-- Logs begin at Tue 2022-10-04 20:58:18 UTC, end at Tue 2022-10-04 23:50:45 UTC. -- Oct 04 21:32:17.860266 n-d-860284-1 systemd[1]: Starting Devstack devstack@n-api.service... Oct 04 21:32:17.870189 n-d-860284-1 devstack@n-api.service[112973]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 04 21:32:17.872231 n-d-860284-1 devstack@n-api.service[112973]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Oct 4 21:32:17 2022] *** Oct 04 21:32:17.872231 n-d-860284-1 devstack@n-api.service[112973]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 04 21:32:17.872231 n-d-860284-1 devstack@n-api.service[112973]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 04 21:32:17.872231 n-d-860284-1 devstack@n-api.service[112973]: nodename: n-d-860284-1 Oct 04 21:32:17.872231 n-d-860284-1 devstack@n-api.service[112973]: machine: x86_64 Oct 04 21:32:17.872231 n-d-860284-1 devstack@n-api.service[112973]: clock source: unix Oct 04 21:32:17.872231 n-d-860284-1 devstack@n-api.service[112973]: pcre jit disabled Oct 04 21:32:17.872231 n-d-860284-1 devstack@n-api.service[112973]: detected number of CPU cores: 4 Oct 04 21:32:17.872231 n-d-860284-1 devstack@n-api.service[112973]: current working directory: / Oct 04 21:32:17.872231 n-d-860284-1 devstack@n-api.service[112973]: detected binary path: /usr/bin/uwsgi-core Oct 04 21:32:17.872231 n-d-860284-1 devstack@n-api.service[112973]: your processes number limit is 47680 Oct 04 21:32:17.873013 n-d-860284-1 devstack@n-api.service[112973]: your memory page size is 4096 bytes Oct 04 21:32:17.873013 n-d-860284-1 devstack@n-api.service[112973]: detected max file descriptor number: 2048 Oct 04 21:32:17.873013 n-d-860284-1 devstack@n-api.service[112973]: lock engine: pthread robust mutexes Oct 04 21:32:17.873013 n-d-860284-1 devstack@n-api.service[112973]: thunder lock: enabled Oct 04 21:32:17.873013 n-d-860284-1 devstack@n-api.service[112973]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 04 21:32:17.873013 n-d-860284-1 devstack@n-api.service[112973]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 04 21:32:17.912444 n-d-860284-1 devstack@n-api.service[112973]: Python main interpreter initialized at 0x55b6477c29c0 Oct 04 21:32:17.912444 n-d-860284-1 devstack@n-api.service[112973]: python threads support enabled Oct 04 21:32:17.912444 n-d-860284-1 devstack@n-api.service[112973]: your server socket listen backlog is limited to 100 connections Oct 04 21:32:17.912444 n-d-860284-1 devstack@n-api.service[112973]: your mercy for graceful operations on workers is 90 seconds Oct 04 21:32:17.913436 n-d-860284-1 devstack@n-api.service[112973]: mapped 403077 bytes (393 KB) for 2 cores Oct 04 21:32:17.913523 n-d-860284-1 devstack@n-api.service[112973]: *** Operational MODE: preforking *** Oct 04 21:32:17.913780 n-d-860284-1 devstack@n-api.service[112973]: *** uWSGI is running in multiple interpreter mode *** Oct 04 21:32:17.913780 n-d-860284-1 devstack@n-api.service[112973]: spawned uWSGI master process (pid: 112973) Oct 04 21:32:17.914057 n-d-860284-1 systemd[1]: Started Devstack devstack@n-api.service. Oct 04 21:32:17.915329 n-d-860284-1 devstack@n-api.service[112973]: spawned uWSGI worker 1 (pid: 112974, cores: 1) Oct 04 21:32:17.915329 n-d-860284-1 devstack@n-api.service[112973]: spawned uWSGI worker 2 (pid: 112975, cores: 1) Oct 04 21:32:17.915329 n-d-860284-1 devstack@n-api.service[112973]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 04 21:32:18.601786 n-d-860284-1 devstack@n-api.service[112975]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 04 21:32:18.610822 n-d-860284-1 devstack@n-api.service[112974]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 04 21:32:19.716726 n-d-860284-1 devstack@n-api.service[112975]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 21:32:19.716726 n-d-860284-1 devstack@n-api.service[112975]: from cryptography.utils import int_from_bytes Oct 04 21:32:19.717330 n-d-860284-1 devstack@n-api.service[112975]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 21:32:19.717330 n-d-860284-1 devstack@n-api.service[112975]: from cryptography.utils import int_from_bytes Oct 04 21:32:19.720244 n-d-860284-1 devstack@n-api.service[112974]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 21:32:19.720244 n-d-860284-1 devstack@n-api.service[112974]: from cryptography.utils import int_from_bytes Oct 04 21:32:19.720689 n-d-860284-1 devstack@n-api.service[112974]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 21:32:19.720689 n-d-860284-1 devstack@n-api.service[112974]: from cryptography.utils import int_from_bytes Oct 04 21:32:22.295560 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 04 21:32:22.296204 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 04 21:32:22.296342 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 04 21:32:22.296710 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 04 21:32:22.296960 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 04 21:32:22.297339 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.297664 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.297976 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.298071 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 04 21:32:22.298489 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.298583 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 04 21:32:22.298669 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.298854 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 04 21:32:22.298943 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.299220 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 04 21:32:22.299324 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.299479 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 04 21:32:22.299566 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.299841 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.299933 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.300100 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.300190 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.300412 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.300500 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.300729 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-860284-1 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.300816 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.301044 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.301138 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.301347 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.301441 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.301653 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.301750 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.301968 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.302071 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.302264 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.302351 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.302606 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.302705 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.302907 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.303050 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.303307 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-860284-1 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.304058 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.304307 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.304624 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.304783 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.304943 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.305092 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.305267 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.305393 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.305577 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.305732 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.305910 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.306039 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.306219 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.306338 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.306685 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.306771 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.306991 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.307086 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.307313 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.307447 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.307620 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.307966 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.308228 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.308360 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-860284-1 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.308546 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.308633 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.308859 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.308955 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.309165 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.309252 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.309476 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.309560 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.309801 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.309900 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.310113 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.310201 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.310484 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.310635 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-860284-1 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.310820 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.310909 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.311123 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.311220 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.311442 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.311536 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.311755 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.311860 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.312071 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.312171 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.312385 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.312472 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.312683 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.312779 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.312990 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.313131 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.313297 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.313402 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.313611 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.313704 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.313911 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.314001 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.314209 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.314296 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.314480 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.314624 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.314786 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.314930 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.315101 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.315243 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.315420 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.315556 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.315736 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.315885 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.315974 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.316193 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.316290 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.316501 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.316591 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.316756 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.316845 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.317068 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.317170 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.317391 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.317479 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.317690 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.317775 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.317994 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.318089 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.318266 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.318353 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.318577 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.318676 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.318908 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.319052 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.319215 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.319319 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.319568 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.319669 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.319878 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.319963 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.320191 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.320275 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.320494 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.320656 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.320802 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.320897 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.321113 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.321208 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.43 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.321423 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.321512 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.43 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.321724 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.321812 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.322041 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.322134 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.322357 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.322481 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.322684 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.322821 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.323000 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.323095 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.323315 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.323488 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.323620 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.323709 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.43 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.323925 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.324011 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.43 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.324226 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.324327 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.324541 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.324629 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.324868 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.324963 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.325170 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.325267 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.325418 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.325506 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.325715 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.325811 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.326017 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.326120 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.326329 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.326446 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.326655 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.326751 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.326959 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.327053 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.327260 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.327355 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.327555 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.327650 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.327857 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.327945 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.328158 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.328246 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.328460 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.328542 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.328761 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.328856 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.329061 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.329156 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.329361 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.329461 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.329659 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.329748 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.329960 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.330058 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.330261 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.330356 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.330585 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.330683 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.330893 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.330978 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.331202 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.331298 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.331502 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.331605 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.331801 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.331900 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.332100 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.332205 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.332401 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.332495 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.332707 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.332803 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.333006 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.333115 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.333306 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.333385 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.333622 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.333699 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.333924 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.334042 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.334223 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.334313 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.334596 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.334820 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.334920 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.335073 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.335214 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.335385 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.335526 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.335702 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.335840 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.336000 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.336166 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.336303 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.336477 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.336616 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.336785 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.336920 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.337104 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.337222 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.337415 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.337542 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.337727 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.337823 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.338047 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.338142 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.338351 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.338472 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.338682 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.338771 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.339003 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.339098 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.339312 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.339400 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.339622 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.339717 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.339929 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.340017 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.340232 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.340322 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.340536 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.340615 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.340839 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.340961 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.341141 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.341229 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.341449 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.341542 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.341751 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.341842 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.342072 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.342191 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.342427 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.342518 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.342749 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.342848 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.343058 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.343157 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.343368 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.343463 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.343676 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.343771 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:32:22.343989 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.344090 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.344313 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.344402 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.344622 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.344727 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.344931 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.345027 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.345246 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.345333 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.345565 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.345658 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.345881 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.345981 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.346206 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.346299 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.347355 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.347442 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.347575 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.347757 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.347931 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.348072 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.348156 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.348429 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.348603 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.349116 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.349359 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.349457 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.349644 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.349738 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.352375 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.352459 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.352527 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.352527 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.352761 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.352761 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.353090 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.353238 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.353442 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.353442 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.353706 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.354077 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.354298 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.354451 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.354574 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.354650 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.354835 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.354983 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.355077 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.355157 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.355226 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.355293 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.355358 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.355433 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.355433 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.355553 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.355626 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.355750 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.355821 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.355897 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.355965 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.356037 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.356103 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.356175 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.356249 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.356317 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.356382 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.356382 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.356499 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.356563 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.356637 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.356704 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.356776 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.356872 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.356939 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.357011 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.357086 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.357160 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.357225 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.357409 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.357508 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.357721 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.357818 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.358028 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.358152 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.358335 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.358487 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.358662 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.358778 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.358967 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.359058 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.359274 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.359369 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.359575 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.359664 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.359891 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.359990 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.360212 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.360301 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.360515 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.360611 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.360832 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.360922 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.361135 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.361221 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.361443 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.361550 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.361750 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.361853 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.362054 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.362150 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.362413 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.362523 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.362688 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.362777 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.362990 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.363091 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.363292 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.363391 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.363611 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.363701 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.363919 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.364042 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.364224 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.364330 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.364543 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.364631 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.364845 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.364948 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.365148 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.365248 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.365457 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.365543 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.366401 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.366688 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.366789 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.366862 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.366969 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.367332 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.367481 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.367573 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.367655 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.367857 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.367948 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.368168 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.368425 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.368524 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.368668 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.368792 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.368883 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.369109 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.369227 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.369411 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.369547 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.369730 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.369819 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.370042 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.370139 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.370339 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.370522 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.370679 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.370778 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.370976 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.371068 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.371278 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.371367 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.371579 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.371685 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.371885 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.371986 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.372184 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.372290 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.372483 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.372591 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.372781 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.372872 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.373080 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.373169 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.373447 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.373541 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.373764 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.373859 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.374065 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.374154 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.374392 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.374573 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.374693 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.374783 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.374992 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.375080 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.375298 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.375399 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.375613 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.375709 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.375922 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.376018 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.376231 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.376334 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.376536 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.376624 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.376848 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.376959 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.377156 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.377274 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.377464 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.377551 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.377771 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.377866 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.378077 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.378165 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.378396 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.378501 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.378706 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.378793 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.379020 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.379116 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.379330 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.379418 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.379646 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.379741 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.379953 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.380043 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.380269 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.380358 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.380575 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.380663 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.380890 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.380980 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.381189 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.381290 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.381645 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.381759 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.381876 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.382099 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.382239 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.382325 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.382538 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.382759 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.382961 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.383050 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.383154 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.383249 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.383465 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.383618 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.383772 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.383862 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.384091 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.384199 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.384386 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.384484 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.384692 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.384846 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.384985 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.385127 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.385299 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.385449 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.385619 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.385755 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.385927 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.386066 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.386242 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.386409 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.386572 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.386725 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.386871 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.387007 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.387206 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.387341 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.387517 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.387649 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.387830 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.387967 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.388148 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.388286 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.388452 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.388599 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.388762 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.388902 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.389075 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.389213 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.389380 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.389519 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.389685 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.389835 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.389995 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.390127 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.390296 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.390457 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.390626 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.390775 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.390919 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.391010 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.391226 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.391313 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.391532 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.391743 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.391887 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.392034 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.392177 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.392269 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.392425 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.392575 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.392729 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.392829 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.393027 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.393117 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.393325 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.393414 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.393633 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.393735 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.393948 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.394037 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.394253 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.394351 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.394596 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.394694 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.394913 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.394999 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.395211 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.395299 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.395516 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.395603 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.395822 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.395909 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.396127 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.396213 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.396427 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.396524 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.396728 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.396831 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.397598 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.397800 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.398004 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.398149 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.398286 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.398459 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.398595 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.398735 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.398872 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.399066 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.399213 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.399457 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.399599 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.399770 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.399909 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.400082 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.400220 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.400391 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.400531 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.400698 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.400835 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.401008 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.401165 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.401319 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.401454 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.401619 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.401756 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.401931 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.402080 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.402238 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.402398 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.402588 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.402702 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.402914 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.403018 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.403229 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.403326 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.403541 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.403628 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.403853 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.404026 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.404157 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.404244 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.404461 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.404555 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.404771 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.404877 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.405077 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.405164 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.405393 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.405655 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.405757 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.405992 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.406086 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.406305 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.406412 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.406647 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.406746 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.406956 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.407051 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.407277 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.407380 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.407591 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.407707 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.407899 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.408006 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.408211 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.408300 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.408515 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.408617 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.408821 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.409090 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.409192 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.409412 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.409503 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.409722 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.409822 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.410026 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.410121 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.410331 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.410450 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.410658 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.410756 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.410965 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.411054 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.411267 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.411361 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.411569 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.411656 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.411870 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.411959 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.412171 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.412276 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.412484 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.412590 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.413370 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.413526 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.413681 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.413975 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.414066 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.414287 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.414397 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.414634 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.414737 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.414944 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.415040 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.415248 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.415344 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.415547 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.415650 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.415849 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.416015 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.416160 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.416292 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.416435 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.416570 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.416741 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.416887 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.417056 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.417202 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.417368 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.417506 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.417695 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.417797 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.418008 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.418201 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.418338 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.418552 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.418684 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.418855 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.419001 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.419156 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.419300 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.419456 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.419597 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.419763 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.419896 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.420068 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.420207 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.420367 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.420512 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.420659 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.420794 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.420971 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.421108 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.421279 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.421428 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.421571 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.421709 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.421873 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.422060 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.422217 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.422473 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.422624 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.422775 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.422993 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.423126 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.423271 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.423405 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.423539 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.423671 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.423812 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.423956 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.424100 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.424245 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.424386 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.424520 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.424653 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.424787 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.424936 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.425083 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.425239 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.425397 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.425549 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.425691 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.425843 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.425982 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.426146 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.426263 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.426474 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.426598 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.426782 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.426904 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.427101 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.427189 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.427413 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.427511 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.427719 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.427814 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.428031 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.428171 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.428365 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.428687 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.428883 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.429024 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.429166 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.429304 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.429440 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.429583 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.429717 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.429862 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.430010 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.430143 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.430276 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.430452 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.430585 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.430720 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.430887 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.431025 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.431204 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.431355 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.431512 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.431649 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.431820 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.431916 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.432091 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.432237 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.432375 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.432514 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.432674 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.433018 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.433226 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.433360 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.433514 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.433648 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.433811 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.433953 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.434134 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.434255 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.434462 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.434579 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.434769 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.434872 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.435072 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.435170 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.435372 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.435460 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.435679 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.435778 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.435986 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.436075 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.436291 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.436386 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.436647 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.436767 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.436901 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.436991 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.437211 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.437301 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.437521 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.437627 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.437832 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.437933 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.438144 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.438242 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.438475 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.438570 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.438790 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.438881 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.439097 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.439217 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.439406 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.439527 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.439705 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.439890 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.440004 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.440199 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.440323 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.440517 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.440629 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.440840 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.440934 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.441156 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.441254 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.441562 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.441675 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.441794 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.441886 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.442102 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.442193 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.442442 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.442536 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.442756 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.442872 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.443621 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.443792 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.443919 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.444010 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.444164 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.444255 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.444352 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.444435 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.444520 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.444601 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.444682 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.444765 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.444930 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.445215 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.445360 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.445460 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.445642 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.445788 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.445929 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.446135 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.446285 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.446450 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.446549 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.446754 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.446851 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.447059 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.447155 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.447360 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.447456 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.447666 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.447755 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.447967 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.448053 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.448275 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.448489 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.448589 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.448929 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.449017 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.449288 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.449375 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.449598 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.449814 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.449909 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.450194 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.450281 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.450526 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.450755 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.450845 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.451139 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.451226 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.451440 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.451661 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.451852 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.452118 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.452214 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.452455 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.452568 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.452761 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.453036 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.453129 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.453349 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.453515 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.453654 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.453959 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.454048 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.454261 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.454356 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.454587 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.454684 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.454885 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.455060 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.455258 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.455366 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.455497 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.455688 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.455813 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.456000 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.456224 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.456319 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.456537 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.456638 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.456839 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.456927 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.457237 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.457323 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.457545 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.457645 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.457855 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.457987 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.458173 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.458453 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.458547 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.458826 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.458923 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.459127 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.459329 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.459975 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.460358 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.460536 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.460687 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.460826 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.460981 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.461293 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.461379 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.461607 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.461756 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.461915 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.462190 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.462291 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.462560 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.462679 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.462872 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.463152 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.463253 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.463587 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.463738 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.463903 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.464051 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.464213 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.464383 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.464532 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.464810 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.464897 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.465131 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.465224 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.465431 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.465529 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.465735 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.465853 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.466038 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.466171 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.466339 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.466506 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.466752 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.466849 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.467059 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.467150 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.467368 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.467456 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.467675 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.467771 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.467980 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.468131 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.468279 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.468585 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.468680 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.468931 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.469019 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.469232 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.469485 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.469574 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.469846 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.469966 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.470163 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.470487 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.470581 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.470800 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.470947 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.471123 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.471404 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.471494 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.471702 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.471860 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.472005 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.472306 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.472393 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.472643 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.472825 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.472944 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.473262 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.473440 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.473586 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.473781 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.473906 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.474104 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.474217 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.474463 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.474578 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.474804 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.474904 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.475187 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.475840 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.476004 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.476102 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.476330 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.476450 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.476638 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.476730 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.476954 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.477043 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.477271 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.477360 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.477579 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.477682 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.477881 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.477970 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.478182 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.478325 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.478512 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.478788 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.478927 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.479100 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.479239 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.479396 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.479673 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.479807 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.479998 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.480172 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.480303 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.480601 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.480748 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.480906 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.481115 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.481256 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.481494 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.481640 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.481779 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.482004 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.482149 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.482425 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.482580 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.482756 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.482994 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.483156 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.483369 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.483471 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.483682 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.483781 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.483998 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.484088 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.484311 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.484400 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.484631 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.484760 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.484935 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.485023 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.485246 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.485333 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.485558 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.485660 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.485868 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.485978 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.486180 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.486290 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.486517 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.486610 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.486838 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.486927 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.487240 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.487390 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.487572 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.487715 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.487889 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.488026 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.488213 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.488337 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.488544 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.488649 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.488856 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.488956 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.489164 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.489264 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.489479 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.489577 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.489791 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.489881 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.490100 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.490203 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.490427 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.490522 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.490784 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.490951 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.491086 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.491206 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.491384 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.491482 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.491693 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.491792 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.492017 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.492107 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.492323 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.492412 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.492633 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.492722 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.492951 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.493042 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.493267 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.493438 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.493579 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.493727 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.493865 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.494030 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.494194 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.494342 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.494532 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.494638 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.494845 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.494942 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.495155 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.495251 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.495463 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.495561 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.495774 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.495870 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.496090 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.496247 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.496389 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.496560 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.496713 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.496845 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.496993 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.497129 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.497275 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.497421 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.497603 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.497774 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.497906 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.498044 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.498219 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.498389 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.498558 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.498697 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.498869 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.498962 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.499182 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.499423 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.499696 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.499785 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.500008 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.500108 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.500336 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.500434 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.500657 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.500746 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.500975 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.501074 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.501291 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.501386 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.501605 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.501704 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.501919 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.502088 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.502219 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.502316 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.502555 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.502647 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.502864 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.502976 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.503170 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.503261 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.503474 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.503576 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.503789 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.503881 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.504096 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.504186 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.504398 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.504486 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.504713 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.504805 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.505017 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.505114 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.505399 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.505551 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.505717 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.505901 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.506028 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.506219 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.506423 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.506596 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.506760 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.506954 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.507143 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.507237 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.507389 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.507528 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.507703 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.507851 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.508022 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.508156 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.508341 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.508460 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.508656 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.508774 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.508972 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.509064 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.509288 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.509379 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.509605 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.509693 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.509931 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.510022 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.510248 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.510338 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.510586 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.510761 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.510894 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.510983 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.511197 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.511295 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.511520 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.511607 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.511821 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.512045 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.512136 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.512365 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.512455 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.512699 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.512787 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.512998 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.513087 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.513298 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.513386 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.513598 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.513689 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.513898 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.513988 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.514206 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.514297 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.514531 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.514622 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.514839 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.514930 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.515138 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.515226 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.515446 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.515543 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.515757 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.515845 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.516079 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.516167 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.516384 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.516515 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.516686 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.516795 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.516994 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.517092 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.517292 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.517400 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.517604 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.517835 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.517933 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.518186 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.518330 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.518542 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.518642 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.518851 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.518952 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.519255 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.519356 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.519487 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.519584 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.519792 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.520010 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.520102 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.520338 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.520428 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.520654 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.520741 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.520981 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.521069 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.521306 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.521396 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.521607 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.521698 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.521912 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.522568 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.522817 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.522973 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.523126 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.523285 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.523428 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.523587 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.523728 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.523893 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.524069 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.524217 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.524354 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.524513 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.524652 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.524819 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.524968 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.525129 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.525269 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.525439 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.525578 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.525754 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.525896 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.526063 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.526216 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.526398 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.526487 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.526685 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.526775 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.526988 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.527094 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.527292 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.527380 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.527603 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.527699 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.527916 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.528015 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.528222 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.528325 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.528536 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.528625 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.528845 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.528943 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.529159 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.529248 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.529467 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.529568 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.529774 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.529864 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.530078 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.530167 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.530447 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.530540 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.530711 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.530808 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.531023 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.531111 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.531331 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.531419 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.531633 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.531732 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.531947 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.532296 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.532391 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.532614 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.532703 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.532933 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.533150 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.533240 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.533488 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.533586 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.533815 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.533925 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.534150 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.534249 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.534477 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.534581 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.534798 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.534896 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.535105 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.535203 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.535410 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.535507 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.535737 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.535827 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.536051 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.536140 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.536366 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.536457 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.536673 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.536765 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.536974 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.537064 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.537275 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.537366 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.537647 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.538247 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.538555 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.538657 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.538917 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.539009 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.539209 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.539342 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.539507 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.539610 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.539817 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.539914 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.540119 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.540208 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.540422 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.540524 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.540724 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.540814 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.541024 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.541113 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.541330 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.541429 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.541709 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.541814 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.541928 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.542019 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.542228 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.542326 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.542554 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.542645 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.542854 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.542942 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.543154 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.543253 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.543458 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.543560 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.543757 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.543860 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.544060 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.544166 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.544357 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.544446 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.544656 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.544745 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.544951 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.545043 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.545274 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.545600 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.545718 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.545910 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.546044 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.546226 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.546389 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.546559 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.546721 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.546881 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.547039 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.547188 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.547375 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.547507 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.547705 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.547809 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.548022 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.548111 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.548350 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.548439 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.548667 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.548765 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.549001 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.549090 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.549310 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.549436 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.549619 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.549716 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.549923 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.550012 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.550227 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.550315 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.550558 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.550650 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.550879 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.550968 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.551200 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.551288 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.551500 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.551590 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.551818 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.551915 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.552124 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.552221 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.552432 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.552528 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.552738 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.552834 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.553046 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.553149 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.553392 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.553534 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.553685 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.553837 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.553989 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.554107 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.554293 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.554481 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.554620 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.554712 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.554923 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.555015 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.555227 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.555315 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.555529 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.555618 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.555833 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.555921 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.556142 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.556232 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.556447 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.556534 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.556755 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.556908 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.557049 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.557197 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.557360 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.557500 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.557668 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.558070 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.558240 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.558406 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.558598 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.558703 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.558904 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.559001 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.559235 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.559324 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.559556 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.559653 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.559865 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.559957 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.560173 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.560263 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.560475 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.560573 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.560713 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 04 21:32:22.560812 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.561104 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.561424 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.561740 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.562079 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.562558 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.562723 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.563038 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.563352 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.563693 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.563976 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.564323 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.564636 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.564988 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.565271 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.565590 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.565912 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.566230 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.566566 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.566898 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.567218 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.567531 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.567842 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.568154 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.568469 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.568789 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.569130 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.569445 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.569760 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.570075 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.570423 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.570754 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.571068 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.571394 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.571721 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.572070 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.572385 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.572737 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.573069 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.573389 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.573704 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.574013 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:32:22.574258 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 04 21:32:22.714694 n-d-860284-1 devstack@n-api.service[112975]: INFO dbcounter [None req-64a5d8d6-a75b-44ee-a810-33a1b3a911e0 None None] Registered counter for database nova_api Oct 04 21:32:22.730613 n-d-860284-1 devstack@n-api.service[112974]: INFO dbcounter [None req-332055e8-4b88-452f-8a46-d4ccd50c859d None None] Registered counter for database nova_api Oct 04 21:32:22.736718 n-d-860284-1 devstack@n-api.service[112975]: DEBUG oslo_db.sqlalchemy.engines [None req-64a5d8d6-a75b-44ee-a810-33a1b3a911e0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112975) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 21:32:22.743405 n-d-860284-1 devstack@n-api.service[112975]: DEBUG dbcounter [-] [112975] Writer thread running {{(pid=112975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 21:32:22.752357 n-d-860284-1 devstack@n-api.service[112974]: DEBUG oslo_db.sqlalchemy.engines [None req-332055e8-4b88-452f-8a46-d4ccd50c859d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112974) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 21:32:22.760146 n-d-860284-1 devstack@n-api.service[112974]: DEBUG dbcounter [-] [112974] Writer thread running {{(pid=112974) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 21:32:22.800382 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.context [None req-64a5d8d6-a75b-44ee-a810-33a1b3a911e0 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1297bf18-d456-4d7b-91a9-0a07f1cafd2a(cell1) {{(pid=112975) load_cells /opt/stack/nova/nova/context.py:464}} Oct 04 21:32:22.804296 n-d-860284-1 devstack@n-api.service[112975]: DEBUG oslo_concurrency.lockutils [None req-64a5d8d6-a75b-44ee-a810-33a1b3a911e0 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:22.804763 n-d-860284-1 devstack@n-api.service[112975]: DEBUG oslo_concurrency.lockutils [None req-64a5d8d6-a75b-44ee-a810-33a1b3a911e0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:22.806313 n-d-860284-1 devstack@n-api.service[112975]: DEBUG oslo_concurrency.lockutils [None req-64a5d8d6-a75b-44ee-a810-33a1b3a911e0 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:22.807044 n-d-860284-1 devstack@n-api.service[112975]: DEBUG oslo_concurrency.lockutils [None req-64a5d8d6-a75b-44ee-a810-33a1b3a911e0 None None] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:22.807483 n-d-860284-1 devstack@n-api.service[112975]: DEBUG oslo_concurrency.lockutils [None req-64a5d8d6-a75b-44ee-a810-33a1b3a911e0 None None] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:22.809681 n-d-860284-1 devstack@n-api.service[112975]: DEBUG oslo_concurrency.lockutils [None req-64a5d8d6-a75b-44ee-a810-33a1b3a911e0 None None] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:22.811696 n-d-860284-1 devstack@n-api.service[112975]: INFO dbcounter [None req-64a5d8d6-a75b-44ee-a810-33a1b3a911e0 None None] Registered counter for database nova_cell0 Oct 04 21:32:22.815999 n-d-860284-1 devstack@n-api.service[112975]: INFO dbcounter [None req-64a5d8d6-a75b-44ee-a810-33a1b3a911e0 None None] Registered counter for database nova_cell1 Oct 04 21:32:22.819819 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.context [None req-332055e8-4b88-452f-8a46-d4ccd50c859d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1297bf18-d456-4d7b-91a9-0a07f1cafd2a(cell1) {{(pid=112974) load_cells /opt/stack/nova/nova/context.py:464}} Oct 04 21:32:22.823941 n-d-860284-1 devstack@n-api.service[112975]: DEBUG oslo_db.sqlalchemy.engines [None req-64a5d8d6-a75b-44ee-a810-33a1b3a911e0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112975) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 21:32:22.824143 n-d-860284-1 devstack@n-api.service[112974]: DEBUG oslo_concurrency.lockutils [None req-332055e8-4b88-452f-8a46-d4ccd50c859d None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:22.824522 n-d-860284-1 devstack@n-api.service[112974]: DEBUG oslo_concurrency.lockutils [None req-332055e8-4b88-452f-8a46-d4ccd50c859d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:22.825289 n-d-860284-1 devstack@n-api.service[112975]: DEBUG oslo_db.sqlalchemy.engines [None req-64a5d8d6-a75b-44ee-a810-33a1b3a911e0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112975) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 21:32:22.826119 n-d-860284-1 devstack@n-api.service[112974]: DEBUG oslo_concurrency.lockutils [None req-332055e8-4b88-452f-8a46-d4ccd50c859d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:22.826894 n-d-860284-1 devstack@n-api.service[112974]: DEBUG oslo_concurrency.lockutils [None req-332055e8-4b88-452f-8a46-d4ccd50c859d None None] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:22.827339 n-d-860284-1 devstack@n-api.service[112974]: DEBUG oslo_concurrency.lockutils [None req-332055e8-4b88-452f-8a46-d4ccd50c859d None None] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:22.829325 n-d-860284-1 devstack@n-api.service[112974]: DEBUG oslo_concurrency.lockutils [None req-332055e8-4b88-452f-8a46-d4ccd50c859d None None] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:22.831405 n-d-860284-1 devstack@n-api.service[112974]: INFO dbcounter [None req-332055e8-4b88-452f-8a46-d4ccd50c859d None None] Registered counter for database nova_cell0 Oct 04 21:32:22.832718 n-d-860284-1 devstack@n-api.service[112975]: DEBUG dbcounter [-] [112975] Writer thread running {{(pid=112975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 21:32:22.833051 n-d-860284-1 devstack@n-api.service[112975]: DEBUG dbcounter [-] [112975] Writer thread running {{(pid=112975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 21:32:22.836552 n-d-860284-1 devstack@n-api.service[112974]: INFO dbcounter [None req-332055e8-4b88-452f-8a46-d4ccd50c859d None None] Registered counter for database nova_cell1 Oct 04 21:32:22.845722 n-d-860284-1 devstack@n-api.service[112974]: DEBUG oslo_db.sqlalchemy.engines [None req-332055e8-4b88-452f-8a46-d4ccd50c859d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112974) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 21:32:22.847586 n-d-860284-1 devstack@n-api.service[112974]: DEBUG oslo_db.sqlalchemy.engines [None req-332055e8-4b88-452f-8a46-d4ccd50c859d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112974) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 21:32:22.853345 n-d-860284-1 devstack@n-api.service[112974]: DEBUG dbcounter [-] [112974] Writer thread running {{(pid=112974) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 21:32:22.856133 n-d-860284-1 devstack@n-api.service[112974]: DEBUG dbcounter [-] [112974] Writer thread running {{(pid=112974) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 21:32:22.983542 n-d-860284-1 devstack@n-api.service[112975]: INFO dbcounter [None req-64a5d8d6-a75b-44ee-a810-33a1b3a911e0 None None] Registered counter for database nova_cell0 Oct 04 21:32:22.990294 n-d-860284-1 devstack@n-api.service[112975]: DEBUG oslo_db.sqlalchemy.engines [None req-64a5d8d6-a75b-44ee-a810-33a1b3a911e0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112975) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 21:32:22.994695 n-d-860284-1 devstack@n-api.service[112975]: DEBUG dbcounter [-] [112975] Writer thread running {{(pid=112975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 21:32:23.006178 n-d-860284-1 devstack@n-api.service[112974]: INFO dbcounter [None req-332055e8-4b88-452f-8a46-d4ccd50c859d None None] Registered counter for database nova_cell0 Oct 04 21:32:23.015352 n-d-860284-1 devstack@n-api.service[112974]: DEBUG oslo_db.sqlalchemy.engines [None req-332055e8-4b88-452f-8a46-d4ccd50c859d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112974) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 21:32:23.021147 n-d-860284-1 devstack@n-api.service[112974]: DEBUG dbcounter [-] [112974] Writer thread running {{(pid=112974) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 21:32:23.335548 n-d-860284-1 devstack@n-api.service[112975]: WARNING keystonemiddleware.auth_token [None req-64a5d8d6-a75b-44ee-a810-33a1b3a911e0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 04 21:32:23.342930 n-d-860284-1 devstack@n-api.service[112975]: WARNING keystonemiddleware.auth_token [None req-64a5d8d6-a75b-44ee-a810-33a1b3a911e0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 04 21:32:23.351924 n-d-860284-1 devstack@n-api.service[112974]: WARNING keystonemiddleware.auth_token [None req-332055e8-4b88-452f-8a46-d4ccd50c859d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 04 21:32:23.359270 n-d-860284-1 devstack@n-api.service[112974]: WARNING keystonemiddleware.auth_token [None req-332055e8-4b88-452f-8a46-d4ccd50c859d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 04 21:32:23.707814 n-d-860284-1 devstack@n-api.service[112974]: WARNING keystonemiddleware.auth_token [None req-332055e8-4b88-452f-8a46-d4ccd50c859d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 04 21:32:23.713904 n-d-860284-1 devstack@n-api.service[112974]: WARNING keystonemiddleware.auth_token [None req-332055e8-4b88-452f-8a46-d4ccd50c859d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 04 21:32:23.719319 n-d-860284-1 devstack@n-api.service[112974]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55b6477c29c0 pid: 112974 (default app) Oct 04 21:32:23.721173 n-d-860284-1 devstack@n-api.service[112975]: WARNING keystonemiddleware.auth_token [None req-64a5d8d6-a75b-44ee-a810-33a1b3a911e0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 04 21:32:23.721423 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi [None req-332055e8-4b88-452f-8a46-d4ccd50c859d None None] Calling method '>' {{(pid=112974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:23.722660 n-d-860284-1 devstack@n-api.service[112974]: INFO nova.api.openstack.requestlog [None req-332055e8-4b88-452f-8a46-d4ccd50c859d None None] 10.222.0.43 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001769 Oct 04 21:32:23.723079 n-d-860284-1 devstack@n-api.service[112974]: [pid: 112974|app: 0|req: 1/1] 10.222.0.43 () {50 vars in 788 bytes} [Tue Oct 4 21:32:23 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:32:23.733657 n-d-860284-1 devstack@n-api.service[112975]: WARNING keystonemiddleware.auth_token [None req-64a5d8d6-a75b-44ee-a810-33a1b3a911e0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 04 21:32:23.744280 n-d-860284-1 devstack@n-api.service[112975]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55b6477c29c0 pid: 112975 (default app) Oct 04 21:33:48.940109 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi [None req-332055e8-4b88-452f-8a46-d4ccd50c859d None None] Calling method '>' {{(pid=112974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:33:48.941480 n-d-860284-1 devstack@n-api.service[112974]: INFO nova.api.openstack.requestlog [None req-332055e8-4b88-452f-8a46-d4ccd50c859d None None] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001586 Oct 04 21:33:48.942006 n-d-860284-1 devstack@n-api.service[112974]: [pid: 112974|app: 0|req: 2/2] 10.222.0.43 () {54 vars in 931 bytes} [Tue Oct 4 21:33:48 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:33:48.958458 n-d-860284-1 devstack@n-api.service[112975]: DEBUG dbcounter [-] [112975] Writing DB stats nova_api:SELECT=3 {{(pid=112975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:33:48.959552 n-d-860284-1 devstack@n-api.service[112975]: DEBUG dbcounter [-] [112975] Writing DB stats nova_cell1:SELECT=3 {{(pid=112975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:33:48.960822 n-d-860284-1 devstack@n-api.service[112975]: DEBUG dbcounter [-] [112975] Writing DB stats nova_cell0:SELECT=3 {{(pid=112975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:33:48.961835 n-d-860284-1 devstack@n-api.service[112975]: DEBUG dbcounter [-] [112975] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=112975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:33:49.845964 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi [None req-50eb0d6e-251c-4752-a317-f35135b22abc admin admin] Calling method '>' {{(pid=112975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:33:49.880846 n-d-860284-1 devstack@n-api.service[112975]: INFO nova.api.openstack.requestlog [None req-50eb0d6e-251c-4752-a317-f35135b22abc admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.929862 Oct 04 21:33:49.881853 n-d-860284-1 devstack@n-api.service[112975]: [pid: 112975|app: 0|req: 1/3] 10.222.0.43 () {60 vars in 1292 bytes} [Tue Oct 4 21:33:48 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:33:52.563184 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi [None req-332055e8-4b88-452f-8a46-d4ccd50c859d None None] Calling method '>' {{(pid=112974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:33:52.564205 n-d-860284-1 devstack@n-api.service[112974]: INFO nova.api.openstack.requestlog [None req-332055e8-4b88-452f-8a46-d4ccd50c859d None None] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Oct 04 21:33:52.564859 n-d-860284-1 devstack@n-api.service[112974]: [pid: 112974|app: 0|req: 3/4] 10.222.0.43 () {54 vars in 931 bytes} [Tue Oct 4 21:33:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:33:53.017162 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi [None req-e0f444b5-7639-4595-afa9-206cb560b598 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "cirros256", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "ram": 256, "os-flavor-access:is_public": true, "disk": 1, "rxtx_factor": 1.0, "id": "c1", "swap": 0}} {{(pid=112975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:33:53.069924 n-d-860284-1 devstack@n-api.service[112975]: INFO nova.api.openstack.requestlog [None req-e0f444b5-7639-4595-afa9-206cb560b598 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.498349 Oct 04 21:33:53.070550 n-d-860284-1 devstack@n-api.service[112975]: [pid: 112975|app: 0|req: 2/5] 10.222.0.43 () {64 vars in 1283 bytes} [Tue Oct 4 21:33:52 2022] POST /compute/v2.1/flavors => generated 407 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 21:33:53.084265 n-d-860284-1 devstack@n-api.service[112974]: DEBUG dbcounter [-] [112974] Writing DB stats nova_api:SELECT=3 {{(pid=112974) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:33:53.085144 n-d-860284-1 devstack@n-api.service[112974]: DEBUG dbcounter [-] [112974] Writing DB stats nova_cell1:SELECT=3 {{(pid=112974) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:33:53.086063 n-d-860284-1 devstack@n-api.service[112974]: DEBUG dbcounter [-] [112974] Writing DB stats nova_cell0:SELECT=3 {{(pid=112974) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:33:53.086850 n-d-860284-1 devstack@n-api.service[112974]: DEBUG dbcounter [-] [112974] Writing DB stats nova_cell0:SELECT=3 {{(pid=112974) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:33:53.302942 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi [None req-3682be6a-4d3b-47fa-9b76-ba0777fdede0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:33:53.392761 n-d-860284-1 devstack@n-api.service[112974]: INFO nova.api.openstack.requestlog [None req-3682be6a-4d3b-47fa-9b76-ba0777fdede0 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.313597 Oct 04 21:33:53.394549 n-d-860284-1 devstack@n-api.service[112974]: [pid: 112974|app: 0|req: 4/6] 10.222.0.43 () {64 vars in 1336 bytes} [Tue Oct 4 21:33:53 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:33:56.143220 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi [None req-e0f444b5-7639-4595-afa9-206cb560b598 admin admin] Calling method '>' {{(pid=112975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:33:56.144947 n-d-860284-1 devstack@n-api.service[112975]: INFO nova.api.openstack.requestlog [None req-e0f444b5-7639-4595-afa9-206cb560b598 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002172 Oct 04 21:33:56.145351 n-d-860284-1 devstack@n-api.service[112975]: [pid: 112975|app: 0|req: 3/7] 10.222.0.43 () {54 vars in 931 bytes} [Tue Oct 4 21:33:56 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:33:57.024469 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi [None req-cbb17efc-110e-4497-990f-0e75b9264972 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "ram": 512, "disk": 5, "os-flavor-access:is_public": true, "name": "ds512M", "id": "d1"}} {{(pid=112974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:33:57.076937 n-d-860284-1 devstack@n-api.service[112974]: INFO nova.api.openstack.requestlog [None req-cbb17efc-110e-4497-990f-0e75b9264972 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.925208 Oct 04 21:33:57.077914 n-d-860284-1 devstack@n-api.service[112974]: [pid: 112974|app: 0|req: 5/8] 10.222.0.43 () {64 vars in 1283 bytes} [Tue Oct 4 21:33:56 2022] POST /compute/v2.1/flavors => generated 404 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 21:33:57.092836 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi [None req-908c3de4-6283-4cfe-8b1a-965038f5ce18 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:33:57.182280 n-d-860284-1 devstack@n-api.service[112975]: INFO nova.api.openstack.requestlog [None req-908c3de4-6283-4cfe-8b1a-965038f5ce18 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.094187 Oct 04 21:33:57.183325 n-d-860284-1 devstack@n-api.service[112975]: [pid: 112975|app: 0|req: 4/9] 10.222.0.43 () {64 vars in 1336 bytes} [Tue Oct 4 21:33:57 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:34:00.164486 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi [None req-cbb17efc-110e-4497-990f-0e75b9264972 admin admin] Calling method '>' {{(pid=112974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:00.165577 n-d-860284-1 devstack@n-api.service[112974]: INFO nova.api.openstack.requestlog [None req-cbb17efc-110e-4497-990f-0e75b9264972 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001533 Oct 04 21:34:00.180235 n-d-860284-1 devstack@n-api.service[112974]: [pid: 112974|app: 0|req: 6/10] 10.222.0.43 () {54 vars in 931 bytes} [Tue Oct 4 21:34:00 2022] GET /compute/v2.1 => generated 388 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:34:00.663651 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi [None req-1de0d37e-7f58-4f42-a028-b2543f1049e3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "d2", "swap": 0, "name": "ds1G", "vcpus": 1, "ram": 1024, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 10}} {{(pid=112975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:34:00.684271 n-d-860284-1 devstack@n-api.service[112975]: INFO nova.api.openstack.requestlog [None req-1de0d37e-7f58-4f42-a028-b2543f1049e3 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.507737 Oct 04 21:34:00.685328 n-d-860284-1 devstack@n-api.service[112975]: [pid: 112975|app: 0|req: 5/11] 10.222.0.43 () {64 vars in 1283 bytes} [Tue Oct 4 21:34:00 2022] POST /compute/v2.1/flavors => generated 404 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:34:00.697756 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi [None req-47ab0be6-8957-4934-9da6-893ef110cfb3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:34:00.728100 n-d-860284-1 devstack@n-api.service[112974]: INFO nova.api.openstack.requestlog [None req-47ab0be6-8957-4934-9da6-893ef110cfb3 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034098 Oct 04 21:34:00.728958 n-d-860284-1 devstack@n-api.service[112974]: [pid: 112974|app: 0|req: 7/12] 10.222.0.43 () {64 vars in 1336 bytes} [Tue Oct 4 21:34:00 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:34:03.388529 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi [None req-1de0d37e-7f58-4f42-a028-b2543f1049e3 admin admin] Calling method '>' {{(pid=112975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:03.389560 n-d-860284-1 devstack@n-api.service[112975]: INFO nova.api.openstack.requestlog [None req-1de0d37e-7f58-4f42-a028-b2543f1049e3 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 Oct 04 21:34:03.389964 n-d-860284-1 devstack@n-api.service[112975]: [pid: 112975|app: 0|req: 6/13] 10.222.0.43 () {54 vars in 931 bytes} [Tue Oct 4 21:34:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:34:03.869211 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi [None req-2509dfdf-bc62-4797-b274-abc3642880be admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "swap": 0, "disk": 10, "ram": 2048, "os-flavor-access:is_public": true, "name": "ds2G", "id": "d3", "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=112974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:34:03.891825 n-d-860284-1 devstack@n-api.service[112974]: INFO nova.api.openstack.requestlog [None req-2509dfdf-bc62-4797-b274-abc3642880be admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.494920 Oct 04 21:34:03.892566 n-d-860284-1 devstack@n-api.service[112974]: [pid: 112974|app: 0|req: 8/14] 10.222.0.43 () {64 vars in 1283 bytes} [Tue Oct 4 21:34:03 2022] POST /compute/v2.1/flavors => generated 404 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:34:03.909064 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi [None req-e50cadd4-aa99-4ead-8ff7-42b1ef7077c2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:34:03.950930 n-d-860284-1 devstack@n-api.service[112975]: INFO nova.api.openstack.requestlog [None req-e50cadd4-aa99-4ead-8ff7-42b1ef7077c2 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.049226 Oct 04 21:34:03.952010 n-d-860284-1 devstack@n-api.service[112975]: [pid: 112975|app: 0|req: 7/15] 10.222.0.43 () {64 vars in 1336 bytes} [Tue Oct 4 21:34:03 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:34:06.711254 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi [None req-2509dfdf-bc62-4797-b274-abc3642880be admin admin] Calling method '>' {{(pid=112974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:06.712974 n-d-860284-1 devstack@n-api.service[112974]: INFO nova.api.openstack.requestlog [None req-2509dfdf-bc62-4797-b274-abc3642880be admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002277 Oct 04 21:34:06.719276 n-d-860284-1 devstack@n-api.service[112974]: [pid: 112974|app: 0|req: 9/16] 10.222.0.43 () {54 vars in 931 bytes} [Tue Oct 4 21:34:06 2022] GET /compute/v2.1 => generated 388 bytes in 9 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:34:07.233915 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi [None req-16c03c09-fe21-497b-a895-b6cc9a296fd8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "disk": 20, "vcpus": 4, "id": "d4", "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "ds4G"}} {{(pid=112975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:34:07.259432 n-d-860284-1 devstack@n-api.service[112975]: INFO nova.api.openstack.requestlog [None req-16c03c09-fe21-497b-a895-b6cc9a296fd8 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.538883 Oct 04 21:34:07.261346 n-d-860284-1 devstack@n-api.service[112975]: [pid: 112975|app: 0|req: 8/17] 10.222.0.43 () {64 vars in 1283 bytes} [Tue Oct 4 21:34:06 2022] POST /compute/v2.1/flavors => generated 404 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:34:07.274116 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi [None req-bfe7bf8b-66fe-4a7c-8d71-a25b7281454a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:34:07.308038 n-d-860284-1 devstack@n-api.service[112974]: INFO nova.api.openstack.requestlog [None req-bfe7bf8b-66fe-4a7c-8d71-a25b7281454a admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037435 Oct 04 21:34:07.323635 n-d-860284-1 devstack@n-api.service[112974]: [pid: 112974|app: 0|req: 10/18] 10.222.0.43 () {64 vars in 1336 bytes} [Tue Oct 4 21:34:07 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:34:10.145653 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi [None req-16c03c09-fe21-497b-a895-b6cc9a296fd8 admin admin] Calling method '>' {{(pid=112975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:10.146972 n-d-860284-1 devstack@n-api.service[112975]: INFO nova.api.openstack.requestlog [None req-16c03c09-fe21-497b-a895-b6cc9a296fd8 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001622 Oct 04 21:34:10.146972 n-d-860284-1 devstack@n-api.service[112975]: [pid: 112975|app: 0|req: 9/19] 10.222.0.43 () {54 vars in 931 bytes} [Tue Oct 4 21:34:10 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:34:10.768539 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi [None req-6a83da7d-8be3-4699-9271-31735da9dd5e admin admin] Calling method '>' {{(pid=112974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:10.793282 n-d-860284-1 devstack@n-api.service[112974]: INFO nova.api.openstack.requestlog [None req-6a83da7d-8be3-4699-9271-31735da9dd5e admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.640502 Oct 04 21:34:10.793802 n-d-860284-1 devstack@n-api.service[112974]: [pid: 112974|app: 0|req: 11/20] 10.222.0.43 () {60 vars in 1292 bytes} [Tue Oct 4 21:34:10 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:34:13.455330 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi [None req-16c03c09-fe21-497b-a895-b6cc9a296fd8 admin admin] Calling method '>' {{(pid=112975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:13.456351 n-d-860284-1 devstack@n-api.service[112975]: INFO nova.api.openstack.requestlog [None req-16c03c09-fe21-497b-a895-b6cc9a296fd8 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001481 Oct 04 21:34:13.456784 n-d-860284-1 devstack@n-api.service[112975]: [pid: 112975|app: 0|req: 10/21] 10.222.0.43 () {54 vars in 931 bytes} [Tue Oct 4 21:34:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:34:13.936474 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi [None req-02428961-1249-4f8f-9b55-c9c4352feeb1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "disk": 1, "os-flavor-access:is_public": true, "name": "m1.tiny", "id": "1"}} {{(pid=112974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:34:13.960493 n-d-860284-1 devstack@n-api.service[112974]: INFO nova.api.openstack.requestlog [None req-02428961-1249-4f8f-9b55-c9c4352feeb1 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.496755 Oct 04 21:34:13.961035 n-d-860284-1 devstack@n-api.service[112974]: [pid: 112974|app: 0|req: 12/22] 10.222.0.43 () {64 vars in 1283 bytes} [Tue Oct 4 21:34:13 2022] POST /compute/v2.1/flavors => generated 402 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:34:13.974128 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi [None req-8ad80128-49f1-4ce6-9e77-9d718dc75232 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:34:14.007322 n-d-860284-1 devstack@n-api.service[112975]: INFO nova.api.openstack.requestlog [None req-8ad80128-49f1-4ce6-9e77-9d718dc75232 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037325 Oct 04 21:34:14.008074 n-d-860284-1 devstack@n-api.service[112975]: [pid: 112975|app: 0|req: 11/23] 10.222.0.43 () {64 vars in 1333 bytes} [Tue Oct 4 21:34:13 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:34:16.625716 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi [None req-02428961-1249-4f8f-9b55-c9c4352feeb1 admin admin] Calling method '>' {{(pid=112974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:16.627432 n-d-860284-1 devstack@n-api.service[112974]: INFO nova.api.openstack.requestlog [None req-02428961-1249-4f8f-9b55-c9c4352feeb1 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002212 Oct 04 21:34:16.628009 n-d-860284-1 devstack@n-api.service[112974]: [pid: 112974|app: 0|req: 13/24] 10.222.0.43 () {54 vars in 931 bytes} [Tue Oct 4 21:34:16 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:34:17.061829 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi [None req-36c0f175-32d3-4b47-a7c7-407ae5cadaf3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "id": "2", "ram": 2048, "os-flavor-access:is_public": true, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "name": "m1.small", "rxtx_factor": 1.0}} {{(pid=112975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:34:17.084945 n-d-860284-1 devstack@n-api.service[112975]: INFO nova.api.openstack.requestlog [None req-36c0f175-32d3-4b47-a7c7-407ae5cadaf3 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.449342 Oct 04 21:34:17.085683 n-d-860284-1 devstack@n-api.service[112975]: [pid: 112975|app: 0|req: 12/25] 10.222.0.43 () {64 vars in 1283 bytes} [Tue Oct 4 21:34:16 2022] POST /compute/v2.1/flavors => generated 405 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:34:17.098163 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi [None req-ade47fbc-24cf-4c27-ad3c-067df8cb869a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:34:17.125451 n-d-860284-1 devstack@n-api.service[112974]: INFO nova.api.openstack.requestlog [None req-ade47fbc-24cf-4c27-ad3c-067df8cb869a admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031210 Oct 04 21:34:17.126392 n-d-860284-1 devstack@n-api.service[112974]: [pid: 112974|app: 0|req: 14/26] 10.222.0.43 () {64 vars in 1333 bytes} [Tue Oct 4 21:34:17 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:34:19.831204 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi [None req-36c0f175-32d3-4b47-a7c7-407ae5cadaf3 admin admin] Calling method '>' {{(pid=112975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:19.833209 n-d-860284-1 devstack@n-api.service[112975]: INFO nova.api.openstack.requestlog [None req-36c0f175-32d3-4b47-a7c7-407ae5cadaf3 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001830 Oct 04 21:34:19.833826 n-d-860284-1 devstack@n-api.service[112975]: [pid: 112975|app: 0|req: 13/27] 10.222.0.43 () {54 vars in 931 bytes} [Tue Oct 4 21:34:19 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:34:20.224026 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi [None req-6ecb1a2d-8304-4f3e-8b75-a9ff567574b7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 40, "name": "m1.medium", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 4096, "vcpus": 2, "swap": 0, "id": "3"}} {{(pid=112974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:34:20.247911 n-d-860284-1 devstack@n-api.service[112974]: INFO nova.api.openstack.requestlog [None req-6ecb1a2d-8304-4f3e-8b75-a9ff567574b7 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.407103 Oct 04 21:34:20.248464 n-d-860284-1 devstack@n-api.service[112974]: [pid: 112974|app: 0|req: 15/28] 10.222.0.43 () {64 vars in 1283 bytes} [Tue Oct 4 21:34:19 2022] POST /compute/v2.1/flavors => generated 406 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:34:20.260592 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi [None req-ef154973-8780-4015-ad62-638c873413fd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:34:20.265321 n-d-860284-1 devstack@n-api.service[112975]: DEBUG dbcounter [-] [112975] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=112975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:34:20.289731 n-d-860284-1 devstack@n-api.service[112975]: INFO nova.api.openstack.requestlog [None req-ef154973-8780-4015-ad62-638c873413fd admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032888 Oct 04 21:34:20.290322 n-d-860284-1 devstack@n-api.service[112975]: [pid: 112975|app: 0|req: 14/29] 10.222.0.43 () {64 vars in 1333 bytes} [Tue Oct 4 21:34:20 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:34:23.066929 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi [None req-6ecb1a2d-8304-4f3e-8b75-a9ff567574b7 admin admin] Calling method '>' {{(pid=112974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:23.068586 n-d-860284-1 devstack@n-api.service[112974]: INFO nova.api.openstack.requestlog [None req-6ecb1a2d-8304-4f3e-8b75-a9ff567574b7 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002133 Oct 04 21:34:23.068995 n-d-860284-1 devstack@n-api.service[112974]: [pid: 112974|app: 0|req: 16/30] 10.222.0.43 () {54 vars in 931 bytes} [Tue Oct 4 21:34:23 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:34:23.610649 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi [None req-93e178c2-2538-4da3-979c-32f9ed8cbda2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "disk": 80, "id": "4", "os-flavor-access:is_public": true, "name": "m1.large", "swap": 0, "rxtx_factor": 1.0, "vcpus": 4, "ram": 8192}} {{(pid=112975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:34:23.635591 n-d-860284-1 devstack@n-api.service[112975]: INFO nova.api.openstack.requestlog [None req-93e178c2-2538-4da3-979c-32f9ed8cbda2 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.560121 Oct 04 21:34:23.636487 n-d-860284-1 devstack@n-api.service[112975]: [pid: 112975|app: 0|req: 15/31] 10.222.0.43 () {64 vars in 1283 bytes} [Tue Oct 4 21:34:23 2022] POST /compute/v2.1/flavors => generated 405 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:34:23.649076 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi [None req-aba9c973-d836-4449-9712-4ddcd71e1c01 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:34:23.657532 n-d-860284-1 devstack@n-api.service[112974]: DEBUG dbcounter [-] [112974] Writing DB stats nova_api:SELECT=39,nova_api:SAVEPOINT=4,nova_api:INSERT=8,nova_api:RELEASE=4 {{(pid=112974) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:34:23.682491 n-d-860284-1 devstack@n-api.service[112974]: INFO nova.api.openstack.requestlog [None req-aba9c973-d836-4449-9712-4ddcd71e1c01 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037565 Oct 04 21:34:23.698395 n-d-860284-1 devstack@n-api.service[112974]: [pid: 112974|app: 0|req: 17/32] 10.222.0.43 () {64 vars in 1333 bytes} [Tue Oct 4 21:34:23 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:34:26.428546 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi [None req-93e178c2-2538-4da3-979c-32f9ed8cbda2 admin admin] Calling method '>' {{(pid=112975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:26.430497 n-d-860284-1 devstack@n-api.service[112975]: INFO nova.api.openstack.requestlog [None req-93e178c2-2538-4da3-979c-32f9ed8cbda2 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002089 Oct 04 21:34:26.431049 n-d-860284-1 devstack@n-api.service[112975]: [pid: 112975|app: 0|req: 16/33] 10.222.0.43 () {54 vars in 931 bytes} [Tue Oct 4 21:34:26 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:34:26.940728 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi [None req-722b3271-36e1-407e-b24f-e7180eda5044 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 160, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "5", "name": "m1.xlarge", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 8, "ram": 16384}} {{(pid=112974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:34:26.966585 n-d-860284-1 devstack@n-api.service[112974]: INFO nova.api.openstack.requestlog [None req-722b3271-36e1-407e-b24f-e7180eda5044 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.529098 Oct 04 21:34:26.967395 n-d-860284-1 devstack@n-api.service[112974]: [pid: 112974|app: 0|req: 18/34] 10.222.0.43 () {64 vars in 1283 bytes} [Tue Oct 4 21:34:26 2022] POST /compute/v2.1/flavors => generated 408 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:34:26.979687 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi [None req-eb5628d7-bd1d-4792-9b76-3f1ce7e4ab80 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:34:27.010829 n-d-860284-1 devstack@n-api.service[112975]: INFO nova.api.openstack.requestlog [None req-eb5628d7-bd1d-4792-9b76-3f1ce7e4ab80 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035022 Oct 04 21:34:27.011513 n-d-860284-1 devstack@n-api.service[112975]: [pid: 112975|app: 0|req: 17/35] 10.222.0.43 () {64 vars in 1333 bytes} [Tue Oct 4 21:34:26 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:34:48.381635 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi [None req-722b3271-36e1-407e-b24f-e7180eda5044 admin admin] Calling method '>' {{(pid=112974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:48.382689 n-d-860284-1 devstack@n-api.service[112974]: INFO nova.api.openstack.requestlog [None req-722b3271-36e1-407e-b24f-e7180eda5044 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 Oct 04 21:34:48.383092 n-d-860284-1 devstack@n-api.service[112974]: [pid: 112974|app: 0|req: 19/36] 10.222.0.43 () {54 vars in 931 bytes} [Tue Oct 4 21:34:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:34:48.393797 n-d-860284-1 devstack@n-api.service[112975]: DEBUG dbcounter [-] [112975] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=112975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:34:48.795207 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi [None req-222efa75-56e3-499b-be2c-0632295d5c69 admin admin] Calling method '>' {{(pid=112975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:48.815434 n-d-860284-1 devstack@n-api.service[112975]: INFO nova.api.openstack.requestlog [None req-222efa75-56e3-499b-be2c-0632295d5c69 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.426111 Oct 04 21:34:48.816161 n-d-860284-1 devstack@n-api.service[112975]: [pid: 112975|app: 0|req: 18/37] 10.222.0.43 () {60 vars in 1292 bytes} [Tue Oct 4 21:34:48 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:34:50.150302 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi [None req-722b3271-36e1-407e-b24f-e7180eda5044 admin admin] Calling method '>' {{(pid=112974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:50.151353 n-d-860284-1 devstack@n-api.service[112974]: INFO nova.api.openstack.requestlog [None req-722b3271-36e1-407e-b24f-e7180eda5044 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001501 Oct 04 21:34:50.151761 n-d-860284-1 devstack@n-api.service[112974]: [pid: 112974|app: 0|req: 20/38] 10.222.0.43 () {56 vars in 1074 bytes} [Tue Oct 4 21:34:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:34:50.701809 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi [None req-40f956ea-d18d-4fb3-8985-8f7afac69772 admin admin] Calling method '>' {{(pid=112975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:50.708000 n-d-860284-1 devstack@n-api.service[112975]: INFO nova.api.openstack.wsgi [None req-40f956ea-d18d-4fb3-8985-8f7afac69772 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 04 21:34:50.711284 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi [None req-40f956ea-d18d-4fb3-8985-8f7afac69772 admin admin] Request method failure captured: Oct 04 21:34:50.711284 n-d-860284-1 devstack@n-api.service[112975]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 04 21:34:50.711284 n-d-860284-1 devstack@n-api.service[112975]: Accept: application/json Oct 04 21:34:50.711284 n-d-860284-1 devstack@n-api.service[112975]: Accept-Encoding: gzip, deflate Oct 04 21:34:50.711284 n-d-860284-1 devstack@n-api.service[112975]: Connection: keep-alive Oct 04 21:34:50.711284 n-d-860284-1 devstack@n-api.service[112975]: Content-Length: 0 Oct 04 21:34:50.711284 n-d-860284-1 devstack@n-api.service[112975]: Host: 10.222.0.43 Oct 04 21:34:50.711284 n-d-860284-1 devstack@n-api.service[112975]: Openstack-Api-Version: compute 2.92 Oct 04 21:34:50.711284 n-d-860284-1 devstack@n-api.service[112975]: Openstack-System-Scope: None Oct 04 21:34:50.711284 n-d-860284-1 devstack@n-api.service[112975]: User-Agent: python-novaclient Oct 04 21:34:50.711284 n-d-860284-1 devstack@n-api.service[112975]: X-Auth-Token: gAAAAABjPKb61BDb80Re0uJg6h5Z8BotshhNCwijapU7KNRyrAudRpiNtbafCO473bA-kKL4_ITN_8tDpbo1LNX4ASAQ9i6ZlGqiTqlGOsQeXOqjSfOoGnxxqETizpa5537ISL103qgF3MhTed-gesdTexex5OrsjVZEcNV_f0TI_ZtCdyR2oCI Oct 04 21:34:50.711284 n-d-860284-1 devstack@n-api.service[112975]: X-Domain-Id: None Oct 04 21:34:50.711284 n-d-860284-1 devstack@n-api.service[112975]: X-Domain-Name: None Oct 04 21:34:50.711284 n-d-860284-1 devstack@n-api.service[112975]: X-Identity-Status: Confirmed Oct 04 21:34:50.711284 n-d-860284-1 devstack@n-api.service[112975]: X-Is-Admin-Project: True Oct 04 21:34:50.711284 n-d-860284-1 devstack@n-api.service[112975]: X-Openstack-Nova-Api-Version: 2.92 Oct 04 21:34:50.711284 n-d-860284-1 devstack@n-api.service[112975]: X-Project-Domain-Id: default Oct 04 21:34:50.711284 n-d-860284-1 devstack@n-api.service[112975]: X-Project-Domain-Name: Default Oct 04 21:34:50.711284 n-d-860284-1 devstack@n-api.service[112975]: X-Project-Id: da88054ecbee4cd99e9eae8f950c0ea2 Oct 04 21:34:50.711284 n-d-860284-1 devstack@n-api.service[112975]: X-Project-Name: admin Oct 04 21:34:50.711284 n-d-860284-1 devstack@n-api.service[112975]: X-Role: reader,admin,member Oct 04 21:34:50.711284 n-d-860284-1 devstack@n-api.service[112975]: X-Roles: reader,admin,member Oct 04 21:34:50.712948 n-d-860284-1 devstack@n-api.service[112975]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/da88054ecbee4cd99e9eae8f950c0ea2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_da88054ecbee4cd99e9eae8f950c0ea2", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/da88054ecbee4cd99e9eae8f950c0ea2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/da88054ecbee4cd99e9eae8f950c0ea2"}]}] Oct 04 21:34:50.712948 n-d-860284-1 devstack@n-api.service[112975]: X-Tenant: admin Oct 04 21:34:50.712948 n-d-860284-1 devstack@n-api.service[112975]: X-Tenant-Id: da88054ecbee4cd99e9eae8f950c0ea2 Oct 04 21:34:50.712948 n-d-860284-1 devstack@n-api.service[112975]: X-Tenant-Name: admin Oct 04 21:34:50.712948 n-d-860284-1 devstack@n-api.service[112975]: X-User: admin Oct 04 21:34:50.712948 n-d-860284-1 devstack@n-api.service[112975]: X-User-Domain-Id: default Oct 04 21:34:50.712948 n-d-860284-1 devstack@n-api.service[112975]: X-User-Domain-Name: Default Oct 04 21:34:50.712948 n-d-860284-1 devstack@n-api.service[112975]: X-User-Id: 9147b39a6bb846f1957a41a51dffbad4 Oct 04 21:34:50.712948 n-d-860284-1 devstack@n-api.service[112975]: X-User-Name: admin Oct 04 21:34:50.712948 n-d-860284-1 devstack@n-api.service[112975]: method: > Oct 04 21:34:50.712948 n-d-860284-1 devstack@n-api.service[112975]: exception: Flavor 42 could not be found. Oct 04 21:34:50.712948 n-d-860284-1 devstack@n-api.service[112975]: action_args: {'id': '42'} Oct 04 21:34:50.712948 n-d-860284-1 devstack@n-api.service[112975]: {{(pid=112975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:34:50.712948 n-d-860284-1 devstack@n-api.service[112975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:34:50.713952 n-d-860284-1 devstack@n-api.service[112975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 04 21:34:50.713952 n-d-860284-1 devstack@n-api.service[112975]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 04 21:34:50.713952 n-d-860284-1 devstack@n-api.service[112975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 04 21:34:50.713952 n-d-860284-1 devstack@n-api.service[112975]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 04 21:34:50.713952 n-d-860284-1 devstack@n-api.service[112975]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 21:34:50.713952 n-d-860284-1 devstack@n-api.service[112975]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 21:34:50.713952 n-d-860284-1 devstack@n-api.service[112975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 04 21:34:50.713952 n-d-860284-1 devstack@n-api.service[112975]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 04 21:34:50.713952 n-d-860284-1 devstack@n-api.service[112975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 04 21:34:50.713952 n-d-860284-1 devstack@n-api.service[112975]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:34:50.713952 n-d-860284-1 devstack@n-api.service[112975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 04 21:34:50.713952 n-d-860284-1 devstack@n-api.service[112975]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 04 21:34:50.713952 n-d-860284-1 devstack@n-api.service[112975]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 04 21:34:50.713952 n-d-860284-1 devstack@n-api.service[112975]: ERROR nova.api.openstack.wsgi Oct 04 21:34:50.713952 n-d-860284-1 devstack@n-api.service[112975]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:34:50.713952 n-d-860284-1 devstack@n-api.service[112975]: ERROR nova.api.openstack.wsgi Oct 04 21:34:50.713952 n-d-860284-1 devstack@n-api.service[112975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:34:50.713952 n-d-860284-1 devstack@n-api.service[112975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:34:50.713952 n-d-860284-1 devstack@n-api.service[112975]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:34:50.715327 n-d-860284-1 devstack@n-api.service[112975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:34:50.715327 n-d-860284-1 devstack@n-api.service[112975]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:34:50.715327 n-d-860284-1 devstack@n-api.service[112975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:34:50.715327 n-d-860284-1 devstack@n-api.service[112975]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:34:50.715327 n-d-860284-1 devstack@n-api.service[112975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 04 21:34:50.715327 n-d-860284-1 devstack@n-api.service[112975]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:34:50.715327 n-d-860284-1 devstack@n-api.service[112975]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 04 21:34:50.715327 n-d-860284-1 devstack@n-api.service[112975]: ERROR nova.api.openstack.wsgi Oct 04 21:34:50.715327 n-d-860284-1 devstack@n-api.service[112975]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:34:50.715327 n-d-860284-1 devstack@n-api.service[112975]: ERROR nova.api.openstack.wsgi Oct 04 21:34:50.715327 n-d-860284-1 devstack@n-api.service[112975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:34:50.715327 n-d-860284-1 devstack@n-api.service[112975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:34:50.715327 n-d-860284-1 devstack@n-api.service[112975]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:34:50.715327 n-d-860284-1 devstack@n-api.service[112975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:34:50.715327 n-d-860284-1 devstack@n-api.service[112975]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:34:50.715327 n-d-860284-1 devstack@n-api.service[112975]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 04 21:34:50.715327 n-d-860284-1 devstack@n-api.service[112975]: ERROR nova.api.openstack.wsgi Oct 04 21:34:50.715327 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi [None req-40f956ea-d18d-4fb3-8985-8f7afac69772 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=112975) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:34:50.716628 n-d-860284-1 devstack@n-api.service[112975]: INFO nova.api.openstack.requestlog [None req-40f956ea-d18d-4fb3-8985-8f7afac69772 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.408716 Oct 04 21:34:50.716628 n-d-860284-1 devstack@n-api.service[112975]: [pid: 112975|app: 0|req: 19/39] 10.222.0.43 () {60 vars in 1190 bytes} [Tue Oct 4 21:34:50 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 410 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 04 21:34:50.722897 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi [None req-7f91f5cc-4656-4a55-8ca1-30012568faa4 admin admin] Calling method '>' {{(pid=112974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:50.726940 n-d-860284-1 devstack@n-api.service[112974]: DEBUG dbcounter [-] [112974] Writing DB stats nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:INSERT=2,nova_api:RELEASE=1 {{(pid=112974) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:34:50.746115 n-d-860284-1 devstack@n-api.service[112974]: INFO nova.api.openstack.requestlog [None req-7f91f5cc-4656-4a55-8ca1-30012568faa4 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026905 Oct 04 21:34:50.746712 n-d-860284-1 devstack@n-api.service[112974]: [pid: 112974|app: 0|req: 21/40] 10.222.0.43 () {60 vars in 1210 bytes} [Tue Oct 4 21:34:50 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:34:50.765489 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi [None req-6f833244-4508-4057-9aae-1935e8405052 admin admin] Calling method '>' {{(pid=112975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:50.787625 n-d-860284-1 devstack@n-api.service[112975]: INFO nova.api.openstack.requestlog [None req-6f833244-4508-4057-9aae-1935e8405052 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026618 Oct 04 21:34:50.788175 n-d-860284-1 devstack@n-api.service[112975]: [pid: 112975|app: 0|req: 20/41] 10.222.0.43 () {60 vars in 1210 bytes} [Tue Oct 4 21:34:50 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:34:50.797546 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi [None req-751bc7ab-4d1d-4282-8a4f-41364608b34c admin admin] Calling method '>' {{(pid=112974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:50.803595 n-d-860284-1 devstack@n-api.service[112974]: INFO nova.api.openstack.wsgi [None req-751bc7ab-4d1d-4282-8a4f-41364608b34c admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 04 21:34:50.807142 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi [None req-751bc7ab-4d1d-4282-8a4f-41364608b34c admin admin] Request method failure captured: Oct 04 21:34:50.807142 n-d-860284-1 devstack@n-api.service[112974]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 04 21:34:50.807142 n-d-860284-1 devstack@n-api.service[112974]: Accept: application/json Oct 04 21:34:50.807142 n-d-860284-1 devstack@n-api.service[112974]: Accept-Encoding: gzip, deflate Oct 04 21:34:50.807142 n-d-860284-1 devstack@n-api.service[112974]: Connection: keep-alive Oct 04 21:34:50.807142 n-d-860284-1 devstack@n-api.service[112974]: Content-Length: 0 Oct 04 21:34:50.807142 n-d-860284-1 devstack@n-api.service[112974]: Host: 10.222.0.43 Oct 04 21:34:50.807142 n-d-860284-1 devstack@n-api.service[112974]: Openstack-Api-Version: compute 2.92 Oct 04 21:34:50.807142 n-d-860284-1 devstack@n-api.service[112974]: Openstack-System-Scope: None Oct 04 21:34:50.807142 n-d-860284-1 devstack@n-api.service[112974]: User-Agent: python-novaclient Oct 04 21:34:50.807142 n-d-860284-1 devstack@n-api.service[112974]: X-Auth-Token: gAAAAABjPKb61BDb80Re0uJg6h5Z8BotshhNCwijapU7KNRyrAudRpiNtbafCO473bA-kKL4_ITN_8tDpbo1LNX4ASAQ9i6ZlGqiTqlGOsQeXOqjSfOoGnxxqETizpa5537ISL103qgF3MhTed-gesdTexex5OrsjVZEcNV_f0TI_ZtCdyR2oCI Oct 04 21:34:50.807142 n-d-860284-1 devstack@n-api.service[112974]: X-Domain-Id: None Oct 04 21:34:50.807142 n-d-860284-1 devstack@n-api.service[112974]: X-Domain-Name: None Oct 04 21:34:50.807142 n-d-860284-1 devstack@n-api.service[112974]: X-Identity-Status: Confirmed Oct 04 21:34:50.807142 n-d-860284-1 devstack@n-api.service[112974]: X-Is-Admin-Project: True Oct 04 21:34:50.807142 n-d-860284-1 devstack@n-api.service[112974]: X-Openstack-Nova-Api-Version: 2.92 Oct 04 21:34:50.807142 n-d-860284-1 devstack@n-api.service[112974]: X-Project-Domain-Id: default Oct 04 21:34:50.807142 n-d-860284-1 devstack@n-api.service[112974]: X-Project-Domain-Name: Default Oct 04 21:34:50.807142 n-d-860284-1 devstack@n-api.service[112974]: X-Project-Id: da88054ecbee4cd99e9eae8f950c0ea2 Oct 04 21:34:50.807142 n-d-860284-1 devstack@n-api.service[112974]: X-Project-Name: admin Oct 04 21:34:50.807142 n-d-860284-1 devstack@n-api.service[112974]: X-Role: reader,admin,member Oct 04 21:34:50.807142 n-d-860284-1 devstack@n-api.service[112974]: X-Roles: reader,admin,member Oct 04 21:34:50.808535 n-d-860284-1 devstack@n-api.service[112974]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/da88054ecbee4cd99e9eae8f950c0ea2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_da88054ecbee4cd99e9eae8f950c0ea2", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/da88054ecbee4cd99e9eae8f950c0ea2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/da88054ecbee4cd99e9eae8f950c0ea2"}]}] Oct 04 21:34:50.808535 n-d-860284-1 devstack@n-api.service[112974]: X-Tenant: admin Oct 04 21:34:50.808535 n-d-860284-1 devstack@n-api.service[112974]: X-Tenant-Id: da88054ecbee4cd99e9eae8f950c0ea2 Oct 04 21:34:50.808535 n-d-860284-1 devstack@n-api.service[112974]: X-Tenant-Name: admin Oct 04 21:34:50.808535 n-d-860284-1 devstack@n-api.service[112974]: X-User: admin Oct 04 21:34:50.808535 n-d-860284-1 devstack@n-api.service[112974]: X-User-Domain-Id: default Oct 04 21:34:50.808535 n-d-860284-1 devstack@n-api.service[112974]: X-User-Domain-Name: Default Oct 04 21:34:50.808535 n-d-860284-1 devstack@n-api.service[112974]: X-User-Id: 9147b39a6bb846f1957a41a51dffbad4 Oct 04 21:34:50.808535 n-d-860284-1 devstack@n-api.service[112974]: X-User-Name: admin Oct 04 21:34:50.808535 n-d-860284-1 devstack@n-api.service[112974]: method: > Oct 04 21:34:50.808535 n-d-860284-1 devstack@n-api.service[112974]: exception: Flavor 42 could not be found. Oct 04 21:34:50.808535 n-d-860284-1 devstack@n-api.service[112974]: action_args: {'id': '42'} Oct 04 21:34:50.808535 n-d-860284-1 devstack@n-api.service[112974]: {{(pid=112974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:34:50.808535 n-d-860284-1 devstack@n-api.service[112974]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:34:50.809516 n-d-860284-1 devstack@n-api.service[112974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 04 21:34:50.809516 n-d-860284-1 devstack@n-api.service[112974]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 04 21:34:50.809516 n-d-860284-1 devstack@n-api.service[112974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 04 21:34:50.809516 n-d-860284-1 devstack@n-api.service[112974]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 04 21:34:50.809516 n-d-860284-1 devstack@n-api.service[112974]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 21:34:50.809516 n-d-860284-1 devstack@n-api.service[112974]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 21:34:50.809516 n-d-860284-1 devstack@n-api.service[112974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 04 21:34:50.809516 n-d-860284-1 devstack@n-api.service[112974]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 04 21:34:50.809516 n-d-860284-1 devstack@n-api.service[112974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 04 21:34:50.809516 n-d-860284-1 devstack@n-api.service[112974]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:34:50.809516 n-d-860284-1 devstack@n-api.service[112974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 04 21:34:50.809516 n-d-860284-1 devstack@n-api.service[112974]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 04 21:34:50.809516 n-d-860284-1 devstack@n-api.service[112974]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 04 21:34:50.809516 n-d-860284-1 devstack@n-api.service[112974]: ERROR nova.api.openstack.wsgi Oct 04 21:34:50.809516 n-d-860284-1 devstack@n-api.service[112974]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:34:50.809516 n-d-860284-1 devstack@n-api.service[112974]: ERROR nova.api.openstack.wsgi Oct 04 21:34:50.809516 n-d-860284-1 devstack@n-api.service[112974]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:34:50.809516 n-d-860284-1 devstack@n-api.service[112974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:34:50.809516 n-d-860284-1 devstack@n-api.service[112974]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:34:50.810934 n-d-860284-1 devstack@n-api.service[112974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:34:50.810934 n-d-860284-1 devstack@n-api.service[112974]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:34:50.810934 n-d-860284-1 devstack@n-api.service[112974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:34:50.810934 n-d-860284-1 devstack@n-api.service[112974]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:34:50.810934 n-d-860284-1 devstack@n-api.service[112974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 04 21:34:50.810934 n-d-860284-1 devstack@n-api.service[112974]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:34:50.810934 n-d-860284-1 devstack@n-api.service[112974]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 04 21:34:50.810934 n-d-860284-1 devstack@n-api.service[112974]: ERROR nova.api.openstack.wsgi Oct 04 21:34:50.810934 n-d-860284-1 devstack@n-api.service[112974]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:34:50.810934 n-d-860284-1 devstack@n-api.service[112974]: ERROR nova.api.openstack.wsgi Oct 04 21:34:50.810934 n-d-860284-1 devstack@n-api.service[112974]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:34:50.810934 n-d-860284-1 devstack@n-api.service[112974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:34:50.810934 n-d-860284-1 devstack@n-api.service[112974]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:34:50.810934 n-d-860284-1 devstack@n-api.service[112974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:34:50.810934 n-d-860284-1 devstack@n-api.service[112974]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:34:50.810934 n-d-860284-1 devstack@n-api.service[112974]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 04 21:34:50.810934 n-d-860284-1 devstack@n-api.service[112974]: ERROR nova.api.openstack.wsgi Oct 04 21:34:50.810934 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi [None req-751bc7ab-4d1d-4282-8a4f-41364608b34c admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=112974) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:34:50.812147 n-d-860284-1 devstack@n-api.service[112974]: INFO nova.api.openstack.requestlog [None req-751bc7ab-4d1d-4282-8a4f-41364608b34c admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.014577 Oct 04 21:34:50.812147 n-d-860284-1 devstack@n-api.service[112974]: [pid: 112974|app: 0|req: 22/42] 10.222.0.43 () {60 vars in 1190 bytes} [Tue Oct 4 21:34:50 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Oct 04 21:34:52.059415 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi [None req-6f833244-4508-4057-9aae-1935e8405052 admin admin] Calling method '>' {{(pid=112975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:52.060426 n-d-860284-1 devstack@n-api.service[112975]: INFO nova.api.openstack.requestlog [None req-6f833244-4508-4057-9aae-1935e8405052 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Oct 04 21:34:52.060822 n-d-860284-1 devstack@n-api.service[112975]: [pid: 112975|app: 0|req: 21/43] 10.222.0.43 () {56 vars in 1074 bytes} [Tue Oct 4 21:34:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:34:52.595308 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi [None req-ce6954ee-23ee-4dea-8efa-7140beeffc56 admin admin] Calling method '>' {{(pid=112974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:52.600395 n-d-860284-1 devstack@n-api.service[112974]: INFO nova.api.openstack.wsgi [None req-ce6954ee-23ee-4dea-8efa-7140beeffc56 admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 04 21:34:52.601891 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi [None req-ce6954ee-23ee-4dea-8efa-7140beeffc56 admin admin] Request method failure captured: Oct 04 21:34:52.601891 n-d-860284-1 devstack@n-api.service[112974]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 04 21:34:52.601891 n-d-860284-1 devstack@n-api.service[112974]: Accept: application/json Oct 04 21:34:52.601891 n-d-860284-1 devstack@n-api.service[112974]: Accept-Encoding: gzip, deflate Oct 04 21:34:52.601891 n-d-860284-1 devstack@n-api.service[112974]: Connection: keep-alive Oct 04 21:34:52.601891 n-d-860284-1 devstack@n-api.service[112974]: Content-Length: 0 Oct 04 21:34:52.601891 n-d-860284-1 devstack@n-api.service[112974]: Host: 10.222.0.43 Oct 04 21:34:52.601891 n-d-860284-1 devstack@n-api.service[112974]: Openstack-Api-Version: compute 2.92 Oct 04 21:34:52.601891 n-d-860284-1 devstack@n-api.service[112974]: Openstack-System-Scope: None Oct 04 21:34:52.601891 n-d-860284-1 devstack@n-api.service[112974]: User-Agent: python-novaclient Oct 04 21:34:52.601891 n-d-860284-1 devstack@n-api.service[112974]: X-Auth-Token: gAAAAABjPKb7jL3hI5wCy8iBTr3ao6O887V7-Kp9gzkr86CeG6lviOrs0ogwYJ7l3qqp86jpDucSSmrO3Zmvm6GANORA1pBxvFsmvPRjXWNyheCIqFby2Z_eQ6pL2A_qOf0zsGBf_ViA-AcBny6XXCcaWafUVNFk1hZFDwVb_4IN5BRj3hjZtYs Oct 04 21:34:52.601891 n-d-860284-1 devstack@n-api.service[112974]: X-Domain-Id: None Oct 04 21:34:52.601891 n-d-860284-1 devstack@n-api.service[112974]: X-Domain-Name: None Oct 04 21:34:52.601891 n-d-860284-1 devstack@n-api.service[112974]: X-Identity-Status: Confirmed Oct 04 21:34:52.601891 n-d-860284-1 devstack@n-api.service[112974]: X-Is-Admin-Project: True Oct 04 21:34:52.601891 n-d-860284-1 devstack@n-api.service[112974]: X-Openstack-Nova-Api-Version: 2.92 Oct 04 21:34:52.601891 n-d-860284-1 devstack@n-api.service[112974]: X-Project-Domain-Id: default Oct 04 21:34:52.601891 n-d-860284-1 devstack@n-api.service[112974]: X-Project-Domain-Name: Default Oct 04 21:34:52.601891 n-d-860284-1 devstack@n-api.service[112974]: X-Project-Id: da88054ecbee4cd99e9eae8f950c0ea2 Oct 04 21:34:52.601891 n-d-860284-1 devstack@n-api.service[112974]: X-Project-Name: admin Oct 04 21:34:52.601891 n-d-860284-1 devstack@n-api.service[112974]: X-Role: reader,admin,member Oct 04 21:34:52.601891 n-d-860284-1 devstack@n-api.service[112974]: X-Roles: reader,admin,member Oct 04 21:34:52.603461 n-d-860284-1 devstack@n-api.service[112974]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/da88054ecbee4cd99e9eae8f950c0ea2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_da88054ecbee4cd99e9eae8f950c0ea2", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/da88054ecbee4cd99e9eae8f950c0ea2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/da88054ecbee4cd99e9eae8f950c0ea2"}]}] Oct 04 21:34:52.603461 n-d-860284-1 devstack@n-api.service[112974]: X-Tenant: admin Oct 04 21:34:52.603461 n-d-860284-1 devstack@n-api.service[112974]: X-Tenant-Id: da88054ecbee4cd99e9eae8f950c0ea2 Oct 04 21:34:52.603461 n-d-860284-1 devstack@n-api.service[112974]: X-Tenant-Name: admin Oct 04 21:34:52.603461 n-d-860284-1 devstack@n-api.service[112974]: X-User: admin Oct 04 21:34:52.603461 n-d-860284-1 devstack@n-api.service[112974]: X-User-Domain-Id: default Oct 04 21:34:52.603461 n-d-860284-1 devstack@n-api.service[112974]: X-User-Domain-Name: Default Oct 04 21:34:52.603461 n-d-860284-1 devstack@n-api.service[112974]: X-User-Id: 9147b39a6bb846f1957a41a51dffbad4 Oct 04 21:34:52.603461 n-d-860284-1 devstack@n-api.service[112974]: X-User-Name: admin Oct 04 21:34:52.603461 n-d-860284-1 devstack@n-api.service[112974]: method: > Oct 04 21:34:52.603461 n-d-860284-1 devstack@n-api.service[112974]: exception: Flavor 84 could not be found. Oct 04 21:34:52.603461 n-d-860284-1 devstack@n-api.service[112974]: action_args: {'id': '84'} Oct 04 21:34:52.603461 n-d-860284-1 devstack@n-api.service[112974]: {{(pid=112974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:34:52.603461 n-d-860284-1 devstack@n-api.service[112974]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:34:52.604421 n-d-860284-1 devstack@n-api.service[112974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 04 21:34:52.604421 n-d-860284-1 devstack@n-api.service[112974]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 04 21:34:52.604421 n-d-860284-1 devstack@n-api.service[112974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 04 21:34:52.604421 n-d-860284-1 devstack@n-api.service[112974]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 04 21:34:52.604421 n-d-860284-1 devstack@n-api.service[112974]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 21:34:52.604421 n-d-860284-1 devstack@n-api.service[112974]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 21:34:52.604421 n-d-860284-1 devstack@n-api.service[112974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 04 21:34:52.604421 n-d-860284-1 devstack@n-api.service[112974]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 04 21:34:52.604421 n-d-860284-1 devstack@n-api.service[112974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 04 21:34:52.604421 n-d-860284-1 devstack@n-api.service[112974]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:34:52.604421 n-d-860284-1 devstack@n-api.service[112974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 04 21:34:52.604421 n-d-860284-1 devstack@n-api.service[112974]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 04 21:34:52.604421 n-d-860284-1 devstack@n-api.service[112974]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 04 21:34:52.604421 n-d-860284-1 devstack@n-api.service[112974]: ERROR nova.api.openstack.wsgi Oct 04 21:34:52.604421 n-d-860284-1 devstack@n-api.service[112974]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:34:52.604421 n-d-860284-1 devstack@n-api.service[112974]: ERROR nova.api.openstack.wsgi Oct 04 21:34:52.604421 n-d-860284-1 devstack@n-api.service[112974]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:34:52.604421 n-d-860284-1 devstack@n-api.service[112974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:34:52.604421 n-d-860284-1 devstack@n-api.service[112974]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:34:52.605686 n-d-860284-1 devstack@n-api.service[112974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:34:52.605686 n-d-860284-1 devstack@n-api.service[112974]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:34:52.605686 n-d-860284-1 devstack@n-api.service[112974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:34:52.605686 n-d-860284-1 devstack@n-api.service[112974]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:34:52.605686 n-d-860284-1 devstack@n-api.service[112974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 04 21:34:52.605686 n-d-860284-1 devstack@n-api.service[112974]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:34:52.605686 n-d-860284-1 devstack@n-api.service[112974]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 04 21:34:52.605686 n-d-860284-1 devstack@n-api.service[112974]: ERROR nova.api.openstack.wsgi Oct 04 21:34:52.605686 n-d-860284-1 devstack@n-api.service[112974]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:34:52.605686 n-d-860284-1 devstack@n-api.service[112974]: ERROR nova.api.openstack.wsgi Oct 04 21:34:52.605686 n-d-860284-1 devstack@n-api.service[112974]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:34:52.605686 n-d-860284-1 devstack@n-api.service[112974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:34:52.605686 n-d-860284-1 devstack@n-api.service[112974]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:34:52.605686 n-d-860284-1 devstack@n-api.service[112974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:34:52.605686 n-d-860284-1 devstack@n-api.service[112974]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:34:52.605686 n-d-860284-1 devstack@n-api.service[112974]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 04 21:34:52.605686 n-d-860284-1 devstack@n-api.service[112974]: ERROR nova.api.openstack.wsgi Oct 04 21:34:52.605686 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi [None req-ce6954ee-23ee-4dea-8efa-7140beeffc56 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=112974) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:34:52.607036 n-d-860284-1 devstack@n-api.service[112974]: INFO nova.api.openstack.requestlog [None req-ce6954ee-23ee-4dea-8efa-7140beeffc56 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.405066 Oct 04 21:34:52.607036 n-d-860284-1 devstack@n-api.service[112974]: [pid: 112974|app: 0|req: 23/44] 10.222.0.43 () {60 vars in 1190 bytes} [Tue Oct 4 21:34:52 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 406 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Oct 04 21:34:52.616784 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi [None req-93a8b5e7-b88f-4ed8-b3c3-1d5ea3e584aa admin admin] Calling method '>' {{(pid=112975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:52.632146 n-d-860284-1 devstack@n-api.service[112975]: INFO nova.api.openstack.requestlog [None req-93a8b5e7-b88f-4ed8-b3c3-1d5ea3e584aa admin admin] 10.222.0.43 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019538 Oct 04 21:34:52.632687 n-d-860284-1 devstack@n-api.service[112975]: [pid: 112975|app: 0|req: 22/45] 10.222.0.43 () {60 vars in 1210 bytes} [Tue Oct 4 21:34:52 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:34:52.642250 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi [None req-e48fd5a9-1650-4516-92b5-6d36b7fea40f admin admin] Calling method '>' {{(pid=112974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:52.657600 n-d-860284-1 devstack@n-api.service[112974]: INFO nova.api.openstack.requestlog [None req-e48fd5a9-1650-4516-92b5-6d36b7fea40f admin admin] 10.222.0.43 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018863 Oct 04 21:34:52.658066 n-d-860284-1 devstack@n-api.service[112974]: [pid: 112974|app: 0|req: 24/46] 10.222.0.43 () {60 vars in 1210 bytes} [Tue Oct 4 21:34:52 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:34:52.667713 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi [None req-6acea3d1-4fc5-4be8-adf3-c6f006347035 admin admin] Calling method '>' {{(pid=112975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:52.672766 n-d-860284-1 devstack@n-api.service[112975]: INFO nova.api.openstack.wsgi [None req-6acea3d1-4fc5-4be8-adf3-c6f006347035 admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 04 21:34:52.674275 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi [None req-6acea3d1-4fc5-4be8-adf3-c6f006347035 admin admin] Request method failure captured: Oct 04 21:34:52.674275 n-d-860284-1 devstack@n-api.service[112975]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 04 21:34:52.674275 n-d-860284-1 devstack@n-api.service[112975]: Accept: application/json Oct 04 21:34:52.674275 n-d-860284-1 devstack@n-api.service[112975]: Accept-Encoding: gzip, deflate Oct 04 21:34:52.674275 n-d-860284-1 devstack@n-api.service[112975]: Connection: keep-alive Oct 04 21:34:52.674275 n-d-860284-1 devstack@n-api.service[112975]: Content-Length: 0 Oct 04 21:34:52.674275 n-d-860284-1 devstack@n-api.service[112975]: Host: 10.222.0.43 Oct 04 21:34:52.674275 n-d-860284-1 devstack@n-api.service[112975]: Openstack-Api-Version: compute 2.92 Oct 04 21:34:52.674275 n-d-860284-1 devstack@n-api.service[112975]: Openstack-System-Scope: None Oct 04 21:34:52.674275 n-d-860284-1 devstack@n-api.service[112975]: User-Agent: python-novaclient Oct 04 21:34:52.674275 n-d-860284-1 devstack@n-api.service[112975]: X-Auth-Token: gAAAAABjPKb7jL3hI5wCy8iBTr3ao6O887V7-Kp9gzkr86CeG6lviOrs0ogwYJ7l3qqp86jpDucSSmrO3Zmvm6GANORA1pBxvFsmvPRjXWNyheCIqFby2Z_eQ6pL2A_qOf0zsGBf_ViA-AcBny6XXCcaWafUVNFk1hZFDwVb_4IN5BRj3hjZtYs Oct 04 21:34:52.674275 n-d-860284-1 devstack@n-api.service[112975]: X-Domain-Id: None Oct 04 21:34:52.674275 n-d-860284-1 devstack@n-api.service[112975]: X-Domain-Name: None Oct 04 21:34:52.674275 n-d-860284-1 devstack@n-api.service[112975]: X-Identity-Status: Confirmed Oct 04 21:34:52.674275 n-d-860284-1 devstack@n-api.service[112975]: X-Is-Admin-Project: True Oct 04 21:34:52.674275 n-d-860284-1 devstack@n-api.service[112975]: X-Openstack-Nova-Api-Version: 2.92 Oct 04 21:34:52.674275 n-d-860284-1 devstack@n-api.service[112975]: X-Project-Domain-Id: default Oct 04 21:34:52.674275 n-d-860284-1 devstack@n-api.service[112975]: X-Project-Domain-Name: Default Oct 04 21:34:52.674275 n-d-860284-1 devstack@n-api.service[112975]: X-Project-Id: da88054ecbee4cd99e9eae8f950c0ea2 Oct 04 21:34:52.674275 n-d-860284-1 devstack@n-api.service[112975]: X-Project-Name: admin Oct 04 21:34:52.674275 n-d-860284-1 devstack@n-api.service[112975]: X-Role: reader,admin,member Oct 04 21:34:52.674275 n-d-860284-1 devstack@n-api.service[112975]: X-Roles: reader,admin,member Oct 04 21:34:52.675828 n-d-860284-1 devstack@n-api.service[112975]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/da88054ecbee4cd99e9eae8f950c0ea2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_da88054ecbee4cd99e9eae8f950c0ea2", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/da88054ecbee4cd99e9eae8f950c0ea2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/da88054ecbee4cd99e9eae8f950c0ea2"}]}] Oct 04 21:34:52.675828 n-d-860284-1 devstack@n-api.service[112975]: X-Tenant: admin Oct 04 21:34:52.675828 n-d-860284-1 devstack@n-api.service[112975]: X-Tenant-Id: da88054ecbee4cd99e9eae8f950c0ea2 Oct 04 21:34:52.675828 n-d-860284-1 devstack@n-api.service[112975]: X-Tenant-Name: admin Oct 04 21:34:52.675828 n-d-860284-1 devstack@n-api.service[112975]: X-User: admin Oct 04 21:34:52.675828 n-d-860284-1 devstack@n-api.service[112975]: X-User-Domain-Id: default Oct 04 21:34:52.675828 n-d-860284-1 devstack@n-api.service[112975]: X-User-Domain-Name: Default Oct 04 21:34:52.675828 n-d-860284-1 devstack@n-api.service[112975]: X-User-Id: 9147b39a6bb846f1957a41a51dffbad4 Oct 04 21:34:52.675828 n-d-860284-1 devstack@n-api.service[112975]: X-User-Name: admin Oct 04 21:34:52.675828 n-d-860284-1 devstack@n-api.service[112975]: method: > Oct 04 21:34:52.675828 n-d-860284-1 devstack@n-api.service[112975]: exception: Flavor 84 could not be found. Oct 04 21:34:52.675828 n-d-860284-1 devstack@n-api.service[112975]: action_args: {'id': '84'} Oct 04 21:34:52.675828 n-d-860284-1 devstack@n-api.service[112975]: {{(pid=112975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:34:52.675828 n-d-860284-1 devstack@n-api.service[112975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:34:52.677685 n-d-860284-1 devstack@n-api.service[112975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 04 21:34:52.677685 n-d-860284-1 devstack@n-api.service[112975]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 04 21:34:52.677685 n-d-860284-1 devstack@n-api.service[112975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 04 21:34:52.677685 n-d-860284-1 devstack@n-api.service[112975]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 04 21:34:52.677685 n-d-860284-1 devstack@n-api.service[112975]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 21:34:52.677685 n-d-860284-1 devstack@n-api.service[112975]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 21:34:52.677685 n-d-860284-1 devstack@n-api.service[112975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 04 21:34:52.677685 n-d-860284-1 devstack@n-api.service[112975]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 04 21:34:52.677685 n-d-860284-1 devstack@n-api.service[112975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 04 21:34:52.677685 n-d-860284-1 devstack@n-api.service[112975]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:34:52.677685 n-d-860284-1 devstack@n-api.service[112975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 04 21:34:52.677685 n-d-860284-1 devstack@n-api.service[112975]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 04 21:34:52.677685 n-d-860284-1 devstack@n-api.service[112975]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 04 21:34:52.677685 n-d-860284-1 devstack@n-api.service[112975]: ERROR nova.api.openstack.wsgi Oct 04 21:34:52.677685 n-d-860284-1 devstack@n-api.service[112975]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:34:52.677685 n-d-860284-1 devstack@n-api.service[112975]: ERROR nova.api.openstack.wsgi Oct 04 21:34:52.677685 n-d-860284-1 devstack@n-api.service[112975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:34:52.677685 n-d-860284-1 devstack@n-api.service[112975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:34:52.677685 n-d-860284-1 devstack@n-api.service[112975]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:34:52.679196 n-d-860284-1 devstack@n-api.service[112975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:34:52.679196 n-d-860284-1 devstack@n-api.service[112975]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:34:52.679196 n-d-860284-1 devstack@n-api.service[112975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:34:52.679196 n-d-860284-1 devstack@n-api.service[112975]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:34:52.679196 n-d-860284-1 devstack@n-api.service[112975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 04 21:34:52.679196 n-d-860284-1 devstack@n-api.service[112975]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:34:52.679196 n-d-860284-1 devstack@n-api.service[112975]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 04 21:34:52.679196 n-d-860284-1 devstack@n-api.service[112975]: ERROR nova.api.openstack.wsgi Oct 04 21:34:52.679196 n-d-860284-1 devstack@n-api.service[112975]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:34:52.679196 n-d-860284-1 devstack@n-api.service[112975]: ERROR nova.api.openstack.wsgi Oct 04 21:34:52.679196 n-d-860284-1 devstack@n-api.service[112975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:34:52.679196 n-d-860284-1 devstack@n-api.service[112975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:34:52.679196 n-d-860284-1 devstack@n-api.service[112975]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:34:52.679196 n-d-860284-1 devstack@n-api.service[112975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:34:52.679196 n-d-860284-1 devstack@n-api.service[112975]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:34:52.679196 n-d-860284-1 devstack@n-api.service[112975]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 04 21:34:52.679196 n-d-860284-1 devstack@n-api.service[112975]: ERROR nova.api.openstack.wsgi Oct 04 21:34:52.679196 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi [None req-6acea3d1-4fc5-4be8-adf3-c6f006347035 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=112975) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:34:52.680716 n-d-860284-1 devstack@n-api.service[112975]: INFO nova.api.openstack.requestlog [None req-6acea3d1-4fc5-4be8-adf3-c6f006347035 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011721 Oct 04 21:34:52.680716 n-d-860284-1 devstack@n-api.service[112975]: [pid: 112975|app: 0|req: 23/47] 10.222.0.43 () {60 vars in 1190 bytes} [Tue Oct 4 21:34:52 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 04 21:34:53.919396 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi [None req-e48fd5a9-1650-4516-92b5-6d36b7fea40f admin admin] Calling method '>' {{(pid=112974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:53.920409 n-d-860284-1 devstack@n-api.service[112974]: INFO nova.api.openstack.requestlog [None req-e48fd5a9-1650-4516-92b5-6d36b7fea40f admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 Oct 04 21:34:53.920826 n-d-860284-1 devstack@n-api.service[112974]: [pid: 112974|app: 0|req: 25/48] 10.222.0.43 () {56 vars in 1074 bytes} [Tue Oct 4 21:34:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:34:54.455901 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi [None req-daf77cfd-3bb4-4ea7-96fa-72459a4d2bfe admin admin] Calling method '>' {{(pid=112975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:54.461810 n-d-860284-1 devstack@n-api.service[112975]: INFO nova.api.openstack.wsgi [None req-daf77cfd-3bb4-4ea7-96fa-72459a4d2bfe admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 04 21:34:54.463336 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi [None req-daf77cfd-3bb4-4ea7-96fa-72459a4d2bfe admin admin] Request method failure captured: Oct 04 21:34:54.463336 n-d-860284-1 devstack@n-api.service[112975]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 04 21:34:54.463336 n-d-860284-1 devstack@n-api.service[112975]: Accept: application/json Oct 04 21:34:54.463336 n-d-860284-1 devstack@n-api.service[112975]: Accept-Encoding: gzip, deflate Oct 04 21:34:54.463336 n-d-860284-1 devstack@n-api.service[112975]: Connection: keep-alive Oct 04 21:34:54.463336 n-d-860284-1 devstack@n-api.service[112975]: Content-Length: 0 Oct 04 21:34:54.463336 n-d-860284-1 devstack@n-api.service[112975]: Host: 10.222.0.43 Oct 04 21:34:54.463336 n-d-860284-1 devstack@n-api.service[112975]: Openstack-Api-Version: compute 2.92 Oct 04 21:34:54.463336 n-d-860284-1 devstack@n-api.service[112975]: Openstack-System-Scope: None Oct 04 21:34:54.463336 n-d-860284-1 devstack@n-api.service[112975]: User-Agent: python-novaclient Oct 04 21:34:54.463336 n-d-860284-1 devstack@n-api.service[112975]: X-Auth-Token: gAAAAABjPKb92grQOUcTbHGX0s7M8ozvAQBh386O4QvKTUXUzosnpDgDTjtgzEYPAdChN1_teVESA6CB-r5t_Y0RSPlxAT0OuZRuSlwmsph7XTiuYM2NGGfc8fAqEQFaPbv8e-EgKt8arhdV-gpa6C-w38k5jTmsJhg4wdwimESwZM9NL8vtwk0 Oct 04 21:34:54.463336 n-d-860284-1 devstack@n-api.service[112975]: X-Domain-Id: None Oct 04 21:34:54.463336 n-d-860284-1 devstack@n-api.service[112975]: X-Domain-Name: None Oct 04 21:34:54.463336 n-d-860284-1 devstack@n-api.service[112975]: X-Identity-Status: Confirmed Oct 04 21:34:54.463336 n-d-860284-1 devstack@n-api.service[112975]: X-Is-Admin-Project: True Oct 04 21:34:54.463336 n-d-860284-1 devstack@n-api.service[112975]: X-Openstack-Nova-Api-Version: 2.92 Oct 04 21:34:54.463336 n-d-860284-1 devstack@n-api.service[112975]: X-Project-Domain-Id: default Oct 04 21:34:54.463336 n-d-860284-1 devstack@n-api.service[112975]: X-Project-Domain-Name: Default Oct 04 21:34:54.463336 n-d-860284-1 devstack@n-api.service[112975]: X-Project-Id: da88054ecbee4cd99e9eae8f950c0ea2 Oct 04 21:34:54.463336 n-d-860284-1 devstack@n-api.service[112975]: X-Project-Name: admin Oct 04 21:34:54.463336 n-d-860284-1 devstack@n-api.service[112975]: X-Role: reader,admin,member Oct 04 21:34:54.463336 n-d-860284-1 devstack@n-api.service[112975]: X-Roles: reader,admin,member Oct 04 21:34:54.464917 n-d-860284-1 devstack@n-api.service[112975]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/da88054ecbee4cd99e9eae8f950c0ea2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_da88054ecbee4cd99e9eae8f950c0ea2", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/da88054ecbee4cd99e9eae8f950c0ea2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/da88054ecbee4cd99e9eae8f950c0ea2"}]}] Oct 04 21:34:54.464917 n-d-860284-1 devstack@n-api.service[112975]: X-Tenant: admin Oct 04 21:34:54.464917 n-d-860284-1 devstack@n-api.service[112975]: X-Tenant-Id: da88054ecbee4cd99e9eae8f950c0ea2 Oct 04 21:34:54.464917 n-d-860284-1 devstack@n-api.service[112975]: X-Tenant-Name: admin Oct 04 21:34:54.464917 n-d-860284-1 devstack@n-api.service[112975]: X-User: admin Oct 04 21:34:54.464917 n-d-860284-1 devstack@n-api.service[112975]: X-User-Domain-Id: default Oct 04 21:34:54.464917 n-d-860284-1 devstack@n-api.service[112975]: X-User-Domain-Name: Default Oct 04 21:34:54.464917 n-d-860284-1 devstack@n-api.service[112975]: X-User-Id: 9147b39a6bb846f1957a41a51dffbad4 Oct 04 21:34:54.464917 n-d-860284-1 devstack@n-api.service[112975]: X-User-Name: admin Oct 04 21:34:54.464917 n-d-860284-1 devstack@n-api.service[112975]: method: > Oct 04 21:34:54.464917 n-d-860284-1 devstack@n-api.service[112975]: exception: Flavor 451 could not be found. Oct 04 21:34:54.464917 n-d-860284-1 devstack@n-api.service[112975]: action_args: {'id': '451'} Oct 04 21:34:54.464917 n-d-860284-1 devstack@n-api.service[112975]: {{(pid=112975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:34:54.464917 n-d-860284-1 devstack@n-api.service[112975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:34:54.465917 n-d-860284-1 devstack@n-api.service[112975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 04 21:34:54.465917 n-d-860284-1 devstack@n-api.service[112975]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 04 21:34:54.465917 n-d-860284-1 devstack@n-api.service[112975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 04 21:34:54.465917 n-d-860284-1 devstack@n-api.service[112975]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 04 21:34:54.465917 n-d-860284-1 devstack@n-api.service[112975]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 21:34:54.465917 n-d-860284-1 devstack@n-api.service[112975]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 21:34:54.465917 n-d-860284-1 devstack@n-api.service[112975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 04 21:34:54.465917 n-d-860284-1 devstack@n-api.service[112975]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 04 21:34:54.465917 n-d-860284-1 devstack@n-api.service[112975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 04 21:34:54.465917 n-d-860284-1 devstack@n-api.service[112975]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:34:54.465917 n-d-860284-1 devstack@n-api.service[112975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 04 21:34:54.465917 n-d-860284-1 devstack@n-api.service[112975]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 04 21:34:54.465917 n-d-860284-1 devstack@n-api.service[112975]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 04 21:34:54.465917 n-d-860284-1 devstack@n-api.service[112975]: ERROR nova.api.openstack.wsgi Oct 04 21:34:54.465917 n-d-860284-1 devstack@n-api.service[112975]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:34:54.465917 n-d-860284-1 devstack@n-api.service[112975]: ERROR nova.api.openstack.wsgi Oct 04 21:34:54.465917 n-d-860284-1 devstack@n-api.service[112975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:34:54.465917 n-d-860284-1 devstack@n-api.service[112975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:34:54.465917 n-d-860284-1 devstack@n-api.service[112975]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:34:54.467218 n-d-860284-1 devstack@n-api.service[112975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:34:54.467218 n-d-860284-1 devstack@n-api.service[112975]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:34:54.467218 n-d-860284-1 devstack@n-api.service[112975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:34:54.467218 n-d-860284-1 devstack@n-api.service[112975]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:34:54.467218 n-d-860284-1 devstack@n-api.service[112975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 04 21:34:54.467218 n-d-860284-1 devstack@n-api.service[112975]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:34:54.467218 n-d-860284-1 devstack@n-api.service[112975]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 04 21:34:54.467218 n-d-860284-1 devstack@n-api.service[112975]: ERROR nova.api.openstack.wsgi Oct 04 21:34:54.467218 n-d-860284-1 devstack@n-api.service[112975]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:34:54.467218 n-d-860284-1 devstack@n-api.service[112975]: ERROR nova.api.openstack.wsgi Oct 04 21:34:54.467218 n-d-860284-1 devstack@n-api.service[112975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:34:54.467218 n-d-860284-1 devstack@n-api.service[112975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:34:54.467218 n-d-860284-1 devstack@n-api.service[112975]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:34:54.467218 n-d-860284-1 devstack@n-api.service[112975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:34:54.467218 n-d-860284-1 devstack@n-api.service[112975]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:34:54.467218 n-d-860284-1 devstack@n-api.service[112975]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 04 21:34:54.467218 n-d-860284-1 devstack@n-api.service[112975]: ERROR nova.api.openstack.wsgi Oct 04 21:34:54.467218 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi [None req-daf77cfd-3bb4-4ea7-96fa-72459a4d2bfe admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=112975) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:34:54.468529 n-d-860284-1 devstack@n-api.service[112975]: INFO nova.api.openstack.requestlog [None req-daf77cfd-3bb4-4ea7-96fa-72459a4d2bfe admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.405602 Oct 04 21:34:54.468529 n-d-860284-1 devstack@n-api.service[112975]: [pid: 112975|app: 0|req: 24/49] 10.222.0.43 () {60 vars in 1193 bytes} [Tue Oct 4 21:34:54 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 407 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 04 21:34:54.475141 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi [None req-730080b7-7f3d-418d-b60e-b31489a1d9cf admin admin] Calling method '>' {{(pid=112974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:54.490386 n-d-860284-1 devstack@n-api.service[112974]: INFO nova.api.openstack.requestlog [None req-730080b7-7f3d-418d-b60e-b31489a1d9cf admin admin] 10.222.0.43 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019312 Oct 04 21:34:54.490928 n-d-860284-1 devstack@n-api.service[112974]: [pid: 112974|app: 0|req: 26/50] 10.222.0.43 () {60 vars in 1210 bytes} [Tue Oct 4 21:34:54 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:34:54.500494 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi [None req-65d1b502-2cec-4c5c-8b95-869713365be2 admin admin] Calling method '>' {{(pid=112975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:54.515781 n-d-860284-1 devstack@n-api.service[112975]: INFO nova.api.openstack.requestlog [None req-65d1b502-2cec-4c5c-8b95-869713365be2 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018753 Oct 04 21:34:54.516332 n-d-860284-1 devstack@n-api.service[112975]: [pid: 112975|app: 0|req: 25/51] 10.222.0.43 () {60 vars in 1210 bytes} [Tue Oct 4 21:34:54 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:34:54.526271 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi [None req-9e40da83-a3ff-4938-8b70-9c299c137bc2 admin admin] Calling method '>' {{(pid=112974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:54.531429 n-d-860284-1 devstack@n-api.service[112974]: INFO nova.api.openstack.wsgi [None req-9e40da83-a3ff-4938-8b70-9c299c137bc2 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 04 21:34:54.532929 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi [None req-9e40da83-a3ff-4938-8b70-9c299c137bc2 admin admin] Request method failure captured: Oct 04 21:34:54.532929 n-d-860284-1 devstack@n-api.service[112974]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 04 21:34:54.532929 n-d-860284-1 devstack@n-api.service[112974]: Accept: application/json Oct 04 21:34:54.532929 n-d-860284-1 devstack@n-api.service[112974]: Accept-Encoding: gzip, deflate Oct 04 21:34:54.532929 n-d-860284-1 devstack@n-api.service[112974]: Connection: keep-alive Oct 04 21:34:54.532929 n-d-860284-1 devstack@n-api.service[112974]: Content-Length: 0 Oct 04 21:34:54.532929 n-d-860284-1 devstack@n-api.service[112974]: Host: 10.222.0.43 Oct 04 21:34:54.532929 n-d-860284-1 devstack@n-api.service[112974]: Openstack-Api-Version: compute 2.92 Oct 04 21:34:54.532929 n-d-860284-1 devstack@n-api.service[112974]: Openstack-System-Scope: None Oct 04 21:34:54.532929 n-d-860284-1 devstack@n-api.service[112974]: User-Agent: python-novaclient Oct 04 21:34:54.532929 n-d-860284-1 devstack@n-api.service[112974]: X-Auth-Token: gAAAAABjPKb92grQOUcTbHGX0s7M8ozvAQBh386O4QvKTUXUzosnpDgDTjtgzEYPAdChN1_teVESA6CB-r5t_Y0RSPlxAT0OuZRuSlwmsph7XTiuYM2NGGfc8fAqEQFaPbv8e-EgKt8arhdV-gpa6C-w38k5jTmsJhg4wdwimESwZM9NL8vtwk0 Oct 04 21:34:54.532929 n-d-860284-1 devstack@n-api.service[112974]: X-Domain-Id: None Oct 04 21:34:54.532929 n-d-860284-1 devstack@n-api.service[112974]: X-Domain-Name: None Oct 04 21:34:54.532929 n-d-860284-1 devstack@n-api.service[112974]: X-Identity-Status: Confirmed Oct 04 21:34:54.532929 n-d-860284-1 devstack@n-api.service[112974]: X-Is-Admin-Project: True Oct 04 21:34:54.532929 n-d-860284-1 devstack@n-api.service[112974]: X-Openstack-Nova-Api-Version: 2.92 Oct 04 21:34:54.532929 n-d-860284-1 devstack@n-api.service[112974]: X-Project-Domain-Id: default Oct 04 21:34:54.532929 n-d-860284-1 devstack@n-api.service[112974]: X-Project-Domain-Name: Default Oct 04 21:34:54.532929 n-d-860284-1 devstack@n-api.service[112974]: X-Project-Id: da88054ecbee4cd99e9eae8f950c0ea2 Oct 04 21:34:54.532929 n-d-860284-1 devstack@n-api.service[112974]: X-Project-Name: admin Oct 04 21:34:54.532929 n-d-860284-1 devstack@n-api.service[112974]: X-Role: reader,admin,member Oct 04 21:34:54.532929 n-d-860284-1 devstack@n-api.service[112974]: X-Roles: reader,admin,member Oct 04 21:34:54.534457 n-d-860284-1 devstack@n-api.service[112974]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/da88054ecbee4cd99e9eae8f950c0ea2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_da88054ecbee4cd99e9eae8f950c0ea2", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/da88054ecbee4cd99e9eae8f950c0ea2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/da88054ecbee4cd99e9eae8f950c0ea2"}]}] Oct 04 21:34:54.534457 n-d-860284-1 devstack@n-api.service[112974]: X-Tenant: admin Oct 04 21:34:54.534457 n-d-860284-1 devstack@n-api.service[112974]: X-Tenant-Id: da88054ecbee4cd99e9eae8f950c0ea2 Oct 04 21:34:54.534457 n-d-860284-1 devstack@n-api.service[112974]: X-Tenant-Name: admin Oct 04 21:34:54.534457 n-d-860284-1 devstack@n-api.service[112974]: X-User: admin Oct 04 21:34:54.534457 n-d-860284-1 devstack@n-api.service[112974]: X-User-Domain-Id: default Oct 04 21:34:54.534457 n-d-860284-1 devstack@n-api.service[112974]: X-User-Domain-Name: Default Oct 04 21:34:54.534457 n-d-860284-1 devstack@n-api.service[112974]: X-User-Id: 9147b39a6bb846f1957a41a51dffbad4 Oct 04 21:34:54.534457 n-d-860284-1 devstack@n-api.service[112974]: X-User-Name: admin Oct 04 21:34:54.534457 n-d-860284-1 devstack@n-api.service[112974]: method: > Oct 04 21:34:54.534457 n-d-860284-1 devstack@n-api.service[112974]: exception: Flavor 451 could not be found. Oct 04 21:34:54.534457 n-d-860284-1 devstack@n-api.service[112974]: action_args: {'id': '451'} Oct 04 21:34:54.534457 n-d-860284-1 devstack@n-api.service[112974]: {{(pid=112974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:34:54.534457 n-d-860284-1 devstack@n-api.service[112974]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:34:54.535394 n-d-860284-1 devstack@n-api.service[112974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 04 21:34:54.535394 n-d-860284-1 devstack@n-api.service[112974]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 04 21:34:54.535394 n-d-860284-1 devstack@n-api.service[112974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 04 21:34:54.535394 n-d-860284-1 devstack@n-api.service[112974]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 04 21:34:54.535394 n-d-860284-1 devstack@n-api.service[112974]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 21:34:54.535394 n-d-860284-1 devstack@n-api.service[112974]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 21:34:54.535394 n-d-860284-1 devstack@n-api.service[112974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 04 21:34:54.535394 n-d-860284-1 devstack@n-api.service[112974]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 04 21:34:54.535394 n-d-860284-1 devstack@n-api.service[112974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 04 21:34:54.535394 n-d-860284-1 devstack@n-api.service[112974]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:34:54.535394 n-d-860284-1 devstack@n-api.service[112974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 04 21:34:54.535394 n-d-860284-1 devstack@n-api.service[112974]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 04 21:34:54.535394 n-d-860284-1 devstack@n-api.service[112974]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 04 21:34:54.535394 n-d-860284-1 devstack@n-api.service[112974]: ERROR nova.api.openstack.wsgi Oct 04 21:34:54.535394 n-d-860284-1 devstack@n-api.service[112974]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:34:54.535394 n-d-860284-1 devstack@n-api.service[112974]: ERROR nova.api.openstack.wsgi Oct 04 21:34:54.535394 n-d-860284-1 devstack@n-api.service[112974]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:34:54.535394 n-d-860284-1 devstack@n-api.service[112974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:34:54.535394 n-d-860284-1 devstack@n-api.service[112974]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:34:54.537213 n-d-860284-1 devstack@n-api.service[112974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:34:54.537213 n-d-860284-1 devstack@n-api.service[112974]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:34:54.537213 n-d-860284-1 devstack@n-api.service[112974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:34:54.537213 n-d-860284-1 devstack@n-api.service[112974]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:34:54.537213 n-d-860284-1 devstack@n-api.service[112974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 04 21:34:54.537213 n-d-860284-1 devstack@n-api.service[112974]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:34:54.537213 n-d-860284-1 devstack@n-api.service[112974]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 04 21:34:54.537213 n-d-860284-1 devstack@n-api.service[112974]: ERROR nova.api.openstack.wsgi Oct 04 21:34:54.537213 n-d-860284-1 devstack@n-api.service[112974]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:34:54.537213 n-d-860284-1 devstack@n-api.service[112974]: ERROR nova.api.openstack.wsgi Oct 04 21:34:54.537213 n-d-860284-1 devstack@n-api.service[112974]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:34:54.537213 n-d-860284-1 devstack@n-api.service[112974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:34:54.537213 n-d-860284-1 devstack@n-api.service[112974]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:34:54.537213 n-d-860284-1 devstack@n-api.service[112974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:34:54.537213 n-d-860284-1 devstack@n-api.service[112974]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:34:54.537213 n-d-860284-1 devstack@n-api.service[112974]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 04 21:34:54.537213 n-d-860284-1 devstack@n-api.service[112974]: ERROR nova.api.openstack.wsgi Oct 04 21:34:54.537213 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi [None req-9e40da83-a3ff-4938-8b70-9c299c137bc2 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=112974) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:34:54.538427 n-d-860284-1 devstack@n-api.service[112974]: INFO nova.api.openstack.requestlog [None req-9e40da83-a3ff-4938-8b70-9c299c137bc2 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011781 Oct 04 21:34:54.538427 n-d-860284-1 devstack@n-api.service[112974]: [pid: 112974|app: 0|req: 27/52] 10.222.0.43 () {60 vars in 1193 bytes} [Tue Oct 4 21:34:54 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 04 21:34:55.773580 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi [None req-65d1b502-2cec-4c5c-8b95-869713365be2 admin admin] Calling method '>' {{(pid=112975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:55.774697 n-d-860284-1 devstack@n-api.service[112975]: INFO nova.api.openstack.requestlog [None req-65d1b502-2cec-4c5c-8b95-869713365be2 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001517 Oct 04 21:34:55.775101 n-d-860284-1 devstack@n-api.service[112975]: [pid: 112975|app: 0|req: 26/53] 10.222.0.43 () {56 vars in 1074 bytes} [Tue Oct 4 21:34:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:34:56.313260 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi [None req-75410d0f-fde2-4af6-9fb1-5cba53f2f9c3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:34:56.333248 n-d-860284-1 devstack@n-api.service[112974]: INFO nova.api.openstack.requestlog [None req-75410d0f-fde2-4af6-9fb1-5cba53f2f9c3 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.417032 Oct 04 21:34:56.333836 n-d-860284-1 devstack@n-api.service[112974]: [pid: 112974|app: 0|req: 28/54] 10.222.0.43 () {64 vars in 1235 bytes} [Tue Oct 4 21:34:55 2022] POST /compute/v2.1/flavors => generated 404 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:34:57.566587 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi [None req-65d1b502-2cec-4c5c-8b95-869713365be2 admin admin] Calling method '>' {{(pid=112975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:57.567614 n-d-860284-1 devstack@n-api.service[112975]: INFO nova.api.openstack.requestlog [None req-65d1b502-2cec-4c5c-8b95-869713365be2 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 Oct 04 21:34:57.567975 n-d-860284-1 devstack@n-api.service[112975]: [pid: 112975|app: 0|req: 27/55] 10.222.0.43 () {56 vars in 1074 bytes} [Tue Oct 4 21:34:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:34:58.093622 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi [None req-a2774759-a5af-4504-a56d-8f44c1d49e54 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:34:58.112422 n-d-860284-1 devstack@n-api.service[112974]: INFO nova.api.openstack.requestlog [None req-a2774759-a5af-4504-a56d-8f44c1d49e54 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.405698 Oct 04 21:34:58.113009 n-d-860284-1 devstack@n-api.service[112974]: [pid: 112974|app: 0|req: 29/56] 10.222.0.43 () {64 vars in 1235 bytes} [Tue Oct 4 21:34:57 2022] POST /compute/v2.1/flavors => generated 405 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:34:59.352628 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi [None req-65d1b502-2cec-4c5c-8b95-869713365be2 admin admin] Calling method '>' {{(pid=112975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:59.353953 n-d-860284-1 devstack@n-api.service[112975]: INFO nova.api.openstack.requestlog [None req-65d1b502-2cec-4c5c-8b95-869713365be2 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001817 Oct 04 21:34:59.354519 n-d-860284-1 devstack@n-api.service[112975]: [pid: 112975|app: 0|req: 28/57] 10.222.0.43 () {56 vars in 1074 bytes} [Tue Oct 4 21:34:59 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:34:59.884113 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi [None req-9aa27e53-86aa-461a-9a4f-71e5cb02301b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:34:59.903543 n-d-860284-1 devstack@n-api.service[112974]: INFO nova.api.openstack.requestlog [None req-9aa27e53-86aa-461a-9a4f-71e5cb02301b admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.410467 Oct 04 21:34:59.904092 n-d-860284-1 devstack@n-api.service[112974]: [pid: 112974|app: 0|req: 30/58] 10.222.0.43 () {64 vars in 1235 bytes} [Tue Oct 4 21:34:59 2022] POST /compute/v2.1/flavors => generated 407 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:35:01.132954 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi [None req-65d1b502-2cec-4c5c-8b95-869713365be2 admin admin] Calling method '>' {{(pid=112975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:35:01.134071 n-d-860284-1 devstack@n-api.service[112975]: INFO nova.api.openstack.requestlog [None req-65d1b502-2cec-4c5c-8b95-869713365be2 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 Oct 04 21:35:01.134535 n-d-860284-1 devstack@n-api.service[112975]: [pid: 112975|app: 0|req: 29/59] 10.222.0.43 () {56 vars in 1074 bytes} [Tue Oct 4 21:35:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:35:01.661337 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi [None req-c4c9a59c-57d4-4316-9f43-8d874cf10833 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:35:01.680584 n-d-860284-1 devstack@n-api.service[112974]: INFO nova.api.openstack.requestlog [None req-c4c9a59c-57d4-4316-9f43-8d874cf10833 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.404440 Oct 04 21:35:01.681140 n-d-860284-1 devstack@n-api.service[112974]: [pid: 112974|app: 0|req: 31/60] 10.222.0.43 () {64 vars in 1235 bytes} [Tue Oct 4 21:35:01 2022] POST /compute/v2.1/flavors => generated 409 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:35:02.930021 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi [None req-65d1b502-2cec-4c5c-8b95-869713365be2 admin admin] Calling method '>' {{(pid=112975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:35:02.931075 n-d-860284-1 devstack@n-api.service[112975]: INFO nova.api.openstack.requestlog [None req-65d1b502-2cec-4c5c-8b95-869713365be2 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001746 Oct 04 21:35:02.931518 n-d-860284-1 devstack@n-api.service[112975]: [pid: 112975|app: 0|req: 30/61] 10.222.0.43 () {56 vars in 1074 bytes} [Tue Oct 4 21:35:02 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:35:03.465623 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi [None req-224d5bfe-8806-4f4b-94bf-9328bb078ece admin admin] Calling method '>' {{(pid=112974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:35:03.485909 n-d-860284-1 devstack@n-api.service[112974]: INFO nova.api.openstack.requestlog [None req-224d5bfe-8806-4f4b-94bf-9328bb078ece admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.414866 Oct 04 21:35:03.486473 n-d-860284-1 devstack@n-api.service[112974]: [pid: 112974|app: 0|req: 32/62] 10.222.0.43 () {60 vars in 1202 bytes} [Tue Oct 4 21:35:03 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:36:01.790022 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi [None req-65d1b502-2cec-4c5c-8b95-869713365be2 admin admin] Calling method '>' {{(pid=112975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:01.791074 n-d-860284-1 devstack@n-api.service[112975]: INFO nova.api.openstack.requestlog [None req-65d1b502-2cec-4c5c-8b95-869713365be2 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001496 Oct 04 21:36:01.791479 n-d-860284-1 devstack@n-api.service[112975]: [pid: 112975|app: 0|req: 31/63] 10.222.0.43 () {54 vars in 931 bytes} [Tue Oct 4 21:36:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:36:01.802335 n-d-860284-1 devstack@n-api.service[112974]: DEBUG dbcounter [-] [112974] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=112974) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:36:02.197771 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi [None req-eafabbb4-bdea-4dd4-9272-a95d306c9328 admin admin] Calling method '>' {{(pid=112974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:02.223368 n-d-860284-1 devstack@n-api.service[112974]: INFO nova.api.openstack.requestlog [None req-eafabbb4-bdea-4dd4-9272-a95d306c9328 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.425564 Oct 04 21:36:02.224014 n-d-860284-1 devstack@n-api.service[112974]: [pid: 112974|app: 0|req: 33/64] 10.222.0.43 () {60 vars in 1292 bytes} [Tue Oct 4 21:36:01 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:36:02.245262 n-d-860284-1 devstack@n-api.service[112975]: DEBUG dbcounter [-] [112975] Writing DB stats nova_api:SELECT=14 {{(pid=112975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:36:02.249037 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi [None req-589a78df-0886-4be4-aaa0-54153898f466 admin admin] Calling method '>' {{(pid=112975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:02.257489 n-d-860284-1 devstack@n-api.service[112975]: INFO nova.api.openstack.requestlog [None req-589a78df-0886-4be4-aaa0-54153898f466 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013722 Oct 04 21:36:02.258041 n-d-860284-1 devstack@n-api.service[112975]: [pid: 112975|app: 0|req: 32/65] 10.222.0.43 () {60 vars in 1283 bytes} [Tue Oct 4 21:36:02 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:36:02.271000 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi [None req-cf95cbaf-0b69-4396-9074-384803cd53fd admin admin] Calling method '>' {{(pid=112974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:02.278583 n-d-860284-1 devstack@n-api.service[112974]: INFO nova.api.openstack.requestlog [None req-cf95cbaf-0b69-4396-9074-384803cd53fd admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011936 Oct 04 21:36:02.279137 n-d-860284-1 devstack@n-api.service[112974]: [pid: 112974|app: 0|req: 34/66] 10.222.0.43 () {60 vars in 1286 bytes} [Tue Oct 4 21:36:02 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:36:02.291505 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi [None req-602d777a-1a71-40f8-9c6e-3ac8934cf29d admin admin] Calling method '>' {{(pid=112975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:02.299220 n-d-860284-1 devstack@n-api.service[112975]: INFO nova.api.openstack.requestlog [None req-602d777a-1a71-40f8-9c6e-3ac8934cf29d admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011189 Oct 04 21:36:02.300006 n-d-860284-1 devstack@n-api.service[112975]: [pid: 112975|app: 0|req: 33/67] 10.222.0.43 () {60 vars in 1286 bytes} [Tue Oct 4 21:36:02 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:36:02.311726 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi [None req-e8094757-545e-4abd-b253-f79c7eeff2fe admin admin] Calling method '>' {{(pid=112974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:02.319536 n-d-860284-1 devstack@n-api.service[112974]: INFO nova.api.openstack.requestlog [None req-e8094757-545e-4abd-b253-f79c7eeff2fe admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011319 Oct 04 21:36:02.319990 n-d-860284-1 devstack@n-api.service[112974]: [pid: 112974|app: 0|req: 35/68] 10.222.0.43 () {60 vars in 1283 bytes} [Tue Oct 4 21:36:02 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:41:38.786607 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi [None req-602d777a-1a71-40f8-9c6e-3ac8934cf29d admin admin] Calling method '>' {{(pid=112975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:41:38.787700 n-d-860284-1 devstack@n-api.service[112975]: INFO nova.api.openstack.requestlog [None req-602d777a-1a71-40f8-9c6e-3ac8934cf29d admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001545 Oct 04 21:41:38.788192 n-d-860284-1 devstack@n-api.service[112975]: [pid: 112975|app: 0|req: 34/69] 10.222.0.43 () {56 vars in 1074 bytes} [Tue Oct 4 21:41:38 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:41:38.933076 n-d-860284-1 devstack@n-api.service[112974]: DEBUG dbcounter [-] [112974] Writing DB stats nova_api:SELECT=6 {{(pid=112974) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:41:39.077422 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi [None req-681216df-d614-4370-8d3d-806698623279 admin admin] Calling method '>' {{(pid=112974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:41:39.082104 n-d-860284-1 devstack@n-api.service[112974]: DEBUG oslo_concurrency.lockutils [None req-681216df-d614-4370-8d3d-806698623279 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:39.082614 n-d-860284-1 devstack@n-api.service[112974]: DEBUG oslo_concurrency.lockutils [None req-681216df-d614-4370-8d3d-806698623279 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:39.083049 n-d-860284-1 devstack@n-api.service[112974]: DEBUG oslo_concurrency.lockutils [None req-681216df-d614-4370-8d3d-806698623279 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:39.083772 n-d-860284-1 devstack@n-api.service[112974]: DEBUG oslo_concurrency.lockutils [None req-681216df-d614-4370-8d3d-806698623279 admin admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:39.084225 n-d-860284-1 devstack@n-api.service[112974]: DEBUG oslo_concurrency.lockutils [None req-681216df-d614-4370-8d3d-806698623279 admin admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:39.084646 n-d-860284-1 devstack@n-api.service[112974]: DEBUG oslo_concurrency.lockutils [None req-681216df-d614-4370-8d3d-806698623279 admin admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:39.124329 n-d-860284-1 devstack@n-api.service[112974]: INFO nova.api.openstack.requestlog [None req-681216df-d614-4370-8d3d-806698623279 admin admin] 10.222.0.43 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.92 time: 0.192473 Oct 04 21:41:39.124900 n-d-860284-1 devstack@n-api.service[112974]: [pid: 112974|app: 0|req: 36/70] 10.222.0.43 () {60 vars in 1193 bytes} [Tue Oct 4 21:41:38 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:41:40.244340 n-d-860284-1 devstack@n-api.service[112975]: DEBUG nova.api.openstack.wsgi [None req-602d777a-1a71-40f8-9c6e-3ac8934cf29d admin admin] Calling method '>' {{(pid=112975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:41:40.245365 n-d-860284-1 devstack@n-api.service[112975]: INFO nova.api.openstack.requestlog [None req-602d777a-1a71-40f8-9c6e-3ac8934cf29d admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Oct 04 21:41:40.245771 n-d-860284-1 devstack@n-api.service[112975]: [pid: 112975|app: 0|req: 35/71] 10.222.0.43 () {56 vars in 1074 bytes} [Tue Oct 4 21:41:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:41:40.443682 n-d-860284-1 devstack@n-api.service[112974]: DEBUG nova.api.openstack.wsgi [None req-7d4abbaa-a76c-48e4-b5b1-9640b8a20642 admin admin] Calling method '>' {{(pid=112974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:41:40.447820 n-d-860284-1 devstack@n-api.service[112974]: DEBUG oslo_concurrency.lockutils [None req-7d4abbaa-a76c-48e4-b5b1-9640b8a20642 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:40.448327 n-d-860284-1 devstack@n-api.service[112974]: DEBUG oslo_concurrency.lockutils [None req-7d4abbaa-a76c-48e4-b5b1-9640b8a20642 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:40.448759 n-d-860284-1 devstack@n-api.service[112974]: DEBUG oslo_concurrency.lockutils [None req-7d4abbaa-a76c-48e4-b5b1-9640b8a20642 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:40.449534 n-d-860284-1 devstack@n-api.service[112974]: DEBUG oslo_concurrency.lockutils [None req-7d4abbaa-a76c-48e4-b5b1-9640b8a20642 admin admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:40.449964 n-d-860284-1 devstack@n-api.service[112974]: DEBUG oslo_concurrency.lockutils [None req-7d4abbaa-a76c-48e4-b5b1-9640b8a20642 admin admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:40.450400 n-d-860284-1 devstack@n-api.service[112974]: DEBUG oslo_concurrency.lockutils [None req-7d4abbaa-a76c-48e4-b5b1-9640b8a20642 admin admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:40.475099 n-d-860284-1 devstack@n-api.service[112974]: INFO nova.api.openstack.requestlog [None req-7d4abbaa-a76c-48e4-b5b1-9640b8a20642 admin admin] 10.222.0.43 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.92 time: 0.087904 Oct 04 21:41:40.475679 n-d-860284-1 devstack@n-api.service[112974]: [pid: 112974|app: 0|req: 37/72] 10.222.0.43 () {60 vars in 1193 bytes} [Tue Oct 4 21:41:40 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:42:27.090338 n-d-860284-1 systemd[1]: Stopping Devstack devstack@n-api.service... Oct 04 21:42:27.091290 n-d-860284-1 devstack@n-api.service[112973]: Tue Oct 4 21:42:27 2022 - graceful shutdown triggered... Oct 04 21:42:27.091805 n-d-860284-1 devstack@n-api.service[112974]: Gracefully killing worker 1 (pid: 112974)... Oct 04 21:42:27.092171 n-d-860284-1 devstack@n-api.service[112975]: Gracefully killing worker 2 (pid: 112975)... Oct 04 21:42:27.222303 n-d-860284-1 devstack@n-api.service[112975]: DEBUG dbcounter [-] [112975] Writing DB stats nova_api:SELECT=4 {{(pid=112975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:42:28.092449 n-d-860284-1 devstack@n-api.service[112973]: worker 1 buried after 1 seconds Oct 04 21:42:28.092449 n-d-860284-1 devstack@n-api.service[112973]: worker 2 buried after 1 seconds Oct 04 21:42:28.092449 n-d-860284-1 devstack@n-api.service[112973]: goodbye to uWSGI. Oct 04 21:42:28.094069 n-d-860284-1 systemd[1]: devstack@n-api.service: Succeeded. Oct 04 21:42:28.094661 n-d-860284-1 systemd[1]: Stopped Devstack devstack@n-api.service. Oct 04 21:42:28.097528 n-d-860284-1 systemd[1]: Starting Devstack devstack@n-api.service... Oct 04 21:42:28.120123 n-d-860284-1 devstack@n-api.service[134088]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 04 21:42:28.145693 n-d-860284-1 devstack@n-api.service[134088]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Oct 4 21:42:28 2022] *** Oct 04 21:42:28.145693 n-d-860284-1 devstack@n-api.service[134088]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 04 21:42:28.145693 n-d-860284-1 devstack@n-api.service[134088]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 04 21:42:28.145693 n-d-860284-1 devstack@n-api.service[134088]: nodename: n-d-860284-1 Oct 04 21:42:28.145693 n-d-860284-1 devstack@n-api.service[134088]: machine: x86_64 Oct 04 21:42:28.145693 n-d-860284-1 devstack@n-api.service[134088]: clock source: unix Oct 04 21:42:28.145693 n-d-860284-1 devstack@n-api.service[134088]: pcre jit disabled Oct 04 21:42:28.145693 n-d-860284-1 devstack@n-api.service[134088]: detected number of CPU cores: 4 Oct 04 21:42:28.145693 n-d-860284-1 devstack@n-api.service[134088]: current working directory: / Oct 04 21:42:28.145693 n-d-860284-1 devstack@n-api.service[134088]: detected binary path: /usr/bin/uwsgi-core Oct 04 21:42:28.145693 n-d-860284-1 devstack@n-api.service[134088]: your processes number limit is 47680 Oct 04 21:42:28.145693 n-d-860284-1 devstack@n-api.service[134088]: your memory page size is 4096 bytes Oct 04 21:42:28.145693 n-d-860284-1 devstack@n-api.service[134088]: detected max file descriptor number: 2048 Oct 04 21:42:28.145693 n-d-860284-1 devstack@n-api.service[134088]: lock engine: pthread robust mutexes Oct 04 21:42:28.146919 n-d-860284-1 devstack@n-api.service[134088]: thunder lock: enabled Oct 04 21:42:28.146919 n-d-860284-1 devstack@n-api.service[134088]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 04 21:42:28.146919 n-d-860284-1 devstack@n-api.service[134088]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 04 21:42:28.188495 n-d-860284-1 devstack@n-api.service[134088]: Python main interpreter initialized at 0x555ec3cbe9c0 Oct 04 21:42:28.188495 n-d-860284-1 devstack@n-api.service[134088]: python threads support enabled Oct 04 21:42:28.188495 n-d-860284-1 devstack@n-api.service[134088]: your server socket listen backlog is limited to 100 connections Oct 04 21:42:28.188495 n-d-860284-1 devstack@n-api.service[134088]: your mercy for graceful operations on workers is 90 seconds Oct 04 21:42:28.188982 n-d-860284-1 devstack@n-api.service[134088]: mapped 403077 bytes (393 KB) for 2 cores Oct 04 21:42:28.188982 n-d-860284-1 devstack@n-api.service[134088]: *** Operational MODE: preforking *** Oct 04 21:42:28.189241 n-d-860284-1 devstack@n-api.service[134088]: *** uWSGI is running in multiple interpreter mode *** Oct 04 21:42:28.189241 n-d-860284-1 devstack@n-api.service[134088]: spawned uWSGI master process (pid: 134088) Oct 04 21:42:28.189497 n-d-860284-1 systemd[1]: Started Devstack devstack@n-api.service. Oct 04 21:42:28.190353 n-d-860284-1 devstack@n-api.service[134088]: spawned uWSGI worker 1 (pid: 134101, cores: 1) Oct 04 21:42:28.190499 n-d-860284-1 devstack@n-api.service[134088]: spawned uWSGI worker 2 (pid: 134102, cores: 1) Oct 04 21:42:28.190675 n-d-860284-1 devstack@n-api.service[134088]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 04 21:42:28.909427 n-d-860284-1 devstack@n-api.service[134102]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 04 21:42:29.014856 n-d-860284-1 devstack@n-api.service[134101]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 04 21:42:30.135404 n-d-860284-1 devstack@n-api.service[134101]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 21:42:30.135404 n-d-860284-1 devstack@n-api.service[134101]: from cryptography.utils import int_from_bytes Oct 04 21:42:30.136132 n-d-860284-1 devstack@n-api.service[134101]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 21:42:30.136132 n-d-860284-1 devstack@n-api.service[134101]: from cryptography.utils import int_from_bytes Oct 04 21:42:30.171865 n-d-860284-1 devstack@n-api.service[134102]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 21:42:30.171865 n-d-860284-1 devstack@n-api.service[134102]: from cryptography.utils import int_from_bytes Oct 04 21:42:30.172469 n-d-860284-1 devstack@n-api.service[134102]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 21:42:30.172469 n-d-860284-1 devstack@n-api.service[134102]: from cryptography.utils import int_from_bytes Oct 04 21:42:32.574951 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 04 21:42:32.575730 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 04 21:42:32.575730 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 04 21:42:32.576124 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 04 21:42:32.576347 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 04 21:42:32.576752 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.577094 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.577425 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.577755 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.578097 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.578438 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.578775 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.579113 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.579450 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.579717 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.580041 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.580377 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-860284-1 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.580704 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.581025 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.581349 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.581676 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.581991 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.582319 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.582665 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.583184 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.583643 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.583964 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.584292 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.584641 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.584969 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.585292 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.585633 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.585966 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.586353 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.586879 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.588010 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-860284-1 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.588570 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.589140 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.589560 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.590193 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.590706 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.591172 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.591619 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.592052 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.592435 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.592900 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.593329 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.593786 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.595493 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.595493 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.595493 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.595493 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.596132 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.596391 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.596799 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.597176 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.597647 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.598092 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.598584 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.599029 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.599402 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.599781 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.600218 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.600670 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.601122 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.601558 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.601985 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.602485 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.603489 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.604010 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.604442 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.604875 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.605362 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.605872 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.606314 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.606797 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.607434 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.607932 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.43 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.608314 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.43 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.608749 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.609221 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.609657 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.610088 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.610736 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.611123 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.611571 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.611995 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.612545 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.612959 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.613384 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.613774 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.614184 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.614651 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.615093 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.615533 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.616033 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.616477 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.616902 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.617397 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.617869 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.618303 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.618793 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.619225 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.619659 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.620092 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.620520 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.620955 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.621381 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.621864 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.622314 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.622812 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.623250 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.623679 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.624120 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.624549 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.625045 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.625470 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.625860 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.626348 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.626846 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.627318 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.627805 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.628276 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.628728 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.629195 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.629656 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.630999 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.630999 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.631943 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.631943 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.632457 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.632928 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.633406 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.633883 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.635356 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.635356 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.635872 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.636610 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.636827 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.637264 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.641235 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.641235 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.641235 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.641235 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.641235 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.641235 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.641235 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.642525 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.642525 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.643017 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.643456 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.643895 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.644357 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.644829 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.645264 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.645703 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.646210 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.646774 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.647237 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.647683 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.648226 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.648681 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.649123 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.650091 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.650605 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.651059 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.651500 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.651970 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.652443 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.652875 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.653330 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.653776 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.654207 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.654672 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.655112 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.655573 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.656012 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.656450 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.656983 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.657419 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.657868 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.658432 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.659165 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.659450 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.660022 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.660604 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.661324 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.661739 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.662219 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.662672 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.663066 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.663468 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.663866 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.664256 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.664648 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.665216 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.665705 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.666126 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.666582 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.667096 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.667533 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.667945 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.668502 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.668904 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.669449 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.669915 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.670416 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.670823 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.671219 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.671692 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.672209 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.672624 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.673112 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.673585 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.674036 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.674624 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.675127 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.675560 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.676027 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.676709 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.677235 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.677688 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.678126 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.678688 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.679120 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.679606 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.680059 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.680514 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.681474 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.682526 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.682757 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.683193 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.683614 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.684060 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.684483 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.684906 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.685405 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.685840 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.686387 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.686827 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.687326 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.687807 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.688210 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.688610 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.689077 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.689536 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.690058 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.690527 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.690997 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.691420 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.691896 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.692350 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.692796 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.693261 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.693695 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.694134 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.694601 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.695028 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.695528 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.695967 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.696551 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.697108 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.697674 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.698194 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.698683 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.699151 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.699621 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.700044 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.700487 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.700952 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.701405 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.701846 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.702287 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.702765 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.703203 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.703636 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.704068 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.704494 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.704919 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.705364 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.705859 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.706541 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.706886 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.707334 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.707781 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.708281 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.708776 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.709285 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.709762 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.710223 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.710706 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.711150 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.711588 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.712019 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.712686 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.713555 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.713734 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.714123 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.714607 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.715043 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.715470 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.715986 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.716415 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.716849 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.717280 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.717702 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.718162 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.718642 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.719136 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.719590 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.720106 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.720553 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.720978 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.721406 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.721859 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.722352 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.722821 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.723272 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.723705 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.724173 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.724610 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.725039 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.725473 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.726236 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.726457 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.726889 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.727324 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.728597 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.728970 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.729513 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.729906 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.730448 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.730898 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.731334 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.731769 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.732226 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.732663 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.733099 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.733573 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.734030 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.734507 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.734948 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.735689 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.736256 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.736718 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.737161 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.737629 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.738073 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.738684 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.739131 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.739627 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.740051 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.740581 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.741017 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.741445 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.741884 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.742304 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.742760 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.743206 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.744063 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.744386 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.744814 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.745237 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.745664 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.746098 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.746681 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.747247 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.747665 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.748087 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.748484 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.748953 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.749293 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.749719 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.750244 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.750772 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.751194 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.751675 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.752141 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.752567 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.752995 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.753446 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.753869 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.754297 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.754747 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.755177 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.755601 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.756061 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.756486 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.756949 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.757382 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.757809 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.758234 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.758698 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.759708 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.760226 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.760762 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.761215 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.761636 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.762073 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.762555 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.762973 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.763403 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.763838 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.764304 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.764730 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.765159 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.765592 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.766027 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.766495 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.766924 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.767372 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.767814 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.768273 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.768703 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.769163 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.769582 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.770043 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.770605 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.771182 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.771570 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.771994 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.772371 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.772738 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.773109 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.773558 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.774070 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.774689 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.775146 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.775532 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.776065 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.776456 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.776867 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.777334 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.777759 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.778097 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.778537 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.779030 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.779489 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.780001 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.780498 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.780976 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.781489 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.782006 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.782478 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.782969 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.783368 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.783765 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.784161 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.784628 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.785030 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.785448 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.785856 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.786249 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.786691 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.787093 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.787556 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.787956 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.788338 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.788738 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.789131 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.789601 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.790056 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.791681 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.791895 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.792371 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.792811 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.793250 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.793679 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.794112 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.794633 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.795042 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.795483 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.795882 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.796253 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.796645 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.797040 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.797518 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.797893 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.798261 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.798798 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.799245 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.799682 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.800111 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.800572 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.801034 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.801773 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.802253 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.802794 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.803365 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.803800 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.804229 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.804737 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.805174 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.805610 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.806146 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.806629 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.807213 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.807657 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.808085 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.808528 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.808958 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.809430 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.809989 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.810470 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.810900 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.811451 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.811958 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.812370 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.812882 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.813325 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.813716 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.814087 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.814508 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.814935 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.815374 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.815777 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.816170 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.816565 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.816952 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.817354 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.817824 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.818233 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.818669 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.819187 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.819666 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.820134 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.820615 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.823090 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.823090 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.823090 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.823657 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.823971 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.824405 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.824865 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.825372 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.825806 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.826285 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.826756 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.827283 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.827700 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.828223 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.828656 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.829101 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.829550 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.829990 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.830480 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.830915 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.831355 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.831793 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.832228 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.832689 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.833215 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.833708 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.834141 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.834618 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.835092 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.835616 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.836044 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.836505 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.836949 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.838135 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.839106 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.839273 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.839676 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.840388 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.840815 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.841288 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.841724 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.842159 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.842624 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.843083 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.843592 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.844056 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.844489 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.844943 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.845378 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.845907 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.846353 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.846807 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.847246 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.847670 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.848146 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.848572 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.849037 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.849474 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.849958 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.850431 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.850880 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.851315 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.851760 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.852202 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.852645 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.853513 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.853839 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.854307 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.854795 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.855242 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.856043 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.856499 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.856941 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.857386 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.857839 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.858274 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.858751 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.859197 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.859634 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.860111 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.860542 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.861003 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.861442 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.861888 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.862351 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.862844 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.863382 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.863894 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.864333 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.864828 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.865279 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.865808 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.866410 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.866880 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.867316 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.867824 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.868273 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.868823 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.869257 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.869697 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.870185 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.870700 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.871161 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.871608 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.872068 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.872549 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.872987 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.873513 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.874051 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.874796 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.875292 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.875749 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.876206 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.876691 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.877156 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.877592 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.878038 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.878499 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.878922 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.879403 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.879833 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.880265 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.880733 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.881166 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.881596 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.882071 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.882589 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.883343 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.884452 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.885464 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.885700 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.886115 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.886611 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.887039 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.887484 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.887922 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.888362 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.888802 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.889232 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.889652 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.890072 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.890554 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.891056 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.891573 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.892031 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.892462 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.892961 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.893437 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.893907 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.894313 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.894729 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.895134 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.895545 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.896005 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.896425 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.896918 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.897343 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.897771 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.898190 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.898707 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.899204 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.899738 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.900193 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.900650 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.901109 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.901538 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.901987 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.902487 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.902935 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.903379 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.903820 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.904395 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.904831 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.905650 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.906140 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.906628 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.907104 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.907566 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.908121 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.908574 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.908990 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.909408 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.909871 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.910281 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.910738 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.911195 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.911677 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.912150 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.912645 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.913106 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.913569 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.914036 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.914556 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.915004 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.916075 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.916574 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.917073 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.917565 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.918009 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.918516 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.918966 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.919401 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.919833 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.920289 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.920730 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.921163 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.921605 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.922059 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.922547 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.922982 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.923865 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.924315 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.924863 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.926772 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.926772 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.926772 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.927282 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.927677 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.928264 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.928805 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.929403 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.930008 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.930575 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.931106 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.931528 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.932042 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.932611 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.933172 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.933672 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.934072 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.934512 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.935062 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.935522 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.936004 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.936481 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.937008 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.937411 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.937807 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.938192 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.938703 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.939285 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.939713 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.940141 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.940574 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.941018 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.941445 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.941951 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.942486 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.942913 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.943338 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.943810 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.944264 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.944707 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.945155 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.945620 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.946062 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.947184 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.947559 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.948037 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.948479 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.948934 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.949492 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.949936 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.950410 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.950858 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.951321 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.951769 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.952288 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.952736 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.953184 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.953615 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.954090 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.954574 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.955059 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.955582 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.956002 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 04 21:42:32.956653 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.956790 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 04 21:42:32.956916 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.957068 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 04 21:42:32.957219 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 04 21:42:32.957342 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.957484 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 04 21:42:32.957806 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.958133 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.958633 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.958963 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.959202 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.959503 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.959756 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.959998 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.960245 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.960476 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.960704 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.960704 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.961158 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.961409 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.961409 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.961409 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-860284-1 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.962132 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.962569 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.962838 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.962838 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.963148 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.963298 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.963445 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.963634 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.963634 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.964113 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.964341 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.964569 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.964795 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.964795 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.965310 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.965548 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.965548 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.965548 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.966206 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.966469 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.966469 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.966982 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.967214 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.967214 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.967631 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.968061 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.968061 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.968483 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.968743 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-860284-1 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.968743 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.968743 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.969412 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.969578 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.969578 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.969918 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.970104 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.970104 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.970447 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.970604 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.970604 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.970894 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.971085 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.971085 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.971470 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.971638 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.971787 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.972029 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.972270 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.972430 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.972716 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:32.972881 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.973031 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.973189 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=134101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 04 21:42:32.973339 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.973519 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.973827 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.974076 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.974489 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.974822 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.975237 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.975471 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.975727 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.975974 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.976293 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.976613 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.976922 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.977230 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.977535 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.978572 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.979013 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.979328 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.979640 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.979952 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.980278 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.980599 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.980924 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.981237 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.981566 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.981971 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.43 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.982223 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.43 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.982566 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.982891 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.983212 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.983525 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.983847 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.984166 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.984473 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.984783 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.985089 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.985414 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.985749 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.986059 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.986310 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.986636 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.986944 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.987265 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.987574 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.987885 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.988193 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.988508 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.988811 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.989116 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.989420 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.989723 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.990028 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.990334 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.990720 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.991029 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.991349 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.991652 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.991983 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.992305 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.992613 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.992930 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.993231 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.993829 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.994159 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.994494 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.994893 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.995221 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.995585 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.995893 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.996214 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.996523 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.996865 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.997303 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.997608 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.997918 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.998239 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.998555 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.998972 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.999386 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.999627 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:32.999853 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:33.000100 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:33.000339 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:33.000641 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:33.000941 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:33.001272 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:33.001599 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:33.001908 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:33.002217 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:33.002554 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:33.002879 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:42:33.003282 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.003545 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.003891 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.004288 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.004531 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.004856 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.005176 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.005487 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.005877 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.006122 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.006445 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.006758 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.007141 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.007458 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.007825 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.008161 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.008532 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.008857 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.010112 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.010112 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.010648 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.010830 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.011725 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.011725 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.011725 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.012224 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.012491 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.012938 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.013203 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.013591 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.013833 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.014081 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.014468 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.014779 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.015093 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.015416 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.015871 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.016251 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.016564 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.016885 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.017349 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.017920 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.018434 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.018823 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.019193 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.019520 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.019890 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.020552 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.020552 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.020890 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.021134 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.021453 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.021810 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.022120 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.022454 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.022774 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.023089 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.023441 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.023747 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.024056 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.024391 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.024769 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.025084 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.025397 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.025713 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.026018 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.026323 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.026739 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.027049 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.027378 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.027692 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.027999 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.028324 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.028632 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.028941 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.029262 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.029575 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.029888 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.030203 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.030567 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.030899 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.031219 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.031532 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.031870 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.032205 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.032513 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.032840 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.033171 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.033550 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.033825 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.034103 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.034405 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.034715 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.035040 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.035312 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.035626 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.035929 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.036234 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.036535 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.036839 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.037166 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.037477 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.037786 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.038086 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.038467 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.038942 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.039175 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.039603 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.039945 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.041139 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.041139 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.044929 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.044929 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.044929 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.044929 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.044929 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.044929 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.044929 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.044929 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.047529 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.047529 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.047529 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.047529 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.047529 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.047529 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.047529 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.047529 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.078915 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.078915 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.078915 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.078915 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.078915 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.078915 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.078915 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.078915 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.080091 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.080091 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.080091 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.080091 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.080091 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.080091 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.080091 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.080091 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.081748 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.081748 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.081748 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.081748 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.081748 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.081748 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.081748 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.081748 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.083960 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.083960 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.083960 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.083960 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.083960 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.083960 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.083960 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.083960 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.086422 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.086422 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.086422 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.086422 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.086422 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.086422 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.086422 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.086422 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.089104 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.089104 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.089104 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.089104 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.089104 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.089104 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.089104 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.089104 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.090568 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.090568 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.090568 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.090568 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.090568 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.090568 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.090568 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.090568 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.091388 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.091388 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.091388 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.091388 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.091388 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.091388 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.091388 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.091388 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.092324 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.092324 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.092545 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.092814 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.093055 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.093390 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.093734 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.094054 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.094830 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.095066 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.095403 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.095727 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.096274 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.097167 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.097167 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.097439 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.097919 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.098127 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.098896 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.098896 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.099219 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.099547 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.099864 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.100181 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.100498 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.100819 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.101133 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.101445 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.101754 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.102067 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.102464 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.103133 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.103133 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.103495 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.103735 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.104248 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.104564 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.104878 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.105189 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.105551 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.105865 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.106517 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.106656 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.106923 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.107339 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.107544 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.107887 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.108219 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.108494 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.108802 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.109123 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.109438 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.109746 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.110061 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.110402 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.110718 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.111033 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.111340 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.111699 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.111962 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.112289 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.112604 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.112910 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.113215 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.113529 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.113842 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.114217 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.114486 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.114795 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.115118 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.115686 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.116042 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.116514 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.116669 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.117000 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.117516 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.118119 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.118275 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.119301 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.119471 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.119802 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.120117 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.120422 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.120741 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.121080 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.121405 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.121714 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.122031 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.122339 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.122683 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.122991 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.123308 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.123614 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.123917 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.124367 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.124798 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.125228 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.125694 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.126153 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.126648 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.127096 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.127540 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.128035 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.128484 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.129005 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.129439 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.129895 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.130227 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.134399 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.134399 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.134399 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.134399 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.134399 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.134399 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.134399 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.134399 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.135972 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.135972 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.135972 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.135972 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.135972 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.135972 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.135972 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.135972 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.137369 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.137369 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.137369 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.137369 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.137369 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.137369 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.138403 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.138403 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.138403 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.138403 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.139143 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.139143 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.139521 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.139719 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.140757 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.140757 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.140757 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.141178 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.141178 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.150832 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.150832 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.150832 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.150832 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.150832 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.150832 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.150832 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.150832 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.151866 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.151866 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.151866 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.151866 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.151866 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.151866 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.151866 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.151866 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.152715 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.152715 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.152715 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.152715 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.152715 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.152715 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.152715 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.152715 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.153583 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.153583 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.153583 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.153583 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.153583 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.153583 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.153583 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.153583 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.154737 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.154737 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.154737 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.154737 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.154737 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.154737 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.154737 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.154737 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.155797 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.155797 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.155797 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.155797 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.156224 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.156224 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.157004 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.157004 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.157299 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.157627 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.157956 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.158263 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.158599 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.158916 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.159224 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.159533 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.159866 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.160174 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.160487 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.160800 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.161111 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.161415 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.161720 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.162049 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.162352 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.163316 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.163316 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.163316 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.163696 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.163945 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.164269 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.164584 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.164889 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.165372 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.165771 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.166212 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.166547 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.166674 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.167524 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.167524 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.167799 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.168022 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.168357 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.168681 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.168997 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.169317 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.169647 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.169954 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.170260 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.170604 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.170912 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.171219 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.171557 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.171872 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.172202 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.172507 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.173072 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.173233 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.173449 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.173775 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.174091 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.175203 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.175203 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.175203 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.175670 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.175967 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.176261 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.176873 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.177304 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.177522 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.177889 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.178337 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.178691 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.179148 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.179496 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.179813 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.180173 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.180493 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.181920 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.182294 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.182938 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.183373 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.183705 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.184062 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.184382 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.184833 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.185157 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.185475 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.185839 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.186158 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.188502 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.188502 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.188502 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.188502 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.188502 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.188502 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.189074 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.189074 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.189431 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.189745 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.190060 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.190467 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.190701 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.191023 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.191342 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.191655 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.191966 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.192283 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.192598 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.192915 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.193228 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.195963 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.195963 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.195963 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.195963 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.195963 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.195963 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.195963 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.195963 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.197843 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.197843 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.197843 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.197843 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.197843 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.198910 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.198910 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.198910 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.199268 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.199394 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.199722 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.200031 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.200337 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.200669 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.200981 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.201423 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.201612 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.201927 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.202589 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.202952 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.203275 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.203716 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.203967 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.204333 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.205133 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.205133 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.205391 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.205604 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.205942 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.206252 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.206613 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.207000 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.207325 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.207638 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.207944 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.208257 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.208856 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.208856 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.209300 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.209791 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.209791 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.210160 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.210529 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.210788 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.211178 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.211491 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.211814 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.212653 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.212968 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.213278 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.213594 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.213951 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.214268 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.214637 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.215358 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.215358 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.215587 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.215891 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.216202 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.216539 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.216858 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.217174 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.217533 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.217855 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.218496 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.219035 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.219227 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.219759 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.219891 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.220207 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.220516 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.220827 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.221157 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.221472 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.221789 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.222100 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.222449 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.222768 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.223081 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.223393 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.223706 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.224115 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.224324 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.224782 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.224946 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.225629 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.225629 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.225883 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.226226 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.226579 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.226901 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.227219 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.227540 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.227951 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.228266 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.228578 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.228889 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.229336 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.229547 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.229985 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.230171 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.230645 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.230961 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.231286 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.231606 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.231918 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.232246 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.232574 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.233282 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.233282 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.233538 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.233834 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.234316 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.234649 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.234974 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.235176 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.235886 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.235886 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.236111 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.237134 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.237134 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.237134 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.237505 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.237638 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.237947 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.238329 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.238671 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.238978 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.239567 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.239567 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.239886 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.240239 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.240494 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.240798 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.241101 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.241413 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.241718 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.242023 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.242326 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.242663 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.242966 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.243840 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.244188 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.244529 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.244831 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.245157 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.245465 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.246233 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.246233 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.246618 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.246773 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.247052 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.247393 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.247707 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.248025 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.248341 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.248653 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.248966 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.249280 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.249770 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.249931 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.250240 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.250677 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.250910 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.251236 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.251557 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.251867 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.252199 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.252512 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.252827 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.253138 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.253447 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.253758 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.254075 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.254422 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.254780 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.255029 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.255342 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.255679 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.256023 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.256690 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.256690 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.256938 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.257358 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.257594 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.257942 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.258271 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.258637 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.258996 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.259355 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:42:33.259600 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=134102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 04 21:42:33.283829 n-d-860284-1 devstack@n-api.service[134101]: INFO dbcounter [None req-7975741e-af22-422b-9898-1546e002d197 None None] Registered counter for database nova_api Oct 04 21:42:33.311201 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_db.sqlalchemy.engines [None req-7975741e-af22-422b-9898-1546e002d197 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134101) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 21:42:33.320499 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writer thread running {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 21:42:33.324375 n-d-860284-1 devstack@n-api.service[134102]: INFO dbcounter [None req-37b3e977-cbc8-478c-9e73-19bc1fe061de None None] Registered counter for database nova_api Oct 04 21:42:33.347657 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_db.sqlalchemy.engines [None req-37b3e977-cbc8-478c-9e73-19bc1fe061de None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134102) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 21:42:33.355770 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writer thread running {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 21:42:33.394934 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.context [None req-7975741e-af22-422b-9898-1546e002d197 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1297bf18-d456-4d7b-91a9-0a07f1cafd2a(cell1) {{(pid=134101) load_cells /opt/stack/nova/nova/context.py:464}} Oct 04 21:42:33.399200 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7975741e-af22-422b-9898-1546e002d197 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:42:33.399900 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7975741e-af22-422b-9898-1546e002d197 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:42:33.401955 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7975741e-af22-422b-9898-1546e002d197 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:42:33.402931 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7975741e-af22-422b-9898-1546e002d197 None None] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:42:33.403524 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7975741e-af22-422b-9898-1546e002d197 None None] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:42:33.405770 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7975741e-af22-422b-9898-1546e002d197 None None] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:42:33.408793 n-d-860284-1 devstack@n-api.service[134101]: INFO dbcounter [None req-7975741e-af22-422b-9898-1546e002d197 None None] Registered counter for database nova_cell0 Oct 04 21:42:33.413671 n-d-860284-1 devstack@n-api.service[134101]: INFO dbcounter [None req-7975741e-af22-422b-9898-1546e002d197 None None] Registered counter for database nova_cell1 Oct 04 21:42:33.422648 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_db.sqlalchemy.engines [None req-7975741e-af22-422b-9898-1546e002d197 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134101) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 21:42:33.425395 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_db.sqlalchemy.engines [None req-7975741e-af22-422b-9898-1546e002d197 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134101) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 21:42:33.430127 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writer thread running {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 21:42:33.433201 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.context [None req-37b3e977-cbc8-478c-9e73-19bc1fe061de None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1297bf18-d456-4d7b-91a9-0a07f1cafd2a(cell1) {{(pid=134102) load_cells /opt/stack/nova/nova/context.py:464}} Oct 04 21:42:33.439449 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-37b3e977-cbc8-478c-9e73-19bc1fe061de None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:42:33.440270 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-37b3e977-cbc8-478c-9e73-19bc1fe061de None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:42:33.442008 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-37b3e977-cbc8-478c-9e73-19bc1fe061de None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:42:33.442973 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-37b3e977-cbc8-478c-9e73-19bc1fe061de None None] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:42:33.443494 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-37b3e977-cbc8-478c-9e73-19bc1fe061de None None] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:42:33.446225 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-37b3e977-cbc8-478c-9e73-19bc1fe061de None None] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:42:33.448732 n-d-860284-1 devstack@n-api.service[134102]: INFO dbcounter [None req-37b3e977-cbc8-478c-9e73-19bc1fe061de None None] Registered counter for database nova_cell0 Oct 04 21:42:33.453713 n-d-860284-1 devstack@n-api.service[134102]: INFO dbcounter [None req-37b3e977-cbc8-478c-9e73-19bc1fe061de None None] Registered counter for database nova_cell1 Oct 04 21:42:33.466784 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_db.sqlalchemy.engines [None req-37b3e977-cbc8-478c-9e73-19bc1fe061de None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134102) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 21:42:33.467951 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_db.sqlalchemy.engines [None req-37b3e977-cbc8-478c-9e73-19bc1fe061de None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134102) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 21:42:33.477020 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writer thread running {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 21:42:33.479263 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writer thread running {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 21:42:33.593347 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writer thread running {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 21:42:33.606567 n-d-860284-1 devstack@n-api.service[134101]: INFO dbcounter [None req-7975741e-af22-422b-9898-1546e002d197 None None] Registered counter for database nova_cell0 Oct 04 21:42:33.617621 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_db.sqlalchemy.engines [None req-7975741e-af22-422b-9898-1546e002d197 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134101) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 21:42:33.626021 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writer thread running {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 21:42:33.650918 n-d-860284-1 devstack@n-api.service[134102]: INFO dbcounter [None req-37b3e977-cbc8-478c-9e73-19bc1fe061de None None] Registered counter for database nova_cell0 Oct 04 21:42:33.660343 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_db.sqlalchemy.engines [None req-37b3e977-cbc8-478c-9e73-19bc1fe061de None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134102) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 21:42:33.665649 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writer thread running {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 21:42:34.130413 n-d-860284-1 devstack@n-api.service[134102]: WARNING keystonemiddleware.auth_token [None req-37b3e977-cbc8-478c-9e73-19bc1fe061de None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 04 21:42:34.138134 n-d-860284-1 devstack@n-api.service[134102]: WARNING keystonemiddleware.auth_token [None req-37b3e977-cbc8-478c-9e73-19bc1fe061de None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 04 21:42:34.219939 n-d-860284-1 devstack@n-api.service[134101]: WARNING keystonemiddleware.auth_token [None req-7975741e-af22-422b-9898-1546e002d197 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 04 21:42:34.235385 n-d-860284-1 devstack@n-api.service[134101]: WARNING keystonemiddleware.auth_token [None req-7975741e-af22-422b-9898-1546e002d197 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 04 21:42:34.498284 n-d-860284-1 devstack@n-api.service[134102]: WARNING keystonemiddleware.auth_token [None req-37b3e977-cbc8-478c-9e73-19bc1fe061de None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 04 21:42:34.504816 n-d-860284-1 devstack@n-api.service[134102]: WARNING keystonemiddleware.auth_token [None req-37b3e977-cbc8-478c-9e73-19bc1fe061de None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 04 21:42:34.511220 n-d-860284-1 devstack@n-api.service[134102]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x555ec3cbe9c0 pid: 134102 (default app) Oct 04 21:42:34.634407 n-d-860284-1 devstack@n-api.service[134101]: WARNING keystonemiddleware.auth_token [None req-7975741e-af22-422b-9898-1546e002d197 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 04 21:42:34.642869 n-d-860284-1 devstack@n-api.service[134101]: WARNING keystonemiddleware.auth_token [None req-7975741e-af22-422b-9898-1546e002d197 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 04 21:42:34.648575 n-d-860284-1 devstack@n-api.service[134101]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x555ec3cbe9c0 pid: 134101 (default app) Oct 04 21:43:15.973236 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_api:SELECT=3 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:43:15.974061 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell0:SELECT=3 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:43:15.975135 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=3 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:43:15.976401 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell0:SELECT=3 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:43:17.706203 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-0e88db38-63e3-4960-aced-5f64fa525000 tempest-AZAdminNegativeTestJSON-995896986 tempest-AZAdminNegativeTestJSON-995896986-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:17.708109 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-0e88db38-63e3-4960-aced-5f64fa525000 tempest-AZAdminNegativeTestJSON-995896986 tempest-AZAdminNegativeTestJSON-995896986-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': '73a0bceae304439fba463c851219031a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecbddab94a1e465f84ea217d10a1765e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:43:17.711732 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-0e88db38-63e3-4960-aced-5f64fa525000 tempest-AZAdminNegativeTestJSON-995896986 tempest-AZAdminNegativeTestJSON-995896986-project] Request method failure captured: Oct 04 21:43:17.711732 n-d-860284-1 devstack@n-api.service[134102]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 Oct 04 21:43:17.711732 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 21:43:17.711732 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 21:43:17.711732 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 21:43:17.711732 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 21:43:17.711732 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 21:43:17.711732 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 21:43:17.711732 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 21:43:17.711732 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 21:43:17.711732 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPKjxpoAQ544PWAO28GLhAUkhe3rXA4Ui3RKbujV45HkoaoIpSr2B0vOHuEkwgw36E7eB0tO4ws90E0zbI984GLzEUX8xV1gFdNia26mlUZSozEEZ135U9UkYt5mvQeB-39pmwLCZihLerkJd1utClKfoEQpnTijae-npl97tGqhR3bo Oct 04 21:43:17.711732 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 21:43:17.711732 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 21:43:17.711732 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 21:43:17.711732 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 21:43:17.711732 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 21:43:17.711732 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 21:43:17.711732 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: ecbddab94a1e465f84ea217d10a1765e Oct 04 21:43:17.711732 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-AZAdminNegativeTestJSON-995896986 Oct 04 21:43:17.711732 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 21:43:17.711732 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 21:43:17.713096 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ecbddab94a1e465f84ea217d10a1765e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_ecbddab94a1e465f84ea217d10a1765e", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ecbddab94a1e465f84ea217d10a1765e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/ecbddab94a1e465f84ea217d10a1765e"}]}] Oct 04 21:43:17.713096 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-AZAdminNegativeTestJSON-995896986 Oct 04 21:43:17.713096 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: ecbddab94a1e465f84ea217d10a1765e Oct 04 21:43:17.713096 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-995896986 Oct 04 21:43:17.713096 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-AZAdminNegativeTestJSON-995896986-project Oct 04 21:43:17.713096 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 21:43:17.713096 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 21:43:17.713096 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: 73a0bceae304439fba463c851219031a Oct 04 21:43:17.713096 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-AZAdminNegativeTestJSON-995896986-project Oct 04 21:43:17.713096 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 21:43:17.713096 n-d-860284-1 devstack@n-api.service[134102]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 04 21:43:17.713096 n-d-860284-1 devstack@n-api.service[134102]: action_args: {} Oct 04 21:43:17.713869 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:43:17.713869 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:43:17.713869 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:43:17.713869 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:43:17.713869 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:43:17.713869 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:43:17.713869 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:43:17.713869 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:43:17.713869 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail Oct 04 21:43:17.713869 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) Oct 04 21:43:17.713869 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 21:43:17.713869 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 21:43:17.713869 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 21:43:17.713869 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 21:43:17.713869 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 21:43:17.713869 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 21:43:17.713869 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 21:43:17.713869 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 21:43:17.713869 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 21:43:17.715064 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 21:43:17.715064 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 21:43:17.715064 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 21:43:17.715064 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 21:43:17.715064 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 21:43:17.715064 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 04 21:43:17.715064 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:43:17.715064 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:43:17.715064 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:43:17.715064 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:43:17.715064 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:43:17.715064 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:43:17.715064 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 21:43:17.715064 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 21:43:17.715064 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 04 21:43:17.715064 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:43:17.715064 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-0e88db38-63e3-4960-aced-5f64fa525000 tempest-AZAdminNegativeTestJSON-995896986 tempest-AZAdminNegativeTestJSON-995896986-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:43:17.716036 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-0e88db38-63e3-4960-aced-5f64fa525000 tempest-AZAdminNegativeTestJSON-995896986 tempest-AZAdminNegativeTestJSON-995896986-project] 10.222.0.43 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 1.745605 Oct 04 21:43:17.718666 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1/1] 10.222.0.43 () {58 vars in 1185 bytes} [Tue Oct 4 21:43:15 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 1752 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 04 21:43:17.781731 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=3 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:43:17.782205 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=3 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:43:17.783183 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=3 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:43:17.783905 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=3 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:43:18.550139 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-af850ee8-493e-4af4-85bd-73a3fe958222 tempest-FlavorsAdminTestJSON-34401135 tempest-FlavorsAdminTestJSON-34401135-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-957567635", "id": 1370840132, "os-flavor-access:is_public": "True"}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:43:18.613322 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-af850ee8-493e-4af4-85bd-73a3fe958222 tempest-FlavorsAdminTestJSON-34401135 tempest-FlavorsAdminTestJSON-34401135-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 429 microversion: 2.1 time: 0.603161 Oct 04 21:43:18.617084 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2/2] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 21:43:18 2022] POST /compute/v2.1/flavors => generated 429 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:43:18.630477 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-77887587-6ecd-415d-937f-d9bd48eac1be tempest-FlavorsAdminTestJSON-34401135 tempest-FlavorsAdminTestJSON-34401135-project-admin] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:18.665094 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-77887587-6ecd-415d-937f-d9bd48eac1be tempest-FlavorsAdminTestJSON-34401135 tempest-FlavorsAdminTestJSON-34401135-project-admin] 10.222.0.43 "DELETE /compute/v2.1/flavors/1370840132" status: 202 len: 0 microversion: 2.1 time: 0.038795 Oct 04 21:43:18.665875 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3/3] 10.222.0.43 () {58 vars in 1161 bytes} [Tue Oct 4 21:43:18 2022] DELETE /compute/v2.1/flavors/1370840132 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 21:43:18.674931 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-b14b9a13-6e29-4eb0-b1a3-43c92274c612 tempest-FlavorsAdminTestJSON-34401135 tempest-FlavorsAdminTestJSON-34401135-project-admin] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:18.709776 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-b14b9a13-6e29-4eb0-b1a3-43c92274c612 tempest-FlavorsAdminTestJSON-34401135 tempest-FlavorsAdminTestJSON-34401135-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.039436 Oct 04 21:43:18.710418 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 4/4] 10.222.0.43 () {58 vars in 1146 bytes} [Tue Oct 4 21:43:18 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:43:18.733829 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-0d3d3c66-eb44-4951-ba95-a7bab1eb9df3 tempest-FlavorsAdminTestJSON-34401135 tempest-FlavorsAdminTestJSON-34401135-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-106015134", "id": 748904985, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:43:18.759853 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-0d3d3c66-eb44-4951-ba95-a7bab1eb9df3 tempest-FlavorsAdminTestJSON-34401135 tempest-FlavorsAdminTestJSON-34401135-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.032677 Oct 04 21:43:18.760457 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 5/5] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 21:43:18 2022] POST /compute/v2.1/flavors => generated 413 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:43:18.772317 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-b9c6ed9a-a9ae-4a52-bc56-f7e088e46890 tempest-FlavorsAdminTestJSON-34401135 tempest-FlavorsAdminTestJSON-34401135-project-admin] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:18.796965 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-b9c6ed9a-a9ae-4a52-bc56-f7e088e46890 tempest-FlavorsAdminTestJSON-34401135 tempest-FlavorsAdminTestJSON-34401135-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 5394 microversion: 2.1 time: 0.027949 Oct 04 21:43:18.798165 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 6/6] 10.222.0.43 () {58 vars in 1146 bytes} [Tue Oct 4 21:43:18 2022] GET /compute/v2.1/flavors/detail => generated 5394 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:43:18.817119 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-52d389a5-5cb5-4130-85bb-493d0e22274a tempest-FlavorsAdminTestJSON-34401135 tempest-FlavorsAdminTestJSON-34401135-project-admin] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:18.839614 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-52d389a5-5cb5-4130-85bb-493d0e22274a tempest-FlavorsAdminTestJSON-34401135 tempest-FlavorsAdminTestJSON-34401135-project-admin] 10.222.0.43 "DELETE /compute/v2.1/flavors/748904985" status: 202 len: 0 microversion: 2.1 time: 0.025954 Oct 04 21:43:18.840202 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 7/7] 10.222.0.43 () {58 vars in 1158 bytes} [Tue Oct 4 21:43:18 2022] DELETE /compute/v2.1/flavors/748904985 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 21:43:18.857003 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-f684fd1b-a1d6-4f06-93a8-4bf63dace1ee tempest-FlavorsAdminTestJSON-34401135 tempest-FlavorsAdminTestJSON-34401135-project-admin] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:18.885983 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-f684fd1b-a1d6-4f06-93a8-4bf63dace1ee tempest-FlavorsAdminTestJSON-34401135 tempest-FlavorsAdminTestJSON-34401135-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.040641 Oct 04 21:43:18.887639 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 8/8] 10.222.0.43 () {58 vars in 1146 bytes} [Tue Oct 4 21:43:18 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:43:18.908147 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-8444f689-8646-4cfe-a776-dc7009d8e958 tempest-FlavorsAdminTestJSON-34401135 tempest-FlavorsAdminTestJSON-34401135-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1885747745", "id": 848494388, "os-flavor-access:is_public": "True"}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:43:18.932714 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-8444f689-8646-4cfe-a776-dc7009d8e958 tempest-FlavorsAdminTestJSON-34401135 tempest-FlavorsAdminTestJSON-34401135-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 426 microversion: 2.1 time: 0.029536 Oct 04 21:43:18.933310 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 9/9] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 21:43:18 2022] POST /compute/v2.1/flavors => generated 426 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:43:18.957684 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-aa45dad6-80b4-47a9-9b02-683ebeb0ab9e tempest-FlavorsAdminTestJSON-34401135 tempest-FlavorsAdminTestJSON-34401135-project-admin] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:18.988666 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-aa45dad6-80b4-47a9-9b02-683ebeb0ab9e tempest-FlavorsAdminTestJSON-34401135 tempest-FlavorsAdminTestJSON-34401135-project-admin] 10.222.0.43 "DELETE /compute/v2.1/flavors/848494388" status: 202 len: 0 microversion: 2.1 time: 0.046439 Oct 04 21:43:18.992292 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 10/10] 10.222.0.43 () {58 vars in 1158 bytes} [Tue Oct 4 21:43:18 2022] DELETE /compute/v2.1/flavors/848494388 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:43:19.001814 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-7b0d4d1a-7ab5-49bf-b999-73025d21f54f tempest-FlavorsAdminTestJSON-34401135 tempest-FlavorsAdminTestJSON-34401135-project-admin] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:19.038050 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-7b0d4d1a-7ab5-49bf-b999-73025d21f54f tempest-FlavorsAdminTestJSON-34401135 tempest-FlavorsAdminTestJSON-34401135-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.042513 Oct 04 21:43:19.047304 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 11/11] 10.222.0.43 () {58 vars in 1146 bytes} [Tue Oct 4 21:43:18 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:43:19.068769 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-f369cdca-e157-4ad9-8b7f-949ce011bd32 tempest-FlavorsAdminTestJSON-34401135 tempest-FlavorsAdminTestJSON-34401135-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1657352657", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:43:19.106085 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-f369cdca-e157-4ad9-8b7f-949ce011bd32 tempest-FlavorsAdminTestJSON-34401135 tempest-FlavorsAdminTestJSON-34401135-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.040026 Oct 04 21:43:19.107010 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 12/12] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 21:43:19 2022] POST /compute/v2.1/flavors => generated 507 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:43:19.121995 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-1bdf231c-1887-4bbc-b486-efd30ca162c9 tempest-FlavorsAdminTestJSON-34401135 tempest-FlavorsAdminTestJSON-34401135-project-admin] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:19.179741 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-1bdf231c-1887-4bbc-b486-efd30ca162c9 tempest-FlavorsAdminTestJSON-34401135 tempest-FlavorsAdminTestJSON-34401135-project-admin] 10.222.0.43 "DELETE /compute/v2.1/flavors/cf0a6baf-36e4-4bb6-8851-cadc2a6fe724" status: 202 len: 0 microversion: 2.1 time: 0.063789 Oct 04 21:43:19.182418 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 13/13] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 21:43:19 2022] DELETE /compute/v2.1/flavors/cf0a6baf-36e4-4bb6-8851-cadc2a6fe724 => generated 0 bytes in 68 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 21:43:19.199270 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-542e21e5-27ef-4eea-8768-271643f57283 tempest-FlavorsAdminTestJSON-34401135 tempest-FlavorsAdminTestJSON-34401135-project-admin] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:19.226645 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-8ce5d4bf-cd08-41bf-9c21-a53ba7857fc8 tempest-AggregatesAdminTestV241-1655760538 tempest-AggregatesAdminTestV241-1655760538-project-admin] Calling method '.version_select at 0x7fbb34b41f70>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:19.239812 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-8ce5d4bf-cd08-41bf-9c21-a53ba7857fc8 tempest-AggregatesAdminTestV241-1655760538 tempest-AggregatesAdminTestV241-1655760538-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1297bf18-d456-4d7b-91a9-0a07f1cafd2a(cell1) {{(pid=134101) load_cells /opt/stack/nova/nova/compute/api.py:319}} Oct 04 21:43:19.240848 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8ce5d4bf-cd08-41bf-9c21-a53ba7857fc8 tempest-AggregatesAdminTestV241-1655760538 tempest-AggregatesAdminTestV241-1655760538-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:19.241515 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8ce5d4bf-cd08-41bf-9c21-a53ba7857fc8 tempest-AggregatesAdminTestV241-1655760538 tempest-AggregatesAdminTestV241-1655760538-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:19.242153 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8ce5d4bf-cd08-41bf-9c21-a53ba7857fc8 tempest-AggregatesAdminTestV241-1655760538 tempest-AggregatesAdminTestV241-1655760538-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:19.252554 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-542e21e5-27ef-4eea-8768-271643f57283 tempest-FlavorsAdminTestJSON-34401135 tempest-FlavorsAdminTestJSON-34401135-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.065561 Oct 04 21:43:19.254722 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 14/14] 10.222.0.43 () {58 vars in 1146 bytes} [Tue Oct 4 21:43:19 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:43:19.282490 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-ab96bacc-6624-41b0-9c8b-e33996ffcd21 tempest-FlavorsAdminTestJSON-34401135 tempest-FlavorsAdminTestJSON-34401135-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-585105662", "id": "d1f5ec81-1552-4aa4-983f-308c43b17362", "os-flavor-access:is_public": "True"}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:43:19.287484 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8ce5d4bf-cd08-41bf-9c21-a53ba7857fc8 tempest-AggregatesAdminTestV241-1655760538 tempest-AggregatesAdminTestV241-1655760538-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:19.289145 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8ce5d4bf-cd08-41bf-9c21-a53ba7857fc8 tempest-AggregatesAdminTestV241-1655760538 tempest-AggregatesAdminTestV241-1655760538-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:19.291010 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8ce5d4bf-cd08-41bf-9c21-a53ba7857fc8 tempest-AggregatesAdminTestV241-1655760538 tempest-AggregatesAdminTestV241-1655760538-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:19.311487 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8ce5d4bf-cd08-41bf-9c21-a53ba7857fc8 tempest-AggregatesAdminTestV241-1655760538 tempest-AggregatesAdminTestV241-1655760538-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:19.312745 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8ce5d4bf-cd08-41bf-9c21-a53ba7857fc8 tempest-AggregatesAdminTestV241-1655760538 tempest-AggregatesAdminTestV241-1655760538-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:19.313568 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8ce5d4bf-cd08-41bf-9c21-a53ba7857fc8 tempest-AggregatesAdminTestV241-1655760538 tempest-AggregatesAdminTestV241-1655760538-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:19.323120 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-8ce5d4bf-cd08-41bf-9c21-a53ba7857fc8 tempest-AggregatesAdminTestV241-1655760538 tempest-AggregatesAdminTestV241-1655760538-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1423 microversion: 2.41 time: 1.551142 Oct 04 21:43:19.324337 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1/15] 10.222.0.43 () {60 vars in 1208 bytes} [Tue Oct 4 21:43:17 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1423 bytes in 1554 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:43:19.328599 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-ab96bacc-6624-41b0-9c8b-e33996ffcd21 tempest-FlavorsAdminTestJSON-34401135 tempest-FlavorsAdminTestJSON-34401135-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 506 microversion: 2.1 time: 0.046569 Oct 04 21:43:19.329550 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 15/16] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 21:43:19 2022] POST /compute/v2.1/flavors => generated 506 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:43:19.342439 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-665c70a4-163c-44a9-9803-29fbd48a1531 tempest-FlavorsAdminTestJSON-34401135 tempest-FlavorsAdminTestJSON-34401135-project-admin] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:19.348654 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-278147aa-fbb2-4b81-a482-58a7a9da5b2e tempest-AggregatesAdminTestV241-1655760538 tempest-AggregatesAdminTestV241-1655760538-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1814712536"}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:43:19.356191 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.objects.aggregate [None req-278147aa-fbb2-4b81-a482-58a7a9da5b2e tempest-AggregatesAdminTestV241-1655760538 tempest-AggregatesAdminTestV241-1655760538-project-admin] Generated uuid dc3f621d-1a4e-4d3d-9e6b-56eb2a011076 for aggregate {{(pid=134102) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 21:43:19.423948 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-665c70a4-163c-44a9-9803-29fbd48a1531 tempest-FlavorsAdminTestJSON-34401135 tempest-FlavorsAdminTestJSON-34401135-project-admin] 10.222.0.43 "DELETE /compute/v2.1/flavors/d1f5ec81-1552-4aa4-983f-308c43b17362" status: 202 len: 0 microversion: 2.1 time: 0.085314 Oct 04 21:43:19.427560 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2/17] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 21:43:19 2022] DELETE /compute/v2.1/flavors/d1f5ec81-1552-4aa4-983f-308c43b17362 => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:43:19.436712 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-58fab3a2-fe76-42a7-9dae-5a5ca8a17241 tempest-FlavorsAdminTestJSON-34401135 tempest-FlavorsAdminTestJSON-34401135-project-admin] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:19.487336 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-278147aa-fbb2-4b81-a482-58a7a9da5b2e tempest-AggregatesAdminTestV241-1655760538 tempest-AggregatesAdminTestV241-1655760538-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates" status: 200 len: 246 microversion: 2.41 time: 0.143155 Oct 04 21:43:19.497751 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 16/18] 10.222.0.43 () {62 vars in 1205 bytes} [Tue Oct 4 21:43:19 2022] POST /compute/v2.1/os-aggregates => generated 246 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:43:19.501343 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-58fab3a2-fe76-42a7-9dae-5a5ca8a17241 tempest-FlavorsAdminTestJSON-34401135 tempest-FlavorsAdminTestJSON-34401135-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.068220 Oct 04 21:43:19.502577 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3/19] 10.222.0.43 () {58 vars in 1146 bytes} [Tue Oct 4 21:43:19 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:43:19.505706 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-5501e05f-3715-45dd-b535-b4e673847e41 tempest-AggregatesAdminTestV241-1655760538 tempest-AggregatesAdminTestV241-1655760538-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1763831941"}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:43:19.526357 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-d8106d48-eddf-4d5a-a5a8-115ae5b879fb tempest-FlavorsAdminTestJSON-34401135 tempest-FlavorsAdminTestJSON-34401135-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-880233616", "id": 289761320, "os-flavor-access:is_public": "True"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:43:19.601444 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-d8106d48-eddf-4d5a-a5a8-115ae5b879fb tempest-FlavorsAdminTestJSON-34401135 tempest-FlavorsAdminTestJSON-34401135-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 410 microversion: 2.1 time: 0.079563 Oct 04 21:43:19.604089 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4/20] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 21:43:19 2022] POST /compute/v2.1/flavors => generated 410 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:43:19.700327 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-5501e05f-3715-45dd-b535-b4e673847e41 tempest-AggregatesAdminTestV241-1655760538 tempest-AggregatesAdminTestV241-1655760538-project-admin] 10.222.0.43 "PUT /compute/v2.1/os-aggregates/1" status: 200 len: 299 microversion: 2.41 time: 0.201270 Oct 04 21:43:19.700980 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 17/21] 10.222.0.43 () {62 vars in 1210 bytes} [Tue Oct 4 21:43:19 2022] PUT /compute/v2.1/os-aggregates/1 => generated 299 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:43:19.705864 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-c9d889d6-d98c-49cf-ad31-3253077ce418 tempest-FlavorsAdminTestJSON-34401135 tempest-FlavorsAdminTestJSON-34401135-project-admin] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:19.721260 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-c9d889d6-d98c-49cf-ad31-3253077ce418 tempest-FlavorsAdminTestJSON-34401135 tempest-FlavorsAdminTestJSON-34401135-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/289761320" status: 200 len: 410 microversion: 2.1 time: 0.018988 Oct 04 21:43:19.722538 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 18/22] 10.222.0.43 () {58 vars in 1155 bytes} [Tue Oct 4 21:43:19 2022] GET /compute/v2.1/flavors/289761320 => generated 410 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:43:19.727455 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-136a5e18-ef57-4417-9a06-1bb6e7f4b502 tempest-AggregatesAdminTestV241-1655760538 tempest-AggregatesAdminTestV241-1655760538-project-admin] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:19.737658 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-136a5e18-ef57-4417-9a06-1bb6e7f4b502 tempest-AggregatesAdminTestV241-1655760538 tempest-AggregatesAdminTestV241-1655760538-project-admin] 10.222.0.43 "GET /compute/v2.1/os-aggregates/1" status: 200 len: 299 microversion: 2.41 time: 0.013613 Oct 04 21:43:19.738269 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 19/23] 10.222.0.43 () {60 vars in 1190 bytes} [Tue Oct 4 21:43:19 2022] GET /compute/v2.1/os-aggregates/1 => generated 299 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:43:20.119608 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-0f95b7e2-05e0-4df2-9225-6df62aec4b63 tempest-AggregatesAdminNegativeTestJSON-664564698 tempest-AggregatesAdminNegativeTestJSON-664564698-project-admin] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:20.123307 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0f95b7e2-05e0-4df2-9225-6df62aec4b63 tempest-AggregatesAdminNegativeTestJSON-664564698 tempest-AggregatesAdminNegativeTestJSON-664564698-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:20.123799 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0f95b7e2-05e0-4df2-9225-6df62aec4b63 tempest-AggregatesAdminNegativeTestJSON-664564698 tempest-AggregatesAdminNegativeTestJSON-664564698-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:20.124229 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0f95b7e2-05e0-4df2-9225-6df62aec4b63 tempest-AggregatesAdminNegativeTestJSON-664564698 tempest-AggregatesAdminNegativeTestJSON-664564698-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:20.124992 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0f95b7e2-05e0-4df2-9225-6df62aec4b63 tempest-AggregatesAdminNegativeTestJSON-664564698 tempest-AggregatesAdminNegativeTestJSON-664564698-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:20.125446 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0f95b7e2-05e0-4df2-9225-6df62aec4b63 tempest-AggregatesAdminNegativeTestJSON-664564698 tempest-AggregatesAdminNegativeTestJSON-664564698-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:20.125867 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0f95b7e2-05e0-4df2-9225-6df62aec4b63 tempest-AggregatesAdminNegativeTestJSON-664564698 tempest-AggregatesAdminNegativeTestJSON-664564698-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:20.177948 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-0f95b7e2-05e0-4df2-9225-6df62aec4b63 tempest-AggregatesAdminNegativeTestJSON-664564698 tempest-AggregatesAdminNegativeTestJSON-664564698-project-admin] 10.222.0.43 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.564415 Oct 04 21:43:20.178821 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 5/24] 10.222.0.43 () {58 vars in 1176 bytes} [Tue Oct 4 21:43:19 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:43:20.185236 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-8ac46627-ebda-4026-ab01-b1ed6743d412 tempest-AggregatesAdminTestV241-1655760538 tempest-AggregatesAdminTestV241-1655760538-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-860284-1"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:43:20.222028 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8ac46627-ebda-4026-ab01-b1ed6743d412 tempest-AggregatesAdminTestV241-1655760538 tempest-AggregatesAdminTestV241-1655760538-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:20.222570 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8ac46627-ebda-4026-ab01-b1ed6743d412 tempest-AggregatesAdminTestV241-1655760538 tempest-AggregatesAdminTestV241-1655760538-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:20.223018 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8ac46627-ebda-4026-ab01-b1ed6743d412 tempest-AggregatesAdminTestV241-1655760538 tempest-AggregatesAdminTestV241-1655760538-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:20.336194 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-36ccf854-7708-41f2-a637-8b0c581fc489 tempest-FlavorsAdminTestJSON-790532742 tempest-FlavorsAdminTestJSON-790532742-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:20.371088 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-36ccf854-7708-41f2-a637-8b0c581fc489 tempest-FlavorsAdminTestJSON-790532742 tempest-FlavorsAdminTestJSON-790532742-project] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 5391 microversion: 2.1 time: 0.631620 Oct 04 21:43:20.371877 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 20/25] 10.222.0.43 () {58 vars in 1146 bytes} [Tue Oct 4 21:43:19 2022] GET /compute/v2.1/flavors/detail => generated 5391 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:43:20.666438 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-dac29c88-cb14-4132-9e05-53b4dbe33506 tempest-AggregatesAdminTestJSON-1644938243 tempest-AggregatesAdminTestJSON-1644938243-project-admin] Calling method '.version_select at 0x7fbb34112ca0>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:20.673992 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-dac29c88-cb14-4132-9e05-53b4dbe33506 tempest-AggregatesAdminTestJSON-1644938243 tempest-AggregatesAdminTestJSON-1644938243-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1297bf18-d456-4d7b-91a9-0a07f1cafd2a(cell1) {{(pid=134102) load_cells /opt/stack/nova/nova/compute/api.py:319}} Oct 04 21:43:20.674864 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dac29c88-cb14-4132-9e05-53b4dbe33506 tempest-AggregatesAdminTestJSON-1644938243 tempest-AggregatesAdminTestJSON-1644938243-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:20.675319 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dac29c88-cb14-4132-9e05-53b4dbe33506 tempest-AggregatesAdminTestJSON-1644938243 tempest-AggregatesAdminTestJSON-1644938243-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:20.675649 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dac29c88-cb14-4132-9e05-53b4dbe33506 tempest-AggregatesAdminTestJSON-1644938243 tempest-AggregatesAdminTestJSON-1644938243-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:20.706348 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dac29c88-cb14-4132-9e05-53b4dbe33506 tempest-AggregatesAdminTestJSON-1644938243 tempest-AggregatesAdminTestJSON-1644938243-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:20.706900 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dac29c88-cb14-4132-9e05-53b4dbe33506 tempest-AggregatesAdminTestJSON-1644938243 tempest-AggregatesAdminTestJSON-1644938243-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:20.708143 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dac29c88-cb14-4132-9e05-53b4dbe33506 tempest-AggregatesAdminTestJSON-1644938243 tempest-AggregatesAdminTestJSON-1644938243-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:20.724880 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dac29c88-cb14-4132-9e05-53b4dbe33506 tempest-AggregatesAdminTestJSON-1644938243 tempest-AggregatesAdminTestJSON-1644938243-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:20.725491 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dac29c88-cb14-4132-9e05-53b4dbe33506 tempest-AggregatesAdminTestJSON-1644938243 tempest-AggregatesAdminTestJSON-1644938243-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:20.725799 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dac29c88-cb14-4132-9e05-53b4dbe33506 tempest-AggregatesAdminTestJSON-1644938243 tempest-AggregatesAdminTestJSON-1644938243-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:20.733122 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-dac29c88-cb14-4132-9e05-53b4dbe33506 tempest-AggregatesAdminTestJSON-1644938243 tempest-AggregatesAdminTestJSON-1644938243-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1503 microversion: 2.1 time: 0.360027 Oct 04 21:43:20.733841 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 21/26] 10.222.0.43 () {58 vars in 1167 bytes} [Tue Oct 4 21:43:20 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1503 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:43:20.862419 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-8ac46627-ebda-4026-ab01-b1ed6743d412 tempest-AggregatesAdminTestV241-1655760538 tempest-AggregatesAdminTestV241-1655760538-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 314 microversion: 2.41 time: 0.682202 Oct 04 21:43:20.863668 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 6/27] 10.222.0.43 () {62 vars in 1232 bytes} [Tue Oct 4 21:43:20 2022] POST /compute/v2.1/os-aggregates/1/action => generated 314 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:43:20.968088 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-6b324335-e000-4bd2-9daf-757a2d89776f tempest-FlavorsV261TestJSON-871440527 tempest-FlavorsV261TestJSON-871440527-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-1230923662", "id": 813993096, "os-flavor-access:is_public": "True"}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:43:20.994192 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-6b324335-e000-4bd2-9daf-757a2d89776f tempest-FlavorsV261TestJSON-871440527 tempest-FlavorsV261TestJSON-871440527-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 465 microversion: 2.61 time: 0.258691 Oct 04 21:43:20.994799 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 22/28] 10.222.0.43 () {62 vars in 1188 bytes} [Tue Oct 4 21:43:20 2022] POST /compute/v2.1/flavors => generated 465 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:43:20.999576 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-373ed7fb-aae1-4dc4-b57c-c3102147000a tempest-FlavorsAdminTestJSON-34401135 tempest-FlavorsAdminTestJSON-34401135-project-admin] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:21.018431 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-373ed7fb-aae1-4dc4-b57c-c3102147000a tempest-FlavorsAdminTestJSON-34401135 tempest-FlavorsAdminTestJSON-34401135-project-admin] 10.222.0.43 "DELETE /compute/v2.1/flavors/289761320" status: 202 len: 0 microversion: 2.1 time: 0.022250 Oct 04 21:43:21.019152 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 23/29] 10.222.0.43 () {58 vars in 1158 bytes} [Tue Oct 4 21:43:20 2022] DELETE /compute/v2.1/flavors/289761320 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:43:21.026814 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-f6a32cee-2d3c-4519-84f4-1540760310bc tempest-AggregatesAdminTestV241-1655760538 tempest-AggregatesAdminTestV241-1655760538-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-860284-1"}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:43:21.041399 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f6a32cee-2d3c-4519-84f4-1540760310bc tempest-AggregatesAdminTestV241-1655760538 tempest-AggregatesAdminTestV241-1655760538-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:21.041925 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f6a32cee-2d3c-4519-84f4-1540760310bc tempest-AggregatesAdminTestV241-1655760538 tempest-AggregatesAdminTestV241-1655760538-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:21.042482 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f6a32cee-2d3c-4519-84f4-1540760310bc tempest-AggregatesAdminTestV241-1655760538 tempest-AggregatesAdminTestV241-1655760538-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:21.184798 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-c500638b-933a-40c8-8248-bd224171e2b4 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1701135839", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:43:21.710175 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-f6a32cee-2d3c-4519-84f4-1540760310bc tempest-AggregatesAdminTestV241-1655760538 tempest-AggregatesAdminTestV241-1655760538-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 299 microversion: 2.41 time: 0.688917 Oct 04 21:43:21.711736 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 24/30] 10.222.0.43 () {62 vars in 1232 bytes} [Tue Oct 4 21:43:21 2022] POST /compute/v2.1/os-aggregates/1/action => generated 299 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:43:22.035161 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.network.neutron [None req-c500638b-933a-40c8-8248-bd224171e2b4 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] validate_networks() for None {{(pid=134101) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:43:22.079091 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-63715803-fc36-430b-8d90-f6b4dcba95a8 tempest-FlavorsV261TestJSON-463161562 tempest-FlavorsV261TestJSON-463161562-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:22.082294 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=7,nova_api:DELETE=16,nova_api:UPDATE=1 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:43:22.106243 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-63715803-fc36-430b-8d90-f6b4dcba95a8 tempest-FlavorsV261TestJSON-463161562 tempest-FlavorsV261TestJSON-463161562-project] 10.222.0.43 "GET /compute/v2.1/flavors/813993096" status: 200 len: 465 microversion: 2.61 time: 0.391733 Oct 04 21:43:22.107094 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 25/31] 10.222.0.43 () {60 vars in 1196 bytes} [Tue Oct 4 21:43:21 2022] GET /compute/v2.1/flavors/813993096 => generated 465 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:43:22.111853 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-a74c4832-0e21-4b09-972e-aa392d32d2fa tempest-FlavorsAdminTestJSON-34401135 tempest-FlavorsAdminTestJSON-34401135-project-admin] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:22.144965 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-a74c4832-0e21-4b09-972e-aa392d32d2fa tempest-FlavorsAdminTestJSON-34401135 tempest-FlavorsAdminTestJSON-34401135-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 5406 microversion: 2.1 time: 0.036551 Oct 04 21:43:22.146200 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 26/32] 10.222.0.43 () {58 vars in 1146 bytes} [Tue Oct 4 21:43:22 2022] GET /compute/v2.1/flavors/detail => generated 5406 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:43:22.153092 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-a6e2518f-dbc9-4eac-8af0-24ec742206a1 tempest-AggregatesAdminTestV241-1655760538 tempest-AggregatesAdminTestV241-1655760538-project-admin] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:22.200947 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-a6e2518f-dbc9-4eac-8af0-24ec742206a1 tempest-AggregatesAdminTestV241-1655760538 tempest-AggregatesAdminTestV241-1655760538-project-admin] 10.222.0.43 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.41 time: 0.052458 Oct 04 21:43:22.202461 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 27/33] 10.222.0.43 () {60 vars in 1193 bytes} [Tue Oct 4 21:43:22 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:43:22.219893 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-1d1242fe-de89-41cf-b422-692a62ffd0e1 tempest-FlavorsV261TestJSON-871440527 tempest-FlavorsV261TestJSON-871440527-project-admin] Action: 'update', calling method: .version_select at 0x7fbb34f63670>, body: {"flavor": {"description": "new"}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:43:22.313874 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-1d1242fe-de89-41cf-b422-692a62ffd0e1 tempest-FlavorsV261TestJSON-871440527 tempest-FlavorsV261TestJSON-871440527-project-admin] 10.222.0.43 "PUT /compute/v2.1/flavors/813993096" status: 200 len: 466 microversion: 2.61 time: 0.104861 Oct 04 21:43:22.318601 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 28/34] 10.222.0.43 () {62 vars in 1216 bytes} [Tue Oct 4 21:43:22 2022] PUT /compute/v2.1/flavors/813993096 => generated 466 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:43:22.332108 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-dbef7890-0d2a-4193-a17a-008168403bb0 tempest-FlavorsAdminTestJSON-34401135 tempest-FlavorsAdminTestJSON-34401135-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-2123288568", "id": 182769984, "os-flavor-access:is_public": "False"}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:43:22.368123 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-dbef7890-0d2a-4193-a17a-008168403bb0 tempest-FlavorsAdminTestJSON-34401135 tempest-FlavorsAdminTestJSON-34401135-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 0.047564 Oct 04 21:43:22.369004 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 29/35] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 21:43:22 2022] POST /compute/v2.1/flavors => generated 427 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:43:22.386990 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-3b3f6c6f-44ce-489c-8e01-ac4a082c5b61 tempest-AggregatesAdminNegativeTestJSON-664564698 tempest-AggregatesAdminNegativeTestJSON-664564698-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1794060674"}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:43:22.391503 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.objects.aggregate [None req-3b3f6c6f-44ce-489c-8e01-ac4a082c5b61 tempest-AggregatesAdminNegativeTestJSON-664564698 tempest-AggregatesAdminNegativeTestJSON-664564698-project-admin] Generated uuid 802a7dde-5774-41ba-99ff-2eeb491c97b7 for aggregate {{(pid=134102) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 21:43:22.391710 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-c500638b-933a-40c8-8248-bd224171e2b4 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Flavor limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:43:22.392363 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-c500638b-933a-40c8-8248-bd224171e2b4 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Image limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:43:22.393788 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-c500638b-933a-40c8-8248-bd224171e2b4 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Flavor pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:43:22.394327 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-c500638b-933a-40c8-8248-bd224171e2b4 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Image pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:43:22.394897 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-c500638b-933a-40c8-8248-bd224171e2b4 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:43:22.421509 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c500638b-933a-40c8-8248-bd224171e2b4 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:22.422241 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c500638b-933a-40c8-8248-bd224171e2b4 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:22.423093 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c500638b-933a-40c8-8248-bd224171e2b4 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:22.424290 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c500638b-933a-40c8-8248-bd224171e2b4 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:22.425045 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c500638b-933a-40c8-8248-bd224171e2b4 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:22.426028 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c500638b-933a-40c8-8248-bd224171e2b4 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:22.439299 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-3b3f6c6f-44ce-489c-8e01-ac4a082c5b61 tempest-AggregatesAdminNegativeTestJSON-664564698 tempest-AggregatesAdminNegativeTestJSON-664564698-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.057721 Oct 04 21:43:22.456402 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 30/36] 10.222.0.43 () {60 vars in 1164 bytes} [Tue Oct 4 21:43:22 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:43:22.471803 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-13f724ff-a5ae-4087-963e-15f5a4e5a133 tempest-FlavorsV261TestJSON-463161562 tempest-FlavorsV261TestJSON-463161562-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:22.495748 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-c500638b-933a-40c8-8248-bd224171e2b4 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Getting quotas for project 7bedc0e10ab24824a40d06bb91626088. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:43:22.508996 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-c500638b-933a-40c8-8248-bd224171e2b4 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Getting quotas for user af5387dbf4e24960809704c398fe999a and project 7bedc0e10ab24824a40d06bb91626088. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:43:22.528002 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-13f724ff-a5ae-4087-963e-15f5a4e5a133 tempest-FlavorsV261TestJSON-463161562 tempest-FlavorsV261TestJSON-463161562-project] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 6247 microversion: 2.61 time: 0.067994 Oct 04 21:43:22.529075 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 31/37] 10.222.0.43 () {60 vars in 1187 bytes} [Tue Oct 4 21:43:22 2022] GET /compute/v2.1/flavors/detail => generated 6247 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:43:22.534464 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-c500638b-933a-40c8-8248-bd224171e2b4 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Going to run 1 instances... {{(pid=134101) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:43:22.537069 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-3e552164-d5cb-485e-941d-5ad4c2ba1d6e tempest-FlavorsAdminTestJSON-790532742 tempest-FlavorsAdminTestJSON-790532742-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "182769984"}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:43:22.537347 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-c500638b-933a-40c8-8248-bd224171e2b4 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] [instance: 4c692055-b3f9-494b-9279-5a8453ed88ba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='58548514-5dac-426c-81f5-19e3fba33e23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134101) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:43:22.558848 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-3e552164-d5cb-485e-941d-5ad4c2ba1d6e tempest-FlavorsAdminTestJSON-790532742 tempest-FlavorsAdminTestJSON-790532742-project] HTTP exception thrown: Flavor 182769984 could not be found. Oct 04 21:43:22.567632 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-3e552164-d5cb-485e-941d-5ad4c2ba1d6e tempest-FlavorsAdminTestJSON-790532742 tempest-FlavorsAdminTestJSON-790532742-project] Request method failure captured: Oct 04 21:43:22.567632 n-d-860284-1 devstack@n-api.service[134102]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 21:43:22.567632 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 21:43:22.567632 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 21:43:22.567632 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 21:43:22.567632 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 106 Oct 04 21:43:22.567632 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 21:43:22.567632 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 21:43:22.567632 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 21:43:22.567632 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 21:43:22.567632 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPKjzJCI8BJAtH_QIKo3mYRpFAwa853n6eoKiwwvrRseoSUTGfmoJA_wCOMDTgoaOhh5AyLfIvg5X3GVCIJ3zK6pV8Sbr6Me4wEqqZFLu7chmwUZH71Na7g-5dejoO1dURmcZiLsVQgPSh92tpkkF0A0FXO-VIKwdxbLcmYPcygzp2Wg Oct 04 21:43:22.567632 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 21:43:22.567632 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 21:43:22.567632 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 21:43:22.567632 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 21:43:22.567632 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 21:43:22.567632 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 21:43:22.567632 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: 7bc3628126704303bc5cc997dc3cfa71 Oct 04 21:43:22.567632 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-FlavorsAdminTestJSON-790532742 Oct 04 21:43:22.567632 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 21:43:22.567632 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 21:43:22.569210 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/7bc3628126704303bc5cc997dc3cfa71"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_7bc3628126704303bc5cc997dc3cfa71", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/7bc3628126704303bc5cc997dc3cfa71"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/7bc3628126704303bc5cc997dc3cfa71"}]}] Oct 04 21:43:22.569210 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-FlavorsAdminTestJSON-790532742 Oct 04 21:43:22.569210 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: 7bc3628126704303bc5cc997dc3cfa71 Oct 04 21:43:22.569210 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-790532742 Oct 04 21:43:22.569210 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-FlavorsAdminTestJSON-790532742-project Oct 04 21:43:22.569210 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 21:43:22.569210 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 21:43:22.569210 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: 2092a8fc9298481590dd0701b7125582 Oct 04 21:43:22.569210 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-FlavorsAdminTestJSON-790532742-project Oct 04 21:43:22.569210 n-d-860284-1 devstack@n-api.service[134102]: Oct 04 21:43:22.569210 n-d-860284-1 devstack@n-api.service[134102]: {"server": {"name": "test", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "182769984"}} Oct 04 21:43:22.569210 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 21:43:22.569210 n-d-860284-1 devstack@n-api.service[134102]: exception: Flavor 182769984 could not be found. Oct 04 21:43:22.569974 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'body': {'server': {'name': 'test', 'imageRef': '58548514-5dac-426c-81f5-19e3fba33e23', 'flavorRef': '182769984'}}} Oct 04 21:43:22.569974 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:43:22.569974 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:43:22.569974 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Oct 04 21:43:22.569974 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Oct 04 21:43:22.569974 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 04 21:43:22.569974 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 04 21:43:22.569974 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 21:43:22.569974 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 21:43:22.569974 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 04 21:43:22.569974 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 04 21:43:22.569974 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 04 21:43:22.569974 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:43:22.569974 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 04 21:43:22.569974 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 04 21:43:22.569974 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 182769984 could not be found. Oct 04 21:43:22.569974 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:43:22.569974 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:43:22.569974 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:43:22.569974 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:43:22.571573 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:43:22.571573 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:43:22.571573 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:43:22.571573 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:43:22.571573 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:43:22.571573 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:43:22.571573 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:43:22.571573 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:43:22.571573 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:43:22.571573 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:43:22.571573 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:43:22.571573 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:43:22.571573 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 21:43:22.571573 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 04 21:43:22.571573 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 04 21:43:22.571573 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 182769984 could not be found. Oct 04 21:43:22.571573 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:43:22.571573 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:43:22.571573 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:43:22.571573 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:43:22.571573 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:43:22.577215 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:43:22.577215 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:43:22.577215 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:43:22.577215 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 182769984 could not be found. Oct 04 21:43:22.577215 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:43:22.577215 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-3e552164-d5cb-485e-941d-5ad4c2ba1d6e tempest-FlavorsAdminTestJSON-790532742 tempest-FlavorsAdminTestJSON-790532742-project] Returning 400 to user: Flavor 182769984 could not be found. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:43:22.577215 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-3e552164-d5cb-485e-941d-5ad4c2ba1d6e tempest-FlavorsAdminTestJSON-790532742 tempest-FlavorsAdminTestJSON-790532742-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 400 len: 80 microversion: 2.1 time: 0.038333 Oct 04 21:43:22.577215 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 32/38] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 21:43:22 2022] POST /compute/v2.1/servers => generated 80 bytes in 42 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 04 21:43:22.580367 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-980901e6-a8d3-4ff6-9dea-6fe796965b1c tempest-AggregatesAdminNegativeTestJSON-664564698 tempest-AggregatesAdminNegativeTestJSON-664564698-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-860284-1"}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:43:22.598747 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-980901e6-a8d3-4ff6-9dea-6fe796965b1c tempest-AggregatesAdminNegativeTestJSON-664564698 tempest-AggregatesAdminNegativeTestJSON-664564698-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:22.599288 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-980901e6-a8d3-4ff6-9dea-6fe796965b1c tempest-AggregatesAdminNegativeTestJSON-664564698 tempest-AggregatesAdminNegativeTestJSON-664564698-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:22.599828 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-980901e6-a8d3-4ff6-9dea-6fe796965b1c tempest-AggregatesAdminNegativeTestJSON-664564698 tempest-AggregatesAdminNegativeTestJSON-664564698-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:22.601712 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-c500638b-933a-40c8-8248-bd224171e2b4 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.729403 Oct 04 21:43:22.603490 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 7/39] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 21:43:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 1739 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:43:22.612452 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-b4f0a5cf-ba02-4a3b-b0a5-eef57e661e77 tempest-FlavorsV261TestJSON-463161562 tempest-FlavorsV261TestJSON-463161562-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:22.663767 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-b4f0a5cf-ba02-4a3b-b0a5-eef57e661e77 tempest-FlavorsV261TestJSON-463161562 tempest-FlavorsV261TestJSON-463161562-project] 10.222.0.43 "GET /compute/v2.1/flavors" status: 200 len: 3154 microversion: 2.61 time: 0.056196 Oct 04 21:43:22.668166 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 8/40] 10.222.0.43 () {60 vars in 1166 bytes} [Tue Oct 4 21:43:22 2022] GET /compute/v2.1/flavors => generated 3154 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:43:22.688136 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-bedcfe31-d06c-4cb8-9797-40f44fc933e9 tempest-FlavorsAdminTestJSON-34401135 tempest-FlavorsAdminTestJSON-34401135-project-admin] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:22.718226 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-bedcfe31-d06c-4cb8-9797-40f44fc933e9 tempest-FlavorsAdminTestJSON-34401135 tempest-FlavorsAdminTestJSON-34401135-project-admin] 10.222.0.43 "DELETE /compute/v2.1/flavors/182769984" status: 202 len: 0 microversion: 2.1 time: 0.034264 Oct 04 21:43:22.718890 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 9/41] 10.222.0.43 () {58 vars in 1158 bytes} [Tue Oct 4 21:43:22 2022] DELETE /compute/v2.1/flavors/182769984 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:43:22.748183 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-9d76157d-8c4a-40e6-8d62-528980d700b7 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:22.748712 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-9d76157d-8c4a-40e6-8d62-528980d700b7 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] [instance: 4c692055-b3f9-494b-9279-5a8453ed88ba] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:43:22.818175 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-980901e6-a8d3-4ff6-9dea-6fe796965b1c tempest-AggregatesAdminNegativeTestJSON-664564698 tempest-AggregatesAdminNegativeTestJSON-664564698-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 242 microversion: 2.1 time: 0.244793 Oct 04 21:43:22.819049 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 33/42] 10.222.0.43 () {60 vars in 1191 bytes} [Tue Oct 4 21:43:22 2022] POST /compute/v2.1/os-aggregates/2/action => generated 242 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:43:22.825278 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-22f7f241-10dc-4cbd-a628-4f48349a9b60 tempest-FlavorsV261TestJSON-871440527 tempest-FlavorsV261TestJSON-871440527-project-admin] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:22.849608 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-22f7f241-10dc-4cbd-a628-4f48349a9b60 tempest-FlavorsV261TestJSON-871440527 tempest-FlavorsV261TestJSON-871440527-project-admin] 10.222.0.43 "DELETE /compute/v2.1/flavors/813993096" status: 202 len: 0 microversion: 2.61 time: 0.028549 Oct 04 21:43:22.851152 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 34/43] 10.222.0.43 () {60 vars in 1199 bytes} [Tue Oct 4 21:43:22 2022] DELETE /compute/v2.1/flavors/813993096 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:43:22.856220 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-23e67e33-9a4e-4ef3-b7d5-fd19a1a1a2ec tempest-FlavorsAdminTestJSON-34401135 tempest-FlavorsAdminTestJSON-34401135-project-admin] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:22.863615 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-9d76157d-8c4a-40e6-8d62-528980d700b7 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5387dbf4e24960809704c398fe999a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bedc0e10ab24824a40d06bb91626088', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:43:22.879963 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-9d76157d-8c4a-40e6-8d62-528980d700b7 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] 10.222.0.43 "GET /compute/v2.1/servers/4c692055-b3f9-494b-9279-5a8453ed88ba" status: 200 len: 1220 microversion: 2.1 time: 0.156328 Oct 04 21:43:22.894980 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 10/44] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:43:22 2022] GET /compute/v2.1/servers/4c692055-b3f9-494b-9279-5a8453ed88ba => generated 1220 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:43:22.898392 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-23e67e33-9a4e-4ef3-b7d5-fd19a1a1a2ec tempest-FlavorsAdminTestJSON-34401135 tempest-FlavorsAdminTestJSON-34401135-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.045931 Oct 04 21:43:22.901489 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 35/45] 10.222.0.43 () {58 vars in 1146 bytes} [Tue Oct 4 21:43:22 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:43:22.901909 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-13ac5f66-3646-437e-b2d2-a89b741301a7 tempest-AggregatesAdminNegativeTestJSON-664564698 tempest-AggregatesAdminNegativeTestJSON-664564698-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-860284-1"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:43:22.907597 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-efe1cf18-4209-44e3-8523-b98c16c3c0dc tempest-FlavorsV261TestJSON-871440527 tempest-FlavorsV261TestJSON-871440527-project-admin] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:22.921684 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-13ac5f66-3646-437e-b2d2-a89b741301a7 tempest-AggregatesAdminNegativeTestJSON-664564698 tempest-AggregatesAdminNegativeTestJSON-664564698-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:22.922182 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-13ac5f66-3646-437e-b2d2-a89b741301a7 tempest-AggregatesAdminNegativeTestJSON-664564698 tempest-AggregatesAdminNegativeTestJSON-664564698-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:22.922643 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-13ac5f66-3646-437e-b2d2-a89b741301a7 tempest-AggregatesAdminNegativeTestJSON-664564698 tempest-AggregatesAdminNegativeTestJSON-664564698-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:22.933412 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-efe1cf18-4209-44e3-8523-b98c16c3c0dc tempest-FlavorsV261TestJSON-871440527 tempest-FlavorsV261TestJSON-871440527-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 5791 microversion: 2.61 time: 0.031425 Oct 04 21:43:22.934006 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 36/46] 10.222.0.43 () {60 vars in 1187 bytes} [Tue Oct 4 21:43:22 2022] GET /compute/v2.1/flavors/detail => generated 5791 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:43:22.939142 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-b6fd5683-b233-4d57-9c5c-78526768f069 tempest-FlavorsAdminTestJSON-34401135 tempest-FlavorsAdminTestJSON-34401135-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-532596796", "id": 206170467, "os-flavor-access:is_public": "False"}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:43:22.964963 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-b6fd5683-b233-4d57-9c5c-78526768f069 tempest-FlavorsAdminTestJSON-34401135 tempest-FlavorsAdminTestJSON-34401135-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.029595 Oct 04 21:43:22.965702 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 37/47] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 21:43:22 2022] POST /compute/v2.1/flavors => generated 411 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:43:22.983844 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-13ac5f66-3646-437e-b2d2-a89b741301a7 tempest-AggregatesAdminNegativeTestJSON-664564698 tempest-AggregatesAdminNegativeTestJSON-664564698-project-admin] HTTP exception thrown: Aggregate 2 already has host n-h1-860284-1. Oct 04 21:43:22.986111 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-7a659586-c939-4e31-be13-1816057b770f tempest-FlavorsAdminTestJSON-34401135 tempest-FlavorsAdminTestJSON-34401135-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-21796211", "id": 1180881651, "os-flavor-access:is_public": "True"}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:43:23.005257 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-13ac5f66-3646-437e-b2d2-a89b741301a7 tempest-AggregatesAdminNegativeTestJSON-664564698 tempest-AggregatesAdminNegativeTestJSON-664564698-project-admin] Request method failure captured: Oct 04 21:43:23.005257 n-d-860284-1 devstack@n-api.service[134101]: request: POST /compute/v2.1/os-aggregates/2/action HTTP/1.1 Oct 04 21:43:23.005257 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 21:43:23.005257 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 21:43:23.005257 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 21:43:23.005257 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 39 Oct 04 21:43:23.005257 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 21:43:23.005257 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 21:43:23.005257 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 21:43:23.005257 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 21:43:23.005257 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPKj3TqDaGoyjJhtIccfWEJxEBj6A1jebRdZTgg-sR19wHLlaDAI2bdTq6Jkp5iiCM0u9cwW4jzhwdoXvQS-WsEl_ywcz5KPWJU7yW05bsnHLpXgHw78VijaFN0Vdk0iAUt3MBmWSUCRj3gV4jO-cbkqRKTWzujvkVBPGumXvhfg-3s0 Oct 04 21:43:23.005257 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 21:43:23.005257 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 21:43:23.005257 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 21:43:23.005257 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 21:43:23.005257 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 21:43:23.005257 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 21:43:23.005257 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: d44d9375451f48269c82a6e559b24c3e Oct 04 21:43:23.005257 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-664564698 Oct 04 21:43:23.005257 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,admin,member Oct 04 21:43:23.005257 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,admin,member Oct 04 21:43:23.006315 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d44d9375451f48269c82a6e559b24c3e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_d44d9375451f48269c82a6e559b24c3e", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d44d9375451f48269c82a6e559b24c3e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/d44d9375451f48269c82a6e559b24c3e"}]}] Oct 04 21:43:23.006315 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-664564698 Oct 04 21:43:23.006315 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: d44d9375451f48269c82a6e559b24c3e Oct 04 21:43:23.006315 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-664564698 Oct 04 21:43:23.006315 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-AggregatesAdminNegativeTestJSON-664564698-project-admin Oct 04 21:43:23.006315 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 21:43:23.006315 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 21:43:23.006315 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 9982336626444aa7b0582b5802e18c20 Oct 04 21:43:23.006315 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-664564698-project-admin Oct 04 21:43:23.006315 n-d-860284-1 devstack@n-api.service[134101]: Oct 04 21:43:23.006315 n-d-860284-1 devstack@n-api.service[134101]: {"add_host": {"host": "n-h1-860284-1"}} Oct 04 21:43:23.006315 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 21:43:23.006315 n-d-860284-1 devstack@n-api.service[134101]: exception: Aggregate 2 already has host n-h1-860284-1. Oct 04 21:43:23.007006 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': '2', 'body': {'add_host': {'host': 'n-h1-860284-1'}}} Oct 04 21:43:23.007006 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:43:23.007006 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:43:23.007006 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 04 21:43:23.007006 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 04 21:43:23.007006 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 04 21:43:23.007006 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 04 21:43:23.007006 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 04 21:43:23.007006 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 04 21:43:23.007006 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 04 21:43:23.007006 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 04 21:43:23.007006 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 04 21:43:23.007006 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 04 21:43:23.007006 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 04 21:43:23.007006 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi result.read() Oct 04 21:43:23.007006 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 04 21:43:23.007006 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 04 21:43:23.007006 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 04 21:43:23.007006 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 04 21:43:23.007907 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 04 21:43:23.007907 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 04 21:43:23.007907 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 04 21:43:23.007907 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 04 21:43:23.007907 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'n-h1-860284-1-2' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Oct 04 21:43:23.007907 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:43:23.007907 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 04 21:43:23.007907 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:43:23.007907 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:43:23.007907 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db Oct 04 21:43:23.007907 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) Oct 04 21:43:23.007907 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 04 21:43:23.007907 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi session.flush() Oct 04 21:43:23.007907 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 04 21:43:23.007907 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 04 21:43:23.007907 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 04 21:43:23.007907 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 04 21:43:23.007907 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 04 21:43:23.007907 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 04 21:43:23.009394 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 04 21:43:23.009394 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception Oct 04 21:43:23.009394 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 04 21:43:23.009394 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 04 21:43:23.009394 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 04 21:43:23.009394 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 04 21:43:23.009394 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 04 21:43:23.009394 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 04 21:43:23.009394 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 04 21:43:23.009394 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 04 21:43:23.009394 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 04 21:43:23.009394 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 04 21:43:23.009394 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 04 21:43:23.009394 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 04 21:43:23.009394 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 04 21:43:23.009394 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 04 21:43:23.009394 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 04 21:43:23.009394 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 04 21:43:23.010328 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 04 21:43:23.010328 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 04 21:43:23.010328 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 04 21:43:23.010328 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 04 21:43:23.010328 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 04 21:43:23.010328 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception Oct 04 21:43:23.010328 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 04 21:43:23.010328 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 04 21:43:23.010328 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 04 21:43:23.010328 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 04 21:43:23.010328 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 04 21:43:23.010328 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 04 21:43:23.010328 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 04 21:43:23.010328 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 04 21:43:23.010328 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 04 21:43:23.010328 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 04 21:43:23.010328 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 04 21:43:23.010328 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi result.read() Oct 04 21:43:23.014621 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 04 21:43:23.014621 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 04 21:43:23.014621 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 04 21:43:23.014621 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 04 21:43:23.014621 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 04 21:43:23.014621 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 04 21:43:23.014621 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 04 21:43:23.014621 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 04 21:43:23.014621 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'n-h1-860284-1-2' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Oct 04 21:43:23.014621 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] Oct 04 21:43:23.014621 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 4, 21, 43, 22, 961516), 'updated_at': None, 'host': 'n-h1-860284-1', 'aggregate_id': 2}] Oct 04 21:43:23.014621 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 04 21:43:23.014621 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:43:23.014621 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:43:23.014621 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:43:23.014621 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:43:23.014621 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Oct 04 21:43:23.024529 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Oct 04 21:43:23.024529 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 21:43:23.024529 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 21:43:23.024529 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 21:43:23.024529 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 21:43:23.024529 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 21:43:23.024529 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 21:43:23.024529 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 21:43:23.024529 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 21:43:23.024529 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6641, in add_host_to_aggregate Oct 04 21:43:23.024529 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) Oct 04 21:43:23.024529 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 04 21:43:23.024529 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 04 21:43:23.024529 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host Oct 04 21:43:23.024529 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) Oct 04 21:43:23.024529 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db Oct 04 21:43:23.024529 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, Oct 04 21:43:23.024529 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 2 already has host n-h1-860284-1. Oct 04 21:43:23.024529 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:43:23.024529 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:43:23.027812 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:43:23.027812 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:43:23.027812 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:43:23.027812 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:43:23.027812 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:43:23.027812 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:43:23.027812 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:43:23.027812 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:43:23.027812 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:43:23.027812 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:43:23.027812 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host Oct 04 21:43:23.027812 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Oct 04 21:43:23.027812 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 2 already has host n-h1-860284-1. Oct 04 21:43:23.027812 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:43:23.027812 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:43:23.027812 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:43:23.027812 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:43:23.027812 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:43:23.027812 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:43:23.027812 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:43:23.027812 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:43:23.031351 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 2 already has host n-h1-860284-1. Oct 04 21:43:23.031351 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:43:23.031351 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-13ac5f66-3646-437e-b2d2-a89b741301a7 tempest-AggregatesAdminNegativeTestJSON-664564698 tempest-AggregatesAdminNegativeTestJSON-664564698-project-admin] Returning 409 to user: Aggregate 2 already has host n-h1-860284-1. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:43:23.031351 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-13ac5f66-3646-437e-b2d2-a89b741301a7 tempest-AggregatesAdminNegativeTestJSON-664564698 tempest-AggregatesAdminNegativeTestJSON-664564698-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates/2/action" status: 409 len: 95 microversion: 2.1 time: 0.111880 Oct 04 21:43:23.031351 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 11/48] 10.222.0.43 () {60 vars in 1191 bytes} [Tue Oct 4 21:43:22 2022] POST /compute/v2.1/os-aggregates/2/action => generated 95 bytes in 114 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) Oct 04 21:43:23.031934 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-7a659586-c939-4e31-be13-1816057b770f tempest-FlavorsAdminTestJSON-34401135 tempest-FlavorsAdminTestJSON-34401135-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 412 microversion: 2.1 time: 0.037965 Oct 04 21:43:23.031934 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 38/49] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 21:43:22 2022] POST /compute/v2.1/flavors => generated 412 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:43:23.032194 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-8fce2e44-622e-49c8-bfa5-82b84f6b4279 tempest-AggregatesAdminNegativeTestJSON-664564698 tempest-AggregatesAdminNegativeTestJSON-664564698-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-860284-1"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:43:23.032290 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-5f1c1115-1c75-4c02-b24f-1f4f3fd04736 tempest-FlavorsAdminTestJSON-34401135 tempest-FlavorsAdminTestJSON-34401135-project-admin] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:23.036010 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8fce2e44-622e-49c8-bfa5-82b84f6b4279 tempest-AggregatesAdminNegativeTestJSON-664564698 tempest-AggregatesAdminNegativeTestJSON-664564698-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:23.036721 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8fce2e44-622e-49c8-bfa5-82b84f6b4279 tempest-AggregatesAdminNegativeTestJSON-664564698 tempest-AggregatesAdminNegativeTestJSON-664564698-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:23.036871 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8fce2e44-622e-49c8-bfa5-82b84f6b4279 tempest-AggregatesAdminNegativeTestJSON-664564698 tempest-AggregatesAdminNegativeTestJSON-664564698-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:23.049230 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-5f1c1115-1c75-4c02-b24f-1f4f3fd04736 tempest-FlavorsAdminTestJSON-34401135 tempest-FlavorsAdminTestJSON-34401135-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 414 microversion: 2.1 time: 0.022739 Oct 04 21:43:23.060327 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 39/50] 10.222.0.43 () {58 vars in 1169 bytes} [Tue Oct 4 21:43:23 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 414 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:43:23.067367 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-9e1abbd3-5f27-40a0-9214-b52496f84413 tempest-FlavorsAdminTestJSON-34401135 tempest-FlavorsAdminTestJSON-34401135-project-admin] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:23.079602 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-9e1abbd3-5f27-40a0-9214-b52496f84413 tempest-FlavorsAdminTestJSON-34401135 tempest-FlavorsAdminTestJSON-34401135-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 414 microversion: 2.1 time: 0.017575 Oct 04 21:43:23.080543 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 40/51] 10.222.0.43 () {58 vars in 1177 bytes} [Tue Oct 4 21:43:23 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 414 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:43:23.097083 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-e6297109-cc25-4bd5-8fae-8f4e4e575ed9 tempest-FlavorsAdminTestJSON-34401135 tempest-FlavorsAdminTestJSON-34401135-project-admin] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:23.108231 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-e6297109-cc25-4bd5-8fae-8f4e4e575ed9 tempest-FlavorsAdminTestJSON-34401135 tempest-FlavorsAdminTestJSON-34401135-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 414 microversion: 2.1 time: 0.015845 Oct 04 21:43:23.108720 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 41/52] 10.222.0.43 () {58 vars in 1171 bytes} [Tue Oct 4 21:43:23 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 414 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:43:23.126633 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-68e8aea3-1cc6-4b19-8ea4-41a23a57a423 tempest-FlavorsAdminTestJSON-34401135 tempest-FlavorsAdminTestJSON-34401135-project-admin] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:23.141658 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-68e8aea3-1cc6-4b19-8ea4-41a23a57a423 tempest-FlavorsAdminTestJSON-34401135 tempest-FlavorsAdminTestJSON-34401135-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 414 microversion: 2.1 time: 0.019355 Oct 04 21:43:23.142855 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 42/53] 10.222.0.43 () {58 vars in 1169 bytes} [Tue Oct 4 21:43:23 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 414 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:43:23.157932 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-f268be9f-88e3-43b1-8f59-cd43653fbd6d tempest-FlavorsAdminTestJSON-34401135 tempest-FlavorsAdminTestJSON-34401135-project-admin] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:23.191886 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-f268be9f-88e3-43b1-8f59-cd43653fbd6d tempest-FlavorsAdminTestJSON-34401135 tempest-FlavorsAdminTestJSON-34401135-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 5393 microversion: 2.1 time: 0.038455 Oct 04 21:43:23.193659 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 43/54] 10.222.0.43 () {58 vars in 1169 bytes} [Tue Oct 4 21:43:23 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 5393 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:43:23.215478 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-8fce2e44-622e-49c8-bfa5-82b84f6b4279 tempest-AggregatesAdminNegativeTestJSON-664564698 tempest-AggregatesAdminNegativeTestJSON-664564698-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 227 microversion: 2.1 time: 0.200816 Oct 04 21:43:23.216096 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 12/55] 10.222.0.43 () {60 vars in 1191 bytes} [Tue Oct 4 21:43:23 2022] POST /compute/v2.1/os-aggregates/2/action => generated 227 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:43:23.226959 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-bfdb1377-2be4-4133-aaab-5977daf94d6b tempest-FlavorsAdminTestJSON-34401135 tempest-FlavorsAdminTestJSON-34401135-project-admin] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:23.251501 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-bfdb1377-2be4-4133-aaab-5977daf94d6b tempest-FlavorsAdminTestJSON-34401135 tempest-FlavorsAdminTestJSON-34401135-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 5393 microversion: 2.1 time: 0.032376 Oct 04 21:43:23.252295 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 13/56] 10.222.0.43 () {58 vars in 1175 bytes} [Tue Oct 4 21:43:23 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 5393 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:43:23.256501 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-ba7b8961-0b40-4a90-941c-f99fe491194c tempest-AggregatesAdminNegativeTestJSON-664564698 tempest-AggregatesAdminNegativeTestJSON-664564698-project-admin] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:23.302665 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-ba7b8961-0b40-4a90-941c-f99fe491194c tempest-AggregatesAdminNegativeTestJSON-664564698 tempest-AggregatesAdminNegativeTestJSON-664564698-project-admin] 10.222.0.43 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.049470 Oct 04 21:43:23.303863 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 14/57] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Oct 4 21:43:23 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 21:43:23.308896 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-c19956f3-b716-450b-8dd5-50f2f05e71de tempest-FlavorsAdminTestJSON-34401135 tempest-FlavorsAdminTestJSON-34401135-project-admin] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:23.338239 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-c19956f3-b716-450b-8dd5-50f2f05e71de tempest-FlavorsAdminTestJSON-34401135 tempest-FlavorsAdminTestJSON-34401135-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 5393 microversion: 2.1 time: 0.033087 Oct 04 21:43:23.342224 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 15/58] 10.222.0.43 () {58 vars in 1173 bytes} [Tue Oct 4 21:43:23 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 5393 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:43:23.348342 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-20ddbbb4-b914-4887-b53a-bc2b4ae35be4 tempest-AggregatesAdminNegativeTestJSON-664564698 tempest-AggregatesAdminNegativeTestJSON-664564698-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-784005203"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:43:23.353071 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.objects.aggregate [None req-20ddbbb4-b914-4887-b53a-bc2b4ae35be4 tempest-AggregatesAdminNegativeTestJSON-664564698 tempest-AggregatesAdminNegativeTestJSON-664564698-project-admin] Generated uuid 7e114197-ecc8-4ab0-a712-2397600cfd78 for aggregate {{(pid=134101) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 21:43:23.419950 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-20ddbbb4-b914-4887-b53a-bc2b4ae35be4 tempest-AggregatesAdminNegativeTestJSON-664564698 tempest-AggregatesAdminNegativeTestJSON-664564698-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.075983 Oct 04 21:43:23.423128 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 16/59] 10.222.0.43 () {60 vars in 1164 bytes} [Tue Oct 4 21:43:23 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:43:23.430052 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-d0fa04cb-726f-42fd-84a2-0bc49e891f5e tempest-FlavorsAdminTestJSON-34401135 tempest-FlavorsAdminTestJSON-34401135-project-admin] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:23.461727 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-d0fa04cb-726f-42fd-84a2-0bc49e891f5e tempest-FlavorsAdminTestJSON-34401135 tempest-FlavorsAdminTestJSON-34401135-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 5393 microversion: 2.1 time: 0.037376 Oct 04 21:43:23.463407 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 17/60] 10.222.0.43 () {58 vars in 1169 bytes} [Tue Oct 4 21:43:23 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 5393 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:43:23.478890 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-5b7a0561-5afc-490a-82fa-e260c91a09c0 tempest-AggregatesAdminTestJSON-1644938243 tempest-AggregatesAdminTestJSON-1644938243-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-924719273", "name": "tempest-test_aggregate-213873303"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:43:23.501580 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.objects.aggregate [None req-5b7a0561-5afc-490a-82fa-e260c91a09c0 tempest-AggregatesAdminTestJSON-1644938243 tempest-AggregatesAdminTestJSON-1644938243-project-admin] Generated uuid 49e3926e-74bb-4b5e-9f3b-b9bf2d78456f for aggregate {{(pid=134101) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 21:43:23.545842 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-5b7a0561-5afc-490a-82fa-e260c91a09c0 tempest-AggregatesAdminTestJSON-1644938243 tempest-AggregatesAdminTestJSON-1644938243-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates" status: 200 len: 220 microversion: 2.1 time: 0.081030 Oct 04 21:43:23.556035 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 18/61] 10.222.0.43 () {60 vars in 1165 bytes} [Tue Oct 4 21:43:23 2022] POST /compute/v2.1/os-aggregates => generated 220 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:43:23.800401 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-7569f398-d168-4ccb-b34b-c975aeb5d62f tempest-HostsAdminNegativeTestJSON-2060517711 tempest-HostsAdminNegativeTestJSON-2060517711-project-admin] Calling method '.version_select at 0x7fbb340d2c10>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:23.809666 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7569f398-d168-4ccb-b34b-c975aeb5d62f tempest-HostsAdminNegativeTestJSON-2060517711 tempest-HostsAdminNegativeTestJSON-2060517711-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:23.810542 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7569f398-d168-4ccb-b34b-c975aeb5d62f tempest-HostsAdminNegativeTestJSON-2060517711 tempest-HostsAdminNegativeTestJSON-2060517711-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:23.811639 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7569f398-d168-4ccb-b34b-c975aeb5d62f tempest-HostsAdminNegativeTestJSON-2060517711 tempest-HostsAdminNegativeTestJSON-2060517711-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:23.815506 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7569f398-d168-4ccb-b34b-c975aeb5d62f tempest-HostsAdminNegativeTestJSON-2060517711 tempest-HostsAdminNegativeTestJSON-2060517711-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:23.816328 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7569f398-d168-4ccb-b34b-c975aeb5d62f tempest-HostsAdminNegativeTestJSON-2060517711 tempest-HostsAdminNegativeTestJSON-2060517711-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:23.817707 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7569f398-d168-4ccb-b34b-c975aeb5d62f tempest-HostsAdminNegativeTestJSON-2060517711 tempest-HostsAdminNegativeTestJSON-2060517711-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:23.953312 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-7569f398-d168-4ccb-b34b-c975aeb5d62f tempest-HostsAdminNegativeTestJSON-2060517711 tempest-HostsAdminNegativeTestJSON-2060517711-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.758203 Oct 04 21:43:23.965934 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 44/62] 10.222.0.43 () {58 vars in 1128 bytes} [Tue Oct 4 21:43:23 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:43:23.973613 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-143a33e4-bcd2-46b4-939c-a1576feed217 tempest-FlavorsAdminTestJSON-34401135 tempest-FlavorsAdminTestJSON-34401135-project-admin] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:23.998343 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-27eae688-f6b6-4394-8cb9-3b33a23d601c tempest-AggregatesAdminNegativeTestJSON-924415762 tempest-AggregatesAdminNegativeTestJSON-924415762-project] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-860284-1"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:43:24.004896 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-27eae688-f6b6-4394-8cb9-3b33a23d601c tempest-AggregatesAdminNegativeTestJSON-924415762 tempest-AggregatesAdminNegativeTestJSON-924415762-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': 'fcfba6078cc8420d913383e2082a22ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa8ecde157b463193ea9635b15ad255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:43:24.013993 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-27eae688-f6b6-4394-8cb9-3b33a23d601c tempest-AggregatesAdminNegativeTestJSON-924415762 tempest-AggregatesAdminNegativeTestJSON-924415762-project] Request method failure captured: Oct 04 21:43:24.013993 n-d-860284-1 devstack@n-api.service[134101]: request: POST /compute/v2.1/os-aggregates/3/action HTTP/1.1 Oct 04 21:43:24.013993 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 21:43:24.013993 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 21:43:24.013993 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 21:43:24.013993 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 39 Oct 04 21:43:24.013993 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 21:43:24.013993 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 21:43:24.013993 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 21:43:24.013993 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 21:43:24.013993 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPKj0sUoAZZb3Xj012WEWWEcxezFEjoqwdwb2wWQa2zcKJIMCHkH7iRzGhMkrAZ42RHW09PCKNhQ2Uj1QZhXAgjIj4fLq3sXTvQwjQcQezstrjEp16MwU8GSGOH7mhj6mUlcCbKJ073k0NTJyIY37zKtkuywjWPZ3g5u9E6-X6lD2zEs Oct 04 21:43:24.013993 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 21:43:24.013993 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 21:43:24.013993 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 21:43:24.013993 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 21:43:24.013993 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 21:43:24.013993 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 21:43:24.013993 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: 1aa8ecde157b463193ea9635b15ad255 Oct 04 21:43:24.013993 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-924415762 Oct 04 21:43:24.013993 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 21:43:24.013993 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 21:43:24.016343 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1aa8ecde157b463193ea9635b15ad255"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_1aa8ecde157b463193ea9635b15ad255", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1aa8ecde157b463193ea9635b15ad255"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/1aa8ecde157b463193ea9635b15ad255"}]}] Oct 04 21:43:24.016343 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-924415762 Oct 04 21:43:24.016343 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: 1aa8ecde157b463193ea9635b15ad255 Oct 04 21:43:24.016343 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-924415762 Oct 04 21:43:24.016343 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-AggregatesAdminNegativeTestJSON-924415762-project Oct 04 21:43:24.016343 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 21:43:24.016343 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 21:43:24.016343 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: fcfba6078cc8420d913383e2082a22ac Oct 04 21:43:24.016343 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-924415762-project Oct 04 21:43:24.016343 n-d-860284-1 devstack@n-api.service[134101]: Oct 04 21:43:24.016343 n-d-860284-1 devstack@n-api.service[134101]: {"add_host": {"host": "n-h1-860284-1"}} Oct 04 21:43:24.016343 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 21:43:24.016343 n-d-860284-1 devstack@n-api.service[134101]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 04 21:43:24.017628 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': '3', 'body': {'add_host': {'host': 'n-h1-860284-1'}}} Oct 04 21:43:24.017628 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:43:24.017628 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:43:24.017628 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:43:24.017628 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:43:24.017628 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:43:24.017628 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:43:24.017628 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:43:24.017628 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:43:24.017628 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:43:24.017628 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:43:24.017628 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host Oct 04 21:43:24.017628 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) Oct 04 21:43:24.017628 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 21:43:24.017628 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 21:43:24.017628 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 21:43:24.017628 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 21:43:24.017628 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 21:43:24.017628 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 21:43:24.019832 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 21:43:24.019832 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 21:43:24.019832 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 21:43:24.019832 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 21:43:24.019832 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 21:43:24.019832 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 21:43:24.019832 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 21:43:24.019832 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 21:43:24.019832 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 04 21:43:24.019832 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:43:24.019832 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:43:24.019832 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:43:24.019832 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:43:24.019832 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:43:24.019832 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:43:24.019832 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 21:43:24.019832 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 21:43:24.019832 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 04 21:43:24.019832 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:43:24.022018 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-27eae688-f6b6-4394-8cb9-3b33a23d601c tempest-AggregatesAdminNegativeTestJSON-924415762 tempest-AggregatesAdminNegativeTestJSON-924415762-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:43:24.022018 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-27eae688-f6b6-4394-8cb9-3b33a23d601c tempest-AggregatesAdminNegativeTestJSON-924415762 tempest-AggregatesAdminNegativeTestJSON-924415762-project] 10.222.0.43 "POST /compute/v2.1/os-aggregates/3/action" status: 403 len: 118 microversion: 2.1 time: 0.467023 Oct 04 21:43:24.022018 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 19/63] 10.222.0.43 () {60 vars in 1191 bytes} [Tue Oct 4 21:43:23 2022] POST /compute/v2.1/os-aggregates/3/action => generated 118 bytes in 468 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:43:24.032653 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-a74787ad-4d7d-41b1-b688-c2ef0d24b434 tempest-AggregatesAdminTestJSON-1644938243 tempest-AggregatesAdminTestJSON-1644938243-project-admin] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:24.044577 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-143a33e4-bcd2-46b4-939c-a1576feed217 tempest-FlavorsAdminTestJSON-34401135 tempest-FlavorsAdminTestJSON-34401135-project-admin] 10.222.0.43 "DELETE /compute/v2.1/flavors/1180881651" status: 202 len: 0 microversion: 2.1 time: 0.076692 Oct 04 21:43:24.049162 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 45/64] 10.222.0.43 () {58 vars in 1161 bytes} [Tue Oct 4 21:43:23 2022] DELETE /compute/v2.1/flavors/1180881651 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:43:24.063858 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-5ad1d1b2-762c-4334-a498-8cf1aaf88c4b tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:24.065816 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-5ad1d1b2-762c-4334-a498-8cf1aaf88c4b tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] [instance: 4c692055-b3f9-494b-9279-5a8453ed88ba] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:43:24.067220 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-a74787ad-4d7d-41b1-b688-c2ef0d24b434 tempest-AggregatesAdminTestJSON-1644938243 tempest-AggregatesAdminTestJSON-1644938243-project-admin] 10.222.0.43 "GET /compute/v2.1/os-aggregates" status: 200 len: 513 microversion: 2.1 time: 0.044272 Oct 04 21:43:24.069479 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 20/65] 10.222.0.43 () {58 vars in 1143 bytes} [Tue Oct 4 21:43:24 2022] GET /compute/v2.1/os-aggregates => generated 513 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:43:24.374014 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e9f5e53f-ae80-48ac-8301-cd6891eda6b8 tempest-HostsAdminNegativeTestJSON-220876180 tempest-HostsAdminNegativeTestJSON-220876180-project] Calling method '.version_select at 0x7fbb2fcea8b0>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:24.379738 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-e9f5e53f-ae80-48ac-8301-cd6891eda6b8 tempest-HostsAdminNegativeTestJSON-220876180 tempest-HostsAdminNegativeTestJSON-220876180-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': '481183bc2cc644158d242f862991213e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4e83b646f71428993a0dcbb37e4cd2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:43:24.382837 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e9f5e53f-ae80-48ac-8301-cd6891eda6b8 tempest-HostsAdminNegativeTestJSON-220876180 tempest-HostsAdminNegativeTestJSON-220876180-project] Request method failure captured: Oct 04 21:43:24.382837 n-d-860284-1 devstack@n-api.service[134101]: request: GET /compute/v2.1/os-hosts HTTP/1.1 Oct 04 21:43:24.382837 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 21:43:24.382837 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 21:43:24.382837 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 21:43:24.382837 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 21:43:24.382837 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 21:43:24.382837 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 21:43:24.382837 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 21:43:24.382837 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 21:43:24.382837 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPKj5xZA4dJRi0ZZNAYy-XXItpdUjnJ_NAow5vIAzgiQmRWgfJMP00IuY8o7lRZwJp9-SyGKznmCSui0kmEC_iHooj1t5bH9knGtsg-NOfRE272PYP-lVs2g4XADoeUKq8QyTm3HvxMKS71tZgHsNM1A3Akh5w89bBLxJNm7FCxtpGLk Oct 04 21:43:24.382837 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 21:43:24.382837 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 21:43:24.382837 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 21:43:24.382837 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 21:43:24.382837 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 21:43:24.382837 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 21:43:24.382837 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: d4e83b646f71428993a0dcbb37e4cd2d Oct 04 21:43:24.382837 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-220876180 Oct 04 21:43:24.382837 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 21:43:24.382837 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 21:43:24.384005 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d4e83b646f71428993a0dcbb37e4cd2d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_d4e83b646f71428993a0dcbb37e4cd2d", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d4e83b646f71428993a0dcbb37e4cd2d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/d4e83b646f71428993a0dcbb37e4cd2d"}]}] Oct 04 21:43:24.384005 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-HostsAdminNegativeTestJSON-220876180 Oct 04 21:43:24.384005 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: d4e83b646f71428993a0dcbb37e4cd2d Oct 04 21:43:24.384005 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-220876180 Oct 04 21:43:24.384005 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-HostsAdminNegativeTestJSON-220876180-project Oct 04 21:43:24.384005 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 21:43:24.384005 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 21:43:24.384005 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 481183bc2cc644158d242f862991213e Oct 04 21:43:24.384005 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-HostsAdminNegativeTestJSON-220876180-project Oct 04 21:43:24.384005 n-d-860284-1 devstack@n-api.service[134101]: method: Oct 04 21:43:24.384005 n-d-860284-1 devstack@n-api.service[134101]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 04 21:43:24.384005 n-d-860284-1 devstack@n-api.service[134101]: action_args: {} Oct 04 21:43:24.384005 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:43:24.384701 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:43:24.384701 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:43:24.384701 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:43:24.384701 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:43:24.384701 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:43:24.384701 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:43:24.384701 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:43:24.384701 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 21:43:24.384701 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:43:24.384701 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:43:24.384701 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:43:24.384701 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index Oct 04 21:43:24.384701 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', Oct 04 21:43:24.384701 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 21:43:24.384701 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 21:43:24.384701 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 21:43:24.384701 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 21:43:24.384701 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 21:43:24.384701 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 21:43:24.385658 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 21:43:24.385658 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 21:43:24.385658 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 21:43:24.385658 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 21:43:24.385658 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 21:43:24.385658 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 21:43:24.385658 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 21:43:24.385658 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 21:43:24.385658 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 04 21:43:24.385658 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:43:24.385658 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:43:24.385658 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:43:24.385658 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:43:24.385658 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:43:24.385658 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:43:24.385658 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 21:43:24.385658 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 21:43:24.385658 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 04 21:43:24.385658 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:43:24.389697 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e9f5e53f-ae80-48ac-8301-cd6891eda6b8 tempest-HostsAdminNegativeTestJSON-220876180 tempest-HostsAdminNegativeTestJSON-220876180-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:43:24.391065 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-e9f5e53f-ae80-48ac-8301-cd6891eda6b8 tempest-HostsAdminNegativeTestJSON-220876180 tempest-HostsAdminNegativeTestJSON-220876180-project] 10.222.0.43 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.319658 Oct 04 21:43:24.398476 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 21/66] 10.222.0.43 () {58 vars in 1128 bytes} [Tue Oct 4 21:43:24 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 328 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:43:24.405358 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-c599b1be-f2a9-44a8-81b4-0cb94d4b06eb tempest-AggregatesAdminNegativeTestJSON-664564698 tempest-AggregatesAdminNegativeTestJSON-664564698-project-admin] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:24.413649 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=82,nova_api:DELETE=9,nova_api:INSERT=9 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:43:24.446328 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-c599b1be-f2a9-44a8-81b4-0cb94d4b06eb tempest-AggregatesAdminNegativeTestJSON-664564698 tempest-AggregatesAdminNegativeTestJSON-664564698-project-admin] 10.222.0.43 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.1 time: 0.044706 Oct 04 21:43:24.457762 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 22/67] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Oct 4 21:43:24 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 21:43:24.464150 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-08163d98-befb-4cfa-9605-ee597f3ed8fb tempest-FlavorsAdminTestJSON-34401135 tempest-FlavorsAdminTestJSON-34401135-project-admin] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:24.488725 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-08163d98-befb-4cfa-9605-ee597f3ed8fb tempest-FlavorsAdminTestJSON-34401135 tempest-FlavorsAdminTestJSON-34401135-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.029188 Oct 04 21:43:24.489944 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 23/68] 10.222.0.43 () {58 vars in 1146 bytes} [Tue Oct 4 21:43:24 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:43:24.499971 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-b95dd255-689a-4fda-ad59-aecf8c171fdf tempest-AggregatesAdminTestJSON-1644938243 tempest-AggregatesAdminTestJSON-1644938243-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-860284-1"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:43:24.514840 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b95dd255-689a-4fda-ad59-aecf8c171fdf tempest-AggregatesAdminTestJSON-1644938243 tempest-AggregatesAdminTestJSON-1644938243-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:24.515838 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b95dd255-689a-4fda-ad59-aecf8c171fdf tempest-AggregatesAdminTestJSON-1644938243 tempest-AggregatesAdminTestJSON-1644938243-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:24.517095 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b95dd255-689a-4fda-ad59-aecf8c171fdf tempest-AggregatesAdminTestJSON-1644938243 tempest-AggregatesAdminTestJSON-1644938243-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:24.769100 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-b95dd255-689a-4fda-ad59-aecf8c171fdf tempest-AggregatesAdminTestJSON-1644938243 tempest-AggregatesAdminTestJSON-1644938243-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 312 microversion: 2.1 time: 0.277743 Oct 04 21:43:24.769700 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 24/69] 10.222.0.43 () {60 vars in 1191 bytes} [Tue Oct 4 21:43:24 2022] POST /compute/v2.1/os-aggregates/4/action => generated 312 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:43:24.791803 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-56dc52b1-6c8c-4eaa-a7b4-461134fc58f7 tempest-HostsAdminNegativeTestJSON-220876180 tempest-HostsAdminNegativeTestJSON-220876180-project] Calling method '.version_select at 0x7fbb2fcea310>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:24.793744 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-56dc52b1-6c8c-4eaa-a7b4-461134fc58f7 tempest-HostsAdminNegativeTestJSON-220876180 tempest-HostsAdminNegativeTestJSON-220876180-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': '481183bc2cc644158d242f862991213e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4e83b646f71428993a0dcbb37e4cd2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:43:24.795990 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-56dc52b1-6c8c-4eaa-a7b4-461134fc58f7 tempest-HostsAdminNegativeTestJSON-220876180 tempest-HostsAdminNegativeTestJSON-220876180-project] Request method failure captured: Oct 04 21:43:24.795990 n-d-860284-1 devstack@n-api.service[134101]: request: GET /compute/v2.1/os-hosts/n-d-860284-1/reboot HTTP/1.1 Oct 04 21:43:24.795990 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 21:43:24.795990 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 21:43:24.795990 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 21:43:24.795990 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 21:43:24.795990 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 21:43:24.795990 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 21:43:24.795990 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 21:43:24.795990 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 21:43:24.795990 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPKj5xZA4dJRi0ZZNAYy-XXItpdUjnJ_NAow5vIAzgiQmRWgfJMP00IuY8o7lRZwJp9-SyGKznmCSui0kmEC_iHooj1t5bH9knGtsg-NOfRE272PYP-lVs2g4XADoeUKq8QyTm3HvxMKS71tZgHsNM1A3Akh5w89bBLxJNm7FCxtpGLk Oct 04 21:43:24.795990 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 21:43:24.795990 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 21:43:24.795990 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 21:43:24.795990 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 21:43:24.795990 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 21:43:24.795990 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 21:43:24.795990 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: d4e83b646f71428993a0dcbb37e4cd2d Oct 04 21:43:24.795990 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-220876180 Oct 04 21:43:24.795990 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 21:43:24.795990 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 21:43:24.797339 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d4e83b646f71428993a0dcbb37e4cd2d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_d4e83b646f71428993a0dcbb37e4cd2d", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d4e83b646f71428993a0dcbb37e4cd2d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/d4e83b646f71428993a0dcbb37e4cd2d"}]}] Oct 04 21:43:24.797339 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-HostsAdminNegativeTestJSON-220876180 Oct 04 21:43:24.797339 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: d4e83b646f71428993a0dcbb37e4cd2d Oct 04 21:43:24.797339 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-220876180 Oct 04 21:43:24.797339 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-HostsAdminNegativeTestJSON-220876180-project Oct 04 21:43:24.797339 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 21:43:24.797339 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 21:43:24.797339 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 481183bc2cc644158d242f862991213e Oct 04 21:43:24.797339 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-HostsAdminNegativeTestJSON-220876180-project Oct 04 21:43:24.797339 n-d-860284-1 devstack@n-api.service[134101]: method: Oct 04 21:43:24.797339 n-d-860284-1 devstack@n-api.service[134101]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 04 21:43:24.797339 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': 'n-d-860284-1'} Oct 04 21:43:24.797339 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:43:24.798141 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:43:24.798141 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:43:24.798141 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:43:24.798141 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:43:24.798141 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:43:24.798141 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:43:24.798141 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:43:24.798141 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:43:24.798141 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:43:24.798141 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot Oct 04 21:43:24.798141 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', Oct 04 21:43:24.798141 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 21:43:24.798141 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 21:43:24.798141 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 21:43:24.798141 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 21:43:24.798141 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 21:43:24.798141 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 21:43:24.798141 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 21:43:24.798141 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 21:43:24.799315 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 21:43:24.799315 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 21:43:24.799315 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 21:43:24.799315 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 21:43:24.799315 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 21:43:24.799315 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 21:43:24.799315 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 04 21:43:24.799315 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:43:24.799315 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:43:24.799315 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:43:24.799315 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:43:24.799315 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:43:24.799315 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:43:24.799315 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 21:43:24.799315 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 21:43:24.799315 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 04 21:43:24.799315 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:43:24.802127 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-56dc52b1-6c8c-4eaa-a7b4-461134fc58f7 tempest-HostsAdminNegativeTestJSON-220876180 tempest-HostsAdminNegativeTestJSON-220876180-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:43:24.803314 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-56dc52b1-6c8c-4eaa-a7b4-461134fc58f7 tempest-HostsAdminNegativeTestJSON-220876180 tempest-HostsAdminNegativeTestJSON-220876180-project] 10.222.0.43 "GET /compute/v2.1/os-hosts/n-d-860284-1/reboot" status: 403 len: 111 microversion: 2.1 time: 0.032534 Oct 04 21:43:24.803998 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 25/70] 10.222.0.43 () {58 vars in 1188 bytes} [Tue Oct 4 21:43:24 2022] GET /compute/v2.1/os-hosts/n-d-860284-1/reboot => generated 111 bytes in 34 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:43:24.811848 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-d22f0be8-5b38-43e1-8322-6431e49e43a9 tempest-AggregatesAdminNegativeTestJSON-664564698 tempest-AggregatesAdminNegativeTestJSON-664564698-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1687524901"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:43:24.815786 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.objects.aggregate [None req-d22f0be8-5b38-43e1-8322-6431e49e43a9 tempest-AggregatesAdminNegativeTestJSON-664564698 tempest-AggregatesAdminNegativeTestJSON-664564698-project-admin] Generated uuid 22f3f7b4-d82a-4b22-b317-2099a9ddfb53 for aggregate {{(pid=134101) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 21:43:24.855493 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-d22f0be8-5b38-43e1-8322-6431e49e43a9 tempest-AggregatesAdminNegativeTestJSON-664564698 tempest-AggregatesAdminNegativeTestJSON-664564698-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.050098 Oct 04 21:43:24.857154 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 26/71] 10.222.0.43 () {60 vars in 1164 bytes} [Tue Oct 4 21:43:24 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:43:24.864526 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-7bde7e79-6fa9-41de-b264-95621240762b tempest-FlavorsAdminTestJSON-34401135 tempest-FlavorsAdminTestJSON-34401135-project-admin] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:24.888560 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-7bde7e79-6fa9-41de-b264-95621240762b tempest-FlavorsAdminTestJSON-34401135 tempest-FlavorsAdminTestJSON-34401135-project-admin] 10.222.0.43 "DELETE /compute/v2.1/flavors/206170467" status: 202 len: 0 microversion: 2.1 time: 0.028926 Oct 04 21:43:24.889921 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 27/72] 10.222.0.43 () {58 vars in 1158 bytes} [Tue Oct 4 21:43:24 2022] DELETE /compute/v2.1/flavors/206170467 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:43:24.903497 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-836963a9-bee2-43aa-9c80-e1804e312f01 tempest-HostsAdminNegativeTestJSON-2060517711 tempest-HostsAdminNegativeTestJSON-2060517711-project-admin] Calling method '.version_select at 0x7fbb2fcc0310>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:24.915418 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-836963a9-bee2-43aa-9c80-e1804e312f01 tempest-HostsAdminNegativeTestJSON-2060517711 tempest-HostsAdminNegativeTestJSON-2060517711-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 21:43:24.920342 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-836963a9-bee2-43aa-9c80-e1804e312f01 tempest-HostsAdminNegativeTestJSON-2060517711 tempest-HostsAdminNegativeTestJSON-2060517711-project-admin] Request method failure captured: Oct 04 21:43:24.920342 n-d-860284-1 devstack@n-api.service[134101]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 Oct 04 21:43:24.920342 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 21:43:24.920342 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 21:43:24.920342 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 21:43:24.920342 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 21:43:24.920342 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 21:43:24.920342 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 21:43:24.920342 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 21:43:24.920342 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 21:43:24.920342 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPKj78qONQOLSNQ0NBfuhAJxekqrxhbrtH1gAMa4W8HRIS0Ozxlj3mOGiRVfJPIsC8Fh5Cs2-u9I9kNJiX54tPlwFzilmKyugZs06FZ6mKYxqjm0VbeGV6oPo_TVtw2AHx5jUxPQuh3EqdMdgnzLXZD7OpZfHofpqt6wvHLnmtea19RY Oct 04 21:43:24.920342 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 21:43:24.920342 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 21:43:24.920342 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 21:43:24.920342 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 21:43:24.920342 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 21:43:24.920342 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 21:43:24.920342 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: 3ae3708b2488499db0002973c0108ddb Oct 04 21:43:24.920342 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2060517711 Oct 04 21:43:24.920342 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,admin,member Oct 04 21:43:24.920342 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,admin,member Oct 04 21:43:24.921750 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/3ae3708b2488499db0002973c0108ddb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_3ae3708b2488499db0002973c0108ddb", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/3ae3708b2488499db0002973c0108ddb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/3ae3708b2488499db0002973c0108ddb"}]}] Oct 04 21:43:24.921750 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2060517711 Oct 04 21:43:24.921750 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: 3ae3708b2488499db0002973c0108ddb Oct 04 21:43:24.921750 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2060517711 Oct 04 21:43:24.921750 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-HostsAdminNegativeTestJSON-2060517711-project-admin Oct 04 21:43:24.921750 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 21:43:24.921750 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 21:43:24.921750 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 7d597b726dd74aefb7529d0a2e42df3c Oct 04 21:43:24.921750 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2060517711-project-admin Oct 04 21:43:24.921750 n-d-860284-1 devstack@n-api.service[134101]: method: Oct 04 21:43:24.921750 n-d-860284-1 devstack@n-api.service[134101]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 21:43:24.921750 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': 'nonexistent_hostname'} Oct 04 21:43:24.921750 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:43:24.923215 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:43:24.923215 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 04 21:43:24.923215 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 04 21:43:24.923215 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 21:43:24.923215 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 21:43:24.923215 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 21:43:24.923215 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 21:43:24.923215 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 21:43:24.923215 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 21:43:24.923215 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 21:43:24.923215 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 21:43:24.923215 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 04 21:43:24.923215 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 04 21:43:24.923215 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 21:43:24.923215 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 21:43:24.923215 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 04 21:43:24.923215 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 04 21:43:24.923215 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 21:43:24.923215 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 21:43:24.924443 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 04 21:43:24.924443 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 04 21:43:24.924443 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 21:43:24.924443 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:43:24.924443 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:43:24.924443 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:43:24.924443 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:43:24.924443 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:43:24.924443 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:43:24.924443 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:43:24.924443 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:43:24.924443 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:43:24.924443 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:43:24.924443 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:43:24.924443 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:43:24.924443 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot Oct 04 21:43:24.924443 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") Oct 04 21:43:24.924443 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 04 21:43:24.924443 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:43:24.925475 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 21:43:24.925475 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:43:24.925475 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:43:24.925475 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:43:24.925475 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:43:24.925475 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:43:24.925475 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:43:24.925475 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:43:24.925475 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:43:24.925475 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 21:43:24.925475 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:43:24.925475 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-836963a9-bee2-43aa-9c80-e1804e312f01 tempest-HostsAdminNegativeTestJSON-2060517711 tempest-HostsAdminNegativeTestJSON-2060517711-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:43:24.925475 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-836963a9-bee2-43aa-9c80-e1804e312f01 tempest-HostsAdminNegativeTestJSON-2060517711 tempest-HostsAdminNegativeTestJSON-2060517711-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.026241 Oct 04 21:43:24.925475 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 28/73] 10.222.0.43 () {58 vars in 1212 bytes} [Tue Oct 4 21:43:24 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 21:43:24.929018 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-cfe939e1-a9e5-4aeb-99a8-db96a2199054 tempest-AggregatesAdminNegativeTestJSON-664564698 tempest-AggregatesAdminNegativeTestJSON-664564698-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-709068030"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:43:24.942436 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cfe939e1-a9e5-4aeb-99a8-db96a2199054 tempest-AggregatesAdminNegativeTestJSON-664564698 tempest-AggregatesAdminNegativeTestJSON-664564698-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:24.942854 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cfe939e1-a9e5-4aeb-99a8-db96a2199054 tempest-AggregatesAdminNegativeTestJSON-664564698 tempest-AggregatesAdminNegativeTestJSON-664564698-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:24.943297 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cfe939e1-a9e5-4aeb-99a8-db96a2199054 tempest-AggregatesAdminNegativeTestJSON-664564698 tempest-AggregatesAdminNegativeTestJSON-664564698-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:24.954226 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cfe939e1-a9e5-4aeb-99a8-db96a2199054 tempest-AggregatesAdminNegativeTestJSON-664564698 tempest-AggregatesAdminNegativeTestJSON-664564698-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:24.954740 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cfe939e1-a9e5-4aeb-99a8-db96a2199054 tempest-AggregatesAdminNegativeTestJSON-664564698 tempest-AggregatesAdminNegativeTestJSON-664564698-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:24.955184 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cfe939e1-a9e5-4aeb-99a8-db96a2199054 tempest-AggregatesAdminNegativeTestJSON-664564698 tempest-AggregatesAdminNegativeTestJSON-664564698-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:24.967587 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-cfe939e1-a9e5-4aeb-99a8-db96a2199054 tempest-AggregatesAdminNegativeTestJSON-664564698 tempest-AggregatesAdminNegativeTestJSON-664564698-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-709068030 could not be found. Oct 04 21:43:24.969972 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-cfe939e1-a9e5-4aeb-99a8-db96a2199054 tempest-AggregatesAdminNegativeTestJSON-664564698 tempest-AggregatesAdminNegativeTestJSON-664564698-project-admin] Request method failure captured: Oct 04 21:43:24.969972 n-d-860284-1 devstack@n-api.service[134101]: request: POST /compute/v2.1/os-aggregates/5/action HTTP/1.1 Oct 04 21:43:24.969972 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 21:43:24.969972 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 21:43:24.969972 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 21:43:24.969972 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 57 Oct 04 21:43:24.969972 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 21:43:24.969972 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 21:43:24.969972 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 21:43:24.969972 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 21:43:24.969972 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPKj3TqDaGoyjJhtIccfWEJxEBj6A1jebRdZTgg-sR19wHLlaDAI2bdTq6Jkp5iiCM0u9cwW4jzhwdoXvQS-WsEl_ywcz5KPWJU7yW05bsnHLpXgHw78VijaFN0Vdk0iAUt3MBmWSUCRj3gV4jO-cbkqRKTWzujvkVBPGumXvhfg-3s0 Oct 04 21:43:24.969972 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 21:43:24.969972 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 21:43:24.969972 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 21:43:24.969972 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 21:43:24.969972 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 21:43:24.969972 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 21:43:24.969972 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: d44d9375451f48269c82a6e559b24c3e Oct 04 21:43:24.969972 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-664564698 Oct 04 21:43:24.969972 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,admin,member Oct 04 21:43:24.969972 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,admin,member Oct 04 21:43:24.971466 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d44d9375451f48269c82a6e559b24c3e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_d44d9375451f48269c82a6e559b24c3e", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d44d9375451f48269c82a6e559b24c3e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/d44d9375451f48269c82a6e559b24c3e"}]}] Oct 04 21:43:24.971466 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-664564698 Oct 04 21:43:24.971466 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: d44d9375451f48269c82a6e559b24c3e Oct 04 21:43:24.971466 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-664564698 Oct 04 21:43:24.971466 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-AggregatesAdminNegativeTestJSON-664564698-project-admin Oct 04 21:43:24.971466 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 21:43:24.971466 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 21:43:24.971466 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 9982336626444aa7b0582b5802e18c20 Oct 04 21:43:24.971466 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-664564698-project-admin Oct 04 21:43:24.971466 n-d-860284-1 devstack@n-api.service[134101]: Oct 04 21:43:24.971466 n-d-860284-1 devstack@n-api.service[134101]: {"add_host": {"host": "tempest-nonexist_host-709068030"}} Oct 04 21:43:24.971466 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 21:43:24.971466 n-d-860284-1 devstack@n-api.service[134101]: exception: Compute host tempest-nonexist_host-709068030 could not be found. Oct 04 21:43:24.972432 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': '5', 'body': {'add_host': {'host': 'tempest-nonexist_host-709068030'}}} Oct 04 21:43:24.972432 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:43:24.972432 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:43:24.972432 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5999, in _get_service_in_cell_by_host Oct 04 21:43:24.972432 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 04 21:43:24.972432 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 21:43:24.972432 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 21:43:24.972432 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 04 21:43:24.972432 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 04 21:43:24.972432 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 21:43:24.972432 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 21:43:24.972432 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 04 21:43:24.972432 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 04 21:43:24.972432 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-709068030' is not mapped to any cell Oct 04 21:43:24.972432 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:43:24.972432 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:43:24.972432 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:43:24.972432 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:43:24.972432 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Oct 04 21:43:24.973548 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Oct 04 21:43:24.973548 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 04 21:43:24.973548 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 04 21:43:24.973548 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 04 21:43:24.973548 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:43:24.973548 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:43:24.973548 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:43:24.973548 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:43:24.973548 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Oct 04 21:43:24.973548 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Oct 04 21:43:24.973548 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 21:43:24.973548 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 21:43:24.973548 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 21:43:24.973548 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 21:43:24.973548 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 21:43:24.973548 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 21:43:24.973548 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 21:43:24.973548 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 21:43:24.973548 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6621, in add_host_to_aggregate Oct 04 21:43:24.973548 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) Oct 04 21:43:24.974652 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6007, in _get_service_in_cell_by_host Oct 04 21:43:24.974652 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Oct 04 21:43:24.974652 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-709068030 could not be found. Oct 04 21:43:24.974652 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:43:24.974652 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:43:24.974652 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:43:24.974652 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:43:24.974652 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:43:24.974652 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:43:24.974652 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:43:24.974652 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:43:24.974652 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:43:24.974652 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:43:24.974652 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:43:24.974652 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:43:24.974652 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host Oct 04 21:43:24.974652 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:43:24.974652 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-709068030 could not be found. Oct 04 21:43:24.974652 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:43:24.974652 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:43:24.974652 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:43:24.975837 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:43:24.975837 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:43:24.975837 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:43:24.975837 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:43:24.975837 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:43:24.975837 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-709068030 could not be found. Oct 04 21:43:24.975837 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:43:24.975837 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-cfe939e1-a9e5-4aeb-99a8-db96a2199054 tempest-AggregatesAdminNegativeTestJSON-664564698 tempest-AggregatesAdminNegativeTestJSON-664564698-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-709068030 could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:43:24.988407 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-cfe939e1-a9e5-4aeb-99a8-db96a2199054 tempest-AggregatesAdminNegativeTestJSON-664564698 tempest-AggregatesAdminNegativeTestJSON-664564698-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates/5/action" status: 404 len: 110 microversion: 2.1 time: 0.047974 Oct 04 21:43:24.992830 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 29/74] 10.222.0.43 () {60 vars in 1191 bytes} [Tue Oct 4 21:43:24 2022] POST /compute/v2.1/os-aggregates/5/action => generated 110 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:43:25.001407 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-2d6727df-ae44-4397-875a-bd9a271777a4 tempest-FlavorsAdminTestJSON-34401135 tempest-FlavorsAdminTestJSON-34401135-project-admin] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:25.037220 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-2d6727df-ae44-4397-875a-bd9a271777a4 tempest-FlavorsAdminTestJSON-34401135 tempest-FlavorsAdminTestJSON-34401135-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.043913 Oct 04 21:43:25.055166 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 30/75] 10.222.0.43 () {58 vars in 1146 bytes} [Tue Oct 4 21:43:24 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:43:25.315312 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-5ad1d1b2-762c-4334-a498-8cf1aaf88c4b tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5387dbf4e24960809704c398fe999a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bedc0e10ab24824a40d06bb91626088', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:43:25.348283 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-5ad1d1b2-762c-4334-a498-8cf1aaf88c4b tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] 10.222.0.43 "GET /compute/v2.1/servers/4c692055-b3f9-494b-9279-5a8453ed88ba" status: 200 len: 1220 microversion: 2.1 time: 1.297645 Oct 04 21:43:25.348898 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 46/76] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:43:24 2022] GET /compute/v2.1/servers/4c692055-b3f9-494b-9279-5a8453ed88ba => generated 1220 bytes in 1299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:43:25.354417 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-5b3b4727-72d7-4427-9f8b-d809463c6674 tempest-HostsAdminNegativeTestJSON-220876180 tempest-HostsAdminNegativeTestJSON-220876180-project] Calling method '.version_select at 0x7fbb340a5160>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:25.356764 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-5b3b4727-72d7-4427-9f8b-d809463c6674 tempest-HostsAdminNegativeTestJSON-220876180 tempest-HostsAdminNegativeTestJSON-220876180-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': '481183bc2cc644158d242f862991213e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4e83b646f71428993a0dcbb37e4cd2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:43:25.359012 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-5b3b4727-72d7-4427-9f8b-d809463c6674 tempest-HostsAdminNegativeTestJSON-220876180 tempest-HostsAdminNegativeTestJSON-220876180-project] Request method failure captured: Oct 04 21:43:25.359012 n-d-860284-1 devstack@n-api.service[134102]: request: GET /compute/v2.1/os-hosts/n-d-860284-1 HTTP/1.1 Oct 04 21:43:25.359012 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 21:43:25.359012 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 21:43:25.359012 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 21:43:25.359012 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 21:43:25.359012 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 21:43:25.359012 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 21:43:25.359012 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 21:43:25.359012 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 21:43:25.359012 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPKj5xZA4dJRi0ZZNAYy-XXItpdUjnJ_NAow5vIAzgiQmRWgfJMP00IuY8o7lRZwJp9-SyGKznmCSui0kmEC_iHooj1t5bH9knGtsg-NOfRE272PYP-lVs2g4XADoeUKq8QyTm3HvxMKS71tZgHsNM1A3Akh5w89bBLxJNm7FCxtpGLk Oct 04 21:43:25.359012 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 21:43:25.359012 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 21:43:25.359012 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 21:43:25.359012 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 21:43:25.359012 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 21:43:25.359012 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 21:43:25.359012 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: d4e83b646f71428993a0dcbb37e4cd2d Oct 04 21:43:25.359012 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-220876180 Oct 04 21:43:25.359012 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 21:43:25.359012 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 21:43:25.360308 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d4e83b646f71428993a0dcbb37e4cd2d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_d4e83b646f71428993a0dcbb37e4cd2d", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d4e83b646f71428993a0dcbb37e4cd2d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/d4e83b646f71428993a0dcbb37e4cd2d"}]}] Oct 04 21:43:25.360308 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-HostsAdminNegativeTestJSON-220876180 Oct 04 21:43:25.360308 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: d4e83b646f71428993a0dcbb37e4cd2d Oct 04 21:43:25.360308 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-220876180 Oct 04 21:43:25.360308 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-HostsAdminNegativeTestJSON-220876180-project Oct 04 21:43:25.360308 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 21:43:25.360308 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 21:43:25.360308 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: 481183bc2cc644158d242f862991213e Oct 04 21:43:25.360308 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-HostsAdminNegativeTestJSON-220876180-project Oct 04 21:43:25.360308 n-d-860284-1 devstack@n-api.service[134102]: method: Oct 04 21:43:25.360308 n-d-860284-1 devstack@n-api.service[134102]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 04 21:43:25.360308 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': 'n-d-860284-1'} Oct 04 21:43:25.360308 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:43:25.361013 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:43:25.361013 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:43:25.361013 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:43:25.361013 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:43:25.361013 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:43:25.361013 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:43:25.361013 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:43:25.361013 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:43:25.361013 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:43:25.361013 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show Oct 04 21:43:25.361013 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', Oct 04 21:43:25.361013 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 21:43:25.361013 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 21:43:25.361013 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 21:43:25.361013 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 21:43:25.361013 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 21:43:25.361013 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 21:43:25.361013 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 21:43:25.361013 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 21:43:25.361887 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 21:43:25.361887 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 21:43:25.361887 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 21:43:25.361887 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 21:43:25.361887 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 21:43:25.361887 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 21:43:25.361887 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 04 21:43:25.361887 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:43:25.361887 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:43:25.361887 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:43:25.361887 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:43:25.361887 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:43:25.361887 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:43:25.361887 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 21:43:25.361887 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 21:43:25.361887 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 04 21:43:25.361887 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:43:25.364021 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-5b3b4727-72d7-4427-9f8b-d809463c6674 tempest-HostsAdminNegativeTestJSON-220876180 tempest-HostsAdminNegativeTestJSON-220876180-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:43:25.364848 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-5b3b4727-72d7-4427-9f8b-d809463c6674 tempest-HostsAdminNegativeTestJSON-220876180 tempest-HostsAdminNegativeTestJSON-220876180-project] 10.222.0.43 "GET /compute/v2.1/os-hosts/n-d-860284-1" status: 403 len: 109 microversion: 2.1 time: 0.014740 Oct 04 21:43:25.365567 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 47/77] 10.222.0.43 () {58 vars in 1167 bytes} [Tue Oct 4 21:43:25 2022] GET /compute/v2.1/os-hosts/n-d-860284-1 => generated 109 bytes in 16 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:43:25.370534 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-581aa291-e59a-4c85-a6d6-9f7730f6f8b5 tempest-AggregatesAdminNegativeTestJSON-664564698 tempest-AggregatesAdminNegativeTestJSON-664564698-project-admin] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:25.394490 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-581aa291-e59a-4c85-a6d6-9f7730f6f8b5 tempest-AggregatesAdminNegativeTestJSON-664564698 tempest-AggregatesAdminNegativeTestJSON-664564698-project-admin] 10.222.0.43 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.027101 Oct 04 21:43:25.400566 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 48/78] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Oct 4 21:43:25 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 21:43:25.407111 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-89fe31dc-25e1-4bdb-95b1-a6aa81a63277 tempest-FlavorsAdminTestJSON-34401135 tempest-FlavorsAdminTestJSON-34401135-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1641732773", "id": 1720006271, "os-flavor-access:is_public": "False"}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:43:25.426378 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-89fe31dc-25e1-4bdb-95b1-a6aa81a63277 tempest-FlavorsAdminTestJSON-34401135 tempest-FlavorsAdminTestJSON-34401135-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.024089 Oct 04 21:43:25.427267 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 49/79] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 21:43:25 2022] POST /compute/v2.1/flavors => generated 415 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:43:25.457799 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-bc6e36ad-7cab-4fc9-b2c3-8479da25b491 tempest-HypervisorAdminTestJSON-71091012 tempest-HypervisorAdminTestJSON-71091012-project-admin] Calling method '.version_select at 0x7fbb2fcc0af0>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:25.459735 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bc6e36ad-7cab-4fc9-b2c3-8479da25b491 tempest-HypervisorAdminTestJSON-71091012 tempest-HypervisorAdminTestJSON-71091012-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:25.460189 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bc6e36ad-7cab-4fc9-b2c3-8479da25b491 tempest-HypervisorAdminTestJSON-71091012 tempest-HypervisorAdminTestJSON-71091012-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:25.460628 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bc6e36ad-7cab-4fc9-b2c3-8479da25b491 tempest-HypervisorAdminTestJSON-71091012 tempest-HypervisorAdminTestJSON-71091012-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:25.487904 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bc6e36ad-7cab-4fc9-b2c3-8479da25b491 tempest-HypervisorAdminTestJSON-71091012 tempest-HypervisorAdminTestJSON-71091012-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:25.488408 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bc6e36ad-7cab-4fc9-b2c3-8479da25b491 tempest-HypervisorAdminTestJSON-71091012 tempest-HypervisorAdminTestJSON-71091012-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:25.489105 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bc6e36ad-7cab-4fc9-b2c3-8479da25b491 tempest-HypervisorAdminTestJSON-71091012 tempest-HypervisorAdminTestJSON-71091012-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:25.501673 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bc6e36ad-7cab-4fc9-b2c3-8479da25b491 tempest-HypervisorAdminTestJSON-71091012 tempest-HypervisorAdminTestJSON-71091012-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:25.502412 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bc6e36ad-7cab-4fc9-b2c3-8479da25b491 tempest-HypervisorAdminTestJSON-71091012 tempest-HypervisorAdminTestJSON-71091012-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:25.503071 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bc6e36ad-7cab-4fc9-b2c3-8479da25b491 tempest-HypervisorAdminTestJSON-71091012 tempest-HypervisorAdminTestJSON-71091012-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:25.510941 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-bc6e36ad-7cab-4fc9-b2c3-8479da25b491 tempest-HypervisorAdminTestJSON-71091012 tempest-HypervisorAdminTestJSON-71091012-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.454013 Oct 04 21:43:25.520101 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 31/80] 10.222.0.43 () {58 vars in 1146 bytes} [Tue Oct 4 21:43:25 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:43:25.526175 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-6ff9606d-65e3-4310-84f1-01661ecb931a tempest-HostsAdminNegativeTestJSON-2060517711 tempest-HostsAdminNegativeTestJSON-2060517711-project-admin] Calling method '.version_select at 0x7fbb2fff7790>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:25.533679 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-6ff9606d-65e3-4310-84f1-01661ecb931a tempest-HostsAdminNegativeTestJSON-2060517711 tempest-HostsAdminNegativeTestJSON-2060517711-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 21:43:25.535505 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-6ff9606d-65e3-4310-84f1-01661ecb931a tempest-HostsAdminNegativeTestJSON-2060517711 tempest-HostsAdminNegativeTestJSON-2060517711-project-admin] Request method failure captured: Oct 04 21:43:25.535505 n-d-860284-1 devstack@n-api.service[134101]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Oct 04 21:43:25.535505 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 21:43:25.535505 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 21:43:25.535505 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 21:43:25.535505 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 21:43:25.535505 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 21:43:25.535505 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 21:43:25.535505 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 21:43:25.535505 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 21:43:25.535505 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPKj78qONQOLSNQ0NBfuhAJxekqrxhbrtH1gAMa4W8HRIS0Ozxlj3mOGiRVfJPIsC8Fh5Cs2-u9I9kNJiX54tPlwFzilmKyugZs06FZ6mKYxqjm0VbeGV6oPo_TVtw2AHx5jUxPQuh3EqdMdgnzLXZD7OpZfHofpqt6wvHLnmtea19RY Oct 04 21:43:25.535505 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 21:43:25.535505 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 21:43:25.535505 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 21:43:25.535505 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 21:43:25.535505 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 21:43:25.535505 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 21:43:25.535505 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: 3ae3708b2488499db0002973c0108ddb Oct 04 21:43:25.535505 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2060517711 Oct 04 21:43:25.535505 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,admin,member Oct 04 21:43:25.535505 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,admin,member Oct 04 21:43:25.536745 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/3ae3708b2488499db0002973c0108ddb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_3ae3708b2488499db0002973c0108ddb", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/3ae3708b2488499db0002973c0108ddb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/3ae3708b2488499db0002973c0108ddb"}]}] Oct 04 21:43:25.536745 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2060517711 Oct 04 21:43:25.536745 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: 3ae3708b2488499db0002973c0108ddb Oct 04 21:43:25.536745 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2060517711 Oct 04 21:43:25.536745 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-HostsAdminNegativeTestJSON-2060517711-project-admin Oct 04 21:43:25.536745 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 21:43:25.536745 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 21:43:25.536745 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 7d597b726dd74aefb7529d0a2e42df3c Oct 04 21:43:25.536745 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2060517711-project-admin Oct 04 21:43:25.536745 n-d-860284-1 devstack@n-api.service[134101]: method: Oct 04 21:43:25.536745 n-d-860284-1 devstack@n-api.service[134101]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 21:43:25.536745 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': 'nonexistent_hostname'} Oct 04 21:43:25.536745 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:43:25.537399 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:43:25.537399 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show Oct 04 21:43:25.537399 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 04 21:43:25.537399 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 21:43:25.537399 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 21:43:25.537399 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 04 21:43:25.537399 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 04 21:43:25.537399 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 21:43:25.537399 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 21:43:25.537399 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 04 21:43:25.537399 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 04 21:43:25.537399 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 21:43:25.537399 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:43:25.537399 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:43:25.537399 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:43:25.537399 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:43:25.537399 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:43:25.537399 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:43:25.537399 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:43:25.538344 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:43:25.538344 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:43:25.538344 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:43:25.538344 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:43:25.538344 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:43:25.538344 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show Oct 04 21:43:25.538344 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:43:25.538344 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 21:43:25.538344 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:43:25.538344 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:43:25.538344 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:43:25.538344 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:43:25.538344 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:43:25.538344 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:43:25.538344 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:43:25.538344 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:43:25.538344 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 21:43:25.538344 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:43:25.540903 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-6ff9606d-65e3-4310-84f1-01661ecb931a tempest-HostsAdminNegativeTestJSON-2060517711 tempest-HostsAdminNegativeTestJSON-2060517711-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:43:25.541849 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-6ff9606d-65e3-4310-84f1-01661ecb931a tempest-HostsAdminNegativeTestJSON-2060517711 tempest-HostsAdminNegativeTestJSON-2060517711-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.020480 Oct 04 21:43:25.547073 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 32/81] 10.222.0.43 () {58 vars in 1191 bytes} [Tue Oct 4 21:43:25 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 21:43:25.547907 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e941373c-0869-4fc6-8364-7fbb213914dc tempest-AggregatesAdminNegativeTestJSON-664564698 tempest-AggregatesAdminNegativeTestJSON-664564698-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:43:25.554194 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e941373c-0869-4fc6-8364-7fbb213914dc tempest-AggregatesAdminNegativeTestJSON-664564698 tempest-AggregatesAdminNegativeTestJSON-664564698-project-admin] Request method failure captured: Oct 04 21:43:25.554194 n-d-860284-1 devstack@n-api.service[134101]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 04 21:43:25.554194 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 21:43:25.554194 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 21:43:25.554194 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 21:43:25.554194 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 283 Oct 04 21:43:25.554194 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 21:43:25.554194 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 21:43:25.554194 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 21:43:25.554194 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 21:43:25.554194 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPKj3TqDaGoyjJhtIccfWEJxEBj6A1jebRdZTgg-sR19wHLlaDAI2bdTq6Jkp5iiCM0u9cwW4jzhwdoXvQS-WsEl_ywcz5KPWJU7yW05bsnHLpXgHw78VijaFN0Vdk0iAUt3MBmWSUCRj3gV4jO-cbkqRKTWzujvkVBPGumXvhfg-3s0 Oct 04 21:43:25.554194 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 21:43:25.554194 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 21:43:25.554194 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 21:43:25.554194 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 21:43:25.554194 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 21:43:25.554194 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 21:43:25.554194 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: d44d9375451f48269c82a6e559b24c3e Oct 04 21:43:25.554194 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-664564698 Oct 04 21:43:25.554194 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,admin,member Oct 04 21:43:25.554194 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,admin,member Oct 04 21:43:25.555750 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d44d9375451f48269c82a6e559b24c3e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_d44d9375451f48269c82a6e559b24c3e", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d44d9375451f48269c82a6e559b24c3e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/d44d9375451f48269c82a6e559b24c3e"}]}] Oct 04 21:43:25.555750 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-664564698 Oct 04 21:43:25.555750 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: d44d9375451f48269c82a6e559b24c3e Oct 04 21:43:25.555750 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-664564698 Oct 04 21:43:25.555750 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-AggregatesAdminNegativeTestJSON-664564698-project-admin Oct 04 21:43:25.555750 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 21:43:25.555750 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 21:43:25.555750 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 9982336626444aa7b0582b5802e18c20 Oct 04 21:43:25.555750 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-664564698-project-admin Oct 04 21:43:25.555750 n-d-860284-1 devstack@n-api.service[134101]: Oct 04 21:43:25.556372 n-d-860284-1 devstack@n-api.service[134101]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 04 21:43:25.556372 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 21:43:25.556372 n-d-860284-1 devstack@n-api.service[134101]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 21:43:25.556372 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 04 21:43:25.556372 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:43:25.556372 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:43:25.556372 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 21:43:25.556372 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 21:43:25.556372 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 21:43:25.556372 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise error Oct 04 21:43:25.556897 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 21:43:25.556897 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:43:25.556897 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: Oct 04 21:43:25.556897 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 04 21:43:25.556897 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:43:25.556897 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Oct 04 21:43:25.556897 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 04 21:43:25.556897 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:43:25.556897 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:43:25.556897 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:43:25.556897 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:43:25.556897 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:43:25.556897 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:43:25.556897 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:43:25.556897 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:43:25.556897 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:43:25.556897 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:43:25.557740 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:43:25.557740 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:43:25.557740 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 21:43:25.557740 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 21:43:25.557740 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 21:43:25.557740 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 21:43:25.557740 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 21:43:25.557740 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 21:43:25.557740 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 21:43:25.557740 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:43:25.557740 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:43:25.557740 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:43:25.557740 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:43:25.557740 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:43:25.557740 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:43:25.559195 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 21:43:25.559195 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 21:43:25.559195 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 21:43:25.559195 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:43:25.559195 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e941373c-0869-4fc6-8364-7fbb213914dc tempest-AggregatesAdminNegativeTestJSON-664564698 tempest-AggregatesAdminNegativeTestJSON-664564698-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:43:25.559679 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-e941373c-0869-4fc6-8364-7fbb213914dc tempest-AggregatesAdminNegativeTestJSON-664564698 tempest-AggregatesAdminNegativeTestJSON-664564698-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.011869 Oct 04 21:43:25.561163 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 33/82] 10.222.0.43 () {60 vars in 1165 bytes} [Tue Oct 4 21:43:25 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 21:43:25.567133 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-08047314-6002-429c-bfcf-04028cbe89b8 tempest-FlavorsAdminTestJSON-34401135 tempest-FlavorsAdminTestJSON-34401135-project-admin] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:25.592785 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-08047314-6002-429c-bfcf-04028cbe89b8 tempest-FlavorsAdminTestJSON-34401135 tempest-FlavorsAdminTestJSON-34401135-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.030047 Oct 04 21:43:25.593381 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 34/83] 10.222.0.43 () {58 vars in 1146 bytes} [Tue Oct 4 21:43:25 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:43:25.597975 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-cc6b9d1d-2685-4a5e-8e3e-cbcc92bd9dc4 tempest-HypervisorAdminTestJSON-71091012 tempest-HypervisorAdminTestJSON-71091012-project-admin] Calling method '.version_select at 0x7fbb2fcea940>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:25.599818 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cc6b9d1d-2685-4a5e-8e3e-cbcc92bd9dc4 tempest-HypervisorAdminTestJSON-71091012 tempest-HypervisorAdminTestJSON-71091012-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:25.600308 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cc6b9d1d-2685-4a5e-8e3e-cbcc92bd9dc4 tempest-HypervisorAdminTestJSON-71091012 tempest-HypervisorAdminTestJSON-71091012-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:25.600756 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cc6b9d1d-2685-4a5e-8e3e-cbcc92bd9dc4 tempest-HypervisorAdminTestJSON-71091012 tempest-HypervisorAdminTestJSON-71091012-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:25.622527 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cc6b9d1d-2685-4a5e-8e3e-cbcc92bd9dc4 tempest-HypervisorAdminTestJSON-71091012 tempest-HypervisorAdminTestJSON-71091012-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:25.623034 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cc6b9d1d-2685-4a5e-8e3e-cbcc92bd9dc4 tempest-HypervisorAdminTestJSON-71091012 tempest-HypervisorAdminTestJSON-71091012-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:25.623547 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cc6b9d1d-2685-4a5e-8e3e-cbcc92bd9dc4 tempest-HypervisorAdminTestJSON-71091012 tempest-HypervisorAdminTestJSON-71091012-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:25.643650 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cc6b9d1d-2685-4a5e-8e3e-cbcc92bd9dc4 tempest-HypervisorAdminTestJSON-71091012 tempest-HypervisorAdminTestJSON-71091012-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:25.644378 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cc6b9d1d-2685-4a5e-8e3e-cbcc92bd9dc4 tempest-HypervisorAdminTestJSON-71091012 tempest-HypervisorAdminTestJSON-71091012-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:25.645086 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cc6b9d1d-2685-4a5e-8e3e-cbcc92bd9dc4 tempest-HypervisorAdminTestJSON-71091012 tempest-HypervisorAdminTestJSON-71091012-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:25.657365 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-cc6b9d1d-2685-4a5e-8e3e-cbcc92bd9dc4 tempest-HypervisorAdminTestJSON-71091012 tempest-HypervisorAdminTestJSON-71091012-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1504 microversion: 2.1 time: 0.062336 Oct 04 21:43:25.667229 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 35/84] 10.222.0.43 () {58 vars in 1167 bytes} [Tue Oct 4 21:43:25 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1504 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:43:25.674952 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-590abba6-3da5-4e8a-bdb4-bb9d2a0a19dc tempest-HostsAdminNegativeTestJSON-220876180 tempest-HostsAdminNegativeTestJSON-220876180-project] Calling method '.version_select at 0x7fbb2fcea670>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:25.678305 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-590abba6-3da5-4e8a-bdb4-bb9d2a0a19dc tempest-HostsAdminNegativeTestJSON-220876180 tempest-HostsAdminNegativeTestJSON-220876180-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': '481183bc2cc644158d242f862991213e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4e83b646f71428993a0dcbb37e4cd2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:43:25.680902 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-590abba6-3da5-4e8a-bdb4-bb9d2a0a19dc tempest-HostsAdminNegativeTestJSON-220876180 tempest-HostsAdminNegativeTestJSON-220876180-project] Request method failure captured: Oct 04 21:43:25.680902 n-d-860284-1 devstack@n-api.service[134101]: request: GET /compute/v2.1/os-hosts/n-d-860284-1/shutdown HTTP/1.1 Oct 04 21:43:25.680902 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 21:43:25.680902 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 21:43:25.680902 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 21:43:25.680902 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 21:43:25.680902 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 21:43:25.680902 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 21:43:25.680902 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 21:43:25.680902 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 21:43:25.680902 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPKj5xZA4dJRi0ZZNAYy-XXItpdUjnJ_NAow5vIAzgiQmRWgfJMP00IuY8o7lRZwJp9-SyGKznmCSui0kmEC_iHooj1t5bH9knGtsg-NOfRE272PYP-lVs2g4XADoeUKq8QyTm3HvxMKS71tZgHsNM1A3Akh5w89bBLxJNm7FCxtpGLk Oct 04 21:43:25.680902 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 21:43:25.680902 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 21:43:25.680902 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 21:43:25.680902 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 21:43:25.680902 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 21:43:25.680902 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 21:43:25.680902 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: d4e83b646f71428993a0dcbb37e4cd2d Oct 04 21:43:25.680902 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-220876180 Oct 04 21:43:25.680902 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 21:43:25.680902 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 21:43:25.681989 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d4e83b646f71428993a0dcbb37e4cd2d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_d4e83b646f71428993a0dcbb37e4cd2d", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d4e83b646f71428993a0dcbb37e4cd2d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/d4e83b646f71428993a0dcbb37e4cd2d"}]}] Oct 04 21:43:25.681989 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-HostsAdminNegativeTestJSON-220876180 Oct 04 21:43:25.681989 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: d4e83b646f71428993a0dcbb37e4cd2d Oct 04 21:43:25.681989 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-220876180 Oct 04 21:43:25.681989 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-HostsAdminNegativeTestJSON-220876180-project Oct 04 21:43:25.681989 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 21:43:25.681989 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 21:43:25.681989 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 481183bc2cc644158d242f862991213e Oct 04 21:43:25.681989 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-HostsAdminNegativeTestJSON-220876180-project Oct 04 21:43:25.681989 n-d-860284-1 devstack@n-api.service[134101]: method: Oct 04 21:43:25.681989 n-d-860284-1 devstack@n-api.service[134101]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 04 21:43:25.681989 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': 'n-d-860284-1'} Oct 04 21:43:25.681989 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:43:25.682708 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:43:25.682708 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:43:25.682708 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:43:25.682708 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:43:25.682708 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:43:25.682708 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:43:25.682708 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:43:25.682708 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:43:25.682708 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:43:25.682708 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown Oct 04 21:43:25.682708 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', Oct 04 21:43:25.682708 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 21:43:25.682708 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 21:43:25.682708 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 21:43:25.682708 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 21:43:25.682708 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 21:43:25.682708 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 21:43:25.682708 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 21:43:25.682708 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 21:43:25.683683 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 21:43:25.683683 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 21:43:25.683683 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 21:43:25.683683 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 21:43:25.683683 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 21:43:25.683683 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 21:43:25.683683 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 04 21:43:25.683683 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:43:25.683683 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:43:25.683683 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:43:25.683683 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:43:25.683683 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:43:25.683683 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:43:25.683683 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 21:43:25.683683 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 21:43:25.683683 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 04 21:43:25.683683 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:43:25.687251 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-590abba6-3da5-4e8a-bdb4-bb9d2a0a19dc tempest-HostsAdminNegativeTestJSON-220876180 tempest-HostsAdminNegativeTestJSON-220876180-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:43:25.688491 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-590abba6-3da5-4e8a-bdb4-bb9d2a0a19dc tempest-HostsAdminNegativeTestJSON-220876180 tempest-HostsAdminNegativeTestJSON-220876180-project] 10.222.0.43 "GET /compute/v2.1/os-hosts/n-d-860284-1/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.020050 Oct 04 21:43:25.696622 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 36/85] 10.222.0.43 () {58 vars in 1194 bytes} [Tue Oct 4 21:43:25 2022] GET /compute/v2.1/os-hosts/n-d-860284-1/shutdown => generated 113 bytes in 29 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:43:25.702562 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-1b89c459-36b2-4100-ba18-47a8f545cc72 tempest-AggregatesAdminNegativeTestJSON-664564698 tempest-AggregatesAdminNegativeTestJSON-664564698-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:43:25.722627 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-1b89c459-36b2-4100-ba18-47a8f545cc72 tempest-AggregatesAdminNegativeTestJSON-664564698 tempest-AggregatesAdminNegativeTestJSON-664564698-project-admin] Request method failure captured: Oct 04 21:43:25.722627 n-d-860284-1 devstack@n-api.service[134101]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 04 21:43:25.722627 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 21:43:25.722627 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 21:43:25.722627 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 21:43:25.722627 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 27 Oct 04 21:43:25.722627 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 21:43:25.722627 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 21:43:25.722627 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 21:43:25.722627 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 21:43:25.722627 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPKj3TqDaGoyjJhtIccfWEJxEBj6A1jebRdZTgg-sR19wHLlaDAI2bdTq6Jkp5iiCM0u9cwW4jzhwdoXvQS-WsEl_ywcz5KPWJU7yW05bsnHLpXgHw78VijaFN0Vdk0iAUt3MBmWSUCRj3gV4jO-cbkqRKTWzujvkVBPGumXvhfg-3s0 Oct 04 21:43:25.722627 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 21:43:25.722627 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 21:43:25.722627 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 21:43:25.722627 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 21:43:25.722627 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 21:43:25.722627 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 21:43:25.722627 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: d44d9375451f48269c82a6e559b24c3e Oct 04 21:43:25.722627 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-664564698 Oct 04 21:43:25.722627 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,admin,member Oct 04 21:43:25.722627 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,admin,member Oct 04 21:43:25.724004 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d44d9375451f48269c82a6e559b24c3e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_d44d9375451f48269c82a6e559b24c3e", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d44d9375451f48269c82a6e559b24c3e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/d44d9375451f48269c82a6e559b24c3e"}]}] Oct 04 21:43:25.724004 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-664564698 Oct 04 21:43:25.724004 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: d44d9375451f48269c82a6e559b24c3e Oct 04 21:43:25.724004 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-664564698 Oct 04 21:43:25.724004 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-AggregatesAdminNegativeTestJSON-664564698-project-admin Oct 04 21:43:25.724004 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 21:43:25.724004 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 21:43:25.724004 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 9982336626444aa7b0582b5802e18c20 Oct 04 21:43:25.724004 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-664564698-project-admin Oct 04 21:43:25.724004 n-d-860284-1 devstack@n-api.service[134101]: Oct 04 21:43:25.724004 n-d-860284-1 devstack@n-api.service[134101]: {"aggregate": {"name": ""}} Oct 04 21:43:25.724004 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 21:43:25.724004 n-d-860284-1 devstack@n-api.service[134101]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 04 21:43:25.724685 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'body': {'aggregate': {'name': ''}}} Oct 04 21:43:25.724685 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:43:25.724685 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:43:25.724685 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 21:43:25.724685 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 21:43:25.724685 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 21:43:25.724685 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise error Oct 04 21:43:25.724685 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 04 21:43:25.724685 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:43:25.724685 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: Oct 04 21:43:25.724685 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 04 21:43:25.724685 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:43:25.724685 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Oct 04 21:43:25.724685 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi '' Oct 04 21:43:25.724685 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:43:25.724685 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:43:25.724685 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:43:25.724685 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:43:25.724685 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:43:25.724685 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:43:25.724685 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:43:25.724685 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:43:25.724685 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:43:25.725866 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:43:25.725866 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:43:25.725866 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:43:25.725866 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 21:43:25.725866 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 21:43:25.725866 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 21:43:25.725866 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 21:43:25.725866 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 21:43:25.725866 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 21:43:25.725866 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 04 21:43:25.725866 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:43:25.725866 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:43:25.725866 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:43:25.725866 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:43:25.725866 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:43:25.725866 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:43:25.725866 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 21:43:25.725866 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 21:43:25.725866 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 04 21:43:25.725866 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:43:25.732234 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-1b89c459-36b2-4100-ba18-47a8f545cc72 tempest-AggregatesAdminNegativeTestJSON-664564698 tempest-AggregatesAdminNegativeTestJSON-664564698-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:43:25.733530 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-1b89c459-36b2-4100-ba18-47a8f545cc72 tempest-AggregatesAdminNegativeTestJSON-664564698 tempest-AggregatesAdminNegativeTestJSON-664564698-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.035401 Oct 04 21:43:25.735387 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 37/86] 10.222.0.43 () {60 vars in 1164 bytes} [Tue Oct 4 21:43:25 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 38 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 21:43:25.748705 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-12dad2f0-b435-4b41-87d9-1c67f15d4ea0 tempest-FlavorsAdminTestJSON-790532742 tempest-FlavorsAdminTestJSON-790532742-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:25.797948 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-12dad2f0-b435-4b41-87d9-1c67f15d4ea0 tempest-FlavorsAdminTestJSON-790532742 tempest-FlavorsAdminTestJSON-790532742-project] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.060983 Oct 04 21:43:25.800724 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 38/87] 10.222.0.43 () {58 vars in 1146 bytes} [Tue Oct 4 21:43:25 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:43:25.813357 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-362a11c4-f62e-4735-b52b-577b82adb936 tempest-HypervisorAdminTestJSON-71091012 tempest-HypervisorAdminTestJSON-71091012-project-admin] Calling method '.version_select at 0x7fbb2fcdee50>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:25.815752 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-362a11c4-f62e-4735-b52b-577b82adb936 tempest-HypervisorAdminTestJSON-71091012 tempest-HypervisorAdminTestJSON-71091012-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:25.816394 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-362a11c4-f62e-4735-b52b-577b82adb936 tempest-HypervisorAdminTestJSON-71091012 tempest-HypervisorAdminTestJSON-71091012-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:25.816986 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-362a11c4-f62e-4735-b52b-577b82adb936 tempest-HypervisorAdminTestJSON-71091012 tempest-HypervisorAdminTestJSON-71091012-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:25.833407 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-362a11c4-f62e-4735-b52b-577b82adb936 tempest-HypervisorAdminTestJSON-71091012 tempest-HypervisorAdminTestJSON-71091012-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:25.834123 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-362a11c4-f62e-4735-b52b-577b82adb936 tempest-HypervisorAdminTestJSON-71091012 tempest-HypervisorAdminTestJSON-71091012-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:25.834747 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-362a11c4-f62e-4735-b52b-577b82adb936 tempest-HypervisorAdminTestJSON-71091012 tempest-HypervisorAdminTestJSON-71091012-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:25.847686 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-362a11c4-f62e-4735-b52b-577b82adb936 tempest-HypervisorAdminTestJSON-71091012 tempest-HypervisorAdminTestJSON-71091012-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:25.848570 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-362a11c4-f62e-4735-b52b-577b82adb936 tempest-HypervisorAdminTestJSON-71091012 tempest-HypervisorAdminTestJSON-71091012-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:25.849395 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-362a11c4-f62e-4735-b52b-577b82adb936 tempest-HypervisorAdminTestJSON-71091012 tempest-HypervisorAdminTestJSON-71091012-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:25.857420 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-362a11c4-f62e-4735-b52b-577b82adb936 tempest-HypervisorAdminTestJSON-71091012 tempest-HypervisorAdminTestJSON-71091012-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.054947 Oct 04 21:43:25.858682 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 39/88] 10.222.0.43 () {58 vars in 1146 bytes} [Tue Oct 4 21:43:25 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:43:25.864158 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-c9be34eb-ae6d-4ca1-916a-467b94fac3aa tempest-HostsAdminNegativeTestJSON-2060517711 tempest-HostsAdminNegativeTestJSON-2060517711-project-admin] Calling method '.version_select at 0x7fbb2fcdeca0>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:25.874047 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-c9be34eb-ae6d-4ca1-916a-467b94fac3aa tempest-HostsAdminNegativeTestJSON-2060517711 tempest-HostsAdminNegativeTestJSON-2060517711-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 21:43:25.876185 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-c9be34eb-ae6d-4ca1-916a-467b94fac3aa tempest-HostsAdminNegativeTestJSON-2060517711 tempest-HostsAdminNegativeTestJSON-2060517711-project-admin] Request method failure captured: Oct 04 21:43:25.876185 n-d-860284-1 devstack@n-api.service[134101]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 Oct 04 21:43:25.876185 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 21:43:25.876185 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 21:43:25.876185 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 21:43:25.876185 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 21:43:25.876185 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 21:43:25.876185 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 21:43:25.876185 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 21:43:25.876185 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 21:43:25.876185 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPKj78qONQOLSNQ0NBfuhAJxekqrxhbrtH1gAMa4W8HRIS0Ozxlj3mOGiRVfJPIsC8Fh5Cs2-u9I9kNJiX54tPlwFzilmKyugZs06FZ6mKYxqjm0VbeGV6oPo_TVtw2AHx5jUxPQuh3EqdMdgnzLXZD7OpZfHofpqt6wvHLnmtea19RY Oct 04 21:43:25.876185 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 21:43:25.876185 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 21:43:25.876185 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 21:43:25.876185 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 21:43:25.876185 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 21:43:25.876185 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 21:43:25.876185 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: 3ae3708b2488499db0002973c0108ddb Oct 04 21:43:25.876185 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2060517711 Oct 04 21:43:25.876185 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,admin,member Oct 04 21:43:25.876185 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,admin,member Oct 04 21:43:25.877269 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/3ae3708b2488499db0002973c0108ddb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_3ae3708b2488499db0002973c0108ddb", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/3ae3708b2488499db0002973c0108ddb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/3ae3708b2488499db0002973c0108ddb"}]}] Oct 04 21:43:25.877269 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2060517711 Oct 04 21:43:25.877269 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: 3ae3708b2488499db0002973c0108ddb Oct 04 21:43:25.877269 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2060517711 Oct 04 21:43:25.877269 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-HostsAdminNegativeTestJSON-2060517711-project-admin Oct 04 21:43:25.877269 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 21:43:25.877269 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 21:43:25.877269 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 7d597b726dd74aefb7529d0a2e42df3c Oct 04 21:43:25.877269 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2060517711-project-admin Oct 04 21:43:25.877269 n-d-860284-1 devstack@n-api.service[134101]: method: Oct 04 21:43:25.877269 n-d-860284-1 devstack@n-api.service[134101]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 21:43:25.877269 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': 'nonexistent_hostname'} Oct 04 21:43:25.877269 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:43:25.878491 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:43:25.878491 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 04 21:43:25.878491 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 04 21:43:25.878491 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 21:43:25.878491 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 21:43:25.878491 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 21:43:25.878491 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 21:43:25.878491 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 21:43:25.878491 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 21:43:25.878491 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 21:43:25.878491 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 21:43:25.878491 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 04 21:43:25.878491 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 04 21:43:25.878491 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 21:43:25.878491 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 21:43:25.878491 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 04 21:43:25.878491 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 04 21:43:25.878491 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 21:43:25.878491 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 21:43:25.879431 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 04 21:43:25.879431 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 04 21:43:25.879431 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 21:43:25.879431 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:43:25.879431 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:43:25.879431 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:43:25.879431 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:43:25.879431 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:43:25.879431 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:43:25.879431 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:43:25.879431 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:43:25.879431 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:43:25.879431 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:43:25.879431 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:43:25.879431 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:43:25.879431 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown Oct 04 21:43:25.879431 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") Oct 04 21:43:25.879431 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 04 21:43:25.879431 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:43:25.880378 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 21:43:25.880378 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:43:25.880378 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:43:25.880378 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:43:25.880378 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:43:25.880378 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:43:25.880378 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:43:25.880378 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:43:25.880378 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:43:25.880378 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 21:43:25.880378 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:43:25.883771 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-c9be34eb-ae6d-4ca1-916a-467b94fac3aa tempest-HostsAdminNegativeTestJSON-2060517711 tempest-HostsAdminNegativeTestJSON-2060517711-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:43:25.885049 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-c9be34eb-ae6d-4ca1-916a-467b94fac3aa tempest-HostsAdminNegativeTestJSON-2060517711 tempest-HostsAdminNegativeTestJSON-2060517711-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.025054 Oct 04 21:43:25.890086 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 40/89] 10.222.0.43 () {58 vars in 1218 bytes} [Tue Oct 4 21:43:25 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 21:43:25.895695 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e3c2783c-b54c-44e2-a9ae-4dd6b238151f tempest-AggregatesAdminNegativeTestJSON-924415762 tempest-AggregatesAdminNegativeTestJSON-924415762-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1197570428"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:43:25.901140 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-e3c2783c-b54c-44e2-a9ae-4dd6b238151f tempest-AggregatesAdminNegativeTestJSON-924415762 tempest-AggregatesAdminNegativeTestJSON-924415762-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': 'fcfba6078cc8420d913383e2082a22ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa8ecde157b463193ea9635b15ad255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:43:25.903691 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e3c2783c-b54c-44e2-a9ae-4dd6b238151f tempest-AggregatesAdminNegativeTestJSON-924415762 tempest-AggregatesAdminNegativeTestJSON-924415762-project] Request method failure captured: Oct 04 21:43:25.903691 n-d-860284-1 devstack@n-api.service[134101]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 04 21:43:25.903691 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 21:43:25.903691 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 21:43:25.903691 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 21:43:25.903691 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 60 Oct 04 21:43:25.903691 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 21:43:25.903691 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 21:43:25.903691 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 21:43:25.903691 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 21:43:25.903691 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPKj0sUoAZZb3Xj012WEWWEcxezFEjoqwdwb2wWQa2zcKJIMCHkH7iRzGhMkrAZ42RHW09PCKNhQ2Uj1QZhXAgjIj4fLq3sXTvQwjQcQezstrjEp16MwU8GSGOH7mhj6mUlcCbKJ073k0NTJyIY37zKtkuywjWPZ3g5u9E6-X6lD2zEs Oct 04 21:43:25.903691 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 21:43:25.903691 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 21:43:25.903691 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 21:43:25.903691 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 21:43:25.903691 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 21:43:25.903691 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 21:43:25.903691 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: 1aa8ecde157b463193ea9635b15ad255 Oct 04 21:43:25.903691 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-924415762 Oct 04 21:43:25.903691 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 21:43:25.903691 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 21:43:25.904794 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1aa8ecde157b463193ea9635b15ad255"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_1aa8ecde157b463193ea9635b15ad255", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1aa8ecde157b463193ea9635b15ad255"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/1aa8ecde157b463193ea9635b15ad255"}]}] Oct 04 21:43:25.904794 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-924415762 Oct 04 21:43:25.904794 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: 1aa8ecde157b463193ea9635b15ad255 Oct 04 21:43:25.904794 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-924415762 Oct 04 21:43:25.904794 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-AggregatesAdminNegativeTestJSON-924415762-project Oct 04 21:43:25.904794 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 21:43:25.904794 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 21:43:25.904794 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: fcfba6078cc8420d913383e2082a22ac Oct 04 21:43:25.904794 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-924415762-project Oct 04 21:43:25.904794 n-d-860284-1 devstack@n-api.service[134101]: Oct 04 21:43:25.904794 n-d-860284-1 devstack@n-api.service[134101]: {"aggregate": {"name": "tempest-test_aggregate-1197570428"}} Oct 04 21:43:25.904794 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 21:43:25.904794 n-d-860284-1 devstack@n-api.service[134101]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 04 21:43:25.905456 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1197570428'}}} Oct 04 21:43:25.905456 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:43:25.905456 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:43:25.905456 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:43:25.905456 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:43:25.905456 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:43:25.905456 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:43:25.905456 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:43:25.905456 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:43:25.905456 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:43:25.905456 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:43:25.905456 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:43:25.905456 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:43:25.905456 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create Oct 04 21:43:25.905456 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) Oct 04 21:43:25.905456 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 21:43:25.905456 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 21:43:25.905456 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 21:43:25.905456 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 21:43:25.906403 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 21:43:25.906403 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 21:43:25.906403 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 21:43:25.906403 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 21:43:25.906403 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 21:43:25.906403 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 21:43:25.906403 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 21:43:25.906403 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 21:43:25.906403 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 21:43:25.906403 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 21:43:25.906403 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 04 21:43:25.906403 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:43:25.906403 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:43:25.906403 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:43:25.906403 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:43:25.906403 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:43:25.906403 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:43:25.906403 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 21:43:25.906403 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 21:43:25.906403 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 04 21:43:25.907397 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:43:25.908939 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e3c2783c-b54c-44e2-a9ae-4dd6b238151f tempest-AggregatesAdminNegativeTestJSON-924415762 tempest-AggregatesAdminNegativeTestJSON-924415762-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:43:25.910005 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-e3c2783c-b54c-44e2-a9ae-4dd6b238151f tempest-AggregatesAdminNegativeTestJSON-924415762 tempest-AggregatesAdminNegativeTestJSON-924415762-project] 10.222.0.43 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.018591 Oct 04 21:43:25.911128 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 41/90] 10.222.0.43 () {60 vars in 1164 bytes} [Tue Oct 4 21:43:25 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 20 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:43:25.921339 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-edd5aab2-b73d-404d-9aee-a51d358749e1 tempest-FlavorsAdminTestJSON-34401135 tempest-FlavorsAdminTestJSON-34401135-project-admin] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:25.964547 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-edd5aab2-b73d-404d-9aee-a51d358749e1 tempest-FlavorsAdminTestJSON-34401135 tempest-FlavorsAdminTestJSON-34401135-project-admin] 10.222.0.43 "DELETE /compute/v2.1/flavors/1720006271" status: 202 len: 0 microversion: 2.1 time: 0.051345 Oct 04 21:43:25.965926 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 42/91] 10.222.0.43 () {58 vars in 1161 bytes} [Tue Oct 4 21:43:25 2022] DELETE /compute/v2.1/flavors/1720006271 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:43:25.971282 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-23d5a4a4-1d21-4854-a8e5-7e2b70bbae59 tempest-HypervisorAdminTestJSON-71091012 tempest-HypervisorAdminTestJSON-71091012-project-admin] Calling method '.version_select at 0x7fbb2fcea0d0>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:25.975113 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-23d5a4a4-1d21-4854-a8e5-7e2b70bbae59 tempest-HypervisorAdminTestJSON-71091012 tempest-HypervisorAdminTestJSON-71091012-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:25.975665 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-23d5a4a4-1d21-4854-a8e5-7e2b70bbae59 tempest-HypervisorAdminTestJSON-71091012 tempest-HypervisorAdminTestJSON-71091012-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:25.976130 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-23d5a4a4-1d21-4854-a8e5-7e2b70bbae59 tempest-HypervisorAdminTestJSON-71091012 tempest-HypervisorAdminTestJSON-71091012-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:25.995784 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-23d5a4a4-1d21-4854-a8e5-7e2b70bbae59 tempest-HypervisorAdminTestJSON-71091012 tempest-HypervisorAdminTestJSON-71091012-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:25.996276 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-23d5a4a4-1d21-4854-a8e5-7e2b70bbae59 tempest-HypervisorAdminTestJSON-71091012 tempest-HypervisorAdminTestJSON-71091012-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:25.996700 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-23d5a4a4-1d21-4854-a8e5-7e2b70bbae59 tempest-HypervisorAdminTestJSON-71091012 tempest-HypervisorAdminTestJSON-71091012-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:25.999802 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-296c0be2-3538-45ae-aac5-83f6aa204ecf tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-1534459716", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452", "availability_zone": "tempest-test_az-924719273"}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:43:26.003468 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-23d5a4a4-1d21-4854-a8e5-7e2b70bbae59 tempest-HypervisorAdminTestJSON-71091012 tempest-HypervisorAdminTestJSON-71091012-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.036162 Oct 04 21:43:26.004132 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 43/92] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Oct 4 21:43:25 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:43:26.009181 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-42faf80c-ce5c-4561-9267-478111fe74ee tempest-HostsAdminNegativeTestJSON-220876180 tempest-HostsAdminNegativeTestJSON-220876180-project] Calling method '.version_select at 0x7fbb2fcb38b0>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:26.011450 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-42faf80c-ce5c-4561-9267-478111fe74ee tempest-HostsAdminNegativeTestJSON-220876180 tempest-HostsAdminNegativeTestJSON-220876180-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': '481183bc2cc644158d242f862991213e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4e83b646f71428993a0dcbb37e4cd2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:43:26.015091 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-42faf80c-ce5c-4561-9267-478111fe74ee tempest-HostsAdminNegativeTestJSON-220876180 tempest-HostsAdminNegativeTestJSON-220876180-project] Request method failure captured: Oct 04 21:43:26.015091 n-d-860284-1 devstack@n-api.service[134101]: request: GET /compute/v2.1/os-hosts/n-d-860284-1/startup HTTP/1.1 Oct 04 21:43:26.015091 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 21:43:26.015091 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 21:43:26.015091 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 21:43:26.015091 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 21:43:26.015091 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 21:43:26.015091 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 21:43:26.015091 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 21:43:26.015091 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 21:43:26.015091 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPKj5xZA4dJRi0ZZNAYy-XXItpdUjnJ_NAow5vIAzgiQmRWgfJMP00IuY8o7lRZwJp9-SyGKznmCSui0kmEC_iHooj1t5bH9knGtsg-NOfRE272PYP-lVs2g4XADoeUKq8QyTm3HvxMKS71tZgHsNM1A3Akh5w89bBLxJNm7FCxtpGLk Oct 04 21:43:26.015091 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 21:43:26.015091 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 21:43:26.015091 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 21:43:26.015091 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 21:43:26.015091 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 21:43:26.015091 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 21:43:26.015091 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: d4e83b646f71428993a0dcbb37e4cd2d Oct 04 21:43:26.015091 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-220876180 Oct 04 21:43:26.015091 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 21:43:26.015091 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 21:43:26.016163 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d4e83b646f71428993a0dcbb37e4cd2d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_d4e83b646f71428993a0dcbb37e4cd2d", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d4e83b646f71428993a0dcbb37e4cd2d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/d4e83b646f71428993a0dcbb37e4cd2d"}]}] Oct 04 21:43:26.016163 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-HostsAdminNegativeTestJSON-220876180 Oct 04 21:43:26.016163 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: d4e83b646f71428993a0dcbb37e4cd2d Oct 04 21:43:26.016163 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-220876180 Oct 04 21:43:26.016163 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-HostsAdminNegativeTestJSON-220876180-project Oct 04 21:43:26.016163 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 21:43:26.016163 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 21:43:26.016163 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 481183bc2cc644158d242f862991213e Oct 04 21:43:26.016163 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-HostsAdminNegativeTestJSON-220876180-project Oct 04 21:43:26.016163 n-d-860284-1 devstack@n-api.service[134101]: method: Oct 04 21:43:26.016163 n-d-860284-1 devstack@n-api.service[134101]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 04 21:43:26.016163 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': 'n-d-860284-1'} Oct 04 21:43:26.016163 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:43:26.016801 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:43:26.016801 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:43:26.016801 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:43:26.016801 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:43:26.016801 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:43:26.016801 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:43:26.016801 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:43:26.016801 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:43:26.016801 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:43:26.016801 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup Oct 04 21:43:26.016801 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', Oct 04 21:43:26.016801 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 21:43:26.016801 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 21:43:26.016801 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 21:43:26.016801 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 21:43:26.016801 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 21:43:26.016801 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 21:43:26.016801 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 21:43:26.016801 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 21:43:26.017722 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 21:43:26.017722 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 21:43:26.017722 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 21:43:26.017722 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 21:43:26.017722 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 21:43:26.017722 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 21:43:26.017722 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 04 21:43:26.017722 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:43:26.017722 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:43:26.017722 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:43:26.017722 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:43:26.017722 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:43:26.017722 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:43:26.017722 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 21:43:26.017722 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 21:43:26.017722 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 04 21:43:26.017722 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:43:26.019912 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-42faf80c-ce5c-4561-9267-478111fe74ee tempest-HostsAdminNegativeTestJSON-220876180 tempest-HostsAdminNegativeTestJSON-220876180-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:43:26.021039 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-42faf80c-ce5c-4561-9267-478111fe74ee tempest-HostsAdminNegativeTestJSON-220876180 tempest-HostsAdminNegativeTestJSON-220876180-project] 10.222.0.43 "GET /compute/v2.1/os-hosts/n-d-860284-1/startup" status: 403 len: 110 microversion: 2.1 time: 0.015658 Oct 04 21:43:26.021415 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-296c0be2-3538-45ae-aac5-83f6aa204ecf tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:26.022599 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 44/93] 10.222.0.43 () {58 vars in 1191 bytes} [Tue Oct 4 21:43:26 2022] GET /compute/v2.1/os-hosts/n-d-860284-1/startup => generated 110 bytes in 18 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:43:26.024308 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-296c0be2-3538-45ae-aac5-83f6aa204ecf tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:26.026245 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-296c0be2-3538-45ae-aac5-83f6aa204ecf tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:26.028431 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-296c0be2-3538-45ae-aac5-83f6aa204ecf tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:26.028591 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e2741bd5-5eab-411c-b5e1-925a07d6c32d tempest-AggregatesAdminNegativeTestJSON-664564698 tempest-AggregatesAdminNegativeTestJSON-664564698-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1971341265"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:43:26.029000 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-296c0be2-3538-45ae-aac5-83f6aa204ecf tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:26.029453 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-296c0be2-3538-45ae-aac5-83f6aa204ecf tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:26.032558 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.objects.aggregate [None req-e2741bd5-5eab-411c-b5e1-925a07d6c32d tempest-AggregatesAdminNegativeTestJSON-664564698 tempest-AggregatesAdminNegativeTestJSON-664564698-project-admin] Generated uuid ab522c35-75be-4f9b-bde7-0f324dbfcb44 for aggregate {{(pid=134101) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 21:43:26.060283 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-e2741bd5-5eab-411c-b5e1-925a07d6c32d tempest-AggregatesAdminNegativeTestJSON-664564698 tempest-AggregatesAdminNegativeTestJSON-664564698-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.036250 Oct 04 21:43:26.061199 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 45/94] 10.222.0.43 () {60 vars in 1164 bytes} [Tue Oct 4 21:43:26 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:43:26.069705 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-b3cecc26-9021-44ce-ba67-062b8f2b6b84 tempest-FlavorsAdminTestJSON-34401135 tempest-FlavorsAdminTestJSON-34401135-project-admin] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:26.092393 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-b3cecc26-9021-44ce-ba67-062b8f2b6b84 tempest-FlavorsAdminTestJSON-34401135 tempest-FlavorsAdminTestJSON-34401135-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.029994 Oct 04 21:43:26.093313 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 46/95] 10.222.0.43 () {58 vars in 1146 bytes} [Tue Oct 4 21:43:26 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:43:26.097677 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-b0da5dd4-92f0-4b41-ab29-b45afe620a24 tempest-HypervisorAdminTestJSON-71091012 tempest-HypervisorAdminTestJSON-71091012-project-admin] Calling method '.version_select at 0x7fbb2fcea550>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:26.100239 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b0da5dd4-92f0-4b41-ab29-b45afe620a24 tempest-HypervisorAdminTestJSON-71091012 tempest-HypervisorAdminTestJSON-71091012-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:26.101228 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b0da5dd4-92f0-4b41-ab29-b45afe620a24 tempest-HypervisorAdminTestJSON-71091012 tempest-HypervisorAdminTestJSON-71091012-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:26.102467 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b0da5dd4-92f0-4b41-ab29-b45afe620a24 tempest-HypervisorAdminTestJSON-71091012 tempest-HypervisorAdminTestJSON-71091012-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:26.144264 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-b0da5dd4-92f0-4b41-ab29-b45afe620a24 tempest-HypervisorAdminTestJSON-71091012 tempest-HypervisorAdminTestJSON-71091012-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 263 microversion: 2.1 time: 0.044384 Oct 04 21:43:26.144942 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 47/96] 10.222.0.43 () {58 vars in 1179 bytes} [Tue Oct 4 21:43:26 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 263 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:43:26.153537 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-f87e2719-2aeb-48dd-834d-32bf01ea3757 tempest-HostsAdminNegativeTestJSON-2060517711 tempest-HostsAdminNegativeTestJSON-2060517711-project-admin] Calling method '.version_select at 0x7fbb2fcb3ee0>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:26.169218 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.network.neutron [None req-296c0be2-3538-45ae-aac5-83f6aa204ecf tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] validate_networks() for None {{(pid=134102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:43:26.175370 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-f87e2719-2aeb-48dd-834d-32bf01ea3757 tempest-HostsAdminNegativeTestJSON-2060517711 tempest-HostsAdminNegativeTestJSON-2060517711-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 21:43:26.178922 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-f87e2719-2aeb-48dd-834d-32bf01ea3757 tempest-HostsAdminNegativeTestJSON-2060517711 tempest-HostsAdminNegativeTestJSON-2060517711-project-admin] Request method failure captured: Oct 04 21:43:26.178922 n-d-860284-1 devstack@n-api.service[134101]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 Oct 04 21:43:26.178922 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 21:43:26.178922 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 21:43:26.178922 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 21:43:26.178922 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 21:43:26.178922 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 21:43:26.178922 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 21:43:26.178922 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 21:43:26.178922 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 21:43:26.178922 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPKj78qONQOLSNQ0NBfuhAJxekqrxhbrtH1gAMa4W8HRIS0Ozxlj3mOGiRVfJPIsC8Fh5Cs2-u9I9kNJiX54tPlwFzilmKyugZs06FZ6mKYxqjm0VbeGV6oPo_TVtw2AHx5jUxPQuh3EqdMdgnzLXZD7OpZfHofpqt6wvHLnmtea19RY Oct 04 21:43:26.178922 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 21:43:26.178922 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 21:43:26.178922 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 21:43:26.178922 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 21:43:26.178922 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 21:43:26.178922 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 21:43:26.178922 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: 3ae3708b2488499db0002973c0108ddb Oct 04 21:43:26.178922 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2060517711 Oct 04 21:43:26.178922 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,admin,member Oct 04 21:43:26.178922 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,admin,member Oct 04 21:43:26.180764 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/3ae3708b2488499db0002973c0108ddb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_3ae3708b2488499db0002973c0108ddb", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/3ae3708b2488499db0002973c0108ddb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/3ae3708b2488499db0002973c0108ddb"}]}] Oct 04 21:43:26.180764 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2060517711 Oct 04 21:43:26.180764 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: 3ae3708b2488499db0002973c0108ddb Oct 04 21:43:26.180764 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2060517711 Oct 04 21:43:26.180764 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-HostsAdminNegativeTestJSON-2060517711-project-admin Oct 04 21:43:26.180764 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 21:43:26.180764 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 21:43:26.180764 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 7d597b726dd74aefb7529d0a2e42df3c Oct 04 21:43:26.180764 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2060517711-project-admin Oct 04 21:43:26.180764 n-d-860284-1 devstack@n-api.service[134101]: method: Oct 04 21:43:26.180764 n-d-860284-1 devstack@n-api.service[134101]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 21:43:26.180764 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': 'nonexistent_hostname'} Oct 04 21:43:26.180764 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:43:26.181492 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:43:26.181492 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 04 21:43:26.181492 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 04 21:43:26.181492 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 21:43:26.181492 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 21:43:26.181492 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 21:43:26.181492 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 21:43:26.181492 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 21:43:26.181492 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 21:43:26.181492 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 21:43:26.181492 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 21:43:26.181492 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 04 21:43:26.181492 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 04 21:43:26.181492 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 21:43:26.181492 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 21:43:26.181492 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 04 21:43:26.181492 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 04 21:43:26.181492 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 21:43:26.181492 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 21:43:26.182909 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 04 21:43:26.182909 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 04 21:43:26.182909 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 21:43:26.182909 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:43:26.182909 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:43:26.182909 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:43:26.182909 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:43:26.182909 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:43:26.182909 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:43:26.182909 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:43:26.182909 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:43:26.182909 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:43:26.182909 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:43:26.182909 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:43:26.182909 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:43:26.182909 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup Oct 04 21:43:26.182909 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") Oct 04 21:43:26.182909 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 04 21:43:26.182909 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:43:26.184098 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 21:43:26.184098 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:43:26.184098 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:43:26.184098 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:43:26.184098 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:43:26.184098 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:43:26.184098 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:43:26.184098 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:43:26.184098 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:43:26.184098 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 21:43:26.184098 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:43:26.184098 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-f87e2719-2aeb-48dd-834d-32bf01ea3757 tempest-HostsAdminNegativeTestJSON-2060517711 tempest-HostsAdminNegativeTestJSON-2060517711-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:43:26.184098 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-f87e2719-2aeb-48dd-834d-32bf01ea3757 tempest-HostsAdminNegativeTestJSON-2060517711 tempest-HostsAdminNegativeTestJSON-2060517711-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.035433 Oct 04 21:43:26.184795 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 48/97] 10.222.0.43 () {58 vars in 1215 bytes} [Tue Oct 4 21:43:26 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 21:43:26.191617 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-685d9f6d-9008-48eb-b8fb-aaa21b819e81 tempest-AggregatesAdminNegativeTestJSON-664564698 tempest-AggregatesAdminNegativeTestJSON-664564698-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1971341265"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:43:26.197195 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.objects.aggregate [None req-685d9f6d-9008-48eb-b8fb-aaa21b819e81 tempest-AggregatesAdminNegativeTestJSON-664564698 tempest-AggregatesAdminNegativeTestJSON-664564698-project-admin] Generated uuid 1a4ee9c4-83d0-4d86-8ec3-8d260d74307b for aggregate {{(pid=134101) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 21:43:26.207739 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-685d9f6d-9008-48eb-b8fb-aaa21b819e81 tempest-AggregatesAdminNegativeTestJSON-664564698 tempest-AggregatesAdminNegativeTestJSON-664564698-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-1971341265 already exists. Oct 04 21:43:26.209894 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-685d9f6d-9008-48eb-b8fb-aaa21b819e81 tempest-AggregatesAdminNegativeTestJSON-664564698 tempest-AggregatesAdminNegativeTestJSON-664564698-project-admin] Request method failure captured: Oct 04 21:43:26.209894 n-d-860284-1 devstack@n-api.service[134101]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 04 21:43:26.209894 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 21:43:26.209894 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 21:43:26.209894 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 21:43:26.209894 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 60 Oct 04 21:43:26.209894 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 21:43:26.209894 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 21:43:26.209894 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 21:43:26.209894 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 21:43:26.209894 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPKj3TqDaGoyjJhtIccfWEJxEBj6A1jebRdZTgg-sR19wHLlaDAI2bdTq6Jkp5iiCM0u9cwW4jzhwdoXvQS-WsEl_ywcz5KPWJU7yW05bsnHLpXgHw78VijaFN0Vdk0iAUt3MBmWSUCRj3gV4jO-cbkqRKTWzujvkVBPGumXvhfg-3s0 Oct 04 21:43:26.209894 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 21:43:26.209894 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 21:43:26.209894 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 21:43:26.209894 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 21:43:26.209894 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 21:43:26.209894 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 21:43:26.209894 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: d44d9375451f48269c82a6e559b24c3e Oct 04 21:43:26.209894 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-664564698 Oct 04 21:43:26.209894 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,admin,member Oct 04 21:43:26.209894 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,admin,member Oct 04 21:43:26.211342 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d44d9375451f48269c82a6e559b24c3e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_d44d9375451f48269c82a6e559b24c3e", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d44d9375451f48269c82a6e559b24c3e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/d44d9375451f48269c82a6e559b24c3e"}]}] Oct 04 21:43:26.211342 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-664564698 Oct 04 21:43:26.211342 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: d44d9375451f48269c82a6e559b24c3e Oct 04 21:43:26.211342 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-664564698 Oct 04 21:43:26.211342 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-AggregatesAdminNegativeTestJSON-664564698-project-admin Oct 04 21:43:26.211342 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 21:43:26.211342 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 21:43:26.211342 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 9982336626444aa7b0582b5802e18c20 Oct 04 21:43:26.211342 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-664564698-project-admin Oct 04 21:43:26.211342 n-d-860284-1 devstack@n-api.service[134101]: Oct 04 21:43:26.211342 n-d-860284-1 devstack@n-api.service[134101]: {"aggregate": {"name": "tempest-test_aggregate-1971341265"}} Oct 04 21:43:26.211342 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 21:43:26.211342 n-d-860284-1 devstack@n-api.service[134101]: exception: Aggregate tempest-test_aggregate-1971341265 already exists. Oct 04 21:43:26.212122 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1971341265'}}} Oct 04 21:43:26.212122 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:43:26.212122 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:43:26.212122 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create Oct 04 21:43:26.212122 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) Oct 04 21:43:26.212122 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 21:43:26.212122 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 21:43:26.212122 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 21:43:26.212122 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 21:43:26.212122 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 21:43:26.212122 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 21:43:26.212122 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 21:43:26.212122 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 21:43:26.212122 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6458, in create_aggregate Oct 04 21:43:26.212122 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi aggregate.create() Oct 04 21:43:26.212122 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 04 21:43:26.212122 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 04 21:43:26.212122 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create Oct 04 21:43:26.212122 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, Oct 04 21:43:26.213057 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 21:43:26.213057 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 21:43:26.213057 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db Oct 04 21:43:26.213057 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) Oct 04 21:43:26.213057 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-1971341265 already exists. Oct 04 21:43:26.213057 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:43:26.213057 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:43:26.213057 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:43:26.213057 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:43:26.213057 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:43:26.213057 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:43:26.213057 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:43:26.213057 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:43:26.213057 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:43:26.213057 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:43:26.213057 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:43:26.213057 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:43:26.213057 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:43:26.213057 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:43:26.213057 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create Oct 04 21:43:26.214030 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Oct 04 21:43:26.214030 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-1971341265 already exists. Oct 04 21:43:26.214030 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:43:26.214030 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:43:26.214030 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:43:26.214030 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:43:26.214030 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:43:26.214030 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:43:26.214030 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:43:26.214030 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:43:26.214030 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-1971341265 already exists. Oct 04 21:43:26.214030 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:43:26.216243 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-685d9f6d-9008-48eb-b8fb-aaa21b819e81 tempest-AggregatesAdminNegativeTestJSON-664564698 tempest-AggregatesAdminNegativeTestJSON-664564698-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-1971341265 already exists. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:43:26.217280 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-685d9f6d-9008-48eb-b8fb-aaa21b819e81 tempest-AggregatesAdminNegativeTestJSON-664564698 tempest-AggregatesAdminNegativeTestJSON-664564698-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates" status: 409 len: 111 microversion: 2.1 time: 0.031218 Oct 04 21:43:26.218489 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 49/98] 10.222.0.43 () {60 vars in 1164 bytes} [Tue Oct 4 21:43:26 2022] POST /compute/v2.1/os-aggregates => generated 111 bytes in 33 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 21:43:26.224000 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-ef8db35c-36f7-4969-82d5-2a3d102d75c5 tempest-FlavorsAdminTestJSON-34401135 tempest-FlavorsAdminTestJSON-34401135-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1299893637", "id": 1730476908, "os-flavor-access:is_public": "True"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:43:26.249193 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-ef8db35c-36f7-4969-82d5-2a3d102d75c5 tempest-FlavorsAdminTestJSON-34401135 tempest-FlavorsAdminTestJSON-34401135-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.029414 Oct 04 21:43:26.249831 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 50/99] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 21:43:26 2022] POST /compute/v2.1/flavors => generated 414 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:43:26.262960 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-c78bb720-4562-4431-9afa-587e528940f7 tempest-HypervisorAdminTestJSON-71091012 tempest-HypervisorAdminTestJSON-71091012-project-admin] Calling method '.version_select at 0x7fbb2fc549d0>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:26.265211 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c78bb720-4562-4431-9afa-587e528940f7 tempest-HypervisorAdminTestJSON-71091012 tempest-HypervisorAdminTestJSON-71091012-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:26.265887 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c78bb720-4562-4431-9afa-587e528940f7 tempest-HypervisorAdminTestJSON-71091012 tempest-HypervisorAdminTestJSON-71091012-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:26.266683 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c78bb720-4562-4431-9afa-587e528940f7 tempest-HypervisorAdminTestJSON-71091012 tempest-HypervisorAdminTestJSON-71091012-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:26.282128 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c78bb720-4562-4431-9afa-587e528940f7 tempest-HypervisorAdminTestJSON-71091012 tempest-HypervisorAdminTestJSON-71091012-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:26.282733 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c78bb720-4562-4431-9afa-587e528940f7 tempest-HypervisorAdminTestJSON-71091012 tempest-HypervisorAdminTestJSON-71091012-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:26.283236 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c78bb720-4562-4431-9afa-587e528940f7 tempest-HypervisorAdminTestJSON-71091012 tempest-HypervisorAdminTestJSON-71091012-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:26.295370 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c78bb720-4562-4431-9afa-587e528940f7 tempest-HypervisorAdminTestJSON-71091012 tempest-HypervisorAdminTestJSON-71091012-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:26.296131 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c78bb720-4562-4431-9afa-587e528940f7 tempest-HypervisorAdminTestJSON-71091012 tempest-HypervisorAdminTestJSON-71091012-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:26.296718 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c78bb720-4562-4431-9afa-587e528940f7 tempest-HypervisorAdminTestJSON-71091012 tempest-HypervisorAdminTestJSON-71091012-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:26.305172 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-c78bb720-4562-4431-9afa-587e528940f7 tempest-HypervisorAdminTestJSON-71091012 tempest-HypervisorAdminTestJSON-71091012-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.046683 Oct 04 21:43:26.311836 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 51/100] 10.222.0.43 () {58 vars in 1146 bytes} [Tue Oct 4 21:43:26 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:43:26.312651 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-58375e14-12a2-4033-8bf8-6ae012918ad2 tempest-HostsAdminNegativeTestJSON-2060517711 tempest-HostsAdminNegativeTestJSON-2060517711-project-admin] Action: 'update', calling method: .version_select at 0x7fbb2fc54dc0>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:43:26.318905 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-58375e14-12a2-4033-8bf8-6ae012918ad2 tempest-HostsAdminNegativeTestJSON-2060517711 tempest-HostsAdminNegativeTestJSON-2060517711-project-admin] Request method failure captured: Oct 04 21:43:26.318905 n-d-860284-1 devstack@n-api.service[134101]: request: PUT /compute/v2.1/os-hosts/n-d-860284-1 HTTP/1.1 Oct 04 21:43:26.318905 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 21:43:26.318905 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 21:43:26.318905 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 21:43:26.318905 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 51 Oct 04 21:43:26.318905 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 21:43:26.318905 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 21:43:26.318905 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 21:43:26.318905 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 21:43:26.318905 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPKj78qONQOLSNQ0NBfuhAJxekqrxhbrtH1gAMa4W8HRIS0Ozxlj3mOGiRVfJPIsC8Fh5Cs2-u9I9kNJiX54tPlwFzilmKyugZs06FZ6mKYxqjm0VbeGV6oPo_TVtw2AHx5jUxPQuh3EqdMdgnzLXZD7OpZfHofpqt6wvHLnmtea19RY Oct 04 21:43:26.318905 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 21:43:26.318905 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 21:43:26.318905 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 21:43:26.318905 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 21:43:26.318905 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 21:43:26.318905 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 21:43:26.318905 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: 3ae3708b2488499db0002973c0108ddb Oct 04 21:43:26.318905 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2060517711 Oct 04 21:43:26.318905 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,admin,member Oct 04 21:43:26.318905 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,admin,member Oct 04 21:43:26.320099 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/3ae3708b2488499db0002973c0108ddb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_3ae3708b2488499db0002973c0108ddb", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/3ae3708b2488499db0002973c0108ddb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/3ae3708b2488499db0002973c0108ddb"}]}] Oct 04 21:43:26.320099 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2060517711 Oct 04 21:43:26.320099 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: 3ae3708b2488499db0002973c0108ddb Oct 04 21:43:26.320099 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2060517711 Oct 04 21:43:26.320099 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-HostsAdminNegativeTestJSON-2060517711-project-admin Oct 04 21:43:26.320099 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 21:43:26.320099 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 21:43:26.320099 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 7d597b726dd74aefb7529d0a2e42df3c Oct 04 21:43:26.320099 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2060517711-project-admin Oct 04 21:43:26.320099 n-d-860284-1 devstack@n-api.service[134101]: Oct 04 21:43:26.320099 n-d-860284-1 devstack@n-api.service[134101]: {"status": "enable", "maintenance_mode": "invalid"} Oct 04 21:43:26.320099 n-d-860284-1 devstack@n-api.service[134101]: method: Oct 04 21:43:26.320099 n-d-860284-1 devstack@n-api.service[134101]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 04 21:43:26.321446 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': 'n-d-860284-1', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} Oct 04 21:43:26.321446 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:43:26.321446 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:43:26.321446 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 21:43:26.321446 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 21:43:26.321446 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 21:43:26.321446 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise error Oct 04 21:43:26.321446 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 04 21:43:26.321446 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:43:26.321446 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: Oct 04 21:43:26.321446 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 04 21:43:26.321446 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi 'disable', Oct 04 21:43:26.321446 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi 'Enable', Oct 04 21:43:26.321446 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi 'Disable', Oct 04 21:43:26.321446 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 04 21:43:26.321446 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 04 21:43:26.321446 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 04 21:43:26.321446 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:43:26.321446 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi On instance: Oct 04 21:43:26.321446 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi 'invalid' Oct 04 21:43:26.321446 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:43:26.321446 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:43:26.321446 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:43:26.321446 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:43:26.321446 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:43:26.322809 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:43:26.322809 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:43:26.322809 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:43:26.322809 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:43:26.322809 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:43:26.322809 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:43:26.322809 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:43:26.322809 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 21:43:26.322809 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 21:43:26.322809 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 21:43:26.322809 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 21:43:26.322809 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 21:43:26.322809 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 21:43:26.322809 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 04 21:43:26.322809 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:43:26.322809 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:43:26.322809 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:43:26.322809 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:43:26.322809 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:43:26.323713 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:43:26.323713 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 21:43:26.323713 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 21:43:26.323713 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 04 21:43:26.323713 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:43:26.323713 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-58375e14-12a2-4033-8bf8-6ae012918ad2 tempest-HostsAdminNegativeTestJSON-2060517711 tempest-HostsAdminNegativeTestJSON-2060517711-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:43:26.323713 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-58375e14-12a2-4033-8bf8-6ae012918ad2 tempest-HostsAdminNegativeTestJSON-2060517711 tempest-HostsAdminNegativeTestJSON-2060517711-project-admin] 10.222.0.43 "PUT /compute/v2.1/os-hosts/n-d-860284-1" status: 400 len: 199 microversion: 2.1 time: 0.012643 Oct 04 21:43:26.323713 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 52/101] 10.222.0.43 () {60 vars in 1187 bytes} [Tue Oct 4 21:43:26 2022] PUT /compute/v2.1/os-hosts/n-d-860284-1 => generated 199 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 21:43:26.328408 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-61f5bd39-e7f7-4a28-89be-313bb2e608e5 tempest-AggregatesAdminNegativeTestJSON-664564698 tempest-AggregatesAdminNegativeTestJSON-664564698-project-admin] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:26.358848 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-61f5bd39-e7f7-4a28-89be-313bb2e608e5 tempest-AggregatesAdminNegativeTestJSON-664564698 tempest-AggregatesAdminNegativeTestJSON-664564698-project-admin] 10.222.0.43 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.1 time: 0.035471 Oct 04 21:43:26.359443 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 53/102] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Oct 4 21:43:26 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 21:43:26.365552 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-b545a399-77b4-4ac1-9f9e-cc21995b7efa tempest-FlavorsAdminTestJSON-790532742 tempest-FlavorsAdminTestJSON-790532742-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:26.390342 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-b545a399-77b4-4ac1-9f9e-cc21995b7efa tempest-FlavorsAdminTestJSON-790532742 tempest-FlavorsAdminTestJSON-790532742-project] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 5395 microversion: 2.1 time: 0.029819 Oct 04 21:43:26.403582 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 54/103] 10.222.0.43 () {58 vars in 1146 bytes} [Tue Oct 4 21:43:26 2022] GET /compute/v2.1/flavors/detail => generated 5395 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:43:26.403582 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-970ea3d7-75d4-48dd-b7e8-851eaa3ecdcd tempest-HypervisorAdminTestJSON-71091012 tempest-HypervisorAdminTestJSON-71091012-project-admin] Calling method '.version_select at 0x7fbb2fcc0280>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:26.403582 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-970ea3d7-75d4-48dd-b7e8-851eaa3ecdcd tempest-HypervisorAdminTestJSON-71091012 tempest-HypervisorAdminTestJSON-71091012-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:26.403582 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-970ea3d7-75d4-48dd-b7e8-851eaa3ecdcd tempest-HypervisorAdminTestJSON-71091012 tempest-HypervisorAdminTestJSON-71091012-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:26.403965 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-970ea3d7-75d4-48dd-b7e8-851eaa3ecdcd tempest-HypervisorAdminTestJSON-71091012 tempest-HypervisorAdminTestJSON-71091012-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:26.417210 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-970ea3d7-75d4-48dd-b7e8-851eaa3ecdcd tempest-HypervisorAdminTestJSON-71091012 tempest-HypervisorAdminTestJSON-71091012-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:26.417985 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-970ea3d7-75d4-48dd-b7e8-851eaa3ecdcd tempest-HypervisorAdminTestJSON-71091012 tempest-HypervisorAdminTestJSON-71091012-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:26.419431 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-970ea3d7-75d4-48dd-b7e8-851eaa3ecdcd tempest-HypervisorAdminTestJSON-71091012 tempest-HypervisorAdminTestJSON-71091012-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:26.431401 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-970ea3d7-75d4-48dd-b7e8-851eaa3ecdcd tempest-HypervisorAdminTestJSON-71091012 tempest-HypervisorAdminTestJSON-71091012-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.038873 Oct 04 21:43:26.432278 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 55/104] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Oct 4 21:43:26 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:43:26.437699 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-3bced737-e056-47b2-b2e6-725974ad1469 tempest-HostsAdminNegativeTestJSON-2060517711 tempest-HostsAdminNegativeTestJSON-2060517711-project-admin] Action: 'update', calling method: .version_select at 0x7fbb2fc544c0>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:43:26.443873 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-3bced737-e056-47b2-b2e6-725974ad1469 tempest-HostsAdminNegativeTestJSON-2060517711 tempest-HostsAdminNegativeTestJSON-2060517711-project-admin] Request method failure captured: Oct 04 21:43:26.443873 n-d-860284-1 devstack@n-api.service[134101]: request: PUT /compute/v2.1/os-hosts/n-d-860284-1 HTTP/1.1 Oct 04 21:43:26.443873 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 21:43:26.443873 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 21:43:26.443873 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 21:43:26.443873 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 51 Oct 04 21:43:26.443873 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 21:43:26.443873 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 21:43:26.443873 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 21:43:26.443873 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 21:43:26.443873 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPKj78qONQOLSNQ0NBfuhAJxekqrxhbrtH1gAMa4W8HRIS0Ozxlj3mOGiRVfJPIsC8Fh5Cs2-u9I9kNJiX54tPlwFzilmKyugZs06FZ6mKYxqjm0VbeGV6oPo_TVtw2AHx5jUxPQuh3EqdMdgnzLXZD7OpZfHofpqt6wvHLnmtea19RY Oct 04 21:43:26.443873 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 21:43:26.443873 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 21:43:26.443873 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 21:43:26.443873 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 21:43:26.443873 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 21:43:26.443873 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 21:43:26.443873 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: 3ae3708b2488499db0002973c0108ddb Oct 04 21:43:26.443873 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2060517711 Oct 04 21:43:26.443873 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,admin,member Oct 04 21:43:26.443873 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,admin,member Oct 04 21:43:26.445004 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/3ae3708b2488499db0002973c0108ddb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_3ae3708b2488499db0002973c0108ddb", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/3ae3708b2488499db0002973c0108ddb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/3ae3708b2488499db0002973c0108ddb"}]}] Oct 04 21:43:26.445004 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2060517711 Oct 04 21:43:26.445004 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: 3ae3708b2488499db0002973c0108ddb Oct 04 21:43:26.445004 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2060517711 Oct 04 21:43:26.445004 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-HostsAdminNegativeTestJSON-2060517711-project-admin Oct 04 21:43:26.445004 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 21:43:26.445004 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 21:43:26.445004 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 7d597b726dd74aefb7529d0a2e42df3c Oct 04 21:43:26.445004 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2060517711-project-admin Oct 04 21:43:26.445004 n-d-860284-1 devstack@n-api.service[134101]: Oct 04 21:43:26.445004 n-d-860284-1 devstack@n-api.service[134101]: {"status": "invalid", "maintenance_mode": "enable"} Oct 04 21:43:26.445004 n-d-860284-1 devstack@n-api.service[134101]: method: Oct 04 21:43:26.445004 n-d-860284-1 devstack@n-api.service[134101]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 04 21:43:26.447477 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': 'n-d-860284-1', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} Oct 04 21:43:26.447477 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:43:26.447477 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:43:26.447477 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 21:43:26.447477 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 21:43:26.447477 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 21:43:26.447477 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise error Oct 04 21:43:26.447477 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 04 21:43:26.447477 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:43:26.447477 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: Oct 04 21:43:26.447477 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 04 21:43:26.447477 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi 'disable', Oct 04 21:43:26.447477 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi 'Enable', Oct 04 21:43:26.447477 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi 'Disable', Oct 04 21:43:26.447477 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 04 21:43:26.447477 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 04 21:43:26.447477 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 04 21:43:26.447477 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:43:26.447477 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi On instance: Oct 04 21:43:26.447477 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi 'invalid' Oct 04 21:43:26.447477 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:43:26.447477 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:43:26.447477 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:43:26.447477 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:43:26.447477 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:43:26.448976 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:43:26.448976 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:43:26.448976 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:43:26.448976 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:43:26.448976 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:43:26.448976 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:43:26.448976 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:43:26.448976 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 21:43:26.448976 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 21:43:26.448976 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 21:43:26.448976 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 21:43:26.448976 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 21:43:26.448976 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 21:43:26.448976 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 04 21:43:26.448976 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:43:26.448976 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:43:26.448976 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:43:26.448976 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:43:26.448976 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:43:26.450682 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:43:26.450682 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 21:43:26.450682 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 21:43:26.450682 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 04 21:43:26.450682 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:43:26.452829 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-3bced737-e056-47b2-b2e6-725974ad1469 tempest-HostsAdminNegativeTestJSON-2060517711 tempest-HostsAdminNegativeTestJSON-2060517711-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:43:26.454093 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-3bced737-e056-47b2-b2e6-725974ad1469 tempest-HostsAdminNegativeTestJSON-2060517711 tempest-HostsAdminNegativeTestJSON-2060517711-project-admin] 10.222.0.43 "PUT /compute/v2.1/os-hosts/n-d-860284-1" status: 400 len: 189 microversion: 2.1 time: 0.020501 Oct 04 21:43:26.455566 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 56/105] 10.222.0.43 () {60 vars in 1187 bytes} [Tue Oct 4 21:43:26 2022] PUT /compute/v2.1/os-hosts/n-d-860284-1 => generated 189 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 21:43:26.472177 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-1c596439-2f25-4e22-a4dd-7bc1640886de tempest-AggregatesAdminNegativeTestJSON-664564698 tempest-AggregatesAdminNegativeTestJSON-664564698-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-247273807"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:43:26.476800 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.objects.aggregate [None req-1c596439-2f25-4e22-a4dd-7bc1640886de tempest-AggregatesAdminNegativeTestJSON-664564698 tempest-AggregatesAdminNegativeTestJSON-664564698-project-admin] Generated uuid b1d70f56-5e52-4f02-975b-fe1657cc54ea for aggregate {{(pid=134101) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 21:43:26.504397 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-1c596439-2f25-4e22-a4dd-7bc1640886de tempest-AggregatesAdminNegativeTestJSON-664564698 tempest-AggregatesAdminNegativeTestJSON-664564698-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.046240 Oct 04 21:43:26.505104 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 57/106] 10.222.0.43 () {60 vars in 1164 bytes} [Tue Oct 4 21:43:26 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:43:26.516722 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-8e9a80ff-d682-4bbe-a822-309af249f124 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:26.517729 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-8e9a80ff-d682-4bbe-a822-309af249f124 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] [instance: 4c692055-b3f9-494b-9279-5a8453ed88ba] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:43:26.530450 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8e9a80ff-d682-4bbe-a822-309af249f124 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:26.531108 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8e9a80ff-d682-4bbe-a822-309af249f124 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:26.531622 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8e9a80ff-d682-4bbe-a822-309af249f124 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:26.532389 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8e9a80ff-d682-4bbe-a822-309af249f124 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:26.532895 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8e9a80ff-d682-4bbe-a822-309af249f124 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:26.533415 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8e9a80ff-d682-4bbe-a822-309af249f124 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:26.663496 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=85,nova_api:DELETE=10,nova_api:INSERT=5 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:43:26.688632 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-296c0be2-3538-45ae-aac5-83f6aa204ecf tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Flavor limits 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:43:26.689156 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-296c0be2-3538-45ae-aac5-83f6aa204ecf tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Image limits 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:43:26.689850 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-296c0be2-3538-45ae-aac5-83f6aa204ecf tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Flavor pref 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:43:26.690642 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-296c0be2-3538-45ae-aac5-83f6aa204ecf tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Image pref 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:43:26.691363 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-296c0be2-3538-45ae-aac5-83f6aa204ecf tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:43:26.713291 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-296c0be2-3538-45ae-aac5-83f6aa204ecf tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:26.714449 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-296c0be2-3538-45ae-aac5-83f6aa204ecf tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:26.714914 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-296c0be2-3538-45ae-aac5-83f6aa204ecf tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:26.715671 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-296c0be2-3538-45ae-aac5-83f6aa204ecf tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:26.716185 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-296c0be2-3538-45ae-aac5-83f6aa204ecf tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:26.716621 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-296c0be2-3538-45ae-aac5-83f6aa204ecf tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:26.724997 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-8e9a80ff-d682-4bbe-a822-309af249f124 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5387dbf4e24960809704c398fe999a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bedc0e10ab24824a40d06bb91626088', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:43:26.752655 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-8e9a80ff-d682-4bbe-a822-309af249f124 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] 10.222.0.43 "GET /compute/v2.1/servers/4c692055-b3f9-494b-9279-5a8453ed88ba" status: 200 len: 1299 microversion: 2.1 time: 0.244234 Oct 04 21:43:26.759553 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 58/107] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:43:26 2022] GET /compute/v2.1/servers/4c692055-b3f9-494b-9279-5a8453ed88ba => generated 1299 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:43:26.764786 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-4635b3a5-17d6-4ced-9a06-135075649ba0 tempest-FlavorsAdminTestJSON-34401135 tempest-FlavorsAdminTestJSON-34401135-project-admin] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:26.795852 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-296c0be2-3538-45ae-aac5-83f6aa204ecf tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Getting quotas for project f306c099ef294f6da8637a8ddcdb46d1. Resources: {'instances', 'ram', 'cores'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:43:26.800767 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-4635b3a5-17d6-4ced-9a06-135075649ba0 tempest-FlavorsAdminTestJSON-34401135 tempest-FlavorsAdminTestJSON-34401135-project-admin] 10.222.0.43 "DELETE /compute/v2.1/flavors/1730476908" status: 202 len: 0 microversion: 2.1 time: 0.039529 Oct 04 21:43:26.801917 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 59/108] 10.222.0.43 () {58 vars in 1161 bytes} [Tue Oct 4 21:43:26 2022] DELETE /compute/v2.1/flavors/1730476908 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:43:26.812344 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_api:SELECT=83,nova_api:DELETE=10,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:43:26.815031 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-4a113fc5-a835-4b20-ac27-06f7fa54dea2 tempest-HypervisorAdminTestJSON-71091012 tempest-HypervisorAdminTestJSON-71091012-project-admin] Calling method '.version_select at 0x7fbb2fbff280>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:26.819337 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4a113fc5-a835-4b20-ac27-06f7fa54dea2 tempest-HypervisorAdminTestJSON-71091012 tempest-HypervisorAdminTestJSON-71091012-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:26.822224 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-296c0be2-3538-45ae-aac5-83f6aa204ecf tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Getting quotas for user e00999a6faf349eea3be7680a855e8d8 and project f306c099ef294f6da8637a8ddcdb46d1. Resources: {'instances', 'ram', 'cores'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:43:26.822914 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4a113fc5-a835-4b20-ac27-06f7fa54dea2 tempest-HypervisorAdminTestJSON-71091012 tempest-HypervisorAdminTestJSON-71091012-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:26.823462 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4a113fc5-a835-4b20-ac27-06f7fa54dea2 tempest-HypervisorAdminTestJSON-71091012 tempest-HypervisorAdminTestJSON-71091012-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:26.847274 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4a113fc5-a835-4b20-ac27-06f7fa54dea2 tempest-HypervisorAdminTestJSON-71091012 tempest-HypervisorAdminTestJSON-71091012-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:26.847842 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4a113fc5-a835-4b20-ac27-06f7fa54dea2 tempest-HypervisorAdminTestJSON-71091012 tempest-HypervisorAdminTestJSON-71091012-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:26.848291 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4a113fc5-a835-4b20-ac27-06f7fa54dea2 tempest-HypervisorAdminTestJSON-71091012 tempest-HypervisorAdminTestJSON-71091012-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:26.855836 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-4a113fc5-a835-4b20-ac27-06f7fa54dea2 tempest-HypervisorAdminTestJSON-71091012 tempest-HypervisorAdminTestJSON-71091012-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 757 microversion: 2.1 time: 0.049232 Oct 04 21:43:26.857026 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 60/109] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Oct 4 21:43:26 2022] GET /compute/v2.1/os-hypervisors/2 => generated 757 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:43:26.857594 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-296c0be2-3538-45ae-aac5-83f6aa204ecf tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Going to run 1 instances... {{(pid=134102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:43:26.861386 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-296c0be2-3538-45ae-aac5-83f6aa204ecf tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] [instance: 4ca5960d-4a64-4a04-a849-d53180a038e9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='58548514-5dac-426c-81f5-19e3fba33e23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:43:26.861940 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-91294fca-7460-497e-aa4b-f7a4d662c5dd tempest-HostsAdminNegativeTestJSON-220876180 tempest-HostsAdminNegativeTestJSON-220876180-project] Action: 'update', calling method: .version_select at 0x7fbb2fb759d0>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:43:26.866074 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-91294fca-7460-497e-aa4b-f7a4d662c5dd tempest-HostsAdminNegativeTestJSON-220876180 tempest-HostsAdminNegativeTestJSON-220876180-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': '481183bc2cc644158d242f862991213e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4e83b646f71428993a0dcbb37e4cd2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:43:26.868363 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-91294fca-7460-497e-aa4b-f7a4d662c5dd tempest-HostsAdminNegativeTestJSON-220876180 tempest-HostsAdminNegativeTestJSON-220876180-project] Request method failure captured: Oct 04 21:43:26.868363 n-d-860284-1 devstack@n-api.service[134101]: request: PUT /compute/v2.1/os-hosts/n-d-860284-1 HTTP/1.1 Oct 04 21:43:26.868363 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 21:43:26.868363 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 21:43:26.868363 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 21:43:26.868363 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 50 Oct 04 21:43:26.868363 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 21:43:26.868363 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 21:43:26.868363 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 21:43:26.868363 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 21:43:26.868363 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPKj5xZA4dJRi0ZZNAYy-XXItpdUjnJ_NAow5vIAzgiQmRWgfJMP00IuY8o7lRZwJp9-SyGKznmCSui0kmEC_iHooj1t5bH9knGtsg-NOfRE272PYP-lVs2g4XADoeUKq8QyTm3HvxMKS71tZgHsNM1A3Akh5w89bBLxJNm7FCxtpGLk Oct 04 21:43:26.868363 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 21:43:26.868363 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 21:43:26.868363 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 21:43:26.868363 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 21:43:26.868363 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 21:43:26.868363 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 21:43:26.868363 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: d4e83b646f71428993a0dcbb37e4cd2d Oct 04 21:43:26.868363 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-220876180 Oct 04 21:43:26.868363 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 21:43:26.868363 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 21:43:26.869454 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d4e83b646f71428993a0dcbb37e4cd2d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_d4e83b646f71428993a0dcbb37e4cd2d", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d4e83b646f71428993a0dcbb37e4cd2d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/d4e83b646f71428993a0dcbb37e4cd2d"}]}] Oct 04 21:43:26.869454 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-HostsAdminNegativeTestJSON-220876180 Oct 04 21:43:26.869454 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: d4e83b646f71428993a0dcbb37e4cd2d Oct 04 21:43:26.869454 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-220876180 Oct 04 21:43:26.869454 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-HostsAdminNegativeTestJSON-220876180-project Oct 04 21:43:26.869454 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 21:43:26.869454 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 21:43:26.869454 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 481183bc2cc644158d242f862991213e Oct 04 21:43:26.869454 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-HostsAdminNegativeTestJSON-220876180-project Oct 04 21:43:26.869454 n-d-860284-1 devstack@n-api.service[134101]: Oct 04 21:43:26.869454 n-d-860284-1 devstack@n-api.service[134101]: {"status": "enable", "maintenance_mode": "enable"} Oct 04 21:43:26.869454 n-d-860284-1 devstack@n-api.service[134101]: method: Oct 04 21:43:26.869454 n-d-860284-1 devstack@n-api.service[134101]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 04 21:43:26.869454 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': 'n-d-860284-1', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Oct 04 21:43:26.870242 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:43:26.870242 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:43:26.870242 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:43:26.870242 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:43:26.870242 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:43:26.870242 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:43:26.870242 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:43:26.870242 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:43:26.870242 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:43:26.870242 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:43:26.870242 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:43:26.870242 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:43:26.870242 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update Oct 04 21:43:26.870242 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', Oct 04 21:43:26.870242 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 21:43:26.870242 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 21:43:26.870242 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 21:43:26.870242 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 21:43:26.870242 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 21:43:26.870242 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 21:43:26.871340 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 21:43:26.871340 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 21:43:26.871340 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 21:43:26.871340 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 21:43:26.871340 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 21:43:26.871340 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 21:43:26.871340 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 21:43:26.871340 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 21:43:26.871340 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 04 21:43:26.871340 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:43:26.871340 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:43:26.871340 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:43:26.871340 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:43:26.871340 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:43:26.871340 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:43:26.871340 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 21:43:26.871340 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 21:43:26.871340 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 04 21:43:26.871340 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:43:26.873486 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-91294fca-7460-497e-aa4b-f7a4d662c5dd tempest-HostsAdminNegativeTestJSON-220876180 tempest-HostsAdminNegativeTestJSON-220876180-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:43:26.874781 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-91294fca-7460-497e-aa4b-f7a4d662c5dd tempest-HostsAdminNegativeTestJSON-220876180 tempest-HostsAdminNegativeTestJSON-220876180-project] 10.222.0.43 "PUT /compute/v2.1/os-hosts/n-d-860284-1" status: 403 len: 111 microversion: 2.1 time: 0.016404 Oct 04 21:43:26.879952 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 61/110] 10.222.0.43 () {60 vars in 1187 bytes} [Tue Oct 4 21:43:26 2022] PUT /compute/v2.1/os-hosts/n-d-860284-1 => generated 111 bytes in 18 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:43:26.887379 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-a84996db-c2e6-4f1d-acb5-2116fca29420 tempest-AggregatesAdminNegativeTestJSON-924415762 tempest-AggregatesAdminNegativeTestJSON-924415762-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:26.889714 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-a84996db-c2e6-4f1d-acb5-2116fca29420 tempest-AggregatesAdminNegativeTestJSON-924415762 tempest-AggregatesAdminNegativeTestJSON-924415762-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': 'fcfba6078cc8420d913383e2082a22ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa8ecde157b463193ea9635b15ad255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:43:26.892483 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-a84996db-c2e6-4f1d-acb5-2116fca29420 tempest-AggregatesAdminNegativeTestJSON-924415762 tempest-AggregatesAdminNegativeTestJSON-924415762-project] Request method failure captured: Oct 04 21:43:26.892483 n-d-860284-1 devstack@n-api.service[134101]: request: DELETE /compute/v2.1/os-aggregates/7 HTTP/1.1 Oct 04 21:43:26.892483 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 21:43:26.892483 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 21:43:26.892483 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 21:43:26.892483 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 21:43:26.892483 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 21:43:26.892483 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 21:43:26.892483 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 21:43:26.892483 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 21:43:26.892483 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPKj0sUoAZZb3Xj012WEWWEcxezFEjoqwdwb2wWQa2zcKJIMCHkH7iRzGhMkrAZ42RHW09PCKNhQ2Uj1QZhXAgjIj4fLq3sXTvQwjQcQezstrjEp16MwU8GSGOH7mhj6mUlcCbKJ073k0NTJyIY37zKtkuywjWPZ3g5u9E6-X6lD2zEs Oct 04 21:43:26.892483 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 21:43:26.892483 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 21:43:26.892483 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 21:43:26.892483 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 21:43:26.892483 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 21:43:26.892483 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 21:43:26.892483 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: 1aa8ecde157b463193ea9635b15ad255 Oct 04 21:43:26.892483 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-924415762 Oct 04 21:43:26.892483 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 21:43:26.892483 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 21:43:26.893582 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1aa8ecde157b463193ea9635b15ad255"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_1aa8ecde157b463193ea9635b15ad255", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1aa8ecde157b463193ea9635b15ad255"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/1aa8ecde157b463193ea9635b15ad255"}]}] Oct 04 21:43:26.893582 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-924415762 Oct 04 21:43:26.893582 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: 1aa8ecde157b463193ea9635b15ad255 Oct 04 21:43:26.893582 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-924415762 Oct 04 21:43:26.893582 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-AggregatesAdminNegativeTestJSON-924415762-project Oct 04 21:43:26.893582 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 21:43:26.893582 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 21:43:26.893582 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: fcfba6078cc8420d913383e2082a22ac Oct 04 21:43:26.893582 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-924415762-project Oct 04 21:43:26.893582 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 21:43:26.893582 n-d-860284-1 devstack@n-api.service[134101]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 04 21:43:26.893582 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': '7'} Oct 04 21:43:26.894455 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:43:26.894455 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:43:26.894455 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:43:26.894455 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:43:26.894455 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:43:26.894455 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:43:26.894455 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:43:26.894455 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:43:26.894455 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete Oct 04 21:43:26.894455 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) Oct 04 21:43:26.894455 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 21:43:26.894455 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 21:43:26.894455 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 21:43:26.894455 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 21:43:26.894455 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 21:43:26.894455 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 21:43:26.894455 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 21:43:26.894455 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 21:43:26.894455 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 21:43:26.895465 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 21:43:26.895465 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 21:43:26.895465 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 21:43:26.895465 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 21:43:26.895465 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 21:43:26.895465 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 04 21:43:26.895465 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:43:26.895465 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:43:26.895465 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:43:26.895465 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:43:26.895465 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:43:26.895465 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:43:26.895465 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 21:43:26.895465 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 21:43:26.895465 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 04 21:43:26.895465 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:43:26.897611 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-a84996db-c2e6-4f1d-acb5-2116fca29420 tempest-AggregatesAdminNegativeTestJSON-924415762 tempest-AggregatesAdminNegativeTestJSON-924415762-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:43:26.899993 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-a84996db-c2e6-4f1d-acb5-2116fca29420 tempest-AggregatesAdminNegativeTestJSON-924415762 tempest-AggregatesAdminNegativeTestJSON-924415762-project] 10.222.0.43 "DELETE /compute/v2.1/os-aggregates/7" status: 403 len: 116 microversion: 2.1 time: 0.017096 Oct 04 21:43:26.901195 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 62/111] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Oct 4 21:43:26 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 116 bytes in 20 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:43:26.906180 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-cdd9545d-4989-4939-a038-d1736bec277c tempest-FlavorsAdminTestJSON-34401135 tempest-FlavorsAdminTestJSON-34401135-project-admin] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:26.930066 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-cdd9545d-4989-4939-a038-d1736bec277c tempest-FlavorsAdminTestJSON-34401135 tempest-FlavorsAdminTestJSON-34401135-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.027381 Oct 04 21:43:26.936947 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-296c0be2-3538-45ae-aac5-83f6aa204ecf tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.508130 Oct 04 21:43:26.938250 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 50/112] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 21:43:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 1510 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:43:26.943103 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 63/113] 10.222.0.43 () {58 vars in 1146 bytes} [Tue Oct 4 21:43:26 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:43:26.948728 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-fb2f7714-0de0-4ede-b875-1b6b14faa1ea tempest-HypervisorAdminTestJSON-71091012 tempest-HypervisorAdminTestJSON-71091012-project-admin] Calling method '.version_select at 0x7fbb2ff53a60>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:26.950845 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-12fcaed4-7aa1-471b-9f8d-6b57b5e101bb tempest-HostsAdminNegativeTestJSON-2060517711 tempest-HostsAdminNegativeTestJSON-2060517711-project-admin] Action: 'update', calling method: .version_select at 0x7fbb2fbff310>, body: {"status": null, "maintenance_mode": null} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:43:26.951363 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fb2f7714-0de0-4ede-b875-1b6b14faa1ea tempest-HypervisorAdminTestJSON-71091012 tempest-HypervisorAdminTestJSON-71091012-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:26.952032 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fb2f7714-0de0-4ede-b875-1b6b14faa1ea tempest-HypervisorAdminTestJSON-71091012 tempest-HypervisorAdminTestJSON-71091012-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:26.953027 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fb2f7714-0de0-4ede-b875-1b6b14faa1ea tempest-HypervisorAdminTestJSON-71091012 tempest-HypervisorAdminTestJSON-71091012-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:26.954625 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-12fcaed4-7aa1-471b-9f8d-6b57b5e101bb tempest-HostsAdminNegativeTestJSON-2060517711 tempest-HostsAdminNegativeTestJSON-2060517711-project-admin] Request method failure captured: Oct 04 21:43:26.954625 n-d-860284-1 devstack@n-api.service[134101]: request: PUT /compute/v2.1/os-hosts/n-d-860284-1 HTTP/1.1 Oct 04 21:43:26.954625 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 21:43:26.954625 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 21:43:26.954625 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 21:43:26.954625 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 42 Oct 04 21:43:26.954625 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 21:43:26.954625 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 21:43:26.954625 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 21:43:26.954625 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 21:43:26.954625 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPKj78qONQOLSNQ0NBfuhAJxekqrxhbrtH1gAMa4W8HRIS0Ozxlj3mOGiRVfJPIsC8Fh5Cs2-u9I9kNJiX54tPlwFzilmKyugZs06FZ6mKYxqjm0VbeGV6oPo_TVtw2AHx5jUxPQuh3EqdMdgnzLXZD7OpZfHofpqt6wvHLnmtea19RY Oct 04 21:43:26.954625 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 21:43:26.954625 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 21:43:26.954625 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 21:43:26.954625 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 21:43:26.954625 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 21:43:26.954625 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 21:43:26.954625 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: 3ae3708b2488499db0002973c0108ddb Oct 04 21:43:26.954625 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2060517711 Oct 04 21:43:26.954625 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,admin,member Oct 04 21:43:26.954625 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,admin,member Oct 04 21:43:26.955716 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/3ae3708b2488499db0002973c0108ddb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_3ae3708b2488499db0002973c0108ddb", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/3ae3708b2488499db0002973c0108ddb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/3ae3708b2488499db0002973c0108ddb"}]}] Oct 04 21:43:26.955716 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2060517711 Oct 04 21:43:26.955716 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: 3ae3708b2488499db0002973c0108ddb Oct 04 21:43:26.955716 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2060517711 Oct 04 21:43:26.955716 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-HostsAdminNegativeTestJSON-2060517711-project-admin Oct 04 21:43:26.955716 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 21:43:26.955716 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 21:43:26.955716 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 7d597b726dd74aefb7529d0a2e42df3c Oct 04 21:43:26.955716 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2060517711-project-admin Oct 04 21:43:26.955716 n-d-860284-1 devstack@n-api.service[134101]: Oct 04 21:43:26.955716 n-d-860284-1 devstack@n-api.service[134101]: {"status": null, "maintenance_mode": null} Oct 04 21:43:26.955716 n-d-860284-1 devstack@n-api.service[134101]: method: Oct 04 21:43:26.955716 n-d-860284-1 devstack@n-api.service[134101]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 04 21:43:26.955716 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': 'n-d-860284-1', 'body': {'status': None, 'maintenance_mode': None}} Oct 04 21:43:26.956397 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:43:26.956397 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:43:26.956397 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 21:43:26.956397 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 21:43:26.956397 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 21:43:26.956397 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise error Oct 04 21:43:26.956397 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' Oct 04 21:43:26.956397 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:43:26.956397 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: Oct 04 21:43:26.956397 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 04 21:43:26.956397 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi 'disable', Oct 04 21:43:26.956397 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi 'Enable', Oct 04 21:43:26.956397 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi 'Disable', Oct 04 21:43:26.956397 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 04 21:43:26.956397 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 04 21:43:26.956397 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 04 21:43:26.956397 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:43:26.956397 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi On instance: Oct 04 21:43:26.956397 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi None Oct 04 21:43:26.956397 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:43:26.956397 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:43:26.956397 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:43:26.956397 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:43:26.956397 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:43:26.956397 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:43:26.957591 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:43:26.957591 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:43:26.957591 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:43:26.957591 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:43:26.957591 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:43:26.957591 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:43:26.957591 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 21:43:26.957591 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 21:43:26.957591 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 21:43:26.957591 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 21:43:26.957591 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 21:43:26.957591 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 21:43:26.957591 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 04 21:43:26.957591 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:43:26.957591 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:43:26.957591 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:43:26.957591 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:43:26.957591 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:43:26.957591 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:43:26.958497 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 21:43:26.958497 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 21:43:26.958497 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 04 21:43:26.958497 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:43:26.958497 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-12fcaed4-7aa1-471b-9f8d-6b57b5e101bb tempest-HostsAdminNegativeTestJSON-2060517711 tempest-HostsAdminNegativeTestJSON-2060517711-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:43:26.958497 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-12fcaed4-7aa1-471b-9f8d-6b57b5e101bb tempest-HostsAdminNegativeTestJSON-2060517711 tempest-HostsAdminNegativeTestJSON-2060517711-project-admin] 10.222.0.43 "PUT /compute/v2.1/os-hosts/n-d-860284-1" status: 400 len: 127 microversion: 2.1 time: 0.011636 Oct 04 21:43:26.961129 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 64/114] 10.222.0.43 () {60 vars in 1187 bytes} [Tue Oct 4 21:43:26 2022] PUT /compute/v2.1/os-hosts/n-d-860284-1 => generated 127 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 21:43:26.967830 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-38bd9919-6607-46b6-8513-e64ca487be27 tempest-AggregatesAdminNegativeTestJSON-664564698 tempest-AggregatesAdminNegativeTestJSON-664564698-project-admin] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:26.985018 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fb2f7714-0de0-4ede-b875-1b6b14faa1ea tempest-HypervisorAdminTestJSON-71091012 tempest-HypervisorAdminTestJSON-71091012-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:26.985603 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fb2f7714-0de0-4ede-b875-1b6b14faa1ea tempest-HypervisorAdminTestJSON-71091012 tempest-HypervisorAdminTestJSON-71091012-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:26.986043 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fb2f7714-0de0-4ede-b875-1b6b14faa1ea tempest-HypervisorAdminTestJSON-71091012 tempest-HypervisorAdminTestJSON-71091012-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:27.005030 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-38bd9919-6607-46b6-8513-e64ca487be27 tempest-AggregatesAdminNegativeTestJSON-664564698 tempest-AggregatesAdminNegativeTestJSON-664564698-project-admin] 10.222.0.43 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.042471 Oct 04 21:43:27.005234 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fb2f7714-0de0-4ede-b875-1b6b14faa1ea tempest-HypervisorAdminTestJSON-71091012 tempest-HypervisorAdminTestJSON-71091012-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:27.005586 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fb2f7714-0de0-4ede-b875-1b6b14faa1ea tempest-HypervisorAdminTestJSON-71091012 tempest-HypervisorAdminTestJSON-71091012-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:27.006074 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fb2f7714-0de0-4ede-b875-1b6b14faa1ea tempest-HypervisorAdminTestJSON-71091012 tempest-HypervisorAdminTestJSON-71091012-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:27.006612 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 65/115] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Oct 4 21:43:26 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 21:43:27.013792 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-b9ccb5ec-e1a6-4a13-8cbf-3c47d20d0db3 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:27.014956 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fb2f7714-0de0-4ede-b875-1b6b14faa1ea tempest-HypervisorAdminTestJSON-71091012 tempest-HypervisorAdminTestJSON-71091012-project-admin] Acquiring lock "compute-rpcapi-router" {{(pid=134102) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 04 21:43:27.015524 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fb2f7714-0de0-4ede-b875-1b6b14faa1ea tempest-HypervisorAdminTestJSON-71091012 tempest-HypervisorAdminTestJSON-71091012-project-admin] Acquired lock "compute-rpcapi-router" {{(pid=134102) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 04 21:43:27.017089 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b534a3d0-2091-4c2e-a53d-e42235c9de93 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:27.017697 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b534a3d0-2091-4c2e-a53d-e42235c9de93 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:27.019232 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b534a3d0-2091-4c2e-a53d-e42235c9de93 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:27.020563 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b534a3d0-2091-4c2e-a53d-e42235c9de93 None None] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:27.021202 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b534a3d0-2091-4c2e-a53d-e42235c9de93 None None] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:27.021742 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b534a3d0-2091-4c2e-a53d-e42235c9de93 None None] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:27.023620 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-b9ccb5ec-e1a6-4a13-8cbf-3c47d20d0db3 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] [instance: 4ca5960d-4a64-4a04-a849-d53180a038e9] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:43:27.033388 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.compute.rpcapi [None req-b534a3d0-2091-4c2e-a53d-e42235c9de93 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 04 21:43:27.034731 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b534a3d0-2091-4c2e-a53d-e42235c9de93 None None] Releasing lock "compute-rpcapi-router" {{(pid=134102) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 04 21:43:27.077590 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-b534a3d0-2091-4c2e-a53d-e42235c9de93 None None] 10.222.0.43 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 175 microversion: 2.1 time: 0.137753 Oct 04 21:43:27.091681 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 51/116] 10.222.0.43 () {58 vars in 1173 bytes} [Tue Oct 4 21:43:26 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 175 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:43:27.101272 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-a0b77932-18f1-4ab5-8782-06f5964334f1 tempest-HostsAdminNegativeTestJSON-2060517711 tempest-HostsAdminNegativeTestJSON-2060517711-project-admin] Action: 'update', calling method: .version_select at 0x7fbb2feec040>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:43:27.120798 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.hosts [None req-a0b77932-18f1-4ab5-8782-06f5964334f1 tempest-HostsAdminNegativeTestJSON-2060517711 tempest-HostsAdminNegativeTestJSON-2060517711-project-admin] Enabling host nonexistent_hostname. Oct 04 21:43:27.145779 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-a0b77932-18f1-4ab5-8782-06f5964334f1 tempest-HostsAdminNegativeTestJSON-2060517711 tempest-HostsAdminNegativeTestJSON-2060517711-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 21:43:27.159822 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-a0b77932-18f1-4ab5-8782-06f5964334f1 tempest-HostsAdminNegativeTestJSON-2060517711 tempest-HostsAdminNegativeTestJSON-2060517711-project-admin] Request method failure captured: Oct 04 21:43:27.159822 n-d-860284-1 devstack@n-api.service[134102]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Oct 04 21:43:27.159822 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 21:43:27.159822 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 21:43:27.159822 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 21:43:27.159822 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 50 Oct 04 21:43:27.159822 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 21:43:27.159822 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 21:43:27.159822 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 21:43:27.159822 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 21:43:27.159822 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPKj78qONQOLSNQ0NBfuhAJxekqrxhbrtH1gAMa4W8HRIS0Ozxlj3mOGiRVfJPIsC8Fh5Cs2-u9I9kNJiX54tPlwFzilmKyugZs06FZ6mKYxqjm0VbeGV6oPo_TVtw2AHx5jUxPQuh3EqdMdgnzLXZD7OpZfHofpqt6wvHLnmtea19RY Oct 04 21:43:27.159822 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 21:43:27.159822 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 21:43:27.159822 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 21:43:27.159822 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 21:43:27.159822 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 21:43:27.159822 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 21:43:27.159822 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: 3ae3708b2488499db0002973c0108ddb Oct 04 21:43:27.159822 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2060517711 Oct 04 21:43:27.159822 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,admin,member Oct 04 21:43:27.159822 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,admin,member Oct 04 21:43:27.161190 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/3ae3708b2488499db0002973c0108ddb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_3ae3708b2488499db0002973c0108ddb", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/3ae3708b2488499db0002973c0108ddb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/3ae3708b2488499db0002973c0108ddb"}]}] Oct 04 21:43:27.161190 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2060517711 Oct 04 21:43:27.161190 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: 3ae3708b2488499db0002973c0108ddb Oct 04 21:43:27.161190 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2060517711 Oct 04 21:43:27.161190 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-HostsAdminNegativeTestJSON-2060517711-project-admin Oct 04 21:43:27.161190 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 21:43:27.161190 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 21:43:27.161190 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: 7d597b726dd74aefb7529d0a2e42df3c Oct 04 21:43:27.161190 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2060517711-project-admin Oct 04 21:43:27.161190 n-d-860284-1 devstack@n-api.service[134102]: Oct 04 21:43:27.161190 n-d-860284-1 devstack@n-api.service[134102]: {"status": "enable", "maintenance_mode": "enable"} Oct 04 21:43:27.161190 n-d-860284-1 devstack@n-api.service[134102]: method: Oct 04 21:43:27.161190 n-d-860284-1 devstack@n-api.service[134102]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 21:43:27.161190 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Oct 04 21:43:27.162197 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:43:27.162197 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:43:27.162197 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status Oct 04 21:43:27.162197 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) Oct 04 21:43:27.162197 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 21:43:27.162197 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 21:43:27.162197 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 21:43:27.162197 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 21:43:27.162197 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 21:43:27.162197 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 21:43:27.162197 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 21:43:27.162197 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 21:43:27.162197 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 04 21:43:27.162197 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 04 21:43:27.162197 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 21:43:27.162197 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 21:43:27.162197 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 04 21:43:27.162197 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 04 21:43:27.163322 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 21:43:27.163322 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 21:43:27.163322 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 04 21:43:27.163322 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 04 21:43:27.163322 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 21:43:27.163322 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:43:27.163322 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:43:27.163322 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:43:27.163322 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:43:27.163322 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:43:27.163322 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:43:27.163322 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:43:27.163322 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:43:27.163322 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:43:27.163322 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:43:27.163322 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:43:27.163322 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:43:27.163322 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:43:27.163322 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:43:27.163322 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update Oct 04 21:43:27.164470 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) Oct 04 21:43:27.164470 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status Oct 04 21:43:27.164470 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:43:27.164470 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 21:43:27.164470 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:43:27.164470 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:43:27.164470 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:43:27.164470 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:43:27.164470 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:43:27.164470 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:43:27.164470 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:43:27.164470 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:43:27.164470 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 21:43:27.164470 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:43:27.166201 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-a0b77932-18f1-4ab5-8782-06f5964334f1 tempest-HostsAdminNegativeTestJSON-2060517711 tempest-HostsAdminNegativeTestJSON-2060517711-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:43:27.167306 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-a0b77932-18f1-4ab5-8782-06f5964334f1 tempest-HostsAdminNegativeTestJSON-2060517711 tempest-HostsAdminNegativeTestJSON-2060517711-project-admin] 10.222.0.43 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.073942 Oct 04 21:43:27.168245 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 52/117] 10.222.0.43 () {60 vars in 1211 bytes} [Tue Oct 4 21:43:27 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 21:43:27.178857 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-d9437afd-8619-489a-9725-a4924ca8477f tempest-AggregatesAdminNegativeTestJSON-664564698 tempest-AggregatesAdminNegativeTestJSON-664564698-project-admin] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:27.198045 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-d9437afd-8619-489a-9725-a4924ca8477f tempest-AggregatesAdminNegativeTestJSON-664564698 tempest-AggregatesAdminNegativeTestJSON-664564698-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Oct 04 21:43:27.201251 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-d9437afd-8619-489a-9725-a4924ca8477f tempest-AggregatesAdminNegativeTestJSON-664564698 tempest-AggregatesAdminNegativeTestJSON-664564698-project-admin] Request method failure captured: Oct 04 21:43:27.201251 n-d-860284-1 devstack@n-api.service[134102]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 Oct 04 21:43:27.201251 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 21:43:27.201251 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 21:43:27.201251 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 21:43:27.201251 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 21:43:27.201251 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 21:43:27.201251 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 21:43:27.201251 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 21:43:27.201251 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 21:43:27.201251 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPKj3TqDaGoyjJhtIccfWEJxEBj6A1jebRdZTgg-sR19wHLlaDAI2bdTq6Jkp5iiCM0u9cwW4jzhwdoXvQS-WsEl_ywcz5KPWJU7yW05bsnHLpXgHw78VijaFN0Vdk0iAUt3MBmWSUCRj3gV4jO-cbkqRKTWzujvkVBPGumXvhfg-3s0 Oct 04 21:43:27.201251 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 21:43:27.201251 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 21:43:27.201251 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 21:43:27.201251 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 21:43:27.201251 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 21:43:27.201251 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 21:43:27.201251 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: d44d9375451f48269c82a6e559b24c3e Oct 04 21:43:27.201251 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-664564698 Oct 04 21:43:27.201251 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,admin,member Oct 04 21:43:27.201251 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,admin,member Oct 04 21:43:27.202409 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d44d9375451f48269c82a6e559b24c3e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_d44d9375451f48269c82a6e559b24c3e", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d44d9375451f48269c82a6e559b24c3e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/d44d9375451f48269c82a6e559b24c3e"}]}] Oct 04 21:43:27.202409 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-664564698 Oct 04 21:43:27.202409 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: d44d9375451f48269c82a6e559b24c3e Oct 04 21:43:27.202409 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-664564698 Oct 04 21:43:27.202409 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-AggregatesAdminNegativeTestJSON-664564698-project-admin Oct 04 21:43:27.202409 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 21:43:27.202409 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 21:43:27.202409 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: 9982336626444aa7b0582b5802e18c20 Oct 04 21:43:27.202409 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-664564698-project-admin Oct 04 21:43:27.202409 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 21:43:27.202409 n-d-860284-1 devstack@n-api.service[134102]: exception: Aggregate -1 could not be found. Oct 04 21:43:27.202409 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': '-1'} Oct 04 21:43:27.203112 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:43:27.203112 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:43:27.203112 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 04 21:43:27.203112 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 04 21:43:27.203112 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 21:43:27.203112 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 21:43:27.203112 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 21:43:27.203112 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 21:43:27.203112 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 21:43:27.203112 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 21:43:27.203112 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 21:43:27.203112 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 21:43:27.203112 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Oct 04 21:43:27.203112 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 04 21:43:27.203112 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 21:43:27.203112 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 21:43:27.203112 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 04 21:43:27.203112 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 04 21:43:27.203112 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 21:43:27.204539 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 21:43:27.204539 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 04 21:43:27.204539 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 04 21:43:27.204539 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Oct 04 21:43:27.204539 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:43:27.204539 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:43:27.204539 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:43:27.204539 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:43:27.204539 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:43:27.204539 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:43:27.204539 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:43:27.204539 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:43:27.204539 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:43:27.204539 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:43:27.204539 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 04 21:43:27.204539 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:43:27.204539 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Oct 04 21:43:27.204539 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:43:27.204539 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:43:27.204539 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:43:27.204539 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:43:27.207000 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:43:27.207000 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:43:27.207000 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:43:27.207000 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:43:27.207000 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Oct 04 21:43:27.207000 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:43:27.207000 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-d9437afd-8619-489a-9725-a4924ca8477f tempest-AggregatesAdminNegativeTestJSON-664564698 tempest-AggregatesAdminNegativeTestJSON-664564698-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:43:27.207000 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-d9437afd-8619-489a-9725-a4924ca8477f tempest-AggregatesAdminNegativeTestJSON-664564698 tempest-AggregatesAdminNegativeTestJSON-664564698-project-admin] 10.222.0.43 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.029370 Oct 04 21:43:27.212492 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 53/118] 10.222.0.43 () {58 vars in 1155 bytes} [Tue Oct 4 21:43:27 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 21:43:27.222318 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-d16600b3-0a6c-413f-aa65-58dd96d1a9f7 tempest-AggregatesAdminNegativeTestJSON-664564698 tempest-AggregatesAdminNegativeTestJSON-664564698-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-836401423"}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:43:27.237762 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.objects.aggregate [None req-d16600b3-0a6c-413f-aa65-58dd96d1a9f7 tempest-AggregatesAdminNegativeTestJSON-664564698 tempest-AggregatesAdminNegativeTestJSON-664564698-project-admin] Generated uuid 833ae94b-0265-4218-8609-d488e40ac6df for aggregate {{(pid=134102) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 21:43:27.282219 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-d16600b3-0a6c-413f-aa65-58dd96d1a9f7 tempest-AggregatesAdminNegativeTestJSON-664564698 tempest-AggregatesAdminNegativeTestJSON-664564698-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.067447 Oct 04 21:43:27.282937 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 54/119] 10.222.0.43 () {60 vars in 1164 bytes} [Tue Oct 4 21:43:27 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:43:27.298346 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-6b1862b6-4990-4320-9751-bde30fbdd425 tempest-AggregatesAdminNegativeTestJSON-924415762 tempest-AggregatesAdminNegativeTestJSON-924415762-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:27.301296 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-6b1862b6-4990-4320-9751-bde30fbdd425 tempest-AggregatesAdminNegativeTestJSON-924415762 tempest-AggregatesAdminNegativeTestJSON-924415762-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': 'fcfba6078cc8420d913383e2082a22ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa8ecde157b463193ea9635b15ad255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:43:27.303113 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-6b1862b6-4990-4320-9751-bde30fbdd425 tempest-AggregatesAdminNegativeTestJSON-924415762 tempest-AggregatesAdminNegativeTestJSON-924415762-project] Request method failure captured: Oct 04 21:43:27.303113 n-d-860284-1 devstack@n-api.service[134102]: request: GET /compute/v2.1/os-aggregates/8 HTTP/1.1 Oct 04 21:43:27.303113 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 21:43:27.303113 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 21:43:27.303113 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 21:43:27.303113 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 21:43:27.303113 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 21:43:27.303113 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 21:43:27.303113 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 21:43:27.303113 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 21:43:27.303113 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPKj0sUoAZZb3Xj012WEWWEcxezFEjoqwdwb2wWQa2zcKJIMCHkH7iRzGhMkrAZ42RHW09PCKNhQ2Uj1QZhXAgjIj4fLq3sXTvQwjQcQezstrjEp16MwU8GSGOH7mhj6mUlcCbKJ073k0NTJyIY37zKtkuywjWPZ3g5u9E6-X6lD2zEs Oct 04 21:43:27.303113 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 21:43:27.303113 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 21:43:27.303113 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 21:43:27.303113 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 21:43:27.303113 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 21:43:27.303113 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 21:43:27.303113 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: 1aa8ecde157b463193ea9635b15ad255 Oct 04 21:43:27.303113 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-924415762 Oct 04 21:43:27.303113 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 21:43:27.303113 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 21:43:27.304274 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1aa8ecde157b463193ea9635b15ad255"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_1aa8ecde157b463193ea9635b15ad255", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1aa8ecde157b463193ea9635b15ad255"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/1aa8ecde157b463193ea9635b15ad255"}]}] Oct 04 21:43:27.304274 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-924415762 Oct 04 21:43:27.304274 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: 1aa8ecde157b463193ea9635b15ad255 Oct 04 21:43:27.304274 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-924415762 Oct 04 21:43:27.304274 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-AggregatesAdminNegativeTestJSON-924415762-project Oct 04 21:43:27.304274 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 21:43:27.304274 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 21:43:27.304274 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: fcfba6078cc8420d913383e2082a22ac Oct 04 21:43:27.304274 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-924415762-project Oct 04 21:43:27.304274 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 21:43:27.304274 n-d-860284-1 devstack@n-api.service[134102]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 04 21:43:27.304274 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': '8'} Oct 04 21:43:27.304947 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:43:27.304947 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:43:27.304947 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:43:27.304947 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:43:27.304947 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:43:27.304947 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:43:27.304947 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:43:27.304947 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:43:27.304947 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show Oct 04 21:43:27.304947 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) Oct 04 21:43:27.304947 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 21:43:27.304947 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 21:43:27.304947 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 21:43:27.304947 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 21:43:27.304947 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 21:43:27.304947 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 21:43:27.304947 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 21:43:27.304947 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 21:43:27.304947 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 21:43:27.308136 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 21:43:27.308136 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 21:43:27.308136 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 21:43:27.308136 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 21:43:27.308136 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 21:43:27.308136 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 04 21:43:27.308136 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:43:27.308136 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:43:27.308136 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:43:27.308136 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:43:27.308136 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:43:27.308136 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:43:27.308136 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 21:43:27.308136 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 21:43:27.308136 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 04 21:43:27.308136 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:43:27.308136 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-6b1862b6-4990-4320-9751-bde30fbdd425 tempest-AggregatesAdminNegativeTestJSON-924415762 tempest-AggregatesAdminNegativeTestJSON-924415762-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:43:27.309296 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-6b1862b6-4990-4320-9751-bde30fbdd425 tempest-AggregatesAdminNegativeTestJSON-924415762 tempest-AggregatesAdminNegativeTestJSON-924415762-project] 10.222.0.43 "GET /compute/v2.1/os-aggregates/8" status: 403 len: 114 microversion: 2.1 time: 0.012080 Oct 04 21:43:27.310356 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 55/120] 10.222.0.43 () {58 vars in 1149 bytes} [Tue Oct 4 21:43:27 2022] GET /compute/v2.1/os-aggregates/8 => generated 114 bytes in 18 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:43:27.316928 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-fbd2115e-3fba-49b9-814a-a86d88b3c3e6 tempest-AggregatesAdminNegativeTestJSON-664564698 tempest-AggregatesAdminNegativeTestJSON-664564698-project-admin] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:27.363189 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-fbd2115e-3fba-49b9-814a-a86d88b3c3e6 tempest-AggregatesAdminNegativeTestJSON-664564698 tempest-AggregatesAdminNegativeTestJSON-664564698-project-admin] 10.222.0.43 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.050758 Oct 04 21:43:27.370441 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 56/121] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Oct 4 21:43:27 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 21:43:27.378909 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-12bd55ac-434b-47b8-bdfc-6e709dd6532f tempest-AggregatesAdminNegativeTestJSON-664564698 tempest-AggregatesAdminNegativeTestJSON-664564698-project-admin] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:27.391997 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-12bd55ac-434b-47b8-bdfc-6e709dd6532f tempest-AggregatesAdminNegativeTestJSON-664564698 tempest-AggregatesAdminNegativeTestJSON-664564698-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Oct 04 21:43:27.394390 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-12bd55ac-434b-47b8-bdfc-6e709dd6532f tempest-AggregatesAdminNegativeTestJSON-664564698 tempest-AggregatesAdminNegativeTestJSON-664564698-project-admin] Request method failure captured: Oct 04 21:43:27.394390 n-d-860284-1 devstack@n-api.service[134102]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 Oct 04 21:43:27.394390 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 21:43:27.394390 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 21:43:27.394390 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 21:43:27.394390 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 21:43:27.394390 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 21:43:27.394390 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 21:43:27.394390 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 21:43:27.394390 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 21:43:27.394390 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPKj3TqDaGoyjJhtIccfWEJxEBj6A1jebRdZTgg-sR19wHLlaDAI2bdTq6Jkp5iiCM0u9cwW4jzhwdoXvQS-WsEl_ywcz5KPWJU7yW05bsnHLpXgHw78VijaFN0Vdk0iAUt3MBmWSUCRj3gV4jO-cbkqRKTWzujvkVBPGumXvhfg-3s0 Oct 04 21:43:27.394390 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 21:43:27.394390 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 21:43:27.394390 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 21:43:27.394390 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 21:43:27.394390 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 21:43:27.394390 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 21:43:27.394390 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: d44d9375451f48269c82a6e559b24c3e Oct 04 21:43:27.394390 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-664564698 Oct 04 21:43:27.394390 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,admin,member Oct 04 21:43:27.394390 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,admin,member Oct 04 21:43:27.395690 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d44d9375451f48269c82a6e559b24c3e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_d44d9375451f48269c82a6e559b24c3e", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d44d9375451f48269c82a6e559b24c3e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/d44d9375451f48269c82a6e559b24c3e"}]}] Oct 04 21:43:27.395690 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-664564698 Oct 04 21:43:27.395690 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: d44d9375451f48269c82a6e559b24c3e Oct 04 21:43:27.395690 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-664564698 Oct 04 21:43:27.395690 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-AggregatesAdminNegativeTestJSON-664564698-project-admin Oct 04 21:43:27.395690 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 21:43:27.395690 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 21:43:27.395690 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: 9982336626444aa7b0582b5802e18c20 Oct 04 21:43:27.395690 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-664564698-project-admin Oct 04 21:43:27.395690 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 21:43:27.395690 n-d-860284-1 devstack@n-api.service[134102]: exception: Aggregate -1 could not be found. Oct 04 21:43:27.395690 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': '-1'} Oct 04 21:43:27.396466 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:43:27.396466 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:43:27.396466 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 04 21:43:27.396466 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 04 21:43:27.396466 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Oct 04 21:43:27.396466 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 04 21:43:27.396466 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 21:43:27.396466 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 21:43:27.396466 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 04 21:43:27.396466 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 04 21:43:27.396466 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 21:43:27.396466 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 21:43:27.396466 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 04 21:43:27.396466 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 04 21:43:27.396466 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Oct 04 21:43:27.396466 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:43:27.396466 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:43:27.396466 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:43:27.396466 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:43:27.396466 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:43:27.397512 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:43:27.397512 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:43:27.397512 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:43:27.397512 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:43:27.397512 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:43:27.397512 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 04 21:43:27.397512 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:43:27.397512 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Oct 04 21:43:27.397512 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:43:27.397512 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:43:27.397512 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:43:27.397512 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:43:27.397512 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:43:27.397512 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:43:27.397512 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:43:27.397512 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:43:27.397512 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Oct 04 21:43:27.397512 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:43:27.400809 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-12bd55ac-434b-47b8-bdfc-6e709dd6532f tempest-AggregatesAdminNegativeTestJSON-664564698 tempest-AggregatesAdminNegativeTestJSON-664564698-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:43:27.402492 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-12bd55ac-434b-47b8-bdfc-6e709dd6532f tempest-AggregatesAdminNegativeTestJSON-664564698 tempest-AggregatesAdminNegativeTestJSON-664564698-project-admin] 10.222.0.43 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.030278 Oct 04 21:43:27.410978 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 57/122] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Oct 4 21:43:27 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 21:43:27.419375 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-61964d38-3524-45b6-9864-35bead527cd4 tempest-AggregatesAdminNegativeTestJSON-924415762 tempest-AggregatesAdminNegativeTestJSON-924415762-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:27.422713 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-61964d38-3524-45b6-9864-35bead527cd4 tempest-AggregatesAdminNegativeTestJSON-924415762 tempest-AggregatesAdminNegativeTestJSON-924415762-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': 'fcfba6078cc8420d913383e2082a22ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa8ecde157b463193ea9635b15ad255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:43:27.425155 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-61964d38-3524-45b6-9864-35bead527cd4 tempest-AggregatesAdminNegativeTestJSON-924415762 tempest-AggregatesAdminNegativeTestJSON-924415762-project] Request method failure captured: Oct 04 21:43:27.425155 n-d-860284-1 devstack@n-api.service[134102]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 Oct 04 21:43:27.425155 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 21:43:27.425155 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 21:43:27.425155 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 21:43:27.425155 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 21:43:27.425155 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 21:43:27.425155 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 21:43:27.425155 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 21:43:27.425155 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 21:43:27.425155 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPKj0sUoAZZb3Xj012WEWWEcxezFEjoqwdwb2wWQa2zcKJIMCHkH7iRzGhMkrAZ42RHW09PCKNhQ2Uj1QZhXAgjIj4fLq3sXTvQwjQcQezstrjEp16MwU8GSGOH7mhj6mUlcCbKJ073k0NTJyIY37zKtkuywjWPZ3g5u9E6-X6lD2zEs Oct 04 21:43:27.425155 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 21:43:27.425155 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 21:43:27.425155 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 21:43:27.425155 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 21:43:27.425155 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 21:43:27.425155 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 21:43:27.425155 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: 1aa8ecde157b463193ea9635b15ad255 Oct 04 21:43:27.425155 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-924415762 Oct 04 21:43:27.425155 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 21:43:27.425155 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 21:43:27.426858 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1aa8ecde157b463193ea9635b15ad255"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_1aa8ecde157b463193ea9635b15ad255", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1aa8ecde157b463193ea9635b15ad255"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/1aa8ecde157b463193ea9635b15ad255"}]}] Oct 04 21:43:27.426858 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-924415762 Oct 04 21:43:27.426858 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: 1aa8ecde157b463193ea9635b15ad255 Oct 04 21:43:27.426858 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-924415762 Oct 04 21:43:27.426858 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-AggregatesAdminNegativeTestJSON-924415762-project Oct 04 21:43:27.426858 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 21:43:27.426858 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 21:43:27.426858 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: fcfba6078cc8420d913383e2082a22ac Oct 04 21:43:27.426858 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-924415762-project Oct 04 21:43:27.426858 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 21:43:27.426858 n-d-860284-1 devstack@n-api.service[134102]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 04 21:43:27.426858 n-d-860284-1 devstack@n-api.service[134102]: action_args: {} Oct 04 21:43:27.427482 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:43:27.427482 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:43:27.427482 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:43:27.427482 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:43:27.427482 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:43:27.427482 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:43:27.427482 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:43:27.427482 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:43:27.427482 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index Oct 04 21:43:27.427482 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) Oct 04 21:43:27.427482 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 21:43:27.427482 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 21:43:27.427482 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 21:43:27.427482 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 21:43:27.427482 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 21:43:27.427482 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 21:43:27.427482 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 21:43:27.427482 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 21:43:27.427482 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 21:43:27.428453 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 21:43:27.428453 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 21:43:27.428453 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 21:43:27.428453 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 21:43:27.428453 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 21:43:27.428453 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 04 21:43:27.428453 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:43:27.428453 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:43:27.428453 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:43:27.428453 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:43:27.428453 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:43:27.428453 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:43:27.428453 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 21:43:27.428453 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 21:43:27.428453 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 04 21:43:27.428453 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:43:27.453405 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-61964d38-3524-45b6-9864-35bead527cd4 tempest-AggregatesAdminNegativeTestJSON-924415762 tempest-AggregatesAdminNegativeTestJSON-924415762-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:43:27.455534 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-61964d38-3524-45b6-9864-35bead527cd4 tempest-AggregatesAdminNegativeTestJSON-924415762 tempest-AggregatesAdminNegativeTestJSON-924415762-project] 10.222.0.43 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.042678 Oct 04 21:43:27.467700 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 58/123] 10.222.0.43 () {58 vars in 1143 bytes} [Tue Oct 4 21:43:27 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 56 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:43:27.503490 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-b9ccb5ec-e1a6-4a13-8cbf-3c47d20d0db3 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e00999a6faf349eea3be7680a855e8d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f306c099ef294f6da8637a8ddcdb46d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:43:27.515310 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-b9ccb5ec-e1a6-4a13-8cbf-3c47d20d0db3 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] 10.222.0.43 "GET /compute/v2.1/servers/4ca5960d-4a64-4a04-a849-d53180a038e9" status: 200 len: 1242 microversion: 2.1 time: 0.507447 Oct 04 21:43:27.517221 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 66/124] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:43:27 2022] GET /compute/v2.1/servers/4ca5960d-4a64-4a04-a849-d53180a038e9 => generated 1242 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:43:27.784571 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-79661e9e-e030-4fcf-8167-19924ba9d3b5 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:27.785078 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-79661e9e-e030-4fcf-8167-19924ba9d3b5 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] [instance: 4c692055-b3f9-494b-9279-5a8453ed88ba] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:43:27.797399 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-79661e9e-e030-4fcf-8167-19924ba9d3b5 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:27.807259 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-79661e9e-e030-4fcf-8167-19924ba9d3b5 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:27.813133 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-79661e9e-e030-4fcf-8167-19924ba9d3b5 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:27.813973 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-79661e9e-e030-4fcf-8167-19924ba9d3b5 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:27.817817 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-79661e9e-e030-4fcf-8167-19924ba9d3b5 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:27.818317 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-79661e9e-e030-4fcf-8167-19924ba9d3b5 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:28.219613 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-79661e9e-e030-4fcf-8167-19924ba9d3b5 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5387dbf4e24960809704c398fe999a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bedc0e10ab24824a40d06bb91626088', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:43:28.262602 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-79661e9e-e030-4fcf-8167-19924ba9d3b5 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] 10.222.0.43 "GET /compute/v2.1/servers/4c692055-b3f9-494b-9279-5a8453ed88ba" status: 200 len: 1299 microversion: 2.1 time: 0.482787 Oct 04 21:43:28.265991 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 59/125] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:43:27 2022] GET /compute/v2.1/servers/4c692055-b3f9-494b-9279-5a8453ed88ba => generated 1299 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:43:28.552071 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-7d65ae70-5db1-4f5d-8b74-3680b454da87 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:28.552701 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-7d65ae70-5db1-4f5d-8b74-3680b454da87 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] [instance: 4ca5960d-4a64-4a04-a849-d53180a038e9] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:43:28.724041 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-7d65ae70-5db1-4f5d-8b74-3680b454da87 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e00999a6faf349eea3be7680a855e8d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f306c099ef294f6da8637a8ddcdb46d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:43:28.736685 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-7d65ae70-5db1-4f5d-8b74-3680b454da87 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] 10.222.0.43 "GET /compute/v2.1/servers/4ca5960d-4a64-4a04-a849-d53180a038e9" status: 200 len: 1242 microversion: 2.1 time: 0.200308 Oct 04 21:43:28.740695 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 67/126] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:43:28 2022] GET /compute/v2.1/servers/4ca5960d-4a64-4a04-a849-d53180a038e9 => generated 1242 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:43:29.294213 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-5605c8fe-f308-4653-9d27-4e31edd52eb5 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:29.295977 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-5605c8fe-f308-4653-9d27-4e31edd52eb5 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] [instance: 4c692055-b3f9-494b-9279-5a8453ed88ba] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:43:29.304703 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5605c8fe-f308-4653-9d27-4e31edd52eb5 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:29.305927 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5605c8fe-f308-4653-9d27-4e31edd52eb5 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:29.306621 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5605c8fe-f308-4653-9d27-4e31edd52eb5 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:29.307649 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5605c8fe-f308-4653-9d27-4e31edd52eb5 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:29.308410 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5605c8fe-f308-4653-9d27-4e31edd52eb5 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:29.309538 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5605c8fe-f308-4653-9d27-4e31edd52eb5 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:29.769467 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-5ef32f86-d4f2-4343-bba6-ac5f0fac6250 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:29.770274 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-5ef32f86-d4f2-4343-bba6-ac5f0fac6250 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] [instance: 4ca5960d-4a64-4a04-a849-d53180a038e9] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:43:29.795953 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5ef32f86-d4f2-4343-bba6-ac5f0fac6250 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:29.800693 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5ef32f86-d4f2-4343-bba6-ac5f0fac6250 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:29.803800 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5ef32f86-d4f2-4343-bba6-ac5f0fac6250 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:29.805681 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5ef32f86-d4f2-4343-bba6-ac5f0fac6250 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:29.808911 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5ef32f86-d4f2-4343-bba6-ac5f0fac6250 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:29.821890 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5ef32f86-d4f2-4343-bba6-ac5f0fac6250 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:29.828269 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-5605c8fe-f308-4653-9d27-4e31edd52eb5 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5387dbf4e24960809704c398fe999a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bedc0e10ab24824a40d06bb91626088', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:43:29.838671 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-5605c8fe-f308-4653-9d27-4e31edd52eb5 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] 10.222.0.43 "GET /compute/v2.1/servers/4c692055-b3f9-494b-9279-5a8453ed88ba" status: 200 len: 1341 microversion: 2.1 time: 0.550092 Oct 04 21:43:29.844913 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 60/127] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:43:29 2022] GET /compute/v2.1/servers/4c692055-b3f9-494b-9279-5a8453ed88ba => generated 1341 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:43:30.028861 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-5ef32f86-d4f2-4343-bba6-ac5f0fac6250 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e00999a6faf349eea3be7680a855e8d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f306c099ef294f6da8637a8ddcdb46d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:43:30.038452 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-5ef32f86-d4f2-4343-bba6-ac5f0fac6250 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] 10.222.0.43 "GET /compute/v2.1/servers/4ca5960d-4a64-4a04-a849-d53180a038e9" status: 200 len: 1290 microversion: 2.1 time: 0.274853 Oct 04 21:43:30.057717 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 68/128] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:43:29 2022] GET /compute/v2.1/servers/4ca5960d-4a64-4a04-a849-d53180a038e9 => generated 1290 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:43:30.869583 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-b5ebe83a-17ac-4352-b71e-90e076ee2f2d tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:30.871273 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-b5ebe83a-17ac-4352-b71e-90e076ee2f2d tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] [instance: 4c692055-b3f9-494b-9279-5a8453ed88ba] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:43:30.882153 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b5ebe83a-17ac-4352-b71e-90e076ee2f2d tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:30.887405 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b5ebe83a-17ac-4352-b71e-90e076ee2f2d tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:30.888243 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b5ebe83a-17ac-4352-b71e-90e076ee2f2d tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:30.889942 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b5ebe83a-17ac-4352-b71e-90e076ee2f2d tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:30.894907 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b5ebe83a-17ac-4352-b71e-90e076ee2f2d tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:30.895737 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b5ebe83a-17ac-4352-b71e-90e076ee2f2d tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:31.240907 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-b5ebe83a-17ac-4352-b71e-90e076ee2f2d tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5387dbf4e24960809704c398fe999a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bedc0e10ab24824a40d06bb91626088', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:43:31.251501 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-b5ebe83a-17ac-4352-b71e-90e076ee2f2d tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] 10.222.0.43 "GET /compute/v2.1/servers/4c692055-b3f9-494b-9279-5a8453ed88ba" status: 200 len: 1341 microversion: 2.1 time: 0.386641 Oct 04 21:43:31.256759 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 69/129] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:43:30 2022] GET /compute/v2.1/servers/4c692055-b3f9-494b-9279-5a8453ed88ba => generated 1341 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:43:31.272672 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-0072ac54-725c-477e-af51-25552f77dced tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:31.273498 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-0072ac54-725c-477e-af51-25552f77dced tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] [instance: 4ca5960d-4a64-4a04-a849-d53180a038e9] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:43:31.283363 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0072ac54-725c-477e-af51-25552f77dced tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:31.291353 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0072ac54-725c-477e-af51-25552f77dced tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:31.294224 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0072ac54-725c-477e-af51-25552f77dced tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:31.295861 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0072ac54-725c-477e-af51-25552f77dced tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:31.297572 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0072ac54-725c-477e-af51-25552f77dced tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:31.298905 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0072ac54-725c-477e-af51-25552f77dced tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:31.454544 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-0072ac54-725c-477e-af51-25552f77dced tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e00999a6faf349eea3be7680a855e8d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f306c099ef294f6da8637a8ddcdb46d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:43:31.465308 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-0072ac54-725c-477e-af51-25552f77dced tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] 10.222.0.43 "GET /compute/v2.1/servers/4ca5960d-4a64-4a04-a849-d53180a038e9" status: 200 len: 1296 microversion: 2.1 time: 0.207186 Oct 04 21:43:31.479463 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 70/130] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:43:31 2022] GET /compute/v2.1/servers/4ca5960d-4a64-4a04-a849-d53180a038e9 => generated 1296 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:43:31.651805 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-8994bb10-55c9-4dd4-ae81-d62ba91c31e6 tempest-AZAdminV2TestJSON-1056185633 tempest-AZAdminV2TestJSON-1056185633-project-admin] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:31.661029 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8994bb10-55c9-4dd4-ae81-d62ba91c31e6 tempest-AZAdminV2TestJSON-1056185633 tempest-AZAdminV2TestJSON-1056185633-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:31.661852 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8994bb10-55c9-4dd4-ae81-d62ba91c31e6 tempest-AZAdminV2TestJSON-1056185633 tempest-AZAdminV2TestJSON-1056185633-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:31.662567 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8994bb10-55c9-4dd4-ae81-d62ba91c31e6 tempest-AZAdminV2TestJSON-1056185633 tempest-AZAdminV2TestJSON-1056185633-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:31.663530 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8994bb10-55c9-4dd4-ae81-d62ba91c31e6 tempest-AZAdminV2TestJSON-1056185633 tempest-AZAdminV2TestJSON-1056185633-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:31.664193 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8994bb10-55c9-4dd4-ae81-d62ba91c31e6 tempest-AZAdminV2TestJSON-1056185633 tempest-AZAdminV2TestJSON-1056185633-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:31.664975 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8994bb10-55c9-4dd4-ae81-d62ba91c31e6 tempest-AZAdminV2TestJSON-1056185633 tempest-AZAdminV2TestJSON-1056185633-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:31.716904 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-8994bb10-55c9-4dd4-ae81-d62ba91c31e6 tempest-AZAdminV2TestJSON-1056185633 tempest-AZAdminV2TestJSON-1056185633-project-admin] 10.222.0.43 "GET /compute/v2.1/os-availability-zone" status: 200 len: 189 microversion: 2.1 time: 1.203655 Oct 04 21:43:31.718451 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 61/131] 10.222.0.43 () {58 vars in 1164 bytes} [Tue Oct 4 21:43:30 2022] GET /compute/v2.1/os-availability-zone => generated 189 bytes in 1206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:43:31.734703 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-5cd9e7ea-54d6-4ab2-8995-3d411c36626f tempest-AZAdminV2TestJSON-1056185633 tempest-AZAdminV2TestJSON-1056185633-project-admin] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:31.737574 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5cd9e7ea-54d6-4ab2-8995-3d411c36626f tempest-AZAdminV2TestJSON-1056185633 tempest-AZAdminV2TestJSON-1056185633-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:31.738358 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5cd9e7ea-54d6-4ab2-8995-3d411c36626f tempest-AZAdminV2TestJSON-1056185633 tempest-AZAdminV2TestJSON-1056185633-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:31.739133 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5cd9e7ea-54d6-4ab2-8995-3d411c36626f tempest-AZAdminV2TestJSON-1056185633 tempest-AZAdminV2TestJSON-1056185633-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:31.739952 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5cd9e7ea-54d6-4ab2-8995-3d411c36626f tempest-AZAdminV2TestJSON-1056185633 tempest-AZAdminV2TestJSON-1056185633-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:31.740537 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5cd9e7ea-54d6-4ab2-8995-3d411c36626f tempest-AZAdminV2TestJSON-1056185633 tempest-AZAdminV2TestJSON-1056185633-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:31.741035 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5cd9e7ea-54d6-4ab2-8995-3d411c36626f tempest-AZAdminV2TestJSON-1056185633 tempest-AZAdminV2TestJSON-1056185633-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:31.770110 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-5cd9e7ea-54d6-4ab2-8995-3d411c36626f tempest-AZAdminV2TestJSON-1056185633 tempest-AZAdminV2TestJSON-1056185633-project-admin] 10.222.0.43 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 700 microversion: 2.1 time: 0.040769 Oct 04 21:43:31.771312 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 71/132] 10.222.0.43 () {58 vars in 1185 bytes} [Tue Oct 4 21:43:31 2022] GET /compute/v2.1/os-availability-zone/detail => generated 700 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:43:32.279401 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-a8efb215-2444-475f-bf89-46976fe7a4a5 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:32.280027 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-a8efb215-2444-475f-bf89-46976fe7a4a5 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] [instance: 4c692055-b3f9-494b-9279-5a8453ed88ba] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:43:32.287151 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a8efb215-2444-475f-bf89-46976fe7a4a5 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:32.288373 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a8efb215-2444-475f-bf89-46976fe7a4a5 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:32.289851 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a8efb215-2444-475f-bf89-46976fe7a4a5 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:32.290870 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a8efb215-2444-475f-bf89-46976fe7a4a5 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:32.291341 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a8efb215-2444-475f-bf89-46976fe7a4a5 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:32.291770 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a8efb215-2444-475f-bf89-46976fe7a4a5 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:32.566644 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-a8efb215-2444-475f-bf89-46976fe7a4a5 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5387dbf4e24960809704c398fe999a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bedc0e10ab24824a40d06bb91626088', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:43:32.578124 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-a8efb215-2444-475f-bf89-46976fe7a4a5 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] 10.222.0.43 "GET /compute/v2.1/servers/4c692055-b3f9-494b-9279-5a8453ed88ba" status: 200 len: 1341 microversion: 2.1 time: 0.302457 Oct 04 21:43:32.579276 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 62/133] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:43:32 2022] GET /compute/v2.1/servers/4c692055-b3f9-494b-9279-5a8453ed88ba => generated 1341 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:43:32.592422 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-7c632a29-f622-48b9-b362-d1a74c3b8825 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:32.593689 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-7c632a29-f622-48b9-b362-d1a74c3b8825 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] [instance: 4ca5960d-4a64-4a04-a849-d53180a038e9] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:43:32.600183 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7c632a29-f622-48b9-b362-d1a74c3b8825 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:32.600927 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7c632a29-f622-48b9-b362-d1a74c3b8825 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:32.601362 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7c632a29-f622-48b9-b362-d1a74c3b8825 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:32.602400 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7c632a29-f622-48b9-b362-d1a74c3b8825 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:32.603046 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7c632a29-f622-48b9-b362-d1a74c3b8825 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:32.603470 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7c632a29-f622-48b9-b362-d1a74c3b8825 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:32.710407 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-7c632a29-f622-48b9-b362-d1a74c3b8825 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e00999a6faf349eea3be7680a855e8d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f306c099ef294f6da8637a8ddcdb46d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:43:32.719282 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-7c632a29-f622-48b9-b362-d1a74c3b8825 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] 10.222.0.43 "GET /compute/v2.1/servers/4ca5960d-4a64-4a04-a849-d53180a038e9" status: 200 len: 1296 microversion: 2.1 time: 0.138513 Oct 04 21:43:32.719813 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 63/134] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:43:32 2022] GET /compute/v2.1/servers/4ca5960d-4a64-4a04-a849-d53180a038e9 => generated 1296 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:43:32.750465 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-a8c24692-5fdc-4354-ba60-29d1b4698587 tempest-QuotaClassesAdmin257Test-1840731366 tempest-QuotaClassesAdmin257Test-1840731366-project-admin] Calling method '.version_select at 0x7fbb2fac54c0>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:32.767017 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-a8c24692-5fdc-4354-ba60-29d1b4698587 tempest-QuotaClassesAdmin257Test-1840731366 tempest-QuotaClassesAdmin257Test-1840731366-project-admin] 10.222.0.43 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.350153 Oct 04 21:43:32.768489 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 72/135] 10.222.0.43 () {60 vars in 1226 bytes} [Tue Oct 4 21:43:32 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 21:43:32.787236 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-d149bdb4-8a67-4b9b-bad6-8e3389391073 tempest-QuotaClassesAdmin257Test-1840731366 tempest-QuotaClassesAdmin257Test-1840731366-project-admin] Action: 'update', calling method: .version_select at 0x7fbb2fbff310>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:43:33.139571 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-d149bdb4-8a67-4b9b-bad6-8e3389391073 tempest-QuotaClassesAdmin257Test-1840731366 tempest-QuotaClassesAdmin257Test-1840731366-project-admin] 10.222.0.43 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.361279 Oct 04 21:43:33.140927 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 73/136] 10.222.0.43 () {62 vars in 1247 bytes} [Tue Oct 4 21:43:32 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:43:33.163581 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-45571c4c-66f3-4015-8308-f57f8a73fbc8 tempest-QuotaClassesAdmin257Test-1840731366 tempest-QuotaClassesAdmin257Test-1840731366-project-admin] Calling method '.version_select at 0x7fbb2fb16430>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:33.189920 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-45571c4c-66f3-4015-8308-f57f8a73fbc8 tempest-QuotaClassesAdmin257Test-1840731366 tempest-QuotaClassesAdmin257Test-1840731366-project-admin] 10.222.0.43 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.039411 Oct 04 21:43:33.202158 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 74/137] 10.222.0.43 () {60 vars in 1226 bytes} [Tue Oct 4 21:43:33 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:43:33.211666 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-b689284a-41ba-420b-82f6-f84f9f7dbb96 tempest-QuotaClassesAdmin257Test-1840731366 tempest-QuotaClassesAdmin257Test-1840731366-project-admin] Action: 'update', calling method: .version_select at 0x7fbb2fb75790>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:43:33.227684 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-d559326e-68a5-43bd-a655-9402bf5391e7 req-cd77c121-17bb-4f79-bab3-571fece0cb0b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c692055-b3f9-494b-9279-5a8453ed88ba", "tag": "f333f58f-c707-413f-85bd-d2d8eaec8ea8"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:43:33.264410 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-d559326e-68a5-43bd-a655-9402bf5391e7 req-cd77c121-17bb-4f79-bab3-571fece0cb0b service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:33.265971 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-d559326e-68a5-43bd-a655-9402bf5391e7 req-cd77c121-17bb-4f79-bab3-571fece0cb0b service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:33.266420 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-d559326e-68a5-43bd-a655-9402bf5391e7 req-cd77c121-17bb-4f79-bab3-571fece0cb0b service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:33.319969 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-d559326e-68a5-43bd-a655-9402bf5391e7 req-cd77c121-17bb-4f79-bab3-571fece0cb0b service nova] Creating event network-changed:f333f58f-c707-413f-85bd-d2d8eaec8ea8 for instance 4c692055-b3f9-494b-9279-5a8453ed88ba on n-h1-860284-1 Oct 04 21:43:33.326795 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-d559326e-68a5-43bd-a655-9402bf5391e7 req-cd77c121-17bb-4f79-bab3-571fece0cb0b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.605082 Oct 04 21:43:33.327933 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 64/138] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:43:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:43:33.347921 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-b689284a-41ba-420b-82f6-f84f9f7dbb96 tempest-QuotaClassesAdmin257Test-1840731366 tempest-QuotaClassesAdmin257Test-1840731366-project-admin] 10.222.0.43 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.143750 Oct 04 21:43:33.353651 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 75/139] 10.222.0.43 () {62 vars in 1247 bytes} [Tue Oct 4 21:43:33 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:43:33.605168 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-1e2d5565-85ec-4950-848d-35979cb042ab tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:33.606253 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-1e2d5565-85ec-4950-848d-35979cb042ab tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] [instance: 4c692055-b3f9-494b-9279-5a8453ed88ba] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:43:33.615513 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1e2d5565-85ec-4950-848d-35979cb042ab tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:33.616693 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1e2d5565-85ec-4950-848d-35979cb042ab tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:33.617346 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1e2d5565-85ec-4950-848d-35979cb042ab tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:33.618668 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1e2d5565-85ec-4950-848d-35979cb042ab tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:33.619478 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1e2d5565-85ec-4950-848d-35979cb042ab tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:33.620091 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1e2d5565-85ec-4950-848d-35979cb042ab tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:33.753446 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-0dd0ed35-931a-4e0d-b24b-5a7ced299a66 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:33.754134 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-0dd0ed35-931a-4e0d-b24b-5a7ced299a66 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] [instance: 4ca5960d-4a64-4a04-a849-d53180a038e9] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:43:33.762935 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0dd0ed35-931a-4e0d-b24b-5a7ced299a66 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:33.764978 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0dd0ed35-931a-4e0d-b24b-5a7ced299a66 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:33.765927 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0dd0ed35-931a-4e0d-b24b-5a7ced299a66 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:33.768960 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0dd0ed35-931a-4e0d-b24b-5a7ced299a66 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:33.769787 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0dd0ed35-931a-4e0d-b24b-5a7ced299a66 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:33.771570 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0dd0ed35-931a-4e0d-b24b-5a7ced299a66 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:33.863225 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-0dd0ed35-931a-4e0d-b24b-5a7ced299a66 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e00999a6faf349eea3be7680a855e8d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f306c099ef294f6da8637a8ddcdb46d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:43:33.867167 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-1e2d5565-85ec-4950-848d-35979cb042ab tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5387dbf4e24960809704c398fe999a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bedc0e10ab24824a40d06bb91626088', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:43:33.871636 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-0dd0ed35-931a-4e0d-b24b-5a7ced299a66 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] 10.222.0.43 "GET /compute/v2.1/servers/4ca5960d-4a64-4a04-a849-d53180a038e9" status: 200 len: 1296 microversion: 2.1 time: 0.122301 Oct 04 21:43:33.873438 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 76/140] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:43:33 2022] GET /compute/v2.1/servers/4ca5960d-4a64-4a04-a849-d53180a038e9 => generated 1296 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:43:33.895138 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-1e2d5565-85ec-4950-848d-35979cb042ab tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] 10.222.0.43 "GET /compute/v2.1/servers/4c692055-b3f9-494b-9279-5a8453ed88ba" status: 200 len: 1341 microversion: 2.1 time: 0.295404 Oct 04 21:43:33.910058 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 65/141] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:43:33 2022] GET /compute/v2.1/servers/4c692055-b3f9-494b-9279-5a8453ed88ba => generated 1341 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:43:34.899436 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-aece74e2-4ad8-450b-acbb-892bb2c00bfa tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:34.900140 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-aece74e2-4ad8-450b-acbb-892bb2c00bfa tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] [instance: 4ca5960d-4a64-4a04-a849-d53180a038e9] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:43:34.907955 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-aece74e2-4ad8-450b-acbb-892bb2c00bfa tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:34.908460 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-aece74e2-4ad8-450b-acbb-892bb2c00bfa tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:34.908903 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-aece74e2-4ad8-450b-acbb-892bb2c00bfa tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:34.911067 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-aece74e2-4ad8-450b-acbb-892bb2c00bfa tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:34.913239 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-aece74e2-4ad8-450b-acbb-892bb2c00bfa tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:34.915308 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-aece74e2-4ad8-450b-acbb-892bb2c00bfa tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:34.921194 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-065382e8-7c27-4cf0-b8fb-0b0d910a5355 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:34.922616 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-065382e8-7c27-4cf0-b8fb-0b0d910a5355 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] [instance: 4c692055-b3f9-494b-9279-5a8453ed88ba] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:43:34.933223 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-065382e8-7c27-4cf0-b8fb-0b0d910a5355 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:34.933726 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-065382e8-7c27-4cf0-b8fb-0b0d910a5355 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:34.934272 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-065382e8-7c27-4cf0-b8fb-0b0d910a5355 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:34.934990 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-065382e8-7c27-4cf0-b8fb-0b0d910a5355 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:34.935450 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-065382e8-7c27-4cf0-b8fb-0b0d910a5355 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:34.935870 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-065382e8-7c27-4cf0-b8fb-0b0d910a5355 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:34.952216 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=100 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:43:35.036016 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-aece74e2-4ad8-450b-acbb-892bb2c00bfa tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e00999a6faf349eea3be7680a855e8d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f306c099ef294f6da8637a8ddcdb46d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:43:35.060836 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-aece74e2-4ad8-450b-acbb-892bb2c00bfa tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] 10.222.0.43 "GET /compute/v2.1/servers/4ca5960d-4a64-4a04-a849-d53180a038e9" status: 200 len: 1296 microversion: 2.1 time: 0.149852 Oct 04 21:43:35.062260 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 77/142] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:43:34 2022] GET /compute/v2.1/servers/4ca5960d-4a64-4a04-a849-d53180a038e9 => generated 1296 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:43:35.178917 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-065382e8-7c27-4cf0-b8fb-0b0d910a5355 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5387dbf4e24960809704c398fe999a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bedc0e10ab24824a40d06bb91626088', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:43:35.193675 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-065382e8-7c27-4cf0-b8fb-0b0d910a5355 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] 10.222.0.43 "GET /compute/v2.1/servers/4c692055-b3f9-494b-9279-5a8453ed88ba" status: 200 len: 1341 microversion: 2.1 time: 0.277075 Oct 04 21:43:35.194327 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 66/143] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:43:34 2022] GET /compute/v2.1/servers/4c692055-b3f9-494b-9279-5a8453ed88ba => generated 1341 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:43:36.090333 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-075b6cdd-0cb4-4047-8974-5f954e1e4844 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:36.092023 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-075b6cdd-0cb4-4047-8974-5f954e1e4844 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] [instance: 4ca5960d-4a64-4a04-a849-d53180a038e9] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:43:36.099588 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=74,nova_api:DELETE=5,nova_api:UPDATE=14,nova_api:INSERT=7 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:43:36.101747 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-075b6cdd-0cb4-4047-8974-5f954e1e4844 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:36.102404 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-075b6cdd-0cb4-4047-8974-5f954e1e4844 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:36.103027 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-075b6cdd-0cb4-4047-8974-5f954e1e4844 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:36.103969 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-075b6cdd-0cb4-4047-8974-5f954e1e4844 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:36.106490 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-075b6cdd-0cb4-4047-8974-5f954e1e4844 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:36.107242 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-075b6cdd-0cb4-4047-8974-5f954e1e4844 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:36.219710 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-754d890c-8095-48a6-b371-b83bd3a87169 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:36.220859 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-754d890c-8095-48a6-b371-b83bd3a87169 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] [instance: 4c692055-b3f9-494b-9279-5a8453ed88ba] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:43:36.228171 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-075b6cdd-0cb4-4047-8974-5f954e1e4844 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e00999a6faf349eea3be7680a855e8d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f306c099ef294f6da8637a8ddcdb46d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:43:36.234131 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-754d890c-8095-48a6-b371-b83bd3a87169 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:36.234690 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-754d890c-8095-48a6-b371-b83bd3a87169 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:36.235495 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-754d890c-8095-48a6-b371-b83bd3a87169 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:36.236239 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-754d890c-8095-48a6-b371-b83bd3a87169 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:36.237242 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-075b6cdd-0cb4-4047-8974-5f954e1e4844 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] 10.222.0.43 "GET /compute/v2.1/servers/4ca5960d-4a64-4a04-a849-d53180a038e9" status: 200 len: 1296 microversion: 2.1 time: 0.151956 Oct 04 21:43:36.240286 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-754d890c-8095-48a6-b371-b83bd3a87169 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:36.240708 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-754d890c-8095-48a6-b371-b83bd3a87169 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:36.255231 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 78/144] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:43:36 2022] GET /compute/v2.1/servers/4ca5960d-4a64-4a04-a849-d53180a038e9 => generated 1296 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:43:36.494467 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-754d890c-8095-48a6-b371-b83bd3a87169 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5387dbf4e24960809704c398fe999a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bedc0e10ab24824a40d06bb91626088', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:43:36.505822 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-754d890c-8095-48a6-b371-b83bd3a87169 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] 10.222.0.43 "GET /compute/v2.1/servers/4c692055-b3f9-494b-9279-5a8453ed88ba" status: 200 len: 1341 microversion: 2.1 time: 0.291489 Oct 04 21:43:36.507121 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 67/145] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:43:36 2022] GET /compute/v2.1/servers/4c692055-b3f9-494b-9279-5a8453ed88ba => generated 1341 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:43:37.278576 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-6f10059c-99ed-46c8-a3a3-2c407e4c3c04 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:37.279832 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell0:SELECT=8 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:43:37.282601 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-6f10059c-99ed-46c8-a3a3-2c407e4c3c04 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] [instance: 4ca5960d-4a64-4a04-a849-d53180a038e9] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:43:37.291387 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6f10059c-99ed-46c8-a3a3-2c407e4c3c04 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:37.292374 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6f10059c-99ed-46c8-a3a3-2c407e4c3c04 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:37.294563 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6f10059c-99ed-46c8-a3a3-2c407e4c3c04 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:37.296113 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6f10059c-99ed-46c8-a3a3-2c407e4c3c04 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:37.296997 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6f10059c-99ed-46c8-a3a3-2c407e4c3c04 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:37.297754 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6f10059c-99ed-46c8-a3a3-2c407e4c3c04 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:37.480813 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-6f10059c-99ed-46c8-a3a3-2c407e4c3c04 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e00999a6faf349eea3be7680a855e8d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f306c099ef294f6da8637a8ddcdb46d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:43:37.490637 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-6f10059c-99ed-46c8-a3a3-2c407e4c3c04 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] 10.222.0.43 "GET /compute/v2.1/servers/4ca5960d-4a64-4a04-a849-d53180a038e9" status: 200 len: 1296 microversion: 2.1 time: 0.228190 Oct 04 21:43:37.502797 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 79/146] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:43:37 2022] GET /compute/v2.1/servers/4ca5960d-4a64-4a04-a849-d53180a038e9 => generated 1296 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:43:37.536645 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-173ada3e-f2c6-450f-8ef9-f4fa21950365 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:37.537642 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-173ada3e-f2c6-450f-8ef9-f4fa21950365 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] [instance: 4c692055-b3f9-494b-9279-5a8453ed88ba] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:43:37.545886 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-173ada3e-f2c6-450f-8ef9-f4fa21950365 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:37.546391 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-173ada3e-f2c6-450f-8ef9-f4fa21950365 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:37.547006 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-173ada3e-f2c6-450f-8ef9-f4fa21950365 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:37.548469 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-173ada3e-f2c6-450f-8ef9-f4fa21950365 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:37.549074 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-173ada3e-f2c6-450f-8ef9-f4fa21950365 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:37.549946 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-173ada3e-f2c6-450f-8ef9-f4fa21950365 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:37.694840 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-c747939b-34e2-40ec-8587-ac09c3b096d9 tempest-FlavorsAccessTestJSON-1595907221 tempest-FlavorsAccessTestJSON-1595907221-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-435059729", "id": 655932259, "os-flavor-access:is_public": "False"}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:43:37.737331 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-c747939b-34e2-40ec-8587-ac09c3b096d9 tempest-FlavorsAccessTestJSON-1595907221 tempest-FlavorsAccessTestJSON-1595907221-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 0.467826 Oct 04 21:43:37.738486 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 68/147] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 21:43:37 2022] POST /compute/v2.1/flavors => generated 427 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:43:37.761350 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-173ada3e-f2c6-450f-8ef9-f4fa21950365 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5387dbf4e24960809704c398fe999a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bedc0e10ab24824a40d06bb91626088', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:43:37.772802 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-173ada3e-f2c6-450f-8ef9-f4fa21950365 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] 10.222.0.43 "GET /compute/v2.1/servers/4c692055-b3f9-494b-9279-5a8453ed88ba" status: 200 len: 1341 microversion: 2.1 time: 0.243462 Oct 04 21:43:37.788438 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 80/148] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:43:37 2022] GET /compute/v2.1/servers/4c692055-b3f9-494b-9279-5a8453ed88ba => generated 1341 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:43:37.788438 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-8d72ab7e-8fe0-45d8-88e0-22923cc9436b tempest-FlavorsAccessTestJSON-1595907221 tempest-FlavorsAccessTestJSON-1595907221-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "3c36bfe7240649e98402b9652fa811be"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:43:38.124706 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-fdbd6121-5fd9-42d3-8b5f-db6d870df46a tempest-KeyPairsV210TestJSON-810033137 tempest-KeyPairsV210TestJSON-810033137-project-admin] Action: 'create', calling method: .version_select at 0x7fbb2fc9d820>, body: {"keypair": {"name": "tempest-keypair-803000016", "type": "ssh", "user_id": "453bb3e3ed6c4aabb90254b3a741fc1a", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAmgD65wyXmJDb4VP4H9DCYw6dAZ29F3xj3dSteDfEUuDRa/SKSN5ndd+irrVGY1aCGKJl1nOVCGixR6T5ZFR4V7ZptmHQLpTmZ1xnw9331uDRg4Gb9IX8YmV1F8EZJ2lg=="}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:43:38.171727 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-fdbd6121-5fd9-42d3-8b5f-db6d870df46a tempest-KeyPairsV210TestJSON-810033137 tempest-KeyPairsV210TestJSON-810033137-project-admin] Getting quotas for project b6ee277975ee4a85abb0b3ceb108194d. Resources: {'key_pairs'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:43:38.192535 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-fdbd6121-5fd9-42d3-8b5f-db6d870df46a tempest-KeyPairsV210TestJSON-810033137 tempest-KeyPairsV210TestJSON-810033137-project-admin] Getting quotas for user 15f79a001baa4fd7b6d07ba9d369d1aa and project b6ee277975ee4a85abb0b3ceb108194d. Resources: {'key_pairs'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:43:38.241096 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-fdbd6121-5fd9-42d3-8b5f-db6d870df46a tempest-KeyPairsV210TestJSON-810033137 tempest-KeyPairsV210TestJSON-810033137-project-admin] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.10 time: 0.501432 Oct 04 21:43:38.243194 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 69/149] 10.222.0.43 () {62 vars in 1200 bytes} [Tue Oct 4 21:43:37 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 503 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 04 21:43:38.254292 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-8d72ab7e-8fe0-45d8-88e0-22923cc9436b tempest-FlavorsAccessTestJSON-1595907221 tempest-FlavorsAccessTestJSON-1595907221-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors/655932259/action" status: 200 len: 96 microversion: 2.1 time: 0.478213 Oct 04 21:43:38.261190 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 81/150] 10.222.0.43 () {60 vars in 1197 bytes} [Tue Oct 4 21:43:37 2022] POST /compute/v2.1/flavors/655932259/action => generated 96 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 21:43:38.269366 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-ef32947f-6c03-47e6-8037-ed78f75a6606 tempest-KeyPairsV210TestJSON-810033137 tempest-KeyPairsV210TestJSON-810033137-project-admin] Action: 'create', calling method: .version_select at 0x7fbb2fadd160>, body: {"keypair": {"name": "tempest-keypair-397495593", "type": "ssh", "user_id": "453bb3e3ed6c4aabb90254b3a741fc1a", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFdhnd0nBt19bzbMZr9OaRdG9WjDA92gAKBisDMSGapkjjxlcw2s+G+x+6+YSbxH2M9yfUglXpYGEjxIp5nMv6IaQCWrYXoplZyQT+banYcq+20R5GujhfBdmtw+HODKbQ=="}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:43:38.295946 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-ef32947f-6c03-47e6-8037-ed78f75a6606 tempest-KeyPairsV210TestJSON-810033137 tempest-KeyPairsV210TestJSON-810033137-project-admin] Getting quotas for project b6ee277975ee4a85abb0b3ceb108194d. Resources: {'key_pairs'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:43:38.301314 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-ef32947f-6c03-47e6-8037-ed78f75a6606 tempest-KeyPairsV210TestJSON-810033137 tempest-KeyPairsV210TestJSON-810033137-project-admin] Getting quotas for user 15f79a001baa4fd7b6d07ba9d369d1aa and project b6ee277975ee4a85abb0b3ceb108194d. Resources: {'key_pairs'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:43:38.334249 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-ef32947f-6c03-47e6-8037-ed78f75a6606 tempest-KeyPairsV210TestJSON-810033137 tempest-KeyPairsV210TestJSON-810033137-project-admin] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.10 time: 0.069197 Oct 04 21:43:38.341243 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 82/151] 10.222.0.43 () {62 vars in 1200 bytes} [Tue Oct 4 21:43:38 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 73 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 04 21:43:38.470801 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-a4b71b83-dc8a-4577-81e9-02548a88726b tempest-HypervisorAdminUnderV252Test-1340830788 tempest-HypervisorAdminUnderV252Test-1340830788-project-admin] Calling method '.version_select at 0x7fbb2fce40d0>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:38.472908 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a4b71b83-dc8a-4577-81e9-02548a88726b tempest-HypervisorAdminUnderV252Test-1340830788 tempest-HypervisorAdminUnderV252Test-1340830788-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:38.473466 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a4b71b83-dc8a-4577-81e9-02548a88726b tempest-HypervisorAdminUnderV252Test-1340830788 tempest-HypervisorAdminUnderV252Test-1340830788-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:38.474548 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a4b71b83-dc8a-4577-81e9-02548a88726b tempest-HypervisorAdminUnderV252Test-1340830788 tempest-HypervisorAdminUnderV252Test-1340830788-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:38.491205 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a4b71b83-dc8a-4577-81e9-02548a88726b tempest-HypervisorAdminUnderV252Test-1340830788 tempest-HypervisorAdminUnderV252Test-1340830788-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:38.492047 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a4b71b83-dc8a-4577-81e9-02548a88726b tempest-HypervisorAdminUnderV252Test-1340830788 tempest-HypervisorAdminUnderV252Test-1340830788-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:38.492758 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a4b71b83-dc8a-4577-81e9-02548a88726b tempest-HypervisorAdminUnderV252Test-1340830788 tempest-HypervisorAdminUnderV252Test-1340830788-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:38.507352 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a4b71b83-dc8a-4577-81e9-02548a88726b tempest-HypervisorAdminUnderV252Test-1340830788 tempest-HypervisorAdminUnderV252Test-1340830788-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:38.508599 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a4b71b83-dc8a-4577-81e9-02548a88726b tempest-HypervisorAdminUnderV252Test-1340830788 tempest-HypervisorAdminUnderV252Test-1340830788-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:38.509453 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a4b71b83-dc8a-4577-81e9-02548a88726b tempest-HypervisorAdminUnderV252Test-1340830788 tempest-HypervisorAdminUnderV252Test-1340830788-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:38.516586 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-a4b71b83-dc8a-4577-81e9-02548a88726b tempest-HypervisorAdminUnderV252Test-1340830788 tempest-HypervisorAdminUnderV252Test-1340830788-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.271795 Oct 04 21:43:38.517516 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 70/152] 10.222.0.43 () {58 vars in 1146 bytes} [Tue Oct 4 21:43:38 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:43:38.528064 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-54948f0d-7114-4075-a8b7-6b54bf67e877 tempest-KeyPairsV210TestJSON-810033137 tempest-KeyPairsV210TestJSON-810033137-project-admin] Calling method '.version_select at 0x7fbb2fd31af0>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:38.538912 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-54948f0d-7114-4075-a8b7-6b54bf67e877 tempest-KeyPairsV210TestJSON-810033137 tempest-KeyPairsV210TestJSON-810033137-project-admin] 10.222.0.43 "GET /compute/v2.1/os-keypairs/tempest-keypair-803000016?user_id=453bb3e3ed6c4aabb90254b3a741fc1a" status: 200 len: 511 microversion: 2.10 time: 0.019953 Oct 04 21:43:38.540425 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 71/153] 10.222.0.43 () {60 vars in 1337 bytes} [Tue Oct 4 21:43:38 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-803000016?user_id=453bb3e3ed6c4aabb90254b3a741fc1a => generated 511 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:43:38.545809 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-d4d615eb-0dc4-4016-a747-da61ce6a5508 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:38.546779 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-d4d615eb-0dc4-4016-a747-da61ce6a5508 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] [instance: 4ca5960d-4a64-4a04-a849-d53180a038e9] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:43:38.550354 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-28039d0e-34d8-4afe-b3d5-0698dac9a259 tempest-FlavorsAccessTestJSON-1413102759 tempest-FlavorsAccessTestJSON-1413102759-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:38.553931 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d4d615eb-0dc4-4016-a747-da61ce6a5508 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:38.554813 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d4d615eb-0dc4-4016-a747-da61ce6a5508 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:38.555363 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d4d615eb-0dc4-4016-a747-da61ce6a5508 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:38.556411 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d4d615eb-0dc4-4016-a747-da61ce6a5508 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:38.557064 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d4d615eb-0dc4-4016-a747-da61ce6a5508 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:38.557682 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d4d615eb-0dc4-4016-a747-da61ce6a5508 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:38.575901 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-28039d0e-34d8-4afe-b3d5-0698dac9a259 tempest-FlavorsAccessTestJSON-1413102759 tempest-FlavorsAccessTestJSON-1413102759-project] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 5408 microversion: 2.1 time: 0.239325 Oct 04 21:43:38.596726 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 83/154] 10.222.0.43 () {58 vars in 1146 bytes} [Tue Oct 4 21:43:38 2022] GET /compute/v2.1/flavors/detail => generated 5408 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:43:38.603040 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-9d8af45b-52bc-4091-bb88-0830b184e002 tempest-HypervisorAdminUnderV252Test-1340830788 tempest-HypervisorAdminUnderV252Test-1340830788-project-admin] Calling method '.version_select at 0x7fbb2fafbf70>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:38.605569 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9d8af45b-52bc-4091-bb88-0830b184e002 tempest-HypervisorAdminUnderV252Test-1340830788 tempest-HypervisorAdminUnderV252Test-1340830788-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:38.606265 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9d8af45b-52bc-4091-bb88-0830b184e002 tempest-HypervisorAdminUnderV252Test-1340830788 tempest-HypervisorAdminUnderV252Test-1340830788-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:38.607722 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9d8af45b-52bc-4091-bb88-0830b184e002 tempest-HypervisorAdminUnderV252Test-1340830788 tempest-HypervisorAdminUnderV252Test-1340830788-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:38.630650 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9d8af45b-52bc-4091-bb88-0830b184e002 tempest-HypervisorAdminUnderV252Test-1340830788 tempest-HypervisorAdminUnderV252Test-1340830788-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:38.631350 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9d8af45b-52bc-4091-bb88-0830b184e002 tempest-HypervisorAdminUnderV252Test-1340830788 tempest-HypervisorAdminUnderV252Test-1340830788-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:38.632143 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9d8af45b-52bc-4091-bb88-0830b184e002 tempest-HypervisorAdminUnderV252Test-1340830788 tempest-HypervisorAdminUnderV252Test-1340830788-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:38.650493 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-d4d615eb-0dc4-4016-a747-da61ce6a5508 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e00999a6faf349eea3be7680a855e8d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f306c099ef294f6da8637a8ddcdb46d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:43:38.659946 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-d4d615eb-0dc4-4016-a747-da61ce6a5508 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] 10.222.0.43 "GET /compute/v2.1/servers/4ca5960d-4a64-4a04-a849-d53180a038e9" status: 200 len: 1296 microversion: 2.1 time: 0.118026 Oct 04 21:43:38.660847 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 72/155] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:43:38 2022] GET /compute/v2.1/servers/4ca5960d-4a64-4a04-a849-d53180a038e9 => generated 1296 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:43:38.667145 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-4a593d46-0682-4129-bc21-d77cd68573bf tempest-KeyPairsV210TestJSON-810033137 tempest-KeyPairsV210TestJSON-810033137-project-admin] Action: 'create', calling method: .version_select at 0x7fbb2fc9d4c0>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-1545387469", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHxKw9XPGfFY97uQNPBdp/3myWR/XBw6jrguK/mHycjeoBdKoiMay9dr1hxHW4ZYZHwZFMrbjTqsXs5qIrL6iNi0ISE/Sex1lirk2ljibhf6++B/rmaKLjdVzprWBZTHjg=="}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:43:38.673543 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9d8af45b-52bc-4091-bb88-0830b184e002 tempest-HypervisorAdminUnderV252Test-1340830788 tempest-HypervisorAdminUnderV252Test-1340830788-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:38.674045 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9d8af45b-52bc-4091-bb88-0830b184e002 tempest-HypervisorAdminUnderV252Test-1340830788 tempest-HypervisorAdminUnderV252Test-1340830788-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:38.674517 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9d8af45b-52bc-4091-bb88-0830b184e002 tempest-HypervisorAdminUnderV252Test-1340830788 tempest-HypervisorAdminUnderV252Test-1340830788-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:38.681249 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-9d8af45b-52bc-4091-bb88-0830b184e002 tempest-HypervisorAdminUnderV252Test-1340830788 tempest-HypervisorAdminUnderV252Test-1340830788-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hypervisors/n-h1-860284-1/servers" status: 200 len: 275 microversion: 2.1 time: 0.083101 Oct 04 21:43:38.683220 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 84/156] 10.222.0.43 () {58 vars in 1212 bytes} [Tue Oct 4 21:43:38 2022] GET /compute/v2.1/os-hypervisors/n-h1-860284-1/servers => generated 275 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:43:38.685129 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-4a593d46-0682-4129-bc21-d77cd68573bf tempest-KeyPairsV210TestJSON-810033137 tempest-KeyPairsV210TestJSON-810033137-project-admin] Getting quotas for project b6ee277975ee4a85abb0b3ceb108194d. Resources: {'key_pairs'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:43:38.689119 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-5f081f97-f98d-44dc-969b-52bb1d671b9a tempest-FlavorsAccessTestJSON-1595907221 tempest-FlavorsAccessTestJSON-1595907221-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "3c36bfe7240649e98402b9652fa811be"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:43:38.693622 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-4a593d46-0682-4129-bc21-d77cd68573bf tempest-KeyPairsV210TestJSON-810033137 tempest-KeyPairsV210TestJSON-810033137-project-admin] Getting quotas for user 15f79a001baa4fd7b6d07ba9d369d1aa and project b6ee277975ee4a85abb0b3ceb108194d. Resources: {'key_pairs'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:43:38.745063 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-4a593d46-0682-4129-bc21-d77cd68573bf tempest-KeyPairsV210TestJSON-810033137 tempest-KeyPairsV210TestJSON-810033137-project-admin] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 201 len: 422 microversion: 2.10 time: 0.082818 Oct 04 21:43:38.746598 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 73/157] 10.222.0.43 () {62 vars in 1200 bytes} [Tue Oct 4 21:43:38 2022] POST /compute/v2.1/os-keypairs => generated 422 bytes in 85 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 04 21:43:38.752389 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-532c1bf7-6338-4562-b332-404038ad6a38 tempest-HypervisorAdminUnderV252Test-1340830788 tempest-HypervisorAdminUnderV252Test-1340830788-project-admin] Calling method '.version_select at 0x7fbb2fe90790>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:38.755692 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-532c1bf7-6338-4562-b332-404038ad6a38 tempest-HypervisorAdminUnderV252Test-1340830788 tempest-HypervisorAdminUnderV252Test-1340830788-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:38.756640 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-532c1bf7-6338-4562-b332-404038ad6a38 tempest-HypervisorAdminUnderV252Test-1340830788 tempest-HypervisorAdminUnderV252Test-1340830788-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:38.758806 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-532c1bf7-6338-4562-b332-404038ad6a38 tempest-HypervisorAdminUnderV252Test-1340830788 tempest-HypervisorAdminUnderV252Test-1340830788-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:38.790063 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-532c1bf7-6338-4562-b332-404038ad6a38 tempest-HypervisorAdminUnderV252Test-1340830788 tempest-HypervisorAdminUnderV252Test-1340830788-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:38.791140 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-532c1bf7-6338-4562-b332-404038ad6a38 tempest-HypervisorAdminUnderV252Test-1340830788 tempest-HypervisorAdminUnderV252Test-1340830788-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:38.791905 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-532c1bf7-6338-4562-b332-404038ad6a38 tempest-HypervisorAdminUnderV252Test-1340830788 tempest-HypervisorAdminUnderV252Test-1340830788-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:38.801832 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=7,nova_api:DELETE=2 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:43:38.806725 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-532c1bf7-6338-4562-b332-404038ad6a38 tempest-HypervisorAdminUnderV252Test-1340830788 tempest-HypervisorAdminUnderV252Test-1340830788-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:38.807320 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-532c1bf7-6338-4562-b332-404038ad6a38 tempest-HypervisorAdminUnderV252Test-1340830788 tempest-HypervisorAdminUnderV252Test-1340830788-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:38.807896 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-532c1bf7-6338-4562-b332-404038ad6a38 tempest-HypervisorAdminUnderV252Test-1340830788 tempest-HypervisorAdminUnderV252Test-1340830788-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:38.819089 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-532c1bf7-6338-4562-b332-404038ad6a38 tempest-HypervisorAdminUnderV252Test-1340830788 tempest-HypervisorAdminUnderV252Test-1340830788-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.070762 Oct 04 21:43:38.820222 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 74/158] 10.222.0.43 () {58 vars in 1146 bytes} [Tue Oct 4 21:43:38 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:43:38.827181 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-c86bfb4c-8a44-4f11-b071-81c6caf3e67f tempest-KeyPairsV210TestJSON-810033137 tempest-KeyPairsV210TestJSON-810033137-project-admin] Calling method '.version_select at 0x7fbb2fd7e940>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:38.839311 n-d-860284-1 devstack@n-api.service[134102]: WARNING oslo_db.sqlalchemy.utils [None req-c86bfb4c-8a44-4f11-b071-81c6caf3e67f tempest-KeyPairsV210TestJSON-810033137 tempest-KeyPairsV210TestJSON-810033137-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Oct 04 21:43:38.848484 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-c86bfb4c-8a44-4f11-b071-81c6caf3e67f tempest-KeyPairsV210TestJSON-810033137 tempest-KeyPairsV210TestJSON-810033137-project-admin] 10.222.0.43 "GET /compute/v2.1/os-keypairs?user_id=453bb3e3ed6c4aabb90254b3a741fc1a" status: 200 len: 724 microversion: 2.10 time: 0.025719 Oct 04 21:43:38.849697 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 75/159] 10.222.0.43 () {60 vars in 1259 bytes} [Tue Oct 4 21:43:38 2022] GET /compute/v2.1/os-keypairs?user_id=453bb3e3ed6c4aabb90254b3a741fc1a => generated 724 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:43:38.859060 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-3f20465c-335d-46dc-92bf-f0a2ef8739dc tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:38.859692 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-3f20465c-335d-46dc-92bf-f0a2ef8739dc tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] [instance: 4c692055-b3f9-494b-9279-5a8453ed88ba] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:43:38.869018 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3f20465c-335d-46dc-92bf-f0a2ef8739dc tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:38.869524 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3f20465c-335d-46dc-92bf-f0a2ef8739dc tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:38.869975 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3f20465c-335d-46dc-92bf-f0a2ef8739dc tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:38.870755 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3f20465c-335d-46dc-92bf-f0a2ef8739dc tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:38.871216 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3f20465c-335d-46dc-92bf-f0a2ef8739dc tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:38.872150 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3f20465c-335d-46dc-92bf-f0a2ef8739dc tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:39.111470 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-5f081f97-f98d-44dc-969b-52bb1d671b9a tempest-FlavorsAccessTestJSON-1595907221 tempest-FlavorsAccessTestJSON-1595907221-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors/655932259/action" status: 200 len: 21 microversion: 2.1 time: 0.426459 Oct 04 21:43:39.112920 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 85/160] 10.222.0.43 () {60 vars in 1197 bytes} [Tue Oct 4 21:43:38 2022] POST /compute/v2.1/flavors/655932259/action => generated 21 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 21:43:39.124208 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-c35b3146-83f3-481d-9670-509412491afe tempest-HypervisorAdminUnderV252Test-1340830788 tempest-HypervisorAdminUnderV252Test-1340830788-project-admin] Calling method '.version_select at 0x7fbb2faddd30>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:39.126440 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c35b3146-83f3-481d-9670-509412491afe tempest-HypervisorAdminUnderV252Test-1340830788 tempest-HypervisorAdminUnderV252Test-1340830788-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:39.127187 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c35b3146-83f3-481d-9670-509412491afe tempest-HypervisorAdminUnderV252Test-1340830788 tempest-HypervisorAdminUnderV252Test-1340830788-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:39.128221 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c35b3146-83f3-481d-9670-509412491afe tempest-HypervisorAdminUnderV252Test-1340830788 tempest-HypervisorAdminUnderV252Test-1340830788-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:39.145622 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c35b3146-83f3-481d-9670-509412491afe tempest-HypervisorAdminUnderV252Test-1340830788 tempest-HypervisorAdminUnderV252Test-1340830788-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:39.146587 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c35b3146-83f3-481d-9670-509412491afe tempest-HypervisorAdminUnderV252Test-1340830788 tempest-HypervisorAdminUnderV252Test-1340830788-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:39.147291 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c35b3146-83f3-481d-9670-509412491afe tempest-HypervisorAdminUnderV252Test-1340830788 tempest-HypervisorAdminUnderV252Test-1340830788-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:39.155048 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-c35b3146-83f3-481d-9670-509412491afe tempest-HypervisorAdminUnderV252Test-1340830788 tempest-HypervisorAdminUnderV252Test-1340830788-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hypervisors/n-h1-860284-1/search" status: 200 len: 104 microversion: 2.1 time: 0.040047 Oct 04 21:43:39.156446 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 86/161] 10.222.0.43 () {58 vars in 1209 bytes} [Tue Oct 4 21:43:39 2022] GET /compute/v2.1/os-hypervisors/n-h1-860284-1/search => generated 104 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:43:39.161352 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-bb06e4b4-4023-4339-be3e-3b61450833a5 tempest-KeyPairsV210TestJSON-810033137 tempest-KeyPairsV210TestJSON-810033137-project-admin] Calling method '.version_select at 0x7fbb2fb33c10>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:39.192233 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-3f20465c-335d-46dc-92bf-f0a2ef8739dc tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5387dbf4e24960809704c398fe999a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bedc0e10ab24824a40d06bb91626088', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:43:39.200572 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-bb06e4b4-4023-4339-be3e-3b61450833a5 tempest-KeyPairsV210TestJSON-810033137 tempest-KeyPairsV210TestJSON-810033137-project-admin] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1545387469" status: 204 len: 0 microversion: 2.10 time: 0.042071 Oct 04 21:43:39.201145 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-3f20465c-335d-46dc-92bf-f0a2ef8739dc tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] 10.222.0.43 "GET /compute/v2.1/servers/4c692055-b3f9-494b-9279-5a8453ed88ba" status: 200 len: 1341 microversion: 2.1 time: 0.349036 Oct 04 21:43:39.205036 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 87/162] 10.222.0.43 () {60 vars in 1325 bytes} [Tue Oct 4 21:43:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1545387469 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 21:43:39.205453 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 76/163] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:43:38 2022] GET /compute/v2.1/servers/4c692055-b3f9-494b-9279-5a8453ed88ba => generated 1341 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:43:39.219843 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-6564b4de-5476-4433-a039-1292ab099239 tempest-KeyPairsV210TestJSON-810033137 tempest-KeyPairsV210TestJSON-810033137-project-admin] Calling method '.version_select at 0x7fbb2fce4940>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:39.220420 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-d1d710cc-b5ca-4e22-9951-fbf355431f58 tempest-FlavorsAccessTestJSON-1413102759 tempest-FlavorsAccessTestJSON-1413102759-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:39.245663 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-6564b4de-5476-4433-a039-1292ab099239 tempest-KeyPairsV210TestJSON-810033137 tempest-KeyPairsV210TestJSON-810033137-project-admin] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-397495593?user_id=453bb3e3ed6c4aabb90254b3a741fc1a" status: 204 len: 0 microversion: 2.10 time: 0.035225 Oct 04 21:43:39.246780 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 77/164] 10.222.0.43 () {60 vars in 1340 bytes} [Tue Oct 4 21:43:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-397495593?user_id=453bb3e3ed6c4aabb90254b3a741fc1a => generated 0 bytes in 37 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 21:43:39.259413 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-deaf8d3d-fd6f-438a-a95a-c98db948e8f5 tempest-KeyPairsV210TestJSON-810033137 tempest-KeyPairsV210TestJSON-810033137-project-admin] Calling method '.version_select at 0x7fbb2fd3bee0>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:39.278030 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-d1d710cc-b5ca-4e22-9951-fbf355431f58 tempest-FlavorsAccessTestJSON-1413102759 tempest-FlavorsAccessTestJSON-1413102759-project] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.067458 Oct 04 21:43:39.290392 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 88/165] 10.222.0.43 () {58 vars in 1146 bytes} [Tue Oct 4 21:43:39 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:43:39.300059 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-caacff17-dc5a-4d50-9fc6-1f4ed00a7283 tempest-FlavorsAccessTestJSON-1595907221 tempest-FlavorsAccessTestJSON-1595907221-project-admin] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:39.301111 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-deaf8d3d-fd6f-438a-a95a-c98db948e8f5 tempest-KeyPairsV210TestJSON-810033137 tempest-KeyPairsV210TestJSON-810033137-project-admin] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-803000016?user_id=453bb3e3ed6c4aabb90254b3a741fc1a" status: 204 len: 0 microversion: 2.10 time: 0.048547 Oct 04 21:43:39.302573 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 78/166] 10.222.0.43 () {60 vars in 1340 bytes} [Tue Oct 4 21:43:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-803000016?user_id=453bb3e3ed6c4aabb90254b3a741fc1a => generated 0 bytes in 52 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 04 21:43:39.337919 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-caacff17-dc5a-4d50-9fc6-1f4ed00a7283 tempest-FlavorsAccessTestJSON-1595907221 tempest-FlavorsAccessTestJSON-1595907221-project-admin] 10.222.0.43 "DELETE /compute/v2.1/flavors/655932259" status: 202 len: 0 microversion: 2.1 time: 0.042659 Oct 04 21:43:39.338830 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 89/167] 10.222.0.43 () {58 vars in 1158 bytes} [Tue Oct 4 21:43:39 2022] DELETE /compute/v2.1/flavors/655932259 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:43:39.347536 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-2457577d-b324-43a6-81d8-3171bf4f9d2f tempest-FlavorsAccessTestJSON-1595907221 tempest-FlavorsAccessTestJSON-1595907221-project-admin] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:39.385126 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-2457577d-b324-43a6-81d8-3171bf4f9d2f tempest-FlavorsAccessTestJSON-1595907221 tempest-FlavorsAccessTestJSON-1595907221-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.041455 Oct 04 21:43:39.407505 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 79/168] 10.222.0.43 () {58 vars in 1146 bytes} [Tue Oct 4 21:43:39 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:43:39.409473 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-8f38c191-941d-442c-a8da-2e133f10cde0 tempest-FlavorsAccessTestJSON-1595907221 tempest-FlavorsAccessTestJSON-1595907221-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-1076388878", "id": 1222291957, "os-flavor-access:is_public": "False"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:43:39.446636 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-8f38c191-941d-442c-a8da-2e133f10cde0 tempest-FlavorsAccessTestJSON-1595907221 tempest-FlavorsAccessTestJSON-1595907221-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 431 microversion: 2.1 time: 0.040294 Oct 04 21:43:39.448667 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 90/169] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 21:43:39 2022] POST /compute/v2.1/flavors => generated 431 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:43:39.464536 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-2d1b7c82-3705-4c09-9e43-0ae75338e01a tempest-FlavorsAccessTestJSON-1595907221 tempest-FlavorsAccessTestJSON-1595907221-project-admin] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:39.489903 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-2d1b7c82-3705-4c09-9e43-0ae75338e01a tempest-FlavorsAccessTestJSON-1595907221 tempest-FlavorsAccessTestJSON-1595907221-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/1222291957/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.032635 Oct 04 21:43:39.496672 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 80/170] 10.222.0.43 () {58 vars in 1209 bytes} [Tue Oct 4 21:43:39 2022] GET /compute/v2.1/flavors/1222291957/os-flavor-access => generated 21 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 21:43:39.502727 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-64f86fab-ab31-40b0-8b02-350af5dde543 tempest-FlavorsAccessTestJSON-1595907221 tempest-FlavorsAccessTestJSON-1595907221-project-admin] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:39.526763 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-64f86fab-ab31-40b0-8b02-350af5dde543 tempest-FlavorsAccessTestJSON-1595907221 tempest-FlavorsAccessTestJSON-1595907221-project-admin] 10.222.0.43 "DELETE /compute/v2.1/flavors/1222291957" status: 202 len: 0 microversion: 2.1 time: 0.026061 Oct 04 21:43:39.528779 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 91/171] 10.222.0.43 () {58 vars in 1161 bytes} [Tue Oct 4 21:43:39 2022] DELETE /compute/v2.1/flavors/1222291957 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:43:39.541044 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-0d681788-35a2-4ec8-ad9c-6e4d53e63fa4 tempest-FlavorsAccessTestJSON-1595907221 tempest-FlavorsAccessTestJSON-1595907221-project-admin] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:39.570649 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-0d681788-35a2-4ec8-ad9c-6e4d53e63fa4 tempest-FlavorsAccessTestJSON-1595907221 tempest-FlavorsAccessTestJSON-1595907221-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.034772 Oct 04 21:43:39.571774 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 81/172] 10.222.0.43 () {58 vars in 1146 bytes} [Tue Oct 4 21:43:39 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:43:39.691722 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-845cddfb-386b-4c0c-ae24-24f4a27ffeaf tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:39.692348 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-845cddfb-386b-4c0c-ae24-24f4a27ffeaf tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] [instance: 4ca5960d-4a64-4a04-a849-d53180a038e9] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:43:39.702545 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-845cddfb-386b-4c0c-ae24-24f4a27ffeaf tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:39.703044 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-845cddfb-386b-4c0c-ae24-24f4a27ffeaf tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:39.703481 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-845cddfb-386b-4c0c-ae24-24f4a27ffeaf tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:39.704199 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-845cddfb-386b-4c0c-ae24-24f4a27ffeaf tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:39.704657 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-845cddfb-386b-4c0c-ae24-24f4a27ffeaf tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:39.705088 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-845cddfb-386b-4c0c-ae24-24f4a27ffeaf tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:39.910433 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-845cddfb-386b-4c0c-ae24-24f4a27ffeaf tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e00999a6faf349eea3be7680a855e8d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f306c099ef294f6da8637a8ddcdb46d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:43:39.918926 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-845cddfb-386b-4c0c-ae24-24f4a27ffeaf tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] 10.222.0.43 "GET /compute/v2.1/servers/4ca5960d-4a64-4a04-a849-d53180a038e9" status: 200 len: 1296 microversion: 2.1 time: 0.237186 Oct 04 21:43:39.927517 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 92/173] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:43:39 2022] GET /compute/v2.1/servers/4ca5960d-4a64-4a04-a849-d53180a038e9 => generated 1296 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:43:40.049027 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-0149f243-3e93-4ec1-9dc5-0af91185cd4d tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-497185603", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452"}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:43:40.151522 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.network.neutron [None req-0149f243-3e93-4ec1-9dc5-0af91185cd4d tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] validate_networks() for None {{(pid=134102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:43:40.225448 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-b3162387-955f-423a-a381-c53452ec1225 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:40.226424 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-b3162387-955f-423a-a381-c53452ec1225 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] [instance: 4c692055-b3f9-494b-9279-5a8453ed88ba] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:43:40.247345 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b3162387-955f-423a-a381-c53452ec1225 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:40.249026 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b3162387-955f-423a-a381-c53452ec1225 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:40.250424 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b3162387-955f-423a-a381-c53452ec1225 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:40.251541 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b3162387-955f-423a-a381-c53452ec1225 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:40.254652 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b3162387-955f-423a-a381-c53452ec1225 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:40.255284 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b3162387-955f-423a-a381-c53452ec1225 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:40.877029 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-b3162387-955f-423a-a381-c53452ec1225 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5387dbf4e24960809704c398fe999a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bedc0e10ab24824a40d06bb91626088', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:43:40.885762 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-b3162387-955f-423a-a381-c53452ec1225 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] 10.222.0.43 "GET /compute/v2.1/servers/4c692055-b3f9-494b-9279-5a8453ed88ba" status: 200 len: 1341 microversion: 2.1 time: 0.664275 Oct 04 21:43:40.894447 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 93/174] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:43:40 2022] GET /compute/v2.1/servers/4c692055-b3f9-494b-9279-5a8453ed88ba => generated 1341 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:43:40.956217 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-9147fcaa-080c-4a93-a35a-92b57cb0dc03 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:40.958983 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-9147fcaa-080c-4a93-a35a-92b57cb0dc03 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] [instance: 4ca5960d-4a64-4a04-a849-d53180a038e9] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:43:40.969316 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9147fcaa-080c-4a93-a35a-92b57cb0dc03 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:40.969818 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9147fcaa-080c-4a93-a35a-92b57cb0dc03 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:40.970259 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9147fcaa-080c-4a93-a35a-92b57cb0dc03 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:40.971696 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9147fcaa-080c-4a93-a35a-92b57cb0dc03 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:40.972569 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9147fcaa-080c-4a93-a35a-92b57cb0dc03 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:40.973221 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9147fcaa-080c-4a93-a35a-92b57cb0dc03 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:41.113985 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-0149f243-3e93-4ec1-9dc5-0af91185cd4d tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Flavor limits 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:43:41.115428 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-0149f243-3e93-4ec1-9dc5-0af91185cd4d tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Image limits 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:43:41.116118 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-0149f243-3e93-4ec1-9dc5-0af91185cd4d tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Flavor pref 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:43:41.116733 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-0149f243-3e93-4ec1-9dc5-0af91185cd4d tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Image pref 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:43:41.117819 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-0149f243-3e93-4ec1-9dc5-0af91185cd4d tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:43:41.137899 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0149f243-3e93-4ec1-9dc5-0af91185cd4d tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:41.141014 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0149f243-3e93-4ec1-9dc5-0af91185cd4d tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:41.141744 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0149f243-3e93-4ec1-9dc5-0af91185cd4d tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:41.144816 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0149f243-3e93-4ec1-9dc5-0af91185cd4d tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:41.146145 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0149f243-3e93-4ec1-9dc5-0af91185cd4d tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:41.149998 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0149f243-3e93-4ec1-9dc5-0af91185cd4d tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:41.159893 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=100 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:43:41.210079 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-0149f243-3e93-4ec1-9dc5-0af91185cd4d tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Getting quotas for project 39edf587afe94b60911198aa0bb61613. Resources: {'instances', 'ram', 'cores'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:43:41.217750 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-0149f243-3e93-4ec1-9dc5-0af91185cd4d tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Getting quotas for user 29842a669a20408b881105135f76cb0a and project 39edf587afe94b60911198aa0bb61613. Resources: {'instances', 'ram', 'cores'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:43:41.237101 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-0149f243-3e93-4ec1-9dc5-0af91185cd4d tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Going to run 1 instances... {{(pid=134102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:43:41.240187 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-0149f243-3e93-4ec1-9dc5-0af91185cd4d tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] [instance: 4b0c3dd7-d609-4b00-8604-35f8a2680c14] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='58548514-5dac-426c-81f5-19e3fba33e23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:43:41.350024 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-0149f243-3e93-4ec1-9dc5-0af91185cd4d tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.657784 Oct 04 21:43:41.350919 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 82/175] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 21:43:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 1668 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:43:41.369536 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-9147fcaa-080c-4a93-a35a-92b57cb0dc03 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e00999a6faf349eea3be7680a855e8d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f306c099ef294f6da8637a8ddcdb46d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:43:41.373884 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-34c5fb2b-156a-4575-80b0-6fbd88b2ca92 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:41.379461 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-9147fcaa-080c-4a93-a35a-92b57cb0dc03 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] 10.222.0.43 "GET /compute/v2.1/servers/4ca5960d-4a64-4a04-a849-d53180a038e9" status: 200 len: 1296 microversion: 2.1 time: 0.438004 Oct 04 21:43:41.379698 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-34c5fb2b-156a-4575-80b0-6fbd88b2ca92 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] [instance: 4b0c3dd7-d609-4b00-8604-35f8a2680c14] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:43:41.385154 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 94/176] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:43:40 2022] GET /compute/v2.1/servers/4ca5960d-4a64-4a04-a849-d53180a038e9 => generated 1296 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:43:41.609531 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-34c5fb2b-156a-4575-80b0-6fbd88b2ca92 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29842a669a20408b881105135f76cb0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39edf587afe94b60911198aa0bb61613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:43:41.625463 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-34c5fb2b-156a-4575-80b0-6fbd88b2ca92 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] 10.222.0.43 "GET /compute/v2.1/servers/4b0c3dd7-d609-4b00-8604-35f8a2680c14" status: 200 len: 1216 microversion: 2.1 time: 0.255163 Oct 04 21:43:41.664568 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 83/177] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:43:41 2022] GET /compute/v2.1/servers/4b0c3dd7-d609-4b00-8604-35f8a2680c14 => generated 1216 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:43:41.911458 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-501a592c-769e-4e14-a7c2-0e3f06a1c318 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:41.912713 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-501a592c-769e-4e14-a7c2-0e3f06a1c318 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] [instance: 4c692055-b3f9-494b-9279-5a8453ed88ba] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:43:41.916253 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=8 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:43:41.932119 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-501a592c-769e-4e14-a7c2-0e3f06a1c318 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:41.934685 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-501a592c-769e-4e14-a7c2-0e3f06a1c318 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:41.937959 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-501a592c-769e-4e14-a7c2-0e3f06a1c318 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:41.939725 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-501a592c-769e-4e14-a7c2-0e3f06a1c318 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:41.941396 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-501a592c-769e-4e14-a7c2-0e3f06a1c318 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:41.944328 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-501a592c-769e-4e14-a7c2-0e3f06a1c318 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:42.404663 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-c1057fde-0372-4d07-9836-34e3924ec7a1 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:42.405471 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-c1057fde-0372-4d07-9836-34e3924ec7a1 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] [instance: 4ca5960d-4a64-4a04-a849-d53180a038e9] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:43:42.421692 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c1057fde-0372-4d07-9836-34e3924ec7a1 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:42.423024 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c1057fde-0372-4d07-9836-34e3924ec7a1 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:42.424212 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c1057fde-0372-4d07-9836-34e3924ec7a1 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:42.426301 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c1057fde-0372-4d07-9836-34e3924ec7a1 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:42.427277 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c1057fde-0372-4d07-9836-34e3924ec7a1 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:42.428488 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c1057fde-0372-4d07-9836-34e3924ec7a1 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:42.510057 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-501a592c-769e-4e14-a7c2-0e3f06a1c318 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5387dbf4e24960809704c398fe999a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bedc0e10ab24824a40d06bb91626088', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:43:42.526684 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-501a592c-769e-4e14-a7c2-0e3f06a1c318 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] 10.222.0.43 "GET /compute/v2.1/servers/4c692055-b3f9-494b-9279-5a8453ed88ba" status: 200 len: 1341 microversion: 2.1 time: 0.620200 Oct 04 21:43:42.527760 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 95/178] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:43:41 2022] GET /compute/v2.1/servers/4c692055-b3f9-494b-9279-5a8453ed88ba => generated 1341 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:43:42.653419 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-df6607fc-1784-497b-b339-b309ebad70c3 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:42.653991 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-df6607fc-1784-497b-b339-b309ebad70c3 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] [instance: 4b0c3dd7-d609-4b00-8604-35f8a2680c14] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:43:42.661686 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-df6607fc-1784-497b-b339-b309ebad70c3 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:42.662753 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-df6607fc-1784-497b-b339-b309ebad70c3 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:42.662753 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-df6607fc-1784-497b-b339-b309ebad70c3 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:42.678954 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-df6607fc-1784-497b-b339-b309ebad70c3 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:42.679540 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-df6607fc-1784-497b-b339-b309ebad70c3 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:42.680021 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-df6607fc-1784-497b-b339-b309ebad70c3 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:42.915941 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-df6607fc-1784-497b-b339-b309ebad70c3 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29842a669a20408b881105135f76cb0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39edf587afe94b60911198aa0bb61613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:43:42.935283 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-df6607fc-1784-497b-b339-b309ebad70c3 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] 10.222.0.43 "GET /compute/v2.1/servers/4b0c3dd7-d609-4b00-8604-35f8a2680c14" status: 200 len: 1212 microversion: 2.1 time: 0.285245 Oct 04 21:43:42.938907 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 96/179] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:43:42 2022] GET /compute/v2.1/servers/4b0c3dd7-d609-4b00-8604-35f8a2680c14 => generated 1212 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:43:43.017783 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-c1057fde-0372-4d07-9836-34e3924ec7a1 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e00999a6faf349eea3be7680a855e8d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f306c099ef294f6da8637a8ddcdb46d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:43:43.034355 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-c1057fde-0372-4d07-9836-34e3924ec7a1 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] 10.222.0.43 "GET /compute/v2.1/servers/4ca5960d-4a64-4a04-a849-d53180a038e9" status: 200 len: 1338 microversion: 2.1 time: 0.632077 Oct 04 21:43:43.037309 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 84/180] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:43:42 2022] GET /compute/v2.1/servers/4ca5960d-4a64-4a04-a849-d53180a038e9 => generated 1338 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:43:43.553825 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-2cfab25b-27d7-4cf8-bd43-64183dd93339 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:43.555805 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-2cfab25b-27d7-4cf8-bd43-64183dd93339 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] [instance: 4c692055-b3f9-494b-9279-5a8453ed88ba] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:43:43.570035 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2cfab25b-27d7-4cf8-bd43-64183dd93339 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:43.570591 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2cfab25b-27d7-4cf8-bd43-64183dd93339 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:43.579064 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2cfab25b-27d7-4cf8-bd43-64183dd93339 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:43.580051 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2cfab25b-27d7-4cf8-bd43-64183dd93339 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:43.581511 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2cfab25b-27d7-4cf8-bd43-64183dd93339 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:43.583852 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2cfab25b-27d7-4cf8-bd43-64183dd93339 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:43.984261 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-57ea0760-c227-4e8d-9317-c1a6d856e39a tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:43.985920 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-57ea0760-c227-4e8d-9317-c1a6d856e39a tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] [instance: 4b0c3dd7-d609-4b00-8604-35f8a2680c14] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:43:44.010684 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-2cfab25b-27d7-4cf8-bd43-64183dd93339 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5387dbf4e24960809704c398fe999a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bedc0e10ab24824a40d06bb91626088', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:43:44.013669 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-57ea0760-c227-4e8d-9317-c1a6d856e39a tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:44.014513 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-57ea0760-c227-4e8d-9317-c1a6d856e39a tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:44.015351 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-57ea0760-c227-4e8d-9317-c1a6d856e39a tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:44.016289 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-57ea0760-c227-4e8d-9317-c1a6d856e39a tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:44.017086 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-57ea0760-c227-4e8d-9317-c1a6d856e39a tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:44.017772 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-57ea0760-c227-4e8d-9317-c1a6d856e39a tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:44.032316 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-2cfab25b-27d7-4cf8-bd43-64183dd93339 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] 10.222.0.43 "GET /compute/v2.1/servers/4c692055-b3f9-494b-9279-5a8453ed88ba" status: 200 len: 1341 microversion: 2.1 time: 0.475919 Oct 04 21:43:44.033236 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 97/181] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:43:43 2022] GET /compute/v2.1/servers/4c692055-b3f9-494b-9279-5a8453ed88ba => generated 1341 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:43:44.063108 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-4561bfaf-1fed-4147-ba65-91d31b3961c0 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:44.063888 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-4561bfaf-1fed-4147-ba65-91d31b3961c0 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] [instance: 4ca5960d-4a64-4a04-a849-d53180a038e9] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:43:44.081556 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4561bfaf-1fed-4147-ba65-91d31b3961c0 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:44.082055 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4561bfaf-1fed-4147-ba65-91d31b3961c0 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:44.083590 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4561bfaf-1fed-4147-ba65-91d31b3961c0 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:44.087669 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4561bfaf-1fed-4147-ba65-91d31b3961c0 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:44.088350 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4561bfaf-1fed-4147-ba65-91d31b3961c0 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:44.088938 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4561bfaf-1fed-4147-ba65-91d31b3961c0 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:44.512526 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-57ea0760-c227-4e8d-9317-c1a6d856e39a tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29842a669a20408b881105135f76cb0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39edf587afe94b60911198aa0bb61613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:43:44.544657 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-57ea0760-c227-4e8d-9317-c1a6d856e39a tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] 10.222.0.43 "GET /compute/v2.1/servers/4b0c3dd7-d609-4b00-8604-35f8a2680c14" status: 200 len: 1274 microversion: 2.1 time: 0.581190 Oct 04 21:43:44.546255 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 85/182] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:43:43 2022] GET /compute/v2.1/servers/4b0c3dd7-d609-4b00-8604-35f8a2680c14 => generated 1274 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:43:45.068314 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-b01fd745-983d-4704-aa2d-9995665a00ae tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:45.077158 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-b01fd745-983d-4704-aa2d-9995665a00ae tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] [instance: 4c692055-b3f9-494b-9279-5a8453ed88ba] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:43:45.115760 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b01fd745-983d-4704-aa2d-9995665a00ae tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:45.116805 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b01fd745-983d-4704-aa2d-9995665a00ae tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:45.117757 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b01fd745-983d-4704-aa2d-9995665a00ae tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:45.121995 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b01fd745-983d-4704-aa2d-9995665a00ae tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:45.123006 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b01fd745-983d-4704-aa2d-9995665a00ae tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:45.125234 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b01fd745-983d-4704-aa2d-9995665a00ae tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:45.481681 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-4561bfaf-1fed-4147-ba65-91d31b3961c0 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e00999a6faf349eea3be7680a855e8d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f306c099ef294f6da8637a8ddcdb46d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:43:45.496804 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-4561bfaf-1fed-4147-ba65-91d31b3961c0 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] 10.222.0.43 "GET /compute/v2.1/servers/4ca5960d-4a64-4a04-a849-d53180a038e9" status: 200 len: 1338 microversion: 2.1 time: 1.439296 Oct 04 21:43:45.515144 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 98/183] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:43:44 2022] GET /compute/v2.1/servers/4ca5960d-4a64-4a04-a849-d53180a038e9 => generated 1338 bytes in 1453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:43:45.895771 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-b01fd745-983d-4704-aa2d-9995665a00ae tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5387dbf4e24960809704c398fe999a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bedc0e10ab24824a40d06bb91626088', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:43:45.907635 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-b01fd745-983d-4704-aa2d-9995665a00ae tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] 10.222.0.43 "GET /compute/v2.1/servers/4c692055-b3f9-494b-9279-5a8453ed88ba" status: 200 len: 1341 microversion: 2.1 time: 0.853001 Oct 04 21:43:45.910061 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 86/184] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:43:45 2022] GET /compute/v2.1/servers/4c692055-b3f9-494b-9279-5a8453ed88ba => generated 1341 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:43:45.926731 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-db53174b-b8c8-4e69-9197-48eed47a3d95 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:45.927474 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-db53174b-b8c8-4e69-9197-48eed47a3d95 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] [instance: 4b0c3dd7-d609-4b00-8604-35f8a2680c14] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:43:45.937261 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-db53174b-b8c8-4e69-9197-48eed47a3d95 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:45.941209 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-db53174b-b8c8-4e69-9197-48eed47a3d95 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:45.941764 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-db53174b-b8c8-4e69-9197-48eed47a3d95 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:45.942994 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-db53174b-b8c8-4e69-9197-48eed47a3d95 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:45.943757 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-db53174b-b8c8-4e69-9197-48eed47a3d95 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:45.944471 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-db53174b-b8c8-4e69-9197-48eed47a3d95 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:46.133537 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-fdf41b7b-2f0b-4d70-b02c-7e089b12e9b9 req-2e02e3f2-0021-4bbd-bd12-333c4d112606 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ca5960d-4a64-4a04-a849-d53180a038e9", "tag": "a854dcbe-0256-4f2a-8a54-097e0782c576"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:43:46.154023 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-db53174b-b8c8-4e69-9197-48eed47a3d95 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29842a669a20408b881105135f76cb0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39edf587afe94b60911198aa0bb61613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:43:46.159932 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-fdf41b7b-2f0b-4d70-b02c-7e089b12e9b9 req-2e02e3f2-0021-4bbd-bd12-333c4d112606 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:46.163013 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-db53174b-b8c8-4e69-9197-48eed47a3d95 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] 10.222.0.43 "GET /compute/v2.1/servers/4b0c3dd7-d609-4b00-8604-35f8a2680c14" status: 200 len: 1274 microversion: 2.1 time: 0.251570 Oct 04 21:43:46.163614 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 87/185] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:43:45 2022] GET /compute/v2.1/servers/4b0c3dd7-d609-4b00-8604-35f8a2680c14 => generated 1274 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:43:46.166930 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-fdf41b7b-2f0b-4d70-b02c-7e089b12e9b9 req-2e02e3f2-0021-4bbd-bd12-333c4d112606 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:46.167619 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-fdf41b7b-2f0b-4d70-b02c-7e089b12e9b9 req-2e02e3f2-0021-4bbd-bd12-333c4d112606 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:46.216970 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-fdf41b7b-2f0b-4d70-b02c-7e089b12e9b9 req-2e02e3f2-0021-4bbd-bd12-333c4d112606 service nova] Creating event network-changed:a854dcbe-0256-4f2a-8a54-097e0782c576 for instance 4ca5960d-4a64-4a04-a849-d53180a038e9 on n-h1-860284-1 Oct 04 21:43:46.217503 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-fdf41b7b-2f0b-4d70-b02c-7e089b12e9b9 req-2e02e3f2-0021-4bbd-bd12-333c4d112606 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=134101) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 04 21:43:46.217900 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-fdf41b7b-2f0b-4d70-b02c-7e089b12e9b9 req-2e02e3f2-0021-4bbd-bd12-333c4d112606 service nova] Acquired lock "compute-rpcapi-router" {{(pid=134101) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 04 21:43:46.220460 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-aa6ae4c4-45c6-4cb1-bc8d-16ddc73c0335 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:46.221053 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-aa6ae4c4-45c6-4cb1-bc8d-16ddc73c0335 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:46.223212 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-aa6ae4c4-45c6-4cb1-bc8d-16ddc73c0335 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:46.225144 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-aa6ae4c4-45c6-4cb1-bc8d-16ddc73c0335 None None] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:46.225923 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-aa6ae4c4-45c6-4cb1-bc8d-16ddc73c0335 None None] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:46.227154 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-aa6ae4c4-45c6-4cb1-bc8d-16ddc73c0335 None None] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:46.262170 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.compute.rpcapi [None req-aa6ae4c4-45c6-4cb1-bc8d-16ddc73c0335 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 04 21:43:46.264092 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-aa6ae4c4-45c6-4cb1-bc8d-16ddc73c0335 None None] Releasing lock "compute-rpcapi-router" {{(pid=134101) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 04 21:43:46.292594 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-aa6ae4c4-45c6-4cb1-bc8d-16ddc73c0335 None None] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.744937 Oct 04 21:43:46.295173 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 99/186] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:43:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:43:46.522581 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-a34b2811-d72e-4af3-841d-63fccb6d8059 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:46.524715 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-a34b2811-d72e-4af3-841d-63fccb6d8059 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] [instance: 4ca5960d-4a64-4a04-a849-d53180a038e9] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:43:46.539896 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a34b2811-d72e-4af3-841d-63fccb6d8059 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:46.540784 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a34b2811-d72e-4af3-841d-63fccb6d8059 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:46.542110 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a34b2811-d72e-4af3-841d-63fccb6d8059 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:46.545469 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a34b2811-d72e-4af3-841d-63fccb6d8059 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:46.546220 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a34b2811-d72e-4af3-841d-63fccb6d8059 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:46.548281 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a34b2811-d72e-4af3-841d-63fccb6d8059 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:46.912321 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-a34b2811-d72e-4af3-841d-63fccb6d8059 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e00999a6faf349eea3be7680a855e8d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f306c099ef294f6da8637a8ddcdb46d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:43:46.922087 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-a34b2811-d72e-4af3-841d-63fccb6d8059 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] 10.222.0.43 "GET /compute/v2.1/servers/4ca5960d-4a64-4a04-a849-d53180a038e9" status: 200 len: 1338 microversion: 2.1 time: 0.403520 Oct 04 21:43:46.942286 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 88/187] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:43:46 2022] GET /compute/v2.1/servers/4ca5960d-4a64-4a04-a849-d53180a038e9 => generated 1338 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:43:46.954063 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-fa972503-5892-4d2f-b5b1-d363c93c6e36 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:46.957949 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-fa972503-5892-4d2f-b5b1-d363c93c6e36 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] [instance: 4c692055-b3f9-494b-9279-5a8453ed88ba] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:43:46.973769 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fa972503-5892-4d2f-b5b1-d363c93c6e36 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:46.974754 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fa972503-5892-4d2f-b5b1-d363c93c6e36 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:46.975425 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fa972503-5892-4d2f-b5b1-d363c93c6e36 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:46.976364 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fa972503-5892-4d2f-b5b1-d363c93c6e36 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:46.977386 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fa972503-5892-4d2f-b5b1-d363c93c6e36 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:46.978178 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fa972503-5892-4d2f-b5b1-d363c93c6e36 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:47.472520 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-fa972503-5892-4d2f-b5b1-d363c93c6e36 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5387dbf4e24960809704c398fe999a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bedc0e10ab24824a40d06bb91626088', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:43:47.486419 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-fa972503-5892-4d2f-b5b1-d363c93c6e36 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] 10.222.0.43 "GET /compute/v2.1/servers/4c692055-b3f9-494b-9279-5a8453ed88ba" status: 200 len: 1341 microversion: 2.1 time: 0.542401 Oct 04 21:43:47.488367 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 89/188] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:43:46 2022] GET /compute/v2.1/servers/4c692055-b3f9-494b-9279-5a8453ed88ba => generated 1341 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:43:47.489823 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-938317cc-b4f6-45c7-90e3-15c266b5a526 tempest-HypervisorAdminV253TestBase-1959040474 tempest-HypervisorAdminV253TestBase-1959040474-project-admin] Calling method '.version_select at 0x7fbb2f9e99d0>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:47.494559 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-938317cc-b4f6-45c7-90e3-15c266b5a526 tempest-HypervisorAdminV253TestBase-1959040474 tempest-HypervisorAdminV253TestBase-1959040474-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:47.497378 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-938317cc-b4f6-45c7-90e3-15c266b5a526 tempest-HypervisorAdminV253TestBase-1959040474 tempest-HypervisorAdminV253TestBase-1959040474-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:47.498622 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-938317cc-b4f6-45c7-90e3-15c266b5a526 tempest-HypervisorAdminV253TestBase-1959040474 tempest-HypervisorAdminV253TestBase-1959040474-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:47.509878 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-f30a334c-65fd-41f5-9960-a5dbb64a95f1 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:47.511627 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-f30a334c-65fd-41f5-9960-a5dbb64a95f1 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] [instance: 4b0c3dd7-d609-4b00-8604-35f8a2680c14] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:43:47.524006 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f30a334c-65fd-41f5-9960-a5dbb64a95f1 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:47.524849 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f30a334c-65fd-41f5-9960-a5dbb64a95f1 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:47.525567 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f30a334c-65fd-41f5-9960-a5dbb64a95f1 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:47.526592 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f30a334c-65fd-41f5-9960-a5dbb64a95f1 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:47.527242 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f30a334c-65fd-41f5-9960-a5dbb64a95f1 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:47.527841 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f30a334c-65fd-41f5-9960-a5dbb64a95f1 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:47.550038 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-938317cc-b4f6-45c7-90e3-15c266b5a526 tempest-HypervisorAdminV253TestBase-1959040474 tempest-HypervisorAdminV253TestBase-1959040474-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:47.551783 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-938317cc-b4f6-45c7-90e3-15c266b5a526 tempest-HypervisorAdminV253TestBase-1959040474 tempest-HypervisorAdminV253TestBase-1959040474-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:47.553781 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-938317cc-b4f6-45c7-90e3-15c266b5a526 tempest-HypervisorAdminV253TestBase-1959040474 tempest-HypervisorAdminV253TestBase-1959040474-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:47.626245 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-938317cc-b4f6-45c7-90e3-15c266b5a526 tempest-HypervisorAdminV253TestBase-1959040474 tempest-HypervisorAdminV253TestBase-1959040474-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:47.626876 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-938317cc-b4f6-45c7-90e3-15c266b5a526 tempest-HypervisorAdminV253TestBase-1959040474 tempest-HypervisorAdminV253TestBase-1959040474-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:47.627636 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-938317cc-b4f6-45c7-90e3-15c266b5a526 tempest-HypervisorAdminV253TestBase-1959040474 tempest-HypervisorAdminV253TestBase-1959040474-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:47.650952 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-938317cc-b4f6-45c7-90e3-15c266b5a526 tempest-HypervisorAdminV253TestBase-1959040474 tempest-HypervisorAdminV253TestBase-1959040474-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:47.651855 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-938317cc-b4f6-45c7-90e3-15c266b5a526 tempest-HypervisorAdminV253TestBase-1959040474 tempest-HypervisorAdminV253TestBase-1959040474-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:47.652437 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-938317cc-b4f6-45c7-90e3-15c266b5a526 tempest-HypervisorAdminV253TestBase-1959040474 tempest-HypervisorAdminV253TestBase-1959040474-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:47.689032 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-938317cc-b4f6-45c7-90e3-15c266b5a526 tempest-HypervisorAdminV253TestBase-1959040474 tempest-HypervisorAdminV253TestBase-1959040474-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:47.689868 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-938317cc-b4f6-45c7-90e3-15c266b5a526 tempest-HypervisorAdminV253TestBase-1959040474 tempest-HypervisorAdminV253TestBase-1959040474-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:47.698255 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-938317cc-b4f6-45c7-90e3-15c266b5a526 tempest-HypervisorAdminV253TestBase-1959040474 tempest-HypervisorAdminV253TestBase-1959040474-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:47.713555 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-938317cc-b4f6-45c7-90e3-15c266b5a526 tempest-HypervisorAdminV253TestBase-1959040474 tempest-HypervisorAdminV253TestBase-1959040474-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 1836 microversion: 2.53 time: 0.979723 Oct 04 21:43:47.726499 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 100/189] 10.222.0.43 () {60 vars in 1243 bytes} [Tue Oct 4 21:43:46 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 1836 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:43:47.734580 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-3439fd4c-cb5e-4e50-971c-2ceb221b05f4 tempest-HypervisorAdminV253TestBase-1959040474 tempest-HypervisorAdminV253TestBase-1959040474-project-admin] Calling method '.version_select at 0x7fbb2f9e9ee0>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:47.739200 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3439fd4c-cb5e-4e50-971c-2ceb221b05f4 tempest-HypervisorAdminV253TestBase-1959040474 tempest-HypervisorAdminV253TestBase-1959040474-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:47.740017 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3439fd4c-cb5e-4e50-971c-2ceb221b05f4 tempest-HypervisorAdminV253TestBase-1959040474 tempest-HypervisorAdminV253TestBase-1959040474-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:47.741063 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3439fd4c-cb5e-4e50-971c-2ceb221b05f4 tempest-HypervisorAdminV253TestBase-1959040474 tempest-HypervisorAdminV253TestBase-1959040474-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:47.766319 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3439fd4c-cb5e-4e50-971c-2ceb221b05f4 tempest-HypervisorAdminV253TestBase-1959040474 tempest-HypervisorAdminV253TestBase-1959040474-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:47.766842 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3439fd4c-cb5e-4e50-971c-2ceb221b05f4 tempest-HypervisorAdminV253TestBase-1959040474 tempest-HypervisorAdminV253TestBase-1959040474-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:47.767281 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3439fd4c-cb5e-4e50-971c-2ceb221b05f4 tempest-HypervisorAdminV253TestBase-1959040474 tempest-HypervisorAdminV253TestBase-1959040474-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:47.803171 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3439fd4c-cb5e-4e50-971c-2ceb221b05f4 tempest-HypervisorAdminV253TestBase-1959040474 tempest-HypervisorAdminV253TestBase-1959040474-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:47.803652 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3439fd4c-cb5e-4e50-971c-2ceb221b05f4 tempest-HypervisorAdminV253TestBase-1959040474 tempest-HypervisorAdminV253TestBase-1959040474-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:47.804459 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3439fd4c-cb5e-4e50-971c-2ceb221b05f4 tempest-HypervisorAdminV253TestBase-1959040474 tempest-HypervisorAdminV253TestBase-1959040474-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:47.814308 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=100 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:43:47.826502 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3439fd4c-cb5e-4e50-971c-2ceb221b05f4 tempest-HypervisorAdminV253TestBase-1959040474 tempest-HypervisorAdminV253TestBase-1959040474-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:47.827227 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3439fd4c-cb5e-4e50-971c-2ceb221b05f4 tempest-HypervisorAdminV253TestBase-1959040474 tempest-HypervisorAdminV253TestBase-1959040474-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:47.827791 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3439fd4c-cb5e-4e50-971c-2ceb221b05f4 tempest-HypervisorAdminV253TestBase-1959040474 tempest-HypervisorAdminV253TestBase-1959040474-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:47.863758 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=3,nova_api:DELETE=8 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:43:47.868254 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3439fd4c-cb5e-4e50-971c-2ceb221b05f4 tempest-HypervisorAdminV253TestBase-1959040474 tempest-HypervisorAdminV253TestBase-1959040474-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:47.869049 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3439fd4c-cb5e-4e50-971c-2ceb221b05f4 tempest-HypervisorAdminV253TestBase-1959040474 tempest-HypervisorAdminV253TestBase-1959040474-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:47.869565 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3439fd4c-cb5e-4e50-971c-2ceb221b05f4 tempest-HypervisorAdminV253TestBase-1959040474 tempest-HypervisorAdminV253TestBase-1959040474-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:47.882107 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-3439fd4c-cb5e-4e50-971c-2ceb221b05f4 tempest-HypervisorAdminV253TestBase-1959040474 tempest-HypervisorAdminV253TestBase-1959040474-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 528 microversion: 2.53 time: 0.152421 Oct 04 21:43:47.883334 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 101/190] 10.222.0.43 () {60 vars in 1222 bytes} [Tue Oct 4 21:43:47 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 528 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 21:43:47.897827 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-a59a4db1-30ad-4d1d-9d91-cd0d3b611e53 tempest-HypervisorAdminV253TestBase-1959040474 tempest-HypervisorAdminV253TestBase-1959040474-project-admin] Calling method '.version_select at 0x7fbb2fa17430>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:47.902256 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a59a4db1-30ad-4d1d-9d91-cd0d3b611e53 tempest-HypervisorAdminV253TestBase-1959040474 tempest-HypervisorAdminV253TestBase-1959040474-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:47.903549 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a59a4db1-30ad-4d1d-9d91-cd0d3b611e53 tempest-HypervisorAdminV253TestBase-1959040474 tempest-HypervisorAdminV253TestBase-1959040474-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:47.904238 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a59a4db1-30ad-4d1d-9d91-cd0d3b611e53 tempest-HypervisorAdminV253TestBase-1959040474 tempest-HypervisorAdminV253TestBase-1959040474-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:47.928867 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a59a4db1-30ad-4d1d-9d91-cd0d3b611e53 tempest-HypervisorAdminV253TestBase-1959040474 tempest-HypervisorAdminV253TestBase-1959040474-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:47.929437 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a59a4db1-30ad-4d1d-9d91-cd0d3b611e53 tempest-HypervisorAdminV253TestBase-1959040474 tempest-HypervisorAdminV253TestBase-1959040474-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:47.930766 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a59a4db1-30ad-4d1d-9d91-cd0d3b611e53 tempest-HypervisorAdminV253TestBase-1959040474 tempest-HypervisorAdminV253TestBase-1959040474-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:47.945673 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-a59a4db1-30ad-4d1d-9d91-cd0d3b611e53 tempest-HypervisorAdminV253TestBase-1959040474 tempest-HypervisorAdminV253TestBase-1959040474-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hypervisors/aa2c76bb-f54d-4be6-9e76-2129cc2bfb45" status: 200 len: 792 microversion: 2.53 time: 0.051421 Oct 04 21:43:47.946983 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 102/191] 10.222.0.43 () {60 vars in 1298 bytes} [Tue Oct 4 21:43:47 2022] GET /compute/v2.1/os-hypervisors/aa2c76bb-f54d-4be6-9e76-2129cc2bfb45 => generated 792 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:43:47.956340 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-20e413b7-4467-40b3-843c-251708d5eecf tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:47.957405 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-20e413b7-4467-40b3-843c-251708d5eecf tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] [instance: 4ca5960d-4a64-4a04-a849-d53180a038e9] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:43:47.966350 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-20e413b7-4467-40b3-843c-251708d5eecf tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:47.967264 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-20e413b7-4467-40b3-843c-251708d5eecf tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:47.967988 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-20e413b7-4467-40b3-843c-251708d5eecf tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:47.968908 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-20e413b7-4467-40b3-843c-251708d5eecf tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:47.969567 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-20e413b7-4467-40b3-843c-251708d5eecf tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:47.970421 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-20e413b7-4467-40b3-843c-251708d5eecf tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:48.108461 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-f30a334c-65fd-41f5-9960-a5dbb64a95f1 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29842a669a20408b881105135f76cb0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39edf587afe94b60911198aa0bb61613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:43:48.134102 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-f30a334c-65fd-41f5-9960-a5dbb64a95f1 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] 10.222.0.43 "GET /compute/v2.1/servers/4b0c3dd7-d609-4b00-8604-35f8a2680c14" status: 200 len: 1316 microversion: 2.1 time: 0.638902 Oct 04 21:43:48.135930 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 90/192] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:43:47 2022] GET /compute/v2.1/servers/4b0c3dd7-d609-4b00-8604-35f8a2680c14 => generated 1316 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:43:48.257556 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-20e413b7-4467-40b3-843c-251708d5eecf tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e00999a6faf349eea3be7680a855e8d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f306c099ef294f6da8637a8ddcdb46d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:43:48.277234 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-20e413b7-4467-40b3-843c-251708d5eecf tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] 10.222.0.43 "GET /compute/v2.1/servers/4ca5960d-4a64-4a04-a849-d53180a038e9" status: 200 len: 1338 microversion: 2.1 time: 0.328427 Oct 04 21:43:48.295368 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 103/193] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:43:47 2022] GET /compute/v2.1/servers/4ca5960d-4a64-4a04-a849-d53180a038e9 => generated 1338 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:43:48.516612 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-1b44455a-e7db-4c7c-8ee5-9ac9fef2bac1 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:48.517451 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-1b44455a-e7db-4c7c-8ee5-9ac9fef2bac1 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] [instance: 4c692055-b3f9-494b-9279-5a8453ed88ba] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:43:48.520754 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=45,nova_cell0:UPDATE=7 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:43:48.537047 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1b44455a-e7db-4c7c-8ee5-9ac9fef2bac1 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:48.537730 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1b44455a-e7db-4c7c-8ee5-9ac9fef2bac1 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:48.545945 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1b44455a-e7db-4c7c-8ee5-9ac9fef2bac1 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:48.545945 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1b44455a-e7db-4c7c-8ee5-9ac9fef2bac1 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:48.545945 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1b44455a-e7db-4c7c-8ee5-9ac9fef2bac1 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:48.545945 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1b44455a-e7db-4c7c-8ee5-9ac9fef2bac1 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:48.893582 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-1b44455a-e7db-4c7c-8ee5-9ac9fef2bac1 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5387dbf4e24960809704c398fe999a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bedc0e10ab24824a40d06bb91626088', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:43:48.902218 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-1b44455a-e7db-4c7c-8ee5-9ac9fef2bac1 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] 10.222.0.43 "GET /compute/v2.1/servers/4c692055-b3f9-494b-9279-5a8453ed88ba" status: 200 len: 1341 microversion: 2.1 time: 0.390524 Oct 04 21:43:48.904307 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 104/194] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:43:48 2022] GET /compute/v2.1/servers/4c692055-b3f9-494b-9279-5a8453ed88ba => generated 1341 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:43:48.974927 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-4780898d-1d8a-44d2-8c74-d0e36d3c65f3 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-2090071231", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452"}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:43:49.062610 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.network.neutron [None req-4780898d-1d8a-44d2-8c74-d0e36d3c65f3 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] validate_networks() for None {{(pid=134102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:43:49.157733 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-067aa01d-befd-40cd-bf42-83ccfe15e9f3 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:49.161016 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-067aa01d-befd-40cd-bf42-83ccfe15e9f3 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] [instance: 4b0c3dd7-d609-4b00-8604-35f8a2680c14] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:43:49.178275 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-067aa01d-befd-40cd-bf42-83ccfe15e9f3 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:49.179199 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-067aa01d-befd-40cd-bf42-83ccfe15e9f3 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:49.180186 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-067aa01d-befd-40cd-bf42-83ccfe15e9f3 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:49.181162 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-067aa01d-befd-40cd-bf42-83ccfe15e9f3 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:49.181855 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-067aa01d-befd-40cd-bf42-83ccfe15e9f3 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:49.182562 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-067aa01d-befd-40cd-bf42-83ccfe15e9f3 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:49.566103 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-067aa01d-befd-40cd-bf42-83ccfe15e9f3 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29842a669a20408b881105135f76cb0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39edf587afe94b60911198aa0bb61613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:43:49.576150 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-067aa01d-befd-40cd-bf42-83ccfe15e9f3 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] 10.222.0.43 "GET /compute/v2.1/servers/4b0c3dd7-d609-4b00-8604-35f8a2680c14" status: 200 len: 1316 microversion: 2.1 time: 0.423319 Oct 04 21:43:49.586601 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 105/195] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:43:49 2022] GET /compute/v2.1/servers/4b0c3dd7-d609-4b00-8604-35f8a2680c14 => generated 1316 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:43:49.591350 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-60f98277-8e36-4320-9219-da7b69ebb5c9 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:49.591970 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-60f98277-8e36-4320-9219-da7b69ebb5c9 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] [instance: 4ca5960d-4a64-4a04-a849-d53180a038e9] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:43:49.598572 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-60f98277-8e36-4320-9219-da7b69ebb5c9 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:49.599067 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-60f98277-8e36-4320-9219-da7b69ebb5c9 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:49.599500 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-60f98277-8e36-4320-9219-da7b69ebb5c9 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:49.600458 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-60f98277-8e36-4320-9219-da7b69ebb5c9 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:49.600804 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-60f98277-8e36-4320-9219-da7b69ebb5c9 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:49.601206 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-60f98277-8e36-4320-9219-da7b69ebb5c9 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:49.662897 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-4780898d-1d8a-44d2-8c74-d0e36d3c65f3 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Flavor limits 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:43:49.663522 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-4780898d-1d8a-44d2-8c74-d0e36d3c65f3 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Image limits 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:43:49.664246 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-4780898d-1d8a-44d2-8c74-d0e36d3c65f3 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Flavor pref 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:43:49.665398 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-4780898d-1d8a-44d2-8c74-d0e36d3c65f3 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Image pref 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:43:49.666122 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-4780898d-1d8a-44d2-8c74-d0e36d3c65f3 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:43:49.685294 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4780898d-1d8a-44d2-8c74-d0e36d3c65f3 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:49.686178 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4780898d-1d8a-44d2-8c74-d0e36d3c65f3 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:49.686981 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4780898d-1d8a-44d2-8c74-d0e36d3c65f3 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:49.688385 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4780898d-1d8a-44d2-8c74-d0e36d3c65f3 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:49.689066 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4780898d-1d8a-44d2-8c74-d0e36d3c65f3 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:49.689737 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4780898d-1d8a-44d2-8c74-d0e36d3c65f3 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:49.702969 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell0:SELECT=13 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:43:49.721298 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-4780898d-1d8a-44d2-8c74-d0e36d3c65f3 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Getting quotas for project 1ad1554e318e45f78a2bc5e148d0c39f. Resources: {'instances', 'ram', 'cores'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:43:49.727894 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-4780898d-1d8a-44d2-8c74-d0e36d3c65f3 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Getting quotas for user ff4e089659884b6d9197141ba9f14f57 and project 1ad1554e318e45f78a2bc5e148d0c39f. Resources: {'instances', 'ram', 'cores'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:43:49.758946 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-4780898d-1d8a-44d2-8c74-d0e36d3c65f3 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Going to run 1 instances... {{(pid=134102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:43:49.761622 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-4780898d-1d8a-44d2-8c74-d0e36d3c65f3 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: ec437ce7-b43a-4c8b-8a06-756cfb877851] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='58548514-5dac-426c-81f5-19e3fba33e23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:43:49.836802 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-4780898d-1d8a-44d2-8c74-d0e36d3c65f3 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.412808 Oct 04 21:43:49.838700 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 91/196] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 21:43:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 1417 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:43:49.957921 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-60f98277-8e36-4320-9219-da7b69ebb5c9 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e00999a6faf349eea3be7680a855e8d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f306c099ef294f6da8637a8ddcdb46d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:43:49.970983 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-60f98277-8e36-4320-9219-da7b69ebb5c9 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] 10.222.0.43 "GET /compute/v2.1/servers/4ca5960d-4a64-4a04-a849-d53180a038e9" status: 200 len: 1338 microversion: 2.1 time: 0.390301 Oct 04 21:43:49.976482 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 106/197] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:43:49 2022] GET /compute/v2.1/servers/4ca5960d-4a64-4a04-a849-d53180a038e9 => generated 1338 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:43:49.982214 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e87128c1-3a80-46b6-a55e-410888ae5ecc tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:49.986424 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-e87128c1-3a80-46b6-a55e-410888ae5ecc tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: ec437ce7-b43a-4c8b-8a06-756cfb877851] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:43:50.146150 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-e87128c1-3a80-46b6-a55e-410888ae5ecc tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:43:50.159533 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-e87128c1-3a80-46b6-a55e-410888ae5ecc tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/ec437ce7-b43a-4c8b-8a06-756cfb877851" status: 200 len: 1213 microversion: 2.1 time: 0.175618 Oct 04 21:43:50.175008 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 107/198] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:43:49 2022] GET /compute/v2.1/servers/ec437ce7-b43a-4c8b-8a06-756cfb877851 => generated 1213 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:43:50.192293 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-1c5458b8-081d-42f1-96fe-4a6db205ecf3 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:50.194846 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-1c5458b8-081d-42f1-96fe-4a6db205ecf3 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] [instance: 4c692055-b3f9-494b-9279-5a8453ed88ba] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:43:50.208399 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1c5458b8-081d-42f1-96fe-4a6db205ecf3 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:50.208932 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1c5458b8-081d-42f1-96fe-4a6db205ecf3 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:50.209320 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1c5458b8-081d-42f1-96fe-4a6db205ecf3 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:50.214147 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1c5458b8-081d-42f1-96fe-4a6db205ecf3 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:50.215994 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1c5458b8-081d-42f1-96fe-4a6db205ecf3 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:50.216349 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1c5458b8-081d-42f1-96fe-4a6db205ecf3 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:50.421281 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-24db7776-94b8-4da9-a52e-541e6a0cae61 tempest-HypervisorAdminNegativeTestJSON-2049143979 tempest-HypervisorAdminNegativeTestJSON-2049143979-project] Calling method '.version_select at 0x7fbb2fc77ee0>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:50.426886 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-24db7776-94b8-4da9-a52e-541e6a0cae61 tempest-HypervisorAdminNegativeTestJSON-2049143979 tempest-HypervisorAdminNegativeTestJSON-2049143979-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': 'd0f3c24a5c694f179c0194366397acfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '969e94a5d5d647ceb155eea8671ec20f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:43:50.434120 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-24db7776-94b8-4da9-a52e-541e6a0cae61 tempest-HypervisorAdminNegativeTestJSON-2049143979 tempest-HypervisorAdminNegativeTestJSON-2049143979-project] Request method failure captured: Oct 04 21:43:50.434120 n-d-860284-1 devstack@n-api.service[134102]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 Oct 04 21:43:50.434120 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 21:43:50.434120 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 21:43:50.434120 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 21:43:50.434120 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 21:43:50.434120 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 21:43:50.434120 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 21:43:50.434120 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 21:43:50.434120 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 21:43:50.434120 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPKkThpUTFI0MdBRvfgz1XgokNDfTWnNRFNZ-zkUTr8qWk-hVwqCvvaBXRiXc8xzzv6M3ikKdYgHgPB1Lh5b4hd0SXWDX-uxsjI07ZMmQ4JHocptXId5DrCM6d1j9am1t_mhxUfW4ihvgF3eonga5G8YiNgOk0WQrYZzP41W7crFFJmU Oct 04 21:43:50.434120 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 21:43:50.434120 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 21:43:50.434120 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 21:43:50.434120 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 21:43:50.434120 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 21:43:50.434120 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 21:43:50.434120 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: 969e94a5d5d647ceb155eea8671ec20f Oct 04 21:43:50.434120 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-2049143979 Oct 04 21:43:50.434120 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 21:43:50.434120 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 21:43:50.435491 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/969e94a5d5d647ceb155eea8671ec20f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_969e94a5d5d647ceb155eea8671ec20f", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/969e94a5d5d647ceb155eea8671ec20f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/969e94a5d5d647ceb155eea8671ec20f"}]}] Oct 04 21:43:50.435491 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-2049143979 Oct 04 21:43:50.435491 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: 969e94a5d5d647ceb155eea8671ec20f Oct 04 21:43:50.435491 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-2049143979 Oct 04 21:43:50.435491 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-HypervisorAdminNegativeTestJSON-2049143979-project Oct 04 21:43:50.435491 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 21:43:50.435491 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 21:43:50.435491 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: d0f3c24a5c694f179c0194366397acfd Oct 04 21:43:50.435491 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-2049143979-project Oct 04 21:43:50.435491 n-d-860284-1 devstack@n-api.service[134102]: method: Oct 04 21:43:50.435491 n-d-860284-1 devstack@n-api.service[134102]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 04 21:43:50.435491 n-d-860284-1 devstack@n-api.service[134102]: action_args: {} Oct 04 21:43:50.435491 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:43:50.436256 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:43:50.436256 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:43:50.436256 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:43:50.436256 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:43:50.436256 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:43:50.436256 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:43:50.436256 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:43:50.436256 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:43:50.436256 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:43:50.436256 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail Oct 04 21:43:50.436256 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return self._detail(req) Oct 04 21:43:50.436256 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail Oct 04 21:43:50.436256 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) Oct 04 21:43:50.436256 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 21:43:50.436256 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 21:43:50.436256 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 21:43:50.436256 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 21:43:50.436256 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 21:43:50.436256 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 21:43:50.437450 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 21:43:50.437450 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 21:43:50.437450 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 21:43:50.437450 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 21:43:50.437450 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 21:43:50.437450 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 21:43:50.437450 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 21:43:50.437450 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 21:43:50.437450 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 04 21:43:50.437450 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:43:50.437450 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:43:50.437450 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:43:50.437450 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:43:50.437450 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:43:50.437450 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:43:50.437450 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 21:43:50.437450 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 21:43:50.437450 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 04 21:43:50.437450 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:43:50.444724 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-24db7776-94b8-4da9-a52e-541e6a0cae61 tempest-HypervisorAdminNegativeTestJSON-2049143979 tempest-HypervisorAdminNegativeTestJSON-2049143979-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:43:50.446978 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-24db7776-94b8-4da9-a52e-541e6a0cae61 tempest-HypervisorAdminNegativeTestJSON-2049143979 tempest-HypervisorAdminNegativeTestJSON-2049143979-project] 10.222.0.43 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.604098 Oct 04 21:43:50.448719 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 92/199] 10.222.0.43 () {58 vars in 1167 bytes} [Tue Oct 4 21:43:49 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 609 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:43:50.467477 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-a8729935-3ee0-45d2-9ce5-a9a7aafb0f5b tempest-HypervisorAdminNegativeTestJSON-2049143979 tempest-HypervisorAdminNegativeTestJSON-2049143979-project] Calling method '.version_select at 0x7fbb2feec040>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:50.475499 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-a8729935-3ee0-45d2-9ce5-a9a7aafb0f5b tempest-HypervisorAdminNegativeTestJSON-2049143979 tempest-HypervisorAdminNegativeTestJSON-2049143979-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': 'd0f3c24a5c694f179c0194366397acfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '969e94a5d5d647ceb155eea8671ec20f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:43:50.480229 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-a8729935-3ee0-45d2-9ce5-a9a7aafb0f5b tempest-HypervisorAdminNegativeTestJSON-2049143979 tempest-HypervisorAdminNegativeTestJSON-2049143979-project] Request method failure captured: Oct 04 21:43:50.480229 n-d-860284-1 devstack@n-api.service[134102]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 Oct 04 21:43:50.480229 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 21:43:50.480229 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 21:43:50.480229 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 21:43:50.480229 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 21:43:50.480229 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 21:43:50.480229 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 21:43:50.480229 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 21:43:50.480229 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 21:43:50.480229 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPKkThpUTFI0MdBRvfgz1XgokNDfTWnNRFNZ-zkUTr8qWk-hVwqCvvaBXRiXc8xzzv6M3ikKdYgHgPB1Lh5b4hd0SXWDX-uxsjI07ZMmQ4JHocptXId5DrCM6d1j9am1t_mhxUfW4ihvgF3eonga5G8YiNgOk0WQrYZzP41W7crFFJmU Oct 04 21:43:50.480229 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 21:43:50.480229 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 21:43:50.480229 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 21:43:50.480229 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 21:43:50.480229 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 21:43:50.480229 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 21:43:50.480229 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: 969e94a5d5d647ceb155eea8671ec20f Oct 04 21:43:50.480229 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-2049143979 Oct 04 21:43:50.480229 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 21:43:50.480229 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 21:43:50.481408 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/969e94a5d5d647ceb155eea8671ec20f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_969e94a5d5d647ceb155eea8671ec20f", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/969e94a5d5d647ceb155eea8671ec20f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/969e94a5d5d647ceb155eea8671ec20f"}]}] Oct 04 21:43:50.481408 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-2049143979 Oct 04 21:43:50.481408 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: 969e94a5d5d647ceb155eea8671ec20f Oct 04 21:43:50.481408 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-2049143979 Oct 04 21:43:50.481408 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-HypervisorAdminNegativeTestJSON-2049143979-project Oct 04 21:43:50.481408 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 21:43:50.481408 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 21:43:50.481408 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: d0f3c24a5c694f179c0194366397acfd Oct 04 21:43:50.481408 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-2049143979-project Oct 04 21:43:50.481408 n-d-860284-1 devstack@n-api.service[134102]: method: Oct 04 21:43:50.481408 n-d-860284-1 devstack@n-api.service[134102]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 04 21:43:50.481408 n-d-860284-1 devstack@n-api.service[134102]: action_args: {} Oct 04 21:43:50.481408 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:43:50.482081 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:43:50.482081 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:43:50.482081 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:43:50.482081 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:43:50.482081 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:43:50.482081 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:43:50.482081 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:43:50.482081 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:43:50.482081 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:43:50.482081 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index Oct 04 21:43:50.482081 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return self._index(req) Oct 04 21:43:50.482081 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index Oct 04 21:43:50.482081 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) Oct 04 21:43:50.482081 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 21:43:50.482081 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 21:43:50.482081 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 21:43:50.482081 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 21:43:50.482081 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 21:43:50.482081 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 21:43:50.483100 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 21:43:50.483100 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 21:43:50.483100 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 21:43:50.483100 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 21:43:50.483100 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 21:43:50.483100 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 21:43:50.483100 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 21:43:50.483100 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 21:43:50.483100 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 04 21:43:50.483100 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:43:50.483100 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:43:50.483100 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:43:50.483100 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:43:50.483100 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:43:50.483100 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:43:50.483100 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 21:43:50.483100 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 21:43:50.483100 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 04 21:43:50.483100 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:43:50.484070 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-a8729935-3ee0-45d2-9ce5-a9a7aafb0f5b tempest-HypervisorAdminNegativeTestJSON-2049143979 tempest-HypervisorAdminNegativeTestJSON-2049143979-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:43:50.486175 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-a8729935-3ee0-45d2-9ce5-a9a7aafb0f5b tempest-HypervisorAdminNegativeTestJSON-2049143979 tempest-HypervisorAdminNegativeTestJSON-2049143979-project] 10.222.0.43 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.029416 Oct 04 21:43:50.495092 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 93/200] 10.222.0.43 () {58 vars in 1146 bytes} [Tue Oct 4 21:43:50 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 39 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:43:50.502694 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-7cdec986-e6e1-49da-aed2-aa728bf1bc78 tempest-HypervisorAdminNegativeTestJSON-2049143979 tempest-HypervisorAdminNegativeTestJSON-2049143979-project] Calling method '.version_select at 0x7fbb2fcf0af0>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:50.511001 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-7cdec986-e6e1-49da-aed2-aa728bf1bc78 tempest-HypervisorAdminNegativeTestJSON-2049143979 tempest-HypervisorAdminNegativeTestJSON-2049143979-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': 'd0f3c24a5c694f179c0194366397acfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '969e94a5d5d647ceb155eea8671ec20f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:43:50.513007 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-1c5458b8-081d-42f1-96fe-4a6db205ecf3 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5387dbf4e24960809704c398fe999a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bedc0e10ab24824a40d06bb91626088', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:43:50.517100 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-7cdec986-e6e1-49da-aed2-aa728bf1bc78 tempest-HypervisorAdminNegativeTestJSON-2049143979 tempest-HypervisorAdminNegativeTestJSON-2049143979-project] Request method failure captured: Oct 04 21:43:50.517100 n-d-860284-1 devstack@n-api.service[134102]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 Oct 04 21:43:50.517100 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 21:43:50.517100 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 21:43:50.517100 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 21:43:50.517100 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 21:43:50.517100 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 21:43:50.517100 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 21:43:50.517100 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 21:43:50.517100 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 21:43:50.517100 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPKkThpUTFI0MdBRvfgz1XgokNDfTWnNRFNZ-zkUTr8qWk-hVwqCvvaBXRiXc8xzzv6M3ikKdYgHgPB1Lh5b4hd0SXWDX-uxsjI07ZMmQ4JHocptXId5DrCM6d1j9am1t_mhxUfW4ihvgF3eonga5G8YiNgOk0WQrYZzP41W7crFFJmU Oct 04 21:43:50.517100 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 21:43:50.517100 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 21:43:50.517100 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 21:43:50.517100 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 21:43:50.517100 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 21:43:50.517100 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 21:43:50.517100 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: 969e94a5d5d647ceb155eea8671ec20f Oct 04 21:43:50.517100 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-2049143979 Oct 04 21:43:50.517100 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 21:43:50.517100 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 21:43:50.518583 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/969e94a5d5d647ceb155eea8671ec20f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_969e94a5d5d647ceb155eea8671ec20f", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/969e94a5d5d647ceb155eea8671ec20f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/969e94a5d5d647ceb155eea8671ec20f"}]}] Oct 04 21:43:50.518583 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-2049143979 Oct 04 21:43:50.518583 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: 969e94a5d5d647ceb155eea8671ec20f Oct 04 21:43:50.518583 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-2049143979 Oct 04 21:43:50.518583 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-HypervisorAdminNegativeTestJSON-2049143979-project Oct 04 21:43:50.518583 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 21:43:50.518583 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 21:43:50.518583 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: d0f3c24a5c694f179c0194366397acfd Oct 04 21:43:50.518583 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-2049143979-project Oct 04 21:43:50.518583 n-d-860284-1 devstack@n-api.service[134102]: method: Oct 04 21:43:50.518583 n-d-860284-1 devstack@n-api.service[134102]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 04 21:43:50.518583 n-d-860284-1 devstack@n-api.service[134102]: action_args: {} Oct 04 21:43:50.518583 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:43:50.519389 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:43:50.519389 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:43:50.519389 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:43:50.519389 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:43:50.519389 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:43:50.519389 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:43:50.519389 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:43:50.519389 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:43:50.519389 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:43:50.519389 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics Oct 04 21:43:50.519389 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) Oct 04 21:43:50.519389 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 21:43:50.519389 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 21:43:50.519389 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 21:43:50.519389 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 21:43:50.519389 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 21:43:50.519389 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 21:43:50.519389 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 21:43:50.519389 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 21:43:50.520776 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 21:43:50.520776 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 21:43:50.520776 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 21:43:50.520776 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 21:43:50.520776 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 21:43:50.520776 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 21:43:50.520776 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 04 21:43:50.520776 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:43:50.520776 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:43:50.520776 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:43:50.520776 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:43:50.520776 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:43:50.520776 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:43:50.520776 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 21:43:50.520776 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 21:43:50.520776 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 04 21:43:50.520776 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:43:50.521926 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-7cdec986-e6e1-49da-aed2-aa728bf1bc78 tempest-HypervisorAdminNegativeTestJSON-2049143979 tempest-HypervisorAdminNegativeTestJSON-2049143979-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:43:50.521926 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-7cdec986-e6e1-49da-aed2-aa728bf1bc78 tempest-HypervisorAdminNegativeTestJSON-2049143979 tempest-HypervisorAdminNegativeTestJSON-2049143979-project] 10.222.0.43 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.022165 Oct 04 21:43:50.525451 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 94/201] 10.222.0.43 () {58 vars in 1179 bytes} [Tue Oct 4 21:43:50 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 30 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:43:50.526242 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-1c5458b8-081d-42f1-96fe-4a6db205ecf3 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] 10.222.0.43 "GET /compute/v2.1/servers/4c692055-b3f9-494b-9279-5a8453ed88ba" status: 200 len: 1341 microversion: 2.1 time: 0.348898 Oct 04 21:43:50.527223 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 108/202] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:43:50 2022] GET /compute/v2.1/servers/4c692055-b3f9-494b-9279-5a8453ed88ba => generated 1341 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:43:50.607225 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-dccb85c0-d3b3-4294-b7d7-556825c4446a tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:50.607878 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-dccb85c0-d3b3-4294-b7d7-556825c4446a tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] [instance: 4b0c3dd7-d609-4b00-8604-35f8a2680c14] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:43:50.615447 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dccb85c0-d3b3-4294-b7d7-556825c4446a tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:50.616317 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dccb85c0-d3b3-4294-b7d7-556825c4446a tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:50.617991 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dccb85c0-d3b3-4294-b7d7-556825c4446a tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:50.619118 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dccb85c0-d3b3-4294-b7d7-556825c4446a tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:50.620048 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dccb85c0-d3b3-4294-b7d7-556825c4446a tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:50.620681 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dccb85c0-d3b3-4294-b7d7-556825c4446a tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:50.782698 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-f513f9f7-e8fd-402f-ad96-12a8d0df7ba3 tempest-HypervisorAdminNegativeTestJSON-1575896621 tempest-HypervisorAdminNegativeTestJSON-1575896621-project-admin] Calling method '.version_select at 0x7fbb2fc00b80>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:50.785781 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f513f9f7-e8fd-402f-ad96-12a8d0df7ba3 tempest-HypervisorAdminNegativeTestJSON-1575896621 tempest-HypervisorAdminNegativeTestJSON-1575896621-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:50.787502 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f513f9f7-e8fd-402f-ad96-12a8d0df7ba3 tempest-HypervisorAdminNegativeTestJSON-1575896621 tempest-HypervisorAdminNegativeTestJSON-1575896621-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:50.788500 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f513f9f7-e8fd-402f-ad96-12a8d0df7ba3 tempest-HypervisorAdminNegativeTestJSON-1575896621 tempest-HypervisorAdminNegativeTestJSON-1575896621-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:50.832089 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f513f9f7-e8fd-402f-ad96-12a8d0df7ba3 tempest-HypervisorAdminNegativeTestJSON-1575896621 tempest-HypervisorAdminNegativeTestJSON-1575896621-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:50.832601 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f513f9f7-e8fd-402f-ad96-12a8d0df7ba3 tempest-HypervisorAdminNegativeTestJSON-1575896621 tempest-HypervisorAdminNegativeTestJSON-1575896621-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:50.833049 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f513f9f7-e8fd-402f-ad96-12a8d0df7ba3 tempest-HypervisorAdminNegativeTestJSON-1575896621 tempest-HypervisorAdminNegativeTestJSON-1575896621-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:50.847320 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f513f9f7-e8fd-402f-ad96-12a8d0df7ba3 tempest-HypervisorAdminNegativeTestJSON-1575896621 tempest-HypervisorAdminNegativeTestJSON-1575896621-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:50.848033 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f513f9f7-e8fd-402f-ad96-12a8d0df7ba3 tempest-HypervisorAdminNegativeTestJSON-1575896621 tempest-HypervisorAdminNegativeTestJSON-1575896621-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:50.848738 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f513f9f7-e8fd-402f-ad96-12a8d0df7ba3 tempest-HypervisorAdminNegativeTestJSON-1575896621 tempest-HypervisorAdminNegativeTestJSON-1575896621-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:50.858425 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-f513f9f7-e8fd-402f-ad96-12a8d0df7ba3 tempest-HypervisorAdminNegativeTestJSON-1575896621 tempest-HypervisorAdminNegativeTestJSON-1575896621-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.329578 Oct 04 21:43:50.861302 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 95/203] 10.222.0.43 () {58 vars in 1146 bytes} [Tue Oct 4 21:43:50 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:43:50.875319 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-ecd36f38-d634-4d65-92e6-cc7a5eacde22 tempest-HypervisorAdminNegativeTestJSON-2049143979 tempest-HypervisorAdminNegativeTestJSON-2049143979-project] Calling method '.version_select at 0x7fbb2fefd430>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:50.887085 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-ecd36f38-d634-4d65-92e6-cc7a5eacde22 tempest-HypervisorAdminNegativeTestJSON-2049143979 tempest-HypervisorAdminNegativeTestJSON-2049143979-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': 'd0f3c24a5c694f179c0194366397acfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '969e94a5d5d647ceb155eea8671ec20f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:43:50.889625 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-ecd36f38-d634-4d65-92e6-cc7a5eacde22 tempest-HypervisorAdminNegativeTestJSON-2049143979 tempest-HypervisorAdminNegativeTestJSON-2049143979-project] Request method failure captured: Oct 04 21:43:50.889625 n-d-860284-1 devstack@n-api.service[134102]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 Oct 04 21:43:50.889625 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 21:43:50.889625 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 21:43:50.889625 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 21:43:50.889625 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 21:43:50.889625 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 21:43:50.889625 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 21:43:50.889625 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 21:43:50.889625 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 21:43:50.889625 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPKkThpUTFI0MdBRvfgz1XgokNDfTWnNRFNZ-zkUTr8qWk-hVwqCvvaBXRiXc8xzzv6M3ikKdYgHgPB1Lh5b4hd0SXWDX-uxsjI07ZMmQ4JHocptXId5DrCM6d1j9am1t_mhxUfW4ihvgF3eonga5G8YiNgOk0WQrYZzP41W7crFFJmU Oct 04 21:43:50.889625 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 21:43:50.889625 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 21:43:50.889625 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 21:43:50.889625 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 21:43:50.889625 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 21:43:50.889625 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 21:43:50.889625 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: 969e94a5d5d647ceb155eea8671ec20f Oct 04 21:43:50.889625 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-2049143979 Oct 04 21:43:50.889625 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 21:43:50.889625 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 21:43:50.890916 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/969e94a5d5d647ceb155eea8671ec20f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_969e94a5d5d647ceb155eea8671ec20f", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/969e94a5d5d647ceb155eea8671ec20f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/969e94a5d5d647ceb155eea8671ec20f"}]}] Oct 04 21:43:50.890916 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-2049143979 Oct 04 21:43:50.890916 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: 969e94a5d5d647ceb155eea8671ec20f Oct 04 21:43:50.890916 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-2049143979 Oct 04 21:43:50.890916 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-HypervisorAdminNegativeTestJSON-2049143979-project Oct 04 21:43:50.890916 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 21:43:50.890916 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 21:43:50.890916 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: d0f3c24a5c694f179c0194366397acfd Oct 04 21:43:50.890916 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-2049143979-project Oct 04 21:43:50.890916 n-d-860284-1 devstack@n-api.service[134102]: method: Oct 04 21:43:50.890916 n-d-860284-1 devstack@n-api.service[134102]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 04 21:43:50.890916 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': '1'} Oct 04 21:43:50.890916 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:43:50.891663 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:43:50.891663 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:43:50.891663 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:43:50.891663 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:43:50.891663 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:43:50.891663 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:43:50.891663 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:43:50.891663 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:43:50.891663 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:43:50.891663 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime Oct 04 21:43:50.891663 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) Oct 04 21:43:50.891663 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 21:43:50.891663 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 21:43:50.891663 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 21:43:50.891663 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 21:43:50.891663 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 21:43:50.891663 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 21:43:50.891663 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 21:43:50.891663 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 21:43:50.893198 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 21:43:50.893198 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 21:43:50.893198 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 21:43:50.893198 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 21:43:50.893198 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 21:43:50.893198 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 21:43:50.893198 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 04 21:43:50.893198 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:43:50.893198 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:43:50.893198 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:43:50.893198 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:43:50.893198 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:43:50.893198 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:43:50.893198 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 21:43:50.893198 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 21:43:50.893198 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 04 21:43:50.893198 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:43:50.894172 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-ecd36f38-d634-4d65-92e6-cc7a5eacde22 tempest-HypervisorAdminNegativeTestJSON-2049143979 tempest-HypervisorAdminNegativeTestJSON-2049143979-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:43:50.899320 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-ecd36f38-d634-4d65-92e6-cc7a5eacde22 tempest-HypervisorAdminNegativeTestJSON-2049143979 tempest-HypervisorAdminNegativeTestJSON-2049143979-project] 10.222.0.43 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.028837 Oct 04 21:43:50.900168 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 96/204] 10.222.0.43 () {58 vars in 1173 bytes} [Tue Oct 4 21:43:50 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 30 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:43:50.912480 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-45437196-efb3-4f8f-b740-cfda49fd0b01 tempest-HypervisorAdminNegativeTestJSON-1575896621 tempest-HypervisorAdminNegativeTestJSON-1575896621-project-admin] Calling method '.version_select at 0x7fbb2fc778b0>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:50.918839 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-45437196-efb3-4f8f-b740-cfda49fd0b01 tempest-HypervisorAdminNegativeTestJSON-1575896621 tempest-HypervisorAdminNegativeTestJSON-1575896621-project-admin] HTTP exception thrown: Hypervisor with ID '8ceb2766-fda3-479a-b096-468c18d3138f' could not be found. Oct 04 21:43:50.929601 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-45437196-efb3-4f8f-b740-cfda49fd0b01 tempest-HypervisorAdminNegativeTestJSON-1575896621 tempest-HypervisorAdminNegativeTestJSON-1575896621-project-admin] Request method failure captured: Oct 04 21:43:50.929601 n-d-860284-1 devstack@n-api.service[134102]: request: GET /compute/v2.1/os-hypervisors/8ceb2766-fda3-479a-b096-468c18d3138f/uptime HTTP/1.1 Oct 04 21:43:50.929601 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 21:43:50.929601 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 21:43:50.929601 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 21:43:50.929601 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 21:43:50.929601 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 21:43:50.929601 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 21:43:50.929601 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 21:43:50.929601 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 21:43:50.929601 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPKkVSvtvMBWS1Mfd5EulQ6Mw5SoStUbbUugB1dKNennPfdCcORsCeaL-qh3UzIPZ8E-pRaxDGRd5_HCKpfh8sRTcLaRidQ4RdiwXq-xXhjrawrJR-mrwU3KrhWU3EL_oKf4i_BRqd4awKpNDHUHLv2mw7mayX63AISf5lM5ToQv2_BI Oct 04 21:43:50.929601 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 21:43:50.929601 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 21:43:50.929601 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 21:43:50.929601 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 21:43:50.929601 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 21:43:50.929601 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 21:43:50.929601 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: 655e91362899448aae967cd3d8b7ee8a Oct 04 21:43:50.929601 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1575896621 Oct 04 21:43:50.929601 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,admin,member Oct 04 21:43:50.929601 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,admin,member Oct 04 21:43:50.932349 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/655e91362899448aae967cd3d8b7ee8a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_655e91362899448aae967cd3d8b7ee8a", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/655e91362899448aae967cd3d8b7ee8a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/655e91362899448aae967cd3d8b7ee8a"}]}] Oct 04 21:43:50.932349 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1575896621 Oct 04 21:43:50.932349 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: 655e91362899448aae967cd3d8b7ee8a Oct 04 21:43:50.932349 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1575896621 Oct 04 21:43:50.932349 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-HypervisorAdminNegativeTestJSON-1575896621-project-admin Oct 04 21:43:50.932349 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 21:43:50.932349 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 21:43:50.932349 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: ed8b2336b815474da03e7fce85097f2c Oct 04 21:43:50.932349 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1575896621-project-admin Oct 04 21:43:50.932349 n-d-860284-1 devstack@n-api.service[134102]: method: Oct 04 21:43:50.932349 n-d-860284-1 devstack@n-api.service[134102]: exception: Hypervisor with ID '8ceb2766-fda3-479a-b096-468c18d3138f' could not be found. Oct 04 21:43:50.932349 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': '8ceb2766-fda3-479a-b096-468c18d3138f'} Oct 04 21:43:50.940450 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:43:50.940450 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:43:50.940450 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Oct 04 21:43:50.940450 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi value = int(str(value)) Oct 04 21:43:50.940450 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '8ceb2766-fda3-479a-b096-468c18d3138f' Oct 04 21:43:50.940450 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:43:50.940450 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:43:50.940450 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:43:50.940450 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:43:50.940450 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Oct 04 21:43:50.940450 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Oct 04 21:43:50.940450 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Oct 04 21:43:50.940450 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Oct 04 21:43:50.940450 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Oct 04 21:43:50.940450 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:43:50.940450 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:43:50.940450 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:43:50.940450 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:43:50.940450 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Oct 04 21:43:50.940450 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Oct 04 21:43:50.940450 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Oct 04 21:43:50.940450 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Oct 04 21:43:50.942587 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Oct 04 21:43:50.942587 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:43:50.942587 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:43:50.942587 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:43:50.942587 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:43:50.942587 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:43:50.942587 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:43:50.942587 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:43:50.942587 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:43:50.942587 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:43:50.942587 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:43:50.942587 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:43:50.942587 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:43:50.942587 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime Oct 04 21:43:50.942587 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Oct 04 21:43:50.942587 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Oct 04 21:43:50.942587 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 04 21:43:50.942587 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '8ceb2766-fda3-479a-b096-468c18d3138f' could not be found. Oct 04 21:43:50.942587 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:43:50.942587 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:43:50.942587 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:43:50.943647 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:43:50.943647 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:43:50.943647 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:43:50.943647 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:43:50.943647 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:43:50.943647 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '8ceb2766-fda3-479a-b096-468c18d3138f' could not be found. Oct 04 21:43:50.943647 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:43:50.943647 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-45437196-efb3-4f8f-b740-cfda49fd0b01 tempest-HypervisorAdminNegativeTestJSON-1575896621 tempest-HypervisorAdminNegativeTestJSON-1575896621-project-admin] Returning 404 to user: Hypervisor with ID '8ceb2766-fda3-479a-b096-468c18d3138f' could not be found. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:43:50.943647 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-45437196-efb3-4f8f-b740-cfda49fd0b01 tempest-HypervisorAdminNegativeTestJSON-1575896621 tempest-HypervisorAdminNegativeTestJSON-1575896621-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hypervisors/8ceb2766-fda3-479a-b096-468c18d3138f/uptime" status: 404 len: 123 microversion: 2.1 time: 0.024612 Oct 04 21:43:50.943647 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 97/205] 10.222.0.43 () {58 vars in 1278 bytes} [Tue Oct 4 21:43:50 2022] GET /compute/v2.1/os-hypervisors/8ceb2766-fda3-479a-b096-468c18d3138f/uptime => generated 123 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:43:50.945280 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-305b798f-1588-4ece-bfe4-5077270ff70b tempest-HypervisorAdminNegativeTestJSON-1575896621 tempest-HypervisorAdminNegativeTestJSON-1575896621-project-admin] Calling method '.version_select at 0x7fbb2fc9d5e0>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:50.947347 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-305b798f-1588-4ece-bfe4-5077270ff70b tempest-HypervisorAdminNegativeTestJSON-1575896621 tempest-HypervisorAdminNegativeTestJSON-1575896621-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:50.947834 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-305b798f-1588-4ece-bfe4-5077270ff70b tempest-HypervisorAdminNegativeTestJSON-1575896621 tempest-HypervisorAdminNegativeTestJSON-1575896621-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:50.948339 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-305b798f-1588-4ece-bfe4-5077270ff70b tempest-HypervisorAdminNegativeTestJSON-1575896621 tempest-HypervisorAdminNegativeTestJSON-1575896621-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:50.968189 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-305b798f-1588-4ece-bfe4-5077270ff70b tempest-HypervisorAdminNegativeTestJSON-1575896621 tempest-HypervisorAdminNegativeTestJSON-1575896621-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:50.968712 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-305b798f-1588-4ece-bfe4-5077270ff70b tempest-HypervisorAdminNegativeTestJSON-1575896621 tempest-HypervisorAdminNegativeTestJSON-1575896621-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:50.969185 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-305b798f-1588-4ece-bfe4-5077270ff70b tempest-HypervisorAdminNegativeTestJSON-1575896621 tempest-HypervisorAdminNegativeTestJSON-1575896621-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:50.986034 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-305b798f-1588-4ece-bfe4-5077270ff70b tempest-HypervisorAdminNegativeTestJSON-1575896621 tempest-HypervisorAdminNegativeTestJSON-1575896621-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:50.986034 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-305b798f-1588-4ece-bfe4-5077270ff70b tempest-HypervisorAdminNegativeTestJSON-1575896621 tempest-HypervisorAdminNegativeTestJSON-1575896621-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:50.986034 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-305b798f-1588-4ece-bfe4-5077270ff70b tempest-HypervisorAdminNegativeTestJSON-1575896621 tempest-HypervisorAdminNegativeTestJSON-1575896621-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:50.998675 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-305b798f-1588-4ece-bfe4-5077270ff70b tempest-HypervisorAdminNegativeTestJSON-1575896621 tempest-HypervisorAdminNegativeTestJSON-1575896621-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.057051 Oct 04 21:43:50.999661 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 98/206] 10.222.0.43 () {58 vars in 1146 bytes} [Tue Oct 4 21:43:50 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:43:51.005294 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-493cb3f5-6be6-4df4-8829-877ead60e78e tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:51.006440 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-493cb3f5-6be6-4df4-8829-877ead60e78e tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] [instance: 4ca5960d-4a64-4a04-a849-d53180a038e9] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:43:51.018101 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-493cb3f5-6be6-4df4-8829-877ead60e78e tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:51.019994 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-493cb3f5-6be6-4df4-8829-877ead60e78e tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:51.020555 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-493cb3f5-6be6-4df4-8829-877ead60e78e tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:51.021637 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-493cb3f5-6be6-4df4-8829-877ead60e78e tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:51.022121 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-493cb3f5-6be6-4df4-8829-877ead60e78e tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:51.022589 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-493cb3f5-6be6-4df4-8829-877ead60e78e tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:51.247382 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-dccb85c0-d3b3-4294-b7d7-556825c4446a tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29842a669a20408b881105135f76cb0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39edf587afe94b60911198aa0bb61613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:43:51.256086 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-dccb85c0-d3b3-4294-b7d7-556825c4446a tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] 10.222.0.43 "GET /compute/v2.1/servers/4b0c3dd7-d609-4b00-8604-35f8a2680c14" status: 200 len: 1316 microversion: 2.1 time: 0.657348 Oct 04 21:43:51.262022 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 109/207] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:43:50 2022] GET /compute/v2.1/servers/4b0c3dd7-d609-4b00-8604-35f8a2680c14 => generated 1316 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:43:51.270573 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-2b6c136a-542f-4bb2-852f-d1a7d59d7b72 tempest-HypervisorAdminNegativeTestJSON-2049143979 tempest-HypervisorAdminNegativeTestJSON-2049143979-project] Calling method '.version_select at 0x7fbb2fa8fb80>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:51.280097 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-2b6c136a-542f-4bb2-852f-d1a7d59d7b72 tempest-HypervisorAdminNegativeTestJSON-2049143979 tempest-HypervisorAdminNegativeTestJSON-2049143979-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': 'd0f3c24a5c694f179c0194366397acfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '969e94a5d5d647ceb155eea8671ec20f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:43:51.285281 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-2b6c136a-542f-4bb2-852f-d1a7d59d7b72 tempest-HypervisorAdminNegativeTestJSON-2049143979 tempest-HypervisorAdminNegativeTestJSON-2049143979-project] Request method failure captured: Oct 04 21:43:51.285281 n-d-860284-1 devstack@n-api.service[134101]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 Oct 04 21:43:51.285281 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 21:43:51.285281 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 21:43:51.285281 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 21:43:51.285281 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 21:43:51.285281 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 21:43:51.285281 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 21:43:51.285281 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 21:43:51.285281 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 21:43:51.285281 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPKkThpUTFI0MdBRvfgz1XgokNDfTWnNRFNZ-zkUTr8qWk-hVwqCvvaBXRiXc8xzzv6M3ikKdYgHgPB1Lh5b4hd0SXWDX-uxsjI07ZMmQ4JHocptXId5DrCM6d1j9am1t_mhxUfW4ihvgF3eonga5G8YiNgOk0WQrYZzP41W7crFFJmU Oct 04 21:43:51.285281 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 21:43:51.285281 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 21:43:51.285281 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 21:43:51.285281 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 21:43:51.285281 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 21:43:51.285281 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 21:43:51.285281 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: 969e94a5d5d647ceb155eea8671ec20f Oct 04 21:43:51.285281 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-2049143979 Oct 04 21:43:51.285281 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 21:43:51.285281 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 21:43:51.286846 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/969e94a5d5d647ceb155eea8671ec20f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_969e94a5d5d647ceb155eea8671ec20f", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/969e94a5d5d647ceb155eea8671ec20f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/969e94a5d5d647ceb155eea8671ec20f"}]}] Oct 04 21:43:51.286846 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-2049143979 Oct 04 21:43:51.286846 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: 969e94a5d5d647ceb155eea8671ec20f Oct 04 21:43:51.286846 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-2049143979 Oct 04 21:43:51.286846 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-HypervisorAdminNegativeTestJSON-2049143979-project Oct 04 21:43:51.286846 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 21:43:51.286846 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 21:43:51.286846 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: d0f3c24a5c694f179c0194366397acfd Oct 04 21:43:51.286846 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-2049143979-project Oct 04 21:43:51.286846 n-d-860284-1 devstack@n-api.service[134101]: method: Oct 04 21:43:51.286846 n-d-860284-1 devstack@n-api.service[134101]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 04 21:43:51.286846 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': '1'} Oct 04 21:43:51.286846 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:43:51.287823 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:43:51.287823 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:43:51.287823 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:43:51.287823 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:43:51.287823 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:43:51.287823 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:43:51.287823 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:43:51.287823 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:43:51.287823 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:43:51.287823 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Oct 04 21:43:51.287823 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 04 21:43:51.287823 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show Oct 04 21:43:51.287823 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) Oct 04 21:43:51.287823 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 21:43:51.287823 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 21:43:51.287823 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 21:43:51.287823 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 21:43:51.287823 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 21:43:51.287823 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 21:43:51.289660 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 21:43:51.289660 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 21:43:51.289660 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 21:43:51.289660 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 21:43:51.289660 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 21:43:51.289660 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 21:43:51.289660 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 21:43:51.289660 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 21:43:51.289660 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 04 21:43:51.289660 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:43:51.289660 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:43:51.289660 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:43:51.289660 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:43:51.289660 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:43:51.289660 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:43:51.289660 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 21:43:51.289660 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 21:43:51.289660 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 04 21:43:51.289660 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:43:51.292376 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-2b6c136a-542f-4bb2-852f-d1a7d59d7b72 tempest-HypervisorAdminNegativeTestJSON-2049143979 tempest-HypervisorAdminNegativeTestJSON-2049143979-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:43:51.295077 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-2b6c136a-542f-4bb2-852f-d1a7d59d7b72 tempest-HypervisorAdminNegativeTestJSON-2049143979 tempest-HypervisorAdminNegativeTestJSON-2049143979-project] 10.222.0.43 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.031650 Oct 04 21:43:51.302213 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 110/208] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Oct 4 21:43:51 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 39 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:43:51.314445 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-89fcb780-c3a4-4f8f-8fc7-a55fb04aebb1 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:51.317796 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-89fcb780-c3a4-4f8f-8fc7-a55fb04aebb1 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: ec437ce7-b43a-4c8b-8a06-756cfb877851] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:43:51.337695 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-89fcb780-c3a4-4f8f-8fc7-a55fb04aebb1 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:51.338200 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-89fcb780-c3a4-4f8f-8fc7-a55fb04aebb1 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:51.338654 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-89fcb780-c3a4-4f8f-8fc7-a55fb04aebb1 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:51.343229 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-89fcb780-c3a4-4f8f-8fc7-a55fb04aebb1 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:51.343801 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-89fcb780-c3a4-4f8f-8fc7-a55fb04aebb1 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:51.344641 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-89fcb780-c3a4-4f8f-8fc7-a55fb04aebb1 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:51.510633 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-89fcb780-c3a4-4f8f-8fc7-a55fb04aebb1 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:43:51.532120 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-89fcb780-c3a4-4f8f-8fc7-a55fb04aebb1 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/ec437ce7-b43a-4c8b-8a06-756cfb877851" status: 200 len: 1209 microversion: 2.1 time: 0.227013 Oct 04 21:43:51.556365 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 111/209] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:43:51 2022] GET /compute/v2.1/servers/ec437ce7-b43a-4c8b-8a06-756cfb877851 => generated 1209 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:43:51.573826 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-7b005346-fc4e-4a87-b9c3-01c6743f143f tempest-HypervisorAdminNegativeTestJSON-1575896621 tempest-HypervisorAdminNegativeTestJSON-1575896621-project-admin] Calling method '.version_select at 0x7fbb2fc54a60>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:51.576212 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-7b005346-fc4e-4a87-b9c3-01c6743f143f tempest-HypervisorAdminNegativeTestJSON-1575896621 tempest-HypervisorAdminNegativeTestJSON-1575896621-project-admin] HTTP exception thrown: Hypervisor with ID '5d326793-3704-49be-8209-d5a54f33aa36' could not be found. Oct 04 21:43:51.579170 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-7b005346-fc4e-4a87-b9c3-01c6743f143f tempest-HypervisorAdminNegativeTestJSON-1575896621 tempest-HypervisorAdminNegativeTestJSON-1575896621-project-admin] Request method failure captured: Oct 04 21:43:51.579170 n-d-860284-1 devstack@n-api.service[134101]: request: GET /compute/v2.1/os-hypervisors/5d326793-3704-49be-8209-d5a54f33aa36 HTTP/1.1 Oct 04 21:43:51.579170 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 21:43:51.579170 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 21:43:51.579170 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 21:43:51.579170 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 21:43:51.579170 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 21:43:51.579170 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 21:43:51.579170 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 21:43:51.579170 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 21:43:51.579170 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPKkVSvtvMBWS1Mfd5EulQ6Mw5SoStUbbUugB1dKNennPfdCcORsCeaL-qh3UzIPZ8E-pRaxDGRd5_HCKpfh8sRTcLaRidQ4RdiwXq-xXhjrawrJR-mrwU3KrhWU3EL_oKf4i_BRqd4awKpNDHUHLv2mw7mayX63AISf5lM5ToQv2_BI Oct 04 21:43:51.579170 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 21:43:51.579170 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 21:43:51.579170 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 21:43:51.579170 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 21:43:51.579170 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 21:43:51.579170 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 21:43:51.579170 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: 655e91362899448aae967cd3d8b7ee8a Oct 04 21:43:51.579170 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1575896621 Oct 04 21:43:51.579170 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,admin,member Oct 04 21:43:51.579170 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,admin,member Oct 04 21:43:51.580453 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/655e91362899448aae967cd3d8b7ee8a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_655e91362899448aae967cd3d8b7ee8a", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/655e91362899448aae967cd3d8b7ee8a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/655e91362899448aae967cd3d8b7ee8a"}]}] Oct 04 21:43:51.580453 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1575896621 Oct 04 21:43:51.580453 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: 655e91362899448aae967cd3d8b7ee8a Oct 04 21:43:51.580453 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1575896621 Oct 04 21:43:51.580453 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-HypervisorAdminNegativeTestJSON-1575896621-project-admin Oct 04 21:43:51.580453 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 21:43:51.580453 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 21:43:51.580453 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: ed8b2336b815474da03e7fce85097f2c Oct 04 21:43:51.580453 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1575896621-project-admin Oct 04 21:43:51.580453 n-d-860284-1 devstack@n-api.service[134101]: method: Oct 04 21:43:51.580453 n-d-860284-1 devstack@n-api.service[134101]: exception: Hypervisor with ID '5d326793-3704-49be-8209-d5a54f33aa36' could not be found. Oct 04 21:43:51.580453 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': '5d326793-3704-49be-8209-d5a54f33aa36'} Oct 04 21:43:51.581101 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:43:51.581101 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:43:51.581101 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Oct 04 21:43:51.581101 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi value = int(str(value)) Oct 04 21:43:51.581101 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '5d326793-3704-49be-8209-d5a54f33aa36' Oct 04 21:43:51.581101 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:43:51.581101 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:43:51.581101 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:43:51.581101 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:43:51.581101 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Oct 04 21:43:51.581101 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Oct 04 21:43:51.581101 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Oct 04 21:43:51.581101 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Oct 04 21:43:51.581101 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Oct 04 21:43:51.581101 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:43:51.581101 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:43:51.581101 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:43:51.581101 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:43:51.581101 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Oct 04 21:43:51.581101 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Oct 04 21:43:51.581101 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Oct 04 21:43:51.581101 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Oct 04 21:43:51.582194 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Oct 04 21:43:51.582194 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:43:51.582194 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:43:51.582194 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:43:51.582194 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:43:51.582194 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:43:51.582194 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:43:51.582194 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:43:51.582194 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:43:51.582194 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:43:51.582194 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:43:51.582194 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:43:51.582194 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:43:51.582194 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Oct 04 21:43:51.582194 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 04 21:43:51.582194 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show Oct 04 21:43:51.582194 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Oct 04 21:43:51.582194 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Oct 04 21:43:51.582194 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 04 21:43:51.582194 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '5d326793-3704-49be-8209-d5a54f33aa36' could not be found. Oct 04 21:43:51.583237 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:43:51.583237 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:43:51.583237 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:43:51.583237 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:43:51.583237 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:43:51.583237 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:43:51.583237 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:43:51.583237 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:43:51.583237 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '5d326793-3704-49be-8209-d5a54f33aa36' could not be found. Oct 04 21:43:51.583237 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:43:51.583237 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-7b005346-fc4e-4a87-b9c3-01c6743f143f tempest-HypervisorAdminNegativeTestJSON-1575896621 tempest-HypervisorAdminNegativeTestJSON-1575896621-project-admin] Returning 404 to user: Hypervisor with ID '5d326793-3704-49be-8209-d5a54f33aa36' could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:43:51.583237 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-7b005346-fc4e-4a87-b9c3-01c6743f143f tempest-HypervisorAdminNegativeTestJSON-1575896621 tempest-HypervisorAdminNegativeTestJSON-1575896621-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hypervisors/5d326793-3704-49be-8209-d5a54f33aa36" status: 404 len: 123 microversion: 2.1 time: 0.023058 Oct 04 21:43:51.583237 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 112/210] 10.222.0.43 () {58 vars in 1257 bytes} [Tue Oct 4 21:43:51 2022] GET /compute/v2.1/os-hypervisors/5d326793-3704-49be-8209-d5a54f33aa36 => generated 123 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:43:51.590967 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-f97fc860-7419-4ed9-8cc8-3369ade38fcb tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:51.591479 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-f97fc860-7419-4ed9-8cc8-3369ade38fcb tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] [instance: 4c692055-b3f9-494b-9279-5a8453ed88ba] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:43:51.598557 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f97fc860-7419-4ed9-8cc8-3369ade38fcb tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:51.599186 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f97fc860-7419-4ed9-8cc8-3369ade38fcb tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:51.599733 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f97fc860-7419-4ed9-8cc8-3369ade38fcb tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:51.600447 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f97fc860-7419-4ed9-8cc8-3369ade38fcb tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:51.600984 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f97fc860-7419-4ed9-8cc8-3369ade38fcb tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:51.601382 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f97fc860-7419-4ed9-8cc8-3369ade38fcb tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:51.729547 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-493cb3f5-6be6-4df4-8829-877ead60e78e tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e00999a6faf349eea3be7680a855e8d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f306c099ef294f6da8637a8ddcdb46d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:43:51.747111 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-493cb3f5-6be6-4df4-8829-877ead60e78e tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] 10.222.0.43 "GET /compute/v2.1/servers/4ca5960d-4a64-4a04-a849-d53180a038e9" status: 200 len: 1338 microversion: 2.1 time: 0.746053 Oct 04 21:43:51.747715 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 99/211] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:43:50 2022] GET /compute/v2.1/servers/4ca5960d-4a64-4a04-a849-d53180a038e9 => generated 1338 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:43:51.960462 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-f97fc860-7419-4ed9-8cc8-3369ade38fcb tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5387dbf4e24960809704c398fe999a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bedc0e10ab24824a40d06bb91626088', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:43:51.978724 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-f97fc860-7419-4ed9-8cc8-3369ade38fcb tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] 10.222.0.43 "GET /compute/v2.1/servers/4c692055-b3f9-494b-9279-5a8453ed88ba" status: 200 len: 1341 microversion: 2.1 time: 0.394133 Oct 04 21:43:51.979532 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 113/212] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:43:51 2022] GET /compute/v2.1/servers/4c692055-b3f9-494b-9279-5a8453ed88ba => generated 1341 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:43:52.287867 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-9d998820-e048-4f69-b6a6-f8bf4d8e21fe tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:52.288488 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-9d998820-e048-4f69-b6a6-f8bf4d8e21fe tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] [instance: 4b0c3dd7-d609-4b00-8604-35f8a2680c14] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:43:52.316298 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9d998820-e048-4f69-b6a6-f8bf4d8e21fe tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:52.316814 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9d998820-e048-4f69-b6a6-f8bf4d8e21fe tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:52.317257 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9d998820-e048-4f69-b6a6-f8bf4d8e21fe tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:52.317982 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9d998820-e048-4f69-b6a6-f8bf4d8e21fe tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:52.318510 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9d998820-e048-4f69-b6a6-f8bf4d8e21fe tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:52.319028 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9d998820-e048-4f69-b6a6-f8bf4d8e21fe tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:52.564101 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-8e20dd55-0033-431b-b589-e687f42f8078 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:52.564955 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-8e20dd55-0033-431b-b589-e687f42f8078 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: ec437ce7-b43a-4c8b-8a06-756cfb877851] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:43:52.582323 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8e20dd55-0033-431b-b589-e687f42f8078 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:52.583072 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8e20dd55-0033-431b-b589-e687f42f8078 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:52.583770 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8e20dd55-0033-431b-b589-e687f42f8078 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:52.584666 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8e20dd55-0033-431b-b589-e687f42f8078 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:52.585293 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8e20dd55-0033-431b-b589-e687f42f8078 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:52.586479 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8e20dd55-0033-431b-b589-e687f42f8078 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:52.930017 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-8e20dd55-0033-431b-b589-e687f42f8078 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:43:52.951743 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-8e20dd55-0033-431b-b589-e687f42f8078 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/ec437ce7-b43a-4c8b-8a06-756cfb877851" status: 200 len: 1271 microversion: 2.1 time: 0.388784 Oct 04 21:43:52.968732 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 114/213] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:43:52 2022] GET /compute/v2.1/servers/ec437ce7-b43a-4c8b-8a06-756cfb877851 => generated 1271 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:43:52.982552 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-710b74b5-6fc6-4dcf-958c-e0e9f1a467df tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:52.983844 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-710b74b5-6fc6-4dcf-958c-e0e9f1a467df tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] [instance: 4ca5960d-4a64-4a04-a849-d53180a038e9] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:43:52.992380 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-710b74b5-6fc6-4dcf-958c-e0e9f1a467df tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:52.993226 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-710b74b5-6fc6-4dcf-958c-e0e9f1a467df tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:52.994100 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-710b74b5-6fc6-4dcf-958c-e0e9f1a467df tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:52.995271 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-710b74b5-6fc6-4dcf-958c-e0e9f1a467df tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:52.996105 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-710b74b5-6fc6-4dcf-958c-e0e9f1a467df tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:52.996948 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-710b74b5-6fc6-4dcf-958c-e0e9f1a467df tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:53.260055 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-9d998820-e048-4f69-b6a6-f8bf4d8e21fe tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29842a669a20408b881105135f76cb0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39edf587afe94b60911198aa0bb61613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:43:53.271380 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-9d998820-e048-4f69-b6a6-f8bf4d8e21fe tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] 10.222.0.43 "GET /compute/v2.1/servers/4b0c3dd7-d609-4b00-8604-35f8a2680c14" status: 200 len: 1316 microversion: 2.1 time: 0.987239 Oct 04 21:43:53.275286 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 100/214] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:43:52 2022] GET /compute/v2.1/servers/4b0c3dd7-d609-4b00-8604-35f8a2680c14 => generated 1316 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:43:53.433418 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-710b74b5-6fc6-4dcf-958c-e0e9f1a467df tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e00999a6faf349eea3be7680a855e8d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f306c099ef294f6da8637a8ddcdb46d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:43:53.447009 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-710b74b5-6fc6-4dcf-958c-e0e9f1a467df tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] 10.222.0.43 "GET /compute/v2.1/servers/4ca5960d-4a64-4a04-a849-d53180a038e9" status: 200 len: 1338 microversion: 2.1 time: 0.483778 Oct 04 21:43:53.467109 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 115/215] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:43:52 2022] GET /compute/v2.1/servers/4ca5960d-4a64-4a04-a849-d53180a038e9 => generated 1338 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:43:53.481439 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-4a424ed5-5982-44f5-9c0a-0a554df8fc1a tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:53.485934 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-4a424ed5-5982-44f5-9c0a-0a554df8fc1a tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] [instance: 4c692055-b3f9-494b-9279-5a8453ed88ba] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:43:53.498967 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4a424ed5-5982-44f5-9c0a-0a554df8fc1a tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:53.499582 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4a424ed5-5982-44f5-9c0a-0a554df8fc1a tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:53.501110 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4a424ed5-5982-44f5-9c0a-0a554df8fc1a tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:53.501922 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4a424ed5-5982-44f5-9c0a-0a554df8fc1a tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:53.506083 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4a424ed5-5982-44f5-9c0a-0a554df8fc1a tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:53.507194 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4a424ed5-5982-44f5-9c0a-0a554df8fc1a tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:53.533028 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-6cd5c2d5-a692-4061-b864-a247c99c3ec9 req-a2d18928-2489-407e-aa15-4236f219169b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c692055-b3f9-494b-9279-5a8453ed88ba", "name": "network-vif-plugged", "status": "completed", "tag": "f333f58f-c707-413f-85bd-d2d8eaec8ea8"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:43:53.552418 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-6cd5c2d5-a692-4061-b864-a247c99c3ec9 req-a2d18928-2489-407e-aa15-4236f219169b service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:53.553197 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-6cd5c2d5-a692-4061-b864-a247c99c3ec9 req-a2d18928-2489-407e-aa15-4236f219169b service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:53.553317 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-6cd5c2d5-a692-4061-b864-a247c99c3ec9 req-a2d18928-2489-407e-aa15-4236f219169b service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:53.593550 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-6cd5c2d5-a692-4061-b864-a247c99c3ec9 req-a2d18928-2489-407e-aa15-4236f219169b service nova] Creating event network-vif-plugged:f333f58f-c707-413f-85bd-d2d8eaec8ea8 for instance 4c692055-b3f9-494b-9279-5a8453ed88ba on n-h1-860284-1 Oct 04 21:43:53.606006 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-6cd5c2d5-a692-4061-b864-a247c99c3ec9 req-a2d18928-2489-407e-aa15-4236f219169b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.329244 Oct 04 21:43:53.616665 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 101/216] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:43:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:43:53.729148 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-a907cd24-ab04-4586-a22d-01039d872a92 req-9bd9a0fb-8888-48b1-b157-fec47d5b3f48 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b0c3dd7-d609-4b00-8604-35f8a2680c14", "tag": "b5c45de7-635e-4f30-8ac6-17479c140cb5"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:43:53.754243 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-a907cd24-ab04-4586-a22d-01039d872a92 req-9bd9a0fb-8888-48b1-b157-fec47d5b3f48 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:53.755667 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-a907cd24-ab04-4586-a22d-01039d872a92 req-9bd9a0fb-8888-48b1-b157-fec47d5b3f48 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:53.757233 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-a907cd24-ab04-4586-a22d-01039d872a92 req-9bd9a0fb-8888-48b1-b157-fec47d5b3f48 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:53.802698 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-a907cd24-ab04-4586-a22d-01039d872a92 req-9bd9a0fb-8888-48b1-b157-fec47d5b3f48 service nova] Creating event network-changed:b5c45de7-635e-4f30-8ac6-17479c140cb5 for instance 4b0c3dd7-d609-4b00-8604-35f8a2680c14 on n-h2-860284-1 Oct 04 21:43:53.817266 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-a907cd24-ab04-4586-a22d-01039d872a92 req-9bd9a0fb-8888-48b1-b157-fec47d5b3f48 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097053 Oct 04 21:43:53.820723 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 102/217] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:43:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:43:53.981406 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-9e7e743f-10a0-494f-8f1f-4cd39849d143 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:53.982697 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-9e7e743f-10a0-494f-8f1f-4cd39849d143 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: ec437ce7-b43a-4c8b-8a06-756cfb877851] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:43:54.000138 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9e7e743f-10a0-494f-8f1f-4cd39849d143 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:54.001055 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9e7e743f-10a0-494f-8f1f-4cd39849d143 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:54.003051 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9e7e743f-10a0-494f-8f1f-4cd39849d143 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:54.006164 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9e7e743f-10a0-494f-8f1f-4cd39849d143 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:54.006957 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9e7e743f-10a0-494f-8f1f-4cd39849d143 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:54.008632 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9e7e743f-10a0-494f-8f1f-4cd39849d143 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:54.411118 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-4a424ed5-5982-44f5-9c0a-0a554df8fc1a tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5387dbf4e24960809704c398fe999a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bedc0e10ab24824a40d06bb91626088', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:43:54.419709 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-4a424ed5-5982-44f5-9c0a-0a554df8fc1a tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] 10.222.0.43 "GET /compute/v2.1/servers/4c692055-b3f9-494b-9279-5a8453ed88ba" status: 200 len: 1341 microversion: 2.1 time: 0.950934 Oct 04 21:43:54.423983 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 116/218] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:43:53 2022] GET /compute/v2.1/servers/4c692055-b3f9-494b-9279-5a8453ed88ba => generated 1341 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:43:54.437398 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-da2cd6fe-f359-4e54-9ce2-c07cb0acbbcd tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:54.438259 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-da2cd6fe-f359-4e54-9ce2-c07cb0acbbcd tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] [instance: 4b0c3dd7-d609-4b00-8604-35f8a2680c14] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:43:54.450182 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-da2cd6fe-f359-4e54-9ce2-c07cb0acbbcd tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:54.455068 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-da2cd6fe-f359-4e54-9ce2-c07cb0acbbcd tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:54.455737 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-da2cd6fe-f359-4e54-9ce2-c07cb0acbbcd tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:54.456622 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-da2cd6fe-f359-4e54-9ce2-c07cb0acbbcd tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:54.457235 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-da2cd6fe-f359-4e54-9ce2-c07cb0acbbcd tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:54.457961 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-da2cd6fe-f359-4e54-9ce2-c07cb0acbbcd tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:54.575653 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-9e7e743f-10a0-494f-8f1f-4cd39849d143 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:43:54.583764 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-9e7e743f-10a0-494f-8f1f-4cd39849d143 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/ec437ce7-b43a-4c8b-8a06-756cfb877851" status: 200 len: 1313 microversion: 2.1 time: 0.608001 Oct 04 21:43:54.584910 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 103/219] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:43:53 2022] GET /compute/v2.1/servers/ec437ce7-b43a-4c8b-8a06-756cfb877851 => generated 1313 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:43:54.809997 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-7ce76a02-06de-4abb-acd0-ce05482c8b2e tempest-QuotaClassesAdminTestJSON-1867010103 tempest-QuotaClassesAdminTestJSON-1867010103-project-admin] Calling method '.version_select at 0x7fbb2fd7ec10>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:54.838187 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-7ce76a02-06de-4abb-acd0-ce05482c8b2e tempest-QuotaClassesAdminTestJSON-1867010103 tempest-QuotaClassesAdminTestJSON-1867010103-project-admin] 10.222.0.43 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.251984 Oct 04 21:43:54.839750 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 104/220] 10.222.0.43 () {58 vars in 1185 bytes} [Tue Oct 4 21:43:54 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:43:54.851712 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-8cd44ebb-6977-4489-9355-44ad7f428d60 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:54.853031 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-8cd44ebb-6977-4489-9355-44ad7f428d60 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] [instance: 4ca5960d-4a64-4a04-a849-d53180a038e9] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:43:54.864418 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8cd44ebb-6977-4489-9355-44ad7f428d60 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:54.865428 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8cd44ebb-6977-4489-9355-44ad7f428d60 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:54.869157 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8cd44ebb-6977-4489-9355-44ad7f428d60 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:54.873868 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8cd44ebb-6977-4489-9355-44ad7f428d60 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:54.874849 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8cd44ebb-6977-4489-9355-44ad7f428d60 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:54.875526 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8cd44ebb-6977-4489-9355-44ad7f428d60 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:54.919621 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-da2cd6fe-f359-4e54-9ce2-c07cb0acbbcd tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29842a669a20408b881105135f76cb0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39edf587afe94b60911198aa0bb61613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:43:54.937264 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-da2cd6fe-f359-4e54-9ce2-c07cb0acbbcd tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] 10.222.0.43 "GET /compute/v2.1/servers/4b0c3dd7-d609-4b00-8604-35f8a2680c14" status: 200 len: 1316 microversion: 2.1 time: 0.510963 Oct 04 21:43:54.939277 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 117/221] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:43:54 2022] GET /compute/v2.1/servers/4b0c3dd7-d609-4b00-8604-35f8a2680c14 => generated 1316 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:43:54.950432 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-895172d2-0159-49eb-aadf-ddae69f1f6ad tempest-QuotaClassesAdminTestJSON-1867010103 tempest-QuotaClassesAdminTestJSON-1867010103-project-admin] Action: 'update', calling method: .version_select at 0x7fbb2fb02c10>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:43:55.395173 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-895172d2-0159-49eb-aadf-ddae69f1f6ad tempest-QuotaClassesAdminTestJSON-1867010103 tempest-QuotaClassesAdminTestJSON-1867010103-project-admin] 10.222.0.43 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 0.452791 Oct 04 21:43:55.403953 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 118/222] 10.222.0.43 () {60 vars in 1206 bytes} [Tue Oct 4 21:43:54 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:43:55.415375 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-62155947-c8b8-4e2b-8345-4127da394ff7 tempest-QuotaClassesAdminTestJSON-1867010103 tempest-QuotaClassesAdminTestJSON-1867010103-project-admin] Calling method '.version_select at 0x7fbb2fa17b80>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:55.447856 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-62155947-c8b8-4e2b-8345-4127da394ff7 tempest-QuotaClassesAdminTestJSON-1867010103 tempest-QuotaClassesAdminTestJSON-1867010103-project-admin] 10.222.0.43 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.034199 Oct 04 21:43:55.451872 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 119/223] 10.222.0.43 () {58 vars in 1185 bytes} [Tue Oct 4 21:43:55 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:43:55.463911 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-ffd48988-f01e-48fc-bade-9db25385bda1 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:55.464705 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-ffd48988-f01e-48fc-bade-9db25385bda1 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] [instance: 4c692055-b3f9-494b-9279-5a8453ed88ba] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:43:55.476344 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ffd48988-f01e-48fc-bade-9db25385bda1 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:55.479503 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ffd48988-f01e-48fc-bade-9db25385bda1 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:55.480863 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ffd48988-f01e-48fc-bade-9db25385bda1 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:55.482106 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ffd48988-f01e-48fc-bade-9db25385bda1 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:55.482860 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ffd48988-f01e-48fc-bade-9db25385bda1 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:55.483499 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ffd48988-f01e-48fc-bade-9db25385bda1 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:55.803170 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-8cd44ebb-6977-4489-9355-44ad7f428d60 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e00999a6faf349eea3be7680a855e8d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f306c099ef294f6da8637a8ddcdb46d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:43:55.819291 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-8cd44ebb-6977-4489-9355-44ad7f428d60 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] 10.222.0.43 "GET /compute/v2.1/servers/4ca5960d-4a64-4a04-a849-d53180a038e9" status: 200 len: 1338 microversion: 2.1 time: 0.978033 Oct 04 21:43:55.836353 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 105/224] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:43:54 2022] GET /compute/v2.1/servers/4ca5960d-4a64-4a04-a849-d53180a038e9 => generated 1338 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:43:55.842140 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-8f60b18a-978f-4480-ade9-d1258ddfbfa4 tempest-QuotaClassesAdminTestJSON-1867010103 tempest-QuotaClassesAdminTestJSON-1867010103-project-admin] Action: 'update', calling method: .version_select at 0x7fbb2fd1c160>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:43:55.854993 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_api:SELECT=91,nova_api:DELETE=2,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:43:56.098034 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-8f60b18a-978f-4480-ade9-d1258ddfbfa4 tempest-QuotaClassesAdminTestJSON-1867010103 tempest-QuotaClassesAdminTestJSON-1867010103-project-admin] 10.222.0.43 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 0.259575 Oct 04 21:43:56.099746 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 106/225] 10.222.0.43 () {60 vars in 1206 bytes} [Tue Oct 4 21:43:55 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:43:56.106478 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-0de59d5d-12a0-42d3-beeb-f6c8d5bc6a08 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:56.107515 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-0de59d5d-12a0-42d3-beeb-f6c8d5bc6a08 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: ec437ce7-b43a-4c8b-8a06-756cfb877851] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:43:56.132342 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0de59d5d-12a0-42d3-beeb-f6c8d5bc6a08 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:56.132913 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0de59d5d-12a0-42d3-beeb-f6c8d5bc6a08 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:56.134839 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0de59d5d-12a0-42d3-beeb-f6c8d5bc6a08 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:56.137001 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0de59d5d-12a0-42d3-beeb-f6c8d5bc6a08 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:56.137490 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0de59d5d-12a0-42d3-beeb-f6c8d5bc6a08 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:56.139282 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0de59d5d-12a0-42d3-beeb-f6c8d5bc6a08 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:56.250643 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=2 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:43:56.335198 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-ffd48988-f01e-48fc-bade-9db25385bda1 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5387dbf4e24960809704c398fe999a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bedc0e10ab24824a40d06bb91626088', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:43:56.357603 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-ffd48988-f01e-48fc-bade-9db25385bda1 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] 10.222.0.43 "GET /compute/v2.1/servers/4c692055-b3f9-494b-9279-5a8453ed88ba" status: 200 len: 1341 microversion: 2.1 time: 0.894896 Oct 04 21:43:56.359289 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 120/226] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:43:55 2022] GET /compute/v2.1/servers/4c692055-b3f9-494b-9279-5a8453ed88ba => generated 1341 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:43:56.387918 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-7e78a805-5b9f-4962-a06f-396fcab6d031 req-f75d5da4-ef7b-414e-8638-6e31f2e3b3d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec437ce7-b43a-4c8b-8a06-756cfb877851", "tag": "11205198-745e-4214-9769-9da045caa32b"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:43:56.400574 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-7e78a805-5b9f-4962-a06f-396fcab6d031 req-f75d5da4-ef7b-414e-8638-6e31f2e3b3d8 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:56.401705 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-7e78a805-5b9f-4962-a06f-396fcab6d031 req-f75d5da4-ef7b-414e-8638-6e31f2e3b3d8 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:56.402412 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-7e78a805-5b9f-4962-a06f-396fcab6d031 req-f75d5da4-ef7b-414e-8638-6e31f2e3b3d8 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:56.430349 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-7e78a805-5b9f-4962-a06f-396fcab6d031 req-f75d5da4-ef7b-414e-8638-6e31f2e3b3d8 service nova] Creating event network-changed:11205198-745e-4214-9769-9da045caa32b for instance ec437ce7-b43a-4c8b-8a06-756cfb877851 on n-h2-860284-1 Oct 04 21:43:56.438590 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-7e78a805-5b9f-4962-a06f-396fcab6d031 req-f75d5da4-ef7b-414e-8638-6e31f2e3b3d8 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076759 Oct 04 21:43:56.440682 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 121/227] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:43:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:43:56.453416 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-22b6d63b-dcbe-4c8e-b28f-401354548199 req-e649422a-8d9c-4f47-912a-319e5d857970 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ca5960d-4a64-4a04-a849-d53180a038e9", "name": "network-vif-plugged", "status": "completed", "tag": "a854dcbe-0256-4f2a-8a54-097e0782c576"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:43:56.490424 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-22b6d63b-dcbe-4c8e-b28f-401354548199 req-e649422a-8d9c-4f47-912a-319e5d857970 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:56.492681 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-22b6d63b-dcbe-4c8e-b28f-401354548199 req-e649422a-8d9c-4f47-912a-319e5d857970 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:56.494302 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-22b6d63b-dcbe-4c8e-b28f-401354548199 req-e649422a-8d9c-4f47-912a-319e5d857970 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:56.517676 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-22b6d63b-dcbe-4c8e-b28f-401354548199 req-e649422a-8d9c-4f47-912a-319e5d857970 service nova] Creating event network-vif-plugged:a854dcbe-0256-4f2a-8a54-097e0782c576 for instance 4ca5960d-4a64-4a04-a849-d53180a038e9 on n-h1-860284-1 Oct 04 21:43:56.527850 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-22b6d63b-dcbe-4c8e-b28f-401354548199 req-e649422a-8d9c-4f47-912a-319e5d857970 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084535 Oct 04 21:43:56.528774 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 122/228] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:43:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:43:56.546420 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-4046fc12-6b76-4d19-8fea-91c65ae1ac5a tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:56.548304 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-4046fc12-6b76-4d19-8fea-91c65ae1ac5a tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] [instance: 4b0c3dd7-d609-4b00-8604-35f8a2680c14] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:43:56.561584 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4046fc12-6b76-4d19-8fea-91c65ae1ac5a tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:56.562284 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4046fc12-6b76-4d19-8fea-91c65ae1ac5a tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:56.563493 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4046fc12-6b76-4d19-8fea-91c65ae1ac5a tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:56.564751 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4046fc12-6b76-4d19-8fea-91c65ae1ac5a tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:56.565805 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4046fc12-6b76-4d19-8fea-91c65ae1ac5a tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:56.566471 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4046fc12-6b76-4d19-8fea-91c65ae1ac5a tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:56.777559 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-0de59d5d-12a0-42d3-beeb-f6c8d5bc6a08 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:43:56.788802 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-0de59d5d-12a0-42d3-beeb-f6c8d5bc6a08 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/ec437ce7-b43a-4c8b-8a06-756cfb877851" status: 200 len: 1313 microversion: 2.1 time: 0.687466 Oct 04 21:43:56.805249 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 107/229] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:43:56 2022] GET /compute/v2.1/servers/ec437ce7-b43a-4c8b-8a06-756cfb877851 => generated 1313 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:43:56.843122 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-e58bf392-a05b-4b41-a539-f371da0c41d5 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:56.843780 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-e58bf392-a05b-4b41-a539-f371da0c41d5 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] [instance: 4ca5960d-4a64-4a04-a849-d53180a038e9] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:43:56.853689 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e58bf392-a05b-4b41-a539-f371da0c41d5 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:56.854631 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e58bf392-a05b-4b41-a539-f371da0c41d5 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:56.856507 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e58bf392-a05b-4b41-a539-f371da0c41d5 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:56.857431 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e58bf392-a05b-4b41-a539-f371da0c41d5 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:56.860261 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e58bf392-a05b-4b41-a539-f371da0c41d5 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:56.861058 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e58bf392-a05b-4b41-a539-f371da0c41d5 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:57.142875 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-4046fc12-6b76-4d19-8fea-91c65ae1ac5a tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29842a669a20408b881105135f76cb0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39edf587afe94b60911198aa0bb61613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:43:57.155534 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-4046fc12-6b76-4d19-8fea-91c65ae1ac5a tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] 10.222.0.43 "GET /compute/v2.1/servers/4b0c3dd7-d609-4b00-8604-35f8a2680c14" status: 200 len: 1316 microversion: 2.1 time: 0.619147 Oct 04 21:43:57.175235 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 123/230] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:43:56 2022] GET /compute/v2.1/servers/4b0c3dd7-d609-4b00-8604-35f8a2680c14 => generated 1316 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:43:57.390343 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-1cd7de64-ac22-4bb6-91a6-baf65d277abd tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:57.391241 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-1cd7de64-ac22-4bb6-91a6-baf65d277abd tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] [instance: 4c692055-b3f9-494b-9279-5a8453ed88ba] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:43:57.401733 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1cd7de64-ac22-4bb6-91a6-baf65d277abd tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:57.403674 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1cd7de64-ac22-4bb6-91a6-baf65d277abd tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:57.404782 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1cd7de64-ac22-4bb6-91a6-baf65d277abd tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:57.408135 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1cd7de64-ac22-4bb6-91a6-baf65d277abd tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:57.408851 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1cd7de64-ac22-4bb6-91a6-baf65d277abd tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:57.410919 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1cd7de64-ac22-4bb6-91a6-baf65d277abd tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:57.419630 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=100 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:43:57.451468 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-e58bf392-a05b-4b41-a539-f371da0c41d5 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e00999a6faf349eea3be7680a855e8d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f306c099ef294f6da8637a8ddcdb46d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:43:57.463525 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-e58bf392-a05b-4b41-a539-f371da0c41d5 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] 10.222.0.43 "GET /compute/v2.1/servers/4ca5960d-4a64-4a04-a849-d53180a038e9" status: 200 len: 1338 microversion: 2.1 time: 0.624380 Oct 04 21:43:57.464119 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 108/231] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:43:56 2022] GET /compute/v2.1/servers/4ca5960d-4a64-4a04-a849-d53180a038e9 => generated 1338 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:43:57.508916 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=12,nova_api:INSERT=7 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:43:57.807161 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-1cd7de64-ac22-4bb6-91a6-baf65d277abd tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5387dbf4e24960809704c398fe999a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bedc0e10ab24824a40d06bb91626088', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:43:57.815535 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-18f8ae17-d054-446c-9fba-e2bd04a20d89 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:57.816105 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-18f8ae17-d054-446c-9fba-e2bd04a20d89 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: ec437ce7-b43a-4c8b-8a06-756cfb877851] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:43:57.821258 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-1cd7de64-ac22-4bb6-91a6-baf65d277abd tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] 10.222.0.43 "GET /compute/v2.1/servers/4c692055-b3f9-494b-9279-5a8453ed88ba" status: 200 len: 1491 microversion: 2.1 time: 0.435949 Oct 04 21:43:57.823237 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-18f8ae17-d054-446c-9fba-e2bd04a20d89 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:57.824149 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 124/232] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:43:57 2022] GET /compute/v2.1/servers/4c692055-b3f9-494b-9279-5a8453ed88ba => generated 1491 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:43:57.827109 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-18f8ae17-d054-446c-9fba-e2bd04a20d89 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:57.827749 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-18f8ae17-d054-446c-9fba-e2bd04a20d89 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:57.828492 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-18f8ae17-d054-446c-9fba-e2bd04a20d89 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:57.830286 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-18f8ae17-d054-446c-9fba-e2bd04a20d89 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:57.835021 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-18f8ae17-d054-446c-9fba-e2bd04a20d89 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:57.884091 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=100 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:43:58.222819 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-18f8ae17-d054-446c-9fba-e2bd04a20d89 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:43:58.231221 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-18f8ae17-d054-446c-9fba-e2bd04a20d89 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/ec437ce7-b43a-4c8b-8a06-756cfb877851" status: 200 len: 1313 microversion: 2.1 time: 0.419466 Oct 04 21:43:58.232348 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 109/233] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:43:57 2022] GET /compute/v2.1/servers/ec437ce7-b43a-4c8b-8a06-756cfb877851 => generated 1313 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:43:58.237816 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-cbd5f67a-8f02-48c8-a438-1f20e559ccba tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:58.238665 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-cbd5f67a-8f02-48c8-a438-1f20e559ccba tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] [instance: 4b0c3dd7-d609-4b00-8604-35f8a2680c14] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:43:58.245881 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cbd5f67a-8f02-48c8-a438-1f20e559ccba tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:58.246729 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cbd5f67a-8f02-48c8-a438-1f20e559ccba tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:58.247379 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cbd5f67a-8f02-48c8-a438-1f20e559ccba tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:58.248148 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cbd5f67a-8f02-48c8-a438-1f20e559ccba tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:58.248834 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cbd5f67a-8f02-48c8-a438-1f20e559ccba tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:58.249326 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cbd5f67a-8f02-48c8-a438-1f20e559ccba tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:58.328278 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-dc7a7da6-0c38-4a7f-bf86-019cda89e715 tempest-DeleteServersAdminTestJSON-312927555 tempest-DeleteServersAdminTestJSON-312927555-project-admin] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:58.329158 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-dc7a7da6-0c38-4a7f-bf86-019cda89e715 tempest-DeleteServersAdminTestJSON-312927555 tempest-DeleteServersAdminTestJSON-312927555-project-admin] [instance: 4c692055-b3f9-494b-9279-5a8453ed88ba] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:43:58.343068 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dc7a7da6-0c38-4a7f-bf86-019cda89e715 tempest-DeleteServersAdminTestJSON-312927555 tempest-DeleteServersAdminTestJSON-312927555-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:58.345847 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dc7a7da6-0c38-4a7f-bf86-019cda89e715 tempest-DeleteServersAdminTestJSON-312927555 tempest-DeleteServersAdminTestJSON-312927555-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:58.346585 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dc7a7da6-0c38-4a7f-bf86-019cda89e715 tempest-DeleteServersAdminTestJSON-312927555 tempest-DeleteServersAdminTestJSON-312927555-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:58.349107 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dc7a7da6-0c38-4a7f-bf86-019cda89e715 tempest-DeleteServersAdminTestJSON-312927555 tempest-DeleteServersAdminTestJSON-312927555-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:58.350619 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dc7a7da6-0c38-4a7f-bf86-019cda89e715 tempest-DeleteServersAdminTestJSON-312927555 tempest-DeleteServersAdminTestJSON-312927555-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:58.353189 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dc7a7da6-0c38-4a7f-bf86-019cda89e715 tempest-DeleteServersAdminTestJSON-312927555 tempest-DeleteServersAdminTestJSON-312927555-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:58.425292 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-cbd5f67a-8f02-48c8-a438-1f20e559ccba tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29842a669a20408b881105135f76cb0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39edf587afe94b60911198aa0bb61613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:43:58.436909 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-cbd5f67a-8f02-48c8-a438-1f20e559ccba tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] 10.222.0.43 "GET /compute/v2.1/servers/4b0c3dd7-d609-4b00-8604-35f8a2680c14" status: 200 len: 1316 microversion: 2.1 time: 0.202656 Oct 04 21:43:58.438028 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 110/234] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:43:58 2022] GET /compute/v2.1/servers/4b0c3dd7-d609-4b00-8604-35f8a2680c14 => generated 1316 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:43:58.485455 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-dc7a7da6-0c38-4a7f-bf86-019cda89e715 tempest-DeleteServersAdminTestJSON-312927555 tempest-DeleteServersAdminTestJSON-312927555-project-admin] [instance: 4c692055-b3f9-494b-9279-5a8453ed88ba] Going to try to terminate instance {{(pid=134101) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:43:58.493306 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-3f14bfe9-e463-40a8-9d96-d0a755bd7842 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:58.494294 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-3f14bfe9-e463-40a8-9d96-d0a755bd7842 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] [instance: 4ca5960d-4a64-4a04-a849-d53180a038e9] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:43:58.505913 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3f14bfe9-e463-40a8-9d96-d0a755bd7842 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:58.508898 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3f14bfe9-e463-40a8-9d96-d0a755bd7842 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:58.509620 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3f14bfe9-e463-40a8-9d96-d0a755bd7842 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:58.512092 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3f14bfe9-e463-40a8-9d96-d0a755bd7842 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:58.514918 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3f14bfe9-e463-40a8-9d96-d0a755bd7842 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:58.516617 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3f14bfe9-e463-40a8-9d96-d0a755bd7842 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:58.752626 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-dc7a7da6-0c38-4a7f-bf86-019cda89e715 tempest-DeleteServersAdminTestJSON-312927555 tempest-DeleteServersAdminTestJSON-312927555-project-admin] 10.222.0.43 "DELETE /compute/v2.1/servers/4c692055-b3f9-494b-9279-5a8453ed88ba" status: 204 len: 0 microversion: 2.1 time: 0.904132 Oct 04 21:43:58.757817 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 125/235] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 21:43:57 2022] DELETE /compute/v2.1/servers/4c692055-b3f9-494b-9279-5a8453ed88ba => generated 0 bytes in 908 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 21:43:58.767158 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-10f7fbb3-3059-43ce-be96-ef2afe53de9c tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:58.767417 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-10f7fbb3-3059-43ce-be96-ef2afe53de9c tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] [instance: 4c692055-b3f9-494b-9279-5a8453ed88ba] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:43:58.775020 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-10f7fbb3-3059-43ce-be96-ef2afe53de9c tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:58.775523 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-10f7fbb3-3059-43ce-be96-ef2afe53de9c tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:58.775964 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-10f7fbb3-3059-43ce-be96-ef2afe53de9c tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:58.776680 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-10f7fbb3-3059-43ce-be96-ef2afe53de9c tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:58.777139 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-10f7fbb3-3059-43ce-be96-ef2afe53de9c tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:58.777562 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-10f7fbb3-3059-43ce-be96-ef2afe53de9c tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:59.154398 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-3f14bfe9-e463-40a8-9d96-d0a755bd7842 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e00999a6faf349eea3be7680a855e8d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f306c099ef294f6da8637a8ddcdb46d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:43:59.167479 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-3f14bfe9-e463-40a8-9d96-d0a755bd7842 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] 10.222.0.43 "GET /compute/v2.1/servers/4ca5960d-4a64-4a04-a849-d53180a038e9" status: 200 len: 1338 microversion: 2.1 time: 0.680050 Oct 04 21:43:59.183828 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 111/236] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:43:58 2022] GET /compute/v2.1/servers/4ca5960d-4a64-4a04-a849-d53180a038e9 => generated 1338 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:43:59.270518 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-10f7fbb3-3059-43ce-be96-ef2afe53de9c tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5387dbf4e24960809704c398fe999a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bedc0e10ab24824a40d06bb91626088', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:43:59.280237 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-10f7fbb3-3059-43ce-be96-ef2afe53de9c tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] 10.222.0.43 "GET /compute/v2.1/servers/4c692055-b3f9-494b-9279-5a8453ed88ba" status: 200 len: 1497 microversion: 2.1 time: 0.519770 Oct 04 21:43:59.284619 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 126/237] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:43:58 2022] GET /compute/v2.1/servers/4c692055-b3f9-494b-9279-5a8453ed88ba => generated 1497 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:43:59.314614 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-8016493b-096f-4cce-9680-ae640f45b22d tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:59.317256 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-8016493b-096f-4cce-9680-ae640f45b22d tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: ec437ce7-b43a-4c8b-8a06-756cfb877851] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:43:59.332988 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8016493b-096f-4cce-9680-ae640f45b22d tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:59.333786 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8016493b-096f-4cce-9680-ae640f45b22d tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:59.334228 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8016493b-096f-4cce-9680-ae640f45b22d tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:59.338472 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8016493b-096f-4cce-9680-ae640f45b22d tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:59.338967 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8016493b-096f-4cce-9680-ae640f45b22d tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:59.339407 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8016493b-096f-4cce-9680-ae640f45b22d tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:59.434197 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-b5c71fa5-d1c5-430e-99fc-d1181d29313f tempest-InstanceUsageAuditLogTestJSON-1912248756 tempest-InstanceUsageAuditLogTestJSON-1912248756-project-admin] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:59.468621 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-b5c71fa5-d1c5-430e-99fc-d1181d29313f tempest-InstanceUsageAuditLogTestJSON-1912248756 tempest-InstanceUsageAuditLogTestJSON-1912248756-project-admin] 10.222.0.43 "GET /compute/v2.1/os-instance_usage_audit_log/2022-10-04 21:43:58" status: 200 len: 318 microversion: 2.1 time: 0.283312 Oct 04 21:43:59.469635 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 112/238] 10.222.0.43 () {58 vars in 1251 bytes} [Tue Oct 4 21:43:59 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-10-04%2021%3A43%3A58 => generated 318 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:43:59.476240 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-b5e445ce-8eee-4858-a806-8428fa93405c tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:59.477740 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-b5e445ce-8eee-4858-a806-8428fa93405c tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] [instance: 4b0c3dd7-d609-4b00-8604-35f8a2680c14] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:43:59.486856 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b5e445ce-8eee-4858-a806-8428fa93405c tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:59.487932 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b5e445ce-8eee-4858-a806-8428fa93405c tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:59.488615 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b5e445ce-8eee-4858-a806-8428fa93405c tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:59.489880 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b5e445ce-8eee-4858-a806-8428fa93405c tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:59.490678 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b5e445ce-8eee-4858-a806-8428fa93405c tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:59.491576 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b5e445ce-8eee-4858-a806-8428fa93405c tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:59.716832 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell0:SELECT=1 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:43:59.920317 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-b5e445ce-8eee-4858-a806-8428fa93405c tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29842a669a20408b881105135f76cb0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39edf587afe94b60911198aa0bb61613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:43:59.953135 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-8016493b-096f-4cce-9680-ae640f45b22d tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:43:59.961988 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-b5e445ce-8eee-4858-a806-8428fa93405c tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] 10.222.0.43 "GET /compute/v2.1/servers/4b0c3dd7-d609-4b00-8604-35f8a2680c14" status: 200 len: 1316 microversion: 2.1 time: 0.490425 Oct 04 21:43:59.964157 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 113/239] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:43:59 2022] GET /compute/v2.1/servers/4b0c3dd7-d609-4b00-8604-35f8a2680c14 => generated 1316 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:43:59.964809 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-8016493b-096f-4cce-9680-ae640f45b22d tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/ec437ce7-b43a-4c8b-8a06-756cfb877851" status: 200 len: 1313 microversion: 2.1 time: 0.658975 Oct 04 21:43:59.966219 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 127/240] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:43:59 2022] GET /compute/v2.1/servers/ec437ce7-b43a-4c8b-8a06-756cfb877851 => generated 1313 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:43:59.978163 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-6c9e71ee-a44e-4fd3-b58f-2c0fe8fa8e42 tempest-InstanceUsageAuditLogTestJSON-1912248756 tempest-InstanceUsageAuditLogTestJSON-1912248756-project-admin] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:00.009420 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-6c9e71ee-a44e-4fd3-b58f-2c0fe8fa8e42 tempest-InstanceUsageAuditLogTestJSON-1912248756 tempest-InstanceUsageAuditLogTestJSON-1912248756-project-admin] 10.222.0.43 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.040334 Oct 04 21:44:00.017418 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 114/241] 10.222.0.43 () {58 vars in 1185 bytes} [Tue Oct 4 21:43:59 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:44:00.214718 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-41617f50-0b86-4821-bcbd-4da922052174 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:00.215607 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-41617f50-0b86-4821-bcbd-4da922052174 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] [instance: 4ca5960d-4a64-4a04-a849-d53180a038e9] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:00.230344 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-41617f50-0b86-4821-bcbd-4da922052174 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:00.235483 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-41617f50-0b86-4821-bcbd-4da922052174 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:00.237917 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-41617f50-0b86-4821-bcbd-4da922052174 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:00.239409 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-41617f50-0b86-4821-bcbd-4da922052174 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:00.240571 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-41617f50-0b86-4821-bcbd-4da922052174 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:00.242683 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-41617f50-0b86-4821-bcbd-4da922052174 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:00.312478 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-277b5eb5-e3ff-4eb9-842d-23e1b67989af tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:00.313487 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-277b5eb5-e3ff-4eb9-842d-23e1b67989af tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] [instance: 4c692055-b3f9-494b-9279-5a8453ed88ba] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:00.336687 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-277b5eb5-e3ff-4eb9-842d-23e1b67989af tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:00.346253 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-277b5eb5-e3ff-4eb9-842d-23e1b67989af tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:00.347204 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-277b5eb5-e3ff-4eb9-842d-23e1b67989af tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:00.348746 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-277b5eb5-e3ff-4eb9-842d-23e1b67989af tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:00.349768 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-277b5eb5-e3ff-4eb9-842d-23e1b67989af tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:00.356072 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-277b5eb5-e3ff-4eb9-842d-23e1b67989af tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:00.546116 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-41617f50-0b86-4821-bcbd-4da922052174 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e00999a6faf349eea3be7680a855e8d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f306c099ef294f6da8637a8ddcdb46d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:44:00.555609 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-41617f50-0b86-4821-bcbd-4da922052174 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] 10.222.0.43 "GET /compute/v2.1/servers/4ca5960d-4a64-4a04-a849-d53180a038e9" status: 200 len: 1488 microversion: 2.1 time: 0.363045 Oct 04 21:44:00.556209 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 128/242] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:44:00 2022] GET /compute/v2.1/servers/4ca5960d-4a64-4a04-a849-d53180a038e9 => generated 1488 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:44:00.584512 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-4d1071c2-17db-4f24-8b09-b1341741ed4e tempest-AggregatesAdminTestJSON-1644938243 tempest-AggregatesAdminTestJSON-1644938243-project-admin] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:00.585394 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-4d1071c2-17db-4f24-8b09-b1341741ed4e tempest-AggregatesAdminTestJSON-1644938243 tempest-AggregatesAdminTestJSON-1644938243-project-admin] [instance: 4ca5960d-4a64-4a04-a849-d53180a038e9] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:00.595808 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4d1071c2-17db-4f24-8b09-b1341741ed4e tempest-AggregatesAdminTestJSON-1644938243 tempest-AggregatesAdminTestJSON-1644938243-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:00.596780 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4d1071c2-17db-4f24-8b09-b1341741ed4e tempest-AggregatesAdminTestJSON-1644938243 tempest-AggregatesAdminTestJSON-1644938243-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:00.597407 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4d1071c2-17db-4f24-8b09-b1341741ed4e tempest-AggregatesAdminTestJSON-1644938243 tempest-AggregatesAdminTestJSON-1644938243-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:00.598603 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4d1071c2-17db-4f24-8b09-b1341741ed4e tempest-AggregatesAdminTestJSON-1644938243 tempest-AggregatesAdminTestJSON-1644938243-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:00.599475 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4d1071c2-17db-4f24-8b09-b1341741ed4e tempest-AggregatesAdminTestJSON-1644938243 tempest-AggregatesAdminTestJSON-1644938243-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:00.600050 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4d1071c2-17db-4f24-8b09-b1341741ed4e tempest-AggregatesAdminTestJSON-1644938243 tempest-AggregatesAdminTestJSON-1644938243-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:00.799849 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-277b5eb5-e3ff-4eb9-842d-23e1b67989af tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5387dbf4e24960809704c398fe999a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bedc0e10ab24824a40d06bb91626088', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:44:00.815594 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-277b5eb5-e3ff-4eb9-842d-23e1b67989af tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] 10.222.0.43 "GET /compute/v2.1/servers/4c692055-b3f9-494b-9279-5a8453ed88ba" status: 200 len: 1497 microversion: 2.1 time: 0.507594 Oct 04 21:44:00.816207 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 115/243] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:44:00 2022] GET /compute/v2.1/servers/4c692055-b3f9-494b-9279-5a8453ed88ba => generated 1497 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:44:00.991477 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-bac60429-8a33-435f-8340-90cbdf9e488f tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:00.992069 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-bac60429-8a33-435f-8340-90cbdf9e488f tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: ec437ce7-b43a-4c8b-8a06-756cfb877851] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:01.030327 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bac60429-8a33-435f-8340-90cbdf9e488f tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:01.032353 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bac60429-8a33-435f-8340-90cbdf9e488f tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:01.033210 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bac60429-8a33-435f-8340-90cbdf9e488f tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:01.034656 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bac60429-8a33-435f-8340-90cbdf9e488f tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:01.035560 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bac60429-8a33-435f-8340-90cbdf9e488f tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:01.044830 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bac60429-8a33-435f-8340-90cbdf9e488f tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:01.247437 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-4d1071c2-17db-4f24-8b09-b1341741ed4e tempest-AggregatesAdminTestJSON-1644938243 tempest-AggregatesAdminTestJSON-1644938243-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/4ca5960d-4a64-4a04-a849-d53180a038e9" status: 200 len: 1639 microversion: 2.1 time: 0.669573 Oct 04 21:44:01.262775 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 129/244] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:44:00 2022] GET /compute/v2.1/servers/4ca5960d-4a64-4a04-a849-d53180a038e9 => generated 1639 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:44:01.271657 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-c1d80d15-e5f4-473e-ada8-aac300b13aef tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:01.272297 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-c1d80d15-e5f4-473e-ada8-aac300b13aef tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] [instance: 4b0c3dd7-d609-4b00-8604-35f8a2680c14] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:01.284632 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c1d80d15-e5f4-473e-ada8-aac300b13aef tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:01.285140 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c1d80d15-e5f4-473e-ada8-aac300b13aef tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:01.285584 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c1d80d15-e5f4-473e-ada8-aac300b13aef tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:01.286311 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c1d80d15-e5f4-473e-ada8-aac300b13aef tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:01.286807 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c1d80d15-e5f4-473e-ada8-aac300b13aef tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:01.287242 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c1d80d15-e5f4-473e-ada8-aac300b13aef tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:01.440804 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-bac60429-8a33-435f-8340-90cbdf9e488f tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:44:01.451132 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-bac60429-8a33-435f-8340-90cbdf9e488f tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/ec437ce7-b43a-4c8b-8a06-756cfb877851" status: 200 len: 1313 microversion: 2.1 time: 0.466301 Oct 04 21:44:01.453195 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 116/245] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:44:00 2022] GET /compute/v2.1/servers/ec437ce7-b43a-4c8b-8a06-756cfb877851 => generated 1313 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:44:01.458765 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-70612634-017c-442e-b190-e55bc17021d2 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:01.459574 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-70612634-017c-442e-b190-e55bc17021d2 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] [instance: 4ca5960d-4a64-4a04-a849-d53180a038e9] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:01.467346 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-70612634-017c-442e-b190-e55bc17021d2 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:01.476861 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-70612634-017c-442e-b190-e55bc17021d2 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:01.478048 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-70612634-017c-442e-b190-e55bc17021d2 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:01.479123 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-70612634-017c-442e-b190-e55bc17021d2 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:01.480149 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-70612634-017c-442e-b190-e55bc17021d2 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:01.480878 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-70612634-017c-442e-b190-e55bc17021d2 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:01.516126 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-70612634-017c-442e-b190-e55bc17021d2 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] [instance: 4ca5960d-4a64-4a04-a849-d53180a038e9] Going to try to terminate instance {{(pid=134102) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:44:01.573299 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-c1d80d15-e5f4-473e-ada8-aac300b13aef tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29842a669a20408b881105135f76cb0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39edf587afe94b60911198aa0bb61613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:44:01.589910 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-c1d80d15-e5f4-473e-ada8-aac300b13aef tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] 10.222.0.43 "GET /compute/v2.1/servers/4b0c3dd7-d609-4b00-8604-35f8a2680c14" status: 200 len: 1316 microversion: 2.1 time: 0.325709 Oct 04 21:44:01.598692 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 130/246] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:44:01 2022] GET /compute/v2.1/servers/4b0c3dd7-d609-4b00-8604-35f8a2680c14 => generated 1316 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:44:01.699541 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-70612634-017c-442e-b190-e55bc17021d2 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] 10.222.0.43 "DELETE /compute/v2.1/servers/4ca5960d-4a64-4a04-a849-d53180a038e9" status: 204 len: 0 microversion: 2.1 time: 0.244773 Oct 04 21:44:01.700707 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 117/247] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 21:44:01 2022] DELETE /compute/v2.1/servers/4ca5960d-4a64-4a04-a849-d53180a038e9 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:44:01.709276 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-2174df1c-8a8a-409f-87c3-cfd8ce3edee8 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:01.710390 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-2174df1c-8a8a-409f-87c3-cfd8ce3edee8 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] [instance: 4ca5960d-4a64-4a04-a849-d53180a038e9] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:01.718134 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2174df1c-8a8a-409f-87c3-cfd8ce3edee8 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:01.718845 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2174df1c-8a8a-409f-87c3-cfd8ce3edee8 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:01.719668 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2174df1c-8a8a-409f-87c3-cfd8ce3edee8 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:01.720789 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2174df1c-8a8a-409f-87c3-cfd8ce3edee8 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:01.721455 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2174df1c-8a8a-409f-87c3-cfd8ce3edee8 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:01.722401 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2174df1c-8a8a-409f-87c3-cfd8ce3edee8 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:01.848828 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-7260c653-94e7-4e5f-9670-890cf991c29a tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:01.850034 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-7260c653-94e7-4e5f-9670-890cf991c29a tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] [instance: 4c692055-b3f9-494b-9279-5a8453ed88ba] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:01.872696 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7260c653-94e7-4e5f-9670-890cf991c29a tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:01.873231 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7260c653-94e7-4e5f-9670-890cf991c29a tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:01.873681 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7260c653-94e7-4e5f-9670-890cf991c29a tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:01.874435 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7260c653-94e7-4e5f-9670-890cf991c29a tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:01.879858 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7260c653-94e7-4e5f-9670-890cf991c29a tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:01.880486 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7260c653-94e7-4e5f-9670-890cf991c29a tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:02.043006 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-7260c653-94e7-4e5f-9670-890cf991c29a tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5387dbf4e24960809704c398fe999a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bedc0e10ab24824a40d06bb91626088', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:44:02.056523 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-7260c653-94e7-4e5f-9670-890cf991c29a tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] 10.222.0.43 "GET /compute/v2.1/servers/4c692055-b3f9-494b-9279-5a8453ed88ba" status: 200 len: 1455 microversion: 2.1 time: 0.211356 Oct 04 21:44:02.057294 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 118/248] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:44:01 2022] GET /compute/v2.1/servers/4c692055-b3f9-494b-9279-5a8453ed88ba => generated 1455 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:44:02.105671 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-2174df1c-8a8a-409f-87c3-cfd8ce3edee8 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e00999a6faf349eea3be7680a855e8d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f306c099ef294f6da8637a8ddcdb46d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:44:02.140652 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-2174df1c-8a8a-409f-87c3-cfd8ce3edee8 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] 10.222.0.43 "GET /compute/v2.1/servers/4ca5960d-4a64-4a04-a849-d53180a038e9" status: 200 len: 1494 microversion: 2.1 time: 0.422766 Oct 04 21:44:02.141566 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 131/249] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:44:01 2022] GET /compute/v2.1/servers/4ca5960d-4a64-4a04-a849-d53180a038e9 => generated 1494 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:44:02.361062 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-ba6f5901-6d7d-4fe2-86b2-9748cb881985 req-e0a4d5ed-9fc5-4c4a-9b24-061feaeb6db7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b0c3dd7-d609-4b00-8604-35f8a2680c14", "name": "network-vif-plugged", "status": "completed", "tag": "b5c45de7-635e-4f30-8ac6-17479c140cb5"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:44:02.381974 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-ba6f5901-6d7d-4fe2-86b2-9748cb881985 req-e0a4d5ed-9fc5-4c4a-9b24-061feaeb6db7 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:02.387597 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-ba6f5901-6d7d-4fe2-86b2-9748cb881985 req-e0a4d5ed-9fc5-4c4a-9b24-061feaeb6db7 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:02.388189 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-ba6f5901-6d7d-4fe2-86b2-9748cb881985 req-e0a4d5ed-9fc5-4c4a-9b24-061feaeb6db7 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:02.397581 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-b4e1b268-0bb2-49a6-a3ef-3e60211e0d0e req-43ef24d5-27be-47cb-b1d1-52d60d32b8ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c692055-b3f9-494b-9279-5a8453ed88ba", "name": "network-vif-deleted", "tag": "f333f58f-c707-413f-85bd-d2d8eaec8ea8"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:44:02.409199 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-b4e1b268-0bb2-49a6-a3ef-3e60211e0d0e req-43ef24d5-27be-47cb-b1d1-52d60d32b8ed service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:02.409412 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-b4e1b268-0bb2-49a6-a3ef-3e60211e0d0e req-43ef24d5-27be-47cb-b1d1-52d60d32b8ed service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:02.410588 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-b4e1b268-0bb2-49a6-a3ef-3e60211e0d0e req-43ef24d5-27be-47cb-b1d1-52d60d32b8ed service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:02.415618 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-ba6f5901-6d7d-4fe2-86b2-9748cb881985 req-e0a4d5ed-9fc5-4c4a-9b24-061feaeb6db7 service nova] Creating event network-vif-plugged:b5c45de7-635e-4f30-8ac6-17479c140cb5 for instance 4b0c3dd7-d609-4b00-8604-35f8a2680c14 on n-h2-860284-1 Oct 04 21:44:02.428891 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-ba6f5901-6d7d-4fe2-86b2-9748cb881985 req-e0a4d5ed-9fc5-4c4a-9b24-061feaeb6db7 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071480 Oct 04 21:44:02.430666 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 119/250] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:44:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:44:02.434998 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-b4e1b268-0bb2-49a6-a3ef-3e60211e0d0e req-43ef24d5-27be-47cb-b1d1-52d60d32b8ed service nova] Creating event network-vif-deleted:f333f58f-c707-413f-85bd-d2d8eaec8ea8 for instance 4c692055-b3f9-494b-9279-5a8453ed88ba on n-h1-860284-1 Oct 04 21:44:02.441257 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-b4e1b268-0bb2-49a6-a3ef-3e60211e0d0e req-43ef24d5-27be-47cb-b1d1-52d60d32b8ed service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047400 Oct 04 21:44:02.442565 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 132/251] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:44:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:44:02.482241 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-ceef8b8f-2e20-438a-86ab-b18af2dbe51f tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:02.483564 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-ceef8b8f-2e20-438a-86ab-b18af2dbe51f tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: ec437ce7-b43a-4c8b-8a06-756cfb877851] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:02.494392 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ceef8b8f-2e20-438a-86ab-b18af2dbe51f tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:02.495610 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ceef8b8f-2e20-438a-86ab-b18af2dbe51f tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:02.509293 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ceef8b8f-2e20-438a-86ab-b18af2dbe51f tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:02.510632 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ceef8b8f-2e20-438a-86ab-b18af2dbe51f tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:02.512098 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ceef8b8f-2e20-438a-86ab-b18af2dbe51f tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:02.513885 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ceef8b8f-2e20-438a-86ab-b18af2dbe51f tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:02.624483 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-ae91ddaa-e59e-47b5-8d24-c0724ddcf4b2 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:02.627298 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-ae91ddaa-e59e-47b5-8d24-c0724ddcf4b2 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] [instance: 4b0c3dd7-d609-4b00-8604-35f8a2680c14] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:02.640681 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ae91ddaa-e59e-47b5-8d24-c0724ddcf4b2 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:02.642523 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ae91ddaa-e59e-47b5-8d24-c0724ddcf4b2 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:02.646277 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ae91ddaa-e59e-47b5-8d24-c0724ddcf4b2 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:02.651902 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ae91ddaa-e59e-47b5-8d24-c0724ddcf4b2 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:02.653052 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ae91ddaa-e59e-47b5-8d24-c0724ddcf4b2 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:02.655997 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ae91ddaa-e59e-47b5-8d24-c0724ddcf4b2 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:03.082242 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-ceef8b8f-2e20-438a-86ab-b18af2dbe51f tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:44:03.098815 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-ceef8b8f-2e20-438a-86ab-b18af2dbe51f tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/ec437ce7-b43a-4c8b-8a06-756cfb877851" status: 200 len: 1313 microversion: 2.1 time: 0.623266 Oct 04 21:44:03.113503 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 120/252] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:44:02 2022] GET /compute/v2.1/servers/ec437ce7-b43a-4c8b-8a06-756cfb877851 => generated 1313 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:44:03.131404 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-eb53c530-3893-4ba8-b2b1-211e5c348e1b tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:03.137953 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-eb53c530-3893-4ba8-b2b1-211e5c348e1b tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] [instance: 4c692055-b3f9-494b-9279-5a8453ed88ba] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:03.161125 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-eb53c530-3893-4ba8-b2b1-211e5c348e1b tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:03.161669 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-eb53c530-3893-4ba8-b2b1-211e5c348e1b tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:03.165669 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-eb53c530-3893-4ba8-b2b1-211e5c348e1b tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:03.166916 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-eb53c530-3893-4ba8-b2b1-211e5c348e1b tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:03.167409 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-eb53c530-3893-4ba8-b2b1-211e5c348e1b tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:03.169673 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-eb53c530-3893-4ba8-b2b1-211e5c348e1b tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:03.212077 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-ae91ddaa-e59e-47b5-8d24-c0724ddcf4b2 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29842a669a20408b881105135f76cb0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39edf587afe94b60911198aa0bb61613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:44:03.221747 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-ae91ddaa-e59e-47b5-8d24-c0724ddcf4b2 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] 10.222.0.43 "GET /compute/v2.1/servers/4b0c3dd7-d609-4b00-8604-35f8a2680c14" status: 200 len: 1316 microversion: 2.1 time: 0.601840 Oct 04 21:44:03.236328 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 133/253] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:44:02 2022] GET /compute/v2.1/servers/4b0c3dd7-d609-4b00-8604-35f8a2680c14 => generated 1316 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:44:03.513474 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-eb53c530-3893-4ba8-b2b1-211e5c348e1b tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:03.514232 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-eb53c530-3893-4ba8-b2b1-211e5c348e1b tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:03.514725 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-eb53c530-3893-4ba8-b2b1-211e5c348e1b tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:03.515221 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.objects.instance [None req-eb53c530-3893-4ba8-b2b1-211e5c348e1b tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lazy-loading 'fault' on Instance uuid 4c692055-b3f9-494b-9279-5a8453ed88ba {{(pid=134102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:44:03.634146 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-eb53c530-3893-4ba8-b2b1-211e5c348e1b tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5387dbf4e24960809704c398fe999a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bedc0e10ab24824a40d06bb91626088', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:44:03.645729 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-eb53c530-3893-4ba8-b2b1-211e5c348e1b tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] 10.222.0.43 "GET /compute/v2.1/servers/4c692055-b3f9-494b-9279-5a8453ed88ba" status: 200 len: 1331 microversion: 2.1 time: 0.529468 Oct 04 21:44:03.647483 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 121/254] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:44:03 2022] GET /compute/v2.1/servers/4c692055-b3f9-494b-9279-5a8453ed88ba => generated 1331 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:44:03.660024 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-b52335aa-53c0-4e38-9197-d81654867071 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:03.661879 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-b52335aa-53c0-4e38-9197-d81654867071 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] [instance: 4ca5960d-4a64-4a04-a849-d53180a038e9] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:03.674649 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b52335aa-53c0-4e38-9197-d81654867071 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:03.678151 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b52335aa-53c0-4e38-9197-d81654867071 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:03.678730 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b52335aa-53c0-4e38-9197-d81654867071 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:03.680506 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b52335aa-53c0-4e38-9197-d81654867071 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:03.682274 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b52335aa-53c0-4e38-9197-d81654867071 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:03.682765 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b52335aa-53c0-4e38-9197-d81654867071 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:03.706782 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-825ea66a-4e5a-4e48-8650-536ec5e2d7cd tempest-QuotasAdminTestV257-77313393 tempest-QuotasAdminTestV257-77313393-project-admin] Action: 'update', calling method: .version_select at 0x7fbb2fcde9d0>, body: {"quota_set": {"ram": "5120"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:44:03.816792 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-825ea66a-4e5a-4e48-8650-536ec5e2d7cd tempest-QuotasAdminTestV257-77313393 tempest-QuotasAdminTestV257-77313393-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:03.818319 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-825ea66a-4e5a-4e48-8650-536ec5e2d7cd tempest-QuotasAdminTestV257-77313393 tempest-QuotasAdminTestV257-77313393-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:03.818999 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-825ea66a-4e5a-4e48-8650-536ec5e2d7cd tempest-QuotasAdminTestV257-77313393 tempest-QuotasAdminTestV257-77313393-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:03.823160 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-825ea66a-4e5a-4e48-8650-536ec5e2d7cd tempest-QuotasAdminTestV257-77313393 tempest-QuotasAdminTestV257-77313393-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:03.823954 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-825ea66a-4e5a-4e48-8650-536ec5e2d7cd tempest-QuotasAdminTestV257-77313393 tempest-QuotasAdminTestV257-77313393-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:03.825777 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-825ea66a-4e5a-4e48-8650-536ec5e2d7cd tempest-QuotasAdminTestV257-77313393 tempest-QuotasAdminTestV257-77313393-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:03.918671 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-825ea66a-4e5a-4e48-8650-536ec5e2d7cd tempest-QuotasAdminTestV257-77313393 tempest-QuotasAdminTestV257-77313393-project-admin] 10.222.0.43 "PUT /compute/v2.1/os-quota-sets/1464791159a14c389e1002a40940f81a" status: 200 len: 148 microversion: 2.57 time: 0.679727 Oct 04 21:44:03.920533 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 134/255] 10.222.0.43 () {62 vars in 1303 bytes} [Tue Oct 4 21:44:03 2022] PUT /compute/v2.1/os-quota-sets/1464791159a14c389e1002a40940f81a => generated 148 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:44:03.959610 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-b52335aa-53c0-4e38-9197-d81654867071 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e00999a6faf349eea3be7680a855e8d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f306c099ef294f6da8637a8ddcdb46d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:44:03.973293 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-b52335aa-53c0-4e38-9197-d81654867071 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] 10.222.0.43 "GET /compute/v2.1/servers/4ca5960d-4a64-4a04-a849-d53180a038e9" status: 200 len: 1494 microversion: 2.1 time: 0.323083 Oct 04 21:44:03.974446 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 122/256] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:44:03 2022] GET /compute/v2.1/servers/4ca5960d-4a64-4a04-a849-d53180a038e9 => generated 1494 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:44:03.993171 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-fe033623-70a4-418a-94bf-76868f36c53e tempest-QuotasAdminTestV257-77313393 tempest-QuotasAdminTestV257-77313393-project-admin] Calling method '.version_select at 0x7fbb2fbda940>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:04.105399 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fe033623-70a4-418a-94bf-76868f36c53e tempest-QuotasAdminTestV257-77313393 tempest-QuotasAdminTestV257-77313393-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:04.110067 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fe033623-70a4-418a-94bf-76868f36c53e tempest-QuotasAdminTestV257-77313393 tempest-QuotasAdminTestV257-77313393-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:04.110751 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fe033623-70a4-418a-94bf-76868f36c53e tempest-QuotasAdminTestV257-77313393 tempest-QuotasAdminTestV257-77313393-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:04.111960 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fe033623-70a4-418a-94bf-76868f36c53e tempest-QuotasAdminTestV257-77313393 tempest-QuotasAdminTestV257-77313393-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:04.112788 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fe033623-70a4-418a-94bf-76868f36c53e tempest-QuotasAdminTestV257-77313393 tempest-QuotasAdminTestV257-77313393-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:04.113759 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fe033623-70a4-418a-94bf-76868f36c53e tempest-QuotasAdminTestV257-77313393 tempest-QuotasAdminTestV257-77313393-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:04.180385 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-fe033623-70a4-418a-94bf-76868f36c53e tempest-QuotasAdminTestV257-77313393 tempest-QuotasAdminTestV257-77313393-project-admin] 10.222.0.43 "GET /compute/v2.1/os-quota-sets/1464791159a14c389e1002a40940f81a/detail" status: 200 len: 463 microversion: 2.57 time: 0.192000 Oct 04 21:44:04.184031 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 123/257] 10.222.0.43 () {60 vars in 1304 bytes} [Tue Oct 4 21:44:03 2022] GET /compute/v2.1/os-quota-sets/1464791159a14c389e1002a40940f81a/detail => generated 463 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:44:04.190276 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-aa0ddf3d-b684-497d-bb47-bc238831c217 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:04.202818 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-aa0ddf3d-b684-497d-bb47-bc238831c217 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] 10.222.0.43 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.280958 Oct 04 21:44:04.204526 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-6660a2ed-06e3-4593-be8a-55b4768243ce tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:04.205756 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 135/258] 10.222.0.43 () {58 vars in 1137 bytes} [Tue Oct 4 21:44:03 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:44:04.207157 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-6660a2ed-06e3-4593-be8a-55b4768243ce tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: ec437ce7-b43a-4c8b-8a06-756cfb877851] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:04.228896 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6660a2ed-06e3-4593-be8a-55b4768243ce tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:04.230525 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6660a2ed-06e3-4593-be8a-55b4768243ce tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:04.232888 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6660a2ed-06e3-4593-be8a-55b4768243ce tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:04.233839 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6660a2ed-06e3-4593-be8a-55b4768243ce tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:04.235162 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6660a2ed-06e3-4593-be8a-55b4768243ce tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:04.236839 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6660a2ed-06e3-4593-be8a-55b4768243ce tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:04.332555 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-dba3932e-5e3d-4eff-ad17-8bbb211d4687 tempest-ServersWithSpecificFlavorTestJSON-535050999 tempest-ServersWithSpecificFlavorTestJSON-535050999-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-2078834911", "id": 1684035327, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:44:04.368740 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-dba3932e-5e3d-4eff-ad17-8bbb211d4687 tempest-ServersWithSpecificFlavorTestJSON-535050999 tempest-ServersWithSpecificFlavorTestJSON-535050999-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 425 microversion: 2.1 time: 0.150572 Oct 04 21:44:04.369375 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 136/259] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 21:44:04 2022] POST /compute/v2.1/flavors => generated 425 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:44:04.374735 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-0eaa72b9-fff2-4f8e-9855-3794391995a7 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:04.384010 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-0eaa72b9-fff2-4f8e-9855-3794391995a7 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] [instance: 4b0c3dd7-d609-4b00-8604-35f8a2680c14] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:04.391315 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0eaa72b9-fff2-4f8e-9855-3794391995a7 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:04.391810 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0eaa72b9-fff2-4f8e-9855-3794391995a7 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:04.392369 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0eaa72b9-fff2-4f8e-9855-3794391995a7 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:04.393079 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0eaa72b9-fff2-4f8e-9855-3794391995a7 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:04.402395 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0eaa72b9-fff2-4f8e-9855-3794391995a7 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:04.403877 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0eaa72b9-fff2-4f8e-9855-3794391995a7 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:04.571448 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-6660a2ed-06e3-4593-be8a-55b4768243ce tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:44:04.588345 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-6660a2ed-06e3-4593-be8a-55b4768243ce tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/ec437ce7-b43a-4c8b-8a06-756cfb877851" status: 200 len: 1313 microversion: 2.1 time: 0.400676 Oct 04 21:44:04.591278 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 124/260] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:44:04 2022] GET /compute/v2.1/servers/ec437ce7-b43a-4c8b-8a06-756cfb877851 => generated 1313 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:44:04.599109 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-e5d16e68-ef93-4de2-8bad-6ea6d75c6faf tempest-ServersWithSpecificFlavorTestJSON-535050999 tempest-ServersWithSpecificFlavorTestJSON-535050999-project-admin] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:04.615206 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-e5d16e68-ef93-4de2-8bad-6ea6d75c6faf tempest-ServersWithSpecificFlavorTestJSON-535050999 tempest-ServersWithSpecificFlavorTestJSON-535050999-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.020992 Oct 04 21:44:04.616367 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 125/261] 10.222.0.43 () {58 vars in 1182 bytes} [Tue Oct 4 21:44:04 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 21:44:04.624463 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-76549e48-a43b-43f4-9283-8470f73d3b33 req-7f07ef41-71a0-492e-b1d0-cf4d32fd303f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ca5960d-4a64-4a04-a849-d53180a038e9", "name": "network-vif-deleted", "tag": "a854dcbe-0256-4f2a-8a54-097e0782c576"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:44:04.662810 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-76549e48-a43b-43f4-9283-8470f73d3b33 req-7f07ef41-71a0-492e-b1d0-cf4d32fd303f service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:04.664824 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-76549e48-a43b-43f4-9283-8470f73d3b33 req-7f07ef41-71a0-492e-b1d0-cf4d32fd303f service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:04.667031 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-76549e48-a43b-43f4-9283-8470f73d3b33 req-7f07ef41-71a0-492e-b1d0-cf4d32fd303f service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:04.688093 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-76549e48-a43b-43f4-9283-8470f73d3b33 req-7f07ef41-71a0-492e-b1d0-cf4d32fd303f service nova] Creating event network-vif-deleted:a854dcbe-0256-4f2a-8a54-097e0782c576 for instance 4ca5960d-4a64-4a04-a849-d53180a038e9 on n-h1-860284-1 Oct 04 21:44:04.703026 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-76549e48-a43b-43f4-9283-8470f73d3b33 req-7f07ef41-71a0-492e-b1d0-cf4d32fd303f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084967 Oct 04 21:44:04.704769 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 126/262] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:44:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:44:04.718925 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-6ae2c247-d9a4-472d-a176-4926b0d8505d tempest-ServersWithSpecificFlavorTestJSON-535050999 tempest-ServersWithSpecificFlavorTestJSON-535050999-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-1150257664", "id": 1135919845, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:44:04.751684 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-0eaa72b9-fff2-4f8e-9855-3794391995a7 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29842a669a20408b881105135f76cb0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39edf587afe94b60911198aa0bb61613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:44:04.769175 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-0eaa72b9-fff2-4f8e-9855-3794391995a7 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] 10.222.0.43 "GET /compute/v2.1/servers/4b0c3dd7-d609-4b00-8604-35f8a2680c14" status: 200 len: 1316 microversion: 2.1 time: 0.398718 Oct 04 21:44:04.787223 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-6ae2c247-d9a4-472d-a176-4926b0d8505d tempest-ServersWithSpecificFlavorTestJSON-535050999 tempest-ServersWithSpecificFlavorTestJSON-535050999-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 425 microversion: 2.1 time: 0.070656 Oct 04 21:44:04.787223 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 127/263] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 21:44:04 2022] POST /compute/v2.1/flavors => generated 425 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:44:04.791719 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 137/264] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:44:04 2022] GET /compute/v2.1/servers/4b0c3dd7-d609-4b00-8604-35f8a2680c14 => generated 1316 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:44:04.796834 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-a3ad1f72-d748-44ff-9a0a-ef683b519b35 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:04.803514 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-239d5023-4421-49c1-98a3-bb1c89006cc0 tempest-QuotasAdminTestV257-77313393 tempest-QuotasAdminTestV257-77313393-project-admin] Action: 'update', calling method: .version_select at 0x7fbb2f9e90d0>, body: {"quota_set": {"ram": "2048"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:44:04.807132 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-a3ad1f72-d748-44ff-9a0a-ef683b519b35 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] [instance: 4c692055-b3f9-494b-9279-5a8453ed88ba] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:04.826811 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a3ad1f72-d748-44ff-9a0a-ef683b519b35 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:04.827376 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a3ad1f72-d748-44ff-9a0a-ef683b519b35 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:04.828004 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a3ad1f72-d748-44ff-9a0a-ef683b519b35 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:04.832532 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a3ad1f72-d748-44ff-9a0a-ef683b519b35 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:04.833317 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a3ad1f72-d748-44ff-9a0a-ef683b519b35 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:04.834066 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a3ad1f72-d748-44ff-9a0a-ef683b519b35 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:04.895639 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-a3ad1f72-d748-44ff-9a0a-ef683b519b35 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] HTTP exception thrown: Instance 4c692055-b3f9-494b-9279-5a8453ed88ba could not be found. Oct 04 21:44:04.907134 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-a3ad1f72-d748-44ff-9a0a-ef683b519b35 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Request method failure captured: Oct 04 21:44:04.907134 n-d-860284-1 devstack@n-api.service[134102]: request: GET /compute/v2.1/servers/4c692055-b3f9-494b-9279-5a8453ed88ba HTTP/1.1 Oct 04 21:44:04.907134 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 21:44:04.907134 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 21:44:04.907134 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 21:44:04.907134 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 21:44:04.907134 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 21:44:04.907134 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 21:44:04.907134 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 21:44:04.907134 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 21:44:04.907134 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPKj0XGeKm2g_qPwErsswiNEsFafdM876zP1siE1RChjqpTQzJBQEzEMmI5SqRXlWrc07EOkeF-Dny846FNq3CLCkYfCxbHV9T-RVeJQnBGG8eKeZ7Jtc8LtS843Vcp967P9tKprMM0Xrie19pHtIm7NCLBt42bJ74ED9x75hbBtbYtQ Oct 04 21:44:04.907134 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 21:44:04.907134 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 21:44:04.907134 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 21:44:04.907134 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 21:44:04.907134 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 21:44:04.907134 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 21:44:04.907134 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: 7bedc0e10ab24824a40d06bb91626088 Oct 04 21:44:04.907134 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-DeleteServersAdminTestJSON-2053137461 Oct 04 21:44:04.907134 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 21:44:04.907134 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 21:44:04.908313 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/7bedc0e10ab24824a40d06bb91626088"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_7bedc0e10ab24824a40d06bb91626088", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/7bedc0e10ab24824a40d06bb91626088"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/7bedc0e10ab24824a40d06bb91626088"}]}] Oct 04 21:44:04.908313 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-DeleteServersAdminTestJSON-2053137461 Oct 04 21:44:04.908313 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: 7bedc0e10ab24824a40d06bb91626088 Oct 04 21:44:04.908313 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-2053137461 Oct 04 21:44:04.908313 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-DeleteServersAdminTestJSON-2053137461-project Oct 04 21:44:04.908313 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 21:44:04.908313 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 21:44:04.908313 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: af5387dbf4e24960809704c398fe999a Oct 04 21:44:04.908313 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-DeleteServersAdminTestJSON-2053137461-project Oct 04 21:44:04.908313 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 21:44:04.908313 n-d-860284-1 devstack@n-api.service[134102]: exception: Instance 4c692055-b3f9-494b-9279-5a8453ed88ba could not be found. Oct 04 21:44:04.908313 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': '4c692055-b3f9-494b-9279-5a8453ed88ba'} Oct 04 21:44:04.908969 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:44:04.908969 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:44:04.908969 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:44:04.908969 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:44:04.908969 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:44:04.908969 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:44:04.908969 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:44:04.908969 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:44:04.908969 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:44:04.908969 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:44:04.908969 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c692055-b3f9-494b-9279-5a8453ed88ba could not be found. Oct 04 21:44:04.908969 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:44:04.908969 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:44:04.908969 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:44:04.908969 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:44:04.908969 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:44:04.908969 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:44:04.908969 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:44:04.908969 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:44:04.908969 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:44:04.910014 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:44:04.910014 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:44:04.910014 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:44:04.910014 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:44:04.910014 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:44:04.910014 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:44:04.910014 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:44:04.910014 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c692055-b3f9-494b-9279-5a8453ed88ba could not be found. Oct 04 21:44:04.910014 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:44:04.910014 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:44:04.910014 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:44:04.910014 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:44:04.910014 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:44:04.910014 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:44:04.910014 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:44:04.910014 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:44:04.910014 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c692055-b3f9-494b-9279-5a8453ed88ba could not be found. Oct 04 21:44:04.910014 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:44:04.910971 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-a3ad1f72-d748-44ff-9a0a-ef683b519b35 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Returning 404 to user: Instance 4c692055-b3f9-494b-9279-5a8453ed88ba could not be found. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:44:04.910971 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-a3ad1f72-d748-44ff-9a0a-ef683b519b35 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] 10.222.0.43 "GET /compute/v2.1/servers/4c692055-b3f9-494b-9279-5a8453ed88ba" status: 404 len: 111 microversion: 2.1 time: 0.125584 Oct 04 21:44:04.910971 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 128/265] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:44:04 2022] GET /compute/v2.1/servers/4c692055-b3f9-494b-9279-5a8453ed88ba => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:44:04.927851 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-eaf658a6-1685-4865-bb9c-d887241a62b6 tempest-ServersWithSpecificFlavorTestJSON-535050999 tempest-ServersWithSpecificFlavorTestJSON-535050999-project-admin] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:04.955299 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-eaf658a6-1685-4865-bb9c-d887241a62b6 tempest-ServersWithSpecificFlavorTestJSON-535050999 tempest-ServersWithSpecificFlavorTestJSON-535050999-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.044514 Oct 04 21:44:04.958425 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 129/266] 10.222.0.43 () {58 vars in 1182 bytes} [Tue Oct 4 21:44:04 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 21:44:04.973365 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-fc9f2e80-9e85-48a7-bef2-a359af63b2e6 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Action: 'create', calling method: .version_select at 0x7fbb2fc24ee0>, body: {"keypair": {"name": "tempest-keypair-1617998943", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFEBWc9g6uAi16m02hWtaeftm6r/DgDxJBR0gmfSGKQkv0s8fNXDDVINZJeAaai1OXpa7RPtCiZId24ppIgmHkXjPTFh5BzDkB4ARxvKS/gOJFi8321pti8qsZvr7t3+bA=="}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:44:04.997413 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-fc9f2e80-9e85-48a7-bef2-a359af63b2e6 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Getting quotas for project da67fc95e2814f4086df020f4c475764. Resources: {'key_pairs'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:44:05.003436 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-fc9f2e80-9e85-48a7-bef2-a359af63b2e6 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Getting quotas for user 1789bb97219a4e1591632126812ea6df and project da67fc95e2814f4086df020f4c475764. Resources: {'key_pairs'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:44:05.036397 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-fc9f2e80-9e85-48a7-bef2-a359af63b2e6 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.068480 Oct 04 21:44:05.043887 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 130/267] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Oct 4 21:44:04 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:44:05.058255 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-10742424-bca5-4b87-b193-b5f0e167fe5d tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:05.058918 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-10742424-bca5-4b87-b193-b5f0e167fe5d tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] [instance: 4ca5960d-4a64-4a04-a849-d53180a038e9] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:05.067546 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_api:SELECT=86,nova_api:UPDATE=12,nova_api:INSERT=2 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:44:05.069047 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-10742424-bca5-4b87-b193-b5f0e167fe5d tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:05.069587 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-10742424-bca5-4b87-b193-b5f0e167fe5d tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:05.070870 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-10742424-bca5-4b87-b193-b5f0e167fe5d tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:05.071809 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-10742424-bca5-4b87-b193-b5f0e167fe5d tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:05.072398 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-10742424-bca5-4b87-b193-b5f0e167fe5d tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:05.073526 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-10742424-bca5-4b87-b193-b5f0e167fe5d tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:05.140701 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-10742424-bca5-4b87-b193-b5f0e167fe5d tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:05.141214 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-10742424-bca5-4b87-b193-b5f0e167fe5d tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:05.141656 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-10742424-bca5-4b87-b193-b5f0e167fe5d tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:05.142127 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.objects.instance [None req-10742424-bca5-4b87-b193-b5f0e167fe5d tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Lazy-loading 'fault' on Instance uuid 4ca5960d-4a64-4a04-a849-d53180a038e9 {{(pid=134102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:44:05.221624 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-239d5023-4421-49c1-98a3-bb1c89006cc0 tempest-QuotasAdminTestV257-77313393 tempest-QuotasAdminTestV257-77313393-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:05.222194 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-239d5023-4421-49c1-98a3-bb1c89006cc0 tempest-QuotasAdminTestV257-77313393 tempest-QuotasAdminTestV257-77313393-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:05.223066 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-239d5023-4421-49c1-98a3-bb1c89006cc0 tempest-QuotasAdminTestV257-77313393 tempest-QuotasAdminTestV257-77313393-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:05.224668 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-239d5023-4421-49c1-98a3-bb1c89006cc0 tempest-QuotasAdminTestV257-77313393 tempest-QuotasAdminTestV257-77313393-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:05.225746 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-239d5023-4421-49c1-98a3-bb1c89006cc0 tempest-QuotasAdminTestV257-77313393 tempest-QuotasAdminTestV257-77313393-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:05.226531 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-239d5023-4421-49c1-98a3-bb1c89006cc0 tempest-QuotasAdminTestV257-77313393 tempest-QuotasAdminTestV257-77313393-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:05.264632 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-10742424-bca5-4b87-b193-b5f0e167fe5d tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e00999a6faf349eea3be7680a855e8d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f306c099ef294f6da8637a8ddcdb46d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:44:05.276799 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-10742424-bca5-4b87-b193-b5f0e167fe5d tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] 10.222.0.43 "GET /compute/v2.1/servers/4ca5960d-4a64-4a04-a849-d53180a038e9" status: 200 len: 1328 microversion: 2.1 time: 0.231604 Oct 04 21:44:05.277912 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 131/268] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:44:05 2022] GET /compute/v2.1/servers/4ca5960d-4a64-4a04-a849-d53180a038e9 => generated 1328 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:44:05.304071 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-7f655ef2-41d5-49f4-8f1c-6512fd5c2195 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-2044937839", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452"}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:44:05.361696 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-239d5023-4421-49c1-98a3-bb1c89006cc0 tempest-QuotasAdminTestV257-77313393 tempest-QuotasAdminTestV257-77313393-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:05.362301 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-239d5023-4421-49c1-98a3-bb1c89006cc0 tempest-QuotasAdminTestV257-77313393 tempest-QuotasAdminTestV257-77313393-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:05.362963 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-239d5023-4421-49c1-98a3-bb1c89006cc0 tempest-QuotasAdminTestV257-77313393 tempest-QuotasAdminTestV257-77313393-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:05.363974 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-239d5023-4421-49c1-98a3-bb1c89006cc0 tempest-QuotasAdminTestV257-77313393 tempest-QuotasAdminTestV257-77313393-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:05.364655 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-239d5023-4421-49c1-98a3-bb1c89006cc0 tempest-QuotasAdminTestV257-77313393 tempest-QuotasAdminTestV257-77313393-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:05.365290 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-239d5023-4421-49c1-98a3-bb1c89006cc0 tempest-QuotasAdminTestV257-77313393 tempest-QuotasAdminTestV257-77313393-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:05.384407 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.network.neutron [None req-7f655ef2-41d5-49f4-8f1c-6512fd5c2195 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] validate_networks() for None {{(pid=134102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:44:05.520187 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-239d5023-4421-49c1-98a3-bb1c89006cc0 tempest-QuotasAdminTestV257-77313393 tempest-QuotasAdminTestV257-77313393-project-admin] 10.222.0.43 "PUT /compute/v2.1/os-quota-sets/1464791159a14c389e1002a40940f81a?user_id=af33820d18db47a2b569a5c085ce859c" status: 200 len: 148 microversion: 2.57 time: 0.726960 Oct 04 21:44:05.524005 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 138/269] 10.222.0.43 () {62 vars in 1384 bytes} [Tue Oct 4 21:44:04 2022] PUT /compute/v2.1/os-quota-sets/1464791159a14c389e1002a40940f81a?user_id=af33820d18db47a2b569a5c085ce859c => generated 148 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:44:05.536996 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-17a27ce0-de29-49e0-a1c9-569cc532faf1 tempest-QuotasAdminTestV257-77313393 tempest-QuotasAdminTestV257-77313393-project-admin] Calling method '.version_select at 0x7fbb2f890820>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:05.743793 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-7f655ef2-41d5-49f4-8f1c-6512fd5c2195 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Flavor limits 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:44:05.745024 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-7f655ef2-41d5-49f4-8f1c-6512fd5c2195 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Image limits 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:44:05.745679 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-7f655ef2-41d5-49f4-8f1c-6512fd5c2195 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Flavor pref 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:44:05.746257 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-7f655ef2-41d5-49f4-8f1c-6512fd5c2195 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Image pref 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:44:05.746837 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-7f655ef2-41d5-49f4-8f1c-6512fd5c2195 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:44:05.773376 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7f655ef2-41d5-49f4-8f1c-6512fd5c2195 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:05.773868 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7f655ef2-41d5-49f4-8f1c-6512fd5c2195 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:05.774674 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7f655ef2-41d5-49f4-8f1c-6512fd5c2195 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:05.775067 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7f655ef2-41d5-49f4-8f1c-6512fd5c2195 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:05.775523 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7f655ef2-41d5-49f4-8f1c-6512fd5c2195 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:05.775950 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7f655ef2-41d5-49f4-8f1c-6512fd5c2195 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:05.805691 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-7f655ef2-41d5-49f4-8f1c-6512fd5c2195 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Getting quotas for project 7bedc0e10ab24824a40d06bb91626088. Resources: {'instances', 'ram', 'cores'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:44:05.812221 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-7f655ef2-41d5-49f4-8f1c-6512fd5c2195 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Getting quotas for user af5387dbf4e24960809704c398fe999a and project 7bedc0e10ab24824a40d06bb91626088. Resources: {'instances', 'ram', 'cores'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:44:05.825827 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-7f655ef2-41d5-49f4-8f1c-6512fd5c2195 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Going to run 1 instances... {{(pid=134102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:44:05.828198 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-7f655ef2-41d5-49f4-8f1c-6512fd5c2195 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] [instance: 80d8aacc-cde5-4451-8697-054eefe15849] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='58548514-5dac-426c-81f5-19e3fba33e23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:44:05.884930 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-7f655ef2-41d5-49f4-8f1c-6512fd5c2195 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.585763 Oct 04 21:44:05.892277 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 132/270] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 21:44:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 607 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:44:05.892277 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-0a66b372-cd83-4e4d-bce0-f24d4fc3b71b tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:05.892277 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-0a66b372-cd83-4e4d-bce0-f24d4fc3b71b tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: ec437ce7-b43a-4c8b-8a06-756cfb877851] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:05.899657 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0a66b372-cd83-4e4d-bce0-f24d4fc3b71b tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:05.900158 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0a66b372-cd83-4e4d-bce0-f24d4fc3b71b tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:05.900596 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0a66b372-cd83-4e4d-bce0-f24d4fc3b71b tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:05.901341 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0a66b372-cd83-4e4d-bce0-f24d4fc3b71b tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:05.901801 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0a66b372-cd83-4e4d-bce0-f24d4fc3b71b tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:05.902230 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0a66b372-cd83-4e4d-bce0-f24d4fc3b71b tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:05.907930 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:44:06.029224 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-17a27ce0-de29-49e0-a1c9-569cc532faf1 tempest-QuotasAdminTestV257-77313393 tempest-QuotasAdminTestV257-77313393-project-admin] 10.222.0.43 "GET /compute/v2.1/os-quota-sets/1464791159a14c389e1002a40940f81a?user_id=af33820d18db47a2b569a5c085ce859c" status: 200 len: 190 microversion: 2.57 time: 0.498258 Oct 04 21:44:06.029727 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 139/271] 10.222.0.43 () {60 vars in 1364 bytes} [Tue Oct 4 21:44:05 2022] GET /compute/v2.1/os-quota-sets/1464791159a14c389e1002a40940f81a?user_id=af33820d18db47a2b569a5c085ce859c => generated 190 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:44:06.046045 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-03334a02-fd4b-4f77-bf1f-371cc6af1383 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:06.048679 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-03334a02-fd4b-4f77-bf1f-371cc6af1383 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] [instance: 4b0c3dd7-d609-4b00-8604-35f8a2680c14] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:06.067754 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-03334a02-fd4b-4f77-bf1f-371cc6af1383 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:06.070202 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-03334a02-fd4b-4f77-bf1f-371cc6af1383 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:06.072115 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-03334a02-fd4b-4f77-bf1f-371cc6af1383 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:06.076078 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-03334a02-fd4b-4f77-bf1f-371cc6af1383 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:06.076584 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-03334a02-fd4b-4f77-bf1f-371cc6af1383 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:06.079287 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-03334a02-fd4b-4f77-bf1f-371cc6af1383 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:06.481044 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-0a66b372-cd83-4e4d-bce0-f24d4fc3b71b tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:44:06.490523 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-0a66b372-cd83-4e4d-bce0-f24d4fc3b71b tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/ec437ce7-b43a-4c8b-8a06-756cfb877851" status: 200 len: 1313 microversion: 2.1 time: 0.603300 Oct 04 21:44:06.498499 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 133/272] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:44:05 2022] GET /compute/v2.1/servers/ec437ce7-b43a-4c8b-8a06-756cfb877851 => generated 1313 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:44:06.516722 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-8b34229f-65ee-45e1-b8b5-54c99661f44e tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:06.519406 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-8b34229f-65ee-45e1-b8b5-54c99661f44e tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] [instance: 80d8aacc-cde5-4451-8697-054eefe15849] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:06.607959 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-03334a02-fd4b-4f77-bf1f-371cc6af1383 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29842a669a20408b881105135f76cb0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39edf587afe94b60911198aa0bb61613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:44:06.620626 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-03334a02-fd4b-4f77-bf1f-371cc6af1383 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] 10.222.0.43 "GET /compute/v2.1/servers/4b0c3dd7-d609-4b00-8604-35f8a2680c14" status: 200 len: 1465 microversion: 2.1 time: 0.589829 Oct 04 21:44:06.627140 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 140/273] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:44:06 2022] GET /compute/v2.1/servers/4b0c3dd7-d609-4b00-8604-35f8a2680c14 => generated 1465 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:44:06.635091 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-dff9d1a0-9bb0-4353-a7d6-f2aeb711a402 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:06.640395 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-dff9d1a0-9bb0-4353-a7d6-f2aeb711a402 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] [instance: 4ca5960d-4a64-4a04-a849-d53180a038e9] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:06.657567 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dff9d1a0-9bb0-4353-a7d6-f2aeb711a402 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:06.660113 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dff9d1a0-9bb0-4353-a7d6-f2aeb711a402 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:06.660773 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dff9d1a0-9bb0-4353-a7d6-f2aeb711a402 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:06.663699 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dff9d1a0-9bb0-4353-a7d6-f2aeb711a402 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:06.666469 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dff9d1a0-9bb0-4353-a7d6-f2aeb711a402 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:06.667088 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dff9d1a0-9bb0-4353-a7d6-f2aeb711a402 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:06.704638 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-8b34229f-65ee-45e1-b8b5-54c99661f44e tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5387dbf4e24960809704c398fe999a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bedc0e10ab24824a40d06bb91626088', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:44:06.714485 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-8b34229f-65ee-45e1-b8b5-54c99661f44e tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] 10.222.0.43 "GET /compute/v2.1/servers/80d8aacc-cde5-4451-8697-054eefe15849" status: 200 len: 1220 microversion: 2.1 time: 0.217756 Oct 04 21:44:06.716132 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-dff9d1a0-9bb0-4353-a7d6-f2aeb711a402 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] HTTP exception thrown: Instance 4ca5960d-4a64-4a04-a849-d53180a038e9 could not be found. Oct 04 21:44:06.725398 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-dff9d1a0-9bb0-4353-a7d6-f2aeb711a402 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Request method failure captured: Oct 04 21:44:06.725398 n-d-860284-1 devstack@n-api.service[134101]: request: GET /compute/v2.1/servers/4ca5960d-4a64-4a04-a849-d53180a038e9 HTTP/1.1 Oct 04 21:44:06.725398 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 21:44:06.725398 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 21:44:06.725398 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 21:44:06.725398 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 21:44:06.725398 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 21:44:06.725398 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 21:44:06.725398 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 21:44:06.725398 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 21:44:06.725398 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPKj0-7W58RQE5aOzdtzD4tgebh0E10jsmQP6igAsGUuznOXC4x4rgvf3ZzbP44LgM-jgYx_t5g_vaUie_N_5lgaQSwDKmKV0C1HWQ8m4fnJ3KaOb07MeYTFd96i104CiZ7MgAfxhCCaxsHZ98rDDCDLevDZcw-4nXTI6CBETD0yk594 Oct 04 21:44:06.725398 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 21:44:06.725398 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 21:44:06.725398 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 21:44:06.725398 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 21:44:06.725398 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 21:44:06.725398 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 21:44:06.725398 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: f306c099ef294f6da8637a8ddcdb46d1 Oct 04 21:44:06.725398 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-AggregatesAdminTestJSON-1392374906 Oct 04 21:44:06.725398 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 21:44:06.725398 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 21:44:06.726803 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f306c099ef294f6da8637a8ddcdb46d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_f306c099ef294f6da8637a8ddcdb46d1", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f306c099ef294f6da8637a8ddcdb46d1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/f306c099ef294f6da8637a8ddcdb46d1"}]}] Oct 04 21:44:06.726803 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-AggregatesAdminTestJSON-1392374906 Oct 04 21:44:06.726803 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: f306c099ef294f6da8637a8ddcdb46d1 Oct 04 21:44:06.726803 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1392374906 Oct 04 21:44:06.726803 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-AggregatesAdminTestJSON-1392374906-project Oct 04 21:44:06.726803 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 21:44:06.726803 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 21:44:06.726803 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: e00999a6faf349eea3be7680a855e8d8 Oct 04 21:44:06.726803 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-AggregatesAdminTestJSON-1392374906-project Oct 04 21:44:06.726803 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 21:44:06.726803 n-d-860284-1 devstack@n-api.service[134101]: exception: Instance 4ca5960d-4a64-4a04-a849-d53180a038e9 could not be found. Oct 04 21:44:06.726803 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': '4ca5960d-4a64-4a04-a849-d53180a038e9'} Oct 04 21:44:06.727585 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:44:06.727585 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:44:06.727585 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:44:06.727585 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:44:06.727585 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:44:06.727585 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:44:06.727585 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:44:06.727585 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:44:06.727585 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:44:06.727585 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:44:06.727585 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ca5960d-4a64-4a04-a849-d53180a038e9 could not be found. Oct 04 21:44:06.727585 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:44:06.727585 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:44:06.727585 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:44:06.727585 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:44:06.727585 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:44:06.727585 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:44:06.727585 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:44:06.727585 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:44:06.727585 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:44:06.728612 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:44:06.728612 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:44:06.728612 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:44:06.728612 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:44:06.728612 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:44:06.728612 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:44:06.728612 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:44:06.728612 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ca5960d-4a64-4a04-a849-d53180a038e9 could not be found. Oct 04 21:44:06.728612 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:44:06.728612 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:44:06.728612 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:44:06.728612 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:44:06.728612 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:44:06.728612 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:44:06.728612 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:44:06.728612 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:44:06.728612 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ca5960d-4a64-4a04-a849-d53180a038e9 could not be found. Oct 04 21:44:06.728612 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:44:06.732775 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-dff9d1a0-9bb0-4353-a7d6-f2aeb711a402 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Returning 404 to user: Instance 4ca5960d-4a64-4a04-a849-d53180a038e9 could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:44:06.733014 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 134/274] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:44:06 2022] GET /compute/v2.1/servers/80d8aacc-cde5-4451-8697-054eefe15849 => generated 1220 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:44:06.737287 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-dff9d1a0-9bb0-4353-a7d6-f2aeb711a402 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] 10.222.0.43 "GET /compute/v2.1/servers/4ca5960d-4a64-4a04-a849-d53180a038e9" status: 404 len: 111 microversion: 2.1 time: 0.108632 Oct 04 21:44:06.745806 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 141/275] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:44:06 2022] GET /compute/v2.1/servers/4ca5960d-4a64-4a04-a849-d53180a038e9 => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:44:06.765161 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-11d234ee-11d3-470d-827a-3f985185c426 tempest-AggregatesAdminTestJSON-1644938243 tempest-AggregatesAdminTestJSON-1644938243-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-860284-1"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:44:06.803592 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-11d234ee-11d3-470d-827a-3f985185c426 tempest-AggregatesAdminTestJSON-1644938243 tempest-AggregatesAdminTestJSON-1644938243-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:06.810764 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-11d234ee-11d3-470d-827a-3f985185c426 tempest-AggregatesAdminTestJSON-1644938243 tempest-AggregatesAdminTestJSON-1644938243-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:06.812029 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-11d234ee-11d3-470d-827a-3f985185c426 tempest-AggregatesAdminTestJSON-1644938243 tempest-AggregatesAdminTestJSON-1644938243-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:07.154959 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-11d234ee-11d3-470d-827a-3f985185c426 tempest-AggregatesAdminTestJSON-1644938243 tempest-AggregatesAdminTestJSON-1644938243-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 297 microversion: 2.1 time: 0.403186 Oct 04 21:44:07.157510 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 142/276] 10.222.0.43 () {60 vars in 1191 bytes} [Tue Oct 4 21:44:06 2022] POST /compute/v2.1/os-aggregates/4/action => generated 297 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:44:07.191371 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-d0955668-2b53-4cc5-a66e-4538ef3b5952 req-549c6ce5-94a4-4a2a-9d8b-685131bcaf0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec437ce7-b43a-4c8b-8a06-756cfb877851", "name": "network-vif-plugged", "status": "completed", "tag": "11205198-745e-4214-9769-9da045caa32b"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:44:07.224905 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-d0955668-2b53-4cc5-a66e-4538ef3b5952 req-549c6ce5-94a4-4a2a-9d8b-685131bcaf0e service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:07.228937 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-d0955668-2b53-4cc5-a66e-4538ef3b5952 req-549c6ce5-94a4-4a2a-9d8b-685131bcaf0e service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:07.229639 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-d0955668-2b53-4cc5-a66e-4538ef3b5952 req-549c6ce5-94a4-4a2a-9d8b-685131bcaf0e service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:07.271957 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-d0955668-2b53-4cc5-a66e-4538ef3b5952 req-549c6ce5-94a4-4a2a-9d8b-685131bcaf0e service nova] Creating event network-vif-plugged:11205198-745e-4214-9769-9da045caa32b for instance ec437ce7-b43a-4c8b-8a06-756cfb877851 on n-h2-860284-1 Oct 04 21:44:07.286233 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-d0955668-2b53-4cc5-a66e-4538ef3b5952 req-549c6ce5-94a4-4a2a-9d8b-685131bcaf0e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105438 Oct 04 21:44:07.287454 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 143/277] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:44:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:44:07.303563 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-a0fd1b71-b2b5-4e81-8ffd-af88bbb57d5a tempest-AggregatesAdminTestJSON-1644938243 tempest-AggregatesAdminTestJSON-1644938243-project-admin] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:07.333734 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-e5451c3c-2367-4c0a-8a6a-d9e4b05b89bc tempest-ServersOnMultiNodesTest-962622545 tempest-ServersOnMultiNodesTest-962622545-project-admin] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:07.334716 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-e5451c3c-2367-4c0a-8a6a-d9e4b05b89bc tempest-ServersOnMultiNodesTest-962622545 tempest-ServersOnMultiNodesTest-962622545-project-admin] [instance: 4b0c3dd7-d609-4b00-8604-35f8a2680c14] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:07.348829 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e5451c3c-2367-4c0a-8a6a-d9e4b05b89bc tempest-ServersOnMultiNodesTest-962622545 tempest-ServersOnMultiNodesTest-962622545-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:07.352297 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-a0fd1b71-b2b5-4e81-8ffd-af88bbb57d5a tempest-AggregatesAdminTestJSON-1644938243 tempest-AggregatesAdminTestJSON-1644938243-project-admin] 10.222.0.43 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.063202 Oct 04 21:44:07.356378 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e5451c3c-2367-4c0a-8a6a-d9e4b05b89bc tempest-ServersOnMultiNodesTest-962622545 tempest-ServersOnMultiNodesTest-962622545-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:07.359581 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e5451c3c-2367-4c0a-8a6a-d9e4b05b89bc tempest-ServersOnMultiNodesTest-962622545 tempest-ServersOnMultiNodesTest-962622545-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:07.360942 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 144/278] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Oct 4 21:44:07 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 21:44:07.361932 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e5451c3c-2367-4c0a-8a6a-d9e4b05b89bc tempest-ServersOnMultiNodesTest-962622545 tempest-ServersOnMultiNodesTest-962622545-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:07.365353 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e5451c3c-2367-4c0a-8a6a-d9e4b05b89bc tempest-ServersOnMultiNodesTest-962622545 tempest-ServersOnMultiNodesTest-962622545-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:07.366910 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e5451c3c-2367-4c0a-8a6a-d9e4b05b89bc tempest-ServersOnMultiNodesTest-962622545 tempest-ServersOnMultiNodesTest-962622545-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:07.375117 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-456864f1-2541-470d-a9c4-e55f68fca06f tempest-AggregatesAdminTestJSON-1644938243 tempest-AggregatesAdminTestJSON-1644938243-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-901211270"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:44:07.387625 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.objects.aggregate [None req-456864f1-2541-470d-a9c4-e55f68fca06f tempest-AggregatesAdminTestJSON-1644938243 tempest-AggregatesAdminTestJSON-1644938243-project-admin] Generated uuid de5c7f00-1fb9-46c9-bddc-7aaac492f871 for aggregate {{(pid=134101) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 21:44:07.399167 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=3,nova_api:DELETE=3 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:44:07.465346 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-456864f1-2541-470d-a9c4-e55f68fca06f tempest-AggregatesAdminTestJSON-1644938243 tempest-AggregatesAdminTestJSON-1644938243-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.088376 Oct 04 21:44:07.472138 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 145/279] 10.222.0.43 () {60 vars in 1164 bytes} [Tue Oct 4 21:44:07 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:44:07.480443 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-244b75ad-e264-452a-88ee-6ecf418f6b6e tempest-AggregatesAdminTestJSON-1644938243 tempest-AggregatesAdminTestJSON-1644938243-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-860284-1"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:44:07.509162 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-244b75ad-e264-452a-88ee-6ecf418f6b6e tempest-AggregatesAdminTestJSON-1644938243 tempest-AggregatesAdminTestJSON-1644938243-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:07.509930 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-244b75ad-e264-452a-88ee-6ecf418f6b6e tempest-AggregatesAdminTestJSON-1644938243 tempest-AggregatesAdminTestJSON-1644938243-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:07.510557 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-244b75ad-e264-452a-88ee-6ecf418f6b6e tempest-AggregatesAdminTestJSON-1644938243 tempest-AggregatesAdminTestJSON-1644938243-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:07.783472 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-244b75ad-e264-452a-88ee-6ecf418f6b6e tempest-AggregatesAdminTestJSON-1644938243 tempest-AggregatesAdminTestJSON-1644938243-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 241 microversion: 2.1 time: 0.309872 Oct 04 21:44:07.784125 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 146/280] 10.222.0.43 () {60 vars in 1191 bytes} [Tue Oct 4 21:44:07 2022] POST /compute/v2.1/os-aggregates/9/action => generated 241 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:44:07.797448 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-0d9d33ba-13a0-4dfe-aa80-3f9eaf3d50f2 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:07.798413 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-0d9d33ba-13a0-4dfe-aa80-3f9eaf3d50f2 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: ec437ce7-b43a-4c8b-8a06-756cfb877851] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:07.817011 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0d9d33ba-13a0-4dfe-aa80-3f9eaf3d50f2 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:07.817607 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0d9d33ba-13a0-4dfe-aa80-3f9eaf3d50f2 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:07.818062 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0d9d33ba-13a0-4dfe-aa80-3f9eaf3d50f2 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:07.818817 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0d9d33ba-13a0-4dfe-aa80-3f9eaf3d50f2 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:07.819273 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0d9d33ba-13a0-4dfe-aa80-3f9eaf3d50f2 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:07.819792 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0d9d33ba-13a0-4dfe-aa80-3f9eaf3d50f2 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:08.244920 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-0d9d33ba-13a0-4dfe-aa80-3f9eaf3d50f2 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:44:08.247498 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:44:08.255609 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-0d9d33ba-13a0-4dfe-aa80-3f9eaf3d50f2 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/ec437ce7-b43a-4c8b-8a06-756cfb877851" status: 200 len: 1313 microversion: 2.1 time: 0.468088 Oct 04 21:44:08.256203 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 147/281] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:44:07 2022] GET /compute/v2.1/servers/ec437ce7-b43a-4c8b-8a06-756cfb877851 => generated 1313 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:44:08.275921 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-a57aa52e-28e9-40c7-8d43-9e7f369370d4 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:08.276927 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-a57aa52e-28e9-40c7-8d43-9e7f369370d4 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] [instance: 80d8aacc-cde5-4451-8697-054eefe15849] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:08.306184 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a57aa52e-28e9-40c7-8d43-9e7f369370d4 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:08.307076 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a57aa52e-28e9-40c7-8d43-9e7f369370d4 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:08.307766 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a57aa52e-28e9-40c7-8d43-9e7f369370d4 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:08.308861 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a57aa52e-28e9-40c7-8d43-9e7f369370d4 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:08.309530 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a57aa52e-28e9-40c7-8d43-9e7f369370d4 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:08.310134 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a57aa52e-28e9-40c7-8d43-9e7f369370d4 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:08.450753 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-a57aa52e-28e9-40c7-8d43-9e7f369370d4 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5387dbf4e24960809704c398fe999a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bedc0e10ab24824a40d06bb91626088', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:44:08.459375 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-a57aa52e-28e9-40c7-8d43-9e7f369370d4 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] 10.222.0.43 "GET /compute/v2.1/servers/80d8aacc-cde5-4451-8697-054eefe15849" status: 200 len: 1290 microversion: 2.1 time: 0.202106 Oct 04 21:44:08.475628 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 148/282] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:44:08 2022] GET /compute/v2.1/servers/80d8aacc-cde5-4451-8697-054eefe15849 => generated 1290 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:44:08.482406 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-50e60e7e-b43e-4c5b-ab70-220c5898b13c tempest-AggregatesAdminTestJSON-1644938243 tempest-AggregatesAdminTestJSON-1644938243-project-admin] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:08.503302 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-50e60e7e-b43e-4c5b-ab70-220c5898b13c tempest-AggregatesAdminTestJSON-1644938243 tempest-AggregatesAdminTestJSON-1644938243-project-admin] 10.222.0.43 "GET /compute/v2.1/os-aggregates/9" status: 200 len: 241 microversion: 2.1 time: 0.026392 Oct 04 21:44:08.504245 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 149/283] 10.222.0.43 () {58 vars in 1149 bytes} [Tue Oct 4 21:44:08 2022] GET /compute/v2.1/os-aggregates/9 => generated 241 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:44:08.539714 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-e5451c3c-2367-4c0a-8a6a-d9e4b05b89bc tempest-ServersOnMultiNodesTest-962622545 tempest-ServersOnMultiNodesTest-962622545-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/4b0c3dd7-d609-4b00-8604-35f8a2680c14" status: 200 len: 1616 microversion: 2.1 time: 1.805090 Oct 04 21:44:08.540405 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 135/284] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:44:06 2022] GET /compute/v2.1/servers/4b0c3dd7-d609-4b00-8604-35f8a2680c14 => generated 1616 bytes in 1807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:44:08.591343 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-80ef2722-a01c-47c1-8953-3bea0b693b97 tempest-AggregatesAdminTestJSON-1644938243 tempest-AggregatesAdminTestJSON-1644938243-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-860284-1"}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:44:08.630927 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-80ef2722-a01c-47c1-8953-3bea0b693b97 tempest-AggregatesAdminTestJSON-1644938243 tempest-AggregatesAdminTestJSON-1644938243-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:08.632103 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-80ef2722-a01c-47c1-8953-3bea0b693b97 tempest-AggregatesAdminTestJSON-1644938243 tempest-AggregatesAdminTestJSON-1644938243-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:08.633525 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-80ef2722-a01c-47c1-8953-3bea0b693b97 tempest-AggregatesAdminTestJSON-1644938243 tempest-AggregatesAdminTestJSON-1644938243-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:08.745106 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-def63a27-5299-4563-a1d4-7a6e8943d1ba tempest-QuotasAdminTestV236-185227993 tempest-QuotasAdminTestV236-185227993-project-admin] Action: 'update', calling method: .version_select at 0x7fbb2f8ab9d0>, body: {"quota_set": {"ram": "5120"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:44:08.793696 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-80ef2722-a01c-47c1-8953-3bea0b693b97 tempest-AggregatesAdminTestJSON-1644938243 tempest-AggregatesAdminTestJSON-1644938243-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 226 microversion: 2.1 time: 0.230914 Oct 04 21:44:08.794627 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 136/285] 10.222.0.43 () {60 vars in 1191 bytes} [Tue Oct 4 21:44:08 2022] POST /compute/v2.1/os-aggregates/9/action => generated 226 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:44:08.806962 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-8798bae5-3d87-4adb-82b7-2d50975ad19b tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Action: 'create', calling method: .version_select at 0x7fbb2fc24a60>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1208877815", "policies": ["affinity"]}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:44:08.838260 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell0:SELECT=49 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:44:08.841689 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-8798bae5-3d87-4adb-82b7-2d50975ad19b tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Getting quotas for project 39edf587afe94b60911198aa0bb61613. Resources: {'server_groups'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:44:08.843286 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-def63a27-5299-4563-a1d4-7a6e8943d1ba tempest-QuotasAdminTestV236-185227993 tempest-QuotasAdminTestV236-185227993-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:08.843777 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-def63a27-5299-4563-a1d4-7a6e8943d1ba tempest-QuotasAdminTestV236-185227993 tempest-QuotasAdminTestV236-185227993-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:08.844214 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-def63a27-5299-4563-a1d4-7a6e8943d1ba tempest-QuotasAdminTestV236-185227993 tempest-QuotasAdminTestV236-185227993-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:08.844944 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-def63a27-5299-4563-a1d4-7a6e8943d1ba tempest-QuotasAdminTestV236-185227993 tempest-QuotasAdminTestV236-185227993-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:08.845398 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-def63a27-5299-4563-a1d4-7a6e8943d1ba tempest-QuotasAdminTestV236-185227993 tempest-QuotasAdminTestV236-185227993-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:08.845827 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-def63a27-5299-4563-a1d4-7a6e8943d1ba tempest-QuotasAdminTestV236-185227993 tempest-QuotasAdminTestV236-185227993-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:08.854210 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-8798bae5-3d87-4adb-82b7-2d50975ad19b tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Getting quotas for user 29842a669a20408b881105135f76cb0a and project 39edf587afe94b60911198aa0bb61613. Resources: {'server_groups'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:44:08.959563 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-def63a27-5299-4563-a1d4-7a6e8943d1ba tempest-QuotasAdminTestV236-185227993 tempest-QuotasAdminTestV236-185227993-project-admin] 10.222.0.43 "PUT /compute/v2.1/os-quota-sets/5071c1db6c8447de83a8e74f7ec94c5d" status: 200 len: 240 microversion: 2.36 time: 0.453581 Oct 04 21:44:08.962965 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 150/286] 10.222.0.43 () {62 vars in 1303 bytes} [Tue Oct 4 21:44:08 2022] PUT /compute/v2.1/os-quota-sets/5071c1db6c8447de83a8e74f7ec94c5d => generated 240 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:44:08.969076 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-cf7bcff5-a35f-4576-a2bd-03773fb55c66 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-195018920", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "1135919845", "adminPass": "***", "networks": [{"uuid": "80c3bd4e-c948-4bd0-860e-856f34e6a879"}], "security_groups": [{"name": "tempest-securitygroup--280203192"}], "key_name": "tempest-keypair-1617998943", "user_data": "}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:44:08.990443 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-8798bae5-3d87-4adb-82b7-2d50975ad19b tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Getting quotas for project 39edf587afe94b60911198aa0bb61613. Resources: {'server_groups'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:44:09.000109 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-8798bae5-3d87-4adb-82b7-2d50975ad19b tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Getting quotas for user 29842a669a20408b881105135f76cb0a and project 39edf587afe94b60911198aa0bb61613. Resources: {'server_groups'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:44:09.024271 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-8798bae5-3d87-4adb-82b7-2d50975ad19b tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] 10.222.0.43 "POST /compute/v2.1/os-server-groups" status: 200 len: 188 microversion: 2.1 time: 0.227268 Oct 04 21:44:09.025234 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 137/287] 10.222.0.43 () {60 vars in 1174 bytes} [Tue Oct 4 21:44:08 2022] POST /compute/v2.1/os-server-groups => generated 188 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:44:09.031491 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-8b990882-009d-4115-972d-81ee6e320dba tempest-AggregatesAdminTestJSON-1644938243 tempest-AggregatesAdminTestJSON-1644938243-project-admin] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:09.095648 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-8b990882-009d-4115-972d-81ee6e320dba tempest-AggregatesAdminTestJSON-1644938243 tempest-AggregatesAdminTestJSON-1644938243-project-admin] 10.222.0.43 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.066871 Oct 04 21:44:09.098487 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 138/288] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Oct 4 21:44:09 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 21:44:09.111368 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-56435324-1a8b-473b-b79b-79816082c9e0 tempest-QuotasAdminTestV236-185227993 tempest-QuotasAdminTestV236-185227993-project-admin] Calling method '.version_select at 0x7fbb35059670>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:09.119558 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.network.neutron [None req-cf7bcff5-a35f-4576-a2bd-03773fb55c66 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] validate_networks() for [('80c3bd4e-c948-4bd0-860e-856f34e6a879', None, None, None, None, None)] {{(pid=134101) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:44:09.504451 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-56435324-1a8b-473b-b79b-79816082c9e0 tempest-QuotasAdminTestV236-185227993 tempest-QuotasAdminTestV236-185227993-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:09.505511 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-56435324-1a8b-473b-b79b-79816082c9e0 tempest-QuotasAdminTestV236-185227993 tempest-QuotasAdminTestV236-185227993-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:09.506189 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-56435324-1a8b-473b-b79b-79816082c9e0 tempest-QuotasAdminTestV236-185227993 tempest-QuotasAdminTestV236-185227993-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:09.507345 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-56435324-1a8b-473b-b79b-79816082c9e0 tempest-QuotasAdminTestV236-185227993 tempest-QuotasAdminTestV236-185227993-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:09.508855 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-56435324-1a8b-473b-b79b-79816082c9e0 tempest-QuotasAdminTestV236-185227993 tempest-QuotasAdminTestV236-185227993-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:09.509537 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-56435324-1a8b-473b-b79b-79816082c9e0 tempest-QuotasAdminTestV236-185227993 tempest-QuotasAdminTestV236-185227993-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:09.534181 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-56435324-1a8b-473b-b79b-79816082c9e0 tempest-QuotasAdminTestV236-185227993 tempest-QuotasAdminTestV236-185227993-project-admin] 10.222.0.43 "GET /compute/v2.1/os-quota-sets/5071c1db6c8447de83a8e74f7ec94c5d/detail" status: 200 len: 672 microversion: 2.36 time: 0.431761 Oct 04 21:44:09.534930 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 139/289] 10.222.0.43 () {60 vars in 1304 bytes} [Tue Oct 4 21:44:09 2022] GET /compute/v2.1/os-quota-sets/5071c1db6c8447de83a8e74f7ec94c5d/detail => generated 672 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:44:09.540951 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-a8e2792b-4b57-43f2-8902-35741a9f8233 tempest-AggregatesAdminTestJSON-1644938243 tempest-AggregatesAdminTestJSON-1644938243-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1057991803"}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:44:09.544722 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.objects.aggregate [None req-a8e2792b-4b57-43f2-8902-35741a9f8233 tempest-AggregatesAdminTestJSON-1644938243 tempest-AggregatesAdminTestJSON-1644938243-project-admin] Generated uuid ad04bf5f-9a4b-4899-b534-a5d627a76c9a for aggregate {{(pid=134102) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 21:44:09.574791 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-a8e2792b-4b57-43f2-8902-35741a9f8233 tempest-AggregatesAdminTestJSON-1644938243 tempest-AggregatesAdminTestJSON-1644938243-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.036740 Oct 04 21:44:09.576220 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 140/290] 10.222.0.43 () {60 vars in 1164 bytes} [Tue Oct 4 21:44:09 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:44:09.590556 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-57d163e5-25d1-4dac-ad89-bf8ad279c655 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-78141915", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "42779ba1-4f53-45cc-b681-4aca803828ae"}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:44:09.688437 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.network.neutron [None req-57d163e5-25d1-4dac-ad89-bf8ad279c655 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] validate_networks() for None {{(pid=134102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:44:10.201192 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-57d163e5-25d1-4dac-ad89-bf8ad279c655 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Flavor limits 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:44:10.201992 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-57d163e5-25d1-4dac-ad89-bf8ad279c655 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Image limits 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:44:10.203193 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-57d163e5-25d1-4dac-ad89-bf8ad279c655 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Flavor pref 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:44:10.203791 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-57d163e5-25d1-4dac-ad89-bf8ad279c655 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Image pref 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:44:10.204204 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-57d163e5-25d1-4dac-ad89-bf8ad279c655 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:44:10.231122 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-cf7bcff5-a35f-4576-a2bd-03773fb55c66 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Flavor limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:44:10.232097 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-cf7bcff5-a35f-4576-a2bd-03773fb55c66 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Image limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:44:10.232585 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-cf7bcff5-a35f-4576-a2bd-03773fb55c66 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Flavor pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:44:10.233001 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-cf7bcff5-a35f-4576-a2bd-03773fb55c66 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Image pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:44:10.233638 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-cf7bcff5-a35f-4576-a2bd-03773fb55c66 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:44:10.235541 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-57d163e5-25d1-4dac-ad89-bf8ad279c655 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:10.236032 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-57d163e5-25d1-4dac-ad89-bf8ad279c655 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:10.236875 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-57d163e5-25d1-4dac-ad89-bf8ad279c655 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:10.237870 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-57d163e5-25d1-4dac-ad89-bf8ad279c655 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:10.238607 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-57d163e5-25d1-4dac-ad89-bf8ad279c655 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:10.238802 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-57d163e5-25d1-4dac-ad89-bf8ad279c655 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:10.242583 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cf7bcff5-a35f-4576-a2bd-03773fb55c66 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:10.243496 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cf7bcff5-a35f-4576-a2bd-03773fb55c66 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:10.243939 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cf7bcff5-a35f-4576-a2bd-03773fb55c66 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:10.244684 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cf7bcff5-a35f-4576-a2bd-03773fb55c66 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:10.245130 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cf7bcff5-a35f-4576-a2bd-03773fb55c66 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:10.245559 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cf7bcff5-a35f-4576-a2bd-03773fb55c66 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:10.258267 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-57d163e5-25d1-4dac-ad89-bf8ad279c655 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Getting quotas for project 39edf587afe94b60911198aa0bb61613. Resources: {'instances', 'ram', 'cores'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:44:10.263939 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-57d163e5-25d1-4dac-ad89-bf8ad279c655 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Getting quotas for user 29842a669a20408b881105135f76cb0a and project 39edf587afe94b60911198aa0bb61613. Resources: {'instances', 'ram', 'cores'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:44:10.266077 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-cf7bcff5-a35f-4576-a2bd-03773fb55c66 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Getting quotas for project da67fc95e2814f4086df020f4c475764. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:44:10.271740 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-cf7bcff5-a35f-4576-a2bd-03773fb55c66 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Getting quotas for user 1789bb97219a4e1591632126812ea6df and project da67fc95e2814f4086df020f4c475764. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:44:10.280106 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-57d163e5-25d1-4dac-ad89-bf8ad279c655 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Going to run 2 instances... {{(pid=134102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:44:10.282605 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-57d163e5-25d1-4dac-ad89-bf8ad279c655 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] [instance: 7d71d6d3-3a63-406b-ac49-3e83bd539cf9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='58548514-5dac-426c-81f5-19e3fba33e23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:44:10.286860 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-cf7bcff5-a35f-4576-a2bd-03773fb55c66 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Going to run 1 instances... {{(pid=134101) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:44:10.289596 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-cf7bcff5-a35f-4576-a2bd-03773fb55c66 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] [instance: c7b7e541-aa71-44f6-96fb-07c2e6e08520] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='58548514-5dac-426c-81f5-19e3fba33e23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134101) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:44:10.323816 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-57d163e5-25d1-4dac-ad89-bf8ad279c655 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=134102) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Oct 04 21:44:10.338350 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=9,nova_api:DELETE=3 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:44:10.345372 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-cf7bcff5-a35f-4576-a2bd-03773fb55c66 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.381008 Oct 04 21:44:10.345990 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-57d163e5-25d1-4dac-ad89-bf8ad279c655 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Getting quotas for project 39edf587afe94b60911198aa0bb61613. Resources: {'server_group_members'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:44:10.346710 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 151/291] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 21:44:08 2022] POST /compute/v2.1/servers => generated 401 bytes in 1383 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:44:10.353013 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-5360ba3c-d00a-4092-a3bd-64f0628241df tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:10.353924 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-5360ba3c-d00a-4092-a3bd-64f0628241df tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: ec437ce7-b43a-4c8b-8a06-756cfb877851] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:10.354053 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-57d163e5-25d1-4dac-ad89-bf8ad279c655 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Getting quotas for user 29842a669a20408b881105135f76cb0a and project 39edf587afe94b60911198aa0bb61613. Resources: {'server_group_members'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:44:10.361327 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5360ba3c-d00a-4092-a3bd-64f0628241df tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:10.362101 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5360ba3c-d00a-4092-a3bd-64f0628241df tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:10.362736 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5360ba3c-d00a-4092-a3bd-64f0628241df tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:10.363605 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5360ba3c-d00a-4092-a3bd-64f0628241df tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:10.364217 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5360ba3c-d00a-4092-a3bd-64f0628241df tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:10.364788 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5360ba3c-d00a-4092-a3bd-64f0628241df tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:10.414683 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-57d163e5-25d1-4dac-ad89-bf8ad279c655 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Getting quotas for project 39edf587afe94b60911198aa0bb61613. Resources: {'server_group_members'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:44:10.439531 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-57d163e5-25d1-4dac-ad89-bf8ad279c655 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Getting quotas for user 29842a669a20408b881105135f76cb0a and project 39edf587afe94b60911198aa0bb61613. Resources: {'server_group_members'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:44:10.500483 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-57d163e5-25d1-4dac-ad89-bf8ad279c655 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] [instance: 258bc0cb-6718-4f8b-8d0b-ef544b2b659b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='58548514-5dac-426c-81f5-19e3fba33e23',instance=,instance_uuid=7d71d6d3-3a63-406b-ac49-3e83bd539cf9,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:44:10.556511 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-5360ba3c-d00a-4092-a3bd-64f0628241df tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:44:10.571391 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-5360ba3c-d00a-4092-a3bd-64f0628241df tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/ec437ce7-b43a-4c8b-8a06-756cfb877851" status: 200 len: 1463 microversion: 2.1 time: 0.222126 Oct 04 21:44:10.572776 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 152/292] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:44:10 2022] GET /compute/v2.1/servers/ec437ce7-b43a-4c8b-8a06-756cfb877851 => generated 1463 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:44:10.590797 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-ef52b3cf-0ac0-4e00-a9a1-ab50dcd4ca62 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:10.591954 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-ef52b3cf-0ac0-4e00-a9a1-ab50dcd4ca62 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] [instance: 80d8aacc-cde5-4451-8697-054eefe15849] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:10.605326 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ef52b3cf-0ac0-4e00-a9a1-ab50dcd4ca62 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:10.606900 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ef52b3cf-0ac0-4e00-a9a1-ab50dcd4ca62 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:10.607392 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ef52b3cf-0ac0-4e00-a9a1-ab50dcd4ca62 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:10.609170 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ef52b3cf-0ac0-4e00-a9a1-ab50dcd4ca62 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:10.609929 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ef52b3cf-0ac0-4e00-a9a1-ab50dcd4ca62 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:10.610544 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ef52b3cf-0ac0-4e00-a9a1-ab50dcd4ca62 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:10.662515 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-57d163e5-25d1-4dac-ad89-bf8ad279c655 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Getting quotas for project 39edf587afe94b60911198aa0bb61613. Resources: {'server_group_members'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:44:10.670748 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-57d163e5-25d1-4dac-ad89-bf8ad279c655 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Getting quotas for user 29842a669a20408b881105135f76cb0a and project 39edf587afe94b60911198aa0bb61613. Resources: {'server_group_members'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:44:10.749694 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-57d163e5-25d1-4dac-ad89-bf8ad279c655 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Getting quotas for project 39edf587afe94b60911198aa0bb61613. Resources: {'server_group_members'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:44:10.767542 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-57d163e5-25d1-4dac-ad89-bf8ad279c655 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Getting quotas for user 29842a669a20408b881105135f76cb0a and project 39edf587afe94b60911198aa0bb61613. Resources: {'server_group_members'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:44:10.798513 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-ef52b3cf-0ac0-4e00-a9a1-ab50dcd4ca62 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5387dbf4e24960809704c398fe999a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bedc0e10ab24824a40d06bb91626088', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:44:10.808463 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-ef52b3cf-0ac0-4e00-a9a1-ab50dcd4ca62 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] 10.222.0.43 "GET /compute/v2.1/servers/80d8aacc-cde5-4451-8697-054eefe15849" status: 200 len: 1320 microversion: 2.1 time: 0.232761 Oct 04 21:44:10.809044 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 153/293] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:44:10 2022] GET /compute/v2.1/servers/80d8aacc-cde5-4451-8697-054eefe15849 => generated 1320 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:44:10.814731 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-51cdce71-5a56-4cd6-bc60-a271b21d43ff tempest-AggregatesAdminTestJSON-1644938243 tempest-AggregatesAdminTestJSON-1644938243-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-860284-1"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:44:10.844360 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-51cdce71-5a56-4cd6-bc60-a271b21d43ff tempest-AggregatesAdminTestJSON-1644938243 tempest-AggregatesAdminTestJSON-1644938243-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:10.846699 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-57d163e5-25d1-4dac-ad89-bf8ad279c655 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.267961 Oct 04 21:44:10.847443 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 141/294] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 21:44:09 2022] POST /compute/v2.1/servers => generated 32 bytes in 1270 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Oct 04 21:44:10.847577 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-51cdce71-5a56-4cd6-bc60-a271b21d43ff tempest-AggregatesAdminTestJSON-1644938243 tempest-AggregatesAdminTestJSON-1644938243-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:10.853168 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-51cdce71-5a56-4cd6-bc60-a271b21d43ff tempest-AggregatesAdminTestJSON-1644938243 tempest-AggregatesAdminTestJSON-1644938243-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:10.853683 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-1f812e1c-56e2-41bd-b822-6fced588878b tempest-QuotasAdminTestV236-185227993 tempest-QuotasAdminTestV236-185227993-project-admin] Action: 'update', calling method: .version_select at 0x7fbb2fbdae50>, body: {"quota_set": {"ram": "2048"}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:44:11.203434 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-51cdce71-5a56-4cd6-bc60-a271b21d43ff tempest-AggregatesAdminTestJSON-1644938243 tempest-AggregatesAdminTestJSON-1644938243-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 243 microversion: 2.1 time: 0.393088 Oct 04 21:44:11.204086 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 154/295] 10.222.0.43 () {60 vars in 1194 bytes} [Tue Oct 4 21:44:10 2022] POST /compute/v2.1/os-aggregates/10/action => generated 243 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:44:11.215602 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-77f68091-9946-449f-88b1-6eb16fd56433 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:11.216234 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-77f68091-9946-449f-88b1-6eb16fd56433 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] [instance: c7b7e541-aa71-44f6-96fb-07c2e6e08520] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:11.291884 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1f812e1c-56e2-41bd-b822-6fced588878b tempest-QuotasAdminTestV236-185227993 tempest-QuotasAdminTestV236-185227993-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:11.292326 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1f812e1c-56e2-41bd-b822-6fced588878b tempest-QuotasAdminTestV236-185227993 tempest-QuotasAdminTestV236-185227993-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:11.292757 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1f812e1c-56e2-41bd-b822-6fced588878b tempest-QuotasAdminTestV236-185227993 tempest-QuotasAdminTestV236-185227993-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:11.293467 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1f812e1c-56e2-41bd-b822-6fced588878b tempest-QuotasAdminTestV236-185227993 tempest-QuotasAdminTestV236-185227993-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:11.293946 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1f812e1c-56e2-41bd-b822-6fced588878b tempest-QuotasAdminTestV236-185227993 tempest-QuotasAdminTestV236-185227993-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:11.294445 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1f812e1c-56e2-41bd-b822-6fced588878b tempest-QuotasAdminTestV236-185227993 tempest-QuotasAdminTestV236-185227993-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:11.330583 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-77f68091-9946-449f-88b1-6eb16fd56433 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1789bb97219a4e1591632126812ea6df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da67fc95e2814f4086df020f4c475764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:44:11.338965 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-77f68091-9946-449f-88b1-6eb16fd56433 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] 10.222.0.43 "GET /compute/v2.1/servers/c7b7e541-aa71-44f6-96fb-07c2e6e08520" status: 200 len: 1264 microversion: 2.1 time: 0.133813 Oct 04 21:44:11.341109 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 155/296] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:44:11 2022] GET /compute/v2.1/servers/c7b7e541-aa71-44f6-96fb-07c2e6e08520 => generated 1264 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:44:11.380942 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1f812e1c-56e2-41bd-b822-6fced588878b tempest-QuotasAdminTestV236-185227993 tempest-QuotasAdminTestV236-185227993-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:11.383323 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1f812e1c-56e2-41bd-b822-6fced588878b tempest-QuotasAdminTestV236-185227993 tempest-QuotasAdminTestV236-185227993-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:11.384269 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1f812e1c-56e2-41bd-b822-6fced588878b tempest-QuotasAdminTestV236-185227993 tempest-QuotasAdminTestV236-185227993-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:11.386215 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1f812e1c-56e2-41bd-b822-6fced588878b tempest-QuotasAdminTestV236-185227993 tempest-QuotasAdminTestV236-185227993-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:11.389389 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1f812e1c-56e2-41bd-b822-6fced588878b tempest-QuotasAdminTestV236-185227993 tempest-QuotasAdminTestV236-185227993-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:11.390156 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1f812e1c-56e2-41bd-b822-6fced588878b tempest-QuotasAdminTestV236-185227993 tempest-QuotasAdminTestV236-185227993-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:11.551155 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-1f812e1c-56e2-41bd-b822-6fced588878b tempest-QuotasAdminTestV236-185227993 tempest-QuotasAdminTestV236-185227993-project-admin] 10.222.0.43 "PUT /compute/v2.1/os-quota-sets/5071c1db6c8447de83a8e74f7ec94c5d?user_id=4b7400f211244e8da579a4a689127a95" status: 200 len: 240 microversion: 2.36 time: 0.702373 Oct 04 21:44:11.552079 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 142/297] 10.222.0.43 () {62 vars in 1384 bytes} [Tue Oct 4 21:44:10 2022] PUT /compute/v2.1/os-quota-sets/5071c1db6c8447de83a8e74f7ec94c5d?user_id=4b7400f211244e8da579a4a689127a95 => generated 240 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:44:11.562208 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-52ed22d2-db9b-4d1b-b66b-1b42b16ff2cb tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:11.576907 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-52ed22d2-db9b-4d1b-b66b-1b42b16ff2cb tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '29842a669a20408b881105135f76cb0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39edf587afe94b60911198aa0bb61613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:44:11.577994 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-52ed22d2-db9b-4d1b-b66b-1b42b16ff2cb tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Searching by: {'deleted': False, 'project_id': '39edf587afe94b60911198aa0bb61613'} {{(pid=134102) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 21:44:11.609100 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-52ed22d2-db9b-4d1b-b66b-1b42b16ff2cb tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:11.610058 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-52ed22d2-db9b-4d1b-b66b-1b42b16ff2cb tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:11.610534 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-52ed22d2-db9b-4d1b-b66b-1b42b16ff2cb tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:11.611275 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-52ed22d2-db9b-4d1b-b66b-1b42b16ff2cb tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:11.612195 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-52ed22d2-db9b-4d1b-b66b-1b42b16ff2cb tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:11.612844 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-52ed22d2-db9b-4d1b-b66b-1b42b16ff2cb tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:11.753965 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-41146362-df75-488c-b8ee-2f7af0c592f7 tempest-MigrationsAdminTest-1218821219 tempest-MigrationsAdminTest-1218821219-project-admin] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:11.755152 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-41146362-df75-488c-b8ee-2f7af0c592f7 tempest-MigrationsAdminTest-1218821219 tempest-MigrationsAdminTest-1218821219-project-admin] [instance: ec437ce7-b43a-4c8b-8a06-756cfb877851] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:11.766991 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-41146362-df75-488c-b8ee-2f7af0c592f7 tempest-MigrationsAdminTest-1218821219 tempest-MigrationsAdminTest-1218821219-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:11.767537 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-41146362-df75-488c-b8ee-2f7af0c592f7 tempest-MigrationsAdminTest-1218821219 tempest-MigrationsAdminTest-1218821219-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:11.768100 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-41146362-df75-488c-b8ee-2f7af0c592f7 tempest-MigrationsAdminTest-1218821219 tempest-MigrationsAdminTest-1218821219-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:11.772410 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-41146362-df75-488c-b8ee-2f7af0c592f7 tempest-MigrationsAdminTest-1218821219 tempest-MigrationsAdminTest-1218821219-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:11.773126 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-41146362-df75-488c-b8ee-2f7af0c592f7 tempest-MigrationsAdminTest-1218821219 tempest-MigrationsAdminTest-1218821219-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:11.776373 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-41146362-df75-488c-b8ee-2f7af0c592f7 tempest-MigrationsAdminTest-1218821219 tempest-MigrationsAdminTest-1218821219-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:11.823892 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.multi_cell_list [None req-52ed22d2-db9b-4d1b-b66b-1b42b16ff2cb tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Listed batch of 2 results from cell out of 998 limit. Returned 2 total so far. {{(pid=134102) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 21:44:12.010718 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-52ed22d2-db9b-4d1b-b66b-1b42b16ff2cb tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] 10.222.0.43 "GET /compute/v2.1/servers" status: 200 len: 999 microversion: 2.1 time: 0.457489 Oct 04 21:44:12.011774 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 143/298] 10.222.0.43 () {58 vars in 1125 bytes} [Tue Oct 4 21:44:11 2022] GET /compute/v2.1/servers => generated 999 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:44:12.017188 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-6360b32d-5040-4f13-9863-66ac435e0c65 req-78941bab-de20-41bc-8493-0b11ec1b342a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80d8aacc-cde5-4451-8697-054eefe15849", "tag": "fafe0a1d-3449-411d-80e8-e00053bf929b"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:44:12.029227 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-6360b32d-5040-4f13-9863-66ac435e0c65 req-78941bab-de20-41bc-8493-0b11ec1b342a service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:12.029712 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-6360b32d-5040-4f13-9863-66ac435e0c65 req-78941bab-de20-41bc-8493-0b11ec1b342a service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:12.030261 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-6360b32d-5040-4f13-9863-66ac435e0c65 req-78941bab-de20-41bc-8493-0b11ec1b342a service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:12.044014 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-6360b32d-5040-4f13-9863-66ac435e0c65 req-78941bab-de20-41bc-8493-0b11ec1b342a service nova] Creating event network-changed:fafe0a1d-3449-411d-80e8-e00053bf929b for instance 80d8aacc-cde5-4451-8697-054eefe15849 on n-h1-860284-1 Oct 04 21:44:12.049557 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-6360b32d-5040-4f13-9863-66ac435e0c65 req-78941bab-de20-41bc-8493-0b11ec1b342a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036371 Oct 04 21:44:12.050630 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 144/299] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:44:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:44:12.056681 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-d9073e22-ec7a-4a62-a6a7-a1a1b50226c9 tempest-AggregatesAdminTestJSON-1644938243 tempest-AggregatesAdminTestJSON-1644938243-project-admin] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:12.069231 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-d9073e22-ec7a-4a62-a6a7-a1a1b50226c9 tempest-AggregatesAdminTestJSON-1644938243 tempest-AggregatesAdminTestJSON-1644938243-project-admin] 10.222.0.43 "GET /compute/v2.1/os-aggregates" status: 200 len: 246 microversion: 2.1 time: 0.017337 Oct 04 21:44:12.077484 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 145/300] 10.222.0.43 () {58 vars in 1143 bytes} [Tue Oct 4 21:44:12 2022] GET /compute/v2.1/os-aggregates => generated 246 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:44:12.082828 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-c8208eaa-8721-41ba-a436-eb9a4f4bb7a1 tempest-QuotasAdminTestV236-185227993 tempest-QuotasAdminTestV236-185227993-project-admin] Calling method '.version_select at 0x7fbb2fa94820>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:12.129684 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-41146362-df75-488c-b8ee-2f7af0c592f7 tempest-MigrationsAdminTest-1218821219 tempest-MigrationsAdminTest-1218821219-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/ec437ce7-b43a-4c8b-8a06-756cfb877851" status: 200 len: 1614 microversion: 2.1 time: 0.787135 Oct 04 21:44:12.134663 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 156/301] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:44:11 2022] GET /compute/v2.1/servers/ec437ce7-b43a-4c8b-8a06-756cfb877851 => generated 1614 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:44:12.141968 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-3621f432-5d14-4e85-a803-ecf02b2d62c1 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:12.142841 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-3621f432-5d14-4e85-a803-ecf02b2d62c1 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] [instance: 80d8aacc-cde5-4451-8697-054eefe15849] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:12.153029 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3621f432-5d14-4e85-a803-ecf02b2d62c1 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:12.153553 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3621f432-5d14-4e85-a803-ecf02b2d62c1 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:12.154172 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3621f432-5d14-4e85-a803-ecf02b2d62c1 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:12.155163 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3621f432-5d14-4e85-a803-ecf02b2d62c1 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:12.155760 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3621f432-5d14-4e85-a803-ecf02b2d62c1 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:12.156560 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3621f432-5d14-4e85-a803-ecf02b2d62c1 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:12.344028 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-3621f432-5d14-4e85-a803-ecf02b2d62c1 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5387dbf4e24960809704c398fe999a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bedc0e10ab24824a40d06bb91626088', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:44:12.356038 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-3621f432-5d14-4e85-a803-ecf02b2d62c1 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] 10.222.0.43 "GET /compute/v2.1/servers/80d8aacc-cde5-4451-8697-054eefe15849" status: 200 len: 1320 microversion: 2.1 time: 0.219918 Oct 04 21:44:12.357428 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 157/302] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:44:12 2022] GET /compute/v2.1/servers/80d8aacc-cde5-4451-8697-054eefe15849 => generated 1320 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:44:12.362665 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-d3b715d2-e7b8-409c-884c-377215a9ebda tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:12.363510 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-d3b715d2-e7b8-409c-884c-377215a9ebda tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] [instance: 258bc0cb-6718-4f8b-8d0b-ef544b2b659b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:12.374438 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d3b715d2-e7b8-409c-884c-377215a9ebda tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:12.375057 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d3b715d2-e7b8-409c-884c-377215a9ebda tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:12.375611 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d3b715d2-e7b8-409c-884c-377215a9ebda tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:12.376528 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d3b715d2-e7b8-409c-884c-377215a9ebda tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:12.377046 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d3b715d2-e7b8-409c-884c-377215a9ebda tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:12.377609 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d3b715d2-e7b8-409c-884c-377215a9ebda tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:12.389562 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-c8208eaa-8721-41ba-a436-eb9a4f4bb7a1 tempest-QuotasAdminTestV236-185227993 tempest-QuotasAdminTestV236-185227993-project-admin] 10.222.0.43 "GET /compute/v2.1/os-quota-sets/5071c1db6c8447de83a8e74f7ec94c5d?user_id=4b7400f211244e8da579a4a689127a95" status: 200 len: 282 microversion: 2.36 time: 0.310530 Oct 04 21:44:12.390784 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 146/303] 10.222.0.43 () {60 vars in 1364 bytes} [Tue Oct 4 21:44:12 2022] GET /compute/v2.1/os-quota-sets/5071c1db6c8447de83a8e74f7ec94c5d?user_id=4b7400f211244e8da579a4a689127a95 => generated 282 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:44:12.395848 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-a311a275-f5fa-4188-92c7-a1e9ffc9474b tempest-AggregatesAdminTestJSON-1644938243 tempest-AggregatesAdminTestJSON-1644938243-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-860284-1"}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:44:12.408327 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a311a275-f5fa-4188-92c7-a1e9ffc9474b tempest-AggregatesAdminTestJSON-1644938243 tempest-AggregatesAdminTestJSON-1644938243-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:12.408950 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a311a275-f5fa-4188-92c7-a1e9ffc9474b tempest-AggregatesAdminTestJSON-1644938243 tempest-AggregatesAdminTestJSON-1644938243-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:12.409461 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a311a275-f5fa-4188-92c7-a1e9ffc9474b tempest-AggregatesAdminTestJSON-1644938243 tempest-AggregatesAdminTestJSON-1644938243-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:12.469383 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-d3b715d2-e7b8-409c-884c-377215a9ebda tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29842a669a20408b881105135f76cb0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39edf587afe94b60911198aa0bb61613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:44:12.480547 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-d3b715d2-e7b8-409c-884c-377215a9ebda tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] 10.222.0.43 "GET /compute/v2.1/servers/258bc0cb-6718-4f8b-8d0b-ef544b2b659b" status: 200 len: 1221 microversion: 2.1 time: 0.121817 Oct 04 21:44:12.488076 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 158/304] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:44:12 2022] GET /compute/v2.1/servers/258bc0cb-6718-4f8b-8d0b-ef544b2b659b => generated 1221 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:44:12.493034 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-46ceeb8e-3557-481e-b2bf-ea7ce23ca8ad tempest-MigrationsAdminTest-1218821219 tempest-MigrationsAdminTest-1218821219-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:44:12.493601 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-46ceeb8e-3557-481e-b2bf-ea7ce23ca8ad tempest-MigrationsAdminTest-1218821219 tempest-MigrationsAdminTest-1218821219-project-admin] [instance: ec437ce7-b43a-4c8b-8a06-756cfb877851] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:12.500161 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-46ceeb8e-3557-481e-b2bf-ea7ce23ca8ad tempest-MigrationsAdminTest-1218821219 tempest-MigrationsAdminTest-1218821219-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:12.500557 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-46ceeb8e-3557-481e-b2bf-ea7ce23ca8ad tempest-MigrationsAdminTest-1218821219 tempest-MigrationsAdminTest-1218821219-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:12.501484 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-46ceeb8e-3557-481e-b2bf-ea7ce23ca8ad tempest-MigrationsAdminTest-1218821219 tempest-MigrationsAdminTest-1218821219-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:12.502668 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-46ceeb8e-3557-481e-b2bf-ea7ce23ca8ad tempest-MigrationsAdminTest-1218821219 tempest-MigrationsAdminTest-1218821219-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:12.503475 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-46ceeb8e-3557-481e-b2bf-ea7ce23ca8ad tempest-MigrationsAdminTest-1218821219 tempest-MigrationsAdminTest-1218821219-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:12.504289 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-46ceeb8e-3557-481e-b2bf-ea7ce23ca8ad tempest-MigrationsAdminTest-1218821219 tempest-MigrationsAdminTest-1218821219-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:12.577892 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-a311a275-f5fa-4188-92c7-a1e9ffc9474b tempest-AggregatesAdminTestJSON-1644938243 tempest-AggregatesAdminTestJSON-1644938243-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 228 microversion: 2.1 time: 0.185472 Oct 04 21:44:12.579513 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 147/305] 10.222.0.43 () {60 vars in 1194 bytes} [Tue Oct 4 21:44:12 2022] POST /compute/v2.1/os-aggregates/10/action => generated 228 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:44:12.587410 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-d8b45bf9-b889-45e4-8e3a-61c2e95313df tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:12.589121 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-d8b45bf9-b889-45e4-8e3a-61c2e95313df tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] [instance: c7b7e541-aa71-44f6-96fb-07c2e6e08520] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:12.598828 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d8b45bf9-b889-45e4-8e3a-61c2e95313df tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:12.600711 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d8b45bf9-b889-45e4-8e3a-61c2e95313df tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:12.601998 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d8b45bf9-b889-45e4-8e3a-61c2e95313df tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:12.603673 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d8b45bf9-b889-45e4-8e3a-61c2e95313df tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:12.604409 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d8b45bf9-b889-45e4-8e3a-61c2e95313df tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:12.605072 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d8b45bf9-b889-45e4-8e3a-61c2e95313df tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:12.612907 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-46ceeb8e-3557-481e-b2bf-ea7ce23ca8ad tempest-MigrationsAdminTest-1218821219 tempest-MigrationsAdminTest-1218821219-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '79dde648c25e4351a6049c34b0a0cb18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aafb7e29584718884558b0baf7af32', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:44:12.613523 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-46ceeb8e-3557-481e-b2bf-ea7ce23ca8ad tempest-MigrationsAdminTest-1218821219 tempest-MigrationsAdminTest-1218821219-project-admin] [instance: ec437ce7-b43a-4c8b-8a06-756cfb877851] flavor_id is None. Assuming migration. {{(pid=134101) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 04 21:44:12.613962 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-46ceeb8e-3557-481e-b2bf-ea7ce23ca8ad tempest-MigrationsAdminTest-1218821219 tempest-MigrationsAdminTest-1218821219-project-admin] [instance: ec437ce7-b43a-4c8b-8a06-756cfb877851] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=134101) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 04 21:44:12.715889 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-d8b45bf9-b889-45e4-8e3a-61c2e95313df tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1789bb97219a4e1591632126812ea6df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da67fc95e2814f4086df020f4c475764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:44:12.731292 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-d8b45bf9-b889-45e4-8e3a-61c2e95313df tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] 10.222.0.43 "GET /compute/v2.1/servers/c7b7e541-aa71-44f6-96fb-07c2e6e08520" status: 200 len: 1316 microversion: 2.1 time: 0.149439 Oct 04 21:44:12.732371 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 148/306] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:44:12 2022] GET /compute/v2.1/servers/c7b7e541-aa71-44f6-96fb-07c2e6e08520 => generated 1316 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:44:12.739822 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-fe4b18bf-f7ff-4b14-b86a-71aa57367bda tempest-AggregatesAdminTestJSON-1644938243 tempest-AggregatesAdminTestJSON-1644938243-project-admin] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:12.783733 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-fe4b18bf-f7ff-4b14-b86a-71aa57367bda tempest-AggregatesAdminTestJSON-1644938243 tempest-AggregatesAdminTestJSON-1644938243-project-admin] 10.222.0.43 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.048398 Oct 04 21:44:12.784771 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 149/307] 10.222.0.43 () {58 vars in 1155 bytes} [Tue Oct 4 21:44:12 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 21:44:12.797106 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-18366f59-bb3d-4e6d-b36f-bbb82028cbc8 tempest-AggregatesAdminTestJSON-1644938243 tempest-AggregatesAdminTestJSON-1644938243-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-473107877"}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:44:12.808670 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.objects.aggregate [None req-18366f59-bb3d-4e6d-b36f-bbb82028cbc8 tempest-AggregatesAdminTestJSON-1644938243 tempest-AggregatesAdminTestJSON-1644938243-project-admin] Generated uuid b8af018f-d631-4bc1-9909-ff45c35420da for aggregate {{(pid=134102) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 21:44:12.823432 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=7,nova_api:DELETE=3 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:44:12.864887 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-18366f59-bb3d-4e6d-b36f-bbb82028cbc8 tempest-AggregatesAdminTestJSON-1644938243 tempest-AggregatesAdminTestJSON-1644938243-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.072589 Oct 04 21:44:12.866269 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 150/308] 10.222.0.43 () {60 vars in 1164 bytes} [Tue Oct 4 21:44:12 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:44:12.876964 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-98ca7a6e-41d4-4b5c-b5c1-5acd7c996d62 tempest-AggregatesAdminTestJSON-1644938243 tempest-AggregatesAdminTestJSON-1644938243-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-860284-1"}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:44:12.889681 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-98ca7a6e-41d4-4b5c-b5c1-5acd7c996d62 tempest-AggregatesAdminTestJSON-1644938243 tempest-AggregatesAdminTestJSON-1644938243-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:12.890511 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-98ca7a6e-41d4-4b5c-b5c1-5acd7c996d62 tempest-AggregatesAdminTestJSON-1644938243 tempest-AggregatesAdminTestJSON-1644938243-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:12.890708 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-98ca7a6e-41d4-4b5c-b5c1-5acd7c996d62 tempest-AggregatesAdminTestJSON-1644938243 tempest-AggregatesAdminTestJSON-1644938243-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:12.961110 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-46ceeb8e-3557-481e-b2bf-ea7ce23ca8ad tempest-MigrationsAdminTest-1218821219 tempest-MigrationsAdminTest-1218821219-project-admin] 10.222.0.43 "POST /compute/v2.1/servers/ec437ce7-b43a-4c8b-8a06-756cfb877851/action" status: 202 len: 0 microversion: 2.1 time: 0.470464 Oct 04 21:44:12.962609 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 159/309] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 21:44:12 2022] POST /compute/v2.1/servers/ec437ce7-b43a-4c8b-8a06-756cfb877851/action => generated 0 bytes in 474 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:44:12.974121 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-de72d662-8ac6-4f1e-975b-f28b3a12eccb tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:12.975672 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-de72d662-8ac6-4f1e-975b-f28b3a12eccb tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: ec437ce7-b43a-4c8b-8a06-756cfb877851] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:12.984450 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-de72d662-8ac6-4f1e-975b-f28b3a12eccb tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:12.985263 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-de72d662-8ac6-4f1e-975b-f28b3a12eccb tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:12.985764 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-de72d662-8ac6-4f1e-975b-f28b3a12eccb tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:12.986602 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-de72d662-8ac6-4f1e-975b-f28b3a12eccb tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:12.987095 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-de72d662-8ac6-4f1e-975b-f28b3a12eccb tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:12.987591 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-de72d662-8ac6-4f1e-975b-f28b3a12eccb tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:13.091405 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-98ca7a6e-41d4-4b5c-b5c1-5acd7c996d62 tempest-AggregatesAdminTestJSON-1644938243 tempest-AggregatesAdminTestJSON-1644938243-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 242 microversion: 2.1 time: 0.218352 Oct 04 21:44:13.092968 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 151/310] 10.222.0.43 () {60 vars in 1194 bytes} [Tue Oct 4 21:44:12 2022] POST /compute/v2.1/os-aggregates/11/action => generated 242 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:44:13.104860 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-d30d761b-6cad-4d9a-bc27-5aeedccf2df4 tempest-AggregatesAdminTestJSON-1644938243 tempest-AggregatesAdminTestJSON-1644938243-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-860284-1"}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:44:13.146222 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d30d761b-6cad-4d9a-bc27-5aeedccf2df4 tempest-AggregatesAdminTestJSON-1644938243 tempest-AggregatesAdminTestJSON-1644938243-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:13.146806 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d30d761b-6cad-4d9a-bc27-5aeedccf2df4 tempest-AggregatesAdminTestJSON-1644938243 tempest-AggregatesAdminTestJSON-1644938243-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:13.147511 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d30d761b-6cad-4d9a-bc27-5aeedccf2df4 tempest-AggregatesAdminTestJSON-1644938243 tempest-AggregatesAdminTestJSON-1644938243-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:13.194492 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-de72d662-8ac6-4f1e-975b-f28b3a12eccb tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:44:13.212842 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-de72d662-8ac6-4f1e-975b-f28b3a12eccb tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/ec437ce7-b43a-4c8b-8a06-756cfb877851" status: 200 len: 1472 microversion: 2.1 time: 0.245093 Oct 04 21:44:13.213990 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 160/311] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:44:12 2022] GET /compute/v2.1/servers/ec437ce7-b43a-4c8b-8a06-756cfb877851 => generated 1472 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:44:13.342091 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-d30d761b-6cad-4d9a-bc27-5aeedccf2df4 tempest-AggregatesAdminTestJSON-1644938243 tempest-AggregatesAdminTestJSON-1644938243-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 227 microversion: 2.1 time: 0.239362 Oct 04 21:44:13.343194 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 152/312] 10.222.0.43 () {60 vars in 1194 bytes} [Tue Oct 4 21:44:13 2022] POST /compute/v2.1/os-aggregates/11/action => generated 227 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:44:13.356700 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-76a52dff-eb23-4278-a8fa-5d20a2a7330e tempest-AggregatesAdminTestJSON-1644938243 tempest-AggregatesAdminTestJSON-1644938243-project-admin] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:13.384270 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-32abfaaa-3cf1-4495-831d-a8f00e748f2c tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:13.384994 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-32abfaaa-3cf1-4495-831d-a8f00e748f2c tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] [instance: 80d8aacc-cde5-4451-8697-054eefe15849] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:13.396370 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-32abfaaa-3cf1-4495-831d-a8f00e748f2c tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:13.397149 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-32abfaaa-3cf1-4495-831d-a8f00e748f2c tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:13.397692 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-32abfaaa-3cf1-4495-831d-a8f00e748f2c tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:13.401643 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-32abfaaa-3cf1-4495-831d-a8f00e748f2c tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:13.402405 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-32abfaaa-3cf1-4495-831d-a8f00e748f2c tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:13.404276 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-32abfaaa-3cf1-4495-831d-a8f00e748f2c tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:13.422775 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-76a52dff-eb23-4278-a8fa-5d20a2a7330e tempest-AggregatesAdminTestJSON-1644938243 tempest-AggregatesAdminTestJSON-1644938243-project-admin] 10.222.0.43 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.066325 Oct 04 21:44:13.428677 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 161/313] 10.222.0.43 () {58 vars in 1155 bytes} [Tue Oct 4 21:44:13 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 21:44:13.436997 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-85fe5679-f833-4a32-a99d-dc154381cb12 tempest-AggregatesAdminTestJSON-1644938243 tempest-AggregatesAdminTestJSON-1644938243-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1867353018"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:44:13.441870 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.objects.aggregate [None req-85fe5679-f833-4a32-a99d-dc154381cb12 tempest-AggregatesAdminTestJSON-1644938243 tempest-AggregatesAdminTestJSON-1644938243-project-admin] Generated uuid adc63714-1da8-4668-91e1-4b44e599a77b for aggregate {{(pid=134101) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 21:44:13.489880 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-85fe5679-f833-4a32-a99d-dc154381cb12 tempest-AggregatesAdminTestJSON-1644938243 tempest-AggregatesAdminTestJSON-1644938243-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.060009 Oct 04 21:44:13.491764 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 162/314] 10.222.0.43 () {60 vars in 1164 bytes} [Tue Oct 4 21:44:13 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:44:13.502345 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-9e826e38-e230-4eea-81af-59a8a6645a48 tempest-AggregatesAdminNegativeTestJSON-664564698 tempest-AggregatesAdminNegativeTestJSON-664564698-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1490902428"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:44:13.517708 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.objects.aggregate [None req-9e826e38-e230-4eea-81af-59a8a6645a48 tempest-AggregatesAdminNegativeTestJSON-664564698 tempest-AggregatesAdminNegativeTestJSON-664564698-project-admin] Generated uuid 17ed7e6c-950a-40dc-976d-e32cf7ced8f3 for aggregate {{(pid=134101) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 21:44:13.551098 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-9e826e38-e230-4eea-81af-59a8a6645a48 tempest-AggregatesAdminNegativeTestJSON-664564698 tempest-AggregatesAdminNegativeTestJSON-664564698-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.052992 Oct 04 21:44:13.552263 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 163/315] 10.222.0.43 () {60 vars in 1164 bytes} [Tue Oct 4 21:44:13 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:44:13.565688 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-8d962b3f-d8e7-4e8c-aa6b-ca7c325cb776 tempest-AggregatesAdminTestJSON-1644938243 tempest-AggregatesAdminTestJSON-1644938243-project-admin] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:13.583376 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:INSERT=9,nova_api:SELECT=88,nova_api:DELETE=3 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:44:13.608514 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-8d962b3f-d8e7-4e8c-aa6b-ca7c325cb776 tempest-AggregatesAdminTestJSON-1644938243 tempest-AggregatesAdminTestJSON-1644938243-project-admin] 10.222.0.43 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.053659 Oct 04 21:44:13.614466 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 164/316] 10.222.0.43 () {58 vars in 1155 bytes} [Tue Oct 4 21:44:13 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 21:44:13.620028 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-6e233ad9-ab7d-4b6e-ad0f-40f1d0b6ba9c tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:13.620737 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-6e233ad9-ab7d-4b6e-ad0f-40f1d0b6ba9c tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] [instance: 258bc0cb-6718-4f8b-8d0b-ef544b2b659b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:13.630793 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6e233ad9-ab7d-4b6e-ad0f-40f1d0b6ba9c tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:13.631419 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6e233ad9-ab7d-4b6e-ad0f-40f1d0b6ba9c tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:13.632041 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6e233ad9-ab7d-4b6e-ad0f-40f1d0b6ba9c tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:13.633476 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6e233ad9-ab7d-4b6e-ad0f-40f1d0b6ba9c tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:13.634188 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6e233ad9-ab7d-4b6e-ad0f-40f1d0b6ba9c tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:13.634980 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6e233ad9-ab7d-4b6e-ad0f-40f1d0b6ba9c tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:13.807485 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-6e233ad9-ab7d-4b6e-ad0f-40f1d0b6ba9c tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29842a669a20408b881105135f76cb0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39edf587afe94b60911198aa0bb61613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:44:13.829546 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-6e233ad9-ab7d-4b6e-ad0f-40f1d0b6ba9c tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] 10.222.0.43 "GET /compute/v2.1/servers/258bc0cb-6718-4f8b-8d0b-ef544b2b659b" status: 200 len: 1221 microversion: 2.1 time: 0.213752 Oct 04 21:44:13.830176 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 165/317] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:44:13 2022] GET /compute/v2.1/servers/258bc0cb-6718-4f8b-8d0b-ef544b2b659b => generated 1221 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:44:13.855731 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-19eca083-730e-46c9-82ba-630988a8e753 tempest-AggregatesAdminNegativeTestJSON-664564698 tempest-AggregatesAdminNegativeTestJSON-664564698-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-860284-1"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:44:13.884885 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-32abfaaa-3cf1-4495-831d-a8f00e748f2c tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5387dbf4e24960809704c398fe999a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bedc0e10ab24824a40d06bb91626088', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:44:13.897325 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-32abfaaa-3cf1-4495-831d-a8f00e748f2c tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] 10.222.0.43 "GET /compute/v2.1/servers/80d8aacc-cde5-4451-8697-054eefe15849" status: 200 len: 1320 microversion: 2.1 time: 0.521564 Oct 04 21:44:13.914391 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 153/318] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:44:13 2022] GET /compute/v2.1/servers/80d8aacc-cde5-4451-8697-054eefe15849 => generated 1320 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:44:13.914704 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-19eca083-730e-46c9-82ba-630988a8e753 tempest-AggregatesAdminNegativeTestJSON-664564698 tempest-AggregatesAdminNegativeTestJSON-664564698-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:13.914704 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-19eca083-730e-46c9-82ba-630988a8e753 tempest-AggregatesAdminNegativeTestJSON-664564698 tempest-AggregatesAdminNegativeTestJSON-664564698-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:13.914704 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-19eca083-730e-46c9-82ba-630988a8e753 tempest-AggregatesAdminNegativeTestJSON-664564698 tempest-AggregatesAdminNegativeTestJSON-664564698-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:13.915570 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-14470504-5293-4d25-ac17-1aa444f94354 tempest-AggregatesAdminTestJSON-1644938243 tempest-AggregatesAdminTestJSON-1644938243-project-admin] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:13.931916 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-14470504-5293-4d25-ac17-1aa444f94354 tempest-AggregatesAdminTestJSON-1644938243 tempest-AggregatesAdminTestJSON-1644938243-project-admin] HTTP exception thrown: Aggregate 12 could not be found. Oct 04 21:44:13.938381 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-14470504-5293-4d25-ac17-1aa444f94354 tempest-AggregatesAdminTestJSON-1644938243 tempest-AggregatesAdminTestJSON-1644938243-project-admin] Request method failure captured: Oct 04 21:44:13.938381 n-d-860284-1 devstack@n-api.service[134102]: request: GET /compute/v2.1/os-aggregates/12 HTTP/1.1 Oct 04 21:44:13.938381 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 21:44:13.938381 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 21:44:13.938381 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 21:44:13.938381 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 21:44:13.938381 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 21:44:13.938381 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 21:44:13.938381 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 21:44:13.938381 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 21:44:13.938381 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPKj3WbterVERMqp50TyjFiUecmqTOFRgoTcw8-v7fr57d_GRcxqLYd6FvCeiEyE9CfSsfwAcz2jSs5en9awaJqW1R9i7P_XY0Ot9eAPoEgJ_2K2DyqLhoCi4UW7OypSHTaLpWKOlgWHNFl_IpuldyYNAJ_Gtps-GBmXMHoXCOiFSp-Y Oct 04 21:44:13.938381 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 21:44:13.938381 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 21:44:13.938381 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 21:44:13.938381 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 21:44:13.938381 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 21:44:13.938381 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 21:44:13.938381 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: acbb6c35938b4e659be30ff03ee05f39 Oct 04 21:44:13.938381 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-AggregatesAdminTestJSON-1644938243 Oct 04 21:44:13.938381 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,admin,member Oct 04 21:44:13.938381 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,admin,member Oct 04 21:44:13.939712 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/acbb6c35938b4e659be30ff03ee05f39"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_acbb6c35938b4e659be30ff03ee05f39", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/acbb6c35938b4e659be30ff03ee05f39"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/acbb6c35938b4e659be30ff03ee05f39"}]}] Oct 04 21:44:13.939712 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-AggregatesAdminTestJSON-1644938243 Oct 04 21:44:13.939712 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: acbb6c35938b4e659be30ff03ee05f39 Oct 04 21:44:13.939712 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1644938243 Oct 04 21:44:13.939712 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-AggregatesAdminTestJSON-1644938243-project-admin Oct 04 21:44:13.939712 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 21:44:13.939712 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 21:44:13.939712 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: 18cfbb9e490d41dba7b7730949f45416 Oct 04 21:44:13.939712 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-AggregatesAdminTestJSON-1644938243-project-admin Oct 04 21:44:13.939712 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 21:44:13.939712 n-d-860284-1 devstack@n-api.service[134102]: exception: Aggregate 12 could not be found. Oct 04 21:44:13.939712 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': '12'} Oct 04 21:44:13.939712 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:44:13.940484 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:44:13.940484 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 04 21:44:13.940484 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 04 21:44:13.940484 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Oct 04 21:44:13.940484 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 04 21:44:13.940484 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 21:44:13.940484 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 21:44:13.940484 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 04 21:44:13.940484 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 04 21:44:13.940484 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 21:44:13.940484 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 21:44:13.940484 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 04 21:44:13.940484 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 04 21:44:13.940484 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 12 could not be found. Oct 04 21:44:13.940484 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:44:13.940484 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:44:13.940484 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:44:13.940484 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:44:13.940484 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:44:13.941566 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:44:13.941566 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:44:13.941566 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:44:13.941566 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:44:13.941566 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:44:13.941566 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 04 21:44:13.941566 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:44:13.941566 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 12 could not be found. Oct 04 21:44:13.941566 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:44:13.941566 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:44:13.941566 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:44:13.941566 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:44:13.941566 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:44:13.941566 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:44:13.941566 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:44:13.941566 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:44:13.941566 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 12 could not be found. Oct 04 21:44:13.941566 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:44:13.942588 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-14470504-5293-4d25-ac17-1aa444f94354 tempest-AggregatesAdminTestJSON-1644938243 tempest-AggregatesAdminTestJSON-1644938243-project-admin] Returning 404 to user: Aggregate 12 could not be found. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:44:13.942790 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-14470504-5293-4d25-ac17-1aa444f94354 tempest-AggregatesAdminTestJSON-1644938243 tempest-AggregatesAdminTestJSON-1644938243-project-admin] 10.222.0.43 "GET /compute/v2.1/os-aggregates/12" status: 404 len: 78 microversion: 2.1 time: 0.036994 Oct 04 21:44:13.949290 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 154/319] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Oct 4 21:44:13 2022] GET /compute/v2.1/os-aggregates/12 => generated 78 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 21:44:13.961900 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-29db8233-9d89-4c34-8c50-930c0ee6ccfa tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:13.963384 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-29db8233-9d89-4c34-8c50-930c0ee6ccfa tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] [instance: c7b7e541-aa71-44f6-96fb-07c2e6e08520] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:13.987224 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-29db8233-9d89-4c34-8c50-930c0ee6ccfa tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:13.988672 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-29db8233-9d89-4c34-8c50-930c0ee6ccfa tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:13.989388 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-29db8233-9d89-4c34-8c50-930c0ee6ccfa tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:13.991688 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-29db8233-9d89-4c34-8c50-930c0ee6ccfa tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:13.992880 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-29db8233-9d89-4c34-8c50-930c0ee6ccfa tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:13.993376 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-29db8233-9d89-4c34-8c50-930c0ee6ccfa tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:14.221676 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-19eca083-730e-46c9-82ba-630988a8e753 tempest-AggregatesAdminNegativeTestJSON-664564698 tempest-AggregatesAdminNegativeTestJSON-664564698-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates/13/action" status: 200 len: 243 microversion: 2.1 time: 0.383479 Oct 04 21:44:14.223068 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 166/320] 10.222.0.43 () {60 vars in 1194 bytes} [Tue Oct 4 21:44:13 2022] POST /compute/v2.1/os-aggregates/13/action => generated 243 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:44:14.230190 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-d5c331b7-4e02-47b6-a3f2-f993976b6261 tempest-AggregatesAdminTestJSON-1644938243 tempest-AggregatesAdminTestJSON-1644938243-project-admin] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:14.244495 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-d5c331b7-4e02-47b6-a3f2-f993976b6261 tempest-AggregatesAdminTestJSON-1644938243 tempest-AggregatesAdminTestJSON-1644938243-project-admin] HTTP exception thrown: Aggregate 12 could not be found. Oct 04 21:44:14.246408 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-d5c331b7-4e02-47b6-a3f2-f993976b6261 tempest-AggregatesAdminTestJSON-1644938243 tempest-AggregatesAdminTestJSON-1644938243-project-admin] Request method failure captured: Oct 04 21:44:14.246408 n-d-860284-1 devstack@n-api.service[134101]: request: DELETE /compute/v2.1/os-aggregates/12 HTTP/1.1 Oct 04 21:44:14.246408 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 21:44:14.246408 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 21:44:14.246408 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 21:44:14.246408 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 21:44:14.246408 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 21:44:14.246408 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 21:44:14.246408 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 21:44:14.246408 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 21:44:14.246408 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPKj3WbterVERMqp50TyjFiUecmqTOFRgoTcw8-v7fr57d_GRcxqLYd6FvCeiEyE9CfSsfwAcz2jSs5en9awaJqW1R9i7P_XY0Ot9eAPoEgJ_2K2DyqLhoCi4UW7OypSHTaLpWKOlgWHNFl_IpuldyYNAJ_Gtps-GBmXMHoXCOiFSp-Y Oct 04 21:44:14.246408 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 21:44:14.246408 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 21:44:14.246408 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 21:44:14.246408 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 21:44:14.246408 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 21:44:14.246408 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 21:44:14.246408 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: acbb6c35938b4e659be30ff03ee05f39 Oct 04 21:44:14.246408 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-AggregatesAdminTestJSON-1644938243 Oct 04 21:44:14.246408 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,admin,member Oct 04 21:44:14.246408 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,admin,member Oct 04 21:44:14.247852 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/acbb6c35938b4e659be30ff03ee05f39"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_acbb6c35938b4e659be30ff03ee05f39", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/acbb6c35938b4e659be30ff03ee05f39"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/acbb6c35938b4e659be30ff03ee05f39"}]}] Oct 04 21:44:14.247852 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-AggregatesAdminTestJSON-1644938243 Oct 04 21:44:14.247852 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: acbb6c35938b4e659be30ff03ee05f39 Oct 04 21:44:14.247852 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1644938243 Oct 04 21:44:14.247852 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-AggregatesAdminTestJSON-1644938243-project-admin Oct 04 21:44:14.247852 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 21:44:14.247852 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 21:44:14.247852 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 18cfbb9e490d41dba7b7730949f45416 Oct 04 21:44:14.247852 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-AggregatesAdminTestJSON-1644938243-project-admin Oct 04 21:44:14.247852 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 21:44:14.247852 n-d-860284-1 devstack@n-api.service[134101]: exception: Aggregate 12 could not be found. Oct 04 21:44:14.247852 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': '12'} Oct 04 21:44:14.247852 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:44:14.248742 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:44:14.248742 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 04 21:44:14.248742 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 04 21:44:14.248742 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 21:44:14.248742 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 21:44:14.248742 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 21:44:14.248742 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 21:44:14.248742 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 21:44:14.248742 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 21:44:14.248742 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 21:44:14.248742 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 21:44:14.248742 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Oct 04 21:44:14.248742 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 04 21:44:14.248742 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 21:44:14.248742 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 21:44:14.248742 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 04 21:44:14.248742 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 04 21:44:14.248742 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 21:44:14.248742 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 21:44:14.250027 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 04 21:44:14.250027 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 04 21:44:14.250027 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 12 could not be found. Oct 04 21:44:14.250027 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:44:14.250027 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:44:14.250027 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:44:14.250027 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:44:14.250027 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:44:14.250027 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:44:14.250027 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:44:14.250027 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:44:14.250027 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:44:14.250027 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:44:14.250027 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 04 21:44:14.250027 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:44:14.250027 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 12 could not be found. Oct 04 21:44:14.250027 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:44:14.250027 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:44:14.250027 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:44:14.250027 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:44:14.250027 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:44:14.251291 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:44:14.251291 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:44:14.251291 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:44:14.251291 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 12 could not be found. Oct 04 21:44:14.251291 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:44:14.251291 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-d5c331b7-4e02-47b6-a3f2-f993976b6261 tempest-AggregatesAdminTestJSON-1644938243 tempest-AggregatesAdminTestJSON-1644938243-project-admin] Returning 404 to user: Aggregate 12 could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:44:14.251291 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-d5c331b7-4e02-47b6-a3f2-f993976b6261 tempest-AggregatesAdminTestJSON-1644938243 tempest-AggregatesAdminTestJSON-1644938243-project-admin] 10.222.0.43 "DELETE /compute/v2.1/os-aggregates/12" status: 404 len: 78 microversion: 2.1 time: 0.023525 Oct 04 21:44:14.253469 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 167/321] 10.222.0.43 () {58 vars in 1155 bytes} [Tue Oct 4 21:44:14 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 78 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 21:44:14.259040 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-589cfa34-ffc3-4be0-b7d1-2aa2c8dfde9d tempest-AggregatesAdminNegativeTestJSON-924415762 tempest-AggregatesAdminNegativeTestJSON-924415762-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-860284-1"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:44:14.263753 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-589cfa34-ffc3-4be0-b7d1-2aa2c8dfde9d tempest-AggregatesAdminNegativeTestJSON-924415762 tempest-AggregatesAdminNegativeTestJSON-924415762-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': 'fcfba6078cc8420d913383e2082a22ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa8ecde157b463193ea9635b15ad255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:44:14.266004 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-589cfa34-ffc3-4be0-b7d1-2aa2c8dfde9d tempest-AggregatesAdminNegativeTestJSON-924415762 tempest-AggregatesAdminNegativeTestJSON-924415762-project] Request method failure captured: Oct 04 21:44:14.266004 n-d-860284-1 devstack@n-api.service[134101]: request: POST /compute/v2.1/os-aggregates/13/action HTTP/1.1 Oct 04 21:44:14.266004 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 21:44:14.266004 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 21:44:14.266004 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 21:44:14.266004 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 42 Oct 04 21:44:14.266004 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 21:44:14.266004 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 21:44:14.266004 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 21:44:14.266004 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 21:44:14.266004 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPKj0sUoAZZb3Xj012WEWWEcxezFEjoqwdwb2wWQa2zcKJIMCHkH7iRzGhMkrAZ42RHW09PCKNhQ2Uj1QZhXAgjIj4fLq3sXTvQwjQcQezstrjEp16MwU8GSGOH7mhj6mUlcCbKJ073k0NTJyIY37zKtkuywjWPZ3g5u9E6-X6lD2zEs Oct 04 21:44:14.266004 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 21:44:14.266004 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 21:44:14.266004 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 21:44:14.266004 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 21:44:14.266004 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 21:44:14.266004 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 21:44:14.266004 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: 1aa8ecde157b463193ea9635b15ad255 Oct 04 21:44:14.266004 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-924415762 Oct 04 21:44:14.266004 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 21:44:14.266004 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 21:44:14.267523 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1aa8ecde157b463193ea9635b15ad255"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_1aa8ecde157b463193ea9635b15ad255", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1aa8ecde157b463193ea9635b15ad255"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/1aa8ecde157b463193ea9635b15ad255"}]}] Oct 04 21:44:14.267523 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-924415762 Oct 04 21:44:14.267523 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: 1aa8ecde157b463193ea9635b15ad255 Oct 04 21:44:14.267523 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-924415762 Oct 04 21:44:14.267523 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-AggregatesAdminNegativeTestJSON-924415762-project Oct 04 21:44:14.267523 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 21:44:14.267523 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 21:44:14.267523 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: fcfba6078cc8420d913383e2082a22ac Oct 04 21:44:14.267523 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-924415762-project Oct 04 21:44:14.267523 n-d-860284-1 devstack@n-api.service[134101]: Oct 04 21:44:14.267523 n-d-860284-1 devstack@n-api.service[134101]: {"remove_host": {"host": "n-h1-860284-1"}} Oct 04 21:44:14.267523 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 21:44:14.267523 n-d-860284-1 devstack@n-api.service[134101]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 04 21:44:14.268316 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': '13', 'body': {'remove_host': {'host': 'n-h1-860284-1'}}} Oct 04 21:44:14.268316 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:44:14.268316 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:44:14.268316 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:44:14.268316 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:44:14.268316 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:44:14.268316 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:44:14.268316 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:44:14.268316 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:44:14.268316 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:44:14.268316 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:44:14.268316 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host Oct 04 21:44:14.268316 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) Oct 04 21:44:14.268316 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 21:44:14.268316 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 21:44:14.268316 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 21:44:14.268316 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 21:44:14.268316 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 21:44:14.268316 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 21:44:14.269524 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 21:44:14.269524 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 21:44:14.269524 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 21:44:14.269524 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 21:44:14.269524 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 21:44:14.269524 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 21:44:14.269524 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 21:44:14.269524 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 21:44:14.269524 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 04 21:44:14.269524 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:44:14.269524 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:44:14.269524 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:44:14.269524 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:44:14.269524 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:44:14.269524 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:44:14.269524 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 21:44:14.269524 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 21:44:14.269524 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 04 21:44:14.269524 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:44:14.270730 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-589cfa34-ffc3-4be0-b7d1-2aa2c8dfde9d tempest-AggregatesAdminNegativeTestJSON-924415762 tempest-AggregatesAdminNegativeTestJSON-924415762-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:44:14.270730 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-589cfa34-ffc3-4be0-b7d1-2aa2c8dfde9d tempest-AggregatesAdminNegativeTestJSON-924415762 tempest-AggregatesAdminNegativeTestJSON-924415762-project] 10.222.0.43 "POST /compute/v2.1/os-aggregates/13/action" status: 403 len: 121 microversion: 2.1 time: 0.012967 Oct 04 21:44:14.273848 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 168/322] 10.222.0.43 () {60 vars in 1194 bytes} [Tue Oct 4 21:44:14 2022] POST /compute/v2.1/os-aggregates/13/action => generated 121 bytes in 20 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:44:14.279107 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-29db8233-9d89-4c34-8c50-930c0ee6ccfa tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1789bb97219a4e1591632126812ea6df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da67fc95e2814f4086df020f4c475764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:44:14.280186 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-fcc5ed0d-848a-4a90-aca6-03d2080a1c24 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:14.281346 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-fcc5ed0d-848a-4a90-aca6-03d2080a1c24 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: ec437ce7-b43a-4c8b-8a06-756cfb877851] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:14.289597 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fcc5ed0d-848a-4a90-aca6-03d2080a1c24 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:14.290032 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fcc5ed0d-848a-4a90-aca6-03d2080a1c24 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:14.290502 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fcc5ed0d-848a-4a90-aca6-03d2080a1c24 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:14.291226 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fcc5ed0d-848a-4a90-aca6-03d2080a1c24 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:14.291686 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fcc5ed0d-848a-4a90-aca6-03d2080a1c24 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:14.292116 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fcc5ed0d-848a-4a90-aca6-03d2080a1c24 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:14.293590 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-29db8233-9d89-4c34-8c50-930c0ee6ccfa tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] 10.222.0.43 "GET /compute/v2.1/servers/c7b7e541-aa71-44f6-96fb-07c2e6e08520" status: 200 len: 1316 microversion: 2.1 time: 0.342317 Oct 04 21:44:14.297243 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 155/323] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:44:13 2022] GET /compute/v2.1/servers/c7b7e541-aa71-44f6-96fb-07c2e6e08520 => generated 1316 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:44:14.306032 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-8fbf320e-6b6c-4255-be55-fff620451713 tempest-AggregatesAdminTestJSON-1644938243 tempest-AggregatesAdminTestJSON-1644938243-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-1810287574", "name": "tempest-test_aggregate-398221927"}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:44:14.350649 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.objects.aggregate [None req-8fbf320e-6b6c-4255-be55-fff620451713 tempest-AggregatesAdminTestJSON-1644938243 tempest-AggregatesAdminTestJSON-1644938243-project-admin] Generated uuid 3f822e2b-c5bc-4453-9a01-3358054363b9 for aggregate {{(pid=134102) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 21:44:14.428086 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-8fbf320e-6b6c-4255-be55-fff620451713 tempest-AggregatesAdminTestJSON-1644938243 tempest-AggregatesAdminTestJSON-1644938243-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.129624 Oct 04 21:44:14.433801 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 156/324] 10.222.0.43 () {60 vars in 1165 bytes} [Tue Oct 4 21:44:14 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:44:14.444331 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-b3bcd620-3fae-4cb9-a0a0-3c10a904d6fd tempest-AggregatesAdminNegativeTestJSON-664564698 tempest-AggregatesAdminNegativeTestJSON-664564698-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-860284-1"}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:44:14.468606 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b3bcd620-3fae-4cb9-a0a0-3c10a904d6fd tempest-AggregatesAdminNegativeTestJSON-664564698 tempest-AggregatesAdminNegativeTestJSON-664564698-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:14.472754 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b3bcd620-3fae-4cb9-a0a0-3c10a904d6fd tempest-AggregatesAdminNegativeTestJSON-664564698 tempest-AggregatesAdminNegativeTestJSON-664564698-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:14.473311 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b3bcd620-3fae-4cb9-a0a0-3c10a904d6fd tempest-AggregatesAdminNegativeTestJSON-664564698 tempest-AggregatesAdminNegativeTestJSON-664564698-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:14.700437 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-b3bcd620-3fae-4cb9-a0a0-3c10a904d6fd tempest-AggregatesAdminNegativeTestJSON-664564698 tempest-AggregatesAdminNegativeTestJSON-664564698-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates/13/action" status: 200 len: 228 microversion: 2.1 time: 0.265262 Oct 04 21:44:14.704614 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 157/325] 10.222.0.43 () {60 vars in 1194 bytes} [Tue Oct 4 21:44:14 2022] POST /compute/v2.1/os-aggregates/13/action => generated 228 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:44:14.710035 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-5cacdc4c-e406-42e3-bf76-17bde7ad5636 tempest-AggregatesAdminTestJSON-1644938243 tempest-AggregatesAdminTestJSON-1644938243-project-admin] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:14.741240 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-fcc5ed0d-848a-4a90-aca6-03d2080a1c24 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:44:14.765396 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-5cacdc4c-e406-42e3-bf76-17bde7ad5636 tempest-AggregatesAdminTestJSON-1644938243 tempest-AggregatesAdminTestJSON-1644938243-project-admin] 10.222.0.43 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.058861 Oct 04 21:44:14.767227 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 158/326] 10.222.0.43 () {58 vars in 1155 bytes} [Tue Oct 4 21:44:14 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 21:44:14.773989 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-fcc5ed0d-848a-4a90-aca6-03d2080a1c24 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/ec437ce7-b43a-4c8b-8a06-756cfb877851" status: 200 len: 1472 microversion: 2.1 time: 0.497320 Oct 04 21:44:14.774972 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-c8d4197e-dd99-499c-b32c-66f4d9237cf5 tempest-AggregatesAdminNegativeTestJSON-664564698 tempest-AggregatesAdminNegativeTestJSON-664564698-project-admin] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:14.775696 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 169/327] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:44:14 2022] GET /compute/v2.1/servers/ec437ce7-b43a-4c8b-8a06-756cfb877851 => generated 1472 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:44:14.785117 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-a605fa37-fa2a-450d-9641-cb9e6320e2e8 tempest-AggregatesAdminTestJSON-1644938243 tempest-AggregatesAdminTestJSON-1644938243-project-admin] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:14.816654 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-a605fa37-fa2a-450d-9641-cb9e6320e2e8 tempest-AggregatesAdminTestJSON-1644938243 tempest-AggregatesAdminTestJSON-1644938243-project-admin] HTTP exception thrown: Aggregate 14 could not be found. Oct 04 21:44:14.818335 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-a605fa37-fa2a-450d-9641-cb9e6320e2e8 tempest-AggregatesAdminTestJSON-1644938243 tempest-AggregatesAdminTestJSON-1644938243-project-admin] Request method failure captured: Oct 04 21:44:14.818335 n-d-860284-1 devstack@n-api.service[134101]: request: GET /compute/v2.1/os-aggregates/14 HTTP/1.1 Oct 04 21:44:14.818335 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 21:44:14.818335 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 21:44:14.818335 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 21:44:14.818335 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 21:44:14.818335 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 21:44:14.818335 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 21:44:14.818335 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 21:44:14.818335 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 21:44:14.818335 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPKj3WbterVERMqp50TyjFiUecmqTOFRgoTcw8-v7fr57d_GRcxqLYd6FvCeiEyE9CfSsfwAcz2jSs5en9awaJqW1R9i7P_XY0Ot9eAPoEgJ_2K2DyqLhoCi4UW7OypSHTaLpWKOlgWHNFl_IpuldyYNAJ_Gtps-GBmXMHoXCOiFSp-Y Oct 04 21:44:14.818335 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 21:44:14.818335 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 21:44:14.818335 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 21:44:14.818335 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 21:44:14.818335 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 21:44:14.818335 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 21:44:14.818335 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: acbb6c35938b4e659be30ff03ee05f39 Oct 04 21:44:14.818335 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-AggregatesAdminTestJSON-1644938243 Oct 04 21:44:14.818335 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,admin,member Oct 04 21:44:14.818335 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,admin,member Oct 04 21:44:14.819486 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/acbb6c35938b4e659be30ff03ee05f39"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_acbb6c35938b4e659be30ff03ee05f39", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/acbb6c35938b4e659be30ff03ee05f39"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/acbb6c35938b4e659be30ff03ee05f39"}]}] Oct 04 21:44:14.819486 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-AggregatesAdminTestJSON-1644938243 Oct 04 21:44:14.819486 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: acbb6c35938b4e659be30ff03ee05f39 Oct 04 21:44:14.819486 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1644938243 Oct 04 21:44:14.819486 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-AggregatesAdminTestJSON-1644938243-project-admin Oct 04 21:44:14.819486 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 21:44:14.819486 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 21:44:14.819486 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 18cfbb9e490d41dba7b7730949f45416 Oct 04 21:44:14.819486 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-AggregatesAdminTestJSON-1644938243-project-admin Oct 04 21:44:14.819486 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 21:44:14.819486 n-d-860284-1 devstack@n-api.service[134101]: exception: Aggregate 14 could not be found. Oct 04 21:44:14.819486 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': '14'} Oct 04 21:44:14.819486 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:44:14.820232 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:44:14.820232 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 04 21:44:14.820232 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 04 21:44:14.820232 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Oct 04 21:44:14.820232 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 04 21:44:14.820232 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 21:44:14.820232 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 21:44:14.820232 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 04 21:44:14.820232 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 04 21:44:14.820232 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 21:44:14.820232 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 21:44:14.820232 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 04 21:44:14.820232 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 04 21:44:14.820232 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 14 could not be found. Oct 04 21:44:14.820232 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:44:14.820232 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:44:14.820232 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:44:14.820232 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:44:14.820232 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:44:14.821224 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:44:14.821224 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:44:14.821224 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:44:14.821224 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:44:14.821224 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:44:14.821224 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 04 21:44:14.821224 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:44:14.821224 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 14 could not be found. Oct 04 21:44:14.821224 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:44:14.821224 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:44:14.821224 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:44:14.821224 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:44:14.821224 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:44:14.821224 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:44:14.821224 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:44:14.821224 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:44:14.821224 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 14 could not be found. Oct 04 21:44:14.821224 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:44:14.822153 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-a605fa37-fa2a-450d-9641-cb9e6320e2e8 tempest-AggregatesAdminTestJSON-1644938243 tempest-AggregatesAdminTestJSON-1644938243-project-admin] Returning 404 to user: Aggregate 14 could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:44:14.822153 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-a605fa37-fa2a-450d-9641-cb9e6320e2e8 tempest-AggregatesAdminTestJSON-1644938243 tempest-AggregatesAdminTestJSON-1644938243-project-admin] 10.222.0.43 "GET /compute/v2.1/os-aggregates/14" status: 404 len: 78 microversion: 2.1 time: 0.042848 Oct 04 21:44:14.822153 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 170/328] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Oct 4 21:44:14 2022] GET /compute/v2.1/os-aggregates/14 => generated 78 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 21:44:14.831775 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-eeba7c65-0071-4b2b-b588-f4c38d0ec811 tempest-AggregatesAdminTestJSON-1644938243 tempest-AggregatesAdminTestJSON-1644938243-project-admin] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:14.849412 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-c8d4197e-dd99-499c-b32c-66f4d9237cf5 tempest-AggregatesAdminNegativeTestJSON-664564698 tempest-AggregatesAdminNegativeTestJSON-664564698-project-admin] 10.222.0.43 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.079634 Oct 04 21:44:14.850134 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 159/329] 10.222.0.43 () {58 vars in 1155 bytes} [Tue Oct 4 21:44:14 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 21:44:14.870444 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-9596a473-8280-4c77-8d35-f83eefd4f6ea tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:14.871082 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-9596a473-8280-4c77-8d35-f83eefd4f6ea tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] [instance: 258bc0cb-6718-4f8b-8d0b-ef544b2b659b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:14.894132 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-eeba7c65-0071-4b2b-b588-f4c38d0ec811 tempest-AggregatesAdminTestJSON-1644938243 tempest-AggregatesAdminTestJSON-1644938243-project-admin] HTTP exception thrown: Aggregate 14 could not be found. Oct 04 21:44:14.897794 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-eeba7c65-0071-4b2b-b588-f4c38d0ec811 tempest-AggregatesAdminTestJSON-1644938243 tempest-AggregatesAdminTestJSON-1644938243-project-admin] Request method failure captured: Oct 04 21:44:14.897794 n-d-860284-1 devstack@n-api.service[134101]: request: DELETE /compute/v2.1/os-aggregates/14 HTTP/1.1 Oct 04 21:44:14.897794 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 21:44:14.897794 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 21:44:14.897794 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 21:44:14.897794 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 21:44:14.897794 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 21:44:14.897794 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 21:44:14.897794 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 21:44:14.897794 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 21:44:14.897794 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPKj3WbterVERMqp50TyjFiUecmqTOFRgoTcw8-v7fr57d_GRcxqLYd6FvCeiEyE9CfSsfwAcz2jSs5en9awaJqW1R9i7P_XY0Ot9eAPoEgJ_2K2DyqLhoCi4UW7OypSHTaLpWKOlgWHNFl_IpuldyYNAJ_Gtps-GBmXMHoXCOiFSp-Y Oct 04 21:44:14.897794 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 21:44:14.897794 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 21:44:14.897794 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 21:44:14.897794 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 21:44:14.897794 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 21:44:14.897794 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 21:44:14.897794 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: acbb6c35938b4e659be30ff03ee05f39 Oct 04 21:44:14.897794 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-AggregatesAdminTestJSON-1644938243 Oct 04 21:44:14.897794 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,admin,member Oct 04 21:44:14.897794 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,admin,member Oct 04 21:44:14.899198 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/acbb6c35938b4e659be30ff03ee05f39"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_acbb6c35938b4e659be30ff03ee05f39", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/acbb6c35938b4e659be30ff03ee05f39"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/acbb6c35938b4e659be30ff03ee05f39"}]}] Oct 04 21:44:14.899198 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-AggregatesAdminTestJSON-1644938243 Oct 04 21:44:14.899198 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: acbb6c35938b4e659be30ff03ee05f39 Oct 04 21:44:14.899198 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1644938243 Oct 04 21:44:14.899198 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-AggregatesAdminTestJSON-1644938243-project-admin Oct 04 21:44:14.899198 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 21:44:14.899198 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 21:44:14.899198 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 18cfbb9e490d41dba7b7730949f45416 Oct 04 21:44:14.899198 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-AggregatesAdminTestJSON-1644938243-project-admin Oct 04 21:44:14.899198 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 21:44:14.899198 n-d-860284-1 devstack@n-api.service[134101]: exception: Aggregate 14 could not be found. Oct 04 21:44:14.899198 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': '14'} Oct 04 21:44:14.899198 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:44:14.899882 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:44:14.899882 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 04 21:44:14.899882 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 04 21:44:14.899882 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 21:44:14.899882 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 21:44:14.899882 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 21:44:14.899882 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 21:44:14.899882 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 21:44:14.899882 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 21:44:14.899882 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 21:44:14.899882 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 21:44:14.899882 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Oct 04 21:44:14.899882 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 04 21:44:14.899882 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 21:44:14.899882 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 21:44:14.899882 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 04 21:44:14.899882 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 04 21:44:14.899882 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 21:44:14.899882 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 21:44:14.900972 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 04 21:44:14.900972 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 04 21:44:14.900972 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 14 could not be found. Oct 04 21:44:14.900972 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:44:14.900972 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:44:14.900972 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:44:14.900972 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:44:14.900972 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:44:14.900972 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:44:14.900972 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:44:14.900972 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:44:14.900972 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:44:14.900972 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:44:14.900972 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 04 21:44:14.900972 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:44:14.900972 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 14 could not be found. Oct 04 21:44:14.900972 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:44:14.900972 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:44:14.900972 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:44:14.900972 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:44:14.900972 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:44:14.902162 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:44:14.902162 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:44:14.902162 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:44:14.902162 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 14 could not be found. Oct 04 21:44:14.902162 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:44:14.902162 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-eeba7c65-0071-4b2b-b588-f4c38d0ec811 tempest-AggregatesAdminTestJSON-1644938243 tempest-AggregatesAdminTestJSON-1644938243-project-admin] Returning 404 to user: Aggregate 14 could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:44:14.902162 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-eeba7c65-0071-4b2b-b588-f4c38d0ec811 tempest-AggregatesAdminTestJSON-1644938243 tempest-AggregatesAdminTestJSON-1644938243-project-admin] 10.222.0.43 "DELETE /compute/v2.1/os-aggregates/14" status: 404 len: 78 microversion: 2.1 time: 0.075202 Oct 04 21:44:14.902586 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9596a473-8280-4c77-8d35-f83eefd4f6ea tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:14.903783 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 171/330] 10.222.0.43 () {58 vars in 1155 bytes} [Tue Oct 4 21:44:14 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 78 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 04 21:44:14.903947 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9596a473-8280-4c77-8d35-f83eefd4f6ea tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:14.903947 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9596a473-8280-4c77-8d35-f83eefd4f6ea tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:14.903947 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9596a473-8280-4c77-8d35-f83eefd4f6ea tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:14.903947 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9596a473-8280-4c77-8d35-f83eefd4f6ea tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:14.904513 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9596a473-8280-4c77-8d35-f83eefd4f6ea tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:14.911928 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-ab1f7a1f-625c-4dce-acfb-9d1b363a2b98 tempest-AggregatesAdminNegativeTestJSON-664564698 tempest-AggregatesAdminNegativeTestJSON-664564698-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1623689352"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:44:14.918884 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.objects.aggregate [None req-ab1f7a1f-625c-4dce-acfb-9d1b363a2b98 tempest-AggregatesAdminNegativeTestJSON-664564698 tempest-AggregatesAdminNegativeTestJSON-664564698-project-admin] Generated uuid 782b10dc-e801-447f-824a-050787088bad for aggregate {{(pid=134101) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 21:44:14.967967 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-ab1f7a1f-625c-4dce-acfb-9d1b363a2b98 tempest-AggregatesAdminNegativeTestJSON-664564698 tempest-AggregatesAdminNegativeTestJSON-664564698-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.063429 Oct 04 21:44:14.969846 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 172/331] 10.222.0.43 () {60 vars in 1164 bytes} [Tue Oct 4 21:44:14 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:44:14.984467 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-a9fd082d-48ae-4920-b36e-8bf5f6020b28 tempest-AggregatesAdminTestJSON-1644938243 tempest-AggregatesAdminTestJSON-1644938243-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1243092088"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:44:14.996514 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.objects.aggregate [None req-a9fd082d-48ae-4920-b36e-8bf5f6020b28 tempest-AggregatesAdminTestJSON-1644938243 tempest-AggregatesAdminTestJSON-1644938243-project-admin] Generated uuid 2eac5061-2e97-45a2-8ee5-77260d531b13 for aggregate {{(pid=134101) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 21:44:15.089515 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-a9fd082d-48ae-4920-b36e-8bf5f6020b28 tempest-AggregatesAdminTestJSON-1644938243 tempest-AggregatesAdminTestJSON-1644938243-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.117118 Oct 04 21:44:15.090670 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 173/332] 10.222.0.43 () {60 vars in 1164 bytes} [Tue Oct 4 21:44:14 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:44:15.098336 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-6186af8e-d17f-4403-87ee-90f0b1d12b85 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:15.099247 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-6186af8e-d17f-4403-87ee-90f0b1d12b85 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] [instance: 80d8aacc-cde5-4451-8697-054eefe15849] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:15.107070 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6186af8e-d17f-4403-87ee-90f0b1d12b85 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:15.107571 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6186af8e-d17f-4403-87ee-90f0b1d12b85 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:15.108009 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6186af8e-d17f-4403-87ee-90f0b1d12b85 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:15.108717 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6186af8e-d17f-4403-87ee-90f0b1d12b85 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:15.109175 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6186af8e-d17f-4403-87ee-90f0b1d12b85 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:15.109601 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6186af8e-d17f-4403-87ee-90f0b1d12b85 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:15.492719 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-9596a473-8280-4c77-8d35-f83eefd4f6ea tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29842a669a20408b881105135f76cb0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39edf587afe94b60911198aa0bb61613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:44:15.502778 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-9596a473-8280-4c77-8d35-f83eefd4f6ea tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] 10.222.0.43 "GET /compute/v2.1/servers/258bc0cb-6718-4f8b-8d0b-ef544b2b659b" status: 200 len: 1213 microversion: 2.1 time: 0.644871 Oct 04 21:44:15.503634 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 160/333] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:44:14 2022] GET /compute/v2.1/servers/258bc0cb-6718-4f8b-8d0b-ef544b2b659b => generated 1213 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:44:15.510178 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-0c7e5797-bcee-4493-a4a7-f5ec63052e43 tempest-AggregatesAdminNegativeTestJSON-664564698 tempest-AggregatesAdminNegativeTestJSON-664564698-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:44:15.531412 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0c7e5797-bcee-4493-a4a7-f5ec63052e43 tempest-AggregatesAdminNegativeTestJSON-664564698 tempest-AggregatesAdminNegativeTestJSON-664564698-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:15.532026 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0c7e5797-bcee-4493-a4a7-f5ec63052e43 tempest-AggregatesAdminNegativeTestJSON-664564698 tempest-AggregatesAdminNegativeTestJSON-664564698-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:15.533153 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0c7e5797-bcee-4493-a4a7-f5ec63052e43 tempest-AggregatesAdminNegativeTestJSON-664564698 tempest-AggregatesAdminNegativeTestJSON-664564698-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:15.547103 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0c7e5797-bcee-4493-a4a7-f5ec63052e43 tempest-AggregatesAdminNegativeTestJSON-664564698 tempest-AggregatesAdminNegativeTestJSON-664564698-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:15.547945 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0c7e5797-bcee-4493-a4a7-f5ec63052e43 tempest-AggregatesAdminNegativeTestJSON-664564698 tempest-AggregatesAdminNegativeTestJSON-664564698-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:15.548620 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0c7e5797-bcee-4493-a4a7-f5ec63052e43 tempest-AggregatesAdminNegativeTestJSON-664564698 tempest-AggregatesAdminNegativeTestJSON-664564698-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:15.558703 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.compute.aggregates [None req-0c7e5797-bcee-4493-a4a7-f5ec63052e43 tempest-AggregatesAdminNegativeTestJSON-664564698 tempest-AggregatesAdminNegativeTestJSON-664564698-project-admin] Failed to remove host nonexist_host from aggregate 15. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Oct 04 21:44:15.559262 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-0c7e5797-bcee-4493-a4a7-f5ec63052e43 tempest-AggregatesAdminNegativeTestJSON-664564698 tempest-AggregatesAdminNegativeTestJSON-664564698-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 15 Oct 04 21:44:15.561474 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-0c7e5797-bcee-4493-a4a7-f5ec63052e43 tempest-AggregatesAdminNegativeTestJSON-664564698 tempest-AggregatesAdminNegativeTestJSON-664564698-project-admin] Request method failure captured: Oct 04 21:44:15.561474 n-d-860284-1 devstack@n-api.service[134102]: request: POST /compute/v2.1/os-aggregates/15/action HTTP/1.1 Oct 04 21:44:15.561474 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 21:44:15.561474 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 21:44:15.561474 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 21:44:15.561474 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 42 Oct 04 21:44:15.561474 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 21:44:15.561474 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 21:44:15.561474 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 21:44:15.561474 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 21:44:15.561474 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPKj3TqDaGoyjJhtIccfWEJxEBj6A1jebRdZTgg-sR19wHLlaDAI2bdTq6Jkp5iiCM0u9cwW4jzhwdoXvQS-WsEl_ywcz5KPWJU7yW05bsnHLpXgHw78VijaFN0Vdk0iAUt3MBmWSUCRj3gV4jO-cbkqRKTWzujvkVBPGumXvhfg-3s0 Oct 04 21:44:15.561474 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 21:44:15.561474 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 21:44:15.561474 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 21:44:15.561474 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 21:44:15.561474 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 21:44:15.561474 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 21:44:15.561474 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: d44d9375451f48269c82a6e559b24c3e Oct 04 21:44:15.561474 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-664564698 Oct 04 21:44:15.561474 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,admin,member Oct 04 21:44:15.561474 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,admin,member Oct 04 21:44:15.562702 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d44d9375451f48269c82a6e559b24c3e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_d44d9375451f48269c82a6e559b24c3e", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d44d9375451f48269c82a6e559b24c3e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/d44d9375451f48269c82a6e559b24c3e"}]}] Oct 04 21:44:15.562702 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-664564698 Oct 04 21:44:15.562702 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: d44d9375451f48269c82a6e559b24c3e Oct 04 21:44:15.562702 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-664564698 Oct 04 21:44:15.562702 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-AggregatesAdminNegativeTestJSON-664564698-project-admin Oct 04 21:44:15.562702 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 21:44:15.562702 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 21:44:15.562702 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: 9982336626444aa7b0582b5802e18c20 Oct 04 21:44:15.562702 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-664564698-project-admin Oct 04 21:44:15.562702 n-d-860284-1 devstack@n-api.service[134102]: Oct 04 21:44:15.562702 n-d-860284-1 devstack@n-api.service[134102]: {"remove_host": {"host": "nonexist_host"}} Oct 04 21:44:15.562702 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 21:44:15.562702 n-d-860284-1 devstack@n-api.service[134102]: exception: Cannot remove host nonexist_host in aggregate 15 Oct 04 21:44:15.563401 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': '15', 'body': {'remove_host': {'host': 'nonexist_host'}}} Oct 04 21:44:15.563401 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:44:15.563401 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:44:15.563401 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5999, in _get_service_in_cell_by_host Oct 04 21:44:15.563401 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 04 21:44:15.563401 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 21:44:15.563401 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 21:44:15.563401 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 04 21:44:15.563401 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 04 21:44:15.563401 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 21:44:15.563401 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 21:44:15.563401 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 04 21:44:15.563401 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 04 21:44:15.563401 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell Oct 04 21:44:15.563401 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:44:15.563401 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:44:15.563401 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:44:15.563401 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:44:15.563401 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Oct 04 21:44:15.563401 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Oct 04 21:44:15.564559 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 04 21:44:15.564559 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 04 21:44:15.564559 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 04 21:44:15.564559 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:44:15.564559 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:44:15.564559 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:44:15.564559 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:44:15.564559 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host Oct 04 21:44:15.564559 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) Oct 04 21:44:15.564559 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 21:44:15.564559 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 21:44:15.564559 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 21:44:15.564559 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 21:44:15.564559 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 21:44:15.564559 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 21:44:15.564559 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 21:44:15.564559 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 21:44:15.564559 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6683, in remove_host_from_aggregate Oct 04 21:44:15.564559 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) Oct 04 21:44:15.564559 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6007, in _get_service_in_cell_by_host Oct 04 21:44:15.565626 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Oct 04 21:44:15.565626 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Oct 04 21:44:15.565626 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:44:15.565626 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:44:15.565626 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:44:15.565626 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:44:15.565626 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:44:15.565626 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:44:15.565626 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:44:15.565626 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:44:15.565626 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:44:15.565626 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:44:15.565626 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:44:15.565626 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:44:15.565626 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host Oct 04 21:44:15.565626 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 04 21:44:15.565626 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 15 Oct 04 21:44:15.565626 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:44:15.565626 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:44:15.565626 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:44:15.565626 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:44:15.566747 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:44:15.566747 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:44:15.566747 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:44:15.566747 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:44:15.566747 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 15 Oct 04 21:44:15.566747 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:44:15.566747 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-0c7e5797-bcee-4493-a4a7-f5ec63052e43 tempest-AggregatesAdminNegativeTestJSON-664564698 tempest-AggregatesAdminNegativeTestJSON-664564698-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 15 {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:44:15.566747 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-0c7e5797-bcee-4493-a4a7-f5ec63052e43 tempest-AggregatesAdminNegativeTestJSON-664564698 tempest-AggregatesAdminNegativeTestJSON-664564698-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates/15/action" status: 404 len: 94 microversion: 2.1 time: 0.059086 Oct 04 21:44:15.568053 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 161/334] 10.222.0.43 () {60 vars in 1194 bytes} [Tue Oct 4 21:44:15 2022] POST /compute/v2.1/os-aggregates/15/action => generated 94 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 21:44:15.576446 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-4c8cd866-d023-4019-9c8a-a11bc96a6fc9 tempest-AggregatesAdminTestJSON-1644938243 tempest-AggregatesAdminTestJSON-1644938243-project-admin] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:15.589272 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-4c8cd866-d023-4019-9c8a-a11bc96a6fc9 tempest-AggregatesAdminTestJSON-1644938243 tempest-AggregatesAdminTestJSON-1644938243-project-admin] 10.222.0.43 "GET /compute/v2.1/os-aggregates/16" status: 200 len: 228 microversion: 2.1 time: 0.018910 Oct 04 21:44:15.590227 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 162/335] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Oct 4 21:44:15 2022] GET /compute/v2.1/os-aggregates/16 => generated 228 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:44:15.596101 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-0836d4ba-2b9a-4c79-921c-f3081729f0d2 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:15.597418 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-0836d4ba-2b9a-4c79-921c-f3081729f0d2 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] [instance: c7b7e541-aa71-44f6-96fb-07c2e6e08520] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:15.655297 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0836d4ba-2b9a-4c79-921c-f3081729f0d2 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:15.656997 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0836d4ba-2b9a-4c79-921c-f3081729f0d2 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:15.658104 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0836d4ba-2b9a-4c79-921c-f3081729f0d2 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:15.659272 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0836d4ba-2b9a-4c79-921c-f3081729f0d2 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:15.660024 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0836d4ba-2b9a-4c79-921c-f3081729f0d2 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:15.660690 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0836d4ba-2b9a-4c79-921c-f3081729f0d2 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:15.788391 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-6186af8e-d17f-4403-87ee-90f0b1d12b85 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5387dbf4e24960809704c398fe999a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bedc0e10ab24824a40d06bb91626088', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:44:15.799181 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-6186af8e-d17f-4403-87ee-90f0b1d12b85 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] 10.222.0.43 "GET /compute/v2.1/servers/80d8aacc-cde5-4451-8697-054eefe15849" status: 200 len: 1320 microversion: 2.1 time: 0.707284 Oct 04 21:44:15.800108 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 174/336] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:44:15 2022] GET /compute/v2.1/servers/80d8aacc-cde5-4451-8697-054eefe15849 => generated 1320 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:44:15.806135 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-cf9b365c-d2f7-44e1-844d-0bfde608d0ed tempest-AggregatesAdminNegativeTestJSON-664564698 tempest-AggregatesAdminNegativeTestJSON-664564698-project-admin] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:15.873152 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-cf9b365c-d2f7-44e1-844d-0bfde608d0ed tempest-AggregatesAdminNegativeTestJSON-664564698 tempest-AggregatesAdminNegativeTestJSON-664564698-project-admin] 10.222.0.43 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.070030 Oct 04 21:44:15.879616 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 175/337] 10.222.0.43 () {58 vars in 1155 bytes} [Tue Oct 4 21:44:15 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 21:44:15.894005 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-0333dd65-03b5-4074-969a-d7f35d5fe56f tempest-AggregatesAdminTestJSON-1644938243 tempest-AggregatesAdminTestJSON-1644938243-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:44:15.969937 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-0333dd65-03b5-4074-969a-d7f35d5fe56f tempest-AggregatesAdminTestJSON-1644938243 tempest-AggregatesAdminTestJSON-1644938243-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates/16/action" status: 200 len: 266 microversion: 2.1 time: 0.088970 Oct 04 21:44:15.971117 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 176/338] 10.222.0.43 () {60 vars in 1194 bytes} [Tue Oct 4 21:44:15 2022] POST /compute/v2.1/os-aggregates/16/action => generated 266 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:44:15.985682 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-812f9614-4fc7-4ed5-8d6f-6fa4683d887a tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:15.986393 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-812f9614-4fc7-4ed5-8d6f-6fa4683d887a tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: ec437ce7-b43a-4c8b-8a06-756cfb877851] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:15.999067 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-0836d4ba-2b9a-4c79-921c-f3081729f0d2 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1789bb97219a4e1591632126812ea6df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da67fc95e2814f4086df020f4c475764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:44:16.003525 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-812f9614-4fc7-4ed5-8d6f-6fa4683d887a tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:16.006518 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-812f9614-4fc7-4ed5-8d6f-6fa4683d887a tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:16.007239 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-812f9614-4fc7-4ed5-8d6f-6fa4683d887a tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:16.007379 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-812f9614-4fc7-4ed5-8d6f-6fa4683d887a tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:16.015931 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-812f9614-4fc7-4ed5-8d6f-6fa4683d887a tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:16.016327 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-0836d4ba-2b9a-4c79-921c-f3081729f0d2 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] 10.222.0.43 "GET /compute/v2.1/servers/c7b7e541-aa71-44f6-96fb-07c2e6e08520" status: 200 len: 1322 microversion: 2.1 time: 0.422192 Oct 04 21:44:16.016501 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-812f9614-4fc7-4ed5-8d6f-6fa4683d887a tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:16.016989 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 163/339] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:44:15 2022] GET /compute/v2.1/servers/c7b7e541-aa71-44f6-96fb-07c2e6e08520 => generated 1322 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:44:16.027974 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-e8dae54d-4edd-4970-8f66-8967362b0e9f tempest-AggregatesAdminTestJSON-1644938243 tempest-AggregatesAdminTestJSON-1644938243-project-admin] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:16.050973 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-e8dae54d-4edd-4970-8f66-8967362b0e9f tempest-AggregatesAdminTestJSON-1644938243 tempest-AggregatesAdminTestJSON-1644938243-project-admin] 10.222.0.43 "GET /compute/v2.1/os-aggregates/16" status: 200 len: 242 microversion: 2.1 time: 0.031858 Oct 04 21:44:16.060627 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 164/340] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Oct 4 21:44:16 2022] GET /compute/v2.1/os-aggregates/16 => generated 242 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:44:16.092064 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-aeffbe17-0179-46e6-9758-487d59074724 tempest-AggregatesAdminTestJSON-1644938243 tempest-AggregatesAdminTestJSON-1644938243-project-admin] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:16.163351 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-aeffbe17-0179-46e6-9758-487d59074724 tempest-AggregatesAdminTestJSON-1644938243 tempest-AggregatesAdminTestJSON-1644938243-project-admin] 10.222.0.43 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.099676 Oct 04 21:44:16.173244 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 165/341] 10.222.0.43 () {58 vars in 1155 bytes} [Tue Oct 4 21:44:16 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 21:44:16.187904 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-98cfbff3-9256-499a-b834-898bd8440765 tempest-AggregatesAdminTestJSON-1644938243 tempest-AggregatesAdminTestJSON-1644938243-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1222150304", "availability_zone": "tempest-test_az-1327855775"}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:44:16.198482 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.objects.aggregate [None req-98cfbff3-9256-499a-b834-898bd8440765 tempest-AggregatesAdminTestJSON-1644938243 tempest-AggregatesAdminTestJSON-1644938243-project-admin] Generated uuid 81a9f81c-219b-416c-ab28-e6984dbb062c for aggregate {{(pid=134102) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 21:44:16.267739 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-98cfbff3-9256-499a-b834-898bd8440765 tempest-AggregatesAdminTestJSON-1644938243 tempest-AggregatesAdminTestJSON-1644938243-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates" status: 200 len: 223 microversion: 2.1 time: 0.093047 Oct 04 21:44:16.269292 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 166/342] 10.222.0.43 () {60 vars in 1165 bytes} [Tue Oct 4 21:44:16 2022] POST /compute/v2.1/os-aggregates => generated 223 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:44:16.284762 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-3c06580f-4d78-4998-8b48-6d7af221b00f tempest-AggregatesAdminTestJSON-1644938243 tempest-AggregatesAdminTestJSON-1644938243-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1222150304_new", "availability_zone": "tempest-test_az-1327855775_new"}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:44:16.341876 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3c06580f-4d78-4998-8b48-6d7af221b00f tempest-AggregatesAdminTestJSON-1644938243 tempest-AggregatesAdminTestJSON-1644938243-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:16.342719 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3c06580f-4d78-4998-8b48-6d7af221b00f tempest-AggregatesAdminTestJSON-1644938243 tempest-AggregatesAdminTestJSON-1644938243-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:16.343400 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3c06580f-4d78-4998-8b48-6d7af221b00f tempest-AggregatesAdminTestJSON-1644938243 tempest-AggregatesAdminTestJSON-1644938243-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:16.403955 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-3c06580f-4d78-4998-8b48-6d7af221b00f tempest-AggregatesAdminTestJSON-1644938243 tempest-AggregatesAdminTestJSON-1644938243-project-admin] 10.222.0.43 "PUT /compute/v2.1/os-aggregates/17" status: 200 len: 337 microversion: 2.1 time: 0.124651 Oct 04 21:44:16.405914 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 167/343] 10.222.0.43 () {60 vars in 1173 bytes} [Tue Oct 4 21:44:16 2022] PUT /compute/v2.1/os-aggregates/17 => generated 337 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:44:16.421550 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-ccb542ce-e192-4c35-aec5-5fbb5ab70355 tempest-AggregatesAdminTestJSON-1644938243 tempest-AggregatesAdminTestJSON-1644938243-project-admin] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:16.447164 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-ccb542ce-e192-4c35-aec5-5fbb5ab70355 tempest-AggregatesAdminTestJSON-1644938243 tempest-AggregatesAdminTestJSON-1644938243-project-admin] 10.222.0.43 "GET /compute/v2.1/os-aggregates" status: 200 len: 340 microversion: 2.1 time: 0.034094 Oct 04 21:44:16.448056 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 168/344] 10.222.0.43 () {58 vars in 1143 bytes} [Tue Oct 4 21:44:16 2022] GET /compute/v2.1/os-aggregates => generated 340 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:44:16.460055 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-eebf596d-8ab3-4ab2-a022-be3738117ffe tempest-AggregatesAdminTestJSON-1644938243 tempest-AggregatesAdminTestJSON-1644938243-project-admin] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:16.499463 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-eebf596d-8ab3-4ab2-a022-be3738117ffe tempest-AggregatesAdminTestJSON-1644938243 tempest-AggregatesAdminTestJSON-1644938243-project-admin] 10.222.0.43 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.043535 Oct 04 21:44:16.520196 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 169/345] 10.222.0.43 () {58 vars in 1155 bytes} [Tue Oct 4 21:44:16 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Oct 04 21:44:16.541948 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-99464414-febd-4dac-9da1-01a419269f0c tempest-AggregatesAdminTestJSON-1644938243 tempest-AggregatesAdminTestJSON-1644938243-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1764092620"}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:44:16.551181 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.objects.aggregate [None req-99464414-febd-4dac-9da1-01a419269f0c tempest-AggregatesAdminTestJSON-1644938243 tempest-AggregatesAdminTestJSON-1644938243-project-admin] Generated uuid 26c78d87-8222-421c-bd58-c73c2fe9adc7 for aggregate {{(pid=134102) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 21:44:16.623369 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-99464414-febd-4dac-9da1-01a419269f0c tempest-AggregatesAdminTestJSON-1644938243 tempest-AggregatesAdminTestJSON-1644938243-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.099925 Oct 04 21:44:16.624509 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 170/346] 10.222.0.43 () {60 vars in 1164 bytes} [Tue Oct 4 21:44:16 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:44:16.641550 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-89667bba-49d8-468f-9525-a5a7f7b0312b tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:16.642843 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-89667bba-49d8-468f-9525-a5a7f7b0312b tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] [instance: 258bc0cb-6718-4f8b-8d0b-ef544b2b659b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:16.662743 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-89667bba-49d8-468f-9525-a5a7f7b0312b tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:16.669799 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-89667bba-49d8-468f-9525-a5a7f7b0312b tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:16.670690 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-89667bba-49d8-468f-9525-a5a7f7b0312b tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:16.672577 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-89667bba-49d8-468f-9525-a5a7f7b0312b tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:16.674984 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-89667bba-49d8-468f-9525-a5a7f7b0312b tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:16.675679 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-89667bba-49d8-468f-9525-a5a7f7b0312b tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:17.048449 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-89667bba-49d8-468f-9525-a5a7f7b0312b tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29842a669a20408b881105135f76cb0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39edf587afe94b60911198aa0bb61613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:44:17.060787 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-89667bba-49d8-468f-9525-a5a7f7b0312b tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] 10.222.0.43 "GET /compute/v2.1/servers/258bc0cb-6718-4f8b-8d0b-ef544b2b659b" status: 200 len: 1275 microversion: 2.1 time: 0.430416 Oct 04 21:44:17.062748 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 171/347] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:44:16 2022] GET /compute/v2.1/servers/258bc0cb-6718-4f8b-8d0b-ef544b2b659b => generated 1275 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:44:17.068894 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-a17b77da-a16e-4853-ae57-094e64e07794 tempest-AggregatesAdminTestJSON-1644938243 tempest-AggregatesAdminTestJSON-1644938243-project-admin] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:17.085122 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-a17b77da-a16e-4853-ae57-094e64e07794 tempest-AggregatesAdminTestJSON-1644938243 tempest-AggregatesAdminTestJSON-1644938243-project-admin] 10.222.0.43 "GET /compute/v2.1/os-aggregates" status: 200 len: 231 microversion: 2.1 time: 0.021260 Oct 04 21:44:17.092836 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 172/348] 10.222.0.43 () {58 vars in 1143 bytes} [Tue Oct 4 21:44:17 2022] GET /compute/v2.1/os-aggregates => generated 231 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:44:17.097781 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-8105e7fd-f597-428e-a584-e047e9482778 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:17.098441 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-8105e7fd-f597-428e-a584-e047e9482778 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] [instance: 80d8aacc-cde5-4451-8697-054eefe15849] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:17.103444 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=6,nova_api:DELETE=10,nova_api:UPDATE=2 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:44:17.107431 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8105e7fd-f597-428e-a584-e047e9482778 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:17.108118 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8105e7fd-f597-428e-a584-e047e9482778 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:17.108560 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8105e7fd-f597-428e-a584-e047e9482778 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:17.109651 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8105e7fd-f597-428e-a584-e047e9482778 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:17.109889 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8105e7fd-f597-428e-a584-e047e9482778 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:17.110325 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8105e7fd-f597-428e-a584-e047e9482778 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:17.135036 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-812f9614-4fc7-4ed5-8d6f-6fa4683d887a tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:44:17.153289 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-812f9614-4fc7-4ed5-8d6f-6fa4683d887a tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/ec437ce7-b43a-4c8b-8a06-756cfb877851" status: 200 len: 1472 microversion: 2.1 time: 1.178322 Oct 04 21:44:17.174503 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 177/349] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:44:15 2022] GET /compute/v2.1/servers/ec437ce7-b43a-4c8b-8a06-756cfb877851 => generated 1472 bytes in 1203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:44:17.187422 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-b799a3f3-cae8-4c39-866c-c9c76d8dffe9 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:17.188702 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-b799a3f3-cae8-4c39-866c-c9c76d8dffe9 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] [instance: c7b7e541-aa71-44f6-96fb-07c2e6e08520] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:17.201992 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b799a3f3-cae8-4c39-866c-c9c76d8dffe9 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:17.203093 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b799a3f3-cae8-4c39-866c-c9c76d8dffe9 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:17.204270 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b799a3f3-cae8-4c39-866c-c9c76d8dffe9 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:17.206050 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b799a3f3-cae8-4c39-866c-c9c76d8dffe9 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:17.207182 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b799a3f3-cae8-4c39-866c-c9c76d8dffe9 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:17.208500 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b799a3f3-cae8-4c39-866c-c9c76d8dffe9 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:17.643687 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-b799a3f3-cae8-4c39-866c-c9c76d8dffe9 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1789bb97219a4e1591632126812ea6df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da67fc95e2814f4086df020f4c475764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:44:17.646099 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:44:17.655608 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-b799a3f3-cae8-4c39-866c-c9c76d8dffe9 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] 10.222.0.43 "GET /compute/v2.1/servers/c7b7e541-aa71-44f6-96fb-07c2e6e08520" status: 200 len: 1389 microversion: 2.1 time: 0.479462 Oct 04 21:44:17.666813 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-8105e7fd-f597-428e-a584-e047e9482778 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5387dbf4e24960809704c398fe999a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bedc0e10ab24824a40d06bb91626088', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:44:17.667564 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 178/350] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:44:17 2022] GET /compute/v2.1/servers/c7b7e541-aa71-44f6-96fb-07c2e6e08520 => generated 1389 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:44:17.670549 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-8105e7fd-f597-428e-a584-e047e9482778 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] 10.222.0.43 "GET /compute/v2.1/servers/80d8aacc-cde5-4451-8697-054eefe15849" status: 200 len: 1320 microversion: 2.1 time: 0.578580 Oct 04 21:44:17.673608 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 173/351] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:44:17 2022] GET /compute/v2.1/servers/80d8aacc-cde5-4451-8697-054eefe15849 => generated 1320 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:44:17.680482 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-6e11958f-fdd9-43d8-ac18-b102515cf4d3 tempest-AggregatesAdminTestJSON-1644938243 tempest-AggregatesAdminTestJSON-1644938243-project-admin] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:17.724978 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-6e11958f-fdd9-43d8-ac18-b102515cf4d3 tempest-AggregatesAdminTestJSON-1644938243 tempest-AggregatesAdminTestJSON-1644938243-project-admin] 10.222.0.43 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.1 time: 0.056039 Oct 04 21:44:17.725752 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 179/352] 10.222.0.43 () {58 vars in 1155 bytes} [Tue Oct 4 21:44:17 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 21:44:17.736167 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-b316c2b0-20f9-448b-bd9e-767d70792186 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:17.736824 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-b316c2b0-20f9-448b-bd9e-767d70792186 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] [instance: 4ca5960d-4a64-4a04-a849-d53180a038e9] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:17.748839 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b316c2b0-20f9-448b-bd9e-767d70792186 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:17.749872 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b316c2b0-20f9-448b-bd9e-767d70792186 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:17.753416 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b316c2b0-20f9-448b-bd9e-767d70792186 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:17.756345 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b316c2b0-20f9-448b-bd9e-767d70792186 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:17.758923 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b316c2b0-20f9-448b-bd9e-767d70792186 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:17.765226 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b316c2b0-20f9-448b-bd9e-767d70792186 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:17.805138 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-b316c2b0-20f9-448b-bd9e-767d70792186 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] HTTP exception thrown: Instance 4ca5960d-4a64-4a04-a849-d53180a038e9 could not be found. Oct 04 21:44:17.808078 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-b316c2b0-20f9-448b-bd9e-767d70792186 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Request method failure captured: Oct 04 21:44:17.808078 n-d-860284-1 devstack@n-api.service[134102]: request: DELETE /compute/v2.1/servers/4ca5960d-4a64-4a04-a849-d53180a038e9 HTTP/1.1 Oct 04 21:44:17.808078 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 21:44:17.808078 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 21:44:17.808078 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 21:44:17.808078 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 21:44:17.808078 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 21:44:17.808078 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 21:44:17.808078 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 21:44:17.808078 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 21:44:17.808078 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPKj0-7W58RQE5aOzdtzD4tgebh0E10jsmQP6igAsGUuznOXC4x4rgvf3ZzbP44LgM-jgYx_t5g_vaUie_N_5lgaQSwDKmKV0C1HWQ8m4fnJ3KaOb07MeYTFd96i104CiZ7MgAfxhCCaxsHZ98rDDCDLevDZcw-4nXTI6CBETD0yk594 Oct 04 21:44:17.808078 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 21:44:17.808078 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 21:44:17.808078 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 21:44:17.808078 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 21:44:17.808078 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 21:44:17.808078 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 21:44:17.808078 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: f306c099ef294f6da8637a8ddcdb46d1 Oct 04 21:44:17.808078 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-AggregatesAdminTestJSON-1392374906 Oct 04 21:44:17.808078 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 21:44:17.808078 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 21:44:17.809798 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f306c099ef294f6da8637a8ddcdb46d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_f306c099ef294f6da8637a8ddcdb46d1", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f306c099ef294f6da8637a8ddcdb46d1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/f306c099ef294f6da8637a8ddcdb46d1"}]}] Oct 04 21:44:17.809798 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-AggregatesAdminTestJSON-1392374906 Oct 04 21:44:17.809798 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: f306c099ef294f6da8637a8ddcdb46d1 Oct 04 21:44:17.809798 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1392374906 Oct 04 21:44:17.809798 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-AggregatesAdminTestJSON-1392374906-project Oct 04 21:44:17.809798 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 21:44:17.809798 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 21:44:17.809798 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: e00999a6faf349eea3be7680a855e8d8 Oct 04 21:44:17.809798 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-AggregatesAdminTestJSON-1392374906-project Oct 04 21:44:17.809798 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 21:44:17.809798 n-d-860284-1 devstack@n-api.service[134102]: exception: Instance 4ca5960d-4a64-4a04-a849-d53180a038e9 could not be found. Oct 04 21:44:17.809798 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': '4ca5960d-4a64-4a04-a849-d53180a038e9'} Oct 04 21:44:17.810656 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:44:17.810656 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:44:17.810656 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:44:17.810656 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:44:17.810656 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:44:17.810656 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:44:17.810656 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:44:17.810656 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:44:17.810656 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:44:17.810656 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:44:17.810656 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ca5960d-4a64-4a04-a849-d53180a038e9 could not be found. Oct 04 21:44:17.810656 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:44:17.810656 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:44:17.810656 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:44:17.810656 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:44:17.810656 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:44:17.810656 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:44:17.810656 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:44:17.810656 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:44:17.810656 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:44:17.811699 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:44:17.811699 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 21:44:17.811699 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 21:44:17.811699 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 21:44:17.811699 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 21:44:17.811699 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:44:17.811699 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:44:17.811699 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:44:17.811699 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:44:17.811699 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ca5960d-4a64-4a04-a849-d53180a038e9 could not be found. Oct 04 21:44:17.811699 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:44:17.811699 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:44:17.811699 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:44:17.811699 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:44:17.811699 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:44:17.811699 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:44:17.811699 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:44:17.811699 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:44:17.811699 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ca5960d-4a64-4a04-a849-d53180a038e9 could not be found. Oct 04 21:44:17.811699 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:44:17.812744 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-b316c2b0-20f9-448b-bd9e-767d70792186 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Returning 404 to user: Instance 4ca5960d-4a64-4a04-a849-d53180a038e9 could not be found. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:44:17.812744 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-b316c2b0-20f9-448b-bd9e-767d70792186 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] 10.222.0.43 "DELETE /compute/v2.1/servers/4ca5960d-4a64-4a04-a849-d53180a038e9" status: 404 len: 111 microversion: 2.1 time: 0.077869 Oct 04 21:44:17.812744 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 174/353] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 21:44:17 2022] DELETE /compute/v2.1/servers/4ca5960d-4a64-4a04-a849-d53180a038e9 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:44:17.818512 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-7a11f60a-a1a1-4155-aba3-056e6666bc24 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:17.819142 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-7a11f60a-a1a1-4155-aba3-056e6666bc24 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] [instance: 4ca5960d-4a64-4a04-a849-d53180a038e9] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:17.826762 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7a11f60a-a1a1-4155-aba3-056e6666bc24 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:17.827526 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7a11f60a-a1a1-4155-aba3-056e6666bc24 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:17.827999 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7a11f60a-a1a1-4155-aba3-056e6666bc24 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:17.829198 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7a11f60a-a1a1-4155-aba3-056e6666bc24 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:17.829998 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7a11f60a-a1a1-4155-aba3-056e6666bc24 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:17.830725 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7a11f60a-a1a1-4155-aba3-056e6666bc24 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:17.847500 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-7a11f60a-a1a1-4155-aba3-056e6666bc24 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] HTTP exception thrown: Instance 4ca5960d-4a64-4a04-a849-d53180a038e9 could not be found. Oct 04 21:44:17.849940 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-7a11f60a-a1a1-4155-aba3-056e6666bc24 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Request method failure captured: Oct 04 21:44:17.849940 n-d-860284-1 devstack@n-api.service[134101]: request: GET /compute/v2.1/servers/4ca5960d-4a64-4a04-a849-d53180a038e9 HTTP/1.1 Oct 04 21:44:17.849940 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 21:44:17.849940 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 21:44:17.849940 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 21:44:17.849940 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 21:44:17.849940 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 21:44:17.849940 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 21:44:17.849940 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 21:44:17.849940 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 21:44:17.849940 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPKj0-7W58RQE5aOzdtzD4tgebh0E10jsmQP6igAsGUuznOXC4x4rgvf3ZzbP44LgM-jgYx_t5g_vaUie_N_5lgaQSwDKmKV0C1HWQ8m4fnJ3KaOb07MeYTFd96i104CiZ7MgAfxhCCaxsHZ98rDDCDLevDZcw-4nXTI6CBETD0yk594 Oct 04 21:44:17.849940 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 21:44:17.849940 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 21:44:17.849940 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 21:44:17.849940 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 21:44:17.849940 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 21:44:17.849940 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 21:44:17.849940 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: f306c099ef294f6da8637a8ddcdb46d1 Oct 04 21:44:17.849940 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-AggregatesAdminTestJSON-1392374906 Oct 04 21:44:17.849940 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 21:44:17.849940 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 21:44:17.851898 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f306c099ef294f6da8637a8ddcdb46d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_f306c099ef294f6da8637a8ddcdb46d1", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f306c099ef294f6da8637a8ddcdb46d1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/f306c099ef294f6da8637a8ddcdb46d1"}]}] Oct 04 21:44:17.851898 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-AggregatesAdminTestJSON-1392374906 Oct 04 21:44:17.851898 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: f306c099ef294f6da8637a8ddcdb46d1 Oct 04 21:44:17.851898 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1392374906 Oct 04 21:44:17.851898 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-AggregatesAdminTestJSON-1392374906-project Oct 04 21:44:17.851898 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 21:44:17.851898 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 21:44:17.851898 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: e00999a6faf349eea3be7680a855e8d8 Oct 04 21:44:17.851898 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-AggregatesAdminTestJSON-1392374906-project Oct 04 21:44:17.851898 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 21:44:17.851898 n-d-860284-1 devstack@n-api.service[134101]: exception: Instance 4ca5960d-4a64-4a04-a849-d53180a038e9 could not be found. Oct 04 21:44:17.851898 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': '4ca5960d-4a64-4a04-a849-d53180a038e9'} Oct 04 21:44:17.852577 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:44:17.852577 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:44:17.852577 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:44:17.852577 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:44:17.852577 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:44:17.852577 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:44:17.852577 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:44:17.852577 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:44:17.852577 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:44:17.852577 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:44:17.852577 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ca5960d-4a64-4a04-a849-d53180a038e9 could not be found. Oct 04 21:44:17.852577 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:44:17.852577 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:44:17.852577 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:44:17.852577 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:44:17.852577 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:44:17.852577 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:44:17.852577 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:44:17.852577 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:44:17.852577 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:44:17.853619 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:44:17.853619 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:44:17.853619 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:44:17.853619 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:44:17.853619 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:44:17.853619 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:44:17.853619 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:44:17.853619 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ca5960d-4a64-4a04-a849-d53180a038e9 could not be found. Oct 04 21:44:17.853619 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:44:17.853619 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:44:17.853619 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:44:17.853619 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:44:17.853619 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:44:17.853619 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:44:17.853619 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:44:17.853619 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:44:17.853619 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ca5960d-4a64-4a04-a849-d53180a038e9 could not be found. Oct 04 21:44:17.853619 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:44:17.856306 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-7a11f60a-a1a1-4155-aba3-056e6666bc24 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] Returning 404 to user: Instance 4ca5960d-4a64-4a04-a849-d53180a038e9 could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:44:17.857442 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-7a11f60a-a1a1-4155-aba3-056e6666bc24 tempest-AggregatesAdminTestJSON-1392374906 tempest-AggregatesAdminTestJSON-1392374906-project] 10.222.0.43 "GET /compute/v2.1/servers/4ca5960d-4a64-4a04-a849-d53180a038e9" status: 404 len: 111 microversion: 2.1 time: 0.042944 Oct 04 21:44:17.862266 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 180/354] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:44:17 2022] GET /compute/v2.1/servers/4ca5960d-4a64-4a04-a849-d53180a038e9 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:44:18.091537 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-8dc0dd79-c7ae-498b-80cc-47c00948825d tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:18.092978 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-8dc0dd79-c7ae-498b-80cc-47c00948825d tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] [instance: 258bc0cb-6718-4f8b-8d0b-ef544b2b659b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:18.110948 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8dc0dd79-c7ae-498b-80cc-47c00948825d tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:18.113592 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8dc0dd79-c7ae-498b-80cc-47c00948825d tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:18.115844 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8dc0dd79-c7ae-498b-80cc-47c00948825d tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:18.117191 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8dc0dd79-c7ae-498b-80cc-47c00948825d tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:18.120415 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8dc0dd79-c7ae-498b-80cc-47c00948825d tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:18.124634 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8dc0dd79-c7ae-498b-80cc-47c00948825d tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:18.168933 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=100 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:44:18.181852 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-c9c9f4c6-335e-44ca-a26b-1dc720c990e8 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:18.183479 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-c9c9f4c6-335e-44ca-a26b-1dc720c990e8 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: ec437ce7-b43a-4c8b-8a06-756cfb877851] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:18.196377 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c9c9f4c6-335e-44ca-a26b-1dc720c990e8 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:18.199624 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c9c9f4c6-335e-44ca-a26b-1dc720c990e8 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:18.202622 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c9c9f4c6-335e-44ca-a26b-1dc720c990e8 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:18.203676 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c9c9f4c6-335e-44ca-a26b-1dc720c990e8 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:18.207252 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c9c9f4c6-335e-44ca-a26b-1dc720c990e8 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:18.208904 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c9c9f4c6-335e-44ca-a26b-1dc720c990e8 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:18.329547 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-8dc0dd79-c7ae-498b-80cc-47c00948825d tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29842a669a20408b881105135f76cb0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39edf587afe94b60911198aa0bb61613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:44:18.356873 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-8dc0dd79-c7ae-498b-80cc-47c00948825d tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] 10.222.0.43 "GET /compute/v2.1/servers/258bc0cb-6718-4f8b-8d0b-ef544b2b659b" status: 200 len: 1275 microversion: 2.1 time: 0.270415 Oct 04 21:44:18.358784 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 175/355] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:44:18 2022] GET /compute/v2.1/servers/258bc0cb-6718-4f8b-8d0b-ef544b2b659b => generated 1275 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:44:18.550764 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-c9c9f4c6-335e-44ca-a26b-1dc720c990e8 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:44:18.565581 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-c9c9f4c6-335e-44ca-a26b-1dc720c990e8 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/ec437ce7-b43a-4c8b-8a06-756cfb877851" status: 200 len: 1472 microversion: 2.1 time: 0.388246 Oct 04 21:44:18.568074 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 181/356] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:44:18 2022] GET /compute/v2.1/servers/ec437ce7-b43a-4c8b-8a06-756cfb877851 => generated 1472 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:44:18.682255 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-dd195797-2c5e-47c0-9f9c-5da3e861171c tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:18.683165 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-dd195797-2c5e-47c0-9f9c-5da3e861171c tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] [instance: c7b7e541-aa71-44f6-96fb-07c2e6e08520] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:18.700486 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dd195797-2c5e-47c0-9f9c-5da3e861171c tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:18.701652 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dd195797-2c5e-47c0-9f9c-5da3e861171c tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:18.702158 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-5ece6e9d-2311-4f2c-9b3e-84893280d35c tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:18.702709 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dd195797-2c5e-47c0-9f9c-5da3e861171c tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:18.703100 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-5ece6e9d-2311-4f2c-9b3e-84893280d35c tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] [instance: 80d8aacc-cde5-4451-8697-054eefe15849] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:18.703830 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dd195797-2c5e-47c0-9f9c-5da3e861171c tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:18.704950 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dd195797-2c5e-47c0-9f9c-5da3e861171c tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:18.705721 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dd195797-2c5e-47c0-9f9c-5da3e861171c tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:18.715976 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5ece6e9d-2311-4f2c-9b3e-84893280d35c tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:18.716553 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5ece6e9d-2311-4f2c-9b3e-84893280d35c tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:18.717062 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5ece6e9d-2311-4f2c-9b3e-84893280d35c tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:18.717982 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5ece6e9d-2311-4f2c-9b3e-84893280d35c tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:18.718661 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5ece6e9d-2311-4f2c-9b3e-84893280d35c tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:18.721678 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5ece6e9d-2311-4f2c-9b3e-84893280d35c tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:19.183528 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-dd195797-2c5e-47c0-9f9c-5da3e861171c tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1789bb97219a4e1591632126812ea6df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da67fc95e2814f4086df020f4c475764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:44:19.185195 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-5ece6e9d-2311-4f2c-9b3e-84893280d35c tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5387dbf4e24960809704c398fe999a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bedc0e10ab24824a40d06bb91626088', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:44:19.193361 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-5ece6e9d-2311-4f2c-9b3e-84893280d35c tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] 10.222.0.43 "GET /compute/v2.1/servers/80d8aacc-cde5-4451-8697-054eefe15849" status: 200 len: 1320 microversion: 2.1 time: 0.495870 Oct 04 21:44:19.203306 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 182/357] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:44:18 2022] GET /compute/v2.1/servers/80d8aacc-cde5-4451-8697-054eefe15849 => generated 1320 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:44:19.228472 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-dd195797-2c5e-47c0-9f9c-5da3e861171c tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] 10.222.0.43 "GET /compute/v2.1/servers/c7b7e541-aa71-44f6-96fb-07c2e6e08520" status: 200 len: 1389 microversion: 2.1 time: 0.550475 Oct 04 21:44:19.246271 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 176/358] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:44:18 2022] GET /compute/v2.1/servers/c7b7e541-aa71-44f6-96fb-07c2e6e08520 => generated 1389 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:44:19.382754 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-eb0e3547-ba07-47ac-82f3-7cd8f71a9fa1 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:19.383485 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-eb0e3547-ba07-47ac-82f3-7cd8f71a9fa1 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] [instance: 258bc0cb-6718-4f8b-8d0b-ef544b2b659b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:19.399090 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-eb0e3547-ba07-47ac-82f3-7cd8f71a9fa1 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:19.399296 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-eb0e3547-ba07-47ac-82f3-7cd8f71a9fa1 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:19.403622 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-eb0e3547-ba07-47ac-82f3-7cd8f71a9fa1 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:19.406982 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-eb0e3547-ba07-47ac-82f3-7cd8f71a9fa1 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:19.409852 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-eb0e3547-ba07-47ac-82f3-7cd8f71a9fa1 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:19.411619 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-eb0e3547-ba07-47ac-82f3-7cd8f71a9fa1 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:19.597692 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-8c20b94e-8269-402d-9014-198f7a27f46a tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:19.598711 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-8c20b94e-8269-402d-9014-198f7a27f46a tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: ec437ce7-b43a-4c8b-8a06-756cfb877851] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:19.607298 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8c20b94e-8269-402d-9014-198f7a27f46a tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:19.608098 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8c20b94e-8269-402d-9014-198f7a27f46a tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:19.608702 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8c20b94e-8269-402d-9014-198f7a27f46a tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:19.609560 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8c20b94e-8269-402d-9014-198f7a27f46a tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:19.610157 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8c20b94e-8269-402d-9014-198f7a27f46a tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:19.610768 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8c20b94e-8269-402d-9014-198f7a27f46a tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:19.735178 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-eb0e3547-ba07-47ac-82f3-7cd8f71a9fa1 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29842a669a20408b881105135f76cb0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39edf587afe94b60911198aa0bb61613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:44:19.784412 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-eb0e3547-ba07-47ac-82f3-7cd8f71a9fa1 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] 10.222.0.43 "GET /compute/v2.1/servers/258bc0cb-6718-4f8b-8d0b-ef544b2b659b" status: 200 len: 1275 microversion: 2.1 time: 0.405803 Oct 04 21:44:19.790702 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 183/359] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:44:19 2022] GET /compute/v2.1/servers/258bc0cb-6718-4f8b-8d0b-ef544b2b659b => generated 1275 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:44:19.947695 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-4235bb67-953f-4c9a-8d68-e5275e6a3edd req-5828d9b4-6f72-4986-a105-70a3f8e0500a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7b7e541-aa71-44f6-96fb-07c2e6e08520", "tag": "7e3bac17-bb02-4dee-99d3-79bc4e2aa285"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:44:19.970045 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-4235bb67-953f-4c9a-8d68-e5275e6a3edd req-5828d9b4-6f72-4986-a105-70a3f8e0500a service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:19.976272 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-4235bb67-953f-4c9a-8d68-e5275e6a3edd req-5828d9b4-6f72-4986-a105-70a3f8e0500a service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:19.977462 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-4235bb67-953f-4c9a-8d68-e5275e6a3edd req-5828d9b4-6f72-4986-a105-70a3f8e0500a service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:20.017115 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-4235bb67-953f-4c9a-8d68-e5275e6a3edd req-5828d9b4-6f72-4986-a105-70a3f8e0500a service nova] Creating event network-changed:7e3bac17-bb02-4dee-99d3-79bc4e2aa285 for instance c7b7e541-aa71-44f6-96fb-07c2e6e08520 on n-h1-860284-1 Oct 04 21:44:20.034831 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-4235bb67-953f-4c9a-8d68-e5275e6a3edd req-5828d9b4-6f72-4986-a105-70a3f8e0500a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090441 Oct 04 21:44:20.038170 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 184/360] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:44:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:44:20.072935 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-d61b9fd7-ed3b-4708-85e5-c466cb4460ad req-1e45dd7b-9f4c-48f3-b3dc-ba360f03c565 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80d8aacc-cde5-4451-8697-054eefe15849", "name": "network-vif-plugged", "status": "completed", "tag": "fafe0a1d-3449-411d-80e8-e00053bf929b"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:44:20.103373 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-d61b9fd7-ed3b-4708-85e5-c466cb4460ad req-1e45dd7b-9f4c-48f3-b3dc-ba360f03c565 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:20.104793 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-d61b9fd7-ed3b-4708-85e5-c466cb4460ad req-1e45dd7b-9f4c-48f3-b3dc-ba360f03c565 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:20.105451 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-d61b9fd7-ed3b-4708-85e5-c466cb4460ad req-1e45dd7b-9f4c-48f3-b3dc-ba360f03c565 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:20.148751 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-d61b9fd7-ed3b-4708-85e5-c466cb4460ad req-1e45dd7b-9f4c-48f3-b3dc-ba360f03c565 service nova] Creating event network-vif-plugged:fafe0a1d-3449-411d-80e8-e00053bf929b for instance 80d8aacc-cde5-4451-8697-054eefe15849 on n-h1-860284-1 Oct 04 21:44:20.164640 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-d61b9fd7-ed3b-4708-85e5-c466cb4460ad req-1e45dd7b-9f4c-48f3-b3dc-ba360f03c565 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099458 Oct 04 21:44:20.165816 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 185/361] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:44:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:44:20.220368 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-16faba1d-6d70-4400-9818-2da74faad6e2 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:20.221825 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-16faba1d-6d70-4400-9818-2da74faad6e2 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] [instance: 80d8aacc-cde5-4451-8697-054eefe15849] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:20.235901 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-16faba1d-6d70-4400-9818-2da74faad6e2 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:20.238763 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-16faba1d-6d70-4400-9818-2da74faad6e2 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:20.240929 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-16faba1d-6d70-4400-9818-2da74faad6e2 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:20.244940 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-16faba1d-6d70-4400-9818-2da74faad6e2 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:20.245751 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-16faba1d-6d70-4400-9818-2da74faad6e2 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:20.246456 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-16faba1d-6d70-4400-9818-2da74faad6e2 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:20.264331 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=11 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:44:20.271637 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-8c20b94e-8269-402d-9014-198f7a27f46a tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:44:20.299788 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-8c20b94e-8269-402d-9014-198f7a27f46a tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/ec437ce7-b43a-4c8b-8a06-756cfb877851" status: 200 len: 1472 microversion: 2.1 time: 0.707166 Oct 04 21:44:20.302304 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 177/362] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:44:19 2022] GET /compute/v2.1/servers/ec437ce7-b43a-4c8b-8a06-756cfb877851 => generated 1472 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:44:20.321758 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-59f04ba5-4cae-4353-8ffe-2c27767b7be3 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:20.322851 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-59f04ba5-4cae-4353-8ffe-2c27767b7be3 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] [instance: c7b7e541-aa71-44f6-96fb-07c2e6e08520] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:20.332391 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-59f04ba5-4cae-4353-8ffe-2c27767b7be3 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:20.334738 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-59f04ba5-4cae-4353-8ffe-2c27767b7be3 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:20.338761 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-59f04ba5-4cae-4353-8ffe-2c27767b7be3 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:20.340977 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-59f04ba5-4cae-4353-8ffe-2c27767b7be3 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:20.343046 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-59f04ba5-4cae-4353-8ffe-2c27767b7be3 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:20.343431 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-59f04ba5-4cae-4353-8ffe-2c27767b7be3 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:20.728834 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-16faba1d-6d70-4400-9818-2da74faad6e2 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5387dbf4e24960809704c398fe999a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bedc0e10ab24824a40d06bb91626088', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:44:20.738855 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-59f04ba5-4cae-4353-8ffe-2c27767b7be3 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1789bb97219a4e1591632126812ea6df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da67fc95e2814f4086df020f4c475764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:44:20.743152 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-16faba1d-6d70-4400-9818-2da74faad6e2 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] 10.222.0.43 "GET /compute/v2.1/servers/80d8aacc-cde5-4451-8697-054eefe15849" status: 200 len: 1320 microversion: 2.1 time: 0.527291 Oct 04 21:44:20.744070 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 186/363] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:44:20 2022] GET /compute/v2.1/servers/80d8aacc-cde5-4451-8697-054eefe15849 => generated 1320 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:44:20.754355 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-59f04ba5-4cae-4353-8ffe-2c27767b7be3 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] 10.222.0.43 "GET /compute/v2.1/servers/c7b7e541-aa71-44f6-96fb-07c2e6e08520" status: 200 len: 1389 microversion: 2.1 time: 0.448731 Oct 04 21:44:20.754992 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 178/364] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:44:20 2022] GET /compute/v2.1/servers/c7b7e541-aa71-44f6-96fb-07c2e6e08520 => generated 1389 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:44:20.823556 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-c68c373d-b1d7-4cbb-bf71-4569c453d727 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:20.825169 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-c68c373d-b1d7-4cbb-bf71-4569c453d727 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] [instance: 258bc0cb-6718-4f8b-8d0b-ef544b2b659b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:20.832757 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c68c373d-b1d7-4cbb-bf71-4569c453d727 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:20.833733 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c68c373d-b1d7-4cbb-bf71-4569c453d727 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:20.834791 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c68c373d-b1d7-4cbb-bf71-4569c453d727 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:20.836832 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c68c373d-b1d7-4cbb-bf71-4569c453d727 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:20.837906 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c68c373d-b1d7-4cbb-bf71-4569c453d727 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:20.838572 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c68c373d-b1d7-4cbb-bf71-4569c453d727 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:21.232948 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-08f182df-8620-4856-8894-9b7eabca87f9 tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-1574444966", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452"}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:44:21.312492 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-c68c373d-b1d7-4cbb-bf71-4569c453d727 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29842a669a20408b881105135f76cb0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39edf587afe94b60911198aa0bb61613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:44:21.321192 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.network.neutron [None req-08f182df-8620-4856-8894-9b7eabca87f9 tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] validate_networks() for None {{(pid=134102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:44:21.322611 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-c68c373d-b1d7-4cbb-bf71-4569c453d727 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] 10.222.0.43 "GET /compute/v2.1/servers/258bc0cb-6718-4f8b-8d0b-ef544b2b659b" status: 200 len: 1317 microversion: 2.1 time: 0.504974 Oct 04 21:44:21.336860 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 187/365] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:44:20 2022] GET /compute/v2.1/servers/258bc0cb-6718-4f8b-8d0b-ef544b2b659b => generated 1317 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:44:21.336860 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-496b88c8-2fd2-4cd9-8b30-fe26b974af6f tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:21.336860 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-496b88c8-2fd2-4cd9-8b30-fe26b974af6f tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: ec437ce7-b43a-4c8b-8a06-756cfb877851] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:21.343058 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=67,nova_cell0:UPDATE=7 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:44:21.352336 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-496b88c8-2fd2-4cd9-8b30-fe26b974af6f tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:21.352856 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-496b88c8-2fd2-4cd9-8b30-fe26b974af6f tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:21.354498 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-496b88c8-2fd2-4cd9-8b30-fe26b974af6f tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:21.355318 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-496b88c8-2fd2-4cd9-8b30-fe26b974af6f tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:21.355788 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-496b88c8-2fd2-4cd9-8b30-fe26b974af6f tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:21.356434 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-496b88c8-2fd2-4cd9-8b30-fe26b974af6f tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:21.687060 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-496b88c8-2fd2-4cd9-8b30-fe26b974af6f tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:44:21.704062 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-496b88c8-2fd2-4cd9-8b30-fe26b974af6f tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/ec437ce7-b43a-4c8b-8a06-756cfb877851" status: 200 len: 1477 microversion: 2.1 time: 0.375330 Oct 04 21:44:21.707814 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 188/366] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:44:21 2022] GET /compute/v2.1/servers/ec437ce7-b43a-4c8b-8a06-756cfb877851 => generated 1477 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:44:21.772159 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-83bc61b1-3910-44a2-aeec-d06bba41f370 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:21.775009 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-83bc61b1-3910-44a2-aeec-d06bba41f370 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] [instance: 80d8aacc-cde5-4451-8697-054eefe15849] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:21.791220 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-08f182df-8620-4856-8894-9b7eabca87f9 tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] Flavor limits 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:44:21.792040 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-08f182df-8620-4856-8894-9b7eabca87f9 tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] Image limits 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:44:21.792713 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-08f182df-8620-4856-8894-9b7eabca87f9 tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] Flavor pref 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:44:21.793272 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-08f182df-8620-4856-8894-9b7eabca87f9 tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] Image pref 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:44:21.793852 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-08f182df-8620-4856-8894-9b7eabca87f9 tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:44:21.803042 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-83bc61b1-3910-44a2-aeec-d06bba41f370 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:21.807407 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-83bc61b1-3910-44a2-aeec-d06bba41f370 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:21.810969 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-83bc61b1-3910-44a2-aeec-d06bba41f370 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:21.820539 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-08f182df-8620-4856-8894-9b7eabca87f9 tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:21.827256 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-08f182df-8620-4856-8894-9b7eabca87f9 tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:21.828000 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-08f182df-8620-4856-8894-9b7eabca87f9 tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:21.829026 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-08f182df-8620-4856-8894-9b7eabca87f9 tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:21.829652 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-08f182df-8620-4856-8894-9b7eabca87f9 tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:21.830261 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-08f182df-8620-4856-8894-9b7eabca87f9 tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:21.842652 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-83bc61b1-3910-44a2-aeec-d06bba41f370 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:21.843545 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-83bc61b1-3910-44a2-aeec-d06bba41f370 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.031s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:21.847462 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-83bc61b1-3910-44a2-aeec-d06bba41f370 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:21.877805 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-08f182df-8620-4856-8894-9b7eabca87f9 tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] Getting quotas for project 8179a9b323b74a789fa7d5a4507cb6b3. Resources: {'instances', 'ram', 'cores'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:44:21.891923 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-08f182df-8620-4856-8894-9b7eabca87f9 tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] Getting quotas for user 539a93c63ab34b789903970b57b96bd6 and project 8179a9b323b74a789fa7d5a4507cb6b3. Resources: {'instances', 'ram', 'cores'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:44:21.922533 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-08f182df-8620-4856-8894-9b7eabca87f9 tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] Going to run 1 instances... {{(pid=134102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:44:21.926131 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-08f182df-8620-4856-8894-9b7eabca87f9 tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] [instance: 3eeb7190-8e00-4c8c-bfd7-a15da2a3e376] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='58548514-5dac-426c-81f5-19e3fba33e23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:44:22.034326 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-08f182df-8620-4856-8894-9b7eabca87f9 tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.100151 Oct 04 21:44:22.035838 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 179/367] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 21:44:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 1103 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:44:22.041264 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-3fc240b7-4ba5-483b-b10a-0fa9f4fb839e tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:22.042127 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-3fc240b7-4ba5-483b-b10a-0fa9f4fb839e tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] [instance: c7b7e541-aa71-44f6-96fb-07c2e6e08520] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:22.049477 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3fc240b7-4ba5-483b-b10a-0fa9f4fb839e tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:22.050221 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3fc240b7-4ba5-483b-b10a-0fa9f4fb839e tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:22.050927 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3fc240b7-4ba5-483b-b10a-0fa9f4fb839e tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:22.054055 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3fc240b7-4ba5-483b-b10a-0fa9f4fb839e tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:22.055452 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3fc240b7-4ba5-483b-b10a-0fa9f4fb839e tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:22.056347 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3fc240b7-4ba5-483b-b10a-0fa9f4fb839e tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:22.221971 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-83bc61b1-3910-44a2-aeec-d06bba41f370 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5387dbf4e24960809704c398fe999a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bedc0e10ab24824a40d06bb91626088', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:44:22.244882 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-83bc61b1-3910-44a2-aeec-d06bba41f370 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] 10.222.0.43 "GET /compute/v2.1/servers/80d8aacc-cde5-4451-8697-054eefe15849" status: 200 len: 1320 microversion: 2.1 time: 0.479205 Oct 04 21:44:22.245495 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 189/368] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:44:21 2022] GET /compute/v2.1/servers/80d8aacc-cde5-4451-8697-054eefe15849 => generated 1320 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:44:22.260020 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-40d42bfc-4274-4c50-9b3e-2539c6017253 tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:22.260656 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-40d42bfc-4274-4c50-9b3e-2539c6017253 tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] [instance: 3eeb7190-8e00-4c8c-bfd7-a15da2a3e376] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:22.395497 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-40d42bfc-4274-4c50-9b3e-2539c6017253 tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539a93c63ab34b789903970b57b96bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8179a9b323b74a789fa7d5a4507cb6b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:44:22.409485 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-40d42bfc-4274-4c50-9b3e-2539c6017253 tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] 10.222.0.43 "GET /compute/v2.1/servers/3eeb7190-8e00-4c8c-bfd7-a15da2a3e376" status: 200 len: 1223 microversion: 2.1 time: 0.162705 Oct 04 21:44:22.427755 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 190/369] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:44:22 2022] GET /compute/v2.1/servers/3eeb7190-8e00-4c8c-bfd7-a15da2a3e376 => generated 1223 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:44:22.440393 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-f3d9567b-db3d-4c1c-b238-6bbf94e27ef2 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:22.441405 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-f3d9567b-db3d-4c1c-b238-6bbf94e27ef2 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] [instance: 258bc0cb-6718-4f8b-8d0b-ef544b2b659b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:22.448369 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-3fc240b7-4ba5-483b-b10a-0fa9f4fb839e tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1789bb97219a4e1591632126812ea6df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da67fc95e2814f4086df020f4c475764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:44:22.451687 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f3d9567b-db3d-4c1c-b238-6bbf94e27ef2 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:22.452512 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f3d9567b-db3d-4c1c-b238-6bbf94e27ef2 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:22.453103 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f3d9567b-db3d-4c1c-b238-6bbf94e27ef2 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:22.454179 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f3d9567b-db3d-4c1c-b238-6bbf94e27ef2 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:22.454913 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f3d9567b-db3d-4c1c-b238-6bbf94e27ef2 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:22.455667 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f3d9567b-db3d-4c1c-b238-6bbf94e27ef2 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:22.469246 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-3fc240b7-4ba5-483b-b10a-0fa9f4fb839e tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] 10.222.0.43 "GET /compute/v2.1/servers/c7b7e541-aa71-44f6-96fb-07c2e6e08520" status: 200 len: 1389 microversion: 2.1 time: 0.432086 Oct 04 21:44:22.470976 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 180/370] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:44:22 2022] GET /compute/v2.1/servers/c7b7e541-aa71-44f6-96fb-07c2e6e08520 => generated 1389 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:44:22.736857 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-98e3857f-9b1d-40c5-ad87-43895febc36b tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:22.737824 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-98e3857f-9b1d-40c5-ad87-43895febc36b tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: ec437ce7-b43a-4c8b-8a06-756cfb877851] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:22.748345 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-98e3857f-9b1d-40c5-ad87-43895febc36b tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:22.749087 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-98e3857f-9b1d-40c5-ad87-43895febc36b tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:22.751164 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-98e3857f-9b1d-40c5-ad87-43895febc36b tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:22.755168 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-98e3857f-9b1d-40c5-ad87-43895febc36b tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:22.756475 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-98e3857f-9b1d-40c5-ad87-43895febc36b tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:22.768951 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-98e3857f-9b1d-40c5-ad87-43895febc36b tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:22.816982 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-f3d9567b-db3d-4c1c-b238-6bbf94e27ef2 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29842a669a20408b881105135f76cb0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39edf587afe94b60911198aa0bb61613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:44:22.834465 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-f3d9567b-db3d-4c1c-b238-6bbf94e27ef2 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] 10.222.0.43 "GET /compute/v2.1/servers/258bc0cb-6718-4f8b-8d0b-ef544b2b659b" status: 200 len: 1317 microversion: 2.1 time: 0.399355 Oct 04 21:44:22.841329 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 191/371] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:44:22 2022] GET /compute/v2.1/servers/258bc0cb-6718-4f8b-8d0b-ef544b2b659b => generated 1317 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:44:22.857605 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-b9e163ee-6179-47fb-9f7f-b03c4f46c847 req-b6985c28-6838-45bc-a757-1f278896b147 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d71d6d3-3a63-406b-ac49-3e83bd539cf9", "tag": "c9b71eee-ecc1-4326-bb8c-04bddb4cc35c"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:44:22.902307 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-b9e163ee-6179-47fb-9f7f-b03c4f46c847 req-b6985c28-6838-45bc-a757-1f278896b147 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:22.909774 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-b9e163ee-6179-47fb-9f7f-b03c4f46c847 req-b6985c28-6838-45bc-a757-1f278896b147 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:22.912523 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-b9e163ee-6179-47fb-9f7f-b03c4f46c847 req-b6985c28-6838-45bc-a757-1f278896b147 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:22.952416 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-b9e163ee-6179-47fb-9f7f-b03c4f46c847 req-b6985c28-6838-45bc-a757-1f278896b147 service nova] Creating event network-changed:c9b71eee-ecc1-4326-bb8c-04bddb4cc35c for instance 7d71d6d3-3a63-406b-ac49-3e83bd539cf9 on n-h1-860284-1 Oct 04 21:44:22.974144 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-b9e163ee-6179-47fb-9f7f-b03c4f46c847 req-b6985c28-6838-45bc-a757-1f278896b147 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.130427 Oct 04 21:44:22.979124 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 192/372] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:44:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:44:23.141077 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-98e3857f-9b1d-40c5-ad87-43895febc36b tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:44:23.154250 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-98e3857f-9b1d-40c5-ad87-43895febc36b tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/ec437ce7-b43a-4c8b-8a06-756cfb877851" status: 200 len: 1477 microversion: 2.1 time: 0.422329 Oct 04 21:44:23.159562 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 181/373] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:44:22 2022] GET /compute/v2.1/servers/ec437ce7-b43a-4c8b-8a06-756cfb877851 => generated 1477 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:44:23.271213 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-ef64b3b1-a64a-49fd-ba98-3490e3dd10e8 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:23.272520 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-ef64b3b1-a64a-49fd-ba98-3490e3dd10e8 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] [instance: 80d8aacc-cde5-4451-8697-054eefe15849] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:23.297459 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ef64b3b1-a64a-49fd-ba98-3490e3dd10e8 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:23.299227 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ef64b3b1-a64a-49fd-ba98-3490e3dd10e8 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:23.302816 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ef64b3b1-a64a-49fd-ba98-3490e3dd10e8 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:23.303808 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ef64b3b1-a64a-49fd-ba98-3490e3dd10e8 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:23.305525 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ef64b3b1-a64a-49fd-ba98-3490e3dd10e8 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:23.306768 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ef64b3b1-a64a-49fd-ba98-3490e3dd10e8 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:23.443132 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-f644184e-d5a1-4087-b64e-94d99cea9788 tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:23.444428 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-f644184e-d5a1-4087-b64e-94d99cea9788 tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] [instance: 3eeb7190-8e00-4c8c-bfd7-a15da2a3e376] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:23.465489 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f644184e-d5a1-4087-b64e-94d99cea9788 tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:23.470590 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f644184e-d5a1-4087-b64e-94d99cea9788 tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:23.471754 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f644184e-d5a1-4087-b64e-94d99cea9788 tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:23.475445 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f644184e-d5a1-4087-b64e-94d99cea9788 tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:23.479738 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f644184e-d5a1-4087-b64e-94d99cea9788 tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:23.480318 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f644184e-d5a1-4087-b64e-94d99cea9788 tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:23.721696 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-f644184e-d5a1-4087-b64e-94d99cea9788 tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539a93c63ab34b789903970b57b96bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8179a9b323b74a789fa7d5a4507cb6b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:44:23.750975 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-f644184e-d5a1-4087-b64e-94d99cea9788 tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] 10.222.0.43 "GET /compute/v2.1/servers/3eeb7190-8e00-4c8c-bfd7-a15da2a3e376" status: 200 len: 1219 microversion: 2.1 time: 0.312313 Oct 04 21:44:23.752577 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 182/374] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:44:23 2022] GET /compute/v2.1/servers/3eeb7190-8e00-4c8c-bfd7-a15da2a3e376 => generated 1219 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:44:23.772415 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-9efaaeb4-861a-4078-a527-f87427f91a47 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:23.773109 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-9efaaeb4-861a-4078-a527-f87427f91a47 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] [instance: c7b7e541-aa71-44f6-96fb-07c2e6e08520] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:23.788078 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9efaaeb4-861a-4078-a527-f87427f91a47 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:23.793120 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9efaaeb4-861a-4078-a527-f87427f91a47 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:23.794266 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9efaaeb4-861a-4078-a527-f87427f91a47 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:23.795250 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9efaaeb4-861a-4078-a527-f87427f91a47 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:23.796083 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9efaaeb4-861a-4078-a527-f87427f91a47 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:23.796761 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9efaaeb4-861a-4078-a527-f87427f91a47 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:23.827814 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-ef64b3b1-a64a-49fd-ba98-3490e3dd10e8 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5387dbf4e24960809704c398fe999a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bedc0e10ab24824a40d06bb91626088', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:44:23.841718 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-ef64b3b1-a64a-49fd-ba98-3490e3dd10e8 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] 10.222.0.43 "GET /compute/v2.1/servers/80d8aacc-cde5-4451-8697-054eefe15849" status: 200 len: 1320 microversion: 2.1 time: 0.575777 Oct 04 21:44:23.846230 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 193/375] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:44:23 2022] GET /compute/v2.1/servers/80d8aacc-cde5-4451-8697-054eefe15849 => generated 1320 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:44:23.876907 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-8e84b4c3-422b-43ae-a8d1-5cb48b959f1c tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:23.880291 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-8e84b4c3-422b-43ae-a8d1-5cb48b959f1c tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] [instance: 258bc0cb-6718-4f8b-8d0b-ef544b2b659b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:23.902620 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8e84b4c3-422b-43ae-a8d1-5cb48b959f1c tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:23.910631 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8e84b4c3-422b-43ae-a8d1-5cb48b959f1c tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:23.912993 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8e84b4c3-422b-43ae-a8d1-5cb48b959f1c tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:23.915133 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8e84b4c3-422b-43ae-a8d1-5cb48b959f1c tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:23.915815 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8e84b4c3-422b-43ae-a8d1-5cb48b959f1c tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:23.916253 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8e84b4c3-422b-43ae-a8d1-5cb48b959f1c tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:24.315367 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-9efaaeb4-861a-4078-a527-f87427f91a47 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1789bb97219a4e1591632126812ea6df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da67fc95e2814f4086df020f4c475764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:44:24.324821 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-9efaaeb4-861a-4078-a527-f87427f91a47 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] 10.222.0.43 "GET /compute/v2.1/servers/c7b7e541-aa71-44f6-96fb-07c2e6e08520" status: 200 len: 1389 microversion: 2.1 time: 0.571054 Oct 04 21:44:24.330151 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 183/376] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:44:23 2022] GET /compute/v2.1/servers/c7b7e541-aa71-44f6-96fb-07c2e6e08520 => generated 1389 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:44:24.340376 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-8e84b4c3-422b-43ae-a8d1-5cb48b959f1c tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29842a669a20408b881105135f76cb0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39edf587afe94b60911198aa0bb61613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:44:24.350730 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-8e84b4c3-422b-43ae-a8d1-5cb48b959f1c tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] 10.222.0.43 "GET /compute/v2.1/servers/258bc0cb-6718-4f8b-8d0b-ef544b2b659b" status: 200 len: 1317 microversion: 2.1 time: 0.491612 Oct 04 21:44:24.363300 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-e4f48075-ee79-44d0-a1b7-435aaa3c354c tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:24.369300 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 194/377] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:44:23 2022] GET /compute/v2.1/servers/258bc0cb-6718-4f8b-8d0b-ef544b2b659b => generated 1317 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:44:24.370805 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-e4f48075-ee79-44d0-a1b7-435aaa3c354c tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: ec437ce7-b43a-4c8b-8a06-756cfb877851] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:24.385692 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e4f48075-ee79-44d0-a1b7-435aaa3c354c tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:24.387069 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e4f48075-ee79-44d0-a1b7-435aaa3c354c tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:24.388031 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e4f48075-ee79-44d0-a1b7-435aaa3c354c tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:24.390254 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e4f48075-ee79-44d0-a1b7-435aaa3c354c tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:24.391065 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e4f48075-ee79-44d0-a1b7-435aaa3c354c tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:24.391732 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e4f48075-ee79-44d0-a1b7-435aaa3c354c tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:24.734635 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-e4f48075-ee79-44d0-a1b7-435aaa3c354c tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:44:24.744381 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-e4f48075-ee79-44d0-a1b7-435aaa3c354c tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/ec437ce7-b43a-4c8b-8a06-756cfb877851" status: 200 len: 1477 microversion: 2.1 time: 0.412855 Oct 04 21:44:24.750915 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 184/378] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:44:24 2022] GET /compute/v2.1/servers/ec437ce7-b43a-4c8b-8a06-756cfb877851 => generated 1477 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:44:24.776122 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-bad8dfde-4a3d-40f2-ab93-0c9d13068885 tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:24.777622 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-bad8dfde-4a3d-40f2-ab93-0c9d13068885 tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] [instance: 3eeb7190-8e00-4c8c-bfd7-a15da2a3e376] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:24.784291 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bad8dfde-4a3d-40f2-ab93-0c9d13068885 tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:24.784763 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bad8dfde-4a3d-40f2-ab93-0c9d13068885 tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:24.785196 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bad8dfde-4a3d-40f2-ab93-0c9d13068885 tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:24.785896 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bad8dfde-4a3d-40f2-ab93-0c9d13068885 tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:24.786343 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bad8dfde-4a3d-40f2-ab93-0c9d13068885 tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:24.794066 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bad8dfde-4a3d-40f2-ab93-0c9d13068885 tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:25.008884 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-bad8dfde-4a3d-40f2-ab93-0c9d13068885 tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539a93c63ab34b789903970b57b96bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8179a9b323b74a789fa7d5a4507cb6b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:44:25.019805 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-bad8dfde-4a3d-40f2-ab93-0c9d13068885 tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] 10.222.0.43 "GET /compute/v2.1/servers/3eeb7190-8e00-4c8c-bfd7-a15da2a3e376" status: 200 len: 1281 microversion: 2.1 time: 0.248555 Oct 04 21:44:25.042400 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 195/379] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:44:24 2022] GET /compute/v2.1/servers/3eeb7190-8e00-4c8c-bfd7-a15da2a3e376 => generated 1281 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:44:25.048798 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-ae5561fe-979f-4df9-803c-6b7b5105dd85 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:25.049752 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-ae5561fe-979f-4df9-803c-6b7b5105dd85 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] [instance: 80d8aacc-cde5-4451-8697-054eefe15849] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:25.061946 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ae5561fe-979f-4df9-803c-6b7b5105dd85 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:25.063132 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ae5561fe-979f-4df9-803c-6b7b5105dd85 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:25.063652 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-f22ef2ae-9fbf-441f-9b09-ee28692cc689 tempest-HypervisorAdminV228Test-433665232 tempest-HypervisorAdminV228Test-433665232-project-admin] Calling method '.version_select at 0x7fbb2f8990d0>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:25.064067 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ae5561fe-979f-4df9-803c-6b7b5105dd85 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:25.065023 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ae5561fe-979f-4df9-803c-6b7b5105dd85 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:25.065713 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f22ef2ae-9fbf-441f-9b09-ee28692cc689 tempest-HypervisorAdminV228Test-433665232 tempest-HypervisorAdminV228Test-433665232-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:25.066570 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ae5561fe-979f-4df9-803c-6b7b5105dd85 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:25.067400 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f22ef2ae-9fbf-441f-9b09-ee28692cc689 tempest-HypervisorAdminV228Test-433665232 tempest-HypervisorAdminV228Test-433665232-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:25.067677 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ae5561fe-979f-4df9-803c-6b7b5105dd85 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:25.067869 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f22ef2ae-9fbf-441f-9b09-ee28692cc689 tempest-HypervisorAdminV228Test-433665232 tempest-HypervisorAdminV228Test-433665232-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:25.101912 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f22ef2ae-9fbf-441f-9b09-ee28692cc689 tempest-HypervisorAdminV228Test-433665232 tempest-HypervisorAdminV228Test-433665232-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:25.102704 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f22ef2ae-9fbf-441f-9b09-ee28692cc689 tempest-HypervisorAdminV228Test-433665232 tempest-HypervisorAdminV228Test-433665232-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:25.103140 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f22ef2ae-9fbf-441f-9b09-ee28692cc689 tempest-HypervisorAdminV228Test-433665232 tempest-HypervisorAdminV228Test-433665232-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:25.141010 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f22ef2ae-9fbf-441f-9b09-ee28692cc689 tempest-HypervisorAdminV228Test-433665232 tempest-HypervisorAdminV228Test-433665232-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:25.143299 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f22ef2ae-9fbf-441f-9b09-ee28692cc689 tempest-HypervisorAdminV228Test-433665232 tempest-HypervisorAdminV228Test-433665232-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:25.143990 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f22ef2ae-9fbf-441f-9b09-ee28692cc689 tempest-HypervisorAdminV228Test-433665232 tempest-HypervisorAdminV228Test-433665232-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:25.153128 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-f22ef2ae-9fbf-441f-9b09-ee28692cc689 tempest-HypervisorAdminV228Test-433665232 tempest-HypervisorAdminV228Test-433665232-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.28 time: 0.357629 Oct 04 21:44:25.154232 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 185/380] 10.222.0.43 () {60 vars in 1187 bytes} [Tue Oct 4 21:44:24 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 21:44:25.164638 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-08aa71cd-8394-42dc-b6df-dddee0a8ca26 tempest-HypervisorAdminV228Test-433665232 tempest-HypervisorAdminV228Test-433665232-project-admin] Calling method '.version_select at 0x7fbb2f95bd30>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:25.171653 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-08aa71cd-8394-42dc-b6df-dddee0a8ca26 tempest-HypervisorAdminV228Test-433665232 tempest-HypervisorAdminV228Test-433665232-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:25.172169 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-08aa71cd-8394-42dc-b6df-dddee0a8ca26 tempest-HypervisorAdminV228Test-433665232 tempest-HypervisorAdminV228Test-433665232-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:25.172605 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-08aa71cd-8394-42dc-b6df-dddee0a8ca26 tempest-HypervisorAdminV228Test-433665232 tempest-HypervisorAdminV228Test-433665232-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:25.193007 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-08aa71cd-8394-42dc-b6df-dddee0a8ca26 tempest-HypervisorAdminV228Test-433665232 tempest-HypervisorAdminV228Test-433665232-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:25.193616 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-08aa71cd-8394-42dc-b6df-dddee0a8ca26 tempest-HypervisorAdminV228Test-433665232 tempest-HypervisorAdminV228Test-433665232-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:25.194219 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-08aa71cd-8394-42dc-b6df-dddee0a8ca26 tempest-HypervisorAdminV228Test-433665232 tempest-HypervisorAdminV228Test-433665232-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:25.203684 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-08aa71cd-8394-42dc-b6df-dddee0a8ca26 tempest-HypervisorAdminV228Test-433665232 tempest-HypervisorAdminV228Test-433665232-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 718 microversion: 2.28 time: 0.042641 Oct 04 21:44:25.205595 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 186/381] 10.222.0.43 () {60 vars in 1193 bytes} [Tue Oct 4 21:44:25 2022] GET /compute/v2.1/os-hypervisors/1 => generated 718 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 21:44:25.350508 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-b9067b6b-82ed-4064-8a4c-b6f336ae0850 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:25.354490 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-b9067b6b-82ed-4064-8a4c-b6f336ae0850 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] [instance: c7b7e541-aa71-44f6-96fb-07c2e6e08520] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:25.359423 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-ae5561fe-979f-4df9-803c-6b7b5105dd85 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5387dbf4e24960809704c398fe999a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bedc0e10ab24824a40d06bb91626088', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:44:25.372636 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-ae5561fe-979f-4df9-803c-6b7b5105dd85 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] 10.222.0.43 "GET /compute/v2.1/servers/80d8aacc-cde5-4451-8697-054eefe15849" status: 200 len: 1468 microversion: 2.1 time: 0.328564 Oct 04 21:44:25.373982 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b9067b6b-82ed-4064-8a4c-b6f336ae0850 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:25.374168 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 196/382] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:44:25 2022] GET /compute/v2.1/servers/80d8aacc-cde5-4451-8697-054eefe15849 => generated 1468 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:44:25.376777 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b9067b6b-82ed-4064-8a4c-b6f336ae0850 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:25.377467 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b9067b6b-82ed-4064-8a4c-b6f336ae0850 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:25.378634 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b9067b6b-82ed-4064-8a4c-b6f336ae0850 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:25.379564 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b9067b6b-82ed-4064-8a4c-b6f336ae0850 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:25.380324 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b9067b6b-82ed-4064-8a4c-b6f336ae0850 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:25.392441 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-bcf1f908-3072-4334-be42-9ece949d0149 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:25.393244 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-bcf1f908-3072-4334-be42-9ece949d0149 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] [instance: 258bc0cb-6718-4f8b-8d0b-ef544b2b659b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:25.404764 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bcf1f908-3072-4334-be42-9ece949d0149 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:25.406197 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bcf1f908-3072-4334-be42-9ece949d0149 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:25.406879 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bcf1f908-3072-4334-be42-9ece949d0149 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:25.409792 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bcf1f908-3072-4334-be42-9ece949d0149 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:25.410540 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bcf1f908-3072-4334-be42-9ece949d0149 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:25.411705 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bcf1f908-3072-4334-be42-9ece949d0149 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:25.735337 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-b9067b6b-82ed-4064-8a4c-b6f336ae0850 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1789bb97219a4e1591632126812ea6df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da67fc95e2814f4086df020f4c475764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:44:25.751123 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-bcf1f908-3072-4334-be42-9ece949d0149 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29842a669a20408b881105135f76cb0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39edf587afe94b60911198aa0bb61613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:44:25.759820 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-bcf1f908-3072-4334-be42-9ece949d0149 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] 10.222.0.43 "GET /compute/v2.1/servers/258bc0cb-6718-4f8b-8d0b-ef544b2b659b" status: 200 len: 1317 microversion: 2.1 time: 0.371876 Oct 04 21:44:25.760729 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 197/383] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:44:25 2022] GET /compute/v2.1/servers/258bc0cb-6718-4f8b-8d0b-ef544b2b659b => generated 1317 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:44:25.765281 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-951b69c7-893c-4805-bf81-53d55be7d030 tempest-DeleteServersAdminTestJSON-312927555 tempest-DeleteServersAdminTestJSON-312927555-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:44:25.767641 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-951b69c7-893c-4805-bf81-53d55be7d030 tempest-DeleteServersAdminTestJSON-312927555 tempest-DeleteServersAdminTestJSON-312927555-project-admin] [instance: 80d8aacc-cde5-4451-8697-054eefe15849] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:25.769866 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:DELETE=5,nova_api:SELECT=91,nova_api:INSERT=4 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:44:25.783283 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-951b69c7-893c-4805-bf81-53d55be7d030 tempest-DeleteServersAdminTestJSON-312927555 tempest-DeleteServersAdminTestJSON-312927555-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:25.784054 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-951b69c7-893c-4805-bf81-53d55be7d030 tempest-DeleteServersAdminTestJSON-312927555 tempest-DeleteServersAdminTestJSON-312927555-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:25.784723 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-951b69c7-893c-4805-bf81-53d55be7d030 tempest-DeleteServersAdminTestJSON-312927555 tempest-DeleteServersAdminTestJSON-312927555-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:25.785755 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-951b69c7-893c-4805-bf81-53d55be7d030 tempest-DeleteServersAdminTestJSON-312927555 tempest-DeleteServersAdminTestJSON-312927555-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:25.786711 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-951b69c7-893c-4805-bf81-53d55be7d030 tempest-DeleteServersAdminTestJSON-312927555 tempest-DeleteServersAdminTestJSON-312927555-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:25.787450 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-951b69c7-893c-4805-bf81-53d55be7d030 tempest-DeleteServersAdminTestJSON-312927555 tempest-DeleteServersAdminTestJSON-312927555-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:25.788231 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-b9067b6b-82ed-4064-8a4c-b6f336ae0850 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] 10.222.0.43 "GET /compute/v2.1/servers/c7b7e541-aa71-44f6-96fb-07c2e6e08520" status: 200 len: 1389 microversion: 2.1 time: 0.443750 Oct 04 21:44:25.806408 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 187/384] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:44:25 2022] GET /compute/v2.1/servers/c7b7e541-aa71-44f6-96fb-07c2e6e08520 => generated 1389 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:44:25.808452 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-676d7a59-e584-4206-b3e4-5906708292b7 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:25.809098 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-676d7a59-e584-4206-b3e4-5906708292b7 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: ec437ce7-b43a-4c8b-8a06-756cfb877851] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:25.827856 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-676d7a59-e584-4206-b3e4-5906708292b7 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:25.828348 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-676d7a59-e584-4206-b3e4-5906708292b7 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:25.834899 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-676d7a59-e584-4206-b3e4-5906708292b7 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:25.837594 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-676d7a59-e584-4206-b3e4-5906708292b7 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:25.838255 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-676d7a59-e584-4206-b3e4-5906708292b7 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:25.838972 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-676d7a59-e584-4206-b3e4-5906708292b7 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:25.929730 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:44:25.956148 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-951b69c7-893c-4805-bf81-53d55be7d030 tempest-DeleteServersAdminTestJSON-312927555 tempest-DeleteServersAdminTestJSON-312927555-project-admin] 10.222.0.43 "POST /compute/v2.1/servers/80d8aacc-cde5-4451-8697-054eefe15849/action" status: 202 len: 0 microversion: 2.1 time: 0.194292 Oct 04 21:44:25.960615 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 198/385] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 21:44:25 2022] POST /compute/v2.1/servers/80d8aacc-cde5-4451-8697-054eefe15849/action => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:44:25.966574 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-2b7b1f19-0cc8-4076-9392-960617074b01 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:25.967201 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-2b7b1f19-0cc8-4076-9392-960617074b01 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] [instance: 80d8aacc-cde5-4451-8697-054eefe15849] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:25.977913 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2b7b1f19-0cc8-4076-9392-960617074b01 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:25.978408 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2b7b1f19-0cc8-4076-9392-960617074b01 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:25.978837 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2b7b1f19-0cc8-4076-9392-960617074b01 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:25.979548 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2b7b1f19-0cc8-4076-9392-960617074b01 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:25.980031 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2b7b1f19-0cc8-4076-9392-960617074b01 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:25.980460 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2b7b1f19-0cc8-4076-9392-960617074b01 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:26.030570 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2b7b1f19-0cc8-4076-9392-960617074b01 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:26.031242 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2b7b1f19-0cc8-4076-9392-960617074b01 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:26.031511 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2b7b1f19-0cc8-4076-9392-960617074b01 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:26.031969 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.objects.instance [None req-2b7b1f19-0cc8-4076-9392-960617074b01 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lazy-loading 'fault' on Instance uuid 80d8aacc-cde5-4451-8697-054eefe15849 {{(pid=134101) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:44:26.280162 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-676d7a59-e584-4206-b3e4-5906708292b7 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:44:26.291913 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-676d7a59-e584-4206-b3e4-5906708292b7 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/ec437ce7-b43a-4c8b-8a06-756cfb877851" status: 200 len: 1477 microversion: 2.1 time: 0.497065 Oct 04 21:44:26.298742 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 188/386] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:44:25 2022] GET /compute/v2.1/servers/ec437ce7-b43a-4c8b-8a06-756cfb877851 => generated 1477 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:44:26.310749 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-2dbe83cf-0f23-4066-b9c8-03dc93dd4240 tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:26.313182 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-2dbe83cf-0f23-4066-b9c8-03dc93dd4240 tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] [instance: 3eeb7190-8e00-4c8c-bfd7-a15da2a3e376] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:26.329502 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2dbe83cf-0f23-4066-b9c8-03dc93dd4240 tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:26.331174 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2dbe83cf-0f23-4066-b9c8-03dc93dd4240 tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:26.331841 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2dbe83cf-0f23-4066-b9c8-03dc93dd4240 tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:26.340186 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2dbe83cf-0f23-4066-b9c8-03dc93dd4240 tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:26.341029 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2dbe83cf-0f23-4066-b9c8-03dc93dd4240 tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:26.342097 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2dbe83cf-0f23-4066-b9c8-03dc93dd4240 tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:26.385303 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-2b7b1f19-0cc8-4076-9392-960617074b01 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5387dbf4e24960809704c398fe999a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bedc0e10ab24824a40d06bb91626088', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:44:26.395220 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-2b7b1f19-0cc8-4076-9392-960617074b01 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] 10.222.0.43 "GET /compute/v2.1/servers/80d8aacc-cde5-4451-8697-054eefe15849" status: 200 len: 1451 microversion: 2.1 time: 0.432578 Oct 04 21:44:26.407237 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 199/387] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:44:25 2022] GET /compute/v2.1/servers/80d8aacc-cde5-4451-8697-054eefe15849 => generated 1451 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:44:26.422383 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-c93b12d4-b78f-4a70-82f3-61463f3ee9cc tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:26.422976 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-c93b12d4-b78f-4a70-82f3-61463f3ee9cc tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] [instance: 80d8aacc-cde5-4451-8697-054eefe15849] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:26.430219 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c93b12d4-b78f-4a70-82f3-61463f3ee9cc tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:26.431596 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c93b12d4-b78f-4a70-82f3-61463f3ee9cc tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:26.432709 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c93b12d4-b78f-4a70-82f3-61463f3ee9cc tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:26.433617 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c93b12d4-b78f-4a70-82f3-61463f3ee9cc tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:26.434497 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c93b12d4-b78f-4a70-82f3-61463f3ee9cc tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:26.435110 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c93b12d4-b78f-4a70-82f3-61463f3ee9cc tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:26.447889 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-2dbe83cf-0f23-4066-b9c8-03dc93dd4240 tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539a93c63ab34b789903970b57b96bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8179a9b323b74a789fa7d5a4507cb6b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:44:26.465690 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-2dbe83cf-0f23-4066-b9c8-03dc93dd4240 tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] 10.222.0.43 "GET /compute/v2.1/servers/3eeb7190-8e00-4c8c-bfd7-a15da2a3e376" status: 200 len: 1281 microversion: 2.1 time: 0.161014 Oct 04 21:44:26.465690 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 189/388] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:44:26 2022] GET /compute/v2.1/servers/3eeb7190-8e00-4c8c-bfd7-a15da2a3e376 => generated 1281 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:44:26.477106 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-c93b12d4-b78f-4a70-82f3-61463f3ee9cc tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] [instance: 80d8aacc-cde5-4451-8697-054eefe15849] Going to try to terminate instance {{(pid=134101) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:44:26.676844 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-c93b12d4-b78f-4a70-82f3-61463f3ee9cc tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] 10.222.0.43 "DELETE /compute/v2.1/servers/80d8aacc-cde5-4451-8697-054eefe15849" status: 204 len: 0 microversion: 2.1 time: 0.260508 Oct 04 21:44:26.677759 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 200/389] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 21:44:26 2022] DELETE /compute/v2.1/servers/80d8aacc-cde5-4451-8697-054eefe15849 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:44:26.689255 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-37fd9c19-f66b-4e18-b5fc-7c568d2bcf02 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:26.695509 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-37fd9c19-f66b-4e18-b5fc-7c568d2bcf02 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] [instance: 80d8aacc-cde5-4451-8697-054eefe15849] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:26.704093 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-37fd9c19-f66b-4e18-b5fc-7c568d2bcf02 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:26.704745 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-37fd9c19-f66b-4e18-b5fc-7c568d2bcf02 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:26.705407 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-37fd9c19-f66b-4e18-b5fc-7c568d2bcf02 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:26.706298 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-37fd9c19-f66b-4e18-b5fc-7c568d2bcf02 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:26.707043 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-37fd9c19-f66b-4e18-b5fc-7c568d2bcf02 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:26.707513 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-37fd9c19-f66b-4e18-b5fc-7c568d2bcf02 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:26.746865 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-37fd9c19-f66b-4e18-b5fc-7c568d2bcf02 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:26.747785 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-37fd9c19-f66b-4e18-b5fc-7c568d2bcf02 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:26.748480 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-37fd9c19-f66b-4e18-b5fc-7c568d2bcf02 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:26.749207 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.objects.instance [None req-37fd9c19-f66b-4e18-b5fc-7c568d2bcf02 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lazy-loading 'fault' on Instance uuid 80d8aacc-cde5-4451-8697-054eefe15849 {{(pid=134101) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:44:26.796049 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-ece086f5-fc46-4279-87f6-a9009b652e9a tempest-FlavorsAccessNegativeTestJSON-1458998978 tempest-FlavorsAccessNegativeTestJSON-1458998978-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-931334637", "id": 581736423, "os-flavor-access:is_public": "False"}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:44:26.844758 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-ece086f5-fc46-4279-87f6-a9009b652e9a tempest-FlavorsAccessNegativeTestJSON-1458998978 tempest-FlavorsAccessNegativeTestJSON-1458998978-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.372016 Oct 04 21:44:26.857172 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 190/390] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 21:44:26 2022] POST /compute/v2.1/flavors => generated 435 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:44:26.870496 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-34c73ea2-c6f1-4ce5-b7ca-6590f69ab8a6 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:26.871423 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-34c73ea2-c6f1-4ce5-b7ca-6590f69ab8a6 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] [instance: 258bc0cb-6718-4f8b-8d0b-ef544b2b659b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:26.885820 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-34c73ea2-c6f1-4ce5-b7ca-6590f69ab8a6 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:26.886667 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-34c73ea2-c6f1-4ce5-b7ca-6590f69ab8a6 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:26.887209 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-34c73ea2-c6f1-4ce5-b7ca-6590f69ab8a6 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:26.888188 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-34c73ea2-c6f1-4ce5-b7ca-6590f69ab8a6 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:26.888868 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-34c73ea2-c6f1-4ce5-b7ca-6590f69ab8a6 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:26.890498 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-34c73ea2-c6f1-4ce5-b7ca-6590f69ab8a6 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:27.065610 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-37fd9c19-f66b-4e18-b5fc-7c568d2bcf02 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5387dbf4e24960809704c398fe999a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bedc0e10ab24824a40d06bb91626088', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:44:27.078783 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-37fd9c19-f66b-4e18-b5fc-7c568d2bcf02 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] 10.222.0.43 "GET /compute/v2.1/servers/80d8aacc-cde5-4451-8697-054eefe15849" status: 200 len: 1457 microversion: 2.1 time: 0.395170 Oct 04 21:44:27.081399 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 201/391] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:44:26 2022] GET /compute/v2.1/servers/80d8aacc-cde5-4451-8697-054eefe15849 => generated 1457 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:44:27.096692 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-7714f05b-77ca-4836-a5d2-75d5e44dc6a6 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:27.099968 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-7714f05b-77ca-4836-a5d2-75d5e44dc6a6 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] [instance: c7b7e541-aa71-44f6-96fb-07c2e6e08520] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:27.116121 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7714f05b-77ca-4836-a5d2-75d5e44dc6a6 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:27.117490 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7714f05b-77ca-4836-a5d2-75d5e44dc6a6 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:27.119109 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7714f05b-77ca-4836-a5d2-75d5e44dc6a6 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:27.121206 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7714f05b-77ca-4836-a5d2-75d5e44dc6a6 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:27.124203 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7714f05b-77ca-4836-a5d2-75d5e44dc6a6 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:27.126423 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7714f05b-77ca-4836-a5d2-75d5e44dc6a6 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:27.151599 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-34c73ea2-c6f1-4ce5-b7ca-6590f69ab8a6 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29842a669a20408b881105135f76cb0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39edf587afe94b60911198aa0bb61613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:44:27.163088 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-34c73ea2-c6f1-4ce5-b7ca-6590f69ab8a6 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] 10.222.0.43 "GET /compute/v2.1/servers/258bc0cb-6718-4f8b-8d0b-ef544b2b659b" status: 200 len: 1317 microversion: 2.1 time: 0.303478 Oct 04 21:44:27.164140 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 191/392] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:44:26 2022] GET /compute/v2.1/servers/258bc0cb-6718-4f8b-8d0b-ef544b2b659b => generated 1317 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:44:27.169714 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-690915a2-72f5-4152-b2e0-1d5b3cdbbe0a req-880a3439-20c7-4199-8392-acf288750951 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "258bc0cb-6718-4f8b-8d0b-ef544b2b659b", "tag": "11865c88-bab8-4b1b-af2e-a51d5befe968"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:44:27.201323 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-690915a2-72f5-4152-b2e0-1d5b3cdbbe0a req-880a3439-20c7-4199-8392-acf288750951 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:27.202354 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-690915a2-72f5-4152-b2e0-1d5b3cdbbe0a req-880a3439-20c7-4199-8392-acf288750951 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:27.203731 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-690915a2-72f5-4152-b2e0-1d5b3cdbbe0a req-880a3439-20c7-4199-8392-acf288750951 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:27.247012 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-690915a2-72f5-4152-b2e0-1d5b3cdbbe0a req-880a3439-20c7-4199-8392-acf288750951 service nova] Creating event network-changed:11865c88-bab8-4b1b-af2e-a51d5befe968 for instance 258bc0cb-6718-4f8b-8d0b-ef544b2b659b on n-h1-860284-1 Oct 04 21:44:27.263391 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-690915a2-72f5-4152-b2e0-1d5b3cdbbe0a req-880a3439-20c7-4199-8392-acf288750951 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095423 Oct 04 21:44:27.266667 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 192/393] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:44:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:44:27.287342 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-ddf73182-6e6e-4aee-9dea-4a61b67181c6 tempest-FlavorsAccessNegativeTestJSON-1458998978 tempest-FlavorsAccessNegativeTestJSON-1458998978-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "8a7bad847b7b43a3bab22eafe6aa648a"}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:44:27.416491 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-7714f05b-77ca-4836-a5d2-75d5e44dc6a6 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1789bb97219a4e1591632126812ea6df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da67fc95e2814f4086df020f4c475764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:44:27.431763 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-7714f05b-77ca-4836-a5d2-75d5e44dc6a6 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] 10.222.0.43 "GET /compute/v2.1/servers/c7b7e541-aa71-44f6-96fb-07c2e6e08520" status: 200 len: 1389 microversion: 2.1 time: 0.347709 Oct 04 21:44:27.435737 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 202/394] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:44:27 2022] GET /compute/v2.1/servers/c7b7e541-aa71-44f6-96fb-07c2e6e08520 => generated 1389 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:44:27.448096 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-63a41f74-78e5-4fc7-bbf2-a98f973e9b18 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:27.449316 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-63a41f74-78e5-4fc7-bbf2-a98f973e9b18 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: ec437ce7-b43a-4c8b-8a06-756cfb877851] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:27.463080 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-63a41f74-78e5-4fc7-bbf2-a98f973e9b18 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:27.468744 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-63a41f74-78e5-4fc7-bbf2-a98f973e9b18 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:27.469508 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-63a41f74-78e5-4fc7-bbf2-a98f973e9b18 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:27.470576 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-63a41f74-78e5-4fc7-bbf2-a98f973e9b18 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:27.472263 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-63a41f74-78e5-4fc7-bbf2-a98f973e9b18 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:27.472951 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-63a41f74-78e5-4fc7-bbf2-a98f973e9b18 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:27.880691 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-ddf73182-6e6e-4aee-9dea-4a61b67181c6 tempest-FlavorsAccessNegativeTestJSON-1458998978 tempest-FlavorsAccessNegativeTestJSON-1458998978-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors/581736423/action" status: 200 len: 96 microversion: 2.1 time: 0.611256 Oct 04 21:44:27.888466 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 193/395] 10.222.0.43 () {60 vars in 1197 bytes} [Tue Oct 4 21:44:27 2022] POST /compute/v2.1/flavors/581736423/action => generated 96 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 21:44:27.899150 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-7451ea2c-3dce-4e23-b9b0-fe87d3ac7367 tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:27.900904 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-7451ea2c-3dce-4e23-b9b0-fe87d3ac7367 tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] [instance: 3eeb7190-8e00-4c8c-bfd7-a15da2a3e376] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:27.911925 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7451ea2c-3dce-4e23-b9b0-fe87d3ac7367 tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:27.912857 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7451ea2c-3dce-4e23-b9b0-fe87d3ac7367 tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:27.913561 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7451ea2c-3dce-4e23-b9b0-fe87d3ac7367 tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:27.915297 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7451ea2c-3dce-4e23-b9b0-fe87d3ac7367 tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:27.915947 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7451ea2c-3dce-4e23-b9b0-fe87d3ac7367 tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:27.916589 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7451ea2c-3dce-4e23-b9b0-fe87d3ac7367 tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:27.935006 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-63a41f74-78e5-4fc7-bbf2-a98f973e9b18 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:44:27.946411 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-63a41f74-78e5-4fc7-bbf2-a98f973e9b18 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/ec437ce7-b43a-4c8b-8a06-756cfb877851" status: 200 len: 1477 microversion: 2.1 time: 0.509158 Oct 04 21:44:27.966020 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 203/396] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:44:27 2022] GET /compute/v2.1/servers/ec437ce7-b43a-4c8b-8a06-756cfb877851 => generated 1477 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:44:27.976101 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-50b58e87-c5c9-465d-bd2f-bc01d7106b43 req-6e8406e3-2d3c-4657-abbf-c699108deb04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7b7e541-aa71-44f6-96fb-07c2e6e08520", "name": "network-vif-plugged", "status": "completed", "tag": "7e3bac17-bb02-4dee-99d3-79bc4e2aa285"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:44:27.997681 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-50b58e87-c5c9-465d-bd2f-bc01d7106b43 req-6e8406e3-2d3c-4657-abbf-c699108deb04 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:28.003903 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-50b58e87-c5c9-465d-bd2f-bc01d7106b43 req-6e8406e3-2d3c-4657-abbf-c699108deb04 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:28.004672 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-50b58e87-c5c9-465d-bd2f-bc01d7106b43 req-6e8406e3-2d3c-4657-abbf-c699108deb04 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:28.056347 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-50b58e87-c5c9-465d-bd2f-bc01d7106b43 req-6e8406e3-2d3c-4657-abbf-c699108deb04 service nova] Creating event network-vif-plugged:7e3bac17-bb02-4dee-99d3-79bc4e2aa285 for instance c7b7e541-aa71-44f6-96fb-07c2e6e08520 on n-h1-860284-1 Oct 04 21:44:28.061866 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-50b58e87-c5c9-465d-bd2f-bc01d7106b43 req-6e8406e3-2d3c-4657-abbf-c699108deb04 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093849 Oct 04 21:44:28.063019 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 204/397] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:44:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:44:28.069557 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-fec23e45-b8cf-4938-b59a-fd1018401b21 tempest-FlavorsAccessNegativeTestJSON-1458998978 tempest-FlavorsAccessNegativeTestJSON-1458998978-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "8a7bad847b7b43a3bab22eafe6aa648a"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:44:28.192888 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-7451ea2c-3dce-4e23-b9b0-fe87d3ac7367 tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539a93c63ab34b789903970b57b96bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8179a9b323b74a789fa7d5a4507cb6b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:44:28.206172 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-7451ea2c-3dce-4e23-b9b0-fe87d3ac7367 tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] 10.222.0.43 "GET /compute/v2.1/servers/3eeb7190-8e00-4c8c-bfd7-a15da2a3e376" status: 200 len: 1323 microversion: 2.1 time: 0.313801 Oct 04 21:44:28.207102 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 194/398] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:44:27 2022] GET /compute/v2.1/servers/3eeb7190-8e00-4c8c-bfd7-a15da2a3e376 => generated 1323 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:44:28.231240 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-d0fc1bf8-f82a-4dbd-ab76-a92439d6b7df tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:28.231860 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-d0fc1bf8-f82a-4dbd-ab76-a92439d6b7df tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] [instance: 80d8aacc-cde5-4451-8697-054eefe15849] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:28.249898 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d0fc1bf8-f82a-4dbd-ab76-a92439d6b7df tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:28.250695 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d0fc1bf8-f82a-4dbd-ab76-a92439d6b7df tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:28.251282 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d0fc1bf8-f82a-4dbd-ab76-a92439d6b7df tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:28.252317 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d0fc1bf8-f82a-4dbd-ab76-a92439d6b7df tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:28.252626 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d0fc1bf8-f82a-4dbd-ab76-a92439d6b7df tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:28.253033 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d0fc1bf8-f82a-4dbd-ab76-a92439d6b7df tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:28.319652 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d0fc1bf8-f82a-4dbd-ab76-a92439d6b7df tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:28.324102 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d0fc1bf8-f82a-4dbd-ab76-a92439d6b7df tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:28.324772 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d0fc1bf8-f82a-4dbd-ab76-a92439d6b7df tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:28.327606 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.objects.instance [None req-d0fc1bf8-f82a-4dbd-ab76-a92439d6b7df tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lazy-loading 'fault' on Instance uuid 80d8aacc-cde5-4451-8697-054eefe15849 {{(pid=134102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:44:28.342314 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=100 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:44:28.366691 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-fec23e45-b8cf-4938-b59a-fd1018401b21 tempest-FlavorsAccessNegativeTestJSON-1458998978 tempest-FlavorsAccessNegativeTestJSON-1458998978-project-admin] HTTP exception thrown: Flavor access already exists for flavor 31 and project 8a7bad847b7b43a3bab22eafe6aa648a combination. Oct 04 21:44:28.371649 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-fec23e45-b8cf-4938-b59a-fd1018401b21 tempest-FlavorsAccessNegativeTestJSON-1458998978 tempest-FlavorsAccessNegativeTestJSON-1458998978-project-admin] Request method failure captured: Oct 04 21:44:28.371649 n-d-860284-1 devstack@n-api.service[134101]: request: POST /compute/v2.1/flavors/581736423/action HTTP/1.1 Oct 04 21:44:28.371649 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 21:44:28.371649 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 21:44:28.371649 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 21:44:28.371649 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 67 Oct 04 21:44:28.371649 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 21:44:28.371649 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 21:44:28.371649 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 21:44:28.371649 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 21:44:28.371649 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPKk5-kRy9Z6FgQyATsRM-m9SyvoeS3jAFg5pX1X_tz_TFr9Hu7H342-EQOGnNli37fgWORV9y5C2cbPBuzbgbMl8WUgEZTez5hZ7FLQErd9AG1-PmekPXi-g-7KomcUS1ehyfVoIXERnup_pjk3Cn0m3F-pZwrRf-5piHgoCmPI50qo Oct 04 21:44:28.371649 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 21:44:28.371649 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 21:44:28.371649 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 21:44:28.371649 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 21:44:28.371649 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 21:44:28.371649 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 21:44:28.371649 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: 48606a488d57418997eaa5f743c37acf Oct 04 21:44:28.371649 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1458998978 Oct 04 21:44:28.371649 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,admin,member Oct 04 21:44:28.371649 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,admin,member Oct 04 21:44:28.373164 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/48606a488d57418997eaa5f743c37acf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_48606a488d57418997eaa5f743c37acf", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/48606a488d57418997eaa5f743c37acf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/48606a488d57418997eaa5f743c37acf"}]}] Oct 04 21:44:28.373164 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1458998978 Oct 04 21:44:28.373164 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: 48606a488d57418997eaa5f743c37acf Oct 04 21:44:28.373164 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1458998978 Oct 04 21:44:28.373164 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-FlavorsAccessNegativeTestJSON-1458998978-project-admin Oct 04 21:44:28.373164 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 21:44:28.373164 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 21:44:28.373164 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: f17889587d034122880f21cfb6a9c517 Oct 04 21:44:28.373164 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1458998978-project-admin Oct 04 21:44:28.373164 n-d-860284-1 devstack@n-api.service[134101]: Oct 04 21:44:28.373164 n-d-860284-1 devstack@n-api.service[134101]: {"addTenantAccess": {"tenant": "8a7bad847b7b43a3bab22eafe6aa648a"}} Oct 04 21:44:28.373164 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 21:44:28.373845 n-d-860284-1 devstack@n-api.service[134101]: exception: Flavor access already exists for flavor 31 and project 8a7bad847b7b43a3bab22eafe6aa648a combination. Oct 04 21:44:28.373845 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': '581736423', 'body': {'addTenantAccess': {'tenant': '8a7bad847b7b43a3bab22eafe6aa648a'}}} Oct 04 21:44:28.373845 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:44:28.373845 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:44:28.373845 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 04 21:44:28.373845 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 04 21:44:28.373845 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 04 21:44:28.373845 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 04 21:44:28.373845 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 04 21:44:28.373845 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 04 21:44:28.373845 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 04 21:44:28.373845 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 04 21:44:28.373845 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 04 21:44:28.373845 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 04 21:44:28.373845 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 04 21:44:28.373845 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi result.read() Oct 04 21:44:28.373845 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 04 21:44:28.373845 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 04 21:44:28.374915 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 04 21:44:28.374915 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 04 21:44:28.374915 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 04 21:44:28.374915 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 04 21:44:28.374915 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 04 21:44:28.374915 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 04 21:44:28.374915 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '31-8a7bad847b7b43a3bab22eafe6aa648a' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Oct 04 21:44:28.374915 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:44:28.374915 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 04 21:44:28.374915 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:44:28.374915 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:44:28.374915 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project Oct 04 21:44:28.374915 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi project.save(context.session) Oct 04 21:44:28.374915 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 04 21:44:28.374915 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi session.flush() Oct 04 21:44:28.374915 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 04 21:44:28.374915 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 04 21:44:28.374915 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 04 21:44:28.374915 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 04 21:44:28.375956 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 04 21:44:28.375956 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 04 21:44:28.375956 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 04 21:44:28.375956 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception Oct 04 21:44:28.375956 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 04 21:44:28.375956 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 04 21:44:28.375956 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 04 21:44:28.375956 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 04 21:44:28.375956 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 04 21:44:28.375956 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 04 21:44:28.375956 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 04 21:44:28.375956 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 04 21:44:28.375956 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 04 21:44:28.375956 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 04 21:44:28.375956 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 04 21:44:28.375956 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 04 21:44:28.375956 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 04 21:44:28.375956 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 04 21:44:28.379037 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 04 21:44:28.379037 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 04 21:44:28.379037 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 04 21:44:28.379037 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 04 21:44:28.379037 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 04 21:44:28.379037 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 04 21:44:28.379037 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 04 21:44:28.379037 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception Oct 04 21:44:28.379037 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 04 21:44:28.379037 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 04 21:44:28.379037 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 04 21:44:28.379037 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 04 21:44:28.379037 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 04 21:44:28.379037 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 04 21:44:28.379037 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 04 21:44:28.379037 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 04 21:44:28.379037 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 04 21:44:28.379037 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 04 21:44:28.381339 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 04 21:44:28.381339 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi result.read() Oct 04 21:44:28.381339 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 04 21:44:28.381339 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 04 21:44:28.381339 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 04 21:44:28.381339 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 04 21:44:28.381339 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 04 21:44:28.381339 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 04 21:44:28.381339 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 04 21:44:28.381339 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 04 21:44:28.381339 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '31-8a7bad847b7b43a3bab22eafe6aa648a' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Oct 04 21:44:28.381339 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] Oct 04 21:44:28.381339 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 4, 21, 44, 28, 360812), 'updated_at': None, 'flavor_id': 31, 'project_id': '8a7bad847b7b43a3bab22eafe6aa648a'}] Oct 04 21:44:28.381339 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 04 21:44:28.381339 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:44:28.381339 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:44:28.381339 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:44:28.384525 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:44:28.384525 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access Oct 04 21:44:28.384525 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) Oct 04 21:44:28.384525 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 04 21:44:28.384525 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 04 21:44:28.384525 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access Oct 04 21:44:28.384525 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi self._add_access(project_id) Oct 04 21:44:28.384525 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access Oct 04 21:44:28.384525 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) Oct 04 21:44:28.384525 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project Oct 04 21:44:28.384525 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) Oct 04 21:44:28.384525 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 21:44:28.384525 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 21:44:28.384525 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project Oct 04 21:44:28.384525 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, Oct 04 21:44:28.384525 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 31 and project 8a7bad847b7b43a3bab22eafe6aa648a combination. Oct 04 21:44:28.384525 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:44:28.384525 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:44:28.384525 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:44:28.387997 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:44:28.387997 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:44:28.387997 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:44:28.387997 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:44:28.387997 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:44:28.387997 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:44:28.387997 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:44:28.387997 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:44:28.387997 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:44:28.387997 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access Oct 04 21:44:28.387997 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) Oct 04 21:44:28.387997 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 31 and project 8a7bad847b7b43a3bab22eafe6aa648a combination. Oct 04 21:44:28.387997 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:44:28.387997 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:44:28.387997 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:44:28.387997 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:44:28.387997 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:44:28.387997 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:44:28.387997 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:44:28.387997 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:44:28.392636 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 31 and project 8a7bad847b7b43a3bab22eafe6aa648a combination. Oct 04 21:44:28.392636 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:44:28.394614 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-fec23e45-b8cf-4938-b59a-fd1018401b21 tempest-FlavorsAccessNegativeTestJSON-1458998978 tempest-FlavorsAccessNegativeTestJSON-1458998978-project-admin] Returning 409 to user: Flavor access already exists for flavor 31 and project 8a7bad847b7b43a3bab22eafe6aa648a combination. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:44:28.398848 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-fec23e45-b8cf-4938-b59a-fd1018401b21 tempest-FlavorsAccessNegativeTestJSON-1458998978 tempest-FlavorsAccessNegativeTestJSON-1458998978-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors/581736423/action" status: 409 len: 152 microversion: 2.1 time: 0.333538 Oct 04 21:44:28.403888 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 205/399] 10.222.0.43 () {60 vars in 1197 bytes} [Tue Oct 4 21:44:28 2022] POST /compute/v2.1/flavors/581736423/action => generated 152 bytes in 340 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 21:44:28.412380 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-80be3dd8-00b1-46f7-8c25-6b99b368364a tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:28.413766 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-80be3dd8-00b1-46f7-8c25-6b99b368364a tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] [instance: 258bc0cb-6718-4f8b-8d0b-ef544b2b659b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:28.421790 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-80be3dd8-00b1-46f7-8c25-6b99b368364a tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:28.422622 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-80be3dd8-00b1-46f7-8c25-6b99b368364a tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:28.423223 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-80be3dd8-00b1-46f7-8c25-6b99b368364a tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:28.424248 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-80be3dd8-00b1-46f7-8c25-6b99b368364a tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:28.425768 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-80be3dd8-00b1-46f7-8c25-6b99b368364a tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:28.426802 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-80be3dd8-00b1-46f7-8c25-6b99b368364a tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:28.798049 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-80be3dd8-00b1-46f7-8c25-6b99b368364a tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29842a669a20408b881105135f76cb0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39edf587afe94b60911198aa0bb61613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:44:28.806447 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-80be3dd8-00b1-46f7-8c25-6b99b368364a tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] 10.222.0.43 "GET /compute/v2.1/servers/258bc0cb-6718-4f8b-8d0b-ef544b2b659b" status: 200 len: 1317 microversion: 2.1 time: 0.400940 Oct 04 21:44:28.807052 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 206/400] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:44:28 2022] GET /compute/v2.1/servers/258bc0cb-6718-4f8b-8d0b-ef544b2b659b => generated 1317 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:44:28.820140 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e726684d-8cc9-4196-873f-1cf13c655ff1 tempest-FlavorsAccessNegativeTestJSON-1458998978 tempest-FlavorsAccessNegativeTestJSON-1458998978-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "8a7bad847b7b43a3bab22eafe6aa648a"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:44:28.832752 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-d0fc1bf8-f82a-4dbd-ab76-a92439d6b7df tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5387dbf4e24960809704c398fe999a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bedc0e10ab24824a40d06bb91626088', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:44:28.848020 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-d0fc1bf8-f82a-4dbd-ab76-a92439d6b7df tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] 10.222.0.43 "GET /compute/v2.1/servers/80d8aacc-cde5-4451-8697-054eefe15849" status: 200 len: 1457 microversion: 2.1 time: 0.620480 Oct 04 21:44:28.849861 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 195/401] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:44:28 2022] GET /compute/v2.1/servers/80d8aacc-cde5-4451-8697-054eefe15849 => generated 1457 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:44:28.865633 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-209af42d-c2a2-4197-b973-23450d9ea402 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:28.866274 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-209af42d-c2a2-4197-b973-23450d9ea402 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] [instance: c7b7e541-aa71-44f6-96fb-07c2e6e08520] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:28.879550 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-209af42d-c2a2-4197-b973-23450d9ea402 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:28.880534 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-209af42d-c2a2-4197-b973-23450d9ea402 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:28.880976 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-209af42d-c2a2-4197-b973-23450d9ea402 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:28.883398 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-209af42d-c2a2-4197-b973-23450d9ea402 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:28.887313 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-209af42d-c2a2-4197-b973-23450d9ea402 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:28.887964 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-209af42d-c2a2-4197-b973-23450d9ea402 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:29.154005 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-e726684d-8cc9-4196-873f-1cf13c655ff1 tempest-FlavorsAccessNegativeTestJSON-1458998978 tempest-FlavorsAccessNegativeTestJSON-1458998978-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors/581736423/action" status: 200 len: 21 microversion: 2.1 time: 0.345863 Oct 04 21:44:29.155062 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 207/402] 10.222.0.43 () {60 vars in 1197 bytes} [Tue Oct 4 21:44:28 2022] POST /compute/v2.1/flavors/581736423/action => generated 21 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 21:44:29.169237 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-186c57a8-7178-4e76-83e8-1c585285c265 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:29.170224 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-186c57a8-7178-4e76-83e8-1c585285c265 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: ec437ce7-b43a-4c8b-8a06-756cfb877851] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:29.177709 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-209af42d-c2a2-4197-b973-23450d9ea402 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1789bb97219a4e1591632126812ea6df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da67fc95e2814f4086df020f4c475764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:44:29.186210 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-186c57a8-7178-4e76-83e8-1c585285c265 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:29.187143 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-186c57a8-7178-4e76-83e8-1c585285c265 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:29.187803 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-186c57a8-7178-4e76-83e8-1c585285c265 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:29.190918 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-209af42d-c2a2-4197-b973-23450d9ea402 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] 10.222.0.43 "GET /compute/v2.1/servers/c7b7e541-aa71-44f6-96fb-07c2e6e08520" status: 200 len: 1389 microversion: 2.1 time: 0.339820 Oct 04 21:44:29.191583 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-186c57a8-7178-4e76-83e8-1c585285c265 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:29.192268 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-186c57a8-7178-4e76-83e8-1c585285c265 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:29.192910 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-186c57a8-7178-4e76-83e8-1c585285c265 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:29.193570 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 196/403] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:44:28 2022] GET /compute/v2.1/servers/c7b7e541-aa71-44f6-96fb-07c2e6e08520 => generated 1389 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:44:29.213839 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-1a202637-1139-4c3f-b697-20cca8ea71c0 tempest-FlavorsAccessNegativeTestJSON-1458998978 tempest-FlavorsAccessNegativeTestJSON-1458998978-project-admin] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:29.261203 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-1a202637-1139-4c3f-b697-20cca8ea71c0 tempest-FlavorsAccessNegativeTestJSON-1458998978 tempest-FlavorsAccessNegativeTestJSON-1458998978-project-admin] 10.222.0.43 "DELETE /compute/v2.1/flavors/581736423" status: 202 len: 0 microversion: 2.1 time: 0.060438 Oct 04 21:44:29.263456 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 197/404] 10.222.0.43 () {58 vars in 1158 bytes} [Tue Oct 4 21:44:29 2022] DELETE /compute/v2.1/flavors/581736423 => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:44:29.275331 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-11dc9022-b590-4a7f-8fff-c2ca53228d0f tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:29.276946 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-11dc9022-b590-4a7f-8fff-c2ca53228d0f tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] [instance: 3eeb7190-8e00-4c8c-bfd7-a15da2a3e376] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:29.294876 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-11dc9022-b590-4a7f-8fff-c2ca53228d0f tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:29.295369 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-11dc9022-b590-4a7f-8fff-c2ca53228d0f tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:29.295802 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-11dc9022-b590-4a7f-8fff-c2ca53228d0f tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:29.309070 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-11dc9022-b590-4a7f-8fff-c2ca53228d0f tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:29.309801 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-11dc9022-b590-4a7f-8fff-c2ca53228d0f tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:29.310424 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-11dc9022-b590-4a7f-8fff-c2ca53228d0f tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:29.500675 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-186c57a8-7178-4e76-83e8-1c585285c265 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:44:29.516379 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-186c57a8-7178-4e76-83e8-1c585285c265 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/ec437ce7-b43a-4c8b-8a06-756cfb877851" status: 200 len: 1477 microversion: 2.1 time: 0.357254 Oct 04 21:44:29.517602 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 208/405] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:44:29 2022] GET /compute/v2.1/servers/ec437ce7-b43a-4c8b-8a06-756cfb877851 => generated 1477 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:44:29.537280 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-27edc592-44a2-4eeb-965d-90c05d9aa5ca tempest-FlavorsAccessNegativeTestJSON-1458998978 tempest-FlavorsAccessNegativeTestJSON-1458998978-project-admin] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:29.581622 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-27edc592-44a2-4eeb-965d-90c05d9aa5ca tempest-FlavorsAccessNegativeTestJSON-1458998978 tempest-FlavorsAccessNegativeTestJSON-1458998978-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 5821 microversion: 2.1 time: 0.062621 Oct 04 21:44:29.597466 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 209/406] 10.222.0.43 () {58 vars in 1146 bytes} [Tue Oct 4 21:44:29 2022] GET /compute/v2.1/flavors/detail => generated 5821 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:44:29.603662 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-55403bfb-ee5a-420b-8afc-38a1e5af4a07 tempest-FlavorsAccessNegativeTestJSON-1458998978 tempest-FlavorsAccessNegativeTestJSON-1458998978-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1350547298", "id": 172101864, "os-flavor-access:is_public": "True"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:44:29.625778 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-55403bfb-ee5a-420b-8afc-38a1e5af4a07 tempest-FlavorsAccessNegativeTestJSON-1458998978 tempest-FlavorsAccessNegativeTestJSON-1458998978-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.026054 Oct 04 21:44:29.635040 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 210/407] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 21:44:29 2022] POST /compute/v2.1/flavors => generated 435 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:44:29.641008 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-62f42299-2705-4e35-90c8-a14d2cf3acb5 tempest-FlavorsAccessNegativeTestJSON-1458998978 tempest-FlavorsAccessNegativeTestJSON-1458998978-project-admin] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:29.650871 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-62f42299-2705-4e35-90c8-a14d2cf3acb5 tempest-FlavorsAccessNegativeTestJSON-1458998978 tempest-FlavorsAccessNegativeTestJSON-1458998978-project-admin] HTTP exception thrown: Access list not available for public flavors. Oct 04 21:44:29.652536 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-62f42299-2705-4e35-90c8-a14d2cf3acb5 tempest-FlavorsAccessNegativeTestJSON-1458998978 tempest-FlavorsAccessNegativeTestJSON-1458998978-project-admin] Request method failure captured: Oct 04 21:44:29.652536 n-d-860284-1 devstack@n-api.service[134101]: request: GET /compute/v2.1/flavors/172101864/os-flavor-access HTTP/1.1 Oct 04 21:44:29.652536 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 21:44:29.652536 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 21:44:29.652536 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 21:44:29.652536 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 21:44:29.652536 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 21:44:29.652536 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 21:44:29.652536 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 21:44:29.652536 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 21:44:29.652536 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPKk5-kRy9Z6FgQyATsRM-m9SyvoeS3jAFg5pX1X_tz_TFr9Hu7H342-EQOGnNli37fgWORV9y5C2cbPBuzbgbMl8WUgEZTez5hZ7FLQErd9AG1-PmekPXi-g-7KomcUS1ehyfVoIXERnup_pjk3Cn0m3F-pZwrRf-5piHgoCmPI50qo Oct 04 21:44:29.652536 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 21:44:29.652536 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 21:44:29.652536 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 21:44:29.652536 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 21:44:29.652536 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 21:44:29.652536 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 21:44:29.652536 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: 48606a488d57418997eaa5f743c37acf Oct 04 21:44:29.652536 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1458998978 Oct 04 21:44:29.652536 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,admin,member Oct 04 21:44:29.652536 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,admin,member Oct 04 21:44:29.653981 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/48606a488d57418997eaa5f743c37acf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_48606a488d57418997eaa5f743c37acf", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/48606a488d57418997eaa5f743c37acf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/48606a488d57418997eaa5f743c37acf"}]}] Oct 04 21:44:29.653981 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1458998978 Oct 04 21:44:29.653981 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: 48606a488d57418997eaa5f743c37acf Oct 04 21:44:29.653981 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1458998978 Oct 04 21:44:29.653981 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-FlavorsAccessNegativeTestJSON-1458998978-project-admin Oct 04 21:44:29.653981 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 21:44:29.653981 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 21:44:29.653981 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: f17889587d034122880f21cfb6a9c517 Oct 04 21:44:29.653981 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1458998978-project-admin Oct 04 21:44:29.653981 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 21:44:29.653981 n-d-860284-1 devstack@n-api.service[134101]: exception: Access list not available for public flavors. Oct 04 21:44:29.653981 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'flavor_id': '172101864'} Oct 04 21:44:29.654846 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:44:29.654846 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:44:29.654846 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:44:29.654846 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:44:29.654846 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:44:29.654846 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:44:29.654846 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:44:29.654846 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:44:29.654846 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index Oct 04 21:44:29.654846 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 21:44:29.654846 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. Oct 04 21:44:29.654846 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:44:29.654846 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:44:29.654846 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:44:29.654846 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:44:29.654846 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:44:29.654846 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:44:29.654846 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:44:29.654846 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:44:29.654846 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. Oct 04 21:44:29.654846 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:44:29.657042 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-62f42299-2705-4e35-90c8-a14d2cf3acb5 tempest-FlavorsAccessNegativeTestJSON-1458998978 tempest-FlavorsAccessNegativeTestJSON-1458998978-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:44:29.658195 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-62f42299-2705-4e35-90c8-a14d2cf3acb5 tempest-FlavorsAccessNegativeTestJSON-1458998978 tempest-FlavorsAccessNegativeTestJSON-1458998978-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/172101864/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.021605 Oct 04 21:44:29.659332 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 211/408] 10.222.0.43 () {58 vars in 1206 bytes} [Tue Oct 4 21:44:29 2022] GET /compute/v2.1/flavors/172101864/os-flavor-access => generated 91 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 21:44:29.665735 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-74e57797-176a-4633-b459-3bcd07612c5c req-daee60d7-63aa-4346-a55a-71607d63259b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3eeb7190-8e00-4c8c-bfd7-a15da2a3e376", "tag": "c805f382-dbdb-446f-8642-d9c2c0cecea8"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:44:29.677478 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-74e57797-176a-4633-b459-3bcd07612c5c req-daee60d7-63aa-4346-a55a-71607d63259b service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:29.678051 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-74e57797-176a-4633-b459-3bcd07612c5c req-daee60d7-63aa-4346-a55a-71607d63259b service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:29.678626 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-74e57797-176a-4633-b459-3bcd07612c5c req-daee60d7-63aa-4346-a55a-71607d63259b service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:29.690459 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-74e57797-176a-4633-b459-3bcd07612c5c req-daee60d7-63aa-4346-a55a-71607d63259b service nova] Creating event network-changed:c805f382-dbdb-446f-8642-d9c2c0cecea8 for instance 3eeb7190-8e00-4c8c-bfd7-a15da2a3e376 on n-h2-860284-1 Oct 04 21:44:29.698894 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-74e57797-176a-4633-b459-3bcd07612c5c req-daee60d7-63aa-4346-a55a-71607d63259b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037934 Oct 04 21:44:29.699568 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 212/409] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:44:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:44:29.716365 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-b2728533-78af-4570-98f7-821366b45f30 tempest-FlavorsAccessNegativeTestJSON-1458998978 tempest-FlavorsAccessNegativeTestJSON-1458998978-project-admin] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:29.753834 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-b2728533-78af-4570-98f7-821366b45f30 tempest-FlavorsAccessNegativeTestJSON-1458998978 tempest-FlavorsAccessNegativeTestJSON-1458998978-project-admin] 10.222.0.43 "DELETE /compute/v2.1/flavors/172101864" status: 202 len: 0 microversion: 2.1 time: 0.049453 Oct 04 21:44:29.763803 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 213/410] 10.222.0.43 () {58 vars in 1158 bytes} [Tue Oct 4 21:44:29 2022] DELETE /compute/v2.1/flavors/172101864 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:44:29.772711 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-4d15813c-2113-4b39-a473-9cd3339d1530 tempest-FlavorsAccessNegativeTestJSON-1458998978 tempest-FlavorsAccessNegativeTestJSON-1458998978-project-admin] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:29.824228 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-4d15813c-2113-4b39-a473-9cd3339d1530 tempest-FlavorsAccessNegativeTestJSON-1458998978 tempest-FlavorsAccessNegativeTestJSON-1458998978-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 5821 microversion: 2.1 time: 0.063360 Oct 04 21:44:29.824894 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 214/411] 10.222.0.43 () {58 vars in 1146 bytes} [Tue Oct 4 21:44:29 2022] GET /compute/v2.1/flavors/detail => generated 5821 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:44:29.834830 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-69ace71a-3aaf-4982-b727-7f016e530d81 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:29.835627 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-69ace71a-3aaf-4982-b727-7f016e530d81 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] [instance: 258bc0cb-6718-4f8b-8d0b-ef544b2b659b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:29.856479 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-69ace71a-3aaf-4982-b727-7f016e530d81 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:29.856977 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-69ace71a-3aaf-4982-b727-7f016e530d81 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:29.857622 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-69ace71a-3aaf-4982-b727-7f016e530d81 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:29.858579 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-69ace71a-3aaf-4982-b727-7f016e530d81 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:29.859194 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-69ace71a-3aaf-4982-b727-7f016e530d81 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:29.859779 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-69ace71a-3aaf-4982-b727-7f016e530d81 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:29.898024 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-11dc9022-b590-4a7f-8fff-c2ca53228d0f tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539a93c63ab34b789903970b57b96bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8179a9b323b74a789fa7d5a4507cb6b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:44:29.908245 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-11dc9022-b590-4a7f-8fff-c2ca53228d0f tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] 10.222.0.43 "GET /compute/v2.1/servers/3eeb7190-8e00-4c8c-bfd7-a15da2a3e376" status: 200 len: 1323 microversion: 2.1 time: 0.643510 Oct 04 21:44:29.911026 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 198/412] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:44:29 2022] GET /compute/v2.1/servers/3eeb7190-8e00-4c8c-bfd7-a15da2a3e376 => generated 1323 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:44:29.928471 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-975e7498-cebc-438b-bb79-fb77b654247d tempest-FlavorsAccessNegativeTestJSON-1458998978 tempest-FlavorsAccessNegativeTestJSON-1458998978-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-548771280", "id": 767335391, "os-flavor-access:is_public": "False"}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:44:29.987223 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-975e7498-cebc-438b-bb79-fb77b654247d tempest-FlavorsAccessNegativeTestJSON-1458998978 tempest-FlavorsAccessNegativeTestJSON-1458998978-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.074704 Oct 04 21:44:29.997859 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 199/413] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 21:44:29 2022] POST /compute/v2.1/flavors => generated 435 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:44:30.003932 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-801c7eb5-8d2d-4723-bc00-66b16a9842fe tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:30.004607 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-801c7eb5-8d2d-4723-bc00-66b16a9842fe tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] [instance: 80d8aacc-cde5-4451-8697-054eefe15849] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:30.012964 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-801c7eb5-8d2d-4723-bc00-66b16a9842fe tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:30.013426 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-801c7eb5-8d2d-4723-bc00-66b16a9842fe tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:30.013872 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-801c7eb5-8d2d-4723-bc00-66b16a9842fe tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:30.014675 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-801c7eb5-8d2d-4723-bc00-66b16a9842fe tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:30.015199 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-801c7eb5-8d2d-4723-bc00-66b16a9842fe tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:30.015628 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-801c7eb5-8d2d-4723-bc00-66b16a9842fe tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:30.066465 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-801c7eb5-8d2d-4723-bc00-66b16a9842fe tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:30.067344 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-801c7eb5-8d2d-4723-bc00-66b16a9842fe tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:30.068087 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-801c7eb5-8d2d-4723-bc00-66b16a9842fe tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:30.068728 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.objects.instance [None req-801c7eb5-8d2d-4723-bc00-66b16a9842fe tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lazy-loading 'fault' on Instance uuid 80d8aacc-cde5-4451-8697-054eefe15849 {{(pid=134102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:44:30.727238 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-69ace71a-3aaf-4982-b727-7f016e530d81 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29842a669a20408b881105135f76cb0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39edf587afe94b60911198aa0bb61613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:44:30.739204 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-69ace71a-3aaf-4982-b727-7f016e530d81 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] 10.222.0.43 "GET /compute/v2.1/servers/258bc0cb-6718-4f8b-8d0b-ef544b2b659b" status: 200 len: 1317 microversion: 2.1 time: 0.908047 Oct 04 21:44:30.755184 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 215/414] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:44:29 2022] GET /compute/v2.1/servers/258bc0cb-6718-4f8b-8d0b-ef544b2b659b => generated 1317 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:44:30.970666 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-801c7eb5-8d2d-4723-bc00-66b16a9842fe tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5387dbf4e24960809704c398fe999a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bedc0e10ab24824a40d06bb91626088', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:44:30.984657 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-801c7eb5-8d2d-4723-bc00-66b16a9842fe tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] 10.222.0.43 "GET /compute/v2.1/servers/80d8aacc-cde5-4451-8697-054eefe15849" status: 200 len: 1457 microversion: 2.1 time: 0.985598 Oct 04 21:44:30.985500 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 200/415] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:44:29 2022] GET /compute/v2.1/servers/80d8aacc-cde5-4451-8697-054eefe15849 => generated 1457 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:44:30.997723 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-2c848337-a68d-4729-97e3-d9e032054a08 tempest-FlavorsAccessNegativeTestJSON-1733968224 tempest-FlavorsAccessNegativeTestJSON-1733968224-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "8a7bad847b7b43a3bab22eafe6aa648a"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:44:31.004680 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-2c848337-a68d-4729-97e3-d9e032054a08 tempest-FlavorsAccessNegativeTestJSON-1733968224 tempest-FlavorsAccessNegativeTestJSON-1733968224-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': 'dfb83633f2714e2b855456b6e5823e0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7bad847b7b43a3bab22eafe6aa648a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:44:31.008126 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-2c848337-a68d-4729-97e3-d9e032054a08 tempest-FlavorsAccessNegativeTestJSON-1733968224 tempest-FlavorsAccessNegativeTestJSON-1733968224-project] Request method failure captured: Oct 04 21:44:31.008126 n-d-860284-1 devstack@n-api.service[134101]: request: POST /compute/v2.1/flavors/767335391/action HTTP/1.1 Oct 04 21:44:31.008126 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 21:44:31.008126 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 21:44:31.008126 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 21:44:31.008126 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 67 Oct 04 21:44:31.008126 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 21:44:31.008126 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 21:44:31.008126 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 21:44:31.008126 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 21:44:31.008126 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPKk4wHhke8TYNY-Csz46RKIYtry17v1295JH-cbqF7Pum8fMpPpb7uCQskxflRwl5fQyjAF7fE4O_78XfYIzR_ZAHTeJvSD2wM8rxPEOfUwqzK_8UBImN0dKYC_S5Y99FztzPEcfOHbB6irjWERpee1Udqjaxqh5_hsJ58YF-LkPkSY Oct 04 21:44:31.008126 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 21:44:31.008126 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 21:44:31.008126 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 21:44:31.008126 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 21:44:31.008126 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 21:44:31.008126 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 21:44:31.008126 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: 8a7bad847b7b43a3bab22eafe6aa648a Oct 04 21:44:31.008126 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1733968224 Oct 04 21:44:31.008126 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 21:44:31.008126 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 21:44:31.009581 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8a7bad847b7b43a3bab22eafe6aa648a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_8a7bad847b7b43a3bab22eafe6aa648a", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8a7bad847b7b43a3bab22eafe6aa648a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/8a7bad847b7b43a3bab22eafe6aa648a"}]}] Oct 04 21:44:31.009581 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1733968224 Oct 04 21:44:31.009581 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: 8a7bad847b7b43a3bab22eafe6aa648a Oct 04 21:44:31.009581 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1733968224 Oct 04 21:44:31.009581 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-FlavorsAccessNegativeTestJSON-1733968224-project Oct 04 21:44:31.009581 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 21:44:31.009581 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 21:44:31.009581 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: dfb83633f2714e2b855456b6e5823e0e Oct 04 21:44:31.009581 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1733968224-project Oct 04 21:44:31.009581 n-d-860284-1 devstack@n-api.service[134101]: Oct 04 21:44:31.009581 n-d-860284-1 devstack@n-api.service[134101]: {"addTenantAccess": {"tenant": "8a7bad847b7b43a3bab22eafe6aa648a"}} Oct 04 21:44:31.009581 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 21:44:31.010295 n-d-860284-1 devstack@n-api.service[134101]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 04 21:44:31.010295 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': '767335391', 'body': {'addTenantAccess': {'tenant': '8a7bad847b7b43a3bab22eafe6aa648a'}}} Oct 04 21:44:31.010295 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:44:31.010295 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:44:31.010295 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:44:31.010295 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:44:31.010295 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:44:31.010295 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:44:31.010295 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:44:31.010295 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:44:31.010295 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:44:31.010295 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:44:31.010295 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access Oct 04 21:44:31.010295 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) Oct 04 21:44:31.010295 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 21:44:31.010295 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 21:44:31.010295 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 21:44:31.010295 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 21:44:31.010295 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 21:44:31.011657 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 21:44:31.011657 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 21:44:31.011657 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 21:44:31.011657 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 21:44:31.011657 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 21:44:31.011657 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 21:44:31.011657 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 21:44:31.011657 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 21:44:31.011657 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 21:44:31.011657 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 04 21:44:31.011657 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:44:31.011657 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:44:31.011657 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:44:31.011657 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:44:31.011657 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:44:31.011657 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:44:31.011657 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 21:44:31.011657 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 21:44:31.011657 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 04 21:44:31.011657 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:44:31.014606 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-2c848337-a68d-4729-97e3-d9e032054a08 tempest-FlavorsAccessNegativeTestJSON-1733968224 tempest-FlavorsAccessNegativeTestJSON-1733968224-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:44:31.015044 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-d342b69a-e29b-464b-9c47-b65edae4f946 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:31.015662 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-d342b69a-e29b-464b-9c47-b65edae4f946 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] [instance: c7b7e541-aa71-44f6-96fb-07c2e6e08520] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:31.016734 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-2c848337-a68d-4729-97e3-d9e032054a08 tempest-FlavorsAccessNegativeTestJSON-1733968224 tempest-FlavorsAccessNegativeTestJSON-1733968224-project] 10.222.0.43 "POST /compute/v2.1/flavors/767335391/action" status: 403 len: 130 microversion: 2.1 time: 0.260332 Oct 04 21:44:31.017846 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 216/416] 10.222.0.43 () {60 vars in 1197 bytes} [Tue Oct 4 21:44:30 2022] POST /compute/v2.1/flavors/767335391/action => generated 130 bytes in 262 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:44:31.025403 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d342b69a-e29b-464b-9c47-b65edae4f946 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:31.025941 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d342b69a-e29b-464b-9c47-b65edae4f946 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:31.026595 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d342b69a-e29b-464b-9c47-b65edae4f946 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:31.027310 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d342b69a-e29b-464b-9c47-b65edae4f946 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:31.027491 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-813cffc0-43b5-4f29-a003-a6bfe8036a62 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:31.027772 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d342b69a-e29b-464b-9c47-b65edae4f946 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:31.028233 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d342b69a-e29b-464b-9c47-b65edae4f946 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:31.028658 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-813cffc0-43b5-4f29-a003-a6bfe8036a62 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: ec437ce7-b43a-4c8b-8a06-756cfb877851] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:31.042756 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-813cffc0-43b5-4f29-a003-a6bfe8036a62 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:31.044920 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-813cffc0-43b5-4f29-a003-a6bfe8036a62 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:31.045386 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-813cffc0-43b5-4f29-a003-a6bfe8036a62 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:31.046486 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-813cffc0-43b5-4f29-a003-a6bfe8036a62 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:31.047466 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-813cffc0-43b5-4f29-a003-a6bfe8036a62 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:31.047967 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-813cffc0-43b5-4f29-a003-a6bfe8036a62 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:31.536493 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-813cffc0-43b5-4f29-a003-a6bfe8036a62 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:44:31.553708 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-813cffc0-43b5-4f29-a003-a6bfe8036a62 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/ec437ce7-b43a-4c8b-8a06-756cfb877851" status: 200 len: 1477 microversion: 2.1 time: 0.534416 Oct 04 21:44:31.556792 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 217/417] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:44:31 2022] GET /compute/v2.1/servers/ec437ce7-b43a-4c8b-8a06-756cfb877851 => generated 1477 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:44:31.557195 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-d342b69a-e29b-464b-9c47-b65edae4f946 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1789bb97219a4e1591632126812ea6df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da67fc95e2814f4086df020f4c475764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:44:31.582118 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-f7f6fb49-0501-41a9-a4a9-734716ce48cf tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:31.582837 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-f7f6fb49-0501-41a9-a4a9-734716ce48cf tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] [instance: 3eeb7190-8e00-4c8c-bfd7-a15da2a3e376] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:31.589132 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-d342b69a-e29b-464b-9c47-b65edae4f946 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] 10.222.0.43 "GET /compute/v2.1/servers/c7b7e541-aa71-44f6-96fb-07c2e6e08520" status: 200 len: 1586 microversion: 2.1 time: 0.601970 Oct 04 21:44:31.592647 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 201/418] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:44:30 2022] GET /compute/v2.1/servers/c7b7e541-aa71-44f6-96fb-07c2e6e08520 => generated 1586 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:44:31.597729 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-358e705f-323b-473b-b5ee-0ba29dffbc5a tempest-FlavorsAccessNegativeTestJSON-1458998978 tempest-FlavorsAccessNegativeTestJSON-1458998978-project-admin] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:31.609311 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f7f6fb49-0501-41a9-a4a9-734716ce48cf tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:31.610128 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f7f6fb49-0501-41a9-a4a9-734716ce48cf tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:31.611392 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f7f6fb49-0501-41a9-a4a9-734716ce48cf tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:31.612634 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f7f6fb49-0501-41a9-a4a9-734716ce48cf tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:31.614821 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f7f6fb49-0501-41a9-a4a9-734716ce48cf tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:31.615815 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f7f6fb49-0501-41a9-a4a9-734716ce48cf tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:31.653313 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=6,nova_api:DELETE=5 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:44:31.665531 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-358e705f-323b-473b-b5ee-0ba29dffbc5a tempest-FlavorsAccessNegativeTestJSON-1458998978 tempest-FlavorsAccessNegativeTestJSON-1458998978-project-admin] 10.222.0.43 "DELETE /compute/v2.1/flavors/767335391" status: 202 len: 0 microversion: 2.1 time: 0.070991 Oct 04 21:44:31.677817 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 202/419] 10.222.0.43 () {58 vars in 1158 bytes} [Tue Oct 4 21:44:31 2022] DELETE /compute/v2.1/flavors/767335391 => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:44:31.709037 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-9ea8e29f-9a1b-4d1c-953e-a4c7a9767241 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:31.710168 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-9ea8e29f-9a1b-4d1c-953e-a4c7a9767241 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] [instance: c7b7e541-aa71-44f6-96fb-07c2e6e08520] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:31.735167 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9ea8e29f-9a1b-4d1c-953e-a4c7a9767241 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:31.737574 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9ea8e29f-9a1b-4d1c-953e-a4c7a9767241 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:31.738875 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9ea8e29f-9a1b-4d1c-953e-a4c7a9767241 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:31.740452 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9ea8e29f-9a1b-4d1c-953e-a4c7a9767241 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:31.741588 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9ea8e29f-9a1b-4d1c-953e-a4c7a9767241 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:31.743216 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9ea8e29f-9a1b-4d1c-953e-a4c7a9767241 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:31.852356 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell0:SELECT=19 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:44:31.906798 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell0:SELECT=53 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:44:31.945756 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-f7f6fb49-0501-41a9-a4a9-734716ce48cf tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539a93c63ab34b789903970b57b96bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8179a9b323b74a789fa7d5a4507cb6b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:44:31.953057 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-f7f6fb49-0501-41a9-a4a9-734716ce48cf tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] 10.222.0.43 "GET /compute/v2.1/servers/3eeb7190-8e00-4c8c-bfd7-a15da2a3e376" status: 200 len: 1323 microversion: 2.1 time: 0.376981 Oct 04 21:44:31.953884 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 218/420] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:44:31 2022] GET /compute/v2.1/servers/3eeb7190-8e00-4c8c-bfd7-a15da2a3e376 => generated 1323 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:44:31.958593 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-8dd06ce7-b1d1-455a-9c10-6d96dbb1dcd8 tempest-FlavorsAccessNegativeTestJSON-1458998978 tempest-FlavorsAccessNegativeTestJSON-1458998978-project-admin] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:31.987975 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-8dd06ce7-b1d1-455a-9c10-6d96dbb1dcd8 tempest-FlavorsAccessNegativeTestJSON-1458998978 tempest-FlavorsAccessNegativeTestJSON-1458998978-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 5821 microversion: 2.1 time: 0.032703 Oct 04 21:44:31.989517 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 219/421] 10.222.0.43 () {58 vars in 1146 bytes} [Tue Oct 4 21:44:31 2022] GET /compute/v2.1/flavors/detail => generated 5821 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:44:31.997817 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-ccb8e0c9-c20b-4f6e-bf26-3d45d231a66a req-35fa27ba-b9e4-4ff2-aceb-2526cb45f686 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d71d6d3-3a63-406b-ac49-3e83bd539cf9", "name": "network-vif-plugged", "status": "completed", "tag": "c9b71eee-ecc1-4326-bb8c-04bddb4cc35c"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:44:32.013359 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-ccb8e0c9-c20b-4f6e-bf26-3d45d231a66a req-35fa27ba-b9e4-4ff2-aceb-2526cb45f686 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:32.014238 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-ccb8e0c9-c20b-4f6e-bf26-3d45d231a66a req-35fa27ba-b9e4-4ff2-aceb-2526cb45f686 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:32.015017 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-ccb8e0c9-c20b-4f6e-bf26-3d45d231a66a req-35fa27ba-b9e4-4ff2-aceb-2526cb45f686 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:32.025255 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-9ea8e29f-9a1b-4d1c-953e-a4c7a9767241 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] 10.222.0.43 "GET /compute/v2.1/servers/c7b7e541-aa71-44f6-96fb-07c2e6e08520/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.343397 Oct 04 21:44:32.027144 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 203/422] 10.222.0.43 () {58 vars in 1275 bytes} [Tue Oct 4 21:44:31 2022] GET /compute/v2.1/servers/c7b7e541-aa71-44f6-96fb-07c2e6e08520/os-interface => generated 284 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:44:32.034391 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-93f92fbe-f0ff-434b-9514-bdc5ac9c18e0 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:32.035437 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-93f92fbe-f0ff-434b-9514-bdc5ac9c18e0 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] [instance: 258bc0cb-6718-4f8b-8d0b-ef544b2b659b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:32.038016 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-ccb8e0c9-c20b-4f6e-bf26-3d45d231a66a req-35fa27ba-b9e4-4ff2-aceb-2526cb45f686 service nova] Creating event network-vif-plugged:c9b71eee-ecc1-4326-bb8c-04bddb4cc35c for instance 7d71d6d3-3a63-406b-ac49-3e83bd539cf9 on n-h1-860284-1 Oct 04 21:44:32.043123 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-93f92fbe-f0ff-434b-9514-bdc5ac9c18e0 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:32.043848 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-ccb8e0c9-c20b-4f6e-bf26-3d45d231a66a req-35fa27ba-b9e4-4ff2-aceb-2526cb45f686 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052607 Oct 04 21:44:32.043998 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-93f92fbe-f0ff-434b-9514-bdc5ac9c18e0 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:32.044801 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 220/423] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:44:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:44:32.045076 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-93f92fbe-f0ff-434b-9514-bdc5ac9c18e0 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:32.046528 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-93f92fbe-f0ff-434b-9514-bdc5ac9c18e0 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:32.047752 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-93f92fbe-f0ff-434b-9514-bdc5ac9c18e0 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:32.048383 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-93f92fbe-f0ff-434b-9514-bdc5ac9c18e0 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:32.052066 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-e5843208-049d-424a-924c-e205ed3b923a req-a1a0a14d-26cf-4232-aade-d969bd157f42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80d8aacc-cde5-4451-8697-054eefe15849", "name": "network-vif-deleted", "tag": "fafe0a1d-3449-411d-80e8-e00053bf929b"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:44:32.063899 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-e5843208-049d-424a-924c-e205ed3b923a req-a1a0a14d-26cf-4232-aade-d969bd157f42 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:32.064833 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-e5843208-049d-424a-924c-e205ed3b923a req-a1a0a14d-26cf-4232-aade-d969bd157f42 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:32.065710 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-e5843208-049d-424a-924c-e205ed3b923a req-a1a0a14d-26cf-4232-aade-d969bd157f42 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:32.079878 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-e5843208-049d-424a-924c-e205ed3b923a req-a1a0a14d-26cf-4232-aade-d969bd157f42 service nova] Creating event network-vif-deleted:fafe0a1d-3449-411d-80e8-e00053bf929b for instance 80d8aacc-cde5-4451-8697-054eefe15849 on n-h1-860284-1 Oct 04 21:44:32.087524 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-e5843208-049d-424a-924c-e205ed3b923a req-a1a0a14d-26cf-4232-aade-d969bd157f42 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041274 Oct 04 21:44:32.088726 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 221/424] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:44:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:44:32.094136 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-11a6cb69-b5a5-41c8-99fb-8794f4edd2ac tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:32.095087 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-11a6cb69-b5a5-41c8-99fb-8794f4edd2ac tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] [instance: 80d8aacc-cde5-4451-8697-054eefe15849] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:32.101679 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-11a6cb69-b5a5-41c8-99fb-8794f4edd2ac tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:32.102497 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-11a6cb69-b5a5-41c8-99fb-8794f4edd2ac tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:32.103128 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-11a6cb69-b5a5-41c8-99fb-8794f4edd2ac tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:32.104038 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-11a6cb69-b5a5-41c8-99fb-8794f4edd2ac tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:32.105647 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-11a6cb69-b5a5-41c8-99fb-8794f4edd2ac tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:32.106223 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-11a6cb69-b5a5-41c8-99fb-8794f4edd2ac tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:32.121743 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-11a6cb69-b5a5-41c8-99fb-8794f4edd2ac tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] HTTP exception thrown: Instance 80d8aacc-cde5-4451-8697-054eefe15849 could not be found. Oct 04 21:44:32.123722 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-11a6cb69-b5a5-41c8-99fb-8794f4edd2ac tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Request method failure captured: Oct 04 21:44:32.123722 n-d-860284-1 devstack@n-api.service[134101]: request: GET /compute/v2.1/servers/80d8aacc-cde5-4451-8697-054eefe15849 HTTP/1.1 Oct 04 21:44:32.123722 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 21:44:32.123722 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 21:44:32.123722 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 21:44:32.123722 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 21:44:32.123722 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 21:44:32.123722 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 21:44:32.123722 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 21:44:32.123722 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 21:44:32.123722 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPKj0XGeKm2g_qPwErsswiNEsFafdM876zP1siE1RChjqpTQzJBQEzEMmI5SqRXlWrc07EOkeF-Dny846FNq3CLCkYfCxbHV9T-RVeJQnBGG8eKeZ7Jtc8LtS843Vcp967P9tKprMM0Xrie19pHtIm7NCLBt42bJ74ED9x75hbBtbYtQ Oct 04 21:44:32.123722 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 21:44:32.123722 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 21:44:32.123722 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 21:44:32.123722 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 21:44:32.123722 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 21:44:32.123722 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 21:44:32.123722 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: 7bedc0e10ab24824a40d06bb91626088 Oct 04 21:44:32.123722 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-DeleteServersAdminTestJSON-2053137461 Oct 04 21:44:32.123722 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 21:44:32.123722 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 21:44:32.125138 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/7bedc0e10ab24824a40d06bb91626088"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_7bedc0e10ab24824a40d06bb91626088", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/7bedc0e10ab24824a40d06bb91626088"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/7bedc0e10ab24824a40d06bb91626088"}]}] Oct 04 21:44:32.125138 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-DeleteServersAdminTestJSON-2053137461 Oct 04 21:44:32.125138 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: 7bedc0e10ab24824a40d06bb91626088 Oct 04 21:44:32.125138 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-2053137461 Oct 04 21:44:32.125138 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-DeleteServersAdminTestJSON-2053137461-project Oct 04 21:44:32.125138 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 21:44:32.125138 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 21:44:32.125138 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: af5387dbf4e24960809704c398fe999a Oct 04 21:44:32.125138 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-DeleteServersAdminTestJSON-2053137461-project Oct 04 21:44:32.125138 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 21:44:32.125138 n-d-860284-1 devstack@n-api.service[134101]: exception: Instance 80d8aacc-cde5-4451-8697-054eefe15849 could not be found. Oct 04 21:44:32.125138 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': '80d8aacc-cde5-4451-8697-054eefe15849'} Oct 04 21:44:32.125943 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:44:32.125943 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:44:32.125943 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:44:32.125943 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:44:32.125943 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:44:32.125943 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:44:32.125943 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:44:32.125943 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:44:32.125943 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:44:32.125943 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:44:32.125943 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80d8aacc-cde5-4451-8697-054eefe15849 could not be found. Oct 04 21:44:32.125943 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:44:32.125943 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:44:32.125943 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:44:32.125943 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:44:32.125943 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:44:32.125943 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:44:32.125943 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:44:32.125943 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:44:32.125943 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:44:32.127412 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:44:32.127412 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:44:32.127412 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:44:32.127412 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:44:32.127412 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:44:32.127412 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:44:32.127412 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:44:32.127412 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80d8aacc-cde5-4451-8697-054eefe15849 could not be found. Oct 04 21:44:32.127412 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:44:32.127412 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:44:32.127412 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:44:32.127412 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:44:32.127412 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:44:32.127412 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:44:32.127412 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:44:32.127412 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:44:32.127412 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80d8aacc-cde5-4451-8697-054eefe15849 could not be found. Oct 04 21:44:32.127412 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:44:32.130637 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-11a6cb69-b5a5-41c8-99fb-8794f4edd2ac tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Returning 404 to user: Instance 80d8aacc-cde5-4451-8697-054eefe15849 could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:44:32.131906 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-11a6cb69-b5a5-41c8-99fb-8794f4edd2ac tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] 10.222.0.43 "GET /compute/v2.1/servers/80d8aacc-cde5-4451-8697-054eefe15849" status: 404 len: 111 microversion: 2.1 time: 0.041660 Oct 04 21:44:32.133444 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 222/425] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:44:32 2022] GET /compute/v2.1/servers/80d8aacc-cde5-4451-8697-054eefe15849 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:44:32.141255 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-36a3a4a4-a23c-4326-8f11-6be394671621 tempest-FlavorsAccessNegativeTestJSON-1458998978 tempest-FlavorsAccessNegativeTestJSON-1458998978-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1036185136", "id": 908368932, "os-flavor-access:is_public": "False"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:44:32.164707 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-36a3a4a4-a23c-4326-8f11-6be394671621 tempest-FlavorsAccessNegativeTestJSON-1458998978 tempest-FlavorsAccessNegativeTestJSON-1458998978-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.029830 Oct 04 21:44:32.166318 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 223/426] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 21:44:32 2022] POST /compute/v2.1/flavors => generated 436 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:44:32.172039 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-f94c43bb-9c78-4b84-98c7-60b4f5fb1ecc tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:32.173198 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-f94c43bb-9c78-4b84-98c7-60b4f5fb1ecc tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] [instance: 80d8aacc-cde5-4451-8697-054eefe15849] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:32.181650 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f94c43bb-9c78-4b84-98c7-60b4f5fb1ecc tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:32.182656 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f94c43bb-9c78-4b84-98c7-60b4f5fb1ecc tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:32.183297 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f94c43bb-9c78-4b84-98c7-60b4f5fb1ecc tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:32.184426 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f94c43bb-9c78-4b84-98c7-60b4f5fb1ecc tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:32.185079 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f94c43bb-9c78-4b84-98c7-60b4f5fb1ecc tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:32.185694 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f94c43bb-9c78-4b84-98c7-60b4f5fb1ecc tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:32.204600 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-f94c43bb-9c78-4b84-98c7-60b4f5fb1ecc tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] HTTP exception thrown: Instance 80d8aacc-cde5-4451-8697-054eefe15849 could not be found. Oct 04 21:44:32.206747 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-f94c43bb-9c78-4b84-98c7-60b4f5fb1ecc tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Request method failure captured: Oct 04 21:44:32.206747 n-d-860284-1 devstack@n-api.service[134101]: request: DELETE /compute/v2.1/servers/80d8aacc-cde5-4451-8697-054eefe15849 HTTP/1.1 Oct 04 21:44:32.206747 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 21:44:32.206747 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 21:44:32.206747 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 21:44:32.206747 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 21:44:32.206747 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 21:44:32.206747 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 21:44:32.206747 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 21:44:32.206747 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 21:44:32.206747 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPKj0XGeKm2g_qPwErsswiNEsFafdM876zP1siE1RChjqpTQzJBQEzEMmI5SqRXlWrc07EOkeF-Dny846FNq3CLCkYfCxbHV9T-RVeJQnBGG8eKeZ7Jtc8LtS843Vcp967P9tKprMM0Xrie19pHtIm7NCLBt42bJ74ED9x75hbBtbYtQ Oct 04 21:44:32.206747 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 21:44:32.206747 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 21:44:32.206747 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 21:44:32.206747 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 21:44:32.206747 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 21:44:32.206747 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 21:44:32.206747 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: 7bedc0e10ab24824a40d06bb91626088 Oct 04 21:44:32.206747 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-DeleteServersAdminTestJSON-2053137461 Oct 04 21:44:32.206747 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 21:44:32.206747 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 21:44:32.208152 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/7bedc0e10ab24824a40d06bb91626088"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_7bedc0e10ab24824a40d06bb91626088", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/7bedc0e10ab24824a40d06bb91626088"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/7bedc0e10ab24824a40d06bb91626088"}]}] Oct 04 21:44:32.208152 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-DeleteServersAdminTestJSON-2053137461 Oct 04 21:44:32.208152 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: 7bedc0e10ab24824a40d06bb91626088 Oct 04 21:44:32.208152 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-2053137461 Oct 04 21:44:32.208152 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-DeleteServersAdminTestJSON-2053137461-project Oct 04 21:44:32.208152 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 21:44:32.208152 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 21:44:32.208152 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: af5387dbf4e24960809704c398fe999a Oct 04 21:44:32.208152 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-DeleteServersAdminTestJSON-2053137461-project Oct 04 21:44:32.208152 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 21:44:32.208152 n-d-860284-1 devstack@n-api.service[134101]: exception: Instance 80d8aacc-cde5-4451-8697-054eefe15849 could not be found. Oct 04 21:44:32.208152 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': '80d8aacc-cde5-4451-8697-054eefe15849'} Oct 04 21:44:32.208843 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:44:32.208843 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:44:32.208843 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:44:32.208843 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:44:32.208843 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:44:32.208843 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:44:32.208843 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:44:32.208843 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:44:32.208843 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:44:32.208843 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:44:32.208843 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80d8aacc-cde5-4451-8697-054eefe15849 could not be found. Oct 04 21:44:32.208843 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:44:32.208843 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:44:32.208843 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:44:32.208843 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:44:32.208843 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:44:32.208843 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:44:32.208843 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:44:32.208843 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:44:32.208843 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:44:32.211546 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:44:32.211546 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 21:44:32.211546 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 21:44:32.211546 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 21:44:32.211546 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 21:44:32.211546 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:44:32.211546 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:44:32.211546 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:44:32.211546 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:44:32.211546 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80d8aacc-cde5-4451-8697-054eefe15849 could not be found. Oct 04 21:44:32.211546 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:44:32.211546 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:44:32.211546 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:44:32.211546 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:44:32.211546 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:44:32.211546 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:44:32.211546 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:44:32.211546 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:44:32.211546 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80d8aacc-cde5-4451-8697-054eefe15849 could not be found. Oct 04 21:44:32.211546 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:44:32.215767 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-f94c43bb-9c78-4b84-98c7-60b4f5fb1ecc tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Returning 404 to user: Instance 80d8aacc-cde5-4451-8697-054eefe15849 could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:44:32.216981 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-f94c43bb-9c78-4b84-98c7-60b4f5fb1ecc tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] 10.222.0.43 "DELETE /compute/v2.1/servers/80d8aacc-cde5-4451-8697-054eefe15849" status: 404 len: 111 microversion: 2.1 time: 0.049426 Oct 04 21:44:32.218057 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 224/427] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 21:44:32 2022] DELETE /compute/v2.1/servers/80d8aacc-cde5-4451-8697-054eefe15849 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:44:32.224131 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-c1714cce-8a7b-4436-99a4-bb54480e3626 tempest-FlavorsAccessNegativeTestJSON-1458998978 tempest-FlavorsAccessNegativeTestJSON-1458998978-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "8a7bad847b7b43a3bab22eafe6aa648a"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:44:32.390323 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-93f92fbe-f0ff-434b-9514-bdc5ac9c18e0 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29842a669a20408b881105135f76cb0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39edf587afe94b60911198aa0bb61613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:44:32.400967 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-93f92fbe-f0ff-434b-9514-bdc5ac9c18e0 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] 10.222.0.43 "GET /compute/v2.1/servers/258bc0cb-6718-4f8b-8d0b-ef544b2b659b" status: 200 len: 1317 microversion: 2.1 time: 0.372225 Oct 04 21:44:32.402171 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 204/428] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:44:32 2022] GET /compute/v2.1/servers/258bc0cb-6718-4f8b-8d0b-ef544b2b659b => generated 1317 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:44:32.409408 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-c7c684e2-7057-4e9d-9e71-b3daac9a2458 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:32.411129 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-c7c684e2-7057-4e9d-9e71-b3daac9a2458 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] [instance: 80d8aacc-cde5-4451-8697-054eefe15849] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:32.418188 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=2 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:44:32.418757 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c7c684e2-7057-4e9d-9e71-b3daac9a2458 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:32.419406 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c7c684e2-7057-4e9d-9e71-b3daac9a2458 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:32.420480 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c7c684e2-7057-4e9d-9e71-b3daac9a2458 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:32.421591 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c7c684e2-7057-4e9d-9e71-b3daac9a2458 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:32.422242 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c7c684e2-7057-4e9d-9e71-b3daac9a2458 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:32.422851 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c7c684e2-7057-4e9d-9e71-b3daac9a2458 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:32.448036 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-c7c684e2-7057-4e9d-9e71-b3daac9a2458 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] HTTP exception thrown: Instance 80d8aacc-cde5-4451-8697-054eefe15849 could not be found. Oct 04 21:44:32.451304 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-c7c684e2-7057-4e9d-9e71-b3daac9a2458 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Request method failure captured: Oct 04 21:44:32.451304 n-d-860284-1 devstack@n-api.service[134102]: request: GET /compute/v2.1/servers/80d8aacc-cde5-4451-8697-054eefe15849 HTTP/1.1 Oct 04 21:44:32.451304 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 21:44:32.451304 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 21:44:32.451304 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 21:44:32.451304 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 21:44:32.451304 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 21:44:32.451304 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 21:44:32.451304 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 21:44:32.451304 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 21:44:32.451304 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPKj0XGeKm2g_qPwErsswiNEsFafdM876zP1siE1RChjqpTQzJBQEzEMmI5SqRXlWrc07EOkeF-Dny846FNq3CLCkYfCxbHV9T-RVeJQnBGG8eKeZ7Jtc8LtS843Vcp967P9tKprMM0Xrie19pHtIm7NCLBt42bJ74ED9x75hbBtbYtQ Oct 04 21:44:32.451304 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 21:44:32.451304 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 21:44:32.451304 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 21:44:32.451304 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 21:44:32.451304 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 21:44:32.451304 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 21:44:32.451304 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: 7bedc0e10ab24824a40d06bb91626088 Oct 04 21:44:32.451304 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-DeleteServersAdminTestJSON-2053137461 Oct 04 21:44:32.451304 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 21:44:32.451304 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 21:44:32.452570 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/7bedc0e10ab24824a40d06bb91626088"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_7bedc0e10ab24824a40d06bb91626088", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/7bedc0e10ab24824a40d06bb91626088"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/7bedc0e10ab24824a40d06bb91626088"}]}] Oct 04 21:44:32.452570 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-DeleteServersAdminTestJSON-2053137461 Oct 04 21:44:32.452570 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: 7bedc0e10ab24824a40d06bb91626088 Oct 04 21:44:32.452570 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-2053137461 Oct 04 21:44:32.452570 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-DeleteServersAdminTestJSON-2053137461-project Oct 04 21:44:32.452570 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 21:44:32.452570 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 21:44:32.452570 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: af5387dbf4e24960809704c398fe999a Oct 04 21:44:32.452570 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-DeleteServersAdminTestJSON-2053137461-project Oct 04 21:44:32.452570 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 21:44:32.452570 n-d-860284-1 devstack@n-api.service[134102]: exception: Instance 80d8aacc-cde5-4451-8697-054eefe15849 could not be found. Oct 04 21:44:32.452570 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': '80d8aacc-cde5-4451-8697-054eefe15849'} Oct 04 21:44:32.453248 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:44:32.453248 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:44:32.453248 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:44:32.453248 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:44:32.453248 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:44:32.453248 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:44:32.453248 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:44:32.453248 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:44:32.453248 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:44:32.453248 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:44:32.453248 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80d8aacc-cde5-4451-8697-054eefe15849 could not be found. Oct 04 21:44:32.453248 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:44:32.453248 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:44:32.453248 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:44:32.453248 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:44:32.453248 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:44:32.453248 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:44:32.453248 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:44:32.453248 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:44:32.453248 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:44:32.454285 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:44:32.454285 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:44:32.454285 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:44:32.454285 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:44:32.454285 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:44:32.454285 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:44:32.454285 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:44:32.454285 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80d8aacc-cde5-4451-8697-054eefe15849 could not be found. Oct 04 21:44:32.454285 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:44:32.454285 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:44:32.454285 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:44:32.454285 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:44:32.454285 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:44:32.454285 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:44:32.454285 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:44:32.454285 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:44:32.454285 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80d8aacc-cde5-4451-8697-054eefe15849 could not be found. Oct 04 21:44:32.454285 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:44:32.455264 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-c1714cce-8a7b-4436-99a4-bb54480e3626 tempest-FlavorsAccessNegativeTestJSON-1458998978 tempest-FlavorsAccessNegativeTestJSON-1458998978-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors/908368932/action" status: 200 len: 96 microversion: 2.1 time: 0.234804 Oct 04 21:44:32.457425 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-c7c684e2-7057-4e9d-9e71-b3daac9a2458 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Returning 404 to user: Instance 80d8aacc-cde5-4451-8697-054eefe15849 could not be found. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:44:32.458625 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-c7c684e2-7057-4e9d-9e71-b3daac9a2458 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] 10.222.0.43 "GET /compute/v2.1/servers/80d8aacc-cde5-4451-8697-054eefe15849" status: 404 len: 111 microversion: 2.1 time: 0.055150 Oct 04 21:44:32.459846 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 225/429] 10.222.0.43 () {60 vars in 1197 bytes} [Tue Oct 4 21:44:32 2022] POST /compute/v2.1/flavors/908368932/action => generated 96 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 21:44:32.463236 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 205/430] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:44:32 2022] GET /compute/v2.1/servers/80d8aacc-cde5-4451-8697-054eefe15849 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:44:32.470697 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-4f02966c-825e-42b3-a597-a9c804b21007 tempest-FlavorsAccessNegativeTestJSON-1733968224 tempest-FlavorsAccessNegativeTestJSON-1733968224-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "8a7bad847b7b43a3bab22eafe6aa648a"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:44:32.471891 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-f7dbb939-14b3-4446-b085-e84d996eca20 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:32.472558 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-f7dbb939-14b3-4446-b085-e84d996eca20 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] [instance: 4c692055-b3f9-494b-9279-5a8453ed88ba] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:32.480781 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f7dbb939-14b3-4446-b085-e84d996eca20 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:32.481493 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f7dbb939-14b3-4446-b085-e84d996eca20 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:32.482304 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f7dbb939-14b3-4446-b085-e84d996eca20 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:32.483813 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f7dbb939-14b3-4446-b085-e84d996eca20 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:32.485115 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-4f02966c-825e-42b3-a597-a9c804b21007 tempest-FlavorsAccessNegativeTestJSON-1733968224 tempest-FlavorsAccessNegativeTestJSON-1733968224-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': 'dfb83633f2714e2b855456b6e5823e0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7bad847b7b43a3bab22eafe6aa648a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:44:32.485373 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f7dbb939-14b3-4446-b085-e84d996eca20 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:32.486011 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f7dbb939-14b3-4446-b085-e84d996eca20 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:32.487498 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-4f02966c-825e-42b3-a597-a9c804b21007 tempest-FlavorsAccessNegativeTestJSON-1733968224 tempest-FlavorsAccessNegativeTestJSON-1733968224-project] Request method failure captured: Oct 04 21:44:32.487498 n-d-860284-1 devstack@n-api.service[134101]: request: POST /compute/v2.1/flavors/908368932/action HTTP/1.1 Oct 04 21:44:32.487498 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 21:44:32.487498 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 21:44:32.487498 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 21:44:32.487498 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 70 Oct 04 21:44:32.487498 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 21:44:32.487498 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 21:44:32.487498 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 21:44:32.487498 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 21:44:32.487498 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPKk4wHhke8TYNY-Csz46RKIYtry17v1295JH-cbqF7Pum8fMpPpb7uCQskxflRwl5fQyjAF7fE4O_78XfYIzR_ZAHTeJvSD2wM8rxPEOfUwqzK_8UBImN0dKYC_S5Y99FztzPEcfOHbB6irjWERpee1Udqjaxqh5_hsJ58YF-LkPkSY Oct 04 21:44:32.487498 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 21:44:32.487498 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 21:44:32.487498 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 21:44:32.487498 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 21:44:32.487498 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 21:44:32.487498 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 21:44:32.487498 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: 8a7bad847b7b43a3bab22eafe6aa648a Oct 04 21:44:32.487498 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1733968224 Oct 04 21:44:32.487498 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 21:44:32.487498 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 21:44:32.488945 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8a7bad847b7b43a3bab22eafe6aa648a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_8a7bad847b7b43a3bab22eafe6aa648a", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8a7bad847b7b43a3bab22eafe6aa648a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/8a7bad847b7b43a3bab22eafe6aa648a"}]}] Oct 04 21:44:32.488945 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1733968224 Oct 04 21:44:32.488945 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: 8a7bad847b7b43a3bab22eafe6aa648a Oct 04 21:44:32.488945 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1733968224 Oct 04 21:44:32.488945 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-FlavorsAccessNegativeTestJSON-1733968224-project Oct 04 21:44:32.488945 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 21:44:32.488945 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 21:44:32.488945 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: dfb83633f2714e2b855456b6e5823e0e Oct 04 21:44:32.488945 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1733968224-project Oct 04 21:44:32.488945 n-d-860284-1 devstack@n-api.service[134101]: Oct 04 21:44:32.488945 n-d-860284-1 devstack@n-api.service[134101]: {"removeTenantAccess": {"tenant": "8a7bad847b7b43a3bab22eafe6aa648a"}} Oct 04 21:44:32.488945 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 21:44:32.489822 n-d-860284-1 devstack@n-api.service[134101]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 04 21:44:32.489822 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': '908368932', 'body': {'removeTenantAccess': {'tenant': '8a7bad847b7b43a3bab22eafe6aa648a'}}} Oct 04 21:44:32.489822 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:44:32.489822 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:44:32.489822 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:44:32.489822 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:44:32.489822 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:44:32.489822 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:44:32.489822 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:44:32.489822 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:44:32.489822 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:44:32.489822 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:44:32.489822 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access Oct 04 21:44:32.489822 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi context.can( Oct 04 21:44:32.489822 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 21:44:32.489822 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 21:44:32.489822 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 21:44:32.489822 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 21:44:32.489822 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 21:44:32.489822 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 21:44:32.491222 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 21:44:32.491222 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 21:44:32.491222 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 21:44:32.491222 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 21:44:32.491222 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 21:44:32.491222 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 21:44:32.491222 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 21:44:32.491222 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 21:44:32.491222 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 04 21:44:32.491222 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:44:32.491222 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:44:32.491222 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:44:32.491222 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:44:32.491222 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:44:32.491222 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:44:32.491222 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 21:44:32.491222 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 21:44:32.491222 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 04 21:44:32.491222 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:44:32.506139 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-f7dbb939-14b3-4446-b085-e84d996eca20 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] HTTP exception thrown: Instance 4c692055-b3f9-494b-9279-5a8453ed88ba could not be found. Oct 04 21:44:32.508699 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-f7dbb939-14b3-4446-b085-e84d996eca20 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Request method failure captured: Oct 04 21:44:32.508699 n-d-860284-1 devstack@n-api.service[134102]: request: DELETE /compute/v2.1/servers/4c692055-b3f9-494b-9279-5a8453ed88ba HTTP/1.1 Oct 04 21:44:32.508699 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 21:44:32.508699 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 21:44:32.508699 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 21:44:32.508699 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 21:44:32.508699 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 21:44:32.508699 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 21:44:32.508699 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 21:44:32.508699 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 21:44:32.508699 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPKj0XGeKm2g_qPwErsswiNEsFafdM876zP1siE1RChjqpTQzJBQEzEMmI5SqRXlWrc07EOkeF-Dny846FNq3CLCkYfCxbHV9T-RVeJQnBGG8eKeZ7Jtc8LtS843Vcp967P9tKprMM0Xrie19pHtIm7NCLBt42bJ74ED9x75hbBtbYtQ Oct 04 21:44:32.508699 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 21:44:32.508699 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 21:44:32.508699 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 21:44:32.508699 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 21:44:32.508699 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 21:44:32.508699 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 21:44:32.508699 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: 7bedc0e10ab24824a40d06bb91626088 Oct 04 21:44:32.508699 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-DeleteServersAdminTestJSON-2053137461 Oct 04 21:44:32.508699 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 21:44:32.508699 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 21:44:32.510099 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/7bedc0e10ab24824a40d06bb91626088"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_7bedc0e10ab24824a40d06bb91626088", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/7bedc0e10ab24824a40d06bb91626088"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/7bedc0e10ab24824a40d06bb91626088"}]}] Oct 04 21:44:32.510099 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-DeleteServersAdminTestJSON-2053137461 Oct 04 21:44:32.510099 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: 7bedc0e10ab24824a40d06bb91626088 Oct 04 21:44:32.510099 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-2053137461 Oct 04 21:44:32.510099 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-DeleteServersAdminTestJSON-2053137461-project Oct 04 21:44:32.510099 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 21:44:32.510099 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 21:44:32.510099 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: af5387dbf4e24960809704c398fe999a Oct 04 21:44:32.510099 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-DeleteServersAdminTestJSON-2053137461-project Oct 04 21:44:32.510099 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 21:44:32.510099 n-d-860284-1 devstack@n-api.service[134102]: exception: Instance 4c692055-b3f9-494b-9279-5a8453ed88ba could not be found. Oct 04 21:44:32.510099 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': '4c692055-b3f9-494b-9279-5a8453ed88ba'} Oct 04 21:44:32.510926 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:44:32.510926 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:44:32.510926 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:44:32.510926 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:44:32.510926 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:44:32.510926 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:44:32.510926 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:44:32.510926 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:44:32.510926 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:44:32.510926 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:44:32.510926 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c692055-b3f9-494b-9279-5a8453ed88ba could not be found. Oct 04 21:44:32.510926 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:44:32.510926 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:44:32.510926 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:44:32.510926 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:44:32.510926 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:44:32.510926 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:44:32.510926 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:44:32.510926 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:44:32.510926 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:44:32.512186 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:44:32.512186 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 21:44:32.512186 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 21:44:32.512186 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 21:44:32.512186 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 21:44:32.512186 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:44:32.512186 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:44:32.512186 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:44:32.512186 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:44:32.512186 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c692055-b3f9-494b-9279-5a8453ed88ba could not be found. Oct 04 21:44:32.512186 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:44:32.512186 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:44:32.512186 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:44:32.512186 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:44:32.512186 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:44:32.512186 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:44:32.512186 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:44:32.512186 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:44:32.512186 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c692055-b3f9-494b-9279-5a8453ed88ba could not be found. Oct 04 21:44:32.512186 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:44:32.513470 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-f7dbb939-14b3-4446-b085-e84d996eca20 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Returning 404 to user: Instance 4c692055-b3f9-494b-9279-5a8453ed88ba could not be found. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:44:32.514743 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-f7dbb939-14b3-4446-b085-e84d996eca20 tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] 10.222.0.43 "DELETE /compute/v2.1/servers/4c692055-b3f9-494b-9279-5a8453ed88ba" status: 404 len: 111 microversion: 2.1 time: 0.049084 Oct 04 21:44:32.515593 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-4f02966c-825e-42b3-a597-a9c804b21007 tempest-FlavorsAccessNegativeTestJSON-1733968224 tempest-FlavorsAccessNegativeTestJSON-1733968224-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:44:32.519380 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 206/431] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 21:44:32 2022] DELETE /compute/v2.1/servers/4c692055-b3f9-494b-9279-5a8453ed88ba => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:44:32.523412 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-4f02966c-825e-42b3-a597-a9c804b21007 tempest-FlavorsAccessNegativeTestJSON-1733968224 tempest-FlavorsAccessNegativeTestJSON-1733968224-project] 10.222.0.43 "POST /compute/v2.1/flavors/908368932/action" status: 403 len: 133 microversion: 2.1 time: 0.060627 Oct 04 21:44:32.526873 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-a27e386f-11f6-49bc-b75c-8569b2aba31a tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:32.527442 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 226/432] 10.222.0.43 () {60 vars in 1197 bytes} [Tue Oct 4 21:44:32 2022] POST /compute/v2.1/flavors/908368932/action => generated 133 bytes in 66 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:44:32.527616 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-a27e386f-11f6-49bc-b75c-8569b2aba31a tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] [instance: 4c692055-b3f9-494b-9279-5a8453ed88ba] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:32.535010 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a27e386f-11f6-49bc-b75c-8569b2aba31a tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:32.535501 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a27e386f-11f6-49bc-b75c-8569b2aba31a tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:32.536015 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a27e386f-11f6-49bc-b75c-8569b2aba31a tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:32.536732 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a27e386f-11f6-49bc-b75c-8569b2aba31a tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:32.537195 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a27e386f-11f6-49bc-b75c-8569b2aba31a tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:32.537626 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a27e386f-11f6-49bc-b75c-8569b2aba31a tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:32.540187 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-2eed990b-30de-4ee4-b363-cbe59954e484 tempest-FlavorsAccessNegativeTestJSON-1458998978 tempest-FlavorsAccessNegativeTestJSON-1458998978-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "8a7bad847b7b43a3bab22eafe6aa648a"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:44:32.556310 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-a27e386f-11f6-49bc-b75c-8569b2aba31a tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] HTTP exception thrown: Instance 4c692055-b3f9-494b-9279-5a8453ed88ba could not be found. Oct 04 21:44:32.558456 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-a27e386f-11f6-49bc-b75c-8569b2aba31a tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Request method failure captured: Oct 04 21:44:32.558456 n-d-860284-1 devstack@n-api.service[134102]: request: GET /compute/v2.1/servers/4c692055-b3f9-494b-9279-5a8453ed88ba HTTP/1.1 Oct 04 21:44:32.558456 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 21:44:32.558456 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 21:44:32.558456 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 21:44:32.558456 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 21:44:32.558456 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 21:44:32.558456 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 21:44:32.558456 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 21:44:32.558456 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 21:44:32.558456 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPKj0XGeKm2g_qPwErsswiNEsFafdM876zP1siE1RChjqpTQzJBQEzEMmI5SqRXlWrc07EOkeF-Dny846FNq3CLCkYfCxbHV9T-RVeJQnBGG8eKeZ7Jtc8LtS843Vcp967P9tKprMM0Xrie19pHtIm7NCLBt42bJ74ED9x75hbBtbYtQ Oct 04 21:44:32.558456 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 21:44:32.558456 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 21:44:32.558456 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 21:44:32.558456 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 21:44:32.558456 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 21:44:32.558456 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 21:44:32.558456 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: 7bedc0e10ab24824a40d06bb91626088 Oct 04 21:44:32.558456 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-DeleteServersAdminTestJSON-2053137461 Oct 04 21:44:32.558456 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 21:44:32.558456 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 21:44:32.559836 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/7bedc0e10ab24824a40d06bb91626088"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_7bedc0e10ab24824a40d06bb91626088", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/7bedc0e10ab24824a40d06bb91626088"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/7bedc0e10ab24824a40d06bb91626088"}]}] Oct 04 21:44:32.559836 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-DeleteServersAdminTestJSON-2053137461 Oct 04 21:44:32.559836 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: 7bedc0e10ab24824a40d06bb91626088 Oct 04 21:44:32.559836 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-2053137461 Oct 04 21:44:32.559836 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-DeleteServersAdminTestJSON-2053137461-project Oct 04 21:44:32.559836 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 21:44:32.559836 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 21:44:32.559836 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: af5387dbf4e24960809704c398fe999a Oct 04 21:44:32.559836 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-DeleteServersAdminTestJSON-2053137461-project Oct 04 21:44:32.559836 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 21:44:32.559836 n-d-860284-1 devstack@n-api.service[134102]: exception: Instance 4c692055-b3f9-494b-9279-5a8453ed88ba could not be found. Oct 04 21:44:32.559836 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': '4c692055-b3f9-494b-9279-5a8453ed88ba'} Oct 04 21:44:32.560614 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:44:32.560614 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:44:32.560614 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:44:32.560614 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:44:32.560614 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:44:32.560614 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:44:32.560614 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:44:32.560614 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:44:32.560614 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:44:32.560614 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:44:32.560614 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c692055-b3f9-494b-9279-5a8453ed88ba could not be found. Oct 04 21:44:32.560614 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:44:32.560614 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:44:32.560614 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:44:32.560614 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:44:32.560614 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:44:32.560614 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:44:32.560614 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:44:32.560614 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:44:32.560614 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:44:32.561875 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:44:32.561875 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:44:32.561875 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:44:32.561875 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:44:32.561875 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:44:32.561875 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:44:32.561875 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:44:32.561875 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c692055-b3f9-494b-9279-5a8453ed88ba could not be found. Oct 04 21:44:32.561875 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:44:32.561875 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:44:32.561875 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:44:32.561875 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:44:32.561875 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:44:32.561875 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:44:32.561875 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:44:32.561875 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:44:32.561875 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c692055-b3f9-494b-9279-5a8453ed88ba could not be found. Oct 04 21:44:32.561875 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:44:32.564159 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-a27e386f-11f6-49bc-b75c-8569b2aba31a tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] Returning 404 to user: Instance 4c692055-b3f9-494b-9279-5a8453ed88ba could not be found. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:44:32.565151 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-a27e386f-11f6-49bc-b75c-8569b2aba31a tempest-DeleteServersAdminTestJSON-2053137461 tempest-DeleteServersAdminTestJSON-2053137461-project] 10.222.0.43 "GET /compute/v2.1/servers/4c692055-b3f9-494b-9279-5a8453ed88ba" status: 404 len: 111 microversion: 2.1 time: 0.044674 Oct 04 21:44:32.573317 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 207/433] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:44:32 2022] GET /compute/v2.1/servers/4c692055-b3f9-494b-9279-5a8453ed88ba => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:44:32.585237 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-40c55463-5e1a-44eb-a8ba-f6a102269c33 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:32.587198 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-40c55463-5e1a-44eb-a8ba-f6a102269c33 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: ec437ce7-b43a-4c8b-8a06-756cfb877851] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:32.596709 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-40c55463-5e1a-44eb-a8ba-f6a102269c33 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:32.597446 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-40c55463-5e1a-44eb-a8ba-f6a102269c33 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:32.598023 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-40c55463-5e1a-44eb-a8ba-f6a102269c33 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:32.598930 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-40c55463-5e1a-44eb-a8ba-f6a102269c33 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:32.601342 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-40c55463-5e1a-44eb-a8ba-f6a102269c33 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:32.602560 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-40c55463-5e1a-44eb-a8ba-f6a102269c33 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:32.702290 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-2eed990b-30de-4ee4-b363-cbe59954e484 tempest-FlavorsAccessNegativeTestJSON-1458998978 tempest-FlavorsAccessNegativeTestJSON-1458998978-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors/908368932/action" status: 200 len: 21 microversion: 2.1 time: 0.171393 Oct 04 21:44:32.703563 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 227/434] 10.222.0.43 () {60 vars in 1197 bytes} [Tue Oct 4 21:44:32 2022] POST /compute/v2.1/flavors/908368932/action => generated 21 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 21:44:32.719666 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-7aa496d0-74d9-46ab-9fbb-5ff0c6c95f63 tempest-FlavorsAccessNegativeTestJSON-1458998978 tempest-FlavorsAccessNegativeTestJSON-1458998978-project-admin] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:32.755260 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-7aa496d0-74d9-46ab-9fbb-5ff0c6c95f63 tempest-FlavorsAccessNegativeTestJSON-1458998978 tempest-FlavorsAccessNegativeTestJSON-1458998978-project-admin] 10.222.0.43 "DELETE /compute/v2.1/flavors/908368932" status: 202 len: 0 microversion: 2.1 time: 0.044904 Oct 04 21:44:32.756056 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 228/435] 10.222.0.43 () {58 vars in 1158 bytes} [Tue Oct 4 21:44:32 2022] DELETE /compute/v2.1/flavors/908368932 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:44:32.767949 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-5a00fd4d-3807-4b99-b0bc-0a46684b5f27 tempest-FlavorsAccessNegativeTestJSON-1458998978 tempest-FlavorsAccessNegativeTestJSON-1458998978-project-admin] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:32.781426 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=1,nova_api:INSERT=4,nova_api:DELETE=8 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:44:32.810901 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-5a00fd4d-3807-4b99-b0bc-0a46684b5f27 tempest-FlavorsAccessNegativeTestJSON-1458998978 tempest-FlavorsAccessNegativeTestJSON-1458998978-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 5821 microversion: 2.1 time: 0.046827 Oct 04 21:44:32.812299 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 229/436] 10.222.0.43 () {58 vars in 1146 bytes} [Tue Oct 4 21:44:32 2022] GET /compute/v2.1/flavors/detail => generated 5821 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:44:32.838766 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-be6b9602-56a7-4faf-b7bd-96373cd3813e tempest-FlavorsAccessNegativeTestJSON-1458998978 tempest-FlavorsAccessNegativeTestJSON-1458998978-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-453940254", "id": 477134497, "os-flavor-access:is_public": "False"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:44:32.879995 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-be6b9602-56a7-4faf-b7bd-96373cd3813e tempest-FlavorsAccessNegativeTestJSON-1458998978 tempest-FlavorsAccessNegativeTestJSON-1458998978-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.046589 Oct 04 21:44:32.885354 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 230/437] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 21:44:32 2022] POST /compute/v2.1/flavors => generated 435 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:44:32.900357 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-778e0b25-e7ed-4b28-82ee-4ee7c8029c50 tempest-FlavorsAccessNegativeTestJSON-1458998978 tempest-FlavorsAccessNegativeTestJSON-1458998978-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "3d4c603a58774b2c8126ab6884c662cd"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:44:33.100692 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-40c55463-5e1a-44eb-a8ba-f6a102269c33 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:44:33.115893 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-40c55463-5e1a-44eb-a8ba-f6a102269c33 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/ec437ce7-b43a-4c8b-8a06-756cfb877851" status: 200 len: 1477 microversion: 2.1 time: 0.536126 Oct 04 21:44:33.116896 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 208/438] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:44:32 2022] GET /compute/v2.1/servers/ec437ce7-b43a-4c8b-8a06-756cfb877851 => generated 1477 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:44:33.124486 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-4831c12c-4e39-4d81-bbb6-824f72a37cab tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:33.125340 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-4831c12c-4e39-4d81-bbb6-824f72a37cab tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] [instance: 3eeb7190-8e00-4c8c-bfd7-a15da2a3e376] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:33.139667 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4831c12c-4e39-4d81-bbb6-824f72a37cab tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:33.140199 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4831c12c-4e39-4d81-bbb6-824f72a37cab tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:33.161939 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4831c12c-4e39-4d81-bbb6-824f72a37cab tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:33.168725 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4831c12c-4e39-4d81-bbb6-824f72a37cab tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:33.169465 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4831c12c-4e39-4d81-bbb6-824f72a37cab tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:33.170012 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4831c12c-4e39-4d81-bbb6-824f72a37cab tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:33.392501 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-778e0b25-e7ed-4b28-82ee-4ee7c8029c50 tempest-FlavorsAccessNegativeTestJSON-1458998978 tempest-FlavorsAccessNegativeTestJSON-1458998978-project-admin] HTTP exception thrown: Flavor access not found for 35 / 3d4c603a58774b2c8126ab6884c662cd combination. Oct 04 21:44:33.394673 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-778e0b25-e7ed-4b28-82ee-4ee7c8029c50 tempest-FlavorsAccessNegativeTestJSON-1458998978 tempest-FlavorsAccessNegativeTestJSON-1458998978-project-admin] Request method failure captured: Oct 04 21:44:33.394673 n-d-860284-1 devstack@n-api.service[134101]: request: POST /compute/v2.1/flavors/477134497/action HTTP/1.1 Oct 04 21:44:33.394673 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 21:44:33.394673 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 21:44:33.394673 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 21:44:33.394673 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 70 Oct 04 21:44:33.394673 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 21:44:33.394673 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 21:44:33.394673 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 21:44:33.394673 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 21:44:33.394673 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPKk5-kRy9Z6FgQyATsRM-m9SyvoeS3jAFg5pX1X_tz_TFr9Hu7H342-EQOGnNli37fgWORV9y5C2cbPBuzbgbMl8WUgEZTez5hZ7FLQErd9AG1-PmekPXi-g-7KomcUS1ehyfVoIXERnup_pjk3Cn0m3F-pZwrRf-5piHgoCmPI50qo Oct 04 21:44:33.394673 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 21:44:33.394673 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 21:44:33.394673 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 21:44:33.394673 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 21:44:33.394673 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 21:44:33.394673 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 21:44:33.394673 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: 48606a488d57418997eaa5f743c37acf Oct 04 21:44:33.394673 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1458998978 Oct 04 21:44:33.394673 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,admin,member Oct 04 21:44:33.394673 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,admin,member Oct 04 21:44:33.396084 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/48606a488d57418997eaa5f743c37acf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_48606a488d57418997eaa5f743c37acf", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/48606a488d57418997eaa5f743c37acf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/48606a488d57418997eaa5f743c37acf"}]}] Oct 04 21:44:33.396084 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1458998978 Oct 04 21:44:33.396084 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: 48606a488d57418997eaa5f743c37acf Oct 04 21:44:33.396084 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1458998978 Oct 04 21:44:33.396084 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-FlavorsAccessNegativeTestJSON-1458998978-project-admin Oct 04 21:44:33.396084 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 21:44:33.396084 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 21:44:33.396084 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: f17889587d034122880f21cfb6a9c517 Oct 04 21:44:33.396084 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1458998978-project-admin Oct 04 21:44:33.396084 n-d-860284-1 devstack@n-api.service[134101]: Oct 04 21:44:33.396084 n-d-860284-1 devstack@n-api.service[134101]: {"removeTenantAccess": {"tenant": "3d4c603a58774b2c8126ab6884c662cd"}} Oct 04 21:44:33.396084 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 21:44:33.396736 n-d-860284-1 devstack@n-api.service[134101]: exception: Flavor access not found for 35 / 3d4c603a58774b2c8126ab6884c662cd combination. Oct 04 21:44:33.396736 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': '477134497', 'body': {'removeTenantAccess': {'tenant': '3d4c603a58774b2c8126ab6884c662cd'}}} Oct 04 21:44:33.396736 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:44:33.396736 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:44:33.396736 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access Oct 04 21:44:33.396736 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) Oct 04 21:44:33.396736 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 04 21:44:33.396736 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 04 21:44:33.396736 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access Oct 04 21:44:33.396736 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) Oct 04 21:44:33.396736 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access Oct 04 21:44:33.396736 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) Oct 04 21:44:33.396736 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project Oct 04 21:44:33.396736 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) Oct 04 21:44:33.396736 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 21:44:33.396736 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 21:44:33.396736 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project Oct 04 21:44:33.396736 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, Oct 04 21:44:33.397698 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 35 / 3d4c603a58774b2c8126ab6884c662cd combination. Oct 04 21:44:33.397698 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:44:33.397698 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:44:33.397698 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:44:33.397698 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:44:33.397698 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:44:33.397698 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:44:33.397698 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:44:33.397698 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:44:33.397698 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:44:33.397698 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:44:33.397698 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:44:33.397698 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:44:33.397698 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access Oct 04 21:44:33.397698 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:44:33.397698 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 35 / 3d4c603a58774b2c8126ab6884c662cd combination. Oct 04 21:44:33.397698 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:44:33.397698 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:44:33.397698 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:44:33.397698 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:44:33.399940 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:44:33.399940 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:44:33.399940 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:44:33.399940 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:44:33.399940 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 35 / 3d4c603a58774b2c8126ab6884c662cd combination. Oct 04 21:44:33.399940 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:44:33.402094 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-778e0b25-e7ed-4b28-82ee-4ee7c8029c50 tempest-FlavorsAccessNegativeTestJSON-1458998978 tempest-FlavorsAccessNegativeTestJSON-1458998978-project-admin] Returning 404 to user: Flavor access not found for 35 / 3d4c603a58774b2c8126ab6884c662cd combination. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:44:33.405178 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-778e0b25-e7ed-4b28-82ee-4ee7c8029c50 tempest-FlavorsAccessNegativeTestJSON-1458998978 tempest-FlavorsAccessNegativeTestJSON-1458998978-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors/477134497/action" status: 404 len: 124 microversion: 2.1 time: 0.511387 Oct 04 21:44:33.408404 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 231/439] 10.222.0.43 () {60 vars in 1197 bytes} [Tue Oct 4 21:44:32 2022] POST /compute/v2.1/flavors/477134497/action => generated 124 bytes in 515 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 21:44:33.424603 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-9857f1be-3bc7-49ac-9ca6-b47909791d95 tempest-FlavorsAccessNegativeTestJSON-1458998978 tempest-FlavorsAccessNegativeTestJSON-1458998978-project-admin] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:33.459339 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-9857f1be-3bc7-49ac-9ca6-b47909791d95 tempest-FlavorsAccessNegativeTestJSON-1458998978 tempest-FlavorsAccessNegativeTestJSON-1458998978-project-admin] 10.222.0.43 "DELETE /compute/v2.1/flavors/477134497" status: 202 len: 0 microversion: 2.1 time: 0.043819 Oct 04 21:44:33.461085 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 232/440] 10.222.0.43 () {58 vars in 1158 bytes} [Tue Oct 4 21:44:33 2022] DELETE /compute/v2.1/flavors/477134497 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 21:44:33.474829 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-56732da8-714a-4043-8be6-236f12e95985 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:33.476670 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-56732da8-714a-4043-8be6-236f12e95985 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] [instance: 258bc0cb-6718-4f8b-8d0b-ef544b2b659b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:33.494884 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-56732da8-714a-4043-8be6-236f12e95985 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:33.495827 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-56732da8-714a-4043-8be6-236f12e95985 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:33.496474 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-56732da8-714a-4043-8be6-236f12e95985 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:33.497444 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-56732da8-714a-4043-8be6-236f12e95985 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:33.498099 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-56732da8-714a-4043-8be6-236f12e95985 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:33.498748 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-56732da8-714a-4043-8be6-236f12e95985 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:33.709247 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-4831c12c-4e39-4d81-bbb6-824f72a37cab tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539a93c63ab34b789903970b57b96bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8179a9b323b74a789fa7d5a4507cb6b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:44:33.737166 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-4831c12c-4e39-4d81-bbb6-824f72a37cab tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] 10.222.0.43 "GET /compute/v2.1/servers/3eeb7190-8e00-4c8c-bfd7-a15da2a3e376" status: 200 len: 1323 microversion: 2.1 time: 0.613999 Oct 04 21:44:33.738571 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 209/441] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:44:33 2022] GET /compute/v2.1/servers/3eeb7190-8e00-4c8c-bfd7-a15da2a3e376 => generated 1323 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:44:33.747866 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-29a27137-bac0-46e8-8a86-45c8c80e4794 tempest-FlavorsAccessNegativeTestJSON-1458998978 tempest-FlavorsAccessNegativeTestJSON-1458998978-project-admin] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:33.785105 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-29a27137-bac0-46e8-8a86-45c8c80e4794 tempest-FlavorsAccessNegativeTestJSON-1458998978 tempest-FlavorsAccessNegativeTestJSON-1458998978-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 5821 microversion: 2.1 time: 0.044039 Oct 04 21:44:33.786238 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 210/442] 10.222.0.43 () {58 vars in 1146 bytes} [Tue Oct 4 21:44:33 2022] GET /compute/v2.1/flavors/detail => generated 5821 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:44:33.938502 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-56732da8-714a-4043-8be6-236f12e95985 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29842a669a20408b881105135f76cb0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39edf587afe94b60911198aa0bb61613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:44:33.951800 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-56732da8-714a-4043-8be6-236f12e95985 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] 10.222.0.43 "GET /compute/v2.1/servers/258bc0cb-6718-4f8b-8d0b-ef544b2b659b" status: 200 len: 1317 microversion: 2.1 time: 0.486032 Oct 04 21:44:33.952553 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 233/443] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:44:33 2022] GET /compute/v2.1/servers/258bc0cb-6718-4f8b-8d0b-ef544b2b659b => generated 1317 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:44:34.143303 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-0e136639-0336-4061-867d-80a0e9992b45 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:34.144507 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-0e136639-0336-4061-867d-80a0e9992b45 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: ec437ce7-b43a-4c8b-8a06-756cfb877851] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:34.182631 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0e136639-0336-4061-867d-80a0e9992b45 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:34.185438 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0e136639-0336-4061-867d-80a0e9992b45 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:34.185914 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0e136639-0336-4061-867d-80a0e9992b45 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:34.188635 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0e136639-0336-4061-867d-80a0e9992b45 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:34.189424 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0e136639-0336-4061-867d-80a0e9992b45 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:34.192930 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0e136639-0336-4061-867d-80a0e9992b45 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:34.620794 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-0e136639-0336-4061-867d-80a0e9992b45 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:44:34.642948 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-0e136639-0336-4061-867d-80a0e9992b45 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/ec437ce7-b43a-4c8b-8a06-756cfb877851" status: 200 len: 1477 microversion: 2.1 time: 0.504697 Oct 04 21:44:34.646188 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 211/444] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:44:34 2022] GET /compute/v2.1/servers/ec437ce7-b43a-4c8b-8a06-756cfb877851 => generated 1477 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:44:34.764631 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-c8473cd2-e39d-442d-b0fb-6563f678505f tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:34.780377 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-c8473cd2-e39d-442d-b0fb-6563f678505f tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] [instance: 3eeb7190-8e00-4c8c-bfd7-a15da2a3e376] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:34.791588 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c8473cd2-e39d-442d-b0fb-6563f678505f tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:34.794048 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c8473cd2-e39d-442d-b0fb-6563f678505f tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:34.795321 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c8473cd2-e39d-442d-b0fb-6563f678505f tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:34.797251 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c8473cd2-e39d-442d-b0fb-6563f678505f tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:34.798669 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c8473cd2-e39d-442d-b0fb-6563f678505f tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:34.799391 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c8473cd2-e39d-442d-b0fb-6563f678505f tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:34.989484 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-eeff896b-77d3-44a5-9373-b2c0ec2ecf1a tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:34.990697 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-eeff896b-77d3-44a5-9373-b2c0ec2ecf1a tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] [instance: 258bc0cb-6718-4f8b-8d0b-ef544b2b659b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:35.005136 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-eeff896b-77d3-44a5-9373-b2c0ec2ecf1a tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:35.006395 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-eeff896b-77d3-44a5-9373-b2c0ec2ecf1a tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:35.007192 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-eeff896b-77d3-44a5-9373-b2c0ec2ecf1a tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:35.008215 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-eeff896b-77d3-44a5-9373-b2c0ec2ecf1a tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:35.008892 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-eeff896b-77d3-44a5-9373-b2c0ec2ecf1a tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:35.010744 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-eeff896b-77d3-44a5-9373-b2c0ec2ecf1a tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:35.443608 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-eeff896b-77d3-44a5-9373-b2c0ec2ecf1a tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29842a669a20408b881105135f76cb0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39edf587afe94b60911198aa0bb61613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:44:35.493254 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-eeff896b-77d3-44a5-9373-b2c0ec2ecf1a tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] 10.222.0.43 "GET /compute/v2.1/servers/258bc0cb-6718-4f8b-8d0b-ef544b2b659b" status: 200 len: 1317 microversion: 2.1 time: 0.516722 Oct 04 21:44:35.515635 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 212/445] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:44:34 2022] GET /compute/v2.1/servers/258bc0cb-6718-4f8b-8d0b-ef544b2b659b => generated 1317 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:44:35.578069 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-c8473cd2-e39d-442d-b0fb-6563f678505f tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539a93c63ab34b789903970b57b96bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8179a9b323b74a789fa7d5a4507cb6b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:44:35.581876 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=97,nova_cell1:INSERT=1 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:44:35.592783 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-c8473cd2-e39d-442d-b0fb-6563f678505f tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] 10.222.0.43 "GET /compute/v2.1/servers/3eeb7190-8e00-4c8c-bfd7-a15da2a3e376" status: 200 len: 1323 microversion: 2.1 time: 0.832009 Oct 04 21:44:35.599190 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 234/446] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:44:34 2022] GET /compute/v2.1/servers/3eeb7190-8e00-4c8c-bfd7-a15da2a3e376 => generated 1323 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:44:35.682978 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-ce64c2aa-ff04-467b-bfb4-098644e10006 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:35.685643 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-ce64c2aa-ff04-467b-bfb4-098644e10006 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: ec437ce7-b43a-4c8b-8a06-756cfb877851] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:35.715785 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ce64c2aa-ff04-467b-bfb4-098644e10006 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:35.717575 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ce64c2aa-ff04-467b-bfb4-098644e10006 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:35.718036 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ce64c2aa-ff04-467b-bfb4-098644e10006 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:35.718809 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ce64c2aa-ff04-467b-bfb4-098644e10006 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:35.725152 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ce64c2aa-ff04-467b-bfb4-098644e10006 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:35.726660 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ce64c2aa-ff04-467b-bfb4-098644e10006 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:36.138490 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-ce64c2aa-ff04-467b-bfb4-098644e10006 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:44:36.157511 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-ce64c2aa-ff04-467b-bfb4-098644e10006 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/ec437ce7-b43a-4c8b-8a06-756cfb877851" status: 200 len: 1477 microversion: 2.1 time: 0.491614 Oct 04 21:44:36.159632 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 213/447] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:44:35 2022] GET /compute/v2.1/servers/ec437ce7-b43a-4c8b-8a06-756cfb877851 => generated 1477 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:44:36.519748 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-36641a6e-192a-4cd1-838d-1e84cba7e059 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:36.520663 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-36641a6e-192a-4cd1-838d-1e84cba7e059 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] [instance: 258bc0cb-6718-4f8b-8d0b-ef544b2b659b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:36.535067 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-36641a6e-192a-4cd1-838d-1e84cba7e059 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:36.536282 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-36641a6e-192a-4cd1-838d-1e84cba7e059 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:36.537223 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-36641a6e-192a-4cd1-838d-1e84cba7e059 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:36.539418 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-36641a6e-192a-4cd1-838d-1e84cba7e059 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:36.545228 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-36641a6e-192a-4cd1-838d-1e84cba7e059 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:36.547270 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-36641a6e-192a-4cd1-838d-1e84cba7e059 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:36.630670 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-561c5c4b-364f-4725-ad1f-5bdf5b9d6ab3 tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:36.631646 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-561c5c4b-364f-4725-ad1f-5bdf5b9d6ab3 tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] [instance: 3eeb7190-8e00-4c8c-bfd7-a15da2a3e376] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:36.652163 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-561c5c4b-364f-4725-ad1f-5bdf5b9d6ab3 tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:36.653368 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-561c5c4b-364f-4725-ad1f-5bdf5b9d6ab3 tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:36.656881 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-561c5c4b-364f-4725-ad1f-5bdf5b9d6ab3 tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:36.659645 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-561c5c4b-364f-4725-ad1f-5bdf5b9d6ab3 tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:36.662010 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-561c5c4b-364f-4725-ad1f-5bdf5b9d6ab3 tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:36.668886 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-561c5c4b-364f-4725-ad1f-5bdf5b9d6ab3 tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:37.174697 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-36641a6e-192a-4cd1-838d-1e84cba7e059 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29842a669a20408b881105135f76cb0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39edf587afe94b60911198aa0bb61613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:44:37.187154 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-36641a6e-192a-4cd1-838d-1e84cba7e059 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] 10.222.0.43 "GET /compute/v2.1/servers/258bc0cb-6718-4f8b-8d0b-ef544b2b659b" status: 200 len: 1317 microversion: 2.1 time: 0.672701 Oct 04 21:44:37.187956 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 235/448] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:44:36 2022] GET /compute/v2.1/servers/258bc0cb-6718-4f8b-8d0b-ef544b2b659b => generated 1317 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:44:37.207755 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-657e5e7d-977a-4192-8e3c-2080ab35c191 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:37.222845 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-657e5e7d-977a-4192-8e3c-2080ab35c191 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] [instance: c7b7e541-aa71-44f6-96fb-07c2e6e08520] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:37.241272 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-657e5e7d-977a-4192-8e3c-2080ab35c191 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:37.241882 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-657e5e7d-977a-4192-8e3c-2080ab35c191 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:37.242693 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-657e5e7d-977a-4192-8e3c-2080ab35c191 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:37.243637 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-657e5e7d-977a-4192-8e3c-2080ab35c191 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:37.244177 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-657e5e7d-977a-4192-8e3c-2080ab35c191 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:37.244610 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-657e5e7d-977a-4192-8e3c-2080ab35c191 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:37.383992 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-561c5c4b-364f-4725-ad1f-5bdf5b9d6ab3 tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539a93c63ab34b789903970b57b96bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8179a9b323b74a789fa7d5a4507cb6b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:44:37.400329 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-561c5c4b-364f-4725-ad1f-5bdf5b9d6ab3 tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] 10.222.0.43 "GET /compute/v2.1/servers/3eeb7190-8e00-4c8c-bfd7-a15da2a3e376" status: 200 len: 1323 microversion: 2.1 time: 0.776979 Oct 04 21:44:37.400936 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 214/449] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:44:36 2022] GET /compute/v2.1/servers/3eeb7190-8e00-4c8c-bfd7-a15da2a3e376 => generated 1323 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:44:37.405457 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-0cec1469-a20a-4182-9a17-9ba30ae6a93a req-22a94ca9-59af-475d-a05e-8861d9e67d88 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7b7e541-aa71-44f6-96fb-07c2e6e08520", "tag": "7e3bac17-bb02-4dee-99d3-79bc4e2aa285"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:44:37.441954 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-0cec1469-a20a-4182-9a17-9ba30ae6a93a req-22a94ca9-59af-475d-a05e-8861d9e67d88 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:37.442464 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-0cec1469-a20a-4182-9a17-9ba30ae6a93a req-22a94ca9-59af-475d-a05e-8861d9e67d88 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:37.448089 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-0cec1469-a20a-4182-9a17-9ba30ae6a93a req-22a94ca9-59af-475d-a05e-8861d9e67d88 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:37.468998 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-0cec1469-a20a-4182-9a17-9ba30ae6a93a req-22a94ca9-59af-475d-a05e-8861d9e67d88 service nova] Creating event network-changed:7e3bac17-bb02-4dee-99d3-79bc4e2aa285 for instance c7b7e541-aa71-44f6-96fb-07c2e6e08520 on n-h1-860284-1 Oct 04 21:44:37.482927 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-0cec1469-a20a-4182-9a17-9ba30ae6a93a req-22a94ca9-59af-475d-a05e-8861d9e67d88 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076380 Oct 04 21:44:37.484031 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 215/450] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:44:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:44:37.490289 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-fde6423d-bc4c-4ecd-8789-3bab92ed3723 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:37.498534 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-fde6423d-bc4c-4ecd-8789-3bab92ed3723 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: ec437ce7-b43a-4c8b-8a06-756cfb877851] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:37.513992 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fde6423d-bc4c-4ecd-8789-3bab92ed3723 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:37.514733 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fde6423d-bc4c-4ecd-8789-3bab92ed3723 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:37.515335 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fde6423d-bc4c-4ecd-8789-3bab92ed3723 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:37.516070 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fde6423d-bc4c-4ecd-8789-3bab92ed3723 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:37.516524 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fde6423d-bc4c-4ecd-8789-3bab92ed3723 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:37.516949 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fde6423d-bc4c-4ecd-8789-3bab92ed3723 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:37.878327 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-657e5e7d-977a-4192-8e3c-2080ab35c191 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1789bb97219a4e1591632126812ea6df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da67fc95e2814f4086df020f4c475764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:44:37.888698 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-657e5e7d-977a-4192-8e3c-2080ab35c191 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] 10.222.0.43 "GET /compute/v2.1/servers/c7b7e541-aa71-44f6-96fb-07c2e6e08520" status: 200 len: 1586 microversion: 2.1 time: 0.688257 Oct 04 21:44:37.892880 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 236/451] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:44:37 2022] GET /compute/v2.1/servers/c7b7e541-aa71-44f6-96fb-07c2e6e08520 => generated 1586 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:44:38.123248 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-fde6423d-bc4c-4ecd-8789-3bab92ed3723 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:44:38.138340 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-fde6423d-bc4c-4ecd-8789-3bab92ed3723 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/ec437ce7-b43a-4c8b-8a06-756cfb877851" status: 200 len: 1477 microversion: 2.1 time: 0.649401 Oct 04 21:44:38.140457 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 216/452] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:44:37 2022] GET /compute/v2.1/servers/ec437ce7-b43a-4c8b-8a06-756cfb877851 => generated 1477 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:44:38.215642 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e40119f8-46bb-4937-ac98-c82148aed069 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:38.216467 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-e40119f8-46bb-4937-ac98-c82148aed069 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] [instance: 258bc0cb-6718-4f8b-8d0b-ef544b2b659b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:38.231179 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e40119f8-46bb-4937-ac98-c82148aed069 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:38.231760 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e40119f8-46bb-4937-ac98-c82148aed069 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:38.232393 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e40119f8-46bb-4937-ac98-c82148aed069 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:38.233184 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e40119f8-46bb-4937-ac98-c82148aed069 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:38.244912 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e40119f8-46bb-4937-ac98-c82148aed069 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:38.246676 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e40119f8-46bb-4937-ac98-c82148aed069 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:38.408279 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-567f0508-a073-40b5-9c60-61fd7e675476 req-e8fd3b4e-08c7-44eb-b77a-29f52b5ba6ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3eeb7190-8e00-4c8c-bfd7-a15da2a3e376", "name": "network-vif-plugged", "status": "completed", "tag": "c805f382-dbdb-446f-8642-d9c2c0cecea8"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:44:38.436808 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-567f0508-a073-40b5-9c60-61fd7e675476 req-e8fd3b4e-08c7-44eb-b77a-29f52b5ba6ec service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:38.437553 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-567f0508-a073-40b5-9c60-61fd7e675476 req-e8fd3b4e-08c7-44eb-b77a-29f52b5ba6ec service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:38.439341 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-567f0508-a073-40b5-9c60-61fd7e675476 req-e8fd3b4e-08c7-44eb-b77a-29f52b5ba6ec service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:38.459493 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-567f0508-a073-40b5-9c60-61fd7e675476 req-e8fd3b4e-08c7-44eb-b77a-29f52b5ba6ec service nova] Creating event network-vif-plugged:c805f382-dbdb-446f-8642-d9c2c0cecea8 for instance 3eeb7190-8e00-4c8c-bfd7-a15da2a3e376 on n-h2-860284-1 Oct 04 21:44:38.475454 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-567f0508-a073-40b5-9c60-61fd7e675476 req-e8fd3b4e-08c7-44eb-b77a-29f52b5ba6ec service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071085 Oct 04 21:44:38.476899 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 217/453] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:44:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:44:38.486337 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-ad43d79a-6acf-494d-b04f-a8ba4938d09b tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:38.490676 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-ad43d79a-6acf-494d-b04f-a8ba4938d09b tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] [instance: 3eeb7190-8e00-4c8c-bfd7-a15da2a3e376] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:38.506206 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ad43d79a-6acf-494d-b04f-a8ba4938d09b tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:38.507118 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ad43d79a-6acf-494d-b04f-a8ba4938d09b tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:38.510449 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ad43d79a-6acf-494d-b04f-a8ba4938d09b tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:38.512874 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ad43d79a-6acf-494d-b04f-a8ba4938d09b tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:38.513475 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ad43d79a-6acf-494d-b04f-a8ba4938d09b tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:38.515717 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ad43d79a-6acf-494d-b04f-a8ba4938d09b tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:39.416639 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-e40119f8-46bb-4937-ac98-c82148aed069 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29842a669a20408b881105135f76cb0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39edf587afe94b60911198aa0bb61613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:44:39.429791 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-e40119f8-46bb-4937-ac98-c82148aed069 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] 10.222.0.43 "GET /compute/v2.1/servers/258bc0cb-6718-4f8b-8d0b-ef544b2b659b" status: 200 len: 1317 microversion: 2.1 time: 1.217050 Oct 04 21:44:39.433938 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 237/454] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:44:38 2022] GET /compute/v2.1/servers/258bc0cb-6718-4f8b-8d0b-ef544b2b659b => generated 1317 bytes in 1223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:44:39.442408 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-ad43d79a-6acf-494d-b04f-a8ba4938d09b tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539a93c63ab34b789903970b57b96bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8179a9b323b74a789fa7d5a4507cb6b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:44:39.443155 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-f5cacfb3-2d3e-43c5-8551-514d828f8479 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:39.446916 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-f5cacfb3-2d3e-43c5-8551-514d828f8479 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: ec437ce7-b43a-4c8b-8a06-756cfb877851] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:39.452385 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-ad43d79a-6acf-494d-b04f-a8ba4938d09b tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] 10.222.0.43 "GET /compute/v2.1/servers/3eeb7190-8e00-4c8c-bfd7-a15da2a3e376" status: 200 len: 1323 microversion: 2.1 time: 0.974141 Oct 04 21:44:39.457792 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f5cacfb3-2d3e-43c5-8551-514d828f8479 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:39.460618 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f5cacfb3-2d3e-43c5-8551-514d828f8479 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:39.461081 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f5cacfb3-2d3e-43c5-8551-514d828f8479 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:39.461826 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f5cacfb3-2d3e-43c5-8551-514d828f8479 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:39.464698 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f5cacfb3-2d3e-43c5-8551-514d828f8479 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:39.465163 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f5cacfb3-2d3e-43c5-8551-514d828f8479 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:39.470795 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 218/455] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:44:38 2022] GET /compute/v2.1/servers/3eeb7190-8e00-4c8c-bfd7-a15da2a3e376 => generated 1323 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:44:40.531211 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-21896541-6740-4012-97f0-151d07e7d4bc tempest-FlavorsExtraSpecsNegativeTestJSON-1215230648 tempest-FlavorsExtraSpecsNegativeTestJSON-1215230648-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1957591455", "ram": 512, "vcpus": 1, "disk": 10, "id": 529323775, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:44:40.589391 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-21896541-6740-4012-97f0-151d07e7d4bc tempest-FlavorsExtraSpecsNegativeTestJSON-1215230648 tempest-FlavorsExtraSpecsNegativeTestJSON-1215230648-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.799946 Oct 04 21:44:40.590047 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 219/456] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 21:44:39 2022] POST /compute/v2.1/flavors => generated 413 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:44:40.604336 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-6c8753c2-b6c6-478a-969c-7c9a9123e0e7 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:40.607079 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-6c8753c2-b6c6-478a-969c-7c9a9123e0e7 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] [instance: 258bc0cb-6718-4f8b-8d0b-ef544b2b659b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:40.630353 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6c8753c2-b6c6-478a-969c-7c9a9123e0e7 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:40.635366 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6c8753c2-b6c6-478a-969c-7c9a9123e0e7 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:40.636011 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6c8753c2-b6c6-478a-969c-7c9a9123e0e7 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:40.639966 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6c8753c2-b6c6-478a-969c-7c9a9123e0e7 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:40.640779 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6c8753c2-b6c6-478a-969c-7c9a9123e0e7 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:40.641807 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6c8753c2-b6c6-478a-969c-7c9a9123e0e7 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:40.730017 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=100 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:44:40.792296 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-f5cacfb3-2d3e-43c5-8551-514d828f8479 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:44:40.801416 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-f5cacfb3-2d3e-43c5-8551-514d828f8479 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/ec437ce7-b43a-4c8b-8a06-756cfb877851" status: 200 len: 1477 microversion: 2.1 time: 1.366279 Oct 04 21:44:40.802279 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 238/457] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:44:39 2022] GET /compute/v2.1/servers/ec437ce7-b43a-4c8b-8a06-756cfb877851 => generated 1477 bytes in 1368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:44:40.823336 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-0fcc2a41-27c9-410d-bf5c-9160767cc635 tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:40.823978 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-0fcc2a41-27c9-410d-bf5c-9160767cc635 tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] [instance: 3eeb7190-8e00-4c8c-bfd7-a15da2a3e376] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:40.836680 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0fcc2a41-27c9-410d-bf5c-9160767cc635 tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:40.837561 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0fcc2a41-27c9-410d-bf5c-9160767cc635 tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:40.838229 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0fcc2a41-27c9-410d-bf5c-9160767cc635 tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:40.839604 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0fcc2a41-27c9-410d-bf5c-9160767cc635 tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:40.840302 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0fcc2a41-27c9-410d-bf5c-9160767cc635 tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:40.849466 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0fcc2a41-27c9-410d-bf5c-9160767cc635 tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:41.315216 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-0fcc2a41-27c9-410d-bf5c-9160767cc635 tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539a93c63ab34b789903970b57b96bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8179a9b323b74a789fa7d5a4507cb6b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:44:41.323812 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-0fcc2a41-27c9-410d-bf5c-9160767cc635 tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] 10.222.0.43 "GET /compute/v2.1/servers/3eeb7190-8e00-4c8c-bfd7-a15da2a3e376" status: 200 len: 1472 microversion: 2.1 time: 0.520258 Oct 04 21:44:41.324736 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 239/458] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:44:40 2022] GET /compute/v2.1/servers/3eeb7190-8e00-4c8c-bfd7-a15da2a3e376 => generated 1472 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:44:41.364704 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-6c8753c2-b6c6-478a-969c-7c9a9123e0e7 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29842a669a20408b881105135f76cb0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39edf587afe94b60911198aa0bb61613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:44:41.394266 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-6c8753c2-b6c6-478a-969c-7c9a9123e0e7 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] 10.222.0.43 "GET /compute/v2.1/servers/258bc0cb-6718-4f8b-8d0b-ef544b2b659b" status: 200 len: 1317 microversion: 2.1 time: 0.799988 Oct 04 21:44:41.399106 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 220/459] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:44:40 2022] GET /compute/v2.1/servers/258bc0cb-6718-4f8b-8d0b-ef544b2b659b => generated 1317 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:44:41.417637 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-eca5887d-5c0b-4896-ba6c-a47b3d9cc1ca req-7e715dcc-ee1b-411a-8bc8-e35c183d2964 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "258bc0cb-6718-4f8b-8d0b-ef544b2b659b", "name": "network-vif-plugged", "status": "completed", "tag": "11865c88-bab8-4b1b-af2e-a51d5befe968"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:44:41.441874 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-eca5887d-5c0b-4896-ba6c-a47b3d9cc1ca req-7e715dcc-ee1b-411a-8bc8-e35c183d2964 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:41.442701 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-eca5887d-5c0b-4896-ba6c-a47b3d9cc1ca req-7e715dcc-ee1b-411a-8bc8-e35c183d2964 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:41.443329 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-eca5887d-5c0b-4896-ba6c-a47b3d9cc1ca req-7e715dcc-ee1b-411a-8bc8-e35c183d2964 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:41.466766 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-eca5887d-5c0b-4896-ba6c-a47b3d9cc1ca req-7e715dcc-ee1b-411a-8bc8-e35c183d2964 service nova] Creating event network-vif-plugged:11865c88-bab8-4b1b-af2e-a51d5befe968 for instance 258bc0cb-6718-4f8b-8d0b-ef544b2b659b on n-h1-860284-1 Oct 04 21:44:41.484333 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-eca5887d-5c0b-4896-ba6c-a47b3d9cc1ca req-7e715dcc-ee1b-411a-8bc8-e35c183d2964 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080964 Oct 04 21:44:41.488226 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 221/460] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:44:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:44:41.497463 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-389c85b1-a9ad-49af-9fe7-b63c5259f2e4 tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:41.498059 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-389c85b1-a9ad-49af-9fe7-b63c5259f2e4 tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] [instance: 3eeb7190-8e00-4c8c-bfd7-a15da2a3e376] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:41.529620 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-389c85b1-a9ad-49af-9fe7-b63c5259f2e4 tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:41.530120 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-389c85b1-a9ad-49af-9fe7-b63c5259f2e4 tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:41.530763 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-389c85b1-a9ad-49af-9fe7-b63c5259f2e4 tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:41.531649 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-389c85b1-a9ad-49af-9fe7-b63c5259f2e4 tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:41.532682 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-389c85b1-a9ad-49af-9fe7-b63c5259f2e4 tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:41.537557 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-389c85b1-a9ad-49af-9fe7-b63c5259f2e4 tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:41.577772 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-389c85b1-a9ad-49af-9fe7-b63c5259f2e4 tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': '539a93c63ab34b789903970b57b96bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8179a9b323b74a789fa7d5a4507cb6b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:44:41.580368 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-389c85b1-a9ad-49af-9fe7-b63c5259f2e4 tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] Request method failure captured: Oct 04 21:44:41.580368 n-d-860284-1 devstack@n-api.service[134102]: request: GET /compute/v2.1/servers/3eeb7190-8e00-4c8c-bfd7-a15da2a3e376/diagnostics HTTP/1.1 Oct 04 21:44:41.580368 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 21:44:41.580368 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 21:44:41.580368 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 21:44:41.580368 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 21:44:41.580368 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 21:44:41.580368 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 21:44:41.580368 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 21:44:41.580368 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 21:44:41.580368 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPKkyIwT4ZBKPKPNyf_67uJmWcfv-Ey6yfxNijx502czjjjvs4xevjqm0A4ss7yIlHYPCymtf3enU-6TbihQwRV3W1vXwQu3dB6Gn_ckkOXQcYyWsmwUBBLwdXdVmk42YPlY3ruYiPZN5LmMR_8dwuQGlo8CDFe8-IWv7Mj72mQf_xz0 Oct 04 21:44:41.580368 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 21:44:41.580368 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 21:44:41.580368 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 21:44:41.580368 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 21:44:41.580368 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 21:44:41.580368 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 21:44:41.580368 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: 8179a9b323b74a789fa7d5a4507cb6b3 Oct 04 21:44:41.580368 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-349809873 Oct 04 21:44:41.580368 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 21:44:41.580368 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 21:44:41.581902 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8179a9b323b74a789fa7d5a4507cb6b3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_8179a9b323b74a789fa7d5a4507cb6b3", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8179a9b323b74a789fa7d5a4507cb6b3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/8179a9b323b74a789fa7d5a4507cb6b3"}]}] Oct 04 21:44:41.581902 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-349809873 Oct 04 21:44:41.581902 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: 8179a9b323b74a789fa7d5a4507cb6b3 Oct 04 21:44:41.581902 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-349809873 Oct 04 21:44:41.581902 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-ServerDiagnosticsNegativeTest-349809873-project Oct 04 21:44:41.581902 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 21:44:41.581902 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 21:44:41.581902 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: 539a93c63ab34b789903970b57b96bd6 Oct 04 21:44:41.581902 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-349809873-project Oct 04 21:44:41.581902 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 21:44:41.581902 n-d-860284-1 devstack@n-api.service[134102]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 04 21:44:41.582749 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'server_id': '3eeb7190-8e00-4c8c-bfd7-a15da2a3e376'} Oct 04 21:44:41.582749 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:44:41.582749 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:44:41.582749 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:44:41.582749 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:44:41.582749 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:44:41.582749 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:44:41.582749 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:44:41.582749 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:44:41.582749 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index Oct 04 21:44:41.582749 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, Oct 04 21:44:41.582749 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 21:44:41.582749 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 21:44:41.582749 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 21:44:41.582749 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 21:44:41.582749 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 21:44:41.582749 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 21:44:41.582749 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 21:44:41.582749 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 21:44:41.582749 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 21:44:41.584152 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 21:44:41.584152 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 21:44:41.584152 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 21:44:41.584152 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 21:44:41.584152 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 21:44:41.584152 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 04 21:44:41.584152 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:44:41.584152 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:44:41.584152 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:44:41.584152 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:44:41.584152 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:44:41.584152 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:44:41.584152 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 21:44:41.584152 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 21:44:41.584152 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 04 21:44:41.584152 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:44:41.587358 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-389c85b1-a9ad-49af-9fe7-b63c5259f2e4 tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:44:41.588438 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-389c85b1-a9ad-49af-9fe7-b63c5259f2e4 tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] 10.222.0.43 "GET /compute/v2.1/servers/3eeb7190-8e00-4c8c-bfd7-a15da2a3e376/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.099010 Oct 04 21:44:41.589516 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 222/461] 10.222.0.43 () {58 vars in 1272 bytes} [Tue Oct 4 21:44:41 2022] GET /compute/v2.1/servers/3eeb7190-8e00-4c8c-bfd7-a15da2a3e376/diagnostics => generated 117 bytes in 101 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:44:41.602843 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-2b4233e8-86a0-49d4-9fea-d128d3469aff tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:41.603422 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-2b4233e8-86a0-49d4-9fea-d128d3469aff tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] [instance: 3eeb7190-8e00-4c8c-bfd7-a15da2a3e376] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:41.612495 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2b4233e8-86a0-49d4-9fea-d128d3469aff tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:41.613478 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2b4233e8-86a0-49d4-9fea-d128d3469aff tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:41.613944 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2b4233e8-86a0-49d4-9fea-d128d3469aff tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:41.614746 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2b4233e8-86a0-49d4-9fea-d128d3469aff tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:41.615210 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2b4233e8-86a0-49d4-9fea-d128d3469aff tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:41.619062 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2b4233e8-86a0-49d4-9fea-d128d3469aff tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:41.675803 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-2b4233e8-86a0-49d4-9fea-d128d3469aff tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] [instance: 3eeb7190-8e00-4c8c-bfd7-a15da2a3e376] Going to try to terminate instance {{(pid=134102) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:44:41.815476 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-9eba150b-3e35-48cb-af01-ab2a1cec8e46 tempest-FlavorsExtraSpecsNegativeTestJSON-1255951022 tempest-FlavorsExtraSpecsNegativeTestJSON-1255951022-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:41.824450 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-2b4233e8-86a0-49d4-9fea-d128d3469aff tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] 10.222.0.43 "DELETE /compute/v2.1/servers/3eeb7190-8e00-4c8c-bfd7-a15da2a3e376" status: 204 len: 0 microversion: 2.1 time: 0.229177 Oct 04 21:44:41.825742 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 223/462] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 21:44:41 2022] DELETE /compute/v2.1/servers/3eeb7190-8e00-4c8c-bfd7-a15da2a3e376 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:44:41.833976 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-9eba150b-3e35-48cb-af01-ab2a1cec8e46 tempest-FlavorsExtraSpecsNegativeTestJSON-1255951022 tempest-FlavorsExtraSpecsNegativeTestJSON-1255951022-project] HTTP exception thrown: Flavor 529323775 has no extra specs with key hw:cpu_thread_policy. Oct 04 21:44:41.839306 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-9eba150b-3e35-48cb-af01-ab2a1cec8e46 tempest-FlavorsExtraSpecsNegativeTestJSON-1255951022 tempest-FlavorsExtraSpecsNegativeTestJSON-1255951022-project] Request method failure captured: Oct 04 21:44:41.839306 n-d-860284-1 devstack@n-api.service[134101]: request: GET /compute/v2.1/flavors/529323775/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Oct 04 21:44:41.839306 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 21:44:41.839306 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 21:44:41.839306 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 21:44:41.839306 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 21:44:41.839306 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 21:44:41.839306 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 21:44:41.839306 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 21:44:41.839306 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 21:44:41.839306 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPKlGZqcSwVnD-ZrHviSsqgXxYn9XVyMUxUZ_B6G2XoNcujM_h4UHypdJZg-3OSbpQeJSfnlAcwxyigi5Pg3-PnX_uW2Cq3XKFR2iKduyvhDHjCcGPHw7VAvLOW_BF9HwqQUCFoJxPdzp-R8ajAfpjmSHAwF6wmDef6H5_AB_eJCCmr4 Oct 04 21:44:41.839306 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 21:44:41.839306 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 21:44:41.839306 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 21:44:41.839306 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 21:44:41.839306 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 21:44:41.839306 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 21:44:41.839306 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: b9d302e787234ec89b74ae0fa39d9511 Oct 04 21:44:41.839306 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1255951022 Oct 04 21:44:41.839306 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 21:44:41.839306 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 21:44:41.840849 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b9d302e787234ec89b74ae0fa39d9511"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_b9d302e787234ec89b74ae0fa39d9511", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b9d302e787234ec89b74ae0fa39d9511"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/b9d302e787234ec89b74ae0fa39d9511"}]}] Oct 04 21:44:41.840849 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1255951022 Oct 04 21:44:41.840849 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: b9d302e787234ec89b74ae0fa39d9511 Oct 04 21:44:41.840849 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1255951022 Oct 04 21:44:41.840849 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1255951022-project Oct 04 21:44:41.840849 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 21:44:41.840849 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 21:44:41.840849 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 8643a515b02b4b0bbf5fa6e7053b0684 Oct 04 21:44:41.840849 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1255951022-project Oct 04 21:44:41.840849 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 21:44:41.840849 n-d-860284-1 devstack@n-api.service[134101]: exception: Flavor 529323775 has no extra specs with key hw:cpu_thread_policy. Oct 04 21:44:41.841728 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'flavor_id': '529323775', 'id': 'hw:cpu_thread_policy'} Oct 04 21:44:41.841728 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:44:41.841728 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:44:41.841728 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show Oct 04 21:44:41.841728 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} Oct 04 21:44:41.841728 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Oct 04 21:44:41.841728 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:44:41.841728 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:44:41.841728 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:44:41.841728 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:44:41.841728 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:44:41.841728 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:44:41.841728 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:44:41.841728 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:44:41.841728 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:44:41.841728 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:44:41.841728 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show Oct 04 21:44:41.841728 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 04 21:44:41.841728 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 529323775 has no extra specs with key hw:cpu_thread_policy. Oct 04 21:44:41.841728 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:44:41.841728 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:44:41.841728 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:44:41.843300 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:44:41.843300 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:44:41.843300 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:44:41.843300 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:44:41.843300 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:44:41.843300 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 529323775 has no extra specs with key hw:cpu_thread_policy. Oct 04 21:44:41.843300 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:44:41.843817 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-5912fd46-97e2-4b33-9a40-ce663858ec0c tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:41.843817 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-5912fd46-97e2-4b33-9a40-ce663858ec0c tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: ec437ce7-b43a-4c8b-8a06-756cfb877851] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:41.850008 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5912fd46-97e2-4b33-9a40-ce663858ec0c tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:41.851943 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5912fd46-97e2-4b33-9a40-ce663858ec0c tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:41.852187 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-9eba150b-3e35-48cb-af01-ab2a1cec8e46 tempest-FlavorsExtraSpecsNegativeTestJSON-1255951022 tempest-FlavorsExtraSpecsNegativeTestJSON-1255951022-project] Returning 404 to user: Flavor 529323775 has no extra specs with key hw:cpu_thread_policy. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:44:41.852717 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5912fd46-97e2-4b33-9a40-ce663858ec0c tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:41.853713 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5912fd46-97e2-4b33-9a40-ce663858ec0c tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:41.853829 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-9eba150b-3e35-48cb-af01-ab2a1cec8e46 tempest-FlavorsExtraSpecsNegativeTestJSON-1255951022 tempest-FlavorsExtraSpecsNegativeTestJSON-1255951022-project] 10.222.0.43 "GET /compute/v2.1/flavors/529323775/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 112 microversion: 2.1 time: 0.513284 Oct 04 21:44:41.854973 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 240/463] 10.222.0.43 () {58 vars in 1263 bytes} [Tue Oct 4 21:44:41 2022] GET /compute/v2.1/flavors/529323775/os-extra_specs/hw:cpu_thread_policy => generated 112 bytes in 515 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:44:41.859445 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5912fd46-97e2-4b33-9a40-ce663858ec0c tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:41.859962 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5912fd46-97e2-4b33-9a40-ce663858ec0c tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:41.870958 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-573f3884-cbaa-4866-8ea6-f8ae4ae5ce73 tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:41.871596 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-573f3884-cbaa-4866-8ea6-f8ae4ae5ce73 tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] [instance: 3eeb7190-8e00-4c8c-bfd7-a15da2a3e376] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:41.892964 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-573f3884-cbaa-4866-8ea6-f8ae4ae5ce73 tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:41.893445 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-573f3884-cbaa-4866-8ea6-f8ae4ae5ce73 tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:41.894314 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-573f3884-cbaa-4866-8ea6-f8ae4ae5ce73 tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:41.895534 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-573f3884-cbaa-4866-8ea6-f8ae4ae5ce73 tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:41.897638 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-573f3884-cbaa-4866-8ea6-f8ae4ae5ce73 tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:41.899076 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-573f3884-cbaa-4866-8ea6-f8ae4ae5ce73 tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:42.492643 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-573f3884-cbaa-4866-8ea6-f8ae4ae5ce73 tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539a93c63ab34b789903970b57b96bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8179a9b323b74a789fa7d5a4507cb6b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:44:42.514814 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-573f3884-cbaa-4866-8ea6-f8ae4ae5ce73 tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] 10.222.0.43 "GET /compute/v2.1/servers/3eeb7190-8e00-4c8c-bfd7-a15da2a3e376" status: 200 len: 1478 microversion: 2.1 time: 0.658456 Oct 04 21:44:42.518862 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-5912fd46-97e2-4b33-9a40-ce663858ec0c tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:44:42.527156 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 241/464] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:44:41 2022] GET /compute/v2.1/servers/3eeb7190-8e00-4c8c-bfd7-a15da2a3e376 => generated 1478 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:44:42.529153 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-5912fd46-97e2-4b33-9a40-ce663858ec0c tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/ec437ce7-b43a-4c8b-8a06-756cfb877851" status: 200 len: 1477 microversion: 2.1 time: 0.700514 Oct 04 21:44:42.532143 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 224/465] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:44:41 2022] GET /compute/v2.1/servers/ec437ce7-b43a-4c8b-8a06-756cfb877851 => generated 1477 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:44:42.552636 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-8d0f4dc7-f53d-45a9-87c4-7723d598bc91 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:42.554995 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-8d0f4dc7-f53d-45a9-87c4-7723d598bc91 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] [instance: 258bc0cb-6718-4f8b-8d0b-ef544b2b659b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:42.556621 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-4eaef440-8b3b-4659-96fb-c5a07490ea97 tempest-FlavorsExtraSpecsNegativeTestJSON-1255951022 tempest-FlavorsExtraSpecsNegativeTestJSON-1255951022-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:44:42.560604 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-4eaef440-8b3b-4659-96fb-c5a07490ea97 tempest-FlavorsExtraSpecsNegativeTestJSON-1255951022 tempest-FlavorsExtraSpecsNegativeTestJSON-1255951022-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': '8643a515b02b4b0bbf5fa6e7053b0684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d302e787234ec89b74ae0fa39d9511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:44:42.564009 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-4eaef440-8b3b-4659-96fb-c5a07490ea97 tempest-FlavorsExtraSpecsNegativeTestJSON-1255951022 tempest-FlavorsExtraSpecsNegativeTestJSON-1255951022-project] Request method failure captured: Oct 04 21:44:42.564009 n-d-860284-1 devstack@n-api.service[134101]: request: POST /compute/v2.1/flavors/529323775/os-extra_specs HTTP/1.1 Oct 04 21:44:42.564009 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 21:44:42.564009 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 21:44:42.564009 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 21:44:42.564009 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 66 Oct 04 21:44:42.564009 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 21:44:42.564009 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 21:44:42.564009 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 21:44:42.564009 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 21:44:42.564009 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPKlGZqcSwVnD-ZrHviSsqgXxYn9XVyMUxUZ_B6G2XoNcujM_h4UHypdJZg-3OSbpQeJSfnlAcwxyigi5Pg3-PnX_uW2Cq3XKFR2iKduyvhDHjCcGPHw7VAvLOW_BF9HwqQUCFoJxPdzp-R8ajAfpjmSHAwF6wmDef6H5_AB_eJCCmr4 Oct 04 21:44:42.564009 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 21:44:42.564009 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 21:44:42.564009 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 21:44:42.564009 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 21:44:42.564009 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 21:44:42.564009 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 21:44:42.564009 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: b9d302e787234ec89b74ae0fa39d9511 Oct 04 21:44:42.564009 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1255951022 Oct 04 21:44:42.564009 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 21:44:42.564009 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 21:44:42.565875 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b9d302e787234ec89b74ae0fa39d9511"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_b9d302e787234ec89b74ae0fa39d9511", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b9d302e787234ec89b74ae0fa39d9511"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/b9d302e787234ec89b74ae0fa39d9511"}]}] Oct 04 21:44:42.565875 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1255951022 Oct 04 21:44:42.565875 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: b9d302e787234ec89b74ae0fa39d9511 Oct 04 21:44:42.565875 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1255951022 Oct 04 21:44:42.565875 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1255951022-project Oct 04 21:44:42.565875 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 21:44:42.565875 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 21:44:42.565875 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 8643a515b02b4b0bbf5fa6e7053b0684 Oct 04 21:44:42.565875 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1255951022-project Oct 04 21:44:42.565875 n-d-860284-1 devstack@n-api.service[134101]: Oct 04 21:44:42.565875 n-d-860284-1 devstack@n-api.service[134101]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} Oct 04 21:44:42.565875 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 21:44:42.566591 n-d-860284-1 devstack@n-api.service[134101]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 04 21:44:42.566591 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'flavor_id': '529323775', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} Oct 04 21:44:42.566591 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:44:42.566591 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:44:42.566591 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:44:42.566591 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:44:42.566591 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:44:42.566591 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:44:42.566591 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:44:42.566591 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:44:42.566591 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:44:42.566591 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:44:42.566591 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create Oct 04 21:44:42.566591 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) Oct 04 21:44:42.566591 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 21:44:42.566591 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 21:44:42.566591 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 21:44:42.566591 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 21:44:42.566591 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 21:44:42.567665 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 21:44:42.567665 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 21:44:42.567665 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 21:44:42.567665 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 21:44:42.567665 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 21:44:42.567665 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 21:44:42.567665 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 21:44:42.567665 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 21:44:42.567665 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 21:44:42.567665 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 04 21:44:42.567665 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:44:42.567665 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:44:42.567665 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:44:42.567665 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:44:42.567665 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:44:42.567665 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:44:42.567665 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 21:44:42.567665 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 21:44:42.567665 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 04 21:44:42.567665 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:44:42.571839 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-4eaef440-8b3b-4659-96fb-c5a07490ea97 tempest-FlavorsExtraSpecsNegativeTestJSON-1255951022 tempest-FlavorsExtraSpecsNegativeTestJSON-1255951022-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:44:42.573574 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-4eaef440-8b3b-4659-96fb-c5a07490ea97 tempest-FlavorsExtraSpecsNegativeTestJSON-1255951022 tempest-FlavorsExtraSpecsNegativeTestJSON-1255951022-project] 10.222.0.43 "POST /compute/v2.1/flavors/529323775/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.045353 Oct 04 21:44:42.582282 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8d0f4dc7-f53d-45a9-87c4-7723d598bc91 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:42.582282 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8d0f4dc7-f53d-45a9-87c4-7723d598bc91 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:42.582282 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8d0f4dc7-f53d-45a9-87c4-7723d598bc91 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:42.582282 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8d0f4dc7-f53d-45a9-87c4-7723d598bc91 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:42.582941 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8d0f4dc7-f53d-45a9-87c4-7723d598bc91 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:42.582941 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8d0f4dc7-f53d-45a9-87c4-7723d598bc91 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:42.586065 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 242/466] 10.222.0.43 () {60 vars in 1221 bytes} [Tue Oct 4 21:44:42 2022] POST /compute/v2.1/flavors/529323775/os-extra_specs => generated 124 bytes in 58 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:44:42.591927 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-422ad969-9a07-4e31-a16f-86e33d30db3e tempest-FlavorsExtraSpecsNegativeTestJSON-1215230648 tempest-FlavorsExtraSpecsNegativeTestJSON-1215230648-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:44:42.653779 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-422ad969-9a07-4e31-a16f-86e33d30db3e tempest-FlavorsExtraSpecsNegativeTestJSON-1215230648 tempest-FlavorsExtraSpecsNegativeTestJSON-1215230648-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors/529323775/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.065714 Oct 04 21:44:42.661204 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 243/467] 10.222.0.43 () {60 vars in 1221 bytes} [Tue Oct 4 21:44:42 2022] POST /compute/v2.1/flavors/529323775/os-extra_specs => generated 66 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 21:44:42.668249 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-c0dbad02-7119-43db-836a-00eb6185eed2 tempest-FlavorsExtraSpecsNegativeTestJSON-1255951022 tempest-FlavorsExtraSpecsNegativeTestJSON-1255951022-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:42.670224 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-c0dbad02-7119-43db-836a-00eb6185eed2 tempest-FlavorsExtraSpecsNegativeTestJSON-1255951022 tempest-FlavorsExtraSpecsNegativeTestJSON-1255951022-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': '8643a515b02b4b0bbf5fa6e7053b0684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d302e787234ec89b74ae0fa39d9511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:44:42.672069 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-c0dbad02-7119-43db-836a-00eb6185eed2 tempest-FlavorsExtraSpecsNegativeTestJSON-1255951022 tempest-FlavorsExtraSpecsNegativeTestJSON-1255951022-project] Request method failure captured: Oct 04 21:44:42.672069 n-d-860284-1 devstack@n-api.service[134101]: request: DELETE /compute/v2.1/flavors/529323775/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 04 21:44:42.672069 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 21:44:42.672069 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 21:44:42.672069 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 21:44:42.672069 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 21:44:42.672069 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 21:44:42.672069 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 21:44:42.672069 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 21:44:42.672069 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 21:44:42.672069 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPKlGZqcSwVnD-ZrHviSsqgXxYn9XVyMUxUZ_B6G2XoNcujM_h4UHypdJZg-3OSbpQeJSfnlAcwxyigi5Pg3-PnX_uW2Cq3XKFR2iKduyvhDHjCcGPHw7VAvLOW_BF9HwqQUCFoJxPdzp-R8ajAfpjmSHAwF6wmDef6H5_AB_eJCCmr4 Oct 04 21:44:42.672069 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 21:44:42.672069 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 21:44:42.672069 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 21:44:42.672069 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 21:44:42.672069 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 21:44:42.672069 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 21:44:42.672069 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: b9d302e787234ec89b74ae0fa39d9511 Oct 04 21:44:42.672069 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1255951022 Oct 04 21:44:42.672069 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 21:44:42.672069 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 21:44:42.673300 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b9d302e787234ec89b74ae0fa39d9511"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_b9d302e787234ec89b74ae0fa39d9511", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b9d302e787234ec89b74ae0fa39d9511"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/b9d302e787234ec89b74ae0fa39d9511"}]}] Oct 04 21:44:42.673300 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1255951022 Oct 04 21:44:42.673300 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: b9d302e787234ec89b74ae0fa39d9511 Oct 04 21:44:42.673300 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1255951022 Oct 04 21:44:42.673300 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1255951022-project Oct 04 21:44:42.673300 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 21:44:42.673300 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 21:44:42.673300 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 8643a515b02b4b0bbf5fa6e7053b0684 Oct 04 21:44:42.673300 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1255951022-project Oct 04 21:44:42.673300 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 21:44:42.673300 n-d-860284-1 devstack@n-api.service[134101]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 04 21:44:42.673918 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'flavor_id': '529323775', 'id': 'hw:numa_nodes'} Oct 04 21:44:42.673918 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:44:42.673918 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:44:42.673918 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:44:42.673918 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:44:42.673918 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:44:42.673918 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:44:42.673918 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:44:42.673918 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:44:42.673918 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete Oct 04 21:44:42.673918 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) Oct 04 21:44:42.673918 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 21:44:42.673918 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 21:44:42.673918 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 21:44:42.673918 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 21:44:42.673918 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 21:44:42.673918 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 21:44:42.673918 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 21:44:42.673918 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 21:44:42.673918 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 21:44:42.675133 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 21:44:42.675133 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 21:44:42.675133 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 21:44:42.675133 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 21:44:42.675133 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 21:44:42.675133 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 04 21:44:42.675133 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:44:42.675133 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:44:42.675133 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:44:42.675133 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:44:42.675133 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:44:42.675133 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:44:42.675133 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 21:44:42.675133 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 21:44:42.675133 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 04 21:44:42.675133 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:44:42.680939 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-c0dbad02-7119-43db-836a-00eb6185eed2 tempest-FlavorsExtraSpecsNegativeTestJSON-1255951022 tempest-FlavorsExtraSpecsNegativeTestJSON-1255951022-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:44:42.682091 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-c0dbad02-7119-43db-836a-00eb6185eed2 tempest-FlavorsExtraSpecsNegativeTestJSON-1255951022 tempest-FlavorsExtraSpecsNegativeTestJSON-1255951022-project] 10.222.0.43 "DELETE /compute/v2.1/flavors/529323775/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.019469 Oct 04 21:44:42.687496 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 244/468] 10.222.0.43 () {58 vars in 1245 bytes} [Tue Oct 4 21:44:42 2022] DELETE /compute/v2.1/flavors/529323775/os-extra_specs/hw:numa_nodes => generated 124 bytes in 25 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:44:42.697794 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-9fe75e45-3260-4803-a788-0cb80e5952d4 tempest-FlavorsExtraSpecsNegativeTestJSON-1215230648 tempest-FlavorsExtraSpecsNegativeTestJSON-1215230648-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:44:42.781466 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-9fe75e45-3260-4803-a788-0cb80e5952d4 tempest-FlavorsExtraSpecsNegativeTestJSON-1215230648 tempest-FlavorsExtraSpecsNegativeTestJSON-1215230648-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors/529323775/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.092432 Oct 04 21:44:42.788873 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 245/469] 10.222.0.43 () {60 vars in 1221 bytes} [Tue Oct 4 21:44:42 2022] POST /compute/v2.1/flavors/529323775/os-extra_specs => generated 66 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 21:44:42.805027 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-f24b3839-dc96-455c-abac-cd43c6568275 tempest-FlavorsExtraSpecsNegativeTestJSON-1255951022 tempest-FlavorsExtraSpecsNegativeTestJSON-1255951022-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:44:42.809647 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-f24b3839-dc96-455c-abac-cd43c6568275 tempest-FlavorsExtraSpecsNegativeTestJSON-1255951022 tempest-FlavorsExtraSpecsNegativeTestJSON-1255951022-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': '8643a515b02b4b0bbf5fa6e7053b0684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d302e787234ec89b74ae0fa39d9511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:44:42.811322 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-f24b3839-dc96-455c-abac-cd43c6568275 tempest-FlavorsExtraSpecsNegativeTestJSON-1255951022 tempest-FlavorsExtraSpecsNegativeTestJSON-1255951022-project] Request method failure captured: Oct 04 21:44:42.811322 n-d-860284-1 devstack@n-api.service[134101]: request: PUT /compute/v2.1/flavors/529323775/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 04 21:44:42.811322 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 21:44:42.811322 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 21:44:42.811322 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 21:44:42.811322 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 22 Oct 04 21:44:42.811322 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 21:44:42.811322 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 21:44:42.811322 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 21:44:42.811322 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 21:44:42.811322 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPKlGZqcSwVnD-ZrHviSsqgXxYn9XVyMUxUZ_B6G2XoNcujM_h4UHypdJZg-3OSbpQeJSfnlAcwxyigi5Pg3-PnX_uW2Cq3XKFR2iKduyvhDHjCcGPHw7VAvLOW_BF9HwqQUCFoJxPdzp-R8ajAfpjmSHAwF6wmDef6H5_AB_eJCCmr4 Oct 04 21:44:42.811322 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 21:44:42.811322 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 21:44:42.811322 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 21:44:42.811322 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 21:44:42.811322 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 21:44:42.811322 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 21:44:42.811322 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: b9d302e787234ec89b74ae0fa39d9511 Oct 04 21:44:42.811322 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1255951022 Oct 04 21:44:42.811322 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 21:44:42.811322 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 21:44:42.812707 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b9d302e787234ec89b74ae0fa39d9511"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_b9d302e787234ec89b74ae0fa39d9511", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b9d302e787234ec89b74ae0fa39d9511"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/b9d302e787234ec89b74ae0fa39d9511"}]}] Oct 04 21:44:42.812707 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1255951022 Oct 04 21:44:42.812707 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: b9d302e787234ec89b74ae0fa39d9511 Oct 04 21:44:42.812707 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1255951022 Oct 04 21:44:42.812707 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1255951022-project Oct 04 21:44:42.812707 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 21:44:42.812707 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 21:44:42.812707 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 8643a515b02b4b0bbf5fa6e7053b0684 Oct 04 21:44:42.812707 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1255951022-project Oct 04 21:44:42.812707 n-d-860284-1 devstack@n-api.service[134101]: Oct 04 21:44:42.812707 n-d-860284-1 devstack@n-api.service[134101]: {"hw:numa_nodes": "1"} Oct 04 21:44:42.812707 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 21:44:42.812707 n-d-860284-1 devstack@n-api.service[134101]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 04 21:44:42.813587 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'flavor_id': '529323775', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} Oct 04 21:44:42.813587 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:44:42.813587 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:44:42.813587 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:44:42.813587 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:44:42.813587 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:44:42.813587 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:44:42.813587 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:44:42.813587 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:44:42.813587 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:44:42.813587 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:44:42.813587 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update Oct 04 21:44:42.813587 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) Oct 04 21:44:42.813587 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 21:44:42.813587 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 21:44:42.813587 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 21:44:42.813587 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 21:44:42.813587 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 21:44:42.813587 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 21:44:42.814808 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 21:44:42.814808 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 21:44:42.814808 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 21:44:42.814808 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 21:44:42.814808 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 21:44:42.814808 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 21:44:42.814808 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 21:44:42.814808 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 21:44:42.814808 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 04 21:44:42.814808 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:44:42.814808 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:44:42.814808 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:44:42.814808 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:44:42.814808 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:44:42.814808 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:44:42.814808 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 21:44:42.814808 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 21:44:42.814808 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 04 21:44:42.814808 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:44:42.823504 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-f24b3839-dc96-455c-abac-cd43c6568275 tempest-FlavorsExtraSpecsNegativeTestJSON-1255951022 tempest-FlavorsExtraSpecsNegativeTestJSON-1255951022-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:44:42.825121 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-f24b3839-dc96-455c-abac-cd43c6568275 tempest-FlavorsExtraSpecsNegativeTestJSON-1255951022 tempest-FlavorsExtraSpecsNegativeTestJSON-1255951022-project] 10.222.0.43 "PUT /compute/v2.1/flavors/529323775/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.032914 Oct 04 21:44:42.826041 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 246/470] 10.222.0.43 () {60 vars in 1262 bytes} [Tue Oct 4 21:44:42 2022] PUT /compute/v2.1/flavors/529323775/os-extra_specs/hw:numa_nodes => generated 124 bytes in 34 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:44:42.886747 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-4bbcdd78-003a-41b0-ad6d-87bec9280b67 tempest-FlavorsExtraSpecsNegativeTestJSON-1215230648 tempest-FlavorsExtraSpecsNegativeTestJSON-1215230648-project-admin] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:42.925982 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-4bbcdd78-003a-41b0-ad6d-87bec9280b67 tempest-FlavorsExtraSpecsNegativeTestJSON-1215230648 tempest-FlavorsExtraSpecsNegativeTestJSON-1215230648-project-admin] HTTP exception thrown: Flavor 529323775 has no extra specs with key hw:cpu_thread_policy. Oct 04 21:44:42.927724 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-4bbcdd78-003a-41b0-ad6d-87bec9280b67 tempest-FlavorsExtraSpecsNegativeTestJSON-1215230648 tempest-FlavorsExtraSpecsNegativeTestJSON-1215230648-project-admin] Request method failure captured: Oct 04 21:44:42.927724 n-d-860284-1 devstack@n-api.service[134101]: request: DELETE /compute/v2.1/flavors/529323775/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Oct 04 21:44:42.927724 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 21:44:42.927724 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 21:44:42.927724 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 21:44:42.927724 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 21:44:42.927724 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 21:44:42.927724 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 21:44:42.927724 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 21:44:42.927724 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 21:44:42.927724 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPKlHlf8ZuRHMSwmQ5Fsezas2EWUJiB7XX0qBOi5TwwVvOrU8xJXMaEnNDBv_e1H9FfytXfK32eXbZwmDVyAAmOk2hx6x2HSkYyTvH4fL4XBvRzKvJWRhBdMc0YBdcTjB3uFFpy-ugo6yUCvtuDVJ-Vj9BuJAoqmApDwnT_oSqW9oTT8 Oct 04 21:44:42.927724 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 21:44:42.927724 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 21:44:42.927724 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 21:44:42.927724 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 21:44:42.927724 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 21:44:42.927724 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 21:44:42.927724 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: 5b43987f8cde43989e42a6fd9f8e721b Oct 04 21:44:42.927724 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1215230648 Oct 04 21:44:42.927724 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,admin,member Oct 04 21:44:42.927724 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,admin,member Oct 04 21:44:42.929600 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5b43987f8cde43989e42a6fd9f8e721b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_5b43987f8cde43989e42a6fd9f8e721b", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5b43987f8cde43989e42a6fd9f8e721b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/5b43987f8cde43989e42a6fd9f8e721b"}]}] Oct 04 21:44:42.929600 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1215230648 Oct 04 21:44:42.929600 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: 5b43987f8cde43989e42a6fd9f8e721b Oct 04 21:44:42.929600 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1215230648 Oct 04 21:44:42.929600 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1215230648-project-admin Oct 04 21:44:42.929600 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 21:44:42.929600 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 21:44:42.929600 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: f521f0ba6ca84374a077ffc58d82f042 Oct 04 21:44:42.929600 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1215230648-project-admin Oct 04 21:44:42.929600 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 21:44:42.929600 n-d-860284-1 devstack@n-api.service[134101]: exception: Flavor 529323775 has no extra specs with key hw:cpu_thread_policy. Oct 04 21:44:42.930312 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'flavor_id': '529323775', 'id': 'hw:cpu_thread_policy'} Oct 04 21:44:42.930312 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:44:42.930312 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:44:42.930312 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete Oct 04 21:44:42.930312 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] Oct 04 21:44:42.930312 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Oct 04 21:44:42.930312 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:44:42.930312 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:44:42.930312 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:44:42.930312 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:44:42.930312 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:44:42.930312 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:44:42.930312 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:44:42.930312 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:44:42.930312 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:44:42.930312 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:44:42.930312 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete Oct 04 21:44:42.930312 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 04 21:44:42.930312 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 529323775 has no extra specs with key hw:cpu_thread_policy. Oct 04 21:44:42.930312 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:44:42.930312 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:44:42.930312 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:44:42.931673 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:44:42.931673 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:44:42.931673 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:44:42.931673 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:44:42.931673 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:44:42.931673 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 529323775 has no extra specs with key hw:cpu_thread_policy. Oct 04 21:44:42.931673 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:44:42.938328 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-4bbcdd78-003a-41b0-ad6d-87bec9280b67 tempest-FlavorsExtraSpecsNegativeTestJSON-1215230648 tempest-FlavorsExtraSpecsNegativeTestJSON-1215230648-project-admin] Returning 404 to user: Flavor 529323775 has no extra specs with key hw:cpu_thread_policy. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:44:42.939482 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-4bbcdd78-003a-41b0-ad6d-87bec9280b67 tempest-FlavorsExtraSpecsNegativeTestJSON-1215230648 tempest-FlavorsExtraSpecsNegativeTestJSON-1215230648-project-admin] 10.222.0.43 "DELETE /compute/v2.1/flavors/529323775/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 112 microversion: 2.1 time: 0.089971 Oct 04 21:44:42.943995 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 247/471] 10.222.0.43 () {58 vars in 1266 bytes} [Tue Oct 4 21:44:42 2022] DELETE /compute/v2.1/flavors/529323775/os-extra_specs/hw:cpu_thread_policy => generated 112 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:44:42.958827 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-5077a206-05ff-4f06-8172-814c3e0617eb tempest-FlavorsExtraSpecsNegativeTestJSON-1215230648 tempest-FlavorsExtraSpecsNegativeTestJSON-1215230648-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:44:42.970842 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-5077a206-05ff-4f06-8172-814c3e0617eb tempest-FlavorsExtraSpecsNegativeTestJSON-1215230648 tempest-FlavorsExtraSpecsNegativeTestJSON-1215230648-project-admin] HTTP exception thrown: Request body and URI mismatch Oct 04 21:44:42.972496 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-5077a206-05ff-4f06-8172-814c3e0617eb tempest-FlavorsExtraSpecsNegativeTestJSON-1215230648 tempest-FlavorsExtraSpecsNegativeTestJSON-1215230648-project-admin] Request method failure captured: Oct 04 21:44:42.972496 n-d-860284-1 devstack@n-api.service[134101]: request: PUT /compute/v2.1/flavors/529323775/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 04 21:44:42.972496 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 21:44:42.972496 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 21:44:42.972496 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 21:44:42.972496 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 27 Oct 04 21:44:42.972496 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 21:44:42.972496 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 21:44:42.972496 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 21:44:42.972496 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 21:44:42.972496 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPKlHlf8ZuRHMSwmQ5Fsezas2EWUJiB7XX0qBOi5TwwVvOrU8xJXMaEnNDBv_e1H9FfytXfK32eXbZwmDVyAAmOk2hx6x2HSkYyTvH4fL4XBvRzKvJWRhBdMc0YBdcTjB3uFFpy-ugo6yUCvtuDVJ-Vj9BuJAoqmApDwnT_oSqW9oTT8 Oct 04 21:44:42.972496 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 21:44:42.972496 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 21:44:42.972496 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 21:44:42.972496 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 21:44:42.972496 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 21:44:42.972496 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 21:44:42.972496 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: 5b43987f8cde43989e42a6fd9f8e721b Oct 04 21:44:42.972496 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1215230648 Oct 04 21:44:42.972496 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,admin,member Oct 04 21:44:42.972496 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,admin,member Oct 04 21:44:42.973916 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5b43987f8cde43989e42a6fd9f8e721b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_5b43987f8cde43989e42a6fd9f8e721b", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5b43987f8cde43989e42a6fd9f8e721b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/5b43987f8cde43989e42a6fd9f8e721b"}]}] Oct 04 21:44:42.973916 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1215230648 Oct 04 21:44:42.973916 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: 5b43987f8cde43989e42a6fd9f8e721b Oct 04 21:44:42.973916 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1215230648 Oct 04 21:44:42.973916 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1215230648-project-admin Oct 04 21:44:42.973916 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 21:44:42.973916 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 21:44:42.973916 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: f521f0ba6ca84374a077ffc58d82f042 Oct 04 21:44:42.973916 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1215230648-project-admin Oct 04 21:44:42.973916 n-d-860284-1 devstack@n-api.service[134101]: Oct 04 21:44:42.973916 n-d-860284-1 devstack@n-api.service[134101]: {"hw:cpu_policy": "shared"} Oct 04 21:44:42.973916 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 21:44:42.973916 n-d-860284-1 devstack@n-api.service[134101]: exception: Request body and URI mismatch Oct 04 21:44:42.974899 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'flavor_id': '529323775', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} Oct 04 21:44:42.974899 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:44:42.974899 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:44:42.974899 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:44:42.974899 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:44:42.974899 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:44:42.974899 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:44:42.974899 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:44:42.974899 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:44:42.974899 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:44:42.974899 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:44:42.974899 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update Oct 04 21:44:42.974899 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) Oct 04 21:44:42.974899 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch Oct 04 21:44:42.974899 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:44:42.974899 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:44:42.974899 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:44:42.974899 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:44:42.974899 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:44:42.974899 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:44:42.976246 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:44:42.976246 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:44:42.976246 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch Oct 04 21:44:42.976246 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:44:42.976505 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-8d0f4dc7-f53d-45a9-87c4-7723d598bc91 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29842a669a20408b881105135f76cb0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39edf587afe94b60911198aa0bb61613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:44:42.979573 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-5077a206-05ff-4f06-8172-814c3e0617eb tempest-FlavorsExtraSpecsNegativeTestJSON-1215230648 tempest-FlavorsExtraSpecsNegativeTestJSON-1215230648-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:44:42.982961 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-5077a206-05ff-4f06-8172-814c3e0617eb tempest-FlavorsExtraSpecsNegativeTestJSON-1215230648 tempest-FlavorsExtraSpecsNegativeTestJSON-1215230648-project-admin] 10.222.0.43 "PUT /compute/v2.1/flavors/529323775/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.028253 Oct 04 21:44:42.985818 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-8d0f4dc7-f53d-45a9-87c4-7723d598bc91 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] 10.222.0.43 "GET /compute/v2.1/servers/258bc0cb-6718-4f8b-8d0b-ef544b2b659b" status: 200 len: 1317 microversion: 2.1 time: 0.437538 Oct 04 21:44:42.986055 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 248/472] 10.222.0.43 () {60 vars in 1262 bytes} [Tue Oct 4 21:44:42 2022] PUT /compute/v2.1/flavors/529323775/os-extra_specs/hw:numa_nodes => generated 73 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Oct 04 21:44:43.000076 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 225/473] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:44:42 2022] GET /compute/v2.1/servers/258bc0cb-6718-4f8b-8d0b-ef544b2b659b => generated 1317 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:44:43.000303 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-66f97ab1-fecd-4ff1-a89e-a215b21495aa tempest-FlavorsExtraSpecsNegativeTestJSON-1215230648 tempest-FlavorsExtraSpecsNegativeTestJSON-1215230648-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:44:43.010075 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-66f97ab1-fecd-4ff1-a89e-a215b21495aa tempest-FlavorsExtraSpecsNegativeTestJSON-1215230648 tempest-FlavorsExtraSpecsNegativeTestJSON-1215230648-project-admin] Request method failure captured: Oct 04 21:44:43.010075 n-d-860284-1 devstack@n-api.service[134101]: request: PUT /compute/v2.1/flavors/529323775/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 04 21:44:43.010075 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 21:44:43.010075 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 21:44:43.010075 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 21:44:43.010075 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 49 Oct 04 21:44:43.010075 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 21:44:43.010075 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 21:44:43.010075 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 21:44:43.010075 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 21:44:43.010075 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPKlHlf8ZuRHMSwmQ5Fsezas2EWUJiB7XX0qBOi5TwwVvOrU8xJXMaEnNDBv_e1H9FfytXfK32eXbZwmDVyAAmOk2hx6x2HSkYyTvH4fL4XBvRzKvJWRhBdMc0YBdcTjB3uFFpy-ugo6yUCvtuDVJ-Vj9BuJAoqmApDwnT_oSqW9oTT8 Oct 04 21:44:43.010075 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 21:44:43.010075 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 21:44:43.010075 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 21:44:43.010075 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 21:44:43.010075 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 21:44:43.010075 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 21:44:43.010075 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: 5b43987f8cde43989e42a6fd9f8e721b Oct 04 21:44:43.010075 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1215230648 Oct 04 21:44:43.010075 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,admin,member Oct 04 21:44:43.010075 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,admin,member Oct 04 21:44:43.011576 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5b43987f8cde43989e42a6fd9f8e721b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_5b43987f8cde43989e42a6fd9f8e721b", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5b43987f8cde43989e42a6fd9f8e721b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/5b43987f8cde43989e42a6fd9f8e721b"}]}] Oct 04 21:44:43.011576 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1215230648 Oct 04 21:44:43.011576 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: 5b43987f8cde43989e42a6fd9f8e721b Oct 04 21:44:43.011576 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1215230648 Oct 04 21:44:43.011576 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1215230648-project-admin Oct 04 21:44:43.011576 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 21:44:43.011576 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 21:44:43.011576 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: f521f0ba6ca84374a077ffc58d82f042 Oct 04 21:44:43.011576 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1215230648-project-admin Oct 04 21:44:43.011576 n-d-860284-1 devstack@n-api.service[134101]: Oct 04 21:44:43.011576 n-d-860284-1 devstack@n-api.service[134101]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} Oct 04 21:44:43.011576 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 21:44:43.012278 n-d-860284-1 devstack@n-api.service[134101]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 04 21:44:43.012278 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'flavor_id': '529323775', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} Oct 04 21:44:43.012278 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:44:43.012278 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:44:43.012278 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 21:44:43.012278 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 21:44:43.012278 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 21:44:43.012278 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise error Oct 04 21:44:43.012278 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 04 21:44:43.012278 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:44:43.012278 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: Oct 04 21:44:43.012278 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 04 21:44:43.012278 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, Oct 04 21:44:43.012278 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi 'minProperties': 1, Oct 04 21:44:43.012278 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 04 21:44:43.012278 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi 'type': ['string', Oct 04 21:44:43.012278 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi 'number']}}, Oct 04 21:44:43.012278 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 04 21:44:43.012278 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:44:43.012278 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi On instance: Oct 04 21:44:43.012278 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} Oct 04 21:44:43.012278 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:44:43.013484 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:44:43.013484 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:44:43.013484 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:44:43.013484 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:44:43.013484 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:44:43.013484 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:44:43.013484 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:44:43.013484 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:44:43.013484 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:44:43.013484 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 21:44:43.013484 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 21:44:43.013484 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 21:44:43.013484 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 21:44:43.013484 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 21:44:43.013484 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 21:44:43.013484 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 04 21:44:43.013484 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:44:43.013484 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:44:43.013484 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:44:43.013484 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:44:43.014651 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:44:43.014651 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:44:43.014651 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 21:44:43.014651 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 21:44:43.014651 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 04 21:44:43.014651 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:44:43.019888 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-66f97ab1-fecd-4ff1-a89e-a215b21495aa tempest-FlavorsExtraSpecsNegativeTestJSON-1215230648 tempest-FlavorsExtraSpecsNegativeTestJSON-1215230648-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:44:43.021958 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-66f97ab1-fecd-4ff1-a89e-a215b21495aa tempest-FlavorsExtraSpecsNegativeTestJSON-1215230648 tempest-FlavorsExtraSpecsNegativeTestJSON-1215230648-project-admin] 10.222.0.43 "PUT /compute/v2.1/flavors/529323775/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.030314 Oct 04 21:44:43.032903 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 249/474] 10.222.0.43 () {60 vars in 1262 bytes} [Tue Oct 4 21:44:42 2022] PUT /compute/v2.1/flavors/529323775/os-extra_specs/hw:numa_nodes => generated 117 bytes in 42 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 04 21:44:43.043161 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-286abb7a-8f61-4d6a-bdc0-55199376af14 tempest-FlavorsExtraSpecsNegativeTestJSON-1215230648 tempest-FlavorsExtraSpecsNegativeTestJSON-1215230648-project-admin] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:43.081723 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-286abb7a-8f61-4d6a-bdc0-55199376af14 tempest-FlavorsExtraSpecsNegativeTestJSON-1215230648 tempest-FlavorsExtraSpecsNegativeTestJSON-1215230648-project-admin] 10.222.0.43 "DELETE /compute/v2.1/flavors/529323775" status: 202 len: 0 microversion: 2.1 time: 0.044712 Oct 04 21:44:43.083294 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 226/475] 10.222.0.43 () {58 vars in 1158 bytes} [Tue Oct 4 21:44:43 2022] DELETE /compute/v2.1/flavors/529323775 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:44:43.099967 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-073b5770-5382-4662-9aa4-9e325c481ec6 tempest-FlavorsExtraSpecsNegativeTestJSON-1215230648 tempest-FlavorsExtraSpecsNegativeTestJSON-1215230648-project-admin] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:43.156118 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-073b5770-5382-4662-9aa4-9e325c481ec6 tempest-FlavorsExtraSpecsNegativeTestJSON-1215230648 tempest-FlavorsExtraSpecsNegativeTestJSON-1215230648-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 5821 microversion: 2.1 time: 0.051311 Oct 04 21:44:43.167499 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 250/476] 10.222.0.43 () {58 vars in 1146 bytes} [Tue Oct 4 21:44:43 2022] GET /compute/v2.1/flavors/detail => generated 5821 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:44:43.560928 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-e2a6f4bc-2389-4318-8aa8-f3d668b5336d tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:43.566797 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-c7d09a5d-324f-4220-8d00-6cbaa869821d tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:43.567776 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-c7d09a5d-324f-4220-8d00-6cbaa869821d tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: ec437ce7-b43a-4c8b-8a06-756cfb877851] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:43.568695 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-e2a6f4bc-2389-4318-8aa8-f3d668b5336d tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] [instance: 3eeb7190-8e00-4c8c-bfd7-a15da2a3e376] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:43.607438 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c7d09a5d-324f-4220-8d00-6cbaa869821d tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:43.609751 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c7d09a5d-324f-4220-8d00-6cbaa869821d tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:43.610494 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c7d09a5d-324f-4220-8d00-6cbaa869821d tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:43.612148 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e2a6f4bc-2389-4318-8aa8-f3d668b5336d tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:43.612851 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e2a6f4bc-2389-4318-8aa8-f3d668b5336d tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:43.613494 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e2a6f4bc-2389-4318-8aa8-f3d668b5336d tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:43.614422 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e2a6f4bc-2389-4318-8aa8-f3d668b5336d tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:43.614799 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c7d09a5d-324f-4220-8d00-6cbaa869821d tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:43.618929 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e2a6f4bc-2389-4318-8aa8-f3d668b5336d tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:43.620352 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e2a6f4bc-2389-4318-8aa8-f3d668b5336d tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:43.627754 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c7d09a5d-324f-4220-8d00-6cbaa869821d tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:43.629422 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c7d09a5d-324f-4220-8d00-6cbaa869821d tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:44.832571 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-e2a6f4bc-2389-4318-8aa8-f3d668b5336d tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539a93c63ab34b789903970b57b96bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8179a9b323b74a789fa7d5a4507cb6b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:44:44.855545 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-e2a6f4bc-2389-4318-8aa8-f3d668b5336d tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] 10.222.0.43 "GET /compute/v2.1/servers/3eeb7190-8e00-4c8c-bfd7-a15da2a3e376" status: 200 len: 1478 microversion: 2.1 time: 1.286749 Oct 04 21:44:44.863396 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 227/477] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:44:43 2022] GET /compute/v2.1/servers/3eeb7190-8e00-4c8c-bfd7-a15da2a3e376 => generated 1478 bytes in 1307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:44:44.890170 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-608ed7ef-32d0-4159-ac2c-3c6f6b25cb7c tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:44.895384 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-608ed7ef-32d0-4159-ac2c-3c6f6b25cb7c tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] [instance: 258bc0cb-6718-4f8b-8d0b-ef544b2b659b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:44.930305 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-608ed7ef-32d0-4159-ac2c-3c6f6b25cb7c tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:44.935693 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-c7d09a5d-324f-4220-8d00-6cbaa869821d tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:44:44.942614 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-608ed7ef-32d0-4159-ac2c-3c6f6b25cb7c tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:44.952069 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-608ed7ef-32d0-4159-ac2c-3c6f6b25cb7c tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:44.959653 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-608ed7ef-32d0-4159-ac2c-3c6f6b25cb7c tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:44.961312 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-608ed7ef-32d0-4159-ac2c-3c6f6b25cb7c tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:44.964570 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-608ed7ef-32d0-4159-ac2c-3c6f6b25cb7c tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:44.969551 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-c7d09a5d-324f-4220-8d00-6cbaa869821d tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/ec437ce7-b43a-4c8b-8a06-756cfb877851" status: 200 len: 1476 microversion: 2.1 time: 1.400199 Oct 04 21:44:44.976857 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 251/478] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:44:43 2022] GET /compute/v2.1/servers/ec437ce7-b43a-4c8b-8a06-756cfb877851 => generated 1476 bytes in 1409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:44:45.001448 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-c6a67543-43ab-455d-96f6-72bf7470b3cf req-b5aab6a6-03cd-41dd-a430-bb57a48b01f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3eeb7190-8e00-4c8c-bfd7-a15da2a3e376", "name": "network-vif-deleted", "tag": "c805f382-dbdb-446f-8642-d9c2c0cecea8"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:44:45.066677 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-c6a67543-43ab-455d-96f6-72bf7470b3cf req-b5aab6a6-03cd-41dd-a430-bb57a48b01f2 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:45.067633 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-c6a67543-43ab-455d-96f6-72bf7470b3cf req-b5aab6a6-03cd-41dd-a430-bb57a48b01f2 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:45.070211 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-c6a67543-43ab-455d-96f6-72bf7470b3cf req-b5aab6a6-03cd-41dd-a430-bb57a48b01f2 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:45.129234 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-c6a67543-43ab-455d-96f6-72bf7470b3cf req-b5aab6a6-03cd-41dd-a430-bb57a48b01f2 service nova] Creating event network-vif-deleted:c805f382-dbdb-446f-8642-d9c2c0cecea8 for instance 3eeb7190-8e00-4c8c-bfd7-a15da2a3e376 on n-h2-860284-1 Oct 04 21:44:45.152569 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-c6a67543-43ab-455d-96f6-72bf7470b3cf req-b5aab6a6-03cd-41dd-a430-bb57a48b01f2 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.173765 Oct 04 21:44:45.159691 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 252/479] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:44:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:44:45.886845 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-119c577f-f05f-4db4-9d6e-23878ad50f4b tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:45.888047 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-119c577f-f05f-4db4-9d6e-23878ad50f4b tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] [instance: 3eeb7190-8e00-4c8c-bfd7-a15da2a3e376] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:45.902426 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-119c577f-f05f-4db4-9d6e-23878ad50f4b tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:45.903377 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-119c577f-f05f-4db4-9d6e-23878ad50f4b tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:45.904115 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-119c577f-f05f-4db4-9d6e-23878ad50f4b tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:45.905375 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-119c577f-f05f-4db4-9d6e-23878ad50f4b tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:45.909963 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-119c577f-f05f-4db4-9d6e-23878ad50f4b tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:45.910859 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-119c577f-f05f-4db4-9d6e-23878ad50f4b tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:46.016254 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-119c577f-f05f-4db4-9d6e-23878ad50f4b tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:46.019805 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-119c577f-f05f-4db4-9d6e-23878ad50f4b tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:46.026253 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-119c577f-f05f-4db4-9d6e-23878ad50f4b tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:46.029416 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.objects.instance [None req-119c577f-f05f-4db4-9d6e-23878ad50f4b tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] Lazy-loading 'fault' on Instance uuid 3eeb7190-8e00-4c8c-bfd7-a15da2a3e376 {{(pid=134101) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:44:46.507559 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-119c577f-f05f-4db4-9d6e-23878ad50f4b tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539a93c63ab34b789903970b57b96bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8179a9b323b74a789fa7d5a4507cb6b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:44:46.532106 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-119c577f-f05f-4db4-9d6e-23878ad50f4b tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] 10.222.0.43 "GET /compute/v2.1/servers/3eeb7190-8e00-4c8c-bfd7-a15da2a3e376" status: 200 len: 1313 microversion: 2.1 time: 0.642883 Oct 04 21:44:46.539617 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 253/480] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:44:45 2022] GET /compute/v2.1/servers/3eeb7190-8e00-4c8c-bfd7-a15da2a3e376 => generated 1313 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:44:46.542908 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-608ed7ef-32d0-4159-ac2c-3c6f6b25cb7c tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29842a669a20408b881105135f76cb0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39edf587afe94b60911198aa0bb61613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:44:46.552208 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-608ed7ef-32d0-4159-ac2c-3c6f6b25cb7c tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] 10.222.0.43 "GET /compute/v2.1/servers/258bc0cb-6718-4f8b-8d0b-ef544b2b659b" status: 200 len: 1467 microversion: 2.1 time: 1.686013 Oct 04 21:44:46.555182 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 228/481] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:44:44 2022] GET /compute/v2.1/servers/258bc0cb-6718-4f8b-8d0b-ef544b2b659b => generated 1467 bytes in 1691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:44:46.577839 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-00610a8a-374f-45b3-a02e-439a6ee90fa4 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:46.578506 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-00610a8a-374f-45b3-a02e-439a6ee90fa4 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: ec437ce7-b43a-4c8b-8a06-756cfb877851] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:46.590358 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-e9b521aa-d803-417e-a2bc-0f4b4ac5dfeb req-6fe38c9d-62c6-4994-b506-09f468697b46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec437ce7-b43a-4c8b-8a06-756cfb877851", "name": "network-vif-unplugged", "status": "completed", "tag": "11205198-745e-4214-9769-9da045caa32b"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:44:46.618628 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-00610a8a-374f-45b3-a02e-439a6ee90fa4 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:46.619984 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-00610a8a-374f-45b3-a02e-439a6ee90fa4 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:46.620593 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-00610a8a-374f-45b3-a02e-439a6ee90fa4 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:46.621484 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-00610a8a-374f-45b3-a02e-439a6ee90fa4 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:46.622094 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-00610a8a-374f-45b3-a02e-439a6ee90fa4 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:46.622699 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-00610a8a-374f-45b3-a02e-439a6ee90fa4 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:46.653352 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-e9b521aa-d803-417e-a2bc-0f4b4ac5dfeb req-6fe38c9d-62c6-4994-b506-09f468697b46 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:46.653880 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-e9b521aa-d803-417e-a2bc-0f4b4ac5dfeb req-6fe38c9d-62c6-4994-b506-09f468697b46 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:46.654313 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-e9b521aa-d803-417e-a2bc-0f4b4ac5dfeb req-6fe38c9d-62c6-4994-b506-09f468697b46 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:46.718168 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-e9b521aa-d803-417e-a2bc-0f4b4ac5dfeb req-6fe38c9d-62c6-4994-b506-09f468697b46 service nova] Creating event network-vif-unplugged:11205198-745e-4214-9769-9da045caa32b for instance ec437ce7-b43a-4c8b-8a06-756cfb877851 on n-h1-860284-1 Oct 04 21:44:46.798980 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [req-e9b521aa-d803-417e-a2bc-0f4b4ac5dfeb req-6fe38c9d-62c6-4994-b506-09f468697b46 service nova] Instance ec437ce7-b43a-4c8b-8a06-756cfb877851 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860284-1', 'n-h1-860284-1'} {{(pid=134102) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 21:44:46.832206 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-e9b521aa-d803-417e-a2bc-0f4b4ac5dfeb req-6fe38c9d-62c6-4994-b506-09f468697b46 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.264555 Oct 04 21:44:46.861728 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 229/482] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:44:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:44:46.875443 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-cd73f355-7997-4c7c-8769-7c21752ef90c tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:46.876069 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-cd73f355-7997-4c7c-8769-7c21752ef90c tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] [instance: 7d71d6d3-3a63-406b-ac49-3e83bd539cf9] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:46.892710 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cd73f355-7997-4c7c-8769-7c21752ef90c tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:46.901616 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cd73f355-7997-4c7c-8769-7c21752ef90c tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:46.902793 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cd73f355-7997-4c7c-8769-7c21752ef90c tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:46.906081 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cd73f355-7997-4c7c-8769-7c21752ef90c tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:46.906832 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cd73f355-7997-4c7c-8769-7c21752ef90c tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:46.907541 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cd73f355-7997-4c7c-8769-7c21752ef90c tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:47.313307 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-00610a8a-374f-45b3-a02e-439a6ee90fa4 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:44:47.323681 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-00610a8a-374f-45b3-a02e-439a6ee90fa4 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/ec437ce7-b43a-4c8b-8a06-756cfb877851" status: 200 len: 1476 microversion: 2.1 time: 0.779388 Oct 04 21:44:47.330420 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 254/483] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:44:46 2022] GET /compute/v2.1/servers/ec437ce7-b43a-4c8b-8a06-756cfb877851 => generated 1476 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:44:47.526332 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-cd73f355-7997-4c7c-8769-7c21752ef90c tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29842a669a20408b881105135f76cb0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39edf587afe94b60911198aa0bb61613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:44:47.546683 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-cd73f355-7997-4c7c-8769-7c21752ef90c tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] 10.222.0.43 "GET /compute/v2.1/servers/7d71d6d3-3a63-406b-ac49-3e83bd539cf9" status: 200 len: 1467 microversion: 2.1 time: 0.682991 Oct 04 21:44:47.548928 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 230/484] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:44:46 2022] GET /compute/v2.1/servers/7d71d6d3-3a63-406b-ac49-3e83bd539cf9 => generated 1467 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:44:47.579452 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-a8262e4e-3aa9-4364-a731-1b776dfe3e97 tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:47.580709 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-a8262e4e-3aa9-4364-a731-1b776dfe3e97 tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] [instance: 3eeb7190-8e00-4c8c-bfd7-a15da2a3e376] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:47.609116 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a8262e4e-3aa9-4364-a731-1b776dfe3e97 tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:47.609883 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a8262e4e-3aa9-4364-a731-1b776dfe3e97 tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:47.611798 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a8262e4e-3aa9-4364-a731-1b776dfe3e97 tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:47.612736 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a8262e4e-3aa9-4364-a731-1b776dfe3e97 tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:47.615708 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a8262e4e-3aa9-4364-a731-1b776dfe3e97 tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:47.617011 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a8262e4e-3aa9-4364-a731-1b776dfe3e97 tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:47.668387 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-a8262e4e-3aa9-4364-a731-1b776dfe3e97 tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] HTTP exception thrown: Instance 3eeb7190-8e00-4c8c-bfd7-a15da2a3e376 could not be found. Oct 04 21:44:47.670809 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-a8262e4e-3aa9-4364-a731-1b776dfe3e97 tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] Request method failure captured: Oct 04 21:44:47.670809 n-d-860284-1 devstack@n-api.service[134102]: request: GET /compute/v2.1/servers/3eeb7190-8e00-4c8c-bfd7-a15da2a3e376 HTTP/1.1 Oct 04 21:44:47.670809 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 21:44:47.670809 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 21:44:47.670809 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 21:44:47.670809 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 21:44:47.670809 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 21:44:47.670809 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 21:44:47.670809 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 21:44:47.670809 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 21:44:47.670809 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPKkyIwT4ZBKPKPNyf_67uJmWcfv-Ey6yfxNijx502czjjjvs4xevjqm0A4ss7yIlHYPCymtf3enU-6TbihQwRV3W1vXwQu3dB6Gn_ckkOXQcYyWsmwUBBLwdXdVmk42YPlY3ruYiPZN5LmMR_8dwuQGlo8CDFe8-IWv7Mj72mQf_xz0 Oct 04 21:44:47.670809 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 21:44:47.670809 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 21:44:47.670809 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 21:44:47.670809 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 21:44:47.670809 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 21:44:47.670809 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 21:44:47.670809 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: 8179a9b323b74a789fa7d5a4507cb6b3 Oct 04 21:44:47.670809 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-349809873 Oct 04 21:44:47.670809 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 21:44:47.670809 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 21:44:47.672143 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8179a9b323b74a789fa7d5a4507cb6b3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_8179a9b323b74a789fa7d5a4507cb6b3", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8179a9b323b74a789fa7d5a4507cb6b3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/8179a9b323b74a789fa7d5a4507cb6b3"}]}] Oct 04 21:44:47.672143 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-349809873 Oct 04 21:44:47.672143 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: 8179a9b323b74a789fa7d5a4507cb6b3 Oct 04 21:44:47.672143 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-349809873 Oct 04 21:44:47.672143 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-ServerDiagnosticsNegativeTest-349809873-project Oct 04 21:44:47.672143 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 21:44:47.672143 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 21:44:47.672143 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: 539a93c63ab34b789903970b57b96bd6 Oct 04 21:44:47.672143 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-349809873-project Oct 04 21:44:47.672143 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 21:44:47.672143 n-d-860284-1 devstack@n-api.service[134102]: exception: Instance 3eeb7190-8e00-4c8c-bfd7-a15da2a3e376 could not be found. Oct 04 21:44:47.672143 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': '3eeb7190-8e00-4c8c-bfd7-a15da2a3e376'} Oct 04 21:44:47.672964 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:44:47.672964 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:44:47.672964 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:44:47.672964 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:44:47.672964 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:44:47.672964 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:44:47.672964 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:44:47.672964 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:44:47.672964 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:44:47.672964 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:44:47.672964 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3eeb7190-8e00-4c8c-bfd7-a15da2a3e376 could not be found. Oct 04 21:44:47.672964 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:44:47.672964 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:44:47.672964 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:44:47.672964 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:44:47.672964 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:44:47.672964 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:44:47.672964 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:44:47.672964 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:44:47.672964 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:44:47.674040 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:44:47.674040 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:44:47.674040 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:44:47.674040 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:44:47.674040 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:44:47.674040 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:44:47.674040 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:44:47.674040 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3eeb7190-8e00-4c8c-bfd7-a15da2a3e376 could not be found. Oct 04 21:44:47.674040 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:44:47.674040 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:44:47.674040 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:44:47.674040 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:44:47.674040 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:44:47.674040 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:44:47.674040 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:44:47.674040 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:44:47.674040 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3eeb7190-8e00-4c8c-bfd7-a15da2a3e376 could not be found. Oct 04 21:44:47.674040 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:44:47.678350 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-a8262e4e-3aa9-4364-a731-1b776dfe3e97 tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] Returning 404 to user: Instance 3eeb7190-8e00-4c8c-bfd7-a15da2a3e376 could not be found. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:44:47.680803 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-a8262e4e-3aa9-4364-a731-1b776dfe3e97 tempest-ServerDiagnosticsNegativeTest-349809873 tempest-ServerDiagnosticsNegativeTest-349809873-project] 10.222.0.43 "GET /compute/v2.1/servers/3eeb7190-8e00-4c8c-bfd7-a15da2a3e376" status: 404 len: 111 microversion: 2.1 time: 0.108881 Oct 04 21:44:47.686307 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 231/485] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:44:47 2022] GET /compute/v2.1/servers/3eeb7190-8e00-4c8c-bfd7-a15da2a3e376 => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:44:47.699640 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-3b2934c1-fc0d-4325-b444-9a87e989c213 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:47.706083 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-3b2934c1-fc0d-4325-b444-9a87e989c213 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '29842a669a20408b881105135f76cb0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39edf587afe94b60911198aa0bb61613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:44:47.707786 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-3b2934c1-fc0d-4325-b444-9a87e989c213 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Searching by: {'reservation_id': 'r-uj65usix', 'deleted': False, 'project_id': '39edf587afe94b60911198aa0bb61613'} {{(pid=134102) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 21:44:47.716213 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3b2934c1-fc0d-4325-b444-9a87e989c213 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:47.717141 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3b2934c1-fc0d-4325-b444-9a87e989c213 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:47.717930 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3b2934c1-fc0d-4325-b444-9a87e989c213 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:47.719343 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3b2934c1-fc0d-4325-b444-9a87e989c213 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:47.719951 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3b2934c1-fc0d-4325-b444-9a87e989c213 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:47.720533 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3b2934c1-fc0d-4325-b444-9a87e989c213 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:48.036284 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e7e3bb02-b35b-4987-85e6-9ef098acb384 tempest-HypervisorAdminNegativeUnderV252Test-1017232615 tempest-HypervisorAdminNegativeUnderV252Test-1017232615-project-admin] Calling method '.version_select at 0x7fbb2f62ddc0>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:48.038106 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e7e3bb02-b35b-4987-85e6-9ef098acb384 tempest-HypervisorAdminNegativeUnderV252Test-1017232615 tempest-HypervisorAdminNegativeUnderV252Test-1017232615-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:48.038659 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e7e3bb02-b35b-4987-85e6-9ef098acb384 tempest-HypervisorAdminNegativeUnderV252Test-1017232615 tempest-HypervisorAdminNegativeUnderV252Test-1017232615-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:48.039095 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e7e3bb02-b35b-4987-85e6-9ef098acb384 tempest-HypervisorAdminNegativeUnderV252Test-1017232615 tempest-HypervisorAdminNegativeUnderV252Test-1017232615-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:48.066810 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.multi_cell_list [None req-3b2934c1-fc0d-4325-b444-9a87e989c213 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=134102) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 21:44:48.096395 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e7e3bb02-b35b-4987-85e6-9ef098acb384 tempest-HypervisorAdminNegativeUnderV252Test-1017232615 tempest-HypervisorAdminNegativeUnderV252Test-1017232615-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:48.138133 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e7e3bb02-b35b-4987-85e6-9ef098acb384 tempest-HypervisorAdminNegativeUnderV252Test-1017232615 tempest-HypervisorAdminNegativeUnderV252Test-1017232615-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:48.139728 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e7e3bb02-b35b-4987-85e6-9ef098acb384 tempest-HypervisorAdminNegativeUnderV252Test-1017232615 tempest-HypervisorAdminNegativeUnderV252Test-1017232615-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:48.185594 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e7e3bb02-b35b-4987-85e6-9ef098acb384 tempest-HypervisorAdminNegativeUnderV252Test-1017232615 tempest-HypervisorAdminNegativeUnderV252Test-1017232615-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:48.186081 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e7e3bb02-b35b-4987-85e6-9ef098acb384 tempest-HypervisorAdminNegativeUnderV252Test-1017232615 tempest-HypervisorAdminNegativeUnderV252Test-1017232615-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:48.186553 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e7e3bb02-b35b-4987-85e6-9ef098acb384 tempest-HypervisorAdminNegativeUnderV252Test-1017232615 tempest-HypervisorAdminNegativeUnderV252Test-1017232615-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:48.230931 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-e7e3bb02-b35b-4987-85e6-9ef098acb384 tempest-HypervisorAdminNegativeUnderV252Test-1017232615 tempest-HypervisorAdminNegativeUnderV252Test-1017232615-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.904202 Oct 04 21:44:48.244933 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 255/486] 10.222.0.43 () {58 vars in 1146 bytes} [Tue Oct 4 21:44:47 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:44:48.300237 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-3b2934c1-fc0d-4325-b444-9a87e989c213 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29842a669a20408b881105135f76cb0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39edf587afe94b60911198aa0bb61613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:44:48.315619 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3b2934c1-fc0d-4325-b444-9a87e989c213 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:48.316404 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3b2934c1-fc0d-4325-b444-9a87e989c213 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:48.317113 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3b2934c1-fc0d-4325-b444-9a87e989c213 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:48.877594 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-1a806237-892d-418e-8947-7ffdcbae30c5 tempest-HypervisorAdminNegativeUnderV252Test-1348498832 tempest-HypervisorAdminNegativeUnderV252Test-1348498832-project] Calling method '.version_select at 0x7fbb2f62df70>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:48.878684 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-3b2934c1-fc0d-4325-b444-9a87e989c213 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] 10.222.0.43 "GET /compute/v2.1/servers/detail?reservation_id=r-uj65usix" status: 200 len: 2927 microversion: 2.1 time: 1.189144 Oct 04 21:44:48.879552 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-1a806237-892d-418e-8947-7ffdcbae30c5 tempest-HypervisorAdminNegativeUnderV252Test-1348498832 tempest-HypervisorAdminNegativeUnderV252Test-1348498832-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': 'b0eee02f0dc34b7fa87f57eb6b6403e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11822c658e27458eafdab7fafe6ea88a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:44:48.880384 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 232/487] 10.222.0.43 () {58 vars in 1197 bytes} [Tue Oct 4 21:44:47 2022] GET /compute/v2.1/servers/detail?reservation_id=r-uj65usix => generated 2927 bytes in 1193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:44:48.881327 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-1a806237-892d-418e-8947-7ffdcbae30c5 tempest-HypervisorAdminNegativeUnderV252Test-1348498832 tempest-HypervisorAdminNegativeUnderV252Test-1348498832-project] Request method failure captured: Oct 04 21:44:48.881327 n-d-860284-1 devstack@n-api.service[134101]: request: GET /compute/v2.1/os-hypervisors/n-h1-860284-1/search HTTP/1.1 Oct 04 21:44:48.881327 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 21:44:48.881327 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 21:44:48.881327 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 21:44:48.881327 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 21:44:48.881327 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 21:44:48.881327 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 21:44:48.881327 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 21:44:48.881327 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 21:44:48.881327 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPKlMUuHtCc67iMZGnf0vVbI7lhitp7pPOf17pC3puUDxtOvRIofjL2SMQhgOHXerl37tUzennQkZbSs4fyVMJP7qT8BRuw4Thz9TdIKClxDtPxu61T83zB9LlPcdtj-61Ux_dW0nIh30daDbWJU8ikBnhyRcnO7tcbRSJiFA0GX5NMk Oct 04 21:44:48.881327 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 21:44:48.881327 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 21:44:48.881327 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 21:44:48.881327 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 21:44:48.881327 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 21:44:48.881327 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 21:44:48.881327 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: 11822c658e27458eafdab7fafe6ea88a Oct 04 21:44:48.881327 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1348498832 Oct 04 21:44:48.881327 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 21:44:48.881327 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 21:44:48.883556 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/11822c658e27458eafdab7fafe6ea88a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_11822c658e27458eafdab7fafe6ea88a", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/11822c658e27458eafdab7fafe6ea88a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/11822c658e27458eafdab7fafe6ea88a"}]}] Oct 04 21:44:48.883556 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1348498832 Oct 04 21:44:48.883556 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: 11822c658e27458eafdab7fafe6ea88a Oct 04 21:44:48.883556 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1348498832 Oct 04 21:44:48.883556 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1348498832-project Oct 04 21:44:48.883556 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 21:44:48.883556 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 21:44:48.883556 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: b0eee02f0dc34b7fa87f57eb6b6403e6 Oct 04 21:44:48.883556 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1348498832-project Oct 04 21:44:48.883556 n-d-860284-1 devstack@n-api.service[134101]: method: Oct 04 21:44:48.883556 n-d-860284-1 devstack@n-api.service[134101]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 04 21:44:48.883556 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': 'n-h1-860284-1'} Oct 04 21:44:48.884289 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:44:48.884289 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:44:48.884289 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:44:48.884289 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:44:48.884289 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:44:48.884289 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:44:48.884289 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:44:48.884289 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:44:48.884289 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:44:48.884289 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:44:48.884289 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search Oct 04 21:44:48.884289 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) Oct 04 21:44:48.884289 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 21:44:48.884289 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 21:44:48.884289 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 21:44:48.884289 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 21:44:48.884289 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 21:44:48.884289 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 21:44:48.884289 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 21:44:48.885437 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 21:44:48.885437 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 21:44:48.885437 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 21:44:48.885437 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 21:44:48.885437 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 21:44:48.885437 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 21:44:48.885437 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 21:44:48.885437 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 04 21:44:48.885437 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:44:48.885437 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:44:48.885437 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:44:48.885437 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:44:48.885437 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:44:48.885437 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:44:48.885437 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 21:44:48.885437 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 21:44:48.885437 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 04 21:44:48.885437 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:44:48.886458 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-1a806237-892d-418e-8947-7ffdcbae30c5 tempest-HypervisorAdminNegativeUnderV252Test-1348498832 tempest-HypervisorAdminNegativeUnderV252Test-1348498832-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:44:48.886458 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-1a806237-892d-418e-8947-7ffdcbae30c5 tempest-HypervisorAdminNegativeUnderV252Test-1348498832 tempest-HypervisorAdminNegativeUnderV252Test-1348498832-project] 10.222.0.43 "GET /compute/v2.1/os-hypervisors/n-h1-860284-1/search" status: 403 len: 117 microversion: 2.1 time: 0.629702 Oct 04 21:44:48.890055 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 256/488] 10.222.0.43 () {58 vars in 1209 bytes} [Tue Oct 4 21:44:48 2022] GET /compute/v2.1/os-hypervisors/n-h1-860284-1/search => generated 117 bytes in 635 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:44:48.893552 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-15070e50-7296-4604-a757-393631b14dda tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:48.894504 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-15070e50-7296-4604-a757-393631b14dda tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: ec437ce7-b43a-4c8b-8a06-756cfb877851] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:48.908602 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-15070e50-7296-4604-a757-393631b14dda tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:48.911036 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-15070e50-7296-4604-a757-393631b14dda tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:48.911883 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-df688d8c-cdc0-42f5-acbe-d111b74b725f tempest-HypervisorAdminNegativeUnderV252Test-1017232615 tempest-HypervisorAdminNegativeUnderV252Test-1017232615-project-admin] Calling method '.version_select at 0x7fbb2f62d310>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:48.914042 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-15070e50-7296-4604-a757-393631b14dda tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:48.916990 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-15070e50-7296-4604-a757-393631b14dda tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:48.917768 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-15070e50-7296-4604-a757-393631b14dda tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:48.919310 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-15070e50-7296-4604-a757-393631b14dda tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:48.923877 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-df688d8c-cdc0-42f5-acbe-d111b74b725f tempest-HypervisorAdminNegativeUnderV252Test-1017232615 tempest-HypervisorAdminNegativeUnderV252Test-1017232615-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:48.924633 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-df688d8c-cdc0-42f5-acbe-d111b74b725f tempest-HypervisorAdminNegativeUnderV252Test-1017232615 tempest-HypervisorAdminNegativeUnderV252Test-1017232615-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:48.925264 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-df688d8c-cdc0-42f5-acbe-d111b74b725f tempest-HypervisorAdminNegativeUnderV252Test-1017232615 tempest-HypervisorAdminNegativeUnderV252Test-1017232615-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:48.955675 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-df688d8c-cdc0-42f5-acbe-d111b74b725f tempest-HypervisorAdminNegativeUnderV252Test-1017232615 tempest-HypervisorAdminNegativeUnderV252Test-1017232615-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 04 21:44:48.958917 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-df688d8c-cdc0-42f5-acbe-d111b74b725f tempest-HypervisorAdminNegativeUnderV252Test-1017232615 tempest-HypervisorAdminNegativeUnderV252Test-1017232615-project-admin] Request method failure captured: Oct 04 21:44:48.958917 n-d-860284-1 devstack@n-api.service[134101]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 Oct 04 21:44:48.958917 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 21:44:48.958917 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 21:44:48.958917 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 21:44:48.958917 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 21:44:48.958917 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 21:44:48.958917 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 21:44:48.958917 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 21:44:48.958917 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 21:44:48.958917 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPKlONts8jiDrKi1nr8HmQ890Wj22HWrwH1XpeVgDQghmIOGX6Zx7sgbSl_uiO5C47nAG82ej8A0VpaXoDkurJ-r6CS2EGDNLs3uYMZ_QO-fbsQSzsQnY1MDyzXXMJ45LsC4THyJSyK7yydPohbucM56ud83KxcWFQD73CcLxaNcTz5I Oct 04 21:44:48.958917 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 21:44:48.958917 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 21:44:48.958917 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 21:44:48.958917 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 21:44:48.958917 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 21:44:48.958917 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 21:44:48.958917 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: 559fec1f79344ddd853d753b731d6ec6 Oct 04 21:44:48.958917 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1017232615 Oct 04 21:44:48.958917 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,admin,member Oct 04 21:44:48.958917 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,admin,member Oct 04 21:44:48.960933 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/559fec1f79344ddd853d753b731d6ec6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_559fec1f79344ddd853d753b731d6ec6", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/559fec1f79344ddd853d753b731d6ec6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/559fec1f79344ddd853d753b731d6ec6"}]}] Oct 04 21:44:48.960933 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1017232615 Oct 04 21:44:48.960933 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: 559fec1f79344ddd853d753b731d6ec6 Oct 04 21:44:48.960933 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1017232615 Oct 04 21:44:48.960933 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1017232615-project-admin Oct 04 21:44:48.960933 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 21:44:48.960933 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 21:44:48.960933 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: b0032be475164a049f0908f7f61eeeff Oct 04 21:44:48.960933 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1017232615-project-admin Oct 04 21:44:48.960933 n-d-860284-1 devstack@n-api.service[134101]: method: Oct 04 21:44:48.960933 n-d-860284-1 devstack@n-api.service[134101]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 04 21:44:48.960933 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': 'nonexistent_hypervisor_name'} Oct 04 21:44:48.961748 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:44:48.961748 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:44:48.961748 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:44:48.961748 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:44:48.961748 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:44:48.961748 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:44:48.961748 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:44:48.961748 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:44:48.961748 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:44:48.961748 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:44:48.961748 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search Oct 04 21:44:48.961748 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Oct 04 21:44:48.961748 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Oct 04 21:44:48.961748 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 04 21:44:48.961748 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 04 21:44:48.961748 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:44:48.961748 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:44:48.961748 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:44:48.961748 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:44:48.961748 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:44:48.963094 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:44:48.963094 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:44:48.963094 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:44:48.963094 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 04 21:44:48.963094 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:44:48.968499 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-df688d8c-cdc0-42f5-acbe-d111b74b725f tempest-HypervisorAdminNegativeUnderV252Test-1017232615 tempest-HypervisorAdminNegativeUnderV252Test-1017232615-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:44:48.974826 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-df688d8c-cdc0-42f5-acbe-d111b74b725f tempest-HypervisorAdminNegativeUnderV252Test-1017232615 tempest-HypervisorAdminNegativeUnderV252Test-1017232615-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.077591 Oct 04 21:44:48.980418 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 257/489] 10.222.0.43 () {58 vars in 1251 bytes} [Tue Oct 4 21:44:48 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:44:48.996867 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-f1d92860-e885-45a3-9f4d-6f07b431d25c tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:49.107361 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.compute.server_groups [None req-f1d92860-e885-45a3-9f4d-6f07b431d25c tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Querying cell 1297bf18-d456-4d7b-91a9-0a07f1cafd2a(cell1) for 2 instances {{(pid=134101) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 04 21:44:49.112644 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f1d92860-e885-45a3-9f4d-6f07b431d25c tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:49.113476 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f1d92860-e885-45a3-9f4d-6f07b431d25c tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:49.136577 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f1d92860-e885-45a3-9f4d-6f07b431d25c tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:49.256061 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-f1d92860-e885-45a3-9f4d-6f07b431d25c tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] 10.222.0.43 "GET /compute/v2.1/os-server-groups/42779ba1-4f53-45cc-b681-4aca803828ae" status: 200 len: 266 microversion: 2.1 time: 0.274307 Oct 04 21:44:49.256650 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 258/490] 10.222.0.43 () {58 vars in 1263 bytes} [Tue Oct 4 21:44:48 2022] GET /compute/v2.1/os-server-groups/42779ba1-4f53-45cc-b681-4aca803828ae => generated 266 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:44:49.275255 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-7945e2a3-b84a-41b0-8350-9372e661951c tempest-HypervisorAdminNegativeUnderV252Test-1017232615 tempest-HypervisorAdminNegativeUnderV252Test-1017232615-project-admin] Calling method '.version_select at 0x7fbb2f77b280>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:49.277071 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7945e2a3-b84a-41b0-8350-9372e661951c tempest-HypervisorAdminNegativeUnderV252Test-1017232615 tempest-HypervisorAdminNegativeUnderV252Test-1017232615-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:49.277562 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7945e2a3-b84a-41b0-8350-9372e661951c tempest-HypervisorAdminNegativeUnderV252Test-1017232615 tempest-HypervisorAdminNegativeUnderV252Test-1017232615-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:49.290521 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7945e2a3-b84a-41b0-8350-9372e661951c tempest-HypervisorAdminNegativeUnderV252Test-1017232615 tempest-HypervisorAdminNegativeUnderV252Test-1017232615-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:49.341508 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7945e2a3-b84a-41b0-8350-9372e661951c tempest-HypervisorAdminNegativeUnderV252Test-1017232615 tempest-HypervisorAdminNegativeUnderV252Test-1017232615-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:49.342049 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7945e2a3-b84a-41b0-8350-9372e661951c tempest-HypervisorAdminNegativeUnderV252Test-1017232615 tempest-HypervisorAdminNegativeUnderV252Test-1017232615-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:49.344625 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7945e2a3-b84a-41b0-8350-9372e661951c tempest-HypervisorAdminNegativeUnderV252Test-1017232615 tempest-HypervisorAdminNegativeUnderV252Test-1017232615-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:49.383351 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7945e2a3-b84a-41b0-8350-9372e661951c tempest-HypervisorAdminNegativeUnderV252Test-1017232615 tempest-HypervisorAdminNegativeUnderV252Test-1017232615-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:49.389429 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7945e2a3-b84a-41b0-8350-9372e661951c tempest-HypervisorAdminNegativeUnderV252Test-1017232615 tempest-HypervisorAdminNegativeUnderV252Test-1017232615-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:49.391445 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7945e2a3-b84a-41b0-8350-9372e661951c tempest-HypervisorAdminNegativeUnderV252Test-1017232615 tempest-HypervisorAdminNegativeUnderV252Test-1017232615-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:49.412866 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-7945e2a3-b84a-41b0-8350-9372e661951c tempest-HypervisorAdminNegativeUnderV252Test-1017232615 tempest-HypervisorAdminNegativeUnderV252Test-1017232615-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.147910 Oct 04 21:44:49.418964 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 259/491] 10.222.0.43 () {58 vars in 1146 bytes} [Tue Oct 4 21:44:49 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:44:49.435129 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-62a9c05a-c376-4521-88a8-ed5878348848 req-1790a1ed-56ba-4f44-bc15-8b663c3f53b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec437ce7-b43a-4c8b-8a06-756cfb877851", "tag": "11205198-745e-4214-9769-9da045caa32b"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:44:49.466197 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-62a9c05a-c376-4521-88a8-ed5878348848 req-1790a1ed-56ba-4f44-bc15-8b663c3f53b6 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:49.467032 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-62a9c05a-c376-4521-88a8-ed5878348848 req-1790a1ed-56ba-4f44-bc15-8b663c3f53b6 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:49.467700 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-62a9c05a-c376-4521-88a8-ed5878348848 req-1790a1ed-56ba-4f44-bc15-8b663c3f53b6 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:49.507291 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-62a9c05a-c376-4521-88a8-ed5878348848 req-1790a1ed-56ba-4f44-bc15-8b663c3f53b6 service nova] Creating event network-changed:11205198-745e-4214-9769-9da045caa32b for instance ec437ce7-b43a-4c8b-8a06-756cfb877851 on n-h1-860284-1 Oct 04 21:44:49.539448 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [req-62a9c05a-c376-4521-88a8-ed5878348848 req-1790a1ed-56ba-4f44-bc15-8b663c3f53b6 service nova] Instance ec437ce7-b43a-4c8b-8a06-756cfb877851 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860284-1', 'n-h1-860284-1'} {{(pid=134101) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 21:44:49.555237 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-15070e50-7296-4604-a757-393631b14dda tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:44:49.567194 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-62a9c05a-c376-4521-88a8-ed5878348848 req-1790a1ed-56ba-4f44-bc15-8b663c3f53b6 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.144132 Oct 04 21:44:49.568148 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 260/492] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:44:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:44:49.568669 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-15070e50-7296-4604-a757-393631b14dda tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/ec437ce7-b43a-4c8b-8a06-756cfb877851" status: 200 len: 1476 microversion: 2.1 time: 0.686549 Oct 04 21:44:49.569992 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 233/493] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:44:48 2022] GET /compute/v2.1/servers/ec437ce7-b43a-4c8b-8a06-756cfb877851 => generated 1476 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:44:49.589129 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-bc732284-0720-48b1-b066-2db78d2085e5 tempest-HypervisorAdminNegativeUnderV252Test-1348498832 tempest-HypervisorAdminNegativeUnderV252Test-1348498832-project] Calling method '.version_select at 0x7fbb2f8848b0>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:49.601984 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-97055d14-3f3e-4856-95ea-63e39f6a9466 tempest-ServersOnMultiNodesTest-962622545 tempest-ServersOnMultiNodesTest-962622545-project-admin] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:49.604580 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-97055d14-3f3e-4856-95ea-63e39f6a9466 tempest-ServersOnMultiNodesTest-962622545 tempest-ServersOnMultiNodesTest-962622545-project-admin] [instance: 258bc0cb-6718-4f8b-8d0b-ef544b2b659b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:49.608435 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-bc732284-0720-48b1-b066-2db78d2085e5 tempest-HypervisorAdminNegativeUnderV252Test-1348498832 tempest-HypervisorAdminNegativeUnderV252Test-1348498832-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': 'b0eee02f0dc34b7fa87f57eb6b6403e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11822c658e27458eafdab7fafe6ea88a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:44:49.612458 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-bc732284-0720-48b1-b066-2db78d2085e5 tempest-HypervisorAdminNegativeUnderV252Test-1348498832 tempest-HypervisorAdminNegativeUnderV252Test-1348498832-project] Request method failure captured: Oct 04 21:44:49.612458 n-d-860284-1 devstack@n-api.service[134102]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 Oct 04 21:44:49.612458 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 21:44:49.612458 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 21:44:49.612458 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 21:44:49.612458 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 21:44:49.612458 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 21:44:49.612458 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 21:44:49.612458 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 21:44:49.612458 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 21:44:49.612458 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPKlMUuHtCc67iMZGnf0vVbI7lhitp7pPOf17pC3puUDxtOvRIofjL2SMQhgOHXerl37tUzennQkZbSs4fyVMJP7qT8BRuw4Thz9TdIKClxDtPxu61T83zB9LlPcdtj-61Ux_dW0nIh30daDbWJU8ikBnhyRcnO7tcbRSJiFA0GX5NMk Oct 04 21:44:49.612458 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 21:44:49.612458 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 21:44:49.612458 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 21:44:49.612458 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 21:44:49.612458 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 21:44:49.612458 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 21:44:49.612458 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: 11822c658e27458eafdab7fafe6ea88a Oct 04 21:44:49.612458 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1348498832 Oct 04 21:44:49.612458 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 21:44:49.612458 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 21:44:49.613937 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/11822c658e27458eafdab7fafe6ea88a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_11822c658e27458eafdab7fafe6ea88a", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/11822c658e27458eafdab7fafe6ea88a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/11822c658e27458eafdab7fafe6ea88a"}]}] Oct 04 21:44:49.613937 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1348498832 Oct 04 21:44:49.613937 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: 11822c658e27458eafdab7fafe6ea88a Oct 04 21:44:49.613937 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1348498832 Oct 04 21:44:49.613937 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1348498832-project Oct 04 21:44:49.613937 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 21:44:49.613937 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 21:44:49.613937 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: b0eee02f0dc34b7fa87f57eb6b6403e6 Oct 04 21:44:49.613937 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1348498832-project Oct 04 21:44:49.613937 n-d-860284-1 devstack@n-api.service[134102]: method: Oct 04 21:44:49.613937 n-d-860284-1 devstack@n-api.service[134102]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 04 21:44:49.613937 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': '1'} Oct 04 21:44:49.614804 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:44:49.614804 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:44:49.614804 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:44:49.614804 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:44:49.614804 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:44:49.614804 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:44:49.614804 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:44:49.614804 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:44:49.614804 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:44:49.614804 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:44:49.614804 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers Oct 04 21:44:49.614804 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) Oct 04 21:44:49.614804 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 21:44:49.614804 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 21:44:49.614804 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 21:44:49.614804 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 21:44:49.614804 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 21:44:49.614804 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 21:44:49.614804 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 21:44:49.616052 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 21:44:49.616052 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 21:44:49.616052 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 21:44:49.616052 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 21:44:49.616052 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 21:44:49.616052 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 21:44:49.616052 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 21:44:49.616052 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 04 21:44:49.616052 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:44:49.616052 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:44:49.616052 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:44:49.616052 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:44:49.616052 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:44:49.616052 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:44:49.616052 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 21:44:49.616052 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 21:44:49.616052 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 04 21:44:49.616052 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:44:49.622642 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-bc732284-0720-48b1-b066-2db78d2085e5 tempest-HypervisorAdminNegativeUnderV252Test-1348498832 tempest-HypervisorAdminNegativeUnderV252Test-1348498832-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:44:49.624613 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-bc732284-0720-48b1-b066-2db78d2085e5 tempest-HypervisorAdminNegativeUnderV252Test-1348498832 tempest-HypervisorAdminNegativeUnderV252Test-1348498832-project] 10.222.0.43 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.052288 Oct 04 21:44:49.629464 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 234/494] 10.222.0.43 () {58 vars in 1176 bytes} [Tue Oct 4 21:44:49 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 54 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:44:49.631868 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-97055d14-3f3e-4856-95ea-63e39f6a9466 tempest-ServersOnMultiNodesTest-962622545 tempest-ServersOnMultiNodesTest-962622545-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:49.632418 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-97055d14-3f3e-4856-95ea-63e39f6a9466 tempest-ServersOnMultiNodesTest-962622545 tempest-ServersOnMultiNodesTest-962622545-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:49.634954 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-1f1d5c7f-d863-441d-ae35-12a2ef048862 tempest-HypervisorAdminNegativeUnderV252Test-1017232615 tempest-HypervisorAdminNegativeUnderV252Test-1017232615-project-admin] Calling method '.version_select at 0x7fbb2f865d30>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:49.636542 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-97055d14-3f3e-4856-95ea-63e39f6a9466 tempest-ServersOnMultiNodesTest-962622545 tempest-ServersOnMultiNodesTest-962622545-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:49.637431 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-97055d14-3f3e-4856-95ea-63e39f6a9466 tempest-ServersOnMultiNodesTest-962622545 tempest-ServersOnMultiNodesTest-962622545-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:49.637921 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-97055d14-3f3e-4856-95ea-63e39f6a9466 tempest-ServersOnMultiNodesTest-962622545 tempest-ServersOnMultiNodesTest-962622545-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:49.638389 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-97055d14-3f3e-4856-95ea-63e39f6a9466 tempest-ServersOnMultiNodesTest-962622545 tempest-ServersOnMultiNodesTest-962622545-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:49.640821 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1f1d5c7f-d863-441d-ae35-12a2ef048862 tempest-HypervisorAdminNegativeUnderV252Test-1017232615 tempest-HypervisorAdminNegativeUnderV252Test-1017232615-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:49.642690 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1f1d5c7f-d863-441d-ae35-12a2ef048862 tempest-HypervisorAdminNegativeUnderV252Test-1017232615 tempest-HypervisorAdminNegativeUnderV252Test-1017232615-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:49.643253 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1f1d5c7f-d863-441d-ae35-12a2ef048862 tempest-HypervisorAdminNegativeUnderV252Test-1017232615 tempest-HypervisorAdminNegativeUnderV252Test-1017232615-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:49.672069 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-1f1d5c7f-d863-441d-ae35-12a2ef048862 tempest-HypervisorAdminNegativeUnderV252Test-1017232615 tempest-HypervisorAdminNegativeUnderV252Test-1017232615-project-admin] HTTP exception thrown: No hypervisor matching 'cd279500-8766-4799-b435-4054a1d9517d' could be found. Oct 04 21:44:49.684269 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-1f1d5c7f-d863-441d-ae35-12a2ef048862 tempest-HypervisorAdminNegativeUnderV252Test-1017232615 tempest-HypervisorAdminNegativeUnderV252Test-1017232615-project-admin] Request method failure captured: Oct 04 21:44:49.684269 n-d-860284-1 devstack@n-api.service[134102]: request: GET /compute/v2.1/os-hypervisors/cd279500-8766-4799-b435-4054a1d9517d/servers HTTP/1.1 Oct 04 21:44:49.684269 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 21:44:49.684269 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 21:44:49.684269 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 21:44:49.684269 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 21:44:49.684269 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 21:44:49.684269 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 21:44:49.684269 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 21:44:49.684269 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 21:44:49.684269 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPKlONts8jiDrKi1nr8HmQ890Wj22HWrwH1XpeVgDQghmIOGX6Zx7sgbSl_uiO5C47nAG82ej8A0VpaXoDkurJ-r6CS2EGDNLs3uYMZ_QO-fbsQSzsQnY1MDyzXXMJ45LsC4THyJSyK7yydPohbucM56ud83KxcWFQD73CcLxaNcTz5I Oct 04 21:44:49.684269 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 21:44:49.684269 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 21:44:49.684269 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 21:44:49.684269 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 21:44:49.684269 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 21:44:49.684269 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 21:44:49.684269 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: 559fec1f79344ddd853d753b731d6ec6 Oct 04 21:44:49.684269 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1017232615 Oct 04 21:44:49.684269 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,admin,member Oct 04 21:44:49.684269 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,admin,member Oct 04 21:44:49.685849 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/559fec1f79344ddd853d753b731d6ec6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_559fec1f79344ddd853d753b731d6ec6", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/559fec1f79344ddd853d753b731d6ec6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/559fec1f79344ddd853d753b731d6ec6"}]}] Oct 04 21:44:49.685849 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1017232615 Oct 04 21:44:49.685849 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: 559fec1f79344ddd853d753b731d6ec6 Oct 04 21:44:49.685849 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1017232615 Oct 04 21:44:49.685849 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1017232615-project-admin Oct 04 21:44:49.685849 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 21:44:49.685849 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 21:44:49.685849 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: b0032be475164a049f0908f7f61eeeff Oct 04 21:44:49.685849 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1017232615-project-admin Oct 04 21:44:49.685849 n-d-860284-1 devstack@n-api.service[134102]: method: Oct 04 21:44:49.685849 n-d-860284-1 devstack@n-api.service[134102]: exception: No hypervisor matching 'cd279500-8766-4799-b435-4054a1d9517d' could be found. Oct 04 21:44:49.685849 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': 'cd279500-8766-4799-b435-4054a1d9517d'} Oct 04 21:44:49.686860 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:44:49.686860 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:44:49.686860 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:44:49.686860 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:44:49.686860 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:44:49.686860 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:44:49.686860 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:44:49.686860 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:44:49.686860 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:44:49.686860 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:44:49.686860 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers Oct 04 21:44:49.686860 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Oct 04 21:44:49.686860 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Oct 04 21:44:49.686860 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 04 21:44:49.686860 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'cd279500-8766-4799-b435-4054a1d9517d' could be found. Oct 04 21:44:49.686860 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:44:49.686860 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:44:49.686860 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:44:49.686860 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:44:49.688261 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:44:49.688261 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:44:49.688261 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:44:49.688261 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:44:49.688261 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'cd279500-8766-4799-b435-4054a1d9517d' could be found. Oct 04 21:44:49.688261 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:44:49.689009 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-1f1d5c7f-d863-441d-ae35-12a2ef048862 tempest-HypervisorAdminNegativeUnderV252Test-1017232615 tempest-HypervisorAdminNegativeUnderV252Test-1017232615-project-admin] Returning 404 to user: No hypervisor matching 'cd279500-8766-4799-b435-4054a1d9517d' could be found. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:44:49.693281 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-1f1d5c7f-d863-441d-ae35-12a2ef048862 tempest-HypervisorAdminNegativeUnderV252Test-1017232615 tempest-HypervisorAdminNegativeUnderV252Test-1017232615-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hypervisors/cd279500-8766-4799-b435-4054a1d9517d/servers" status: 404 len: 123 microversion: 2.1 time: 0.061041 Oct 04 21:44:49.700143 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 235/495] 10.222.0.43 () {58 vars in 1281 bytes} [Tue Oct 4 21:44:49 2022] GET /compute/v2.1/os-hypervisors/cd279500-8766-4799-b435-4054a1d9517d/servers => generated 123 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:44:50.342303 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-97055d14-3f3e-4856-95ea-63e39f6a9466 tempest-ServersOnMultiNodesTest-962622545 tempest-ServersOnMultiNodesTest-962622545-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/258bc0cb-6718-4f8b-8d0b-ef544b2b659b" status: 200 len: 1618 microversion: 2.1 time: 0.757842 Oct 04 21:44:50.342902 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 261/496] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:44:49 2022] GET /compute/v2.1/servers/258bc0cb-6718-4f8b-8d0b-ef544b2b659b => generated 1618 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:44:50.371420 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-69a99f0e-2c86-43e9-b70f-e1cf4afa78a4 tempest-ServersOnMultiNodesTest-962622545 tempest-ServersOnMultiNodesTest-962622545-project-admin] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:50.373223 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-69a99f0e-2c86-43e9-b70f-e1cf4afa78a4 tempest-ServersOnMultiNodesTest-962622545 tempest-ServersOnMultiNodesTest-962622545-project-admin] [instance: 7d71d6d3-3a63-406b-ac49-3e83bd539cf9] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:50.387976 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-69a99f0e-2c86-43e9-b70f-e1cf4afa78a4 tempest-ServersOnMultiNodesTest-962622545 tempest-ServersOnMultiNodesTest-962622545-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:50.390999 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-69a99f0e-2c86-43e9-b70f-e1cf4afa78a4 tempest-ServersOnMultiNodesTest-962622545 tempest-ServersOnMultiNodesTest-962622545-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:50.391769 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-69a99f0e-2c86-43e9-b70f-e1cf4afa78a4 tempest-ServersOnMultiNodesTest-962622545 tempest-ServersOnMultiNodesTest-962622545-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:50.392756 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-69a99f0e-2c86-43e9-b70f-e1cf4afa78a4 tempest-ServersOnMultiNodesTest-962622545 tempest-ServersOnMultiNodesTest-962622545-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:50.395563 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-69a99f0e-2c86-43e9-b70f-e1cf4afa78a4 tempest-ServersOnMultiNodesTest-962622545 tempest-ServersOnMultiNodesTest-962622545-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:50.398292 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-69a99f0e-2c86-43e9-b70f-e1cf4afa78a4 tempest-ServersOnMultiNodesTest-962622545 tempest-ServersOnMultiNodesTest-962622545-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:50.599796 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-b1b67d39-f3b1-4287-bba2-fe12b45ba426 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:50.602206 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-b1b67d39-f3b1-4287-bba2-fe12b45ba426 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: ec437ce7-b43a-4c8b-8a06-756cfb877851] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:50.612621 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b1b67d39-f3b1-4287-bba2-fe12b45ba426 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:50.619441 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b1b67d39-f3b1-4287-bba2-fe12b45ba426 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:50.624156 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b1b67d39-f3b1-4287-bba2-fe12b45ba426 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:50.625540 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b1b67d39-f3b1-4287-bba2-fe12b45ba426 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:50.626859 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b1b67d39-f3b1-4287-bba2-fe12b45ba426 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:50.627840 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b1b67d39-f3b1-4287-bba2-fe12b45ba426 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:50.720273 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-69a99f0e-2c86-43e9-b70f-e1cf4afa78a4 tempest-ServersOnMultiNodesTest-962622545 tempest-ServersOnMultiNodesTest-962622545-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/7d71d6d3-3a63-406b-ac49-3e83bd539cf9" status: 200 len: 1618 microversion: 2.1 time: 0.354545 Oct 04 21:44:50.721440 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 236/497] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:44:50 2022] GET /compute/v2.1/servers/7d71d6d3-3a63-406b-ac49-3e83bd539cf9 => generated 1618 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:44:50.769845 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-cc3d79bc-69a8-485b-ae2c-73aeb4e69ca9 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Action: 'create', calling method: .version_select at 0x7fbb2f869a60>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-304837733", "policies": ["anti-affinity"]}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:44:50.834423 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-cc3d79bc-69a8-485b-ae2c-73aeb4e69ca9 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Getting quotas for project 39edf587afe94b60911198aa0bb61613. Resources: {'server_groups'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:44:50.848023 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-cc3d79bc-69a8-485b-ae2c-73aeb4e69ca9 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Getting quotas for user 29842a669a20408b881105135f76cb0a and project 39edf587afe94b60911198aa0bb61613. Resources: {'server_groups'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:44:50.948586 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=4,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:44:50.974859 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-cc3d79bc-69a8-485b-ae2c-73aeb4e69ca9 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Getting quotas for project 39edf587afe94b60911198aa0bb61613. Resources: {'server_groups'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:44:50.993857 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-cc3d79bc-69a8-485b-ae2c-73aeb4e69ca9 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Getting quotas for user 29842a669a20408b881105135f76cb0a and project 39edf587afe94b60911198aa0bb61613. Resources: {'server_groups'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:44:51.030614 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-b1b67d39-f3b1-4287-bba2-fe12b45ba426 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:44:51.040823 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-b1b67d39-f3b1-4287-bba2-fe12b45ba426 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/ec437ce7-b43a-4c8b-8a06-756cfb877851" status: 200 len: 1474 microversion: 2.1 time: 0.445637 Oct 04 21:44:51.042448 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-cc3d79bc-69a8-485b-ae2c-73aeb4e69ca9 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] 10.222.0.43 "POST /compute/v2.1/os-server-groups" status: 200 len: 192 microversion: 2.1 time: 0.278575 Oct 04 21:44:51.055429 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 237/498] 10.222.0.43 () {60 vars in 1174 bytes} [Tue Oct 4 21:44:50 2022] POST /compute/v2.1/os-server-groups => generated 192 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:44:51.059944 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 262/499] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:44:50 2022] GET /compute/v2.1/servers/ec437ce7-b43a-4c8b-8a06-756cfb877851 => generated 1474 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:44:51.458745 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-ea65d135-50f4-427f-b14b-03dd1c1b79ca tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-379279328", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "98988bff-2fca-46fa-8954-3dfc730df468"}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:44:51.627673 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.network.neutron [None req-ea65d135-50f4-427f-b14b-03dd1c1b79ca tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] validate_networks() for None {{(pid=134102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:44:52.089183 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-c9147b71-bb8e-479c-8ce5-960f060cc001 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:52.089920 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-c9147b71-bb8e-479c-8ce5-960f060cc001 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: ec437ce7-b43a-4c8b-8a06-756cfb877851] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:52.105713 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c9147b71-bb8e-479c-8ce5-960f060cc001 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:52.107728 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c9147b71-bb8e-479c-8ce5-960f060cc001 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:52.117551 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c9147b71-bb8e-479c-8ce5-960f060cc001 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:52.120353 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c9147b71-bb8e-479c-8ce5-960f060cc001 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:52.124707 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c9147b71-bb8e-479c-8ce5-960f060cc001 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:52.125496 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c9147b71-bb8e-479c-8ce5-960f060cc001 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:52.496439 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-ea65d135-50f4-427f-b14b-03dd1c1b79ca tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Flavor limits 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:44:52.497066 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-ea65d135-50f4-427f-b14b-03dd1c1b79ca tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Image limits 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:44:52.498900 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-ea65d135-50f4-427f-b14b-03dd1c1b79ca tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Flavor pref 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:44:52.500500 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-ea65d135-50f4-427f-b14b-03dd1c1b79ca tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Image pref 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:44:52.501066 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-ea65d135-50f4-427f-b14b-03dd1c1b79ca tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:44:52.558470 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ea65d135-50f4-427f-b14b-03dd1c1b79ca tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:52.558955 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ea65d135-50f4-427f-b14b-03dd1c1b79ca tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:52.559389 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ea65d135-50f4-427f-b14b-03dd1c1b79ca tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:52.560105 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ea65d135-50f4-427f-b14b-03dd1c1b79ca tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:52.560552 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ea65d135-50f4-427f-b14b-03dd1c1b79ca tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:52.560973 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ea65d135-50f4-427f-b14b-03dd1c1b79ca tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:52.653071 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-ea65d135-50f4-427f-b14b-03dd1c1b79ca tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Getting quotas for project 39edf587afe94b60911198aa0bb61613. Resources: {'instances', 'ram', 'cores'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:44:52.681118 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-ea65d135-50f4-427f-b14b-03dd1c1b79ca tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Getting quotas for user 29842a669a20408b881105135f76cb0a and project 39edf587afe94b60911198aa0bb61613. Resources: {'instances', 'ram', 'cores'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:44:52.727440 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-c9147b71-bb8e-479c-8ce5-960f060cc001 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:44:52.739540 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-ea65d135-50f4-427f-b14b-03dd1c1b79ca tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Going to run 2 instances... {{(pid=134102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:44:52.742951 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-ea65d135-50f4-427f-b14b-03dd1c1b79ca tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] [instance: 3968d68f-a421-4d08-8b67-b5410b618a47] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='58548514-5dac-426c-81f5-19e3fba33e23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:44:52.745304 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-c9147b71-bb8e-479c-8ce5-960f060cc001 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/ec437ce7-b43a-4c8b-8a06-756cfb877851" status: 200 len: 1474 microversion: 2.1 time: 0.660825 Oct 04 21:44:52.756279 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 263/500] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:44:52 2022] GET /compute/v2.1/servers/ec437ce7-b43a-4c8b-8a06-756cfb877851 => generated 1474 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:44:52.940700 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-ea65d135-50f4-427f-b14b-03dd1c1b79ca tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Getting quotas for project 39edf587afe94b60911198aa0bb61613. Resources: {'server_group_members'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:44:52.975271 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-ea65d135-50f4-427f-b14b-03dd1c1b79ca tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Getting quotas for user 29842a669a20408b881105135f76cb0a and project 39edf587afe94b60911198aa0bb61613. Resources: {'server_group_members'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:44:53.087394 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-ea65d135-50f4-427f-b14b-03dd1c1b79ca tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Getting quotas for project 39edf587afe94b60911198aa0bb61613. Resources: {'server_group_members'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:44:53.114903 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-ea65d135-50f4-427f-b14b-03dd1c1b79ca tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Getting quotas for user 29842a669a20408b881105135f76cb0a and project 39edf587afe94b60911198aa0bb61613. Resources: {'server_group_members'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:44:53.162398 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-ea65d135-50f4-427f-b14b-03dd1c1b79ca tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] [instance: e204d537-73b1-4070-a3f4-e0e3053e0639] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='58548514-5dac-426c-81f5-19e3fba33e23',instance=,instance_uuid=3968d68f-a421-4d08-8b67-b5410b618a47,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:44:53.419712 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-ea65d135-50f4-427f-b14b-03dd1c1b79ca tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Getting quotas for project 39edf587afe94b60911198aa0bb61613. Resources: {'server_group_members'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:44:53.435898 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-ea65d135-50f4-427f-b14b-03dd1c1b79ca tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Getting quotas for user 29842a669a20408b881105135f76cb0a and project 39edf587afe94b60911198aa0bb61613. Resources: {'server_group_members'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:44:53.567306 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-ea65d135-50f4-427f-b14b-03dd1c1b79ca tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Getting quotas for project 39edf587afe94b60911198aa0bb61613. Resources: {'server_group_members'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:44:53.605006 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-ea65d135-50f4-427f-b14b-03dd1c1b79ca tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Getting quotas for user 29842a669a20408b881105135f76cb0a and project 39edf587afe94b60911198aa0bb61613. Resources: {'server_group_members'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:44:53.730040 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-ea65d135-50f4-427f-b14b-03dd1c1b79ca tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 2.277696 Oct 04 21:44:53.734645 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 238/501] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 21:44:51 2022] POST /compute/v2.1/servers => generated 32 bytes in 2283 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Oct 04 21:44:53.752775 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-2811fc3c-a258-4eaf-96d1-2b38bd95c102 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:53.778042 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-2811fc3c-a258-4eaf-96d1-2b38bd95c102 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '29842a669a20408b881105135f76cb0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39edf587afe94b60911198aa0bb61613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:44:53.782234 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-cea25d86-e853-4974-b3fb-78bb28ad4ad2 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:53.782947 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-cea25d86-e853-4974-b3fb-78bb28ad4ad2 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: ec437ce7-b43a-4c8b-8a06-756cfb877851] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:53.786514 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-2811fc3c-a258-4eaf-96d1-2b38bd95c102 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Searching by: {'deleted': False, 'project_id': '39edf587afe94b60911198aa0bb61613'} {{(pid=134101) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 21:44:53.792988 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cea25d86-e853-4974-b3fb-78bb28ad4ad2 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:53.793575 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cea25d86-e853-4974-b3fb-78bb28ad4ad2 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:53.794026 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cea25d86-e853-4974-b3fb-78bb28ad4ad2 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:53.798213 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cea25d86-e853-4974-b3fb-78bb28ad4ad2 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:53.798762 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cea25d86-e853-4974-b3fb-78bb28ad4ad2 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:53.801133 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cea25d86-e853-4974-b3fb-78bb28ad4ad2 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:53.864223 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2811fc3c-a258-4eaf-96d1-2b38bd95c102 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:53.867311 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2811fc3c-a258-4eaf-96d1-2b38bd95c102 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:53.867828 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2811fc3c-a258-4eaf-96d1-2b38bd95c102 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:53.870732 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2811fc3c-a258-4eaf-96d1-2b38bd95c102 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:53.871213 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2811fc3c-a258-4eaf-96d1-2b38bd95c102 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:53.874006 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2811fc3c-a258-4eaf-96d1-2b38bd95c102 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:54.384064 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=100 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:44:54.402114 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.multi_cell_list [None req-2811fc3c-a258-4eaf-96d1-2b38bd95c102 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=134101) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 21:44:54.594425 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-cea25d86-e853-4974-b3fb-78bb28ad4ad2 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:44:54.609728 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-cea25d86-e853-4974-b3fb-78bb28ad4ad2 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/ec437ce7-b43a-4c8b-8a06-756cfb877851" status: 200 len: 1471 microversion: 2.1 time: 0.831320 Oct 04 21:44:54.612995 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 239/502] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:44:53 2022] GET /compute/v2.1/servers/ec437ce7-b43a-4c8b-8a06-756cfb877851 => generated 1471 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:44:54.642511 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-e0849bb4-2e96-47f1-b738-b4a9e56dcbfe tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:44:54.643371 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-e0849bb4-2e96-47f1-b738-b4a9e56dcbfe tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: ec437ce7-b43a-4c8b-8a06-756cfb877851] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:54.657276 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e0849bb4-2e96-47f1-b738-b4a9e56dcbfe tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:54.661211 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e0849bb4-2e96-47f1-b738-b4a9e56dcbfe tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:54.664430 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e0849bb4-2e96-47f1-b738-b4a9e56dcbfe tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:54.669554 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e0849bb4-2e96-47f1-b738-b4a9e56dcbfe tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:54.671578 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e0849bb4-2e96-47f1-b738-b4a9e56dcbfe tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:54.672802 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e0849bb4-2e96-47f1-b738-b4a9e56dcbfe tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:54.717646 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-2811fc3c-a258-4eaf-96d1-2b38bd95c102 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] 10.222.0.43 "GET /compute/v2.1/servers" status: 200 len: 1659 microversion: 2.1 time: 0.977748 Oct 04 21:44:54.720818 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 264/503] 10.222.0.43 () {58 vars in 1125 bytes} [Tue Oct 4 21:44:53 2022] GET /compute/v2.1/servers => generated 1659 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:44:54.771856 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-73686d74-0bf4-4ce0-a873-2eadbd72a0a5 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:54.775686 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-73686d74-0bf4-4ce0-a873-2eadbd72a0a5 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] [instance: e204d537-73b1-4070-a3f4-e0e3053e0639] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:54.844441 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:44:54.977051 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-e0849bb4-2e96-47f1-b738-b4a9e56dcbfe tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "POST /compute/v2.1/servers/ec437ce7-b43a-4c8b-8a06-756cfb877851/action" status: 204 len: 0 microversion: 2.1 time: 0.324489 Oct 04 21:44:54.984577 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 240/504] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 21:44:54 2022] POST /compute/v2.1/servers/ec437ce7-b43a-4c8b-8a06-756cfb877851/action => generated 0 bytes in 343 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 21:44:55.017232 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-6dc620ba-e899-4fa1-834d-dec1503cc541 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:55.020263 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-6dc620ba-e899-4fa1-834d-dec1503cc541 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: ec437ce7-b43a-4c8b-8a06-756cfb877851] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:55.077846 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6dc620ba-e899-4fa1-834d-dec1503cc541 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:55.084035 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6dc620ba-e899-4fa1-834d-dec1503cc541 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:55.084516 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6dc620ba-e899-4fa1-834d-dec1503cc541 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:55.093417 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6dc620ba-e899-4fa1-834d-dec1503cc541 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:55.097491 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6dc620ba-e899-4fa1-834d-dec1503cc541 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:55.103004 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6dc620ba-e899-4fa1-834d-dec1503cc541 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:55.150985 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-73686d74-0bf4-4ce0-a873-2eadbd72a0a5 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29842a669a20408b881105135f76cb0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39edf587afe94b60911198aa0bb61613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:44:55.183352 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-73686d74-0bf4-4ce0-a873-2eadbd72a0a5 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] 10.222.0.43 "GET /compute/v2.1/servers/e204d537-73b1-4070-a3f4-e0e3053e0639" status: 200 len: 1218 microversion: 2.1 time: 0.431354 Oct 04 21:44:55.185012 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 265/505] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:44:54 2022] GET /compute/v2.1/servers/e204d537-73b1-4070-a3f4-e0e3053e0639 => generated 1218 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:44:55.585777 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-6dc620ba-e899-4fa1-834d-dec1503cc541 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:44:55.599421 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-6dc620ba-e899-4fa1-834d-dec1503cc541 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/ec437ce7-b43a-4c8b-8a06-756cfb877851" status: 200 len: 1471 microversion: 2.1 time: 0.609527 Oct 04 21:44:55.600789 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 241/506] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:44:54 2022] GET /compute/v2.1/servers/ec437ce7-b43a-4c8b-8a06-756cfb877851 => generated 1471 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:44:56.219953 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-2358311a-a116-4997-a2d3-e0beb82e27f3 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:56.221113 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-2358311a-a116-4997-a2d3-e0beb82e27f3 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] [instance: e204d537-73b1-4070-a3f4-e0e3053e0639] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:56.231618 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2358311a-a116-4997-a2d3-e0beb82e27f3 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:56.235823 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2358311a-a116-4997-a2d3-e0beb82e27f3 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:56.236518 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2358311a-a116-4997-a2d3-e0beb82e27f3 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:56.238826 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2358311a-a116-4997-a2d3-e0beb82e27f3 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:56.239459 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2358311a-a116-4997-a2d3-e0beb82e27f3 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:56.240697 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2358311a-a116-4997-a2d3-e0beb82e27f3 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:56.487908 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-d1637bb5-f95d-48ab-acf8-ff8f6ba0c7da tempest-FlavorsV255TestJSON-1089473033 tempest-FlavorsV255TestJSON-1089473033-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-1103989487", "id": 15798027, "os-flavor-access:is_public": "True"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:44:56.526254 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=4,nova_api:DELETE=4,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:44:56.561497 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-d1637bb5-f95d-48ab-acf8-ff8f6ba0c7da tempest-FlavorsV255TestJSON-1089473033 tempest-FlavorsV255TestJSON-1089473033-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 443 microversion: 2.55 time: 0.604671 Oct 04 21:44:56.567324 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 266/507] 10.222.0.43 () {62 vars in 1188 bytes} [Tue Oct 4 21:44:55 2022] POST /compute/v2.1/flavors => generated 443 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:44:56.590453 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-2358311a-a116-4997-a2d3-e0beb82e27f3 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29842a669a20408b881105135f76cb0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39edf587afe94b60911198aa0bb61613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:44:56.604308 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-2358311a-a116-4997-a2d3-e0beb82e27f3 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] 10.222.0.43 "GET /compute/v2.1/servers/e204d537-73b1-4070-a3f4-e0e3053e0639" status: 200 len: 1222 microversion: 2.1 time: 0.389873 Oct 04 21:44:56.631686 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 242/508] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:44:56 2022] GET /compute/v2.1/servers/e204d537-73b1-4070-a3f4-e0e3053e0639 => generated 1222 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:44:56.637170 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-138acd84-e30b-4b83-950c-e12fa59c6877 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:56.637806 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-138acd84-e30b-4b83-950c-e12fa59c6877 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: ec437ce7-b43a-4c8b-8a06-756cfb877851] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:56.689144 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-138acd84-e30b-4b83-950c-e12fa59c6877 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:56.689651 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-138acd84-e30b-4b83-950c-e12fa59c6877 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:56.690095 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-138acd84-e30b-4b83-950c-e12fa59c6877 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:56.690853 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-138acd84-e30b-4b83-950c-e12fa59c6877 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:56.691321 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-138acd84-e30b-4b83-950c-e12fa59c6877 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:56.691754 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-138acd84-e30b-4b83-950c-e12fa59c6877 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:57.158153 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-17e9cd98-7f26-480f-be9a-e5335d1fa8e0 tempest-FlavorsV255TestJSON-519467626 tempest-FlavorsV255TestJSON-519467626-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:57.169879 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-17e9cd98-7f26-480f-be9a-e5335d1fa8e0 tempest-FlavorsV255TestJSON-519467626 tempest-FlavorsV255TestJSON-519467626-project] 10.222.0.43 "GET /compute/v2.1/flavors/15798027" status: 200 len: 443 microversion: 2.55 time: 0.594511 Oct 04 21:44:57.178632 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 267/509] 10.222.0.43 () {60 vars in 1193 bytes} [Tue Oct 4 21:44:56 2022] GET /compute/v2.1/flavors/15798027 => generated 443 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 21:44:57.197406 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-d574d49c-6144-4cc8-9943-3765fd6ef866 tempest-FlavorsV255TestJSON-1089473033 tempest-FlavorsV255TestJSON-1089473033-project-admin] Action: 'update', calling method: .version_select at 0x7fbb34f1c310>, body: {"flavor": {"description": "new"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:44:57.294074 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-d574d49c-6144-4cc8-9943-3765fd6ef866 tempest-FlavorsV255TestJSON-1089473033 tempest-FlavorsV255TestJSON-1089473033-project-admin] 10.222.0.43 "PUT /compute/v2.1/flavors/15798027" status: 200 len: 444 microversion: 2.55 time: 0.103825 Oct 04 21:44:57.294989 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 268/510] 10.222.0.43 () {62 vars in 1213 bytes} [Tue Oct 4 21:44:57 2022] PUT /compute/v2.1/flavors/15798027 => generated 444 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:44:57.312000 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-8c4ef775-eb81-4687-87b6-5e25298f7328 tempest-FlavorsV255TestJSON-519467626 tempest-FlavorsV255TestJSON-519467626-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:57.381764 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-8c4ef775-eb81-4687-87b6-5e25298f7328 tempest-FlavorsV255TestJSON-519467626 tempest-FlavorsV255TestJSON-519467626-project] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 6591 microversion: 2.55 time: 0.074376 Oct 04 21:44:57.385998 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 269/511] 10.222.0.43 () {60 vars in 1187 bytes} [Tue Oct 4 21:44:57 2022] GET /compute/v2.1/flavors/detail => generated 6591 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:44:57.407770 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-23c22bbb-1c2d-485d-877f-7e8dbe4df740 tempest-FlavorsV255TestJSON-519467626 tempest-FlavorsV255TestJSON-519467626-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:57.488083 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-23c22bbb-1c2d-485d-877f-7e8dbe4df740 tempest-FlavorsV255TestJSON-519467626 tempest-FlavorsV255TestJSON-519467626-project] 10.222.0.43 "GET /compute/v2.1/flavors" status: 200 len: 3681 microversion: 2.55 time: 0.083050 Oct 04 21:44:57.491992 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 270/512] 10.222.0.43 () {60 vars in 1166 bytes} [Tue Oct 4 21:44:57 2022] GET /compute/v2.1/flavors => generated 3681 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:44:57.510247 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-4e745c69-415f-4810-9d7b-2d82890ba26f tempest-FlavorsV255TestJSON-1089473033 tempest-FlavorsV255TestJSON-1089473033-project-admin] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:57.563337 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-4e745c69-415f-4810-9d7b-2d82890ba26f tempest-FlavorsV255TestJSON-1089473033 tempest-FlavorsV255TestJSON-1089473033-project-admin] 10.222.0.43 "DELETE /compute/v2.1/flavors/15798027" status: 202 len: 0 microversion: 2.55 time: 0.053464 Oct 04 21:44:57.564799 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 271/513] 10.222.0.43 () {60 vars in 1196 bytes} [Tue Oct 4 21:44:57 2022] DELETE /compute/v2.1/flavors/15798027 => generated 0 bytes in 59 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 04 21:44:57.587419 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-3137ef2f-e5a5-49a3-b4fd-10d04b2b3e89 tempest-FlavorsV255TestJSON-1089473033 tempest-FlavorsV255TestJSON-1089473033-project-admin] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:57.690590 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-3137ef2f-e5a5-49a3-b4fd-10d04b2b3e89 tempest-FlavorsV255TestJSON-1089473033 tempest-FlavorsV255TestJSON-1089473033-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 6157 microversion: 2.55 time: 0.120120 Oct 04 21:44:57.691885 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 272/514] 10.222.0.43 () {60 vars in 1187 bytes} [Tue Oct 4 21:44:57 2022] GET /compute/v2.1/flavors/detail => generated 6157 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:44:57.720745 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-97fb27ea-11d0-4d03-bd94-b3b28f3f95cb tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:57.724069 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-97fb27ea-11d0-4d03-bd94-b3b28f3f95cb tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] [instance: e204d537-73b1-4070-a3f4-e0e3053e0639] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:57.745406 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-97fb27ea-11d0-4d03-bd94-b3b28f3f95cb tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:57.746207 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-97fb27ea-11d0-4d03-bd94-b3b28f3f95cb tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:57.747243 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-97fb27ea-11d0-4d03-bd94-b3b28f3f95cb tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:57.750130 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-97fb27ea-11d0-4d03-bd94-b3b28f3f95cb tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:57.752293 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-97fb27ea-11d0-4d03-bd94-b3b28f3f95cb tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:57.756305 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-97fb27ea-11d0-4d03-bd94-b3b28f3f95cb tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:58.252418 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-97fb27ea-11d0-4d03-bd94-b3b28f3f95cb tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29842a669a20408b881105135f76cb0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39edf587afe94b60911198aa0bb61613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:44:58.269164 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-97fb27ea-11d0-4d03-bd94-b3b28f3f95cb tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] 10.222.0.43 "GET /compute/v2.1/servers/e204d537-73b1-4070-a3f4-e0e3053e0639" status: 200 len: 1270 microversion: 2.1 time: 0.575889 Oct 04 21:44:58.281098 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 273/515] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:44:57 2022] GET /compute/v2.1/servers/e204d537-73b1-4070-a3f4-e0e3053e0639 => generated 1270 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:44:58.282048 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-138acd84-e30b-4b83-950c-e12fa59c6877 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:44:58.309425 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-138acd84-e30b-4b83-950c-e12fa59c6877 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/ec437ce7-b43a-4c8b-8a06-756cfb877851" status: 200 len: 1471 microversion: 2.1 time: 1.676013 Oct 04 21:44:58.310296 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 243/516] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:44:56 2022] GET /compute/v2.1/servers/ec437ce7-b43a-4c8b-8a06-756cfb877851 => generated 1471 bytes in 1678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:44:59.321553 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-42c96791-63c5-41ce-b33f-460281bfa5ec tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:59.323181 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-42c96791-63c5-41ce-b33f-460281bfa5ec tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] [instance: e204d537-73b1-4070-a3f4-e0e3053e0639] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:59.347622 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-0dc1bb1f-ad00-4a76-ac55-4d979a99aeb9 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:59.348409 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-0dc1bb1f-ad00-4a76-ac55-4d979a99aeb9 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: ec437ce7-b43a-4c8b-8a06-756cfb877851] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:59.365350 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0dc1bb1f-ad00-4a76-ac55-4d979a99aeb9 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:59.367172 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0dc1bb1f-ad00-4a76-ac55-4d979a99aeb9 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:59.367628 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0dc1bb1f-ad00-4a76-ac55-4d979a99aeb9 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:59.367811 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-42c96791-63c5-41ce-b33f-460281bfa5ec tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:59.368472 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-42c96791-63c5-41ce-b33f-460281bfa5ec tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:59.370784 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0dc1bb1f-ad00-4a76-ac55-4d979a99aeb9 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:59.370977 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-42c96791-63c5-41ce-b33f-460281bfa5ec tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:59.372813 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0dc1bb1f-ad00-4a76-ac55-4d979a99aeb9 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:59.372813 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0dc1bb1f-ad00-4a76-ac55-4d979a99aeb9 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:59.379411 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-42c96791-63c5-41ce-b33f-460281bfa5ec tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:59.380252 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-42c96791-63c5-41ce-b33f-460281bfa5ec tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:59.382226 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-42c96791-63c5-41ce-b33f-460281bfa5ec tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:59.820693 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-42c96791-63c5-41ce-b33f-460281bfa5ec tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29842a669a20408b881105135f76cb0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39edf587afe94b60911198aa0bb61613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:44:59.832536 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-42c96791-63c5-41ce-b33f-460281bfa5ec tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] 10.222.0.43 "GET /compute/v2.1/servers/e204d537-73b1-4070-a3f4-e0e3053e0639" status: 200 len: 1276 microversion: 2.1 time: 0.522187 Oct 04 21:44:59.834624 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 274/517] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:44:59 2022] GET /compute/v2.1/servers/e204d537-73b1-4070-a3f4-e0e3053e0639 => generated 1276 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:44:59.994936 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-26cc65c7-dd7b-4961-ab57-1c335a81c88c req-4148db92-8bea-4faa-8a30-0e71dd2a1536 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec437ce7-b43a-4c8b-8a06-756cfb877851", "name": "network-vif-plugged", "status": "completed", "tag": "11205198-745e-4214-9769-9da045caa32b"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:45:00.024685 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-26cc65c7-dd7b-4961-ab57-1c335a81c88c req-4148db92-8bea-4faa-8a30-0e71dd2a1536 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:00.024685 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-26cc65c7-dd7b-4961-ab57-1c335a81c88c req-4148db92-8bea-4faa-8a30-0e71dd2a1536 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:00.025151 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-26cc65c7-dd7b-4961-ab57-1c335a81c88c req-4148db92-8bea-4faa-8a30-0e71dd2a1536 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:00.057561 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-26cc65c7-dd7b-4961-ab57-1c335a81c88c req-4148db92-8bea-4faa-8a30-0e71dd2a1536 service nova] Creating event network-vif-plugged:11205198-745e-4214-9769-9da045caa32b for instance ec437ce7-b43a-4c8b-8a06-756cfb877851 on n-h1-860284-1 Oct 04 21:45:00.088277 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-26cc65c7-dd7b-4961-ab57-1c335a81c88c req-4148db92-8bea-4faa-8a30-0e71dd2a1536 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097521 Oct 04 21:45:00.090652 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 275/518] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:44:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:45:00.701922 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-0dc1bb1f-ad00-4a76-ac55-4d979a99aeb9 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:00.713333 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-0dc1bb1f-ad00-4a76-ac55-4d979a99aeb9 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/ec437ce7-b43a-4c8b-8a06-756cfb877851" status: 200 len: 1471 microversion: 2.1 time: 1.378649 Oct 04 21:45:00.720422 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 244/519] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:44:59 2022] GET /compute/v2.1/servers/ec437ce7-b43a-4c8b-8a06-756cfb877851 => generated 1471 bytes in 1387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:45:00.861699 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-f98d6ac2-c66f-4a77-bf61-d535055e8db4 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:00.864031 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-f98d6ac2-c66f-4a77-bf61-d535055e8db4 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] [instance: e204d537-73b1-4070-a3f4-e0e3053e0639] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:00.874187 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f98d6ac2-c66f-4a77-bf61-d535055e8db4 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:00.874773 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f98d6ac2-c66f-4a77-bf61-d535055e8db4 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:00.875195 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f98d6ac2-c66f-4a77-bf61-d535055e8db4 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:00.876833 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f98d6ac2-c66f-4a77-bf61-d535055e8db4 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:00.878033 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f98d6ac2-c66f-4a77-bf61-d535055e8db4 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:00.879053 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f98d6ac2-c66f-4a77-bf61-d535055e8db4 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:01.037547 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-43648ce2-2ccf-4cb1-9446-cece45407574 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-752609464", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:45:01.072719 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-f98d6ac2-c66f-4a77-bf61-d535055e8db4 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29842a669a20408b881105135f76cb0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39edf587afe94b60911198aa0bb61613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:01.085613 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-f98d6ac2-c66f-4a77-bf61-d535055e8db4 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] 10.222.0.43 "GET /compute/v2.1/servers/e204d537-73b1-4070-a3f4-e0e3053e0639" status: 200 len: 1276 microversion: 2.1 time: 0.229238 Oct 04 21:45:01.086733 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 245/520] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:00 2022] GET /compute/v2.1/servers/e204d537-73b1-4070-a3f4-e0e3053e0639 => generated 1276 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:45:01.145652 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.network.neutron [None req-43648ce2-2ccf-4cb1-9446-cece45407574 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] validate_networks() for None {{(pid=134101) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:45:01.752558 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-cbc8b47b-0c0c-40cc-a8ae-007ea94126fd tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:01.753194 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-cbc8b47b-0c0c-40cc-a8ae-007ea94126fd tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: ec437ce7-b43a-4c8b-8a06-756cfb877851] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:01.767609 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cbc8b47b-0c0c-40cc-a8ae-007ea94126fd tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:01.768677 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cbc8b47b-0c0c-40cc-a8ae-007ea94126fd tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:01.771606 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cbc8b47b-0c0c-40cc-a8ae-007ea94126fd tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:01.772970 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cbc8b47b-0c0c-40cc-a8ae-007ea94126fd tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:01.773688 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cbc8b47b-0c0c-40cc-a8ae-007ea94126fd tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:01.774343 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cbc8b47b-0c0c-40cc-a8ae-007ea94126fd tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:01.885109 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-43648ce2-2ccf-4cb1-9446-cece45407574 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Flavor limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:45:01.886061 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-43648ce2-2ccf-4cb1-9446-cece45407574 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Image limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:45:01.886584 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-43648ce2-2ccf-4cb1-9446-cece45407574 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Flavor pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:45:01.887003 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-43648ce2-2ccf-4cb1-9446-cece45407574 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Image pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:45:01.887621 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-43648ce2-2ccf-4cb1-9446-cece45407574 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:45:01.908651 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-43648ce2-2ccf-4cb1-9446-cece45407574 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:01.914510 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-43648ce2-2ccf-4cb1-9446-cece45407574 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:01.915317 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-43648ce2-2ccf-4cb1-9446-cece45407574 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:01.916464 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-43648ce2-2ccf-4cb1-9446-cece45407574 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:01.917089 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-43648ce2-2ccf-4cb1-9446-cece45407574 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:01.917701 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-43648ce2-2ccf-4cb1-9446-cece45407574 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:01.982178 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-43648ce2-2ccf-4cb1-9446-cece45407574 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Getting quotas for project 94201b6c845f4334b6f4883606b0d037. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:45:01.998456 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-43648ce2-2ccf-4cb1-9446-cece45407574 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Getting quotas for user 6975d7cbd8554e06a15a8b2adc811b12 and project 94201b6c845f4334b6f4883606b0d037. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:45:02.040592 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-43648ce2-2ccf-4cb1-9446-cece45407574 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Going to run 1 instances... {{(pid=134101) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:45:02.043162 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-43648ce2-2ccf-4cb1-9446-cece45407574 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] [instance: 049f396b-7494-4b40-ad21-c3401958088b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='58548514-5dac-426c-81f5-19e3fba33e23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134101) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:45:02.183420 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-43648ce2-2ccf-4cb1-9446-cece45407574 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.661757 Oct 04 21:45:02.191359 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 276/521] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 21:45:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 1670 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 21:45:02.197725 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-7f20c000-5aa5-42f6-8326-1c2eb25d30b4 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:02.198703 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-7f20c000-5aa5-42f6-8326-1c2eb25d30b4 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] [instance: e204d537-73b1-4070-a3f4-e0e3053e0639] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:02.207797 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7f20c000-5aa5-42f6-8326-1c2eb25d30b4 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:02.208599 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7f20c000-5aa5-42f6-8326-1c2eb25d30b4 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:02.209245 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7f20c000-5aa5-42f6-8326-1c2eb25d30b4 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:02.210272 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7f20c000-5aa5-42f6-8326-1c2eb25d30b4 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:02.211485 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7f20c000-5aa5-42f6-8326-1c2eb25d30b4 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:02.212504 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7f20c000-5aa5-42f6-8326-1c2eb25d30b4 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:02.617912 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell0:SELECT=4 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:45:03.453752 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-7f20c000-5aa5-42f6-8326-1c2eb25d30b4 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29842a669a20408b881105135f76cb0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39edf587afe94b60911198aa0bb61613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:03.464182 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-7f20c000-5aa5-42f6-8326-1c2eb25d30b4 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] 10.222.0.43 "GET /compute/v2.1/servers/e204d537-73b1-4070-a3f4-e0e3053e0639" status: 200 len: 1276 microversion: 2.1 time: 1.270999 Oct 04 21:45:03.471438 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 277/522] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:02 2022] GET /compute/v2.1/servers/e204d537-73b1-4070-a3f4-e0e3053e0639 => generated 1276 bytes in 1279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:45:03.486782 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-3c5fe05d-2e72-4e10-b3e4-23cb7ae813ea tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:03.488012 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-3c5fe05d-2e72-4e10-b3e4-23cb7ae813ea tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] [instance: 049f396b-7494-4b40-ad21-c3401958088b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:03.505679 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3c5fe05d-2e72-4e10-b3e4-23cb7ae813ea tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:03.512255 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3c5fe05d-2e72-4e10-b3e4-23cb7ae813ea tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:03.512890 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3c5fe05d-2e72-4e10-b3e4-23cb7ae813ea tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:03.515753 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3c5fe05d-2e72-4e10-b3e4-23cb7ae813ea tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:03.516657 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3c5fe05d-2e72-4e10-b3e4-23cb7ae813ea tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:03.519128 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3c5fe05d-2e72-4e10-b3e4-23cb7ae813ea tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:03.637702 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell0:SELECT=32 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:45:04.161685 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-3c5fe05d-2e72-4e10-b3e4-23cb7ae813ea tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6975d7cbd8554e06a15a8b2adc811b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94201b6c845f4334b6f4883606b0d037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:04.173011 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-3c5fe05d-2e72-4e10-b3e4-23cb7ae813ea tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] 10.222.0.43 "GET /compute/v2.1/servers/049f396b-7494-4b40-ad21-c3401958088b" status: 200 len: 1217 microversion: 2.1 time: 0.700143 Oct 04 21:45:04.178386 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 278/523] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:03 2022] GET /compute/v2.1/servers/049f396b-7494-4b40-ad21-c3401958088b => generated 1217 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:45:04.501626 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-0859190b-915a-4b26-b9a7-941aeb565dd6 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:04.502324 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-0859190b-915a-4b26-b9a7-941aeb565dd6 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] [instance: e204d537-73b1-4070-a3f4-e0e3053e0639] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:04.524682 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0859190b-915a-4b26-b9a7-941aeb565dd6 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:04.525426 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0859190b-915a-4b26-b9a7-941aeb565dd6 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:04.527119 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0859190b-915a-4b26-b9a7-941aeb565dd6 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:04.527999 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0859190b-915a-4b26-b9a7-941aeb565dd6 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:04.529623 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0859190b-915a-4b26-b9a7-941aeb565dd6 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:04.530307 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0859190b-915a-4b26-b9a7-941aeb565dd6 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:04.692787 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-cbc8b47b-0c0c-40cc-a8ae-007ea94126fd tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:04.702922 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-cbc8b47b-0c0c-40cc-a8ae-007ea94126fd tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/ec437ce7-b43a-4c8b-8a06-756cfb877851" status: 200 len: 1463 microversion: 2.1 time: 2.955782 Oct 04 21:45:04.707225 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 246/524] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:01 2022] GET /compute/v2.1/servers/ec437ce7-b43a-4c8b-8a06-756cfb877851 => generated 1463 bytes in 2961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:45:04.733535 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-dbfb75c3-da8a-4ada-ac5b-3cf1bd5fb57d tempest-MigrationsAdminTest-1218821219 tempest-MigrationsAdminTest-1218821219-project-admin] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:04.745459 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-dbfb75c3-da8a-4ada-ac5b-3cf1bd5fb57d tempest-MigrationsAdminTest-1218821219 tempest-MigrationsAdminTest-1218821219-project-admin] [instance: ec437ce7-b43a-4c8b-8a06-756cfb877851] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:04.756583 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dbfb75c3-da8a-4ada-ac5b-3cf1bd5fb57d tempest-MigrationsAdminTest-1218821219 tempest-MigrationsAdminTest-1218821219-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:04.757362 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dbfb75c3-da8a-4ada-ac5b-3cf1bd5fb57d tempest-MigrationsAdminTest-1218821219 tempest-MigrationsAdminTest-1218821219-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:04.757976 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dbfb75c3-da8a-4ada-ac5b-3cf1bd5fb57d tempest-MigrationsAdminTest-1218821219 tempest-MigrationsAdminTest-1218821219-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:04.758876 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dbfb75c3-da8a-4ada-ac5b-3cf1bd5fb57d tempest-MigrationsAdminTest-1218821219 tempest-MigrationsAdminTest-1218821219-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:04.759482 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dbfb75c3-da8a-4ada-ac5b-3cf1bd5fb57d tempest-MigrationsAdminTest-1218821219 tempest-MigrationsAdminTest-1218821219-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:04.760055 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dbfb75c3-da8a-4ada-ac5b-3cf1bd5fb57d tempest-MigrationsAdminTest-1218821219 tempest-MigrationsAdminTest-1218821219-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:05.382358 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-0859190b-915a-4b26-b9a7-941aeb565dd6 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29842a669a20408b881105135f76cb0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39edf587afe94b60911198aa0bb61613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:05.403279 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-0859190b-915a-4b26-b9a7-941aeb565dd6 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] 10.222.0.43 "GET /compute/v2.1/servers/e204d537-73b1-4070-a3f4-e0e3053e0639" status: 200 len: 1318 microversion: 2.1 time: 0.907932 Oct 04 21:45:05.404673 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 279/525] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:04 2022] GET /compute/v2.1/servers/e204d537-73b1-4070-a3f4-e0e3053e0639 => generated 1318 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:45:05.425791 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-eecd630c-9ae7-4dcb-90f2-893ff33e5b09 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:05.427490 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-eecd630c-9ae7-4dcb-90f2-893ff33e5b09 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] [instance: 049f396b-7494-4b40-ad21-c3401958088b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:05.443750 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-eecd630c-9ae7-4dcb-90f2-893ff33e5b09 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:05.445600 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-eecd630c-9ae7-4dcb-90f2-893ff33e5b09 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:05.447080 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-eecd630c-9ae7-4dcb-90f2-893ff33e5b09 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:05.450931 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-eecd630c-9ae7-4dcb-90f2-893ff33e5b09 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:05.451704 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-eecd630c-9ae7-4dcb-90f2-893ff33e5b09 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:05.452331 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-eecd630c-9ae7-4dcb-90f2-893ff33e5b09 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:05.518639 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-dbfb75c3-da8a-4ada-ac5b-3cf1bd5fb57d tempest-MigrationsAdminTest-1218821219 tempest-MigrationsAdminTest-1218821219-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/ec437ce7-b43a-4c8b-8a06-756cfb877851" status: 200 len: 1614 microversion: 2.1 time: 0.784348 Oct 04 21:45:05.520526 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 247/526] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:04 2022] GET /compute/v2.1/servers/ec437ce7-b43a-4c8b-8a06-756cfb877851 => generated 1614 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:45:05.556502 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-b812e637-94c7-44cd-94c2-615f0ad76d63 tempest-MigrationsAdminTest-1218821219 tempest-MigrationsAdminTest-1218821219-project-admin] Calling method '.version_select at 0x7fbb2f865ca0>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:05.560091 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b812e637-94c7-44cd-94c2-615f0ad76d63 tempest-MigrationsAdminTest-1218821219 tempest-MigrationsAdminTest-1218821219-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:05.560578 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b812e637-94c7-44cd-94c2-615f0ad76d63 tempest-MigrationsAdminTest-1218821219 tempest-MigrationsAdminTest-1218821219-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:05.560999 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b812e637-94c7-44cd-94c2-615f0ad76d63 tempest-MigrationsAdminTest-1218821219 tempest-MigrationsAdminTest-1218821219-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:05.592072 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-b812e637-94c7-44cd-94c2-615f0ad76d63 tempest-MigrationsAdminTest-1218821219 tempest-MigrationsAdminTest-1218821219-project-admin] 10.222.0.43 "GET /compute/v2.1/os-migrations" status: 200 len: 409 microversion: 2.1 time: 0.041256 Oct 04 21:45:05.597938 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 248/527] 10.222.0.43 () {58 vars in 1143 bytes} [Tue Oct 4 21:45:05 2022] GET /compute/v2.1/os-migrations => generated 409 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:45:05.798431 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-c35c398d-b7c1-47bb-8286-1a752f8e3b5f tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-339819585", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452"}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:45:05.936667 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.network.neutron [None req-c35c398d-b7c1-47bb-8286-1a752f8e3b5f tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] validate_networks() for None {{(pid=134102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:45:06.023227 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-eecd630c-9ae7-4dcb-90f2-893ff33e5b09 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6975d7cbd8554e06a15a8b2adc811b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94201b6c845f4334b6f4883606b0d037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:06.041626 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-eecd630c-9ae7-4dcb-90f2-893ff33e5b09 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] 10.222.0.43 "GET /compute/v2.1/servers/049f396b-7494-4b40-ad21-c3401958088b" status: 200 len: 1279 microversion: 2.1 time: 0.630679 Oct 04 21:45:06.042478 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 280/528] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:05 2022] GET /compute/v2.1/servers/049f396b-7494-4b40-ad21-c3401958088b => generated 1279 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:45:06.431428 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-bff59136-f28f-4ab7-81b0-2f5c68b8fc98 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:06.432248 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-bff59136-f28f-4ab7-81b0-2f5c68b8fc98 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] [instance: e204d537-73b1-4070-a3f4-e0e3053e0639] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:06.442038 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bff59136-f28f-4ab7-81b0-2f5c68b8fc98 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:06.447753 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bff59136-f28f-4ab7-81b0-2f5c68b8fc98 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:06.450805 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bff59136-f28f-4ab7-81b0-2f5c68b8fc98 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:06.452778 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bff59136-f28f-4ab7-81b0-2f5c68b8fc98 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:06.457901 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bff59136-f28f-4ab7-81b0-2f5c68b8fc98 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:06.458748 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bff59136-f28f-4ab7-81b0-2f5c68b8fc98 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:07.174606 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-bff59136-f28f-4ab7-81b0-2f5c68b8fc98 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29842a669a20408b881105135f76cb0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39edf587afe94b60911198aa0bb61613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:07.179774 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-c35c398d-b7c1-47bb-8286-1a752f8e3b5f tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Flavor limits 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:45:07.180245 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-c35c398d-b7c1-47bb-8286-1a752f8e3b5f tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Image limits 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:45:07.180673 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-c35c398d-b7c1-47bb-8286-1a752f8e3b5f tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Flavor pref 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:45:07.181224 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-c35c398d-b7c1-47bb-8286-1a752f8e3b5f tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Image pref 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:45:07.181644 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-c35c398d-b7c1-47bb-8286-1a752f8e3b5f tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:45:07.185804 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-bff59136-f28f-4ab7-81b0-2f5c68b8fc98 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] 10.222.0.43 "GET /compute/v2.1/servers/e204d537-73b1-4070-a3f4-e0e3053e0639" status: 200 len: 1318 microversion: 2.1 time: 0.762361 Oct 04 21:45:07.187041 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 281/529] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:06 2022] GET /compute/v2.1/servers/e204d537-73b1-4070-a3f4-e0e3053e0639 => generated 1318 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:45:07.188269 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-bff59136-f28f-4ab7-81b0-2f5c68b8fc98 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:07.189363 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-bff59136-f28f-4ab7-81b0-2f5c68b8fc98 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] 10.222.0.43 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001264 Oct 04 21:45:07.197874 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:45:07.201174 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 282/530] 10.222.0.43 () {56 vars in 886 bytes} [Tue Oct 4 21:45:07 2022] GET /compute/ => generated 377 bytes in 13 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 04 21:45:07.217549 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c35c398d-b7c1-47bb-8286-1a752f8e3b5f tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:07.218048 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c35c398d-b7c1-47bb-8286-1a752f8e3b5f tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:07.219148 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c35c398d-b7c1-47bb-8286-1a752f8e3b5f tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:07.220526 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c35c398d-b7c1-47bb-8286-1a752f8e3b5f tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:07.221214 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c35c398d-b7c1-47bb-8286-1a752f8e3b5f tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:07.223081 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c35c398d-b7c1-47bb-8286-1a752f8e3b5f tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:07.227791 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-4e61ac5a-38fd-44f9-8536-8e3ad70493f7 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:07.230638 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-4e61ac5a-38fd-44f9-8536-8e3ad70493f7 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] [instance: 049f396b-7494-4b40-ad21-c3401958088b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:07.249911 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4e61ac5a-38fd-44f9-8536-8e3ad70493f7 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:07.251631 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4e61ac5a-38fd-44f9-8536-8e3ad70493f7 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:07.252420 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4e61ac5a-38fd-44f9-8536-8e3ad70493f7 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:07.254592 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4e61ac5a-38fd-44f9-8536-8e3ad70493f7 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:07.260489 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4e61ac5a-38fd-44f9-8536-8e3ad70493f7 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:07.261997 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4e61ac5a-38fd-44f9-8536-8e3ad70493f7 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:07.294827 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-c35c398d-b7c1-47bb-8286-1a752f8e3b5f tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Getting quotas for project 1ad1554e318e45f78a2bc5e148d0c39f. Resources: {'instances', 'ram', 'cores'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:45:07.303154 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-c35c398d-b7c1-47bb-8286-1a752f8e3b5f tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Getting quotas for user ff4e089659884b6d9197141ba9f14f57 and project 1ad1554e318e45f78a2bc5e148d0c39f. Resources: {'instances', 'ram', 'cores'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:45:07.341207 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-c35c398d-b7c1-47bb-8286-1a752f8e3b5f tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Going to run 1 instances... {{(pid=134102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:45:07.346055 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-c35c398d-b7c1-47bb-8286-1a752f8e3b5f tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: a2d1b827-a865-4d56-a665-110d0541a669] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='58548514-5dac-426c-81f5-19e3fba33e23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:45:07.455847 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-c35c398d-b7c1-47bb-8286-1a752f8e3b5f tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.659740 Oct 04 21:45:07.458171 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 249/531] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 21:45:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 1665 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:45:07.468962 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-e2e432a1-337c-4bf2-b41d-e5e3f42a360f tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:07.469798 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-e2e432a1-337c-4bf2-b41d-e5e3f42a360f tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: a2d1b827-a865-4d56-a665-110d0541a669] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:07.733474 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-4e61ac5a-38fd-44f9-8536-8e3ad70493f7 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6975d7cbd8554e06a15a8b2adc811b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94201b6c845f4334b6f4883606b0d037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:07.743961 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-4e61ac5a-38fd-44f9-8536-8e3ad70493f7 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] 10.222.0.43 "GET /compute/v2.1/servers/049f396b-7494-4b40-ad21-c3401958088b" status: 200 len: 1279 microversion: 2.1 time: 0.528538 Oct 04 21:45:07.764033 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 283/532] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:07 2022] GET /compute/v2.1/servers/049f396b-7494-4b40-ad21-c3401958088b => generated 1279 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:45:07.868111 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-e2e432a1-337c-4bf2-b41d-e5e3f42a360f tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:07.882821 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-e2e432a1-337c-4bf2-b41d-e5e3f42a360f tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/a2d1b827-a865-4d56-a665-110d0541a669" status: 200 len: 1212 microversion: 2.1 time: 0.415806 Oct 04 21:45:07.884995 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 250/533] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:07 2022] GET /compute/v2.1/servers/a2d1b827-a865-4d56-a665-110d0541a669 => generated 1212 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:45:08.215666 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-062cc0bd-e503-4d4c-a40c-f912d5e62cbb tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:08.217382 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-062cc0bd-e503-4d4c-a40c-f912d5e62cbb tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] [instance: e204d537-73b1-4070-a3f4-e0e3053e0639] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:08.228875 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-062cc0bd-e503-4d4c-a40c-f912d5e62cbb tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:08.229636 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-062cc0bd-e503-4d4c-a40c-f912d5e62cbb tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:08.230941 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-062cc0bd-e503-4d4c-a40c-f912d5e62cbb tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:08.236332 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-062cc0bd-e503-4d4c-a40c-f912d5e62cbb tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:08.237040 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-062cc0bd-e503-4d4c-a40c-f912d5e62cbb tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:08.237797 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-062cc0bd-e503-4d4c-a40c-f912d5e62cbb tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:08.781696 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-8d69d7de-df38-459a-a4cc-112416af720e tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:08.783135 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-8d69d7de-df38-459a-a4cc-112416af720e tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] [instance: 049f396b-7494-4b40-ad21-c3401958088b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:08.800341 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8d69d7de-df38-459a-a4cc-112416af720e tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:08.803401 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8d69d7de-df38-459a-a4cc-112416af720e tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:08.805204 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8d69d7de-df38-459a-a4cc-112416af720e tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:08.807766 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8d69d7de-df38-459a-a4cc-112416af720e tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:08.808952 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8d69d7de-df38-459a-a4cc-112416af720e tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:08.809698 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8d69d7de-df38-459a-a4cc-112416af720e tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:09.661796 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-062cc0bd-e503-4d4c-a40c-f912d5e62cbb tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29842a669a20408b881105135f76cb0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39edf587afe94b60911198aa0bb61613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:09.671215 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-062cc0bd-e503-4d4c-a40c-f912d5e62cbb tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] 10.222.0.43 "GET /compute/v2.1/servers/e204d537-73b1-4070-a3f4-e0e3053e0639" status: 200 len: 1318 microversion: 2.1 time: 1.459821 Oct 04 21:45:09.687127 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 284/534] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:08 2022] GET /compute/v2.1/servers/e204d537-73b1-4070-a3f4-e0e3053e0639 => generated 1318 bytes in 1466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:45:09.701201 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-a1145a24-67b1-46f6-a0f3-475c9f46579f tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:09.706266 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-a1145a24-67b1-46f6-a0f3-475c9f46579f tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: a2d1b827-a865-4d56-a665-110d0541a669] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:09.729520 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a1145a24-67b1-46f6-a0f3-475c9f46579f tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:09.730021 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a1145a24-67b1-46f6-a0f3-475c9f46579f tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:09.739042 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a1145a24-67b1-46f6-a0f3-475c9f46579f tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:09.746730 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a1145a24-67b1-46f6-a0f3-475c9f46579f tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:09.748624 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a1145a24-67b1-46f6-a0f3-475c9f46579f tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:09.749094 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a1145a24-67b1-46f6-a0f3-475c9f46579f tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:09.996541 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-8d69d7de-df38-459a-a4cc-112416af720e tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6975d7cbd8554e06a15a8b2adc811b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94201b6c845f4334b6f4883606b0d037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:10.014034 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-8d69d7de-df38-459a-a4cc-112416af720e tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] 10.222.0.43 "GET /compute/v2.1/servers/049f396b-7494-4b40-ad21-c3401958088b" status: 200 len: 1321 microversion: 2.1 time: 1.239312 Oct 04 21:45:10.021461 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 251/535] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:08 2022] GET /compute/v2.1/servers/049f396b-7494-4b40-ad21-c3401958088b => generated 1321 bytes in 1249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:45:10.048540 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-11ecca34-7864-465f-9a88-46929c0512a8 req-60ad5ba6-633e-446d-a7d6-d4c0635e8fa5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e204d537-73b1-4070-a3f4-e0e3053e0639", "tag": "e3daffcc-8395-4ccb-a2f3-5d37cce4823c"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:45:10.080212 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-a1145a24-67b1-46f6-a0f3-475c9f46579f tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:10.104350 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-a1145a24-67b1-46f6-a0f3-475c9f46579f tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/a2d1b827-a865-4d56-a665-110d0541a669" status: 200 len: 1264 microversion: 2.1 time: 0.412649 Oct 04 21:45:10.110547 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 285/536] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:09 2022] GET /compute/v2.1/servers/a2d1b827-a865-4d56-a665-110d0541a669 => generated 1264 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:45:10.121667 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-11ecca34-7864-465f-9a88-46929c0512a8 req-60ad5ba6-633e-446d-a7d6-d4c0635e8fa5 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:10.122930 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-11ecca34-7864-465f-9a88-46929c0512a8 req-60ad5ba6-633e-446d-a7d6-d4c0635e8fa5 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:10.126157 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-11ecca34-7864-465f-9a88-46929c0512a8 req-60ad5ba6-633e-446d-a7d6-d4c0635e8fa5 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:10.207695 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-11ecca34-7864-465f-9a88-46929c0512a8 req-60ad5ba6-633e-446d-a7d6-d4c0635e8fa5 service nova] Creating event network-changed:e3daffcc-8395-4ccb-a2f3-5d37cce4823c for instance e204d537-73b1-4070-a3f4-e0e3053e0639 on n-h1-860284-1 Oct 04 21:45:10.231857 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-11ecca34-7864-465f-9a88-46929c0512a8 req-60ad5ba6-633e-446d-a7d6-d4c0635e8fa5 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.207279 Oct 04 21:45:10.235674 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 252/537] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:45:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:45:10.700798 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-6b9e2ee7-6ed7-4ead-a3a8-bf004b7b0665 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:10.701460 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-6b9e2ee7-6ed7-4ead-a3a8-bf004b7b0665 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] [instance: e204d537-73b1-4070-a3f4-e0e3053e0639] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:10.718625 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6b9e2ee7-6ed7-4ead-a3a8-bf004b7b0665 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:10.727230 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6b9e2ee7-6ed7-4ead-a3a8-bf004b7b0665 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:10.730650 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6b9e2ee7-6ed7-4ead-a3a8-bf004b7b0665 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:10.731671 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6b9e2ee7-6ed7-4ead-a3a8-bf004b7b0665 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:10.733241 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6b9e2ee7-6ed7-4ead-a3a8-bf004b7b0665 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:10.736322 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6b9e2ee7-6ed7-4ead-a3a8-bf004b7b0665 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:11.038544 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-77a0d62d-a27a-4f6a-9bd5-64f1a7eac290 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:11.039391 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-77a0d62d-a27a-4f6a-9bd5-64f1a7eac290 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] [instance: 049f396b-7494-4b40-ad21-c3401958088b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:11.064271 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-77a0d62d-a27a-4f6a-9bd5-64f1a7eac290 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:11.068989 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-77a0d62d-a27a-4f6a-9bd5-64f1a7eac290 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:11.069577 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-77a0d62d-a27a-4f6a-9bd5-64f1a7eac290 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:11.072881 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-77a0d62d-a27a-4f6a-9bd5-64f1a7eac290 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:11.076964 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-77a0d62d-a27a-4f6a-9bd5-64f1a7eac290 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:11.080013 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-77a0d62d-a27a-4f6a-9bd5-64f1a7eac290 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:11.139829 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-6b9e2ee7-6ed7-4ead-a3a8-bf004b7b0665 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29842a669a20408b881105135f76cb0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39edf587afe94b60911198aa0bb61613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:11.154156 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-6b9e2ee7-6ed7-4ead-a3a8-bf004b7b0665 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] 10.222.0.43 "GET /compute/v2.1/servers/e204d537-73b1-4070-a3f4-e0e3053e0639" status: 200 len: 1318 microversion: 2.1 time: 0.455121 Oct 04 21:45:11.172971 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 286/538] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:10 2022] GET /compute/v2.1/servers/e204d537-73b1-4070-a3f4-e0e3053e0639 => generated 1318 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:45:11.554441 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-51727c24-d133-4711-918f-fa65ca5ae8ef tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-2091314775", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452", "networks": [{"uuid": "42a7af1a-ab70-4431-afd7-8915bdbe4cf9"}]}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:45:11.642161 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.network.neutron [None req-51727c24-d133-4711-918f-fa65ca5ae8ef tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] validate_networks() for [('42a7af1a-ab70-4431-afd7-8915bdbe4cf9', None, None, None, None, None)] {{(pid=134101) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:45:11.955278 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=4 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:45:12.021230 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=8 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:45:12.161618 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-77a0d62d-a27a-4f6a-9bd5-64f1a7eac290 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6975d7cbd8554e06a15a8b2adc811b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94201b6c845f4334b6f4883606b0d037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:12.172794 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-77a0d62d-a27a-4f6a-9bd5-64f1a7eac290 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] 10.222.0.43 "GET /compute/v2.1/servers/049f396b-7494-4b40-ad21-c3401958088b" status: 200 len: 1321 microversion: 2.1 time: 1.140226 Oct 04 21:45:12.196545 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 253/539] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:11 2022] GET /compute/v2.1/servers/049f396b-7494-4b40-ad21-c3401958088b => generated 1321 bytes in 1165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:45:12.203297 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-f6f80489-85fc-48a2-a46c-b297b7ca0aec tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:12.204918 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-f6f80489-85fc-48a2-a46c-b297b7ca0aec tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: a2d1b827-a865-4d56-a665-110d0541a669] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:12.219384 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f6f80489-85fc-48a2-a46c-b297b7ca0aec tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:12.221641 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f6f80489-85fc-48a2-a46c-b297b7ca0aec tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:12.222351 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f6f80489-85fc-48a2-a46c-b297b7ca0aec tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:12.224842 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f6f80489-85fc-48a2-a46c-b297b7ca0aec tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:12.229050 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f6f80489-85fc-48a2-a46c-b297b7ca0aec tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:12.229891 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f6f80489-85fc-48a2-a46c-b297b7ca0aec tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:12.671551 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-f6f80489-85fc-48a2-a46c-b297b7ca0aec tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:12.699950 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-f6f80489-85fc-48a2-a46c-b297b7ca0aec tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/a2d1b827-a865-4d56-a665-110d0541a669" status: 200 len: 1270 microversion: 2.1 time: 0.501440 Oct 04 21:45:12.708370 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 254/540] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:12 2022] GET /compute/v2.1/servers/a2d1b827-a865-4d56-a665-110d0541a669 => generated 1270 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:45:12.733066 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-b601a7d5-991b-4137-93dd-d7a94b968c86 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:12.736406 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-b601a7d5-991b-4137-93dd-d7a94b968c86 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] [instance: e204d537-73b1-4070-a3f4-e0e3053e0639] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:12.768051 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b601a7d5-991b-4137-93dd-d7a94b968c86 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:12.768560 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b601a7d5-991b-4137-93dd-d7a94b968c86 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:12.769014 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b601a7d5-991b-4137-93dd-d7a94b968c86 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:12.777717 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b601a7d5-991b-4137-93dd-d7a94b968c86 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:12.783608 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b601a7d5-991b-4137-93dd-d7a94b968c86 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:12.786390 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b601a7d5-991b-4137-93dd-d7a94b968c86 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:13.237411 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-51727c24-d133-4711-918f-fa65ca5ae8ef tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Flavor limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:45:13.238547 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-51727c24-d133-4711-918f-fa65ca5ae8ef tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Image limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:45:13.239855 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-51727c24-d133-4711-918f-fa65ca5ae8ef tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Flavor pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:45:13.240667 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-51727c24-d133-4711-918f-fa65ca5ae8ef tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Image pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:45:13.242182 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-51727c24-d133-4711-918f-fa65ca5ae8ef tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:45:13.271138 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-51727c24-d133-4711-918f-fa65ca5ae8ef tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:13.272142 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-51727c24-d133-4711-918f-fa65ca5ae8ef tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:13.272927 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-51727c24-d133-4711-918f-fa65ca5ae8ef tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:13.277480 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-51727c24-d133-4711-918f-fa65ca5ae8ef tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:13.278076 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-51727c24-d133-4711-918f-fa65ca5ae8ef tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:13.278579 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-51727c24-d133-4711-918f-fa65ca5ae8ef tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:13.283798 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-b601a7d5-991b-4137-93dd-d7a94b968c86 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29842a669a20408b881105135f76cb0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39edf587afe94b60911198aa0bb61613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:13.297128 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-b601a7d5-991b-4137-93dd-d7a94b968c86 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] 10.222.0.43 "GET /compute/v2.1/servers/e204d537-73b1-4070-a3f4-e0e3053e0639" status: 200 len: 1318 microversion: 2.1 time: 0.584087 Oct 04 21:45:13.312342 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 255/541] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:12 2022] GET /compute/v2.1/servers/e204d537-73b1-4070-a3f4-e0e3053e0639 => generated 1318 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:45:13.327236 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-e53655f0-2161-458d-8f9c-9aef37aca966 req-e71f11ec-d870-48d6-920a-8eb746f9404f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3968d68f-a421-4d08-8b67-b5410b618a47", "tag": "43c59e39-3268-4c67-a16b-99af52e4bacf"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:45:13.348601 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-e53655f0-2161-458d-8f9c-9aef37aca966 req-e71f11ec-d870-48d6-920a-8eb746f9404f service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:13.352706 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-e53655f0-2161-458d-8f9c-9aef37aca966 req-e71f11ec-d870-48d6-920a-8eb746f9404f service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:13.353367 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-e53655f0-2161-458d-8f9c-9aef37aca966 req-e71f11ec-d870-48d6-920a-8eb746f9404f service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:13.359373 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-51727c24-d133-4711-918f-fa65ca5ae8ef tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Getting quotas for project f17fee483fd14b07977669df199f3018. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:45:13.382221 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-e53655f0-2161-458d-8f9c-9aef37aca966 req-e71f11ec-d870-48d6-920a-8eb746f9404f service nova] Creating event network-changed:43c59e39-3268-4c67-a16b-99af52e4bacf for instance 3968d68f-a421-4d08-8b67-b5410b618a47 on n-h2-860284-1 Oct 04 21:45:13.382642 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-51727c24-d133-4711-918f-fa65ca5ae8ef tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Getting quotas for user f529f881a037459d9405bd14afd7a639 and project f17fee483fd14b07977669df199f3018. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:45:13.401768 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-e53655f0-2161-458d-8f9c-9aef37aca966 req-e71f11ec-d870-48d6-920a-8eb746f9404f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084198 Oct 04 21:45:13.403790 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 256/542] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:45:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:45:13.422703 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-89bae75a-bf8d-4d3c-8950-2ba181df1643 req-9f6ce8ab-8de8-4253-88f4-997bf49d9b29 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "049f396b-7494-4b40-ad21-c3401958088b", "tag": "b8904ed3-c3c4-4e36-91c9-b8a1f2fa53b0"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:45:13.436327 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-89bae75a-bf8d-4d3c-8950-2ba181df1643 req-9f6ce8ab-8de8-4253-88f4-997bf49d9b29 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:13.437275 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-51727c24-d133-4711-918f-fa65ca5ae8ef tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Going to run 1 instances... {{(pid=134101) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:45:13.438963 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-89bae75a-bf8d-4d3c-8950-2ba181df1643 req-9f6ce8ab-8de8-4253-88f4-997bf49d9b29 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:13.439507 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-51727c24-d133-4711-918f-fa65ca5ae8ef tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] [instance: 659208f3-1bef-41f7-9616-50c2db9f46ba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='58548514-5dac-426c-81f5-19e3fba33e23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134101) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:45:13.440136 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-89bae75a-bf8d-4d3c-8950-2ba181df1643 req-9f6ce8ab-8de8-4253-88f4-997bf49d9b29 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:13.476272 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-89bae75a-bf8d-4d3c-8950-2ba181df1643 req-9f6ce8ab-8de8-4253-88f4-997bf49d9b29 service nova] Creating event network-changed:b8904ed3-c3c4-4e36-91c9-b8a1f2fa53b0 for instance 049f396b-7494-4b40-ad21-c3401958088b on n-h2-860284-1 Oct 04 21:45:13.496667 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-89bae75a-bf8d-4d3c-8950-2ba181df1643 req-9f6ce8ab-8de8-4253-88f4-997bf49d9b29 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091264 Oct 04 21:45:13.500635 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 257/543] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:45:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:45:13.517657 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-2e8ab753-8052-40f9-9471-d46c9faea1d3 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:13.518411 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-2e8ab753-8052-40f9-9471-d46c9faea1d3 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] [instance: 049f396b-7494-4b40-ad21-c3401958088b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:13.561162 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2e8ab753-8052-40f9-9471-d46c9faea1d3 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:13.561982 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2e8ab753-8052-40f9-9471-d46c9faea1d3 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:13.562529 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2e8ab753-8052-40f9-9471-d46c9faea1d3 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:13.566461 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-51727c24-d133-4711-918f-fa65ca5ae8ef tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 2.392211 Oct 04 21:45:13.566645 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2e8ab753-8052-40f9-9471-d46c9faea1d3 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:13.567010 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2e8ab753-8052-40f9-9471-d46c9faea1d3 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:13.567463 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2e8ab753-8052-40f9-9471-d46c9faea1d3 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:13.569231 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 287/544] 10.222.0.43 () {62 vars in 1188 bytes} [Tue Oct 4 21:45:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 2395 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 04 21:45:13.585545 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-ba33dbb8-6c31-4cb4-8d45-daf7b77f72de tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:13.586788 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-ba33dbb8-6c31-4cb4-8d45-daf7b77f72de tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] [instance: 659208f3-1bef-41f7-9616-50c2db9f46ba] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:13.746891 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-ba33dbb8-6c31-4cb4-8d45-daf7b77f72de tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:13.757505 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-ba33dbb8-6c31-4cb4-8d45-daf7b77f72de tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:13.766504 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-ba33dbb8-6c31-4cb4-8d45-daf7b77f72de tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:13.769887 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-ba33dbb8-6c31-4cb4-8d45-daf7b77f72de tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] 10.222.0.43 "GET /compute/v2.1/servers/659208f3-1bef-41f7-9616-50c2db9f46ba" status: 200 len: 1262 microversion: 2.25 time: 0.194264 Oct 04 21:45:13.774988 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 288/545] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:45:13 2022] GET /compute/v2.1/servers/659208f3-1bef-41f7-9616-50c2db9f46ba => generated 1262 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:45:13.789825 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-b5b4b4ab-3348-4fa8-a194-8d1b8c5d2fc7 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:13.802546 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-b5b4b4ab-3348-4fa8-a194-8d1b8c5d2fc7 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: a2d1b827-a865-4d56-a665-110d0541a669] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:13.828284 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b5b4b4ab-3348-4fa8-a194-8d1b8c5d2fc7 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:13.829048 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b5b4b4ab-3348-4fa8-a194-8d1b8c5d2fc7 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:13.829750 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b5b4b4ab-3348-4fa8-a194-8d1b8c5d2fc7 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:13.830671 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b5b4b4ab-3348-4fa8-a194-8d1b8c5d2fc7 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:13.832402 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b5b4b4ab-3348-4fa8-a194-8d1b8c5d2fc7 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:13.835960 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b5b4b4ab-3348-4fa8-a194-8d1b8c5d2fc7 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:14.399186 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-b5b4b4ab-3348-4fa8-a194-8d1b8c5d2fc7 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:14.425892 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-b5b4b4ab-3348-4fa8-a194-8d1b8c5d2fc7 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/a2d1b827-a865-4d56-a665-110d0541a669" status: 200 len: 1270 microversion: 2.1 time: 0.638389 Oct 04 21:45:14.425892 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 289/546] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:13 2022] GET /compute/v2.1/servers/a2d1b827-a865-4d56-a665-110d0541a669 => generated 1270 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:45:14.478555 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-7a10b063-51c6-4708-9e09-28b215280c49 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:14.479050 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-7a10b063-51c6-4708-9e09-28b215280c49 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] [instance: e204d537-73b1-4070-a3f4-e0e3053e0639] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:14.562112 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7a10b063-51c6-4708-9e09-28b215280c49 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:14.568203 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7a10b063-51c6-4708-9e09-28b215280c49 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:14.568701 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7a10b063-51c6-4708-9e09-28b215280c49 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:14.572331 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7a10b063-51c6-4708-9e09-28b215280c49 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:14.581448 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7a10b063-51c6-4708-9e09-28b215280c49 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:14.582583 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7a10b063-51c6-4708-9e09-28b215280c49 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:15.340196 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-2e8ab753-8052-40f9-9471-d46c9faea1d3 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6975d7cbd8554e06a15a8b2adc811b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94201b6c845f4334b6f4883606b0d037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:15.352295 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-2e8ab753-8052-40f9-9471-d46c9faea1d3 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] 10.222.0.43 "GET /compute/v2.1/servers/049f396b-7494-4b40-ad21-c3401958088b" status: 200 len: 1321 microversion: 2.1 time: 1.849804 Oct 04 21:45:15.354637 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 258/547] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:13 2022] GET /compute/v2.1/servers/049f396b-7494-4b40-ad21-c3401958088b => generated 1321 bytes in 1853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:45:15.368309 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-8c5ba142-61eb-4cf3-8c1c-1dfe8b48dbcf tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:15.375791 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-8c5ba142-61eb-4cf3-8c1c-1dfe8b48dbcf tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] [instance: 659208f3-1bef-41f7-9616-50c2db9f46ba] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:15.410239 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8c5ba142-61eb-4cf3-8c1c-1dfe8b48dbcf tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:15.411083 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8c5ba142-61eb-4cf3-8c1c-1dfe8b48dbcf tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:15.411826 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8c5ba142-61eb-4cf3-8c1c-1dfe8b48dbcf tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:15.412745 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8c5ba142-61eb-4cf3-8c1c-1dfe8b48dbcf tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:15.414140 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8c5ba142-61eb-4cf3-8c1c-1dfe8b48dbcf tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:15.415016 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8c5ba142-61eb-4cf3-8c1c-1dfe8b48dbcf tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:15.650665 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-8c5ba142-61eb-4cf3-8c1c-1dfe8b48dbcf tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:15.664528 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-8c5ba142-61eb-4cf3-8c1c-1dfe8b48dbcf tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:15.672621 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-8c5ba142-61eb-4cf3-8c1c-1dfe8b48dbcf tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:15.676301 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-8c5ba142-61eb-4cf3-8c1c-1dfe8b48dbcf tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] 10.222.0.43 "GET /compute/v2.1/servers/659208f3-1bef-41f7-9616-50c2db9f46ba" status: 200 len: 1258 microversion: 2.25 time: 0.319391 Oct 04 21:45:15.685635 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 259/548] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:45:15 2022] GET /compute/v2.1/servers/659208f3-1bef-41f7-9616-50c2db9f46ba => generated 1258 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:45:15.693561 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-19df7fb6-ee14-445d-884b-53565180a5df tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:15.696624 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-19df7fb6-ee14-445d-884b-53565180a5df tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: a2d1b827-a865-4d56-a665-110d0541a669] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:15.726338 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-19df7fb6-ee14-445d-884b-53565180a5df tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:15.726932 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-19df7fb6-ee14-445d-884b-53565180a5df tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:15.727362 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-19df7fb6-ee14-445d-884b-53565180a5df tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:15.728072 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-19df7fb6-ee14-445d-884b-53565180a5df tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:15.728529 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-19df7fb6-ee14-445d-884b-53565180a5df tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:15.728950 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-19df7fb6-ee14-445d-884b-53565180a5df tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:15.885832 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-7a10b063-51c6-4708-9e09-28b215280c49 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29842a669a20408b881105135f76cb0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39edf587afe94b60911198aa0bb61613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:15.904708 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-7a10b063-51c6-4708-9e09-28b215280c49 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] 10.222.0.43 "GET /compute/v2.1/servers/e204d537-73b1-4070-a3f4-e0e3053e0639" status: 200 len: 1318 microversion: 2.1 time: 1.445152 Oct 04 21:45:15.919428 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 290/549] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:14 2022] GET /compute/v2.1/servers/e204d537-73b1-4070-a3f4-e0e3053e0639 => generated 1318 bytes in 1494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:45:16.158741 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-19df7fb6-ee14-445d-884b-53565180a5df tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:16.162632 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:45:16.171610 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-19df7fb6-ee14-445d-884b-53565180a5df tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/a2d1b827-a865-4d56-a665-110d0541a669" status: 200 len: 1270 microversion: 2.1 time: 0.484689 Oct 04 21:45:16.176557 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 260/550] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:15 2022] GET /compute/v2.1/servers/a2d1b827-a865-4d56-a665-110d0541a669 => generated 1270 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:45:16.377469 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e5be4ce1-03db-468e-bf52-04dd6f68f8e1 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:16.378654 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-e5be4ce1-03db-468e-bf52-04dd6f68f8e1 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] [instance: 049f396b-7494-4b40-ad21-c3401958088b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:16.392046 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e5be4ce1-03db-468e-bf52-04dd6f68f8e1 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:16.393703 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e5be4ce1-03db-468e-bf52-04dd6f68f8e1 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:16.397125 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e5be4ce1-03db-468e-bf52-04dd6f68f8e1 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:16.401623 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e5be4ce1-03db-468e-bf52-04dd6f68f8e1 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:16.404780 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e5be4ce1-03db-468e-bf52-04dd6f68f8e1 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:16.405919 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e5be4ce1-03db-468e-bf52-04dd6f68f8e1 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:16.734357 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-cc110814-4951-4f25-aaca-69426f727be9 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:16.740865 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-cc110814-4951-4f25-aaca-69426f727be9 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] [instance: 659208f3-1bef-41f7-9616-50c2db9f46ba] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:16.811844 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cc110814-4951-4f25-aaca-69426f727be9 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:16.812365 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cc110814-4951-4f25-aaca-69426f727be9 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:16.818582 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cc110814-4951-4f25-aaca-69426f727be9 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:16.821101 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cc110814-4951-4f25-aaca-69426f727be9 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:16.824267 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cc110814-4951-4f25-aaca-69426f727be9 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:16.825273 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cc110814-4951-4f25-aaca-69426f727be9 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:17.261087 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell0:SELECT=2 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:45:17.579669 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-cc110814-4951-4f25-aaca-69426f727be9 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:17.599078 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-cc110814-4951-4f25-aaca-69426f727be9 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:17.605888 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-cc110814-4951-4f25-aaca-69426f727be9 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:17.610923 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-cc110814-4951-4f25-aaca-69426f727be9 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] 10.222.0.43 "GET /compute/v2.1/servers/659208f3-1bef-41f7-9616-50c2db9f46ba" status: 200 len: 1332 microversion: 2.25 time: 0.901519 Oct 04 21:45:17.614899 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 261/551] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:45:16 2022] GET /compute/v2.1/servers/659208f3-1bef-41f7-9616-50c2db9f46ba => generated 1332 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:45:17.625733 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-6b13d385-a49d-4b9c-bb26-3b66b633ba59 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:17.627234 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-6b13d385-a49d-4b9c-bb26-3b66b633ba59 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] [instance: e204d537-73b1-4070-a3f4-e0e3053e0639] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:17.643770 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6b13d385-a49d-4b9c-bb26-3b66b633ba59 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:17.645903 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6b13d385-a49d-4b9c-bb26-3b66b633ba59 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:17.648356 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6b13d385-a49d-4b9c-bb26-3b66b633ba59 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:17.649677 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6b13d385-a49d-4b9c-bb26-3b66b633ba59 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:17.652616 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6b13d385-a49d-4b9c-bb26-3b66b633ba59 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:17.653294 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6b13d385-a49d-4b9c-bb26-3b66b633ba59 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:17.793094 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-e5be4ce1-03db-468e-bf52-04dd6f68f8e1 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6975d7cbd8554e06a15a8b2adc811b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94201b6c845f4334b6f4883606b0d037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:17.806060 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-e5be4ce1-03db-468e-bf52-04dd6f68f8e1 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] 10.222.0.43 "GET /compute/v2.1/servers/049f396b-7494-4b40-ad21-c3401958088b" status: 200 len: 1321 microversion: 2.1 time: 1.432704 Oct 04 21:45:17.810440 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 291/552] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:16 2022] GET /compute/v2.1/servers/049f396b-7494-4b40-ad21-c3401958088b => generated 1321 bytes in 1437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:45:17.823963 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-8fbe41e0-91ee-4a15-a2ba-4de4521f0be5 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:17.824862 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-8fbe41e0-91ee-4a15-a2ba-4de4521f0be5 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: a2d1b827-a865-4d56-a665-110d0541a669] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:17.839480 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8fbe41e0-91ee-4a15-a2ba-4de4521f0be5 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:17.841438 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8fbe41e0-91ee-4a15-a2ba-4de4521f0be5 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:17.842344 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8fbe41e0-91ee-4a15-a2ba-4de4521f0be5 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:17.845737 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8fbe41e0-91ee-4a15-a2ba-4de4521f0be5 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:17.846510 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8fbe41e0-91ee-4a15-a2ba-4de4521f0be5 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:17.847433 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8fbe41e0-91ee-4a15-a2ba-4de4521f0be5 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:17.879385 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell0:SELECT=8 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:45:17.886026 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=100 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:45:19.197126 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-6b13d385-a49d-4b9c-bb26-3b66b633ba59 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29842a669a20408b881105135f76cb0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39edf587afe94b60911198aa0bb61613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:19.211663 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-6b13d385-a49d-4b9c-bb26-3b66b633ba59 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] 10.222.0.43 "GET /compute/v2.1/servers/e204d537-73b1-4070-a3f4-e0e3053e0639" status: 200 len: 1318 microversion: 2.1 time: 1.593388 Oct 04 21:45:19.215257 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 262/553] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:17 2022] GET /compute/v2.1/servers/e204d537-73b1-4070-a3f4-e0e3053e0639 => generated 1318 bytes in 1599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:45:19.346619 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-8fbe41e0-91ee-4a15-a2ba-4de4521f0be5 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:19.355802 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-8fbe41e0-91ee-4a15-a2ba-4de4521f0be5 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/a2d1b827-a865-4d56-a665-110d0541a669" status: 200 len: 1312 microversion: 2.1 time: 1.543638 Oct 04 21:45:19.361084 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 292/554] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:17 2022] GET /compute/v2.1/servers/a2d1b827-a865-4d56-a665-110d0541a669 => generated 1312 bytes in 1550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:45:19.371471 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-52b133a1-5402-42d1-a106-a8797a573704 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:19.372350 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-52b133a1-5402-42d1-a106-a8797a573704 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] [instance: 659208f3-1bef-41f7-9616-50c2db9f46ba] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:19.384348 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-52b133a1-5402-42d1-a106-a8797a573704 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:19.399288 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-52b133a1-5402-42d1-a106-a8797a573704 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:19.401246 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-52b133a1-5402-42d1-a106-a8797a573704 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:19.402669 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-52b133a1-5402-42d1-a106-a8797a573704 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:19.403888 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-52b133a1-5402-42d1-a106-a8797a573704 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:19.404501 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-52b133a1-5402-42d1-a106-a8797a573704 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:19.814741 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-b3dfc71d-e43d-4259-8802-333c77009a49 tempest-InstanceUsageAuditLogNegativeTestJSON-771694486 tempest-InstanceUsageAuditLogNegativeTestJSON-771694486-project-admin] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:19.816241 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-b3dfc71d-e43d-4259-8802-333c77009a49 tempest-InstanceUsageAuditLogNegativeTestJSON-771694486 tempest-InstanceUsageAuditLogNegativeTestJSON-771694486-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Oct 04 21:45:19.833755 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-b3dfc71d-e43d-4259-8802-333c77009a49 tempest-InstanceUsageAuditLogNegativeTestJSON-771694486 tempest-InstanceUsageAuditLogNegativeTestJSON-771694486-project-admin] Request method failure captured: Oct 04 21:45:19.833755 n-d-860284-1 devstack@n-api.service[134102]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 Oct 04 21:45:19.833755 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 21:45:19.833755 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 21:45:19.833755 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 21:45:19.833755 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 21:45:19.833755 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 21:45:19.833755 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 21:45:19.833755 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 21:45:19.833755 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 21:45:19.833755 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPKltLePg8God11D5Vzg-NmOTi2oDYE8Z0C1OK-K3hOznlAn6h86Z6I6kx21xSZT6hyy6dgcPJI_eVdmP_emH_TOeTdHuUiUbxiVk8GikvwM6iRHyRpffAT5tj0V830xiP3rWD9uWo2YPgq-3CjJVMPtlUQsKOBPoRJudFAwEIzoUcgk Oct 04 21:45:19.833755 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 21:45:19.833755 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 21:45:19.833755 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 21:45:19.833755 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 21:45:19.833755 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 21:45:19.833755 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 21:45:19.833755 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: 964b274ce0df41b197941cd3371b2deb Oct 04 21:45:19.833755 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-771694486 Oct 04 21:45:19.833755 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,admin,member Oct 04 21:45:19.833755 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,admin,member Oct 04 21:45:19.835424 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/964b274ce0df41b197941cd3371b2deb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_964b274ce0df41b197941cd3371b2deb", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/964b274ce0df41b197941cd3371b2deb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/964b274ce0df41b197941cd3371b2deb"}]}] Oct 04 21:45:19.835424 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-771694486 Oct 04 21:45:19.835424 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: 964b274ce0df41b197941cd3371b2deb Oct 04 21:45:19.835424 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-771694486 Oct 04 21:45:19.835424 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-771694486-project-admin Oct 04 21:45:19.835424 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 21:45:19.835424 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 21:45:19.835424 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: 33aaa0fc74464118a4be64099e0c4287 Oct 04 21:45:19.835424 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-771694486-project-admin Oct 04 21:45:19.835424 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 21:45:19.835424 n-d-860284-1 devstack@n-api.service[134102]: exception: Invalid timestamp for date invalid_time Oct 04 21:45:19.836114 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': 'invalid_time'} Oct 04 21:45:19.836114 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:45:19.836114 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:45:19.836114 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show Oct 04 21:45:19.836114 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), Oct 04 21:45:19.836114 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime Oct 04 21:45:19.836114 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) Oct 04 21:45:19.836114 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime Oct 04 21:45:19.836114 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % Oct 04 21:45:19.836114 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' Oct 04 21:45:19.836114 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:45:19.836114 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:45:19.836114 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:45:19.836114 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:45:19.836114 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:45:19.836114 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:45:19.836114 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:45:19.836114 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:45:19.836114 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:45:19.836114 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:45:19.838135 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show Oct 04 21:45:19.838135 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) Oct 04 21:45:19.838135 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time Oct 04 21:45:19.838135 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:45:19.838135 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:45:19.838135 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:45:19.838135 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:45:19.838135 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:45:19.838135 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:45:19.838135 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:45:19.838135 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:45:19.838135 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time Oct 04 21:45:19.838135 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:45:19.838135 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-b3dfc71d-e43d-4259-8802-333c77009a49 tempest-InstanceUsageAuditLogNegativeTestJSON-771694486 tempest-InstanceUsageAuditLogNegativeTestJSON-771694486-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:45:19.838135 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-b3dfc71d-e43d-4259-8802-333c77009a49 tempest-InstanceUsageAuditLogNegativeTestJSON-771694486 tempest-InstanceUsageAuditLogNegativeTestJSON-771694486-project-admin] 10.222.0.43 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.618570 Oct 04 21:45:19.839726 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 263/555] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Oct 4 21:45:19 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 620 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 04 21:45:19.839836 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-52b133a1-5402-42d1-a106-a8797a573704 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:19.841193 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-8d60ff6f-cbaa-4364-85b5-aa24bc847e0f tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:19.841822 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-8d60ff6f-cbaa-4364-85b5-aa24bc847e0f tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] [instance: 049f396b-7494-4b40-ad21-c3401958088b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:19.845363 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-52b133a1-5402-42d1-a106-a8797a573704 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:19.852149 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-52b133a1-5402-42d1-a106-a8797a573704 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:19.853319 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-52b133a1-5402-42d1-a106-a8797a573704 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] 10.222.0.43 "GET /compute/v2.1/servers/659208f3-1bef-41f7-9616-50c2db9f46ba" status: 200 len: 1320 microversion: 2.25 time: 0.491026 Oct 04 21:45:19.853878 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 293/556] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:45:19 2022] GET /compute/v2.1/servers/659208f3-1bef-41f7-9616-50c2db9f46ba => generated 1320 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:45:19.861320 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-f8ad3863-c08c-4233-9a79-148d3d67d74e req-48deb740-2829-4d1e-9757-bf3f9bc5995d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2d1b827-a865-4d56-a665-110d0541a669", "tag": "63fc7a3b-4543-41af-bdba-41c87b0c3709"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:45:19.870006 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8d60ff6f-cbaa-4364-85b5-aa24bc847e0f tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:19.875268 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8d60ff6f-cbaa-4364-85b5-aa24bc847e0f tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:19.876084 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8d60ff6f-cbaa-4364-85b5-aa24bc847e0f tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:19.877147 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8d60ff6f-cbaa-4364-85b5-aa24bc847e0f tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:19.877897 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8d60ff6f-cbaa-4364-85b5-aa24bc847e0f tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:19.878542 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8d60ff6f-cbaa-4364-85b5-aa24bc847e0f tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:19.879966 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-f8ad3863-c08c-4233-9a79-148d3d67d74e req-48deb740-2829-4d1e-9757-bf3f9bc5995d service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:19.880462 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-f8ad3863-c08c-4233-9a79-148d3d67d74e req-48deb740-2829-4d1e-9757-bf3f9bc5995d service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:19.880904 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-f8ad3863-c08c-4233-9a79-148d3d67d74e req-48deb740-2829-4d1e-9757-bf3f9bc5995d service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:19.920207 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-f8ad3863-c08c-4233-9a79-148d3d67d74e req-48deb740-2829-4d1e-9757-bf3f9bc5995d service nova] Creating event network-changed:63fc7a3b-4543-41af-bdba-41c87b0c3709 for instance a2d1b827-a865-4d56-a665-110d0541a669 on n-h1-860284-1 Oct 04 21:45:19.934433 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-f8ad3863-c08c-4233-9a79-148d3d67d74e req-48deb740-2829-4d1e-9757-bf3f9bc5995d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076464 Oct 04 21:45:19.934988 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 294/557] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:45:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:45:20.084291 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-31facd9c-967b-418d-991d-15081e338b21 tempest-InstanceUsageAuditLogNegativeTestJSON-1561963023 tempest-InstanceUsageAuditLogNegativeTestJSON-1561963023-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:20.086595 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-31facd9c-967b-418d-991d-15081e338b21 tempest-InstanceUsageAuditLogNegativeTestJSON-1561963023 tempest-InstanceUsageAuditLogNegativeTestJSON-1561963023-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': 'c7fe494807bb49e9963fd2633e55dd2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b3759eeac44fe9a7380dfe0403cf04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:20.090291 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-31facd9c-967b-418d-991d-15081e338b21 tempest-InstanceUsageAuditLogNegativeTestJSON-1561963023 tempest-InstanceUsageAuditLogNegativeTestJSON-1561963023-project] Request method failure captured: Oct 04 21:45:20.090291 n-d-860284-1 devstack@n-api.service[134101]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 Oct 04 21:45:20.090291 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 21:45:20.090291 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 21:45:20.090291 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 21:45:20.090291 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 21:45:20.090291 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 21:45:20.090291 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 21:45:20.090291 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 21:45:20.090291 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 21:45:20.090291 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPKlsMNn5MRphyEAouxbpkLTzMh3jIQd7_a-abm4NzSRpOKIY9qqPuPZ9esA1daKOtdG4rJNYSYWEGcP5c3bmWxI-JWSx5XiH8yHYpHgIUNSqtgMkcgCb2lu4ds_TAf6vI3xD4NfqJy1KYr7rODxZHXvW0Vi1azSy_ccq065KH0YZ7qM Oct 04 21:45:20.090291 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 21:45:20.090291 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 21:45:20.090291 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 21:45:20.090291 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 21:45:20.090291 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 21:45:20.090291 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 21:45:20.090291 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: 37b3759eeac44fe9a7380dfe0403cf04 Oct 04 21:45:20.090291 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1561963023 Oct 04 21:45:20.090291 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 21:45:20.090291 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 21:45:20.091803 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/37b3759eeac44fe9a7380dfe0403cf04"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_37b3759eeac44fe9a7380dfe0403cf04", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/37b3759eeac44fe9a7380dfe0403cf04"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/37b3759eeac44fe9a7380dfe0403cf04"}]}] Oct 04 21:45:20.091803 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1561963023 Oct 04 21:45:20.091803 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: 37b3759eeac44fe9a7380dfe0403cf04 Oct 04 21:45:20.091803 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1561963023 Oct 04 21:45:20.091803 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1561963023-project Oct 04 21:45:20.091803 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 21:45:20.091803 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 21:45:20.091803 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: c7fe494807bb49e9963fd2633e55dd2b Oct 04 21:45:20.091803 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1561963023-project Oct 04 21:45:20.091803 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 21:45:20.092506 n-d-860284-1 devstack@n-api.service[134101]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 04 21:45:20.092506 n-d-860284-1 devstack@n-api.service[134101]: action_args: {} Oct 04 21:45:20.092506 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:45:20.092506 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:45:20.092506 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:45:20.092506 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:45:20.092506 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:45:20.092506 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:45:20.092506 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:45:20.092506 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:45:20.092506 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index Oct 04 21:45:20.092506 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) Oct 04 21:45:20.092506 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 21:45:20.092506 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 21:45:20.092506 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 21:45:20.092506 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 21:45:20.092506 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 21:45:20.092506 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 21:45:20.092506 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 21:45:20.092506 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 21:45:20.094062 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 21:45:20.094062 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 21:45:20.094062 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 21:45:20.094062 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 21:45:20.094062 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 21:45:20.094062 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 21:45:20.094062 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 04 21:45:20.094062 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:45:20.094062 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:45:20.094062 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:45:20.094062 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:45:20.094062 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:45:20.094062 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:45:20.094062 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 21:45:20.094062 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 21:45:20.094062 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 04 21:45:20.094062 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:45:20.095891 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-31facd9c-967b-418d-991d-15081e338b21 tempest-InstanceUsageAuditLogNegativeTestJSON-1561963023 tempest-InstanceUsageAuditLogNegativeTestJSON-1561963023-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:45:20.096979 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-31facd9c-967b-418d-991d-15081e338b21 tempest-InstanceUsageAuditLogNegativeTestJSON-1561963023 tempest-InstanceUsageAuditLogNegativeTestJSON-1561963023-project] 10.222.0.43 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.160741 Oct 04 21:45:20.098059 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 295/558] 10.222.0.43 () {58 vars in 1185 bytes} [Tue Oct 4 21:45:19 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 162 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:45:20.116447 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-d289c519-9021-4e4d-92d7-4e293fff2ef3 tempest-InstanceUsageAuditLogNegativeTestJSON-1561963023 tempest-InstanceUsageAuditLogNegativeTestJSON-1561963023-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:20.119125 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-d289c519-9021-4e4d-92d7-4e293fff2ef3 tempest-InstanceUsageAuditLogNegativeTestJSON-1561963023 tempest-InstanceUsageAuditLogNegativeTestJSON-1561963023-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': 'c7fe494807bb49e9963fd2633e55dd2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b3759eeac44fe9a7380dfe0403cf04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:20.120958 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-d289c519-9021-4e4d-92d7-4e293fff2ef3 tempest-InstanceUsageAuditLogNegativeTestJSON-1561963023 tempest-InstanceUsageAuditLogNegativeTestJSON-1561963023-project] Request method failure captured: Oct 04 21:45:20.120958 n-d-860284-1 devstack@n-api.service[134101]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-10-04%2021:45:20 HTTP/1.1 Oct 04 21:45:20.120958 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 21:45:20.120958 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 21:45:20.120958 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 21:45:20.120958 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 21:45:20.120958 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 21:45:20.120958 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 21:45:20.120958 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 21:45:20.120958 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 21:45:20.120958 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPKlsMNn5MRphyEAouxbpkLTzMh3jIQd7_a-abm4NzSRpOKIY9qqPuPZ9esA1daKOtdG4rJNYSYWEGcP5c3bmWxI-JWSx5XiH8yHYpHgIUNSqtgMkcgCb2lu4ds_TAf6vI3xD4NfqJy1KYr7rODxZHXvW0Vi1azSy_ccq065KH0YZ7qM Oct 04 21:45:20.120958 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 21:45:20.120958 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 21:45:20.120958 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 21:45:20.120958 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 21:45:20.120958 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 21:45:20.120958 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 21:45:20.120958 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: 37b3759eeac44fe9a7380dfe0403cf04 Oct 04 21:45:20.120958 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1561963023 Oct 04 21:45:20.120958 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 21:45:20.120958 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 21:45:20.122279 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/37b3759eeac44fe9a7380dfe0403cf04"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_37b3759eeac44fe9a7380dfe0403cf04", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/37b3759eeac44fe9a7380dfe0403cf04"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/37b3759eeac44fe9a7380dfe0403cf04"}]}] Oct 04 21:45:20.122279 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1561963023 Oct 04 21:45:20.122279 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: 37b3759eeac44fe9a7380dfe0403cf04 Oct 04 21:45:20.122279 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1561963023 Oct 04 21:45:20.122279 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1561963023-project Oct 04 21:45:20.122279 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 21:45:20.122279 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 21:45:20.122279 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: c7fe494807bb49e9963fd2633e55dd2b Oct 04 21:45:20.122279 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1561963023-project Oct 04 21:45:20.122279 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 21:45:20.122945 n-d-860284-1 devstack@n-api.service[134101]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 04 21:45:20.122945 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': '2022-10-04 21:45:20'} Oct 04 21:45:20.122945 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:45:20.122945 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:45:20.122945 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:45:20.122945 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:45:20.122945 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:45:20.122945 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:45:20.122945 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:45:20.122945 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:45:20.122945 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show Oct 04 21:45:20.122945 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) Oct 04 21:45:20.122945 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 21:45:20.122945 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 21:45:20.122945 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 21:45:20.122945 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 21:45:20.122945 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 21:45:20.122945 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 21:45:20.122945 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 21:45:20.122945 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 21:45:20.124498 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 21:45:20.124498 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 21:45:20.124498 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 21:45:20.124498 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 21:45:20.124498 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 21:45:20.124498 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 21:45:20.124498 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 04 21:45:20.124498 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:45:20.124498 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:45:20.124498 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:45:20.124498 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:45:20.124498 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:45:20.124498 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:45:20.124498 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 21:45:20.124498 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 21:45:20.124498 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 04 21:45:20.124498 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:45:20.125462 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-d289c519-9021-4e4d-92d7-4e293fff2ef3 tempest-InstanceUsageAuditLogNegativeTestJSON-1561963023 tempest-InstanceUsageAuditLogNegativeTestJSON-1561963023-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:45:20.125462 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-d289c519-9021-4e4d-92d7-4e293fff2ef3 tempest-InstanceUsageAuditLogNegativeTestJSON-1561963023 tempest-InstanceUsageAuditLogNegativeTestJSON-1561963023-project] 10.222.0.43 "GET /compute/v2.1/os-instance_usage_audit_log/2022-10-04 21:45:20" status: 403 len: 128 microversion: 2.1 time: 0.010850 Oct 04 21:45:20.125462 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 296/559] 10.222.0.43 () {58 vars in 1251 bytes} [Tue Oct 4 21:45:20 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-10-04%2021%3A45%3A20 => generated 128 bytes in 12 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:45:20.243749 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-252a8595-69a7-4b50-9889-38366ec095e9 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:20.244494 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-252a8595-69a7-4b50-9889-38366ec095e9 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] [instance: e204d537-73b1-4070-a3f4-e0e3053e0639] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:20.264524 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-252a8595-69a7-4b50-9889-38366ec095e9 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:20.265403 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-252a8595-69a7-4b50-9889-38366ec095e9 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:20.266061 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-252a8595-69a7-4b50-9889-38366ec095e9 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:20.267029 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-252a8595-69a7-4b50-9889-38366ec095e9 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:20.267698 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-252a8595-69a7-4b50-9889-38366ec095e9 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:20.268355 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-252a8595-69a7-4b50-9889-38366ec095e9 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:20.343496 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-8d60ff6f-cbaa-4364-85b5-aa24bc847e0f tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6975d7cbd8554e06a15a8b2adc811b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94201b6c845f4334b6f4883606b0d037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:20.361233 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-8d60ff6f-cbaa-4364-85b5-aa24bc847e0f tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] 10.222.0.43 "GET /compute/v2.1/servers/049f396b-7494-4b40-ad21-c3401958088b" status: 200 len: 1321 microversion: 2.1 time: 0.521373 Oct 04 21:45:20.361961 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 264/560] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:19 2022] GET /compute/v2.1/servers/049f396b-7494-4b40-ad21-c3401958088b => generated 1321 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:45:20.415414 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-dfc5d1b3-222c-49e0-921f-1a75245d5e34 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:20.416290 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-dfc5d1b3-222c-49e0-921f-1a75245d5e34 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: a2d1b827-a865-4d56-a665-110d0541a669] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:20.430794 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dfc5d1b3-222c-49e0-921f-1a75245d5e34 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:20.432054 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dfc5d1b3-222c-49e0-921f-1a75245d5e34 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:20.432759 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dfc5d1b3-222c-49e0-921f-1a75245d5e34 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:20.443375 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dfc5d1b3-222c-49e0-921f-1a75245d5e34 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:20.444642 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dfc5d1b3-222c-49e0-921f-1a75245d5e34 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:20.445607 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dfc5d1b3-222c-49e0-921f-1a75245d5e34 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:20.706175 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-252a8595-69a7-4b50-9889-38366ec095e9 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29842a669a20408b881105135f76cb0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39edf587afe94b60911198aa0bb61613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:20.715885 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-252a8595-69a7-4b50-9889-38366ec095e9 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] 10.222.0.43 "GET /compute/v2.1/servers/e204d537-73b1-4070-a3f4-e0e3053e0639" status: 200 len: 1318 microversion: 2.1 time: 0.482250 Oct 04 21:45:20.729835 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 297/561] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:20 2022] GET /compute/v2.1/servers/e204d537-73b1-4070-a3f4-e0e3053e0639 => generated 1318 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:45:20.800329 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-64bd94ca-69d2-49a2-b7ee-a577aa47fab6 req-cc56bac1-7c73-4efa-94e4-5ed51160c642 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3968d68f-a421-4d08-8b67-b5410b618a47", "name": "network-vif-plugged", "status": "completed", "tag": "43c59e39-3268-4c67-a16b-99af52e4bacf"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:45:20.846318 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-64bd94ca-69d2-49a2-b7ee-a577aa47fab6 req-cc56bac1-7c73-4efa-94e4-5ed51160c642 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:20.849358 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-64bd94ca-69d2-49a2-b7ee-a577aa47fab6 req-cc56bac1-7c73-4efa-94e4-5ed51160c642 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:20.849803 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-64bd94ca-69d2-49a2-b7ee-a577aa47fab6 req-cc56bac1-7c73-4efa-94e4-5ed51160c642 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:20.861741 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-dfc5d1b3-222c-49e0-921f-1a75245d5e34 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:20.873833 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-dfc5d1b3-222c-49e0-921f-1a75245d5e34 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/a2d1b827-a865-4d56-a665-110d0541a669" status: 200 len: 1312 microversion: 2.1 time: 0.486277 Oct 04 21:45:20.880221 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 265/562] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:20 2022] GET /compute/v2.1/servers/a2d1b827-a865-4d56-a665-110d0541a669 => generated 1312 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:45:20.882933 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-64bd94ca-69d2-49a2-b7ee-a577aa47fab6 req-cc56bac1-7c73-4efa-94e4-5ed51160c642 service nova] Creating event network-vif-plugged:43c59e39-3268-4c67-a16b-99af52e4bacf for instance 3968d68f-a421-4d08-8b67-b5410b618a47 on n-h2-860284-1 Oct 04 21:45:20.887949 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-60a68f1a-dc68-4739-82fd-3823e9c6fe80 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:20.889019 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-60a68f1a-dc68-4739-82fd-3823e9c6fe80 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] [instance: 659208f3-1bef-41f7-9616-50c2db9f46ba] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:20.900229 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-64bd94ca-69d2-49a2-b7ee-a577aa47fab6 req-cc56bac1-7c73-4efa-94e4-5ed51160c642 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103552 Oct 04 21:45:20.900999 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-60a68f1a-dc68-4739-82fd-3823e9c6fe80 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:20.901578 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-60a68f1a-dc68-4739-82fd-3823e9c6fe80 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:20.902033 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-60a68f1a-dc68-4739-82fd-3823e9c6fe80 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:20.902793 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-60a68f1a-dc68-4739-82fd-3823e9c6fe80 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:20.903264 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-60a68f1a-dc68-4739-82fd-3823e9c6fe80 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:20.903680 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-60a68f1a-dc68-4739-82fd-3823e9c6fe80 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:20.904377 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 298/563] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:45:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:45:21.270413 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-60a68f1a-dc68-4739-82fd-3823e9c6fe80 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:21.285985 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-60a68f1a-dc68-4739-82fd-3823e9c6fe80 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:21.294459 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-60a68f1a-dc68-4739-82fd-3823e9c6fe80 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:21.295718 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-60a68f1a-dc68-4739-82fd-3823e9c6fe80 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] 10.222.0.43 "GET /compute/v2.1/servers/659208f3-1bef-41f7-9616-50c2db9f46ba" status: 200 len: 1362 microversion: 2.25 time: 0.411578 Oct 04 21:45:21.296307 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 266/564] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:45:20 2022] GET /compute/v2.1/servers/659208f3-1bef-41f7-9616-50c2db9f46ba => generated 1362 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:45:21.390209 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-009435d2-0eae-4bc3-872e-10aee24a9088 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:21.391625 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-009435d2-0eae-4bc3-872e-10aee24a9088 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] [instance: 049f396b-7494-4b40-ad21-c3401958088b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:21.398616 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=1,nova_api:DELETE=3,nova_api:INSERT=6 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:45:21.402534 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-009435d2-0eae-4bc3-872e-10aee24a9088 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:21.403726 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-009435d2-0eae-4bc3-872e-10aee24a9088 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:21.405685 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-009435d2-0eae-4bc3-872e-10aee24a9088 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:21.406790 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-009435d2-0eae-4bc3-872e-10aee24a9088 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:21.407638 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-009435d2-0eae-4bc3-872e-10aee24a9088 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:21.408408 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-009435d2-0eae-4bc3-872e-10aee24a9088 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:21.743607 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-7c27548e-68c4-489e-84d6-147a4078454e tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:21.744029 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-7c27548e-68c4-489e-84d6-147a4078454e tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] [instance: e204d537-73b1-4070-a3f4-e0e3053e0639] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:21.754669 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7c27548e-68c4-489e-84d6-147a4078454e tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:21.757478 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7c27548e-68c4-489e-84d6-147a4078454e tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:21.764178 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7c27548e-68c4-489e-84d6-147a4078454e tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:21.765255 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7c27548e-68c4-489e-84d6-147a4078454e tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:21.766671 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7c27548e-68c4-489e-84d6-147a4078454e tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:21.767923 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7c27548e-68c4-489e-84d6-147a4078454e tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:21.842567 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-009435d2-0eae-4bc3-872e-10aee24a9088 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6975d7cbd8554e06a15a8b2adc811b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94201b6c845f4334b6f4883606b0d037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:21.863802 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-009435d2-0eae-4bc3-872e-10aee24a9088 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] 10.222.0.43 "GET /compute/v2.1/servers/049f396b-7494-4b40-ad21-c3401958088b" status: 200 len: 1321 microversion: 2.1 time: 0.479212 Oct 04 21:45:21.865259 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 299/565] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:21 2022] GET /compute/v2.1/servers/049f396b-7494-4b40-ad21-c3401958088b => generated 1321 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:45:21.904724 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-19bd4357-4640-4cca-9ea7-abdd65c05821 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:21.908931 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-19bd4357-4640-4cca-9ea7-abdd65c05821 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: a2d1b827-a865-4d56-a665-110d0541a669] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:21.919577 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-19bd4357-4640-4cca-9ea7-abdd65c05821 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:21.921310 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-19bd4357-4640-4cca-9ea7-abdd65c05821 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:21.922923 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-19bd4357-4640-4cca-9ea7-abdd65c05821 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:21.927786 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-19bd4357-4640-4cca-9ea7-abdd65c05821 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:21.950107 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-19bd4357-4640-4cca-9ea7-abdd65c05821 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:21.952856 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-19bd4357-4640-4cca-9ea7-abdd65c05821 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:22.796870 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-7c27548e-68c4-489e-84d6-147a4078454e tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29842a669a20408b881105135f76cb0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39edf587afe94b60911198aa0bb61613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:22.814309 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-7c27548e-68c4-489e-84d6-147a4078454e tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] 10.222.0.43 "GET /compute/v2.1/servers/e204d537-73b1-4070-a3f4-e0e3053e0639" status: 200 len: 1318 microversion: 2.1 time: 1.072687 Oct 04 21:45:22.817456 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 267/566] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:21 2022] GET /compute/v2.1/servers/e204d537-73b1-4070-a3f4-e0e3053e0639 => generated 1318 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:45:22.830003 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-2345d262-2b1a-49fd-9ae1-1beed3333486 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:22.833138 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-2345d262-2b1a-49fd-9ae1-1beed3333486 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] [instance: 659208f3-1bef-41f7-9616-50c2db9f46ba] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:22.851984 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-19bd4357-4640-4cca-9ea7-abdd65c05821 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:22.853104 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2345d262-2b1a-49fd-9ae1-1beed3333486 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:22.855459 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2345d262-2b1a-49fd-9ae1-1beed3333486 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:22.856435 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2345d262-2b1a-49fd-9ae1-1beed3333486 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:22.858404 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2345d262-2b1a-49fd-9ae1-1beed3333486 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:22.860690 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2345d262-2b1a-49fd-9ae1-1beed3333486 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:22.861453 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2345d262-2b1a-49fd-9ae1-1beed3333486 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:22.864256 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-19bd4357-4640-4cca-9ea7-abdd65c05821 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/a2d1b827-a865-4d56-a665-110d0541a669" status: 200 len: 1312 microversion: 2.1 time: 0.960495 Oct 04 21:45:22.866556 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 300/567] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:21 2022] GET /compute/v2.1/servers/a2d1b827-a865-4d56-a665-110d0541a669 => generated 1312 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:45:22.892692 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-a2d33846-ae33-45ba-b4e0-a9dbae09869c tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:22.893648 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-a2d33846-ae33-45ba-b4e0-a9dbae09869c tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] [instance: 049f396b-7494-4b40-ad21-c3401958088b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:22.906158 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a2d33846-ae33-45ba-b4e0-a9dbae09869c tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:22.907732 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a2d33846-ae33-45ba-b4e0-a9dbae09869c tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:22.908386 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a2d33846-ae33-45ba-b4e0-a9dbae09869c tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:22.909707 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a2d33846-ae33-45ba-b4e0-a9dbae09869c tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:22.910597 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a2d33846-ae33-45ba-b4e0-a9dbae09869c tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:22.912255 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a2d33846-ae33-45ba-b4e0-a9dbae09869c tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:23.317339 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=2 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:45:23.397916 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-2345d262-2b1a-49fd-9ae1-1beed3333486 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:23.413878 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-2345d262-2b1a-49fd-9ae1-1beed3333486 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:23.419386 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-2345d262-2b1a-49fd-9ae1-1beed3333486 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:23.420953 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-2345d262-2b1a-49fd-9ae1-1beed3333486 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] 10.222.0.43 "GET /compute/v2.1/servers/659208f3-1bef-41f7-9616-50c2db9f46ba" status: 200 len: 1362 microversion: 2.25 time: 0.599696 Oct 04 21:45:23.447279 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-a2d33846-ae33-45ba-b4e0-a9dbae09869c tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6975d7cbd8554e06a15a8b2adc811b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94201b6c845f4334b6f4883606b0d037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:23.450869 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 268/568] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:45:22 2022] GET /compute/v2.1/servers/659208f3-1bef-41f7-9616-50c2db9f46ba => generated 1362 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:45:23.455809 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-b9ded151-0732-4441-96b0-0ae00b809642 req-c4a9e1cd-b0a5-497e-b086-5482c6acfc63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e204d537-73b1-4070-a3f4-e0e3053e0639", "name": "network-vif-plugged", "status": "completed", "tag": "e3daffcc-8395-4ccb-a2f3-5d37cce4823c"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:45:23.461684 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-a2d33846-ae33-45ba-b4e0-a9dbae09869c tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] 10.222.0.43 "GET /compute/v2.1/servers/049f396b-7494-4b40-ad21-c3401958088b" status: 200 len: 1321 microversion: 2.1 time: 0.573131 Oct 04 21:45:23.466222 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 301/569] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:22 2022] GET /compute/v2.1/servers/049f396b-7494-4b40-ad21-c3401958088b => generated 1321 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:45:23.482117 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-b9ded151-0732-4441-96b0-0ae00b809642 req-c4a9e1cd-b0a5-497e-b086-5482c6acfc63 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:23.482932 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-b9ded151-0732-4441-96b0-0ae00b809642 req-c4a9e1cd-b0a5-497e-b086-5482c6acfc63 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:23.483539 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-b9ded151-0732-4441-96b0-0ae00b809642 req-c4a9e1cd-b0a5-497e-b086-5482c6acfc63 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:23.520965 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-b9ded151-0732-4441-96b0-0ae00b809642 req-c4a9e1cd-b0a5-497e-b086-5482c6acfc63 service nova] Creating event network-vif-plugged:e3daffcc-8395-4ccb-a2f3-5d37cce4823c for instance e204d537-73b1-4070-a3f4-e0e3053e0639 on n-h1-860284-1 Oct 04 21:45:23.547343 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-b9ded151-0732-4441-96b0-0ae00b809642 req-c4a9e1cd-b0a5-497e-b086-5482c6acfc63 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080604 Oct 04 21:45:23.548616 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 269/570] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:45:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:45:23.841533 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-bad56452-e788-4bb3-b22f-a78c507ac03e tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:23.842203 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-bad56452-e788-4bb3-b22f-a78c507ac03e tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] [instance: e204d537-73b1-4070-a3f4-e0e3053e0639] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:23.857804 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=8 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:45:23.868334 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bad56452-e788-4bb3-b22f-a78c507ac03e tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:23.870346 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bad56452-e788-4bb3-b22f-a78c507ac03e tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:23.870788 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bad56452-e788-4bb3-b22f-a78c507ac03e tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:23.871548 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bad56452-e788-4bb3-b22f-a78c507ac03e tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:23.872010 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bad56452-e788-4bb3-b22f-a78c507ac03e tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:23.872438 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bad56452-e788-4bb3-b22f-a78c507ac03e tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:23.902324 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-9422558c-774d-42bf-91cd-be67764a1579 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:23.911316 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-9422558c-774d-42bf-91cd-be67764a1579 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: a2d1b827-a865-4d56-a665-110d0541a669] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:23.926470 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9422558c-774d-42bf-91cd-be67764a1579 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:23.927494 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9422558c-774d-42bf-91cd-be67764a1579 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:23.928092 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9422558c-774d-42bf-91cd-be67764a1579 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:23.929758 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9422558c-774d-42bf-91cd-be67764a1579 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:23.930408 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9422558c-774d-42bf-91cd-be67764a1579 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:23.932756 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9422558c-774d-42bf-91cd-be67764a1579 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:24.697609 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-bad56452-e788-4bb3-b22f-a78c507ac03e tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29842a669a20408b881105135f76cb0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39edf587afe94b60911198aa0bb61613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:24.699382 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-9422558c-774d-42bf-91cd-be67764a1579 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:24.710478 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-9422558c-774d-42bf-91cd-be67764a1579 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/a2d1b827-a865-4d56-a665-110d0541a669" status: 200 len: 1312 microversion: 2.1 time: 0.819001 Oct 04 21:45:24.711928 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 270/571] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:23 2022] GET /compute/v2.1/servers/a2d1b827-a865-4d56-a665-110d0541a669 => generated 1312 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:45:24.722879 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-6dd117a0-3e42-4373-b215-3ba081a20abf req-a805765e-3e00-4bf0-a364-9302ac29789e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "659208f3-1bef-41f7-9616-50c2db9f46ba", "tag": "368ea7da-0153-4a50-967c-853fb135f91d"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:45:24.726703 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-bad56452-e788-4bb3-b22f-a78c507ac03e tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] 10.222.0.43 "GET /compute/v2.1/servers/e204d537-73b1-4070-a3f4-e0e3053e0639" status: 200 len: 1318 microversion: 2.1 time: 0.890693 Oct 04 21:45:24.744702 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-6dd117a0-3e42-4373-b215-3ba081a20abf req-a805765e-3e00-4bf0-a364-9302ac29789e service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:24.745181 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-6dd117a0-3e42-4373-b215-3ba081a20abf req-a805765e-3e00-4bf0-a364-9302ac29789e service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:24.745605 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-6dd117a0-3e42-4373-b215-3ba081a20abf req-a805765e-3e00-4bf0-a364-9302ac29789e service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:24.747687 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 302/572] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:23 2022] GET /compute/v2.1/servers/e204d537-73b1-4070-a3f4-e0e3053e0639 => generated 1318 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:45:24.757245 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-83e0392b-3c20-4308-8cd1-576e52e26b80 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:24.759231 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-83e0392b-3c20-4308-8cd1-576e52e26b80 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] [instance: 659208f3-1bef-41f7-9616-50c2db9f46ba] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:24.766816 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-6dd117a0-3e42-4373-b215-3ba081a20abf req-a805765e-3e00-4bf0-a364-9302ac29789e service nova] Creating event network-changed:368ea7da-0153-4a50-967c-853fb135f91d for instance 659208f3-1bef-41f7-9616-50c2db9f46ba on n-h2-860284-1 Oct 04 21:45:24.768602 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-83e0392b-3c20-4308-8cd1-576e52e26b80 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:24.769286 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-83e0392b-3c20-4308-8cd1-576e52e26b80 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:24.769889 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-83e0392b-3c20-4308-8cd1-576e52e26b80 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:24.772021 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-83e0392b-3c20-4308-8cd1-576e52e26b80 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:24.774036 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-83e0392b-3c20-4308-8cd1-576e52e26b80 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:24.775428 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-83e0392b-3c20-4308-8cd1-576e52e26b80 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:24.778216 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-6dd117a0-3e42-4373-b215-3ba081a20abf req-a805765e-3e00-4bf0-a364-9302ac29789e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059748 Oct 04 21:45:24.780783 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 271/573] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:45:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:45:24.797532 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-d415d344-9c48-4a49-9049-da38afd7a4bc tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:24.798501 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-d415d344-9c48-4a49-9049-da38afd7a4bc tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] [instance: 049f396b-7494-4b40-ad21-c3401958088b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:24.813604 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d415d344-9c48-4a49-9049-da38afd7a4bc tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:24.821560 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d415d344-9c48-4a49-9049-da38afd7a4bc tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:24.822190 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d415d344-9c48-4a49-9049-da38afd7a4bc tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:24.823293 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d415d344-9c48-4a49-9049-da38afd7a4bc tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:24.823901 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d415d344-9c48-4a49-9049-da38afd7a4bc tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:24.824482 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d415d344-9c48-4a49-9049-da38afd7a4bc tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:25.840303 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-83e0392b-3c20-4308-8cd1-576e52e26b80 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:25.849635 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-83e0392b-3c20-4308-8cd1-576e52e26b80 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:25.863171 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-83e0392b-3c20-4308-8cd1-576e52e26b80 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:25.864567 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-83e0392b-3c20-4308-8cd1-576e52e26b80 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] 10.222.0.43 "GET /compute/v2.1/servers/659208f3-1bef-41f7-9616-50c2db9f46ba" status: 200 len: 1362 microversion: 2.25 time: 1.114490 Oct 04 21:45:25.865316 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 303/574] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:45:24 2022] GET /compute/v2.1/servers/659208f3-1bef-41f7-9616-50c2db9f46ba => generated 1362 bytes in 1117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:45:25.884143 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-b8022101-0c0d-4883-aefc-5a302705a752 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:25.886748 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-b8022101-0c0d-4883-aefc-5a302705a752 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: a2d1b827-a865-4d56-a665-110d0541a669] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:25.918164 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b8022101-0c0d-4883-aefc-5a302705a752 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:25.919051 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b8022101-0c0d-4883-aefc-5a302705a752 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:25.919940 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b8022101-0c0d-4883-aefc-5a302705a752 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:25.920865 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b8022101-0c0d-4883-aefc-5a302705a752 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:25.925447 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b8022101-0c0d-4883-aefc-5a302705a752 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:25.926441 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b8022101-0c0d-4883-aefc-5a302705a752 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:25.996266 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-d415d344-9c48-4a49-9049-da38afd7a4bc tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6975d7cbd8554e06a15a8b2adc811b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94201b6c845f4334b6f4883606b0d037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:26.018540 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-d415d344-9c48-4a49-9049-da38afd7a4bc tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] 10.222.0.43 "GET /compute/v2.1/servers/049f396b-7494-4b40-ad21-c3401958088b" status: 200 len: 1321 microversion: 2.1 time: 1.222924 Oct 04 21:45:26.019678 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 272/575] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:24 2022] GET /compute/v2.1/servers/049f396b-7494-4b40-ad21-c3401958088b => generated 1321 bytes in 1238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:45:26.035325 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-97e170da-f564-44eb-bab9-39692a666c0e tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:26.036572 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-97e170da-f564-44eb-bab9-39692a666c0e tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] [instance: e204d537-73b1-4070-a3f4-e0e3053e0639] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:26.047806 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-97e170da-f564-44eb-bab9-39692a666c0e tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:26.049487 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-97e170da-f564-44eb-bab9-39692a666c0e tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:26.050540 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-97e170da-f564-44eb-bab9-39692a666c0e tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:26.052351 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-97e170da-f564-44eb-bab9-39692a666c0e tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:26.053874 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-97e170da-f564-44eb-bab9-39692a666c0e tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:26.054786 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-97e170da-f564-44eb-bab9-39692a666c0e tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:26.674985 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-97e170da-f564-44eb-bab9-39692a666c0e tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29842a669a20408b881105135f76cb0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39edf587afe94b60911198aa0bb61613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:26.699323 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-b8022101-0c0d-4883-aefc-5a302705a752 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:26.700951 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-97e170da-f564-44eb-bab9-39692a666c0e tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] 10.222.0.43 "GET /compute/v2.1/servers/e204d537-73b1-4070-a3f4-e0e3053e0639" status: 200 len: 1318 microversion: 2.1 time: 0.665711 Oct 04 21:45:26.714980 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 273/576] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:26 2022] GET /compute/v2.1/servers/e204d537-73b1-4070-a3f4-e0e3053e0639 => generated 1318 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:45:26.715292 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-b8022101-0c0d-4883-aefc-5a302705a752 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/a2d1b827-a865-4d56-a665-110d0541a669" status: 200 len: 1312 microversion: 2.1 time: 0.843420 Oct 04 21:45:26.715292 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 304/577] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:25 2022] GET /compute/v2.1/servers/a2d1b827-a865-4d56-a665-110d0541a669 => generated 1312 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:45:26.893132 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-9bf1fe04-ea3c-4caf-9ce7-67cd8041413e tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:26.893800 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-9bf1fe04-ea3c-4caf-9ce7-67cd8041413e tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] [instance: 659208f3-1bef-41f7-9616-50c2db9f46ba] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:26.900254 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9bf1fe04-ea3c-4caf-9ce7-67cd8041413e tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:26.900773 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9bf1fe04-ea3c-4caf-9ce7-67cd8041413e tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:26.901623 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9bf1fe04-ea3c-4caf-9ce7-67cd8041413e tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:26.901954 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9bf1fe04-ea3c-4caf-9ce7-67cd8041413e tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:26.911490 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9bf1fe04-ea3c-4caf-9ce7-67cd8041413e tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:26.913778 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9bf1fe04-ea3c-4caf-9ce7-67cd8041413e tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:27.046842 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-24c60d56-d1e3-427d-94ae-63232d68d381 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:27.048556 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-24c60d56-d1e3-427d-94ae-63232d68d381 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] [instance: 049f396b-7494-4b40-ad21-c3401958088b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:27.062922 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-24c60d56-d1e3-427d-94ae-63232d68d381 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:27.065616 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-24c60d56-d1e3-427d-94ae-63232d68d381 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:27.068111 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-24c60d56-d1e3-427d-94ae-63232d68d381 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:27.069657 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-24c60d56-d1e3-427d-94ae-63232d68d381 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:27.075136 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-24c60d56-d1e3-427d-94ae-63232d68d381 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:27.075941 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-24c60d56-d1e3-427d-94ae-63232d68d381 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:27.251113 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-9bf1fe04-ea3c-4caf-9ce7-67cd8041413e tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:27.260152 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-9bf1fe04-ea3c-4caf-9ce7-67cd8041413e tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:27.261597 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-9bf1fe04-ea3c-4caf-9ce7-67cd8041413e tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:27.274753 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-9bf1fe04-ea3c-4caf-9ce7-67cd8041413e tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] 10.222.0.43 "GET /compute/v2.1/servers/659208f3-1bef-41f7-9616-50c2db9f46ba" status: 200 len: 1362 microversion: 2.25 time: 0.385398 Oct 04 21:45:27.275360 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 274/578] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:45:26 2022] GET /compute/v2.1/servers/659208f3-1bef-41f7-9616-50c2db9f46ba => generated 1362 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:45:27.408985 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-24c60d56-d1e3-427d-94ae-63232d68d381 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6975d7cbd8554e06a15a8b2adc811b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94201b6c845f4334b6f4883606b0d037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:27.420486 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-24c60d56-d1e3-427d-94ae-63232d68d381 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] 10.222.0.43 "GET /compute/v2.1/servers/049f396b-7494-4b40-ad21-c3401958088b" status: 200 len: 1321 microversion: 2.1 time: 0.377382 Oct 04 21:45:27.421886 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 305/579] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:27 2022] GET /compute/v2.1/servers/049f396b-7494-4b40-ad21-c3401958088b => generated 1321 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:45:27.727676 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-216abc5f-e8c8-4d9d-b3a6-25f13695c3ba tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:27.728297 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-216abc5f-e8c8-4d9d-b3a6-25f13695c3ba tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] [instance: e204d537-73b1-4070-a3f4-e0e3053e0639] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:27.751585 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-216abc5f-e8c8-4d9d-b3a6-25f13695c3ba tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:27.753564 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-216abc5f-e8c8-4d9d-b3a6-25f13695c3ba tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:27.755642 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-216abc5f-e8c8-4d9d-b3a6-25f13695c3ba tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:27.759221 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-216abc5f-e8c8-4d9d-b3a6-25f13695c3ba tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:27.760825 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-216abc5f-e8c8-4d9d-b3a6-25f13695c3ba tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:27.761507 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-216abc5f-e8c8-4d9d-b3a6-25f13695c3ba tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:27.959288 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-82ce4bc1-b52b-4448-8ccc-2a2dc8f92648 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Action: 'create', calling method: .version_select at 0x7fbb2f754160>, body: {"keypair": {"name": "tempest-keypair-642459235", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOSd5+k0a5PrdfiQbXxbCcpBll1994xXH0trPvYwx6Hyt4jkFuWzqnGR/hOUFagWW2CtsrGJnyml5CKv9DgmAHeThy3R6Ol5svhWBzcYrduxiAn4OoMBi6C1+5Muxhjr0g=="}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:45:28.020048 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-82ce4bc1-b52b-4448-8ccc-2a2dc8f92648 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Getting quotas for project 0f6a5f1476ac48f3831f2ed202dacdf8. Resources: {'key_pairs'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:45:28.028162 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-82ce4bc1-b52b-4448-8ccc-2a2dc8f92648 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Getting quotas for user 5a2dff38dea346219f6534426fd27ff8 and project 0f6a5f1476ac48f3831f2ed202dacdf8. Resources: {'key_pairs'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:45:28.062187 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-82ce4bc1-b52b-4448-8ccc-2a2dc8f92648 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.473011 Oct 04 21:45:28.063177 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 275/580] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Oct 4 21:45:27 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:45:28.070934 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-d63e3930-7aba-4e5d-9cbc-c26bd4b00527 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:28.072486 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-d63e3930-7aba-4e5d-9cbc-c26bd4b00527 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: a2d1b827-a865-4d56-a665-110d0541a669] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:28.081643 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d63e3930-7aba-4e5d-9cbc-c26bd4b00527 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:28.082593 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d63e3930-7aba-4e5d-9cbc-c26bd4b00527 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:28.083250 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d63e3930-7aba-4e5d-9cbc-c26bd4b00527 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:28.084187 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d63e3930-7aba-4e5d-9cbc-c26bd4b00527 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:28.085478 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d63e3930-7aba-4e5d-9cbc-c26bd4b00527 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:28.086400 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d63e3930-7aba-4e5d-9cbc-c26bd4b00527 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:28.107806 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-216abc5f-e8c8-4d9d-b3a6-25f13695c3ba tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29842a669a20408b881105135f76cb0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39edf587afe94b60911198aa0bb61613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:28.116195 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-216abc5f-e8c8-4d9d-b3a6-25f13695c3ba tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] 10.222.0.43 "GET /compute/v2.1/servers/e204d537-73b1-4070-a3f4-e0e3053e0639" status: 200 len: 1467 microversion: 2.1 time: 0.392389 Oct 04 21:45:28.116780 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 306/581] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:27 2022] GET /compute/v2.1/servers/e204d537-73b1-4070-a3f4-e0e3053e0639 => generated 1467 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:45:28.144342 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e4956d3b-48f3-440d-a9fd-2eb2030c6a2d tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:28.145217 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-e4956d3b-48f3-440d-a9fd-2eb2030c6a2d tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] [instance: 3968d68f-a421-4d08-8b67-b5410b618a47] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:28.154904 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e4956d3b-48f3-440d-a9fd-2eb2030c6a2d tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:28.158541 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e4956d3b-48f3-440d-a9fd-2eb2030c6a2d tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:28.159297 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e4956d3b-48f3-440d-a9fd-2eb2030c6a2d tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:28.173926 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e4956d3b-48f3-440d-a9fd-2eb2030c6a2d tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:28.175035 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e4956d3b-48f3-440d-a9fd-2eb2030c6a2d tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:28.175693 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e4956d3b-48f3-440d-a9fd-2eb2030c6a2d tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:28.471979 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-d63e3930-7aba-4e5d-9cbc-c26bd4b00527 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:28.484937 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-d63e3930-7aba-4e5d-9cbc-c26bd4b00527 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/a2d1b827-a865-4d56-a665-110d0541a669" status: 200 len: 1312 microversion: 2.1 time: 0.420206 Oct 04 21:45:28.485608 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 276/582] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:28 2022] GET /compute/v2.1/servers/a2d1b827-a865-4d56-a665-110d0541a669 => generated 1312 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:45:28.499050 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-3370d9cf-a281-4ec4-84cc-e24b45dd62f1 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:28.499949 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-3370d9cf-a281-4ec4-84cc-e24b45dd62f1 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] [instance: 659208f3-1bef-41f7-9616-50c2db9f46ba] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:28.518205 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3370d9cf-a281-4ec4-84cc-e24b45dd62f1 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:28.519758 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3370d9cf-a281-4ec4-84cc-e24b45dd62f1 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:28.520422 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3370d9cf-a281-4ec4-84cc-e24b45dd62f1 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:28.521315 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3370d9cf-a281-4ec4-84cc-e24b45dd62f1 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:28.526115 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3370d9cf-a281-4ec4-84cc-e24b45dd62f1 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:28.526810 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3370d9cf-a281-4ec4-84cc-e24b45dd62f1 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:28.607302 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-e4956d3b-48f3-440d-a9fd-2eb2030c6a2d tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29842a669a20408b881105135f76cb0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39edf587afe94b60911198aa0bb61613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:28.620665 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-e4956d3b-48f3-440d-a9fd-2eb2030c6a2d tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] 10.222.0.43 "GET /compute/v2.1/servers/3968d68f-a421-4d08-8b67-b5410b618a47" status: 200 len: 1468 microversion: 2.1 time: 0.481944 Oct 04 21:45:28.621772 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 307/583] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:28 2022] GET /compute/v2.1/servers/3968d68f-a421-4d08-8b67-b5410b618a47 => generated 1468 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:45:28.632209 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-d679d989-6de1-4288-be89-4539aa7f9c44 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:28.633171 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-d679d989-6de1-4288-be89-4539aa7f9c44 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] [instance: 049f396b-7494-4b40-ad21-c3401958088b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:28.654251 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d679d989-6de1-4288-be89-4539aa7f9c44 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:28.655299 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d679d989-6de1-4288-be89-4539aa7f9c44 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:28.656843 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d679d989-6de1-4288-be89-4539aa7f9c44 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:28.659600 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d679d989-6de1-4288-be89-4539aa7f9c44 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:28.660532 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d679d989-6de1-4288-be89-4539aa7f9c44 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:28.661139 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d679d989-6de1-4288-be89-4539aa7f9c44 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:28.857840 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-3370d9cf-a281-4ec4-84cc-e24b45dd62f1 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:28.870646 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-3370d9cf-a281-4ec4-84cc-e24b45dd62f1 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:28.874836 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-3370d9cf-a281-4ec4-84cc-e24b45dd62f1 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:28.878697 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-3370d9cf-a281-4ec4-84cc-e24b45dd62f1 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] 10.222.0.43 "GET /compute/v2.1/servers/659208f3-1bef-41f7-9616-50c2db9f46ba" status: 200 len: 1362 microversion: 2.25 time: 0.391461 Oct 04 21:45:28.879930 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 277/584] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:45:28 2022] GET /compute/v2.1/servers/659208f3-1bef-41f7-9616-50c2db9f46ba => generated 1362 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:45:28.885556 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-9ac35d32-cb64-42d8-a361-edb7a2a3b155 req-de5d378f-9f0c-405b-92a8-d15db2b24ec7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "049f396b-7494-4b40-ad21-c3401958088b", "name": "network-vif-plugged", "status": "completed", "tag": "b8904ed3-c3c4-4e36-91c9-b8a1f2fa53b0"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:45:28.897085 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-9ac35d32-cb64-42d8-a361-edb7a2a3b155 req-de5d378f-9f0c-405b-92a8-d15db2b24ec7 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:28.898745 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-9ac35d32-cb64-42d8-a361-edb7a2a3b155 req-de5d378f-9f0c-405b-92a8-d15db2b24ec7 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:28.899404 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-9ac35d32-cb64-42d8-a361-edb7a2a3b155 req-de5d378f-9f0c-405b-92a8-d15db2b24ec7 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:28.921886 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-9ac35d32-cb64-42d8-a361-edb7a2a3b155 req-de5d378f-9f0c-405b-92a8-d15db2b24ec7 service nova] Creating event network-vif-plugged:b8904ed3-c3c4-4e36-91c9-b8a1f2fa53b0 for instance 049f396b-7494-4b40-ad21-c3401958088b on n-h2-860284-1 Oct 04 21:45:28.945640 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-9ac35d32-cb64-42d8-a361-edb7a2a3b155 req-de5d378f-9f0c-405b-92a8-d15db2b24ec7 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064186 Oct 04 21:45:28.950341 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 278/585] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:45:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:45:29.090590 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-d679d989-6de1-4288-be89-4539aa7f9c44 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6975d7cbd8554e06a15a8b2adc811b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94201b6c845f4334b6f4883606b0d037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:29.105223 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-d679d989-6de1-4288-be89-4539aa7f9c44 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] 10.222.0.43 "GET /compute/v2.1/servers/049f396b-7494-4b40-ad21-c3401958088b" status: 200 len: 1321 microversion: 2.1 time: 0.479597 Oct 04 21:45:29.121130 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 308/586] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:28 2022] GET /compute/v2.1/servers/049f396b-7494-4b40-ad21-c3401958088b => generated 1321 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:45:29.139780 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-fe6210b4-3085-44f0-9c8f-ca265e4cdbf3 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:29.156614 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-fe6210b4-3085-44f0-9c8f-ca265e4cdbf3 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '29842a669a20408b881105135f76cb0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39edf587afe94b60911198aa0bb61613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:29.159190 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-fe6210b4-3085-44f0-9c8f-ca265e4cdbf3 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Searching by: {'reservation_id': 'r-wxs9h7f5', 'deleted': False, 'project_id': '39edf587afe94b60911198aa0bb61613'} {{(pid=134101) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 21:45:29.167522 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fe6210b4-3085-44f0-9c8f-ca265e4cdbf3 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:29.169175 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fe6210b4-3085-44f0-9c8f-ca265e4cdbf3 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:29.170483 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fe6210b4-3085-44f0-9c8f-ca265e4cdbf3 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:29.171755 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fe6210b4-3085-44f0-9c8f-ca265e4cdbf3 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:29.172837 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fe6210b4-3085-44f0-9c8f-ca265e4cdbf3 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:29.173484 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fe6210b4-3085-44f0-9c8f-ca265e4cdbf3 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:29.323492 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.multi_cell_list [None req-fe6210b4-3085-44f0-9c8f-ca265e4cdbf3 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=134101) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 21:45:29.365097 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-ab05624e-b88f-4df0-a2b6-1547bc5bdcbb tempest-QuotasAdminTestJSON-1929373289 tempest-QuotasAdminTestJSON-1929373289-project-admin] Calling method '.version_select at 0x7fbb2f719a60>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:29.434678 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-fe6210b4-3085-44f0-9c8f-ca265e4cdbf3 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29842a669a20408b881105135f76cb0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39edf587afe94b60911198aa0bb61613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:29.445516 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fe6210b4-3085-44f0-9c8f-ca265e4cdbf3 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:29.447262 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fe6210b4-3085-44f0-9c8f-ca265e4cdbf3 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:29.448034 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fe6210b4-3085-44f0-9c8f-ca265e4cdbf3 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:29.559872 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-ab05624e-b88f-4df0-a2b6-1547bc5bdcbb tempest-QuotasAdminTestJSON-1929373289 tempest-QuotasAdminTestJSON-1929373289-project-admin] 10.222.0.43 "GET /compute/v2.1/os-quota-sets/3e0ae60433a6405a8503862f3feaa5ab" status: 200 len: 371 microversion: 2.1 time: 0.607619 Oct 04 21:45:29.560492 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 279/587] 10.222.0.43 () {58 vars in 1242 bytes} [Tue Oct 4 21:45:28 2022] GET /compute/v2.1/os-quota-sets/3e0ae60433a6405a8503862f3feaa5ab => generated 371 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:45:29.570545 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-672df6c9-5b5f-40da-a926-624d7d9c2396 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:29.575874 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-672df6c9-5b5f-40da-a926-624d7d9c2396 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: a2d1b827-a865-4d56-a665-110d0541a669] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:29.589652 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-672df6c9-5b5f-40da-a926-624d7d9c2396 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:29.591498 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-672df6c9-5b5f-40da-a926-624d7d9c2396 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:29.592427 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-672df6c9-5b5f-40da-a926-624d7d9c2396 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:29.594527 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-672df6c9-5b5f-40da-a926-624d7d9c2396 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:29.596300 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-672df6c9-5b5f-40da-a926-624d7d9c2396 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:29.596903 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-672df6c9-5b5f-40da-a926-624d7d9c2396 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:29.793114 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-fe6210b4-3085-44f0-9c8f-ca265e4cdbf3 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] 10.222.0.43 "GET /compute/v2.1/servers/detail?reservation_id=r-wxs9h7f5" status: 200 len: 2928 microversion: 2.1 time: 0.669997 Oct 04 21:45:29.793930 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 309/588] 10.222.0.43 () {58 vars in 1197 bytes} [Tue Oct 4 21:45:29 2022] GET /compute/v2.1/servers/detail?reservation_id=r-wxs9h7f5 => generated 2928 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:45:29.820159 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-ac28ca74-0686-4ec9-be1d-e09dbc2ddc66 tempest-QuotasAdminTestJSON-1929373289 tempest-QuotasAdminTestJSON-1929373289-project-admin] Action: 'update', calling method: .version_select at 0x7fbb2f694280>, body: {"quota_set": {"ram": "5120"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:45:29.912432 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ac28ca74-0686-4ec9-be1d-e09dbc2ddc66 tempest-QuotasAdminTestJSON-1929373289 tempest-QuotasAdminTestJSON-1929373289-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:29.912959 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ac28ca74-0686-4ec9-be1d-e09dbc2ddc66 tempest-QuotasAdminTestJSON-1929373289 tempest-QuotasAdminTestJSON-1929373289-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:29.913429 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ac28ca74-0686-4ec9-be1d-e09dbc2ddc66 tempest-QuotasAdminTestJSON-1929373289 tempest-QuotasAdminTestJSON-1929373289-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:29.914599 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ac28ca74-0686-4ec9-be1d-e09dbc2ddc66 tempest-QuotasAdminTestJSON-1929373289 tempest-QuotasAdminTestJSON-1929373289-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:29.915069 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ac28ca74-0686-4ec9-be1d-e09dbc2ddc66 tempest-QuotasAdminTestJSON-1929373289 tempest-QuotasAdminTestJSON-1929373289-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:29.915498 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ac28ca74-0686-4ec9-be1d-e09dbc2ddc66 tempest-QuotasAdminTestJSON-1929373289 tempest-QuotasAdminTestJSON-1929373289-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:29.956929 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-672df6c9-5b5f-40da-a926-624d7d9c2396 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:29.971856 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-672df6c9-5b5f-40da-a926-624d7d9c2396 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/a2d1b827-a865-4d56-a665-110d0541a669" status: 200 len: 1312 microversion: 2.1 time: 0.410033 Oct 04 21:45:29.973093 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 280/589] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:29 2022] GET /compute/v2.1/servers/a2d1b827-a865-4d56-a665-110d0541a669 => generated 1312 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:45:29.998824 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-ac28ca74-0686-4ec9-be1d-e09dbc2ddc66 tempest-QuotasAdminTestJSON-1929373289 tempest-QuotasAdminTestJSON-1929373289-project-admin] 10.222.0.43 "PUT /compute/v2.1/os-quota-sets/3e0ae60433a6405a8503862f3feaa5ab" status: 200 len: 328 microversion: 2.1 time: 0.183270 Oct 04 21:45:29.999812 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 310/590] 10.222.0.43 () {60 vars in 1262 bytes} [Tue Oct 4 21:45:29 2022] PUT /compute/v2.1/os-quota-sets/3e0ae60433a6405a8503862f3feaa5ab => generated 328 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:45:30.007208 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-23a14529-1994-418a-801f-f73c1d935abf tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:30.033236 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.compute.server_groups [None req-23a14529-1994-418a-801f-f73c1d935abf tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Querying cell 1297bf18-d456-4d7b-91a9-0a07f1cafd2a(cell1) for 2 instances {{(pid=134101) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 04 21:45:30.036519 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-23a14529-1994-418a-801f-f73c1d935abf tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:30.037114 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-23a14529-1994-418a-801f-f73c1d935abf tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:30.037611 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-23a14529-1994-418a-801f-f73c1d935abf tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:30.067756 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-23a14529-1994-418a-801f-f73c1d935abf tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] 10.222.0.43 "GET /compute/v2.1/os-server-groups/98988bff-2fca-46fa-8954-3dfc730df468" status: 200 len: 270 microversion: 2.1 time: 0.066524 Oct 04 21:45:30.069895 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 311/591] 10.222.0.43 () {58 vars in 1263 bytes} [Tue Oct 4 21:45:29 2022] GET /compute/v2.1/os-server-groups/98988bff-2fca-46fa-8954-3dfc730df468 => generated 270 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:45:30.076103 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-f821e266-6891-492b-9f24-38e114290bff tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:30.076848 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-f821e266-6891-492b-9f24-38e114290bff tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] [instance: 659208f3-1bef-41f7-9616-50c2db9f46ba] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:30.078677 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-d1abb6ca-8858-4c2e-a99a-4d09c2a21a13 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1719477865", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452", "networks": [{"uuid": "7c037080-0b8b-4757-a710-31df9b3a21f4"}]}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:45:30.083671 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f821e266-6891-492b-9f24-38e114290bff tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:30.084174 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f821e266-6891-492b-9f24-38e114290bff tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:30.084662 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f821e266-6891-492b-9f24-38e114290bff tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:30.085374 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f821e266-6891-492b-9f24-38e114290bff tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:30.085831 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f821e266-6891-492b-9f24-38e114290bff tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:30.086253 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f821e266-6891-492b-9f24-38e114290bff tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:30.196707 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.network.neutron [None req-d1abb6ca-8858-4c2e-a99a-4d09c2a21a13 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] validate_networks() for [('7c037080-0b8b-4757-a710-31df9b3a21f4', None, None, None, None, None)] {{(pid=134102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:45:30.373128 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-f821e266-6891-492b-9f24-38e114290bff tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:30.384980 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=100 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:45:30.392443 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-f821e266-6891-492b-9f24-38e114290bff tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:30.393959 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-f821e266-6891-492b-9f24-38e114290bff tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:30.395173 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-f821e266-6891-492b-9f24-38e114290bff tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] 10.222.0.43 "GET /compute/v2.1/servers/659208f3-1bef-41f7-9616-50c2db9f46ba" status: 200 len: 1362 microversion: 2.25 time: 0.323863 Oct 04 21:45:30.398276 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 312/592] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:45:30 2022] GET /compute/v2.1/servers/659208f3-1bef-41f7-9616-50c2db9f46ba => generated 1362 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:45:30.403648 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-f866a66e-42e0-4087-9b57-32d37edd1e5f tempest-QuotasAdminTestJSON-1929373289 tempest-QuotasAdminTestJSON-1929373289-project-admin] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:30.421390 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-f866a66e-42e0-4087-9b57-32d37edd1e5f tempest-QuotasAdminTestJSON-1929373289 tempest-QuotasAdminTestJSON-1929373289-project-admin] 10.222.0.43 "DELETE /compute/v2.1/os-quota-sets/3e0ae60433a6405a8503862f3feaa5ab" status: 202 len: 0 microversion: 2.1 time: 0.021709 Oct 04 21:45:30.422328 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 313/593] 10.222.0.43 () {58 vars in 1245 bytes} [Tue Oct 4 21:45:30 2022] DELETE /compute/v2.1/os-quota-sets/3e0ae60433a6405a8503862f3feaa5ab => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:45:30.427525 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-db18c267-e31e-4d3d-abad-60e20f6ea960 tempest-ServersOnMultiNodesTest-962622545 tempest-ServersOnMultiNodesTest-962622545-project-admin] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:30.428199 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-db18c267-e31e-4d3d-abad-60e20f6ea960 tempest-ServersOnMultiNodesTest-962622545 tempest-ServersOnMultiNodesTest-962622545-project-admin] [instance: e204d537-73b1-4070-a3f4-e0e3053e0639] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:30.437357 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-db18c267-e31e-4d3d-abad-60e20f6ea960 tempest-ServersOnMultiNodesTest-962622545 tempest-ServersOnMultiNodesTest-962622545-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:30.437856 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-db18c267-e31e-4d3d-abad-60e20f6ea960 tempest-ServersOnMultiNodesTest-962622545 tempest-ServersOnMultiNodesTest-962622545-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:30.438300 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-db18c267-e31e-4d3d-abad-60e20f6ea960 tempest-ServersOnMultiNodesTest-962622545 tempest-ServersOnMultiNodesTest-962622545-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:30.439102 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-db18c267-e31e-4d3d-abad-60e20f6ea960 tempest-ServersOnMultiNodesTest-962622545 tempest-ServersOnMultiNodesTest-962622545-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:30.439555 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-db18c267-e31e-4d3d-abad-60e20f6ea960 tempest-ServersOnMultiNodesTest-962622545 tempest-ServersOnMultiNodesTest-962622545-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:30.439980 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-db18c267-e31e-4d3d-abad-60e20f6ea960 tempest-ServersOnMultiNodesTest-962622545 tempest-ServersOnMultiNodesTest-962622545-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:30.734658 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-db18c267-e31e-4d3d-abad-60e20f6ea960 tempest-ServersOnMultiNodesTest-962622545 tempest-ServersOnMultiNodesTest-962622545-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/e204d537-73b1-4070-a3f4-e0e3053e0639" status: 200 len: 1618 microversion: 2.1 time: 0.311194 Oct 04 21:45:30.735334 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 314/594] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:30 2022] GET /compute/v2.1/servers/e204d537-73b1-4070-a3f4-e0e3053e0639 => generated 1618 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:45:30.740390 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-5c524764-3257-4f64-aaf7-af873b96f079 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:30.741071 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-5c524764-3257-4f64-aaf7-af873b96f079 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] [instance: 049f396b-7494-4b40-ad21-c3401958088b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:30.759074 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5c524764-3257-4f64-aaf7-af873b96f079 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:30.759649 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5c524764-3257-4f64-aaf7-af873b96f079 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:30.760162 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5c524764-3257-4f64-aaf7-af873b96f079 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:30.760964 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5c524764-3257-4f64-aaf7-af873b96f079 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:30.761504 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5c524764-3257-4f64-aaf7-af873b96f079 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:30.762004 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5c524764-3257-4f64-aaf7-af873b96f079 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:31.024264 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-5c524764-3257-4f64-aaf7-af873b96f079 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6975d7cbd8554e06a15a8b2adc811b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94201b6c845f4334b6f4883606b0d037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:31.034690 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-5c524764-3257-4f64-aaf7-af873b96f079 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] 10.222.0.43 "GET /compute/v2.1/servers/049f396b-7494-4b40-ad21-c3401958088b" status: 200 len: 1321 microversion: 2.1 time: 0.297960 Oct 04 21:45:31.035311 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 315/595] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:30 2022] GET /compute/v2.1/servers/049f396b-7494-4b40-ad21-c3401958088b => generated 1321 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:45:31.059366 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-d6540738-2c4c-4893-9fd3-4874e70d2922 tempest-QuotasAdminTestJSON-1929373289 tempest-QuotasAdminTestJSON-1929373289-project-admin] Calling method '.version_select at 0x7fbb2f62d4c0>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:31.136437 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-d1abb6ca-8858-4c2e-a99a-4d09c2a21a13 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Flavor limits 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:45:31.136890 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-d1abb6ca-8858-4c2e-a99a-4d09c2a21a13 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Image limits 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:45:31.137341 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-d1abb6ca-8858-4c2e-a99a-4d09c2a21a13 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Flavor pref 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:45:31.137750 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-d1abb6ca-8858-4c2e-a99a-4d09c2a21a13 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Image pref 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:45:31.138171 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-d1abb6ca-8858-4c2e-a99a-4d09c2a21a13 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:45:31.156212 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-d6540738-2c4c-4893-9fd3-4874e70d2922 tempest-QuotasAdminTestJSON-1929373289 tempest-QuotasAdminTestJSON-1929373289-project-admin] 10.222.0.43 "GET /compute/v2.1/os-quota-sets/3e0ae60433a6405a8503862f3feaa5ab" status: 200 len: 371 microversion: 2.1 time: 0.102489 Oct 04 21:45:31.173493 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d1abb6ca-8858-4c2e-a99a-4d09c2a21a13 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:31.175277 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 316/596] 10.222.0.43 () {58 vars in 1242 bytes} [Tue Oct 4 21:45:31 2022] GET /compute/v2.1/os-quota-sets/3e0ae60433a6405a8503862f3feaa5ab => generated 371 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:45:31.180890 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-6b689756-1001-45b0-8e7d-429ffa8dd3b9 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-1315364960", "imageRef": "b9f4eb8d-2e6f-48b2-b8f8-1022074a5f7e", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "f4f8f29a-5893-4662-9025-323e39ab6075"}], "security_groups": [{"name": "tempest-securitygroup--571679084"}], "key_name": "tempest-keypair-642459235", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:45:31.187214 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d1abb6ca-8858-4c2e-a99a-4d09c2a21a13 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:31.187722 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d1abb6ca-8858-4c2e-a99a-4d09c2a21a13 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:31.188528 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d1abb6ca-8858-4c2e-a99a-4d09c2a21a13 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:31.188977 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d1abb6ca-8858-4c2e-a99a-4d09c2a21a13 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:31.189404 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d1abb6ca-8858-4c2e-a99a-4d09c2a21a13 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:31.217157 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-d1abb6ca-8858-4c2e-a99a-4d09c2a21a13 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Getting quotas for project 78dcfc7024fc49388c4bd5f25f03e60d. Resources: {'instances', 'ram', 'cores'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:45:31.223681 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-d1abb6ca-8858-4c2e-a99a-4d09c2a21a13 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Getting quotas for user bb7ad048becf474fb972d4291422d810 and project 78dcfc7024fc49388c4bd5f25f03e60d. Resources: {'instances', 'ram', 'cores'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:45:31.259547 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-d1abb6ca-8858-4c2e-a99a-4d09c2a21a13 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Going to run 1 instances... {{(pid=134102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:45:31.264396 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-d1abb6ca-8858-4c2e-a99a-4d09c2a21a13 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 10062905-54d7-47e2-b621-522e0954b72b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='58548514-5dac-426c-81f5-19e3fba33e23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:45:31.280684 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:45:31.333698 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-d1abb6ca-8858-4c2e-a99a-4d09c2a21a13 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.359206 Oct 04 21:45:31.335385 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 281/597] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 21:45:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 1361 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:45:31.353992 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.network.neutron [None req-6b689756-1001-45b0-8e7d-429ffa8dd3b9 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] validate_networks() for [('f4f8f29a-5893-4662-9025-323e39ab6075', None, None, None, None, None)] {{(pid=134101) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:45:31.362516 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-d9fbdbc7-71b0-4057-99a1-82477b567e07 tempest-ServersOnMultiNodesTest-962622545 tempest-ServersOnMultiNodesTest-962622545-project-admin] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:31.363563 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-d9fbdbc7-71b0-4057-99a1-82477b567e07 tempest-ServersOnMultiNodesTest-962622545 tempest-ServersOnMultiNodesTest-962622545-project-admin] [instance: 3968d68f-a421-4d08-8b67-b5410b618a47] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:31.374310 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d9fbdbc7-71b0-4057-99a1-82477b567e07 tempest-ServersOnMultiNodesTest-962622545 tempest-ServersOnMultiNodesTest-962622545-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:31.374835 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d9fbdbc7-71b0-4057-99a1-82477b567e07 tempest-ServersOnMultiNodesTest-962622545 tempest-ServersOnMultiNodesTest-962622545-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:31.375443 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d9fbdbc7-71b0-4057-99a1-82477b567e07 tempest-ServersOnMultiNodesTest-962622545 tempest-ServersOnMultiNodesTest-962622545-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:31.377339 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d9fbdbc7-71b0-4057-99a1-82477b567e07 tempest-ServersOnMultiNodesTest-962622545 tempest-ServersOnMultiNodesTest-962622545-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:31.377967 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d9fbdbc7-71b0-4057-99a1-82477b567e07 tempest-ServersOnMultiNodesTest-962622545 tempest-ServersOnMultiNodesTest-962622545-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:31.378571 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d9fbdbc7-71b0-4057-99a1-82477b567e07 tempest-ServersOnMultiNodesTest-962622545 tempest-ServersOnMultiNodesTest-962622545-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:31.595641 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-d9fbdbc7-71b0-4057-99a1-82477b567e07 tempest-ServersOnMultiNodesTest-962622545 tempest-ServersOnMultiNodesTest-962622545-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/3968d68f-a421-4d08-8b67-b5410b618a47" status: 200 len: 1619 microversion: 2.1 time: 0.258599 Oct 04 21:45:31.596528 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 282/598] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:31 2022] GET /compute/v2.1/servers/3968d68f-a421-4d08-8b67-b5410b618a47 => generated 1619 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:45:31.605615 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-a7208dd8-2c61-43be-9033-9d3e7a21ba92 req-324ba20a-51e4-4cf0-951c-0bad5a89b25e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2d1b827-a865-4d56-a665-110d0541a669", "name": "network-vif-plugged", "status": "completed", "tag": "63fc7a3b-4543-41af-bdba-41c87b0c3709"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:45:31.617513 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-a7208dd8-2c61-43be-9033-9d3e7a21ba92 req-324ba20a-51e4-4cf0-951c-0bad5a89b25e service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:31.618525 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-a7208dd8-2c61-43be-9033-9d3e7a21ba92 req-324ba20a-51e4-4cf0-951c-0bad5a89b25e service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:31.619139 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-a7208dd8-2c61-43be-9033-9d3e7a21ba92 req-324ba20a-51e4-4cf0-951c-0bad5a89b25e service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:31.623550 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=100 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:45:31.650219 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-a7208dd8-2c61-43be-9033-9d3e7a21ba92 req-324ba20a-51e4-4cf0-951c-0bad5a89b25e service nova] Creating event network-vif-plugged:63fc7a3b-4543-41af-bdba-41c87b0c3709 for instance a2d1b827-a865-4d56-a665-110d0541a669 on n-h1-860284-1 Oct 04 21:45:31.657325 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-a7208dd8-2c61-43be-9033-9d3e7a21ba92 req-324ba20a-51e4-4cf0-951c-0bad5a89b25e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059199 Oct 04 21:45:31.661516 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 283/599] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:45:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:45:31.675133 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-38fc7cf1-7961-4678-95f8-17aa4870aea4 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:31.675837 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-38fc7cf1-7961-4678-95f8-17aa4870aea4 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: a2d1b827-a865-4d56-a665-110d0541a669] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:31.688891 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-38fc7cf1-7961-4678-95f8-17aa4870aea4 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:31.689384 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-38fc7cf1-7961-4678-95f8-17aa4870aea4 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:31.689992 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-38fc7cf1-7961-4678-95f8-17aa4870aea4 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:31.690734 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-38fc7cf1-7961-4678-95f8-17aa4870aea4 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:31.691219 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-38fc7cf1-7961-4678-95f8-17aa4870aea4 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:31.691641 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-38fc7cf1-7961-4678-95f8-17aa4870aea4 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:32.021105 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-38fc7cf1-7961-4678-95f8-17aa4870aea4 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:32.035004 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-38fc7cf1-7961-4678-95f8-17aa4870aea4 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/a2d1b827-a865-4d56-a665-110d0541a669" status: 200 len: 1312 microversion: 2.1 time: 0.367164 Oct 04 21:45:32.035800 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 284/600] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:31 2022] GET /compute/v2.1/servers/a2d1b827-a865-4d56-a665-110d0541a669 => generated 1312 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:45:32.056534 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-21f664e5-829e-4ae4-8f97-3ab00ffd3857 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:32.058814 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-21f664e5-829e-4ae4-8f97-3ab00ffd3857 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 10062905-54d7-47e2-b621-522e0954b72b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:32.067506 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-21f664e5-829e-4ae4-8f97-3ab00ffd3857 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:32.068138 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-21f664e5-829e-4ae4-8f97-3ab00ffd3857 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:32.069503 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-21f664e5-829e-4ae4-8f97-3ab00ffd3857 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:32.070517 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-21f664e5-829e-4ae4-8f97-3ab00ffd3857 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:32.071111 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-21f664e5-829e-4ae4-8f97-3ab00ffd3857 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:32.071754 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-21f664e5-829e-4ae4-8f97-3ab00ffd3857 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:32.100508 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-6b689756-1001-45b0-8e7d-429ffa8dd3b9 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Flavor limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:45:32.101517 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-6b689756-1001-45b0-8e7d-429ffa8dd3b9 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Image limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:45:32.102168 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-6b689756-1001-45b0-8e7d-429ffa8dd3b9 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Flavor pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:45:32.102609 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-6b689756-1001-45b0-8e7d-429ffa8dd3b9 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Image pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:45:32.103190 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-6b689756-1001-45b0-8e7d-429ffa8dd3b9 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:45:32.112918 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6b689756-1001-45b0-8e7d-429ffa8dd3b9 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:32.113700 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6b689756-1001-45b0-8e7d-429ffa8dd3b9 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:32.114312 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6b689756-1001-45b0-8e7d-429ffa8dd3b9 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:32.115133 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6b689756-1001-45b0-8e7d-429ffa8dd3b9 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:32.116361 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6b689756-1001-45b0-8e7d-429ffa8dd3b9 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:32.116966 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6b689756-1001-45b0-8e7d-429ffa8dd3b9 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:32.138280 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-6b689756-1001-45b0-8e7d-429ffa8dd3b9 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Getting quotas for project 0f6a5f1476ac48f3831f2ed202dacdf8. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:45:32.144813 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-6b689756-1001-45b0-8e7d-429ffa8dd3b9 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Getting quotas for user 5a2dff38dea346219f6534426fd27ff8 and project 0f6a5f1476ac48f3831f2ed202dacdf8. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:45:32.159231 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-6b689756-1001-45b0-8e7d-429ffa8dd3b9 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Going to run 1 instances... {{(pid=134101) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:45:32.160756 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-21f664e5-829e-4ae4-8f97-3ab00ffd3857 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ad048becf474fb972d4291422d810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dcfc7024fc49388c4bd5f25f03e60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:32.161612 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-6b689756-1001-45b0-8e7d-429ffa8dd3b9 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] [instance: 1e9957cf-cfeb-483d-bc32-73ca72a54eb9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9f4eb8d-2e6f-48b2-b8f8-1022074a5f7e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134101) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:45:32.169102 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-21f664e5-829e-4ae4-8f97-3ab00ffd3857 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/10062905-54d7-47e2-b621-522e0954b72b" status: 200 len: 1207 microversion: 2.1 time: 0.131993 Oct 04 21:45:32.169768 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 285/601] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:32 2022] GET /compute/v2.1/servers/10062905-54d7-47e2-b621-522e0954b72b => generated 1207 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:45:32.174489 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-ca63cadc-53a1-40b1-9b99-8c5e12a974c3 tempest-QuotasAdminTestJSON-1929373289 tempest-QuotasAdminTestJSON-1929373289-project-admin] Calling method '.version_select at 0x7fbb2f74d670>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:32.237308 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-6b689756-1001-45b0-8e7d-429ffa8dd3b9 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.060750 Oct 04 21:45:32.242884 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 317/602] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 21:45:31 2022] POST /compute/v2.1/servers => generated 405 bytes in 1067 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:45:32.249864 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-2e2211ec-ea6b-44d0-9285-e696db50aef8 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:32.251228 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-2e2211ec-ea6b-44d0-9285-e696db50aef8 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] [instance: 659208f3-1bef-41f7-9616-50c2db9f46ba] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:32.261915 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2e2211ec-ea6b-44d0-9285-e696db50aef8 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:32.262563 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2e2211ec-ea6b-44d0-9285-e696db50aef8 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:32.263053 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2e2211ec-ea6b-44d0-9285-e696db50aef8 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:32.264467 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2e2211ec-ea6b-44d0-9285-e696db50aef8 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:32.264995 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2e2211ec-ea6b-44d0-9285-e696db50aef8 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:32.265504 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2e2211ec-ea6b-44d0-9285-e696db50aef8 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:32.463115 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-ca63cadc-53a1-40b1-9b99-8c5e12a974c3 tempest-QuotasAdminTestJSON-1929373289 tempest-QuotasAdminTestJSON-1929373289-project-admin] 10.222.0.43 "GET /compute/v2.1/os-quota-sets/d4bf79d874664f4b858c334c5b585c56/defaults" status: 200 len: 371 microversion: 2.1 time: 0.291945 Oct 04 21:45:32.464724 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 286/603] 10.222.0.43 () {58 vars in 1269 bytes} [Tue Oct 4 21:45:32 2022] GET /compute/v2.1/os-quota-sets/d4bf79d874664f4b858c334c5b585c56/defaults => generated 371 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:45:32.472000 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-f1fbf9a2-1092-4262-b6f6-a6ecc198638e tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-793713646", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "4b0c3dd7-d609-4b00-8604-35f8a2680c14"}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:45:32.535138 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-2e2211ec-ea6b-44d0-9285-e696db50aef8 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:32.546295 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-2e2211ec-ea6b-44d0-9285-e696db50aef8 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:32.548280 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-2e2211ec-ea6b-44d0-9285-e696db50aef8 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:32.550114 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-2e2211ec-ea6b-44d0-9285-e696db50aef8 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] 10.222.0.43 "GET /compute/v2.1/servers/659208f3-1bef-41f7-9616-50c2db9f46ba" status: 200 len: 1362 microversion: 2.25 time: 0.305643 Oct 04 21:45:32.552396 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 318/604] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:45:32 2022] GET /compute/v2.1/servers/659208f3-1bef-41f7-9616-50c2db9f46ba => generated 1362 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:45:32.558710 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-ef705262-1e1c-4f82-bb28-c4699298ca79 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:32.559668 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-ef705262-1e1c-4f82-bb28-c4699298ca79 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] [instance: 049f396b-7494-4b40-ad21-c3401958088b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:32.568249 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ef705262-1e1c-4f82-bb28-c4699298ca79 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:32.569722 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ef705262-1e1c-4f82-bb28-c4699298ca79 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:32.570506 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ef705262-1e1c-4f82-bb28-c4699298ca79 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:32.571797 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ef705262-1e1c-4f82-bb28-c4699298ca79 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:32.572624 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ef705262-1e1c-4f82-bb28-c4699298ca79 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:32.573501 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ef705262-1e1c-4f82-bb28-c4699298ca79 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:32.582289 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.network.neutron [None req-f1fbf9a2-1092-4262-b6f6-a6ecc198638e tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] validate_networks() for None {{(pid=134102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:45:33.036271 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-ef705262-1e1c-4f82-bb28-c4699298ca79 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6975d7cbd8554e06a15a8b2adc811b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94201b6c845f4334b6f4883606b0d037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:33.045248 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-ef705262-1e1c-4f82-bb28-c4699298ca79 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] 10.222.0.43 "GET /compute/v2.1/servers/049f396b-7494-4b40-ad21-c3401958088b" status: 200 len: 1471 microversion: 2.1 time: 0.491225 Oct 04 21:45:33.045394 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 319/605] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:32 2022] GET /compute/v2.1/servers/049f396b-7494-4b40-ad21-c3401958088b => generated 1471 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:45:33.055064 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-596998df-b696-45c8-9d87-57b3ce5e0b81 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:33.055685 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-596998df-b696-45c8-9d87-57b3ce5e0b81 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] [instance: 1e9957cf-cfeb-483d-bc32-73ca72a54eb9] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:33.069549 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-596998df-b696-45c8-9d87-57b3ce5e0b81 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:33.071035 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-596998df-b696-45c8-9d87-57b3ce5e0b81 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:33.071676 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-596998df-b696-45c8-9d87-57b3ce5e0b81 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:33.072595 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-596998df-b696-45c8-9d87-57b3ce5e0b81 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:33.073059 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-596998df-b696-45c8-9d87-57b3ce5e0b81 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:33.073493 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-596998df-b696-45c8-9d87-57b3ce5e0b81 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:33.167296 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-f1fbf9a2-1092-4262-b6f6-a6ecc198638e tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Flavor limits 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:45:33.167785 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-f1fbf9a2-1092-4262-b6f6-a6ecc198638e tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Image limits 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:45:33.168345 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-f1fbf9a2-1092-4262-b6f6-a6ecc198638e tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Flavor pref 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:45:33.169102 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-f1fbf9a2-1092-4262-b6f6-a6ecc198638e tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Image pref 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:45:33.169905 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-f1fbf9a2-1092-4262-b6f6-a6ecc198638e tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:45:33.186095 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f1fbf9a2-1092-4262-b6f6-a6ecc198638e tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:33.187194 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f1fbf9a2-1092-4262-b6f6-a6ecc198638e tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:33.188553 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f1fbf9a2-1092-4262-b6f6-a6ecc198638e tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:33.189688 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f1fbf9a2-1092-4262-b6f6-a6ecc198638e tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:33.190819 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-596998df-b696-45c8-9d87-57b3ce5e0b81 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2dff38dea346219f6534426fd27ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6a5f1476ac48f3831f2ed202dacdf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:33.191686 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f1fbf9a2-1092-4262-b6f6-a6ecc198638e tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:33.192418 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f1fbf9a2-1092-4262-b6f6-a6ecc198638e tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:33.215755 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-596998df-b696-45c8-9d87-57b3ce5e0b81 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] 10.222.0.43 "GET /compute/v2.1/servers/1e9957cf-cfeb-483d-bc32-73ca72a54eb9" status: 200 len: 1249 microversion: 2.1 time: 0.169305 Oct 04 21:45:33.227234 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-f1fbf9a2-1092-4262-b6f6-a6ecc198638e tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Getting quotas for project 39edf587afe94b60911198aa0bb61613. Resources: {'instances', 'ram', 'cores'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:45:33.237942 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 320/606] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:33 2022] GET /compute/v2.1/servers/1e9957cf-cfeb-483d-bc32-73ca72a54eb9 => generated 1249 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:45:33.240528 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-f1fbf9a2-1092-4262-b6f6-a6ecc198638e tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Getting quotas for user 29842a669a20408b881105135f76cb0a and project 39edf587afe94b60911198aa0bb61613. Resources: {'instances', 'ram', 'cores'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:45:33.247083 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-6efd65df-2992-4b33-9203-05f2dd8f94b6 tempest-QuotasAdminTestJSON-1929373289 tempest-QuotasAdminTestJSON-1929373289-project-admin] Action: 'update', calling method: .version_select at 0x7fbb2f4a7a60>, body: {"quota_set": {"ram": "5120"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:45:33.269618 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-f1fbf9a2-1092-4262-b6f6-a6ecc198638e tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Going to run 1 instances... {{(pid=134102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:45:33.276825 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-f1fbf9a2-1092-4262-b6f6-a6ecc198638e tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] [instance: f3a0dc37-502e-48d3-9537-10dd7fb15e94] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='58548514-5dac-426c-81f5-19e3fba33e23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:45:33.344226 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-f1fbf9a2-1092-4262-b6f6-a6ecc198638e tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.878230 Oct 04 21:45:33.345704 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 287/607] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 21:45:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 880 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:45:33.351098 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-8ab4c5d8-67da-4276-8916-15417d64a5d6 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:33.352187 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-8ab4c5d8-67da-4276-8916-15417d64a5d6 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: a2d1b827-a865-4d56-a665-110d0541a669] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:33.360336 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8ab4c5d8-67da-4276-8916-15417d64a5d6 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:33.361130 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8ab4c5d8-67da-4276-8916-15417d64a5d6 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:33.361893 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8ab4c5d8-67da-4276-8916-15417d64a5d6 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:33.363161 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8ab4c5d8-67da-4276-8916-15417d64a5d6 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:33.363776 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8ab4c5d8-67da-4276-8916-15417d64a5d6 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:33.364229 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8ab4c5d8-67da-4276-8916-15417d64a5d6 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:33.439320 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6efd65df-2992-4b33-9203-05f2dd8f94b6 tempest-QuotasAdminTestJSON-1929373289 tempest-QuotasAdminTestJSON-1929373289-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:33.440007 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6efd65df-2992-4b33-9203-05f2dd8f94b6 tempest-QuotasAdminTestJSON-1929373289 tempest-QuotasAdminTestJSON-1929373289-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:33.440630 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6efd65df-2992-4b33-9203-05f2dd8f94b6 tempest-QuotasAdminTestJSON-1929373289 tempest-QuotasAdminTestJSON-1929373289-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:33.441536 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6efd65df-2992-4b33-9203-05f2dd8f94b6 tempest-QuotasAdminTestJSON-1929373289 tempest-QuotasAdminTestJSON-1929373289-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:33.442154 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6efd65df-2992-4b33-9203-05f2dd8f94b6 tempest-QuotasAdminTestJSON-1929373289 tempest-QuotasAdminTestJSON-1929373289-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:33.442840 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6efd65df-2992-4b33-9203-05f2dd8f94b6 tempest-QuotasAdminTestJSON-1929373289 tempest-QuotasAdminTestJSON-1929373289-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:33.507575 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-6efd65df-2992-4b33-9203-05f2dd8f94b6 tempest-QuotasAdminTestJSON-1929373289 tempest-QuotasAdminTestJSON-1929373289-project-admin] 10.222.0.43 "PUT /compute/v2.1/os-quota-sets/362f6eb7c6474ed79a0a8cb4b7ad786e" status: 200 len: 328 microversion: 2.1 time: 0.267174 Oct 04 21:45:33.514860 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 321/608] 10.222.0.43 () {60 vars in 1262 bytes} [Tue Oct 4 21:45:33 2022] PUT /compute/v2.1/os-quota-sets/362f6eb7c6474ed79a0a8cb4b7ad786e => generated 328 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:45:33.644071 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-8ab4c5d8-67da-4276-8916-15417d64a5d6 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:33.654600 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-8ab4c5d8-67da-4276-8916-15417d64a5d6 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/a2d1b827-a865-4d56-a665-110d0541a669" status: 200 len: 1312 microversion: 2.1 time: 0.307418 Oct 04 21:45:33.655222 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 288/609] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:33 2022] GET /compute/v2.1/servers/a2d1b827-a865-4d56-a665-110d0541a669 => generated 1312 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:45:33.660568 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-d70fc8bb-dc90-4f37-98b4-9801fe06cef4 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:33.661370 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-d70fc8bb-dc90-4f37-98b4-9801fe06cef4 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 10062905-54d7-47e2-b621-522e0954b72b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:33.669818 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d70fc8bb-dc90-4f37-98b4-9801fe06cef4 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:33.670786 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d70fc8bb-dc90-4f37-98b4-9801fe06cef4 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:33.671438 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d70fc8bb-dc90-4f37-98b4-9801fe06cef4 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:33.672386 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d70fc8bb-dc90-4f37-98b4-9801fe06cef4 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:33.673053 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d70fc8bb-dc90-4f37-98b4-9801fe06cef4 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:33.673698 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d70fc8bb-dc90-4f37-98b4-9801fe06cef4 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:33.690618 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-73aa25f5-94de-4896-8d5b-20777ad53ffe tempest-ServersAdminNegativeTestJSON-223082715 tempest-ServersAdminNegativeTestJSON-223082715-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:45:33.691601 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-73aa25f5-94de-4896-8d5b-20777ad53ffe tempest-ServersAdminNegativeTestJSON-223082715 tempest-ServersAdminNegativeTestJSON-223082715-project-admin] [instance: fd9f97e1-1eab-4201-9a2e-c2f1d00df38e] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:33.698528 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-73aa25f5-94de-4896-8d5b-20777ad53ffe tempest-ServersAdminNegativeTestJSON-223082715 tempest-ServersAdminNegativeTestJSON-223082715-project-admin] HTTP exception thrown: Instance fd9f97e1-1eab-4201-9a2e-c2f1d00df38e could not be found. Oct 04 21:45:33.704186 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-73aa25f5-94de-4896-8d5b-20777ad53ffe tempest-ServersAdminNegativeTestJSON-223082715 tempest-ServersAdminNegativeTestJSON-223082715-project-admin] Request method failure captured: Oct 04 21:45:33.704186 n-d-860284-1 devstack@n-api.service[134101]: request: POST /compute/v2.1/servers/fd9f97e1-1eab-4201-9a2e-c2f1d00df38e/action HTTP/1.1 Oct 04 21:45:33.704186 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 21:45:33.704186 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 21:45:33.704186 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 21:45:33.704186 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 15 Oct 04 21:45:33.704186 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 21:45:33.704186 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 21:45:33.704186 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 21:45:33.704186 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 21:45:33.704186 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPKlcstBJ_e_eeicTLFBoLhbdLHdHmVyiojKBIkDG0BEXG377WAXANmxI5NFEUJ5lkQPvbASA8odpcSKsCBGedAQ2Y0tpGO57llrsYPR8FRbOCVTkRBNhcLHFXTlWYVX2CJVAu156o3i327YyTGalKfNz4UCTjp0VDuviBqffepolLGQ Oct 04 21:45:33.704186 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 21:45:33.704186 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 21:45:33.704186 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 21:45:33.704186 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 21:45:33.704186 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 21:45:33.704186 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 21:45:33.704186 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: 1b19a1a36fbf4edcbee78e73a2e3aca4 Oct 04 21:45:33.704186 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-223082715 Oct 04 21:45:33.704186 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,admin,member Oct 04 21:45:33.704186 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,admin,member Oct 04 21:45:33.705523 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1b19a1a36fbf4edcbee78e73a2e3aca4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_1b19a1a36fbf4edcbee78e73a2e3aca4", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1b19a1a36fbf4edcbee78e73a2e3aca4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/1b19a1a36fbf4edcbee78e73a2e3aca4"}]}] Oct 04 21:45:33.705523 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-ServersAdminNegativeTestJSON-223082715 Oct 04 21:45:33.705523 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: 1b19a1a36fbf4edcbee78e73a2e3aca4 Oct 04 21:45:33.705523 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-223082715 Oct 04 21:45:33.705523 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-ServersAdminNegativeTestJSON-223082715-project-admin Oct 04 21:45:33.705523 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 21:45:33.705523 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 21:45:33.705523 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: ff041b1766904d4e8a4e54f29620d8b3 Oct 04 21:45:33.705523 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-ServersAdminNegativeTestJSON-223082715-project-admin Oct 04 21:45:33.705523 n-d-860284-1 devstack@n-api.service[134101]: Oct 04 21:45:33.705523 n-d-860284-1 devstack@n-api.service[134101]: {"migrate": {}} Oct 04 21:45:33.705523 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 21:45:33.705523 n-d-860284-1 devstack@n-api.service[134101]: exception: Instance fd9f97e1-1eab-4201-9a2e-c2f1d00df38e could not be found. Oct 04 21:45:33.706334 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': 'fd9f97e1-1eab-4201-9a2e-c2f1d00df38e', 'body': {'migrate': {}}} Oct 04 21:45:33.706334 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:45:33.706334 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:45:33.706334 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:45:33.706334 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:45:33.706334 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:45:33.706334 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:45:33.706334 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 21:45:33.706334 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 21:45:33.706334 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd9f97e1-1eab-4201-9a2e-c2f1d00df38e could not be found. Oct 04 21:45:33.706334 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:45:33.706334 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:45:33.706334 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:45:33.706334 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:45:33.706334 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:45:33.706334 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:45:33.706334 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:45:33.706334 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:45:33.706334 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:45:33.706334 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:45:33.707551 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:45:33.707551 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:45:33.707551 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate Oct 04 21:45:33.707551 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, Oct 04 21:45:33.707551 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:45:33.707551 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:45:33.707551 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd9f97e1-1eab-4201-9a2e-c2f1d00df38e could not be found. Oct 04 21:45:33.707551 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:45:33.707551 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:45:33.707551 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:45:33.707551 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:45:33.707551 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:45:33.707551 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:45:33.707551 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:45:33.707551 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:45:33.707551 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd9f97e1-1eab-4201-9a2e-c2f1d00df38e could not be found. Oct 04 21:45:33.707551 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:45:33.711388 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-73aa25f5-94de-4896-8d5b-20777ad53ffe tempest-ServersAdminNegativeTestJSON-223082715 tempest-ServersAdminNegativeTestJSON-223082715-project-admin] Returning 404 to user: Instance fd9f97e1-1eab-4201-9a2e-c2f1d00df38e could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:45:33.711388 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-73aa25f5-94de-4896-8d5b-20777ad53ffe tempest-ServersAdminNegativeTestJSON-223082715 tempest-ServersAdminNegativeTestJSON-223082715-project-admin] 10.222.0.43 "POST /compute/v2.1/servers/fd9f97e1-1eab-4201-9a2e-c2f1d00df38e/action" status: 404 len: 111 microversion: 2.1 time: 0.196626 Oct 04 21:45:33.711388 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 322/610] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 21:45:33 2022] POST /compute/v2.1/servers/fd9f97e1-1eab-4201-9a2e-c2f1d00df38e/action => generated 111 bytes in 199 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:45:33.713007 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-8633f795-ab1d-4025-99bf-8836228dc601 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:33.713625 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-8633f795-ab1d-4025-99bf-8836228dc601 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] [instance: f3a0dc37-502e-48d3-9537-10dd7fb15e94] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:33.785451 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-d70fc8bb-dc90-4f37-98b4-9801fe06cef4 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ad048becf474fb972d4291422d810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dcfc7024fc49388c4bd5f25f03e60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:33.795757 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-d70fc8bb-dc90-4f37-98b4-9801fe06cef4 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/10062905-54d7-47e2-b621-522e0954b72b" status: 200 len: 1263 microversion: 2.1 time: 0.139279 Oct 04 21:45:33.805104 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 289/611] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:33 2022] GET /compute/v2.1/servers/10062905-54d7-47e2-b621-522e0954b72b => generated 1263 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:45:33.818049 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-8633f795-ab1d-4025-99bf-8836228dc601 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29842a669a20408b881105135f76cb0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39edf587afe94b60911198aa0bb61613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:33.828686 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-e90b2ac9-3510-4f8a-bc5a-586af1cb663f tempest-QuotasAdminTestJSON-1929373289 tempest-QuotasAdminTestJSON-1929373289-project-admin] Calling method '.version_select at 0x7fbb2f76e8b0>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:33.831870 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-8633f795-ab1d-4025-99bf-8836228dc601 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] 10.222.0.43 "GET /compute/v2.1/servers/f3a0dc37-502e-48d3-9537-10dd7fb15e94" status: 200 len: 1216 microversion: 2.1 time: 0.122837 Oct 04 21:45:33.840448 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 323/612] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:33 2022] GET /compute/v2.1/servers/f3a0dc37-502e-48d3-9537-10dd7fb15e94 => generated 1216 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:45:33.848675 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-07f0a55c-de4d-4bef-a557-bf9f211ecbe9 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:33.849295 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-07f0a55c-de4d-4bef-a557-bf9f211ecbe9 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] [instance: 659208f3-1bef-41f7-9616-50c2db9f46ba] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:33.886707 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-07f0a55c-de4d-4bef-a557-bf9f211ecbe9 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:33.887443 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-07f0a55c-de4d-4bef-a557-bf9f211ecbe9 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:33.888062 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-07f0a55c-de4d-4bef-a557-bf9f211ecbe9 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:33.888988 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-07f0a55c-de4d-4bef-a557-bf9f211ecbe9 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:33.894062 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-07f0a55c-de4d-4bef-a557-bf9f211ecbe9 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:33.894727 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-07f0a55c-de4d-4bef-a557-bf9f211ecbe9 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:33.962405 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e90b2ac9-3510-4f8a-bc5a-586af1cb663f tempest-QuotasAdminTestJSON-1929373289 tempest-QuotasAdminTestJSON-1929373289-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:33.962912 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e90b2ac9-3510-4f8a-bc5a-586af1cb663f tempest-QuotasAdminTestJSON-1929373289 tempest-QuotasAdminTestJSON-1929373289-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:33.964466 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e90b2ac9-3510-4f8a-bc5a-586af1cb663f tempest-QuotasAdminTestJSON-1929373289 tempest-QuotasAdminTestJSON-1929373289-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:33.970301 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e90b2ac9-3510-4f8a-bc5a-586af1cb663f tempest-QuotasAdminTestJSON-1929373289 tempest-QuotasAdminTestJSON-1929373289-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:33.970822 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e90b2ac9-3510-4f8a-bc5a-586af1cb663f tempest-QuotasAdminTestJSON-1929373289 tempest-QuotasAdminTestJSON-1929373289-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:33.971481 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e90b2ac9-3510-4f8a-bc5a-586af1cb663f tempest-QuotasAdminTestJSON-1929373289 tempest-QuotasAdminTestJSON-1929373289-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:33.998303 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-e90b2ac9-3510-4f8a-bc5a-586af1cb663f tempest-QuotasAdminTestJSON-1929373289 tempest-QuotasAdminTestJSON-1929373289-project-admin] 10.222.0.43 "GET /compute/v2.1/os-quota-sets/362f6eb7c6474ed79a0a8cb4b7ad786e/detail" status: 200 len: 916 microversion: 2.1 time: 0.182239 Oct 04 21:45:33.999713 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 290/613] 10.222.0.43 () {58 vars in 1263 bytes} [Tue Oct 4 21:45:33 2022] GET /compute/v2.1/os-quota-sets/362f6eb7c6474ed79a0a8cb4b7ad786e/detail => generated 916 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:45:34.006995 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-4883e5fe-91ba-4c43-8a88-3fc0d9cb7902 req-b1edcc7a-ee5e-4423-82a0-c7f0dca81597 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "659208f3-1bef-41f7-9616-50c2db9f46ba", "name": "network-vif-plugged", "status": "completed", "tag": "368ea7da-0153-4a50-967c-853fb135f91d"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:45:34.023348 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-4883e5fe-91ba-4c43-8a88-3fc0d9cb7902 req-b1edcc7a-ee5e-4423-82a0-c7f0dca81597 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:34.024044 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-4883e5fe-91ba-4c43-8a88-3fc0d9cb7902 req-b1edcc7a-ee5e-4423-82a0-c7f0dca81597 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:34.024501 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-4883e5fe-91ba-4c43-8a88-3fc0d9cb7902 req-b1edcc7a-ee5e-4423-82a0-c7f0dca81597 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:34.048775 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-4883e5fe-91ba-4c43-8a88-3fc0d9cb7902 req-b1edcc7a-ee5e-4423-82a0-c7f0dca81597 service nova] Creating event network-vif-plugged:368ea7da-0153-4a50-967c-853fb135f91d for instance 659208f3-1bef-41f7-9616-50c2db9f46ba on n-h2-860284-1 Oct 04 21:45:34.059810 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-4883e5fe-91ba-4c43-8a88-3fc0d9cb7902 req-b1edcc7a-ee5e-4423-82a0-c7f0dca81597 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057689 Oct 04 21:45:34.061207 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 291/614] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:45:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:45:34.072538 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-001f028e-15c4-4d4e-aa32-de6c531abfad tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-567971162", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452"}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:45:34.188993 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.network.neutron [None req-001f028e-15c4-4d4e-aa32-de6c531abfad tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] validate_networks() for None {{(pid=134102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:45:34.410343 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-07f0a55c-de4d-4bef-a557-bf9f211ecbe9 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:34.433441 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-07f0a55c-de4d-4bef-a557-bf9f211ecbe9 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:34.435325 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-07f0a55c-de4d-4bef-a557-bf9f211ecbe9 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:34.436853 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-07f0a55c-de4d-4bef-a557-bf9f211ecbe9 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] 10.222.0.43 "GET /compute/v2.1/servers/659208f3-1bef-41f7-9616-50c2db9f46ba" status: 200 len: 1362 microversion: 2.25 time: 0.593557 Oct 04 21:45:34.440996 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 324/615] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:45:33 2022] GET /compute/v2.1/servers/659208f3-1bef-41f7-9616-50c2db9f46ba => generated 1362 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:45:34.450109 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-6efde03d-6f9b-481b-b72a-6d75de867d9e tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:34.454385 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-6efde03d-6f9b-481b-b72a-6d75de867d9e tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] [instance: 1e9957cf-cfeb-483d-bc32-73ca72a54eb9] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:34.460476 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=5,nova_api:DELETE=2 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:45:34.472656 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6efde03d-6f9b-481b-b72a-6d75de867d9e tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:34.473157 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6efde03d-6f9b-481b-b72a-6d75de867d9e tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:34.473595 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6efde03d-6f9b-481b-b72a-6d75de867d9e tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:34.474308 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6efde03d-6f9b-481b-b72a-6d75de867d9e tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:34.474798 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6efde03d-6f9b-481b-b72a-6d75de867d9e tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:34.475879 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6efde03d-6f9b-481b-b72a-6d75de867d9e tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:34.626752 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-6efde03d-6f9b-481b-b72a-6d75de867d9e tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2dff38dea346219f6534426fd27ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6a5f1476ac48f3831f2ed202dacdf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:34.637823 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-6efde03d-6f9b-481b-b72a-6d75de867d9e tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] 10.222.0.43 "GET /compute/v2.1/servers/1e9957cf-cfeb-483d-bc32-73ca72a54eb9" status: 200 len: 1297 microversion: 2.1 time: 0.193935 Oct 04 21:45:34.638431 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 325/616] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:34 2022] GET /compute/v2.1/servers/1e9957cf-cfeb-483d-bc32-73ca72a54eb9 => generated 1297 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:45:34.648289 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-75bc82f3-7f7c-476e-86c7-78b2fd641c2b tempest-QuotasAdminTestJSON-1929373289 tempest-QuotasAdminTestJSON-1929373289-project-admin] Action: 'update', calling method: .version_select at 0x7fbb2f49aa60>, body: {"quota_set": {"ram": "2048"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:45:34.729298 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-75bc82f3-7f7c-476e-86c7-78b2fd641c2b tempest-QuotasAdminTestJSON-1929373289 tempest-QuotasAdminTestJSON-1929373289-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:34.729783 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-75bc82f3-7f7c-476e-86c7-78b2fd641c2b tempest-QuotasAdminTestJSON-1929373289 tempest-QuotasAdminTestJSON-1929373289-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:34.730219 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-75bc82f3-7f7c-476e-86c7-78b2fd641c2b tempest-QuotasAdminTestJSON-1929373289 tempest-QuotasAdminTestJSON-1929373289-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:34.730989 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-75bc82f3-7f7c-476e-86c7-78b2fd641c2b tempest-QuotasAdminTestJSON-1929373289 tempest-QuotasAdminTestJSON-1929373289-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:34.731440 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-75bc82f3-7f7c-476e-86c7-78b2fd641c2b tempest-QuotasAdminTestJSON-1929373289 tempest-QuotasAdminTestJSON-1929373289-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:34.731860 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-75bc82f3-7f7c-476e-86c7-78b2fd641c2b tempest-QuotasAdminTestJSON-1929373289 tempest-QuotasAdminTestJSON-1929373289-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:34.770845 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-75bc82f3-7f7c-476e-86c7-78b2fd641c2b tempest-QuotasAdminTestJSON-1929373289 tempest-QuotasAdminTestJSON-1929373289-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:34.771487 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-75bc82f3-7f7c-476e-86c7-78b2fd641c2b tempest-QuotasAdminTestJSON-1929373289 tempest-QuotasAdminTestJSON-1929373289-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:34.772268 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-75bc82f3-7f7c-476e-86c7-78b2fd641c2b tempest-QuotasAdminTestJSON-1929373289 tempest-QuotasAdminTestJSON-1929373289-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:34.773899 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-75bc82f3-7f7c-476e-86c7-78b2fd641c2b tempest-QuotasAdminTestJSON-1929373289 tempest-QuotasAdminTestJSON-1929373289-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:34.775056 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-75bc82f3-7f7c-476e-86c7-78b2fd641c2b tempest-QuotasAdminTestJSON-1929373289 tempest-QuotasAdminTestJSON-1929373289-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:34.776001 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-75bc82f3-7f7c-476e-86c7-78b2fd641c2b tempest-QuotasAdminTestJSON-1929373289 tempest-QuotasAdminTestJSON-1929373289-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:34.820211 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-001f028e-15c4-4d4e-aa32-de6c531abfad tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Flavor limits 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:45:34.820704 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-001f028e-15c4-4d4e-aa32-de6c531abfad tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Image limits 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:45:34.821210 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-001f028e-15c4-4d4e-aa32-de6c531abfad tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Flavor pref 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:45:34.821626 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-001f028e-15c4-4d4e-aa32-de6c531abfad tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Image pref 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:45:34.822044 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-001f028e-15c4-4d4e-aa32-de6c531abfad tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:45:34.842345 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-001f028e-15c4-4d4e-aa32-de6c531abfad tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:34.843626 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-001f028e-15c4-4d4e-aa32-de6c531abfad tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:34.844264 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-001f028e-15c4-4d4e-aa32-de6c531abfad tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:34.845722 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-001f028e-15c4-4d4e-aa32-de6c531abfad tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:34.847335 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-001f028e-15c4-4d4e-aa32-de6c531abfad tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:34.849597 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-001f028e-15c4-4d4e-aa32-de6c531abfad tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:34.867603 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-75bc82f3-7f7c-476e-86c7-78b2fd641c2b tempest-QuotasAdminTestJSON-1929373289 tempest-QuotasAdminTestJSON-1929373289-project-admin] 10.222.0.43 "PUT /compute/v2.1/os-quota-sets/362f6eb7c6474ed79a0a8cb4b7ad786e?user_id=3a7ae9a1a7994116868c86699c3b39e8" status: 200 len: 328 microversion: 2.1 time: 0.227673 Oct 04 21:45:34.870213 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 326/617] 10.222.0.43 () {60 vars in 1343 bytes} [Tue Oct 4 21:45:34 2022] PUT /compute/v2.1/os-quota-sets/362f6eb7c6474ed79a0a8cb4b7ad786e?user_id=3a7ae9a1a7994116868c86699c3b39e8 => generated 328 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:45:34.874650 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-9934422d-5ad9-4e9c-86e7-a8d2f46c5ffa tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:34.875554 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-9934422d-5ad9-4e9c-86e7-a8d2f46c5ffa tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: a2d1b827-a865-4d56-a665-110d0541a669] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:34.886618 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9934422d-5ad9-4e9c-86e7-a8d2f46c5ffa tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:34.887265 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9934422d-5ad9-4e9c-86e7-a8d2f46c5ffa tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:34.888197 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9934422d-5ad9-4e9c-86e7-a8d2f46c5ffa tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:34.889015 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9934422d-5ad9-4e9c-86e7-a8d2f46c5ffa tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:34.889581 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9934422d-5ad9-4e9c-86e7-a8d2f46c5ffa tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:34.890125 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9934422d-5ad9-4e9c-86e7-a8d2f46c5ffa tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:34.915427 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-001f028e-15c4-4d4e-aa32-de6c531abfad tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Getting quotas for project 94201b6c845f4334b6f4883606b0d037. Resources: {'instances', 'ram', 'cores'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:45:34.931348 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-001f028e-15c4-4d4e-aa32-de6c531abfad tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Getting quotas for user 6975d7cbd8554e06a15a8b2adc811b12 and project 94201b6c845f4334b6f4883606b0d037. Resources: {'instances', 'ram', 'cores'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:45:34.955254 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-001f028e-15c4-4d4e-aa32-de6c531abfad tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Going to run 1 instances... {{(pid=134102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:45:34.958130 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-001f028e-15c4-4d4e-aa32-de6c531abfad tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] [instance: caabd624-94e3-4d85-9038-2f3beeabfda9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='58548514-5dac-426c-81f5-19e3fba33e23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:45:35.047403 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-001f028e-15c4-4d4e-aa32-de6c531abfad tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.981197 Oct 04 21:45:35.055580 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 292/618] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 21:45:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 993 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:45:35.065949 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-038425b7-7d2e-44ff-9a9e-3c5c8bb85fc4 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:35.066614 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-038425b7-7d2e-44ff-9a9e-3c5c8bb85fc4 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 10062905-54d7-47e2-b621-522e0954b72b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:35.090705 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-038425b7-7d2e-44ff-9a9e-3c5c8bb85fc4 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:35.091258 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-038425b7-7d2e-44ff-9a9e-3c5c8bb85fc4 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:35.091731 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-038425b7-7d2e-44ff-9a9e-3c5c8bb85fc4 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:35.093202 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-038425b7-7d2e-44ff-9a9e-3c5c8bb85fc4 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:35.093734 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-038425b7-7d2e-44ff-9a9e-3c5c8bb85fc4 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:35.095289 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-038425b7-7d2e-44ff-9a9e-3c5c8bb85fc4 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:35.270562 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-9934422d-5ad9-4e9c-86e7-a8d2f46c5ffa tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:35.294954 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-9934422d-5ad9-4e9c-86e7-a8d2f46c5ffa tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/a2d1b827-a865-4d56-a665-110d0541a669" status: 200 len: 1461 microversion: 2.1 time: 0.422245 Oct 04 21:45:35.297226 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 327/619] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:34 2022] GET /compute/v2.1/servers/a2d1b827-a865-4d56-a665-110d0541a669 => generated 1461 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:45:35.309490 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-038425b7-7d2e-44ff-9a9e-3c5c8bb85fc4 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ad048becf474fb972d4291422d810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dcfc7024fc49388c4bd5f25f03e60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:35.327512 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-de505890-1257-4c3d-a93e-6b27102bf21c tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:35.328434 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-de505890-1257-4c3d-a93e-6b27102bf21c tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] [instance: f3a0dc37-502e-48d3-9537-10dd7fb15e94] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:35.329173 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-038425b7-7d2e-44ff-9a9e-3c5c8bb85fc4 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/10062905-54d7-47e2-b621-522e0954b72b" status: 200 len: 1269 microversion: 2.1 time: 0.271819 Oct 04 21:45:35.330325 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 293/620] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:35 2022] GET /compute/v2.1/servers/10062905-54d7-47e2-b621-522e0954b72b => generated 1269 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:45:35.343727 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-45b7e681-5ac4-4327-854c-5c9bfa3fcedb tempest-QuotasAdminTestJSON-1929373289 tempest-QuotasAdminTestJSON-1929373289-project-admin] Calling method '.version_select at 0x7fbb2f719c10>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:35.346546 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-de505890-1257-4c3d-a93e-6b27102bf21c tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:35.347694 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-de505890-1257-4c3d-a93e-6b27102bf21c tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:35.348313 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-de505890-1257-4c3d-a93e-6b27102bf21c tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:35.349236 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-de505890-1257-4c3d-a93e-6b27102bf21c tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:35.351305 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-de505890-1257-4c3d-a93e-6b27102bf21c tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:35.352018 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-de505890-1257-4c3d-a93e-6b27102bf21c tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:35.544541 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-45b7e681-5ac4-4327-854c-5c9bfa3fcedb tempest-QuotasAdminTestJSON-1929373289 tempest-QuotasAdminTestJSON-1929373289-project-admin] 10.222.0.43 "GET /compute/v2.1/os-quota-sets/362f6eb7c6474ed79a0a8cb4b7ad786e?user_id=3a7ae9a1a7994116868c86699c3b39e8" status: 200 len: 370 microversion: 2.1 time: 0.212302 Oct 04 21:45:35.545157 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 294/621] 10.222.0.43 () {58 vars in 1323 bytes} [Tue Oct 4 21:45:35 2022] GET /compute/v2.1/os-quota-sets/362f6eb7c6474ed79a0a8cb4b7ad786e?user_id=3a7ae9a1a7994116868c86699c3b39e8 => generated 370 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:45:35.550568 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-17a0d7d8-8996-42f2-918f-f4b877a3976e tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:35.551456 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-17a0d7d8-8996-42f2-918f-f4b877a3976e tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] [instance: caabd624-94e3-4d85-9038-2f3beeabfda9] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:35.593660 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-de505890-1257-4c3d-a93e-6b27102bf21c tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29842a669a20408b881105135f76cb0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39edf587afe94b60911198aa0bb61613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:35.606405 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-de505890-1257-4c3d-a93e-6b27102bf21c tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] 10.222.0.43 "GET /compute/v2.1/servers/f3a0dc37-502e-48d3-9537-10dd7fb15e94" status: 200 len: 1268 microversion: 2.1 time: 0.307481 Oct 04 21:45:35.609225 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 328/622] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:35 2022] GET /compute/v2.1/servers/f3a0dc37-502e-48d3-9537-10dd7fb15e94 => generated 1268 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:45:35.625535 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-0d3447e3-8a99-40ff-8dd2-cc4bae0e0896 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:45:35.650072 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-0d3447e3-8a99-40ff-8dd2-cc4bae0e0896 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: a2d1b827-a865-4d56-a665-110d0541a669] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:35.675322 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0d3447e3-8a99-40ff-8dd2-cc4bae0e0896 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:35.675835 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0d3447e3-8a99-40ff-8dd2-cc4bae0e0896 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:35.676265 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0d3447e3-8a99-40ff-8dd2-cc4bae0e0896 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:35.677240 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0d3447e3-8a99-40ff-8dd2-cc4bae0e0896 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:35.677699 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0d3447e3-8a99-40ff-8dd2-cc4bae0e0896 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:35.678164 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0d3447e3-8a99-40ff-8dd2-cc4bae0e0896 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:35.748522 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-17a0d7d8-8996-42f2-918f-f4b877a3976e tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6975d7cbd8554e06a15a8b2adc811b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94201b6c845f4334b6f4883606b0d037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:35.765965 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-17a0d7d8-8996-42f2-918f-f4b877a3976e tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] 10.222.0.43 "GET /compute/v2.1/servers/caabd624-94e3-4d85-9038-2f3beeabfda9" status: 200 len: 1221 microversion: 2.1 time: 0.212176 Oct 04 21:45:35.791063 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 295/623] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:35 2022] GET /compute/v2.1/servers/caabd624-94e3-4d85-9038-2f3beeabfda9 => generated 1221 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:45:35.797058 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-80a5bb6c-0d2d-4335-8fd2-1916a1c98343 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:35.797880 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-80a5bb6c-0d2d-4335-8fd2-1916a1c98343 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] [instance: 659208f3-1bef-41f7-9616-50c2db9f46ba] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:35.809321 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-80a5bb6c-0d2d-4335-8fd2-1916a1c98343 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:35.815572 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-80a5bb6c-0d2d-4335-8fd2-1916a1c98343 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:35.816313 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-80a5bb6c-0d2d-4335-8fd2-1916a1c98343 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:35.817399 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-80a5bb6c-0d2d-4335-8fd2-1916a1c98343 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:35.818038 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-80a5bb6c-0d2d-4335-8fd2-1916a1c98343 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:35.818678 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-80a5bb6c-0d2d-4335-8fd2-1916a1c98343 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:35.882240 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-0d3447e3-8a99-40ff-8dd2-cc4bae0e0896 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:35.892671 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-0d3447e3-8a99-40ff-8dd2-cc4bae0e0896 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: a2d1b827-a865-4d56-a665-110d0541a669] Old instance type m1.heat2, new instance type m1.heat {{(pid=134101) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 04 21:45:35.928733 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-0d3447e3-8a99-40ff-8dd2-cc4bae0e0896 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Flavor limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:45:35.929453 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-0d3447e3-8a99-40ff-8dd2-cc4bae0e0896 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Image limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:45:35.932310 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-0d3447e3-8a99-40ff-8dd2-cc4bae0e0896 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Flavor pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:45:35.933353 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-0d3447e3-8a99-40ff-8dd2-cc4bae0e0896 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Image pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:45:35.933353 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-0d3447e3-8a99-40ff-8dd2-cc4bae0e0896 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:45:36.232945 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-80a5bb6c-0d2d-4335-8fd2-1916a1c98343 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:36.239297 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-0d3447e3-8a99-40ff-8dd2-cc4bae0e0896 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "POST /compute/v2.1/servers/a2d1b827-a865-4d56-a665-110d0541a669/action" status: 202 len: 0 microversion: 2.1 time: 0.627697 Oct 04 21:45:36.243848 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-80a5bb6c-0d2d-4335-8fd2-1916a1c98343 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:36.244444 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 329/624] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 21:45:35 2022] POST /compute/v2.1/servers/a2d1b827-a865-4d56-a665-110d0541a669/action => generated 0 bytes in 634 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:45:36.248927 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-80a5bb6c-0d2d-4335-8fd2-1916a1c98343 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:36.250274 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-80a5bb6c-0d2d-4335-8fd2-1916a1c98343 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] 10.222.0.43 "GET /compute/v2.1/servers/659208f3-1bef-41f7-9616-50c2db9f46ba" status: 200 len: 1362 microversion: 2.25 time: 0.457583 Oct 04 21:45:36.251862 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 296/625] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:45:35 2022] GET /compute/v2.1/servers/659208f3-1bef-41f7-9616-50c2db9f46ba => generated 1362 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:45:36.266561 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-361bb46d-8a70-4641-8df1-be56aec6a176 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:36.266561 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-361bb46d-8a70-4641-8df1-be56aec6a176 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] [instance: 1e9957cf-cfeb-483d-bc32-73ca72a54eb9] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:36.280608 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-ca9b12b4-3f89-42f9-8a0b-e2f6fdf469b4 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:36.282738 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-ca9b12b4-3f89-42f9-8a0b-e2f6fdf469b4 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: a2d1b827-a865-4d56-a665-110d0541a669] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:36.289682 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-361bb46d-8a70-4641-8df1-be56aec6a176 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:36.290271 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-361bb46d-8a70-4641-8df1-be56aec6a176 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:36.293934 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-361bb46d-8a70-4641-8df1-be56aec6a176 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:36.294829 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-361bb46d-8a70-4641-8df1-be56aec6a176 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:36.295394 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-361bb46d-8a70-4641-8df1-be56aec6a176 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:36.295844 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-361bb46d-8a70-4641-8df1-be56aec6a176 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:36.299321 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ca9b12b4-3f89-42f9-8a0b-e2f6fdf469b4 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:36.300756 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ca9b12b4-3f89-42f9-8a0b-e2f6fdf469b4 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:36.301224 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ca9b12b4-3f89-42f9-8a0b-e2f6fdf469b4 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:36.302222 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ca9b12b4-3f89-42f9-8a0b-e2f6fdf469b4 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:36.302716 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ca9b12b4-3f89-42f9-8a0b-e2f6fdf469b4 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:36.306928 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ca9b12b4-3f89-42f9-8a0b-e2f6fdf469b4 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:36.637384 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-361bb46d-8a70-4641-8df1-be56aec6a176 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2dff38dea346219f6534426fd27ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6a5f1476ac48f3831f2ed202dacdf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:36.646490 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-361bb46d-8a70-4641-8df1-be56aec6a176 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] 10.222.0.43 "GET /compute/v2.1/servers/1e9957cf-cfeb-483d-bc32-73ca72a54eb9" status: 200 len: 1303 microversion: 2.1 time: 0.400797 Oct 04 21:45:36.658733 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 330/626] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:36 2022] GET /compute/v2.1/servers/1e9957cf-cfeb-483d-bc32-73ca72a54eb9 => generated 1303 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:45:36.664028 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-21e5f81c-8703-4cb9-8bff-73b7bdae508f tempest-QuotasAdminTestJSON-1929373289 tempest-QuotasAdminTestJSON-1929373289-project-admin] Calling method '.version_select at 0x7fbb2f8025e0>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:36.994658 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-21e5f81c-8703-4cb9-8bff-73b7bdae508f tempest-QuotasAdminTestJSON-1929373289 tempest-QuotasAdminTestJSON-1929373289-project-admin] 10.222.0.43 "GET /compute/v2.1/os-quota-sets/d4bf79d874664f4b858c334c5b585c56/defaults" status: 200 len: 371 microversion: 2.1 time: 0.334605 Oct 04 21:45:36.997113 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 331/627] 10.222.0.43 () {58 vars in 1269 bytes} [Tue Oct 4 21:45:36 2022] GET /compute/v2.1/os-quota-sets/d4bf79d874664f4b858c334c5b585c56/defaults => generated 371 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:45:37.009157 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-3f500c37-8e50-45b2-80bd-f2f950898719 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:37.013994 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-3f500c37-8e50-45b2-80bd-f2f950898719 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 10062905-54d7-47e2-b621-522e0954b72b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:37.031518 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3f500c37-8e50-45b2-80bd-f2f950898719 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:37.033281 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3f500c37-8e50-45b2-80bd-f2f950898719 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:37.033857 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3f500c37-8e50-45b2-80bd-f2f950898719 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:37.037320 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3f500c37-8e50-45b2-80bd-f2f950898719 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:37.039401 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3f500c37-8e50-45b2-80bd-f2f950898719 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:37.041017 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3f500c37-8e50-45b2-80bd-f2f950898719 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:37.101899 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-ca9b12b4-3f89-42f9-8a0b-e2f6fdf469b4 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:37.134342 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-ca9b12b4-3f89-42f9-8a0b-e2f6fdf469b4 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/a2d1b827-a865-4d56-a665-110d0541a669" status: 200 len: 1470 microversion: 2.1 time: 0.846493 Oct 04 21:45:37.137036 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 297/628] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:36 2022] GET /compute/v2.1/servers/a2d1b827-a865-4d56-a665-110d0541a669 => generated 1470 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:45:37.173444 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-ebc7b16a-5c84-4db2-8ffb-34a6e9d59ca6 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:37.174246 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-ebc7b16a-5c84-4db2-8ffb-34a6e9d59ca6 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] [instance: f3a0dc37-502e-48d3-9537-10dd7fb15e94] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:37.201535 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ebc7b16a-5c84-4db2-8ffb-34a6e9d59ca6 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:37.205498 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ebc7b16a-5c84-4db2-8ffb-34a6e9d59ca6 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:37.212159 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ebc7b16a-5c84-4db2-8ffb-34a6e9d59ca6 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:37.213319 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ebc7b16a-5c84-4db2-8ffb-34a6e9d59ca6 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:37.214098 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ebc7b16a-5c84-4db2-8ffb-34a6e9d59ca6 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:37.214910 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ebc7b16a-5c84-4db2-8ffb-34a6e9d59ca6 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:37.747216 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-ebc7b16a-5c84-4db2-8ffb-34a6e9d59ca6 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29842a669a20408b881105135f76cb0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39edf587afe94b60911198aa0bb61613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:37.763637 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-ebc7b16a-5c84-4db2-8ffb-34a6e9d59ca6 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] 10.222.0.43 "GET /compute/v2.1/servers/f3a0dc37-502e-48d3-9537-10dd7fb15e94" status: 200 len: 1274 microversion: 2.1 time: 0.617860 Oct 04 21:45:37.764621 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 298/629] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:37 2022] GET /compute/v2.1/servers/f3a0dc37-502e-48d3-9537-10dd7fb15e94 => generated 1274 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:45:37.770283 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-e48012c7-d500-472d-933e-f321f30667b9 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:37.776546 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-e48012c7-d500-472d-933e-f321f30667b9 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] [instance: caabd624-94e3-4d85-9038-2f3beeabfda9] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:37.791018 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e48012c7-d500-472d-933e-f321f30667b9 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:37.791588 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e48012c7-d500-472d-933e-f321f30667b9 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:37.792077 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e48012c7-d500-472d-933e-f321f30667b9 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:37.792882 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e48012c7-d500-472d-933e-f321f30667b9 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:37.793440 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e48012c7-d500-472d-933e-f321f30667b9 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:37.808276 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e48012c7-d500-472d-933e-f321f30667b9 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:38.623268 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-e48012c7-d500-472d-933e-f321f30667b9 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6975d7cbd8554e06a15a8b2adc811b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94201b6c845f4334b6f4883606b0d037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:38.642117 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-e48012c7-d500-472d-933e-f321f30667b9 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] 10.222.0.43 "GET /compute/v2.1/servers/caabd624-94e3-4d85-9038-2f3beeabfda9" status: 200 len: 1279 microversion: 2.1 time: 0.872687 Oct 04 21:45:38.647898 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 299/630] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:37 2022] GET /compute/v2.1/servers/caabd624-94e3-4d85-9038-2f3beeabfda9 => generated 1279 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:45:38.664462 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-b39905ee-2e4c-4c07-a8d5-d6ba359de8cd tempest-QuotasAdminTestJSON-1929373289 tempest-QuotasAdminTestJSON-1929373289-project-admin] Action: 'update', calling method: .version_select at 0x7fbb2f6fe310>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:45:38.778778 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-3f500c37-8e50-45b2-80bd-f2f950898719 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ad048becf474fb972d4291422d810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dcfc7024fc49388c4bd5f25f03e60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:38.798167 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-3f500c37-8e50-45b2-80bd-f2f950898719 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/10062905-54d7-47e2-b621-522e0954b72b" status: 200 len: 1311 microversion: 2.1 time: 1.799618 Oct 04 21:45:38.805207 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 332/631] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:36 2022] GET /compute/v2.1/servers/10062905-54d7-47e2-b621-522e0954b72b => generated 1311 bytes in 1807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:45:38.823886 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-8ba185cd-3f4d-4339-90c5-bdfdeef4506e tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:38.833771 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-8ba185cd-3f4d-4339-90c5-bdfdeef4506e tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] [instance: 659208f3-1bef-41f7-9616-50c2db9f46ba] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:38.850074 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8ba185cd-3f4d-4339-90c5-bdfdeef4506e tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:38.855460 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8ba185cd-3f4d-4339-90c5-bdfdeef4506e tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:38.856334 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8ba185cd-3f4d-4339-90c5-bdfdeef4506e tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:38.857601 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8ba185cd-3f4d-4339-90c5-bdfdeef4506e tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:38.858406 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8ba185cd-3f4d-4339-90c5-bdfdeef4506e tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:38.867518 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8ba185cd-3f4d-4339-90c5-bdfdeef4506e tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:39.114252 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b39905ee-2e4c-4c07-a8d5-d6ba359de8cd tempest-QuotasAdminTestJSON-1929373289 tempest-QuotasAdminTestJSON-1929373289-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:39.119632 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b39905ee-2e4c-4c07-a8d5-d6ba359de8cd tempest-QuotasAdminTestJSON-1929373289 tempest-QuotasAdminTestJSON-1929373289-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:39.127846 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b39905ee-2e4c-4c07-a8d5-d6ba359de8cd tempest-QuotasAdminTestJSON-1929373289 tempest-QuotasAdminTestJSON-1929373289-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:39.131858 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b39905ee-2e4c-4c07-a8d5-d6ba359de8cd tempest-QuotasAdminTestJSON-1929373289 tempest-QuotasAdminTestJSON-1929373289-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:39.135843 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b39905ee-2e4c-4c07-a8d5-d6ba359de8cd tempest-QuotasAdminTestJSON-1929373289 tempest-QuotasAdminTestJSON-1929373289-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:39.135843 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b39905ee-2e4c-4c07-a8d5-d6ba359de8cd tempest-QuotasAdminTestJSON-1929373289 tempest-QuotasAdminTestJSON-1929373289-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:39.499307 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_api:INSERT=16,nova_api:SELECT=84 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:45:39.645030 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-8ba185cd-3f4d-4339-90c5-bdfdeef4506e tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:39.666161 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-8ba185cd-3f4d-4339-90c5-bdfdeef4506e tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:39.672726 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-8ba185cd-3f4d-4339-90c5-bdfdeef4506e tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:39.678945 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-8ba185cd-3f4d-4339-90c5-bdfdeef4506e tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] 10.222.0.43 "GET /compute/v2.1/servers/659208f3-1bef-41f7-9616-50c2db9f46ba" status: 200 len: 1558 microversion: 2.25 time: 0.870498 Oct 04 21:45:39.691481 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 333/632] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:45:38 2022] GET /compute/v2.1/servers/659208f3-1bef-41f7-9616-50c2db9f46ba => generated 1558 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:45:39.697519 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-b8e0d0d4-c118-46ab-9e92-e9d5b23e759d tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:39.698302 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-b8e0d0d4-c118-46ab-9e92-e9d5b23e759d tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] [instance: 1e9957cf-cfeb-483d-bc32-73ca72a54eb9] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:39.707994 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b8e0d0d4-c118-46ab-9e92-e9d5b23e759d tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:39.712583 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b8e0d0d4-c118-46ab-9e92-e9d5b23e759d tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:39.713409 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b8e0d0d4-c118-46ab-9e92-e9d5b23e759d tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:39.726065 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b8e0d0d4-c118-46ab-9e92-e9d5b23e759d tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:39.727782 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b8e0d0d4-c118-46ab-9e92-e9d5b23e759d tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:39.735141 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b8e0d0d4-c118-46ab-9e92-e9d5b23e759d tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:39.762260 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-b39905ee-2e4c-4c07-a8d5-d6ba359de8cd tempest-QuotasAdminTestJSON-1929373289 tempest-QuotasAdminTestJSON-1929373289-project-admin] 10.222.0.43 "PUT /compute/v2.1/os-quota-sets/d4bf79d874664f4b858c334c5b585c56" status: 200 len: 329 microversion: 2.1 time: 1.112820 Oct 04 21:45:39.773899 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 300/633] 10.222.0.43 () {60 vars in 1263 bytes} [Tue Oct 4 21:45:38 2022] PUT /compute/v2.1/os-quota-sets/d4bf79d874664f4b858c334c5b585c56 => generated 329 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:45:39.777801 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-3ef0aa68-6393-4763-949f-575e22da1439 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:39.778448 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-3ef0aa68-6393-4763-949f-575e22da1439 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: a2d1b827-a865-4d56-a665-110d0541a669] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:39.800931 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3ef0aa68-6393-4763-949f-575e22da1439 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:39.801443 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3ef0aa68-6393-4763-949f-575e22da1439 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:39.804175 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3ef0aa68-6393-4763-949f-575e22da1439 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:39.805111 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3ef0aa68-6393-4763-949f-575e22da1439 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:39.807152 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3ef0aa68-6393-4763-949f-575e22da1439 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:39.807598 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3ef0aa68-6393-4763-949f-575e22da1439 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:40.234117 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-3ef0aa68-6393-4763-949f-575e22da1439 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:40.244338 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-3ef0aa68-6393-4763-949f-575e22da1439 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/a2d1b827-a865-4d56-a665-110d0541a669" status: 200 len: 1470 microversion: 2.1 time: 0.470690 Oct 04 21:45:40.244932 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 301/634] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:39 2022] GET /compute/v2.1/servers/a2d1b827-a865-4d56-a665-110d0541a669 => generated 1470 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:45:40.261609 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-b8e0d0d4-c118-46ab-9e92-e9d5b23e759d tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2dff38dea346219f6534426fd27ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6a5f1476ac48f3831f2ed202dacdf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:40.264268 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-1f538ef3-4820-4bff-ad6a-aaff51259a0a tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:40.264430 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:45:40.265577 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-1f538ef3-4820-4bff-ad6a-aaff51259a0a tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] [instance: f3a0dc37-502e-48d3-9537-10dd7fb15e94] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:40.275839 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1f538ef3-4820-4bff-ad6a-aaff51259a0a tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:40.276407 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1f538ef3-4820-4bff-ad6a-aaff51259a0a tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:40.280609 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-b8e0d0d4-c118-46ab-9e92-e9d5b23e759d tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] 10.222.0.43 "GET /compute/v2.1/servers/1e9957cf-cfeb-483d-bc32-73ca72a54eb9" status: 200 len: 1370 microversion: 2.1 time: 0.583332 Oct 04 21:45:40.281428 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1f538ef3-4820-4bff-ad6a-aaff51259a0a tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:40.282356 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1f538ef3-4820-4bff-ad6a-aaff51259a0a tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:40.283012 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1f538ef3-4820-4bff-ad6a-aaff51259a0a tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:40.283636 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1f538ef3-4820-4bff-ad6a-aaff51259a0a tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:40.302308 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 334/635] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:39 2022] GET /compute/v2.1/servers/1e9957cf-cfeb-483d-bc32-73ca72a54eb9 => generated 1370 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:45:40.311271 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-f5d3d391-f980-43bf-8e73-0d8c1abff539 req-dca9723b-0cff-4770-9ee9-b080bdd7607e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10062905-54d7-47e2-b621-522e0954b72b", "tag": "f5b5fac6-bb2d-4a99-a6db-4f032a197633"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:45:40.329421 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-f5d3d391-f980-43bf-8e73-0d8c1abff539 req-dca9723b-0cff-4770-9ee9-b080bdd7607e service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:40.330254 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-f5d3d391-f980-43bf-8e73-0d8c1abff539 req-dca9723b-0cff-4770-9ee9-b080bdd7607e service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:40.331448 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-f5d3d391-f980-43bf-8e73-0d8c1abff539 req-dca9723b-0cff-4770-9ee9-b080bdd7607e service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:40.348651 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-f5d3d391-f980-43bf-8e73-0d8c1abff539 req-dca9723b-0cff-4770-9ee9-b080bdd7607e service nova] Creating event network-changed:f5b5fac6-bb2d-4a99-a6db-4f032a197633 for instance 10062905-54d7-47e2-b621-522e0954b72b on n-h1-860284-1 Oct 04 21:45:40.358450 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-f5d3d391-f980-43bf-8e73-0d8c1abff539 req-dca9723b-0cff-4770-9ee9-b080bdd7607e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053472 Oct 04 21:45:40.361159 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 335/636] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:45:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:45:40.372457 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-54c605ee-3ec5-4d04-8c13-000010f65af5 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:40.373472 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-54c605ee-3ec5-4d04-8c13-000010f65af5 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] [instance: caabd624-94e3-4d85-9038-2f3beeabfda9] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:40.382173 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-54c605ee-3ec5-4d04-8c13-000010f65af5 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:40.383272 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-54c605ee-3ec5-4d04-8c13-000010f65af5 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:40.383685 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-54c605ee-3ec5-4d04-8c13-000010f65af5 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:40.396708 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-54c605ee-3ec5-4d04-8c13-000010f65af5 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:40.399251 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-54c605ee-3ec5-4d04-8c13-000010f65af5 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:40.400502 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-54c605ee-3ec5-4d04-8c13-000010f65af5 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:40.547731 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-54c605ee-3ec5-4d04-8c13-000010f65af5 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6975d7cbd8554e06a15a8b2adc811b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94201b6c845f4334b6f4883606b0d037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:40.568388 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-54c605ee-3ec5-4d04-8c13-000010f65af5 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] 10.222.0.43 "GET /compute/v2.1/servers/caabd624-94e3-4d85-9038-2f3beeabfda9" status: 200 len: 1279 microversion: 2.1 time: 0.205326 Oct 04 21:45:40.582619 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 336/637] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:40 2022] GET /compute/v2.1/servers/caabd624-94e3-4d85-9038-2f3beeabfda9 => generated 1279 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:45:40.612234 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-1f538ef3-4820-4bff-ad6a-aaff51259a0a tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29842a669a20408b881105135f76cb0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39edf587afe94b60911198aa0bb61613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:40.623869 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-1f538ef3-4820-4bff-ad6a-aaff51259a0a tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] 10.222.0.43 "GET /compute/v2.1/servers/f3a0dc37-502e-48d3-9537-10dd7fb15e94" status: 200 len: 1316 microversion: 2.1 time: 0.363890 Oct 04 21:45:40.625037 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 302/638] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:40 2022] GET /compute/v2.1/servers/f3a0dc37-502e-48d3-9537-10dd7fb15e94 => generated 1316 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:45:40.633976 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-64c48952-fe00-4f78-8b0f-987282a6e36b tempest-QuotasAdminTestJSON-1929373289 tempest-QuotasAdminTestJSON-1929373289-project-admin] Action: 'update', calling method: .version_select at 0x7fbb2f9fb040>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:45:40.760391 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-64c48952-fe00-4f78-8b0f-987282a6e36b tempest-QuotasAdminTestJSON-1929373289 tempest-QuotasAdminTestJSON-1929373289-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:40.763273 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-64c48952-fe00-4f78-8b0f-987282a6e36b tempest-QuotasAdminTestJSON-1929373289 tempest-QuotasAdminTestJSON-1929373289-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:40.765473 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-64c48952-fe00-4f78-8b0f-987282a6e36b tempest-QuotasAdminTestJSON-1929373289 tempest-QuotasAdminTestJSON-1929373289-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:40.768602 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-64c48952-fe00-4f78-8b0f-987282a6e36b tempest-QuotasAdminTestJSON-1929373289 tempest-QuotasAdminTestJSON-1929373289-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:40.769339 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-64c48952-fe00-4f78-8b0f-987282a6e36b tempest-QuotasAdminTestJSON-1929373289 tempest-QuotasAdminTestJSON-1929373289-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:40.769924 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-64c48952-fe00-4f78-8b0f-987282a6e36b tempest-QuotasAdminTestJSON-1929373289 tempest-QuotasAdminTestJSON-1929373289-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:40.863746 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-f880984d-fd9d-45f1-a9ae-be2ad39b7ac9 tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:40.865185 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-f880984d-fd9d-45f1-a9ae-be2ad39b7ac9 tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] [instance: 659208f3-1bef-41f7-9616-50c2db9f46ba] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:40.881983 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f880984d-fd9d-45f1-a9ae-be2ad39b7ac9 tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:40.882718 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f880984d-fd9d-45f1-a9ae-be2ad39b7ac9 tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:40.883333 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f880984d-fd9d-45f1-a9ae-be2ad39b7ac9 tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:40.887074 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f880984d-fd9d-45f1-a9ae-be2ad39b7ac9 tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:40.888082 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f880984d-fd9d-45f1-a9ae-be2ad39b7ac9 tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:40.889992 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f880984d-fd9d-45f1-a9ae-be2ad39b7ac9 tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:41.476693 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell0:SELECT=100 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:45:41.488750 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-64c48952-fe00-4f78-8b0f-987282a6e36b tempest-QuotasAdminTestJSON-1929373289 tempest-QuotasAdminTestJSON-1929373289-project-admin] 10.222.0.43 "PUT /compute/v2.1/os-quota-sets/d4bf79d874664f4b858c334c5b585c56" status: 200 len: 329 microversion: 2.1 time: 0.861872 Oct 04 21:45:41.489648 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 303/639] 10.222.0.43 () {60 vars in 1263 bytes} [Tue Oct 4 21:45:40 2022] PUT /compute/v2.1/os-quota-sets/d4bf79d874664f4b858c334c5b585c56 => generated 329 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:45:41.494591 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-eba8d583-9c60-48d6-8740-f63cc9790cd2 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:41.495309 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-eba8d583-9c60-48d6-8740-f63cc9790cd2 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 10062905-54d7-47e2-b621-522e0954b72b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:41.502649 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-eba8d583-9c60-48d6-8740-f63cc9790cd2 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:41.503213 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-eba8d583-9c60-48d6-8740-f63cc9790cd2 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:41.503739 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-eba8d583-9c60-48d6-8740-f63cc9790cd2 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:41.504562 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-eba8d583-9c60-48d6-8740-f63cc9790cd2 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:41.505087 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-eba8d583-9c60-48d6-8740-f63cc9790cd2 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:41.505577 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-eba8d583-9c60-48d6-8740-f63cc9790cd2 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:41.848628 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-eba8d583-9c60-48d6-8740-f63cc9790cd2 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ad048becf474fb972d4291422d810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dcfc7024fc49388c4bd5f25f03e60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:41.862482 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-eba8d583-9c60-48d6-8740-f63cc9790cd2 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/10062905-54d7-47e2-b621-522e0954b72b" status: 200 len: 1311 microversion: 2.1 time: 0.371723 Oct 04 21:45:41.865285 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 304/640] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:41 2022] GET /compute/v2.1/servers/10062905-54d7-47e2-b621-522e0954b72b => generated 1311 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:45:41.873071 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-24a90362-fb47-4c89-8f33-93fa71ef4dfc req-f675ed62-fadb-4995-80ec-832c8ff74a7d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e9957cf-cfeb-483d-bc32-73ca72a54eb9", "tag": "76bebc24-16b6-4425-aef8-2807d95b42ac"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:45:41.881302 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.objects.instance [None req-f880984d-fd9d-45f1-a9ae-be2ad39b7ac9 tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Lazy-loading 'services' on Instance uuid 659208f3-1bef-41f7-9616-50c2db9f46ba {{(pid=134101) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:45:41.884059 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-24a90362-fb47-4c89-8f33-93fa71ef4dfc req-f675ed62-fadb-4995-80ec-832c8ff74a7d service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:41.884649 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-24a90362-fb47-4c89-8f33-93fa71ef4dfc req-f675ed62-fadb-4995-80ec-832c8ff74a7d service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:41.885182 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-24a90362-fb47-4c89-8f33-93fa71ef4dfc req-f675ed62-fadb-4995-80ec-832c8ff74a7d service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:41.898227 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-24a90362-fb47-4c89-8f33-93fa71ef4dfc req-f675ed62-fadb-4995-80ec-832c8ff74a7d service nova] Creating event network-changed:76bebc24-16b6-4425-aef8-2807d95b42ac for instance 1e9957cf-cfeb-483d-bc32-73ca72a54eb9 on n-h1-860284-1 Oct 04 21:45:41.904421 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-24a90362-fb47-4c89-8f33-93fa71ef4dfc req-f675ed62-fadb-4995-80ec-832c8ff74a7d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036297 Oct 04 21:45:41.905375 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 305/641] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:45:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:45:41.911887 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-b530df1f-b264-47fa-a8f8-16e1ddfab73f tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:41.912702 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-b530df1f-b264-47fa-a8f8-16e1ddfab73f tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: a2d1b827-a865-4d56-a665-110d0541a669] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:41.921762 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b530df1f-b264-47fa-a8f8-16e1ddfab73f tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:41.922522 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b530df1f-b264-47fa-a8f8-16e1ddfab73f tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:41.923023 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b530df1f-b264-47fa-a8f8-16e1ddfab73f tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:41.924249 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b530df1f-b264-47fa-a8f8-16e1ddfab73f tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:41.924774 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b530df1f-b264-47fa-a8f8-16e1ddfab73f tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:41.925261 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b530df1f-b264-47fa-a8f8-16e1ddfab73f tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:41.957142 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-f880984d-fd9d-45f1-a9ae-be2ad39b7ac9 tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/659208f3-1bef-41f7-9616-50c2db9f46ba" status: 200 len: 2051 microversion: 2.25 time: 1.385511 Oct 04 21:45:41.958426 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 337/642] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:45:40 2022] GET /compute/v2.1/servers/659208f3-1bef-41f7-9616-50c2db9f46ba => generated 2051 bytes in 1388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:45:41.963740 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e293a176-63e4-445d-9822-d339c5067638 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:41.964617 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-e293a176-63e4-445d-9822-d339c5067638 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] [instance: 1e9957cf-cfeb-483d-bc32-73ca72a54eb9] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:41.971182 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e293a176-63e4-445d-9822-d339c5067638 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:41.971909 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e293a176-63e4-445d-9822-d339c5067638 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:41.972563 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e293a176-63e4-445d-9822-d339c5067638 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:41.973478 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e293a176-63e4-445d-9822-d339c5067638 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:41.974128 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e293a176-63e4-445d-9822-d339c5067638 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:41.974785 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e293a176-63e4-445d-9822-d339c5067638 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:42.311580 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-e293a176-63e4-445d-9822-d339c5067638 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2dff38dea346219f6534426fd27ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6a5f1476ac48f3831f2ed202dacdf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:42.320772 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-e293a176-63e4-445d-9822-d339c5067638 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] 10.222.0.43 "GET /compute/v2.1/servers/1e9957cf-cfeb-483d-bc32-73ca72a54eb9" status: 200 len: 1370 microversion: 2.1 time: 0.361000 Oct 04 21:45:42.325600 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 338/643] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:41 2022] GET /compute/v2.1/servers/1e9957cf-cfeb-483d-bc32-73ca72a54eb9 => generated 1370 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:45:42.343335 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-685512a8-e542-469e-9c4c-ce31bfe3fd5d tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:42.344270 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-685512a8-e542-469e-9c4c-ce31bfe3fd5d tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] [instance: caabd624-94e3-4d85-9038-2f3beeabfda9] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:42.356147 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-685512a8-e542-469e-9c4c-ce31bfe3fd5d tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:42.356967 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-685512a8-e542-469e-9c4c-ce31bfe3fd5d tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:42.357609 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-685512a8-e542-469e-9c4c-ce31bfe3fd5d tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:42.358560 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-685512a8-e542-469e-9c4c-ce31bfe3fd5d tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:42.359387 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-685512a8-e542-469e-9c4c-ce31bfe3fd5d tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:42.359817 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-685512a8-e542-469e-9c4c-ce31bfe3fd5d tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:42.366526 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-b530df1f-b264-47fa-a8f8-16e1ddfab73f tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:42.377098 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-b530df1f-b264-47fa-a8f8-16e1ddfab73f tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/a2d1b827-a865-4d56-a665-110d0541a669" status: 200 len: 1470 microversion: 2.1 time: 0.470387 Oct 04 21:45:42.379099 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 306/644] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:41 2022] GET /compute/v2.1/servers/a2d1b827-a865-4d56-a665-110d0541a669 => generated 1470 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:45:42.406830 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-6195bb0c-e0bf-4511-a0cc-887d6c15f8fc tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:42.407839 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-6195bb0c-e0bf-4511-a0cc-887d6c15f8fc tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] [instance: f3a0dc37-502e-48d3-9537-10dd7fb15e94] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:42.424259 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6195bb0c-e0bf-4511-a0cc-887d6c15f8fc tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:42.427791 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6195bb0c-e0bf-4511-a0cc-887d6c15f8fc tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:42.432781 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6195bb0c-e0bf-4511-a0cc-887d6c15f8fc tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:42.434024 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6195bb0c-e0bf-4511-a0cc-887d6c15f8fc tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:42.434875 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6195bb0c-e0bf-4511-a0cc-887d6c15f8fc tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:42.435497 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6195bb0c-e0bf-4511-a0cc-887d6c15f8fc tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:42.747895 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-685512a8-e542-469e-9c4c-ce31bfe3fd5d tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6975d7cbd8554e06a15a8b2adc811b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94201b6c845f4334b6f4883606b0d037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:42.756887 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-685512a8-e542-469e-9c4c-ce31bfe3fd5d tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] 10.222.0.43 "GET /compute/v2.1/servers/caabd624-94e3-4d85-9038-2f3beeabfda9" status: 200 len: 1321 microversion: 2.1 time: 0.429969 Oct 04 21:45:42.757477 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 339/645] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:42 2022] GET /compute/v2.1/servers/caabd624-94e3-4d85-9038-2f3beeabfda9 => generated 1321 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:45:42.770074 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-0470cdac-1f5c-4da6-9a0e-ee0f2c13f11c tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:42.771462 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-0470cdac-1f5c-4da6-9a0e-ee0f2c13f11c tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] [instance: 659208f3-1bef-41f7-9616-50c2db9f46ba] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:42.783818 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0470cdac-1f5c-4da6-9a0e-ee0f2c13f11c tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:42.784456 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0470cdac-1f5c-4da6-9a0e-ee0f2c13f11c tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:42.785202 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0470cdac-1f5c-4da6-9a0e-ee0f2c13f11c tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:42.786305 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0470cdac-1f5c-4da6-9a0e-ee0f2c13f11c tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:42.786611 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0470cdac-1f5c-4da6-9a0e-ee0f2c13f11c tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:42.787108 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0470cdac-1f5c-4da6-9a0e-ee0f2c13f11c tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:42.816228 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-6195bb0c-e0bf-4511-a0cc-887d6c15f8fc tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29842a669a20408b881105135f76cb0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39edf587afe94b60911198aa0bb61613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:42.839595 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-6195bb0c-e0bf-4511-a0cc-887d6c15f8fc tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] 10.222.0.43 "GET /compute/v2.1/servers/f3a0dc37-502e-48d3-9537-10dd7fb15e94" status: 200 len: 1316 microversion: 2.1 time: 0.456785 Oct 04 21:45:42.840230 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 307/646] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:42 2022] GET /compute/v2.1/servers/f3a0dc37-502e-48d3-9537-10dd7fb15e94 => generated 1316 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:45:42.868527 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-467e72c3-38c6-4997-befb-7d4a8c5414b1 req-69c3941f-7002-404c-a38b-46fccecb61c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "caabd624-94e3-4d85-9038-2f3beeabfda9", "tag": "d9f07922-9bf0-42e8-b7a2-a88c1c73314c"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:45:42.893796 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-467e72c3-38c6-4997-befb-7d4a8c5414b1 req-69c3941f-7002-404c-a38b-46fccecb61c4 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:42.894283 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-467e72c3-38c6-4997-befb-7d4a8c5414b1 req-69c3941f-7002-404c-a38b-46fccecb61c4 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:42.894747 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-467e72c3-38c6-4997-befb-7d4a8c5414b1 req-69c3941f-7002-404c-a38b-46fccecb61c4 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:42.943232 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=100 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:45:42.950215 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-467e72c3-38c6-4997-befb-7d4a8c5414b1 req-69c3941f-7002-404c-a38b-46fccecb61c4 service nova] Creating event network-changed:d9f07922-9bf0-42e8-b7a2-a88c1c73314c for instance caabd624-94e3-4d85-9038-2f3beeabfda9 on n-h2-860284-1 Oct 04 21:45:42.958161 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-467e72c3-38c6-4997-befb-7d4a8c5414b1 req-69c3941f-7002-404c-a38b-46fccecb61c4 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096575 Oct 04 21:45:42.959152 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 308/647] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:45:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:45:42.978666 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-3fe1ca1e-1a48-41dc-a173-99a382e96233 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:42.979739 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-3fe1ca1e-1a48-41dc-a173-99a382e96233 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 10062905-54d7-47e2-b621-522e0954b72b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:42.991511 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_api:INSERT=21,nova_api:SELECT=65,nova_api:UPDATE=14 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:45:42.995636 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3fe1ca1e-1a48-41dc-a173-99a382e96233 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:42.998119 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3fe1ca1e-1a48-41dc-a173-99a382e96233 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:43.001398 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3fe1ca1e-1a48-41dc-a173-99a382e96233 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:43.004420 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3fe1ca1e-1a48-41dc-a173-99a382e96233 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:43.004902 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3fe1ca1e-1a48-41dc-a173-99a382e96233 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:43.005333 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3fe1ca1e-1a48-41dc-a173-99a382e96233 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:43.113280 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.objects.instance [None req-0470cdac-1f5c-4da6-9a0e-ee0f2c13f11c tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Lazy-loading 'services' on Instance uuid 659208f3-1bef-41f7-9616-50c2db9f46ba {{(pid=134101) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:45:43.146127 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-0470cdac-1f5c-4da6-9a0e-ee0f2c13f11c tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/659208f3-1bef-41f7-9616-50c2db9f46ba" status: 200 len: 2051 microversion: 2.25 time: 0.387571 Oct 04 21:45:43.151145 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 340/648] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:45:42 2022] GET /compute/v2.1/servers/659208f3-1bef-41f7-9616-50c2db9f46ba => generated 2051 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:45:43.180830 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-b9f5c18e-2fc4-4f14-b4f9-b4e872c42b2b tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:43.184882 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b9f5c18e-2fc4-4f14-b4f9-b4e872c42b2b tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:43.194431 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b9f5c18e-2fc4-4f14-b4f9-b4e872c42b2b tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:43.195059 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b9f5c18e-2fc4-4f14-b4f9-b4e872c42b2b tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:43.196320 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b9f5c18e-2fc4-4f14-b4f9-b4e872c42b2b tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:43.197027 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b9f5c18e-2fc4-4f14-b4f9-b4e872c42b2b tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:43.197700 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b9f5c18e-2fc4-4f14-b4f9-b4e872c42b2b tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:43.252038 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-b9f5c18e-2fc4-4f14-b4f9-b4e872c42b2b tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] 10.222.0.43 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.075887 Oct 04 21:45:43.257980 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 341/649] 10.222.0.43 () {60 vars in 1217 bytes} [Tue Oct 4 21:45:43 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 21:45:43.276443 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-82575956-b387-402a-854a-f83a96624dc9 tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-860284-1", "block_migration": "auto"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:45:43.280656 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-82575956-b387-402a-854a-f83a96624dc9 tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] [instance: 659208f3-1bef-41f7-9616-50c2db9f46ba] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:43.287516 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-82575956-b387-402a-854a-f83a96624dc9 tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:43.288782 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-82575956-b387-402a-854a-f83a96624dc9 tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:43.289412 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-82575956-b387-402a-854a-f83a96624dc9 tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:43.290295 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-82575956-b387-402a-854a-f83a96624dc9 tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:43.290942 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-82575956-b387-402a-854a-f83a96624dc9 tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:43.291893 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-82575956-b387-402a-854a-f83a96624dc9 tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:43.364386 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-3fe1ca1e-1a48-41dc-a173-99a382e96233 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ad048becf474fb972d4291422d810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dcfc7024fc49388c4bd5f25f03e60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:43.374125 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-3fe1ca1e-1a48-41dc-a173-99a382e96233 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/10062905-54d7-47e2-b621-522e0954b72b" status: 200 len: 1311 microversion: 2.1 time: 0.402852 Oct 04 21:45:43.390326 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.objects.instance [None req-82575956-b387-402a-854a-f83a96624dc9 tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Lazy-loading 'flavor' on Instance uuid 659208f3-1bef-41f7-9616-50c2db9f46ba {{(pid=134101) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:45:43.392284 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 309/650] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:42 2022] GET /compute/v2.1/servers/10062905-54d7-47e2-b621-522e0954b72b => generated 1311 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:45:43.401185 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-058e3db6-5aed-4d0b-a07e-77bdea1859ee tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:43.402086 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-058e3db6-5aed-4d0b-a07e-77bdea1859ee tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] [instance: 1e9957cf-cfeb-483d-bc32-73ca72a54eb9] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:43.418871 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-058e3db6-5aed-4d0b-a07e-77bdea1859ee tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:43.419628 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-058e3db6-5aed-4d0b-a07e-77bdea1859ee tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:43.420266 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-058e3db6-5aed-4d0b-a07e-77bdea1859ee tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:43.421189 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-058e3db6-5aed-4d0b-a07e-77bdea1859ee tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:43.421967 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-058e3db6-5aed-4d0b-a07e-77bdea1859ee tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:43.422616 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-058e3db6-5aed-4d0b-a07e-77bdea1859ee tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:43.483856 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-82575956-b387-402a-854a-f83a96624dc9 tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] [instance: 659208f3-1bef-41f7-9616-50c2db9f46ba] Going to try to live migrate instance to n-h1-860284-1 {{(pid=134101) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 04 21:45:43.837595 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-058e3db6-5aed-4d0b-a07e-77bdea1859ee tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2dff38dea346219f6534426fd27ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6a5f1476ac48f3831f2ed202dacdf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:43.869177 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-058e3db6-5aed-4d0b-a07e-77bdea1859ee tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] 10.222.0.43 "GET /compute/v2.1/servers/1e9957cf-cfeb-483d-bc32-73ca72a54eb9" status: 200 len: 1370 microversion: 2.1 time: 0.473513 Oct 04 21:45:43.887609 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 310/651] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:43 2022] GET /compute/v2.1/servers/1e9957cf-cfeb-483d-bc32-73ca72a54eb9 => generated 1370 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:45:43.892569 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-33de3e6a-b5a8-4667-b012-438bc346296f tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:43.893365 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-33de3e6a-b5a8-4667-b012-438bc346296f tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: a2d1b827-a865-4d56-a665-110d0541a669] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:43.900606 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-33de3e6a-b5a8-4667-b012-438bc346296f tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:43.901124 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-33de3e6a-b5a8-4667-b012-438bc346296f tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:43.902171 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-33de3e6a-b5a8-4667-b012-438bc346296f tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:43.903916 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-33de3e6a-b5a8-4667-b012-438bc346296f tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:43.906053 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-33de3e6a-b5a8-4667-b012-438bc346296f tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:43.907316 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-33de3e6a-b5a8-4667-b012-438bc346296f tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:44.196248 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-33de3e6a-b5a8-4667-b012-438bc346296f tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:44.206926 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-33de3e6a-b5a8-4667-b012-438bc346296f tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/a2d1b827-a865-4d56-a665-110d0541a669" status: 200 len: 1470 microversion: 2.1 time: 0.318078 Oct 04 21:45:44.207995 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 311/652] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:43 2022] GET /compute/v2.1/servers/a2d1b827-a865-4d56-a665-110d0541a669 => generated 1470 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:45:44.219154 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-da94ce6e-9db3-4383-8633-78064d6f9c3c tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:44.221752 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-da94ce6e-9db3-4383-8633-78064d6f9c3c tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] [instance: caabd624-94e3-4d85-9038-2f3beeabfda9] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:44.231639 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-da94ce6e-9db3-4383-8633-78064d6f9c3c tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:44.232214 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-da94ce6e-9db3-4383-8633-78064d6f9c3c tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:44.232733 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-da94ce6e-9db3-4383-8633-78064d6f9c3c tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:44.233517 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-da94ce6e-9db3-4383-8633-78064d6f9c3c tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:44.233978 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-da94ce6e-9db3-4383-8633-78064d6f9c3c tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:44.234434 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-da94ce6e-9db3-4383-8633-78064d6f9c3c tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:44.490406 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-da94ce6e-9db3-4383-8633-78064d6f9c3c tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6975d7cbd8554e06a15a8b2adc811b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94201b6c845f4334b6f4883606b0d037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:44.503975 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-da94ce6e-9db3-4383-8633-78064d6f9c3c tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] 10.222.0.43 "GET /compute/v2.1/servers/caabd624-94e3-4d85-9038-2f3beeabfda9" status: 200 len: 1321 microversion: 2.1 time: 0.294693 Oct 04 21:45:44.505814 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 312/653] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:44 2022] GET /compute/v2.1/servers/caabd624-94e3-4d85-9038-2f3beeabfda9 => generated 1321 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:45:44.512362 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-b9f0b945-7e74-4b34-9f55-310c8d818039 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:44.513825 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-b9f0b945-7e74-4b34-9f55-310c8d818039 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] [instance: f3a0dc37-502e-48d3-9537-10dd7fb15e94] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:44.521376 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b9f0b945-7e74-4b34-9f55-310c8d818039 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:44.522965 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b9f0b945-7e74-4b34-9f55-310c8d818039 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:44.523627 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b9f0b945-7e74-4b34-9f55-310c8d818039 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:44.524741 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b9f0b945-7e74-4b34-9f55-310c8d818039 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:44.525424 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b9f0b945-7e74-4b34-9f55-310c8d818039 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:44.526102 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b9f0b945-7e74-4b34-9f55-310c8d818039 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:44.706916 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-b9f0b945-7e74-4b34-9f55-310c8d818039 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29842a669a20408b881105135f76cb0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39edf587afe94b60911198aa0bb61613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:44.717207 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-b9f0b945-7e74-4b34-9f55-310c8d818039 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] 10.222.0.43 "GET /compute/v2.1/servers/f3a0dc37-502e-48d3-9537-10dd7fb15e94" status: 200 len: 1316 microversion: 2.1 time: 0.209321 Oct 04 21:45:44.734537 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 313/654] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:44 2022] GET /compute/v2.1/servers/f3a0dc37-502e-48d3-9537-10dd7fb15e94 => generated 1316 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:45:44.743749 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-82183e4c-4b4f-4afb-97f8-a339d8de40e3 req-9b378523-3650-46f5-ad3f-431bb9e5af5c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3a0dc37-502e-48d3-9537-10dd7fb15e94", "tag": "5b7ac8fb-dad6-4cfb-b728-11e125a3df78"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:45:44.754867 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-82183e4c-4b4f-4afb-97f8-a339d8de40e3 req-9b378523-3650-46f5-ad3f-431bb9e5af5c service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:44.755507 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-82183e4c-4b4f-4afb-97f8-a339d8de40e3 req-9b378523-3650-46f5-ad3f-431bb9e5af5c service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:44.755945 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-82183e4c-4b4f-4afb-97f8-a339d8de40e3 req-9b378523-3650-46f5-ad3f-431bb9e5af5c service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:44.768588 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-82183e4c-4b4f-4afb-97f8-a339d8de40e3 req-9b378523-3650-46f5-ad3f-431bb9e5af5c service nova] Creating event network-changed:5b7ac8fb-dad6-4cfb-b728-11e125a3df78 for instance f3a0dc37-502e-48d3-9537-10dd7fb15e94 on n-h1-860284-1 Oct 04 21:45:44.785342 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-82183e4c-4b4f-4afb-97f8-a339d8de40e3 req-9b378523-3650-46f5-ad3f-431bb9e5af5c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049125 Oct 04 21:45:44.794695 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 314/655] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:45:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:45:44.805990 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-0d74486a-bcc8-4e12-9097-6d5192b9977e tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:44.806747 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-0d74486a-bcc8-4e12-9097-6d5192b9977e tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 10062905-54d7-47e2-b621-522e0954b72b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:44.813736 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0d74486a-bcc8-4e12-9097-6d5192b9977e tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:44.814230 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0d74486a-bcc8-4e12-9097-6d5192b9977e tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:44.814723 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0d74486a-bcc8-4e12-9097-6d5192b9977e tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:44.815486 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0d74486a-bcc8-4e12-9097-6d5192b9977e tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:44.815885 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0d74486a-bcc8-4e12-9097-6d5192b9977e tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:44.816309 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0d74486a-bcc8-4e12-9097-6d5192b9977e tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:44.854703 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=40 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:45:44.995807 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-0d74486a-bcc8-4e12-9097-6d5192b9977e tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ad048becf474fb972d4291422d810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dcfc7024fc49388c4bd5f25f03e60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:45.004323 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-0d74486a-bcc8-4e12-9097-6d5192b9977e tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/10062905-54d7-47e2-b621-522e0954b72b" status: 200 len: 1311 microversion: 2.1 time: 0.208103 Oct 04 21:45:45.005194 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 315/656] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:44 2022] GET /compute/v2.1/servers/10062905-54d7-47e2-b621-522e0954b72b => generated 1311 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:45:45.010763 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-593f5df3-86fb-48ed-93d3-b34e17859d7a tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:45.011482 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-593f5df3-86fb-48ed-93d3-b34e17859d7a tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] [instance: 1e9957cf-cfeb-483d-bc32-73ca72a54eb9] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:45.017823 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-593f5df3-86fb-48ed-93d3-b34e17859d7a tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:45.018324 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-593f5df3-86fb-48ed-93d3-b34e17859d7a tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:45.021615 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-593f5df3-86fb-48ed-93d3-b34e17859d7a tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:45.021615 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-593f5df3-86fb-48ed-93d3-b34e17859d7a tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:45.021615 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-593f5df3-86fb-48ed-93d3-b34e17859d7a tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:45.021615 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-593f5df3-86fb-48ed-93d3-b34e17859d7a tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:45.184048 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-593f5df3-86fb-48ed-93d3-b34e17859d7a tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2dff38dea346219f6534426fd27ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6a5f1476ac48f3831f2ed202dacdf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:45.194459 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-593f5df3-86fb-48ed-93d3-b34e17859d7a tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] 10.222.0.43 "GET /compute/v2.1/servers/1e9957cf-cfeb-483d-bc32-73ca72a54eb9" status: 200 len: 1370 microversion: 2.1 time: 0.187635 Oct 04 21:45:45.211730 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 316/657] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:45 2022] GET /compute/v2.1/servers/1e9957cf-cfeb-483d-bc32-73ca72a54eb9 => generated 1370 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:45:45.240451 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-f2646df0-d1eb-44d4-a4cc-cc7f53327a69 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:45.242144 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-f2646df0-d1eb-44d4-a4cc-cc7f53327a69 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: a2d1b827-a865-4d56-a665-110d0541a669] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:45.254105 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f2646df0-d1eb-44d4-a4cc-cc7f53327a69 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:45.254680 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f2646df0-d1eb-44d4-a4cc-cc7f53327a69 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:45.255111 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f2646df0-d1eb-44d4-a4cc-cc7f53327a69 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:45.255825 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f2646df0-d1eb-44d4-a4cc-cc7f53327a69 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:45.257134 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f2646df0-d1eb-44d4-a4cc-cc7f53327a69 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:45.257134 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f2646df0-d1eb-44d4-a4cc-cc7f53327a69 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:45.407275 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-f2646df0-d1eb-44d4-a4cc-cc7f53327a69 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:45.416114 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-f2646df0-d1eb-44d4-a4cc-cc7f53327a69 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/a2d1b827-a865-4d56-a665-110d0541a669" status: 200 len: 1470 microversion: 2.1 time: 0.187436 Oct 04 21:45:45.416718 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 317/658] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:45 2022] GET /compute/v2.1/servers/a2d1b827-a865-4d56-a665-110d0541a669 => generated 1470 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:45:45.532641 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-4c265f52-5ca4-4d8a-9f01-564b96255a52 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:45.533344 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-4c265f52-5ca4-4d8a-9f01-564b96255a52 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] [instance: caabd624-94e3-4d85-9038-2f3beeabfda9] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:45.540439 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4c265f52-5ca4-4d8a-9f01-564b96255a52 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:45.541257 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4c265f52-5ca4-4d8a-9f01-564b96255a52 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:45.541929 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4c265f52-5ca4-4d8a-9f01-564b96255a52 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:45.542721 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4c265f52-5ca4-4d8a-9f01-564b96255a52 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:45.543337 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4c265f52-5ca4-4d8a-9f01-564b96255a52 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:45.543946 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4c265f52-5ca4-4d8a-9f01-564b96255a52 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:45.697097 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-4c265f52-5ca4-4d8a-9f01-564b96255a52 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6975d7cbd8554e06a15a8b2adc811b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94201b6c845f4334b6f4883606b0d037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:45.706470 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-4c265f52-5ca4-4d8a-9f01-564b96255a52 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] 10.222.0.43 "GET /compute/v2.1/servers/caabd624-94e3-4d85-9038-2f3beeabfda9" status: 200 len: 1321 microversion: 2.1 time: 0.178823 Oct 04 21:45:45.716333 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 318/659] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:45 2022] GET /compute/v2.1/servers/caabd624-94e3-4d85-9038-2f3beeabfda9 => generated 1321 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:45:45.746033 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-8ae4fe13-36c8-40f6-969b-06a7a9545da3 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:45.746678 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-8ae4fe13-36c8-40f6-969b-06a7a9545da3 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] [instance: f3a0dc37-502e-48d3-9537-10dd7fb15e94] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:45.758660 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8ae4fe13-36c8-40f6-969b-06a7a9545da3 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:45.759260 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8ae4fe13-36c8-40f6-969b-06a7a9545da3 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:45.759700 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8ae4fe13-36c8-40f6-969b-06a7a9545da3 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:45.760459 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8ae4fe13-36c8-40f6-969b-06a7a9545da3 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:45.760918 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8ae4fe13-36c8-40f6-969b-06a7a9545da3 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:45.761430 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8ae4fe13-36c8-40f6-969b-06a7a9545da3 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:45.956845 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-8ae4fe13-36c8-40f6-969b-06a7a9545da3 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29842a669a20408b881105135f76cb0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39edf587afe94b60911198aa0bb61613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:45.970116 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-8ae4fe13-36c8-40f6-969b-06a7a9545da3 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] 10.222.0.43 "GET /compute/v2.1/servers/f3a0dc37-502e-48d3-9537-10dd7fb15e94" status: 200 len: 1316 microversion: 2.1 time: 0.228432 Oct 04 21:45:45.970758 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 319/660] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:45 2022] GET /compute/v2.1/servers/f3a0dc37-502e-48d3-9537-10dd7fb15e94 => generated 1316 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:45:46.169361 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-f2b8d499-68b8-4553-8a8a-0f073411580a tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1016914737", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452"}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:45:46.245346 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.network.neutron [None req-f2b8d499-68b8-4553-8a8a-0f073411580a tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] validate_networks() for None {{(pid=134102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:45:46.809287 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-f2b8d499-68b8-4553-8a8a-0f073411580a tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Flavor limits 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:45:46.809724 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-f2b8d499-68b8-4553-8a8a-0f073411580a tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Image limits 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:45:46.810202 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-f2b8d499-68b8-4553-8a8a-0f073411580a tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Flavor pref 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:45:46.810649 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-f2b8d499-68b8-4553-8a8a-0f073411580a tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Image pref 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:45:46.811067 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-f2b8d499-68b8-4553-8a8a-0f073411580a tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:45:46.819988 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f2b8d499-68b8-4553-8a8a-0f073411580a tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:46.820472 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f2b8d499-68b8-4553-8a8a-0f073411580a tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:46.820913 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f2b8d499-68b8-4553-8a8a-0f073411580a tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:46.821677 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f2b8d499-68b8-4553-8a8a-0f073411580a tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:46.822137 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f2b8d499-68b8-4553-8a8a-0f073411580a tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:46.822597 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f2b8d499-68b8-4553-8a8a-0f073411580a tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:46.840181 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-f2b8d499-68b8-4553-8a8a-0f073411580a tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Getting quotas for project a1e3bf9149434d34b6762aaeef1478ed. Resources: {'instances', 'ram', 'cores'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:45:46.845583 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-f2b8d499-68b8-4553-8a8a-0f073411580a tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Getting quotas for user 87616cd16995468ab7febf5aa4b284db and project a1e3bf9149434d34b6762aaeef1478ed. Resources: {'instances', 'ram', 'cores'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:45:46.858827 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-f2b8d499-68b8-4553-8a8a-0f073411580a tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Going to run 1 instances... {{(pid=134102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:45:46.861178 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-f2b8d499-68b8-4553-8a8a-0f073411580a tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] [instance: e3380b36-6aba-4736-bcbc-f0058f806d55] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='58548514-5dac-426c-81f5-19e3fba33e23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:45:46.915242 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-f2b8d499-68b8-4553-8a8a-0f073411580a tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.892150 Oct 04 21:45:46.932021 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 320/661] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 21:45:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 894 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 21:45:46.932021 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-91898339-992f-4c9f-8293-98fa1825f92e tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:46.932021 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-91898339-992f-4c9f-8293-98fa1825f92e tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 10062905-54d7-47e2-b621-522e0954b72b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:46.940744 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-91898339-992f-4c9f-8293-98fa1825f92e tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:46.941428 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-91898339-992f-4c9f-8293-98fa1825f92e tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:46.941957 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-91898339-992f-4c9f-8293-98fa1825f92e tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:46.944302 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-91898339-992f-4c9f-8293-98fa1825f92e tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:46.945434 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-91898339-992f-4c9f-8293-98fa1825f92e tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:46.946058 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-91898339-992f-4c9f-8293-98fa1825f92e tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:47.179341 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-91898339-992f-4c9f-8293-98fa1825f92e tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ad048becf474fb972d4291422d810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dcfc7024fc49388c4bd5f25f03e60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:47.187371 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-91898339-992f-4c9f-8293-98fa1825f92e tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/10062905-54d7-47e2-b621-522e0954b72b" status: 200 len: 1311 microversion: 2.1 time: 0.270107 Oct 04 21:45:47.188195 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 321/662] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:46 2022] GET /compute/v2.1/servers/10062905-54d7-47e2-b621-522e0954b72b => generated 1311 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:45:47.202645 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-3b90c153-89b1-41da-bd2c-59bb7febe691 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:47.203274 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-3b90c153-89b1-41da-bd2c-59bb7febe691 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] [instance: 1e9957cf-cfeb-483d-bc32-73ca72a54eb9] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:47.209491 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3b90c153-89b1-41da-bd2c-59bb7febe691 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:47.210235 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3b90c153-89b1-41da-bd2c-59bb7febe691 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:47.210726 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3b90c153-89b1-41da-bd2c-59bb7febe691 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:47.211527 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3b90c153-89b1-41da-bd2c-59bb7febe691 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:47.212398 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3b90c153-89b1-41da-bd2c-59bb7febe691 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:47.212398 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3b90c153-89b1-41da-bd2c-59bb7febe691 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:47.347449 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-3b90c153-89b1-41da-bd2c-59bb7febe691 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2dff38dea346219f6534426fd27ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6a5f1476ac48f3831f2ed202dacdf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:47.355586 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-3b90c153-89b1-41da-bd2c-59bb7febe691 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] 10.222.0.43 "GET /compute/v2.1/servers/1e9957cf-cfeb-483d-bc32-73ca72a54eb9" status: 200 len: 1370 microversion: 2.1 time: 0.159863 Oct 04 21:45:47.356208 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 322/663] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:47 2022] GET /compute/v2.1/servers/1e9957cf-cfeb-483d-bc32-73ca72a54eb9 => generated 1370 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:45:47.360739 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-d2076fa4-9574-4584-a918-689c11fabeeb tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:47.361367 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-d2076fa4-9574-4584-a918-689c11fabeeb tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: a2d1b827-a865-4d56-a665-110d0541a669] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:47.367805 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d2076fa4-9574-4584-a918-689c11fabeeb tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:47.368289 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d2076fa4-9574-4584-a918-689c11fabeeb tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:47.368721 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d2076fa4-9574-4584-a918-689c11fabeeb tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:47.369411 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d2076fa4-9574-4584-a918-689c11fabeeb tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:47.369871 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d2076fa4-9574-4584-a918-689c11fabeeb tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:47.370295 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d2076fa4-9574-4584-a918-689c11fabeeb tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:47.510616 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-d2076fa4-9574-4584-a918-689c11fabeeb tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:47.518641 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-d2076fa4-9574-4584-a918-689c11fabeeb tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/a2d1b827-a865-4d56-a665-110d0541a669" status: 200 len: 1470 microversion: 2.1 time: 0.161369 Oct 04 21:45:47.519237 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 323/664] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:47 2022] GET /compute/v2.1/servers/a2d1b827-a865-4d56-a665-110d0541a669 => generated 1470 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:45:47.525097 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-46a28e4c-c9d5-4ff3-a6d6-ab03986323cd tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:47.526024 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-46a28e4c-c9d5-4ff3-a6d6-ab03986323cd tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] [instance: caabd624-94e3-4d85-9038-2f3beeabfda9] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:47.532384 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-46a28e4c-c9d5-4ff3-a6d6-ab03986323cd tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:47.532899 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-46a28e4c-c9d5-4ff3-a6d6-ab03986323cd tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:47.533382 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-46a28e4c-c9d5-4ff3-a6d6-ab03986323cd tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:47.534077 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-46a28e4c-c9d5-4ff3-a6d6-ab03986323cd tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:47.534567 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-46a28e4c-c9d5-4ff3-a6d6-ab03986323cd tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:47.534986 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-46a28e4c-c9d5-4ff3-a6d6-ab03986323cd tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:47.677623 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-46a28e4c-c9d5-4ff3-a6d6-ab03986323cd tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6975d7cbd8554e06a15a8b2adc811b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94201b6c845f4334b6f4883606b0d037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:47.686730 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-46a28e4c-c9d5-4ff3-a6d6-ab03986323cd tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] 10.222.0.43 "GET /compute/v2.1/servers/caabd624-94e3-4d85-9038-2f3beeabfda9" status: 200 len: 1321 microversion: 2.1 time: 0.166411 Oct 04 21:45:47.687360 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 324/665] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:47 2022] GET /compute/v2.1/servers/caabd624-94e3-4d85-9038-2f3beeabfda9 => generated 1321 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:45:47.692218 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-8a053691-a073-4f52-be70-fd31dbb2ab93 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:47.693101 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-8a053691-a073-4f52-be70-fd31dbb2ab93 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] [instance: f3a0dc37-502e-48d3-9537-10dd7fb15e94] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:47.700165 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8a053691-a073-4f52-be70-fd31dbb2ab93 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:47.700660 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8a053691-a073-4f52-be70-fd31dbb2ab93 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:47.701132 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8a053691-a073-4f52-be70-fd31dbb2ab93 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:47.702122 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8a053691-a073-4f52-be70-fd31dbb2ab93 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:47.709376 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8a053691-a073-4f52-be70-fd31dbb2ab93 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:47.709376 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8a053691-a073-4f52-be70-fd31dbb2ab93 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:47.842027 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-8a053691-a073-4f52-be70-fd31dbb2ab93 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29842a669a20408b881105135f76cb0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39edf587afe94b60911198aa0bb61613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:47.850556 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-8a053691-a073-4f52-be70-fd31dbb2ab93 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] 10.222.0.43 "GET /compute/v2.1/servers/f3a0dc37-502e-48d3-9537-10dd7fb15e94" status: 200 len: 1316 microversion: 2.1 time: 0.161585 Oct 04 21:45:47.851507 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 325/666] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:47 2022] GET /compute/v2.1/servers/f3a0dc37-502e-48d3-9537-10dd7fb15e94 => generated 1316 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:45:47.856419 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-50c56995-aebf-4774-ad77-c79ce25ebc79 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1959555704", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452"}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:45:47.911428 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.network.neutron [None req-50c56995-aebf-4774-ad77-c79ce25ebc79 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] validate_networks() for None {{(pid=134102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:45:48.102991 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-50c56995-aebf-4774-ad77-c79ce25ebc79 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Flavor limits 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:45:48.103419 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-50c56995-aebf-4774-ad77-c79ce25ebc79 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Image limits 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:45:48.103895 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-50c56995-aebf-4774-ad77-c79ce25ebc79 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Flavor pref 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:45:48.104307 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-50c56995-aebf-4774-ad77-c79ce25ebc79 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Image pref 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:45:48.104719 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-50c56995-aebf-4774-ad77-c79ce25ebc79 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:45:48.113299 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-50c56995-aebf-4774-ad77-c79ce25ebc79 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:48.113779 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-50c56995-aebf-4774-ad77-c79ce25ebc79 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:48.114216 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-50c56995-aebf-4774-ad77-c79ce25ebc79 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:48.114980 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-50c56995-aebf-4774-ad77-c79ce25ebc79 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:48.115437 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-50c56995-aebf-4774-ad77-c79ce25ebc79 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:48.116149 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-50c56995-aebf-4774-ad77-c79ce25ebc79 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:48.133707 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-50c56995-aebf-4774-ad77-c79ce25ebc79 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Getting quotas for project a1e3bf9149434d34b6762aaeef1478ed. Resources: {'instances', 'ram', 'cores'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:45:48.138861 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-50c56995-aebf-4774-ad77-c79ce25ebc79 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Getting quotas for user 87616cd16995468ab7febf5aa4b284db and project a1e3bf9149434d34b6762aaeef1478ed. Resources: {'instances', 'ram', 'cores'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:45:48.152088 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-50c56995-aebf-4774-ad77-c79ce25ebc79 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Going to run 1 instances... {{(pid=134102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:45:48.154273 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-50c56995-aebf-4774-ad77-c79ce25ebc79 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] [instance: 58b5b55c-fd7d-4a43-96af-01ae27cb29de] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='58548514-5dac-426c-81f5-19e3fba33e23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:45:48.199528 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-50c56995-aebf-4774-ad77-c79ce25ebc79 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.346962 Oct 04 21:45:48.206215 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 326/667] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 21:45:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 354 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:45:48.211896 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-dab4dc35-9214-47b5-baee-a4dc9b0d0e73 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:48.212516 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-dab4dc35-9214-47b5-baee-a4dc9b0d0e73 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] [instance: 58b5b55c-fd7d-4a43-96af-01ae27cb29de] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:48.271382 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-dab4dc35-9214-47b5-baee-a4dc9b0d0e73 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87616cd16995468ab7febf5aa4b284db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e3bf9149434d34b6762aaeef1478ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:48.280224 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-dab4dc35-9214-47b5-baee-a4dc9b0d0e73 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] 10.222.0.43 "GET /compute/v2.1/servers/58b5b55c-fd7d-4a43-96af-01ae27cb29de" status: 200 len: 1214 microversion: 2.1 time: 0.072999 Oct 04 21:45:48.294391 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 327/668] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:48 2022] GET /compute/v2.1/servers/58b5b55c-fd7d-4a43-96af-01ae27cb29de => generated 1214 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:45:48.294391 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-c72ff6f1-d77b-466c-acf8-94f8f0ddcf21 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:48.294391 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-c72ff6f1-d77b-466c-acf8-94f8f0ddcf21 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 10062905-54d7-47e2-b621-522e0954b72b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:48.300058 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c72ff6f1-d77b-466c-acf8-94f8f0ddcf21 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:48.300058 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c72ff6f1-d77b-466c-acf8-94f8f0ddcf21 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:48.300781 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c72ff6f1-d77b-466c-acf8-94f8f0ddcf21 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:48.302911 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c72ff6f1-d77b-466c-acf8-94f8f0ddcf21 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:48.303500 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c72ff6f1-d77b-466c-acf8-94f8f0ddcf21 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:48.304021 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c72ff6f1-d77b-466c-acf8-94f8f0ddcf21 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:48.325742 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=100 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:45:48.545082 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-c72ff6f1-d77b-466c-acf8-94f8f0ddcf21 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ad048becf474fb972d4291422d810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dcfc7024fc49388c4bd5f25f03e60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:48.554412 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-c72ff6f1-d77b-466c-acf8-94f8f0ddcf21 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/10062905-54d7-47e2-b621-522e0954b72b" status: 200 len: 1311 microversion: 2.1 time: 0.272080 Oct 04 21:45:48.555680 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 328/669] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:48 2022] GET /compute/v2.1/servers/10062905-54d7-47e2-b621-522e0954b72b => generated 1311 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:45:48.561343 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-4346fad2-68a7-4ada-8309-60de9c5784eb tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:48.562564 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-4346fad2-68a7-4ada-8309-60de9c5784eb tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] [instance: 1e9957cf-cfeb-483d-bc32-73ca72a54eb9] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:48.577925 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4346fad2-68a7-4ada-8309-60de9c5784eb tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:48.581561 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4346fad2-68a7-4ada-8309-60de9c5784eb tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:48.582911 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4346fad2-68a7-4ada-8309-60de9c5784eb tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:48.587548 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4346fad2-68a7-4ada-8309-60de9c5784eb tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:48.588040 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4346fad2-68a7-4ada-8309-60de9c5784eb tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:48.588488 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4346fad2-68a7-4ada-8309-60de9c5784eb tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:48.816811 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-4346fad2-68a7-4ada-8309-60de9c5784eb tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2dff38dea346219f6534426fd27ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6a5f1476ac48f3831f2ed202dacdf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:48.826407 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-4346fad2-68a7-4ada-8309-60de9c5784eb tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] 10.222.0.43 "GET /compute/v2.1/servers/1e9957cf-cfeb-483d-bc32-73ca72a54eb9" status: 200 len: 1370 microversion: 2.1 time: 0.269452 Oct 04 21:45:48.831924 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 329/670] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:48 2022] GET /compute/v2.1/servers/1e9957cf-cfeb-483d-bc32-73ca72a54eb9 => generated 1370 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:45:48.831924 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-aa64f9e1-00cd-4eea-b497-cd95b82f7dd1 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:48.832381 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-aa64f9e1-00cd-4eea-b497-cd95b82f7dd1 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: a2d1b827-a865-4d56-a665-110d0541a669] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:48.839149 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-aa64f9e1-00cd-4eea-b497-cd95b82f7dd1 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:48.839639 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-aa64f9e1-00cd-4eea-b497-cd95b82f7dd1 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:48.840078 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-aa64f9e1-00cd-4eea-b497-cd95b82f7dd1 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:48.840783 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-aa64f9e1-00cd-4eea-b497-cd95b82f7dd1 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:48.841241 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-aa64f9e1-00cd-4eea-b497-cd95b82f7dd1 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:48.841975 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-aa64f9e1-00cd-4eea-b497-cd95b82f7dd1 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:49.101458 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-aa64f9e1-00cd-4eea-b497-cd95b82f7dd1 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:49.109900 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-aa64f9e1-00cd-4eea-b497-cd95b82f7dd1 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/a2d1b827-a865-4d56-a665-110d0541a669" status: 200 len: 1470 microversion: 2.1 time: 0.281893 Oct 04 21:45:49.110779 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 330/671] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:48 2022] GET /compute/v2.1/servers/a2d1b827-a865-4d56-a665-110d0541a669 => generated 1470 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:45:49.120787 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-746d9efa-12e5-462b-b2d9-c5e8640e1c10 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:49.121490 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-746d9efa-12e5-462b-b2d9-c5e8640e1c10 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] [instance: caabd624-94e3-4d85-9038-2f3beeabfda9] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:49.135155 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-746d9efa-12e5-462b-b2d9-c5e8640e1c10 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:49.135751 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-746d9efa-12e5-462b-b2d9-c5e8640e1c10 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:49.136263 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-746d9efa-12e5-462b-b2d9-c5e8640e1c10 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:49.137686 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-746d9efa-12e5-462b-b2d9-c5e8640e1c10 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:49.137686 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-746d9efa-12e5-462b-b2d9-c5e8640e1c10 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:49.138190 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-746d9efa-12e5-462b-b2d9-c5e8640e1c10 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:49.384163 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-746d9efa-12e5-462b-b2d9-c5e8640e1c10 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6975d7cbd8554e06a15a8b2adc811b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94201b6c845f4334b6f4883606b0d037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:49.393359 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-746d9efa-12e5-462b-b2d9-c5e8640e1c10 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] 10.222.0.43 "GET /compute/v2.1/servers/caabd624-94e3-4d85-9038-2f3beeabfda9" status: 200 len: 1321 microversion: 2.1 time: 0.281656 Oct 04 21:45:49.394238 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 331/672] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:49 2022] GET /compute/v2.1/servers/caabd624-94e3-4d85-9038-2f3beeabfda9 => generated 1321 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:45:49.413083 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-3502a356-89f4-4608-b717-7d23a8ca5fbb tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:49.413916 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-3502a356-89f4-4608-b717-7d23a8ca5fbb tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] [instance: f3a0dc37-502e-48d3-9537-10dd7fb15e94] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:49.420475 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3502a356-89f4-4608-b717-7d23a8ca5fbb tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:49.421077 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3502a356-89f4-4608-b717-7d23a8ca5fbb tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:49.421518 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3502a356-89f4-4608-b717-7d23a8ca5fbb tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:49.422381 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3502a356-89f4-4608-b717-7d23a8ca5fbb tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:49.423016 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3502a356-89f4-4608-b717-7d23a8ca5fbb tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:49.423443 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3502a356-89f4-4608-b717-7d23a8ca5fbb tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:49.627951 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-3502a356-89f4-4608-b717-7d23a8ca5fbb tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29842a669a20408b881105135f76cb0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39edf587afe94b60911198aa0bb61613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:49.637022 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-3502a356-89f4-4608-b717-7d23a8ca5fbb tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] 10.222.0.43 "GET /compute/v2.1/servers/f3a0dc37-502e-48d3-9537-10dd7fb15e94" status: 200 len: 1316 microversion: 2.1 time: 0.241401 Oct 04 21:45:49.637617 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 332/673] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:49 2022] GET /compute/v2.1/servers/f3a0dc37-502e-48d3-9537-10dd7fb15e94 => generated 1316 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:45:49.642602 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-5b5d1037-3759-45c0-9bda-c763115e0ccb tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:49.643509 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-5b5d1037-3759-45c0-9bda-c763115e0ccb tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] [instance: 58b5b55c-fd7d-4a43-96af-01ae27cb29de] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:49.650476 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5b5d1037-3759-45c0-9bda-c763115e0ccb tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:49.650996 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5b5d1037-3759-45c0-9bda-c763115e0ccb tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:49.651477 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5b5d1037-3759-45c0-9bda-c763115e0ccb tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:49.652296 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5b5d1037-3759-45c0-9bda-c763115e0ccb tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:49.652973 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5b5d1037-3759-45c0-9bda-c763115e0ccb tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:49.653409 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5b5d1037-3759-45c0-9bda-c763115e0ccb tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:49.749408 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-5b5d1037-3759-45c0-9bda-c763115e0ccb tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87616cd16995468ab7febf5aa4b284db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e3bf9149434d34b6762aaeef1478ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:49.762665 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-5b5d1037-3759-45c0-9bda-c763115e0ccb tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] 10.222.0.43 "GET /compute/v2.1/servers/58b5b55c-fd7d-4a43-96af-01ae27cb29de" status: 200 len: 1266 microversion: 2.1 time: 0.122182 Oct 04 21:45:49.763332 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 333/674] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:49 2022] GET /compute/v2.1/servers/58b5b55c-fd7d-4a43-96af-01ae27cb29de => generated 1266 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:45:49.786755 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-62e43f37-5e19-4620-b581-09760ff92ec7 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:49.789737 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-62e43f37-5e19-4620-b581-09760ff92ec7 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 10062905-54d7-47e2-b621-522e0954b72b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:49.797770 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-62e43f37-5e19-4620-b581-09760ff92ec7 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:49.798273 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-62e43f37-5e19-4620-b581-09760ff92ec7 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:49.798922 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-62e43f37-5e19-4620-b581-09760ff92ec7 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:49.799632 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-62e43f37-5e19-4620-b581-09760ff92ec7 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:49.800192 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-62e43f37-5e19-4620-b581-09760ff92ec7 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:49.800619 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-62e43f37-5e19-4620-b581-09760ff92ec7 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:50.360897 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-62e43f37-5e19-4620-b581-09760ff92ec7 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ad048becf474fb972d4291422d810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dcfc7024fc49388c4bd5f25f03e60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:50.376374 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-62e43f37-5e19-4620-b581-09760ff92ec7 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/10062905-54d7-47e2-b621-522e0954b72b" status: 200 len: 1311 microversion: 2.1 time: 0.606746 Oct 04 21:45:50.377777 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 334/675] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:49 2022] GET /compute/v2.1/servers/10062905-54d7-47e2-b621-522e0954b72b => generated 1311 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:45:50.387916 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-01899dd2-cfa0-4336-8d99-c431e678d0a1 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:50.389853 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-01899dd2-cfa0-4336-8d99-c431e678d0a1 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] [instance: 1e9957cf-cfeb-483d-bc32-73ca72a54eb9] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:50.406180 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-01899dd2-cfa0-4336-8d99-c431e678d0a1 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:50.407855 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-01899dd2-cfa0-4336-8d99-c431e678d0a1 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:50.408727 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-01899dd2-cfa0-4336-8d99-c431e678d0a1 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:50.409673 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-01899dd2-cfa0-4336-8d99-c431e678d0a1 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:50.414665 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-01899dd2-cfa0-4336-8d99-c431e678d0a1 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:50.415346 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-01899dd2-cfa0-4336-8d99-c431e678d0a1 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:51.188412 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-01899dd2-cfa0-4336-8d99-c431e678d0a1 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2dff38dea346219f6534426fd27ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6a5f1476ac48f3831f2ed202dacdf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:51.197827 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-01899dd2-cfa0-4336-8d99-c431e678d0a1 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] 10.222.0.43 "GET /compute/v2.1/servers/1e9957cf-cfeb-483d-bc32-73ca72a54eb9" status: 200 len: 1370 microversion: 2.1 time: 0.818603 Oct 04 21:45:51.198456 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 335/676] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:50 2022] GET /compute/v2.1/servers/1e9957cf-cfeb-483d-bc32-73ca72a54eb9 => generated 1370 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:45:51.203562 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-b496a491-c0fd-49f6-ad25-0eb73d5add2f tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:51.204366 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-b496a491-c0fd-49f6-ad25-0eb73d5add2f tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: a2d1b827-a865-4d56-a665-110d0541a669] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:51.215228 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b496a491-c0fd-49f6-ad25-0eb73d5add2f tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:51.216006 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b496a491-c0fd-49f6-ad25-0eb73d5add2f tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:51.216654 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b496a491-c0fd-49f6-ad25-0eb73d5add2f tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:51.217373 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b496a491-c0fd-49f6-ad25-0eb73d5add2f tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:51.217826 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b496a491-c0fd-49f6-ad25-0eb73d5add2f tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:51.218532 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b496a491-c0fd-49f6-ad25-0eb73d5add2f tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:51.613985 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-b496a491-c0fd-49f6-ad25-0eb73d5add2f tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:51.622311 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-b496a491-c0fd-49f6-ad25-0eb73d5add2f tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/a2d1b827-a865-4d56-a665-110d0541a669" status: 200 len: 1470 microversion: 2.1 time: 0.422548 Oct 04 21:45:51.622930 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 336/677] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:51 2022] GET /compute/v2.1/servers/a2d1b827-a865-4d56-a665-110d0541a669 => generated 1470 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:45:51.631982 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-6e883a03-4fac-4a26-9bd5-c8b7250f5292 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:51.632601 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-6e883a03-4fac-4a26-9bd5-c8b7250f5292 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] [instance: caabd624-94e3-4d85-9038-2f3beeabfda9] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:51.645964 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6e883a03-4fac-4a26-9bd5-c8b7250f5292 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:51.646497 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6e883a03-4fac-4a26-9bd5-c8b7250f5292 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:51.647731 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6e883a03-4fac-4a26-9bd5-c8b7250f5292 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:51.648965 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6e883a03-4fac-4a26-9bd5-c8b7250f5292 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:51.649894 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6e883a03-4fac-4a26-9bd5-c8b7250f5292 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:51.650224 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6e883a03-4fac-4a26-9bd5-c8b7250f5292 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:52.050327 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-6e883a03-4fac-4a26-9bd5-c8b7250f5292 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6975d7cbd8554e06a15a8b2adc811b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94201b6c845f4334b6f4883606b0d037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:52.058843 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-6e883a03-4fac-4a26-9bd5-c8b7250f5292 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] 10.222.0.43 "GET /compute/v2.1/servers/caabd624-94e3-4d85-9038-2f3beeabfda9" status: 200 len: 1321 microversion: 2.1 time: 0.434837 Oct 04 21:45:52.059478 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 337/678] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:51 2022] GET /compute/v2.1/servers/caabd624-94e3-4d85-9038-2f3beeabfda9 => generated 1321 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:45:52.064167 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-fe78e85d-2d01-4516-a12c-419f5523ecf3 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:52.064791 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-fe78e85d-2d01-4516-a12c-419f5523ecf3 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] [instance: f3a0dc37-502e-48d3-9537-10dd7fb15e94] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:52.071574 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fe78e85d-2d01-4516-a12c-419f5523ecf3 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:52.072208 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fe78e85d-2d01-4516-a12c-419f5523ecf3 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:52.072495 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fe78e85d-2d01-4516-a12c-419f5523ecf3 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:52.073199 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fe78e85d-2d01-4516-a12c-419f5523ecf3 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:52.073842 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fe78e85d-2d01-4516-a12c-419f5523ecf3 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:52.074268 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fe78e85d-2d01-4516-a12c-419f5523ecf3 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:52.210692 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-82575956-b387-402a-854a-f83a96624dc9 tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] 10.222.0.43 "POST /compute/v2.1/servers/659208f3-1bef-41f7-9616-50c2db9f46ba/action" status: 202 len: 0 microversion: 2.25 time: 8.940970 Oct 04 21:45:52.211312 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 342/679] 10.222.0.43 () {62 vars in 1319 bytes} [Tue Oct 4 21:45:43 2022] POST /compute/v2.1/servers/659208f3-1bef-41f7-9616-50c2db9f46ba/action => generated 0 bytes in 8944 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:45:52.218433 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-cd399b7d-e445-4baf-8b11-a0268f183bd1 req-018f7ada-4421-46b6-9ddc-b5e638f150d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "caabd624-94e3-4d85-9038-2f3beeabfda9", "name": "network-vif-plugged", "status": "completed", "tag": "d9f07922-9bf0-42e8-b7a2-a88c1c73314c"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:45:52.231668 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-cd399b7d-e445-4baf-8b11-a0268f183bd1 req-018f7ada-4421-46b6-9ddc-b5e638f150d5 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:52.232067 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-cd399b7d-e445-4baf-8b11-a0268f183bd1 req-018f7ada-4421-46b6-9ddc-b5e638f150d5 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:52.232510 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-cd399b7d-e445-4baf-8b11-a0268f183bd1 req-018f7ada-4421-46b6-9ddc-b5e638f150d5 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:52.251381 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-cd399b7d-e445-4baf-8b11-a0268f183bd1 req-018f7ada-4421-46b6-9ddc-b5e638f150d5 service nova] Creating event network-vif-plugged:d9f07922-9bf0-42e8-b7a2-a88c1c73314c for instance caabd624-94e3-4d85-9038-2f3beeabfda9 on n-h2-860284-1 Oct 04 21:45:52.264208 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-cd399b7d-e445-4baf-8b11-a0268f183bd1 req-018f7ada-4421-46b6-9ddc-b5e638f150d5 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051290 Oct 04 21:45:52.265648 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 343/680] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:45:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:45:52.272952 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e9f5478e-d48d-49dc-a3d9-2347a4af2204 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:52.273916 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-e9f5478e-d48d-49dc-a3d9-2347a4af2204 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] [instance: 58b5b55c-fd7d-4a43-96af-01ae27cb29de] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:52.282834 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e9f5478e-d48d-49dc-a3d9-2347a4af2204 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:52.283789 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e9f5478e-d48d-49dc-a3d9-2347a4af2204 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:52.284890 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e9f5478e-d48d-49dc-a3d9-2347a4af2204 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:52.286394 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e9f5478e-d48d-49dc-a3d9-2347a4af2204 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:52.287829 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e9f5478e-d48d-49dc-a3d9-2347a4af2204 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:52.288701 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e9f5478e-d48d-49dc-a3d9-2347a4af2204 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:52.511042 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-fe78e85d-2d01-4516-a12c-419f5523ecf3 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29842a669a20408b881105135f76cb0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39edf587afe94b60911198aa0bb61613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:52.520069 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-fe78e85d-2d01-4516-a12c-419f5523ecf3 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] 10.222.0.43 "GET /compute/v2.1/servers/f3a0dc37-502e-48d3-9537-10dd7fb15e94" status: 200 len: 1316 microversion: 2.1 time: 0.459582 Oct 04 21:45:52.520840 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 338/681] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:52 2022] GET /compute/v2.1/servers/f3a0dc37-502e-48d3-9537-10dd7fb15e94 => generated 1316 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:45:52.528887 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-22015074-fb50-47bf-a92d-75e1a6ce5592 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:52.529871 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-22015074-fb50-47bf-a92d-75e1a6ce5592 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 10062905-54d7-47e2-b621-522e0954b72b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:52.541094 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-22015074-fb50-47bf-a92d-75e1a6ce5592 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:52.541839 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-22015074-fb50-47bf-a92d-75e1a6ce5592 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:52.542344 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-22015074-fb50-47bf-a92d-75e1a6ce5592 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:52.543177 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-22015074-fb50-47bf-a92d-75e1a6ce5592 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:52.543757 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-22015074-fb50-47bf-a92d-75e1a6ce5592 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:52.544317 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-22015074-fb50-47bf-a92d-75e1a6ce5592 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:52.669700 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-e9f5478e-d48d-49dc-a3d9-2347a4af2204 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87616cd16995468ab7febf5aa4b284db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e3bf9149434d34b6762aaeef1478ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:52.677620 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-e9f5478e-d48d-49dc-a3d9-2347a4af2204 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] 10.222.0.43 "GET /compute/v2.1/servers/58b5b55c-fd7d-4a43-96af-01ae27cb29de" status: 200 len: 1314 microversion: 2.1 time: 0.410750 Oct 04 21:45:52.678906 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 344/682] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:52 2022] GET /compute/v2.1/servers/58b5b55c-fd7d-4a43-96af-01ae27cb29de => generated 1314 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:45:52.698776 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-ab0577c3-db0d-43b1-97cb-4fecb5f65f2e req-22950ad3-553c-4b2a-b428-95da687c4e20 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3380b36-6aba-4736-bcbc-f0058f806d55", "tag": "b25814f1-d2d0-4853-bfa4-3948c24c40e5"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:45:52.708315 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-ab0577c3-db0d-43b1-97cb-4fecb5f65f2e req-22950ad3-553c-4b2a-b428-95da687c4e20 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:52.708796 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-ab0577c3-db0d-43b1-97cb-4fecb5f65f2e req-22950ad3-553c-4b2a-b428-95da687c4e20 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:52.709264 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-ab0577c3-db0d-43b1-97cb-4fecb5f65f2e req-22950ad3-553c-4b2a-b428-95da687c4e20 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:52.720973 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-ab0577c3-db0d-43b1-97cb-4fecb5f65f2e req-22950ad3-553c-4b2a-b428-95da687c4e20 service nova] Creating event network-changed:b25814f1-d2d0-4853-bfa4-3948c24c40e5 for instance e3380b36-6aba-4736-bcbc-f0058f806d55 on n-h2-860284-1 Oct 04 21:45:52.726249 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-ab0577c3-db0d-43b1-97cb-4fecb5f65f2e req-22950ad3-553c-4b2a-b428-95da687c4e20 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034449 Oct 04 21:45:52.727109 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 345/683] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:45:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:45:52.731977 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-519dbfbb-79a2-47b8-a8fa-636d9e6a040f tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:52.732708 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-519dbfbb-79a2-47b8-a8fa-636d9e6a040f tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] [instance: 659208f3-1bef-41f7-9616-50c2db9f46ba] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:52.738705 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-519dbfbb-79a2-47b8-a8fa-636d9e6a040f tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:52.739189 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-519dbfbb-79a2-47b8-a8fa-636d9e6a040f tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:52.739623 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-519dbfbb-79a2-47b8-a8fa-636d9e6a040f tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:52.740314 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-519dbfbb-79a2-47b8-a8fa-636d9e6a040f tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:52.741583 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-519dbfbb-79a2-47b8-a8fa-636d9e6a040f tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:52.742040 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-519dbfbb-79a2-47b8-a8fa-636d9e6a040f tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:52.808079 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-22015074-fb50-47bf-a92d-75e1a6ce5592 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ad048becf474fb972d4291422d810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dcfc7024fc49388c4bd5f25f03e60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:52.815992 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-22015074-fb50-47bf-a92d-75e1a6ce5592 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/10062905-54d7-47e2-b621-522e0954b72b" status: 200 len: 1311 microversion: 2.1 time: 0.292833 Oct 04 21:45:52.816665 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 339/684] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:52 2022] GET /compute/v2.1/servers/10062905-54d7-47e2-b621-522e0954b72b => generated 1311 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:45:52.821305 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-30e30625-6b88-4846-ac28-feb527fc21f0 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:52.821907 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-30e30625-6b88-4846-ac28-feb527fc21f0 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] [instance: 1e9957cf-cfeb-483d-bc32-73ca72a54eb9] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:52.827844 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-30e30625-6b88-4846-ac28-feb527fc21f0 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:52.829082 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-30e30625-6b88-4846-ac28-feb527fc21f0 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:52.829228 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-30e30625-6b88-4846-ac28-feb527fc21f0 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:52.830050 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-30e30625-6b88-4846-ac28-feb527fc21f0 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:52.831398 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-30e30625-6b88-4846-ac28-feb527fc21f0 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:52.831398 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-30e30625-6b88-4846-ac28-feb527fc21f0 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:53.204684 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=15 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:45:53.273427 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-519dbfbb-79a2-47b8-a8fa-636d9e6a040f tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:53.282486 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-519dbfbb-79a2-47b8-a8fa-636d9e6a040f tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:53.283937 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-519dbfbb-79a2-47b8-a8fa-636d9e6a040f tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:53.285111 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-519dbfbb-79a2-47b8-a8fa-636d9e6a040f tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] 10.222.0.43 "GET /compute/v2.1/servers/659208f3-1bef-41f7-9616-50c2db9f46ba" status: 200 len: 1568 microversion: 2.25 time: 0.557103 Oct 04 21:45:53.285683 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 346/685] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:45:52 2022] GET /compute/v2.1/servers/659208f3-1bef-41f7-9616-50c2db9f46ba => generated 1568 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:45:53.290635 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-17a662e9-7e1f-43b6-8694-f4b948000347 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:53.291259 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-17a662e9-7e1f-43b6-8694-f4b948000347 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: a2d1b827-a865-4d56-a665-110d0541a669] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:53.297404 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-17a662e9-7e1f-43b6-8694-f4b948000347 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:53.297890 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-17a662e9-7e1f-43b6-8694-f4b948000347 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:53.298328 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-17a662e9-7e1f-43b6-8694-f4b948000347 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:53.299104 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-17a662e9-7e1f-43b6-8694-f4b948000347 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:53.299562 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-17a662e9-7e1f-43b6-8694-f4b948000347 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:53.299986 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-17a662e9-7e1f-43b6-8694-f4b948000347 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:53.309309 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-30e30625-6b88-4846-ac28-feb527fc21f0 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2dff38dea346219f6534426fd27ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6a5f1476ac48f3831f2ed202dacdf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:53.318215 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-30e30625-6b88-4846-ac28-feb527fc21f0 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] 10.222.0.43 "GET /compute/v2.1/servers/1e9957cf-cfeb-483d-bc32-73ca72a54eb9" status: 200 len: 1370 microversion: 2.1 time: 0.500512 Oct 04 21:45:53.319669 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 340/686] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:52 2022] GET /compute/v2.1/servers/1e9957cf-cfeb-483d-bc32-73ca72a54eb9 => generated 1370 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:45:53.325523 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-f3d3fcb4-ddfb-4fcc-b224-c88da82ae9f5 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:53.326490 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-f3d3fcb4-ddfb-4fcc-b224-c88da82ae9f5 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] [instance: caabd624-94e3-4d85-9038-2f3beeabfda9] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:53.333026 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f3d3fcb4-ddfb-4fcc-b224-c88da82ae9f5 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:53.333825 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f3d3fcb4-ddfb-4fcc-b224-c88da82ae9f5 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:53.334385 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f3d3fcb4-ddfb-4fcc-b224-c88da82ae9f5 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:53.335198 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f3d3fcb4-ddfb-4fcc-b224-c88da82ae9f5 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:53.335763 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f3d3fcb4-ddfb-4fcc-b224-c88da82ae9f5 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:53.336295 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f3d3fcb4-ddfb-4fcc-b224-c88da82ae9f5 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:53.706320 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-17a662e9-7e1f-43b6-8694-f4b948000347 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:53.714763 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-17a662e9-7e1f-43b6-8694-f4b948000347 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/a2d1b827-a865-4d56-a665-110d0541a669" status: 200 len: 1470 microversion: 2.1 time: 0.428005 Oct 04 21:45:53.715359 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 347/687] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:53 2022] GET /compute/v2.1/servers/a2d1b827-a865-4d56-a665-110d0541a669 => generated 1470 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:45:53.720433 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-56cee520-ddc2-48da-b206-e087eeb6713b tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:53.721042 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-56cee520-ddc2-48da-b206-e087eeb6713b tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] [instance: f3a0dc37-502e-48d3-9537-10dd7fb15e94] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:53.728059 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-56cee520-ddc2-48da-b206-e087eeb6713b tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:53.728549 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-56cee520-ddc2-48da-b206-e087eeb6713b tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:53.728989 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-56cee520-ddc2-48da-b206-e087eeb6713b tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:53.729697 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-56cee520-ddc2-48da-b206-e087eeb6713b tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:53.730158 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-56cee520-ddc2-48da-b206-e087eeb6713b tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:53.730819 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-56cee520-ddc2-48da-b206-e087eeb6713b tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:53.764280 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-f3d3fcb4-ddfb-4fcc-b224-c88da82ae9f5 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6975d7cbd8554e06a15a8b2adc811b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94201b6c845f4334b6f4883606b0d037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:53.772749 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-f3d3fcb4-ddfb-4fcc-b224-c88da82ae9f5 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] 10.222.0.43 "GET /compute/v2.1/servers/caabd624-94e3-4d85-9038-2f3beeabfda9" status: 200 len: 1321 microversion: 2.1 time: 0.451661 Oct 04 21:45:53.773793 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 341/688] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:53 2022] GET /compute/v2.1/servers/caabd624-94e3-4d85-9038-2f3beeabfda9 => generated 1321 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:45:53.778895 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-6ae40096-53a4-46c5-b42c-e95d1ccd8a50 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:53.779772 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-6ae40096-53a4-46c5-b42c-e95d1ccd8a50 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] [instance: 58b5b55c-fd7d-4a43-96af-01ae27cb29de] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:53.786953 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6ae40096-53a4-46c5-b42c-e95d1ccd8a50 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:53.787686 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6ae40096-53a4-46c5-b42c-e95d1ccd8a50 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:53.788880 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6ae40096-53a4-46c5-b42c-e95d1ccd8a50 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:53.789819 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6ae40096-53a4-46c5-b42c-e95d1ccd8a50 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:53.790777 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6ae40096-53a4-46c5-b42c-e95d1ccd8a50 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:53.791201 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6ae40096-53a4-46c5-b42c-e95d1ccd8a50 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:54.052994 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-56cee520-ddc2-48da-b206-e087eeb6713b tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29842a669a20408b881105135f76cb0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39edf587afe94b60911198aa0bb61613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:54.075841 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-56cee520-ddc2-48da-b206-e087eeb6713b tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] 10.222.0.43 "GET /compute/v2.1/servers/f3a0dc37-502e-48d3-9537-10dd7fb15e94" status: 200 len: 1316 microversion: 2.1 time: 0.359216 Oct 04 21:45:54.085566 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-6ae40096-53a4-46c5-b42c-e95d1ccd8a50 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87616cd16995468ab7febf5aa4b284db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e3bf9149434d34b6762aaeef1478ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:54.095573 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 348/689] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:53 2022] GET /compute/v2.1/servers/f3a0dc37-502e-48d3-9537-10dd7fb15e94 => generated 1316 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:45:54.100822 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-6ae40096-53a4-46c5-b42c-e95d1ccd8a50 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] 10.222.0.43 "GET /compute/v2.1/servers/58b5b55c-fd7d-4a43-96af-01ae27cb29de" status: 200 len: 1314 microversion: 2.1 time: 0.325014 Oct 04 21:45:54.103343 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 342/690] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:53 2022] GET /compute/v2.1/servers/58b5b55c-fd7d-4a43-96af-01ae27cb29de => generated 1314 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:45:54.107701 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-cd00734b-057b-4535-a3c9-1155a096b027 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:54.108435 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-cd00734b-057b-4535-a3c9-1155a096b027 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 10062905-54d7-47e2-b621-522e0954b72b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:54.121347 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cd00734b-057b-4535-a3c9-1155a096b027 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:54.123105 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cd00734b-057b-4535-a3c9-1155a096b027 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:54.123475 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cd00734b-057b-4535-a3c9-1155a096b027 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:54.128931 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cd00734b-057b-4535-a3c9-1155a096b027 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:54.130778 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cd00734b-057b-4535-a3c9-1155a096b027 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:54.131585 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cd00734b-057b-4535-a3c9-1155a096b027 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:54.313596 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-6f5c204b-6e79-45be-83db-b9fa2bdd3de1 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:54.314516 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-6f5c204b-6e79-45be-83db-b9fa2bdd3de1 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] [instance: 659208f3-1bef-41f7-9616-50c2db9f46ba] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:54.322253 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6f5c204b-6e79-45be-83db-b9fa2bdd3de1 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:54.323033 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6f5c204b-6e79-45be-83db-b9fa2bdd3de1 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:54.323636 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6f5c204b-6e79-45be-83db-b9fa2bdd3de1 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:54.324498 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6f5c204b-6e79-45be-83db-b9fa2bdd3de1 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:54.325109 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6f5c204b-6e79-45be-83db-b9fa2bdd3de1 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:54.325683 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6f5c204b-6e79-45be-83db-b9fa2bdd3de1 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:54.527392 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-cd00734b-057b-4535-a3c9-1155a096b027 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ad048becf474fb972d4291422d810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dcfc7024fc49388c4bd5f25f03e60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:54.536828 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-cd00734b-057b-4535-a3c9-1155a096b027 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/10062905-54d7-47e2-b621-522e0954b72b" status: 200 len: 1311 microversion: 2.1 time: 0.439976 Oct 04 21:45:54.537344 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 349/691] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:54 2022] GET /compute/v2.1/servers/10062905-54d7-47e2-b621-522e0954b72b => generated 1311 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:45:54.544074 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-8b2bcfbb-df8c-4ac3-bfac-b641e55f02dd tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:54.544979 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-8b2bcfbb-df8c-4ac3-bfac-b641e55f02dd tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] [instance: 1e9957cf-cfeb-483d-bc32-73ca72a54eb9] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:54.552780 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8b2bcfbb-df8c-4ac3-bfac-b641e55f02dd tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:54.555224 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8b2bcfbb-df8c-4ac3-bfac-b641e55f02dd tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:54.555743 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8b2bcfbb-df8c-4ac3-bfac-b641e55f02dd tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:54.556538 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8b2bcfbb-df8c-4ac3-bfac-b641e55f02dd tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:54.557069 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8b2bcfbb-df8c-4ac3-bfac-b641e55f02dd tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:54.557567 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8b2bcfbb-df8c-4ac3-bfac-b641e55f02dd tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:54.618376 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-6f5c204b-6e79-45be-83db-b9fa2bdd3de1 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:54.627920 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-6f5c204b-6e79-45be-83db-b9fa2bdd3de1 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:54.630005 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-6f5c204b-6e79-45be-83db-b9fa2bdd3de1 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:54.632181 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-6f5c204b-6e79-45be-83db-b9fa2bdd3de1 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] 10.222.0.43 "GET /compute/v2.1/servers/659208f3-1bef-41f7-9616-50c2db9f46ba" status: 200 len: 1568 microversion: 2.25 time: 0.322566 Oct 04 21:45:54.633221 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 343/692] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:45:54 2022] GET /compute/v2.1/servers/659208f3-1bef-41f7-9616-50c2db9f46ba => generated 1568 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:45:54.739246 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-ce0242de-b764-4e97-9d77-944b69e33f00 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:54.740324 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-ce0242de-b764-4e97-9d77-944b69e33f00 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: a2d1b827-a865-4d56-a665-110d0541a669] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:54.743823 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:45:54.751050 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ce0242de-b764-4e97-9d77-944b69e33f00 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:54.751821 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ce0242de-b764-4e97-9d77-944b69e33f00 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:54.752535 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ce0242de-b764-4e97-9d77-944b69e33f00 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:54.753340 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ce0242de-b764-4e97-9d77-944b69e33f00 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:54.754018 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ce0242de-b764-4e97-9d77-944b69e33f00 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:54.754574 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ce0242de-b764-4e97-9d77-944b69e33f00 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:54.773141 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-8b2bcfbb-df8c-4ac3-bfac-b641e55f02dd tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2dff38dea346219f6534426fd27ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6a5f1476ac48f3831f2ed202dacdf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:54.784931 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-8b2bcfbb-df8c-4ac3-bfac-b641e55f02dd tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] 10.222.0.43 "GET /compute/v2.1/servers/1e9957cf-cfeb-483d-bc32-73ca72a54eb9" status: 200 len: 1370 microversion: 2.1 time: 0.245657 Oct 04 21:45:54.786326 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 350/693] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:54 2022] GET /compute/v2.1/servers/1e9957cf-cfeb-483d-bc32-73ca72a54eb9 => generated 1370 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:45:54.795233 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-f173c077-2721-4bbe-ae95-b430cdfc67cb req-e2b6eed6-e3b0-4730-83d1-e09684eaf9b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58b5b55c-fd7d-4a43-96af-01ae27cb29de", "tag": "38c2c5e6-fad8-4765-8442-be827ff69b3f"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:45:54.810490 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-f173c077-2721-4bbe-ae95-b430cdfc67cb req-e2b6eed6-e3b0-4730-83d1-e09684eaf9b5 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:54.811905 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-f173c077-2721-4bbe-ae95-b430cdfc67cb req-e2b6eed6-e3b0-4730-83d1-e09684eaf9b5 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:54.812452 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-f173c077-2721-4bbe-ae95-b430cdfc67cb req-e2b6eed6-e3b0-4730-83d1-e09684eaf9b5 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:54.825444 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-f173c077-2721-4bbe-ae95-b430cdfc67cb req-e2b6eed6-e3b0-4730-83d1-e09684eaf9b5 service nova] Creating event network-changed:38c2c5e6-fad8-4765-8442-be827ff69b3f for instance 58b5b55c-fd7d-4a43-96af-01ae27cb29de on n-h2-860284-1 Oct 04 21:45:54.830726 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-f173c077-2721-4bbe-ae95-b430cdfc67cb req-e2b6eed6-e3b0-4730-83d1-e09684eaf9b5 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041433 Oct 04 21:45:54.831512 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 351/694] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:45:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:45:54.836938 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-2a0c45ec-a391-4574-a382-041d6f2e5c25 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:54.837628 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-2a0c45ec-a391-4574-a382-041d6f2e5c25 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] [instance: caabd624-94e3-4d85-9038-2f3beeabfda9] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:54.858518 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2a0c45ec-a391-4574-a382-041d6f2e5c25 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:54.859312 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2a0c45ec-a391-4574-a382-041d6f2e5c25 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:54.859931 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2a0c45ec-a391-4574-a382-041d6f2e5c25 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:54.860877 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2a0c45ec-a391-4574-a382-041d6f2e5c25 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:54.861485 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2a0c45ec-a391-4574-a382-041d6f2e5c25 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:54.862133 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2a0c45ec-a391-4574-a382-041d6f2e5c25 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:54.866315 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:45:55.092635 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-ce0242de-b764-4e97-9d77-944b69e33f00 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:55.106631 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-ce0242de-b764-4e97-9d77-944b69e33f00 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/a2d1b827-a865-4d56-a665-110d0541a669" status: 200 len: 1475 microversion: 2.1 time: 0.372056 Oct 04 21:45:55.124174 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 344/695] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:54 2022] GET /compute/v2.1/servers/a2d1b827-a865-4d56-a665-110d0541a669 => generated 1475 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:45:55.130550 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-e23dc093-1913-43cc-bd9c-16a8f13353fa tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:55.131690 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-e23dc093-1913-43cc-bd9c-16a8f13353fa tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] [instance: f3a0dc37-502e-48d3-9537-10dd7fb15e94] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:55.140518 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e23dc093-1913-43cc-bd9c-16a8f13353fa tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:55.141007 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e23dc093-1913-43cc-bd9c-16a8f13353fa tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:55.141440 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e23dc093-1913-43cc-bd9c-16a8f13353fa tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:55.142137 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e23dc093-1913-43cc-bd9c-16a8f13353fa tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:55.142613 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e23dc093-1913-43cc-bd9c-16a8f13353fa tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:55.143238 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e23dc093-1913-43cc-bd9c-16a8f13353fa tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:55.149926 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=100 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:45:55.177047 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-2a0c45ec-a391-4574-a382-041d6f2e5c25 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6975d7cbd8554e06a15a8b2adc811b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94201b6c845f4334b6f4883606b0d037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:55.189615 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-2a0c45ec-a391-4574-a382-041d6f2e5c25 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] 10.222.0.43 "GET /compute/v2.1/servers/caabd624-94e3-4d85-9038-2f3beeabfda9" status: 200 len: 1471 microversion: 2.1 time: 0.356475 Oct 04 21:45:55.195731 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 352/696] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:54 2022] GET /compute/v2.1/servers/caabd624-94e3-4d85-9038-2f3beeabfda9 => generated 1471 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:45:55.202916 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-6bb4946e-e445-4a67-ac8e-1f607dc8b95a tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:55.203525 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-6bb4946e-e445-4a67-ac8e-1f607dc8b95a tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] [instance: 58b5b55c-fd7d-4a43-96af-01ae27cb29de] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:55.217890 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6bb4946e-e445-4a67-ac8e-1f607dc8b95a tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:55.217890 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6bb4946e-e445-4a67-ac8e-1f607dc8b95a tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:55.218680 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6bb4946e-e445-4a67-ac8e-1f607dc8b95a tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:55.219111 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6bb4946e-e445-4a67-ac8e-1f607dc8b95a tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:55.219565 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6bb4946e-e445-4a67-ac8e-1f607dc8b95a tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:55.219996 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6bb4946e-e445-4a67-ac8e-1f607dc8b95a tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:55.374633 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-e23dc093-1913-43cc-bd9c-16a8f13353fa tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29842a669a20408b881105135f76cb0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39edf587afe94b60911198aa0bb61613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:55.382592 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-e23dc093-1913-43cc-bd9c-16a8f13353fa tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] 10.222.0.43 "GET /compute/v2.1/servers/f3a0dc37-502e-48d3-9537-10dd7fb15e94" status: 200 len: 1316 microversion: 2.1 time: 0.257145 Oct 04 21:45:55.383187 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 345/697] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:55 2022] GET /compute/v2.1/servers/f3a0dc37-502e-48d3-9537-10dd7fb15e94 => generated 1316 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:45:55.387667 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-68ecbab1-4b99-4c48-b32e-40e377e92920 tempest-ServersAdminNegativeTestJSON-223082715 tempest-ServersAdminNegativeTestJSON-223082715-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:45:55.388194 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-68ecbab1-4b99-4c48-b32e-40e377e92920 tempest-ServersAdminNegativeTestJSON-223082715 tempest-ServersAdminNegativeTestJSON-223082715-project-admin] [instance: caabd624-94e3-4d85-9038-2f3beeabfda9] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:55.393954 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-68ecbab1-4b99-4c48-b32e-40e377e92920 tempest-ServersAdminNegativeTestJSON-223082715 tempest-ServersAdminNegativeTestJSON-223082715-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:55.394467 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-68ecbab1-4b99-4c48-b32e-40e377e92920 tempest-ServersAdminNegativeTestJSON-223082715 tempest-ServersAdminNegativeTestJSON-223082715-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:55.394903 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-68ecbab1-4b99-4c48-b32e-40e377e92920 tempest-ServersAdminNegativeTestJSON-223082715 tempest-ServersAdminNegativeTestJSON-223082715-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:55.395597 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-68ecbab1-4b99-4c48-b32e-40e377e92920 tempest-ServersAdminNegativeTestJSON-223082715 tempest-ServersAdminNegativeTestJSON-223082715-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:55.396044 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-68ecbab1-4b99-4c48-b32e-40e377e92920 tempest-ServersAdminNegativeTestJSON-223082715 tempest-ServersAdminNegativeTestJSON-223082715-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:55.396458 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-68ecbab1-4b99-4c48-b32e-40e377e92920 tempest-ServersAdminNegativeTestJSON-223082715 tempest-ServersAdminNegativeTestJSON-223082715-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:55.410952 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-6bb4946e-e445-4a67-ac8e-1f607dc8b95a tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87616cd16995468ab7febf5aa4b284db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e3bf9149434d34b6762aaeef1478ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:55.420252 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-6bb4946e-e445-4a67-ac8e-1f607dc8b95a tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] 10.222.0.43 "GET /compute/v2.1/servers/58b5b55c-fd7d-4a43-96af-01ae27cb29de" status: 200 len: 1314 microversion: 2.1 time: 0.220995 Oct 04 21:45:55.421112 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 353/698] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:55 2022] GET /compute/v2.1/servers/58b5b55c-fd7d-4a43-96af-01ae27cb29de => generated 1314 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:45:55.459880 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.objects.instance [None req-68ecbab1-4b99-4c48-b32e-40e377e92920 tempest-ServersAdminNegativeTestJSON-223082715 tempest-ServersAdminNegativeTestJSON-223082715-project-admin] Lazy-loading 'flavor' on Instance uuid caabd624-94e3-4d85-9038-2f3beeabfda9 {{(pid=134102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:45:55.560370 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-69b8c74f-109e-4a6a-a9dc-b23e6f9e8c1b tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:55.560967 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-69b8c74f-109e-4a6a-a9dc-b23e6f9e8c1b tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 10062905-54d7-47e2-b621-522e0954b72b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:55.562405 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-68ecbab1-4b99-4c48-b32e-40e377e92920 tempest-ServersAdminNegativeTestJSON-223082715 tempest-ServersAdminNegativeTestJSON-223082715-project-admin] 10.222.0.43 "POST /compute/v2.1/servers/caabd624-94e3-4d85-9038-2f3beeabfda9/action" status: 202 len: 0 microversion: 2.1 time: 0.177783 Oct 04 21:45:55.566058 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 346/699] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 21:45:55 2022] POST /compute/v2.1/servers/caabd624-94e3-4d85-9038-2f3beeabfda9/action => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:45:55.567543 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-69b8c74f-109e-4a6a-a9dc-b23e6f9e8c1b tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:55.568027 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-69b8c74f-109e-4a6a-a9dc-b23e6f9e8c1b tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:55.568461 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-69b8c74f-109e-4a6a-a9dc-b23e6f9e8c1b tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:55.569202 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-69b8c74f-109e-4a6a-a9dc-b23e6f9e8c1b tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:55.569649 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-69b8c74f-109e-4a6a-a9dc-b23e6f9e8c1b tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:55.570068 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-69b8c74f-109e-4a6a-a9dc-b23e6f9e8c1b tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:55.571633 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-31b33eab-5807-4978-ac02-0d4b5359226b tempest-ServersAdminNegativeTestJSON-223082715 tempest-ServersAdminNegativeTestJSON-223082715-project-admin] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:55.572348 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-31b33eab-5807-4978-ac02-0d4b5359226b tempest-ServersAdminNegativeTestJSON-223082715 tempest-ServersAdminNegativeTestJSON-223082715-project-admin] [instance: caabd624-94e3-4d85-9038-2f3beeabfda9] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:55.578488 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-31b33eab-5807-4978-ac02-0d4b5359226b tempest-ServersAdminNegativeTestJSON-223082715 tempest-ServersAdminNegativeTestJSON-223082715-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:55.578921 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-31b33eab-5807-4978-ac02-0d4b5359226b tempest-ServersAdminNegativeTestJSON-223082715 tempest-ServersAdminNegativeTestJSON-223082715-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:55.579361 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-31b33eab-5807-4978-ac02-0d4b5359226b tempest-ServersAdminNegativeTestJSON-223082715 tempest-ServersAdminNegativeTestJSON-223082715-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:55.580104 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-31b33eab-5807-4978-ac02-0d4b5359226b tempest-ServersAdminNegativeTestJSON-223082715 tempest-ServersAdminNegativeTestJSON-223082715-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:55.580524 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-31b33eab-5807-4978-ac02-0d4b5359226b tempest-ServersAdminNegativeTestJSON-223082715 tempest-ServersAdminNegativeTestJSON-223082715-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:55.580954 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-31b33eab-5807-4978-ac02-0d4b5359226b tempest-ServersAdminNegativeTestJSON-223082715 tempest-ServersAdminNegativeTestJSON-223082715-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:55.759898 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-69b8c74f-109e-4a6a-a9dc-b23e6f9e8c1b tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ad048becf474fb972d4291422d810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dcfc7024fc49388c4bd5f25f03e60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:55.767822 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-69b8c74f-109e-4a6a-a9dc-b23e6f9e8c1b tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/10062905-54d7-47e2-b621-522e0954b72b" status: 200 len: 1311 microversion: 2.1 time: 0.211343 Oct 04 21:45:55.768409 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 354/700] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:55 2022] GET /compute/v2.1/servers/10062905-54d7-47e2-b621-522e0954b72b => generated 1311 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:45:55.773610 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-862f2ed3-3540-46db-8423-5f10c7171c67 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:55.774295 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-862f2ed3-3540-46db-8423-5f10c7171c67 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] [instance: 659208f3-1bef-41f7-9616-50c2db9f46ba] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:55.780005 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-862f2ed3-3540-46db-8423-5f10c7171c67 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:55.780493 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-862f2ed3-3540-46db-8423-5f10c7171c67 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:55.780932 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-862f2ed3-3540-46db-8423-5f10c7171c67 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:55.781629 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-862f2ed3-3540-46db-8423-5f10c7171c67 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:55.782086 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-862f2ed3-3540-46db-8423-5f10c7171c67 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:55.782568 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-862f2ed3-3540-46db-8423-5f10c7171c67 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:55.923108 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-31b33eab-5807-4978-ac02-0d4b5359226b tempest-ServersAdminNegativeTestJSON-223082715 tempest-ServersAdminNegativeTestJSON-223082715-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/caabd624-94e3-4d85-9038-2f3beeabfda9" status: 200 len: 1630 microversion: 2.1 time: 0.355474 Oct 04 21:45:55.939324 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 347/701] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:55 2022] GET /compute/v2.1/servers/caabd624-94e3-4d85-9038-2f3beeabfda9 => generated 1630 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:45:55.945114 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-633020a2-1a49-41bf-b082-4795f3d7976f tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:55.945913 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-633020a2-1a49-41bf-b082-4795f3d7976f tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] [instance: 1e9957cf-cfeb-483d-bc32-73ca72a54eb9] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:55.952355 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-633020a2-1a49-41bf-b082-4795f3d7976f tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:55.952917 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-633020a2-1a49-41bf-b082-4795f3d7976f tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:55.953415 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-633020a2-1a49-41bf-b082-4795f3d7976f tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:55.954187 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-633020a2-1a49-41bf-b082-4795f3d7976f tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:55.954721 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-633020a2-1a49-41bf-b082-4795f3d7976f tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:55.955211 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-633020a2-1a49-41bf-b082-4795f3d7976f tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:55.971833 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-862f2ed3-3540-46db-8423-5f10c7171c67 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:55.981114 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-862f2ed3-3540-46db-8423-5f10c7171c67 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:55.982639 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-862f2ed3-3540-46db-8423-5f10c7171c67 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:55.983813 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-862f2ed3-3540-46db-8423-5f10c7171c67 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] 10.222.0.43 "GET /compute/v2.1/servers/659208f3-1bef-41f7-9616-50c2db9f46ba" status: 200 len: 1568 microversion: 2.25 time: 0.214482 Oct 04 21:45:55.984587 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 355/702] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:45:55 2022] GET /compute/v2.1/servers/659208f3-1bef-41f7-9616-50c2db9f46ba => generated 1568 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:45:56.091218 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-633020a2-1a49-41bf-b082-4795f3d7976f tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2dff38dea346219f6534426fd27ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6a5f1476ac48f3831f2ed202dacdf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:56.098834 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-633020a2-1a49-41bf-b082-4795f3d7976f tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] 10.222.0.43 "GET /compute/v2.1/servers/1e9957cf-cfeb-483d-bc32-73ca72a54eb9" status: 200 len: 1370 microversion: 2.1 time: 0.158090 Oct 04 21:45:56.099474 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 348/703] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:55 2022] GET /compute/v2.1/servers/1e9957cf-cfeb-483d-bc32-73ca72a54eb9 => generated 1370 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:45:56.136463 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-2a65e4aa-7540-49dd-9a03-0f39cf89a5c1 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:56.137078 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-2a65e4aa-7540-49dd-9a03-0f39cf89a5c1 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: a2d1b827-a865-4d56-a665-110d0541a669] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:56.143061 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2a65e4aa-7540-49dd-9a03-0f39cf89a5c1 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:56.143553 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2a65e4aa-7540-49dd-9a03-0f39cf89a5c1 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:56.143997 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2a65e4aa-7540-49dd-9a03-0f39cf89a5c1 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:56.144694 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2a65e4aa-7540-49dd-9a03-0f39cf89a5c1 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:56.145150 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2a65e4aa-7540-49dd-9a03-0f39cf89a5c1 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:56.145579 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2a65e4aa-7540-49dd-9a03-0f39cf89a5c1 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:56.276739 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-2a65e4aa-7540-49dd-9a03-0f39cf89a5c1 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:56.284522 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-2a65e4aa-7540-49dd-9a03-0f39cf89a5c1 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/a2d1b827-a865-4d56-a665-110d0541a669" status: 200 len: 1475 microversion: 2.1 time: 0.152057 Oct 04 21:45:56.285101 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 356/704] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:56 2022] GET /compute/v2.1/servers/a2d1b827-a865-4d56-a665-110d0541a669 => generated 1475 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:45:56.406791 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-5a77d8aa-1911-4d5c-bef7-12b0c8670894 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:56.407320 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-5a77d8aa-1911-4d5c-bef7-12b0c8670894 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] [instance: f3a0dc37-502e-48d3-9537-10dd7fb15e94] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:56.414546 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5a77d8aa-1911-4d5c-bef7-12b0c8670894 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:56.415036 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5a77d8aa-1911-4d5c-bef7-12b0c8670894 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:56.415504 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5a77d8aa-1911-4d5c-bef7-12b0c8670894 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:56.416173 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5a77d8aa-1911-4d5c-bef7-12b0c8670894 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:56.416629 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5a77d8aa-1911-4d5c-bef7-12b0c8670894 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:56.417060 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5a77d8aa-1911-4d5c-bef7-12b0c8670894 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:56.445732 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-65fdca6b-4f41-4c8d-9161-d2730a207248 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:56.446684 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-65fdca6b-4f41-4c8d-9161-d2730a207248 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] [instance: 58b5b55c-fd7d-4a43-96af-01ae27cb29de] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:56.453464 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-65fdca6b-4f41-4c8d-9161-d2730a207248 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:56.454047 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-65fdca6b-4f41-4c8d-9161-d2730a207248 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:56.454587 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-65fdca6b-4f41-4c8d-9161-d2730a207248 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:56.455389 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-65fdca6b-4f41-4c8d-9161-d2730a207248 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:56.455989 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-65fdca6b-4f41-4c8d-9161-d2730a207248 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:56.456488 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-65fdca6b-4f41-4c8d-9161-d2730a207248 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:56.728688 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-5a77d8aa-1911-4d5c-bef7-12b0c8670894 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29842a669a20408b881105135f76cb0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39edf587afe94b60911198aa0bb61613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:56.736355 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-5a77d8aa-1911-4d5c-bef7-12b0c8670894 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] 10.222.0.43 "GET /compute/v2.1/servers/f3a0dc37-502e-48d3-9537-10dd7fb15e94" status: 200 len: 1316 microversion: 2.1 time: 0.333681 Oct 04 21:45:56.736929 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 349/705] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:56 2022] GET /compute/v2.1/servers/f3a0dc37-502e-48d3-9537-10dd7fb15e94 => generated 1316 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:45:56.782299 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-65fdca6b-4f41-4c8d-9161-d2730a207248 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87616cd16995468ab7febf5aa4b284db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e3bf9149434d34b6762aaeef1478ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:56.790225 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-65fdca6b-4f41-4c8d-9161-d2730a207248 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] 10.222.0.43 "GET /compute/v2.1/servers/58b5b55c-fd7d-4a43-96af-01ae27cb29de" status: 200 len: 1314 microversion: 2.1 time: 0.349622 Oct 04 21:45:56.791059 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-6367af92-606c-4646-81ee-4646655a59d5 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:56.791180 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 357/706] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:56 2022] GET /compute/v2.1/servers/58b5b55c-fd7d-4a43-96af-01ae27cb29de => generated 1314 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:45:56.791914 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-6367af92-606c-4646-81ee-4646655a59d5 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 10062905-54d7-47e2-b621-522e0954b72b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:56.797940 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6367af92-606c-4646-81ee-4646655a59d5 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:56.798518 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6367af92-606c-4646-81ee-4646655a59d5 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:56.798885 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6367af92-606c-4646-81ee-4646655a59d5 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:56.799595 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6367af92-606c-4646-81ee-4646655a59d5 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:56.800044 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6367af92-606c-4646-81ee-4646655a59d5 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:56.800663 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6367af92-606c-4646-81ee-4646655a59d5 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:56.946792 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-3294d57d-8068-4471-893b-554f692e12db tempest-ServersAdminNegativeTestJSON-223082715 tempest-ServersAdminNegativeTestJSON-223082715-project-admin] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:56.947342 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-3294d57d-8068-4471-893b-554f692e12db tempest-ServersAdminNegativeTestJSON-223082715 tempest-ServersAdminNegativeTestJSON-223082715-project-admin] [instance: caabd624-94e3-4d85-9038-2f3beeabfda9] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:56.953466 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3294d57d-8068-4471-893b-554f692e12db tempest-ServersAdminNegativeTestJSON-223082715 tempest-ServersAdminNegativeTestJSON-223082715-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:56.953960 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3294d57d-8068-4471-893b-554f692e12db tempest-ServersAdminNegativeTestJSON-223082715 tempest-ServersAdminNegativeTestJSON-223082715-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:56.954438 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3294d57d-8068-4471-893b-554f692e12db tempest-ServersAdminNegativeTestJSON-223082715 tempest-ServersAdminNegativeTestJSON-223082715-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:56.955143 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3294d57d-8068-4471-893b-554f692e12db tempest-ServersAdminNegativeTestJSON-223082715 tempest-ServersAdminNegativeTestJSON-223082715-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:56.955597 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3294d57d-8068-4471-893b-554f692e12db tempest-ServersAdminNegativeTestJSON-223082715 tempest-ServersAdminNegativeTestJSON-223082715-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:56.956024 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3294d57d-8068-4471-893b-554f692e12db tempest-ServersAdminNegativeTestJSON-223082715 tempest-ServersAdminNegativeTestJSON-223082715-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:57.361329 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-6367af92-606c-4646-81ee-4646655a59d5 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ad048becf474fb972d4291422d810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dcfc7024fc49388c4bd5f25f03e60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:57.370023 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-6367af92-606c-4646-81ee-4646655a59d5 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/10062905-54d7-47e2-b621-522e0954b72b" status: 200 len: 1311 microversion: 2.1 time: 0.582867 Oct 04 21:45:57.370866 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 350/707] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:56 2022] GET /compute/v2.1/servers/10062905-54d7-47e2-b621-522e0954b72b => generated 1311 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:45:57.375275 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-af90c268-7c6a-452c-ad24-4fbe518a880d tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:57.375910 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-af90c268-7c6a-452c-ad24-4fbe518a880d tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] [instance: 659208f3-1bef-41f7-9616-50c2db9f46ba] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:57.378149 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-3294d57d-8068-4471-893b-554f692e12db tempest-ServersAdminNegativeTestJSON-223082715 tempest-ServersAdminNegativeTestJSON-223082715-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/caabd624-94e3-4d85-9038-2f3beeabfda9" status: 200 len: 1630 microversion: 2.1 time: 0.435584 Oct 04 21:45:57.387658 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 358/708] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:56 2022] GET /compute/v2.1/servers/caabd624-94e3-4d85-9038-2f3beeabfda9 => generated 1630 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:45:57.388079 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-af90c268-7c6a-452c-ad24-4fbe518a880d tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:57.388079 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-af90c268-7c6a-452c-ad24-4fbe518a880d tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:57.388079 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-af90c268-7c6a-452c-ad24-4fbe518a880d tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:57.388079 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-af90c268-7c6a-452c-ad24-4fbe518a880d tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:57.388435 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-af90c268-7c6a-452c-ad24-4fbe518a880d tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:57.388536 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-b616656a-9f64-4cd3-87ec-588eaebbeddd tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:57.388630 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-af90c268-7c6a-452c-ad24-4fbe518a880d tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:57.388719 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-b616656a-9f64-4cd3-87ec-588eaebbeddd tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] [instance: 1e9957cf-cfeb-483d-bc32-73ca72a54eb9] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:57.394215 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b616656a-9f64-4cd3-87ec-588eaebbeddd tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:57.394827 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b616656a-9f64-4cd3-87ec-588eaebbeddd tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:57.395337 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b616656a-9f64-4cd3-87ec-588eaebbeddd tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:57.396108 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b616656a-9f64-4cd3-87ec-588eaebbeddd tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:57.396641 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b616656a-9f64-4cd3-87ec-588eaebbeddd tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:57.397157 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b616656a-9f64-4cd3-87ec-588eaebbeddd tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:57.791339 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-af90c268-7c6a-452c-ad24-4fbe518a880d tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:57.799950 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-af90c268-7c6a-452c-ad24-4fbe518a880d tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:57.801510 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-af90c268-7c6a-452c-ad24-4fbe518a880d tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:57.803055 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-af90c268-7c6a-452c-ad24-4fbe518a880d tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] 10.222.0.43 "GET /compute/v2.1/servers/659208f3-1bef-41f7-9616-50c2db9f46ba" status: 200 len: 1568 microversion: 2.25 time: 0.431474 Oct 04 21:45:57.803789 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 351/709] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:45:57 2022] GET /compute/v2.1/servers/659208f3-1bef-41f7-9616-50c2db9f46ba => generated 1568 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:45:57.804025 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-b616656a-9f64-4cd3-87ec-588eaebbeddd tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2dff38dea346219f6534426fd27ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6a5f1476ac48f3831f2ed202dacdf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:57.809607 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-91be381f-e9b2-48c0-8da4-64dfc85d1433 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:57.810552 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-91be381f-e9b2-48c0-8da4-64dfc85d1433 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: a2d1b827-a865-4d56-a665-110d0541a669] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:57.814835 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-b616656a-9f64-4cd3-87ec-588eaebbeddd tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] 10.222.0.43 "GET /compute/v2.1/servers/1e9957cf-cfeb-483d-bc32-73ca72a54eb9" status: 200 len: 1370 microversion: 2.1 time: 0.434575 Oct 04 21:45:57.815792 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 359/710] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:57 2022] GET /compute/v2.1/servers/1e9957cf-cfeb-483d-bc32-73ca72a54eb9 => generated 1370 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:45:57.817376 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-91be381f-e9b2-48c0-8da4-64dfc85d1433 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:57.818078 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-91be381f-e9b2-48c0-8da4-64dfc85d1433 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:57.818631 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-91be381f-e9b2-48c0-8da4-64dfc85d1433 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:57.819933 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-91be381f-e9b2-48c0-8da4-64dfc85d1433 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:57.820471 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-91be381f-e9b2-48c0-8da4-64dfc85d1433 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:57.820978 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-91be381f-e9b2-48c0-8da4-64dfc85d1433 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:57.828343 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-6070b21a-2465-4d9d-8eb3-66b8ff39266c req-dcf99e74-4bdc-400c-9dcb-40fa31ece3fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10062905-54d7-47e2-b621-522e0954b72b", "name": "network-vif-plugged", "status": "completed", "tag": "f5b5fac6-bb2d-4a99-a6db-4f032a197633"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:45:57.835419 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:45:57.841639 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-6070b21a-2465-4d9d-8eb3-66b8ff39266c req-dcf99e74-4bdc-400c-9dcb-40fa31ece3fc service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:57.842991 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-6070b21a-2465-4d9d-8eb3-66b8ff39266c req-dcf99e74-4bdc-400c-9dcb-40fa31ece3fc service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:57.843438 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-6070b21a-2465-4d9d-8eb3-66b8ff39266c req-dcf99e74-4bdc-400c-9dcb-40fa31ece3fc service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:57.857325 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-6070b21a-2465-4d9d-8eb3-66b8ff39266c req-dcf99e74-4bdc-400c-9dcb-40fa31ece3fc service nova] Creating event network-vif-plugged:f5b5fac6-bb2d-4a99-a6db-4f032a197633 for instance 10062905-54d7-47e2-b621-522e0954b72b on n-h1-860284-1 Oct 04 21:45:57.862933 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-6070b21a-2465-4d9d-8eb3-66b8ff39266c req-dcf99e74-4bdc-400c-9dcb-40fa31ece3fc service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045632 Oct 04 21:45:57.867259 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 360/711] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:45:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:45:57.873795 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-eef402e0-6b8c-4347-a89c-1ba17c4afbda tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:57.874544 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-eef402e0-6b8c-4347-a89c-1ba17c4afbda tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] [instance: f3a0dc37-502e-48d3-9537-10dd7fb15e94] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:57.880979 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-eef402e0-6b8c-4347-a89c-1ba17c4afbda tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:57.881474 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-eef402e0-6b8c-4347-a89c-1ba17c4afbda tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:57.882604 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-eef402e0-6b8c-4347-a89c-1ba17c4afbda tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:57.883461 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-eef402e0-6b8c-4347-a89c-1ba17c4afbda tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:57.883963 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-eef402e0-6b8c-4347-a89c-1ba17c4afbda tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:57.884401 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-eef402e0-6b8c-4347-a89c-1ba17c4afbda tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:58.122439 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell0:SELECT=16 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:45:58.207479 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-91be381f-e9b2-48c0-8da4-64dfc85d1433 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:58.217135 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-91be381f-e9b2-48c0-8da4-64dfc85d1433 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/a2d1b827-a865-4d56-a665-110d0541a669" status: 200 len: 1475 microversion: 2.1 time: 0.411343 Oct 04 21:45:58.217811 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 352/712] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:57 2022] GET /compute/v2.1/servers/a2d1b827-a865-4d56-a665-110d0541a669 => generated 1475 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:45:58.218629 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-eef402e0-6b8c-4347-a89c-1ba17c4afbda tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29842a669a20408b881105135f76cb0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39edf587afe94b60911198aa0bb61613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:58.222729 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-2d664389-e5bc-4490-9f4e-d20f33778d64 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:58.223423 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-2d664389-e5bc-4490-9f4e-d20f33778d64 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] [instance: 58b5b55c-fd7d-4a43-96af-01ae27cb29de] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:58.227419 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-eef402e0-6b8c-4347-a89c-1ba17c4afbda tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] 10.222.0.43 "GET /compute/v2.1/servers/f3a0dc37-502e-48d3-9537-10dd7fb15e94" status: 200 len: 1316 microversion: 2.1 time: 0.358760 Oct 04 21:45:58.228125 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 361/713] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:57 2022] GET /compute/v2.1/servers/f3a0dc37-502e-48d3-9537-10dd7fb15e94 => generated 1316 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:45:58.230020 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2d664389-e5bc-4490-9f4e-d20f33778d64 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:58.230609 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2d664389-e5bc-4490-9f4e-d20f33778d64 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:58.231098 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2d664389-e5bc-4490-9f4e-d20f33778d64 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:58.231958 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2d664389-e5bc-4490-9f4e-d20f33778d64 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:58.232515 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2d664389-e5bc-4490-9f4e-d20f33778d64 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:58.233040 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2d664389-e5bc-4490-9f4e-d20f33778d64 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:58.276998 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell0:SELECT=14 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:45:58.394571 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-eb2da06e-7b6b-4dc0-ab7d-c720d5b1fa32 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:58.395182 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-eb2da06e-7b6b-4dc0-ab7d-c720d5b1fa32 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 10062905-54d7-47e2-b621-522e0954b72b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:58.399274 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-2d664389-e5bc-4490-9f4e-d20f33778d64 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87616cd16995468ab7febf5aa4b284db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e3bf9149434d34b6762aaeef1478ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:58.402984 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-eb2da06e-7b6b-4dc0-ab7d-c720d5b1fa32 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:58.403487 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-eb2da06e-7b6b-4dc0-ab7d-c720d5b1fa32 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:58.404198 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-eb2da06e-7b6b-4dc0-ab7d-c720d5b1fa32 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:58.404885 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-eb2da06e-7b6b-4dc0-ab7d-c720d5b1fa32 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:58.405354 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-eb2da06e-7b6b-4dc0-ab7d-c720d5b1fa32 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:58.405844 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-eb2da06e-7b6b-4dc0-ab7d-c720d5b1fa32 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:58.408578 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-2d664389-e5bc-4490-9f4e-d20f33778d64 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] 10.222.0.43 "GET /compute/v2.1/servers/58b5b55c-fd7d-4a43-96af-01ae27cb29de" status: 200 len: 1314 microversion: 2.1 time: 0.189620 Oct 04 21:45:58.409447 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 353/714] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:58 2022] GET /compute/v2.1/servers/58b5b55c-fd7d-4a43-96af-01ae27cb29de => generated 1314 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:45:58.429418 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-4403246d-9dc3-426b-b71e-563e0feb2454 tempest-ServersAdminNegativeTestJSON-223082715 tempest-ServersAdminNegativeTestJSON-223082715-project-admin] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:58.429677 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-4403246d-9dc3-426b-b71e-563e0feb2454 tempest-ServersAdminNegativeTestJSON-223082715 tempest-ServersAdminNegativeTestJSON-223082715-project-admin] [instance: caabd624-94e3-4d85-9038-2f3beeabfda9] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:58.436011 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4403246d-9dc3-426b-b71e-563e0feb2454 tempest-ServersAdminNegativeTestJSON-223082715 tempest-ServersAdminNegativeTestJSON-223082715-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:58.436499 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4403246d-9dc3-426b-b71e-563e0feb2454 tempest-ServersAdminNegativeTestJSON-223082715 tempest-ServersAdminNegativeTestJSON-223082715-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:58.436932 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4403246d-9dc3-426b-b71e-563e0feb2454 tempest-ServersAdminNegativeTestJSON-223082715 tempest-ServersAdminNegativeTestJSON-223082715-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:58.437629 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4403246d-9dc3-426b-b71e-563e0feb2454 tempest-ServersAdminNegativeTestJSON-223082715 tempest-ServersAdminNegativeTestJSON-223082715-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:58.438145 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4403246d-9dc3-426b-b71e-563e0feb2454 tempest-ServersAdminNegativeTestJSON-223082715 tempest-ServersAdminNegativeTestJSON-223082715-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:58.438542 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4403246d-9dc3-426b-b71e-563e0feb2454 tempest-ServersAdminNegativeTestJSON-223082715 tempest-ServersAdminNegativeTestJSON-223082715-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:58.611545 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-eb2da06e-7b6b-4dc0-ab7d-c720d5b1fa32 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ad048becf474fb972d4291422d810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dcfc7024fc49388c4bd5f25f03e60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:58.622274 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-4403246d-9dc3-426b-b71e-563e0feb2454 tempest-ServersAdminNegativeTestJSON-223082715 tempest-ServersAdminNegativeTestJSON-223082715-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/caabd624-94e3-4d85-9038-2f3beeabfda9" status: 200 len: 1613 microversion: 2.1 time: 0.197769 Oct 04 21:45:58.623100 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 354/715] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:58 2022] GET /compute/v2.1/servers/caabd624-94e3-4d85-9038-2f3beeabfda9 => generated 1613 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:45:58.623249 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-eb2da06e-7b6b-4dc0-ab7d-c720d5b1fa32 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/10062905-54d7-47e2-b621-522e0954b72b" status: 200 len: 1311 microversion: 2.1 time: 0.233589 Oct 04 21:45:58.623780 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 362/716] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:58 2022] GET /compute/v2.1/servers/10062905-54d7-47e2-b621-522e0954b72b => generated 1311 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:45:58.645318 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-46b3567f-4251-4c07-b46b-3e95a2bc351a tempest-ServersAdminNegativeTestJSON-223082715 tempest-ServersAdminNegativeTestJSON-223082715-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:45:58.645889 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-46b3567f-4251-4c07-b46b-3e95a2bc351a tempest-ServersAdminNegativeTestJSON-223082715 tempest-ServersAdminNegativeTestJSON-223082715-project-admin] [instance: caabd624-94e3-4d85-9038-2f3beeabfda9] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:58.652356 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-46b3567f-4251-4c07-b46b-3e95a2bc351a tempest-ServersAdminNegativeTestJSON-223082715 tempest-ServersAdminNegativeTestJSON-223082715-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:58.652872 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-46b3567f-4251-4c07-b46b-3e95a2bc351a tempest-ServersAdminNegativeTestJSON-223082715 tempest-ServersAdminNegativeTestJSON-223082715-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:58.653294 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-46b3567f-4251-4c07-b46b-3e95a2bc351a tempest-ServersAdminNegativeTestJSON-223082715 tempest-ServersAdminNegativeTestJSON-223082715-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:58.653989 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-46b3567f-4251-4c07-b46b-3e95a2bc351a tempest-ServersAdminNegativeTestJSON-223082715 tempest-ServersAdminNegativeTestJSON-223082715-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:58.654487 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-46b3567f-4251-4c07-b46b-3e95a2bc351a tempest-ServersAdminNegativeTestJSON-223082715 tempest-ServersAdminNegativeTestJSON-223082715-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:58.654902 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-46b3567f-4251-4c07-b46b-3e95a2bc351a tempest-ServersAdminNegativeTestJSON-223082715 tempest-ServersAdminNegativeTestJSON-223082715-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:58.744890 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-46b3567f-4251-4c07-b46b-3e95a2bc351a tempest-ServersAdminNegativeTestJSON-223082715 tempest-ServersAdminNegativeTestJSON-223082715-project-admin] HTTP exception thrown: Cannot 'migrate' instance caabd624-94e3-4d85-9038-2f3beeabfda9 while it is in vm_state suspended Oct 04 21:45:58.746980 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-46b3567f-4251-4c07-b46b-3e95a2bc351a tempest-ServersAdminNegativeTestJSON-223082715 tempest-ServersAdminNegativeTestJSON-223082715-project-admin] Request method failure captured: Oct 04 21:45:58.746980 n-d-860284-1 devstack@n-api.service[134102]: request: POST /compute/v2.1/servers/caabd624-94e3-4d85-9038-2f3beeabfda9/action HTTP/1.1 Oct 04 21:45:58.746980 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 21:45:58.746980 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 21:45:58.746980 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 21:45:58.746980 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 15 Oct 04 21:45:58.746980 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 21:45:58.746980 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 21:45:58.746980 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 21:45:58.746980 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 21:45:58.746980 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPKlcstBJ_e_eeicTLFBoLhbdLHdHmVyiojKBIkDG0BEXG377WAXANmxI5NFEUJ5lkQPvbASA8odpcSKsCBGedAQ2Y0tpGO57llrsYPR8FRbOCVTkRBNhcLHFXTlWYVX2CJVAu156o3i327YyTGalKfNz4UCTjp0VDuviBqffepolLGQ Oct 04 21:45:58.746980 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 21:45:58.746980 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 21:45:58.746980 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 21:45:58.746980 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 21:45:58.746980 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 21:45:58.746980 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 21:45:58.746980 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: 1b19a1a36fbf4edcbee78e73a2e3aca4 Oct 04 21:45:58.746980 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-223082715 Oct 04 21:45:58.746980 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,admin,member Oct 04 21:45:58.746980 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,admin,member Oct 04 21:45:58.748737 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1b19a1a36fbf4edcbee78e73a2e3aca4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_1b19a1a36fbf4edcbee78e73a2e3aca4", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1b19a1a36fbf4edcbee78e73a2e3aca4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/1b19a1a36fbf4edcbee78e73a2e3aca4"}]}] Oct 04 21:45:58.748737 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-ServersAdminNegativeTestJSON-223082715 Oct 04 21:45:58.748737 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: 1b19a1a36fbf4edcbee78e73a2e3aca4 Oct 04 21:45:58.748737 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-223082715 Oct 04 21:45:58.748737 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-ServersAdminNegativeTestJSON-223082715-project-admin Oct 04 21:45:58.748737 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 21:45:58.748737 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 21:45:58.748737 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: ff041b1766904d4e8a4e54f29620d8b3 Oct 04 21:45:58.748737 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-ServersAdminNegativeTestJSON-223082715-project-admin Oct 04 21:45:58.748737 n-d-860284-1 devstack@n-api.service[134102]: Oct 04 21:45:58.748737 n-d-860284-1 devstack@n-api.service[134102]: {"migrate": {}} Oct 04 21:45:58.748737 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 21:45:58.748737 n-d-860284-1 devstack@n-api.service[134102]: exception: Cannot 'migrate' instance caabd624-94e3-4d85-9038-2f3beeabfda9 while it is in vm_state suspended Oct 04 21:45:58.749935 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': 'caabd624-94e3-4d85-9038-2f3beeabfda9', 'body': {'migrate': {}}} Oct 04 21:45:58.749935 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:45:58.749935 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:45:58.749935 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Oct 04 21:45:58.749935 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Oct 04 21:45:58.749935 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 04 21:45:58.749935 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 21:45:58.749935 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 04 21:45:58.749935 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 21:45:58.749935 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 04 21:45:58.749935 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 21:45:58.749935 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 21:45:58.749935 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 21:45:58.749935 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 04 21:45:58.749935 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 04 21:45:58.749935 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance caabd624-94e3-4d85-9038-2f3beeabfda9 in vm_state suspended. Cannot resize while the instance is in this state. Oct 04 21:45:58.749935 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:45:58.749935 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:45:58.749935 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:45:58.749935 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:45:58.751445 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:45:58.751445 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:45:58.751445 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:45:58.751445 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:45:58.751445 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:45:58.751445 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:45:58.751445 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:45:58.751445 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:45:58.751445 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 69, in _migrate Oct 04 21:45:58.751445 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 04 21:45:58.751445 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 04 21:45:58.751445 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 21:45:58.751445 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'migrate' instance caabd624-94e3-4d85-9038-2f3beeabfda9 while it is in vm_state suspended Oct 04 21:45:58.751445 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:45:58.751445 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:45:58.751445 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:45:58.751445 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:45:58.751445 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:45:58.751445 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:45:58.752803 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:45:58.752803 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:45:58.752803 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'migrate' instance caabd624-94e3-4d85-9038-2f3beeabfda9 while it is in vm_state suspended Oct 04 21:45:58.752803 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:45:58.752803 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-46b3567f-4251-4c07-b46b-3e95a2bc351a tempest-ServersAdminNegativeTestJSON-223082715 tempest-ServersAdminNegativeTestJSON-223082715-project-admin] Returning 409 to user: Cannot 'migrate' instance caabd624-94e3-4d85-9038-2f3beeabfda9 while it is in vm_state suspended {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:45:58.752803 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-46b3567f-4251-4c07-b46b-3e95a2bc351a tempest-ServersAdminNegativeTestJSON-223082715 tempest-ServersAdminNegativeTestJSON-223082715-project-admin] 10.222.0.43 "POST /compute/v2.1/servers/caabd624-94e3-4d85-9038-2f3beeabfda9/action" status: 409 len: 148 microversion: 2.1 time: 0.107055 Oct 04 21:45:58.752803 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 355/717] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 21:45:58 2022] POST /compute/v2.1/servers/caabd624-94e3-4d85-9038-2f3beeabfda9/action => generated 148 bytes in 108 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 21:45:58.761583 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-720de224-c04d-4554-bf64-a71359a25974 tempest-ServersAdminNegativeTestJSON-223082715 tempest-ServersAdminNegativeTestJSON-223082715-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:45:58.765220 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-720de224-c04d-4554-bf64-a71359a25974 tempest-ServersAdminNegativeTestJSON-223082715 tempest-ServersAdminNegativeTestJSON-223082715-project-admin] Request method failure captured: Oct 04 21:45:58.765220 n-d-860284-1 devstack@n-api.service[134101]: request: POST /compute/v2.1/servers/049f396b-7494-4b40-ad21-c3401958088b/action HTTP/1.1 Oct 04 21:45:58.765220 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 21:45:58.765220 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 21:45:58.765220 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 21:45:58.765220 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 39 Oct 04 21:45:58.765220 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 21:45:58.765220 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 21:45:58.765220 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 21:45:58.765220 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 21:45:58.765220 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPKlcstBJ_e_eeicTLFBoLhbdLHdHmVyiojKBIkDG0BEXG377WAXANmxI5NFEUJ5lkQPvbASA8odpcSKsCBGedAQ2Y0tpGO57llrsYPR8FRbOCVTkRBNhcLHFXTlWYVX2CJVAu156o3i327YyTGalKfNz4UCTjp0VDuviBqffepolLGQ Oct 04 21:45:58.765220 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 21:45:58.765220 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 21:45:58.765220 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 21:45:58.765220 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 21:45:58.765220 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 21:45:58.765220 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 21:45:58.765220 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: 1b19a1a36fbf4edcbee78e73a2e3aca4 Oct 04 21:45:58.765220 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-223082715 Oct 04 21:45:58.765220 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,admin,member Oct 04 21:45:58.765220 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,admin,member Oct 04 21:45:58.766731 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1b19a1a36fbf4edcbee78e73a2e3aca4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_1b19a1a36fbf4edcbee78e73a2e3aca4", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1b19a1a36fbf4edcbee78e73a2e3aca4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/1b19a1a36fbf4edcbee78e73a2e3aca4"}]}] Oct 04 21:45:58.766731 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-ServersAdminNegativeTestJSON-223082715 Oct 04 21:45:58.766731 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: 1b19a1a36fbf4edcbee78e73a2e3aca4 Oct 04 21:45:58.766731 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-223082715 Oct 04 21:45:58.766731 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-ServersAdminNegativeTestJSON-223082715-project-admin Oct 04 21:45:58.766731 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 21:45:58.766731 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 21:45:58.766731 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: ff041b1766904d4e8a4e54f29620d8b3 Oct 04 21:45:58.766731 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-ServersAdminNegativeTestJSON-223082715-project-admin Oct 04 21:45:58.766731 n-d-860284-1 devstack@n-api.service[134101]: Oct 04 21:45:58.766731 n-d-860284-1 devstack@n-api.service[134101]: {"os-resetState": {"state": "invalid"}} Oct 04 21:45:58.766731 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 21:45:58.767740 n-d-860284-1 devstack@n-api.service[134101]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 04 21:45:58.767740 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': '049f396b-7494-4b40-ad21-c3401958088b', 'body': {'os-resetState': {'state': 'invalid'}}} Oct 04 21:45:58.767740 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:45:58.767740 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:45:58.767740 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 21:45:58.767740 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 21:45:58.767740 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 21:45:58.767740 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise error Oct 04 21:45:58.767740 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] Oct 04 21:45:58.767740 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:45:58.767740 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: Oct 04 21:45:58.767740 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Oct 04 21:45:58.767740 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:45:58.767740 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Oct 04 21:45:58.767740 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi 'invalid' Oct 04 21:45:58.767740 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:45:58.767740 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:45:58.767740 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:45:58.767740 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:45:58.767740 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:45:58.767740 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:45:58.767740 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:45:58.769234 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:45:58.769234 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:45:58.769234 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:45:58.769234 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 21:45:58.769234 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 21:45:58.769234 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 21:45:58.769234 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 21:45:58.769234 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 21:45:58.769234 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 21:45:58.769234 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 04 21:45:58.769234 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:45:58.769234 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:45:58.769234 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:45:58.769234 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:45:58.769234 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:45:58.769234 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:45:58.769234 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 21:45:58.769234 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 21:45:58.769234 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 04 21:45:58.770502 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:45:58.770502 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-720de224-c04d-4554-bf64-a71359a25974 tempest-ServersAdminNegativeTestJSON-223082715 tempest-ServersAdminNegativeTestJSON-223082715-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:45:58.770502 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-720de224-c04d-4554-bf64-a71359a25974 tempest-ServersAdminNegativeTestJSON-223082715 tempest-ServersAdminNegativeTestJSON-223082715-project-admin] 10.222.0.43 "POST /compute/v2.1/servers/049f396b-7494-4b40-ad21-c3401958088b/action" status: 400 len: 144 microversion: 2.1 time: 0.009003 Oct 04 21:45:58.770502 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 363/718] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 21:45:58 2022] POST /compute/v2.1/servers/049f396b-7494-4b40-ad21-c3401958088b/action => generated 144 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 04 21:45:58.778011 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-b73c4671-32a3-42e0-8716-fe654093f9c8 tempest-ServersAdminNegativeTestJSON-223082715 tempest-ServersAdminNegativeTestJSON-223082715-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:45:58.789992 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-b73c4671-32a3-42e0-8716-fe654093f9c8 tempest-ServersAdminNegativeTestJSON-223082715 tempest-ServersAdminNegativeTestJSON-223082715-project-admin] Request method failure captured: Oct 04 21:45:58.789992 n-d-860284-1 devstack@n-api.service[134102]: request: POST /compute/v2.1/servers/049f396b-7494-4b40-ad21-c3401958088b/action HTTP/1.1 Oct 04 21:45:58.789992 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 21:45:58.789992 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 21:45:58.789992 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 21:45:58.789992 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 31 Oct 04 21:45:58.789992 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 21:45:58.789992 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 21:45:58.789992 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 21:45:58.789992 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 21:45:58.789992 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPKlcstBJ_e_eeicTLFBoLhbdLHdHmVyiojKBIkDG0BEXG377WAXANmxI5NFEUJ5lkQPvbASA8odpcSKsCBGedAQ2Y0tpGO57llrsYPR8FRbOCVTkRBNhcLHFXTlWYVX2CJVAu156o3i327YyTGalKfNz4UCTjp0VDuviBqffepolLGQ Oct 04 21:45:58.789992 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 21:45:58.789992 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 21:45:58.789992 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 21:45:58.789992 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 21:45:58.789992 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 21:45:58.789992 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 21:45:58.789992 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: 1b19a1a36fbf4edcbee78e73a2e3aca4 Oct 04 21:45:58.789992 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-223082715 Oct 04 21:45:58.789992 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,admin,member Oct 04 21:45:58.789992 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,admin,member Oct 04 21:45:58.791665 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1b19a1a36fbf4edcbee78e73a2e3aca4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_1b19a1a36fbf4edcbee78e73a2e3aca4", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1b19a1a36fbf4edcbee78e73a2e3aca4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/1b19a1a36fbf4edcbee78e73a2e3aca4"}]}] Oct 04 21:45:58.791665 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-ServersAdminNegativeTestJSON-223082715 Oct 04 21:45:58.791665 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: 1b19a1a36fbf4edcbee78e73a2e3aca4 Oct 04 21:45:58.791665 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-223082715 Oct 04 21:45:58.791665 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-ServersAdminNegativeTestJSON-223082715-project-admin Oct 04 21:45:58.791665 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 21:45:58.791665 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 21:45:58.791665 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: ff041b1766904d4e8a4e54f29620d8b3 Oct 04 21:45:58.791665 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-ServersAdminNegativeTestJSON-223082715-project-admin Oct 04 21:45:58.791665 n-d-860284-1 devstack@n-api.service[134102]: Oct 04 21:45:58.791665 n-d-860284-1 devstack@n-api.service[134102]: {"os-resetState": {"state": 1}} Oct 04 21:45:58.791665 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 21:45:58.791665 n-d-860284-1 devstack@n-api.service[134102]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 04 21:45:58.792559 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': '049f396b-7494-4b40-ad21-c3401958088b', 'body': {'os-resetState': {'state': 1}}} Oct 04 21:45:58.792559 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:45:58.792559 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:45:58.792559 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 21:45:58.792559 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 21:45:58.792559 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 21:45:58.792559 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise error Oct 04 21:45:58.792559 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' Oct 04 21:45:58.792559 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:45:58.792559 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: Oct 04 21:45:58.792559 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Oct 04 21:45:58.792559 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:45:58.792559 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Oct 04 21:45:58.792559 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi 1 Oct 04 21:45:58.792559 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:45:58.792559 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:45:58.792559 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:45:58.792559 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:45:58.792559 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:45:58.792559 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:45:58.792559 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:45:58.792559 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:45:58.794064 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:45:58.794064 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:45:58.794064 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 21:45:58.794064 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 21:45:58.794064 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 21:45:58.794064 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 21:45:58.794064 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 21:45:58.794064 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 21:45:58.794064 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 04 21:45:58.794064 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:45:58.794064 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:45:58.794064 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:45:58.794064 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:45:58.794064 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:45:58.794064 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:45:58.794064 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 21:45:58.794064 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 21:45:58.794064 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 04 21:45:58.794064 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:45:58.795471 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-b73c4671-32a3-42e0-8716-fe654093f9c8 tempest-ServersAdminNegativeTestJSON-223082715 tempest-ServersAdminNegativeTestJSON-223082715-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:45:58.795471 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-b73c4671-32a3-42e0-8716-fe654093f9c8 tempest-ServersAdminNegativeTestJSON-223082715 tempest-ServersAdminNegativeTestJSON-223082715-project-admin] 10.222.0.43 "POST /compute/v2.1/servers/049f396b-7494-4b40-ad21-c3401958088b/action" status: 400 len: 120 microversion: 2.1 time: 0.017461 Oct 04 21:45:58.795471 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 356/719] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 21:45:58 2022] POST /compute/v2.1/servers/049f396b-7494-4b40-ad21-c3401958088b/action => generated 120 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 21:45:58.801128 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e88c5802-db2d-471a-8bbc-9ec96bd5d7a1 tempest-ServersAdminNegativeTestJSON-223082715 tempest-ServersAdminNegativeTestJSON-223082715-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:45:58.803638 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-e88c5802-db2d-471a-8bbc-9ec96bd5d7a1 tempest-ServersAdminNegativeTestJSON-223082715 tempest-ServersAdminNegativeTestJSON-223082715-project-admin] Failed to fetch instance by id 999 {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 04 21:45:58.804217 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-e88c5802-db2d-471a-8bbc-9ec96bd5d7a1 tempest-ServersAdminNegativeTestJSON-223082715 tempest-ServersAdminNegativeTestJSON-223082715-project-admin] HTTP exception thrown: Instance 999 could not be found. Oct 04 21:45:58.812943 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e88c5802-db2d-471a-8bbc-9ec96bd5d7a1 tempest-ServersAdminNegativeTestJSON-223082715 tempest-ServersAdminNegativeTestJSON-223082715-project-admin] Request method failure captured: Oct 04 21:45:58.812943 n-d-860284-1 devstack@n-api.service[134101]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 Oct 04 21:45:58.812943 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 21:45:58.812943 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 21:45:58.812943 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 21:45:58.812943 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 37 Oct 04 21:45:58.812943 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 21:45:58.812943 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 21:45:58.812943 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 21:45:58.812943 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 21:45:58.812943 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPKlcstBJ_e_eeicTLFBoLhbdLHdHmVyiojKBIkDG0BEXG377WAXANmxI5NFEUJ5lkQPvbASA8odpcSKsCBGedAQ2Y0tpGO57llrsYPR8FRbOCVTkRBNhcLHFXTlWYVX2CJVAu156o3i327YyTGalKfNz4UCTjp0VDuviBqffepolLGQ Oct 04 21:45:58.812943 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 21:45:58.812943 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 21:45:58.812943 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 21:45:58.812943 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 21:45:58.812943 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 21:45:58.812943 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 21:45:58.812943 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: 1b19a1a36fbf4edcbee78e73a2e3aca4 Oct 04 21:45:58.812943 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-223082715 Oct 04 21:45:58.812943 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,admin,member Oct 04 21:45:58.812943 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,admin,member Oct 04 21:45:58.814507 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1b19a1a36fbf4edcbee78e73a2e3aca4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_1b19a1a36fbf4edcbee78e73a2e3aca4", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1b19a1a36fbf4edcbee78e73a2e3aca4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/1b19a1a36fbf4edcbee78e73a2e3aca4"}]}] Oct 04 21:45:58.814507 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-ServersAdminNegativeTestJSON-223082715 Oct 04 21:45:58.814507 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: 1b19a1a36fbf4edcbee78e73a2e3aca4 Oct 04 21:45:58.814507 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-223082715 Oct 04 21:45:58.814507 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-ServersAdminNegativeTestJSON-223082715-project-admin Oct 04 21:45:58.814507 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 21:45:58.814507 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 21:45:58.814507 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: ff041b1766904d4e8a4e54f29620d8b3 Oct 04 21:45:58.814507 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-ServersAdminNegativeTestJSON-223082715-project-admin Oct 04 21:45:58.814507 n-d-860284-1 devstack@n-api.service[134101]: Oct 04 21:45:58.814507 n-d-860284-1 devstack@n-api.service[134101]: {"os-resetState": {"state": "error"}} Oct 04 21:45:58.814507 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 21:45:58.814507 n-d-860284-1 devstack@n-api.service[134101]: exception: Instance 999 could not be found. Oct 04 21:45:58.815468 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} Oct 04 21:45:58.815468 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:45:58.815468 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:45:58.815468 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:45:58.815468 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:45:58.815468 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 04 21:45:58.815468 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 04 21:45:58.815468 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Oct 04 21:45:58.815468 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:45:58.815468 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:45:58.815468 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:45:58.815468 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:45:58.815468 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:45:58.815468 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:45:58.815468 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:45:58.815468 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:45:58.815468 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:45:58.815468 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:45:58.815468 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:45:58.815468 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:45:58.815468 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state Oct 04 21:45:58.816935 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 04 21:45:58.816935 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:45:58.816935 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:45:58.816935 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Oct 04 21:45:58.816935 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:45:58.816935 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:45:58.816935 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:45:58.816935 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:45:58.816935 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:45:58.816935 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:45:58.816935 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:45:58.816935 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:45:58.816935 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Oct 04 21:45:58.816935 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:45:58.816935 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e88c5802-db2d-471a-8bbc-9ec96bd5d7a1 tempest-ServersAdminNegativeTestJSON-223082715 tempest-ServersAdminNegativeTestJSON-223082715-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:45:58.816935 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-e88c5802-db2d-471a-8bbc-9ec96bd5d7a1 tempest-ServersAdminNegativeTestJSON-223082715 tempest-ServersAdminNegativeTestJSON-223082715-project-admin] 10.222.0.43 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.017108 Oct 04 21:45:58.818172 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 364/720] 10.222.0.43 () {60 vars in 1179 bytes} [Tue Oct 4 21:45:58 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 04 21:45:58.825036 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-d624d7c8-621a-4047-a33b-059742048855 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:58.825553 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-d624d7c8-621a-4047-a33b-059742048855 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] [instance: caabd624-94e3-4d85-9038-2f3beeabfda9] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:58.831561 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d624d7c8-621a-4047-a33b-059742048855 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:58.832043 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d624d7c8-621a-4047-a33b-059742048855 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:58.832473 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d624d7c8-621a-4047-a33b-059742048855 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:58.833165 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d624d7c8-621a-4047-a33b-059742048855 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:58.833737 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d624d7c8-621a-4047-a33b-059742048855 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:58.834167 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d624d7c8-621a-4047-a33b-059742048855 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:58.839101 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-8027a50e-2ab9-4806-b6ef-37a0ef8cd017 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:58.839722 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-8027a50e-2ab9-4806-b6ef-37a0ef8cd017 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] [instance: 1e9957cf-cfeb-483d-bc32-73ca72a54eb9] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:58.845729 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8027a50e-2ab9-4806-b6ef-37a0ef8cd017 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:58.846236 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8027a50e-2ab9-4806-b6ef-37a0ef8cd017 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:58.846722 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8027a50e-2ab9-4806-b6ef-37a0ef8cd017 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:58.847496 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8027a50e-2ab9-4806-b6ef-37a0ef8cd017 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:58.848134 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8027a50e-2ab9-4806-b6ef-37a0ef8cd017 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:58.848698 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8027a50e-2ab9-4806-b6ef-37a0ef8cd017 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:58.861662 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-d624d7c8-621a-4047-a33b-059742048855 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] [instance: caabd624-94e3-4d85-9038-2f3beeabfda9] Going to try to terminate instance {{(pid=134102) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:45:58.945073 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-d624d7c8-621a-4047-a33b-059742048855 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] 10.222.0.43 "DELETE /compute/v2.1/servers/caabd624-94e3-4d85-9038-2f3beeabfda9" status: 204 len: 0 microversion: 2.1 time: 0.123007 Oct 04 21:45:58.945687 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 357/721] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 21:45:58 2022] DELETE /compute/v2.1/servers/caabd624-94e3-4d85-9038-2f3beeabfda9 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:45:58.950908 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-1072ba44-7f11-4ccc-adf7-e0603fe3a185 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:58.951615 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-1072ba44-7f11-4ccc-adf7-e0603fe3a185 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] [instance: 659208f3-1bef-41f7-9616-50c2db9f46ba] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:58.957399 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1072ba44-7f11-4ccc-adf7-e0603fe3a185 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:58.957885 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1072ba44-7f11-4ccc-adf7-e0603fe3a185 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:58.958323 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1072ba44-7f11-4ccc-adf7-e0603fe3a185 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:58.959050 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1072ba44-7f11-4ccc-adf7-e0603fe3a185 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:58.959559 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1072ba44-7f11-4ccc-adf7-e0603fe3a185 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:58.960721 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1072ba44-7f11-4ccc-adf7-e0603fe3a185 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:58.983934 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-8027a50e-2ab9-4806-b6ef-37a0ef8cd017 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2dff38dea346219f6534426fd27ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6a5f1476ac48f3831f2ed202dacdf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:58.992083 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-8027a50e-2ab9-4806-b6ef-37a0ef8cd017 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] 10.222.0.43 "GET /compute/v2.1/servers/1e9957cf-cfeb-483d-bc32-73ca72a54eb9" status: 200 len: 1370 microversion: 2.1 time: 0.158903 Oct 04 21:45:58.992660 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 365/722] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:58 2022] GET /compute/v2.1/servers/1e9957cf-cfeb-483d-bc32-73ca72a54eb9 => generated 1370 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:45:58.997245 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-8d3e7bff-a646-480d-8c9c-8d52e2bbc479 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:58.997893 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-8d3e7bff-a646-480d-8c9c-8d52e2bbc479 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] [instance: caabd624-94e3-4d85-9038-2f3beeabfda9] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:59.004285 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8d3e7bff-a646-480d-8c9c-8d52e2bbc479 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:59.005003 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8d3e7bff-a646-480d-8c9c-8d52e2bbc479 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:59.005637 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8d3e7bff-a646-480d-8c9c-8d52e2bbc479 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:59.009223 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8d3e7bff-a646-480d-8c9c-8d52e2bbc479 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:59.009770 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8d3e7bff-a646-480d-8c9c-8d52e2bbc479 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:59.010753 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8d3e7bff-a646-480d-8c9c-8d52e2bbc479 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:59.156134 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-1072ba44-7f11-4ccc-adf7-e0603fe3a185 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:59.164764 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-1072ba44-7f11-4ccc-adf7-e0603fe3a185 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:59.166219 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-1072ba44-7f11-4ccc-adf7-e0603fe3a185 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:59.167417 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-1072ba44-7f11-4ccc-adf7-e0603fe3a185 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] 10.222.0.43 "GET /compute/v2.1/servers/659208f3-1bef-41f7-9616-50c2db9f46ba" status: 200 len: 1568 microversion: 2.25 time: 0.220639 Oct 04 21:45:59.168198 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 358/723] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:45:58 2022] GET /compute/v2.1/servers/659208f3-1bef-41f7-9616-50c2db9f46ba => generated 1568 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:45:59.183151 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-8d3e7bff-a646-480d-8c9c-8d52e2bbc479 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6975d7cbd8554e06a15a8b2adc811b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94201b6c845f4334b6f4883606b0d037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:59.191028 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-8d3e7bff-a646-480d-8c9c-8d52e2bbc479 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] 10.222.0.43 "GET /compute/v2.1/servers/caabd624-94e3-4d85-9038-2f3beeabfda9" status: 200 len: 1468 microversion: 2.1 time: 0.197398 Oct 04 21:45:59.191611 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 366/724] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:58 2022] GET /compute/v2.1/servers/caabd624-94e3-4d85-9038-2f3beeabfda9 => generated 1468 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:45:59.241289 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-125e44bd-68ef-4e68-8614-07458b6b97f4 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:59.241996 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-125e44bd-68ef-4e68-8614-07458b6b97f4 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: a2d1b827-a865-4d56-a665-110d0541a669] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:59.248120 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-125e44bd-68ef-4e68-8614-07458b6b97f4 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:59.248601 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-125e44bd-68ef-4e68-8614-07458b6b97f4 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:59.249036 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-125e44bd-68ef-4e68-8614-07458b6b97f4 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:59.249137 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-d658c581-0bf1-4378-8c7c-c4fc3b2004ad tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:59.249703 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-d658c581-0bf1-4378-8c7c-c4fc3b2004ad tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] [instance: f3a0dc37-502e-48d3-9537-10dd7fb15e94] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:59.249821 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-125e44bd-68ef-4e68-8614-07458b6b97f4 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:59.250180 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-125e44bd-68ef-4e68-8614-07458b6b97f4 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:59.250645 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-125e44bd-68ef-4e68-8614-07458b6b97f4 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:59.255601 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d658c581-0bf1-4378-8c7c-c4fc3b2004ad tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:59.256089 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d658c581-0bf1-4378-8c7c-c4fc3b2004ad tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:59.257012 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d658c581-0bf1-4378-8c7c-c4fc3b2004ad tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:59.257869 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d658c581-0bf1-4378-8c7c-c4fc3b2004ad tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:59.258318 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d658c581-0bf1-4378-8c7c-c4fc3b2004ad tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:59.258764 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d658c581-0bf1-4378-8c7c-c4fc3b2004ad tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:59.458173 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-125e44bd-68ef-4e68-8614-07458b6b97f4 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:59.462333 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:45:59.465542 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-d658c581-0bf1-4378-8c7c-c4fc3b2004ad tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29842a669a20408b881105135f76cb0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39edf587afe94b60911198aa0bb61613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:59.468528 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-125e44bd-68ef-4e68-8614-07458b6b97f4 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/a2d1b827-a865-4d56-a665-110d0541a669" status: 200 len: 1475 microversion: 2.1 time: 0.231252 Oct 04 21:45:59.469117 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 359/725] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:59 2022] GET /compute/v2.1/servers/a2d1b827-a865-4d56-a665-110d0541a669 => generated 1475 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:45:59.474288 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-d658c581-0bf1-4378-8c7c-c4fc3b2004ad tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] 10.222.0.43 "GET /compute/v2.1/servers/f3a0dc37-502e-48d3-9537-10dd7fb15e94" status: 200 len: 1316 microversion: 2.1 time: 0.228962 Oct 04 21:45:59.474901 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-eb291ba0-b17f-4ff9-b4d6-d5e296611865 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:59.486448 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 367/726] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:59 2022] GET /compute/v2.1/servers/f3a0dc37-502e-48d3-9537-10dd7fb15e94 => generated 1316 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:45:59.486648 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-eb291ba0-b17f-4ff9-b4d6-d5e296611865 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] [instance: 58b5b55c-fd7d-4a43-96af-01ae27cb29de] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:59.486648 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-eb291ba0-b17f-4ff9-b4d6-d5e296611865 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:59.486648 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-eb291ba0-b17f-4ff9-b4d6-d5e296611865 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:59.486648 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-eb291ba0-b17f-4ff9-b4d6-d5e296611865 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:59.487002 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-eb291ba0-b17f-4ff9-b4d6-d5e296611865 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:59.487002 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-eb291ba0-b17f-4ff9-b4d6-d5e296611865 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:59.487002 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-eb291ba0-b17f-4ff9-b4d6-d5e296611865 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:59.622220 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-eb291ba0-b17f-4ff9-b4d6-d5e296611865 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87616cd16995468ab7febf5aa4b284db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e3bf9149434d34b6762aaeef1478ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:59.629930 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-eb291ba0-b17f-4ff9-b4d6-d5e296611865 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] 10.222.0.43 "GET /compute/v2.1/servers/58b5b55c-fd7d-4a43-96af-01ae27cb29de" status: 200 len: 1314 microversion: 2.1 time: 0.159646 Oct 04 21:45:59.630539 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 360/727] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:59 2022] GET /compute/v2.1/servers/58b5b55c-fd7d-4a43-96af-01ae27cb29de => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:45:59.646522 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-83d322cb-69b4-4879-ab4e-a48c353f0fd6 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:59.647753 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-83d322cb-69b4-4879-ab4e-a48c353f0fd6 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 10062905-54d7-47e2-b621-522e0954b72b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:59.653820 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-83d322cb-69b4-4879-ab4e-a48c353f0fd6 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:59.654310 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-83d322cb-69b4-4879-ab4e-a48c353f0fd6 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:59.654785 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-83d322cb-69b4-4879-ab4e-a48c353f0fd6 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:59.655498 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-83d322cb-69b4-4879-ab4e-a48c353f0fd6 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:59.655958 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-83d322cb-69b4-4879-ab4e-a48c353f0fd6 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:59.656391 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-83d322cb-69b4-4879-ab4e-a48c353f0fd6 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:59.803645 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-83d322cb-69b4-4879-ab4e-a48c353f0fd6 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ad048becf474fb972d4291422d810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dcfc7024fc49388c4bd5f25f03e60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:59.813364 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-83d322cb-69b4-4879-ab4e-a48c353f0fd6 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/10062905-54d7-47e2-b621-522e0954b72b" status: 200 len: 1311 microversion: 2.1 time: 0.170533 Oct 04 21:45:59.822813 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 368/728] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:59 2022] GET /compute/v2.1/servers/10062905-54d7-47e2-b621-522e0954b72b => generated 1311 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:00.015850 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-a2779f37-c59e-4380-915f-936235e78ce3 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:00.016453 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-a2779f37-c59e-4380-915f-936235e78ce3 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] [instance: 1e9957cf-cfeb-483d-bc32-73ca72a54eb9] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:00.023335 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a2779f37-c59e-4380-915f-936235e78ce3 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:00.023821 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a2779f37-c59e-4380-915f-936235e78ce3 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:00.024253 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a2779f37-c59e-4380-915f-936235e78ce3 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:00.024949 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a2779f37-c59e-4380-915f-936235e78ce3 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:00.025396 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a2779f37-c59e-4380-915f-936235e78ce3 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:00.025819 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a2779f37-c59e-4380-915f-936235e78ce3 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:00.185627 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-a2779f37-c59e-4380-915f-936235e78ce3 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2dff38dea346219f6534426fd27ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6a5f1476ac48f3831f2ed202dacdf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:00.193147 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-518e5366-c87b-40cc-818c-9a338be84e93 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:00.193767 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-518e5366-c87b-40cc-818c-9a338be84e93 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] [instance: 659208f3-1bef-41f7-9616-50c2db9f46ba] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:00.198309 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-a2779f37-c59e-4380-915f-936235e78ce3 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] 10.222.0.43 "GET /compute/v2.1/servers/1e9957cf-cfeb-483d-bc32-73ca72a54eb9" status: 200 len: 1370 microversion: 2.1 time: 0.186129 Oct 04 21:46:00.198973 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 361/729] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:00 2022] GET /compute/v2.1/servers/1e9957cf-cfeb-483d-bc32-73ca72a54eb9 => generated 1370 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:00.201305 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-518e5366-c87b-40cc-818c-9a338be84e93 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:00.201806 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-518e5366-c87b-40cc-818c-9a338be84e93 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:00.202276 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-518e5366-c87b-40cc-818c-9a338be84e93 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:00.203026 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-518e5366-c87b-40cc-818c-9a338be84e93 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:00.203481 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-518e5366-c87b-40cc-818c-9a338be84e93 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:00.203909 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-518e5366-c87b-40cc-818c-9a338be84e93 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:00.215081 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-a450dec4-feb3-4c39-81ac-092791270c6b tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:00.215701 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-a450dec4-feb3-4c39-81ac-092791270c6b tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] [instance: caabd624-94e3-4d85-9038-2f3beeabfda9] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:00.221808 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a450dec4-feb3-4c39-81ac-092791270c6b tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:00.222747 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a450dec4-feb3-4c39-81ac-092791270c6b tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:00.223185 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a450dec4-feb3-4c39-81ac-092791270c6b tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:00.223899 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a450dec4-feb3-4c39-81ac-092791270c6b tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:00.224358 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a450dec4-feb3-4c39-81ac-092791270c6b tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:00.224791 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a450dec4-feb3-4c39-81ac-092791270c6b tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:00.417769 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-518e5366-c87b-40cc-818c-9a338be84e93 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:00.425219 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-a450dec4-feb3-4c39-81ac-092791270c6b tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6975d7cbd8554e06a15a8b2adc811b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94201b6c845f4334b6f4883606b0d037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:00.427940 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-518e5366-c87b-40cc-818c-9a338be84e93 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:00.429560 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-518e5366-c87b-40cc-818c-9a338be84e93 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:00.430783 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-518e5366-c87b-40cc-818c-9a338be84e93 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] 10.222.0.43 "GET /compute/v2.1/servers/659208f3-1bef-41f7-9616-50c2db9f46ba" status: 200 len: 1568 microversion: 2.25 time: 0.241680 Oct 04 21:46:00.431550 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 369/730] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:46:00 2022] GET /compute/v2.1/servers/659208f3-1bef-41f7-9616-50c2db9f46ba => generated 1568 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:46:00.439667 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-a450dec4-feb3-4c39-81ac-092791270c6b tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] 10.222.0.43 "GET /compute/v2.1/servers/caabd624-94e3-4d85-9038-2f3beeabfda9" status: 200 len: 1468 microversion: 2.1 time: 0.228875 Oct 04 21:46:00.440444 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 362/731] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:00 2022] GET /compute/v2.1/servers/caabd624-94e3-4d85-9038-2f3beeabfda9 => generated 1468 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:46:00.493012 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-f49b3912-1f8d-4e93-8e3d-07d8aac3eee1 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:00.493805 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-f49b3912-1f8d-4e93-8e3d-07d8aac3eee1 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: a2d1b827-a865-4d56-a665-110d0541a669] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:00.499341 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-641d1b9c-d001-401d-9df7-ef05dfdd4a9b tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:00.500285 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-641d1b9c-d001-401d-9df7-ef05dfdd4a9b tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] [instance: f3a0dc37-502e-48d3-9537-10dd7fb15e94] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:00.501258 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f49b3912-1f8d-4e93-8e3d-07d8aac3eee1 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:00.501847 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f49b3912-1f8d-4e93-8e3d-07d8aac3eee1 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:00.502407 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f49b3912-1f8d-4e93-8e3d-07d8aac3eee1 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:00.503170 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f49b3912-1f8d-4e93-8e3d-07d8aac3eee1 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:00.503637 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f49b3912-1f8d-4e93-8e3d-07d8aac3eee1 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:00.504070 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f49b3912-1f8d-4e93-8e3d-07d8aac3eee1 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:00.507658 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-641d1b9c-d001-401d-9df7-ef05dfdd4a9b tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:00.508206 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-641d1b9c-d001-401d-9df7-ef05dfdd4a9b tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:00.508627 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-641d1b9c-d001-401d-9df7-ef05dfdd4a9b tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:00.509394 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-641d1b9c-d001-401d-9df7-ef05dfdd4a9b tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:00.509853 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-641d1b9c-d001-401d-9df7-ef05dfdd4a9b tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:00.511242 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-641d1b9c-d001-401d-9df7-ef05dfdd4a9b tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:00.733768 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-f49b3912-1f8d-4e93-8e3d-07d8aac3eee1 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:00.737436 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-641d1b9c-d001-401d-9df7-ef05dfdd4a9b tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29842a669a20408b881105135f76cb0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39edf587afe94b60911198aa0bb61613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:00.743704 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-f49b3912-1f8d-4e93-8e3d-07d8aac3eee1 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/a2d1b827-a865-4d56-a665-110d0541a669" status: 200 len: 1475 microversion: 2.1 time: 0.254896 Oct 04 21:46:00.744513 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 370/732] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:00 2022] GET /compute/v2.1/servers/a2d1b827-a865-4d56-a665-110d0541a669 => generated 1475 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:00.746576 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-641d1b9c-d001-401d-9df7-ef05dfdd4a9b tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] 10.222.0.43 "GET /compute/v2.1/servers/f3a0dc37-502e-48d3-9537-10dd7fb15e94" status: 200 len: 1316 microversion: 2.1 time: 0.251015 Oct 04 21:46:00.749961 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-79d9c0ce-13d9-4756-a30e-4cd2e032467f tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:00.750893 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-79d9c0ce-13d9-4756-a30e-4cd2e032467f tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] [instance: 58b5b55c-fd7d-4a43-96af-01ae27cb29de] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:00.759159 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 363/733] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:00 2022] GET /compute/v2.1/servers/f3a0dc37-502e-48d3-9537-10dd7fb15e94 => generated 1316 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:46:00.761843 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-79d9c0ce-13d9-4756-a30e-4cd2e032467f tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:00.762826 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-79d9c0ce-13d9-4756-a30e-4cd2e032467f tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:00.763833 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-79d9c0ce-13d9-4756-a30e-4cd2e032467f tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:00.764926 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-79d9c0ce-13d9-4756-a30e-4cd2e032467f tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:00.765759 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-79d9c0ce-13d9-4756-a30e-4cd2e032467f tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:00.766477 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-79d9c0ce-13d9-4756-a30e-4cd2e032467f tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:00.785325 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=100 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:46:00.840660 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-a7431a14-cefc-4033-a64b-cad4efa4ea36 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:00.841363 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-a7431a14-cefc-4033-a64b-cad4efa4ea36 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 10062905-54d7-47e2-b621-522e0954b72b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:00.847667 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a7431a14-cefc-4033-a64b-cad4efa4ea36 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:00.848166 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a7431a14-cefc-4033-a64b-cad4efa4ea36 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:00.848603 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a7431a14-cefc-4033-a64b-cad4efa4ea36 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:00.849316 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a7431a14-cefc-4033-a64b-cad4efa4ea36 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:00.849906 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a7431a14-cefc-4033-a64b-cad4efa4ea36 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:00.850192 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a7431a14-cefc-4033-a64b-cad4efa4ea36 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:00.932892 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-79d9c0ce-13d9-4756-a30e-4cd2e032467f tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87616cd16995468ab7febf5aa4b284db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e3bf9149434d34b6762aaeef1478ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:00.946066 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-79d9c0ce-13d9-4756-a30e-4cd2e032467f tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] 10.222.0.43 "GET /compute/v2.1/servers/58b5b55c-fd7d-4a43-96af-01ae27cb29de" status: 200 len: 1314 microversion: 2.1 time: 0.199834 Oct 04 21:46:00.947173 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 371/734] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:00 2022] GET /compute/v2.1/servers/58b5b55c-fd7d-4a43-96af-01ae27cb29de => generated 1314 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:00.952113 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-d2db9325-426a-4da7-99df-bf2dd226e1f5 req-3119db28-61b4-4e46-968e-3f0ee8cd42fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3380b36-6aba-4736-bcbc-f0058f806d55", "name": "network-vif-plugged", "status": "completed", "tag": "b25814f1-d2d0-4853-bfa4-3948c24c40e5"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:46:00.962942 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-d2db9325-426a-4da7-99df-bf2dd226e1f5 req-3119db28-61b4-4e46-968e-3f0ee8cd42fd service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:00.963429 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-d2db9325-426a-4da7-99df-bf2dd226e1f5 req-3119db28-61b4-4e46-968e-3f0ee8cd42fd service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:00.963863 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-d2db9325-426a-4da7-99df-bf2dd226e1f5 req-3119db28-61b4-4e46-968e-3f0ee8cd42fd service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:00.977226 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-d2db9325-426a-4da7-99df-bf2dd226e1f5 req-3119db28-61b4-4e46-968e-3f0ee8cd42fd service nova] Creating event network-vif-plugged:b25814f1-d2d0-4853-bfa4-3948c24c40e5 for instance e3380b36-6aba-4736-bcbc-f0058f806d55 on n-h2-860284-1 Oct 04 21:46:00.982400 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-d2db9325-426a-4da7-99df-bf2dd226e1f5 req-3119db28-61b4-4e46-968e-3f0ee8cd42fd service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034010 Oct 04 21:46:00.983015 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 372/735] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:46:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:46:01.171630 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-a7431a14-cefc-4033-a64b-cad4efa4ea36 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ad048becf474fb972d4291422d810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dcfc7024fc49388c4bd5f25f03e60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:01.179805 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-a7431a14-cefc-4033-a64b-cad4efa4ea36 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/10062905-54d7-47e2-b621-522e0954b72b" status: 200 len: 1311 microversion: 2.1 time: 0.345035 Oct 04 21:46:01.180308 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 364/736] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:00 2022] GET /compute/v2.1/servers/10062905-54d7-47e2-b621-522e0954b72b => generated 1311 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:46:01.222414 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-7526337d-945b-4661-8fc4-d773328c0f14 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:01.223126 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-7526337d-945b-4661-8fc4-d773328c0f14 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] [instance: 1e9957cf-cfeb-483d-bc32-73ca72a54eb9] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:01.230202 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7526337d-945b-4661-8fc4-d773328c0f14 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:01.230724 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7526337d-945b-4661-8fc4-d773328c0f14 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:01.231165 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7526337d-945b-4661-8fc4-d773328c0f14 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:01.231862 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7526337d-945b-4661-8fc4-d773328c0f14 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:01.232324 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7526337d-945b-4661-8fc4-d773328c0f14 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:01.232755 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7526337d-945b-4661-8fc4-d773328c0f14 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:01.361233 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-7526337d-945b-4661-8fc4-d773328c0f14 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2dff38dea346219f6534426fd27ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6a5f1476ac48f3831f2ed202dacdf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:01.369242 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-7526337d-945b-4661-8fc4-d773328c0f14 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] 10.222.0.43 "GET /compute/v2.1/servers/1e9957cf-cfeb-483d-bc32-73ca72a54eb9" status: 200 len: 1370 microversion: 2.1 time: 0.151203 Oct 04 21:46:01.369812 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 373/737] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:01 2022] GET /compute/v2.1/servers/1e9957cf-cfeb-483d-bc32-73ca72a54eb9 => generated 1370 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:01.463434 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-afe81a2c-13e1-4fcd-a7ef-221543cdc7f3 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:01.463965 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-afe81a2c-13e1-4fcd-a7ef-221543cdc7f3 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] [instance: caabd624-94e3-4d85-9038-2f3beeabfda9] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:01.466029 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-b4903f68-cad7-4884-a978-9dc3a409bde6 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:01.466672 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-b4903f68-cad7-4884-a978-9dc3a409bde6 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] [instance: 659208f3-1bef-41f7-9616-50c2db9f46ba] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:01.470437 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-afe81a2c-13e1-4fcd-a7ef-221543cdc7f3 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:01.470925 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-afe81a2c-13e1-4fcd-a7ef-221543cdc7f3 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:01.471370 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-afe81a2c-13e1-4fcd-a7ef-221543cdc7f3 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:01.472075 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-afe81a2c-13e1-4fcd-a7ef-221543cdc7f3 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:01.472543 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-afe81a2c-13e1-4fcd-a7ef-221543cdc7f3 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:01.472748 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b4903f68-cad7-4884-a978-9dc3a409bde6 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:01.472970 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-afe81a2c-13e1-4fcd-a7ef-221543cdc7f3 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:01.473239 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b4903f68-cad7-4884-a978-9dc3a409bde6 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:01.473680 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b4903f68-cad7-4884-a978-9dc3a409bde6 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:01.474400 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b4903f68-cad7-4884-a978-9dc3a409bde6 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:01.474888 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b4903f68-cad7-4884-a978-9dc3a409bde6 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:01.475332 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b4903f68-cad7-4884-a978-9dc3a409bde6 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:01.925833 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-afe81a2c-13e1-4fcd-a7ef-221543cdc7f3 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6975d7cbd8554e06a15a8b2adc811b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94201b6c845f4334b6f4883606b0d037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:01.930623 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-b4903f68-cad7-4884-a978-9dc3a409bde6 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:01.938746 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-afe81a2c-13e1-4fcd-a7ef-221543cdc7f3 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] 10.222.0.43 "GET /compute/v2.1/servers/caabd624-94e3-4d85-9038-2f3beeabfda9" status: 200 len: 1468 microversion: 2.1 time: 0.480023 Oct 04 21:46:01.940763 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 374/738] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:01 2022] GET /compute/v2.1/servers/caabd624-94e3-4d85-9038-2f3beeabfda9 => generated 1468 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:46:01.946421 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-b4903f68-cad7-4884-a978-9dc3a409bde6 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:01.949297 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-b4903f68-cad7-4884-a978-9dc3a409bde6 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:01.950957 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-b4903f68-cad7-4884-a978-9dc3a409bde6 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] 10.222.0.43 "GET /compute/v2.1/servers/659208f3-1bef-41f7-9616-50c2db9f46ba" status: 200 len: 1568 microversion: 2.25 time: 0.493582 Oct 04 21:46:01.952131 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 365/739] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:46:01 2022] GET /compute/v2.1/servers/659208f3-1bef-41f7-9616-50c2db9f46ba => generated 1568 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:46:01.957638 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-f6da10f4-c9d5-4ffe-8a3e-1dafbacfb1c7 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:01.958598 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-f6da10f4-c9d5-4ffe-8a3e-1dafbacfb1c7 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] [instance: f3a0dc37-502e-48d3-9537-10dd7fb15e94] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:01.971732 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-f212dc9d-4c25-40ac-bfb3-515618c79377 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:01.974540 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-f212dc9d-4c25-40ac-bfb3-515618c79377 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: a2d1b827-a865-4d56-a665-110d0541a669] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:01.974871 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f6da10f4-c9d5-4ffe-8a3e-1dafbacfb1c7 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:01.975364 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f6da10f4-c9d5-4ffe-8a3e-1dafbacfb1c7 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:01.975812 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f6da10f4-c9d5-4ffe-8a3e-1dafbacfb1c7 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:01.976550 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f6da10f4-c9d5-4ffe-8a3e-1dafbacfb1c7 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:01.977018 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f6da10f4-c9d5-4ffe-8a3e-1dafbacfb1c7 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:01.977457 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f6da10f4-c9d5-4ffe-8a3e-1dafbacfb1c7 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:01.996835 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f212dc9d-4c25-40ac-bfb3-515618c79377 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:01.997341 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f212dc9d-4c25-40ac-bfb3-515618c79377 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:01.997788 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f212dc9d-4c25-40ac-bfb3-515618c79377 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:01.998777 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f212dc9d-4c25-40ac-bfb3-515618c79377 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:01.999245 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f212dc9d-4c25-40ac-bfb3-515618c79377 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:01.999674 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f212dc9d-4c25-40ac-bfb3-515618c79377 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:02.231763 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-f6da10f4-c9d5-4ffe-8a3e-1dafbacfb1c7 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29842a669a20408b881105135f76cb0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39edf587afe94b60911198aa0bb61613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:02.233712 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-f212dc9d-4c25-40ac-bfb3-515618c79377 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:02.242409 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-f212dc9d-4c25-40ac-bfb3-515618c79377 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/a2d1b827-a865-4d56-a665-110d0541a669" status: 200 len: 1475 microversion: 2.1 time: 0.293467 Oct 04 21:46:02.246998 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-f6da10f4-c9d5-4ffe-8a3e-1dafbacfb1c7 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] 10.222.0.43 "GET /compute/v2.1/servers/f3a0dc37-502e-48d3-9537-10dd7fb15e94" status: 200 len: 1316 microversion: 2.1 time: 0.293407 Oct 04 21:46:02.248256 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 366/740] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:01 2022] GET /compute/v2.1/servers/f3a0dc37-502e-48d3-9537-10dd7fb15e94 => generated 1316 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:02.253637 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-49fe4835-0943-4788-8be4-a60a5a93c653 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:02.255117 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-49fe4835-0943-4788-8be4-a60a5a93c653 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] [instance: 58b5b55c-fd7d-4a43-96af-01ae27cb29de] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:02.258709 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 375/741] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:01 2022] GET /compute/v2.1/servers/a2d1b827-a865-4d56-a665-110d0541a669 => generated 1475 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:02.263564 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-3cd6531c-03da-4315-a1fb-a9933401bb7e tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:02.264172 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-3cd6531c-03da-4315-a1fb-a9933401bb7e tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 10062905-54d7-47e2-b621-522e0954b72b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:02.266155 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-49fe4835-0943-4788-8be4-a60a5a93c653 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:02.266947 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-49fe4835-0943-4788-8be4-a60a5a93c653 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:02.267705 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-49fe4835-0943-4788-8be4-a60a5a93c653 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:02.269069 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-49fe4835-0943-4788-8be4-a60a5a93c653 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:02.269734 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-49fe4835-0943-4788-8be4-a60a5a93c653 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:02.270382 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-49fe4835-0943-4788-8be4-a60a5a93c653 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:02.271094 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3cd6531c-03da-4315-a1fb-a9933401bb7e tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:02.271581 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3cd6531c-03da-4315-a1fb-a9933401bb7e tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:02.272022 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3cd6531c-03da-4315-a1fb-a9933401bb7e tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:02.273040 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3cd6531c-03da-4315-a1fb-a9933401bb7e tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:02.273496 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3cd6531c-03da-4315-a1fb-a9933401bb7e tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:02.273918 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3cd6531c-03da-4315-a1fb-a9933401bb7e tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:02.574239 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-49fe4835-0943-4788-8be4-a60a5a93c653 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87616cd16995468ab7febf5aa4b284db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e3bf9149434d34b6762aaeef1478ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:02.584380 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-49fe4835-0943-4788-8be4-a60a5a93c653 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] 10.222.0.43 "GET /compute/v2.1/servers/58b5b55c-fd7d-4a43-96af-01ae27cb29de" status: 200 len: 1314 microversion: 2.1 time: 0.334791 Oct 04 21:46:02.588675 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-3cd6531c-03da-4315-a1fb-a9933401bb7e tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ad048becf474fb972d4291422d810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dcfc7024fc49388c4bd5f25f03e60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:02.606335 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 367/742] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:02 2022] GET /compute/v2.1/servers/58b5b55c-fd7d-4a43-96af-01ae27cb29de => generated 1314 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:02.611449 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-60165292-2d1a-40ed-b5dc-36384bb116ae req-98169642-4252-46c4-8af8-2fbff177af4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "659208f3-1bef-41f7-9616-50c2db9f46ba", "name": "network-vif-unplugged", "status": "completed", "tag": "368ea7da-0153-4a50-967c-853fb135f91d"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:46:02.613824 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-3cd6531c-03da-4315-a1fb-a9933401bb7e tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/10062905-54d7-47e2-b621-522e0954b72b" status: 200 len: 1311 microversion: 2.1 time: 0.353696 Oct 04 21:46:02.615757 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 376/743] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:02 2022] GET /compute/v2.1/servers/10062905-54d7-47e2-b621-522e0954b72b => generated 1311 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:02.621787 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-60165292-2d1a-40ed-b5dc-36384bb116ae req-98169642-4252-46c4-8af8-2fbff177af4e service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:02.622314 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-6f5e5e73-5d88-4c96-967d-6b5e4ecc39b6 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:02.622521 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-60165292-2d1a-40ed-b5dc-36384bb116ae req-98169642-4252-46c4-8af8-2fbff177af4e service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:02.622964 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-60165292-2d1a-40ed-b5dc-36384bb116ae req-98169642-4252-46c4-8af8-2fbff177af4e service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:02.623573 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-6f5e5e73-5d88-4c96-967d-6b5e4ecc39b6 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] [instance: 1e9957cf-cfeb-483d-bc32-73ca72a54eb9] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:02.630220 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6f5e5e73-5d88-4c96-967d-6b5e4ecc39b6 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:02.630801 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6f5e5e73-5d88-4c96-967d-6b5e4ecc39b6 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:02.631242 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6f5e5e73-5d88-4c96-967d-6b5e4ecc39b6 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:02.632385 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6f5e5e73-5d88-4c96-967d-6b5e4ecc39b6 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:02.632998 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6f5e5e73-5d88-4c96-967d-6b5e4ecc39b6 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:02.633429 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6f5e5e73-5d88-4c96-967d-6b5e4ecc39b6 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:02.637164 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-60165292-2d1a-40ed-b5dc-36384bb116ae req-98169642-4252-46c4-8af8-2fbff177af4e service nova] Creating event network-vif-unplugged:368ea7da-0153-4a50-967c-853fb135f91d for instance 659208f3-1bef-41f7-9616-50c2db9f46ba on n-h2-860284-1 Oct 04 21:46:02.643800 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-60165292-2d1a-40ed-b5dc-36384bb116ae req-98169642-4252-46c4-8af8-2fbff177af4e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035726 Oct 04 21:46:02.645010 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 368/744] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:46:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:46:02.778928 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-6f5e5e73-5d88-4c96-967d-6b5e4ecc39b6 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2dff38dea346219f6534426fd27ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6a5f1476ac48f3831f2ed202dacdf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:02.787796 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-6f5e5e73-5d88-4c96-967d-6b5e4ecc39b6 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] 10.222.0.43 "GET /compute/v2.1/servers/1e9957cf-cfeb-483d-bc32-73ca72a54eb9" status: 200 len: 1370 microversion: 2.1 time: 0.170237 Oct 04 21:46:02.788854 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 377/745] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:02 2022] GET /compute/v2.1/servers/1e9957cf-cfeb-483d-bc32-73ca72a54eb9 => generated 1370 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:02.983111 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-b025708f-e852-4c8b-9f24-429239373d7c tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:02.983811 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-b025708f-e852-4c8b-9f24-429239373d7c tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] [instance: 659208f3-1bef-41f7-9616-50c2db9f46ba] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:02.990532 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b025708f-e852-4c8b-9f24-429239373d7c tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:02.992133 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b025708f-e852-4c8b-9f24-429239373d7c tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:02.992699 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b025708f-e852-4c8b-9f24-429239373d7c tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:02.993447 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b025708f-e852-4c8b-9f24-429239373d7c tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:02.993906 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b025708f-e852-4c8b-9f24-429239373d7c tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:02.994335 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b025708f-e852-4c8b-9f24-429239373d7c tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:02.997599 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-a83338e6-0adf-46c3-925a-c0a29a772ee6 req-bace6f3a-ff5b-435f-836c-46fe637ee7f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3a0dc37-502e-48d3-9537-10dd7fb15e94", "name": "network-vif-plugged", "status": "completed", "tag": "5b7ac8fb-dad6-4cfb-b728-11e125a3df78"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:46:03.007309 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-a83338e6-0adf-46c3-925a-c0a29a772ee6 req-bace6f3a-ff5b-435f-836c-46fe637ee7f0 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:03.008013 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-a83338e6-0adf-46c3-925a-c0a29a772ee6 req-bace6f3a-ff5b-435f-836c-46fe637ee7f0 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:03.008444 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-a83338e6-0adf-46c3-925a-c0a29a772ee6 req-bace6f3a-ff5b-435f-836c-46fe637ee7f0 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:03.019579 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-a83338e6-0adf-46c3-925a-c0a29a772ee6 req-bace6f3a-ff5b-435f-836c-46fe637ee7f0 service nova] Creating event network-vif-plugged:5b7ac8fb-dad6-4cfb-b728-11e125a3df78 for instance f3a0dc37-502e-48d3-9537-10dd7fb15e94 on n-h1-860284-1 Oct 04 21:46:03.024604 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-a83338e6-0adf-46c3-925a-c0a29a772ee6 req-bace6f3a-ff5b-435f-836c-46fe637ee7f0 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030725 Oct 04 21:46:03.025203 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 378/746] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:46:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:46:03.032495 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-7d342796-e6e4-4b2d-8421-dd0abac269f4 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:03.033185 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-7d342796-e6e4-4b2d-8421-dd0abac269f4 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] [instance: caabd624-94e3-4d85-9038-2f3beeabfda9] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:03.040483 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7d342796-e6e4-4b2d-8421-dd0abac269f4 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:03.040955 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7d342796-e6e4-4b2d-8421-dd0abac269f4 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:03.041384 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7d342796-e6e4-4b2d-8421-dd0abac269f4 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:03.042092 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7d342796-e6e4-4b2d-8421-dd0abac269f4 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:03.042579 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7d342796-e6e4-4b2d-8421-dd0abac269f4 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:03.043003 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7d342796-e6e4-4b2d-8421-dd0abac269f4 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:03.183193 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-b025708f-e852-4c8b-9f24-429239373d7c tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:03.191734 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-b025708f-e852-4c8b-9f24-429239373d7c tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:03.193208 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-b025708f-e852-4c8b-9f24-429239373d7c tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:03.195204 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-b025708f-e852-4c8b-9f24-429239373d7c tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] 10.222.0.43 "GET /compute/v2.1/servers/659208f3-1bef-41f7-9616-50c2db9f46ba" status: 200 len: 1568 microversion: 2.25 time: 0.216294 Oct 04 21:46:03.196019 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 369/747] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:46:02 2022] GET /compute/v2.1/servers/659208f3-1bef-41f7-9616-50c2db9f46ba => generated 1568 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:46:03.217460 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-7d342796-e6e4-4b2d-8421-dd0abac269f4 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6975d7cbd8554e06a15a8b2adc811b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94201b6c845f4334b6f4883606b0d037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:03.225804 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-7d342796-e6e4-4b2d-8421-dd0abac269f4 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] 10.222.0.43 "GET /compute/v2.1/servers/caabd624-94e3-4d85-9038-2f3beeabfda9" status: 200 len: 1468 microversion: 2.1 time: 0.197284 Oct 04 21:46:03.226754 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 379/748] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:03 2022] GET /compute/v2.1/servers/caabd624-94e3-4d85-9038-2f3beeabfda9 => generated 1468 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:03.266323 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-67e48cb0-dd51-4ea2-b8df-26afea1fba87 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:03.267172 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-67e48cb0-dd51-4ea2-b8df-26afea1fba87 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: a2d1b827-a865-4d56-a665-110d0541a669] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:03.273596 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-67e48cb0-dd51-4ea2-b8df-26afea1fba87 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:03.274093 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-67e48cb0-dd51-4ea2-b8df-26afea1fba87 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:03.274563 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-67e48cb0-dd51-4ea2-b8df-26afea1fba87 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:03.275280 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-67e48cb0-dd51-4ea2-b8df-26afea1fba87 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:03.275831 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-67e48cb0-dd51-4ea2-b8df-26afea1fba87 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:03.276606 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-67e48cb0-dd51-4ea2-b8df-26afea1fba87 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:03.282543 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-6a647048-c8fc-465a-93e6-0fe611e3616d tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:03.283169 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-6a647048-c8fc-465a-93e6-0fe611e3616d tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] [instance: f3a0dc37-502e-48d3-9537-10dd7fb15e94] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:03.289699 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6a647048-c8fc-465a-93e6-0fe611e3616d tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:03.290196 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6a647048-c8fc-465a-93e6-0fe611e3616d tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:03.290656 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6a647048-c8fc-465a-93e6-0fe611e3616d tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:03.291359 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6a647048-c8fc-465a-93e6-0fe611e3616d tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:03.291816 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6a647048-c8fc-465a-93e6-0fe611e3616d tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:03.292240 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6a647048-c8fc-465a-93e6-0fe611e3616d tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:03.482203 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-67e48cb0-dd51-4ea2-b8df-26afea1fba87 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:03.489251 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-6a647048-c8fc-465a-93e6-0fe611e3616d tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29842a669a20408b881105135f76cb0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39edf587afe94b60911198aa0bb61613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:03.490022 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-67e48cb0-dd51-4ea2-b8df-26afea1fba87 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/a2d1b827-a865-4d56-a665-110d0541a669" status: 200 len: 1475 microversion: 2.1 time: 0.228585 Oct 04 21:46:03.490657 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 370/749] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:03 2022] GET /compute/v2.1/servers/a2d1b827-a865-4d56-a665-110d0541a669 => generated 1475 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:46:03.498298 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-6a647048-c8fc-465a-93e6-0fe611e3616d tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] 10.222.0.43 "GET /compute/v2.1/servers/f3a0dc37-502e-48d3-9537-10dd7fb15e94" status: 200 len: 1316 microversion: 2.1 time: 0.219703 Oct 04 21:46:03.499068 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 380/750] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:03 2022] GET /compute/v2.1/servers/f3a0dc37-502e-48d3-9537-10dd7fb15e94 => generated 1316 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:46:03.608791 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-c7a1d9a7-93e1-4f5c-96d2-219a8941d891 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:03.609403 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-c7a1d9a7-93e1-4f5c-96d2-219a8941d891 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] [instance: 58b5b55c-fd7d-4a43-96af-01ae27cb29de] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:03.615492 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c7a1d9a7-93e1-4f5c-96d2-219a8941d891 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:03.616590 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c7a1d9a7-93e1-4f5c-96d2-219a8941d891 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:03.617033 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c7a1d9a7-93e1-4f5c-96d2-219a8941d891 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:03.617828 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c7a1d9a7-93e1-4f5c-96d2-219a8941d891 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:03.618282 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c7a1d9a7-93e1-4f5c-96d2-219a8941d891 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:03.618732 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c7a1d9a7-93e1-4f5c-96d2-219a8941d891 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:03.637897 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-d2a00f30-d232-4eae-90b5-eb57c88a9a81 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:03.638551 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-d2a00f30-d232-4eae-90b5-eb57c88a9a81 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 10062905-54d7-47e2-b621-522e0954b72b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:03.645140 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d2a00f30-d232-4eae-90b5-eb57c88a9a81 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:03.645719 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d2a00f30-d232-4eae-90b5-eb57c88a9a81 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:03.646234 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d2a00f30-d232-4eae-90b5-eb57c88a9a81 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:03.647149 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d2a00f30-d232-4eae-90b5-eb57c88a9a81 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:03.647965 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d2a00f30-d232-4eae-90b5-eb57c88a9a81 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:03.648086 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d2a00f30-d232-4eae-90b5-eb57c88a9a81 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:03.867677 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-c7a1d9a7-93e1-4f5c-96d2-219a8941d891 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87616cd16995468ab7febf5aa4b284db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e3bf9149434d34b6762aaeef1478ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:03.872562 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-d2a00f30-d232-4eae-90b5-eb57c88a9a81 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ad048becf474fb972d4291422d810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dcfc7024fc49388c4bd5f25f03e60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:03.879256 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-c7a1d9a7-93e1-4f5c-96d2-219a8941d891 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] 10.222.0.43 "GET /compute/v2.1/servers/58b5b55c-fd7d-4a43-96af-01ae27cb29de" status: 200 len: 1314 microversion: 2.1 time: 0.273920 Oct 04 21:46:03.880557 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 371/751] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:03 2022] GET /compute/v2.1/servers/58b5b55c-fd7d-4a43-96af-01ae27cb29de => generated 1314 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:03.887058 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-d2a00f30-d232-4eae-90b5-eb57c88a9a81 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/10062905-54d7-47e2-b621-522e0954b72b" status: 200 len: 1311 microversion: 2.1 time: 0.253302 Oct 04 21:46:03.892649 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-fbece464-2d62-43d3-a11e-a571d8c675d0 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:03.893844 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-fbece464-2d62-43d3-a11e-a571d8c675d0 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] [instance: 1e9957cf-cfeb-483d-bc32-73ca72a54eb9] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:03.897260 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 381/752] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:03 2022] GET /compute/v2.1/servers/10062905-54d7-47e2-b621-522e0954b72b => generated 1311 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:03.906643 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fbece464-2d62-43d3-a11e-a571d8c675d0 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:03.907937 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fbece464-2d62-43d3-a11e-a571d8c675d0 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:03.908816 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fbece464-2d62-43d3-a11e-a571d8c675d0 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:03.910831 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fbece464-2d62-43d3-a11e-a571d8c675d0 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:03.912257 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fbece464-2d62-43d3-a11e-a571d8c675d0 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:03.913790 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fbece464-2d62-43d3-a11e-a571d8c675d0 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:04.191627 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-fbece464-2d62-43d3-a11e-a571d8c675d0 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2dff38dea346219f6534426fd27ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6a5f1476ac48f3831f2ed202dacdf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:04.200029 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-fbece464-2d62-43d3-a11e-a571d8c675d0 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] 10.222.0.43 "GET /compute/v2.1/servers/1e9957cf-cfeb-483d-bc32-73ca72a54eb9" status: 200 len: 1370 microversion: 2.1 time: 0.317686 Oct 04 21:46:04.200623 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 372/753] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:03 2022] GET /compute/v2.1/servers/1e9957cf-cfeb-483d-bc32-73ca72a54eb9 => generated 1370 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:04.222033 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-f61f97e5-1409-4266-90a9-8748060cb027 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:04.222033 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-f61f97e5-1409-4266-90a9-8748060cb027 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] [instance: 659208f3-1bef-41f7-9616-50c2db9f46ba] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:04.229240 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f61f97e5-1409-4266-90a9-8748060cb027 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:04.229740 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f61f97e5-1409-4266-90a9-8748060cb027 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:04.230180 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f61f97e5-1409-4266-90a9-8748060cb027 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:04.230946 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f61f97e5-1409-4266-90a9-8748060cb027 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:04.231403 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f61f97e5-1409-4266-90a9-8748060cb027 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:04.231829 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f61f97e5-1409-4266-90a9-8748060cb027 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:04.251704 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-f167488c-e62d-4388-960d-331290060417 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:04.252320 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-f167488c-e62d-4388-960d-331290060417 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] [instance: caabd624-94e3-4d85-9038-2f3beeabfda9] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:04.259928 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f167488c-e62d-4388-960d-331290060417 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:04.260425 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f167488c-e62d-4388-960d-331290060417 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:04.260875 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f167488c-e62d-4388-960d-331290060417 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:04.261643 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f167488c-e62d-4388-960d-331290060417 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:04.262018 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f167488c-e62d-4388-960d-331290060417 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:04.265971 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f167488c-e62d-4388-960d-331290060417 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:04.544849 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-f61f97e5-1409-4266-90a9-8748060cb027 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:04.551405 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-f167488c-e62d-4388-960d-331290060417 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6975d7cbd8554e06a15a8b2adc811b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94201b6c845f4334b6f4883606b0d037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:04.559949 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-f167488c-e62d-4388-960d-331290060417 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] 10.222.0.43 "GET /compute/v2.1/servers/caabd624-94e3-4d85-9038-2f3beeabfda9" status: 200 len: 1468 microversion: 2.1 time: 0.312447 Oct 04 21:46:04.560338 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-f61f97e5-1409-4266-90a9-8748060cb027 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:04.560766 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 373/754] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:04 2022] GET /compute/v2.1/servers/caabd624-94e3-4d85-9038-2f3beeabfda9 => generated 1468 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:46:04.565870 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-5f641daf-b471-4c32-a918-7873e05a9c42 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:04.566390 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-5f641daf-b471-4c32-a918-7873e05a9c42 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] [instance: c7b7e541-aa71-44f6-96fb-07c2e6e08520] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:04.571843 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-f61f97e5-1409-4266-90a9-8748060cb027 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:04.573236 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5f641daf-b471-4c32-a918-7873e05a9c42 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:04.573387 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-f61f97e5-1409-4266-90a9-8748060cb027 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] 10.222.0.43 "GET /compute/v2.1/servers/659208f3-1bef-41f7-9616-50c2db9f46ba" status: 200 len: 1568 microversion: 2.25 time: 0.356133 Oct 04 21:46:04.573717 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5f641daf-b471-4c32-a918-7873e05a9c42 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:04.574192 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5f641daf-b471-4c32-a918-7873e05a9c42 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:04.574954 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5f641daf-b471-4c32-a918-7873e05a9c42 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:04.575417 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5f641daf-b471-4c32-a918-7873e05a9c42 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:04.575824 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5f641daf-b471-4c32-a918-7873e05a9c42 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:04.581496 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 382/755] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:46:04 2022] GET /compute/v2.1/servers/659208f3-1bef-41f7-9616-50c2db9f46ba => generated 1568 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:46:04.586194 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-7e45e82c-ab3d-4e80-9c90-be83209a7551 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:04.586952 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-7e45e82c-ab3d-4e80-9c90-be83209a7551 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: a2d1b827-a865-4d56-a665-110d0541a669] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:04.595381 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7e45e82c-ab3d-4e80-9c90-be83209a7551 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:04.596171 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7e45e82c-ab3d-4e80-9c90-be83209a7551 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:04.596681 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7e45e82c-ab3d-4e80-9c90-be83209a7551 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:04.597464 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7e45e82c-ab3d-4e80-9c90-be83209a7551 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:04.598109 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7e45e82c-ab3d-4e80-9c90-be83209a7551 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:04.599493 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7e45e82c-ab3d-4e80-9c90-be83209a7551 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:04.611786 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-5f641daf-b471-4c32-a918-7873e05a9c42 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] [instance: c7b7e541-aa71-44f6-96fb-07c2e6e08520] Going to try to terminate instance {{(pid=134102) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:46:04.730879 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-5f641daf-b471-4c32-a918-7873e05a9c42 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] 10.222.0.43 "DELETE /compute/v2.1/servers/c7b7e541-aa71-44f6-96fb-07c2e6e08520" status: 204 len: 0 microversion: 2.1 time: 0.167664 Oct 04 21:46:04.731917 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 374/756] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 21:46:04 2022] DELETE /compute/v2.1/servers/c7b7e541-aa71-44f6-96fb-07c2e6e08520 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:46:04.747589 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-daa413b0-08de-4131-93aa-d88c158d5888 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:04.748396 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-daa413b0-08de-4131-93aa-d88c158d5888 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] [instance: f3a0dc37-502e-48d3-9537-10dd7fb15e94] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:04.758187 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-daa413b0-08de-4131-93aa-d88c158d5888 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:04.758804 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-daa413b0-08de-4131-93aa-d88c158d5888 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:04.759265 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-daa413b0-08de-4131-93aa-d88c158d5888 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:04.759987 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-daa413b0-08de-4131-93aa-d88c158d5888 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:04.760449 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-daa413b0-08de-4131-93aa-d88c158d5888 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:04.760879 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-daa413b0-08de-4131-93aa-d88c158d5888 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:04.815168 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:46:04.950643 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-7e45e82c-ab3d-4e80-9c90-be83209a7551 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:04.959214 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-7e45e82c-ab3d-4e80-9c90-be83209a7551 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/a2d1b827-a865-4d56-a665-110d0541a669" status: 200 len: 1475 microversion: 2.1 time: 0.377110 Oct 04 21:46:04.959654 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 383/757] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:04 2022] GET /compute/v2.1/servers/a2d1b827-a865-4d56-a665-110d0541a669 => generated 1475 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:04.982737 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-a42ae97a-d6b5-4436-a882-41ffdb7c3928 req-50a2057e-51e7-4b27-89bb-5e41a7fe0baf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "659208f3-1bef-41f7-9616-50c2db9f46ba", "tag": "368ea7da-0153-4a50-967c-853fb135f91d"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:46:04.993534 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-a42ae97a-d6b5-4436-a882-41ffdb7c3928 req-50a2057e-51e7-4b27-89bb-5e41a7fe0baf service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:04.994295 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-a42ae97a-d6b5-4436-a882-41ffdb7c3928 req-50a2057e-51e7-4b27-89bb-5e41a7fe0baf service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:04.994981 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-a42ae97a-d6b5-4436-a882-41ffdb7c3928 req-50a2057e-51e7-4b27-89bb-5e41a7fe0baf service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:05.011480 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-a42ae97a-d6b5-4436-a882-41ffdb7c3928 req-50a2057e-51e7-4b27-89bb-5e41a7fe0baf service nova] Creating event network-changed:368ea7da-0153-4a50-967c-853fb135f91d for instance 659208f3-1bef-41f7-9616-50c2db9f46ba on n-h2-860284-1 Oct 04 21:46:05.016995 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-a42ae97a-d6b5-4436-a882-41ffdb7c3928 req-50a2057e-51e7-4b27-89bb-5e41a7fe0baf service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043773 Oct 04 21:46:05.017623 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 384/758] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:46:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:46:05.029311 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-2174d904-a7d0-4554-89e8-49cef79d3b0d req-903330ca-15d1-4780-925f-29c535167196 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "caabd624-94e3-4d85-9038-2f3beeabfda9", "name": "network-vif-deleted", "tag": "d9f07922-9bf0-42e8-b7a2-a88c1c73314c"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:46:05.038858 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-daa413b0-08de-4131-93aa-d88c158d5888 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29842a669a20408b881105135f76cb0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39edf587afe94b60911198aa0bb61613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:05.041777 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-2174d904-a7d0-4554-89e8-49cef79d3b0d req-903330ca-15d1-4780-925f-29c535167196 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:05.042338 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-2174d904-a7d0-4554-89e8-49cef79d3b0d req-903330ca-15d1-4780-925f-29c535167196 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:05.043990 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-2174d904-a7d0-4554-89e8-49cef79d3b0d req-903330ca-15d1-4780-925f-29c535167196 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:05.049948 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-daa413b0-08de-4131-93aa-d88c158d5888 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] 10.222.0.43 "GET /compute/v2.1/servers/f3a0dc37-502e-48d3-9537-10dd7fb15e94" status: 200 len: 1316 microversion: 2.1 time: 0.312412 Oct 04 21:46:05.065050 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 375/759] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:04 2022] GET /compute/v2.1/servers/f3a0dc37-502e-48d3-9537-10dd7fb15e94 => generated 1316 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:05.071847 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-8aabf4d8-0c25-40f5-8d7a-92a4e7a1246d tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:05.072469 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-8aabf4d8-0c25-40f5-8d7a-92a4e7a1246d tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] [instance: 58b5b55c-fd7d-4a43-96af-01ae27cb29de] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:05.077377 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-2174d904-a7d0-4554-89e8-49cef79d3b0d req-903330ca-15d1-4780-925f-29c535167196 service nova] Creating event network-vif-deleted:d9f07922-9bf0-42e8-b7a2-a88c1c73314c for instance caabd624-94e3-4d85-9038-2f3beeabfda9 on n-h2-860284-1 Oct 04 21:46:05.083612 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-2174d904-a7d0-4554-89e8-49cef79d3b0d req-903330ca-15d1-4780-925f-29c535167196 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059526 Oct 04 21:46:05.083896 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 385/760] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:46:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:46:05.092212 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8aabf4d8-0c25-40f5-8d7a-92a4e7a1246d tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:05.093823 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8aabf4d8-0c25-40f5-8d7a-92a4e7a1246d tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:05.094353 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8aabf4d8-0c25-40f5-8d7a-92a4e7a1246d tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:05.095538 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8aabf4d8-0c25-40f5-8d7a-92a4e7a1246d tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:05.095823 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8aabf4d8-0c25-40f5-8d7a-92a4e7a1246d tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:05.097451 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-5fdf5316-a26f-40b1-86e2-3a432bb11408 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:05.097915 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8aabf4d8-0c25-40f5-8d7a-92a4e7a1246d tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:05.099355 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-5fdf5316-a26f-40b1-86e2-3a432bb11408 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 10062905-54d7-47e2-b621-522e0954b72b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:05.110204 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5fdf5316-a26f-40b1-86e2-3a432bb11408 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:05.112361 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5fdf5316-a26f-40b1-86e2-3a432bb11408 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:05.113060 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5fdf5316-a26f-40b1-86e2-3a432bb11408 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:05.126696 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5fdf5316-a26f-40b1-86e2-3a432bb11408 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:05.127293 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5fdf5316-a26f-40b1-86e2-3a432bb11408 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:05.127895 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5fdf5316-a26f-40b1-86e2-3a432bb11408 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:05.441264 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-8aabf4d8-0c25-40f5-8d7a-92a4e7a1246d tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87616cd16995468ab7febf5aa4b284db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e3bf9149434d34b6762aaeef1478ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:05.451312 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-8aabf4d8-0c25-40f5-8d7a-92a4e7a1246d tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] 10.222.0.43 "GET /compute/v2.1/servers/58b5b55c-fd7d-4a43-96af-01ae27cb29de" status: 200 len: 1314 microversion: 2.1 time: 0.386969 Oct 04 21:46:05.451829 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 376/761] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:05 2022] GET /compute/v2.1/servers/58b5b55c-fd7d-4a43-96af-01ae27cb29de => generated 1314 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:05.457475 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-05d2831f-7640-47a6-8d4c-efa60f0a7717 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-777527038", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "1684035327", "adminPass": "***", "networks": [{"uuid": "80c3bd4e-c948-4bd0-860e-856f34e6a879"}], "security_groups": [{"name": "tempest-securitygroup--280203192"}], "key_name": "tempest-keypair-1617998943", "user_data": "}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:46:05.461947 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-5fdf5316-a26f-40b1-86e2-3a432bb11408 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ad048becf474fb972d4291422d810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dcfc7024fc49388c4bd5f25f03e60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:05.470170 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-5fdf5316-a26f-40b1-86e2-3a432bb11408 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/10062905-54d7-47e2-b621-522e0954b72b" status: 200 len: 1493 microversion: 2.1 time: 0.382972 Oct 04 21:46:05.470783 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 386/762] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:05 2022] GET /compute/v2.1/servers/10062905-54d7-47e2-b621-522e0954b72b => generated 1493 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:05.475808 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-dc612df5-2df2-4bc6-b488-0a169230b4be req-32767e3b-ed2b-4768-9bfa-426e2f50b367 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58b5b55c-fd7d-4a43-96af-01ae27cb29de", "name": "network-vif-plugged", "status": "completed", "tag": "38c2c5e6-fad8-4765-8442-be827ff69b3f"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:46:05.485382 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-dc612df5-2df2-4bc6-b488-0a169230b4be req-32767e3b-ed2b-4768-9bfa-426e2f50b367 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:05.485860 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-dc612df5-2df2-4bc6-b488-0a169230b4be req-32767e3b-ed2b-4768-9bfa-426e2f50b367 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:05.486288 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-dc612df5-2df2-4bc6-b488-0a169230b4be req-32767e3b-ed2b-4768-9bfa-426e2f50b367 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:05.498746 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-dc612df5-2df2-4bc6-b488-0a169230b4be req-32767e3b-ed2b-4768-9bfa-426e2f50b367 service nova] Creating event network-vif-plugged:38c2c5e6-fad8-4765-8442-be827ff69b3f for instance 58b5b55c-fd7d-4a43-96af-01ae27cb29de on n-h2-860284-1 Oct 04 21:46:05.503486 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-dc612df5-2df2-4bc6-b488-0a169230b4be req-32767e3b-ed2b-4768-9bfa-426e2f50b367 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031520 Oct 04 21:46:05.504220 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 387/763] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:46:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:46:05.509884 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-ed743236-d459-4783-86c9-27da6202a9a2 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:05.510608 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-ed743236-d459-4783-86c9-27da6202a9a2 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] [instance: 1e9957cf-cfeb-483d-bc32-73ca72a54eb9] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:05.516829 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ed743236-d459-4783-86c9-27da6202a9a2 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:05.517310 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ed743236-d459-4783-86c9-27da6202a9a2 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:05.517744 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ed743236-d459-4783-86c9-27da6202a9a2 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:05.518460 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ed743236-d459-4783-86c9-27da6202a9a2 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:05.518911 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ed743236-d459-4783-86c9-27da6202a9a2 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:05.519330 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ed743236-d459-4783-86c9-27da6202a9a2 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:05.597036 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.network.neutron [None req-05d2831f-7640-47a6-8d4c-efa60f0a7717 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] validate_networks() for [('80c3bd4e-c948-4bd0-860e-856f34e6a879', None, None, None, None, None)] {{(pid=134102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:46:05.770113 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-ed743236-d459-4783-86c9-27da6202a9a2 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2dff38dea346219f6534426fd27ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6a5f1476ac48f3831f2ed202dacdf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:05.780844 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-ed743236-d459-4783-86c9-27da6202a9a2 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] 10.222.0.43 "GET /compute/v2.1/servers/1e9957cf-cfeb-483d-bc32-73ca72a54eb9" status: 200 len: 1370 microversion: 2.1 time: 0.275081 Oct 04 21:46:05.781528 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 388/764] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:05 2022] GET /compute/v2.1/servers/1e9957cf-cfeb-483d-bc32-73ca72a54eb9 => generated 1370 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:05.939121 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-a1a8e468-e6be-454e-9ef3-ec05713d3590 tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:05.940119 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-a1a8e468-e6be-454e-9ef3-ec05713d3590 tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] [instance: 10062905-54d7-47e2-b621-522e0954b72b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:05.947141 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a1a8e468-e6be-454e-9ef3-ec05713d3590 tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:05.948428 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a1a8e468-e6be-454e-9ef3-ec05713d3590 tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:05.949290 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a1a8e468-e6be-454e-9ef3-ec05713d3590 tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:05.950238 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a1a8e468-e6be-454e-9ef3-ec05713d3590 tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:05.950924 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a1a8e468-e6be-454e-9ef3-ec05713d3590 tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:05.951562 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a1a8e468-e6be-454e-9ef3-ec05713d3590 tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:06.473274 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-a1a8e468-e6be-454e-9ef3-ec05713d3590 tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/10062905-54d7-47e2-b621-522e0954b72b" status: 200 len: 1644 microversion: 2.1 time: 0.690669 Oct 04 21:46:06.474061 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 389/765] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:05 2022] GET /compute/v2.1/servers/10062905-54d7-47e2-b621-522e0954b72b => generated 1644 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:06.480513 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-eba7f9d3-adb8-4ed4-9258-767f8f6e44d6 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:06.481308 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-eba7f9d3-adb8-4ed4-9258-767f8f6e44d6 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] [instance: caabd624-94e3-4d85-9038-2f3beeabfda9] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:06.487559 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-eba7f9d3-adb8-4ed4-9258-767f8f6e44d6 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:06.488296 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-eba7f9d3-adb8-4ed4-9258-767f8f6e44d6 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:06.488880 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-eba7f9d3-adb8-4ed4-9258-767f8f6e44d6 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:06.489595 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-eba7f9d3-adb8-4ed4-9258-767f8f6e44d6 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:06.490057 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-eba7f9d3-adb8-4ed4-9258-767f8f6e44d6 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:06.490538 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-eba7f9d3-adb8-4ed4-9258-767f8f6e44d6 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:06.505754 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-eba7f9d3-adb8-4ed4-9258-767f8f6e44d6 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] HTTP exception thrown: Instance caabd624-94e3-4d85-9038-2f3beeabfda9 could not be found. Oct 04 21:46:06.508223 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-eba7f9d3-adb8-4ed4-9258-767f8f6e44d6 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Request method failure captured: Oct 04 21:46:06.508223 n-d-860284-1 devstack@n-api.service[134101]: request: GET /compute/v2.1/servers/caabd624-94e3-4d85-9038-2f3beeabfda9 HTTP/1.1 Oct 04 21:46:06.508223 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 21:46:06.508223 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 21:46:06.508223 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 21:46:06.508223 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 21:46:06.508223 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 21:46:06.508223 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 21:46:06.508223 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 21:46:06.508223 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 21:46:06.508223 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPKlahfyY_VpZsyKxVX-InBaTGHAYQjTZlsBYKy5-L5WK_nlYvrzHLlwSNu8eskay1b_TfKXr3Hu1cjcMcUEXYTdUjbdmEnagAngqbnej5tyuNB4ajvQL5uIAAOpOA9SYZCiSdsDDLdJebWwbjWQAuaasRmnK1AwBPpiOu4WABL-dchU Oct 04 21:46:06.508223 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 21:46:06.508223 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 21:46:06.508223 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 21:46:06.508223 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 21:46:06.508223 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 21:46:06.508223 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 21:46:06.508223 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: 94201b6c845f4334b6f4883606b0d037 Oct 04 21:46:06.508223 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1947518546 Oct 04 21:46:06.508223 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 21:46:06.508223 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 21:46:06.510343 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/94201b6c845f4334b6f4883606b0d037"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_94201b6c845f4334b6f4883606b0d037", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/94201b6c845f4334b6f4883606b0d037"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/94201b6c845f4334b6f4883606b0d037"}]}] Oct 04 21:46:06.510343 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1947518546 Oct 04 21:46:06.510343 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: 94201b6c845f4334b6f4883606b0d037 Oct 04 21:46:06.510343 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1947518546 Oct 04 21:46:06.510343 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-ServersAdminNegativeTestJSON-1947518546-project Oct 04 21:46:06.510343 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 21:46:06.510343 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 21:46:06.510343 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 6975d7cbd8554e06a15a8b2adc811b12 Oct 04 21:46:06.510343 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1947518546-project Oct 04 21:46:06.510343 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 21:46:06.510343 n-d-860284-1 devstack@n-api.service[134101]: exception: Instance caabd624-94e3-4d85-9038-2f3beeabfda9 could not be found. Oct 04 21:46:06.510343 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': 'caabd624-94e3-4d85-9038-2f3beeabfda9'} Oct 04 21:46:06.511267 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:46:06.511267 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:46:06.511267 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:46:06.511267 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:46:06.511267 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:46:06.511267 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:46:06.511267 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:46:06.511267 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:46:06.511267 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:46:06.511267 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:46:06.511267 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance caabd624-94e3-4d85-9038-2f3beeabfda9 could not be found. Oct 04 21:46:06.511267 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:46:06.511267 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:46:06.511267 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:46:06.511267 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:46:06.511267 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:46:06.511267 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:46:06.511267 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:46:06.511267 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:46:06.511267 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:46:06.512835 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:46:06.512835 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:46:06.512835 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:46:06.512835 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:46:06.512835 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:46:06.512835 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:46:06.512835 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:46:06.512835 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance caabd624-94e3-4d85-9038-2f3beeabfda9 could not be found. Oct 04 21:46:06.512835 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:46:06.512835 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:46:06.512835 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:46:06.512835 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:46:06.512835 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:46:06.512835 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:46:06.512835 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:46:06.512835 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:46:06.512835 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance caabd624-94e3-4d85-9038-2f3beeabfda9 could not be found. Oct 04 21:46:06.512835 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:46:06.514256 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-eba7f9d3-adb8-4ed4-9258-767f8f6e44d6 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Returning 404 to user: Instance caabd624-94e3-4d85-9038-2f3beeabfda9 could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:46:06.514256 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-eba7f9d3-adb8-4ed4-9258-767f8f6e44d6 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] 10.222.0.43 "GET /compute/v2.1/servers/caabd624-94e3-4d85-9038-2f3beeabfda9" status: 404 len: 111 microversion: 2.1 time: 0.034647 Oct 04 21:46:06.514256 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 390/766] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:06 2022] GET /compute/v2.1/servers/caabd624-94e3-4d85-9038-2f3beeabfda9 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:46:06.518799 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-30eff104-ee96-4a00-8d05-d855266464b9 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:06.519417 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-30eff104-ee96-4a00-8d05-d855266464b9 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] [instance: 659208f3-1bef-41f7-9616-50c2db9f46ba] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:06.525490 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-30eff104-ee96-4a00-8d05-d855266464b9 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:06.525978 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-30eff104-ee96-4a00-8d05-d855266464b9 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:06.526450 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-30eff104-ee96-4a00-8d05-d855266464b9 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:06.527161 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-30eff104-ee96-4a00-8d05-d855266464b9 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:06.527619 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-30eff104-ee96-4a00-8d05-d855266464b9 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:06.528260 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-30eff104-ee96-4a00-8d05-d855266464b9 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:06.660427 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-05d2831f-7640-47a6-8d4c-efa60f0a7717 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Flavor limits 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:46:06.661530 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-05d2831f-7640-47a6-8d4c-efa60f0a7717 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Image limits 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:46:06.662028 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-05d2831f-7640-47a6-8d4c-efa60f0a7717 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Flavor pref 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:46:06.662481 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-05d2831f-7640-47a6-8d4c-efa60f0a7717 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Image pref 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:46:06.663289 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-05d2831f-7640-47a6-8d4c-efa60f0a7717 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:46:06.672289 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-05d2831f-7640-47a6-8d4c-efa60f0a7717 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:06.672965 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-05d2831f-7640-47a6-8d4c-efa60f0a7717 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:06.673412 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-05d2831f-7640-47a6-8d4c-efa60f0a7717 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:06.674192 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-05d2831f-7640-47a6-8d4c-efa60f0a7717 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:06.674696 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-05d2831f-7640-47a6-8d4c-efa60f0a7717 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:06.675129 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-05d2831f-7640-47a6-8d4c-efa60f0a7717 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:06.694698 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-05d2831f-7640-47a6-8d4c-efa60f0a7717 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Getting quotas for project da67fc95e2814f4086df020f4c475764. Resources: {'instances', 'ram', 'cores'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:46:06.700242 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-05d2831f-7640-47a6-8d4c-efa60f0a7717 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Getting quotas for user 1789bb97219a4e1591632126812ea6df and project da67fc95e2814f4086df020f4c475764. Resources: {'instances', 'ram', 'cores'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:46:06.714494 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-05d2831f-7640-47a6-8d4c-efa60f0a7717 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Going to run 1 instances... {{(pid=134102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:46:06.717046 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-05d2831f-7640-47a6-8d4c-efa60f0a7717 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] [instance: 34276621-d087-478b-81c7-bdf5e38efc69] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='58548514-5dac-426c-81f5-19e3fba33e23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=134102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:46:06.718348 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-30eff104-ee96-4a00-8d05-d855266464b9 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:06.726967 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-30eff104-ee96-4a00-8d05-d855266464b9 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:06.728478 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-30eff104-ee96-4a00-8d05-d855266464b9 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:06.729640 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-30eff104-ee96-4a00-8d05-d855266464b9 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] 10.222.0.43 "GET /compute/v2.1/servers/659208f3-1bef-41f7-9616-50c2db9f46ba" status: 200 len: 1568 microversion: 2.25 time: 0.214600 Oct 04 21:46:06.730194 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 391/767] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:46:06 2022] GET /compute/v2.1/servers/659208f3-1bef-41f7-9616-50c2db9f46ba => generated 1568 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:46:06.734776 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-c6306e93-0304-44b9-9e9e-29179cba552c tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:06.735382 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-c6306e93-0304-44b9-9e9e-29179cba552c tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: a2d1b827-a865-4d56-a665-110d0541a669] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:06.741920 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c6306e93-0304-44b9-9e9e-29179cba552c tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:06.742544 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c6306e93-0304-44b9-9e9e-29179cba552c tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:06.742986 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c6306e93-0304-44b9-9e9e-29179cba552c tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:06.743682 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c6306e93-0304-44b9-9e9e-29179cba552c tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:06.744140 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c6306e93-0304-44b9-9e9e-29179cba552c tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:06.744567 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c6306e93-0304-44b9-9e9e-29179cba552c tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:06.747445 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=100 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:46:06.770984 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-05d2831f-7640-47a6-8d4c-efa60f0a7717 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.318081 Oct 04 21:46:06.771928 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 377/768] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 21:46:05 2022] POST /compute/v2.1/servers => generated 401 bytes in 1319 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:46:06.777161 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-ede92e27-0347-4cac-9130-6d4eb8a739b5 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:06.777857 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-ede92e27-0347-4cac-9130-6d4eb8a739b5 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] [instance: f3a0dc37-502e-48d3-9537-10dd7fb15e94] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:06.787090 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ede92e27-0347-4cac-9130-6d4eb8a739b5 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:06.787585 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ede92e27-0347-4cac-9130-6d4eb8a739b5 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:06.788080 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ede92e27-0347-4cac-9130-6d4eb8a739b5 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:06.789029 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ede92e27-0347-4cac-9130-6d4eb8a739b5 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:06.789505 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ede92e27-0347-4cac-9130-6d4eb8a739b5 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:06.789934 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ede92e27-0347-4cac-9130-6d4eb8a739b5 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:06.951161 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-c6306e93-0304-44b9-9e9e-29179cba552c tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:06.962634 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-c6306e93-0304-44b9-9e9e-29179cba552c tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/a2d1b827-a865-4d56-a665-110d0541a669" status: 200 len: 1475 microversion: 2.1 time: 0.230507 Oct 04 21:46:06.963404 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 392/769] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:06 2022] GET /compute/v2.1/servers/a2d1b827-a865-4d56-a665-110d0541a669 => generated 1475 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:06.982886 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-d65f1d86-11a2-47f5-9b86-61f93f56ae49 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:06.983997 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-d65f1d86-11a2-47f5-9b86-61f93f56ae49 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] [instance: 58b5b55c-fd7d-4a43-96af-01ae27cb29de] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:06.992907 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d65f1d86-11a2-47f5-9b86-61f93f56ae49 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:06.994059 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d65f1d86-11a2-47f5-9b86-61f93f56ae49 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:06.995273 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d65f1d86-11a2-47f5-9b86-61f93f56ae49 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:06.996085 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d65f1d86-11a2-47f5-9b86-61f93f56ae49 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:06.996658 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d65f1d86-11a2-47f5-9b86-61f93f56ae49 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:06.997219 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d65f1d86-11a2-47f5-9b86-61f93f56ae49 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:06.999642 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-ede92e27-0347-4cac-9130-6d4eb8a739b5 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29842a669a20408b881105135f76cb0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39edf587afe94b60911198aa0bb61613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:07.009077 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-ede92e27-0347-4cac-9130-6d4eb8a739b5 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] 10.222.0.43 "GET /compute/v2.1/servers/f3a0dc37-502e-48d3-9537-10dd7fb15e94" status: 200 len: 1466 microversion: 2.1 time: 0.235515 Oct 04 21:46:07.009881 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 378/770] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:06 2022] GET /compute/v2.1/servers/f3a0dc37-502e-48d3-9537-10dd7fb15e94 => generated 1466 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:07.014086 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-6d0acddb-36f5-4649-9908-beae31bd41cc tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:07.014754 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-6d0acddb-36f5-4649-9908-beae31bd41cc tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] [instance: 10062905-54d7-47e2-b621-522e0954b72b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:07.020599 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6d0acddb-36f5-4649-9908-beae31bd41cc tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:07.021087 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6d0acddb-36f5-4649-9908-beae31bd41cc tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:07.021521 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6d0acddb-36f5-4649-9908-beae31bd41cc tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:07.023125 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6d0acddb-36f5-4649-9908-beae31bd41cc tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:07.023610 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6d0acddb-36f5-4649-9908-beae31bd41cc tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:07.024042 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6d0acddb-36f5-4649-9908-beae31bd41cc tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:07.256636 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-d65f1d86-11a2-47f5-9b86-61f93f56ae49 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87616cd16995468ab7febf5aa4b284db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e3bf9149434d34b6762aaeef1478ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:07.261987 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-6d0acddb-36f5-4649-9908-beae31bd41cc tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/10062905-54d7-47e2-b621-522e0954b72b" status: 200 len: 1644 microversion: 2.1 time: 0.250964 Oct 04 21:46:07.262923 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 379/771] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:07 2022] GET /compute/v2.1/servers/10062905-54d7-47e2-b621-522e0954b72b => generated 1644 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:07.265011 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-d65f1d86-11a2-47f5-9b86-61f93f56ae49 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] 10.222.0.43 "GET /compute/v2.1/servers/58b5b55c-fd7d-4a43-96af-01ae27cb29de" status: 200 len: 1314 microversion: 2.1 time: 0.299875 Oct 04 21:46:07.265773 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 393/772] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:06 2022] GET /compute/v2.1/servers/58b5b55c-fd7d-4a43-96af-01ae27cb29de => generated 1314 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:07.267786 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-4c57fd3c-1aef-49f3-8f2f-193f282ef8bc tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:07.268285 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-4c57fd3c-1aef-49f3-8f2f-193f282ef8bc tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] [instance: 049f396b-7494-4b40-ad21-c3401958088b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:07.275729 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4c57fd3c-1aef-49f3-8f2f-193f282ef8bc tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:07.276425 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4c57fd3c-1aef-49f3-8f2f-193f282ef8bc tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:07.277027 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4c57fd3c-1aef-49f3-8f2f-193f282ef8bc tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:07.277884 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4c57fd3c-1aef-49f3-8f2f-193f282ef8bc tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:07.278522 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4c57fd3c-1aef-49f3-8f2f-193f282ef8bc tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:07.279101 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4c57fd3c-1aef-49f3-8f2f-193f282ef8bc tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:07.286763 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-7fe66e81-4bb5-49ae-a25f-8a050f34611d tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:07.287584 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-7fe66e81-4bb5-49ae-a25f-8a050f34611d tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] [instance: 34276621-d087-478b-81c7-bdf5e38efc69] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:07.316233 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-4c57fd3c-1aef-49f3-8f2f-193f282ef8bc tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] [instance: 049f396b-7494-4b40-ad21-c3401958088b] Going to try to terminate instance {{(pid=134102) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:46:07.345035 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-7fe66e81-4bb5-49ae-a25f-8a050f34611d tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1789bb97219a4e1591632126812ea6df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da67fc95e2814f4086df020f4c475764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:07.352740 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-7fe66e81-4bb5-49ae-a25f-8a050f34611d tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] 10.222.0.43 "GET /compute/v2.1/servers/34276621-d087-478b-81c7-bdf5e38efc69" status: 200 len: 1264 microversion: 2.1 time: 0.085763 Oct 04 21:46:07.353318 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 394/773] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:07 2022] GET /compute/v2.1/servers/34276621-d087-478b-81c7-bdf5e38efc69 => generated 1264 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:07.374350 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-3f9108d0-3f92-4c75-9e64-50c85a93cb22 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:07.374996 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-3f9108d0-3f92-4c75-9e64-50c85a93cb22 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] [instance: 1e9957cf-cfeb-483d-bc32-73ca72a54eb9] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:07.382004 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3f9108d0-3f92-4c75-9e64-50c85a93cb22 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:07.382805 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3f9108d0-3f92-4c75-9e64-50c85a93cb22 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:07.383333 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3f9108d0-3f92-4c75-9e64-50c85a93cb22 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:07.384044 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3f9108d0-3f92-4c75-9e64-50c85a93cb22 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:07.384544 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3f9108d0-3f92-4c75-9e64-50c85a93cb22 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:07.384966 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3f9108d0-3f92-4c75-9e64-50c85a93cb22 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:07.386417 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:46:07.406251 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-4c57fd3c-1aef-49f3-8f2f-193f282ef8bc tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] 10.222.0.43 "DELETE /compute/v2.1/servers/049f396b-7494-4b40-ad21-c3401958088b" status: 204 len: 0 microversion: 2.1 time: 0.142049 Oct 04 21:46:07.406915 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 380/774] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 21:46:07 2022] DELETE /compute/v2.1/servers/049f396b-7494-4b40-ad21-c3401958088b => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:46:07.412499 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-32bb264d-f899-4b8f-8c01-1e6418ae407d tempest-ServersOnMultiNodesTest-962622545 tempest-ServersOnMultiNodesTest-962622545-project-admin] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:07.413970 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-32bb264d-f899-4b8f-8c01-1e6418ae407d tempest-ServersOnMultiNodesTest-962622545 tempest-ServersOnMultiNodesTest-962622545-project-admin] [instance: f3a0dc37-502e-48d3-9537-10dd7fb15e94] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:07.420031 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-32bb264d-f899-4b8f-8c01-1e6418ae407d tempest-ServersOnMultiNodesTest-962622545 tempest-ServersOnMultiNodesTest-962622545-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:07.420472 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-32bb264d-f899-4b8f-8c01-1e6418ae407d tempest-ServersOnMultiNodesTest-962622545 tempest-ServersOnMultiNodesTest-962622545-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:07.421064 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-32bb264d-f899-4b8f-8c01-1e6418ae407d tempest-ServersOnMultiNodesTest-962622545 tempest-ServersOnMultiNodesTest-962622545-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:07.421919 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-32bb264d-f899-4b8f-8c01-1e6418ae407d tempest-ServersOnMultiNodesTest-962622545 tempest-ServersOnMultiNodesTest-962622545-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:07.422570 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-32bb264d-f899-4b8f-8c01-1e6418ae407d tempest-ServersOnMultiNodesTest-962622545 tempest-ServersOnMultiNodesTest-962622545-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:07.423139 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-32bb264d-f899-4b8f-8c01-1e6418ae407d tempest-ServersOnMultiNodesTest-962622545 tempest-ServersOnMultiNodesTest-962622545-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:07.588800 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-3f9108d0-3f92-4c75-9e64-50c85a93cb22 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2dff38dea346219f6534426fd27ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6a5f1476ac48f3831f2ed202dacdf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:07.598786 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-3f9108d0-3f92-4c75-9e64-50c85a93cb22 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] 10.222.0.43 "GET /compute/v2.1/servers/1e9957cf-cfeb-483d-bc32-73ca72a54eb9" status: 200 len: 1370 microversion: 2.1 time: 0.230546 Oct 04 21:46:07.599368 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 395/775] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:07 2022] GET /compute/v2.1/servers/1e9957cf-cfeb-483d-bc32-73ca72a54eb9 => generated 1370 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:07.604577 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-9e2ab395-c59f-4953-bc9f-348fc884481b tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:07.608482 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9e2ab395-c59f-4953-bc9f-348fc884481b tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:07.609131 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9e2ab395-c59f-4953-bc9f-348fc884481b tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:07.609724 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9e2ab395-c59f-4953-bc9f-348fc884481b tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:07.609873 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-32bb264d-f899-4b8f-8c01-1e6418ae407d tempest-ServersOnMultiNodesTest-962622545 tempest-ServersOnMultiNodesTest-962622545-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/f3a0dc37-502e-48d3-9537-10dd7fb15e94" status: 200 len: 1617 microversion: 2.1 time: 0.200997 Oct 04 21:46:07.610770 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9e2ab395-c59f-4953-bc9f-348fc884481b tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:07.611349 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 381/776] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:07 2022] GET /compute/v2.1/servers/f3a0dc37-502e-48d3-9537-10dd7fb15e94 => generated 1617 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:07.611477 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9e2ab395-c59f-4953-bc9f-348fc884481b tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:07.611804 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9e2ab395-c59f-4953-bc9f-348fc884481b tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:07.619731 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-7bc6a71c-52bd-4da8-a171-24b5af85a2b3 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:07.621452 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-7bc6a71c-52bd-4da8-a171-24b5af85a2b3 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] [instance: 049f396b-7494-4b40-ad21-c3401958088b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:07.633620 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7bc6a71c-52bd-4da8-a171-24b5af85a2b3 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:07.634678 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7bc6a71c-52bd-4da8-a171-24b5af85a2b3 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:07.636273 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7bc6a71c-52bd-4da8-a171-24b5af85a2b3 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:07.636626 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-9e2ab395-c59f-4953-bc9f-348fc884481b tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] 10.222.0.43 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.036016 Oct 04 21:46:07.642414 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 396/777] 10.222.0.43 () {58 vars in 1176 bytes} [Tue Oct 4 21:46:07 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:46:07.643544 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7bc6a71c-52bd-4da8-a171-24b5af85a2b3 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:07.644097 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7bc6a71c-52bd-4da8-a171-24b5af85a2b3 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:07.644616 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7bc6a71c-52bd-4da8-a171-24b5af85a2b3 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:07.651279 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-a1d424b8-8e2f-4a0a-9494-abbc92d06929 req-4f910d62-201c-420f-9224-c9bd1c148d87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e9957cf-cfeb-483d-bc32-73ca72a54eb9", "name": "network-vif-plugged", "status": "completed", "tag": "76bebc24-16b6-4425-aef8-2807d95b42ac"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:46:07.668778 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-a1d424b8-8e2f-4a0a-9494-abbc92d06929 req-4f910d62-201c-420f-9224-c9bd1c148d87 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:07.669331 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-a1d424b8-8e2f-4a0a-9494-abbc92d06929 req-4f910d62-201c-420f-9224-c9bd1c148d87 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:07.678051 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-a1d424b8-8e2f-4a0a-9494-abbc92d06929 req-4f910d62-201c-420f-9224-c9bd1c148d87 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:07.708294 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-a1d424b8-8e2f-4a0a-9494-abbc92d06929 req-4f910d62-201c-420f-9224-c9bd1c148d87 service nova] Creating event network-vif-plugged:76bebc24-16b6-4425-aef8-2807d95b42ac for instance 1e9957cf-cfeb-483d-bc32-73ca72a54eb9 on n-h1-860284-1 Oct 04 21:46:07.715592 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-a1d424b8-8e2f-4a0a-9494-abbc92d06929 req-4f910d62-201c-420f-9224-c9bd1c148d87 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076791 Oct 04 21:46:07.717225 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 397/778] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:46:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:46:07.723431 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-40e80a20-486e-474e-b60c-ceca5109fcc4 tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-860284-1", "block_migration": true, "disk_over_commit": false}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:46:07.727128 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-40e80a20-486e-474e-b60c-ceca5109fcc4 tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] [instance: 10062905-54d7-47e2-b621-522e0954b72b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:07.733915 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-40e80a20-486e-474e-b60c-ceca5109fcc4 tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:07.734491 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-40e80a20-486e-474e-b60c-ceca5109fcc4 tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:07.734938 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-40e80a20-486e-474e-b60c-ceca5109fcc4 tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:07.735726 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-40e80a20-486e-474e-b60c-ceca5109fcc4 tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:07.736179 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-40e80a20-486e-474e-b60c-ceca5109fcc4 tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:07.736662 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-40e80a20-486e-474e-b60c-ceca5109fcc4 tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:07.772690 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.objects.instance [None req-40e80a20-486e-474e-b60c-ceca5109fcc4 tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Lazy-loading 'flavor' on Instance uuid 10062905-54d7-47e2-b621-522e0954b72b {{(pid=134101) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:46:07.791369 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-40e80a20-486e-474e-b60c-ceca5109fcc4 tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] [instance: 10062905-54d7-47e2-b621-522e0954b72b] Going to try to live migrate instance to n-h2-860284-1 {{(pid=134101) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 04 21:46:07.801132 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-7bc6a71c-52bd-4da8-a171-24b5af85a2b3 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6975d7cbd8554e06a15a8b2adc811b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94201b6c845f4334b6f4883606b0d037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:07.810176 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-7bc6a71c-52bd-4da8-a171-24b5af85a2b3 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] 10.222.0.43 "GET /compute/v2.1/servers/049f396b-7494-4b40-ad21-c3401958088b" status: 200 len: 1477 microversion: 2.1 time: 0.197124 Oct 04 21:46:07.810824 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 382/779] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:07 2022] GET /compute/v2.1/servers/049f396b-7494-4b40-ad21-c3401958088b => generated 1477 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:07.822051 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-62cb7813-ede1-42eb-b70a-8d71481bcbe1 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:07.823087 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-62cb7813-ede1-42eb-b70a-8d71481bcbe1 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] [instance: 659208f3-1bef-41f7-9616-50c2db9f46ba] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:07.830466 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-62cb7813-ede1-42eb-b70a-8d71481bcbe1 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:07.830956 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-62cb7813-ede1-42eb-b70a-8d71481bcbe1 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:07.831386 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-62cb7813-ede1-42eb-b70a-8d71481bcbe1 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:07.832086 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-62cb7813-ede1-42eb-b70a-8d71481bcbe1 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:07.832539 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-62cb7813-ede1-42eb-b70a-8d71481bcbe1 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:07.832991 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-62cb7813-ede1-42eb-b70a-8d71481bcbe1 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:07.975287 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-62cb7813-ede1-42eb-b70a-8d71481bcbe1 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:07.985592 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-62cb7813-ede1-42eb-b70a-8d71481bcbe1 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:07.987091 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-62cb7813-ede1-42eb-b70a-8d71481bcbe1 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:07.988394 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-62cb7813-ede1-42eb-b70a-8d71481bcbe1 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] 10.222.0.43 "GET /compute/v2.1/servers/659208f3-1bef-41f7-9616-50c2db9f46ba" status: 200 len: 1568 microversion: 2.25 time: 0.172607 Oct 04 21:46:07.988982 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 383/780] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:46:07 2022] GET /compute/v2.1/servers/659208f3-1bef-41f7-9616-50c2db9f46ba => generated 1568 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:46:07.994194 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-20d45e02-f446-4932-b867-e6690b6b2774 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-2007582859", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["4b0c3dd7-d609-4b00-8604-35f8a2680c14"]}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:46:08.050038 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.network.neutron [None req-20d45e02-f446-4932-b867-e6690b6b2774 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] validate_networks() for None {{(pid=134102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:46:08.290652 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-20d45e02-f446-4932-b867-e6690b6b2774 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Flavor limits 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:46:08.291106 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-20d45e02-f446-4932-b867-e6690b6b2774 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Image limits 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:46:08.291570 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-20d45e02-f446-4932-b867-e6690b6b2774 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Flavor pref 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:46:08.291987 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-20d45e02-f446-4932-b867-e6690b6b2774 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Image pref 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:46:08.292404 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-20d45e02-f446-4932-b867-e6690b6b2774 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:46:08.301570 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-20d45e02-f446-4932-b867-e6690b6b2774 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:08.302315 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-20d45e02-f446-4932-b867-e6690b6b2774 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:08.302786 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-20d45e02-f446-4932-b867-e6690b6b2774 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:08.303612 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-20d45e02-f446-4932-b867-e6690b6b2774 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:08.304082 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-20d45e02-f446-4932-b867-e6690b6b2774 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:08.304518 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-20d45e02-f446-4932-b867-e6690b6b2774 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:08.322019 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-20d45e02-f446-4932-b867-e6690b6b2774 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Getting quotas for project 39edf587afe94b60911198aa0bb61613. Resources: {'instances', 'ram', 'cores'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:46:08.327333 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-20d45e02-f446-4932-b867-e6690b6b2774 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Getting quotas for user 29842a669a20408b881105135f76cb0a and project 39edf587afe94b60911198aa0bb61613. Resources: {'instances', 'ram', 'cores'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:46:08.340405 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-20d45e02-f446-4932-b867-e6690b6b2774 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Going to run 1 instances... {{(pid=134102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:46:08.342798 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-20d45e02-f446-4932-b867-e6690b6b2774 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] [instance: b19ef33c-3012-4eed-abd6-edc1bd9f3e9c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='58548514-5dac-426c-81f5-19e3fba33e23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:46:08.387798 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-20d45e02-f446-4932-b867-e6690b6b2774 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.397776 Oct 04 21:46:08.388456 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 384/781] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 21:46:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 399 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:46:08.392949 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-747dce32-5d1d-4257-b636-699dd453827e tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:08.393551 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-747dce32-5d1d-4257-b636-699dd453827e tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: a2d1b827-a865-4d56-a665-110d0541a669] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:08.400931 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-747dce32-5d1d-4257-b636-699dd453827e tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:08.401781 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-747dce32-5d1d-4257-b636-699dd453827e tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:08.401887 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-747dce32-5d1d-4257-b636-699dd453827e tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:08.402533 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-747dce32-5d1d-4257-b636-699dd453827e tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:08.402986 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-747dce32-5d1d-4257-b636-699dd453827e tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:08.403406 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-747dce32-5d1d-4257-b636-699dd453827e tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:08.541350 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-747dce32-5d1d-4257-b636-699dd453827e tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:08.550092 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-747dce32-5d1d-4257-b636-699dd453827e tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/a2d1b827-a865-4d56-a665-110d0541a669" status: 200 len: 1475 microversion: 2.1 time: 0.160629 Oct 04 21:46:08.558492 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 385/782] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:08 2022] GET /compute/v2.1/servers/a2d1b827-a865-4d56-a665-110d0541a669 => generated 1475 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:08.558492 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-36d8db84-1ea5-4c76-a378-f57f767c3683 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:08.558492 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-36d8db84-1ea5-4c76-a378-f57f767c3683 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] [instance: 58b5b55c-fd7d-4a43-96af-01ae27cb29de] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:08.562873 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-36d8db84-1ea5-4c76-a378-f57f767c3683 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:08.563363 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-36d8db84-1ea5-4c76-a378-f57f767c3683 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:08.563801 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-36d8db84-1ea5-4c76-a378-f57f767c3683 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:08.564504 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-36d8db84-1ea5-4c76-a378-f57f767c3683 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:08.564958 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-36d8db84-1ea5-4c76-a378-f57f767c3683 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:08.565386 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-36d8db84-1ea5-4c76-a378-f57f767c3683 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:08.736502 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-36d8db84-1ea5-4c76-a378-f57f767c3683 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87616cd16995468ab7febf5aa4b284db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e3bf9149434d34b6762aaeef1478ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:08.745228 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-36d8db84-1ea5-4c76-a378-f57f767c3683 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] 10.222.0.43 "GET /compute/v2.1/servers/58b5b55c-fd7d-4a43-96af-01ae27cb29de" status: 200 len: 1463 microversion: 2.1 time: 0.193371 Oct 04 21:46:08.754046 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 386/783] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:08 2022] GET /compute/v2.1/servers/58b5b55c-fd7d-4a43-96af-01ae27cb29de => generated 1463 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:08.760157 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-78d9e66b-2888-49b8-8aed-79c3682a065f tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:08.761440 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-78d9e66b-2888-49b8-8aed-79c3682a065f tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] [instance: 34276621-d087-478b-81c7-bdf5e38efc69] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:08.767701 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-78d9e66b-2888-49b8-8aed-79c3682a065f tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:08.768193 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-78d9e66b-2888-49b8-8aed-79c3682a065f tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:08.768634 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-78d9e66b-2888-49b8-8aed-79c3682a065f tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:08.769345 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-78d9e66b-2888-49b8-8aed-79c3682a065f tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:08.769806 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-78d9e66b-2888-49b8-8aed-79c3682a065f tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:08.770237 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-78d9e66b-2888-49b8-8aed-79c3682a065f tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:08.847239 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-78d9e66b-2888-49b8-8aed-79c3682a065f tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1789bb97219a4e1591632126812ea6df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da67fc95e2814f4086df020f4c475764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:08.858742 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-78d9e66b-2888-49b8-8aed-79c3682a065f tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] 10.222.0.43 "GET /compute/v2.1/servers/34276621-d087-478b-81c7-bdf5e38efc69" status: 200 len: 1260 microversion: 2.1 time: 0.103456 Oct 04 21:46:08.859503 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 387/784] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:08 2022] GET /compute/v2.1/servers/34276621-d087-478b-81c7-bdf5e38efc69 => generated 1260 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:08.864763 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-876fab10-ca7c-409c-b41a-89cd5aae182a tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:08.865368 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-876fab10-ca7c-409c-b41a-89cd5aae182a tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] [instance: b19ef33c-3012-4eed-abd6-edc1bd9f3e9c] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:08.872166 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-876fab10-ca7c-409c-b41a-89cd5aae182a tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:08.872894 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-876fab10-ca7c-409c-b41a-89cd5aae182a tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:08.873503 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-876fab10-ca7c-409c-b41a-89cd5aae182a tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:08.874203 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-876fab10-ca7c-409c-b41a-89cd5aae182a tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:08.874691 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-876fab10-ca7c-409c-b41a-89cd5aae182a tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:08.875115 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-876fab10-ca7c-409c-b41a-89cd5aae182a tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:08.945619 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-876fab10-ca7c-409c-b41a-89cd5aae182a tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29842a669a20408b881105135f76cb0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39edf587afe94b60911198aa0bb61613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:08.955218 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-876fab10-ca7c-409c-b41a-89cd5aae182a tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] 10.222.0.43 "GET /compute/v2.1/servers/b19ef33c-3012-4eed-abd6-edc1bd9f3e9c" status: 200 len: 1221 microversion: 2.1 time: 0.094439 Oct 04 21:46:08.956085 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 388/785] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:08 2022] GET /compute/v2.1/servers/b19ef33c-3012-4eed-abd6-edc1bd9f3e9c => generated 1221 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:08.965562 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-c0ee002d-d135-43a1-8d7a-c63d753de462 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:08.966190 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-c0ee002d-d135-43a1-8d7a-c63d753de462 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] [instance: 1e9957cf-cfeb-483d-bc32-73ca72a54eb9] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:08.972463 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c0ee002d-d135-43a1-8d7a-c63d753de462 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:08.972955 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c0ee002d-d135-43a1-8d7a-c63d753de462 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:08.973420 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c0ee002d-d135-43a1-8d7a-c63d753de462 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:08.974130 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c0ee002d-d135-43a1-8d7a-c63d753de462 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:08.974614 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c0ee002d-d135-43a1-8d7a-c63d753de462 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:08.975044 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c0ee002d-d135-43a1-8d7a-c63d753de462 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:09.111867 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-c0ee002d-d135-43a1-8d7a-c63d753de462 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2dff38dea346219f6534426fd27ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6a5f1476ac48f3831f2ed202dacdf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:09.120148 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-c0ee002d-d135-43a1-8d7a-c63d753de462 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] 10.222.0.43 "GET /compute/v2.1/servers/1e9957cf-cfeb-483d-bc32-73ca72a54eb9" status: 200 len: 1370 microversion: 2.1 time: 0.158722 Oct 04 21:46:09.120737 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 389/786] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:08 2022] GET /compute/v2.1/servers/1e9957cf-cfeb-483d-bc32-73ca72a54eb9 => generated 1370 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:09.125669 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-c2df121e-c604-4c47-adbd-b8cd73a1bacc tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:09.126288 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-c2df121e-c604-4c47-adbd-b8cd73a1bacc tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] [instance: e3380b36-6aba-4736-bcbc-f0058f806d55] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:09.134277 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c2df121e-c604-4c47-adbd-b8cd73a1bacc tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:09.134815 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c2df121e-c604-4c47-adbd-b8cd73a1bacc tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:09.135351 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c2df121e-c604-4c47-adbd-b8cd73a1bacc tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:09.136076 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c2df121e-c604-4c47-adbd-b8cd73a1bacc tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:09.136675 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c2df121e-c604-4c47-adbd-b8cd73a1bacc tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:09.136963 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c2df121e-c604-4c47-adbd-b8cd73a1bacc tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:09.281086 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-c2df121e-c604-4c47-adbd-b8cd73a1bacc tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87616cd16995468ab7febf5aa4b284db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e3bf9149434d34b6762aaeef1478ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:09.289183 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-c2df121e-c604-4c47-adbd-b8cd73a1bacc tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] 10.222.0.43 "GET /compute/v2.1/servers/e3380b36-6aba-4736-bcbc-f0058f806d55" status: 200 len: 1463 microversion: 2.1 time: 0.167443 Oct 04 21:46:09.289777 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 390/787] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:09 2022] GET /compute/v2.1/servers/e3380b36-6aba-4736-bcbc-f0058f806d55 => generated 1463 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:09.294555 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-72d0bc9b-bc9b-4c6d-84d1-fcff9a2dafe9 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:09.295371 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-72d0bc9b-bc9b-4c6d-84d1-fcff9a2dafe9 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] [instance: 049f396b-7494-4b40-ad21-c3401958088b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:09.301659 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-72d0bc9b-bc9b-4c6d-84d1-fcff9a2dafe9 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:09.302430 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-72d0bc9b-bc9b-4c6d-84d1-fcff9a2dafe9 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:09.302868 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-72d0bc9b-bc9b-4c6d-84d1-fcff9a2dafe9 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:09.304164 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-72d0bc9b-bc9b-4c6d-84d1-fcff9a2dafe9 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:09.304779 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-72d0bc9b-bc9b-4c6d-84d1-fcff9a2dafe9 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:09.305300 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-72d0bc9b-bc9b-4c6d-84d1-fcff9a2dafe9 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:09.440747 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-72d0bc9b-bc9b-4c6d-84d1-fcff9a2dafe9 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6975d7cbd8554e06a15a8b2adc811b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94201b6c845f4334b6f4883606b0d037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:09.444863 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:46:09.449888 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-72d0bc9b-bc9b-4c6d-84d1-fcff9a2dafe9 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] 10.222.0.43 "GET /compute/v2.1/servers/049f396b-7494-4b40-ad21-c3401958088b" status: 200 len: 1477 microversion: 2.1 time: 0.159150 Oct 04 21:46:09.450497 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 391/788] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:09 2022] GET /compute/v2.1/servers/049f396b-7494-4b40-ad21-c3401958088b => generated 1477 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:09.455606 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-e2b9483b-3e7e-4c5b-80ce-9c05581b8e81 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:09.456213 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-e2b9483b-3e7e-4c5b-80ce-9c05581b8e81 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] [instance: 659208f3-1bef-41f7-9616-50c2db9f46ba] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:09.463273 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e2b9483b-3e7e-4c5b-80ce-9c05581b8e81 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:09.463754 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e2b9483b-3e7e-4c5b-80ce-9c05581b8e81 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:09.464183 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e2b9483b-3e7e-4c5b-80ce-9c05581b8e81 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:09.464868 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e2b9483b-3e7e-4c5b-80ce-9c05581b8e81 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:09.465317 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e2b9483b-3e7e-4c5b-80ce-9c05581b8e81 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:09.465733 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e2b9483b-3e7e-4c5b-80ce-9c05581b8e81 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:09.695004 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-e2b9483b-3e7e-4c5b-80ce-9c05581b8e81 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:09.707447 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-e2b9483b-3e7e-4c5b-80ce-9c05581b8e81 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:09.708891 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-e2b9483b-3e7e-4c5b-80ce-9c05581b8e81 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:09.710326 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-e2b9483b-3e7e-4c5b-80ce-9c05581b8e81 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] 10.222.0.43 "GET /compute/v2.1/servers/659208f3-1bef-41f7-9616-50c2db9f46ba" status: 200 len: 1568 microversion: 2.25 time: 0.258879 Oct 04 21:46:09.711465 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 392/789] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:46:09 2022] GET /compute/v2.1/servers/659208f3-1bef-41f7-9616-50c2db9f46ba => generated 1568 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:46:09.732441 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-ff63a3c9-2b71-4739-a761-0ad2836fec1d tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-522992719", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "e3380b36-6aba-4736-bcbc-f0058f806d55"}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:46:09.808171 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.network.neutron [None req-ff63a3c9-2b71-4739-a761-0ad2836fec1d tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] validate_networks() for None {{(pid=134102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:46:10.515712 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-ff63a3c9-2b71-4739-a761-0ad2836fec1d tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Flavor limits 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:46:10.516366 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-ff63a3c9-2b71-4739-a761-0ad2836fec1d tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Image limits 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:46:10.516753 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-ff63a3c9-2b71-4739-a761-0ad2836fec1d tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Flavor pref 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:46:10.517238 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-ff63a3c9-2b71-4739-a761-0ad2836fec1d tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Image pref 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:46:10.517754 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-ff63a3c9-2b71-4739-a761-0ad2836fec1d tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:46:10.538290 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ff63a3c9-2b71-4739-a761-0ad2836fec1d tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:10.539263 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ff63a3c9-2b71-4739-a761-0ad2836fec1d tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:10.540720 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ff63a3c9-2b71-4739-a761-0ad2836fec1d tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:10.541887 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ff63a3c9-2b71-4739-a761-0ad2836fec1d tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:10.544256 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ff63a3c9-2b71-4739-a761-0ad2836fec1d tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:10.545013 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ff63a3c9-2b71-4739-a761-0ad2836fec1d tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:10.622992 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-ff63a3c9-2b71-4739-a761-0ad2836fec1d tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Getting quotas for project a1e3bf9149434d34b6762aaeef1478ed. Resources: {'instances', 'ram', 'cores'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:46:10.642745 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-ff63a3c9-2b71-4739-a761-0ad2836fec1d tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Getting quotas for user 87616cd16995468ab7febf5aa4b284db and project a1e3bf9149434d34b6762aaeef1478ed. Resources: {'instances', 'ram', 'cores'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:46:10.700661 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-ff63a3c9-2b71-4739-a761-0ad2836fec1d tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Going to run 1 instances... {{(pid=134102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:46:10.709174 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-ff63a3c9-2b71-4739-a761-0ad2836fec1d tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] [instance: d2542961-c0a1-46da-9ae8-2f40faa0a294] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='58548514-5dac-426c-81f5-19e3fba33e23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:46:10.806264 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-ff63a3c9-2b71-4739-a761-0ad2836fec1d tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.090719 Oct 04 21:46:10.809020 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 393/790] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 21:46:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1097 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:46:10.817742 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-9dde3693-9469-4692-a419-fb6519c4e3b3 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:10.826558 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-9dde3693-9469-4692-a419-fb6519c4e3b3 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: a2d1b827-a865-4d56-a665-110d0541a669] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:10.838334 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9dde3693-9469-4692-a419-fb6519c4e3b3 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:10.839891 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9dde3693-9469-4692-a419-fb6519c4e3b3 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:10.842307 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9dde3693-9469-4692-a419-fb6519c4e3b3 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:10.843390 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9dde3693-9469-4692-a419-fb6519c4e3b3 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:10.845034 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9dde3693-9469-4692-a419-fb6519c4e3b3 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:10.846420 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9dde3693-9469-4692-a419-fb6519c4e3b3 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:11.884307 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-9dde3693-9469-4692-a419-fb6519c4e3b3 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:11.897523 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-9dde3693-9469-4692-a419-fb6519c4e3b3 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/a2d1b827-a865-4d56-a665-110d0541a669" status: 200 len: 1474 microversion: 2.1 time: 1.084305 Oct 04 21:46:11.901740 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 394/791] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:10 2022] GET /compute/v2.1/servers/a2d1b827-a865-4d56-a665-110d0541a669 => generated 1474 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:11.911643 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-54b1b138-7f1f-42a1-b2ea-e3b7292d4b76 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:11.912453 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-54b1b138-7f1f-42a1-b2ea-e3b7292d4b76 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] [instance: 34276621-d087-478b-81c7-bdf5e38efc69] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:11.930466 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-54b1b138-7f1f-42a1-b2ea-e3b7292d4b76 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:11.931293 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-54b1b138-7f1f-42a1-b2ea-e3b7292d4b76 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:11.931901 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-54b1b138-7f1f-42a1-b2ea-e3b7292d4b76 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:11.932789 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-54b1b138-7f1f-42a1-b2ea-e3b7292d4b76 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:11.933992 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-54b1b138-7f1f-42a1-b2ea-e3b7292d4b76 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:11.934831 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-54b1b138-7f1f-42a1-b2ea-e3b7292d4b76 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:12.025438 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-40e80a20-486e-474e-b60c-ceca5109fcc4 tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] 10.222.0.43 "POST /compute/v2.1/servers/10062905-54d7-47e2-b621-522e0954b72b/action" status: 202 len: 0 microversion: 2.1 time: 4.306553 Oct 04 21:46:12.028555 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 398/792] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 21:46:07 2022] POST /compute/v2.1/servers/10062905-54d7-47e2-b621-522e0954b72b/action => generated 0 bytes in 4311 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:46:12.035442 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-781cd9df-5c30-46ba-b6af-828e8d0a5f4e tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:12.036363 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-781cd9df-5c30-46ba-b6af-828e8d0a5f4e tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] [instance: b19ef33c-3012-4eed-abd6-edc1bd9f3e9c] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:12.059899 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-781cd9df-5c30-46ba-b6af-828e8d0a5f4e tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:12.062572 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-781cd9df-5c30-46ba-b6af-828e8d0a5f4e tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:12.063218 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-781cd9df-5c30-46ba-b6af-828e8d0a5f4e tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:12.065745 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-781cd9df-5c30-46ba-b6af-828e8d0a5f4e tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:12.072610 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-781cd9df-5c30-46ba-b6af-828e8d0a5f4e tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:12.073314 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-781cd9df-5c30-46ba-b6af-828e8d0a5f4e tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:12.333472 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-781cd9df-5c30-46ba-b6af-828e8d0a5f4e tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29842a669a20408b881105135f76cb0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39edf587afe94b60911198aa0bb61613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:12.337796 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-54b1b138-7f1f-42a1-b2ea-e3b7292d4b76 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1789bb97219a4e1591632126812ea6df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da67fc95e2814f4086df020f4c475764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:12.348736 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-781cd9df-5c30-46ba-b6af-828e8d0a5f4e tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] 10.222.0.43 "GET /compute/v2.1/servers/b19ef33c-3012-4eed-abd6-edc1bd9f3e9c" status: 200 len: 1213 microversion: 2.1 time: 0.318801 Oct 04 21:46:12.352814 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-54b1b138-7f1f-42a1-b2ea-e3b7292d4b76 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] 10.222.0.43 "GET /compute/v2.1/servers/34276621-d087-478b-81c7-bdf5e38efc69" status: 200 len: 1322 microversion: 2.1 time: 0.449723 Oct 04 21:46:12.369690 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 399/793] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:12 2022] GET /compute/v2.1/servers/b19ef33c-3012-4eed-abd6-edc1bd9f3e9c => generated 1213 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:12.374260 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 395/794] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:11 2022] GET /compute/v2.1/servers/34276621-d087-478b-81c7-bdf5e38efc69 => generated 1322 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:12.379422 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-b854b81d-117b-4891-913b-82b2b17511cb tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:12.380292 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-b854b81d-117b-4891-913b-82b2b17511cb tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] [instance: 1e9957cf-cfeb-483d-bc32-73ca72a54eb9] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:12.400000 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b854b81d-117b-4891-913b-82b2b17511cb tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:12.403434 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b854b81d-117b-4891-913b-82b2b17511cb tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:12.403739 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-902b8de7-7da7-414e-82b9-a1b441118598 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:12.404275 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b854b81d-117b-4891-913b-82b2b17511cb tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:12.405198 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b854b81d-117b-4891-913b-82b2b17511cb tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:12.407200 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b854b81d-117b-4891-913b-82b2b17511cb tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:12.408789 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-902b8de7-7da7-414e-82b9-a1b441118598 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] [instance: 049f396b-7494-4b40-ad21-c3401958088b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:12.409010 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b854b81d-117b-4891-913b-82b2b17511cb tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:12.450442 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-902b8de7-7da7-414e-82b9-a1b441118598 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:12.450946 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-902b8de7-7da7-414e-82b9-a1b441118598 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:12.451385 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-902b8de7-7da7-414e-82b9-a1b441118598 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:12.452114 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-902b8de7-7da7-414e-82b9-a1b441118598 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:12.452590 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-902b8de7-7da7-414e-82b9-a1b441118598 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:12.453019 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-902b8de7-7da7-414e-82b9-a1b441118598 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:12.502089 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-902b8de7-7da7-414e-82b9-a1b441118598 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] HTTP exception thrown: Instance 049f396b-7494-4b40-ad21-c3401958088b could not be found. Oct 04 21:46:12.504401 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-902b8de7-7da7-414e-82b9-a1b441118598 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Request method failure captured: Oct 04 21:46:12.504401 n-d-860284-1 devstack@n-api.service[134102]: request: GET /compute/v2.1/servers/049f396b-7494-4b40-ad21-c3401958088b HTTP/1.1 Oct 04 21:46:12.504401 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 21:46:12.504401 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 21:46:12.504401 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 21:46:12.504401 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 21:46:12.504401 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 21:46:12.504401 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 21:46:12.504401 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 21:46:12.504401 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 21:46:12.504401 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPKlahfyY_VpZsyKxVX-InBaTGHAYQjTZlsBYKy5-L5WK_nlYvrzHLlwSNu8eskay1b_TfKXr3Hu1cjcMcUEXYTdUjbdmEnagAngqbnej5tyuNB4ajvQL5uIAAOpOA9SYZCiSdsDDLdJebWwbjWQAuaasRmnK1AwBPpiOu4WABL-dchU Oct 04 21:46:12.504401 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 21:46:12.504401 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 21:46:12.504401 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 21:46:12.504401 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 21:46:12.504401 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 21:46:12.504401 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 21:46:12.504401 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: 94201b6c845f4334b6f4883606b0d037 Oct 04 21:46:12.504401 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1947518546 Oct 04 21:46:12.504401 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 21:46:12.504401 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 21:46:12.506095 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/94201b6c845f4334b6f4883606b0d037"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_94201b6c845f4334b6f4883606b0d037", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/94201b6c845f4334b6f4883606b0d037"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/94201b6c845f4334b6f4883606b0d037"}]}] Oct 04 21:46:12.506095 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1947518546 Oct 04 21:46:12.506095 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: 94201b6c845f4334b6f4883606b0d037 Oct 04 21:46:12.506095 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1947518546 Oct 04 21:46:12.506095 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-ServersAdminNegativeTestJSON-1947518546-project Oct 04 21:46:12.506095 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 21:46:12.506095 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 21:46:12.506095 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: 6975d7cbd8554e06a15a8b2adc811b12 Oct 04 21:46:12.506095 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1947518546-project Oct 04 21:46:12.506095 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 21:46:12.506095 n-d-860284-1 devstack@n-api.service[134102]: exception: Instance 049f396b-7494-4b40-ad21-c3401958088b could not be found. Oct 04 21:46:12.506095 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': '049f396b-7494-4b40-ad21-c3401958088b'} Oct 04 21:46:12.507066 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:46:12.507066 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:46:12.507066 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:46:12.507066 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:46:12.507066 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:46:12.507066 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:46:12.507066 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:46:12.507066 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:46:12.507066 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:46:12.507066 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:46:12.507066 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 049f396b-7494-4b40-ad21-c3401958088b could not be found. Oct 04 21:46:12.507066 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:46:12.507066 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:46:12.507066 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:46:12.507066 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:46:12.507066 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:46:12.507066 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:46:12.507066 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:46:12.507066 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:46:12.507066 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:46:12.508668 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:46:12.508668 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:46:12.508668 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:46:12.508668 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:46:12.508668 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:46:12.508668 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:46:12.508668 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:46:12.508668 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 049f396b-7494-4b40-ad21-c3401958088b could not be found. Oct 04 21:46:12.508668 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:46:12.508668 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:46:12.508668 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:46:12.508668 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:46:12.508668 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:46:12.508668 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:46:12.508668 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:46:12.508668 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:46:12.508668 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 049f396b-7494-4b40-ad21-c3401958088b could not be found. Oct 04 21:46:12.508668 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:46:12.511058 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-902b8de7-7da7-414e-82b9-a1b441118598 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] Returning 404 to user: Instance 049f396b-7494-4b40-ad21-c3401958088b could not be found. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:46:12.512145 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-902b8de7-7da7-414e-82b9-a1b441118598 tempest-ServersAdminNegativeTestJSON-1947518546 tempest-ServersAdminNegativeTestJSON-1947518546-project] 10.222.0.43 "GET /compute/v2.1/servers/049f396b-7494-4b40-ad21-c3401958088b" status: 404 len: 111 microversion: 2.1 time: 0.136799 Oct 04 21:46:12.516258 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 396/795] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:12 2022] GET /compute/v2.1/servers/049f396b-7494-4b40-ad21-c3401958088b => generated 111 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:46:12.523258 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-0a7dc78f-5947-4e86-b260-5702808fdfde tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:12.524101 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-0a7dc78f-5947-4e86-b260-5702808fdfde tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] [instance: 659208f3-1bef-41f7-9616-50c2db9f46ba] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:12.530461 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0a7dc78f-5947-4e86-b260-5702808fdfde tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:12.531271 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0a7dc78f-5947-4e86-b260-5702808fdfde tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:12.531906 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0a7dc78f-5947-4e86-b260-5702808fdfde tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:12.532794 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0a7dc78f-5947-4e86-b260-5702808fdfde tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:12.533423 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0a7dc78f-5947-4e86-b260-5702808fdfde tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:12.534021 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0a7dc78f-5947-4e86-b260-5702808fdfde tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:13.146434 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-0a7dc78f-5947-4e86-b260-5702808fdfde tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:13.159330 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-0a7dc78f-5947-4e86-b260-5702808fdfde tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:13.176632 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-0a7dc78f-5947-4e86-b260-5702808fdfde tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:13.178814 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-0a7dc78f-5947-4e86-b260-5702808fdfde tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] 10.222.0.43 "GET /compute/v2.1/servers/659208f3-1bef-41f7-9616-50c2db9f46ba" status: 200 len: 1568 microversion: 2.25 time: 0.660757 Oct 04 21:46:13.179686 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 397/796] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:46:12 2022] GET /compute/v2.1/servers/659208f3-1bef-41f7-9616-50c2db9f46ba => generated 1568 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:46:13.203336 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-c8f52f18-11ec-4cf0-9668-9c120c6cead3 req-0f34257a-db08-4088-ac88-44ad3fcba9e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "049f396b-7494-4b40-ad21-c3401958088b", "name": "network-vif-deleted", "tag": "b8904ed3-c3c4-4e36-91c9-b8a1f2fa53b0"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:46:13.233602 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-c8f52f18-11ec-4cf0-9668-9c120c6cead3 req-0f34257a-db08-4088-ac88-44ad3fcba9e1 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:13.234193 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-c8f52f18-11ec-4cf0-9668-9c120c6cead3 req-0f34257a-db08-4088-ac88-44ad3fcba9e1 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:13.234919 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-c8f52f18-11ec-4cf0-9668-9c120c6cead3 req-0f34257a-db08-4088-ac88-44ad3fcba9e1 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:13.280440 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-c8f52f18-11ec-4cf0-9668-9c120c6cead3 req-0f34257a-db08-4088-ac88-44ad3fcba9e1 service nova] Creating event network-vif-deleted:b8904ed3-c3c4-4e36-91c9-b8a1f2fa53b0 for instance 049f396b-7494-4b40-ad21-c3401958088b on n-h2-860284-1 Oct 04 21:46:13.301986 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-c8f52f18-11ec-4cf0-9668-9c120c6cead3 req-0f34257a-db08-4088-ac88-44ad3fcba9e1 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114747 Oct 04 21:46:13.302832 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 398/797] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:46:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:46:13.316281 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-e8e2f757-f846-498a-9163-48296e8d200e tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:13.324821 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-e8e2f757-f846-498a-9163-48296e8d200e tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] [instance: d2542961-c0a1-46da-9ae8-2f40faa0a294] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:13.353142 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e8e2f757-f846-498a-9163-48296e8d200e tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:13.354911 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e8e2f757-f846-498a-9163-48296e8d200e tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:13.356824 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e8e2f757-f846-498a-9163-48296e8d200e tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:13.357738 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e8e2f757-f846-498a-9163-48296e8d200e tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:13.367104 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e8e2f757-f846-498a-9163-48296e8d200e tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:13.367990 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e8e2f757-f846-498a-9163-48296e8d200e tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:14.117510 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-e8e2f757-f846-498a-9163-48296e8d200e tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87616cd16995468ab7febf5aa4b284db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e3bf9149434d34b6762aaeef1478ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:14.126279 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-e8e2f757-f846-498a-9163-48296e8d200e tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] 10.222.0.43 "GET /compute/v2.1/servers/d2542961-c0a1-46da-9ae8-2f40faa0a294" status: 200 len: 1265 microversion: 2.1 time: 0.814315 Oct 04 21:46:14.127147 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 399/798] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:13 2022] GET /compute/v2.1/servers/d2542961-c0a1-46da-9ae8-2f40faa0a294 => generated 1265 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:14.154831 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-50655ad1-badc-4843-a8ea-e20fa83743a9 req-2f3221d9-909a-433d-bc78-b5a386f7323f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2d1b827-a865-4d56-a665-110d0541a669", "name": "network-vif-unplugged", "status": "completed", "tag": "63fc7a3b-4543-41af-bdba-41c87b0c3709"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:46:14.192980 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-50655ad1-badc-4843-a8ea-e20fa83743a9 req-2f3221d9-909a-433d-bc78-b5a386f7323f service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:14.194908 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-50655ad1-badc-4843-a8ea-e20fa83743a9 req-2f3221d9-909a-433d-bc78-b5a386f7323f service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:14.195913 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-50655ad1-badc-4843-a8ea-e20fa83743a9 req-2f3221d9-909a-433d-bc78-b5a386f7323f service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:14.217893 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-50655ad1-badc-4843-a8ea-e20fa83743a9 req-2f3221d9-909a-433d-bc78-b5a386f7323f service nova] Creating event network-vif-unplugged:63fc7a3b-4543-41af-bdba-41c87b0c3709 for instance a2d1b827-a865-4d56-a665-110d0541a669 on n-h2-860284-1 Oct 04 21:46:14.227004 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [req-50655ad1-badc-4843-a8ea-e20fa83743a9 req-2f3221d9-909a-433d-bc78-b5a386f7323f service nova] Instance a2d1b827-a865-4d56-a665-110d0541a669 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860284-1', 'n-h2-860284-1'} {{(pid=134102) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 21:46:14.247112 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-50655ad1-badc-4843-a8ea-e20fa83743a9 req-2f3221d9-909a-433d-bc78-b5a386f7323f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.117717 Oct 04 21:46:14.253389 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 400/799] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:46:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:46:14.264444 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-1d9e1d98-3168-4c8c-92a2-d0eccc524e22 req-51d8015a-c19f-4277-a473-e3350b82f8b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7b7e541-aa71-44f6-96fb-07c2e6e08520", "name": "network-vif-deleted", "tag": "7e3bac17-bb02-4dee-99d3-79bc4e2aa285"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:46:14.278997 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-1d9e1d98-3168-4c8c-92a2-d0eccc524e22 req-51d8015a-c19f-4277-a473-e3350b82f8b5 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:14.279778 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-1d9e1d98-3168-4c8c-92a2-d0eccc524e22 req-51d8015a-c19f-4277-a473-e3350b82f8b5 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:14.280378 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-1d9e1d98-3168-4c8c-92a2-d0eccc524e22 req-51d8015a-c19f-4277-a473-e3350b82f8b5 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:14.303908 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-1d9e1d98-3168-4c8c-92a2-d0eccc524e22 req-51d8015a-c19f-4277-a473-e3350b82f8b5 service nova] Creating event network-vif-deleted:7e3bac17-bb02-4dee-99d3-79bc4e2aa285 for instance c7b7e541-aa71-44f6-96fb-07c2e6e08520 on n-h1-860284-1 Oct 04 21:46:14.312159 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-1d9e1d98-3168-4c8c-92a2-d0eccc524e22 req-51d8015a-c19f-4277-a473-e3350b82f8b5 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053432 Oct 04 21:46:14.314350 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 401/800] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:46:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:46:14.321887 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-994471b3-6fa2-4079-adbb-b8bbc870c959 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:14.322827 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-994471b3-6fa2-4079-adbb-b8bbc870c959 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 10062905-54d7-47e2-b621-522e0954b72b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:14.332450 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-994471b3-6fa2-4079-adbb-b8bbc870c959 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:14.333561 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-994471b3-6fa2-4079-adbb-b8bbc870c959 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:14.334200 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-994471b3-6fa2-4079-adbb-b8bbc870c959 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:14.335217 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-994471b3-6fa2-4079-adbb-b8bbc870c959 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:14.336024 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-994471b3-6fa2-4079-adbb-b8bbc870c959 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:14.336621 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-994471b3-6fa2-4079-adbb-b8bbc870c959 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:14.779579 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-b854b81d-117b-4891-913b-82b2b17511cb tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2dff38dea346219f6534426fd27ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6a5f1476ac48f3831f2ed202dacdf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:14.819552 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-b854b81d-117b-4891-913b-82b2b17511cb tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] 10.222.0.43 "GET /compute/v2.1/servers/1e9957cf-cfeb-483d-bc32-73ca72a54eb9" status: 200 len: 1370 microversion: 2.1 time: 2.446767 Oct 04 21:46:14.832416 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 400/801] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:12 2022] GET /compute/v2.1/servers/1e9957cf-cfeb-483d-bc32-73ca72a54eb9 => generated 1370 bytes in 2457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:14.858514 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-ea0fe448-1e55-404c-97e0-6bb2b0772d8d tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:14.903359 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-ea0fe448-1e55-404c-97e0-6bb2b0772d8d tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: a2d1b827-a865-4d56-a665-110d0541a669] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:14.934631 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ea0fe448-1e55-404c-97e0-6bb2b0772d8d tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:14.935318 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ea0fe448-1e55-404c-97e0-6bb2b0772d8d tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:14.936086 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ea0fe448-1e55-404c-97e0-6bb2b0772d8d tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:14.937600 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ea0fe448-1e55-404c-97e0-6bb2b0772d8d tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:14.938720 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ea0fe448-1e55-404c-97e0-6bb2b0772d8d tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:14.939388 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ea0fe448-1e55-404c-97e0-6bb2b0772d8d tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:15.122798 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-994471b3-6fa2-4079-adbb-b8bbc870c959 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ad048becf474fb972d4291422d810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dcfc7024fc49388c4bd5f25f03e60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:15.137332 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-994471b3-6fa2-4079-adbb-b8bbc870c959 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/10062905-54d7-47e2-b621-522e0954b72b" status: 200 len: 1503 microversion: 2.1 time: 0.816962 Oct 04 21:46:15.138214 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 402/802] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:14 2022] GET /compute/v2.1/servers/10062905-54d7-47e2-b621-522e0954b72b => generated 1503 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:15.157911 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-baf879a4-2a28-4ba9-b3d7-331f966f5c9f tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:15.164513 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-baf879a4-2a28-4ba9-b3d7-331f966f5c9f tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] [instance: b19ef33c-3012-4eed-abd6-edc1bd9f3e9c] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:15.177794 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-baf879a4-2a28-4ba9-b3d7-331f966f5c9f tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:15.180344 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-baf879a4-2a28-4ba9-b3d7-331f966f5c9f tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:15.180822 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-baf879a4-2a28-4ba9-b3d7-331f966f5c9f tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:15.181568 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-baf879a4-2a28-4ba9-b3d7-331f966f5c9f tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:15.182046 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-baf879a4-2a28-4ba9-b3d7-331f966f5c9f tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:15.184640 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-baf879a4-2a28-4ba9-b3d7-331f966f5c9f tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:15.546707 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-baf879a4-2a28-4ba9-b3d7-331f966f5c9f tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29842a669a20408b881105135f76cb0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39edf587afe94b60911198aa0bb61613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:15.559720 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-baf879a4-2a28-4ba9-b3d7-331f966f5c9f tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] 10.222.0.43 "GET /compute/v2.1/servers/b19ef33c-3012-4eed-abd6-edc1bd9f3e9c" status: 200 len: 1275 microversion: 2.1 time: 0.420156 Oct 04 21:46:15.560872 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 403/803] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:15 2022] GET /compute/v2.1/servers/b19ef33c-3012-4eed-abd6-edc1bd9f3e9c => generated 1275 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:15.579025 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-f56cb161-0f7c-4342-b86e-da54089928a6 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:15.579588 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-f56cb161-0f7c-4342-b86e-da54089928a6 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] [instance: 34276621-d087-478b-81c7-bdf5e38efc69] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:15.598525 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f56cb161-0f7c-4342-b86e-da54089928a6 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:15.599029 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f56cb161-0f7c-4342-b86e-da54089928a6 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:15.599474 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f56cb161-0f7c-4342-b86e-da54089928a6 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:15.605652 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f56cb161-0f7c-4342-b86e-da54089928a6 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:15.606244 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f56cb161-0f7c-4342-b86e-da54089928a6 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:15.606728 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f56cb161-0f7c-4342-b86e-da54089928a6 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:15.852529 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-ea0fe448-1e55-404c-97e0-6bb2b0772d8d tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:15.868110 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-ea0fe448-1e55-404c-97e0-6bb2b0772d8d tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/a2d1b827-a865-4d56-a665-110d0541a669" status: 200 len: 1474 microversion: 2.1 time: 1.033796 Oct 04 21:46:15.892872 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 401/804] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:14 2022] GET /compute/v2.1/servers/a2d1b827-a865-4d56-a665-110d0541a669 => generated 1474 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:15.902644 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-cdb3959a-7820-4420-9fcb-a3dfc55490f1 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:15.904102 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-cdb3959a-7820-4420-9fcb-a3dfc55490f1 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] [instance: 659208f3-1bef-41f7-9616-50c2db9f46ba] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:15.917434 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cdb3959a-7820-4420-9fcb-a3dfc55490f1 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:15.918515 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cdb3959a-7820-4420-9fcb-a3dfc55490f1 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:15.919234 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cdb3959a-7820-4420-9fcb-a3dfc55490f1 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:15.921960 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cdb3959a-7820-4420-9fcb-a3dfc55490f1 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:15.922937 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cdb3959a-7820-4420-9fcb-a3dfc55490f1 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:15.923583 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cdb3959a-7820-4420-9fcb-a3dfc55490f1 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:16.770146 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-f56cb161-0f7c-4342-b86e-da54089928a6 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1789bb97219a4e1591632126812ea6df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da67fc95e2814f4086df020f4c475764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:16.792853 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-f56cb161-0f7c-4342-b86e-da54089928a6 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] 10.222.0.43 "GET /compute/v2.1/servers/34276621-d087-478b-81c7-bdf5e38efc69" status: 200 len: 1389 microversion: 2.1 time: 1.230804 Oct 04 21:46:16.794830 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 404/805] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:15 2022] GET /compute/v2.1/servers/34276621-d087-478b-81c7-bdf5e38efc69 => generated 1389 bytes in 1232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:16.814180 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-62a73d47-b135-4c67-8df4-a643ed778d37 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:16.815205 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-62a73d47-b135-4c67-8df4-a643ed778d37 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] [instance: d2542961-c0a1-46da-9ae8-2f40faa0a294] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:16.824335 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-62a73d47-b135-4c67-8df4-a643ed778d37 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:16.825236 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-62a73d47-b135-4c67-8df4-a643ed778d37 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:16.825954 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-62a73d47-b135-4c67-8df4-a643ed778d37 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:16.826970 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-62a73d47-b135-4c67-8df4-a643ed778d37 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:16.827976 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-62a73d47-b135-4c67-8df4-a643ed778d37 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:16.828647 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-62a73d47-b135-4c67-8df4-a643ed778d37 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:16.847795 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-cdb3959a-7820-4420-9fcb-a3dfc55490f1 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:16.875842 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-cdb3959a-7820-4420-9fcb-a3dfc55490f1 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:16.884629 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-cdb3959a-7820-4420-9fcb-a3dfc55490f1 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:16.888173 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-cdb3959a-7820-4420-9fcb-a3dfc55490f1 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] 10.222.0.43 "GET /compute/v2.1/servers/659208f3-1bef-41f7-9616-50c2db9f46ba" status: 200 len: 1568 microversion: 2.25 time: 0.991845 Oct 04 21:46:16.889685 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 402/806] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:46:15 2022] GET /compute/v2.1/servers/659208f3-1bef-41f7-9616-50c2db9f46ba => generated 1568 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:46:16.916464 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-9c7423ba-b7bc-424b-bd89-3b8e6212bb3a tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:16.920425 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-9c7423ba-b7bc-424b-bd89-3b8e6212bb3a tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] [instance: 1e9957cf-cfeb-483d-bc32-73ca72a54eb9] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:16.939449 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9c7423ba-b7bc-424b-bd89-3b8e6212bb3a tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:16.940415 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9c7423ba-b7bc-424b-bd89-3b8e6212bb3a tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:16.942092 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9c7423ba-b7bc-424b-bd89-3b8e6212bb3a tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:16.944860 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9c7423ba-b7bc-424b-bd89-3b8e6212bb3a tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:16.948282 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9c7423ba-b7bc-424b-bd89-3b8e6212bb3a tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:16.949922 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9c7423ba-b7bc-424b-bd89-3b8e6212bb3a tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:17.352804 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=2 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:46:17.512501 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-62a73d47-b135-4c67-8df4-a643ed778d37 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87616cd16995468ab7febf5aa4b284db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e3bf9149434d34b6762aaeef1478ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:17.525032 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-62a73d47-b135-4c67-8df4-a643ed778d37 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] 10.222.0.43 "GET /compute/v2.1/servers/d2542961-c0a1-46da-9ae8-2f40faa0a294" status: 200 len: 1313 microversion: 2.1 time: 0.730167 Oct 04 21:46:17.527087 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 405/807] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:16 2022] GET /compute/v2.1/servers/d2542961-c0a1-46da-9ae8-2f40faa0a294 => generated 1313 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:17.543877 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-5879454a-c41b-411e-b929-aea27229f81d tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:17.545107 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-5879454a-c41b-411e-b929-aea27229f81d tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 10062905-54d7-47e2-b621-522e0954b72b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:17.557638 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5879454a-c41b-411e-b929-aea27229f81d tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:17.562927 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5879454a-c41b-411e-b929-aea27229f81d tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:17.563628 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5879454a-c41b-411e-b929-aea27229f81d tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:17.565832 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5879454a-c41b-411e-b929-aea27229f81d tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:17.566311 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5879454a-c41b-411e-b929-aea27229f81d tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:17.566777 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5879454a-c41b-411e-b929-aea27229f81d tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:17.618203 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=2 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:46:17.649970 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-9c7423ba-b7bc-424b-bd89-3b8e6212bb3a tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2dff38dea346219f6534426fd27ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6a5f1476ac48f3831f2ed202dacdf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:17.659732 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-9c7423ba-b7bc-424b-bd89-3b8e6212bb3a tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] 10.222.0.43 "GET /compute/v2.1/servers/1e9957cf-cfeb-483d-bc32-73ca72a54eb9" status: 200 len: 1555 microversion: 2.1 time: 0.767885 Oct 04 21:46:17.661822 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 403/808] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:16 2022] GET /compute/v2.1/servers/1e9957cf-cfeb-483d-bc32-73ca72a54eb9 => generated 1555 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:17.682704 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-92a6bf22-d980-4bab-ae22-f84f9447185e req-75ffd5b8-f477-4e68-9b8b-4fe7e2e1dfd3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2d1b827-a865-4d56-a665-110d0541a669", "tag": "63fc7a3b-4543-41af-bdba-41c87b0c3709"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:46:17.709233 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-92a6bf22-d980-4bab-ae22-f84f9447185e req-75ffd5b8-f477-4e68-9b8b-4fe7e2e1dfd3 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:17.711470 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-92a6bf22-d980-4bab-ae22-f84f9447185e req-75ffd5b8-f477-4e68-9b8b-4fe7e2e1dfd3 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:17.712272 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-92a6bf22-d980-4bab-ae22-f84f9447185e req-75ffd5b8-f477-4e68-9b8b-4fe7e2e1dfd3 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:17.768566 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-92a6bf22-d980-4bab-ae22-f84f9447185e req-75ffd5b8-f477-4e68-9b8b-4fe7e2e1dfd3 service nova] Creating event network-changed:63fc7a3b-4543-41af-bdba-41c87b0c3709 for instance a2d1b827-a865-4d56-a665-110d0541a669 on n-h2-860284-1 Oct 04 21:46:17.801025 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [req-92a6bf22-d980-4bab-ae22-f84f9447185e req-75ffd5b8-f477-4e68-9b8b-4fe7e2e1dfd3 service nova] Instance a2d1b827-a865-4d56-a665-110d0541a669 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860284-1', 'n-h2-860284-1'} {{(pid=134101) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 21:46:17.826961 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-92a6bf22-d980-4bab-ae22-f84f9447185e req-75ffd5b8-f477-4e68-9b8b-4fe7e2e1dfd3 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.161987 Oct 04 21:46:17.833544 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 404/809] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:46:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:46:17.851093 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-1d40e2d8-2944-4758-bce8-22b9f65f329b tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:17.853947 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-1d40e2d8-2944-4758-bce8-22b9f65f329b tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] [instance: b19ef33c-3012-4eed-abd6-edc1bd9f3e9c] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:17.868319 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1d40e2d8-2944-4758-bce8-22b9f65f329b tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:17.868896 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1d40e2d8-2944-4758-bce8-22b9f65f329b tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:17.869501 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1d40e2d8-2944-4758-bce8-22b9f65f329b tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:17.870252 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1d40e2d8-2944-4758-bce8-22b9f65f329b tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:17.871102 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1d40e2d8-2944-4758-bce8-22b9f65f329b tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:17.871763 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1d40e2d8-2944-4758-bce8-22b9f65f329b tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:18.228325 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-5879454a-c41b-411e-b929-aea27229f81d tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ad048becf474fb972d4291422d810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dcfc7024fc49388c4bd5f25f03e60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:18.258317 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-5879454a-c41b-411e-b929-aea27229f81d tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/10062905-54d7-47e2-b621-522e0954b72b" status: 200 len: 1503 microversion: 2.1 time: 0.727750 Oct 04 21:46:18.274555 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 406/810] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:17 2022] GET /compute/v2.1/servers/10062905-54d7-47e2-b621-522e0954b72b => generated 1503 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:18.290996 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-a3c8f58a-6c49-40e9-ac0f-7592f868b772 req-f44193c9-e287-46e8-8831-8f3eb0fb818c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10062905-54d7-47e2-b621-522e0954b72b", "name": "network-vif-unplugged", "status": "completed", "tag": "f5b5fac6-bb2d-4a99-a6db-4f032a197633"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:46:18.306912 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-a3c8f58a-6c49-40e9-ac0f-7592f868b772 req-f44193c9-e287-46e8-8831-8f3eb0fb818c service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:18.307684 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-a3c8f58a-6c49-40e9-ac0f-7592f868b772 req-f44193c9-e287-46e8-8831-8f3eb0fb818c service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:18.308825 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-a3c8f58a-6c49-40e9-ac0f-7592f868b772 req-f44193c9-e287-46e8-8831-8f3eb0fb818c service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:18.324256 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-a3c8f58a-6c49-40e9-ac0f-7592f868b772 req-f44193c9-e287-46e8-8831-8f3eb0fb818c service nova] Creating event network-vif-unplugged:f5b5fac6-bb2d-4a99-a6db-4f032a197633 for instance 10062905-54d7-47e2-b621-522e0954b72b on n-h1-860284-1 Oct 04 21:46:18.331924 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-a3c8f58a-6c49-40e9-ac0f-7592f868b772 req-f44193c9-e287-46e8-8831-8f3eb0fb818c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050791 Oct 04 21:46:18.333082 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 407/811] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:46:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:46:18.343156 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-d8badb56-afe0-49d1-9371-cbc6ce17182a tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:18.344793 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-d8badb56-afe0-49d1-9371-cbc6ce17182a tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: a2d1b827-a865-4d56-a665-110d0541a669] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:18.357306 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d8badb56-afe0-49d1-9371-cbc6ce17182a tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:18.357822 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d8badb56-afe0-49d1-9371-cbc6ce17182a tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:18.359185 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d8badb56-afe0-49d1-9371-cbc6ce17182a tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:18.360883 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d8badb56-afe0-49d1-9371-cbc6ce17182a tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:18.361654 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d8badb56-afe0-49d1-9371-cbc6ce17182a tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:18.362444 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d8badb56-afe0-49d1-9371-cbc6ce17182a tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:18.615856 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-1d40e2d8-2944-4758-bce8-22b9f65f329b tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29842a669a20408b881105135f76cb0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39edf587afe94b60911198aa0bb61613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:18.628905 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-1d40e2d8-2944-4758-bce8-22b9f65f329b tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] 10.222.0.43 "GET /compute/v2.1/servers/b19ef33c-3012-4eed-abd6-edc1bd9f3e9c" status: 200 len: 1317 microversion: 2.1 time: 0.789240 Oct 04 21:46:18.646578 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 405/812] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:17 2022] GET /compute/v2.1/servers/b19ef33c-3012-4eed-abd6-edc1bd9f3e9c => generated 1317 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:18.660497 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-2d84ba3a-0b5b-4ff6-b0f6-b46b545d8d79 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:18.661915 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-2d84ba3a-0b5b-4ff6-b0f6-b46b545d8d79 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] [instance: 1e9957cf-cfeb-483d-bc32-73ca72a54eb9] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:18.680644 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2d84ba3a-0b5b-4ff6-b0f6-b46b545d8d79 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:18.682667 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2d84ba3a-0b5b-4ff6-b0f6-b46b545d8d79 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:18.684156 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2d84ba3a-0b5b-4ff6-b0f6-b46b545d8d79 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:18.686945 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2d84ba3a-0b5b-4ff6-b0f6-b46b545d8d79 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:18.688724 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2d84ba3a-0b5b-4ff6-b0f6-b46b545d8d79 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:18.690275 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2d84ba3a-0b5b-4ff6-b0f6-b46b545d8d79 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:18.927360 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-2d84ba3a-0b5b-4ff6-b0f6-b46b545d8d79 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] 10.222.0.43 "GET /compute/v2.1/servers/1e9957cf-cfeb-483d-bc32-73ca72a54eb9/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.275593 Oct 04 21:46:18.929850 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 406/813] 10.222.0.43 () {58 vars in 1275 bytes} [Tue Oct 4 21:46:18 2022] GET /compute/v2.1/servers/1e9957cf-cfeb-483d-bc32-73ca72a54eb9/os-interface => generated 284 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:46:18.939883 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-1f68a3af-0ae2-4e1e-93dd-1dbf615627d2 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:18.940968 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-1f68a3af-0ae2-4e1e-93dd-1dbf615627d2 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] [instance: 34276621-d087-478b-81c7-bdf5e38efc69] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:18.941827 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-d8badb56-afe0-49d1-9371-cbc6ce17182a tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:18.951236 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-d8badb56-afe0-49d1-9371-cbc6ce17182a tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/a2d1b827-a865-4d56-a665-110d0541a669" status: 200 len: 1474 microversion: 2.1 time: 0.616599 Oct 04 21:46:18.951846 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 408/814] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:18 2022] GET /compute/v2.1/servers/a2d1b827-a865-4d56-a665-110d0541a669 => generated 1474 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:18.956350 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1f68a3af-0ae2-4e1e-93dd-1dbf615627d2 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:18.958872 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1f68a3af-0ae2-4e1e-93dd-1dbf615627d2 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:18.961279 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-e508a73d-2e36-437a-80bf-d8f1ee7a3163 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:18.961654 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1f68a3af-0ae2-4e1e-93dd-1dbf615627d2 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:18.963216 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1f68a3af-0ae2-4e1e-93dd-1dbf615627d2 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:18.970712 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-e508a73d-2e36-437a-80bf-d8f1ee7a3163 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] [instance: 659208f3-1bef-41f7-9616-50c2db9f46ba] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:18.981454 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1f68a3af-0ae2-4e1e-93dd-1dbf615627d2 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:18.983074 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1f68a3af-0ae2-4e1e-93dd-1dbf615627d2 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:18.985791 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e508a73d-2e36-437a-80bf-d8f1ee7a3163 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:18.986289 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e508a73d-2e36-437a-80bf-d8f1ee7a3163 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:18.989920 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e508a73d-2e36-437a-80bf-d8f1ee7a3163 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:18.991262 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e508a73d-2e36-437a-80bf-d8f1ee7a3163 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:18.991746 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e508a73d-2e36-437a-80bf-d8f1ee7a3163 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:18.992183 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e508a73d-2e36-437a-80bf-d8f1ee7a3163 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:19.449741 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-e508a73d-2e36-437a-80bf-d8f1ee7a3163 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:19.464663 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-e508a73d-2e36-437a-80bf-d8f1ee7a3163 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:19.467074 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-e508a73d-2e36-437a-80bf-d8f1ee7a3163 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:19.468534 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-e508a73d-2e36-437a-80bf-d8f1ee7a3163 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] 10.222.0.43 "GET /compute/v2.1/servers/659208f3-1bef-41f7-9616-50c2db9f46ba" status: 200 len: 1568 microversion: 2.25 time: 0.511754 Oct 04 21:46:19.469272 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 409/815] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:46:18 2022] GET /compute/v2.1/servers/659208f3-1bef-41f7-9616-50c2db9f46ba => generated 1568 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:46:19.524372 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-0306eeb4-f921-4502-91a6-7a253320db32 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:19.531007 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-0306eeb4-f921-4502-91a6-7a253320db32 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] [instance: d2542961-c0a1-46da-9ae8-2f40faa0a294] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:19.542867 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0306eeb4-f921-4502-91a6-7a253320db32 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:19.543653 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0306eeb4-f921-4502-91a6-7a253320db32 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:19.544365 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0306eeb4-f921-4502-91a6-7a253320db32 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:19.545720 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0306eeb4-f921-4502-91a6-7a253320db32 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:19.547079 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0306eeb4-f921-4502-91a6-7a253320db32 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:19.547079 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0306eeb4-f921-4502-91a6-7a253320db32 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:19.577712 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-1f68a3af-0ae2-4e1e-93dd-1dbf615627d2 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1789bb97219a4e1591632126812ea6df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da67fc95e2814f4086df020f4c475764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:19.592981 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-1f68a3af-0ae2-4e1e-93dd-1dbf615627d2 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] 10.222.0.43 "GET /compute/v2.1/servers/34276621-d087-478b-81c7-bdf5e38efc69" status: 200 len: 1389 microversion: 2.1 time: 0.661625 Oct 04 21:46:19.594063 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 407/816] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:18 2022] GET /compute/v2.1/servers/34276621-d087-478b-81c7-bdf5e38efc69 => generated 1389 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:19.603128 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-59d6c4e2-3afa-4b45-860f-f9b181408305 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:19.604011 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-59d6c4e2-3afa-4b45-860f-f9b181408305 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 10062905-54d7-47e2-b621-522e0954b72b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:19.610843 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-59d6c4e2-3afa-4b45-860f-f9b181408305 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:19.611703 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-59d6c4e2-3afa-4b45-860f-f9b181408305 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:19.612379 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-59d6c4e2-3afa-4b45-860f-f9b181408305 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:19.613406 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-59d6c4e2-3afa-4b45-860f-f9b181408305 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:19.613945 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-59d6c4e2-3afa-4b45-860f-f9b181408305 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:19.614646 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-59d6c4e2-3afa-4b45-860f-f9b181408305 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:20.260899 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-0306eeb4-f921-4502-91a6-7a253320db32 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87616cd16995468ab7febf5aa4b284db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e3bf9149434d34b6762aaeef1478ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:20.265420 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-59d6c4e2-3afa-4b45-860f-f9b181408305 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ad048becf474fb972d4291422d810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dcfc7024fc49388c4bd5f25f03e60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:20.272966 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-0306eeb4-f921-4502-91a6-7a253320db32 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] 10.222.0.43 "GET /compute/v2.1/servers/d2542961-c0a1-46da-9ae8-2f40faa0a294" status: 200 len: 1313 microversion: 2.1 time: 0.772602 Oct 04 21:46:20.277227 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-59d6c4e2-3afa-4b45-860f-f9b181408305 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/10062905-54d7-47e2-b621-522e0954b72b" status: 200 len: 1503 microversion: 2.1 time: 0.680264 Oct 04 21:46:20.287735 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 410/817] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:19 2022] GET /compute/v2.1/servers/d2542961-c0a1-46da-9ae8-2f40faa0a294 => generated 1313 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:20.293262 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 408/818] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:19 2022] GET /compute/v2.1/servers/10062905-54d7-47e2-b621-522e0954b72b => generated 1503 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:20.299002 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-8d5ebecf-fad4-41ef-a19c-d4a9cc462bc3 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:20.299863 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-8d5ebecf-fad4-41ef-a19c-d4a9cc462bc3 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] [instance: b19ef33c-3012-4eed-abd6-edc1bd9f3e9c] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:20.303102 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-dfdbd893-6497-4ae4-8e52-1b039f6853ed tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:20.303830 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-dfdbd893-6497-4ae4-8e52-1b039f6853ed tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: a2d1b827-a865-4d56-a665-110d0541a669] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:20.309241 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=100 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:46:20.310739 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dfdbd893-6497-4ae4-8e52-1b039f6853ed tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:20.311240 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dfdbd893-6497-4ae4-8e52-1b039f6853ed tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:20.311405 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8d5ebecf-fad4-41ef-a19c-d4a9cc462bc3 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:20.311668 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dfdbd893-6497-4ae4-8e52-1b039f6853ed tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:20.312268 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8d5ebecf-fad4-41ef-a19c-d4a9cc462bc3 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:20.312757 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dfdbd893-6497-4ae4-8e52-1b039f6853ed tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:20.313033 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8d5ebecf-fad4-41ef-a19c-d4a9cc462bc3 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:20.313214 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dfdbd893-6497-4ae4-8e52-1b039f6853ed tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:20.313802 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dfdbd893-6497-4ae4-8e52-1b039f6853ed tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:20.313939 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8d5ebecf-fad4-41ef-a19c-d4a9cc462bc3 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:20.314267 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8d5ebecf-fad4-41ef-a19c-d4a9cc462bc3 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:20.315314 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8d5ebecf-fad4-41ef-a19c-d4a9cc462bc3 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:20.593199 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell0:SELECT=6 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:46:20.630925 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-dfdbd893-6497-4ae4-8e52-1b039f6853ed tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:20.636129 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:46:20.653479 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-8d5ebecf-fad4-41ef-a19c-d4a9cc462bc3 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29842a669a20408b881105135f76cb0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39edf587afe94b60911198aa0bb61613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:20.657904 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-dfdbd893-6497-4ae4-8e52-1b039f6853ed tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/a2d1b827-a865-4d56-a665-110d0541a669" status: 200 len: 1472 microversion: 2.1 time: 0.355985 Oct 04 21:46:20.659100 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 409/819] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:20 2022] GET /compute/v2.1/servers/a2d1b827-a865-4d56-a665-110d0541a669 => generated 1472 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:20.678179 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-e7f40e94-6a98-4ff9-a03d-e8bb230fa2bd req-34e770a4-aaca-406c-906f-5745149c6716 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34276621-d087-478b-81c7-bdf5e38efc69", "tag": "80b76ccd-8248-4ae2-ae94-68b23a4a9c2c"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:46:20.683367 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell0:SELECT=18 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:46:20.694770 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-8d5ebecf-fad4-41ef-a19c-d4a9cc462bc3 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] 10.222.0.43 "GET /compute/v2.1/servers/b19ef33c-3012-4eed-abd6-edc1bd9f3e9c" status: 200 len: 1317 microversion: 2.1 time: 0.405154 Oct 04 21:46:20.696154 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 411/820] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:20 2022] GET /compute/v2.1/servers/b19ef33c-3012-4eed-abd6-edc1bd9f3e9c => generated 1317 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:20.701563 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-6a8f1728-9cfc-4114-9f0a-bb9d0cc913cc req-e94624a5-6e4a-4e0b-a5ca-2a3dea6852d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10062905-54d7-47e2-b621-522e0954b72b", "tag": "f5b5fac6-bb2d-4a99-a6db-4f032a197633"}, {"name": "network-changed", "server_uuid": "d2542961-c0a1-46da-9ae8-2f40faa0a294", "tag": "6e14d23d-e9fb-4b7d-84b3-d5394b74d104"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:46:20.715210 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-6a8f1728-9cfc-4114-9f0a-bb9d0cc913cc req-e94624a5-6e4a-4e0b-a5ca-2a3dea6852d6 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:20.715977 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-6a8f1728-9cfc-4114-9f0a-bb9d0cc913cc req-e94624a5-6e4a-4e0b-a5ca-2a3dea6852d6 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:20.716604 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-6a8f1728-9cfc-4114-9f0a-bb9d0cc913cc req-e94624a5-6e4a-4e0b-a5ca-2a3dea6852d6 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:20.721499 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=100 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:46:20.733619 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-6a8f1728-9cfc-4114-9f0a-bb9d0cc913cc req-e94624a5-6e4a-4e0b-a5ca-2a3dea6852d6 service nova] Creating event network-changed:f5b5fac6-bb2d-4a99-a6db-4f032a197633 for instance 10062905-54d7-47e2-b621-522e0954b72b on n-h1-860284-1 Oct 04 21:46:20.734484 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-6a8f1728-9cfc-4114-9f0a-bb9d0cc913cc req-e94624a5-6e4a-4e0b-a5ca-2a3dea6852d6 service nova] Creating event network-changed:6e14d23d-e9fb-4b7d-84b3-d5394b74d104 for instance d2542961-c0a1-46da-9ae8-2f40faa0a294 on n-h2-860284-1 Oct 04 21:46:20.736244 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-e7f40e94-6a98-4ff9-a03d-e8bb230fa2bd req-34e770a4-aaca-406c-906f-5745149c6716 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:20.737255 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-e7f40e94-6a98-4ff9-a03d-e8bb230fa2bd req-34e770a4-aaca-406c-906f-5745149c6716 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:20.738040 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-e7f40e94-6a98-4ff9-a03d-e8bb230fa2bd req-34e770a4-aaca-406c-906f-5745149c6716 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:20.745383 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-6a8f1728-9cfc-4114-9f0a-bb9d0cc913cc req-e94624a5-6e4a-4e0b-a5ca-2a3dea6852d6 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.047152 Oct 04 21:46:20.746285 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 412/821] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:46:20 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:46:20.751955 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-28f8bada-dad4-41e4-af6a-bbfe64253722 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:20.754759 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-28f8bada-dad4-41e4-af6a-bbfe64253722 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] [instance: 659208f3-1bef-41f7-9616-50c2db9f46ba] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:20.765300 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-28f8bada-dad4-41e4-af6a-bbfe64253722 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:20.766755 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-28f8bada-dad4-41e4-af6a-bbfe64253722 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:20.767448 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-28f8bada-dad4-41e4-af6a-bbfe64253722 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:20.768448 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-28f8bada-dad4-41e4-af6a-bbfe64253722 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:20.769162 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-28f8bada-dad4-41e4-af6a-bbfe64253722 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:20.770156 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-28f8bada-dad4-41e4-af6a-bbfe64253722 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:20.770820 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-e7f40e94-6a98-4ff9-a03d-e8bb230fa2bd req-34e770a4-aaca-406c-906f-5745149c6716 service nova] Creating event network-changed:80b76ccd-8248-4ae2-ae94-68b23a4a9c2c for instance 34276621-d087-478b-81c7-bdf5e38efc69 on n-h2-860284-1 Oct 04 21:46:20.782665 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-e7f40e94-6a98-4ff9-a03d-e8bb230fa2bd req-34e770a4-aaca-406c-906f-5745149c6716 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120746 Oct 04 21:46:20.785353 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 410/822] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:46:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:46:20.797100 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-ec7cdeaf-e47f-4bf9-896c-e609caa4b34a tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:20.802517 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-ec7cdeaf-e47f-4bf9-896c-e609caa4b34a tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] [instance: 34276621-d087-478b-81c7-bdf5e38efc69] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:20.819052 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ec7cdeaf-e47f-4bf9-896c-e609caa4b34a tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:20.819982 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ec7cdeaf-e47f-4bf9-896c-e609caa4b34a tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:20.820799 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ec7cdeaf-e47f-4bf9-896c-e609caa4b34a tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:20.822560 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ec7cdeaf-e47f-4bf9-896c-e609caa4b34a tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:20.824471 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ec7cdeaf-e47f-4bf9-896c-e609caa4b34a tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:20.829860 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ec7cdeaf-e47f-4bf9-896c-e609caa4b34a tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:21.140156 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-28f8bada-dad4-41e4-af6a-bbfe64253722 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:21.149710 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-28f8bada-dad4-41e4-af6a-bbfe64253722 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:21.151632 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-28f8bada-dad4-41e4-af6a-bbfe64253722 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:21.153119 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-28f8bada-dad4-41e4-af6a-bbfe64253722 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] 10.222.0.43 "GET /compute/v2.1/servers/659208f3-1bef-41f7-9616-50c2db9f46ba" status: 200 len: 1568 microversion: 2.25 time: 0.405519 Oct 04 21:46:21.170727 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 413/823] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:46:20 2022] GET /compute/v2.1/servers/659208f3-1bef-41f7-9616-50c2db9f46ba => generated 1568 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:46:21.170881 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-ec7cdeaf-e47f-4bf9-896c-e609caa4b34a tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1789bb97219a4e1591632126812ea6df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da67fc95e2814f4086df020f4c475764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:21.185526 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-ec7cdeaf-e47f-4bf9-896c-e609caa4b34a tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] 10.222.0.43 "GET /compute/v2.1/servers/34276621-d087-478b-81c7-bdf5e38efc69" status: 200 len: 1389 microversion: 2.1 time: 0.398294 Oct 04 21:46:21.186130 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 411/824] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:20 2022] GET /compute/v2.1/servers/34276621-d087-478b-81c7-bdf5e38efc69 => generated 1389 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:21.303831 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-703dd349-80c0-4ea3-a1b2-810d2107bb61 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:21.304446 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-703dd349-80c0-4ea3-a1b2-810d2107bb61 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] [instance: d2542961-c0a1-46da-9ae8-2f40faa0a294] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:21.307882 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e2f12ebe-e277-41b9-a53d-e60a7bc5b492 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:21.309226 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-e2f12ebe-e277-41b9-a53d-e60a7bc5b492 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 10062905-54d7-47e2-b621-522e0954b72b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:21.313706 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:46:21.315640 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-703dd349-80c0-4ea3-a1b2-810d2107bb61 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:21.316970 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-703dd349-80c0-4ea3-a1b2-810d2107bb61 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:21.317247 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e2f12ebe-e277-41b9-a53d-e60a7bc5b492 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:21.317471 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-703dd349-80c0-4ea3-a1b2-810d2107bb61 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:21.318171 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e2f12ebe-e277-41b9-a53d-e60a7bc5b492 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:21.318311 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-703dd349-80c0-4ea3-a1b2-810d2107bb61 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:21.318703 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-703dd349-80c0-4ea3-a1b2-810d2107bb61 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:21.319781 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e2f12ebe-e277-41b9-a53d-e60a7bc5b492 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:21.319898 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-703dd349-80c0-4ea3-a1b2-810d2107bb61 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:21.321194 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e2f12ebe-e277-41b9-a53d-e60a7bc5b492 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:21.321900 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e2f12ebe-e277-41b9-a53d-e60a7bc5b492 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:21.322689 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e2f12ebe-e277-41b9-a53d-e60a7bc5b492 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:21.738391 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-703dd349-80c0-4ea3-a1b2-810d2107bb61 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87616cd16995468ab7febf5aa4b284db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e3bf9149434d34b6762aaeef1478ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:21.742532 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-e2f12ebe-e277-41b9-a53d-e60a7bc5b492 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ad048becf474fb972d4291422d810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dcfc7024fc49388c4bd5f25f03e60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:21.754050 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-e2f12ebe-e277-41b9-a53d-e60a7bc5b492 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/10062905-54d7-47e2-b621-522e0954b72b" status: 200 len: 1503 microversion: 2.1 time: 0.451729 Oct 04 21:46:21.755271 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 412/825] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:21 2022] GET /compute/v2.1/servers/10062905-54d7-47e2-b621-522e0954b72b => generated 1503 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:46:21.761498 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-703dd349-80c0-4ea3-a1b2-810d2107bb61 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] 10.222.0.43 "GET /compute/v2.1/servers/d2542961-c0a1-46da-9ae8-2f40faa0a294" status: 200 len: 1313 microversion: 2.1 time: 0.464311 Oct 04 21:46:21.762909 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-10e689cd-117e-4315-aa0f-b3a4b55f35ea tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:21.763792 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-10e689cd-117e-4315-aa0f-b3a4b55f35ea tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: a2d1b827-a865-4d56-a665-110d0541a669] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:21.773888 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-10e689cd-117e-4315-aa0f-b3a4b55f35ea tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:21.775138 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-10e689cd-117e-4315-aa0f-b3a4b55f35ea tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:21.775869 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 414/826] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:21 2022] GET /compute/v2.1/servers/d2542961-c0a1-46da-9ae8-2f40faa0a294 => generated 1313 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:46:21.776341 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-10e689cd-117e-4315-aa0f-b3a4b55f35ea tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:21.777422 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-10e689cd-117e-4315-aa0f-b3a4b55f35ea tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:21.778237 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-10e689cd-117e-4315-aa0f-b3a4b55f35ea tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:21.779410 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-10e689cd-117e-4315-aa0f-b3a4b55f35ea tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:21.789325 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-187b766d-2a81-4dd4-8f8e-04c65dea1462 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:21.795531 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-187b766d-2a81-4dd4-8f8e-04c65dea1462 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] [instance: b19ef33c-3012-4eed-abd6-edc1bd9f3e9c] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:21.815868 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-187b766d-2a81-4dd4-8f8e-04c65dea1462 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:21.817322 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-187b766d-2a81-4dd4-8f8e-04c65dea1462 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:21.818587 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-187b766d-2a81-4dd4-8f8e-04c65dea1462 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:21.820167 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-187b766d-2a81-4dd4-8f8e-04c65dea1462 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:21.820791 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-187b766d-2a81-4dd4-8f8e-04c65dea1462 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:21.821955 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-187b766d-2a81-4dd4-8f8e-04c65dea1462 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:22.054744 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-187b766d-2a81-4dd4-8f8e-04c65dea1462 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29842a669a20408b881105135f76cb0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39edf587afe94b60911198aa0bb61613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:22.068178 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-187b766d-2a81-4dd4-8f8e-04c65dea1462 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] 10.222.0.43 "GET /compute/v2.1/servers/b19ef33c-3012-4eed-abd6-edc1bd9f3e9c" status: 200 len: 1317 microversion: 2.1 time: 0.290866 Oct 04 21:46:22.069198 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 415/827] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:21 2022] GET /compute/v2.1/servers/b19ef33c-3012-4eed-abd6-edc1bd9f3e9c => generated 1317 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:22.079071 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-10e689cd-117e-4315-aa0f-b3a4b55f35ea tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:22.089409 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-10e689cd-117e-4315-aa0f-b3a4b55f35ea tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/a2d1b827-a865-4d56-a665-110d0541a669" status: 200 len: 1472 microversion: 2.1 time: 0.332403 Oct 04 21:46:22.090009 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 413/828] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:21 2022] GET /compute/v2.1/servers/a2d1b827-a865-4d56-a665-110d0541a669 => generated 1472 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:22.177694 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-019ca6b9-c354-423d-98e5-10c3655c442b tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:22.179180 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-019ca6b9-c354-423d-98e5-10c3655c442b tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] [instance: 659208f3-1bef-41f7-9616-50c2db9f46ba] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:22.186264 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-019ca6b9-c354-423d-98e5-10c3655c442b tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:22.187169 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-019ca6b9-c354-423d-98e5-10c3655c442b tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:22.187841 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-019ca6b9-c354-423d-98e5-10c3655c442b tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:22.188804 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-019ca6b9-c354-423d-98e5-10c3655c442b tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:22.189502 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-019ca6b9-c354-423d-98e5-10c3655c442b tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:22.190158 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-019ca6b9-c354-423d-98e5-10c3655c442b tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:22.209325 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-37a005e9-9aa2-474a-8a2d-5fc22c3c9bd4 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:22.210620 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-37a005e9-9aa2-474a-8a2d-5fc22c3c9bd4 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] [instance: 34276621-d087-478b-81c7-bdf5e38efc69] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:22.224887 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-37a005e9-9aa2-474a-8a2d-5fc22c3c9bd4 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:22.225938 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-37a005e9-9aa2-474a-8a2d-5fc22c3c9bd4 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:22.226641 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-37a005e9-9aa2-474a-8a2d-5fc22c3c9bd4 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:22.227591 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-37a005e9-9aa2-474a-8a2d-5fc22c3c9bd4 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:22.228233 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-37a005e9-9aa2-474a-8a2d-5fc22c3c9bd4 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:22.228928 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-37a005e9-9aa2-474a-8a2d-5fc22c3c9bd4 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:22.430159 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-019ca6b9-c354-423d-98e5-10c3655c442b tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:22.446392 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-019ca6b9-c354-423d-98e5-10c3655c442b tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:22.448630 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-019ca6b9-c354-423d-98e5-10c3655c442b tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:22.450420 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-019ca6b9-c354-423d-98e5-10c3655c442b tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] 10.222.0.43 "GET /compute/v2.1/servers/659208f3-1bef-41f7-9616-50c2db9f46ba" status: 200 len: 1558 microversion: 2.25 time: 0.276834 Oct 04 21:46:22.452451 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 416/829] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:46:22 2022] GET /compute/v2.1/servers/659208f3-1bef-41f7-9616-50c2db9f46ba => generated 1558 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:46:22.477951 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-9cd11310-d30b-44f4-8ab8-74df43e91546 tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Calling method '.version_select at 0x7fbb2f754ca0>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:22.482580 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9cd11310-d30b-44f4-8ab8-74df43e91546 tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:22.484480 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9cd11310-d30b-44f4-8ab8-74df43e91546 tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:22.485839 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9cd11310-d30b-44f4-8ab8-74df43e91546 tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:22.490969 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-37a005e9-9aa2-474a-8a2d-5fc22c3c9bd4 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1789bb97219a4e1591632126812ea6df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da67fc95e2814f4086df020f4c475764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:22.502928 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-9cd11310-d30b-44f4-8ab8-74df43e91546 tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] 10.222.0.43 "GET /compute/v2.1/os-migrations" status: 200 len: 2194 microversion: 2.25 time: 0.029072 Oct 04 21:46:22.504477 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 417/830] 10.222.0.43 () {60 vars in 1184 bytes} [Tue Oct 4 21:46:22 2022] GET /compute/v2.1/os-migrations => generated 2194 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:46:22.508854 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-37a005e9-9aa2-474a-8a2d-5fc22c3c9bd4 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] 10.222.0.43 "GET /compute/v2.1/servers/34276621-d087-478b-81c7-bdf5e38efc69" status: 200 len: 1389 microversion: 2.1 time: 0.299381 Oct 04 21:46:22.509895 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 414/831] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:22 2022] GET /compute/v2.1/servers/34276621-d087-478b-81c7-bdf5e38efc69 => generated 1389 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:22.534502 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-b17b780f-7564-4d92-b095-7329388a7474 tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:22.539753 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-b17b780f-7564-4d92-b095-7329388a7474 tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] [instance: 659208f3-1bef-41f7-9616-50c2db9f46ba] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:22.564302 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b17b780f-7564-4d92-b095-7329388a7474 tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:22.565662 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b17b780f-7564-4d92-b095-7329388a7474 tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:22.567319 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b17b780f-7564-4d92-b095-7329388a7474 tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:22.569558 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b17b780f-7564-4d92-b095-7329388a7474 tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:22.570729 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b17b780f-7564-4d92-b095-7329388a7474 tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:22.571622 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b17b780f-7564-4d92-b095-7329388a7474 tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:22.779262 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-bc0a8acc-7120-4f18-a783-708f5acd8d46 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:22.780764 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-bc0a8acc-7120-4f18-a783-708f5acd8d46 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 10062905-54d7-47e2-b621-522e0954b72b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:22.792004 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bc0a8acc-7120-4f18-a783-708f5acd8d46 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:22.792893 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bc0a8acc-7120-4f18-a783-708f5acd8d46 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:22.793875 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bc0a8acc-7120-4f18-a783-708f5acd8d46 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:22.795812 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bc0a8acc-7120-4f18-a783-708f5acd8d46 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:22.797146 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bc0a8acc-7120-4f18-a783-708f5acd8d46 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:22.797887 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bc0a8acc-7120-4f18-a783-708f5acd8d46 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:22.884773 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.objects.instance [None req-b17b780f-7564-4d92-b095-7329388a7474 tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Lazy-loading 'services' on Instance uuid 659208f3-1bef-41f7-9616-50c2db9f46ba {{(pid=134102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:46:23.017744 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-b17b780f-7564-4d92-b095-7329388a7474 tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/659208f3-1bef-41f7-9616-50c2db9f46ba" status: 200 len: 2051 microversion: 2.25 time: 0.500046 Oct 04 21:46:23.018089 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 418/832] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:46:22 2022] GET /compute/v2.1/servers/659208f3-1bef-41f7-9616-50c2db9f46ba => generated 2051 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:46:23.037606 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-c8c06ef5-fa4d-4416-8c72-3faa364b08b7 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:23.037606 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-c8c06ef5-fa4d-4416-8c72-3faa364b08b7 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] [instance: d2542961-c0a1-46da-9ae8-2f40faa0a294] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:23.049420 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c8c06ef5-fa4d-4416-8c72-3faa364b08b7 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:23.049959 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c8c06ef5-fa4d-4416-8c72-3faa364b08b7 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:23.050641 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c8c06ef5-fa4d-4416-8c72-3faa364b08b7 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:23.051394 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c8c06ef5-fa4d-4416-8c72-3faa364b08b7 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:23.052113 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c8c06ef5-fa4d-4416-8c72-3faa364b08b7 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:23.055366 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c8c06ef5-fa4d-4416-8c72-3faa364b08b7 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:23.637544 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-bc0a8acc-7120-4f18-a783-708f5acd8d46 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ad048becf474fb972d4291422d810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dcfc7024fc49388c4bd5f25f03e60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:23.647208 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-bc0a8acc-7120-4f18-a783-708f5acd8d46 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/10062905-54d7-47e2-b621-522e0954b72b" status: 200 len: 1503 microversion: 2.1 time: 0.872227 Oct 04 21:46:23.654816 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 415/833] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:22 2022] GET /compute/v2.1/servers/10062905-54d7-47e2-b621-522e0954b72b => generated 1503 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:23.655175 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-c8c06ef5-fa4d-4416-8c72-3faa364b08b7 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87616cd16995468ab7febf5aa4b284db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e3bf9149434d34b6762aaeef1478ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:23.655374 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-b3e110b2-83a5-4285-9827-ba92d312d180 req-19ecb389-0c8e-4cf9-8505-838d2faba492 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b19ef33c-3012-4eed-abd6-edc1bd9f3e9c", "tag": "81a6665d-8e6b-4af7-a8e7-6bb2e16217db"}, {"name": "network-changed", "server_uuid": "1e9957cf-cfeb-483d-bc32-73ca72a54eb9", "tag": "76bebc24-16b6-4425-aef8-2807d95b42ac"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:46:23.661988 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-c8c06ef5-fa4d-4416-8c72-3faa364b08b7 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] 10.222.0.43 "GET /compute/v2.1/servers/d2542961-c0a1-46da-9ae8-2f40faa0a294" status: 200 len: 1313 microversion: 2.1 time: 0.638765 Oct 04 21:46:23.661988 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 419/834] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:23 2022] GET /compute/v2.1/servers/d2542961-c0a1-46da-9ae8-2f40faa0a294 => generated 1313 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:23.674412 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-171c019b-f50e-46b7-8a5e-0e15cc5b53a5 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:23.679613 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-171c019b-f50e-46b7-8a5e-0e15cc5b53a5 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] [instance: b19ef33c-3012-4eed-abd6-edc1bd9f3e9c] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:23.690476 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-171c019b-f50e-46b7-8a5e-0e15cc5b53a5 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:23.690933 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-171c019b-f50e-46b7-8a5e-0e15cc5b53a5 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:23.691440 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-171c019b-f50e-46b7-8a5e-0e15cc5b53a5 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:23.692106 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-171c019b-f50e-46b7-8a5e-0e15cc5b53a5 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:23.692570 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-171c019b-f50e-46b7-8a5e-0e15cc5b53a5 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:23.692999 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-171c019b-f50e-46b7-8a5e-0e15cc5b53a5 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:23.706574 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-b3e110b2-83a5-4285-9827-ba92d312d180 req-19ecb389-0c8e-4cf9-8505-838d2faba492 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:23.708196 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-b3e110b2-83a5-4285-9827-ba92d312d180 req-19ecb389-0c8e-4cf9-8505-838d2faba492 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:23.709340 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-b3e110b2-83a5-4285-9827-ba92d312d180 req-19ecb389-0c8e-4cf9-8505-838d2faba492 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:23.760186 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-b3e110b2-83a5-4285-9827-ba92d312d180 req-19ecb389-0c8e-4cf9-8505-838d2faba492 service nova] Creating event network-changed:81a6665d-8e6b-4af7-a8e7-6bb2e16217db for instance b19ef33c-3012-4eed-abd6-edc1bd9f3e9c on n-h1-860284-1 Oct 04 21:46:23.762566 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-b3e110b2-83a5-4285-9827-ba92d312d180 req-19ecb389-0c8e-4cf9-8505-838d2faba492 service nova] Creating event network-changed:76bebc24-16b6-4425-aef8-2807d95b42ac for instance 1e9957cf-cfeb-483d-bc32-73ca72a54eb9 on n-h1-860284-1 Oct 04 21:46:23.771401 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-b3e110b2-83a5-4285-9827-ba92d312d180 req-19ecb389-0c8e-4cf9-8505-838d2faba492 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.121812 Oct 04 21:46:23.774334 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 416/835] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:46:23 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:46:23.782335 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-9eb1b60f-214c-4538-8c25-3801fc1955f3 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:23.783900 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-9eb1b60f-214c-4538-8c25-3801fc1955f3 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: a2d1b827-a865-4d56-a665-110d0541a669] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:23.793154 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9eb1b60f-214c-4538-8c25-3801fc1955f3 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:23.794168 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9eb1b60f-214c-4538-8c25-3801fc1955f3 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:23.794854 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9eb1b60f-214c-4538-8c25-3801fc1955f3 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:23.795818 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9eb1b60f-214c-4538-8c25-3801fc1955f3 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:23.796676 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9eb1b60f-214c-4538-8c25-3801fc1955f3 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:23.797352 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9eb1b60f-214c-4538-8c25-3801fc1955f3 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:24.168369 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-171c019b-f50e-46b7-8a5e-0e15cc5b53a5 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29842a669a20408b881105135f76cb0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39edf587afe94b60911198aa0bb61613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:24.182537 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-171c019b-f50e-46b7-8a5e-0e15cc5b53a5 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] 10.222.0.43 "GET /compute/v2.1/servers/b19ef33c-3012-4eed-abd6-edc1bd9f3e9c" status: 200 len: 1317 microversion: 2.1 time: 0.512092 Oct 04 21:46:24.185009 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 420/836] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:23 2022] GET /compute/v2.1/servers/b19ef33c-3012-4eed-abd6-edc1bd9f3e9c => generated 1317 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:24.198819 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-ee99ddf9-dd5e-4ba3-b523-9ecbc45afdd5 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-2139761077", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452", "networks": [{"uuid": "42a7af1a-ab70-4431-afd7-8915bdbe4cf9"}]}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:46:24.252442 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-9eb1b60f-214c-4538-8c25-3801fc1955f3 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:24.262939 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-9eb1b60f-214c-4538-8c25-3801fc1955f3 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/a2d1b827-a865-4d56-a665-110d0541a669" status: 200 len: 1469 microversion: 2.1 time: 0.486918 Oct 04 21:46:24.283648 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 417/837] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:23 2022] GET /compute/v2.1/servers/a2d1b827-a865-4d56-a665-110d0541a669 => generated 1469 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:24.289599 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-7dde7c30-3e89-44a5-bbfe-ba1ce1ff81ff tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:24.290238 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-7dde7c30-3e89-44a5-bbfe-ba1ce1ff81ff tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] [instance: 34276621-d087-478b-81c7-bdf5e38efc69] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:24.298273 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7dde7c30-3e89-44a5-bbfe-ba1ce1ff81ff tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:24.298813 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7dde7c30-3e89-44a5-bbfe-ba1ce1ff81ff tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:24.299253 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7dde7c30-3e89-44a5-bbfe-ba1ce1ff81ff tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:24.299969 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7dde7c30-3e89-44a5-bbfe-ba1ce1ff81ff tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:24.300427 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7dde7c30-3e89-44a5-bbfe-ba1ce1ff81ff tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:24.300854 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7dde7c30-3e89-44a5-bbfe-ba1ce1ff81ff tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:24.301542 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.network.neutron [None req-ee99ddf9-dd5e-4ba3-b523-9ecbc45afdd5 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] validate_networks() for [('42a7af1a-ab70-4431-afd7-8915bdbe4cf9', None, None, None, None, None)] {{(pid=134102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:46:24.557604 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-7dde7c30-3e89-44a5-bbfe-ba1ce1ff81ff tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1789bb97219a4e1591632126812ea6df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da67fc95e2814f4086df020f4c475764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:24.574109 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-7dde7c30-3e89-44a5-bbfe-ba1ce1ff81ff tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] 10.222.0.43 "GET /compute/v2.1/servers/34276621-d087-478b-81c7-bdf5e38efc69" status: 200 len: 1389 microversion: 2.1 time: 0.289431 Oct 04 21:46:24.576965 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 418/838] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:24 2022] GET /compute/v2.1/servers/34276621-d087-478b-81c7-bdf5e38efc69 => generated 1389 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:24.584651 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-19302855-c966-467c-82c2-724dbe304c5f tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:46:24.590126 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-19302855-c966-467c-82c2-724dbe304c5f tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: a2d1b827-a865-4d56-a665-110d0541a669] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:24.598537 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-19302855-c966-467c-82c2-724dbe304c5f tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:24.599422 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-19302855-c966-467c-82c2-724dbe304c5f tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:24.600559 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-19302855-c966-467c-82c2-724dbe304c5f tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:24.601766 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-19302855-c966-467c-82c2-724dbe304c5f tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:24.602317 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-19302855-c966-467c-82c2-724dbe304c5f tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:24.602822 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-19302855-c966-467c-82c2-724dbe304c5f tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:24.716159 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-19302855-c966-467c-82c2-724dbe304c5f tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "POST /compute/v2.1/servers/a2d1b827-a865-4d56-a665-110d0541a669/action" status: 204 len: 0 microversion: 2.1 time: 0.137336 Oct 04 21:46:24.718329 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 419/839] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 21:46:24 2022] POST /compute/v2.1/servers/a2d1b827-a865-4d56-a665-110d0541a669/action => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:46:24.727257 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-9b2a390d-9a79-4e11-b0c3-04758bb1618b tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:24.728317 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-9b2a390d-9a79-4e11-b0c3-04758bb1618b tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 10062905-54d7-47e2-b621-522e0954b72b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:24.740099 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9b2a390d-9a79-4e11-b0c3-04758bb1618b tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:24.741468 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9b2a390d-9a79-4e11-b0c3-04758bb1618b tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:24.742731 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9b2a390d-9a79-4e11-b0c3-04758bb1618b tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:24.743672 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9b2a390d-9a79-4e11-b0c3-04758bb1618b tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:24.744937 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9b2a390d-9a79-4e11-b0c3-04758bb1618b tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:24.745731 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9b2a390d-9a79-4e11-b0c3-04758bb1618b tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:25.356279 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-ee99ddf9-dd5e-4ba3-b523-9ecbc45afdd5 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Flavor limits 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:46:25.358343 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-ee99ddf9-dd5e-4ba3-b523-9ecbc45afdd5 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Image limits 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:46:25.359146 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-ee99ddf9-dd5e-4ba3-b523-9ecbc45afdd5 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Flavor pref 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:46:25.359779 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-ee99ddf9-dd5e-4ba3-b523-9ecbc45afdd5 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Image pref 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:46:25.360488 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-ee99ddf9-dd5e-4ba3-b523-9ecbc45afdd5 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:46:25.382999 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-9b2a390d-9a79-4e11-b0c3-04758bb1618b tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ad048becf474fb972d4291422d810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dcfc7024fc49388c4bd5f25f03e60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:25.388843 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ee99ddf9-dd5e-4ba3-b523-9ecbc45afdd5 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:25.393380 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ee99ddf9-dd5e-4ba3-b523-9ecbc45afdd5 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:25.394208 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ee99ddf9-dd5e-4ba3-b523-9ecbc45afdd5 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:25.395910 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ee99ddf9-dd5e-4ba3-b523-9ecbc45afdd5 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:25.396644 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ee99ddf9-dd5e-4ba3-b523-9ecbc45afdd5 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:25.397867 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ee99ddf9-dd5e-4ba3-b523-9ecbc45afdd5 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:25.430875 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-9b2a390d-9a79-4e11-b0c3-04758bb1618b tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/10062905-54d7-47e2-b621-522e0954b72b" status: 200 len: 1503 microversion: 2.1 time: 0.698498 Oct 04 21:46:25.442390 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 420/840] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:24 2022] GET /compute/v2.1/servers/10062905-54d7-47e2-b621-522e0954b72b => generated 1503 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:25.442390 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-0b96fb2b-288d-4165-996c-26b7feae191c tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:25.442390 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-0b96fb2b-288d-4165-996c-26b7feae191c tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] [instance: d2542961-c0a1-46da-9ae8-2f40faa0a294] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:25.468399 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0b96fb2b-288d-4165-996c-26b7feae191c tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:25.468906 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0b96fb2b-288d-4165-996c-26b7feae191c tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:25.469346 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0b96fb2b-288d-4165-996c-26b7feae191c tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:25.470069 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0b96fb2b-288d-4165-996c-26b7feae191c tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:25.470654 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0b96fb2b-288d-4165-996c-26b7feae191c tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:25.471083 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0b96fb2b-288d-4165-996c-26b7feae191c tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:25.482900 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-ee99ddf9-dd5e-4ba3-b523-9ecbc45afdd5 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Getting quotas for project f17fee483fd14b07977669df199f3018. Resources: {'instances', 'ram', 'cores'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:46:25.489988 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-ee99ddf9-dd5e-4ba3-b523-9ecbc45afdd5 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Getting quotas for user f529f881a037459d9405bd14afd7a639 and project f17fee483fd14b07977669df199f3018. Resources: {'instances', 'ram', 'cores'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:46:25.526712 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-ee99ddf9-dd5e-4ba3-b523-9ecbc45afdd5 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Going to run 1 instances... {{(pid=134102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:46:25.533562 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-ee99ddf9-dd5e-4ba3-b523-9ecbc45afdd5 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] [instance: 7512d9d6-ab41-453e-bb9d-8e0861aa37f7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='58548514-5dac-426c-81f5-19e3fba33e23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:46:25.649272 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-ee99ddf9-dd5e-4ba3-b523-9ecbc45afdd5 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.462888 Oct 04 21:46:25.657643 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 421/841] 10.222.0.43 () {62 vars in 1188 bytes} [Tue Oct 4 21:46:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 1472 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 04 21:46:25.664720 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-e36891c1-0f0a-43ca-acbe-da3b3d93b830 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:25.665743 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-e36891c1-0f0a-43ca-acbe-da3b3d93b830 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: a2d1b827-a865-4d56-a665-110d0541a669] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:25.678771 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e36891c1-0f0a-43ca-acbe-da3b3d93b830 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:25.679580 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e36891c1-0f0a-43ca-acbe-da3b3d93b830 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:25.680302 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e36891c1-0f0a-43ca-acbe-da3b3d93b830 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:25.681330 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e36891c1-0f0a-43ca-acbe-da3b3d93b830 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:25.682043 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e36891c1-0f0a-43ca-acbe-da3b3d93b830 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:25.682909 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e36891c1-0f0a-43ca-acbe-da3b3d93b830 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:26.336847 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-0b96fb2b-288d-4165-996c-26b7feae191c tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87616cd16995468ab7febf5aa4b284db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e3bf9149434d34b6762aaeef1478ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:26.351538 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-0b96fb2b-288d-4165-996c-26b7feae191c tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] 10.222.0.43 "GET /compute/v2.1/servers/d2542961-c0a1-46da-9ae8-2f40faa0a294" status: 200 len: 1313 microversion: 2.1 time: 0.918329 Oct 04 21:46:26.353909 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 421/842] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:25 2022] GET /compute/v2.1/servers/d2542961-c0a1-46da-9ae8-2f40faa0a294 => generated 1313 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:26.359379 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-10289aac-17e3-4586-a521-3e550a9ab30f tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:26.360268 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-10289aac-17e3-4586-a521-3e550a9ab30f tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] [instance: b19ef33c-3012-4eed-abd6-edc1bd9f3e9c] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:26.367903 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-e36891c1-0f0a-43ca-acbe-da3b3d93b830 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:26.369216 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-10289aac-17e3-4586-a521-3e550a9ab30f tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:26.369888 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-10289aac-17e3-4586-a521-3e550a9ab30f tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:26.370533 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-10289aac-17e3-4586-a521-3e550a9ab30f tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:26.371414 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-10289aac-17e3-4586-a521-3e550a9ab30f tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:26.372083 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-10289aac-17e3-4586-a521-3e550a9ab30f tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:26.372989 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-10289aac-17e3-4586-a521-3e550a9ab30f tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:26.376241 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-e36891c1-0f0a-43ca-acbe-da3b3d93b830 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/a2d1b827-a865-4d56-a665-110d0541a669" status: 200 len: 1469 microversion: 2.1 time: 0.716730 Oct 04 21:46:26.376633 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 422/843] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:25 2022] GET /compute/v2.1/servers/a2d1b827-a865-4d56-a665-110d0541a669 => generated 1469 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:26.402137 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-80297d15-c4e3-4590-87e2-5ba66573ead8 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:26.402759 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-80297d15-c4e3-4590-87e2-5ba66573ead8 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] [instance: 34276621-d087-478b-81c7-bdf5e38efc69] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:26.421433 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-80297d15-c4e3-4590-87e2-5ba66573ead8 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:26.422178 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-80297d15-c4e3-4590-87e2-5ba66573ead8 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:26.422797 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-80297d15-c4e3-4590-87e2-5ba66573ead8 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:26.424010 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-80297d15-c4e3-4590-87e2-5ba66573ead8 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:26.424781 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-80297d15-c4e3-4590-87e2-5ba66573ead8 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:26.425375 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-80297d15-c4e3-4590-87e2-5ba66573ead8 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:26.934600 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-10289aac-17e3-4586-a521-3e550a9ab30f tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29842a669a20408b881105135f76cb0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39edf587afe94b60911198aa0bb61613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:26.943266 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-10289aac-17e3-4586-a521-3e550a9ab30f tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] 10.222.0.43 "GET /compute/v2.1/servers/b19ef33c-3012-4eed-abd6-edc1bd9f3e9c" status: 200 len: 1317 microversion: 2.1 time: 0.587703 Oct 04 21:46:26.944857 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 422/844] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:26 2022] GET /compute/v2.1/servers/b19ef33c-3012-4eed-abd6-edc1bd9f3e9c => generated 1317 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:26.950117 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-bcedf1ec-b0e8-4ce7-aa7c-d4f9393d8d77 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:26.953060 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-bcedf1ec-b0e8-4ce7-aa7c-d4f9393d8d77 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] [instance: 7512d9d6-ab41-453e-bb9d-8e0861aa37f7] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:26.964020 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bcedf1ec-b0e8-4ce7-aa7c-d4f9393d8d77 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:26.964544 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bcedf1ec-b0e8-4ce7-aa7c-d4f9393d8d77 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:26.965226 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bcedf1ec-b0e8-4ce7-aa7c-d4f9393d8d77 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:26.966815 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bcedf1ec-b0e8-4ce7-aa7c-d4f9393d8d77 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:26.967870 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bcedf1ec-b0e8-4ce7-aa7c-d4f9393d8d77 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:26.968359 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bcedf1ec-b0e8-4ce7-aa7c-d4f9393d8d77 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:27.171003 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-bcedf1ec-b0e8-4ce7-aa7c-d4f9393d8d77 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:27.171465 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-80297d15-c4e3-4590-87e2-5ba66573ead8 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1789bb97219a4e1591632126812ea6df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da67fc95e2814f4086df020f4c475764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:27.191084 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-bcedf1ec-b0e8-4ce7-aa7c-d4f9393d8d77 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:27.193285 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-bcedf1ec-b0e8-4ce7-aa7c-d4f9393d8d77 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:27.196160 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-80297d15-c4e3-4590-87e2-5ba66573ead8 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] 10.222.0.43 "GET /compute/v2.1/servers/34276621-d087-478b-81c7-bdf5e38efc69" status: 200 len: 1389 microversion: 2.1 time: 0.798836 Oct 04 21:46:27.203437 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-bcedf1ec-b0e8-4ce7-aa7c-d4f9393d8d77 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] 10.222.0.43 "GET /compute/v2.1/servers/7512d9d6-ab41-453e-bb9d-8e0861aa37f7" status: 200 len: 1258 microversion: 2.25 time: 0.256386 Oct 04 21:46:27.204341 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 423/845] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:26 2022] GET /compute/v2.1/servers/34276621-d087-478b-81c7-bdf5e38efc69 => generated 1389 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:27.220412 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 423/846] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:46:26 2022] GET /compute/v2.1/servers/7512d9d6-ab41-453e-bb9d-8e0861aa37f7 => generated 1258 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:46:27.231474 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-659656f2-07b4-43e1-bf86-d359d440a856 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:27.235817 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-659656f2-07b4-43e1-bf86-d359d440a856 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 10062905-54d7-47e2-b621-522e0954b72b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:27.236807 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-f793ac48-b9ea-4d34-8d67-ab2122950380 req-0b315816-1b27-4d37-b52c-4ee1fa3f74cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2d1b827-a865-4d56-a665-110d0541a669", "name": "network-vif-plugged", "status": "completed", "tag": "63fc7a3b-4543-41af-bdba-41c87b0c3709"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:46:27.246336 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-659656f2-07b4-43e1-bf86-d359d440a856 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:27.247326 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-659656f2-07b4-43e1-bf86-d359d440a856 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:27.248025 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-659656f2-07b4-43e1-bf86-d359d440a856 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:27.249060 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-659656f2-07b4-43e1-bf86-d359d440a856 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:27.250117 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-659656f2-07b4-43e1-bf86-d359d440a856 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:27.250821 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-659656f2-07b4-43e1-bf86-d359d440a856 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:27.279931 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-f793ac48-b9ea-4d34-8d67-ab2122950380 req-0b315816-1b27-4d37-b52c-4ee1fa3f74cd service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:27.281541 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-f793ac48-b9ea-4d34-8d67-ab2122950380 req-0b315816-1b27-4d37-b52c-4ee1fa3f74cd service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:27.283672 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-f793ac48-b9ea-4d34-8d67-ab2122950380 req-0b315816-1b27-4d37-b52c-4ee1fa3f74cd service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:27.337141 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-f793ac48-b9ea-4d34-8d67-ab2122950380 req-0b315816-1b27-4d37-b52c-4ee1fa3f74cd service nova] Creating event network-vif-plugged:63fc7a3b-4543-41af-bdba-41c87b0c3709 for instance a2d1b827-a865-4d56-a665-110d0541a669 on n-h2-860284-1 Oct 04 21:46:27.349786 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [req-f793ac48-b9ea-4d34-8d67-ab2122950380 req-0b315816-1b27-4d37-b52c-4ee1fa3f74cd service nova] Instance a2d1b827-a865-4d56-a665-110d0541a669 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860284-1', 'n-h2-860284-1'} {{(pid=134102) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 21:46:27.366020 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-f793ac48-b9ea-4d34-8d67-ab2122950380 req-0b315816-1b27-4d37-b52c-4ee1fa3f74cd service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142257 Oct 04 21:46:27.367433 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 424/847] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:46:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:46:27.386616 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-138906b0-282d-49ad-8014-5bae55576512 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:27.387585 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-138906b0-282d-49ad-8014-5bae55576512 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] [instance: d2542961-c0a1-46da-9ae8-2f40faa0a294] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:27.399964 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-138906b0-282d-49ad-8014-5bae55576512 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:27.412246 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-138906b0-282d-49ad-8014-5bae55576512 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:27.413498 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-138906b0-282d-49ad-8014-5bae55576512 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:27.415743 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-138906b0-282d-49ad-8014-5bae55576512 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:27.418342 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-138906b0-282d-49ad-8014-5bae55576512 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:27.422482 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-138906b0-282d-49ad-8014-5bae55576512 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:28.167447 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-659656f2-07b4-43e1-bf86-d359d440a856 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ad048becf474fb972d4291422d810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dcfc7024fc49388c4bd5f25f03e60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:28.179348 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-659656f2-07b4-43e1-bf86-d359d440a856 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/10062905-54d7-47e2-b621-522e0954b72b" status: 200 len: 1503 microversion: 2.1 time: 0.957274 Oct 04 21:46:28.180098 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 424/848] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:27 2022] GET /compute/v2.1/servers/10062905-54d7-47e2-b621-522e0954b72b => generated 1503 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:28.185616 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-c1b9a3c5-847a-4c27-8b46-bdd45fdef09d tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:28.186453 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-c1b9a3c5-847a-4c27-8b46-bdd45fdef09d tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: a2d1b827-a865-4d56-a665-110d0541a669] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:28.187433 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-138906b0-282d-49ad-8014-5bae55576512 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87616cd16995468ab7febf5aa4b284db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e3bf9149434d34b6762aaeef1478ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:28.196933 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c1b9a3c5-847a-4c27-8b46-bdd45fdef09d tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:28.197350 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-138906b0-282d-49ad-8014-5bae55576512 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] 10.222.0.43 "GET /compute/v2.1/servers/d2542961-c0a1-46da-9ae8-2f40faa0a294" status: 200 len: 1313 microversion: 2.1 time: 0.817220 Oct 04 21:46:28.197497 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c1b9a3c5-847a-4c27-8b46-bdd45fdef09d tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:28.197957 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 425/849] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:27 2022] GET /compute/v2.1/servers/d2542961-c0a1-46da-9ae8-2f40faa0a294 => generated 1313 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:28.198122 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c1b9a3c5-847a-4c27-8b46-bdd45fdef09d tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:28.198788 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c1b9a3c5-847a-4c27-8b46-bdd45fdef09d tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:28.199429 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c1b9a3c5-847a-4c27-8b46-bdd45fdef09d tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:28.200057 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c1b9a3c5-847a-4c27-8b46-bdd45fdef09d tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:28.228102 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-9684fe77-ad5a-4771-8ed1-c677678bbf18 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:28.229194 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-9684fe77-ad5a-4771-8ed1-c677678bbf18 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] [instance: b19ef33c-3012-4eed-abd6-edc1bd9f3e9c] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:28.239760 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9684fe77-ad5a-4771-8ed1-c677678bbf18 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:28.242652 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9684fe77-ad5a-4771-8ed1-c677678bbf18 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:28.243105 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9684fe77-ad5a-4771-8ed1-c677678bbf18 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:28.244193 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9684fe77-ad5a-4771-8ed1-c677678bbf18 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:28.245104 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9684fe77-ad5a-4771-8ed1-c677678bbf18 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:28.245104 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9684fe77-ad5a-4771-8ed1-c677678bbf18 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:28.603034 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-c1b9a3c5-847a-4c27-8b46-bdd45fdef09d tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:28.613146 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-9684fe77-ad5a-4771-8ed1-c677678bbf18 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29842a669a20408b881105135f76cb0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39edf587afe94b60911198aa0bb61613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:28.615173 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-c1b9a3c5-847a-4c27-8b46-bdd45fdef09d tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/a2d1b827-a865-4d56-a665-110d0541a669" status: 200 len: 1461 microversion: 2.1 time: 0.433737 Oct 04 21:46:28.616644 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 425/850] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:28 2022] GET /compute/v2.1/servers/a2d1b827-a865-4d56-a665-110d0541a669 => generated 1461 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:28.623237 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-762842c0-bf02-47c8-9780-f0d313aa24d4 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:28.624364 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-762842c0-bf02-47c8-9780-f0d313aa24d4 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] [instance: 34276621-d087-478b-81c7-bdf5e38efc69] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:28.630630 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-9684fe77-ad5a-4771-8ed1-c677678bbf18 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] 10.222.0.43 "GET /compute/v2.1/servers/b19ef33c-3012-4eed-abd6-edc1bd9f3e9c" status: 200 len: 1317 microversion: 2.1 time: 0.431148 Oct 04 21:46:28.630779 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-762842c0-bf02-47c8-9780-f0d313aa24d4 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:28.631216 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-762842c0-bf02-47c8-9780-f0d313aa24d4 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:28.632050 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-762842c0-bf02-47c8-9780-f0d313aa24d4 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:28.632963 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-762842c0-bf02-47c8-9780-f0d313aa24d4 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:28.633600 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-762842c0-bf02-47c8-9780-f0d313aa24d4 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:28.634178 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-762842c0-bf02-47c8-9780-f0d313aa24d4 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:28.643033 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 426/851] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:28 2022] GET /compute/v2.1/servers/b19ef33c-3012-4eed-abd6-edc1bd9f3e9c => generated 1317 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:28.652353 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-a763ba7e-a3a3-4bbb-8f23-1cd6093afbac tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:28.653635 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-a763ba7e-a3a3-4bbb-8f23-1cd6093afbac tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] [instance: 7512d9d6-ab41-453e-bb9d-8e0861aa37f7] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:28.658973 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:46:28.665061 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a763ba7e-a3a3-4bbb-8f23-1cd6093afbac tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:28.665693 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a763ba7e-a3a3-4bbb-8f23-1cd6093afbac tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:28.666352 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a763ba7e-a3a3-4bbb-8f23-1cd6093afbac tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:28.668998 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a763ba7e-a3a3-4bbb-8f23-1cd6093afbac tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:28.669703 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a763ba7e-a3a3-4bbb-8f23-1cd6093afbac tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:28.670354 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a763ba7e-a3a3-4bbb-8f23-1cd6093afbac tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:28.867436 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-a763ba7e-a3a3-4bbb-8f23-1cd6093afbac tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:28.881067 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-a763ba7e-a3a3-4bbb-8f23-1cd6093afbac tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:28.884456 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-a763ba7e-a3a3-4bbb-8f23-1cd6093afbac tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:28.885619 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-a763ba7e-a3a3-4bbb-8f23-1cd6093afbac tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] 10.222.0.43 "GET /compute/v2.1/servers/7512d9d6-ab41-453e-bb9d-8e0861aa37f7" status: 200 len: 1258 microversion: 2.25 time: 0.241512 Oct 04 21:46:28.886200 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 427/852] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:46:28 2022] GET /compute/v2.1/servers/7512d9d6-ab41-453e-bb9d-8e0861aa37f7 => generated 1258 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:46:28.890886 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-b76fafda-8b87-4ee8-9aa6-5a30e4a193ac tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:28.891499 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-b76fafda-8b87-4ee8-9aa6-5a30e4a193ac tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: a2d1b827-a865-4d56-a665-110d0541a669] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:28.897919 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b76fafda-8b87-4ee8-9aa6-5a30e4a193ac tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:28.898682 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b76fafda-8b87-4ee8-9aa6-5a30e4a193ac tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:28.899310 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b76fafda-8b87-4ee8-9aa6-5a30e4a193ac tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:28.900198 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b76fafda-8b87-4ee8-9aa6-5a30e4a193ac tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:28.900814 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b76fafda-8b87-4ee8-9aa6-5a30e4a193ac tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:28.901677 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b76fafda-8b87-4ee8-9aa6-5a30e4a193ac tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:29.110447 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-762842c0-bf02-47c8-9780-f0d313aa24d4 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1789bb97219a4e1591632126812ea6df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da67fc95e2814f4086df020f4c475764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:29.121150 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-762842c0-bf02-47c8-9780-f0d313aa24d4 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] 10.222.0.43 "GET /compute/v2.1/servers/34276621-d087-478b-81c7-bdf5e38efc69" status: 200 len: 1389 microversion: 2.1 time: 0.503096 Oct 04 21:46:29.121855 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 426/853] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:28 2022] GET /compute/v2.1/servers/34276621-d087-478b-81c7-bdf5e38efc69 => generated 1389 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:29.205262 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-2d1bfacc-bd95-4f2f-b037-3018268115ae tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:29.206088 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-2d1bfacc-bd95-4f2f-b037-3018268115ae tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 10062905-54d7-47e2-b621-522e0954b72b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:29.215154 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2d1bfacc-bd95-4f2f-b037-3018268115ae tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:29.216222 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2d1bfacc-bd95-4f2f-b037-3018268115ae tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:29.217468 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2d1bfacc-bd95-4f2f-b037-3018268115ae tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:29.218512 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2d1bfacc-bd95-4f2f-b037-3018268115ae tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:29.219138 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2d1bfacc-bd95-4f2f-b037-3018268115ae tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:29.219779 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2d1bfacc-bd95-4f2f-b037-3018268115ae tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:29.261685 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-b76fafda-8b87-4ee8-9aa6-5a30e4a193ac tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:29.273702 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-b76fafda-8b87-4ee8-9aa6-5a30e4a193ac tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/a2d1b827-a865-4d56-a665-110d0541a669" status: 200 len: 1461 microversion: 2.1 time: 0.385885 Oct 04 21:46:29.274962 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 428/854] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:28 2022] GET /compute/v2.1/servers/a2d1b827-a865-4d56-a665-110d0541a669 => generated 1461 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:29.279899 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-7cc92fd2-8c12-4620-b459-d7a756312728 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:29.280793 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-7cc92fd2-8c12-4620-b459-d7a756312728 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] [instance: d2542961-c0a1-46da-9ae8-2f40faa0a294] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:29.290488 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7cc92fd2-8c12-4620-b459-d7a756312728 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:29.291371 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7cc92fd2-8c12-4620-b459-d7a756312728 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:29.292278 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7cc92fd2-8c12-4620-b459-d7a756312728 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:29.293235 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7cc92fd2-8c12-4620-b459-d7a756312728 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:29.294144 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7cc92fd2-8c12-4620-b459-d7a756312728 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:29.294901 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7cc92fd2-8c12-4620-b459-d7a756312728 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:29.608721 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-2d1bfacc-bd95-4f2f-b037-3018268115ae tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ad048becf474fb972d4291422d810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dcfc7024fc49388c4bd5f25f03e60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:29.617412 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-2d1bfacc-bd95-4f2f-b037-3018268115ae tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/10062905-54d7-47e2-b621-522e0954b72b" status: 200 len: 1503 microversion: 2.1 time: 0.416389 Oct 04 21:46:29.630801 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 427/855] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:29 2022] GET /compute/v2.1/servers/10062905-54d7-47e2-b621-522e0954b72b => generated 1503 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:29.638855 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-daa36cb7-dc75-40a1-a726-24ebf5b10098 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Action: 'create', calling method: .version_select at 0x7fbb2f49a0d0>, body: {"keypair": {"name": "tempest-keypair-1013933539", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPmJndjM+ZedDCxJ2PojSU0hFJujgqhaj5LV7LA69ZKAnrp3muKKmIP0hHkwha4z89gQ+6Ka2XIlxLx5Q5JrFmynni2W6EYWRvivu5aXjlHOQIvH+LtSVqM9q8DRTVdVtQ=="}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:46:29.640316 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-7cc92fd2-8c12-4620-b459-d7a756312728 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87616cd16995468ab7febf5aa4b284db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e3bf9149434d34b6762aaeef1478ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:29.653684 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-7cc92fd2-8c12-4620-b459-d7a756312728 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] 10.222.0.43 "GET /compute/v2.1/servers/d2542961-c0a1-46da-9ae8-2f40faa0a294" status: 200 len: 1313 microversion: 2.1 time: 0.376955 Oct 04 21:46:29.657219 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 429/856] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:29 2022] GET /compute/v2.1/servers/d2542961-c0a1-46da-9ae8-2f40faa0a294 => generated 1313 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:29.660923 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-daa36cb7-dc75-40a1-a726-24ebf5b10098 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Getting quotas for project 1ad1554e318e45f78a2bc5e148d0c39f. Resources: {'key_pairs'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:46:29.662236 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-7352f4b9-8bde-42d0-876b-227db4fb5234 req-6c716190-b50a-4323-8875-9bb88c40646f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b19ef33c-3012-4eed-abd6-edc1bd9f3e9c", "name": "network-vif-plugged", "status": "completed", "tag": "81a6665d-8e6b-4af7-a8e7-6bb2e16217db"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:46:29.668580 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-daa36cb7-dc75-40a1-a726-24ebf5b10098 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Getting quotas for user ff4e089659884b6d9197141ba9f14f57 and project 1ad1554e318e45f78a2bc5e148d0c39f. Resources: {'key_pairs'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:46:29.677212 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-7352f4b9-8bde-42d0-876b-227db4fb5234 req-6c716190-b50a-4323-8875-9bb88c40646f service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:29.677712 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-7352f4b9-8bde-42d0-876b-227db4fb5234 req-6c716190-b50a-4323-8875-9bb88c40646f service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:29.678202 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-7352f4b9-8bde-42d0-876b-227db4fb5234 req-6c716190-b50a-4323-8875-9bb88c40646f service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:29.685840 n-d-860284-1 devstack@n-api.service[134101]: ERROR oslo.messaging._drivers.impl_rabbit [None req-daa36cb7-dc75-40a1-a726-24ebf5b10098 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [54f0993b-fb22-4e4c-ae00-e3f0e5da4c18] AMQP server on 10.222.0.43:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 21:46:29.695725 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-7352f4b9-8bde-42d0-876b-227db4fb5234 req-6c716190-b50a-4323-8875-9bb88c40646f service nova] Creating event network-vif-plugged:81a6665d-8e6b-4af7-a8e7-6bb2e16217db for instance b19ef33c-3012-4eed-abd6-edc1bd9f3e9c on n-h1-860284-1 Oct 04 21:46:29.700985 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-7352f4b9-8bde-42d0-876b-227db4fb5234 req-6c716190-b50a-4323-8875-9bb88c40646f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042453 Oct 04 21:46:29.701602 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 430/857] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:46:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:46:29.710415 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-525ac90d-813e-4283-929c-30b2368b2d3b tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:29.715153 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-525ac90d-813e-4283-929c-30b2368b2d3b tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] [instance: b19ef33c-3012-4eed-abd6-edc1bd9f3e9c] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:29.722276 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-525ac90d-813e-4283-929c-30b2368b2d3b tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:29.722808 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-525ac90d-813e-4283-929c-30b2368b2d3b tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:29.723823 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-525ac90d-813e-4283-929c-30b2368b2d3b tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:29.724386 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-525ac90d-813e-4283-929c-30b2368b2d3b tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:29.725910 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-525ac90d-813e-4283-929c-30b2368b2d3b tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:29.726437 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-525ac90d-813e-4283-929c-30b2368b2d3b tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:29.749834 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=100 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:46:29.982987 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-525ac90d-813e-4283-929c-30b2368b2d3b tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29842a669a20408b881105135f76cb0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39edf587afe94b60911198aa0bb61613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:29.992058 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-525ac90d-813e-4283-929c-30b2368b2d3b tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] 10.222.0.43 "GET /compute/v2.1/servers/b19ef33c-3012-4eed-abd6-edc1bd9f3e9c" status: 200 len: 1317 microversion: 2.1 time: 0.288919 Oct 04 21:46:29.993023 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 431/858] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:29 2022] GET /compute/v2.1/servers/b19ef33c-3012-4eed-abd6-edc1bd9f3e9c => generated 1317 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:29.998005 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-800ce460-dcf8-4936-89f2-b4f8628a8712 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:29.998718 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-800ce460-dcf8-4936-89f2-b4f8628a8712 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] [instance: 7512d9d6-ab41-453e-bb9d-8e0861aa37f7] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:30.004997 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-800ce460-dcf8-4936-89f2-b4f8628a8712 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:30.005568 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-800ce460-dcf8-4936-89f2-b4f8628a8712 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:30.006613 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-800ce460-dcf8-4936-89f2-b4f8628a8712 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:30.007451 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-800ce460-dcf8-4936-89f2-b4f8628a8712 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:30.007983 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-800ce460-dcf8-4936-89f2-b4f8628a8712 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:30.008506 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-800ce460-dcf8-4936-89f2-b4f8628a8712 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:30.105468 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-800ce460-dcf8-4936-89f2-b4f8628a8712 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:30.116542 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-800ce460-dcf8-4936-89f2-b4f8628a8712 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:30.120599 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-800ce460-dcf8-4936-89f2-b4f8628a8712 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:30.122827 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-800ce460-dcf8-4936-89f2-b4f8628a8712 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] 10.222.0.43 "GET /compute/v2.1/servers/7512d9d6-ab41-453e-bb9d-8e0861aa37f7" status: 200 len: 1258 microversion: 2.25 time: 0.128297 Oct 04 21:46:30.123625 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 432/859] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:46:29 2022] GET /compute/v2.1/servers/7512d9d6-ab41-453e-bb9d-8e0861aa37f7 => generated 1258 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:46:30.147888 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-0039d5f1-e67b-4c20-b2bc-e556638949c0 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:30.148697 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-0039d5f1-e67b-4c20-b2bc-e556638949c0 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] [instance: 34276621-d087-478b-81c7-bdf5e38efc69] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:30.156344 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0039d5f1-e67b-4c20-b2bc-e556638949c0 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:30.157057 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0039d5f1-e67b-4c20-b2bc-e556638949c0 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:30.157561 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0039d5f1-e67b-4c20-b2bc-e556638949c0 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:30.158352 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0039d5f1-e67b-4c20-b2bc-e556638949c0 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:30.158902 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0039d5f1-e67b-4c20-b2bc-e556638949c0 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:30.159425 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0039d5f1-e67b-4c20-b2bc-e556638949c0 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:30.351805 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-0039d5f1-e67b-4c20-b2bc-e556638949c0 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1789bb97219a4e1591632126812ea6df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da67fc95e2814f4086df020f4c475764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:30.361235 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-0039d5f1-e67b-4c20-b2bc-e556638949c0 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] 10.222.0.43 "GET /compute/v2.1/servers/34276621-d087-478b-81c7-bdf5e38efc69" status: 200 len: 1389 microversion: 2.1 time: 0.217663 Oct 04 21:46:30.362397 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 433/860] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:30 2022] GET /compute/v2.1/servers/34276621-d087-478b-81c7-bdf5e38efc69 => generated 1389 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:46:30.571765 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-341f7314-bda5-44d9-9b06-62a7015923be tempest-FloatingIPDetailsNegativeTestJSON-1068625378 tempest-FloatingIPDetailsNegativeTestJSON-1068625378-project] Calling method '.version_select at 0x7fbb2f861280>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:30.651681 n-d-860284-1 devstack@n-api.service[134102]: DEBUG neutronclient.v2_0.client [None req-341f7314-bda5-44d9-9b06-62a7015923be tempest-FloatingIPDetailsNegativeTestJSON-1068625378 tempest-FloatingIPDetailsNegativeTestJSON-1068625378-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 80b19953-c261-49bf-9ddc-93290a9688b5 could not be found", "detail": ""}} {{(pid=134102) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 21:46:30.653459 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-341f7314-bda5-44d9-9b06-62a7015923be tempest-FloatingIPDetailsNegativeTestJSON-1068625378 tempest-FloatingIPDetailsNegativeTestJSON-1068625378-project] HTTP exception thrown: Floating IP not found for ID 80b19953-c261-49bf-9ddc-93290a9688b5 Oct 04 21:46:30.696181 n-d-860284-1 devstack@n-api.service[134101]: INFO oslo.messaging._drivers.impl_rabbit [None req-daa36cb7-dc75-40a1-a726-24ebf5b10098 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [54f0993b-fb22-4e4c-ae00-e3f0e5da4c18] Reconnected to AMQP server on 10.222.0.43:5672 via [amqp] client with port 59132. Oct 04 21:46:30.713717 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-341f7314-bda5-44d9-9b06-62a7015923be tempest-FloatingIPDetailsNegativeTestJSON-1068625378 tempest-FloatingIPDetailsNegativeTestJSON-1068625378-project] Request method failure captured: Oct 04 21:46:30.713717 n-d-860284-1 devstack@n-api.service[134102]: request: GET /compute/v2.1/os-floating-ips/80b19953-c261-49bf-9ddc-93290a9688b5 HTTP/1.1 Oct 04 21:46:30.713717 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 21:46:30.713717 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 21:46:30.713717 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 21:46:30.713717 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 21:46:30.713717 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 21:46:30.713717 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 21:46:30.713717 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 21:46:30.713717 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 21:46:30.713717 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPKm2a7luE0XYGkwg3oa2rnHd2zh_PHBIvWERqWrr4uaNqmCNZTKV0C7gaY-Dg-bmjqeTQeTqlN3PrVVF3jN7lOH-ezJCD3qTsUi7yj9Ias6q3VS3gdidI6zVeFiBoo86QHoi1H33etQp3JyMYe47fkZlv3KOz4dfCWfR7l7K0bGdD78 Oct 04 21:46:30.713717 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 21:46:30.713717 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 21:46:30.713717 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 21:46:30.713717 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 21:46:30.713717 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 21:46:30.713717 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 21:46:30.713717 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: e18d8258f84d402cb29c63453a336b5e Oct 04 21:46:30.713717 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-1068625378 Oct 04 21:46:30.713717 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 21:46:30.713717 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 21:46:30.716334 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/e18d8258f84d402cb29c63453a336b5e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_e18d8258f84d402cb29c63453a336b5e", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/e18d8258f84d402cb29c63453a336b5e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/e18d8258f84d402cb29c63453a336b5e"}]}] Oct 04 21:46:30.716334 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-1068625378 Oct 04 21:46:30.716334 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: e18d8258f84d402cb29c63453a336b5e Oct 04 21:46:30.716334 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-1068625378 Oct 04 21:46:30.716334 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-1068625378-project Oct 04 21:46:30.716334 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 21:46:30.716334 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 21:46:30.716334 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: 6fdd7fb6032c4f139573d5001501cbf8 Oct 04 21:46:30.716334 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-1068625378-project Oct 04 21:46:30.716334 n-d-860284-1 devstack@n-api.service[134102]: method: Oct 04 21:46:30.716334 n-d-860284-1 devstack@n-api.service[134102]: exception: Floating IP not found for ID 80b19953-c261-49bf-9ddc-93290a9688b5 Oct 04 21:46:30.716334 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': '80b19953-c261-49bf-9ddc-93290a9688b5'} Oct 04 21:46:30.717113 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:46:30.717113 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:46:30.717113 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 04 21:46:30.717113 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 04 21:46:30.717113 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:46:30.717113 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:46:30.717113 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 04 21:46:30.717113 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 04 21:46:30.717113 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:46:30.717113 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:46:30.717113 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 21:46:30.717113 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 21:46:30.717113 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:46:30.717113 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:46:30.717113 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 21:46:30.717113 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 21:46:30.717113 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:46:30.717113 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:46:30.717113 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 21:46:30.719630 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 21:46:30.719630 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:46:30.719630 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:46:30.719630 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 21:46:30.719630 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 21:46:30.719630 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 21:46:30.719630 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 21:46:30.719630 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 80b19953-c261-49bf-9ddc-93290a9688b5 could not be found Oct 04 21:46:30.719630 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-eb82fa83-fab4-4fe3-9994-f7a49740e0af'] Oct 04 21:46:30.719630 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:46:30.719630 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:46:30.719630 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:46:30.719630 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:46:30.719630 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Oct 04 21:46:30.719630 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 04 21:46:30.719630 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 04 21:46:30.719630 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 04 21:46:30.719630 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 80b19953-c261-49bf-9ddc-93290a9688b5. Oct 04 21:46:30.719630 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:46:30.722599 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:46:30.722599 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:46:30.722599 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:46:30.722599 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:46:30.722599 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:46:30.722599 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:46:30.722599 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:46:30.722599 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:46:30.722599 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:46:30.722599 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:46:30.722599 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:46:30.722599 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Oct 04 21:46:30.722599 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 04 21:46:30.722599 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 80b19953-c261-49bf-9ddc-93290a9688b5 Oct 04 21:46:30.722599 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:46:30.722599 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:46:30.722599 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:46:30.722599 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:46:30.722599 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:46:30.722599 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:46:30.722599 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:46:30.725654 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:46:30.725654 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 80b19953-c261-49bf-9ddc-93290a9688b5 Oct 04 21:46:30.725654 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:46:30.725654 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-341f7314-bda5-44d9-9b06-62a7015923be tempest-FloatingIPDetailsNegativeTestJSON-1068625378 tempest-FloatingIPDetailsNegativeTestJSON-1068625378-project] Returning 404 to user: Floating IP not found for ID 80b19953-c261-49bf-9ddc-93290a9688b5 {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:46:30.725654 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-341f7314-bda5-44d9-9b06-62a7015923be tempest-FloatingIPDetailsNegativeTestJSON-1068625378 tempest-FloatingIPDetailsNegativeTestJSON-1068625378-project] 10.222.0.43 "GET /compute/v2.1/os-floating-ips/80b19953-c261-49bf-9ddc-93290a9688b5" status: 404 len: 111 microversion: 2.1 time: 0.276470 Oct 04 21:46:30.725654 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 434/861] 10.222.0.43 () {58 vars in 1260 bytes} [Tue Oct 4 21:46:30 2022] GET /compute/v2.1/os-floating-ips/80b19953-c261-49bf-9ddc-93290a9688b5 => generated 111 bytes in 280 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 21:46:30.730960 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-1fa4ffec-07da-4974-b303-368cd0fcf717 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:30.731218 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-1fa4ffec-07da-4974-b303-368cd0fcf717 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 10062905-54d7-47e2-b621-522e0954b72b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:30.731383 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-daa36cb7-dc75-40a1-a726-24ebf5b10098 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.099033 Oct 04 21:46:30.732301 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 428/862] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Oct 4 21:46:29 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:46:30.743383 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-141c23a3-07fb-4d6f-a749-e3b5949ab564 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:30.744229 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-141c23a3-07fb-4d6f-a749-e3b5949ab564 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] [instance: d2542961-c0a1-46da-9ae8-2f40faa0a294] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:30.752255 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-141c23a3-07fb-4d6f-a749-e3b5949ab564 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:30.753017 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-141c23a3-07fb-4d6f-a749-e3b5949ab564 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:30.753621 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-141c23a3-07fb-4d6f-a749-e3b5949ab564 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:30.754554 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-141c23a3-07fb-4d6f-a749-e3b5949ab564 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:30.755317 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-141c23a3-07fb-4d6f-a749-e3b5949ab564 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:30.755931 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-141c23a3-07fb-4d6f-a749-e3b5949ab564 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:30.757197 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1fa4ffec-07da-4974-b303-368cd0fcf717 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:30.759268 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1fa4ffec-07da-4974-b303-368cd0fcf717 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:30.761126 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1fa4ffec-07da-4974-b303-368cd0fcf717 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:30.762704 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1fa4ffec-07da-4974-b303-368cd0fcf717 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:30.763018 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1fa4ffec-07da-4974-b303-368cd0fcf717 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:30.763464 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1fa4ffec-07da-4974-b303-368cd0fcf717 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:31.438458 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-1fa4ffec-07da-4974-b303-368cd0fcf717 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ad048becf474fb972d4291422d810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dcfc7024fc49388c4bd5f25f03e60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:31.440817 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-141c23a3-07fb-4d6f-a749-e3b5949ab564 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87616cd16995468ab7febf5aa4b284db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e3bf9149434d34b6762aaeef1478ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:31.456770 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-1fa4ffec-07da-4974-b303-368cd0fcf717 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/10062905-54d7-47e2-b621-522e0954b72b" status: 200 len: 1503 microversion: 2.1 time: 0.737099 Oct 04 21:46:31.457450 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-141c23a3-07fb-4d6f-a749-e3b5949ab564 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] 10.222.0.43 "GET /compute/v2.1/servers/d2542961-c0a1-46da-9ae8-2f40faa0a294" status: 200 len: 1313 microversion: 2.1 time: 0.718088 Oct 04 21:46:31.474432 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 429/863] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:30 2022] GET /compute/v2.1/servers/d2542961-c0a1-46da-9ae8-2f40faa0a294 => generated 1313 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:31.478146 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 435/864] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:30 2022] GET /compute/v2.1/servers/10062905-54d7-47e2-b621-522e0954b72b => generated 1503 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:31.481898 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-3cf8ec9d-a233-4145-953e-22a2283e9226 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:31.485778 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-3cf8ec9d-a233-4145-953e-22a2283e9226 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] [instance: b19ef33c-3012-4eed-abd6-edc1bd9f3e9c] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:31.487075 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-a605ff33-40f4-43bb-97b7-c5c3226eb86c tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:31.489679 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-a605ff33-40f4-43bb-97b7-c5c3226eb86c tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] [instance: 7512d9d6-ab41-453e-bb9d-8e0861aa37f7] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:31.499569 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a605ff33-40f4-43bb-97b7-c5c3226eb86c tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:31.499944 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3cf8ec9d-a233-4145-953e-22a2283e9226 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:31.500248 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a605ff33-40f4-43bb-97b7-c5c3226eb86c tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:31.500753 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a605ff33-40f4-43bb-97b7-c5c3226eb86c tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:31.501192 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3cf8ec9d-a233-4145-953e-22a2283e9226 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:31.501655 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a605ff33-40f4-43bb-97b7-c5c3226eb86c tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:31.502381 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a605ff33-40f4-43bb-97b7-c5c3226eb86c tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:31.503308 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a605ff33-40f4-43bb-97b7-c5c3226eb86c tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:31.504218 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3cf8ec9d-a233-4145-953e-22a2283e9226 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:31.505041 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3cf8ec9d-a233-4145-953e-22a2283e9226 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:31.507142 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3cf8ec9d-a233-4145-953e-22a2283e9226 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:31.507880 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3cf8ec9d-a233-4145-953e-22a2283e9226 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:31.679493 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-a605ff33-40f4-43bb-97b7-c5c3226eb86c tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:31.709391 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-a605ff33-40f4-43bb-97b7-c5c3226eb86c tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:31.711510 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-a605ff33-40f4-43bb-97b7-c5c3226eb86c tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:31.716794 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-a605ff33-40f4-43bb-97b7-c5c3226eb86c tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] 10.222.0.43 "GET /compute/v2.1/servers/7512d9d6-ab41-453e-bb9d-8e0861aa37f7" status: 200 len: 1258 microversion: 2.25 time: 0.239348 Oct 04 21:46:31.718182 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 436/865] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:46:31 2022] GET /compute/v2.1/servers/7512d9d6-ab41-453e-bb9d-8e0861aa37f7 => generated 1258 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:46:31.752487 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-3bfa31b7-e663-495d-9153-1aa71f6de826 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:31.753135 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-3bfa31b7-e663-495d-9153-1aa71f6de826 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] [instance: 34276621-d087-478b-81c7-bdf5e38efc69] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:31.778988 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3bfa31b7-e663-495d-9153-1aa71f6de826 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:31.782808 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3bfa31b7-e663-495d-9153-1aa71f6de826 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:31.783994 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3bfa31b7-e663-495d-9153-1aa71f6de826 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:31.784904 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3bfa31b7-e663-495d-9153-1aa71f6de826 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:31.786994 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3bfa31b7-e663-495d-9153-1aa71f6de826 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:31.788337 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3bfa31b7-e663-495d-9153-1aa71f6de826 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:32.025693 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-3cf8ec9d-a233-4145-953e-22a2283e9226 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29842a669a20408b881105135f76cb0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39edf587afe94b60911198aa0bb61613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:32.042760 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-3cf8ec9d-a233-4145-953e-22a2283e9226 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] 10.222.0.43 "GET /compute/v2.1/servers/b19ef33c-3012-4eed-abd6-edc1bd9f3e9c" status: 200 len: 1317 microversion: 2.1 time: 0.564459 Oct 04 21:46:32.043820 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 430/866] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:31 2022] GET /compute/v2.1/servers/b19ef33c-3012-4eed-abd6-edc1bd9f3e9c => generated 1317 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:32.048680 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-5e0ce4af-c7b5-40bb-b8a9-8dd7a42676ef req-ed9c309f-b83e-45b7-8836-cdc113ab4d2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2542961-c0a1-46da-9ae8-2f40faa0a294", "name": "network-vif-plugged", "status": "completed", "tag": "6e14d23d-e9fb-4b7d-84b3-d5394b74d104"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:46:32.072282 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-5e0ce4af-c7b5-40bb-b8a9-8dd7a42676ef req-ed9c309f-b83e-45b7-8836-cdc113ab4d2c service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:32.072972 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-5e0ce4af-c7b5-40bb-b8a9-8dd7a42676ef req-ed9c309f-b83e-45b7-8836-cdc113ab4d2c service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:32.073414 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-5e0ce4af-c7b5-40bb-b8a9-8dd7a42676ef req-ed9c309f-b83e-45b7-8836-cdc113ab4d2c service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:32.093298 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-5e0ce4af-c7b5-40bb-b8a9-8dd7a42676ef req-ed9c309f-b83e-45b7-8836-cdc113ab4d2c service nova] Creating event network-vif-plugged:6e14d23d-e9fb-4b7d-84b3-d5394b74d104 for instance d2542961-c0a1-46da-9ae8-2f40faa0a294 on n-h2-860284-1 Oct 04 21:46:32.109987 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-5e0ce4af-c7b5-40bb-b8a9-8dd7a42676ef req-ed9c309f-b83e-45b7-8836-cdc113ab4d2c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064676 Oct 04 21:46:32.110939 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 431/867] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:46:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:46:32.476195 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-3bfa31b7-e663-495d-9153-1aa71f6de826 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1789bb97219a4e1591632126812ea6df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da67fc95e2814f4086df020f4c475764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:32.486592 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-f56a260b-8040-4aa2-b759-1b995ab1b338 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:32.487354 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-f56a260b-8040-4aa2-b759-1b995ab1b338 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 10062905-54d7-47e2-b621-522e0954b72b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:32.489787 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-3bfa31b7-e663-495d-9153-1aa71f6de826 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] 10.222.0.43 "GET /compute/v2.1/servers/34276621-d087-478b-81c7-bdf5e38efc69" status: 200 len: 1389 microversion: 2.1 time: 0.769932 Oct 04 21:46:32.509795 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f56a260b-8040-4aa2-b759-1b995ab1b338 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:32.510578 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f56a260b-8040-4aa2-b759-1b995ab1b338 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:32.511252 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f56a260b-8040-4aa2-b759-1b995ab1b338 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:32.512410 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f56a260b-8040-4aa2-b759-1b995ab1b338 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:32.512912 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f56a260b-8040-4aa2-b759-1b995ab1b338 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:32.513347 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f56a260b-8040-4aa2-b759-1b995ab1b338 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:32.514591 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 437/868] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:31 2022] GET /compute/v2.1/servers/34276621-d087-478b-81c7-bdf5e38efc69 => generated 1389 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:32.522425 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-ab1476af-ad99-443c-8634-5b0eb390ddff tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:32.523894 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-ab1476af-ad99-443c-8634-5b0eb390ddff tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] [instance: d2542961-c0a1-46da-9ae8-2f40faa0a294] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:32.530731 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ab1476af-ad99-443c-8634-5b0eb390ddff tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:32.531236 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ab1476af-ad99-443c-8634-5b0eb390ddff tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:32.531683 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ab1476af-ad99-443c-8634-5b0eb390ddff tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:32.532413 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ab1476af-ad99-443c-8634-5b0eb390ddff tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:32.532957 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ab1476af-ad99-443c-8634-5b0eb390ddff tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:32.533744 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ab1476af-ad99-443c-8634-5b0eb390ddff tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:33.038568 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-ab1476af-ad99-443c-8634-5b0eb390ddff tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87616cd16995468ab7febf5aa4b284db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e3bf9149434d34b6762aaeef1478ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:33.051313 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-ab1476af-ad99-443c-8634-5b0eb390ddff tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] 10.222.0.43 "GET /compute/v2.1/servers/d2542961-c0a1-46da-9ae8-2f40faa0a294" status: 200 len: 1313 microversion: 2.1 time: 0.535414 Oct 04 21:46:33.061456 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-f56a260b-8040-4aa2-b759-1b995ab1b338 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ad048becf474fb972d4291422d810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dcfc7024fc49388c4bd5f25f03e60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:33.069459 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 438/869] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:32 2022] GET /compute/v2.1/servers/d2542961-c0a1-46da-9ae8-2f40faa0a294 => generated 1313 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:33.074705 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-83e4e176-3bb8-4157-989a-17c70b1337ab tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:33.075706 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-83e4e176-3bb8-4157-989a-17c70b1337ab tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] [instance: 7512d9d6-ab41-453e-bb9d-8e0861aa37f7] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:33.093240 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-83e4e176-3bb8-4157-989a-17c70b1337ab tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:33.095638 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-83e4e176-3bb8-4157-989a-17c70b1337ab tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:33.096473 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-83e4e176-3bb8-4157-989a-17c70b1337ab tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:33.097596 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-83e4e176-3bb8-4157-989a-17c70b1337ab tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:33.098294 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-83e4e176-3bb8-4157-989a-17c70b1337ab tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:33.098969 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-83e4e176-3bb8-4157-989a-17c70b1337ab tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:33.114503 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-f56a260b-8040-4aa2-b759-1b995ab1b338 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/10062905-54d7-47e2-b621-522e0954b72b" status: 200 len: 1503 microversion: 2.1 time: 0.617128 Oct 04 21:46:33.116136 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 432/870] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:32 2022] GET /compute/v2.1/servers/10062905-54d7-47e2-b621-522e0954b72b => generated 1503 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:33.122710 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-8b50fb02-9d50-4f2a-b4b1-a8b5dc999ee1 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:33.123705 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-8b50fb02-9d50-4f2a-b4b1-a8b5dc999ee1 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] [instance: b19ef33c-3012-4eed-abd6-edc1bd9f3e9c] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:33.132157 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8b50fb02-9d50-4f2a-b4b1-a8b5dc999ee1 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:33.133110 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8b50fb02-9d50-4f2a-b4b1-a8b5dc999ee1 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:33.133814 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8b50fb02-9d50-4f2a-b4b1-a8b5dc999ee1 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:33.135085 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8b50fb02-9d50-4f2a-b4b1-a8b5dc999ee1 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:33.135981 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8b50fb02-9d50-4f2a-b4b1-a8b5dc999ee1 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:33.136653 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8b50fb02-9d50-4f2a-b4b1-a8b5dc999ee1 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:33.567129 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-83e4e176-3bb8-4157-989a-17c70b1337ab tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:33.588935 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-83e4e176-3bb8-4157-989a-17c70b1337ab tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:33.593241 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-83e4e176-3bb8-4157-989a-17c70b1337ab tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:33.596081 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-83e4e176-3bb8-4157-989a-17c70b1337ab tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] 10.222.0.43 "GET /compute/v2.1/servers/7512d9d6-ab41-453e-bb9d-8e0861aa37f7" status: 200 len: 1258 microversion: 2.25 time: 0.529030 Oct 04 21:46:33.597549 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 439/871] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:46:33 2022] GET /compute/v2.1/servers/7512d9d6-ab41-453e-bb9d-8e0861aa37f7 => generated 1258 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:46:33.608075 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-8aca393d-4b15-48d9-9c06-cb031c5e95a3 tempest-MigrationsAdminTest-1218821219 tempest-MigrationsAdminTest-1218821219-project-admin] Calling method '.version_select at 0x7fbb2f97bf70>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:33.616438 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8aca393d-4b15-48d9-9c06-cb031c5e95a3 tempest-MigrationsAdminTest-1218821219 tempest-MigrationsAdminTest-1218821219-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:33.617755 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8aca393d-4b15-48d9-9c06-cb031c5e95a3 tempest-MigrationsAdminTest-1218821219 tempest-MigrationsAdminTest-1218821219-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:33.618571 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8aca393d-4b15-48d9-9c06-cb031c5e95a3 tempest-MigrationsAdminTest-1218821219 tempest-MigrationsAdminTest-1218821219-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:33.638639 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-8aca393d-4b15-48d9-9c06-cb031c5e95a3 tempest-MigrationsAdminTest-1218821219 tempest-MigrationsAdminTest-1218821219-project-admin] 10.222.0.43 "GET /compute/v2.1/os-migrations" status: 200 len: 1566 microversion: 2.1 time: 0.038720 Oct 04 21:46:33.651391 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 440/872] 10.222.0.43 () {58 vars in 1143 bytes} [Tue Oct 4 21:46:33 2022] GET /compute/v2.1/os-migrations => generated 1566 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:33.666203 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-37df21f1-a1e5-4f75-aa4b-6235f62aec48 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:33.667155 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-37df21f1-a1e5-4f75-aa4b-6235f62aec48 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] [instance: 34276621-d087-478b-81c7-bdf5e38efc69] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:33.677830 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-37df21f1-a1e5-4f75-aa4b-6235f62aec48 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:33.679208 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-37df21f1-a1e5-4f75-aa4b-6235f62aec48 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:33.680025 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-37df21f1-a1e5-4f75-aa4b-6235f62aec48 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:33.680952 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-37df21f1-a1e5-4f75-aa4b-6235f62aec48 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:33.681584 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-37df21f1-a1e5-4f75-aa4b-6235f62aec48 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:33.684274 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-37df21f1-a1e5-4f75-aa4b-6235f62aec48 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:34.003558 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-8b50fb02-9d50-4f2a-b4b1-a8b5dc999ee1 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29842a669a20408b881105135f76cb0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39edf587afe94b60911198aa0bb61613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:34.012950 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-8b50fb02-9d50-4f2a-b4b1-a8b5dc999ee1 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] 10.222.0.43 "GET /compute/v2.1/servers/b19ef33c-3012-4eed-abd6-edc1bd9f3e9c" status: 200 len: 1467 microversion: 2.1 time: 0.895420 Oct 04 21:46:34.018417 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 433/873] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:33 2022] GET /compute/v2.1/servers/b19ef33c-3012-4eed-abd6-edc1bd9f3e9c => generated 1467 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:34.018417 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-071e55bd-d7ae-412b-b539-16a2032f2db8 tempest-MigrationsAdminTest-1218821219 tempest-MigrationsAdminTest-1218821219-project-admin] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:34.026392 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-071e55bd-d7ae-412b-b539-16a2032f2db8 tempest-MigrationsAdminTest-1218821219 tempest-MigrationsAdminTest-1218821219-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.011538 Oct 04 21:46:34.034621 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 434/874] 10.222.0.43 () {58 vars in 1137 bytes} [Tue Oct 4 21:46:34 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:46:34.041038 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-8532becc-fda3-45ed-9c4e-1c2a25e17043 tempest-MigrationsAdminTest-1218821219 tempest-MigrationsAdminTest-1218821219-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-802784835", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:46:34.066922 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-8532becc-fda3-45ed-9c4e-1c2a25e17043 tempest-MigrationsAdminTest-1218821219 tempest-MigrationsAdminTest-1218821219-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 498 microversion: 2.1 time: 0.031024 Oct 04 21:46:34.067948 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 435/875] 10.222.0.43 () {60 vars in 1146 bytes} [Tue Oct 4 21:46:34 2022] POST /compute/v2.1/flavors => generated 498 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:46:34.074632 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-fbd85f58-376e-40d2-8562-06b66d7e2ed8 tempest-ServersOnMultiNodesTest-962622545 tempest-ServersOnMultiNodesTest-962622545-project-admin] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:34.075367 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-fbd85f58-376e-40d2-8562-06b66d7e2ed8 tempest-ServersOnMultiNodesTest-962622545 tempest-ServersOnMultiNodesTest-962622545-project-admin] [instance: b19ef33c-3012-4eed-abd6-edc1bd9f3e9c] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:34.080364 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-37df21f1-a1e5-4f75-aa4b-6235f62aec48 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1789bb97219a4e1591632126812ea6df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da67fc95e2814f4086df020f4c475764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:34.081728 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fbd85f58-376e-40d2-8562-06b66d7e2ed8 tempest-ServersOnMultiNodesTest-962622545 tempest-ServersOnMultiNodesTest-962622545-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:34.082237 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fbd85f58-376e-40d2-8562-06b66d7e2ed8 tempest-ServersOnMultiNodesTest-962622545 tempest-ServersOnMultiNodesTest-962622545-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:34.082715 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fbd85f58-376e-40d2-8562-06b66d7e2ed8 tempest-ServersOnMultiNodesTest-962622545 tempest-ServersOnMultiNodesTest-962622545-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:34.083445 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fbd85f58-376e-40d2-8562-06b66d7e2ed8 tempest-ServersOnMultiNodesTest-962622545 tempest-ServersOnMultiNodesTest-962622545-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:34.083911 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fbd85f58-376e-40d2-8562-06b66d7e2ed8 tempest-ServersOnMultiNodesTest-962622545 tempest-ServersOnMultiNodesTest-962622545-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:34.084875 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fbd85f58-376e-40d2-8562-06b66d7e2ed8 tempest-ServersOnMultiNodesTest-962622545 tempest-ServersOnMultiNodesTest-962622545-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:34.097050 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-37df21f1-a1e5-4f75-aa4b-6235f62aec48 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] 10.222.0.43 "GET /compute/v2.1/servers/34276621-d087-478b-81c7-bdf5e38efc69" status: 200 len: 1389 microversion: 2.1 time: 0.441436 Oct 04 21:46:34.099124 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 441/876] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:33 2022] GET /compute/v2.1/servers/34276621-d087-478b-81c7-bdf5e38efc69 => generated 1389 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:34.105153 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-b01ae510-bbf9-49c3-8e5c-32a3dea4726b tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:34.106004 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-b01ae510-bbf9-49c3-8e5c-32a3dea4726b tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] [instance: d2542961-c0a1-46da-9ae8-2f40faa0a294] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:34.113287 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b01ae510-bbf9-49c3-8e5c-32a3dea4726b tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:34.114061 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b01ae510-bbf9-49c3-8e5c-32a3dea4726b tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:34.114865 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b01ae510-bbf9-49c3-8e5c-32a3dea4726b tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:34.115892 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b01ae510-bbf9-49c3-8e5c-32a3dea4726b tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:34.117762 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b01ae510-bbf9-49c3-8e5c-32a3dea4726b tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:34.118535 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b01ae510-bbf9-49c3-8e5c-32a3dea4726b tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:34.572808 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-fbd85f58-376e-40d2-8562-06b66d7e2ed8 tempest-ServersOnMultiNodesTest-962622545 tempest-ServersOnMultiNodesTest-962622545-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/b19ef33c-3012-4eed-abd6-edc1bd9f3e9c" status: 200 len: 1618 microversion: 2.1 time: 0.503856 Oct 04 21:46:34.573405 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 436/877] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:34 2022] GET /compute/v2.1/servers/b19ef33c-3012-4eed-abd6-edc1bd9f3e9c => generated 1618 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:34.586490 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-3f1410bf-378b-49ca-aaef-8047d6eb1996 tempest-MigrationsAdminTest-1218821219 tempest-MigrationsAdminTest-1218821219-project-admin] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:34.612008 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-3f1410bf-378b-49ca-aaef-8047d6eb1996 tempest-MigrationsAdminTest-1218821219 tempest-MigrationsAdminTest-1218821219-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.033126 Oct 04 21:46:34.614679 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 437/878] 10.222.0.43 () {58 vars in 1182 bytes} [Tue Oct 4 21:46:34 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 21:46:34.630630 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-eb4d6429-f339-4cac-bbf5-b97d6de2f00e tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:34.632290 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-eb4d6429-f339-4cac-bbf5-b97d6de2f00e tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 10062905-54d7-47e2-b621-522e0954b72b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:34.643300 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-eb4d6429-f339-4cac-bbf5-b97d6de2f00e tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:34.643793 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-eb4d6429-f339-4cac-bbf5-b97d6de2f00e tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:34.644229 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-eb4d6429-f339-4cac-bbf5-b97d6de2f00e tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:34.649861 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-eb4d6429-f339-4cac-bbf5-b97d6de2f00e tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:34.650408 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-eb4d6429-f339-4cac-bbf5-b97d6de2f00e tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:34.651035 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-eb4d6429-f339-4cac-bbf5-b97d6de2f00e tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:34.692746 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-b01ae510-bbf9-49c3-8e5c-32a3dea4726b tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87616cd16995468ab7febf5aa4b284db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e3bf9149434d34b6762aaeef1478ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:34.719587 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-b01ae510-bbf9-49c3-8e5c-32a3dea4726b tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] 10.222.0.43 "GET /compute/v2.1/servers/d2542961-c0a1-46da-9ae8-2f40faa0a294" status: 200 len: 1313 microversion: 2.1 time: 0.618900 Oct 04 21:46:34.721934 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 442/879] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:34 2022] GET /compute/v2.1/servers/d2542961-c0a1-46da-9ae8-2f40faa0a294 => generated 1313 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:34.730124 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-5358e40c-5aba-45e0-b6fe-371ed9548b27 req-a4e66533-c965-41ea-9828-f9cfa1200932 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10062905-54d7-47e2-b621-522e0954b72b", "name": "network-vif-plugged", "status": "completed", "tag": "f5b5fac6-bb2d-4a99-a6db-4f032a197633"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:46:34.766515 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-5358e40c-5aba-45e0-b6fe-371ed9548b27 req-a4e66533-c965-41ea-9828-f9cfa1200932 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:34.767424 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-5358e40c-5aba-45e0-b6fe-371ed9548b27 req-a4e66533-c965-41ea-9828-f9cfa1200932 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:34.768563 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-5358e40c-5aba-45e0-b6fe-371ed9548b27 req-a4e66533-c965-41ea-9828-f9cfa1200932 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:34.789383 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-5358e40c-5aba-45e0-b6fe-371ed9548b27 req-a4e66533-c965-41ea-9828-f9cfa1200932 service nova] Creating event network-vif-plugged:f5b5fac6-bb2d-4a99-a6db-4f032a197633 for instance 10062905-54d7-47e2-b621-522e0954b72b on n-h1-860284-1 Oct 04 21:46:34.795586 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-5358e40c-5aba-45e0-b6fe-371ed9548b27 req-a4e66533-c965-41ea-9828-f9cfa1200932 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071297 Oct 04 21:46:34.801679 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 443/880] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:46:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:46:34.810602 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-0a8cb903-89a2-40f2-a74e-0274311d6fbb tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:34.811726 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-0a8cb903-89a2-40f2-a74e-0274311d6fbb tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] [instance: 7512d9d6-ab41-453e-bb9d-8e0861aa37f7] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:34.819581 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0a8cb903-89a2-40f2-a74e-0274311d6fbb tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:34.820270 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0a8cb903-89a2-40f2-a74e-0274311d6fbb tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:34.820888 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0a8cb903-89a2-40f2-a74e-0274311d6fbb tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:34.822191 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0a8cb903-89a2-40f2-a74e-0274311d6fbb tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:34.823151 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0a8cb903-89a2-40f2-a74e-0274311d6fbb tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:34.823612 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0a8cb903-89a2-40f2-a74e-0274311d6fbb tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:34.984152 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-0a8cb903-89a2-40f2-a74e-0274311d6fbb tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:34.999318 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-0a8cb903-89a2-40f2-a74e-0274311d6fbb tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:35.005417 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-0a8cb903-89a2-40f2-a74e-0274311d6fbb tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:35.009721 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-0a8cb903-89a2-40f2-a74e-0274311d6fbb tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] 10.222.0.43 "GET /compute/v2.1/servers/7512d9d6-ab41-453e-bb9d-8e0861aa37f7" status: 200 len: 1314 microversion: 2.25 time: 0.206090 Oct 04 21:46:35.013596 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 444/881] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:46:34 2022] GET /compute/v2.1/servers/7512d9d6-ab41-453e-bb9d-8e0861aa37f7 => generated 1314 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:46:35.039447 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-54ffa0da-c76d-4970-83f6-ed7f56c4d377 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-491018079", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "4b0c3dd7-d609-4b00-8604-35f8a2680c14"}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:46:35.115268 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.network.neutron [None req-54ffa0da-c76d-4970-83f6-ed7f56c4d377 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] validate_networks() for None {{(pid=134102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:46:35.361873 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-eb4d6429-f339-4cac-bbf5-b97d6de2f00e tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ad048becf474fb972d4291422d810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dcfc7024fc49388c4bd5f25f03e60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:35.380349 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-eb4d6429-f339-4cac-bbf5-b97d6de2f00e tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/10062905-54d7-47e2-b621-522e0954b72b" status: 200 len: 1503 microversion: 2.1 time: 0.764217 Oct 04 21:46:35.381922 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 438/882] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:34 2022] GET /compute/v2.1/servers/10062905-54d7-47e2-b621-522e0954b72b => generated 1503 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:35.392875 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-de0d0cf9-0f1a-479a-a7f8-264b19394bb6 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-169927515", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "2f11d680-cbcd-4967-844a-69bea5307624"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:46:35.430029 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell0:SELECT=2 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:46:35.474599 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.network.neutron [None req-de0d0cf9-0f1a-479a-a7f8-264b19394bb6 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] validate_networks() for None {{(pid=134101) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:46:35.506557 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell0:SELECT=6 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:46:36.290820 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-54ffa0da-c76d-4970-83f6-ed7f56c4d377 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Flavor limits 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:46:36.291739 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-54ffa0da-c76d-4970-83f6-ed7f56c4d377 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Image limits 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:46:36.291739 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-54ffa0da-c76d-4970-83f6-ed7f56c4d377 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Flavor pref 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:46:36.292124 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-54ffa0da-c76d-4970-83f6-ed7f56c4d377 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Image pref 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:46:36.292572 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-54ffa0da-c76d-4970-83f6-ed7f56c4d377 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:46:36.303445 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-54ffa0da-c76d-4970-83f6-ed7f56c4d377 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:36.304261 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-54ffa0da-c76d-4970-83f6-ed7f56c4d377 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:36.304893 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-54ffa0da-c76d-4970-83f6-ed7f56c4d377 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:36.306015 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-54ffa0da-c76d-4970-83f6-ed7f56c4d377 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:36.306691 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-54ffa0da-c76d-4970-83f6-ed7f56c4d377 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:36.307297 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-54ffa0da-c76d-4970-83f6-ed7f56c4d377 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:36.330092 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-54ffa0da-c76d-4970-83f6-ed7f56c4d377 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Getting quotas for project 39edf587afe94b60911198aa0bb61613. Resources: {'instances', 'ram', 'cores'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:46:36.337327 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-54ffa0da-c76d-4970-83f6-ed7f56c4d377 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Getting quotas for user 29842a669a20408b881105135f76cb0a and project 39edf587afe94b60911198aa0bb61613. Resources: {'instances', 'ram', 'cores'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:46:36.354110 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-54ffa0da-c76d-4970-83f6-ed7f56c4d377 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Going to run 1 instances... {{(pid=134102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:46:36.357025 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-54ffa0da-c76d-4970-83f6-ed7f56c4d377 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] [instance: 663b2cc6-7a55-406a-b56f-86047b0e514d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='58548514-5dac-426c-81f5-19e3fba33e23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:46:36.416337 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-54ffa0da-c76d-4970-83f6-ed7f56c4d377 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.400557 Oct 04 21:46:36.417011 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 445/883] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 21:46:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 1403 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:46:36.422102 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-0dfe9ecf-5310-44f1-b622-62edb3972ba7 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:36.422760 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-0dfe9ecf-5310-44f1-b622-62edb3972ba7 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] [instance: 34276621-d087-478b-81c7-bdf5e38efc69] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:36.432899 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0dfe9ecf-5310-44f1-b622-62edb3972ba7 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:36.433794 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0dfe9ecf-5310-44f1-b622-62edb3972ba7 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:36.434445 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0dfe9ecf-5310-44f1-b622-62edb3972ba7 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:36.435337 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0dfe9ecf-5310-44f1-b622-62edb3972ba7 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:36.435963 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0dfe9ecf-5310-44f1-b622-62edb3972ba7 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:36.436621 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0dfe9ecf-5310-44f1-b622-62edb3972ba7 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:36.483539 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-de0d0cf9-0f1a-479a-a7f8-264b19394bb6 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Flavor limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:46:36.484080 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-de0d0cf9-0f1a-479a-a7f8-264b19394bb6 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Image limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:46:36.485272 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-de0d0cf9-0f1a-479a-a7f8-264b19394bb6 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Flavor pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:46:36.485777 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-de0d0cf9-0f1a-479a-a7f8-264b19394bb6 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Image pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:46:36.486289 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-de0d0cf9-0f1a-479a-a7f8-264b19394bb6 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:46:36.501567 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-de0d0cf9-0f1a-479a-a7f8-264b19394bb6 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:36.502055 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-de0d0cf9-0f1a-479a-a7f8-264b19394bb6 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:36.502781 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-de0d0cf9-0f1a-479a-a7f8-264b19394bb6 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:36.504498 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-de0d0cf9-0f1a-479a-a7f8-264b19394bb6 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:36.506314 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-de0d0cf9-0f1a-479a-a7f8-264b19394bb6 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:36.507148 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-de0d0cf9-0f1a-479a-a7f8-264b19394bb6 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:36.548166 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-de0d0cf9-0f1a-479a-a7f8-264b19394bb6 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Getting quotas for project 1ad1554e318e45f78a2bc5e148d0c39f. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:46:36.565079 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-de0d0cf9-0f1a-479a-a7f8-264b19394bb6 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Getting quotas for user ff4e089659884b6d9197141ba9f14f57 and project 1ad1554e318e45f78a2bc5e148d0c39f. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:46:36.608655 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-de0d0cf9-0f1a-479a-a7f8-264b19394bb6 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Going to run 1 instances... {{(pid=134101) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:46:36.619644 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-de0d0cf9-0f1a-479a-a7f8-264b19394bb6 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: 424a22f0-ccc3-4fec-bf38-4aaf924928e3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='58548514-5dac-426c-81f5-19e3fba33e23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134101) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:46:36.734961 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-de0d0cf9-0f1a-479a-a7f8-264b19394bb6 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.346064 Oct 04 21:46:36.739014 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 439/884] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 21:46:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 1355 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:46:36.755081 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-ee1b0a08-d4df-49fd-9595-cbd6be6a1481 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:36.758456 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-ee1b0a08-d4df-49fd-9595-cbd6be6a1481 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] [instance: d2542961-c0a1-46da-9ae8-2f40faa0a294] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:36.775577 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ee1b0a08-d4df-49fd-9595-cbd6be6a1481 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:36.778891 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ee1b0a08-d4df-49fd-9595-cbd6be6a1481 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:36.779698 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ee1b0a08-d4df-49fd-9595-cbd6be6a1481 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:36.780689 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ee1b0a08-d4df-49fd-9595-cbd6be6a1481 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:36.783083 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ee1b0a08-d4df-49fd-9595-cbd6be6a1481 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:36.783777 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ee1b0a08-d4df-49fd-9595-cbd6be6a1481 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:36.869185 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-0dfe9ecf-5310-44f1-b622-62edb3972ba7 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1789bb97219a4e1591632126812ea6df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da67fc95e2814f4086df020f4c475764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:36.902687 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-0dfe9ecf-5310-44f1-b622-62edb3972ba7 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] 10.222.0.43 "GET /compute/v2.1/servers/34276621-d087-478b-81c7-bdf5e38efc69" status: 200 len: 1389 microversion: 2.1 time: 0.483188 Oct 04 21:46:36.906163 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 446/885] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:36 2022] GET /compute/v2.1/servers/34276621-d087-478b-81c7-bdf5e38efc69 => generated 1389 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:36.924866 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-2e83a238-ec4b-4435-81c6-cfc7d4c91e05 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:36.928959 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-2e83a238-ec4b-4435-81c6-cfc7d4c91e05 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] [instance: 7512d9d6-ab41-453e-bb9d-8e0861aa37f7] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:36.958644 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2e83a238-ec4b-4435-81c6-cfc7d4c91e05 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:36.962109 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2e83a238-ec4b-4435-81c6-cfc7d4c91e05 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:36.963103 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2e83a238-ec4b-4435-81c6-cfc7d4c91e05 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:36.963880 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2e83a238-ec4b-4435-81c6-cfc7d4c91e05 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:36.964372 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2e83a238-ec4b-4435-81c6-cfc7d4c91e05 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:36.968159 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2e83a238-ec4b-4435-81c6-cfc7d4c91e05 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:37.311665 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-2e83a238-ec4b-4435-81c6-cfc7d4c91e05 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:37.328563 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-2e83a238-ec4b-4435-81c6-cfc7d4c91e05 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:37.336123 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-2e83a238-ec4b-4435-81c6-cfc7d4c91e05 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:37.337994 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-2e83a238-ec4b-4435-81c6-cfc7d4c91e05 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] 10.222.0.43 "GET /compute/v2.1/servers/7512d9d6-ab41-453e-bb9d-8e0861aa37f7" status: 200 len: 1362 microversion: 2.25 time: 0.430038 Oct 04 21:46:37.354278 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 447/886] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:46:36 2022] GET /compute/v2.1/servers/7512d9d6-ab41-453e-bb9d-8e0861aa37f7 => generated 1362 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:46:37.363526 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-7a0daa04-246e-474a-be75-a9698937957d tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:37.365098 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-7a0daa04-246e-474a-be75-a9698937957d tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 10062905-54d7-47e2-b621-522e0954b72b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:37.377866 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7a0daa04-246e-474a-be75-a9698937957d tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:37.378827 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7a0daa04-246e-474a-be75-a9698937957d tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:37.379704 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7a0daa04-246e-474a-be75-a9698937957d tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:37.381354 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7a0daa04-246e-474a-be75-a9698937957d tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:37.382090 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7a0daa04-246e-474a-be75-a9698937957d tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:37.382908 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7a0daa04-246e-474a-be75-a9698937957d tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:37.939212 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-ee1b0a08-d4df-49fd-9595-cbd6be6a1481 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87616cd16995468ab7febf5aa4b284db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e3bf9149434d34b6762aaeef1478ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:37.955853 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-ee1b0a08-d4df-49fd-9595-cbd6be6a1481 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] 10.222.0.43 "GET /compute/v2.1/servers/d2542961-c0a1-46da-9ae8-2f40faa0a294" status: 200 len: 1462 microversion: 2.1 time: 1.215278 Oct 04 21:46:37.957195 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 440/887] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:36 2022] GET /compute/v2.1/servers/d2542961-c0a1-46da-9ae8-2f40faa0a294 => generated 1462 bytes in 1217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:37.979178 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-25ddf4b3-5fb0-4b05-ba61-99c4d936a000 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:37.980138 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-25ddf4b3-5fb0-4b05-ba61-99c4d936a000 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] [instance: 663b2cc6-7a55-406a-b56f-86047b0e514d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:37.991264 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-25ddf4b3-5fb0-4b05-ba61-99c4d936a000 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:37.992087 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-25ddf4b3-5fb0-4b05-ba61-99c4d936a000 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:37.992859 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-25ddf4b3-5fb0-4b05-ba61-99c4d936a000 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:37.993685 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-25ddf4b3-5fb0-4b05-ba61-99c4d936a000 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:37.994211 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-25ddf4b3-5fb0-4b05-ba61-99c4d936a000 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:37.995547 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-25ddf4b3-5fb0-4b05-ba61-99c4d936a000 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:38.160260 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-25ddf4b3-5fb0-4b05-ba61-99c4d936a000 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29842a669a20408b881105135f76cb0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39edf587afe94b60911198aa0bb61613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:38.175908 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-25ddf4b3-5fb0-4b05-ba61-99c4d936a000 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] 10.222.0.43 "GET /compute/v2.1/servers/663b2cc6-7a55-406a-b56f-86047b0e514d" status: 200 len: 1268 microversion: 2.1 time: 0.217251 Oct 04 21:46:38.176575 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 441/888] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:37 2022] GET /compute/v2.1/servers/663b2cc6-7a55-406a-b56f-86047b0e514d => generated 1268 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:38.200265 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-0abfc2db-16d7-4b2c-95c7-2bb9eb542f86 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:38.201440 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-0abfc2db-16d7-4b2c-95c7-2bb9eb542f86 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: 424a22f0-ccc3-4fec-bf38-4aaf924928e3] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:38.203530 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-7a0daa04-246e-474a-be75-a9698937957d tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ad048becf474fb972d4291422d810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dcfc7024fc49388c4bd5f25f03e60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:38.211807 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0abfc2db-16d7-4b2c-95c7-2bb9eb542f86 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:38.213511 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0abfc2db-16d7-4b2c-95c7-2bb9eb542f86 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:38.213984 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0abfc2db-16d7-4b2c-95c7-2bb9eb542f86 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:38.214786 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0abfc2db-16d7-4b2c-95c7-2bb9eb542f86 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:38.215227 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0abfc2db-16d7-4b2c-95c7-2bb9eb542f86 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:38.215653 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0abfc2db-16d7-4b2c-95c7-2bb9eb542f86 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:38.219869 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-7a0daa04-246e-474a-be75-a9698937957d tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/10062905-54d7-47e2-b621-522e0954b72b" status: 200 len: 1493 microversion: 2.1 time: 0.863964 Oct 04 21:46:38.236611 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 448/889] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:37 2022] GET /compute/v2.1/servers/10062905-54d7-47e2-b621-522e0954b72b => generated 1493 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:38.236611 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-f16a818f-ad2b-4e0f-ae47-4a9eaa85b262 req-e0719b5e-19ca-4ba8-b128-b6f41cb55a72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34276621-d087-478b-81c7-bdf5e38efc69", "name": "network-vif-plugged", "status": "completed", "tag": "80b76ccd-8248-4ae2-ae94-68b23a4a9c2c"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:46:38.285827 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-f16a818f-ad2b-4e0f-ae47-4a9eaa85b262 req-e0719b5e-19ca-4ba8-b128-b6f41cb55a72 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:38.287079 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-f16a818f-ad2b-4e0f-ae47-4a9eaa85b262 req-e0719b5e-19ca-4ba8-b128-b6f41cb55a72 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:38.291308 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-f16a818f-ad2b-4e0f-ae47-4a9eaa85b262 req-e0719b5e-19ca-4ba8-b128-b6f41cb55a72 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:38.325158 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-f16a818f-ad2b-4e0f-ae47-4a9eaa85b262 req-e0719b5e-19ca-4ba8-b128-b6f41cb55a72 service nova] Creating event network-vif-plugged:80b76ccd-8248-4ae2-ae94-68b23a4a9c2c for instance 34276621-d087-478b-81c7-bdf5e38efc69 on n-h2-860284-1 Oct 04 21:46:38.335734 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-f16a818f-ad2b-4e0f-ae47-4a9eaa85b262 req-e0719b5e-19ca-4ba8-b128-b6f41cb55a72 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101132 Oct 04 21:46:38.340468 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 449/890] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:46:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:46:38.346521 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-8de7e3b6-0470-4209-8dd2-d4dcb200fe07 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:38.347268 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-8de7e3b6-0470-4209-8dd2-d4dcb200fe07 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] [instance: 34276621-d087-478b-81c7-bdf5e38efc69] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:38.365533 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8de7e3b6-0470-4209-8dd2-d4dcb200fe07 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:38.366895 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8de7e3b6-0470-4209-8dd2-d4dcb200fe07 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:38.368132 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8de7e3b6-0470-4209-8dd2-d4dcb200fe07 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:38.369238 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8de7e3b6-0470-4209-8dd2-d4dcb200fe07 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:38.370037 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8de7e3b6-0470-4209-8dd2-d4dcb200fe07 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:38.381219 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8de7e3b6-0470-4209-8dd2-d4dcb200fe07 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:38.402936 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-0abfc2db-16d7-4b2c-95c7-2bb9eb542f86 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:38.427950 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-0abfc2db-16d7-4b2c-95c7-2bb9eb542f86 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/424a22f0-ccc3-4fec-bf38-4aaf924928e3" status: 200 len: 1274 microversion: 2.1 time: 0.230696 Oct 04 21:46:38.431292 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 442/891] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:38 2022] GET /compute/v2.1/servers/424a22f0-ccc3-4fec-bf38-4aaf924928e3 => generated 1274 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:38.699003 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-c6b3fd45-0da3-4607-baca-9d0184b1b080 tempest-ServersAdminTestJSON-717699517 tempest-ServersAdminTestJSON-717699517-project-admin] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:38.704751 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-c6b3fd45-0da3-4607-baca-9d0184b1b080 tempest-ServersAdminTestJSON-717699517 tempest-ServersAdminTestJSON-717699517-project-admin] Searching by: {'deleted': False, 'project_id': '934352511a4c4c63a9fa12e2a6f5c561'} {{(pid=134101) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 21:46:38.713918 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c6b3fd45-0da3-4607-baca-9d0184b1b080 tempest-ServersAdminTestJSON-717699517 tempest-ServersAdminTestJSON-717699517-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:38.714660 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c6b3fd45-0da3-4607-baca-9d0184b1b080 tempest-ServersAdminTestJSON-717699517 tempest-ServersAdminTestJSON-717699517-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:38.715428 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c6b3fd45-0da3-4607-baca-9d0184b1b080 tempest-ServersAdminTestJSON-717699517 tempest-ServersAdminTestJSON-717699517-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:38.716478 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c6b3fd45-0da3-4607-baca-9d0184b1b080 tempest-ServersAdminTestJSON-717699517 tempest-ServersAdminTestJSON-717699517-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:38.717705 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c6b3fd45-0da3-4607-baca-9d0184b1b080 tempest-ServersAdminTestJSON-717699517 tempest-ServersAdminTestJSON-717699517-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:38.718291 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c6b3fd45-0da3-4607-baca-9d0184b1b080 tempest-ServersAdminTestJSON-717699517 tempest-ServersAdminTestJSON-717699517-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:38.785516 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-8de7e3b6-0470-4209-8dd2-d4dcb200fe07 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1789bb97219a4e1591632126812ea6df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da67fc95e2814f4086df020f4c475764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:38.795325 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-8de7e3b6-0470-4209-8dd2-d4dcb200fe07 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] 10.222.0.43 "GET /compute/v2.1/servers/34276621-d087-478b-81c7-bdf5e38efc69" status: 200 len: 1389 microversion: 2.1 time: 0.453449 Oct 04 21:46:38.795918 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 450/892] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:38 2022] GET /compute/v2.1/servers/34276621-d087-478b-81c7-bdf5e38efc69 => generated 1389 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:38.810070 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-f1826eb4-b51a-44ee-89d9-992b476307e4 tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Calling method '.version_select at 0x7fbb2f8c1670>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:38.814834 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f1826eb4-b51a-44ee-89d9-992b476307e4 tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:38.820482 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f1826eb4-b51a-44ee-89d9-992b476307e4 tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:38.822626 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f1826eb4-b51a-44ee-89d9-992b476307e4 tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:38.835588 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-f1826eb4-b51a-44ee-89d9-992b476307e4 tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] 10.222.0.43 "GET /compute/v2.1/os-migrations" status: 200 len: 1568 microversion: 2.1 time: 0.038138 Oct 04 21:46:38.836912 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 451/893] 10.222.0.43 () {58 vars in 1143 bytes} [Tue Oct 4 21:46:38 2022] GET /compute/v2.1/os-migrations => generated 1568 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:38.847522 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-58e74853-511e-414c-9132-006876f9d78d tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:38.848391 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-58e74853-511e-414c-9132-006876f9d78d tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] [instance: 7512d9d6-ab41-453e-bb9d-8e0861aa37f7] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:38.855352 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-58e74853-511e-414c-9132-006876f9d78d tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:38.855850 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-58e74853-511e-414c-9132-006876f9d78d tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:38.856282 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-58e74853-511e-414c-9132-006876f9d78d tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:38.857211 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-58e74853-511e-414c-9132-006876f9d78d tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:38.857908 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-58e74853-511e-414c-9132-006876f9d78d tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:38.858697 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-58e74853-511e-414c-9132-006876f9d78d tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:38.864392 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-c6b3fd45-0da3-4607-baca-9d0184b1b080 tempest-ServersAdminTestJSON-717699517 tempest-ServersAdminTestJSON-717699517-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.416706 Oct 04 21:46:38.865450 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 443/894] 10.222.0.43 () {58 vars in 1146 bytes} [Tue Oct 4 21:46:38 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 21:46:38.874212 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-d587229a-96be-459a-8240-23d2979b7d16 req-6bdc4b49-e9fd-4c66-a710-b07746d0dfa0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7512d9d6-ab41-453e-bb9d-8e0861aa37f7", "tag": "330dc731-c16a-47f0-a849-93d182a330a4"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:46:38.880397 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=100 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:46:38.898640 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-d587229a-96be-459a-8240-23d2979b7d16 req-6bdc4b49-e9fd-4c66-a710-b07746d0dfa0 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:38.899173 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-d587229a-96be-459a-8240-23d2979b7d16 req-6bdc4b49-e9fd-4c66-a710-b07746d0dfa0 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:38.899674 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-d587229a-96be-459a-8240-23d2979b7d16 req-6bdc4b49-e9fd-4c66-a710-b07746d0dfa0 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:38.922033 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-d587229a-96be-459a-8240-23d2979b7d16 req-6bdc4b49-e9fd-4c66-a710-b07746d0dfa0 service nova] Creating event network-changed:330dc731-c16a-47f0-a849-93d182a330a4 for instance 7512d9d6-ab41-453e-bb9d-8e0861aa37f7 on n-h2-860284-1 Oct 04 21:46:38.927924 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-d587229a-96be-459a-8240-23d2979b7d16 req-6bdc4b49-e9fd-4c66-a710-b07746d0dfa0 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059808 Oct 04 21:46:38.929685 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 444/895] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:46:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:46:38.937774 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-c23541c7-f51f-4f03-b1f6-cc37353cb323 tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:38.938556 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-c23541c7-f51f-4f03-b1f6-cc37353cb323 tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] [instance: 10062905-54d7-47e2-b621-522e0954b72b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:38.945739 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:46:38.948122 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c23541c7-f51f-4f03-b1f6-cc37353cb323 tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:38.948741 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c23541c7-f51f-4f03-b1f6-cc37353cb323 tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:38.949219 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c23541c7-f51f-4f03-b1f6-cc37353cb323 tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:38.950012 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c23541c7-f51f-4f03-b1f6-cc37353cb323 tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:38.950522 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c23541c7-f51f-4f03-b1f6-cc37353cb323 tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:38.950949 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c23541c7-f51f-4f03-b1f6-cc37353cb323 tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:39.285186 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-58e74853-511e-414c-9132-006876f9d78d tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:39.302065 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-58e74853-511e-414c-9132-006876f9d78d tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:39.304244 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-58e74853-511e-414c-9132-006876f9d78d tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:39.305479 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-58e74853-511e-414c-9132-006876f9d78d tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] 10.222.0.43 "GET /compute/v2.1/servers/7512d9d6-ab41-453e-bb9d-8e0861aa37f7" status: 200 len: 1362 microversion: 2.25 time: 0.467377 Oct 04 21:46:39.306054 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 452/896] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:46:38 2022] GET /compute/v2.1/servers/7512d9d6-ab41-453e-bb9d-8e0861aa37f7 => generated 1362 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:46:39.328611 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-046a8f86-6789-4dc7-882d-18549e75d3ea tempest-ServersAdminTestJSON-717699517 tempest-ServersAdminTestJSON-717699517-project-admin] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:39.337488 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-046a8f86-6789-4dc7-882d-18549e75d3ea tempest-ServersAdminTestJSON-717699517 tempest-ServersAdminTestJSON-717699517-project-admin] Searching by: {'deleted': False} {{(pid=134102) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 21:46:39.344775 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-046a8f86-6789-4dc7-882d-18549e75d3ea tempest-ServersAdminTestJSON-717699517 tempest-ServersAdminTestJSON-717699517-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:39.345580 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-046a8f86-6789-4dc7-882d-18549e75d3ea tempest-ServersAdminTestJSON-717699517 tempest-ServersAdminTestJSON-717699517-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:39.346209 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-046a8f86-6789-4dc7-882d-18549e75d3ea tempest-ServersAdminTestJSON-717699517 tempest-ServersAdminTestJSON-717699517-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:39.347178 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-046a8f86-6789-4dc7-882d-18549e75d3ea tempest-ServersAdminTestJSON-717699517 tempest-ServersAdminTestJSON-717699517-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:39.348148 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-046a8f86-6789-4dc7-882d-18549e75d3ea tempest-ServersAdminTestJSON-717699517 tempest-ServersAdminTestJSON-717699517-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:39.348696 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-046a8f86-6789-4dc7-882d-18549e75d3ea tempest-ServersAdminTestJSON-717699517 tempest-ServersAdminTestJSON-717699517-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:39.354806 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-c23541c7-f51f-4f03-b1f6-cc37353cb323 tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/10062905-54d7-47e2-b621-522e0954b72b" status: 200 len: 1644 microversion: 2.1 time: 0.419379 Oct 04 21:46:39.369505 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 445/897] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:38 2022] GET /compute/v2.1/servers/10062905-54d7-47e2-b621-522e0954b72b => generated 1644 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:39.384877 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-db538317-cb65-48c5-b271-c185b65c85ec tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:39.385800 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-db538317-cb65-48c5-b271-c185b65c85ec tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] [instance: 663b2cc6-7a55-406a-b56f-86047b0e514d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:39.405785 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-db538317-cb65-48c5-b271-c185b65c85ec tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:39.406683 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-db538317-cb65-48c5-b271-c185b65c85ec tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:39.407312 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-db538317-cb65-48c5-b271-c185b65c85ec tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:39.409018 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-db538317-cb65-48c5-b271-c185b65c85ec tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:39.410135 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-db538317-cb65-48c5-b271-c185b65c85ec tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:39.410792 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-db538317-cb65-48c5-b271-c185b65c85ec tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:39.501178 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.multi_cell_list [None req-046a8f86-6789-4dc7-882d-18549e75d3ea tempest-ServersAdminTestJSON-717699517 tempest-ServersAdminTestJSON-717699517-project-admin] Listed batch of 19 results from cell out of 1000 limit. Returned 19 total so far. {{(pid=134102) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 21:46:39.602166 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:46:39.615683 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-046a8f86-6789-4dc7-882d-18549e75d3ea tempest-ServersAdminTestJSON-717699517 tempest-ServersAdminTestJSON-717699517-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:39.616013 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-046a8f86-6789-4dc7-882d-18549e75d3ea tempest-ServersAdminTestJSON-717699517 tempest-ServersAdminTestJSON-717699517-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:39.616755 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-046a8f86-6789-4dc7-882d-18549e75d3ea tempest-ServersAdminTestJSON-717699517 tempest-ServersAdminTestJSON-717699517-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:39.899598 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-db538317-cb65-48c5-b271-c185b65c85ec tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29842a669a20408b881105135f76cb0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39edf587afe94b60911198aa0bb61613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:39.913996 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-db538317-cb65-48c5-b271-c185b65c85ec tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] 10.222.0.43 "GET /compute/v2.1/servers/663b2cc6-7a55-406a-b56f-86047b0e514d" status: 200 len: 1286 microversion: 2.1 time: 0.541657 Oct 04 21:46:39.928615 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 446/898] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:39 2022] GET /compute/v2.1/servers/663b2cc6-7a55-406a-b56f-86047b0e514d => generated 1286 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:39.928615 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-10ad9ee2-6d37-47ca-b8f2-057e5ab4ee1b tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:39.928615 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-10ad9ee2-6d37-47ca-b8f2-057e5ab4ee1b tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: 424a22f0-ccc3-4fec-bf38-4aaf924928e3] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:39.931622 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-10ad9ee2-6d37-47ca-b8f2-057e5ab4ee1b tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:39.932134 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-10ad9ee2-6d37-47ca-b8f2-057e5ab4ee1b tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:39.932572 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-10ad9ee2-6d37-47ca-b8f2-057e5ab4ee1b tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:39.933489 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-10ad9ee2-6d37-47ca-b8f2-057e5ab4ee1b tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:39.933944 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-10ad9ee2-6d37-47ca-b8f2-057e5ab4ee1b tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:39.934404 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-10ad9ee2-6d37-47ca-b8f2-057e5ab4ee1b tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:40.121591 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-10ad9ee2-6d37-47ca-b8f2-057e5ab4ee1b tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:40.139463 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-10ad9ee2-6d37-47ca-b8f2-057e5ab4ee1b tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/424a22f0-ccc3-4fec-bf38-4aaf924928e3" status: 200 len: 1330 microversion: 2.1 time: 0.222794 Oct 04 21:46:40.150869 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 447/899] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:39 2022] GET /compute/v2.1/servers/424a22f0-ccc3-4fec-bf38-4aaf924928e3 => generated 1330 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:40.150869 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-1c2c060f-a206-4e69-b227-851ff6d85bc3 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1294044041", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452", "networks": [{"uuid": "7c037080-0b8b-4757-a710-31df9b3a21f4"}]}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:46:40.273014 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.network.neutron [None req-1c2c060f-a206-4e69-b227-851ff6d85bc3 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] validate_networks() for [('7c037080-0b8b-4757-a710-31df9b3a21f4', None, None, None, None, None)] {{(pid=134101) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:46:40.707301 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-046a8f86-6789-4dc7-882d-18549e75d3ea tempest-ServersAdminTestJSON-717699517 tempest-ServersAdminTestJSON-717699517-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 30287 microversion: 2.1 time: 1.383480 Oct 04 21:46:40.708364 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 453/900] 10.222.0.43 () {58 vars in 1171 bytes} [Tue Oct 4 21:46:39 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 30287 bytes in 1385 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:46:40.713660 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-1d084d71-2286-4bbd-a64a-11e5e4b82faf tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:40.714296 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-1d084d71-2286-4bbd-a64a-11e5e4b82faf tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] [instance: 34276621-d087-478b-81c7-bdf5e38efc69] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:40.731734 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1d084d71-2286-4bbd-a64a-11e5e4b82faf tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:40.732236 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1d084d71-2286-4bbd-a64a-11e5e4b82faf tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:40.732681 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1d084d71-2286-4bbd-a64a-11e5e4b82faf tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:40.733408 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1d084d71-2286-4bbd-a64a-11e5e4b82faf tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:40.734030 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1d084d71-2286-4bbd-a64a-11e5e4b82faf tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:40.734669 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1d084d71-2286-4bbd-a64a-11e5e4b82faf tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:41.167788 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-1d084d71-2286-4bbd-a64a-11e5e4b82faf tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1789bb97219a4e1591632126812ea6df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da67fc95e2814f4086df020f4c475764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:41.180368 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-1d084d71-2286-4bbd-a64a-11e5e4b82faf tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] 10.222.0.43 "GET /compute/v2.1/servers/34276621-d087-478b-81c7-bdf5e38efc69" status: 200 len: 1389 microversion: 2.1 time: 0.470235 Oct 04 21:46:41.180997 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 454/901] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:40 2022] GET /compute/v2.1/servers/34276621-d087-478b-81c7-bdf5e38efc69 => generated 1389 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:41.186584 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-610201ce-799d-4883-a572-3746971c7c92 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:41.205118 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-610201ce-799d-4883-a572-3746971c7c92 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] [instance: 7512d9d6-ab41-453e-bb9d-8e0861aa37f7] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:41.212640 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-610201ce-799d-4883-a572-3746971c7c92 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:41.217523 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-610201ce-799d-4883-a572-3746971c7c92 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:41.219188 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-610201ce-799d-4883-a572-3746971c7c92 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:41.223513 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-610201ce-799d-4883-a572-3746971c7c92 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:41.224167 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-610201ce-799d-4883-a572-3746971c7c92 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:41.229666 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-610201ce-799d-4883-a572-3746971c7c92 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:41.478567 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-1c2c060f-a206-4e69-b227-851ff6d85bc3 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Flavor limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:46:41.479157 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-1c2c060f-a206-4e69-b227-851ff6d85bc3 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Image limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:46:41.479577 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-1c2c060f-a206-4e69-b227-851ff6d85bc3 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Flavor pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:46:41.480060 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-1c2c060f-a206-4e69-b227-851ff6d85bc3 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Image pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:46:41.480575 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-1c2c060f-a206-4e69-b227-851ff6d85bc3 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:46:41.492520 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1c2c060f-a206-4e69-b227-851ff6d85bc3 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:41.493166 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1c2c060f-a206-4e69-b227-851ff6d85bc3 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:41.493674 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1c2c060f-a206-4e69-b227-851ff6d85bc3 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:41.494552 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1c2c060f-a206-4e69-b227-851ff6d85bc3 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:41.495123 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1c2c060f-a206-4e69-b227-851ff6d85bc3 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:41.495649 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1c2c060f-a206-4e69-b227-851ff6d85bc3 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:41.518303 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-1c2c060f-a206-4e69-b227-851ff6d85bc3 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Getting quotas for project 78dcfc7024fc49388c4bd5f25f03e60d. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:46:41.525360 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-1c2c060f-a206-4e69-b227-851ff6d85bc3 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Getting quotas for user bb7ad048becf474fb972d4291422d810 and project 78dcfc7024fc49388c4bd5f25f03e60d. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:46:41.541389 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-1c2c060f-a206-4e69-b227-851ff6d85bc3 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Going to run 1 instances... {{(pid=134101) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:46:41.544957 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-1c2c060f-a206-4e69-b227-851ff6d85bc3 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 4e8281d2-9de4-42eb-94cc-417be864315d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='58548514-5dac-426c-81f5-19e3fba33e23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134101) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:46:41.545505 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-610201ce-799d-4883-a572-3746971c7c92 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:41.561520 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-610201ce-799d-4883-a572-3746971c7c92 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:41.565261 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-610201ce-799d-4883-a572-3746971c7c92 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:41.566829 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-610201ce-799d-4883-a572-3746971c7c92 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] 10.222.0.43 "GET /compute/v2.1/servers/7512d9d6-ab41-453e-bb9d-8e0861aa37f7" status: 200 len: 1362 microversion: 2.25 time: 0.384017 Oct 04 21:46:41.569253 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 455/902] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:46:41 2022] GET /compute/v2.1/servers/7512d9d6-ab41-453e-bb9d-8e0861aa37f7 => generated 1362 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:46:41.574694 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-a233959a-c916-46d1-a5a3-0e74dad90564 tempest-ServersAdminTestJSON-717699517 tempest-ServersAdminTestJSON-717699517-project-admin] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:41.581691 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-a233959a-c916-46d1-a5a3-0e74dad90564 tempest-ServersAdminTestJSON-717699517 tempest-ServersAdminTestJSON-717699517-project-admin] Searching by: {'deleted': False, 'project_id': '934352511a4c4c63a9fa12e2a6f5c561'} {{(pid=134102) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 21:46:41.591575 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a233959a-c916-46d1-a5a3-0e74dad90564 tempest-ServersAdminTestJSON-717699517 tempest-ServersAdminTestJSON-717699517-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:41.592505 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a233959a-c916-46d1-a5a3-0e74dad90564 tempest-ServersAdminTestJSON-717699517 tempest-ServersAdminTestJSON-717699517-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:41.593445 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a233959a-c916-46d1-a5a3-0e74dad90564 tempest-ServersAdminTestJSON-717699517 tempest-ServersAdminTestJSON-717699517-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:41.594979 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a233959a-c916-46d1-a5a3-0e74dad90564 tempest-ServersAdminTestJSON-717699517 tempest-ServersAdminTestJSON-717699517-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:41.595986 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a233959a-c916-46d1-a5a3-0e74dad90564 tempest-ServersAdminTestJSON-717699517 tempest-ServersAdminTestJSON-717699517-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:41.596724 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a233959a-c916-46d1-a5a3-0e74dad90564 tempest-ServersAdminTestJSON-717699517 tempest-ServersAdminTestJSON-717699517-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:41.623620 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-1c2c060f-a206-4e69-b227-851ff6d85bc3 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.481819 Oct 04 21:46:41.630758 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 448/903] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 21:46:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 1490 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:46:41.636207 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-679a2d2e-c790-4bf2-8080-0ca9869bcfb3 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:41.636819 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-679a2d2e-c790-4bf2-8080-0ca9869bcfb3 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] [instance: 663b2cc6-7a55-406a-b56f-86047b0e514d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:41.644783 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-679a2d2e-c790-4bf2-8080-0ca9869bcfb3 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:41.645508 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-679a2d2e-c790-4bf2-8080-0ca9869bcfb3 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:41.646108 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-679a2d2e-c790-4bf2-8080-0ca9869bcfb3 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:41.648545 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-679a2d2e-c790-4bf2-8080-0ca9869bcfb3 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:41.649185 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-679a2d2e-c790-4bf2-8080-0ca9869bcfb3 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:41.649778 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-679a2d2e-c790-4bf2-8080-0ca9869bcfb3 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:41.735727 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-a233959a-c916-46d1-a5a3-0e74dad90564 tempest-ServersAdminTestJSON-717699517 tempest-ServersAdminTestJSON-717699517-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/detail?tenant_id=a1e3bf9149434d34b6762aaeef1478ed" status: 200 len: 15 microversion: 2.1 time: 0.164583 Oct 04 21:46:41.742466 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 456/904] 10.222.0.43 () {58 vars in 1231 bytes} [Tue Oct 4 21:46:41 2022] GET /compute/v2.1/servers/detail?tenant_id=a1e3bf9149434d34b6762aaeef1478ed => generated 15 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 21:46:41.748110 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-b51084b4-ca8d-4ae5-928f-73f0e6f4d29d tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:41.749044 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-b51084b4-ca8d-4ae5-928f-73f0e6f4d29d tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: 424a22f0-ccc3-4fec-bf38-4aaf924928e3] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:41.755950 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b51084b4-ca8d-4ae5-928f-73f0e6f4d29d tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:41.756786 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b51084b4-ca8d-4ae5-928f-73f0e6f4d29d tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:41.758558 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b51084b4-ca8d-4ae5-928f-73f0e6f4d29d tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:41.763159 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b51084b4-ca8d-4ae5-928f-73f0e6f4d29d tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:41.767206 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b51084b4-ca8d-4ae5-928f-73f0e6f4d29d tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:41.770051 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b51084b4-ca8d-4ae5-928f-73f0e6f4d29d tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:41.779801 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-679a2d2e-c790-4bf2-8080-0ca9869bcfb3 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29842a669a20408b881105135f76cb0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39edf587afe94b60911198aa0bb61613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:41.794067 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-679a2d2e-c790-4bf2-8080-0ca9869bcfb3 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] 10.222.0.43 "GET /compute/v2.1/servers/663b2cc6-7a55-406a-b56f-86047b0e514d" status: 200 len: 1274 microversion: 2.1 time: 0.160738 Oct 04 21:46:41.802155 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 449/905] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:41 2022] GET /compute/v2.1/servers/663b2cc6-7a55-406a-b56f-86047b0e514d => generated 1274 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:41.816690 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-ddf1a2aa-ad29-40c3-a375-4369a91e4271 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:41.819424 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-ddf1a2aa-ad29-40c3-a375-4369a91e4271 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 4e8281d2-9de4-42eb-94cc-417be864315d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:41.957693 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-b51084b4-ca8d-4ae5-928f-73f0e6f4d29d tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:41.972602 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-b51084b4-ca8d-4ae5-928f-73f0e6f4d29d tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/424a22f0-ccc3-4fec-bf38-4aaf924928e3" status: 200 len: 1330 microversion: 2.1 time: 0.228631 Oct 04 21:46:41.976825 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 457/906] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:41 2022] GET /compute/v2.1/servers/424a22f0-ccc3-4fec-bf38-4aaf924928e3 => generated 1330 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:42.007113 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-86e38a4d-af80-4568-afef-92995b3f3fbb tempest-ServersAdminTestJSON-717699517 tempest-ServersAdminTestJSON-717699517-project-admin] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:42.016390 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-ddf1a2aa-ad29-40c3-a375-4369a91e4271 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ad048becf474fb972d4291422d810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dcfc7024fc49388c4bd5f25f03e60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:42.017194 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-86e38a4d-af80-4568-afef-92995b3f3fbb tempest-ServersAdminTestJSON-717699517 tempest-ServersAdminTestJSON-717699517-project-admin] Searching by: {'tenant_id': 'a1e3bf9149434d34b6762aaeef1478ed', 'deleted': False} {{(pid=134102) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 21:46:42.027924 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-ddf1a2aa-ad29-40c3-a375-4369a91e4271 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/4e8281d2-9de4-42eb-94cc-417be864315d" status: 200 len: 1211 microversion: 2.1 time: 0.222482 Oct 04 21:46:42.036472 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-86e38a4d-af80-4568-afef-92995b3f3fbb tempest-ServersAdminTestJSON-717699517 tempest-ServersAdminTestJSON-717699517-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:42.037699 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-86e38a4d-af80-4568-afef-92995b3f3fbb tempest-ServersAdminTestJSON-717699517 tempest-ServersAdminTestJSON-717699517-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:42.038486 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-86e38a4d-af80-4568-afef-92995b3f3fbb tempest-ServersAdminTestJSON-717699517 tempest-ServersAdminTestJSON-717699517-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:42.039869 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-86e38a4d-af80-4568-afef-92995b3f3fbb tempest-ServersAdminTestJSON-717699517 tempest-ServersAdminTestJSON-717699517-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:42.041563 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-86e38a4d-af80-4568-afef-92995b3f3fbb tempest-ServersAdminTestJSON-717699517 tempest-ServersAdminTestJSON-717699517-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:42.042955 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-86e38a4d-af80-4568-afef-92995b3f3fbb tempest-ServersAdminTestJSON-717699517 tempest-ServersAdminTestJSON-717699517-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:42.049080 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 450/907] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:41 2022] GET /compute/v2.1/servers/4e8281d2-9de4-42eb-94cc-417be864315d => generated 1211 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:42.088850 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.multi_cell_list [None req-86e38a4d-af80-4568-afef-92995b3f3fbb tempest-ServersAdminTestJSON-717699517 tempest-ServersAdminTestJSON-717699517-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=134102) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 21:46:42.206102 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-3b632ed5-9f7e-4fa5-bf9f-56206638710a tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:42.206765 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-3b632ed5-9f7e-4fa5-bf9f-56206638710a tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] [instance: 34276621-d087-478b-81c7-bdf5e38efc69] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:42.220229 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-86e38a4d-af80-4568-afef-92995b3f3fbb tempest-ServersAdminTestJSON-717699517 tempest-ServersAdminTestJSON-717699517-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:42.220731 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-86e38a4d-af80-4568-afef-92995b3f3fbb tempest-ServersAdminTestJSON-717699517 tempest-ServersAdminTestJSON-717699517-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:42.226946 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-86e38a4d-af80-4568-afef-92995b3f3fbb tempest-ServersAdminTestJSON-717699517 tempest-ServersAdminTestJSON-717699517-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:42.261879 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3b632ed5-9f7e-4fa5-bf9f-56206638710a tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:42.262475 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3b632ed5-9f7e-4fa5-bf9f-56206638710a tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:42.262971 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3b632ed5-9f7e-4fa5-bf9f-56206638710a tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:42.266914 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3b632ed5-9f7e-4fa5-bf9f-56206638710a tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:42.267503 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3b632ed5-9f7e-4fa5-bf9f-56206638710a tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:42.267953 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3b632ed5-9f7e-4fa5-bf9f-56206638710a tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:42.314805 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=100 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:46:42.463354 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-86e38a4d-af80-4568-afef-92995b3f3fbb tempest-ServersAdminTestJSON-717699517 tempest-ServersAdminTestJSON-717699517-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=a1e3bf9149434d34b6762aaeef1478ed" status: 200 len: 4824 microversion: 2.1 time: 0.485192 Oct 04 21:46:42.463983 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 458/908] 10.222.0.43 () {58 vars in 1257 bytes} [Tue Oct 4 21:46:41 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=a1e3bf9149434d34b6762aaeef1478ed => generated 4824 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:42.491266 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-f857fbb7-34ea-4c0c-8432-0b34797b6fce tempest-ServersAdminTestJSON-717699517 tempest-ServersAdminTestJSON-717699517-project-admin] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:42.497479 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-f857fbb7-34ea-4c0c-8432-0b34797b6fce tempest-ServersAdminTestJSON-717699517 tempest-ServersAdminTestJSON-717699517-project-admin] Searching by: {'tenant_id': '934352511a4c4c63a9fa12e2a6f5c561', 'deleted': False} {{(pid=134102) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 21:46:42.509751 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f857fbb7-34ea-4c0c-8432-0b34797b6fce tempest-ServersAdminTestJSON-717699517 tempest-ServersAdminTestJSON-717699517-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:42.514354 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f857fbb7-34ea-4c0c-8432-0b34797b6fce tempest-ServersAdminTestJSON-717699517 tempest-ServersAdminTestJSON-717699517-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:42.514836 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f857fbb7-34ea-4c0c-8432-0b34797b6fce tempest-ServersAdminTestJSON-717699517 tempest-ServersAdminTestJSON-717699517-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:42.515608 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f857fbb7-34ea-4c0c-8432-0b34797b6fce tempest-ServersAdminTestJSON-717699517 tempest-ServersAdminTestJSON-717699517-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:42.516062 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f857fbb7-34ea-4c0c-8432-0b34797b6fce tempest-ServersAdminTestJSON-717699517 tempest-ServersAdminTestJSON-717699517-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:42.516494 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f857fbb7-34ea-4c0c-8432-0b34797b6fce tempest-ServersAdminTestJSON-717699517 tempest-ServersAdminTestJSON-717699517-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:42.556555 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-3b632ed5-9f7e-4fa5-bf9f-56206638710a tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1789bb97219a4e1591632126812ea6df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da67fc95e2814f4086df020f4c475764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:42.566582 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-3b632ed5-9f7e-4fa5-bf9f-56206638710a tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] 10.222.0.43 "GET /compute/v2.1/servers/34276621-d087-478b-81c7-bdf5e38efc69" status: 200 len: 1389 microversion: 2.1 time: 0.365588 Oct 04 21:46:42.567441 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 451/909] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:42 2022] GET /compute/v2.1/servers/34276621-d087-478b-81c7-bdf5e38efc69 => generated 1389 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:42.577700 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-f857fbb7-34ea-4c0c-8432-0b34797b6fce tempest-ServersAdminTestJSON-717699517 tempest-ServersAdminTestJSON-717699517-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=934352511a4c4c63a9fa12e2a6f5c561" status: 200 len: 15 microversion: 2.1 time: 0.090688 Oct 04 21:46:42.578382 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 459/910] 10.222.0.43 () {58 vars in 1257 bytes} [Tue Oct 4 21:46:42 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=934352511a4c4c63a9fa12e2a6f5c561 => generated 15 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 21:46:42.603281 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-0155ed64-3bec-4901-ad47-63b68b309875 tempest-ServersAdminTestJSON-717699517 tempest-ServersAdminTestJSON-717699517-project-admin] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:42.608363 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-8a380d5f-b6f8-40f7-8a6b-3693c956370d tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:42.609676 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-8a380d5f-b6f8-40f7-8a6b-3693c956370d tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] [instance: 7512d9d6-ab41-453e-bb9d-8e0861aa37f7] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:42.610994 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-0155ed64-3bec-4901-ad47-63b68b309875 tempest-ServersAdminTestJSON-717699517 tempest-ServersAdminTestJSON-717699517-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.012224 Oct 04 21:46:42.611549 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 452/911] 10.222.0.43 () {58 vars in 1189 bytes} [Tue Oct 4 21:46:42 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 21:46:42.617848 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8a380d5f-b6f8-40f7-8a6b-3693c956370d tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:42.618346 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8a380d5f-b6f8-40f7-8a6b-3693c956370d tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:42.618920 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8a380d5f-b6f8-40f7-8a6b-3693c956370d tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:42.619649 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8a380d5f-b6f8-40f7-8a6b-3693c956370d tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:42.620139 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8a380d5f-b6f8-40f7-8a6b-3693c956370d tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:42.620592 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8a380d5f-b6f8-40f7-8a6b-3693c956370d tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:42.643546 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-f68a19f0-cb2c-4f9c-bb25-226921770eef tempest-ServersAdminTestJSON-717699517 tempest-ServersAdminTestJSON-717699517-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:46:42.646430 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-f68a19f0-cb2c-4f9c-bb25-226921770eef tempest-ServersAdminTestJSON-717699517 tempest-ServersAdminTestJSON-717699517-project-admin] [instance: e3380b36-6aba-4736-bcbc-f0058f806d55] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:42.654430 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f68a19f0-cb2c-4f9c-bb25-226921770eef tempest-ServersAdminTestJSON-717699517 tempest-ServersAdminTestJSON-717699517-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:42.655351 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f68a19f0-cb2c-4f9c-bb25-226921770eef tempest-ServersAdminTestJSON-717699517 tempest-ServersAdminTestJSON-717699517-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:42.656612 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f68a19f0-cb2c-4f9c-bb25-226921770eef tempest-ServersAdminTestJSON-717699517 tempest-ServersAdminTestJSON-717699517-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:42.658350 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f68a19f0-cb2c-4f9c-bb25-226921770eef tempest-ServersAdminTestJSON-717699517 tempest-ServersAdminTestJSON-717699517-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:42.659146 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f68a19f0-cb2c-4f9c-bb25-226921770eef tempest-ServersAdminTestJSON-717699517 tempest-ServersAdminTestJSON-717699517-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:42.659822 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f68a19f0-cb2c-4f9c-bb25-226921770eef tempest-ServersAdminTestJSON-717699517 tempest-ServersAdminTestJSON-717699517-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:42.790279 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-f68a19f0-cb2c-4f9c-bb25-226921770eef tempest-ServersAdminTestJSON-717699517 tempest-ServersAdminTestJSON-717699517-project-admin] 10.222.0.43 "POST /compute/v2.1/servers/e3380b36-6aba-4736-bcbc-f0058f806d55/action" status: 202 len: 0 microversion: 2.1 time: 0.152927 Oct 04 21:46:42.791139 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 453/912] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 21:46:42 2022] POST /compute/v2.1/servers/e3380b36-6aba-4736-bcbc-f0058f806d55/action => generated 0 bytes in 155 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:46:42.799787 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-a5d691cf-d324-4fe8-a646-d49653e9f0c3 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:42.811461 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-a5d691cf-d324-4fe8-a646-d49653e9f0c3 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '87616cd16995468ab7febf5aa4b284db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e3bf9149434d34b6762aaeef1478ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:42.813208 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-a5d691cf-d324-4fe8-a646-d49653e9f0c3 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': 'a1e3bf9149434d34b6762aaeef1478ed'} {{(pid=134101) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 21:46:42.825863 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a5d691cf-d324-4fe8-a646-d49653e9f0c3 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:42.826984 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a5d691cf-d324-4fe8-a646-d49653e9f0c3 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:42.827521 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a5d691cf-d324-4fe8-a646-d49653e9f0c3 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:42.828498 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a5d691cf-d324-4fe8-a646-d49653e9f0c3 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:42.829160 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a5d691cf-d324-4fe8-a646-d49653e9f0c3 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:42.829803 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a5d691cf-d324-4fe8-a646-d49653e9f0c3 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:42.842838 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-8a380d5f-b6f8-40f7-8a6b-3693c956370d tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:42.852760 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-8a380d5f-b6f8-40f7-8a6b-3693c956370d tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:42.854419 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-8a380d5f-b6f8-40f7-8a6b-3693c956370d tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:42.855484 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-8a380d5f-b6f8-40f7-8a6b-3693c956370d tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] 10.222.0.43 "GET /compute/v2.1/servers/7512d9d6-ab41-453e-bb9d-8e0861aa37f7" status: 200 len: 1362 microversion: 2.25 time: 0.256679 Oct 04 21:46:42.858875 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 460/913] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:46:42 2022] GET /compute/v2.1/servers/7512d9d6-ab41-453e-bb9d-8e0861aa37f7 => generated 1362 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:46:42.863961 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-0bd29b62-4c7f-46c1-9c9a-8bb340df325d tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:42.864756 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-0bd29b62-4c7f-46c1-9c9a-8bb340df325d tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] [instance: 663b2cc6-7a55-406a-b56f-86047b0e514d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:42.871608 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0bd29b62-4c7f-46c1-9c9a-8bb340df325d tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:42.872344 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0bd29b62-4c7f-46c1-9c9a-8bb340df325d tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:42.872813 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0bd29b62-4c7f-46c1-9c9a-8bb340df325d tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:42.873672 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0bd29b62-4c7f-46c1-9c9a-8bb340df325d tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:42.874335 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0bd29b62-4c7f-46c1-9c9a-8bb340df325d tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:42.874930 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0bd29b62-4c7f-46c1-9c9a-8bb340df325d tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:42.955283 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.multi_cell_list [None req-a5d691cf-d324-4fe8-a646-d49653e9f0c3 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=134101) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 21:46:43.034835 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-a5d691cf-d324-4fe8-a646-d49653e9f0c3 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] 10.222.0.43 "GET /compute/v2.1/servers?status=error" status: 200 len: 339 microversion: 2.1 time: 0.238795 Oct 04 21:46:43.036264 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 454/914] 10.222.0.43 () {58 vars in 1150 bytes} [Tue Oct 4 21:46:42 2022] GET /compute/v2.1/servers?status=error => generated 339 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:46:43.041580 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-7741e502-28ae-4168-a4c5-56e6c498d9b1 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:43.042606 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-7741e502-28ae-4168-a4c5-56e6c498d9b1 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: 424a22f0-ccc3-4fec-bf38-4aaf924928e3] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:43.049598 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7741e502-28ae-4168-a4c5-56e6c498d9b1 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:43.050439 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7741e502-28ae-4168-a4c5-56e6c498d9b1 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:43.051236 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7741e502-28ae-4168-a4c5-56e6c498d9b1 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:43.052405 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7741e502-28ae-4168-a4c5-56e6c498d9b1 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:43.053780 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7741e502-28ae-4168-a4c5-56e6c498d9b1 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:43.054460 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7741e502-28ae-4168-a4c5-56e6c498d9b1 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:43.087507 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-0bd29b62-4c7f-46c1-9c9a-8bb340df325d tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29842a669a20408b881105135f76cb0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39edf587afe94b60911198aa0bb61613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:43.099353 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-0bd29b62-4c7f-46c1-9c9a-8bb340df325d tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] 10.222.0.43 "GET /compute/v2.1/servers/663b2cc6-7a55-406a-b56f-86047b0e514d" status: 200 len: 1316 microversion: 2.1 time: 0.239209 Oct 04 21:46:43.100174 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 461/915] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:42 2022] GET /compute/v2.1/servers/663b2cc6-7a55-406a-b56f-86047b0e514d => generated 1316 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:43.106801 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-d54a692d-847a-41e8-aedf-7ea329121680 tempest-ServersAdminTestJSON-717699517 tempest-ServersAdminTestJSON-717699517-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:46:43.110520 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-d54a692d-847a-41e8-aedf-7ea329121680 tempest-ServersAdminTestJSON-717699517 tempest-ServersAdminTestJSON-717699517-project-admin] [instance: e3380b36-6aba-4736-bcbc-f0058f806d55] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:43.120108 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d54a692d-847a-41e8-aedf-7ea329121680 tempest-ServersAdminTestJSON-717699517 tempest-ServersAdminTestJSON-717699517-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:43.120985 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d54a692d-847a-41e8-aedf-7ea329121680 tempest-ServersAdminTestJSON-717699517 tempest-ServersAdminTestJSON-717699517-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:43.123635 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d54a692d-847a-41e8-aedf-7ea329121680 tempest-ServersAdminTestJSON-717699517 tempest-ServersAdminTestJSON-717699517-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:43.125573 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d54a692d-847a-41e8-aedf-7ea329121680 tempest-ServersAdminTestJSON-717699517 tempest-ServersAdminTestJSON-717699517-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:43.126191 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d54a692d-847a-41e8-aedf-7ea329121680 tempest-ServersAdminTestJSON-717699517 tempest-ServersAdminTestJSON-717699517-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:43.128438 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d54a692d-847a-41e8-aedf-7ea329121680 tempest-ServersAdminTestJSON-717699517 tempest-ServersAdminTestJSON-717699517-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:43.148811 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-7741e502-28ae-4168-a4c5-56e6c498d9b1 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:43.165284 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-7741e502-28ae-4168-a4c5-56e6c498d9b1 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/424a22f0-ccc3-4fec-bf38-4aaf924928e3" status: 200 len: 1330 microversion: 2.1 time: 0.127289 Oct 04 21:46:43.166541 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 455/916] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:43 2022] GET /compute/v2.1/servers/424a22f0-ccc3-4fec-bf38-4aaf924928e3 => generated 1330 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:43.173187 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-862ca910-f748-431f-a189-664b07a5cc6a tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:43.173839 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-862ca910-f748-431f-a189-664b07a5cc6a tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 4e8281d2-9de4-42eb-94cc-417be864315d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:43.181740 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-862ca910-f748-431f-a189-664b07a5cc6a tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:43.182221 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-862ca910-f748-431f-a189-664b07a5cc6a tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:43.183174 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-862ca910-f748-431f-a189-664b07a5cc6a tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:43.184081 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-862ca910-f748-431f-a189-664b07a5cc6a tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:43.184873 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-862ca910-f748-431f-a189-664b07a5cc6a tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:43.185508 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-862ca910-f748-431f-a189-664b07a5cc6a tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:43.246421 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-d54a692d-847a-41e8-aedf-7ea329121680 tempest-ServersAdminTestJSON-717699517 tempest-ServersAdminTestJSON-717699517-project-admin] 10.222.0.43 "POST /compute/v2.1/servers/e3380b36-6aba-4736-bcbc-f0058f806d55/action" status: 202 len: 0 microversion: 2.1 time: 0.143725 Oct 04 21:46:43.251145 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 462/917] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 21:46:43 2022] POST /compute/v2.1/servers/e3380b36-6aba-4736-bcbc-f0058f806d55/action => generated 0 bytes in 150 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:46:43.259604 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-eb2bb036-52ea-4bc9-9dea-4c946123318e tempest-ServersAdminTestJSON-717699517 tempest-ServersAdminTestJSON-717699517-project-admin] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:43.260226 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-eb2bb036-52ea-4bc9-9dea-4c946123318e tempest-ServersAdminTestJSON-717699517 tempest-ServersAdminTestJSON-717699517-project-admin] [instance: e3380b36-6aba-4736-bcbc-f0058f806d55] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:43.267333 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-eb2bb036-52ea-4bc9-9dea-4c946123318e tempest-ServersAdminTestJSON-717699517 tempest-ServersAdminTestJSON-717699517-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:43.267989 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-eb2bb036-52ea-4bc9-9dea-4c946123318e tempest-ServersAdminTestJSON-717699517 tempest-ServersAdminTestJSON-717699517-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:43.268524 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-eb2bb036-52ea-4bc9-9dea-4c946123318e tempest-ServersAdminTestJSON-717699517 tempest-ServersAdminTestJSON-717699517-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:43.269312 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-eb2bb036-52ea-4bc9-9dea-4c946123318e tempest-ServersAdminTestJSON-717699517 tempest-ServersAdminTestJSON-717699517-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:43.270533 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-eb2bb036-52ea-4bc9-9dea-4c946123318e tempest-ServersAdminTestJSON-717699517 tempest-ServersAdminTestJSON-717699517-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:43.271308 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-eb2bb036-52ea-4bc9-9dea-4c946123318e tempest-ServersAdminTestJSON-717699517 tempest-ServersAdminTestJSON-717699517-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:43.280642 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-862ca910-f748-431f-a189-664b07a5cc6a tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ad048becf474fb972d4291422d810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dcfc7024fc49388c4bd5f25f03e60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:43.289772 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-862ca910-f748-431f-a189-664b07a5cc6a tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/4e8281d2-9de4-42eb-94cc-417be864315d" status: 200 len: 1263 microversion: 2.1 time: 0.121725 Oct 04 21:46:43.291070 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 456/918] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:43 2022] GET /compute/v2.1/servers/4e8281d2-9de4-42eb-94cc-417be864315d => generated 1263 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:43.413414 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-eb2bb036-52ea-4bc9-9dea-4c946123318e tempest-ServersAdminTestJSON-717699517 tempest-ServersAdminTestJSON-717699517-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/e3380b36-6aba-4736-bcbc-f0058f806d55" status: 200 len: 1614 microversion: 2.1 time: 0.152206 Oct 04 21:46:43.414034 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 463/919] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:43 2022] GET /compute/v2.1/servers/e3380b36-6aba-4736-bcbc-f0058f806d55 => generated 1614 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:43.436601 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-48ec1dcd-e78b-4e60-8ab5-1a03c803a059 tempest-ServersAdminTestJSON-717699517 tempest-ServersAdminTestJSON-717699517-project-admin] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:43.437328 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-48ec1dcd-e78b-4e60-8ab5-1a03c803a059 tempest-ServersAdminTestJSON-717699517 tempest-ServersAdminTestJSON-717699517-project-admin] [instance: e3380b36-6aba-4736-bcbc-f0058f806d55] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:43.443787 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-48ec1dcd-e78b-4e60-8ab5-1a03c803a059 tempest-ServersAdminTestJSON-717699517 tempest-ServersAdminTestJSON-717699517-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:43.444913 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-48ec1dcd-e78b-4e60-8ab5-1a03c803a059 tempest-ServersAdminTestJSON-717699517 tempest-ServersAdminTestJSON-717699517-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:43.445559 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-48ec1dcd-e78b-4e60-8ab5-1a03c803a059 tempest-ServersAdminTestJSON-717699517 tempest-ServersAdminTestJSON-717699517-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:43.446267 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-48ec1dcd-e78b-4e60-8ab5-1a03c803a059 tempest-ServersAdminTestJSON-717699517 tempest-ServersAdminTestJSON-717699517-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:43.446750 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-48ec1dcd-e78b-4e60-8ab5-1a03c803a059 tempest-ServersAdminTestJSON-717699517 tempest-ServersAdminTestJSON-717699517-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:43.447471 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-48ec1dcd-e78b-4e60-8ab5-1a03c803a059 tempest-ServersAdminTestJSON-717699517 tempest-ServersAdminTestJSON-717699517-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:43.595202 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-48ec1dcd-e78b-4e60-8ab5-1a03c803a059 tempest-ServersAdminTestJSON-717699517 tempest-ServersAdminTestJSON-717699517-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/e3380b36-6aba-4736-bcbc-f0058f806d55" status: 200 len: 1614 microversion: 2.1 time: 0.162121 Oct 04 21:46:43.596016 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 457/920] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:43 2022] GET /compute/v2.1/servers/e3380b36-6aba-4736-bcbc-f0058f806d55 => generated 1614 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:46:43.601129 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-3e942926-411e-4706-ba8f-c24c6053434c tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:43.601822 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-3e942926-411e-4706-ba8f-c24c6053434c tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] [instance: 34276621-d087-478b-81c7-bdf5e38efc69] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:43.608205 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3e942926-411e-4706-ba8f-c24c6053434c tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:43.609017 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3e942926-411e-4706-ba8f-c24c6053434c tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:43.609519 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3e942926-411e-4706-ba8f-c24c6053434c tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:43.610408 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3e942926-411e-4706-ba8f-c24c6053434c tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:43.611054 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3e942926-411e-4706-ba8f-c24c6053434c tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:43.611647 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3e942926-411e-4706-ba8f-c24c6053434c tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:43.682905 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-fb73a663-b88c-4889-bd0d-479c2513912f tempest-ImagesDeleteNegativeTestJSON-1558753180 tempest-ImagesDeleteNegativeTestJSON-1558753180-project] 10.222.0.43 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.145225 Oct 04 21:46:43.683845 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 464/921] 10.222.0.43 () {58 vars in 1128 bytes} [Tue Oct 4 21:46:43 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 04 21:46:43.696513 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-dbe59cf7-a0c1-4cfb-9005-cadd5b754b68 tempest-ServersAdminTestJSON-717699517 tempest-ServersAdminTestJSON-717699517-project-admin] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:43.706432 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-dbe59cf7-a0c1-4cfb-9005-cadd5b754b68 tempest-ServersAdminTestJSON-717699517 tempest-ServersAdminTestJSON-717699517-project-admin] Searching by: {'host': 'n-h2-860284-1', 'deleted': False} {{(pid=134102) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 21:46:43.715970 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dbe59cf7-a0c1-4cfb-9005-cadd5b754b68 tempest-ServersAdminTestJSON-717699517 tempest-ServersAdminTestJSON-717699517-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:43.716446 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dbe59cf7-a0c1-4cfb-9005-cadd5b754b68 tempest-ServersAdminTestJSON-717699517 tempest-ServersAdminTestJSON-717699517-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:43.716953 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dbe59cf7-a0c1-4cfb-9005-cadd5b754b68 tempest-ServersAdminTestJSON-717699517 tempest-ServersAdminTestJSON-717699517-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:43.717694 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dbe59cf7-a0c1-4cfb-9005-cadd5b754b68 tempest-ServersAdminTestJSON-717699517 tempest-ServersAdminTestJSON-717699517-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:43.718156 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dbe59cf7-a0c1-4cfb-9005-cadd5b754b68 tempest-ServersAdminTestJSON-717699517 tempest-ServersAdminTestJSON-717699517-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:43.718618 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dbe59cf7-a0c1-4cfb-9005-cadd5b754b68 tempest-ServersAdminTestJSON-717699517 tempest-ServersAdminTestJSON-717699517-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:43.777205 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-3e942926-411e-4706-ba8f-c24c6053434c tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1789bb97219a4e1591632126812ea6df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da67fc95e2814f4086df020f4c475764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:43.786125 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-3e942926-411e-4706-ba8f-c24c6053434c tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] 10.222.0.43 "GET /compute/v2.1/servers/34276621-d087-478b-81c7-bdf5e38efc69" status: 200 len: 1389 microversion: 2.1 time: 0.189141 Oct 04 21:46:43.798773 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 458/922] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:43 2022] GET /compute/v2.1/servers/34276621-d087-478b-81c7-bdf5e38efc69 => generated 1389 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:43.809470 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-eff010f1-0d75-4ef5-9c49-50856b895b34 tempest-ImagesDeleteNegativeTestJSON-1558753180 tempest-ImagesDeleteNegativeTestJSON-1558753180-project] Calling method '.version_select at 0x7fbb2f195940>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:43.827876 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.multi_cell_list [None req-dbe59cf7-a0c1-4cfb-9005-cadd5b754b68 tempest-ServersAdminTestJSON-717699517 tempest-ServersAdminTestJSON-717699517-project-admin] Listed batch of 11 results from cell out of 1000 limit. Returned 11 total so far. {{(pid=134102) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 21:46:43.888383 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-eff010f1-0d75-4ef5-9c49-50856b895b34 tempest-ImagesDeleteNegativeTestJSON-1558753180 tempest-ImagesDeleteNegativeTestJSON-1558753180-project] HTTP exception thrown: Image not found. Oct 04 21:46:43.911123 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-dbe59cf7-a0c1-4cfb-9005-cadd5b754b68 tempest-ServersAdminTestJSON-717699517 tempest-ServersAdminTestJSON-717699517-project-admin] 10.222.0.43 "GET /compute/v2.1/servers?host=n-h2-860284-1&all_tenants=1" status: 200 len: 3621 microversion: 2.1 time: 0.225835 Oct 04 21:46:43.914055 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-eff010f1-0d75-4ef5-9c49-50856b895b34 tempest-ImagesDeleteNegativeTestJSON-1558753180 tempest-ImagesDeleteNegativeTestJSON-1558753180-project] Request method failure captured: Oct 04 21:46:43.914055 n-d-860284-1 devstack@n-api.service[134101]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 Oct 04 21:46:43.914055 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 21:46:43.914055 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 21:46:43.914055 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 21:46:43.914055 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 21:46:43.914055 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 21:46:43.914055 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 21:46:43.914055 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 21:46:43.914055 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 21:46:43.914055 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPKnDfmWdhLMsLjgbZ9AGds9oJNbzf_hQMsu7cUnG9Fbemj3HYkwIYxTjw15x7hSH5iFB-7xsXUmVBqPvz1vRuwtgdGNvU9AbtHTMWwODx2hr5PlVouLTyj4SaLJOfelToMdLMYrPwy86iHSUb2iyEksvTVAx50YMXBVqD8h9q9b6nQI Oct 04 21:46:43.914055 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 21:46:43.914055 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 21:46:43.914055 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 21:46:43.914055 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 21:46:43.914055 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 21:46:43.914055 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 21:46:43.914055 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: 8b86a2e17faf4808943ef462a80957ee Oct 04 21:46:43.914055 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1558753180 Oct 04 21:46:43.914055 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 21:46:43.914055 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 21:46:43.915593 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8b86a2e17faf4808943ef462a80957ee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_8b86a2e17faf4808943ef462a80957ee", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8b86a2e17faf4808943ef462a80957ee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/8b86a2e17faf4808943ef462a80957ee"}]}] Oct 04 21:46:43.915593 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1558753180 Oct 04 21:46:43.915593 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: 8b86a2e17faf4808943ef462a80957ee Oct 04 21:46:43.915593 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1558753180 Oct 04 21:46:43.915593 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-ImagesDeleteNegativeTestJSON-1558753180-project Oct 04 21:46:43.915593 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 21:46:43.915593 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 21:46:43.915593 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 79cd2e1b5457440897218bafd1a45425 Oct 04 21:46:43.915593 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1558753180-project Oct 04 21:46:43.915593 n-d-860284-1 devstack@n-api.service[134101]: method: Oct 04 21:46:43.915593 n-d-860284-1 devstack@n-api.service[134101]: exception: Image not found. Oct 04 21:46:43.915593 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': '-1'} Oct 04 21:46:43.915593 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:46:43.915593 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:46:43.916487 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 04 21:46:43.916487 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 04 21:46:43.916487 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 21:46:43.916487 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 21:46:43.916487 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 21:46:43.916487 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 21:46:43.916487 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 04 21:46:43.916487 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 04 21:46:43.916487 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 04 21:46:43.916487 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 04 21:46:43.916487 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 21:46:43.916487 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 21:46:43.916487 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 21:46:43.916487 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 21:46:43.916487 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete Oct 04 21:46:43.916487 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:46:43.916487 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:46:43.916487 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:46:43.916487 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:46:43.917731 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 04 21:46:43.917731 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 04 21:46:43.917731 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 04 21:46:43.917731 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 04 21:46:43.917731 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 04 21:46:43.917731 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 04 21:46:43.917731 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. Oct 04 21:46:43.917731 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:46:43.917731 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:46:43.917731 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:46:43.917731 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:46:43.917731 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:46:43.917731 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:46:43.917731 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:46:43.917731 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:46:43.917731 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:46:43.917731 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:46:43.917731 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:46:43.917731 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:46:43.917731 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 04 21:46:43.918995 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 21:46:43.918995 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 21:46:43.918995 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:46:43.918995 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:46:43.918995 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:46:43.918995 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:46:43.918995 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:46:43.918995 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:46:43.918995 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:46:43.918995 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:46:43.918995 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 21:46:43.918995 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:46:43.918995 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-eff010f1-0d75-4ef5-9c49-50856b895b34 tempest-ImagesDeleteNegativeTestJSON-1558753180 tempest-ImagesDeleteNegativeTestJSON-1558753180-project] Returning 404 to user: Image not found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:46:43.918995 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-eff010f1-0d75-4ef5-9c49-50856b895b34 tempest-ImagesDeleteNegativeTestJSON-1558753180 tempest-ImagesDeleteNegativeTestJSON-1558753180-project] 10.222.0.43 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.115824 Oct 04 21:46:43.919868 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 465/923] 10.222.0.43 () {58 vars in 1190 bytes} [Tue Oct 4 21:46:43 2022] GET /compute/v2.1/servers?host=n-h2-860284-1&all_tenants=1 => generated 3621 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:43.921710 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 459/924] 10.222.0.43 () {58 vars in 1134 bytes} [Tue Oct 4 21:46:43 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 21:46:43.927721 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-d8c4caaf-78da-4add-859e-450bc06fec2b tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:43.928495 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-7e146939-9fac-4028-8584-c311e1e8d1e6 tempest-ImagesDeleteNegativeTestJSON-1558753180 tempest-ImagesDeleteNegativeTestJSON-1558753180-project] Calling method '.version_select at 0x7fbb2f142dc0>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:43.929196 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-d8c4caaf-78da-4add-859e-450bc06fec2b tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] [instance: 7512d9d6-ab41-453e-bb9d-8e0861aa37f7] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:43.937735 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d8c4caaf-78da-4add-859e-450bc06fec2b tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:43.938245 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d8c4caaf-78da-4add-859e-450bc06fec2b tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:43.939128 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d8c4caaf-78da-4add-859e-450bc06fec2b tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:43.940764 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d8c4caaf-78da-4add-859e-450bc06fec2b tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:43.940764 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d8c4caaf-78da-4add-859e-450bc06fec2b tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:43.940764 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d8c4caaf-78da-4add-859e-450bc06fec2b tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:43.989648 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-7e146939-9fac-4028-8584-c311e1e8d1e6 tempest-ImagesDeleteNegativeTestJSON-1558753180 tempest-ImagesDeleteNegativeTestJSON-1558753180-project] HTTP exception thrown: Image not found. Oct 04 21:46:43.992575 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-7e146939-9fac-4028-8584-c311e1e8d1e6 tempest-ImagesDeleteNegativeTestJSON-1558753180 tempest-ImagesDeleteNegativeTestJSON-1558753180-project] Request method failure captured: Oct 04 21:46:43.992575 n-d-860284-1 devstack@n-api.service[134101]: request: DELETE /compute/v2.1/images/2f35933e-59d2-44cc-8dae-6b41f9c614ej HTTP/1.1 Oct 04 21:46:43.992575 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 21:46:43.992575 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 21:46:43.992575 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 21:46:43.992575 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 21:46:43.992575 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 21:46:43.992575 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 21:46:43.992575 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 21:46:43.992575 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 21:46:43.992575 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPKnDfmWdhLMsLjgbZ9AGds9oJNbzf_hQMsu7cUnG9Fbemj3HYkwIYxTjw15x7hSH5iFB-7xsXUmVBqPvz1vRuwtgdGNvU9AbtHTMWwODx2hr5PlVouLTyj4SaLJOfelToMdLMYrPwy86iHSUb2iyEksvTVAx50YMXBVqD8h9q9b6nQI Oct 04 21:46:43.992575 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 21:46:43.992575 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 21:46:43.992575 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 21:46:43.992575 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 21:46:43.992575 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 21:46:43.992575 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 21:46:43.992575 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: 8b86a2e17faf4808943ef462a80957ee Oct 04 21:46:43.992575 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1558753180 Oct 04 21:46:43.992575 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 21:46:43.992575 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 21:46:43.993944 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8b86a2e17faf4808943ef462a80957ee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_8b86a2e17faf4808943ef462a80957ee", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8b86a2e17faf4808943ef462a80957ee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/8b86a2e17faf4808943ef462a80957ee"}]}] Oct 04 21:46:43.993944 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1558753180 Oct 04 21:46:43.993944 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: 8b86a2e17faf4808943ef462a80957ee Oct 04 21:46:43.993944 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1558753180 Oct 04 21:46:43.993944 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-ImagesDeleteNegativeTestJSON-1558753180-project Oct 04 21:46:43.993944 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 21:46:43.993944 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 21:46:43.993944 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 79cd2e1b5457440897218bafd1a45425 Oct 04 21:46:43.993944 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1558753180-project Oct 04 21:46:43.993944 n-d-860284-1 devstack@n-api.service[134101]: method: Oct 04 21:46:43.993944 n-d-860284-1 devstack@n-api.service[134101]: exception: Image not found. Oct 04 21:46:43.993944 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': '2f35933e-59d2-44cc-8dae-6b41f9c614ej'} Oct 04 21:46:43.993944 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:46:43.994733 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:46:43.994733 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 04 21:46:43.994733 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 04 21:46:43.994733 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 21:46:43.994733 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 21:46:43.994733 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 21:46:43.994733 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 21:46:43.994733 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 04 21:46:43.994733 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 04 21:46:43.994733 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 04 21:46:43.994733 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 04 21:46:43.994733 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 21:46:43.994733 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 21:46:43.994733 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 21:46:43.994733 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 21:46:43.994733 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 2f35933e-59d2-44cc-8dae-6b41f9c614ej to delete Oct 04 21:46:43.994733 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:46:43.994733 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:46:43.994733 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:46:43.995882 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:46:43.995882 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 04 21:46:43.995882 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 04 21:46:43.995882 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 04 21:46:43.995882 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 04 21:46:43.995882 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 04 21:46:43.995882 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 04 21:46:43.995882 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 2f35933e-59d2-44cc-8dae-6b41f9c614ej could not be found. Oct 04 21:46:43.995882 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:46:43.995882 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:46:43.995882 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:46:43.995882 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:46:43.995882 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:46:43.995882 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:46:43.995882 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:46:43.995882 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:46:43.995882 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:46:43.995882 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:46:43.995882 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:46:43.995882 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:46:43.997699 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 04 21:46:43.997699 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 21:46:43.997699 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 21:46:43.997699 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:46:43.997699 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:46:43.997699 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:46:43.997699 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:46:43.997699 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:46:43.997699 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:46:43.997699 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:46:43.997699 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:46:43.997699 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 21:46:43.997699 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:46:43.997699 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-7e146939-9fac-4028-8584-c311e1e8d1e6 tempest-ImagesDeleteNegativeTestJSON-1558753180 tempest-ImagesDeleteNegativeTestJSON-1558753180-project] Returning 404 to user: Image not found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:46:43.997699 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-7e146939-9fac-4028-8584-c311e1e8d1e6 tempest-ImagesDeleteNegativeTestJSON-1558753180 tempest-ImagesDeleteNegativeTestJSON-1558753180-project] 10.222.0.43 "DELETE /compute/v2.1/images/2f35933e-59d2-44cc-8dae-6b41f9c614ej" status: 404 len: 62 microversion: 2.1 time: 0.070948 Oct 04 21:46:43.998823 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 460/925] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:43 2022] DELETE /compute/v2.1/images/2f35933e-59d2-44cc-8dae-6b41f9c614ej => generated 62 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 21:46:44.010780 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-cb70cf99-1f25-4d76-ab58-80127ec5b9b4 tempest-ServersAdminTestJSON-717699517 tempest-ServersAdminTestJSON-717699517-project-admin] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:44.018272 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-cb70cf99-1f25-4d76-ab58-80127ec5b9b4 tempest-ServersAdminTestJSON-717699517 tempest-ServersAdminTestJSON-717699517-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=134101) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 21:46:44.023975 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cb70cf99-1f25-4d76-ab58-80127ec5b9b4 tempest-ServersAdminTestJSON-717699517 tempest-ServersAdminTestJSON-717699517-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:44.024650 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cb70cf99-1f25-4d76-ab58-80127ec5b9b4 tempest-ServersAdminTestJSON-717699517 tempest-ServersAdminTestJSON-717699517-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:44.025149 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cb70cf99-1f25-4d76-ab58-80127ec5b9b4 tempest-ServersAdminTestJSON-717699517 tempest-ServersAdminTestJSON-717699517-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:44.025880 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cb70cf99-1f25-4d76-ab58-80127ec5b9b4 tempest-ServersAdminTestJSON-717699517 tempest-ServersAdminTestJSON-717699517-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:44.026332 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cb70cf99-1f25-4d76-ab58-80127ec5b9b4 tempest-ServersAdminTestJSON-717699517 tempest-ServersAdminTestJSON-717699517-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:44.026847 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cb70cf99-1f25-4d76-ab58-80127ec5b9b4 tempest-ServersAdminTestJSON-717699517 tempest-ServersAdminTestJSON-717699517-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:44.133761 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-cb70cf99-1f25-4d76-ab58-80127ec5b9b4 tempest-ServersAdminTestJSON-717699517 tempest-ServersAdminTestJSON-717699517-project-admin] 10.222.0.43 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.133435 Oct 04 21:46:44.138512 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 461/926] 10.222.0.43 () {58 vars in 1196 bytes} [Tue Oct 4 21:46:43 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 21:46:44.145106 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-05f06e45-62ad-488c-af16-261f406d4958 tempest-ImagesDeleteNegativeTestJSON-1558753180 tempest-ImagesDeleteNegativeTestJSON-1558753180-project] Calling method '.version_select at 0x7fbb2f1a4280>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:44.166281 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-d8c4caaf-78da-4add-859e-450bc06fec2b tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:44.167931 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-05f06e45-62ad-488c-af16-261f406d4958 tempest-ImagesDeleteNegativeTestJSON-1558753180 tempest-ImagesDeleteNegativeTestJSON-1558753180-project] HTTP exception thrown: Image not found. Oct 04 21:46:44.177489 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-05f06e45-62ad-488c-af16-261f406d4958 tempest-ImagesDeleteNegativeTestJSON-1558753180 tempest-ImagesDeleteNegativeTestJSON-1558753180-project] Request method failure captured: Oct 04 21:46:44.177489 n-d-860284-1 devstack@n-api.service[134101]: request: DELETE /compute/v2.1/images/6667141d-37d4-437f-a816-a272eb83fe561 HTTP/1.1 Oct 04 21:46:44.177489 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 21:46:44.177489 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 21:46:44.177489 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 21:46:44.177489 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 21:46:44.177489 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 21:46:44.177489 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 21:46:44.177489 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 21:46:44.177489 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 21:46:44.177489 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPKnDfmWdhLMsLjgbZ9AGds9oJNbzf_hQMsu7cUnG9Fbemj3HYkwIYxTjw15x7hSH5iFB-7xsXUmVBqPvz1vRuwtgdGNvU9AbtHTMWwODx2hr5PlVouLTyj4SaLJOfelToMdLMYrPwy86iHSUb2iyEksvTVAx50YMXBVqD8h9q9b6nQI Oct 04 21:46:44.177489 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 21:46:44.177489 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 21:46:44.177489 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 21:46:44.177489 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 21:46:44.177489 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 21:46:44.177489 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 21:46:44.177489 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: 8b86a2e17faf4808943ef462a80957ee Oct 04 21:46:44.177489 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1558753180 Oct 04 21:46:44.177489 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 21:46:44.177489 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 21:46:44.179949 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8b86a2e17faf4808943ef462a80957ee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_8b86a2e17faf4808943ef462a80957ee", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8b86a2e17faf4808943ef462a80957ee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/8b86a2e17faf4808943ef462a80957ee"}]}] Oct 04 21:46:44.179949 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1558753180 Oct 04 21:46:44.179949 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: 8b86a2e17faf4808943ef462a80957ee Oct 04 21:46:44.179949 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1558753180 Oct 04 21:46:44.179949 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-ImagesDeleteNegativeTestJSON-1558753180-project Oct 04 21:46:44.179949 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 21:46:44.179949 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 21:46:44.179949 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 79cd2e1b5457440897218bafd1a45425 Oct 04 21:46:44.179949 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1558753180-project Oct 04 21:46:44.179949 n-d-860284-1 devstack@n-api.service[134101]: method: Oct 04 21:46:44.179949 n-d-860284-1 devstack@n-api.service[134101]: exception: Image not found. Oct 04 21:46:44.179949 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': '6667141d-37d4-437f-a816-a272eb83fe561'} Oct 04 21:46:44.179949 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:46:44.180932 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:46:44.180932 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 04 21:46:44.180932 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 04 21:46:44.180932 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 21:46:44.180932 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 21:46:44.180932 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 21:46:44.180932 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 21:46:44.180932 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 04 21:46:44.180932 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 04 21:46:44.180932 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 04 21:46:44.180932 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 04 21:46:44.180932 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 21:46:44.180932 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 21:46:44.180932 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 21:46:44.180932 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 21:46:44.180932 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 6667141d-37d4-437f-a816-a272eb83fe561 to delete Oct 04 21:46:44.180932 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:46:44.180932 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:46:44.180932 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:46:44.182349 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:46:44.182349 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 04 21:46:44.182349 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 04 21:46:44.182349 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 04 21:46:44.182349 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 04 21:46:44.182349 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 04 21:46:44.182349 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 04 21:46:44.182349 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 6667141d-37d4-437f-a816-a272eb83fe561 could not be found. Oct 04 21:46:44.182349 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:46:44.182349 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:46:44.182349 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:46:44.182349 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:46:44.182349 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:46:44.182349 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:46:44.182349 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:46:44.182349 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:46:44.182349 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:46:44.182349 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:46:44.182349 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:46:44.182349 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:46:44.183818 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 04 21:46:44.183818 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 21:46:44.183818 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 21:46:44.183818 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:46:44.183818 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:46:44.183818 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:46:44.183818 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:46:44.183818 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:46:44.183818 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:46:44.183818 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:46:44.183818 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:46:44.183818 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 21:46:44.183818 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:46:44.184774 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-d8c4caaf-78da-4add-859e-450bc06fec2b tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:44.184774 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-d8c4caaf-78da-4add-859e-450bc06fec2b tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:44.186535 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-05f06e45-62ad-488c-af16-261f406d4958 tempest-ImagesDeleteNegativeTestJSON-1558753180 tempest-ImagesDeleteNegativeTestJSON-1558753180-project] Returning 404 to user: Image not found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:46:44.186618 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-d8c4caaf-78da-4add-859e-450bc06fec2b tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] 10.222.0.43 "GET /compute/v2.1/servers/7512d9d6-ab41-453e-bb9d-8e0861aa37f7" status: 200 len: 1362 microversion: 2.25 time: 0.262355 Oct 04 21:46:44.186692 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-05f06e45-62ad-488c-af16-261f406d4958 tempest-ImagesDeleteNegativeTestJSON-1558753180 tempest-ImagesDeleteNegativeTestJSON-1558753180-project] 10.222.0.43 "DELETE /compute/v2.1/images/6667141d-37d4-437f-a816-a272eb83fe561" status: 404 len: 62 microversion: 2.1 time: 0.045537 Oct 04 21:46:44.190498 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 462/927] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 21:46:44 2022] DELETE /compute/v2.1/images/6667141d-37d4-437f-a816-a272eb83fe561 => generated 62 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 21:46:44.195890 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-60509c60-9468-4874-beac-28231de7be22 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:44.196780 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-60509c60-9468-4874-beac-28231de7be22 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] [instance: 663b2cc6-7a55-406a-b56f-86047b0e514d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:44.204612 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-60509c60-9468-4874-beac-28231de7be22 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:44.205709 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-60509c60-9468-4874-beac-28231de7be22 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:44.207059 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-60509c60-9468-4874-beac-28231de7be22 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:44.208037 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-60509c60-9468-4874-beac-28231de7be22 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:44.208233 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 466/928] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:46:43 2022] GET /compute/v2.1/servers/7512d9d6-ab41-453e-bb9d-8e0861aa37f7 => generated 1362 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:46:44.208893 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-60509c60-9468-4874-beac-28231de7be22 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:44.209759 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-60509c60-9468-4874-beac-28231de7be22 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:44.219203 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-5f1103e1-8735-42b4-9dfa-db5fdb55bbf4 tempest-ServersAdminTestJSON-717699517 tempest-ServersAdminTestJSON-717699517-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:46:44.221755 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-5f1103e1-8735-42b4-9dfa-db5fdb55bbf4 tempest-ServersAdminTestJSON-717699517 tempest-ServersAdminTestJSON-717699517-project-admin] [instance: e3380b36-6aba-4736-bcbc-f0058f806d55] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:44.230136 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5f1103e1-8735-42b4-9dfa-db5fdb55bbf4 tempest-ServersAdminTestJSON-717699517 tempest-ServersAdminTestJSON-717699517-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:44.230879 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5f1103e1-8735-42b4-9dfa-db5fdb55bbf4 tempest-ServersAdminTestJSON-717699517 tempest-ServersAdminTestJSON-717699517-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:44.231460 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5f1103e1-8735-42b4-9dfa-db5fdb55bbf4 tempest-ServersAdminTestJSON-717699517 tempest-ServersAdminTestJSON-717699517-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:44.232388 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5f1103e1-8735-42b4-9dfa-db5fdb55bbf4 tempest-ServersAdminTestJSON-717699517 tempest-ServersAdminTestJSON-717699517-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:44.233282 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5f1103e1-8735-42b4-9dfa-db5fdb55bbf4 tempest-ServersAdminTestJSON-717699517 tempest-ServersAdminTestJSON-717699517-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:44.234001 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5f1103e1-8735-42b4-9dfa-db5fdb55bbf4 tempest-ServersAdminTestJSON-717699517 tempest-ServersAdminTestJSON-717699517-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:44.293115 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:46:44.336300 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-5f1103e1-8735-42b4-9dfa-db5fdb55bbf4 tempest-ServersAdminTestJSON-717699517 tempest-ServersAdminTestJSON-717699517-project-admin] 10.222.0.43 "POST /compute/v2.1/servers/e3380b36-6aba-4736-bcbc-f0058f806d55/action" status: 202 len: 0 microversion: 2.1 time: 0.126634 Oct 04 21:46:44.337574 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 467/929] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 21:46:44 2022] POST /compute/v2.1/servers/e3380b36-6aba-4736-bcbc-f0058f806d55/action => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:46:44.342824 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-5bec547b-625d-446a-b2e3-b187e7727891 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:44.343771 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-5bec547b-625d-446a-b2e3-b187e7727891 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: 424a22f0-ccc3-4fec-bf38-4aaf924928e3] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:44.350680 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5bec547b-625d-446a-b2e3-b187e7727891 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:44.351624 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5bec547b-625d-446a-b2e3-b187e7727891 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:44.352254 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5bec547b-625d-446a-b2e3-b187e7727891 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:44.353139 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5bec547b-625d-446a-b2e3-b187e7727891 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:44.353737 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5bec547b-625d-446a-b2e3-b187e7727891 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:44.354342 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5bec547b-625d-446a-b2e3-b187e7727891 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:44.469525 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-5bec547b-625d-446a-b2e3-b187e7727891 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:44.481503 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-5bec547b-625d-446a-b2e3-b187e7727891 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/424a22f0-ccc3-4fec-bf38-4aaf924928e3" status: 200 len: 1330 microversion: 2.1 time: 0.142435 Oct 04 21:46:44.494411 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 468/930] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:44 2022] GET /compute/v2.1/servers/424a22f0-ccc3-4fec-bf38-4aaf924928e3 => generated 1330 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:44.494411 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-189e929f-3acd-40f6-aa32-5e28ee877d31 tempest-ImagesDeleteNegativeTestJSON-1558753180 tempest-ImagesDeleteNegativeTestJSON-1558753180-project] Calling method '.version_select at 0x7fbb2fc004c0>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:44.515820 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-60509c60-9468-4874-beac-28231de7be22 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29842a669a20408b881105135f76cb0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39edf587afe94b60911198aa0bb61613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:44.525746 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-60509c60-9468-4874-beac-28231de7be22 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] 10.222.0.43 "GET /compute/v2.1/servers/663b2cc6-7a55-406a-b56f-86047b0e514d" status: 200 len: 1316 microversion: 2.1 time: 0.333991 Oct 04 21:46:44.528040 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-189e929f-3acd-40f6-aa32-5e28ee877d31 tempest-ImagesDeleteNegativeTestJSON-1558753180 tempest-ImagesDeleteNegativeTestJSON-1558753180-project] HTTP exception thrown: Image not found. Oct 04 21:46:44.534128 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-189e929f-3acd-40f6-aa32-5e28ee877d31 tempest-ImagesDeleteNegativeTestJSON-1558753180 tempest-ImagesDeleteNegativeTestJSON-1558753180-project] Request method failure captured: Oct 04 21:46:44.534128 n-d-860284-1 devstack@n-api.service[134102]: request: DELETE /compute/v2.1/images/tempest-invalid-400273975 HTTP/1.1 Oct 04 21:46:44.534128 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 21:46:44.534128 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 21:46:44.534128 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 21:46:44.534128 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 21:46:44.534128 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 21:46:44.534128 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 21:46:44.534128 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 21:46:44.534128 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 21:46:44.534128 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPKnDfmWdhLMsLjgbZ9AGds9oJNbzf_hQMsu7cUnG9Fbemj3HYkwIYxTjw15x7hSH5iFB-7xsXUmVBqPvz1vRuwtgdGNvU9AbtHTMWwODx2hr5PlVouLTyj4SaLJOfelToMdLMYrPwy86iHSUb2iyEksvTVAx50YMXBVqD8h9q9b6nQI Oct 04 21:46:44.534128 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 21:46:44.534128 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 21:46:44.534128 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 21:46:44.534128 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 21:46:44.534128 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 21:46:44.534128 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 21:46:44.534128 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: 8b86a2e17faf4808943ef462a80957ee Oct 04 21:46:44.534128 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1558753180 Oct 04 21:46:44.534128 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 21:46:44.534128 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 21:46:44.535468 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8b86a2e17faf4808943ef462a80957ee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_8b86a2e17faf4808943ef462a80957ee", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8b86a2e17faf4808943ef462a80957ee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/8b86a2e17faf4808943ef462a80957ee"}]}] Oct 04 21:46:44.535468 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1558753180 Oct 04 21:46:44.535468 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: 8b86a2e17faf4808943ef462a80957ee Oct 04 21:46:44.535468 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1558753180 Oct 04 21:46:44.535468 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-ImagesDeleteNegativeTestJSON-1558753180-project Oct 04 21:46:44.535468 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 21:46:44.535468 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 21:46:44.535468 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: 79cd2e1b5457440897218bafd1a45425 Oct 04 21:46:44.535468 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1558753180-project Oct 04 21:46:44.535468 n-d-860284-1 devstack@n-api.service[134102]: method: Oct 04 21:46:44.535468 n-d-860284-1 devstack@n-api.service[134102]: exception: Image not found. Oct 04 21:46:44.535468 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': 'tempest-invalid-400273975'} Oct 04 21:46:44.535468 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:46:44.536259 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:46:44.536259 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 04 21:46:44.536259 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 04 21:46:44.536259 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 21:46:44.536259 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 21:46:44.536259 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 21:46:44.536259 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 21:46:44.536259 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 04 21:46:44.536259 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 04 21:46:44.536259 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 04 21:46:44.536259 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 04 21:46:44.536259 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 21:46:44.536259 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 21:46:44.536259 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 21:46:44.536259 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 21:46:44.536259 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-400273975 to delete Oct 04 21:46:44.536259 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:46:44.536259 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:46:44.536259 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:46:44.538616 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:46:44.538616 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 04 21:46:44.538616 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 04 21:46:44.538616 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 04 21:46:44.538616 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 04 21:46:44.538616 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 04 21:46:44.538616 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 04 21:46:44.538616 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-400273975 could not be found. Oct 04 21:46:44.538616 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:46:44.538616 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:46:44.538616 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:46:44.538616 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:46:44.538616 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:46:44.538616 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:46:44.538616 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:46:44.538616 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:46:44.538616 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:46:44.538616 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:46:44.538616 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:46:44.538616 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:46:44.539820 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 04 21:46:44.539820 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 21:46:44.539820 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 21:46:44.539820 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:46:44.539820 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:46:44.539820 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:46:44.539820 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:46:44.539820 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:46:44.539820 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:46:44.539820 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:46:44.539820 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:46:44.539820 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 21:46:44.539820 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:46:44.539820 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-189e929f-3acd-40f6-aa32-5e28ee877d31 tempest-ImagesDeleteNegativeTestJSON-1558753180 tempest-ImagesDeleteNegativeTestJSON-1558753180-project] Returning 404 to user: Image not found. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:46:44.539820 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-189e929f-3acd-40f6-aa32-5e28ee877d31 tempest-ImagesDeleteNegativeTestJSON-1558753180 tempest-ImagesDeleteNegativeTestJSON-1558753180-project] 10.222.0.43 "DELETE /compute/v2.1/images/tempest-invalid-400273975" status: 404 len: 62 microversion: 2.1 time: 0.051360 Oct 04 21:46:44.543679 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 463/932] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:44 2022] GET /compute/v2.1/servers/663b2cc6-7a55-406a-b56f-86047b0e514d => generated 1316 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:44.546436 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 469/932] 10.222.0.43 () {58 vars in 1203 bytes} [Tue Oct 4 21:46:44 2022] DELETE /compute/v2.1/images/tempest-invalid-400273975 => generated 62 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 21:46:44.549061 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-dbf3ef4c-d579-4112-8526-f566213d00f9 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:44.549783 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-dbf3ef4c-d579-4112-8526-f566213d00f9 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 4e8281d2-9de4-42eb-94cc-417be864315d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:44.554768 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-77e98445-1f90-4bca-abcd-57774614c613 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "58548514-5dac-426c-81f5-19e3fba33e23"}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:46:44.557996 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dbf3ef4c-d579-4112-8526-f566213d00f9 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:44.558670 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dbf3ef4c-d579-4112-8526-f566213d00f9 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:44.559110 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-77e98445-1f90-4bca-abcd-57774614c613 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] [instance: e3380b36-6aba-4736-bcbc-f0058f806d55] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:44.559289 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dbf3ef4c-d579-4112-8526-f566213d00f9 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:44.560086 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dbf3ef4c-d579-4112-8526-f566213d00f9 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:44.560657 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dbf3ef4c-d579-4112-8526-f566213d00f9 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:44.561173 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dbf3ef4c-d579-4112-8526-f566213d00f9 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:44.568637 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-77e98445-1f90-4bca-abcd-57774614c613 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:44.569360 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-77e98445-1f90-4bca-abcd-57774614c613 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:44.569857 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-77e98445-1f90-4bca-abcd-57774614c613 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:44.570629 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-77e98445-1f90-4bca-abcd-57774614c613 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:44.571098 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-77e98445-1f90-4bca-abcd-57774614c613 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:44.571538 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-77e98445-1f90-4bca-abcd-57774614c613 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:44.692335 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-77e98445-1f90-4bca-abcd-57774614c613 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Flavor limits 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:46:44.692757 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-77e98445-1f90-4bca-abcd-57774614c613 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Image limits 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:46:44.693255 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-77e98445-1f90-4bca-abcd-57774614c613 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Flavor pref 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:46:44.693790 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-77e98445-1f90-4bca-abcd-57774614c613 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Image pref 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:46:44.694415 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-77e98445-1f90-4bca-abcd-57774614c613 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:46:44.793059 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-77e98445-1f90-4bca-abcd-57774614c613 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] [instance: e3380b36-6aba-4736-bcbc-f0058f806d55] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:44.800077 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-77e98445-1f90-4bca-abcd-57774614c613 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:44.812094 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-77e98445-1f90-4bca-abcd-57774614c613 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:44.815372 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-77e98445-1f90-4bca-abcd-57774614c613 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:44.816682 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-77e98445-1f90-4bca-abcd-57774614c613 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:44.819302 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-77e98445-1f90-4bca-abcd-57774614c613 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:44.821141 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-77e98445-1f90-4bca-abcd-57774614c613 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:44.862261 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-77e98445-1f90-4bca-abcd-57774614c613 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] 10.222.0.43 "POST /compute/v2.1/servers/e3380b36-6aba-4736-bcbc-f0058f806d55/action" status: 202 len: 1067 microversion: 2.1 time: 0.313944 Oct 04 21:46:44.863342 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 470/933] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 21:46:44 2022] POST /compute/v2.1/servers/e3380b36-6aba-4736-bcbc-f0058f806d55/action => generated 1067 bytes in 316 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 04 21:46:44.870936 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-27c3b6e1-8c6e-4c39-9f62-cb5ab230c6a4 tempest-ImagesDeleteNegativeTestJSON-1558753180 tempest-ImagesDeleteNegativeTestJSON-1558753180-project] Calling method '.version_select at 0x7fbb2f5d0d30>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:44.900454 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-27c3b6e1-8c6e-4c39-9f62-cb5ab230c6a4 tempest-ImagesDeleteNegativeTestJSON-1558753180 tempest-ImagesDeleteNegativeTestJSON-1558753180-project] HTTP exception thrown: Image not found. Oct 04 21:46:44.904129 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-27c3b6e1-8c6e-4c39-9f62-cb5ab230c6a4 tempest-ImagesDeleteNegativeTestJSON-1558753180 tempest-ImagesDeleteNegativeTestJSON-1558753180-project] Request method failure captured: Oct 04 21:46:44.904129 n-d-860284-1 devstack@n-api.service[134102]: request: DELETE /compute/v2.1/images/253e7db9-b944-4b83-9f07-5aaba4bdd2fc HTTP/1.1 Oct 04 21:46:44.904129 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 21:46:44.904129 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 21:46:44.904129 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 21:46:44.904129 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 21:46:44.904129 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 21:46:44.904129 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 21:46:44.904129 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 21:46:44.904129 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 21:46:44.904129 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPKnDfmWdhLMsLjgbZ9AGds9oJNbzf_hQMsu7cUnG9Fbemj3HYkwIYxTjw15x7hSH5iFB-7xsXUmVBqPvz1vRuwtgdGNvU9AbtHTMWwODx2hr5PlVouLTyj4SaLJOfelToMdLMYrPwy86iHSUb2iyEksvTVAx50YMXBVqD8h9q9b6nQI Oct 04 21:46:44.904129 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 21:46:44.904129 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 21:46:44.904129 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 21:46:44.904129 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 21:46:44.904129 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 21:46:44.904129 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 21:46:44.904129 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: 8b86a2e17faf4808943ef462a80957ee Oct 04 21:46:44.904129 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1558753180 Oct 04 21:46:44.904129 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 21:46:44.904129 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 21:46:44.905657 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8b86a2e17faf4808943ef462a80957ee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_8b86a2e17faf4808943ef462a80957ee", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8b86a2e17faf4808943ef462a80957ee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/8b86a2e17faf4808943ef462a80957ee"}]}] Oct 04 21:46:44.905657 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1558753180 Oct 04 21:46:44.905657 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: 8b86a2e17faf4808943ef462a80957ee Oct 04 21:46:44.905657 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1558753180 Oct 04 21:46:44.905657 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-ImagesDeleteNegativeTestJSON-1558753180-project Oct 04 21:46:44.905657 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 21:46:44.905657 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 21:46:44.905657 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: 79cd2e1b5457440897218bafd1a45425 Oct 04 21:46:44.905657 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1558753180-project Oct 04 21:46:44.905657 n-d-860284-1 devstack@n-api.service[134102]: method: Oct 04 21:46:44.905657 n-d-860284-1 devstack@n-api.service[134102]: exception: Image not found. Oct 04 21:46:44.905657 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': '253e7db9-b944-4b83-9f07-5aaba4bdd2fc'} Oct 04 21:46:44.905657 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:46:44.906666 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:46:44.906666 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 04 21:46:44.906666 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 04 21:46:44.906666 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 21:46:44.906666 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 21:46:44.906666 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 21:46:44.906666 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 21:46:44.906666 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 04 21:46:44.906666 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 04 21:46:44.906666 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 04 21:46:44.906666 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 04 21:46:44.906666 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 21:46:44.906666 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 21:46:44.906666 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 21:46:44.906666 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 21:46:44.906666 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 253e7db9-b944-4b83-9f07-5aaba4bdd2fc to delete Oct 04 21:46:44.906666 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:46:44.906666 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:46:44.906666 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:46:44.907934 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:46:44.907934 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 04 21:46:44.907934 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 04 21:46:44.907934 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 04 21:46:44.907934 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 04 21:46:44.907934 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 04 21:46:44.907934 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 04 21:46:44.907934 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 253e7db9-b944-4b83-9f07-5aaba4bdd2fc could not be found. Oct 04 21:46:44.907934 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:46:44.907934 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:46:44.907934 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:46:44.907934 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:46:44.907934 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:46:44.907934 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:46:44.907934 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:46:44.907934 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:46:44.907934 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:46:44.907934 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:46:44.907934 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:46:44.907934 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:46:44.909087 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 04 21:46:44.909087 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 21:46:44.909087 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 21:46:44.909087 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:46:44.909087 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:46:44.909087 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:46:44.909087 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:46:44.909087 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:46:44.909087 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:46:44.909087 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:46:44.909087 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:46:44.909087 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 21:46:44.909087 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:46:44.909087 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-27c3b6e1-8c6e-4c39-9f62-cb5ab230c6a4 tempest-ImagesDeleteNegativeTestJSON-1558753180 tempest-ImagesDeleteNegativeTestJSON-1558753180-project] Returning 404 to user: Image not found. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:46:44.909087 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-27c3b6e1-8c6e-4c39-9f62-cb5ab230c6a4 tempest-ImagesDeleteNegativeTestJSON-1558753180 tempest-ImagesDeleteNegativeTestJSON-1558753180-project] 10.222.0.43 "DELETE /compute/v2.1/images/253e7db9-b944-4b83-9f07-5aaba4bdd2fc" status: 404 len: 62 microversion: 2.1 time: 0.044740 Oct 04 21:46:44.910852 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 471/934] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:44 2022] DELETE /compute/v2.1/images/253e7db9-b944-4b83-9f07-5aaba4bdd2fc => generated 62 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 21:46:44.930419 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-93e732e3-e71c-4cac-bcc1-ae6f2d9d8b79 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:44.932518 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-93e732e3-e71c-4cac-bcc1-ae6f2d9d8b79 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] [instance: 34276621-d087-478b-81c7-bdf5e38efc69] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:44.949138 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-dbf3ef4c-d579-4112-8526-f566213d00f9 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ad048becf474fb972d4291422d810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dcfc7024fc49388c4bd5f25f03e60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:44.954250 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-93e732e3-e71c-4cac-bcc1-ae6f2d9d8b79 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:44.954802 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-93e732e3-e71c-4cac-bcc1-ae6f2d9d8b79 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:44.955257 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-93e732e3-e71c-4cac-bcc1-ae6f2d9d8b79 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:44.956009 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-93e732e3-e71c-4cac-bcc1-ae6f2d9d8b79 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:44.960757 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-93e732e3-e71c-4cac-bcc1-ae6f2d9d8b79 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:44.961335 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-93e732e3-e71c-4cac-bcc1-ae6f2d9d8b79 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:44.962648 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-dbf3ef4c-d579-4112-8526-f566213d00f9 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/4e8281d2-9de4-42eb-94cc-417be864315d" status: 200 len: 1311 microversion: 2.1 time: 0.417579 Oct 04 21:46:44.967250 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 464/935] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:44 2022] GET /compute/v2.1/servers/4e8281d2-9de4-42eb-94cc-417be864315d => generated 1311 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:44.974054 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-11ac3fe3-e012-4385-babb-78ca93804eb4 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:44.979853 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-11ac3fe3-e012-4385-babb-78ca93804eb4 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] [instance: e3380b36-6aba-4736-bcbc-f0058f806d55] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:44.993974 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-11ac3fe3-e012-4385-babb-78ca93804eb4 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:44.994814 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-11ac3fe3-e012-4385-babb-78ca93804eb4 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:44.995410 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-11ac3fe3-e012-4385-babb-78ca93804eb4 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:44.997343 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-11ac3fe3-e012-4385-babb-78ca93804eb4 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:45.007103 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-11ac3fe3-e012-4385-babb-78ca93804eb4 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:45.008031 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-11ac3fe3-e012-4385-babb-78ca93804eb4 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:45.678787 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-93e732e3-e71c-4cac-bcc1-ae6f2d9d8b79 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1789bb97219a4e1591632126812ea6df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da67fc95e2814f4086df020f4c475764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:45.690053 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-93e732e3-e71c-4cac-bcc1-ae6f2d9d8b79 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] 10.222.0.43 "GET /compute/v2.1/servers/34276621-d087-478b-81c7-bdf5e38efc69" status: 200 len: 1586 microversion: 2.1 time: 0.770907 Oct 04 21:46:45.692061 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 472/936] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:44 2022] GET /compute/v2.1/servers/34276621-d087-478b-81c7-bdf5e38efc69 => generated 1586 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:45.700361 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-c163df70-55b5-408f-8cd0-9a6855270f15 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:45.702038 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-c163df70-55b5-408f-8cd0-9a6855270f15 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] [instance: 7512d9d6-ab41-453e-bb9d-8e0861aa37f7] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:45.715399 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c163df70-55b5-408f-8cd0-9a6855270f15 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:45.716131 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c163df70-55b5-408f-8cd0-9a6855270f15 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:45.716729 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c163df70-55b5-408f-8cd0-9a6855270f15 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:45.717594 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c163df70-55b5-408f-8cd0-9a6855270f15 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:45.718188 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c163df70-55b5-408f-8cd0-9a6855270f15 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:45.718792 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c163df70-55b5-408f-8cd0-9a6855270f15 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:45.761618 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-11ac3fe3-e012-4385-babb-78ca93804eb4 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87616cd16995468ab7febf5aa4b284db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e3bf9149434d34b6762aaeef1478ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:45.774454 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-11ac3fe3-e012-4385-babb-78ca93804eb4 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] 10.222.0.43 "GET /compute/v2.1/servers/e3380b36-6aba-4736-bcbc-f0058f806d55" status: 200 len: 1471 microversion: 2.1 time: 0.805721 Oct 04 21:46:45.775346 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 465/937] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:44 2022] GET /compute/v2.1/servers/e3380b36-6aba-4736-bcbc-f0058f806d55 => generated 1471 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:45.786740 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-1a37af5b-972f-499f-9c58-28860235e743 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:45.786740 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-1a37af5b-972f-499f-9c58-28860235e743 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: 424a22f0-ccc3-4fec-bf38-4aaf924928e3] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:45.795209 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1a37af5b-972f-499f-9c58-28860235e743 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:45.795979 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1a37af5b-972f-499f-9c58-28860235e743 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:45.796659 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1a37af5b-972f-499f-9c58-28860235e743 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:45.797551 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1a37af5b-972f-499f-9c58-28860235e743 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:45.798218 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1a37af5b-972f-499f-9c58-28860235e743 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:45.798890 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1a37af5b-972f-499f-9c58-28860235e743 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:45.970540 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-1a37af5b-972f-499f-9c58-28860235e743 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:45.980995 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-1a37af5b-972f-499f-9c58-28860235e743 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/424a22f0-ccc3-4fec-bf38-4aaf924928e3" status: 200 len: 1336 microversion: 2.1 time: 0.203965 Oct 04 21:46:45.994951 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 466/938] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:45 2022] GET /compute/v2.1/servers/424a22f0-ccc3-4fec-bf38-4aaf924928e3 => generated 1336 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:45.994951 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-6ec62e65-a8dd-474f-924c-d02c604e5197 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:45.994951 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-6ec62e65-a8dd-474f-924c-d02c604e5197 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] [instance: 663b2cc6-7a55-406a-b56f-86047b0e514d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:46.005678 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6ec62e65-a8dd-474f-924c-d02c604e5197 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:46.007804 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6ec62e65-a8dd-474f-924c-d02c604e5197 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:46.008959 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6ec62e65-a8dd-474f-924c-d02c604e5197 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:46.009877 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6ec62e65-a8dd-474f-924c-d02c604e5197 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:46.010155 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6ec62e65-a8dd-474f-924c-d02c604e5197 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:46.011681 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6ec62e65-a8dd-474f-924c-d02c604e5197 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:46.244598 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-c163df70-55b5-408f-8cd0-9a6855270f15 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:46.257667 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-c163df70-55b5-408f-8cd0-9a6855270f15 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:46.259466 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-c163df70-55b5-408f-8cd0-9a6855270f15 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:46.260839 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-c163df70-55b5-408f-8cd0-9a6855270f15 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] 10.222.0.43 "GET /compute/v2.1/servers/7512d9d6-ab41-453e-bb9d-8e0861aa37f7" status: 200 len: 1362 microversion: 2.25 time: 0.567414 Oct 04 21:46:46.261590 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 473/939] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:46:45 2022] GET /compute/v2.1/servers/7512d9d6-ab41-453e-bb9d-8e0861aa37f7 => generated 1362 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:46:46.266945 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-17f1d5b5-e040-4807-9cb3-477c1d2930d5 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:46.267763 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-17f1d5b5-e040-4807-9cb3-477c1d2930d5 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] [instance: 34276621-d087-478b-81c7-bdf5e38efc69] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:46.275947 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-17f1d5b5-e040-4807-9cb3-477c1d2930d5 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:46.277345 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-17f1d5b5-e040-4807-9cb3-477c1d2930d5 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:46.278063 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-17f1d5b5-e040-4807-9cb3-477c1d2930d5 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:46.279087 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-17f1d5b5-e040-4807-9cb3-477c1d2930d5 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:46.279802 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-17f1d5b5-e040-4807-9cb3-477c1d2930d5 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:46.280439 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-17f1d5b5-e040-4807-9cb3-477c1d2930d5 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:46.464614 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-6ec62e65-a8dd-474f-924c-d02c604e5197 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29842a669a20408b881105135f76cb0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39edf587afe94b60911198aa0bb61613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:46.495107 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-17f1d5b5-e040-4807-9cb3-477c1d2930d5 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] 10.222.0.43 "GET /compute/v2.1/servers/34276621-d087-478b-81c7-bdf5e38efc69/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.231753 Oct 04 21:46:46.496092 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 474/940] 10.222.0.43 () {58 vars in 1275 bytes} [Tue Oct 4 21:46:46 2022] GET /compute/v2.1/servers/34276621-d087-478b-81c7-bdf5e38efc69/os-interface => generated 284 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:46:46.508595 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-eabde067-950d-4195-b21d-ad76e49917ad tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:46.509218 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-eabde067-950d-4195-b21d-ad76e49917ad tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 4e8281d2-9de4-42eb-94cc-417be864315d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:46.520131 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-6ec62e65-a8dd-474f-924c-d02c604e5197 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] 10.222.0.43 "GET /compute/v2.1/servers/663b2cc6-7a55-406a-b56f-86047b0e514d" status: 200 len: 1316 microversion: 2.1 time: 0.537526 Oct 04 21:46:46.536164 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 467/941] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:45 2022] GET /compute/v2.1/servers/663b2cc6-7a55-406a-b56f-86047b0e514d => generated 1316 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:46.536512 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-eabde067-950d-4195-b21d-ad76e49917ad tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:46.536512 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-eabde067-950d-4195-b21d-ad76e49917ad tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:46.536512 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-eabde067-950d-4195-b21d-ad76e49917ad tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:46.536512 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-eabde067-950d-4195-b21d-ad76e49917ad tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:46.536805 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-eabde067-950d-4195-b21d-ad76e49917ad tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:46.539093 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-eabde067-950d-4195-b21d-ad76e49917ad tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:46.539271 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-b886eba5-8fc0-4992-918c-2425fb05da1b req-5ed87316-4596-401d-97f4-a2f2547ff3cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "663b2cc6-7a55-406a-b56f-86047b0e514d", "tag": "b18d9b3a-6ec1-47b6-83c8-9f36631f8f7c"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:46:46.563071 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-b886eba5-8fc0-4992-918c-2425fb05da1b req-5ed87316-4596-401d-97f4-a2f2547ff3cc service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:46.563637 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-b886eba5-8fc0-4992-918c-2425fb05da1b req-5ed87316-4596-401d-97f4-a2f2547ff3cc service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:46.564128 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-b886eba5-8fc0-4992-918c-2425fb05da1b req-5ed87316-4596-401d-97f4-a2f2547ff3cc service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:46.592682 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-b886eba5-8fc0-4992-918c-2425fb05da1b req-5ed87316-4596-401d-97f4-a2f2547ff3cc service nova] Creating event network-changed:b18d9b3a-6ec1-47b6-83c8-9f36631f8f7c for instance 663b2cc6-7a55-406a-b56f-86047b0e514d on n-h2-860284-1 Oct 04 21:46:46.602690 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-b886eba5-8fc0-4992-918c-2425fb05da1b req-5ed87316-4596-401d-97f4-a2f2547ff3cc service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079442 Oct 04 21:46:46.605810 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 468/942] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:46:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:46:46.775736 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-9b444f52-c28f-4b88-abb0-8b076e220774 req-c28c070b-dfff-425f-bd35-93346cb5fc7f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e8281d2-9de4-42eb-94cc-417be864315d", "tag": "291eba78-3b41-496a-92b2-60808ec215af"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:46:46.803871 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-9b444f52-c28f-4b88-abb0-8b076e220774 req-c28c070b-dfff-425f-bd35-93346cb5fc7f service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:46.804731 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-9b444f52-c28f-4b88-abb0-8b076e220774 req-c28c070b-dfff-425f-bd35-93346cb5fc7f service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:46.805191 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-9b444f52-c28f-4b88-abb0-8b076e220774 req-c28c070b-dfff-425f-bd35-93346cb5fc7f service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:46.837393 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-9b444f52-c28f-4b88-abb0-8b076e220774 req-c28c070b-dfff-425f-bd35-93346cb5fc7f service nova] Creating event network-changed:291eba78-3b41-496a-92b2-60808ec215af for instance 4e8281d2-9de4-42eb-94cc-417be864315d on n-h1-860284-1 Oct 04 21:46:46.842665 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-9b444f52-c28f-4b88-abb0-8b076e220774 req-c28c070b-dfff-425f-bd35-93346cb5fc7f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072548 Oct 04 21:46:46.844412 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 469/943] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:46:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:46:46.853707 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-eda7702c-087c-4579-98e4-ba2074ce67aa tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:46.854583 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-eda7702c-087c-4579-98e4-ba2074ce67aa tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] [instance: e3380b36-6aba-4736-bcbc-f0058f806d55] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:46.869013 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-eda7702c-087c-4579-98e4-ba2074ce67aa tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:46.870044 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-eda7702c-087c-4579-98e4-ba2074ce67aa tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:46.870740 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-eda7702c-087c-4579-98e4-ba2074ce67aa tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:46.871732 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-eda7702c-087c-4579-98e4-ba2074ce67aa tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:46.872430 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-eda7702c-087c-4579-98e4-ba2074ce67aa tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:46.873077 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-eda7702c-087c-4579-98e4-ba2074ce67aa tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:47.060249 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-eabde067-950d-4195-b21d-ad76e49917ad tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ad048becf474fb972d4291422d810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dcfc7024fc49388c4bd5f25f03e60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:47.080936 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-eabde067-950d-4195-b21d-ad76e49917ad tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/4e8281d2-9de4-42eb-94cc-417be864315d" status: 200 len: 1311 microversion: 2.1 time: 0.583496 Oct 04 21:46:47.096190 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 475/944] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:46 2022] GET /compute/v2.1/servers/4e8281d2-9de4-42eb-94cc-417be864315d => generated 1311 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:47.110336 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-000f220e-33fa-4ab3-bde8-8304f88cd441 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:47.112402 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-000f220e-33fa-4ab3-bde8-8304f88cd441 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: 424a22f0-ccc3-4fec-bf38-4aaf924928e3] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:47.123819 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-000f220e-33fa-4ab3-bde8-8304f88cd441 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:47.124834 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-000f220e-33fa-4ab3-bde8-8304f88cd441 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:47.125462 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-000f220e-33fa-4ab3-bde8-8304f88cd441 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:47.127423 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-000f220e-33fa-4ab3-bde8-8304f88cd441 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:47.128644 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-000f220e-33fa-4ab3-bde8-8304f88cd441 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:47.129311 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-000f220e-33fa-4ab3-bde8-8304f88cd441 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:47.262470 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-000f220e-33fa-4ab3-bde8-8304f88cd441 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:47.274854 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-000f220e-33fa-4ab3-bde8-8304f88cd441 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/424a22f0-ccc3-4fec-bf38-4aaf924928e3" status: 200 len: 1336 microversion: 2.1 time: 0.176749 Oct 04 21:46:47.276257 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 476/945] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:47 2022] GET /compute/v2.1/servers/424a22f0-ccc3-4fec-bf38-4aaf924928e3 => generated 1336 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:47.294864 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-4fca4583-97df-4222-a89b-a100e1a09d6b tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:47.295772 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-4fca4583-97df-4222-a89b-a100e1a09d6b tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] [instance: 7512d9d6-ab41-453e-bb9d-8e0861aa37f7] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:47.328411 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4fca4583-97df-4222-a89b-a100e1a09d6b tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:47.329144 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4fca4583-97df-4222-a89b-a100e1a09d6b tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:47.341984 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4fca4583-97df-4222-a89b-a100e1a09d6b tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:47.346914 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4fca4583-97df-4222-a89b-a100e1a09d6b tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:47.347529 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4fca4583-97df-4222-a89b-a100e1a09d6b tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:47.348000 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4fca4583-97df-4222-a89b-a100e1a09d6b tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:47.349545 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-eda7702c-087c-4579-98e4-ba2074ce67aa tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87616cd16995468ab7febf5aa4b284db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e3bf9149434d34b6762aaeef1478ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:47.373121 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-eda7702c-087c-4579-98e4-ba2074ce67aa tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] 10.222.0.43 "GET /compute/v2.1/servers/e3380b36-6aba-4736-bcbc-f0058f806d55" status: 200 len: 1471 microversion: 2.1 time: 0.527093 Oct 04 21:46:47.394005 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 470/946] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:46 2022] GET /compute/v2.1/servers/e3380b36-6aba-4736-bcbc-f0058f806d55 => generated 1471 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:47.543503 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-dd464db2-e01f-4ea7-9136-d1e61fc50733 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:47.544123 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-dd464db2-e01f-4ea7-9136-d1e61fc50733 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] [instance: 663b2cc6-7a55-406a-b56f-86047b0e514d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:47.559753 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dd464db2-e01f-4ea7-9136-d1e61fc50733 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:47.560286 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dd464db2-e01f-4ea7-9136-d1e61fc50733 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:47.560730 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dd464db2-e01f-4ea7-9136-d1e61fc50733 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:47.561517 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dd464db2-e01f-4ea7-9136-d1e61fc50733 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:47.561903 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dd464db2-e01f-4ea7-9136-d1e61fc50733 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:47.562315 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dd464db2-e01f-4ea7-9136-d1e61fc50733 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:47.769846 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-4fca4583-97df-4222-a89b-a100e1a09d6b tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:47.778585 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-4fca4583-97df-4222-a89b-a100e1a09d6b tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:47.780285 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-4fca4583-97df-4222-a89b-a100e1a09d6b tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:47.781609 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-4fca4583-97df-4222-a89b-a100e1a09d6b tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] 10.222.0.43 "GET /compute/v2.1/servers/7512d9d6-ab41-453e-bb9d-8e0861aa37f7" status: 200 len: 1362 microversion: 2.25 time: 0.495204 Oct 04 21:46:47.798183 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 477/947] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:46:47 2022] GET /compute/v2.1/servers/7512d9d6-ab41-453e-bb9d-8e0861aa37f7 => generated 1362 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:46:47.827278 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-dd464db2-e01f-4ea7-9136-d1e61fc50733 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29842a669a20408b881105135f76cb0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39edf587afe94b60911198aa0bb61613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:47.837804 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-dd464db2-e01f-4ea7-9136-d1e61fc50733 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] 10.222.0.43 "GET /compute/v2.1/servers/663b2cc6-7a55-406a-b56f-86047b0e514d" status: 200 len: 1316 microversion: 2.1 time: 0.298043 Oct 04 21:46:47.841042 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 471/948] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:47 2022] GET /compute/v2.1/servers/663b2cc6-7a55-406a-b56f-86047b0e514d => generated 1316 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:46:47.948516 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-e9ccd2d4-168d-4e0c-9a30-28e611d290cb tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-700910729", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452"}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:46:48.008790 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.network.neutron [None req-e9ccd2d4-168d-4e0c-9a30-28e611d290cb tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] validate_networks() for None {{(pid=134102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:46:48.109804 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-975374ee-7443-4029-99ba-dcc2044a795e tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:48.111986 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-975374ee-7443-4029-99ba-dcc2044a795e tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 4e8281d2-9de4-42eb-94cc-417be864315d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:48.121013 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-975374ee-7443-4029-99ba-dcc2044a795e tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:48.121519 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-975374ee-7443-4029-99ba-dcc2044a795e tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:48.123075 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-975374ee-7443-4029-99ba-dcc2044a795e tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:48.123837 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-975374ee-7443-4029-99ba-dcc2044a795e tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:48.124311 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-975374ee-7443-4029-99ba-dcc2044a795e tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:48.124743 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-975374ee-7443-4029-99ba-dcc2044a795e tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:48.145719 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:46:48.356026 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-e9ccd2d4-168d-4e0c-9a30-28e611d290cb tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Flavor limits 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:46:48.356756 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-e9ccd2d4-168d-4e0c-9a30-28e611d290cb tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Image limits 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:46:48.357289 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-e9ccd2d4-168d-4e0c-9a30-28e611d290cb tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Flavor pref 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:46:48.357855 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-e9ccd2d4-168d-4e0c-9a30-28e611d290cb tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Image pref 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:46:48.358396 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-e9ccd2d4-168d-4e0c-9a30-28e611d290cb tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:46:48.359013 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-975374ee-7443-4029-99ba-dcc2044a795e tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ad048becf474fb972d4291422d810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dcfc7024fc49388c4bd5f25f03e60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:48.371284 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e9ccd2d4-168d-4e0c-9a30-28e611d290cb tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:48.371871 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-975374ee-7443-4029-99ba-dcc2044a795e tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/4e8281d2-9de4-42eb-94cc-417be864315d" status: 200 len: 1311 microversion: 2.1 time: 0.265589 Oct 04 21:46:48.373029 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 472/949] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:48 2022] GET /compute/v2.1/servers/4e8281d2-9de4-42eb-94cc-417be864315d => generated 1311 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:48.374002 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e9ccd2d4-168d-4e0c-9a30-28e611d290cb tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:48.374679 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e9ccd2d4-168d-4e0c-9a30-28e611d290cb tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:48.375875 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e9ccd2d4-168d-4e0c-9a30-28e611d290cb tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:48.376513 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e9ccd2d4-168d-4e0c-9a30-28e611d290cb tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:48.377089 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e9ccd2d4-168d-4e0c-9a30-28e611d290cb tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:48.385621 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-0988ecc0-aeb2-4025-ae0b-4f2915ce47d0 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:48.387159 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-0988ecc0-aeb2-4025-ae0b-4f2915ce47d0 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] [instance: 34276621-d087-478b-81c7-bdf5e38efc69] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:48.398222 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-e9ccd2d4-168d-4e0c-9a30-28e611d290cb tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Getting quotas for project 00081ff1d1aa41cbad345326b337093a. Resources: {'instances', 'ram', 'cores'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:46:48.402069 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0988ecc0-aeb2-4025-ae0b-4f2915ce47d0 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:48.402982 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0988ecc0-aeb2-4025-ae0b-4f2915ce47d0 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:48.403780 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0988ecc0-aeb2-4025-ae0b-4f2915ce47d0 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:48.403983 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-e9ccd2d4-168d-4e0c-9a30-28e611d290cb tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Getting quotas for user 7614aeaedd1947b88031fb55ca4783ae and project 00081ff1d1aa41cbad345326b337093a. Resources: {'instances', 'ram', 'cores'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:46:48.405136 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0988ecc0-aeb2-4025-ae0b-4f2915ce47d0 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:48.406256 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0988ecc0-aeb2-4025-ae0b-4f2915ce47d0 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:48.407108 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0988ecc0-aeb2-4025-ae0b-4f2915ce47d0 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:48.419674 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-e9ccd2d4-168d-4e0c-9a30-28e611d290cb tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Going to run 1 instances... {{(pid=134102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:46:48.422096 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-e9ccd2d4-168d-4e0c-9a30-28e611d290cb tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] [instance: 59a1880f-2802-4e72-9a17-b966cfec8fe9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='58548514-5dac-426c-81f5-19e3fba33e23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:46:48.473227 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-e9ccd2d4-168d-4e0c-9a30-28e611d290cb tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.672147 Oct 04 21:46:48.473897 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 478/950] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 21:46:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 676 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:46:48.479997 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-6f50d61d-75e6-48c1-9997-44813cc51cfd tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:48.480895 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-6f50d61d-75e6-48c1-9997-44813cc51cfd tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: 424a22f0-ccc3-4fec-bf38-4aaf924928e3] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:48.491086 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6f50d61d-75e6-48c1-9997-44813cc51cfd tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:48.492043 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6f50d61d-75e6-48c1-9997-44813cc51cfd tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:48.494116 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6f50d61d-75e6-48c1-9997-44813cc51cfd tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:48.495675 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6f50d61d-75e6-48c1-9997-44813cc51cfd tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:48.496918 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6f50d61d-75e6-48c1-9997-44813cc51cfd tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:48.497606 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6f50d61d-75e6-48c1-9997-44813cc51cfd tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:48.786026 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-0988ecc0-aeb2-4025-ae0b-4f2915ce47d0 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1789bb97219a4e1591632126812ea6df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da67fc95e2814f4086df020f4c475764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:48.809510 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-0988ecc0-aeb2-4025-ae0b-4f2915ce47d0 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] 10.222.0.43 "GET /compute/v2.1/servers/34276621-d087-478b-81c7-bdf5e38efc69" status: 200 len: 1586 microversion: 2.1 time: 0.429569 Oct 04 21:46:48.826149 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 473/951] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:48 2022] GET /compute/v2.1/servers/34276621-d087-478b-81c7-bdf5e38efc69 => generated 1586 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:48.826677 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-6f50d61d-75e6-48c1-9997-44813cc51cfd tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:48.827632 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-6f50d61d-75e6-48c1-9997-44813cc51cfd tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/424a22f0-ccc3-4fec-bf38-4aaf924928e3" status: 200 len: 1378 microversion: 2.1 time: 0.352171 Oct 04 21:46:48.828692 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 479/952] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:48 2022] GET /compute/v2.1/servers/424a22f0-ccc3-4fec-bf38-4aaf924928e3 => generated 1378 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:48.834821 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-4147ef2b-6c0c-4289-be51-18b4d197e6d4 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:48.835572 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-4147ef2b-6c0c-4289-be51-18b4d197e6d4 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] [instance: 59a1880f-2802-4e72-9a17-b966cfec8fe9] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:48.884729 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-b0a5c0f1-9cdc-40c9-8fae-c25e9f9eb834 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:48.886595 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-b0a5c0f1-9cdc-40c9-8fae-c25e9f9eb834 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] [instance: e3380b36-6aba-4736-bcbc-f0058f806d55] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:48.903430 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b0a5c0f1-9cdc-40c9-8fae-c25e9f9eb834 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:48.904935 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b0a5c0f1-9cdc-40c9-8fae-c25e9f9eb834 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:48.906035 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b0a5c0f1-9cdc-40c9-8fae-c25e9f9eb834 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:48.908581 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b0a5c0f1-9cdc-40c9-8fae-c25e9f9eb834 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:48.909748 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b0a5c0f1-9cdc-40c9-8fae-c25e9f9eb834 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:48.911623 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b0a5c0f1-9cdc-40c9-8fae-c25e9f9eb834 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:48.913429 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-4147ef2b-6c0c-4289-be51-18b4d197e6d4 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7614aeaedd1947b88031fb55ca4783ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00081ff1d1aa41cbad345326b337093a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:48.926539 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-4147ef2b-6c0c-4289-be51-18b4d197e6d4 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] 10.222.0.43 "GET /compute/v2.1/servers/59a1880f-2802-4e72-9a17-b966cfec8fe9" status: 200 len: 1216 microversion: 2.1 time: 0.096603 Oct 04 21:46:48.928659 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 480/953] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:48 2022] GET /compute/v2.1/servers/59a1880f-2802-4e72-9a17-b966cfec8fe9 => generated 1216 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:48.934962 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-b0829c51-cf0f-49bc-835f-1d6855317afe tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:48.935596 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-b0829c51-cf0f-49bc-835f-1d6855317afe tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] [instance: 7512d9d6-ab41-453e-bb9d-8e0861aa37f7] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:48.957752 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b0829c51-cf0f-49bc-835f-1d6855317afe tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:48.958471 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b0829c51-cf0f-49bc-835f-1d6855317afe tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:48.958961 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b0829c51-cf0f-49bc-835f-1d6855317afe tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:48.960812 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b0829c51-cf0f-49bc-835f-1d6855317afe tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:48.961518 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b0829c51-cf0f-49bc-835f-1d6855317afe tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:48.962075 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b0829c51-cf0f-49bc-835f-1d6855317afe tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:49.207086 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-b0829c51-cf0f-49bc-835f-1d6855317afe tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:49.219213 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-b0829c51-cf0f-49bc-835f-1d6855317afe tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:49.222792 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-b0829c51-cf0f-49bc-835f-1d6855317afe tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:49.226577 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-b0829c51-cf0f-49bc-835f-1d6855317afe tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] 10.222.0.43 "GET /compute/v2.1/servers/7512d9d6-ab41-453e-bb9d-8e0861aa37f7" status: 200 len: 1362 microversion: 2.25 time: 0.296423 Oct 04 21:46:49.228268 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 481/954] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:46:48 2022] GET /compute/v2.1/servers/7512d9d6-ab41-453e-bb9d-8e0861aa37f7 => generated 1362 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:46:49.235242 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-7be4e31b-2113-4b1d-8706-f6f72bf0ab42 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:49.237432 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-7be4e31b-2113-4b1d-8706-f6f72bf0ab42 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] [instance: 663b2cc6-7a55-406a-b56f-86047b0e514d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:49.242975 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-b0a5c0f1-9cdc-40c9-8fae-c25e9f9eb834 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87616cd16995468ab7febf5aa4b284db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e3bf9149434d34b6762aaeef1478ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:49.262012 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-b0a5c0f1-9cdc-40c9-8fae-c25e9f9eb834 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] 10.222.0.43 "GET /compute/v2.1/servers/e3380b36-6aba-4736-bcbc-f0058f806d55" status: 200 len: 1471 microversion: 2.1 time: 0.431473 Oct 04 21:46:49.265688 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 474/955] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:48 2022] GET /compute/v2.1/servers/e3380b36-6aba-4736-bcbc-f0058f806d55 => generated 1471 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:49.281146 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7be4e31b-2113-4b1d-8706-f6f72bf0ab42 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:49.283170 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7be4e31b-2113-4b1d-8706-f6f72bf0ab42 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:49.283840 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7be4e31b-2113-4b1d-8706-f6f72bf0ab42 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:49.284752 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7be4e31b-2113-4b1d-8706-f6f72bf0ab42 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:49.285409 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7be4e31b-2113-4b1d-8706-f6f72bf0ab42 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:49.286078 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7be4e31b-2113-4b1d-8706-f6f72bf0ab42 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:49.291226 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-c5bcae28-37f1-42ac-ac91-cc8d081b3867 req-f417f2ef-541c-4c44-9d92-61efd455dffc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34276621-d087-478b-81c7-bdf5e38efc69", "tag": "80b76ccd-8248-4ae2-ae94-68b23a4a9c2c"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:46:49.311783 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-c5bcae28-37f1-42ac-ac91-cc8d081b3867 req-f417f2ef-541c-4c44-9d92-61efd455dffc service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:49.312864 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-c5bcae28-37f1-42ac-ac91-cc8d081b3867 req-f417f2ef-541c-4c44-9d92-61efd455dffc service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:49.313656 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-c5bcae28-37f1-42ac-ac91-cc8d081b3867 req-f417f2ef-541c-4c44-9d92-61efd455dffc service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:49.341610 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-c5bcae28-37f1-42ac-ac91-cc8d081b3867 req-f417f2ef-541c-4c44-9d92-61efd455dffc service nova] Creating event network-changed:80b76ccd-8248-4ae2-ae94-68b23a4a9c2c for instance 34276621-d087-478b-81c7-bdf5e38efc69 on n-h2-860284-1 Oct 04 21:46:49.347263 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-c5bcae28-37f1-42ac-ac91-cc8d081b3867 req-f417f2ef-541c-4c44-9d92-61efd455dffc service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064168 Oct 04 21:46:49.348276 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 475/956] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:46:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:46:49.354343 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-694b40c0-ae76-45f4-a973-11926959bbf4 req-a0ee65ef-c363-4994-92f7-c827ba6ec94d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7512d9d6-ab41-453e-bb9d-8e0861aa37f7", "name": "network-vif-plugged", "status": "completed", "tag": "330dc731-c16a-47f0-a849-93d182a330a4"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:46:49.364904 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-694b40c0-ae76-45f4-a973-11926959bbf4 req-a0ee65ef-c363-4994-92f7-c827ba6ec94d service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:49.365896 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-694b40c0-ae76-45f4-a973-11926959bbf4 req-a0ee65ef-c363-4994-92f7-c827ba6ec94d service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:49.366033 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-694b40c0-ae76-45f4-a973-11926959bbf4 req-a0ee65ef-c363-4994-92f7-c827ba6ec94d service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:49.380141 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-694b40c0-ae76-45f4-a973-11926959bbf4 req-a0ee65ef-c363-4994-92f7-c827ba6ec94d service nova] Creating event network-vif-plugged:330dc731-c16a-47f0-a849-93d182a330a4 for instance 7512d9d6-ab41-453e-bb9d-8e0861aa37f7 on n-h2-860284-1 Oct 04 21:46:49.386298 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-694b40c0-ae76-45f4-a973-11926959bbf4 req-a0ee65ef-c363-4994-92f7-c827ba6ec94d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036486 Oct 04 21:46:49.387330 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 476/957] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:46:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:46:49.396413 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-850121b6-4203-402e-abcb-23edd9d0f167 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:49.398166 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-850121b6-4203-402e-abcb-23edd9d0f167 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 4e8281d2-9de4-42eb-94cc-417be864315d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:49.404837 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-850121b6-4203-402e-abcb-23edd9d0f167 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:49.405339 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-850121b6-4203-402e-abcb-23edd9d0f167 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:49.405776 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-850121b6-4203-402e-abcb-23edd9d0f167 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:49.406536 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-850121b6-4203-402e-abcb-23edd9d0f167 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:49.407067 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-850121b6-4203-402e-abcb-23edd9d0f167 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:49.407404 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-850121b6-4203-402e-abcb-23edd9d0f167 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:49.534575 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-7be4e31b-2113-4b1d-8706-f6f72bf0ab42 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29842a669a20408b881105135f76cb0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39edf587afe94b60911198aa0bb61613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:49.552503 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-7be4e31b-2113-4b1d-8706-f6f72bf0ab42 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] 10.222.0.43 "GET /compute/v2.1/servers/663b2cc6-7a55-406a-b56f-86047b0e514d" status: 200 len: 1316 microversion: 2.1 time: 0.322196 Oct 04 21:46:49.554163 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 482/958] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:49 2022] GET /compute/v2.1/servers/663b2cc6-7a55-406a-b56f-86047b0e514d => generated 1316 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:49.617810 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-850121b6-4203-402e-abcb-23edd9d0f167 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ad048becf474fb972d4291422d810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dcfc7024fc49388c4bd5f25f03e60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:49.626715 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-850121b6-4203-402e-abcb-23edd9d0f167 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/4e8281d2-9de4-42eb-94cc-417be864315d" status: 200 len: 1311 microversion: 2.1 time: 0.234431 Oct 04 21:46:49.627529 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 477/959] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:49 2022] GET /compute/v2.1/servers/4e8281d2-9de4-42eb-94cc-417be864315d => generated 1311 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:46:49.894249 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-4a59be78-f677-4a2f-9611-3c60f36b67e6 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:49.895504 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-4a59be78-f677-4a2f-9611-3c60f36b67e6 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: 424a22f0-ccc3-4fec-bf38-4aaf924928e3] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:49.915128 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4a59be78-f677-4a2f-9611-3c60f36b67e6 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:49.915730 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4a59be78-f677-4a2f-9611-3c60f36b67e6 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:49.916300 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4a59be78-f677-4a2f-9611-3c60f36b67e6 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:49.917133 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4a59be78-f677-4a2f-9611-3c60f36b67e6 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:49.917606 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4a59be78-f677-4a2f-9611-3c60f36b67e6 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:49.918042 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4a59be78-f677-4a2f-9611-3c60f36b67e6 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:49.962630 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-3e5ca740-4b11-4ef5-9c50-25f2f4a4446d tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:49.963115 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-3e5ca740-4b11-4ef5-9c50-25f2f4a4446d tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] [instance: 59a1880f-2802-4e72-9a17-b966cfec8fe9] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:49.980559 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3e5ca740-4b11-4ef5-9c50-25f2f4a4446d tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:49.981534 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3e5ca740-4b11-4ef5-9c50-25f2f4a4446d tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:49.982460 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3e5ca740-4b11-4ef5-9c50-25f2f4a4446d tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:49.983965 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3e5ca740-4b11-4ef5-9c50-25f2f4a4446d tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:49.985004 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3e5ca740-4b11-4ef5-9c50-25f2f4a4446d tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:49.985947 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3e5ca740-4b11-4ef5-9c50-25f2f4a4446d tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:50.123762 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-3e5ca740-4b11-4ef5-9c50-25f2f4a4446d tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7614aeaedd1947b88031fb55ca4783ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00081ff1d1aa41cbad345326b337093a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:50.136650 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-3e5ca740-4b11-4ef5-9c50-25f2f4a4446d tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] 10.222.0.43 "GET /compute/v2.1/servers/59a1880f-2802-4e72-9a17-b966cfec8fe9" status: 200 len: 1220 microversion: 2.1 time: 0.178766 Oct 04 21:46:50.137893 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 478/960] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:49 2022] GET /compute/v2.1/servers/59a1880f-2802-4e72-9a17-b966cfec8fe9 => generated 1220 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:50.167857 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-4a59be78-f677-4a2f-9611-3c60f36b67e6 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:50.176312 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-4a59be78-f677-4a2f-9611-3c60f36b67e6 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/424a22f0-ccc3-4fec-bf38-4aaf924928e3" status: 200 len: 1378 microversion: 2.1 time: 0.286579 Oct 04 21:46:50.177162 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 483/961] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:49 2022] GET /compute/v2.1/servers/424a22f0-ccc3-4fec-bf38-4aaf924928e3 => generated 1378 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:50.277073 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-34bcb7e9-4a0e-4239-a064-36f27675436d tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:50.277717 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-34bcb7e9-4a0e-4239-a064-36f27675436d tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] [instance: 7512d9d6-ab41-453e-bb9d-8e0861aa37f7] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:50.285899 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-34bcb7e9-4a0e-4239-a064-36f27675436d tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:50.286563 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-34bcb7e9-4a0e-4239-a064-36f27675436d tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:50.287296 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-34bcb7e9-4a0e-4239-a064-36f27675436d tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:50.288214 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-34bcb7e9-4a0e-4239-a064-36f27675436d tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:50.289023 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-34bcb7e9-4a0e-4239-a064-36f27675436d tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:50.289622 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-34bcb7e9-4a0e-4239-a064-36f27675436d tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:50.294190 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-ba962561-fe32-4022-a965-15a65e71d80a tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:50.294857 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-ba962561-fe32-4022-a965-15a65e71d80a tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] [instance: e3380b36-6aba-4736-bcbc-f0058f806d55] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:50.301427 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ba962561-fe32-4022-a965-15a65e71d80a tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:50.302169 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ba962561-fe32-4022-a965-15a65e71d80a tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:50.302641 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ba962561-fe32-4022-a965-15a65e71d80a tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:50.303454 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ba962561-fe32-4022-a965-15a65e71d80a tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:50.303910 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ba962561-fe32-4022-a965-15a65e71d80a tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:50.304335 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ba962561-fe32-4022-a965-15a65e71d80a tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:50.507603 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-34bcb7e9-4a0e-4239-a064-36f27675436d tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:50.516144 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-ba962561-fe32-4022-a965-15a65e71d80a tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87616cd16995468ab7febf5aa4b284db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e3bf9149434d34b6762aaeef1478ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:50.516939 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-34bcb7e9-4a0e-4239-a064-36f27675436d tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:50.518440 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-34bcb7e9-4a0e-4239-a064-36f27675436d tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:50.519595 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-34bcb7e9-4a0e-4239-a064-36f27675436d tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] 10.222.0.43 "GET /compute/v2.1/servers/7512d9d6-ab41-453e-bb9d-8e0861aa37f7" status: 200 len: 1362 microversion: 2.25 time: 0.247545 Oct 04 21:46:50.520197 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 479/962] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:46:50 2022] GET /compute/v2.1/servers/7512d9d6-ab41-453e-bb9d-8e0861aa37f7 => generated 1362 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:46:50.526996 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-ba962561-fe32-4022-a965-15a65e71d80a tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] 10.222.0.43 "GET /compute/v2.1/servers/e3380b36-6aba-4736-bcbc-f0058f806d55" status: 200 len: 1471 microversion: 2.1 time: 0.236742 Oct 04 21:46:50.527598 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 484/963] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:50 2022] GET /compute/v2.1/servers/e3380b36-6aba-4736-bcbc-f0058f806d55 => generated 1471 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:50.588240 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-c3040235-090e-4647-ac1d-9bce6f16e005 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:50.589102 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-c3040235-090e-4647-ac1d-9bce6f16e005 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] [instance: 663b2cc6-7a55-406a-b56f-86047b0e514d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:50.596213 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c3040235-090e-4647-ac1d-9bce6f16e005 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:50.596722 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c3040235-090e-4647-ac1d-9bce6f16e005 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:50.597383 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c3040235-090e-4647-ac1d-9bce6f16e005 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:50.599002 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c3040235-090e-4647-ac1d-9bce6f16e005 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:50.599002 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c3040235-090e-4647-ac1d-9bce6f16e005 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:50.599203 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c3040235-090e-4647-ac1d-9bce6f16e005 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:50.665021 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-b22bdf23-be0e-410a-a90a-9a3a82ab1ff4 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:50.666449 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-b22bdf23-be0e-410a-a90a-9a3a82ab1ff4 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 4e8281d2-9de4-42eb-94cc-417be864315d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:50.673596 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b22bdf23-be0e-410a-a90a-9a3a82ab1ff4 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:50.674358 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b22bdf23-be0e-410a-a90a-9a3a82ab1ff4 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:50.674987 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b22bdf23-be0e-410a-a90a-9a3a82ab1ff4 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:50.675877 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b22bdf23-be0e-410a-a90a-9a3a82ab1ff4 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:50.676497 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b22bdf23-be0e-410a-a90a-9a3a82ab1ff4 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:50.677340 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b22bdf23-be0e-410a-a90a-9a3a82ab1ff4 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:50.707081 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:46:51.066291 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-c3040235-090e-4647-ac1d-9bce6f16e005 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29842a669a20408b881105135f76cb0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39edf587afe94b60911198aa0bb61613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:51.081700 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-c3040235-090e-4647-ac1d-9bce6f16e005 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] 10.222.0.43 "GET /compute/v2.1/servers/663b2cc6-7a55-406a-b56f-86047b0e514d" status: 200 len: 1316 microversion: 2.1 time: 0.496323 Oct 04 21:46:51.086444 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 480/964] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:50 2022] GET /compute/v2.1/servers/663b2cc6-7a55-406a-b56f-86047b0e514d => generated 1316 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:51.163754 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-ade6df43-679f-4658-888e-2efe9fd38129 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:51.165029 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-ade6df43-679f-4658-888e-2efe9fd38129 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] [instance: 59a1880f-2802-4e72-9a17-b966cfec8fe9] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:51.170815 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-b22bdf23-be0e-410a-a90a-9a3a82ab1ff4 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ad048becf474fb972d4291422d810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dcfc7024fc49388c4bd5f25f03e60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:51.172621 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ade6df43-679f-4658-888e-2efe9fd38129 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:51.174599 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ade6df43-679f-4658-888e-2efe9fd38129 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:51.175256 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ade6df43-679f-4658-888e-2efe9fd38129 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:51.176483 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ade6df43-679f-4658-888e-2efe9fd38129 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:51.177375 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ade6df43-679f-4658-888e-2efe9fd38129 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:51.178603 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ade6df43-679f-4658-888e-2efe9fd38129 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:51.182433 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-b22bdf23-be0e-410a-a90a-9a3a82ab1ff4 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/4e8281d2-9de4-42eb-94cc-417be864315d" status: 200 len: 1311 microversion: 2.1 time: 0.521350 Oct 04 21:46:51.183695 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 485/965] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:50 2022] GET /compute/v2.1/servers/4e8281d2-9de4-42eb-94cc-417be864315d => generated 1311 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:51.202713 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-2e3014a3-f61f-4bed-84f8-4d45c34de013 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:51.203835 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-2e3014a3-f61f-4bed-84f8-4d45c34de013 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: 424a22f0-ccc3-4fec-bf38-4aaf924928e3] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:51.224508 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2e3014a3-f61f-4bed-84f8-4d45c34de013 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:51.225918 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2e3014a3-f61f-4bed-84f8-4d45c34de013 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:51.226624 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2e3014a3-f61f-4bed-84f8-4d45c34de013 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:51.227937 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2e3014a3-f61f-4bed-84f8-4d45c34de013 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:51.229304 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2e3014a3-f61f-4bed-84f8-4d45c34de013 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:51.230075 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2e3014a3-f61f-4bed-84f8-4d45c34de013 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:51.653163 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-ade6df43-679f-4658-888e-2efe9fd38129 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7614aeaedd1947b88031fb55ca4783ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00081ff1d1aa41cbad345326b337093a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:51.664506 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-ade6df43-679f-4658-888e-2efe9fd38129 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] 10.222.0.43 "GET /compute/v2.1/servers/59a1880f-2802-4e72-9a17-b966cfec8fe9" status: 200 len: 1268 microversion: 2.1 time: 0.507022 Oct 04 21:46:51.681101 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 481/966] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:51 2022] GET /compute/v2.1/servers/59a1880f-2802-4e72-9a17-b966cfec8fe9 => generated 1268 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:51.686514 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-24b2c4ef-8786-4163-971c-d5b15137b6bb tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:51.687148 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-24b2c4ef-8786-4163-971c-d5b15137b6bb tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] [instance: 7512d9d6-ab41-453e-bb9d-8e0861aa37f7] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:51.695570 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-24b2c4ef-8786-4163-971c-d5b15137b6bb tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:51.696081 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-24b2c4ef-8786-4163-971c-d5b15137b6bb tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:51.696525 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-24b2c4ef-8786-4163-971c-d5b15137b6bb tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:51.697455 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-24b2c4ef-8786-4163-971c-d5b15137b6bb tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:51.697924 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-24b2c4ef-8786-4163-971c-d5b15137b6bb tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:51.699311 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-24b2c4ef-8786-4163-971c-d5b15137b6bb tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:51.967070 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-2e3014a3-f61f-4bed-84f8-4d45c34de013 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:51.981134 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-2e3014a3-f61f-4bed-84f8-4d45c34de013 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/424a22f0-ccc3-4fec-bf38-4aaf924928e3" status: 200 len: 1378 microversion: 2.1 time: 0.784202 Oct 04 21:46:51.982083 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 486/967] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:51 2022] GET /compute/v2.1/servers/424a22f0-ccc3-4fec-bf38-4aaf924928e3 => generated 1378 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:51.987713 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-4e92359a-de51-4000-a7d1-419aa50d5fe7 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:51.988517 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-4e92359a-de51-4000-a7d1-419aa50d5fe7 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] [instance: e3380b36-6aba-4736-bcbc-f0058f806d55] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:52.012516 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4e92359a-de51-4000-a7d1-419aa50d5fe7 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:52.013131 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4e92359a-de51-4000-a7d1-419aa50d5fe7 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:52.013648 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4e92359a-de51-4000-a7d1-419aa50d5fe7 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:52.014995 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4e92359a-de51-4000-a7d1-419aa50d5fe7 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:52.015554 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4e92359a-de51-4000-a7d1-419aa50d5fe7 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:52.016067 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4e92359a-de51-4000-a7d1-419aa50d5fe7 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:52.022628 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=18 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:46:52.026575 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-24b2c4ef-8786-4163-971c-d5b15137b6bb tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:52.039945 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-24b2c4ef-8786-4163-971c-d5b15137b6bb tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:52.041431 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-24b2c4ef-8786-4163-971c-d5b15137b6bb tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:52.044343 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-24b2c4ef-8786-4163-971c-d5b15137b6bb tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] 10.222.0.43 "GET /compute/v2.1/servers/7512d9d6-ab41-453e-bb9d-8e0861aa37f7" status: 200 len: 1362 microversion: 2.25 time: 0.376220 Oct 04 21:46:52.045167 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 482/968] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:46:51 2022] GET /compute/v2.1/servers/7512d9d6-ab41-453e-bb9d-8e0861aa37f7 => generated 1362 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:46:52.130158 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-51a3daf0-3f95-4422-949b-f962849d9ffc tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:52.131019 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-51a3daf0-3f95-4422-949b-f962849d9ffc tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] [instance: 663b2cc6-7a55-406a-b56f-86047b0e514d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:52.148408 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-51a3daf0-3f95-4422-949b-f962849d9ffc tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:52.149759 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-51a3daf0-3f95-4422-949b-f962849d9ffc tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:52.151251 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-51a3daf0-3f95-4422-949b-f962849d9ffc tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:52.152814 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-51a3daf0-3f95-4422-949b-f962849d9ffc tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:52.153311 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-51a3daf0-3f95-4422-949b-f962849d9ffc tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:52.154072 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-51a3daf0-3f95-4422-949b-f962849d9ffc tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:52.447818 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-4e92359a-de51-4000-a7d1-419aa50d5fe7 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87616cd16995468ab7febf5aa4b284db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e3bf9149434d34b6762aaeef1478ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:52.459713 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-4e92359a-de51-4000-a7d1-419aa50d5fe7 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] 10.222.0.43 "GET /compute/v2.1/servers/e3380b36-6aba-4736-bcbc-f0058f806d55" status: 200 len: 1471 microversion: 2.1 time: 0.476167 Oct 04 21:46:52.461186 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 487/969] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:51 2022] GET /compute/v2.1/servers/e3380b36-6aba-4736-bcbc-f0058f806d55 => generated 1471 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:52.466203 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-9cce56ca-ed3d-4397-9545-6ca858483149 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:52.467201 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-9cce56ca-ed3d-4397-9545-6ca858483149 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 4e8281d2-9de4-42eb-94cc-417be864315d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:52.475747 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9cce56ca-ed3d-4397-9545-6ca858483149 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:52.476700 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9cce56ca-ed3d-4397-9545-6ca858483149 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:52.477501 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9cce56ca-ed3d-4397-9545-6ca858483149 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:52.478600 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9cce56ca-ed3d-4397-9545-6ca858483149 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:52.479197 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9cce56ca-ed3d-4397-9545-6ca858483149 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:52.479749 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9cce56ca-ed3d-4397-9545-6ca858483149 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:52.564437 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-51a3daf0-3f95-4422-949b-f962849d9ffc tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29842a669a20408b881105135f76cb0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39edf587afe94b60911198aa0bb61613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:52.583820 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-51a3daf0-3f95-4422-949b-f962849d9ffc tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] 10.222.0.43 "GET /compute/v2.1/servers/663b2cc6-7a55-406a-b56f-86047b0e514d" status: 200 len: 1316 microversion: 2.1 time: 0.455238 Oct 04 21:46:52.585255 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 483/970] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:52 2022] GET /compute/v2.1/servers/663b2cc6-7a55-406a-b56f-86047b0e514d => generated 1316 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:46:52.692334 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-43405c3a-5993-40a6-b28c-8388b7213e77 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:52.694896 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-43405c3a-5993-40a6-b28c-8388b7213e77 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] [instance: 59a1880f-2802-4e72-9a17-b966cfec8fe9] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:52.707646 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-43405c3a-5993-40a6-b28c-8388b7213e77 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:52.709432 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-43405c3a-5993-40a6-b28c-8388b7213e77 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:52.710555 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-43405c3a-5993-40a6-b28c-8388b7213e77 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:52.712325 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-43405c3a-5993-40a6-b28c-8388b7213e77 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:52.713401 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-43405c3a-5993-40a6-b28c-8388b7213e77 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:52.715652 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-43405c3a-5993-40a6-b28c-8388b7213e77 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:52.933416 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-43405c3a-5993-40a6-b28c-8388b7213e77 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7614aeaedd1947b88031fb55ca4783ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00081ff1d1aa41cbad345326b337093a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:52.937906 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-9cce56ca-ed3d-4397-9545-6ca858483149 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ad048becf474fb972d4291422d810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dcfc7024fc49388c4bd5f25f03e60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:52.948409 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-43405c3a-5993-40a6-b28c-8388b7213e77 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] 10.222.0.43 "GET /compute/v2.1/servers/59a1880f-2802-4e72-9a17-b966cfec8fe9" status: 200 len: 1274 microversion: 2.1 time: 0.262629 Oct 04 21:46:52.950785 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 484/971] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:52 2022] GET /compute/v2.1/servers/59a1880f-2802-4e72-9a17-b966cfec8fe9 => generated 1274 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:46:52.958583 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-9cce56ca-ed3d-4397-9545-6ca858483149 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/4e8281d2-9de4-42eb-94cc-417be864315d" status: 200 len: 1311 microversion: 2.1 time: 0.488151 Oct 04 21:46:52.961702 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 488/972] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:52 2022] GET /compute/v2.1/servers/4e8281d2-9de4-42eb-94cc-417be864315d => generated 1311 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:53.011157 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-8cd68a7b-08ba-41ce-9d5c-512a34c18edf tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:53.012467 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-8cd68a7b-08ba-41ce-9d5c-512a34c18edf tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: 424a22f0-ccc3-4fec-bf38-4aaf924928e3] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:53.014070 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-7702943e-77d6-45dd-9d14-4491cb78c13b req-dd22f005-8f35-41ab-9adb-2dde64e3da21 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "424a22f0-ccc3-4fec-bf38-4aaf924928e3", "tag": "0fc2e8ca-ce8a-4b4a-992c-9e648d20829d"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:46:53.019267 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8cd68a7b-08ba-41ce-9d5c-512a34c18edf tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:53.020049 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8cd68a7b-08ba-41ce-9d5c-512a34c18edf tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:53.020666 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8cd68a7b-08ba-41ce-9d5c-512a34c18edf tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:53.022243 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8cd68a7b-08ba-41ce-9d5c-512a34c18edf tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:53.022946 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8cd68a7b-08ba-41ce-9d5c-512a34c18edf tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:53.023538 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8cd68a7b-08ba-41ce-9d5c-512a34c18edf tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:53.026322 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-7702943e-77d6-45dd-9d14-4491cb78c13b req-dd22f005-8f35-41ab-9adb-2dde64e3da21 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:53.026925 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-7702943e-77d6-45dd-9d14-4491cb78c13b req-dd22f005-8f35-41ab-9adb-2dde64e3da21 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:53.027370 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-7702943e-77d6-45dd-9d14-4491cb78c13b req-dd22f005-8f35-41ab-9adb-2dde64e3da21 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:53.041155 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-7702943e-77d6-45dd-9d14-4491cb78c13b req-dd22f005-8f35-41ab-9adb-2dde64e3da21 service nova] Creating event network-changed:0fc2e8ca-ce8a-4b4a-992c-9e648d20829d for instance 424a22f0-ccc3-4fec-bf38-4aaf924928e3 on n-h2-860284-1 Oct 04 21:46:53.046905 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-7702943e-77d6-45dd-9d14-4491cb78c13b req-dd22f005-8f35-41ab-9adb-2dde64e3da21 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041591 Oct 04 21:46:53.047913 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 485/973] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:46:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:46:53.073733 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-72d820a7-71e8-4a68-b72f-f2215b07c1fe tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:53.074896 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-72d820a7-71e8-4a68-b72f-f2215b07c1fe tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] [instance: 7512d9d6-ab41-453e-bb9d-8e0861aa37f7] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:53.081688 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-72d820a7-71e8-4a68-b72f-f2215b07c1fe tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:53.082197 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-72d820a7-71e8-4a68-b72f-f2215b07c1fe tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:53.082683 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-72d820a7-71e8-4a68-b72f-f2215b07c1fe tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:53.083427 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-72d820a7-71e8-4a68-b72f-f2215b07c1fe tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:53.083881 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-72d820a7-71e8-4a68-b72f-f2215b07c1fe tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:53.085080 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-72d820a7-71e8-4a68-b72f-f2215b07c1fe tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:53.447103 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-8cd68a7b-08ba-41ce-9d5c-512a34c18edf tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:53.462929 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-8cd68a7b-08ba-41ce-9d5c-512a34c18edf tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/424a22f0-ccc3-4fec-bf38-4aaf924928e3" status: 200 len: 1378 microversion: 2.1 time: 0.455329 Oct 04 21:46:53.478683 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-72d820a7-71e8-4a68-b72f-f2215b07c1fe tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:53.479838 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 489/974] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:53 2022] GET /compute/v2.1/servers/424a22f0-ccc3-4fec-bf38-4aaf924928e3 => generated 1378 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:46:53.488272 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-8b59a840-a284-42f2-bfdd-4b2efec8d1a6 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:53.492846 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-8b59a840-a284-42f2-bfdd-4b2efec8d1a6 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] [instance: e3380b36-6aba-4736-bcbc-f0058f806d55] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:53.499833 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-72d820a7-71e8-4a68-b72f-f2215b07c1fe tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:53.504775 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-72d820a7-71e8-4a68-b72f-f2215b07c1fe tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:53.508223 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8b59a840-a284-42f2-bfdd-4b2efec8d1a6 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:53.509932 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-72d820a7-71e8-4a68-b72f-f2215b07c1fe tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] 10.222.0.43 "GET /compute/v2.1/servers/7512d9d6-ab41-453e-bb9d-8e0861aa37f7" status: 200 len: 1362 microversion: 2.25 time: 0.442391 Oct 04 21:46:53.511189 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 486/975] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:46:53 2022] GET /compute/v2.1/servers/7512d9d6-ab41-453e-bb9d-8e0861aa37f7 => generated 1362 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:46:53.512798 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8b59a840-a284-42f2-bfdd-4b2efec8d1a6 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:53.513433 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8b59a840-a284-42f2-bfdd-4b2efec8d1a6 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:53.514389 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8b59a840-a284-42f2-bfdd-4b2efec8d1a6 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:53.515006 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8b59a840-a284-42f2-bfdd-4b2efec8d1a6 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:53.515585 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8b59a840-a284-42f2-bfdd-4b2efec8d1a6 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:53.610589 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-7a31a121-feba-49df-bd43-e0c5d2c28202 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:53.611603 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-7a31a121-feba-49df-bd43-e0c5d2c28202 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] [instance: 663b2cc6-7a55-406a-b56f-86047b0e514d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:53.621116 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7a31a121-feba-49df-bd43-e0c5d2c28202 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:53.621924 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7a31a121-feba-49df-bd43-e0c5d2c28202 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:53.622584 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7a31a121-feba-49df-bd43-e0c5d2c28202 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:53.623477 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7a31a121-feba-49df-bd43-e0c5d2c28202 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:53.624102 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7a31a121-feba-49df-bd43-e0c5d2c28202 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:53.624703 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7a31a121-feba-49df-bd43-e0c5d2c28202 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:53.923277 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-8b59a840-a284-42f2-bfdd-4b2efec8d1a6 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87616cd16995468ab7febf5aa4b284db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e3bf9149434d34b6762aaeef1478ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:53.941465 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-8b59a840-a284-42f2-bfdd-4b2efec8d1a6 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] 10.222.0.43 "GET /compute/v2.1/servers/e3380b36-6aba-4736-bcbc-f0058f806d55" status: 200 len: 1471 microversion: 2.1 time: 0.456826 Oct 04 21:46:53.954393 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 490/976] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:53 2022] GET /compute/v2.1/servers/e3380b36-6aba-4736-bcbc-f0058f806d55 => generated 1471 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:53.954393 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-9a2166d1-6edf-42c6-809c-eede1d67a09b req-54ee58b9-2e7d-459c-b957-24e85e02575f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e8281d2-9de4-42eb-94cc-417be864315d", "name": "network-vif-plugged", "status": "completed", "tag": "291eba78-3b41-496a-92b2-60808ec215af"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:46:53.964750 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-9a2166d1-6edf-42c6-809c-eede1d67a09b req-54ee58b9-2e7d-459c-b957-24e85e02575f service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:53.965331 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-9a2166d1-6edf-42c6-809c-eede1d67a09b req-54ee58b9-2e7d-459c-b957-24e85e02575f service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:53.965838 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-9a2166d1-6edf-42c6-809c-eede1d67a09b req-54ee58b9-2e7d-459c-b957-24e85e02575f service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:53.972673 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-7a31a121-feba-49df-bd43-e0c5d2c28202 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29842a669a20408b881105135f76cb0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39edf587afe94b60911198aa0bb61613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:53.979526 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-9a2166d1-6edf-42c6-809c-eede1d67a09b req-54ee58b9-2e7d-459c-b957-24e85e02575f service nova] Creating event network-vif-plugged:291eba78-3b41-496a-92b2-60808ec215af for instance 4e8281d2-9de4-42eb-94cc-417be864315d on n-h1-860284-1 Oct 04 21:46:53.985397 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-9a2166d1-6edf-42c6-809c-eede1d67a09b req-54ee58b9-2e7d-459c-b957-24e85e02575f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040053 Oct 04 21:46:53.989847 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 491/977] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:46:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:46:53.996414 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-7a31a121-feba-49df-bd43-e0c5d2c28202 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] 10.222.0.43 "GET /compute/v2.1/servers/663b2cc6-7a55-406a-b56f-86047b0e514d" status: 200 len: 1316 microversion: 2.1 time: 0.389738 Oct 04 21:46:53.998553 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 487/978] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:53 2022] GET /compute/v2.1/servers/663b2cc6-7a55-406a-b56f-86047b0e514d => generated 1316 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:54.004323 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-9edce348-139e-4142-a42e-9da1cfa650aa tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:54.005206 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-9edce348-139e-4142-a42e-9da1cfa650aa tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 4e8281d2-9de4-42eb-94cc-417be864315d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:54.008399 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-93360e50-d5aa-46e0-8952-fa419ec4f5a0 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:54.009626 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-93360e50-d5aa-46e0-8952-fa419ec4f5a0 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] [instance: 59a1880f-2802-4e72-9a17-b966cfec8fe9] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:54.013573 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9edce348-139e-4142-a42e-9da1cfa650aa tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:54.014383 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9edce348-139e-4142-a42e-9da1cfa650aa tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:54.015001 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9edce348-139e-4142-a42e-9da1cfa650aa tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:54.015901 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9edce348-139e-4142-a42e-9da1cfa650aa tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:54.016823 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9edce348-139e-4142-a42e-9da1cfa650aa tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:54.017434 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9edce348-139e-4142-a42e-9da1cfa650aa tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:54.017704 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-93360e50-d5aa-46e0-8952-fa419ec4f5a0 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:54.018195 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-93360e50-d5aa-46e0-8952-fa419ec4f5a0 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:54.018708 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-93360e50-d5aa-46e0-8952-fa419ec4f5a0 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:54.019443 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-93360e50-d5aa-46e0-8952-fa419ec4f5a0 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:54.019910 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-93360e50-d5aa-46e0-8952-fa419ec4f5a0 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:54.020344 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-93360e50-d5aa-46e0-8952-fa419ec4f5a0 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:54.059017 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=10 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:46:54.161796 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-93360e50-d5aa-46e0-8952-fa419ec4f5a0 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7614aeaedd1947b88031fb55ca4783ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00081ff1d1aa41cbad345326b337093a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:54.177520 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-93360e50-d5aa-46e0-8952-fa419ec4f5a0 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] 10.222.0.43 "GET /compute/v2.1/servers/59a1880f-2802-4e72-9a17-b966cfec8fe9" status: 200 len: 1274 microversion: 2.1 time: 0.184706 Oct 04 21:46:54.179708 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 492/979] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:53 2022] GET /compute/v2.1/servers/59a1880f-2802-4e72-9a17-b966cfec8fe9 => generated 1274 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:54.296418 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-9edce348-139e-4142-a42e-9da1cfa650aa tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ad048becf474fb972d4291422d810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dcfc7024fc49388c4bd5f25f03e60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:54.305205 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-9edce348-139e-4142-a42e-9da1cfa650aa tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/4e8281d2-9de4-42eb-94cc-417be864315d" status: 200 len: 1311 microversion: 2.1 time: 0.305201 Oct 04 21:46:54.305797 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 488/980] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:53 2022] GET /compute/v2.1/servers/4e8281d2-9de4-42eb-94cc-417be864315d => generated 1311 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:54.491165 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-0971d6d7-da9a-4cb6-9141-baac9979f0c0 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:54.491980 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-0971d6d7-da9a-4cb6-9141-baac9979f0c0 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: 424a22f0-ccc3-4fec-bf38-4aaf924928e3] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:54.494298 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:46:54.500130 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0971d6d7-da9a-4cb6-9141-baac9979f0c0 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:54.500731 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0971d6d7-da9a-4cb6-9141-baac9979f0c0 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:54.501240 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0971d6d7-da9a-4cb6-9141-baac9979f0c0 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:54.502072 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0971d6d7-da9a-4cb6-9141-baac9979f0c0 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:54.502682 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0971d6d7-da9a-4cb6-9141-baac9979f0c0 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:54.503187 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0971d6d7-da9a-4cb6-9141-baac9979f0c0 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:54.536385 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-ca470d7b-eed8-4502-acd5-470d904e952a tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:54.537040 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-ca470d7b-eed8-4502-acd5-470d904e952a tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] [instance: 7512d9d6-ab41-453e-bb9d-8e0861aa37f7] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:54.554170 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ca470d7b-eed8-4502-acd5-470d904e952a tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:54.554721 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ca470d7b-eed8-4502-acd5-470d904e952a tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:54.555168 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ca470d7b-eed8-4502-acd5-470d904e952a tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:54.555898 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ca470d7b-eed8-4502-acd5-470d904e952a tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:54.556547 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ca470d7b-eed8-4502-acd5-470d904e952a tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:54.556975 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ca470d7b-eed8-4502-acd5-470d904e952a tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:55.090056 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-0971d6d7-da9a-4cb6-9141-baac9979f0c0 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:55.098687 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-0971d6d7-da9a-4cb6-9141-baac9979f0c0 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/424a22f0-ccc3-4fec-bf38-4aaf924928e3" status: 200 len: 1378 microversion: 2.1 time: 0.612172 Oct 04 21:46:55.100001 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 493/981] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:54 2022] GET /compute/v2.1/servers/424a22f0-ccc3-4fec-bf38-4aaf924928e3 => generated 1378 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:55.104775 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-e3a1db1a-233b-4310-91aa-ff8ba25c5e80 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:55.105393 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-e3a1db1a-233b-4310-91aa-ff8ba25c5e80 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] [instance: e3380b36-6aba-4736-bcbc-f0058f806d55] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:55.111628 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e3a1db1a-233b-4310-91aa-ff8ba25c5e80 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:55.112201 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e3a1db1a-233b-4310-91aa-ff8ba25c5e80 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:55.112641 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e3a1db1a-233b-4310-91aa-ff8ba25c5e80 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:55.113354 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e3a1db1a-233b-4310-91aa-ff8ba25c5e80 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:55.113813 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e3a1db1a-233b-4310-91aa-ff8ba25c5e80 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:55.114241 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e3a1db1a-233b-4310-91aa-ff8ba25c5e80 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:55.171587 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-ca470d7b-eed8-4502-acd5-470d904e952a tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:55.180917 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-ca470d7b-eed8-4502-acd5-470d904e952a tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:55.182551 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-ca470d7b-eed8-4502-acd5-470d904e952a tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:55.183845 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-ca470d7b-eed8-4502-acd5-470d904e952a tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] 10.222.0.43 "GET /compute/v2.1/servers/7512d9d6-ab41-453e-bb9d-8e0861aa37f7" status: 200 len: 1559 microversion: 2.25 time: 0.651784 Oct 04 21:46:55.184520 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 489/982] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:46:54 2022] GET /compute/v2.1/servers/7512d9d6-ab41-453e-bb9d-8e0861aa37f7 => generated 1559 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:46:55.191665 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e0c6075d-d6cb-4138-98ab-db8a2acf4370 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:55.193110 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-e0c6075d-d6cb-4138-98ab-db8a2acf4370 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] [instance: 663b2cc6-7a55-406a-b56f-86047b0e514d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:55.202254 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e0c6075d-d6cb-4138-98ab-db8a2acf4370 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:55.203744 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e0c6075d-d6cb-4138-98ab-db8a2acf4370 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:55.204397 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e0c6075d-d6cb-4138-98ab-db8a2acf4370 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:55.205169 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e0c6075d-d6cb-4138-98ab-db8a2acf4370 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:55.205638 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e0c6075d-d6cb-4138-98ab-db8a2acf4370 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:55.206949 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e0c6075d-d6cb-4138-98ab-db8a2acf4370 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:55.401277 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-e3a1db1a-233b-4310-91aa-ff8ba25c5e80 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87616cd16995468ab7febf5aa4b284db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e3bf9149434d34b6762aaeef1478ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:55.412057 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-e3a1db1a-233b-4310-91aa-ff8ba25c5e80 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] 10.222.0.43 "GET /compute/v2.1/servers/e3380b36-6aba-4736-bcbc-f0058f806d55" status: 200 len: 1471 microversion: 2.1 time: 0.310385 Oct 04 21:46:55.412346 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 494/983] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:55 2022] GET /compute/v2.1/servers/e3380b36-6aba-4736-bcbc-f0058f806d55 => generated 1471 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:55.434279 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-f7bdaca7-4298-4f08-9460-94fea445a053 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:55.434935 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-f7bdaca7-4298-4f08-9460-94fea445a053 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] [instance: 59a1880f-2802-4e72-9a17-b966cfec8fe9] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:55.441298 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f7bdaca7-4298-4f08-9460-94fea445a053 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:55.441800 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f7bdaca7-4298-4f08-9460-94fea445a053 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:55.442236 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f7bdaca7-4298-4f08-9460-94fea445a053 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:55.442990 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f7bdaca7-4298-4f08-9460-94fea445a053 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:55.444013 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f7bdaca7-4298-4f08-9460-94fea445a053 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:55.445052 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f7bdaca7-4298-4f08-9460-94fea445a053 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:55.509920 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-e0c6075d-d6cb-4138-98ab-db8a2acf4370 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29842a669a20408b881105135f76cb0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39edf587afe94b60911198aa0bb61613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:55.518181 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-e0c6075d-d6cb-4138-98ab-db8a2acf4370 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] 10.222.0.43 "GET /compute/v2.1/servers/663b2cc6-7a55-406a-b56f-86047b0e514d" status: 200 len: 1316 microversion: 2.1 time: 0.331255 Oct 04 21:46:55.518810 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 490/984] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:55 2022] GET /compute/v2.1/servers/663b2cc6-7a55-406a-b56f-86047b0e514d => generated 1316 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:55.535075 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-a7ca0208-9fc2-4e3b-8d62-c3bb71eb57e2 tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:55.535732 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-a7ca0208-9fc2-4e3b-8d62-c3bb71eb57e2 tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] [instance: 7512d9d6-ab41-453e-bb9d-8e0861aa37f7] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:55.539115 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:46:55.544527 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a7ca0208-9fc2-4e3b-8d62-c3bb71eb57e2 tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:55.544527 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a7ca0208-9fc2-4e3b-8d62-c3bb71eb57e2 tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:55.544527 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a7ca0208-9fc2-4e3b-8d62-c3bb71eb57e2 tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:55.544978 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a7ca0208-9fc2-4e3b-8d62-c3bb71eb57e2 tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:55.546016 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a7ca0208-9fc2-4e3b-8d62-c3bb71eb57e2 tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:55.546016 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a7ca0208-9fc2-4e3b-8d62-c3bb71eb57e2 tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:55.551313 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=100 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:46:55.742391 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-f7bdaca7-4298-4f08-9460-94fea445a053 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7614aeaedd1947b88031fb55ca4783ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00081ff1d1aa41cbad345326b337093a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:55.752099 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-f7bdaca7-4298-4f08-9460-94fea445a053 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] 10.222.0.43 "GET /compute/v2.1/servers/59a1880f-2802-4e72-9a17-b966cfec8fe9" status: 200 len: 1316 microversion: 2.1 time: 0.323756 Oct 04 21:46:55.758485 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 495/985] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:55 2022] GET /compute/v2.1/servers/59a1880f-2802-4e72-9a17-b966cfec8fe9 => generated 1316 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:55.769483 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-d4e93f1a-3701-488b-95bc-ec967ea3a819 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:55.771014 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-d4e93f1a-3701-488b-95bc-ec967ea3a819 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 4e8281d2-9de4-42eb-94cc-417be864315d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:55.783481 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d4e93f1a-3701-488b-95bc-ec967ea3a819 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:55.784443 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d4e93f1a-3701-488b-95bc-ec967ea3a819 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:55.785073 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d4e93f1a-3701-488b-95bc-ec967ea3a819 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:55.786762 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d4e93f1a-3701-488b-95bc-ec967ea3a819 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:55.788605 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d4e93f1a-3701-488b-95bc-ec967ea3a819 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:55.789661 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d4e93f1a-3701-488b-95bc-ec967ea3a819 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:55.819327 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.objects.instance [None req-a7ca0208-9fc2-4e3b-8d62-c3bb71eb57e2 tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Lazy-loading 'services' on Instance uuid 7512d9d6-ab41-453e-bb9d-8e0861aa37f7 {{(pid=134101) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:46:55.837989 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-a7ca0208-9fc2-4e3b-8d62-c3bb71eb57e2 tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/7512d9d6-ab41-453e-bb9d-8e0861aa37f7" status: 200 len: 2052 microversion: 2.25 time: 0.318088 Oct 04 21:46:55.839457 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 491/986] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:46:55 2022] GET /compute/v2.1/servers/7512d9d6-ab41-453e-bb9d-8e0861aa37f7 => generated 2052 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:46:55.880289 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-981bf804-d576-4ef6-8f97-0861fd00f80f tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:55.882003 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-981bf804-d576-4ef6-8f97-0861fd00f80f tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] [instance: 7512d9d6-ab41-453e-bb9d-8e0861aa37f7] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:55.890059 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-981bf804-d576-4ef6-8f97-0861fd00f80f tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:55.891071 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-981bf804-d576-4ef6-8f97-0861fd00f80f tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:55.891798 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-981bf804-d576-4ef6-8f97-0861fd00f80f tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:55.892961 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-981bf804-d576-4ef6-8f97-0861fd00f80f tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:55.893709 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-981bf804-d576-4ef6-8f97-0861fd00f80f tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:55.894335 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-981bf804-d576-4ef6-8f97-0861fd00f80f tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:56.165787 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-d4e93f1a-3701-488b-95bc-ec967ea3a819 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ad048becf474fb972d4291422d810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dcfc7024fc49388c4bd5f25f03e60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:56.173994 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-d4e93f1a-3701-488b-95bc-ec967ea3a819 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/4e8281d2-9de4-42eb-94cc-417be864315d" status: 200 len: 1311 microversion: 2.1 time: 0.413568 Oct 04 21:46:56.174620 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 496/987] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:55 2022] GET /compute/v2.1/servers/4e8281d2-9de4-42eb-94cc-417be864315d => generated 1311 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:56.180621 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-6329a05a-089d-4ef0-b6bb-35fb9eeaff5a req-dfad348c-d6c6-4445-b6d9-26778bc131c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "663b2cc6-7a55-406a-b56f-86047b0e514d", "name": "network-vif-plugged", "status": "completed", "tag": "b18d9b3a-6ec1-47b6-83c8-9f36631f8f7c"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:46:56.190710 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-6329a05a-089d-4ef0-b6bb-35fb9eeaff5a req-dfad348c-d6c6-4445-b6d9-26778bc131c5 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:56.191218 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-6329a05a-089d-4ef0-b6bb-35fb9eeaff5a req-dfad348c-d6c6-4445-b6d9-26778bc131c5 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:56.191648 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-6329a05a-089d-4ef0-b6bb-35fb9eeaff5a req-dfad348c-d6c6-4445-b6d9-26778bc131c5 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:56.201375 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.objects.instance [None req-981bf804-d576-4ef6-8f97-0861fd00f80f tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Lazy-loading 'services' on Instance uuid 7512d9d6-ab41-453e-bb9d-8e0861aa37f7 {{(pid=134101) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:46:56.205379 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-6329a05a-089d-4ef0-b6bb-35fb9eeaff5a req-dfad348c-d6c6-4445-b6d9-26778bc131c5 service nova] Creating event network-vif-plugged:b18d9b3a-6ec1-47b6-83c8-9f36631f8f7c for instance 663b2cc6-7a55-406a-b56f-86047b0e514d on n-h2-860284-1 Oct 04 21:46:56.212026 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-6329a05a-089d-4ef0-b6bb-35fb9eeaff5a req-dfad348c-d6c6-4445-b6d9-26778bc131c5 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036224 Oct 04 21:46:56.212631 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 497/988] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:46:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:46:56.217938 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-0d27786a-995c-4479-a202-4224e882a951 req-d32a77b9-a34c-4096-b883-e897ec6e21fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59a1880f-2802-4e72-9a17-b966cfec8fe9", "tag": "893f32f5-2183-4d13-8c2e-2095ab07e2af"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:46:56.218245 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-981bf804-d576-4ef6-8f97-0861fd00f80f tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/7512d9d6-ab41-453e-bb9d-8e0861aa37f7" status: 200 len: 2052 microversion: 2.25 time: 0.342291 Oct 04 21:46:56.218989 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 492/989] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:46:55 2022] GET /compute/v2.1/servers/7512d9d6-ab41-453e-bb9d-8e0861aa37f7 => generated 2052 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:46:56.224018 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-a91fb762-bab6-4eca-891b-5ca68c2ff69c tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:56.225491 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-a91fb762-bab6-4eca-891b-5ca68c2ff69c tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: 424a22f0-ccc3-4fec-bf38-4aaf924928e3] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:56.228946 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-0d27786a-995c-4479-a202-4224e882a951 req-d32a77b9-a34c-4096-b883-e897ec6e21fc service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:56.229435 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-0d27786a-995c-4479-a202-4224e882a951 req-d32a77b9-a34c-4096-b883-e897ec6e21fc service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:56.229867 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-0d27786a-995c-4479-a202-4224e882a951 req-d32a77b9-a34c-4096-b883-e897ec6e21fc service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:56.232772 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a91fb762-bab6-4eca-891b-5ca68c2ff69c tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:56.233426 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a91fb762-bab6-4eca-891b-5ca68c2ff69c tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:56.234020 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a91fb762-bab6-4eca-891b-5ca68c2ff69c tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:56.234767 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a91fb762-bab6-4eca-891b-5ca68c2ff69c tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:56.235228 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a91fb762-bab6-4eca-891b-5ca68c2ff69c tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:56.235660 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a91fb762-bab6-4eca-891b-5ca68c2ff69c tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:56.241804 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-0d27786a-995c-4479-a202-4224e882a951 req-d32a77b9-a34c-4096-b883-e897ec6e21fc service nova] Creating event network-changed:893f32f5-2183-4d13-8c2e-2095ab07e2af for instance 59a1880f-2802-4e72-9a17-b966cfec8fe9 on n-h1-860284-1 Oct 04 21:46:56.246985 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-0d27786a-995c-4479-a202-4224e882a951 req-d32a77b9-a34c-4096-b883-e897ec6e21fc service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033007 Oct 04 21:46:56.247979 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 498/990] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:46:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:46:56.254500 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-3a762a35-fad8-4c9e-87cb-4cb04a446c68 tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:56.258901 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3a762a35-fad8-4c9e-87cb-4cb04a446c68 tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:56.259788 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3a762a35-fad8-4c9e-87cb-4cb04a446c68 tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:56.260631 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3a762a35-fad8-4c9e-87cb-4cb04a446c68 tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:56.261974 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3a762a35-fad8-4c9e-87cb-4cb04a446c68 tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:56.262650 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3a762a35-fad8-4c9e-87cb-4cb04a446c68 tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:56.263279 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3a762a35-fad8-4c9e-87cb-4cb04a446c68 tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:56.289605 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-3a762a35-fad8-4c9e-87cb-4cb04a446c68 tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] 10.222.0.43 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.040434 Oct 04 21:46:56.290218 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 499/991] 10.222.0.43 () {60 vars in 1217 bytes} [Tue Oct 4 21:46:56 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:46:56.301835 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-f365f901-f135-4b8f-9820-086acf89299b tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:46:56.302846 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-f365f901-f135-4b8f-9820-086acf89299b tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] [instance: 7512d9d6-ab41-453e-bb9d-8e0861aa37f7] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:56.309359 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f365f901-f135-4b8f-9820-086acf89299b tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:56.309842 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f365f901-f135-4b8f-9820-086acf89299b tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:56.310274 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f365f901-f135-4b8f-9820-086acf89299b tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:56.311000 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f365f901-f135-4b8f-9820-086acf89299b tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:56.311449 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f365f901-f135-4b8f-9820-086acf89299b tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:56.311868 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f365f901-f135-4b8f-9820-086acf89299b tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:56.380846 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-f365f901-f135-4b8f-9820-086acf89299b tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] 10.222.0.43 "POST /compute/v2.1/servers/7512d9d6-ab41-453e-bb9d-8e0861aa37f7/action" status: 202 len: 0 microversion: 2.25 time: 0.082474 Oct 04 21:46:56.381735 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 500/992] 10.222.0.43 () {62 vars in 1319 bytes} [Tue Oct 4 21:46:56 2022] POST /compute/v2.1/servers/7512d9d6-ab41-453e-bb9d-8e0861aa37f7/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 04 21:46:56.389975 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-57c5609b-d601-467d-b69f-28e73638e7b4 tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:56.391350 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-57c5609b-d601-467d-b69f-28e73638e7b4 tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] [instance: 7512d9d6-ab41-453e-bb9d-8e0861aa37f7] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:56.399367 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-57c5609b-d601-467d-b69f-28e73638e7b4 tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:56.400145 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-57c5609b-d601-467d-b69f-28e73638e7b4 tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:56.400563 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-57c5609b-d601-467d-b69f-28e73638e7b4 tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:56.401305 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-57c5609b-d601-467d-b69f-28e73638e7b4 tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:56.401736 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-57c5609b-d601-467d-b69f-28e73638e7b4 tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:56.402352 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-57c5609b-d601-467d-b69f-28e73638e7b4 tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:56.472682 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-a91fb762-bab6-4eca-891b-5ca68c2ff69c tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:56.482356 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-a91fb762-bab6-4eca-891b-5ca68c2ff69c tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/424a22f0-ccc3-4fec-bf38-4aaf924928e3" status: 200 len: 1378 microversion: 2.1 time: 0.262023 Oct 04 21:46:56.483238 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 493/993] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:56 2022] GET /compute/v2.1/servers/424a22f0-ccc3-4fec-bf38-4aaf924928e3 => generated 1378 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:56.488238 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-bc135531-e145-4751-91a0-06df4ec6df15 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:56.488848 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-bc135531-e145-4751-91a0-06df4ec6df15 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] [instance: e3380b36-6aba-4736-bcbc-f0058f806d55] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:56.496277 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bc135531-e145-4751-91a0-06df4ec6df15 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:56.496781 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bc135531-e145-4751-91a0-06df4ec6df15 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:56.497230 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bc135531-e145-4751-91a0-06df4ec6df15 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:56.497947 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bc135531-e145-4751-91a0-06df4ec6df15 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:56.498633 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bc135531-e145-4751-91a0-06df4ec6df15 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:56.498858 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bc135531-e145-4751-91a0-06df4ec6df15 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:56.728934 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.objects.instance [None req-57c5609b-d601-467d-b69f-28e73638e7b4 tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Lazy-loading 'services' on Instance uuid 7512d9d6-ab41-453e-bb9d-8e0861aa37f7 {{(pid=134102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:46:56.743647 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-57c5609b-d601-467d-b69f-28e73638e7b4 tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/7512d9d6-ab41-453e-bb9d-8e0861aa37f7" status: 200 len: 2057 microversion: 2.25 time: 0.357598 Oct 04 21:46:56.744488 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 501/994] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:46:56 2022] GET /compute/v2.1/servers/7512d9d6-ab41-453e-bb9d-8e0861aa37f7 => generated 2057 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:46:56.749033 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-db4957b3-d333-455f-a7c8-ae6d1ec5adf0 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:56.749661 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-db4957b3-d333-455f-a7c8-ae6d1ec5adf0 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] [instance: 663b2cc6-7a55-406a-b56f-86047b0e514d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:56.756728 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-db4957b3-d333-455f-a7c8-ae6d1ec5adf0 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:56.757229 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-db4957b3-d333-455f-a7c8-ae6d1ec5adf0 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:56.757671 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-db4957b3-d333-455f-a7c8-ae6d1ec5adf0 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:56.758410 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-db4957b3-d333-455f-a7c8-ae6d1ec5adf0 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:56.758870 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-db4957b3-d333-455f-a7c8-ae6d1ec5adf0 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:56.759300 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-db4957b3-d333-455f-a7c8-ae6d1ec5adf0 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:56.766880 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-bc135531-e145-4751-91a0-06df4ec6df15 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87616cd16995468ab7febf5aa4b284db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e3bf9149434d34b6762aaeef1478ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:56.777175 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-bc135531-e145-4751-91a0-06df4ec6df15 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] 10.222.0.43 "GET /compute/v2.1/servers/e3380b36-6aba-4736-bcbc-f0058f806d55" status: 200 len: 1471 microversion: 2.1 time: 0.292674 Oct 04 21:46:56.778212 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 494/995] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:56 2022] GET /compute/v2.1/servers/e3380b36-6aba-4736-bcbc-f0058f806d55 => generated 1471 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:56.783917 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-18881b8f-faad-4c0e-a282-39a57da3d65b tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:56.784620 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-18881b8f-faad-4c0e-a282-39a57da3d65b tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] [instance: 59a1880f-2802-4e72-9a17-b966cfec8fe9] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:56.791732 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-18881b8f-faad-4c0e-a282-39a57da3d65b tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:56.792597 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-18881b8f-faad-4c0e-a282-39a57da3d65b tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:56.793327 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-18881b8f-faad-4c0e-a282-39a57da3d65b tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:56.794287 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-18881b8f-faad-4c0e-a282-39a57da3d65b tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:56.794997 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-18881b8f-faad-4c0e-a282-39a57da3d65b tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:56.795393 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-18881b8f-faad-4c0e-a282-39a57da3d65b tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:56.984772 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-db4957b3-d333-455f-a7c8-ae6d1ec5adf0 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29842a669a20408b881105135f76cb0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39edf587afe94b60911198aa0bb61613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:56.994061 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-db4957b3-d333-455f-a7c8-ae6d1ec5adf0 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] 10.222.0.43 "GET /compute/v2.1/servers/663b2cc6-7a55-406a-b56f-86047b0e514d" status: 200 len: 1316 microversion: 2.1 time: 0.248701 Oct 04 21:46:56.994705 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 502/996] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:56 2022] GET /compute/v2.1/servers/663b2cc6-7a55-406a-b56f-86047b0e514d => generated 1316 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:57.004860 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-18881b8f-faad-4c0e-a282-39a57da3d65b tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7614aeaedd1947b88031fb55ca4783ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00081ff1d1aa41cbad345326b337093a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:57.013988 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-18881b8f-faad-4c0e-a282-39a57da3d65b tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] 10.222.0.43 "GET /compute/v2.1/servers/59a1880f-2802-4e72-9a17-b966cfec8fe9" status: 200 len: 1316 microversion: 2.1 time: 0.234191 Oct 04 21:46:57.014619 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 495/997] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:56 2022] GET /compute/v2.1/servers/59a1880f-2802-4e72-9a17-b966cfec8fe9 => generated 1316 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:57.200971 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-c7cc86f7-0b2d-46ec-8ad3-0f322753b23f tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:57.201976 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-c7cc86f7-0b2d-46ec-8ad3-0f322753b23f tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 4e8281d2-9de4-42eb-94cc-417be864315d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:57.209660 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c7cc86f7-0b2d-46ec-8ad3-0f322753b23f tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:57.209660 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c7cc86f7-0b2d-46ec-8ad3-0f322753b23f tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:57.210983 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c7cc86f7-0b2d-46ec-8ad3-0f322753b23f tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:57.211591 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c7cc86f7-0b2d-46ec-8ad3-0f322753b23f tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:57.212071 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c7cc86f7-0b2d-46ec-8ad3-0f322753b23f tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:57.212635 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c7cc86f7-0b2d-46ec-8ad3-0f322753b23f tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:57.235291 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:46:57.363485 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-c7cc86f7-0b2d-46ec-8ad3-0f322753b23f tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ad048becf474fb972d4291422d810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dcfc7024fc49388c4bd5f25f03e60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:57.371907 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-c7cc86f7-0b2d-46ec-8ad3-0f322753b23f tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/4e8281d2-9de4-42eb-94cc-417be864315d" status: 200 len: 1493 microversion: 2.1 time: 0.175190 Oct 04 21:46:57.372509 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 503/998] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:57 2022] GET /compute/v2.1/servers/4e8281d2-9de4-42eb-94cc-417be864315d => generated 1493 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:46:57.397279 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-6140e821-6379-47f8-ab2e-7b7f7b4eff0a tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:57.398082 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-6140e821-6379-47f8-ab2e-7b7f7b4eff0a tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] [instance: 4e8281d2-9de4-42eb-94cc-417be864315d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:57.405114 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6140e821-6379-47f8-ab2e-7b7f7b4eff0a tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:57.405701 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6140e821-6379-47f8-ab2e-7b7f7b4eff0a tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:57.407262 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6140e821-6379-47f8-ab2e-7b7f7b4eff0a tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:57.408168 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6140e821-6379-47f8-ab2e-7b7f7b4eff0a tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:57.408635 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6140e821-6379-47f8-ab2e-7b7f7b4eff0a tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:57.409069 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6140e821-6379-47f8-ab2e-7b7f7b4eff0a tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:57.510549 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-1351c412-e05b-4108-bfdb-c71f5f5c47d8 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:57.511934 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-1351c412-e05b-4108-bfdb-c71f5f5c47d8 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: 424a22f0-ccc3-4fec-bf38-4aaf924928e3] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:57.522662 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1351c412-e05b-4108-bfdb-c71f5f5c47d8 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:57.523495 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1351c412-e05b-4108-bfdb-c71f5f5c47d8 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:57.524290 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1351c412-e05b-4108-bfdb-c71f5f5c47d8 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:57.525589 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1351c412-e05b-4108-bfdb-c71f5f5c47d8 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:57.526467 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1351c412-e05b-4108-bfdb-c71f5f5c47d8 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:57.527649 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1351c412-e05b-4108-bfdb-c71f5f5c47d8 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:57.544773 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-6140e821-6379-47f8-ab2e-7b7f7b4eff0a tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/4e8281d2-9de4-42eb-94cc-417be864315d" status: 200 len: 1644 microversion: 2.1 time: 0.152029 Oct 04 21:46:57.545379 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 496/999] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:57 2022] GET /compute/v2.1/servers/4e8281d2-9de4-42eb-94cc-417be864315d => generated 1644 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:57.567917 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-074e6c4d-1914-49c6-aaaf-7b533dbaf0a1 tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:57.569110 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-074e6c4d-1914-49c6-aaaf-7b533dbaf0a1 tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] [instance: 4e8281d2-9de4-42eb-94cc-417be864315d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:57.579566 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-074e6c4d-1914-49c6-aaaf-7b533dbaf0a1 tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:57.585467 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-074e6c4d-1914-49c6-aaaf-7b533dbaf0a1 tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:57.586634 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-074e6c4d-1914-49c6-aaaf-7b533dbaf0a1 tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:57.592151 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-074e6c4d-1914-49c6-aaaf-7b533dbaf0a1 tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:57.592811 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-074e6c4d-1914-49c6-aaaf-7b533dbaf0a1 tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:57.593607 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-074e6c4d-1914-49c6-aaaf-7b533dbaf0a1 tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:57.739930 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-1351c412-e05b-4108-bfdb-c71f5f5c47d8 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:57.749625 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-1351c412-e05b-4108-bfdb-c71f5f5c47d8 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/424a22f0-ccc3-4fec-bf38-4aaf924928e3" status: 200 len: 1378 microversion: 2.1 time: 0.246861 Oct 04 21:46:57.750441 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 504/1000] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:57 2022] GET /compute/v2.1/servers/424a22f0-ccc3-4fec-bf38-4aaf924928e3 => generated 1378 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:57.772710 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-615f6274-d6ff-4973-ab67-f0ddc0ec7d1b tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:57.774287 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-615f6274-d6ff-4973-ab67-f0ddc0ec7d1b tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] [instance: 7512d9d6-ab41-453e-bb9d-8e0861aa37f7] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:57.780871 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-615f6274-d6ff-4973-ab67-f0ddc0ec7d1b tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:57.781478 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-615f6274-d6ff-4973-ab67-f0ddc0ec7d1b tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:57.781987 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-615f6274-d6ff-4973-ab67-f0ddc0ec7d1b tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:57.782798 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-615f6274-d6ff-4973-ab67-f0ddc0ec7d1b tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:57.783354 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-615f6274-d6ff-4973-ab67-f0ddc0ec7d1b tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:57.784010 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-615f6274-d6ff-4973-ab67-f0ddc0ec7d1b tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:57.788956 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-074e6c4d-1914-49c6-aaaf-7b533dbaf0a1 tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/4e8281d2-9de4-42eb-94cc-417be864315d" status: 200 len: 1644 microversion: 2.1 time: 0.224977 Oct 04 21:46:57.789774 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 497/1001] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:57 2022] GET /compute/v2.1/servers/4e8281d2-9de4-42eb-94cc-417be864315d => generated 1644 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:46:57.801370 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-9d59d767-9e90-499c-8812-02058d02b1e7 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:57.803537 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-9d59d767-9e90-499c-8812-02058d02b1e7 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] [instance: e3380b36-6aba-4736-bcbc-f0058f806d55] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:57.809960 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9d59d767-9e90-499c-8812-02058d02b1e7 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:57.810492 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9d59d767-9e90-499c-8812-02058d02b1e7 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:57.810940 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9d59d767-9e90-499c-8812-02058d02b1e7 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:57.811722 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9d59d767-9e90-499c-8812-02058d02b1e7 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:57.812116 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9d59d767-9e90-499c-8812-02058d02b1e7 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:57.812543 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9d59d767-9e90-499c-8812-02058d02b1e7 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:57.987513 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.objects.instance [None req-615f6274-d6ff-4973-ab67-f0ddc0ec7d1b tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Lazy-loading 'services' on Instance uuid 7512d9d6-ab41-453e-bb9d-8e0861aa37f7 {{(pid=134102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:46:58.000871 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-9d59d767-9e90-499c-8812-02058d02b1e7 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87616cd16995468ab7febf5aa4b284db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e3bf9149434d34b6762aaeef1478ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:58.001182 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-615f6274-d6ff-4973-ab67-f0ddc0ec7d1b tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/7512d9d6-ab41-453e-bb9d-8e0861aa37f7" status: 200 len: 2057 microversion: 2.25 time: 0.233521 Oct 04 21:46:58.001785 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 505/1002] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:46:57 2022] GET /compute/v2.1/servers/7512d9d6-ab41-453e-bb9d-8e0861aa37f7 => generated 2057 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:46:58.006183 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-b79cbae4-02f4-4fd7-85c2-b5884044303d tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:58.010091 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b79cbae4-02f4-4fd7-85c2-b5884044303d tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:58.010609 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b79cbae4-02f4-4fd7-85c2-b5884044303d tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:58.011057 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b79cbae4-02f4-4fd7-85c2-b5884044303d tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:58.011794 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b79cbae4-02f4-4fd7-85c2-b5884044303d tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:58.012254 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b79cbae4-02f4-4fd7-85c2-b5884044303d tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:58.012687 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b79cbae4-02f4-4fd7-85c2-b5884044303d tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:58.013860 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-9d59d767-9e90-499c-8812-02058d02b1e7 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] 10.222.0.43 "GET /compute/v2.1/servers/e3380b36-6aba-4736-bcbc-f0058f806d55" status: 200 len: 1471 microversion: 2.1 time: 0.216577 Oct 04 21:46:58.016373 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 498/1003] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:57 2022] GET /compute/v2.1/servers/e3380b36-6aba-4736-bcbc-f0058f806d55 => generated 1471 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:46:58.023295 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-82fe119c-ff00-4a6f-aefb-8dc79bd4fe01 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:58.023949 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-82fe119c-ff00-4a6f-aefb-8dc79bd4fe01 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] [instance: 663b2cc6-7a55-406a-b56f-86047b0e514d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:58.029819 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-82fe119c-ff00-4a6f-aefb-8dc79bd4fe01 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:58.031905 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-82fe119c-ff00-4a6f-aefb-8dc79bd4fe01 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:58.032355 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-82fe119c-ff00-4a6f-aefb-8dc79bd4fe01 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:58.033069 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-82fe119c-ff00-4a6f-aefb-8dc79bd4fe01 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:58.033566 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-82fe119c-ff00-4a6f-aefb-8dc79bd4fe01 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:58.034000 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-82fe119c-ff00-4a6f-aefb-8dc79bd4fe01 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:58.042264 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-b79cbae4-02f4-4fd7-85c2-b5884044303d tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] 10.222.0.43 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.039440 Oct 04 21:46:58.042913 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 506/1004] 10.222.0.43 () {58 vars in 1176 bytes} [Tue Oct 4 21:46:58 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:46:58.047476 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-fa30846b-76df-415a-a344-c137ee9e8318 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:58.048298 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-fa30846b-76df-415a-a344-c137ee9e8318 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] [instance: 59a1880f-2802-4e72-9a17-b966cfec8fe9] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:58.055086 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fa30846b-76df-415a-a344-c137ee9e8318 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:58.055571 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fa30846b-76df-415a-a344-c137ee9e8318 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:58.056000 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fa30846b-76df-415a-a344-c137ee9e8318 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:58.056690 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fa30846b-76df-415a-a344-c137ee9e8318 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:58.057140 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fa30846b-76df-415a-a344-c137ee9e8318 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:58.057557 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fa30846b-76df-415a-a344-c137ee9e8318 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:58.227029 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-82fe119c-ff00-4a6f-aefb-8dc79bd4fe01 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29842a669a20408b881105135f76cb0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39edf587afe94b60911198aa0bb61613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:58.234773 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-82fe119c-ff00-4a6f-aefb-8dc79bd4fe01 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] 10.222.0.43 "GET /compute/v2.1/servers/663b2cc6-7a55-406a-b56f-86047b0e514d" status: 200 len: 1316 microversion: 2.1 time: 0.215900 Oct 04 21:46:58.235356 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 499/1005] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:58 2022] GET /compute/v2.1/servers/663b2cc6-7a55-406a-b56f-86047b0e514d => generated 1316 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:58.240098 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-8c7784c8-356d-4507-a7d1-aa68dade99ab tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:46:58.240667 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-8c7784c8-356d-4507-a7d1-aa68dade99ab tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] [instance: 4e8281d2-9de4-42eb-94cc-417be864315d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:58.249040 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-fa30846b-76df-415a-a344-c137ee9e8318 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7614aeaedd1947b88031fb55ca4783ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00081ff1d1aa41cbad345326b337093a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:58.257813 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8c7784c8-356d-4507-a7d1-aa68dade99ab tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:58.258158 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-fa30846b-76df-415a-a344-c137ee9e8318 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] 10.222.0.43 "GET /compute/v2.1/servers/59a1880f-2802-4e72-9a17-b966cfec8fe9" status: 200 len: 1316 microversion: 2.1 time: 0.214130 Oct 04 21:46:58.258289 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8c7784c8-356d-4507-a7d1-aa68dade99ab tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:58.258744 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8c7784c8-356d-4507-a7d1-aa68dade99ab tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:58.259155 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 507/1006] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:58 2022] GET /compute/v2.1/servers/59a1880f-2802-4e72-9a17-b966cfec8fe9 => generated 1316 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:58.259453 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8c7784c8-356d-4507-a7d1-aa68dade99ab tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:58.259903 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8c7784c8-356d-4507-a7d1-aa68dade99ab tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:58.260330 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8c7784c8-356d-4507-a7d1-aa68dade99ab tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:58.331600 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-8c7784c8-356d-4507-a7d1-aa68dade99ab tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] 10.222.0.43 "POST /compute/v2.1/servers/4e8281d2-9de4-42eb-94cc-417be864315d/action" status: 202 len: 0 microversion: 2.1 time: 0.094941 Oct 04 21:46:58.332167 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 500/1007] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 21:46:58 2022] POST /compute/v2.1/servers/4e8281d2-9de4-42eb-94cc-417be864315d/action => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:46:58.340971 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-ac0ec14f-2491-4cc6-a226-07112b44966b tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:58.341583 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-ac0ec14f-2491-4cc6-a226-07112b44966b tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] [instance: 4e8281d2-9de4-42eb-94cc-417be864315d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:58.347800 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ac0ec14f-2491-4cc6-a226-07112b44966b tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:58.348286 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ac0ec14f-2491-4cc6-a226-07112b44966b tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:58.348720 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ac0ec14f-2491-4cc6-a226-07112b44966b tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:58.349416 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ac0ec14f-2491-4cc6-a226-07112b44966b tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:58.349902 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ac0ec14f-2491-4cc6-a226-07112b44966b tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:58.350333 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ac0ec14f-2491-4cc6-a226-07112b44966b tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:58.487071 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-ac0ec14f-2491-4cc6-a226-07112b44966b tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/4e8281d2-9de4-42eb-94cc-417be864315d" status: 200 len: 1649 microversion: 2.1 time: 0.149749 Oct 04 21:46:58.487982 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 508/1008] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:58 2022] GET /compute/v2.1/servers/4e8281d2-9de4-42eb-94cc-417be864315d => generated 1649 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:58.774824 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-805e6cda-81df-48d7-b067-b18d5c905b02 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:58.775533 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-805e6cda-81df-48d7-b067-b18d5c905b02 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: 424a22f0-ccc3-4fec-bf38-4aaf924928e3] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:58.782756 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-805e6cda-81df-48d7-b067-b18d5c905b02 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:58.783254 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-805e6cda-81df-48d7-b067-b18d5c905b02 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:58.783698 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-805e6cda-81df-48d7-b067-b18d5c905b02 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:58.784410 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-805e6cda-81df-48d7-b067-b18d5c905b02 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:58.784865 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-805e6cda-81df-48d7-b067-b18d5c905b02 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:58.785297 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-805e6cda-81df-48d7-b067-b18d5c905b02 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:58.923019 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-805e6cda-81df-48d7-b067-b18d5c905b02 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:58.931696 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-805e6cda-81df-48d7-b067-b18d5c905b02 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/424a22f0-ccc3-4fec-bf38-4aaf924928e3" status: 200 len: 1378 microversion: 2.1 time: 0.162158 Oct 04 21:46:58.932269 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 501/1009] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:58 2022] GET /compute/v2.1/servers/424a22f0-ccc3-4fec-bf38-4aaf924928e3 => generated 1378 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:59.028471 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-faec2134-8c54-49a7-9539-c1baed367a25 tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:59.029496 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-faec2134-8c54-49a7-9539-c1baed367a25 tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] [instance: 7512d9d6-ab41-453e-bb9d-8e0861aa37f7] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:59.032947 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell0:SELECT=18 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:46:59.039982 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-7b4156bf-7f2e-43c9-ab20-e9e156fb3620 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:59.040596 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-faec2134-8c54-49a7-9539-c1baed367a25 tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:59.040793 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-7b4156bf-7f2e-43c9-ab20-e9e156fb3620 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] [instance: e3380b36-6aba-4736-bcbc-f0058f806d55] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:59.041749 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-faec2134-8c54-49a7-9539-c1baed367a25 tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:59.042695 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-faec2134-8c54-49a7-9539-c1baed367a25 tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:59.044518 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-faec2134-8c54-49a7-9539-c1baed367a25 tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:59.045281 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-faec2134-8c54-49a7-9539-c1baed367a25 tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:59.045876 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-faec2134-8c54-49a7-9539-c1baed367a25 tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:59.054445 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7b4156bf-7f2e-43c9-ab20-e9e156fb3620 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:59.055210 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7b4156bf-7f2e-43c9-ab20-e9e156fb3620 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:59.055811 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7b4156bf-7f2e-43c9-ab20-e9e156fb3620 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:59.057285 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7b4156bf-7f2e-43c9-ab20-e9e156fb3620 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:59.057910 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7b4156bf-7f2e-43c9-ab20-e9e156fb3620 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:59.058552 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7b4156bf-7f2e-43c9-ab20-e9e156fb3620 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:59.248309 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-7b4156bf-7f2e-43c9-ab20-e9e156fb3620 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87616cd16995468ab7febf5aa4b284db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e3bf9149434d34b6762aaeef1478ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:59.257523 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-7b4156bf-7f2e-43c9-ab20-e9e156fb3620 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] 10.222.0.43 "GET /compute/v2.1/servers/e3380b36-6aba-4736-bcbc-f0058f806d55" status: 200 len: 1489 microversion: 2.1 time: 0.222347 Oct 04 21:46:59.258139 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 502/1010] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:59 2022] GET /compute/v2.1/servers/e3380b36-6aba-4736-bcbc-f0058f806d55 => generated 1489 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:46:59.262592 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.objects.instance [None req-faec2134-8c54-49a7-9539-c1baed367a25 tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Lazy-loading 'services' on Instance uuid 7512d9d6-ab41-453e-bb9d-8e0861aa37f7 {{(pid=134102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:46:59.263384 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-91fb395c-8598-405b-aca7-43a3390d8baf tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:59.263998 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-91fb395c-8598-405b-aca7-43a3390d8baf tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] [instance: 663b2cc6-7a55-406a-b56f-86047b0e514d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:59.269891 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-91fb395c-8598-405b-aca7-43a3390d8baf tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:59.270612 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-91fb395c-8598-405b-aca7-43a3390d8baf tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:59.270985 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-91fb395c-8598-405b-aca7-43a3390d8baf tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:59.272318 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-91fb395c-8598-405b-aca7-43a3390d8baf tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:59.273051 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-91fb395c-8598-405b-aca7-43a3390d8baf tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:59.273550 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-91fb395c-8598-405b-aca7-43a3390d8baf tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:59.283858 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-faec2134-8c54-49a7-9539-c1baed367a25 tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/7512d9d6-ab41-453e-bb9d-8e0861aa37f7" status: 200 len: 2037 microversion: 2.25 time: 0.260681 Oct 04 21:46:59.284574 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 509/1011] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:46:59 2022] GET /compute/v2.1/servers/7512d9d6-ab41-453e-bb9d-8e0861aa37f7 => generated 2037 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:46:59.290281 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-22ff0113-2c2d-4a60-8196-ea1497a6d96b tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:59.291152 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-22ff0113-2c2d-4a60-8196-ea1497a6d96b tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] [instance: 59a1880f-2802-4e72-9a17-b966cfec8fe9] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:59.297429 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-22ff0113-2c2d-4a60-8196-ea1497a6d96b tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:59.298226 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-22ff0113-2c2d-4a60-8196-ea1497a6d96b tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:59.300113 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-22ff0113-2c2d-4a60-8196-ea1497a6d96b tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:59.300113 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-22ff0113-2c2d-4a60-8196-ea1497a6d96b tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:59.300596 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-22ff0113-2c2d-4a60-8196-ea1497a6d96b tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:59.301309 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-22ff0113-2c2d-4a60-8196-ea1497a6d96b tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:59.490027 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-91fb395c-8598-405b-aca7-43a3390d8baf tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29842a669a20408b881105135f76cb0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39edf587afe94b60911198aa0bb61613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:59.494960 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-22ff0113-2c2d-4a60-8196-ea1497a6d96b tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7614aeaedd1947b88031fb55ca4783ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00081ff1d1aa41cbad345326b337093a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:59.498794 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-91fb395c-8598-405b-aca7-43a3390d8baf tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] 10.222.0.43 "GET /compute/v2.1/servers/663b2cc6-7a55-406a-b56f-86047b0e514d" status: 200 len: 1316 microversion: 2.1 time: 0.239539 Oct 04 21:46:59.499397 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 503/1012] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:59 2022] GET /compute/v2.1/servers/663b2cc6-7a55-406a-b56f-86047b0e514d => generated 1316 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:59.503595 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-22ff0113-2c2d-4a60-8196-ea1497a6d96b tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] 10.222.0.43 "GET /compute/v2.1/servers/59a1880f-2802-4e72-9a17-b966cfec8fe9" status: 200 len: 1316 microversion: 2.1 time: 0.217855 Oct 04 21:46:59.504012 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-446b20b7-0831-46c3-8303-8e08f693c47b tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-860284-1", "block_migration": "auto"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:46:59.504971 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 510/1013] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:59 2022] GET /compute/v2.1/servers/59a1880f-2802-4e72-9a17-b966cfec8fe9 => generated 1316 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:59.506866 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-446b20b7-0831-46c3-8303-8e08f693c47b tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] [instance: 7512d9d6-ab41-453e-bb9d-8e0861aa37f7] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:59.524430 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-9d29e518-30ba-4d15-a688-56120f02e471 tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:59.524649 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-446b20b7-0831-46c3-8303-8e08f693c47b tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:59.524944 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-446b20b7-0831-46c3-8303-8e08f693c47b tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:59.525391 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-446b20b7-0831-46c3-8303-8e08f693c47b tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:59.525806 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-9d29e518-30ba-4d15-a688-56120f02e471 tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] [instance: 4e8281d2-9de4-42eb-94cc-417be864315d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:59.526105 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-446b20b7-0831-46c3-8303-8e08f693c47b tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:59.526602 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-446b20b7-0831-46c3-8303-8e08f693c47b tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:59.527032 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-446b20b7-0831-46c3-8303-8e08f693c47b tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:59.536852 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9d29e518-30ba-4d15-a688-56120f02e471 tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:59.539272 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9d29e518-30ba-4d15-a688-56120f02e471 tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:59.540064 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9d29e518-30ba-4d15-a688-56120f02e471 tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:59.541331 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9d29e518-30ba-4d15-a688-56120f02e471 tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:59.542188 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9d29e518-30ba-4d15-a688-56120f02e471 tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:59.542980 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9d29e518-30ba-4d15-a688-56120f02e471 tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:59.554460 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.objects.instance [None req-446b20b7-0831-46c3-8303-8e08f693c47b tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Lazy-loading 'flavor' on Instance uuid 7512d9d6-ab41-453e-bb9d-8e0861aa37f7 {{(pid=134101) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:46:59.567510 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-446b20b7-0831-46c3-8303-8e08f693c47b tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] [instance: 7512d9d6-ab41-453e-bb9d-8e0861aa37f7] Going to try to live migrate instance to n-h1-860284-1 {{(pid=134101) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 04 21:46:59.613415 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:46:59.694383 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-9d29e518-30ba-4d15-a688-56120f02e471 tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/4e8281d2-9de4-42eb-94cc-417be864315d" status: 200 len: 1649 microversion: 2.1 time: 0.177607 Oct 04 21:46:59.696316 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 511/1014] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:59 2022] GET /compute/v2.1/servers/4e8281d2-9de4-42eb-94cc-417be864315d => generated 1649 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:59.955488 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-7dce85d7-6712-452f-8cea-383574311574 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:59.956204 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-7dce85d7-6712-452f-8cea-383574311574 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: 424a22f0-ccc3-4fec-bf38-4aaf924928e3] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:59.963093 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7dce85d7-6712-452f-8cea-383574311574 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:59.963665 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7dce85d7-6712-452f-8cea-383574311574 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:59.964126 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7dce85d7-6712-452f-8cea-383574311574 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:59.964836 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7dce85d7-6712-452f-8cea-383574311574 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:59.965293 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7dce85d7-6712-452f-8cea-383574311574 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:59.965721 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7dce85d7-6712-452f-8cea-383574311574 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:00.170453 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-7dce85d7-6712-452f-8cea-383574311574 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:00.181200 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-7dce85d7-6712-452f-8cea-383574311574 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/424a22f0-ccc3-4fec-bf38-4aaf924928e3" status: 200 len: 1378 microversion: 2.1 time: 0.229366 Oct 04 21:47:00.182944 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 512/1015] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:59 2022] GET /compute/v2.1/servers/424a22f0-ccc3-4fec-bf38-4aaf924928e3 => generated 1378 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:47:00.257676 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-e00122d3-abb0-4b05-ac4b-5cb09efbb8f0 req-d12f3d31-a674-44a0-a2a4-4b97fa067ef6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "424a22f0-ccc3-4fec-bf38-4aaf924928e3", "name": "network-vif-plugged", "status": "completed", "tag": "0fc2e8ca-ce8a-4b4a-992c-9e648d20829d"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:47:00.270088 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-e00122d3-abb0-4b05-ac4b-5cb09efbb8f0 req-d12f3d31-a674-44a0-a2a4-4b97fa067ef6 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:00.270727 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-e00122d3-abb0-4b05-ac4b-5cb09efbb8f0 req-d12f3d31-a674-44a0-a2a4-4b97fa067ef6 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:00.271039 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-e00122d3-abb0-4b05-ac4b-5cb09efbb8f0 req-d12f3d31-a674-44a0-a2a4-4b97fa067ef6 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:00.285729 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-e00122d3-abb0-4b05-ac4b-5cb09efbb8f0 req-d12f3d31-a674-44a0-a2a4-4b97fa067ef6 service nova] Creating event network-vif-plugged:0fc2e8ca-ce8a-4b4a-992c-9e648d20829d for instance 424a22f0-ccc3-4fec-bf38-4aaf924928e3 on n-h2-860284-1 Oct 04 21:47:00.291988 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-e00122d3-abb0-4b05-ac4b-5cb09efbb8f0 req-d12f3d31-a674-44a0-a2a4-4b97fa067ef6 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040070 Oct 04 21:47:00.292795 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 513/1016] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:47:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:47:00.298242 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-91f53e27-d35b-469b-b175-1399d42894dc tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:00.299082 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-91f53e27-d35b-469b-b175-1399d42894dc tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] [instance: e3380b36-6aba-4736-bcbc-f0058f806d55] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:00.307397 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-91f53e27-d35b-469b-b175-1399d42894dc tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:00.308120 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-91f53e27-d35b-469b-b175-1399d42894dc tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:00.308566 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-91f53e27-d35b-469b-b175-1399d42894dc tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:00.309618 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-91f53e27-d35b-469b-b175-1399d42894dc tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:00.309737 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-91f53e27-d35b-469b-b175-1399d42894dc tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:00.310135 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-91f53e27-d35b-469b-b175-1399d42894dc tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:00.586555 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-91f53e27-d35b-469b-b175-1399d42894dc tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87616cd16995468ab7febf5aa4b284db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e3bf9149434d34b6762aaeef1478ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:00.601583 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-91f53e27-d35b-469b-b175-1399d42894dc tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] 10.222.0.43 "GET /compute/v2.1/servers/e3380b36-6aba-4736-bcbc-f0058f806d55" status: 200 len: 1477 microversion: 2.1 time: 0.307586 Oct 04 21:47:00.602183 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 514/1017] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:00 2022] GET /compute/v2.1/servers/e3380b36-6aba-4736-bcbc-f0058f806d55 => generated 1477 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:00.607162 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-b4824e48-683f-4d01-8a33-c40f5c28662b tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:00.607971 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-b4824e48-683f-4d01-8a33-c40f5c28662b tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] [instance: 663b2cc6-7a55-406a-b56f-86047b0e514d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:00.614859 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b4824e48-683f-4d01-8a33-c40f5c28662b tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:00.616090 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b4824e48-683f-4d01-8a33-c40f5c28662b tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:00.616855 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b4824e48-683f-4d01-8a33-c40f5c28662b tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:00.617836 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b4824e48-683f-4d01-8a33-c40f5c28662b tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:00.618777 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b4824e48-683f-4d01-8a33-c40f5c28662b tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:00.619436 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b4824e48-683f-4d01-8a33-c40f5c28662b tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:00.840747 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-b4824e48-683f-4d01-8a33-c40f5c28662b tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29842a669a20408b881105135f76cb0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39edf587afe94b60911198aa0bb61613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:00.849864 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-b4824e48-683f-4d01-8a33-c40f5c28662b tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] 10.222.0.43 "GET /compute/v2.1/servers/663b2cc6-7a55-406a-b56f-86047b0e514d" status: 200 len: 1316 microversion: 2.1 time: 0.246375 Oct 04 21:47:00.862685 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 515/1018] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:00 2022] GET /compute/v2.1/servers/663b2cc6-7a55-406a-b56f-86047b0e514d => generated 1316 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:00.868729 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-bfe25db0-d97d-4659-a426-9dc68355a520 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:00.869348 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-bfe25db0-d97d-4659-a426-9dc68355a520 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] [instance: 59a1880f-2802-4e72-9a17-b966cfec8fe9] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:00.875367 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bfe25db0-d97d-4659-a426-9dc68355a520 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:00.875857 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bfe25db0-d97d-4659-a426-9dc68355a520 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:00.876278 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bfe25db0-d97d-4659-a426-9dc68355a520 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:00.877184 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bfe25db0-d97d-4659-a426-9dc68355a520 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:00.877641 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bfe25db0-d97d-4659-a426-9dc68355a520 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:00.878066 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bfe25db0-d97d-4659-a426-9dc68355a520 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:01.072746 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-bfe25db0-d97d-4659-a426-9dc68355a520 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7614aeaedd1947b88031fb55ca4783ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00081ff1d1aa41cbad345326b337093a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:01.080451 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-bfe25db0-d97d-4659-a426-9dc68355a520 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] 10.222.0.43 "GET /compute/v2.1/servers/59a1880f-2802-4e72-9a17-b966cfec8fe9" status: 200 len: 1316 microversion: 2.1 time: 0.216623 Oct 04 21:47:01.081064 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 516/1019] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:00 2022] GET /compute/v2.1/servers/59a1880f-2802-4e72-9a17-b966cfec8fe9 => generated 1316 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:01.085594 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-28c18911-2c94-43d6-b074-e48a1ef5d397 tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:01.086208 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-28c18911-2c94-43d6-b074-e48a1ef5d397 tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] [instance: 4e8281d2-9de4-42eb-94cc-417be864315d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:01.092277 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-28c18911-2c94-43d6-b074-e48a1ef5d397 tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:01.092769 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-28c18911-2c94-43d6-b074-e48a1ef5d397 tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:01.093205 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-28c18911-2c94-43d6-b074-e48a1ef5d397 tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:01.094087 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-28c18911-2c94-43d6-b074-e48a1ef5d397 tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:01.094630 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-28c18911-2c94-43d6-b074-e48a1ef5d397 tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:01.095060 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-28c18911-2c94-43d6-b074-e48a1ef5d397 tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:01.509484 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-28c18911-2c94-43d6-b074-e48a1ef5d397 tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/4e8281d2-9de4-42eb-94cc-417be864315d" status: 200 len: 1629 microversion: 2.1 time: 0.427358 Oct 04 21:47:01.510940 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 517/1020] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:01 2022] GET /compute/v2.1/servers/4e8281d2-9de4-42eb-94cc-417be864315d => generated 1629 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:01.530838 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-589ca7ee-8d58-4a06-8b42-9fcf7ac53b37 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:01.531578 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-589ca7ee-8d58-4a06-8b42-9fcf7ac53b37 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: 424a22f0-ccc3-4fec-bf38-4aaf924928e3] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:01.539242 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-589ca7ee-8d58-4a06-8b42-9fcf7ac53b37 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:01.539764 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-589ca7ee-8d58-4a06-8b42-9fcf7ac53b37 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:01.546314 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-589ca7ee-8d58-4a06-8b42-9fcf7ac53b37 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:01.547017 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-589ca7ee-8d58-4a06-8b42-9fcf7ac53b37 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:01.547484 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-589ca7ee-8d58-4a06-8b42-9fcf7ac53b37 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:01.547949 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-589ca7ee-8d58-4a06-8b42-9fcf7ac53b37 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:01.573342 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-446b20b7-0831-46c3-8303-8e08f693c47b tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] 10.222.0.43 "POST /compute/v2.1/servers/7512d9d6-ab41-453e-bb9d-8e0861aa37f7/action" status: 202 len: 0 microversion: 2.25 time: 2.072843 Oct 04 21:47:01.574317 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 504/1021] 10.222.0.43 () {62 vars in 1319 bytes} [Tue Oct 4 21:46:59 2022] POST /compute/v2.1/servers/7512d9d6-ab41-453e-bb9d-8e0861aa37f7/action => generated 0 bytes in 2074 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:47:01.579388 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-08bc2fa1-1682-4879-aa8f-b607777da1db tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-860284-1", "block_migration": true, "disk_over_commit": false}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:47:01.581997 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-08bc2fa1-1682-4879-aa8f-b607777da1db tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] [instance: 4e8281d2-9de4-42eb-94cc-417be864315d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:01.590318 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-08bc2fa1-1682-4879-aa8f-b607777da1db tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:01.590837 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-08bc2fa1-1682-4879-aa8f-b607777da1db tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:01.591275 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-08bc2fa1-1682-4879-aa8f-b607777da1db tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:01.591978 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-08bc2fa1-1682-4879-aa8f-b607777da1db tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:01.592429 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-08bc2fa1-1682-4879-aa8f-b607777da1db tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:01.592854 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-08bc2fa1-1682-4879-aa8f-b607777da1db tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:01.618767 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.objects.instance [None req-08bc2fa1-1682-4879-aa8f-b607777da1db tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Lazy-loading 'flavor' on Instance uuid 4e8281d2-9de4-42eb-94cc-417be864315d {{(pid=134101) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:47:01.631538 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-08bc2fa1-1682-4879-aa8f-b607777da1db tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] [instance: 4e8281d2-9de4-42eb-94cc-417be864315d] Going to try to live migrate instance to n-h2-860284-1 {{(pid=134101) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 04 21:47:01.702616 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-589ca7ee-8d58-4a06-8b42-9fcf7ac53b37 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:01.714258 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-589ca7ee-8d58-4a06-8b42-9fcf7ac53b37 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/424a22f0-ccc3-4fec-bf38-4aaf924928e3" status: 200 len: 1378 microversion: 2.1 time: 0.188554 Oct 04 21:47:01.714944 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 518/1022] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:01 2022] GET /compute/v2.1/servers/424a22f0-ccc3-4fec-bf38-4aaf924928e3 => generated 1378 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:01.719655 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-43935b89-a968-452e-bb14-ae1655829afb tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:01.721270 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-43935b89-a968-452e-bb14-ae1655829afb tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] [instance: 7512d9d6-ab41-453e-bb9d-8e0861aa37f7] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:01.729180 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-43935b89-a968-452e-bb14-ae1655829afb tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:01.729667 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-43935b89-a968-452e-bb14-ae1655829afb tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:01.730100 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-43935b89-a968-452e-bb14-ae1655829afb tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:01.730840 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-43935b89-a968-452e-bb14-ae1655829afb tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:01.731515 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-43935b89-a968-452e-bb14-ae1655829afb tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:01.731979 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-43935b89-a968-452e-bb14-ae1655829afb tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:01.882358 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-43935b89-a968-452e-bb14-ae1655829afb tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:01.891498 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-43935b89-a968-452e-bb14-ae1655829afb tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:01.892945 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-43935b89-a968-452e-bb14-ae1655829afb tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:01.894224 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-43935b89-a968-452e-bb14-ae1655829afb tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] 10.222.0.43 "GET /compute/v2.1/servers/7512d9d6-ab41-453e-bb9d-8e0861aa37f7" status: 200 len: 1569 microversion: 2.25 time: 0.178293 Oct 04 21:47:01.894925 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 519/1023] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:47:01 2022] GET /compute/v2.1/servers/7512d9d6-ab41-453e-bb9d-8e0861aa37f7 => generated 1569 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:47:01.900163 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-64b3ca12-7e0c-4098-a063-46d185ae4be2 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:01.901344 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-64b3ca12-7e0c-4098-a063-46d185ae4be2 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] [instance: e3380b36-6aba-4736-bcbc-f0058f806d55] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:01.907683 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-64b3ca12-7e0c-4098-a063-46d185ae4be2 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:01.908183 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-64b3ca12-7e0c-4098-a063-46d185ae4be2 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:01.908621 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-64b3ca12-7e0c-4098-a063-46d185ae4be2 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:01.909523 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-64b3ca12-7e0c-4098-a063-46d185ae4be2 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:01.909987 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-64b3ca12-7e0c-4098-a063-46d185ae4be2 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:01.910450 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-64b3ca12-7e0c-4098-a063-46d185ae4be2 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:02.086948 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-64b3ca12-7e0c-4098-a063-46d185ae4be2 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87616cd16995468ab7febf5aa4b284db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e3bf9149434d34b6762aaeef1478ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:02.091147 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=100 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:47:02.096648 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-64b3ca12-7e0c-4098-a063-46d185ae4be2 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] 10.222.0.43 "GET /compute/v2.1/servers/e3380b36-6aba-4736-bcbc-f0058f806d55" status: 200 len: 1477 microversion: 2.1 time: 0.200831 Oct 04 21:47:02.097266 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 520/1024] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:01 2022] GET /compute/v2.1/servers/e3380b36-6aba-4736-bcbc-f0058f806d55 => generated 1477 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:02.115919 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-bb336916-3332-4256-b2b5-a0b9eaa4dae0 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:02.122095 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-bb336916-3332-4256-b2b5-a0b9eaa4dae0 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] [instance: 663b2cc6-7a55-406a-b56f-86047b0e514d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:02.134834 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bb336916-3332-4256-b2b5-a0b9eaa4dae0 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:02.135346 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bb336916-3332-4256-b2b5-a0b9eaa4dae0 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:02.135796 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bb336916-3332-4256-b2b5-a0b9eaa4dae0 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:02.138004 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bb336916-3332-4256-b2b5-a0b9eaa4dae0 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:02.139253 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bb336916-3332-4256-b2b5-a0b9eaa4dae0 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:02.139253 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bb336916-3332-4256-b2b5-a0b9eaa4dae0 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:02.304439 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-bb336916-3332-4256-b2b5-a0b9eaa4dae0 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29842a669a20408b881105135f76cb0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39edf587afe94b60911198aa0bb61613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:02.312710 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-bb336916-3332-4256-b2b5-a0b9eaa4dae0 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] 10.222.0.43 "GET /compute/v2.1/servers/663b2cc6-7a55-406a-b56f-86047b0e514d" status: 200 len: 1466 microversion: 2.1 time: 0.208562 Oct 04 21:47:02.313316 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 521/1025] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:02 2022] GET /compute/v2.1/servers/663b2cc6-7a55-406a-b56f-86047b0e514d => generated 1466 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:02.322130 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-f8faa1de-f4ed-49b8-b374-3d163213a832 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:02.323594 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-f8faa1de-f4ed-49b8-b374-3d163213a832 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] [instance: 59a1880f-2802-4e72-9a17-b966cfec8fe9] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:02.330061 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f8faa1de-f4ed-49b8-b374-3d163213a832 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:02.330688 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f8faa1de-f4ed-49b8-b374-3d163213a832 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:02.331165 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f8faa1de-f4ed-49b8-b374-3d163213a832 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:02.332013 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f8faa1de-f4ed-49b8-b374-3d163213a832 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:02.332472 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f8faa1de-f4ed-49b8-b374-3d163213a832 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:02.332903 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f8faa1de-f4ed-49b8-b374-3d163213a832 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:02.568032 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-f8faa1de-f4ed-49b8-b374-3d163213a832 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7614aeaedd1947b88031fb55ca4783ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00081ff1d1aa41cbad345326b337093a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:02.580999 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-f8faa1de-f4ed-49b8-b374-3d163213a832 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] 10.222.0.43 "GET /compute/v2.1/servers/59a1880f-2802-4e72-9a17-b966cfec8fe9" status: 200 len: 1316 microversion: 2.1 time: 0.266270 Oct 04 21:47:02.581797 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 522/1026] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:02 2022] GET /compute/v2.1/servers/59a1880f-2802-4e72-9a17-b966cfec8fe9 => generated 1316 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:02.586702 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-ada892a2-2e0a-48d9-82d5-318ec6b477e5 tempest-ServersOnMultiNodesTest-962622545 tempest-ServersOnMultiNodesTest-962622545-project-admin] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:02.587314 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-ada892a2-2e0a-48d9-82d5-318ec6b477e5 tempest-ServersOnMultiNodesTest-962622545 tempest-ServersOnMultiNodesTest-962622545-project-admin] [instance: 663b2cc6-7a55-406a-b56f-86047b0e514d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:02.594248 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ada892a2-2e0a-48d9-82d5-318ec6b477e5 tempest-ServersOnMultiNodesTest-962622545 tempest-ServersOnMultiNodesTest-962622545-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:02.594761 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ada892a2-2e0a-48d9-82d5-318ec6b477e5 tempest-ServersOnMultiNodesTest-962622545 tempest-ServersOnMultiNodesTest-962622545-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:02.595245 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ada892a2-2e0a-48d9-82d5-318ec6b477e5 tempest-ServersOnMultiNodesTest-962622545 tempest-ServersOnMultiNodesTest-962622545-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:02.595895 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ada892a2-2e0a-48d9-82d5-318ec6b477e5 tempest-ServersOnMultiNodesTest-962622545 tempest-ServersOnMultiNodesTest-962622545-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:02.596438 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ada892a2-2e0a-48d9-82d5-318ec6b477e5 tempest-ServersOnMultiNodesTest-962622545 tempest-ServersOnMultiNodesTest-962622545-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:02.596859 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ada892a2-2e0a-48d9-82d5-318ec6b477e5 tempest-ServersOnMultiNodesTest-962622545 tempest-ServersOnMultiNodesTest-962622545-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:02.857236 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-ada892a2-2e0a-48d9-82d5-318ec6b477e5 tempest-ServersOnMultiNodesTest-962622545 tempest-ServersOnMultiNodesTest-962622545-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/663b2cc6-7a55-406a-b56f-86047b0e514d" status: 200 len: 1617 microversion: 2.1 time: 0.274167 Oct 04 21:47:02.858118 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 523/1027] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:02 2022] GET /compute/v2.1/servers/663b2cc6-7a55-406a-b56f-86047b0e514d => generated 1617 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:02.874606 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-70673a8e-7898-4101-834a-bfb8d58a6152 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:02.874606 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-70673a8e-7898-4101-834a-bfb8d58a6152 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: 424a22f0-ccc3-4fec-bf38-4aaf924928e3] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:02.874606 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-70673a8e-7898-4101-834a-bfb8d58a6152 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:02.874606 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-70673a8e-7898-4101-834a-bfb8d58a6152 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:02.874914 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-70673a8e-7898-4101-834a-bfb8d58a6152 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:02.874914 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-70673a8e-7898-4101-834a-bfb8d58a6152 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:02.874914 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-70673a8e-7898-4101-834a-bfb8d58a6152 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:02.874914 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-70673a8e-7898-4101-834a-bfb8d58a6152 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:03.092730 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-70673a8e-7898-4101-834a-bfb8d58a6152 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:03.101141 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-70673a8e-7898-4101-834a-bfb8d58a6152 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/424a22f0-ccc3-4fec-bf38-4aaf924928e3" status: 200 len: 1378 microversion: 2.1 time: 0.241972 Oct 04 21:47:03.114390 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 524/1028] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:02 2022] GET /compute/v2.1/servers/424a22f0-ccc3-4fec-bf38-4aaf924928e3 => generated 1378 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:03.114390 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-13183a34-a588-4aa3-be98-7212a5ad6d57 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:03.114390 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-13183a34-a588-4aa3-be98-7212a5ad6d57 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] [instance: 663b2cc6-7a55-406a-b56f-86047b0e514d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:03.114390 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-13183a34-a588-4aa3-be98-7212a5ad6d57 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:03.114955 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-13183a34-a588-4aa3-be98-7212a5ad6d57 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:03.114955 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-13183a34-a588-4aa3-be98-7212a5ad6d57 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:03.114955 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-13183a34-a588-4aa3-be98-7212a5ad6d57 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:03.114955 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-13183a34-a588-4aa3-be98-7212a5ad6d57 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:03.115237 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-13183a34-a588-4aa3-be98-7212a5ad6d57 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:03.145158 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-13183a34-a588-4aa3-be98-7212a5ad6d57 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] [instance: 663b2cc6-7a55-406a-b56f-86047b0e514d] Going to try to terminate instance {{(pid=134102) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:47:03.229091 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-13183a34-a588-4aa3-be98-7212a5ad6d57 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] 10.222.0.43 "DELETE /compute/v2.1/servers/663b2cc6-7a55-406a-b56f-86047b0e514d" status: 204 len: 0 microversion: 2.1 time: 0.126034 Oct 04 21:47:03.229700 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 525/1029] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 21:47:03 2022] DELETE /compute/v2.1/servers/663b2cc6-7a55-406a-b56f-86047b0e514d => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:47:03.236032 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-2a480e5c-53cc-4cd8-a044-117b598f37b3 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:03.236744 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-2a480e5c-53cc-4cd8-a044-117b598f37b3 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] [instance: 7512d9d6-ab41-453e-bb9d-8e0861aa37f7] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:03.242952 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2a480e5c-53cc-4cd8-a044-117b598f37b3 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:03.243436 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2a480e5c-53cc-4cd8-a044-117b598f37b3 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:03.243896 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2a480e5c-53cc-4cd8-a044-117b598f37b3 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:03.244601 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2a480e5c-53cc-4cd8-a044-117b598f37b3 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:03.245054 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2a480e5c-53cc-4cd8-a044-117b598f37b3 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:03.245489 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2a480e5c-53cc-4cd8-a044-117b598f37b3 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:03.460922 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-2a480e5c-53cc-4cd8-a044-117b598f37b3 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:03.469200 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-2a480e5c-53cc-4cd8-a044-117b598f37b3 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:03.470688 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-2a480e5c-53cc-4cd8-a044-117b598f37b3 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:03.471868 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-2a480e5c-53cc-4cd8-a044-117b598f37b3 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] 10.222.0.43 "GET /compute/v2.1/servers/7512d9d6-ab41-453e-bb9d-8e0861aa37f7" status: 200 len: 1569 microversion: 2.25 time: 0.240892 Oct 04 21:47:03.472445 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 526/1030] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:47:03 2022] GET /compute/v2.1/servers/7512d9d6-ab41-453e-bb9d-8e0861aa37f7 => generated 1569 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:47:03.477229 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-5194e2b3-c292-4238-95d9-6e0c1752605f tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:03.477841 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-5194e2b3-c292-4238-95d9-6e0c1752605f tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] [instance: e3380b36-6aba-4736-bcbc-f0058f806d55] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:03.483884 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5194e2b3-c292-4238-95d9-6e0c1752605f tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:03.484375 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5194e2b3-c292-4238-95d9-6e0c1752605f tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:03.484814 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5194e2b3-c292-4238-95d9-6e0c1752605f tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:03.485546 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5194e2b3-c292-4238-95d9-6e0c1752605f tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:03.486005 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5194e2b3-c292-4238-95d9-6e0c1752605f tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:03.486487 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5194e2b3-c292-4238-95d9-6e0c1752605f tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:03.696362 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-5194e2b3-c292-4238-95d9-6e0c1752605f tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87616cd16995468ab7febf5aa4b284db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e3bf9149434d34b6762aaeef1478ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:03.707690 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-5194e2b3-c292-4238-95d9-6e0c1752605f tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] 10.222.0.43 "GET /compute/v2.1/servers/e3380b36-6aba-4736-bcbc-f0058f806d55" status: 200 len: 1477 microversion: 2.1 time: 0.233838 Oct 04 21:47:03.708497 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 527/1031] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:03 2022] GET /compute/v2.1/servers/e3380b36-6aba-4736-bcbc-f0058f806d55 => generated 1477 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:03.718803 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-327fb222-5658-405f-8362-8e5cfd28afc9 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:03.719558 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-327fb222-5658-405f-8362-8e5cfd28afc9 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] [instance: 663b2cc6-7a55-406a-b56f-86047b0e514d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:03.725853 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-327fb222-5658-405f-8362-8e5cfd28afc9 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:03.726522 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-327fb222-5658-405f-8362-8e5cfd28afc9 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:03.726840 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-327fb222-5658-405f-8362-8e5cfd28afc9 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:03.727741 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-327fb222-5658-405f-8362-8e5cfd28afc9 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:03.728200 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-327fb222-5658-405f-8362-8e5cfd28afc9 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:03.728664 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-327fb222-5658-405f-8362-8e5cfd28afc9 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:03.984552 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-327fb222-5658-405f-8362-8e5cfd28afc9 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29842a669a20408b881105135f76cb0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39edf587afe94b60911198aa0bb61613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:03.994129 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-327fb222-5658-405f-8362-8e5cfd28afc9 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] 10.222.0.43 "GET /compute/v2.1/servers/663b2cc6-7a55-406a-b56f-86047b0e514d" status: 200 len: 1472 microversion: 2.1 time: 0.280314 Oct 04 21:47:03.994771 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 528/1032] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:03 2022] GET /compute/v2.1/servers/663b2cc6-7a55-406a-b56f-86047b0e514d => generated 1472 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:03.999638 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-5d2fe3ae-8a8e-43d6-be21-3633f3ff4834 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:04.000257 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-5d2fe3ae-8a8e-43d6-be21-3633f3ff4834 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] [instance: 59a1880f-2802-4e72-9a17-b966cfec8fe9] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:04.007326 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5d2fe3ae-8a8e-43d6-be21-3633f3ff4834 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:04.008169 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5d2fe3ae-8a8e-43d6-be21-3633f3ff4834 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:04.008324 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5d2fe3ae-8a8e-43d6-be21-3633f3ff4834 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:04.008971 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5d2fe3ae-8a8e-43d6-be21-3633f3ff4834 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:04.009537 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5d2fe3ae-8a8e-43d6-be21-3633f3ff4834 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:04.009947 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5d2fe3ae-8a8e-43d6-be21-3633f3ff4834 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:04.249004 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-5d2fe3ae-8a8e-43d6-be21-3633f3ff4834 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7614aeaedd1947b88031fb55ca4783ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00081ff1d1aa41cbad345326b337093a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:04.257785 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-5d2fe3ae-8a8e-43d6-be21-3633f3ff4834 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] 10.222.0.43 "GET /compute/v2.1/servers/59a1880f-2802-4e72-9a17-b966cfec8fe9" status: 200 len: 1316 microversion: 2.1 time: 0.261750 Oct 04 21:47:04.258423 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 529/1033] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:03 2022] GET /compute/v2.1/servers/59a1880f-2802-4e72-9a17-b966cfec8fe9 => generated 1316 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:04.268629 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-63b00d4e-6d42-4bc7-a555-c8fb9ac6e662 req-e005e73e-dd9e-430b-bc90-f09e1166bbb2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7512d9d6-ab41-453e-bb9d-8e0861aa37f7", "name": "network-vif-unplugged", "status": "completed", "tag": "330dc731-c16a-47f0-a849-93d182a330a4"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:47:04.276777 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-63b00d4e-6d42-4bc7-a555-c8fb9ac6e662 req-e005e73e-dd9e-430b-bc90-f09e1166bbb2 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:04.277096 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-63b00d4e-6d42-4bc7-a555-c8fb9ac6e662 req-e005e73e-dd9e-430b-bc90-f09e1166bbb2 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:04.277535 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-63b00d4e-6d42-4bc7-a555-c8fb9ac6e662 req-e005e73e-dd9e-430b-bc90-f09e1166bbb2 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:04.290614 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-63b00d4e-6d42-4bc7-a555-c8fb9ac6e662 req-e005e73e-dd9e-430b-bc90-f09e1166bbb2 service nova] Creating event network-vif-unplugged:330dc731-c16a-47f0-a849-93d182a330a4 for instance 7512d9d6-ab41-453e-bb9d-8e0861aa37f7 on n-h2-860284-1 Oct 04 21:47:04.295552 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-63b00d4e-6d42-4bc7-a555-c8fb9ac6e662 req-e005e73e-dd9e-430b-bc90-f09e1166bbb2 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035995 Oct 04 21:47:04.296341 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 530/1034] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:47:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:47:04.301139 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-40a33f83-7788-4386-a1cb-c9e17653a948 req-9bc485f2-0210-490c-b445-a1c16b3f812f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59a1880f-2802-4e72-9a17-b966cfec8fe9", "name": "network-vif-plugged", "status": "completed", "tag": "893f32f5-2183-4d13-8c2e-2095ab07e2af"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:47:04.311958 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-40a33f83-7788-4386-a1cb-c9e17653a948 req-9bc485f2-0210-490c-b445-a1c16b3f812f service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:04.312455 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-40a33f83-7788-4386-a1cb-c9e17653a948 req-9bc485f2-0210-490c-b445-a1c16b3f812f service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:04.312873 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-40a33f83-7788-4386-a1cb-c9e17653a948 req-9bc485f2-0210-490c-b445-a1c16b3f812f service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:04.325817 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-40a33f83-7788-4386-a1cb-c9e17653a948 req-9bc485f2-0210-490c-b445-a1c16b3f812f service nova] Creating event network-vif-plugged:893f32f5-2183-4d13-8c2e-2095ab07e2af for instance 59a1880f-2802-4e72-9a17-b966cfec8fe9 on n-h1-860284-1 Oct 04 21:47:04.330621 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-40a33f83-7788-4386-a1cb-c9e17653a948 req-9bc485f2-0210-490c-b445-a1c16b3f812f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033170 Oct 04 21:47:04.331231 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 531/1035] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:47:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:47:04.336908 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-385fe452-633a-4f9c-84d9-aee088446308 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:04.340195 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-385fe452-633a-4f9c-84d9-aee088446308 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: 424a22f0-ccc3-4fec-bf38-4aaf924928e3] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:04.344301 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-385fe452-633a-4f9c-84d9-aee088446308 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:04.344795 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-385fe452-633a-4f9c-84d9-aee088446308 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:04.345234 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-385fe452-633a-4f9c-84d9-aee088446308 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:04.345944 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-385fe452-633a-4f9c-84d9-aee088446308 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:04.346452 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-385fe452-633a-4f9c-84d9-aee088446308 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:04.347388 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-385fe452-633a-4f9c-84d9-aee088446308 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:04.543507 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-385fe452-633a-4f9c-84d9-aee088446308 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:04.551660 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-385fe452-633a-4f9c-84d9-aee088446308 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/424a22f0-ccc3-4fec-bf38-4aaf924928e3" status: 200 len: 1378 microversion: 2.1 time: 0.219238 Oct 04 21:47:04.552537 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 532/1036] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:04 2022] GET /compute/v2.1/servers/424a22f0-ccc3-4fec-bf38-4aaf924928e3 => generated 1378 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:04.557601 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-89f1650a-0282-41bf-a9a6-dd3751f2ed0f tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:04.558209 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-89f1650a-0282-41bf-a9a6-dd3751f2ed0f tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] [instance: 7512d9d6-ab41-453e-bb9d-8e0861aa37f7] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:04.564219 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-89f1650a-0282-41bf-a9a6-dd3751f2ed0f tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:04.564706 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-89f1650a-0282-41bf-a9a6-dd3751f2ed0f tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:04.565149 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-89f1650a-0282-41bf-a9a6-dd3751f2ed0f tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:04.565846 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-89f1650a-0282-41bf-a9a6-dd3751f2ed0f tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:04.566304 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-89f1650a-0282-41bf-a9a6-dd3751f2ed0f tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:04.566756 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-89f1650a-0282-41bf-a9a6-dd3751f2ed0f tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:04.700288 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-89f1650a-0282-41bf-a9a6-dd3751f2ed0f tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:04.709538 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-89f1650a-0282-41bf-a9a6-dd3751f2ed0f tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:04.711211 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-89f1650a-0282-41bf-a9a6-dd3751f2ed0f tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:04.712347 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-89f1650a-0282-41bf-a9a6-dd3751f2ed0f tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] 10.222.0.43 "GET /compute/v2.1/servers/7512d9d6-ab41-453e-bb9d-8e0861aa37f7" status: 200 len: 1569 microversion: 2.25 time: 0.158380 Oct 04 21:47:04.712929 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 533/1037] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:47:04 2022] GET /compute/v2.1/servers/7512d9d6-ab41-453e-bb9d-8e0861aa37f7 => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:47:04.735412 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-b56be0a9-524f-4811-8228-e7abb60be69f tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:04.736020 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-b56be0a9-524f-4811-8228-e7abb60be69f tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] [instance: e3380b36-6aba-4736-bcbc-f0058f806d55] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:04.742588 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b56be0a9-524f-4811-8228-e7abb60be69f tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:04.743069 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b56be0a9-524f-4811-8228-e7abb60be69f tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:04.743501 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b56be0a9-524f-4811-8228-e7abb60be69f tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:04.744190 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b56be0a9-524f-4811-8228-e7abb60be69f tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:04.744653 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b56be0a9-524f-4811-8228-e7abb60be69f tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:04.745070 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b56be0a9-524f-4811-8228-e7abb60be69f tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:04.879935 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-b56be0a9-524f-4811-8228-e7abb60be69f tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87616cd16995468ab7febf5aa4b284db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e3bf9149434d34b6762aaeef1478ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:04.887775 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-b56be0a9-524f-4811-8228-e7abb60be69f tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] 10.222.0.43 "GET /compute/v2.1/servers/e3380b36-6aba-4736-bcbc-f0058f806d55" status: 200 len: 1477 microversion: 2.1 time: 0.155999 Oct 04 21:47:04.888351 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 534/1038] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:04 2022] GET /compute/v2.1/servers/e3380b36-6aba-4736-bcbc-f0058f806d55 => generated 1477 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:47:05.018449 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-5b70d4b0-32f4-4c15-9956-4c7efb28e022 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:05.019063 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-5b70d4b0-32f4-4c15-9956-4c7efb28e022 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] [instance: 663b2cc6-7a55-406a-b56f-86047b0e514d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:05.025278 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5b70d4b0-32f4-4c15-9956-4c7efb28e022 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:05.025754 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5b70d4b0-32f4-4c15-9956-4c7efb28e022 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:05.026484 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5b70d4b0-32f4-4c15-9956-4c7efb28e022 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:05.027283 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5b70d4b0-32f4-4c15-9956-4c7efb28e022 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:05.027939 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5b70d4b0-32f4-4c15-9956-4c7efb28e022 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:05.028542 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5b70d4b0-32f4-4c15-9956-4c7efb28e022 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:05.164143 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-5b70d4b0-32f4-4c15-9956-4c7efb28e022 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29842a669a20408b881105135f76cb0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39edf587afe94b60911198aa0bb61613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:05.173100 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-5b70d4b0-32f4-4c15-9956-4c7efb28e022 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] 10.222.0.43 "GET /compute/v2.1/servers/663b2cc6-7a55-406a-b56f-86047b0e514d" status: 200 len: 1472 microversion: 2.1 time: 0.158466 Oct 04 21:47:05.173997 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 535/1039] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:05 2022] GET /compute/v2.1/servers/663b2cc6-7a55-406a-b56f-86047b0e514d => generated 1472 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:47:05.280891 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-7b69f081-99b9-4ba9-96e2-c9472407d726 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:05.281566 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-7b69f081-99b9-4ba9-96e2-c9472407d726 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] [instance: 59a1880f-2802-4e72-9a17-b966cfec8fe9] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:05.288752 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7b69f081-99b9-4ba9-96e2-c9472407d726 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:05.289235 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7b69f081-99b9-4ba9-96e2-c9472407d726 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:05.290174 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7b69f081-99b9-4ba9-96e2-c9472407d726 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:05.290899 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7b69f081-99b9-4ba9-96e2-c9472407d726 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:05.291351 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7b69f081-99b9-4ba9-96e2-c9472407d726 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:05.291766 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7b69f081-99b9-4ba9-96e2-c9472407d726 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:05.431672 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-7b69f081-99b9-4ba9-96e2-c9472407d726 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7614aeaedd1947b88031fb55ca4783ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00081ff1d1aa41cbad345326b337093a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:05.439423 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-7b69f081-99b9-4ba9-96e2-c9472407d726 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] 10.222.0.43 "GET /compute/v2.1/servers/59a1880f-2802-4e72-9a17-b966cfec8fe9" status: 200 len: 1316 microversion: 2.1 time: 0.162580 Oct 04 21:47:05.440015 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 536/1040] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:05 2022] GET /compute/v2.1/servers/59a1880f-2802-4e72-9a17-b966cfec8fe9 => generated 1316 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:47:05.577415 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-027ff54e-a24e-4ed4-aa4b-91149e4d47dc tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:05.577946 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-027ff54e-a24e-4ed4-aa4b-91149e4d47dc tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: 424a22f0-ccc3-4fec-bf38-4aaf924928e3] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:05.584554 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-027ff54e-a24e-4ed4-aa4b-91149e4d47dc tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:05.585043 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-027ff54e-a24e-4ed4-aa4b-91149e4d47dc tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:05.585482 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-027ff54e-a24e-4ed4-aa4b-91149e4d47dc tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:05.586193 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-027ff54e-a24e-4ed4-aa4b-91149e4d47dc tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:05.586686 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-027ff54e-a24e-4ed4-aa4b-91149e4d47dc tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:05.587117 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-027ff54e-a24e-4ed4-aa4b-91149e4d47dc tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:05.591461 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:47:05.733693 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-027ff54e-a24e-4ed4-aa4b-91149e4d47dc tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:05.745954 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-027ff54e-a24e-4ed4-aa4b-91149e4d47dc tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/424a22f0-ccc3-4fec-bf38-4aaf924928e3" status: 200 len: 1378 microversion: 2.1 time: 0.172532 Oct 04 21:47:05.747054 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 537/1041] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:05 2022] GET /compute/v2.1/servers/424a22f0-ccc3-4fec-bf38-4aaf924928e3 => generated 1378 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:47:05.752895 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-e6020e68-6494-41ed-b146-aa9e1ed13248 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:05.753189 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-e6020e68-6494-41ed-b146-aa9e1ed13248 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] [instance: 7512d9d6-ab41-453e-bb9d-8e0861aa37f7] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:05.755084 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:47:05.763168 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e6020e68-6494-41ed-b146-aa9e1ed13248 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:05.764012 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e6020e68-6494-41ed-b146-aa9e1ed13248 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:05.764677 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e6020e68-6494-41ed-b146-aa9e1ed13248 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:05.765710 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e6020e68-6494-41ed-b146-aa9e1ed13248 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:05.766081 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e6020e68-6494-41ed-b146-aa9e1ed13248 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:05.767363 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e6020e68-6494-41ed-b146-aa9e1ed13248 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:05.905510 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-e6020e68-6494-41ed-b146-aa9e1ed13248 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:05.915105 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-e6020e68-6494-41ed-b146-aa9e1ed13248 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:05.916852 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-e6020e68-6494-41ed-b146-aa9e1ed13248 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:05.918215 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-e6020e68-6494-41ed-b146-aa9e1ed13248 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] 10.222.0.43 "GET /compute/v2.1/servers/7512d9d6-ab41-453e-bb9d-8e0861aa37f7" status: 200 len: 1569 microversion: 2.25 time: 0.170100 Oct 04 21:47:05.918875 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 538/1042] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:47:05 2022] GET /compute/v2.1/servers/7512d9d6-ab41-453e-bb9d-8e0861aa37f7 => generated 1569 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:47:05.931744 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-8a018256-ff59-41db-aa8b-6c1ce85714d8 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:05.931744 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-8a018256-ff59-41db-aa8b-6c1ce85714d8 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] [instance: e3380b36-6aba-4736-bcbc-f0058f806d55] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:05.931744 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8a018256-ff59-41db-aa8b-6c1ce85714d8 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:05.932118 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8a018256-ff59-41db-aa8b-6c1ce85714d8 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:05.932560 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8a018256-ff59-41db-aa8b-6c1ce85714d8 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:05.933271 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8a018256-ff59-41db-aa8b-6c1ce85714d8 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:05.933729 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8a018256-ff59-41db-aa8b-6c1ce85714d8 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:05.934157 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8a018256-ff59-41db-aa8b-6c1ce85714d8 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:06.072446 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-8a018256-ff59-41db-aa8b-6c1ce85714d8 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87616cd16995468ab7febf5aa4b284db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e3bf9149434d34b6762aaeef1478ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:06.080442 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-8a018256-ff59-41db-aa8b-6c1ce85714d8 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] 10.222.0.43 "GET /compute/v2.1/servers/e3380b36-6aba-4736-bcbc-f0058f806d55" status: 200 len: 1477 microversion: 2.1 time: 0.160439 Oct 04 21:47:06.081061 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 539/1043] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:05 2022] GET /compute/v2.1/servers/e3380b36-6aba-4736-bcbc-f0058f806d55 => generated 1477 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:06.197838 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-63b76afc-5f22-43aa-9cf7-c6a60f567ea4 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:06.199064 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-63b76afc-5f22-43aa-9cf7-c6a60f567ea4 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] [instance: 663b2cc6-7a55-406a-b56f-86047b0e514d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:06.206012 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-63b76afc-5f22-43aa-9cf7-c6a60f567ea4 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:06.206641 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-63b76afc-5f22-43aa-9cf7-c6a60f567ea4 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:06.207156 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-63b76afc-5f22-43aa-9cf7-c6a60f567ea4 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:06.208465 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-63b76afc-5f22-43aa-9cf7-c6a60f567ea4 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:06.209642 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-63b76afc-5f22-43aa-9cf7-c6a60f567ea4 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:06.211214 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-63b76afc-5f22-43aa-9cf7-c6a60f567ea4 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:06.361963 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-63b76afc-5f22-43aa-9cf7-c6a60f567ea4 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29842a669a20408b881105135f76cb0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39edf587afe94b60911198aa0bb61613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:06.374911 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-63b76afc-5f22-43aa-9cf7-c6a60f567ea4 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] 10.222.0.43 "GET /compute/v2.1/servers/663b2cc6-7a55-406a-b56f-86047b0e514d" status: 200 len: 1472 microversion: 2.1 time: 0.181074 Oct 04 21:47:06.375901 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 540/1044] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:06 2022] GET /compute/v2.1/servers/663b2cc6-7a55-406a-b56f-86047b0e514d => generated 1472 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:47:06.383036 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-e7db0e6c-f112-4273-a6ff-0eb10e90df47 req-0e002580-0f3a-47db-9ce4-ae2a863ca84d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7512d9d6-ab41-453e-bb9d-8e0861aa37f7", "tag": "330dc731-c16a-47f0-a849-93d182a330a4"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:47:06.409349 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-e7db0e6c-f112-4273-a6ff-0eb10e90df47 req-0e002580-0f3a-47db-9ce4-ae2a863ca84d service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:06.409829 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-e7db0e6c-f112-4273-a6ff-0eb10e90df47 req-0e002580-0f3a-47db-9ce4-ae2a863ca84d service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:06.410256 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-e7db0e6c-f112-4273-a6ff-0eb10e90df47 req-0e002580-0f3a-47db-9ce4-ae2a863ca84d service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:06.422318 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-e7db0e6c-f112-4273-a6ff-0eb10e90df47 req-0e002580-0f3a-47db-9ce4-ae2a863ca84d service nova] Creating event network-changed:330dc731-c16a-47f0-a849-93d182a330a4 for instance 7512d9d6-ab41-453e-bb9d-8e0861aa37f7 on n-h2-860284-1 Oct 04 21:47:06.427927 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-e7db0e6c-f112-4273-a6ff-0eb10e90df47 req-0e002580-0f3a-47db-9ce4-ae2a863ca84d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050007 Oct 04 21:47:06.428838 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 541/1045] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:47:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:47:06.434523 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-475f8891-364b-4a23-8284-06c733a2d436 req-3d76c8b5-74f3-4b63-9157-38e54cebe7ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3380b36-6aba-4736-bcbc-f0058f806d55", "name": "network-vif-unplugged", "status": "completed", "tag": "b25814f1-d2d0-4853-bfa4-3948c24c40e5"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:47:06.446982 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-475f8891-364b-4a23-8284-06c733a2d436 req-3d76c8b5-74f3-4b63-9157-38e54cebe7ab service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:06.447578 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-475f8891-364b-4a23-8284-06c733a2d436 req-3d76c8b5-74f3-4b63-9157-38e54cebe7ab service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:06.448225 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-475f8891-364b-4a23-8284-06c733a2d436 req-3d76c8b5-74f3-4b63-9157-38e54cebe7ab service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:06.466023 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-475f8891-364b-4a23-8284-06c733a2d436 req-3d76c8b5-74f3-4b63-9157-38e54cebe7ab service nova] Creating event network-vif-unplugged:b25814f1-d2d0-4853-bfa4-3948c24c40e5 for instance e3380b36-6aba-4736-bcbc-f0058f806d55 on n-h2-860284-1 Oct 04 21:47:06.472461 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-475f8891-364b-4a23-8284-06c733a2d436 req-3d76c8b5-74f3-4b63-9157-38e54cebe7ab service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042314 Oct 04 21:47:06.473111 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 542/1046] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:47:06 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:47:06.479087 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-23d25add-f134-4a8f-ba0b-8298e1019fa4 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:06.479790 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-23d25add-f134-4a8f-ba0b-8298e1019fa4 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] [instance: 59a1880f-2802-4e72-9a17-b966cfec8fe9] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:06.486205 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-23d25add-f134-4a8f-ba0b-8298e1019fa4 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:06.486748 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-23d25add-f134-4a8f-ba0b-8298e1019fa4 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:06.487179 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-23d25add-f134-4a8f-ba0b-8298e1019fa4 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:06.487889 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-23d25add-f134-4a8f-ba0b-8298e1019fa4 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:06.488336 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-23d25add-f134-4a8f-ba0b-8298e1019fa4 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:06.488758 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-23d25add-f134-4a8f-ba0b-8298e1019fa4 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:06.657689 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-23d25add-f134-4a8f-ba0b-8298e1019fa4 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7614aeaedd1947b88031fb55ca4783ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00081ff1d1aa41cbad345326b337093a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:06.667241 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-23d25add-f134-4a8f-ba0b-8298e1019fa4 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] 10.222.0.43 "GET /compute/v2.1/servers/59a1880f-2802-4e72-9a17-b966cfec8fe9" status: 200 len: 1466 microversion: 2.1 time: 0.192912 Oct 04 21:47:06.667841 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 543/1047] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:06 2022] GET /compute/v2.1/servers/59a1880f-2802-4e72-9a17-b966cfec8fe9 => generated 1466 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:06.691690 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-c722acdc-3104-4a17-b99d-78e068d5159d tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-1445159695", "metadata": {"image_type": "test"}}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:47:06.695300 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-c722acdc-3104-4a17-b99d-78e068d5159d tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] [instance: 59a1880f-2802-4e72-9a17-b966cfec8fe9] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:06.701631 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c722acdc-3104-4a17-b99d-78e068d5159d tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:06.702150 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c722acdc-3104-4a17-b99d-78e068d5159d tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:06.702618 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c722acdc-3104-4a17-b99d-78e068d5159d tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:06.703314 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c722acdc-3104-4a17-b99d-78e068d5159d tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:06.703768 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c722acdc-3104-4a17-b99d-78e068d5159d tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:06.704190 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c722acdc-3104-4a17-b99d-78e068d5159d tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:06.739431 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-c722acdc-3104-4a17-b99d-78e068d5159d tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Getting quotas for project 00081ff1d1aa41cbad345326b337093a. Resources: dict_keys(['metadata_items']) {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:47:06.745260 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-c722acdc-3104-4a17-b99d-78e068d5159d tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Getting quotas for user 7614aeaedd1947b88031fb55ca4783ae and project 00081ff1d1aa41cbad345326b337093a. Resources: dict_keys(['metadata_items']) {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:47:06.944736 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-c722acdc-3104-4a17-b99d-78e068d5159d tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] 10.222.0.43 "POST /compute/v2.1/servers/59a1880f-2802-4e72-9a17-b966cfec8fe9/action" status: 202 len: 0 microversion: 2.1 time: 0.256667 Oct 04 21:47:06.945409 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 544/1048] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 21:47:06 2022] POST /compute/v2.1/servers/59a1880f-2802-4e72-9a17-b966cfec8fe9/action => generated 0 bytes in 258 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 04 21:47:06.950862 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-8b8bac2a-9f26-4efb-b188-8c21f9c0c87a tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:06.951397 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-8b8bac2a-9f26-4efb-b188-8c21f9c0c87a tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: 424a22f0-ccc3-4fec-bf38-4aaf924928e3] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:06.960686 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8b8bac2a-9f26-4efb-b188-8c21f9c0c87a tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:06.961184 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8b8bac2a-9f26-4efb-b188-8c21f9c0c87a tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:06.961629 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8b8bac2a-9f26-4efb-b188-8c21f9c0c87a tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:06.962344 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8b8bac2a-9f26-4efb-b188-8c21f9c0c87a tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:06.962828 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8b8bac2a-9f26-4efb-b188-8c21f9c0c87a tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:06.963252 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8b8bac2a-9f26-4efb-b188-8c21f9c0c87a tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:07.099555 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-8b8bac2a-9f26-4efb-b188-8c21f9c0c87a tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:07.108048 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-8b8bac2a-9f26-4efb-b188-8c21f9c0c87a tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/424a22f0-ccc3-4fec-bf38-4aaf924928e3" status: 200 len: 1527 microversion: 2.1 time: 0.161435 Oct 04 21:47:07.108677 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 545/1049] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:06 2022] GET /compute/v2.1/servers/424a22f0-ccc3-4fec-bf38-4aaf924928e3 => generated 1527 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:07.113317 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-f591d93f-6078-4515-8457-35cf1c8bddc6 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:07.113921 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-f591d93f-6078-4515-8457-35cf1c8bddc6 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] [instance: 7512d9d6-ab41-453e-bb9d-8e0861aa37f7] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:07.120507 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f591d93f-6078-4515-8457-35cf1c8bddc6 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:07.120994 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f591d93f-6078-4515-8457-35cf1c8bddc6 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:07.121541 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f591d93f-6078-4515-8457-35cf1c8bddc6 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:07.122244 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f591d93f-6078-4515-8457-35cf1c8bddc6 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:07.122725 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f591d93f-6078-4515-8457-35cf1c8bddc6 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:07.123149 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f591d93f-6078-4515-8457-35cf1c8bddc6 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:07.272945 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-f591d93f-6078-4515-8457-35cf1c8bddc6 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:07.281815 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-f591d93f-6078-4515-8457-35cf1c8bddc6 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:07.283289 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-f591d93f-6078-4515-8457-35cf1c8bddc6 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:07.284479 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-f591d93f-6078-4515-8457-35cf1c8bddc6 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] 10.222.0.43 "GET /compute/v2.1/servers/7512d9d6-ab41-453e-bb9d-8e0861aa37f7" status: 200 len: 1569 microversion: 2.25 time: 0.174876 Oct 04 21:47:07.285081 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 546/1050] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:47:07 2022] GET /compute/v2.1/servers/7512d9d6-ab41-453e-bb9d-8e0861aa37f7 => generated 1569 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:47:07.290088 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-17b943dc-bcbc-4876-9855-34f9853b4ec2 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Calling method '.version_select at 0x7fbb2f185430>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:07.339538 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-17b943dc-bcbc-4876-9855-34f9853b4ec2 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] 10.222.0.43 "GET /compute/v2.1/images/ac8e9797-0b3b-4c06-9229-b4ac23c4312c" status: 200 len: 1422 microversion: 2.1 time: 0.053353 Oct 04 21:47:07.340132 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 547/1051] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:47:07 2022] GET /compute/v2.1/images/ac8e9797-0b3b-4c06-9229-b4ac23c4312c => generated 1422 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:07.344835 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-384ef595-03e2-40ed-9121-f9c8966437b3 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:07.345456 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-384ef595-03e2-40ed-9121-f9c8966437b3 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] [instance: e3380b36-6aba-4736-bcbc-f0058f806d55] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:07.352607 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-384ef595-03e2-40ed-9121-f9c8966437b3 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:07.353009 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-384ef595-03e2-40ed-9121-f9c8966437b3 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:07.353446 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-384ef595-03e2-40ed-9121-f9c8966437b3 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:07.354154 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-384ef595-03e2-40ed-9121-f9c8966437b3 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:07.354646 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-384ef595-03e2-40ed-9121-f9c8966437b3 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:07.355071 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-384ef595-03e2-40ed-9121-f9c8966437b3 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:07.497299 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-384ef595-03e2-40ed-9121-f9c8966437b3 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87616cd16995468ab7febf5aa4b284db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e3bf9149434d34b6762aaeef1478ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:07.505210 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-384ef595-03e2-40ed-9121-f9c8966437b3 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] 10.222.0.43 "GET /compute/v2.1/servers/e3380b36-6aba-4736-bcbc-f0058f806d55" status: 200 len: 1477 microversion: 2.1 time: 0.164059 Oct 04 21:47:07.505825 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 548/1052] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:07 2022] GET /compute/v2.1/servers/e3380b36-6aba-4736-bcbc-f0058f806d55 => generated 1477 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:07.510998 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-f5142aa1-9def-499f-a78e-eb004470fc8d tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:07.511631 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-f5142aa1-9def-499f-a78e-eb004470fc8d tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: 424a22f0-ccc3-4fec-bf38-4aaf924928e3] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:07.517824 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f5142aa1-9def-499f-a78e-eb004470fc8d tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:07.518308 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f5142aa1-9def-499f-a78e-eb004470fc8d tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:07.518772 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f5142aa1-9def-499f-a78e-eb004470fc8d tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:07.519503 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f5142aa1-9def-499f-a78e-eb004470fc8d tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:07.519933 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f5142aa1-9def-499f-a78e-eb004470fc8d tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:07.520349 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f5142aa1-9def-499f-a78e-eb004470fc8d tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:07.685385 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-f5142aa1-9def-499f-a78e-eb004470fc8d tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:07.693380 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-f5142aa1-9def-499f-a78e-eb004470fc8d tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/424a22f0-ccc3-4fec-bf38-4aaf924928e3" status: 200 len: 1527 microversion: 2.1 time: 0.185964 Oct 04 21:47:07.694416 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 549/1053] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:07 2022] GET /compute/v2.1/servers/424a22f0-ccc3-4fec-bf38-4aaf924928e3 => generated 1527 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:07.699424 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-223b6125-18f6-404b-b8bb-b9752982fdbe tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:07.699889 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-223b6125-18f6-404b-b8bb-b9752982fdbe tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] [instance: 663b2cc6-7a55-406a-b56f-86047b0e514d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:07.706163 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-223b6125-18f6-404b-b8bb-b9752982fdbe tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:07.706701 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-223b6125-18f6-404b-b8bb-b9752982fdbe tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:07.707130 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-223b6125-18f6-404b-b8bb-b9752982fdbe tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:07.707880 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-223b6125-18f6-404b-b8bb-b9752982fdbe tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:07.708332 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-223b6125-18f6-404b-b8bb-b9752982fdbe tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:07.708751 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-223b6125-18f6-404b-b8bb-b9752982fdbe tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:07.844583 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-223b6125-18f6-404b-b8bb-b9752982fdbe tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29842a669a20408b881105135f76cb0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39edf587afe94b60911198aa0bb61613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:07.853500 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-223b6125-18f6-404b-b8bb-b9752982fdbe tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] 10.222.0.43 "GET /compute/v2.1/servers/663b2cc6-7a55-406a-b56f-86047b0e514d" status: 200 len: 1472 microversion: 2.1 time: 0.158044 Oct 04 21:47:07.854092 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 550/1054] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:07 2022] GET /compute/v2.1/servers/663b2cc6-7a55-406a-b56f-86047b0e514d => generated 1472 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:07.858572 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-1f2140f3-0baf-4599-899d-4f156b635ce2 tempest-MigrationsAdminTest-1218821219 tempest-MigrationsAdminTest-1218821219-project-admin] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:07.876850 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-1f2140f3-0baf-4599-899d-4f156b635ce2 tempest-MigrationsAdminTest-1218821219 tempest-MigrationsAdminTest-1218821219-project-admin] 10.222.0.43 "DELETE /compute/v2.1/flavors/2f11d680-cbcd-4967-844a-69bea5307624" status: 202 len: 0 microversion: 2.1 time: 0.021684 Oct 04 21:47:07.877751 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 551/1055] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 21:47:07 2022] DELETE /compute/v2.1/flavors/2f11d680-cbcd-4967-844a-69bea5307624 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:47:07.886183 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-ae598291-4fb0-4649-9905-df76abe00e6f tempest-MigrationsAdminTest-1218821219 tempest-MigrationsAdminTest-1218821219-project-admin] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:07.907689 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-ae598291-4fb0-4649-9905-df76abe00e6f tempest-MigrationsAdminTest-1218821219 tempest-MigrationsAdminTest-1218821219-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 5821 microversion: 2.1 time: 0.025047 Oct 04 21:47:07.909075 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 552/1056] 10.222.0.43 () {58 vars in 1146 bytes} [Tue Oct 4 21:47:07 2022] GET /compute/v2.1/flavors/detail => generated 5821 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:47:07.929548 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-340f031b-e1b0-4835-9be1-17da35b8b8be tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:47:07.931949 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-340f031b-e1b0-4835-9be1-17da35b8b8be tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: 424a22f0-ccc3-4fec-bf38-4aaf924928e3] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:07.938167 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-340f031b-e1b0-4835-9be1-17da35b8b8be tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:07.939293 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-340f031b-e1b0-4835-9be1-17da35b8b8be tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:07.939293 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-340f031b-e1b0-4835-9be1-17da35b8b8be tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:07.939810 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-340f031b-e1b0-4835-9be1-17da35b8b8be tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:07.940323 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-340f031b-e1b0-4835-9be1-17da35b8b8be tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:07.940793 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-340f031b-e1b0-4835-9be1-17da35b8b8be tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:08.019795 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell0:SELECT=18 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:47:08.066444 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-340f031b-e1b0-4835-9be1-17da35b8b8be tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:08.073988 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-340f031b-e1b0-4835-9be1-17da35b8b8be tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: 424a22f0-ccc3-4fec-bf38-4aaf924928e3] Old instance type tempest-test_resize_flavor_-802784835, new instance type m1.heat {{(pid=134102) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 04 21:47:08.082984 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-340f031b-e1b0-4835-9be1-17da35b8b8be tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Flavor limits 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:47:08.083419 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-340f031b-e1b0-4835-9be1-17da35b8b8be tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Image limits 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:47:08.084445 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-340f031b-e1b0-4835-9be1-17da35b8b8be tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Flavor pref 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:47:08.085496 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-340f031b-e1b0-4835-9be1-17da35b8b8be tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Image pref 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:47:08.085670 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-340f031b-e1b0-4835-9be1-17da35b8b8be tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:47:08.208616 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-340f031b-e1b0-4835-9be1-17da35b8b8be tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "POST /compute/v2.1/servers/424a22f0-ccc3-4fec-bf38-4aaf924928e3/action" status: 202 len: 0 microversion: 2.1 time: 0.284007 Oct 04 21:47:08.213065 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 553/1057] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 21:47:07 2022] POST /compute/v2.1/servers/424a22f0-ccc3-4fec-bf38-4aaf924928e3/action => generated 0 bytes in 289 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 21:47:08.218117 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-30997dcc-8a70-4188-98cf-ad3d18cb4683 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:08.218675 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-30997dcc-8a70-4188-98cf-ad3d18cb4683 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: 424a22f0-ccc3-4fec-bf38-4aaf924928e3] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:08.225249 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-30997dcc-8a70-4188-98cf-ad3d18cb4683 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:08.226353 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-30997dcc-8a70-4188-98cf-ad3d18cb4683 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:08.227078 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-30997dcc-8a70-4188-98cf-ad3d18cb4683 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:08.227960 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-30997dcc-8a70-4188-98cf-ad3d18cb4683 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:08.228252 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-30997dcc-8a70-4188-98cf-ad3d18cb4683 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:08.228914 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-30997dcc-8a70-4188-98cf-ad3d18cb4683 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:08.558175 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-30997dcc-8a70-4188-98cf-ad3d18cb4683 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:08.563767 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:47:08.579968 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-30997dcc-8a70-4188-98cf-ad3d18cb4683 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/424a22f0-ccc3-4fec-bf38-4aaf924928e3" status: 200 len: 1536 microversion: 2.1 time: 0.366138 Oct 04 21:47:08.587853 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 554/1058] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:08 2022] GET /compute/v2.1/servers/424a22f0-ccc3-4fec-bf38-4aaf924928e3 => generated 1536 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:08.608456 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-685f14b3-1454-4a92-9296-fe70dba61025 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:08.611193 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-685f14b3-1454-4a92-9296-fe70dba61025 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] [instance: 7512d9d6-ab41-453e-bb9d-8e0861aa37f7] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:08.651442 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-685f14b3-1454-4a92-9296-fe70dba61025 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:08.651956 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-685f14b3-1454-4a92-9296-fe70dba61025 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:08.655785 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-685f14b3-1454-4a92-9296-fe70dba61025 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:08.656594 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-685f14b3-1454-4a92-9296-fe70dba61025 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:08.657081 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-685f14b3-1454-4a92-9296-fe70dba61025 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:08.657520 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-685f14b3-1454-4a92-9296-fe70dba61025 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:09.507500 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-685f14b3-1454-4a92-9296-fe70dba61025 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:09.525226 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-685f14b3-1454-4a92-9296-fe70dba61025 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:09.527139 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-685f14b3-1454-4a92-9296-fe70dba61025 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:09.529751 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-685f14b3-1454-4a92-9296-fe70dba61025 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] 10.222.0.43 "GET /compute/v2.1/servers/7512d9d6-ab41-453e-bb9d-8e0861aa37f7" status: 200 len: 1569 microversion: 2.25 time: 0.940648 Oct 04 21:47:09.531246 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 555/1059] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:47:08 2022] GET /compute/v2.1/servers/7512d9d6-ab41-453e-bb9d-8e0861aa37f7 => generated 1569 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:47:09.548347 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-0a6d383d-500c-4711-9282-79408e728aed tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Calling method '.version_select at 0x7fbb2f093820>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:09.571874 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-08bc2fa1-1682-4879-aa8f-b607777da1db tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] 10.222.0.43 "POST /compute/v2.1/servers/4e8281d2-9de4-42eb-94cc-417be864315d/action" status: 202 len: 0 microversion: 2.1 time: 7.990943 Oct 04 21:47:09.572819 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 505/1060] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 21:47:01 2022] POST /compute/v2.1/servers/4e8281d2-9de4-42eb-94cc-417be864315d/action => generated 0 bytes in 7998 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:47:09.596850 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-57ebff4a-026f-4d93-99c2-4248766c2a7f tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:09.597839 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-57ebff4a-026f-4d93-99c2-4248766c2a7f tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] [instance: e3380b36-6aba-4736-bcbc-f0058f806d55] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:09.611521 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-57ebff4a-026f-4d93-99c2-4248766c2a7f tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:09.612386 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-57ebff4a-026f-4d93-99c2-4248766c2a7f tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:09.613123 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-57ebff4a-026f-4d93-99c2-4248766c2a7f tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:09.614140 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-57ebff4a-026f-4d93-99c2-4248766c2a7f tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:09.614873 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-57ebff4a-026f-4d93-99c2-4248766c2a7f tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:09.616041 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-57ebff4a-026f-4d93-99c2-4248766c2a7f tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:09.658418 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-0a6d383d-500c-4711-9282-79408e728aed tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] 10.222.0.43 "GET /compute/v2.1/images/ac8e9797-0b3b-4c06-9229-b4ac23c4312c" status: 200 len: 1422 microversion: 2.1 time: 0.125824 Oct 04 21:47:09.658980 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 556/1061] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:47:09 2022] GET /compute/v2.1/images/ac8e9797-0b3b-4c06-9229-b4ac23c4312c => generated 1422 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:09.667567 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-0a7feed4-2461-4e12-98d5-05b9c701da8e req-baee2e63-6bad-4a01-af0b-2cfd141e5e02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "663b2cc6-7a55-406a-b56f-86047b0e514d", "name": "network-vif-deleted", "tag": "b18d9b3a-6ec1-47b6-83c8-9f36631f8f7c"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:47:09.688125 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-0a7feed4-2461-4e12-98d5-05b9c701da8e req-baee2e63-6bad-4a01-af0b-2cfd141e5e02 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:09.689105 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-0a7feed4-2461-4e12-98d5-05b9c701da8e req-baee2e63-6bad-4a01-af0b-2cfd141e5e02 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:09.689953 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-0a7feed4-2461-4e12-98d5-05b9c701da8e req-baee2e63-6bad-4a01-af0b-2cfd141e5e02 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:09.711029 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-0a7feed4-2461-4e12-98d5-05b9c701da8e req-baee2e63-6bad-4a01-af0b-2cfd141e5e02 service nova] Creating event network-vif-deleted:b18d9b3a-6ec1-47b6-83c8-9f36631f8f7c for instance 663b2cc6-7a55-406a-b56f-86047b0e514d on n-h2-860284-1 Oct 04 21:47:09.716819 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-0a7feed4-2461-4e12-98d5-05b9c701da8e req-baee2e63-6bad-4a01-af0b-2cfd141e5e02 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056446 Oct 04 21:47:09.723137 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 557/1062] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:47:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:47:09.730705 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-b5105f02-6dcb-4837-b9ba-faeb3711de56 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:09.731822 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-b5105f02-6dcb-4837-b9ba-faeb3711de56 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] [instance: 663b2cc6-7a55-406a-b56f-86047b0e514d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:09.744580 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b5105f02-6dcb-4837-b9ba-faeb3711de56 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:09.746460 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b5105f02-6dcb-4837-b9ba-faeb3711de56 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:09.746866 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b5105f02-6dcb-4837-b9ba-faeb3711de56 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:09.748366 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b5105f02-6dcb-4837-b9ba-faeb3711de56 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:09.749939 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b5105f02-6dcb-4837-b9ba-faeb3711de56 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:09.750888 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b5105f02-6dcb-4837-b9ba-faeb3711de56 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:09.801032 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b5105f02-6dcb-4837-b9ba-faeb3711de56 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:09.801795 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b5105f02-6dcb-4837-b9ba-faeb3711de56 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:09.802564 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b5105f02-6dcb-4837-b9ba-faeb3711de56 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:09.803022 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.objects.instance [None req-b5105f02-6dcb-4837-b9ba-faeb3711de56 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lazy-loading 'fault' on Instance uuid 663b2cc6-7a55-406a-b56f-86047b0e514d {{(pid=134102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:47:09.914490 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-57ebff4a-026f-4d93-99c2-4248766c2a7f tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87616cd16995468ab7febf5aa4b284db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e3bf9149434d34b6762aaeef1478ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:09.916359 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-b5105f02-6dcb-4837-b9ba-faeb3711de56 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29842a669a20408b881105135f76cb0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39edf587afe94b60911198aa0bb61613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:09.931401 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-b5105f02-6dcb-4837-b9ba-faeb3711de56 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] 10.222.0.43 "GET /compute/v2.1/servers/663b2cc6-7a55-406a-b56f-86047b0e514d" status: 200 len: 1306 microversion: 2.1 time: 0.206948 Oct 04 21:47:09.933142 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 558/1063] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:09 2022] GET /compute/v2.1/servers/663b2cc6-7a55-406a-b56f-86047b0e514d => generated 1306 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:09.955718 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-edda6827-61cb-4830-8b94-ff51304dcfe1 req-aec7970e-e089-4e42-ba0e-3176a1310dda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3380b36-6aba-4736-bcbc-f0058f806d55", "name": "network-vif-plugged", "status": "completed", "tag": "b25814f1-d2d0-4853-bfa4-3948c24c40e5"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:47:09.962290 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-57ebff4a-026f-4d93-99c2-4248766c2a7f tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] 10.222.0.43 "GET /compute/v2.1/servers/e3380b36-6aba-4736-bcbc-f0058f806d55" status: 200 len: 1477 microversion: 2.1 time: 0.383660 Oct 04 21:47:09.962943 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 506/1064] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:09 2022] GET /compute/v2.1/servers/e3380b36-6aba-4736-bcbc-f0058f806d55 => generated 1477 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:09.973419 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-58632804-930c-4e5f-9436-f2ad70efaad8 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:09.985695 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-58632804-930c-4e5f-9436-f2ad70efaad8 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 4e8281d2-9de4-42eb-94cc-417be864315d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:09.992981 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-edda6827-61cb-4830-8b94-ff51304dcfe1 req-aec7970e-e089-4e42-ba0e-3176a1310dda service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:09.993475 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-edda6827-61cb-4830-8b94-ff51304dcfe1 req-aec7970e-e089-4e42-ba0e-3176a1310dda service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:09.993904 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-edda6827-61cb-4830-8b94-ff51304dcfe1 req-aec7970e-e089-4e42-ba0e-3176a1310dda service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:09.999134 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-58632804-930c-4e5f-9436-f2ad70efaad8 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:09.999946 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-58632804-930c-4e5f-9436-f2ad70efaad8 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:10.004986 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-58632804-930c-4e5f-9436-f2ad70efaad8 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:10.006542 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-58632804-930c-4e5f-9436-f2ad70efaad8 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:10.007226 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-58632804-930c-4e5f-9436-f2ad70efaad8 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:10.007837 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-58632804-930c-4e5f-9436-f2ad70efaad8 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:10.023351 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-edda6827-61cb-4830-8b94-ff51304dcfe1 req-aec7970e-e089-4e42-ba0e-3176a1310dda service nova] Creating event network-vif-plugged:b25814f1-d2d0-4853-bfa4-3948c24c40e5 for instance e3380b36-6aba-4736-bcbc-f0058f806d55 on n-h2-860284-1 Oct 04 21:47:10.030736 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-edda6827-61cb-4830-8b94-ff51304dcfe1 req-aec7970e-e089-4e42-ba0e-3176a1310dda service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095903 Oct 04 21:47:10.036631 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 559/1065] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:47:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:47:10.043909 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-ef6e4150-769f-482a-8742-e2c41f3367b4 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:10.048988 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-ef6e4150-769f-482a-8742-e2c41f3367b4 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: 424a22f0-ccc3-4fec-bf38-4aaf924928e3] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:10.061355 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ef6e4150-769f-482a-8742-e2c41f3367b4 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:10.062157 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ef6e4150-769f-482a-8742-e2c41f3367b4 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:10.062849 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ef6e4150-769f-482a-8742-e2c41f3367b4 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:10.063775 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ef6e4150-769f-482a-8742-e2c41f3367b4 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:10.064425 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ef6e4150-769f-482a-8742-e2c41f3367b4 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:10.065045 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ef6e4150-769f-482a-8742-e2c41f3367b4 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:10.507154 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-ef6e4150-769f-482a-8742-e2c41f3367b4 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:10.516347 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-ef6e4150-769f-482a-8742-e2c41f3367b4 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/424a22f0-ccc3-4fec-bf38-4aaf924928e3" status: 200 len: 1536 microversion: 2.1 time: 0.477770 Oct 04 21:47:10.517948 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 560/1066] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:10 2022] GET /compute/v2.1/servers/424a22f0-ccc3-4fec-bf38-4aaf924928e3 => generated 1536 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:10.537568 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-58632804-930c-4e5f-9436-f2ad70efaad8 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ad048becf474fb972d4291422d810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dcfc7024fc49388c4bd5f25f03e60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:10.545757 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-58632804-930c-4e5f-9436-f2ad70efaad8 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/4e8281d2-9de4-42eb-94cc-417be864315d" status: 200 len: 1503 microversion: 2.1 time: 0.576226 Oct 04 21:47:10.558159 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-04812f25-a54c-4e35-990e-6a1fb8a29a29 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:10.559402 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-04812f25-a54c-4e35-990e-6a1fb8a29a29 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] [instance: 7512d9d6-ab41-453e-bb9d-8e0861aa37f7] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:10.560105 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 507/1067] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:09 2022] GET /compute/v2.1/servers/4e8281d2-9de4-42eb-94cc-417be864315d => generated 1503 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:10.565211 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-04812f25-a54c-4e35-990e-6a1fb8a29a29 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:10.565828 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-04812f25-a54c-4e35-990e-6a1fb8a29a29 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:10.566271 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-04812f25-a54c-4e35-990e-6a1fb8a29a29 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:10.567137 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-04812f25-a54c-4e35-990e-6a1fb8a29a29 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:10.567637 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-04812f25-a54c-4e35-990e-6a1fb8a29a29 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:10.568280 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-04812f25-a54c-4e35-990e-6a1fb8a29a29 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:10.676200 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-3443020a-bf72-44c5-94cd-7e9125865963 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Calling method '.version_select at 0x7fbb2fb753a0>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:10.723776 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-3443020a-bf72-44c5-94cd-7e9125865963 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] 10.222.0.43 "GET /compute/v2.1/images/ac8e9797-0b3b-4c06-9229-b4ac23c4312c" status: 200 len: 1422 microversion: 2.1 time: 0.051550 Oct 04 21:47:10.724709 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 508/1068] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:47:10 2022] GET /compute/v2.1/images/ac8e9797-0b3b-4c06-9229-b4ac23c4312c => generated 1422 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:47:10.757738 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-04812f25-a54c-4e35-990e-6a1fb8a29a29 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:10.765974 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-04812f25-a54c-4e35-990e-6a1fb8a29a29 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:10.767542 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-04812f25-a54c-4e35-990e-6a1fb8a29a29 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:10.768759 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-04812f25-a54c-4e35-990e-6a1fb8a29a29 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] 10.222.0.43 "GET /compute/v2.1/servers/7512d9d6-ab41-453e-bb9d-8e0861aa37f7" status: 200 len: 1569 microversion: 2.25 time: 0.215065 Oct 04 21:47:10.769336 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 561/1069] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:47:10 2022] GET /compute/v2.1/servers/7512d9d6-ab41-453e-bb9d-8e0861aa37f7 => generated 1569 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:47:10.959149 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-a434c266-cc82-4c91-8594-dbb20d3c9974 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:10.959716 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-a434c266-cc82-4c91-8594-dbb20d3c9974 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] [instance: 663b2cc6-7a55-406a-b56f-86047b0e514d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:10.966811 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a434c266-cc82-4c91-8594-dbb20d3c9974 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:10.967303 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a434c266-cc82-4c91-8594-dbb20d3c9974 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:10.967739 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a434c266-cc82-4c91-8594-dbb20d3c9974 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:10.968436 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a434c266-cc82-4c91-8594-dbb20d3c9974 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:10.968886 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a434c266-cc82-4c91-8594-dbb20d3c9974 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:10.969311 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a434c266-cc82-4c91-8594-dbb20d3c9974 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:10.985187 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-a434c266-cc82-4c91-8594-dbb20d3c9974 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] HTTP exception thrown: Instance 663b2cc6-7a55-406a-b56f-86047b0e514d could not be found. Oct 04 21:47:10.986889 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-a434c266-cc82-4c91-8594-dbb20d3c9974 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Request method failure captured: Oct 04 21:47:10.986889 n-d-860284-1 devstack@n-api.service[134101]: request: GET /compute/v2.1/servers/663b2cc6-7a55-406a-b56f-86047b0e514d HTTP/1.1 Oct 04 21:47:10.986889 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 21:47:10.986889 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 21:47:10.986889 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 21:47:10.986889 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 21:47:10.986889 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 21:47:10.986889 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 21:47:10.986889 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 21:47:10.986889 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 21:47:10.986889 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPKkKKWGhYvwCdv1J2MeGQ-jOAZuoGQ1lwAe198r71Ukwb_5umfLkuxNfZWiQHMUxBfhv-_5em_OANDxdq4CvMn57rB1IdcDSs2VQnXaxFUQOJQx2QIboBa8MD9AFC6JsgH39EDtpQDm0bx49UHlQ1MXYHpusDcMOOxl5o1LHadq_Xtg Oct 04 21:47:10.986889 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 21:47:10.986889 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 21:47:10.986889 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 21:47:10.986889 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 21:47:10.986889 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 21:47:10.986889 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 21:47:10.986889 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: 39edf587afe94b60911198aa0bb61613 Oct 04 21:47:10.986889 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-ServersOnMultiNodesTest-569263937 Oct 04 21:47:10.986889 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 21:47:10.986889 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 21:47:10.988499 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/39edf587afe94b60911198aa0bb61613"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_39edf587afe94b60911198aa0bb61613", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/39edf587afe94b60911198aa0bb61613"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/39edf587afe94b60911198aa0bb61613"}]}] Oct 04 21:47:10.988499 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-ServersOnMultiNodesTest-569263937 Oct 04 21:47:10.988499 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: 39edf587afe94b60911198aa0bb61613 Oct 04 21:47:10.988499 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-569263937 Oct 04 21:47:10.988499 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-ServersOnMultiNodesTest-569263937-project Oct 04 21:47:10.988499 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 21:47:10.988499 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 21:47:10.988499 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 29842a669a20408b881105135f76cb0a Oct 04 21:47:10.988499 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-ServersOnMultiNodesTest-569263937-project Oct 04 21:47:10.988499 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 21:47:10.988499 n-d-860284-1 devstack@n-api.service[134101]: exception: Instance 663b2cc6-7a55-406a-b56f-86047b0e514d could not be found. Oct 04 21:47:10.988499 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': '663b2cc6-7a55-406a-b56f-86047b0e514d'} Oct 04 21:47:10.989393 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:47:10.989393 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:47:10.989393 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:47:10.989393 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:47:10.989393 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:47:10.989393 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:47:10.989393 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:47:10.989393 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:47:10.989393 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:47:10.989393 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:47:10.989393 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 663b2cc6-7a55-406a-b56f-86047b0e514d could not be found. Oct 04 21:47:10.989393 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:47:10.989393 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:47:10.989393 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:47:10.989393 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:47:10.989393 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:47:10.989393 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:47:10.989393 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:47:10.989393 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:47:10.989393 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:47:10.991169 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:47:10.991169 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:47:10.991169 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:47:10.991169 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:47:10.991169 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:47:10.991169 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:47:10.991169 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:47:10.991169 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 663b2cc6-7a55-406a-b56f-86047b0e514d could not be found. Oct 04 21:47:10.991169 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:47:10.991169 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:47:10.991169 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:47:10.991169 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:47:10.991169 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:47:10.991169 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:47:10.991169 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:47:10.991169 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:47:10.991169 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 663b2cc6-7a55-406a-b56f-86047b0e514d could not be found. Oct 04 21:47:10.991169 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:47:10.992266 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-a434c266-cc82-4c91-8594-dbb20d3c9974 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Returning 404 to user: Instance 663b2cc6-7a55-406a-b56f-86047b0e514d could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:47:10.992266 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-a434c266-cc82-4c91-8594-dbb20d3c9974 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] 10.222.0.43 "GET /compute/v2.1/servers/663b2cc6-7a55-406a-b56f-86047b0e514d" status: 404 len: 111 microversion: 2.1 time: 0.033656 Oct 04 21:47:10.992266 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 509/1070] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:10 2022] GET /compute/v2.1/servers/663b2cc6-7a55-406a-b56f-86047b0e514d => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:47:10.994411 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-5b107c09-ee1b-45f7-9eef-654be07ad9dd tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:10.995038 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-5b107c09-ee1b-45f7-9eef-654be07ad9dd tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] [instance: e3380b36-6aba-4736-bcbc-f0058f806d55] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:10.997642 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-9d7effcd-c83a-4d8c-8e41-657ffc21eff1 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:10.998153 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-9d7effcd-c83a-4d8c-8e41-657ffc21eff1 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] [instance: b19ef33c-3012-4eed-abd6-edc1bd9f3e9c] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:11.001142 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5b107c09-ee1b-45f7-9eef-654be07ad9dd tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:11.001651 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5b107c09-ee1b-45f7-9eef-654be07ad9dd tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:11.002094 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5b107c09-ee1b-45f7-9eef-654be07ad9dd tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:11.002821 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5b107c09-ee1b-45f7-9eef-654be07ad9dd tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:11.003277 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5b107c09-ee1b-45f7-9eef-654be07ad9dd tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:11.003699 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5b107c09-ee1b-45f7-9eef-654be07ad9dd tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:11.004294 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9d7effcd-c83a-4d8c-8e41-657ffc21eff1 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:11.004784 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9d7effcd-c83a-4d8c-8e41-657ffc21eff1 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:11.005235 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9d7effcd-c83a-4d8c-8e41-657ffc21eff1 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:11.006583 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9d7effcd-c83a-4d8c-8e41-657ffc21eff1 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:11.007047 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9d7effcd-c83a-4d8c-8e41-657ffc21eff1 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:11.007472 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9d7effcd-c83a-4d8c-8e41-657ffc21eff1 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:11.033646 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-9d7effcd-c83a-4d8c-8e41-657ffc21eff1 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] [instance: b19ef33c-3012-4eed-abd6-edc1bd9f3e9c] Going to try to terminate instance {{(pid=134101) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:47:11.126456 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-9d7effcd-c83a-4d8c-8e41-657ffc21eff1 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] 10.222.0.43 "DELETE /compute/v2.1/servers/b19ef33c-3012-4eed-abd6-edc1bd9f3e9c" status: 204 len: 0 microversion: 2.1 time: 0.131895 Oct 04 21:47:11.127438 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 510/1071] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 21:47:10 2022] DELETE /compute/v2.1/servers/b19ef33c-3012-4eed-abd6-edc1bd9f3e9c => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 21:47:11.141286 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-8246e854-5111-4a98-aa9b-a09649c7b5a3 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:11.142151 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-8246e854-5111-4a98-aa9b-a09649c7b5a3 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] [instance: b19ef33c-3012-4eed-abd6-edc1bd9f3e9c] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:11.149914 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8246e854-5111-4a98-aa9b-a09649c7b5a3 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:11.150420 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8246e854-5111-4a98-aa9b-a09649c7b5a3 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:11.150858 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8246e854-5111-4a98-aa9b-a09649c7b5a3 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:11.151559 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8246e854-5111-4a98-aa9b-a09649c7b5a3 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:11.152030 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8246e854-5111-4a98-aa9b-a09649c7b5a3 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:11.152428 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8246e854-5111-4a98-aa9b-a09649c7b5a3 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:11.174513 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-5b107c09-ee1b-45f7-9eef-654be07ad9dd tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87616cd16995468ab7febf5aa4b284db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e3bf9149434d34b6762aaeef1478ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:11.184010 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-5b107c09-ee1b-45f7-9eef-654be07ad9dd tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] 10.222.0.43 "GET /compute/v2.1/servers/e3380b36-6aba-4736-bcbc-f0058f806d55" status: 200 len: 1477 microversion: 2.1 time: 0.194640 Oct 04 21:47:11.184613 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 562/1072] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:10 2022] GET /compute/v2.1/servers/e3380b36-6aba-4736-bcbc-f0058f806d55 => generated 1477 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:11.289706 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-8246e854-5111-4a98-aa9b-a09649c7b5a3 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29842a669a20408b881105135f76cb0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39edf587afe94b60911198aa0bb61613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:11.297476 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-8246e854-5111-4a98-aa9b-a09649c7b5a3 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] 10.222.0.43 "GET /compute/v2.1/servers/b19ef33c-3012-4eed-abd6-edc1bd9f3e9c" status: 200 len: 1473 microversion: 2.1 time: 0.161224 Oct 04 21:47:11.298054 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 511/1073] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:11 2022] GET /compute/v2.1/servers/b19ef33c-3012-4eed-abd6-edc1bd9f3e9c => generated 1473 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:47:11.541788 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-0a11a791-7632-4cec-8080-777c9ca62c02 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:11.542450 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-0a11a791-7632-4cec-8080-777c9ca62c02 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: 424a22f0-ccc3-4fec-bf38-4aaf924928e3] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:11.548932 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0a11a791-7632-4cec-8080-777c9ca62c02 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:11.549409 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0a11a791-7632-4cec-8080-777c9ca62c02 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:11.549837 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0a11a791-7632-4cec-8080-777c9ca62c02 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:11.550557 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0a11a791-7632-4cec-8080-777c9ca62c02 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:11.551015 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0a11a791-7632-4cec-8080-777c9ca62c02 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:11.551435 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0a11a791-7632-4cec-8080-777c9ca62c02 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:11.574965 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-96fd57c8-aafc-4902-ad17-f958570af1e0 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:11.575726 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-96fd57c8-aafc-4902-ad17-f958570af1e0 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 4e8281d2-9de4-42eb-94cc-417be864315d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:11.581911 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-96fd57c8-aafc-4902-ad17-f958570af1e0 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:11.582436 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-96fd57c8-aafc-4902-ad17-f958570af1e0 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:11.583215 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-96fd57c8-aafc-4902-ad17-f958570af1e0 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:11.583690 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-96fd57c8-aafc-4902-ad17-f958570af1e0 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:11.584150 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-96fd57c8-aafc-4902-ad17-f958570af1e0 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:11.584569 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-96fd57c8-aafc-4902-ad17-f958570af1e0 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:11.820866 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-0a11a791-7632-4cec-8080-777c9ca62c02 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:11.829670 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-0a11a791-7632-4cec-8080-777c9ca62c02 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/424a22f0-ccc3-4fec-bf38-4aaf924928e3" status: 200 len: 1536 microversion: 2.1 time: 0.292794 Oct 04 21:47:11.830336 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 563/1074] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:11 2022] GET /compute/v2.1/servers/424a22f0-ccc3-4fec-bf38-4aaf924928e3 => generated 1536 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:11.835885 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-71d4a208-fc59-4c56-b069-591673f2129a tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Calling method '.version_select at 0x7fbb2f170550>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:11.886616 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-71d4a208-fc59-4c56-b069-591673f2129a tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] 10.222.0.43 "GET /compute/v2.1/images/ac8e9797-0b3b-4c06-9229-b4ac23c4312c" status: 200 len: 1422 microversion: 2.1 time: 0.054925 Oct 04 21:47:11.887700 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-96fd57c8-aafc-4902-ad17-f958570af1e0 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ad048becf474fb972d4291422d810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dcfc7024fc49388c4bd5f25f03e60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:11.888442 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 564/1075] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:47:11 2022] GET /compute/v2.1/images/ac8e9797-0b3b-4c06-9229-b4ac23c4312c => generated 1422 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:11.893410 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-7d928d4d-55c8-4c75-83f1-769cff0cd1ed tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:11.894227 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-7d928d4d-55c8-4c75-83f1-769cff0cd1ed tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] [instance: 7512d9d6-ab41-453e-bb9d-8e0861aa37f7] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:11.901422 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7d928d4d-55c8-4c75-83f1-769cff0cd1ed tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:11.902332 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7d928d4d-55c8-4c75-83f1-769cff0cd1ed tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:11.902820 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7d928d4d-55c8-4c75-83f1-769cff0cd1ed tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:11.903707 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7d928d4d-55c8-4c75-83f1-769cff0cd1ed tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:11.904165 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-96fd57c8-aafc-4902-ad17-f958570af1e0 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/4e8281d2-9de4-42eb-94cc-417be864315d" status: 200 len: 1503 microversion: 2.1 time: 0.334153 Oct 04 21:47:11.904284 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7d928d4d-55c8-4c75-83f1-769cff0cd1ed tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:11.904592 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7d928d4d-55c8-4c75-83f1-769cff0cd1ed tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:11.904786 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 512/1076] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:11 2022] GET /compute/v2.1/servers/4e8281d2-9de4-42eb-94cc-417be864315d => generated 1503 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:12.046554 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-7d928d4d-55c8-4c75-83f1-769cff0cd1ed tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:12.057757 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-7d928d4d-55c8-4c75-83f1-769cff0cd1ed tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:12.059953 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-7d928d4d-55c8-4c75-83f1-769cff0cd1ed tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:12.064808 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-7d928d4d-55c8-4c75-83f1-769cff0cd1ed tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] 10.222.0.43 "GET /compute/v2.1/servers/7512d9d6-ab41-453e-bb9d-8e0861aa37f7" status: 200 len: 1569 microversion: 2.25 time: 0.175291 Oct 04 21:47:12.065640 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 565/1077] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:47:11 2022] GET /compute/v2.1/servers/7512d9d6-ab41-453e-bb9d-8e0861aa37f7 => generated 1569 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:47:12.207619 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-24328724-0419-44fb-adca-39681ae31e4f tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:12.208228 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-24328724-0419-44fb-adca-39681ae31e4f tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] [instance: e3380b36-6aba-4736-bcbc-f0058f806d55] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:12.214609 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-24328724-0419-44fb-adca-39681ae31e4f tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:12.215110 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-24328724-0419-44fb-adca-39681ae31e4f tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:12.215585 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-24328724-0419-44fb-adca-39681ae31e4f tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:12.216317 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-24328724-0419-44fb-adca-39681ae31e4f tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:12.216783 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-24328724-0419-44fb-adca-39681ae31e4f tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:12.217209 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-24328724-0419-44fb-adca-39681ae31e4f tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:12.320666 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-8fcd6157-eaca-4757-b901-59f06834c814 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:12.321281 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-8fcd6157-eaca-4757-b901-59f06834c814 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] [instance: b19ef33c-3012-4eed-abd6-edc1bd9f3e9c] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:12.327966 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8fcd6157-eaca-4757-b901-59f06834c814 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:12.328459 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8fcd6157-eaca-4757-b901-59f06834c814 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:12.328893 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8fcd6157-eaca-4757-b901-59f06834c814 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:12.329652 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8fcd6157-eaca-4757-b901-59f06834c814 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:12.330109 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8fcd6157-eaca-4757-b901-59f06834c814 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:12.330583 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8fcd6157-eaca-4757-b901-59f06834c814 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:12.362661 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-24328724-0419-44fb-adca-39681ae31e4f tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87616cd16995468ab7febf5aa4b284db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e3bf9149434d34b6762aaeef1478ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:12.371812 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-24328724-0419-44fb-adca-39681ae31e4f tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] 10.222.0.43 "GET /compute/v2.1/servers/e3380b36-6aba-4736-bcbc-f0058f806d55" status: 200 len: 1463 microversion: 2.1 time: 0.168304 Oct 04 21:47:12.373189 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 513/1078] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:12 2022] GET /compute/v2.1/servers/e3380b36-6aba-4736-bcbc-f0058f806d55 => generated 1463 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:12.395479 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-bfc9fc77-b0fe-4663-93c7-12ce3fb7fd88 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:12.397382 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-bfc9fc77-b0fe-4663-93c7-12ce3fb7fd88 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] [instance: e3380b36-6aba-4736-bcbc-f0058f806d55] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:12.404177 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bfc9fc77-b0fe-4663-93c7-12ce3fb7fd88 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:12.404930 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bfc9fc77-b0fe-4663-93c7-12ce3fb7fd88 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:12.405515 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bfc9fc77-b0fe-4663-93c7-12ce3fb7fd88 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:12.406439 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bfc9fc77-b0fe-4663-93c7-12ce3fb7fd88 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:12.407551 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bfc9fc77-b0fe-4663-93c7-12ce3fb7fd88 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:12.408161 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bfc9fc77-b0fe-4663-93c7-12ce3fb7fd88 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:12.657538 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-8fcd6157-eaca-4757-b901-59f06834c814 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29842a669a20408b881105135f76cb0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39edf587afe94b60911198aa0bb61613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:12.668348 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-8fcd6157-eaca-4757-b901-59f06834c814 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] 10.222.0.43 "GET /compute/v2.1/servers/b19ef33c-3012-4eed-abd6-edc1bd9f3e9c" status: 200 len: 1473 microversion: 2.1 time: 0.352217 Oct 04 21:47:12.685063 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 566/1079] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:12 2022] GET /compute/v2.1/servers/b19ef33c-3012-4eed-abd6-edc1bd9f3e9c => generated 1473 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:12.698224 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-bfc9fc77-b0fe-4663-93c7-12ce3fb7fd88 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87616cd16995468ab7febf5aa4b284db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e3bf9149434d34b6762aaeef1478ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:12.711568 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-bfc9fc77-b0fe-4663-93c7-12ce3fb7fd88 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] 10.222.0.43 "GET /compute/v2.1/servers/e3380b36-6aba-4736-bcbc-f0058f806d55" status: 200 len: 1463 microversion: 2.1 time: 0.320061 Oct 04 21:47:12.713828 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 514/1080] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:12 2022] GET /compute/v2.1/servers/e3380b36-6aba-4736-bcbc-f0058f806d55 => generated 1463 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:47:12.739260 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-64e976e1-9ded-4678-8243-534636a0afe2 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "58548514-5dac-426c-81f5-19e3fba33e23"}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:47:12.742355 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-64e976e1-9ded-4678-8243-534636a0afe2 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] [instance: e3380b36-6aba-4736-bcbc-f0058f806d55] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:12.755263 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-64e976e1-9ded-4678-8243-534636a0afe2 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:12.756857 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-64e976e1-9ded-4678-8243-534636a0afe2 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:12.757684 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-64e976e1-9ded-4678-8243-534636a0afe2 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:12.758746 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-64e976e1-9ded-4678-8243-534636a0afe2 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:12.759685 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-64e976e1-9ded-4678-8243-534636a0afe2 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:12.760353 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-64e976e1-9ded-4678-8243-534636a0afe2 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:12.855915 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-b8ee6a7b-8d15-47c5-ba7f-20560a2eaa76 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:12.856674 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-b8ee6a7b-8d15-47c5-ba7f-20560a2eaa76 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: 424a22f0-ccc3-4fec-bf38-4aaf924928e3] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:12.861901 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-64e976e1-9ded-4678-8243-534636a0afe2 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Flavor limits 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:47:12.862681 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-64e976e1-9ded-4678-8243-534636a0afe2 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Image limits 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:47:12.863032 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b8ee6a7b-8d15-47c5-ba7f-20560a2eaa76 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:12.863584 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-64e976e1-9ded-4678-8243-534636a0afe2 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Flavor pref 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:47:12.863995 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b8ee6a7b-8d15-47c5-ba7f-20560a2eaa76 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:12.864122 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-64e976e1-9ded-4678-8243-534636a0afe2 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Image pref 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:47:12.864570 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-64e976e1-9ded-4678-8243-534636a0afe2 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:47:12.865051 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b8ee6a7b-8d15-47c5-ba7f-20560a2eaa76 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:12.865986 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b8ee6a7b-8d15-47c5-ba7f-20560a2eaa76 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:12.866752 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b8ee6a7b-8d15-47c5-ba7f-20560a2eaa76 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:12.867392 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b8ee6a7b-8d15-47c5-ba7f-20560a2eaa76 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:12.936485 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-64e976e1-9ded-4678-8243-534636a0afe2 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] [instance: e3380b36-6aba-4736-bcbc-f0058f806d55] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:12.943365 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-64e976e1-9ded-4678-8243-534636a0afe2 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:12.944609 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-64e976e1-9ded-4678-8243-534636a0afe2 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:12.945271 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-64e976e1-9ded-4678-8243-534636a0afe2 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:12.946084 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-64e976e1-9ded-4678-8243-534636a0afe2 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:12.946589 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-64e976e1-9ded-4678-8243-534636a0afe2 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:12.947922 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-64e976e1-9ded-4678-8243-534636a0afe2 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:12.978296 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-64e976e1-9ded-4678-8243-534636a0afe2 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] 10.222.0.43 "POST /compute/v2.1/servers/e3380b36-6aba-4736-bcbc-f0058f806d55/action" status: 202 len: 1067 microversion: 2.1 time: 0.245147 Oct 04 21:47:12.978999 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 567/1081] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 21:47:12 2022] POST /compute/v2.1/servers/e3380b36-6aba-4736-bcbc-f0058f806d55/action => generated 1067 bytes in 247 msecs (HTTP/1.1 202) 10 headers in 452 bytes (3 switches on core 0) Oct 04 21:47:12.984387 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-09df3336-3250-4626-8ef2-5a908c3b3aec tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Calling method '.version_select at 0x7fbb2f1855e0>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:13.072805 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-09df3336-3250-4626-8ef2-5a908c3b3aec tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] 10.222.0.43 "GET /compute/v2.1/images/ac8e9797-0b3b-4c06-9229-b4ac23c4312c" status: 200 len: 1422 microversion: 2.1 time: 0.092617 Oct 04 21:47:13.073433 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 568/1082] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:47:12 2022] GET /compute/v2.1/images/ac8e9797-0b3b-4c06-9229-b4ac23c4312c => generated 1422 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:13.089447 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-f1bc2ee7-b1df-4652-bea9-9f245d809430 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:13.090087 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-f1bc2ee7-b1df-4652-bea9-9f245d809430 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 4e8281d2-9de4-42eb-94cc-417be864315d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:13.104564 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f1bc2ee7-b1df-4652-bea9-9f245d809430 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:13.105071 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f1bc2ee7-b1df-4652-bea9-9f245d809430 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:13.105516 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f1bc2ee7-b1df-4652-bea9-9f245d809430 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:13.106795 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f1bc2ee7-b1df-4652-bea9-9f245d809430 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:13.106795 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f1bc2ee7-b1df-4652-bea9-9f245d809430 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:13.107164 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f1bc2ee7-b1df-4652-bea9-9f245d809430 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:13.142016 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-b8ee6a7b-8d15-47c5-ba7f-20560a2eaa76 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:13.164979 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-b8ee6a7b-8d15-47c5-ba7f-20560a2eaa76 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/424a22f0-ccc3-4fec-bf38-4aaf924928e3" status: 200 len: 1541 microversion: 2.1 time: 0.314174 Oct 04 21:47:13.165598 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 515/1083] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:12 2022] GET /compute/v2.1/servers/424a22f0-ccc3-4fec-bf38-4aaf924928e3 => generated 1541 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:47:13.173534 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-80ca12db-d165-472c-82c5-c9518c0ec754 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:13.176493 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-80ca12db-d165-472c-82c5-c9518c0ec754 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] [instance: e3380b36-6aba-4736-bcbc-f0058f806d55] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:13.186049 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-80ca12db-d165-472c-82c5-c9518c0ec754 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:13.186049 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-80ca12db-d165-472c-82c5-c9518c0ec754 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:13.191801 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-80ca12db-d165-472c-82c5-c9518c0ec754 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:13.192985 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-80ca12db-d165-472c-82c5-c9518c0ec754 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:13.194482 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-80ca12db-d165-472c-82c5-c9518c0ec754 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:13.195239 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-80ca12db-d165-472c-82c5-c9518c0ec754 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:13.644459 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-f1bc2ee7-b1df-4652-bea9-9f245d809430 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ad048becf474fb972d4291422d810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dcfc7024fc49388c4bd5f25f03e60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:13.652943 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-f1bc2ee7-b1df-4652-bea9-9f245d809430 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/4e8281d2-9de4-42eb-94cc-417be864315d" status: 200 len: 1503 microversion: 2.1 time: 0.568325 Oct 04 21:47:13.653873 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 569/1084] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:13 2022] GET /compute/v2.1/servers/4e8281d2-9de4-42eb-94cc-417be864315d => generated 1503 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:13.676409 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-e9522453-e893-4312-aeee-abf0f35f6d17 req-ed4bed7d-18ff-4c54-8aa5-ddc0b72d3608 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e8281d2-9de4-42eb-94cc-417be864315d", "name": "network-vif-unplugged", "status": "completed", "tag": "291eba78-3b41-496a-92b2-60808ec215af"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:47:13.687904 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-80ca12db-d165-472c-82c5-c9518c0ec754 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87616cd16995468ab7febf5aa4b284db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e3bf9149434d34b6762aaeef1478ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:13.688148 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-e9522453-e893-4312-aeee-abf0f35f6d17 req-ed4bed7d-18ff-4c54-8aa5-ddc0b72d3608 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:13.688866 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-e9522453-e893-4312-aeee-abf0f35f6d17 req-ed4bed7d-18ff-4c54-8aa5-ddc0b72d3608 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:13.689513 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-e9522453-e893-4312-aeee-abf0f35f6d17 req-ed4bed7d-18ff-4c54-8aa5-ddc0b72d3608 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:13.701010 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-80ca12db-d165-472c-82c5-c9518c0ec754 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] 10.222.0.43 "GET /compute/v2.1/servers/e3380b36-6aba-4736-bcbc-f0058f806d55" status: 200 len: 1472 microversion: 2.1 time: 0.533727 Oct 04 21:47:13.701809 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 516/1085] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:13 2022] GET /compute/v2.1/servers/e3380b36-6aba-4736-bcbc-f0058f806d55 => generated 1472 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:13.705038 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-e9522453-e893-4312-aeee-abf0f35f6d17 req-ed4bed7d-18ff-4c54-8aa5-ddc0b72d3608 service nova] Creating event network-vif-unplugged:291eba78-3b41-496a-92b2-60808ec215af for instance 4e8281d2-9de4-42eb-94cc-417be864315d on n-h1-860284-1 Oct 04 21:47:13.707231 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-7c0d6965-8a14-41f9-88c0-91143456113c tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:13.707741 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-7c0d6965-8a14-41f9-88c0-91143456113c tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] [instance: 7512d9d6-ab41-453e-bb9d-8e0861aa37f7] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:13.713007 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-e9522453-e893-4312-aeee-abf0f35f6d17 req-ed4bed7d-18ff-4c54-8aa5-ddc0b72d3608 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044868 Oct 04 21:47:13.714251 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 570/1086] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:47:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:47:13.714926 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7c0d6965-8a14-41f9-88c0-91143456113c tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:13.715426 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7c0d6965-8a14-41f9-88c0-91143456113c tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:13.715867 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7c0d6965-8a14-41f9-88c0-91143456113c tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:13.716828 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7c0d6965-8a14-41f9-88c0-91143456113c tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:13.717295 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7c0d6965-8a14-41f9-88c0-91143456113c tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:13.717723 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7c0d6965-8a14-41f9-88c0-91143456113c tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:13.723654 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-e8515fbe-865d-4ab7-ace3-f83280529265 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:13.725557 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-e8515fbe-865d-4ab7-ace3-f83280529265 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] [instance: b19ef33c-3012-4eed-abd6-edc1bd9f3e9c] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:13.734103 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e8515fbe-865d-4ab7-ace3-f83280529265 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:13.734711 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e8515fbe-865d-4ab7-ace3-f83280529265 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:13.735215 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e8515fbe-865d-4ab7-ace3-f83280529265 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:13.735997 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e8515fbe-865d-4ab7-ace3-f83280529265 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:13.736512 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e8515fbe-865d-4ab7-ace3-f83280529265 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:13.737663 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e8515fbe-865d-4ab7-ace3-f83280529265 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:14.003285 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-7c0d6965-8a14-41f9-88c0-91143456113c tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:14.012535 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-7c0d6965-8a14-41f9-88c0-91143456113c tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:14.014009 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-7c0d6965-8a14-41f9-88c0-91143456113c tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:14.015217 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-7c0d6965-8a14-41f9-88c0-91143456113c tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] 10.222.0.43 "GET /compute/v2.1/servers/7512d9d6-ab41-453e-bb9d-8e0861aa37f7" status: 200 len: 1569 microversion: 2.25 time: 0.312554 Oct 04 21:47:14.015786 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 517/1087] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:47:13 2022] GET /compute/v2.1/servers/7512d9d6-ab41-453e-bb9d-8e0861aa37f7 => generated 1569 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:47:14.042760 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-e8515fbe-865d-4ab7-ace3-f83280529265 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29842a669a20408b881105135f76cb0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39edf587afe94b60911198aa0bb61613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:14.051090 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-e8515fbe-865d-4ab7-ace3-f83280529265 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] 10.222.0.43 "GET /compute/v2.1/servers/b19ef33c-3012-4eed-abd6-edc1bd9f3e9c" status: 200 len: 1473 microversion: 2.1 time: 0.335182 Oct 04 21:47:14.052177 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 571/1088] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:13 2022] GET /compute/v2.1/servers/b19ef33c-3012-4eed-abd6-edc1bd9f3e9c => generated 1473 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:14.088754 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-82cc0c62-1762-41bd-a5e8-0b6abcec3d02 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Calling method '.version_select at 0x7fbb2ef468b0>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:14.135101 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-82cc0c62-1762-41bd-a5e8-0b6abcec3d02 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] 10.222.0.43 "GET /compute/v2.1/images/ac8e9797-0b3b-4c06-9229-b4ac23c4312c" status: 200 len: 1422 microversion: 2.1 time: 0.050103 Oct 04 21:47:14.135793 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 518/1089] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:47:14 2022] GET /compute/v2.1/images/ac8e9797-0b3b-4c06-9229-b4ac23c4312c => generated 1422 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:47:14.197496 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-ae157225-28a1-4ca7-ad47-81703a50f215 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:14.198114 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-ae157225-28a1-4ca7-ad47-81703a50f215 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: 424a22f0-ccc3-4fec-bf38-4aaf924928e3] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:14.204552 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ae157225-28a1-4ca7-ad47-81703a50f215 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:14.205090 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ae157225-28a1-4ca7-ad47-81703a50f215 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:14.205472 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ae157225-28a1-4ca7-ad47-81703a50f215 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:14.206295 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ae157225-28a1-4ca7-ad47-81703a50f215 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:14.206809 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ae157225-28a1-4ca7-ad47-81703a50f215 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:14.207232 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ae157225-28a1-4ca7-ad47-81703a50f215 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:14.403495 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-ae157225-28a1-4ca7-ad47-81703a50f215 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:14.412351 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-ae157225-28a1-4ca7-ad47-81703a50f215 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/424a22f0-ccc3-4fec-bf38-4aaf924928e3" status: 200 len: 1541 microversion: 2.1 time: 0.219016 Oct 04 21:47:14.413110 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 572/1090] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:14 2022] GET /compute/v2.1/servers/424a22f0-ccc3-4fec-bf38-4aaf924928e3 => generated 1541 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:14.683523 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-99ec6953-1954-40ec-ba4d-b78a9bf7e256 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:14.684037 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-99ec6953-1954-40ec-ba4d-b78a9bf7e256 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 4e8281d2-9de4-42eb-94cc-417be864315d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:14.690072 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-99ec6953-1954-40ec-ba4d-b78a9bf7e256 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:14.690596 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-99ec6953-1954-40ec-ba4d-b78a9bf7e256 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:14.691046 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-99ec6953-1954-40ec-ba4d-b78a9bf7e256 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:14.691862 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-99ec6953-1954-40ec-ba4d-b78a9bf7e256 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:14.692222 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-99ec6953-1954-40ec-ba4d-b78a9bf7e256 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:14.692654 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-99ec6953-1954-40ec-ba4d-b78a9bf7e256 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:14.725228 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-1979afe5-61a1-456d-b949-5138a3d17397 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:14.725835 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-1979afe5-61a1-456d-b949-5138a3d17397 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] [instance: e3380b36-6aba-4736-bcbc-f0058f806d55] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:14.732724 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1979afe5-61a1-456d-b949-5138a3d17397 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:14.733286 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1979afe5-61a1-456d-b949-5138a3d17397 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:14.733813 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1979afe5-61a1-456d-b949-5138a3d17397 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:14.734629 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1979afe5-61a1-456d-b949-5138a3d17397 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:14.735146 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1979afe5-61a1-456d-b949-5138a3d17397 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:14.735654 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1979afe5-61a1-456d-b949-5138a3d17397 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:14.978607 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-99ec6953-1954-40ec-ba4d-b78a9bf7e256 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ad048becf474fb972d4291422d810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dcfc7024fc49388c4bd5f25f03e60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:14.985499 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:47:14.988139 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-99ec6953-1954-40ec-ba4d-b78a9bf7e256 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/4e8281d2-9de4-42eb-94cc-417be864315d" status: 200 len: 1503 microversion: 2.1 time: 0.308619 Oct 04 21:47:14.989454 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 519/1091] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:14 2022] GET /compute/v2.1/servers/4e8281d2-9de4-42eb-94cc-417be864315d => generated 1503 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:14.995608 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-1979afe5-61a1-456d-b949-5138a3d17397 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87616cd16995468ab7febf5aa4b284db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e3bf9149434d34b6762aaeef1478ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:15.003945 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-1979afe5-61a1-456d-b949-5138a3d17397 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] 10.222.0.43 "GET /compute/v2.1/servers/e3380b36-6aba-4736-bcbc-f0058f806d55" status: 200 len: 1472 microversion: 2.1 time: 0.283245 Oct 04 21:47:15.018791 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 573/1092] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:14 2022] GET /compute/v2.1/servers/e3380b36-6aba-4736-bcbc-f0058f806d55 => generated 1472 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:15.041643 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-a3ce2257-0163-47a4-8c6e-e71a0134685b tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:15.042176 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-a3ce2257-0163-47a4-8c6e-e71a0134685b tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] [instance: 7512d9d6-ab41-453e-bb9d-8e0861aa37f7] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:15.049028 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a3ce2257-0163-47a4-8c6e-e71a0134685b tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:15.049836 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a3ce2257-0163-47a4-8c6e-e71a0134685b tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:15.050279 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a3ce2257-0163-47a4-8c6e-e71a0134685b tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:15.051203 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a3ce2257-0163-47a4-8c6e-e71a0134685b tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:15.051656 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a3ce2257-0163-47a4-8c6e-e71a0134685b tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:15.052587 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a3ce2257-0163-47a4-8c6e-e71a0134685b tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:15.078263 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-b9c36ab7-5d59-4fe2-9177-09ca8ff5558e tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:15.079407 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-b9c36ab7-5d59-4fe2-9177-09ca8ff5558e tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] [instance: b19ef33c-3012-4eed-abd6-edc1bd9f3e9c] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:15.087937 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b9c36ab7-5d59-4fe2-9177-09ca8ff5558e tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:15.088819 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b9c36ab7-5d59-4fe2-9177-09ca8ff5558e tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:15.089483 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b9c36ab7-5d59-4fe2-9177-09ca8ff5558e tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:15.090544 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b9c36ab7-5d59-4fe2-9177-09ca8ff5558e tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:15.091359 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b9c36ab7-5d59-4fe2-9177-09ca8ff5558e tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:15.092015 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b9c36ab7-5d59-4fe2-9177-09ca8ff5558e tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:15.098736 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:47:15.218147 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-b9c36ab7-5d59-4fe2-9177-09ca8ff5558e tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29842a669a20408b881105135f76cb0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39edf587afe94b60911198aa0bb61613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:15.230118 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-b9c36ab7-5d59-4fe2-9177-09ca8ff5558e tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] 10.222.0.43 "GET /compute/v2.1/servers/b19ef33c-3012-4eed-abd6-edc1bd9f3e9c" status: 200 len: 1302 microversion: 2.1 time: 0.157475 Oct 04 21:47:15.230724 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 574/1093] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:15 2022] GET /compute/v2.1/servers/b19ef33c-3012-4eed-abd6-edc1bd9f3e9c => generated 1302 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:47:15.246729 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-c897def1-aa77-4ffb-a3e6-2292d6033f2e tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Calling method '.version_select at 0x7fbb2f185670>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:15.324250 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-c897def1-aa77-4ffb-a3e6-2292d6033f2e tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] 10.222.0.43 "GET /compute/v2.1/images/ac8e9797-0b3b-4c06-9229-b4ac23c4312c" status: 200 len: 1422 microversion: 2.1 time: 0.091140 Oct 04 21:47:15.335587 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 575/1094] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:47:15 2022] GET /compute/v2.1/images/ac8e9797-0b3b-4c06-9229-b4ac23c4312c => generated 1422 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:15.376921 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-a3ce2257-0163-47a4-8c6e-e71a0134685b tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:15.387386 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-a3ce2257-0163-47a4-8c6e-e71a0134685b tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:15.389253 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-a3ce2257-0163-47a4-8c6e-e71a0134685b tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:15.398128 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-a3ce2257-0163-47a4-8c6e-e71a0134685b tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] 10.222.0.43 "GET /compute/v2.1/servers/7512d9d6-ab41-453e-bb9d-8e0861aa37f7" status: 200 len: 1569 microversion: 2.25 time: 0.361375 Oct 04 21:47:15.402445 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 520/1095] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:47:15 2022] GET /compute/v2.1/servers/7512d9d6-ab41-453e-bb9d-8e0861aa37f7 => generated 1569 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:47:15.445398 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-63454985-2676-4de7-afaa-5ceed7063e10 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:15.447938 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-63454985-2676-4de7-afaa-5ceed7063e10 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: 424a22f0-ccc3-4fec-bf38-4aaf924928e3] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:15.461638 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-63454985-2676-4de7-afaa-5ceed7063e10 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:15.463257 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-63454985-2676-4de7-afaa-5ceed7063e10 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:15.465236 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-63454985-2676-4de7-afaa-5ceed7063e10 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:15.467448 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-63454985-2676-4de7-afaa-5ceed7063e10 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:15.469611 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-63454985-2676-4de7-afaa-5ceed7063e10 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:15.470265 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-63454985-2676-4de7-afaa-5ceed7063e10 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:15.734277 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-acec761d-86ef-4006-b5e8-8050107247ac req-c44d7bdb-8418-4eb8-810f-206af4ef9752 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e8281d2-9de4-42eb-94cc-417be864315d", "tag": "291eba78-3b41-496a-92b2-60808ec215af"}, {"server_uuid": "b19ef33c-3012-4eed-abd6-edc1bd9f3e9c", "name": "network-vif-deleted", "tag": "81a6665d-8e6b-4af7-a8e7-6bb2e16217db"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:47:15.746598 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-acec761d-86ef-4006-b5e8-8050107247ac req-c44d7bdb-8418-4eb8-810f-206af4ef9752 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:15.747308 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-acec761d-86ef-4006-b5e8-8050107247ac req-c44d7bdb-8418-4eb8-810f-206af4ef9752 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:15.747965 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-acec761d-86ef-4006-b5e8-8050107247ac req-c44d7bdb-8418-4eb8-810f-206af4ef9752 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:15.764229 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-acec761d-86ef-4006-b5e8-8050107247ac req-c44d7bdb-8418-4eb8-810f-206af4ef9752 service nova] Creating event network-changed:291eba78-3b41-496a-92b2-60808ec215af for instance 4e8281d2-9de4-42eb-94cc-417be864315d on n-h1-860284-1 Oct 04 21:47:15.765324 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-acec761d-86ef-4006-b5e8-8050107247ac req-c44d7bdb-8418-4eb8-810f-206af4ef9752 service nova] Creating event network-vif-deleted:81a6665d-8e6b-4af7-a8e7-6bb2e16217db for instance b19ef33c-3012-4eed-abd6-edc1bd9f3e9c on n-h1-860284-1 Oct 04 21:47:15.775796 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-acec761d-86ef-4006-b5e8-8050107247ac req-c44d7bdb-8418-4eb8-810f-206af4ef9752 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.045749 Oct 04 21:47:15.779350 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 521/1096] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:47:15 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:47:15.789813 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-63454985-2676-4de7-afaa-5ceed7063e10 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:15.800421 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-63454985-2676-4de7-afaa-5ceed7063e10 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/424a22f0-ccc3-4fec-bf38-4aaf924928e3" status: 200 len: 1541 microversion: 2.1 time: 0.367047 Oct 04 21:47:15.804581 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 576/1097] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:15 2022] GET /compute/v2.1/servers/424a22f0-ccc3-4fec-bf38-4aaf924928e3 => generated 1541 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:16.015699 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-8bb11653-8849-4cd1-a0ef-708ea658b578 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:16.016519 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-8bb11653-8849-4cd1-a0ef-708ea658b578 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 4e8281d2-9de4-42eb-94cc-417be864315d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:16.023613 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8bb11653-8849-4cd1-a0ef-708ea658b578 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:16.024197 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8bb11653-8849-4cd1-a0ef-708ea658b578 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:16.024717 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8bb11653-8849-4cd1-a0ef-708ea658b578 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:16.025565 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8bb11653-8849-4cd1-a0ef-708ea658b578 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:16.026047 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8bb11653-8849-4cd1-a0ef-708ea658b578 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:16.026588 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8bb11653-8849-4cd1-a0ef-708ea658b578 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:16.028481 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-de09d104-1040-4aad-ac60-fb289e59a2b7 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:16.029336 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-de09d104-1040-4aad-ac60-fb289e59a2b7 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] [instance: e3380b36-6aba-4736-bcbc-f0058f806d55] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:16.035273 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-de09d104-1040-4aad-ac60-fb289e59a2b7 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:16.035764 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-de09d104-1040-4aad-ac60-fb289e59a2b7 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:16.036226 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-de09d104-1040-4aad-ac60-fb289e59a2b7 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:16.037032 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-de09d104-1040-4aad-ac60-fb289e59a2b7 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:16.037486 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-de09d104-1040-4aad-ac60-fb289e59a2b7 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:16.038246 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-de09d104-1040-4aad-ac60-fb289e59a2b7 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:16.295861 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-8bb11653-8849-4cd1-a0ef-708ea658b578 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ad048becf474fb972d4291422d810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dcfc7024fc49388c4bd5f25f03e60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:16.301343 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-de09d104-1040-4aad-ac60-fb289e59a2b7 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87616cd16995468ab7febf5aa4b284db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e3bf9149434d34b6762aaeef1478ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:16.308285 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-8bb11653-8849-4cd1-a0ef-708ea658b578 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/4e8281d2-9de4-42eb-94cc-417be864315d" status: 200 len: 1503 microversion: 2.1 time: 0.295434 Oct 04 21:47:16.309562 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 522/1098] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:16 2022] GET /compute/v2.1/servers/4e8281d2-9de4-42eb-94cc-417be864315d => generated 1503 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:16.313364 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-de09d104-1040-4aad-ac60-fb289e59a2b7 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] 10.222.0.43 "GET /compute/v2.1/servers/e3380b36-6aba-4736-bcbc-f0058f806d55" status: 200 len: 1472 microversion: 2.1 time: 0.288649 Oct 04 21:47:16.314462 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 577/1099] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:16 2022] GET /compute/v2.1/servers/e3380b36-6aba-4736-bcbc-f0058f806d55 => generated 1472 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:47:16.326056 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e5bb1887-9aa2-4634-b976-a3886b9d9db6 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:16.326921 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-e5bb1887-9aa2-4634-b976-a3886b9d9db6 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] [instance: b19ef33c-3012-4eed-abd6-edc1bd9f3e9c] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:16.333489 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e5bb1887-9aa2-4634-b976-a3886b9d9db6 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:16.334112 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e5bb1887-9aa2-4634-b976-a3886b9d9db6 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:16.334765 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e5bb1887-9aa2-4634-b976-a3886b9d9db6 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:16.335623 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e5bb1887-9aa2-4634-b976-a3886b9d9db6 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:16.336225 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e5bb1887-9aa2-4634-b976-a3886b9d9db6 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:16.336922 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e5bb1887-9aa2-4634-b976-a3886b9d9db6 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:16.342586 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-50b11fa2-b464-4202-8ff4-6d3fb45756e8 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Calling method '.version_select at 0x7fbb2fce4a60>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:16.370329 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e5bb1887-9aa2-4634-b976-a3886b9d9db6 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:16.374721 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e5bb1887-9aa2-4634-b976-a3886b9d9db6 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:16.375173 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e5bb1887-9aa2-4634-b976-a3886b9d9db6 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:16.376019 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.objects.instance [None req-e5bb1887-9aa2-4634-b976-a3886b9d9db6 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lazy-loading 'fault' on Instance uuid b19ef33c-3012-4eed-abd6-edc1bd9f3e9c {{(pid=134101) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:47:16.390104 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-50b11fa2-b464-4202-8ff4-6d3fb45756e8 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] 10.222.0.43 "GET /compute/v2.1/images/ac8e9797-0b3b-4c06-9229-b4ac23c4312c" status: 200 len: 1422 microversion: 2.1 time: 0.053376 Oct 04 21:47:16.390911 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 578/1100] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:47:16 2022] GET /compute/v2.1/images/ac8e9797-0b3b-4c06-9229-b4ac23c4312c => generated 1422 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:47:16.421525 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-e5bb1887-9aa2-4634-b976-a3886b9d9db6 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29842a669a20408b881105135f76cb0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39edf587afe94b60911198aa0bb61613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:16.425969 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-9f99a746-5af0-41f6-b2ed-eb5d92bf3007 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:16.426468 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-9f99a746-5af0-41f6-b2ed-eb5d92bf3007 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] [instance: 7512d9d6-ab41-453e-bb9d-8e0861aa37f7] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:16.433796 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-e5bb1887-9aa2-4634-b976-a3886b9d9db6 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] 10.222.0.43 "GET /compute/v2.1/servers/b19ef33c-3012-4eed-abd6-edc1bd9f3e9c" status: 200 len: 1307 microversion: 2.1 time: 0.122576 Oct 04 21:47:16.434657 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 523/1101] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:16 2022] GET /compute/v2.1/servers/b19ef33c-3012-4eed-abd6-edc1bd9f3e9c => generated 1307 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:16.434796 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9f99a746-5af0-41f6-b2ed-eb5d92bf3007 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:16.447025 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9f99a746-5af0-41f6-b2ed-eb5d92bf3007 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:16.450457 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9f99a746-5af0-41f6-b2ed-eb5d92bf3007 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:16.455025 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9f99a746-5af0-41f6-b2ed-eb5d92bf3007 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:16.455520 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9f99a746-5af0-41f6-b2ed-eb5d92bf3007 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:16.455962 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9f99a746-5af0-41f6-b2ed-eb5d92bf3007 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:16.738838 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-9f99a746-5af0-41f6-b2ed-eb5d92bf3007 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:16.750707 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-9f99a746-5af0-41f6-b2ed-eb5d92bf3007 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:16.752863 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-9f99a746-5af0-41f6-b2ed-eb5d92bf3007 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:16.754478 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-9f99a746-5af0-41f6-b2ed-eb5d92bf3007 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] 10.222.0.43 "GET /compute/v2.1/servers/7512d9d6-ab41-453e-bb9d-8e0861aa37f7" status: 200 len: 1569 microversion: 2.25 time: 0.333445 Oct 04 21:47:16.755371 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 579/1102] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:47:16 2022] GET /compute/v2.1/servers/7512d9d6-ab41-453e-bb9d-8e0861aa37f7 => generated 1569 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:47:16.834755 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-3708789f-1771-448f-a38e-8785ab2b4f69 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:16.836915 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-3708789f-1771-448f-a38e-8785ab2b4f69 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: 424a22f0-ccc3-4fec-bf38-4aaf924928e3] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:16.847177 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3708789f-1771-448f-a38e-8785ab2b4f69 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:16.847766 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3708789f-1771-448f-a38e-8785ab2b4f69 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:16.848197 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3708789f-1771-448f-a38e-8785ab2b4f69 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:16.849086 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3708789f-1771-448f-a38e-8785ab2b4f69 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:16.850417 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3708789f-1771-448f-a38e-8785ab2b4f69 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:16.850999 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3708789f-1771-448f-a38e-8785ab2b4f69 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:17.108108 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-3708789f-1771-448f-a38e-8785ab2b4f69 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:17.150907 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-3708789f-1771-448f-a38e-8785ab2b4f69 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/424a22f0-ccc3-4fec-bf38-4aaf924928e3" status: 200 len: 1541 microversion: 2.1 time: 0.324648 Oct 04 21:47:17.160540 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 524/1103] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:16 2022] GET /compute/v2.1/servers/424a22f0-ccc3-4fec-bf38-4aaf924928e3 => generated 1541 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:17.337048 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-85db0ea4-af14-4bea-a75c-3ec1b866f8b3 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:17.338542 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-6b092258-383e-441b-b436-a6885c6299c8 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:17.339055 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-6b092258-383e-441b-b436-a6885c6299c8 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 4e8281d2-9de4-42eb-94cc-417be864315d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:17.341110 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-85db0ea4-af14-4bea-a75c-3ec1b866f8b3 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] [instance: e3380b36-6aba-4736-bcbc-f0058f806d55] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:17.351759 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-85db0ea4-af14-4bea-a75c-3ec1b866f8b3 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:17.352142 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-85db0ea4-af14-4bea-a75c-3ec1b866f8b3 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:17.353893 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6b092258-383e-441b-b436-a6885c6299c8 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:17.354581 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-85db0ea4-af14-4bea-a75c-3ec1b866f8b3 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:17.356305 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6b092258-383e-441b-b436-a6885c6299c8 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:17.356918 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6b092258-383e-441b-b436-a6885c6299c8 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:17.357390 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-85db0ea4-af14-4bea-a75c-3ec1b866f8b3 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:17.357905 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-85db0ea4-af14-4bea-a75c-3ec1b866f8b3 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:17.358861 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6b092258-383e-441b-b436-a6885c6299c8 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:17.359582 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-85db0ea4-af14-4bea-a75c-3ec1b866f8b3 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:17.362985 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6b092258-383e-441b-b436-a6885c6299c8 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:17.363492 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6b092258-383e-441b-b436-a6885c6299c8 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:17.579337 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-85db0ea4-af14-4bea-a75c-3ec1b866f8b3 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87616cd16995468ab7febf5aa4b284db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e3bf9149434d34b6762aaeef1478ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:17.591431 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-85db0ea4-af14-4bea-a75c-3ec1b866f8b3 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] 10.222.0.43 "GET /compute/v2.1/servers/e3380b36-6aba-4736-bcbc-f0058f806d55" status: 200 len: 1472 microversion: 2.1 time: 0.257288 Oct 04 21:47:17.593168 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 525/1104] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:17 2022] GET /compute/v2.1/servers/e3380b36-6aba-4736-bcbc-f0058f806d55 => generated 1472 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:17.603185 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-f3efb498-7c93-4975-8b22-b64ea3986629 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Calling method '.version_select at 0x7fbb2f1a4700>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:17.625731 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-6b092258-383e-441b-b436-a6885c6299c8 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ad048becf474fb972d4291422d810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dcfc7024fc49388c4bd5f25f03e60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:17.636335 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-6b092258-383e-441b-b436-a6885c6299c8 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/4e8281d2-9de4-42eb-94cc-417be864315d" status: 200 len: 1503 microversion: 2.1 time: 0.307774 Oct 04 21:47:17.636972 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 580/1105] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:17 2022] GET /compute/v2.1/servers/4e8281d2-9de4-42eb-94cc-417be864315d => generated 1503 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:17.648199 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-d8fb4dbc-a844-446e-ac39-37d3c6c81dc4 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:17.648851 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-d8fb4dbc-a844-446e-ac39-37d3c6c81dc4 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] [instance: b19ef33c-3012-4eed-abd6-edc1bd9f3e9c] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:17.655257 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d8fb4dbc-a844-446e-ac39-37d3c6c81dc4 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:17.656020 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d8fb4dbc-a844-446e-ac39-37d3c6c81dc4 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:17.656605 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d8fb4dbc-a844-446e-ac39-37d3c6c81dc4 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:17.657503 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d8fb4dbc-a844-446e-ac39-37d3c6c81dc4 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:17.658112 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d8fb4dbc-a844-446e-ac39-37d3c6c81dc4 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:17.658779 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d8fb4dbc-a844-446e-ac39-37d3c6c81dc4 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:17.673650 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-f3efb498-7c93-4975-8b22-b64ea3986629 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] 10.222.0.43 "GET /compute/v2.1/images/ac8e9797-0b3b-4c06-9229-b4ac23c4312c" status: 200 len: 1422 microversion: 2.1 time: 0.075433 Oct 04 21:47:17.678652 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 526/1106] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:47:17 2022] GET /compute/v2.1/images/ac8e9797-0b3b-4c06-9229-b4ac23c4312c => generated 1422 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:17.683777 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-d8fb4dbc-a844-446e-ac39-37d3c6c81dc4 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] HTTP exception thrown: Instance b19ef33c-3012-4eed-abd6-edc1bd9f3e9c could not be found. Oct 04 21:47:17.685838 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-d8fb4dbc-a844-446e-ac39-37d3c6c81dc4 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Request method failure captured: Oct 04 21:47:17.685838 n-d-860284-1 devstack@n-api.service[134102]: request: GET /compute/v2.1/servers/b19ef33c-3012-4eed-abd6-edc1bd9f3e9c HTTP/1.1 Oct 04 21:47:17.685838 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 21:47:17.685838 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 21:47:17.685838 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 21:47:17.685838 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 21:47:17.685838 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 21:47:17.685838 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 21:47:17.685838 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 21:47:17.685838 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 21:47:17.685838 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPKkKKWGhYvwCdv1J2MeGQ-jOAZuoGQ1lwAe198r71Ukwb_5umfLkuxNfZWiQHMUxBfhv-_5em_OANDxdq4CvMn57rB1IdcDSs2VQnXaxFUQOJQx2QIboBa8MD9AFC6JsgH39EDtpQDm0bx49UHlQ1MXYHpusDcMOOxl5o1LHadq_Xtg Oct 04 21:47:17.685838 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 21:47:17.685838 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 21:47:17.685838 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 21:47:17.685838 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 21:47:17.685838 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 21:47:17.685838 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 21:47:17.685838 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: 39edf587afe94b60911198aa0bb61613 Oct 04 21:47:17.685838 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-ServersOnMultiNodesTest-569263937 Oct 04 21:47:17.685838 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 21:47:17.685838 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 21:47:17.687478 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/39edf587afe94b60911198aa0bb61613"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_39edf587afe94b60911198aa0bb61613", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/39edf587afe94b60911198aa0bb61613"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/39edf587afe94b60911198aa0bb61613"}]}] Oct 04 21:47:17.687478 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-ServersOnMultiNodesTest-569263937 Oct 04 21:47:17.687478 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: 39edf587afe94b60911198aa0bb61613 Oct 04 21:47:17.687478 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-569263937 Oct 04 21:47:17.687478 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-ServersOnMultiNodesTest-569263937-project Oct 04 21:47:17.687478 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 21:47:17.687478 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 21:47:17.687478 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: 29842a669a20408b881105135f76cb0a Oct 04 21:47:17.687478 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-ServersOnMultiNodesTest-569263937-project Oct 04 21:47:17.687478 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 21:47:17.687478 n-d-860284-1 devstack@n-api.service[134102]: exception: Instance b19ef33c-3012-4eed-abd6-edc1bd9f3e9c could not be found. Oct 04 21:47:17.687478 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': 'b19ef33c-3012-4eed-abd6-edc1bd9f3e9c'} Oct 04 21:47:17.688301 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:47:17.688301 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:47:17.688301 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:47:17.688301 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:47:17.688301 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:47:17.688301 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:47:17.688301 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:47:17.688301 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:47:17.688301 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:47:17.688301 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:47:17.688301 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b19ef33c-3012-4eed-abd6-edc1bd9f3e9c could not be found. Oct 04 21:47:17.688301 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:47:17.688301 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:47:17.688301 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:47:17.688301 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:47:17.688301 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:47:17.688301 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:47:17.688301 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:47:17.688301 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:47:17.688301 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:47:17.689567 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:47:17.689567 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:47:17.689567 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:47:17.689567 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:47:17.689567 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:47:17.689567 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:47:17.689567 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:47:17.689567 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b19ef33c-3012-4eed-abd6-edc1bd9f3e9c could not be found. Oct 04 21:47:17.689567 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:47:17.689567 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:47:17.689567 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:47:17.689567 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:47:17.689567 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:47:17.689567 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:47:17.689567 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:47:17.689567 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:47:17.689567 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b19ef33c-3012-4eed-abd6-edc1bd9f3e9c could not be found. Oct 04 21:47:17.689567 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:47:17.691490 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-d8fb4dbc-a844-446e-ac39-37d3c6c81dc4 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Returning 404 to user: Instance b19ef33c-3012-4eed-abd6-edc1bd9f3e9c could not be found. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:47:17.692574 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-d8fb4dbc-a844-446e-ac39-37d3c6c81dc4 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] 10.222.0.43 "GET /compute/v2.1/servers/b19ef33c-3012-4eed-abd6-edc1bd9f3e9c" status: 404 len: 111 microversion: 2.1 time: 0.054678 Oct 04 21:47:17.693963 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 581/1107] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:17 2022] GET /compute/v2.1/servers/b19ef33c-3012-4eed-abd6-edc1bd9f3e9c => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:47:17.706795 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-af20a405-eb19-43da-9916-9bd78eecff76 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:17.707575 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-af20a405-eb19-43da-9916-9bd78eecff76 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] [instance: f3a0dc37-502e-48d3-9537-10dd7fb15e94] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:17.717249 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-af20a405-eb19-43da-9916-9bd78eecff76 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:17.717990 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-af20a405-eb19-43da-9916-9bd78eecff76 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:17.718605 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-af20a405-eb19-43da-9916-9bd78eecff76 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:17.719555 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-af20a405-eb19-43da-9916-9bd78eecff76 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:17.720159 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-af20a405-eb19-43da-9916-9bd78eecff76 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:17.720749 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-af20a405-eb19-43da-9916-9bd78eecff76 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:17.752235 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-af20a405-eb19-43da-9916-9bd78eecff76 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] [instance: f3a0dc37-502e-48d3-9537-10dd7fb15e94] Going to try to terminate instance {{(pid=134101) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:47:17.783421 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-28114799-1b23-46c8-a1ce-49f7bd8bc527 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:17.784014 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-28114799-1b23-46c8-a1ce-49f7bd8bc527 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] [instance: 7512d9d6-ab41-453e-bb9d-8e0861aa37f7] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:17.795902 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=3 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:47:17.798170 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-28114799-1b23-46c8-a1ce-49f7bd8bc527 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:17.800194 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-28114799-1b23-46c8-a1ce-49f7bd8bc527 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:17.800998 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-28114799-1b23-46c8-a1ce-49f7bd8bc527 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:17.803679 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-28114799-1b23-46c8-a1ce-49f7bd8bc527 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:17.804380 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-28114799-1b23-46c8-a1ce-49f7bd8bc527 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:17.807557 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-28114799-1b23-46c8-a1ce-49f7bd8bc527 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:17.925806 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-af20a405-eb19-43da-9916-9bd78eecff76 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] 10.222.0.43 "DELETE /compute/v2.1/servers/f3a0dc37-502e-48d3-9537-10dd7fb15e94" status: 204 len: 0 microversion: 2.1 time: 0.225828 Oct 04 21:47:17.926345 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 527/1108] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 21:47:17 2022] DELETE /compute/v2.1/servers/f3a0dc37-502e-48d3-9537-10dd7fb15e94 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:47:17.942061 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-bf12b87f-cf63-455e-99f5-60616ed98568 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:17.942820 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-bf12b87f-cf63-455e-99f5-60616ed98568 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] [instance: f3a0dc37-502e-48d3-9537-10dd7fb15e94] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:17.961861 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bf12b87f-cf63-455e-99f5-60616ed98568 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:17.962397 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bf12b87f-cf63-455e-99f5-60616ed98568 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:17.962888 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bf12b87f-cf63-455e-99f5-60616ed98568 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:17.963597 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bf12b87f-cf63-455e-99f5-60616ed98568 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:17.964061 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bf12b87f-cf63-455e-99f5-60616ed98568 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:17.964494 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bf12b87f-cf63-455e-99f5-60616ed98568 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:17.999133 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-28114799-1b23-46c8-a1ce-49f7bd8bc527 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:18.009488 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-28114799-1b23-46c8-a1ce-49f7bd8bc527 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:18.011089 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-28114799-1b23-46c8-a1ce-49f7bd8bc527 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:18.012350 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-28114799-1b23-46c8-a1ce-49f7bd8bc527 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] 10.222.0.43 "GET /compute/v2.1/servers/7512d9d6-ab41-453e-bb9d-8e0861aa37f7" status: 200 len: 1544 microversion: 2.25 time: 0.232941 Oct 04 21:47:18.012992 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 582/1109] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:47:17 2022] GET /compute/v2.1/servers/7512d9d6-ab41-453e-bb9d-8e0861aa37f7 => generated 1544 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:47:18.040284 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-12741481-69ee-497f-b4ef-4238696939d0 tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Calling method '.version_select at 0x7fbb2f093940>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:18.043957 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-12741481-69ee-497f-b4ef-4238696939d0 tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:18.044530 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-12741481-69ee-497f-b4ef-4238696939d0 tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:18.045028 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-12741481-69ee-497f-b4ef-4238696939d0 tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:18.060718 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-12741481-69ee-497f-b4ef-4238696939d0 tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] 10.222.0.43 "GET /compute/v2.1/os-migrations" status: 200 len: 3450 microversion: 2.25 time: 0.024993 Oct 04 21:47:18.062672 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 583/1110] 10.222.0.43 () {60 vars in 1184 bytes} [Tue Oct 4 21:47:18 2022] GET /compute/v2.1/os-migrations => generated 3450 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:47:18.086810 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-c1e7a363-29f7-4745-87ef-640a4e205283 tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:18.087996 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-c1e7a363-29f7-4745-87ef-640a4e205283 tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] [instance: 7512d9d6-ab41-453e-bb9d-8e0861aa37f7] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:18.095001 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c1e7a363-29f7-4745-87ef-640a4e205283 tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:18.095703 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c1e7a363-29f7-4745-87ef-640a4e205283 tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:18.096396 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c1e7a363-29f7-4745-87ef-640a4e205283 tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:18.097273 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c1e7a363-29f7-4745-87ef-640a4e205283 tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:18.098082 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c1e7a363-29f7-4745-87ef-640a4e205283 tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:18.098855 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c1e7a363-29f7-4745-87ef-640a4e205283 tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:18.132754 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-bf12b87f-cf63-455e-99f5-60616ed98568 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29842a669a20408b881105135f76cb0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39edf587afe94b60911198aa0bb61613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:18.142941 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-bf12b87f-cf63-455e-99f5-60616ed98568 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] 10.222.0.43 "GET /compute/v2.1/servers/f3a0dc37-502e-48d3-9537-10dd7fb15e94" status: 200 len: 1472 microversion: 2.1 time: 0.209450 Oct 04 21:47:18.143534 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 528/1111] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:17 2022] GET /compute/v2.1/servers/f3a0dc37-502e-48d3-9537-10dd7fb15e94 => generated 1472 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:18.181948 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-8a316187-429d-4d66-8c69-f02da35ffa06 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:18.182769 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-8a316187-429d-4d66-8c69-f02da35ffa06 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: 424a22f0-ccc3-4fec-bf38-4aaf924928e3] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:18.195220 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8a316187-429d-4d66-8c69-f02da35ffa06 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:18.196526 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8a316187-429d-4d66-8c69-f02da35ffa06 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:18.197160 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8a316187-429d-4d66-8c69-f02da35ffa06 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:18.198053 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8a316187-429d-4d66-8c69-f02da35ffa06 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:18.198698 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8a316187-429d-4d66-8c69-f02da35ffa06 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:18.199612 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8a316187-429d-4d66-8c69-f02da35ffa06 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:18.356389 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.objects.instance [None req-c1e7a363-29f7-4745-87ef-640a4e205283 tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Lazy-loading 'services' on Instance uuid 7512d9d6-ab41-453e-bb9d-8e0861aa37f7 {{(pid=134102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:47:18.383024 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-c1e7a363-29f7-4745-87ef-640a4e205283 tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/7512d9d6-ab41-453e-bb9d-8e0861aa37f7" status: 200 len: 2037 microversion: 2.25 time: 0.300654 Oct 04 21:47:18.384218 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 584/1112] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:47:18 2022] GET /compute/v2.1/servers/7512d9d6-ab41-453e-bb9d-8e0861aa37f7 => generated 2037 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:47:18.422452 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-07ee4d70-b037-48f0-bedb-646041b66765 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Action: 'create', calling method: .version_select at 0x7fbb2f0a98b0>, body: {"keypair": {"name": "tempest-keypair-821678649", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDurm7o9qhFrnAytbszS5ykx5W0TFCcfAxFV9d3lQiRDIKG0/z+NyWa36ib9QJmEsmXHppujAuI7ZJ9gfcxZv6+6EjVYYfY4ByHvOUg//WlV4lUHTHmh2O7LZoNlshyBVg=="}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:47:18.444875 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-07ee4d70-b037-48f0-bedb-646041b66765 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Getting quotas for project f17fee483fd14b07977669df199f3018. Resources: {'key_pairs'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:47:18.452667 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-07ee4d70-b037-48f0-bedb-646041b66765 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Getting quotas for user f529f881a037459d9405bd14afd7a639 and project f17fee483fd14b07977669df199f3018. Resources: {'key_pairs'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:47:18.485046 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-07ee4d70-b037-48f0-bedb-646041b66765 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.25 time: 0.067351 Oct 04 21:47:18.486965 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 585/1113] 10.222.0.43 () {62 vars in 1200 bytes} [Tue Oct 4 21:47:18 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 70 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Oct 04 21:47:18.492701 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-40362e44-3d4b-44de-a1d5-02135e6d77e1 req-21333398-1e46-4147-8607-92b52b3ccf75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59a1880f-2802-4e72-9a17-b966cfec8fe9", "name": "network-vif-plugged", "status": "completed", "tag": "893f32f5-2183-4d13-8c2e-2095ab07e2af"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:47:18.520957 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-8a316187-429d-4d66-8c69-f02da35ffa06 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:18.528748 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-40362e44-3d4b-44de-a1d5-02135e6d77e1 req-21333398-1e46-4147-8607-92b52b3ccf75 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:18.538130 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-40362e44-3d4b-44de-a1d5-02135e6d77e1 req-21333398-1e46-4147-8607-92b52b3ccf75 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:18.538286 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-8a316187-429d-4d66-8c69-f02da35ffa06 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/424a22f0-ccc3-4fec-bf38-4aaf924928e3" status: 200 len: 1541 microversion: 2.1 time: 0.359833 Oct 04 21:47:18.539299 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 529/1114] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:18 2022] GET /compute/v2.1/servers/424a22f0-ccc3-4fec-bf38-4aaf924928e3 => generated 1541 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:18.542141 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-40362e44-3d4b-44de-a1d5-02135e6d77e1 req-21333398-1e46-4147-8607-92b52b3ccf75 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:18.578191 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-40362e44-3d4b-44de-a1d5-02135e6d77e1 req-21333398-1e46-4147-8607-92b52b3ccf75 service nova] Creating event network-vif-plugged:893f32f5-2183-4d13-8c2e-2095ab07e2af for instance 59a1880f-2802-4e72-9a17-b966cfec8fe9 on n-h1-860284-1 Oct 04 21:47:18.589718 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-40362e44-3d4b-44de-a1d5-02135e6d77e1 req-21333398-1e46-4147-8607-92b52b3ccf75 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098721 Oct 04 21:47:18.592501 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 586/1115] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:47:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:47:18.632297 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-dfd1cff0-c6d1-4a42-b494-e3b9efc94181 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:18.633190 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-dfd1cff0-c6d1-4a42-b494-e3b9efc94181 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] [instance: e3380b36-6aba-4736-bcbc-f0058f806d55] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:18.639736 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dfd1cff0-c6d1-4a42-b494-e3b9efc94181 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:18.640339 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dfd1cff0-c6d1-4a42-b494-e3b9efc94181 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:18.641031 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dfd1cff0-c6d1-4a42-b494-e3b9efc94181 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:18.642149 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dfd1cff0-c6d1-4a42-b494-e3b9efc94181 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:18.643908 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dfd1cff0-c6d1-4a42-b494-e3b9efc94181 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:18.645037 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dfd1cff0-c6d1-4a42-b494-e3b9efc94181 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:18.663896 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-6e37ef66-e641-4aa8-b643-8d852daaf32e tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:18.665069 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-6e37ef66-e641-4aa8-b643-8d852daaf32e tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 4e8281d2-9de4-42eb-94cc-417be864315d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:18.681257 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6e37ef66-e641-4aa8-b643-8d852daaf32e tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:18.682318 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6e37ef66-e641-4aa8-b643-8d852daaf32e tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:18.684175 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6e37ef66-e641-4aa8-b643-8d852daaf32e tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:18.686112 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6e37ef66-e641-4aa8-b643-8d852daaf32e tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:18.687547 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6e37ef66-e641-4aa8-b643-8d852daaf32e tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:18.689056 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6e37ef66-e641-4aa8-b643-8d852daaf32e tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:18.992933 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-6e37ef66-e641-4aa8-b643-8d852daaf32e tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ad048becf474fb972d4291422d810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dcfc7024fc49388c4bd5f25f03e60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:18.993225 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-dfd1cff0-c6d1-4a42-b494-e3b9efc94181 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87616cd16995468ab7febf5aa4b284db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e3bf9149434d34b6762aaeef1478ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:19.003175 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-6e37ef66-e641-4aa8-b643-8d852daaf32e tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/4e8281d2-9de4-42eb-94cc-417be864315d" status: 200 len: 1503 microversion: 2.1 time: 0.345023 Oct 04 21:47:19.004092 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 587/1116] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:18 2022] GET /compute/v2.1/servers/4e8281d2-9de4-42eb-94cc-417be864315d => generated 1503 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:19.009511 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-474a01f7-fb78-49a1-b91d-99c4c2d5a4ef tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Calling method '.version_select at 0x7fbb2f185670>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:19.015276 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-dfd1cff0-c6d1-4a42-b494-e3b9efc94181 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] 10.222.0.43 "GET /compute/v2.1/servers/e3380b36-6aba-4736-bcbc-f0058f806d55" status: 200 len: 1472 microversion: 2.1 time: 0.388856 Oct 04 21:47:19.019208 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 530/1117] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:18 2022] GET /compute/v2.1/servers/e3380b36-6aba-4736-bcbc-f0058f806d55 => generated 1472 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:19.092755 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-474a01f7-fb78-49a1-b91d-99c4c2d5a4ef tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] 10.222.0.43 "GET /compute/v2.1/images/ac8e9797-0b3b-4c06-9229-b4ac23c4312c" status: 200 len: 1422 microversion: 2.1 time: 0.087279 Oct 04 21:47:19.093542 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 588/1118] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:47:19 2022] GET /compute/v2.1/images/ac8e9797-0b3b-4c06-9229-b4ac23c4312c => generated 1422 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:19.171859 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-8832f26b-0ba7-4c5f-8d21-3ae9c9e1f3da tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:19.172865 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-8832f26b-0ba7-4c5f-8d21-3ae9c9e1f3da tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] [instance: f3a0dc37-502e-48d3-9537-10dd7fb15e94] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:19.184115 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8832f26b-0ba7-4c5f-8d21-3ae9c9e1f3da tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:19.184887 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8832f26b-0ba7-4c5f-8d21-3ae9c9e1f3da tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:19.185601 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8832f26b-0ba7-4c5f-8d21-3ae9c9e1f3da tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:19.186805 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8832f26b-0ba7-4c5f-8d21-3ae9c9e1f3da tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:19.187527 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8832f26b-0ba7-4c5f-8d21-3ae9c9e1f3da tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:19.188045 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8832f26b-0ba7-4c5f-8d21-3ae9c9e1f3da tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:19.509957 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-8832f26b-0ba7-4c5f-8d21-3ae9c9e1f3da tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29842a669a20408b881105135f76cb0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39edf587afe94b60911198aa0bb61613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:19.523157 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-8832f26b-0ba7-4c5f-8d21-3ae9c9e1f3da tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] 10.222.0.43 "GET /compute/v2.1/servers/f3a0dc37-502e-48d3-9537-10dd7fb15e94" status: 200 len: 1472 microversion: 2.1 time: 0.360059 Oct 04 21:47:19.524116 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 531/1119] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:19 2022] GET /compute/v2.1/servers/f3a0dc37-502e-48d3-9537-10dd7fb15e94 => generated 1472 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:19.564527 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-99c2ec96-6cd1-467a-a087-700611848312 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:19.565899 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-99c2ec96-6cd1-467a-a087-700611848312 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: 424a22f0-ccc3-4fec-bf38-4aaf924928e3] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:19.576447 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-99c2ec96-6cd1-467a-a087-700611848312 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:19.577243 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-99c2ec96-6cd1-467a-a087-700611848312 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:19.577888 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-99c2ec96-6cd1-467a-a087-700611848312 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:19.579429 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-99c2ec96-6cd1-467a-a087-700611848312 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:19.580645 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-99c2ec96-6cd1-467a-a087-700611848312 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:19.581270 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-99c2ec96-6cd1-467a-a087-700611848312 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:19.878016 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-99c2ec96-6cd1-467a-a087-700611848312 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:19.897813 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-99c2ec96-6cd1-467a-a087-700611848312 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/424a22f0-ccc3-4fec-bf38-4aaf924928e3" status: 200 len: 1541 microversion: 2.1 time: 0.339643 Oct 04 21:47:19.901188 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 589/1120] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:19 2022] GET /compute/v2.1/servers/424a22f0-ccc3-4fec-bf38-4aaf924928e3 => generated 1541 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:20.041581 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-a218a5d9-b07e-4564-9628-fc748b1516b1 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:20.042473 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-a218a5d9-b07e-4564-9628-fc748b1516b1 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 4e8281d2-9de4-42eb-94cc-417be864315d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:20.052954 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-150e909b-807f-4087-b815-da7879818d9e tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:20.054435 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-150e909b-807f-4087-b815-da7879818d9e tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] [instance: e3380b36-6aba-4736-bcbc-f0058f806d55] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:20.065725 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-150e909b-807f-4087-b815-da7879818d9e tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:20.067298 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-150e909b-807f-4087-b815-da7879818d9e tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:20.068305 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-150e909b-807f-4087-b815-da7879818d9e tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:20.068687 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a218a5d9-b07e-4564-9628-fc748b1516b1 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:20.069982 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a218a5d9-b07e-4564-9628-fc748b1516b1 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:20.070689 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-150e909b-807f-4087-b815-da7879818d9e tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:20.071371 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a218a5d9-b07e-4564-9628-fc748b1516b1 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:20.071932 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-150e909b-807f-4087-b815-da7879818d9e tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:20.072979 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-150e909b-807f-4087-b815-da7879818d9e tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:20.074288 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a218a5d9-b07e-4564-9628-fc748b1516b1 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:20.080706 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a218a5d9-b07e-4564-9628-fc748b1516b1 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:20.082060 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a218a5d9-b07e-4564-9628-fc748b1516b1 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:20.852642 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-150e909b-807f-4087-b815-da7879818d9e tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87616cd16995468ab7febf5aa4b284db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e3bf9149434d34b6762aaeef1478ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:20.863782 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-a218a5d9-b07e-4564-9628-fc748b1516b1 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ad048becf474fb972d4291422d810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dcfc7024fc49388c4bd5f25f03e60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:20.869571 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-150e909b-807f-4087-b815-da7879818d9e tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] 10.222.0.43 "GET /compute/v2.1/servers/e3380b36-6aba-4736-bcbc-f0058f806d55" status: 200 len: 1472 microversion: 2.1 time: 0.827363 Oct 04 21:47:20.875227 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-a218a5d9-b07e-4564-9628-fc748b1516b1 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/4e8281d2-9de4-42eb-94cc-417be864315d" status: 200 len: 1503 microversion: 2.1 time: 0.850038 Oct 04 21:47:20.881435 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 532/1122] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:20 2022] GET /compute/v2.1/servers/4e8281d2-9de4-42eb-94cc-417be864315d => generated 1503 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:20.889876 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 590/1122] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:20 2022] GET /compute/v2.1/servers/e3380b36-6aba-4736-bcbc-f0058f806d55 => generated 1472 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:20.955556 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-0bd5963e-86f8-400e-93a9-72798607e671 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Calling method '.version_select at 0x7fbb2eec0040>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:20.956889 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-921b1063-5d4f-48de-ab26-4283580dd4ee tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:20.956889 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-921b1063-5d4f-48de-ab26-4283580dd4ee tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] [instance: f3a0dc37-502e-48d3-9537-10dd7fb15e94] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:20.956889 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-921b1063-5d4f-48de-ab26-4283580dd4ee tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:20.956889 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-921b1063-5d4f-48de-ab26-4283580dd4ee tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:20.957194 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-921b1063-5d4f-48de-ab26-4283580dd4ee tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:20.957194 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-921b1063-5d4f-48de-ab26-4283580dd4ee tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:20.957194 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-921b1063-5d4f-48de-ab26-4283580dd4ee tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:20.957194 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-921b1063-5d4f-48de-ab26-4283580dd4ee tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:21.027913 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-0bd5963e-86f8-400e-93a9-72798607e671 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] 10.222.0.43 "GET /compute/v2.1/images/ac8e9797-0b3b-4c06-9229-b4ac23c4312c" status: 200 len: 1422 microversion: 2.1 time: 0.139622 Oct 04 21:47:21.035205 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 533/1123] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:47:20 2022] GET /compute/v2.1/images/ac8e9797-0b3b-4c06-9229-b4ac23c4312c => generated 1422 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:21.049661 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-459fead7-a7d3-4615-9d89-33f05c3b552c tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:21.052359 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-459fead7-a7d3-4615-9d89-33f05c3b552c tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: 424a22f0-ccc3-4fec-bf38-4aaf924928e3] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:21.064656 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-459fead7-a7d3-4615-9d89-33f05c3b552c tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:21.065481 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-459fead7-a7d3-4615-9d89-33f05c3b552c tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:21.066098 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-459fead7-a7d3-4615-9d89-33f05c3b552c tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:21.067115 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-459fead7-a7d3-4615-9d89-33f05c3b552c tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:21.068714 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-459fead7-a7d3-4615-9d89-33f05c3b552c tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:21.069497 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-459fead7-a7d3-4615-9d89-33f05c3b552c tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:21.081071 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-921b1063-5d4f-48de-ab26-4283580dd4ee tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29842a669a20408b881105135f76cb0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39edf587afe94b60911198aa0bb61613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:21.125006 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-921b1063-5d4f-48de-ab26-4283580dd4ee tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] 10.222.0.43 "GET /compute/v2.1/servers/f3a0dc37-502e-48d3-9537-10dd7fb15e94" status: 200 len: 1430 microversion: 2.1 time: 0.232025 Oct 04 21:47:21.128133 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 591/1124] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:20 2022] GET /compute/v2.1/servers/f3a0dc37-502e-48d3-9537-10dd7fb15e94 => generated 1430 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:21.144835 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-92999723-0c21-4686-aaf1-f3b7cc44d2ba req-d3deba20-7e46-40ef-acb4-2ba4db680792 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3a0dc37-502e-48d3-9537-10dd7fb15e94", "name": "network-vif-deleted", "tag": "5b7ac8fb-dad6-4cfb-b728-11e125a3df78"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:47:21.198890 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-92999723-0c21-4686-aaf1-f3b7cc44d2ba req-d3deba20-7e46-40ef-acb4-2ba4db680792 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:21.199933 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-92999723-0c21-4686-aaf1-f3b7cc44d2ba req-d3deba20-7e46-40ef-acb4-2ba4db680792 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:21.200794 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-92999723-0c21-4686-aaf1-f3b7cc44d2ba req-d3deba20-7e46-40ef-acb4-2ba4db680792 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:21.230854 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-92999723-0c21-4686-aaf1-f3b7cc44d2ba req-d3deba20-7e46-40ef-acb4-2ba4db680792 service nova] Creating event network-vif-deleted:5b7ac8fb-dad6-4cfb-b728-11e125a3df78 for instance f3a0dc37-502e-48d3-9537-10dd7fb15e94 on n-h1-860284-1 Oct 04 21:47:21.237408 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-92999723-0c21-4686-aaf1-f3b7cc44d2ba req-d3deba20-7e46-40ef-acb4-2ba4db680792 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096349 Oct 04 21:47:21.238049 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 592/1125] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:47:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:47:21.706940 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-459fead7-a7d3-4615-9d89-33f05c3b552c tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:21.738455 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-459fead7-a7d3-4615-9d89-33f05c3b552c tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/424a22f0-ccc3-4fec-bf38-4aaf924928e3" status: 200 len: 1541 microversion: 2.1 time: 0.701663 Oct 04 21:47:21.755360 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 534/1126] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:21 2022] GET /compute/v2.1/servers/424a22f0-ccc3-4fec-bf38-4aaf924928e3 => generated 1541 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:21.900736 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-bd0d240d-168b-432f-a7ec-bed721f2af82 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:21.901594 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-bd0d240d-168b-432f-a7ec-bed721f2af82 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] [instance: e3380b36-6aba-4736-bcbc-f0058f806d55] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:21.908876 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-903399eb-ea1d-49fd-ad82-7a44b9f313b0 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:21.911047 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-903399eb-ea1d-49fd-ad82-7a44b9f313b0 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 4e8281d2-9de4-42eb-94cc-417be864315d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:21.917753 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-903399eb-ea1d-49fd-ad82-7a44b9f313b0 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:21.918257 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-903399eb-ea1d-49fd-ad82-7a44b9f313b0 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:21.918734 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-903399eb-ea1d-49fd-ad82-7a44b9f313b0 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:21.919462 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-903399eb-ea1d-49fd-ad82-7a44b9f313b0 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:21.919926 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-903399eb-ea1d-49fd-ad82-7a44b9f313b0 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:21.920366 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-903399eb-ea1d-49fd-ad82-7a44b9f313b0 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:21.936062 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bd0d240d-168b-432f-a7ec-bed721f2af82 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:21.936571 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bd0d240d-168b-432f-a7ec-bed721f2af82 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:21.937026 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bd0d240d-168b-432f-a7ec-bed721f2af82 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:21.937745 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bd0d240d-168b-432f-a7ec-bed721f2af82 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:21.938528 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bd0d240d-168b-432f-a7ec-bed721f2af82 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:21.950970 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bd0d240d-168b-432f-a7ec-bed721f2af82 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:22.487863 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-bd0d240d-168b-432f-a7ec-bed721f2af82 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87616cd16995468ab7febf5aa4b284db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e3bf9149434d34b6762aaeef1478ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:22.512080 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-bd0d240d-168b-432f-a7ec-bed721f2af82 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] 10.222.0.43 "GET /compute/v2.1/servers/e3380b36-6aba-4736-bcbc-f0058f806d55" status: 200 len: 1472 microversion: 2.1 time: 0.615237 Oct 04 21:47:22.517183 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 593/1127] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:21 2022] GET /compute/v2.1/servers/e3380b36-6aba-4736-bcbc-f0058f806d55 => generated 1472 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:47:22.525982 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-f2e53853-369f-44d9-9866-baea3c83efae tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Calling method '.version_select at 0x7fbb2f1858b0>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:22.554044 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-903399eb-ea1d-49fd-ad82-7a44b9f313b0 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ad048becf474fb972d4291422d810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dcfc7024fc49388c4bd5f25f03e60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:22.579509 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-903399eb-ea1d-49fd-ad82-7a44b9f313b0 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/4e8281d2-9de4-42eb-94cc-417be864315d" status: 200 len: 1503 microversion: 2.1 time: 0.671634 Oct 04 21:47:22.580186 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 535/1128] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:21 2022] GET /compute/v2.1/servers/4e8281d2-9de4-42eb-94cc-417be864315d => generated 1503 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:47:22.605663 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-c7283248-4489-42fe-9c2a-09e3e42bc988 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:22.607828 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-c7283248-4489-42fe-9c2a-09e3e42bc988 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] [instance: f3a0dc37-502e-48d3-9537-10dd7fb15e94] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:22.614720 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:47:22.621568 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-f2e53853-369f-44d9-9866-baea3c83efae tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] 10.222.0.43 "GET /compute/v2.1/images/ac8e9797-0b3b-4c06-9229-b4ac23c4312c" status: 200 len: 1422 microversion: 2.1 time: 0.101842 Oct 04 21:47:22.624159 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 594/1129] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:47:22 2022] GET /compute/v2.1/images/ac8e9797-0b3b-4c06-9229-b4ac23c4312c => generated 1422 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:22.624723 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c7283248-4489-42fe-9c2a-09e3e42bc988 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:22.625300 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c7283248-4489-42fe-9c2a-09e3e42bc988 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:22.625754 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c7283248-4489-42fe-9c2a-09e3e42bc988 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:22.626515 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c7283248-4489-42fe-9c2a-09e3e42bc988 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:22.626993 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c7283248-4489-42fe-9c2a-09e3e42bc988 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:22.627431 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c7283248-4489-42fe-9c2a-09e3e42bc988 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:22.635677 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-c38435a0-242c-45c9-a041-13d1b9402eb0 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1110911112", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452", "networks": [{"uuid": "42a7af1a-ab70-4431-afd7-8915bdbe4cf9"}], "security_groups": [{"name": "tempest-securitygroup--913467020"}], "key_name": "tempest-keypair-821678649", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:47:22.708075 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c7283248-4489-42fe-9c2a-09e3e42bc988 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:22.709315 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c7283248-4489-42fe-9c2a-09e3e42bc988 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:22.710072 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c7283248-4489-42fe-9c2a-09e3e42bc988 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:22.710699 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.objects.instance [None req-c7283248-4489-42fe-9c2a-09e3e42bc988 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lazy-loading 'fault' on Instance uuid f3a0dc37-502e-48d3-9537-10dd7fb15e94 {{(pid=134101) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:47:22.842674 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-c7283248-4489-42fe-9c2a-09e3e42bc988 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29842a669a20408b881105135f76cb0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39edf587afe94b60911198aa0bb61613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:22.867546 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:47:22.871559 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-c7283248-4489-42fe-9c2a-09e3e42bc988 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] 10.222.0.43 "GET /compute/v2.1/servers/f3a0dc37-502e-48d3-9537-10dd7fb15e94" status: 200 len: 1306 microversion: 2.1 time: 0.289472 Oct 04 21:47:22.873215 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 536/1130] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:22 2022] GET /compute/v2.1/servers/f3a0dc37-502e-48d3-9537-10dd7fb15e94 => generated 1306 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:22.878455 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.network.neutron [None req-c38435a0-242c-45c9-a041-13d1b9402eb0 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] validate_networks() for [('42a7af1a-ab70-4431-afd7-8915bdbe4cf9', None, None, None, None, None)] {{(pid=134102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:47:22.879577 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e1237788-4064-4af5-9aec-15029537ebf8 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:22.880204 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-e1237788-4064-4af5-9aec-15029537ebf8 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: 424a22f0-ccc3-4fec-bf38-4aaf924928e3] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:22.917175 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e1237788-4064-4af5-9aec-15029537ebf8 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:22.919094 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e1237788-4064-4af5-9aec-15029537ebf8 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:22.920203 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e1237788-4064-4af5-9aec-15029537ebf8 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:22.922899 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e1237788-4064-4af5-9aec-15029537ebf8 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:22.924062 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e1237788-4064-4af5-9aec-15029537ebf8 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:22.925168 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e1237788-4064-4af5-9aec-15029537ebf8 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:23.241876 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-e1237788-4064-4af5-9aec-15029537ebf8 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:23.268541 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-e1237788-4064-4af5-9aec-15029537ebf8 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/424a22f0-ccc3-4fec-bf38-4aaf924928e3" status: 200 len: 1541 microversion: 2.1 time: 0.393772 Oct 04 21:47:23.269699 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 537/1131] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:22 2022] GET /compute/v2.1/servers/424a22f0-ccc3-4fec-bf38-4aaf924928e3 => generated 1541 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:23.544161 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-974b8fe0-effd-4ce1-8d0a-a572338fd004 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:23.545119 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-974b8fe0-effd-4ce1-8d0a-a572338fd004 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] [instance: e3380b36-6aba-4736-bcbc-f0058f806d55] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:23.555159 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-974b8fe0-effd-4ce1-8d0a-a572338fd004 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:23.556624 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-974b8fe0-effd-4ce1-8d0a-a572338fd004 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:23.557233 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-974b8fe0-effd-4ce1-8d0a-a572338fd004 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:23.558294 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-974b8fe0-effd-4ce1-8d0a-a572338fd004 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:23.559056 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-974b8fe0-effd-4ce1-8d0a-a572338fd004 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:23.559917 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-974b8fe0-effd-4ce1-8d0a-a572338fd004 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:23.784039 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-c38435a0-242c-45c9-a041-13d1b9402eb0 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Flavor limits 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:47:23.784839 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-c38435a0-242c-45c9-a041-13d1b9402eb0 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Image limits 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:47:23.785686 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-c38435a0-242c-45c9-a041-13d1b9402eb0 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Flavor pref 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:47:23.786393 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-c38435a0-242c-45c9-a041-13d1b9402eb0 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Image pref 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:47:23.787727 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-c38435a0-242c-45c9-a041-13d1b9402eb0 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:47:23.799252 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c38435a0-242c-45c9-a041-13d1b9402eb0 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:23.800205 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c38435a0-242c-45c9-a041-13d1b9402eb0 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:23.800916 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c38435a0-242c-45c9-a041-13d1b9402eb0 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:23.802290 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c38435a0-242c-45c9-a041-13d1b9402eb0 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:23.804432 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c38435a0-242c-45c9-a041-13d1b9402eb0 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:23.804978 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c38435a0-242c-45c9-a041-13d1b9402eb0 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:23.827293 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-c38435a0-242c-45c9-a041-13d1b9402eb0 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Getting quotas for project f17fee483fd14b07977669df199f3018. Resources: {'instances', 'ram', 'cores'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:47:23.835464 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-c38435a0-242c-45c9-a041-13d1b9402eb0 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Getting quotas for user f529f881a037459d9405bd14afd7a639 and project f17fee483fd14b07977669df199f3018. Resources: {'instances', 'ram', 'cores'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:47:23.870270 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-974b8fe0-effd-4ce1-8d0a-a572338fd004 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87616cd16995468ab7febf5aa4b284db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e3bf9149434d34b6762aaeef1478ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:23.870609 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-c38435a0-242c-45c9-a041-13d1b9402eb0 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Going to run 1 instances... {{(pid=134102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:47:23.877162 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-c38435a0-242c-45c9-a041-13d1b9402eb0 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] [instance: d4abcd04-329d-40a8-8d6e-4383bef437ae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='58548514-5dac-426c-81f5-19e3fba33e23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:47:23.881471 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-974b8fe0-effd-4ce1-8d0a-a572338fd004 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] 10.222.0.43 "GET /compute/v2.1/servers/e3380b36-6aba-4736-bcbc-f0058f806d55" status: 200 len: 1472 microversion: 2.1 time: 0.341749 Oct 04 21:47:23.882708 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 538/1132] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:23 2022] GET /compute/v2.1/servers/e3380b36-6aba-4736-bcbc-f0058f806d55 => generated 1472 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:47:23.888378 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-dbbdabd1-2c3e-44c9-9423-ee4b525fb0f7 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:23.889413 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-dbbdabd1-2c3e-44c9-9423-ee4b525fb0f7 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 4e8281d2-9de4-42eb-94cc-417be864315d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:23.921741 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dbbdabd1-2c3e-44c9-9423-ee4b525fb0f7 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:23.922656 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dbbdabd1-2c3e-44c9-9423-ee4b525fb0f7 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:23.923294 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dbbdabd1-2c3e-44c9-9423-ee4b525fb0f7 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:23.924586 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dbbdabd1-2c3e-44c9-9423-ee4b525fb0f7 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:23.925325 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dbbdabd1-2c3e-44c9-9423-ee4b525fb0f7 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:23.925952 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dbbdabd1-2c3e-44c9-9423-ee4b525fb0f7 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:23.974074 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-c38435a0-242c-45c9-a041-13d1b9402eb0 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.25 time: 1.347529 Oct 04 21:47:23.981152 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 595/1133] 10.222.0.43 () {62 vars in 1188 bytes} [Tue Oct 4 21:47:22 2022] POST /compute/v2.1/servers => generated 405 bytes in 1350 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 04 21:47:23.981152 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-fefb5011-860c-4437-ad6b-f51a0f730f67 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Calling method '.version_select at 0x7fbb2f052940>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:24.066936 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-fefb5011-860c-4437-ad6b-f51a0f730f67 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] 10.222.0.43 "GET /compute/v2.1/images/ac8e9797-0b3b-4c06-9229-b4ac23c4312c" status: 200 len: 1422 microversion: 2.1 time: 0.089571 Oct 04 21:47:24.068793 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 596/1134] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:47:23 2022] GET /compute/v2.1/images/ac8e9797-0b3b-4c06-9229-b4ac23c4312c => generated 1422 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:24.078497 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-d32c0a3a-b866-4c30-8e27-008a106972b8 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:24.081096 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-d32c0a3a-b866-4c30-8e27-008a106972b8 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] [instance: f3a0dc37-502e-48d3-9537-10dd7fb15e94] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:24.090292 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d32c0a3a-b866-4c30-8e27-008a106972b8 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:24.091818 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d32c0a3a-b866-4c30-8e27-008a106972b8 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:24.092990 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d32c0a3a-b866-4c30-8e27-008a106972b8 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:24.095216 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d32c0a3a-b866-4c30-8e27-008a106972b8 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:24.096454 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d32c0a3a-b866-4c30-8e27-008a106972b8 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:24.097861 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d32c0a3a-b866-4c30-8e27-008a106972b8 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:24.145204 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-d32c0a3a-b866-4c30-8e27-008a106972b8 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] HTTP exception thrown: Instance f3a0dc37-502e-48d3-9537-10dd7fb15e94 could not be found. Oct 04 21:47:24.147809 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-d32c0a3a-b866-4c30-8e27-008a106972b8 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Request method failure captured: Oct 04 21:47:24.147809 n-d-860284-1 devstack@n-api.service[134102]: request: GET /compute/v2.1/servers/f3a0dc37-502e-48d3-9537-10dd7fb15e94 HTTP/1.1 Oct 04 21:47:24.147809 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 21:47:24.147809 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 21:47:24.147809 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 21:47:24.147809 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 21:47:24.147809 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 21:47:24.147809 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 21:47:24.147809 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 21:47:24.147809 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 21:47:24.147809 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPKkKKWGhYvwCdv1J2MeGQ-jOAZuoGQ1lwAe198r71Ukwb_5umfLkuxNfZWiQHMUxBfhv-_5em_OANDxdq4CvMn57rB1IdcDSs2VQnXaxFUQOJQx2QIboBa8MD9AFC6JsgH39EDtpQDm0bx49UHlQ1MXYHpusDcMOOxl5o1LHadq_Xtg Oct 04 21:47:24.147809 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 21:47:24.147809 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 21:47:24.147809 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 21:47:24.147809 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 21:47:24.147809 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 21:47:24.147809 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 21:47:24.147809 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: 39edf587afe94b60911198aa0bb61613 Oct 04 21:47:24.147809 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-ServersOnMultiNodesTest-569263937 Oct 04 21:47:24.147809 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 21:47:24.147809 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 21:47:24.150892 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/39edf587afe94b60911198aa0bb61613"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_39edf587afe94b60911198aa0bb61613", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/39edf587afe94b60911198aa0bb61613"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/39edf587afe94b60911198aa0bb61613"}]}] Oct 04 21:47:24.150892 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-ServersOnMultiNodesTest-569263937 Oct 04 21:47:24.150892 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: 39edf587afe94b60911198aa0bb61613 Oct 04 21:47:24.150892 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-569263937 Oct 04 21:47:24.150892 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-ServersOnMultiNodesTest-569263937-project Oct 04 21:47:24.150892 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 21:47:24.150892 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 21:47:24.150892 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: 29842a669a20408b881105135f76cb0a Oct 04 21:47:24.150892 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-ServersOnMultiNodesTest-569263937-project Oct 04 21:47:24.150892 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 21:47:24.150892 n-d-860284-1 devstack@n-api.service[134102]: exception: Instance f3a0dc37-502e-48d3-9537-10dd7fb15e94 could not be found. Oct 04 21:47:24.150892 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': 'f3a0dc37-502e-48d3-9537-10dd7fb15e94'} Oct 04 21:47:24.152684 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:47:24.152684 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:47:24.152684 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:47:24.152684 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:47:24.152684 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:47:24.152684 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:47:24.152684 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:47:24.152684 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:47:24.152684 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:47:24.152684 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:47:24.152684 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3a0dc37-502e-48d3-9537-10dd7fb15e94 could not be found. Oct 04 21:47:24.152684 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:47:24.152684 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:47:24.152684 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:47:24.152684 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:47:24.152684 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:47:24.152684 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:47:24.152684 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:47:24.152684 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:47:24.152684 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:47:24.155959 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:47:24.155959 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:47:24.155959 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:47:24.155959 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:47:24.155959 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:47:24.155959 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:47:24.155959 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:47:24.155959 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3a0dc37-502e-48d3-9537-10dd7fb15e94 could not be found. Oct 04 21:47:24.155959 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:47:24.155959 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:47:24.155959 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:47:24.155959 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:47:24.155959 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:47:24.155959 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:47:24.155959 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:47:24.155959 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:47:24.155959 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3a0dc37-502e-48d3-9537-10dd7fb15e94 could not be found. Oct 04 21:47:24.155959 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:47:24.158341 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-d32c0a3a-b866-4c30-8e27-008a106972b8 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Returning 404 to user: Instance f3a0dc37-502e-48d3-9537-10dd7fb15e94 could not be found. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:47:24.158341 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-d32c0a3a-b866-4c30-8e27-008a106972b8 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] 10.222.0.43 "GET /compute/v2.1/servers/f3a0dc37-502e-48d3-9537-10dd7fb15e94" status: 404 len: 111 microversion: 2.1 time: 0.078788 Oct 04 21:47:24.158341 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 597/1135] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:24 2022] GET /compute/v2.1/servers/f3a0dc37-502e-48d3-9537-10dd7fb15e94 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:47:24.159716 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-a0574c4e-fcb3-4528-824b-293d2950f0cd tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:24.160003 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-a0574c4e-fcb3-4528-824b-293d2950f0cd tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] [instance: d4abcd04-329d-40a8-8d6e-4383bef437ae] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:24.342160 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-a0574c4e-fcb3-4528-824b-293d2950f0cd tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:24.355716 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-a0574c4e-fcb3-4528-824b-293d2950f0cd tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:24.362015 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-a0574c4e-fcb3-4528-824b-293d2950f0cd tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:24.363438 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-a0574c4e-fcb3-4528-824b-293d2950f0cd tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] 10.222.0.43 "GET /compute/v2.1/servers/d4abcd04-329d-40a8-8d6e-4383bef437ae" status: 200 len: 1285 microversion: 2.25 time: 0.208715 Oct 04 21:47:24.380068 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 598/1136] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:47:24 2022] GET /compute/v2.1/servers/d4abcd04-329d-40a8-8d6e-4383bef437ae => generated 1285 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:47:24.393260 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-20e9683d-7c1d-4f90-8cfd-6c03cb21f628 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:24.394110 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-20e9683d-7c1d-4f90-8cfd-6c03cb21f628 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] [instance: 3968d68f-a421-4d08-8b67-b5410b618a47] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:24.407090 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-20e9683d-7c1d-4f90-8cfd-6c03cb21f628 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:24.408177 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-20e9683d-7c1d-4f90-8cfd-6c03cb21f628 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:24.409516 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-20e9683d-7c1d-4f90-8cfd-6c03cb21f628 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:24.411079 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-20e9683d-7c1d-4f90-8cfd-6c03cb21f628 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:24.417393 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-20e9683d-7c1d-4f90-8cfd-6c03cb21f628 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:24.418628 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-20e9683d-7c1d-4f90-8cfd-6c03cb21f628 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:24.467844 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-dbbdabd1-2c3e-44c9-9423-ee4b525fb0f7 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ad048becf474fb972d4291422d810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dcfc7024fc49388c4bd5f25f03e60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:24.497830 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-dbbdabd1-2c3e-44c9-9423-ee4b525fb0f7 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/4e8281d2-9de4-42eb-94cc-417be864315d" status: 200 len: 1503 microversion: 2.1 time: 0.613182 Oct 04 21:47:24.504719 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 539/1137] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:23 2022] GET /compute/v2.1/servers/4e8281d2-9de4-42eb-94cc-417be864315d => generated 1503 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:24.529669 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-517387ed-d975-4646-b88c-4ff853e98e2f tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:24.532261 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-20e9683d-7c1d-4f90-8cfd-6c03cb21f628 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] [instance: 3968d68f-a421-4d08-8b67-b5410b618a47] Going to try to terminate instance {{(pid=134102) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:47:24.533685 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-517387ed-d975-4646-b88c-4ff853e98e2f tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: 424a22f0-ccc3-4fec-bf38-4aaf924928e3] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:24.547393 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-517387ed-d975-4646-b88c-4ff853e98e2f tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:24.548037 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-517387ed-d975-4646-b88c-4ff853e98e2f tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:24.548572 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-517387ed-d975-4646-b88c-4ff853e98e2f tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:24.549817 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-517387ed-d975-4646-b88c-4ff853e98e2f tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:24.550912 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-517387ed-d975-4646-b88c-4ff853e98e2f tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:24.551450 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-517387ed-d975-4646-b88c-4ff853e98e2f tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:24.647279 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:47:24.707364 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-20e9683d-7c1d-4f90-8cfd-6c03cb21f628 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] 10.222.0.43 "DELETE /compute/v2.1/servers/3968d68f-a421-4d08-8b67-b5410b618a47" status: 204 len: 0 microversion: 2.1 time: 0.324679 Oct 04 21:47:24.709406 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 599/1138] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 21:47:24 2022] DELETE /compute/v2.1/servers/3968d68f-a421-4d08-8b67-b5410b618a47 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:47:24.726344 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-0699be0e-20dc-4495-b83e-a4781f2a7f58 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:24.726802 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-0699be0e-20dc-4495-b83e-a4781f2a7f58 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] [instance: e204d537-73b1-4070-a3f4-e0e3053e0639] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:24.746520 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0699be0e-20dc-4495-b83e-a4781f2a7f58 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:24.747029 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0699be0e-20dc-4495-b83e-a4781f2a7f58 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:24.747474 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0699be0e-20dc-4495-b83e-a4781f2a7f58 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:24.749159 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0699be0e-20dc-4495-b83e-a4781f2a7f58 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:24.751668 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0699be0e-20dc-4495-b83e-a4781f2a7f58 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:24.752378 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0699be0e-20dc-4495-b83e-a4781f2a7f58 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:24.801776 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-0699be0e-20dc-4495-b83e-a4781f2a7f58 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] [instance: e204d537-73b1-4070-a3f4-e0e3053e0639] Going to try to terminate instance {{(pid=134102) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:47:24.813977 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-517387ed-d975-4646-b88c-4ff853e98e2f tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:24.826824 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-517387ed-d975-4646-b88c-4ff853e98e2f tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/424a22f0-ccc3-4fec-bf38-4aaf924928e3" status: 200 len: 1541 microversion: 2.1 time: 0.317172 Oct 04 21:47:24.827774 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 540/1139] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:24 2022] GET /compute/v2.1/servers/424a22f0-ccc3-4fec-bf38-4aaf924928e3 => generated 1541 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:24.910681 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-07edb153-d7c5-43e9-9f64-bfc06efb264d tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:24.911251 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-07edb153-d7c5-43e9-9f64-bfc06efb264d tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] [instance: e3380b36-6aba-4736-bcbc-f0058f806d55] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:24.925217 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-0699be0e-20dc-4495-b83e-a4781f2a7f58 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] 10.222.0.43 "DELETE /compute/v2.1/servers/e204d537-73b1-4070-a3f4-e0e3053e0639" status: 204 len: 0 microversion: 2.1 time: 0.210974 Oct 04 21:47:24.926934 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 600/1140] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 21:47:24 2022] DELETE /compute/v2.1/servers/e204d537-73b1-4070-a3f4-e0e3053e0639 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:47:24.936780 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-07edb153-d7c5-43e9-9f64-bfc06efb264d tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:24.937331 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-07edb153-d7c5-43e9-9f64-bfc06efb264d tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:24.937650 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-82445155-2a13-4d77-8a5b-7dd1f1402ac7 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:24.937779 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-07edb153-d7c5-43e9-9f64-bfc06efb264d tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:24.938460 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-82445155-2a13-4d77-8a5b-7dd1f1402ac7 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] [instance: 3968d68f-a421-4d08-8b67-b5410b618a47] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:24.938584 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-07edb153-d7c5-43e9-9f64-bfc06efb264d tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:24.939023 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-07edb153-d7c5-43e9-9f64-bfc06efb264d tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:24.939458 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-07edb153-d7c5-43e9-9f64-bfc06efb264d tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:24.945685 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-82445155-2a13-4d77-8a5b-7dd1f1402ac7 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:24.946178 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-82445155-2a13-4d77-8a5b-7dd1f1402ac7 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:24.946636 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-82445155-2a13-4d77-8a5b-7dd1f1402ac7 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:24.947393 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-82445155-2a13-4d77-8a5b-7dd1f1402ac7 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:24.948052 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-82445155-2a13-4d77-8a5b-7dd1f1402ac7 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:24.948476 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-82445155-2a13-4d77-8a5b-7dd1f1402ac7 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:25.189137 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-82445155-2a13-4d77-8a5b-7dd1f1402ac7 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29842a669a20408b881105135f76cb0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39edf587afe94b60911198aa0bb61613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:25.192549 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-07edb153-d7c5-43e9-9f64-bfc06efb264d tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87616cd16995468ab7febf5aa4b284db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e3bf9149434d34b6762aaeef1478ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:25.202281 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-07edb153-d7c5-43e9-9f64-bfc06efb264d tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] 10.222.0.43 "GET /compute/v2.1/servers/e3380b36-6aba-4736-bcbc-f0058f806d55" status: 200 len: 1472 microversion: 2.1 time: 0.295639 Oct 04 21:47:25.203562 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-82445155-2a13-4d77-8a5b-7dd1f1402ac7 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] 10.222.0.43 "GET /compute/v2.1/servers/3968d68f-a421-4d08-8b67-b5410b618a47" status: 200 len: 1474 microversion: 2.1 time: 0.271706 Oct 04 21:47:25.204364 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 601/1141] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:24 2022] GET /compute/v2.1/servers/3968d68f-a421-4d08-8b67-b5410b618a47 => generated 1474 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:25.205532 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 541/1142] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:24 2022] GET /compute/v2.1/servers/e3380b36-6aba-4736-bcbc-f0058f806d55 => generated 1472 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:25.224982 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-00bad703-2e28-4f2f-9269-f9643a858107 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Calling method '.version_select at 0x7fbb2f185c10>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:25.275706 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-00bad703-2e28-4f2f-9269-f9643a858107 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] 10.222.0.43 "GET /compute/v2.1/images/ac8e9797-0b3b-4c06-9229-b4ac23c4312c" status: 200 len: 1422 microversion: 2.1 time: 0.054680 Oct 04 21:47:25.276451 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 602/1143] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:47:25 2022] GET /compute/v2.1/images/ac8e9797-0b3b-4c06-9229-b4ac23c4312c => generated 1422 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:25.392438 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-10f56ee8-ece9-4451-a085-3849e524a0c0 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:25.393058 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-10f56ee8-ece9-4451-a085-3849e524a0c0 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] [instance: d4abcd04-329d-40a8-8d6e-4383bef437ae] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:25.399473 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-10f56ee8-ece9-4451-a085-3849e524a0c0 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:25.400005 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-10f56ee8-ece9-4451-a085-3849e524a0c0 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:25.400633 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-10f56ee8-ece9-4451-a085-3849e524a0c0 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:25.401519 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-10f56ee8-ece9-4451-a085-3849e524a0c0 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:25.402124 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-10f56ee8-ece9-4451-a085-3849e524a0c0 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:25.402744 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-10f56ee8-ece9-4451-a085-3849e524a0c0 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:25.469810 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-10f56ee8-ece9-4451-a085-3849e524a0c0 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:25.480446 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-10f56ee8-ece9-4451-a085-3849e524a0c0 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:25.481977 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-10f56ee8-ece9-4451-a085-3849e524a0c0 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:25.483192 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-10f56ee8-ece9-4451-a085-3849e524a0c0 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] 10.222.0.43 "GET /compute/v2.1/servers/d4abcd04-329d-40a8-8d6e-4383bef437ae" status: 200 len: 1281 microversion: 2.25 time: 0.094756 Oct 04 21:47:25.483864 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 542/1144] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:47:25 2022] GET /compute/v2.1/servers/d4abcd04-329d-40a8-8d6e-4383bef437ae => generated 1281 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:47:25.555923 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-3b156b9b-fb06-4b3a-9c72-b44638b32e2a tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:25.556790 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-3b156b9b-fb06-4b3a-9c72-b44638b32e2a tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 4e8281d2-9de4-42eb-94cc-417be864315d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:25.563388 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3b156b9b-fb06-4b3a-9c72-b44638b32e2a tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:25.563880 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3b156b9b-fb06-4b3a-9c72-b44638b32e2a tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:25.564311 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3b156b9b-fb06-4b3a-9c72-b44638b32e2a tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:25.565058 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3b156b9b-fb06-4b3a-9c72-b44638b32e2a tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:25.565523 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3b156b9b-fb06-4b3a-9c72-b44638b32e2a tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:25.565944 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3b156b9b-fb06-4b3a-9c72-b44638b32e2a tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:25.706780 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-3b156b9b-fb06-4b3a-9c72-b44638b32e2a tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ad048becf474fb972d4291422d810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dcfc7024fc49388c4bd5f25f03e60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:25.721124 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-3b156b9b-fb06-4b3a-9c72-b44638b32e2a tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/4e8281d2-9de4-42eb-94cc-417be864315d" status: 200 len: 1478 microversion: 2.1 time: 0.170427 Oct 04 21:47:25.721859 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 603/1145] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:25 2022] GET /compute/v2.1/servers/4e8281d2-9de4-42eb-94cc-417be864315d => generated 1478 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:25.749366 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-0089e006-5521-4ed3-b53c-48365a6aab8a tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Calling method '.version_select at 0x7fbb2eec6c10>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:25.752914 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0089e006-5521-4ed3-b53c-48365a6aab8a tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:25.753399 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0089e006-5521-4ed3-b53c-48365a6aab8a tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:25.753846 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0089e006-5521-4ed3-b53c-48365a6aab8a tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:25.769198 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-0089e006-5521-4ed3-b53c-48365a6aab8a tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] 10.222.0.43 "GET /compute/v2.1/os-migrations" status: 200 len: 2729 microversion: 2.1 time: 0.023783 Oct 04 21:47:25.769847 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 543/1146] 10.222.0.43 () {58 vars in 1143 bytes} [Tue Oct 4 21:47:25 2022] GET /compute/v2.1/os-migrations => generated 2729 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:25.785340 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-1a1db380-aab2-4f36-91cc-3c6e82b55db6 tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:25.786091 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-1a1db380-aab2-4f36-91cc-3c6e82b55db6 tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] [instance: 4e8281d2-9de4-42eb-94cc-417be864315d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:25.792598 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1a1db380-aab2-4f36-91cc-3c6e82b55db6 tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:25.793092 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1a1db380-aab2-4f36-91cc-3c6e82b55db6 tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:25.793530 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1a1db380-aab2-4f36-91cc-3c6e82b55db6 tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:25.794231 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1a1db380-aab2-4f36-91cc-3c6e82b55db6 tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:25.794725 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1a1db380-aab2-4f36-91cc-3c6e82b55db6 tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:25.795153 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1a1db380-aab2-4f36-91cc-3c6e82b55db6 tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:25.851717 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-a3d6d851-65f9-4225-9e48-86f2669bfeca tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:25.852970 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-a3d6d851-65f9-4225-9e48-86f2669bfeca tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: 424a22f0-ccc3-4fec-bf38-4aaf924928e3] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:25.859460 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a3d6d851-65f9-4225-9e48-86f2669bfeca tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:25.860204 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a3d6d851-65f9-4225-9e48-86f2669bfeca tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:25.860634 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a3d6d851-65f9-4225-9e48-86f2669bfeca tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:25.861494 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a3d6d851-65f9-4225-9e48-86f2669bfeca tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:25.862118 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a3d6d851-65f9-4225-9e48-86f2669bfeca tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:25.862736 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a3d6d851-65f9-4225-9e48-86f2669bfeca tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:26.292727 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-1a1db380-aab2-4f36-91cc-3c6e82b55db6 tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/4e8281d2-9de4-42eb-94cc-417be864315d" status: 200 len: 1629 microversion: 2.1 time: 0.511164 Oct 04 21:47:26.294324 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 604/1147] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:25 2022] GET /compute/v2.1/servers/4e8281d2-9de4-42eb-94cc-417be864315d => generated 1629 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:26.306674 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-45d10cd6-2086-4b4b-86ae-3f9ccb768da3 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:26.306674 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-45d10cd6-2086-4b4b-86ae-3f9ccb768da3 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] [instance: 3968d68f-a421-4d08-8b67-b5410b618a47] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:26.323156 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-45d10cd6-2086-4b4b-86ae-3f9ccb768da3 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:26.323910 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-45d10cd6-2086-4b4b-86ae-3f9ccb768da3 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:26.324448 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-45d10cd6-2086-4b4b-86ae-3f9ccb768da3 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:26.325398 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-45d10cd6-2086-4b4b-86ae-3f9ccb768da3 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:26.326001 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-45d10cd6-2086-4b4b-86ae-3f9ccb768da3 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:26.326550 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-45d10cd6-2086-4b4b-86ae-3f9ccb768da3 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:26.462427 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-a3d6d851-65f9-4225-9e48-86f2669bfeca tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:26.480770 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-a3d6d851-65f9-4225-9e48-86f2669bfeca tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/424a22f0-ccc3-4fec-bf38-4aaf924928e3" status: 200 len: 1541 microversion: 2.1 time: 0.632895 Oct 04 21:47:26.486903 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 544/1148] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:25 2022] GET /compute/v2.1/servers/424a22f0-ccc3-4fec-bf38-4aaf924928e3 => generated 1541 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:26.496424 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-4025e49a-e529-4ede-9579-3ab0ad6e12d6 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:26.497286 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-4025e49a-e529-4ede-9579-3ab0ad6e12d6 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] [instance: e3380b36-6aba-4736-bcbc-f0058f806d55] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:26.503690 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4025e49a-e529-4ede-9579-3ab0ad6e12d6 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:26.504358 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4025e49a-e529-4ede-9579-3ab0ad6e12d6 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:26.504897 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4025e49a-e529-4ede-9579-3ab0ad6e12d6 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:26.505954 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4025e49a-e529-4ede-9579-3ab0ad6e12d6 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:26.506602 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4025e49a-e529-4ede-9579-3ab0ad6e12d6 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:26.507479 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4025e49a-e529-4ede-9579-3ab0ad6e12d6 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:26.643595 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-45d10cd6-2086-4b4b-86ae-3f9ccb768da3 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29842a669a20408b881105135f76cb0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39edf587afe94b60911198aa0bb61613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:26.668277 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-45d10cd6-2086-4b4b-86ae-3f9ccb768da3 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] 10.222.0.43 "GET /compute/v2.1/servers/3968d68f-a421-4d08-8b67-b5410b618a47" status: 200 len: 1474 microversion: 2.1 time: 0.370258 Oct 04 21:47:26.672859 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 605/1149] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:26 2022] GET /compute/v2.1/servers/3968d68f-a421-4d08-8b67-b5410b618a47 => generated 1474 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:26.690770 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-13950b7a-fee3-4793-a37e-0f56019b4459 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Calling method '.version_select at 0x7fbb2f1850d0>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:26.758237 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-4025e49a-e529-4ede-9579-3ab0ad6e12d6 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87616cd16995468ab7febf5aa4b284db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e3bf9149434d34b6762aaeef1478ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:26.767714 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-4025e49a-e529-4ede-9579-3ab0ad6e12d6 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] 10.222.0.43 "GET /compute/v2.1/servers/e3380b36-6aba-4736-bcbc-f0058f806d55" status: 200 len: 1472 microversion: 2.1 time: 0.278639 Oct 04 21:47:26.768298 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 545/1150] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:26 2022] GET /compute/v2.1/servers/e3380b36-6aba-4736-bcbc-f0058f806d55 => generated 1472 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:26.769088 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-13950b7a-fee3-4793-a37e-0f56019b4459 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] 10.222.0.43 "GET /compute/v2.1/images/ac8e9797-0b3b-4c06-9229-b4ac23c4312c" status: 200 len: 1422 microversion: 2.1 time: 0.083515 Oct 04 21:47:26.777869 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 606/1151] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:47:26 2022] GET /compute/v2.1/images/ac8e9797-0b3b-4c06-9229-b4ac23c4312c => generated 1422 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:26.778198 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e6d39f34-bf7a-4686-991d-fc279266da16 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Action: 'create', calling method: .version_select at 0x7fbb2ef19ca0>, body: {"keypair": {"name": "tempest-keypair-1394490439", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMDiZhtoj29xRtqrPe/FuQGQmcbnmlmTqrEYnrbs3qn9U/VTnV33fBzbGQB039AlvbmOq3ER05HP3Sxjx2ckti3ueCBWKyHFmzj3OzIIGPcsY9HgWCsq3uqTQk5y7JS88g=="}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:47:26.778318 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-564ffee2-f60c-405a-b231-a831e97d836b tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:26.778318 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-564ffee2-f60c-405a-b231-a831e97d836b tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] [instance: d4abcd04-329d-40a8-8d6e-4383bef437ae] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:26.785490 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-564ffee2-f60c-405a-b231-a831e97d836b tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:26.785981 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-564ffee2-f60c-405a-b231-a831e97d836b tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:26.786441 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-564ffee2-f60c-405a-b231-a831e97d836b tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:26.787955 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-564ffee2-f60c-405a-b231-a831e97d836b tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:26.788416 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-564ffee2-f60c-405a-b231-a831e97d836b tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:26.788945 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-564ffee2-f60c-405a-b231-a831e97d836b tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:26.810646 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-e6d39f34-bf7a-4686-991d-fc279266da16 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Getting quotas for project 78dcfc7024fc49388c4bd5f25f03e60d. Resources: {'key_pairs'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:47:26.825324 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-e6d39f34-bf7a-4686-991d-fc279266da16 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Getting quotas for user bb7ad048becf474fb972d4291422d810 and project 78dcfc7024fc49388c4bd5f25f03e60d. Resources: {'key_pairs'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:47:26.876228 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-e6d39f34-bf7a-4686-991d-fc279266da16 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.106019 Oct 04 21:47:26.883600 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 546/1152] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Oct 4 21:47:26 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:47:26.953931 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-564ffee2-f60c-405a-b231-a831e97d836b tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:26.968735 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-564ffee2-f60c-405a-b231-a831e97d836b tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:26.978330 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-564ffee2-f60c-405a-b231-a831e97d836b tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:26.979620 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-564ffee2-f60c-405a-b231-a831e97d836b tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] 10.222.0.43 "GET /compute/v2.1/servers/d4abcd04-329d-40a8-8d6e-4383bef437ae" status: 200 len: 1337 microversion: 2.25 time: 0.208475 Oct 04 21:47:26.980952 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 607/1153] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:47:26 2022] GET /compute/v2.1/servers/d4abcd04-329d-40a8-8d6e-4383bef437ae => generated 1337 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:47:27.511039 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-0fdf714d-9195-4fea-8e79-07bd936cfe0e tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:27.511724 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-0fdf714d-9195-4fea-8e79-07bd936cfe0e tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: 424a22f0-ccc3-4fec-bf38-4aaf924928e3] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:27.520195 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0fdf714d-9195-4fea-8e79-07bd936cfe0e tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:27.521731 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0fdf714d-9195-4fea-8e79-07bd936cfe0e tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:27.523542 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0fdf714d-9195-4fea-8e79-07bd936cfe0e tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:27.524903 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0fdf714d-9195-4fea-8e79-07bd936cfe0e tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:27.525544 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0fdf714d-9195-4fea-8e79-07bd936cfe0e tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:27.526142 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0fdf714d-9195-4fea-8e79-07bd936cfe0e tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:27.701886 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-faf97739-8843-4a2a-9d51-49d1346ff512 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:27.702739 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-faf97739-8843-4a2a-9d51-49d1346ff512 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] [instance: 3968d68f-a421-4d08-8b67-b5410b618a47] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:27.723555 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-faf97739-8843-4a2a-9d51-49d1346ff512 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:27.725399 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-faf97739-8843-4a2a-9d51-49d1346ff512 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:27.728854 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-faf97739-8843-4a2a-9d51-49d1346ff512 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:27.730428 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-faf97739-8843-4a2a-9d51-49d1346ff512 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:27.731248 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-faf97739-8843-4a2a-9d51-49d1346ff512 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:27.733588 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-faf97739-8843-4a2a-9d51-49d1346ff512 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:27.956605 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-0fdf714d-9195-4fea-8e79-07bd936cfe0e tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:27.969509 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-0fdf714d-9195-4fea-8e79-07bd936cfe0e tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/424a22f0-ccc3-4fec-bf38-4aaf924928e3" status: 200 len: 1541 microversion: 2.1 time: 0.464205 Oct 04 21:47:27.970110 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 547/1154] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:27 2022] GET /compute/v2.1/servers/424a22f0-ccc3-4fec-bf38-4aaf924928e3 => generated 1541 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:27.976532 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-faf97739-8843-4a2a-9d51-49d1346ff512 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29842a669a20408b881105135f76cb0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39edf587afe94b60911198aa0bb61613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:27.988643 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-3e275e7a-cd34-4291-8362-6cfb7d45cc41 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Calling method '.version_select at 0x7fbb2ef46820>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:27.990173 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-faf97739-8843-4a2a-9d51-49d1346ff512 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] 10.222.0.43 "GET /compute/v2.1/servers/3968d68f-a421-4d08-8b67-b5410b618a47" status: 200 len: 1432 microversion: 2.1 time: 0.297641 Oct 04 21:47:28.007695 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 608/1155] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:27 2022] GET /compute/v2.1/servers/3968d68f-a421-4d08-8b67-b5410b618a47 => generated 1432 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:28.022023 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-fb945fe2-7ce7-4bf7-ae98-0d4123e84419 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:28.043427 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-fb945fe2-7ce7-4bf7-ae98-0d4123e84419 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] [instance: e3380b36-6aba-4736-bcbc-f0058f806d55] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:28.060152 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fb945fe2-7ce7-4bf7-ae98-0d4123e84419 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:28.062597 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fb945fe2-7ce7-4bf7-ae98-0d4123e84419 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:28.063342 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fb945fe2-7ce7-4bf7-ae98-0d4123e84419 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:28.066452 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fb945fe2-7ce7-4bf7-ae98-0d4123e84419 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:28.067336 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fb945fe2-7ce7-4bf7-ae98-0d4123e84419 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:28.068962 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fb945fe2-7ce7-4bf7-ae98-0d4123e84419 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:28.100665 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-3e275e7a-cd34-4291-8362-6cfb7d45cc41 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] 10.222.0.43 "GET /compute/v2.1/images/ac8e9797-0b3b-4c06-9229-b4ac23c4312c" status: 200 len: 1422 microversion: 2.1 time: 0.116278 Oct 04 21:47:28.101444 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 548/1156] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:47:27 2022] GET /compute/v2.1/images/ac8e9797-0b3b-4c06-9229-b4ac23c4312c => generated 1422 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:28.112780 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-20affaf0-6590-4004-a0c2-011e67ee0aec tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:28.131436 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-20affaf0-6590-4004-a0c2-011e67ee0aec tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] [instance: d4abcd04-329d-40a8-8d6e-4383bef437ae] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:28.151997 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-20affaf0-6590-4004-a0c2-011e67ee0aec tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:28.152799 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-20affaf0-6590-4004-a0c2-011e67ee0aec tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:28.153408 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-20affaf0-6590-4004-a0c2-011e67ee0aec tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:28.154288 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-20affaf0-6590-4004-a0c2-011e67ee0aec tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:28.155026 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-20affaf0-6590-4004-a0c2-011e67ee0aec tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:28.155614 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-20affaf0-6590-4004-a0c2-011e67ee0aec tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:28.405193 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-20affaf0-6590-4004-a0c2-011e67ee0aec tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:28.436261 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-20affaf0-6590-4004-a0c2-011e67ee0aec tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:28.442638 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-20affaf0-6590-4004-a0c2-011e67ee0aec tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:28.448754 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-20affaf0-6590-4004-a0c2-011e67ee0aec tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] 10.222.0.43 "GET /compute/v2.1/servers/d4abcd04-329d-40a8-8d6e-4383bef437ae" status: 200 len: 1343 microversion: 2.25 time: 0.339919 Oct 04 21:47:28.459718 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 549/1157] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:47:28 2022] GET /compute/v2.1/servers/d4abcd04-329d-40a8-8d6e-4383bef437ae => generated 1343 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:47:28.501074 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-c6d6f519-1003-4487-842e-d87fec50c996 req-0b57c188-cea5-4b0e-a6d5-beeba4b05981 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3968d68f-a421-4d08-8b67-b5410b618a47", "name": "network-vif-deleted", "tag": "43c59e39-3268-4c67-a16b-99af52e4bacf"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:47:28.553958 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-c6d6f519-1003-4487-842e-d87fec50c996 req-0b57c188-cea5-4b0e-a6d5-beeba4b05981 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:28.554975 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-c6d6f519-1003-4487-842e-d87fec50c996 req-0b57c188-cea5-4b0e-a6d5-beeba4b05981 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:28.557326 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-c6d6f519-1003-4487-842e-d87fec50c996 req-0b57c188-cea5-4b0e-a6d5-beeba4b05981 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:28.600121 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-c6d6f519-1003-4487-842e-d87fec50c996 req-0b57c188-cea5-4b0e-a6d5-beeba4b05981 service nova] Creating event network-vif-deleted:43c59e39-3268-4c67-a16b-99af52e4bacf for instance 3968d68f-a421-4d08-8b67-b5410b618a47 on n-h2-860284-1 Oct 04 21:47:28.618906 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-c6d6f519-1003-4487-842e-d87fec50c996 req-0b57c188-cea5-4b0e-a6d5-beeba4b05981 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.153261 Oct 04 21:47:28.624105 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 550/1158] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:47:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:47:28.641621 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-277599cb-0ed1-4b6a-bfa2-166f04a0f24d req-088cdf01-83eb-4e66-b853-7b6603c8d534 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e204d537-73b1-4070-a3f4-e0e3053e0639", "name": "network-vif-deleted", "tag": "e3daffcc-8395-4ccb-a2f3-5d37cce4823c"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:47:28.672919 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-277599cb-0ed1-4b6a-bfa2-166f04a0f24d req-088cdf01-83eb-4e66-b853-7b6603c8d534 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:28.675597 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-277599cb-0ed1-4b6a-bfa2-166f04a0f24d req-088cdf01-83eb-4e66-b853-7b6603c8d534 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:28.677839 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-277599cb-0ed1-4b6a-bfa2-166f04a0f24d req-088cdf01-83eb-4e66-b853-7b6603c8d534 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:28.701818 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-277599cb-0ed1-4b6a-bfa2-166f04a0f24d req-088cdf01-83eb-4e66-b853-7b6603c8d534 service nova] Creating event network-vif-deleted:e3daffcc-8395-4ccb-a2f3-5d37cce4823c for instance e204d537-73b1-4070-a3f4-e0e3053e0639 on n-h1-860284-1 Oct 04 21:47:28.720944 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-277599cb-0ed1-4b6a-bfa2-166f04a0f24d req-088cdf01-83eb-4e66-b853-7b6603c8d534 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086069 Oct 04 21:47:28.721493 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 551/1159] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:47:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:47:28.916829 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-fb945fe2-7ce7-4bf7-ae98-0d4123e84419 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87616cd16995468ab7febf5aa4b284db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e3bf9149434d34b6762aaeef1478ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:28.935750 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-fb945fe2-7ce7-4bf7-ae98-0d4123e84419 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] 10.222.0.43 "GET /compute/v2.1/servers/e3380b36-6aba-4736-bcbc-f0058f806d55" status: 200 len: 1472 microversion: 2.1 time: 0.924818 Oct 04 21:47:28.937755 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 609/1160] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:28 2022] GET /compute/v2.1/servers/e3380b36-6aba-4736-bcbc-f0058f806d55 => generated 1472 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:28.996305 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-41562939-e975-4a96-9f29-4aab393aa1da tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:28.997018 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-41562939-e975-4a96-9f29-4aab393aa1da tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: 424a22f0-ccc3-4fec-bf38-4aaf924928e3] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:29.004655 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-41562939-e975-4a96-9f29-4aab393aa1da tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:29.005151 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-41562939-e975-4a96-9f29-4aab393aa1da tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:29.014522 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-41562939-e975-4a96-9f29-4aab393aa1da tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:29.015206 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-41562939-e975-4a96-9f29-4aab393aa1da tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:29.023965 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-41562939-e975-4a96-9f29-4aab393aa1da tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:29.024567 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-eda7eaa1-31f8-4ad3-abd5-5f51818c5fd8 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:29.024726 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-41562939-e975-4a96-9f29-4aab393aa1da tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:29.025499 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-eda7eaa1-31f8-4ad3-abd5-5f51818c5fd8 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] [instance: 3968d68f-a421-4d08-8b67-b5410b618a47] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:29.036634 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-eda7eaa1-31f8-4ad3-abd5-5f51818c5fd8 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:29.037208 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-eda7eaa1-31f8-4ad3-abd5-5f51818c5fd8 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:29.038448 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-eda7eaa1-31f8-4ad3-abd5-5f51818c5fd8 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:29.039920 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-eda7eaa1-31f8-4ad3-abd5-5f51818c5fd8 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:29.041624 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-eda7eaa1-31f8-4ad3-abd5-5f51818c5fd8 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:29.042232 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-eda7eaa1-31f8-4ad3-abd5-5f51818c5fd8 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:29.105328 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-eda7eaa1-31f8-4ad3-abd5-5f51818c5fd8 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:29.105967 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-eda7eaa1-31f8-4ad3-abd5-5f51818c5fd8 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:29.106525 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-eda7eaa1-31f8-4ad3-abd5-5f51818c5fd8 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:29.107159 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.objects.instance [None req-eda7eaa1-31f8-4ad3-abd5-5f51818c5fd8 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lazy-loading 'fault' on Instance uuid 3968d68f-a421-4d08-8b67-b5410b618a47 {{(pid=134102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:47:29.304990 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-eda7eaa1-31f8-4ad3-abd5-5f51818c5fd8 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29842a669a20408b881105135f76cb0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39edf587afe94b60911198aa0bb61613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:29.329953 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-eda7eaa1-31f8-4ad3-abd5-5f51818c5fd8 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] 10.222.0.43 "GET /compute/v2.1/servers/3968d68f-a421-4d08-8b67-b5410b618a47" status: 200 len: 1308 microversion: 2.1 time: 0.310211 Oct 04 21:47:29.331898 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 610/1161] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:29 2022] GET /compute/v2.1/servers/3968d68f-a421-4d08-8b67-b5410b618a47 => generated 1308 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:47:29.350007 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-696f800f-5220-4367-abab-ae9d234f0ea4 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Calling method '.version_select at 0x7fbb2f0524c0>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:29.484004 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-696f800f-5220-4367-abab-ae9d234f0ea4 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] 10.222.0.43 "GET /compute/v2.1/images/ac8e9797-0b3b-4c06-9229-b4ac23c4312c" status: 200 len: 1422 microversion: 2.1 time: 0.150744 Oct 04 21:47:29.496508 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 611/1162] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:47:29 2022] GET /compute/v2.1/images/ac8e9797-0b3b-4c06-9229-b4ac23c4312c => generated 1422 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:29.515463 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-2adf7cd4-cbea-4aac-997e-e826e7220a17 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:29.533883 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-2adf7cd4-cbea-4aac-997e-e826e7220a17 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] [instance: d4abcd04-329d-40a8-8d6e-4383bef437ae] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:29.563847 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2adf7cd4-cbea-4aac-997e-e826e7220a17 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:29.565228 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2adf7cd4-cbea-4aac-997e-e826e7220a17 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:29.566113 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2adf7cd4-cbea-4aac-997e-e826e7220a17 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:29.568460 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2adf7cd4-cbea-4aac-997e-e826e7220a17 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:29.572109 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2adf7cd4-cbea-4aac-997e-e826e7220a17 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:29.572845 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2adf7cd4-cbea-4aac-997e-e826e7220a17 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:29.673293 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-41562939-e975-4a96-9f29-4aab393aa1da tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:29.688770 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-41562939-e975-4a96-9f29-4aab393aa1da tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/424a22f0-ccc3-4fec-bf38-4aaf924928e3" status: 200 len: 1541 microversion: 2.1 time: 0.696824 Oct 04 21:47:29.689663 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 552/1163] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:28 2022] GET /compute/v2.1/servers/424a22f0-ccc3-4fec-bf38-4aaf924928e3 => generated 1541 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:29.930737 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-2adf7cd4-cbea-4aac-997e-e826e7220a17 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:29.945046 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-2adf7cd4-cbea-4aac-997e-e826e7220a17 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:29.948480 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-2adf7cd4-cbea-4aac-997e-e826e7220a17 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:29.950654 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-2adf7cd4-cbea-4aac-997e-e826e7220a17 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] 10.222.0.43 "GET /compute/v2.1/servers/d4abcd04-329d-40a8-8d6e-4383bef437ae" status: 200 len: 1410 microversion: 2.25 time: 0.448003 Oct 04 21:47:29.963270 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-500b5db7-e849-424f-b4aa-70c33dd17b5d tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:29.964237 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-500b5db7-e849-424f-b4aa-70c33dd17b5d tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] [instance: e3380b36-6aba-4736-bcbc-f0058f806d55] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:29.967078 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 612/1164] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:47:29 2022] GET /compute/v2.1/servers/d4abcd04-329d-40a8-8d6e-4383bef437ae => generated 1410 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:47:29.982552 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-500b5db7-e849-424f-b4aa-70c33dd17b5d tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:29.989011 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-500b5db7-e849-424f-b4aa-70c33dd17b5d tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:29.996587 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-500b5db7-e849-424f-b4aa-70c33dd17b5d tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:29.997518 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-500b5db7-e849-424f-b4aa-70c33dd17b5d tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:29.998108 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-500b5db7-e849-424f-b4aa-70c33dd17b5d tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:29.999271 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-500b5db7-e849-424f-b4aa-70c33dd17b5d tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:30.251718 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-500b5db7-e849-424f-b4aa-70c33dd17b5d tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87616cd16995468ab7febf5aa4b284db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e3bf9149434d34b6762aaeef1478ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:30.260707 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-500b5db7-e849-424f-b4aa-70c33dd17b5d tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] 10.222.0.43 "GET /compute/v2.1/servers/e3380b36-6aba-4736-bcbc-f0058f806d55" status: 200 len: 1472 microversion: 2.1 time: 0.302384 Oct 04 21:47:30.267600 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 553/1165] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:29 2022] GET /compute/v2.1/servers/e3380b36-6aba-4736-bcbc-f0058f806d55 => generated 1472 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:30.353339 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-99a78589-03c5-448c-b3c4-1b30b3cc10e8 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:30.353886 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-99a78589-03c5-448c-b3c4-1b30b3cc10e8 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] [instance: 3968d68f-a421-4d08-8b67-b5410b618a47] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:30.372633 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-99a78589-03c5-448c-b3c4-1b30b3cc10e8 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:30.374842 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-99a78589-03c5-448c-b3c4-1b30b3cc10e8 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:30.376163 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-99a78589-03c5-448c-b3c4-1b30b3cc10e8 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:30.385718 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-99a78589-03c5-448c-b3c4-1b30b3cc10e8 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:30.386448 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-99a78589-03c5-448c-b3c4-1b30b3cc10e8 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:30.386913 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-99a78589-03c5-448c-b3c4-1b30b3cc10e8 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:30.408106 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-99a78589-03c5-448c-b3c4-1b30b3cc10e8 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] HTTP exception thrown: Instance 3968d68f-a421-4d08-8b67-b5410b618a47 could not be found. Oct 04 21:47:30.410957 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-99a78589-03c5-448c-b3c4-1b30b3cc10e8 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Request method failure captured: Oct 04 21:47:30.410957 n-d-860284-1 devstack@n-api.service[134102]: request: GET /compute/v2.1/servers/3968d68f-a421-4d08-8b67-b5410b618a47 HTTP/1.1 Oct 04 21:47:30.410957 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 21:47:30.410957 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 21:47:30.410957 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 21:47:30.410957 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 21:47:30.410957 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 21:47:30.410957 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 21:47:30.410957 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 21:47:30.410957 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 21:47:30.410957 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPKkKKWGhYvwCdv1J2MeGQ-jOAZuoGQ1lwAe198r71Ukwb_5umfLkuxNfZWiQHMUxBfhv-_5em_OANDxdq4CvMn57rB1IdcDSs2VQnXaxFUQOJQx2QIboBa8MD9AFC6JsgH39EDtpQDm0bx49UHlQ1MXYHpusDcMOOxl5o1LHadq_Xtg Oct 04 21:47:30.410957 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 21:47:30.410957 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 21:47:30.410957 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 21:47:30.410957 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 21:47:30.410957 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 21:47:30.410957 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 21:47:30.410957 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: 39edf587afe94b60911198aa0bb61613 Oct 04 21:47:30.410957 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-ServersOnMultiNodesTest-569263937 Oct 04 21:47:30.410957 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 21:47:30.410957 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 21:47:30.412319 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/39edf587afe94b60911198aa0bb61613"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_39edf587afe94b60911198aa0bb61613", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/39edf587afe94b60911198aa0bb61613"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/39edf587afe94b60911198aa0bb61613"}]}] Oct 04 21:47:30.412319 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-ServersOnMultiNodesTest-569263937 Oct 04 21:47:30.412319 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: 39edf587afe94b60911198aa0bb61613 Oct 04 21:47:30.412319 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-569263937 Oct 04 21:47:30.412319 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-ServersOnMultiNodesTest-569263937-project Oct 04 21:47:30.412319 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 21:47:30.412319 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 21:47:30.412319 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: 29842a669a20408b881105135f76cb0a Oct 04 21:47:30.412319 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-ServersOnMultiNodesTest-569263937-project Oct 04 21:47:30.412319 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 21:47:30.412319 n-d-860284-1 devstack@n-api.service[134102]: exception: Instance 3968d68f-a421-4d08-8b67-b5410b618a47 could not be found. Oct 04 21:47:30.412319 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': '3968d68f-a421-4d08-8b67-b5410b618a47'} Oct 04 21:47:30.413049 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:47:30.413049 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:47:30.413049 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:47:30.413049 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:47:30.413049 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:47:30.413049 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:47:30.413049 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:47:30.413049 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:47:30.413049 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:47:30.413049 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:47:30.413049 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3968d68f-a421-4d08-8b67-b5410b618a47 could not be found. Oct 04 21:47:30.413049 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:47:30.413049 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:47:30.413049 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:47:30.413049 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:47:30.413049 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:47:30.413049 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:47:30.413049 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:47:30.413049 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:47:30.413049 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:47:30.417826 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:47:30.417826 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:47:30.417826 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:47:30.417826 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:47:30.417826 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:47:30.417826 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:47:30.417826 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:47:30.417826 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3968d68f-a421-4d08-8b67-b5410b618a47 could not be found. Oct 04 21:47:30.417826 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:47:30.417826 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:47:30.417826 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:47:30.417826 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:47:30.417826 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:47:30.417826 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:47:30.417826 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:47:30.417826 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:47:30.417826 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3968d68f-a421-4d08-8b67-b5410b618a47 could not be found. Oct 04 21:47:30.417826 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:47:30.418909 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-99a78589-03c5-448c-b3c4-1b30b3cc10e8 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Returning 404 to user: Instance 3968d68f-a421-4d08-8b67-b5410b618a47 could not be found. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:47:30.418909 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-99a78589-03c5-448c-b3c4-1b30b3cc10e8 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] 10.222.0.43 "GET /compute/v2.1/servers/3968d68f-a421-4d08-8b67-b5410b618a47" status: 404 len: 111 microversion: 2.1 time: 0.063055 Oct 04 21:47:30.418909 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 613/1166] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:30 2022] GET /compute/v2.1/servers/3968d68f-a421-4d08-8b67-b5410b618a47 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 21:47:30.421815 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-887b6ac8-4ae7-4132-94d8-cc4ce7cd42a7 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:30.422450 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-887b6ac8-4ae7-4132-94d8-cc4ce7cd42a7 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] [instance: e204d537-73b1-4070-a3f4-e0e3053e0639] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:30.432290 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-887b6ac8-4ae7-4132-94d8-cc4ce7cd42a7 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:30.432795 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-887b6ac8-4ae7-4132-94d8-cc4ce7cd42a7 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:30.433234 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-887b6ac8-4ae7-4132-94d8-cc4ce7cd42a7 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:30.436089 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-887b6ac8-4ae7-4132-94d8-cc4ce7cd42a7 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:30.437955 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-887b6ac8-4ae7-4132-94d8-cc4ce7cd42a7 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:30.438397 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-887b6ac8-4ae7-4132-94d8-cc4ce7cd42a7 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:30.514259 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-5b64fb3d-fbff-4ee4-9191-d0bf6304ccf8 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Calling method '.version_select at 0x7fbb2f0735e0>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:30.520415 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-887b6ac8-4ae7-4132-94d8-cc4ce7cd42a7 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:30.521216 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-887b6ac8-4ae7-4132-94d8-cc4ce7cd42a7 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:30.521810 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-887b6ac8-4ae7-4132-94d8-cc4ce7cd42a7 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:30.522490 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.objects.instance [None req-887b6ac8-4ae7-4132-94d8-cc4ce7cd42a7 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lazy-loading 'fault' on Instance uuid e204d537-73b1-4070-a3f4-e0e3053e0639 {{(pid=134101) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:47:30.602913 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-5b64fb3d-fbff-4ee4-9191-d0bf6304ccf8 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] 10.222.0.43 "GET /compute/v2.1/images/ac8e9797-0b3b-4c06-9229-b4ac23c4312c" status: 200 len: 1422 microversion: 2.1 time: 0.093417 Oct 04 21:47:30.603953 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 614/1167] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:47:30 2022] GET /compute/v2.1/images/ac8e9797-0b3b-4c06-9229-b4ac23c4312c => generated 1422 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:30.616124 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-887b6ac8-4ae7-4132-94d8-cc4ce7cd42a7 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29842a669a20408b881105135f76cb0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39edf587afe94b60911198aa0bb61613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:30.628841 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-887b6ac8-4ae7-4132-94d8-cc4ce7cd42a7 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] 10.222.0.43 "GET /compute/v2.1/servers/e204d537-73b1-4070-a3f4-e0e3053e0639" status: 200 len: 1308 microversion: 2.1 time: 0.210742 Oct 04 21:47:30.629406 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 554/1168] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:30 2022] GET /compute/v2.1/servers/e204d537-73b1-4070-a3f4-e0e3053e0639 => generated 1308 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:30.718175 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-def7e2cc-7165-4334-b0ad-ae3870e2471e tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:30.719002 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-def7e2cc-7165-4334-b0ad-ae3870e2471e tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: 424a22f0-ccc3-4fec-bf38-4aaf924928e3] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:30.727602 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-def7e2cc-7165-4334-b0ad-ae3870e2471e tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:30.728506 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-def7e2cc-7165-4334-b0ad-ae3870e2471e tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:30.729666 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-def7e2cc-7165-4334-b0ad-ae3870e2471e tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:30.730903 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-def7e2cc-7165-4334-b0ad-ae3870e2471e tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:30.732380 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-def7e2cc-7165-4334-b0ad-ae3870e2471e tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:30.733281 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-def7e2cc-7165-4334-b0ad-ae3870e2471e tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:30.976473 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-09b54c09-71af-4542-9618-06cfe6f277f4 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:30.977348 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-09b54c09-71af-4542-9618-06cfe6f277f4 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] [instance: d4abcd04-329d-40a8-8d6e-4383bef437ae] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:30.986356 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-09b54c09-71af-4542-9618-06cfe6f277f4 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:30.987161 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-09b54c09-71af-4542-9618-06cfe6f277f4 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:30.987846 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-09b54c09-71af-4542-9618-06cfe6f277f4 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:30.988896 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-09b54c09-71af-4542-9618-06cfe6f277f4 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:30.989569 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-09b54c09-71af-4542-9618-06cfe6f277f4 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:30.991074 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-09b54c09-71af-4542-9618-06cfe6f277f4 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:31.018814 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-def7e2cc-7165-4334-b0ad-ae3870e2471e tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:31.030226 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-def7e2cc-7165-4334-b0ad-ae3870e2471e tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/424a22f0-ccc3-4fec-bf38-4aaf924928e3" status: 200 len: 1541 microversion: 2.1 time: 0.317952 Oct 04 21:47:31.030851 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 615/1169] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:30 2022] GET /compute/v2.1/servers/424a22f0-ccc3-4fec-bf38-4aaf924928e3 => generated 1541 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:31.158445 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-240db441-b1da-409c-b7dc-13dd9e62dbfa req-b75a84dc-e665-4e24-b848-866d970206b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4abcd04-329d-40a8-8d6e-4383bef437ae", "tag": "000d4b8f-4676-41c0-a0c8-303e63366262"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:47:31.189664 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-240db441-b1da-409c-b7dc-13dd9e62dbfa req-b75a84dc-e665-4e24-b848-866d970206b9 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:31.190630 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-240db441-b1da-409c-b7dc-13dd9e62dbfa req-b75a84dc-e665-4e24-b848-866d970206b9 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:31.192239 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-240db441-b1da-409c-b7dc-13dd9e62dbfa req-b75a84dc-e665-4e24-b848-866d970206b9 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:31.259152 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-240db441-b1da-409c-b7dc-13dd9e62dbfa req-b75a84dc-e665-4e24-b848-866d970206b9 service nova] Creating event network-changed:000d4b8f-4676-41c0-a0c8-303e63366262 for instance d4abcd04-329d-40a8-8d6e-4383bef437ae on n-h1-860284-1 Oct 04 21:47:31.338295 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-09b54c09-71af-4542-9618-06cfe6f277f4 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:31.353035 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-09b54c09-71af-4542-9618-06cfe6f277f4 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:31.354832 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-09b54c09-71af-4542-9618-06cfe6f277f4 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:31.356029 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-09b54c09-71af-4542-9618-06cfe6f277f4 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] 10.222.0.43 "GET /compute/v2.1/servers/d4abcd04-329d-40a8-8d6e-4383bef437ae" status: 200 len: 1410 microversion: 2.25 time: 0.384521 Oct 04 21:47:31.359461 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 555/1170] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:47:30 2022] GET /compute/v2.1/servers/d4abcd04-329d-40a8-8d6e-4383bef437ae => generated 1410 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:47:31.374162 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-bf6bd7cb-89b1-4e17-b8cd-ca1ed6b7b822 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:31.374824 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-bf6bd7cb-89b1-4e17-b8cd-ca1ed6b7b822 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] [instance: e3380b36-6aba-4736-bcbc-f0058f806d55] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:31.387895 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bf6bd7cb-89b1-4e17-b8cd-ca1ed6b7b822 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:31.388399 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bf6bd7cb-89b1-4e17-b8cd-ca1ed6b7b822 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:31.388839 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bf6bd7cb-89b1-4e17-b8cd-ca1ed6b7b822 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:31.389548 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bf6bd7cb-89b1-4e17-b8cd-ca1ed6b7b822 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:31.390005 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bf6bd7cb-89b1-4e17-b8cd-ca1ed6b7b822 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:31.390488 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bf6bd7cb-89b1-4e17-b8cd-ca1ed6b7b822 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:31.430180 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-240db441-b1da-409c-b7dc-13dd9e62dbfa req-b75a84dc-e665-4e24-b848-866d970206b9 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.276930 Oct 04 21:47:31.431023 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 616/1171] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:47:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:47:31.440714 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-140a5b5f-fc1a-4ff9-801a-063b707379f5 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1596405230", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452", "networks": [{"uuid": "7c037080-0b8b-4757-a710-31df9b3a21f4"}], "security_groups": [{"name": "tempest-securitygroup--5276825"}], "key_name": "tempest-keypair-1394490439", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:47:31.628443 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.network.neutron [None req-140a5b5f-fc1a-4ff9-801a-063b707379f5 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] validate_networks() for [('7c037080-0b8b-4757-a710-31df9b3a21f4', None, None, None, None, None)] {{(pid=134102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:47:31.729259 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-bf6bd7cb-89b1-4e17-b8cd-ca1ed6b7b822 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87616cd16995468ab7febf5aa4b284db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e3bf9149434d34b6762aaeef1478ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:31.745684 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-bf6bd7cb-89b1-4e17-b8cd-ca1ed6b7b822 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] 10.222.0.43 "GET /compute/v2.1/servers/e3380b36-6aba-4736-bcbc-f0058f806d55" status: 200 len: 1472 microversion: 2.1 time: 0.380974 Oct 04 21:47:31.748089 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 556/1172] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:31 2022] GET /compute/v2.1/servers/e3380b36-6aba-4736-bcbc-f0058f806d55 => generated 1472 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:31.757273 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-edf328c1-11bb-4ec1-97c2-eacbcc7cc990 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Calling method '.version_select at 0x7fbb2f234dc0>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:31.834886 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-edf328c1-11bb-4ec1-97c2-eacbcc7cc990 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] 10.222.0.43 "GET /compute/v2.1/images/ac8e9797-0b3b-4c06-9229-b4ac23c4312c" status: 200 len: 1422 microversion: 2.1 time: 0.083532 Oct 04 21:47:31.837097 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 557/1173] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:47:31 2022] GET /compute/v2.1/images/ac8e9797-0b3b-4c06-9229-b4ac23c4312c => generated 1422 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:31.848114 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-80654b93-4398-4348-8409-2fd5cba988e9 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:31.849165 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-80654b93-4398-4348-8409-2fd5cba988e9 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] [instance: e204d537-73b1-4070-a3f4-e0e3053e0639] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:31.856518 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-80654b93-4398-4348-8409-2fd5cba988e9 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:31.857671 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-80654b93-4398-4348-8409-2fd5cba988e9 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:31.858284 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-80654b93-4398-4348-8409-2fd5cba988e9 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:31.859219 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-80654b93-4398-4348-8409-2fd5cba988e9 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:31.859832 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-80654b93-4398-4348-8409-2fd5cba988e9 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:31.860654 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-80654b93-4398-4348-8409-2fd5cba988e9 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:31.869595 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=100 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:47:31.883893 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-80654b93-4398-4348-8409-2fd5cba988e9 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] HTTP exception thrown: Instance e204d537-73b1-4070-a3f4-e0e3053e0639 could not be found. Oct 04 21:47:31.886605 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-80654b93-4398-4348-8409-2fd5cba988e9 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Request method failure captured: Oct 04 21:47:31.886605 n-d-860284-1 devstack@n-api.service[134101]: request: GET /compute/v2.1/servers/e204d537-73b1-4070-a3f4-e0e3053e0639 HTTP/1.1 Oct 04 21:47:31.886605 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 21:47:31.886605 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 21:47:31.886605 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 21:47:31.886605 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 21:47:31.886605 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 21:47:31.886605 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 21:47:31.886605 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 21:47:31.886605 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 21:47:31.886605 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPKkKKWGhYvwCdv1J2MeGQ-jOAZuoGQ1lwAe198r71Ukwb_5umfLkuxNfZWiQHMUxBfhv-_5em_OANDxdq4CvMn57rB1IdcDSs2VQnXaxFUQOJQx2QIboBa8MD9AFC6JsgH39EDtpQDm0bx49UHlQ1MXYHpusDcMOOxl5o1LHadq_Xtg Oct 04 21:47:31.886605 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 21:47:31.886605 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 21:47:31.886605 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 21:47:31.886605 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 21:47:31.886605 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 21:47:31.886605 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 21:47:31.886605 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: 39edf587afe94b60911198aa0bb61613 Oct 04 21:47:31.886605 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-ServersOnMultiNodesTest-569263937 Oct 04 21:47:31.886605 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 21:47:31.886605 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 21:47:31.888237 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/39edf587afe94b60911198aa0bb61613"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_39edf587afe94b60911198aa0bb61613", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/39edf587afe94b60911198aa0bb61613"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/39edf587afe94b60911198aa0bb61613"}]}] Oct 04 21:47:31.888237 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-ServersOnMultiNodesTest-569263937 Oct 04 21:47:31.888237 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: 39edf587afe94b60911198aa0bb61613 Oct 04 21:47:31.888237 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-569263937 Oct 04 21:47:31.888237 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-ServersOnMultiNodesTest-569263937-project Oct 04 21:47:31.888237 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 21:47:31.888237 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 21:47:31.888237 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 29842a669a20408b881105135f76cb0a Oct 04 21:47:31.888237 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-ServersOnMultiNodesTest-569263937-project Oct 04 21:47:31.888237 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 21:47:31.888237 n-d-860284-1 devstack@n-api.service[134101]: exception: Instance e204d537-73b1-4070-a3f4-e0e3053e0639 could not be found. Oct 04 21:47:31.888237 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': 'e204d537-73b1-4070-a3f4-e0e3053e0639'} Oct 04 21:47:31.889121 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:47:31.889121 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:47:31.889121 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:47:31.889121 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:47:31.889121 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:47:31.889121 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:47:31.889121 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:47:31.889121 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:47:31.889121 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:47:31.889121 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:47:31.889121 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e204d537-73b1-4070-a3f4-e0e3053e0639 could not be found. Oct 04 21:47:31.889121 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:47:31.889121 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:47:31.889121 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:47:31.889121 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:47:31.889121 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:47:31.889121 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:47:31.889121 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:47:31.889121 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:47:31.889121 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:47:31.890671 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:47:31.890671 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:47:31.890671 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:47:31.890671 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:47:31.890671 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:47:31.890671 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:47:31.890671 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:47:31.890671 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e204d537-73b1-4070-a3f4-e0e3053e0639 could not be found. Oct 04 21:47:31.890671 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:47:31.890671 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:47:31.890671 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:47:31.890671 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:47:31.890671 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:47:31.890671 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:47:31.890671 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:47:31.890671 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:47:31.890671 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e204d537-73b1-4070-a3f4-e0e3053e0639 could not be found. Oct 04 21:47:31.890671 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:47:31.894410 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-80654b93-4398-4348-8409-2fd5cba988e9 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Returning 404 to user: Instance e204d537-73b1-4070-a3f4-e0e3053e0639 could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:47:31.895532 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-80654b93-4398-4348-8409-2fd5cba988e9 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] 10.222.0.43 "GET /compute/v2.1/servers/e204d537-73b1-4070-a3f4-e0e3053e0639" status: 404 len: 111 microversion: 2.1 time: 0.056804 Oct 04 21:47:31.897998 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 558/1174] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:31 2022] GET /compute/v2.1/servers/e204d537-73b1-4070-a3f4-e0e3053e0639 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:47:31.908529 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-0c5369ef-fa0f-47b3-bf16-6ef8800d5b59 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:31.946232 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-0c5369ef-fa0f-47b3-bf16-6ef8800d5b59 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] 10.222.0.43 "DELETE /compute/v2.1/os-server-groups/98988bff-2fca-46fa-8954-3dfc730df468" status: 204 len: 0 microversion: 2.1 time: 0.044034 Oct 04 21:47:31.948470 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 559/1175] 10.222.0.43 () {58 vars in 1266 bytes} [Tue Oct 4 21:47:31 2022] DELETE /compute/v2.1/os-server-groups/98988bff-2fca-46fa-8954-3dfc730df468 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 21:47:31.956065 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-5e0bad6a-ed7a-4609-8830-a6dd64501e6c tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:31.956909 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-5e0bad6a-ed7a-4609-8830-a6dd64501e6c tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] [instance: 7d71d6d3-3a63-406b-ac49-3e83bd539cf9] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:31.964709 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5e0bad6a-ed7a-4609-8830-a6dd64501e6c tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:31.965311 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5e0bad6a-ed7a-4609-8830-a6dd64501e6c tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:31.965869 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5e0bad6a-ed7a-4609-8830-a6dd64501e6c tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:31.966736 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5e0bad6a-ed7a-4609-8830-a6dd64501e6c tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:31.967210 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5e0bad6a-ed7a-4609-8830-a6dd64501e6c tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:31.967649 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5e0bad6a-ed7a-4609-8830-a6dd64501e6c tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:32.001645 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-5e0bad6a-ed7a-4609-8830-a6dd64501e6c tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] [instance: 7d71d6d3-3a63-406b-ac49-3e83bd539cf9] Going to try to terminate instance {{(pid=134101) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:47:32.099978 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-5e0bad6a-ed7a-4609-8830-a6dd64501e6c tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] 10.222.0.43 "DELETE /compute/v2.1/servers/7d71d6d3-3a63-406b-ac49-3e83bd539cf9" status: 204 len: 0 microversion: 2.1 time: 0.147357 Oct 04 21:47:32.100933 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 560/1176] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 21:47:31 2022] DELETE /compute/v2.1/servers/7d71d6d3-3a63-406b-ac49-3e83bd539cf9 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 21:47:32.108326 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-78a5a8ef-4c56-422d-a9ad-1727e826c81e tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:32.109301 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-78a5a8ef-4c56-422d-a9ad-1727e826c81e tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: 424a22f0-ccc3-4fec-bf38-4aaf924928e3] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:32.117021 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-78a5a8ef-4c56-422d-a9ad-1727e826c81e tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:32.117795 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-78a5a8ef-4c56-422d-a9ad-1727e826c81e tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:32.118406 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-78a5a8ef-4c56-422d-a9ad-1727e826c81e tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:32.119342 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-78a5a8ef-4c56-422d-a9ad-1727e826c81e tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:32.119951 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-78a5a8ef-4c56-422d-a9ad-1727e826c81e tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:32.120698 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-78a5a8ef-4c56-422d-a9ad-1727e826c81e tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:32.227550 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-140a5b5f-fc1a-4ff9-801a-063b707379f5 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Flavor limits 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:47:32.228073 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-140a5b5f-fc1a-4ff9-801a-063b707379f5 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Image limits 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:47:32.228451 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-140a5b5f-fc1a-4ff9-801a-063b707379f5 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Flavor pref 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:47:32.228900 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-140a5b5f-fc1a-4ff9-801a-063b707379f5 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Image pref 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:47:32.229319 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-140a5b5f-fc1a-4ff9-801a-063b707379f5 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:47:32.232599 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:UPDATE=2 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:47:32.245221 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-140a5b5f-fc1a-4ff9-801a-063b707379f5 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:32.246636 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-140a5b5f-fc1a-4ff9-801a-063b707379f5 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:32.246636 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-140a5b5f-fc1a-4ff9-801a-063b707379f5 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:32.247113 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-140a5b5f-fc1a-4ff9-801a-063b707379f5 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:32.247572 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-140a5b5f-fc1a-4ff9-801a-063b707379f5 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:32.248027 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-140a5b5f-fc1a-4ff9-801a-063b707379f5 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:32.267635 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-140a5b5f-fc1a-4ff9-801a-063b707379f5 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Getting quotas for project 78dcfc7024fc49388c4bd5f25f03e60d. Resources: {'instances', 'ram', 'cores'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:47:32.274131 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-140a5b5f-fc1a-4ff9-801a-063b707379f5 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Getting quotas for user bb7ad048becf474fb972d4291422d810 and project 78dcfc7024fc49388c4bd5f25f03e60d. Resources: {'instances', 'ram', 'cores'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:47:32.287973 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-140a5b5f-fc1a-4ff9-801a-063b707379f5 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Going to run 1 instances... {{(pid=134102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:47:32.290701 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-140a5b5f-fc1a-4ff9-801a-063b707379f5 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 3f0a02bc-7993-4849-8b3c-7572327b4799] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='58548514-5dac-426c-81f5-19e3fba33e23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:47:32.293460 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-78a5a8ef-4c56-422d-a9ad-1727e826c81e tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:32.301777 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-78a5a8ef-4c56-422d-a9ad-1727e826c81e tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/424a22f0-ccc3-4fec-bf38-4aaf924928e3" status: 200 len: 1541 microversion: 2.1 time: 0.199220 Oct 04 21:47:32.303354 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 561/1177] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:32 2022] GET /compute/v2.1/servers/424a22f0-ccc3-4fec-bf38-4aaf924928e3 => generated 1541 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:32.308163 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-c4f1556a-7719-4f2e-8852-99153b003dff tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:32.308626 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-c4f1556a-7719-4f2e-8852-99153b003dff tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] [instance: 258bc0cb-6718-4f8b-8d0b-ef544b2b659b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:32.315901 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c4f1556a-7719-4f2e-8852-99153b003dff tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:32.316411 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c4f1556a-7719-4f2e-8852-99153b003dff tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:32.316836 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c4f1556a-7719-4f2e-8852-99153b003dff tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:32.317555 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c4f1556a-7719-4f2e-8852-99153b003dff tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:32.318637 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c4f1556a-7719-4f2e-8852-99153b003dff tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:32.319062 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c4f1556a-7719-4f2e-8852-99153b003dff tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:32.341885 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-140a5b5f-fc1a-4ff9-801a-063b707379f5 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.909270 Oct 04 21:47:32.342941 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 617/1178] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 21:47:31 2022] POST /compute/v2.1/servers => generated 403 bytes in 911 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:47:32.348045 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-c4f1556a-7719-4f2e-8852-99153b003dff tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] [instance: 258bc0cb-6718-4f8b-8d0b-ef544b2b659b] Going to try to terminate instance {{(pid=134101) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:47:32.353787 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-6f24f8f5-6548-4423-bf36-f2159c6595a3 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:32.355296 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-6f24f8f5-6548-4423-bf36-f2159c6595a3 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 3f0a02bc-7993-4849-8b3c-7572327b4799] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:32.416742 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-6f24f8f5-6548-4423-bf36-f2159c6595a3 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ad048becf474fb972d4291422d810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dcfc7024fc49388c4bd5f25f03e60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:32.426842 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-6f24f8f5-6548-4423-bf36-f2159c6595a3 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/3f0a02bc-7993-4849-8b3c-7572327b4799" status: 200 len: 1235 microversion: 2.1 time: 0.076483 Oct 04 21:47:32.428186 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 618/1179] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:32 2022] GET /compute/v2.1/servers/3f0a02bc-7993-4849-8b3c-7572327b4799 => generated 1235 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:47:32.435786 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-dc62cd2b-fd25-4056-bbf9-f7ca20c93599 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:32.436387 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-dc62cd2b-fd25-4056-bbf9-f7ca20c93599 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] [instance: d4abcd04-329d-40a8-8d6e-4383bef437ae] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:32.444991 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dc62cd2b-fd25-4056-bbf9-f7ca20c93599 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:32.445544 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dc62cd2b-fd25-4056-bbf9-f7ca20c93599 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:32.446031 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dc62cd2b-fd25-4056-bbf9-f7ca20c93599 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:32.447077 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dc62cd2b-fd25-4056-bbf9-f7ca20c93599 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:32.447856 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dc62cd2b-fd25-4056-bbf9-f7ca20c93599 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:32.448711 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dc62cd2b-fd25-4056-bbf9-f7ca20c93599 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:32.454040 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-c4f1556a-7719-4f2e-8852-99153b003dff tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] 10.222.0.43 "DELETE /compute/v2.1/servers/258bc0cb-6718-4f8b-8d0b-ef544b2b659b" status: 204 len: 0 microversion: 2.1 time: 0.149379 Oct 04 21:47:32.455794 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 562/1180] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 21:47:32 2022] DELETE /compute/v2.1/servers/258bc0cb-6718-4f8b-8d0b-ef544b2b659b => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:47:32.464101 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-da6fcdd4-11a2-4990-88a5-6740cc569a99 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:32.464808 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-da6fcdd4-11a2-4990-88a5-6740cc569a99 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] [instance: 7d71d6d3-3a63-406b-ac49-3e83bd539cf9] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:32.471478 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-da6fcdd4-11a2-4990-88a5-6740cc569a99 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:32.472286 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-da6fcdd4-11a2-4990-88a5-6740cc569a99 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:32.472431 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-da6fcdd4-11a2-4990-88a5-6740cc569a99 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:32.473164 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-da6fcdd4-11a2-4990-88a5-6740cc569a99 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:32.473614 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-da6fcdd4-11a2-4990-88a5-6740cc569a99 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:32.474064 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-da6fcdd4-11a2-4990-88a5-6740cc569a99 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:32.669442 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-dc62cd2b-fd25-4056-bbf9-f7ca20c93599 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:32.672282 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-da6fcdd4-11a2-4990-88a5-6740cc569a99 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29842a669a20408b881105135f76cb0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39edf587afe94b60911198aa0bb61613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:32.680438 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-dc62cd2b-fd25-4056-bbf9-f7ca20c93599 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:32.681211 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-da6fcdd4-11a2-4990-88a5-6740cc569a99 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] 10.222.0.43 "GET /compute/v2.1/servers/7d71d6d3-3a63-406b-ac49-3e83bd539cf9" status: 200 len: 1473 microversion: 2.1 time: 0.221552 Oct 04 21:47:32.681786 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 563/1181] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:32 2022] GET /compute/v2.1/servers/7d71d6d3-3a63-406b-ac49-3e83bd539cf9 => generated 1473 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:32.682078 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-dc62cd2b-fd25-4056-bbf9-f7ca20c93599 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:32.683457 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-dc62cd2b-fd25-4056-bbf9-f7ca20c93599 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] 10.222.0.43 "GET /compute/v2.1/servers/d4abcd04-329d-40a8-8d6e-4383bef437ae" status: 200 len: 1410 microversion: 2.25 time: 0.251719 Oct 04 21:47:32.684127 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 619/1182] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:47:32 2022] GET /compute/v2.1/servers/d4abcd04-329d-40a8-8d6e-4383bef437ae => generated 1410 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:47:32.781274 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-3d40aa9e-1539-4f58-9bee-af5fb5aa1319 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:32.781984 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-3d40aa9e-1539-4f58-9bee-af5fb5aa1319 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] [instance: e3380b36-6aba-4736-bcbc-f0058f806d55] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:32.788270 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3d40aa9e-1539-4f58-9bee-af5fb5aa1319 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:32.788844 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3d40aa9e-1539-4f58-9bee-af5fb5aa1319 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:32.789359 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3d40aa9e-1539-4f58-9bee-af5fb5aa1319 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:32.790074 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3d40aa9e-1539-4f58-9bee-af5fb5aa1319 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:32.790567 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3d40aa9e-1539-4f58-9bee-af5fb5aa1319 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:32.791004 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3d40aa9e-1539-4f58-9bee-af5fb5aa1319 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:32.851222 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-aedc9354-a943-48ea-a03d-ee0fc002a643 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Calling method '.version_select at 0x7fbb2f19e550>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:32.899169 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-aedc9354-a943-48ea-a03d-ee0fc002a643 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] 10.222.0.43 "GET /compute/v2.1/images/ac8e9797-0b3b-4c06-9229-b4ac23c4312c" status: 200 len: 1431 microversion: 2.1 time: 0.051644 Oct 04 21:47:32.899787 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 620/1183] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:47:32 2022] GET /compute/v2.1/images/ac8e9797-0b3b-4c06-9229-b4ac23c4312c => generated 1431 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:47:32.913653 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-fb5296c4-0888-4a9b-a306-a4b83a3ad59a tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Calling method '.version_select at 0x7fbb2f0a9f70>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:32.931727 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-3d40aa9e-1539-4f58-9bee-af5fb5aa1319 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87616cd16995468ab7febf5aa4b284db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e3bf9149434d34b6762aaeef1478ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:32.939826 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-3d40aa9e-1539-4f58-9bee-af5fb5aa1319 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] 10.222.0.43 "GET /compute/v2.1/servers/e3380b36-6aba-4736-bcbc-f0058f806d55" status: 200 len: 1472 microversion: 2.1 time: 0.162514 Oct 04 21:47:32.940414 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 564/1184] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:32 2022] GET /compute/v2.1/servers/e3380b36-6aba-4736-bcbc-f0058f806d55 => generated 1472 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:32.963674 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-fb5296c4-0888-4a9b-a306-a4b83a3ad59a tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] 10.222.0.43 "GET /compute/v2.1/images/ac8e9797-0b3b-4c06-9229-b4ac23c4312c" status: 200 len: 1431 microversion: 2.1 time: 0.054016 Oct 04 21:47:32.964258 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 621/1185] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:47:32 2022] GET /compute/v2.1/images/ac8e9797-0b3b-4c06-9229-b4ac23c4312c => generated 1431 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:47:32.977749 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-cde75665-45fb-4e32-8eae-add64029b615 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:32.978351 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-cde75665-45fb-4e32-8eae-add64029b615 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] [instance: 59a1880f-2802-4e72-9a17-b966cfec8fe9] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:32.984248 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cde75665-45fb-4e32-8eae-add64029b615 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:32.984726 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cde75665-45fb-4e32-8eae-add64029b615 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:32.985160 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cde75665-45fb-4e32-8eae-add64029b615 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:32.985846 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cde75665-45fb-4e32-8eae-add64029b615 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:32.986292 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cde75665-45fb-4e32-8eae-add64029b615 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:32.986738 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cde75665-45fb-4e32-8eae-add64029b615 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:33.116568 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-cde75665-45fb-4e32-8eae-add64029b615 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7614aeaedd1947b88031fb55ca4783ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00081ff1d1aa41cbad345326b337093a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:33.124710 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-cde75665-45fb-4e32-8eae-add64029b615 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] 10.222.0.43 "GET /compute/v2.1/servers/59a1880f-2802-4e72-9a17-b966cfec8fe9" status: 200 len: 1479 microversion: 2.1 time: 0.150721 Oct 04 21:47:33.125297 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 565/1186] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:32 2022] GET /compute/v2.1/servers/59a1880f-2802-4e72-9a17-b966cfec8fe9 => generated 1479 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:33.327661 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-5348691a-4765-4133-8941-f6bbf9347b3b tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:33.328354 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-5348691a-4765-4133-8941-f6bbf9347b3b tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: 424a22f0-ccc3-4fec-bf38-4aaf924928e3] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:33.335776 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5348691a-4765-4133-8941-f6bbf9347b3b tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:33.336273 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5348691a-4765-4133-8941-f6bbf9347b3b tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:33.336712 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5348691a-4765-4133-8941-f6bbf9347b3b tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:33.337440 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5348691a-4765-4133-8941-f6bbf9347b3b tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:33.337901 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5348691a-4765-4133-8941-f6bbf9347b3b tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:33.338332 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5348691a-4765-4133-8941-f6bbf9347b3b tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:33.449797 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-7fa60465-47fa-42a1-86c9-82bf7e941262 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:33.450443 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-7fa60465-47fa-42a1-86c9-82bf7e941262 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 3f0a02bc-7993-4849-8b3c-7572327b4799] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:33.456889 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7fa60465-47fa-42a1-86c9-82bf7e941262 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:33.457383 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7fa60465-47fa-42a1-86c9-82bf7e941262 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:33.457825 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7fa60465-47fa-42a1-86c9-82bf7e941262 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:33.459097 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7fa60465-47fa-42a1-86c9-82bf7e941262 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:33.459563 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7fa60465-47fa-42a1-86c9-82bf7e941262 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:33.460010 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7fa60465-47fa-42a1-86c9-82bf7e941262 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:33.480088 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-5348691a-4765-4133-8941-f6bbf9347b3b tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:33.488178 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-5348691a-4765-4133-8941-f6bbf9347b3b tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/424a22f0-ccc3-4fec-bf38-4aaf924928e3" status: 200 len: 1541 microversion: 2.1 time: 0.164478 Oct 04 21:47:33.488758 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 622/1187] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:33 2022] GET /compute/v2.1/servers/424a22f0-ccc3-4fec-bf38-4aaf924928e3 => generated 1541 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:33.520467 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-7fa60465-47fa-42a1-86c9-82bf7e941262 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ad048becf474fb972d4291422d810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dcfc7024fc49388c4bd5f25f03e60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:33.528902 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-7fa60465-47fa-42a1-86c9-82bf7e941262 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/3f0a02bc-7993-4849-8b3c-7572327b4799" status: 200 len: 1239 microversion: 2.1 time: 0.083057 Oct 04 21:47:33.529474 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 566/1188] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:33 2022] GET /compute/v2.1/servers/3f0a02bc-7993-4849-8b3c-7572327b4799 => generated 1239 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:47:33.705396 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-0ec3fd74-a36a-418f-915e-373b5aa49245 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:33.705931 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-0ec3fd74-a36a-418f-915e-373b5aa49245 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] [instance: 7d71d6d3-3a63-406b-ac49-3e83bd539cf9] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:33.708973 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-b2e67093-9012-4a18-bd54-4cdc79a2e758 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:33.709937 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-b2e67093-9012-4a18-bd54-4cdc79a2e758 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] [instance: d4abcd04-329d-40a8-8d6e-4383bef437ae] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:33.713943 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0ec3fd74-a36a-418f-915e-373b5aa49245 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:33.714460 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0ec3fd74-a36a-418f-915e-373b5aa49245 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:33.715991 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0ec3fd74-a36a-418f-915e-373b5aa49245 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:33.715991 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0ec3fd74-a36a-418f-915e-373b5aa49245 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:33.716247 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0ec3fd74-a36a-418f-915e-373b5aa49245 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:33.716602 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0ec3fd74-a36a-418f-915e-373b5aa49245 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:33.716790 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b2e67093-9012-4a18-bd54-4cdc79a2e758 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:33.717283 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b2e67093-9012-4a18-bd54-4cdc79a2e758 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:33.717832 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b2e67093-9012-4a18-bd54-4cdc79a2e758 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:33.718510 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b2e67093-9012-4a18-bd54-4cdc79a2e758 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:33.718970 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b2e67093-9012-4a18-bd54-4cdc79a2e758 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:33.719399 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b2e67093-9012-4a18-bd54-4cdc79a2e758 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:33.736217 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:47:33.922483 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-0ec3fd74-a36a-418f-915e-373b5aa49245 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29842a669a20408b881105135f76cb0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39edf587afe94b60911198aa0bb61613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:33.925716 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-b2e67093-9012-4a18-bd54-4cdc79a2e758 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:33.930717 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-0ec3fd74-a36a-418f-915e-373b5aa49245 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] 10.222.0.43 "GET /compute/v2.1/servers/7d71d6d3-3a63-406b-ac49-3e83bd539cf9" status: 200 len: 1473 microversion: 2.1 time: 0.229333 Oct 04 21:47:33.931313 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 623/1189] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:33 2022] GET /compute/v2.1/servers/7d71d6d3-3a63-406b-ac49-3e83bd539cf9 => generated 1473 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:33.934575 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-b2e67093-9012-4a18-bd54-4cdc79a2e758 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:33.936026 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-b2e67093-9012-4a18-bd54-4cdc79a2e758 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:33.937140 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-b2e67093-9012-4a18-bd54-4cdc79a2e758 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] 10.222.0.43 "GET /compute/v2.1/servers/d4abcd04-329d-40a8-8d6e-4383bef437ae" status: 200 len: 1410 microversion: 2.25 time: 0.232654 Oct 04 21:47:33.937686 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 567/1190] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:47:33 2022] GET /compute/v2.1/servers/d4abcd04-329d-40a8-8d6e-4383bef437ae => generated 1410 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:47:33.964066 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-507bbe4a-5756-4ab1-863d-23b9d67381b4 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:33.964621 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-507bbe4a-5756-4ab1-863d-23b9d67381b4 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] [instance: e3380b36-6aba-4736-bcbc-f0058f806d55] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:33.970536 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-507bbe4a-5756-4ab1-863d-23b9d67381b4 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:33.971040 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-507bbe4a-5756-4ab1-863d-23b9d67381b4 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:33.971470 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-507bbe4a-5756-4ab1-863d-23b9d67381b4 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:33.972149 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-507bbe4a-5756-4ab1-863d-23b9d67381b4 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:33.972595 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-507bbe4a-5756-4ab1-863d-23b9d67381b4 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:33.973011 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-507bbe4a-5756-4ab1-863d-23b9d67381b4 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:34.105179 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-507bbe4a-5756-4ab1-863d-23b9d67381b4 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87616cd16995468ab7febf5aa4b284db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e3bf9149434d34b6762aaeef1478ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:34.112930 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-507bbe4a-5756-4ab1-863d-23b9d67381b4 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] 10.222.0.43 "GET /compute/v2.1/servers/e3380b36-6aba-4736-bcbc-f0058f806d55" status: 200 len: 1472 microversion: 2.1 time: 0.152797 Oct 04 21:47:34.113509 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 624/1191] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:33 2022] GET /compute/v2.1/servers/e3380b36-6aba-4736-bcbc-f0058f806d55 => generated 1472 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:34.148224 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-cc4e6274-c86a-4550-af2a-558c57006b6d tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:34.148841 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-cc4e6274-c86a-4550-af2a-558c57006b6d tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] [instance: 59a1880f-2802-4e72-9a17-b966cfec8fe9] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:34.154956 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cc4e6274-c86a-4550-af2a-558c57006b6d tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:34.155441 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cc4e6274-c86a-4550-af2a-558c57006b6d tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:34.155879 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cc4e6274-c86a-4550-af2a-558c57006b6d tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:34.156575 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cc4e6274-c86a-4550-af2a-558c57006b6d tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:34.157030 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cc4e6274-c86a-4550-af2a-558c57006b6d tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:34.157456 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cc4e6274-c86a-4550-af2a-558c57006b6d tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:34.288284 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-cc4e6274-c86a-4550-af2a-558c57006b6d tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7614aeaedd1947b88031fb55ca4783ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00081ff1d1aa41cbad345326b337093a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:34.296011 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-cc4e6274-c86a-4550-af2a-558c57006b6d tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] 10.222.0.43 "GET /compute/v2.1/servers/59a1880f-2802-4e72-9a17-b966cfec8fe9" status: 200 len: 1479 microversion: 2.1 time: 0.152249 Oct 04 21:47:34.297085 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 568/1192] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:34 2022] GET /compute/v2.1/servers/59a1880f-2802-4e72-9a17-b966cfec8fe9 => generated 1479 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:34.511373 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-b7828474-7beb-4e2a-842b-0c36673b932d tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:34.512034 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-b7828474-7beb-4e2a-842b-0c36673b932d tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: 424a22f0-ccc3-4fec-bf38-4aaf924928e3] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:34.518073 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b7828474-7beb-4e2a-842b-0c36673b932d tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:34.518618 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b7828474-7beb-4e2a-842b-0c36673b932d tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:34.519059 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b7828474-7beb-4e2a-842b-0c36673b932d tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:34.519791 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b7828474-7beb-4e2a-842b-0c36673b932d tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:34.520249 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b7828474-7beb-4e2a-842b-0c36673b932d tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:34.520688 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b7828474-7beb-4e2a-842b-0c36673b932d tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:34.550936 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-142b6014-3582-4055-ad57-ca13bcbf40b5 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:34.551660 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-142b6014-3582-4055-ad57-ca13bcbf40b5 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 3f0a02bc-7993-4849-8b3c-7572327b4799] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:34.558417 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-142b6014-3582-4055-ad57-ca13bcbf40b5 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:34.558919 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-142b6014-3582-4055-ad57-ca13bcbf40b5 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:34.559363 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-142b6014-3582-4055-ad57-ca13bcbf40b5 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:34.560073 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-142b6014-3582-4055-ad57-ca13bcbf40b5 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:34.560533 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-142b6014-3582-4055-ad57-ca13bcbf40b5 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:34.560998 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-142b6014-3582-4055-ad57-ca13bcbf40b5 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:34.633105 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-142b6014-3582-4055-ad57-ca13bcbf40b5 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ad048becf474fb972d4291422d810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dcfc7024fc49388c4bd5f25f03e60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:34.641001 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-142b6014-3582-4055-ad57-ca13bcbf40b5 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/3f0a02bc-7993-4849-8b3c-7572327b4799" status: 200 len: 1239 microversion: 2.1 time: 0.093962 Oct 04 21:47:34.641770 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 569/1193] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:34 2022] GET /compute/v2.1/servers/3f0a02bc-7993-4849-8b3c-7572327b4799 => generated 1239 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:47:34.674755 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-b7828474-7beb-4e2a-842b-0c36673b932d tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:34.683025 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-b7828474-7beb-4e2a-842b-0c36673b932d tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/424a22f0-ccc3-4fec-bf38-4aaf924928e3" status: 200 len: 1541 microversion: 2.1 time: 0.175545 Oct 04 21:47:34.683630 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 625/1194] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:34 2022] GET /compute/v2.1/servers/424a22f0-ccc3-4fec-bf38-4aaf924928e3 => generated 1541 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:34.954889 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-15e22cab-45c7-493a-aa88-fb93c1105182 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:34.955708 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-15e22cab-45c7-493a-aa88-fb93c1105182 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] [instance: 7d71d6d3-3a63-406b-ac49-3e83bd539cf9] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:34.962558 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-15e22cab-45c7-493a-aa88-fb93c1105182 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:34.963052 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-15e22cab-45c7-493a-aa88-fb93c1105182 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:34.963303 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-44adf2a3-3b60-44b1-ab55-704494e7fdf9 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:34.963502 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-15e22cab-45c7-493a-aa88-fb93c1105182 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:34.963925 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-44adf2a3-3b60-44b1-ab55-704494e7fdf9 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] [instance: d4abcd04-329d-40a8-8d6e-4383bef437ae] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:34.964208 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-15e22cab-45c7-493a-aa88-fb93c1105182 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:34.964670 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-15e22cab-45c7-493a-aa88-fb93c1105182 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:34.965101 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-15e22cab-45c7-493a-aa88-fb93c1105182 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:34.970413 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-44adf2a3-3b60-44b1-ab55-704494e7fdf9 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:34.970901 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-44adf2a3-3b60-44b1-ab55-704494e7fdf9 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:34.971335 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-44adf2a3-3b60-44b1-ab55-704494e7fdf9 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:34.972033 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-44adf2a3-3b60-44b1-ab55-704494e7fdf9 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:34.972492 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-44adf2a3-3b60-44b1-ab55-704494e7fdf9 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:34.972928 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-44adf2a3-3b60-44b1-ab55-704494e7fdf9 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:35.378451 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-15e22cab-45c7-493a-aa88-fb93c1105182 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29842a669a20408b881105135f76cb0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39edf587afe94b60911198aa0bb61613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:35.381785 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-44adf2a3-3b60-44b1-ab55-704494e7fdf9 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:35.386683 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-15e22cab-45c7-493a-aa88-fb93c1105182 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] 10.222.0.43 "GET /compute/v2.1/servers/7d71d6d3-3a63-406b-ac49-3e83bd539cf9" status: 200 len: 1473 microversion: 2.1 time: 0.436074 Oct 04 21:47:35.387314 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 570/1195] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:34 2022] GET /compute/v2.1/servers/7d71d6d3-3a63-406b-ac49-3e83bd539cf9 => generated 1473 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:35.390563 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-44adf2a3-3b60-44b1-ab55-704494e7fdf9 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:35.391662 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-3b5dbcc6-0cf6-4193-bd4d-123ba8e37893 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:35.391982 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-44adf2a3-3b60-44b1-ab55-704494e7fdf9 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:35.392266 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-3b5dbcc6-0cf6-4193-bd4d-123ba8e37893 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] [instance: e3380b36-6aba-4736-bcbc-f0058f806d55] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:35.393106 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-44adf2a3-3b60-44b1-ab55-704494e7fdf9 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] 10.222.0.43 "GET /compute/v2.1/servers/d4abcd04-329d-40a8-8d6e-4383bef437ae" status: 200 len: 1410 microversion: 2.25 time: 0.434043 Oct 04 21:47:35.393926 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 626/1196] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:47:34 2022] GET /compute/v2.1/servers/d4abcd04-329d-40a8-8d6e-4383bef437ae => generated 1410 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:47:35.401018 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-f8d5c8da-4469-4cd1-8173-7c363cdb59d1 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:35.401192 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3b5dbcc6-0cf6-4193-bd4d-123ba8e37893 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:35.401192 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3b5dbcc6-0cf6-4193-bd4d-123ba8e37893 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:35.401373 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-f8d5c8da-4469-4cd1-8173-7c363cdb59d1 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] [instance: 59a1880f-2802-4e72-9a17-b966cfec8fe9] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:35.401456 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3b5dbcc6-0cf6-4193-bd4d-123ba8e37893 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:35.401456 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3b5dbcc6-0cf6-4193-bd4d-123ba8e37893 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:35.401456 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3b5dbcc6-0cf6-4193-bd4d-123ba8e37893 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:35.401456 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3b5dbcc6-0cf6-4193-bd4d-123ba8e37893 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:35.407045 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f8d5c8da-4469-4cd1-8173-7c363cdb59d1 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:35.407517 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f8d5c8da-4469-4cd1-8173-7c363cdb59d1 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:35.407957 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f8d5c8da-4469-4cd1-8173-7c363cdb59d1 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:35.408699 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f8d5c8da-4469-4cd1-8173-7c363cdb59d1 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:35.409188 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f8d5c8da-4469-4cd1-8173-7c363cdb59d1 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:35.409614 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f8d5c8da-4469-4cd1-8173-7c363cdb59d1 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:35.604401 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-3b5dbcc6-0cf6-4193-bd4d-123ba8e37893 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87616cd16995468ab7febf5aa4b284db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e3bf9149434d34b6762aaeef1478ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:35.608567 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-f8d5c8da-4469-4cd1-8173-7c363cdb59d1 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7614aeaedd1947b88031fb55ca4783ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00081ff1d1aa41cbad345326b337093a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:35.612289 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-3b5dbcc6-0cf6-4193-bd4d-123ba8e37893 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] 10.222.0.43 "GET /compute/v2.1/servers/e3380b36-6aba-4736-bcbc-f0058f806d55" status: 200 len: 1472 microversion: 2.1 time: 0.224113 Oct 04 21:47:35.612864 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 571/1197] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:35 2022] GET /compute/v2.1/servers/e3380b36-6aba-4736-bcbc-f0058f806d55 => generated 1472 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:35.616934 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-f8d5c8da-4469-4cd1-8173-7c363cdb59d1 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] 10.222.0.43 "GET /compute/v2.1/servers/59a1880f-2802-4e72-9a17-b966cfec8fe9" status: 200 len: 1479 microversion: 2.1 time: 0.221999 Oct 04 21:47:35.617621 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 627/1198] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:35 2022] GET /compute/v2.1/servers/59a1880f-2802-4e72-9a17-b966cfec8fe9 => generated 1479 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:35.664878 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-1df8221f-c464-406f-bf81-ff9c9496bff5 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:35.665418 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-1df8221f-c464-406f-bf81-ff9c9496bff5 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 3f0a02bc-7993-4849-8b3c-7572327b4799] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:35.671786 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1df8221f-c464-406f-bf81-ff9c9496bff5 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:35.672273 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1df8221f-c464-406f-bf81-ff9c9496bff5 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:35.672715 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1df8221f-c464-406f-bf81-ff9c9496bff5 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:35.673410 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1df8221f-c464-406f-bf81-ff9c9496bff5 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:35.673874 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1df8221f-c464-406f-bf81-ff9c9496bff5 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:35.674300 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1df8221f-c464-406f-bf81-ff9c9496bff5 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:35.706002 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-1c39035d-f434-4553-8510-a3b7af91137a tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:35.706809 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-1c39035d-f434-4553-8510-a3b7af91137a tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: 424a22f0-ccc3-4fec-bf38-4aaf924928e3] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:35.713571 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1c39035d-f434-4553-8510-a3b7af91137a tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:35.714057 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1c39035d-f434-4553-8510-a3b7af91137a tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:35.714514 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1c39035d-f434-4553-8510-a3b7af91137a tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:35.715215 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1c39035d-f434-4553-8510-a3b7af91137a tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:35.715665 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1c39035d-f434-4553-8510-a3b7af91137a tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:35.716082 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1c39035d-f434-4553-8510-a3b7af91137a tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:35.739381 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-1df8221f-c464-406f-bf81-ff9c9496bff5 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ad048becf474fb972d4291422d810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dcfc7024fc49388c4bd5f25f03e60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:35.747563 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-1df8221f-c464-406f-bf81-ff9c9496bff5 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/3f0a02bc-7993-4849-8b3c-7572327b4799" status: 200 len: 1239 microversion: 2.1 time: 0.087300 Oct 04 21:47:35.748332 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 572/1199] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:35 2022] GET /compute/v2.1/servers/3f0a02bc-7993-4849-8b3c-7572327b4799 => generated 1239 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:35.851612 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-1c39035d-f434-4553-8510-a3b7af91137a tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:35.859298 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-1c39035d-f434-4553-8510-a3b7af91137a tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/424a22f0-ccc3-4fec-bf38-4aaf924928e3" status: 200 len: 1541 microversion: 2.1 time: 0.157090 Oct 04 21:47:35.859883 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 628/1200] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:35 2022] GET /compute/v2.1/servers/424a22f0-ccc3-4fec-bf38-4aaf924928e3 => generated 1541 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:47:36.409133 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-3fa91f5c-0987-4389-8d08-a03cfa1be615 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:36.409691 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-3fa91f5c-0987-4389-8d08-a03cfa1be615 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] [instance: 7d71d6d3-3a63-406b-ac49-3e83bd539cf9] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:36.413378 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=1,nova_api:DELETE=3,nova_api:UPDATE=2 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:47:36.417199 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3fa91f5c-0987-4389-8d08-a03cfa1be615 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:36.417688 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3fa91f5c-0987-4389-8d08-a03cfa1be615 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:36.418123 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3fa91f5c-0987-4389-8d08-a03cfa1be615 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:36.418859 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3fa91f5c-0987-4389-8d08-a03cfa1be615 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:36.419314 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3fa91f5c-0987-4389-8d08-a03cfa1be615 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:36.419738 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3fa91f5c-0987-4389-8d08-a03cfa1be615 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:36.419862 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-30635c92-9145-4880-a57d-ec850105d2f0 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:36.420484 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-30635c92-9145-4880-a57d-ec850105d2f0 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] [instance: d4abcd04-329d-40a8-8d6e-4383bef437ae] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:36.424776 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:47:36.428785 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-30635c92-9145-4880-a57d-ec850105d2f0 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:36.429282 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-30635c92-9145-4880-a57d-ec850105d2f0 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:36.429739 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-30635c92-9145-4880-a57d-ec850105d2f0 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:36.430475 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-30635c92-9145-4880-a57d-ec850105d2f0 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:36.430938 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-30635c92-9145-4880-a57d-ec850105d2f0 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:36.431741 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-30635c92-9145-4880-a57d-ec850105d2f0 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:36.618304 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-3fa91f5c-0987-4389-8d08-a03cfa1be615 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29842a669a20408b881105135f76cb0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39edf587afe94b60911198aa0bb61613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:36.624955 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-30635c92-9145-4880-a57d-ec850105d2f0 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:36.626032 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-3fa91f5c-0987-4389-8d08-a03cfa1be615 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] 10.222.0.43 "GET /compute/v2.1/servers/7d71d6d3-3a63-406b-ac49-3e83bd539cf9" status: 200 len: 1473 microversion: 2.1 time: 0.220860 Oct 04 21:47:36.626621 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 573/1201] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:36 2022] GET /compute/v2.1/servers/7d71d6d3-3a63-406b-ac49-3e83bd539cf9 => generated 1473 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:36.634657 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-30635c92-9145-4880-a57d-ec850105d2f0 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:36.636346 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-30635c92-9145-4880-a57d-ec850105d2f0 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:36.637379 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-ec7e684c-ea00-4bac-a40d-e828e319bdf8 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:36.637603 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-30635c92-9145-4880-a57d-ec850105d2f0 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] 10.222.0.43 "GET /compute/v2.1/servers/d4abcd04-329d-40a8-8d6e-4383bef437ae" status: 200 len: 1410 microversion: 2.25 time: 0.222071 Oct 04 21:47:36.637983 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-ec7e684c-ea00-4bac-a40d-e828e319bdf8 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] [instance: e3380b36-6aba-4736-bcbc-f0058f806d55] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:36.638352 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 629/1202] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:47:36 2022] GET /compute/v2.1/servers/d4abcd04-329d-40a8-8d6e-4383bef437ae => generated 1410 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:47:36.643245 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-9800d8e6-06a6-4f6c-bce7-03c44d2be8a3 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:36.644399 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-9800d8e6-06a6-4f6c-bce7-03c44d2be8a3 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] [instance: 59a1880f-2802-4e72-9a17-b966cfec8fe9] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:36.648240 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ec7e684c-ea00-4bac-a40d-e828e319bdf8 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:36.648743 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ec7e684c-ea00-4bac-a40d-e828e319bdf8 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:36.649201 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ec7e684c-ea00-4bac-a40d-e828e319bdf8 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:36.650041 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ec7e684c-ea00-4bac-a40d-e828e319bdf8 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:36.650460 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9800d8e6-06a6-4f6c-bce7-03c44d2be8a3 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:36.650571 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ec7e684c-ea00-4bac-a40d-e828e319bdf8 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:36.650948 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9800d8e6-06a6-4f6c-bce7-03c44d2be8a3 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:36.651054 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ec7e684c-ea00-4bac-a40d-e828e319bdf8 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:36.651385 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9800d8e6-06a6-4f6c-bce7-03c44d2be8a3 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:36.652127 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9800d8e6-06a6-4f6c-bce7-03c44d2be8a3 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:36.652574 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9800d8e6-06a6-4f6c-bce7-03c44d2be8a3 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:36.653002 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9800d8e6-06a6-4f6c-bce7-03c44d2be8a3 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:36.845438 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=4 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:47:36.854093 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-ec7e684c-ea00-4bac-a40d-e828e319bdf8 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87616cd16995468ab7febf5aa4b284db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e3bf9149434d34b6762aaeef1478ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:36.857393 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-9800d8e6-06a6-4f6c-bce7-03c44d2be8a3 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7614aeaedd1947b88031fb55ca4783ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00081ff1d1aa41cbad345326b337093a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:36.861902 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-ec7e684c-ea00-4bac-a40d-e828e319bdf8 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] 10.222.0.43 "GET /compute/v2.1/servers/e3380b36-6aba-4736-bcbc-f0058f806d55" status: 200 len: 1472 microversion: 2.1 time: 0.228477 Oct 04 21:47:36.862513 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 574/1203] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:36 2022] GET /compute/v2.1/servers/e3380b36-6aba-4736-bcbc-f0058f806d55 => generated 1472 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:47:36.866175 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-9800d8e6-06a6-4f6c-bce7-03c44d2be8a3 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] 10.222.0.43 "GET /compute/v2.1/servers/59a1880f-2802-4e72-9a17-b966cfec8fe9" status: 200 len: 1479 microversion: 2.1 time: 0.226512 Oct 04 21:47:36.867003 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 630/1204] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:36 2022] GET /compute/v2.1/servers/59a1880f-2802-4e72-9a17-b966cfec8fe9 => generated 1479 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:36.867756 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-c45b2032-0b51-4285-93a8-955773936cae tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:36.868371 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-c45b2032-0b51-4285-93a8-955773936cae tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 3f0a02bc-7993-4849-8b3c-7572327b4799] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:36.874324 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c45b2032-0b51-4285-93a8-955773936cae tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:36.874854 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c45b2032-0b51-4285-93a8-955773936cae tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:36.875298 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c45b2032-0b51-4285-93a8-955773936cae tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:36.877498 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c45b2032-0b51-4285-93a8-955773936cae tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:36.877498 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c45b2032-0b51-4285-93a8-955773936cae tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:36.877498 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c45b2032-0b51-4285-93a8-955773936cae tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:36.886453 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-d76fecae-01af-4b7f-8855-ada2a76ea856 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:36.887067 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-d76fecae-01af-4b7f-8855-ada2a76ea856 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: 424a22f0-ccc3-4fec-bf38-4aaf924928e3] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:36.893026 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d76fecae-01af-4b7f-8855-ada2a76ea856 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:36.893506 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d76fecae-01af-4b7f-8855-ada2a76ea856 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:36.893943 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d76fecae-01af-4b7f-8855-ada2a76ea856 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:36.894692 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d76fecae-01af-4b7f-8855-ada2a76ea856 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:36.895145 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d76fecae-01af-4b7f-8855-ada2a76ea856 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:36.895569 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d76fecae-01af-4b7f-8855-ada2a76ea856 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:36.946900 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-c45b2032-0b51-4285-93a8-955773936cae tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ad048becf474fb972d4291422d810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dcfc7024fc49388c4bd5f25f03e60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:36.954880 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-c45b2032-0b51-4285-93a8-955773936cae tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/3f0a02bc-7993-4849-8b3c-7572327b4799" status: 200 len: 1231 microversion: 2.1 time: 0.091257 Oct 04 21:47:36.955475 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 575/1205] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:36 2022] GET /compute/v2.1/servers/3f0a02bc-7993-4849-8b3c-7572327b4799 => generated 1231 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:37.034881 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-d76fecae-01af-4b7f-8855-ada2a76ea856 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:37.043378 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-d76fecae-01af-4b7f-8855-ada2a76ea856 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/424a22f0-ccc3-4fec-bf38-4aaf924928e3" status: 200 len: 1541 microversion: 2.1 time: 0.160796 Oct 04 21:47:37.043963 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 631/1206] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:36 2022] GET /compute/v2.1/servers/424a22f0-ccc3-4fec-bf38-4aaf924928e3 => generated 1541 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:37.651887 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-ef530ba1-5d19-419f-9489-8ddbb8ce8fd3 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:37.652493 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-ef530ba1-5d19-419f-9489-8ddbb8ce8fd3 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] [instance: 7d71d6d3-3a63-406b-ac49-3e83bd539cf9] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:37.659119 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ef530ba1-5d19-419f-9489-8ddbb8ce8fd3 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:37.659609 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ef530ba1-5d19-419f-9489-8ddbb8ce8fd3 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:37.660056 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ef530ba1-5d19-419f-9489-8ddbb8ce8fd3 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:37.660756 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ef530ba1-5d19-419f-9489-8ddbb8ce8fd3 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:37.661223 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ef530ba1-5d19-419f-9489-8ddbb8ce8fd3 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:37.662219 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ef530ba1-5d19-419f-9489-8ddbb8ce8fd3 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:37.663821 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-d1594bad-4e41-4627-9c86-07c87d361853 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:37.664462 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-d1594bad-4e41-4627-9c86-07c87d361853 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] [instance: d4abcd04-329d-40a8-8d6e-4383bef437ae] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:37.670922 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d1594bad-4e41-4627-9c86-07c87d361853 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:37.671445 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d1594bad-4e41-4627-9c86-07c87d361853 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:37.671880 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d1594bad-4e41-4627-9c86-07c87d361853 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:37.672581 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d1594bad-4e41-4627-9c86-07c87d361853 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:37.673039 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d1594bad-4e41-4627-9c86-07c87d361853 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:37.673466 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d1594bad-4e41-4627-9c86-07c87d361853 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:37.860284 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-ef530ba1-5d19-419f-9489-8ddbb8ce8fd3 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29842a669a20408b881105135f76cb0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39edf587afe94b60911198aa0bb61613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:37.864346 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-d1594bad-4e41-4627-9c86-07c87d361853 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:37.869898 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-ef530ba1-5d19-419f-9489-8ddbb8ce8fd3 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] 10.222.0.43 "GET /compute/v2.1/servers/7d71d6d3-3a63-406b-ac49-3e83bd539cf9" status: 200 len: 1473 microversion: 2.1 time: 0.222036 Oct 04 21:47:37.871112 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 576/1207] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:37 2022] GET /compute/v2.1/servers/7d71d6d3-3a63-406b-ac49-3e83bd539cf9 => generated 1473 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:37.873283 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-d1594bad-4e41-4627-9c86-07c87d361853 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:37.875484 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-d1594bad-4e41-4627-9c86-07c87d361853 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:37.876609 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-d1594bad-4e41-4627-9c86-07c87d361853 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] 10.222.0.43 "GET /compute/v2.1/servers/d4abcd04-329d-40a8-8d6e-4383bef437ae" status: 200 len: 1410 microversion: 2.25 time: 0.217232 Oct 04 21:47:37.877562 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 632/1208] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:47:37 2022] GET /compute/v2.1/servers/d4abcd04-329d-40a8-8d6e-4383bef437ae => generated 1410 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:47:37.902426 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-c22f8544-17eb-4593-a13e-80d98ac8899c tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:37.903151 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-c22f8544-17eb-4593-a13e-80d98ac8899c tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] [instance: 59a1880f-2802-4e72-9a17-b966cfec8fe9] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:37.903625 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-444d71c3-2f56-4b27-bdae-fb7ad3fef909 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:37.904428 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-444d71c3-2f56-4b27-bdae-fb7ad3fef909 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] [instance: e3380b36-6aba-4736-bcbc-f0058f806d55] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:37.909943 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c22f8544-17eb-4593-a13e-80d98ac8899c tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:37.910477 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c22f8544-17eb-4593-a13e-80d98ac8899c tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:37.912212 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c22f8544-17eb-4593-a13e-80d98ac8899c tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:37.912848 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-444d71c3-2f56-4b27-bdae-fb7ad3fef909 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:37.912848 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-444d71c3-2f56-4b27-bdae-fb7ad3fef909 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:37.913036 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c22f8544-17eb-4593-a13e-80d98ac8899c tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:37.913116 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-444d71c3-2f56-4b27-bdae-fb7ad3fef909 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:37.913345 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c22f8544-17eb-4593-a13e-80d98ac8899c tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:37.913345 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c22f8544-17eb-4593-a13e-80d98ac8899c tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:37.913509 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-444d71c3-2f56-4b27-bdae-fb7ad3fef909 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:37.913927 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-444d71c3-2f56-4b27-bdae-fb7ad3fef909 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:37.914419 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-444d71c3-2f56-4b27-bdae-fb7ad3fef909 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:38.294348 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-c22f8544-17eb-4593-a13e-80d98ac8899c tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7614aeaedd1947b88031fb55ca4783ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00081ff1d1aa41cbad345326b337093a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:38.306308 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-444d71c3-2f56-4b27-bdae-fb7ad3fef909 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87616cd16995468ab7febf5aa4b284db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e3bf9149434d34b6762aaeef1478ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:38.314159 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-c22f8544-17eb-4593-a13e-80d98ac8899c tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] 10.222.0.43 "GET /compute/v2.1/servers/59a1880f-2802-4e72-9a17-b966cfec8fe9" status: 200 len: 1466 microversion: 2.1 time: 0.416230 Oct 04 21:47:38.314683 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-444d71c3-2f56-4b27-bdae-fb7ad3fef909 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] 10.222.0.43 "GET /compute/v2.1/servers/e3380b36-6aba-4736-bcbc-f0058f806d55" status: 200 len: 1472 microversion: 2.1 time: 0.432252 Oct 04 21:47:38.314808 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 633/1209] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:37 2022] GET /compute/v2.1/servers/59a1880f-2802-4e72-9a17-b966cfec8fe9 => generated 1466 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:38.329205 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 577/1210] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:37 2022] GET /compute/v2.1/servers/e3380b36-6aba-4736-bcbc-f0058f806d55 => generated 1472 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:38.331713 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-b56eeb1a-993d-4607-8ce9-23f519c89c1e tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:38.333335 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-b56eeb1a-993d-4607-8ce9-23f519c89c1e tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: 424a22f0-ccc3-4fec-bf38-4aaf924928e3] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:38.341535 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-53cb98d4-12c1-4f3a-897a-fce46fcd1618 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:38.342262 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-53cb98d4-12c1-4f3a-897a-fce46fcd1618 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 3f0a02bc-7993-4849-8b3c-7572327b4799] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:38.344770 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b56eeb1a-993d-4607-8ce9-23f519c89c1e tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:38.345291 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b56eeb1a-993d-4607-8ce9-23f519c89c1e tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:38.345740 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b56eeb1a-993d-4607-8ce9-23f519c89c1e tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:38.346501 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b56eeb1a-993d-4607-8ce9-23f519c89c1e tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:38.347034 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b56eeb1a-993d-4607-8ce9-23f519c89c1e tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:38.347467 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b56eeb1a-993d-4607-8ce9-23f519c89c1e tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:38.360431 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-53cb98d4-12c1-4f3a-897a-fce46fcd1618 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:38.361613 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-53cb98d4-12c1-4f3a-897a-fce46fcd1618 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:38.362062 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-53cb98d4-12c1-4f3a-897a-fce46fcd1618 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:38.362834 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-53cb98d4-12c1-4f3a-897a-fce46fcd1618 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:38.363302 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-53cb98d4-12c1-4f3a-897a-fce46fcd1618 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:38.363726 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-53cb98d4-12c1-4f3a-897a-fce46fcd1618 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:38.501531 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-53cb98d4-12c1-4f3a-897a-fce46fcd1618 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ad048becf474fb972d4291422d810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dcfc7024fc49388c4bd5f25f03e60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:38.513371 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-53cb98d4-12c1-4f3a-897a-fce46fcd1618 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/3f0a02bc-7993-4849-8b3c-7572327b4799" status: 200 len: 1287 microversion: 2.1 time: 0.178116 Oct 04 21:47:38.514291 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 634/1211] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:38 2022] GET /compute/v2.1/servers/3f0a02bc-7993-4849-8b3c-7572327b4799 => generated 1287 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:38.538145 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-5936de0a-c0e4-4d89-ac96-e36015b0bb33 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Calling method '.version_select at 0x7fbb2f1858b0>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:38.602256 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-5936de0a-c0e4-4d89-ac96-e36015b0bb33 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] 10.222.0.43 "GET /compute/v2.1/images/58548514-5dac-426c-81f5-19e3fba33e23" status: 200 len: 784 microversion: 2.1 time: 0.086536 Oct 04 21:47:38.608942 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-b56eeb1a-993d-4607-8ce9-23f519c89c1e tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:38.612556 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 635/1212] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:47:38 2022] GET /compute/v2.1/images/58548514-5dac-426c-81f5-19e3fba33e23 => generated 784 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:47:38.618040 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-81b728c1-513f-4f6a-975b-aa2bf8bac1c0 req-4e9db896-64f8-47f8-9777-c0d03bfcb2f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4abcd04-329d-40a8-8d6e-4383bef437ae", "name": "network-vif-plugged", "status": "completed", "tag": "000d4b8f-4676-41c0-a0c8-303e63366262"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:47:38.619621 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-b56eeb1a-993d-4607-8ce9-23f519c89c1e tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/424a22f0-ccc3-4fec-bf38-4aaf924928e3" status: 200 len: 1541 microversion: 2.1 time: 0.291673 Oct 04 21:47:38.620223 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 578/1213] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:38 2022] GET /compute/v2.1/servers/424a22f0-ccc3-4fec-bf38-4aaf924928e3 => generated 1541 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:38.624863 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-d3a8d051-d81f-4956-96fc-611f9ccb980b tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:38.630559 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-81b728c1-513f-4f6a-975b-aa2bf8bac1c0 req-4e9db896-64f8-47f8-9777-c0d03bfcb2f2 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:38.631143 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-81b728c1-513f-4f6a-975b-aa2bf8bac1c0 req-4e9db896-64f8-47f8-9777-c0d03bfcb2f2 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:38.631622 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-81b728c1-513f-4f6a-975b-aa2bf8bac1c0 req-4e9db896-64f8-47f8-9777-c0d03bfcb2f2 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:38.652258 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-d3a8d051-d81f-4956-96fc-611f9ccb980b tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] 10.222.0.43 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.030936 Oct 04 21:47:38.653182 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 579/1214] 10.222.0.43 () {58 vars in 1137 bytes} [Tue Oct 4 21:47:38 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:47:38.666292 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-f477c156-0eb0-40a0-84e0-89e80c3fb57a tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Calling method '.version_select at 0x7fbb2eee1a60>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:38.671504 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-81b728c1-513f-4f6a-975b-aa2bf8bac1c0 req-4e9db896-64f8-47f8-9777-c0d03bfcb2f2 service nova] Creating event network-vif-plugged:000d4b8f-4676-41c0-a0c8-303e63366262 for instance d4abcd04-329d-40a8-8d6e-4383bef437ae on n-h1-860284-1 Oct 04 21:47:38.700619 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-81b728c1-513f-4f6a-975b-aa2bf8bac1c0 req-4e9db896-64f8-47f8-9777-c0d03bfcb2f2 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086653 Oct 04 21:47:38.705248 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 636/1215] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:47:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:47:38.899714 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-a707a5f0-9d8f-437a-bd1e-58b31721941c tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:38.901642 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-a707a5f0-9d8f-437a-bd1e-58b31721941c tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] [instance: 7d71d6d3-3a63-406b-ac49-3e83bd539cf9] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:38.921963 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a707a5f0-9d8f-437a-bd1e-58b31721941c tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:38.922515 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a707a5f0-9d8f-437a-bd1e-58b31721941c tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:38.922962 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a707a5f0-9d8f-437a-bd1e-58b31721941c tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:38.923729 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a707a5f0-9d8f-437a-bd1e-58b31721941c tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:38.925986 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a707a5f0-9d8f-437a-bd1e-58b31721941c tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:38.928008 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a707a5f0-9d8f-437a-bd1e-58b31721941c tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:39.158308 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-a707a5f0-9d8f-437a-bd1e-58b31721941c tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29842a669a20408b881105135f76cb0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39edf587afe94b60911198aa0bb61613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:39.176180 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-a707a5f0-9d8f-437a-bd1e-58b31721941c tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] 10.222.0.43 "GET /compute/v2.1/servers/7d71d6d3-3a63-406b-ac49-3e83bd539cf9" status: 200 len: 1431 microversion: 2.1 time: 0.280710 Oct 04 21:47:39.182166 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 637/1216] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:38 2022] GET /compute/v2.1/servers/7d71d6d3-3a63-406b-ac49-3e83bd539cf9 => generated 1431 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:39.196317 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-95950ae8-4666-4c35-916b-c4282f9654d7 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:39.197267 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-95950ae8-4666-4c35-916b-c4282f9654d7 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] [instance: d4abcd04-329d-40a8-8d6e-4383bef437ae] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:39.213558 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-95950ae8-4666-4c35-916b-c4282f9654d7 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:39.214530 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-95950ae8-4666-4c35-916b-c4282f9654d7 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:39.215157 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-95950ae8-4666-4c35-916b-c4282f9654d7 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:39.216101 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-95950ae8-4666-4c35-916b-c4282f9654d7 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:39.216721 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-95950ae8-4666-4c35-916b-c4282f9654d7 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:39.217315 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-95950ae8-4666-4c35-916b-c4282f9654d7 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:39.350015 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-f477c156-0eb0-40a0-84e0-89e80c3fb57a tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] 10.222.0.43 "DELETE /compute/v2.1/images/ac8e9797-0b3b-4c06-9229-b4ac23c4312c" status: 204 len: 0 microversion: 2.1 time: 0.688830 Oct 04 21:47:39.350740 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 580/1217] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:38 2022] DELETE /compute/v2.1/images/ac8e9797-0b3b-4c06-9229-b4ac23c4312c => generated 0 bytes in 690 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 21:47:39.358867 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-95586ede-f3d6-4e27-acef-e92964787bb5 req-2f8890c0-daf0-4a7b-975a-ed2be6dbf8c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d71d6d3-3a63-406b-ac49-3e83bd539cf9", "name": "network-vif-deleted", "tag": "c9b71eee-ecc1-4326-bb8c-04bddb4cc35c"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:47:39.370308 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-95586ede-f3d6-4e27-acef-e92964787bb5 req-2f8890c0-daf0-4a7b-975a-ed2be6dbf8c6 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:39.370932 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-95586ede-f3d6-4e27-acef-e92964787bb5 req-2f8890c0-daf0-4a7b-975a-ed2be6dbf8c6 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:39.371567 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-95586ede-f3d6-4e27-acef-e92964787bb5 req-2f8890c0-daf0-4a7b-975a-ed2be6dbf8c6 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:39.383671 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-95586ede-f3d6-4e27-acef-e92964787bb5 req-2f8890c0-daf0-4a7b-975a-ed2be6dbf8c6 service nova] Creating event network-vif-deleted:c9b71eee-ecc1-4326-bb8c-04bddb4cc35c for instance 7d71d6d3-3a63-406b-ac49-3e83bd539cf9 on n-h1-860284-1 Oct 04 21:47:39.389068 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-95586ede-f3d6-4e27-acef-e92964787bb5 req-2f8890c0-daf0-4a7b-975a-ed2be6dbf8c6 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033627 Oct 04 21:47:39.390327 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 581/1218] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:47:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:47:39.393511 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-95950ae8-4666-4c35-916b-c4282f9654d7 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:39.397895 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-f4c3880d-38e3-4b99-aa98-bde4fea6d0bc req-b70cf8be-a281-47c1-96e9-a6275ccd4e5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "258bc0cb-6718-4f8b-8d0b-ef544b2b659b", "name": "network-vif-deleted", "tag": "11865c88-bab8-4b1b-af2e-a51d5befe968"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:47:39.404174 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-95950ae8-4666-4c35-916b-c4282f9654d7 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:39.405825 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-95950ae8-4666-4c35-916b-c4282f9654d7 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:39.407124 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-95950ae8-4666-4c35-916b-c4282f9654d7 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] 10.222.0.43 "GET /compute/v2.1/servers/d4abcd04-329d-40a8-8d6e-4383bef437ae" status: 200 len: 1410 microversion: 2.25 time: 0.223714 Oct 04 21:47:39.422674 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 638/1219] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:47:39 2022] GET /compute/v2.1/servers/d4abcd04-329d-40a8-8d6e-4383bef437ae => generated 1410 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:47:39.422883 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-f4c3880d-38e3-4b99-aa98-bde4fea6d0bc req-b70cf8be-a281-47c1-96e9-a6275ccd4e5d service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:39.422883 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-f4c3880d-38e3-4b99-aa98-bde4fea6d0bc req-b70cf8be-a281-47c1-96e9-a6275ccd4e5d service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:39.422883 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-f4c3880d-38e3-4b99-aa98-bde4fea6d0bc req-b70cf8be-a281-47c1-96e9-a6275ccd4e5d service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:39.423102 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-a723b01f-24d6-482f-ab3f-297bbb93633d tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:39.423102 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-a723b01f-24d6-482f-ab3f-297bbb93633d tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] [instance: e3380b36-6aba-4736-bcbc-f0058f806d55] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:39.423102 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a723b01f-24d6-482f-ab3f-297bbb93633d tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:39.423102 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a723b01f-24d6-482f-ab3f-297bbb93633d tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:39.423406 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a723b01f-24d6-482f-ab3f-297bbb93633d tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:39.423406 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a723b01f-24d6-482f-ab3f-297bbb93633d tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:39.423406 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a723b01f-24d6-482f-ab3f-297bbb93633d tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:39.423406 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a723b01f-24d6-482f-ab3f-297bbb93633d tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:39.427878 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-f4c3880d-38e3-4b99-aa98-bde4fea6d0bc req-b70cf8be-a281-47c1-96e9-a6275ccd4e5d service nova] Creating event network-vif-deleted:11865c88-bab8-4b1b-af2e-a51d5befe968 for instance 258bc0cb-6718-4f8b-8d0b-ef544b2b659b on n-h1-860284-1 Oct 04 21:47:39.432907 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-f4c3880d-38e3-4b99-aa98-bde4fea6d0bc req-b70cf8be-a281-47c1-96e9-a6275ccd4e5d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041121 Oct 04 21:47:39.434039 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 582/1220] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:47:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:47:39.440298 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-c9b21083-adfc-4615-9d2c-6c4d70a81664 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Calling method '.version_select at 0x7fbb2eee15e0>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:39.464849 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-c9b21083-adfc-4615-9d2c-6c4d70a81664 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] HTTP exception thrown: Image not found. Oct 04 21:47:39.467402 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-c9b21083-adfc-4615-9d2c-6c4d70a81664 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Request method failure captured: Oct 04 21:47:39.467402 n-d-860284-1 devstack@n-api.service[134101]: request: GET /compute/v2.1/images/ac8e9797-0b3b-4c06-9229-b4ac23c4312c HTTP/1.1 Oct 04 21:47:39.467402 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 21:47:39.467402 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 21:47:39.467402 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 21:47:39.467402 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 21:47:39.467402 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 21:47:39.467402 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 21:47:39.467402 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 21:47:39.467402 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 21:47:39.467402 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPKnHeaK9tmRrmAvrTzwz5PMuGvLZo6w0RzRBi-ESYQgfyjrrnkZ38Zu2JwOt5LIXhidJXXWMojxm08vFwalBKwJg1Rg9TZtolbT7DOzzXgrMEMgqLI1DqdGm1pJgN2X-4uD20_vhYRbxUjk-Ks6luVK8o8L8qWMFEceWeaOgYF3vYNA Oct 04 21:47:39.467402 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 21:47:39.467402 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 21:47:39.467402 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 21:47:39.467402 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 21:47:39.467402 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 21:47:39.467402 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 21:47:39.467402 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: 00081ff1d1aa41cbad345326b337093a Oct 04 21:47:39.467402 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-ImagesOneServerTestJSON-144510230 Oct 04 21:47:39.467402 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 21:47:39.467402 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 21:47:39.468986 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/00081ff1d1aa41cbad345326b337093a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_00081ff1d1aa41cbad345326b337093a", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/00081ff1d1aa41cbad345326b337093a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/00081ff1d1aa41cbad345326b337093a"}]}] Oct 04 21:47:39.468986 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-ImagesOneServerTestJSON-144510230 Oct 04 21:47:39.468986 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: 00081ff1d1aa41cbad345326b337093a Oct 04 21:47:39.468986 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-144510230 Oct 04 21:47:39.468986 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-ImagesOneServerTestJSON-144510230-project Oct 04 21:47:39.468986 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 21:47:39.468986 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 21:47:39.468986 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 7614aeaedd1947b88031fb55ca4783ae Oct 04 21:47:39.468986 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-ImagesOneServerTestJSON-144510230-project Oct 04 21:47:39.468986 n-d-860284-1 devstack@n-api.service[134101]: method: Oct 04 21:47:39.468986 n-d-860284-1 devstack@n-api.service[134101]: exception: Image not found. Oct 04 21:47:39.468986 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': 'ac8e9797-0b3b-4c06-9229-b4ac23c4312c'} Oct 04 21:47:39.468986 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:47:39.469856 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:47:39.469856 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 21:47:39.469856 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 21:47:39.469856 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 21:47:39.469856 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 21:47:39.469856 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 21:47:39.469856 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 21:47:39.469856 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 21:47:39.469856 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 21:47:39.469856 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 21:47:39.469856 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 21:47:39.469856 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 21:47:39.469856 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 21:47:39.469856 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 21:47:39.469856 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 21:47:39.469856 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 21:47:39.469856 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 21:47:39.469856 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID ac8e9797-0b3b-4c06-9229-b4ac23c4312c Oct 04 21:47:39.471400 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:47:39.471400 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:47:39.471400 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:47:39.471400 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:47:39.471400 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 04 21:47:39.471400 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 04 21:47:39.471400 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 04 21:47:39.471400 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 04 21:47:39.471400 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 04 21:47:39.471400 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 04 21:47:39.471400 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 04 21:47:39.471400 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 04 21:47:39.471400 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 21:47:39.471400 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 21:47:39.471400 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 21:47:39.471400 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 21:47:39.471400 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 21:47:39.471400 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 21:47:39.471400 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 21:47:39.471400 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 21:47:39.480757 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 21:47:39.480757 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 21:47:39.480757 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 21:47:39.480757 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 21:47:39.480757 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 21:47:39.480757 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 21:47:39.480757 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 21:47:39.480757 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 21:47:39.480757 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image ac8e9797-0b3b-4c06-9229-b4ac23c4312c could not be found. Oct 04 21:47:39.480757 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:47:39.480757 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:47:39.480757 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:47:39.480757 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:47:39.480757 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:47:39.480757 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:47:39.480757 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:47:39.480757 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:47:39.480757 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:47:39.480757 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:47:39.486823 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:47:39.486823 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:47:39.486823 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 04 21:47:39.486823 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 21:47:39.486823 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 21:47:39.486823 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:47:39.486823 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:47:39.486823 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:47:39.486823 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:47:39.486823 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:47:39.486823 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:47:39.486823 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:47:39.486823 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:47:39.486823 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 21:47:39.486823 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:47:39.486823 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-c9b21083-adfc-4615-9d2c-6c4d70a81664 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Returning 404 to user: Image not found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:47:39.486823 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-c9b21083-adfc-4615-9d2c-6c4d70a81664 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] 10.222.0.43 "GET /compute/v2.1/images/ac8e9797-0b3b-4c06-9229-b4ac23c4312c" status: 404 len: 62 microversion: 2.1 time: 0.033654 Oct 04 21:47:39.488893 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 583/1221] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:47:39 2022] GET /compute/v2.1/images/ac8e9797-0b3b-4c06-9229-b4ac23c4312c => generated 62 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 21:47:39.491044 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-c1980037-4fe8-42cb-b664-1265b9719328 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-761718400"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:47:39.495838 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-c1980037-4fe8-42cb-b664-1265b9719328 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] [instance: 59a1880f-2802-4e72-9a17-b966cfec8fe9] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:39.515685 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c1980037-4fe8-42cb-b664-1265b9719328 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:39.516342 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c1980037-4fe8-42cb-b664-1265b9719328 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:39.516794 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c1980037-4fe8-42cb-b664-1265b9719328 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:39.517516 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c1980037-4fe8-42cb-b664-1265b9719328 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:39.517979 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c1980037-4fe8-42cb-b664-1265b9719328 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:39.518522 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c1980037-4fe8-42cb-b664-1265b9719328 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:39.636984 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-a723b01f-24d6-482f-ab3f-297bbb93633d tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87616cd16995468ab7febf5aa4b284db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e3bf9149434d34b6762aaeef1478ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:39.651167 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-a723b01f-24d6-482f-ab3f-297bbb93633d tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] 10.222.0.43 "GET /compute/v2.1/servers/e3380b36-6aba-4736-bcbc-f0058f806d55" status: 200 len: 1472 microversion: 2.1 time: 0.241207 Oct 04 21:47:39.652988 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 639/1222] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:39 2022] GET /compute/v2.1/servers/e3380b36-6aba-4736-bcbc-f0058f806d55 => generated 1472 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:39.664304 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-8c987038-29b7-4168-861e-0bc368b53f61 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:39.665268 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-8c987038-29b7-4168-861e-0bc368b53f61 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 3f0a02bc-7993-4849-8b3c-7572327b4799] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:39.674542 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8c987038-29b7-4168-861e-0bc368b53f61 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:39.675901 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8c987038-29b7-4168-861e-0bc368b53f61 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:39.676797 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8c987038-29b7-4168-861e-0bc368b53f61 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:39.679562 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8c987038-29b7-4168-861e-0bc368b53f61 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:39.680516 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8c987038-29b7-4168-861e-0bc368b53f61 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:39.681230 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8c987038-29b7-4168-861e-0bc368b53f61 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:39.757411 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-8c987038-29b7-4168-861e-0bc368b53f61 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ad048becf474fb972d4291422d810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dcfc7024fc49388c4bd5f25f03e60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:39.766426 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-8c987038-29b7-4168-861e-0bc368b53f61 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/3f0a02bc-7993-4849-8b3c-7572327b4799" status: 200 len: 1293 microversion: 2.1 time: 0.112190 Oct 04 21:47:39.767164 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 640/1223] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:39 2022] GET /compute/v2.1/servers/3f0a02bc-7993-4849-8b3c-7572327b4799 => generated 1293 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:39.773816 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-c1980037-4fe8-42cb-b664-1265b9719328 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] 10.222.0.43 "POST /compute/v2.1/servers/59a1880f-2802-4e72-9a17-b966cfec8fe9/action" status: 202 len: 0 microversion: 2.1 time: 0.293293 Oct 04 21:47:39.774620 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 584/1224] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 21:47:39 2022] POST /compute/v2.1/servers/59a1880f-2802-4e72-9a17-b966cfec8fe9/action => generated 0 bytes in 295 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Oct 04 21:47:39.787892 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-72be0985-8eec-4856-8389-90053f8b2088 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:39.787892 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-72be0985-8eec-4856-8389-90053f8b2088 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: 424a22f0-ccc3-4fec-bf38-4aaf924928e3] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:39.791691 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-72be0985-8eec-4856-8389-90053f8b2088 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:39.792202 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-72be0985-8eec-4856-8389-90053f8b2088 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:39.792710 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-72be0985-8eec-4856-8389-90053f8b2088 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:39.793558 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-72be0985-8eec-4856-8389-90053f8b2088 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:39.794128 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-72be0985-8eec-4856-8389-90053f8b2088 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:39.794235 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-041db467-dbe4-441e-bc04-448bf65610bb tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Calling method '.version_select at 0x7fbb2ee888b0>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:39.794660 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-72be0985-8eec-4856-8389-90053f8b2088 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:39.849400 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-041db467-dbe4-441e-bc04-448bf65610bb tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] 10.222.0.43 "GET /compute/v2.1/images/6b7f3390-fca2-4f36-a6ff-e815f6857c6a" status: 200 len: 1426 microversion: 2.1 time: 0.059145 Oct 04 21:47:39.850287 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 585/1225] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:47:39 2022] GET /compute/v2.1/images/6b7f3390-fca2-4f36-a6ff-e815f6857c6a => generated 1426 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:39.975113 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-72be0985-8eec-4856-8389-90053f8b2088 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:39.979286 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=100 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:47:39.984511 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-72be0985-8eec-4856-8389-90053f8b2088 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/424a22f0-ccc3-4fec-bf38-4aaf924928e3" status: 200 len: 1541 microversion: 2.1 time: 0.216186 Oct 04 21:47:39.985148 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 641/1226] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:39 2022] GET /compute/v2.1/servers/424a22f0-ccc3-4fec-bf38-4aaf924928e3 => generated 1541 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:40.208716 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-14f8fb8f-7ff3-44ec-a07d-cb4d39345f88 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:40.210282 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-14f8fb8f-7ff3-44ec-a07d-cb4d39345f88 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] [instance: 7d71d6d3-3a63-406b-ac49-3e83bd539cf9] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:40.243196 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-14f8fb8f-7ff3-44ec-a07d-cb4d39345f88 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:40.244265 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-14f8fb8f-7ff3-44ec-a07d-cb4d39345f88 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:40.244819 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-14f8fb8f-7ff3-44ec-a07d-cb4d39345f88 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:40.245664 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-14f8fb8f-7ff3-44ec-a07d-cb4d39345f88 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:40.246255 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-14f8fb8f-7ff3-44ec-a07d-cb4d39345f88 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:40.246806 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-14f8fb8f-7ff3-44ec-a07d-cb4d39345f88 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:40.327111 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-14f8fb8f-7ff3-44ec-a07d-cb4d39345f88 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:40.327769 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-14f8fb8f-7ff3-44ec-a07d-cb4d39345f88 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:40.328340 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-14f8fb8f-7ff3-44ec-a07d-cb4d39345f88 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:40.328965 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.objects.instance [None req-14f8fb8f-7ff3-44ec-a07d-cb4d39345f88 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lazy-loading 'fault' on Instance uuid 7d71d6d3-3a63-406b-ac49-3e83bd539cf9 {{(pid=134101) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:47:40.378034 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-14f8fb8f-7ff3-44ec-a07d-cb4d39345f88 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29842a669a20408b881105135f76cb0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39edf587afe94b60911198aa0bb61613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:40.387870 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-14f8fb8f-7ff3-44ec-a07d-cb4d39345f88 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] 10.222.0.43 "GET /compute/v2.1/servers/7d71d6d3-3a63-406b-ac49-3e83bd539cf9" status: 200 len: 1307 microversion: 2.1 time: 0.184003 Oct 04 21:47:40.388655 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 586/1227] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:40 2022] GET /compute/v2.1/servers/7d71d6d3-3a63-406b-ac49-3e83bd539cf9 => generated 1307 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:40.439027 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-5ae1c7fb-5d81-4979-b469-0f47e2a53782 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:40.439790 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-5ae1c7fb-5d81-4979-b469-0f47e2a53782 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] [instance: d4abcd04-329d-40a8-8d6e-4383bef437ae] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:40.447368 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5ae1c7fb-5d81-4979-b469-0f47e2a53782 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:40.447783 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5ae1c7fb-5d81-4979-b469-0f47e2a53782 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:40.448208 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5ae1c7fb-5d81-4979-b469-0f47e2a53782 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:40.448977 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5ae1c7fb-5d81-4979-b469-0f47e2a53782 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:40.449570 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5ae1c7fb-5d81-4979-b469-0f47e2a53782 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:40.449999 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5ae1c7fb-5d81-4979-b469-0f47e2a53782 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:40.618846 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-5ae1c7fb-5d81-4979-b469-0f47e2a53782 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:40.632720 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-5ae1c7fb-5d81-4979-b469-0f47e2a53782 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:40.635588 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-5ae1c7fb-5d81-4979-b469-0f47e2a53782 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:40.638150 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-5ae1c7fb-5d81-4979-b469-0f47e2a53782 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] 10.222.0.43 "GET /compute/v2.1/servers/d4abcd04-329d-40a8-8d6e-4383bef437ae" status: 200 len: 1410 microversion: 2.25 time: 0.203646 Oct 04 21:47:40.639840 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 642/1228] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:47:40 2022] GET /compute/v2.1/servers/d4abcd04-329d-40a8-8d6e-4383bef437ae => generated 1410 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:47:40.675128 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-f88490cb-2413-41aa-a211-5ae438392e1b tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:40.675664 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-f88490cb-2413-41aa-a211-5ae438392e1b tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] [instance: e3380b36-6aba-4736-bcbc-f0058f806d55] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:40.683869 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f88490cb-2413-41aa-a211-5ae438392e1b tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:40.684835 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f88490cb-2413-41aa-a211-5ae438392e1b tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:40.685139 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f88490cb-2413-41aa-a211-5ae438392e1b tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:40.686031 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f88490cb-2413-41aa-a211-5ae438392e1b tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:40.686528 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f88490cb-2413-41aa-a211-5ae438392e1b tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:40.686965 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f88490cb-2413-41aa-a211-5ae438392e1b tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:40.796487 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-6297987b-c764-4dc7-8b41-e52fe15f8419 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:40.797709 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-6297987b-c764-4dc7-8b41-e52fe15f8419 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 3f0a02bc-7993-4849-8b3c-7572327b4799] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:40.805877 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6297987b-c764-4dc7-8b41-e52fe15f8419 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:40.806403 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6297987b-c764-4dc7-8b41-e52fe15f8419 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:40.806854 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6297987b-c764-4dc7-8b41-e52fe15f8419 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:40.807613 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6297987b-c764-4dc7-8b41-e52fe15f8419 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:40.808281 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6297987b-c764-4dc7-8b41-e52fe15f8419 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:40.808879 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6297987b-c764-4dc7-8b41-e52fe15f8419 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:40.900684 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-f88490cb-2413-41aa-a211-5ae438392e1b tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87616cd16995468ab7febf5aa4b284db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e3bf9149434d34b6762aaeef1478ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:40.913872 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-f88490cb-2413-41aa-a211-5ae438392e1b tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] 10.222.0.43 "GET /compute/v2.1/servers/e3380b36-6aba-4736-bcbc-f0058f806d55" status: 200 len: 1472 microversion: 2.1 time: 0.242416 Oct 04 21:47:40.914827 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 587/1229] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:40 2022] GET /compute/v2.1/servers/e3380b36-6aba-4736-bcbc-f0058f806d55 => generated 1472 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:40.924390 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-48206dc6-86a4-4b62-97f0-5a5bf3d32335 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Calling method '.version_select at 0x7fbb2ee88820>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:41.000357 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-48206dc6-86a4-4b62-97f0-5a5bf3d32335 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] 10.222.0.43 "GET /compute/v2.1/images/6b7f3390-fca2-4f36-a6ff-e815f6857c6a" status: 200 len: 1426 microversion: 2.1 time: 0.083511 Oct 04 21:47:41.001300 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 588/1230] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:47:40 2022] GET /compute/v2.1/images/6b7f3390-fca2-4f36-a6ff-e815f6857c6a => generated 1426 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:41.015388 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-6297987b-c764-4dc7-8b41-e52fe15f8419 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ad048becf474fb972d4291422d810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dcfc7024fc49388c4bd5f25f03e60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:41.020234 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-cd7e491f-1012-4907-b56c-2237aa96a852 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:41.021701 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-cd7e491f-1012-4907-b56c-2237aa96a852 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: 424a22f0-ccc3-4fec-bf38-4aaf924928e3] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:41.024699 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-6297987b-c764-4dc7-8b41-e52fe15f8419 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/3f0a02bc-7993-4849-8b3c-7572327b4799" status: 200 len: 1358 microversion: 2.1 time: 0.232050 Oct 04 21:47:41.025717 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 643/1231] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:40 2022] GET /compute/v2.1/servers/3f0a02bc-7993-4849-8b3c-7572327b4799 => generated 1358 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:47:41.032752 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cd7e491f-1012-4907-b56c-2237aa96a852 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:41.033644 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cd7e491f-1012-4907-b56c-2237aa96a852 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:41.034615 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cd7e491f-1012-4907-b56c-2237aa96a852 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:41.035831 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cd7e491f-1012-4907-b56c-2237aa96a852 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:41.036673 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cd7e491f-1012-4907-b56c-2237aa96a852 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:41.037439 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cd7e491f-1012-4907-b56c-2237aa96a852 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:41.211297 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-cd7e491f-1012-4907-b56c-2237aa96a852 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:41.226895 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-cd7e491f-1012-4907-b56c-2237aa96a852 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/424a22f0-ccc3-4fec-bf38-4aaf924928e3" status: 200 len: 1541 microversion: 2.1 time: 0.211597 Oct 04 21:47:41.227757 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 589/1232] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:41 2022] GET /compute/v2.1/servers/424a22f0-ccc3-4fec-bf38-4aaf924928e3 => generated 1541 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:41.410883 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-0dafd518-d429-4162-8913-af1fd6926774 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:41.412048 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-0dafd518-d429-4162-8913-af1fd6926774 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] [instance: 7d71d6d3-3a63-406b-ac49-3e83bd539cf9] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:41.418510 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0dafd518-d429-4162-8913-af1fd6926774 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:41.418996 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0dafd518-d429-4162-8913-af1fd6926774 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:41.419426 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0dafd518-d429-4162-8913-af1fd6926774 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:41.420554 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0dafd518-d429-4162-8913-af1fd6926774 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:41.421262 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0dafd518-d429-4162-8913-af1fd6926774 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:41.421838 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0dafd518-d429-4162-8913-af1fd6926774 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:41.438750 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-0dafd518-d429-4162-8913-af1fd6926774 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] HTTP exception thrown: Instance 7d71d6d3-3a63-406b-ac49-3e83bd539cf9 could not be found. Oct 04 21:47:41.440631 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-0dafd518-d429-4162-8913-af1fd6926774 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Request method failure captured: Oct 04 21:47:41.440631 n-d-860284-1 devstack@n-api.service[134102]: request: GET /compute/v2.1/servers/7d71d6d3-3a63-406b-ac49-3e83bd539cf9 HTTP/1.1 Oct 04 21:47:41.440631 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 21:47:41.440631 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 21:47:41.440631 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 21:47:41.440631 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 21:47:41.440631 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 21:47:41.440631 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 21:47:41.440631 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 21:47:41.440631 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 21:47:41.440631 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPKkKKWGhYvwCdv1J2MeGQ-jOAZuoGQ1lwAe198r71Ukwb_5umfLkuxNfZWiQHMUxBfhv-_5em_OANDxdq4CvMn57rB1IdcDSs2VQnXaxFUQOJQx2QIboBa8MD9AFC6JsgH39EDtpQDm0bx49UHlQ1MXYHpusDcMOOxl5o1LHadq_Xtg Oct 04 21:47:41.440631 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 21:47:41.440631 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 21:47:41.440631 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 21:47:41.440631 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 21:47:41.440631 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 21:47:41.440631 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 21:47:41.440631 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: 39edf587afe94b60911198aa0bb61613 Oct 04 21:47:41.440631 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-ServersOnMultiNodesTest-569263937 Oct 04 21:47:41.440631 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 21:47:41.440631 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 21:47:41.442235 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/39edf587afe94b60911198aa0bb61613"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_39edf587afe94b60911198aa0bb61613", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/39edf587afe94b60911198aa0bb61613"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/39edf587afe94b60911198aa0bb61613"}]}] Oct 04 21:47:41.442235 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-ServersOnMultiNodesTest-569263937 Oct 04 21:47:41.442235 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: 39edf587afe94b60911198aa0bb61613 Oct 04 21:47:41.442235 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-569263937 Oct 04 21:47:41.442235 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-ServersOnMultiNodesTest-569263937-project Oct 04 21:47:41.442235 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 21:47:41.442235 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 21:47:41.442235 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: 29842a669a20408b881105135f76cb0a Oct 04 21:47:41.442235 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-ServersOnMultiNodesTest-569263937-project Oct 04 21:47:41.442235 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 21:47:41.442235 n-d-860284-1 devstack@n-api.service[134102]: exception: Instance 7d71d6d3-3a63-406b-ac49-3e83bd539cf9 could not be found. Oct 04 21:47:41.442235 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': '7d71d6d3-3a63-406b-ac49-3e83bd539cf9'} Oct 04 21:47:41.443262 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:47:41.443262 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:47:41.443262 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:47:41.443262 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:47:41.443262 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:47:41.443262 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:47:41.443262 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:47:41.443262 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:47:41.443262 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:47:41.443262 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:47:41.443262 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d71d6d3-3a63-406b-ac49-3e83bd539cf9 could not be found. Oct 04 21:47:41.443262 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:47:41.443262 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:47:41.443262 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:47:41.443262 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:47:41.443262 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:47:41.443262 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:47:41.443262 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:47:41.443262 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:47:41.443262 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:47:41.444925 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:47:41.444925 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:47:41.444925 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:47:41.444925 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:47:41.444925 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:47:41.444925 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:47:41.444925 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:47:41.444925 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d71d6d3-3a63-406b-ac49-3e83bd539cf9 could not be found. Oct 04 21:47:41.444925 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:47:41.444925 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:47:41.444925 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:47:41.444925 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:47:41.444925 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:47:41.444925 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:47:41.444925 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:47:41.444925 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:47:41.444925 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d71d6d3-3a63-406b-ac49-3e83bd539cf9 could not be found. Oct 04 21:47:41.444925 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:47:41.446164 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-0dafd518-d429-4162-8913-af1fd6926774 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Returning 404 to user: Instance 7d71d6d3-3a63-406b-ac49-3e83bd539cf9 could not be found. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:47:41.446164 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-0dafd518-d429-4162-8913-af1fd6926774 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] 10.222.0.43 "GET /compute/v2.1/servers/7d71d6d3-3a63-406b-ac49-3e83bd539cf9" status: 404 len: 111 microversion: 2.1 time: 0.035359 Oct 04 21:47:41.446164 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 644/1233] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:41 2022] GET /compute/v2.1/servers/7d71d6d3-3a63-406b-ac49-3e83bd539cf9 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:47:41.451025 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-f4a36f52-925b-4811-a512-44ad9e6355e8 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:41.451841 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-f4a36f52-925b-4811-a512-44ad9e6355e8 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] [instance: 258bc0cb-6718-4f8b-8d0b-ef544b2b659b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:41.458182 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f4a36f52-925b-4811-a512-44ad9e6355e8 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:41.459136 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f4a36f52-925b-4811-a512-44ad9e6355e8 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:41.459362 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-0ec5b779-fb5e-4553-8d60-ce1fef97dc3a req-a4ccb5d4-bdb8-4e69-86e9-5f8899a08f65 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f0a02bc-7993-4849-8b3c-7572327b4799", "tag": "c2e7099f-7aa9-4be4-9b2d-631622cf5151"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:47:41.459638 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f4a36f52-925b-4811-a512-44ad9e6355e8 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:41.460354 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f4a36f52-925b-4811-a512-44ad9e6355e8 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:41.460815 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f4a36f52-925b-4811-a512-44ad9e6355e8 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:41.461247 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f4a36f52-925b-4811-a512-44ad9e6355e8 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:41.469304 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-0ec5b779-fb5e-4553-8d60-ce1fef97dc3a req-a4ccb5d4-bdb8-4e69-86e9-5f8899a08f65 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:41.469831 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-0ec5b779-fb5e-4553-8d60-ce1fef97dc3a req-a4ccb5d4-bdb8-4e69-86e9-5f8899a08f65 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:41.470207 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-0ec5b779-fb5e-4553-8d60-ce1fef97dc3a req-a4ccb5d4-bdb8-4e69-86e9-5f8899a08f65 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:41.482943 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-0ec5b779-fb5e-4553-8d60-ce1fef97dc3a req-a4ccb5d4-bdb8-4e69-86e9-5f8899a08f65 service nova] Creating event network-changed:c2e7099f-7aa9-4be4-9b2d-631622cf5151 for instance 3f0a02bc-7993-4849-8b3c-7572327b4799 on n-h1-860284-1 Oct 04 21:47:41.488226 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-0ec5b779-fb5e-4553-8d60-ce1fef97dc3a req-a4ccb5d4-bdb8-4e69-86e9-5f8899a08f65 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032384 Oct 04 21:47:41.489530 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 645/1234] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:47:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:47:41.501806 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f4a36f52-925b-4811-a512-44ad9e6355e8 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:41.502257 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f4a36f52-925b-4811-a512-44ad9e6355e8 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:41.502724 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f4a36f52-925b-4811-a512-44ad9e6355e8 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:41.503350 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.objects.instance [None req-f4a36f52-925b-4811-a512-44ad9e6355e8 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lazy-loading 'fault' on Instance uuid 258bc0cb-6718-4f8b-8d0b-ef544b2b659b {{(pid=134101) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:47:41.547167 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-f4a36f52-925b-4811-a512-44ad9e6355e8 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29842a669a20408b881105135f76cb0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39edf587afe94b60911198aa0bb61613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:41.555573 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-f4a36f52-925b-4811-a512-44ad9e6355e8 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] 10.222.0.43 "GET /compute/v2.1/servers/258bc0cb-6718-4f8b-8d0b-ef544b2b659b" status: 200 len: 1307 microversion: 2.1 time: 0.108384 Oct 04 21:47:41.570850 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 590/1235] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:41 2022] GET /compute/v2.1/servers/258bc0cb-6718-4f8b-8d0b-ef544b2b659b => generated 1307 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:41.664665 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-9c91eb8d-b320-485c-85a3-77e55b436ff2 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:41.665355 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-9c91eb8d-b320-485c-85a3-77e55b436ff2 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] [instance: d4abcd04-329d-40a8-8d6e-4383bef437ae] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:41.671847 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9c91eb8d-b320-485c-85a3-77e55b436ff2 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:41.672326 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9c91eb8d-b320-485c-85a3-77e55b436ff2 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:41.672754 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9c91eb8d-b320-485c-85a3-77e55b436ff2 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:41.673437 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9c91eb8d-b320-485c-85a3-77e55b436ff2 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:41.673885 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9c91eb8d-b320-485c-85a3-77e55b436ff2 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:41.674302 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9c91eb8d-b320-485c-85a3-77e55b436ff2 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:41.808037 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-9c91eb8d-b320-485c-85a3-77e55b436ff2 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:41.816171 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-9c91eb8d-b320-485c-85a3-77e55b436ff2 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:41.817603 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-9c91eb8d-b320-485c-85a3-77e55b436ff2 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:41.819366 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-9c91eb8d-b320-485c-85a3-77e55b436ff2 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] 10.222.0.43 "GET /compute/v2.1/servers/d4abcd04-329d-40a8-8d6e-4383bef437ae" status: 200 len: 1607 microversion: 2.25 time: 0.159237 Oct 04 21:47:41.819926 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 646/1236] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:47:41 2022] GET /compute/v2.1/servers/d4abcd04-329d-40a8-8d6e-4383bef437ae => generated 1607 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:47:41.843877 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-5320e01f-67cc-4424-9372-38a48b6234f9 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:41.844401 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-5320e01f-67cc-4424-9372-38a48b6234f9 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] [instance: d4abcd04-329d-40a8-8d6e-4383bef437ae] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:41.851030 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5320e01f-67cc-4424-9372-38a48b6234f9 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:41.852077 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5320e01f-67cc-4424-9372-38a48b6234f9 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:41.852077 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5320e01f-67cc-4424-9372-38a48b6234f9 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:41.852656 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5320e01f-67cc-4424-9372-38a48b6234f9 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:41.853113 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5320e01f-67cc-4424-9372-38a48b6234f9 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:41.853542 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5320e01f-67cc-4424-9372-38a48b6234f9 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:41.941425 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-5320e01f-67cc-4424-9372-38a48b6234f9 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] 10.222.0.43 "GET /compute/v2.1/servers/d4abcd04-329d-40a8-8d6e-4383bef437ae/os-interface" status: 200 len: 285 microversion: 2.25 time: 0.101357 Oct 04 21:47:41.944836 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 591/1237] 10.222.0.43 () {60 vars in 1316 bytes} [Tue Oct 4 21:47:41 2022] GET /compute/v2.1/servers/d4abcd04-329d-40a8-8d6e-4383bef437ae/os-interface => generated 285 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:47:41.959133 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-d22c5703-9870-4370-a312-52d3c7ad36fb tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:41.959995 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-d22c5703-9870-4370-a312-52d3c7ad36fb tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] [instance: e3380b36-6aba-4736-bcbc-f0058f806d55] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:41.967610 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d22c5703-9870-4370-a312-52d3c7ad36fb tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:41.968131 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d22c5703-9870-4370-a312-52d3c7ad36fb tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:41.968564 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d22c5703-9870-4370-a312-52d3c7ad36fb tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:41.969717 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d22c5703-9870-4370-a312-52d3c7ad36fb tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:41.970172 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d22c5703-9870-4370-a312-52d3c7ad36fb tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:41.970617 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d22c5703-9870-4370-a312-52d3c7ad36fb tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:42.021715 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-5fdb77ab-0f6c-4ba5-809a-498589c97c8d tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Calling method '.version_select at 0x7fbb2eec6280>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:42.078895 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-5fdb77ab-0f6c-4ba5-809a-498589c97c8d tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] 10.222.0.43 "GET /compute/v2.1/images/6b7f3390-fca2-4f36-a6ff-e815f6857c6a" status: 200 len: 1426 microversion: 2.1 time: 0.061505 Oct 04 21:47:42.079476 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 592/1238] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:47:42 2022] GET /compute/v2.1/images/6b7f3390-fca2-4f36-a6ff-e815f6857c6a => generated 1426 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:47:42.090417 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-8f1a0b70-d28f-40ea-93c9-37bdbf5d8052 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:42.091172 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-8f1a0b70-d28f-40ea-93c9-37bdbf5d8052 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 3f0a02bc-7993-4849-8b3c-7572327b4799] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:42.097774 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8f1a0b70-d28f-40ea-93c9-37bdbf5d8052 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:42.098409 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8f1a0b70-d28f-40ea-93c9-37bdbf5d8052 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:42.099624 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8f1a0b70-d28f-40ea-93c9-37bdbf5d8052 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:42.100460 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8f1a0b70-d28f-40ea-93c9-37bdbf5d8052 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:42.100947 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8f1a0b70-d28f-40ea-93c9-37bdbf5d8052 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:42.101686 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8f1a0b70-d28f-40ea-93c9-37bdbf5d8052 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:42.257582 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell0:SELECT=4 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:47:42.374881 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-d22c5703-9870-4370-a312-52d3c7ad36fb tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87616cd16995468ab7febf5aa4b284db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e3bf9149434d34b6762aaeef1478ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:42.384330 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-d22c5703-9870-4370-a312-52d3c7ad36fb tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] 10.222.0.43 "GET /compute/v2.1/servers/e3380b36-6aba-4736-bcbc-f0058f806d55" status: 200 len: 1472 microversion: 2.1 time: 0.432825 Oct 04 21:47:42.385085 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 647/1239] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:41 2022] GET /compute/v2.1/servers/e3380b36-6aba-4736-bcbc-f0058f806d55 => generated 1472 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:42.390356 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-501fb6f8-b6f4-447e-9c95-db5aeef1fd6a tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:42.391128 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-501fb6f8-b6f4-447e-9c95-db5aeef1fd6a tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: 424a22f0-ccc3-4fec-bf38-4aaf924928e3] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:42.398187 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-501fb6f8-b6f4-447e-9c95-db5aeef1fd6a tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:42.399057 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-501fb6f8-b6f4-447e-9c95-db5aeef1fd6a tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:42.399737 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-501fb6f8-b6f4-447e-9c95-db5aeef1fd6a tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:42.400681 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-501fb6f8-b6f4-447e-9c95-db5aeef1fd6a tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:42.401418 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-501fb6f8-b6f4-447e-9c95-db5aeef1fd6a tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:42.401950 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-501fb6f8-b6f4-447e-9c95-db5aeef1fd6a tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:42.417899 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-8f1a0b70-d28f-40ea-93c9-37bdbf5d8052 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ad048becf474fb972d4291422d810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dcfc7024fc49388c4bd5f25f03e60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:42.423540 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell0:SELECT=20 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:47:42.430765 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-8f1a0b70-d28f-40ea-93c9-37bdbf5d8052 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/3f0a02bc-7993-4849-8b3c-7572327b4799" status: 200 len: 1358 microversion: 2.1 time: 0.348789 Oct 04 21:47:42.433315 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 593/1240] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:42 2022] GET /compute/v2.1/servers/3f0a02bc-7993-4849-8b3c-7572327b4799 => generated 1358 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:42.444155 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-6d78d932-cb69-479c-8168-a7a09abc3c2c req-53544281-f14c-477b-ae81-3dc59799e8d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59a1880f-2802-4e72-9a17-b966cfec8fe9", "name": "network-vif-unplugged", "status": "completed", "tag": "893f32f5-2183-4d13-8c2e-2095ab07e2af"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:47:42.457244 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-6d78d932-cb69-479c-8168-a7a09abc3c2c req-53544281-f14c-477b-ae81-3dc59799e8d4 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:42.458887 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-6d78d932-cb69-479c-8168-a7a09abc3c2c req-53544281-f14c-477b-ae81-3dc59799e8d4 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:42.459365 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-6d78d932-cb69-479c-8168-a7a09abc3c2c req-53544281-f14c-477b-ae81-3dc59799e8d4 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:42.477233 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-6d78d932-cb69-479c-8168-a7a09abc3c2c req-53544281-f14c-477b-ae81-3dc59799e8d4 service nova] Creating event network-vif-unplugged:893f32f5-2183-4d13-8c2e-2095ab07e2af for instance 59a1880f-2802-4e72-9a17-b966cfec8fe9 on n-h1-860284-1 Oct 04 21:47:42.482918 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-6d78d932-cb69-479c-8168-a7a09abc3c2c req-53544281-f14c-477b-ae81-3dc59799e8d4 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048088 Oct 04 21:47:42.483537 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 594/1241] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:47:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:47:42.579333 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-d03eb18c-8951-4947-9873-5e90fed57f99 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:42.580032 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-d03eb18c-8951-4947-9873-5e90fed57f99 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] [instance: 258bc0cb-6718-4f8b-8d0b-ef544b2b659b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:42.586870 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d03eb18c-8951-4947-9873-5e90fed57f99 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:42.587364 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d03eb18c-8951-4947-9873-5e90fed57f99 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:42.587801 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d03eb18c-8951-4947-9873-5e90fed57f99 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:42.588499 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d03eb18c-8951-4947-9873-5e90fed57f99 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:42.588962 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d03eb18c-8951-4947-9873-5e90fed57f99 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:42.589391 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d03eb18c-8951-4947-9873-5e90fed57f99 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:42.603241 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-d03eb18c-8951-4947-9873-5e90fed57f99 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] HTTP exception thrown: Instance 258bc0cb-6718-4f8b-8d0b-ef544b2b659b could not be found. Oct 04 21:47:42.604908 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-d03eb18c-8951-4947-9873-5e90fed57f99 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Request method failure captured: Oct 04 21:47:42.604908 n-d-860284-1 devstack@n-api.service[134101]: request: GET /compute/v2.1/servers/258bc0cb-6718-4f8b-8d0b-ef544b2b659b HTTP/1.1 Oct 04 21:47:42.604908 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 21:47:42.604908 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 21:47:42.604908 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 21:47:42.604908 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 21:47:42.604908 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 21:47:42.604908 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 21:47:42.604908 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 21:47:42.604908 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 21:47:42.604908 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPKkKKWGhYvwCdv1J2MeGQ-jOAZuoGQ1lwAe198r71Ukwb_5umfLkuxNfZWiQHMUxBfhv-_5em_OANDxdq4CvMn57rB1IdcDSs2VQnXaxFUQOJQx2QIboBa8MD9AFC6JsgH39EDtpQDm0bx49UHlQ1MXYHpusDcMOOxl5o1LHadq_Xtg Oct 04 21:47:42.604908 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 21:47:42.604908 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 21:47:42.604908 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 21:47:42.604908 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 21:47:42.604908 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 21:47:42.604908 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 21:47:42.604908 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: 39edf587afe94b60911198aa0bb61613 Oct 04 21:47:42.604908 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-ServersOnMultiNodesTest-569263937 Oct 04 21:47:42.604908 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 21:47:42.604908 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 21:47:42.606477 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/39edf587afe94b60911198aa0bb61613"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_39edf587afe94b60911198aa0bb61613", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/39edf587afe94b60911198aa0bb61613"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/39edf587afe94b60911198aa0bb61613"}]}] Oct 04 21:47:42.606477 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-ServersOnMultiNodesTest-569263937 Oct 04 21:47:42.606477 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: 39edf587afe94b60911198aa0bb61613 Oct 04 21:47:42.606477 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-569263937 Oct 04 21:47:42.606477 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-ServersOnMultiNodesTest-569263937-project Oct 04 21:47:42.606477 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 21:47:42.606477 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 21:47:42.606477 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 29842a669a20408b881105135f76cb0a Oct 04 21:47:42.606477 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-ServersOnMultiNodesTest-569263937-project Oct 04 21:47:42.606477 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 21:47:42.606477 n-d-860284-1 devstack@n-api.service[134101]: exception: Instance 258bc0cb-6718-4f8b-8d0b-ef544b2b659b could not be found. Oct 04 21:47:42.606477 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': '258bc0cb-6718-4f8b-8d0b-ef544b2b659b'} Oct 04 21:47:42.607350 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:47:42.607350 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:47:42.607350 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:47:42.607350 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:47:42.607350 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:47:42.607350 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:47:42.607350 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:47:42.607350 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:47:42.607350 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:47:42.607350 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:47:42.607350 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 258bc0cb-6718-4f8b-8d0b-ef544b2b659b could not be found. Oct 04 21:47:42.607350 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:47:42.607350 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:47:42.607350 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:47:42.607350 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:47:42.607350 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:47:42.607350 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:47:42.607350 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:47:42.607350 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:47:42.607350 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:47:42.608734 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:47:42.608734 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:47:42.608734 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:47:42.608734 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:47:42.608734 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:47:42.608734 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:47:42.608734 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:47:42.608734 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 258bc0cb-6718-4f8b-8d0b-ef544b2b659b could not be found. Oct 04 21:47:42.608734 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:47:42.608734 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:47:42.608734 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:47:42.608734 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:47:42.608734 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:47:42.608734 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:47:42.608734 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:47:42.608734 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:47:42.608734 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 258bc0cb-6718-4f8b-8d0b-ef544b2b659b could not be found. Oct 04 21:47:42.608734 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:47:42.610292 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-d03eb18c-8951-4947-9873-5e90fed57f99 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Returning 404 to user: Instance 258bc0cb-6718-4f8b-8d0b-ef544b2b659b could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:47:42.610292 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-d03eb18c-8951-4947-9873-5e90fed57f99 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] 10.222.0.43 "GET /compute/v2.1/servers/258bc0cb-6718-4f8b-8d0b-ef544b2b659b" status: 404 len: 111 microversion: 2.1 time: 0.031234 Oct 04 21:47:42.610292 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 595/1242] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:42 2022] GET /compute/v2.1/servers/258bc0cb-6718-4f8b-8d0b-ef544b2b659b => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 21:47:42.615073 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-307fafde-c51a-4962-832f-f14b83ac73f3 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:42.643144 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-307fafde-c51a-4962-832f-f14b83ac73f3 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] 10.222.0.43 "DELETE /compute/v2.1/os-server-groups/42779ba1-4f53-45cc-b681-4aca803828ae" status: 204 len: 0 microversion: 2.1 time: 0.031933 Oct 04 21:47:42.644307 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 596/1243] 10.222.0.43 () {58 vars in 1266 bytes} [Tue Oct 4 21:47:42 2022] DELETE /compute/v2.1/os-server-groups/42779ba1-4f53-45cc-b681-4aca803828ae => generated 0 bytes in 33 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:47:42.652213 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-f2f562b7-4d84-4857-856b-ea5e1623114e tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:42.652864 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-f2f562b7-4d84-4857-856b-ea5e1623114e tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] [instance: 4b0c3dd7-d609-4b00-8604-35f8a2680c14] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:42.660330 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f2f562b7-4d84-4857-856b-ea5e1623114e tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:42.660823 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f2f562b7-4d84-4857-856b-ea5e1623114e tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:42.661257 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f2f562b7-4d84-4857-856b-ea5e1623114e tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:42.661982 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f2f562b7-4d84-4857-856b-ea5e1623114e tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:42.662452 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f2f562b7-4d84-4857-856b-ea5e1623114e tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:42.663013 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f2f562b7-4d84-4857-856b-ea5e1623114e tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:42.691276 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-f2f562b7-4d84-4857-856b-ea5e1623114e tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] [instance: 4b0c3dd7-d609-4b00-8604-35f8a2680c14] Going to try to terminate instance {{(pid=134101) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:47:42.696713 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:47:42.767962 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-501fb6f8-b6f4-447e-9c95-db5aeef1fd6a tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:42.785290 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-f2f562b7-4d84-4857-856b-ea5e1623114e tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] 10.222.0.43 "DELETE /compute/v2.1/servers/4b0c3dd7-d609-4b00-8604-35f8a2680c14" status: 204 len: 0 microversion: 2.1 time: 0.136583 Oct 04 21:47:42.787084 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 597/1244] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 21:47:42 2022] DELETE /compute/v2.1/servers/4b0c3dd7-d609-4b00-8604-35f8a2680c14 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 21:47:42.792881 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-501fb6f8-b6f4-447e-9c95-db5aeef1fd6a tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/424a22f0-ccc3-4fec-bf38-4aaf924928e3" status: 200 len: 1541 microversion: 2.1 time: 0.406042 Oct 04 21:47:42.793496 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 648/1245] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:42 2022] GET /compute/v2.1/servers/424a22f0-ccc3-4fec-bf38-4aaf924928e3 => generated 1541 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:42.799429 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-a9db5720-42e1-404d-b9f7-cee1b7b380f3 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:42.800915 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-a9db5720-42e1-404d-b9f7-cee1b7b380f3 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] [instance: 4b0c3dd7-d609-4b00-8604-35f8a2680c14] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:42.809190 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a9db5720-42e1-404d-b9f7-cee1b7b380f3 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:42.809700 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a9db5720-42e1-404d-b9f7-cee1b7b380f3 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:42.810049 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a9db5720-42e1-404d-b9f7-cee1b7b380f3 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:42.810956 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a9db5720-42e1-404d-b9f7-cee1b7b380f3 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:42.811486 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a9db5720-42e1-404d-b9f7-cee1b7b380f3 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:42.812273 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a9db5720-42e1-404d-b9f7-cee1b7b380f3 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:43.095215 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-3c04ff9a-5d29-4869-a05d-ed07a3cca4d6 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Calling method '.version_select at 0x7fbb2f052670>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:43.148322 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-3c04ff9a-5d29-4869-a05d-ed07a3cca4d6 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] 10.222.0.43 "GET /compute/v2.1/images/6b7f3390-fca2-4f36-a6ff-e815f6857c6a" status: 200 len: 1426 microversion: 2.1 time: 0.057030 Oct 04 21:47:43.149113 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 649/1246] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:47:43 2022] GET /compute/v2.1/images/6b7f3390-fca2-4f36-a6ff-e815f6857c6a => generated 1426 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:47:43.315361 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-a9db5720-42e1-404d-b9f7-cee1b7b380f3 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29842a669a20408b881105135f76cb0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39edf587afe94b60911198aa0bb61613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:43.324234 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-a9db5720-42e1-404d-b9f7-cee1b7b380f3 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] 10.222.0.43 "GET /compute/v2.1/servers/4b0c3dd7-d609-4b00-8604-35f8a2680c14" status: 200 len: 1471 microversion: 2.1 time: 0.530680 Oct 04 21:47:43.324814 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 598/1247] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:42 2022] GET /compute/v2.1/servers/4b0c3dd7-d609-4b00-8604-35f8a2680c14 => generated 1471 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:43.409413 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-b5f0d03f-1340-401f-856f-5e0770c2323a tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:43.410023 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-b5f0d03f-1340-401f-856f-5e0770c2323a tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] [instance: e3380b36-6aba-4736-bcbc-f0058f806d55] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:43.417971 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b5f0d03f-1340-401f-856f-5e0770c2323a tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:43.418512 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b5f0d03f-1340-401f-856f-5e0770c2323a tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:43.418909 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b5f0d03f-1340-401f-856f-5e0770c2323a tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:43.419606 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b5f0d03f-1340-401f-856f-5e0770c2323a tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:43.420056 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b5f0d03f-1340-401f-856f-5e0770c2323a tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:43.420477 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b5f0d03f-1340-401f-856f-5e0770c2323a tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:43.461611 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-40e19836-b7b9-42d8-983b-ecdce19542bf tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:43.462225 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-40e19836-b7b9-42d8-983b-ecdce19542bf tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 3f0a02bc-7993-4849-8b3c-7572327b4799] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:43.469089 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-40e19836-b7b9-42d8-983b-ecdce19542bf tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:43.469578 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-40e19836-b7b9-42d8-983b-ecdce19542bf tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:43.470007 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-40e19836-b7b9-42d8-983b-ecdce19542bf tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:43.470742 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-40e19836-b7b9-42d8-983b-ecdce19542bf tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:43.471195 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-40e19836-b7b9-42d8-983b-ecdce19542bf tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:43.471620 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-40e19836-b7b9-42d8-983b-ecdce19542bf tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:43.721958 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-b5f0d03f-1340-401f-856f-5e0770c2323a tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87616cd16995468ab7febf5aa4b284db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e3bf9149434d34b6762aaeef1478ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:43.730415 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-b5f0d03f-1340-401f-856f-5e0770c2323a tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] 10.222.0.43 "GET /compute/v2.1/servers/e3380b36-6aba-4736-bcbc-f0058f806d55" status: 200 len: 1472 microversion: 2.1 time: 0.325333 Oct 04 21:47:43.730970 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 650/1248] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:43 2022] GET /compute/v2.1/servers/e3380b36-6aba-4736-bcbc-f0058f806d55 => generated 1472 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:43.738295 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-40e19836-b7b9-42d8-983b-ecdce19542bf tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ad048becf474fb972d4291422d810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dcfc7024fc49388c4bd5f25f03e60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:43.748181 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-40e19836-b7b9-42d8-983b-ecdce19542bf tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/3f0a02bc-7993-4849-8b3c-7572327b4799" status: 200 len: 1358 microversion: 2.1 time: 0.293804 Oct 04 21:47:43.749071 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 599/1249] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:43 2022] GET /compute/v2.1/servers/3f0a02bc-7993-4849-8b3c-7572327b4799 => generated 1358 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:47:43.817260 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-2b7d7a16-e539-4580-9bfc-b13d59aedc67 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:43.818450 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-2b7d7a16-e539-4580-9bfc-b13d59aedc67 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: 424a22f0-ccc3-4fec-bf38-4aaf924928e3] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:43.824520 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2b7d7a16-e539-4580-9bfc-b13d59aedc67 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:43.825034 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2b7d7a16-e539-4580-9bfc-b13d59aedc67 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:43.825422 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2b7d7a16-e539-4580-9bfc-b13d59aedc67 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:43.826108 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2b7d7a16-e539-4580-9bfc-b13d59aedc67 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:43.826584 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2b7d7a16-e539-4580-9bfc-b13d59aedc67 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:43.827005 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2b7d7a16-e539-4580-9bfc-b13d59aedc67 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:43.925544 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-09f58d87-de18-4f9f-bfa2-2a319fafd165 req-9a71761b-e4ed-4e1e-9627-f7d3b50819e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4abcd04-329d-40a8-8d6e-4383bef437ae", "tag": "000d4b8f-4676-41c0-a0c8-303e63366262"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:47:43.936825 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-09f58d87-de18-4f9f-bfa2-2a319fafd165 req-9a71761b-e4ed-4e1e-9627-f7d3b50819e9 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:43.937311 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-09f58d87-de18-4f9f-bfa2-2a319fafd165 req-9a71761b-e4ed-4e1e-9627-f7d3b50819e9 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:43.937747 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-09f58d87-de18-4f9f-bfa2-2a319fafd165 req-9a71761b-e4ed-4e1e-9627-f7d3b50819e9 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:43.950121 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-09f58d87-de18-4f9f-bfa2-2a319fafd165 req-9a71761b-e4ed-4e1e-9627-f7d3b50819e9 service nova] Creating event network-changed:000d4b8f-4676-41c0-a0c8-303e63366262 for instance d4abcd04-329d-40a8-8d6e-4383bef437ae on n-h1-860284-1 Oct 04 21:47:43.956236 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-09f58d87-de18-4f9f-bfa2-2a319fafd165 req-9a71761b-e4ed-4e1e-9627-f7d3b50819e9 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033669 Oct 04 21:47:43.957178 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 600/1250] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:47:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:47:43.993036 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-2b7d7a16-e539-4580-9bfc-b13d59aedc67 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:44.000968 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-2b7d7a16-e539-4580-9bfc-b13d59aedc67 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/424a22f0-ccc3-4fec-bf38-4aaf924928e3" status: 200 len: 1541 microversion: 2.1 time: 0.187544 Oct 04 21:47:44.001563 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 651/1251] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:43 2022] GET /compute/v2.1/servers/424a22f0-ccc3-4fec-bf38-4aaf924928e3 => generated 1541 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:44.165168 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-53125387-1dda-4bd7-b9ad-ed4759dd11ec tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Calling method '.version_select at 0x7fbb2eee1040>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:44.221597 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-53125387-1dda-4bd7-b9ad-ed4759dd11ec tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] 10.222.0.43 "GET /compute/v2.1/images/6b7f3390-fca2-4f36-a6ff-e815f6857c6a" status: 200 len: 1426 microversion: 2.1 time: 0.061013 Oct 04 21:47:44.222336 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 601/1252] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:47:44 2022] GET /compute/v2.1/images/6b7f3390-fca2-4f36-a6ff-e815f6857c6a => generated 1426 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:44.349655 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-2c6c3962-1561-48d1-923f-e2029231c3f6 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:44.350409 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-2c6c3962-1561-48d1-923f-e2029231c3f6 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] [instance: 4b0c3dd7-d609-4b00-8604-35f8a2680c14] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:44.357804 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2c6c3962-1561-48d1-923f-e2029231c3f6 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:44.358294 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2c6c3962-1561-48d1-923f-e2029231c3f6 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:44.358769 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2c6c3962-1561-48d1-923f-e2029231c3f6 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:44.359485 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2c6c3962-1561-48d1-923f-e2029231c3f6 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:44.359947 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2c6c3962-1561-48d1-923f-e2029231c3f6 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:44.360378 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2c6c3962-1561-48d1-923f-e2029231c3f6 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:44.521661 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-2c6c3962-1561-48d1-923f-e2029231c3f6 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29842a669a20408b881105135f76cb0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39edf587afe94b60911198aa0bb61613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:44.529914 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-2c6c3962-1561-48d1-923f-e2029231c3f6 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] 10.222.0.43 "GET /compute/v2.1/servers/4b0c3dd7-d609-4b00-8604-35f8a2680c14" status: 200 len: 1471 microversion: 2.1 time: 0.184963 Oct 04 21:47:44.530521 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 652/1253] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:44 2022] GET /compute/v2.1/servers/4b0c3dd7-d609-4b00-8604-35f8a2680c14 => generated 1471 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:44.758012 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-49f1555b-f9bf-4ed3-808a-55b78bbf2819 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:44.758811 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-49f1555b-f9bf-4ed3-808a-55b78bbf2819 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] [instance: e3380b36-6aba-4736-bcbc-f0058f806d55] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:44.765345 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-49f1555b-f9bf-4ed3-808a-55b78bbf2819 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:44.765835 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-49f1555b-f9bf-4ed3-808a-55b78bbf2819 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:44.766271 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-49f1555b-f9bf-4ed3-808a-55b78bbf2819 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:44.767305 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-49f1555b-f9bf-4ed3-808a-55b78bbf2819 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:44.767767 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-49f1555b-f9bf-4ed3-808a-55b78bbf2819 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:44.768382 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-49f1555b-f9bf-4ed3-808a-55b78bbf2819 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:44.772414 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-92e33bb6-b3ed-4795-9b73-d2d2b40f85cd tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:44.773042 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-92e33bb6-b3ed-4795-9b73-d2d2b40f85cd tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 3f0a02bc-7993-4849-8b3c-7572327b4799] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:44.779556 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-92e33bb6-b3ed-4795-9b73-d2d2b40f85cd tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:44.780051 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-92e33bb6-b3ed-4795-9b73-d2d2b40f85cd tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:44.780490 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-92e33bb6-b3ed-4795-9b73-d2d2b40f85cd tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:44.781204 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-92e33bb6-b3ed-4795-9b73-d2d2b40f85cd tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:44.781664 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-92e33bb6-b3ed-4795-9b73-d2d2b40f85cd tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:44.782094 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-92e33bb6-b3ed-4795-9b73-d2d2b40f85cd tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:44.979316 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-49f1555b-f9bf-4ed3-808a-55b78bbf2819 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87616cd16995468ab7febf5aa4b284db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e3bf9149434d34b6762aaeef1478ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:44.983377 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-92e33bb6-b3ed-4795-9b73-d2d2b40f85cd tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ad048becf474fb972d4291422d810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dcfc7024fc49388c4bd5f25f03e60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:44.987395 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-49f1555b-f9bf-4ed3-808a-55b78bbf2819 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] 10.222.0.43 "GET /compute/v2.1/servers/e3380b36-6aba-4736-bcbc-f0058f806d55" status: 200 len: 1472 microversion: 2.1 time: 0.234627 Oct 04 21:47:44.987989 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 602/1254] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:44 2022] GET /compute/v2.1/servers/e3380b36-6aba-4736-bcbc-f0058f806d55 => generated 1472 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:44.993568 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-92e33bb6-b3ed-4795-9b73-d2d2b40f85cd tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/3f0a02bc-7993-4849-8b3c-7572327b4799" status: 200 len: 1358 microversion: 2.1 time: 0.225230 Oct 04 21:47:44.994156 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 653/1255] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:44 2022] GET /compute/v2.1/servers/3f0a02bc-7993-4849-8b3c-7572327b4799 => generated 1358 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:47:45.025923 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-51c4440d-1d11-4246-95dd-6c7adeaf701f tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:45.026661 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-51c4440d-1d11-4246-95dd-6c7adeaf701f tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: 424a22f0-ccc3-4fec-bf38-4aaf924928e3] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:45.033156 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-51c4440d-1d11-4246-95dd-6c7adeaf701f tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:45.033657 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-51c4440d-1d11-4246-95dd-6c7adeaf701f tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:45.034097 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-51c4440d-1d11-4246-95dd-6c7adeaf701f tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:45.034837 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-51c4440d-1d11-4246-95dd-6c7adeaf701f tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:45.035297 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-51c4440d-1d11-4246-95dd-6c7adeaf701f tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:45.035728 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-51c4440d-1d11-4246-95dd-6c7adeaf701f tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:45.168419 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-51c4440d-1d11-4246-95dd-6c7adeaf701f tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:45.176842 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-51c4440d-1d11-4246-95dd-6c7adeaf701f tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/424a22f0-ccc3-4fec-bf38-4aaf924928e3" status: 200 len: 1541 microversion: 2.1 time: 0.155733 Oct 04 21:47:45.178499 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 603/1256] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:45 2022] GET /compute/v2.1/servers/424a22f0-ccc3-4fec-bf38-4aaf924928e3 => generated 1541 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:45.237421 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-b9520bc6-854d-4876-b06c-7fec4ecd5c1b tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Calling method '.version_select at 0x7fbb2f073280>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:45.286244 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-b9520bc6-854d-4876-b06c-7fec4ecd5c1b tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] 10.222.0.43 "GET /compute/v2.1/images/6b7f3390-fca2-4f36-a6ff-e815f6857c6a" status: 200 len: 1426 microversion: 2.1 time: 0.052568 Oct 04 21:47:45.287524 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 654/1257] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:47:45 2022] GET /compute/v2.1/images/6b7f3390-fca2-4f36-a6ff-e815f6857c6a => generated 1426 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:45.553425 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-b9874606-c621-4e60-a844-efb119d3f183 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:45.554074 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-b9874606-c621-4e60-a844-efb119d3f183 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] [instance: 4b0c3dd7-d609-4b00-8604-35f8a2680c14] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:45.560108 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b9874606-c621-4e60-a844-efb119d3f183 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:45.560602 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b9874606-c621-4e60-a844-efb119d3f183 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:45.561040 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b9874606-c621-4e60-a844-efb119d3f183 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:45.561786 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b9874606-c621-4e60-a844-efb119d3f183 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:45.562246 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b9874606-c621-4e60-a844-efb119d3f183 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:45.562703 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b9874606-c621-4e60-a844-efb119d3f183 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:45.712224 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-b9874606-c621-4e60-a844-efb119d3f183 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29842a669a20408b881105135f76cb0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39edf587afe94b60911198aa0bb61613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:45.720540 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-b9874606-c621-4e60-a844-efb119d3f183 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] 10.222.0.43 "GET /compute/v2.1/servers/4b0c3dd7-d609-4b00-8604-35f8a2680c14" status: 200 len: 1471 microversion: 2.1 time: 0.171739 Oct 04 21:47:45.721147 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 604/1258] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:45 2022] GET /compute/v2.1/servers/4b0c3dd7-d609-4b00-8604-35f8a2680c14 => generated 1471 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:46.014356 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-33f81707-7662-4839-80b3-6de7c6374990 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:46.015103 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-33f81707-7662-4839-80b3-6de7c6374990 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] [instance: e3380b36-6aba-4736-bcbc-f0058f806d55] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:46.026003 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-6f75fcea-81fe-4715-a915-770427db075d tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:46.027621 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-33f81707-7662-4839-80b3-6de7c6374990 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:46.028124 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-33f81707-7662-4839-80b3-6de7c6374990 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:46.028638 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-33f81707-7662-4839-80b3-6de7c6374990 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:46.029127 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-6f75fcea-81fe-4715-a915-770427db075d tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 3f0a02bc-7993-4849-8b3c-7572327b4799] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:46.030805 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-33f81707-7662-4839-80b3-6de7c6374990 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:46.031349 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-33f81707-7662-4839-80b3-6de7c6374990 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:46.034282 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-33f81707-7662-4839-80b3-6de7c6374990 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:46.037478 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6f75fcea-81fe-4715-a915-770427db075d tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:46.037978 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6f75fcea-81fe-4715-a915-770427db075d tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:46.039280 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6f75fcea-81fe-4715-a915-770427db075d tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:46.040030 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6f75fcea-81fe-4715-a915-770427db075d tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:46.040498 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6f75fcea-81fe-4715-a915-770427db075d tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:46.041492 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6f75fcea-81fe-4715-a915-770427db075d tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:46.276857 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-33f81707-7662-4839-80b3-6de7c6374990 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87616cd16995468ab7febf5aa4b284db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e3bf9149434d34b6762aaeef1478ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:46.281261 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-6f75fcea-81fe-4715-a915-770427db075d tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ad048becf474fb972d4291422d810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dcfc7024fc49388c4bd5f25f03e60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:46.285508 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-33f81707-7662-4839-80b3-6de7c6374990 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] 10.222.0.43 "GET /compute/v2.1/servers/e3380b36-6aba-4736-bcbc-f0058f806d55" status: 200 len: 1472 microversion: 2.1 time: 0.276116 Oct 04 21:47:46.289746 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-6f75fcea-81fe-4715-a915-770427db075d tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/3f0a02bc-7993-4849-8b3c-7572327b4799" status: 200 len: 1358 microversion: 2.1 time: 0.270554 Oct 04 21:47:46.290658 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 655/1260] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:46 2022] GET /compute/v2.1/servers/e3380b36-6aba-4736-bcbc-f0058f806d55 => generated 1472 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:46.296462 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-0a404f12-78da-401a-804f-b8fa45587992 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:46.299179 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-0a404f12-78da-401a-804f-b8fa45587992 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: 424a22f0-ccc3-4fec-bf38-4aaf924928e3] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:46.303309 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 605/1259] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:46 2022] GET /compute/v2.1/servers/3f0a02bc-7993-4849-8b3c-7572327b4799 => generated 1358 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:46.312943 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-24c6dee4-0714-4988-84aa-a37fca522a27 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Calling method '.version_select at 0x7fbb2ee88dc0>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:46.319612 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0a404f12-78da-401a-804f-b8fa45587992 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:46.320525 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0a404f12-78da-401a-804f-b8fa45587992 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:46.322116 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0a404f12-78da-401a-804f-b8fa45587992 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:46.323095 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0a404f12-78da-401a-804f-b8fa45587992 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:46.323849 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0a404f12-78da-401a-804f-b8fa45587992 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:46.324618 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0a404f12-78da-401a-804f-b8fa45587992 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:46.361199 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-24c6dee4-0714-4988-84aa-a37fca522a27 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] 10.222.0.43 "GET /compute/v2.1/images/6b7f3390-fca2-4f36-a6ff-e815f6857c6a" status: 200 len: 1426 microversion: 2.1 time: 0.052498 Oct 04 21:47:46.361773 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 606/1261] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:47:46 2022] GET /compute/v2.1/images/6b7f3390-fca2-4f36-a6ff-e815f6857c6a => generated 1426 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:46.493657 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-0a404f12-78da-401a-804f-b8fa45587992 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:46.501800 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-0a404f12-78da-401a-804f-b8fa45587992 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/424a22f0-ccc3-4fec-bf38-4aaf924928e3" status: 200 len: 1540 microversion: 2.1 time: 0.208954 Oct 04 21:47:46.502428 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 656/1262] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:46 2022] GET /compute/v2.1/servers/424a22f0-ccc3-4fec-bf38-4aaf924928e3 => generated 1540 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:46.745238 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-2be8a580-5ff8-4770-9e8e-5203d96a3179 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:46.745857 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-2be8a580-5ff8-4770-9e8e-5203d96a3179 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] [instance: 4b0c3dd7-d609-4b00-8604-35f8a2680c14] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:46.752549 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2be8a580-5ff8-4770-9e8e-5203d96a3179 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:46.753141 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2be8a580-5ff8-4770-9e8e-5203d96a3179 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:46.753805 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2be8a580-5ff8-4770-9e8e-5203d96a3179 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:46.754777 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2be8a580-5ff8-4770-9e8e-5203d96a3179 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:46.755301 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2be8a580-5ff8-4770-9e8e-5203d96a3179 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:46.756058 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2be8a580-5ff8-4770-9e8e-5203d96a3179 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:46.922261 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-2be8a580-5ff8-4770-9e8e-5203d96a3179 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29842a669a20408b881105135f76cb0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39edf587afe94b60911198aa0bb61613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:46.932577 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-2be8a580-5ff8-4770-9e8e-5203d96a3179 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] 10.222.0.43 "GET /compute/v2.1/servers/4b0c3dd7-d609-4b00-8604-35f8a2680c14" status: 200 len: 1471 microversion: 2.1 time: 0.191251 Oct 04 21:47:46.933273 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 607/1263] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:46 2022] GET /compute/v2.1/servers/4b0c3dd7-d609-4b00-8604-35f8a2680c14 => generated 1471 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:47.299194 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-5fb94b92-75a7-4f21-a5a0-95a8c04661df req-8bac0ea4-c195-4b29-8ce1-f76dc015439f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b0c3dd7-d609-4b00-8604-35f8a2680c14", "name": "network-vif-deleted", "tag": "b5c45de7-635e-4f30-8ac6-17479c140cb5"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:47:47.316049 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-0423b3e7-ae8d-42a8-9d2e-0e00734debc2 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:47.317464 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-0423b3e7-ae8d-42a8-9d2e-0e00734debc2 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] [instance: e3380b36-6aba-4736-bcbc-f0058f806d55] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:47.319076 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-5fb94b92-75a7-4f21-a5a0-95a8c04661df req-8bac0ea4-c195-4b29-8ce1-f76dc015439f service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:47.319932 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-5fb94b92-75a7-4f21-a5a0-95a8c04661df req-8bac0ea4-c195-4b29-8ce1-f76dc015439f service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:47.320650 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-5fb94b92-75a7-4f21-a5a0-95a8c04661df req-8bac0ea4-c195-4b29-8ce1-f76dc015439f service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:47.329790 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0423b3e7-ae8d-42a8-9d2e-0e00734debc2 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:47.330318 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0423b3e7-ae8d-42a8-9d2e-0e00734debc2 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:47.330939 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0423b3e7-ae8d-42a8-9d2e-0e00734debc2 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:47.331892 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0423b3e7-ae8d-42a8-9d2e-0e00734debc2 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:47.332522 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0423b3e7-ae8d-42a8-9d2e-0e00734debc2 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:47.334007 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0423b3e7-ae8d-42a8-9d2e-0e00734debc2 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:47.336406 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-5fb94b92-75a7-4f21-a5a0-95a8c04661df req-8bac0ea4-c195-4b29-8ce1-f76dc015439f service nova] Creating event network-vif-deleted:b5c45de7-635e-4f30-8ac6-17479c140cb5 for instance 4b0c3dd7-d609-4b00-8604-35f8a2680c14 on n-h2-860284-1 Oct 04 21:47:47.344589 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-5fb94b92-75a7-4f21-a5a0-95a8c04661df req-8bac0ea4-c195-4b29-8ce1-f76dc015439f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048972 Oct 04 21:47:47.345321 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 657/1264] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:47:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:47:47.354544 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-b310d315-1b65-49dd-b88f-2f1df9cae372 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:47.355279 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-b310d315-1b65-49dd-b88f-2f1df9cae372 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 3f0a02bc-7993-4849-8b3c-7572327b4799] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:47.368134 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b310d315-1b65-49dd-b88f-2f1df9cae372 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:47.370886 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b310d315-1b65-49dd-b88f-2f1df9cae372 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:47.371685 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b310d315-1b65-49dd-b88f-2f1df9cae372 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:47.373401 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b310d315-1b65-49dd-b88f-2f1df9cae372 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:47.375672 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b310d315-1b65-49dd-b88f-2f1df9cae372 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:47.376140 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b310d315-1b65-49dd-b88f-2f1df9cae372 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:47.538072 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-0423b3e7-ae8d-42a8-9d2e-0e00734debc2 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87616cd16995468ab7febf5aa4b284db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e3bf9149434d34b6762aaeef1478ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:47.547898 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-0423b3e7-ae8d-42a8-9d2e-0e00734debc2 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] 10.222.0.43 "GET /compute/v2.1/servers/e3380b36-6aba-4736-bcbc-f0058f806d55" status: 200 len: 1472 microversion: 2.1 time: 0.236211 Oct 04 21:47:47.549524 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 608/1265] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:47 2022] GET /compute/v2.1/servers/e3380b36-6aba-4736-bcbc-f0058f806d55 => generated 1472 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:47.555045 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-f7f02bf2-2d84-4499-81cb-47a546cd0c18 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Calling method '.version_select at 0x7fbb2eec65e0>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:47.621493 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-b310d315-1b65-49dd-b88f-2f1df9cae372 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ad048becf474fb972d4291422d810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dcfc7024fc49388c4bd5f25f03e60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:47.630790 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-b310d315-1b65-49dd-b88f-2f1df9cae372 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/3f0a02bc-7993-4849-8b3c-7572327b4799" status: 200 len: 1358 microversion: 2.1 time: 0.281705 Oct 04 21:47:47.631528 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 658/1266] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:47 2022] GET /compute/v2.1/servers/3f0a02bc-7993-4849-8b3c-7572327b4799 => generated 1358 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:47.636429 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-8b07b4a7-7d41-4cce-9efe-e4a038407f42 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:47.637351 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-8b07b4a7-7d41-4cce-9efe-e4a038407f42 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: 424a22f0-ccc3-4fec-bf38-4aaf924928e3] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:47.641299 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-f7f02bf2-2d84-4499-81cb-47a546cd0c18 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] 10.222.0.43 "GET /compute/v2.1/images/6b7f3390-fca2-4f36-a6ff-e815f6857c6a" status: 200 len: 1426 microversion: 2.1 time: 0.078712 Oct 04 21:47:47.644209 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8b07b4a7-7d41-4cce-9efe-e4a038407f42 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:47.644981 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8b07b4a7-7d41-4cce-9efe-e4a038407f42 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:47.645703 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8b07b4a7-7d41-4cce-9efe-e4a038407f42 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:47.647252 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8b07b4a7-7d41-4cce-9efe-e4a038407f42 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:47.647917 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8b07b4a7-7d41-4cce-9efe-e4a038407f42 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:47.648701 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8b07b4a7-7d41-4cce-9efe-e4a038407f42 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:47.652881 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 609/1267] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:47:47 2022] GET /compute/v2.1/images/6b7f3390-fca2-4f36-a6ff-e815f6857c6a => generated 1426 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:47.835885 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-8b07b4a7-7d41-4cce-9efe-e4a038407f42 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:47.843971 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-8b07b4a7-7d41-4cce-9efe-e4a038407f42 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/424a22f0-ccc3-4fec-bf38-4aaf924928e3" status: 200 len: 1540 microversion: 2.1 time: 0.211130 Oct 04 21:47:47.844570 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 659/1268] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:47 2022] GET /compute/v2.1/servers/424a22f0-ccc3-4fec-bf38-4aaf924928e3 => generated 1540 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:47.955998 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-4825e410-d69b-4efd-8eca-57296092fd05 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:47.956852 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-4825e410-d69b-4efd-8eca-57296092fd05 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] [instance: 4b0c3dd7-d609-4b00-8604-35f8a2680c14] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:47.965423 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4825e410-d69b-4efd-8eca-57296092fd05 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:47.966015 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4825e410-d69b-4efd-8eca-57296092fd05 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:47.966583 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4825e410-d69b-4efd-8eca-57296092fd05 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:47.967344 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4825e410-d69b-4efd-8eca-57296092fd05 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:47.968002 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4825e410-d69b-4efd-8eca-57296092fd05 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:47.968442 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4825e410-d69b-4efd-8eca-57296092fd05 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:48.002240 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4825e410-d69b-4efd-8eca-57296092fd05 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:48.002765 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4825e410-d69b-4efd-8eca-57296092fd05 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:48.003400 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4825e410-d69b-4efd-8eca-57296092fd05 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:48.003859 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.objects.instance [None req-4825e410-d69b-4efd-8eca-57296092fd05 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lazy-loading 'fault' on Instance uuid 4b0c3dd7-d609-4b00-8604-35f8a2680c14 {{(pid=134101) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:47:48.049985 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-4825e410-d69b-4efd-8eca-57296092fd05 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29842a669a20408b881105135f76cb0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39edf587afe94b60911198aa0bb61613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:48.060095 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-4825e410-d69b-4efd-8eca-57296092fd05 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] 10.222.0.43 "GET /compute/v2.1/servers/4b0c3dd7-d609-4b00-8604-35f8a2680c14" status: 200 len: 1306 microversion: 2.1 time: 0.108129 Oct 04 21:47:48.060881 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 610/1269] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:47 2022] GET /compute/v2.1/servers/4b0c3dd7-d609-4b00-8604-35f8a2680c14 => generated 1306 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:48.571759 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-bfb128a6-fca4-455f-a117-2ca5da95dc09 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:48.572372 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-bfb128a6-fca4-455f-a117-2ca5da95dc09 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] [instance: e3380b36-6aba-4736-bcbc-f0058f806d55] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:48.579009 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bfb128a6-fca4-455f-a117-2ca5da95dc09 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:48.579506 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bfb128a6-fca4-455f-a117-2ca5da95dc09 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:48.579999 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bfb128a6-fca4-455f-a117-2ca5da95dc09 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:48.580797 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bfb128a6-fca4-455f-a117-2ca5da95dc09 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:48.581295 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bfb128a6-fca4-455f-a117-2ca5da95dc09 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:48.582200 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bfb128a6-fca4-455f-a117-2ca5da95dc09 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:48.656279 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-13621320-80e9-477e-8ec1-6734ef581333 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:48.656964 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-13621320-80e9-477e-8ec1-6734ef581333 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 3f0a02bc-7993-4849-8b3c-7572327b4799] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:48.663637 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-13621320-80e9-477e-8ec1-6734ef581333 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:48.664155 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-13621320-80e9-477e-8ec1-6734ef581333 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:48.664553 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-13621320-80e9-477e-8ec1-6734ef581333 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:48.665263 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-13621320-80e9-477e-8ec1-6734ef581333 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:48.665725 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-13621320-80e9-477e-8ec1-6734ef581333 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:48.666154 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-13621320-80e9-477e-8ec1-6734ef581333 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:48.753779 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-bfb128a6-fca4-455f-a117-2ca5da95dc09 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87616cd16995468ab7febf5aa4b284db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e3bf9149434d34b6762aaeef1478ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:48.762484 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-bfb128a6-fca4-455f-a117-2ca5da95dc09 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] 10.222.0.43 "GET /compute/v2.1/servers/e3380b36-6aba-4736-bcbc-f0058f806d55" status: 200 len: 1472 microversion: 2.1 time: 0.195490 Oct 04 21:47:48.763066 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 660/1270] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:48 2022] GET /compute/v2.1/servers/e3380b36-6aba-4736-bcbc-f0058f806d55 => generated 1472 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:48.774533 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-84977a7b-407b-4f1a-8402-fc358d90bd36 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Calling method '.version_select at 0x7fbb2f053550>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:48.815917 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-84977a7b-407b-4f1a-8402-fc358d90bd36 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] 10.222.0.43 "GET /compute/v2.1/images/6b7f3390-fca2-4f36-a6ff-e815f6857c6a" status: 200 len: 1426 microversion: 2.1 time: 0.051740 Oct 04 21:47:48.816506 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 661/1271] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:47:48 2022] GET /compute/v2.1/images/6b7f3390-fca2-4f36-a6ff-e815f6857c6a => generated 1426 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:48.818518 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-13621320-80e9-477e-8ec1-6734ef581333 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ad048becf474fb972d4291422d810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dcfc7024fc49388c4bd5f25f03e60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:48.826420 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-13621320-80e9-477e-8ec1-6734ef581333 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/3f0a02bc-7993-4849-8b3c-7572327b4799" status: 200 len: 1358 microversion: 2.1 time: 0.174028 Oct 04 21:47:48.827005 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 611/1272] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:48 2022] GET /compute/v2.1/servers/3f0a02bc-7993-4849-8b3c-7572327b4799 => generated 1358 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:47:48.872167 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-d4d1e7c3-39df-46f9-80b7-814220cff8af tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:48.872811 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-d4d1e7c3-39df-46f9-80b7-814220cff8af tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: 424a22f0-ccc3-4fec-bf38-4aaf924928e3] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:48.878879 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d4d1e7c3-39df-46f9-80b7-814220cff8af tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:48.879351 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d4d1e7c3-39df-46f9-80b7-814220cff8af tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:48.879791 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d4d1e7c3-39df-46f9-80b7-814220cff8af tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:48.880491 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d4d1e7c3-39df-46f9-80b7-814220cff8af tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:48.880949 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d4d1e7c3-39df-46f9-80b7-814220cff8af tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:48.881373 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d4d1e7c3-39df-46f9-80b7-814220cff8af tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:49.022750 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-d4d1e7c3-39df-46f9-80b7-814220cff8af tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:49.031046 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-d4d1e7c3-39df-46f9-80b7-814220cff8af tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/424a22f0-ccc3-4fec-bf38-4aaf924928e3" status: 200 len: 1472 microversion: 2.1 time: 0.162877 Oct 04 21:47:49.031828 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 662/1273] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:48 2022] GET /compute/v2.1/servers/424a22f0-ccc3-4fec-bf38-4aaf924928e3 => generated 1472 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:47:49.082668 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-916be603-2c98-4905-99ba-93a1eba9af88 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:49.083758 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-916be603-2c98-4905-99ba-93a1eba9af88 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] [instance: 4b0c3dd7-d609-4b00-8604-35f8a2680c14] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:49.089534 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-916be603-2c98-4905-99ba-93a1eba9af88 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:49.090025 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-916be603-2c98-4905-99ba-93a1eba9af88 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:49.090491 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-916be603-2c98-4905-99ba-93a1eba9af88 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:49.091201 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-916be603-2c98-4905-99ba-93a1eba9af88 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:49.091658 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-916be603-2c98-4905-99ba-93a1eba9af88 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:49.092085 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-916be603-2c98-4905-99ba-93a1eba9af88 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:49.107350 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-916be603-2c98-4905-99ba-93a1eba9af88 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] HTTP exception thrown: Instance 4b0c3dd7-d609-4b00-8604-35f8a2680c14 could not be found. Oct 04 21:47:49.109005 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-916be603-2c98-4905-99ba-93a1eba9af88 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Request method failure captured: Oct 04 21:47:49.109005 n-d-860284-1 devstack@n-api.service[134101]: request: GET /compute/v2.1/servers/4b0c3dd7-d609-4b00-8604-35f8a2680c14 HTTP/1.1 Oct 04 21:47:49.109005 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 21:47:49.109005 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 21:47:49.109005 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 21:47:49.109005 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 21:47:49.109005 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 21:47:49.109005 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 21:47:49.109005 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 21:47:49.109005 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 21:47:49.109005 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPKkKKWGhYvwCdv1J2MeGQ-jOAZuoGQ1lwAe198r71Ukwb_5umfLkuxNfZWiQHMUxBfhv-_5em_OANDxdq4CvMn57rB1IdcDSs2VQnXaxFUQOJQx2QIboBa8MD9AFC6JsgH39EDtpQDm0bx49UHlQ1MXYHpusDcMOOxl5o1LHadq_Xtg Oct 04 21:47:49.109005 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 21:47:49.109005 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 21:47:49.109005 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 21:47:49.109005 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 21:47:49.109005 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 21:47:49.109005 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 21:47:49.109005 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: 39edf587afe94b60911198aa0bb61613 Oct 04 21:47:49.109005 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-ServersOnMultiNodesTest-569263937 Oct 04 21:47:49.109005 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 21:47:49.109005 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 21:47:49.110713 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/39edf587afe94b60911198aa0bb61613"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_39edf587afe94b60911198aa0bb61613", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/39edf587afe94b60911198aa0bb61613"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/39edf587afe94b60911198aa0bb61613"}]}] Oct 04 21:47:49.110713 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-ServersOnMultiNodesTest-569263937 Oct 04 21:47:49.110713 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: 39edf587afe94b60911198aa0bb61613 Oct 04 21:47:49.110713 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-569263937 Oct 04 21:47:49.110713 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-ServersOnMultiNodesTest-569263937-project Oct 04 21:47:49.110713 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 21:47:49.110713 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 21:47:49.110713 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 29842a669a20408b881105135f76cb0a Oct 04 21:47:49.110713 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-ServersOnMultiNodesTest-569263937-project Oct 04 21:47:49.110713 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 21:47:49.110713 n-d-860284-1 devstack@n-api.service[134101]: exception: Instance 4b0c3dd7-d609-4b00-8604-35f8a2680c14 could not be found. Oct 04 21:47:49.110713 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': '4b0c3dd7-d609-4b00-8604-35f8a2680c14'} Oct 04 21:47:49.111638 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:47:49.111638 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:47:49.111638 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:47:49.111638 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:47:49.111638 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:47:49.111638 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:47:49.111638 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:47:49.111638 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:47:49.111638 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:47:49.111638 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:47:49.111638 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b0c3dd7-d609-4b00-8604-35f8a2680c14 could not be found. Oct 04 21:47:49.111638 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:47:49.111638 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:47:49.111638 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:47:49.111638 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:47:49.111638 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:47:49.111638 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:47:49.111638 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:47:49.111638 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:47:49.111638 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:47:49.113464 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:47:49.113464 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:47:49.113464 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:47:49.113464 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:47:49.113464 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:47:49.113464 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:47:49.113464 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:47:49.113464 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b0c3dd7-d609-4b00-8604-35f8a2680c14 could not be found. Oct 04 21:47:49.113464 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:47:49.113464 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:47:49.113464 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:47:49.113464 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:47:49.113464 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:47:49.113464 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:47:49.113464 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:47:49.113464 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:47:49.113464 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b0c3dd7-d609-4b00-8604-35f8a2680c14 could not be found. Oct 04 21:47:49.113464 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:47:49.115529 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-916be603-2c98-4905-99ba-93a1eba9af88 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] Returning 404 to user: Instance 4b0c3dd7-d609-4b00-8604-35f8a2680c14 could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:47:49.115529 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-916be603-2c98-4905-99ba-93a1eba9af88 tempest-ServersOnMultiNodesTest-569263937 tempest-ServersOnMultiNodesTest-569263937-project] 10.222.0.43 "GET /compute/v2.1/servers/4b0c3dd7-d609-4b00-8604-35f8a2680c14" status: 404 len: 111 microversion: 2.1 time: 0.031767 Oct 04 21:47:49.115529 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 612/1274] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:49 2022] GET /compute/v2.1/servers/4b0c3dd7-d609-4b00-8604-35f8a2680c14 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:47:49.362429 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-e82649d7-03a5-4d8e-b999-9030233bdb21 req-285364aa-64e1-4da0-9485-de25fc978e5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "424a22f0-ccc3-4fec-bf38-4aaf924928e3", "name": "network-vif-unplugged", "status": "completed", "tag": "0fc2e8ca-ce8a-4b4a-992c-9e648d20829d"}, {"name": "network-changed", "server_uuid": "424a22f0-ccc3-4fec-bf38-4aaf924928e3", "tag": "0fc2e8ca-ce8a-4b4a-992c-9e648d20829d"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:47:49.372043 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-e82649d7-03a5-4d8e-b999-9030233bdb21 req-285364aa-64e1-4da0-9485-de25fc978e5d service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:49.372520 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-e82649d7-03a5-4d8e-b999-9030233bdb21 req-285364aa-64e1-4da0-9485-de25fc978e5d service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:49.372949 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-e82649d7-03a5-4d8e-b999-9030233bdb21 req-285364aa-64e1-4da0-9485-de25fc978e5d service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:49.384504 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-e82649d7-03a5-4d8e-b999-9030233bdb21 req-285364aa-64e1-4da0-9485-de25fc978e5d service nova] Creating event network-vif-unplugged:0fc2e8ca-ce8a-4b4a-992c-9e648d20829d for instance 424a22f0-ccc3-4fec-bf38-4aaf924928e3 on n-h1-860284-1 Oct 04 21:47:49.385008 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-e82649d7-03a5-4d8e-b999-9030233bdb21 req-285364aa-64e1-4da0-9485-de25fc978e5d service nova] Creating event network-changed:0fc2e8ca-ce8a-4b4a-992c-9e648d20829d for instance 424a22f0-ccc3-4fec-bf38-4aaf924928e3 on n-h1-860284-1 Oct 04 21:47:49.387774 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=100 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:47:49.391986 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [req-e82649d7-03a5-4d8e-b999-9030233bdb21 req-285364aa-64e1-4da0-9485-de25fc978e5d service nova] Instance 424a22f0-ccc3-4fec-bf38-4aaf924928e3 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860284-1', 'n-h1-860284-1'} {{(pid=134102) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 21:47:49.403616 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-e82649d7-03a5-4d8e-b999-9030233bdb21 req-285364aa-64e1-4da0-9485-de25fc978e5d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.044940 Oct 04 21:47:49.404234 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 663/1275] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:47:49 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:47:49.788182 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-659310f7-7b48-4c03-84ba-ee2043238b40 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:49.788723 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-659310f7-7b48-4c03-84ba-ee2043238b40 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] [instance: e3380b36-6aba-4736-bcbc-f0058f806d55] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:49.796657 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-659310f7-7b48-4c03-84ba-ee2043238b40 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:49.797846 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-659310f7-7b48-4c03-84ba-ee2043238b40 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:49.798443 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-659310f7-7b48-4c03-84ba-ee2043238b40 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:49.799259 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-659310f7-7b48-4c03-84ba-ee2043238b40 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:49.799940 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-659310f7-7b48-4c03-84ba-ee2043238b40 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:49.800593 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-659310f7-7b48-4c03-84ba-ee2043238b40 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:49.833815 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-cb9bda73-6784-45e4-89ae-28aac8e3fe05 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Calling method '.version_select at 0x7fbb2f073280>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:49.900113 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-cb9bda73-6784-45e4-89ae-28aac8e3fe05 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] 10.222.0.43 "GET /compute/v2.1/images/6b7f3390-fca2-4f36-a6ff-e815f6857c6a" status: 200 len: 1426 microversion: 2.1 time: 0.072232 Oct 04 21:47:49.909027 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 664/1276] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:47:49 2022] GET /compute/v2.1/images/6b7f3390-fca2-4f36-a6ff-e815f6857c6a => generated 1426 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:49.916384 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-2d40623e-1556-429c-a71f-93bdbdb65fb4 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:49.917379 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-2d40623e-1556-429c-a71f-93bdbdb65fb4 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 3f0a02bc-7993-4849-8b3c-7572327b4799] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:49.931319 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2d40623e-1556-429c-a71f-93bdbdb65fb4 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:49.931907 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2d40623e-1556-429c-a71f-93bdbdb65fb4 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:49.932533 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2d40623e-1556-429c-a71f-93bdbdb65fb4 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:49.933558 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2d40623e-1556-429c-a71f-93bdbdb65fb4 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:49.934025 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2d40623e-1556-429c-a71f-93bdbdb65fb4 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:49.934470 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2d40623e-1556-429c-a71f-93bdbdb65fb4 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:50.093545 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-659310f7-7b48-4c03-84ba-ee2043238b40 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87616cd16995468ab7febf5aa4b284db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e3bf9149434d34b6762aaeef1478ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:50.106105 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-659310f7-7b48-4c03-84ba-ee2043238b40 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] 10.222.0.43 "GET /compute/v2.1/servers/e3380b36-6aba-4736-bcbc-f0058f806d55" status: 200 len: 1472 microversion: 2.1 time: 0.321295 Oct 04 21:47:50.108411 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 613/1277] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:49 2022] GET /compute/v2.1/servers/e3380b36-6aba-4736-bcbc-f0058f806d55 => generated 1472 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:50.129189 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-dbc7b9bf-732a-4d45-99da-eef6558c9bd1 req-3593df5f-e157-4588-a635-8f74c3efb867 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f0a02bc-7993-4849-8b3c-7572327b4799", "name": "network-vif-plugged", "status": "completed", "tag": "c2e7099f-7aa9-4be4-9b2d-631622cf5151"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:47:50.155554 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-dbc7b9bf-732a-4d45-99da-eef6558c9bd1 req-3593df5f-e157-4588-a635-8f74c3efb867 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:50.157117 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-dbc7b9bf-732a-4d45-99da-eef6558c9bd1 req-3593df5f-e157-4588-a635-8f74c3efb867 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:50.158720 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-dbc7b9bf-732a-4d45-99da-eef6558c9bd1 req-3593df5f-e157-4588-a635-8f74c3efb867 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:50.181272 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-dbc7b9bf-732a-4d45-99da-eef6558c9bd1 req-3593df5f-e157-4588-a635-8f74c3efb867 service nova] Creating event network-vif-plugged:c2e7099f-7aa9-4be4-9b2d-631622cf5151 for instance 3f0a02bc-7993-4849-8b3c-7572327b4799 on n-h1-860284-1 Oct 04 21:47:50.181656 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-2d40623e-1556-429c-a71f-93bdbdb65fb4 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ad048becf474fb972d4291422d810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dcfc7024fc49388c4bd5f25f03e60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:50.189354 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-dbc7b9bf-732a-4d45-99da-eef6558c9bd1 req-3593df5f-e157-4588-a635-8f74c3efb867 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078766 Oct 04 21:47:50.190558 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 614/1278] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:47:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:47:50.196116 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-2d40623e-1556-429c-a71f-93bdbdb65fb4 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/3f0a02bc-7993-4849-8b3c-7572327b4799" status: 200 len: 1358 microversion: 2.1 time: 0.283923 Oct 04 21:47:50.201014 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-fc057698-dc75-4c79-8004-644563bccd16 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:50.202484 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-fc057698-dc75-4c79-8004-644563bccd16 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: 424a22f0-ccc3-4fec-bf38-4aaf924928e3] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:50.206871 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 665/1279] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:49 2022] GET /compute/v2.1/servers/3f0a02bc-7993-4849-8b3c-7572327b4799 => generated 1358 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:50.210260 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fc057698-dc75-4c79-8004-644563bccd16 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:50.210850 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fc057698-dc75-4c79-8004-644563bccd16 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:50.211283 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fc057698-dc75-4c79-8004-644563bccd16 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:50.212172 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fc057698-dc75-4c79-8004-644563bccd16 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:50.212688 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fc057698-dc75-4c79-8004-644563bccd16 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:50.213117 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fc057698-dc75-4c79-8004-644563bccd16 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:50.368294 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-fc057698-dc75-4c79-8004-644563bccd16 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:50.377643 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-fc057698-dc75-4c79-8004-644563bccd16 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/424a22f0-ccc3-4fec-bf38-4aaf924928e3" status: 200 len: 1472 microversion: 2.1 time: 0.184955 Oct 04 21:47:50.377643 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 615/1280] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:50 2022] GET /compute/v2.1/servers/424a22f0-ccc3-4fec-bf38-4aaf924928e3 => generated 1472 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:50.915962 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-53f94a16-8476-4110-aeff-1c13a2adcc16 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Calling method '.version_select at 0x7fbb2f16dee0>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:50.966521 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-53f94a16-8476-4110-aeff-1c13a2adcc16 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] 10.222.0.43 "GET /compute/v2.1/images/6b7f3390-fca2-4f36-a6ff-e815f6857c6a" status: 200 len: 1426 microversion: 2.1 time: 0.054261 Oct 04 21:47:50.967213 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 666/1281] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:47:50 2022] GET /compute/v2.1/images/6b7f3390-fca2-4f36-a6ff-e815f6857c6a => generated 1426 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:51.135030 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-3a2d254c-4bae-4502-9d07-a19b9b61e970 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:51.135030 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-3a2d254c-4bae-4502-9d07-a19b9b61e970 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] [instance: e3380b36-6aba-4736-bcbc-f0058f806d55] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:51.141704 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3a2d254c-4bae-4502-9d07-a19b9b61e970 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:51.142187 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3a2d254c-4bae-4502-9d07-a19b9b61e970 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:51.142653 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3a2d254c-4bae-4502-9d07-a19b9b61e970 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:51.143358 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3a2d254c-4bae-4502-9d07-a19b9b61e970 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:51.143812 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3a2d254c-4bae-4502-9d07-a19b9b61e970 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:51.144235 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3a2d254c-4bae-4502-9d07-a19b9b61e970 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:51.217276 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-21cc8695-87cd-4e8a-8909-53a637794993 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:51.218210 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-21cc8695-87cd-4e8a-8909-53a637794993 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 3f0a02bc-7993-4849-8b3c-7572327b4799] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:51.225811 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-21cc8695-87cd-4e8a-8909-53a637794993 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:51.226648 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-21cc8695-87cd-4e8a-8909-53a637794993 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:51.227209 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-21cc8695-87cd-4e8a-8909-53a637794993 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:51.228435 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-21cc8695-87cd-4e8a-8909-53a637794993 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:51.229248 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-21cc8695-87cd-4e8a-8909-53a637794993 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:51.229864 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-21cc8695-87cd-4e8a-8909-53a637794993 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:51.320659 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-3a2d254c-4bae-4502-9d07-a19b9b61e970 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87616cd16995468ab7febf5aa4b284db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e3bf9149434d34b6762aaeef1478ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:51.331261 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-3a2d254c-4bae-4502-9d07-a19b9b61e970 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] 10.222.0.43 "GET /compute/v2.1/servers/e3380b36-6aba-4736-bcbc-f0058f806d55" status: 200 len: 1472 microversion: 2.1 time: 0.201895 Oct 04 21:47:51.332053 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 616/1282] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:51 2022] GET /compute/v2.1/servers/e3380b36-6aba-4736-bcbc-f0058f806d55 => generated 1472 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:51.398807 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-21cc8695-87cd-4e8a-8909-53a637794993 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ad048becf474fb972d4291422d810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dcfc7024fc49388c4bd5f25f03e60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:51.403493 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-7e0104bc-f1e4-46f9-8dda-7ce2f93e363a tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:51.404543 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-7e0104bc-f1e4-46f9-8dda-7ce2f93e363a tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: 424a22f0-ccc3-4fec-bf38-4aaf924928e3] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:51.406800 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-21cc8695-87cd-4e8a-8909-53a637794993 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/3f0a02bc-7993-4849-8b3c-7572327b4799" status: 200 len: 1358 microversion: 2.1 time: 0.193405 Oct 04 21:47:51.407390 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 667/1283] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:51 2022] GET /compute/v2.1/servers/3f0a02bc-7993-4849-8b3c-7572327b4799 => generated 1358 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:47:51.412804 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7e0104bc-f1e4-46f9-8dda-7ce2f93e363a tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:51.413495 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7e0104bc-f1e4-46f9-8dda-7ce2f93e363a tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:51.413938 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7e0104bc-f1e4-46f9-8dda-7ce2f93e363a tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:51.414657 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7e0104bc-f1e4-46f9-8dda-7ce2f93e363a tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:51.415407 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7e0104bc-f1e4-46f9-8dda-7ce2f93e363a tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:51.415843 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7e0104bc-f1e4-46f9-8dda-7ce2f93e363a tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:51.431686 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:47:51.558786 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-7e0104bc-f1e4-46f9-8dda-7ce2f93e363a tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:51.566913 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-7e0104bc-f1e4-46f9-8dda-7ce2f93e363a tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/424a22f0-ccc3-4fec-bf38-4aaf924928e3" status: 200 len: 1472 microversion: 2.1 time: 0.167296 Oct 04 21:47:51.567494 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 617/1284] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:51 2022] GET /compute/v2.1/servers/424a22f0-ccc3-4fec-bf38-4aaf924928e3 => generated 1472 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:51.828454 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-981b679f-0bac-4bdf-9bc2-b277cb5cbbdf tempest-ServicesAdminNegativeV253TestJSON-994774581 tempest-ServicesAdminNegativeV253TestJSON-994774581-project-admin] Action: 'update', calling method: .version_select at 0x7fbb2f073310>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:47:51.832190 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-981b679f-0bac-4bdf-9bc2-b277cb5cbbdf tempest-ServicesAdminNegativeV253TestJSON-994774581 tempest-ServicesAdminNegativeV253TestJSON-994774581-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:51.832673 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-981b679f-0bac-4bdf-9bc2-b277cb5cbbdf tempest-ServicesAdminNegativeV253TestJSON-994774581 tempest-ServicesAdminNegativeV253TestJSON-994774581-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:51.833106 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-981b679f-0bac-4bdf-9bc2-b277cb5cbbdf tempest-ServicesAdminNegativeV253TestJSON-994774581 tempest-ServicesAdminNegativeV253TestJSON-994774581-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:51.840563 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-981b679f-0bac-4bdf-9bc2-b277cb5cbbdf tempest-ServicesAdminNegativeV253TestJSON-994774581 tempest-ServicesAdminNegativeV253TestJSON-994774581-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:51.841033 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-981b679f-0bac-4bdf-9bc2-b277cb5cbbdf tempest-ServicesAdminNegativeV253TestJSON-994774581 tempest-ServicesAdminNegativeV253TestJSON-994774581-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:51.841460 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-981b679f-0bac-4bdf-9bc2-b277cb5cbbdf tempest-ServicesAdminNegativeV253TestJSON-994774581 tempest-ServicesAdminNegativeV253TestJSON-994774581-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:51.847968 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-981b679f-0bac-4bdf-9bc2-b277cb5cbbdf tempest-ServicesAdminNegativeV253TestJSON-994774581 tempest-ServicesAdminNegativeV253TestJSON-994774581-project-admin] HTTP exception thrown: Service be4a925d-30ae-4fbc-9bc5-404eb7ffaa9c could not be found. Oct 04 21:47:51.855864 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-981b679f-0bac-4bdf-9bc2-b277cb5cbbdf tempest-ServicesAdminNegativeV253TestJSON-994774581 tempest-ServicesAdminNegativeV253TestJSON-994774581-project-admin] Request method failure captured: Oct 04 21:47:51.855864 n-d-860284-1 devstack@n-api.service[134102]: request: PUT /compute/v2.1/os-services/be4a925d-30ae-4fbc-9bc5-404eb7ffaa9c HTTP/1.1 Oct 04 21:47:51.855864 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 21:47:51.855864 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 21:47:51.855864 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 21:47:51.855864 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 56 Oct 04 21:47:51.855864 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 21:47:51.855864 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 21:47:51.855864 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 21:47:51.855864 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 21:47:51.855864 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPKoHkFPtrHTWZdzqD_wqL_nJjPosjBcpmZ3v9emRywq5LcidFVCXkTAaO0cQ07v3noTwHl3H094YX3k1TVtTJW0xWIXGXSTxXqjuofRYswhh3dUbFdtBQxFfaAlbmBtm5Lqwrmv3Gqv25ejrheqSCiRcIILwHl7rO7ZnGnD09QC8UB4 Oct 04 21:47:51.855864 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 21:47:51.855864 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 21:47:51.855864 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 21:47:51.855864 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 21:47:51.855864 n-d-860284-1 devstack@n-api.service[134102]: X-Openstack-Nova-Api-Version: 2.53 Oct 04 21:47:51.855864 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 21:47:51.855864 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 21:47:51.855864 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: fd77b55673a6484eb43b4877a678b5d7 Oct 04 21:47:51.855864 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-994774581 Oct 04 21:47:51.855864 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,admin,member Oct 04 21:47:51.855864 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,admin,member Oct 04 21:47:51.857423 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/fd77b55673a6484eb43b4877a678b5d7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_fd77b55673a6484eb43b4877a678b5d7", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/fd77b55673a6484eb43b4877a678b5d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/fd77b55673a6484eb43b4877a678b5d7"}]}] Oct 04 21:47:51.857423 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-994774581 Oct 04 21:47:51.857423 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: fd77b55673a6484eb43b4877a678b5d7 Oct 04 21:47:51.857423 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-994774581 Oct 04 21:47:51.857423 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-ServicesAdminNegativeV253TestJSON-994774581-project-admin Oct 04 21:47:51.857423 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 21:47:51.857423 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 21:47:51.857423 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: 0509832fd12c4d1c89bcd5c81cc6af3b Oct 04 21:47:51.857423 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-994774581-project-admin Oct 04 21:47:51.857423 n-d-860284-1 devstack@n-api.service[134102]: Oct 04 21:47:51.857423 n-d-860284-1 devstack@n-api.service[134102]: {"status": "disabled", "disabled_reason": "maintenance"} Oct 04 21:47:51.857423 n-d-860284-1 devstack@n-api.service[134102]: method: Oct 04 21:47:51.857423 n-d-860284-1 devstack@n-api.service[134102]: exception: Service be4a925d-30ae-4fbc-9bc5-404eb7ffaa9c could not be found. Oct 04 21:47:51.858468 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': 'be4a925d-30ae-4fbc-9bc5-404eb7ffaa9c', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} Oct 04 21:47:51.858468 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:47:51.858468 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:47:51.858468 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Oct 04 21:47:51.858468 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 04 21:47:51.858468 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 04 21:47:51.858468 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 04 21:47:51.858468 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 04 21:47:51.858468 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:47:51.858468 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:47:51.858468 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:47:51.858468 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:47:51.858468 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 04 21:47:51.858468 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 04 21:47:51.858468 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Oct 04 21:47:51.858468 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 04 21:47:51.858468 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service be4a925d-30ae-4fbc-9bc5-404eb7ffaa9c could not be found. Oct 04 21:47:51.858468 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:47:51.858468 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:47:51.858468 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:47:51.858468 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:47:51.860019 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:47:51.860019 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:47:51.860019 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:47:51.860019 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:47:51.860019 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:47:51.860019 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:47:51.860019 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:47:51.860019 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:47:51.860019 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:47:51.860019 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:47:51.860019 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 04 21:47:51.860019 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:47:51.860019 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service be4a925d-30ae-4fbc-9bc5-404eb7ffaa9c could not be found. Oct 04 21:47:51.860019 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:47:51.860019 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:47:51.860019 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:47:51.860019 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:47:51.860019 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:47:51.860019 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:47:51.860019 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:47:51.861393 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:47:51.861393 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service be4a925d-30ae-4fbc-9bc5-404eb7ffaa9c could not be found. Oct 04 21:47:51.861393 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:47:51.861393 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-981b679f-0bac-4bdf-9bc2-b277cb5cbbdf tempest-ServicesAdminNegativeV253TestJSON-994774581 tempest-ServicesAdminNegativeV253TestJSON-994774581-project-admin] Returning 404 to user: Service be4a925d-30ae-4fbc-9bc5-404eb7ffaa9c could not be found. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:47:51.861393 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-981b679f-0bac-4bdf-9bc2-b277cb5cbbdf tempest-ServicesAdminNegativeV253TestJSON-994774581 tempest-ServicesAdminNegativeV253TestJSON-994774581-project-admin] 10.222.0.43 "PUT /compute/v2.1/os-services/be4a925d-30ae-4fbc-9bc5-404eb7ffaa9c" status: 404 len: 110 microversion: 2.53 time: 0.149643 Oct 04 21:47:51.861393 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 668/1285] 10.222.0.43 () {62 vars in 1309 bytes} [Tue Oct 4 21:47:51 2022] PUT /compute/v2.1/os-services/be4a925d-30ae-4fbc-9bc5-404eb7ffaa9c => generated 110 bytes in 151 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 21:47:51.868121 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-4b9fa013-c033-4937-8260-311babef76cd tempest-ServicesAdminNegativeV253TestJSON-994774581 tempest-ServicesAdminNegativeV253TestJSON-994774581-project-admin] Action: 'update', calling method: .version_select at 0x7fbb2f2349d0>, body: {"status": "disabled"} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:47:51.871699 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4b9fa013-c033-4937-8260-311babef76cd tempest-ServicesAdminNegativeV253TestJSON-994774581 tempest-ServicesAdminNegativeV253TestJSON-994774581-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:51.872215 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4b9fa013-c033-4937-8260-311babef76cd tempest-ServicesAdminNegativeV253TestJSON-994774581 tempest-ServicesAdminNegativeV253TestJSON-994774581-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:51.872652 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4b9fa013-c033-4937-8260-311babef76cd tempest-ServicesAdminNegativeV253TestJSON-994774581 tempest-ServicesAdminNegativeV253TestJSON-994774581-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:51.879960 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4b9fa013-c033-4937-8260-311babef76cd tempest-ServicesAdminNegativeV253TestJSON-994774581 tempest-ServicesAdminNegativeV253TestJSON-994774581-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:51.880692 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4b9fa013-c033-4937-8260-311babef76cd tempest-ServicesAdminNegativeV253TestJSON-994774581 tempest-ServicesAdminNegativeV253TestJSON-994774581-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:51.881238 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4b9fa013-c033-4937-8260-311babef76cd tempest-ServicesAdminNegativeV253TestJSON-994774581 tempest-ServicesAdminNegativeV253TestJSON-994774581-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:51.887794 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-4b9fa013-c033-4937-8260-311babef76cd tempest-ServicesAdminNegativeV253TestJSON-994774581 tempest-ServicesAdminNegativeV253TestJSON-994774581-project-admin] HTTP exception thrown: Service be4a925d-30ae-4fbc-9bc5-404eb7ffaa9c could not be found. Oct 04 21:47:51.889861 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-4b9fa013-c033-4937-8260-311babef76cd tempest-ServicesAdminNegativeV253TestJSON-994774581 tempest-ServicesAdminNegativeV253TestJSON-994774581-project-admin] Request method failure captured: Oct 04 21:47:51.889861 n-d-860284-1 devstack@n-api.service[134101]: request: PUT /compute/v2.1/os-services/be4a925d-30ae-4fbc-9bc5-404eb7ffaa9c HTTP/1.1 Oct 04 21:47:51.889861 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 21:47:51.889861 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 21:47:51.889861 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 21:47:51.889861 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 22 Oct 04 21:47:51.889861 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 21:47:51.889861 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 21:47:51.889861 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 21:47:51.889861 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 21:47:51.889861 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPKoHkFPtrHTWZdzqD_wqL_nJjPosjBcpmZ3v9emRywq5LcidFVCXkTAaO0cQ07v3noTwHl3H094YX3k1TVtTJW0xWIXGXSTxXqjuofRYswhh3dUbFdtBQxFfaAlbmBtm5Lqwrmv3Gqv25ejrheqSCiRcIILwHl7rO7ZnGnD09QC8UB4 Oct 04 21:47:51.889861 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 21:47:51.889861 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 21:47:51.889861 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 21:47:51.889861 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 21:47:51.889861 n-d-860284-1 devstack@n-api.service[134101]: X-Openstack-Nova-Api-Version: 2.53 Oct 04 21:47:51.889861 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 21:47:51.889861 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 21:47:51.889861 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: fd77b55673a6484eb43b4877a678b5d7 Oct 04 21:47:51.889861 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-994774581 Oct 04 21:47:51.889861 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,admin,member Oct 04 21:47:51.889861 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,admin,member Oct 04 21:47:51.891636 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/fd77b55673a6484eb43b4877a678b5d7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_fd77b55673a6484eb43b4877a678b5d7", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/fd77b55673a6484eb43b4877a678b5d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/fd77b55673a6484eb43b4877a678b5d7"}]}] Oct 04 21:47:51.891636 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-994774581 Oct 04 21:47:51.891636 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: fd77b55673a6484eb43b4877a678b5d7 Oct 04 21:47:51.891636 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-994774581 Oct 04 21:47:51.891636 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-ServicesAdminNegativeV253TestJSON-994774581-project-admin Oct 04 21:47:51.891636 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 21:47:51.891636 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 21:47:51.891636 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 0509832fd12c4d1c89bcd5c81cc6af3b Oct 04 21:47:51.891636 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-994774581-project-admin Oct 04 21:47:51.891636 n-d-860284-1 devstack@n-api.service[134101]: Oct 04 21:47:51.891636 n-d-860284-1 devstack@n-api.service[134101]: {"status": "disabled"} Oct 04 21:47:51.891636 n-d-860284-1 devstack@n-api.service[134101]: method: Oct 04 21:47:51.891636 n-d-860284-1 devstack@n-api.service[134101]: exception: Service be4a925d-30ae-4fbc-9bc5-404eb7ffaa9c could not be found. Oct 04 21:47:51.891636 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': 'be4a925d-30ae-4fbc-9bc5-404eb7ffaa9c', 'body': {'status': 'disabled'}} Oct 04 21:47:51.892689 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:47:51.892689 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:47:51.892689 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Oct 04 21:47:51.892689 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 04 21:47:51.892689 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 04 21:47:51.892689 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 04 21:47:51.892689 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 04 21:47:51.892689 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:47:51.892689 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:47:51.892689 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:47:51.892689 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:47:51.892689 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 04 21:47:51.892689 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 04 21:47:51.892689 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Oct 04 21:47:51.892689 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 04 21:47:51.892689 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service be4a925d-30ae-4fbc-9bc5-404eb7ffaa9c could not be found. Oct 04 21:47:51.892689 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:47:51.892689 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:47:51.892689 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:47:51.892689 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:47:51.892689 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:47:51.895852 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:47:51.895852 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:47:51.895852 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:47:51.895852 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:47:51.895852 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:47:51.895852 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:47:51.895852 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:47:51.895852 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:47:51.895852 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:47:51.895852 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 04 21:47:51.895852 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:47:51.895852 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service be4a925d-30ae-4fbc-9bc5-404eb7ffaa9c could not be found. Oct 04 21:47:51.895852 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:47:51.895852 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:47:51.895852 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:47:51.895852 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:47:51.895852 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:47:51.895852 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:47:51.895852 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:47:51.895852 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:47:51.897333 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service be4a925d-30ae-4fbc-9bc5-404eb7ffaa9c could not be found. Oct 04 21:47:51.897333 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:47:51.897333 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-4b9fa013-c033-4937-8260-311babef76cd tempest-ServicesAdminNegativeV253TestJSON-994774581 tempest-ServicesAdminNegativeV253TestJSON-994774581-project-admin] Returning 404 to user: Service be4a925d-30ae-4fbc-9bc5-404eb7ffaa9c could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:47:51.897333 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-4b9fa013-c033-4937-8260-311babef76cd tempest-ServicesAdminNegativeV253TestJSON-994774581 tempest-ServicesAdminNegativeV253TestJSON-994774581-project-admin] 10.222.0.43 "PUT /compute/v2.1/os-services/be4a925d-30ae-4fbc-9bc5-404eb7ffaa9c" status: 404 len: 110 microversion: 2.53 time: 0.027733 Oct 04 21:47:51.897333 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 618/1286] 10.222.0.43 () {62 vars in 1309 bytes} [Tue Oct 4 21:47:51 2022] PUT /compute/v2.1/os-services/be4a925d-30ae-4fbc-9bc5-404eb7ffaa9c => generated 110 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 21:47:51.904184 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-8ee065e3-59ce-49dd-92bc-5ed5dd9d7b08 tempest-ServicesAdminNegativeV253TestJSON-994774581 tempest-ServicesAdminNegativeV253TestJSON-994774581-project-admin] Action: 'update', calling method: .version_select at 0x7fbb2f1700d0>, body: {"status": "enabled"} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:47:51.907842 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8ee065e3-59ce-49dd-92bc-5ed5dd9d7b08 tempest-ServicesAdminNegativeV253TestJSON-994774581 tempest-ServicesAdminNegativeV253TestJSON-994774581-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:51.908442 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8ee065e3-59ce-49dd-92bc-5ed5dd9d7b08 tempest-ServicesAdminNegativeV253TestJSON-994774581 tempest-ServicesAdminNegativeV253TestJSON-994774581-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:51.908888 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8ee065e3-59ce-49dd-92bc-5ed5dd9d7b08 tempest-ServicesAdminNegativeV253TestJSON-994774581 tempest-ServicesAdminNegativeV253TestJSON-994774581-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:51.915178 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8ee065e3-59ce-49dd-92bc-5ed5dd9d7b08 tempest-ServicesAdminNegativeV253TestJSON-994774581 tempest-ServicesAdminNegativeV253TestJSON-994774581-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:51.915663 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8ee065e3-59ce-49dd-92bc-5ed5dd9d7b08 tempest-ServicesAdminNegativeV253TestJSON-994774581 tempest-ServicesAdminNegativeV253TestJSON-994774581-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:51.916103 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8ee065e3-59ce-49dd-92bc-5ed5dd9d7b08 tempest-ServicesAdminNegativeV253TestJSON-994774581 tempest-ServicesAdminNegativeV253TestJSON-994774581-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:51.920959 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-8ee065e3-59ce-49dd-92bc-5ed5dd9d7b08 tempest-ServicesAdminNegativeV253TestJSON-994774581 tempest-ServicesAdminNegativeV253TestJSON-994774581-project-admin] HTTP exception thrown: Service be4a925d-30ae-4fbc-9bc5-404eb7ffaa9c could not be found. Oct 04 21:47:51.922667 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-8ee065e3-59ce-49dd-92bc-5ed5dd9d7b08 tempest-ServicesAdminNegativeV253TestJSON-994774581 tempest-ServicesAdminNegativeV253TestJSON-994774581-project-admin] Request method failure captured: Oct 04 21:47:51.922667 n-d-860284-1 devstack@n-api.service[134102]: request: PUT /compute/v2.1/os-services/be4a925d-30ae-4fbc-9bc5-404eb7ffaa9c HTTP/1.1 Oct 04 21:47:51.922667 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 21:47:51.922667 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 21:47:51.922667 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 21:47:51.922667 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 21 Oct 04 21:47:51.922667 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 21:47:51.922667 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 21:47:51.922667 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 21:47:51.922667 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 21:47:51.922667 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPKoHkFPtrHTWZdzqD_wqL_nJjPosjBcpmZ3v9emRywq5LcidFVCXkTAaO0cQ07v3noTwHl3H094YX3k1TVtTJW0xWIXGXSTxXqjuofRYswhh3dUbFdtBQxFfaAlbmBtm5Lqwrmv3Gqv25ejrheqSCiRcIILwHl7rO7ZnGnD09QC8UB4 Oct 04 21:47:51.922667 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 21:47:51.922667 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 21:47:51.922667 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 21:47:51.922667 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 21:47:51.922667 n-d-860284-1 devstack@n-api.service[134102]: X-Openstack-Nova-Api-Version: 2.53 Oct 04 21:47:51.922667 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 21:47:51.922667 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 21:47:51.922667 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: fd77b55673a6484eb43b4877a678b5d7 Oct 04 21:47:51.922667 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-994774581 Oct 04 21:47:51.922667 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,admin,member Oct 04 21:47:51.922667 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,admin,member Oct 04 21:47:51.924383 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/fd77b55673a6484eb43b4877a678b5d7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_fd77b55673a6484eb43b4877a678b5d7", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/fd77b55673a6484eb43b4877a678b5d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/fd77b55673a6484eb43b4877a678b5d7"}]}] Oct 04 21:47:51.924383 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-994774581 Oct 04 21:47:51.924383 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: fd77b55673a6484eb43b4877a678b5d7 Oct 04 21:47:51.924383 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-994774581 Oct 04 21:47:51.924383 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-ServicesAdminNegativeV253TestJSON-994774581-project-admin Oct 04 21:47:51.924383 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 21:47:51.924383 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 21:47:51.924383 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: 0509832fd12c4d1c89bcd5c81cc6af3b Oct 04 21:47:51.924383 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-994774581-project-admin Oct 04 21:47:51.924383 n-d-860284-1 devstack@n-api.service[134102]: Oct 04 21:47:51.924383 n-d-860284-1 devstack@n-api.service[134102]: {"status": "enabled"} Oct 04 21:47:51.924383 n-d-860284-1 devstack@n-api.service[134102]: method: Oct 04 21:47:51.924383 n-d-860284-1 devstack@n-api.service[134102]: exception: Service be4a925d-30ae-4fbc-9bc5-404eb7ffaa9c could not be found. Oct 04 21:47:51.924383 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': 'be4a925d-30ae-4fbc-9bc5-404eb7ffaa9c', 'body': {'status': 'enabled'}} Oct 04 21:47:51.925611 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:47:51.925611 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:47:51.925611 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Oct 04 21:47:51.925611 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 04 21:47:51.925611 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 04 21:47:51.925611 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 04 21:47:51.925611 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 04 21:47:51.925611 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:47:51.925611 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:47:51.925611 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:47:51.925611 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:47:51.925611 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 04 21:47:51.925611 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 04 21:47:51.925611 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Oct 04 21:47:51.925611 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 04 21:47:51.925611 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service be4a925d-30ae-4fbc-9bc5-404eb7ffaa9c could not be found. Oct 04 21:47:51.925611 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:47:51.925611 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:47:51.925611 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:47:51.925611 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:47:51.925611 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:47:51.927985 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:47:51.927985 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:47:51.927985 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:47:51.927985 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:47:51.927985 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:47:51.927985 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:47:51.927985 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:47:51.927985 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:47:51.927985 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:47:51.927985 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 04 21:47:51.927985 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:47:51.927985 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service be4a925d-30ae-4fbc-9bc5-404eb7ffaa9c could not be found. Oct 04 21:47:51.927985 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:47:51.927985 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:47:51.927985 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:47:51.927985 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:47:51.927985 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:47:51.927985 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:47:51.927985 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:47:51.927985 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:47:51.929547 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service be4a925d-30ae-4fbc-9bc5-404eb7ffaa9c could not be found. Oct 04 21:47:51.929547 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:47:51.929547 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-8ee065e3-59ce-49dd-92bc-5ed5dd9d7b08 tempest-ServicesAdminNegativeV253TestJSON-994774581 tempest-ServicesAdminNegativeV253TestJSON-994774581-project-admin] Returning 404 to user: Service be4a925d-30ae-4fbc-9bc5-404eb7ffaa9c could not be found. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:47:51.929547 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-8ee065e3-59ce-49dd-92bc-5ed5dd9d7b08 tempest-ServicesAdminNegativeV253TestJSON-994774581 tempest-ServicesAdminNegativeV253TestJSON-994774581-project-admin] 10.222.0.43 "PUT /compute/v2.1/os-services/be4a925d-30ae-4fbc-9bc5-404eb7ffaa9c" status: 404 len: 110 microversion: 2.53 time: 0.024691 Oct 04 21:47:51.929547 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 669/1287] 10.222.0.43 () {62 vars in 1309 bytes} [Tue Oct 4 21:47:51 2022] PUT /compute/v2.1/os-services/be4a925d-30ae-4fbc-9bc5-404eb7ffaa9c => generated 110 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 21:47:51.935536 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-64d43f32-7c8a-4759-9667-d79e65f31978 tempest-ServicesAdminNegativeV253TestJSON-994774581 tempest-ServicesAdminNegativeV253TestJSON-994774581-project-admin] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:51.939156 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-64d43f32-7c8a-4759-9667-d79e65f31978 tempest-ServicesAdminNegativeV253TestJSON-994774581 tempest-ServicesAdminNegativeV253TestJSON-994774581-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:51.939640 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-64d43f32-7c8a-4759-9667-d79e65f31978 tempest-ServicesAdminNegativeV253TestJSON-994774581 tempest-ServicesAdminNegativeV253TestJSON-994774581-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:51.940082 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-64d43f32-7c8a-4759-9667-d79e65f31978 tempest-ServicesAdminNegativeV253TestJSON-994774581 tempest-ServicesAdminNegativeV253TestJSON-994774581-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:51.940806 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-64d43f32-7c8a-4759-9667-d79e65f31978 tempest-ServicesAdminNegativeV253TestJSON-994774581 tempest-ServicesAdminNegativeV253TestJSON-994774581-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:51.941259 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-64d43f32-7c8a-4759-9667-d79e65f31978 tempest-ServicesAdminNegativeV253TestJSON-994774581 tempest-ServicesAdminNegativeV253TestJSON-994774581-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:51.941680 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-64d43f32-7c8a-4759-9667-d79e65f31978 tempest-ServicesAdminNegativeV253TestJSON-994774581 tempest-ServicesAdminNegativeV253TestJSON-994774581-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:51.964895 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-64d43f32-7c8a-4759-9667-d79e65f31978 tempest-ServicesAdminNegativeV253TestJSON-994774581 tempest-ServicesAdminNegativeV253TestJSON-994774581-project-admin] 10.222.0.43 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.034145 Oct 04 21:47:51.965497 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 619/1288] 10.222.0.43 () {60 vars in 1178 bytes} [Tue Oct 4 21:47:51 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:47:51.978702 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-dbd3eb2e-1a3a-4988-817d-0c5ea91c4e6f tempest-ServicesAdminNegativeV253TestJSON-994774581 tempest-ServicesAdminNegativeV253TestJSON-994774581-project-admin] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:51.982211 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dbd3eb2e-1a3a-4988-817d-0c5ea91c4e6f tempest-ServicesAdminNegativeV253TestJSON-994774581 tempest-ServicesAdminNegativeV253TestJSON-994774581-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:51.982836 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dbd3eb2e-1a3a-4988-817d-0c5ea91c4e6f tempest-ServicesAdminNegativeV253TestJSON-994774581 tempest-ServicesAdminNegativeV253TestJSON-994774581-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:51.982959 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-d7ebc189-2b45-4dcc-b7c2-8f9abfd7614e tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Calling method '.version_select at 0x7fbb2eee1c10>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:51.983278 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dbd3eb2e-1a3a-4988-817d-0c5ea91c4e6f tempest-ServicesAdminNegativeV253TestJSON-994774581 tempest-ServicesAdminNegativeV253TestJSON-994774581-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:51.984015 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dbd3eb2e-1a3a-4988-817d-0c5ea91c4e6f tempest-ServicesAdminNegativeV253TestJSON-994774581 tempest-ServicesAdminNegativeV253TestJSON-994774581-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:51.984473 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dbd3eb2e-1a3a-4988-817d-0c5ea91c4e6f tempest-ServicesAdminNegativeV253TestJSON-994774581 tempest-ServicesAdminNegativeV253TestJSON-994774581-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:51.984902 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dbd3eb2e-1a3a-4988-817d-0c5ea91c4e6f tempest-ServicesAdminNegativeV253TestJSON-994774581 tempest-ServicesAdminNegativeV253TestJSON-994774581-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:52.003112 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:47:52.015038 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-dbd3eb2e-1a3a-4988-817d-0c5ea91c4e6f tempest-ServicesAdminNegativeV253TestJSON-994774581 tempest-ServicesAdminNegativeV253TestJSON-994774581-project-admin] 10.222.0.43 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.039726 Oct 04 21:47:52.016090 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 670/1289] 10.222.0.43 () {60 vars in 1211 bytes} [Tue Oct 4 21:47:51 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1239 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:47:52.029235 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-dd4c08aa-a479-4e2b-a2f6-75edb14cd01c tempest-ServicesAdminNegativeV253TestJSON-994774581 tempest-ServicesAdminNegativeV253TestJSON-994774581-project-admin] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:52.029949 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-d7ebc189-2b45-4dcc-b7c2-8f9abfd7614e tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] 10.222.0.43 "GET /compute/v2.1/images/6b7f3390-fca2-4f36-a6ff-e815f6857c6a" status: 200 len: 1426 microversion: 2.1 time: 0.050556 Oct 04 21:47:52.030552 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 620/1290] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:47:51 2022] GET /compute/v2.1/images/6b7f3390-fca2-4f36-a6ff-e815f6857c6a => generated 1426 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:47:52.033050 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dd4c08aa-a479-4e2b-a2f6-75edb14cd01c tempest-ServicesAdminNegativeV253TestJSON-994774581 tempest-ServicesAdminNegativeV253TestJSON-994774581-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:52.033565 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dd4c08aa-a479-4e2b-a2f6-75edb14cd01c tempest-ServicesAdminNegativeV253TestJSON-994774581 tempest-ServicesAdminNegativeV253TestJSON-994774581-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:52.034038 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dd4c08aa-a479-4e2b-a2f6-75edb14cd01c tempest-ServicesAdminNegativeV253TestJSON-994774581 tempest-ServicesAdminNegativeV253TestJSON-994774581-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:52.034800 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dd4c08aa-a479-4e2b-a2f6-75edb14cd01c tempest-ServicesAdminNegativeV253TestJSON-994774581 tempest-ServicesAdminNegativeV253TestJSON-994774581-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:52.035257 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dd4c08aa-a479-4e2b-a2f6-75edb14cd01c tempest-ServicesAdminNegativeV253TestJSON-994774581 tempest-ServicesAdminNegativeV253TestJSON-994774581-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:52.035684 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dd4c08aa-a479-4e2b-a2f6-75edb14cd01c tempest-ServicesAdminNegativeV253TestJSON-994774581 tempest-ServicesAdminNegativeV253TestJSON-994774581-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:52.061233 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-dd4c08aa-a479-4e2b-a2f6-75edb14cd01c tempest-ServicesAdminNegativeV253TestJSON-994774581 tempest-ServicesAdminNegativeV253TestJSON-994774581-project-admin] 10.222.0.43 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.035530 Oct 04 21:47:52.061842 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 671/1291] 10.222.0.43 () {60 vars in 1178 bytes} [Tue Oct 4 21:47:52 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:47:52.073979 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-00c04798-ac2c-4ddb-ab8d-5c95875bbf77 tempest-ServicesAdminNegativeV253TestJSON-994774581 tempest-ServicesAdminNegativeV253TestJSON-994774581-project-admin] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:52.077644 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-00c04798-ac2c-4ddb-ab8d-5c95875bbf77 tempest-ServicesAdminNegativeV253TestJSON-994774581 tempest-ServicesAdminNegativeV253TestJSON-994774581-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:52.078141 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-00c04798-ac2c-4ddb-ab8d-5c95875bbf77 tempest-ServicesAdminNegativeV253TestJSON-994774581 tempest-ServicesAdminNegativeV253TestJSON-994774581-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:52.078743 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-00c04798-ac2c-4ddb-ab8d-5c95875bbf77 tempest-ServicesAdminNegativeV253TestJSON-994774581 tempest-ServicesAdminNegativeV253TestJSON-994774581-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:52.079499 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-00c04798-ac2c-4ddb-ab8d-5c95875bbf77 tempest-ServicesAdminNegativeV253TestJSON-994774581 tempest-ServicesAdminNegativeV253TestJSON-994774581-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:52.079960 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-00c04798-ac2c-4ddb-ab8d-5c95875bbf77 tempest-ServicesAdminNegativeV253TestJSON-994774581 tempest-ServicesAdminNegativeV253TestJSON-994774581-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:52.080393 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-00c04798-ac2c-4ddb-ab8d-5c95875bbf77 tempest-ServicesAdminNegativeV253TestJSON-994774581 tempest-ServicesAdminNegativeV253TestJSON-994774581-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:52.104882 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-00c04798-ac2c-4ddb-ab8d-5c95875bbf77 tempest-ServicesAdminNegativeV253TestJSON-994774581 tempest-ServicesAdminNegativeV253TestJSON-994774581-project-admin] 10.222.0.43 "GET /compute/v2.1/os-services?host=n-d-860284-1&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.034635 Oct 04 21:47:52.105492 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 621/1292] 10.222.0.43 () {60 vars in 1235 bytes} [Tue Oct 4 21:47:52 2022] GET /compute/v2.1/os-services?host=n-d-860284-1&binary=xxx => generated 16 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:52.118500 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-704959c2-d2a8-4b31-85ee-42a6adbe2cc1 tempest-ServicesAdminNegativeV253TestJSON-994774581 tempest-ServicesAdminNegativeV253TestJSON-994774581-project-admin] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:52.122883 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-704959c2-d2a8-4b31-85ee-42a6adbe2cc1 tempest-ServicesAdminNegativeV253TestJSON-994774581 tempest-ServicesAdminNegativeV253TestJSON-994774581-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:52.123457 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-704959c2-d2a8-4b31-85ee-42a6adbe2cc1 tempest-ServicesAdminNegativeV253TestJSON-994774581 tempest-ServicesAdminNegativeV253TestJSON-994774581-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:52.123971 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-704959c2-d2a8-4b31-85ee-42a6adbe2cc1 tempest-ServicesAdminNegativeV253TestJSON-994774581 tempest-ServicesAdminNegativeV253TestJSON-994774581-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:52.124783 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-704959c2-d2a8-4b31-85ee-42a6adbe2cc1 tempest-ServicesAdminNegativeV253TestJSON-994774581 tempest-ServicesAdminNegativeV253TestJSON-994774581-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:52.125483 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-704959c2-d2a8-4b31-85ee-42a6adbe2cc1 tempest-ServicesAdminNegativeV253TestJSON-994774581 tempest-ServicesAdminNegativeV253TestJSON-994774581-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:52.126650 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-704959c2-d2a8-4b31-85ee-42a6adbe2cc1 tempest-ServicesAdminNegativeV253TestJSON-994774581 tempest-ServicesAdminNegativeV253TestJSON-994774581-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:52.155408 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-704959c2-d2a8-4b31-85ee-42a6adbe2cc1 tempest-ServicesAdminNegativeV253TestJSON-994774581 tempest-ServicesAdminNegativeV253TestJSON-994774581-project-admin] 10.222.0.43 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.040733 Oct 04 21:47:52.155408 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 672/1293] 10.222.0.43 () {60 vars in 1178 bytes} [Tue Oct 4 21:47:52 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:47:52.168515 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-34f7682a-c0ba-4998-851e-e2cee9561255 tempest-ServicesAdminNegativeV253TestJSON-994774581 tempest-ServicesAdminNegativeV253TestJSON-994774581-project-admin] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:52.172305 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-34f7682a-c0ba-4998-851e-e2cee9561255 tempest-ServicesAdminNegativeV253TestJSON-994774581 tempest-ServicesAdminNegativeV253TestJSON-994774581-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:52.172885 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-34f7682a-c0ba-4998-851e-e2cee9561255 tempest-ServicesAdminNegativeV253TestJSON-994774581 tempest-ServicesAdminNegativeV253TestJSON-994774581-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:52.173620 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-34f7682a-c0ba-4998-851e-e2cee9561255 tempest-ServicesAdminNegativeV253TestJSON-994774581 tempest-ServicesAdminNegativeV253TestJSON-994774581-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:52.174203 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-34f7682a-c0ba-4998-851e-e2cee9561255 tempest-ServicesAdminNegativeV253TestJSON-994774581 tempest-ServicesAdminNegativeV253TestJSON-994774581-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:52.174756 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-34f7682a-c0ba-4998-851e-e2cee9561255 tempest-ServicesAdminNegativeV253TestJSON-994774581 tempest-ServicesAdminNegativeV253TestJSON-994774581-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:52.175250 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-34f7682a-c0ba-4998-851e-e2cee9561255 tempest-ServicesAdminNegativeV253TestJSON-994774581 tempest-ServicesAdminNegativeV253TestJSON-994774581-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:52.191236 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:47:52.202791 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-34f7682a-c0ba-4998-851e-e2cee9561255 tempest-ServicesAdminNegativeV253TestJSON-994774581 tempest-ServicesAdminNegativeV253TestJSON-994774581-project-admin] 10.222.0.43 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.53 time: 0.038453 Oct 04 21:47:52.203562 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 622/1294] 10.222.0.43 () {60 vars in 1239 bytes} [Tue Oct 4 21:47:52 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:52.209862 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-0eb20cd6-03ae-4c5d-b846-4f7bdd2bf087 req-8ad3d434-068e-44c7-a162-07c68825c0fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59a1880f-2802-4e72-9a17-b966cfec8fe9", "name": "network-vif-plugged", "status": "completed", "tag": "893f32f5-2183-4d13-8c2e-2095ab07e2af"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:47:52.222719 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-0eb20cd6-03ae-4c5d-b846-4f7bdd2bf087 req-8ad3d434-068e-44c7-a162-07c68825c0fe service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:52.223206 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-0eb20cd6-03ae-4c5d-b846-4f7bdd2bf087 req-8ad3d434-068e-44c7-a162-07c68825c0fe service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:52.223645 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-0eb20cd6-03ae-4c5d-b846-4f7bdd2bf087 req-8ad3d434-068e-44c7-a162-07c68825c0fe service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:52.235601 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-0eb20cd6-03ae-4c5d-b846-4f7bdd2bf087 req-8ad3d434-068e-44c7-a162-07c68825c0fe service nova] Creating event network-vif-plugged:893f32f5-2183-4d13-8c2e-2095ab07e2af for instance 59a1880f-2802-4e72-9a17-b966cfec8fe9 on n-h1-860284-1 Oct 04 21:47:52.241364 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-0eb20cd6-03ae-4c5d-b846-4f7bdd2bf087 req-8ad3d434-068e-44c7-a162-07c68825c0fe service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035110 Oct 04 21:47:52.242199 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 673/1295] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:47:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:47:52.326513 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-27b7c6f2-8b7a-4f16-bc71-490111f6b251 tempest-ServicesAdminNegativeV253TestJSON-665635043 tempest-ServicesAdminNegativeV253TestJSON-665635043-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:52.330013 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-27b7c6f2-8b7a-4f16-bc71-490111f6b251 tempest-ServicesAdminNegativeV253TestJSON-665635043 tempest-ServicesAdminNegativeV253TestJSON-665635043-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '05bd90bdfac84ff788385446991e765b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b009b987a44f2f99f953c7411bd598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:52.331813 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-27b7c6f2-8b7a-4f16-bc71-490111f6b251 tempest-ServicesAdminNegativeV253TestJSON-665635043 tempest-ServicesAdminNegativeV253TestJSON-665635043-project] Request method failure captured: Oct 04 21:47:52.331813 n-d-860284-1 devstack@n-api.service[134101]: request: GET /compute/v2.1/os-services HTTP/1.1 Oct 04 21:47:52.331813 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 21:47:52.331813 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 21:47:52.331813 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 21:47:52.331813 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 21:47:52.331813 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 21:47:52.331813 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 21:47:52.331813 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 21:47:52.331813 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 21:47:52.331813 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPKoHlj1MauSGIA7-7D3CzlK2Mb_A0J5_16G7NE3u-VCcGjiR1wNXCtbiiAfrraXjpnWPokxKI-39d2daMh3tx7cyz3uYM5_GiVMsORQ-K6x3kRQLq52PAckGl3FsndQHJUVRpcf4oV-CjniXScA1iScrVph_9n3BhffsKovL-kN6MB0 Oct 04 21:47:52.331813 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 21:47:52.331813 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 21:47:52.331813 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 21:47:52.331813 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 21:47:52.331813 n-d-860284-1 devstack@n-api.service[134101]: X-Openstack-Nova-Api-Version: 2.53 Oct 04 21:47:52.331813 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 21:47:52.331813 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 21:47:52.331813 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: c5b009b987a44f2f99f953c7411bd598 Oct 04 21:47:52.331813 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-665635043 Oct 04 21:47:52.331813 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 21:47:52.331813 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 21:47:52.333453 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c5b009b987a44f2f99f953c7411bd598"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_c5b009b987a44f2f99f953c7411bd598", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c5b009b987a44f2f99f953c7411bd598"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/c5b009b987a44f2f99f953c7411bd598"}]}] Oct 04 21:47:52.333453 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-665635043 Oct 04 21:47:52.333453 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: c5b009b987a44f2f99f953c7411bd598 Oct 04 21:47:52.333453 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-665635043 Oct 04 21:47:52.333453 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-ServicesAdminNegativeV253TestJSON-665635043-project Oct 04 21:47:52.333453 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 21:47:52.333453 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 21:47:52.333453 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 05bd90bdfac84ff788385446991e765b Oct 04 21:47:52.333453 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-665635043-project Oct 04 21:47:52.333453 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 21:47:52.333453 n-d-860284-1 devstack@n-api.service[134101]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 04 21:47:52.333453 n-d-860284-1 devstack@n-api.service[134101]: action_args: {} Oct 04 21:47:52.334468 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:47:52.334468 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:47:52.334468 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:47:52.334468 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:47:52.334468 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:47:52.334468 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:47:52.334468 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 21:47:52.334468 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:47:52.334468 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 21:47:52.334468 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:47:52.334468 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:47:52.334468 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:47:52.334468 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Oct 04 21:47:52.334468 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Oct 04 21:47:52.334468 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 21:47:52.334468 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 21:47:52.334468 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 21:47:52.334468 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 21:47:52.334468 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 21:47:52.336126 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 21:47:52.336126 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 21:47:52.336126 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 21:47:52.336126 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 21:47:52.336126 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 21:47:52.336126 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 21:47:52.336126 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 21:47:52.336126 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 21:47:52.336126 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 21:47:52.336126 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 04 21:47:52.336126 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:47:52.336126 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:47:52.336126 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:47:52.336126 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:47:52.336126 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:47:52.336126 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:47:52.336126 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 21:47:52.336126 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 21:47:52.336126 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 04 21:47:52.336126 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:47:52.337443 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-27b7c6f2-8b7a-4f16-bc71-490111f6b251 tempest-ServicesAdminNegativeV253TestJSON-665635043 tempest-ServicesAdminNegativeV253TestJSON-665635043-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:47:52.337443 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-27b7c6f2-8b7a-4f16-bc71-490111f6b251 tempest-ServicesAdminNegativeV253TestJSON-665635043 tempest-ServicesAdminNegativeV253TestJSON-665635043-project] 10.222.0.43 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.120223 Oct 04 21:47:52.338119 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 623/1296] 10.222.0.43 () {60 vars in 1178 bytes} [Tue Oct 4 21:47:52 2022] GET /compute/v2.1/os-services => generated 112 bytes in 126 msecs (HTTP/1.1 403) 9 headers in 381 bytes (2 switches on core 0) Oct 04 21:47:52.356185 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-52835f3c-8744-41e7-ad47-aa8f1e2ce9e5 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:52.357063 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-52835f3c-8744-41e7-ad47-aa8f1e2ce9e5 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] [instance: e3380b36-6aba-4736-bcbc-f0058f806d55] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:52.363839 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-52835f3c-8744-41e7-ad47-aa8f1e2ce9e5 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:52.365060 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-52835f3c-8744-41e7-ad47-aa8f1e2ce9e5 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:52.365980 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-52835f3c-8744-41e7-ad47-aa8f1e2ce9e5 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:52.366881 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-52835f3c-8744-41e7-ad47-aa8f1e2ce9e5 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:52.367460 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-52835f3c-8744-41e7-ad47-aa8f1e2ce9e5 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:52.367997 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-52835f3c-8744-41e7-ad47-aa8f1e2ce9e5 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:52.431522 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-b2bbf8ea-09f2-444d-bad6-9935c1e74cf0 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:52.432340 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-b2bbf8ea-09f2-444d-bad6-9935c1e74cf0 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 3f0a02bc-7993-4849-8b3c-7572327b4799] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:52.440913 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b2bbf8ea-09f2-444d-bad6-9935c1e74cf0 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:52.441813 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b2bbf8ea-09f2-444d-bad6-9935c1e74cf0 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:52.442448 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b2bbf8ea-09f2-444d-bad6-9935c1e74cf0 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:52.444309 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b2bbf8ea-09f2-444d-bad6-9935c1e74cf0 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:52.444968 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b2bbf8ea-09f2-444d-bad6-9935c1e74cf0 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:52.445573 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b2bbf8ea-09f2-444d-bad6-9935c1e74cf0 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:52.569870 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-52835f3c-8744-41e7-ad47-aa8f1e2ce9e5 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87616cd16995468ab7febf5aa4b284db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e3bf9149434d34b6762aaeef1478ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:52.584817 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-52835f3c-8744-41e7-ad47-aa8f1e2ce9e5 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] 10.222.0.43 "GET /compute/v2.1/servers/e3380b36-6aba-4736-bcbc-f0058f806d55" status: 200 len: 1472 microversion: 2.1 time: 0.231808 Oct 04 21:47:52.600900 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 674/1297] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:52 2022] GET /compute/v2.1/servers/e3380b36-6aba-4736-bcbc-f0058f806d55 => generated 1472 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:52.609297 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-186cfcdd-5255-4252-98f1-2d90491b5e9a tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:52.610735 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-186cfcdd-5255-4252-98f1-2d90491b5e9a tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: 424a22f0-ccc3-4fec-bf38-4aaf924928e3] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:52.622581 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-186cfcdd-5255-4252-98f1-2d90491b5e9a tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:52.623887 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-186cfcdd-5255-4252-98f1-2d90491b5e9a tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:52.624885 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-186cfcdd-5255-4252-98f1-2d90491b5e9a tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:52.626086 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-186cfcdd-5255-4252-98f1-2d90491b5e9a tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:52.627245 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-186cfcdd-5255-4252-98f1-2d90491b5e9a tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:52.628079 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-186cfcdd-5255-4252-98f1-2d90491b5e9a tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:52.666345 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-b2bbf8ea-09f2-444d-bad6-9935c1e74cf0 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ad048becf474fb972d4291422d810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dcfc7024fc49388c4bd5f25f03e60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:52.674688 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-b2bbf8ea-09f2-444d-bad6-9935c1e74cf0 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/3f0a02bc-7993-4849-8b3c-7572327b4799" status: 200 len: 1358 microversion: 2.1 time: 0.248962 Oct 04 21:47:52.675254 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 624/1298] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:52 2022] GET /compute/v2.1/servers/3f0a02bc-7993-4849-8b3c-7572327b4799 => generated 1358 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:47:52.778393 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-186cfcdd-5255-4252-98f1-2d90491b5e9a tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:52.787022 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-186cfcdd-5255-4252-98f1-2d90491b5e9a tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/424a22f0-ccc3-4fec-bf38-4aaf924928e3" status: 200 len: 1469 microversion: 2.1 time: 0.183880 Oct 04 21:47:52.787666 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 675/1299] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:52 2022] GET /compute/v2.1/servers/424a22f0-ccc3-4fec-bf38-4aaf924928e3 => generated 1469 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:52.810278 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-783bb327-d39e-4e89-bf1f-3c16ea591489 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:47:52.811118 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-783bb327-d39e-4e89-bf1f-3c16ea591489 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: 424a22f0-ccc3-4fec-bf38-4aaf924928e3] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:52.817037 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-783bb327-d39e-4e89-bf1f-3c16ea591489 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:52.817565 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-783bb327-d39e-4e89-bf1f-3c16ea591489 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:52.818088 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-783bb327-d39e-4e89-bf1f-3c16ea591489 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:52.818905 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-783bb327-d39e-4e89-bf1f-3c16ea591489 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:52.819371 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-783bb327-d39e-4e89-bf1f-3c16ea591489 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:52.819785 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-783bb327-d39e-4e89-bf1f-3c16ea591489 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:52.857103 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-783bb327-d39e-4e89-bf1f-3c16ea591489 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:52.857579 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-783bb327-d39e-4e89-bf1f-3c16ea591489 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:52.858025 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-783bb327-d39e-4e89-bf1f-3c16ea591489 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:52.858781 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-783bb327-d39e-4e89-bf1f-3c16ea591489 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:52.859206 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-783bb327-d39e-4e89-bf1f-3c16ea591489 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:52.859625 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-783bb327-d39e-4e89-bf1f-3c16ea591489 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:52.883088 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-783bb327-d39e-4e89-bf1f-3c16ea591489 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Getting quotas for project 1ad1554e318e45f78a2bc5e148d0c39f. Resources: {'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:47:52.888372 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-783bb327-d39e-4e89-bf1f-3c16ea591489 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Getting quotas for user ff4e089659884b6d9197141ba9f14f57 and project 1ad1554e318e45f78a2bc5e148d0c39f. Resources: {'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:47:53.002071 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-783bb327-d39e-4e89-bf1f-3c16ea591489 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "POST /compute/v2.1/servers/424a22f0-ccc3-4fec-bf38-4aaf924928e3/action" status: 202 len: 0 microversion: 2.1 time: 0.195629 Oct 04 21:47:53.002709 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 625/1300] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 21:47:52 2022] POST /compute/v2.1/servers/424a22f0-ccc3-4fec-bf38-4aaf924928e3/action => generated 0 bytes in 197 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:47:53.010973 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-7c411454-1b47-455e-88f1-8f1764684497 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:53.011581 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-7c411454-1b47-455e-88f1-8f1764684497 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: 424a22f0-ccc3-4fec-bf38-4aaf924928e3] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:53.018298 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7c411454-1b47-455e-88f1-8f1764684497 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:53.019295 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7c411454-1b47-455e-88f1-8f1764684497 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:53.019862 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7c411454-1b47-455e-88f1-8f1764684497 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:53.021434 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7c411454-1b47-455e-88f1-8f1764684497 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:53.022401 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7c411454-1b47-455e-88f1-8f1764684497 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:53.022929 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7c411454-1b47-455e-88f1-8f1764684497 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:53.047434 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-8a2a95f6-2988-45d1-9a2d-ac9fa78281ce tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Calling method '.version_select at 0x7fbb2ee99f70>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:53.093120 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-8a2a95f6-2988-45d1-9a2d-ac9fa78281ce tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] 10.222.0.43 "GET /compute/v2.1/images/6b7f3390-fca2-4f36-a6ff-e815f6857c6a" status: 200 len: 1426 microversion: 2.1 time: 0.050285 Oct 04 21:47:53.093626 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 626/1301] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:47:53 2022] GET /compute/v2.1/images/6b7f3390-fca2-4f36-a6ff-e815f6857c6a => generated 1426 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:53.235246 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-7c411454-1b47-455e-88f1-8f1764684497 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:53.243492 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-7c411454-1b47-455e-88f1-8f1764684497 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/424a22f0-ccc3-4fec-bf38-4aaf924928e3" status: 200 len: 1468 microversion: 2.1 time: 0.236324 Oct 04 21:47:53.244080 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 676/1302] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:53 2022] GET /compute/v2.1/servers/424a22f0-ccc3-4fec-bf38-4aaf924928e3 => generated 1468 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:47:53.613291 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-22b1dfaa-a1c3-414e-82f0-34516c0262fa tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:53.613832 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-22b1dfaa-a1c3-414e-82f0-34516c0262fa tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] [instance: e3380b36-6aba-4736-bcbc-f0058f806d55] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:53.621741 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-22b1dfaa-a1c3-414e-82f0-34516c0262fa tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:53.622236 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-22b1dfaa-a1c3-414e-82f0-34516c0262fa tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:53.622719 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-22b1dfaa-a1c3-414e-82f0-34516c0262fa tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:53.623417 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-22b1dfaa-a1c3-414e-82f0-34516c0262fa tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:53.623879 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-22b1dfaa-a1c3-414e-82f0-34516c0262fa tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:53.624305 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-22b1dfaa-a1c3-414e-82f0-34516c0262fa tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:53.698346 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-1d9bce3f-b895-4d7e-8c83-4cbaad66f841 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:53.698989 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-1d9bce3f-b895-4d7e-8c83-4cbaad66f841 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 3f0a02bc-7993-4849-8b3c-7572327b4799] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:53.705052 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1d9bce3f-b895-4d7e-8c83-4cbaad66f841 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:53.705551 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1d9bce3f-b895-4d7e-8c83-4cbaad66f841 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:53.705969 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1d9bce3f-b895-4d7e-8c83-4cbaad66f841 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:53.707017 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1d9bce3f-b895-4d7e-8c83-4cbaad66f841 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:53.707372 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1d9bce3f-b895-4d7e-8c83-4cbaad66f841 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:53.707849 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1d9bce3f-b895-4d7e-8c83-4cbaad66f841 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:53.859611 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-22b1dfaa-a1c3-414e-82f0-34516c0262fa tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87616cd16995468ab7febf5aa4b284db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e3bf9149434d34b6762aaeef1478ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:53.869973 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-22b1dfaa-a1c3-414e-82f0-34516c0262fa tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] 10.222.0.43 "GET /compute/v2.1/servers/e3380b36-6aba-4736-bcbc-f0058f806d55" status: 200 len: 1472 microversion: 2.1 time: 0.261224 Oct 04 21:47:53.870654 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 627/1303] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:53 2022] GET /compute/v2.1/servers/e3380b36-6aba-4736-bcbc-f0058f806d55 => generated 1472 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:53.888851 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-1d9bce3f-b895-4d7e-8c83-4cbaad66f841 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ad048becf474fb972d4291422d810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dcfc7024fc49388c4bd5f25f03e60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:53.899910 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-1d9bce3f-b895-4d7e-8c83-4cbaad66f841 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/3f0a02bc-7993-4849-8b3c-7572327b4799" status: 200 len: 1358 microversion: 2.1 time: 0.205479 Oct 04 21:47:53.900511 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 677/1304] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:53 2022] GET /compute/v2.1/servers/3f0a02bc-7993-4849-8b3c-7572327b4799 => generated 1358 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:47:54.108890 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-3f550e55-926e-4473-bc64-119113ec532c tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Calling method '.version_select at 0x7fbb2ee99f70>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:54.179502 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-3f550e55-926e-4473-bc64-119113ec532c tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] 10.222.0.43 "GET /compute/v2.1/images/6b7f3390-fca2-4f36-a6ff-e815f6857c6a" status: 200 len: 1426 microversion: 2.1 time: 0.074346 Oct 04 21:47:54.182390 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 628/1305] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:47:54 2022] GET /compute/v2.1/images/6b7f3390-fca2-4f36-a6ff-e815f6857c6a => generated 1426 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:54.268277 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-16cf35e1-1008-4a9a-b446-8472754c444a tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:54.270517 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-16cf35e1-1008-4a9a-b446-8472754c444a tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: 424a22f0-ccc3-4fec-bf38-4aaf924928e3] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:54.279215 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-16cf35e1-1008-4a9a-b446-8472754c444a tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:54.280673 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-16cf35e1-1008-4a9a-b446-8472754c444a tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:54.281215 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-16cf35e1-1008-4a9a-b446-8472754c444a tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:54.282304 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-16cf35e1-1008-4a9a-b446-8472754c444a tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:54.283152 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-16cf35e1-1008-4a9a-b446-8472754c444a tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:54.283947 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-16cf35e1-1008-4a9a-b446-8472754c444a tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:54.470205 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-16cf35e1-1008-4a9a-b446-8472754c444a tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:54.479934 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-16cf35e1-1008-4a9a-b446-8472754c444a tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/424a22f0-ccc3-4fec-bf38-4aaf924928e3" status: 200 len: 1468 microversion: 2.1 time: 0.216475 Oct 04 21:47:54.480523 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 678/1306] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:54 2022] GET /compute/v2.1/servers/424a22f0-ccc3-4fec-bf38-4aaf924928e3 => generated 1468 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:54.907008 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e0d2b49a-fd11-4c0b-8b30-0e2bfe2ca900 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:54.908899 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-e0d2b49a-fd11-4c0b-8b30-0e2bfe2ca900 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] [instance: e3380b36-6aba-4736-bcbc-f0058f806d55] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:54.927938 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-d0c6f521-c646-4aca-8e1d-c8ed7cf7efa0 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:54.928596 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-d0c6f521-c646-4aca-8e1d-c8ed7cf7efa0 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 3f0a02bc-7993-4849-8b3c-7572327b4799] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:54.932314 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e0d2b49a-fd11-4c0b-8b30-0e2bfe2ca900 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:54.935530 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e0d2b49a-fd11-4c0b-8b30-0e2bfe2ca900 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:54.941321 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d0c6f521-c646-4aca-8e1d-c8ed7cf7efa0 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:54.941966 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e0d2b49a-fd11-4c0b-8b30-0e2bfe2ca900 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:54.948988 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e0d2b49a-fd11-4c0b-8b30-0e2bfe2ca900 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:54.949197 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d0c6f521-c646-4aca-8e1d-c8ed7cf7efa0 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:54.949709 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d0c6f521-c646-4aca-8e1d-c8ed7cf7efa0 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:54.950516 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d0c6f521-c646-4aca-8e1d-c8ed7cf7efa0 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:54.950874 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e0d2b49a-fd11-4c0b-8b30-0e2bfe2ca900 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:54.951152 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d0c6f521-c646-4aca-8e1d-c8ed7cf7efa0 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:54.952480 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d0c6f521-c646-4aca-8e1d-c8ed7cf7efa0 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:54.954821 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e0d2b49a-fd11-4c0b-8b30-0e2bfe2ca900 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:55.309013 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-d0c6f521-c646-4aca-8e1d-c8ed7cf7efa0 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ad048becf474fb972d4291422d810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dcfc7024fc49388c4bd5f25f03e60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:55.326746 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-d0c6f521-c646-4aca-8e1d-c8ed7cf7efa0 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/3f0a02bc-7993-4849-8b3c-7572327b4799" status: 200 len: 1541 microversion: 2.1 time: 0.403737 Oct 04 21:47:55.330663 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 679/1307] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:54 2022] GET /compute/v2.1/servers/3f0a02bc-7993-4849-8b3c-7572327b4799 => generated 1541 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:47:55.335656 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-aebd2b0d-e521-4296-b7aa-5042d5bb0c4a tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Calling method '.version_select at 0x7fbb2f16df70>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:55.384958 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-e0d2b49a-fd11-4c0b-8b30-0e2bfe2ca900 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87616cd16995468ab7febf5aa4b284db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e3bf9149434d34b6762aaeef1478ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:55.408174 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-e0d2b49a-fd11-4c0b-8b30-0e2bfe2ca900 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] 10.222.0.43 "GET /compute/v2.1/servers/e3380b36-6aba-4736-bcbc-f0058f806d55" status: 200 len: 1472 microversion: 2.1 time: 0.501506 Oct 04 21:47:55.414164 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 629/1308] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:54 2022] GET /compute/v2.1/servers/e3380b36-6aba-4736-bcbc-f0058f806d55 => generated 1472 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:55.441356 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-1adcb882-0bf6-44d5-bfd5-4e9b714ab428 req-d618047f-48d3-479a-a3dc-b533347d2a3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "424a22f0-ccc3-4fec-bf38-4aaf924928e3", "name": "network-vif-plugged", "status": "completed", "tag": "0fc2e8ca-ce8a-4b4a-992c-9e648d20829d"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:47:55.447576 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-aebd2b0d-e521-4296-b7aa-5042d5bb0c4a tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] 10.222.0.43 "GET /compute/v2.1/images/6b7f3390-fca2-4f36-a6ff-e815f6857c6a" status: 200 len: 1426 microversion: 2.1 time: 0.115639 Oct 04 21:47:55.456716 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 680/1309] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:47:55 2022] GET /compute/v2.1/images/6b7f3390-fca2-4f36-a6ff-e815f6857c6a => generated 1426 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:55.462880 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-465e7839-0967-4f94-9d7d-26bedaf2008e tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:55.463575 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-465e7839-0967-4f94-9d7d-26bedaf2008e tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 3f0a02bc-7993-4849-8b3c-7572327b4799] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:55.470933 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-465e7839-0967-4f94-9d7d-26bedaf2008e tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:55.471685 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-465e7839-0967-4f94-9d7d-26bedaf2008e tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:55.472285 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-465e7839-0967-4f94-9d7d-26bedaf2008e tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:55.473222 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-465e7839-0967-4f94-9d7d-26bedaf2008e tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:55.473976 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-465e7839-0967-4f94-9d7d-26bedaf2008e tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:55.474586 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-465e7839-0967-4f94-9d7d-26bedaf2008e tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:55.478722 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-1adcb882-0bf6-44d5-bfd5-4e9b714ab428 req-d618047f-48d3-479a-a3dc-b533347d2a3d service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:55.480835 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-1adcb882-0bf6-44d5-bfd5-4e9b714ab428 req-d618047f-48d3-479a-a3dc-b533347d2a3d service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:55.481848 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-1adcb882-0bf6-44d5-bfd5-4e9b714ab428 req-d618047f-48d3-479a-a3dc-b533347d2a3d service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:55.525837 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-1adcb882-0bf6-44d5-bfd5-4e9b714ab428 req-d618047f-48d3-479a-a3dc-b533347d2a3d service nova] Creating event network-vif-plugged:0fc2e8ca-ce8a-4b4a-992c-9e648d20829d for instance 424a22f0-ccc3-4fec-bf38-4aaf924928e3 on n-h1-860284-1 Oct 04 21:47:55.572652 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [req-1adcb882-0bf6-44d5-bfd5-4e9b714ab428 req-d618047f-48d3-479a-a3dc-b533347d2a3d service nova] Instance 424a22f0-ccc3-4fec-bf38-4aaf924928e3 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860284-1', 'n-h1-860284-1'} {{(pid=134101) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 21:47:55.611965 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-1adcb882-0bf6-44d5-bfd5-4e9b714ab428 req-d618047f-48d3-479a-a3dc-b533347d2a3d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.192394 Oct 04 21:47:55.620101 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 630/1310] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:47:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:47:55.640679 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-80922814-2c27-4f33-a5c1-9046701a0ccf tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:55.643297 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-80922814-2c27-4f33-a5c1-9046701a0ccf tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: 424a22f0-ccc3-4fec-bf38-4aaf924928e3] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:55.663678 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-80922814-2c27-4f33-a5c1-9046701a0ccf tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:55.667588 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-80922814-2c27-4f33-a5c1-9046701a0ccf tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:55.670622 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-80922814-2c27-4f33-a5c1-9046701a0ccf tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:55.672069 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-80922814-2c27-4f33-a5c1-9046701a0ccf tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:55.672951 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-80922814-2c27-4f33-a5c1-9046701a0ccf tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:55.674656 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-80922814-2c27-4f33-a5c1-9046701a0ccf tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:55.695443 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-465e7839-0967-4f94-9d7d-26bedaf2008e tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/3f0a02bc-7993-4849-8b3c-7572327b4799/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.237306 Oct 04 21:47:55.696162 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 681/1311] 10.222.0.43 () {58 vars in 1275 bytes} [Tue Oct 4 21:47:55 2022] GET /compute/v2.1/servers/3f0a02bc-7993-4849-8b3c-7572327b4799/os-interface => generated 285 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:47:55.913484 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-80922814-2c27-4f33-a5c1-9046701a0ccf tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:55.924408 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-80922814-2c27-4f33-a5c1-9046701a0ccf tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/424a22f0-ccc3-4fec-bf38-4aaf924928e3" status: 200 len: 1468 microversion: 2.1 time: 0.300431 Oct 04 21:47:55.925250 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 631/1312] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:55 2022] GET /compute/v2.1/servers/424a22f0-ccc3-4fec-bf38-4aaf924928e3 => generated 1468 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:56.425383 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-2d12ce91-3d1c-41cb-8980-d1b1cd69fddb tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-1375302960", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452"}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:47:56.441446 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-d521ece2-80cb-4015-b00d-16ee9b439dea tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:56.442510 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-d521ece2-80cb-4015-b00d-16ee9b439dea tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] [instance: e3380b36-6aba-4736-bcbc-f0058f806d55] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:56.455839 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d521ece2-80cb-4015-b00d-16ee9b439dea tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:56.456350 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d521ece2-80cb-4015-b00d-16ee9b439dea tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:56.457974 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d521ece2-80cb-4015-b00d-16ee9b439dea tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:56.459670 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d521ece2-80cb-4015-b00d-16ee9b439dea tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:56.462872 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d521ece2-80cb-4015-b00d-16ee9b439dea tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:56.464485 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d521ece2-80cb-4015-b00d-16ee9b439dea tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:56.518985 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.network.neutron [None req-2d12ce91-3d1c-41cb-8980-d1b1cd69fddb tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] validate_networks() for None {{(pid=134102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:47:56.761961 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-d521ece2-80cb-4015-b00d-16ee9b439dea tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87616cd16995468ab7febf5aa4b284db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e3bf9149434d34b6762aaeef1478ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:56.770388 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-d521ece2-80cb-4015-b00d-16ee9b439dea tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] 10.222.0.43 "GET /compute/v2.1/servers/e3380b36-6aba-4736-bcbc-f0058f806d55" status: 200 len: 1478 microversion: 2.1 time: 0.333021 Oct 04 21:47:56.794999 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 632/1313] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:56 2022] GET /compute/v2.1/servers/e3380b36-6aba-4736-bcbc-f0058f806d55 => generated 1478 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:47:56.814289 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-a8142c74-62a9-48f0-b6e7-d4f0946a8863 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Calling method '.version_select at 0x7fbb2eee15e0>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:56.887632 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-a8142c74-62a9-48f0-b6e7-d4f0946a8863 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] 10.222.0.43 "GET /compute/v2.1/images/6b7f3390-fca2-4f36-a6ff-e815f6857c6a" status: 200 len: 1426 microversion: 2.1 time: 0.091426 Oct 04 21:47:56.888550 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 633/1314] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:47:56 2022] GET /compute/v2.1/images/6b7f3390-fca2-4f36-a6ff-e815f6857c6a => generated 1426 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:56.908278 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-2d12ce91-3d1c-41cb-8980-d1b1cd69fddb tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Flavor limits 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:47:56.908704 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-2d12ce91-3d1c-41cb-8980-d1b1cd69fddb tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Image limits 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:47:56.909188 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-2d12ce91-3d1c-41cb-8980-d1b1cd69fddb tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Flavor pref 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:47:56.909603 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-2d12ce91-3d1c-41cb-8980-d1b1cd69fddb tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Image pref 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:47:56.910022 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-2d12ce91-3d1c-41cb-8980-d1b1cd69fddb tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:47:56.921199 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2d12ce91-3d1c-41cb-8980-d1b1cd69fddb tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:56.921755 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2d12ce91-3d1c-41cb-8980-d1b1cd69fddb tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:56.922203 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2d12ce91-3d1c-41cb-8980-d1b1cd69fddb tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:56.922984 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2d12ce91-3d1c-41cb-8980-d1b1cd69fddb tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:56.923448 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2d12ce91-3d1c-41cb-8980-d1b1cd69fddb tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:56.923884 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2d12ce91-3d1c-41cb-8980-d1b1cd69fddb tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:56.949775 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-2d12ce91-3d1c-41cb-8980-d1b1cd69fddb tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Getting quotas for project ff5345566eeb4a5f88d31f733eaa04bc. Resources: {'instances', 'ram', 'cores'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:47:56.952934 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-6485bd97-13a7-4cea-b783-d78014d88db5 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:56.954170 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-6485bd97-13a7-4cea-b783-d78014d88db5 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: 424a22f0-ccc3-4fec-bf38-4aaf924928e3] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:56.961821 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-2d12ce91-3d1c-41cb-8980-d1b1cd69fddb tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Getting quotas for user 7c7e992115ea4ba58205d3da003ec625 and project ff5345566eeb4a5f88d31f733eaa04bc. Resources: {'instances', 'ram', 'cores'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:47:56.975663 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6485bd97-13a7-4cea-b783-d78014d88db5 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:56.976080 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6485bd97-13a7-4cea-b783-d78014d88db5 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:56.976524 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6485bd97-13a7-4cea-b783-d78014d88db5 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:56.977001 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-2d12ce91-3d1c-41cb-8980-d1b1cd69fddb tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Going to run 1 instances... {{(pid=134102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:47:56.977243 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6485bd97-13a7-4cea-b783-d78014d88db5 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:56.977702 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6485bd97-13a7-4cea-b783-d78014d88db5 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:56.978130 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6485bd97-13a7-4cea-b783-d78014d88db5 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:56.979444 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-2d12ce91-3d1c-41cb-8980-d1b1cd69fddb tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] [instance: 197b66b3-69ef-4b80-9de7-b25ae132dc2e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='58548514-5dac-426c-81f5-19e3fba33e23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:47:57.048328 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-2d12ce91-3d1c-41cb-8980-d1b1cd69fddb tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.808684 Oct 04 21:47:57.058711 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 682/1315] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 21:47:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 820 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:47:57.070269 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-e21d9eb1-4e48-4468-967d-be807467f995 tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:57.071011 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-e21d9eb1-4e48-4468-967d-be807467f995 tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] [instance: 197b66b3-69ef-4b80-9de7-b25ae132dc2e] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:57.389664 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-e21d9eb1-4e48-4468-967d-be807467f995 tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7e992115ea4ba58205d3da003ec625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5345566eeb4a5f88d31f733eaa04bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:57.436142 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-e21d9eb1-4e48-4468-967d-be807467f995 tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] 10.222.0.43 "GET /compute/v2.1/servers/197b66b3-69ef-4b80-9de7-b25ae132dc2e" status: 200 len: 1214 microversion: 2.1 time: 0.371631 Oct 04 21:47:57.440950 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 683/1316] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:57 2022] GET /compute/v2.1/servers/197b66b3-69ef-4b80-9de7-b25ae132dc2e => generated 1214 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:57.478788 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-6485bd97-13a7-4cea-b783-d78014d88db5 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:57.480515 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-83c83635-e662-40da-9f27-eb49bf4ba3bc req-44d4bed9-99e9-407f-8fcd-1da08560a303 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f0a02bc-7993-4849-8b3c-7572327b4799", "tag": "c2e7099f-7aa9-4be4-9b2d-631622cf5151"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:47:57.491062 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-6485bd97-13a7-4cea-b783-d78014d88db5 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/424a22f0-ccc3-4fec-bf38-4aaf924928e3" status: 200 len: 1468 microversion: 2.1 time: 0.543964 Oct 04 21:47:57.495231 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 634/1317] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:56 2022] GET /compute/v2.1/servers/424a22f0-ccc3-4fec-bf38-4aaf924928e3 => generated 1468 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:47:57.570033 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-83c83635-e662-40da-9f27-eb49bf4ba3bc req-44d4bed9-99e9-407f-8fcd-1da08560a303 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:57.570587 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-83c83635-e662-40da-9f27-eb49bf4ba3bc req-44d4bed9-99e9-407f-8fcd-1da08560a303 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:57.570990 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-83c83635-e662-40da-9f27-eb49bf4ba3bc req-44d4bed9-99e9-407f-8fcd-1da08560a303 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:57.619417 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-83c83635-e662-40da-9f27-eb49bf4ba3bc req-44d4bed9-99e9-407f-8fcd-1da08560a303 service nova] Creating event network-changed:c2e7099f-7aa9-4be4-9b2d-631622cf5151 for instance 3f0a02bc-7993-4849-8b3c-7572327b4799 on n-h1-860284-1 Oct 04 21:47:57.665343 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-83c83635-e662-40da-9f27-eb49bf4ba3bc req-44d4bed9-99e9-407f-8fcd-1da08560a303 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.214884 Oct 04 21:47:57.665993 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 684/1318] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:47:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:47:57.807999 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-4382ff25-8209-4f68-9886-7e28ea5504aa tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:57.809001 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-4382ff25-8209-4f68-9886-7e28ea5504aa tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] [instance: e3380b36-6aba-4736-bcbc-f0058f806d55] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:57.829148 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4382ff25-8209-4f68-9886-7e28ea5504aa tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:57.835296 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4382ff25-8209-4f68-9886-7e28ea5504aa tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:57.836492 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4382ff25-8209-4f68-9886-7e28ea5504aa tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:57.837006 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4382ff25-8209-4f68-9886-7e28ea5504aa tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:57.837472 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4382ff25-8209-4f68-9886-7e28ea5504aa tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:57.837913 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4382ff25-8209-4f68-9886-7e28ea5504aa tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:57.907512 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-dbf5b2a5-db85-40db-90bb-bb00054a1b1a tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Calling method '.version_select at 0x7fbb2f053550>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:58.037125 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-dbf5b2a5-db85-40db-90bb-bb00054a1b1a tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] 10.222.0.43 "GET /compute/v2.1/images/6b7f3390-fca2-4f36-a6ff-e815f6857c6a" status: 200 len: 1426 microversion: 2.1 time: 0.135395 Oct 04 21:47:58.056173 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 685/1319] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:47:57 2022] GET /compute/v2.1/images/6b7f3390-fca2-4f36-a6ff-e815f6857c6a => generated 1426 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:58.322882 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-4382ff25-8209-4f68-9886-7e28ea5504aa tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87616cd16995468ab7febf5aa4b284db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e3bf9149434d34b6762aaeef1478ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:58.335951 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-4382ff25-8209-4f68-9886-7e28ea5504aa tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] 10.222.0.43 "GET /compute/v2.1/servers/e3380b36-6aba-4736-bcbc-f0058f806d55" status: 200 len: 1478 microversion: 2.1 time: 0.531777 Oct 04 21:47:58.336753 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 635/1320] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:57 2022] GET /compute/v2.1/servers/e3380b36-6aba-4736-bcbc-f0058f806d55 => generated 1478 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:47:58.470511 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-d11e12e4-bb8a-4495-a377-3457b04d5ed7 tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:58.471257 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-d11e12e4-bb8a-4495-a377-3457b04d5ed7 tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] [instance: 197b66b3-69ef-4b80-9de7-b25ae132dc2e] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:58.483499 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d11e12e4-bb8a-4495-a377-3457b04d5ed7 tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:58.484305 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d11e12e4-bb8a-4495-a377-3457b04d5ed7 tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:58.485100 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d11e12e4-bb8a-4495-a377-3457b04d5ed7 tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:58.486079 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d11e12e4-bb8a-4495-a377-3457b04d5ed7 tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:58.486566 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d11e12e4-bb8a-4495-a377-3457b04d5ed7 tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:58.487168 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d11e12e4-bb8a-4495-a377-3457b04d5ed7 tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:58.539943 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e9133392-cecf-484b-8e2e-fbf0c57b438e tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:58.540563 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-e9133392-cecf-484b-8e2e-fbf0c57b438e tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: 424a22f0-ccc3-4fec-bf38-4aaf924928e3] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:58.554200 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e9133392-cecf-484b-8e2e-fbf0c57b438e tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:58.567128 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e9133392-cecf-484b-8e2e-fbf0c57b438e tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:58.568373 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e9133392-cecf-484b-8e2e-fbf0c57b438e tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:58.569799 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e9133392-cecf-484b-8e2e-fbf0c57b438e tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:58.570776 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e9133392-cecf-484b-8e2e-fbf0c57b438e tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:58.571523 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e9133392-cecf-484b-8e2e-fbf0c57b438e tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:58.589430 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-d11e12e4-bb8a-4495-a377-3457b04d5ed7 tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7e992115ea4ba58205d3da003ec625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5345566eeb4a5f88d31f733eaa04bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:58.602391 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-d11e12e4-bb8a-4495-a377-3457b04d5ed7 tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] 10.222.0.43 "GET /compute/v2.1/servers/197b66b3-69ef-4b80-9de7-b25ae132dc2e" status: 200 len: 1210 microversion: 2.1 time: 0.137328 Oct 04 21:47:58.604260 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 686/1321] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:58 2022] GET /compute/v2.1/servers/197b66b3-69ef-4b80-9de7-b25ae132dc2e => generated 1210 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:47:58.825571 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-e9133392-cecf-484b-8e2e-fbf0c57b438e tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:58.840835 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-e9133392-cecf-484b-8e2e-fbf0c57b438e tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/424a22f0-ccc3-4fec-bf38-4aaf924928e3" status: 200 len: 1468 microversion: 2.1 time: 0.302685 Oct 04 21:47:58.841832 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 636/1322] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:58 2022] GET /compute/v2.1/servers/424a22f0-ccc3-4fec-bf38-4aaf924928e3 => generated 1468 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:59.068712 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-2186af9a-698a-4888-bc76-507f16f7a078 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Calling method '.version_select at 0x7fbb2f019670>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:59.193261 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-2186af9a-698a-4888-bc76-507f16f7a078 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] 10.222.0.43 "GET /compute/v2.1/images/6b7f3390-fca2-4f36-a6ff-e815f6857c6a" status: 200 len: 1426 microversion: 2.1 time: 0.132649 Oct 04 21:47:59.195074 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 687/1323] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:47:59 2022] GET /compute/v2.1/images/6b7f3390-fca2-4f36-a6ff-e815f6857c6a => generated 1426 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:59.228353 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-df06fbd6-ed8f-4650-b70c-a482c94e9bb0 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0e7513f9-7cb3-40cb-8f03-b68b5d2b8423"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:47:59.232485 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-df06fbd6-ed8f-4650-b70c-a482c94e9bb0 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] [instance: 1e9957cf-cfeb-483d-bc32-73ca72a54eb9] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:59.249848 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-df06fbd6-ed8f-4650-b70c-a482c94e9bb0 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:59.252898 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-df06fbd6-ed8f-4650-b70c-a482c94e9bb0 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:59.253576 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-df06fbd6-ed8f-4650-b70c-a482c94e9bb0 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:59.254551 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-df06fbd6-ed8f-4650-b70c-a482c94e9bb0 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:59.256247 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-df06fbd6-ed8f-4650-b70c-a482c94e9bb0 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:59.257119 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-df06fbd6-ed8f-4650-b70c-a482c94e9bb0 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:59.361137 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-7a879504-655f-4829-ba8b-216f14fb1ae9 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:59.361745 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-7a879504-655f-4829-ba8b-216f14fb1ae9 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] [instance: e3380b36-6aba-4736-bcbc-f0058f806d55] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:59.377717 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7a879504-655f-4829-ba8b-216f14fb1ae9 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:59.386386 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7a879504-655f-4829-ba8b-216f14fb1ae9 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:59.386920 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7a879504-655f-4829-ba8b-216f14fb1ae9 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:59.387688 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7a879504-655f-4829-ba8b-216f14fb1ae9 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:59.388170 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7a879504-655f-4829-ba8b-216f14fb1ae9 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:59.388603 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7a879504-655f-4829-ba8b-216f14fb1ae9 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:59.794155 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-7a879504-655f-4829-ba8b-216f14fb1ae9 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87616cd16995468ab7febf5aa4b284db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e3bf9149434d34b6762aaeef1478ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:59.806350 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-7a879504-655f-4829-ba8b-216f14fb1ae9 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] 10.222.0.43 "GET /compute/v2.1/servers/e3380b36-6aba-4736-bcbc-f0058f806d55" status: 200 len: 1478 microversion: 2.1 time: 0.449016 Oct 04 21:47:59.808146 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 688/1324] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:59 2022] GET /compute/v2.1/servers/e3380b36-6aba-4736-bcbc-f0058f806d55 => generated 1478 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:59.814768 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-bfbc07e6-2512-4104-bfe7-6547f4086b85 req-1ef9eeb2-0ede-47c8-ae0d-c4ea920cf25f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3380b36-6aba-4736-bcbc-f0058f806d55", "name": "network-vif-unplugged", "status": "completed", "tag": "b25814f1-d2d0-4853-bfa4-3948c24c40e5"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:47:59.827548 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-bfbc07e6-2512-4104-bfe7-6547f4086b85 req-1ef9eeb2-0ede-47c8-ae0d-c4ea920cf25f service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:59.828231 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-bfbc07e6-2512-4104-bfe7-6547f4086b85 req-1ef9eeb2-0ede-47c8-ae0d-c4ea920cf25f service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:59.828771 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-bfbc07e6-2512-4104-bfe7-6547f4086b85 req-1ef9eeb2-0ede-47c8-ae0d-c4ea920cf25f service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:59.842760 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-bfbc07e6-2512-4104-bfe7-6547f4086b85 req-1ef9eeb2-0ede-47c8-ae0d-c4ea920cf25f service nova] Creating event network-vif-unplugged:b25814f1-d2d0-4853-bfa4-3948c24c40e5 for instance e3380b36-6aba-4736-bcbc-f0058f806d55 on n-h2-860284-1 Oct 04 21:47:59.849424 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-bfbc07e6-2512-4104-bfe7-6547f4086b85 req-1ef9eeb2-0ede-47c8-ae0d-c4ea920cf25f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039109 Oct 04 21:47:59.851373 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 689/1325] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:47:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:47:59.857966 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-4bbb43cd-088a-4b5d-98a4-64397d48a22a tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:59.859151 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-4bbb43cd-088a-4b5d-98a4-64397d48a22a tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] [instance: 197b66b3-69ef-4b80-9de7-b25ae132dc2e] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:59.867930 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4bbb43cd-088a-4b5d-98a4-64397d48a22a tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:59.869010 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4bbb43cd-088a-4b5d-98a4-64397d48a22a tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:59.869884 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4bbb43cd-088a-4b5d-98a4-64397d48a22a tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:59.871534 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4bbb43cd-088a-4b5d-98a4-64397d48a22a tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:59.872202 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4bbb43cd-088a-4b5d-98a4-64397d48a22a tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:59.872977 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4bbb43cd-088a-4b5d-98a4-64397d48a22a tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:59.902992 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=4,nova_cell1:INSERT=1 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:47:59.941049 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-df06fbd6-ed8f-4650-b70c-a482c94e9bb0 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] 10.222.0.43 "POST /compute/v2.1/servers/1e9957cf-cfeb-483d-bc32-73ca72a54eb9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.703882 Oct 04 21:47:59.946457 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 637/1326] 10.222.0.43 () {60 vars in 1323 bytes} [Tue Oct 4 21:47:59 2022] POST /compute/v2.1/servers/1e9957cf-cfeb-483d-bc32-73ca72a54eb9/os-volume_attachments => generated 194 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:47:59.956630 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-79ea7b49-2a75-4fe7-b537-21c2cca3857b tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:59.957342 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-79ea7b49-2a75-4fe7-b537-21c2cca3857b tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: 424a22f0-ccc3-4fec-bf38-4aaf924928e3] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:48:00.003492 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-79ea7b49-2a75-4fe7-b537-21c2cca3857b tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:00.003884 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-4bbb43cd-088a-4b5d-98a4-64397d48a22a tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7e992115ea4ba58205d3da003ec625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5345566eeb4a5f88d31f733eaa04bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:48:00.004032 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-79ea7b49-2a75-4fe7-b537-21c2cca3857b tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:00.004433 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-79ea7b49-2a75-4fe7-b537-21c2cca3857b tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:00.005713 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-79ea7b49-2a75-4fe7-b537-21c2cca3857b tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:00.006178 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-79ea7b49-2a75-4fe7-b537-21c2cca3857b tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:00.006667 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-79ea7b49-2a75-4fe7-b537-21c2cca3857b tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:00.019811 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-4bbb43cd-088a-4b5d-98a4-64397d48a22a tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] 10.222.0.43 "GET /compute/v2.1/servers/197b66b3-69ef-4b80-9de7-b25ae132dc2e" status: 200 len: 1266 microversion: 2.1 time: 0.166417 Oct 04 21:48:00.022636 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 690/1327] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:59 2022] GET /compute/v2.1/servers/197b66b3-69ef-4b80-9de7-b25ae132dc2e => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:48:00.212391 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-6400d3ca-da42-45de-9c36-09135a615ce5 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Calling method '.version_select at 0x7fbb2efc0b80>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:00.297753 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-6400d3ca-da42-45de-9c36-09135a615ce5 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] 10.222.0.43 "GET /compute/v2.1/images/6b7f3390-fca2-4f36-a6ff-e815f6857c6a" status: 200 len: 1426 microversion: 2.1 time: 0.089303 Oct 04 21:48:00.311240 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-79ea7b49-2a75-4fe7-b537-21c2cca3857b tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:48:00.319905 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-79ea7b49-2a75-4fe7-b537-21c2cca3857b tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/424a22f0-ccc3-4fec-bf38-4aaf924928e3" status: 200 len: 1534 microversion: 2.1 time: 0.370309 Oct 04 21:48:00.320789 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 691/1328] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:48:00 2022] GET /compute/v2.1/images/6b7f3390-fca2-4f36-a6ff-e815f6857c6a => generated 1426 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:48:00.321841 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 638/1329] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:59 2022] GET /compute/v2.1/servers/424a22f0-ccc3-4fec-bf38-4aaf924928e3 => generated 1534 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:48:00.760393 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-a6754911-5ead-4196-9bc4-7967d3506e33 req-8d6e1c84-ceab-4b4a-a4be-e4497a2d3f0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "424a22f0-ccc3-4fec-bf38-4aaf924928e3", "name": "network-vif-unplugged", "status": "completed", "tag": "0fc2e8ca-ce8a-4b4a-992c-9e648d20829d"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:48:00.780165 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-a6754911-5ead-4196-9bc4-7967d3506e33 req-8d6e1c84-ceab-4b4a-a4be-e4497a2d3f0a service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:00.780669 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-a6754911-5ead-4196-9bc4-7967d3506e33 req-8d6e1c84-ceab-4b4a-a4be-e4497a2d3f0a service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:00.783004 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-a6754911-5ead-4196-9bc4-7967d3506e33 req-8d6e1c84-ceab-4b4a-a4be-e4497a2d3f0a service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:00.808168 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-a6754911-5ead-4196-9bc4-7967d3506e33 req-8d6e1c84-ceab-4b4a-a4be-e4497a2d3f0a service nova] Creating event network-vif-unplugged:0fc2e8ca-ce8a-4b4a-992c-9e648d20829d for instance 424a22f0-ccc3-4fec-bf38-4aaf924928e3 on n-h2-860284-1 Oct 04 21:48:00.828877 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [req-a6754911-5ead-4196-9bc4-7967d3506e33 req-8d6e1c84-ceab-4b4a-a4be-e4497a2d3f0a service nova] Instance 424a22f0-ccc3-4fec-bf38-4aaf924928e3 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860284-1', 'n-h2-860284-1'} {{(pid=134102) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 21:48:00.832258 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-297cd47d-9aae-4b0a-9772-0f40d7c94802 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:00.832880 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-297cd47d-9aae-4b0a-9772-0f40d7c94802 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] [instance: e3380b36-6aba-4736-bcbc-f0058f806d55] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:48:00.844671 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-a6754911-5ead-4196-9bc4-7967d3506e33 req-8d6e1c84-ceab-4b4a-a4be-e4497a2d3f0a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.093028 Oct 04 21:48:00.845941 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 692/1330] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:48:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:48:00.850505 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-297cd47d-9aae-4b0a-9772-0f40d7c94802 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:00.851567 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-297cd47d-9aae-4b0a-9772-0f40d7c94802 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:00.852027 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-297cd47d-9aae-4b0a-9772-0f40d7c94802 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:00.859077 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-297cd47d-9aae-4b0a-9772-0f40d7c94802 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:00.860213 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-297cd47d-9aae-4b0a-9772-0f40d7c94802 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:00.866669 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-297cd47d-9aae-4b0a-9772-0f40d7c94802 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:01.046321 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-90cc8914-d670-45b0-9d6a-76003463525b tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:01.047119 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-90cc8914-d670-45b0-9d6a-76003463525b tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] [instance: 197b66b3-69ef-4b80-9de7-b25ae132dc2e] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:48:01.091310 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-297cd47d-9aae-4b0a-9772-0f40d7c94802 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87616cd16995468ab7febf5aa4b284db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e3bf9149434d34b6762aaeef1478ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:48:01.097142 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-90cc8914-d670-45b0-9d6a-76003463525b tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:01.097923 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-90cc8914-d670-45b0-9d6a-76003463525b tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:01.098615 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-90cc8914-d670-45b0-9d6a-76003463525b tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:01.103984 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-297cd47d-9aae-4b0a-9772-0f40d7c94802 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] 10.222.0.43 "GET /compute/v2.1/servers/e3380b36-6aba-4736-bcbc-f0058f806d55" status: 200 len: 1478 microversion: 2.1 time: 0.275555 Oct 04 21:48:01.104433 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-90cc8914-d670-45b0-9d6a-76003463525b tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:01.105012 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-90cc8914-d670-45b0-9d6a-76003463525b tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:01.123737 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-90cc8914-d670-45b0-9d6a-76003463525b tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:01.123986 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 639/1331] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:48:00 2022] GET /compute/v2.1/servers/e3380b36-6aba-4736-bcbc-f0058f806d55 => generated 1478 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:48:01.266928 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-90cc8914-d670-45b0-9d6a-76003463525b tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7e992115ea4ba58205d3da003ec625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5345566eeb4a5f88d31f733eaa04bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:48:01.280599 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-90cc8914-d670-45b0-9d6a-76003463525b tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] 10.222.0.43 "GET /compute/v2.1/servers/197b66b3-69ef-4b80-9de7-b25ae132dc2e" status: 200 len: 1272 microversion: 2.1 time: 0.238308 Oct 04 21:48:01.281417 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 693/1332] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:48:01 2022] GET /compute/v2.1/servers/197b66b3-69ef-4b80-9de7-b25ae132dc2e => generated 1272 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:48:01.314993 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-775093cd-6c16-4c6e-a927-a76df7d3fa94 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Calling method '.version_select at 0x7fbb2ee2f550>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:01.348718 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-479af7a6-78b8-4e99-8f60-ae1171de85fb tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:01.350354 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-479af7a6-78b8-4e99-8f60-ae1171de85fb tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: 424a22f0-ccc3-4fec-bf38-4aaf924928e3] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:48:01.369465 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-479af7a6-78b8-4e99-8f60-ae1171de85fb tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:01.370345 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-479af7a6-78b8-4e99-8f60-ae1171de85fb tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:01.371332 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-479af7a6-78b8-4e99-8f60-ae1171de85fb tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:01.371885 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-479af7a6-78b8-4e99-8f60-ae1171de85fb tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:01.372497 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-479af7a6-78b8-4e99-8f60-ae1171de85fb tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:01.373074 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-479af7a6-78b8-4e99-8f60-ae1171de85fb tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:01.406848 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-775093cd-6c16-4c6e-a927-a76df7d3fa94 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] 10.222.0.43 "GET /compute/v2.1/images/6b7f3390-fca2-4f36-a6ff-e815f6857c6a" status: 200 len: 1426 microversion: 2.1 time: 0.096169 Oct 04 21:48:01.410238 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 640/1333] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:48:01 2022] GET /compute/v2.1/images/6b7f3390-fca2-4f36-a6ff-e815f6857c6a => generated 1426 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:48:01.640665 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=100 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:48:01.837596 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-479af7a6-78b8-4e99-8f60-ae1171de85fb tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:48:01.853812 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-479af7a6-78b8-4e99-8f60-ae1171de85fb tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/424a22f0-ccc3-4fec-bf38-4aaf924928e3" status: 200 len: 1534 microversion: 2.1 time: 0.510128 Oct 04 21:48:01.876107 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 694/1334] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:48:01 2022] GET /compute/v2.1/servers/424a22f0-ccc3-4fec-bf38-4aaf924928e3 => generated 1534 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:48:02.138855 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-91b977eb-a12a-4cdb-bd32-6ea85d7c4efa tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:02.139987 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-91b977eb-a12a-4cdb-bd32-6ea85d7c4efa tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] [instance: e3380b36-6aba-4736-bcbc-f0058f806d55] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:48:02.166530 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-91b977eb-a12a-4cdb-bd32-6ea85d7c4efa tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:02.167473 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-91b977eb-a12a-4cdb-bd32-6ea85d7c4efa tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:02.168190 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-91b977eb-a12a-4cdb-bd32-6ea85d7c4efa tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:02.169134 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-91b977eb-a12a-4cdb-bd32-6ea85d7c4efa tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:02.174144 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-91b977eb-a12a-4cdb-bd32-6ea85d7c4efa tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:02.174950 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-91b977eb-a12a-4cdb-bd32-6ea85d7c4efa tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:02.305163 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-da9b49d8-d960-49d7-b2a3-23a97a060bc5 tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:02.305938 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-da9b49d8-d960-49d7-b2a3-23a97a060bc5 tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] [instance: 197b66b3-69ef-4b80-9de7-b25ae132dc2e] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:48:02.313433 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-da9b49d8-d960-49d7-b2a3-23a97a060bc5 tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:02.320441 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-da9b49d8-d960-49d7-b2a3-23a97a060bc5 tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:02.321102 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-da9b49d8-d960-49d7-b2a3-23a97a060bc5 tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:02.321948 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-da9b49d8-d960-49d7-b2a3-23a97a060bc5 tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:02.325900 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-da9b49d8-d960-49d7-b2a3-23a97a060bc5 tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:02.326473 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-da9b49d8-d960-49d7-b2a3-23a97a060bc5 tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:02.494136 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-da9b49d8-d960-49d7-b2a3-23a97a060bc5 tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7e992115ea4ba58205d3da003ec625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5345566eeb4a5f88d31f733eaa04bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:48:02.502407 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-da9b49d8-d960-49d7-b2a3-23a97a060bc5 tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] 10.222.0.43 "GET /compute/v2.1/servers/197b66b3-69ef-4b80-9de7-b25ae132dc2e" status: 200 len: 1272 microversion: 2.1 time: 0.202169 Oct 04 21:48:02.505576 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 695/1335] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:48:02 2022] GET /compute/v2.1/servers/197b66b3-69ef-4b80-9de7-b25ae132dc2e => generated 1272 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:48:02.523156 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-f2370d2a-a190-44db-85f8-d71f8e19b89b tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Calling method '.version_select at 0x7fbb2f01bee0>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:02.545116 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-91b977eb-a12a-4cdb-bd32-6ea85d7c4efa tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87616cd16995468ab7febf5aa4b284db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e3bf9149434d34b6762aaeef1478ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:48:02.561377 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-91b977eb-a12a-4cdb-bd32-6ea85d7c4efa tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] 10.222.0.43 "GET /compute/v2.1/servers/e3380b36-6aba-4736-bcbc-f0058f806d55" status: 200 len: 1478 microversion: 2.1 time: 0.435870 Oct 04 21:48:02.564876 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 641/1336] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:48:02 2022] GET /compute/v2.1/servers/e3380b36-6aba-4736-bcbc-f0058f806d55 => generated 1478 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:48:02.609372 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-f2370d2a-a190-44db-85f8-d71f8e19b89b tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] 10.222.0.43 "GET /compute/v2.1/images/6b7f3390-fca2-4f36-a6ff-e815f6857c6a" status: 200 len: 1426 microversion: 2.1 time: 0.100523 Oct 04 21:48:02.619599 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 696/1337] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:48:02 2022] GET /compute/v2.1/images/6b7f3390-fca2-4f36-a6ff-e815f6857c6a => generated 1426 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:48:02.876305 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-3b7aed01-3536-4e8c-881a-cbf05d18087f req-17d2ea7e-45e9-469d-8046-71411bf6c299 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "424a22f0-ccc3-4fec-bf38-4aaf924928e3", "tag": "0fc2e8ca-ce8a-4b4a-992c-9e648d20829d"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:48:02.883549 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-039a61f5-b8eb-435a-9b02-290b4de9d412 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:02.885286 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-039a61f5-b8eb-435a-9b02-290b4de9d412 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: 424a22f0-ccc3-4fec-bf38-4aaf924928e3] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:48:02.889051 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=11 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:48:02.902062 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-3b7aed01-3536-4e8c-881a-cbf05d18087f req-17d2ea7e-45e9-469d-8046-71411bf6c299 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:02.902774 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-3b7aed01-3536-4e8c-881a-cbf05d18087f req-17d2ea7e-45e9-469d-8046-71411bf6c299 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:02.903309 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-3b7aed01-3536-4e8c-881a-cbf05d18087f req-17d2ea7e-45e9-469d-8046-71411bf6c299 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:02.905038 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-039a61f5-b8eb-435a-9b02-290b4de9d412 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:02.905737 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-039a61f5-b8eb-435a-9b02-290b4de9d412 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:02.906189 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-039a61f5-b8eb-435a-9b02-290b4de9d412 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:02.906978 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-039a61f5-b8eb-435a-9b02-290b4de9d412 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:02.907594 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-039a61f5-b8eb-435a-9b02-290b4de9d412 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:02.908195 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-039a61f5-b8eb-435a-9b02-290b4de9d412 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:02.962654 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-3b7aed01-3536-4e8c-881a-cbf05d18087f req-17d2ea7e-45e9-469d-8046-71411bf6c299 service nova] Creating event network-changed:0fc2e8ca-ce8a-4b4a-992c-9e648d20829d for instance 424a22f0-ccc3-4fec-bf38-4aaf924928e3 on n-h2-860284-1 Oct 04 21:48:02.978162 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [req-3b7aed01-3536-4e8c-881a-cbf05d18087f req-17d2ea7e-45e9-469d-8046-71411bf6c299 service nova] Instance 424a22f0-ccc3-4fec-bf38-4aaf924928e3 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860284-1', 'n-h2-860284-1'} {{(pid=134101) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 21:48:03.007567 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-3b7aed01-3536-4e8c-881a-cbf05d18087f req-17d2ea7e-45e9-469d-8046-71411bf6c299 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.138479 Oct 04 21:48:03.015080 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 642/1338] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:48:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:48:03.263703 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-039a61f5-b8eb-435a-9b02-290b4de9d412 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:48:03.279652 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-039a61f5-b8eb-435a-9b02-290b4de9d412 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/424a22f0-ccc3-4fec-bf38-4aaf924928e3" status: 200 len: 1534 microversion: 2.1 time: 0.401929 Oct 04 21:48:03.299280 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 697/1339] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:48:02 2022] GET /compute/v2.1/servers/424a22f0-ccc3-4fec-bf38-4aaf924928e3 => generated 1534 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:48:03.534896 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-075f007c-1c37-4065-977b-db3117362706 tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:03.536491 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-075f007c-1c37-4065-977b-db3117362706 tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] [instance: 197b66b3-69ef-4b80-9de7-b25ae132dc2e] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:48:03.553440 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-075f007c-1c37-4065-977b-db3117362706 tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:03.554437 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-075f007c-1c37-4065-977b-db3117362706 tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:03.555172 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-075f007c-1c37-4065-977b-db3117362706 tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:03.556147 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-075f007c-1c37-4065-977b-db3117362706 tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:03.557063 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-075f007c-1c37-4065-977b-db3117362706 tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:03.557956 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-075f007c-1c37-4065-977b-db3117362706 tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:03.587994 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-932ae5d0-f75f-4207-85be-7b38a963c179 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:03.589004 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-932ae5d0-f75f-4207-85be-7b38a963c179 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] [instance: e3380b36-6aba-4736-bcbc-f0058f806d55] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:48:03.602248 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-932ae5d0-f75f-4207-85be-7b38a963c179 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:03.604626 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-932ae5d0-f75f-4207-85be-7b38a963c179 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:03.606920 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-932ae5d0-f75f-4207-85be-7b38a963c179 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:03.607953 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-932ae5d0-f75f-4207-85be-7b38a963c179 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:03.608870 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-932ae5d0-f75f-4207-85be-7b38a963c179 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:03.610829 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-932ae5d0-f75f-4207-85be-7b38a963c179 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:03.991070 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-932ae5d0-f75f-4207-85be-7b38a963c179 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87616cd16995468ab7febf5aa4b284db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e3bf9149434d34b6762aaeef1478ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:48:04.012667 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-932ae5d0-f75f-4207-85be-7b38a963c179 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] 10.222.0.43 "GET /compute/v2.1/servers/e3380b36-6aba-4736-bcbc-f0058f806d55" status: 200 len: 1478 microversion: 2.1 time: 0.423924 Oct 04 21:48:04.016286 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 698/1340] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:48:03 2022] GET /compute/v2.1/servers/e3380b36-6aba-4736-bcbc-f0058f806d55 => generated 1478 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:48:04.041301 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-25925edd-1c4a-4651-bcc1-2164346ba97a tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Calling method '.version_select at 0x7fbb2f01b280>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:04.078197 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-075f007c-1c37-4065-977b-db3117362706 tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7e992115ea4ba58205d3da003ec625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5345566eeb4a5f88d31f733eaa04bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:48:04.092841 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-075f007c-1c37-4065-977b-db3117362706 tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] 10.222.0.43 "GET /compute/v2.1/servers/197b66b3-69ef-4b80-9de7-b25ae132dc2e" status: 200 len: 1314 microversion: 2.1 time: 0.566357 Oct 04 21:48:04.094233 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 643/1341] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:48:03 2022] GET /compute/v2.1/servers/197b66b3-69ef-4b80-9de7-b25ae132dc2e => generated 1314 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:48:04.104639 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-69ef8328-2d4f-436b-aaba-26959c39fa32 req-8fb029cf-433f-43bb-b928-94d7fac2a8ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3380b36-6aba-4736-bcbc-f0058f806d55", "name": "network-vif-plugged", "status": "completed", "tag": "b25814f1-d2d0-4853-bfa4-3948c24c40e5"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:48:04.124244 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-69ef8328-2d4f-436b-aaba-26959c39fa32 req-8fb029cf-433f-43bb-b928-94d7fac2a8ef service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:04.125044 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-69ef8328-2d4f-436b-aaba-26959c39fa32 req-8fb029cf-433f-43bb-b928-94d7fac2a8ef service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:04.125784 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-69ef8328-2d4f-436b-aaba-26959c39fa32 req-8fb029cf-433f-43bb-b928-94d7fac2a8ef service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:04.142087 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-25925edd-1c4a-4651-bcc1-2164346ba97a tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] 10.222.0.43 "GET /compute/v2.1/images/6b7f3390-fca2-4f36-a6ff-e815f6857c6a" status: 200 len: 1426 microversion: 2.1 time: 0.122972 Oct 04 21:48:04.153499 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 699/1342] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:48:04 2022] GET /compute/v2.1/images/6b7f3390-fca2-4f36-a6ff-e815f6857c6a => generated 1426 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:48:04.166774 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-69ef8328-2d4f-436b-aaba-26959c39fa32 req-8fb029cf-433f-43bb-b928-94d7fac2a8ef service nova] Creating event network-vif-plugged:b25814f1-d2d0-4853-bfa4-3948c24c40e5 for instance e3380b36-6aba-4736-bcbc-f0058f806d55 on n-h2-860284-1 Oct 04 21:48:04.182246 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-69ef8328-2d4f-436b-aaba-26959c39fa32 req-8fb029cf-433f-43bb-b928-94d7fac2a8ef service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081378 Oct 04 21:48:04.183403 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 644/1343] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:48:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:48:04.318689 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-e7f4b143-f1b5-462e-9c98-df5c32d02041 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:04.319608 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-e7f4b143-f1b5-462e-9c98-df5c32d02041 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: 424a22f0-ccc3-4fec-bf38-4aaf924928e3] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:48:04.333632 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e7f4b143-f1b5-462e-9c98-df5c32d02041 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:04.335096 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e7f4b143-f1b5-462e-9c98-df5c32d02041 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:04.336806 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e7f4b143-f1b5-462e-9c98-df5c32d02041 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:04.337607 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e7f4b143-f1b5-462e-9c98-df5c32d02041 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:04.338081 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e7f4b143-f1b5-462e-9c98-df5c32d02041 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:04.341196 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e7f4b143-f1b5-462e-9c98-df5c32d02041 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:04.590863 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-e7f4b143-f1b5-462e-9c98-df5c32d02041 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:48:04.600677 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-e7f4b143-f1b5-462e-9c98-df5c32d02041 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/424a22f0-ccc3-4fec-bf38-4aaf924928e3" status: 200 len: 1534 microversion: 2.1 time: 0.287306 Oct 04 21:48:04.602541 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 700/1344] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:48:04 2022] GET /compute/v2.1/servers/424a22f0-ccc3-4fec-bf38-4aaf924928e3 => generated 1534 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:48:05.040748 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-ef70c8cd-9b36-4955-87dc-fb3505273f17 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:05.041842 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-ef70c8cd-9b36-4955-87dc-fb3505273f17 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] [instance: e3380b36-6aba-4736-bcbc-f0058f806d55] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:48:05.068441 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-1245f38e-3e71-4da7-a7c1-b31b71d93910 req-a168c9a4-911d-4a4d-b824-7b937b900106 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "197b66b3-69ef-4b80-9de7-b25ae132dc2e", "tag": "26a59657-af0b-440a-bb00-9593baadfa84"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:48:05.072157 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ef70c8cd-9b36-4955-87dc-fb3505273f17 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:05.074976 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ef70c8cd-9b36-4955-87dc-fb3505273f17 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:05.075850 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ef70c8cd-9b36-4955-87dc-fb3505273f17 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:05.077256 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ef70c8cd-9b36-4955-87dc-fb3505273f17 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:05.079048 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ef70c8cd-9b36-4955-87dc-fb3505273f17 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:05.080102 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ef70c8cd-9b36-4955-87dc-fb3505273f17 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:05.094494 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-1245f38e-3e71-4da7-a7c1-b31b71d93910 req-a168c9a4-911d-4a4d-b824-7b937b900106 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:05.094998 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-1245f38e-3e71-4da7-a7c1-b31b71d93910 req-a168c9a4-911d-4a4d-b824-7b937b900106 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:05.095768 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-1245f38e-3e71-4da7-a7c1-b31b71d93910 req-a168c9a4-911d-4a4d-b824-7b937b900106 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:05.132053 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-1245f38e-3e71-4da7-a7c1-b31b71d93910 req-a168c9a4-911d-4a4d-b824-7b937b900106 service nova] Creating event network-changed:26a59657-af0b-440a-bb00-9593baadfa84 for instance 197b66b3-69ef-4b80-9de7-b25ae132dc2e on n-h1-860284-1 Oct 04 21:48:05.141670 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-1245f38e-3e71-4da7-a7c1-b31b71d93910 req-a168c9a4-911d-4a4d-b824-7b937b900106 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078585 Oct 04 21:48:05.143401 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 701/1345] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:48:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:48:05.149555 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-e57e9a08-482a-4078-85f9-2cf0746f422c tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:05.150724 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-e57e9a08-482a-4078-85f9-2cf0746f422c tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] [instance: 197b66b3-69ef-4b80-9de7-b25ae132dc2e] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:48:05.159221 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e57e9a08-482a-4078-85f9-2cf0746f422c tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:05.160053 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e57e9a08-482a-4078-85f9-2cf0746f422c tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:05.160841 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e57e9a08-482a-4078-85f9-2cf0746f422c tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:05.161980 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e57e9a08-482a-4078-85f9-2cf0746f422c tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:05.163708 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e57e9a08-482a-4078-85f9-2cf0746f422c tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:05.164375 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e57e9a08-482a-4078-85f9-2cf0746f422c tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:05.432060 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-e57e9a08-482a-4078-85f9-2cf0746f422c tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7e992115ea4ba58205d3da003ec625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5345566eeb4a5f88d31f733eaa04bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:48:05.459843 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-e57e9a08-482a-4078-85f9-2cf0746f422c tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] 10.222.0.43 "GET /compute/v2.1/servers/197b66b3-69ef-4b80-9de7-b25ae132dc2e" status: 200 len: 1314 microversion: 2.1 time: 0.314627 Oct 04 21:48:05.460451 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 702/1346] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:48:05 2022] GET /compute/v2.1/servers/197b66b3-69ef-4b80-9de7-b25ae132dc2e => generated 1314 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:48:05.492739 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-4d2ff309-3fb1-40de-8062-54be1f25481a tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Calling method '.version_select at 0x7fbb2f170550>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:05.535310 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-ef70c8cd-9b36-4955-87dc-fb3505273f17 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87616cd16995468ab7febf5aa4b284db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e3bf9149434d34b6762aaeef1478ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:48:05.547393 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-ef70c8cd-9b36-4955-87dc-fb3505273f17 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] 10.222.0.43 "GET /compute/v2.1/servers/e3380b36-6aba-4736-bcbc-f0058f806d55" status: 200 len: 1478 microversion: 2.1 time: 0.510988 Oct 04 21:48:05.551732 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 645/1347] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:48:05 2022] GET /compute/v2.1/servers/e3380b36-6aba-4736-bcbc-f0058f806d55 => generated 1478 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:48:05.578733 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-4d2ff309-3fb1-40de-8062-54be1f25481a tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] 10.222.0.43 "GET /compute/v2.1/images/6b7f3390-fca2-4f36-a6ff-e815f6857c6a" status: 200 len: 1426 microversion: 2.1 time: 0.095116 Oct 04 21:48:05.579726 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 703/1348] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:48:05 2022] GET /compute/v2.1/images/6b7f3390-fca2-4f36-a6ff-e815f6857c6a => generated 1426 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:48:05.624982 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-6a774d1d-0533-4b3e-9f6a-5647c257a637 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:05.625610 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-6a774d1d-0533-4b3e-9f6a-5647c257a637 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: 424a22f0-ccc3-4fec-bf38-4aaf924928e3] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:48:05.640521 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6a774d1d-0533-4b3e-9f6a-5647c257a637 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:05.641060 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6a774d1d-0533-4b3e-9f6a-5647c257a637 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:05.641516 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6a774d1d-0533-4b3e-9f6a-5647c257a637 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:05.642266 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6a774d1d-0533-4b3e-9f6a-5647c257a637 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:05.642756 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6a774d1d-0533-4b3e-9f6a-5647c257a637 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:05.647376 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6a774d1d-0533-4b3e-9f6a-5647c257a637 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:05.971362 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-6a774d1d-0533-4b3e-9f6a-5647c257a637 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:48:05.980179 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-6a774d1d-0533-4b3e-9f6a-5647c257a637 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/424a22f0-ccc3-4fec-bf38-4aaf924928e3" status: 200 len: 1534 microversion: 2.1 time: 0.358979 Oct 04 21:48:06.005633 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 646/1349] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:48:05 2022] GET /compute/v2.1/servers/424a22f0-ccc3-4fec-bf38-4aaf924928e3 => generated 1534 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:48:06.484369 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-8ecb0734-9411-4b18-a049-edeb4aeb02d9 tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:06.485002 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-8ecb0734-9411-4b18-a049-edeb4aeb02d9 tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] [instance: 197b66b3-69ef-4b80-9de7-b25ae132dc2e] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:48:06.507695 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8ecb0734-9411-4b18-a049-edeb4aeb02d9 tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:06.508575 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8ecb0734-9411-4b18-a049-edeb4aeb02d9 tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:06.509191 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8ecb0734-9411-4b18-a049-edeb4aeb02d9 tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:06.510438 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8ecb0734-9411-4b18-a049-edeb4aeb02d9 tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:06.512202 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8ecb0734-9411-4b18-a049-edeb4aeb02d9 tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:06.514267 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8ecb0734-9411-4b18-a049-edeb4aeb02d9 tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:06.572372 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-7154f7b6-3a75-41b5-afc7-9d96822036d3 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:06.573600 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-7154f7b6-3a75-41b5-afc7-9d96822036d3 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] [instance: e3380b36-6aba-4736-bcbc-f0058f806d55] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:48:06.592570 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7154f7b6-3a75-41b5-afc7-9d96822036d3 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:06.593365 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7154f7b6-3a75-41b5-afc7-9d96822036d3 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:06.593971 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7154f7b6-3a75-41b5-afc7-9d96822036d3 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:06.594902 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7154f7b6-3a75-41b5-afc7-9d96822036d3 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:06.595515 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7154f7b6-3a75-41b5-afc7-9d96822036d3 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:06.596100 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7154f7b6-3a75-41b5-afc7-9d96822036d3 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:06.862966 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-8ecb0734-9411-4b18-a049-edeb4aeb02d9 tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7e992115ea4ba58205d3da003ec625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5345566eeb4a5f88d31f733eaa04bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:48:06.875668 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-8ecb0734-9411-4b18-a049-edeb4aeb02d9 tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] 10.222.0.43 "GET /compute/v2.1/servers/197b66b3-69ef-4b80-9de7-b25ae132dc2e" status: 200 len: 1314 microversion: 2.1 time: 0.396214 Oct 04 21:48:06.893156 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 704/1350] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:48:06 2022] GET /compute/v2.1/servers/197b66b3-69ef-4b80-9de7-b25ae132dc2e => generated 1314 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:48:06.903942 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-d9c35935-4a0b-4ebf-8566-f18c324d8577 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Calling method '.version_select at 0x7fbb2f170ee0>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:06.936877 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell0:SELECT=12 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:48:06.963259 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-d9c35935-4a0b-4ebf-8566-f18c324d8577 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] 10.222.0.43 "GET /compute/v2.1/images/6b7f3390-fca2-4f36-a6ff-e815f6857c6a" status: 200 len: 1426 microversion: 2.1 time: 0.068079 Oct 04 21:48:06.967086 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 705/1351] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:48:06 2022] GET /compute/v2.1/images/6b7f3390-fca2-4f36-a6ff-e815f6857c6a => generated 1426 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:48:07.015280 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-7ed7371b-8810-4c03-97d3-5575d30f056a tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:07.015935 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-7ed7371b-8810-4c03-97d3-5575d30f056a tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: 424a22f0-ccc3-4fec-bf38-4aaf924928e3] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:48:07.026209 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7ed7371b-8810-4c03-97d3-5575d30f056a tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:07.028645 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7ed7371b-8810-4c03-97d3-5575d30f056a tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:07.031200 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7ed7371b-8810-4c03-97d3-5575d30f056a tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:07.033169 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7ed7371b-8810-4c03-97d3-5575d30f056a tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:07.033695 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7ed7371b-8810-4c03-97d3-5575d30f056a tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:07.034130 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7ed7371b-8810-4c03-97d3-5575d30f056a tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:07.262203 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-7154f7b6-3a75-41b5-afc7-9d96822036d3 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87616cd16995468ab7febf5aa4b284db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e3bf9149434d34b6762aaeef1478ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:48:07.272014 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-7154f7b6-3a75-41b5-afc7-9d96822036d3 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] 10.222.0.43 "GET /compute/v2.1/servers/e3380b36-6aba-4736-bcbc-f0058f806d55" status: 200 len: 1478 microversion: 2.1 time: 0.704688 Oct 04 21:48:07.273680 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 647/1352] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:48:06 2022] GET /compute/v2.1/servers/e3380b36-6aba-4736-bcbc-f0058f806d55 => generated 1478 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:48:07.371187 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-7ed7371b-8810-4c03-97d3-5575d30f056a tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:48:07.383086 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-7ed7371b-8810-4c03-97d3-5575d30f056a tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/424a22f0-ccc3-4fec-bf38-4aaf924928e3" status: 200 len: 1527 microversion: 2.1 time: 0.372028 Oct 04 21:48:07.384330 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 706/1353] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:48:07 2022] GET /compute/v2.1/servers/424a22f0-ccc3-4fec-bf38-4aaf924928e3 => generated 1527 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:48:07.408924 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-853e9d08-33f7-4c05-89be-404543097fa1 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:07.409541 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-853e9d08-33f7-4c05-89be-404543097fa1 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: 424a22f0-ccc3-4fec-bf38-4aaf924928e3] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:48:07.418300 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-853e9d08-33f7-4c05-89be-404543097fa1 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:07.419124 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-853e9d08-33f7-4c05-89be-404543097fa1 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:07.419866 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-853e9d08-33f7-4c05-89be-404543097fa1 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:07.420786 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-853e9d08-33f7-4c05-89be-404543097fa1 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:07.421435 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-853e9d08-33f7-4c05-89be-404543097fa1 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:07.422067 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-853e9d08-33f7-4c05-89be-404543097fa1 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:07.603789 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-853e9d08-33f7-4c05-89be-404543097fa1 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:48:07.615147 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-853e9d08-33f7-4c05-89be-404543097fa1 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/424a22f0-ccc3-4fec-bf38-4aaf924928e3" status: 200 len: 1527 microversion: 2.1 time: 0.209179 Oct 04 21:48:07.616733 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 648/1354] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:48:07 2022] GET /compute/v2.1/servers/424a22f0-ccc3-4fec-bf38-4aaf924928e3 => generated 1527 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:48:07.638396 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-7839f439-d4c1-43b5-97dd-c0eb8e60b8a2 tempest-MigrationsAdminTest-1218821219 tempest-MigrationsAdminTest-1218821219-project-admin] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:07.645142 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell0:SELECT=8 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:48:07.649716 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-7839f439-d4c1-43b5-97dd-c0eb8e60b8a2 tempest-MigrationsAdminTest-1218821219 tempest-MigrationsAdminTest-1218821219-project-admin] HTTP exception thrown: Flavor 2f11d680-cbcd-4967-844a-69bea5307624 could not be found. Oct 04 21:48:07.659088 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-7839f439-d4c1-43b5-97dd-c0eb8e60b8a2 tempest-MigrationsAdminTest-1218821219 tempest-MigrationsAdminTest-1218821219-project-admin] Request method failure captured: Oct 04 21:48:07.659088 n-d-860284-1 devstack@n-api.service[134102]: request: DELETE /compute/v2.1/flavors/2f11d680-cbcd-4967-844a-69bea5307624 HTTP/1.1 Oct 04 21:48:07.659088 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 21:48:07.659088 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 21:48:07.659088 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 21:48:07.659088 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 21:48:07.659088 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 21:48:07.659088 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 21:48:07.659088 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 21:48:07.659088 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 21:48:07.659088 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPKkTgi4ln7RhelT4WaEmK2x0JjxyaZjkRvevQPHOqz3Ud1rd3GuzgOuLeu67KCT0pgNVT0AkTnMjy3EUEW2_s6hEsl-ei7c43s8D8UmsQJk8M5xunz_m26mqDRgbgQ7UL06NDJdWe_N58a2pOYQqnrCt49g5jG9WBF7H5vYm5IpBbw4 Oct 04 21:48:07.659088 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 21:48:07.659088 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 21:48:07.659088 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 21:48:07.659088 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 21:48:07.659088 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 21:48:07.659088 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 21:48:07.659088 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: 26aafb7e29584718884558b0baf7af32 Oct 04 21:48:07.659088 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-MigrationsAdminTest-1218821219 Oct 04 21:48:07.659088 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,admin,member Oct 04 21:48:07.659088 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,admin,member Oct 04 21:48:07.660579 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/26aafb7e29584718884558b0baf7af32"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_26aafb7e29584718884558b0baf7af32", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/26aafb7e29584718884558b0baf7af32"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/26aafb7e29584718884558b0baf7af32"}]}] Oct 04 21:48:07.660579 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-MigrationsAdminTest-1218821219 Oct 04 21:48:07.660579 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: 26aafb7e29584718884558b0baf7af32 Oct 04 21:48:07.660579 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-MigrationsAdminTest-1218821219 Oct 04 21:48:07.660579 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-MigrationsAdminTest-1218821219-project-admin Oct 04 21:48:07.660579 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 21:48:07.660579 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 21:48:07.660579 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: 79dde648c25e4351a6049c34b0a0cb18 Oct 04 21:48:07.660579 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-MigrationsAdminTest-1218821219-project-admin Oct 04 21:48:07.660579 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 21:48:07.660579 n-d-860284-1 devstack@n-api.service[134102]: exception: Flavor 2f11d680-cbcd-4967-844a-69bea5307624 could not be found. Oct 04 21:48:07.660579 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': '2f11d680-cbcd-4967-844a-69bea5307624'} Oct 04 21:48:07.661448 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:48:07.661448 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:48:07.661448 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 43, in _delete Oct 04 21:48:07.661448 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi flavor.destroy() Oct 04 21:48:07.661448 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 04 21:48:07.661448 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 04 21:48:07.661448 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 558, in destroy Oct 04 21:48:07.661448 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi db_flavor = self._flavor_destroy(self._context, Oct 04 21:48:07.661448 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 544, in _flavor_destroy Oct 04 21:48:07.661448 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return _flavor_destroy(context, flavor_id=flavor_id, flavorid=flavorid) Oct 04 21:48:07.661448 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 21:48:07.661448 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 21:48:07.661448 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 185, in _flavor_destroy Oct 04 21:48:07.661448 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=(flavor_id or flavorid)) Oct 04 21:48:07.661448 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 2f11d680-cbcd-4967-844a-69bea5307624 could not be found. Oct 04 21:48:07.661448 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:48:07.661448 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:48:07.661448 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:48:07.661448 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:48:07.661448 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:48:07.663141 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:48:07.663141 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:48:07.663141 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:48:07.663141 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:48:07.663141 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:48:07.663141 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 45, in _delete Oct 04 21:48:07.663141 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:48:07.663141 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 2f11d680-cbcd-4967-844a-69bea5307624 could not be found. Oct 04 21:48:07.663141 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:48:07.663141 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:48:07.663141 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:48:07.663141 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:48:07.663141 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:48:07.663141 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:48:07.663141 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:48:07.663141 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:48:07.663141 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 2f11d680-cbcd-4967-844a-69bea5307624 could not be found. Oct 04 21:48:07.663141 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:48:07.665632 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-7839f439-d4c1-43b5-97dd-c0eb8e60b8a2 tempest-MigrationsAdminTest-1218821219 tempest-MigrationsAdminTest-1218821219-project-admin] Returning 404 to user: Flavor 2f11d680-cbcd-4967-844a-69bea5307624 could not be found. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:48:07.667218 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-7839f439-d4c1-43b5-97dd-c0eb8e60b8a2 tempest-MigrationsAdminTest-1218821219 tempest-MigrationsAdminTest-1218821219-project-admin] 10.222.0.43 "DELETE /compute/v2.1/flavors/2f11d680-cbcd-4967-844a-69bea5307624" status: 404 len: 109 microversion: 2.1 time: 0.032732 Oct 04 21:48:07.668453 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 707/1355] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 21:48:07 2022] DELETE /compute/v2.1/flavors/2f11d680-cbcd-4967-844a-69bea5307624 => generated 109 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:48:07.831745 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-4530d8c0-cf02-41c3-83bf-63619c382d54 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-378142966", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:48:07.902418 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.network.neutron [None req-4530d8c0-cf02-41c3-83bf-63619c382d54 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] validate_networks() for None {{(pid=134101) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:48:07.904155 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-5f7755a1-eeaf-4dbc-94e0-e3e789cbc0cb tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:07.904986 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-5f7755a1-eeaf-4dbc-94e0-e3e789cbc0cb tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] [instance: 197b66b3-69ef-4b80-9de7-b25ae132dc2e] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:48:07.926465 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5f7755a1-eeaf-4dbc-94e0-e3e789cbc0cb tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:07.927958 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5f7755a1-eeaf-4dbc-94e0-e3e789cbc0cb tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:07.932074 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5f7755a1-eeaf-4dbc-94e0-e3e789cbc0cb tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:07.933095 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5f7755a1-eeaf-4dbc-94e0-e3e789cbc0cb tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:07.933588 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5f7755a1-eeaf-4dbc-94e0-e3e789cbc0cb tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:07.934118 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5f7755a1-eeaf-4dbc-94e0-e3e789cbc0cb tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:08.193925 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-5f7755a1-eeaf-4dbc-94e0-e3e789cbc0cb tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7e992115ea4ba58205d3da003ec625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5345566eeb4a5f88d31f733eaa04bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:48:08.205071 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-5f7755a1-eeaf-4dbc-94e0-e3e789cbc0cb tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] 10.222.0.43 "GET /compute/v2.1/servers/197b66b3-69ef-4b80-9de7-b25ae132dc2e" status: 200 len: 1314 microversion: 2.1 time: 0.305390 Oct 04 21:48:08.206481 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 708/1356] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:48:07 2022] GET /compute/v2.1/servers/197b66b3-69ef-4b80-9de7-b25ae132dc2e => generated 1314 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:48:08.212664 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-3d0dd016-97e1-4ac8-8ef3-2eec2d7d5326 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Calling method '.version_select at 0x7fbb2f0b7820>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:08.268431 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-3d0dd016-97e1-4ac8-8ef3-2eec2d7d5326 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] 10.222.0.43 "GET /compute/v2.1/images/6b7f3390-fca2-4f36-a6ff-e815f6857c6a" status: 200 len: 1426 microversion: 2.1 time: 0.060671 Oct 04 21:48:08.277644 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 709/1357] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:48:08 2022] GET /compute/v2.1/images/6b7f3390-fca2-4f36-a6ff-e815f6857c6a => generated 1426 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:48:08.292537 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-4530d8c0-cf02-41c3-83bf-63619c382d54 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Flavor limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:48:08.293062 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-4530d8c0-cf02-41c3-83bf-63619c382d54 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Image limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:48:08.293627 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-4530d8c0-cf02-41c3-83bf-63619c382d54 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Flavor pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:48:08.294117 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-4530d8c0-cf02-41c3-83bf-63619c382d54 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Image pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:48:08.294583 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-4530d8c0-cf02-41c3-83bf-63619c382d54 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:48:08.308739 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-0ee608e0-c9a3-4f24-985e-d6e219e4c9dd tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:08.309371 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-0ee608e0-c9a3-4f24-985e-d6e219e4c9dd tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] [instance: e3380b36-6aba-4736-bcbc-f0058f806d55] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:48:08.314332 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4530d8c0-cf02-41c3-83bf-63619c382d54 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:08.314927 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4530d8c0-cf02-41c3-83bf-63619c382d54 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:08.315291 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4530d8c0-cf02-41c3-83bf-63619c382d54 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:08.317823 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4530d8c0-cf02-41c3-83bf-63619c382d54 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:08.320580 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4530d8c0-cf02-41c3-83bf-63619c382d54 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:08.321024 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4530d8c0-cf02-41c3-83bf-63619c382d54 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:08.326615 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0ee608e0-c9a3-4f24-985e-d6e219e4c9dd tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:08.327118 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0ee608e0-c9a3-4f24-985e-d6e219e4c9dd tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:08.327563 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0ee608e0-c9a3-4f24-985e-d6e219e4c9dd tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:08.332012 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0ee608e0-c9a3-4f24-985e-d6e219e4c9dd tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:08.332637 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0ee608e0-c9a3-4f24-985e-d6e219e4c9dd tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:08.333220 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0ee608e0-c9a3-4f24-985e-d6e219e4c9dd tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:08.366636 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-4530d8c0-cf02-41c3-83bf-63619c382d54 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Getting quotas for project 1ad1554e318e45f78a2bc5e148d0c39f. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:48:08.379396 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-4530d8c0-cf02-41c3-83bf-63619c382d54 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Getting quotas for user ff4e089659884b6d9197141ba9f14f57 and project 1ad1554e318e45f78a2bc5e148d0c39f. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:48:08.409659 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-4530d8c0-cf02-41c3-83bf-63619c382d54 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Going to run 1 instances... {{(pid=134101) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:48:08.413023 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-4530d8c0-cf02-41c3-83bf-63619c382d54 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: be573c06-25e7-485e-9443-5bc21196a45e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='58548514-5dac-426c-81f5-19e3fba33e23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134101) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:48:08.492624 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-4530d8c0-cf02-41c3-83bf-63619c382d54 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.665358 Oct 04 21:48:08.494021 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 649/1358] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 21:48:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 667 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 21:48:08.508819 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-d37bbf8e-ede4-4a10-a7ca-6a4cb4c163f2 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:08.511604 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-d37bbf8e-ede4-4a10-a7ca-6a4cb4c163f2 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: be573c06-25e7-485e-9443-5bc21196a45e] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:48:08.612864 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-d37bbf8e-ede4-4a10-a7ca-6a4cb4c163f2 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:48:08.619881 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-d37bbf8e-ede4-4a10-a7ca-6a4cb4c163f2 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/be573c06-25e7-485e-9443-5bc21196a45e" status: 200 len: 1212 microversion: 2.1 time: 0.118807 Oct 04 21:48:08.620472 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 650/1359] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:48:08 2022] GET /compute/v2.1/servers/be573c06-25e7-485e-9443-5bc21196a45e => generated 1212 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:48:08.644158 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-8e4697bd-9c92-47b6-a1c8-06a642a54065 req-aba48b2c-584e-4729-bb83-46549e971fb7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "424a22f0-ccc3-4fec-bf38-4aaf924928e3", "name": "network-vif-plugged", "status": "completed", "tag": "0fc2e8ca-ce8a-4b4a-992c-9e648d20829d"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:48:08.655988 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-0ee608e0-c9a3-4f24-985e-d6e219e4c9dd tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87616cd16995468ab7febf5aa4b284db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e3bf9149434d34b6762aaeef1478ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:48:08.666404 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-0ee608e0-c9a3-4f24-985e-d6e219e4c9dd tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] 10.222.0.43 "GET /compute/v2.1/servers/e3380b36-6aba-4736-bcbc-f0058f806d55" status: 200 len: 1478 microversion: 2.1 time: 0.367481 Oct 04 21:48:08.686674 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-8e4697bd-9c92-47b6-a1c8-06a642a54065 req-aba48b2c-584e-4729-bb83-46549e971fb7 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:08.686674 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-8e4697bd-9c92-47b6-a1c8-06a642a54065 req-aba48b2c-584e-4729-bb83-46549e971fb7 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:08.686674 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-8e4697bd-9c92-47b6-a1c8-06a642a54065 req-aba48b2c-584e-4729-bb83-46549e971fb7 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:08.687090 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 710/1360] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:48:08 2022] GET /compute/v2.1/servers/e3380b36-6aba-4736-bcbc-f0058f806d55 => generated 1478 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:48:08.695368 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-8e4697bd-9c92-47b6-a1c8-06a642a54065 req-aba48b2c-584e-4729-bb83-46549e971fb7 service nova] Creating event network-vif-plugged:0fc2e8ca-ce8a-4b4a-992c-9e648d20829d for instance 424a22f0-ccc3-4fec-bf38-4aaf924928e3 on n-h2-860284-1 Oct 04 21:48:08.701391 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-8e4697bd-9c92-47b6-a1c8-06a642a54065 req-aba48b2c-584e-4729-bb83-46549e971fb7 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063430 Oct 04 21:48:08.703100 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 651/1361] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:48:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:48:09.231499 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-dc68cf2f-fcaf-49a4-af63-d8ff938a9712 tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:09.232031 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-dc68cf2f-fcaf-49a4-af63-d8ff938a9712 tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] [instance: 197b66b3-69ef-4b80-9de7-b25ae132dc2e] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:48:09.238668 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dc68cf2f-fcaf-49a4-af63-d8ff938a9712 tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:09.239588 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dc68cf2f-fcaf-49a4-af63-d8ff938a9712 tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:09.240053 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dc68cf2f-fcaf-49a4-af63-d8ff938a9712 tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:09.241351 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dc68cf2f-fcaf-49a4-af63-d8ff938a9712 tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:09.241816 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dc68cf2f-fcaf-49a4-af63-d8ff938a9712 tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:09.242250 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dc68cf2f-fcaf-49a4-af63-d8ff938a9712 tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:09.289259 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-18a41227-ab12-4176-a2b7-adcbf9cf36cd tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Calling method '.version_select at 0x7fbb2edec9d0>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:09.404452 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-18a41227-ab12-4176-a2b7-adcbf9cf36cd tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] 10.222.0.43 "GET /compute/v2.1/images/6b7f3390-fca2-4f36-a6ff-e815f6857c6a" status: 200 len: 1426 microversion: 2.1 time: 0.123342 Oct 04 21:48:09.414826 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 652/1362] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:48:09 2022] GET /compute/v2.1/images/6b7f3390-fca2-4f36-a6ff-e815f6857c6a => generated 1426 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:48:09.482181 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-dc68cf2f-fcaf-49a4-af63-d8ff938a9712 tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7e992115ea4ba58205d3da003ec625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5345566eeb4a5f88d31f733eaa04bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:48:09.492003 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-dc68cf2f-fcaf-49a4-af63-d8ff938a9712 tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] 10.222.0.43 "GET /compute/v2.1/servers/197b66b3-69ef-4b80-9de7-b25ae132dc2e" status: 200 len: 1314 microversion: 2.1 time: 0.264475 Oct 04 21:48:09.504225 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 711/1363] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:48:09 2022] GET /compute/v2.1/servers/197b66b3-69ef-4b80-9de7-b25ae132dc2e => generated 1314 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:48:09.648479 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-7b4ce7d0-d9e6-47c7-afd1-9e4bc7d57846 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:09.649373 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-7b4ce7d0-d9e6-47c7-afd1-9e4bc7d57846 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: be573c06-25e7-485e-9443-5bc21196a45e] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:48:09.673251 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7b4ce7d0-d9e6-47c7-afd1-9e4bc7d57846 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:09.673922 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7b4ce7d0-d9e6-47c7-afd1-9e4bc7d57846 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:09.677741 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7b4ce7d0-d9e6-47c7-afd1-9e4bc7d57846 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:09.681506 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7b4ce7d0-d9e6-47c7-afd1-9e4bc7d57846 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:09.682207 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7b4ce7d0-d9e6-47c7-afd1-9e4bc7d57846 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:09.683036 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7b4ce7d0-d9e6-47c7-afd1-9e4bc7d57846 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:09.697440 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-911cd874-137c-4b19-8fe4-fc07a4ef7735 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:09.699064 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-911cd874-137c-4b19-8fe4-fc07a4ef7735 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] [instance: e3380b36-6aba-4736-bcbc-f0058f806d55] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:48:09.711596 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-911cd874-137c-4b19-8fe4-fc07a4ef7735 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:09.713910 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-911cd874-137c-4b19-8fe4-fc07a4ef7735 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:09.714385 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-911cd874-137c-4b19-8fe4-fc07a4ef7735 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:09.715128 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-911cd874-137c-4b19-8fe4-fc07a4ef7735 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:09.715591 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-911cd874-137c-4b19-8fe4-fc07a4ef7735 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:09.716025 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-911cd874-137c-4b19-8fe4-fc07a4ef7735 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:09.803607 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-7b4ce7d0-d9e6-47c7-afd1-9e4bc7d57846 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:48:09.814581 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-7b4ce7d0-d9e6-47c7-afd1-9e4bc7d57846 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/be573c06-25e7-485e-9443-5bc21196a45e" status: 200 len: 1264 microversion: 2.1 time: 0.169924 Oct 04 21:48:09.841833 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 653/1364] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:48:09 2022] GET /compute/v2.1/servers/be573c06-25e7-485e-9443-5bc21196a45e => generated 1264 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:48:09.915262 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-911cd874-137c-4b19-8fe4-fc07a4ef7735 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87616cd16995468ab7febf5aa4b284db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e3bf9149434d34b6762aaeef1478ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:48:09.926198 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-911cd874-137c-4b19-8fe4-fc07a4ef7735 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] 10.222.0.43 "GET /compute/v2.1/servers/e3380b36-6aba-4736-bcbc-f0058f806d55" status: 200 len: 1463 microversion: 2.1 time: 0.233050 Oct 04 21:48:09.941588 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 712/1365] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:48:09 2022] GET /compute/v2.1/servers/e3380b36-6aba-4736-bcbc-f0058f806d55 => generated 1463 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:48:09.964451 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-3f94b490-350b-4dd8-9e1a-c75986b562d5 tempest-ServersAdminTestJSON-717699517 tempest-ServersAdminTestJSON-717699517-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:48:09.968086 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-3f94b490-350b-4dd8-9e1a-c75986b562d5 tempest-ServersAdminTestJSON-717699517 tempest-ServersAdminTestJSON-717699517-project-admin] [instance: e3380b36-6aba-4736-bcbc-f0058f806d55] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:48:09.978556 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3f94b490-350b-4dd8-9e1a-c75986b562d5 tempest-ServersAdminTestJSON-717699517 tempest-ServersAdminTestJSON-717699517-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:09.979391 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3f94b490-350b-4dd8-9e1a-c75986b562d5 tempest-ServersAdminTestJSON-717699517 tempest-ServersAdminTestJSON-717699517-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:09.980041 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3f94b490-350b-4dd8-9e1a-c75986b562d5 tempest-ServersAdminTestJSON-717699517 tempest-ServersAdminTestJSON-717699517-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:09.981020 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3f94b490-350b-4dd8-9e1a-c75986b562d5 tempest-ServersAdminTestJSON-717699517 tempest-ServersAdminTestJSON-717699517-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:09.981673 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3f94b490-350b-4dd8-9e1a-c75986b562d5 tempest-ServersAdminTestJSON-717699517 tempest-ServersAdminTestJSON-717699517-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:09.982289 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3f94b490-350b-4dd8-9e1a-c75986b562d5 tempest-ServersAdminTestJSON-717699517 tempest-ServersAdminTestJSON-717699517-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:10.120928 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-3f94b490-350b-4dd8-9e1a-c75986b562d5 tempest-ServersAdminTestJSON-717699517 tempest-ServersAdminTestJSON-717699517-project-admin] 10.222.0.43 "POST /compute/v2.1/servers/e3380b36-6aba-4736-bcbc-f0058f806d55/action" status: 202 len: 0 microversion: 2.1 time: 0.162210 Oct 04 21:48:10.130413 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-18e5007a-5a5e-475a-be1a-bad0c68e373a tempest-ServersAdminTestJSON-717699517 tempest-ServersAdminTestJSON-717699517-project-admin] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:10.131145 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-18e5007a-5a5e-475a-be1a-bad0c68e373a tempest-ServersAdminTestJSON-717699517 tempest-ServersAdminTestJSON-717699517-project-admin] [instance: e3380b36-6aba-4736-bcbc-f0058f806d55] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:48:10.135670 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 654/1366] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 21:48:09 2022] POST /compute/v2.1/servers/e3380b36-6aba-4736-bcbc-f0058f806d55/action => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:48:10.140916 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-18e5007a-5a5e-475a-be1a-bad0c68e373a tempest-ServersAdminTestJSON-717699517 tempest-ServersAdminTestJSON-717699517-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:10.147044 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-18e5007a-5a5e-475a-be1a-bad0c68e373a tempest-ServersAdminTestJSON-717699517 tempest-ServersAdminTestJSON-717699517-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:10.148713 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-18e5007a-5a5e-475a-be1a-bad0c68e373a tempest-ServersAdminTestJSON-717699517 tempest-ServersAdminTestJSON-717699517-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:10.149658 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-18e5007a-5a5e-475a-be1a-bad0c68e373a tempest-ServersAdminTestJSON-717699517 tempest-ServersAdminTestJSON-717699517-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:10.151372 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-18e5007a-5a5e-475a-be1a-bad0c68e373a tempest-ServersAdminTestJSON-717699517 tempest-ServersAdminTestJSON-717699517-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:10.151816 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-18e5007a-5a5e-475a-be1a-bad0c68e373a tempest-ServersAdminTestJSON-717699517 tempest-ServersAdminTestJSON-717699517-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:10.205364 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-18e5007a-5a5e-475a-be1a-bad0c68e373a tempest-ServersAdminTestJSON-717699517 tempest-ServersAdminTestJSON-717699517-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:10.205941 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-18e5007a-5a5e-475a-be1a-bad0c68e373a tempest-ServersAdminTestJSON-717699517 tempest-ServersAdminTestJSON-717699517-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:10.206398 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-18e5007a-5a5e-475a-be1a-bad0c68e373a tempest-ServersAdminTestJSON-717699517 tempest-ServersAdminTestJSON-717699517-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:10.207017 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.objects.instance [None req-18e5007a-5a5e-475a-be1a-bad0c68e373a tempest-ServersAdminTestJSON-717699517 tempest-ServersAdminTestJSON-717699517-project-admin] Lazy-loading 'fault' on Instance uuid e3380b36-6aba-4736-bcbc-f0058f806d55 {{(pid=134102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:48:10.350947 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-18e5007a-5a5e-475a-be1a-bad0c68e373a tempest-ServersAdminTestJSON-717699517 tempest-ServersAdminTestJSON-717699517-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/e3380b36-6aba-4736-bcbc-f0058f806d55" status: 200 len: 1597 microversion: 2.1 time: 0.224441 Oct 04 21:48:10.351698 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 713/1367] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:48:10 2022] GET /compute/v2.1/servers/e3380b36-6aba-4736-bcbc-f0058f806d55 => generated 1597 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:48:10.379557 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-1c33948b-e9f1-4a43-8a24-0101df0c87cd tempest-ServersAdminTestJSON-717699517 tempest-ServersAdminTestJSON-717699517-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:48:10.382825 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-1c33948b-e9f1-4a43-8a24-0101df0c87cd tempest-ServersAdminTestJSON-717699517 tempest-ServersAdminTestJSON-717699517-project-admin] [instance: e3380b36-6aba-4736-bcbc-f0058f806d55] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:48:10.389446 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1c33948b-e9f1-4a43-8a24-0101df0c87cd tempest-ServersAdminTestJSON-717699517 tempest-ServersAdminTestJSON-717699517-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:10.390023 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1c33948b-e9f1-4a43-8a24-0101df0c87cd tempest-ServersAdminTestJSON-717699517 tempest-ServersAdminTestJSON-717699517-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:10.390714 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1c33948b-e9f1-4a43-8a24-0101df0c87cd tempest-ServersAdminTestJSON-717699517 tempest-ServersAdminTestJSON-717699517-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:10.391655 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1c33948b-e9f1-4a43-8a24-0101df0c87cd tempest-ServersAdminTestJSON-717699517 tempest-ServersAdminTestJSON-717699517-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:10.392210 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1c33948b-e9f1-4a43-8a24-0101df0c87cd tempest-ServersAdminTestJSON-717699517 tempest-ServersAdminTestJSON-717699517-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:10.393026 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1c33948b-e9f1-4a43-8a24-0101df0c87cd tempest-ServersAdminTestJSON-717699517 tempest-ServersAdminTestJSON-717699517-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:10.422142 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-5004832e-817c-49ac-956a-002a210fa43e tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Calling method '.version_select at 0x7fbb2f19e160>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:10.512307 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-1c33948b-e9f1-4a43-8a24-0101df0c87cd tempest-ServersAdminTestJSON-717699517 tempest-ServersAdminTestJSON-717699517-project-admin] 10.222.0.43 "POST /compute/v2.1/servers/e3380b36-6aba-4736-bcbc-f0058f806d55/action" status: 202 len: 0 microversion: 2.1 time: 0.134628 Oct 04 21:48:10.515016 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 655/1368] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 21:48:10 2022] POST /compute/v2.1/servers/e3380b36-6aba-4736-bcbc-f0058f806d55/action => generated 0 bytes in 139 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:48:10.522170 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-5004832e-817c-49ac-956a-002a210fa43e tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] 10.222.0.43 "GET /compute/v2.1/images/6b7f3390-fca2-4f36-a6ff-e815f6857c6a" status: 200 len: 1426 microversion: 2.1 time: 0.103812 Oct 04 21:48:10.532880 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 714/1369] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:48:10 2022] GET /compute/v2.1/images/6b7f3390-fca2-4f36-a6ff-e815f6857c6a => generated 1426 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:48:10.535518 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-f36bf810-3b63-478b-bc7e-3283560f2f43 tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:10.537229 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-f36bf810-3b63-478b-bc7e-3283560f2f43 tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] [instance: 197b66b3-69ef-4b80-9de7-b25ae132dc2e] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:48:10.539275 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-ee1465df-3f8e-47a5-a8b1-b9430e961c78 tempest-ServersAdminTestJSON-717699517 tempest-ServersAdminTestJSON-717699517-project-admin] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:10.539954 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-ee1465df-3f8e-47a5-a8b1-b9430e961c78 tempest-ServersAdminTestJSON-717699517 tempest-ServersAdminTestJSON-717699517-project-admin] [instance: e3380b36-6aba-4736-bcbc-f0058f806d55] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:48:10.547505 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f36bf810-3b63-478b-bc7e-3283560f2f43 tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:10.548301 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f36bf810-3b63-478b-bc7e-3283560f2f43 tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:10.548755 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f36bf810-3b63-478b-bc7e-3283560f2f43 tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:10.549331 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ee1465df-3f8e-47a5-a8b1-b9430e961c78 tempest-ServersAdminTestJSON-717699517 tempest-ServersAdminTestJSON-717699517-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:10.549613 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f36bf810-3b63-478b-bc7e-3283560f2f43 tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:10.550138 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ee1465df-3f8e-47a5-a8b1-b9430e961c78 tempest-ServersAdminTestJSON-717699517 tempest-ServersAdminTestJSON-717699517-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:10.550323 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f36bf810-3b63-478b-bc7e-3283560f2f43 tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:10.550916 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ee1465df-3f8e-47a5-a8b1-b9430e961c78 tempest-ServersAdminTestJSON-717699517 tempest-ServersAdminTestJSON-717699517-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:10.551381 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f36bf810-3b63-478b-bc7e-3283560f2f43 tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:10.553194 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ee1465df-3f8e-47a5-a8b1-b9430e961c78 tempest-ServersAdminTestJSON-717699517 tempest-ServersAdminTestJSON-717699517-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:10.553924 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ee1465df-3f8e-47a5-a8b1-b9430e961c78 tempest-ServersAdminTestJSON-717699517 tempest-ServersAdminTestJSON-717699517-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:10.554714 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ee1465df-3f8e-47a5-a8b1-b9430e961c78 tempest-ServersAdminTestJSON-717699517 tempest-ServersAdminTestJSON-717699517-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:10.899426 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-ee1465df-3f8e-47a5-a8b1-b9430e961c78 tempest-ServersAdminTestJSON-717699517 tempest-ServersAdminTestJSON-717699517-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/e3380b36-6aba-4736-bcbc-f0058f806d55" status: 200 len: 1614 microversion: 2.1 time: 0.365571 Oct 04 21:48:10.900010 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 715/1370] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:48:10 2022] GET /compute/v2.1/servers/e3380b36-6aba-4736-bcbc-f0058f806d55 => generated 1614 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:48:10.909782 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-f36bf810-3b63-478b-bc7e-3283560f2f43 tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7e992115ea4ba58205d3da003ec625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5345566eeb4a5f88d31f733eaa04bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:48:10.912522 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:INSERT=3,nova_cell1:SELECT=93,nova_cell1:UPDATE=4 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:48:10.924409 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-a332e2e7-4472-480a-ac81-5e2323837579 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:10.925024 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-a332e2e7-4472-480a-ac81-5e2323837579 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: be573c06-25e7-485e-9443-5bc21196a45e] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:48:10.933943 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a332e2e7-4472-480a-ac81-5e2323837579 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:10.934471 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a332e2e7-4472-480a-ac81-5e2323837579 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:10.934800 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-f36bf810-3b63-478b-bc7e-3283560f2f43 tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] 10.222.0.43 "GET /compute/v2.1/servers/197b66b3-69ef-4b80-9de7-b25ae132dc2e" status: 200 len: 1314 microversion: 2.1 time: 0.417954 Oct 04 21:48:10.935283 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a332e2e7-4472-480a-ac81-5e2323837579 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:10.935411 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 656/1371] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:48:10 2022] GET /compute/v2.1/servers/197b66b3-69ef-4b80-9de7-b25ae132dc2e => generated 1314 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:48:10.936262 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a332e2e7-4472-480a-ac81-5e2323837579 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:10.936898 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a332e2e7-4472-480a-ac81-5e2323837579 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:10.937482 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a332e2e7-4472-480a-ac81-5e2323837579 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:10.948592 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-d1ce7127-bc29-4abd-8f57-441cafbfb4c2 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:10.949353 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-d1ce7127-bc29-4abd-8f57-441cafbfb4c2 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] [instance: d2542961-c0a1-46da-9ae8-2f40faa0a294] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:48:10.970931 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d1ce7127-bc29-4abd-8f57-441cafbfb4c2 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:10.971379 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d1ce7127-bc29-4abd-8f57-441cafbfb4c2 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:10.971814 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d1ce7127-bc29-4abd-8f57-441cafbfb4c2 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:10.972525 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d1ce7127-bc29-4abd-8f57-441cafbfb4c2 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:10.972975 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d1ce7127-bc29-4abd-8f57-441cafbfb4c2 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:10.978156 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d1ce7127-bc29-4abd-8f57-441cafbfb4c2 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:11.033338 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-a332e2e7-4472-480a-ac81-5e2323837579 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:48:11.033541 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-d1ce7127-bc29-4abd-8f57-441cafbfb4c2 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] [instance: d2542961-c0a1-46da-9ae8-2f40faa0a294] Going to try to terminate instance {{(pid=134101) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:48:11.046725 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-a332e2e7-4472-480a-ac81-5e2323837579 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/be573c06-25e7-485e-9443-5bc21196a45e" status: 200 len: 1270 microversion: 2.1 time: 0.130908 Oct 04 21:48:11.047585 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 716/1372] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:48:10 2022] GET /compute/v2.1/servers/be573c06-25e7-485e-9443-5bc21196a45e => generated 1270 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:48:11.207040 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-d1ce7127-bc29-4abd-8f57-441cafbfb4c2 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] 10.222.0.43 "DELETE /compute/v2.1/servers/d2542961-c0a1-46da-9ae8-2f40faa0a294" status: 204 len: 0 microversion: 2.1 time: 0.270252 Oct 04 21:48:11.209836 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 657/1373] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 21:48:10 2022] DELETE /compute/v2.1/servers/d2542961-c0a1-46da-9ae8-2f40faa0a294 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:48:11.218919 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-dbdf9be1-0070-489e-a9cb-60ba3fea95e7 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:11.219889 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-dbdf9be1-0070-489e-a9cb-60ba3fea95e7 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] [instance: d2542961-c0a1-46da-9ae8-2f40faa0a294] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:48:11.228911 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dbdf9be1-0070-489e-a9cb-60ba3fea95e7 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:11.229609 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dbdf9be1-0070-489e-a9cb-60ba3fea95e7 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:11.230305 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dbdf9be1-0070-489e-a9cb-60ba3fea95e7 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:11.231476 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dbdf9be1-0070-489e-a9cb-60ba3fea95e7 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:11.232058 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dbdf9be1-0070-489e-a9cb-60ba3fea95e7 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:11.232835 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dbdf9be1-0070-489e-a9cb-60ba3fea95e7 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:11.424150 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-dbdf9be1-0070-489e-a9cb-60ba3fea95e7 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87616cd16995468ab7febf5aa4b284db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e3bf9149434d34b6762aaeef1478ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:48:11.436374 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-dbdf9be1-0070-489e-a9cb-60ba3fea95e7 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] 10.222.0.43 "GET /compute/v2.1/servers/d2542961-c0a1-46da-9ae8-2f40faa0a294" status: 200 len: 1468 microversion: 2.1 time: 0.221714 Oct 04 21:48:11.438093 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 717/1374] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:48:11 2022] GET /compute/v2.1/servers/d2542961-c0a1-46da-9ae8-2f40faa0a294 => generated 1468 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:48:11.540026 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-eedc2283-bf0d-470d-8548-bb31b8136882 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Calling method '.version_select at 0x7fbb2edf0550>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:11.590890 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-eedc2283-bf0d-470d-8548-bb31b8136882 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] 10.222.0.43 "GET /compute/v2.1/images/6b7f3390-fca2-4f36-a6ff-e815f6857c6a" status: 200 len: 1426 microversion: 2.1 time: 0.056053 Oct 04 21:48:11.591477 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 658/1375] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:48:11 2022] GET /compute/v2.1/images/6b7f3390-fca2-4f36-a6ff-e815f6857c6a => generated 1426 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:48:11.967444 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-cbc0b973-9f01-4d57-a0c3-76d7ab5e54bf tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:11.968365 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-cbc0b973-9f01-4d57-a0c3-76d7ab5e54bf tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] [instance: 197b66b3-69ef-4b80-9de7-b25ae132dc2e] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:48:11.972836 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:48:11.977385 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cbc0b973-9f01-4d57-a0c3-76d7ab5e54bf tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:11.977965 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cbc0b973-9f01-4d57-a0c3-76d7ab5e54bf tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:11.979383 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cbc0b973-9f01-4d57-a0c3-76d7ab5e54bf tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:11.980188 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cbc0b973-9f01-4d57-a0c3-76d7ab5e54bf tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:11.981025 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cbc0b973-9f01-4d57-a0c3-76d7ab5e54bf tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:11.981759 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cbc0b973-9f01-4d57-a0c3-76d7ab5e54bf tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:11.987671 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=100 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:48:12.075044 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-84820733-3a20-4b7d-bcaf-0b428c5c0b6e tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:12.075953 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-84820733-3a20-4b7d-bcaf-0b428c5c0b6e tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: be573c06-25e7-485e-9443-5bc21196a45e] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:48:12.084072 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-84820733-3a20-4b7d-bcaf-0b428c5c0b6e tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:12.084491 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-84820733-3a20-4b7d-bcaf-0b428c5c0b6e tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:12.084929 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-84820733-3a20-4b7d-bcaf-0b428c5c0b6e tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:12.085637 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-84820733-3a20-4b7d-bcaf-0b428c5c0b6e tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:12.086234 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-84820733-3a20-4b7d-bcaf-0b428c5c0b6e tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:12.086703 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-84820733-3a20-4b7d-bcaf-0b428c5c0b6e tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:12.147508 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-cbc0b973-9f01-4d57-a0c3-76d7ab5e54bf tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7e992115ea4ba58205d3da003ec625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5345566eeb4a5f88d31f733eaa04bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:48:12.156983 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-cbc0b973-9f01-4d57-a0c3-76d7ab5e54bf tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] 10.222.0.43 "GET /compute/v2.1/servers/197b66b3-69ef-4b80-9de7-b25ae132dc2e" status: 200 len: 1314 microversion: 2.1 time: 0.195133 Oct 04 21:48:12.157796 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 718/1376] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:48:11 2022] GET /compute/v2.1/servers/197b66b3-69ef-4b80-9de7-b25ae132dc2e => generated 1314 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:48:12.248127 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-84820733-3a20-4b7d-bcaf-0b428c5c0b6e tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:48:12.256224 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-84820733-3a20-4b7d-bcaf-0b428c5c0b6e tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/be573c06-25e7-485e-9443-5bc21196a45e" status: 200 len: 1312 microversion: 2.1 time: 0.186070 Oct 04 21:48:12.256860 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 659/1377] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:48:12 2022] GET /compute/v2.1/servers/be573c06-25e7-485e-9443-5bc21196a45e => generated 1312 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:48:12.463149 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-f0734c16-3032-426c-bd24-087686e18d6a tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:12.464111 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-f0734c16-3032-426c-bd24-087686e18d6a tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] [instance: d2542961-c0a1-46da-9ae8-2f40faa0a294] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:48:12.478612 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f0734c16-3032-426c-bd24-087686e18d6a tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:12.479050 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f0734c16-3032-426c-bd24-087686e18d6a tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:12.479612 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-1851e3a3-941c-473c-9769-581fe883846a req-146cfcf7-7184-48a8-9b8f-455a74821557 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be573c06-25e7-485e-9443-5bc21196a45e", "tag": "ab7d2e00-d523-4e06-a029-fdb5f5ae6c75"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:48:12.480492 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f0734c16-3032-426c-bd24-087686e18d6a tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:12.483303 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f0734c16-3032-426c-bd24-087686e18d6a tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:12.484086 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f0734c16-3032-426c-bd24-087686e18d6a tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:12.484754 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f0734c16-3032-426c-bd24-087686e18d6a tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:12.493828 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:48:12.507061 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-1851e3a3-941c-473c-9769-581fe883846a req-146cfcf7-7184-48a8-9b8f-455a74821557 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:12.508184 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-1851e3a3-941c-473c-9769-581fe883846a req-146cfcf7-7184-48a8-9b8f-455a74821557 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:12.509793 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-1851e3a3-941c-473c-9769-581fe883846a req-146cfcf7-7184-48a8-9b8f-455a74821557 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:12.527851 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-1851e3a3-941c-473c-9769-581fe883846a req-146cfcf7-7184-48a8-9b8f-455a74821557 service nova] Creating event network-changed:ab7d2e00-d523-4e06-a029-fdb5f5ae6c75 for instance be573c06-25e7-485e-9443-5bc21196a45e on n-h1-860284-1 Oct 04 21:48:12.534564 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-1851e3a3-941c-473c-9769-581fe883846a req-146cfcf7-7184-48a8-9b8f-455a74821557 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062838 Oct 04 21:48:12.537059 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 660/1378] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:48:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:48:12.609217 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-8c2e549c-acf1-421d-aa6e-818ff1890757 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Calling method '.version_select at 0x7fbb2edf0c10>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:12.646706 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-f0734c16-3032-426c-bd24-087686e18d6a tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87616cd16995468ab7febf5aa4b284db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e3bf9149434d34b6762aaeef1478ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:48:12.658501 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-f0734c16-3032-426c-bd24-087686e18d6a tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] 10.222.0.43 "GET /compute/v2.1/servers/d2542961-c0a1-46da-9ae8-2f40faa0a294" status: 200 len: 1468 microversion: 2.1 time: 0.200951 Oct 04 21:48:12.659717 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 719/1379] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:48:12 2022] GET /compute/v2.1/servers/d2542961-c0a1-46da-9ae8-2f40faa0a294 => generated 1468 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:48:12.673832 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-8c2e549c-acf1-421d-aa6e-818ff1890757 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] 10.222.0.43 "GET /compute/v2.1/images/6b7f3390-fca2-4f36-a6ff-e815f6857c6a" status: 200 len: 1435 microversion: 2.1 time: 0.070103 Oct 04 21:48:12.678786 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 661/1380] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:48:12 2022] GET /compute/v2.1/images/6b7f3390-fca2-4f36-a6ff-e815f6857c6a => generated 1435 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:48:12.691414 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-78976b15-ea52-4723-855f-49313873a376 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Calling method '.version_select at 0x7fbb2efef310>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:12.743723 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-78976b15-ea52-4723-855f-49313873a376 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] 10.222.0.43 "GET /compute/v2.1/images/6b7f3390-fca2-4f36-a6ff-e815f6857c6a" status: 200 len: 1435 microversion: 2.1 time: 0.056169 Oct 04 21:48:12.744487 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 720/1381] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:48:12 2022] GET /compute/v2.1/images/6b7f3390-fca2-4f36-a6ff-e815f6857c6a => generated 1435 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:48:12.759370 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-83ef05f2-37f3-4c19-9418-a0245b15d172 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:12.760199 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-83ef05f2-37f3-4c19-9418-a0245b15d172 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] [instance: 59a1880f-2802-4e72-9a17-b966cfec8fe9] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:48:12.767323 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-83ef05f2-37f3-4c19-9418-a0245b15d172 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:12.768116 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-83ef05f2-37f3-4c19-9418-a0245b15d172 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:12.768558 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-83ef05f2-37f3-4c19-9418-a0245b15d172 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:12.769269 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-83ef05f2-37f3-4c19-9418-a0245b15d172 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:12.769725 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-83ef05f2-37f3-4c19-9418-a0245b15d172 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:12.770148 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-83ef05f2-37f3-4c19-9418-a0245b15d172 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:12.925180 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-83ef05f2-37f3-4c19-9418-a0245b15d172 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7614aeaedd1947b88031fb55ca4783ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00081ff1d1aa41cbad345326b337093a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:48:12.934974 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-83ef05f2-37f3-4c19-9418-a0245b15d172 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] 10.222.0.43 "GET /compute/v2.1/servers/59a1880f-2802-4e72-9a17-b966cfec8fe9" status: 200 len: 1466 microversion: 2.1 time: 0.180297 Oct 04 21:48:12.935758 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 662/1382] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:48:12 2022] GET /compute/v2.1/servers/59a1880f-2802-4e72-9a17-b966cfec8fe9 => generated 1466 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:48:12.964818 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-0d5b5bb3-91d1-4f41-9fcd-bc685da17a1a tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Calling method '.version_select at 0x7fbb2f170af0>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:13.183341 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-b8bdc309-653e-479a-bf1a-2a1dcf9d7ece tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:13.183979 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-b8bdc309-653e-479a-bf1a-2a1dcf9d7ece tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] [instance: 197b66b3-69ef-4b80-9de7-b25ae132dc2e] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:48:13.197957 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b8bdc309-653e-479a-bf1a-2a1dcf9d7ece tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:13.199969 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b8bdc309-653e-479a-bf1a-2a1dcf9d7ece tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:13.201502 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b8bdc309-653e-479a-bf1a-2a1dcf9d7ece tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:13.202533 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b8bdc309-653e-479a-bf1a-2a1dcf9d7ece tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:13.205847 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b8bdc309-653e-479a-bf1a-2a1dcf9d7ece tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:13.206996 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b8bdc309-653e-479a-bf1a-2a1dcf9d7ece tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:13.581645 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-b8bdc309-653e-479a-bf1a-2a1dcf9d7ece tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7e992115ea4ba58205d3da003ec625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5345566eeb4a5f88d31f733eaa04bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:48:13.595976 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-b8bdc309-653e-479a-bf1a-2a1dcf9d7ece tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] 10.222.0.43 "GET /compute/v2.1/servers/197b66b3-69ef-4b80-9de7-b25ae132dc2e" status: 200 len: 1314 microversion: 2.1 time: 0.418985 Oct 04 21:48:13.606542 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 663/1383] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:48:13 2022] GET /compute/v2.1/servers/197b66b3-69ef-4b80-9de7-b25ae132dc2e => generated 1314 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:48:13.621283 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e5b679ce-b02e-4222-a17f-2de8814afaf8 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:13.626893 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-e5b679ce-b02e-4222-a17f-2de8814afaf8 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: be573c06-25e7-485e-9443-5bc21196a45e] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:48:13.639018 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e5b679ce-b02e-4222-a17f-2de8814afaf8 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:13.641049 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e5b679ce-b02e-4222-a17f-2de8814afaf8 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:13.643402 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e5b679ce-b02e-4222-a17f-2de8814afaf8 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:13.644276 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e5b679ce-b02e-4222-a17f-2de8814afaf8 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:13.646885 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e5b679ce-b02e-4222-a17f-2de8814afaf8 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:13.647672 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e5b679ce-b02e-4222-a17f-2de8814afaf8 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:13.768737 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-0d5b5bb3-91d1-4f41-9fcd-bc685da17a1a tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] 10.222.0.43 "DELETE /compute/v2.1/images/6b7f3390-fca2-4f36-a6ff-e815f6857c6a" status: 204 len: 0 microversion: 2.1 time: 0.808240 Oct 04 21:48:13.774974 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 721/1384] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:48:12 2022] DELETE /compute/v2.1/images/6b7f3390-fca2-4f36-a6ff-e815f6857c6a => generated 0 bytes in 813 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:48:13.779359 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-d6e888a5-1925-4b6b-b933-8a02183fbfc4 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:13.784329 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-d6e888a5-1925-4b6b-b933-8a02183fbfc4 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] [instance: d2542961-c0a1-46da-9ae8-2f40faa0a294] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:48:13.799417 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d6e888a5-1925-4b6b-b933-8a02183fbfc4 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:13.799975 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d6e888a5-1925-4b6b-b933-8a02183fbfc4 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:13.800583 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d6e888a5-1925-4b6b-b933-8a02183fbfc4 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:13.801413 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d6e888a5-1925-4b6b-b933-8a02183fbfc4 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:13.801622 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d6e888a5-1925-4b6b-b933-8a02183fbfc4 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:13.802065 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d6e888a5-1925-4b6b-b933-8a02183fbfc4 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:14.000334 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-e5b679ce-b02e-4222-a17f-2de8814afaf8 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:48:14.022242 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-e5b679ce-b02e-4222-a17f-2de8814afaf8 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/be573c06-25e7-485e-9443-5bc21196a45e" status: 200 len: 1312 microversion: 2.1 time: 0.413744 Oct 04 21:48:14.033631 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 664/1385] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:48:13 2022] GET /compute/v2.1/servers/be573c06-25e7-485e-9443-5bc21196a45e => generated 1312 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:48:14.050265 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-d64e97f5-de7c-49d7-8979-9eecfe3035f9 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Calling method '.version_select at 0x7fbb2edec9d0>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:14.070588 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-d6e888a5-1925-4b6b-b933-8a02183fbfc4 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87616cd16995468ab7febf5aa4b284db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e3bf9149434d34b6762aaeef1478ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:48:14.081390 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-d6e888a5-1925-4b6b-b933-8a02183fbfc4 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] 10.222.0.43 "GET /compute/v2.1/servers/d2542961-c0a1-46da-9ae8-2f40faa0a294" status: 200 len: 1468 microversion: 2.1 time: 0.305998 Oct 04 21:48:14.081718 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-d64e97f5-de7c-49d7-8979-9eecfe3035f9 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] HTTP exception thrown: Image not found. Oct 04 21:48:14.082926 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 722/1386] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:48:13 2022] GET /compute/v2.1/servers/d2542961-c0a1-46da-9ae8-2f40faa0a294 => generated 1468 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:48:14.088998 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-e448424c-b2a2-430d-9a9e-92fde890b929 req-29d710f5-5360-48e4-b194-eda93718547d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "197b66b3-69ef-4b80-9de7-b25ae132dc2e", "name": "network-vif-plugged", "status": "completed", "tag": "26a59657-af0b-440a-bb00-9593baadfa84"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:48:14.098325 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-d64e97f5-de7c-49d7-8979-9eecfe3035f9 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Request method failure captured: Oct 04 21:48:14.098325 n-d-860284-1 devstack@n-api.service[134101]: request: DELETE /compute/v2.1/images/ac8e9797-0b3b-4c06-9229-b4ac23c4312c HTTP/1.1 Oct 04 21:48:14.098325 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 21:48:14.098325 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 21:48:14.098325 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 21:48:14.098325 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 21:48:14.098325 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 21:48:14.098325 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 21:48:14.098325 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 21:48:14.098325 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 21:48:14.098325 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPKnHeaK9tmRrmAvrTzwz5PMuGvLZo6w0RzRBi-ESYQgfyjrrnkZ38Zu2JwOt5LIXhidJXXWMojxm08vFwalBKwJg1Rg9TZtolbT7DOzzXgrMEMgqLI1DqdGm1pJgN2X-4uD20_vhYRbxUjk-Ks6luVK8o8L8qWMFEceWeaOgYF3vYNA Oct 04 21:48:14.098325 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 21:48:14.098325 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 21:48:14.098325 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 21:48:14.098325 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 21:48:14.098325 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 21:48:14.098325 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 21:48:14.098325 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: 00081ff1d1aa41cbad345326b337093a Oct 04 21:48:14.098325 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-ImagesOneServerTestJSON-144510230 Oct 04 21:48:14.098325 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 21:48:14.098325 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 21:48:14.100328 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/00081ff1d1aa41cbad345326b337093a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_00081ff1d1aa41cbad345326b337093a", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/00081ff1d1aa41cbad345326b337093a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/00081ff1d1aa41cbad345326b337093a"}]}] Oct 04 21:48:14.100328 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-ImagesOneServerTestJSON-144510230 Oct 04 21:48:14.100328 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: 00081ff1d1aa41cbad345326b337093a Oct 04 21:48:14.100328 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-144510230 Oct 04 21:48:14.100328 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-ImagesOneServerTestJSON-144510230-project Oct 04 21:48:14.100328 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 21:48:14.100328 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 21:48:14.100328 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 7614aeaedd1947b88031fb55ca4783ae Oct 04 21:48:14.100328 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-ImagesOneServerTestJSON-144510230-project Oct 04 21:48:14.100328 n-d-860284-1 devstack@n-api.service[134101]: method: Oct 04 21:48:14.100328 n-d-860284-1 devstack@n-api.service[134101]: exception: Image not found. Oct 04 21:48:14.100328 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': 'ac8e9797-0b3b-4c06-9229-b4ac23c4312c'} Oct 04 21:48:14.100328 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:48:14.101145 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:48:14.101145 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 04 21:48:14.101145 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 04 21:48:14.101145 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 21:48:14.101145 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 21:48:14.101145 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 21:48:14.101145 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 21:48:14.101145 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 04 21:48:14.101145 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 04 21:48:14.101145 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 04 21:48:14.101145 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 04 21:48:14.101145 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 21:48:14.101145 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 21:48:14.101145 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 21:48:14.101145 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 21:48:14.101145 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image ac8e9797-0b3b-4c06-9229-b4ac23c4312c to delete Oct 04 21:48:14.101145 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:48:14.101145 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:48:14.101145 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:48:14.102329 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:48:14.102329 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 04 21:48:14.102329 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 04 21:48:14.102329 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 04 21:48:14.102329 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 04 21:48:14.102329 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 04 21:48:14.102329 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 04 21:48:14.102329 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image ac8e9797-0b3b-4c06-9229-b4ac23c4312c could not be found. Oct 04 21:48:14.102329 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:48:14.102329 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:48:14.102329 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:48:14.102329 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:48:14.102329 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:48:14.102329 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:48:14.102329 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:48:14.102329 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:48:14.102329 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:48:14.102329 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:48:14.102329 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:48:14.102329 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:48:14.107338 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 04 21:48:14.107338 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 21:48:14.107338 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 21:48:14.107338 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:48:14.107338 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:48:14.107338 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:48:14.107338 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:48:14.107338 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:48:14.107338 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:48:14.107338 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:48:14.107338 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:48:14.107338 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 21:48:14.107338 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:48:14.107338 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-d64e97f5-de7c-49d7-8979-9eecfe3035f9 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Returning 404 to user: Image not found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:48:14.107338 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-d64e97f5-de7c-49d7-8979-9eecfe3035f9 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] 10.222.0.43 "DELETE /compute/v2.1/images/ac8e9797-0b3b-4c06-9229-b4ac23c4312c" status: 404 len: 62 microversion: 2.1 time: 0.068907 Oct 04 21:48:14.111108 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 665/1387] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:48:14 2022] DELETE /compute/v2.1/images/ac8e9797-0b3b-4c06-9229-b4ac23c4312c => generated 62 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 21:48:14.117794 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-e448424c-b2a2-430d-9a9e-92fde890b929 req-29d710f5-5360-48e4-b194-eda93718547d service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:14.119323 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-e448424c-b2a2-430d-9a9e-92fde890b929 req-29d710f5-5360-48e4-b194-eda93718547d service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:14.120015 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-e448424c-b2a2-430d-9a9e-92fde890b929 req-29d710f5-5360-48e4-b194-eda93718547d service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:14.125874 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-a2843868-d817-4e07-8a79-d09198192fde tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:14.126269 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-a2843868-d817-4e07-8a79-d09198192fde tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] [instance: 59a1880f-2802-4e72-9a17-b966cfec8fe9] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:48:14.150532 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-e448424c-b2a2-430d-9a9e-92fde890b929 req-29d710f5-5360-48e4-b194-eda93718547d service nova] Creating event network-vif-plugged:26a59657-af0b-440a-bb00-9593baadfa84 for instance 197b66b3-69ef-4b80-9de7-b25ae132dc2e on n-h1-860284-1 Oct 04 21:48:14.150805 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a2843868-d817-4e07-8a79-d09198192fde tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:14.151231 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a2843868-d817-4e07-8a79-d09198192fde tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:14.151674 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a2843868-d817-4e07-8a79-d09198192fde tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:14.152402 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a2843868-d817-4e07-8a79-d09198192fde tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:14.153731 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a2843868-d817-4e07-8a79-d09198192fde tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:14.154175 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a2843868-d817-4e07-8a79-d09198192fde tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:14.158334 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-e448424c-b2a2-430d-9a9e-92fde890b929 req-29d710f5-5360-48e4-b194-eda93718547d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073306 Oct 04 21:48:14.159618 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 723/1388] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:48:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:48:14.199318 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-a2843868-d817-4e07-8a79-d09198192fde tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] [instance: 59a1880f-2802-4e72-9a17-b966cfec8fe9] Going to try to terminate instance {{(pid=134101) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:48:14.289888 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-a2843868-d817-4e07-8a79-d09198192fde tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] 10.222.0.43 "DELETE /compute/v2.1/servers/59a1880f-2802-4e72-9a17-b966cfec8fe9" status: 204 len: 0 microversion: 2.1 time: 0.179299 Oct 04 21:48:14.290659 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 666/1389] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 21:48:14 2022] DELETE /compute/v2.1/servers/59a1880f-2802-4e72-9a17-b966cfec8fe9 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 21:48:14.299458 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-548a30b9-7693-4e72-880d-fbfde1031ce2 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:14.300627 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-548a30b9-7693-4e72-880d-fbfde1031ce2 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] [instance: 59a1880f-2802-4e72-9a17-b966cfec8fe9] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:48:14.308296 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-548a30b9-7693-4e72-880d-fbfde1031ce2 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:14.308784 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-548a30b9-7693-4e72-880d-fbfde1031ce2 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:14.309220 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-548a30b9-7693-4e72-880d-fbfde1031ce2 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:14.309923 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-548a30b9-7693-4e72-880d-fbfde1031ce2 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:14.310401 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-548a30b9-7693-4e72-880d-fbfde1031ce2 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:14.310835 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-548a30b9-7693-4e72-880d-fbfde1031ce2 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:14.462253 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-548a30b9-7693-4e72-880d-fbfde1031ce2 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7614aeaedd1947b88031fb55ca4783ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00081ff1d1aa41cbad345326b337093a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:48:14.471135 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-548a30b9-7693-4e72-880d-fbfde1031ce2 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] 10.222.0.43 "GET /compute/v2.1/servers/59a1880f-2802-4e72-9a17-b966cfec8fe9" status: 200 len: 1472 microversion: 2.1 time: 0.176113 Oct 04 21:48:14.471709 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 724/1390] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:48:14 2022] GET /compute/v2.1/servers/59a1880f-2802-4e72-9a17-b966cfec8fe9 => generated 1472 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:48:14.561731 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-f07c19ec-e456-4ea1-ad51-cbd945672d1c req-c366476a-3838-46b6-9967-2ecdcde0ba31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2542961-c0a1-46da-9ae8-2f40faa0a294", "name": "network-vif-deleted", "tag": "6e14d23d-e9fb-4b7d-84b3-d5394b74d104"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:48:14.572165 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-f07c19ec-e456-4ea1-ad51-cbd945672d1c req-c366476a-3838-46b6-9967-2ecdcde0ba31 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:14.572641 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-f07c19ec-e456-4ea1-ad51-cbd945672d1c req-c366476a-3838-46b6-9967-2ecdcde0ba31 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:14.573254 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-f07c19ec-e456-4ea1-ad51-cbd945672d1c req-c366476a-3838-46b6-9967-2ecdcde0ba31 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:14.585066 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-f07c19ec-e456-4ea1-ad51-cbd945672d1c req-c366476a-3838-46b6-9967-2ecdcde0ba31 service nova] Creating event network-vif-deleted:6e14d23d-e9fb-4b7d-84b3-d5394b74d104 for instance d2542961-c0a1-46da-9ae8-2f40faa0a294 on n-h2-860284-1 Oct 04 21:48:14.589873 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-f07c19ec-e456-4ea1-ad51-cbd945672d1c req-c366476a-3838-46b6-9967-2ecdcde0ba31 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032511 Oct 04 21:48:14.590490 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 667/1391] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:48:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:48:14.623448 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-27cbad0a-08b7-4cd7-a61e-f60d5405dc98 tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:14.624001 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-27cbad0a-08b7-4cd7-a61e-f60d5405dc98 tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] [instance: 197b66b3-69ef-4b80-9de7-b25ae132dc2e] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:48:14.631141 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-27cbad0a-08b7-4cd7-a61e-f60d5405dc98 tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:14.631570 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-27cbad0a-08b7-4cd7-a61e-f60d5405dc98 tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:14.632009 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-27cbad0a-08b7-4cd7-a61e-f60d5405dc98 tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:14.632709 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-27cbad0a-08b7-4cd7-a61e-f60d5405dc98 tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:14.633166 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-27cbad0a-08b7-4cd7-a61e-f60d5405dc98 tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:14.633588 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-27cbad0a-08b7-4cd7-a61e-f60d5405dc98 tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:14.767115 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-27cbad0a-08b7-4cd7-a61e-f60d5405dc98 tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7e992115ea4ba58205d3da003ec625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5345566eeb4a5f88d31f733eaa04bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:48:14.774935 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-27cbad0a-08b7-4cd7-a61e-f60d5405dc98 tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] 10.222.0.43 "GET /compute/v2.1/servers/197b66b3-69ef-4b80-9de7-b25ae132dc2e" status: 200 len: 1314 microversion: 2.1 time: 0.155439 Oct 04 21:48:14.775570 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 725/1392] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:48:14 2022] GET /compute/v2.1/servers/197b66b3-69ef-4b80-9de7-b25ae132dc2e => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:48:15.057483 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-3a2c609d-d2e8-40fd-978a-e2394ab55e07 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:15.058179 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-3a2c609d-d2e8-40fd-978a-e2394ab55e07 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: be573c06-25e7-485e-9443-5bc21196a45e] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:48:15.064359 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3a2c609d-d2e8-40fd-978a-e2394ab55e07 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:15.064837 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3a2c609d-d2e8-40fd-978a-e2394ab55e07 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:15.065270 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3a2c609d-d2e8-40fd-978a-e2394ab55e07 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:15.065949 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3a2c609d-d2e8-40fd-978a-e2394ab55e07 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:15.066436 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3a2c609d-d2e8-40fd-978a-e2394ab55e07 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:15.066858 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3a2c609d-d2e8-40fd-978a-e2394ab55e07 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:15.109154 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-a4eb0a25-0597-4a7c-ae08-6290dfcf7ef2 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:15.109867 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-a4eb0a25-0597-4a7c-ae08-6290dfcf7ef2 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] [instance: d2542961-c0a1-46da-9ae8-2f40faa0a294] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:48:15.117386 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a4eb0a25-0597-4a7c-ae08-6290dfcf7ef2 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:15.117965 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a4eb0a25-0597-4a7c-ae08-6290dfcf7ef2 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:15.118509 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a4eb0a25-0597-4a7c-ae08-6290dfcf7ef2 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:15.119292 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a4eb0a25-0597-4a7c-ae08-6290dfcf7ef2 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:15.119852 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a4eb0a25-0597-4a7c-ae08-6290dfcf7ef2 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:15.120339 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a4eb0a25-0597-4a7c-ae08-6290dfcf7ef2 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:15.154030 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a4eb0a25-0597-4a7c-ae08-6290dfcf7ef2 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:15.154557 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a4eb0a25-0597-4a7c-ae08-6290dfcf7ef2 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:15.155060 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a4eb0a25-0597-4a7c-ae08-6290dfcf7ef2 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:15.155534 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.objects.instance [None req-a4eb0a25-0597-4a7c-ae08-6290dfcf7ef2 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lazy-loading 'fault' on Instance uuid d2542961-c0a1-46da-9ae8-2f40faa0a294 {{(pid=134102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:48:15.203840 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-a4eb0a25-0597-4a7c-ae08-6290dfcf7ef2 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87616cd16995468ab7febf5aa4b284db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e3bf9149434d34b6762aaeef1478ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:48:15.212790 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-a4eb0a25-0597-4a7c-ae08-6290dfcf7ef2 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] 10.222.0.43 "GET /compute/v2.1/servers/d2542961-c0a1-46da-9ae8-2f40faa0a294" status: 200 len: 1303 microversion: 2.1 time: 0.107464 Oct 04 21:48:15.213726 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 726/1393] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:48:15 2022] GET /compute/v2.1/servers/d2542961-c0a1-46da-9ae8-2f40faa0a294 => generated 1303 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:48:15.232896 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-3a2c609d-d2e8-40fd-978a-e2394ab55e07 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:48:15.241908 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-3a2c609d-d2e8-40fd-978a-e2394ab55e07 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/be573c06-25e7-485e-9443-5bc21196a45e" status: 200 len: 1312 microversion: 2.1 time: 0.190019 Oct 04 21:48:15.242528 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 668/1394] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:48:15 2022] GET /compute/v2.1/servers/be573c06-25e7-485e-9443-5bc21196a45e => generated 1312 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:48:15.494582 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-f9024405-c210-4479-b387-1e7d8d43240f tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:15.495204 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-f9024405-c210-4479-b387-1e7d8d43240f tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] [instance: 59a1880f-2802-4e72-9a17-b966cfec8fe9] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:48:15.501254 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f9024405-c210-4479-b387-1e7d8d43240f tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:15.501741 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f9024405-c210-4479-b387-1e7d8d43240f tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:15.502177 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f9024405-c210-4479-b387-1e7d8d43240f tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:15.502907 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f9024405-c210-4479-b387-1e7d8d43240f tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:15.503369 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f9024405-c210-4479-b387-1e7d8d43240f tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:15.503788 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f9024405-c210-4479-b387-1e7d8d43240f tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:15.640167 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-f9024405-c210-4479-b387-1e7d8d43240f tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7614aeaedd1947b88031fb55ca4783ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00081ff1d1aa41cbad345326b337093a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:48:15.647974 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-f9024405-c210-4479-b387-1e7d8d43240f tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] 10.222.0.43 "GET /compute/v2.1/servers/59a1880f-2802-4e72-9a17-b966cfec8fe9" status: 200 len: 1472 microversion: 2.1 time: 0.157616 Oct 04 21:48:15.648551 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 727/1395] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:48:15 2022] GET /compute/v2.1/servers/59a1880f-2802-4e72-9a17-b966cfec8fe9 => generated 1472 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:48:15.797126 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-ef5608e5-07df-41ea-a318-04bca6ea9ba0 tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:15.797746 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-ef5608e5-07df-41ea-a318-04bca6ea9ba0 tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] [instance: 197b66b3-69ef-4b80-9de7-b25ae132dc2e] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:48:15.804755 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ef5608e5-07df-41ea-a318-04bca6ea9ba0 tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:15.805253 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ef5608e5-07df-41ea-a318-04bca6ea9ba0 tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:15.805700 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ef5608e5-07df-41ea-a318-04bca6ea9ba0 tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:15.806436 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ef5608e5-07df-41ea-a318-04bca6ea9ba0 tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:15.806903 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ef5608e5-07df-41ea-a318-04bca6ea9ba0 tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:15.807340 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ef5608e5-07df-41ea-a318-04bca6ea9ba0 tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:15.936962 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-ef5608e5-07df-41ea-a318-04bca6ea9ba0 tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7e992115ea4ba58205d3da003ec625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5345566eeb4a5f88d31f733eaa04bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:48:15.945554 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-ef5608e5-07df-41ea-a318-04bca6ea9ba0 tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] 10.222.0.43 "GET /compute/v2.1/servers/197b66b3-69ef-4b80-9de7-b25ae132dc2e" status: 200 len: 1314 microversion: 2.1 time: 0.152331 Oct 04 21:48:15.946123 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 669/1396] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:48:15 2022] GET /compute/v2.1/servers/197b66b3-69ef-4b80-9de7-b25ae132dc2e => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:48:16.236979 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-7fcdcff2-8de8-4af6-81a8-fba89d6daae4 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:16.237597 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-7fcdcff2-8de8-4af6-81a8-fba89d6daae4 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] [instance: d2542961-c0a1-46da-9ae8-2f40faa0a294] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:48:16.244748 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7fcdcff2-8de8-4af6-81a8-fba89d6daae4 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:16.245231 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7fcdcff2-8de8-4af6-81a8-fba89d6daae4 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:16.245676 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7fcdcff2-8de8-4af6-81a8-fba89d6daae4 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:16.246392 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7fcdcff2-8de8-4af6-81a8-fba89d6daae4 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:16.246868 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7fcdcff2-8de8-4af6-81a8-fba89d6daae4 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:16.247298 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7fcdcff2-8de8-4af6-81a8-fba89d6daae4 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:16.262070 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-7fcdcff2-8de8-4af6-81a8-fba89d6daae4 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] HTTP exception thrown: Instance d2542961-c0a1-46da-9ae8-2f40faa0a294 could not be found. Oct 04 21:48:16.263816 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-7fcdcff2-8de8-4af6-81a8-fba89d6daae4 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Request method failure captured: Oct 04 21:48:16.263816 n-d-860284-1 devstack@n-api.service[134102]: request: GET /compute/v2.1/servers/d2542961-c0a1-46da-9ae8-2f40faa0a294 HTTP/1.1 Oct 04 21:48:16.263816 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 21:48:16.263816 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 21:48:16.263816 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 21:48:16.263816 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 21:48:16.263816 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 21:48:16.263816 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 21:48:16.263816 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 21:48:16.263816 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 21:48:16.263816 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPKmIg2p4Jaxd9N6jvYm_ZlmIMNjr8orAnEv7D8rk6jEPCLTvf0ENcigrAMkoCJ8-5tEY0vHmABCtEiCAdU087VK1bxPHI47P91pdF73KZc8Mzo7LOt4YWB2vFleaIkUVBrnDLuNXAmn_EiwaVwPZivvplgN0f1eDFUFr9oDqS014MUs Oct 04 21:48:16.263816 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 21:48:16.263816 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 21:48:16.263816 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 21:48:16.263816 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 21:48:16.263816 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 21:48:16.263816 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 21:48:16.263816 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: a1e3bf9149434d34b6762aaeef1478ed Oct 04 21:48:16.263816 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-ServersAdminTestJSON-106350315 Oct 04 21:48:16.263816 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 21:48:16.263816 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 21:48:16.265457 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a1e3bf9149434d34b6762aaeef1478ed"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_a1e3bf9149434d34b6762aaeef1478ed", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a1e3bf9149434d34b6762aaeef1478ed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/a1e3bf9149434d34b6762aaeef1478ed"}]}] Oct 04 21:48:16.265457 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-ServersAdminTestJSON-106350315 Oct 04 21:48:16.265457 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: a1e3bf9149434d34b6762aaeef1478ed Oct 04 21:48:16.265457 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-ServersAdminTestJSON-106350315 Oct 04 21:48:16.265457 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-ServersAdminTestJSON-106350315-project Oct 04 21:48:16.265457 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 21:48:16.265457 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 21:48:16.265457 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: 87616cd16995468ab7febf5aa4b284db Oct 04 21:48:16.265457 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-ServersAdminTestJSON-106350315-project Oct 04 21:48:16.265457 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 21:48:16.265457 n-d-860284-1 devstack@n-api.service[134102]: exception: Instance d2542961-c0a1-46da-9ae8-2f40faa0a294 could not be found. Oct 04 21:48:16.265457 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': 'd2542961-c0a1-46da-9ae8-2f40faa0a294'} Oct 04 21:48:16.266426 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:48:16.266426 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:48:16.266426 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:48:16.266426 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:48:16.266426 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:48:16.266426 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:48:16.266426 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:48:16.266426 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:48:16.266426 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:48:16.266426 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:48:16.266426 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2542961-c0a1-46da-9ae8-2f40faa0a294 could not be found. Oct 04 21:48:16.266426 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:48:16.266426 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:48:16.266426 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:48:16.266426 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:48:16.266426 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:48:16.266426 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:48:16.266426 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:48:16.266426 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:48:16.266426 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:48:16.267957 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:48:16.267957 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:48:16.267957 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:48:16.267957 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:48:16.267957 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:48:16.267957 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:48:16.267957 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:48:16.267957 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2542961-c0a1-46da-9ae8-2f40faa0a294 could not be found. Oct 04 21:48:16.267957 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:48:16.267957 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:48:16.267957 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:48:16.267957 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:48:16.267957 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:48:16.267957 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:48:16.267957 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:48:16.267957 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:48:16.267957 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2542961-c0a1-46da-9ae8-2f40faa0a294 could not be found. Oct 04 21:48:16.267957 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:48:16.269339 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-7fcdcff2-8de8-4af6-81a8-fba89d6daae4 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Returning 404 to user: Instance d2542961-c0a1-46da-9ae8-2f40faa0a294 could not be found. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:48:16.269429 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-6ba85477-cda1-42a6-9d29-d917063c40af tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:16.269863 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-7fcdcff2-8de8-4af6-81a8-fba89d6daae4 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] 10.222.0.43 "GET /compute/v2.1/servers/d2542961-c0a1-46da-9ae8-2f40faa0a294" status: 404 len: 111 microversion: 2.1 time: 0.032330 Oct 04 21:48:16.269959 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-6ba85477-cda1-42a6-9d29-d917063c40af tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: be573c06-25e7-485e-9443-5bc21196a45e] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:48:16.270054 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 728/1397] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:48:16 2022] GET /compute/v2.1/servers/d2542961-c0a1-46da-9ae8-2f40faa0a294 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:48:16.273284 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6ba85477-cda1-42a6-9d29-d917063c40af tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:16.273766 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6ba85477-cda1-42a6-9d29-d917063c40af tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:16.273893 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-a5fdc8c5-c1ad-4cd8-82b3-03e41e96d2b6 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:16.274207 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6ba85477-cda1-42a6-9d29-d917063c40af tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:16.274342 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-a5fdc8c5-c1ad-4cd8-82b3-03e41e96d2b6 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] [instance: 58b5b55c-fd7d-4a43-96af-01ae27cb29de] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:48:16.274935 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6ba85477-cda1-42a6-9d29-d917063c40af tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:16.275383 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6ba85477-cda1-42a6-9d29-d917063c40af tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:16.275805 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6ba85477-cda1-42a6-9d29-d917063c40af tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:16.280395 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a5fdc8c5-c1ad-4cd8-82b3-03e41e96d2b6 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:16.280884 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a5fdc8c5-c1ad-4cd8-82b3-03e41e96d2b6 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:16.281333 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a5fdc8c5-c1ad-4cd8-82b3-03e41e96d2b6 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:16.282037 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a5fdc8c5-c1ad-4cd8-82b3-03e41e96d2b6 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:16.282555 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a5fdc8c5-c1ad-4cd8-82b3-03e41e96d2b6 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:16.282993 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a5fdc8c5-c1ad-4cd8-82b3-03e41e96d2b6 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:16.309278 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-a5fdc8c5-c1ad-4cd8-82b3-03e41e96d2b6 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] [instance: 58b5b55c-fd7d-4a43-96af-01ae27cb29de] Going to try to terminate instance {{(pid=134102) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:48:16.391603 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-a5fdc8c5-c1ad-4cd8-82b3-03e41e96d2b6 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] 10.222.0.43 "DELETE /compute/v2.1/servers/58b5b55c-fd7d-4a43-96af-01ae27cb29de" status: 204 len: 0 microversion: 2.1 time: 0.121155 Oct 04 21:48:16.392476 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 729/1398] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 21:48:16 2022] DELETE /compute/v2.1/servers/58b5b55c-fd7d-4a43-96af-01ae27cb29de => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:48:16.401013 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-05c6ceec-32b6-447a-91ab-92355b08248a tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:16.401716 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-05c6ceec-32b6-447a-91ab-92355b08248a tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] [instance: 58b5b55c-fd7d-4a43-96af-01ae27cb29de] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:48:16.407761 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-05c6ceec-32b6-447a-91ab-92355b08248a tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:16.408244 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-05c6ceec-32b6-447a-91ab-92355b08248a tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:16.408676 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-05c6ceec-32b6-447a-91ab-92355b08248a tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:16.409374 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-05c6ceec-32b6-447a-91ab-92355b08248a tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:16.409828 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-05c6ceec-32b6-447a-91ab-92355b08248a tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:16.410245 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-05c6ceec-32b6-447a-91ab-92355b08248a tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:16.420161 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-6ba85477-cda1-42a6-9d29-d917063c40af tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:48:16.429640 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-6ba85477-cda1-42a6-9d29-d917063c40af tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/be573c06-25e7-485e-9443-5bc21196a45e" status: 200 len: 1312 microversion: 2.1 time: 0.168237 Oct 04 21:48:16.430413 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 670/1399] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:48:16 2022] GET /compute/v2.1/servers/be573c06-25e7-485e-9443-5bc21196a45e => generated 1312 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:48:16.542994 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-05c6ceec-32b6-447a-91ab-92355b08248a tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87616cd16995468ab7febf5aa4b284db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e3bf9149434d34b6762aaeef1478ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:48:16.550738 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-05c6ceec-32b6-447a-91ab-92355b08248a tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] 10.222.0.43 "GET /compute/v2.1/servers/58b5b55c-fd7d-4a43-96af-01ae27cb29de" status: 200 len: 1469 microversion: 2.1 time: 0.154078 Oct 04 21:48:16.551313 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 730/1400] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:48:16 2022] GET /compute/v2.1/servers/58b5b55c-fd7d-4a43-96af-01ae27cb29de => generated 1469 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:48:16.671084 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-a2a4d284-efda-4324-ad21-0e275d2b6e2b tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:16.671706 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-a2a4d284-efda-4324-ad21-0e275d2b6e2b tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] [instance: 59a1880f-2802-4e72-9a17-b966cfec8fe9] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:48:16.678998 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a2a4d284-efda-4324-ad21-0e275d2b6e2b tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:16.679496 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a2a4d284-efda-4324-ad21-0e275d2b6e2b tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:16.679937 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a2a4d284-efda-4324-ad21-0e275d2b6e2b tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:16.680657 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a2a4d284-efda-4324-ad21-0e275d2b6e2b tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:16.681113 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a2a4d284-efda-4324-ad21-0e275d2b6e2b tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:16.681541 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a2a4d284-efda-4324-ad21-0e275d2b6e2b tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:16.821174 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-a2a4d284-efda-4324-ad21-0e275d2b6e2b tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7614aeaedd1947b88031fb55ca4783ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00081ff1d1aa41cbad345326b337093a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:48:16.829191 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-a2a4d284-efda-4324-ad21-0e275d2b6e2b tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] 10.222.0.43 "GET /compute/v2.1/servers/59a1880f-2802-4e72-9a17-b966cfec8fe9" status: 200 len: 1472 microversion: 2.1 time: 0.161988 Oct 04 21:48:16.829764 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 671/1401] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:48:16 2022] GET /compute/v2.1/servers/59a1880f-2802-4e72-9a17-b966cfec8fe9 => generated 1472 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:48:16.970476 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-fe4fe793-2860-40b4-8b1b-656991c1db25 tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:16.971103 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-fe4fe793-2860-40b4-8b1b-656991c1db25 tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] [instance: 197b66b3-69ef-4b80-9de7-b25ae132dc2e] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:48:16.977245 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fe4fe793-2860-40b4-8b1b-656991c1db25 tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:16.977740 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fe4fe793-2860-40b4-8b1b-656991c1db25 tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:16.978182 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fe4fe793-2860-40b4-8b1b-656991c1db25 tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:16.978954 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fe4fe793-2860-40b4-8b1b-656991c1db25 tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:16.979416 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fe4fe793-2860-40b4-8b1b-656991c1db25 tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:16.979847 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fe4fe793-2860-40b4-8b1b-656991c1db25 tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:17.111699 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-fe4fe793-2860-40b4-8b1b-656991c1db25 tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7e992115ea4ba58205d3da003ec625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5345566eeb4a5f88d31f733eaa04bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:48:17.120907 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-fe4fe793-2860-40b4-8b1b-656991c1db25 tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] 10.222.0.43 "GET /compute/v2.1/servers/197b66b3-69ef-4b80-9de7-b25ae132dc2e" status: 200 len: 1314 microversion: 2.1 time: 0.154503 Oct 04 21:48:17.121498 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 731/1402] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:48:16 2022] GET /compute/v2.1/servers/197b66b3-69ef-4b80-9de7-b25ae132dc2e => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:48:17.453116 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-05c6d915-e528-472f-9d88-e66422d432a3 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:17.453703 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-05c6d915-e528-472f-9d88-e66422d432a3 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: be573c06-25e7-485e-9443-5bc21196a45e] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:48:17.461293 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-05c6d915-e528-472f-9d88-e66422d432a3 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:17.461774 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-05c6d915-e528-472f-9d88-e66422d432a3 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:17.462246 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-05c6d915-e528-472f-9d88-e66422d432a3 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:17.463225 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-05c6d915-e528-472f-9d88-e66422d432a3 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:17.463680 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-05c6d915-e528-472f-9d88-e66422d432a3 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:17.464109 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-05c6d915-e528-472f-9d88-e66422d432a3 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:17.497406 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-33d6a4aa-c4b4-44e8-9f17-cfd57be8a404 req-90c543b9-53f2-4c90-afdc-c75562a35843 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59a1880f-2802-4e72-9a17-b966cfec8fe9", "name": "network-vif-unplugged", "status": "completed", "tag": "893f32f5-2183-4d13-8c2e-2095ab07e2af"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:48:17.509083 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-33d6a4aa-c4b4-44e8-9f17-cfd57be8a404 req-90c543b9-53f2-4c90-afdc-c75562a35843 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:17.511732 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-33d6a4aa-c4b4-44e8-9f17-cfd57be8a404 req-90c543b9-53f2-4c90-afdc-c75562a35843 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:17.511732 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-33d6a4aa-c4b4-44e8-9f17-cfd57be8a404 req-90c543b9-53f2-4c90-afdc-c75562a35843 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:17.524923 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-33d6a4aa-c4b4-44e8-9f17-cfd57be8a404 req-90c543b9-53f2-4c90-afdc-c75562a35843 service nova] Creating event network-vif-unplugged:893f32f5-2183-4d13-8c2e-2095ab07e2af for instance 59a1880f-2802-4e72-9a17-b966cfec8fe9 on n-h1-860284-1 Oct 04 21:48:17.530000 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-33d6a4aa-c4b4-44e8-9f17-cfd57be8a404 req-90c543b9-53f2-4c90-afdc-c75562a35843 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036917 Oct 04 21:48:17.530900 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 732/1403] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:48:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:48:17.575451 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-cbb8edac-d6de-493d-b772-370652a8be15 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:17.576229 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-cbb8edac-d6de-493d-b772-370652a8be15 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] [instance: 58b5b55c-fd7d-4a43-96af-01ae27cb29de] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:48:17.582791 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cbb8edac-d6de-493d-b772-370652a8be15 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:17.583961 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cbb8edac-d6de-493d-b772-370652a8be15 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:17.584463 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cbb8edac-d6de-493d-b772-370652a8be15 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:17.585269 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cbb8edac-d6de-493d-b772-370652a8be15 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:17.585951 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cbb8edac-d6de-493d-b772-370652a8be15 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:17.586490 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cbb8edac-d6de-493d-b772-370652a8be15 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:17.605657 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-05c6d915-e528-472f-9d88-e66422d432a3 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:48:17.614010 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-05c6d915-e528-472f-9d88-e66422d432a3 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/be573c06-25e7-485e-9443-5bc21196a45e" status: 200 len: 1312 microversion: 2.1 time: 0.164747 Oct 04 21:48:17.614727 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 672/1404] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:48:17 2022] GET /compute/v2.1/servers/be573c06-25e7-485e-9443-5bc21196a45e => generated 1312 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:48:17.728695 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-cbb8edac-d6de-493d-b772-370652a8be15 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87616cd16995468ab7febf5aa4b284db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e3bf9149434d34b6762aaeef1478ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:48:17.736713 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-cbb8edac-d6de-493d-b772-370652a8be15 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] 10.222.0.43 "GET /compute/v2.1/servers/58b5b55c-fd7d-4a43-96af-01ae27cb29de" status: 200 len: 1469 microversion: 2.1 time: 0.165968 Oct 04 21:48:17.737822 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 733/1405] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:48:17 2022] GET /compute/v2.1/servers/58b5b55c-fd7d-4a43-96af-01ae27cb29de => generated 1469 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:48:17.852369 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-ead8f5a8-d04c-450b-b2ae-f5a64323c76c tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:17.852995 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-ead8f5a8-d04c-450b-b2ae-f5a64323c76c tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] [instance: 59a1880f-2802-4e72-9a17-b966cfec8fe9] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:48:17.859472 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ead8f5a8-d04c-450b-b2ae-f5a64323c76c tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:17.860185 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ead8f5a8-d04c-450b-b2ae-f5a64323c76c tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:17.860372 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ead8f5a8-d04c-450b-b2ae-f5a64323c76c tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:17.861063 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ead8f5a8-d04c-450b-b2ae-f5a64323c76c tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:17.861503 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ead8f5a8-d04c-450b-b2ae-f5a64323c76c tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:17.861985 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ead8f5a8-d04c-450b-b2ae-f5a64323c76c tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:17.997044 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-ead8f5a8-d04c-450b-b2ae-f5a64323c76c tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7614aeaedd1947b88031fb55ca4783ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00081ff1d1aa41cbad345326b337093a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:48:18.005382 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-ead8f5a8-d04c-450b-b2ae-f5a64323c76c tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] 10.222.0.43 "GET /compute/v2.1/servers/59a1880f-2802-4e72-9a17-b966cfec8fe9" status: 200 len: 1472 microversion: 2.1 time: 0.156255 Oct 04 21:48:18.005994 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 673/1406] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:48:17 2022] GET /compute/v2.1/servers/59a1880f-2802-4e72-9a17-b966cfec8fe9 => generated 1472 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:48:18.153725 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-a1523507-cabd-4ce5-9e11-d003d07f3d11 tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:18.153725 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-a1523507-cabd-4ce5-9e11-d003d07f3d11 tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] [instance: 197b66b3-69ef-4b80-9de7-b25ae132dc2e] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:48:18.155197 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a1523507-cabd-4ce5-9e11-d003d07f3d11 tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:18.155686 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a1523507-cabd-4ce5-9e11-d003d07f3d11 tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:18.156119 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a1523507-cabd-4ce5-9e11-d003d07f3d11 tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:18.156821 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a1523507-cabd-4ce5-9e11-d003d07f3d11 tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:18.157273 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a1523507-cabd-4ce5-9e11-d003d07f3d11 tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:18.157693 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a1523507-cabd-4ce5-9e11-d003d07f3d11 tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:18.346643 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-a1523507-cabd-4ce5-9e11-d003d07f3d11 tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7e992115ea4ba58205d3da003ec625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5345566eeb4a5f88d31f733eaa04bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:48:18.355056 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-a1523507-cabd-4ce5-9e11-d003d07f3d11 tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] 10.222.0.43 "GET /compute/v2.1/servers/197b66b3-69ef-4b80-9de7-b25ae132dc2e" status: 200 len: 1314 microversion: 2.1 time: 0.213557 Oct 04 21:48:18.355645 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 734/1407] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:48:18 2022] GET /compute/v2.1/servers/197b66b3-69ef-4b80-9de7-b25ae132dc2e => generated 1314 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:48:18.462274 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e522b94c-9e41-4b6a-bcf5-815ef060bc46 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:18.462930 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-e522b94c-9e41-4b6a-bcf5-815ef060bc46 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] [instance: 34276621-d087-478b-81c7-bdf5e38efc69] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:48:18.464785 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=2 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:48:18.471082 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e522b94c-9e41-4b6a-bcf5-815ef060bc46 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:18.471575 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e522b94c-9e41-4b6a-bcf5-815ef060bc46 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:18.472012 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e522b94c-9e41-4b6a-bcf5-815ef060bc46 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:18.472718 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e522b94c-9e41-4b6a-bcf5-815ef060bc46 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:18.473176 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e522b94c-9e41-4b6a-bcf5-815ef060bc46 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:18.474234 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e522b94c-9e41-4b6a-bcf5-815ef060bc46 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:18.585593 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-19974964-40d3-4d79-80cf-7b6370b23cb0 req-e00522b5-e7ca-4106-b631-2127846c3713 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58b5b55c-fd7d-4a43-96af-01ae27cb29de", "name": "network-vif-deleted", "tag": "38c2c5e6-fad8-4765-8442-be827ff69b3f"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:48:18.598035 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-19974964-40d3-4d79-80cf-7b6370b23cb0 req-e00522b5-e7ca-4106-b631-2127846c3713 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:18.599536 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-19974964-40d3-4d79-80cf-7b6370b23cb0 req-e00522b5-e7ca-4106-b631-2127846c3713 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:18.600150 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-19974964-40d3-4d79-80cf-7b6370b23cb0 req-e00522b5-e7ca-4106-b631-2127846c3713 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:18.626835 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-19974964-40d3-4d79-80cf-7b6370b23cb0 req-e00522b5-e7ca-4106-b631-2127846c3713 service nova] Creating event network-vif-deleted:38c2c5e6-fad8-4765-8442-be827ff69b3f for instance 58b5b55c-fd7d-4a43-96af-01ae27cb29de on n-h2-860284-1 Oct 04 21:48:18.635443 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-19974964-40d3-4d79-80cf-7b6370b23cb0 req-e00522b5-e7ca-4106-b631-2127846c3713 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053205 Oct 04 21:48:18.636785 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 735/1408] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:48:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:48:18.643691 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-2d5479ac-2a65-47f4-abf2-4621e5ef91ec tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:18.644415 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-2d5479ac-2a65-47f4-abf2-4621e5ef91ec tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: be573c06-25e7-485e-9443-5bc21196a45e] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:48:18.654241 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2d5479ac-2a65-47f4-abf2-4621e5ef91ec tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:18.654770 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2d5479ac-2a65-47f4-abf2-4621e5ef91ec tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:18.655421 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2d5479ac-2a65-47f4-abf2-4621e5ef91ec tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:18.656826 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2d5479ac-2a65-47f4-abf2-4621e5ef91ec tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:18.657485 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2d5479ac-2a65-47f4-abf2-4621e5ef91ec tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:18.658082 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2d5479ac-2a65-47f4-abf2-4621e5ef91ec tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:18.690962 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=8 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:48:18.691987 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:48:18.707189 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-e522b94c-9e41-4b6a-bcf5-815ef060bc46 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] [instance: 34276621-d087-478b-81c7-bdf5e38efc69] Going to try to terminate instance {{(pid=134101) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:48:18.813556 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-e522b94c-9e41-4b6a-bcf5-815ef060bc46 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] 10.222.0.43 "DELETE /compute/v2.1/servers/34276621-d087-478b-81c7-bdf5e38efc69" status: 204 len: 0 microversion: 2.1 time: 0.355390 Oct 04 21:48:18.817834 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 674/1409] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 21:48:18 2022] DELETE /compute/v2.1/servers/34276621-d087-478b-81c7-bdf5e38efc69 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:48:18.822578 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-8f8d97b2-a7cb-454c-add9-ee2042ffaa7b tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:18.823575 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-8f8d97b2-a7cb-454c-add9-ee2042ffaa7b tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] [instance: 58b5b55c-fd7d-4a43-96af-01ae27cb29de] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:48:18.830123 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8f8d97b2-a7cb-454c-add9-ee2042ffaa7b tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:18.830646 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8f8d97b2-a7cb-454c-add9-ee2042ffaa7b tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:18.831086 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8f8d97b2-a7cb-454c-add9-ee2042ffaa7b tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:18.831793 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8f8d97b2-a7cb-454c-add9-ee2042ffaa7b tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:18.832250 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8f8d97b2-a7cb-454c-add9-ee2042ffaa7b tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:18.832664 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8f8d97b2-a7cb-454c-add9-ee2042ffaa7b tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:18.863369 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-2d5479ac-2a65-47f4-abf2-4621e5ef91ec tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:48:18.869509 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8f8d97b2-a7cb-454c-add9-ee2042ffaa7b tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:18.870024 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8f8d97b2-a7cb-454c-add9-ee2042ffaa7b tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:18.870499 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8f8d97b2-a7cb-454c-add9-ee2042ffaa7b tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:18.870961 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.objects.instance [None req-8f8d97b2-a7cb-454c-add9-ee2042ffaa7b tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lazy-loading 'fault' on Instance uuid 58b5b55c-fd7d-4a43-96af-01ae27cb29de {{(pid=134101) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:48:18.872789 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-2d5479ac-2a65-47f4-abf2-4621e5ef91ec tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/be573c06-25e7-485e-9443-5bc21196a45e" status: 200 len: 1312 microversion: 2.1 time: 0.234480 Oct 04 21:48:18.873577 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 736/1410] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:48:18 2022] GET /compute/v2.1/servers/be573c06-25e7-485e-9443-5bc21196a45e => generated 1312 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:48:18.879297 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-610597c0-0dc6-496d-a2cb-fbb4ea5403f1 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:18.880531 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-610597c0-0dc6-496d-a2cb-fbb4ea5403f1 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] [instance: 34276621-d087-478b-81c7-bdf5e38efc69] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:48:18.887115 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-610597c0-0dc6-496d-a2cb-fbb4ea5403f1 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:18.887601 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-610597c0-0dc6-496d-a2cb-fbb4ea5403f1 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:18.888217 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-610597c0-0dc6-496d-a2cb-fbb4ea5403f1 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:18.889111 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-610597c0-0dc6-496d-a2cb-fbb4ea5403f1 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:18.889575 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-610597c0-0dc6-496d-a2cb-fbb4ea5403f1 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:18.890008 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-610597c0-0dc6-496d-a2cb-fbb4ea5403f1 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:18.911001 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:48:18.919689 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-8f8d97b2-a7cb-454c-add9-ee2042ffaa7b tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87616cd16995468ab7febf5aa4b284db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e3bf9149434d34b6762aaeef1478ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:48:18.928571 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-8f8d97b2-a7cb-454c-add9-ee2042ffaa7b tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] 10.222.0.43 "GET /compute/v2.1/servers/58b5b55c-fd7d-4a43-96af-01ae27cb29de" status: 200 len: 1304 microversion: 2.1 time: 0.112694 Oct 04 21:48:18.929156 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 675/1411] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:48:18 2022] GET /compute/v2.1/servers/58b5b55c-fd7d-4a43-96af-01ae27cb29de => generated 1304 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:48:19.029919 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-7a1e770c-85e3-4e52-a7c3-1db216b2af65 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:19.030606 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-7a1e770c-85e3-4e52-a7c3-1db216b2af65 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] [instance: 59a1880f-2802-4e72-9a17-b966cfec8fe9] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:48:19.039528 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-610597c0-0dc6-496d-a2cb-fbb4ea5403f1 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1789bb97219a4e1591632126812ea6df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da67fc95e2814f4086df020f4c475764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:48:19.040356 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7a1e770c-85e3-4e52-a7c3-1db216b2af65 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:19.040356 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7a1e770c-85e3-4e52-a7c3-1db216b2af65 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:19.040897 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7a1e770c-85e3-4e52-a7c3-1db216b2af65 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:19.041720 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7a1e770c-85e3-4e52-a7c3-1db216b2af65 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:19.042289 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7a1e770c-85e3-4e52-a7c3-1db216b2af65 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:19.042840 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7a1e770c-85e3-4e52-a7c3-1db216b2af65 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:19.048626 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-610597c0-0dc6-496d-a2cb-fbb4ea5403f1 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] 10.222.0.43 "GET /compute/v2.1/servers/34276621-d087-478b-81c7-bdf5e38efc69" status: 200 len: 1710 microversion: 2.1 time: 0.173664 Oct 04 21:48:19.049252 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 737/1412] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:48:18 2022] GET /compute/v2.1/servers/34276621-d087-478b-81c7-bdf5e38efc69 => generated 1710 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:48:19.185799 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-7a1e770c-85e3-4e52-a7c3-1db216b2af65 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7614aeaedd1947b88031fb55ca4783ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00081ff1d1aa41cbad345326b337093a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:48:19.194808 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-7a1e770c-85e3-4e52-a7c3-1db216b2af65 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] 10.222.0.43 "GET /compute/v2.1/servers/59a1880f-2802-4e72-9a17-b966cfec8fe9" status: 200 len: 1472 microversion: 2.1 time: 0.170208 Oct 04 21:48:19.195378 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 676/1413] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:48:19 2022] GET /compute/v2.1/servers/59a1880f-2802-4e72-9a17-b966cfec8fe9 => generated 1472 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:48:19.378801 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-68311a44-6c5d-4c0f-91ee-bcdaffd11a54 tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:19.379412 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-68311a44-6c5d-4c0f-91ee-bcdaffd11a54 tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] [instance: 197b66b3-69ef-4b80-9de7-b25ae132dc2e] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:48:19.386397 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-68311a44-6c5d-4c0f-91ee-bcdaffd11a54 tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:19.386889 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-68311a44-6c5d-4c0f-91ee-bcdaffd11a54 tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:19.387332 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-68311a44-6c5d-4c0f-91ee-bcdaffd11a54 tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:19.388224 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-68311a44-6c5d-4c0f-91ee-bcdaffd11a54 tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:19.388583 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-68311a44-6c5d-4c0f-91ee-bcdaffd11a54 tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:19.389016 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-68311a44-6c5d-4c0f-91ee-bcdaffd11a54 tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:19.527565 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-68311a44-6c5d-4c0f-91ee-bcdaffd11a54 tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7e992115ea4ba58205d3da003ec625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5345566eeb4a5f88d31f733eaa04bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:48:19.535474 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-68311a44-6c5d-4c0f-91ee-bcdaffd11a54 tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] 10.222.0.43 "GET /compute/v2.1/servers/197b66b3-69ef-4b80-9de7-b25ae132dc2e" status: 200 len: 1314 microversion: 2.1 time: 0.160905 Oct 04 21:48:19.536590 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 738/1414] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:48:19 2022] GET /compute/v2.1/servers/197b66b3-69ef-4b80-9de7-b25ae132dc2e => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:48:19.897929 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-2567c590-69ba-4695-9831-ee73c619206b tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:19.898594 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-2567c590-69ba-4695-9831-ee73c619206b tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: be573c06-25e7-485e-9443-5bc21196a45e] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:48:19.905472 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2567c590-69ba-4695-9831-ee73c619206b tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:19.905966 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2567c590-69ba-4695-9831-ee73c619206b tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:19.906449 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2567c590-69ba-4695-9831-ee73c619206b tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:19.907171 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2567c590-69ba-4695-9831-ee73c619206b tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:19.907630 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2567c590-69ba-4695-9831-ee73c619206b tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:19.908064 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2567c590-69ba-4695-9831-ee73c619206b tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:19.953059 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-d4410d39-4ada-424c-8d0c-4beb6d60a88a tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:19.953679 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-d4410d39-4ada-424c-8d0c-4beb6d60a88a tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] [instance: 58b5b55c-fd7d-4a43-96af-01ae27cb29de] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:48:19.961070 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d4410d39-4ada-424c-8d0c-4beb6d60a88a tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:19.961553 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d4410d39-4ada-424c-8d0c-4beb6d60a88a tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:19.962218 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d4410d39-4ada-424c-8d0c-4beb6d60a88a tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:19.963158 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d4410d39-4ada-424c-8d0c-4beb6d60a88a tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:19.963802 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d4410d39-4ada-424c-8d0c-4beb6d60a88a tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:19.964526 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d4410d39-4ada-424c-8d0c-4beb6d60a88a tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:20.023398 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d4410d39-4ada-424c-8d0c-4beb6d60a88a tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:20.023887 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d4410d39-4ada-424c-8d0c-4beb6d60a88a tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:20.024321 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d4410d39-4ada-424c-8d0c-4beb6d60a88a tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:20.024772 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.objects.instance [None req-d4410d39-4ada-424c-8d0c-4beb6d60a88a tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lazy-loading 'fault' on Instance uuid 58b5b55c-fd7d-4a43-96af-01ae27cb29de {{(pid=134102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:48:20.076223 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-d4410d39-4ada-424c-8d0c-4beb6d60a88a tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87616cd16995468ab7febf5aa4b284db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e3bf9149434d34b6762aaeef1478ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:48:20.079508 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-2567c590-69ba-4695-9831-ee73c619206b tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:48:20.084350 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-d4410d39-4ada-424c-8d0c-4beb6d60a88a tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] 10.222.0.43 "GET /compute/v2.1/servers/58b5b55c-fd7d-4a43-96af-01ae27cb29de" status: 200 len: 1304 microversion: 2.1 time: 0.135066 Oct 04 21:48:20.084930 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 739/1415] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:48:19 2022] GET /compute/v2.1/servers/58b5b55c-fd7d-4a43-96af-01ae27cb29de => generated 1304 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:48:20.088656 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-2567c590-69ba-4695-9831-ee73c619206b tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/be573c06-25e7-485e-9443-5bc21196a45e" status: 200 len: 1312 microversion: 2.1 time: 0.195434 Oct 04 21:48:20.099119 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 677/1416] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:48:19 2022] GET /compute/v2.1/servers/be573c06-25e7-485e-9443-5bc21196a45e => generated 1312 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:48:20.099279 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-2cd88abf-ab16-4fef-b457-f9b934b55cd1 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:20.099279 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-2cd88abf-ab16-4fef-b457-f9b934b55cd1 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] [instance: 34276621-d087-478b-81c7-bdf5e38efc69] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:48:20.099279 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2cd88abf-ab16-4fef-b457-f9b934b55cd1 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:20.099279 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2cd88abf-ab16-4fef-b457-f9b934b55cd1 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:20.099616 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2cd88abf-ab16-4fef-b457-f9b934b55cd1 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:20.099616 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2cd88abf-ab16-4fef-b457-f9b934b55cd1 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:20.099616 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2cd88abf-ab16-4fef-b457-f9b934b55cd1 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:20.099851 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2cd88abf-ab16-4fef-b457-f9b934b55cd1 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:20.217927 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-16663b0c-8837-4c00-b627-2609006d9907 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:20.218598 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-16663b0c-8837-4c00-b627-2609006d9907 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] [instance: 59a1880f-2802-4e72-9a17-b966cfec8fe9] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:48:20.225788 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-16663b0c-8837-4c00-b627-2609006d9907 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:20.226281 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-16663b0c-8837-4c00-b627-2609006d9907 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:20.226745 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-16663b0c-8837-4c00-b627-2609006d9907 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:20.227454 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-16663b0c-8837-4c00-b627-2609006d9907 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:20.227897 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-16663b0c-8837-4c00-b627-2609006d9907 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:20.228842 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-16663b0c-8837-4c00-b627-2609006d9907 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:20.237975 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-2cd88abf-ab16-4fef-b457-f9b934b55cd1 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1789bb97219a4e1591632126812ea6df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da67fc95e2814f4086df020f4c475764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:48:20.246988 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-2cd88abf-ab16-4fef-b457-f9b934b55cd1 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] 10.222.0.43 "GET /compute/v2.1/servers/34276621-d087-478b-81c7-bdf5e38efc69" status: 200 len: 1710 microversion: 2.1 time: 0.160811 Oct 04 21:48:20.247574 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 740/1417] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:48:20 2022] GET /compute/v2.1/servers/34276621-d087-478b-81c7-bdf5e38efc69 => generated 1710 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:48:20.370027 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-16663b0c-8837-4c00-b627-2609006d9907 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7614aeaedd1947b88031fb55ca4783ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00081ff1d1aa41cbad345326b337093a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:48:20.377715 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-16663b0c-8837-4c00-b627-2609006d9907 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] 10.222.0.43 "GET /compute/v2.1/servers/59a1880f-2802-4e72-9a17-b966cfec8fe9" status: 200 len: 1472 microversion: 2.1 time: 0.163633 Oct 04 21:48:20.378262 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 678/1418] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:48:20 2022] GET /compute/v2.1/servers/59a1880f-2802-4e72-9a17-b966cfec8fe9 => generated 1472 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:48:20.559197 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-6a75bda1-d3fc-48af-815f-f53cae003b5c tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:20.559945 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-6a75bda1-d3fc-48af-815f-f53cae003b5c tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] [instance: 197b66b3-69ef-4b80-9de7-b25ae132dc2e] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:48:20.565961 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6a75bda1-d3fc-48af-815f-f53cae003b5c tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:20.566472 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6a75bda1-d3fc-48af-815f-f53cae003b5c tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:20.566916 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6a75bda1-d3fc-48af-815f-f53cae003b5c tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:20.568173 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6a75bda1-d3fc-48af-815f-f53cae003b5c tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:20.568659 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6a75bda1-d3fc-48af-815f-f53cae003b5c tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:20.569093 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6a75bda1-d3fc-48af-815f-f53cae003b5c tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:20.704185 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-6a75bda1-d3fc-48af-815f-f53cae003b5c tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7e992115ea4ba58205d3da003ec625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5345566eeb4a5f88d31f733eaa04bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:48:20.712550 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-6a75bda1-d3fc-48af-815f-f53cae003b5c tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] 10.222.0.43 "GET /compute/v2.1/servers/197b66b3-69ef-4b80-9de7-b25ae132dc2e" status: 200 len: 1314 microversion: 2.1 time: 0.157402 Oct 04 21:48:20.713155 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 741/1419] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:48:20 2022] GET /compute/v2.1/servers/197b66b3-69ef-4b80-9de7-b25ae132dc2e => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:48:21.111931 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-0995debf-4a37-4d70-9e61-fa20f392166b tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:21.112636 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-0995debf-4a37-4d70-9e61-fa20f392166b tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: be573c06-25e7-485e-9443-5bc21196a45e] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:48:21.113337 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-76ec3629-333a-4fb3-ab8a-96b3bd8eb166 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:21.119442 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-76ec3629-333a-4fb3-ab8a-96b3bd8eb166 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] [instance: 58b5b55c-fd7d-4a43-96af-01ae27cb29de] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:48:21.134859 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0995debf-4a37-4d70-9e61-fa20f392166b tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:21.136796 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0995debf-4a37-4d70-9e61-fa20f392166b tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:21.137237 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-76ec3629-333a-4fb3-ab8a-96b3bd8eb166 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:21.137805 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-76ec3629-333a-4fb3-ab8a-96b3bd8eb166 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:21.138356 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0995debf-4a37-4d70-9e61-fa20f392166b tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:21.138520 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-76ec3629-333a-4fb3-ab8a-96b3bd8eb166 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:21.139525 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0995debf-4a37-4d70-9e61-fa20f392166b tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:21.140272 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0995debf-4a37-4d70-9e61-fa20f392166b tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:21.141019 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0995debf-4a37-4d70-9e61-fa20f392166b tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:21.144711 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-76ec3629-333a-4fb3-ab8a-96b3bd8eb166 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:21.145795 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-76ec3629-333a-4fb3-ab8a-96b3bd8eb166 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:21.146211 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-76ec3629-333a-4fb3-ab8a-96b3bd8eb166 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:21.172486 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-76ec3629-333a-4fb3-ab8a-96b3bd8eb166 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] HTTP exception thrown: Instance 58b5b55c-fd7d-4a43-96af-01ae27cb29de could not be found. Oct 04 21:48:21.174258 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-76ec3629-333a-4fb3-ab8a-96b3bd8eb166 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Request method failure captured: Oct 04 21:48:21.174258 n-d-860284-1 devstack@n-api.service[134101]: request: GET /compute/v2.1/servers/58b5b55c-fd7d-4a43-96af-01ae27cb29de HTTP/1.1 Oct 04 21:48:21.174258 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 21:48:21.174258 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 21:48:21.174258 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 21:48:21.174258 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 21:48:21.174258 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 21:48:21.174258 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 21:48:21.174258 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 21:48:21.174258 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 21:48:21.174258 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPKmIg2p4Jaxd9N6jvYm_ZlmIMNjr8orAnEv7D8rk6jEPCLTvf0ENcigrAMkoCJ8-5tEY0vHmABCtEiCAdU087VK1bxPHI47P91pdF73KZc8Mzo7LOt4YWB2vFleaIkUVBrnDLuNXAmn_EiwaVwPZivvplgN0f1eDFUFr9oDqS014MUs Oct 04 21:48:21.174258 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 21:48:21.174258 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 21:48:21.174258 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 21:48:21.174258 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 21:48:21.174258 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 21:48:21.174258 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 21:48:21.174258 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: a1e3bf9149434d34b6762aaeef1478ed Oct 04 21:48:21.174258 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-ServersAdminTestJSON-106350315 Oct 04 21:48:21.174258 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 21:48:21.174258 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 21:48:21.175777 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a1e3bf9149434d34b6762aaeef1478ed"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_a1e3bf9149434d34b6762aaeef1478ed", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a1e3bf9149434d34b6762aaeef1478ed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/a1e3bf9149434d34b6762aaeef1478ed"}]}] Oct 04 21:48:21.175777 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-ServersAdminTestJSON-106350315 Oct 04 21:48:21.175777 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: a1e3bf9149434d34b6762aaeef1478ed Oct 04 21:48:21.175777 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-ServersAdminTestJSON-106350315 Oct 04 21:48:21.175777 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-ServersAdminTestJSON-106350315-project Oct 04 21:48:21.175777 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 21:48:21.175777 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 21:48:21.175777 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 87616cd16995468ab7febf5aa4b284db Oct 04 21:48:21.175777 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-ServersAdminTestJSON-106350315-project Oct 04 21:48:21.175777 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 21:48:21.175777 n-d-860284-1 devstack@n-api.service[134101]: exception: Instance 58b5b55c-fd7d-4a43-96af-01ae27cb29de could not be found. Oct 04 21:48:21.175777 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': '58b5b55c-fd7d-4a43-96af-01ae27cb29de'} Oct 04 21:48:21.176597 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:48:21.176597 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:48:21.176597 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:48:21.176597 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:48:21.176597 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:48:21.176597 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:48:21.176597 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:48:21.176597 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:48:21.176597 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:48:21.176597 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:48:21.176597 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58b5b55c-fd7d-4a43-96af-01ae27cb29de could not be found. Oct 04 21:48:21.176597 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:48:21.176597 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:48:21.176597 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:48:21.176597 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:48:21.176597 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:48:21.176597 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:48:21.176597 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:48:21.176597 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:48:21.176597 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:48:21.179516 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:48:21.179516 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:48:21.179516 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:48:21.179516 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:48:21.179516 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:48:21.179516 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:48:21.179516 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:48:21.179516 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58b5b55c-fd7d-4a43-96af-01ae27cb29de could not be found. Oct 04 21:48:21.179516 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:48:21.179516 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:48:21.179516 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:48:21.179516 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:48:21.179516 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:48:21.179516 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:48:21.179516 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:48:21.179516 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:48:21.179516 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58b5b55c-fd7d-4a43-96af-01ae27cb29de could not be found. Oct 04 21:48:21.179516 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:48:21.181856 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-76ec3629-333a-4fb3-ab8a-96b3bd8eb166 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Returning 404 to user: Instance 58b5b55c-fd7d-4a43-96af-01ae27cb29de could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:48:21.181856 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-76ec3629-333a-4fb3-ab8a-96b3bd8eb166 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] 10.222.0.43 "GET /compute/v2.1/servers/58b5b55c-fd7d-4a43-96af-01ae27cb29de" status: 404 len: 111 microversion: 2.1 time: 0.072791 Oct 04 21:48:21.181856 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 679/1420] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:48:21 2022] GET /compute/v2.1/servers/58b5b55c-fd7d-4a43-96af-01ae27cb29de => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:48:21.210469 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-9ea71bfe-a0c6-4846-b2f8-35f3a8cf9586 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:21.211248 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-9ea71bfe-a0c6-4846-b2f8-35f3a8cf9586 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] [instance: e3380b36-6aba-4736-bcbc-f0058f806d55] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:48:21.220498 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9ea71bfe-a0c6-4846-b2f8-35f3a8cf9586 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:21.221007 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9ea71bfe-a0c6-4846-b2f8-35f3a8cf9586 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:21.221505 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9ea71bfe-a0c6-4846-b2f8-35f3a8cf9586 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:21.222408 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9ea71bfe-a0c6-4846-b2f8-35f3a8cf9586 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:21.222896 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9ea71bfe-a0c6-4846-b2f8-35f3a8cf9586 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:21.223330 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9ea71bfe-a0c6-4846-b2f8-35f3a8cf9586 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:21.265328 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-9ea71bfe-a0c6-4846-b2f8-35f3a8cf9586 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] [instance: e3380b36-6aba-4736-bcbc-f0058f806d55] Going to try to terminate instance {{(pid=134101) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:48:21.411075 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-9ea71bfe-a0c6-4846-b2f8-35f3a8cf9586 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] 10.222.0.43 "DELETE /compute/v2.1/servers/e3380b36-6aba-4736-bcbc-f0058f806d55" status: 204 len: 0 microversion: 2.1 time: 0.227687 Oct 04 21:48:21.411849 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 680/1421] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 21:48:21 2022] DELETE /compute/v2.1/servers/e3380b36-6aba-4736-bcbc-f0058f806d55 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:48:21.428147 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-8f89e14a-279b-4ff3-8a4b-5411c0766e76 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:21.429299 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-8f89e14a-279b-4ff3-8a4b-5411c0766e76 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] [instance: 34276621-d087-478b-81c7-bdf5e38efc69] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:48:21.436523 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8f89e14a-279b-4ff3-8a4b-5411c0766e76 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:21.437187 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8f89e14a-279b-4ff3-8a4b-5411c0766e76 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:21.438117 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8f89e14a-279b-4ff3-8a4b-5411c0766e76 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:21.438996 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8f89e14a-279b-4ff3-8a4b-5411c0766e76 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:21.439565 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8f89e14a-279b-4ff3-8a4b-5411c0766e76 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:21.440103 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8f89e14a-279b-4ff3-8a4b-5411c0766e76 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:21.642322 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-0995debf-4a37-4d70-9e61-fa20f392166b tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:48:21.653230 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-0995debf-4a37-4d70-9e61-fa20f392166b tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/be573c06-25e7-485e-9443-5bc21196a45e" status: 200 len: 1312 microversion: 2.1 time: 0.545043 Oct 04 21:48:21.654961 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 742/1422] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:48:21 2022] GET /compute/v2.1/servers/be573c06-25e7-485e-9443-5bc21196a45e => generated 1312 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:48:21.660641 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-450abbb1-4b58-4bc3-b2bd-9e94c421f6c2 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:21.662407 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-450abbb1-4b58-4bc3-b2bd-9e94c421f6c2 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] [instance: 59a1880f-2802-4e72-9a17-b966cfec8fe9] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:48:21.669052 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-450abbb1-4b58-4bc3-b2bd-9e94c421f6c2 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:21.669787 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-450abbb1-4b58-4bc3-b2bd-9e94c421f6c2 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:21.671596 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-450abbb1-4b58-4bc3-b2bd-9e94c421f6c2 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:21.672503 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-450abbb1-4b58-4bc3-b2bd-9e94c421f6c2 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:21.673115 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-450abbb1-4b58-4bc3-b2bd-9e94c421f6c2 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:21.673693 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-450abbb1-4b58-4bc3-b2bd-9e94c421f6c2 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:22.190264 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-450abbb1-4b58-4bc3-b2bd-9e94c421f6c2 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7614aeaedd1947b88031fb55ca4783ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00081ff1d1aa41cbad345326b337093a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:48:22.199851 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-450abbb1-4b58-4bc3-b2bd-9e94c421f6c2 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] 10.222.0.43 "GET /compute/v2.1/servers/59a1880f-2802-4e72-9a17-b966cfec8fe9" status: 200 len: 1472 microversion: 2.1 time: 0.543531 Oct 04 21:48:22.200967 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 743/1423] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:48:21 2022] GET /compute/v2.1/servers/59a1880f-2802-4e72-9a17-b966cfec8fe9 => generated 1472 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:48:22.201119 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-8f89e14a-279b-4ff3-8a4b-5411c0766e76 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1789bb97219a4e1591632126812ea6df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da67fc95e2814f4086df020f4c475764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:48:22.207092 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-d81c7276-a2b7-4ab3-87e4-00bc03688f19 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:22.211164 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-d81c7276-a2b7-4ab3-87e4-00bc03688f19 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] [instance: e3380b36-6aba-4736-bcbc-f0058f806d55] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:48:22.222055 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d81c7276-a2b7-4ab3-87e4-00bc03688f19 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:22.222583 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d81c7276-a2b7-4ab3-87e4-00bc03688f19 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:22.222981 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-8f89e14a-279b-4ff3-8a4b-5411c0766e76 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] 10.222.0.43 "GET /compute/v2.1/servers/34276621-d087-478b-81c7-bdf5e38efc69" status: 200 len: 1710 microversion: 2.1 time: 0.800437 Oct 04 21:48:22.223114 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d81c7276-a2b7-4ab3-87e4-00bc03688f19 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:22.224538 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d81c7276-a2b7-4ab3-87e4-00bc03688f19 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:22.225079 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d81c7276-a2b7-4ab3-87e4-00bc03688f19 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:22.225398 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 681/1424] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:48:21 2022] GET /compute/v2.1/servers/34276621-d087-478b-81c7-bdf5e38efc69 => generated 1710 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:48:22.225614 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d81c7276-a2b7-4ab3-87e4-00bc03688f19 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:22.235427 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-60fe5bed-67b3-4157-bf1f-ede4550b65ba req-f1402499-5388-4426-a838-341371416982 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be573c06-25e7-485e-9443-5bc21196a45e", "name": "network-vif-plugged", "status": "completed", "tag": "ab7d2e00-d523-4e06-a029-fdb5f5ae6c75"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:48:22.251962 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-60fe5bed-67b3-4157-bf1f-ede4550b65ba req-f1402499-5388-4426-a838-341371416982 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:22.254146 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-60fe5bed-67b3-4157-bf1f-ede4550b65ba req-f1402499-5388-4426-a838-341371416982 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:22.255975 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-60fe5bed-67b3-4157-bf1f-ede4550b65ba req-f1402499-5388-4426-a838-341371416982 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:22.277972 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-60fe5bed-67b3-4157-bf1f-ede4550b65ba req-f1402499-5388-4426-a838-341371416982 service nova] Creating event network-vif-plugged:ab7d2e00-d523-4e06-a029-fdb5f5ae6c75 for instance be573c06-25e7-485e-9443-5bc21196a45e on n-h1-860284-1 Oct 04 21:48:22.285204 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-60fe5bed-67b3-4157-bf1f-ede4550b65ba req-f1402499-5388-4426-a838-341371416982 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056139 Oct 04 21:48:22.287227 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 682/1425] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:48:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:48:22.293224 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-dc45de26-9ff2-4630-acb4-cd6fd0f31a01 tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:22.293926 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-dc45de26-9ff2-4630-acb4-cd6fd0f31a01 tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] [instance: 197b66b3-69ef-4b80-9de7-b25ae132dc2e] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:48:22.302558 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dc45de26-9ff2-4630-acb4-cd6fd0f31a01 tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:22.303635 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dc45de26-9ff2-4630-acb4-cd6fd0f31a01 tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:22.304798 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dc45de26-9ff2-4630-acb4-cd6fd0f31a01 tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:22.305894 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dc45de26-9ff2-4630-acb4-cd6fd0f31a01 tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:22.306710 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dc45de26-9ff2-4630-acb4-cd6fd0f31a01 tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:22.307361 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dc45de26-9ff2-4630-acb4-cd6fd0f31a01 tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:22.674309 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-d81c7276-a2b7-4ab3-87e4-00bc03688f19 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87616cd16995468ab7febf5aa4b284db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e3bf9149434d34b6762aaeef1478ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:48:22.683800 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-d81c7276-a2b7-4ab3-87e4-00bc03688f19 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] 10.222.0.43 "GET /compute/v2.1/servers/e3380b36-6aba-4736-bcbc-f0058f806d55" status: 200 len: 1469 microversion: 2.1 time: 0.481130 Oct 04 21:48:22.684437 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 744/1426] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:48:22 2022] GET /compute/v2.1/servers/e3380b36-6aba-4736-bcbc-f0058f806d55 => generated 1469 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:48:22.688905 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-03d40bd4-b774-42c3-84fa-f4efcff27bc5 req-2b67cd27-31b4-4bec-943b-3a65429ea34b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59a1880f-2802-4e72-9a17-b966cfec8fe9", "name": "network-vif-deleted", "tag": "893f32f5-2183-4d13-8c2e-2095ab07e2af"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:48:22.694470 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-dc45de26-9ff2-4630-acb4-cd6fd0f31a01 tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7e992115ea4ba58205d3da003ec625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5345566eeb4a5f88d31f733eaa04bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:48:22.702573 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-03d40bd4-b774-42c3-84fa-f4efcff27bc5 req-2b67cd27-31b4-4bec-943b-3a65429ea34b service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:22.703345 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-03d40bd4-b774-42c3-84fa-f4efcff27bc5 req-2b67cd27-31b4-4bec-943b-3a65429ea34b service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:22.703779 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-03d40bd4-b774-42c3-84fa-f4efcff27bc5 req-2b67cd27-31b4-4bec-943b-3a65429ea34b service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:22.705021 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-dc45de26-9ff2-4630-acb4-cd6fd0f31a01 tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] 10.222.0.43 "GET /compute/v2.1/servers/197b66b3-69ef-4b80-9de7-b25ae132dc2e" status: 200 len: 1314 microversion: 2.1 time: 0.416297 Oct 04 21:48:22.705646 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 683/1427] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:48:22 2022] GET /compute/v2.1/servers/197b66b3-69ef-4b80-9de7-b25ae132dc2e => generated 1314 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:48:22.712341 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-1a87d494-ef96-471b-a304-438484b0d788 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:22.715351 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-1a87d494-ef96-471b-a304-438484b0d788 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] [instance: 1e9957cf-cfeb-483d-bc32-73ca72a54eb9] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:48:22.721353 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-03d40bd4-b774-42c3-84fa-f4efcff27bc5 req-2b67cd27-31b4-4bec-943b-3a65429ea34b service nova] Creating event network-vif-deleted:893f32f5-2183-4d13-8c2e-2095ab07e2af for instance 59a1880f-2802-4e72-9a17-b966cfec8fe9 on n-h1-860284-1 Oct 04 21:48:22.722113 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1a87d494-ef96-471b-a304-438484b0d788 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:22.722678 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1a87d494-ef96-471b-a304-438484b0d788 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:22.724591 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1a87d494-ef96-471b-a304-438484b0d788 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:22.724591 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1a87d494-ef96-471b-a304-438484b0d788 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:22.724591 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1a87d494-ef96-471b-a304-438484b0d788 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:22.725383 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1a87d494-ef96-471b-a304-438484b0d788 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:22.729576 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-03d40bd4-b774-42c3-84fa-f4efcff27bc5 req-2b67cd27-31b4-4bec-943b-3a65429ea34b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043960 Oct 04 21:48:22.730206 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 745/1428] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:48:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:48:22.738481 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-25389611-bfb8-4574-8b73-bd6850173f82 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:22.739911 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-25389611-bfb8-4574-8b73-bd6850173f82 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: be573c06-25e7-485e-9443-5bc21196a45e] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:48:22.746267 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-25389611-bfb8-4574-8b73-bd6850173f82 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:22.746731 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-25389611-bfb8-4574-8b73-bd6850173f82 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:22.747157 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-25389611-bfb8-4574-8b73-bd6850173f82 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:22.747850 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-25389611-bfb8-4574-8b73-bd6850173f82 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:22.748449 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-25389611-bfb8-4574-8b73-bd6850173f82 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:22.748880 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-25389611-bfb8-4574-8b73-bd6850173f82 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:22.759601 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-1a87d494-ef96-471b-a304-438484b0d788 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] 10.222.0.43 "GET /compute/v2.1/servers/1e9957cf-cfeb-483d-bc32-73ca72a54eb9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052256 Oct 04 21:48:22.764001 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 684/1429] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 21:48:22 2022] GET /compute/v2.1/servers/1e9957cf-cfeb-483d-bc32-73ca72a54eb9/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:48:22.771214 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-7d66d925-309f-4d54-890a-0e962916a46a tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:22.771718 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-7d66d925-309f-4d54-890a-0e962916a46a tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] [instance: 1e9957cf-cfeb-483d-bc32-73ca72a54eb9] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:48:22.777737 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7d66d925-309f-4d54-890a-0e962916a46a tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:22.778231 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7d66d925-309f-4d54-890a-0e962916a46a tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:22.778743 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7d66d925-309f-4d54-890a-0e962916a46a tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:22.779451 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7d66d925-309f-4d54-890a-0e962916a46a tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:22.779916 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7d66d925-309f-4d54-890a-0e962916a46a tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:22.780469 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7d66d925-309f-4d54-890a-0e962916a46a tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:22.932359 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.objects.instance [None req-7d66d925-309f-4d54-890a-0e962916a46a tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Lazy-loading 'services' on Instance uuid 1e9957cf-cfeb-483d-bc32-73ca72a54eb9 {{(pid=134101) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:48:23.040583 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-25389611-bfb8-4574-8b73-bd6850173f82 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:48:23.057005 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-25389611-bfb8-4574-8b73-bd6850173f82 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/be573c06-25e7-485e-9443-5bc21196a45e" status: 200 len: 1312 microversion: 2.1 time: 0.322604 Oct 04 21:48:23.057726 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 746/1430] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:48:22 2022] GET /compute/v2.1/servers/be573c06-25e7-485e-9443-5bc21196a45e => generated 1312 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:48:23.064326 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-d2146d1a-2a6e-42ad-bfc7-358f15cde2f7 req-c57b931a-ac4d-47bd-9b5e-0402c9f72ad6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34276621-d087-478b-81c7-bdf5e38efc69", "name": "network-vif-deleted", "tag": "80b76ccd-8248-4ae2-ae94-68b23a4a9c2c"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:48:23.075918 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-d2146d1a-2a6e-42ad-bfc7-358f15cde2f7 req-c57b931a-ac4d-47bd-9b5e-0402c9f72ad6 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:23.076734 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-d2146d1a-2a6e-42ad-bfc7-358f15cde2f7 req-c57b931a-ac4d-47bd-9b5e-0402c9f72ad6 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:23.077569 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-d2146d1a-2a6e-42ad-bfc7-358f15cde2f7 req-c57b931a-ac4d-47bd-9b5e-0402c9f72ad6 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:23.091195 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-d2146d1a-2a6e-42ad-bfc7-358f15cde2f7 req-c57b931a-ac4d-47bd-9b5e-0402c9f72ad6 service nova] Creating event network-vif-deleted:80b76ccd-8248-4ae2-ae94-68b23a4a9c2c for instance 34276621-d087-478b-81c7-bdf5e38efc69 on n-h2-860284-1 Oct 04 21:48:23.097070 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-d2146d1a-2a6e-42ad-bfc7-358f15cde2f7 req-c57b931a-ac4d-47bd-9b5e-0402c9f72ad6 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037840 Oct 04 21:48:23.097825 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 747/1431] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:48:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:48:23.123151 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-7d66d925-309f-4d54-890a-0e962916a46a tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] 10.222.0.43 "DELETE /compute/v2.1/servers/1e9957cf-cfeb-483d-bc32-73ca72a54eb9/os-volume_attachments/0e7513f9-7cb3-40cb-8f03-b68b5d2b8423" status: 202 len: 0 microversion: 2.1 time: 0.355978 Oct 04 21:48:23.123875 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 685/1432] 10.222.0.43 () {58 vars in 1416 bytes} [Tue Oct 4 21:48:22 2022] DELETE /compute/v2.1/servers/1e9957cf-cfeb-483d-bc32-73ca72a54eb9/os-volume_attachments/0e7513f9-7cb3-40cb-8f03-b68b5d2b8423 => generated 0 bytes in 358 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:48:23.231072 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-01446dbf-68a0-44cf-8ba6-cebeb891c689 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:23.232097 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-01446dbf-68a0-44cf-8ba6-cebeb891c689 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] [instance: 59a1880f-2802-4e72-9a17-b966cfec8fe9] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:48:23.247016 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-01446dbf-68a0-44cf-8ba6-cebeb891c689 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:23.248717 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-01446dbf-68a0-44cf-8ba6-cebeb891c689 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:23.249261 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-01446dbf-68a0-44cf-8ba6-cebeb891c689 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:23.250206 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-01446dbf-68a0-44cf-8ba6-cebeb891c689 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:23.250838 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-01446dbf-68a0-44cf-8ba6-cebeb891c689 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:23.251489 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-01446dbf-68a0-44cf-8ba6-cebeb891c689 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:23.256911 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-89bad054-c54f-419e-862a-937d15140ddf tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:23.257679 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-89bad054-c54f-419e-862a-937d15140ddf tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] [instance: 34276621-d087-478b-81c7-bdf5e38efc69] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:48:23.282565 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-89bad054-c54f-419e-862a-937d15140ddf tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:23.283978 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-89bad054-c54f-419e-862a-937d15140ddf tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:23.285028 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-89bad054-c54f-419e-862a-937d15140ddf tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:23.286436 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-89bad054-c54f-419e-862a-937d15140ddf tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:23.288658 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-89bad054-c54f-419e-862a-937d15140ddf tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:23.289728 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-89bad054-c54f-419e-862a-937d15140ddf tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:23.299327 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-01446dbf-68a0-44cf-8ba6-cebeb891c689 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:23.300160 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-01446dbf-68a0-44cf-8ba6-cebeb891c689 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:23.300693 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-01446dbf-68a0-44cf-8ba6-cebeb891c689 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:23.301162 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.objects.instance [None req-01446dbf-68a0-44cf-8ba6-cebeb891c689 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Lazy-loading 'fault' on Instance uuid 59a1880f-2802-4e72-9a17-b966cfec8fe9 {{(pid=134102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:48:23.345076 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-89bad054-c54f-419e-862a-937d15140ddf tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:23.345631 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-89bad054-c54f-419e-862a-937d15140ddf tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:23.346071 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-89bad054-c54f-419e-862a-937d15140ddf tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:23.346560 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.objects.instance [None req-89bad054-c54f-419e-862a-937d15140ddf tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lazy-loading 'fault' on Instance uuid 34276621-d087-478b-81c7-bdf5e38efc69 {{(pid=134101) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:48:23.433275 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-01446dbf-68a0-44cf-8ba6-cebeb891c689 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7614aeaedd1947b88031fb55ca4783ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00081ff1d1aa41cbad345326b337093a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:48:23.436878 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-89bad054-c54f-419e-862a-937d15140ddf tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1789bb97219a4e1591632126812ea6df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da67fc95e2814f4086df020f4c475764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:48:23.446049 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-01446dbf-68a0-44cf-8ba6-cebeb891c689 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] 10.222.0.43 "GET /compute/v2.1/servers/59a1880f-2802-4e72-9a17-b966cfec8fe9" status: 200 len: 1306 microversion: 2.1 time: 0.220958 Oct 04 21:48:23.458395 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-89bad054-c54f-419e-862a-937d15140ddf tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] 10.222.0.43 "GET /compute/v2.1/servers/34276621-d087-478b-81c7-bdf5e38efc69" status: 200 len: 1354 microversion: 2.1 time: 0.196129 Oct 04 21:48:23.458395 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 686/1433] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:48:23 2022] GET /compute/v2.1/servers/34276621-d087-478b-81c7-bdf5e38efc69 => generated 1354 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:48:23.458863 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 748/1434] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:48:23 2022] GET /compute/v2.1/servers/59a1880f-2802-4e72-9a17-b966cfec8fe9 => generated 1306 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:48:23.712038 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-dcebf6b2-15bb-4684-a8b4-dd8bc9b3ee07 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:23.713186 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-dcebf6b2-15bb-4684-a8b4-dd8bc9b3ee07 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] [instance: e3380b36-6aba-4736-bcbc-f0058f806d55] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:48:23.724564 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dcebf6b2-15bb-4684-a8b4-dd8bc9b3ee07 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:23.725792 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dcebf6b2-15bb-4684-a8b4-dd8bc9b3ee07 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:23.726867 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dcebf6b2-15bb-4684-a8b4-dd8bc9b3ee07 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:23.728032 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dcebf6b2-15bb-4684-a8b4-dd8bc9b3ee07 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:23.728618 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dcebf6b2-15bb-4684-a8b4-dd8bc9b3ee07 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:23.729184 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dcebf6b2-15bb-4684-a8b4-dd8bc9b3ee07 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:23.731195 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-6b92370f-ef73-406c-98e9-259d0ea391db tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:23.731843 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-6b92370f-ef73-406c-98e9-259d0ea391db tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] [instance: 197b66b3-69ef-4b80-9de7-b25ae132dc2e] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:48:23.741388 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6b92370f-ef73-406c-98e9-259d0ea391db tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:23.741887 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6b92370f-ef73-406c-98e9-259d0ea391db tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:23.742739 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6b92370f-ef73-406c-98e9-259d0ea391db tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:23.743671 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6b92370f-ef73-406c-98e9-259d0ea391db tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:23.744131 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6b92370f-ef73-406c-98e9-259d0ea391db tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:23.744554 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6b92370f-ef73-406c-98e9-259d0ea391db tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:23.948336 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-dcebf6b2-15bb-4684-a8b4-dd8bc9b3ee07 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87616cd16995468ab7febf5aa4b284db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e3bf9149434d34b6762aaeef1478ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:48:23.967364 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:48:23.976965 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-dcebf6b2-15bb-4684-a8b4-dd8bc9b3ee07 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] 10.222.0.43 "GET /compute/v2.1/servers/e3380b36-6aba-4736-bcbc-f0058f806d55" status: 200 len: 1427 microversion: 2.1 time: 0.269280 Oct 04 21:48:23.978067 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 687/1435] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:48:23 2022] GET /compute/v2.1/servers/e3380b36-6aba-4736-bcbc-f0058f806d55 => generated 1427 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:48:24.081165 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-7c7e2d80-0fb3-452e-a6ca-0b7f904ba83e tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:24.081770 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-7c7e2d80-0fb3-452e-a6ca-0b7f904ba83e tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: be573c06-25e7-485e-9443-5bc21196a45e] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:48:24.092161 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-6b92370f-ef73-406c-98e9-259d0ea391db tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7e992115ea4ba58205d3da003ec625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5345566eeb4a5f88d31f733eaa04bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:48:24.107603 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7c7e2d80-0fb3-452e-a6ca-0b7f904ba83e tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:24.108929 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7c7e2d80-0fb3-452e-a6ca-0b7f904ba83e tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:24.109394 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7c7e2d80-0fb3-452e-a6ca-0b7f904ba83e tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:24.112391 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7c7e2d80-0fb3-452e-a6ca-0b7f904ba83e tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:24.112928 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7c7e2d80-0fb3-452e-a6ca-0b7f904ba83e tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:24.113377 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7c7e2d80-0fb3-452e-a6ca-0b7f904ba83e tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:24.123122 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-6b92370f-ef73-406c-98e9-259d0ea391db tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] 10.222.0.43 "GET /compute/v2.1/servers/197b66b3-69ef-4b80-9de7-b25ae132dc2e" status: 200 len: 1464 microversion: 2.1 time: 0.387873 Oct 04 21:48:24.124607 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 749/1436] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:48:23 2022] GET /compute/v2.1/servers/197b66b3-69ef-4b80-9de7-b25ae132dc2e => generated 1464 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:48:24.266138 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-393489b9-35b3-4695-93e5-118d1e310025 tempest-TenantUsagesTestJSON-487734786 tempest-TenantUsagesTestJSON-487734786-project-admin] Calling method '.version_select at 0x7fbb2f142700>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:24.289556 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-393489b9-35b3-4695-93e5-118d1e310025 tempest-TenantUsagesTestJSON-487734786 tempest-TenantUsagesTestJSON-487734786-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:24.290235 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-393489b9-35b3-4695-93e5-118d1e310025 tempest-TenantUsagesTestJSON-487734786 tempest-TenantUsagesTestJSON-487734786-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:24.290940 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-393489b9-35b3-4695-93e5-118d1e310025 tempest-TenantUsagesTestJSON-487734786 tempest-TenantUsagesTestJSON-487734786-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:24.314308 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-393489b9-35b3-4695-93e5-118d1e310025 tempest-TenantUsagesTestJSON-487734786 tempest-TenantUsagesTestJSON-487734786-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:24.314858 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-393489b9-35b3-4695-93e5-118d1e310025 tempest-TenantUsagesTestJSON-487734786 tempest-TenantUsagesTestJSON-487734786-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:24.315295 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-393489b9-35b3-4695-93e5-118d1e310025 tempest-TenantUsagesTestJSON-487734786 tempest-TenantUsagesTestJSON-487734786-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:24.344105 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-393489b9-35b3-4695-93e5-118d1e310025 tempest-TenantUsagesTestJSON-487734786 tempest-TenantUsagesTestJSON-487734786-project-admin] 10.222.0.43 "GET /compute/v2.1/os-simple-tenant-usage/ff5345566eeb4a5f88d31f733eaa04bc?start=2022-10-03T21%3A48%3A24.142698&end=2022-10-05T21%3A48%3A24.142698" status: 200 len: 695 microversion: 2.1 time: 0.195005 Oct 04 21:48:24.346514 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 750/1437] 10.222.0.43 () {58 vars in 1412 bytes} [Tue Oct 4 21:48:24 2022] GET /compute/v2.1/os-simple-tenant-usage/ff5345566eeb4a5f88d31f733eaa04bc?start=2022-10-03T21%3A48%3A24.142698&end=2022-10-05T21%3A48%3A24.142698 => generated 695 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:48:24.362077 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-c1d398a6-3fd7-4d6f-a890-b8588351bf9e tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Calling method '.version_select at 0x7fbb2f6b8d30>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:24.373550 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c1d398a6-3fd7-4d6f-a890-b8588351bf9e tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:24.373814 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c1d398a6-3fd7-4d6f-a890-b8588351bf9e tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:24.374260 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c1d398a6-3fd7-4d6f-a890-b8588351bf9e tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:24.385033 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c1d398a6-3fd7-4d6f-a890-b8588351bf9e tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:24.385521 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c1d398a6-3fd7-4d6f-a890-b8588351bf9e tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:24.385960 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c1d398a6-3fd7-4d6f-a890-b8588351bf9e tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:24.403229 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-c1d398a6-3fd7-4d6f-a890-b8588351bf9e tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] 10.222.0.43 "GET /compute/v2.1/os-simple-tenant-usage/ff5345566eeb4a5f88d31f733eaa04bc?start=2022-10-03T21%3A48%3A24.142698&end=2022-10-05T21%3A48%3A24.142698" status: 200 len: 651 microversion: 2.1 time: 0.046346 Oct 04 21:48:24.404047 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 751/1438] 10.222.0.43 () {58 vars in 1412 bytes} [Tue Oct 4 21:48:24 2022] GET /compute/v2.1/os-simple-tenant-usage/ff5345566eeb4a5f88d31f733eaa04bc?start=2022-10-03T21%3A48%3A24.142698&end=2022-10-05T21%3A48%3A24.142698 => generated 651 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:48:24.419988 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-bf28c484-9d68-4e98-bfe3-186b5fc3e1c3 tempest-TenantUsagesTestJSON-487734786 tempest-TenantUsagesTestJSON-487734786-project-admin] Calling method '.version_select at 0x7fbb2f523430>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:24.435436 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bf28c484-9d68-4e98-bfe3-186b5fc3e1c3 tempest-TenantUsagesTestJSON-487734786 tempest-TenantUsagesTestJSON-487734786-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:24.436293 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bf28c484-9d68-4e98-bfe3-186b5fc3e1c3 tempest-TenantUsagesTestJSON-487734786 tempest-TenantUsagesTestJSON-487734786-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:24.436759 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bf28c484-9d68-4e98-bfe3-186b5fc3e1c3 tempest-TenantUsagesTestJSON-487734786 tempest-TenantUsagesTestJSON-487734786-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:24.458931 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bf28c484-9d68-4e98-bfe3-186b5fc3e1c3 tempest-TenantUsagesTestJSON-487734786 tempest-TenantUsagesTestJSON-487734786-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:24.459610 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bf28c484-9d68-4e98-bfe3-186b5fc3e1c3 tempest-TenantUsagesTestJSON-487734786 tempest-TenantUsagesTestJSON-487734786-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:24.460061 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bf28c484-9d68-4e98-bfe3-186b5fc3e1c3 tempest-TenantUsagesTestJSON-487734786 tempest-TenantUsagesTestJSON-487734786-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:24.490065 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-7c7e2d80-0fb3-452e-a6ca-0b7f904ba83e tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:48:24.502915 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-7c7e2d80-0fb3-452e-a6ca-0b7f904ba83e tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/be573c06-25e7-485e-9443-5bc21196a45e" status: 200 len: 1312 microversion: 2.1 time: 0.426443 Oct 04 21:48:24.504199 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 688/1439] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:48:24 2022] GET /compute/v2.1/servers/be573c06-25e7-485e-9443-5bc21196a45e => generated 1312 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:48:24.530943 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-95960073-6905-45af-84da-0f4197ef58b4 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:24.536769 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-bf28c484-9d68-4e98-bfe3-186b5fc3e1c3 tempest-TenantUsagesTestJSON-487734786 tempest-TenantUsagesTestJSON-487734786-project-admin] 10.222.0.43 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-03T21%3A48%3A24.142698&end=2022-10-05T21%3A48%3A24.142698&detailed=1" status: 200 len: 15990 microversion: 2.1 time: 0.120760 Oct 04 21:48:24.538080 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 752/1440] 10.222.0.43 () {58 vars in 1335 bytes} [Tue Oct 4 21:48:24 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-03T21%3A48%3A24.142698&end=2022-10-05T21%3A48%3A24.142698&detailed=1 => generated 15990 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:48:24.543060 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-977fe508-f68f-4aa3-93eb-3f55695c745c tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:24.543898 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-977fe508-f68f-4aa3-93eb-3f55695c745c tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] [instance: 34276621-d087-478b-81c7-bdf5e38efc69] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:48:24.556293 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-977fe508-f68f-4aa3-93eb-3f55695c745c tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:24.557211 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-977fe508-f68f-4aa3-93eb-3f55695c745c tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:24.557368 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-95960073-6905-45af-84da-0f4197ef58b4 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] [instance: 59a1880f-2802-4e72-9a17-b966cfec8fe9] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:48:24.557968 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-977fe508-f68f-4aa3-93eb-3f55695c745c tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:24.558925 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-977fe508-f68f-4aa3-93eb-3f55695c745c tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:24.559547 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-977fe508-f68f-4aa3-93eb-3f55695c745c tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:24.560159 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-977fe508-f68f-4aa3-93eb-3f55695c745c tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:24.568275 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-95960073-6905-45af-84da-0f4197ef58b4 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:24.568789 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-95960073-6905-45af-84da-0f4197ef58b4 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:24.571350 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-95960073-6905-45af-84da-0f4197ef58b4 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:24.572653 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-95960073-6905-45af-84da-0f4197ef58b4 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:24.575801 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-95960073-6905-45af-84da-0f4197ef58b4 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:24.579071 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-95960073-6905-45af-84da-0f4197ef58b4 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:24.585995 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-977fe508-f68f-4aa3-93eb-3f55695c745c tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] HTTP exception thrown: Instance 34276621-d087-478b-81c7-bdf5e38efc69 could not be found. Oct 04 21:48:24.588027 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-977fe508-f68f-4aa3-93eb-3f55695c745c tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Request method failure captured: Oct 04 21:48:24.588027 n-d-860284-1 devstack@n-api.service[134102]: request: GET /compute/v2.1/servers/34276621-d087-478b-81c7-bdf5e38efc69 HTTP/1.1 Oct 04 21:48:24.588027 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 21:48:24.588027 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 21:48:24.588027 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 21:48:24.588027 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 21:48:24.588027 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 21:48:24.588027 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 21:48:24.588027 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 21:48:24.588027 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 21:48:24.588027 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPKkViVLk0wuNp0ZZ7JSvpOoMJojyl_QYUa-NlAgf6yHdl1vGkLKLlguGwJY9TPc2RC1uR3eEXrCXwpM-P6Sw01KADzrHjXb6WAntPYzFM8qRPbOqJbVu0xd-btAX_Lptb-QCqDASM3OEpH2gr1-q7iUMVY3XA8F4NTom5pXJgjN-qCw Oct 04 21:48:24.588027 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 21:48:24.588027 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 21:48:24.588027 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 21:48:24.588027 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 21:48:24.588027 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 21:48:24.588027 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 21:48:24.588027 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: da67fc95e2814f4086df020f4c475764 Oct 04 21:48:24.588027 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1276781908 Oct 04 21:48:24.588027 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 21:48:24.588027 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 21:48:24.589626 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/da67fc95e2814f4086df020f4c475764"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_da67fc95e2814f4086df020f4c475764", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/da67fc95e2814f4086df020f4c475764"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/da67fc95e2814f4086df020f4c475764"}]}] Oct 04 21:48:24.589626 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1276781908 Oct 04 21:48:24.589626 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: da67fc95e2814f4086df020f4c475764 Oct 04 21:48:24.589626 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1276781908 Oct 04 21:48:24.589626 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1276781908-project Oct 04 21:48:24.589626 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 21:48:24.589626 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 21:48:24.589626 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: 1789bb97219a4e1591632126812ea6df Oct 04 21:48:24.589626 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1276781908-project Oct 04 21:48:24.589626 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 21:48:24.589626 n-d-860284-1 devstack@n-api.service[134102]: exception: Instance 34276621-d087-478b-81c7-bdf5e38efc69 could not be found. Oct 04 21:48:24.589626 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': '34276621-d087-478b-81c7-bdf5e38efc69'} Oct 04 21:48:24.590657 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:48:24.590657 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:48:24.590657 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:48:24.590657 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:48:24.590657 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:48:24.590657 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:48:24.590657 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:48:24.590657 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:48:24.590657 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:48:24.590657 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:48:24.590657 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34276621-d087-478b-81c7-bdf5e38efc69 could not be found. Oct 04 21:48:24.590657 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:48:24.590657 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:48:24.590657 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:48:24.590657 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:48:24.590657 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:48:24.590657 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:48:24.590657 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:48:24.590657 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:48:24.590657 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:48:24.592155 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:48:24.592155 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:48:24.592155 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:48:24.592155 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:48:24.592155 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:48:24.592155 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:48:24.592155 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:48:24.592155 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34276621-d087-478b-81c7-bdf5e38efc69 could not be found. Oct 04 21:48:24.592155 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:48:24.592155 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:48:24.592155 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:48:24.592155 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:48:24.592155 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:48:24.592155 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:48:24.592155 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:48:24.592155 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:48:24.592155 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34276621-d087-478b-81c7-bdf5e38efc69 could not be found. Oct 04 21:48:24.592155 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:48:24.593732 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-977fe508-f68f-4aa3-93eb-3f55695c745c tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Returning 404 to user: Instance 34276621-d087-478b-81c7-bdf5e38efc69 could not be found. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:48:24.594334 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-977fe508-f68f-4aa3-93eb-3f55695c745c tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] 10.222.0.43 "GET /compute/v2.1/servers/34276621-d087-478b-81c7-bdf5e38efc69" status: 404 len: 111 microversion: 2.1 time: 0.055009 Oct 04 21:48:24.595070 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 753/1441] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:48:24 2022] GET /compute/v2.1/servers/34276621-d087-478b-81c7-bdf5e38efc69 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:48:24.602215 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-3fd45d5d-40d6-4b94-ae71-95d3f2eefca1 tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:24.603500 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-3fd45d5d-40d6-4b94-ae71-95d3f2eefca1 tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] [instance: 197b66b3-69ef-4b80-9de7-b25ae132dc2e] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:48:24.613090 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3fd45d5d-40d6-4b94-ae71-95d3f2eefca1 tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:24.614551 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3fd45d5d-40d6-4b94-ae71-95d3f2eefca1 tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:24.615072 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3fd45d5d-40d6-4b94-ae71-95d3f2eefca1 tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:24.616273 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3fd45d5d-40d6-4b94-ae71-95d3f2eefca1 tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:24.616884 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3fd45d5d-40d6-4b94-ae71-95d3f2eefca1 tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:24.617704 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3fd45d5d-40d6-4b94-ae71-95d3f2eefca1 tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:24.625083 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-95960073-6905-45af-84da-0f4197ef58b4 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:24.625580 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-95960073-6905-45af-84da-0f4197ef58b4 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:24.626190 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-95960073-6905-45af-84da-0f4197ef58b4 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:24.626667 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.objects.instance [None req-95960073-6905-45af-84da-0f4197ef58b4 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Lazy-loading 'fault' on Instance uuid 59a1880f-2802-4e72-9a17-b966cfec8fe9 {{(pid=134101) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:48:24.648893 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-3fd45d5d-40d6-4b94-ae71-95d3f2eefca1 tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] [instance: 197b66b3-69ef-4b80-9de7-b25ae132dc2e] Going to try to terminate instance {{(pid=134102) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:48:24.674534 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-95960073-6905-45af-84da-0f4197ef58b4 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7614aeaedd1947b88031fb55ca4783ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00081ff1d1aa41cbad345326b337093a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:48:24.687816 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-95960073-6905-45af-84da-0f4197ef58b4 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] 10.222.0.43 "GET /compute/v2.1/servers/59a1880f-2802-4e72-9a17-b966cfec8fe9" status: 200 len: 1306 microversion: 2.1 time: 0.181436 Oct 04 21:48:24.689068 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 689/1442] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:48:24 2022] GET /compute/v2.1/servers/59a1880f-2802-4e72-9a17-b966cfec8fe9 => generated 1306 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:48:24.697685 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-cb50a40c-1561-4e15-85a8-c5bd04444934 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:24.699210 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-cb50a40c-1561-4e15-85a8-c5bd04444934 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] [instance: c7b7e541-aa71-44f6-96fb-07c2e6e08520] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:48:24.709433 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cb50a40c-1561-4e15-85a8-c5bd04444934 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:24.710412 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cb50a40c-1561-4e15-85a8-c5bd04444934 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:24.711203 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cb50a40c-1561-4e15-85a8-c5bd04444934 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:24.712473 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cb50a40c-1561-4e15-85a8-c5bd04444934 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:24.713566 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cb50a40c-1561-4e15-85a8-c5bd04444934 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:24.714533 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cb50a40c-1561-4e15-85a8-c5bd04444934 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:24.732596 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-cb50a40c-1561-4e15-85a8-c5bd04444934 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] HTTP exception thrown: Instance c7b7e541-aa71-44f6-96fb-07c2e6e08520 could not be found. Oct 04 21:48:24.734317 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-cb50a40c-1561-4e15-85a8-c5bd04444934 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Request method failure captured: Oct 04 21:48:24.734317 n-d-860284-1 devstack@n-api.service[134101]: request: DELETE /compute/v2.1/servers/c7b7e541-aa71-44f6-96fb-07c2e6e08520 HTTP/1.1 Oct 04 21:48:24.734317 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 21:48:24.734317 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 21:48:24.734317 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 21:48:24.734317 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 21:48:24.734317 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 21:48:24.734317 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 21:48:24.734317 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 21:48:24.734317 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 21:48:24.734317 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPKkViVLk0wuNp0ZZ7JSvpOoMJojyl_QYUa-NlAgf6yHdl1vGkLKLlguGwJY9TPc2RC1uR3eEXrCXwpM-P6Sw01KADzrHjXb6WAntPYzFM8qRPbOqJbVu0xd-btAX_Lptb-QCqDASM3OEpH2gr1-q7iUMVY3XA8F4NTom5pXJgjN-qCw Oct 04 21:48:24.734317 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 21:48:24.734317 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 21:48:24.734317 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 21:48:24.734317 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 21:48:24.734317 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 21:48:24.734317 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 21:48:24.734317 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: da67fc95e2814f4086df020f4c475764 Oct 04 21:48:24.734317 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1276781908 Oct 04 21:48:24.734317 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 21:48:24.734317 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 21:48:24.735934 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/da67fc95e2814f4086df020f4c475764"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_da67fc95e2814f4086df020f4c475764", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/da67fc95e2814f4086df020f4c475764"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/da67fc95e2814f4086df020f4c475764"}]}] Oct 04 21:48:24.735934 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1276781908 Oct 04 21:48:24.735934 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: da67fc95e2814f4086df020f4c475764 Oct 04 21:48:24.735934 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1276781908 Oct 04 21:48:24.735934 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1276781908-project Oct 04 21:48:24.735934 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 21:48:24.735934 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 21:48:24.735934 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 1789bb97219a4e1591632126812ea6df Oct 04 21:48:24.735934 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1276781908-project Oct 04 21:48:24.735934 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 21:48:24.735934 n-d-860284-1 devstack@n-api.service[134101]: exception: Instance c7b7e541-aa71-44f6-96fb-07c2e6e08520 could not be found. Oct 04 21:48:24.735934 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': 'c7b7e541-aa71-44f6-96fb-07c2e6e08520'} Oct 04 21:48:24.736747 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:48:24.736747 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:48:24.736747 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:48:24.736747 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:48:24.736747 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:48:24.736747 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:48:24.736747 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:48:24.736747 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:48:24.736747 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:48:24.736747 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:48:24.736747 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7b7e541-aa71-44f6-96fb-07c2e6e08520 could not be found. Oct 04 21:48:24.736747 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:48:24.736747 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:48:24.736747 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:48:24.736747 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:48:24.736747 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:48:24.736747 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:48:24.736747 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:48:24.736747 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:48:24.736747 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:48:24.738064 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:48:24.738064 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 21:48:24.738064 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 21:48:24.738064 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 21:48:24.738064 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 21:48:24.738064 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:48:24.738064 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:48:24.738064 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:48:24.738064 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:48:24.738064 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7b7e541-aa71-44f6-96fb-07c2e6e08520 could not be found. Oct 04 21:48:24.738064 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:48:24.738064 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:48:24.738064 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:48:24.738064 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:48:24.738064 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:48:24.738064 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:48:24.738064 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:48:24.738064 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:48:24.738064 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7b7e541-aa71-44f6-96fb-07c2e6e08520 could not be found. Oct 04 21:48:24.738064 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:48:24.740755 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-cb50a40c-1561-4e15-85a8-c5bd04444934 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Returning 404 to user: Instance c7b7e541-aa71-44f6-96fb-07c2e6e08520 could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:48:24.740755 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-cb50a40c-1561-4e15-85a8-c5bd04444934 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] 10.222.0.43 "DELETE /compute/v2.1/servers/c7b7e541-aa71-44f6-96fb-07c2e6e08520" status: 404 len: 111 microversion: 2.1 time: 0.045525 Oct 04 21:48:24.740755 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 690/1443] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 21:48:24 2022] DELETE /compute/v2.1/servers/c7b7e541-aa71-44f6-96fb-07c2e6e08520 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:48:24.745713 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-1cd90321-d205-4b5c-b55b-3733c998d750 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:24.746395 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-1cd90321-d205-4b5c-b55b-3733c998d750 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] [instance: c7b7e541-aa71-44f6-96fb-07c2e6e08520] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:48:24.747047 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-3fd45d5d-40d6-4b94-ae71-95d3f2eefca1 tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] 10.222.0.43 "DELETE /compute/v2.1/servers/197b66b3-69ef-4b80-9de7-b25ae132dc2e" status: 204 len: 0 microversion: 2.1 time: 0.149989 Oct 04 21:48:24.747749 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 754/1444] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 21:48:24 2022] DELETE /compute/v2.1/servers/197b66b3-69ef-4b80-9de7-b25ae132dc2e => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:48:24.755294 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1cd90321-d205-4b5c-b55b-3733c998d750 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:24.756307 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1cd90321-d205-4b5c-b55b-3733c998d750 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:24.756795 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1cd90321-d205-4b5c-b55b-3733c998d750 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:24.757448 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1cd90321-d205-4b5c-b55b-3733c998d750 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:24.757914 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1cd90321-d205-4b5c-b55b-3733c998d750 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:24.758031 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-c7b7146e-5766-4fb3-a403-c21262dabc0c tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:24.758585 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1cd90321-d205-4b5c-b55b-3733c998d750 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:24.758905 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-c7b7146e-5766-4fb3-a403-c21262dabc0c tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] [instance: 197b66b3-69ef-4b80-9de7-b25ae132dc2e] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:48:24.765598 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c7b7146e-5766-4fb3-a403-c21262dabc0c tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:24.766192 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c7b7146e-5766-4fb3-a403-c21262dabc0c tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:24.766751 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c7b7146e-5766-4fb3-a403-c21262dabc0c tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:24.767586 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c7b7146e-5766-4fb3-a403-c21262dabc0c tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:24.768126 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c7b7146e-5766-4fb3-a403-c21262dabc0c tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:24.768629 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c7b7146e-5766-4fb3-a403-c21262dabc0c tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:24.777500 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-1cd90321-d205-4b5c-b55b-3733c998d750 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] HTTP exception thrown: Instance c7b7e541-aa71-44f6-96fb-07c2e6e08520 could not be found. Oct 04 21:48:24.779279 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-1cd90321-d205-4b5c-b55b-3733c998d750 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Request method failure captured: Oct 04 21:48:24.779279 n-d-860284-1 devstack@n-api.service[134101]: request: GET /compute/v2.1/servers/c7b7e541-aa71-44f6-96fb-07c2e6e08520 HTTP/1.1 Oct 04 21:48:24.779279 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 21:48:24.779279 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 21:48:24.779279 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 21:48:24.779279 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 21:48:24.779279 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 21:48:24.779279 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 21:48:24.779279 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 21:48:24.779279 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 21:48:24.779279 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPKkViVLk0wuNp0ZZ7JSvpOoMJojyl_QYUa-NlAgf6yHdl1vGkLKLlguGwJY9TPc2RC1uR3eEXrCXwpM-P6Sw01KADzrHjXb6WAntPYzFM8qRPbOqJbVu0xd-btAX_Lptb-QCqDASM3OEpH2gr1-q7iUMVY3XA8F4NTom5pXJgjN-qCw Oct 04 21:48:24.779279 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 21:48:24.779279 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 21:48:24.779279 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 21:48:24.779279 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 21:48:24.779279 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 21:48:24.779279 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 21:48:24.779279 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: da67fc95e2814f4086df020f4c475764 Oct 04 21:48:24.779279 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1276781908 Oct 04 21:48:24.779279 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 21:48:24.779279 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 21:48:24.780847 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/da67fc95e2814f4086df020f4c475764"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_da67fc95e2814f4086df020f4c475764", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/da67fc95e2814f4086df020f4c475764"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/da67fc95e2814f4086df020f4c475764"}]}] Oct 04 21:48:24.780847 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1276781908 Oct 04 21:48:24.780847 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: da67fc95e2814f4086df020f4c475764 Oct 04 21:48:24.780847 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1276781908 Oct 04 21:48:24.780847 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1276781908-project Oct 04 21:48:24.780847 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 21:48:24.780847 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 21:48:24.780847 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 1789bb97219a4e1591632126812ea6df Oct 04 21:48:24.780847 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1276781908-project Oct 04 21:48:24.780847 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 21:48:24.780847 n-d-860284-1 devstack@n-api.service[134101]: exception: Instance c7b7e541-aa71-44f6-96fb-07c2e6e08520 could not be found. Oct 04 21:48:24.780847 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': 'c7b7e541-aa71-44f6-96fb-07c2e6e08520'} Oct 04 21:48:24.782117 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:48:24.782117 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:48:24.782117 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:48:24.782117 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:48:24.782117 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:48:24.782117 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:48:24.782117 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:48:24.782117 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:48:24.782117 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:48:24.782117 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:48:24.782117 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7b7e541-aa71-44f6-96fb-07c2e6e08520 could not be found. Oct 04 21:48:24.782117 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:48:24.782117 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:48:24.782117 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:48:24.782117 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:48:24.782117 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:48:24.782117 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:48:24.782117 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:48:24.782117 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:48:24.782117 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:48:24.783597 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:48:24.783597 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:48:24.783597 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:48:24.783597 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:48:24.783597 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:48:24.783597 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:48:24.783597 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:48:24.783597 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7b7e541-aa71-44f6-96fb-07c2e6e08520 could not be found. Oct 04 21:48:24.783597 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:48:24.783597 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:48:24.783597 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:48:24.783597 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:48:24.783597 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:48:24.783597 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:48:24.783597 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:48:24.783597 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:48:24.783597 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7b7e541-aa71-44f6-96fb-07c2e6e08520 could not be found. Oct 04 21:48:24.783597 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:48:24.785136 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-1cd90321-d205-4b5c-b55b-3733c998d750 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Returning 404 to user: Instance c7b7e541-aa71-44f6-96fb-07c2e6e08520 could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:48:24.785136 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-1cd90321-d205-4b5c-b55b-3733c998d750 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] 10.222.0.43 "GET /compute/v2.1/servers/c7b7e541-aa71-44f6-96fb-07c2e6e08520" status: 404 len: 111 microversion: 2.1 time: 0.039602 Oct 04 21:48:24.785311 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 691/1445] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:48:24 2022] GET /compute/v2.1/servers/c7b7e541-aa71-44f6-96fb-07c2e6e08520 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:48:24.790356 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-9ebf55ec-069d-4411-913a-78c272b343eb tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Calling method '.version_select at 0x7fbb2ee999d0>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:24.810576 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-9ebf55ec-069d-4411-913a-78c272b343eb tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1617998943" status: 202 len: 0 microversion: 2.1 time: 0.024051 Oct 04 21:48:24.811042 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 692/1446] 10.222.0.43 () {58 vars in 1221 bytes} [Tue Oct 4 21:48:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1617998943 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:48:25.014729 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-d8ef48d4-0ed9-4b60-bd23-edbd59f6519f tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:25.015649 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-d8ef48d4-0ed9-4b60-bd23-edbd59f6519f tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] [instance: e3380b36-6aba-4736-bcbc-f0058f806d55] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:48:25.016049 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-c7b7146e-5766-4fb3-a403-c21262dabc0c tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7e992115ea4ba58205d3da003ec625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5345566eeb4a5f88d31f733eaa04bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:48:25.024219 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d8ef48d4-0ed9-4b60-bd23-edbd59f6519f tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:25.025014 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d8ef48d4-0ed9-4b60-bd23-edbd59f6519f tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:25.025709 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d8ef48d4-0ed9-4b60-bd23-edbd59f6519f tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:25.027753 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:48:25.028275 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d8ef48d4-0ed9-4b60-bd23-edbd59f6519f tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:25.028899 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d8ef48d4-0ed9-4b60-bd23-edbd59f6519f tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:25.029481 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d8ef48d4-0ed9-4b60-bd23-edbd59f6519f tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:25.044278 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-c7b7146e-5766-4fb3-a403-c21262dabc0c tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] 10.222.0.43 "GET /compute/v2.1/servers/197b66b3-69ef-4b80-9de7-b25ae132dc2e" status: 200 len: 1470 microversion: 2.1 time: 0.291540 Oct 04 21:48:25.062942 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 755/1447] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:48:24 2022] GET /compute/v2.1/servers/197b66b3-69ef-4b80-9de7-b25ae132dc2e => generated 1470 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:48:25.095794 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d8ef48d4-0ed9-4b60-bd23-edbd59f6519f tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:25.096592 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d8ef48d4-0ed9-4b60-bd23-edbd59f6519f tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:25.097269 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d8ef48d4-0ed9-4b60-bd23-edbd59f6519f tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:25.097872 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.objects.instance [None req-d8ef48d4-0ed9-4b60-bd23-edbd59f6519f tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lazy-loading 'fault' on Instance uuid e3380b36-6aba-4736-bcbc-f0058f806d55 {{(pid=134101) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:48:25.116064 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-16ba3577-009a-4465-84ab-e3f3cb56feeb req-709d39db-ba12-4203-ae95-8d02689c0994 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3380b36-6aba-4736-bcbc-f0058f806d55", "name": "network-vif-deleted", "tag": "b25814f1-d2d0-4853-bfa4-3948c24c40e5"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:48:25.140464 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-16ba3577-009a-4465-84ab-e3f3cb56feeb req-709d39db-ba12-4203-ae95-8d02689c0994 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:25.141630 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-16ba3577-009a-4465-84ab-e3f3cb56feeb req-709d39db-ba12-4203-ae95-8d02689c0994 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:25.142080 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-16ba3577-009a-4465-84ab-e3f3cb56feeb req-709d39db-ba12-4203-ae95-8d02689c0994 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:25.159611 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-16ba3577-009a-4465-84ab-e3f3cb56feeb req-709d39db-ba12-4203-ae95-8d02689c0994 service nova] Creating event network-vif-deleted:b25814f1-d2d0-4853-bfa4-3948c24c40e5 for instance e3380b36-6aba-4736-bcbc-f0058f806d55 on n-h2-860284-1 Oct 04 21:48:25.165054 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-16ba3577-009a-4465-84ab-e3f3cb56feeb req-709d39db-ba12-4203-ae95-8d02689c0994 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054755 Oct 04 21:48:25.166069 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 756/1448] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:48:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:48:25.183196 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-d8ef48d4-0ed9-4b60-bd23-edbd59f6519f tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87616cd16995468ab7febf5aa4b284db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e3bf9149434d34b6762aaeef1478ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:48:25.191411 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-d8ef48d4-0ed9-4b60-bd23-edbd59f6519f tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] 10.222.0.43 "GET /compute/v2.1/servers/e3380b36-6aba-4736-bcbc-f0058f806d55" status: 200 len: 1304 microversion: 2.1 time: 0.180580 Oct 04 21:48:25.192030 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 693/1449] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:48:25 2022] GET /compute/v2.1/servers/e3380b36-6aba-4736-bcbc-f0058f806d55 => generated 1304 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:48:25.532197 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-4d13e8d9-e6fd-4c62-988d-c148e1e3747d tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:25.532911 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-4d13e8d9-e6fd-4c62-988d-c148e1e3747d tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: be573c06-25e7-485e-9443-5bc21196a45e] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:48:25.540549 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4d13e8d9-e6fd-4c62-988d-c148e1e3747d tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:25.541070 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4d13e8d9-e6fd-4c62-988d-c148e1e3747d tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:25.541506 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4d13e8d9-e6fd-4c62-988d-c148e1e3747d tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:25.542291 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4d13e8d9-e6fd-4c62-988d-c148e1e3747d tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:25.542818 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4d13e8d9-e6fd-4c62-988d-c148e1e3747d tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:25.543275 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4d13e8d9-e6fd-4c62-988d-c148e1e3747d tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:25.553569 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-7e997919-bd5c-4612-a92b-506461c10c45 tempest-ServersWithSpecificFlavorTestJSON-535050999 tempest-ServersWithSpecificFlavorTestJSON-535050999-project-admin] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:25.573669 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-7e997919-bd5c-4612-a92b-506461c10c45 tempest-ServersWithSpecificFlavorTestJSON-535050999 tempest-ServersWithSpecificFlavorTestJSON-535050999-project-admin] 10.222.0.43 "DELETE /compute/v2.1/flavors/1135919845" status: 202 len: 0 microversion: 2.1 time: 0.024661 Oct 04 21:48:25.574379 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 694/1450] 10.222.0.43 () {58 vars in 1161 bytes} [Tue Oct 4 21:48:25 2022] DELETE /compute/v2.1/flavors/1135919845 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 21:48:25.583059 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-82950b00-97b9-4d36-8e5b-b847fd3fd4b1 tempest-ServersWithSpecificFlavorTestJSON-535050999 tempest-ServersWithSpecificFlavorTestJSON-535050999-project-admin] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:25.589738 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=3,nova_api:DELETE=4 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:48:25.606280 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-82950b00-97b9-4d36-8e5b-b847fd3fd4b1 tempest-ServersWithSpecificFlavorTestJSON-535050999 tempest-ServersWithSpecificFlavorTestJSON-535050999-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 5406 microversion: 2.1 time: 0.027073 Oct 04 21:48:25.606924 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 695/1451] 10.222.0.43 () {58 vars in 1146 bytes} [Tue Oct 4 21:48:25 2022] GET /compute/v2.1/flavors/detail => generated 5406 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:48:25.627439 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-b4a99c9d-2906-4fca-9630-a0aca1c773af tempest-ServersWithSpecificFlavorTestJSON-535050999 tempest-ServersWithSpecificFlavorTestJSON-535050999-project-admin] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:25.647237 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-b4a99c9d-2906-4fca-9630-a0aca1c773af tempest-ServersWithSpecificFlavorTestJSON-535050999 tempest-ServersWithSpecificFlavorTestJSON-535050999-project-admin] 10.222.0.43 "DELETE /compute/v2.1/flavors/1684035327" status: 202 len: 0 microversion: 2.1 time: 0.024772 Oct 04 21:48:25.647971 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 696/1452] 10.222.0.43 () {58 vars in 1161 bytes} [Tue Oct 4 21:48:25 2022] DELETE /compute/v2.1/flavors/1684035327 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:48:25.657588 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-15d4344b-491a-41c6-92d2-13bd69675480 tempest-ServersWithSpecificFlavorTestJSON-535050999 tempest-ServersWithSpecificFlavorTestJSON-535050999-project-admin] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:25.679351 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-15d4344b-491a-41c6-92d2-13bd69675480 tempest-ServersWithSpecificFlavorTestJSON-535050999 tempest-ServersWithSpecificFlavorTestJSON-535050999-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.025465 Oct 04 21:48:25.680230 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 697/1453] 10.222.0.43 () {58 vars in 1146 bytes} [Tue Oct 4 21:48:25 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:48:25.705510 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-4d13e8d9-e6fd-4c62-988d-c148e1e3747d tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:48:25.706886 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-bc55452f-ceff-4b11-b9d2-9d75e4db639d tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:25.707705 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-bc55452f-ceff-4b11-b9d2-9d75e4db639d tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] [instance: 34276621-d087-478b-81c7-bdf5e38efc69] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:48:25.712376 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-4d13e8d9-e6fd-4c62-988d-c148e1e3747d tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/be573c06-25e7-485e-9443-5bc21196a45e" status: 200 len: 1462 microversion: 2.1 time: 0.185071 Oct 04 21:48:25.712984 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 757/1454] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:48:25 2022] GET /compute/v2.1/servers/be573c06-25e7-485e-9443-5bc21196a45e => generated 1462 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:48:25.717606 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-1c60bf89-958e-404b-8995-3d55d9274f65 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:25.718227 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-1c60bf89-958e-404b-8995-3d55d9274f65 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] [instance: 59a1880f-2802-4e72-9a17-b966cfec8fe9] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:48:25.724408 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1c60bf89-958e-404b-8995-3d55d9274f65 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:25.724897 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1c60bf89-958e-404b-8995-3d55d9274f65 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:25.725231 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bc55452f-ceff-4b11-b9d2-9d75e4db639d tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:25.725378 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1c60bf89-958e-404b-8995-3d55d9274f65 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:25.726040 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bc55452f-ceff-4b11-b9d2-9d75e4db639d tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:25.726160 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1c60bf89-958e-404b-8995-3d55d9274f65 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:25.726562 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1c60bf89-958e-404b-8995-3d55d9274f65 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:25.726684 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bc55452f-ceff-4b11-b9d2-9d75e4db639d tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:25.726998 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1c60bf89-958e-404b-8995-3d55d9274f65 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:25.727660 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bc55452f-ceff-4b11-b9d2-9d75e4db639d tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:25.728458 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bc55452f-ceff-4b11-b9d2-9d75e4db639d tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:25.729076 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bc55452f-ceff-4b11-b9d2-9d75e4db639d tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:25.746396 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-bc55452f-ceff-4b11-b9d2-9d75e4db639d tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] HTTP exception thrown: Instance 34276621-d087-478b-81c7-bdf5e38efc69 could not be found. Oct 04 21:48:25.748000 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-bc55452f-ceff-4b11-b9d2-9d75e4db639d tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Request method failure captured: Oct 04 21:48:25.748000 n-d-860284-1 devstack@n-api.service[134101]: request: DELETE /compute/v2.1/servers/34276621-d087-478b-81c7-bdf5e38efc69 HTTP/1.1 Oct 04 21:48:25.748000 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 21:48:25.748000 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 21:48:25.748000 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 21:48:25.748000 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 21:48:25.748000 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 21:48:25.748000 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 21:48:25.748000 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 21:48:25.748000 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 21:48:25.748000 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPKkViVLk0wuNp0ZZ7JSvpOoMJojyl_QYUa-NlAgf6yHdl1vGkLKLlguGwJY9TPc2RC1uR3eEXrCXwpM-P6Sw01KADzrHjXb6WAntPYzFM8qRPbOqJbVu0xd-btAX_Lptb-QCqDASM3OEpH2gr1-q7iUMVY3XA8F4NTom5pXJgjN-qCw Oct 04 21:48:25.748000 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 21:48:25.748000 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 21:48:25.748000 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 21:48:25.748000 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 21:48:25.748000 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 21:48:25.748000 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 21:48:25.748000 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: da67fc95e2814f4086df020f4c475764 Oct 04 21:48:25.748000 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1276781908 Oct 04 21:48:25.748000 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 21:48:25.748000 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 21:48:25.749566 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/da67fc95e2814f4086df020f4c475764"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_da67fc95e2814f4086df020f4c475764", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/da67fc95e2814f4086df020f4c475764"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/da67fc95e2814f4086df020f4c475764"}]}] Oct 04 21:48:25.749566 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1276781908 Oct 04 21:48:25.749566 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: da67fc95e2814f4086df020f4c475764 Oct 04 21:48:25.749566 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1276781908 Oct 04 21:48:25.749566 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1276781908-project Oct 04 21:48:25.749566 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 21:48:25.749566 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 21:48:25.749566 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 1789bb97219a4e1591632126812ea6df Oct 04 21:48:25.749566 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1276781908-project Oct 04 21:48:25.749566 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 21:48:25.749566 n-d-860284-1 devstack@n-api.service[134101]: exception: Instance 34276621-d087-478b-81c7-bdf5e38efc69 could not be found. Oct 04 21:48:25.749566 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': '34276621-d087-478b-81c7-bdf5e38efc69'} Oct 04 21:48:25.753609 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:48:25.753609 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:48:25.753609 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:48:25.753609 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:48:25.753609 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:48:25.753609 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:48:25.753609 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:48:25.753609 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:48:25.753609 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:48:25.753609 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:48:25.753609 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34276621-d087-478b-81c7-bdf5e38efc69 could not be found. Oct 04 21:48:25.753609 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:48:25.753609 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:48:25.753609 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:48:25.753609 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:48:25.753609 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:48:25.753609 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:48:25.753609 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:48:25.753609 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:48:25.753609 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:48:25.755791 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:48:25.755791 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 21:48:25.755791 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 21:48:25.755791 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 21:48:25.755791 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 21:48:25.755791 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:48:25.755791 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:48:25.755791 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:48:25.755791 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:48:25.755791 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34276621-d087-478b-81c7-bdf5e38efc69 could not be found. Oct 04 21:48:25.755791 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:48:25.755791 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:48:25.755791 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:48:25.755791 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:48:25.755791 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:48:25.755791 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:48:25.755791 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:48:25.755791 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:48:25.755791 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34276621-d087-478b-81c7-bdf5e38efc69 could not be found. Oct 04 21:48:25.755791 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:48:25.757255 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-bc55452f-ceff-4b11-b9d2-9d75e4db639d tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Returning 404 to user: Instance 34276621-d087-478b-81c7-bdf5e38efc69 could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:48:25.757255 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-bc55452f-ceff-4b11-b9d2-9d75e4db639d tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] 10.222.0.43 "DELETE /compute/v2.1/servers/34276621-d087-478b-81c7-bdf5e38efc69" status: 404 len: 111 microversion: 2.1 time: 0.046745 Oct 04 21:48:25.757255 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 698/1455] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 21:48:25 2022] DELETE /compute/v2.1/servers/34276621-d087-478b-81c7-bdf5e38efc69 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:48:25.757255 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-efd37ce5-15fb-490a-a240-c5d7762c2b08 tempest-MigrationsAdminTest-1218821219 tempest-MigrationsAdminTest-1218821219-project-admin] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:25.757255 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-efd37ce5-15fb-490a-a240-c5d7762c2b08 tempest-MigrationsAdminTest-1218821219 tempest-MigrationsAdminTest-1218821219-project-admin] [instance: be573c06-25e7-485e-9443-5bc21196a45e] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:48:25.761904 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1c60bf89-958e-404b-8995-3d55d9274f65 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:25.762303 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-efd37ce5-15fb-490a-a240-c5d7762c2b08 tempest-MigrationsAdminTest-1218821219 tempest-MigrationsAdminTest-1218821219-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:25.762575 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1c60bf89-958e-404b-8995-3d55d9274f65 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:25.762842 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-efd37ce5-15fb-490a-a240-c5d7762c2b08 tempest-MigrationsAdminTest-1218821219 tempest-MigrationsAdminTest-1218821219-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:25.762938 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1c60bf89-958e-404b-8995-3d55d9274f65 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:25.763319 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-efd37ce5-15fb-490a-a240-c5d7762c2b08 tempest-MigrationsAdminTest-1218821219 tempest-MigrationsAdminTest-1218821219-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:25.763451 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.objects.instance [None req-1c60bf89-958e-404b-8995-3d55d9274f65 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Lazy-loading 'fault' on Instance uuid 59a1880f-2802-4e72-9a17-b966cfec8fe9 {{(pid=134102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:48:25.764004 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-efd37ce5-15fb-490a-a240-c5d7762c2b08 tempest-MigrationsAdminTest-1218821219 tempest-MigrationsAdminTest-1218821219-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:25.764469 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-efd37ce5-15fb-490a-a240-c5d7762c2b08 tempest-MigrationsAdminTest-1218821219 tempest-MigrationsAdminTest-1218821219-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:25.764906 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-efd37ce5-15fb-490a-a240-c5d7762c2b08 tempest-MigrationsAdminTest-1218821219 tempest-MigrationsAdminTest-1218821219-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:25.814464 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-1c60bf89-958e-404b-8995-3d55d9274f65 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7614aeaedd1947b88031fb55ca4783ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00081ff1d1aa41cbad345326b337093a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:48:25.823511 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-1c60bf89-958e-404b-8995-3d55d9274f65 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] 10.222.0.43 "GET /compute/v2.1/servers/59a1880f-2802-4e72-9a17-b966cfec8fe9" status: 200 len: 1306 microversion: 2.1 time: 0.109438 Oct 04 21:48:25.824113 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 758/1456] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:48:25 2022] GET /compute/v2.1/servers/59a1880f-2802-4e72-9a17-b966cfec8fe9 => generated 1306 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:48:25.828939 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-2f152d70-92b2-482d-9ca8-7df8b4d1fd7a tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:25.829530 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-2f152d70-92b2-482d-9ca8-7df8b4d1fd7a tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] [instance: 34276621-d087-478b-81c7-bdf5e38efc69] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:48:25.837460 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2f152d70-92b2-482d-9ca8-7df8b4d1fd7a tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:25.837974 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2f152d70-92b2-482d-9ca8-7df8b4d1fd7a tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:25.838943 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2f152d70-92b2-482d-9ca8-7df8b4d1fd7a tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:25.839228 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2f152d70-92b2-482d-9ca8-7df8b4d1fd7a tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:25.839681 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2f152d70-92b2-482d-9ca8-7df8b4d1fd7a tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:25.840113 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2f152d70-92b2-482d-9ca8-7df8b4d1fd7a tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:25.856231 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-2f152d70-92b2-482d-9ca8-7df8b4d1fd7a tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] HTTP exception thrown: Instance 34276621-d087-478b-81c7-bdf5e38efc69 could not be found. Oct 04 21:48:25.857916 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-2f152d70-92b2-482d-9ca8-7df8b4d1fd7a tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Request method failure captured: Oct 04 21:48:25.857916 n-d-860284-1 devstack@n-api.service[134102]: request: GET /compute/v2.1/servers/34276621-d087-478b-81c7-bdf5e38efc69 HTTP/1.1 Oct 04 21:48:25.857916 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 21:48:25.857916 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 21:48:25.857916 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 21:48:25.857916 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 21:48:25.857916 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 21:48:25.857916 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 21:48:25.857916 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 21:48:25.857916 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 21:48:25.857916 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPKkViVLk0wuNp0ZZ7JSvpOoMJojyl_QYUa-NlAgf6yHdl1vGkLKLlguGwJY9TPc2RC1uR3eEXrCXwpM-P6Sw01KADzrHjXb6WAntPYzFM8qRPbOqJbVu0xd-btAX_Lptb-QCqDASM3OEpH2gr1-q7iUMVY3XA8F4NTom5pXJgjN-qCw Oct 04 21:48:25.857916 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 21:48:25.857916 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 21:48:25.857916 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 21:48:25.857916 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 21:48:25.857916 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 21:48:25.857916 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 21:48:25.857916 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: da67fc95e2814f4086df020f4c475764 Oct 04 21:48:25.857916 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1276781908 Oct 04 21:48:25.857916 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 21:48:25.857916 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 21:48:25.859600 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/da67fc95e2814f4086df020f4c475764"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_da67fc95e2814f4086df020f4c475764", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/da67fc95e2814f4086df020f4c475764"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/da67fc95e2814f4086df020f4c475764"}]}] Oct 04 21:48:25.859600 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1276781908 Oct 04 21:48:25.859600 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: da67fc95e2814f4086df020f4c475764 Oct 04 21:48:25.859600 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1276781908 Oct 04 21:48:25.859600 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1276781908-project Oct 04 21:48:25.859600 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 21:48:25.859600 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 21:48:25.859600 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: 1789bb97219a4e1591632126812ea6df Oct 04 21:48:25.859600 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1276781908-project Oct 04 21:48:25.859600 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 21:48:25.859600 n-d-860284-1 devstack@n-api.service[134102]: exception: Instance 34276621-d087-478b-81c7-bdf5e38efc69 could not be found. Oct 04 21:48:25.859600 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': '34276621-d087-478b-81c7-bdf5e38efc69'} Oct 04 21:48:25.860401 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:48:25.860401 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:48:25.860401 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:48:25.860401 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:48:25.860401 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:48:25.860401 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:48:25.860401 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:48:25.860401 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:48:25.860401 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:48:25.860401 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:48:25.860401 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34276621-d087-478b-81c7-bdf5e38efc69 could not be found. Oct 04 21:48:25.860401 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:48:25.860401 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:48:25.860401 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:48:25.860401 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:48:25.860401 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:48:25.860401 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:48:25.860401 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:48:25.860401 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:48:25.860401 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:48:25.861588 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:48:25.861588 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:48:25.861588 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:48:25.861588 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:48:25.861588 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:48:25.861588 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:48:25.861588 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:48:25.861588 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34276621-d087-478b-81c7-bdf5e38efc69 could not be found. Oct 04 21:48:25.861588 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:48:25.861588 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:48:25.861588 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:48:25.861588 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:48:25.861588 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:48:25.861588 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:48:25.861588 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:48:25.861588 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:48:25.861588 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34276621-d087-478b-81c7-bdf5e38efc69 could not be found. Oct 04 21:48:25.861588 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:48:25.862685 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-2f152d70-92b2-482d-9ca8-7df8b4d1fd7a tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Returning 404 to user: Instance 34276621-d087-478b-81c7-bdf5e38efc69 could not be found. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:48:25.862685 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-2f152d70-92b2-482d-9ca8-7df8b4d1fd7a tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] 10.222.0.43 "GET /compute/v2.1/servers/34276621-d087-478b-81c7-bdf5e38efc69" status: 404 len: 111 microversion: 2.1 time: 0.034323 Oct 04 21:48:25.862685 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 759/1457] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:48:25 2022] GET /compute/v2.1/servers/34276621-d087-478b-81c7-bdf5e38efc69 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:48:25.869654 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-d779aaeb-fcfd-4c49-809e-9b9e7b1c13fc tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:25.870326 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-d779aaeb-fcfd-4c49-809e-9b9e7b1c13fc tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] [instance: c7b7e541-aa71-44f6-96fb-07c2e6e08520] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:48:25.873917 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:48:25.880555 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d779aaeb-fcfd-4c49-809e-9b9e7b1c13fc tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:25.881116 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d779aaeb-fcfd-4c49-809e-9b9e7b1c13fc tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:25.881760 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d779aaeb-fcfd-4c49-809e-9b9e7b1c13fc tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:25.882629 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d779aaeb-fcfd-4c49-809e-9b9e7b1c13fc tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:25.883131 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d779aaeb-fcfd-4c49-809e-9b9e7b1c13fc tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:25.883599 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d779aaeb-fcfd-4c49-809e-9b9e7b1c13fc tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:25.899644 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-d779aaeb-fcfd-4c49-809e-9b9e7b1c13fc tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] HTTP exception thrown: Instance c7b7e541-aa71-44f6-96fb-07c2e6e08520 could not be found. Oct 04 21:48:25.901249 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-d779aaeb-fcfd-4c49-809e-9b9e7b1c13fc tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Request method failure captured: Oct 04 21:48:25.901249 n-d-860284-1 devstack@n-api.service[134102]: request: DELETE /compute/v2.1/servers/c7b7e541-aa71-44f6-96fb-07c2e6e08520 HTTP/1.1 Oct 04 21:48:25.901249 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 21:48:25.901249 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 21:48:25.901249 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 21:48:25.901249 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 21:48:25.901249 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 21:48:25.901249 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 21:48:25.901249 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 21:48:25.901249 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 21:48:25.901249 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPKkViVLk0wuNp0ZZ7JSvpOoMJojyl_QYUa-NlAgf6yHdl1vGkLKLlguGwJY9TPc2RC1uR3eEXrCXwpM-P6Sw01KADzrHjXb6WAntPYzFM8qRPbOqJbVu0xd-btAX_Lptb-QCqDASM3OEpH2gr1-q7iUMVY3XA8F4NTom5pXJgjN-qCw Oct 04 21:48:25.901249 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 21:48:25.901249 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 21:48:25.901249 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 21:48:25.901249 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 21:48:25.901249 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 21:48:25.901249 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 21:48:25.901249 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: da67fc95e2814f4086df020f4c475764 Oct 04 21:48:25.901249 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1276781908 Oct 04 21:48:25.901249 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 21:48:25.901249 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 21:48:25.904114 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/da67fc95e2814f4086df020f4c475764"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_da67fc95e2814f4086df020f4c475764", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/da67fc95e2814f4086df020f4c475764"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/da67fc95e2814f4086df020f4c475764"}]}] Oct 04 21:48:25.904114 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1276781908 Oct 04 21:48:25.904114 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: da67fc95e2814f4086df020f4c475764 Oct 04 21:48:25.904114 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1276781908 Oct 04 21:48:25.904114 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1276781908-project Oct 04 21:48:25.904114 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 21:48:25.904114 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 21:48:25.904114 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: 1789bb97219a4e1591632126812ea6df Oct 04 21:48:25.904114 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1276781908-project Oct 04 21:48:25.904114 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 21:48:25.904114 n-d-860284-1 devstack@n-api.service[134102]: exception: Instance c7b7e541-aa71-44f6-96fb-07c2e6e08520 could not be found. Oct 04 21:48:25.904114 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': 'c7b7e541-aa71-44f6-96fb-07c2e6e08520'} Oct 04 21:48:25.905607 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:48:25.905607 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:48:25.905607 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:48:25.905607 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:48:25.905607 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:48:25.905607 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:48:25.905607 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:48:25.905607 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:48:25.905607 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:48:25.905607 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:48:25.905607 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7b7e541-aa71-44f6-96fb-07c2e6e08520 could not be found. Oct 04 21:48:25.905607 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:48:25.905607 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:48:25.905607 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:48:25.905607 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:48:25.905607 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:48:25.905607 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:48:25.905607 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:48:25.905607 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:48:25.905607 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:48:25.908398 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:48:25.908398 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 21:48:25.908398 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 21:48:25.908398 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 21:48:25.908398 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 21:48:25.908398 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:48:25.908398 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:48:25.908398 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:48:25.908398 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:48:25.908398 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7b7e541-aa71-44f6-96fb-07c2e6e08520 could not be found. Oct 04 21:48:25.908398 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:48:25.908398 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:48:25.908398 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:48:25.908398 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:48:25.908398 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:48:25.908398 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:48:25.908398 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:48:25.908398 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:48:25.908398 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7b7e541-aa71-44f6-96fb-07c2e6e08520 could not be found. Oct 04 21:48:25.908398 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:48:25.911070 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-d779aaeb-fcfd-4c49-809e-9b9e7b1c13fc tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Returning 404 to user: Instance c7b7e541-aa71-44f6-96fb-07c2e6e08520 could not be found. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:48:25.911070 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-d779aaeb-fcfd-4c49-809e-9b9e7b1c13fc tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] 10.222.0.43 "DELETE /compute/v2.1/servers/c7b7e541-aa71-44f6-96fb-07c2e6e08520" status: 404 len: 111 microversion: 2.1 time: 0.038344 Oct 04 21:48:25.911070 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 760/1458] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 21:48:25 2022] DELETE /compute/v2.1/servers/c7b7e541-aa71-44f6-96fb-07c2e6e08520 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:48:25.912307 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-c4c40ac4-2bc9-4da3-b803-8bb99b4d1296 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:25.912944 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-c4c40ac4-2bc9-4da3-b803-8bb99b4d1296 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] [instance: c7b7e541-aa71-44f6-96fb-07c2e6e08520] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:48:25.919684 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c4c40ac4-2bc9-4da3-b803-8bb99b4d1296 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:25.920183 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c4c40ac4-2bc9-4da3-b803-8bb99b4d1296 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:25.920633 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c4c40ac4-2bc9-4da3-b803-8bb99b4d1296 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:25.921377 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c4c40ac4-2bc9-4da3-b803-8bb99b4d1296 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:25.921846 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c4c40ac4-2bc9-4da3-b803-8bb99b4d1296 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:25.922279 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c4c40ac4-2bc9-4da3-b803-8bb99b4d1296 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:25.938286 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-efd37ce5-15fb-490a-a240-c5d7762c2b08 tempest-MigrationsAdminTest-1218821219 tempest-MigrationsAdminTest-1218821219-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/be573c06-25e7-485e-9443-5bc21196a45e" status: 200 len: 1613 microversion: 2.1 time: 0.186869 Oct 04 21:48:25.938899 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 699/1459] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:48:25 2022] GET /compute/v2.1/servers/be573c06-25e7-485e-9443-5bc21196a45e => generated 1613 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:48:25.944853 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-c4c40ac4-2bc9-4da3-b803-8bb99b4d1296 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] HTTP exception thrown: Instance c7b7e541-aa71-44f6-96fb-07c2e6e08520 could not be found. Oct 04 21:48:25.947569 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-c4c40ac4-2bc9-4da3-b803-8bb99b4d1296 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Request method failure captured: Oct 04 21:48:25.947569 n-d-860284-1 devstack@n-api.service[134102]: request: GET /compute/v2.1/servers/c7b7e541-aa71-44f6-96fb-07c2e6e08520 HTTP/1.1 Oct 04 21:48:25.947569 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 21:48:25.947569 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 21:48:25.947569 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 21:48:25.947569 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 21:48:25.947569 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 21:48:25.947569 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 21:48:25.947569 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 21:48:25.947569 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 21:48:25.947569 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPKkViVLk0wuNp0ZZ7JSvpOoMJojyl_QYUa-NlAgf6yHdl1vGkLKLlguGwJY9TPc2RC1uR3eEXrCXwpM-P6Sw01KADzrHjXb6WAntPYzFM8qRPbOqJbVu0xd-btAX_Lptb-QCqDASM3OEpH2gr1-q7iUMVY3XA8F4NTom5pXJgjN-qCw Oct 04 21:48:25.947569 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 21:48:25.947569 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 21:48:25.947569 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 21:48:25.947569 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 21:48:25.947569 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 21:48:25.947569 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 21:48:25.947569 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: da67fc95e2814f4086df020f4c475764 Oct 04 21:48:25.947569 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1276781908 Oct 04 21:48:25.947569 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 21:48:25.947569 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 21:48:25.949845 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/da67fc95e2814f4086df020f4c475764"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_da67fc95e2814f4086df020f4c475764", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/da67fc95e2814f4086df020f4c475764"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/da67fc95e2814f4086df020f4c475764"}]}] Oct 04 21:48:25.949845 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1276781908 Oct 04 21:48:25.949845 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: da67fc95e2814f4086df020f4c475764 Oct 04 21:48:25.949845 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1276781908 Oct 04 21:48:25.949845 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1276781908-project Oct 04 21:48:25.949845 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 21:48:25.949845 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 21:48:25.949845 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: 1789bb97219a4e1591632126812ea6df Oct 04 21:48:25.949845 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1276781908-project Oct 04 21:48:25.949845 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 21:48:25.949845 n-d-860284-1 devstack@n-api.service[134102]: exception: Instance c7b7e541-aa71-44f6-96fb-07c2e6e08520 could not be found. Oct 04 21:48:25.949845 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': 'c7b7e541-aa71-44f6-96fb-07c2e6e08520'} Oct 04 21:48:25.951117 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:48:25.951117 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:48:25.951117 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:48:25.951117 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:48:25.951117 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:48:25.951117 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:48:25.951117 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:48:25.951117 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:48:25.951117 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:48:25.951117 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:48:25.951117 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7b7e541-aa71-44f6-96fb-07c2e6e08520 could not be found. Oct 04 21:48:25.951117 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:48:25.951117 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:48:25.951117 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:48:25.951117 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:48:25.951117 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:48:25.951117 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:48:25.951117 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:48:25.951117 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:48:25.951117 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:48:25.953404 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:48:25.953404 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:48:25.953404 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:48:25.953404 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:48:25.953404 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:48:25.953404 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:48:25.953404 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:48:25.953404 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7b7e541-aa71-44f6-96fb-07c2e6e08520 could not be found. Oct 04 21:48:25.953404 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:48:25.953404 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:48:25.953404 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:48:25.953404 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:48:25.953404 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:48:25.953404 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:48:25.953404 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:48:25.953404 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:48:25.953404 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7b7e541-aa71-44f6-96fb-07c2e6e08520 could not be found. Oct 04 21:48:25.953404 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:48:25.956495 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-c4c40ac4-2bc9-4da3-b803-8bb99b4d1296 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] Returning 404 to user: Instance c7b7e541-aa71-44f6-96fb-07c2e6e08520 could not be found. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:48:25.956495 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-c4c40ac4-2bc9-4da3-b803-8bb99b4d1296 tempest-ServersWithSpecificFlavorTestJSON-1276781908 tempest-ServersWithSpecificFlavorTestJSON-1276781908-project] 10.222.0.43 "GET /compute/v2.1/servers/c7b7e541-aa71-44f6-96fb-07c2e6e08520" status: 404 len: 111 microversion: 2.1 time: 0.042019 Oct 04 21:48:25.956495 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 761/1460] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:48:25 2022] GET /compute/v2.1/servers/c7b7e541-aa71-44f6-96fb-07c2e6e08520 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:48:25.963394 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-6dbfc116-c4ed-472f-93d9-7acba7971ddf tempest-MigrationsAdminTest-1218821219 tempest-MigrationsAdminTest-1218821219-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:48:25.964102 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-6dbfc116-c4ed-472f-93d9-7acba7971ddf tempest-MigrationsAdminTest-1218821219 tempest-MigrationsAdminTest-1218821219-project-admin] [instance: be573c06-25e7-485e-9443-5bc21196a45e] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:48:25.971643 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6dbfc116-c4ed-472f-93d9-7acba7971ddf tempest-MigrationsAdminTest-1218821219 tempest-MigrationsAdminTest-1218821219-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:25.972145 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6dbfc116-c4ed-472f-93d9-7acba7971ddf tempest-MigrationsAdminTest-1218821219 tempest-MigrationsAdminTest-1218821219-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:25.972588 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6dbfc116-c4ed-472f-93d9-7acba7971ddf tempest-MigrationsAdminTest-1218821219 tempest-MigrationsAdminTest-1218821219-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:25.973306 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6dbfc116-c4ed-472f-93d9-7acba7971ddf tempest-MigrationsAdminTest-1218821219 tempest-MigrationsAdminTest-1218821219-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:25.974484 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6dbfc116-c4ed-472f-93d9-7acba7971ddf tempest-MigrationsAdminTest-1218821219 tempest-MigrationsAdminTest-1218821219-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:25.974921 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6dbfc116-c4ed-472f-93d9-7acba7971ddf tempest-MigrationsAdminTest-1218821219 tempest-MigrationsAdminTest-1218821219-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:26.007828 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-6dbfc116-c4ed-472f-93d9-7acba7971ddf tempest-MigrationsAdminTest-1218821219 tempest-MigrationsAdminTest-1218821219-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '79dde648c25e4351a6049c34b0a0cb18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aafb7e29584718884558b0baf7af32', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:48:26.008431 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-6dbfc116-c4ed-472f-93d9-7acba7971ddf tempest-MigrationsAdminTest-1218821219 tempest-MigrationsAdminTest-1218821219-project-admin] [instance: be573c06-25e7-485e-9443-5bc21196a45e] flavor_id is None. Assuming migration. {{(pid=134101) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 04 21:48:26.008885 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-6dbfc116-c4ed-472f-93d9-7acba7971ddf tempest-MigrationsAdminTest-1218821219 tempest-MigrationsAdminTest-1218821219-project-admin] [instance: be573c06-25e7-485e-9443-5bc21196a45e] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=134101) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 04 21:48:26.073460 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-f9612ebd-85c2-49d9-a23f-6ec7ad07d190 tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:26.075243 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-f9612ebd-85c2-49d9-a23f-6ec7ad07d190 tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] [instance: 197b66b3-69ef-4b80-9de7-b25ae132dc2e] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:48:26.087905 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f9612ebd-85c2-49d9-a23f-6ec7ad07d190 tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:26.089132 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f9612ebd-85c2-49d9-a23f-6ec7ad07d190 tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:26.090123 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f9612ebd-85c2-49d9-a23f-6ec7ad07d190 tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:26.092766 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f9612ebd-85c2-49d9-a23f-6ec7ad07d190 tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:26.093818 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f9612ebd-85c2-49d9-a23f-6ec7ad07d190 tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:26.094820 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f9612ebd-85c2-49d9-a23f-6ec7ad07d190 tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:26.321623 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-6dbfc116-c4ed-472f-93d9-7acba7971ddf tempest-MigrationsAdminTest-1218821219 tempest-MigrationsAdminTest-1218821219-project-admin] 10.222.0.43 "POST /compute/v2.1/servers/be573c06-25e7-485e-9443-5bc21196a45e/action" status: 202 len: 0 microversion: 2.1 time: 0.362918 Oct 04 21:48:26.324141 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 700/1461] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 21:48:25 2022] POST /compute/v2.1/servers/be573c06-25e7-485e-9443-5bc21196a45e/action => generated 0 bytes in 367 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:48:26.338487 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-6bc333b2-afef-4d67-9a51-590966d0d0a8 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:26.340678 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-6bc333b2-afef-4d67-9a51-590966d0d0a8 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] [instance: e3380b36-6aba-4736-bcbc-f0058f806d55] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:48:26.352199 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6bc333b2-afef-4d67-9a51-590966d0d0a8 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:26.353247 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6bc333b2-afef-4d67-9a51-590966d0d0a8 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:26.354269 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6bc333b2-afef-4d67-9a51-590966d0d0a8 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:26.354942 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-f9612ebd-85c2-49d9-a23f-6ec7ad07d190 tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7e992115ea4ba58205d3da003ec625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5345566eeb4a5f88d31f733eaa04bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:48:26.355855 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6bc333b2-afef-4d67-9a51-590966d0d0a8 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:26.356692 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6bc333b2-afef-4d67-9a51-590966d0d0a8 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:26.357567 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6bc333b2-afef-4d67-9a51-590966d0d0a8 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:26.370068 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-f9612ebd-85c2-49d9-a23f-6ec7ad07d190 tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] 10.222.0.43 "GET /compute/v2.1/servers/197b66b3-69ef-4b80-9de7-b25ae132dc2e" status: 200 len: 1470 microversion: 2.1 time: 0.303885 Oct 04 21:48:26.371818 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 762/1462] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:48:26 2022] GET /compute/v2.1/servers/197b66b3-69ef-4b80-9de7-b25ae132dc2e => generated 1470 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:48:26.378025 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-833a7c59-2179-45a0-bc8f-4e78de6b4869 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:26.379355 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-833a7c59-2179-45a0-bc8f-4e78de6b4869 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: be573c06-25e7-485e-9443-5bc21196a45e] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:48:26.389930 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-833a7c59-2179-45a0-bc8f-4e78de6b4869 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:26.390587 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-833a7c59-2179-45a0-bc8f-4e78de6b4869 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:26.391426 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-833a7c59-2179-45a0-bc8f-4e78de6b4869 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:26.392354 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-833a7c59-2179-45a0-bc8f-4e78de6b4869 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:26.393055 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-833a7c59-2179-45a0-bc8f-4e78de6b4869 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:26.393821 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-833a7c59-2179-45a0-bc8f-4e78de6b4869 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:26.401613 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-6bc333b2-afef-4d67-9a51-590966d0d0a8 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] HTTP exception thrown: Instance e3380b36-6aba-4736-bcbc-f0058f806d55 could not be found. Oct 04 21:48:26.406291 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-6bc333b2-afef-4d67-9a51-590966d0d0a8 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Request method failure captured: Oct 04 21:48:26.406291 n-d-860284-1 devstack@n-api.service[134101]: request: GET /compute/v2.1/servers/e3380b36-6aba-4736-bcbc-f0058f806d55 HTTP/1.1 Oct 04 21:48:26.406291 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 21:48:26.406291 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 21:48:26.406291 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 21:48:26.406291 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 21:48:26.406291 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 21:48:26.406291 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 21:48:26.406291 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 21:48:26.406291 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 21:48:26.406291 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPKmIg2p4Jaxd9N6jvYm_ZlmIMNjr8orAnEv7D8rk6jEPCLTvf0ENcigrAMkoCJ8-5tEY0vHmABCtEiCAdU087VK1bxPHI47P91pdF73KZc8Mzo7LOt4YWB2vFleaIkUVBrnDLuNXAmn_EiwaVwPZivvplgN0f1eDFUFr9oDqS014MUs Oct 04 21:48:26.406291 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 21:48:26.406291 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 21:48:26.406291 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 21:48:26.406291 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 21:48:26.406291 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 21:48:26.406291 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 21:48:26.406291 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: a1e3bf9149434d34b6762aaeef1478ed Oct 04 21:48:26.406291 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-ServersAdminTestJSON-106350315 Oct 04 21:48:26.406291 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 21:48:26.406291 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 21:48:26.408297 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a1e3bf9149434d34b6762aaeef1478ed"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_a1e3bf9149434d34b6762aaeef1478ed", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a1e3bf9149434d34b6762aaeef1478ed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/a1e3bf9149434d34b6762aaeef1478ed"}]}] Oct 04 21:48:26.408297 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-ServersAdminTestJSON-106350315 Oct 04 21:48:26.408297 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: a1e3bf9149434d34b6762aaeef1478ed Oct 04 21:48:26.408297 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-ServersAdminTestJSON-106350315 Oct 04 21:48:26.408297 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-ServersAdminTestJSON-106350315-project Oct 04 21:48:26.408297 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 21:48:26.408297 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 21:48:26.408297 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 87616cd16995468ab7febf5aa4b284db Oct 04 21:48:26.408297 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-ServersAdminTestJSON-106350315-project Oct 04 21:48:26.408297 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 21:48:26.408297 n-d-860284-1 devstack@n-api.service[134101]: exception: Instance e3380b36-6aba-4736-bcbc-f0058f806d55 could not be found. Oct 04 21:48:26.408297 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': 'e3380b36-6aba-4736-bcbc-f0058f806d55'} Oct 04 21:48:26.409522 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:48:26.409522 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:48:26.409522 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:48:26.409522 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:48:26.409522 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:48:26.409522 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:48:26.409522 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:48:26.409522 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:48:26.409522 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:48:26.409522 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:48:26.409522 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3380b36-6aba-4736-bcbc-f0058f806d55 could not be found. Oct 04 21:48:26.409522 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:48:26.409522 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:48:26.409522 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:48:26.409522 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:48:26.409522 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:48:26.409522 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:48:26.409522 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:48:26.409522 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:48:26.409522 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:48:26.413051 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:48:26.413051 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:48:26.413051 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:48:26.413051 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:48:26.413051 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:48:26.413051 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:48:26.413051 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:48:26.413051 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3380b36-6aba-4736-bcbc-f0058f806d55 could not be found. Oct 04 21:48:26.413051 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:48:26.413051 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:48:26.413051 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:48:26.413051 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:48:26.413051 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:48:26.413051 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:48:26.413051 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:48:26.413051 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:48:26.413051 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3380b36-6aba-4736-bcbc-f0058f806d55 could not be found. Oct 04 21:48:26.413051 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:48:26.414312 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-6bc333b2-afef-4d67-9a51-590966d0d0a8 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] Returning 404 to user: Instance e3380b36-6aba-4736-bcbc-f0058f806d55 could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:48:26.414312 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-6bc333b2-afef-4d67-9a51-590966d0d0a8 tempest-ServersAdminTestJSON-106350315 tempest-ServersAdminTestJSON-106350315-project] 10.222.0.43 "GET /compute/v2.1/servers/e3380b36-6aba-4736-bcbc-f0058f806d55" status: 404 len: 111 microversion: 2.1 time: 0.084087 Oct 04 21:48:26.414312 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 701/1463] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:48:26 2022] GET /compute/v2.1/servers/e3380b36-6aba-4736-bcbc-f0058f806d55 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:48:26.854340 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-24b862b9-84f0-487d-ae40-afbc40e9bf79 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:26.855861 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-24b862b9-84f0-487d-ae40-afbc40e9bf79 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] [instance: 59a1880f-2802-4e72-9a17-b966cfec8fe9] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:48:26.867324 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-833a7c59-2179-45a0-bc8f-4e78de6b4869 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:48:26.874767 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-24b862b9-84f0-487d-ae40-afbc40e9bf79 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:26.875355 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-24b862b9-84f0-487d-ae40-afbc40e9bf79 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:26.875977 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-24b862b9-84f0-487d-ae40-afbc40e9bf79 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:26.876849 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-24b862b9-84f0-487d-ae40-afbc40e9bf79 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:26.877557 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-24b862b9-84f0-487d-ae40-afbc40e9bf79 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:26.878284 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-24b862b9-84f0-487d-ae40-afbc40e9bf79 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:26.890232 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-833a7c59-2179-45a0-bc8f-4e78de6b4869 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/be573c06-25e7-485e-9443-5bc21196a45e" status: 200 len: 1471 microversion: 2.1 time: 0.517082 Oct 04 21:48:26.891421 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 763/1464] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:48:26 2022] GET /compute/v2.1/servers/be573c06-25e7-485e-9443-5bc21196a45e => generated 1471 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:48:26.905631 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-24b862b9-84f0-487d-ae40-afbc40e9bf79 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] HTTP exception thrown: Instance 59a1880f-2802-4e72-9a17-b966cfec8fe9 could not be found. Oct 04 21:48:26.913777 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-24b862b9-84f0-487d-ae40-afbc40e9bf79 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Request method failure captured: Oct 04 21:48:26.913777 n-d-860284-1 devstack@n-api.service[134101]: request: GET /compute/v2.1/servers/59a1880f-2802-4e72-9a17-b966cfec8fe9 HTTP/1.1 Oct 04 21:48:26.913777 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 21:48:26.913777 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 21:48:26.913777 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 21:48:26.913777 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 21:48:26.913777 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 21:48:26.913777 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 21:48:26.913777 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 21:48:26.913777 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 21:48:26.913777 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPKnHeaK9tmRrmAvrTzwz5PMuGvLZo6w0RzRBi-ESYQgfyjrrnkZ38Zu2JwOt5LIXhidJXXWMojxm08vFwalBKwJg1Rg9TZtolbT7DOzzXgrMEMgqLI1DqdGm1pJgN2X-4uD20_vhYRbxUjk-Ks6luVK8o8L8qWMFEceWeaOgYF3vYNA Oct 04 21:48:26.913777 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 21:48:26.913777 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 21:48:26.913777 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 21:48:26.913777 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 21:48:26.913777 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 21:48:26.913777 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 21:48:26.913777 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: 00081ff1d1aa41cbad345326b337093a Oct 04 21:48:26.913777 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-ImagesOneServerTestJSON-144510230 Oct 04 21:48:26.913777 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 21:48:26.913777 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 21:48:26.915366 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/00081ff1d1aa41cbad345326b337093a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_00081ff1d1aa41cbad345326b337093a", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/00081ff1d1aa41cbad345326b337093a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/00081ff1d1aa41cbad345326b337093a"}]}] Oct 04 21:48:26.915366 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-ImagesOneServerTestJSON-144510230 Oct 04 21:48:26.915366 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: 00081ff1d1aa41cbad345326b337093a Oct 04 21:48:26.915366 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-144510230 Oct 04 21:48:26.915366 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-ImagesOneServerTestJSON-144510230-project Oct 04 21:48:26.915366 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 21:48:26.915366 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 21:48:26.915366 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 7614aeaedd1947b88031fb55ca4783ae Oct 04 21:48:26.915366 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-ImagesOneServerTestJSON-144510230-project Oct 04 21:48:26.915366 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 21:48:26.915366 n-d-860284-1 devstack@n-api.service[134101]: exception: Instance 59a1880f-2802-4e72-9a17-b966cfec8fe9 could not be found. Oct 04 21:48:26.915366 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': '59a1880f-2802-4e72-9a17-b966cfec8fe9'} Oct 04 21:48:26.916145 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:48:26.916145 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:48:26.916145 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:48:26.916145 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:48:26.916145 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:48:26.916145 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:48:26.916145 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:48:26.916145 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:48:26.916145 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:48:26.916145 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:48:26.916145 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 59a1880f-2802-4e72-9a17-b966cfec8fe9 could not be found. Oct 04 21:48:26.916145 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:48:26.916145 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:48:26.916145 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:48:26.916145 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:48:26.916145 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:48:26.916145 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:48:26.916145 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:48:26.916145 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:48:26.916145 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:48:26.919211 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:48:26.919211 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:48:26.919211 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:48:26.919211 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:48:26.919211 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:48:26.919211 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:48:26.919211 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:48:26.919211 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 59a1880f-2802-4e72-9a17-b966cfec8fe9 could not be found. Oct 04 21:48:26.919211 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:48:26.919211 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:48:26.919211 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:48:26.919211 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:48:26.919211 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:48:26.919211 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:48:26.919211 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:48:26.919211 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:48:26.919211 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 59a1880f-2802-4e72-9a17-b966cfec8fe9 could not be found. Oct 04 21:48:26.919211 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:48:26.922716 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-24b862b9-84f0-487d-ae40-afbc40e9bf79 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] Returning 404 to user: Instance 59a1880f-2802-4e72-9a17-b966cfec8fe9 could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:48:26.922716 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-24b862b9-84f0-487d-ae40-afbc40e9bf79 tempest-ImagesOneServerTestJSON-144510230 tempest-ImagesOneServerTestJSON-144510230-project] 10.222.0.43 "GET /compute/v2.1/servers/59a1880f-2802-4e72-9a17-b966cfec8fe9" status: 404 len: 111 microversion: 2.1 time: 0.070268 Oct 04 21:48:26.922716 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 702/1465] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:48:26 2022] GET /compute/v2.1/servers/59a1880f-2802-4e72-9a17-b966cfec8fe9 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 21:48:27.416641 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-7409ba6b-2881-4883-89b4-a532605df490 tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:27.417708 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-7409ba6b-2881-4883-89b4-a532605df490 tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] [instance: 197b66b3-69ef-4b80-9de7-b25ae132dc2e] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:48:27.433438 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7409ba6b-2881-4883-89b4-a532605df490 tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:27.434224 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7409ba6b-2881-4883-89b4-a532605df490 tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:27.435171 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7409ba6b-2881-4883-89b4-a532605df490 tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:27.438526 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7409ba6b-2881-4883-89b4-a532605df490 tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:27.439161 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7409ba6b-2881-4883-89b4-a532605df490 tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:27.440296 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7409ba6b-2881-4883-89b4-a532605df490 tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:27.931418 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-faec62aa-3f29-472d-99ef-235ccfde92cc tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:27.932141 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-faec62aa-3f29-472d-99ef-235ccfde92cc tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: be573c06-25e7-485e-9443-5bc21196a45e] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:48:27.944610 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-faec62aa-3f29-472d-99ef-235ccfde92cc tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:27.945419 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-faec62aa-3f29-472d-99ef-235ccfde92cc tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:27.946071 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-faec62aa-3f29-472d-99ef-235ccfde92cc tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:27.947314 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-faec62aa-3f29-472d-99ef-235ccfde92cc tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:27.947956 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-faec62aa-3f29-472d-99ef-235ccfde92cc tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:27.949214 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-faec62aa-3f29-472d-99ef-235ccfde92cc tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:28.089428 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-7409ba6b-2881-4883-89b4-a532605df490 tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7e992115ea4ba58205d3da003ec625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5345566eeb4a5f88d31f733eaa04bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:48:28.105242 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-7409ba6b-2881-4883-89b4-a532605df490 tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] 10.222.0.43 "GET /compute/v2.1/servers/197b66b3-69ef-4b80-9de7-b25ae132dc2e" status: 200 len: 1470 microversion: 2.1 time: 0.692712 Oct 04 21:48:28.106606 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 764/1466] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:48:27 2022] GET /compute/v2.1/servers/197b66b3-69ef-4b80-9de7-b25ae132dc2e => generated 1470 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:48:28.125368 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-038fbd13-bd15-4c4c-a48f-a044fa1eda39 req-40bff987-d9b7-4888-925d-a1c11b75a7c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "197b66b3-69ef-4b80-9de7-b25ae132dc2e", "name": "network-vif-deleted", "tag": "26a59657-af0b-440a-bb00-9593baadfa84"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:48:28.180703 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-038fbd13-bd15-4c4c-a48f-a044fa1eda39 req-40bff987-d9b7-4888-925d-a1c11b75a7c6 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:28.181856 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-038fbd13-bd15-4c4c-a48f-a044fa1eda39 req-40bff987-d9b7-4888-925d-a1c11b75a7c6 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:28.183479 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-038fbd13-bd15-4c4c-a48f-a044fa1eda39 req-40bff987-d9b7-4888-925d-a1c11b75a7c6 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:28.234698 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-038fbd13-bd15-4c4c-a48f-a044fa1eda39 req-40bff987-d9b7-4888-925d-a1c11b75a7c6 service nova] Creating event network-vif-deleted:26a59657-af0b-440a-bb00-9593baadfa84 for instance 197b66b3-69ef-4b80-9de7-b25ae132dc2e on n-h1-860284-1 Oct 04 21:48:28.244576 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-038fbd13-bd15-4c4c-a48f-a044fa1eda39 req-40bff987-d9b7-4888-925d-a1c11b75a7c6 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136402 Oct 04 21:48:28.245214 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 765/1467] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:48:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:48:28.741839 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-faec62aa-3f29-472d-99ef-235ccfde92cc tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:48:28.754071 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-faec62aa-3f29-472d-99ef-235ccfde92cc tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/be573c06-25e7-485e-9443-5bc21196a45e" status: 200 len: 1471 microversion: 2.1 time: 0.841915 Oct 04 21:48:28.754734 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 703/1468] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:48:27 2022] GET /compute/v2.1/servers/be573c06-25e7-485e-9443-5bc21196a45e => generated 1471 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:48:29.139250 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-e02a90a0-4b5f-4437-974c-5f3be51e76ce tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:29.140738 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-e02a90a0-4b5f-4437-974c-5f3be51e76ce tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] [instance: 197b66b3-69ef-4b80-9de7-b25ae132dc2e] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:48:29.176357 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e02a90a0-4b5f-4437-974c-5f3be51e76ce tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:29.182029 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e02a90a0-4b5f-4437-974c-5f3be51e76ce tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:29.186844 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e02a90a0-4b5f-4437-974c-5f3be51e76ce tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:29.188750 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e02a90a0-4b5f-4437-974c-5f3be51e76ce tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:29.194766 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e02a90a0-4b5f-4437-974c-5f3be51e76ce tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:29.196580 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e02a90a0-4b5f-4437-974c-5f3be51e76ce tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:29.327243 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e02a90a0-4b5f-4437-974c-5f3be51e76ce tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:29.327551 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e02a90a0-4b5f-4437-974c-5f3be51e76ce tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:29.328180 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e02a90a0-4b5f-4437-974c-5f3be51e76ce tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:29.328804 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.objects.instance [None req-e02a90a0-4b5f-4437-974c-5f3be51e76ce tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Lazy-loading 'fault' on Instance uuid 197b66b3-69ef-4b80-9de7-b25ae132dc2e {{(pid=134102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:48:29.778301 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-9c53bd44-e8bb-4ef3-aad4-0bf4ed727186 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:29.779055 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-9c53bd44-e8bb-4ef3-aad4-0bf4ed727186 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: be573c06-25e7-485e-9443-5bc21196a45e] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:48:29.789741 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9c53bd44-e8bb-4ef3-aad4-0bf4ed727186 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:29.791148 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9c53bd44-e8bb-4ef3-aad4-0bf4ed727186 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:29.792547 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9c53bd44-e8bb-4ef3-aad4-0bf4ed727186 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:29.794091 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9c53bd44-e8bb-4ef3-aad4-0bf4ed727186 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:29.794937 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9c53bd44-e8bb-4ef3-aad4-0bf4ed727186 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:29.796191 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9c53bd44-e8bb-4ef3-aad4-0bf4ed727186 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:29.968096 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-e02a90a0-4b5f-4437-974c-5f3be51e76ce tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7e992115ea4ba58205d3da003ec625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5345566eeb4a5f88d31f733eaa04bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:48:29.979384 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-e02a90a0-4b5f-4437-974c-5f3be51e76ce tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] 10.222.0.43 "GET /compute/v2.1/servers/197b66b3-69ef-4b80-9de7-b25ae132dc2e" status: 200 len: 1304 microversion: 2.1 time: 0.844238 Oct 04 21:48:29.980213 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 766/1469] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:48:29 2022] GET /compute/v2.1/servers/197b66b3-69ef-4b80-9de7-b25ae132dc2e => generated 1304 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:48:30.355033 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-9c53bd44-e8bb-4ef3-aad4-0bf4ed727186 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:48:30.390148 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-9c53bd44-e8bb-4ef3-aad4-0bf4ed727186 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/be573c06-25e7-485e-9443-5bc21196a45e" status: 200 len: 1471 microversion: 2.1 time: 0.613549 Oct 04 21:48:30.395984 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 704/1470] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:48:29 2022] GET /compute/v2.1/servers/be573c06-25e7-485e-9443-5bc21196a45e => generated 1471 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:48:31.003626 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-6020dfff-5963-46a4-a28a-2d879ad35928 tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:31.004401 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-6020dfff-5963-46a4-a28a-2d879ad35928 tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] [instance: 197b66b3-69ef-4b80-9de7-b25ae132dc2e] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:48:31.017913 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6020dfff-5963-46a4-a28a-2d879ad35928 tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:31.019320 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6020dfff-5963-46a4-a28a-2d879ad35928 tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:31.020196 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6020dfff-5963-46a4-a28a-2d879ad35928 tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:31.021746 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6020dfff-5963-46a4-a28a-2d879ad35928 tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:31.022524 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6020dfff-5963-46a4-a28a-2d879ad35928 tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:31.023254 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6020dfff-5963-46a4-a28a-2d879ad35928 tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:31.053759 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-6020dfff-5963-46a4-a28a-2d879ad35928 tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] HTTP exception thrown: Instance 197b66b3-69ef-4b80-9de7-b25ae132dc2e could not be found. Oct 04 21:48:31.056450 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-6020dfff-5963-46a4-a28a-2d879ad35928 tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Request method failure captured: Oct 04 21:48:31.056450 n-d-860284-1 devstack@n-api.service[134101]: request: GET /compute/v2.1/servers/197b66b3-69ef-4b80-9de7-b25ae132dc2e HTTP/1.1 Oct 04 21:48:31.056450 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 21:48:31.056450 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 21:48:31.056450 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 21:48:31.056450 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 21:48:31.056450 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 21:48:31.056450 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 21:48:31.056450 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 21:48:31.056450 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 21:48:31.056450 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPKoKW-jNrWpX8eJJ1kebA8l0oCnESEU0ZbAXa44h9mO8OeMBUJwh7h-DMWumXY4Hi5poWVVtcvH4NB_27X6OV2UtrQmycpmlUtEtM-BvxFuiZ4DySuVeqJ8A7ZimwcKN_Xs4XYmpImV5DScEh5zCuE_-1nHXiVwbdlSZhXobIxqbLJo Oct 04 21:48:31.056450 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 21:48:31.056450 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 21:48:31.056450 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 21:48:31.056450 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 21:48:31.056450 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 21:48:31.056450 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 21:48:31.056450 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: ff5345566eeb4a5f88d31f733eaa04bc Oct 04 21:48:31.056450 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-TenantUsagesTestJSON-1766157990 Oct 04 21:48:31.056450 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 21:48:31.056450 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 21:48:31.057892 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ff5345566eeb4a5f88d31f733eaa04bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_ff5345566eeb4a5f88d31f733eaa04bc", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ff5345566eeb4a5f88d31f733eaa04bc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/ff5345566eeb4a5f88d31f733eaa04bc"}]}] Oct 04 21:48:31.057892 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-TenantUsagesTestJSON-1766157990 Oct 04 21:48:31.057892 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: ff5345566eeb4a5f88d31f733eaa04bc Oct 04 21:48:31.057892 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-TenantUsagesTestJSON-1766157990 Oct 04 21:48:31.057892 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-TenantUsagesTestJSON-1766157990-project Oct 04 21:48:31.057892 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 21:48:31.057892 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 21:48:31.057892 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 7c7e992115ea4ba58205d3da003ec625 Oct 04 21:48:31.057892 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-TenantUsagesTestJSON-1766157990-project Oct 04 21:48:31.057892 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 21:48:31.057892 n-d-860284-1 devstack@n-api.service[134101]: exception: Instance 197b66b3-69ef-4b80-9de7-b25ae132dc2e could not be found. Oct 04 21:48:31.057892 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': '197b66b3-69ef-4b80-9de7-b25ae132dc2e'} Oct 04 21:48:31.058775 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:48:31.058775 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:48:31.058775 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:48:31.058775 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:48:31.058775 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:48:31.058775 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:48:31.058775 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:48:31.058775 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:48:31.058775 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:48:31.058775 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:48:31.058775 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 197b66b3-69ef-4b80-9de7-b25ae132dc2e could not be found. Oct 04 21:48:31.058775 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:48:31.058775 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:48:31.058775 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:48:31.058775 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:48:31.058775 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:48:31.058775 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:48:31.058775 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:48:31.058775 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:48:31.058775 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:48:31.060073 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:48:31.060073 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:48:31.060073 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:48:31.060073 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:48:31.060073 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:48:31.060073 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:48:31.060073 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:48:31.060073 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 197b66b3-69ef-4b80-9de7-b25ae132dc2e could not be found. Oct 04 21:48:31.060073 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:48:31.060073 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:48:31.060073 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:48:31.060073 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:48:31.060073 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:48:31.060073 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:48:31.060073 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:48:31.060073 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:48:31.060073 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 197b66b3-69ef-4b80-9de7-b25ae132dc2e could not be found. Oct 04 21:48:31.060073 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:48:31.064119 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-6020dfff-5963-46a4-a28a-2d879ad35928 tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] Returning 404 to user: Instance 197b66b3-69ef-4b80-9de7-b25ae132dc2e could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:48:31.065246 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-6020dfff-5963-46a4-a28a-2d879ad35928 tempest-TenantUsagesTestJSON-1766157990 tempest-TenantUsagesTestJSON-1766157990-project] 10.222.0.43 "GET /compute/v2.1/servers/197b66b3-69ef-4b80-9de7-b25ae132dc2e" status: 404 len: 111 microversion: 2.1 time: 0.066194 Oct 04 21:48:31.066067 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 705/1471] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:48:30 2022] GET /compute/v2.1/servers/197b66b3-69ef-4b80-9de7-b25ae132dc2e => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 21:48:31.185918 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-23f83091-1426-48be-8516-5b261b5bac49 tempest-ListImagesTestJSON-1036777445 tempest-ListImagesTestJSON-1036777445-project] Calling method '.version_select at 0x7fbb2f142040>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:31.275434 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-23f83091-1426-48be-8516-5b261b5bac49 tempest-ListImagesTestJSON-1036777445 tempest-ListImagesTestJSON-1036777445-project] 10.222.0.43 "GET /compute/v2.1/images/58548514-5dac-426c-81f5-19e3fba33e23" status: 200 len: 784 microversion: 2.1 time: 0.557734 Oct 04 21:48:31.277569 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 767/1472] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:48:30 2022] GET /compute/v2.1/images/58548514-5dac-426c-81f5-19e3fba33e23 => generated 784 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:48:31.292225 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-64ca9b2f-3e66-4c7b-9214-1f6be5cc5f18 tempest-ListImagesTestJSON-1036777445 tempest-ListImagesTestJSON-1036777445-project] Calling method '.version_select at 0x7fbb2eec6f70>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:31.414797 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-f421f4a6-da22-4828-88ee-28828d920a50 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:31.415338 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-f421f4a6-da22-4828-88ee-28828d920a50 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: be573c06-25e7-485e-9443-5bc21196a45e] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:48:31.423840 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f421f4a6-da22-4828-88ee-28828d920a50 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:31.424816 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f421f4a6-da22-4828-88ee-28828d920a50 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:31.432816 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f421f4a6-da22-4828-88ee-28828d920a50 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:31.435123 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f421f4a6-da22-4828-88ee-28828d920a50 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:31.436055 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f421f4a6-da22-4828-88ee-28828d920a50 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:31.436853 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f421f4a6-da22-4828-88ee-28828d920a50 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:31.457218 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-64ca9b2f-3e66-4c7b-9214-1f6be5cc5f18 tempest-ListImagesTestJSON-1036777445 tempest-ListImagesTestJSON-1036777445-project] 10.222.0.43 "GET /compute/v2.1/images" status: 200 len: 871 microversion: 2.1 time: 0.168954 Oct 04 21:48:31.458990 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 706/1473] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Oct 4 21:48:31 2022] GET /compute/v2.1/images => generated 871 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:48:31.494257 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-6c91aaf7-03e5-490e-b58a-982a5af54457 tempest-ListImagesTestJSON-1036777445 tempest-ListImagesTestJSON-1036777445-project] Calling method '.version_select at 0x7fbb2eec0af0>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:31.593767 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-6c91aaf7-03e5-490e-b58a-982a5af54457 tempest-ListImagesTestJSON-1036777445 tempest-ListImagesTestJSON-1036777445-project] 10.222.0.43 "GET /compute/v2.1/images/detail" status: 200 len: 1475 microversion: 2.1 time: 0.124298 Oct 04 21:48:31.597077 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 707/1474] 10.222.0.43 () {58 vars in 1143 bytes} [Tue Oct 4 21:48:31 2022] GET /compute/v2.1/images/detail => generated 1475 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:48:31.900179 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-f421f4a6-da22-4828-88ee-28828d920a50 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:48:31.909708 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-f421f4a6-da22-4828-88ee-28828d920a50 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/be573c06-25e7-485e-9443-5bc21196a45e" status: 200 len: 1476 microversion: 2.1 time: 0.498953 Oct 04 21:48:31.911411 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 768/1475] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:48:31 2022] GET /compute/v2.1/servers/be573c06-25e7-485e-9443-5bc21196a45e => generated 1476 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:48:32.414297 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-7df34ee2-3876-4da1-9cc1-574fb7a3a549 tempest-ServicesAdminTestJSON-1655428802 tempest-ServicesAdminTestJSON-1655428802-project-admin] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:32.418202 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7df34ee2-3876-4da1-9cc1-574fb7a3a549 tempest-ServicesAdminTestJSON-1655428802 tempest-ServicesAdminTestJSON-1655428802-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:32.421634 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7df34ee2-3876-4da1-9cc1-574fb7a3a549 tempest-ServicesAdminTestJSON-1655428802 tempest-ServicesAdminTestJSON-1655428802-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:32.422107 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7df34ee2-3876-4da1-9cc1-574fb7a3a549 tempest-ServicesAdminTestJSON-1655428802 tempest-ServicesAdminTestJSON-1655428802-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:32.423000 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7df34ee2-3876-4da1-9cc1-574fb7a3a549 tempest-ServicesAdminTestJSON-1655428802 tempest-ServicesAdminTestJSON-1655428802-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:32.423488 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7df34ee2-3876-4da1-9cc1-574fb7a3a549 tempest-ServicesAdminTestJSON-1655428802 tempest-ServicesAdminTestJSON-1655428802-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:32.423921 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7df34ee2-3876-4da1-9cc1-574fb7a3a549 tempest-ServicesAdminTestJSON-1655428802 tempest-ServicesAdminTestJSON-1655428802-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:32.509799 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-7df34ee2-3876-4da1-9cc1-574fb7a3a549 tempest-ServicesAdminTestJSON-1655428802 tempest-ServicesAdminTestJSON-1655428802-project-admin] 10.222.0.43 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.366491 Oct 04 21:48:32.514769 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 708/1476] 10.222.0.43 () {58 vars in 1137 bytes} [Tue Oct 4 21:48:32 2022] GET /compute/v2.1/os-services => generated 944 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:48:32.529718 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-3a95a6f9-b2d6-4bb3-a365-8f6f0ca0948b tempest-ServicesAdminTestJSON-1655428802 tempest-ServicesAdminTestJSON-1655428802-project-admin] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:32.546674 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3a95a6f9-b2d6-4bb3-a365-8f6f0ca0948b tempest-ServicesAdminTestJSON-1655428802 tempest-ServicesAdminTestJSON-1655428802-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:32.547320 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3a95a6f9-b2d6-4bb3-a365-8f6f0ca0948b tempest-ServicesAdminTestJSON-1655428802 tempest-ServicesAdminTestJSON-1655428802-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:32.547775 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3a95a6f9-b2d6-4bb3-a365-8f6f0ca0948b tempest-ServicesAdminTestJSON-1655428802 tempest-ServicesAdminTestJSON-1655428802-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:32.548600 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3a95a6f9-b2d6-4bb3-a365-8f6f0ca0948b tempest-ServicesAdminTestJSON-1655428802 tempest-ServicesAdminTestJSON-1655428802-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:32.549057 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3a95a6f9-b2d6-4bb3-a365-8f6f0ca0948b tempest-ServicesAdminTestJSON-1655428802 tempest-ServicesAdminTestJSON-1655428802-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:32.549855 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3a95a6f9-b2d6-4bb3-a365-8f6f0ca0948b tempest-ServicesAdminTestJSON-1655428802 tempest-ServicesAdminTestJSON-1655428802-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:32.617013 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-3a95a6f9-b2d6-4bb3-a365-8f6f0ca0948b tempest-ServicesAdminTestJSON-1655428802 tempest-ServicesAdminTestJSON-1655428802-project-admin] 10.222.0.43 "GET /compute/v2.1/os-services?host=n-d-860284-1" status: 200 len: 578 microversion: 2.1 time: 0.091594 Oct 04 21:48:32.618323 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 769/1477] 10.222.0.43 () {58 vars in 1172 bytes} [Tue Oct 4 21:48:32 2022] GET /compute/v2.1/os-services?host=n-d-860284-1 => generated 578 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:48:32.632380 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-7aa3ae40-9733-44f1-8a4c-01037e19e816 tempest-ServicesAdminTestJSON-1655428802 tempest-ServicesAdminTestJSON-1655428802-project-admin] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:32.642309 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7aa3ae40-9733-44f1-8a4c-01037e19e816 tempest-ServicesAdminTestJSON-1655428802 tempest-ServicesAdminTestJSON-1655428802-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:32.643916 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7aa3ae40-9733-44f1-8a4c-01037e19e816 tempest-ServicesAdminTestJSON-1655428802 tempest-ServicesAdminTestJSON-1655428802-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:32.647420 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7aa3ae40-9733-44f1-8a4c-01037e19e816 tempest-ServicesAdminTestJSON-1655428802 tempest-ServicesAdminTestJSON-1655428802-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:32.651434 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7aa3ae40-9733-44f1-8a4c-01037e19e816 tempest-ServicesAdminTestJSON-1655428802 tempest-ServicesAdminTestJSON-1655428802-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:32.653281 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7aa3ae40-9733-44f1-8a4c-01037e19e816 tempest-ServicesAdminTestJSON-1655428802 tempest-ServicesAdminTestJSON-1655428802-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:32.655750 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7aa3ae40-9733-44f1-8a4c-01037e19e816 tempest-ServicesAdminTestJSON-1655428802 tempest-ServicesAdminTestJSON-1655428802-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:32.739122 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-7aa3ae40-9733-44f1-8a4c-01037e19e816 tempest-ServicesAdminTestJSON-1655428802 tempest-ServicesAdminTestJSON-1655428802-project-admin] 10.222.0.43 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.111382 Oct 04 21:48:32.740671 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 709/1478] 10.222.0.43 () {58 vars in 1176 bytes} [Tue Oct 4 21:48:32 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:48:32.752821 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-a9eb9e58-cf23-4e46-a0c1-b07e1e267abd tempest-ServicesAdminTestJSON-1655428802 tempest-ServicesAdminTestJSON-1655428802-project-admin] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:32.757392 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a9eb9e58-cf23-4e46-a0c1-b07e1e267abd tempest-ServicesAdminTestJSON-1655428802 tempest-ServicesAdminTestJSON-1655428802-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:32.758438 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a9eb9e58-cf23-4e46-a0c1-b07e1e267abd tempest-ServicesAdminTestJSON-1655428802 tempest-ServicesAdminTestJSON-1655428802-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:32.759161 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a9eb9e58-cf23-4e46-a0c1-b07e1e267abd tempest-ServicesAdminTestJSON-1655428802 tempest-ServicesAdminTestJSON-1655428802-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:32.760083 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a9eb9e58-cf23-4e46-a0c1-b07e1e267abd tempest-ServicesAdminTestJSON-1655428802 tempest-ServicesAdminTestJSON-1655428802-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:32.760972 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a9eb9e58-cf23-4e46-a0c1-b07e1e267abd tempest-ServicesAdminTestJSON-1655428802 tempest-ServicesAdminTestJSON-1655428802-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:32.761600 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a9eb9e58-cf23-4e46-a0c1-b07e1e267abd tempest-ServicesAdminTestJSON-1655428802 tempest-ServicesAdminTestJSON-1655428802-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:32.793407 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-a9eb9e58-cf23-4e46-a0c1-b07e1e267abd tempest-ServicesAdminTestJSON-1655428802 tempest-ServicesAdminTestJSON-1655428802-project-admin] 10.222.0.43 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.044106 Oct 04 21:48:32.794646 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 770/1479] 10.222.0.43 () {58 vars in 1137 bytes} [Tue Oct 4 21:48:32 2022] GET /compute/v2.1/os-services => generated 944 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:48:32.940003 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-483ddbf4-ff49-42be-97eb-367f73354f3c tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:32.941390 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-483ddbf4-ff49-42be-97eb-367f73354f3c tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: be573c06-25e7-485e-9443-5bc21196a45e] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:48:32.952542 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-483ddbf4-ff49-42be-97eb-367f73354f3c tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:32.953921 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-483ddbf4-ff49-42be-97eb-367f73354f3c tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:32.954835 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-483ddbf4-ff49-42be-97eb-367f73354f3c tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:32.956759 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-483ddbf4-ff49-42be-97eb-367f73354f3c tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:32.958482 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-483ddbf4-ff49-42be-97eb-367f73354f3c tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:32.959859 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-483ddbf4-ff49-42be-97eb-367f73354f3c tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:33.229509 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-483ddbf4-ff49-42be-97eb-367f73354f3c tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:48:33.240537 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-483ddbf4-ff49-42be-97eb-367f73354f3c tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/be573c06-25e7-485e-9443-5bc21196a45e" status: 200 len: 1476 microversion: 2.1 time: 0.306685 Oct 04 21:48:33.241849 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 710/1480] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:48:32 2022] GET /compute/v2.1/servers/be573c06-25e7-485e-9443-5bc21196a45e => generated 1476 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:48:34.279404 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-d72c8f17-7c21-40bf-ad9b-3a47ac6276b8 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:34.280194 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-d72c8f17-7c21-40bf-ad9b-3a47ac6276b8 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: be573c06-25e7-485e-9443-5bc21196a45e] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:48:34.293552 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d72c8f17-7c21-40bf-ad9b-3a47ac6276b8 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:34.297227 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d72c8f17-7c21-40bf-ad9b-3a47ac6276b8 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:34.297684 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d72c8f17-7c21-40bf-ad9b-3a47ac6276b8 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:34.299283 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d72c8f17-7c21-40bf-ad9b-3a47ac6276b8 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:34.300644 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d72c8f17-7c21-40bf-ad9b-3a47ac6276b8 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:34.303118 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d72c8f17-7c21-40bf-ad9b-3a47ac6276b8 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:34.681614 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-d72c8f17-7c21-40bf-ad9b-3a47ac6276b8 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:48:34.695546 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-d72c8f17-7c21-40bf-ad9b-3a47ac6276b8 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/be573c06-25e7-485e-9443-5bc21196a45e" status: 200 len: 1476 microversion: 2.1 time: 0.420310 Oct 04 21:48:34.696502 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 771/1481] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:48:34 2022] GET /compute/v2.1/servers/be573c06-25e7-485e-9443-5bc21196a45e => generated 1476 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:48:34.701677 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-4dc41327-146d-4d3f-bc8c-14aae0dbbd84 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:34.703950 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-4dc41327-146d-4d3f-bc8c-14aae0dbbd84 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] [instance: 1e9957cf-cfeb-483d-bc32-73ca72a54eb9] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:48:34.720471 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4dc41327-146d-4d3f-bc8c-14aae0dbbd84 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:34.721325 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4dc41327-146d-4d3f-bc8c-14aae0dbbd84 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:34.722858 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4dc41327-146d-4d3f-bc8c-14aae0dbbd84 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:34.725792 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4dc41327-146d-4d3f-bc8c-14aae0dbbd84 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:34.727448 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4dc41327-146d-4d3f-bc8c-14aae0dbbd84 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:34.728428 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4dc41327-146d-4d3f-bc8c-14aae0dbbd84 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:34.768511 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-4dc41327-146d-4d3f-bc8c-14aae0dbbd84 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] 10.222.0.43 "GET /compute/v2.1/servers/1e9957cf-cfeb-483d-bc32-73ca72a54eb9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.070671 Oct 04 21:48:34.769742 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 772/1482] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 21:48:34 2022] GET /compute/v2.1/servers/1e9957cf-cfeb-483d-bc32-73ca72a54eb9/os-volume_attachments => generated 25 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 21:48:34.813056 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-ca3431c4-6402-4b7b-968e-8920968a26aa tempest-KeyPairsV2TestJSON-2129216155 tempest-KeyPairsV2TestJSON-2129216155-project] Action: 'create', calling method: .version_select at 0x7fbb2ef19940>, body: {"keypair": {"name": "tempest-keypair-968870750", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOexgLYEPCDZJfex/Uvpyl3y7iVcBbz9RZU+nIGL+Zkh8P6SwMMIIRSCB0fH/tzzemc/uROQUQhaD59E1wkH/qz286zagul209/wFzIHcrs513znaFHeWG9oppd56zN07w=="}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:48:34.853875 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-ca3431c4-6402-4b7b-968e-8920968a26aa tempest-KeyPairsV2TestJSON-2129216155 tempest-KeyPairsV2TestJSON-2129216155-project] Getting quotas for project 5293bac565a54f0ca4bfeb3ca2690bba. Resources: {'key_pairs'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:48:34.874455 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-ca3431c4-6402-4b7b-968e-8920968a26aa tempest-KeyPairsV2TestJSON-2129216155 tempest-KeyPairsV2TestJSON-2129216155-project] Getting quotas for user b98ef5711b054ebea995210e87b9160e and project 5293bac565a54f0ca4bfeb3ca2690bba. Resources: {'key_pairs'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:48:34.925642 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-ca3431c4-6402-4b7b-968e-8920968a26aa tempest-KeyPairsV2TestJSON-2129216155 tempest-KeyPairsV2TestJSON-2129216155-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.538458 Oct 04 21:48:34.934188 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 711/1483] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Oct 4 21:48:34 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:48:34.939110 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-9e6d0a68-7f63-44f5-80e2-17845a1f3003 tempest-KeyPairsV2TestJSON-2129216155 tempest-KeyPairsV2TestJSON-2129216155-project] Calling method '.version_select at 0x7fbb2f1f6820>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:34.956884 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-9e6d0a68-7f63-44f5-80e2-17845a1f3003 tempest-KeyPairsV2TestJSON-2129216155 tempest-KeyPairsV2TestJSON-2129216155-project] 10.222.0.43 "GET /compute/v2.1/os-keypairs/tempest-keypair-968870750" status: 200 len: 496 microversion: 2.1 time: 0.021892 Oct 04 21:48:34.957502 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 773/1484] 10.222.0.43 () {58 vars in 1215 bytes} [Tue Oct 4 21:48:34 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-968870750 => generated 496 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:48:34.987573 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-627e9924-d71e-496b-ab19-2131ed670431 tempest-KeyPairsV2TestJSON-2129216155 tempest-KeyPairsV2TestJSON-2129216155-project] Calling method '.version_select at 0x7fbb2ef0ca60>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:35.008736 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-78e35da2-b68d-408b-8f0f-8e624b728db6 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:35.014141 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-627e9924-d71e-496b-ab19-2131ed670431 tempest-KeyPairsV2TestJSON-2129216155 tempest-KeyPairsV2TestJSON-2129216155-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-968870750" status: 202 len: 0 microversion: 2.1 time: 0.046629 Oct 04 21:48:35.023210 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 712/1485] 10.222.0.43 () {58 vars in 1218 bytes} [Tue Oct 4 21:48:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-968870750 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:48:35.028306 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-78e35da2-b68d-408b-8f0f-8e624b728db6 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] [instance: 1e9957cf-cfeb-483d-bc32-73ca72a54eb9] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:48:35.029659 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e0309296-cd86-45ea-bb1b-1a970f6d0c6e tempest-KeyPairsV2TestJSON-2129216155 tempest-KeyPairsV2TestJSON-2129216155-project] Action: 'create', calling method: .version_select at 0x7fbb2eec6b80>, body: {"keypair": {"name": "tempest-keypair-1633840280", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOCK9hlldGDw63XDObCjUNgM4twxFnnlc8C9vFjes+QOGCE2RAu+O98G+Z69R1HWAYRpuijjIXej7q/Pfw9AglL2CdhU8U3PLXgqeGfVCrRl/1rmhxA4/rsUCZvEpj8K0w=="}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:48:35.044241 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-78e35da2-b68d-408b-8f0f-8e624b728db6 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:35.046319 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-78e35da2-b68d-408b-8f0f-8e624b728db6 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:35.050223 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-78e35da2-b68d-408b-8f0f-8e624b728db6 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:35.050793 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-e0309296-cd86-45ea-bb1b-1a970f6d0c6e tempest-KeyPairsV2TestJSON-2129216155 tempest-KeyPairsV2TestJSON-2129216155-project] Getting quotas for project 5293bac565a54f0ca4bfeb3ca2690bba. Resources: {'key_pairs'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:48:35.053826 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-78e35da2-b68d-408b-8f0f-8e624b728db6 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:35.054595 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-78e35da2-b68d-408b-8f0f-8e624b728db6 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:35.055119 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-78e35da2-b68d-408b-8f0f-8e624b728db6 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:35.058651 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-e0309296-cd86-45ea-bb1b-1a970f6d0c6e tempest-KeyPairsV2TestJSON-2129216155 tempest-KeyPairsV2TestJSON-2129216155-project] Getting quotas for user b98ef5711b054ebea995210e87b9160e and project 5293bac565a54f0ca4bfeb3ca2690bba. Resources: {'key_pairs'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:48:35.090775 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-e0309296-cd86-45ea-bb1b-1a970f6d0c6e tempest-KeyPairsV2TestJSON-2129216155 tempest-KeyPairsV2TestJSON-2129216155-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.065960 Oct 04 21:48:35.098994 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 713/1486] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Oct 4 21:48:35 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:48:35.105384 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-b43e8c2c-1ba1-4219-bcbe-249b8031b732 tempest-KeyPairsV2TestJSON-2129216155 tempest-KeyPairsV2TestJSON-2129216155-project] Calling method '.version_select at 0x7fbb2edf08b0>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:35.124546 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-78e35da2-b68d-408b-8f0f-8e624b728db6 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] 10.222.0.43 "GET /compute/v2.1/servers/1e9957cf-cfeb-483d-bc32-73ca72a54eb9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.127880 Oct 04 21:48:35.131648 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 774/1487] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 21:48:34 2022] GET /compute/v2.1/servers/1e9957cf-cfeb-483d-bc32-73ca72a54eb9/os-volume_attachments => generated 25 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 21:48:35.156653 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-b43e8c2c-1ba1-4219-bcbe-249b8031b732 tempest-KeyPairsV2TestJSON-2129216155 tempest-KeyPairsV2TestJSON-2129216155-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1633840280" status: 202 len: 0 microversion: 2.1 time: 0.054379 Oct 04 21:48:35.164358 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 714/1488] 10.222.0.43 () {58 vars in 1221 bytes} [Tue Oct 4 21:48:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1633840280 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:48:35.173097 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-651a49b5-5622-4926-9664-e66df8523947 tempest-KeyPairsV2TestJSON-2129216155 tempest-KeyPairsV2TestJSON-2129216155-project] Action: 'create', calling method: .version_select at 0x7fbb2f69ea60>, body: {"keypair": {"name": "tempest-keypair-1100164979", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:48:35.205533 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-651a49b5-5622-4926-9664-e66df8523947 tempest-KeyPairsV2TestJSON-2129216155 tempest-KeyPairsV2TestJSON-2129216155-project] Getting quotas for project 5293bac565a54f0ca4bfeb3ca2690bba. Resources: {'key_pairs'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:48:35.214426 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-651a49b5-5622-4926-9664-e66df8523947 tempest-KeyPairsV2TestJSON-2129216155 tempest-KeyPairsV2TestJSON-2129216155-project] Getting quotas for user b98ef5711b054ebea995210e87b9160e and project 5293bac565a54f0ca4bfeb3ca2690bba. Resources: {'key_pairs'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:48:35.222574 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-85f38e26-c0de-4285-a65d-a39963e827f3 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:35.223817 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-85f38e26-c0de-4285-a65d-a39963e827f3 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] [instance: 1e9957cf-cfeb-483d-bc32-73ca72a54eb9] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:48:35.242968 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-85f38e26-c0de-4285-a65d-a39963e827f3 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:35.243670 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-85f38e26-c0de-4285-a65d-a39963e827f3 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:35.244273 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-85f38e26-c0de-4285-a65d-a39963e827f3 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:35.245575 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-85f38e26-c0de-4285-a65d-a39963e827f3 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:35.246287 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-85f38e26-c0de-4285-a65d-a39963e827f3 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:35.247608 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-85f38e26-c0de-4285-a65d-a39963e827f3 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:35.250730 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-651a49b5-5622-4926-9664-e66df8523947 tempest-KeyPairsV2TestJSON-2129216155 tempest-KeyPairsV2TestJSON-2129216155-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 574 microversion: 2.1 time: 0.086729 Oct 04 21:48:35.251959 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 775/1489] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Oct 4 21:48:35 2022] POST /compute/v2.1/os-keypairs => generated 574 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:48:35.263325 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-beec802b-21af-4a51-8b12-2ac52cbd6d22 tempest-KeyPairsV2TestJSON-2129216155 tempest-KeyPairsV2TestJSON-2129216155-project] Calling method '.version_select at 0x7fbb2f6fbee0>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:35.290149 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-beec802b-21af-4a51-8b12-2ac52cbd6d22 tempest-KeyPairsV2TestJSON-2129216155 tempest-KeyPairsV2TestJSON-2129216155-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1100164979" status: 202 len: 0 microversion: 2.1 time: 0.030481 Oct 04 21:48:35.292251 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 776/1490] 10.222.0.43 () {58 vars in 1221 bytes} [Tue Oct 4 21:48:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1100164979 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 21:48:35.310079 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-85f38e26-c0de-4285-a65d-a39963e827f3 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] [instance: 1e9957cf-cfeb-483d-bc32-73ca72a54eb9] Going to try to terminate instance {{(pid=134101) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:48:35.312549 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-b7c81c48-bb84-421c-ac1e-368bc1f82c76 tempest-KeyPairsV2TestJSON-2129216155 tempest-KeyPairsV2TestJSON-2129216155-project] Action: 'create', calling method: .version_select at 0x7fbb2f523310>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-719049013", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDs4qTD54Vd04SEtNTX0Yj3LLFySm9Ind1QouPxJRUWxDDzDjrRK3lJSJk4GcsLTA6myXAHcsR7VUl9jv26D5v7Ms7rKCFBjQ+A09urdBFihsj8oXXU3jAny7YeP6tnk3w=="}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:48:35.355990 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-b7c81c48-bb84-421c-ac1e-368bc1f82c76 tempest-KeyPairsV2TestJSON-2129216155 tempest-KeyPairsV2TestJSON-2129216155-project] Getting quotas for project 5293bac565a54f0ca4bfeb3ca2690bba. Resources: {'key_pairs'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:48:35.363535 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-b7c81c48-bb84-421c-ac1e-368bc1f82c76 tempest-KeyPairsV2TestJSON-2129216155 tempest-KeyPairsV2TestJSON-2129216155-project] Getting quotas for user b98ef5711b054ebea995210e87b9160e and project 5293bac565a54f0ca4bfeb3ca2690bba. Resources: {'key_pairs'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:48:35.401235 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-b7c81c48-bb84-421c-ac1e-368bc1f82c76 tempest-KeyPairsV2TestJSON-2129216155 tempest-KeyPairsV2TestJSON-2129216155-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.093878 Oct 04 21:48:35.413259 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 777/1491] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Oct 4 21:48:35 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:48:35.420709 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-93dabd4c-6299-4afb-a475-d2807b0d2471 tempest-KeyPairsV2TestJSON-2129216155 tempest-KeyPairsV2TestJSON-2129216155-project] Action: 'create', calling method: .version_select at 0x7fbb2f91baf0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-2122906416", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK2drt/H/+F5XM0YtJ7x9ClfZZWX/5fyuTHyQdu0Dwy05HDL/HPydPpNXUMQ8LsjNMASBupOh1cdca/58q6JCacjaSxHJ7Zt7SXOeUJMjUOtz+lGwra7gk+X9AzMYWg5Rg=="}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:48:35.455075 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-93dabd4c-6299-4afb-a475-d2807b0d2471 tempest-KeyPairsV2TestJSON-2129216155 tempest-KeyPairsV2TestJSON-2129216155-project] Getting quotas for project 5293bac565a54f0ca4bfeb3ca2690bba. Resources: {'key_pairs'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:48:35.469937 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-85f38e26-c0de-4285-a65d-a39963e827f3 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] 10.222.0.43 "DELETE /compute/v2.1/servers/1e9957cf-cfeb-483d-bc32-73ca72a54eb9" status: 204 len: 0 microversion: 2.1 time: 0.251177 Oct 04 21:48:35.472404 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-93dabd4c-6299-4afb-a475-d2807b0d2471 tempest-KeyPairsV2TestJSON-2129216155 tempest-KeyPairsV2TestJSON-2129216155-project] Getting quotas for user b98ef5711b054ebea995210e87b9160e and project 5293bac565a54f0ca4bfeb3ca2690bba. Resources: {'key_pairs'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:48:35.490417 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 715/1492] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 21:48:35 2022] DELETE /compute/v2.1/servers/1e9957cf-cfeb-483d-bc32-73ca72a54eb9 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:48:35.499286 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-582a41c9-b8ea-423f-bd03-61cfb9f21f0e tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:35.500019 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-582a41c9-b8ea-423f-bd03-61cfb9f21f0e tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] [instance: 1e9957cf-cfeb-483d-bc32-73ca72a54eb9] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:48:35.509154 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-582a41c9-b8ea-423f-bd03-61cfb9f21f0e tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:35.509645 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-582a41c9-b8ea-423f-bd03-61cfb9f21f0e tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:35.510326 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-582a41c9-b8ea-423f-bd03-61cfb9f21f0e tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:35.511092 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-582a41c9-b8ea-423f-bd03-61cfb9f21f0e tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:35.511579 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-582a41c9-b8ea-423f-bd03-61cfb9f21f0e tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:35.512413 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-582a41c9-b8ea-423f-bd03-61cfb9f21f0e tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:35.517215 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-93dabd4c-6299-4afb-a475-d2807b0d2471 tempest-KeyPairsV2TestJSON-2129216155 tempest-KeyPairsV2TestJSON-2129216155-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.102500 Oct 04 21:48:35.520920 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 778/1493] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Oct 4 21:48:35 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:48:35.537155 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-68cb4aad-f14b-4010-800c-1490bb0c11b4 tempest-KeyPairsV2TestJSON-2129216155 tempest-KeyPairsV2TestJSON-2129216155-project] Action: 'create', calling method: .version_select at 0x7fbb2f899700>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1777626017", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKtFqJ8ohw9rqGdwP+ET0IpLLdCOG889RMG3K1vJPPkeEPAbIAJNUzOk+TrMzjr++76o1ByKmjk3NQ3nGEA5Y9hXP5Xr38Mec+gOjOV5qtbFoav6dnwot6qqB9SvCT98KQ=="}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:48:35.558322 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-68cb4aad-f14b-4010-800c-1490bb0c11b4 tempest-KeyPairsV2TestJSON-2129216155 tempest-KeyPairsV2TestJSON-2129216155-project] Getting quotas for project 5293bac565a54f0ca4bfeb3ca2690bba. Resources: {'key_pairs'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:48:35.565300 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-68cb4aad-f14b-4010-800c-1490bb0c11b4 tempest-KeyPairsV2TestJSON-2129216155 tempest-KeyPairsV2TestJSON-2129216155-project] Getting quotas for user b98ef5711b054ebea995210e87b9160e and project 5293bac565a54f0ca4bfeb3ca2690bba. Resources: {'key_pairs'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:48:35.606062 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-68cb4aad-f14b-4010-800c-1490bb0c11b4 tempest-KeyPairsV2TestJSON-2129216155 tempest-KeyPairsV2TestJSON-2129216155-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.077640 Oct 04 21:48:35.606943 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 779/1494] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Oct 4 21:48:35 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:48:35.619470 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-e5536dce-f67a-4167-9674-907f8ef43059 tempest-KeyPairsV2TestJSON-2129216155 tempest-KeyPairsV2TestJSON-2129216155-project] Calling method '.version_select at 0x7fbb2f1f6820>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:35.624236 n-d-860284-1 devstack@n-api.service[134102]: WARNING oslo_db.sqlalchemy.utils [None req-e5536dce-f67a-4167-9674-907f8ef43059 tempest-KeyPairsV2TestJSON-2129216155 tempest-KeyPairsV2TestJSON-2129216155-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 04 21:48:35.632535 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-e5536dce-f67a-4167-9674-907f8ef43059 tempest-KeyPairsV2TestJSON-2129216155 tempest-KeyPairsV2TestJSON-2129216155-project] 10.222.0.43 "GET /compute/v2.1/os-keypairs" status: 200 len: 1093 microversion: 2.1 time: 0.018327 Oct 04 21:48:35.633377 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 780/1495] 10.222.0.43 () {58 vars in 1137 bytes} [Tue Oct 4 21:48:35 2022] GET /compute/v2.1/os-keypairs => generated 1093 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:48:35.646485 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-009a7570-6fa3-47dd-81c5-89a4b29889cb tempest-KeyPairsV2TestJSON-2129216155 tempest-KeyPairsV2TestJSON-2129216155-project] Calling method '.version_select at 0x7fbb2f754f70>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:35.675851 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-009a7570-6fa3-47dd-81c5-89a4b29889cb tempest-KeyPairsV2TestJSON-2129216155 tempest-KeyPairsV2TestJSON-2129216155-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1777626017" status: 202 len: 0 microversion: 2.1 time: 0.034522 Oct 04 21:48:35.677789 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 781/1496] 10.222.0.43 () {58 vars in 1278 bytes} [Tue Oct 4 21:48:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1777626017 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:48:35.686873 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-b0eb7516-78a9-479f-af1f-5234152c6187 tempest-KeyPairsV2TestJSON-2129216155 tempest-KeyPairsV2TestJSON-2129216155-project] Calling method '.version_select at 0x7fbb2f1f6790>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:35.711630 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-b0eb7516-78a9-479f-af1f-5234152c6187 tempest-KeyPairsV2TestJSON-2129216155 tempest-KeyPairsV2TestJSON-2129216155-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-2122906416" status: 202 len: 0 microversion: 2.1 time: 0.029251 Oct 04 21:48:35.712229 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 782/1497] 10.222.0.43 () {58 vars in 1278 bytes} [Tue Oct 4 21:48:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-2122906416 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:48:35.722012 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-bee85dd3-f4c9-484a-8800-4e3eb9d66972 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:35.722853 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-bee85dd3-f4c9-484a-8800-4e3eb9d66972 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: be573c06-25e7-485e-9443-5bc21196a45e] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:48:35.731302 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bee85dd3-f4c9-484a-8800-4e3eb9d66972 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:35.731921 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bee85dd3-f4c9-484a-8800-4e3eb9d66972 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:35.732548 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bee85dd3-f4c9-484a-8800-4e3eb9d66972 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:35.733612 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bee85dd3-f4c9-484a-8800-4e3eb9d66972 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:35.734241 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bee85dd3-f4c9-484a-8800-4e3eb9d66972 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:35.734712 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bee85dd3-f4c9-484a-8800-4e3eb9d66972 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:35.914137 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-582a41c9-b8ea-423f-bd03-61cfb9f21f0e tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2dff38dea346219f6534426fd27ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6a5f1476ac48f3831f2ed202dacdf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:48:35.917223 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:48:35.927850 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-582a41c9-b8ea-423f-bd03-61cfb9f21f0e tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] 10.222.0.43 "GET /compute/v2.1/servers/1e9957cf-cfeb-483d-bc32-73ca72a54eb9" status: 200 len: 1680 microversion: 2.1 time: 0.434721 Oct 04 21:48:35.928773 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 716/1498] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:48:35 2022] GET /compute/v2.1/servers/1e9957cf-cfeb-483d-bc32-73ca72a54eb9 => generated 1680 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:48:35.937716 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-7147cd68-2e28-46d7-a27d-d835cf8bb485 tempest-KeyPairsV2TestJSON-2129216155 tempest-KeyPairsV2TestJSON-2129216155-project] Calling method '.version_select at 0x7fbb2edf09d0>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:35.966778 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-7147cd68-2e28-46d7-a27d-d835cf8bb485 tempest-KeyPairsV2TestJSON-2129216155 tempest-KeyPairsV2TestJSON-2129216155-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-719049013" status: 202 len: 0 microversion: 2.1 time: 0.036696 Oct 04 21:48:35.968174 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 717/1499] 10.222.0.43 () {58 vars in 1275 bytes} [Tue Oct 4 21:48:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-719049013 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:48:36.064147 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-bee85dd3-f4c9-484a-8800-4e3eb9d66972 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:48:36.084572 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-bee85dd3-f4c9-484a-8800-4e3eb9d66972 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/be573c06-25e7-485e-9443-5bc21196a45e" status: 200 len: 1476 microversion: 2.1 time: 0.365977 Oct 04 21:48:36.085644 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 783/1500] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:48:35 2022] GET /compute/v2.1/servers/be573c06-25e7-485e-9443-5bc21196a45e => generated 1476 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:48:36.953263 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-de31ae52-b352-450f-9891-64031b3307a9 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:36.953879 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-de31ae52-b352-450f-9891-64031b3307a9 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] [instance: 1e9957cf-cfeb-483d-bc32-73ca72a54eb9] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:48:36.967335 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-de31ae52-b352-450f-9891-64031b3307a9 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:36.968100 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-de31ae52-b352-450f-9891-64031b3307a9 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:36.968784 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-de31ae52-b352-450f-9891-64031b3307a9 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:36.969744 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-de31ae52-b352-450f-9891-64031b3307a9 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:36.983212 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-de31ae52-b352-450f-9891-64031b3307a9 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:36.983977 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-de31ae52-b352-450f-9891-64031b3307a9 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:37.110449 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-982d8be0-2770-449b-8127-9bdca4f4920d tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:37.111693 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-982d8be0-2770-449b-8127-9bdca4f4920d tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: be573c06-25e7-485e-9443-5bc21196a45e] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:48:37.120931 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-982d8be0-2770-449b-8127-9bdca4f4920d tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:37.124802 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-982d8be0-2770-449b-8127-9bdca4f4920d tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:37.125504 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-982d8be0-2770-449b-8127-9bdca4f4920d tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:37.126500 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-982d8be0-2770-449b-8127-9bdca4f4920d tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:37.127130 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-982d8be0-2770-449b-8127-9bdca4f4920d tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:37.128638 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-982d8be0-2770-449b-8127-9bdca4f4920d tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:37.380533 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-de31ae52-b352-450f-9891-64031b3307a9 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2dff38dea346219f6534426fd27ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6a5f1476ac48f3831f2ed202dacdf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:48:37.396446 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-de31ae52-b352-450f-9891-64031b3307a9 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] 10.222.0.43 "GET /compute/v2.1/servers/1e9957cf-cfeb-483d-bc32-73ca72a54eb9" status: 200 len: 1680 microversion: 2.1 time: 0.443294 Oct 04 21:48:37.404315 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 718/1501] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:48:36 2022] GET /compute/v2.1/servers/1e9957cf-cfeb-483d-bc32-73ca72a54eb9 => generated 1680 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:48:37.572335 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-982d8be0-2770-449b-8127-9bdca4f4920d tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:48:37.595251 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-982d8be0-2770-449b-8127-9bdca4f4920d tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/be573c06-25e7-485e-9443-5bc21196a45e" status: 200 len: 1476 microversion: 2.1 time: 0.488650 Oct 04 21:48:37.603444 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 784/1502] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:48:37 2022] GET /compute/v2.1/servers/be573c06-25e7-485e-9443-5bc21196a45e => generated 1476 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:48:37.659939 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-3da518d3-9d80-4f1c-8d22-270f951cc3e7 tempest-FlavorsV2NegativeTest-1096397576 tempest-FlavorsV2NegativeTest-1096397576-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:37.669112 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-3da518d3-9d80-4f1c-8d22-270f951cc3e7 tempest-FlavorsV2NegativeTest-1096397576 tempest-FlavorsV2NegativeTest-1096397576-project] 10.222.0.43 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.268078 Oct 04 21:48:37.669765 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 719/1503] 10.222.0.43 () {58 vars in 1137 bytes} [Tue Oct 4 21:48:37 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:48:38.425989 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-e2701a5e-ad29-4cc5-a8a0-9cf32212672d tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:38.428061 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-e2701a5e-ad29-4cc5-a8a0-9cf32212672d tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] [instance: 1e9957cf-cfeb-483d-bc32-73ca72a54eb9] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:48:38.437637 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=4,nova_api:DELETE=3 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:48:38.452084 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e2701a5e-ad29-4cc5-a8a0-9cf32212672d tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:38.453034 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e2701a5e-ad29-4cc5-a8a0-9cf32212672d tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:38.453585 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e2701a5e-ad29-4cc5-a8a0-9cf32212672d tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:38.454806 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e2701a5e-ad29-4cc5-a8a0-9cf32212672d tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:38.455380 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e2701a5e-ad29-4cc5-a8a0-9cf32212672d tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:38.457049 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e2701a5e-ad29-4cc5-a8a0-9cf32212672d tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:38.622909 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-8d45cb95-04c8-4c6b-adbc-9e4148891db5 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:38.623648 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-8d45cb95-04c8-4c6b-adbc-9e4148891db5 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: be573c06-25e7-485e-9443-5bc21196a45e] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:48:38.648629 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8d45cb95-04c8-4c6b-adbc-9e4148891db5 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:38.655363 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8d45cb95-04c8-4c6b-adbc-9e4148891db5 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:38.655840 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8d45cb95-04c8-4c6b-adbc-9e4148891db5 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:38.656621 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8d45cb95-04c8-4c6b-adbc-9e4148891db5 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:38.657095 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8d45cb95-04c8-4c6b-adbc-9e4148891db5 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:38.657531 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8d45cb95-04c8-4c6b-adbc-9e4148891db5 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:38.813873 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-e2701a5e-ad29-4cc5-a8a0-9cf32212672d tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2dff38dea346219f6534426fd27ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6a5f1476ac48f3831f2ed202dacdf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:48:38.833444 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-e2701a5e-ad29-4cc5-a8a0-9cf32212672d tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] 10.222.0.43 "GET /compute/v2.1/servers/1e9957cf-cfeb-483d-bc32-73ca72a54eb9" status: 200 len: 1680 microversion: 2.1 time: 0.410389 Oct 04 21:48:38.838462 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 785/1504] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:48:38 2022] GET /compute/v2.1/servers/1e9957cf-cfeb-483d-bc32-73ca72a54eb9 => generated 1680 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:48:38.983442 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-8d45cb95-04c8-4c6b-adbc-9e4148891db5 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:48:38.996398 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-8d45cb95-04c8-4c6b-adbc-9e4148891db5 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/be573c06-25e7-485e-9443-5bc21196a45e" status: 200 len: 1476 microversion: 2.1 time: 0.379448 Oct 04 21:48:38.997538 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 720/1505] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:48:38 2022] GET /compute/v2.1/servers/be573c06-25e7-485e-9443-5bc21196a45e => generated 1476 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:48:39.152659 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-d5107769-aa34-4689-9a0e-4fa07d4e793d tempest-FlavorsV2NegativeTest-1096397576 tempest-FlavorsV2NegativeTest-1096397576-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-575068471", "imageRef": "c78f3d7e-4105-471d-a9db-1999a8612aa1", "flavorRef": "452"}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:48:39.257552 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.network.neutron [None req-d5107769-aa34-4689-9a0e-4fa07d4e793d tempest-FlavorsV2NegativeTest-1096397576 tempest-FlavorsV2NegativeTest-1096397576-project] validate_networks() for None {{(pid=134102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:48:39.682000 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-d5107769-aa34-4689-9a0e-4fa07d4e793d tempest-FlavorsV2NegativeTest-1096397576 tempest-FlavorsV2NegativeTest-1096397576-project] HTTP exception thrown: Flavor's memory is too small for requested image. Oct 04 21:48:39.684376 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-d5107769-aa34-4689-9a0e-4fa07d4e793d tempest-FlavorsV2NegativeTest-1096397576 tempest-FlavorsV2NegativeTest-1096397576-project] Request method failure captured: Oct 04 21:48:39.684376 n-d-860284-1 devstack@n-api.service[134102]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 21:48:39.684376 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 21:48:39.684376 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 21:48:39.684376 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 21:48:39.684376 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 142 Oct 04 21:48:39.684376 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 21:48:39.684376 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 21:48:39.684376 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 21:48:39.684376 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 21:48:39.684376 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPKo1Z4l-BkS3DD4mmLERpCMymWFSwEmIfqKp2G-57h1Gma-QLre2GxOF7ybh_klZX_Se9cds9qpD-Koaxvl4LECh6H1gKVNXk5JtKJbfIRVmMfupr14lJYSFTBKnNE337XeALAByJm8gc__CxE8gEHvyOoQcNFjZVXjBF-yKnS4PjQ4 Oct 04 21:48:39.684376 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 21:48:39.684376 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 21:48:39.684376 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 21:48:39.684376 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 21:48:39.684376 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 21:48:39.684376 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 21:48:39.684376 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: b20b62fa3d1e4a288397035740008baa Oct 04 21:48:39.684376 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-FlavorsV2NegativeTest-1096397576 Oct 04 21:48:39.684376 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 21:48:39.684376 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 21:48:39.686023 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b20b62fa3d1e4a288397035740008baa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_b20b62fa3d1e4a288397035740008baa", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b20b62fa3d1e4a288397035740008baa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/b20b62fa3d1e4a288397035740008baa"}]}] Oct 04 21:48:39.686023 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-FlavorsV2NegativeTest-1096397576 Oct 04 21:48:39.686023 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: b20b62fa3d1e4a288397035740008baa Oct 04 21:48:39.686023 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-1096397576 Oct 04 21:48:39.686023 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-FlavorsV2NegativeTest-1096397576-project Oct 04 21:48:39.686023 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 21:48:39.686023 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 21:48:39.686023 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: f6e216b1f76b4fe89f661b7815d7a8ce Oct 04 21:48:39.686023 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-FlavorsV2NegativeTest-1096397576-project Oct 04 21:48:39.686023 n-d-860284-1 devstack@n-api.service[134102]: Oct 04 21:48:39.686023 n-d-860284-1 devstack@n-api.service[134102]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-575068471", "imageRef": "c78f3d7e-4105-471d-a9db-1999a8612aa1", "flavorRef": "452"}} Oct 04 21:48:39.686023 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 21:48:39.686880 n-d-860284-1 devstack@n-api.service[134102]: exception: Flavor's memory is too small for requested image. Oct 04 21:48:39.686880 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-575068471', 'imageRef': 'c78f3d7e-4105-471d-a9db-1999a8612aa1', 'flavorRef': '452'}}} Oct 04 21:48:39.686880 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:48:39.686880 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:48:39.686880 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 21:48:39.686880 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 21:48:39.686880 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 21:48:39.686880 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 21:48:39.686880 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Oct 04 21:48:39.686880 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Oct 04 21:48:39.686880 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1019, in _checks_for_create_and_rebuild Oct 04 21:48:39.686880 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, Oct 04 21:48:39.686880 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 683, in _validate_flavor_image Oct 04 21:48:39.686880 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( Oct 04 21:48:39.686880 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 751, in _validate_flavor_image_nostatus Oct 04 21:48:39.686880 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() Oct 04 21:48:39.686880 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. Oct 04 21:48:39.686880 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:48:39.686880 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:48:39.686880 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:48:39.688168 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:48:39.688168 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:48:39.688168 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:48:39.688168 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:48:39.688168 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:48:39.688168 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:48:39.688168 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:48:39.688168 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:48:39.688168 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:48:39.688168 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:48:39.688168 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:48:39.688168 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:48:39.688168 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:48:39.688168 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 21:48:39.688168 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create Oct 04 21:48:39.688168 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 04 21:48:39.688168 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. Oct 04 21:48:39.688168 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:48:39.688168 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:48:39.688168 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:48:39.688168 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:48:39.689472 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:48:39.689472 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:48:39.689472 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:48:39.689472 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:48:39.689472 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. Oct 04 21:48:39.689472 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:48:39.689472 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-d5107769-aa34-4689-9a0e-4fa07d4e793d tempest-FlavorsV2NegativeTest-1096397576 tempest-FlavorsV2NegativeTest-1096397576-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:48:39.689472 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-d5107769-aa34-4689-9a0e-4fa07d4e793d tempest-FlavorsV2NegativeTest-1096397576 tempest-FlavorsV2NegativeTest-1096397576-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 0.537818 Oct 04 21:48:39.690047 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 786/1506] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 21:48:39 2022] POST /compute/v2.1/servers => generated 93 bytes in 542 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 04 21:48:39.836523 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-3ed66d25-1b1f-4966-8027-5a9bb0254a91 tempest-KeyPairsNegativeTestJSON-167233433 tempest-KeyPairsNegativeTestJSON-167233433-project] Action: 'create', calling method: .version_select at 0x7fbb2eec6940>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNvtJsIhfQ3ZbMPXbJLry/7UP7GRzVtj8sYzxlAF0mmqXJkfaCma9BeqR7zDp9BpPUssObT/sjjwYPMw83m9fjiylUdQ+nd6qLYT0MOzWWPRAdooSmhRFI7Br/2dM8YoVg=="}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:48:39.844725 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-3ed66d25-1b1f-4966-8027-5a9bb0254a91 tempest-KeyPairsNegativeTestJSON-167233433 tempest-KeyPairsNegativeTestJSON-167233433-project] Request method failure captured: Oct 04 21:48:39.844725 n-d-860284-1 devstack@n-api.service[134101]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 04 21:48:39.844725 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 21:48:39.844725 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 21:48:39.844725 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 21:48:39.844725 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 257 Oct 04 21:48:39.844725 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 21:48:39.844725 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 21:48:39.844725 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 21:48:39.844725 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 21:48:39.844725 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPKo3e_YJgsgHBePaUl3tx-T2DQ8PiNKCuiUlfCFseD1omSCoRLB6ZRZGK_qar6_pFQIC6ba4s1FxLD8e0ub09XegaqFYbEN_oNoB4nGhQrrg3ETKzzwAt48_GCnz9vQs7lxaW_0p4gldogt1etIshQfAYc9SRQ5Omqd_2NKOreDDgDk Oct 04 21:48:39.844725 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 21:48:39.844725 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 21:48:39.844725 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 21:48:39.844725 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 21:48:39.844725 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 21:48:39.844725 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 21:48:39.844725 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: 3167fc598ada4ac0ac290f3edae8aa85 Oct 04 21:48:39.844725 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-167233433 Oct 04 21:48:39.844725 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 21:48:39.844725 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 21:48:39.846214 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/3167fc598ada4ac0ac290f3edae8aa85"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_3167fc598ada4ac0ac290f3edae8aa85", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/3167fc598ada4ac0ac290f3edae8aa85"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/3167fc598ada4ac0ac290f3edae8aa85"}]}] Oct 04 21:48:39.846214 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-KeyPairsNegativeTestJSON-167233433 Oct 04 21:48:39.846214 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: 3167fc598ada4ac0ac290f3edae8aa85 Oct 04 21:48:39.846214 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-167233433 Oct 04 21:48:39.846214 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-KeyPairsNegativeTestJSON-167233433-project Oct 04 21:48:39.846214 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 21:48:39.846214 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 21:48:39.846214 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 63055f4ea2964d6dabcd86f6ce42d912 Oct 04 21:48:39.846214 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-KeyPairsNegativeTestJSON-167233433-project Oct 04 21:48:39.846214 n-d-860284-1 devstack@n-api.service[134101]: Oct 04 21:48:39.846214 n-d-860284-1 devstack@n-api.service[134101]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNvtJsIhfQ3ZbMPXbJLry/7UP7GRzVtj8sYzxlAF0mmqXJkfaCma9BeqR7zDp9BpPUssObT/sjjwYPMw83m9fjiylUdQ+nd6qLYT0MOzWWPRAdooSmhRFI7Br/2dM8YoVg=="}} Oct 04 21:48:39.846995 n-d-860284-1 devstack@n-api.service[134101]: method: Oct 04 21:48:39.846995 n-d-860284-1 devstack@n-api.service[134101]: exception: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 04 21:48:39.846995 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNvtJsIhfQ3ZbMPXbJLry/7UP7GRzVtj8sYzxlAF0mmqXJkfaCma9BeqR7zDp9BpPUssObT/sjjwYPMw83m9fjiylUdQ+nd6qLYT0MOzWWPRAdooSmhRFI7Br/2dM8YoVg=='}}} Oct 04 21:48:39.846995 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:48:39.846995 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:48:39.846995 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 04 21:48:39.846995 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 04 21:48:39.846995 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 161, in _validate_keypair_name_20 Oct 04 21:48:39.846995 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return _validate_keypair_name(keypair_name, safe_chars) Oct 04 21:48:39.846995 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 175, in _validate_keypair_name Oct 04 21:48:39.846995 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InvalidName(reason=reason) Oct 04 21:48:39.846995 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InvalidName: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 04 21:48:39.846995 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:48:39.846995 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 04 21:48:39.846995 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:48:39.846995 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:48:39.846995 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 21:48:39.852912 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 21:48:39.852912 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 21:48:39.852912 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise error Oct 04 21:48:39.852912 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'key_/.\\@:' is not a 'keypair_name_20' Oct 04 21:48:39.852912 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:48:39.852912 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['keypair']['properties']['name']['allOf'][1]: Oct 04 21:48:39.852912 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi {'format': 'keypair_name_20', Oct 04 21:48:39.852912 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi 'maxLength': 255, Oct 04 21:48:39.852912 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi 'minLength': 1, Oct 04 21:48:39.852912 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 04 21:48:39.852912 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:48:39.852912 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi On instance['keypair']['name']: Oct 04 21:48:39.852912 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi 'key_/.\\@:' Oct 04 21:48:39.852912 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:48:39.852912 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:48:39.852912 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:48:39.852912 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:48:39.852912 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:48:39.852912 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:48:39.852912 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:48:39.852912 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:48:39.852912 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:48:39.852912 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:48:39.855501 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:48:39.855501 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:48:39.855501 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:48:39.855501 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:48:39.855501 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 21:48:39.855501 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 21:48:39.855501 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 21:48:39.855501 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 21:48:39.855501 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 21:48:39.855501 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 21:48:39.855501 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 04 21:48:39.855501 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:48:39.855501 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:48:39.855501 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:48:39.855501 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:48:39.855501 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:48:39.855501 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:48:39.855501 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 21:48:39.855501 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 21:48:39.857128 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 04 21:48:39.857128 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:48:39.857128 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-3ed66d25-1b1f-4966-8027-5a9bb0254a91 tempest-KeyPairsNegativeTestJSON-167233433 tempest-KeyPairsNegativeTestJSON-167233433-project] Returning 400 to user: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:48:39.857128 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-3ed66d25-1b1f-4966-8027-5a9bb0254a91 tempest-KeyPairsNegativeTestJSON-167233433 tempest-KeyPairsNegativeTestJSON-167233433-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 400 len: 193 microversion: 2.1 time: 0.186956 Oct 04 21:48:39.857128 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 721/1507] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Oct 4 21:48:39 2022] POST /compute/v2.1/os-keypairs => generated 193 bytes in 189 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 04 21:48:39.864421 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-e1658178-36ee-4763-8e57-e8d9942ed4a5 tempest-KeyPairsNegativeTestJSON-167233433 tempest-KeyPairsNegativeTestJSON-167233433-project] Action: 'create', calling method: .version_select at 0x7fbb2f16dd30>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-589706096", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:48:39.885668 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-5eace3c0-5e19-489d-ba7f-d24aa0c2493f tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:39.890898 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-5eace3c0-5e19-489d-ba7f-d24aa0c2493f tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] [instance: 1e9957cf-cfeb-483d-bc32-73ca72a54eb9] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:48:39.909120 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5eace3c0-5e19-489d-ba7f-d24aa0c2493f tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:39.909632 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5eace3c0-5e19-489d-ba7f-d24aa0c2493f tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:39.910080 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5eace3c0-5e19-489d-ba7f-d24aa0c2493f tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:39.910947 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5eace3c0-5e19-489d-ba7f-d24aa0c2493f tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:39.911604 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5eace3c0-5e19-489d-ba7f-d24aa0c2493f tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:39.912044 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5eace3c0-5e19-489d-ba7f-d24aa0c2493f tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:39.922007 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-e1658178-36ee-4763-8e57-e8d9942ed4a5 tempest-KeyPairsNegativeTestJSON-167233433 tempest-KeyPairsNegativeTestJSON-167233433-project] Getting quotas for project 3167fc598ada4ac0ac290f3edae8aa85. Resources: {'key_pairs'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:48:39.935826 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-e1658178-36ee-4763-8e57-e8d9942ed4a5 tempest-KeyPairsNegativeTestJSON-167233433 tempest-KeyPairsNegativeTestJSON-167233433-project] Getting quotas for user 63055f4ea2964d6dabcd86f6ce42d912 and project 3167fc598ada4ac0ac290f3edae8aa85. Resources: {'key_pairs'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:48:39.994231 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-e1658178-36ee-4763-8e57-e8d9942ed4a5 tempest-KeyPairsNegativeTestJSON-167233433 tempest-KeyPairsNegativeTestJSON-167233433-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 04 21:48:40.018255 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-e1658178-36ee-4763-8e57-e8d9942ed4a5 tempest-KeyPairsNegativeTestJSON-167233433 tempest-KeyPairsNegativeTestJSON-167233433-project] Request method failure captured: Oct 04 21:48:40.018255 n-d-860284-1 devstack@n-api.service[134102]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 04 21:48:40.018255 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 21:48:40.018255 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 21:48:40.018255 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 21:48:40.018255 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 2166 Oct 04 21:48:40.018255 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 21:48:40.018255 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 21:48:40.018255 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 21:48:40.018255 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 21:48:40.018255 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPKo3e_YJgsgHBePaUl3tx-T2DQ8PiNKCuiUlfCFseD1omSCoRLB6ZRZGK_qar6_pFQIC6ba4s1FxLD8e0ub09XegaqFYbEN_oNoB4nGhQrrg3ETKzzwAt48_GCnz9vQs7lxaW_0p4gldogt1etIshQfAYc9SRQ5Omqd_2NKOreDDgDk Oct 04 21:48:40.018255 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 21:48:40.018255 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 21:48:40.018255 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 21:48:40.018255 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 21:48:40.018255 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 21:48:40.018255 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 21:48:40.018255 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: 3167fc598ada4ac0ac290f3edae8aa85 Oct 04 21:48:40.018255 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-167233433 Oct 04 21:48:40.018255 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 21:48:40.018255 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 21:48:40.018255 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/3167fc598ada4ac0ac290f3edae8aa85"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_3167fc598ada4ac0ac290f3edae8aa85", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/3167fc598ada4ac0ac290f3edae8aa85"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/3167fc598ada4ac0ac290f3edae8aa85"}]}] Oct 04 21:48:40.018255 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-KeyPairsNegativeTestJSON-167233433 Oct 04 21:48:40.018255 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: 3167fc598ada4ac0ac290f3edae8aa85 Oct 04 21:48:40.018255 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-167233433 Oct 04 21:48:40.018255 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-KeyPairsNegativeTestJSON-167233433-project Oct 04 21:48:40.018255 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 21:48:40.018255 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 21:48:40.018255 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: 63055f4ea2964d6dabcd86f6ce42d912 Oct 04 21:48:40.018255 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-KeyPairsNegativeTestJSON-167233433-project Oct 04 21:48:40.018255 n-d-860284-1 devstack@n-api.service[134102]: Oct 04 21:48:40.018255 n-d-860284-1 devstack@n-api.service[134102]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-589706096", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} Oct 04 21:48:40.018255 n-d-860284-1 devstack@n-api.service[134102]: method: Oct 04 21:48:40.018255 n-d-860284-1 devstack@n-api.service[134102]: exception: Keypair data is invalid: failed to generate fingerprint Oct 04 21:48:40.023565 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-589706096', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} Oct 04 21:48:40.023565 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:48:40.023565 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:48:40.023565 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 04 21:48:40.023565 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 04 21:48:40.023565 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key Oct 04 21:48:40.023565 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") Oct 04 21:48:40.023565 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format Oct 04 21:48:40.023565 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:48:40.023565 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:48:40.023565 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:48:40.023565 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:48:40.023565 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 04 21:48:40.023565 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 04 21:48:40.023565 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 21:48:40.023565 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 21:48:40.023565 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 21:48:40.023565 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 21:48:40.023565 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 21:48:40.023565 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 21:48:40.023565 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 21:48:40.023565 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 21:48:40.023565 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Oct 04 21:48:40.023565 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 04 21:48:40.023565 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Oct 04 21:48:40.023565 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 04 21:48:40.023565 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 04 21:48:40.023565 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 04 21:48:40.023565 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 04 21:48:40.023565 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:48:40.023565 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:48:40.023565 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:48:40.023565 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:48:40.023565 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:48:40.023565 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:48:40.023565 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:48:40.023565 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:48:40.023565 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:48:40.023565 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:48:40.023565 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:48:40.023565 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:48:40.037073 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:48:40.037073 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:48:40.037073 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:48:40.037073 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:48:40.037073 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 04 21:48:40.037073 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 04 21:48:40.037073 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 04 21:48:40.037073 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 04 21:48:40.037073 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 04 21:48:40.037073 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:48:40.037073 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:48:40.037073 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:48:40.037073 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:48:40.037073 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:48:40.037073 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:48:40.037073 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:48:40.037073 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:48:40.037073 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 04 21:48:40.037073 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:48:40.037073 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-e1658178-36ee-4763-8e57-e8d9942ed4a5 tempest-KeyPairsNegativeTestJSON-167233433 tempest-KeyPairsNegativeTestJSON-167233433-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:48:40.037073 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-e1658178-36ee-4763-8e57-e8d9942ed4a5 tempest-KeyPairsNegativeTestJSON-167233433 tempest-KeyPairsNegativeTestJSON-167233433-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.178446 Oct 04 21:48:40.037073 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 787/1508] 10.222.0.43 () {60 vars in 1160 bytes} [Tue Oct 4 21:48:39 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 181 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 04 21:48:40.056790 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-5eace3c0-5e19-489d-ba7f-d24aa0c2493f tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2dff38dea346219f6534426fd27ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6a5f1476ac48f3831f2ed202dacdf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:48:40.068350 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-5eace3c0-5e19-489d-ba7f-d24aa0c2493f tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] 10.222.0.43 "GET /compute/v2.1/servers/1e9957cf-cfeb-483d-bc32-73ca72a54eb9" status: 200 len: 1613 microversion: 2.1 time: 0.194185 Oct 04 21:48:40.070171 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 722/1509] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:48:39 2022] GET /compute/v2.1/servers/1e9957cf-cfeb-483d-bc32-73ca72a54eb9 => generated 1613 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:48:40.071239 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-5ed2ce91-f366-431a-9f18-c9263441f4b2 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:40.072370 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-5ed2ce91-f366-431a-9f18-c9263441f4b2 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: be573c06-25e7-485e-9443-5bc21196a45e] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:48:40.075613 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-86179f0a-2eec-44fa-9671-3317aa86087f tempest-KeyPairsNegativeTestJSON-167233433 tempest-KeyPairsNegativeTestJSON-167233433-project] Action: 'create', calling method: .version_select at 0x7fbb2ee094c0>, body: {"keypair": {"name": "tempest-keypair-2051274704", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHhCtG1CkSYy8PH3DKnpjohKgw1OLUtDwkJlSL4Pm7nTRR1ilKSxJf8jAeE+mYqE7HRgLA6Zni0Inn+h+3KNX2zLQTD3rd4kPFcfcCkc5XNIdVXnjXPhbRTF1LGsjvJ2iA=="}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:48:40.093829 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5ed2ce91-f366-431a-9f18-c9263441f4b2 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:40.095978 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5ed2ce91-f366-431a-9f18-c9263441f4b2 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:40.096433 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5ed2ce91-f366-431a-9f18-c9263441f4b2 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:40.097201 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5ed2ce91-f366-431a-9f18-c9263441f4b2 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:40.097728 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5ed2ce91-f366-431a-9f18-c9263441f4b2 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:40.098175 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5ed2ce91-f366-431a-9f18-c9263441f4b2 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:40.113174 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-86179f0a-2eec-44fa-9671-3317aa86087f tempest-KeyPairsNegativeTestJSON-167233433 tempest-KeyPairsNegativeTestJSON-167233433-project] Getting quotas for project 3167fc598ada4ac0ac290f3edae8aa85. Resources: {'key_pairs'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:48:40.127668 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-86179f0a-2eec-44fa-9671-3317aa86087f tempest-KeyPairsNegativeTestJSON-167233433 tempest-KeyPairsNegativeTestJSON-167233433-project] Getting quotas for user 63055f4ea2964d6dabcd86f6ce42d912 and project 3167fc598ada4ac0ac290f3edae8aa85. Resources: {'key_pairs'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:48:40.146173 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=100 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:48:40.152931 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=91,nova_api:DELETE=6,nova_api:INSERT=2,nova_api:UPDATE=1 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:48:40.219080 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-86179f0a-2eec-44fa-9671-3317aa86087f tempest-KeyPairsNegativeTestJSON-167233433 tempest-KeyPairsNegativeTestJSON-167233433-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.147518 Oct 04 21:48:40.219620 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 723/1510] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Oct 4 21:48:40 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:48:40.244344 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-cb51dcd0-c3b7-4208-8e61-9837fdf6f47f tempest-KeyPairsNegativeTestJSON-167233433 tempest-KeyPairsNegativeTestJSON-167233433-project] Action: 'create', calling method: .version_select at 0x7fbb2f05e700>, body: {"keypair": {"name": "tempest-keypair-2051274704", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLCRsxwwq89H82QEO0wuzVoEAimz6d57gIECEKabLV4R5ECy3UlNX6uPbV6DfIEWfgFYqBgeRW0GriaJ5wKNVLZVWh0/TqZ7TOjZwPETIHBaSCjS+6qv150ZoEVL7ktwBw=="}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:48:40.289296 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-cb51dcd0-c3b7-4208-8e61-9837fdf6f47f tempest-KeyPairsNegativeTestJSON-167233433 tempest-KeyPairsNegativeTestJSON-167233433-project] Getting quotas for project 3167fc598ada4ac0ac290f3edae8aa85. Resources: {'key_pairs'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:48:40.305952 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-cb51dcd0-c3b7-4208-8e61-9837fdf6f47f tempest-KeyPairsNegativeTestJSON-167233433 tempest-KeyPairsNegativeTestJSON-167233433-project] Getting quotas for user 63055f4ea2964d6dabcd86f6ce42d912 and project 3167fc598ada4ac0ac290f3edae8aa85. Resources: {'key_pairs'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:48:40.375023 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-cb51dcd0-c3b7-4208-8e61-9837fdf6f47f tempest-KeyPairsNegativeTestJSON-167233433 tempest-KeyPairsNegativeTestJSON-167233433-project] HTTP exception thrown: Key pair 'tempest-keypair-2051274704' already exists. Oct 04 21:48:40.387727 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-cb51dcd0-c3b7-4208-8e61-9837fdf6f47f tempest-KeyPairsNegativeTestJSON-167233433 tempest-KeyPairsNegativeTestJSON-167233433-project] Request method failure captured: Oct 04 21:48:40.387727 n-d-860284-1 devstack@n-api.service[134101]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 04 21:48:40.387727 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 21:48:40.387727 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 21:48:40.387727 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 21:48:40.387727 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 273 Oct 04 21:48:40.387727 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 21:48:40.387727 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 21:48:40.387727 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 21:48:40.387727 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 21:48:40.387727 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPKo3e_YJgsgHBePaUl3tx-T2DQ8PiNKCuiUlfCFseD1omSCoRLB6ZRZGK_qar6_pFQIC6ba4s1FxLD8e0ub09XegaqFYbEN_oNoB4nGhQrrg3ETKzzwAt48_GCnz9vQs7lxaW_0p4gldogt1etIshQfAYc9SRQ5Omqd_2NKOreDDgDk Oct 04 21:48:40.387727 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 21:48:40.387727 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 21:48:40.387727 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 21:48:40.387727 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 21:48:40.387727 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 21:48:40.387727 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 21:48:40.387727 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: 3167fc598ada4ac0ac290f3edae8aa85 Oct 04 21:48:40.387727 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-167233433 Oct 04 21:48:40.387727 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 21:48:40.387727 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 21:48:40.387727 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/3167fc598ada4ac0ac290f3edae8aa85"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_3167fc598ada4ac0ac290f3edae8aa85", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/3167fc598ada4ac0ac290f3edae8aa85"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/3167fc598ada4ac0ac290f3edae8aa85"}]}] Oct 04 21:48:40.387727 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-KeyPairsNegativeTestJSON-167233433 Oct 04 21:48:40.387727 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: 3167fc598ada4ac0ac290f3edae8aa85 Oct 04 21:48:40.387727 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-167233433 Oct 04 21:48:40.387727 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-KeyPairsNegativeTestJSON-167233433-project Oct 04 21:48:40.387727 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 21:48:40.387727 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 21:48:40.387727 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 63055f4ea2964d6dabcd86f6ce42d912 Oct 04 21:48:40.387727 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-KeyPairsNegativeTestJSON-167233433-project Oct 04 21:48:40.387727 n-d-860284-1 devstack@n-api.service[134101]: Oct 04 21:48:40.387727 n-d-860284-1 devstack@n-api.service[134101]: {"keypair": {"name": "tempest-keypair-2051274704", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLCRsxwwq89H82QEO0wuzVoEAimz6d57gIECEKabLV4R5ECy3UlNX6uPbV6DfIEWfgFYqBgeRW0GriaJ5wKNVLZVWh0/TqZ7TOjZwPETIHBaSCjS+6qv150ZoEVL7ktwBw=="}} Oct 04 21:48:40.387727 n-d-860284-1 devstack@n-api.service[134101]: method: Oct 04 21:48:40.387727 n-d-860284-1 devstack@n-api.service[134101]: exception: Key pair 'tempest-keypair-2051274704' already exists. Oct 04 21:48:40.387727 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-2051274704', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLCRsxwwq89H82QEO0wuzVoEAimz6d57gIECEKabLV4R5ECy3UlNX6uPbV6DfIEWfgFYqBgeRW0GriaJ5wKNVLZVWh0/TqZ7TOjZwPETIHBaSCjS+6qv150ZoEVL7ktwBw=='}}} Oct 04 21:48:40.387727 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:48:40.387727 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:48:40.387727 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 04 21:48:40.387727 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 04 21:48:40.387727 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 04 21:48:40.387727 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 04 21:48:40.387727 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 04 21:48:40.387727 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 04 21:48:40.387727 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 04 21:48:40.387727 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 04 21:48:40.387727 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 04 21:48:40.387727 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 04 21:48:40.387727 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 04 21:48:40.387727 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi result.read() Oct 04 21:48:40.387727 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 04 21:48:40.387727 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 04 21:48:40.387727 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 04 21:48:40.387727 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 04 21:48:40.387727 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 04 21:48:40.387727 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 04 21:48:40.387727 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 04 21:48:40.387727 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 04 21:48:40.387727 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '63055f4ea2964d6dabcd86f6ce42d912-tempest-keypair-2051274704' for key 'key_pairs.uniq_key_pairs0user_id0name'") Oct 04 21:48:40.387727 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:48:40.392090 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 04 21:48:40.392090 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:48:40.392090 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:48:40.392090 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db Oct 04 21:48:40.392090 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi kp.save(context.session) Oct 04 21:48:40.392090 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 04 21:48:40.392090 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi session.flush() Oct 04 21:48:40.392090 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 04 21:48:40.392090 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 04 21:48:40.392090 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 04 21:48:40.392090 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 04 21:48:40.392090 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 04 21:48:40.392090 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 04 21:48:40.392090 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 04 21:48:40.392090 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception Oct 04 21:48:40.392090 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 04 21:48:40.392090 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 04 21:48:40.392090 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 04 21:48:40.392090 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 04 21:48:40.392090 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 04 21:48:40.392090 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 04 21:48:40.392090 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 04 21:48:40.392090 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 04 21:48:40.392090 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 04 21:48:40.392090 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 04 21:48:40.392090 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 04 21:48:40.392090 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 04 21:48:40.392090 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 04 21:48:40.392090 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 04 21:48:40.392090 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 04 21:48:40.392090 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 04 21:48:40.392090 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 04 21:48:40.392090 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 04 21:48:40.392090 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 04 21:48:40.392090 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 04 21:48:40.392090 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 04 21:48:40.392090 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception Oct 04 21:48:40.392090 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 04 21:48:40.392090 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 04 21:48:40.392090 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 04 21:48:40.392090 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 04 21:48:40.392090 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 04 21:48:40.392090 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 04 21:48:40.392090 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 04 21:48:40.392090 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 04 21:48:40.392090 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 04 21:48:40.392090 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 04 21:48:40.392090 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 04 21:48:40.392090 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi result.read() Oct 04 21:48:40.392090 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 04 21:48:40.392090 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 04 21:48:40.392090 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 04 21:48:40.392090 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 04 21:48:40.392090 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 04 21:48:40.392090 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 04 21:48:40.392090 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 04 21:48:40.396901 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 04 21:48:40.396901 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '63055f4ea2964d6dabcd86f6ce42d912-tempest-keypair-2051274704' for key 'key_pairs.uniq_key_pairs0user_id0name'") Oct 04 21:48:40.396901 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] Oct 04 21:48:40.396901 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 4, 21, 48, 40, 352870), 'updated_at': None, 'name': 'tempest-keypair-2051274704', 'user_id': '63055f4ea2964d6dabcd86f6ce42d912', 'fingerprint': 'dc:11:be:b8:66:95:eb:c8:4d:1e:a1:7c:30:16:8a:6e', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLCRsxwwq89H82QEO0wuzVoEAimz6d57gIECEKabLV4R5ECy3UlNX6uPbV6DfIEWfgFYqBgeRW0GriaJ5wKNVLZVWh0/TqZ7TOjZwPETIHBaSCjS+6qv150ZoEVL7ktwBw==', 'type': 'ssh'}] Oct 04 21:48:40.396901 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 04 21:48:40.396901 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:48:40.396901 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:48:40.396901 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:48:40.396901 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:48:40.396901 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 04 21:48:40.396901 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 04 21:48:40.396901 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 21:48:40.396901 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 21:48:40.396901 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 21:48:40.396901 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 21:48:40.396901 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 21:48:40.396901 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 21:48:40.396901 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 21:48:40.396901 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 21:48:40.396901 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6777, in import_key_pair Oct 04 21:48:40.396901 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi keypair.create() Oct 04 21:48:40.396901 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 04 21:48:40.396901 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 04 21:48:40.396901 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create Oct 04 21:48:40.396901 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi self._create() Oct 04 21:48:40.396901 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create Oct 04 21:48:40.396901 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) Oct 04 21:48:40.396901 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db Oct 04 21:48:40.396901 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) Oct 04 21:48:40.396901 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 21:48:40.396901 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 21:48:40.396901 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db Oct 04 21:48:40.396901 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) Oct 04 21:48:40.396901 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-2051274704' already exists. Oct 04 21:48:40.396901 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:48:40.396901 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:48:40.396901 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:48:40.396901 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:48:40.396901 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:48:40.396901 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:48:40.396901 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:48:40.396901 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:48:40.396901 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:48:40.396901 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:48:40.396901 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:48:40.396901 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:48:40.396901 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:48:40.396901 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:48:40.396901 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:48:40.396901 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:48:40.396901 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 04 21:48:40.396901 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 04 21:48:40.396901 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 132, in _create Oct 04 21:48:40.396901 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) Oct 04 21:48:40.396901 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-2051274704' already exists. Oct 04 21:48:40.405187 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:48:40.405187 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:48:40.405187 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:48:40.405187 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:48:40.405187 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:48:40.405187 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:48:40.405187 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:48:40.405187 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:48:40.405187 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-2051274704' already exists. Oct 04 21:48:40.405187 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:48:40.405187 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-cb51dcd0-c3b7-4208-8e61-9837fdf6f47f tempest-KeyPairsNegativeTestJSON-167233433 tempest-KeyPairsNegativeTestJSON-167233433-project] Returning 409 to user: Key pair 'tempest-keypair-2051274704' already exists. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:48:40.405187 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-cb51dcd0-c3b7-4208-8e61-9837fdf6f47f tempest-KeyPairsNegativeTestJSON-167233433 tempest-KeyPairsNegativeTestJSON-167233433-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 409 len: 105 microversion: 2.1 time: 0.170565 Oct 04 21:48:40.411534 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 724/1511] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Oct 4 21:48:40 2022] POST /compute/v2.1/os-keypairs => generated 105 bytes in 181 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 21:48:40.420680 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-94f43f07-7664-4b68-a149-0f2454ab2305 tempest-KeyPairsNegativeTestJSON-167233433 tempest-KeyPairsNegativeTestJSON-167233433-project] Calling method '.version_select at 0x7fbb2edf0160>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:40.456974 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-5ed2ce91-f366-431a-9f18-c9263441f4b2 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:48:40.473144 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-94f43f07-7664-4b68-a149-0f2454ab2305 tempest-KeyPairsNegativeTestJSON-167233433 tempest-KeyPairsNegativeTestJSON-167233433-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2051274704" status: 202 len: 0 microversion: 2.1 time: 0.059874 Oct 04 21:48:40.474988 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 725/1512] 10.222.0.43 () {58 vars in 1221 bytes} [Tue Oct 4 21:48:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2051274704 => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:48:40.481986 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-5ed2ce91-f366-431a-9f18-c9263441f4b2 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/be573c06-25e7-485e-9443-5bc21196a45e" status: 200 len: 1476 microversion: 2.1 time: 0.435831 Oct 04 21:48:40.484348 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 788/1513] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:48:40 2022] GET /compute/v2.1/servers/be573c06-25e7-485e-9443-5bc21196a45e => generated 1476 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:48:40.488472 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-aab54927-7c22-4a01-8350-92d03e089876 tempest-KeyPairsNegativeTestJSON-167233433 tempest-KeyPairsNegativeTestJSON-167233433-project] Action: 'create', calling method: .version_select at 0x7fbb2eec0f70>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDpA/gbdY3bMhE2slNfcpA5T504/AAShSTGl4Kstz1kuur5bFKXY0ZXKj/eqzfzRcoOwfJRjUD6w0W9kch7nVvSDfm3WM0Pmjz8wejTQmoVwWMWqB1DHUge8nam5rdjiiQ=="}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:48:40.493280 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-aab54927-7c22-4a01-8350-92d03e089876 tempest-KeyPairsNegativeTestJSON-167233433 tempest-KeyPairsNegativeTestJSON-167233433-project] Request method failure captured: Oct 04 21:48:40.493280 n-d-860284-1 devstack@n-api.service[134101]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 04 21:48:40.493280 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 21:48:40.493280 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 21:48:40.493280 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 21:48:40.493280 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 247 Oct 04 21:48:40.493280 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 21:48:40.493280 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 21:48:40.493280 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 21:48:40.493280 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 21:48:40.493280 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPKo3e_YJgsgHBePaUl3tx-T2DQ8PiNKCuiUlfCFseD1omSCoRLB6ZRZGK_qar6_pFQIC6ba4s1FxLD8e0ub09XegaqFYbEN_oNoB4nGhQrrg3ETKzzwAt48_GCnz9vQs7lxaW_0p4gldogt1etIshQfAYc9SRQ5Omqd_2NKOreDDgDk Oct 04 21:48:40.493280 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 21:48:40.493280 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 21:48:40.493280 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 21:48:40.493280 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 21:48:40.493280 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 21:48:40.493280 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 21:48:40.493280 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: 3167fc598ada4ac0ac290f3edae8aa85 Oct 04 21:48:40.493280 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-167233433 Oct 04 21:48:40.493280 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 21:48:40.493280 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 21:48:40.493280 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/3167fc598ada4ac0ac290f3edae8aa85"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_3167fc598ada4ac0ac290f3edae8aa85", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/3167fc598ada4ac0ac290f3edae8aa85"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/3167fc598ada4ac0ac290f3edae8aa85"}]}] Oct 04 21:48:40.493280 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-KeyPairsNegativeTestJSON-167233433 Oct 04 21:48:40.493280 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: 3167fc598ada4ac0ac290f3edae8aa85 Oct 04 21:48:40.493280 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-167233433 Oct 04 21:48:40.493280 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-KeyPairsNegativeTestJSON-167233433-project Oct 04 21:48:40.493280 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 21:48:40.493280 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 21:48:40.493280 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 63055f4ea2964d6dabcd86f6ce42d912 Oct 04 21:48:40.493280 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-KeyPairsNegativeTestJSON-167233433-project Oct 04 21:48:40.493280 n-d-860284-1 devstack@n-api.service[134101]: Oct 04 21:48:40.493280 n-d-860284-1 devstack@n-api.service[134101]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDpA/gbdY3bMhE2slNfcpA5T504/AAShSTGl4Kstz1kuur5bFKXY0ZXKj/eqzfzRcoOwfJRjUD6w0W9kch7nVvSDfm3WM0Pmjz8wejTQmoVwWMWqB1DHUge8nam5rdjiiQ=="}} Oct 04 21:48:40.493280 n-d-860284-1 devstack@n-api.service[134101]: method: Oct 04 21:48:40.493280 n-d-860284-1 devstack@n-api.service[134101]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 04 21:48:40.493280 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDpA/gbdY3bMhE2slNfcpA5T504/AAShSTGl4Kstz1kuur5bFKXY0ZXKj/eqzfzRcoOwfJRjUD6w0W9kch7nVvSDfm3WM0Pmjz8wejTQmoVwWMWqB1DHUge8nam5rdjiiQ=='}}} Oct 04 21:48:40.493280 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:48:40.493280 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:48:40.493280 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 21:48:40.493280 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 21:48:40.493280 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 21:48:40.493280 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise error Oct 04 21:48:40.493280 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 04 21:48:40.493280 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:48:40.493280 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Oct 04 21:48:40.493280 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 04 21:48:40.493280 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:48:40.493280 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi On instance['keypair']: Oct 04 21:48:40.493280 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi '' Oct 04 21:48:40.493280 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:48:40.493280 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:48:40.493280 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:48:40.493280 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:48:40.493280 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:48:40.493280 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:48:40.493280 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:48:40.493280 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:48:40.493280 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:48:40.493280 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:48:40.493280 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:48:40.493280 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:48:40.493280 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:48:40.493280 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:48:40.493280 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 21:48:40.493280 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 21:48:40.497259 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 21:48:40.497259 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 21:48:40.497259 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 21:48:40.497259 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 21:48:40.497259 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 04 21:48:40.497259 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:48:40.497259 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:48:40.497259 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:48:40.497259 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:48:40.497259 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:48:40.497259 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:48:40.497259 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 21:48:40.497259 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 21:48:40.497259 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 04 21:48:40.497259 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:48:40.499811 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-aab54927-7c22-4a01-8350-92d03e089876 tempest-KeyPairsNegativeTestJSON-167233433 tempest-KeyPairsNegativeTestJSON-167233433-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:48:40.501032 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-aab54927-7c22-4a01-8350-92d03e089876 tempest-KeyPairsNegativeTestJSON-167233433 tempest-KeyPairsNegativeTestJSON-167233433-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.017099 Oct 04 21:48:40.502178 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 726/1514] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Oct 4 21:48:40 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 21:48:40.517700 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-b615ee9d-8413-4be9-b3fe-fd252f388977 tempest-KeyPairsNegativeTestJSON-167233433 tempest-KeyPairsNegativeTestJSON-167233433-project] Action: 'create', calling method: .version_select at 0x7fbb2f893160>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1541448690", "public_key": " "}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:48:40.536868 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-b615ee9d-8413-4be9-b3fe-fd252f388977 tempest-KeyPairsNegativeTestJSON-167233433 tempest-KeyPairsNegativeTestJSON-167233433-project] Getting quotas for project 3167fc598ada4ac0ac290f3edae8aa85. Resources: {'key_pairs'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:48:40.544631 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-b615ee9d-8413-4be9-b3fe-fd252f388977 tempest-KeyPairsNegativeTestJSON-167233433 tempest-KeyPairsNegativeTestJSON-167233433-project] Getting quotas for user 63055f4ea2964d6dabcd86f6ce42d912 and project 3167fc598ada4ac0ac290f3edae8aa85. Resources: {'key_pairs'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:48:40.571087 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-b615ee9d-8413-4be9-b3fe-fd252f388977 tempest-KeyPairsNegativeTestJSON-167233433 tempest-KeyPairsNegativeTestJSON-167233433-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 04 21:48:40.591654 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-b615ee9d-8413-4be9-b3fe-fd252f388977 tempest-KeyPairsNegativeTestJSON-167233433 tempest-KeyPairsNegativeTestJSON-167233433-project] Request method failure captured: Oct 04 21:48:40.591654 n-d-860284-1 devstack@n-api.service[134102]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 04 21:48:40.591654 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 21:48:40.591654 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 21:48:40.591654 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 21:48:40.591654 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 95 Oct 04 21:48:40.591654 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 21:48:40.591654 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 21:48:40.591654 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 21:48:40.591654 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 21:48:40.591654 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPKo3e_YJgsgHBePaUl3tx-T2DQ8PiNKCuiUlfCFseD1omSCoRLB6ZRZGK_qar6_pFQIC6ba4s1FxLD8e0ub09XegaqFYbEN_oNoB4nGhQrrg3ETKzzwAt48_GCnz9vQs7lxaW_0p4gldogt1etIshQfAYc9SRQ5Omqd_2NKOreDDgDk Oct 04 21:48:40.591654 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 21:48:40.591654 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 21:48:40.591654 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 21:48:40.591654 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 21:48:40.591654 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 21:48:40.591654 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 21:48:40.591654 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: 3167fc598ada4ac0ac290f3edae8aa85 Oct 04 21:48:40.591654 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-167233433 Oct 04 21:48:40.591654 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 21:48:40.591654 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 21:48:40.591654 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/3167fc598ada4ac0ac290f3edae8aa85"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_3167fc598ada4ac0ac290f3edae8aa85", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/3167fc598ada4ac0ac290f3edae8aa85"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/3167fc598ada4ac0ac290f3edae8aa85"}]}] Oct 04 21:48:40.591654 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-KeyPairsNegativeTestJSON-167233433 Oct 04 21:48:40.591654 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: 3167fc598ada4ac0ac290f3edae8aa85 Oct 04 21:48:40.591654 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-167233433 Oct 04 21:48:40.591654 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-KeyPairsNegativeTestJSON-167233433-project Oct 04 21:48:40.591654 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 21:48:40.591654 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 21:48:40.591654 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: 63055f4ea2964d6dabcd86f6ce42d912 Oct 04 21:48:40.591654 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-KeyPairsNegativeTestJSON-167233433-project Oct 04 21:48:40.591654 n-d-860284-1 devstack@n-api.service[134102]: Oct 04 21:48:40.591654 n-d-860284-1 devstack@n-api.service[134102]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1541448690", "public_key": " "}} Oct 04 21:48:40.591654 n-d-860284-1 devstack@n-api.service[134102]: method: Oct 04 21:48:40.591654 n-d-860284-1 devstack@n-api.service[134102]: exception: Keypair data is invalid: failed to generate fingerprint Oct 04 21:48:40.591654 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1541448690', 'public_key': ' '}}} Oct 04 21:48:40.591654 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:48:40.591654 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:48:40.591654 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 04 21:48:40.591654 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 04 21:48:40.591654 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key Oct 04 21:48:40.591654 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") Oct 04 21:48:40.591654 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format Oct 04 21:48:40.591654 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:48:40.591654 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:48:40.591654 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:48:40.591654 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:48:40.591654 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 04 21:48:40.591654 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 04 21:48:40.591654 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 21:48:40.591654 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 21:48:40.591654 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 21:48:40.591654 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 21:48:40.591654 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 21:48:40.591654 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 21:48:40.591654 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 21:48:40.591654 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 21:48:40.591654 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Oct 04 21:48:40.591654 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 04 21:48:40.591654 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Oct 04 21:48:40.591654 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 04 21:48:40.591654 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 04 21:48:40.591654 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 04 21:48:40.591654 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 04 21:48:40.591654 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:48:40.591654 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:48:40.591654 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:48:40.596135 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:48:40.596135 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:48:40.596135 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:48:40.596135 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:48:40.596135 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:48:40.596135 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:48:40.596135 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:48:40.596135 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:48:40.596135 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:48:40.596135 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:48:40.596135 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:48:40.596135 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:48:40.596135 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:48:40.596135 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 04 21:48:40.596135 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 04 21:48:40.596135 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 04 21:48:40.596135 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 04 21:48:40.596135 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 04 21:48:40.596135 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:48:40.596135 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:48:40.596135 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:48:40.596135 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:48:40.596135 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:48:40.596135 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:48:40.596135 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:48:40.596135 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:48:40.596135 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 04 21:48:40.596135 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:48:40.601298 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-b615ee9d-8413-4be9-b3fe-fd252f388977 tempest-KeyPairsNegativeTestJSON-167233433 tempest-KeyPairsNegativeTestJSON-167233433-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:48:40.602866 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-b615ee9d-8413-4be9-b3fe-fd252f388977 tempest-KeyPairsNegativeTestJSON-167233433 tempest-KeyPairsNegativeTestJSON-167233433-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.089328 Oct 04 21:48:40.604052 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 789/1515] 10.222.0.43 () {60 vars in 1158 bytes} [Tue Oct 4 21:48:40 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 96 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Oct 04 21:48:40.627684 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-3b008f09-8d0f-4a6d-b61b-5417ebec7224 tempest-KeyPairsNegativeTestJSON-167233433 tempest-KeyPairsNegativeTestJSON-167233433-project] Action: 'create', calling method: .version_select at 0x7fbb2eee13a0>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCM3nLQ9rtO+Ntvagug0Pip1iWf4VZfO2uoWTCDZmH21L8T6PlfXD7DKByEOiYckP94+ScsX50pu2Eorgt5CLGQ9yZOTZK1o94PWaSaxal0Wq4lG+nRbf55gwYgTRId6Tg=="}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:48:40.652430 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-3b008f09-8d0f-4a6d-b61b-5417ebec7224 tempest-KeyPairsNegativeTestJSON-167233433 tempest-KeyPairsNegativeTestJSON-167233433-project] Request method failure captured: Oct 04 21:48:40.652430 n-d-860284-1 devstack@n-api.service[134101]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 04 21:48:40.652430 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 21:48:40.652430 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 21:48:40.652430 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 21:48:40.652430 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 507 Oct 04 21:48:40.652430 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 21:48:40.652430 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 21:48:40.652430 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 21:48:40.652430 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 21:48:40.652430 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPKo3e_YJgsgHBePaUl3tx-T2DQ8PiNKCuiUlfCFseD1omSCoRLB6ZRZGK_qar6_pFQIC6ba4s1FxLD8e0ub09XegaqFYbEN_oNoB4nGhQrrg3ETKzzwAt48_GCnz9vQs7lxaW_0p4gldogt1etIshQfAYc9SRQ5Omqd_2NKOreDDgDk Oct 04 21:48:40.652430 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 21:48:40.652430 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 21:48:40.652430 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 21:48:40.652430 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 21:48:40.652430 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 21:48:40.652430 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 21:48:40.652430 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: 3167fc598ada4ac0ac290f3edae8aa85 Oct 04 21:48:40.652430 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-167233433 Oct 04 21:48:40.652430 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 21:48:40.652430 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 21:48:40.652430 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/3167fc598ada4ac0ac290f3edae8aa85"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_3167fc598ada4ac0ac290f3edae8aa85", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/3167fc598ada4ac0ac290f3edae8aa85"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/3167fc598ada4ac0ac290f3edae8aa85"}]}] Oct 04 21:48:40.652430 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-KeyPairsNegativeTestJSON-167233433 Oct 04 21:48:40.652430 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: 3167fc598ada4ac0ac290f3edae8aa85 Oct 04 21:48:40.652430 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-167233433 Oct 04 21:48:40.652430 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-KeyPairsNegativeTestJSON-167233433-project Oct 04 21:48:40.652430 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 21:48:40.652430 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 21:48:40.652430 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 63055f4ea2964d6dabcd86f6ce42d912 Oct 04 21:48:40.652430 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-KeyPairsNegativeTestJSON-167233433-project Oct 04 21:48:40.652430 n-d-860284-1 devstack@n-api.service[134101]: Oct 04 21:48:40.652430 n-d-860284-1 devstack@n-api.service[134101]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCM3nLQ9rtO+Ntvagug0Pip1iWf4VZfO2uoWTCDZmH21L8T6PlfXD7DKByEOiYckP94+ScsX50pu2Eorgt5CLGQ9yZOTZK1o94PWaSaxal0Wq4lG+nRbf55gwYgTRId6Tg=="}} Oct 04 21:48:40.652430 n-d-860284-1 devstack@n-api.service[134101]: method: Oct 04 21:48:40.652430 n-d-860284-1 devstack@n-api.service[134101]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 04 21:48:40.652430 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCM3nLQ9rtO+Ntvagug0Pip1iWf4VZfO2uoWTCDZmH21L8T6PlfXD7DKByEOiYckP94+ScsX50pu2Eorgt5CLGQ9yZOTZK1o94PWaSaxal0Wq4lG+nRbf55gwYgTRId6Tg=='}}} Oct 04 21:48:40.652430 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:48:40.652430 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:48:40.652430 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 21:48:40.652430 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 21:48:40.652430 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 21:48:40.652430 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise error Oct 04 21:48:40.652430 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 04 21:48:40.652430 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:48:40.652430 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Oct 04 21:48:40.652430 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 04 21:48:40.652430 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:48:40.652430 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi On instance['keypair']: Oct 04 21:48:40.652430 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' Oct 04 21:48:40.655718 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:48:40.655718 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:48:40.655718 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:48:40.655718 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:48:40.655718 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:48:40.655718 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:48:40.655718 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:48:40.655718 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:48:40.655718 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:48:40.655718 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:48:40.655718 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:48:40.655718 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:48:40.655718 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:48:40.655718 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:48:40.655718 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 21:48:40.655718 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 21:48:40.655718 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 21:48:40.655718 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 21:48:40.655718 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 21:48:40.655718 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 21:48:40.655718 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 04 21:48:40.655718 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:48:40.655718 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:48:40.655718 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:48:40.655718 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:48:40.655718 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:48:40.655718 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:48:40.655718 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 21:48:40.655718 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 21:48:40.655718 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 04 21:48:40.655718 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:48:40.655718 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-3b008f09-8d0f-4a6d-b61b-5417ebec7224 tempest-KeyPairsNegativeTestJSON-167233433 tempest-KeyPairsNegativeTestJSON-167233433-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:48:40.669447 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-3b008f09-8d0f-4a6d-b61b-5417ebec7224 tempest-KeyPairsNegativeTestJSON-167233433 tempest-KeyPairsNegativeTestJSON-167233433-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.043368 Oct 04 21:48:40.669447 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 727/1516] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Oct 4 21:48:40 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 55 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 04 21:48:40.683848 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-38d79ddb-2bb4-4fae-aa23-b213f74a99df tempest-KeyPairsNegativeTestJSON-167233433 tempest-KeyPairsNegativeTestJSON-167233433-project] Action: 'create', calling method: .version_select at 0x7fbb2f69e820>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1520358081", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:48:40.715663 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-38d79ddb-2bb4-4fae-aa23-b213f74a99df tempest-KeyPairsNegativeTestJSON-167233433 tempest-KeyPairsNegativeTestJSON-167233433-project] Getting quotas for project 3167fc598ada4ac0ac290f3edae8aa85. Resources: {'key_pairs'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:48:40.724336 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-38d79ddb-2bb4-4fae-aa23-b213f74a99df tempest-KeyPairsNegativeTestJSON-167233433 tempest-KeyPairsNegativeTestJSON-167233433-project] Getting quotas for user 63055f4ea2964d6dabcd86f6ce42d912 and project 3167fc598ada4ac0ac290f3edae8aa85. Resources: {'key_pairs'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:48:40.769968 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-38d79ddb-2bb4-4fae-aa23-b213f74a99df tempest-KeyPairsNegativeTestJSON-167233433 tempest-KeyPairsNegativeTestJSON-167233433-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 04 21:48:40.776795 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-38d79ddb-2bb4-4fae-aa23-b213f74a99df tempest-KeyPairsNegativeTestJSON-167233433 tempest-KeyPairsNegativeTestJSON-167233433-project] Request method failure captured: Oct 04 21:48:40.776795 n-d-860284-1 devstack@n-api.service[134102]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 04 21:48:40.776795 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 21:48:40.776795 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 21:48:40.776795 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 21:48:40.776795 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 118 Oct 04 21:48:40.776795 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 21:48:40.776795 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 21:48:40.776795 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 21:48:40.776795 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 21:48:40.776795 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPKo3e_YJgsgHBePaUl3tx-T2DQ8PiNKCuiUlfCFseD1omSCoRLB6ZRZGK_qar6_pFQIC6ba4s1FxLD8e0ub09XegaqFYbEN_oNoB4nGhQrrg3ETKzzwAt48_GCnz9vQs7lxaW_0p4gldogt1etIshQfAYc9SRQ5Omqd_2NKOreDDgDk Oct 04 21:48:40.776795 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 21:48:40.776795 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 21:48:40.776795 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 21:48:40.776795 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 21:48:40.776795 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 21:48:40.776795 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 21:48:40.776795 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: 3167fc598ada4ac0ac290f3edae8aa85 Oct 04 21:48:40.776795 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-167233433 Oct 04 21:48:40.776795 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 21:48:40.776795 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 21:48:40.776795 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/3167fc598ada4ac0ac290f3edae8aa85"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_3167fc598ada4ac0ac290f3edae8aa85", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/3167fc598ada4ac0ac290f3edae8aa85"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/3167fc598ada4ac0ac290f3edae8aa85"}]}] Oct 04 21:48:40.776795 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-KeyPairsNegativeTestJSON-167233433 Oct 04 21:48:40.776795 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: 3167fc598ada4ac0ac290f3edae8aa85 Oct 04 21:48:40.776795 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-167233433 Oct 04 21:48:40.776795 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-KeyPairsNegativeTestJSON-167233433-project Oct 04 21:48:40.776795 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 21:48:40.776795 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 21:48:40.776795 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: 63055f4ea2964d6dabcd86f6ce42d912 Oct 04 21:48:40.776795 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-KeyPairsNegativeTestJSON-167233433-project Oct 04 21:48:40.776795 n-d-860284-1 devstack@n-api.service[134102]: Oct 04 21:48:40.776795 n-d-860284-1 devstack@n-api.service[134102]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1520358081", "public_key": "ssh-rsa JUNK nova@ubuntu"}} Oct 04 21:48:40.776795 n-d-860284-1 devstack@n-api.service[134102]: method: Oct 04 21:48:40.776795 n-d-860284-1 devstack@n-api.service[134102]: exception: Keypair data is invalid: failed to generate fingerprint Oct 04 21:48:40.776795 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1520358081', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} Oct 04 21:48:40.776795 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:48:40.776795 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:48:40.776795 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 04 21:48:40.776795 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 04 21:48:40.776795 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key Oct 04 21:48:40.776795 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) Oct 04 21:48:40.776795 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr Oct 04 21:48:40.776795 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) Oct 04 21:48:40.776795 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 Oct 04 21:48:40.776795 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") Oct 04 21:48:40.776795 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi ValueError: Invalid data Oct 04 21:48:40.776795 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:48:40.776795 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:48:40.776795 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:48:40.776795 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:48:40.776795 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 04 21:48:40.776795 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 04 21:48:40.776795 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 21:48:40.776795 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 21:48:40.776795 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 21:48:40.776795 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 21:48:40.776795 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 21:48:40.776795 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 21:48:40.776795 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 21:48:40.776795 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 21:48:40.776795 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Oct 04 21:48:40.776795 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 04 21:48:40.776795 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Oct 04 21:48:40.776795 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 04 21:48:40.783588 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 04 21:48:40.783588 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 04 21:48:40.783588 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 04 21:48:40.783588 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:48:40.783588 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:48:40.783588 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:48:40.783588 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:48:40.783588 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:48:40.783588 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:48:40.783588 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:48:40.783588 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:48:40.783588 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:48:40.783588 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:48:40.783588 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:48:40.783588 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:48:40.783588 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:48:40.783588 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:48:40.783588 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:48:40.783588 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:48:40.783588 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 04 21:48:40.783588 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 04 21:48:40.783588 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 04 21:48:40.783588 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 04 21:48:40.783588 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 04 21:48:40.783588 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:48:40.783588 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:48:40.783588 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:48:40.783588 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:48:40.783588 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:48:40.783588 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:48:40.783588 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:48:40.783588 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:48:40.783588 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 04 21:48:40.783588 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:48:40.792046 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-38d79ddb-2bb4-4fae-aa23-b213f74a99df tempest-KeyPairsNegativeTestJSON-167233433 tempest-KeyPairsNegativeTestJSON-167233433-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:48:40.797197 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-38d79ddb-2bb4-4fae-aa23-b213f74a99df tempest-KeyPairsNegativeTestJSON-167233433 tempest-KeyPairsNegativeTestJSON-167233433-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.114438 Oct 04 21:48:40.799622 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 790/1517] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Oct 4 21:48:40 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 123 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Oct 04 21:48:40.812248 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-135d3f4a-cc74-4f8c-94d4-6ee5509e8f8b tempest-KeyPairsNegativeTestJSON-167233433 tempest-KeyPairsNegativeTestJSON-167233433-project] Calling method '.version_select at 0x7fbb2ef0c1f0>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:40.836586 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-135d3f4a-cc74-4f8c-94d4-6ee5509e8f8b tempest-KeyPairsNegativeTestJSON-167233433 tempest-KeyPairsNegativeTestJSON-167233433-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-1578067374 not found for user 63055f4ea2964d6dabcd86f6ce42d912 Oct 04 21:48:40.842844 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-135d3f4a-cc74-4f8c-94d4-6ee5509e8f8b tempest-KeyPairsNegativeTestJSON-167233433 tempest-KeyPairsNegativeTestJSON-167233433-project] Request method failure captured: Oct 04 21:48:40.842844 n-d-860284-1 devstack@n-api.service[134101]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1578067374 HTTP/1.1 Oct 04 21:48:40.842844 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 21:48:40.842844 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 21:48:40.842844 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 21:48:40.842844 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 21:48:40.842844 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 21:48:40.842844 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 21:48:40.842844 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 21:48:40.842844 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 21:48:40.842844 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPKo3e_YJgsgHBePaUl3tx-T2DQ8PiNKCuiUlfCFseD1omSCoRLB6ZRZGK_qar6_pFQIC6ba4s1FxLD8e0ub09XegaqFYbEN_oNoB4nGhQrrg3ETKzzwAt48_GCnz9vQs7lxaW_0p4gldogt1etIshQfAYc9SRQ5Omqd_2NKOreDDgDk Oct 04 21:48:40.842844 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 21:48:40.842844 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 21:48:40.842844 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 21:48:40.842844 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 21:48:40.842844 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 21:48:40.842844 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 21:48:40.842844 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: 3167fc598ada4ac0ac290f3edae8aa85 Oct 04 21:48:40.842844 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-167233433 Oct 04 21:48:40.842844 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 21:48:40.842844 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 21:48:40.842844 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/3167fc598ada4ac0ac290f3edae8aa85"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_3167fc598ada4ac0ac290f3edae8aa85", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/3167fc598ada4ac0ac290f3edae8aa85"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/3167fc598ada4ac0ac290f3edae8aa85"}]}] Oct 04 21:48:40.842844 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-KeyPairsNegativeTestJSON-167233433 Oct 04 21:48:40.842844 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: 3167fc598ada4ac0ac290f3edae8aa85 Oct 04 21:48:40.842844 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-167233433 Oct 04 21:48:40.842844 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-KeyPairsNegativeTestJSON-167233433-project Oct 04 21:48:40.842844 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 21:48:40.842844 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 21:48:40.842844 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 63055f4ea2964d6dabcd86f6ce42d912 Oct 04 21:48:40.842844 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-KeyPairsNegativeTestJSON-167233433-project Oct 04 21:48:40.842844 n-d-860284-1 devstack@n-api.service[134101]: method: Oct 04 21:48:40.842844 n-d-860284-1 devstack@n-api.service[134101]: exception: Keypair tempest-keypair-non-existent-1578067374 not found for user 63055f4ea2964d6dabcd86f6ce42d912 Oct 04 21:48:40.842844 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': 'tempest-keypair-non-existent-1578067374'} Oct 04 21:48:40.842844 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:48:40.842844 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:48:40.842844 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 170, in _delete Oct 04 21:48:40.842844 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Oct 04 21:48:40.842844 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 21:48:40.842844 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 21:48:40.842844 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 21:48:40.842844 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 21:48:40.842844 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 21:48:40.842844 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 21:48:40.842844 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 21:48:40.842844 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 21:48:40.842844 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6861, in delete_key_pair Oct 04 21:48:40.842844 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Oct 04 21:48:40.842844 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6882, in get_key_pair Oct 04 21:48:40.842844 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Oct 04 21:48:40.842844 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 21:48:40.842844 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 21:48:40.842844 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Oct 04 21:48:40.842844 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Oct 04 21:48:40.842844 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Oct 04 21:48:40.842844 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Oct 04 21:48:40.842844 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 21:48:40.842844 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 21:48:40.842844 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Oct 04 21:48:40.842844 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Oct 04 21:48:40.842844 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-1578067374 not found for user 63055f4ea2964d6dabcd86f6ce42d912 Oct 04 21:48:40.842844 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:48:40.842844 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:48:40.852344 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:48:40.852344 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:48:40.852344 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:48:40.852344 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:48:40.852344 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:48:40.852344 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:48:40.852344 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:48:40.852344 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:48:40.852344 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 21:48:40.852344 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:48:40.852344 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:48:40.852344 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:48:40.852344 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 143, in delete Oct 04 21:48:40.852344 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi self._delete(req, id) Oct 04 21:48:40.852344 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 172, in _delete Oct 04 21:48:40.852344 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Oct 04 21:48:40.852344 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-1578067374 not found for user 63055f4ea2964d6dabcd86f6ce42d912 Oct 04 21:48:40.852344 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:48:40.852344 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:48:40.852344 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:48:40.852344 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:48:40.852344 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:48:40.852344 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:48:40.852344 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:48:40.852344 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:48:40.852344 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-1578067374 not found for user 63055f4ea2964d6dabcd86f6ce42d912 Oct 04 21:48:40.852344 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:48:40.852344 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-135d3f4a-cc74-4f8c-94d4-6ee5509e8f8b tempest-KeyPairsNegativeTestJSON-167233433 tempest-KeyPairsNegativeTestJSON-167233433-project] Returning 404 to user: Keypair tempest-keypair-non-existent-1578067374 not found for user 63055f4ea2964d6dabcd86f6ce42d912 {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:48:40.852344 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-135d3f4a-cc74-4f8c-94d4-6ee5509e8f8b tempest-KeyPairsNegativeTestJSON-167233433 tempest-KeyPairsNegativeTestJSON-167233433-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1578067374" status: 404 len: 145 microversion: 2.1 time: 0.038516 Oct 04 21:48:40.852344 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 728/1518] 10.222.0.43 () {58 vars in 1260 bytes} [Tue Oct 4 21:48:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1578067374 => generated 145 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:48:41.097921 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-ae2f38e6-f2f2-4f84-931b-3b69112450f2 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:41.099067 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-ae2f38e6-f2f2-4f84-931b-3b69112450f2 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] [instance: 1e9957cf-cfeb-483d-bc32-73ca72a54eb9] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:48:41.124251 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ae2f38e6-f2f2-4f84-931b-3b69112450f2 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:41.124806 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ae2f38e6-f2f2-4f84-931b-3b69112450f2 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:41.125256 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ae2f38e6-f2f2-4f84-931b-3b69112450f2 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:41.138846 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ae2f38e6-f2f2-4f84-931b-3b69112450f2 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:41.139641 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ae2f38e6-f2f2-4f84-931b-3b69112450f2 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:41.140247 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ae2f38e6-f2f2-4f84-931b-3b69112450f2 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:41.219980 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-7a346a31-d913-4e38-a033-6c0139f23220 req-cefa724d-d85d-493d-bef3-9fc9ebb64383 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e9957cf-cfeb-483d-bc32-73ca72a54eb9", "name": "network-vif-deleted", "tag": "76bebc24-16b6-4425-aef8-2807d95b42ac"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:48:41.261268 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-7a346a31-d913-4e38-a033-6c0139f23220 req-cefa724d-d85d-493d-bef3-9fc9ebb64383 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:41.262977 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-7a346a31-d913-4e38-a033-6c0139f23220 req-cefa724d-d85d-493d-bef3-9fc9ebb64383 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:41.264702 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-7a346a31-d913-4e38-a033-6c0139f23220 req-cefa724d-d85d-493d-bef3-9fc9ebb64383 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:41.340365 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-7a346a31-d913-4e38-a033-6c0139f23220 req-cefa724d-d85d-493d-bef3-9fc9ebb64383 service nova] Creating event network-vif-deleted:76bebc24-16b6-4425-aef8-2807d95b42ac for instance 1e9957cf-cfeb-483d-bc32-73ca72a54eb9 on n-h1-860284-1 Oct 04 21:48:41.380023 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-7a346a31-d913-4e38-a033-6c0139f23220 req-cefa724d-d85d-493d-bef3-9fc9ebb64383 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.157425 Oct 04 21:48:41.382415 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 729/1519] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:48:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:48:41.502772 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-ae2f38e6-f2f2-4f84-931b-3b69112450f2 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2dff38dea346219f6534426fd27ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6a5f1476ac48f3831f2ed202dacdf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:48:41.527535 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-b3523bdb-80e4-42bb-aebe-68364334c075 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:41.533178 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-b3523bdb-80e4-42bb-aebe-68364334c075 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: be573c06-25e7-485e-9443-5bc21196a45e] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:48:41.533975 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-ae2f38e6-f2f2-4f84-931b-3b69112450f2 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] 10.222.0.43 "GET /compute/v2.1/servers/1e9957cf-cfeb-483d-bc32-73ca72a54eb9" status: 200 len: 1613 microversion: 2.1 time: 0.440871 Oct 04 21:48:41.565447 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b3523bdb-80e4-42bb-aebe-68364334c075 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:41.565723 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 791/1520] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:48:41 2022] GET /compute/v2.1/servers/1e9957cf-cfeb-483d-bc32-73ca72a54eb9 => generated 1613 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:48:41.565835 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b3523bdb-80e4-42bb-aebe-68364334c075 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:41.565835 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b3523bdb-80e4-42bb-aebe-68364334c075 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:41.565835 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b3523bdb-80e4-42bb-aebe-68364334c075 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:41.565835 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b3523bdb-80e4-42bb-aebe-68364334c075 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:41.565835 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b3523bdb-80e4-42bb-aebe-68364334c075 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:41.894648 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-b3523bdb-80e4-42bb-aebe-68364334c075 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:48:41.904912 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-b3523bdb-80e4-42bb-aebe-68364334c075 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/be573c06-25e7-485e-9443-5bc21196a45e" status: 200 len: 1476 microversion: 2.1 time: 0.392231 Oct 04 21:48:41.921293 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 730/1521] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:48:41 2022] GET /compute/v2.1/servers/be573c06-25e7-485e-9443-5bc21196a45e => generated 1476 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:48:42.607791 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-ca41a1be-8f44-45d4-8241-b8f39ccbd7d5 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:42.624697 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-ca41a1be-8f44-45d4-8241-b8f39ccbd7d5 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] [instance: 1e9957cf-cfeb-483d-bc32-73ca72a54eb9] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:48:42.686139 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ca41a1be-8f44-45d4-8241-b8f39ccbd7d5 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:42.701908 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ca41a1be-8f44-45d4-8241-b8f39ccbd7d5 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:42.702569 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ca41a1be-8f44-45d4-8241-b8f39ccbd7d5 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:42.705396 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ca41a1be-8f44-45d4-8241-b8f39ccbd7d5 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:42.705995 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ca41a1be-8f44-45d4-8241-b8f39ccbd7d5 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:42.708857 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ca41a1be-8f44-45d4-8241-b8f39ccbd7d5 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:42.745101 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-ca41a1be-8f44-45d4-8241-b8f39ccbd7d5 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] HTTP exception thrown: Instance 1e9957cf-cfeb-483d-bc32-73ca72a54eb9 could not be found. Oct 04 21:48:42.747430 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-ca41a1be-8f44-45d4-8241-b8f39ccbd7d5 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Request method failure captured: Oct 04 21:48:42.747430 n-d-860284-1 devstack@n-api.service[134102]: request: GET /compute/v2.1/servers/1e9957cf-cfeb-483d-bc32-73ca72a54eb9 HTTP/1.1 Oct 04 21:48:42.747430 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 21:48:42.747430 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 21:48:42.747430 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 21:48:42.747430 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 21:48:42.747430 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 21:48:42.747430 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 21:48:42.747430 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 21:48:42.747430 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 21:48:42.747430 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPKk608Zd4sYHwPFk5U59PlIAwuPgot7OTXGV_aSkyPZ0bwxbMweTeyEZ1AFLJ3sD8_k6FD4UZBeQnIWzP_Dhuvkxz8fr2N4feRn9kw8XoN1wz_g8qzYCXsRKkgzhhV7pyurye_naKA8q4KTCRj1JQTG85J-NFuxWDhAvl23V45hS9HE Oct 04 21:48:42.747430 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 21:48:42.747430 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 21:48:42.747430 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 21:48:42.747430 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 21:48:42.747430 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 21:48:42.747430 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 21:48:42.747430 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: 0f6a5f1476ac48f3831f2ed202dacdf8 Oct 04 21:48:42.747430 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-943603883 Oct 04 21:48:42.747430 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 21:48:42.747430 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 21:48:42.747430 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0f6a5f1476ac48f3831f2ed202dacdf8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_0f6a5f1476ac48f3831f2ed202dacdf8", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0f6a5f1476ac48f3831f2ed202dacdf8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/0f6a5f1476ac48f3831f2ed202dacdf8"}]}] Oct 04 21:48:42.747430 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-943603883 Oct 04 21:48:42.747430 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: 0f6a5f1476ac48f3831f2ed202dacdf8 Oct 04 21:48:42.747430 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-943603883 Oct 04 21:48:42.747430 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-AttachSCSIVolumeTestJSON-943603883-project Oct 04 21:48:42.747430 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 21:48:42.747430 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 21:48:42.747430 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: 5a2dff38dea346219f6534426fd27ff8 Oct 04 21:48:42.747430 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-943603883-project Oct 04 21:48:42.747430 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 21:48:42.747430 n-d-860284-1 devstack@n-api.service[134102]: exception: Instance 1e9957cf-cfeb-483d-bc32-73ca72a54eb9 could not be found. Oct 04 21:48:42.747430 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': '1e9957cf-cfeb-483d-bc32-73ca72a54eb9'} Oct 04 21:48:42.747430 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:48:42.747430 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:48:42.747430 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:48:42.747430 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:48:42.747430 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:48:42.747430 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:48:42.747430 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:48:42.747430 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:48:42.747430 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:48:42.747430 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:48:42.747430 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e9957cf-cfeb-483d-bc32-73ca72a54eb9 could not be found. Oct 04 21:48:42.747430 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:48:42.747430 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:48:42.747430 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:48:42.747430 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:48:42.747430 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:48:42.747430 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:48:42.747430 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:48:42.747430 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:48:42.747430 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:48:42.747430 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:48:42.747430 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:48:42.747430 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:48:42.747430 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:48:42.747430 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:48:42.747430 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:48:42.747430 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:48:42.747430 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e9957cf-cfeb-483d-bc32-73ca72a54eb9 could not be found. Oct 04 21:48:42.747430 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:48:42.747430 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:48:42.747430 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:48:42.752600 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:48:42.752600 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:48:42.752600 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:48:42.752600 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:48:42.752600 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:48:42.752600 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e9957cf-cfeb-483d-bc32-73ca72a54eb9 could not be found. Oct 04 21:48:42.752600 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:48:42.752600 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-ca41a1be-8f44-45d4-8241-b8f39ccbd7d5 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Returning 404 to user: Instance 1e9957cf-cfeb-483d-bc32-73ca72a54eb9 could not be found. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:48:42.752600 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-ca41a1be-8f44-45d4-8241-b8f39ccbd7d5 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] 10.222.0.43 "GET /compute/v2.1/servers/1e9957cf-cfeb-483d-bc32-73ca72a54eb9" status: 404 len: 111 microversion: 2.1 time: 0.176024 Oct 04 21:48:42.756168 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=4 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:48:42.758919 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 792/1522] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:48:42 2022] GET /compute/v2.1/servers/1e9957cf-cfeb-483d-bc32-73ca72a54eb9 => generated 111 bytes in 189 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:48:42.760550 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-c0956c11-100e-4f5c-9cf3-96e22e0cc829 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Calling method '.version_select at 0x7fbb2ed0a280>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:42.804397 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-c0956c11-100e-4f5c-9cf3-96e22e0cc829 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-642459235" status: 202 len: 0 microversion: 2.1 time: 0.049636 Oct 04 21:48:42.805006 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 731/1523] 10.222.0.43 () {58 vars in 1218 bytes} [Tue Oct 4 21:48:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-642459235 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:48:42.926106 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell0:SELECT=10 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:48:42.931977 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-62d980a2-9a52-4678-950c-a987bb979b12 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:42.932799 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-62d980a2-9a52-4678-950c-a987bb979b12 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: be573c06-25e7-485e-9443-5bc21196a45e] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:48:42.946851 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-62d980a2-9a52-4678-950c-a987bb979b12 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:42.947352 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-62d980a2-9a52-4678-950c-a987bb979b12 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:42.947792 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-62d980a2-9a52-4678-950c-a987bb979b12 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:42.948523 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-62d980a2-9a52-4678-950c-a987bb979b12 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:42.948977 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-62d980a2-9a52-4678-950c-a987bb979b12 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:42.949406 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-62d980a2-9a52-4678-950c-a987bb979b12 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:43.536723 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-62d980a2-9a52-4678-950c-a987bb979b12 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:48:43.546124 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-62d980a2-9a52-4678-950c-a987bb979b12 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/be573c06-25e7-485e-9443-5bc21196a45e" status: 200 len: 1476 microversion: 2.1 time: 0.620925 Oct 04 21:48:43.550395 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 793/1524] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:48:42 2022] GET /compute/v2.1/servers/be573c06-25e7-485e-9443-5bc21196a45e => generated 1476 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:48:44.577214 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-73f5e677-03b0-4eb4-b52e-d8c3af8ce047 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:44.577961 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-73f5e677-03b0-4eb4-b52e-d8c3af8ce047 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: be573c06-25e7-485e-9443-5bc21196a45e] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:48:44.587462 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-73f5e677-03b0-4eb4-b52e-d8c3af8ce047 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:44.587964 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-73f5e677-03b0-4eb4-b52e-d8c3af8ce047 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:44.588433 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-73f5e677-03b0-4eb4-b52e-d8c3af8ce047 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:44.589149 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-73f5e677-03b0-4eb4-b52e-d8c3af8ce047 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:44.589617 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-73f5e677-03b0-4eb4-b52e-d8c3af8ce047 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:44.590054 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-73f5e677-03b0-4eb4-b52e-d8c3af8ce047 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:44.914262 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-73f5e677-03b0-4eb4-b52e-d8c3af8ce047 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:48:44.939102 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-73f5e677-03b0-4eb4-b52e-d8c3af8ce047 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/be573c06-25e7-485e-9443-5bc21196a45e" status: 200 len: 1476 microversion: 2.1 time: 0.366344 Oct 04 21:48:44.940249 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 732/1525] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:48:44 2022] GET /compute/v2.1/servers/be573c06-25e7-485e-9443-5bc21196a45e => generated 1476 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:48:45.967063 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-33dea82f-533b-4e96-bb74-e5dc609530b7 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:45.968044 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-33dea82f-533b-4e96-bb74-e5dc609530b7 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: be573c06-25e7-485e-9443-5bc21196a45e] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:48:45.996215 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-33dea82f-533b-4e96-bb74-e5dc609530b7 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:46.000605 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-33dea82f-533b-4e96-bb74-e5dc609530b7 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:46.003692 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-33dea82f-533b-4e96-bb74-e5dc609530b7 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:46.009250 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-33dea82f-533b-4e96-bb74-e5dc609530b7 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:46.012664 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-33dea82f-533b-4e96-bb74-e5dc609530b7 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:46.014665 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-33dea82f-533b-4e96-bb74-e5dc609530b7 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:46.423922 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-4f22787a-50ad-49cd-85cc-190b2d8fbcc6 tempest-AbsoluteLimitsTestJSON-1668636471 tempest-AbsoluteLimitsTestJSON-1668636471-project] Calling method '.version_select at 0x7fbb2f893310>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:46.451555 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4f22787a-50ad-49cd-85cc-190b2d8fbcc6 tempest-AbsoluteLimitsTestJSON-1668636471 tempest-AbsoluteLimitsTestJSON-1668636471-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:46.455192 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4f22787a-50ad-49cd-85cc-190b2d8fbcc6 tempest-AbsoluteLimitsTestJSON-1668636471 tempest-AbsoluteLimitsTestJSON-1668636471-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:46.459007 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4f22787a-50ad-49cd-85cc-190b2d8fbcc6 tempest-AbsoluteLimitsTestJSON-1668636471 tempest-AbsoluteLimitsTestJSON-1668636471-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:46.463358 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4f22787a-50ad-49cd-85cc-190b2d8fbcc6 tempest-AbsoluteLimitsTestJSON-1668636471 tempest-AbsoluteLimitsTestJSON-1668636471-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:46.464320 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4f22787a-50ad-49cd-85cc-190b2d8fbcc6 tempest-AbsoluteLimitsTestJSON-1668636471 tempest-AbsoluteLimitsTestJSON-1668636471-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:46.465870 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4f22787a-50ad-49cd-85cc-190b2d8fbcc6 tempest-AbsoluteLimitsTestJSON-1668636471 tempest-AbsoluteLimitsTestJSON-1668636471-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:46.546577 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-4f22787a-50ad-49cd-85cc-190b2d8fbcc6 tempest-AbsoluteLimitsTestJSON-1668636471 tempest-AbsoluteLimitsTestJSON-1668636471-project] 10.222.0.43 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.723983 Oct 04 21:48:46.549243 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 794/1526] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Oct 4 21:48:45 2022] GET /compute/v2.1/limits => generated 511 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:48:46.707477 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-33dea82f-533b-4e96-bb74-e5dc609530b7 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:48:46.725260 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-33dea82f-533b-4e96-bb74-e5dc609530b7 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/be573c06-25e7-485e-9443-5bc21196a45e" status: 200 len: 1476 microversion: 2.1 time: 0.762987 Oct 04 21:48:46.733869 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 733/1527] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:48:45 2022] GET /compute/v2.1/servers/be573c06-25e7-485e-9443-5bc21196a45e => generated 1476 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:48:47.037005 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-8906c82b-9b03-4c9d-a861-e1d8efe43e77 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-589779785", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452", "networks": [{"uuid": "e4c13216-4fea-4d87-aa16-a7572859740d"}]}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:48:47.146808 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.network.neutron [None req-8906c82b-9b03-4c9d-a861-e1d8efe43e77 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] validate_networks() for [('e4c13216-4fea-4d87-aa16-a7572859740d', None, None, None, None, None)] {{(pid=134102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:48:47.173711 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-23fed13f-0f8c-4ec4-98e8-90e416b8e78b tempest-FlavorMetadataValidation-363421977 tempest-FlavorMetadataValidation-363421977-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-488768595", "id": 1763742592, "os-flavor-access:is_public": "True"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:48:47.228783 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-23fed13f-0f8c-4ec4-98e8-90e416b8e78b tempest-FlavorMetadataValidation-363421977 tempest-FlavorMetadataValidation-363421977-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 470 microversion: 2.86 time: 0.400199 Oct 04 21:48:47.231906 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 734/1528] 10.222.0.43 () {62 vars in 1188 bytes} [Tue Oct 4 21:48:46 2022] POST /compute/v2.1/flavors => generated 470 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 21:48:47.247343 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-be40ae8f-4a30-4176-996a-135d963e4e13 tempest-FlavorMetadataValidation-363421977 tempest-FlavorMetadataValidation-363421977-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:48:47.589901 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-be40ae8f-4a30-4176-996a-135d963e4e13 tempest-FlavorMetadataValidation-363421977 tempest-FlavorMetadataValidation-363421977-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors/1763742592/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.347242 Oct 04 21:48:47.595970 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 735/1529] 10.222.0.43 () {62 vars in 1265 bytes} [Tue Oct 4 21:48:47 2022] POST /compute/v2.1/flavors/1763742592/os-extra_specs => generated 62 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:48:47.622707 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-7423b2c0-f18b-488e-94ad-171d932267b3 tempest-FlavorMetadataValidation-363421977 tempest-FlavorMetadataValidation-363421977-project-admin] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:47.690066 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-7423b2c0-f18b-488e-94ad-171d932267b3 tempest-FlavorMetadataValidation-363421977 tempest-FlavorMetadataValidation-363421977-project-admin] 10.222.0.43 "DELETE /compute/v2.1/flavors/1763742592" status: 202 len: 0 microversion: 2.86 time: 0.084131 Oct 04 21:48:47.696504 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 736/1530] 10.222.0.43 () {60 vars in 1202 bytes} [Tue Oct 4 21:48:47 2022] DELETE /compute/v2.1/flavors/1763742592 => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:48:47.701987 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-acbf8ba4-b4f7-4f8e-865b-05d1385b6586 tempest-FlavorMetadataValidation-363421977 tempest-FlavorMetadataValidation-363421977-project-admin] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:47.779917 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-acbf8ba4-b4f7-4f8e-865b-05d1385b6586 tempest-FlavorMetadataValidation-363421977 tempest-FlavorMetadataValidation-363421977-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.86 time: 0.081684 Oct 04 21:48:47.781099 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 737/1531] 10.222.0.43 () {60 vars in 1187 bytes} [Tue Oct 4 21:48:47 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:48:47.786117 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-489ac94f-28fb-4f98-b374-3f3796c74fb0 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:47.786774 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-489ac94f-28fb-4f98-b374-3f3796c74fb0 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: be573c06-25e7-485e-9443-5bc21196a45e] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:48:47.827188 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-489ac94f-28fb-4f98-b374-3f3796c74fb0 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:47.827730 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-489ac94f-28fb-4f98-b374-3f3796c74fb0 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:47.828174 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-489ac94f-28fb-4f98-b374-3f3796c74fb0 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:47.829411 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-489ac94f-28fb-4f98-b374-3f3796c74fb0 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:47.830075 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-489ac94f-28fb-4f98-b374-3f3796c74fb0 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:47.830940 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-489ac94f-28fb-4f98-b374-3f3796c74fb0 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:48.015459 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-8906c82b-9b03-4c9d-a861-e1d8efe43e77 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Flavor limits 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:48:48.015978 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-8906c82b-9b03-4c9d-a861-e1d8efe43e77 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Image limits 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:48:48.016571 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-8906c82b-9b03-4c9d-a861-e1d8efe43e77 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Flavor pref 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:48:48.016992 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-8906c82b-9b03-4c9d-a861-e1d8efe43e77 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Image pref 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:48:48.017598 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-8906c82b-9b03-4c9d-a861-e1d8efe43e77 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:48:48.034061 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8906c82b-9b03-4c9d-a861-e1d8efe43e77 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:48.042135 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8906c82b-9b03-4c9d-a861-e1d8efe43e77 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:48.042634 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8906c82b-9b03-4c9d-a861-e1d8efe43e77 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:48.043486 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8906c82b-9b03-4c9d-a861-e1d8efe43e77 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:48.044255 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8906c82b-9b03-4c9d-a861-e1d8efe43e77 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:48.044906 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8906c82b-9b03-4c9d-a861-e1d8efe43e77 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:48.090137 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-8906c82b-9b03-4c9d-a861-e1d8efe43e77 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Getting quotas for project 758fcafb5db74075b183978a97b7c4ee. Resources: {'instances', 'ram', 'cores'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:48:48.097613 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-8906c82b-9b03-4c9d-a861-e1d8efe43e77 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Getting quotas for user 56d66a6a9c5c4c57ba0d25a37323f37f and project 758fcafb5db74075b183978a97b7c4ee. Resources: {'instances', 'ram', 'cores'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:48:48.138946 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-8906c82b-9b03-4c9d-a861-e1d8efe43e77 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Going to run 1 instances... {{(pid=134102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:48:48.141448 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-8906c82b-9b03-4c9d-a861-e1d8efe43e77 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] [instance: fdc82b91-5dfa-44cf-b8c5-402922265d88] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='58548514-5dac-426c-81f5-19e3fba33e23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:48:48.264706 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-8906c82b-9b03-4c9d-a861-e1d8efe43e77 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.482077 Oct 04 21:48:48.265531 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 795/1532] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 21:48:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 1490 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:48:48.277624 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-39693a7f-c4e2-417e-a70a-deee692dc279 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:48.278243 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-39693a7f-c4e2-417e-a70a-deee692dc279 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] [instance: fdc82b91-5dfa-44cf-b8c5-402922265d88] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:48:48.534101 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-489ac94f-28fb-4f98-b374-3f3796c74fb0 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:48:48.556410 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-39693a7f-c4e2-417e-a70a-deee692dc279 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d66a6a9c5c4c57ba0d25a37323f37f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758fcafb5db74075b183978a97b7c4ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:48:48.561698 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-489ac94f-28fb-4f98-b374-3f3796c74fb0 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/be573c06-25e7-485e-9443-5bc21196a45e" status: 200 len: 1476 microversion: 2.1 time: 0.779341 Oct 04 21:48:48.575577 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 738/1533] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:48:47 2022] GET /compute/v2.1/servers/be573c06-25e7-485e-9443-5bc21196a45e => generated 1476 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:48:48.585380 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-39693a7f-c4e2-417e-a70a-deee692dc279 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] 10.222.0.43 "GET /compute/v2.1/servers/fdc82b91-5dfa-44cf-b8c5-402922265d88" status: 200 len: 1223 microversion: 2.1 time: 0.310456 Oct 04 21:48:48.586334 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 796/1534] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:48:48 2022] GET /compute/v2.1/servers/fdc82b91-5dfa-44cf-b8c5-402922265d88 => generated 1223 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:48:49.609633 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-00c34a34-421d-4a79-bd09-8c3d86644e57 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:49.610353 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-00c34a34-421d-4a79-bd09-8c3d86644e57 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] [instance: fdc82b91-5dfa-44cf-b8c5-402922265d88] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:48:49.633235 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-00c34a34-421d-4a79-bd09-8c3d86644e57 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:49.636904 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-00c34a34-421d-4a79-bd09-8c3d86644e57 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:49.637601 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-00c34a34-421d-4a79-bd09-8c3d86644e57 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:49.639011 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-00c34a34-421d-4a79-bd09-8c3d86644e57 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:49.641531 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-00c34a34-421d-4a79-bd09-8c3d86644e57 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:49.642215 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-00c34a34-421d-4a79-bd09-8c3d86644e57 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:49.870170 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-00c34a34-421d-4a79-bd09-8c3d86644e57 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d66a6a9c5c4c57ba0d25a37323f37f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758fcafb5db74075b183978a97b7c4ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:48:49.882852 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-00c34a34-421d-4a79-bd09-8c3d86644e57 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] 10.222.0.43 "GET /compute/v2.1/servers/fdc82b91-5dfa-44cf-b8c5-402922265d88" status: 200 len: 1227 microversion: 2.1 time: 0.277528 Oct 04 21:48:49.884175 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 797/1535] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:48:49 2022] GET /compute/v2.1/servers/fdc82b91-5dfa-44cf-b8c5-402922265d88 => generated 1227 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:48:50.176016 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e8699a82-0e61-4af2-8b5b-fcf566854e03 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:50.177750 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-e8699a82-0e61-4af2-8b5b-fcf566854e03 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: be573c06-25e7-485e-9443-5bc21196a45e] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:48:50.220425 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e8699a82-0e61-4af2-8b5b-fcf566854e03 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:50.224917 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e8699a82-0e61-4af2-8b5b-fcf566854e03 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:50.227305 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e8699a82-0e61-4af2-8b5b-fcf566854e03 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:50.234872 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e8699a82-0e61-4af2-8b5b-fcf566854e03 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:50.237835 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e8699a82-0e61-4af2-8b5b-fcf566854e03 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:50.241110 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e8699a82-0e61-4af2-8b5b-fcf566854e03 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:50.342006 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=16 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:48:50.661080 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-e8699a82-0e61-4af2-8b5b-fcf566854e03 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:48:50.676840 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-e8699a82-0e61-4af2-8b5b-fcf566854e03 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/be573c06-25e7-485e-9443-5bc21196a45e" status: 200 len: 1476 microversion: 2.1 time: 1.088845 Oct 04 21:48:50.707085 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 739/1536] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:48:49 2022] GET /compute/v2.1/servers/be573c06-25e7-485e-9443-5bc21196a45e => generated 1476 bytes in 1120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:48:50.913399 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-dcecdb34-76c5-4afd-8ff3-0bb0b076eca7 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:50.914770 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-dcecdb34-76c5-4afd-8ff3-0bb0b076eca7 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] [instance: fdc82b91-5dfa-44cf-b8c5-402922265d88] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:48:50.935155 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dcecdb34-76c5-4afd-8ff3-0bb0b076eca7 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:50.941674 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dcecdb34-76c5-4afd-8ff3-0bb0b076eca7 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:50.945864 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dcecdb34-76c5-4afd-8ff3-0bb0b076eca7 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:50.951269 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dcecdb34-76c5-4afd-8ff3-0bb0b076eca7 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:50.951933 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dcecdb34-76c5-4afd-8ff3-0bb0b076eca7 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:50.953882 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dcecdb34-76c5-4afd-8ff3-0bb0b076eca7 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:51.246591 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-dcecdb34-76c5-4afd-8ff3-0bb0b076eca7 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d66a6a9c5c4c57ba0d25a37323f37f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758fcafb5db74075b183978a97b7c4ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:48:51.258997 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-dcecdb34-76c5-4afd-8ff3-0bb0b076eca7 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] 10.222.0.43 "GET /compute/v2.1/servers/fdc82b91-5dfa-44cf-b8c5-402922265d88" status: 200 len: 1283 microversion: 2.1 time: 0.348346 Oct 04 21:48:51.279432 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 798/1537] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:48:50 2022] GET /compute/v2.1/servers/fdc82b91-5dfa-44cf-b8c5-402922265d88 => generated 1283 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:48:51.732547 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-1124c87c-3acc-46cc-8337-7bd5ddafbf0e tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:51.735198 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-1124c87c-3acc-46cc-8337-7bd5ddafbf0e tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: be573c06-25e7-485e-9443-5bc21196a45e] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:48:51.752378 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1124c87c-3acc-46cc-8337-7bd5ddafbf0e tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:51.752862 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1124c87c-3acc-46cc-8337-7bd5ddafbf0e tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:51.755396 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1124c87c-3acc-46cc-8337-7bd5ddafbf0e tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:51.757252 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1124c87c-3acc-46cc-8337-7bd5ddafbf0e tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:51.761174 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1124c87c-3acc-46cc-8337-7bd5ddafbf0e tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:51.763160 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1124c87c-3acc-46cc-8337-7bd5ddafbf0e tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:52.303812 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-08e7563e-2363-43db-8bec-d4b263796b4a tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:52.305240 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-08e7563e-2363-43db-8bec-d4b263796b4a tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] [instance: fdc82b91-5dfa-44cf-b8c5-402922265d88] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:48:52.325523 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-08e7563e-2363-43db-8bec-d4b263796b4a tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:52.326404 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-08e7563e-2363-43db-8bec-d4b263796b4a tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:52.327533 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-08e7563e-2363-43db-8bec-d4b263796b4a tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:52.328713 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-08e7563e-2363-43db-8bec-d4b263796b4a tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:52.329539 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-08e7563e-2363-43db-8bec-d4b263796b4a tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:52.330663 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-08e7563e-2363-43db-8bec-d4b263796b4a tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:52.383529 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-1124c87c-3acc-46cc-8337-7bd5ddafbf0e tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:48:52.396075 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-1124c87c-3acc-46cc-8337-7bd5ddafbf0e tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/be573c06-25e7-485e-9443-5bc21196a45e" status: 200 len: 1476 microversion: 2.1 time: 0.679871 Oct 04 21:48:52.397601 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 740/1538] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:48:51 2022] GET /compute/v2.1/servers/be573c06-25e7-485e-9443-5bc21196a45e => generated 1476 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:48:52.468994 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-08e7563e-2363-43db-8bec-d4b263796b4a tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d66a6a9c5c4c57ba0d25a37323f37f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758fcafb5db74075b183978a97b7c4ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:48:52.478239 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-08e7563e-2363-43db-8bec-d4b263796b4a tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] 10.222.0.43 "GET /compute/v2.1/servers/fdc82b91-5dfa-44cf-b8c5-402922265d88" status: 200 len: 1281 microversion: 2.1 time: 0.188219 Oct 04 21:48:52.478873 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 799/1539] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:48:52 2022] GET /compute/v2.1/servers/fdc82b91-5dfa-44cf-b8c5-402922265d88 => generated 1281 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:48:52.940088 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-d430efdb-fc6b-4c4f-a864-d3ad1b07b0f0 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:52.940859 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-d430efdb-fc6b-4c4f-a864-d3ad1b07b0f0 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] [instance: 1e9957cf-cfeb-483d-bc32-73ca72a54eb9] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:48:52.963356 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d430efdb-fc6b-4c4f-a864-d3ad1b07b0f0 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:52.964172 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d430efdb-fc6b-4c4f-a864-d3ad1b07b0f0 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:52.968660 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d430efdb-fc6b-4c4f-a864-d3ad1b07b0f0 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:52.971497 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d430efdb-fc6b-4c4f-a864-d3ad1b07b0f0 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:52.972432 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d430efdb-fc6b-4c4f-a864-d3ad1b07b0f0 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:52.973178 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d430efdb-fc6b-4c4f-a864-d3ad1b07b0f0 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:53.012249 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-d430efdb-fc6b-4c4f-a864-d3ad1b07b0f0 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] HTTP exception thrown: Instance 1e9957cf-cfeb-483d-bc32-73ca72a54eb9 could not be found. Oct 04 21:48:53.014816 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-d430efdb-fc6b-4c4f-a864-d3ad1b07b0f0 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Request method failure captured: Oct 04 21:48:53.014816 n-d-860284-1 devstack@n-api.service[134101]: request: DELETE /compute/v2.1/servers/1e9957cf-cfeb-483d-bc32-73ca72a54eb9 HTTP/1.1 Oct 04 21:48:53.014816 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 21:48:53.014816 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 21:48:53.014816 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 21:48:53.014816 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 21:48:53.014816 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 21:48:53.014816 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 21:48:53.014816 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 21:48:53.014816 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 21:48:53.014816 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPKk608Zd4sYHwPFk5U59PlIAwuPgot7OTXGV_aSkyPZ0bwxbMweTeyEZ1AFLJ3sD8_k6FD4UZBeQnIWzP_Dhuvkxz8fr2N4feRn9kw8XoN1wz_g8qzYCXsRKkgzhhV7pyurye_naKA8q4KTCRj1JQTG85J-NFuxWDhAvl23V45hS9HE Oct 04 21:48:53.014816 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 21:48:53.014816 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 21:48:53.014816 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 21:48:53.014816 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 21:48:53.014816 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 21:48:53.014816 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 21:48:53.014816 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: 0f6a5f1476ac48f3831f2ed202dacdf8 Oct 04 21:48:53.014816 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-943603883 Oct 04 21:48:53.014816 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 21:48:53.014816 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 21:48:53.014816 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0f6a5f1476ac48f3831f2ed202dacdf8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_0f6a5f1476ac48f3831f2ed202dacdf8", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0f6a5f1476ac48f3831f2ed202dacdf8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/0f6a5f1476ac48f3831f2ed202dacdf8"}]}] Oct 04 21:48:53.014816 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-943603883 Oct 04 21:48:53.014816 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: 0f6a5f1476ac48f3831f2ed202dacdf8 Oct 04 21:48:53.014816 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-943603883 Oct 04 21:48:53.014816 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-AttachSCSIVolumeTestJSON-943603883-project Oct 04 21:48:53.014816 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 21:48:53.014816 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 21:48:53.014816 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 5a2dff38dea346219f6534426fd27ff8 Oct 04 21:48:53.014816 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-943603883-project Oct 04 21:48:53.014816 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 21:48:53.014816 n-d-860284-1 devstack@n-api.service[134101]: exception: Instance 1e9957cf-cfeb-483d-bc32-73ca72a54eb9 could not be found. Oct 04 21:48:53.014816 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': '1e9957cf-cfeb-483d-bc32-73ca72a54eb9'} Oct 04 21:48:53.014816 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:48:53.014816 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:48:53.014816 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:48:53.014816 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:48:53.014816 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:48:53.014816 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:48:53.014816 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:48:53.014816 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:48:53.014816 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:48:53.014816 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:48:53.014816 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e9957cf-cfeb-483d-bc32-73ca72a54eb9 could not be found. Oct 04 21:48:53.014816 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:48:53.014816 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:48:53.014816 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:48:53.014816 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:48:53.014816 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:48:53.014816 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:48:53.014816 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:48:53.014816 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:48:53.014816 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:48:53.014816 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:48:53.014816 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 21:48:53.014816 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 21:48:53.014816 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 21:48:53.014816 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 21:48:53.014816 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:48:53.014816 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:48:53.014816 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:48:53.014816 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:48:53.019231 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e9957cf-cfeb-483d-bc32-73ca72a54eb9 could not be found. Oct 04 21:48:53.019231 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:48:53.019231 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:48:53.019231 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:48:53.019231 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:48:53.019231 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:48:53.019231 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:48:53.019231 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:48:53.019231 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:48:53.019231 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e9957cf-cfeb-483d-bc32-73ca72a54eb9 could not be found. Oct 04 21:48:53.019231 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:48:53.022777 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-d430efdb-fc6b-4c4f-a864-d3ad1b07b0f0 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Returning 404 to user: Instance 1e9957cf-cfeb-483d-bc32-73ca72a54eb9 could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:48:53.025437 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-d430efdb-fc6b-4c4f-a864-d3ad1b07b0f0 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] 10.222.0.43 "DELETE /compute/v2.1/servers/1e9957cf-cfeb-483d-bc32-73ca72a54eb9" status: 404 len: 111 microversion: 2.1 time: 0.089940 Oct 04 21:48:53.026328 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 741/1540] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 21:48:52 2022] DELETE /compute/v2.1/servers/1e9957cf-cfeb-483d-bc32-73ca72a54eb9 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 21:48:53.042446 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-74b8a11e-43f1-41da-9398-51477922be38 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:53.044901 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-74b8a11e-43f1-41da-9398-51477922be38 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] [instance: 1e9957cf-cfeb-483d-bc32-73ca72a54eb9] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:48:53.060794 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-74b8a11e-43f1-41da-9398-51477922be38 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:53.061482 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-74b8a11e-43f1-41da-9398-51477922be38 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:53.062211 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-74b8a11e-43f1-41da-9398-51477922be38 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:53.063169 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-74b8a11e-43f1-41da-9398-51477922be38 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:53.063894 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-74b8a11e-43f1-41da-9398-51477922be38 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:53.064638 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-74b8a11e-43f1-41da-9398-51477922be38 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:53.137524 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-74b8a11e-43f1-41da-9398-51477922be38 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] HTTP exception thrown: Instance 1e9957cf-cfeb-483d-bc32-73ca72a54eb9 could not be found. Oct 04 21:48:53.142175 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-74b8a11e-43f1-41da-9398-51477922be38 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Request method failure captured: Oct 04 21:48:53.142175 n-d-860284-1 devstack@n-api.service[134102]: request: GET /compute/v2.1/servers/1e9957cf-cfeb-483d-bc32-73ca72a54eb9 HTTP/1.1 Oct 04 21:48:53.142175 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 21:48:53.142175 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 21:48:53.142175 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 21:48:53.142175 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 21:48:53.142175 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 21:48:53.142175 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 21:48:53.142175 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 21:48:53.142175 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 21:48:53.142175 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPKk608Zd4sYHwPFk5U59PlIAwuPgot7OTXGV_aSkyPZ0bwxbMweTeyEZ1AFLJ3sD8_k6FD4UZBeQnIWzP_Dhuvkxz8fr2N4feRn9kw8XoN1wz_g8qzYCXsRKkgzhhV7pyurye_naKA8q4KTCRj1JQTG85J-NFuxWDhAvl23V45hS9HE Oct 04 21:48:53.142175 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 21:48:53.142175 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 21:48:53.142175 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 21:48:53.142175 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 21:48:53.142175 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 21:48:53.142175 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 21:48:53.142175 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: 0f6a5f1476ac48f3831f2ed202dacdf8 Oct 04 21:48:53.142175 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-943603883 Oct 04 21:48:53.142175 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 21:48:53.142175 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 21:48:53.142175 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0f6a5f1476ac48f3831f2ed202dacdf8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_0f6a5f1476ac48f3831f2ed202dacdf8", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0f6a5f1476ac48f3831f2ed202dacdf8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/0f6a5f1476ac48f3831f2ed202dacdf8"}]}] Oct 04 21:48:53.142175 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-943603883 Oct 04 21:48:53.142175 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: 0f6a5f1476ac48f3831f2ed202dacdf8 Oct 04 21:48:53.142175 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-943603883 Oct 04 21:48:53.142175 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-AttachSCSIVolumeTestJSON-943603883-project Oct 04 21:48:53.142175 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 21:48:53.142175 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 21:48:53.142175 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: 5a2dff38dea346219f6534426fd27ff8 Oct 04 21:48:53.142175 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-943603883-project Oct 04 21:48:53.142175 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 21:48:53.142175 n-d-860284-1 devstack@n-api.service[134102]: exception: Instance 1e9957cf-cfeb-483d-bc32-73ca72a54eb9 could not be found. Oct 04 21:48:53.142175 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': '1e9957cf-cfeb-483d-bc32-73ca72a54eb9'} Oct 04 21:48:53.142175 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:48:53.142175 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:48:53.142175 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:48:53.142175 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:48:53.142175 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:48:53.142175 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:48:53.142175 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:48:53.142175 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:48:53.142175 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:48:53.142175 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:48:53.142175 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e9957cf-cfeb-483d-bc32-73ca72a54eb9 could not be found. Oct 04 21:48:53.142175 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:48:53.142175 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:48:53.142175 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:48:53.142175 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:48:53.142175 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:48:53.142175 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:48:53.142175 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:48:53.142175 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:48:53.142175 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:48:53.142175 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:48:53.142175 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:48:53.142175 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:48:53.142175 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:48:53.142175 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:48:53.142175 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:48:53.142175 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:48:53.142175 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e9957cf-cfeb-483d-bc32-73ca72a54eb9 could not be found. Oct 04 21:48:53.142175 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:48:53.142175 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:48:53.142175 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:48:53.148114 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:48:53.148114 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:48:53.148114 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:48:53.148114 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:48:53.148114 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:48:53.148114 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e9957cf-cfeb-483d-bc32-73ca72a54eb9 could not be found. Oct 04 21:48:53.148114 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:48:53.150763 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-74b8a11e-43f1-41da-9398-51477922be38 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] Returning 404 to user: Instance 1e9957cf-cfeb-483d-bc32-73ca72a54eb9 could not be found. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:48:53.152809 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-74b8a11e-43f1-41da-9398-51477922be38 tempest-AttachSCSIVolumeTestJSON-943603883 tempest-AttachSCSIVolumeTestJSON-943603883-project] 10.222.0.43 "GET /compute/v2.1/servers/1e9957cf-cfeb-483d-bc32-73ca72a54eb9" status: 404 len: 111 microversion: 2.1 time: 0.121008 Oct 04 21:48:53.154542 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 800/1541] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:48:53 2022] GET /compute/v2.1/servers/1e9957cf-cfeb-483d-bc32-73ca72a54eb9 => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:48:53.422723 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-5d274600-c850-4ef5-bec5-557b8792772f tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:53.423860 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-5d274600-c850-4ef5-bec5-557b8792772f tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: be573c06-25e7-485e-9443-5bc21196a45e] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:48:53.444475 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5d274600-c850-4ef5-bec5-557b8792772f tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:53.445341 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5d274600-c850-4ef5-bec5-557b8792772f tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:53.449964 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5d274600-c850-4ef5-bec5-557b8792772f tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:53.450969 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5d274600-c850-4ef5-bec5-557b8792772f tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:53.451622 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5d274600-c850-4ef5-bec5-557b8792772f tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:53.452253 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5d274600-c850-4ef5-bec5-557b8792772f tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:53.503019 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-d95a132f-cf78-4e8f-b138-399e867ed7a9 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:53.504282 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-d95a132f-cf78-4e8f-b138-399e867ed7a9 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] [instance: fdc82b91-5dfa-44cf-b8c5-402922265d88] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:48:53.520008 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d95a132f-cf78-4e8f-b138-399e867ed7a9 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:53.524251 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d95a132f-cf78-4e8f-b138-399e867ed7a9 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:53.530739 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d95a132f-cf78-4e8f-b138-399e867ed7a9 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:53.531600 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d95a132f-cf78-4e8f-b138-399e867ed7a9 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:53.532103 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d95a132f-cf78-4e8f-b138-399e867ed7a9 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:53.543040 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d95a132f-cf78-4e8f-b138-399e867ed7a9 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:54.618930 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-d95a132f-cf78-4e8f-b138-399e867ed7a9 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d66a6a9c5c4c57ba0d25a37323f37f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758fcafb5db74075b183978a97b7c4ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:48:54.620813 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-5d274600-c850-4ef5-bec5-557b8792772f tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:48:54.637361 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-5d274600-c850-4ef5-bec5-557b8792772f tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/be573c06-25e7-485e-9443-5bc21196a45e" status: 200 len: 1476 microversion: 2.1 time: 1.213612 Oct 04 21:48:54.641554 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 742/1542] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:48:53 2022] GET /compute/v2.1/servers/be573c06-25e7-485e-9443-5bc21196a45e => generated 1476 bytes in 1225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:48:54.684883 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-d95a132f-cf78-4e8f-b138-399e867ed7a9 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] 10.222.0.43 "GET /compute/v2.1/servers/fdc82b91-5dfa-44cf-b8c5-402922265d88" status: 200 len: 1323 microversion: 2.1 time: 1.185870 Oct 04 21:48:54.686146 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 801/1543] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:48:53 2022] GET /compute/v2.1/servers/fdc82b91-5dfa-44cf-b8c5-402922265d88 => generated 1323 bytes in 1188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:48:55.685641 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-bd5bbf0c-02d0-4526-af77-d233319410c4 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:55.686481 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-bd5bbf0c-02d0-4526-af77-d233319410c4 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: be573c06-25e7-485e-9443-5bc21196a45e] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:48:55.706083 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bd5bbf0c-02d0-4526-af77-d233319410c4 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:55.706903 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bd5bbf0c-02d0-4526-af77-d233319410c4 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:55.707582 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bd5bbf0c-02d0-4526-af77-d233319410c4 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:55.708739 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bd5bbf0c-02d0-4526-af77-d233319410c4 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:55.709402 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bd5bbf0c-02d0-4526-af77-d233319410c4 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:55.710012 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bd5bbf0c-02d0-4526-af77-d233319410c4 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:55.713333 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-7c20e3c6-b8ab-4167-9aa8-779cccf5e159 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:55.713962 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-7c20e3c6-b8ab-4167-9aa8-779cccf5e159 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] [instance: fdc82b91-5dfa-44cf-b8c5-402922265d88] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:48:55.731251 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7c20e3c6-b8ab-4167-9aa8-779cccf5e159 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:55.731770 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7c20e3c6-b8ab-4167-9aa8-779cccf5e159 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:55.732223 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7c20e3c6-b8ab-4167-9aa8-779cccf5e159 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:55.737183 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7c20e3c6-b8ab-4167-9aa8-779cccf5e159 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:55.739587 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7c20e3c6-b8ab-4167-9aa8-779cccf5e159 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:55.742590 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7c20e3c6-b8ab-4167-9aa8-779cccf5e159 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:56.716161 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-bd5bbf0c-02d0-4526-af77-d233319410c4 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:48:56.726895 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-bd5bbf0c-02d0-4526-af77-d233319410c4 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/be573c06-25e7-485e-9443-5bc21196a45e" status: 200 len: 1476 microversion: 2.1 time: 1.045549 Oct 04 21:48:56.728503 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 743/1544] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:48:55 2022] GET /compute/v2.1/servers/be573c06-25e7-485e-9443-5bc21196a45e => generated 1476 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:48:56.757635 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-7c20e3c6-b8ab-4167-9aa8-779cccf5e159 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d66a6a9c5c4c57ba0d25a37323f37f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758fcafb5db74075b183978a97b7c4ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:48:56.776116 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-7c20e3c6-b8ab-4167-9aa8-779cccf5e159 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] 10.222.0.43 "GET /compute/v2.1/servers/fdc82b91-5dfa-44cf-b8c5-402922265d88" status: 200 len: 1323 microversion: 2.1 time: 1.066478 Oct 04 21:48:56.786802 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 802/1545] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:48:55 2022] GET /compute/v2.1/servers/fdc82b91-5dfa-44cf-b8c5-402922265d88 => generated 1323 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:48:56.967677 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-11c1a024-5ff7-4cd3-b28c-c46c1680e5e2 tempest-FlavorsExtraSpecsTestJSON-1649286841 tempest-FlavorsExtraSpecsTestJSON-1649286841-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1304464689", "ram": 512, "vcpus": 1, "disk": 10, "id": 25997412, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:48:57.022921 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-11c1a024-5ff7-4cd3-b28c-c46c1680e5e2 tempest-FlavorsExtraSpecsTestJSON-1649286841 tempest-FlavorsExtraSpecsTestJSON-1649286841-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 410 microversion: 2.1 time: 0.292976 Oct 04 21:48:57.028325 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 744/1546] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 21:48:56 2022] POST /compute/v2.1/flavors => generated 410 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:48:57.038211 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-45a54316-16e3-4319-8dcc-da76a4b2fbaf tempest-FlavorsExtraSpecsTestJSON-1649286841 tempest-FlavorsExtraSpecsTestJSON-1649286841-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:48:57.048822 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-b5486ec2-7385-49ad-9bdd-5acf8af33d91 tempest-FloatingIPsTestJSON-413331982 tempest-FloatingIPsTestJSON-413331982-project] Action: 'create', calling method: .version_select at 0x7fbb2f95bb80>, body: {"pool": null} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:48:57.084574 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-45a54316-16e3-4319-8dcc-da76a4b2fbaf tempest-FlavorsExtraSpecsTestJSON-1649286841 tempest-FlavorsExtraSpecsTestJSON-1649286841-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors/25997412/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.050725 Oct 04 21:48:57.085784 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 745/1547] 10.222.0.43 () {60 vars in 1218 bytes} [Tue Oct 4 21:48:57 2022] POST /compute/v2.1/flavors/25997412/os-extra_specs => generated 66 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 04 21:48:57.337426 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-732cfe65-e8c7-4e43-89ff-9ff573c9ec86 tempest-FlavorsExtraSpecsTestJSON-1585448240 tempest-FlavorsExtraSpecsTestJSON-1585448240-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:57.420584 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-732cfe65-e8c7-4e43-89ff-9ff573c9ec86 tempest-FlavorsExtraSpecsTestJSON-1585448240 tempest-FlavorsExtraSpecsTestJSON-1585448240-project] 10.222.0.43 "GET /compute/v2.1/flavors/25997412/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.327222 Oct 04 21:48:57.421112 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 746/1548] 10.222.0.43 () {58 vars in 1197 bytes} [Tue Oct 4 21:48:57 2022] GET /compute/v2.1/flavors/25997412/os-extra_specs => generated 66 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 21:48:57.435784 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-400fa5b6-cf8a-4e3c-acc0-559c2d69cfec tempest-FlavorsExtraSpecsTestJSON-1649286841 tempest-FlavorsExtraSpecsTestJSON-1649286841-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:48:57.492148 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-400fa5b6-cf8a-4e3c-acc0-559c2d69cfec tempest-FlavorsExtraSpecsTestJSON-1649286841 tempest-FlavorsExtraSpecsTestJSON-1649286841-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors/25997412/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.059922 Oct 04 21:48:57.494227 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 747/1549] 10.222.0.43 () {60 vars in 1218 bytes} [Tue Oct 4 21:48:57 2022] POST /compute/v2.1/flavors/25997412/os-extra_specs => generated 66 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 04 21:48:57.511407 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-267d5739-51f5-4284-9f02-9f5d4efd6f2c tempest-FlavorsExtraSpecsTestJSON-1585448240 tempest-FlavorsExtraSpecsTestJSON-1585448240-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:57.540181 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=8,nova_api:DELETE=5,nova_api:SAVEPOINT=6,nova_api:RELEASE=6 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:48:57.561509 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-267d5739-51f5-4284-9f02-9f5d4efd6f2c tempest-FlavorsExtraSpecsTestJSON-1585448240 tempest-FlavorsExtraSpecsTestJSON-1585448240-project] 10.222.0.43 "GET /compute/v2.1/flavors/25997412/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.060760 Oct 04 21:48:57.565999 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 748/1550] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 21:48:57 2022] GET /compute/v2.1/flavors/25997412/os-extra_specs/hw:numa_nodes => generated 22 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 21:48:57.580408 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-12477701-c428-4cd6-837e-3af7bb9dc016 tempest-FlavorsExtraSpecsTestJSON-1649286841 tempest-FlavorsExtraSpecsTestJSON-1649286841-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:48:57.612046 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-12477701-c428-4cd6-837e-3af7bb9dc016 tempest-FlavorsExtraSpecsTestJSON-1649286841 tempest-FlavorsExtraSpecsTestJSON-1649286841-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors/25997412/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.038619 Oct 04 21:48:57.618824 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 749/1551] 10.222.0.43 () {60 vars in 1218 bytes} [Tue Oct 4 21:48:57 2022] POST /compute/v2.1/flavors/25997412/os-extra_specs => generated 66 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 04 21:48:57.624511 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-5fb759eb-aefb-4712-9e01-db904b883d6a tempest-FlavorsExtraSpecsTestJSON-1649286841 tempest-FlavorsExtraSpecsTestJSON-1649286841-project-admin] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:57.644251 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-5fb759eb-aefb-4712-9e01-db904b883d6a tempest-FlavorsExtraSpecsTestJSON-1649286841 tempest-FlavorsExtraSpecsTestJSON-1649286841-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/25997412/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.023117 Oct 04 21:48:57.646153 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 750/1552] 10.222.0.43 () {58 vars in 1197 bytes} [Tue Oct 4 21:48:57 2022] GET /compute/v2.1/flavors/25997412/os-extra_specs => generated 66 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 21:48:57.659836 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e1436f2f-1dda-4000-b32b-736671048b79 tempest-FlavorsExtraSpecsTestJSON-1649286841 tempest-FlavorsExtraSpecsTestJSON-1649286841-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:48:57.724656 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-e1436f2f-1dda-4000-b32b-736671048b79 tempest-FlavorsExtraSpecsTestJSON-1649286841 tempest-FlavorsExtraSpecsTestJSON-1649286841-project-admin] 10.222.0.43 "PUT /compute/v2.1/flavors/25997412/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.070836 Oct 04 21:48:57.729382 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 751/1553] 10.222.0.43 () {60 vars in 1259 bytes} [Tue Oct 4 21:48:57 2022] PUT /compute/v2.1/flavors/25997412/os-extra_specs/hw:numa_nodes => generated 22 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 04 21:48:57.739742 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-6cbb30d9-2028-4e6c-bcf4-3037258e3399 tempest-FlavorsExtraSpecsTestJSON-1649286841 tempest-FlavorsExtraSpecsTestJSON-1649286841-project-admin] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:57.753968 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-6cbb30d9-2028-4e6c-bcf4-3037258e3399 tempest-FlavorsExtraSpecsTestJSON-1649286841 tempest-FlavorsExtraSpecsTestJSON-1649286841-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/25997412/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.018945 Oct 04 21:48:57.755710 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 752/1554] 10.222.0.43 () {58 vars in 1197 bytes} [Tue Oct 4 21:48:57 2022] GET /compute/v2.1/flavors/25997412/os-extra_specs => generated 66 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 21:48:57.761662 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-3315b68d-6d09-433d-890b-55e847b67574 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:57.762693 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-3315b68d-6d09-433d-890b-55e847b67574 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: be573c06-25e7-485e-9443-5bc21196a45e] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:48:57.771737 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3315b68d-6d09-433d-890b-55e847b67574 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:57.773837 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3315b68d-6d09-433d-890b-55e847b67574 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:57.774732 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3315b68d-6d09-433d-890b-55e847b67574 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:57.775703 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3315b68d-6d09-433d-890b-55e847b67574 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:57.776373 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3315b68d-6d09-433d-890b-55e847b67574 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:57.776978 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3315b68d-6d09-433d-890b-55e847b67574 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:58.072301 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell0:SELECT=4 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:48:58.561194 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell0:SELECT=38 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:48:59.277846 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-3315b68d-6d09-433d-890b-55e847b67574 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:48:59.294565 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-3315b68d-6d09-433d-890b-55e847b67574 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/be573c06-25e7-485e-9443-5bc21196a45e" status: 200 len: 1476 microversion: 2.1 time: 1.537404 Oct 04 21:48:59.295166 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 753/1555] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:48:57 2022] GET /compute/v2.1/servers/be573c06-25e7-485e-9443-5bc21196a45e => generated 1476 bytes in 1539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:48:59.320248 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-ec5396c2-fa2c-480d-949a-07c499f62676 tempest-FlavorsExtraSpecsTestJSON-1649286841 tempest-FlavorsExtraSpecsTestJSON-1649286841-project-admin] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:59.391620 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-ec5396c2-fa2c-480d-949a-07c499f62676 tempest-FlavorsExtraSpecsTestJSON-1649286841 tempest-FlavorsExtraSpecsTestJSON-1649286841-project-admin] 10.222.0.43 "DELETE /compute/v2.1/flavors/25997412/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.089114 Oct 04 21:48:59.395534 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 754/1556] 10.222.0.43 () {58 vars in 1242 bytes} [Tue Oct 4 21:48:59 2022] DELETE /compute/v2.1/flavors/25997412/os-extra_specs/hw:numa_nodes => generated 0 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 21:48:59.407447 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-656a5258-9d8b-42e7-858b-27bbf82dbdca tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:59.412764 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-656a5258-9d8b-42e7-858b-27bbf82dbdca tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] [instance: fdc82b91-5dfa-44cf-b8c5-402922265d88] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:48:59.462008 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-656a5258-9d8b-42e7-858b-27bbf82dbdca tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:59.467794 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-656a5258-9d8b-42e7-858b-27bbf82dbdca tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:59.469560 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-656a5258-9d8b-42e7-858b-27bbf82dbdca tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:59.475658 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-656a5258-9d8b-42e7-858b-27bbf82dbdca tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:59.477013 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-656a5258-9d8b-42e7-858b-27bbf82dbdca tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:59.484798 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-656a5258-9d8b-42e7-858b-27bbf82dbdca tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:00.227269 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-656a5258-9d8b-42e7-858b-27bbf82dbdca tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d66a6a9c5c4c57ba0d25a37323f37f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758fcafb5db74075b183978a97b7c4ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:49:00.271165 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-656a5258-9d8b-42e7-858b-27bbf82dbdca tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] 10.222.0.43 "GET /compute/v2.1/servers/fdc82b91-5dfa-44cf-b8c5-402922265d88" status: 200 len: 1323 microversion: 2.1 time: 0.873192 Oct 04 21:49:00.276879 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 755/1557] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:48:59 2022] GET /compute/v2.1/servers/fdc82b91-5dfa-44cf-b8c5-402922265d88 => generated 1323 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:49:00.436694 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-03930ef7-8a1d-44b4-954b-33c7b68ba84e req-76141abc-0b1c-4050-b209-5a3de4dc8534 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be573c06-25e7-485e-9443-5bc21196a45e", "name": "network-vif-unplugged", "status": "completed", "tag": "ab7d2e00-d523-4e06-a029-fdb5f5ae6c75"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:49:00.450786 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-03930ef7-8a1d-44b4-954b-33c7b68ba84e req-76141abc-0b1c-4050-b209-5a3de4dc8534 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:00.451047 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-03930ef7-8a1d-44b4-954b-33c7b68ba84e req-76141abc-0b1c-4050-b209-5a3de4dc8534 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:00.451512 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-03930ef7-8a1d-44b4-954b-33c7b68ba84e req-76141abc-0b1c-4050-b209-5a3de4dc8534 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:00.465563 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-03930ef7-8a1d-44b4-954b-33c7b68ba84e req-76141abc-0b1c-4050-b209-5a3de4dc8534 service nova] Creating event network-vif-unplugged:ab7d2e00-d523-4e06-a029-fdb5f5ae6c75 for instance be573c06-25e7-485e-9443-5bc21196a45e on n-h2-860284-1 Oct 04 21:49:00.475237 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [req-03930ef7-8a1d-44b4-954b-33c7b68ba84e req-76141abc-0b1c-4050-b209-5a3de4dc8534 service nova] Instance be573c06-25e7-485e-9443-5bc21196a45e is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860284-1', 'n-h2-860284-1'} {{(pid=134101) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 21:49:00.494120 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-03930ef7-8a1d-44b4-954b-33c7b68ba84e req-76141abc-0b1c-4050-b209-5a3de4dc8534 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.215211 Oct 04 21:49:00.494805 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 756/1558] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:49:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:49:00.500167 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-48ec88bd-10ca-4f4b-af81-e3c5b626ae82 tempest-FlavorsExtraSpecsTestJSON-1649286841 tempest-FlavorsExtraSpecsTestJSON-1649286841-project-admin] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:49:00.523499 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-48ec88bd-10ca-4f4b-af81-e3c5b626ae82 tempest-FlavorsExtraSpecsTestJSON-1649286841 tempest-FlavorsExtraSpecsTestJSON-1649286841-project-admin] 10.222.0.43 "DELETE /compute/v2.1/flavors/25997412/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.027165 Oct 04 21:49:00.524011 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 757/1559] 10.222.0.43 () {58 vars in 1242 bytes} [Tue Oct 4 21:49:00 2022] DELETE /compute/v2.1/flavors/25997412/os-extra_specs/hw:cpu_policy => generated 0 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 21:49:00.639377 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-b53034c3-dcd3-4952-bf43-27ba4ed22352 req-33394b22-a4dd-4c8a-a002-9808b11b1ff2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fdc82b91-5dfa-44cf-b8c5-402922265d88", "tag": "c36556e1-4c6d-4308-8210-aa45c17cd2d1"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:49:00.652906 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-b53034c3-dcd3-4952-bf43-27ba4ed22352 req-33394b22-a4dd-4c8a-a002-9808b11b1ff2 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:00.653388 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-b53034c3-dcd3-4952-bf43-27ba4ed22352 req-33394b22-a4dd-4c8a-a002-9808b11b1ff2 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:00.653820 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-b53034c3-dcd3-4952-bf43-27ba4ed22352 req-33394b22-a4dd-4c8a-a002-9808b11b1ff2 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:00.667669 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-b53034c3-dcd3-4952-bf43-27ba4ed22352 req-33394b22-a4dd-4c8a-a002-9808b11b1ff2 service nova] Creating event network-changed:c36556e1-4c6d-4308-8210-aa45c17cd2d1 for instance fdc82b91-5dfa-44cf-b8c5-402922265d88 on n-h2-860284-1 Oct 04 21:49:00.672868 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-b53034c3-dcd3-4952-bf43-27ba4ed22352 req-33394b22-a4dd-4c8a-a002-9808b11b1ff2 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.147291 Oct 04 21:49:00.673784 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 758/1560] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:49:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:49:00.680385 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-449435b0-0064-478d-a221-ec130bc12883 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:49:00.681480 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-449435b0-0064-478d-a221-ec130bc12883 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: be573c06-25e7-485e-9443-5bc21196a45e] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:49:00.688321 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-449435b0-0064-478d-a221-ec130bc12883 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:00.688814 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-449435b0-0064-478d-a221-ec130bc12883 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:00.689247 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-449435b0-0064-478d-a221-ec130bc12883 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:00.689959 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-449435b0-0064-478d-a221-ec130bc12883 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:00.690441 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-449435b0-0064-478d-a221-ec130bc12883 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:00.690870 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-449435b0-0064-478d-a221-ec130bc12883 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:01.260803 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-449435b0-0064-478d-a221-ec130bc12883 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:49:01.278658 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-449435b0-0064-478d-a221-ec130bc12883 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/be573c06-25e7-485e-9443-5bc21196a45e" status: 200 len: 1475 microversion: 2.1 time: 0.602876 Oct 04 21:49:01.285522 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 759/1561] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:49:00 2022] GET /compute/v2.1/servers/be573c06-25e7-485e-9443-5bc21196a45e => generated 1475 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:49:01.290557 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-8dd2c0e6-f802-48f7-bd07-6f6c2e23f6ce tempest-FlavorsExtraSpecsTestJSON-1649286841 tempest-FlavorsExtraSpecsTestJSON-1649286841-project-admin] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:49:01.306705 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-8dd2c0e6-f802-48f7-bd07-6f6c2e23f6ce tempest-FlavorsExtraSpecsTestJSON-1649286841 tempest-FlavorsExtraSpecsTestJSON-1649286841-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/25997412/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.024266 Oct 04 21:49:01.311067 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 760/1562] 10.222.0.43 () {58 vars in 1197 bytes} [Tue Oct 4 21:49:01 2022] GET /compute/v2.1/flavors/25997412/os-extra_specs => generated 19 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 21:49:01.318695 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-8a1d7140-570b-4dbd-b26e-9b0487c76bf5 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:49:01.319322 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-8a1d7140-570b-4dbd-b26e-9b0487c76bf5 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] [instance: fdc82b91-5dfa-44cf-b8c5-402922265d88] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:49:01.325749 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8a1d7140-570b-4dbd-b26e-9b0487c76bf5 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:01.326251 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8a1d7140-570b-4dbd-b26e-9b0487c76bf5 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:01.326744 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8a1d7140-570b-4dbd-b26e-9b0487c76bf5 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:01.327626 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8a1d7140-570b-4dbd-b26e-9b0487c76bf5 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:01.328092 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8a1d7140-570b-4dbd-b26e-9b0487c76bf5 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:01.328528 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8a1d7140-570b-4dbd-b26e-9b0487c76bf5 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:01.929380 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-8a1d7140-570b-4dbd-b26e-9b0487c76bf5 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d66a6a9c5c4c57ba0d25a37323f37f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758fcafb5db74075b183978a97b7c4ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:49:01.931861 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=100 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:49:01.955136 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-8a1d7140-570b-4dbd-b26e-9b0487c76bf5 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] 10.222.0.43 "GET /compute/v2.1/servers/fdc82b91-5dfa-44cf-b8c5-402922265d88" status: 200 len: 1323 microversion: 2.1 time: 0.632413 Oct 04 21:49:01.970407 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 761/1563] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:49:01 2022] GET /compute/v2.1/servers/fdc82b91-5dfa-44cf-b8c5-402922265d88 => generated 1323 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:49:01.970407 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-ccbe0b86-72c5-48a9-9cd9-da9e5bcd84a6 tempest-FlavorsExtraSpecsTestJSON-1649286841 tempest-FlavorsExtraSpecsTestJSON-1649286841-project-admin] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:49:02.006981 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-ccbe0b86-72c5-48a9-9cd9-da9e5bcd84a6 tempest-FlavorsExtraSpecsTestJSON-1649286841 tempest-FlavorsExtraSpecsTestJSON-1649286841-project-admin] 10.222.0.43 "DELETE /compute/v2.1/flavors/25997412" status: 202 len: 0 microversion: 2.1 time: 0.049124 Oct 04 21:49:02.007619 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 762/1564] 10.222.0.43 () {58 vars in 1155 bytes} [Tue Oct 4 21:49:01 2022] DELETE /compute/v2.1/flavors/25997412 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:49:02.017980 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-829fb177-2455-4bbc-bda6-be90d6ab0e8a tempest-FlavorsExtraSpecsTestJSON-1649286841 tempest-FlavorsExtraSpecsTestJSON-1649286841-project-admin] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:49:02.066510 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-829fb177-2455-4bbc-bda6-be90d6ab0e8a tempest-FlavorsExtraSpecsTestJSON-1649286841 tempest-FlavorsExtraSpecsTestJSON-1649286841-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.053328 Oct 04 21:49:02.067582 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 763/1565] 10.222.0.43 () {58 vars in 1146 bytes} [Tue Oct 4 21:49:02 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:49:02.306313 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-687f6fc8-bdb5-42bb-97c5-efb8209ea497 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:49:02.306982 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-687f6fc8-bdb5-42bb-97c5-efb8209ea497 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: be573c06-25e7-485e-9443-5bc21196a45e] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:49:02.318571 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-687f6fc8-bdb5-42bb-97c5-efb8209ea497 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:02.319080 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-687f6fc8-bdb5-42bb-97c5-efb8209ea497 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:02.324916 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-687f6fc8-bdb5-42bb-97c5-efb8209ea497 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:02.326099 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-687f6fc8-bdb5-42bb-97c5-efb8209ea497 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:02.326849 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-687f6fc8-bdb5-42bb-97c5-efb8209ea497 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:02.335132 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-687f6fc8-bdb5-42bb-97c5-efb8209ea497 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:02.777550 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-687f6fc8-bdb5-42bb-97c5-efb8209ea497 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:49:02.804063 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-687f6fc8-bdb5-42bb-97c5-efb8209ea497 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/be573c06-25e7-485e-9443-5bc21196a45e" status: 200 len: 1473 microversion: 2.1 time: 0.502057 Oct 04 21:49:02.810706 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 764/1566] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:49:02 2022] GET /compute/v2.1/servers/be573c06-25e7-485e-9443-5bc21196a45e => generated 1473 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:49:02.823814 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-1ff8a997-2f39-4c9f-a1ff-9ba6e1d51057 req-fdc41d93-4ad9-47c0-82c1-757855c818f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be573c06-25e7-485e-9443-5bc21196a45e", "tag": "ab7d2e00-d523-4e06-a029-fdb5f5ae6c75"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:49:02.852408 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-1ff8a997-2f39-4c9f-a1ff-9ba6e1d51057 req-fdc41d93-4ad9-47c0-82c1-757855c818f8 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:02.853248 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-1ff8a997-2f39-4c9f-a1ff-9ba6e1d51057 req-fdc41d93-4ad9-47c0-82c1-757855c818f8 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:02.854683 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-1ff8a997-2f39-4c9f-a1ff-9ba6e1d51057 req-fdc41d93-4ad9-47c0-82c1-757855c818f8 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:02.902446 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-1ff8a997-2f39-4c9f-a1ff-9ba6e1d51057 req-fdc41d93-4ad9-47c0-82c1-757855c818f8 service nova] Creating event network-changed:ab7d2e00-d523-4e06-a029-fdb5f5ae6c75 for instance be573c06-25e7-485e-9443-5bc21196a45e on n-h2-860284-1 Oct 04 21:49:02.912928 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [req-1ff8a997-2f39-4c9f-a1ff-9ba6e1d51057 req-fdc41d93-4ad9-47c0-82c1-757855c818f8 service nova] Instance be573c06-25e7-485e-9443-5bc21196a45e is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860284-1', 'n-h2-860284-1'} {{(pid=134101) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 21:49:02.929104 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-1ff8a997-2f39-4c9f-a1ff-9ba6e1d51057 req-fdc41d93-4ad9-47c0-82c1-757855c818f8 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115973 Oct 04 21:49:02.930089 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 765/1567] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:49:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:49:02.997300 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-b65db7a8-da86-4f2c-bda1-c7c86aee70b4 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:49:03.001161 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-b65db7a8-da86-4f2c-bda1-c7c86aee70b4 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] [instance: fdc82b91-5dfa-44cf-b8c5-402922265d88] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:49:03.024905 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b65db7a8-da86-4f2c-bda1-c7c86aee70b4 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:03.025406 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b65db7a8-da86-4f2c-bda1-c7c86aee70b4 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:03.026189 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b65db7a8-da86-4f2c-bda1-c7c86aee70b4 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:03.027499 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b65db7a8-da86-4f2c-bda1-c7c86aee70b4 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:03.028154 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b65db7a8-da86-4f2c-bda1-c7c86aee70b4 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:03.028833 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b65db7a8-da86-4f2c-bda1-c7c86aee70b4 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:03.170031 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-b5486ec2-7385-49ad-9bdd-5acf8af33d91 tempest-FloatingIPsTestJSON-413331982 tempest-FloatingIPsTestJSON-413331982-project] 10.222.0.43 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 6.382423 Oct 04 21:49:03.172019 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 803/1568] 10.222.0.43 () {60 vars in 1170 bytes} [Tue Oct 4 21:48:56 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 6386 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:49:03.187687 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-79371b14-d5d7-4402-b181-3456fa7c2121 tempest-FloatingIPsTestJSON-413331982 tempest-FloatingIPsTestJSON-413331982-project] Calling method '.version_select at 0x7fbb2f1f6b80>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:49:03.615310 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-b65db7a8-da86-4f2c-bda1-c7c86aee70b4 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d66a6a9c5c4c57ba0d25a37323f37f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758fcafb5db74075b183978a97b7c4ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:49:03.627450 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-b65db7a8-da86-4f2c-bda1-c7c86aee70b4 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] 10.222.0.43 "GET /compute/v2.1/servers/fdc82b91-5dfa-44cf-b8c5-402922265d88" status: 200 len: 1323 microversion: 2.1 time: 0.648956 Oct 04 21:49:03.642998 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 766/1569] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:49:02 2022] GET /compute/v2.1/servers/fdc82b91-5dfa-44cf-b8c5-402922265d88 => generated 1323 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:49:03.659873 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-79371b14-d5d7-4402-b181-3456fa7c2121 tempest-FloatingIPsTestJSON-413331982 tempest-FloatingIPsTestJSON-413331982-project] 10.222.0.43 "GET /compute/v2.1/os-floating-ips/c6e81be5-3fba-49b1-a393-5abc39237915" status: 200 len: 142 microversion: 2.1 time: 0.476900 Oct 04 21:49:03.661824 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 804/1570] 10.222.0.43 () {58 vars in 1260 bytes} [Tue Oct 4 21:49:03 2022] GET /compute/v2.1/os-floating-ips/c6e81be5-3fba-49b1-a393-5abc39237915 => generated 142 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:49:03.674535 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-42f0c73e-dfd3-418e-b511-c7f1c7c63cd7 tempest-FloatingIPsTestJSON-413331982 tempest-FloatingIPsTestJSON-413331982-project] Calling method '.version_select at 0x7fbb2eee13a0>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:49:03.865190 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-67596642-891b-4118-ab8b-4a353e2edb79 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:49:03.865917 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-67596642-891b-4118-ab8b-4a353e2edb79 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: be573c06-25e7-485e-9443-5bc21196a45e] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:49:03.888634 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-67596642-891b-4118-ab8b-4a353e2edb79 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:03.889639 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-67596642-891b-4118-ab8b-4a353e2edb79 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:03.890339 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-67596642-891b-4118-ab8b-4a353e2edb79 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:03.893007 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-67596642-891b-4118-ab8b-4a353e2edb79 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:03.894261 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-67596642-891b-4118-ab8b-4a353e2edb79 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:03.895546 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-67596642-891b-4118-ab8b-4a353e2edb79 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:04.328465 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-42f0c73e-dfd3-418e-b511-c7f1c7c63cd7 tempest-FloatingIPsTestJSON-413331982 tempest-FloatingIPsTestJSON-413331982-project] 10.222.0.43 "GET /compute/v2.1/os-floating-ips" status: 200 len: 145 microversion: 2.1 time: 0.657989 Oct 04 21:49:04.330072 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 767/1571] 10.222.0.43 () {58 vars in 1149 bytes} [Tue Oct 4 21:49:03 2022] GET /compute/v2.1/os-floating-ips => generated 145 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:49:04.350395 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-b855b2a8-5847-41a6-b41e-18c09b499e96 tempest-FloatingIPsTestJSON-413331982 tempest-FloatingIPsTestJSON-413331982-project] Calling method '.version_select at 0x7fbb2ee55280>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:49:04.870663 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-67596642-891b-4118-ab8b-4a353e2edb79 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:49:04.886430 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-67596642-891b-4118-ab8b-4a353e2edb79 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/be573c06-25e7-485e-9443-5bc21196a45e" status: 200 len: 1473 microversion: 2.1 time: 1.035344 Oct 04 21:49:04.887269 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 805/1572] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:49:03 2022] GET /compute/v2.1/servers/be573c06-25e7-485e-9443-5bc21196a45e => generated 1473 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:49:04.910280 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-080679e1-c2a4-4517-896a-888e0b3cb09f tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:49:04.911182 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-080679e1-c2a4-4517-896a-888e0b3cb09f tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] [instance: fdc82b91-5dfa-44cf-b8c5-402922265d88] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:49:04.918562 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-080679e1-c2a4-4517-896a-888e0b3cb09f tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:04.919762 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-080679e1-c2a4-4517-896a-888e0b3cb09f tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:04.920616 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-080679e1-c2a4-4517-896a-888e0b3cb09f tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:04.921373 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-080679e1-c2a4-4517-896a-888e0b3cb09f tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:04.921840 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-080679e1-c2a4-4517-896a-888e0b3cb09f tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:04.922271 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-080679e1-c2a4-4517-896a-888e0b3cb09f tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:05.641788 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-080679e1-c2a4-4517-896a-888e0b3cb09f tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d66a6a9c5c4c57ba0d25a37323f37f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758fcafb5db74075b183978a97b7c4ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:49:05.663989 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-080679e1-c2a4-4517-896a-888e0b3cb09f tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] 10.222.0.43 "GET /compute/v2.1/servers/fdc82b91-5dfa-44cf-b8c5-402922265d88" status: 200 len: 1323 microversion: 2.1 time: 0.761613 Oct 04 21:49:05.665681 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 806/1573] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:49:04 2022] GET /compute/v2.1/servers/fdc82b91-5dfa-44cf-b8c5-402922265d88 => generated 1323 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:49:05.913068 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-c2c993be-a86b-43be-9def-5c8fe34302dd tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:49:05.913744 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-c2c993be-a86b-43be-9def-5c8fe34302dd tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: be573c06-25e7-485e-9443-5bc21196a45e] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:49:05.932181 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c2c993be-a86b-43be-9def-5c8fe34302dd tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:05.934319 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c2c993be-a86b-43be-9def-5c8fe34302dd tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:05.935143 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c2c993be-a86b-43be-9def-5c8fe34302dd tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:05.935935 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c2c993be-a86b-43be-9def-5c8fe34302dd tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:05.939521 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c2c993be-a86b-43be-9def-5c8fe34302dd tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:05.939994 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c2c993be-a86b-43be-9def-5c8fe34302dd tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:06.792640 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-c2c993be-a86b-43be-9def-5c8fe34302dd tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:49:06.810293 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-c2c993be-a86b-43be-9def-5c8fe34302dd tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/be573c06-25e7-485e-9443-5bc21196a45e" status: 200 len: 1470 microversion: 2.1 time: 0.902092 Oct 04 21:49:06.828388 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 807/1574] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:49:05 2022] GET /compute/v2.1/servers/be573c06-25e7-485e-9443-5bc21196a45e => generated 1470 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:49:06.838102 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-0bf277b0-dc24-47a9-af44-fb484d9ac645 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:49:06.839073 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-0bf277b0-dc24-47a9-af44-fb484d9ac645 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] [instance: fdc82b91-5dfa-44cf-b8c5-402922265d88] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:49:06.847362 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0bf277b0-dc24-47a9-af44-fb484d9ac645 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:06.848130 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0bf277b0-dc24-47a9-af44-fb484d9ac645 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:06.849163 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0bf277b0-dc24-47a9-af44-fb484d9ac645 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:06.851642 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0bf277b0-dc24-47a9-af44-fb484d9ac645 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:06.852897 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0bf277b0-dc24-47a9-af44-fb484d9ac645 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:06.854019 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0bf277b0-dc24-47a9-af44-fb484d9ac645 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:07.370820 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-0bf277b0-dc24-47a9-af44-fb484d9ac645 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d66a6a9c5c4c57ba0d25a37323f37f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758fcafb5db74075b183978a97b7c4ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:49:07.381010 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-0bf277b0-dc24-47a9-af44-fb484d9ac645 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] 10.222.0.43 "GET /compute/v2.1/servers/fdc82b91-5dfa-44cf-b8c5-402922265d88" status: 200 len: 1323 microversion: 2.1 time: 0.549547 Oct 04 21:49:07.397202 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 808/1575] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:49:06 2022] GET /compute/v2.1/servers/fdc82b91-5dfa-44cf-b8c5-402922265d88 => generated 1323 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:49:07.403334 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-8dbc2f7f-f494-4125-bc33-f755e0b022e2 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:49:07.404277 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-8dbc2f7f-f494-4125-bc33-f755e0b022e2 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: be573c06-25e7-485e-9443-5bc21196a45e] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:49:07.412636 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8dbc2f7f-f494-4125-bc33-f755e0b022e2 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:07.413136 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8dbc2f7f-f494-4125-bc33-f755e0b022e2 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:07.420582 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8dbc2f7f-f494-4125-bc33-f755e0b022e2 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:07.421805 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8dbc2f7f-f494-4125-bc33-f755e0b022e2 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:07.422266 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8dbc2f7f-f494-4125-bc33-f755e0b022e2 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:07.422738 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8dbc2f7f-f494-4125-bc33-f755e0b022e2 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:07.611211 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-8dbc2f7f-f494-4125-bc33-f755e0b022e2 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "POST /compute/v2.1/servers/be573c06-25e7-485e-9443-5bc21196a45e/action" status: 202 len: 0 microversion: 2.1 time: 0.212124 Oct 04 21:49:07.614928 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 809/1576] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 21:49:07 2022] POST /compute/v2.1/servers/be573c06-25e7-485e-9443-5bc21196a45e/action => generated 0 bytes in 217 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:49:07.637110 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-d2c20085-6dcb-4796-861a-eb0c2dd59e46 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:49:07.638950 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-d2c20085-6dcb-4796-861a-eb0c2dd59e46 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: be573c06-25e7-485e-9443-5bc21196a45e] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:49:07.647802 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d2c20085-6dcb-4796-861a-eb0c2dd59e46 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:07.648324 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d2c20085-6dcb-4796-861a-eb0c2dd59e46 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:07.649134 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d2c20085-6dcb-4796-861a-eb0c2dd59e46 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:07.649517 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d2c20085-6dcb-4796-861a-eb0c2dd59e46 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:07.649982 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d2c20085-6dcb-4796-861a-eb0c2dd59e46 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:07.650446 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d2c20085-6dcb-4796-861a-eb0c2dd59e46 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:08.764310 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-d2c20085-6dcb-4796-861a-eb0c2dd59e46 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:49:08.779262 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-d2c20085-6dcb-4796-861a-eb0c2dd59e46 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/be573c06-25e7-485e-9443-5bc21196a45e" status: 200 len: 1469 microversion: 2.1 time: 1.157872 Oct 04 21:49:08.780666 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 810/1577] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:49:07 2022] GET /compute/v2.1/servers/be573c06-25e7-485e-9443-5bc21196a45e => generated 1469 bytes in 1160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:49:08.787080 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-851b2799-f577-4109-a1fd-5898d23aa71f tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:49:08.787861 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-851b2799-f577-4109-a1fd-5898d23aa71f tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] [instance: fdc82b91-5dfa-44cf-b8c5-402922265d88] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:49:08.800687 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=3 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:49:08.805751 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-851b2799-f577-4109-a1fd-5898d23aa71f tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:08.806570 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-851b2799-f577-4109-a1fd-5898d23aa71f tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:08.807137 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-851b2799-f577-4109-a1fd-5898d23aa71f tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:08.808022 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-851b2799-f577-4109-a1fd-5898d23aa71f tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:08.808703 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-851b2799-f577-4109-a1fd-5898d23aa71f tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:08.809406 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-851b2799-f577-4109-a1fd-5898d23aa71f tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:08.847432 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:49:08.908493 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-b855b2a8-5847-41a6-b41e-18c09b499e96 tempest-FloatingIPsTestJSON-413331982 tempest-FloatingIPsTestJSON-413331982-project] 10.222.0.43 "DELETE /compute/v2.1/os-floating-ips/c6e81be5-3fba-49b1-a393-5abc39237915" status: 202 len: 0 microversion: 2.1 time: 4.566160 Oct 04 21:49:08.909473 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 768/1578] 10.222.0.43 () {58 vars in 1263 bytes} [Tue Oct 4 21:49:04 2022] DELETE /compute/v2.1/os-floating-ips/c6e81be5-3fba-49b1-a393-5abc39237915 => generated 0 bytes in 4570 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 21:49:09.086644 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-b23f66d3-5591-4b62-88a1-4ba07beae7b3 req-81a225b1-1d43-4443-98a5-5522035f607d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be573c06-25e7-485e-9443-5bc21196a45e", "name": "network-vif-plugged", "status": "completed", "tag": "ab7d2e00-d523-4e06-a029-fdb5f5ae6c75"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:49:09.096590 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-b23f66d3-5591-4b62-88a1-4ba07beae7b3 req-81a225b1-1d43-4443-98a5-5522035f607d service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:09.097074 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-b23f66d3-5591-4b62-88a1-4ba07beae7b3 req-81a225b1-1d43-4443-98a5-5522035f607d service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:09.097509 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-b23f66d3-5591-4b62-88a1-4ba07beae7b3 req-81a225b1-1d43-4443-98a5-5522035f607d service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:09.110738 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-b23f66d3-5591-4b62-88a1-4ba07beae7b3 req-81a225b1-1d43-4443-98a5-5522035f607d service nova] Creating event network-vif-plugged:ab7d2e00-d523-4e06-a029-fdb5f5ae6c75 for instance be573c06-25e7-485e-9443-5bc21196a45e on n-h2-860284-1 Oct 04 21:49:09.119795 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [req-b23f66d3-5591-4b62-88a1-4ba07beae7b3 req-81a225b1-1d43-4443-98a5-5522035f607d service nova] Instance be573c06-25e7-485e-9443-5bc21196a45e is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860284-1', 'n-h2-860284-1'} {{(pid=134101) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 21:49:09.131567 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-b23f66d3-5591-4b62-88a1-4ba07beae7b3 req-81a225b1-1d43-4443-98a5-5522035f607d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.220628 Oct 04 21:49:09.132483 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 769/1579] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:49:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:49:09.143162 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-2f95034d-efac-41ad-9581-054f7f461694 tempest-FloatingIPsTestJSON-413331982 tempest-FloatingIPsTestJSON-413331982-project] Action: 'create', calling method: .version_select at 0x7fbb2f05e5e0>, body: {"pool": null} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:49:09.255976 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-851b2799-f577-4109-a1fd-5898d23aa71f tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d66a6a9c5c4c57ba0d25a37323f37f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758fcafb5db74075b183978a97b7c4ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:49:09.267511 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-851b2799-f577-4109-a1fd-5898d23aa71f tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] 10.222.0.43 "GET /compute/v2.1/servers/fdc82b91-5dfa-44cf-b8c5-402922265d88" status: 200 len: 1323 microversion: 2.1 time: 0.484900 Oct 04 21:49:09.268426 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 811/1580] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:49:08 2022] GET /compute/v2.1/servers/fdc82b91-5dfa-44cf-b8c5-402922265d88 => generated 1323 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:49:09.342553 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-81fe9c22-6eb6-4adc-be05-9ad0a9c4901b tempest-HostsAdminTestJSON-785849655 tempest-HostsAdminTestJSON-785849655-project-admin] Calling method '.version_select at 0x7fbb2f719940>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:49:09.346518 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-81fe9c22-6eb6-4adc-be05-9ad0a9c4901b tempest-HostsAdminTestJSON-785849655 tempest-HostsAdminTestJSON-785849655-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:09.347008 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-81fe9c22-6eb6-4adc-be05-9ad0a9c4901b tempest-HostsAdminTestJSON-785849655 tempest-HostsAdminTestJSON-785849655-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:09.347627 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-81fe9c22-6eb6-4adc-be05-9ad0a9c4901b tempest-HostsAdminTestJSON-785849655 tempest-HostsAdminTestJSON-785849655-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:09.349081 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-81fe9c22-6eb6-4adc-be05-9ad0a9c4901b tempest-HostsAdminTestJSON-785849655 tempest-HostsAdminTestJSON-785849655-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:09.349537 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-81fe9c22-6eb6-4adc-be05-9ad0a9c4901b tempest-HostsAdminTestJSON-785849655 tempest-HostsAdminTestJSON-785849655-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:09.350166 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-81fe9c22-6eb6-4adc-be05-9ad0a9c4901b tempest-HostsAdminTestJSON-785849655 tempest-HostsAdminTestJSON-785849655-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:09.380580 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-81fe9c22-6eb6-4adc-be05-9ad0a9c4901b tempest-HostsAdminTestJSON-785849655 tempest-HostsAdminTestJSON-785849655-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.110910 Oct 04 21:49:09.381181 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 812/1581] 10.222.0.43 () {58 vars in 1128 bytes} [Tue Oct 4 21:49:09 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:49:09.397213 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-859ca611-88fd-4d34-9844-1788a6a035f5 tempest-HostsAdminTestJSON-785849655 tempest-HostsAdminTestJSON-785849655-project-admin] Calling method '.version_select at 0x7fbb340e34c0>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:49:09.400066 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-859ca611-88fd-4d34-9844-1788a6a035f5 tempest-HostsAdminTestJSON-785849655 tempest-HostsAdminTestJSON-785849655-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:09.400672 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-859ca611-88fd-4d34-9844-1788a6a035f5 tempest-HostsAdminTestJSON-785849655 tempest-HostsAdminTestJSON-785849655-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:09.401108 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-859ca611-88fd-4d34-9844-1788a6a035f5 tempest-HostsAdminTestJSON-785849655 tempest-HostsAdminTestJSON-785849655-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:09.402077 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-859ca611-88fd-4d34-9844-1788a6a035f5 tempest-HostsAdminTestJSON-785849655 tempest-HostsAdminTestJSON-785849655-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:09.402571 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-859ca611-88fd-4d34-9844-1788a6a035f5 tempest-HostsAdminTestJSON-785849655 tempest-HostsAdminTestJSON-785849655-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:09.403020 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-859ca611-88fd-4d34-9844-1788a6a035f5 tempest-HostsAdminTestJSON-785849655 tempest-HostsAdminTestJSON-785849655-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:09.431216 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-859ca611-88fd-4d34-9844-1788a6a035f5 tempest-HostsAdminTestJSON-785849655 tempest-HostsAdminTestJSON-785849655-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 376 microversion: 2.1 time: 0.042232 Oct 04 21:49:09.432558 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 813/1582] 10.222.0.43 () {58 vars in 1139 bytes} [Tue Oct 4 21:49:09 2022] GET /compute/v2.1/os-hosts?zone= => generated 376 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:49:09.446844 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-8923068d-062d-433d-80c0-adc26d1d26c3 tempest-HostsAdminTestJSON-785849655 tempest-HostsAdminTestJSON-785849655-project-admin] Calling method '.version_select at 0x7fbb2f523310>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:49:09.451582 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8923068d-062d-433d-80c0-adc26d1d26c3 tempest-HostsAdminTestJSON-785849655 tempest-HostsAdminTestJSON-785849655-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:09.452379 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8923068d-062d-433d-80c0-adc26d1d26c3 tempest-HostsAdminTestJSON-785849655 tempest-HostsAdminTestJSON-785849655-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:09.453291 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8923068d-062d-433d-80c0-adc26d1d26c3 tempest-HostsAdminTestJSON-785849655 tempest-HostsAdminTestJSON-785849655-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:09.454254 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8923068d-062d-433d-80c0-adc26d1d26c3 tempest-HostsAdminTestJSON-785849655 tempest-HostsAdminTestJSON-785849655-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:09.454981 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8923068d-062d-433d-80c0-adc26d1d26c3 tempest-HostsAdminTestJSON-785849655 tempest-HostsAdminTestJSON-785849655-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:09.455408 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8923068d-062d-433d-80c0-adc26d1d26c3 tempest-HostsAdminTestJSON-785849655 tempest-HostsAdminTestJSON-785849655-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:09.481211 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-8923068d-062d-433d-80c0-adc26d1d26c3 tempest-HostsAdminTestJSON-785849655 tempest-HostsAdminTestJSON-785849655-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.041007 Oct 04 21:49:09.482449 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 814/1583] 10.222.0.43 () {58 vars in 1145 bytes} [Tue Oct 4 21:49:09 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 21:49:09.498539 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-0fd2ff3e-6e9f-4343-bc38-e1053bed5801 tempest-HostsAdminTestJSON-785849655 tempest-HostsAdminTestJSON-785849655-project-admin] Calling method '.version_select at 0x7fbb2f01b670>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:49:09.502332 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0fd2ff3e-6e9f-4343-bc38-e1053bed5801 tempest-HostsAdminTestJSON-785849655 tempest-HostsAdminTestJSON-785849655-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:09.503043 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0fd2ff3e-6e9f-4343-bc38-e1053bed5801 tempest-HostsAdminTestJSON-785849655 tempest-HostsAdminTestJSON-785849655-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:09.503573 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0fd2ff3e-6e9f-4343-bc38-e1053bed5801 tempest-HostsAdminTestJSON-785849655 tempest-HostsAdminTestJSON-785849655-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:09.504982 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0fd2ff3e-6e9f-4343-bc38-e1053bed5801 tempest-HostsAdminTestJSON-785849655 tempest-HostsAdminTestJSON-785849655-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:09.505596 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0fd2ff3e-6e9f-4343-bc38-e1053bed5801 tempest-HostsAdminTestJSON-785849655 tempest-HostsAdminTestJSON-785849655-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:09.506023 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0fd2ff3e-6e9f-4343-bc38-e1053bed5801 tempest-HostsAdminTestJSON-785849655 tempest-HostsAdminTestJSON-785849655-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:09.536184 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-0fd2ff3e-6e9f-4343-bc38-e1053bed5801 tempest-HostsAdminTestJSON-785849655 tempest-HostsAdminTestJSON-785849655-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.043316 Oct 04 21:49:09.537334 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 815/1584] 10.222.0.43 () {58 vars in 1128 bytes} [Tue Oct 4 21:49:09 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:49:09.548649 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-c9385b63-fbad-49bd-aa69-eaa6a05f868d tempest-HostsAdminTestJSON-785849655 tempest-HostsAdminTestJSON-785849655-project-admin] Calling method '.version_select at 0x7fbb2fa94ee0>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:49:09.553800 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c9385b63-fbad-49bd-aa69-eaa6a05f868d tempest-HostsAdminTestJSON-785849655 tempest-HostsAdminTestJSON-785849655-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:09.554557 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c9385b63-fbad-49bd-aa69-eaa6a05f868d tempest-HostsAdminTestJSON-785849655 tempest-HostsAdminTestJSON-785849655-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:09.555183 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c9385b63-fbad-49bd-aa69-eaa6a05f868d tempest-HostsAdminTestJSON-785849655 tempest-HostsAdminTestJSON-785849655-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:09.555926 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c9385b63-fbad-49bd-aa69-eaa6a05f868d tempest-HostsAdminTestJSON-785849655 tempest-HostsAdminTestJSON-785849655-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:09.556813 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c9385b63-fbad-49bd-aa69-eaa6a05f868d tempest-HostsAdminTestJSON-785849655 tempest-HostsAdminTestJSON-785849655-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:09.557193 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c9385b63-fbad-49bd-aa69-eaa6a05f868d tempest-HostsAdminTestJSON-785849655 tempest-HostsAdminTestJSON-785849655-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:09.585567 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-c9385b63-fbad-49bd-aa69-eaa6a05f868d tempest-HostsAdminTestJSON-785849655 tempest-HostsAdminTestJSON-785849655-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 236 microversion: 2.1 time: 0.041579 Oct 04 21:49:09.586484 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 816/1585] 10.222.0.43 () {58 vars in 1155 bytes} [Tue Oct 4 21:49:09 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 236 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:49:09.598905 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-a8b0fdc0-aac4-438f-8f33-7eb317116b17 tempest-HostsAdminTestJSON-785849655 tempest-HostsAdminTestJSON-785849655-project-admin] Calling method '.version_select at 0x7fbb2f5d0f70>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:49:09.604505 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a8b0fdc0-aac4-438f-8f33-7eb317116b17 tempest-HostsAdminTestJSON-785849655 tempest-HostsAdminTestJSON-785849655-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:09.604992 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a8b0fdc0-aac4-438f-8f33-7eb317116b17 tempest-HostsAdminTestJSON-785849655 tempest-HostsAdminTestJSON-785849655-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:09.605483 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a8b0fdc0-aac4-438f-8f33-7eb317116b17 tempest-HostsAdminTestJSON-785849655 tempest-HostsAdminTestJSON-785849655-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:09.607766 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a8b0fdc0-aac4-438f-8f33-7eb317116b17 tempest-HostsAdminTestJSON-785849655 tempest-HostsAdminTestJSON-785849655-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:09.608500 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a8b0fdc0-aac4-438f-8f33-7eb317116b17 tempest-HostsAdminTestJSON-785849655 tempest-HostsAdminTestJSON-785849655-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:09.609194 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a8b0fdc0-aac4-438f-8f33-7eb317116b17 tempest-HostsAdminTestJSON-785849655 tempest-HostsAdminTestJSON-785849655-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:09.638073 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-a8b0fdc0-aac4-438f-8f33-7eb317116b17 tempest-HostsAdminTestJSON-785849655 tempest-HostsAdminTestJSON-785849655-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.043846 Oct 04 21:49:09.638734 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 817/1586] 10.222.0.43 () {58 vars in 1128 bytes} [Tue Oct 4 21:49:09 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:49:09.649372 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-33446209-8c63-49f8-80f7-4f306fe80d44 tempest-HostsAdminTestJSON-785849655 tempest-HostsAdminTestJSON-785849655-project-admin] Calling method '.version_select at 0x7fbb2fa94700>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:49:09.657592 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-33446209-8c63-49f8-80f7-4f306fe80d44 tempest-HostsAdminTestJSON-785849655 tempest-HostsAdminTestJSON-785849655-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:09.658114 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-33446209-8c63-49f8-80f7-4f306fe80d44 tempest-HostsAdminTestJSON-785849655 tempest-HostsAdminTestJSON-785849655-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:09.658782 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-33446209-8c63-49f8-80f7-4f306fe80d44 tempest-HostsAdminTestJSON-785849655 tempest-HostsAdminTestJSON-785849655-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:09.676494 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-33446209-8c63-49f8-80f7-4f306fe80d44 tempest-HostsAdminTestJSON-785849655 tempest-HostsAdminTestJSON-785849655-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:09.676990 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-33446209-8c63-49f8-80f7-4f306fe80d44 tempest-HostsAdminTestJSON-785849655 tempest-HostsAdminTestJSON-785849655-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:09.678171 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-33446209-8c63-49f8-80f7-4f306fe80d44 tempest-HostsAdminTestJSON-785849655 tempest-HostsAdminTestJSON-785849655-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:09.729706 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-33446209-8c63-49f8-80f7-4f306fe80d44 tempest-HostsAdminTestJSON-785849655 tempest-HostsAdminTestJSON-785849655-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hosts/n-h1-860284-1" status: 200 len: 729 microversion: 2.1 time: 0.084404 Oct 04 21:49:09.730480 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 818/1587] 10.222.0.43 () {58 vars in 1170 bytes} [Tue Oct 4 21:49:09 2022] GET /compute/v2.1/os-hosts/n-h1-860284-1 => generated 729 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:49:09.740196 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-d72339c8-74f5-4a08-9c2f-71ce48f74f1a tempest-HostsAdminTestJSON-785849655 tempest-HostsAdminTestJSON-785849655-project-admin] Calling method '.version_select at 0x7fbb2f1f6160>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:49:09.747616 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d72339c8-74f5-4a08-9c2f-71ce48f74f1a tempest-HostsAdminTestJSON-785849655 tempest-HostsAdminTestJSON-785849655-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:09.748487 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d72339c8-74f5-4a08-9c2f-71ce48f74f1a tempest-HostsAdminTestJSON-785849655 tempest-HostsAdminTestJSON-785849655-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:09.749080 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d72339c8-74f5-4a08-9c2f-71ce48f74f1a tempest-HostsAdminTestJSON-785849655 tempest-HostsAdminTestJSON-785849655-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:09.764730 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d72339c8-74f5-4a08-9c2f-71ce48f74f1a tempest-HostsAdminTestJSON-785849655 tempest-HostsAdminTestJSON-785849655-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:09.765375 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d72339c8-74f5-4a08-9c2f-71ce48f74f1a tempest-HostsAdminTestJSON-785849655 tempest-HostsAdminTestJSON-785849655-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:09.765921 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d72339c8-74f5-4a08-9c2f-71ce48f74f1a tempest-HostsAdminTestJSON-785849655 tempest-HostsAdminTestJSON-785849655-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:09.798355 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-d72339c8-74f5-4a08-9c2f-71ce48f74f1a tempest-HostsAdminTestJSON-785849655 tempest-HostsAdminTestJSON-785849655-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hosts/n-h2-860284-1" status: 200 len: 729 microversion: 2.1 time: 0.062020 Oct 04 21:49:09.806409 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 819/1588] 10.222.0.43 () {58 vars in 1170 bytes} [Tue Oct 4 21:49:09 2022] GET /compute/v2.1/os-hosts/n-h2-860284-1 => generated 729 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:49:09.811532 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-9b920a4d-ca18-4c25-a4f6-43a3c665d67a tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:49:09.812644 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-9b920a4d-ca18-4c25-a4f6-43a3c665d67a tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: be573c06-25e7-485e-9443-5bc21196a45e] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:49:09.819962 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9b920a4d-ca18-4c25-a4f6-43a3c665d67a tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:09.820716 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9b920a4d-ca18-4c25-a4f6-43a3c665d67a tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:09.821322 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9b920a4d-ca18-4c25-a4f6-43a3c665d67a tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:09.822208 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9b920a4d-ca18-4c25-a4f6-43a3c665d67a tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:09.822843 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9b920a4d-ca18-4c25-a4f6-43a3c665d67a tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:09.823423 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9b920a4d-ca18-4c25-a4f6-43a3c665d67a tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:10.539570 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-9b920a4d-ca18-4c25-a4f6-43a3c665d67a tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:49:10.552907 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-9b920a4d-ca18-4c25-a4f6-43a3c665d67a tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/be573c06-25e7-485e-9443-5bc21196a45e" status: 200 len: 1469 microversion: 2.1 time: 0.744714 Oct 04 21:49:10.556035 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 820/1589] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:49:09 2022] GET /compute/v2.1/servers/be573c06-25e7-485e-9443-5bc21196a45e => generated 1469 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:49:10.562645 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-a6040069-fcae-48de-8950-31c5ab5e9a73 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:49:10.563992 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-a6040069-fcae-48de-8950-31c5ab5e9a73 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] [instance: fdc82b91-5dfa-44cf-b8c5-402922265d88] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:49:10.572940 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a6040069-fcae-48de-8950-31c5ab5e9a73 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:10.573843 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a6040069-fcae-48de-8950-31c5ab5e9a73 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:10.574558 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a6040069-fcae-48de-8950-31c5ab5e9a73 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:10.575663 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a6040069-fcae-48de-8950-31c5ab5e9a73 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:10.576485 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a6040069-fcae-48de-8950-31c5ab5e9a73 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:10.577364 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a6040069-fcae-48de-8950-31c5ab5e9a73 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:10.999878 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-a6040069-fcae-48de-8950-31c5ab5e9a73 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d66a6a9c5c4c57ba0d25a37323f37f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758fcafb5db74075b183978a97b7c4ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:49:11.016430 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-a6040069-fcae-48de-8950-31c5ab5e9a73 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] 10.222.0.43 "GET /compute/v2.1/servers/fdc82b91-5dfa-44cf-b8c5-402922265d88" status: 200 len: 1323 microversion: 2.1 time: 0.456868 Oct 04 21:49:11.017312 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 821/1590] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:49:10 2022] GET /compute/v2.1/servers/fdc82b91-5dfa-44cf-b8c5-402922265d88 => generated 1323 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:49:11.330521 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-6d04c9e6-ce34-48e5-b9ef-0737f4465ff7 tempest-SecurityGroupRulesTestJSON-1224420723 tempest-SecurityGroupRulesTestJSON-1224420723-project] Action: 'create', calling method: .version_select at 0x7fbb2f719ca0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-405119210", "description": "tempest-description-66010647"}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:49:12.405785 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-6d04c9e6-ce34-48e5-b9ef-0737f4465ff7 tempest-SecurityGroupRulesTestJSON-1224420723 tempest-SecurityGroupRulesTestJSON-1224420723-project] 10.222.0.43 "POST /compute/v2.1/os-security-groups" status: 200 len: 245 microversion: 2.1 time: 1.333436 Oct 04 21:49:12.425237 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 822/1591] 10.222.0.43 () {60 vars in 1180 bytes} [Tue Oct 4 21:49:11 2022] POST /compute/v2.1/os-security-groups => generated 245 bytes in 1349 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:49:12.449273 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-df9cc9cc-94eb-4dcc-8b66-a94b5e2e897e tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:49:12.455995 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-df9cc9cc-94eb-4dcc-8b66-a94b5e2e897e tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: be573c06-25e7-485e-9443-5bc21196a45e] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:49:12.484153 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-df9cc9cc-94eb-4dcc-8b66-a94b5e2e897e tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:12.490565 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-df9cc9cc-94eb-4dcc-8b66-a94b5e2e897e tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:12.493111 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-df9cc9cc-94eb-4dcc-8b66-a94b5e2e897e tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:12.494813 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-df9cc9cc-94eb-4dcc-8b66-a94b5e2e897e tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:12.495944 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-df9cc9cc-94eb-4dcc-8b66-a94b5e2e897e tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:12.502091 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-df9cc9cc-94eb-4dcc-8b66-a94b5e2e897e tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:12.924203 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-df9cc9cc-94eb-4dcc-8b66-a94b5e2e897e tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:49:12.945729 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-df9cc9cc-94eb-4dcc-8b66-a94b5e2e897e tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/be573c06-25e7-485e-9443-5bc21196a45e" status: 200 len: 1469 microversion: 2.1 time: 0.517303 Oct 04 21:49:12.946275 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 823/1592] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:49:12 2022] GET /compute/v2.1/servers/be573c06-25e7-485e-9443-5bc21196a45e => generated 1469 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:49:12.962763 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-558d1b9a-5d2c-434f-81e6-715f71f64462 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:49:12.963400 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-558d1b9a-5d2c-434f-81e6-715f71f64462 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] [instance: fdc82b91-5dfa-44cf-b8c5-402922265d88] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:49:12.981344 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-558d1b9a-5d2c-434f-81e6-715f71f64462 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:12.981922 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-558d1b9a-5d2c-434f-81e6-715f71f64462 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:12.986766 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-558d1b9a-5d2c-434f-81e6-715f71f64462 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:12.987887 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-558d1b9a-5d2c-434f-81e6-715f71f64462 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:12.989038 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-558d1b9a-5d2c-434f-81e6-715f71f64462 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:12.989610 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-558d1b9a-5d2c-434f-81e6-715f71f64462 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:13.751949 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-558d1b9a-5d2c-434f-81e6-715f71f64462 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d66a6a9c5c4c57ba0d25a37323f37f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758fcafb5db74075b183978a97b7c4ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:49:13.771255 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-558d1b9a-5d2c-434f-81e6-715f71f64462 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] 10.222.0.43 "GET /compute/v2.1/servers/fdc82b91-5dfa-44cf-b8c5-402922265d88" status: 200 len: 1323 microversion: 2.1 time: 0.823678 Oct 04 21:49:13.772040 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 824/1593] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:49:12 2022] GET /compute/v2.1/servers/fdc82b91-5dfa-44cf-b8c5-402922265d88 => generated 1323 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:49:13.777164 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-bf2a78ab-a6de-4254-8fcb-5c6e46e47467 tempest-SecurityGroupRulesTestJSON-1224420723 tempest-SecurityGroupRulesTestJSON-1224420723-project] Action: 'create', calling method: .version_select at 0x7fbb2f754f70>, body: {"security_group_rule": {"parent_group_id": "d68e7c17-82de-412a-a6cf-9df5f805c157", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:49:14.269515 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-2f95034d-efac-41ad-9581-054f7f461694 tempest-FloatingIPsTestJSON-413331982 tempest-FloatingIPsTestJSON-413331982-project] 10.222.0.43 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 5.135655 Oct 04 21:49:14.270457 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 770/1594] 10.222.0.43 () {60 vars in 1170 bytes} [Tue Oct 4 21:49:09 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 5137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:49:14.282255 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-3fb88ea9-fbe7-41d3-a243-a8833d1437b8 req-c3088eb9-5101-4391-9940-0aad59bb58e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fdc82b91-5dfa-44cf-b8c5-402922265d88", "name": "network-vif-plugged", "status": "completed", "tag": "c36556e1-4c6d-4308-8210-aa45c17cd2d1"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:49:14.316328 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-3fb88ea9-fbe7-41d3-a243-a8833d1437b8 req-c3088eb9-5101-4391-9940-0aad59bb58e4 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:14.317109 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-3fb88ea9-fbe7-41d3-a243-a8833d1437b8 req-c3088eb9-5101-4391-9940-0aad59bb58e4 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:14.317574 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-3fb88ea9-fbe7-41d3-a243-a8833d1437b8 req-c3088eb9-5101-4391-9940-0aad59bb58e4 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:14.345141 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-3fb88ea9-fbe7-41d3-a243-a8833d1437b8 req-c3088eb9-5101-4391-9940-0aad59bb58e4 service nova] Creating event network-vif-plugged:c36556e1-4c6d-4308-8210-aa45c17cd2d1 for instance fdc82b91-5dfa-44cf-b8c5-402922265d88 on n-h2-860284-1 Oct 04 21:49:14.355181 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-3fb88ea9-fbe7-41d3-a243-a8833d1437b8 req-c3088eb9-5101-4391-9940-0aad59bb58e4 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082728 Oct 04 21:49:14.356149 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 771/1595] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:49:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:49:14.363048 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-89871201-f459-42f6-b71d-bdb6b7911b11 tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:49:14.365326 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-89871201-f459-42f6-b71d-bdb6b7911b11 tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] [instance: d4abcd04-329d-40a8-8d6e-4383bef437ae] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:49:14.373778 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-89871201-f459-42f6-b71d-bdb6b7911b11 tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:14.374743 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-89871201-f459-42f6-b71d-bdb6b7911b11 tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:14.375568 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-89871201-f459-42f6-b71d-bdb6b7911b11 tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:14.376783 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-89871201-f459-42f6-b71d-bdb6b7911b11 tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:14.377470 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-89871201-f459-42f6-b71d-bdb6b7911b11 tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:14.378141 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-89871201-f459-42f6-b71d-bdb6b7911b11 tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:14.592200 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-bf2a78ab-a6de-4254-8fcb-5c6e46e47467 tempest-SecurityGroupRulesTestJSON-1224420723 tempest-SecurityGroupRulesTestJSON-1224420723-project] 10.222.0.43 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.818947 Oct 04 21:49:14.593450 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 825/1596] 10.222.0.43 () {60 vars in 1195 bytes} [Tue Oct 4 21:49:13 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:49:14.600241 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-464fa435-8d5b-4406-bbfe-397cbb242d91 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:49:14.601934 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-464fa435-8d5b-4406-bbfe-397cbb242d91 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: be573c06-25e7-485e-9443-5bc21196a45e] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:49:14.628422 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-464fa435-8d5b-4406-bbfe-397cbb242d91 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:14.628924 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-464fa435-8d5b-4406-bbfe-397cbb242d91 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:14.629900 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-464fa435-8d5b-4406-bbfe-397cbb242d91 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:14.630736 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-464fa435-8d5b-4406-bbfe-397cbb242d91 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:14.639157 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-464fa435-8d5b-4406-bbfe-397cbb242d91 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:14.639877 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-464fa435-8d5b-4406-bbfe-397cbb242d91 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:14.943591 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.objects.instance [None req-89871201-f459-42f6-b71d-bdb6b7911b11 tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Lazy-loading 'services' on Instance uuid d4abcd04-329d-40a8-8d6e-4383bef437ae {{(pid=134101) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:49:14.981764 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-89871201-f459-42f6-b71d-bdb6b7911b11 tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/d4abcd04-329d-40a8-8d6e-4383bef437ae" status: 200 len: 2345 microversion: 2.25 time: 0.624162 Oct 04 21:49:14.983428 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 772/1597] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:49:14 2022] GET /compute/v2.1/servers/d4abcd04-329d-40a8-8d6e-4383bef437ae => generated 2345 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:49:14.990196 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-b7944c14-10fa-4668-8683-906c023d6dee tempest-FloatingIPsTestJSON-413331982 tempest-FloatingIPsTestJSON-413331982-project] Calling method '.version_select at 0x7fbb2f2323a0>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:49:15.134656 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-464fa435-8d5b-4406-bbfe-397cbb242d91 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:49:15.152067 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-464fa435-8d5b-4406-bbfe-397cbb242d91 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/be573c06-25e7-485e-9443-5bc21196a45e" status: 200 len: 1469 microversion: 2.1 time: 0.557138 Oct 04 21:49:15.153552 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 826/1598] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:49:14 2022] GET /compute/v2.1/servers/be573c06-25e7-485e-9443-5bc21196a45e => generated 1469 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:49:15.159876 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-02fc0644-5022-482b-b05e-8638139b42f4 tempest-SecurityGroupRulesTestJSON-1224420723 tempest-SecurityGroupRulesTestJSON-1224420723-project] Action: 'create', calling method: .version_select at 0x7fbb2f6fb5e0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-504587667", "description": "tempest-description-273548146"}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:49:15.737964 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-02fc0644-5022-482b-b05e-8638139b42f4 tempest-SecurityGroupRulesTestJSON-1224420723 tempest-SecurityGroupRulesTestJSON-1224420723-project] 10.222.0.43 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.582955 Oct 04 21:49:15.739873 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 827/1599] 10.222.0.43 () {60 vars in 1180 bytes} [Tue Oct 4 21:49:15 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:49:15.747494 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-e040300a-09d7-43e3-89fb-681a4b75379c tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:49:15.748503 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-e040300a-09d7-43e3-89fb-681a4b75379c tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] [instance: fdc82b91-5dfa-44cf-b8c5-402922265d88] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:49:15.783260 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e040300a-09d7-43e3-89fb-681a4b75379c tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:15.783771 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e040300a-09d7-43e3-89fb-681a4b75379c tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:15.784392 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e040300a-09d7-43e3-89fb-681a4b75379c tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:15.785111 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e040300a-09d7-43e3-89fb-681a4b75379c tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:15.786117 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e040300a-09d7-43e3-89fb-681a4b75379c tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:15.788139 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e040300a-09d7-43e3-89fb-681a4b75379c tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:16.119385 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-e040300a-09d7-43e3-89fb-681a4b75379c tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d66a6a9c5c4c57ba0d25a37323f37f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758fcafb5db74075b183978a97b7c4ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:49:16.137979 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-e040300a-09d7-43e3-89fb-681a4b75379c tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] 10.222.0.43 "GET /compute/v2.1/servers/fdc82b91-5dfa-44cf-b8c5-402922265d88" status: 200 len: 1323 microversion: 2.1 time: 0.396800 Oct 04 21:49:16.141036 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 828/1600] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:49:15 2022] GET /compute/v2.1/servers/fdc82b91-5dfa-44cf-b8c5-402922265d88 => generated 1323 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:49:16.146262 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-e5f9908f-456d-489d-9b67-275e027d0fb8 tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:49:16.154965 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e5f9908f-456d-489d-9b67-275e027d0fb8 tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:16.162655 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e5f9908f-456d-489d-9b67-275e027d0fb8 tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:16.164087 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e5f9908f-456d-489d-9b67-275e027d0fb8 tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:16.165652 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e5f9908f-456d-489d-9b67-275e027d0fb8 tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:16.166237 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e5f9908f-456d-489d-9b67-275e027d0fb8 tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:16.166810 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e5f9908f-456d-489d-9b67-275e027d0fb8 tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:16.197428 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-e5f9908f-456d-489d-9b67-275e027d0fb8 tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] 10.222.0.43 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.055160 Oct 04 21:49:16.198430 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 829/1601] 10.222.0.43 () {60 vars in 1217 bytes} [Tue Oct 4 21:49:16 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:49:16.203562 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-b9291fc9-c23c-422d-b715-502020d934fc req-382f69a0-ea46-4eaa-af04-ac4470f6f1ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be573c06-25e7-485e-9443-5bc21196a45e", "name": "network-vif-unplugged", "status": "completed", "tag": "ab7d2e00-d523-4e06-a029-fdb5f5ae6c75"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:49:16.216298 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-b9291fc9-c23c-422d-b715-502020d934fc req-382f69a0-ea46-4eaa-af04-ac4470f6f1ed service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:16.220083 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-b9291fc9-c23c-422d-b715-502020d934fc req-382f69a0-ea46-4eaa-af04-ac4470f6f1ed service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:16.220793 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-b9291fc9-c23c-422d-b715-502020d934fc req-382f69a0-ea46-4eaa-af04-ac4470f6f1ed service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:16.236913 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-b9291fc9-c23c-422d-b715-502020d934fc req-382f69a0-ea46-4eaa-af04-ac4470f6f1ed service nova] Creating event network-vif-unplugged:ab7d2e00-d523-4e06-a029-fdb5f5ae6c75 for instance be573c06-25e7-485e-9443-5bc21196a45e on n-h1-860284-1 Oct 04 21:49:16.244353 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [req-b9291fc9-c23c-422d-b715-502020d934fc req-382f69a0-ea46-4eaa-af04-ac4470f6f1ed service nova] Instance be573c06-25e7-485e-9443-5bc21196a45e is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860284-1', 'n-h1-860284-1'} {{(pid=134102) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 21:49:16.267096 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-b9291fc9-c23c-422d-b715-502020d934fc req-382f69a0-ea46-4eaa-af04-ac4470f6f1ed service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.066873 Oct 04 21:49:16.268467 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 830/1602] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:49:16 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:49:16.277706 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-7ab1f8de-8ae2-4eba-8ecf-feba0c95e473 tempest-SecurityGroupRulesTestJSON-1224420723 tempest-SecurityGroupRulesTestJSON-1224420723-project] Action: 'create', calling method: .version_select at 0x7fbb2f74d670>, body: {"security_group_rule": {"parent_group_id": "415ce3d9-b33b-4799-9fd0-e01451e9836d", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:49:16.687085 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-b7944c14-10fa-4668-8683-906c023d6dee tempest-FloatingIPsTestJSON-413331982 tempest-FloatingIPsTestJSON-413331982-project] 10.222.0.43 "DELETE /compute/v2.1/os-floating-ips/9303ec6b-39ba-4015-b127-982f4a41a5ca" status: 202 len: 0 microversion: 2.1 time: 1.702045 Oct 04 21:49:16.689213 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 773/1603] 10.222.0.43 () {58 vars in 1263 bytes} [Tue Oct 4 21:49:14 2022] DELETE /compute/v2.1/os-floating-ips/9303ec6b-39ba-4015-b127-982f4a41a5ca => generated 0 bytes in 1705 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:49:16.714609 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-3f68277f-c925-4fe6-a070-fd002de68156 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:49:16.716549 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-3f68277f-c925-4fe6-a070-fd002de68156 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: be573c06-25e7-485e-9443-5bc21196a45e] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:49:16.741869 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3f68277f-c925-4fe6-a070-fd002de68156 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:16.743183 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3f68277f-c925-4fe6-a070-fd002de68156 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:16.748454 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3f68277f-c925-4fe6-a070-fd002de68156 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:16.750534 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3f68277f-c925-4fe6-a070-fd002de68156 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:16.751448 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3f68277f-c925-4fe6-a070-fd002de68156 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:16.753665 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3f68277f-c925-4fe6-a070-fd002de68156 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:17.027630 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-7ab1f8de-8ae2-4eba-8ecf-feba0c95e473 tempest-SecurityGroupRulesTestJSON-1224420723 tempest-SecurityGroupRulesTestJSON-1224420723-project] 10.222.0.43 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 0.756869 Oct 04 21:49:17.029237 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 831/1604] 10.222.0.43 () {60 vars in 1195 bytes} [Tue Oct 4 21:49:16 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:49:17.037353 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-54e05416-8394-4433-bf17-4408eaaa7d15 tempest-FloatingIPsTestJSON-413331982 tempest-FloatingIPsTestJSON-413331982-project] Calling method '.version_select at 0x7fbb2f50e1f0>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:49:17.156862 n-d-860284-1 devstack@n-api.service[134102]: DEBUG neutronclient.v2_0.client [None req-54e05416-8394-4433-bf17-4408eaaa7d15 tempest-FloatingIPsTestJSON-413331982 tempest-FloatingIPsTestJSON-413331982-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 9303ec6b-39ba-4015-b127-982f4a41a5ca could not be found", "detail": ""}} {{(pid=134102) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 21:49:17.162536 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-54e05416-8394-4433-bf17-4408eaaa7d15 tempest-FloatingIPsTestJSON-413331982 tempest-FloatingIPsTestJSON-413331982-project] HTTP exception thrown: Floating IP not found for ID 9303ec6b-39ba-4015-b127-982f4a41a5ca Oct 04 21:49:17.168235 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-54e05416-8394-4433-bf17-4408eaaa7d15 tempest-FloatingIPsTestJSON-413331982 tempest-FloatingIPsTestJSON-413331982-project] Request method failure captured: Oct 04 21:49:17.168235 n-d-860284-1 devstack@n-api.service[134102]: request: GET /compute/v2.1/os-floating-ips/9303ec6b-39ba-4015-b127-982f4a41a5ca HTTP/1.1 Oct 04 21:49:17.168235 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 21:49:17.168235 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 21:49:17.168235 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 21:49:17.168235 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 21:49:17.168235 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 21:49:17.168235 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 21:49:17.168235 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 21:49:17.168235 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 21:49:17.168235 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPKpIE4vKd_LGb86RwNcD2QzD6LIhmpwUfyA5yiJNWLWdR4EFk0MuGR68283j4NNRBuD5LF6dc1JqD4eb5LW4WMm9i42cI5si5qJzkyHPuCaJIrDbYN6TO9aoso1YB3X6P59SeouT_Kq_RIqaI9hxusv_TltLo9JkHI55lcyxeOLFrSE Oct 04 21:49:17.168235 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 21:49:17.168235 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 21:49:17.168235 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 21:49:17.168235 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 21:49:17.168235 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 21:49:17.168235 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 21:49:17.168235 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: 06fe8c00c65a447fb43bde52385a2d2a Oct 04 21:49:17.168235 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-FloatingIPsTestJSON-413331982 Oct 04 21:49:17.168235 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 21:49:17.168235 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 21:49:17.168235 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/06fe8c00c65a447fb43bde52385a2d2a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_06fe8c00c65a447fb43bde52385a2d2a", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/06fe8c00c65a447fb43bde52385a2d2a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/06fe8c00c65a447fb43bde52385a2d2a"}]}] Oct 04 21:49:17.168235 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-FloatingIPsTestJSON-413331982 Oct 04 21:49:17.168235 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: 06fe8c00c65a447fb43bde52385a2d2a Oct 04 21:49:17.168235 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-FloatingIPsTestJSON-413331982 Oct 04 21:49:17.168235 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-FloatingIPsTestJSON-413331982-project Oct 04 21:49:17.168235 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 21:49:17.168235 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 21:49:17.168235 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: ca2f35985e784a37bae7b96d42a9c238 Oct 04 21:49:17.168235 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-FloatingIPsTestJSON-413331982-project Oct 04 21:49:17.168235 n-d-860284-1 devstack@n-api.service[134102]: method: Oct 04 21:49:17.168235 n-d-860284-1 devstack@n-api.service[134102]: exception: Floating IP not found for ID 9303ec6b-39ba-4015-b127-982f4a41a5ca Oct 04 21:49:17.168235 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': '9303ec6b-39ba-4015-b127-982f4a41a5ca'} Oct 04 21:49:17.168235 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:49:17.168235 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:49:17.168235 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 04 21:49:17.168235 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 04 21:49:17.168235 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:49:17.168235 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:49:17.168235 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 04 21:49:17.168235 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 04 21:49:17.168235 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:49:17.168235 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:49:17.168235 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 21:49:17.168235 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 21:49:17.168235 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:49:17.168235 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:49:17.168235 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 21:49:17.168235 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 21:49:17.168235 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:49:17.168235 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:49:17.168235 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 21:49:17.168235 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 21:49:17.168235 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:49:17.168235 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:49:17.168235 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 21:49:17.168235 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 21:49:17.168235 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 21:49:17.168235 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 21:49:17.168235 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 9303ec6b-39ba-4015-b127-982f4a41a5ca could not be found Oct 04 21:49:17.168235 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-227eece4-d785-42b8-a6a4-c0b5818417b2'] Oct 04 21:49:17.168235 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:49:17.173831 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:49:17.173831 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:49:17.173831 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:49:17.173831 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Oct 04 21:49:17.173831 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 04 21:49:17.173831 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 04 21:49:17.173831 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 04 21:49:17.173831 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 9303ec6b-39ba-4015-b127-982f4a41a5ca. Oct 04 21:49:17.173831 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:49:17.173831 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:49:17.173831 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:49:17.173831 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:49:17.173831 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:49:17.173831 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:49:17.173831 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:49:17.173831 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:49:17.173831 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:49:17.173831 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:49:17.173831 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:49:17.173831 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:49:17.173831 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Oct 04 21:49:17.173831 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 04 21:49:17.173831 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 9303ec6b-39ba-4015-b127-982f4a41a5ca Oct 04 21:49:17.173831 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:49:17.173831 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:49:17.173831 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:49:17.173831 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:49:17.173831 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:49:17.173831 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:49:17.173831 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:49:17.173831 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:49:17.173831 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 9303ec6b-39ba-4015-b127-982f4a41a5ca Oct 04 21:49:17.173831 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:49:17.182305 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-54e05416-8394-4433-bf17-4408eaaa7d15 tempest-FloatingIPsTestJSON-413331982 tempest-FloatingIPsTestJSON-413331982-project] Returning 404 to user: Floating IP not found for ID 9303ec6b-39ba-4015-b127-982f4a41a5ca {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:49:17.183609 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-54e05416-8394-4433-bf17-4408eaaa7d15 tempest-FloatingIPsTestJSON-413331982 tempest-FloatingIPsTestJSON-413331982-project] 10.222.0.43 "GET /compute/v2.1/os-floating-ips/9303ec6b-39ba-4015-b127-982f4a41a5ca" status: 404 len: 111 microversion: 2.1 time: 0.152538 Oct 04 21:49:17.184569 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 832/1605] 10.222.0.43 () {58 vars in 1260 bytes} [Tue Oct 4 21:49:17 2022] GET /compute/v2.1/os-floating-ips/9303ec6b-39ba-4015-b127-982f4a41a5ca => generated 111 bytes in 155 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:49:17.233666 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-3f68277f-c925-4fe6-a070-fd002de68156 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:49:17.255805 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-3f68277f-c925-4fe6-a070-fd002de68156 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/be573c06-25e7-485e-9443-5bc21196a45e" status: 200 len: 1469 microversion: 2.1 time: 0.562400 Oct 04 21:49:17.257225 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 774/1606] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:49:16 2022] GET /compute/v2.1/servers/be573c06-25e7-485e-9443-5bc21196a45e => generated 1469 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:49:17.264351 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-d48cc4cb-fffb-4083-97b4-c2586ca78cf6 tempest-SecurityGroupRulesTestJSON-1224420723 tempest-SecurityGroupRulesTestJSON-1224420723-project] Action: 'create', calling method: .version_select at 0x7fbb2f00b9d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-797384073", "description": "tempest-description-1528491939"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:49:17.565401 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-d48cc4cb-fffb-4083-97b4-c2586ca78cf6 tempest-SecurityGroupRulesTestJSON-1224420723 tempest-SecurityGroupRulesTestJSON-1224420723-project] 10.222.0.43 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.306265 Oct 04 21:49:17.566346 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 775/1607] 10.222.0.43 () {60 vars in 1180 bytes} [Tue Oct 4 21:49:17 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:49:17.587426 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-f9150739-b59d-4e0e-ad32-32a9ec258a79 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:49:17.588422 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-f9150739-b59d-4e0e-ad32-32a9ec258a79 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] [instance: fdc82b91-5dfa-44cf-b8c5-402922265d88] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:49:17.607718 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f9150739-b59d-4e0e-ad32-32a9ec258a79 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:17.608866 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f9150739-b59d-4e0e-ad32-32a9ec258a79 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:17.609544 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f9150739-b59d-4e0e-ad32-32a9ec258a79 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:17.610612 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f9150739-b59d-4e0e-ad32-32a9ec258a79 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:17.611301 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f9150739-b59d-4e0e-ad32-32a9ec258a79 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:17.613020 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f9150739-b59d-4e0e-ad32-32a9ec258a79 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:17.703180 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-b5aa8253-7bab-4e91-b367-8e300864ee0a tempest-NetworksTest-1369123777 tempest-NetworksTest-1369123777-project-admin] Calling method '.version_select at 0x7fbb2f76e700>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:49:18.156596 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-f9150739-b59d-4e0e-ad32-32a9ec258a79 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d66a6a9c5c4c57ba0d25a37323f37f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758fcafb5db74075b183978a97b7c4ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:49:18.169589 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-b5aa8253-7bab-4e91-b367-8e300864ee0a tempest-NetworksTest-1369123777 tempest-NetworksTest-1369123777-project-admin] 10.222.0.43 "GET /compute/v2.1/os-networks" status: 200 len: 6736 microversion: 2.1 time: 0.979456 Oct 04 21:49:18.170302 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 833/1608] 10.222.0.43 () {58 vars in 1137 bytes} [Tue Oct 4 21:49:17 2022] GET /compute/v2.1/os-networks => generated 6736 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:49:18.181916 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-d6825d60-ac2f-41e1-986b-7dd4d693ad71 tempest-FloatingIPsTestJSON-413331982 tempest-FloatingIPsTestJSON-413331982-project] Calling method '.version_select at 0x7fbb2f95bc10>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:49:18.182164 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-f9150739-b59d-4e0e-ad32-32a9ec258a79 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] 10.222.0.43 "GET /compute/v2.1/servers/fdc82b91-5dfa-44cf-b8c5-402922265d88" status: 200 len: 1520 microversion: 2.1 time: 0.613433 Oct 04 21:49:18.182830 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 776/1609] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:49:17 2022] GET /compute/v2.1/servers/fdc82b91-5dfa-44cf-b8c5-402922265d88 => generated 1520 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:49:18.188201 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-04c7095e-d047-4eb7-b403-9297507d555f tempest-SecurityGroupRulesTestJSON-1224420723 tempest-SecurityGroupRulesTestJSON-1224420723-project] Action: 'create', calling method: .version_select at 0x7fbb2eeb3550>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-457038817", "description": "tempest-description-2046978466"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:49:18.234776 n-d-860284-1 devstack@n-api.service[134102]: DEBUG neutronclient.v2_0.client [None req-d6825d60-ac2f-41e1-986b-7dd4d693ad71 tempest-FloatingIPsTestJSON-413331982 tempest-FloatingIPsTestJSON-413331982-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 9303ec6b-39ba-4015-b127-982f4a41a5ca could not be found", "detail": ""}} {{(pid=134102) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 21:49:18.235674 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-d6825d60-ac2f-41e1-986b-7dd4d693ad71 tempest-FloatingIPsTestJSON-413331982 tempest-FloatingIPsTestJSON-413331982-project] HTTP exception thrown: Floating IP not found for ID 9303ec6b-39ba-4015-b127-982f4a41a5ca Oct 04 21:49:18.237834 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-d6825d60-ac2f-41e1-986b-7dd4d693ad71 tempest-FloatingIPsTestJSON-413331982 tempest-FloatingIPsTestJSON-413331982-project] Request method failure captured: Oct 04 21:49:18.237834 n-d-860284-1 devstack@n-api.service[134102]: request: DELETE /compute/v2.1/os-floating-ips/9303ec6b-39ba-4015-b127-982f4a41a5ca HTTP/1.1 Oct 04 21:49:18.237834 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 21:49:18.237834 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 21:49:18.237834 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 21:49:18.237834 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 21:49:18.237834 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 21:49:18.237834 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 21:49:18.237834 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 21:49:18.237834 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 21:49:18.237834 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPKpIE4vKd_LGb86RwNcD2QzD6LIhmpwUfyA5yiJNWLWdR4EFk0MuGR68283j4NNRBuD5LF6dc1JqD4eb5LW4WMm9i42cI5si5qJzkyHPuCaJIrDbYN6TO9aoso1YB3X6P59SeouT_Kq_RIqaI9hxusv_TltLo9JkHI55lcyxeOLFrSE Oct 04 21:49:18.237834 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 21:49:18.237834 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 21:49:18.237834 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 21:49:18.237834 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 21:49:18.237834 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 21:49:18.237834 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 21:49:18.237834 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: 06fe8c00c65a447fb43bde52385a2d2a Oct 04 21:49:18.237834 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-FloatingIPsTestJSON-413331982 Oct 04 21:49:18.237834 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 21:49:18.237834 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 21:49:18.237834 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/06fe8c00c65a447fb43bde52385a2d2a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_06fe8c00c65a447fb43bde52385a2d2a", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/06fe8c00c65a447fb43bde52385a2d2a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/06fe8c00c65a447fb43bde52385a2d2a"}]}] Oct 04 21:49:18.237834 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-FloatingIPsTestJSON-413331982 Oct 04 21:49:18.237834 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: 06fe8c00c65a447fb43bde52385a2d2a Oct 04 21:49:18.237834 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-FloatingIPsTestJSON-413331982 Oct 04 21:49:18.237834 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-FloatingIPsTestJSON-413331982-project Oct 04 21:49:18.237834 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 21:49:18.237834 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 21:49:18.237834 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: ca2f35985e784a37bae7b96d42a9c238 Oct 04 21:49:18.237834 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-FloatingIPsTestJSON-413331982-project Oct 04 21:49:18.237834 n-d-860284-1 devstack@n-api.service[134102]: method: Oct 04 21:49:18.237834 n-d-860284-1 devstack@n-api.service[134102]: exception: Floating IP not found for ID 9303ec6b-39ba-4015-b127-982f4a41a5ca Oct 04 21:49:18.237834 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': '9303ec6b-39ba-4015-b127-982f4a41a5ca'} Oct 04 21:49:18.237834 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:49:18.237834 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:49:18.237834 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 04 21:49:18.237834 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 04 21:49:18.237834 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:49:18.237834 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:49:18.237834 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 04 21:49:18.237834 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 04 21:49:18.237834 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:49:18.237834 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:49:18.237834 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 21:49:18.237834 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 21:49:18.237834 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:49:18.237834 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:49:18.237834 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 21:49:18.237834 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 21:49:18.237834 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:49:18.237834 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:49:18.237834 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 21:49:18.237834 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 21:49:18.237834 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:49:18.237834 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:49:18.237834 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 21:49:18.237834 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 21:49:18.237834 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 21:49:18.237834 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 21:49:18.237834 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 9303ec6b-39ba-4015-b127-982f4a41a5ca could not be found Oct 04 21:49:18.237834 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5f73354a-2b16-4aaf-9d26-1e5ae9a99c4d'] Oct 04 21:49:18.237834 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:49:18.244424 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:49:18.244424 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:49:18.244424 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:49:18.244424 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Oct 04 21:49:18.244424 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 04 21:49:18.244424 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 04 21:49:18.244424 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 04 21:49:18.244424 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 9303ec6b-39ba-4015-b127-982f4a41a5ca. Oct 04 21:49:18.244424 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:49:18.244424 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:49:18.244424 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:49:18.244424 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:49:18.244424 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:49:18.244424 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:49:18.244424 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:49:18.244424 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:49:18.244424 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:49:18.244424 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:49:18.244424 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:49:18.244424 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:49:18.244424 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Oct 04 21:49:18.244424 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 04 21:49:18.244424 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 9303ec6b-39ba-4015-b127-982f4a41a5ca Oct 04 21:49:18.244424 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:49:18.244424 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:49:18.244424 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:49:18.244424 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:49:18.244424 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:49:18.244424 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:49:18.244424 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:49:18.244424 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:49:18.244424 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 9303ec6b-39ba-4015-b127-982f4a41a5ca Oct 04 21:49:18.244424 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:49:18.244424 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-d6825d60-ac2f-41e1-986b-7dd4d693ad71 tempest-FloatingIPsTestJSON-413331982 tempest-FloatingIPsTestJSON-413331982-project] Returning 404 to user: Floating IP not found for ID 9303ec6b-39ba-4015-b127-982f4a41a5ca {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:49:18.244424 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-d6825d60-ac2f-41e1-986b-7dd4d693ad71 tempest-FloatingIPsTestJSON-413331982 tempest-FloatingIPsTestJSON-413331982-project] 10.222.0.43 "DELETE /compute/v2.1/os-floating-ips/9303ec6b-39ba-4015-b127-982f4a41a5ca" status: 404 len: 111 microversion: 2.1 time: 0.068598 Oct 04 21:49:18.244424 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 834/1610] 10.222.0.43 () {58 vars in 1263 bytes} [Tue Oct 4 21:49:18 2022] DELETE /compute/v2.1/os-floating-ips/9303ec6b-39ba-4015-b127-982f4a41a5ca => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:49:18.249813 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-61567a6d-deaa-490d-a458-735e0ecee36a tempest-NetworksTest-1369123777 tempest-NetworksTest-1369123777-project-admin] Calling method '.version_select at 0x7fbb2f50e0d0>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:49:18.421203 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-61567a6d-deaa-490d-a458-735e0ecee36a tempest-NetworksTest-1369123777 tempest-NetworksTest-1369123777-project-admin] 10.222.0.43 "GET /compute/v2.1/os-networks/24746097-fcdf-4b45-9e46-271eb6b454d7" status: 200 len: 652 microversion: 2.1 time: 0.178721 Oct 04 21:49:18.422416 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 835/1611] 10.222.0.43 () {58 vars in 1248 bytes} [Tue Oct 4 21:49:18 2022] GET /compute/v2.1/os-networks/24746097-fcdf-4b45-9e46-271eb6b454d7 => generated 652 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:49:18.433375 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-9a5db02a-31d9-4bfc-ae3a-a42a2bbc14a5 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Action: 'create', calling method: .version_select at 0x7fbb2f6bd820>, body: {"pool": null} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:49:18.565393 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-04c7095e-d047-4eb7-b403-9297507d555f tempest-SecurityGroupRulesTestJSON-1224420723 tempest-SecurityGroupRulesTestJSON-1224420723-project] 10.222.0.43 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.381207 Oct 04 21:49:18.565984 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 777/1612] 10.222.0.43 () {60 vars in 1180 bytes} [Tue Oct 4 21:49:18 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:49:18.582801 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-b86820fc-6011-49df-a150-9f368b596bf3 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:49:18.585005 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-b86820fc-6011-49df-a150-9f368b596bf3 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: be573c06-25e7-485e-9443-5bc21196a45e] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:49:18.596294 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b86820fc-6011-49df-a150-9f368b596bf3 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:18.597752 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b86820fc-6011-49df-a150-9f368b596bf3 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:18.599405 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b86820fc-6011-49df-a150-9f368b596bf3 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:18.600708 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b86820fc-6011-49df-a150-9f368b596bf3 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:18.602434 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b86820fc-6011-49df-a150-9f368b596bf3 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:18.604880 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b86820fc-6011-49df-a150-9f368b596bf3 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:18.857188 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-b86820fc-6011-49df-a150-9f368b596bf3 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:49:18.866204 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-b86820fc-6011-49df-a150-9f368b596bf3 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/be573c06-25e7-485e-9443-5bc21196a45e" status: 200 len: 1469 microversion: 2.1 time: 0.299024 Oct 04 21:49:18.867219 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 778/1613] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:49:18 2022] GET /compute/v2.1/servers/be573c06-25e7-485e-9443-5bc21196a45e => generated 1469 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:49:18.888611 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-ed05d408-d14b-4a67-aecb-260575eaf119 req-923f9a58-eee7-4b77-ab1d-bf015bfa175f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be573c06-25e7-485e-9443-5bc21196a45e", "tag": "ab7d2e00-d523-4e06-a029-fdb5f5ae6c75"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:49:18.901574 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-ed05d408-d14b-4a67-aecb-260575eaf119 req-923f9a58-eee7-4b77-ab1d-bf015bfa175f service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:18.903100 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-ed05d408-d14b-4a67-aecb-260575eaf119 req-923f9a58-eee7-4b77-ab1d-bf015bfa175f service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:18.903769 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-ed05d408-d14b-4a67-aecb-260575eaf119 req-923f9a58-eee7-4b77-ab1d-bf015bfa175f service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:18.928762 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-ed05d408-d14b-4a67-aecb-260575eaf119 req-923f9a58-eee7-4b77-ab1d-bf015bfa175f service nova] Creating event network-changed:ab7d2e00-d523-4e06-a029-fdb5f5ae6c75 for instance be573c06-25e7-485e-9443-5bc21196a45e on n-h1-860284-1 Oct 04 21:49:18.937110 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [req-ed05d408-d14b-4a67-aecb-260575eaf119 req-923f9a58-eee7-4b77-ab1d-bf015bfa175f service nova] Instance be573c06-25e7-485e-9443-5bc21196a45e is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860284-1', 'n-h1-860284-1'} {{(pid=134101) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 21:49:18.950779 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-ed05d408-d14b-4a67-aecb-260575eaf119 req-923f9a58-eee7-4b77-ab1d-bf015bfa175f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066403 Oct 04 21:49:18.951916 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 779/1614] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:49:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:49:18.959502 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-06d53c95-692f-46ad-9203-a57667a60542 tempest-NetworksTest-1369123777 tempest-NetworksTest-1369123777-project-admin] Calling method '.version_select at 0x7fbb2eec6e50>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:49:19.577928 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-06d53c95-692f-46ad-9203-a57667a60542 tempest-NetworksTest-1369123777 tempest-NetworksTest-1369123777-project-admin] 10.222.0.43 "GET /compute/v2.1/os-networks" status: 200 len: 6736 microversion: 2.1 time: 0.624581 Oct 04 21:49:19.584070 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 780/1615] 10.222.0.43 () {58 vars in 1137 bytes} [Tue Oct 4 21:49:18 2022] GET /compute/v2.1/os-networks => generated 6736 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:49:19.585277 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-d1b1f7c6-2640-4699-bd75-7bd29e2a0eae tempest-SecurityGroupRulesTestJSON-1224420723 tempest-SecurityGroupRulesTestJSON-1224420723-project] Action: 'create', calling method: .version_select at 0x7fbb2ef46f70>, body: {"security_group_rule": {"parent_group_id": "c80cd1de-967a-47b0-ad28-8dac2e5dd558", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "3bdf7644-9916-41fd-adf1-668ee9808f93"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:49:20.412772 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-d1b1f7c6-2640-4699-bd75-7bd29e2a0eae tempest-SecurityGroupRulesTestJSON-1224420723 tempest-SecurityGroupRulesTestJSON-1224420723-project] 10.222.0.43 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 330 microversion: 2.1 time: 0.833045 Oct 04 21:49:20.413748 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 781/1616] 10.222.0.43 () {60 vars in 1195 bytes} [Tue Oct 4 21:49:19 2022] POST /compute/v2.1/os-security-group-rules => generated 330 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:49:20.434973 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-78857994-6eba-4920-bfe3-28489ff1be47 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e69ddac7-a8e9-41b4-9ecf-697d8d90efaa", "device": "/dev/xvdb"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:49:20.439877 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-78857994-6eba-4920-bfe3-28489ff1be47 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] [instance: d4abcd04-329d-40a8-8d6e-4383bef437ae] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:49:20.456789 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-78857994-6eba-4920-bfe3-28489ff1be47 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:20.458239 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-78857994-6eba-4920-bfe3-28489ff1be47 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:20.459091 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-78857994-6eba-4920-bfe3-28489ff1be47 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:20.460028 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-78857994-6eba-4920-bfe3-28489ff1be47 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:20.460787 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-78857994-6eba-4920-bfe3-28489ff1be47 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:20.461422 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-78857994-6eba-4920-bfe3-28489ff1be47 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:20.872807 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-78857994-6eba-4920-bfe3-28489ff1be47 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] 10.222.0.43 "POST /compute/v2.1/servers/d4abcd04-329d-40a8-8d6e-4383bef437ae/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 0.456587 Oct 04 21:49:20.875731 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 782/1617] 10.222.0.43 () {62 vars in 1364 bytes} [Tue Oct 4 21:49:20 2022] POST /compute/v2.1/servers/d4abcd04-329d-40a8-8d6e-4383bef437ae/os-volume_attachments => generated 194 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:49:20.894730 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-668ebe17-3072-4afc-858f-c71f033b086a tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:49:20.897149 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-668ebe17-3072-4afc-858f-c71f033b086a tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: be573c06-25e7-485e-9443-5bc21196a45e] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:49:20.909858 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-668ebe17-3072-4afc-858f-c71f033b086a tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:20.910588 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-668ebe17-3072-4afc-858f-c71f033b086a tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:20.911232 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-668ebe17-3072-4afc-858f-c71f033b086a tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:20.912934 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-668ebe17-3072-4afc-858f-c71f033b086a tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:20.913747 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-668ebe17-3072-4afc-858f-c71f033b086a tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:20.914445 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-668ebe17-3072-4afc-858f-c71f033b086a tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:21.050219 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-9a5db02a-31d9-4bfc-ae3a-a42a2bbc14a5 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] 10.222.0.43 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.621664 Oct 04 21:49:21.053971 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 836/1618] 10.222.0.43 () {60 vars in 1170 bytes} [Tue Oct 4 21:49:18 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2631 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:49:21.061541 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-47a5bd5a-a1be-49d3-a3c6-e211622605fd tempest-SecurityGroupRulesTestJSON-1224420723 tempest-SecurityGroupRulesTestJSON-1224420723-project] Action: 'create', calling method: .version_select at 0x7fbb2f74da60>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1225440909", "description": "tempest-description-2072485531"}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:49:21.202011 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-668ebe17-3072-4afc-858f-c71f033b086a tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:49:21.218737 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-668ebe17-3072-4afc-858f-c71f033b086a tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/be573c06-25e7-485e-9443-5bc21196a45e" status: 200 len: 1462 microversion: 2.1 time: 0.340365 Oct 04 21:49:21.219392 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 783/1619] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:49:20 2022] GET /compute/v2.1/servers/be573c06-25e7-485e-9443-5bc21196a45e => generated 1462 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:49:21.398983 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-47a5bd5a-a1be-49d3-a3c6-e211622605fd tempest-SecurityGroupRulesTestJSON-1224420723 tempest-SecurityGroupRulesTestJSON-1224420723-project] 10.222.0.43 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.343653 Oct 04 21:49:21.400895 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 837/1620] 10.222.0.43 () {60 vars in 1180 bytes} [Tue Oct 4 21:49:21 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:49:21.414639 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-126b7636-367a-44c8-a1d8-6df34f20385d tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1465091574", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452", "networks": [{"uuid": "e4c13216-4fea-4d87-aa16-a7572859740d"}]}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:49:21.563229 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.network.neutron [None req-126b7636-367a-44c8-a1d8-6df34f20385d tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] validate_networks() for [('e4c13216-4fea-4d87-aa16-a7572859740d', None, None, None, None, None)] {{(pid=134102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:49:21.639062 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-3db67c14-fc9f-4a7e-b4a9-befeff0e371f tempest-MigrationsAdminTest-1218821219 tempest-MigrationsAdminTest-1218821219-project-admin] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:49:21.639697 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-3db67c14-fc9f-4a7e-b4a9-befeff0e371f tempest-MigrationsAdminTest-1218821219 tempest-MigrationsAdminTest-1218821219-project-admin] [instance: be573c06-25e7-485e-9443-5bc21196a45e] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:49:21.649350 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3db67c14-fc9f-4a7e-b4a9-befeff0e371f tempest-MigrationsAdminTest-1218821219 tempest-MigrationsAdminTest-1218821219-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:21.653090 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3db67c14-fc9f-4a7e-b4a9-befeff0e371f tempest-MigrationsAdminTest-1218821219 tempest-MigrationsAdminTest-1218821219-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:21.654594 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3db67c14-fc9f-4a7e-b4a9-befeff0e371f tempest-MigrationsAdminTest-1218821219 tempest-MigrationsAdminTest-1218821219-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:21.656555 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3db67c14-fc9f-4a7e-b4a9-befeff0e371f tempest-MigrationsAdminTest-1218821219 tempest-MigrationsAdminTest-1218821219-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:21.660427 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3db67c14-fc9f-4a7e-b4a9-befeff0e371f tempest-MigrationsAdminTest-1218821219 tempest-MigrationsAdminTest-1218821219-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:21.661136 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3db67c14-fc9f-4a7e-b4a9-befeff0e371f tempest-MigrationsAdminTest-1218821219 tempest-MigrationsAdminTest-1218821219-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:21.963147 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-3db67c14-fc9f-4a7e-b4a9-befeff0e371f tempest-MigrationsAdminTest-1218821219 tempest-MigrationsAdminTest-1218821219-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/be573c06-25e7-485e-9443-5bc21196a45e" status: 200 len: 1613 microversion: 2.1 time: 0.717972 Oct 04 21:49:21.966663 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 784/1621] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:49:21 2022] GET /compute/v2.1/servers/be573c06-25e7-485e-9443-5bc21196a45e => generated 1613 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:49:21.989660 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-8c3ed0b5-f0bc-478c-82ee-70d74d246f35 tempest-SecurityGroupRulesTestJSON-1224420723 tempest-SecurityGroupRulesTestJSON-1224420723-project] Action: 'create', calling method: .version_select at 0x7fbb2f00b040>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1345983962", "description": "tempest-description-378268990"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:49:22.543684 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-126b7636-367a-44c8-a1d8-6df34f20385d tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Flavor limits 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:49:22.545365 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-126b7636-367a-44c8-a1d8-6df34f20385d tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Image limits 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:49:22.547039 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-126b7636-367a-44c8-a1d8-6df34f20385d tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Flavor pref 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:49:22.547746 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-126b7636-367a-44c8-a1d8-6df34f20385d tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Image pref 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:49:22.548441 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-126b7636-367a-44c8-a1d8-6df34f20385d tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:49:22.566701 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-126b7636-367a-44c8-a1d8-6df34f20385d tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:22.567734 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-126b7636-367a-44c8-a1d8-6df34f20385d tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:22.569719 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-126b7636-367a-44c8-a1d8-6df34f20385d tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:22.570954 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-126b7636-367a-44c8-a1d8-6df34f20385d tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:22.571545 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-126b7636-367a-44c8-a1d8-6df34f20385d tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:22.573041 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-126b7636-367a-44c8-a1d8-6df34f20385d tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:22.598973 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-126b7636-367a-44c8-a1d8-6df34f20385d tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Getting quotas for project 758fcafb5db74075b183978a97b7c4ee. Resources: {'instances', 'ram', 'cores'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:49:22.606519 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-126b7636-367a-44c8-a1d8-6df34f20385d tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Getting quotas for user 56d66a6a9c5c4c57ba0d25a37323f37f and project 758fcafb5db74075b183978a97b7c4ee. Resources: {'instances', 'ram', 'cores'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:49:22.629770 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-126b7636-367a-44c8-a1d8-6df34f20385d tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Going to run 1 instances... {{(pid=134102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:49:22.633696 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-126b7636-367a-44c8-a1d8-6df34f20385d tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] [instance: 69b35751-ffe5-4447-8c07-8db18ae96e9d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='58548514-5dac-426c-81f5-19e3fba33e23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:49:22.637908 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-8c3ed0b5-f0bc-478c-82ee-70d74d246f35 tempest-SecurityGroupRulesTestJSON-1224420723 tempest-SecurityGroupRulesTestJSON-1224420723-project] 10.222.0.43 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.669439 Oct 04 21:49:22.639267 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 785/1622] 10.222.0.43 () {60 vars in 1180 bytes} [Tue Oct 4 21:49:21 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:49:22.652455 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-a8c193d4-fc4c-49c5-bd78-dab13d3e4be3 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:49:22.653546 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-a8c193d4-fc4c-49c5-bd78-dab13d3e4be3 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: be573c06-25e7-485e-9443-5bc21196a45e] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:49:22.667279 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a8c193d4-fc4c-49c5-bd78-dab13d3e4be3 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:22.669246 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a8c193d4-fc4c-49c5-bd78-dab13d3e4be3 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:22.670699 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a8c193d4-fc4c-49c5-bd78-dab13d3e4be3 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:22.673445 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a8c193d4-fc4c-49c5-bd78-dab13d3e4be3 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:22.674199 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a8c193d4-fc4c-49c5-bd78-dab13d3e4be3 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:22.678563 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a8c193d4-fc4c-49c5-bd78-dab13d3e4be3 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:22.702776 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-126b7636-367a-44c8-a1d8-6df34f20385d tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.299117 Oct 04 21:49:22.710233 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 838/1623] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 21:49:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 1301 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:49:22.710233 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-255f6216-5f8d-4671-affc-96c59e6283f8 tempest-SecurityGroupRulesTestJSON-1224420723 tempest-SecurityGroupRulesTestJSON-1224420723-project] Action: 'create', calling method: .version_select at 0x7fbb2f570310>, body: {"security_group_rule": {"parent_group_id": "5342ec7b-7761-4f9b-89e0-01e35d850b67", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "8051a5f8-a1f5-451a-a1fc-a9a6e889ce96"}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:49:22.778719 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-a8c193d4-fc4c-49c5-bd78-dab13d3e4be3 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: be573c06-25e7-485e-9443-5bc21196a45e] Going to try to terminate instance {{(pid=134101) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:49:22.919562 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-a8c193d4-fc4c-49c5-bd78-dab13d3e4be3 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "DELETE /compute/v2.1/servers/be573c06-25e7-485e-9443-5bc21196a45e" status: 204 len: 0 microversion: 2.1 time: 0.278030 Oct 04 21:49:22.922054 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 786/1624] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 21:49:22 2022] DELETE /compute/v2.1/servers/be573c06-25e7-485e-9443-5bc21196a45e => generated 0 bytes in 282 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:49:22.944367 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-bce24d2c-0d06-4119-bf4c-a5564d085d80 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:49:22.945831 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-bce24d2c-0d06-4119-bf4c-a5564d085d80 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] [instance: 69b35751-ffe5-4447-8c07-8db18ae96e9d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:49:22.960297 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=83,nova_api:SAVEPOINT=5,nova_api:RELEASE=5,nova_api:UPDATE=2,nova_api:DELETE=5 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:49:23.060321 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-bce24d2c-0d06-4119-bf4c-a5564d085d80 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d66a6a9c5c4c57ba0d25a37323f37f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758fcafb5db74075b183978a97b7c4ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:49:23.068780 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-bce24d2c-0d06-4119-bf4c-a5564d085d80 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] 10.222.0.43 "GET /compute/v2.1/servers/69b35751-ffe5-4447-8c07-8db18ae96e9d" status: 200 len: 1224 microversion: 2.1 time: 0.140303 Oct 04 21:49:23.069803 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 787/1625] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:49:22 2022] GET /compute/v2.1/servers/69b35751-ffe5-4447-8c07-8db18ae96e9d => generated 1224 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:49:23.100894 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-56078f9d-dcd8-403e-bb6b-f533f3b252bf tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:49:23.101641 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-56078f9d-dcd8-403e-bb6b-f533f3b252bf tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: be573c06-25e7-485e-9443-5bc21196a45e] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:49:23.120068 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-56078f9d-dcd8-403e-bb6b-f533f3b252bf tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:23.120585 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-56078f9d-dcd8-403e-bb6b-f533f3b252bf tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:23.123380 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-56078f9d-dcd8-403e-bb6b-f533f3b252bf tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:23.127095 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-56078f9d-dcd8-403e-bb6b-f533f3b252bf tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:23.128157 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-56078f9d-dcd8-403e-bb6b-f533f3b252bf tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:23.129987 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-56078f9d-dcd8-403e-bb6b-f533f3b252bf tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:23.217007 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-255f6216-5f8d-4671-affc-96c59e6283f8 tempest-SecurityGroupRulesTestJSON-1224420723 tempest-SecurityGroupRulesTestJSON-1224420723-project] 10.222.0.43 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 0.511883 Oct 04 21:49:23.218137 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 839/1626] 10.222.0.43 () {60 vars in 1195 bytes} [Tue Oct 4 21:49:22 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:49:23.232219 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-421a69dd-b1dd-4dcc-85de-89ec9df74841 tempest-SecurityGroupRulesTestJSON-1224420723 tempest-SecurityGroupRulesTestJSON-1224420723-project] Calling method '.version_select at 0x7fbb2f6bd700>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:49:23.555286 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-56078f9d-dcd8-403e-bb6b-f533f3b252bf tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:49:23.557557 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:49:23.566751 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-56078f9d-dcd8-403e-bb6b-f533f3b252bf tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/be573c06-25e7-485e-9443-5bc21196a45e" status: 200 len: 1468 microversion: 2.1 time: 0.480239 Oct 04 21:49:23.572424 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 788/1627] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:49:23 2022] GET /compute/v2.1/servers/be573c06-25e7-485e-9443-5bc21196a45e => generated 1468 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:49:23.695905 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-421a69dd-b1dd-4dcc-85de-89ec9df74841 tempest-SecurityGroupRulesTestJSON-1224420723 tempest-SecurityGroupRulesTestJSON-1224420723-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/8051a5f8-a1f5-451a-a1fc-a9a6e889ce96" status: 202 len: 0 microversion: 2.1 time: 0.468145 Oct 04 21:49:23.705335 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 840/1628] 10.222.0.43 () {58 vars in 1272 bytes} [Tue Oct 4 21:49:23 2022] DELETE /compute/v2.1/os-security-groups/8051a5f8-a1f5-451a-a1fc-a9a6e889ce96 => generated 0 bytes in 473 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:49:23.706063 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-dc828edb-63b8-42b4-8346-2a54d286f22f tempest-SecurityGroupRulesTestJSON-1224420723 tempest-SecurityGroupRulesTestJSON-1224420723-project] Calling method '.version_select at 0x7fbb2f232ee0>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:49:23.813860 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-dc828edb-63b8-42b4-8346-2a54d286f22f tempest-SecurityGroupRulesTestJSON-1224420723 tempest-SecurityGroupRulesTestJSON-1224420723-project] 10.222.0.43 "GET /compute/v2.1/os-security-groups/5342ec7b-7761-4f9b-89e0-01e35d850b67" status: 200 len: 248 microversion: 2.1 time: 0.112055 Oct 04 21:49:23.814800 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 789/1629] 10.222.0.43 () {58 vars in 1269 bytes} [Tue Oct 4 21:49:23 2022] GET /compute/v2.1/os-security-groups/5342ec7b-7761-4f9b-89e0-01e35d850b67 => generated 248 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:49:23.835861 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-ee297561-7170-4be0-93ab-93461d40047b tempest-SecurityGroupRulesTestJSON-1224420723 tempest-SecurityGroupRulesTestJSON-1224420723-project] Action: 'create', calling method: .version_select at 0x7fbb2f6bdf70>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-932922933", "description": "tempest-description-1706639124"}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:49:24.026106 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-ee297561-7170-4be0-93ab-93461d40047b tempest-SecurityGroupRulesTestJSON-1224420723 tempest-SecurityGroupRulesTestJSON-1224420723-project] 10.222.0.43 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.194423 Oct 04 21:49:24.027025 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 841/1630] 10.222.0.43 () {60 vars in 1180 bytes} [Tue Oct 4 21:49:23 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:49:24.073501 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-ce1e51be-752b-411b-a09e-ee0a6fb9111c tempest-SecurityGroupRulesTestJSON-1224420723 tempest-SecurityGroupRulesTestJSON-1224420723-project] Action: 'create', calling method: .version_select at 0x7fbb2f1fa1f0>, body: {"security_group_rule": {"parent_group_id": "ec5874ad-7292-4f12-8440-1d19e1fd4601", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:49:24.100298 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-c751f790-7c30-4953-a13c-3eeab34a8e9e tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:49:24.101448 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-c751f790-7c30-4953-a13c-3eeab34a8e9e tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] [instance: 69b35751-ffe5-4447-8c07-8db18ae96e9d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:49:24.115715 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c751f790-7c30-4953-a13c-3eeab34a8e9e tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:24.116527 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c751f790-7c30-4953-a13c-3eeab34a8e9e tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:24.117409 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c751f790-7c30-4953-a13c-3eeab34a8e9e tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:24.118314 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c751f790-7c30-4953-a13c-3eeab34a8e9e tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:24.119560 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c751f790-7c30-4953-a13c-3eeab34a8e9e tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:24.120198 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c751f790-7c30-4953-a13c-3eeab34a8e9e tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:24.358504 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-c751f790-7c30-4953-a13c-3eeab34a8e9e tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d66a6a9c5c4c57ba0d25a37323f37f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758fcafb5db74075b183978a97b7c4ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:49:24.375386 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-c751f790-7c30-4953-a13c-3eeab34a8e9e tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] 10.222.0.43 "GET /compute/v2.1/servers/69b35751-ffe5-4447-8c07-8db18ae96e9d" status: 200 len: 1276 microversion: 2.1 time: 0.280754 Oct 04 21:49:24.377581 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 842/1631] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:49:24 2022] GET /compute/v2.1/servers/69b35751-ffe5-4447-8c07-8db18ae96e9d => generated 1276 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:49:24.589936 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-438f770a-ba59-421a-9d3f-431e46a6c0cc tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:49:24.590505 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-438f770a-ba59-421a-9d3f-431e46a6c0cc tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: be573c06-25e7-485e-9443-5bc21196a45e] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:49:24.597248 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-438f770a-ba59-421a-9d3f-431e46a6c0cc tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:24.597784 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-438f770a-ba59-421a-9d3f-431e46a6c0cc tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:24.598246 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-438f770a-ba59-421a-9d3f-431e46a6c0cc tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:24.598993 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-438f770a-ba59-421a-9d3f-431e46a6c0cc tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:24.599610 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-438f770a-ba59-421a-9d3f-431e46a6c0cc tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:24.600047 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-438f770a-ba59-421a-9d3f-431e46a6c0cc tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:24.609257 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-ce1e51be-752b-411b-a09e-ee0a6fb9111c tempest-SecurityGroupRulesTestJSON-1224420723 tempest-SecurityGroupRulesTestJSON-1224420723-project] 10.222.0.43 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.571056 Oct 04 21:49:24.618355 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 790/1632] 10.222.0.43 () {60 vars in 1195 bytes} [Tue Oct 4 21:49:24 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:49:24.623731 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-5b493edc-c067-4a9f-b138-0e8b5889c329 tempest-SecurityGroupRulesTestJSON-1224420723 tempest-SecurityGroupRulesTestJSON-1224420723-project] Action: 'create', calling method: .version_select at 0x7fbb2f399550>, body: {"security_group_rule": {"parent_group_id": "ec5874ad-7292-4f12-8440-1d19e1fd4601", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:49:25.138687 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-438f770a-ba59-421a-9d3f-431e46a6c0cc tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:49:25.154311 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-438f770a-ba59-421a-9d3f-431e46a6c0cc tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/be573c06-25e7-485e-9443-5bc21196a45e" status: 200 len: 1468 microversion: 2.1 time: 0.568606 Oct 04 21:49:25.155536 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 843/1633] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:49:24 2022] GET /compute/v2.1/servers/be573c06-25e7-485e-9443-5bc21196a45e => generated 1468 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:49:25.404088 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-f908d752-444f-47f4-8c97-a9b2f24e34fc tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:49:25.406494 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-f908d752-444f-47f4-8c97-a9b2f24e34fc tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] [instance: 69b35751-ffe5-4447-8c07-8db18ae96e9d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:49:25.424333 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f908d752-444f-47f4-8c97-a9b2f24e34fc tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:25.431109 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f908d752-444f-47f4-8c97-a9b2f24e34fc tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:25.432275 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f908d752-444f-47f4-8c97-a9b2f24e34fc tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:25.438084 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f908d752-444f-47f4-8c97-a9b2f24e34fc tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:25.438822 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f908d752-444f-47f4-8c97-a9b2f24e34fc tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:25.439514 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f908d752-444f-47f4-8c97-a9b2f24e34fc tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:25.792613 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-f908d752-444f-47f4-8c97-a9b2f24e34fc tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d66a6a9c5c4c57ba0d25a37323f37f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758fcafb5db74075b183978a97b7c4ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:49:25.800600 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-f908d752-444f-47f4-8c97-a9b2f24e34fc tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] 10.222.0.43 "GET /compute/v2.1/servers/69b35751-ffe5-4447-8c07-8db18ae96e9d" status: 200 len: 1282 microversion: 2.1 time: 0.401216 Oct 04 21:49:25.810401 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 844/1634] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:49:25 2022] GET /compute/v2.1/servers/69b35751-ffe5-4447-8c07-8db18ae96e9d => generated 1282 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:49:25.947674 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-d301eac7-dbff-465f-8aa8-fe906ec3616e req-29eca20d-5a8c-412a-b613-a0245270c5c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be573c06-25e7-485e-9443-5bc21196a45e", "name": "network-vif-deleted", "tag": "ab7d2e00-d523-4e06-a029-fdb5f5ae6c75"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:49:25.969243 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-d301eac7-dbff-465f-8aa8-fe906ec3616e req-29eca20d-5a8c-412a-b613-a0245270c5c2 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:25.970179 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-d301eac7-dbff-465f-8aa8-fe906ec3616e req-29eca20d-5a8c-412a-b613-a0245270c5c2 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:25.970816 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-d301eac7-dbff-465f-8aa8-fe906ec3616e req-29eca20d-5a8c-412a-b613-a0245270c5c2 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:26.001939 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-d301eac7-dbff-465f-8aa8-fe906ec3616e req-29eca20d-5a8c-412a-b613-a0245270c5c2 service nova] Creating event network-vif-deleted:ab7d2e00-d523-4e06-a029-fdb5f5ae6c75 for instance be573c06-25e7-485e-9443-5bc21196a45e on n-h1-860284-1 Oct 04 21:49:26.011970 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-d301eac7-dbff-465f-8aa8-fe906ec3616e req-29eca20d-5a8c-412a-b613-a0245270c5c2 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073563 Oct 04 21:49:26.014526 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 845/1635] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:49:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:49:26.029997 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-1e70ca22-2c5a-4dec-86c1-2466c6f582b8 tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:49:26.031050 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-1e70ca22-2c5a-4dec-86c1-2466c6f582b8 tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] [instance: 3f0a02bc-7993-4849-8b3c-7572327b4799] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:49:26.049427 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1e70ca22-2c5a-4dec-86c1-2466c6f582b8 tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:26.051396 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1e70ca22-2c5a-4dec-86c1-2466c6f582b8 tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:26.052743 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1e70ca22-2c5a-4dec-86c1-2466c6f582b8 tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:26.055917 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1e70ca22-2c5a-4dec-86c1-2466c6f582b8 tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:26.056801 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1e70ca22-2c5a-4dec-86c1-2466c6f582b8 tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:26.059462 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1e70ca22-2c5a-4dec-86c1-2466c6f582b8 tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:26.353685 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-5b493edc-c067-4a9f-b138-0e8b5889c329 tempest-SecurityGroupRulesTestJSON-1224420723 tempest-SecurityGroupRulesTestJSON-1224420723-project] 10.222.0.43 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 1.733896 Oct 04 21:49:26.355362 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 791/1636] 10.222.0.43 () {60 vars in 1195 bytes} [Tue Oct 4 21:49:24 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 1736 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:49:26.363906 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e5085925-9da3-4668-b9b8-ae7efa4b7fd6 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:49:26.365670 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-e5085925-9da3-4668-b9b8-ae7efa4b7fd6 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: be573c06-25e7-485e-9443-5bc21196a45e] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:49:26.377590 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e5085925-9da3-4668-b9b8-ae7efa4b7fd6 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:26.378632 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e5085925-9da3-4668-b9b8-ae7efa4b7fd6 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:26.383788 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e5085925-9da3-4668-b9b8-ae7efa4b7fd6 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:26.385108 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e5085925-9da3-4668-b9b8-ae7efa4b7fd6 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:26.385921 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e5085925-9da3-4668-b9b8-ae7efa4b7fd6 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:26.394049 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e5085925-9da3-4668-b9b8-ae7efa4b7fd6 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:26.452560 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-e5085925-9da3-4668-b9b8-ae7efa4b7fd6 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] HTTP exception thrown: Instance be573c06-25e7-485e-9443-5bc21196a45e could not be found. Oct 04 21:49:26.455717 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e5085925-9da3-4668-b9b8-ae7efa4b7fd6 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Request method failure captured: Oct 04 21:49:26.455717 n-d-860284-1 devstack@n-api.service[134101]: request: GET /compute/v2.1/servers/be573c06-25e7-485e-9443-5bc21196a45e HTTP/1.1 Oct 04 21:49:26.455717 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 21:49:26.455717 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 21:49:26.455717 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 21:49:26.455717 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 21:49:26.455717 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 21:49:26.455717 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 21:49:26.455717 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 21:49:26.455717 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 21:49:26.455717 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPKkSWMYDuUKVegFXtR5Dq665FCEvHr6gUPE2yil6i-rj34rHI9TeiStwErZ2Z3W0XoMQuC69vn2-UANat7ubXSf1uXDj3o94Fpzj4pdWUuZ8ToGaTjk7-rR7tmlESVrnkipl33ILcpgcRu4jH8fV30u3RdMcBMY2Ca0qLAfp0gKOTz8 Oct 04 21:49:26.455717 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 21:49:26.455717 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 21:49:26.455717 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 21:49:26.455717 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 21:49:26.455717 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 21:49:26.455717 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 21:49:26.455717 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: 1ad1554e318e45f78a2bc5e148d0c39f Oct 04 21:49:26.455717 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-MigrationsAdminTest-285422622 Oct 04 21:49:26.455717 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 21:49:26.455717 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 21:49:26.455717 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1ad1554e318e45f78a2bc5e148d0c39f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_1ad1554e318e45f78a2bc5e148d0c39f", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1ad1554e318e45f78a2bc5e148d0c39f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/1ad1554e318e45f78a2bc5e148d0c39f"}]}] Oct 04 21:49:26.455717 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-MigrationsAdminTest-285422622 Oct 04 21:49:26.455717 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: 1ad1554e318e45f78a2bc5e148d0c39f Oct 04 21:49:26.455717 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-MigrationsAdminTest-285422622 Oct 04 21:49:26.455717 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-MigrationsAdminTest-285422622-project Oct 04 21:49:26.455717 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 21:49:26.455717 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 21:49:26.455717 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: ff4e089659884b6d9197141ba9f14f57 Oct 04 21:49:26.455717 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-MigrationsAdminTest-285422622-project Oct 04 21:49:26.455717 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 21:49:26.455717 n-d-860284-1 devstack@n-api.service[134101]: exception: Instance be573c06-25e7-485e-9443-5bc21196a45e could not be found. Oct 04 21:49:26.455717 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': 'be573c06-25e7-485e-9443-5bc21196a45e'} Oct 04 21:49:26.455717 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:49:26.455717 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:49:26.455717 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:49:26.455717 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:49:26.455717 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:49:26.455717 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:49:26.455717 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:49:26.455717 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:49:26.455717 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:49:26.455717 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:49:26.455717 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be573c06-25e7-485e-9443-5bc21196a45e could not be found. Oct 04 21:49:26.455717 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:49:26.455717 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:49:26.455717 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:49:26.455717 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:49:26.455717 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:49:26.455717 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:49:26.455717 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:49:26.455717 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:49:26.455717 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:49:26.455717 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:49:26.455717 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:49:26.455717 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:49:26.455717 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:49:26.455717 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:49:26.455717 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:49:26.455717 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:49:26.455717 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be573c06-25e7-485e-9443-5bc21196a45e could not be found. Oct 04 21:49:26.455717 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:49:26.455717 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:49:26.455717 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:49:26.463133 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:49:26.463133 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:49:26.463133 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:49:26.463133 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:49:26.463133 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:49:26.463133 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be573c06-25e7-485e-9443-5bc21196a45e could not be found. Oct 04 21:49:26.463133 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:49:26.467615 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e5085925-9da3-4668-b9b8-ae7efa4b7fd6 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Returning 404 to user: Instance be573c06-25e7-485e-9443-5bc21196a45e could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:49:26.469079 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-e5085925-9da3-4668-b9b8-ae7efa4b7fd6 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/be573c06-25e7-485e-9443-5bc21196a45e" status: 404 len: 111 microversion: 2.1 time: 0.112400 Oct 04 21:49:26.470194 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 792/1637] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:49:26 2022] GET /compute/v2.1/servers/be573c06-25e7-485e-9443-5bc21196a45e => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:49:26.478277 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-2281c375-869f-4526-bd64-a7dc21b73fc7 tempest-SecurityGroupRulesTestJSON-1224420723 tempest-SecurityGroupRulesTestJSON-1224420723-project] Calling method '.version_select at 0x7fbb2f1f14c0>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:49:27.092679 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-2281c375-869f-4526-bd64-a7dc21b73fc7 tempest-SecurityGroupRulesTestJSON-1224420723 tempest-SecurityGroupRulesTestJSON-1224420723-project] 10.222.0.43 "GET /compute/v2.1/os-security-groups/ec5874ad-7292-4f12-8440-1d19e1fd4601" status: 200 len: 664 microversion: 2.1 time: 0.620950 Oct 04 21:49:27.094290 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 793/1638] 10.222.0.43 () {58 vars in 1269 bytes} [Tue Oct 4 21:49:26 2022] GET /compute/v2.1/os-security-groups/ec5874ad-7292-4f12-8440-1d19e1fd4601 => generated 664 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:49:27.100237 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-c0b52d86-f0bc-4bd1-aec9-80d7dd5e67da tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:49:27.101086 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-c0b52d86-f0bc-4bd1-aec9-80d7dd5e67da tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: 424a22f0-ccc3-4fec-bf38-4aaf924928e3] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:49:27.122024 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-1e70ca22-2c5a-4dec-86c1-2466c6f582b8 tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/3f0a02bc-7993-4849-8b3c-7572327b4799" status: 200 len: 1811 microversion: 2.1 time: 1.105798 Oct 04 21:49:27.132322 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c0b52d86-f0bc-4bd1-aec9-80d7dd5e67da tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:27.133197 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c0b52d86-f0bc-4bd1-aec9-80d7dd5e67da tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:27.136260 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 846/1639] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:49:26 2022] GET /compute/v2.1/servers/3f0a02bc-7993-4849-8b3c-7572327b4799 => generated 1811 bytes in 1121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:49:27.137044 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c0b52d86-f0bc-4bd1-aec9-80d7dd5e67da tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:27.139181 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c0b52d86-f0bc-4bd1-aec9-80d7dd5e67da tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:27.140596 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c0b52d86-f0bc-4bd1-aec9-80d7dd5e67da tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:27.142167 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c0b52d86-f0bc-4bd1-aec9-80d7dd5e67da tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:27.244428 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-c0b52d86-f0bc-4bd1-aec9-80d7dd5e67da tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: 424a22f0-ccc3-4fec-bf38-4aaf924928e3] Going to try to terminate instance {{(pid=134101) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:49:27.427078 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-879a2ce9-bfd3-4d6a-a9ab-b0dcc020558f tempest-FlavorsV2TestJSON-1897051808 tempest-FlavorsV2TestJSON-1897051808-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:49:27.429920 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-c0b52d86-f0bc-4bd1-aec9-80d7dd5e67da tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "DELETE /compute/v2.1/servers/424a22f0-ccc3-4fec-bf38-4aaf924928e3" status: 204 len: 0 microversion: 2.1 time: 0.329899 Oct 04 21:49:27.431507 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 794/1640] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 21:49:27 2022] DELETE /compute/v2.1/servers/424a22f0-ccc3-4fec-bf38-4aaf924928e3 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:49:27.441506 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-97b87b1b-c017-4c78-b449-f6b4b4c40f5d tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:49:27.443583 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-97b87b1b-c017-4c78-b449-f6b4b4c40f5d tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] [instance: 69b35751-ffe5-4447-8c07-8db18ae96e9d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:49:27.443865 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-879a2ce9-bfd3-4d6a-a9ab-b0dcc020558f tempest-FlavorsV2TestJSON-1897051808 tempest-FlavorsV2TestJSON-1897051808-project] 10.222.0.43 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.302994 Oct 04 21:49:27.444776 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 847/1641] 10.222.0.43 () {58 vars in 1137 bytes} [Tue Oct 4 21:49:27 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:49:27.459799 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-ac9fb5a0-a15b-4530-8c1b-7c5dee2e8565 tempest-SecurityGroupRulesTestJSON-1224420723 tempest-SecurityGroupRulesTestJSON-1224420723-project] Calling method '.version_select at 0x7fbb2f70d9d0>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:49:27.461949 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-97b87b1b-c017-4c78-b449-f6b4b4c40f5d tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:27.462554 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-97b87b1b-c017-4c78-b449-f6b4b4c40f5d tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:27.463086 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-97b87b1b-c017-4c78-b449-f6b4b4c40f5d tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:27.463801 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-97b87b1b-c017-4c78-b449-f6b4b4c40f5d tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:27.464463 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-97b87b1b-c017-4c78-b449-f6b4b4c40f5d tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:27.465107 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-97b87b1b-c017-4c78-b449-f6b4b4c40f5d tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:27.746715 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-97b87b1b-c017-4c78-b449-f6b4b4c40f5d tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d66a6a9c5c4c57ba0d25a37323f37f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758fcafb5db74075b183978a97b7c4ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:49:27.760178 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-97b87b1b-c017-4c78-b449-f6b4b4c40f5d tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] 10.222.0.43 "GET /compute/v2.1/servers/69b35751-ffe5-4447-8c07-8db18ae96e9d" status: 200 len: 1324 microversion: 2.1 time: 0.325097 Oct 04 21:49:27.760807 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 795/1642] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:49:27 2022] GET /compute/v2.1/servers/69b35751-ffe5-4447-8c07-8db18ae96e9d => generated 1324 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:49:27.779105 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-152c0f1b-e9fd-4859-b082-4ba0c02c4ba7 tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:49:27.783614 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-152c0f1b-e9fd-4859-b082-4ba0c02c4ba7 tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:27.784162 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-152c0f1b-e9fd-4859-b082-4ba0c02c4ba7 tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:27.784617 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-152c0f1b-e9fd-4859-b082-4ba0c02c4ba7 tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:27.788735 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-152c0f1b-e9fd-4859-b082-4ba0c02c4ba7 tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:27.789344 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-152c0f1b-e9fd-4859-b082-4ba0c02c4ba7 tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:27.790601 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-152c0f1b-e9fd-4859-b082-4ba0c02c4ba7 tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:27.862158 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-152c0f1b-e9fd-4859-b082-4ba0c02c4ba7 tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] 10.222.0.43 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.095616 Oct 04 21:49:27.863265 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 796/1643] 10.222.0.43 () {58 vars in 1176 bytes} [Tue Oct 4 21:49:27 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:49:27.874889 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-4a026b7c-4060-45f5-ae55-bf97c0faef83 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:49:27.875523 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-4a026b7c-4060-45f5-ae55-bf97c0faef83 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: 424a22f0-ccc3-4fec-bf38-4aaf924928e3] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:49:27.890302 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4a026b7c-4060-45f5-ae55-bf97c0faef83 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:27.890953 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4a026b7c-4060-45f5-ae55-bf97c0faef83 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:27.891411 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4a026b7c-4060-45f5-ae55-bf97c0faef83 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:27.894135 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4a026b7c-4060-45f5-ae55-bf97c0faef83 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:27.895766 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4a026b7c-4060-45f5-ae55-bf97c0faef83 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:27.896170 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4a026b7c-4060-45f5-ae55-bf97c0faef83 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:28.810594 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-ac9fb5a0-a15b-4530-8c1b-7c5dee2e8565 tempest-SecurityGroupRulesTestJSON-1224420723 tempest-SecurityGroupRulesTestJSON-1224420723-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-group-rules/18bcd87a-e74d-4303-bea0-5b771b0bb8dd" status: 202 len: 0 microversion: 2.1 time: 1.363650 Oct 04 21:49:28.811524 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 848/1644] 10.222.0.43 () {58 vars in 1287 bytes} [Tue Oct 4 21:49:27 2022] DELETE /compute/v2.1/os-security-group-rules/18bcd87a-e74d-4303-bea0-5b771b0bb8dd => generated 0 bytes in 1366 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:49:28.816544 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-7f2f9ba2-982d-4d1b-87ce-57fc831a06ee tempest-FlavorsV2TestJSON-1897051808 tempest-FlavorsV2TestJSON-1897051808-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:49:28.880745 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-7f2f9ba2-982d-4d1b-87ce-57fc831a06ee tempest-FlavorsV2TestJSON-1897051808 tempest-FlavorsV2TestJSON-1897051808-project] 10.222.0.43 "GET /compute/v2.1/flavors" status: 200 len: 2594 microversion: 2.1 time: 0.067840 Oct 04 21:49:28.881367 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 849/1645] 10.222.0.43 () {58 vars in 1125 bytes} [Tue Oct 4 21:49:28 2022] GET /compute/v2.1/flavors => generated 2594 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:49:28.896852 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-53ebdd04-c56e-49e5-b279-b3963010f9d1 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:49:28.897767 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-53ebdd04-c56e-49e5-b279-b3963010f9d1 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] [instance: 69b35751-ffe5-4447-8c07-8db18ae96e9d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:49:28.909437 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-53ebdd04-c56e-49e5-b279-b3963010f9d1 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:28.921057 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-53ebdd04-c56e-49e5-b279-b3963010f9d1 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:28.921726 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-53ebdd04-c56e-49e5-b279-b3963010f9d1 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:28.922846 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-53ebdd04-c56e-49e5-b279-b3963010f9d1 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:28.923530 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-53ebdd04-c56e-49e5-b279-b3963010f9d1 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:28.924160 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-53ebdd04-c56e-49e5-b279-b3963010f9d1 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:28.974133 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=100 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:49:28.983520 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-4a026b7c-4060-45f5-ae55-bf97c0faef83 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:49:28.991798 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-4a026b7c-4060-45f5-ae55-bf97c0faef83 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/424a22f0-ccc3-4fec-bf38-4aaf924928e3" status: 200 len: 1533 microversion: 2.1 time: 1.126622 Oct 04 21:49:28.992376 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 797/1646] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:49:27 2022] GET /compute/v2.1/servers/424a22f0-ccc3-4fec-bf38-4aaf924928e3 => generated 1533 bytes in 1129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:49:29.005745 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-f9634cfc-a8c7-41a4-986e-6e468464692d tempest-SecurityGroupRulesTestJSON-1224420723 tempest-SecurityGroupRulesTestJSON-1224420723-project] Calling method '.version_select at 0x7fbb2ef19dc0>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:49:29.675080 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-53ebdd04-c56e-49e5-b279-b3963010f9d1 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d66a6a9c5c4c57ba0d25a37323f37f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758fcafb5db74075b183978a97b7c4ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:49:29.699333 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-53ebdd04-c56e-49e5-b279-b3963010f9d1 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] 10.222.0.43 "GET /compute/v2.1/servers/69b35751-ffe5-4447-8c07-8db18ae96e9d" status: 200 len: 1324 microversion: 2.1 time: 0.807309 Oct 04 21:49:29.699958 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 850/1647] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:49:28 2022] GET /compute/v2.1/servers/69b35751-ffe5-4447-8c07-8db18ae96e9d => generated 1324 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:49:29.713158 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-87910053-b3d3-4b0e-9abb-2693c0108c04 tempest-FlavorsV2TestJSON-1897051808 tempest-FlavorsV2TestJSON-1897051808-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:49:29.724806 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-87910053-b3d3-4b0e-9abb-2693c0108c04 tempest-FlavorsV2TestJSON-1897051808 tempest-FlavorsV2TestJSON-1897051808-project] 10.222.0.43 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.022949 Oct 04 21:49:29.741616 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 851/1648] 10.222.0.43 () {58 vars in 1137 bytes} [Tue Oct 4 21:49:29 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:49:29.753279 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-1538ade9-8cb4-43c6-8a75-4aa4a3484247 tempest-FlavorsV2TestJSON-1897051808 tempest-FlavorsV2TestJSON-1897051808-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:49:29.775878 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-1538ade9-8cb4-43c6-8a75-4aa4a3484247 tempest-FlavorsV2TestJSON-1897051808 tempest-FlavorsV2TestJSON-1897051808-project] 10.222.0.43 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.033057 Oct 04 21:49:29.780713 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 852/1649] 10.222.0.43 () {58 vars in 1137 bytes} [Tue Oct 4 21:49:29 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:49:29.794137 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-25c18c59-d93f-4e42-a4c9-80aad5a9eb1f tempest-FlavorsV2TestJSON-1897051808 tempest-FlavorsV2TestJSON-1897051808-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:49:29.859798 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-25c18c59-d93f-4e42-a4c9-80aad5a9eb1f tempest-FlavorsV2TestJSON-1897051808 tempest-FlavorsV2TestJSON-1897051808-project] 10.222.0.43 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.070275 Oct 04 21:49:29.870738 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 853/1650] 10.222.0.43 () {58 vars in 1165 bytes} [Tue Oct 4 21:49:29 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:49:29.880906 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-da4a0843-08be-498f-90ab-15139b48915e tempest-FlavorsV2TestJSON-1897051808 tempest-FlavorsV2TestJSON-1897051808-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:49:29.907754 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-da4a0843-08be-498f-90ab-15139b48915e tempest-FlavorsV2TestJSON-1897051808 tempest-FlavorsV2TestJSON-1897051808-project] 10.222.0.43 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.031379 Oct 04 21:49:29.908360 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 854/1651] 10.222.0.43 () {58 vars in 1137 bytes} [Tue Oct 4 21:49:29 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:49:29.925567 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-e2cd94c2-ab7b-43f9-8db1-be961402046f tempest-FlavorsV2TestJSON-1897051808 tempest-FlavorsV2TestJSON-1897051808-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:49:29.996657 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-e2cd94c2-ab7b-43f9-8db1-be961402046f tempest-FlavorsV2TestJSON-1897051808 tempest-FlavorsV2TestJSON-1897051808-project] 10.222.0.43 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.073429 Oct 04 21:49:30.000526 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 855/1652] 10.222.0.43 () {58 vars in 1169 bytes} [Tue Oct 4 21:49:29 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:49:30.018172 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-e3615b9e-ed8c-4ac1-b999-42e3dc41b0d8 tempest-FlavorsV2TestJSON-1897051808 tempest-FlavorsV2TestJSON-1897051808-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:49:30.052695 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-e3615b9e-ed8c-4ac1-b999-42e3dc41b0d8 tempest-FlavorsV2TestJSON-1897051808 tempest-FlavorsV2TestJSON-1897051808-project] 10.222.0.43 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.035936 Oct 04 21:49:30.053853 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 856/1653] 10.222.0.43 () {58 vars in 1161 bytes} [Tue Oct 4 21:49:30 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:49:30.072516 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-551d6df5-a060-42a5-b93d-8f9026ddd929 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:49:30.076673 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-551d6df5-a060-42a5-b93d-8f9026ddd929 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: 424a22f0-ccc3-4fec-bf38-4aaf924928e3] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:49:30.093231 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-f9634cfc-a8c7-41a4-986e-6e468464692d tempest-SecurityGroupRulesTestJSON-1224420723 tempest-SecurityGroupRulesTestJSON-1224420723-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/ec5874ad-7292-4f12-8440-1d19e1fd4601" status: 202 len: 0 microversion: 2.1 time: 1.099688 Oct 04 21:49:30.094731 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 798/1654] 10.222.0.43 () {58 vars in 1272 bytes} [Tue Oct 4 21:49:28 2022] DELETE /compute/v2.1/os-security-groups/ec5874ad-7292-4f12-8440-1d19e1fd4601 => generated 0 bytes in 1102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:49:30.096591 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-551d6df5-a060-42a5-b93d-8f9026ddd929 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:30.097171 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-551d6df5-a060-42a5-b93d-8f9026ddd929 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:30.098404 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-551d6df5-a060-42a5-b93d-8f9026ddd929 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:30.099528 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-551d6df5-a060-42a5-b93d-8f9026ddd929 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:30.100001 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-551d6df5-a060-42a5-b93d-8f9026ddd929 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:30.100436 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-551d6df5-a060-42a5-b93d-8f9026ddd929 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:30.102324 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-0e45e3e2-8144-4b3f-9949-82d67d62d7a5 tempest-FlavorsV2TestJSON-1897051808 tempest-FlavorsV2TestJSON-1897051808-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:49:30.135845 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-0e45e3e2-8144-4b3f-9949-82d67d62d7a5 tempest-FlavorsV2TestJSON-1897051808 tempest-FlavorsV2TestJSON-1897051808-project] 10.222.0.43 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.032681 Oct 04 21:49:30.138092 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 799/1655] 10.222.0.43 () {58 vars in 1137 bytes} [Tue Oct 4 21:49:30 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:49:30.150107 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-4284aa44-0843-455d-8510-98c02ac3795e tempest-SecurityGroupRulesTestJSON-1224420723 tempest-SecurityGroupRulesTestJSON-1224420723-project] Calling method '.version_select at 0x7fbb2ed0a280>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:49:30.406616 n-d-860284-1 devstack@n-api.service[134101]: DEBUG neutronclient.v2_0.client [None req-4284aa44-0843-455d-8510-98c02ac3795e tempest-SecurityGroupRulesTestJSON-1224420723 tempest-SecurityGroupRulesTestJSON-1224420723-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 8051a5f8-a1f5-451a-a1fc-a9a6e889ce96 does not exist", "detail": ""}} {{(pid=134101) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 21:49:30.408074 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.network.security_group_api [None req-4284aa44-0843-455d-8510-98c02ac3795e tempest-SecurityGroupRulesTestJSON-1224420723 tempest-SecurityGroupRulesTestJSON-1224420723-project] Neutron security group 8051a5f8-a1f5-451a-a1fc-a9a6e889ce96 not found {{(pid=134101) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 04 21:49:30.408782 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-4284aa44-0843-455d-8510-98c02ac3795e tempest-SecurityGroupRulesTestJSON-1224420723 tempest-SecurityGroupRulesTestJSON-1224420723-project] HTTP exception thrown: Security group 8051a5f8-a1f5-451a-a1fc-a9a6e889ce96 does not exist Oct 04 21:49:30.408782 n-d-860284-1 devstack@n-api.service[134101]: Neutron server returns request_ids: ['req-6b66db7c-f0a7-4fc8-9e44-149d446d07bb'] Oct 04 21:49:30.423019 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-551d6df5-a060-42a5-b93d-8f9026ddd929 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:49:30.431121 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-4284aa44-0843-455d-8510-98c02ac3795e tempest-SecurityGroupRulesTestJSON-1224420723 tempest-SecurityGroupRulesTestJSON-1224420723-project] Request method failure captured: Oct 04 21:49:30.431121 n-d-860284-1 devstack@n-api.service[134101]: request: DELETE /compute/v2.1/os-security-groups/8051a5f8-a1f5-451a-a1fc-a9a6e889ce96 HTTP/1.1 Oct 04 21:49:30.431121 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 21:49:30.431121 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 21:49:30.431121 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 21:49:30.431121 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 21:49:30.431121 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 21:49:30.431121 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 21:49:30.431121 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 21:49:30.431121 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 21:49:30.431121 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPKpWWHHeE9HmiMbpP9vlD_51wsvOdk_Bs1PGMj8z7dgXjajVC2e1sv_St5-JTydoGyjkQgOy8cVsg6xpPfa9f_XQWp21bSjbWccYNqqwa2E61YL4EWehlRVPPcwOZCRX4y0tiYhPkl_2oF8YFqAi6bEx6X0pq4ReNwVCEWwI2NrsEMk Oct 04 21:49:30.431121 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 21:49:30.431121 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 21:49:30.431121 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 21:49:30.431121 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 21:49:30.431121 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 21:49:30.431121 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 21:49:30.431121 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: f0a250bf3b0044d5ba29a095622d3584 Oct 04 21:49:30.431121 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-1224420723 Oct 04 21:49:30.431121 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 21:49:30.431121 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 21:49:30.431121 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f0a250bf3b0044d5ba29a095622d3584"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_f0a250bf3b0044d5ba29a095622d3584", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f0a250bf3b0044d5ba29a095622d3584"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/f0a250bf3b0044d5ba29a095622d3584"}]}] Oct 04 21:49:30.431121 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-SecurityGroupRulesTestJSON-1224420723 Oct 04 21:49:30.431121 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: f0a250bf3b0044d5ba29a095622d3584 Oct 04 21:49:30.431121 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-1224420723 Oct 04 21:49:30.431121 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-SecurityGroupRulesTestJSON-1224420723-project Oct 04 21:49:30.431121 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 21:49:30.431121 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 21:49:30.431121 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 32152c48adeb40208da3634d9c3b2378 Oct 04 21:49:30.431121 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-SecurityGroupRulesTestJSON-1224420723-project Oct 04 21:49:30.431121 n-d-860284-1 devstack@n-api.service[134101]: method: Oct 04 21:49:30.431121 n-d-860284-1 devstack@n-api.service[134101]: exception: Security group 8051a5f8-a1f5-451a-a1fc-a9a6e889ce96 does not exist Oct 04 21:49:30.431121 n-d-860284-1 devstack@n-api.service[134101]: Neutron server returns request_ids: ['req-6b66db7c-f0a7-4fc8-9e44-149d446d07bb'] Oct 04 21:49:30.431121 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': '8051a5f8-a1f5-451a-a1fc-a9a6e889ce96'} Oct 04 21:49:30.431121 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:49:30.431121 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:49:30.431121 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 04 21:49:30.431121 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 04 21:49:30.431121 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:49:30.431121 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:49:30.431121 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 04 21:49:30.431121 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 04 21:49:30.431121 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:49:30.431121 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:49:30.431121 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 21:49:30.431121 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 21:49:30.431121 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:49:30.431121 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:49:30.431121 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 21:49:30.431121 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 21:49:30.431121 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:49:30.431121 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:49:30.431121 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 21:49:30.431121 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 21:49:30.431121 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:49:30.431121 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:49:30.431121 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 21:49:30.431121 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 21:49:30.431121 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 21:49:30.431121 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 21:49:30.431121 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 8051a5f8-a1f5-451a-a1fc-a9a6e889ce96 does not exist Oct 04 21:49:30.435895 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6b66db7c-f0a7-4fc8-9e44-149d446d07bb'] Oct 04 21:49:30.435895 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:49:30.435895 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:49:30.435895 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:49:30.435895 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:49:30.435895 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 04 21:49:30.435895 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 04 21:49:30.435895 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 04 21:49:30.435895 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 21:49:30.435895 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 8051a5f8-a1f5-451a-a1fc-a9a6e889ce96 does not exist Oct 04 21:49:30.435895 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6b66db7c-f0a7-4fc8-9e44-149d446d07bb'] Oct 04 21:49:30.435895 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:49:30.435895 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:49:30.435895 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:49:30.435895 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:49:30.435895 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:49:30.435895 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:49:30.435895 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:49:30.435895 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:49:30.435895 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:49:30.435895 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:49:30.435895 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:49:30.435895 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:49:30.435895 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 04 21:49:30.435895 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 21:49:30.435895 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 8051a5f8-a1f5-451a-a1fc-a9a6e889ce96 does not exist Oct 04 21:49:30.435895 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6b66db7c-f0a7-4fc8-9e44-149d446d07bb'] Oct 04 21:49:30.435895 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:49:30.435895 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:49:30.435895 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:49:30.435895 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:49:30.435895 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:49:30.435895 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:49:30.435895 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:49:30.435895 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:49:30.435895 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 8051a5f8-a1f5-451a-a1fc-a9a6e889ce96 does not exist Oct 04 21:49:30.435895 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6b66db7c-f0a7-4fc8-9e44-149d446d07bb'] Oct 04 21:49:30.435895 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:49:30.435895 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-4284aa44-0843-455d-8510-98c02ac3795e tempest-SecurityGroupRulesTestJSON-1224420723 tempest-SecurityGroupRulesTestJSON-1224420723-project] Returning 404 to user: Security group 8051a5f8-a1f5-451a-a1fc-a9a6e889ce96 does not exist Oct 04 21:49:30.435895 n-d-860284-1 devstack@n-api.service[134101]: Neutron server returns request_ids: ['req-6b66db7c-f0a7-4fc8-9e44-149d446d07bb'] {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:49:30.435895 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-4284aa44-0843-455d-8510-98c02ac3795e tempest-SecurityGroupRulesTestJSON-1224420723 tempest-SecurityGroupRulesTestJSON-1224420723-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/8051a5f8-a1f5-451a-a1fc-a9a6e889ce96" status: 404 len: 194 microversion: 2.1 time: 0.292398 Oct 04 21:49:30.435895 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 800/1656] 10.222.0.43 () {58 vars in 1272 bytes} [Tue Oct 4 21:49:30 2022] DELETE /compute/v2.1/os-security-groups/8051a5f8-a1f5-451a-a1fc-a9a6e889ce96 => generated 194 bytes in 293 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:49:30.440732 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-9b20a812-c776-4734-86dc-35fdd24d4309 tempest-FlavorsV2TestJSON-1897051808 tempest-FlavorsV2TestJSON-1897051808-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:49:30.446703 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-551d6df5-a060-42a5-b93d-8f9026ddd929 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/424a22f0-ccc3-4fec-bf38-4aaf924928e3" status: 200 len: 1491 microversion: 2.1 time: 0.388573 Oct 04 21:49:30.448269 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 857/1657] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:49:30 2022] GET /compute/v2.1/servers/424a22f0-ccc3-4fec-bf38-4aaf924928e3 => generated 1491 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:49:30.455518 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-f81ae875-ab33-438b-8919-130af5070ad5 tempest-SecurityGroupRulesTestJSON-1224420723 tempest-SecurityGroupRulesTestJSON-1224420723-project] Calling method '.version_select at 0x7fbb2f6bd820>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:49:30.547730 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-9b20a812-c776-4734-86dc-35fdd24d4309 tempest-FlavorsV2TestJSON-1897051808 tempest-FlavorsV2TestJSON-1897051808-project] 10.222.0.43 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2500 microversion: 2.1 time: 0.111353 Oct 04 21:49:30.549362 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 801/1658] 10.222.0.43 () {58 vars in 1167 bytes} [Tue Oct 4 21:49:30 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2500 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:49:30.576154 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-6e23d0d0-9430-4dc3-adce-e298e6f1b88a tempest-FlavorsV2TestJSON-1897051808 tempest-FlavorsV2TestJSON-1897051808-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:49:30.601086 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-6e23d0d0-9430-4dc3-adce-e298e6f1b88a tempest-FlavorsV2TestJSON-1897051808 tempest-FlavorsV2TestJSON-1897051808-project] 10.222.0.43 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.030910 Oct 04 21:49:30.603231 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 802/1659] 10.222.0.43 () {58 vars in 1137 bytes} [Tue Oct 4 21:49:30 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:49:30.620062 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-5b9e12a9-a010-45b8-9bba-4c68cc2a297a tempest-FlavorsV2TestJSON-1897051808 tempest-FlavorsV2TestJSON-1897051808-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:49:30.693479 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-5b9e12a9-a010-45b8-9bba-4c68cc2a297a tempest-FlavorsV2TestJSON-1897051808 tempest-FlavorsV2TestJSON-1897051808-project] 10.222.0.43 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.081060 Oct 04 21:49:30.695400 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 803/1660] 10.222.0.43 () {58 vars in 1144 bytes} [Tue Oct 4 21:49:30 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:49:30.711720 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-3877a896-9461-4730-8a57-af7c871ac0b6 tempest-FlavorsV2TestJSON-1897051808 tempest-FlavorsV2TestJSON-1897051808-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:49:30.732331 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-3877a896-9461-4730-8a57-af7c871ac0b6 tempest-FlavorsV2TestJSON-1897051808 tempest-FlavorsV2TestJSON-1897051808-project] 10.222.0.43 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.025424 Oct 04 21:49:30.736143 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 804/1661] 10.222.0.43 () {58 vars in 1137 bytes} [Tue Oct 4 21:49:30 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:49:30.743881 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-863ff0d0-f24e-4741-94c8-13df0dd00076 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:49:30.760311 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-863ff0d0-f24e-4741-94c8-13df0dd00076 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] [instance: 69b35751-ffe5-4447-8c07-8db18ae96e9d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:49:30.792032 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-863ff0d0-f24e-4741-94c8-13df0dd00076 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:30.793616 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-863ff0d0-f24e-4741-94c8-13df0dd00076 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:30.795597 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-863ff0d0-f24e-4741-94c8-13df0dd00076 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:30.800825 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-863ff0d0-f24e-4741-94c8-13df0dd00076 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:30.804954 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-863ff0d0-f24e-4741-94c8-13df0dd00076 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:30.806675 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-863ff0d0-f24e-4741-94c8-13df0dd00076 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:31.317073 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-863ff0d0-f24e-4741-94c8-13df0dd00076 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d66a6a9c5c4c57ba0d25a37323f37f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758fcafb5db74075b183978a97b7c4ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:49:31.327641 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-863ff0d0-f24e-4741-94c8-13df0dd00076 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] 10.222.0.43 "GET /compute/v2.1/servers/69b35751-ffe5-4447-8c07-8db18ae96e9d" status: 200 len: 1324 microversion: 2.1 time: 0.590377 Oct 04 21:49:31.340601 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 805/1662] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:49:30 2022] GET /compute/v2.1/servers/69b35751-ffe5-4447-8c07-8db18ae96e9d => generated 1324 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:49:31.353986 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-073b5a6c-f84a-47b2-9e62-040cc4afc826 tempest-FlavorsV2TestJSON-1897051808 tempest-FlavorsV2TestJSON-1897051808-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:49:31.439399 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-073b5a6c-f84a-47b2-9e62-040cc4afc826 tempest-FlavorsV2TestJSON-1897051808 tempest-FlavorsV2TestJSON-1897051808-project] 10.222.0.43 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.096901 Oct 04 21:49:31.446423 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 806/1663] 10.222.0.43 () {58 vars in 1148 bytes} [Tue Oct 4 21:49:31 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:49:31.446423 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-a4fae053-10e5-4255-89e8-db568e1c9621 req-8e559fa5-6cb4-4766-9816-40803406480b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "424a22f0-ccc3-4fec-bf38-4aaf924928e3", "name": "network-vif-deleted", "tag": "0fc2e8ca-ce8a-4b4a-992c-9e648d20829d"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:49:31.458354 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-a4fae053-10e5-4255-89e8-db568e1c9621 req-8e559fa5-6cb4-4766-9816-40803406480b service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:31.458890 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-a4fae053-10e5-4255-89e8-db568e1c9621 req-8e559fa5-6cb4-4766-9816-40803406480b service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:31.459327 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-a4fae053-10e5-4255-89e8-db568e1c9621 req-8e559fa5-6cb4-4766-9816-40803406480b service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:31.476128 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-a4fae053-10e5-4255-89e8-db568e1c9621 req-8e559fa5-6cb4-4766-9816-40803406480b service nova] Creating event network-vif-deleted:0fc2e8ca-ce8a-4b4a-992c-9e648d20829d for instance 424a22f0-ccc3-4fec-bf38-4aaf924928e3 on n-h2-860284-1 Oct 04 21:49:31.490888 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-a4fae053-10e5-4255-89e8-db568e1c9621 req-8e559fa5-6cb4-4766-9816-40803406480b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049159 Oct 04 21:49:31.494465 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 807/1664] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:49:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:49:31.511302 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-59964e8c-d41a-427b-96a1-b47faf9172c8 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7c49ea41-da52-4911-8ad8-b4d606e49777", "device": "/dev/xvdb"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:49:31.513836 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-59964e8c-d41a-427b-96a1-b47faf9172c8 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 3f0a02bc-7993-4849-8b3c-7572327b4799] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:49:31.533253 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-59964e8c-d41a-427b-96a1-b47faf9172c8 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:31.533812 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-59964e8c-d41a-427b-96a1-b47faf9172c8 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:31.534276 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-59964e8c-d41a-427b-96a1-b47faf9172c8 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:31.535893 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-59964e8c-d41a-427b-96a1-b47faf9172c8 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:31.536659 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-59964e8c-d41a-427b-96a1-b47faf9172c8 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:31.537423 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-59964e8c-d41a-427b-96a1-b47faf9172c8 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:31.545561 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-f81ae875-ab33-438b-8919-130af5070ad5 tempest-SecurityGroupRulesTestJSON-1224420723 tempest-SecurityGroupRulesTestJSON-1224420723-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/5342ec7b-7761-4f9b-89e0-01e35d850b67" status: 202 len: 0 microversion: 2.1 time: 1.096034 Oct 04 21:49:31.547432 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 858/1665] 10.222.0.43 () {58 vars in 1272 bytes} [Tue Oct 4 21:49:30 2022] DELETE /compute/v2.1/os-security-groups/5342ec7b-7761-4f9b-89e0-01e35d850b67 => generated 0 bytes in 1098 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:49:31.553811 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-0a9660e9-9702-4138-834b-760ec9ffd184 tempest-FlavorsV2TestJSON-1897051808 tempest-FlavorsV2TestJSON-1897051808-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:49:31.586939 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-0a9660e9-9702-4138-834b-760ec9ffd184 tempest-FlavorsV2TestJSON-1897051808 tempest-FlavorsV2TestJSON-1897051808-project] 10.222.0.43 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.038091 Oct 04 21:49:31.603717 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 859/1666] 10.222.0.43 () {58 vars in 1140 bytes} [Tue Oct 4 21:49:31 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:49:31.616320 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-49839b71-c4a1-4f0d-ad7b-4402fdde8813 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:49:31.620730 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-49839b71-c4a1-4f0d-ad7b-4402fdde8813 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: 424a22f0-ccc3-4fec-bf38-4aaf924928e3] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:49:31.638170 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:49:31.640443 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-49839b71-c4a1-4f0d-ad7b-4402fdde8813 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:31.641273 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-49839b71-c4a1-4f0d-ad7b-4402fdde8813 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:31.642836 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-49839b71-c4a1-4f0d-ad7b-4402fdde8813 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:31.647130 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-49839b71-c4a1-4f0d-ad7b-4402fdde8813 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:31.648357 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-49839b71-c4a1-4f0d-ad7b-4402fdde8813 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:31.649563 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-49839b71-c4a1-4f0d-ad7b-4402fdde8813 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:31.790664 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-49839b71-c4a1-4f0d-ad7b-4402fdde8813 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:31.792194 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-49839b71-c4a1-4f0d-ad7b-4402fdde8813 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:31.792996 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-49839b71-c4a1-4f0d-ad7b-4402fdde8813 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:31.793612 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.objects.instance [None req-49839b71-c4a1-4f0d-ad7b-4402fdde8813 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lazy-loading 'fault' on Instance uuid 424a22f0-ccc3-4fec-bf38-4aaf924928e3 {{(pid=134102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:49:31.927851 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-49839b71-c4a1-4f0d-ad7b-4402fdde8813 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:49:31.942826 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-49839b71-c4a1-4f0d-ad7b-4402fdde8813 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/424a22f0-ccc3-4fec-bf38-4aaf924928e3" status: 200 len: 1368 microversion: 2.1 time: 0.335067 Oct 04 21:49:31.945017 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 860/1667] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:49:31 2022] GET /compute/v2.1/servers/424a22f0-ccc3-4fec-bf38-4aaf924928e3 => generated 1368 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:49:31.954630 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-86781a24-06ca-49c4-90a7-c55ab4b1b66f tempest-SecurityGroupRulesTestJSON-1224420723 tempest-SecurityGroupRulesTestJSON-1224420723-project] Calling method '.version_select at 0x7fbb2f6bd790>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:49:32.054175 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-59964e8c-d41a-427b-96a1-b47faf9172c8 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "POST /compute/v2.1/servers/3f0a02bc-7993-4849-8b3c-7572327b4799/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.550416 Oct 04 21:49:32.056472 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 808/1668] 10.222.0.43 () {60 vars in 1323 bytes} [Tue Oct 4 21:49:31 2022] POST /compute/v2.1/servers/3f0a02bc-7993-4849-8b3c-7572327b4799/os-volume_attachments => generated 194 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:49:32.070466 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-9bfab32e-9eff-4a20-9d28-af7b11ff1ca8 req-e16e9a47-3a0e-4c21-bb66-1008717a3cbd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69b35751-ffe5-4447-8c07-8db18ae96e9d", "tag": "e2331ba4-826a-40cf-853f-720873f465a1"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:49:32.096969 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-9bfab32e-9eff-4a20-9d28-af7b11ff1ca8 req-e16e9a47-3a0e-4c21-bb66-1008717a3cbd service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:32.101991 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-9bfab32e-9eff-4a20-9d28-af7b11ff1ca8 req-e16e9a47-3a0e-4c21-bb66-1008717a3cbd service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:32.102943 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-9bfab32e-9eff-4a20-9d28-af7b11ff1ca8 req-e16e9a47-3a0e-4c21-bb66-1008717a3cbd service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:32.144184 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-9bfab32e-9eff-4a20-9d28-af7b11ff1ca8 req-e16e9a47-3a0e-4c21-bb66-1008717a3cbd service nova] Creating event network-changed:e2331ba4-826a-40cf-853f-720873f465a1 for instance 69b35751-ffe5-4447-8c07-8db18ae96e9d on n-h2-860284-1 Oct 04 21:49:32.168194 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-9bfab32e-9eff-4a20-9d28-af7b11ff1ca8 req-e16e9a47-3a0e-4c21-bb66-1008717a3cbd service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105811 Oct 04 21:49:32.169664 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 809/1669] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:49:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:49:32.191914 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-4c07e6b6-5895-4702-ac38-0f3344743c09 tempest-FlavorsV2TestJSON-1897051808 tempest-FlavorsV2TestJSON-1897051808-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:49:32.217550 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-4c07e6b6-5895-4702-ac38-0f3344743c09 tempest-FlavorsV2TestJSON-1897051808 tempest-FlavorsV2TestJSON-1897051808-project] 10.222.0.43 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.040634 Oct 04 21:49:32.228863 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 810/1670] 10.222.0.43 () {58 vars in 1137 bytes} [Tue Oct 4 21:49:32 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:49:32.244812 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-b46294e7-5bd2-4749-baab-be3bf59e64b7 tempest-FlavorsV2TestJSON-1897051808 tempest-FlavorsV2TestJSON-1897051808-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:49:32.347444 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-b46294e7-5bd2-4749-baab-be3bf59e64b7 tempest-FlavorsV2TestJSON-1897051808 tempest-FlavorsV2TestJSON-1897051808-project] 10.222.0.43 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1300 microversion: 2.1 time: 0.117104 Oct 04 21:49:32.365940 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 811/1671] 10.222.0.43 () {58 vars in 1146 bytes} [Tue Oct 4 21:49:32 2022] GET /compute/v2.1/flavors?marker=452 => generated 1300 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:49:32.391117 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-bc619ac0-c98b-41b4-8eeb-8eebd791478c tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:49:32.392197 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-bc619ac0-c98b-41b4-8eeb-8eebd791478c tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] [instance: 69b35751-ffe5-4447-8c07-8db18ae96e9d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:49:32.407111 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bc619ac0-c98b-41b4-8eeb-8eebd791478c tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:32.407832 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bc619ac0-c98b-41b4-8eeb-8eebd791478c tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:32.408736 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bc619ac0-c98b-41b4-8eeb-8eebd791478c tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:32.411348 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bc619ac0-c98b-41b4-8eeb-8eebd791478c tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:32.417349 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bc619ac0-c98b-41b4-8eeb-8eebd791478c tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:32.418250 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bc619ac0-c98b-41b4-8eeb-8eebd791478c tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:32.589310 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell0:SELECT=16 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:49:32.622354 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell0:SELECT=6 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:49:32.836032 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-bc619ac0-c98b-41b4-8eeb-8eebd791478c tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d66a6a9c5c4c57ba0d25a37323f37f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758fcafb5db74075b183978a97b7c4ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:49:32.852543 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-bc619ac0-c98b-41b4-8eeb-8eebd791478c tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] 10.222.0.43 "GET /compute/v2.1/servers/69b35751-ffe5-4447-8c07-8db18ae96e9d" status: 200 len: 1324 microversion: 2.1 time: 0.481404 Oct 04 21:49:32.856077 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 812/1672] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:49:32 2022] GET /compute/v2.1/servers/69b35751-ffe5-4447-8c07-8db18ae96e9d => generated 1324 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:49:32.861686 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-06b6929e-dbfa-40c0-9304-a32a975ebffd tempest-FlavorsV2TestJSON-1897051808 tempest-FlavorsV2TestJSON-1897051808-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:49:32.903975 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-06b6929e-dbfa-40c0-9304-a32a975ebffd tempest-FlavorsV2TestJSON-1897051808 tempest-FlavorsV2TestJSON-1897051808-project] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.046519 Oct 04 21:49:32.905697 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 813/1673] 10.222.0.43 () {58 vars in 1146 bytes} [Tue Oct 4 21:49:32 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:49:33.009559 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-86781a24-06ca-49c4-90a7-c55ab4b1b66f tempest-SecurityGroupRulesTestJSON-1224420723 tempest-SecurityGroupRulesTestJSON-1224420723-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/3bdf7644-9916-41fd-adf1-668ee9808f93" status: 202 len: 0 microversion: 2.1 time: 1.062580 Oct 04 21:49:33.010564 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 861/1674] 10.222.0.43 () {58 vars in 1272 bytes} [Tue Oct 4 21:49:31 2022] DELETE /compute/v2.1/os-security-groups/3bdf7644-9916-41fd-adf1-668ee9808f93 => generated 0 bytes in 1065 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:49:33.018713 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-9c9e3b71-b812-48e0-8a49-4e7d76bfb4e8 tempest-FlavorsV2TestJSON-1897051808 tempest-FlavorsV2TestJSON-1897051808-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:49:33.060652 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-9c9e3b71-b812-48e0-8a49-4e7d76bfb4e8 tempest-FlavorsV2TestJSON-1897051808 tempest-FlavorsV2TestJSON-1897051808-project] 10.222.0.43 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.047696 Oct 04 21:49:33.065174 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 862/1675] 10.222.0.43 () {58 vars in 1137 bytes} [Tue Oct 4 21:49:33 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:49:33.065635 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=2 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:49:33.076950 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-72d56977-ba9a-49d0-9ef1-e371da6c4485 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:49:33.077786 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-72d56977-ba9a-49d0-9ef1-e371da6c4485 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: 424a22f0-ccc3-4fec-bf38-4aaf924928e3] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:49:33.088799 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-72d56977-ba9a-49d0-9ef1-e371da6c4485 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:33.090340 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-72d56977-ba9a-49d0-9ef1-e371da6c4485 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:33.091068 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-72d56977-ba9a-49d0-9ef1-e371da6c4485 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:33.093299 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-72d56977-ba9a-49d0-9ef1-e371da6c4485 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:33.094166 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-72d56977-ba9a-49d0-9ef1-e371da6c4485 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:33.095114 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-72d56977-ba9a-49d0-9ef1-e371da6c4485 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:33.147038 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-72d56977-ba9a-49d0-9ef1-e371da6c4485 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] HTTP exception thrown: Instance 424a22f0-ccc3-4fec-bf38-4aaf924928e3 could not be found. Oct 04 21:49:33.149378 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-72d56977-ba9a-49d0-9ef1-e371da6c4485 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Request method failure captured: Oct 04 21:49:33.149378 n-d-860284-1 devstack@n-api.service[134102]: request: GET /compute/v2.1/servers/424a22f0-ccc3-4fec-bf38-4aaf924928e3 HTTP/1.1 Oct 04 21:49:33.149378 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 21:49:33.149378 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 21:49:33.149378 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 21:49:33.149378 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 21:49:33.149378 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 21:49:33.149378 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 21:49:33.149378 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 21:49:33.149378 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 21:49:33.149378 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPKkSWMYDuUKVegFXtR5Dq665FCEvHr6gUPE2yil6i-rj34rHI9TeiStwErZ2Z3W0XoMQuC69vn2-UANat7ubXSf1uXDj3o94Fpzj4pdWUuZ8ToGaTjk7-rR7tmlESVrnkipl33ILcpgcRu4jH8fV30u3RdMcBMY2Ca0qLAfp0gKOTz8 Oct 04 21:49:33.149378 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 21:49:33.149378 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 21:49:33.149378 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 21:49:33.149378 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 21:49:33.149378 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 21:49:33.149378 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 21:49:33.149378 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: 1ad1554e318e45f78a2bc5e148d0c39f Oct 04 21:49:33.149378 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-MigrationsAdminTest-285422622 Oct 04 21:49:33.149378 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 21:49:33.149378 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 21:49:33.149378 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1ad1554e318e45f78a2bc5e148d0c39f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_1ad1554e318e45f78a2bc5e148d0c39f", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1ad1554e318e45f78a2bc5e148d0c39f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/1ad1554e318e45f78a2bc5e148d0c39f"}]}] Oct 04 21:49:33.149378 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-MigrationsAdminTest-285422622 Oct 04 21:49:33.149378 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: 1ad1554e318e45f78a2bc5e148d0c39f Oct 04 21:49:33.149378 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-MigrationsAdminTest-285422622 Oct 04 21:49:33.149378 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-MigrationsAdminTest-285422622-project Oct 04 21:49:33.149378 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 21:49:33.149378 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 21:49:33.149378 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: ff4e089659884b6d9197141ba9f14f57 Oct 04 21:49:33.149378 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-MigrationsAdminTest-285422622-project Oct 04 21:49:33.149378 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 21:49:33.149378 n-d-860284-1 devstack@n-api.service[134102]: exception: Instance 424a22f0-ccc3-4fec-bf38-4aaf924928e3 could not be found. Oct 04 21:49:33.149378 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': '424a22f0-ccc3-4fec-bf38-4aaf924928e3'} Oct 04 21:49:33.149378 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:49:33.149378 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:49:33.149378 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:49:33.149378 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:49:33.149378 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:49:33.149378 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:49:33.149378 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:49:33.149378 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:49:33.149378 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:49:33.149378 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:49:33.149378 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 424a22f0-ccc3-4fec-bf38-4aaf924928e3 could not be found. Oct 04 21:49:33.149378 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:49:33.149378 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:49:33.149378 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:49:33.149378 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:49:33.149378 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:49:33.149378 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:49:33.149378 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:49:33.149378 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:49:33.149378 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:49:33.149378 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:49:33.149378 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:49:33.149378 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:49:33.149378 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:49:33.149378 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:49:33.149378 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:49:33.149378 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:49:33.149378 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 424a22f0-ccc3-4fec-bf38-4aaf924928e3 could not be found. Oct 04 21:49:33.149378 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:49:33.149378 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:49:33.149378 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:49:33.155612 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:49:33.155612 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:49:33.155612 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:49:33.155612 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:49:33.155612 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:49:33.155612 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 424a22f0-ccc3-4fec-bf38-4aaf924928e3 could not be found. Oct 04 21:49:33.155612 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:49:33.155612 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-72d56977-ba9a-49d0-9ef1-e371da6c4485 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Returning 404 to user: Instance 424a22f0-ccc3-4fec-bf38-4aaf924928e3 could not be found. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:49:33.155612 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-72d56977-ba9a-49d0-9ef1-e371da6c4485 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/424a22f0-ccc3-4fec-bf38-4aaf924928e3" status: 404 len: 111 microversion: 2.1 time: 0.083714 Oct 04 21:49:33.155612 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 863/1676] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:49:33 2022] GET /compute/v2.1/servers/424a22f0-ccc3-4fec-bf38-4aaf924928e3 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:49:33.163055 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-48661c93-5ef7-450e-bdf6-95306bc07f4c tempest-SecurityGroupRulesTestJSON-1224420723 tempest-SecurityGroupRulesTestJSON-1224420723-project] Calling method '.version_select at 0x7fbb2f6bd790>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:49:33.333343 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-c9c1ec88-ab2f-456e-9e44-d295ed38d917 tempest-FloatingIPDetailsTestJSON-650903168 tempest-FloatingIPDetailsTestJSON-650903168-project] Action: 'create', calling method: .version_select at 0x7fbb2f399ca0>, body: {"pool": null} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:49:33.752162 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-48661c93-5ef7-450e-bdf6-95306bc07f4c tempest-SecurityGroupRulesTestJSON-1224420723 tempest-SecurityGroupRulesTestJSON-1224420723-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/c80cd1de-967a-47b0-ad28-8dac2e5dd558" status: 202 len: 0 microversion: 2.1 time: 0.595254 Oct 04 21:49:33.753803 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 864/1677] 10.222.0.43 () {58 vars in 1272 bytes} [Tue Oct 4 21:49:33 2022] DELETE /compute/v2.1/os-security-groups/c80cd1de-967a-47b0-ad28-8dac2e5dd558 => generated 0 bytes in 601 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:49:33.761465 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-950f87c3-af4d-44d8-b56b-544e3ecdb915 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '.version_select at 0x7fbb2f570b80>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:49:33.788421 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-950f87c3-af4d-44d8-b56b-544e3ecdb915 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1013933539" status: 202 len: 0 microversion: 2.1 time: 0.032150 Oct 04 21:49:33.791663 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 865/1678] 10.222.0.43 () {58 vars in 1221 bytes} [Tue Oct 4 21:49:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1013933539 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:49:33.809498 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-64238bc6-4fa2-4174-8cad-9efb14faa5c2 tempest-SecurityGroupRulesTestJSON-1224420723 tempest-SecurityGroupRulesTestJSON-1224420723-project] Calling method '.version_select at 0x7fbb2f91baf0>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:49:34.826899 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-64238bc6-4fa2-4174-8cad-9efb14faa5c2 tempest-SecurityGroupRulesTestJSON-1224420723 tempest-SecurityGroupRulesTestJSON-1224420723-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/415ce3d9-b33b-4799-9fd0-e01451e9836d" status: 202 len: 0 microversion: 2.1 time: 1.033752 Oct 04 21:49:34.827461 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 866/1679] 10.222.0.43 () {58 vars in 1272 bytes} [Tue Oct 4 21:49:33 2022] DELETE /compute/v2.1/os-security-groups/415ce3d9-b33b-4799-9fd0-e01451e9836d => generated 0 bytes in 1035 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:49:34.834358 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-3ae87543-2b06-4488-934e-2d72a5e3517d tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:49:34.835441 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-3ae87543-2b06-4488-934e-2d72a5e3517d tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] [instance: 69b35751-ffe5-4447-8c07-8db18ae96e9d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:49:34.856879 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3ae87543-2b06-4488-934e-2d72a5e3517d tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:34.858858 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3ae87543-2b06-4488-934e-2d72a5e3517d tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:34.863332 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3ae87543-2b06-4488-934e-2d72a5e3517d tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:34.868497 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3ae87543-2b06-4488-934e-2d72a5e3517d tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:34.870508 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3ae87543-2b06-4488-934e-2d72a5e3517d tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:34.874259 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3ae87543-2b06-4488-934e-2d72a5e3517d tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:35.639417 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-3ae87543-2b06-4488-934e-2d72a5e3517d tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d66a6a9c5c4c57ba0d25a37323f37f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758fcafb5db74075b183978a97b7c4ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:49:35.648950 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-3ae87543-2b06-4488-934e-2d72a5e3517d tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] 10.222.0.43 "GET /compute/v2.1/servers/69b35751-ffe5-4447-8c07-8db18ae96e9d" status: 200 len: 1324 microversion: 2.1 time: 0.820181 Oct 04 21:49:35.671517 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 867/1680] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:49:34 2022] GET /compute/v2.1/servers/69b35751-ffe5-4447-8c07-8db18ae96e9d => generated 1324 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:49:35.678809 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-cfb40f43-55f6-48f1-b896-2159fd872b11 tempest-SecurityGroupRulesTestJSON-1224420723 tempest-SecurityGroupRulesTestJSON-1224420723-project] Calling method '.version_select at 0x7fbb2f869700>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:49:37.559891 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-c9c1ec88-ab2f-456e-9e44-d295ed38d917 tempest-FloatingIPDetailsTestJSON-650903168 tempest-FloatingIPDetailsTestJSON-650903168-project] 10.222.0.43 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.652848 Oct 04 21:49:37.560623 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 814/1681] 10.222.0.43 () {60 vars in 1170 bytes} [Tue Oct 4 21:49:32 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4654 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:49:37.573346 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-ae79eaf7-d891-4d52-ab18-77c7ecbb8050 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:49:37.574630 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-ae79eaf7-d891-4d52-ab18-77c7ecbb8050 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: a2d1b827-a865-4d56-a665-110d0541a669] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:49:37.583908 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ae79eaf7-d891-4d52-ab18-77c7ecbb8050 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:37.588117 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ae79eaf7-d891-4d52-ab18-77c7ecbb8050 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:37.590108 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ae79eaf7-d891-4d52-ab18-77c7ecbb8050 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:37.591250 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ae79eaf7-d891-4d52-ab18-77c7ecbb8050 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:37.599080 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ae79eaf7-d891-4d52-ab18-77c7ecbb8050 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:37.600417 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ae79eaf7-d891-4d52-ab18-77c7ecbb8050 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:37.697624 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-ae79eaf7-d891-4d52-ab18-77c7ecbb8050 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: a2d1b827-a865-4d56-a665-110d0541a669] Going to try to terminate instance {{(pid=134101) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:49:37.700955 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-cfb40f43-55f6-48f1-b896-2159fd872b11 tempest-SecurityGroupRulesTestJSON-1224420723 tempest-SecurityGroupRulesTestJSON-1224420723-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/d68e7c17-82de-412a-a6cf-9df5f805c157" status: 202 len: 0 microversion: 2.1 time: 2.027642 Oct 04 21:49:37.702323 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 868/1682] 10.222.0.43 () {58 vars in 1272 bytes} [Tue Oct 4 21:49:35 2022] DELETE /compute/v2.1/os-security-groups/d68e7c17-82de-412a-a6cf-9df5f805c157 => generated 0 bytes in 2030 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:49:37.734736 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-763d65ba-b661-4bc8-8a91-b44d39bda97d tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:49:37.735618 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-763d65ba-b661-4bc8-8a91-b44d39bda97d tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] [instance: 69b35751-ffe5-4447-8c07-8db18ae96e9d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:49:37.744051 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-763d65ba-b661-4bc8-8a91-b44d39bda97d tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:37.744792 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-763d65ba-b661-4bc8-8a91-b44d39bda97d tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:37.745427 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-763d65ba-b661-4bc8-8a91-b44d39bda97d tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:37.746306 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-763d65ba-b661-4bc8-8a91-b44d39bda97d tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:37.746978 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-763d65ba-b661-4bc8-8a91-b44d39bda97d tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:37.747758 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-763d65ba-b661-4bc8-8a91-b44d39bda97d tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:37.819299 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=2 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:49:37.883129 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-ae79eaf7-d891-4d52-ab18-77c7ecbb8050 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "DELETE /compute/v2.1/servers/a2d1b827-a865-4d56-a665-110d0541a669" status: 204 len: 0 microversion: 2.1 time: 0.320760 Oct 04 21:49:37.884404 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 815/1683] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 21:49:37 2022] DELETE /compute/v2.1/servers/a2d1b827-a865-4d56-a665-110d0541a669 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:49:37.890680 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-25d886cf-d79f-4b7b-baf0-a3de6f4dec79 tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:49:37.891707 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-25d886cf-d79f-4b7b-baf0-a3de6f4dec79 tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] [instance: d4abcd04-329d-40a8-8d6e-4383bef437ae] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:49:37.905888 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-25d886cf-d79f-4b7b-baf0-a3de6f4dec79 tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:37.909191 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-25d886cf-d79f-4b7b-baf0-a3de6f4dec79 tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:37.917368 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-25d886cf-d79f-4b7b-baf0-a3de6f4dec79 tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:37.918703 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-25d886cf-d79f-4b7b-baf0-a3de6f4dec79 tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:37.919448 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-25d886cf-d79f-4b7b-baf0-a3de6f4dec79 tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:37.920399 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-25d886cf-d79f-4b7b-baf0-a3de6f4dec79 tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:38.569337 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-763d65ba-b661-4bc8-8a91-b44d39bda97d tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d66a6a9c5c4c57ba0d25a37323f37f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758fcafb5db74075b183978a97b7c4ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:49:38.580506 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-763d65ba-b661-4bc8-8a91-b44d39bda97d tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] 10.222.0.43 "GET /compute/v2.1/servers/69b35751-ffe5-4447-8c07-8db18ae96e9d" status: 200 len: 1324 microversion: 2.1 time: 0.854862 Oct 04 21:49:38.583602 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 869/1684] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:49:37 2022] GET /compute/v2.1/servers/69b35751-ffe5-4447-8c07-8db18ae96e9d => generated 1324 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:49:38.594213 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-ae1805ad-6bd3-4a7f-8163-4dd9127d7cd4 tempest-ImagesMetadataTestJSON-1000283254 tempest-ImagesMetadataTestJSON-1000283254-project] Calling method '.version_select at 0x7fbb2f0195e0>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:49:38.699849 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-ae1805ad-6bd3-4a7f-8163-4dd9127d7cd4 tempest-ImagesMetadataTestJSON-1000283254 tempest-ImagesMetadataTestJSON-1000283254-project] 10.222.0.43 "GET /compute/v2.1/images/716dc685-bb05-4bba-9a60-122d1fad21d5" status: 200 len: 636 microversion: 2.1 time: 0.111476 Oct 04 21:49:38.701394 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 870/1685] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:49:38 2022] GET /compute/v2.1/images/716dc685-bb05-4bba-9a60-122d1fad21d5 => generated 636 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:49:38.716989 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-2ddae49b-04b3-47dc-b5d6-5f1335cfcbac tempest-FloatingIPDetailsTestJSON-650903168 tempest-FloatingIPDetailsTestJSON-650903168-project] Action: 'create', calling method: .version_select at 0x7fbb2f754820>, body: {"pool": null} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:49:38.843347 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.objects.instance [None req-25d886cf-d79f-4b7b-baf0-a3de6f4dec79 tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Lazy-loading 'services' on Instance uuid d4abcd04-329d-40a8-8d6e-4383bef437ae {{(pid=134101) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:49:38.899415 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-25d886cf-d79f-4b7b-baf0-a3de6f4dec79 tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/d4abcd04-329d-40a8-8d6e-4383bef437ae" status: 200 len: 2423 microversion: 2.25 time: 1.013404 Oct 04 21:49:38.910410 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 816/1686] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:49:37 2022] GET /compute/v2.1/servers/d4abcd04-329d-40a8-8d6e-4383bef437ae => generated 2423 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:49:38.915678 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-22e671a1-224a-42c4-85d2-3ff2a4276ea7 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:49:38.920333 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-22e671a1-224a-42c4-85d2-3ff2a4276ea7 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: a2d1b827-a865-4d56-a665-110d0541a669] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:49:38.953384 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-22e671a1-224a-42c4-85d2-3ff2a4276ea7 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:38.953898 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-22e671a1-224a-42c4-85d2-3ff2a4276ea7 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:38.958822 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-22e671a1-224a-42c4-85d2-3ff2a4276ea7 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:38.959700 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-22e671a1-224a-42c4-85d2-3ff2a4276ea7 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:38.960181 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-22e671a1-224a-42c4-85d2-3ff2a4276ea7 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:38.960628 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-22e671a1-224a-42c4-85d2-3ff2a4276ea7 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:39.649459 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-22e671a1-224a-42c4-85d2-3ff2a4276ea7 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:49:39.660513 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-22e671a1-224a-42c4-85d2-3ff2a4276ea7 tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/a2d1b827-a865-4d56-a665-110d0541a669" status: 200 len: 1467 microversion: 2.1 time: 0.748534 Oct 04 21:49:39.666601 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 817/1687] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:49:38 2022] GET /compute/v2.1/servers/a2d1b827-a865-4d56-a665-110d0541a669 => generated 1467 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:49:39.680387 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-9e12a738-1ad4-4cf8-ab91-a3e95d6403ac tempest-ImagesMetadataTestJSON-1000283254 tempest-ImagesMetadataTestJSON-1000283254-project] Action: 'update_all', calling method: .version_select at 0x7fbb2ee880d0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:49:39.780795 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-9e12a738-1ad4-4cf8-ab91-a3e95d6403ac tempest-ImagesMetadataTestJSON-1000283254 tempest-ImagesMetadataTestJSON-1000283254-project] Getting quotas for project ed830eec825e4c6fb45a4063e9b24b15. Resources: dict_keys(['metadata_items']) {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:49:39.805101 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-9e12a738-1ad4-4cf8-ab91-a3e95d6403ac tempest-ImagesMetadataTestJSON-1000283254 tempest-ImagesMetadataTestJSON-1000283254-project] Getting quotas for user e5264d8a9dc647f489a7fc930597e0b2 and project ed830eec825e4c6fb45a4063e9b24b15. Resources: dict_keys(['metadata_items']) {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:49:40.394967 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-9e12a738-1ad4-4cf8-ab91-a3e95d6403ac tempest-ImagesMetadataTestJSON-1000283254 tempest-ImagesMetadataTestJSON-1000283254-project] 10.222.0.43 "PUT /compute/v2.1/images/716dc685-bb05-4bba-9a60-122d1fad21d5/metadata" status: 200 len: 61 microversion: 2.1 time: 0.727001 Oct 04 21:49:40.398036 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 818/1688] 10.222.0.43 () {60 vars in 1280 bytes} [Tue Oct 4 21:49:39 2022] PUT /compute/v2.1/images/716dc685-bb05-4bba-9a60-122d1fad21d5/metadata => generated 61 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 21:49:40.404543 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-ebb0c31e-1bea-4756-890a-44375426e234 tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-860284-1", "block_migration": "auto"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:49:40.410430 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-ebb0c31e-1bea-4756-890a-44375426e234 tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] [instance: d4abcd04-329d-40a8-8d6e-4383bef437ae] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:49:40.439303 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ebb0c31e-1bea-4756-890a-44375426e234 tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:40.440161 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ebb0c31e-1bea-4756-890a-44375426e234 tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:40.440858 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ebb0c31e-1bea-4756-890a-44375426e234 tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:40.442483 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ebb0c31e-1bea-4756-890a-44375426e234 tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:40.443170 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ebb0c31e-1bea-4756-890a-44375426e234 tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:40.443832 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ebb0c31e-1bea-4756-890a-44375426e234 tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:40.475597 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.objects.instance [None req-ebb0c31e-1bea-4756-890a-44375426e234 tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Lazy-loading 'flavor' on Instance uuid d4abcd04-329d-40a8-8d6e-4383bef437ae {{(pid=134101) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:49:40.497612 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-ebb0c31e-1bea-4756-890a-44375426e234 tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] [instance: d4abcd04-329d-40a8-8d6e-4383bef437ae] Going to try to live migrate instance to n-h2-860284-1 {{(pid=134101) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 04 21:49:40.519532 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:49:43.682782 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-2ddae49b-04b3-47dc-b5d6-5f1335cfcbac tempest-FloatingIPDetailsTestJSON-650903168 tempest-FloatingIPDetailsTestJSON-650903168-project] 10.222.0.43 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 4.979846 Oct 04 21:49:43.684104 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 871/1689] 10.222.0.43 () {60 vars in 1170 bytes} [Tue Oct 4 21:49:38 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 4982 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:49:43.690031 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-6b26a524-0906-4c79-98f7-4b7eee67f023 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:49:43.691158 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-6b26a524-0906-4c79-98f7-4b7eee67f023 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] [instance: 69b35751-ffe5-4447-8c07-8db18ae96e9d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:49:43.699692 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6b26a524-0906-4c79-98f7-4b7eee67f023 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:43.700351 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6b26a524-0906-4c79-98f7-4b7eee67f023 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:43.701212 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6b26a524-0906-4c79-98f7-4b7eee67f023 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:43.702162 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6b26a524-0906-4c79-98f7-4b7eee67f023 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:43.703054 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6b26a524-0906-4c79-98f7-4b7eee67f023 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:43.703728 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6b26a524-0906-4c79-98f7-4b7eee67f023 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:43.735326 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-ebb0c31e-1bea-4756-890a-44375426e234 tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] 10.222.0.43 "POST /compute/v2.1/servers/d4abcd04-329d-40a8-8d6e-4383bef437ae/action" status: 202 len: 0 microversion: 2.25 time: 3.335777 Oct 04 21:49:43.736058 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 819/1690] 10.222.0.43 () {62 vars in 1319 bytes} [Tue Oct 4 21:49:40 2022] POST /compute/v2.1/servers/d4abcd04-329d-40a8-8d6e-4383bef437ae/action => generated 0 bytes in 3337 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:49:43.744646 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-f9c8ec21-779c-4f5b-a7ae-b61a2196135e tempest-ImagesMetadataTestJSON-1000283254 tempest-ImagesMetadataTestJSON-1000283254-project] Calling method '.version_select at 0x7fbb3739e0d0>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:49:43.943813 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-6b26a524-0906-4c79-98f7-4b7eee67f023 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d66a6a9c5c4c57ba0d25a37323f37f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758fcafb5db74075b183978a97b7c4ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:49:43.952520 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-6b26a524-0906-4c79-98f7-4b7eee67f023 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] 10.222.0.43 "GET /compute/v2.1/servers/69b35751-ffe5-4447-8c07-8db18ae96e9d" status: 200 len: 1324 microversion: 2.1 time: 0.266719 Oct 04 21:49:43.953497 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 872/1691] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:49:43 2022] GET /compute/v2.1/servers/69b35751-ffe5-4447-8c07-8db18ae96e9d => generated 1324 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:49:43.959898 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-42dd5dd2-eb1c-45ca-8f56-38aee3fbdd5d tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:49:43.960717 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-42dd5dd2-eb1c-45ca-8f56-38aee3fbdd5d tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: a2d1b827-a865-4d56-a665-110d0541a669] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:49:43.967526 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-42dd5dd2-eb1c-45ca-8f56-38aee3fbdd5d tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:43.968338 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-42dd5dd2-eb1c-45ca-8f56-38aee3fbdd5d tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:43.968947 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-42dd5dd2-eb1c-45ca-8f56-38aee3fbdd5d tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:43.969862 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-42dd5dd2-eb1c-45ca-8f56-38aee3fbdd5d tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:43.970518 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-42dd5dd2-eb1c-45ca-8f56-38aee3fbdd5d tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:43.971105 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-42dd5dd2-eb1c-45ca-8f56-38aee3fbdd5d tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:43.986756 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-42dd5dd2-eb1c-45ca-8f56-38aee3fbdd5d tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] HTTP exception thrown: Instance a2d1b827-a865-4d56-a665-110d0541a669 could not be found. Oct 04 21:49:43.989251 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-42dd5dd2-eb1c-45ca-8f56-38aee3fbdd5d tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Request method failure captured: Oct 04 21:49:43.989251 n-d-860284-1 devstack@n-api.service[134102]: request: GET /compute/v2.1/servers/a2d1b827-a865-4d56-a665-110d0541a669 HTTP/1.1 Oct 04 21:49:43.989251 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 21:49:43.989251 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 21:49:43.989251 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 21:49:43.989251 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 21:49:43.989251 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 21:49:43.989251 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 21:49:43.989251 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 21:49:43.989251 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 21:49:43.989251 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPKkSWMYDuUKVegFXtR5Dq665FCEvHr6gUPE2yil6i-rj34rHI9TeiStwErZ2Z3W0XoMQuC69vn2-UANat7ubXSf1uXDj3o94Fpzj4pdWUuZ8ToGaTjk7-rR7tmlESVrnkipl33ILcpgcRu4jH8fV30u3RdMcBMY2Ca0qLAfp0gKOTz8 Oct 04 21:49:43.989251 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 21:49:43.989251 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 21:49:43.989251 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 21:49:43.989251 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 21:49:43.989251 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 21:49:43.989251 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 21:49:43.989251 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: 1ad1554e318e45f78a2bc5e148d0c39f Oct 04 21:49:43.989251 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-MigrationsAdminTest-285422622 Oct 04 21:49:43.989251 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 21:49:43.989251 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 21:49:43.989251 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1ad1554e318e45f78a2bc5e148d0c39f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_1ad1554e318e45f78a2bc5e148d0c39f", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1ad1554e318e45f78a2bc5e148d0c39f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/1ad1554e318e45f78a2bc5e148d0c39f"}]}] Oct 04 21:49:43.989251 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-MigrationsAdminTest-285422622 Oct 04 21:49:43.989251 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: 1ad1554e318e45f78a2bc5e148d0c39f Oct 04 21:49:43.989251 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-MigrationsAdminTest-285422622 Oct 04 21:49:43.989251 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-MigrationsAdminTest-285422622-project Oct 04 21:49:43.989251 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 21:49:43.989251 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 21:49:43.989251 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: ff4e089659884b6d9197141ba9f14f57 Oct 04 21:49:43.989251 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-MigrationsAdminTest-285422622-project Oct 04 21:49:43.989251 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 21:49:43.989251 n-d-860284-1 devstack@n-api.service[134102]: exception: Instance a2d1b827-a865-4d56-a665-110d0541a669 could not be found. Oct 04 21:49:43.989251 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': 'a2d1b827-a865-4d56-a665-110d0541a669'} Oct 04 21:49:43.989251 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:49:43.989251 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:49:43.989251 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:49:43.989251 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:49:43.989251 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:49:43.989251 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:49:43.989251 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:49:43.989251 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:49:43.989251 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:49:43.989251 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:49:43.989251 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2d1b827-a865-4d56-a665-110d0541a669 could not be found. Oct 04 21:49:43.989251 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:49:43.989251 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:49:43.989251 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:49:43.989251 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:49:43.989251 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:49:43.989251 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:49:43.989251 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:49:43.989251 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:49:43.989251 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:49:43.989251 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:49:43.989251 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:49:43.989251 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:49:43.989251 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:49:43.989251 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:49:43.989251 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:49:43.989251 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:49:43.989251 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2d1b827-a865-4d56-a665-110d0541a669 could not be found. Oct 04 21:49:43.989251 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:49:43.989251 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:49:43.989251 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:49:43.994820 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:49:43.994820 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:49:43.994820 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:49:43.994820 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:49:43.994820 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:49:43.994820 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2d1b827-a865-4d56-a665-110d0541a669 could not be found. Oct 04 21:49:43.994820 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:49:43.994820 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-42dd5dd2-eb1c-45ca-8f56-38aee3fbdd5d tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Returning 404 to user: Instance a2d1b827-a865-4d56-a665-110d0541a669 could not be found. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:49:43.994820 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-42dd5dd2-eb1c-45ca-8f56-38aee3fbdd5d tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/a2d1b827-a865-4d56-a665-110d0541a669" status: 404 len: 111 microversion: 2.1 time: 0.035935 Oct 04 21:49:43.994820 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 873/1692] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:49:43 2022] GET /compute/v2.1/servers/a2d1b827-a865-4d56-a665-110d0541a669 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:49:43.999497 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-eedb7b89-6e9a-4ea1-9559-d7148adfb7de req-16a1e0f1-99cc-46e4-9519-ef378a6bcd2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69b35751-ffe5-4447-8c07-8db18ae96e9d", "name": "network-vif-plugged", "status": "completed", "tag": "e2331ba4-826a-40cf-853f-720873f465a1"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:49:44.011347 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-eedb7b89-6e9a-4ea1-9559-d7148adfb7de req-16a1e0f1-99cc-46e4-9519-ef378a6bcd2d service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:44.012083 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-eedb7b89-6e9a-4ea1-9559-d7148adfb7de req-16a1e0f1-99cc-46e4-9519-ef378a6bcd2d service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:44.013245 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-eedb7b89-6e9a-4ea1-9559-d7148adfb7de req-16a1e0f1-99cc-46e4-9519-ef378a6bcd2d service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:44.051630 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-eedb7b89-6e9a-4ea1-9559-d7148adfb7de req-16a1e0f1-99cc-46e4-9519-ef378a6bcd2d service nova] Creating event network-vif-plugged:e2331ba4-826a-40cf-853f-720873f465a1 for instance 69b35751-ffe5-4447-8c07-8db18ae96e9d on n-h2-860284-1 Oct 04 21:49:44.070513 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-eedb7b89-6e9a-4ea1-9559-d7148adfb7de req-16a1e0f1-99cc-46e4-9519-ef378a6bcd2d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064409 Oct 04 21:49:44.071398 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 874/1693] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:49:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:49:44.256047 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-f9c8ec21-779c-4f5b-a7ae-b61a2196135e tempest-ImagesMetadataTestJSON-1000283254 tempest-ImagesMetadataTestJSON-1000283254-project] 10.222.0.43 "DELETE /compute/v2.1/images/716dc685-bb05-4bba-9a60-122d1fad21d5/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.518605 Oct 04 21:49:44.257301 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 820/1694] 10.222.0.43 () {58 vars in 1296 bytes} [Tue Oct 4 21:49:43 2022] DELETE /compute/v2.1/images/716dc685-bb05-4bba-9a60-122d1fad21d5/metadata/os_version => generated 0 bytes in 520 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:49:44.264559 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-00de5233-4327-4748-9e8e-77f5b28505cc req-2237c727-4d90-43b3-8ae0-161cb50f6336 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2d1b827-a865-4d56-a665-110d0541a669", "name": "network-vif-deleted", "tag": "63fc7a3b-4543-41af-bdba-41c87b0c3709"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:49:44.290143 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-00de5233-4327-4748-9e8e-77f5b28505cc req-2237c727-4d90-43b3-8ae0-161cb50f6336 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:44.292110 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-00de5233-4327-4748-9e8e-77f5b28505cc req-2237c727-4d90-43b3-8ae0-161cb50f6336 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:44.294414 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-00de5233-4327-4748-9e8e-77f5b28505cc req-2237c727-4d90-43b3-8ae0-161cb50f6336 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:44.333002 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-00de5233-4327-4748-9e8e-77f5b28505cc req-2237c727-4d90-43b3-8ae0-161cb50f6336 service nova] Creating event network-vif-deleted:63fc7a3b-4543-41af-bdba-41c87b0c3709 for instance a2d1b827-a865-4d56-a665-110d0541a669 on n-h2-860284-1 Oct 04 21:49:44.340213 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-b0a2fec2-76bf-4ab8-94ee-02c4a7332c10 tempest-ImagesNegativeTestJSON-71193266 tempest-ImagesNegativeTestJSON-71193266-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-2008928090", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452", "networks": [{"uuid": "e2c65b58-2e7b-40d1-9419-0c3fb6cd91ea"}]}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:49:44.360223 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-00de5233-4327-4748-9e8e-77f5b28505cc req-2237c727-4d90-43b3-8ae0-161cb50f6336 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101106 Oct 04 21:49:44.361035 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 821/1695] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:49:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:49:44.373958 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-75c101b6-8041-4151-ba70-4dcbc7469ed0 tempest-FloatingIPDetailsTestJSON-650903168 tempest-FloatingIPDetailsTestJSON-650903168-project] Action: 'create', calling method: .version_select at 0x7fbb3739e670>, body: {"pool": null} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:49:44.463126 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.network.neutron [None req-b0a2fec2-76bf-4ab8-94ee-02c4a7332c10 tempest-ImagesNegativeTestJSON-71193266 tempest-ImagesNegativeTestJSON-71193266-project] validate_networks() for [('e2c65b58-2e7b-40d1-9419-0c3fb6cd91ea', None, None, None, None, None)] {{(pid=134102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:49:45.345357 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-b0a2fec2-76bf-4ab8-94ee-02c4a7332c10 tempest-ImagesNegativeTestJSON-71193266 tempest-ImagesNegativeTestJSON-71193266-project] Flavor limits 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:49:45.345983 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-b0a2fec2-76bf-4ab8-94ee-02c4a7332c10 tempest-ImagesNegativeTestJSON-71193266 tempest-ImagesNegativeTestJSON-71193266-project] Image limits 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:49:45.346701 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-b0a2fec2-76bf-4ab8-94ee-02c4a7332c10 tempest-ImagesNegativeTestJSON-71193266 tempest-ImagesNegativeTestJSON-71193266-project] Flavor pref 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:49:45.348074 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-b0a2fec2-76bf-4ab8-94ee-02c4a7332c10 tempest-ImagesNegativeTestJSON-71193266 tempest-ImagesNegativeTestJSON-71193266-project] Image pref 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:49:45.349090 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-b0a2fec2-76bf-4ab8-94ee-02c4a7332c10 tempest-ImagesNegativeTestJSON-71193266 tempest-ImagesNegativeTestJSON-71193266-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:49:45.372389 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b0a2fec2-76bf-4ab8-94ee-02c4a7332c10 tempest-ImagesNegativeTestJSON-71193266 tempest-ImagesNegativeTestJSON-71193266-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:45.373240 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b0a2fec2-76bf-4ab8-94ee-02c4a7332c10 tempest-ImagesNegativeTestJSON-71193266 tempest-ImagesNegativeTestJSON-71193266-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:45.374097 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b0a2fec2-76bf-4ab8-94ee-02c4a7332c10 tempest-ImagesNegativeTestJSON-71193266 tempest-ImagesNegativeTestJSON-71193266-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:45.375344 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b0a2fec2-76bf-4ab8-94ee-02c4a7332c10 tempest-ImagesNegativeTestJSON-71193266 tempest-ImagesNegativeTestJSON-71193266-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:45.376093 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b0a2fec2-76bf-4ab8-94ee-02c4a7332c10 tempest-ImagesNegativeTestJSON-71193266 tempest-ImagesNegativeTestJSON-71193266-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:45.387390 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b0a2fec2-76bf-4ab8-94ee-02c4a7332c10 tempest-ImagesNegativeTestJSON-71193266 tempest-ImagesNegativeTestJSON-71193266-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:45.420702 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-b0a2fec2-76bf-4ab8-94ee-02c4a7332c10 tempest-ImagesNegativeTestJSON-71193266 tempest-ImagesNegativeTestJSON-71193266-project] Getting quotas for project b6559674f0b84e97948cd4286269507a. Resources: {'instances', 'ram', 'cores'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:49:45.432998 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-b0a2fec2-76bf-4ab8-94ee-02c4a7332c10 tempest-ImagesNegativeTestJSON-71193266 tempest-ImagesNegativeTestJSON-71193266-project] Getting quotas for user 7bd9fbc0c71d4e14b353a571dd257a0a and project b6559674f0b84e97948cd4286269507a. Resources: {'instances', 'ram', 'cores'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:49:45.453937 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-b0a2fec2-76bf-4ab8-94ee-02c4a7332c10 tempest-ImagesNegativeTestJSON-71193266 tempest-ImagesNegativeTestJSON-71193266-project] Going to run 1 instances... {{(pid=134102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:49:45.456712 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-b0a2fec2-76bf-4ab8-94ee-02c4a7332c10 tempest-ImagesNegativeTestJSON-71193266 tempest-ImagesNegativeTestJSON-71193266-project] [instance: 18c556c5-0b7d-4acb-9803-a504ab597fbb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='58548514-5dac-426c-81f5-19e3fba33e23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:49:45.524213 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-b0a2fec2-76bf-4ab8-94ee-02c4a7332c10 tempest-ImagesNegativeTestJSON-71193266 tempest-ImagesNegativeTestJSON-71193266-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.451427 Oct 04 21:49:45.525024 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 875/1696] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 21:49:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 1453 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:49:45.535852 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-0fb4c2c7-6a2b-414e-9594-d99eb8eb0313 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:49:45.536914 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-0fb4c2c7-6a2b-414e-9594-d99eb8eb0313 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] [instance: d4abcd04-329d-40a8-8d6e-4383bef437ae] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:49:45.545763 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0fb4c2c7-6a2b-414e-9594-d99eb8eb0313 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:45.547708 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0fb4c2c7-6a2b-414e-9594-d99eb8eb0313 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:45.549066 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0fb4c2c7-6a2b-414e-9594-d99eb8eb0313 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:45.550038 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0fb4c2c7-6a2b-414e-9594-d99eb8eb0313 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:45.551016 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0fb4c2c7-6a2b-414e-9594-d99eb8eb0313 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:45.551981 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0fb4c2c7-6a2b-414e-9594-d99eb8eb0313 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:46.022201 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-0fb4c2c7-6a2b-414e-9594-d99eb8eb0313 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:49:46.031950 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-0fb4c2c7-6a2b-414e-9594-d99eb8eb0313 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:49:46.033450 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-0fb4c2c7-6a2b-414e-9594-d99eb8eb0313 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:49:46.042039 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-0fb4c2c7-6a2b-414e-9594-d99eb8eb0313 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] 10.222.0.43 "GET /compute/v2.1/servers/d4abcd04-329d-40a8-8d6e-4383bef437ae" status: 200 len: 1814 microversion: 2.25 time: 0.515648 Oct 04 21:49:46.043251 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 876/1697] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:49:45 2022] GET /compute/v2.1/servers/d4abcd04-329d-40a8-8d6e-4383bef437ae => generated 1814 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:49:46.061646 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-bba72a07-7df6-48eb-9ac4-c7493234c85a tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:49:46.062350 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-bba72a07-7df6-48eb-9ac4-c7493234c85a tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: ec437ce7-b43a-4c8b-8a06-756cfb877851] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:49:46.072570 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bba72a07-7df6-48eb-9ac4-c7493234c85a tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:46.073080 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bba72a07-7df6-48eb-9ac4-c7493234c85a tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:46.073495 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bba72a07-7df6-48eb-9ac4-c7493234c85a tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:46.074692 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bba72a07-7df6-48eb-9ac4-c7493234c85a tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:46.075713 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bba72a07-7df6-48eb-9ac4-c7493234c85a tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:46.076778 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bba72a07-7df6-48eb-9ac4-c7493234c85a tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:46.124816 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-bba72a07-7df6-48eb-9ac4-c7493234c85a tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: ec437ce7-b43a-4c8b-8a06-756cfb877851] Going to try to terminate instance {{(pid=134102) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:49:46.265071 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-bba72a07-7df6-48eb-9ac4-c7493234c85a tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "DELETE /compute/v2.1/servers/ec437ce7-b43a-4c8b-8a06-756cfb877851" status: 204 len: 0 microversion: 2.1 time: 0.220345 Oct 04 21:49:46.271947 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 877/1698] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 21:49:46 2022] DELETE /compute/v2.1/servers/ec437ce7-b43a-4c8b-8a06-756cfb877851 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:49:46.284483 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-63539c3f-2cea-4c00-a647-927f770608d7 tempest-ImagesMetadataTestJSON-1000283254 tempest-ImagesMetadataTestJSON-1000283254-project] Calling method '.version_select at 0x7fbb2f6fb040>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:49:46.349999 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-63539c3f-2cea-4c00-a647-927f770608d7 tempest-ImagesMetadataTestJSON-1000283254 tempest-ImagesMetadataTestJSON-1000283254-project] 10.222.0.43 "GET /compute/v2.1/images/716dc685-bb05-4bba-9a60-122d1fad21d5/metadata" status: 200 len: 37 microversion: 2.1 time: 0.076226 Oct 04 21:49:46.359345 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 878/1699] 10.222.0.43 () {58 vars in 1260 bytes} [Tue Oct 4 21:49:46 2022] GET /compute/v2.1/images/716dc685-bb05-4bba-9a60-122d1fad21d5/metadata => generated 37 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 21:49:46.359345 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-8ec85966-5cbb-4e17-816c-4c081fca3c52 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:49:46.359345 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-8ec85966-5cbb-4e17-816c-4c081fca3c52 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] [instance: 69b35751-ffe5-4447-8c07-8db18ae96e9d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:49:46.367575 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8ec85966-5cbb-4e17-816c-4c081fca3c52 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:46.368383 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8ec85966-5cbb-4e17-816c-4c081fca3c52 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:46.369017 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8ec85966-5cbb-4e17-816c-4c081fca3c52 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:46.369919 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8ec85966-5cbb-4e17-816c-4c081fca3c52 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:46.370651 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8ec85966-5cbb-4e17-816c-4c081fca3c52 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:46.371251 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8ec85966-5cbb-4e17-816c-4c081fca3c52 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:46.777610 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-8ec85966-5cbb-4e17-816c-4c081fca3c52 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d66a6a9c5c4c57ba0d25a37323f37f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758fcafb5db74075b183978a97b7c4ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:49:46.786153 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-8ec85966-5cbb-4e17-816c-4c081fca3c52 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] 10.222.0.43 "GET /compute/v2.1/servers/69b35751-ffe5-4447-8c07-8db18ae96e9d" status: 200 len: 1520 microversion: 2.1 time: 0.434308 Oct 04 21:49:46.786928 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 879/1700] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:49:46 2022] GET /compute/v2.1/servers/69b35751-ffe5-4447-8c07-8db18ae96e9d => generated 1520 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:49:46.792089 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-5c23a441-c9f7-4174-accf-b0e68b76b357 tempest-ImagesNegativeTestJSON-71193266 tempest-ImagesNegativeTestJSON-71193266-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:49:46.793259 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-5c23a441-c9f7-4174-accf-b0e68b76b357 tempest-ImagesNegativeTestJSON-71193266 tempest-ImagesNegativeTestJSON-71193266-project] [instance: 18c556c5-0b7d-4acb-9803-a504ab597fbb] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:49:46.803498 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5c23a441-c9f7-4174-accf-b0e68b76b357 tempest-ImagesNegativeTestJSON-71193266 tempest-ImagesNegativeTestJSON-71193266-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:46.804140 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5c23a441-c9f7-4174-accf-b0e68b76b357 tempest-ImagesNegativeTestJSON-71193266 tempest-ImagesNegativeTestJSON-71193266-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:46.804979 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5c23a441-c9f7-4174-accf-b0e68b76b357 tempest-ImagesNegativeTestJSON-71193266 tempest-ImagesNegativeTestJSON-71193266-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:46.805682 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5c23a441-c9f7-4174-accf-b0e68b76b357 tempest-ImagesNegativeTestJSON-71193266 tempest-ImagesNegativeTestJSON-71193266-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:46.806137 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5c23a441-c9f7-4174-accf-b0e68b76b357 tempest-ImagesNegativeTestJSON-71193266 tempest-ImagesNegativeTestJSON-71193266-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:46.806590 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5c23a441-c9f7-4174-accf-b0e68b76b357 tempest-ImagesNegativeTestJSON-71193266 tempest-ImagesNegativeTestJSON-71193266-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:46.891410 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-5c23a441-c9f7-4174-accf-b0e68b76b357 tempest-ImagesNegativeTestJSON-71193266 tempest-ImagesNegativeTestJSON-71193266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd9fbc0c71d4e14b353a571dd257a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6559674f0b84e97948cd4286269507a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:49:46.902739 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-5c23a441-c9f7-4174-accf-b0e68b76b357 tempest-ImagesNegativeTestJSON-71193266 tempest-ImagesNegativeTestJSON-71193266-project] 10.222.0.43 "GET /compute/v2.1/servers/18c556c5-0b7d-4acb-9803-a504ab597fbb" status: 200 len: 1220 microversion: 2.1 time: 0.114365 Oct 04 21:49:46.906259 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 880/1701] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:49:46 2022] GET /compute/v2.1/servers/18c556c5-0b7d-4acb-9803-a504ab597fbb => generated 1220 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:49:46.912575 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-e38eb436-59ef-4adf-864d-9b2a050757cb req-4c4077a7-cc6b-43a7-9d7f-8af83bc9804c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2d1b827-a865-4d56-a665-110d0541a669", "name": "network-vif-unplugged", "status": "completed", "tag": "63fc7a3b-4543-41af-bdba-41c87b0c3709"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:49:46.923418 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-e38eb436-59ef-4adf-864d-9b2a050757cb req-4c4077a7-cc6b-43a7-9d7f-8af83bc9804c service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:46.924049 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-e38eb436-59ef-4adf-864d-9b2a050757cb req-4c4077a7-cc6b-43a7-9d7f-8af83bc9804c service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:46.924591 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-e38eb436-59ef-4adf-864d-9b2a050757cb req-4c4077a7-cc6b-43a7-9d7f-8af83bc9804c service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:46.953506 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-e38eb436-59ef-4adf-864d-9b2a050757cb req-4c4077a7-cc6b-43a7-9d7f-8af83bc9804c service nova] Creating event network-vif-unplugged:63fc7a3b-4543-41af-bdba-41c87b0c3709 for instance a2d1b827-a865-4d56-a665-110d0541a669 on n-h2-860284-1 Oct 04 21:49:46.973174 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-e38eb436-59ef-4adf-864d-9b2a050757cb req-4c4077a7-cc6b-43a7-9d7f-8af83bc9804c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.065063 Oct 04 21:49:46.974504 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 881/1702] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:49:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:49:46.982639 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-310b2709-0682-4ace-b345-0cee9148f77a tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:49:46.985485 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-310b2709-0682-4ace-b345-0cee9148f77a tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: ec437ce7-b43a-4c8b-8a06-756cfb877851] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:49:46.995102 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-310b2709-0682-4ace-b345-0cee9148f77a tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:46.995713 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-310b2709-0682-4ace-b345-0cee9148f77a tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:46.996244 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-310b2709-0682-4ace-b345-0cee9148f77a tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:46.997051 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-310b2709-0682-4ace-b345-0cee9148f77a tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:46.997741 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-310b2709-0682-4ace-b345-0cee9148f77a tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:46.998258 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-310b2709-0682-4ace-b345-0cee9148f77a tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:47.242167 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-310b2709-0682-4ace-b345-0cee9148f77a tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4e089659884b6d9197141ba9f14f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad1554e318e45f78a2bc5e148d0c39f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:49:47.251779 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-310b2709-0682-4ace-b345-0cee9148f77a tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/ec437ce7-b43a-4c8b-8a06-756cfb877851" status: 200 len: 1469 microversion: 2.1 time: 0.275888 Oct 04 21:49:47.264913 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 882/1703] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:49:46 2022] GET /compute/v2.1/servers/ec437ce7-b43a-4c8b-8a06-756cfb877851 => generated 1469 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:49:47.271283 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-033981e9-3ad8-4673-aff9-77385e4c5171 tempest-ImagesMetadataTestJSON-1000283254 tempest-ImagesMetadataTestJSON-1000283254-project] Action: 'update_all', calling method: .version_select at 0x7fbb2f1f6160>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:49:47.344998 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-033981e9-3ad8-4673-aff9-77385e4c5171 tempest-ImagesMetadataTestJSON-1000283254 tempest-ImagesMetadataTestJSON-1000283254-project] Getting quotas for project ed830eec825e4c6fb45a4063e9b24b15. Resources: dict_keys(['metadata_items']) {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:49:47.353219 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-033981e9-3ad8-4673-aff9-77385e4c5171 tempest-ImagesMetadataTestJSON-1000283254 tempest-ImagesMetadataTestJSON-1000283254-project] Getting quotas for user e5264d8a9dc647f489a7fc930597e0b2 and project ed830eec825e4c6fb45a4063e9b24b15. Resources: dict_keys(['metadata_items']) {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:49:47.693708 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-75c101b6-8041-4151-ba70-4dcbc7469ed0 tempest-FloatingIPDetailsTestJSON-650903168 tempest-FloatingIPDetailsTestJSON-650903168-project] 10.222.0.43 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.330643 Oct 04 21:49:47.694737 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 822/1704] 10.222.0.43 () {60 vars in 1170 bytes} [Tue Oct 4 21:49:44 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3333 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:49:47.701667 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-88b8d8e4-2e8b-4682-ab9b-3651799a2182 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Action: 'action', calling method: .version_select at 0x7fbb34da11f0>, body: {"addFloatingIp": {"address": "172.25.1.111"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:49:47.706267 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-88b8d8e4-2e8b-4682-ab9b-3651799a2182 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] [instance: fdc82b91-5dfa-44cf-b8c5-402922265d88] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:49:47.726436 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-88b8d8e4-2e8b-4682-ab9b-3651799a2182 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:47.727517 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-88b8d8e4-2e8b-4682-ab9b-3651799a2182 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:47.728994 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-88b8d8e4-2e8b-4682-ab9b-3651799a2182 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:47.730588 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-88b8d8e4-2e8b-4682-ab9b-3651799a2182 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:47.732159 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-88b8d8e4-2e8b-4682-ab9b-3651799a2182 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:47.732771 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-88b8d8e4-2e8b-4682-ab9b-3651799a2182 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:47.818636 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-033981e9-3ad8-4673-aff9-77385e4c5171 tempest-ImagesMetadataTestJSON-1000283254 tempest-ImagesMetadataTestJSON-1000283254-project] 10.222.0.43 "PUT /compute/v2.1/images/716dc685-bb05-4bba-9a60-122d1fad21d5/metadata" status: 200 len: 61 microversion: 2.1 time: 0.545283 Oct 04 21:49:47.818636 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 883/1705] 10.222.0.43 () {60 vars in 1280 bytes} [Tue Oct 4 21:49:47 2022] PUT /compute/v2.1/images/716dc685-bb05-4bba-9a60-122d1fad21d5/metadata => generated 61 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 21:49:47.825870 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-dab42d3e-9c13-44ed-9277-6c634b402e3e tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:49:47.827865 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-dab42d3e-9c13-44ed-9277-6c634b402e3e tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] [instance: d4abcd04-329d-40a8-8d6e-4383bef437ae] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:49:47.835365 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dab42d3e-9c13-44ed-9277-6c634b402e3e tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:47.835944 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dab42d3e-9c13-44ed-9277-6c634b402e3e tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:47.836638 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dab42d3e-9c13-44ed-9277-6c634b402e3e tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:47.837991 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dab42d3e-9c13-44ed-9277-6c634b402e3e tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:47.838668 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dab42d3e-9c13-44ed-9277-6c634b402e3e tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:47.839303 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dab42d3e-9c13-44ed-9277-6c634b402e3e tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:47.845395 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-88b8d8e4-2e8b-4682-ab9b-3651799a2182 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Acquiring lock "refresh_cache-fdc82b91-5dfa-44cf-b8c5-402922265d88" {{(pid=134101) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 04 21:49:47.845922 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-88b8d8e4-2e8b-4682-ab9b-3651799a2182 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Acquired lock "refresh_cache-fdc82b91-5dfa-44cf-b8c5-402922265d88" {{(pid=134101) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 04 21:49:48.883510 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-dab42d3e-9c13-44ed-9277-6c634b402e3e tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:49:48.898813 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-dab42d3e-9c13-44ed-9277-6c634b402e3e tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:49:48.902515 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-dab42d3e-9c13-44ed-9277-6c634b402e3e tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:49:48.905490 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-dab42d3e-9c13-44ed-9277-6c634b402e3e tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] 10.222.0.43 "GET /compute/v2.1/servers/d4abcd04-329d-40a8-8d6e-4383bef437ae" status: 200 len: 1814 microversion: 2.25 time: 1.091147 Oct 04 21:49:48.918418 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 884/1706] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:49:47 2022] GET /compute/v2.1/servers/d4abcd04-329d-40a8-8d6e-4383bef437ae => generated 1814 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:49:48.918418 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-543c35f5-809f-45c0-bdbe-4a025705c8e0 tempest-FloatingIPDetailsTestJSON-650903168 tempest-FloatingIPDetailsTestJSON-650903168-project] Action: 'create', calling method: .version_select at 0x7fbb2f869700>, body: {"pool": null} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:49:49.835224 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=4 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:49:50.024829 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.network.neutron [None req-88b8d8e4-2e8b-4682-ab9b-3651799a2182 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] [instance: fdc82b91-5dfa-44cf-b8c5-402922265d88] Building network info cache for instance {{(pid=134101) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 04 21:49:51.709782 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.network.neutron [None req-88b8d8e4-2e8b-4682-ab9b-3651799a2182 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] [instance: fdc82b91-5dfa-44cf-b8c5-402922265d88] Updating instance_info_cache with network_info: [{"id": "c36556e1-4c6d-4308-8210-aa45c17cd2d1", "address": "fa:16:3e:30:86:84", "network": {"id": "e4c13216-4fea-4d87-aa16-a7572859740d", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1638687548-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.1.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "758fcafb5db74075b183978a97b7c4ee", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapc36556e1-4c", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=134101) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 04 21:49:51.736059 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-88b8d8e4-2e8b-4682-ab9b-3651799a2182 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Releasing lock "refresh_cache-fdc82b91-5dfa-44cf-b8c5-402922265d88" {{(pid=134101) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 04 21:49:51.737677 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-88b8d8e4-2e8b-4682-ab9b-3651799a2182 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] 10.222.0.43 "POST /compute/v2.1/servers/fdc82b91-5dfa-44cf-b8c5-402922265d88/action" status: 202 len: 0 microversion: 2.1 time: 4.041776 Oct 04 21:49:51.739123 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 823/1707] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 21:49:47 2022] POST /compute/v2.1/servers/fdc82b91-5dfa-44cf-b8c5-402922265d88/action => generated 0 bytes in 4044 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 04 21:49:51.745522 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-38bf19ed-8df3-478f-a6e0-fb51a89312f5 tempest-ImagesMetadataTestJSON-1000283254 tempest-ImagesMetadataTestJSON-1000283254-project] Calling method '.version_select at 0x7fbb2ef46790>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:49:51.832430 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-38bf19ed-8df3-478f-a6e0-fb51a89312f5 tempest-ImagesMetadataTestJSON-1000283254 tempest-ImagesMetadataTestJSON-1000283254-project] 10.222.0.43 "GET /compute/v2.1/images/716dc685-bb05-4bba-9a60-122d1fad21d5/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.091758 Oct 04 21:49:51.833642 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 824/1708] 10.222.0.43 () {58 vars in 1290 bytes} [Tue Oct 4 21:49:51 2022] GET /compute/v2.1/images/716dc685-bb05-4bba-9a60-122d1fad21d5/metadata/os_distro => generated 33 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 21:49:51.840798 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-7a22de38-ab71-4f8c-9d25-3e566e650654 tempest-ImagesNegativeTestJSON-71193266 tempest-ImagesNegativeTestJSON-71193266-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:49:51.841614 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-7a22de38-ab71-4f8c-9d25-3e566e650654 tempest-ImagesNegativeTestJSON-71193266 tempest-ImagesNegativeTestJSON-71193266-project] [instance: 18c556c5-0b7d-4acb-9803-a504ab597fbb] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:49:51.851566 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7a22de38-ab71-4f8c-9d25-3e566e650654 tempest-ImagesNegativeTestJSON-71193266 tempest-ImagesNegativeTestJSON-71193266-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:51.852412 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7a22de38-ab71-4f8c-9d25-3e566e650654 tempest-ImagesNegativeTestJSON-71193266 tempest-ImagesNegativeTestJSON-71193266-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:51.853031 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7a22de38-ab71-4f8c-9d25-3e566e650654 tempest-ImagesNegativeTestJSON-71193266 tempest-ImagesNegativeTestJSON-71193266-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:51.853929 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7a22de38-ab71-4f8c-9d25-3e566e650654 tempest-ImagesNegativeTestJSON-71193266 tempest-ImagesNegativeTestJSON-71193266-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:51.854671 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7a22de38-ab71-4f8c-9d25-3e566e650654 tempest-ImagesNegativeTestJSON-71193266 tempest-ImagesNegativeTestJSON-71193266-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:51.855342 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7a22de38-ab71-4f8c-9d25-3e566e650654 tempest-ImagesNegativeTestJSON-71193266 tempest-ImagesNegativeTestJSON-71193266-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:52.247952 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-7a22de38-ab71-4f8c-9d25-3e566e650654 tempest-ImagesNegativeTestJSON-71193266 tempest-ImagesNegativeTestJSON-71193266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd9fbc0c71d4e14b353a571dd257a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6559674f0b84e97948cd4286269507a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:49:52.271359 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-7a22de38-ab71-4f8c-9d25-3e566e650654 tempest-ImagesNegativeTestJSON-71193266 tempest-ImagesNegativeTestJSON-71193266-project] 10.222.0.43 "GET /compute/v2.1/servers/18c556c5-0b7d-4acb-9803-a504ab597fbb" status: 200 len: 1316 microversion: 2.1 time: 0.436204 Oct 04 21:49:52.275672 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 825/1709] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:49:51 2022] GET /compute/v2.1/servers/18c556c5-0b7d-4acb-9803-a504ab597fbb => generated 1316 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:49:52.289670 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-1cb53260-ecf2-4469-baad-778703a486cb tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:49:52.290759 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-1cb53260-ecf2-4469-baad-778703a486cb tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] [instance: ec437ce7-b43a-4c8b-8a06-756cfb877851] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:49:52.299455 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1cb53260-ecf2-4469-baad-778703a486cb tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:52.304497 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1cb53260-ecf2-4469-baad-778703a486cb tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:52.309360 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1cb53260-ecf2-4469-baad-778703a486cb tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:52.311161 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1cb53260-ecf2-4469-baad-778703a486cb tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:52.311840 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1cb53260-ecf2-4469-baad-778703a486cb tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:52.312005 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-543c35f5-809f-45c0-bdbe-4a025705c8e0 tempest-FloatingIPDetailsTestJSON-650903168 tempest-FloatingIPDetailsTestJSON-650903168-project] 10.222.0.43 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.402678 Oct 04 21:49:52.313856 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 885/1710] 10.222.0.43 () {60 vars in 1170 bytes} [Tue Oct 4 21:49:48 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3404 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:49:52.320163 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-ed79e46d-2811-4d51-9588-b356d761361b tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:49:52.321293 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-ed79e46d-2811-4d51-9588-b356d761361b tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] [instance: 3f0a02bc-7993-4849-8b3c-7572327b4799] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:49:52.322026 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1cb53260-ecf2-4469-baad-778703a486cb tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:52.346020 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ed79e46d-2811-4d51-9588-b356d761361b tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:52.346855 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ed79e46d-2811-4d51-9588-b356d761361b tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:52.348285 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ed79e46d-2811-4d51-9588-b356d761361b tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:52.349256 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ed79e46d-2811-4d51-9588-b356d761361b tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:52.349432 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-1cb53260-ecf2-4469-baad-778703a486cb tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] HTTP exception thrown: Instance ec437ce7-b43a-4c8b-8a06-756cfb877851 could not be found. Oct 04 21:49:52.349907 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ed79e46d-2811-4d51-9588-b356d761361b tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:52.350344 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ed79e46d-2811-4d51-9588-b356d761361b tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:52.351975 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-1cb53260-ecf2-4469-baad-778703a486cb tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Request method failure captured: Oct 04 21:49:52.351975 n-d-860284-1 devstack@n-api.service[134101]: request: GET /compute/v2.1/servers/ec437ce7-b43a-4c8b-8a06-756cfb877851 HTTP/1.1 Oct 04 21:49:52.351975 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 21:49:52.351975 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 21:49:52.351975 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 21:49:52.351975 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 21:49:52.351975 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 21:49:52.351975 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 21:49:52.351975 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 21:49:52.351975 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 21:49:52.351975 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPKkSWMYDuUKVegFXtR5Dq665FCEvHr6gUPE2yil6i-rj34rHI9TeiStwErZ2Z3W0XoMQuC69vn2-UANat7ubXSf1uXDj3o94Fpzj4pdWUuZ8ToGaTjk7-rR7tmlESVrnkipl33ILcpgcRu4jH8fV30u3RdMcBMY2Ca0qLAfp0gKOTz8 Oct 04 21:49:52.351975 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 21:49:52.351975 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 21:49:52.351975 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 21:49:52.351975 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 21:49:52.351975 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 21:49:52.351975 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 21:49:52.351975 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: 1ad1554e318e45f78a2bc5e148d0c39f Oct 04 21:49:52.351975 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-MigrationsAdminTest-285422622 Oct 04 21:49:52.351975 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 21:49:52.351975 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 21:49:52.351975 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1ad1554e318e45f78a2bc5e148d0c39f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_1ad1554e318e45f78a2bc5e148d0c39f", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1ad1554e318e45f78a2bc5e148d0c39f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/1ad1554e318e45f78a2bc5e148d0c39f"}]}] Oct 04 21:49:52.351975 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-MigrationsAdminTest-285422622 Oct 04 21:49:52.351975 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: 1ad1554e318e45f78a2bc5e148d0c39f Oct 04 21:49:52.351975 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-MigrationsAdminTest-285422622 Oct 04 21:49:52.351975 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-MigrationsAdminTest-285422622-project Oct 04 21:49:52.351975 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 21:49:52.351975 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 21:49:52.351975 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: ff4e089659884b6d9197141ba9f14f57 Oct 04 21:49:52.351975 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-MigrationsAdminTest-285422622-project Oct 04 21:49:52.351975 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 21:49:52.351975 n-d-860284-1 devstack@n-api.service[134101]: exception: Instance ec437ce7-b43a-4c8b-8a06-756cfb877851 could not be found. Oct 04 21:49:52.351975 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': 'ec437ce7-b43a-4c8b-8a06-756cfb877851'} Oct 04 21:49:52.351975 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:49:52.351975 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:49:52.351975 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:49:52.351975 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:49:52.351975 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:49:52.351975 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:49:52.351975 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:49:52.351975 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:49:52.351975 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:49:52.351975 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:49:52.351975 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec437ce7-b43a-4c8b-8a06-756cfb877851 could not be found. Oct 04 21:49:52.351975 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:49:52.351975 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:49:52.351975 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:49:52.351975 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:49:52.351975 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:49:52.351975 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:49:52.351975 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:49:52.351975 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:49:52.351975 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:49:52.351975 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:49:52.351975 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:49:52.351975 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:49:52.351975 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:49:52.351975 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:49:52.351975 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:49:52.351975 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:49:52.351975 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec437ce7-b43a-4c8b-8a06-756cfb877851 could not be found. Oct 04 21:49:52.351975 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:49:52.351975 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:49:52.351975 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:49:52.357059 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:49:52.357059 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:49:52.357059 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:49:52.357059 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:49:52.357059 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:49:52.357059 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec437ce7-b43a-4c8b-8a06-756cfb877851 could not be found. Oct 04 21:49:52.357059 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:49:52.359343 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-1cb53260-ecf2-4469-baad-778703a486cb tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] Returning 404 to user: Instance ec437ce7-b43a-4c8b-8a06-756cfb877851 could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:49:52.360464 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-1cb53260-ecf2-4469-baad-778703a486cb tempest-MigrationsAdminTest-285422622 tempest-MigrationsAdminTest-285422622-project] 10.222.0.43 "GET /compute/v2.1/servers/ec437ce7-b43a-4c8b-8a06-756cfb877851" status: 404 len: 111 microversion: 2.1 time: 0.081516 Oct 04 21:49:52.361588 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 826/1711] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:49:52 2022] GET /compute/v2.1/servers/ec437ce7-b43a-4c8b-8a06-756cfb877851 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:49:52.382028 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-b4662064-3911-4d08-a7b3-27bb51fed0f0 req-f6b1578a-ccd8-4525-8c3b-5889235d546b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec437ce7-b43a-4c8b-8a06-756cfb877851", "name": "network-vif-deleted", "tag": "11205198-745e-4214-9769-9da045caa32b"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:49:52.409453 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-b4662064-3911-4d08-a7b3-27bb51fed0f0 req-f6b1578a-ccd8-4525-8c3b-5889235d546b service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:52.415285 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-b4662064-3911-4d08-a7b3-27bb51fed0f0 req-f6b1578a-ccd8-4525-8c3b-5889235d546b service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:52.419619 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-b4662064-3911-4d08-a7b3-27bb51fed0f0 req-f6b1578a-ccd8-4525-8c3b-5889235d546b service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:52.452873 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-b4662064-3911-4d08-a7b3-27bb51fed0f0 req-f6b1578a-ccd8-4525-8c3b-5889235d546b service nova] Creating event network-vif-deleted:11205198-745e-4214-9769-9da045caa32b for instance ec437ce7-b43a-4c8b-8a06-756cfb877851 on n-h1-860284-1 Oct 04 21:49:52.475122 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-b4662064-3911-4d08-a7b3-27bb51fed0f0 req-f6b1578a-ccd8-4525-8c3b-5889235d546b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099365 Oct 04 21:49:52.476135 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 827/1712] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:49:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:49:52.492151 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-03c6862d-8ad4-42a0-b3d3-b40599e5e473 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:49:52.493782 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-03c6862d-8ad4-42a0-b3d3-b40599e5e473 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] [instance: d4abcd04-329d-40a8-8d6e-4383bef437ae] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:49:52.512573 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-03c6862d-8ad4-42a0-b3d3-b40599e5e473 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:52.513463 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-03c6862d-8ad4-42a0-b3d3-b40599e5e473 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:52.517989 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-03c6862d-8ad4-42a0-b3d3-b40599e5e473 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:52.520028 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-03c6862d-8ad4-42a0-b3d3-b40599e5e473 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:52.521489 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-03c6862d-8ad4-42a0-b3d3-b40599e5e473 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:52.527430 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-03c6862d-8ad4-42a0-b3d3-b40599e5e473 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:52.791557 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-ed79e46d-2811-4d51-9588-b356d761361b tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/3f0a02bc-7993-4849-8b3c-7572327b4799" status: 200 len: 1857 microversion: 2.1 time: 0.476297 Oct 04 21:49:52.793334 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 886/1713] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:49:52 2022] GET /compute/v2.1/servers/3f0a02bc-7993-4849-8b3c-7572327b4799 => generated 1857 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:49:52.805997 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-f8a5808b-fcb5-47bf-a472-7a99ee4a1913 req-d0959192-eaf5-4622-b103-d95dff6edd37 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fdc82b91-5dfa-44cf-b8c5-402922265d88", "tag": "c36556e1-4c6d-4308-8210-aa45c17cd2d1"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:49:52.835661 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-f8a5808b-fcb5-47bf-a472-7a99ee4a1913 req-d0959192-eaf5-4622-b103-d95dff6edd37 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:52.836479 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-f8a5808b-fcb5-47bf-a472-7a99ee4a1913 req-d0959192-eaf5-4622-b103-d95dff6edd37 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:52.837181 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-f8a5808b-fcb5-47bf-a472-7a99ee4a1913 req-d0959192-eaf5-4622-b103-d95dff6edd37 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:52.842142 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:49:52.842940 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-03c6862d-8ad4-42a0-b3d3-b40599e5e473 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:49:52.856085 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-03c6862d-8ad4-42a0-b3d3-b40599e5e473 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:49:52.858258 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-03c6862d-8ad4-42a0-b3d3-b40599e5e473 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:49:52.859741 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-03c6862d-8ad4-42a0-b3d3-b40599e5e473 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] 10.222.0.43 "GET /compute/v2.1/servers/d4abcd04-329d-40a8-8d6e-4383bef437ae" status: 200 len: 1814 microversion: 2.25 time: 0.379506 Oct 04 21:49:52.861024 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 828/1714] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:49:52 2022] GET /compute/v2.1/servers/d4abcd04-329d-40a8-8d6e-4383bef437ae => generated 1814 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:49:52.879200 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-f8a5808b-fcb5-47bf-a472-7a99ee4a1913 req-d0959192-eaf5-4622-b103-d95dff6edd37 service nova] Creating event network-changed:c36556e1-4c6d-4308-8210-aa45c17cd2d1 for instance fdc82b91-5dfa-44cf-b8c5-402922265d88 on n-h2-860284-1 Oct 04 21:49:52.879479 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-6eb8776f-bcc0-4674-bc7e-50d7d3905205 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.1.111"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:49:52.881860 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-6eb8776f-bcc0-4674-bc7e-50d7d3905205 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] [instance: 69b35751-ffe5-4447-8c07-8db18ae96e9d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:49:52.889102 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-f8a5808b-fcb5-47bf-a472-7a99ee4a1913 req-d0959192-eaf5-4622-b103-d95dff6edd37 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093117 Oct 04 21:49:52.889745 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 887/1715] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:49:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:49:52.902280 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6eb8776f-bcc0-4674-bc7e-50d7d3905205 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:52.902858 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6eb8776f-bcc0-4674-bc7e-50d7d3905205 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:52.903308 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6eb8776f-bcc0-4674-bc7e-50d7d3905205 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:52.904050 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6eb8776f-bcc0-4674-bc7e-50d7d3905205 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:52.906183 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-1d5c98f0-edd9-4859-b742-696f01bde94a tempest-ImagesMetadataTestJSON-1000283254 tempest-ImagesMetadataTestJSON-1000283254-project] Action: 'update_all', calling method: .version_select at 0x7fbb2f869af0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:49:52.907055 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6eb8776f-bcc0-4674-bc7e-50d7d3905205 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:52.907517 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6eb8776f-bcc0-4674-bc7e-50d7d3905205 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:52.967452 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6eb8776f-bcc0-4674-bc7e-50d7d3905205 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Acquiring lock "refresh_cache-69b35751-ffe5-4447-8c07-8db18ae96e9d" {{(pid=134101) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 04 21:49:52.967867 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6eb8776f-bcc0-4674-bc7e-50d7d3905205 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Acquired lock "refresh_cache-69b35751-ffe5-4447-8c07-8db18ae96e9d" {{(pid=134101) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 04 21:49:53.019697 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-1d5c98f0-edd9-4859-b742-696f01bde94a tempest-ImagesMetadataTestJSON-1000283254 tempest-ImagesMetadataTestJSON-1000283254-project] Getting quotas for project ed830eec825e4c6fb45a4063e9b24b15. Resources: dict_keys(['metadata_items']) {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:49:53.038255 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-1d5c98f0-edd9-4859-b742-696f01bde94a tempest-ImagesMetadataTestJSON-1000283254 tempest-ImagesMetadataTestJSON-1000283254-project] Getting quotas for user e5264d8a9dc647f489a7fc930597e0b2 and project ed830eec825e4c6fb45a4063e9b24b15. Resources: dict_keys(['metadata_items']) {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:49:53.354023 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-1d5c98f0-edd9-4859-b742-696f01bde94a tempest-ImagesMetadataTestJSON-1000283254 tempest-ImagesMetadataTestJSON-1000283254-project] 10.222.0.43 "PUT /compute/v2.1/images/716dc685-bb05-4bba-9a60-122d1fad21d5/metadata" status: 200 len: 61 microversion: 2.1 time: 0.460882 Oct 04 21:49:53.365000 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 888/1716] 10.222.0.43 () {60 vars in 1280 bytes} [Tue Oct 4 21:49:52 2022] PUT /compute/v2.1/images/716dc685-bb05-4bba-9a60-122d1fad21d5/metadata => generated 61 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 21:49:53.371077 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-f34a0cd1-3aec-4909-ad53-2a35c60f1636 tempest-FloatingIPDetailsTestJSON-650903168 tempest-FloatingIPDetailsTestJSON-650903168-project] Calling method '.version_select at 0x7fbb2f869d30>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:49:54.287935 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-f34a0cd1-3aec-4909-ad53-2a35c60f1636 tempest-FloatingIPDetailsTestJSON-650903168 tempest-FloatingIPDetailsTestJSON-650903168-project] 10.222.0.43 "GET /compute/v2.1/os-floating-ips/7afb48de-fe0b-45c5-954c-36b11288dfe8" status: 200 len: 142 microversion: 2.1 time: 0.930186 Oct 04 21:49:54.288944 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 889/1717] 10.222.0.43 () {58 vars in 1260 bytes} [Tue Oct 4 21:49:53 2022] GET /compute/v2.1/os-floating-ips/7afb48de-fe0b-45c5-954c-36b11288dfe8 => generated 142 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:49:54.293841 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-f574d64f-51e9-4520-ac31-bf514e5ef11a tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-860284-1", "block_migration": true, "disk_over_commit": false}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:49:54.309417 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-f574d64f-51e9-4520-ac31-bf514e5ef11a tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] [instance: 3f0a02bc-7993-4849-8b3c-7572327b4799] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:49:54.329298 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f574d64f-51e9-4520-ac31-bf514e5ef11a tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:54.333412 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f574d64f-51e9-4520-ac31-bf514e5ef11a tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:54.334966 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f574d64f-51e9-4520-ac31-bf514e5ef11a tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:54.335925 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f574d64f-51e9-4520-ac31-bf514e5ef11a tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:54.336569 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f574d64f-51e9-4520-ac31-bf514e5ef11a tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:54.337167 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f574d64f-51e9-4520-ac31-bf514e5ef11a tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:54.502686 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.objects.instance [None req-f574d64f-51e9-4520-ac31-bf514e5ef11a tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Lazy-loading 'flavor' on Instance uuid 3f0a02bc-7993-4849-8b3c-7572327b4799 {{(pid=134102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:49:54.530203 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-f574d64f-51e9-4520-ac31-bf514e5ef11a tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] [instance: 3f0a02bc-7993-4849-8b3c-7572327b4799] Going to try to live migrate instance to n-h2-860284-1 {{(pid=134102) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 04 21:49:55.399877 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell0:SELECT=2 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:49:57.429890 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-f574d64f-51e9-4520-ac31-bf514e5ef11a tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] 10.222.0.43 "POST /compute/v2.1/servers/3f0a02bc-7993-4849-8b3c-7572327b4799/action" status: 202 len: 0 microversion: 2.1 time: 3.139689 Oct 04 21:49:57.431818 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 890/1718] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 21:49:54 2022] POST /compute/v2.1/servers/3f0a02bc-7993-4849-8b3c-7572327b4799/action => generated 0 bytes in 3142 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:49:57.436878 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-d2f16e7f-821b-44ef-96d7-d1d54fbabbc3 tempest-ImagesNegativeTestJSON-71193266 tempest-ImagesNegativeTestJSON-71193266-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:49:57.437745 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-d2f16e7f-821b-44ef-96d7-d1d54fbabbc3 tempest-ImagesNegativeTestJSON-71193266 tempest-ImagesNegativeTestJSON-71193266-project] [instance: 18c556c5-0b7d-4acb-9803-a504ab597fbb] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:49:57.446559 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d2f16e7f-821b-44ef-96d7-d1d54fbabbc3 tempest-ImagesNegativeTestJSON-71193266 tempest-ImagesNegativeTestJSON-71193266-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:57.447604 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d2f16e7f-821b-44ef-96d7-d1d54fbabbc3 tempest-ImagesNegativeTestJSON-71193266 tempest-ImagesNegativeTestJSON-71193266-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:57.448197 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d2f16e7f-821b-44ef-96d7-d1d54fbabbc3 tempest-ImagesNegativeTestJSON-71193266 tempest-ImagesNegativeTestJSON-71193266-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:57.449238 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d2f16e7f-821b-44ef-96d7-d1d54fbabbc3 tempest-ImagesNegativeTestJSON-71193266 tempest-ImagesNegativeTestJSON-71193266-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:57.449963 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d2f16e7f-821b-44ef-96d7-d1d54fbabbc3 tempest-ImagesNegativeTestJSON-71193266 tempest-ImagesNegativeTestJSON-71193266-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:57.450598 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d2f16e7f-821b-44ef-96d7-d1d54fbabbc3 tempest-ImagesNegativeTestJSON-71193266 tempest-ImagesNegativeTestJSON-71193266-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:57.817000 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-d2f16e7f-821b-44ef-96d7-d1d54fbabbc3 tempest-ImagesNegativeTestJSON-71193266 tempest-ImagesNegativeTestJSON-71193266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd9fbc0c71d4e14b353a571dd257a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6559674f0b84e97948cd4286269507a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:49:57.825528 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-d2f16e7f-821b-44ef-96d7-d1d54fbabbc3 tempest-ImagesNegativeTestJSON-71193266 tempest-ImagesNegativeTestJSON-71193266-project] 10.222.0.43 "GET /compute/v2.1/servers/18c556c5-0b7d-4acb-9803-a504ab597fbb" status: 200 len: 1316 microversion: 2.1 time: 0.392440 Oct 04 21:49:57.830920 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 891/1719] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:49:57 2022] GET /compute/v2.1/servers/18c556c5-0b7d-4acb-9803-a504ab597fbb => generated 1316 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:49:57.839696 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-c9b094ae-5dd9-498e-8511-a6cf5b7a2d78 tempest-ImagesMetadataTestJSON-1000283254 tempest-ImagesMetadataTestJSON-1000283254-project] Calling method '.version_select at 0x7fbb2f0b7280>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:49:57.911436 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-c9b094ae-5dd9-498e-8511-a6cf5b7a2d78 tempest-ImagesMetadataTestJSON-1000283254 tempest-ImagesMetadataTestJSON-1000283254-project] 10.222.0.43 "GET /compute/v2.1/images/716dc685-bb05-4bba-9a60-122d1fad21d5/metadata" status: 200 len: 61 microversion: 2.1 time: 0.078704 Oct 04 21:49:57.912342 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 892/1720] 10.222.0.43 () {58 vars in 1260 bytes} [Tue Oct 4 21:49:57 2022] GET /compute/v2.1/images/716dc685-bb05-4bba-9a60-122d1fad21d5/metadata => generated 61 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 21:49:57.918650 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-c1168dee-2c44-48cd-8fc8-21c089ff54fe tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:49:57.923255 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-c1168dee-2c44-48cd-8fc8-21c089ff54fe tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] [instance: d4abcd04-329d-40a8-8d6e-4383bef437ae] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:49:57.943236 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c1168dee-2c44-48cd-8fc8-21c089ff54fe tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:57.944127 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c1168dee-2c44-48cd-8fc8-21c089ff54fe tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:57.944931 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c1168dee-2c44-48cd-8fc8-21c089ff54fe tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:57.945875 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c1168dee-2c44-48cd-8fc8-21c089ff54fe tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:57.946925 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c1168dee-2c44-48cd-8fc8-21c089ff54fe tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:57.947546 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c1168dee-2c44-48cd-8fc8-21c089ff54fe tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:58.271700 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-c1168dee-2c44-48cd-8fc8-21c089ff54fe tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:49:58.288246 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-c1168dee-2c44-48cd-8fc8-21c089ff54fe tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:49:58.289725 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-c1168dee-2c44-48cd-8fc8-21c089ff54fe tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:49:58.291005 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-c1168dee-2c44-48cd-8fc8-21c089ff54fe tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] 10.222.0.43 "GET /compute/v2.1/servers/d4abcd04-329d-40a8-8d6e-4383bef437ae" status: 200 len: 1814 microversion: 2.25 time: 0.377323 Oct 04 21:49:58.302512 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 893/1721] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:49:57 2022] GET /compute/v2.1/servers/d4abcd04-329d-40a8-8d6e-4383bef437ae => generated 1814 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:49:58.307282 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-455d8f56-0e40-4207-9816-a31148f3767d tempest-FloatingIPDetailsTestJSON-650903168 tempest-FloatingIPDetailsTestJSON-650903168-project] Calling method '.version_select at 0x7fbb2f865ca0>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:49:58.426646 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.network.neutron [None req-6eb8776f-bcc0-4674-bc7e-50d7d3905205 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] [instance: 69b35751-ffe5-4447-8c07-8db18ae96e9d] re-assign floating IP 172.25.1.111 from instance fdc82b91-5dfa-44cf-b8c5-402922265d88 Oct 04 21:49:58.551068 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.network.neutron [None req-6eb8776f-bcc0-4674-bc7e-50d7d3905205 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] [instance: fdc82b91-5dfa-44cf-b8c5-402922265d88] Building network info cache for instance {{(pid=134101) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 04 21:49:59.872064 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.network.neutron [None req-6eb8776f-bcc0-4674-bc7e-50d7d3905205 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] [instance: fdc82b91-5dfa-44cf-b8c5-402922265d88] Updating instance_info_cache with network_info: [{"id": "c36556e1-4c6d-4308-8210-aa45c17cd2d1", "address": "fa:16:3e:30:86:84", "network": {"id": "e4c13216-4fea-4d87-aa16-a7572859740d", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1638687548-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "758fcafb5db74075b183978a97b7c4ee", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapc36556e1-4c", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=134101) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 04 21:49:59.895939 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.network.neutron [None req-6eb8776f-bcc0-4674-bc7e-50d7d3905205 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] [instance: 69b35751-ffe5-4447-8c07-8db18ae96e9d] Building network info cache for instance {{(pid=134101) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 04 21:50:00.002097 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-455d8f56-0e40-4207-9816-a31148f3767d tempest-FloatingIPDetailsTestJSON-650903168 tempest-FloatingIPDetailsTestJSON-650903168-project] 10.222.0.43 "DELETE /compute/v2.1/os-floating-ips/7afb48de-fe0b-45c5-954c-36b11288dfe8" status: 202 len: 0 microversion: 2.1 time: 1.708597 Oct 04 21:50:00.004323 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 894/1722] 10.222.0.43 () {58 vars in 1263 bytes} [Tue Oct 4 21:49:58 2022] DELETE /compute/v2.1/os-floating-ips/7afb48de-fe0b-45c5-954c-36b11288dfe8 => generated 0 bytes in 1712 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:50:00.015251 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-dbfcb1b9-8d49-4a5f-af87-b0a570e216e4 req-eca170ff-ffae-4d2e-b644-be833513b6d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18c556c5-0b7d-4acb-9803-a504ab597fbb", "tag": "dbb43da1-fb74-4dcb-8680-218d158e3dcc"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:50:00.041149 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-dbfcb1b9-8d49-4a5f-af87-b0a570e216e4 req-eca170ff-ffae-4d2e-b644-be833513b6d9 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:00.041397 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-dbfcb1b9-8d49-4a5f-af87-b0a570e216e4 req-eca170ff-ffae-4d2e-b644-be833513b6d9 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:00.046649 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-dbfcb1b9-8d49-4a5f-af87-b0a570e216e4 req-eca170ff-ffae-4d2e-b644-be833513b6d9 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:00.073928 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-dbfcb1b9-8d49-4a5f-af87-b0a570e216e4 req-eca170ff-ffae-4d2e-b644-be833513b6d9 service nova] Creating event network-changed:dbb43da1-fb74-4dcb-8680-218d158e3dcc for instance 18c556c5-0b7d-4acb-9803-a504ab597fbb on n-h1-860284-1 Oct 04 21:50:00.084542 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-dbfcb1b9-8d49-4a5f-af87-b0a570e216e4 req-eca170ff-ffae-4d2e-b644-be833513b6d9 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078242 Oct 04 21:50:00.098741 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 895/1723] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:50:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:50:00.116016 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-90d5c246-3b2e-42c3-a988-4b652df90190 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:50:00.119765 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-90d5c246-3b2e-42c3-a988-4b652df90190 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 3f0a02bc-7993-4849-8b3c-7572327b4799] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:50:00.137633 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-90d5c246-3b2e-42c3-a988-4b652df90190 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:00.138143 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-90d5c246-3b2e-42c3-a988-4b652df90190 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:00.138628 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-90d5c246-3b2e-42c3-a988-4b652df90190 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:00.145718 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-90d5c246-3b2e-42c3-a988-4b652df90190 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:00.146530 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-90d5c246-3b2e-42c3-a988-4b652df90190 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:00.147957 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-90d5c246-3b2e-42c3-a988-4b652df90190 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:00.605658 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-90d5c246-3b2e-42c3-a988-4b652df90190 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ad048becf474fb972d4291422d810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dcfc7024fc49388c4bd5f25f03e60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:00.623965 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-90d5c246-3b2e-42c3-a988-4b652df90190 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/3f0a02bc-7993-4849-8b3c-7572327b4799" status: 200 len: 1716 microversion: 2.1 time: 0.515244 Oct 04 21:50:00.625130 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 896/1724] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:50:00 2022] GET /compute/v2.1/servers/3f0a02bc-7993-4849-8b3c-7572327b4799 => generated 1716 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:50:00.633670 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-34198cd2-c1cd-444c-a2f2-b5a529043020 tempest-ImagesMetadataTestJSON-1000283254 tempest-ImagesMetadataTestJSON-1000283254-project] Action: 'update_all', calling method: .version_select at 0x7fbb2f566040>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:50:00.747533 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-34198cd2-c1cd-444c-a2f2-b5a529043020 tempest-ImagesMetadataTestJSON-1000283254 tempest-ImagesMetadataTestJSON-1000283254-project] Getting quotas for project ed830eec825e4c6fb45a4063e9b24b15. Resources: dict_keys(['metadata_items']) {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:50:00.775221 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-34198cd2-c1cd-444c-a2f2-b5a529043020 tempest-ImagesMetadataTestJSON-1000283254 tempest-ImagesMetadataTestJSON-1000283254-project] Getting quotas for user e5264d8a9dc647f489a7fc930597e0b2 and project ed830eec825e4c6fb45a4063e9b24b15. Resources: dict_keys(['metadata_items']) {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:50:01.137594 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-34198cd2-c1cd-444c-a2f2-b5a529043020 tempest-ImagesMetadataTestJSON-1000283254 tempest-ImagesMetadataTestJSON-1000283254-project] 10.222.0.43 "PUT /compute/v2.1/images/716dc685-bb05-4bba-9a60-122d1fad21d5/metadata" status: 200 len: 61 microversion: 2.1 time: 0.511084 Oct 04 21:50:01.138830 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 897/1725] 10.222.0.43 () {60 vars in 1280 bytes} [Tue Oct 4 21:50:00 2022] PUT /compute/v2.1/images/716dc685-bb05-4bba-9a60-122d1fad21d5/metadata => generated 61 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 21:50:01.147440 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-256a49a6-e7a9-4acb-a9f0-1c51d11c885a req-6075058f-33b7-4024-93fa-19e6fa9353bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fdc82b91-5dfa-44cf-b8c5-402922265d88", "tag": "c36556e1-4c6d-4308-8210-aa45c17cd2d1"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:50:01.161489 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-256a49a6-e7a9-4acb-a9f0-1c51d11c885a req-6075058f-33b7-4024-93fa-19e6fa9353bc service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:01.161997 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-256a49a6-e7a9-4acb-a9f0-1c51d11c885a req-6075058f-33b7-4024-93fa-19e6fa9353bc service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:01.165705 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-256a49a6-e7a9-4acb-a9f0-1c51d11c885a req-6075058f-33b7-4024-93fa-19e6fa9353bc service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:01.197743 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-256a49a6-e7a9-4acb-a9f0-1c51d11c885a req-6075058f-33b7-4024-93fa-19e6fa9353bc service nova] Creating event network-changed:c36556e1-4c6d-4308-8210-aa45c17cd2d1 for instance fdc82b91-5dfa-44cf-b8c5-402922265d88 on n-h2-860284-1 Oct 04 21:50:01.208340 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-256a49a6-e7a9-4acb-a9f0-1c51d11c885a req-6075058f-33b7-4024-93fa-19e6fa9353bc service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068448 Oct 04 21:50:01.212228 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 898/1726] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:50:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:50:01.218826 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-e26fee8d-6352-4ca5-8fb1-85202931caff req-1d54cba7-377b-4092-98b1-a78ffd99eedc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18c556c5-0b7d-4acb-9803-a504ab597fbb", "name": "network-vif-plugged", "status": "completed", "tag": "dbb43da1-fb74-4dcb-8680-218d158e3dcc"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:50:01.229494 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:50:01.232180 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-e26fee8d-6352-4ca5-8fb1-85202931caff req-1d54cba7-377b-4092-98b1-a78ffd99eedc service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:01.232908 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-e26fee8d-6352-4ca5-8fb1-85202931caff req-1d54cba7-377b-4092-98b1-a78ffd99eedc service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:01.233900 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-e26fee8d-6352-4ca5-8fb1-85202931caff req-1d54cba7-377b-4092-98b1-a78ffd99eedc service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:01.256958 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-e26fee8d-6352-4ca5-8fb1-85202931caff req-1d54cba7-377b-4092-98b1-a78ffd99eedc service nova] Creating event network-vif-plugged:dbb43da1-fb74-4dcb-8680-218d158e3dcc for instance 18c556c5-0b7d-4acb-9803-a504ab597fbb on n-h1-860284-1 Oct 04 21:50:01.264274 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-e26fee8d-6352-4ca5-8fb1-85202931caff req-1d54cba7-377b-4092-98b1-a78ffd99eedc service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049958 Oct 04 21:50:01.265593 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 899/1727] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:50:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:50:01.272394 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-9a971a68-9444-410c-a20a-74dd4698ca99 tempest-ImagesNegativeTestJSON-71193266 tempest-ImagesNegativeTestJSON-71193266-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:50:01.273397 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-9a971a68-9444-410c-a20a-74dd4698ca99 tempest-ImagesNegativeTestJSON-71193266 tempest-ImagesNegativeTestJSON-71193266-project] [instance: 18c556c5-0b7d-4acb-9803-a504ab597fbb] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:50:01.281527 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9a971a68-9444-410c-a20a-74dd4698ca99 tempest-ImagesNegativeTestJSON-71193266 tempest-ImagesNegativeTestJSON-71193266-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:01.282339 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9a971a68-9444-410c-a20a-74dd4698ca99 tempest-ImagesNegativeTestJSON-71193266 tempest-ImagesNegativeTestJSON-71193266-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:01.282991 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9a971a68-9444-410c-a20a-74dd4698ca99 tempest-ImagesNegativeTestJSON-71193266 tempest-ImagesNegativeTestJSON-71193266-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:01.283924 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9a971a68-9444-410c-a20a-74dd4698ca99 tempest-ImagesNegativeTestJSON-71193266 tempest-ImagesNegativeTestJSON-71193266-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:01.285123 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9a971a68-9444-410c-a20a-74dd4698ca99 tempest-ImagesNegativeTestJSON-71193266 tempest-ImagesNegativeTestJSON-71193266-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:01.285734 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9a971a68-9444-410c-a20a-74dd4698ca99 tempest-ImagesNegativeTestJSON-71193266 tempest-ImagesNegativeTestJSON-71193266-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:01.364392 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.network.neutron [None req-6eb8776f-bcc0-4674-bc7e-50d7d3905205 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] [instance: 69b35751-ffe5-4447-8c07-8db18ae96e9d] Updating instance_info_cache with network_info: [{"id": "e2331ba4-826a-40cf-853f-720873f465a1", "address": "fa:16:3e:ef:d7:68", "network": {"id": "e4c13216-4fea-4d87-aa16-a7572859740d", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1638687548-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.1.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "758fcafb5db74075b183978a97b7c4ee", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tape2331ba4-82", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=134101) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 04 21:50:01.389102 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6eb8776f-bcc0-4674-bc7e-50d7d3905205 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Releasing lock "refresh_cache-69b35751-ffe5-4447-8c07-8db18ae96e9d" {{(pid=134101) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 04 21:50:01.395955 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-6eb8776f-bcc0-4674-bc7e-50d7d3905205 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] 10.222.0.43 "POST /compute/v2.1/servers/69b35751-ffe5-4447-8c07-8db18ae96e9d/action" status: 202 len: 0 microversion: 2.1 time: 8.533759 Oct 04 21:50:01.397482 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 829/1728] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 21:49:52 2022] POST /compute/v2.1/servers/69b35751-ffe5-4447-8c07-8db18ae96e9d/action => generated 0 bytes in 8536 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 04 21:50:01.404092 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-40662886-9c70-46f9-9ef4-4795088532dc tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:50:01.405346 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-40662886-9c70-46f9-9ef4-4795088532dc tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] [instance: d4abcd04-329d-40a8-8d6e-4383bef437ae] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:50:01.416483 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=2 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:50:01.436185 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-40662886-9c70-46f9-9ef4-4795088532dc tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:01.436846 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-40662886-9c70-46f9-9ef4-4795088532dc tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:01.437401 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-40662886-9c70-46f9-9ef4-4795088532dc tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:01.442951 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-40662886-9c70-46f9-9ef4-4795088532dc tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:01.443476 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-40662886-9c70-46f9-9ef4-4795088532dc tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:01.444168 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-40662886-9c70-46f9-9ef4-4795088532dc tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:01.647349 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-9a971a68-9444-410c-a20a-74dd4698ca99 tempest-ImagesNegativeTestJSON-71193266 tempest-ImagesNegativeTestJSON-71193266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd9fbc0c71d4e14b353a571dd257a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6559674f0b84e97948cd4286269507a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:01.661109 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-9a971a68-9444-410c-a20a-74dd4698ca99 tempest-ImagesNegativeTestJSON-71193266 tempest-ImagesNegativeTestJSON-71193266-project] 10.222.0.43 "GET /compute/v2.1/servers/18c556c5-0b7d-4acb-9803-a504ab597fbb" status: 200 len: 1316 microversion: 2.1 time: 0.393721 Oct 04 21:50:01.661883 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 900/1729] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:50:01 2022] GET /compute/v2.1/servers/18c556c5-0b7d-4acb-9803-a504ab597fbb => generated 1316 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:50:01.675856 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-90335b58-874e-4aa4-b3d8-5ef542b8947e tempest-FloatingIPDetailsTestJSON-650903168 tempest-FloatingIPDetailsTestJSON-650903168-project] Calling method '.version_select at 0x7fbb2f142280>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:50:01.839568 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-40662886-9c70-46f9-9ef4-4795088532dc tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:01.850215 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-40662886-9c70-46f9-9ef4-4795088532dc tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:01.851795 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-40662886-9c70-46f9-9ef4-4795088532dc tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:01.853076 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-40662886-9c70-46f9-9ef4-4795088532dc tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] 10.222.0.43 "GET /compute/v2.1/servers/d4abcd04-329d-40a8-8d6e-4383bef437ae" status: 200 len: 1814 microversion: 2.25 time: 0.454412 Oct 04 21:50:01.865150 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 830/1730] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:50:01 2022] GET /compute/v2.1/servers/d4abcd04-329d-40a8-8d6e-4383bef437ae => generated 1814 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:50:01.897285 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-a3e7bc1a-8a62-4569-bae6-60be3ce6fa28 tempest-ImagesMetadataTestJSON-1000283254 tempest-ImagesMetadataTestJSON-1000283254-project] Action: 'update_all', calling method: .version_select at 0x7fbb373739d0>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:50:01.976441 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-a3e7bc1a-8a62-4569-bae6-60be3ce6fa28 tempest-ImagesMetadataTestJSON-1000283254 tempest-ImagesMetadataTestJSON-1000283254-project] Getting quotas for project ed830eec825e4c6fb45a4063e9b24b15. Resources: dict_keys(['metadata_items']) {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:50:01.985389 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-a3e7bc1a-8a62-4569-bae6-60be3ce6fa28 tempest-ImagesMetadataTestJSON-1000283254 tempest-ImagesMetadataTestJSON-1000283254-project] Getting quotas for user e5264d8a9dc647f489a7fc930597e0b2 and project ed830eec825e4c6fb45a4063e9b24b15. Resources: dict_keys(['metadata_items']) {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:50:02.644586 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-a3e7bc1a-8a62-4569-bae6-60be3ce6fa28 tempest-ImagesMetadataTestJSON-1000283254 tempest-ImagesMetadataTestJSON-1000283254-project] 10.222.0.43 "PUT /compute/v2.1/images/716dc685-bb05-4bba-9a60-122d1fad21d5/metadata" status: 200 len: 64 microversion: 2.1 time: 0.762288 Oct 04 21:50:02.644586 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 831/1731] 10.222.0.43 () {60 vars in 1280 bytes} [Tue Oct 4 21:50:01 2022] PUT /compute/v2.1/images/716dc685-bb05-4bba-9a60-122d1fad21d5/metadata => generated 64 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 21:50:02.655856 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-6cd60a9c-d32c-4a7f-91fa-8971838bb291 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Action: 'action', calling method: .version_select at 0x7fbb34da1820>, body: {"removeFloatingIp": {"address": "172.25.1.111"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:50:03.011606 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-90335b58-874e-4aa4-b3d8-5ef542b8947e tempest-FloatingIPDetailsTestJSON-650903168 tempest-FloatingIPDetailsTestJSON-650903168-project] 10.222.0.43 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 1.342091 Oct 04 21:50:03.013359 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 901/1732] 10.222.0.43 () {58 vars in 1164 bytes} [Tue Oct 4 21:50:01 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 1351 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 21:50:03.032108 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-0eaebe7b-67b8-4c11-af3f-a18c8aa5426f tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:50:03.033481 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-0eaebe7b-67b8-4c11-af3f-a18c8aa5426f tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 3f0a02bc-7993-4849-8b3c-7572327b4799] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:50:03.046742 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0eaebe7b-67b8-4c11-af3f-a18c8aa5426f tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:03.062051 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0eaebe7b-67b8-4c11-af3f-a18c8aa5426f tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:03.066194 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0eaebe7b-67b8-4c11-af3f-a18c8aa5426f tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:03.067928 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0eaebe7b-67b8-4c11-af3f-a18c8aa5426f tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:03.068761 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0eaebe7b-67b8-4c11-af3f-a18c8aa5426f tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:03.069548 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0eaebe7b-67b8-4c11-af3f-a18c8aa5426f tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:03.185663 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-6cd60a9c-d32c-4a7f-91fa-8971838bb291 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] [instance: 69b35751-ffe5-4447-8c07-8db18ae96e9d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:50:03.196969 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6cd60a9c-d32c-4a7f-91fa-8971838bb291 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:03.197489 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6cd60a9c-d32c-4a7f-91fa-8971838bb291 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:03.197947 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6cd60a9c-d32c-4a7f-91fa-8971838bb291 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:03.200149 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6cd60a9c-d32c-4a7f-91fa-8971838bb291 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:03.202496 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6cd60a9c-d32c-4a7f-91fa-8971838bb291 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:03.202995 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6cd60a9c-d32c-4a7f-91fa-8971838bb291 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:03.649248 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-0eaebe7b-67b8-4c11-af3f-a18c8aa5426f tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ad048becf474fb972d4291422d810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dcfc7024fc49388c4bd5f25f03e60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:03.666334 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-0eaebe7b-67b8-4c11-af3f-a18c8aa5426f tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/3f0a02bc-7993-4849-8b3c-7572327b4799" status: 200 len: 1716 microversion: 2.1 time: 0.649411 Oct 04 21:50:03.667540 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 902/1733] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:50:03 2022] GET /compute/v2.1/servers/3f0a02bc-7993-4849-8b3c-7572327b4799 => generated 1716 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:50:03.672625 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-8d5300ed-4979-4088-a66d-f4dfe2bd043c tempest-ImagesMetadataTestJSON-1000283254 tempest-ImagesMetadataTestJSON-1000283254-project] Calling method '.version_select at 0x7fbb2f50e1f0>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:50:03.703366 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-6cd60a9c-d32c-4a7f-91fa-8971838bb291 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] HTTP exception thrown: Floating IP 172.25.1.111 is not associated with instance fdc82b91-5dfa-44cf-b8c5-402922265d88. Oct 04 21:50:03.706200 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-6cd60a9c-d32c-4a7f-91fa-8971838bb291 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Request method failure captured: Oct 04 21:50:03.706200 n-d-860284-1 devstack@n-api.service[134101]: request: POST /compute/v2.1/servers/fdc82b91-5dfa-44cf-b8c5-402922265d88/action HTTP/1.1 Oct 04 21:50:03.706200 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 21:50:03.706200 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 21:50:03.706200 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 21:50:03.706200 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 49 Oct 04 21:50:03.706200 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 21:50:03.706200 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 21:50:03.706200 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 21:50:03.706200 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 21:50:03.706200 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPKo-ln9523hGjik6efbNIsBZPXFxTLqGBuFcWCKjxuW1p1evQNKO_Uyff6cDRYbZa6WI6XvxbfG3eUM6j7dp79zYbjcyduRTyVhI8BgLq8de552QDbCx15COQpRJimlMG4NhjchhlltTp5_5UxkZkLafVbBjmnPUJzBfVZabhSWYBEs Oct 04 21:50:03.706200 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 21:50:03.706200 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 21:50:03.706200 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 21:50:03.706200 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 21:50:03.706200 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 21:50:03.706200 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 21:50:03.706200 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: 758fcafb5db74075b183978a97b7c4ee Oct 04 21:50:03.706200 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-87315922 Oct 04 21:50:03.706200 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 21:50:03.706200 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 21:50:03.706200 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/758fcafb5db74075b183978a97b7c4ee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_758fcafb5db74075b183978a97b7c4ee", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/758fcafb5db74075b183978a97b7c4ee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/758fcafb5db74075b183978a97b7c4ee"}]}] Oct 04 21:50:03.706200 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-87315922 Oct 04 21:50:03.706200 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: 758fcafb5db74075b183978a97b7c4ee Oct 04 21:50:03.706200 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-87315922 Oct 04 21:50:03.706200 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-FloatingIPsAssociationTestJSON-87315922-project Oct 04 21:50:03.706200 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 21:50:03.706200 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 21:50:03.706200 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 56d66a6a9c5c4c57ba0d25a37323f37f Oct 04 21:50:03.706200 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-87315922-project Oct 04 21:50:03.706200 n-d-860284-1 devstack@n-api.service[134101]: Oct 04 21:50:03.706200 n-d-860284-1 devstack@n-api.service[134101]: {"removeFloatingIp": {"address": "172.25.1.111"}} Oct 04 21:50:03.706200 n-d-860284-1 devstack@n-api.service[134101]: method: Oct 04 21:50:03.706200 n-d-860284-1 devstack@n-api.service[134101]: exception: Floating IP 172.25.1.111 is not associated with instance fdc82b91-5dfa-44cf-b8c5-402922265d88. Oct 04 21:50:03.706200 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': 'fdc82b91-5dfa-44cf-b8c5-402922265d88', 'body': {'removeFloatingIp': {'address': '172.25.1.111'}}} Oct 04 21:50:03.706200 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:50:03.706200 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:50:03.706200 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:50:03.706200 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:50:03.706200 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:50:03.706200 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:50:03.706200 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:50:03.706200 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:50:03.706200 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:50:03.706200 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:50:03.706200 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:50:03.706200 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:50:03.706200 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 300, in _remove_floating_ip Oct 04 21:50:03.706200 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 21:50:03.706200 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Floating IP 172.25.1.111 is not associated with instance fdc82b91-5dfa-44cf-b8c5-402922265d88. Oct 04 21:50:03.706200 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:50:03.706200 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:50:03.706200 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:50:03.706200 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:50:03.706200 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:50:03.706200 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:50:03.706200 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:50:03.706200 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:50:03.706200 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP 172.25.1.111 is not associated with instance fdc82b91-5dfa-44cf-b8c5-402922265d88. Oct 04 21:50:03.706200 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:50:03.714503 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-6cd60a9c-d32c-4a7f-91fa-8971838bb291 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Returning 409 to user: Floating IP 172.25.1.111 is not associated with instance fdc82b91-5dfa-44cf-b8c5-402922265d88. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:50:03.715780 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-6cd60a9c-d32c-4a7f-91fa-8971838bb291 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] 10.222.0.43 "POST /compute/v2.1/servers/fdc82b91-5dfa-44cf-b8c5-402922265d88/action" status: 409 len: 146 microversion: 2.1 time: 1.065418 Oct 04 21:50:03.716654 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 832/1734] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 21:50:02 2022] POST /compute/v2.1/servers/fdc82b91-5dfa-44cf-b8c5-402922265d88/action => generated 146 bytes in 1072 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 21:50:03.725896 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-b70ce471-7b0d-4cb4-bb3f-22df30914481 tempest-ImagesNegativeTestJSON-71193266 tempest-ImagesNegativeTestJSON-71193266-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:50:03.727398 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-b70ce471-7b0d-4cb4-bb3f-22df30914481 tempest-ImagesNegativeTestJSON-71193266 tempest-ImagesNegativeTestJSON-71193266-project] [instance: 18c556c5-0b7d-4acb-9803-a504ab597fbb] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:50:03.759972 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-8d5300ed-4979-4088-a66d-f4dfe2bd043c tempest-ImagesMetadataTestJSON-1000283254 tempest-ImagesMetadataTestJSON-1000283254-project] 10.222.0.43 "GET /compute/v2.1/images/716dc685-bb05-4bba-9a60-122d1fad21d5/metadata" status: 200 len: 64 microversion: 2.1 time: 0.091242 Oct 04 21:50:03.762958 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 903/1735] 10.222.0.43 () {58 vars in 1260 bytes} [Tue Oct 4 21:50:03 2022] GET /compute/v2.1/images/716dc685-bb05-4bba-9a60-122d1fad21d5/metadata => generated 64 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 21:50:03.770399 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b70ce471-7b0d-4cb4-bb3f-22df30914481 tempest-ImagesNegativeTestJSON-71193266 tempest-ImagesNegativeTestJSON-71193266-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:03.772337 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b70ce471-7b0d-4cb4-bb3f-22df30914481 tempest-ImagesNegativeTestJSON-71193266 tempest-ImagesNegativeTestJSON-71193266-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:03.775566 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b70ce471-7b0d-4cb4-bb3f-22df30914481 tempest-ImagesNegativeTestJSON-71193266 tempest-ImagesNegativeTestJSON-71193266-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:03.777232 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b70ce471-7b0d-4cb4-bb3f-22df30914481 tempest-ImagesNegativeTestJSON-71193266 tempest-ImagesNegativeTestJSON-71193266-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:03.778110 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-ebebce36-2792-4d8a-82d0-94c2e599bd9f tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:50:03.778780 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b70ce471-7b0d-4cb4-bb3f-22df30914481 tempest-ImagesNegativeTestJSON-71193266 tempest-ImagesNegativeTestJSON-71193266-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:03.779754 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b70ce471-7b0d-4cb4-bb3f-22df30914481 tempest-ImagesNegativeTestJSON-71193266 tempest-ImagesNegativeTestJSON-71193266-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:03.780123 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-ebebce36-2792-4d8a-82d0-94c2e599bd9f tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] [instance: d4abcd04-329d-40a8-8d6e-4383bef437ae] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:50:03.797850 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ebebce36-2792-4d8a-82d0-94c2e599bd9f tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:03.803904 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ebebce36-2792-4d8a-82d0-94c2e599bd9f tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:03.804595 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ebebce36-2792-4d8a-82d0-94c2e599bd9f tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:03.806160 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ebebce36-2792-4d8a-82d0-94c2e599bd9f tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:03.806773 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ebebce36-2792-4d8a-82d0-94c2e599bd9f tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:03.807285 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ebebce36-2792-4d8a-82d0-94c2e599bd9f tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:04.127484 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-b70ce471-7b0d-4cb4-bb3f-22df30914481 tempest-ImagesNegativeTestJSON-71193266 tempest-ImagesNegativeTestJSON-71193266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd9fbc0c71d4e14b353a571dd257a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6559674f0b84e97948cd4286269507a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:04.152606 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-b70ce471-7b0d-4cb4-bb3f-22df30914481 tempest-ImagesNegativeTestJSON-71193266 tempest-ImagesNegativeTestJSON-71193266-project] 10.222.0.43 "GET /compute/v2.1/servers/18c556c5-0b7d-4acb-9803-a504ab597fbb" status: 200 len: 1504 microversion: 2.1 time: 0.434603 Oct 04 21:50:04.153211 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 833/1736] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:50:03 2022] GET /compute/v2.1/servers/18c556c5-0b7d-4acb-9803-a504ab597fbb => generated 1504 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:50:04.178461 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-ebebce36-2792-4d8a-82d0-94c2e599bd9f tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:04.190731 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-ebebce36-2792-4d8a-82d0-94c2e599bd9f tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:04.193567 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-ebebce36-2792-4d8a-82d0-94c2e599bd9f tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:04.197198 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-ebebce36-2792-4d8a-82d0-94c2e599bd9f tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] 10.222.0.43 "GET /compute/v2.1/servers/d4abcd04-329d-40a8-8d6e-4383bef437ae" status: 200 len: 1814 microversion: 2.25 time: 0.433066 Oct 04 21:50:04.198448 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 904/1737] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:50:03 2022] GET /compute/v2.1/servers/d4abcd04-329d-40a8-8d6e-4383bef437ae => generated 1814 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:50:04.203676 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-da4cd745-adf0-4501-bcc4-cce3e4f82ed2 tempest-FloatingIPDetailsTestJSON-650903168 tempest-FloatingIPDetailsTestJSON-650903168-project] Calling method '.version_select at 0x7fbb2f5705e0>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:50:04.403204 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-632f9642-ae21-4151-88b4-b8cefc9b8ed4 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-1549318", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452", "networks": "none"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:50:04.480690 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-632f9642-ae21-4151-88b4-b8cefc9b8ed4 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Flavor limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:50:04.481118 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-632f9642-ae21-4151-88b4-b8cefc9b8ed4 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Image limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:50:04.481812 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-632f9642-ae21-4151-88b4-b8cefc9b8ed4 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Flavor pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:50:04.482428 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-632f9642-ae21-4151-88b4-b8cefc9b8ed4 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Image pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:50:04.483036 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-632f9642-ae21-4151-88b4-b8cefc9b8ed4 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:50:04.494642 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-632f9642-ae21-4151-88b4-b8cefc9b8ed4 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:04.495489 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-632f9642-ae21-4151-88b4-b8cefc9b8ed4 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:04.496151 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-632f9642-ae21-4151-88b4-b8cefc9b8ed4 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:04.497154 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-632f9642-ae21-4151-88b4-b8cefc9b8ed4 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:04.497682 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-632f9642-ae21-4151-88b4-b8cefc9b8ed4 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:04.498325 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-632f9642-ae21-4151-88b4-b8cefc9b8ed4 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:04.523454 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-632f9642-ae21-4151-88b4-b8cefc9b8ed4 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Getting quotas for project 1b700f614a8b4cfba9b4abea45a06f30. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:50:04.538244 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-632f9642-ae21-4151-88b4-b8cefc9b8ed4 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Getting quotas for user 43653f2aea4e4884b5001dea5ec12be2 and project 1b700f614a8b4cfba9b4abea45a06f30. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:50:04.560787 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-da4cd745-adf0-4501-bcc4-cce3e4f82ed2 tempest-FloatingIPDetailsTestJSON-650903168 tempest-FloatingIPDetailsTestJSON-650903168-project] 10.222.0.43 "GET /compute/v2.1/os-floating-ips" status: 200 len: 398 microversion: 2.1 time: 0.360820 Oct 04 21:50:04.561807 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 905/1738] 10.222.0.43 () {58 vars in 1149 bytes} [Tue Oct 4 21:50:04 2022] GET /compute/v2.1/os-floating-ips => generated 398 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:50:04.564094 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-632f9642-ae21-4151-88b4-b8cefc9b8ed4 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Going to run 1 instances... {{(pid=134101) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:50:04.570293 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-632f9642-ae21-4151-88b4-b8cefc9b8ed4 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] [instance: 3f80e8f0-dba3-4403-83f8-0473c5d7d29b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='58548514-5dac-426c-81f5-19e3fba33e23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134101) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:50:04.631190 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-632f9642-ae21-4151-88b4-b8cefc9b8ed4 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 0.476540 Oct 04 21:50:04.634552 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 834/1739] 10.222.0.43 () {62 vars in 1188 bytes} [Tue Oct 4 21:50:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 478 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 04 21:50:04.635993 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-659d5b5d-cbc3-47a9-a1f0-c27b50e6ba64 tempest-ServersTestFqdnHostnames-1740621305 tempest-ServersTestFqdnHostnames-1740621305-project] Action: 'create', calling method: .version_select at 0x7fbb2f8c1430>, body: {"keypair": {"name": "tempest-keypair-1617412126", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAg//j2Pnre1zDN1coRuf0gksctpmdDqS7brx3HFOmv/1KFbVzg69G6VvdgBvVgoNmSOGNRFl1a2prbKpUxFUW+c7oW+9Tzv8IZToKmVJ3uVxBJ21vGTfmSdMkBoNqZpsA=="}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:50:04.638646 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-4d4964c8-527b-49d6-9386-760ef3d6c856 req-31991996-2d79-4846-9241-6e54aa810277 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69b35751-ffe5-4447-8c07-8db18ae96e9d", "tag": "e2331ba4-826a-40cf-853f-720873f465a1"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:50:04.651637 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-4d4964c8-527b-49d6-9386-760ef3d6c856 req-31991996-2d79-4846-9241-6e54aa810277 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:04.652747 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-4d4964c8-527b-49d6-9386-760ef3d6c856 req-31991996-2d79-4846-9241-6e54aa810277 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:04.653830 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-4d4964c8-527b-49d6-9386-760ef3d6c856 req-31991996-2d79-4846-9241-6e54aa810277 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:04.655772 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-659d5b5d-cbc3-47a9-a1f0-c27b50e6ba64 tempest-ServersTestFqdnHostnames-1740621305 tempest-ServersTestFqdnHostnames-1740621305-project] Getting quotas for project 60dbdc46c0aa4d07a1eb5ade5b3a7212. Resources: {'key_pairs'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:50:04.663203 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-659d5b5d-cbc3-47a9-a1f0-c27b50e6ba64 tempest-ServersTestFqdnHostnames-1740621305 tempest-ServersTestFqdnHostnames-1740621305-project] Getting quotas for user 5ade6e5b885f4e7db1fef86de59a08de and project 60dbdc46c0aa4d07a1eb5ade5b3a7212. Resources: {'key_pairs'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:50:04.672317 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-4d4964c8-527b-49d6-9386-760ef3d6c856 req-31991996-2d79-4846-9241-6e54aa810277 service nova] Creating event network-changed:e2331ba4-826a-40cf-853f-720873f465a1 for instance 69b35751-ffe5-4447-8c07-8db18ae96e9d on n-h2-860284-1 Oct 04 21:50:04.680604 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-4d4964c8-527b-49d6-9386-760ef3d6c856 req-31991996-2d79-4846-9241-6e54aa810277 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046887 Oct 04 21:50:04.681863 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 835/1740] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:50:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:50:04.690924 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-079358db-271f-4174-a775-b7e12b270a41 req-5fbe85a2-a6bf-4347-86bc-c49cd6d527e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4abcd04-329d-40a8-8d6e-4383bef437ae", "name": "network-vif-unplugged", "status": "completed", "tag": "000d4b8f-4676-41c0-a0c8-303e63366262"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:50:04.694797 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-659d5b5d-cbc3-47a9-a1f0-c27b50e6ba64 tempest-ServersTestFqdnHostnames-1740621305 tempest-ServersTestFqdnHostnames-1740621305-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.131384 Oct 04 21:50:04.695941 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 906/1741] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Oct 4 21:50:04 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:50:04.706638 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-079358db-271f-4174-a775-b7e12b270a41 req-5fbe85a2-a6bf-4347-86bc-c49cd6d527e7 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:04.710002 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-079358db-271f-4174-a775-b7e12b270a41 req-5fbe85a2-a6bf-4347-86bc-c49cd6d527e7 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:04.712237 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-079358db-271f-4174-a775-b7e12b270a41 req-5fbe85a2-a6bf-4347-86bc-c49cd6d527e7 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:04.715703 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-1c8a6886-ae23-434b-81fb-8fc1bcdb1c62 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Action: 'action', calling method: .version_select at 0x7fbb34da2ca0>, body: {"removeFloatingIp": {"address": "172.25.1.111"}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:50:04.739191 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-079358db-271f-4174-a775-b7e12b270a41 req-5fbe85a2-a6bf-4347-86bc-c49cd6d527e7 service nova] Creating event network-vif-unplugged:000d4b8f-4676-41c0-a0c8-303e63366262 for instance d4abcd04-329d-40a8-8d6e-4383bef437ae on n-h1-860284-1 Oct 04 21:50:04.749582 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-079358db-271f-4174-a775-b7e12b270a41 req-5fbe85a2-a6bf-4347-86bc-c49cd6d527e7 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.065648 Oct 04 21:50:04.750559 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 836/1742] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:50:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:50:04.760213 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-364add0a-6b47-4eab-a907-7fd4091d6294 tempest-ImagesMetadataTestJSON-1000283254 tempest-ImagesMetadataTestJSON-1000283254-project] Action: 'update_all', calling method: .version_select at 0x7fbb2ef46a60>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:50:04.844985 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-364add0a-6b47-4eab-a907-7fd4091d6294 tempest-ImagesMetadataTestJSON-1000283254 tempest-ImagesMetadataTestJSON-1000283254-project] Getting quotas for project ed830eec825e4c6fb45a4063e9b24b15. Resources: dict_keys(['metadata_items']) {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:50:04.852137 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-364add0a-6b47-4eab-a907-7fd4091d6294 tempest-ImagesMetadataTestJSON-1000283254 tempest-ImagesMetadataTestJSON-1000283254-project] Getting quotas for user e5264d8a9dc647f489a7fc930597e0b2 and project ed830eec825e4c6fb45a4063e9b24b15. Resources: dict_keys(['metadata_items']) {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:50:04.988644 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-1c8a6886-ae23-434b-81fb-8fc1bcdb1c62 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] [instance: 69b35751-ffe5-4447-8c07-8db18ae96e9d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:50:04.996954 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1c8a6886-ae23-434b-81fb-8fc1bcdb1c62 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:04.997595 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1c8a6886-ae23-434b-81fb-8fc1bcdb1c62 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:04.998878 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1c8a6886-ae23-434b-81fb-8fc1bcdb1c62 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:05.000133 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1c8a6886-ae23-434b-81fb-8fc1bcdb1c62 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:05.007504 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1c8a6886-ae23-434b-81fb-8fc1bcdb1c62 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:05.008442 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1c8a6886-ae23-434b-81fb-8fc1bcdb1c62 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:05.561105 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-364add0a-6b47-4eab-a907-7fd4091d6294 tempest-ImagesMetadataTestJSON-1000283254 tempest-ImagesMetadataTestJSON-1000283254-project] 10.222.0.43 "PUT /compute/v2.1/images/716dc685-bb05-4bba-9a60-122d1fad21d5/metadata" status: 200 len: 61 microversion: 2.1 time: 0.807600 Oct 04 21:50:05.561754 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 837/1743] 10.222.0.43 () {60 vars in 1280 bytes} [Tue Oct 4 21:50:04 2022] PUT /compute/v2.1/images/716dc685-bb05-4bba-9a60-122d1fad21d5/metadata => generated 61 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 21:50:05.569919 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-aeb919d8-a22e-4bf8-aa4c-97e5781d4554 tempest-ImagesNegativeTestJSON-71193266 tempest-ImagesNegativeTestJSON-71193266-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:50:05.570520 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-aeb919d8-a22e-4bf8-aa4c-97e5781d4554 tempest-ImagesNegativeTestJSON-71193266 tempest-ImagesNegativeTestJSON-71193266-project] [instance: 18c556c5-0b7d-4acb-9803-a504ab597fbb] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:50:05.609959 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-aeb919d8-a22e-4bf8-aa4c-97e5781d4554 tempest-ImagesNegativeTestJSON-71193266 tempest-ImagesNegativeTestJSON-71193266-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:05.612102 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-aeb919d8-a22e-4bf8-aa4c-97e5781d4554 tempest-ImagesNegativeTestJSON-71193266 tempest-ImagesNegativeTestJSON-71193266-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:05.614191 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-aeb919d8-a22e-4bf8-aa4c-97e5781d4554 tempest-ImagesNegativeTestJSON-71193266 tempest-ImagesNegativeTestJSON-71193266-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:05.616895 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-aeb919d8-a22e-4bf8-aa4c-97e5781d4554 tempest-ImagesNegativeTestJSON-71193266 tempest-ImagesNegativeTestJSON-71193266-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:05.619159 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-aeb919d8-a22e-4bf8-aa4c-97e5781d4554 tempest-ImagesNegativeTestJSON-71193266 tempest-ImagesNegativeTestJSON-71193266-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:05.620018 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1c8a6886-ae23-434b-81fb-8fc1bcdb1c62 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Acquiring lock "refresh_cache-69b35751-ffe5-4447-8c07-8db18ae96e9d" {{(pid=134102) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 04 21:50:05.620729 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-aeb919d8-a22e-4bf8-aa4c-97e5781d4554 tempest-ImagesNegativeTestJSON-71193266 tempest-ImagesNegativeTestJSON-71193266-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:05.621732 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1c8a6886-ae23-434b-81fb-8fc1bcdb1c62 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Acquired lock "refresh_cache-69b35751-ffe5-4447-8c07-8db18ae96e9d" {{(pid=134102) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 04 21:50:05.711065 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-aeb919d8-a22e-4bf8-aa4c-97e5781d4554 tempest-ImagesNegativeTestJSON-71193266 tempest-ImagesNegativeTestJSON-71193266-project] [instance: 18c556c5-0b7d-4acb-9803-a504ab597fbb] Going to try to terminate instance {{(pid=134101) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:50:05.911618 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-aeb919d8-a22e-4bf8-aa4c-97e5781d4554 tempest-ImagesNegativeTestJSON-71193266 tempest-ImagesNegativeTestJSON-71193266-project] 10.222.0.43 "DELETE /compute/v2.1/servers/18c556c5-0b7d-4acb-9803-a504ab597fbb" status: 204 len: 0 microversion: 2.1 time: 0.347641 Oct 04 21:50:05.913303 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 838/1744] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 21:50:05 2022] DELETE /compute/v2.1/servers/18c556c5-0b7d-4acb-9803-a504ab597fbb => generated 0 bytes in 351 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:50:05.920068 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e7aaf582-72d9-43ad-8aca-8b0e2a477163 tempest-FloatingIPDetailsTestJSON-650903168 tempest-FloatingIPDetailsTestJSON-650903168-project] Calling method '.version_select at 0x7fbb2f282310>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:50:07.922346 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.network.neutron [None req-1c8a6886-ae23-434b-81fb-8fc1bcdb1c62 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] [instance: 69b35751-ffe5-4447-8c07-8db18ae96e9d] Building network info cache for instance {{(pid=134102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 04 21:50:08.653276 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-e7aaf582-72d9-43ad-8aca-8b0e2a477163 tempest-FloatingIPDetailsTestJSON-650903168 tempest-FloatingIPDetailsTestJSON-650903168-project] 10.222.0.43 "DELETE /compute/v2.1/os-floating-ips/7d170aeb-7643-4a8a-bf4f-3274374a17e0" status: 202 len: 0 microversion: 2.1 time: 2.737486 Oct 04 21:50:08.655591 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 839/1745] 10.222.0.43 () {58 vars in 1263 bytes} [Tue Oct 4 21:50:05 2022] DELETE /compute/v2.1/os-floating-ips/7d170aeb-7643-4a8a-bf4f-3274374a17e0 => generated 0 bytes in 2741 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:50:08.721591 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-6d4d0b8d-1d7c-4798-9e2b-fb449c0e7132 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:50:08.738080 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-6d4d0b8d-1d7c-4798-9e2b-fb449c0e7132 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] [instance: 3f80e8f0-dba3-4403-83f8-0473c5d7d29b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:50:08.776614 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6d4d0b8d-1d7c-4798-9e2b-fb449c0e7132 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:08.777702 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6d4d0b8d-1d7c-4798-9e2b-fb449c0e7132 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:08.778538 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6d4d0b8d-1d7c-4798-9e2b-fb449c0e7132 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:08.788632 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6d4d0b8d-1d7c-4798-9e2b-fb449c0e7132 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:08.789926 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6d4d0b8d-1d7c-4798-9e2b-fb449c0e7132 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:08.791068 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6d4d0b8d-1d7c-4798-9e2b-fb449c0e7132 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:09.032492 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=6,nova_cell1:INSERT=2,nova_cell1:SAVEPOINT=3,nova_cell1:RELEASE=3 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:50:09.195244 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-6d4d0b8d-1d7c-4798-9e2b-fb449c0e7132 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43653f2aea4e4884b5001dea5ec12be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b700f614a8b4cfba9b4abea45a06f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:09.202174 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.network.neutron [None req-1c8a6886-ae23-434b-81fb-8fc1bcdb1c62 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] [instance: 69b35751-ffe5-4447-8c07-8db18ae96e9d] Updating instance_info_cache with network_info: [{"id": "e2331ba4-826a-40cf-853f-720873f465a1", "address": "fa:16:3e:ef:d7:68", "network": {"id": "e4c13216-4fea-4d87-aa16-a7572859740d", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1638687548-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "758fcafb5db74075b183978a97b7c4ee", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tape2331ba4-82", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=134102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 04 21:50:09.226981 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-6d4d0b8d-1d7c-4798-9e2b-fb449c0e7132 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43653f2aea4e4884b5001dea5ec12be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b700f614a8b4cfba9b4abea45a06f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:09.228928 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-6d4d0b8d-1d7c-4798-9e2b-fb449c0e7132 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43653f2aea4e4884b5001dea5ec12be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b700f614a8b4cfba9b4abea45a06f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:09.233338 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1c8a6886-ae23-434b-81fb-8fc1bcdb1c62 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Releasing lock "refresh_cache-69b35751-ffe5-4447-8c07-8db18ae96e9d" {{(pid=134102) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 04 21:50:09.234854 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-1c8a6886-ae23-434b-81fb-8fc1bcdb1c62 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] 10.222.0.43 "POST /compute/v2.1/servers/69b35751-ffe5-4447-8c07-8db18ae96e9d/action" status: 202 len: 0 microversion: 2.1 time: 4.537766 Oct 04 21:50:09.235768 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 907/1746] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 21:50:04 2022] POST /compute/v2.1/servers/69b35751-ffe5-4447-8c07-8db18ae96e9d/action => generated 0 bytes in 4539 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 04 21:50:09.241444 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-aa7a56b7-b848-4f73-838d-6206a701012f tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:50:09.242502 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-aa7a56b7-b848-4f73-838d-6206a701012f tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 3f0a02bc-7993-4849-8b3c-7572327b4799] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:50:09.250272 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-aa7a56b7-b848-4f73-838d-6206a701012f tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:09.251218 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-aa7a56b7-b848-4f73-838d-6206a701012f tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:09.252576 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-aa7a56b7-b848-4f73-838d-6206a701012f tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:09.253424 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-6d4d0b8d-1d7c-4798-9e2b-fb449c0e7132 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] 10.222.0.43 "PUT /compute/v2.1/servers/3f80e8f0-dba3-4403-83f8-0473c5d7d29b" status: 200 len: 1414 microversion: 2.75 time: 0.586210 Oct 04 21:50:09.253645 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-aa7a56b7-b848-4f73-838d-6206a701012f tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:09.253975 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-aa7a56b7-b848-4f73-838d-6206a701012f tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:09.254475 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-aa7a56b7-b848-4f73-838d-6206a701012f tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:09.269000 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 840/1747] 10.222.0.43 () {62 vars in 1297 bytes} [Tue Oct 4 21:50:08 2022] PUT /compute/v2.1/servers/3f80e8f0-dba3-4403-83f8-0473c5d7d29b => generated 1414 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:50:09.274889 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-fd724f89-b363-4718-864f-fd405ce2a4b3 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:50:09.277737 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-fd724f89-b363-4718-864f-fd405ce2a4b3 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] [instance: d4abcd04-329d-40a8-8d6e-4383bef437ae] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:50:09.288899 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fd724f89-b363-4718-864f-fd405ce2a4b3 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:09.290553 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fd724f89-b363-4718-864f-fd405ce2a4b3 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:09.291702 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fd724f89-b363-4718-864f-fd405ce2a4b3 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:09.293356 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fd724f89-b363-4718-864f-fd405ce2a4b3 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:09.294446 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fd724f89-b363-4718-864f-fd405ce2a4b3 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:09.295666 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fd724f89-b363-4718-864f-fd405ce2a4b3 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:09.588632 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-aa7a56b7-b848-4f73-838d-6206a701012f tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ad048becf474fb972d4291422d810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dcfc7024fc49388c4bd5f25f03e60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:09.591235 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-fd724f89-b363-4718-864f-fd405ce2a4b3 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:09.600847 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-aa7a56b7-b848-4f73-838d-6206a701012f tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/3f0a02bc-7993-4849-8b3c-7572327b4799" status: 200 len: 1716 microversion: 2.1 time: 0.363362 Oct 04 21:50:09.601456 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 908/1748] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:50:09 2022] GET /compute/v2.1/servers/3f0a02bc-7993-4849-8b3c-7572327b4799 => generated 1716 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:50:09.606542 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-6a7903fd-6f80-477d-846f-679b438e47b1 tempest-ImagesMetadataTestJSON-1000283254 tempest-ImagesMetadataTestJSON-1000283254-project] Action: 'update', calling method: .version_select at 0x7fbb37438d30>, body: {"meta": {"os_version": "alt"}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:50:09.626206 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-fd724f89-b363-4718-864f-fd405ce2a4b3 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:09.630526 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-fd724f89-b363-4718-864f-fd405ce2a4b3 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:09.632845 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-fd724f89-b363-4718-864f-fd405ce2a4b3 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] 10.222.0.43 "GET /compute/v2.1/servers/d4abcd04-329d-40a8-8d6e-4383bef437ae" status: 200 len: 1814 microversion: 2.25 time: 0.361756 Oct 04 21:50:09.641015 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 841/1749] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:50:09 2022] GET /compute/v2.1/servers/d4abcd04-329d-40a8-8d6e-4383bef437ae => generated 1814 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:50:09.651539 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-0c48bea1-24e9-4d2b-b726-02f76eeb586d tempest-ImagesNegativeTestJSON-71193266 tempest-ImagesNegativeTestJSON-71193266-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:50:09.652463 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-0c48bea1-24e9-4d2b-b726-02f76eeb586d tempest-ImagesNegativeTestJSON-71193266 tempest-ImagesNegativeTestJSON-71193266-project] [instance: 18c556c5-0b7d-4acb-9803-a504ab597fbb] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:50:09.663334 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0c48bea1-24e9-4d2b-b726-02f76eeb586d tempest-ImagesNegativeTestJSON-71193266 tempest-ImagesNegativeTestJSON-71193266-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:09.664260 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0c48bea1-24e9-4d2b-b726-02f76eeb586d tempest-ImagesNegativeTestJSON-71193266 tempest-ImagesNegativeTestJSON-71193266-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:09.664608 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0c48bea1-24e9-4d2b-b726-02f76eeb586d tempest-ImagesNegativeTestJSON-71193266 tempest-ImagesNegativeTestJSON-71193266-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:09.665733 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0c48bea1-24e9-4d2b-b726-02f76eeb586d tempest-ImagesNegativeTestJSON-71193266 tempest-ImagesNegativeTestJSON-71193266-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:09.666456 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0c48bea1-24e9-4d2b-b726-02f76eeb586d tempest-ImagesNegativeTestJSON-71193266 tempest-ImagesNegativeTestJSON-71193266-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:09.667404 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0c48bea1-24e9-4d2b-b726-02f76eeb586d tempest-ImagesNegativeTestJSON-71193266 tempest-ImagesNegativeTestJSON-71193266-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:09.694299 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-6a7903fd-6f80-477d-846f-679b438e47b1 tempest-ImagesMetadataTestJSON-1000283254 tempest-ImagesMetadataTestJSON-1000283254-project] Getting quotas for project ed830eec825e4c6fb45a4063e9b24b15. Resources: dict_keys(['metadata_items']) {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:50:09.705595 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-6a7903fd-6f80-477d-846f-679b438e47b1 tempest-ImagesMetadataTestJSON-1000283254 tempest-ImagesMetadataTestJSON-1000283254-project] Getting quotas for user e5264d8a9dc647f489a7fc930597e0b2 and project ed830eec825e4c6fb45a4063e9b24b15. Resources: dict_keys(['metadata_items']) {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:50:09.716752 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0c48bea1-24e9-4d2b-b726-02f76eeb586d tempest-ImagesNegativeTestJSON-71193266 tempest-ImagesNegativeTestJSON-71193266-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:09.717543 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0c48bea1-24e9-4d2b-b726-02f76eeb586d tempest-ImagesNegativeTestJSON-71193266 tempest-ImagesNegativeTestJSON-71193266-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:09.717986 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0c48bea1-24e9-4d2b-b726-02f76eeb586d tempest-ImagesNegativeTestJSON-71193266 tempest-ImagesNegativeTestJSON-71193266-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:09.719247 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.objects.instance [None req-0c48bea1-24e9-4d2b-b726-02f76eeb586d tempest-ImagesNegativeTestJSON-71193266 tempest-ImagesNegativeTestJSON-71193266-project] Lazy-loading 'fault' on Instance uuid 18c556c5-0b7d-4acb-9803-a504ab597fbb {{(pid=134101) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:50:09.782321 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-0c48bea1-24e9-4d2b-b726-02f76eeb586d tempest-ImagesNegativeTestJSON-71193266 tempest-ImagesNegativeTestJSON-71193266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd9fbc0c71d4e14b353a571dd257a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6559674f0b84e97948cd4286269507a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:09.791157 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-0c48bea1-24e9-4d2b-b726-02f76eeb586d tempest-ImagesNegativeTestJSON-71193266 tempest-ImagesNegativeTestJSON-71193266-project] 10.222.0.43 "GET /compute/v2.1/servers/18c556c5-0b7d-4acb-9803-a504ab597fbb" status: 200 len: 1306 microversion: 2.1 time: 0.147959 Oct 04 21:50:09.792037 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 842/1750] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:50:09 2022] GET /compute/v2.1/servers/18c556c5-0b7d-4acb-9803-a504ab597fbb => generated 1306 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:50:09.796795 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-a4b25a5d-5998-4864-85e1-4a4af760e34a req-517c7ff5-1685-4d4e-bccc-e75fb2e6fc26 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4abcd04-329d-40a8-8d6e-4383bef437ae", "tag": "000d4b8f-4676-41c0-a0c8-303e63366262"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:50:09.809748 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-a4b25a5d-5998-4864-85e1-4a4af760e34a req-517c7ff5-1685-4d4e-bccc-e75fb2e6fc26 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:09.810596 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-a4b25a5d-5998-4864-85e1-4a4af760e34a req-517c7ff5-1685-4d4e-bccc-e75fb2e6fc26 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:09.811193 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-a4b25a5d-5998-4864-85e1-4a4af760e34a req-517c7ff5-1685-4d4e-bccc-e75fb2e6fc26 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:09.826210 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-a4b25a5d-5998-4864-85e1-4a4af760e34a req-517c7ff5-1685-4d4e-bccc-e75fb2e6fc26 service nova] Creating event network-changed:000d4b8f-4676-41c0-a0c8-303e63366262 for instance d4abcd04-329d-40a8-8d6e-4383bef437ae on n-h1-860284-1 Oct 04 21:50:09.837835 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-a4b25a5d-5998-4864-85e1-4a4af760e34a req-517c7ff5-1685-4d4e-bccc-e75fb2e6fc26 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040126 Oct 04 21:50:09.838829 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 843/1751] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:50:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:50:09.855987 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-fdd7cc39-216e-4f56-a057-7c22a4e593f8 req-99669e11-63e2-4569-a21b-73548bf7984b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69b35751-ffe5-4447-8c07-8db18ae96e9d", "tag": "e2331ba4-826a-40cf-853f-720873f465a1"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:50:09.869894 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-fdd7cc39-216e-4f56-a057-7c22a4e593f8 req-99669e11-63e2-4569-a21b-73548bf7984b service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:09.870552 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-fdd7cc39-216e-4f56-a057-7c22a4e593f8 req-99669e11-63e2-4569-a21b-73548bf7984b service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:09.870986 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-fdd7cc39-216e-4f56-a057-7c22a4e593f8 req-99669e11-63e2-4569-a21b-73548bf7984b service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:09.898355 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-fdd7cc39-216e-4f56-a057-7c22a4e593f8 req-99669e11-63e2-4569-a21b-73548bf7984b service nova] Creating event network-changed:e2331ba4-826a-40cf-853f-720873f465a1 for instance 69b35751-ffe5-4447-8c07-8db18ae96e9d on n-h2-860284-1 Oct 04 21:50:09.910983 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-fdd7cc39-216e-4f56-a057-7c22a4e593f8 req-99669e11-63e2-4569-a21b-73548bf7984b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068303 Oct 04 21:50:09.912793 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 844/1752] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:50:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:50:09.931878 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-6b5b3bd1-0f52-4679-be51-12606071e223 tempest-ServersTestFqdnHostnames-1740621305 tempest-ServersTestFqdnHostnames-1740621305-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "b6300fa0-3a1c-4e48-ad86-66edc5a62189"}], "security_groups": [{"name": "tempest-securitygroup--488503346"}], "key_name": "tempest-keypair-1617412126", "user_data": "}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:50:10.106434 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.network.neutron [None req-6b5b3bd1-0f52-4679-be51-12606071e223 tempest-ServersTestFqdnHostnames-1740621305 tempest-ServersTestFqdnHostnames-1740621305-project] validate_networks() for [('b6300fa0-3a1c-4e48-ad86-66edc5a62189', None, None, None, None, None)] {{(pid=134101) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:50:10.137899 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-6a7903fd-6f80-477d-846f-679b438e47b1 tempest-ImagesMetadataTestJSON-1000283254 tempest-ImagesMetadataTestJSON-1000283254-project] 10.222.0.43 "PUT /compute/v2.1/images/716dc685-bb05-4bba-9a60-122d1fad21d5/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.532484 Oct 04 21:50:10.139679 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 909/1753] 10.222.0.43 () {60 vars in 1313 bytes} [Tue Oct 4 21:50:09 2022] PUT /compute/v2.1/images/716dc685-bb05-4bba-9a60-122d1fad21d5/metadata/os_version => generated 31 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 21:50:10.148156 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-967bb944-afaf-4f98-a269-e26c081996c0 tempest-FloatingIPDetailsTestJSON-650903168 tempest-FloatingIPDetailsTestJSON-650903168-project] Calling method '.version_select at 0x7fbb37423d30>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:50:10.989804 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-6b5b3bd1-0f52-4679-be51-12606071e223 tempest-ServersTestFqdnHostnames-1740621305 tempest-ServersTestFqdnHostnames-1740621305-project] Flavor limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:50:10.992839 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-6b5b3bd1-0f52-4679-be51-12606071e223 tempest-ServersTestFqdnHostnames-1740621305 tempest-ServersTestFqdnHostnames-1740621305-project] Image limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:50:10.994117 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-6b5b3bd1-0f52-4679-be51-12606071e223 tempest-ServersTestFqdnHostnames-1740621305 tempest-ServersTestFqdnHostnames-1740621305-project] Flavor pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:50:10.995774 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-6b5b3bd1-0f52-4679-be51-12606071e223 tempest-ServersTestFqdnHostnames-1740621305 tempest-ServersTestFqdnHostnames-1740621305-project] Image pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:50:10.996880 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-6b5b3bd1-0f52-4679-be51-12606071e223 tempest-ServersTestFqdnHostnames-1740621305 tempest-ServersTestFqdnHostnames-1740621305-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:50:11.016580 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6b5b3bd1-0f52-4679-be51-12606071e223 tempest-ServersTestFqdnHostnames-1740621305 tempest-ServersTestFqdnHostnames-1740621305-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:11.018191 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6b5b3bd1-0f52-4679-be51-12606071e223 tempest-ServersTestFqdnHostnames-1740621305 tempest-ServersTestFqdnHostnames-1740621305-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:11.020124 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6b5b3bd1-0f52-4679-be51-12606071e223 tempest-ServersTestFqdnHostnames-1740621305 tempest-ServersTestFqdnHostnames-1740621305-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:11.021994 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6b5b3bd1-0f52-4679-be51-12606071e223 tempest-ServersTestFqdnHostnames-1740621305 tempest-ServersTestFqdnHostnames-1740621305-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:11.025158 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6b5b3bd1-0f52-4679-be51-12606071e223 tempest-ServersTestFqdnHostnames-1740621305 tempest-ServersTestFqdnHostnames-1740621305-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:11.026165 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6b5b3bd1-0f52-4679-be51-12606071e223 tempest-ServersTestFqdnHostnames-1740621305 tempest-ServersTestFqdnHostnames-1740621305-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:11.052708 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-6b5b3bd1-0f52-4679-be51-12606071e223 tempest-ServersTestFqdnHostnames-1740621305 tempest-ServersTestFqdnHostnames-1740621305-project] Getting quotas for project 60dbdc46c0aa4d07a1eb5ade5b3a7212. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:50:11.060132 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-6b5b3bd1-0f52-4679-be51-12606071e223 tempest-ServersTestFqdnHostnames-1740621305 tempest-ServersTestFqdnHostnames-1740621305-project] Getting quotas for user 5ade6e5b885f4e7db1fef86de59a08de and project 60dbdc46c0aa4d07a1eb5ade5b3a7212. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:50:11.075991 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-6b5b3bd1-0f52-4679-be51-12606071e223 tempest-ServersTestFqdnHostnames-1740621305 tempest-ServersTestFqdnHostnames-1740621305-project] Going to run 1 instances... {{(pid=134101) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:50:11.078559 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-6b5b3bd1-0f52-4679-be51-12606071e223 tempest-ServersTestFqdnHostnames-1740621305 tempest-ServersTestFqdnHostnames-1740621305-project] [instance: a50a2117-fefe-499b-a2d4-b57e264a5a51] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='58548514-5dac-426c-81f5-19e3fba33e23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134101) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:50:11.148754 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-6b5b3bd1-0f52-4679-be51-12606071e223 tempest-ServersTestFqdnHostnames-1740621305 tempest-ServersTestFqdnHostnames-1740621305-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.233358 Oct 04 21:50:11.149945 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 845/1754] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 21:50:09 2022] POST /compute/v2.1/servers => generated 408 bytes in 1237 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:50:11.155016 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-c557df5d-14da-46ba-9058-88a35dc2b770 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:50:11.155767 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-c557df5d-14da-46ba-9058-88a35dc2b770 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] [instance: 69b35751-ffe5-4447-8c07-8db18ae96e9d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:50:11.164167 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c557df5d-14da-46ba-9058-88a35dc2b770 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:11.164673 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c557df5d-14da-46ba-9058-88a35dc2b770 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:11.165124 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c557df5d-14da-46ba-9058-88a35dc2b770 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:11.165850 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c557df5d-14da-46ba-9058-88a35dc2b770 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:11.166309 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c557df5d-14da-46ba-9058-88a35dc2b770 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:11.166765 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c557df5d-14da-46ba-9058-88a35dc2b770 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:11.201800 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-c557df5d-14da-46ba-9058-88a35dc2b770 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] [instance: 69b35751-ffe5-4447-8c07-8db18ae96e9d] Going to try to terminate instance {{(pid=134101) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:50:11.309979 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-c557df5d-14da-46ba-9058-88a35dc2b770 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] 10.222.0.43 "DELETE /compute/v2.1/servers/69b35751-ffe5-4447-8c07-8db18ae96e9d" status: 204 len: 0 microversion: 2.1 time: 0.157699 Oct 04 21:50:11.311429 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 846/1755] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 21:50:11 2022] DELETE /compute/v2.1/servers/69b35751-ffe5-4447-8c07-8db18ae96e9d => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:50:11.324717 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-74d3b92e-73f6-4f9f-9e27-4f932c02e030 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:50:11.325763 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-74d3b92e-73f6-4f9f-9e27-4f932c02e030 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] [instance: 3f80e8f0-dba3-4403-83f8-0473c5d7d29b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:50:11.334348 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-74d3b92e-73f6-4f9f-9e27-4f932c02e030 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:11.334884 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-74d3b92e-73f6-4f9f-9e27-4f932c02e030 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:11.335777 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-74d3b92e-73f6-4f9f-9e27-4f932c02e030 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:11.336873 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-74d3b92e-73f6-4f9f-9e27-4f932c02e030 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:11.337190 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-74d3b92e-73f6-4f9f-9e27-4f932c02e030 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:11.337653 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-74d3b92e-73f6-4f9f-9e27-4f932c02e030 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:11.360171 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-967bb944-afaf-4f98-a269-e26c081996c0 tempest-FloatingIPDetailsTestJSON-650903168 tempest-FloatingIPDetailsTestJSON-650903168-project] 10.222.0.43 "DELETE /compute/v2.1/os-floating-ips/e3525d06-c5a4-4e6d-91f3-254cc2804262" status: 202 len: 0 microversion: 2.1 time: 1.218570 Oct 04 21:50:11.367493 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 910/1756] 10.222.0.43 () {58 vars in 1263 bytes} [Tue Oct 4 21:50:10 2022] DELETE /compute/v2.1/os-floating-ips/e3525d06-c5a4-4e6d-91f3-254cc2804262 => generated 0 bytes in 1221 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:50:11.367493 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-afbb8dd1-3ece-4701-9590-e352cfc535e4 tempest-ImagesMetadataTestJSON-1000283254 tempest-ImagesMetadataTestJSON-1000283254-project] Calling method '.version_select at 0x7fbb374593a0>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:50:11.423180 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-afbb8dd1-3ece-4701-9590-e352cfc535e4 tempest-ImagesMetadataTestJSON-1000283254 tempest-ImagesMetadataTestJSON-1000283254-project] 10.222.0.43 "GET /compute/v2.1/images/716dc685-bb05-4bba-9a60-122d1fad21d5/metadata" status: 200 len: 58 microversion: 2.1 time: 0.059890 Oct 04 21:50:11.424142 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 911/1757] 10.222.0.43 () {58 vars in 1260 bytes} [Tue Oct 4 21:50:11 2022] GET /compute/v2.1/images/716dc685-bb05-4bba-9a60-122d1fad21d5/metadata => generated 58 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 21:50:11.432932 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-74d3b92e-73f6-4f9f-9e27-4f932c02e030 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43653f2aea4e4884b5001dea5ec12be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b700f614a8b4cfba9b4abea45a06f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:11.435930 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-bb5393b3-474a-48c7-b405-f98ccd7ec957 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:50:11.437808 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-bb5393b3-474a-48c7-b405-f98ccd7ec957 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 3f0a02bc-7993-4849-8b3c-7572327b4799] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:50:11.443682 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-74d3b92e-73f6-4f9f-9e27-4f932c02e030 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43653f2aea4e4884b5001dea5ec12be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b700f614a8b4cfba9b4abea45a06f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:11.445285 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-74d3b92e-73f6-4f9f-9e27-4f932c02e030 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43653f2aea4e4884b5001dea5ec12be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b700f614a8b4cfba9b4abea45a06f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:11.454019 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-74d3b92e-73f6-4f9f-9e27-4f932c02e030 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] 10.222.0.43 "GET /compute/v2.1/servers/3f80e8f0-dba3-4403-83f8-0473c5d7d29b" status: 200 len: 1414 microversion: 2.75 time: 0.140122 Oct 04 21:50:11.454607 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bb5393b3-474a-48c7-b405-f98ccd7ec957 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:11.455403 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 847/1758] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:50:11 2022] GET /compute/v2.1/servers/3f80e8f0-dba3-4403-83f8-0473c5d7d29b => generated 1414 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:50:11.465915 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bb5393b3-474a-48c7-b405-f98ccd7ec957 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:11.466908 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bb5393b3-474a-48c7-b405-f98ccd7ec957 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:11.467907 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bb5393b3-474a-48c7-b405-f98ccd7ec957 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:11.468807 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bb5393b3-474a-48c7-b405-f98ccd7ec957 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:11.471920 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bb5393b3-474a-48c7-b405-f98ccd7ec957 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:11.653055 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-4a4a2ebb-de9d-4ba8-99b4-ff7ba1aa7aa9 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:50:11.653677 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-4a4a2ebb-de9d-4ba8-99b4-ff7ba1aa7aa9 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] [instance: d4abcd04-329d-40a8-8d6e-4383bef437ae] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:50:11.665093 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4a4a2ebb-de9d-4ba8-99b4-ff7ba1aa7aa9 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:11.665093 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4a4a2ebb-de9d-4ba8-99b4-ff7ba1aa7aa9 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:11.665093 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4a4a2ebb-de9d-4ba8-99b4-ff7ba1aa7aa9 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:11.665093 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4a4a2ebb-de9d-4ba8-99b4-ff7ba1aa7aa9 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:11.665093 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4a4a2ebb-de9d-4ba8-99b4-ff7ba1aa7aa9 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:11.665093 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4a4a2ebb-de9d-4ba8-99b4-ff7ba1aa7aa9 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:11.683510 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-bb5393b3-474a-48c7-b405-f98ccd7ec957 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ad048becf474fb972d4291422d810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dcfc7024fc49388c4bd5f25f03e60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:11.700200 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-bb5393b3-474a-48c7-b405-f98ccd7ec957 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/3f0a02bc-7993-4849-8b3c-7572327b4799" status: 200 len: 1716 microversion: 2.1 time: 0.272603 Oct 04 21:50:11.713990 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 912/1759] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:50:11 2022] GET /compute/v2.1/servers/3f0a02bc-7993-4849-8b3c-7572327b4799 => generated 1716 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:50:11.713990 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-85fdf3c2-3960-4cbe-8807-64fec13a316e tempest-ImagesNegativeTestJSON-71193266 tempest-ImagesNegativeTestJSON-71193266-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:50:11.713990 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-85fdf3c2-3960-4cbe-8807-64fec13a316e tempest-ImagesNegativeTestJSON-71193266 tempest-ImagesNegativeTestJSON-71193266-project] [instance: 18c556c5-0b7d-4acb-9803-a504ab597fbb] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:50:11.727760 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-85fdf3c2-3960-4cbe-8807-64fec13a316e tempest-ImagesNegativeTestJSON-71193266 tempest-ImagesNegativeTestJSON-71193266-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:11.728379 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-85fdf3c2-3960-4cbe-8807-64fec13a316e tempest-ImagesNegativeTestJSON-71193266 tempest-ImagesNegativeTestJSON-71193266-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:11.728716 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-85fdf3c2-3960-4cbe-8807-64fec13a316e tempest-ImagesNegativeTestJSON-71193266 tempest-ImagesNegativeTestJSON-71193266-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:11.729456 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-85fdf3c2-3960-4cbe-8807-64fec13a316e tempest-ImagesNegativeTestJSON-71193266 tempest-ImagesNegativeTestJSON-71193266-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:11.729928 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-85fdf3c2-3960-4cbe-8807-64fec13a316e tempest-ImagesNegativeTestJSON-71193266 tempest-ImagesNegativeTestJSON-71193266-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:11.730471 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-85fdf3c2-3960-4cbe-8807-64fec13a316e tempest-ImagesNegativeTestJSON-71193266 tempest-ImagesNegativeTestJSON-71193266-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:11.747914 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-85fdf3c2-3960-4cbe-8807-64fec13a316e tempest-ImagesNegativeTestJSON-71193266 tempest-ImagesNegativeTestJSON-71193266-project] HTTP exception thrown: Instance 18c556c5-0b7d-4acb-9803-a504ab597fbb could not be found. Oct 04 21:50:11.749682 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-85fdf3c2-3960-4cbe-8807-64fec13a316e tempest-ImagesNegativeTestJSON-71193266 tempest-ImagesNegativeTestJSON-71193266-project] Request method failure captured: Oct 04 21:50:11.749682 n-d-860284-1 devstack@n-api.service[134102]: request: GET /compute/v2.1/servers/18c556c5-0b7d-4acb-9803-a504ab597fbb HTTP/1.1 Oct 04 21:50:11.749682 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 21:50:11.749682 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 21:50:11.749682 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 21:50:11.749682 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 21:50:11.749682 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 21:50:11.749682 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 21:50:11.749682 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 21:50:11.749682 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 21:50:11.749682 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPKp1tx3JdD7L-NqKYgSeGp-8e-_HDxzbWGGtT4IlN4hvI-8VQrD23-ZbIUyZkgg1KfshFmu351r76auJF1ZjP4iryQSWVmQ7PC_e8-Om781T3KjFBi8kNj7FfG1NkQT9dHnxXsOnmcxuj9JuH3KAECHtNV3qTtOpIZBGfo872DFRXI4 Oct 04 21:50:11.749682 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 21:50:11.749682 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 21:50:11.749682 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 21:50:11.749682 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 21:50:11.749682 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 21:50:11.749682 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 21:50:11.749682 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: b6559674f0b84e97948cd4286269507a Oct 04 21:50:11.749682 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-ImagesNegativeTestJSON-71193266 Oct 04 21:50:11.749682 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 21:50:11.749682 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 21:50:11.749682 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b6559674f0b84e97948cd4286269507a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_b6559674f0b84e97948cd4286269507a", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b6559674f0b84e97948cd4286269507a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/b6559674f0b84e97948cd4286269507a"}]}] Oct 04 21:50:11.749682 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-ImagesNegativeTestJSON-71193266 Oct 04 21:50:11.749682 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: b6559674f0b84e97948cd4286269507a Oct 04 21:50:11.749682 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-71193266 Oct 04 21:50:11.749682 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-ImagesNegativeTestJSON-71193266-project Oct 04 21:50:11.749682 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 21:50:11.749682 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 21:50:11.749682 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: 7bd9fbc0c71d4e14b353a571dd257a0a Oct 04 21:50:11.749682 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-ImagesNegativeTestJSON-71193266-project Oct 04 21:50:11.749682 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 21:50:11.749682 n-d-860284-1 devstack@n-api.service[134102]: exception: Instance 18c556c5-0b7d-4acb-9803-a504ab597fbb could not be found. Oct 04 21:50:11.749682 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': '18c556c5-0b7d-4acb-9803-a504ab597fbb'} Oct 04 21:50:11.749682 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:50:11.749682 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:50:11.749682 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:50:11.749682 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:50:11.749682 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:50:11.749682 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:50:11.749682 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:50:11.749682 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:50:11.749682 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:50:11.749682 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:50:11.749682 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18c556c5-0b7d-4acb-9803-a504ab597fbb could not be found. Oct 04 21:50:11.749682 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:50:11.749682 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:50:11.749682 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:50:11.749682 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:50:11.749682 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:50:11.749682 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:50:11.749682 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:50:11.749682 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:50:11.749682 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:50:11.749682 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:50:11.749682 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:50:11.749682 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:50:11.749682 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:50:11.749682 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:50:11.749682 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:50:11.749682 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:50:11.749682 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18c556c5-0b7d-4acb-9803-a504ab597fbb could not be found. Oct 04 21:50:11.749682 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:50:11.749682 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:50:11.749682 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:50:11.755539 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:50:11.755539 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:50:11.755539 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:50:11.755539 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:50:11.755539 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:50:11.755539 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18c556c5-0b7d-4acb-9803-a504ab597fbb could not be found. Oct 04 21:50:11.755539 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:50:11.755539 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-85fdf3c2-3960-4cbe-8807-64fec13a316e tempest-ImagesNegativeTestJSON-71193266 tempest-ImagesNegativeTestJSON-71193266-project] Returning 404 to user: Instance 18c556c5-0b7d-4acb-9803-a504ab597fbb could not be found. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:50:11.755539 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-85fdf3c2-3960-4cbe-8807-64fec13a316e tempest-ImagesNegativeTestJSON-71193266 tempest-ImagesNegativeTestJSON-71193266-project] 10.222.0.43 "GET /compute/v2.1/servers/18c556c5-0b7d-4acb-9803-a504ab597fbb" status: 404 len: 111 microversion: 2.1 time: 0.048272 Oct 04 21:50:11.755539 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 913/1760] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:50:11 2022] GET /compute/v2.1/servers/18c556c5-0b7d-4acb-9803-a504ab597fbb => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:50:11.757616 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-9c7322ce-045f-4215-8027-0c9c720b6c7d tempest-ServersTestFqdnHostnames-1740621305 tempest-ServersTestFqdnHostnames-1740621305-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:50:11.758249 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-9c7322ce-045f-4215-8027-0c9c720b6c7d tempest-ServersTestFqdnHostnames-1740621305 tempest-ServersTestFqdnHostnames-1740621305-project] [instance: a50a2117-fefe-499b-a2d4-b57e264a5a51] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:50:11.842695 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-9c7322ce-045f-4215-8027-0c9c720b6c7d tempest-ServersTestFqdnHostnames-1740621305 tempest-ServersTestFqdnHostnames-1740621305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ade6e5b885f4e7db1fef86de59a08de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dbdc46c0aa4d07a1eb5ade5b3a7212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:11.856117 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-9c7322ce-045f-4215-8027-0c9c720b6c7d tempest-ServersTestFqdnHostnames-1740621305 tempest-ServersTestFqdnHostnames-1740621305-project] 10.222.0.43 "GET /compute/v2.1/servers/a50a2117-fefe-499b-a2d4-b57e264a5a51" status: 200 len: 1226 microversion: 2.1 time: 0.101894 Oct 04 21:50:11.873038 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 914/1761] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:50:11 2022] GET /compute/v2.1/servers/a50a2117-fefe-499b-a2d4-b57e264a5a51 => generated 1226 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:50:11.878332 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-2d038338-43e8-4cfb-858d-bbae8c2bd667 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Action: 'action', calling method: .version_select at 0x7fbb34da2d30>, body: {"addFloatingIp": {"address": "172.25.1.111"}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:50:11.883021 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-2d038338-43e8-4cfb-858d-bbae8c2bd667 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] [instance: fdc82b91-5dfa-44cf-b8c5-402922265d88] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:50:11.892094 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2d038338-43e8-4cfb-858d-bbae8c2bd667 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:11.893251 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2d038338-43e8-4cfb-858d-bbae8c2bd667 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:11.893955 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2d038338-43e8-4cfb-858d-bbae8c2bd667 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:11.894983 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2d038338-43e8-4cfb-858d-bbae8c2bd667 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:11.895566 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2d038338-43e8-4cfb-858d-bbae8c2bd667 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:11.896111 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2d038338-43e8-4cfb-858d-bbae8c2bd667 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:11.927047 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-4a4a2ebb-de9d-4ba8-99b4-ff7ba1aa7aa9 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:11.928330 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2d038338-43e8-4cfb-858d-bbae8c2bd667 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Acquiring lock "refresh_cache-fdc82b91-5dfa-44cf-b8c5-402922265d88" {{(pid=134102) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 04 21:50:11.928809 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2d038338-43e8-4cfb-858d-bbae8c2bd667 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Acquired lock "refresh_cache-fdc82b91-5dfa-44cf-b8c5-402922265d88" {{(pid=134102) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 04 21:50:11.934015 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-4a4a2ebb-de9d-4ba8-99b4-ff7ba1aa7aa9 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:11.935564 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-4a4a2ebb-de9d-4ba8-99b4-ff7ba1aa7aa9 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:11.937150 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-4a4a2ebb-de9d-4ba8-99b4-ff7ba1aa7aa9 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] 10.222.0.43 "GET /compute/v2.1/servers/d4abcd04-329d-40a8-8d6e-4383bef437ae" status: 200 len: 1814 microversion: 2.25 time: 0.479905 Oct 04 21:50:11.951004 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 848/1762] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:50:11 2022] GET /compute/v2.1/servers/d4abcd04-329d-40a8-8d6e-4383bef437ae => generated 1814 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:50:11.963279 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-ac9cea82-2212-4b58-a26f-45027c6e72a8 tempest-FloatingIPDetailsTestJSON-650903168 tempest-FloatingIPDetailsTestJSON-650903168-project] Calling method '.version_select at 0x7fbb37373e50>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:50:14.646917 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-ac9cea82-2212-4b58-a26f-45027c6e72a8 tempest-FloatingIPDetailsTestJSON-650903168 tempest-FloatingIPDetailsTestJSON-650903168-project] 10.222.0.43 "DELETE /compute/v2.1/os-floating-ips/a4f8fe2e-9818-41df-aae1-11901488fbc7" status: 202 len: 0 microversion: 2.1 time: 2.694574 Oct 04 21:50:14.647883 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 849/1763] 10.222.0.43 () {58 vars in 1263 bytes} [Tue Oct 4 21:50:11 2022] DELETE /compute/v2.1/os-floating-ips/a4f8fe2e-9818-41df-aae1-11901488fbc7 => generated 0 bytes in 2696 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:50:14.654464 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-95048d0a-b546-4f3f-af45-ae537ca93bcd tempest-ImagesMetadataTestJSON-1000283254 tempest-ImagesMetadataTestJSON-1000283254-project] Action: 'update_all', calling method: .version_select at 0x7fbb372cc790>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:50:14.760376 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-95048d0a-b546-4f3f-af45-ae537ca93bcd tempest-ImagesMetadataTestJSON-1000283254 tempest-ImagesMetadataTestJSON-1000283254-project] Getting quotas for project ed830eec825e4c6fb45a4063e9b24b15. Resources: dict_keys(['metadata_items']) {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:50:14.770701 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-95048d0a-b546-4f3f-af45-ae537ca93bcd tempest-ImagesMetadataTestJSON-1000283254 tempest-ImagesMetadataTestJSON-1000283254-project] Getting quotas for user e5264d8a9dc647f489a7fc930597e0b2 and project ed830eec825e4c6fb45a4063e9b24b15. Resources: dict_keys(['metadata_items']) {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:50:14.772506 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:50:15.171764 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-95048d0a-b546-4f3f-af45-ae537ca93bcd tempest-ImagesMetadataTestJSON-1000283254 tempest-ImagesMetadataTestJSON-1000283254-project] 10.222.0.43 "PUT /compute/v2.1/images/716dc685-bb05-4bba-9a60-122d1fad21d5/metadata" status: 200 len: 61 microversion: 2.1 time: 0.522561 Oct 04 21:50:15.172440 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 850/1764] 10.222.0.43 () {60 vars in 1280 bytes} [Tue Oct 4 21:50:14 2022] PUT /compute/v2.1/images/716dc685-bb05-4bba-9a60-122d1fad21d5/metadata => generated 61 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 21:50:15.183730 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-51ebc18e-7c3d-46dc-b0ec-61eef0e750cd tempest-ImagesNegativeTestJSON-71193266 tempest-ImagesNegativeTestJSON-71193266-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1144414732", "metadata": {"image_type": "test"}}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:50:15.187560 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-51ebc18e-7c3d-46dc-b0ec-61eef0e750cd tempest-ImagesNegativeTestJSON-71193266 tempest-ImagesNegativeTestJSON-71193266-project] [instance: 18c556c5-0b7d-4acb-9803-a504ab597fbb] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:50:15.197383 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-51ebc18e-7c3d-46dc-b0ec-61eef0e750cd tempest-ImagesNegativeTestJSON-71193266 tempest-ImagesNegativeTestJSON-71193266-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:15.198303 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-51ebc18e-7c3d-46dc-b0ec-61eef0e750cd tempest-ImagesNegativeTestJSON-71193266 tempest-ImagesNegativeTestJSON-71193266-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:15.199024 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-51ebc18e-7c3d-46dc-b0ec-61eef0e750cd tempest-ImagesNegativeTestJSON-71193266 tempest-ImagesNegativeTestJSON-71193266-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:15.199978 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-51ebc18e-7c3d-46dc-b0ec-61eef0e750cd tempest-ImagesNegativeTestJSON-71193266 tempest-ImagesNegativeTestJSON-71193266-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:15.201452 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-51ebc18e-7c3d-46dc-b0ec-61eef0e750cd tempest-ImagesNegativeTestJSON-71193266 tempest-ImagesNegativeTestJSON-71193266-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:15.203086 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-51ebc18e-7c3d-46dc-b0ec-61eef0e750cd tempest-ImagesNegativeTestJSON-71193266 tempest-ImagesNegativeTestJSON-71193266-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:15.224546 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-51ebc18e-7c3d-46dc-b0ec-61eef0e750cd tempest-ImagesNegativeTestJSON-71193266 tempest-ImagesNegativeTestJSON-71193266-project] HTTP exception thrown: Instance 18c556c5-0b7d-4acb-9803-a504ab597fbb could not be found. Oct 04 21:50:15.226856 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-51ebc18e-7c3d-46dc-b0ec-61eef0e750cd tempest-ImagesNegativeTestJSON-71193266 tempest-ImagesNegativeTestJSON-71193266-project] Request method failure captured: Oct 04 21:50:15.226856 n-d-860284-1 devstack@n-api.service[134101]: request: POST /compute/v2.1/servers/18c556c5-0b7d-4acb-9803-a504ab597fbb/action HTTP/1.1 Oct 04 21:50:15.226856 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 21:50:15.226856 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 21:50:15.226856 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 21:50:15.226856 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 112 Oct 04 21:50:15.226856 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 21:50:15.226856 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 21:50:15.226856 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 21:50:15.226856 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 21:50:15.226856 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPKp1tx3JdD7L-NqKYgSeGp-8e-_HDxzbWGGtT4IlN4hvI-8VQrD23-ZbIUyZkgg1KfshFmu351r76auJF1ZjP4iryQSWVmQ7PC_e8-Om781T3KjFBi8kNj7FfG1NkQT9dHnxXsOnmcxuj9JuH3KAECHtNV3qTtOpIZBGfo872DFRXI4 Oct 04 21:50:15.226856 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 21:50:15.226856 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 21:50:15.226856 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 21:50:15.226856 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 21:50:15.226856 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 21:50:15.226856 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 21:50:15.226856 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: b6559674f0b84e97948cd4286269507a Oct 04 21:50:15.226856 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-ImagesNegativeTestJSON-71193266 Oct 04 21:50:15.226856 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 21:50:15.226856 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 21:50:15.226856 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b6559674f0b84e97948cd4286269507a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_b6559674f0b84e97948cd4286269507a", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b6559674f0b84e97948cd4286269507a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/b6559674f0b84e97948cd4286269507a"}]}] Oct 04 21:50:15.226856 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-ImagesNegativeTestJSON-71193266 Oct 04 21:50:15.226856 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: b6559674f0b84e97948cd4286269507a Oct 04 21:50:15.226856 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-71193266 Oct 04 21:50:15.226856 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-ImagesNegativeTestJSON-71193266-project Oct 04 21:50:15.226856 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 21:50:15.226856 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 21:50:15.226856 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 7bd9fbc0c71d4e14b353a571dd257a0a Oct 04 21:50:15.226856 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-ImagesNegativeTestJSON-71193266-project Oct 04 21:50:15.226856 n-d-860284-1 devstack@n-api.service[134101]: Oct 04 21:50:15.226856 n-d-860284-1 devstack@n-api.service[134101]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1144414732", "metadata": {"image_type": "test"}}} Oct 04 21:50:15.226856 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 21:50:15.226856 n-d-860284-1 devstack@n-api.service[134101]: exception: Instance 18c556c5-0b7d-4acb-9803-a504ab597fbb could not be found. Oct 04 21:50:15.226856 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': '18c556c5-0b7d-4acb-9803-a504ab597fbb', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1144414732', 'metadata': {'image_type': 'test'}}}} Oct 04 21:50:15.226856 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:50:15.226856 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:50:15.226856 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:50:15.226856 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:50:15.226856 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:50:15.226856 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:50:15.226856 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:50:15.226856 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:50:15.226856 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:50:15.226856 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:50:15.226856 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18c556c5-0b7d-4acb-9803-a504ab597fbb could not be found. Oct 04 21:50:15.226856 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:50:15.226856 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:50:15.226856 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:50:15.226856 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:50:15.226856 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:50:15.226856 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:50:15.226856 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:50:15.226856 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:50:15.226856 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:50:15.226856 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:50:15.226856 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:50:15.226856 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:50:15.226856 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:50:15.226856 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:50:15.226856 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 04 21:50:15.226856 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 04 21:50:15.226856 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:50:15.232427 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:50:15.232427 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:50:15.232427 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:50:15.232427 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18c556c5-0b7d-4acb-9803-a504ab597fbb could not be found. Oct 04 21:50:15.232427 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:50:15.232427 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:50:15.232427 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:50:15.232427 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:50:15.232427 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:50:15.232427 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:50:15.232427 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:50:15.232427 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:50:15.232427 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18c556c5-0b7d-4acb-9803-a504ab597fbb could not be found. Oct 04 21:50:15.232427 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:50:15.237128 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-51ebc18e-7c3d-46dc-b0ec-61eef0e750cd tempest-ImagesNegativeTestJSON-71193266 tempest-ImagesNegativeTestJSON-71193266-project] Returning 404 to user: Instance 18c556c5-0b7d-4acb-9803-a504ab597fbb could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:50:15.240108 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-51ebc18e-7c3d-46dc-b0ec-61eef0e750cd tempest-ImagesNegativeTestJSON-71193266 tempest-ImagesNegativeTestJSON-71193266-project] 10.222.0.43 "POST /compute/v2.1/servers/18c556c5-0b7d-4acb-9803-a504ab597fbb/action" status: 404 len: 111 microversion: 2.1 time: 0.066190 Oct 04 21:50:15.241214 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 851/1765] 10.222.0.43 () {60 vars in 1279 bytes} [Tue Oct 4 21:50:15 2022] POST /compute/v2.1/servers/18c556c5-0b7d-4acb-9803-a504ab597fbb/action => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:50:15.261272 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-15535e3d-633c-45f9-b41f-5c6d17dca20b req-09de3c73-890a-4454-a4da-c552827fdd5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18c556c5-0b7d-4acb-9803-a504ab597fbb", "name": "network-vif-deleted", "tag": "dbb43da1-fb74-4dcb-8680-218d158e3dcc"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:50:15.291164 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-15535e3d-633c-45f9-b41f-5c6d17dca20b req-09de3c73-890a-4454-a4da-c552827fdd5d service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:15.302035 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-15535e3d-633c-45f9-b41f-5c6d17dca20b req-09de3c73-890a-4454-a4da-c552827fdd5d service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:15.302917 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-15535e3d-633c-45f9-b41f-5c6d17dca20b req-09de3c73-890a-4454-a4da-c552827fdd5d service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:15.312939 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.network.neutron [None req-2d038338-43e8-4cfb-858d-bbae8c2bd667 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] [instance: fdc82b91-5dfa-44cf-b8c5-402922265d88] Building network info cache for instance {{(pid=134102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 04 21:50:15.336884 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-15535e3d-633c-45f9-b41f-5c6d17dca20b req-09de3c73-890a-4454-a4da-c552827fdd5d service nova] Creating event network-vif-deleted:dbb43da1-fb74-4dcb-8680-218d158e3dcc for instance 18c556c5-0b7d-4acb-9803-a504ab597fbb on n-h1-860284-1 Oct 04 21:50:15.351805 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-15535e3d-633c-45f9-b41f-5c6d17dca20b req-09de3c73-890a-4454-a4da-c552827fdd5d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097384 Oct 04 21:50:15.353299 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 852/1766] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:50:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:50:15.366809 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-5234c027-1742-4e4f-a3df-1f10b0ff3a56 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:50:15.368878 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-5234c027-1742-4e4f-a3df-1f10b0ff3a56 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] [instance: 3f80e8f0-dba3-4403-83f8-0473c5d7d29b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:50:15.383488 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5234c027-1742-4e4f-a3df-1f10b0ff3a56 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:15.385448 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5234c027-1742-4e4f-a3df-1f10b0ff3a56 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:15.386139 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5234c027-1742-4e4f-a3df-1f10b0ff3a56 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:15.387182 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5234c027-1742-4e4f-a3df-1f10b0ff3a56 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:15.387862 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5234c027-1742-4e4f-a3df-1f10b0ff3a56 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:15.395264 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5234c027-1742-4e4f-a3df-1f10b0ff3a56 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:15.729968 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-5234c027-1742-4e4f-a3df-1f10b0ff3a56 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43653f2aea4e4884b5001dea5ec12be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b700f614a8b4cfba9b4abea45a06f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:15.753388 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-5234c027-1742-4e4f-a3df-1f10b0ff3a56 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43653f2aea4e4884b5001dea5ec12be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b700f614a8b4cfba9b4abea45a06f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:15.755088 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-5234c027-1742-4e4f-a3df-1f10b0ff3a56 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43653f2aea4e4884b5001dea5ec12be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b700f614a8b4cfba9b4abea45a06f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:15.761331 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-5234c027-1742-4e4f-a3df-1f10b0ff3a56 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] 10.222.0.43 "GET /compute/v2.1/servers/3f80e8f0-dba3-4403-83f8-0473c5d7d29b" status: 200 len: 1435 microversion: 2.75 time: 0.406618 Oct 04 21:50:15.766689 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 853/1767] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:50:15 2022] GET /compute/v2.1/servers/3f80e8f0-dba3-4403-83f8-0473c5d7d29b => generated 1435 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:50:15.776751 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-76f27f59-4b1d-4217-a77c-70283799915f tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:50:15.777677 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-76f27f59-4b1d-4217-a77c-70283799915f tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 3f0a02bc-7993-4849-8b3c-7572327b4799] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:50:15.807421 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-76f27f59-4b1d-4217-a77c-70283799915f tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:15.808737 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-76f27f59-4b1d-4217-a77c-70283799915f tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:15.808737 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-76f27f59-4b1d-4217-a77c-70283799915f tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:15.809991 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-76f27f59-4b1d-4217-a77c-70283799915f tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:15.810919 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-76f27f59-4b1d-4217-a77c-70283799915f tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:15.811451 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-76f27f59-4b1d-4217-a77c-70283799915f tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:16.289562 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-76f27f59-4b1d-4217-a77c-70283799915f tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ad048becf474fb972d4291422d810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dcfc7024fc49388c4bd5f25f03e60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:16.306541 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-76f27f59-4b1d-4217-a77c-70283799915f tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/3f0a02bc-7993-4849-8b3c-7572327b4799" status: 200 len: 1716 microversion: 2.1 time: 0.535984 Oct 04 21:50:16.309581 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 854/1768] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:50:15 2022] GET /compute/v2.1/servers/3f0a02bc-7993-4849-8b3c-7572327b4799 => generated 1716 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:50:16.323070 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-5c7ddcd4-c64b-4abc-a988-a5d16fc5b410 tempest-ServersTestFqdnHostnames-1740621305 tempest-ServersTestFqdnHostnames-1740621305-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:50:16.323821 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-5c7ddcd4-c64b-4abc-a988-a5d16fc5b410 tempest-ServersTestFqdnHostnames-1740621305 tempest-ServersTestFqdnHostnames-1740621305-project] [instance: a50a2117-fefe-499b-a2d4-b57e264a5a51] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:50:16.337328 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5c7ddcd4-c64b-4abc-a988-a5d16fc5b410 tempest-ServersTestFqdnHostnames-1740621305 tempest-ServersTestFqdnHostnames-1740621305-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:16.342152 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5c7ddcd4-c64b-4abc-a988-a5d16fc5b410 tempest-ServersTestFqdnHostnames-1740621305 tempest-ServersTestFqdnHostnames-1740621305-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:16.343881 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5c7ddcd4-c64b-4abc-a988-a5d16fc5b410 tempest-ServersTestFqdnHostnames-1740621305 tempest-ServersTestFqdnHostnames-1740621305-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:16.347130 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5c7ddcd4-c64b-4abc-a988-a5d16fc5b410 tempest-ServersTestFqdnHostnames-1740621305 tempest-ServersTestFqdnHostnames-1740621305-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:16.347951 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5c7ddcd4-c64b-4abc-a988-a5d16fc5b410 tempest-ServersTestFqdnHostnames-1740621305 tempest-ServersTestFqdnHostnames-1740621305-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:16.349634 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5c7ddcd4-c64b-4abc-a988-a5d16fc5b410 tempest-ServersTestFqdnHostnames-1740621305 tempest-ServersTestFqdnHostnames-1740621305-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:16.651789 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-5c7ddcd4-c64b-4abc-a988-a5d16fc5b410 tempest-ServersTestFqdnHostnames-1740621305 tempest-ServersTestFqdnHostnames-1740621305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ade6e5b885f4e7db1fef86de59a08de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dbdc46c0aa4d07a1eb5ade5b3a7212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:16.667046 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-5c7ddcd4-c64b-4abc-a988-a5d16fc5b410 tempest-ServersTestFqdnHostnames-1740621305 tempest-ServersTestFqdnHostnames-1740621305-project] 10.222.0.43 "GET /compute/v2.1/servers/a50a2117-fefe-499b-a2d4-b57e264a5a51" status: 200 len: 1351 microversion: 2.1 time: 0.356016 Oct 04 21:50:16.672990 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 855/1769] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:50:16 2022] GET /compute/v2.1/servers/a50a2117-fefe-499b-a2d4-b57e264a5a51 => generated 1351 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:50:16.681460 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-7c63848c-3bef-42d3-9f3b-8ac911377306 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:50:16.682411 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-7c63848c-3bef-42d3-9f3b-8ac911377306 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] [instance: d4abcd04-329d-40a8-8d6e-4383bef437ae] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:50:16.712809 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7c63848c-3bef-42d3-9f3b-8ac911377306 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:16.713329 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7c63848c-3bef-42d3-9f3b-8ac911377306 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:16.713774 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7c63848c-3bef-42d3-9f3b-8ac911377306 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:16.714545 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7c63848c-3bef-42d3-9f3b-8ac911377306 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:16.715007 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7c63848c-3bef-42d3-9f3b-8ac911377306 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:16.715430 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7c63848c-3bef-42d3-9f3b-8ac911377306 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:17.084794 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-7c63848c-3bef-42d3-9f3b-8ac911377306 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:17.124740 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-7c63848c-3bef-42d3-9f3b-8ac911377306 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:17.139787 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-7c63848c-3bef-42d3-9f3b-8ac911377306 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:17.141080 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-7c63848c-3bef-42d3-9f3b-8ac911377306 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] 10.222.0.43 "GET /compute/v2.1/servers/d4abcd04-329d-40a8-8d6e-4383bef437ae" status: 200 len: 1814 microversion: 2.25 time: 0.466771 Oct 04 21:50:17.141673 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 856/1770] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:50:16 2022] GET /compute/v2.1/servers/d4abcd04-329d-40a8-8d6e-4383bef437ae => generated 1814 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:50:17.183699 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-5a290882-7e4c-4d54-bcbd-b94ac2ecda26 tempest-ImagesMetadataTestJSON-1000283254 tempest-ImagesMetadataTestJSON-1000283254-project] Action: 'create', calling method: .version_select at 0x7fbb3739e820>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:50:17.270778 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-5a290882-7e4c-4d54-bcbd-b94ac2ecda26 tempest-ImagesMetadataTestJSON-1000283254 tempest-ImagesMetadataTestJSON-1000283254-project] Getting quotas for project ed830eec825e4c6fb45a4063e9b24b15. Resources: dict_keys(['metadata_items']) {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:50:17.281347 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-5a290882-7e4c-4d54-bcbd-b94ac2ecda26 tempest-ImagesMetadataTestJSON-1000283254 tempest-ImagesMetadataTestJSON-1000283254-project] Getting quotas for user e5264d8a9dc647f489a7fc930597e0b2 and project ed830eec825e4c6fb45a4063e9b24b15. Resources: dict_keys(['metadata_items']) {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:50:17.588765 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.network.neutron [None req-2d038338-43e8-4cfb-858d-bbae8c2bd667 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] [instance: fdc82b91-5dfa-44cf-b8c5-402922265d88] Updating instance_info_cache with network_info: [{"id": "c36556e1-4c6d-4308-8210-aa45c17cd2d1", "address": "fa:16:3e:30:86:84", "network": {"id": "e4c13216-4fea-4d87-aa16-a7572859740d", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1638687548-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.1.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "758fcafb5db74075b183978a97b7c4ee", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapc36556e1-4c", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=134102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 04 21:50:17.605064 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2d038338-43e8-4cfb-858d-bbae8c2bd667 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Releasing lock "refresh_cache-fdc82b91-5dfa-44cf-b8c5-402922265d88" {{(pid=134102) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 04 21:50:17.606415 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-2d038338-43e8-4cfb-858d-bbae8c2bd667 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] 10.222.0.43 "POST /compute/v2.1/servers/fdc82b91-5dfa-44cf-b8c5-402922265d88/action" status: 202 len: 0 microversion: 2.1 time: 5.733274 Oct 04 21:50:17.607492 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 915/1771] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 21:50:11 2022] POST /compute/v2.1/servers/fdc82b91-5dfa-44cf-b8c5-402922265d88/action => generated 0 bytes in 5736 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 04 21:50:17.615217 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-6c8ac425-4b72-4c8f-9d94-0a5a0f91b3a8 tempest-ImagesNegativeTestJSON-71193266 tempest-ImagesNegativeTestJSON-71193266-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1809149216", "metadata": {"image_type": "test"}}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:50:17.618512 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-6c8ac425-4b72-4c8f-9d94-0a5a0f91b3a8 tempest-ImagesNegativeTestJSON-71193266 tempest-ImagesNegativeTestJSON-71193266-project] Failed to fetch instance by id tempest-invalid-868767111 {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 04 21:50:17.620245 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-6c8ac425-4b72-4c8f-9d94-0a5a0f91b3a8 tempest-ImagesNegativeTestJSON-71193266 tempest-ImagesNegativeTestJSON-71193266-project] HTTP exception thrown: Instance tempest-invalid-868767111 could not be found. Oct 04 21:50:17.622434 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-6c8ac425-4b72-4c8f-9d94-0a5a0f91b3a8 tempest-ImagesNegativeTestJSON-71193266 tempest-ImagesNegativeTestJSON-71193266-project] Request method failure captured: Oct 04 21:50:17.622434 n-d-860284-1 devstack@n-api.service[134102]: request: POST /compute/v2.1/servers/tempest-invalid-868767111/action HTTP/1.1 Oct 04 21:50:17.622434 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 21:50:17.622434 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 21:50:17.622434 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 21:50:17.622434 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 112 Oct 04 21:50:17.622434 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 21:50:17.622434 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 21:50:17.622434 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 21:50:17.622434 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 21:50:17.622434 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPKp1tx3JdD7L-NqKYgSeGp-8e-_HDxzbWGGtT4IlN4hvI-8VQrD23-ZbIUyZkgg1KfshFmu351r76auJF1ZjP4iryQSWVmQ7PC_e8-Om781T3KjFBi8kNj7FfG1NkQT9dHnxXsOnmcxuj9JuH3KAECHtNV3qTtOpIZBGfo872DFRXI4 Oct 04 21:50:17.622434 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 21:50:17.622434 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 21:50:17.622434 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 21:50:17.622434 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 21:50:17.622434 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 21:50:17.622434 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 21:50:17.622434 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: b6559674f0b84e97948cd4286269507a Oct 04 21:50:17.622434 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-ImagesNegativeTestJSON-71193266 Oct 04 21:50:17.622434 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 21:50:17.622434 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 21:50:17.622434 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b6559674f0b84e97948cd4286269507a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_b6559674f0b84e97948cd4286269507a", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b6559674f0b84e97948cd4286269507a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/b6559674f0b84e97948cd4286269507a"}]}] Oct 04 21:50:17.622434 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-ImagesNegativeTestJSON-71193266 Oct 04 21:50:17.622434 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: b6559674f0b84e97948cd4286269507a Oct 04 21:50:17.622434 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-71193266 Oct 04 21:50:17.622434 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-ImagesNegativeTestJSON-71193266-project Oct 04 21:50:17.622434 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 21:50:17.622434 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 21:50:17.622434 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: 7bd9fbc0c71d4e14b353a571dd257a0a Oct 04 21:50:17.622434 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-ImagesNegativeTestJSON-71193266-project Oct 04 21:50:17.622434 n-d-860284-1 devstack@n-api.service[134102]: Oct 04 21:50:17.622434 n-d-860284-1 devstack@n-api.service[134102]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1809149216", "metadata": {"image_type": "test"}}} Oct 04 21:50:17.622434 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 21:50:17.622434 n-d-860284-1 devstack@n-api.service[134102]: exception: Instance tempest-invalid-868767111 could not be found. Oct 04 21:50:17.622434 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': 'tempest-invalid-868767111', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1809149216', 'metadata': {'image_type': 'test'}}}} Oct 04 21:50:17.622434 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:50:17.622434 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:50:17.622434 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:50:17.622434 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:50:17.622434 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 04 21:50:17.622434 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 04 21:50:17.622434 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-868767111 could not be found. Oct 04 21:50:17.622434 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:50:17.622434 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:50:17.622434 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:50:17.622434 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:50:17.622434 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:50:17.622434 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:50:17.622434 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:50:17.622434 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:50:17.622434 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:50:17.622434 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:50:17.622434 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:50:17.622434 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:50:17.622434 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:50:17.622434 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:50:17.622434 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 04 21:50:17.622434 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 04 21:50:17.622434 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:50:17.622434 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:50:17.622434 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:50:17.622434 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:50:17.622434 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-868767111 could not be found. Oct 04 21:50:17.626678 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:50:17.626678 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:50:17.626678 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:50:17.626678 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:50:17.626678 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:50:17.626678 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:50:17.626678 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:50:17.626678 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:50:17.626678 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-868767111 could not be found. Oct 04 21:50:17.626678 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:50:17.633953 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-6c8ac425-4b72-4c8f-9d94-0a5a0f91b3a8 tempest-ImagesNegativeTestJSON-71193266 tempest-ImagesNegativeTestJSON-71193266-project] Returning 404 to user: Instance tempest-invalid-868767111 could not be found. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:50:17.635078 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-6c8ac425-4b72-4c8f-9d94-0a5a0f91b3a8 tempest-ImagesNegativeTestJSON-71193266 tempest-ImagesNegativeTestJSON-71193266-project] 10.222.0.43 "POST /compute/v2.1/servers/tempest-invalid-868767111/action" status: 404 len: 100 microversion: 2.1 time: 0.025753 Oct 04 21:50:17.635874 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 916/1772] 10.222.0.43 () {60 vars in 1246 bytes} [Tue Oct 4 21:50:17 2022] POST /compute/v2.1/servers/tempest-invalid-868767111/action => generated 100 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:50:17.649812 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-631069ea-462b-478d-868d-605fe17f61c0 req-2f473349-bc9d-4b0f-9d07-e307bf7bd53c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fdc82b91-5dfa-44cf-b8c5-402922265d88", "tag": "c36556e1-4c6d-4308-8210-aa45c17cd2d1"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:50:17.661849 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-5a290882-7e4c-4d54-bcbd-b94ac2ecda26 tempest-ImagesMetadataTestJSON-1000283254 tempest-ImagesMetadataTestJSON-1000283254-project] 10.222.0.43 "POST /compute/v2.1/images/716dc685-bb05-4bba-9a60-122d1fad21d5/metadata" status: 200 len: 85 microversion: 2.1 time: 0.518637 Oct 04 21:50:17.662929 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 857/1773] 10.222.0.43 () {60 vars in 1281 bytes} [Tue Oct 4 21:50:17 2022] POST /compute/v2.1/images/716dc685-bb05-4bba-9a60-122d1fad21d5/metadata => generated 85 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 21:50:17.666206 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-631069ea-462b-478d-868d-605fe17f61c0 req-2f473349-bc9d-4b0f-9d07-e307bf7bd53c service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:17.666715 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-631069ea-462b-478d-868d-605fe17f61c0 req-2f473349-bc9d-4b0f-9d07-e307bf7bd53c service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:17.667146 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-631069ea-462b-478d-868d-605fe17f61c0 req-2f473349-bc9d-4b0f-9d07-e307bf7bd53c service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:17.671453 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e6a62f56-7f25-4b60-a0a2-c12d45ec0d21 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "58548514-5dac-426c-81f5-19e3fba33e23"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:50:17.676401 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-e6a62f56-7f25-4b60-a0a2-c12d45ec0d21 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] [instance: 3f80e8f0-dba3-4403-83f8-0473c5d7d29b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:50:17.683364 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e6a62f56-7f25-4b60-a0a2-c12d45ec0d21 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:17.683952 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-631069ea-462b-478d-868d-605fe17f61c0 req-2f473349-bc9d-4b0f-9d07-e307bf7bd53c service nova] Creating event network-changed:c36556e1-4c6d-4308-8210-aa45c17cd2d1 for instance fdc82b91-5dfa-44cf-b8c5-402922265d88 on n-h2-860284-1 Oct 04 21:50:17.684576 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e6a62f56-7f25-4b60-a0a2-c12d45ec0d21 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:17.685269 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e6a62f56-7f25-4b60-a0a2-c12d45ec0d21 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:17.686685 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e6a62f56-7f25-4b60-a0a2-c12d45ec0d21 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:17.687376 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e6a62f56-7f25-4b60-a0a2-c12d45ec0d21 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:17.688088 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e6a62f56-7f25-4b60-a0a2-c12d45ec0d21 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:17.689442 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-631069ea-462b-478d-868d-605fe17f61c0 req-2f473349-bc9d-4b0f-9d07-e307bf7bd53c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046238 Oct 04 21:50:17.691719 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 917/1774] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:50:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:50:17.702545 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-2cb98af6-1e53-4b60-ba7a-09dc1e35640f tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:50:17.703378 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-2cb98af6-1e53-4b60-ba7a-09dc1e35640f tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 3f0a02bc-7993-4849-8b3c-7572327b4799] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:50:17.719978 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2cb98af6-1e53-4b60-ba7a-09dc1e35640f tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:17.720483 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2cb98af6-1e53-4b60-ba7a-09dc1e35640f tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:17.723312 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2cb98af6-1e53-4b60-ba7a-09dc1e35640f tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:17.724081 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2cb98af6-1e53-4b60-ba7a-09dc1e35640f tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:17.724561 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2cb98af6-1e53-4b60-ba7a-09dc1e35640f tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:17.725001 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2cb98af6-1e53-4b60-ba7a-09dc1e35640f tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:17.741791 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=4,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=2,nova_cell1:RELEASE=2 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:50:17.810143 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-e6a62f56-7f25-4b60-a0a2-c12d45ec0d21 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Flavor limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:50:17.811245 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-e6a62f56-7f25-4b60-a0a2-c12d45ec0d21 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Image limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:50:17.811937 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-e6a62f56-7f25-4b60-a0a2-c12d45ec0d21 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Flavor pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:50:17.812531 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-e6a62f56-7f25-4b60-a0a2-c12d45ec0d21 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Image pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:50:17.813133 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-e6a62f56-7f25-4b60-a0a2-c12d45ec0d21 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:50:17.947187 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-e6a62f56-7f25-4b60-a0a2-c12d45ec0d21 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] [instance: 3f80e8f0-dba3-4403-83f8-0473c5d7d29b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:50:17.954770 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e6a62f56-7f25-4b60-a0a2-c12d45ec0d21 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:17.957064 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e6a62f56-7f25-4b60-a0a2-c12d45ec0d21 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:17.957768 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e6a62f56-7f25-4b60-a0a2-c12d45ec0d21 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:17.970042 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e6a62f56-7f25-4b60-a0a2-c12d45ec0d21 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:17.971710 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e6a62f56-7f25-4b60-a0a2-c12d45ec0d21 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:17.972487 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e6a62f56-7f25-4b60-a0a2-c12d45ec0d21 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:18.133574 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-e6a62f56-7f25-4b60-a0a2-c12d45ec0d21 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43653f2aea4e4884b5001dea5ec12be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b700f614a8b4cfba9b4abea45a06f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:18.140995 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:50:18.151439 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-e6a62f56-7f25-4b60-a0a2-c12d45ec0d21 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43653f2aea4e4884b5001dea5ec12be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b700f614a8b4cfba9b4abea45a06f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:18.156549 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-e6a62f56-7f25-4b60-a0a2-c12d45ec0d21 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43653f2aea4e4884b5001dea5ec12be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b700f614a8b4cfba9b4abea45a06f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:18.172532 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-e6a62f56-7f25-4b60-a0a2-c12d45ec0d21 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] 10.222.0.43 "POST /compute/v2.1/servers/3f80e8f0-dba3-4403-83f8-0473c5d7d29b/action" status: 202 len: 1492 microversion: 2.75 time: 0.508201 Oct 04 21:50:18.173812 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 858/1775] 10.222.0.43 () {62 vars in 1319 bytes} [Tue Oct 4 21:50:17 2022] POST /compute/v2.1/servers/3f80e8f0-dba3-4403-83f8-0473c5d7d29b/action => generated 1492 bytes in 510 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 04 21:50:18.179886 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-f4920173-c33c-46b3-901c-067e3693f146 req-b2609e2e-3761-4582-8b38-0ecd36447380 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a50a2117-fefe-499b-a2d4-b57e264a5a51", "tag": "be4ecfc6-29dd-49c4-9fc3-83e38314144a"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:50:18.192661 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-f4920173-c33c-46b3-901c-067e3693f146 req-b2609e2e-3761-4582-8b38-0ecd36447380 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:18.193154 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-f4920173-c33c-46b3-901c-067e3693f146 req-b2609e2e-3761-4582-8b38-0ecd36447380 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:18.193591 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-f4920173-c33c-46b3-901c-067e3693f146 req-b2609e2e-3761-4582-8b38-0ecd36447380 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:18.213580 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-f4920173-c33c-46b3-901c-067e3693f146 req-b2609e2e-3761-4582-8b38-0ecd36447380 service nova] Creating event network-changed:be4ecfc6-29dd-49c4-9fc3-83e38314144a for instance a50a2117-fefe-499b-a2d4-b57e264a5a51 on n-h1-860284-1 Oct 04 21:50:18.220390 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-f4920173-c33c-46b3-901c-067e3693f146 req-b2609e2e-3761-4582-8b38-0ecd36447380 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044248 Oct 04 21:50:18.221216 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 859/1776] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:50:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:50:18.227336 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-a1b69635-2936-49c9-9343-584834ba5a7f tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Calling method '.version_select at 0x7fbb3739e3a0>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:50:18.230670 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-2cb98af6-1e53-4b60-ba7a-09dc1e35640f tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ad048becf474fb972d4291422d810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dcfc7024fc49388c4bd5f25f03e60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:18.247681 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-2cb98af6-1e53-4b60-ba7a-09dc1e35640f tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/3f0a02bc-7993-4849-8b3c-7572327b4799" status: 200 len: 1716 microversion: 2.1 time: 0.554708 Oct 04 21:50:18.248857 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 918/1777] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:50:17 2022] GET /compute/v2.1/servers/3f0a02bc-7993-4849-8b3c-7572327b4799 => generated 1716 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:50:18.261212 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-795c57e5-f9c8-4c03-9a7a-9b9abf3fb573 tempest-ImagesNegativeTestJSON-71193266 tempest-ImagesNegativeTestJSON-71193266-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1149546146"}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:50:18.268642 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-795c57e5-f9c8-4c03-9a7a-9b9abf3fb573 tempest-ImagesNegativeTestJSON-71193266 tempest-ImagesNegativeTestJSON-71193266-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 04 21:50:18.269678 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-795c57e5-f9c8-4c03-9a7a-9b9abf3fb573 tempest-ImagesNegativeTestJSON-71193266 tempest-ImagesNegativeTestJSON-71193266-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 04 21:50:18.271627 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-795c57e5-f9c8-4c03-9a7a-9b9abf3fb573 tempest-ImagesNegativeTestJSON-71193266 tempest-ImagesNegativeTestJSON-71193266-project] Request method failure captured: Oct 04 21:50:18.271627 n-d-860284-1 devstack@n-api.service[134102]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Oct 04 21:50:18.271627 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 21:50:18.271627 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 21:50:18.271627 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 21:50:18.271627 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 57 Oct 04 21:50:18.271627 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 21:50:18.271627 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 21:50:18.271627 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 21:50:18.271627 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 21:50:18.271627 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPKp1tx3JdD7L-NqKYgSeGp-8e-_HDxzbWGGtT4IlN4hvI-8VQrD23-ZbIUyZkgg1KfshFmu351r76auJF1ZjP4iryQSWVmQ7PC_e8-Om781T3KjFBi8kNj7FfG1NkQT9dHnxXsOnmcxuj9JuH3KAECHtNV3qTtOpIZBGfo872DFRXI4 Oct 04 21:50:18.271627 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 21:50:18.271627 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 21:50:18.271627 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 21:50:18.271627 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 21:50:18.271627 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 21:50:18.271627 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 21:50:18.271627 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: b6559674f0b84e97948cd4286269507a Oct 04 21:50:18.271627 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-ImagesNegativeTestJSON-71193266 Oct 04 21:50:18.271627 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 21:50:18.271627 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 21:50:18.271627 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b6559674f0b84e97948cd4286269507a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_b6559674f0b84e97948cd4286269507a", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b6559674f0b84e97948cd4286269507a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/b6559674f0b84e97948cd4286269507a"}]}] Oct 04 21:50:18.271627 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-ImagesNegativeTestJSON-71193266 Oct 04 21:50:18.271627 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: b6559674f0b84e97948cd4286269507a Oct 04 21:50:18.271627 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-71193266 Oct 04 21:50:18.271627 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-ImagesNegativeTestJSON-71193266-project Oct 04 21:50:18.271627 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 21:50:18.271627 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 21:50:18.271627 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: 7bd9fbc0c71d4e14b353a571dd257a0a Oct 04 21:50:18.271627 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-ImagesNegativeTestJSON-71193266-project Oct 04 21:50:18.271627 n-d-860284-1 devstack@n-api.service[134102]: Oct 04 21:50:18.271627 n-d-860284-1 devstack@n-api.service[134102]: {"createImage": {"name": "tempest-test-snap-1149546146"}} Oct 04 21:50:18.271627 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 21:50:18.271627 n-d-860284-1 devstack@n-api.service[134102]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 04 21:50:18.271627 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-1149546146'}}} Oct 04 21:50:18.271627 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:50:18.271627 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:50:18.271627 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:50:18.271627 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:50:18.271627 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 04 21:50:18.271627 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 04 21:50:18.271627 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 04 21:50:18.271627 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:50:18.271627 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:50:18.271627 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:50:18.271627 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:50:18.271627 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:50:18.271627 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:50:18.271627 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:50:18.271627 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:50:18.271627 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:50:18.271627 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:50:18.271627 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:50:18.271627 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:50:18.271627 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:50:18.271627 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:50:18.271627 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 04 21:50:18.271627 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 04 21:50:18.271627 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:50:18.271627 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:50:18.271627 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:50:18.271627 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:50:18.271627 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 04 21:50:18.271627 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:50:18.276452 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:50:18.276452 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:50:18.276452 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:50:18.276452 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:50:18.276452 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:50:18.276452 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:50:18.276452 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:50:18.276452 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 04 21:50:18.276452 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:50:18.278139 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-795c57e5-f9c8-4c03-9a7a-9b9abf3fb573 tempest-ImagesNegativeTestJSON-71193266 tempest-ImagesNegativeTestJSON-71193266-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:50:18.279876 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-795c57e5-f9c8-4c03-9a7a-9b9abf3fb573 tempest-ImagesNegativeTestJSON-71193266 tempest-ImagesNegativeTestJSON-71193266-project] 10.222.0.43 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.027577 Oct 04 21:50:18.280698 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 919/1778] 10.222.0.43 () {60 vars in 1275 bytes} [Tue Oct 4 21:50:18 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:50:18.286150 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-151d6e95-5c87-492f-9d26-d8be7065a772 tempest-ImagesMetadataTestJSON-1000283254 tempest-ImagesMetadataTestJSON-1000283254-project] Calling method '.version_select at 0x7fbb2f8c1af0>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:50:18.365803 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-151d6e95-5c87-492f-9d26-d8be7065a772 tempest-ImagesMetadataTestJSON-1000283254 tempest-ImagesMetadataTestJSON-1000283254-project] 10.222.0.43 "GET /compute/v2.1/images/716dc685-bb05-4bba-9a60-122d1fad21d5/metadata" status: 200 len: 85 microversion: 2.1 time: 0.083673 Oct 04 21:50:18.366339 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 920/1779] 10.222.0.43 () {58 vars in 1260 bytes} [Tue Oct 4 21:50:18 2022] GET /compute/v2.1/images/716dc685-bb05-4bba-9a60-122d1fad21d5/metadata => generated 85 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 21:50:18.387799 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-0c33ff34-846b-4024-9a8e-aec3cfe2a884 tempest-ServersTestFqdnHostnames-1740621305 tempest-ServersTestFqdnHostnames-1740621305-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:50:18.388974 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-0c33ff34-846b-4024-9a8e-aec3cfe2a884 tempest-ServersTestFqdnHostnames-1740621305 tempest-ServersTestFqdnHostnames-1740621305-project] [instance: a50a2117-fefe-499b-a2d4-b57e264a5a51] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:50:18.398632 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0c33ff34-846b-4024-9a8e-aec3cfe2a884 tempest-ServersTestFqdnHostnames-1740621305 tempest-ServersTestFqdnHostnames-1740621305-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:18.399559 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0c33ff34-846b-4024-9a8e-aec3cfe2a884 tempest-ServersTestFqdnHostnames-1740621305 tempest-ServersTestFqdnHostnames-1740621305-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:18.403658 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0c33ff34-846b-4024-9a8e-aec3cfe2a884 tempest-ServersTestFqdnHostnames-1740621305 tempest-ServersTestFqdnHostnames-1740621305-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:18.404046 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0c33ff34-846b-4024-9a8e-aec3cfe2a884 tempest-ServersTestFqdnHostnames-1740621305 tempest-ServersTestFqdnHostnames-1740621305-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:18.430982 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0c33ff34-846b-4024-9a8e-aec3cfe2a884 tempest-ServersTestFqdnHostnames-1740621305 tempest-ServersTestFqdnHostnames-1740621305-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:18.432575 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0c33ff34-846b-4024-9a8e-aec3cfe2a884 tempest-ServersTestFqdnHostnames-1740621305 tempest-ServersTestFqdnHostnames-1740621305-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:18.660777 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-a1b69635-2936-49c9-9343-584834ba5a7f tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] 10.222.0.43 "GET /compute/v2.1/os-floating-ips/170713b9-2dcd-445b-b5de-8c303609f758" status: 200 len: 185 microversion: 2.1 time: 0.437944 Oct 04 21:50:18.661837 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 860/1780] 10.222.0.43 () {58 vars in 1260 bytes} [Tue Oct 4 21:50:18 2022] GET /compute/v2.1/os-floating-ips/170713b9-2dcd-445b-b5de-8c303609f758 => generated 185 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:50:18.667708 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-fd2a00b9-987a-432d-91e1-35ce318ad201 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:50:18.668510 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-fd2a00b9-987a-432d-91e1-35ce318ad201 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] [instance: d4abcd04-329d-40a8-8d6e-4383bef437ae] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:50:18.676391 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fd2a00b9-987a-432d-91e1-35ce318ad201 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:18.677764 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fd2a00b9-987a-432d-91e1-35ce318ad201 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:18.678450 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fd2a00b9-987a-432d-91e1-35ce318ad201 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:18.679590 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fd2a00b9-987a-432d-91e1-35ce318ad201 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:18.680425 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fd2a00b9-987a-432d-91e1-35ce318ad201 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:18.680995 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fd2a00b9-987a-432d-91e1-35ce318ad201 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:18.849720 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-0c33ff34-846b-4024-9a8e-aec3cfe2a884 tempest-ServersTestFqdnHostnames-1740621305 tempest-ServersTestFqdnHostnames-1740621305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ade6e5b885f4e7db1fef86de59a08de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dbdc46c0aa4d07a1eb5ade5b3a7212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:18.882804 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-0c33ff34-846b-4024-9a8e-aec3cfe2a884 tempest-ServersTestFqdnHostnames-1740621305 tempest-ServersTestFqdnHostnames-1740621305-project] 10.222.0.43 "GET /compute/v2.1/servers/a50a2117-fefe-499b-a2d4-b57e264a5a51" status: 200 len: 1351 microversion: 2.1 time: 0.511338 Oct 04 21:50:18.885362 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 921/1781] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:50:18 2022] GET /compute/v2.1/servers/a50a2117-fefe-499b-a2d4-b57e264a5a51 => generated 1351 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:50:18.893601 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-18e77b63-5ed2-469a-a810-8958d7f80b9f tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:50:18.895174 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-18e77b63-5ed2-469a-a810-8958d7f80b9f tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] [instance: 3f80e8f0-dba3-4403-83f8-0473c5d7d29b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:50:18.902534 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-18e77b63-5ed2-469a-a810-8958d7f80b9f tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:18.903029 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-18e77b63-5ed2-469a-a810-8958d7f80b9f tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:18.903682 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-18e77b63-5ed2-469a-a810-8958d7f80b9f tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:18.904394 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-18e77b63-5ed2-469a-a810-8958d7f80b9f tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:18.905069 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-18e77b63-5ed2-469a-a810-8958d7f80b9f tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:18.905677 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-18e77b63-5ed2-469a-a810-8958d7f80b9f tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:18.942236 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-fd2a00b9-987a-432d-91e1-35ce318ad201 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:18.957652 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-fd2a00b9-987a-432d-91e1-35ce318ad201 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:18.959083 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-fd2a00b9-987a-432d-91e1-35ce318ad201 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:18.961737 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-fd2a00b9-987a-432d-91e1-35ce318ad201 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] 10.222.0.43 "GET /compute/v2.1/servers/d4abcd04-329d-40a8-8d6e-4383bef437ae" status: 200 len: 1814 microversion: 2.25 time: 0.298734 Oct 04 21:50:18.972560 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 861/1782] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:50:18 2022] GET /compute/v2.1/servers/d4abcd04-329d-40a8-8d6e-4383bef437ae => generated 1814 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:50:18.985343 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-d1f1eed8-ad59-4456-bec5-e528d5cdf7e3 tempest-ImagesNegativeTestJSON-71193266 tempest-ImagesNegativeTestJSON-71193266-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1596026002"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:50:18.989506 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-d1f1eed8-ad59-4456-bec5-e528d5cdf7e3 tempest-ImagesNegativeTestJSON-71193266 tempest-ImagesNegativeTestJSON-71193266-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 04 21:50:18.990513 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-d1f1eed8-ad59-4456-bec5-e528d5cdf7e3 tempest-ImagesNegativeTestJSON-71193266 tempest-ImagesNegativeTestJSON-71193266-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 04 21:50:18.992683 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-d1f1eed8-ad59-4456-bec5-e528d5cdf7e3 tempest-ImagesNegativeTestJSON-71193266 tempest-ImagesNegativeTestJSON-71193266-project] Request method failure captured: Oct 04 21:50:18.992683 n-d-860284-1 devstack@n-api.service[134101]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Oct 04 21:50:18.992683 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 21:50:18.992683 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 21:50:18.992683 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 21:50:18.992683 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 57 Oct 04 21:50:18.992683 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 21:50:18.992683 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 21:50:18.992683 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 21:50:18.992683 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 21:50:18.992683 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPKp1tx3JdD7L-NqKYgSeGp-8e-_HDxzbWGGtT4IlN4hvI-8VQrD23-ZbIUyZkgg1KfshFmu351r76auJF1ZjP4iryQSWVmQ7PC_e8-Om781T3KjFBi8kNj7FfG1NkQT9dHnxXsOnmcxuj9JuH3KAECHtNV3qTtOpIZBGfo872DFRXI4 Oct 04 21:50:18.992683 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 21:50:18.992683 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 21:50:18.992683 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 21:50:18.992683 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 21:50:18.992683 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 21:50:18.992683 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 21:50:18.992683 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: b6559674f0b84e97948cd4286269507a Oct 04 21:50:18.992683 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-ImagesNegativeTestJSON-71193266 Oct 04 21:50:18.992683 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 21:50:18.992683 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 21:50:18.992683 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b6559674f0b84e97948cd4286269507a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_b6559674f0b84e97948cd4286269507a", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b6559674f0b84e97948cd4286269507a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/b6559674f0b84e97948cd4286269507a"}]}] Oct 04 21:50:18.992683 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-ImagesNegativeTestJSON-71193266 Oct 04 21:50:18.992683 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: b6559674f0b84e97948cd4286269507a Oct 04 21:50:18.992683 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-71193266 Oct 04 21:50:18.992683 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-ImagesNegativeTestJSON-71193266-project Oct 04 21:50:18.992683 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 21:50:18.992683 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 21:50:18.992683 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 7bd9fbc0c71d4e14b353a571dd257a0a Oct 04 21:50:18.992683 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-ImagesNegativeTestJSON-71193266-project Oct 04 21:50:18.992683 n-d-860284-1 devstack@n-api.service[134101]: Oct 04 21:50:18.992683 n-d-860284-1 devstack@n-api.service[134101]: {"createImage": {"name": "tempest-test-snap-1596026002"}} Oct 04 21:50:18.992683 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 21:50:18.992683 n-d-860284-1 devstack@n-api.service[134101]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 04 21:50:18.992683 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-1596026002'}}} Oct 04 21:50:18.992683 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:50:18.992683 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:50:18.992683 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:50:18.992683 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:50:18.992683 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 04 21:50:18.992683 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 04 21:50:18.992683 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 04 21:50:18.992683 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:50:18.992683 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:50:18.992683 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:50:18.992683 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:50:18.992683 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:50:18.992683 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:50:18.992683 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:50:18.992683 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:50:18.992683 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:50:18.992683 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:50:18.992683 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:50:18.992683 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:50:18.992683 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:50:18.992683 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:50:18.992683 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 04 21:50:18.992683 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 04 21:50:18.992683 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:50:18.992683 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:50:18.992683 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:50:18.992683 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:50:18.992683 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 04 21:50:18.992683 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:50:18.997152 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:50:18.997152 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:50:18.997152 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:50:18.997152 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:50:18.997152 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:50:18.997152 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:50:18.997152 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:50:18.997152 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 04 21:50:18.997152 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:50:18.999255 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-d1f1eed8-ad59-4456-bec5-e528d5cdf7e3 tempest-ImagesNegativeTestJSON-71193266 tempest-ImagesNegativeTestJSON-71193266-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:50:19.000386 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-d1f1eed8-ad59-4456-bec5-e528d5cdf7e3 tempest-ImagesNegativeTestJSON-71193266 tempest-ImagesNegativeTestJSON-71193266-project] 10.222.0.43 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.026541 Oct 04 21:50:19.001215 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 862/1783] 10.222.0.43 () {60 vars in 1281 bytes} [Tue Oct 4 21:50:18 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:50:19.010418 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-99a0a5d0-1153-47f2-9b4c-964996ed3ed5 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.1.111"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:50:19.103881 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-18e77b63-5ed2-469a-a810-8958d7f80b9f tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43653f2aea4e4884b5001dea5ec12be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b700f614a8b4cfba9b4abea45a06f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:19.115210 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-18e77b63-5ed2-469a-a810-8958d7f80b9f tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43653f2aea4e4884b5001dea5ec12be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b700f614a8b4cfba9b4abea45a06f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:19.117278 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-18e77b63-5ed2-469a-a810-8958d7f80b9f tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43653f2aea4e4884b5001dea5ec12be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b700f614a8b4cfba9b4abea45a06f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:19.136296 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-18e77b63-5ed2-469a-a810-8958d7f80b9f tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] 10.222.0.43 "GET /compute/v2.1/servers/3f80e8f0-dba3-4403-83f8-0473c5d7d29b" status: 200 len: 1444 microversion: 2.75 time: 0.247693 Oct 04 21:50:19.137684 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 922/1784] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:50:18 2022] GET /compute/v2.1/servers/3f80e8f0-dba3-4403-83f8-0473c5d7d29b => generated 1444 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:50:19.146751 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-461daa3c-cb00-4e64-b1e0-cb987315a4e3 tempest-ImagesNegativeTestJSON-71193266 tempest-ImagesNegativeTestJSON-71193266-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:50:19.147299 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-461daa3c-cb00-4e64-b1e0-cb987315a4e3 tempest-ImagesNegativeTestJSON-71193266 tempest-ImagesNegativeTestJSON-71193266-project] [instance: 18c556c5-0b7d-4acb-9803-a504ab597fbb] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:50:19.156037 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-461daa3c-cb00-4e64-b1e0-cb987315a4e3 tempest-ImagesNegativeTestJSON-71193266 tempest-ImagesNegativeTestJSON-71193266-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:19.156591 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-461daa3c-cb00-4e64-b1e0-cb987315a4e3 tempest-ImagesNegativeTestJSON-71193266 tempest-ImagesNegativeTestJSON-71193266-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:19.157038 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-461daa3c-cb00-4e64-b1e0-cb987315a4e3 tempest-ImagesNegativeTestJSON-71193266 tempest-ImagesNegativeTestJSON-71193266-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:19.157864 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-461daa3c-cb00-4e64-b1e0-cb987315a4e3 tempest-ImagesNegativeTestJSON-71193266 tempest-ImagesNegativeTestJSON-71193266-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:19.159139 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-461daa3c-cb00-4e64-b1e0-cb987315a4e3 tempest-ImagesNegativeTestJSON-71193266 tempest-ImagesNegativeTestJSON-71193266-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:19.159593 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-461daa3c-cb00-4e64-b1e0-cb987315a4e3 tempest-ImagesNegativeTestJSON-71193266 tempest-ImagesNegativeTestJSON-71193266-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:19.177096 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-461daa3c-cb00-4e64-b1e0-cb987315a4e3 tempest-ImagesNegativeTestJSON-71193266 tempest-ImagesNegativeTestJSON-71193266-project] HTTP exception thrown: Instance 18c556c5-0b7d-4acb-9803-a504ab597fbb could not be found. Oct 04 21:50:19.178719 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-461daa3c-cb00-4e64-b1e0-cb987315a4e3 tempest-ImagesNegativeTestJSON-71193266 tempest-ImagesNegativeTestJSON-71193266-project] Request method failure captured: Oct 04 21:50:19.178719 n-d-860284-1 devstack@n-api.service[134102]: request: DELETE /compute/v2.1/servers/18c556c5-0b7d-4acb-9803-a504ab597fbb HTTP/1.1 Oct 04 21:50:19.178719 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 21:50:19.178719 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 21:50:19.178719 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 21:50:19.178719 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 21:50:19.178719 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 21:50:19.178719 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 21:50:19.178719 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 21:50:19.178719 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 21:50:19.178719 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPKp1tx3JdD7L-NqKYgSeGp-8e-_HDxzbWGGtT4IlN4hvI-8VQrD23-ZbIUyZkgg1KfshFmu351r76auJF1ZjP4iryQSWVmQ7PC_e8-Om781T3KjFBi8kNj7FfG1NkQT9dHnxXsOnmcxuj9JuH3KAECHtNV3qTtOpIZBGfo872DFRXI4 Oct 04 21:50:19.178719 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 21:50:19.178719 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 21:50:19.178719 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 21:50:19.178719 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 21:50:19.178719 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 21:50:19.178719 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 21:50:19.178719 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: b6559674f0b84e97948cd4286269507a Oct 04 21:50:19.178719 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-ImagesNegativeTestJSON-71193266 Oct 04 21:50:19.178719 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 21:50:19.178719 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 21:50:19.178719 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b6559674f0b84e97948cd4286269507a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_b6559674f0b84e97948cd4286269507a", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b6559674f0b84e97948cd4286269507a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/b6559674f0b84e97948cd4286269507a"}]}] Oct 04 21:50:19.178719 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-ImagesNegativeTestJSON-71193266 Oct 04 21:50:19.178719 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: b6559674f0b84e97948cd4286269507a Oct 04 21:50:19.178719 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-71193266 Oct 04 21:50:19.178719 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-ImagesNegativeTestJSON-71193266-project Oct 04 21:50:19.178719 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 21:50:19.178719 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 21:50:19.178719 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: 7bd9fbc0c71d4e14b353a571dd257a0a Oct 04 21:50:19.178719 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-ImagesNegativeTestJSON-71193266-project Oct 04 21:50:19.178719 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 21:50:19.178719 n-d-860284-1 devstack@n-api.service[134102]: exception: Instance 18c556c5-0b7d-4acb-9803-a504ab597fbb could not be found. Oct 04 21:50:19.178719 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': '18c556c5-0b7d-4acb-9803-a504ab597fbb'} Oct 04 21:50:19.178719 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:50:19.178719 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:50:19.178719 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:50:19.178719 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:50:19.178719 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:50:19.178719 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:50:19.178719 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:50:19.178719 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:50:19.178719 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:50:19.178719 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:50:19.178719 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18c556c5-0b7d-4acb-9803-a504ab597fbb could not be found. Oct 04 21:50:19.178719 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:50:19.178719 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:50:19.178719 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:50:19.178719 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:50:19.178719 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:50:19.178719 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:50:19.178719 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:50:19.178719 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:50:19.178719 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:50:19.178719 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:50:19.178719 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 21:50:19.178719 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 21:50:19.178719 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 21:50:19.178719 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 21:50:19.178719 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:50:19.178719 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:50:19.178719 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:50:19.178719 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:50:19.183828 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18c556c5-0b7d-4acb-9803-a504ab597fbb could not be found. Oct 04 21:50:19.183828 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:50:19.183828 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:50:19.183828 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:50:19.183828 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:50:19.183828 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:50:19.183828 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:50:19.183828 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:50:19.183828 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:50:19.183828 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18c556c5-0b7d-4acb-9803-a504ab597fbb could not be found. Oct 04 21:50:19.183828 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:50:19.183828 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-461daa3c-cb00-4e64-b1e0-cb987315a4e3 tempest-ImagesNegativeTestJSON-71193266 tempest-ImagesNegativeTestJSON-71193266-project] Returning 404 to user: Instance 18c556c5-0b7d-4acb-9803-a504ab597fbb could not be found. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:50:19.183828 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-461daa3c-cb00-4e64-b1e0-cb987315a4e3 tempest-ImagesNegativeTestJSON-71193266 tempest-ImagesNegativeTestJSON-71193266-project] 10.222.0.43 "DELETE /compute/v2.1/servers/18c556c5-0b7d-4acb-9803-a504ab597fbb" status: 404 len: 111 microversion: 2.1 time: 0.040867 Oct 04 21:50:19.183828 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 923/1785] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 21:50:19 2022] DELETE /compute/v2.1/servers/18c556c5-0b7d-4acb-9803-a504ab597fbb => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:50:19.191092 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-c927b4bf-dbbb-49ac-bf1a-aa9c9a87dc91 tempest-ImagesNegativeTestJSON-71193266 tempest-ImagesNegativeTestJSON-71193266-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:50:19.191843 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-c927b4bf-dbbb-49ac-bf1a-aa9c9a87dc91 tempest-ImagesNegativeTestJSON-71193266 tempest-ImagesNegativeTestJSON-71193266-project] [instance: 18c556c5-0b7d-4acb-9803-a504ab597fbb] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:50:19.199562 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c927b4bf-dbbb-49ac-bf1a-aa9c9a87dc91 tempest-ImagesNegativeTestJSON-71193266 tempest-ImagesNegativeTestJSON-71193266-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:19.200157 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c927b4bf-dbbb-49ac-bf1a-aa9c9a87dc91 tempest-ImagesNegativeTestJSON-71193266 tempest-ImagesNegativeTestJSON-71193266-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:19.200710 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c927b4bf-dbbb-49ac-bf1a-aa9c9a87dc91 tempest-ImagesNegativeTestJSON-71193266 tempest-ImagesNegativeTestJSON-71193266-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:19.201556 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c927b4bf-dbbb-49ac-bf1a-aa9c9a87dc91 tempest-ImagesNegativeTestJSON-71193266 tempest-ImagesNegativeTestJSON-71193266-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:19.202102 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c927b4bf-dbbb-49ac-bf1a-aa9c9a87dc91 tempest-ImagesNegativeTestJSON-71193266 tempest-ImagesNegativeTestJSON-71193266-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:19.202668 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c927b4bf-dbbb-49ac-bf1a-aa9c9a87dc91 tempest-ImagesNegativeTestJSON-71193266 tempest-ImagesNegativeTestJSON-71193266-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:19.220667 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-c927b4bf-dbbb-49ac-bf1a-aa9c9a87dc91 tempest-ImagesNegativeTestJSON-71193266 tempest-ImagesNegativeTestJSON-71193266-project] HTTP exception thrown: Instance 18c556c5-0b7d-4acb-9803-a504ab597fbb could not be found. Oct 04 21:50:19.222858 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-c927b4bf-dbbb-49ac-bf1a-aa9c9a87dc91 tempest-ImagesNegativeTestJSON-71193266 tempest-ImagesNegativeTestJSON-71193266-project] Request method failure captured: Oct 04 21:50:19.222858 n-d-860284-1 devstack@n-api.service[134102]: request: GET /compute/v2.1/servers/18c556c5-0b7d-4acb-9803-a504ab597fbb HTTP/1.1 Oct 04 21:50:19.222858 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 21:50:19.222858 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 21:50:19.222858 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 21:50:19.222858 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 21:50:19.222858 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 21:50:19.222858 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 21:50:19.222858 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 21:50:19.222858 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 21:50:19.222858 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPKp1tx3JdD7L-NqKYgSeGp-8e-_HDxzbWGGtT4IlN4hvI-8VQrD23-ZbIUyZkgg1KfshFmu351r76auJF1ZjP4iryQSWVmQ7PC_e8-Om781T3KjFBi8kNj7FfG1NkQT9dHnxXsOnmcxuj9JuH3KAECHtNV3qTtOpIZBGfo872DFRXI4 Oct 04 21:50:19.222858 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 21:50:19.222858 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 21:50:19.222858 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 21:50:19.222858 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 21:50:19.222858 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 21:50:19.222858 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 21:50:19.222858 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: b6559674f0b84e97948cd4286269507a Oct 04 21:50:19.222858 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-ImagesNegativeTestJSON-71193266 Oct 04 21:50:19.222858 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 21:50:19.222858 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 21:50:19.222858 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b6559674f0b84e97948cd4286269507a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_b6559674f0b84e97948cd4286269507a", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b6559674f0b84e97948cd4286269507a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/b6559674f0b84e97948cd4286269507a"}]}] Oct 04 21:50:19.222858 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-ImagesNegativeTestJSON-71193266 Oct 04 21:50:19.222858 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: b6559674f0b84e97948cd4286269507a Oct 04 21:50:19.222858 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-71193266 Oct 04 21:50:19.222858 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-ImagesNegativeTestJSON-71193266-project Oct 04 21:50:19.222858 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 21:50:19.222858 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 21:50:19.222858 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: 7bd9fbc0c71d4e14b353a571dd257a0a Oct 04 21:50:19.222858 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-ImagesNegativeTestJSON-71193266-project Oct 04 21:50:19.222858 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 21:50:19.222858 n-d-860284-1 devstack@n-api.service[134102]: exception: Instance 18c556c5-0b7d-4acb-9803-a504ab597fbb could not be found. Oct 04 21:50:19.222858 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': '18c556c5-0b7d-4acb-9803-a504ab597fbb'} Oct 04 21:50:19.222858 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:50:19.222858 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:50:19.222858 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:50:19.222858 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:50:19.222858 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:50:19.222858 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:50:19.222858 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:50:19.222858 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:50:19.222858 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:50:19.222858 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:50:19.222858 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18c556c5-0b7d-4acb-9803-a504ab597fbb could not be found. Oct 04 21:50:19.222858 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:50:19.222858 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:50:19.222858 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:50:19.222858 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:50:19.222858 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:50:19.222858 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:50:19.222858 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:50:19.222858 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:50:19.222858 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:50:19.222858 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:50:19.222858 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:50:19.222858 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:50:19.222858 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:50:19.222858 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:50:19.222858 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:50:19.222858 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:50:19.222858 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18c556c5-0b7d-4acb-9803-a504ab597fbb could not be found. Oct 04 21:50:19.222858 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:50:19.222858 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:50:19.222858 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:50:19.227820 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:50:19.227820 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:50:19.227820 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:50:19.227820 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:50:19.227820 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:50:19.227820 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18c556c5-0b7d-4acb-9803-a504ab597fbb could not be found. Oct 04 21:50:19.227820 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:50:19.230168 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-c927b4bf-dbbb-49ac-bf1a-aa9c9a87dc91 tempest-ImagesNegativeTestJSON-71193266 tempest-ImagesNegativeTestJSON-71193266-project] Returning 404 to user: Instance 18c556c5-0b7d-4acb-9803-a504ab597fbb could not be found. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:50:19.231322 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-c927b4bf-dbbb-49ac-bf1a-aa9c9a87dc91 tempest-ImagesNegativeTestJSON-71193266 tempest-ImagesNegativeTestJSON-71193266-project] 10.222.0.43 "GET /compute/v2.1/servers/18c556c5-0b7d-4acb-9803-a504ab597fbb" status: 404 len: 111 microversion: 2.1 time: 0.045704 Oct 04 21:50:19.232455 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 924/1786] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:50:19 2022] GET /compute/v2.1/servers/18c556c5-0b7d-4acb-9803-a504ab597fbb => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:50:19.273946 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-707ccae1-2dd5-4e2e-b71e-e32f6d4fad92 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:50:19.274606 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-707ccae1-2dd5-4e2e-b71e-e32f6d4fad92 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 3f0a02bc-7993-4849-8b3c-7572327b4799] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:50:19.283810 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-707ccae1-2dd5-4e2e-b71e-e32f6d4fad92 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:19.284319 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-707ccae1-2dd5-4e2e-b71e-e32f6d4fad92 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:19.289357 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-707ccae1-2dd5-4e2e-b71e-e32f6d4fad92 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:19.290640 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-707ccae1-2dd5-4e2e-b71e-e32f6d4fad92 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:19.291674 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-707ccae1-2dd5-4e2e-b71e-e32f6d4fad92 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:19.294239 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-707ccae1-2dd5-4e2e-b71e-e32f6d4fad92 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:19.324993 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-99a0a5d0-1153-47f2-9b4c-964996ed3ed5 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] [instance: fdc82b91-5dfa-44cf-b8c5-402922265d88] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:50:19.343351 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-99a0a5d0-1153-47f2-9b4c-964996ed3ed5 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:19.345546 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-99a0a5d0-1153-47f2-9b4c-964996ed3ed5 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:19.347523 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-99a0a5d0-1153-47f2-9b4c-964996ed3ed5 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:19.348896 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-99a0a5d0-1153-47f2-9b4c-964996ed3ed5 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:19.349716 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-99a0a5d0-1153-47f2-9b4c-964996ed3ed5 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:19.350506 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-99a0a5d0-1153-47f2-9b4c-964996ed3ed5 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:19.675112 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-707ccae1-2dd5-4e2e-b71e-e32f6d4fad92 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ad048becf474fb972d4291422d810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dcfc7024fc49388c4bd5f25f03e60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:19.683848 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-707ccae1-2dd5-4e2e-b71e-e32f6d4fad92 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/3f0a02bc-7993-4849-8b3c-7572327b4799" status: 200 len: 1716 microversion: 2.1 time: 0.414151 Oct 04 21:50:19.684428 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 925/1787] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:50:19 2022] GET /compute/v2.1/servers/3f0a02bc-7993-4849-8b3c-7572327b4799 => generated 1716 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:50:19.806045 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-2d20473c-30d7-4eb4-a063-497d3ffd2d7e req-fab22d95-0516-4b3e-8e47-64c7880411a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69b35751-ffe5-4447-8c07-8db18ae96e9d", "name": "network-vif-deleted", "tag": "e2331ba4-826a-40cf-853f-720873f465a1"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:50:19.816741 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-2d20473c-30d7-4eb4-a063-497d3ffd2d7e req-fab22d95-0516-4b3e-8e47-64c7880411a1 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:19.817492 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-2d20473c-30d7-4eb4-a063-497d3ffd2d7e req-fab22d95-0516-4b3e-8e47-64c7880411a1 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:19.818129 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-2d20473c-30d7-4eb4-a063-497d3ffd2d7e req-fab22d95-0516-4b3e-8e47-64c7880411a1 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:19.831158 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-2d20473c-30d7-4eb4-a063-497d3ffd2d7e req-fab22d95-0516-4b3e-8e47-64c7880411a1 service nova] Creating event network-vif-deleted:e2331ba4-826a-40cf-853f-720873f465a1 for instance 69b35751-ffe5-4447-8c07-8db18ae96e9d on n-h2-860284-1 Oct 04 21:50:19.836963 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-2d20473c-30d7-4eb4-a063-497d3ffd2d7e req-fab22d95-0516-4b3e-8e47-64c7880411a1 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034368 Oct 04 21:50:19.838194 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 926/1788] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:50:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:50:19.927942 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-4944ba8e-67ce-4bd8-a0c4-5e662251bf66 tempest-ServersTestFqdnHostnames-1740621305 tempest-ServersTestFqdnHostnames-1740621305-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:50:19.929384 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-4944ba8e-67ce-4bd8-a0c4-5e662251bf66 tempest-ServersTestFqdnHostnames-1740621305 tempest-ServersTestFqdnHostnames-1740621305-project] [instance: a50a2117-fefe-499b-a2d4-b57e264a5a51] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:50:19.942565 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4944ba8e-67ce-4bd8-a0c4-5e662251bf66 tempest-ServersTestFqdnHostnames-1740621305 tempest-ServersTestFqdnHostnames-1740621305-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:19.943238 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4944ba8e-67ce-4bd8-a0c4-5e662251bf66 tempest-ServersTestFqdnHostnames-1740621305 tempest-ServersTestFqdnHostnames-1740621305-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:19.943911 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-99a0a5d0-1153-47f2-9b4c-964996ed3ed5 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Acquiring lock "refresh_cache-fdc82b91-5dfa-44cf-b8c5-402922265d88" {{(pid=134101) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 04 21:50:19.944331 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-99a0a5d0-1153-47f2-9b4c-964996ed3ed5 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Acquired lock "refresh_cache-fdc82b91-5dfa-44cf-b8c5-402922265d88" {{(pid=134101) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 04 21:50:19.944576 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4944ba8e-67ce-4bd8-a0c4-5e662251bf66 tempest-ServersTestFqdnHostnames-1740621305 tempest-ServersTestFqdnHostnames-1740621305-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:19.945945 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4944ba8e-67ce-4bd8-a0c4-5e662251bf66 tempest-ServersTestFqdnHostnames-1740621305 tempest-ServersTestFqdnHostnames-1740621305-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:19.946649 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4944ba8e-67ce-4bd8-a0c4-5e662251bf66 tempest-ServersTestFqdnHostnames-1740621305 tempest-ServersTestFqdnHostnames-1740621305-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:19.947231 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4944ba8e-67ce-4bd8-a0c4-5e662251bf66 tempest-ServersTestFqdnHostnames-1740621305 tempest-ServersTestFqdnHostnames-1740621305-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:20.796763 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-4944ba8e-67ce-4bd8-a0c4-5e662251bf66 tempest-ServersTestFqdnHostnames-1740621305 tempest-ServersTestFqdnHostnames-1740621305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ade6e5b885f4e7db1fef86de59a08de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dbdc46c0aa4d07a1eb5ade5b3a7212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:20.820574 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-4944ba8e-67ce-4bd8-a0c4-5e662251bf66 tempest-ServersTestFqdnHostnames-1740621305 tempest-ServersTestFqdnHostnames-1740621305-project] 10.222.0.43 "GET /compute/v2.1/servers/a50a2117-fefe-499b-a2d4-b57e264a5a51" status: 200 len: 1351 microversion: 2.1 time: 0.904577 Oct 04 21:50:20.821462 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 927/1789] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:50:19 2022] GET /compute/v2.1/servers/a50a2117-fefe-499b-a2d4-b57e264a5a51 => generated 1351 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:50:20.826627 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-a4f7e818-e47b-4643-8cef-0aa76fc39b91 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:50:20.827587 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-a4f7e818-e47b-4643-8cef-0aa76fc39b91 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] [instance: d4abcd04-329d-40a8-8d6e-4383bef437ae] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:50:20.837293 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a4f7e818-e47b-4643-8cef-0aa76fc39b91 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:20.838168 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a4f7e818-e47b-4643-8cef-0aa76fc39b91 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:20.838919 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a4f7e818-e47b-4643-8cef-0aa76fc39b91 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:20.840069 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a4f7e818-e47b-4643-8cef-0aa76fc39b91 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:20.840743 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a4f7e818-e47b-4643-8cef-0aa76fc39b91 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:20.841535 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a4f7e818-e47b-4643-8cef-0aa76fc39b91 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:21.040019 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=4 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:50:21.200640 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-a4f7e818-e47b-4643-8cef-0aa76fc39b91 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:21.238852 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-a4f7e818-e47b-4643-8cef-0aa76fc39b91 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:21.243234 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-a4f7e818-e47b-4643-8cef-0aa76fc39b91 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:21.246499 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-a4f7e818-e47b-4643-8cef-0aa76fc39b91 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] 10.222.0.43 "GET /compute/v2.1/servers/d4abcd04-329d-40a8-8d6e-4383bef437ae" status: 200 len: 1814 microversion: 2.25 time: 0.423676 Oct 04 21:50:21.250039 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 928/1790] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:50:20 2022] GET /compute/v2.1/servers/d4abcd04-329d-40a8-8d6e-4383bef437ae => generated 1814 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:50:21.259877 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-6c473a9d-dcc3-4f32-a5cb-c11136377e4a tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:50:21.261506 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-6c473a9d-dcc3-4f32-a5cb-c11136377e4a tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] [instance: 3f80e8f0-dba3-4403-83f8-0473c5d7d29b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:50:21.275460 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6c473a9d-dcc3-4f32-a5cb-c11136377e4a tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:21.277453 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6c473a9d-dcc3-4f32-a5cb-c11136377e4a tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:21.278346 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6c473a9d-dcc3-4f32-a5cb-c11136377e4a tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:21.281848 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6c473a9d-dcc3-4f32-a5cb-c11136377e4a tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:21.282851 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6c473a9d-dcc3-4f32-a5cb-c11136377e4a tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:21.284793 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6c473a9d-dcc3-4f32-a5cb-c11136377e4a tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:21.506048 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-6c473a9d-dcc3-4f32-a5cb-c11136377e4a tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43653f2aea4e4884b5001dea5ec12be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b700f614a8b4cfba9b4abea45a06f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:21.515682 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-6c473a9d-dcc3-4f32-a5cb-c11136377e4a tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43653f2aea4e4884b5001dea5ec12be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b700f614a8b4cfba9b4abea45a06f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:21.517205 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-6c473a9d-dcc3-4f32-a5cb-c11136377e4a tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43653f2aea4e4884b5001dea5ec12be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b700f614a8b4cfba9b4abea45a06f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:21.536033 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-6c473a9d-dcc3-4f32-a5cb-c11136377e4a tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] 10.222.0.43 "GET /compute/v2.1/servers/3f80e8f0-dba3-4403-83f8-0473c5d7d29b" status: 200 len: 1444 microversion: 2.75 time: 0.283401 Oct 04 21:50:21.536920 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 929/1791] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:50:21 2022] GET /compute/v2.1/servers/3f80e8f0-dba3-4403-83f8-0473c5d7d29b => generated 1444 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:50:21.542736 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-88eee894-5002-4735-ad88-d76194c5f4a9 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:50:21.545893 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-88eee894-5002-4735-ad88-d76194c5f4a9 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 3f0a02bc-7993-4849-8b3c-7572327b4799] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:50:21.554468 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-88eee894-5002-4735-ad88-d76194c5f4a9 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:21.555416 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-88eee894-5002-4735-ad88-d76194c5f4a9 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:21.556031 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-88eee894-5002-4735-ad88-d76194c5f4a9 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:21.559093 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-88eee894-5002-4735-ad88-d76194c5f4a9 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:21.561080 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-88eee894-5002-4735-ad88-d76194c5f4a9 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:21.561713 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-88eee894-5002-4735-ad88-d76194c5f4a9 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:21.855239 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell0:SELECT=28 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:50:22.106706 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-88eee894-5002-4735-ad88-d76194c5f4a9 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ad048becf474fb972d4291422d810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dcfc7024fc49388c4bd5f25f03e60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:22.148187 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-88eee894-5002-4735-ad88-d76194c5f4a9 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/3f0a02bc-7993-4849-8b3c-7572327b4799" status: 200 len: 1716 microversion: 2.1 time: 0.609946 Oct 04 21:50:22.169380 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 930/1792] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:50:21 2022] GET /compute/v2.1/servers/3f0a02bc-7993-4849-8b3c-7572327b4799 => generated 1716 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:50:22.174847 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-ea538554-0d41-4677-bffb-890919b84c00 tempest-ServersTestFqdnHostnames-1740621305 tempest-ServersTestFqdnHostnames-1740621305-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:50:22.175476 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-ea538554-0d41-4677-bffb-890919b84c00 tempest-ServersTestFqdnHostnames-1740621305 tempest-ServersTestFqdnHostnames-1740621305-project] [instance: a50a2117-fefe-499b-a2d4-b57e264a5a51] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:50:22.197449 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ea538554-0d41-4677-bffb-890919b84c00 tempest-ServersTestFqdnHostnames-1740621305 tempest-ServersTestFqdnHostnames-1740621305-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:22.197938 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ea538554-0d41-4677-bffb-890919b84c00 tempest-ServersTestFqdnHostnames-1740621305 tempest-ServersTestFqdnHostnames-1740621305-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:22.205986 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ea538554-0d41-4677-bffb-890919b84c00 tempest-ServersTestFqdnHostnames-1740621305 tempest-ServersTestFqdnHostnames-1740621305-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:22.206807 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ea538554-0d41-4677-bffb-890919b84c00 tempest-ServersTestFqdnHostnames-1740621305 tempest-ServersTestFqdnHostnames-1740621305-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:22.207645 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ea538554-0d41-4677-bffb-890919b84c00 tempest-ServersTestFqdnHostnames-1740621305 tempest-ServersTestFqdnHostnames-1740621305-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:22.208352 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ea538554-0d41-4677-bffb-890919b84c00 tempest-ServersTestFqdnHostnames-1740621305 tempest-ServersTestFqdnHostnames-1740621305-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:22.315126 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.network.neutron [None req-99a0a5d0-1153-47f2-9b4c-964996ed3ed5 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] [instance: fdc82b91-5dfa-44cf-b8c5-402922265d88] Building network info cache for instance {{(pid=134101) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 04 21:50:22.585089 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-ea538554-0d41-4677-bffb-890919b84c00 tempest-ServersTestFqdnHostnames-1740621305 tempest-ServersTestFqdnHostnames-1740621305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ade6e5b885f4e7db1fef86de59a08de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dbdc46c0aa4d07a1eb5ade5b3a7212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:22.597884 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-ea538554-0d41-4677-bffb-890919b84c00 tempest-ServersTestFqdnHostnames-1740621305 tempest-ServersTestFqdnHostnames-1740621305-project] 10.222.0.43 "GET /compute/v2.1/servers/a50a2117-fefe-499b-a2d4-b57e264a5a51" status: 200 len: 1351 microversion: 2.1 time: 0.427275 Oct 04 21:50:22.603975 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 931/1793] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:50:22 2022] GET /compute/v2.1/servers/a50a2117-fefe-499b-a2d4-b57e264a5a51 => generated 1351 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:50:22.609022 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-db00e449-5990-44d3-b030-6b57031af261 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:50:22.609645 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-db00e449-5990-44d3-b030-6b57031af261 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] [instance: d4abcd04-329d-40a8-8d6e-4383bef437ae] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:50:22.628577 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-db00e449-5990-44d3-b030-6b57031af261 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:22.629074 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-db00e449-5990-44d3-b030-6b57031af261 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:22.629518 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-db00e449-5990-44d3-b030-6b57031af261 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:22.636518 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-db00e449-5990-44d3-b030-6b57031af261 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:22.637339 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-db00e449-5990-44d3-b030-6b57031af261 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:22.638463 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-db00e449-5990-44d3-b030-6b57031af261 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:23.082048 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-db00e449-5990-44d3-b030-6b57031af261 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:23.097602 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-db00e449-5990-44d3-b030-6b57031af261 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:23.099342 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-db00e449-5990-44d3-b030-6b57031af261 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:23.112163 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-db00e449-5990-44d3-b030-6b57031af261 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] 10.222.0.43 "GET /compute/v2.1/servers/d4abcd04-329d-40a8-8d6e-4383bef437ae" status: 200 len: 1804 microversion: 2.25 time: 0.506858 Oct 04 21:50:23.112926 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 932/1794] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:50:22 2022] GET /compute/v2.1/servers/d4abcd04-329d-40a8-8d6e-4383bef437ae => generated 1804 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:50:23.138893 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-f0b3d63e-34db-40cb-8bf3-93ee13453191 req-9e137f55-5295-4090-a5c3-d7f28b85480a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fdc82b91-5dfa-44cf-b8c5-402922265d88", "tag": "c36556e1-4c6d-4308-8210-aa45c17cd2d1"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:50:23.154484 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-f0b3d63e-34db-40cb-8bf3-93ee13453191 req-9e137f55-5295-4090-a5c3-d7f28b85480a service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:23.154484 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-f0b3d63e-34db-40cb-8bf3-93ee13453191 req-9e137f55-5295-4090-a5c3-d7f28b85480a service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:23.154484 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-f0b3d63e-34db-40cb-8bf3-93ee13453191 req-9e137f55-5295-4090-a5c3-d7f28b85480a service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:23.165046 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-f0b3d63e-34db-40cb-8bf3-93ee13453191 req-9e137f55-5295-4090-a5c3-d7f28b85480a service nova] Creating event network-changed:c36556e1-4c6d-4308-8210-aa45c17cd2d1 for instance fdc82b91-5dfa-44cf-b8c5-402922265d88 on n-h2-860284-1 Oct 04 21:50:23.170617 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-f0b3d63e-34db-40cb-8bf3-93ee13453191 req-9e137f55-5295-4090-a5c3-d7f28b85480a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056061 Oct 04 21:50:23.171910 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 933/1795] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:50:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:50:23.415273 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-8346136d-aff7-4efc-8d2e-440d4cf0f152 tempest-ListImageFiltersNegativeTestJSON-959652364 tempest-ListImageFiltersNegativeTestJSON-959652364-project] Calling method '.version_select at 0x7fbb373f4550>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:50:23.462703 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-8346136d-aff7-4efc-8d2e-440d4cf0f152 tempest-ListImageFiltersNegativeTestJSON-959652364 tempest-ListImageFiltersNegativeTestJSON-959652364-project] HTTP exception thrown: Image not found. Oct 04 21:50:23.464879 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-8346136d-aff7-4efc-8d2e-440d4cf0f152 tempest-ListImageFiltersNegativeTestJSON-959652364 tempest-ListImageFiltersNegativeTestJSON-959652364-project] Request method failure captured: Oct 04 21:50:23.464879 n-d-860284-1 devstack@n-api.service[134102]: request: GET /compute/v2.1/images/91676134-8920-45fe-8aa4-c486ca0ce2a2 HTTP/1.1 Oct 04 21:50:23.464879 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 21:50:23.464879 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 21:50:23.464879 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 21:50:23.464879 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 21:50:23.464879 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 21:50:23.464879 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 21:50:23.464879 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 21:50:23.464879 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 21:50:23.464879 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPKqe4TYIBYymIemr_3evA2LwTreXjicF16wx8f2Bj1YpQDv2TfmOQnLJizEFzMhPxjqPuHMua_c_g1J-RIw_MywMF7LjYDum_vtBBd8zYBcS2ktI63wugkyPnQ-Lppji0voAxkTX3Uwi3pSCQ7a663iM0Svs-NGZQOGtfJ1JZK-X3xw Oct 04 21:50:23.464879 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 21:50:23.464879 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 21:50:23.464879 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 21:50:23.464879 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 21:50:23.464879 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 21:50:23.464879 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 21:50:23.464879 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: d8d80a4a69704c1bb46e6ceb50f92cb1 Oct 04 21:50:23.464879 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-959652364 Oct 04 21:50:23.464879 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 21:50:23.464879 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 21:50:23.464879 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d8d80a4a69704c1bb46e6ceb50f92cb1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_d8d80a4a69704c1bb46e6ceb50f92cb1", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d8d80a4a69704c1bb46e6ceb50f92cb1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/d8d80a4a69704c1bb46e6ceb50f92cb1"}]}] Oct 04 21:50:23.464879 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-959652364 Oct 04 21:50:23.464879 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: d8d80a4a69704c1bb46e6ceb50f92cb1 Oct 04 21:50:23.464879 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-959652364 Oct 04 21:50:23.464879 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-ListImageFiltersNegativeTestJSON-959652364-project Oct 04 21:50:23.464879 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 21:50:23.464879 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 21:50:23.464879 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: 35d1a97bc8f243fa84c82422f30f8d11 Oct 04 21:50:23.464879 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-959652364-project Oct 04 21:50:23.464879 n-d-860284-1 devstack@n-api.service[134102]: method: Oct 04 21:50:23.464879 n-d-860284-1 devstack@n-api.service[134102]: exception: Image not found. Oct 04 21:50:23.464879 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': '91676134-8920-45fe-8aa4-c486ca0ce2a2'} Oct 04 21:50:23.464879 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:50:23.464879 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:50:23.464879 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 21:50:23.464879 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 21:50:23.464879 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 21:50:23.464879 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 21:50:23.464879 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 21:50:23.464879 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 21:50:23.464879 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 21:50:23.464879 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 21:50:23.464879 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 21:50:23.464879 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 21:50:23.464879 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 21:50:23.464879 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 21:50:23.464879 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 21:50:23.464879 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 21:50:23.464879 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 21:50:23.464879 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 21:50:23.464879 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 91676134-8920-45fe-8aa4-c486ca0ce2a2 Oct 04 21:50:23.464879 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:50:23.464879 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:50:23.464879 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:50:23.464879 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:50:23.464879 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 04 21:50:23.464879 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 04 21:50:23.464879 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 04 21:50:23.464879 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 04 21:50:23.464879 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 04 21:50:23.464879 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 04 21:50:23.464879 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 04 21:50:23.472545 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 04 21:50:23.472545 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 21:50:23.472545 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 21:50:23.472545 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 21:50:23.472545 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 21:50:23.472545 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 21:50:23.472545 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 21:50:23.472545 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 21:50:23.472545 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 21:50:23.472545 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 21:50:23.472545 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 21:50:23.472545 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 21:50:23.472545 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 21:50:23.472545 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 21:50:23.472545 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 21:50:23.472545 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 21:50:23.472545 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 21:50:23.472545 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 91676134-8920-45fe-8aa4-c486ca0ce2a2 could not be found. Oct 04 21:50:23.472545 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:50:23.472545 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:50:23.472545 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:50:23.472545 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:50:23.472545 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:50:23.472545 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:50:23.472545 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:50:23.472545 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:50:23.472545 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:50:23.472545 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:50:23.472545 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:50:23.472545 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:50:23.472545 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 04 21:50:23.472545 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 21:50:23.472545 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 21:50:23.472545 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:50:23.472545 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:50:23.472545 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:50:23.472545 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:50:23.472545 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:50:23.472545 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:50:23.472545 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:50:23.472545 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:50:23.472545 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 21:50:23.472545 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:50:23.472545 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-8346136d-aff7-4efc-8d2e-440d4cf0f152 tempest-ListImageFiltersNegativeTestJSON-959652364 tempest-ListImageFiltersNegativeTestJSON-959652364-project] Returning 404 to user: Image not found. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:50:23.472545 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-8346136d-aff7-4efc-8d2e-440d4cf0f152 tempest-ListImageFiltersNegativeTestJSON-959652364 tempest-ListImageFiltersNegativeTestJSON-959652364-project] 10.222.0.43 "GET /compute/v2.1/images/91676134-8920-45fe-8aa4-c486ca0ce2a2" status: 404 len: 62 microversion: 2.1 time: 0.293273 Oct 04 21:50:23.472545 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 934/1796] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:50:23 2022] GET /compute/v2.1/images/91676134-8920-45fe-8aa4-c486ca0ce2a2 => generated 62 bytes in 295 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 21:50:23.487940 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-abc00a5a-1d5d-46c0-86fe-0ee04399c79a tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:50:23.488972 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-abc00a5a-1d5d-46c0-86fe-0ee04399c79a tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] [instance: 3f80e8f0-dba3-4403-83f8-0473c5d7d29b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:50:23.504616 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-abc00a5a-1d5d-46c0-86fe-0ee04399c79a tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:23.506592 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-abc00a5a-1d5d-46c0-86fe-0ee04399c79a tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:23.507882 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-abc00a5a-1d5d-46c0-86fe-0ee04399c79a tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:23.509777 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-abc00a5a-1d5d-46c0-86fe-0ee04399c79a tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:23.520314 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-abc00a5a-1d5d-46c0-86fe-0ee04399c79a tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:23.525175 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-abc00a5a-1d5d-46c0-86fe-0ee04399c79a tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:23.775245 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-abc00a5a-1d5d-46c0-86fe-0ee04399c79a tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43653f2aea4e4884b5001dea5ec12be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b700f614a8b4cfba9b4abea45a06f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:23.789570 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-abc00a5a-1d5d-46c0-86fe-0ee04399c79a tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43653f2aea4e4884b5001dea5ec12be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b700f614a8b4cfba9b4abea45a06f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:23.797270 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-abc00a5a-1d5d-46c0-86fe-0ee04399c79a tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43653f2aea4e4884b5001dea5ec12be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b700f614a8b4cfba9b4abea45a06f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:23.811303 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-abc00a5a-1d5d-46c0-86fe-0ee04399c79a tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] 10.222.0.43 "GET /compute/v2.1/servers/3f80e8f0-dba3-4403-83f8-0473c5d7d29b" status: 200 len: 1444 microversion: 2.75 time: 0.341495 Oct 04 21:50:23.828956 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 935/1797] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:50:23 2022] GET /compute/v2.1/servers/3f80e8f0-dba3-4403-83f8-0473c5d7d29b => generated 1444 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:50:23.837422 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-c2ed1641-c43c-436b-ace7-6d70087881ad tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Calling method '.version_select at 0x7fbb37459f70>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:50:23.870751 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c2ed1641-c43c-436b-ace7-6d70087881ad tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:23.874420 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c2ed1641-c43c-436b-ace7-6d70087881ad tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:23.877677 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c2ed1641-c43c-436b-ace7-6d70087881ad tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:23.883130 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.network.neutron [None req-99a0a5d0-1153-47f2-9b4c-964996ed3ed5 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] [instance: fdc82b91-5dfa-44cf-b8c5-402922265d88] Updating instance_info_cache with network_info: [{"id": "c36556e1-4c6d-4308-8210-aa45c17cd2d1", "address": "fa:16:3e:30:86:84", "network": {"id": "e4c13216-4fea-4d87-aa16-a7572859740d", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1638687548-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "758fcafb5db74075b183978a97b7c4ee", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapc36556e1-4c", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=134101) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 04 21:50:23.912477 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-c2ed1641-c43c-436b-ace7-6d70087881ad tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] 10.222.0.43 "GET /compute/v2.1/os-migrations" status: 200 len: 2785 microversion: 2.25 time: 0.080913 Oct 04 21:50:23.912785 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-99a0a5d0-1153-47f2-9b4c-964996ed3ed5 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Releasing lock "refresh_cache-fdc82b91-5dfa-44cf-b8c5-402922265d88" {{(pid=134101) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 04 21:50:23.913793 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-99a0a5d0-1153-47f2-9b4c-964996ed3ed5 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] 10.222.0.43 "POST /compute/v2.1/servers/fdc82b91-5dfa-44cf-b8c5-402922265d88/action" status: 202 len: 0 microversion: 2.1 time: 4.911326 Oct 04 21:50:23.915116 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 863/1798] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 21:50:19 2022] POST /compute/v2.1/servers/fdc82b91-5dfa-44cf-b8c5-402922265d88/action => generated 0 bytes in 4913 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 04 21:50:23.922833 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 936/1799] 10.222.0.43 () {60 vars in 1184 bytes} [Tue Oct 4 21:50:23 2022] GET /compute/v2.1/os-migrations => generated 2785 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:50:23.929424 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-964c9840-8838-4d7d-a925-0bffaaac5d4b tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:50:23.930315 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-964c9840-8838-4d7d-a925-0bffaaac5d4b tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 3f0a02bc-7993-4849-8b3c-7572327b4799] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:50:23.931814 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-55c0b92f-d546-4dbf-81f1-3c6fbd7d6b9b tempest-ServersTestFqdnHostnames-1740621305 tempest-ServersTestFqdnHostnames-1740621305-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:50:23.948126 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-55c0b92f-d546-4dbf-81f1-3c6fbd7d6b9b tempest-ServersTestFqdnHostnames-1740621305 tempest-ServersTestFqdnHostnames-1740621305-project] [instance: a50a2117-fefe-499b-a2d4-b57e264a5a51] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:50:23.956886 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-964c9840-8838-4d7d-a925-0bffaaac5d4b tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:23.957949 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-964c9840-8838-4d7d-a925-0bffaaac5d4b tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:23.958657 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-964c9840-8838-4d7d-a925-0bffaaac5d4b tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:23.960186 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-964c9840-8838-4d7d-a925-0bffaaac5d4b tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:23.960871 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-964c9840-8838-4d7d-a925-0bffaaac5d4b tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:23.961498 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-964c9840-8838-4d7d-a925-0bffaaac5d4b tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:23.972682 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-55c0b92f-d546-4dbf-81f1-3c6fbd7d6b9b tempest-ServersTestFqdnHostnames-1740621305 tempest-ServersTestFqdnHostnames-1740621305-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:23.974996 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-55c0b92f-d546-4dbf-81f1-3c6fbd7d6b9b tempest-ServersTestFqdnHostnames-1740621305 tempest-ServersTestFqdnHostnames-1740621305-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:23.976742 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-55c0b92f-d546-4dbf-81f1-3c6fbd7d6b9b tempest-ServersTestFqdnHostnames-1740621305 tempest-ServersTestFqdnHostnames-1740621305-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:23.980810 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-55c0b92f-d546-4dbf-81f1-3c6fbd7d6b9b tempest-ServersTestFqdnHostnames-1740621305 tempest-ServersTestFqdnHostnames-1740621305-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:23.983022 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-55c0b92f-d546-4dbf-81f1-3c6fbd7d6b9b tempest-ServersTestFqdnHostnames-1740621305 tempest-ServersTestFqdnHostnames-1740621305-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:23.983700 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-55c0b92f-d546-4dbf-81f1-3c6fbd7d6b9b tempest-ServersTestFqdnHostnames-1740621305 tempest-ServersTestFqdnHostnames-1740621305-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:24.545712 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-964c9840-8838-4d7d-a925-0bffaaac5d4b tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ad048becf474fb972d4291422d810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dcfc7024fc49388c4bd5f25f03e60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:24.560274 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-964c9840-8838-4d7d-a925-0bffaaac5d4b tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/3f0a02bc-7993-4849-8b3c-7572327b4799" status: 200 len: 1716 microversion: 2.1 time: 0.643618 Oct 04 21:50:24.563569 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 864/1800] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:50:23 2022] GET /compute/v2.1/servers/3f0a02bc-7993-4849-8b3c-7572327b4799 => generated 1716 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:50:24.570313 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-6c597f49-2897-45f2-b241-4aadc96f2362 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:50:24.571147 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-6c597f49-2897-45f2-b241-4aadc96f2362 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] [instance: 69b35751-ffe5-4447-8c07-8db18ae96e9d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:50:24.586234 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6c597f49-2897-45f2-b241-4aadc96f2362 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:24.587234 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6c597f49-2897-45f2-b241-4aadc96f2362 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:24.587685 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6c597f49-2897-45f2-b241-4aadc96f2362 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:24.588423 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6c597f49-2897-45f2-b241-4aadc96f2362 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:24.589055 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6c597f49-2897-45f2-b241-4aadc96f2362 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:24.589690 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6c597f49-2897-45f2-b241-4aadc96f2362 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:24.630894 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-6c597f49-2897-45f2-b241-4aadc96f2362 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] HTTP exception thrown: Instance 69b35751-ffe5-4447-8c07-8db18ae96e9d could not be found. Oct 04 21:50:24.632896 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-6c597f49-2897-45f2-b241-4aadc96f2362 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Request method failure captured: Oct 04 21:50:24.632896 n-d-860284-1 devstack@n-api.service[134101]: request: DELETE /compute/v2.1/servers/69b35751-ffe5-4447-8c07-8db18ae96e9d HTTP/1.1 Oct 04 21:50:24.632896 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 21:50:24.632896 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 21:50:24.632896 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 21:50:24.632896 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 21:50:24.632896 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 21:50:24.632896 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 21:50:24.632896 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 21:50:24.632896 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 21:50:24.632896 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPKo-ln9523hGjik6efbNIsBZPXFxTLqGBuFcWCKjxuW1p1evQNKO_Uyff6cDRYbZa6WI6XvxbfG3eUM6j7dp79zYbjcyduRTyVhI8BgLq8de552QDbCx15COQpRJimlMG4NhjchhlltTp5_5UxkZkLafVbBjmnPUJzBfVZabhSWYBEs Oct 04 21:50:24.632896 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 21:50:24.632896 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 21:50:24.632896 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 21:50:24.632896 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 21:50:24.632896 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 21:50:24.632896 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 21:50:24.632896 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: 758fcafb5db74075b183978a97b7c4ee Oct 04 21:50:24.632896 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-87315922 Oct 04 21:50:24.632896 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 21:50:24.632896 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 21:50:24.632896 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/758fcafb5db74075b183978a97b7c4ee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_758fcafb5db74075b183978a97b7c4ee", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/758fcafb5db74075b183978a97b7c4ee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/758fcafb5db74075b183978a97b7c4ee"}]}] Oct 04 21:50:24.632896 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-87315922 Oct 04 21:50:24.632896 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: 758fcafb5db74075b183978a97b7c4ee Oct 04 21:50:24.632896 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-87315922 Oct 04 21:50:24.632896 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-FloatingIPsAssociationTestJSON-87315922-project Oct 04 21:50:24.632896 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 21:50:24.632896 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 21:50:24.632896 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 56d66a6a9c5c4c57ba0d25a37323f37f Oct 04 21:50:24.632896 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-87315922-project Oct 04 21:50:24.632896 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 21:50:24.632896 n-d-860284-1 devstack@n-api.service[134101]: exception: Instance 69b35751-ffe5-4447-8c07-8db18ae96e9d could not be found. Oct 04 21:50:24.632896 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': '69b35751-ffe5-4447-8c07-8db18ae96e9d'} Oct 04 21:50:24.632896 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:50:24.632896 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:50:24.632896 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:50:24.632896 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:50:24.632896 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:50:24.632896 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:50:24.632896 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:50:24.632896 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:50:24.632896 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:50:24.632896 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:50:24.632896 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69b35751-ffe5-4447-8c07-8db18ae96e9d could not be found. Oct 04 21:50:24.632896 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:50:24.632896 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:50:24.632896 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:50:24.632896 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:50:24.632896 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:50:24.632896 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:50:24.632896 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:50:24.632896 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:50:24.632896 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:50:24.632896 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:50:24.632896 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 21:50:24.632896 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 21:50:24.632896 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 21:50:24.632896 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 21:50:24.632896 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:50:24.632896 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:50:24.632896 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:50:24.632896 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:50:24.639132 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69b35751-ffe5-4447-8c07-8db18ae96e9d could not be found. Oct 04 21:50:24.639132 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:50:24.639132 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:50:24.639132 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:50:24.639132 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:50:24.639132 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:50:24.639132 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:50:24.639132 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:50:24.639132 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:50:24.639132 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69b35751-ffe5-4447-8c07-8db18ae96e9d could not be found. Oct 04 21:50:24.639132 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:50:24.640580 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-55c0b92f-d546-4dbf-81f1-3c6fbd7d6b9b tempest-ServersTestFqdnHostnames-1740621305 tempest-ServersTestFqdnHostnames-1740621305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ade6e5b885f4e7db1fef86de59a08de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dbdc46c0aa4d07a1eb5ade5b3a7212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:24.643790 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-6c597f49-2897-45f2-b241-4aadc96f2362 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Returning 404 to user: Instance 69b35751-ffe5-4447-8c07-8db18ae96e9d could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:50:24.647444 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-6c597f49-2897-45f2-b241-4aadc96f2362 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] 10.222.0.43 "DELETE /compute/v2.1/servers/69b35751-ffe5-4447-8c07-8db18ae96e9d" status: 404 len: 111 microversion: 2.1 time: 0.080150 Oct 04 21:50:24.652695 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 865/1801] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 21:50:24 2022] DELETE /compute/v2.1/servers/69b35751-ffe5-4447-8c07-8db18ae96e9d => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:50:24.657874 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-57dfeca8-d513-439f-9bca-205ce8206e39 tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:50:24.659816 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-57dfeca8-d513-439f-9bca-205ce8206e39 tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] [instance: d4abcd04-329d-40a8-8d6e-4383bef437ae] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:50:24.664707 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-55c0b92f-d546-4dbf-81f1-3c6fbd7d6b9b tempest-ServersTestFqdnHostnames-1740621305 tempest-ServersTestFqdnHostnames-1740621305-project] 10.222.0.43 "GET /compute/v2.1/servers/a50a2117-fefe-499b-a2d4-b57e264a5a51" status: 200 len: 1351 microversion: 2.1 time: 0.739331 Oct 04 21:50:24.665303 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 937/1802] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:50:23 2022] GET /compute/v2.1/servers/a50a2117-fefe-499b-a2d4-b57e264a5a51 => generated 1351 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:50:24.681121 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-57dfeca8-d513-439f-9bca-205ce8206e39 tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:24.682550 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-0324ac3c-7e7a-4c91-b2bc-d0203b8690a1 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:50:24.683177 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-0324ac3c-7e7a-4c91-b2bc-d0203b8690a1 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] [instance: 69b35751-ffe5-4447-8c07-8db18ae96e9d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:50:24.683869 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-57dfeca8-d513-439f-9bca-205ce8206e39 tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:24.684442 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-57dfeca8-d513-439f-9bca-205ce8206e39 tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:24.685298 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-57dfeca8-d513-439f-9bca-205ce8206e39 tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:24.685882 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-57dfeca8-d513-439f-9bca-205ce8206e39 tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:24.686457 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-57dfeca8-d513-439f-9bca-205ce8206e39 tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:24.727336 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0324ac3c-7e7a-4c91-b2bc-d0203b8690a1 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:24.727943 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0324ac3c-7e7a-4c91-b2bc-d0203b8690a1 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:24.728493 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0324ac3c-7e7a-4c91-b2bc-d0203b8690a1 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:24.729321 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0324ac3c-7e7a-4c91-b2bc-d0203b8690a1 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:24.730183 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0324ac3c-7e7a-4c91-b2bc-d0203b8690a1 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:24.730759 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0324ac3c-7e7a-4c91-b2bc-d0203b8690a1 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:24.758614 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-0324ac3c-7e7a-4c91-b2bc-d0203b8690a1 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] HTTP exception thrown: Instance 69b35751-ffe5-4447-8c07-8db18ae96e9d could not be found. Oct 04 21:50:24.761559 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-0324ac3c-7e7a-4c91-b2bc-d0203b8690a1 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Request method failure captured: Oct 04 21:50:24.761559 n-d-860284-1 devstack@n-api.service[134102]: request: GET /compute/v2.1/servers/69b35751-ffe5-4447-8c07-8db18ae96e9d HTTP/1.1 Oct 04 21:50:24.761559 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 21:50:24.761559 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 21:50:24.761559 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 21:50:24.761559 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 21:50:24.761559 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 21:50:24.761559 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 21:50:24.761559 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 21:50:24.761559 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 21:50:24.761559 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPKo-ln9523hGjik6efbNIsBZPXFxTLqGBuFcWCKjxuW1p1evQNKO_Uyff6cDRYbZa6WI6XvxbfG3eUM6j7dp79zYbjcyduRTyVhI8BgLq8de552QDbCx15COQpRJimlMG4NhjchhlltTp5_5UxkZkLafVbBjmnPUJzBfVZabhSWYBEs Oct 04 21:50:24.761559 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 21:50:24.761559 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 21:50:24.761559 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 21:50:24.761559 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 21:50:24.761559 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 21:50:24.761559 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 21:50:24.761559 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: 758fcafb5db74075b183978a97b7c4ee Oct 04 21:50:24.761559 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-87315922 Oct 04 21:50:24.761559 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 21:50:24.761559 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 21:50:24.761559 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/758fcafb5db74075b183978a97b7c4ee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_758fcafb5db74075b183978a97b7c4ee", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/758fcafb5db74075b183978a97b7c4ee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/758fcafb5db74075b183978a97b7c4ee"}]}] Oct 04 21:50:24.761559 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-87315922 Oct 04 21:50:24.761559 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: 758fcafb5db74075b183978a97b7c4ee Oct 04 21:50:24.761559 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-87315922 Oct 04 21:50:24.761559 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-FloatingIPsAssociationTestJSON-87315922-project Oct 04 21:50:24.761559 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 21:50:24.761559 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 21:50:24.761559 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: 56d66a6a9c5c4c57ba0d25a37323f37f Oct 04 21:50:24.761559 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-87315922-project Oct 04 21:50:24.761559 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 21:50:24.761559 n-d-860284-1 devstack@n-api.service[134102]: exception: Instance 69b35751-ffe5-4447-8c07-8db18ae96e9d could not be found. Oct 04 21:50:24.761559 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': '69b35751-ffe5-4447-8c07-8db18ae96e9d'} Oct 04 21:50:24.761559 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:50:24.761559 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:50:24.761559 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:50:24.761559 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:50:24.761559 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:50:24.761559 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:50:24.761559 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:50:24.761559 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:50:24.761559 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:50:24.761559 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:50:24.761559 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69b35751-ffe5-4447-8c07-8db18ae96e9d could not be found. Oct 04 21:50:24.761559 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:50:24.761559 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:50:24.761559 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:50:24.761559 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:50:24.761559 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:50:24.761559 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:50:24.761559 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:50:24.761559 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:50:24.761559 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:50:24.761559 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:50:24.761559 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:50:24.761559 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:50:24.761559 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:50:24.761559 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:50:24.761559 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:50:24.761559 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:50:24.761559 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69b35751-ffe5-4447-8c07-8db18ae96e9d could not be found. Oct 04 21:50:24.761559 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:50:24.761559 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:50:24.766160 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:50:24.766160 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:50:24.766160 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:50:24.766160 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:50:24.766160 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:50:24.766160 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:50:24.766160 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69b35751-ffe5-4447-8c07-8db18ae96e9d could not be found. Oct 04 21:50:24.766160 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:50:24.768689 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-0324ac3c-7e7a-4c91-b2bc-d0203b8690a1 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Returning 404 to user: Instance 69b35751-ffe5-4447-8c07-8db18ae96e9d could not be found. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:50:24.770070 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-0324ac3c-7e7a-4c91-b2bc-d0203b8690a1 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] 10.222.0.43 "GET /compute/v2.1/servers/69b35751-ffe5-4447-8c07-8db18ae96e9d" status: 404 len: 111 microversion: 2.1 time: 0.103830 Oct 04 21:50:24.774561 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 938/1803] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:50:24 2022] GET /compute/v2.1/servers/69b35751-ffe5-4447-8c07-8db18ae96e9d => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:50:24.791974 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-b5243772-a4c6-468e-ab98-38dcd945e96c tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Calling method '.version_select at 0x7fbb373dc700>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:50:25.715047 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.objects.instance [None req-57dfeca8-d513-439f-9bca-205ce8206e39 tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Lazy-loading 'services' on Instance uuid d4abcd04-329d-40a8-8d6e-4383bef437ae {{(pid=134101) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:50:25.750625 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-57dfeca8-d513-439f-9bca-205ce8206e39 tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/d4abcd04-329d-40a8-8d6e-4383bef437ae" status: 200 len: 2423 microversion: 2.25 time: 1.094700 Oct 04 21:50:25.751702 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 866/1804] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:50:24 2022] GET /compute/v2.1/servers/d4abcd04-329d-40a8-8d6e-4383bef437ae => generated 2423 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:50:25.758554 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-72f1b274-9407-4f18-916c-2044a83da644 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:50:25.759948 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-72f1b274-9407-4f18-916c-2044a83da644 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] [instance: 3f80e8f0-dba3-4403-83f8-0473c5d7d29b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:50:25.772747 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-72f1b274-9407-4f18-916c-2044a83da644 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:25.773741 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-72f1b274-9407-4f18-916c-2044a83da644 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:25.775359 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-72f1b274-9407-4f18-916c-2044a83da644 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:25.776533 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-72f1b274-9407-4f18-916c-2044a83da644 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:25.778050 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-72f1b274-9407-4f18-916c-2044a83da644 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:25.778547 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-72f1b274-9407-4f18-916c-2044a83da644 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:25.951709 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-72f1b274-9407-4f18-916c-2044a83da644 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43653f2aea4e4884b5001dea5ec12be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b700f614a8b4cfba9b4abea45a06f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:25.966208 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-72f1b274-9407-4f18-916c-2044a83da644 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43653f2aea4e4884b5001dea5ec12be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b700f614a8b4cfba9b4abea45a06f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:25.967888 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-72f1b274-9407-4f18-916c-2044a83da644 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43653f2aea4e4884b5001dea5ec12be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b700f614a8b4cfba9b4abea45a06f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:25.974664 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-72f1b274-9407-4f18-916c-2044a83da644 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] 10.222.0.43 "GET /compute/v2.1/servers/3f80e8f0-dba3-4403-83f8-0473c5d7d29b" status: 200 len: 1444 microversion: 2.75 time: 0.220121 Oct 04 21:50:25.975691 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 867/1805] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:50:25 2022] GET /compute/v2.1/servers/3f80e8f0-dba3-4403-83f8-0473c5d7d29b => generated 1444 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:50:25.981207 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-37e018a1-a529-4f46-884f-9489d0d02466 req-7042470e-8c71-4ac2-8f8f-74cd953011ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a50a2117-fefe-499b-a2d4-b57e264a5a51", "name": "network-vif-plugged", "status": "completed", "tag": "be4ecfc6-29dd-49c4-9fc3-83e38314144a"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:50:25.991687 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-37e018a1-a529-4f46-884f-9489d0d02466 req-7042470e-8c71-4ac2-8f8f-74cd953011ac service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:25.992592 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-37e018a1-a529-4f46-884f-9489d0d02466 req-7042470e-8c71-4ac2-8f8f-74cd953011ac service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:25.993264 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-37e018a1-a529-4f46-884f-9489d0d02466 req-7042470e-8c71-4ac2-8f8f-74cd953011ac service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:26.013928 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-37e018a1-a529-4f46-884f-9489d0d02466 req-7042470e-8c71-4ac2-8f8f-74cd953011ac service nova] Creating event network-vif-plugged:be4ecfc6-29dd-49c4-9fc3-83e38314144a for instance a50a2117-fefe-499b-a2d4-b57e264a5a51 on n-h1-860284-1 Oct 04 21:50:26.029605 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-37e018a1-a529-4f46-884f-9489d0d02466 req-7042470e-8c71-4ac2-8f8f-74cd953011ac service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051898 Oct 04 21:50:26.030475 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 868/1806] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:50:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:50:26.039632 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-47443028-33d8-4805-aa8a-b8298ba0f151 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:50:26.040753 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-47443028-33d8-4805-aa8a-b8298ba0f151 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 3f0a02bc-7993-4849-8b3c-7572327b4799] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:50:26.049099 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-47443028-33d8-4805-aa8a-b8298ba0f151 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:26.050034 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-47443028-33d8-4805-aa8a-b8298ba0f151 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:26.050608 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-47443028-33d8-4805-aa8a-b8298ba0f151 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:26.052245 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-47443028-33d8-4805-aa8a-b8298ba0f151 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:26.052744 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-47443028-33d8-4805-aa8a-b8298ba0f151 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:26.054700 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-47443028-33d8-4805-aa8a-b8298ba0f151 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:26.664538 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-47443028-33d8-4805-aa8a-b8298ba0f151 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ad048becf474fb972d4291422d810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dcfc7024fc49388c4bd5f25f03e60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:26.684115 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-47443028-33d8-4805-aa8a-b8298ba0f151 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/3f0a02bc-7993-4849-8b3c-7572327b4799" status: 200 len: 1716 microversion: 2.1 time: 0.652351 Oct 04 21:50:26.694195 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 869/1807] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:50:26 2022] GET /compute/v2.1/servers/3f0a02bc-7993-4849-8b3c-7572327b4799 => generated 1716 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:50:26.710304 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-1e624c09-3c82-4f14-bd6f-a987f5e05db2 tempest-ServersTestFqdnHostnames-1740621305 tempest-ServersTestFqdnHostnames-1740621305-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:50:26.711953 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-1e624c09-3c82-4f14-bd6f-a987f5e05db2 tempest-ServersTestFqdnHostnames-1740621305 tempest-ServersTestFqdnHostnames-1740621305-project] [instance: a50a2117-fefe-499b-a2d4-b57e264a5a51] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:50:26.719001 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1e624c09-3c82-4f14-bd6f-a987f5e05db2 tempest-ServersTestFqdnHostnames-1740621305 tempest-ServersTestFqdnHostnames-1740621305-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:26.721208 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1e624c09-3c82-4f14-bd6f-a987f5e05db2 tempest-ServersTestFqdnHostnames-1740621305 tempest-ServersTestFqdnHostnames-1740621305-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:26.722130 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1e624c09-3c82-4f14-bd6f-a987f5e05db2 tempest-ServersTestFqdnHostnames-1740621305 tempest-ServersTestFqdnHostnames-1740621305-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:26.723363 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1e624c09-3c82-4f14-bd6f-a987f5e05db2 tempest-ServersTestFqdnHostnames-1740621305 tempest-ServersTestFqdnHostnames-1740621305-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:26.724275 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1e624c09-3c82-4f14-bd6f-a987f5e05db2 tempest-ServersTestFqdnHostnames-1740621305 tempest-ServersTestFqdnHostnames-1740621305-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:26.725088 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1e624c09-3c82-4f14-bd6f-a987f5e05db2 tempest-ServersTestFqdnHostnames-1740621305 tempest-ServersTestFqdnHostnames-1740621305-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:27.029500 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-1e624c09-3c82-4f14-bd6f-a987f5e05db2 tempest-ServersTestFqdnHostnames-1740621305 tempest-ServersTestFqdnHostnames-1740621305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ade6e5b885f4e7db1fef86de59a08de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dbdc46c0aa4d07a1eb5ade5b3a7212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:27.056623 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-1e624c09-3c82-4f14-bd6f-a987f5e05db2 tempest-ServersTestFqdnHostnames-1740621305 tempest-ServersTestFqdnHostnames-1740621305-project] 10.222.0.43 "GET /compute/v2.1/servers/a50a2117-fefe-499b-a2d4-b57e264a5a51" status: 200 len: 1351 microversion: 2.1 time: 0.357982 Oct 04 21:50:27.057385 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 870/1808] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:50:26 2022] GET /compute/v2.1/servers/a50a2117-fefe-499b-a2d4-b57e264a5a51 => generated 1351 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:50:27.077867 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-bd64c5fd-49c6-4df2-ac85-84ceebdc59ec tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:50:27.082337 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-bd64c5fd-49c6-4df2-ac85-84ceebdc59ec tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] [instance: d4abcd04-329d-40a8-8d6e-4383bef437ae] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:50:27.110639 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bd64c5fd-49c6-4df2-ac85-84ceebdc59ec tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:27.111669 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bd64c5fd-49c6-4df2-ac85-84ceebdc59ec tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:27.112484 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bd64c5fd-49c6-4df2-ac85-84ceebdc59ec tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:27.113827 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bd64c5fd-49c6-4df2-ac85-84ceebdc59ec tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:27.114529 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bd64c5fd-49c6-4df2-ac85-84ceebdc59ec tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:27.115437 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bd64c5fd-49c6-4df2-ac85-84ceebdc59ec tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:27.292052 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=28 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:50:27.397280 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-b5243772-a4c6-468e-ab98-38dcd945e96c tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] 10.222.0.43 "DELETE /compute/v2.1/os-floating-ips/170713b9-2dcd-445b-b5de-8c303609f758" status: 202 len: 0 microversion: 2.1 time: 2.621096 Oct 04 21:50:27.397961 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 939/1809] 10.222.0.43 () {58 vars in 1263 bytes} [Tue Oct 4 21:50:24 2022] DELETE /compute/v2.1/os-floating-ips/170713b9-2dcd-445b-b5de-8c303609f758 => generated 0 bytes in 2622 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:50:27.404732 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-ce8b76e8-e732-4f9c-98a8-e37be17f3adf tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:50:27.405354 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-ce8b76e8-e732-4f9c-98a8-e37be17f3adf tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] [instance: 3f80e8f0-dba3-4403-83f8-0473c5d7d29b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:50:27.422004 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ce8b76e8-e732-4f9c-98a8-e37be17f3adf tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:27.422525 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ce8b76e8-e732-4f9c-98a8-e37be17f3adf tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:27.423184 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ce8b76e8-e732-4f9c-98a8-e37be17f3adf tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:27.424708 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ce8b76e8-e732-4f9c-98a8-e37be17f3adf tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:27.425472 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ce8b76e8-e732-4f9c-98a8-e37be17f3adf tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:27.427463 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ce8b76e8-e732-4f9c-98a8-e37be17f3adf tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:27.430058 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.objects.instance [None req-bd64c5fd-49c6-4df2-ac85-84ceebdc59ec tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Lazy-loading 'services' on Instance uuid d4abcd04-329d-40a8-8d6e-4383bef437ae {{(pid=134101) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:50:27.449286 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-bd64c5fd-49c6-4df2-ac85-84ceebdc59ec tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/d4abcd04-329d-40a8-8d6e-4383bef437ae" status: 200 len: 2423 microversion: 2.25 time: 0.389286 Oct 04 21:50:27.450609 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 871/1810] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:50:27 2022] GET /compute/v2.1/servers/d4abcd04-329d-40a8-8d6e-4383bef437ae => generated 2423 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:50:27.466863 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-067b3fad-6df7-45f8-8829-b49a748719cb tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:50:27.467616 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-067b3fad-6df7-45f8-8829-b49a748719cb tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] [instance: fdc82b91-5dfa-44cf-b8c5-402922265d88] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:50:27.479925 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-067b3fad-6df7-45f8-8829-b49a748719cb tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:27.480413 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-067b3fad-6df7-45f8-8829-b49a748719cb tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:27.482277 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-067b3fad-6df7-45f8-8829-b49a748719cb tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:27.483053 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-067b3fad-6df7-45f8-8829-b49a748719cb tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:27.484662 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-067b3fad-6df7-45f8-8829-b49a748719cb tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:27.488154 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-067b3fad-6df7-45f8-8829-b49a748719cb tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:27.560421 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-067b3fad-6df7-45f8-8829-b49a748719cb tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] [instance: fdc82b91-5dfa-44cf-b8c5-402922265d88] Going to try to terminate instance {{(pid=134101) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:50:27.591678 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-ce8b76e8-e732-4f9c-98a8-e37be17f3adf tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43653f2aea4e4884b5001dea5ec12be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b700f614a8b4cfba9b4abea45a06f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:27.607663 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-ce8b76e8-e732-4f9c-98a8-e37be17f3adf tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43653f2aea4e4884b5001dea5ec12be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b700f614a8b4cfba9b4abea45a06f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:27.609224 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-ce8b76e8-e732-4f9c-98a8-e37be17f3adf tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43653f2aea4e4884b5001dea5ec12be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b700f614a8b4cfba9b4abea45a06f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:27.622569 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-ce8b76e8-e732-4f9c-98a8-e37be17f3adf tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] 10.222.0.43 "GET /compute/v2.1/servers/3f80e8f0-dba3-4403-83f8-0473c5d7d29b" status: 200 len: 1444 microversion: 2.75 time: 0.223498 Oct 04 21:50:27.624103 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 940/1811] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:50:27 2022] GET /compute/v2.1/servers/3f80e8f0-dba3-4403-83f8-0473c5d7d29b => generated 1444 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:50:27.629530 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-7469fce6-8a00-47d5-ae88-c339bd1a7ed6 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:50:27.631021 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-7469fce6-8a00-47d5-ae88-c339bd1a7ed6 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] [instance: d4abcd04-329d-40a8-8d6e-4383bef437ae] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:50:27.643034 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7469fce6-8a00-47d5-ae88-c339bd1a7ed6 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:27.643532 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7469fce6-8a00-47d5-ae88-c339bd1a7ed6 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:27.643963 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7469fce6-8a00-47d5-ae88-c339bd1a7ed6 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:27.644658 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7469fce6-8a00-47d5-ae88-c339bd1a7ed6 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:27.645129 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7469fce6-8a00-47d5-ae88-c339bd1a7ed6 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:27.645519 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7469fce6-8a00-47d5-ae88-c339bd1a7ed6 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:27.680925 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-067b3fad-6df7-45f8-8829-b49a748719cb tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] 10.222.0.43 "DELETE /compute/v2.1/servers/fdc82b91-5dfa-44cf-b8c5-402922265d88" status: 204 len: 0 microversion: 2.1 time: 0.228508 Oct 04 21:50:27.685554 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 872/1812] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 21:50:27 2022] DELETE /compute/v2.1/servers/fdc82b91-5dfa-44cf-b8c5-402922265d88 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:50:27.697039 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-d82522a8-0213-43c3-ad02-1e5a60a0ac9f tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:50:27.702951 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-d82522a8-0213-43c3-ad02-1e5a60a0ac9f tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] [instance: fdc82b91-5dfa-44cf-b8c5-402922265d88] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:50:27.718461 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d82522a8-0213-43c3-ad02-1e5a60a0ac9f tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:27.719453 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d82522a8-0213-43c3-ad02-1e5a60a0ac9f tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:27.721039 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d82522a8-0213-43c3-ad02-1e5a60a0ac9f tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:27.721932 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d82522a8-0213-43c3-ad02-1e5a60a0ac9f tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:27.722781 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d82522a8-0213-43c3-ad02-1e5a60a0ac9f tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:27.723369 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d82522a8-0213-43c3-ad02-1e5a60a0ac9f tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:27.960858 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.objects.instance [None req-7469fce6-8a00-47d5-ae88-c339bd1a7ed6 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lazy-loading 'services' on Instance uuid d4abcd04-329d-40a8-8d6e-4383bef437ae {{(pid=134102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:50:27.975261 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-d82522a8-0213-43c3-ad02-1e5a60a0ac9f tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d66a6a9c5c4c57ba0d25a37323f37f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758fcafb5db74075b183978a97b7c4ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:27.999946 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-d82522a8-0213-43c3-ad02-1e5a60a0ac9f tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] 10.222.0.43 "GET /compute/v2.1/servers/fdc82b91-5dfa-44cf-b8c5-402922265d88" status: 200 len: 1526 microversion: 2.1 time: 0.297515 Oct 04 21:50:28.004457 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 873/1813] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:50:27 2022] GET /compute/v2.1/servers/fdc82b91-5dfa-44cf-b8c5-402922265d88 => generated 1526 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:50:28.015916 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e9537cc1-1a76-432d-9528-59baf9ae4ca6 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:50:28.018971 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-e9537cc1-1a76-432d-9528-59baf9ae4ca6 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 3f0a02bc-7993-4849-8b3c-7572327b4799] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:50:28.033700 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e9537cc1-1a76-432d-9528-59baf9ae4ca6 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:28.036255 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e9537cc1-1a76-432d-9528-59baf9ae4ca6 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:28.037113 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e9537cc1-1a76-432d-9528-59baf9ae4ca6 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:28.038506 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e9537cc1-1a76-432d-9528-59baf9ae4ca6 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:28.039240 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e9537cc1-1a76-432d-9528-59baf9ae4ca6 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:28.043705 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e9537cc1-1a76-432d-9528-59baf9ae4ca6 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:28.120867 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-7469fce6-8a00-47d5-ae88-c339bd1a7ed6 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] 10.222.0.43 "DELETE /compute/v2.1/servers/d4abcd04-329d-40a8-8d6e-4383bef437ae/os-volume_attachments/e69ddac7-a8e9-41b4-9ecf-697d8d90efaa" status: 202 len: 0 microversion: 2.25 time: 0.495323 Oct 04 21:50:28.122044 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 941/1814] 10.222.0.43 () {60 vars in 1457 bytes} [Tue Oct 4 21:50:27 2022] DELETE /compute/v2.1/servers/d4abcd04-329d-40a8-8d6e-4383bef437ae/os-volume_attachments/e69ddac7-a8e9-41b4-9ecf-697d8d90efaa => generated 0 bytes in 497 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:50:28.129976 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-7281f71e-3fd5-4c03-a4c2-2ed2e6960c9d tempest-ServersTestFqdnHostnames-1740621305 tempest-ServersTestFqdnHostnames-1740621305-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:50:28.130985 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-7281f71e-3fd5-4c03-a4c2-2ed2e6960c9d tempest-ServersTestFqdnHostnames-1740621305 tempest-ServersTestFqdnHostnames-1740621305-project] [instance: a50a2117-fefe-499b-a2d4-b57e264a5a51] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:50:28.148034 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7281f71e-3fd5-4c03-a4c2-2ed2e6960c9d tempest-ServersTestFqdnHostnames-1740621305 tempest-ServersTestFqdnHostnames-1740621305-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:28.156821 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7281f71e-3fd5-4c03-a4c2-2ed2e6960c9d tempest-ServersTestFqdnHostnames-1740621305 tempest-ServersTestFqdnHostnames-1740621305-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:28.157576 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7281f71e-3fd5-4c03-a4c2-2ed2e6960c9d tempest-ServersTestFqdnHostnames-1740621305 tempest-ServersTestFqdnHostnames-1740621305-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:28.159927 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7281f71e-3fd5-4c03-a4c2-2ed2e6960c9d tempest-ServersTestFqdnHostnames-1740621305 tempest-ServersTestFqdnHostnames-1740621305-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:28.160974 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7281f71e-3fd5-4c03-a4c2-2ed2e6960c9d tempest-ServersTestFqdnHostnames-1740621305 tempest-ServersTestFqdnHostnames-1740621305-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:28.161668 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7281f71e-3fd5-4c03-a4c2-2ed2e6960c9d tempest-ServersTestFqdnHostnames-1740621305 tempest-ServersTestFqdnHostnames-1740621305-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:28.196268 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:50:28.216456 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-e9537cc1-1a76-432d-9528-59baf9ae4ca6 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ad048becf474fb972d4291422d810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dcfc7024fc49388c4bd5f25f03e60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:28.226285 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-e9537cc1-1a76-432d-9528-59baf9ae4ca6 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/3f0a02bc-7993-4849-8b3c-7572327b4799" status: 200 len: 1716 microversion: 2.1 time: 0.219420 Oct 04 21:50:28.229483 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 874/1815] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:50:28 2022] GET /compute/v2.1/servers/3f0a02bc-7993-4849-8b3c-7572327b4799 => generated 1716 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:50:28.238561 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-60f19b5e-78ca-4ab0-82c4-321cdeb668cc tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:50:28.241518 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-60f19b5e-78ca-4ab0-82c4-321cdeb668cc tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] [instance: d4abcd04-329d-40a8-8d6e-4383bef437ae] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:50:28.250654 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-60f19b5e-78ca-4ab0-82c4-321cdeb668cc tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:28.252176 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-60f19b5e-78ca-4ab0-82c4-321cdeb668cc tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:28.252804 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-60f19b5e-78ca-4ab0-82c4-321cdeb668cc tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:28.257849 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-60f19b5e-78ca-4ab0-82c4-321cdeb668cc tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:28.258836 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-60f19b5e-78ca-4ab0-82c4-321cdeb668cc tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:28.260030 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-60f19b5e-78ca-4ab0-82c4-321cdeb668cc tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:28.346679 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-60f19b5e-78ca-4ab0-82c4-321cdeb668cc tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] 10.222.0.43 "GET /compute/v2.1/servers/d4abcd04-329d-40a8-8d6e-4383bef437ae/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.112908 Oct 04 21:50:28.351194 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 875/1816] 10.222.0.43 () {60 vars in 1343 bytes} [Tue Oct 4 21:50:28 2022] GET /compute/v2.1/servers/d4abcd04-329d-40a8-8d6e-4383bef437ae/os-volume_attachments => generated 197 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:50:28.453096 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-7281f71e-3fd5-4c03-a4c2-2ed2e6960c9d tempest-ServersTestFqdnHostnames-1740621305 tempest-ServersTestFqdnHostnames-1740621305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ade6e5b885f4e7db1fef86de59a08de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dbdc46c0aa4d07a1eb5ade5b3a7212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:28.463289 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-7281f71e-3fd5-4c03-a4c2-2ed2e6960c9d tempest-ServersTestFqdnHostnames-1740621305 tempest-ServersTestFqdnHostnames-1740621305-project] 10.222.0.43 "GET /compute/v2.1/servers/a50a2117-fefe-499b-a2d4-b57e264a5a51" status: 200 len: 1542 microversion: 2.1 time: 0.339843 Oct 04 21:50:28.463875 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 942/1817] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:50:28 2022] GET /compute/v2.1/servers/a50a2117-fefe-499b-a2d4-b57e264a5a51 => generated 1542 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:50:28.493938 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-5c4726ae-b9e2-4a4a-ae0b-13d80a757e24 tempest-ServersTestFqdnHostnames-1740621305 tempest-ServersTestFqdnHostnames-1740621305-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:50:28.494975 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-5c4726ae-b9e2-4a4a-ae0b-13d80a757e24 tempest-ServersTestFqdnHostnames-1740621305 tempest-ServersTestFqdnHostnames-1740621305-project] [instance: a50a2117-fefe-499b-a2d4-b57e264a5a51] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:50:28.505445 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5c4726ae-b9e2-4a4a-ae0b-13d80a757e24 tempest-ServersTestFqdnHostnames-1740621305 tempest-ServersTestFqdnHostnames-1740621305-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:28.506868 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5c4726ae-b9e2-4a4a-ae0b-13d80a757e24 tempest-ServersTestFqdnHostnames-1740621305 tempest-ServersTestFqdnHostnames-1740621305-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:28.509360 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5c4726ae-b9e2-4a4a-ae0b-13d80a757e24 tempest-ServersTestFqdnHostnames-1740621305 tempest-ServersTestFqdnHostnames-1740621305-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:28.511568 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5c4726ae-b9e2-4a4a-ae0b-13d80a757e24 tempest-ServersTestFqdnHostnames-1740621305 tempest-ServersTestFqdnHostnames-1740621305-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:28.512259 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5c4726ae-b9e2-4a4a-ae0b-13d80a757e24 tempest-ServersTestFqdnHostnames-1740621305 tempest-ServersTestFqdnHostnames-1740621305-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:28.515131 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5c4726ae-b9e2-4a4a-ae0b-13d80a757e24 tempest-ServersTestFqdnHostnames-1740621305 tempest-ServersTestFqdnHostnames-1740621305-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:28.550265 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=95,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=2,nova_cell1:RELEASE=1,nova_cell1:INSERT=1 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:50:28.654310 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-91a799d7-bdc0-4a75-b733-6b287127ef49 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:50:28.655173 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-91a799d7-bdc0-4a75-b733-6b287127ef49 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] [instance: 3f80e8f0-dba3-4403-83f8-0473c5d7d29b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:50:28.667060 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-91a799d7-bdc0-4a75-b733-6b287127ef49 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:28.667834 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-91a799d7-bdc0-4a75-b733-6b287127ef49 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:28.668646 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-91a799d7-bdc0-4a75-b733-6b287127ef49 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:28.670521 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-91a799d7-bdc0-4a75-b733-6b287127ef49 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:28.671530 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-91a799d7-bdc0-4a75-b733-6b287127ef49 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:28.671966 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-91a799d7-bdc0-4a75-b733-6b287127ef49 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:28.692179 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-5c4726ae-b9e2-4a4a-ae0b-13d80a757e24 tempest-ServersTestFqdnHostnames-1740621305 tempest-ServersTestFqdnHostnames-1740621305-project] 10.222.0.43 "GET /compute/v2.1/servers/a50a2117-fefe-499b-a2d4-b57e264a5a51/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.205946 Oct 04 21:50:28.692795 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 876/1818] 10.222.0.43 () {58 vars in 1275 bytes} [Tue Oct 4 21:50:28 2022] GET /compute/v2.1/servers/a50a2117-fefe-499b-a2d4-b57e264a5a51/os-interface => generated 285 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:50:28.929877 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-91a799d7-bdc0-4a75-b733-6b287127ef49 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43653f2aea4e4884b5001dea5ec12be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b700f614a8b4cfba9b4abea45a06f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:28.944007 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-91a799d7-bdc0-4a75-b733-6b287127ef49 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43653f2aea4e4884b5001dea5ec12be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b700f614a8b4cfba9b4abea45a06f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:28.945934 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-91a799d7-bdc0-4a75-b733-6b287127ef49 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43653f2aea4e4884b5001dea5ec12be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b700f614a8b4cfba9b4abea45a06f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:28.967557 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-91a799d7-bdc0-4a75-b733-6b287127ef49 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] 10.222.0.43 "GET /compute/v2.1/servers/3f80e8f0-dba3-4403-83f8-0473c5d7d29b" status: 200 len: 1444 microversion: 2.75 time: 0.313406 Oct 04 21:50:28.968969 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 943/1819] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:50:28 2022] GET /compute/v2.1/servers/3f80e8f0-dba3-4403-83f8-0473c5d7d29b => generated 1444 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:50:29.027287 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-1604feb1-b0dc-49ab-bdb5-6a3020e613d4 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:50:29.028734 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-1604feb1-b0dc-49ab-bdb5-6a3020e613d4 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] [instance: fdc82b91-5dfa-44cf-b8c5-402922265d88] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:50:29.039272 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1604feb1-b0dc-49ab-bdb5-6a3020e613d4 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:29.044852 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1604feb1-b0dc-49ab-bdb5-6a3020e613d4 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:29.045332 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1604feb1-b0dc-49ab-bdb5-6a3020e613d4 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:29.046194 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1604feb1-b0dc-49ab-bdb5-6a3020e613d4 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:29.047649 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1604feb1-b0dc-49ab-bdb5-6a3020e613d4 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:29.048089 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1604feb1-b0dc-49ab-bdb5-6a3020e613d4 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:29.306677 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-32ba39f1-29a6-46ec-9a76-7a1bd9201952 tempest-AZV2TestJSON-270175611 tempest-AZV2TestJSON-270175611-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:50:29.309250 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-32ba39f1-29a6-46ec-9a76-7a1bd9201952 tempest-AZV2TestJSON-270175611 tempest-AZV2TestJSON-270175611-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:29.310005 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-32ba39f1-29a6-46ec-9a76-7a1bd9201952 tempest-AZV2TestJSON-270175611 tempest-AZV2TestJSON-270175611-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:29.310732 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-32ba39f1-29a6-46ec-9a76-7a1bd9201952 tempest-AZV2TestJSON-270175611 tempest-AZV2TestJSON-270175611-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:29.311826 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-32ba39f1-29a6-46ec-9a76-7a1bd9201952 tempest-AZV2TestJSON-270175611 tempest-AZV2TestJSON-270175611-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:29.312572 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-32ba39f1-29a6-46ec-9a76-7a1bd9201952 tempest-AZV2TestJSON-270175611 tempest-AZV2TestJSON-270175611-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:29.313167 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-32ba39f1-29a6-46ec-9a76-7a1bd9201952 tempest-AZV2TestJSON-270175611 tempest-AZV2TestJSON-270175611-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:29.346163 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-32ba39f1-29a6-46ec-9a76-7a1bd9201952 tempest-AZV2TestJSON-270175611 tempest-AZV2TestJSON-270175611-project] 10.222.0.43 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.267562 Oct 04 21:50:29.346926 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 944/1820] 10.222.0.43 () {58 vars in 1164 bytes} [Tue Oct 4 21:50:29 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 04 21:50:29.360063 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-7d17b13b-06bf-4b39-9742-19f3163f9350 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:50:29.361120 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-7d17b13b-06bf-4b39-9742-19f3163f9350 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 3f0a02bc-7993-4849-8b3c-7572327b4799] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:50:29.376090 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:50:29.380643 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7d17b13b-06bf-4b39-9742-19f3163f9350 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:29.383376 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7d17b13b-06bf-4b39-9742-19f3163f9350 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:29.386489 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7d17b13b-06bf-4b39-9742-19f3163f9350 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:29.387712 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7d17b13b-06bf-4b39-9742-19f3163f9350 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:29.389029 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7d17b13b-06bf-4b39-9742-19f3163f9350 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:29.390099 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7d17b13b-06bf-4b39-9742-19f3163f9350 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:29.393287 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-1604feb1-b0dc-49ab-bdb5-6a3020e613d4 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d66a6a9c5c4c57ba0d25a37323f37f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758fcafb5db74075b183978a97b7c4ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:29.404622 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-1604feb1-b0dc-49ab-bdb5-6a3020e613d4 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] 10.222.0.43 "GET /compute/v2.1/servers/fdc82b91-5dfa-44cf-b8c5-402922265d88" status: 200 len: 1526 microversion: 2.1 time: 0.383306 Oct 04 21:50:29.410202 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 877/1821] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:50:29 2022] GET /compute/v2.1/servers/fdc82b91-5dfa-44cf-b8c5-402922265d88 => generated 1526 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:50:29.415724 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-5037b785-b64e-4110-98a7-494d9c593cd1 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:50:29.429080 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-5037b785-b64e-4110-98a7-494d9c593cd1 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] [instance: d4abcd04-329d-40a8-8d6e-4383bef437ae] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:50:29.436480 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5037b785-b64e-4110-98a7-494d9c593cd1 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:29.437294 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5037b785-b64e-4110-98a7-494d9c593cd1 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:29.437917 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5037b785-b64e-4110-98a7-494d9c593cd1 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:29.438876 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5037b785-b64e-4110-98a7-494d9c593cd1 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:29.440121 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5037b785-b64e-4110-98a7-494d9c593cd1 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:29.440739 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5037b785-b64e-4110-98a7-494d9c593cd1 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:29.481693 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-5037b785-b64e-4110-98a7-494d9c593cd1 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] 10.222.0.43 "GET /compute/v2.1/servers/d4abcd04-329d-40a8-8d6e-4383bef437ae/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.069909 Oct 04 21:50:29.483323 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 878/1822] 10.222.0.43 () {60 vars in 1343 bytes} [Tue Oct 4 21:50:29 2022] GET /compute/v2.1/servers/d4abcd04-329d-40a8-8d6e-4383bef437ae/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:50:29.820907 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-7d17b13b-06bf-4b39-9742-19f3163f9350 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ad048becf474fb972d4291422d810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dcfc7024fc49388c4bd5f25f03e60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:29.834764 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-7d17b13b-06bf-4b39-9742-19f3163f9350 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/3f0a02bc-7993-4849-8b3c-7572327b4799" status: 200 len: 1716 microversion: 2.1 time: 0.485288 Oct 04 21:50:29.836451 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 945/1823] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:50:29 2022] GET /compute/v2.1/servers/3f0a02bc-7993-4849-8b3c-7572327b4799 => generated 1716 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:50:30.000173 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-7777b5b1-79ce-40e4-971a-6747b5f91678 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:50:30.001407 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-7777b5b1-79ce-40e4-971a-6747b5f91678 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] [instance: 3f80e8f0-dba3-4403-83f8-0473c5d7d29b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:50:30.017296 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7777b5b1-79ce-40e4-971a-6747b5f91678 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:30.019385 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7777b5b1-79ce-40e4-971a-6747b5f91678 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:30.021248 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7777b5b1-79ce-40e4-971a-6747b5f91678 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:30.022686 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7777b5b1-79ce-40e4-971a-6747b5f91678 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:30.025360 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7777b5b1-79ce-40e4-971a-6747b5f91678 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:30.026441 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7777b5b1-79ce-40e4-971a-6747b5f91678 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:30.260494 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-7777b5b1-79ce-40e4-971a-6747b5f91678 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43653f2aea4e4884b5001dea5ec12be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b700f614a8b4cfba9b4abea45a06f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:30.278207 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-7777b5b1-79ce-40e4-971a-6747b5f91678 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43653f2aea4e4884b5001dea5ec12be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b700f614a8b4cfba9b4abea45a06f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:30.291231 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-7777b5b1-79ce-40e4-971a-6747b5f91678 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43653f2aea4e4884b5001dea5ec12be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b700f614a8b4cfba9b4abea45a06f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:30.304937 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-7777b5b1-79ce-40e4-971a-6747b5f91678 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] 10.222.0.43 "GET /compute/v2.1/servers/3f80e8f0-dba3-4403-83f8-0473c5d7d29b" status: 200 len: 1444 microversion: 2.75 time: 0.310398 Oct 04 21:50:30.310495 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 879/1824] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:50:29 2022] GET /compute/v2.1/servers/3f80e8f0-dba3-4403-83f8-0473c5d7d29b => generated 1444 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:50:30.434115 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-fd6dc22a-128e-413c-b159-0f11a216ea4a tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:50:30.435120 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-fd6dc22a-128e-413c-b159-0f11a216ea4a tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] [instance: fdc82b91-5dfa-44cf-b8c5-402922265d88] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:50:30.449409 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fd6dc22a-128e-413c-b159-0f11a216ea4a tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:30.450263 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fd6dc22a-128e-413c-b159-0f11a216ea4a tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:30.450971 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fd6dc22a-128e-413c-b159-0f11a216ea4a tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:30.452794 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fd6dc22a-128e-413c-b159-0f11a216ea4a tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:30.456562 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fd6dc22a-128e-413c-b159-0f11a216ea4a tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:30.457473 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fd6dc22a-128e-413c-b159-0f11a216ea4a tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:30.496979 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-590b914d-0d05-415b-a0c3-0cb4859c75a4 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:50:30.500176 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-590b914d-0d05-415b-a0c3-0cb4859c75a4 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] [instance: d4abcd04-329d-40a8-8d6e-4383bef437ae] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:50:30.522354 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-590b914d-0d05-415b-a0c3-0cb4859c75a4 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:30.527235 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-590b914d-0d05-415b-a0c3-0cb4859c75a4 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:30.528926 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-590b914d-0d05-415b-a0c3-0cb4859c75a4 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:30.531069 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-590b914d-0d05-415b-a0c3-0cb4859c75a4 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:30.538660 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-590b914d-0d05-415b-a0c3-0cb4859c75a4 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:30.539746 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-590b914d-0d05-415b-a0c3-0cb4859c75a4 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:30.638248 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-590b914d-0d05-415b-a0c3-0cb4859c75a4 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] 10.222.0.43 "GET /compute/v2.1/servers/d4abcd04-329d-40a8-8d6e-4383bef437ae/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.146117 Oct 04 21:50:30.639681 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 880/1825] 10.222.0.43 () {60 vars in 1343 bytes} [Tue Oct 4 21:50:30 2022] GET /compute/v2.1/servers/d4abcd04-329d-40a8-8d6e-4383bef437ae/os-volume_attachments => generated 197 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:50:30.891502 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-fd6dc22a-128e-413c-b159-0f11a216ea4a tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d66a6a9c5c4c57ba0d25a37323f37f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758fcafb5db74075b183978a97b7c4ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:30.911603 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-fd6dc22a-128e-413c-b159-0f11a216ea4a tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] 10.222.0.43 "GET /compute/v2.1/servers/fdc82b91-5dfa-44cf-b8c5-402922265d88" status: 200 len: 1526 microversion: 2.1 time: 0.480210 Oct 04 21:50:30.913319 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 946/1826] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:50:30 2022] GET /compute/v2.1/servers/fdc82b91-5dfa-44cf-b8c5-402922265d88 => generated 1526 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:50:31.208763 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-5ac9bf93-8d5d-452d-973a-864ad4c84a0f tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:50:31.209658 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-5ac9bf93-8d5d-452d-973a-864ad4c84a0f tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 3f0a02bc-7993-4849-8b3c-7572327b4799] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:50:31.237426 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5ac9bf93-8d5d-452d-973a-864ad4c84a0f tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:31.244267 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5ac9bf93-8d5d-452d-973a-864ad4c84a0f tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:31.245060 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5ac9bf93-8d5d-452d-973a-864ad4c84a0f tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:31.246328 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5ac9bf93-8d5d-452d-973a-864ad4c84a0f tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:31.247150 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5ac9bf93-8d5d-452d-973a-864ad4c84a0f tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:31.248175 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5ac9bf93-8d5d-452d-973a-864ad4c84a0f tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:31.350553 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-68dcc5de-95a1-46f2-beb6-b7915314ab32 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:50:31.351224 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-68dcc5de-95a1-46f2-beb6-b7915314ab32 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] [instance: 3f80e8f0-dba3-4403-83f8-0473c5d7d29b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:50:31.362208 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-68dcc5de-95a1-46f2-beb6-b7915314ab32 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:31.364617 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-68dcc5de-95a1-46f2-beb6-b7915314ab32 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:31.365261 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-68dcc5de-95a1-46f2-beb6-b7915314ab32 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:31.367739 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-68dcc5de-95a1-46f2-beb6-b7915314ab32 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:31.368483 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-68dcc5de-95a1-46f2-beb6-b7915314ab32 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:31.368919 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-68dcc5de-95a1-46f2-beb6-b7915314ab32 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:31.593548 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-68dcc5de-95a1-46f2-beb6-b7915314ab32 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43653f2aea4e4884b5001dea5ec12be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b700f614a8b4cfba9b4abea45a06f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:31.606314 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-68dcc5de-95a1-46f2-beb6-b7915314ab32 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43653f2aea4e4884b5001dea5ec12be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b700f614a8b4cfba9b4abea45a06f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:31.608432 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-68dcc5de-95a1-46f2-beb6-b7915314ab32 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43653f2aea4e4884b5001dea5ec12be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b700f614a8b4cfba9b4abea45a06f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:31.615976 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-68dcc5de-95a1-46f2-beb6-b7915314ab32 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] 10.222.0.43 "GET /compute/v2.1/servers/3f80e8f0-dba3-4403-83f8-0473c5d7d29b" status: 200 len: 1444 microversion: 2.75 time: 0.277266 Oct 04 21:50:31.617878 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 947/1827] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:50:31 2022] GET /compute/v2.1/servers/3f80e8f0-dba3-4403-83f8-0473c5d7d29b => generated 1444 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:50:31.651979 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-e8657d42-a43b-49ea-85d6-b1460c520651 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:50:31.654944 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-e8657d42-a43b-49ea-85d6-b1460c520651 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] [instance: d4abcd04-329d-40a8-8d6e-4383bef437ae] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:50:31.662653 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e8657d42-a43b-49ea-85d6-b1460c520651 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:31.663386 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e8657d42-a43b-49ea-85d6-b1460c520651 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:31.664231 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e8657d42-a43b-49ea-85d6-b1460c520651 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:31.665123 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e8657d42-a43b-49ea-85d6-b1460c520651 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:31.665745 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e8657d42-a43b-49ea-85d6-b1460c520651 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:31.666336 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e8657d42-a43b-49ea-85d6-b1460c520651 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:31.703780 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-e8657d42-a43b-49ea-85d6-b1460c520651 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] 10.222.0.43 "GET /compute/v2.1/servers/d4abcd04-329d-40a8-8d6e-4383bef437ae/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.056308 Oct 04 21:50:31.705782 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 948/1828] 10.222.0.43 () {60 vars in 1343 bytes} [Tue Oct 4 21:50:31 2022] GET /compute/v2.1/servers/d4abcd04-329d-40a8-8d6e-4383bef437ae/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 21:50:31.743989 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-3e0e02c9-eb2d-4943-87dc-e04da8a99db3 req-7be7b28d-f4c6-4a8f-b6d7-c6a331667124 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fdc82b91-5dfa-44cf-b8c5-402922265d88", "name": "network-vif-deleted", "tag": "c36556e1-4c6d-4308-8210-aa45c17cd2d1"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:50:31.770302 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-3e0e02c9-eb2d-4943-87dc-e04da8a99db3 req-7be7b28d-f4c6-4a8f-b6d7-c6a331667124 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:31.770835 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-3e0e02c9-eb2d-4943-87dc-e04da8a99db3 req-7be7b28d-f4c6-4a8f-b6d7-c6a331667124 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:31.771260 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-3e0e02c9-eb2d-4943-87dc-e04da8a99db3 req-7be7b28d-f4c6-4a8f-b6d7-c6a331667124 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:31.805134 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-3e0e02c9-eb2d-4943-87dc-e04da8a99db3 req-7be7b28d-f4c6-4a8f-b6d7-c6a331667124 service nova] Creating event network-vif-deleted:c36556e1-4c6d-4308-8210-aa45c17cd2d1 for instance fdc82b91-5dfa-44cf-b8c5-402922265d88 on n-h2-860284-1 Oct 04 21:50:31.813516 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-3e0e02c9-eb2d-4943-87dc-e04da8a99db3 req-7be7b28d-f4c6-4a8f-b6d7-c6a331667124 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072657 Oct 04 21:50:31.815135 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 949/1829] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:50:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:50:31.933410 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-5ac9bf93-8d5d-452d-973a-864ad4c84a0f tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ad048becf474fb972d4291422d810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dcfc7024fc49388c4bd5f25f03e60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:31.940664 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-4e4076ec-e6e3-42cf-880c-6141ec1465d9 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:50:31.941368 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-4e4076ec-e6e3-42cf-880c-6141ec1465d9 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] [instance: fdc82b91-5dfa-44cf-b8c5-402922265d88] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:50:31.953179 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-5ac9bf93-8d5d-452d-973a-864ad4c84a0f tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/3f0a02bc-7993-4849-8b3c-7572327b4799" status: 200 len: 1716 microversion: 2.1 time: 1.090658 Oct 04 21:50:31.953752 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 881/1830] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:50:30 2022] GET /compute/v2.1/servers/3f0a02bc-7993-4849-8b3c-7572327b4799 => generated 1716 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:50:31.962931 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4e4076ec-e6e3-42cf-880c-6141ec1465d9 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:31.985282 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4e4076ec-e6e3-42cf-880c-6141ec1465d9 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:31.985964 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4e4076ec-e6e3-42cf-880c-6141ec1465d9 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:31.995616 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4e4076ec-e6e3-42cf-880c-6141ec1465d9 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:31.996122 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4e4076ec-e6e3-42cf-880c-6141ec1465d9 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:32.002187 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4e4076ec-e6e3-42cf-880c-6141ec1465d9 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:32.146447 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4e4076ec-e6e3-42cf-880c-6141ec1465d9 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:32.148673 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4e4076ec-e6e3-42cf-880c-6141ec1465d9 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:32.150680 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4e4076ec-e6e3-42cf-880c-6141ec1465d9 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:32.151661 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.objects.instance [None req-4e4076ec-e6e3-42cf-880c-6141ec1465d9 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Lazy-loading 'fault' on Instance uuid fdc82b91-5dfa-44cf-b8c5-402922265d88 {{(pid=134102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:50:32.435381 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-4e4076ec-e6e3-42cf-880c-6141ec1465d9 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56d66a6a9c5c4c57ba0d25a37323f37f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758fcafb5db74075b183978a97b7c4ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:32.447770 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-4e4076ec-e6e3-42cf-880c-6141ec1465d9 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] 10.222.0.43 "GET /compute/v2.1/servers/fdc82b91-5dfa-44cf-b8c5-402922265d88" status: 200 len: 1313 microversion: 2.1 time: 0.513226 Oct 04 21:50:32.450156 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 950/1831] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:50:31 2022] GET /compute/v2.1/servers/fdc82b91-5dfa-44cf-b8c5-402922265d88 => generated 1313 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:50:32.645194 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-b04252a2-43c9-4b05-85d4-82acd5620157 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:50:32.646039 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-b04252a2-43c9-4b05-85d4-82acd5620157 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] [instance: 3f80e8f0-dba3-4403-83f8-0473c5d7d29b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:50:32.666660 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b04252a2-43c9-4b05-85d4-82acd5620157 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:32.669585 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b04252a2-43c9-4b05-85d4-82acd5620157 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:32.671467 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b04252a2-43c9-4b05-85d4-82acd5620157 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:32.672270 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b04252a2-43c9-4b05-85d4-82acd5620157 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:32.672755 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b04252a2-43c9-4b05-85d4-82acd5620157 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:32.685918 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b04252a2-43c9-4b05-85d4-82acd5620157 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:32.718187 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-0a617b6a-dc75-4f43-962a-b1262c2b1d5c tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:50:32.722147 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-0a617b6a-dc75-4f43-962a-b1262c2b1d5c tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] [instance: d4abcd04-329d-40a8-8d6e-4383bef437ae] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:50:32.748355 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0a617b6a-dc75-4f43-962a-b1262c2b1d5c tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:32.750203 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0a617b6a-dc75-4f43-962a-b1262c2b1d5c tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:32.756952 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0a617b6a-dc75-4f43-962a-b1262c2b1d5c tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:32.763729 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0a617b6a-dc75-4f43-962a-b1262c2b1d5c tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:32.764457 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0a617b6a-dc75-4f43-962a-b1262c2b1d5c tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:32.766080 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0a617b6a-dc75-4f43-962a-b1262c2b1d5c tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:32.889115 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-0a617b6a-dc75-4f43-962a-b1262c2b1d5c tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] 10.222.0.43 "GET /compute/v2.1/servers/d4abcd04-329d-40a8-8d6e-4383bef437ae/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.175491 Oct 04 21:50:32.892549 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 951/1832] 10.222.0.43 () {60 vars in 1343 bytes} [Tue Oct 4 21:50:32 2022] GET /compute/v2.1/servers/d4abcd04-329d-40a8-8d6e-4383bef437ae/os-volume_attachments => generated 197 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:50:32.988429 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-b04252a2-43c9-4b05-85d4-82acd5620157 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43653f2aea4e4884b5001dea5ec12be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b700f614a8b4cfba9b4abea45a06f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:32.999766 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-5ae443c0-e027-467d-837f-97cd5a8011ef tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:50:33.003697 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-5ae443c0-e027-467d-837f-97cd5a8011ef tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 3f0a02bc-7993-4849-8b3c-7572327b4799] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:50:33.023054 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-b04252a2-43c9-4b05-85d4-82acd5620157 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43653f2aea4e4884b5001dea5ec12be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b700f614a8b4cfba9b4abea45a06f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:33.026137 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-b04252a2-43c9-4b05-85d4-82acd5620157 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43653f2aea4e4884b5001dea5ec12be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b700f614a8b4cfba9b4abea45a06f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:33.027310 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5ae443c0-e027-467d-837f-97cd5a8011ef tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:33.028729 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5ae443c0-e027-467d-837f-97cd5a8011ef tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:33.031005 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5ae443c0-e027-467d-837f-97cd5a8011ef tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:33.032016 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5ae443c0-e027-467d-837f-97cd5a8011ef tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:33.034726 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5ae443c0-e027-467d-837f-97cd5a8011ef tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:33.036976 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5ae443c0-e027-467d-837f-97cd5a8011ef tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:33.042086 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-b04252a2-43c9-4b05-85d4-82acd5620157 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] 10.222.0.43 "GET /compute/v2.1/servers/3f80e8f0-dba3-4403-83f8-0473c5d7d29b" status: 200 len: 1444 microversion: 2.75 time: 0.402391 Oct 04 21:50:33.046631 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 882/1833] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:50:32 2022] GET /compute/v2.1/servers/3f80e8f0-dba3-4403-83f8-0473c5d7d29b => generated 1444 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:50:33.475096 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-839e77df-0488-4bf5-8938-5a04f6c41315 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:50:33.475822 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-839e77df-0488-4bf5-8938-5a04f6c41315 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] [instance: fdc82b91-5dfa-44cf-b8c5-402922265d88] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:50:33.494742 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-839e77df-0488-4bf5-8938-5a04f6c41315 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:33.495516 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-839e77df-0488-4bf5-8938-5a04f6c41315 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:33.496229 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-839e77df-0488-4bf5-8938-5a04f6c41315 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:33.506984 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-839e77df-0488-4bf5-8938-5a04f6c41315 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:33.513782 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-839e77df-0488-4bf5-8938-5a04f6c41315 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:33.518529 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-839e77df-0488-4bf5-8938-5a04f6c41315 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:33.574290 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-839e77df-0488-4bf5-8938-5a04f6c41315 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] HTTP exception thrown: Instance fdc82b91-5dfa-44cf-b8c5-402922265d88 could not be found. Oct 04 21:50:33.577275 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-839e77df-0488-4bf5-8938-5a04f6c41315 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Request method failure captured: Oct 04 21:50:33.577275 n-d-860284-1 devstack@n-api.service[134101]: request: GET /compute/v2.1/servers/fdc82b91-5dfa-44cf-b8c5-402922265d88 HTTP/1.1 Oct 04 21:50:33.577275 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 21:50:33.577275 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 21:50:33.577275 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 21:50:33.577275 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 21:50:33.577275 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 21:50:33.577275 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 21:50:33.577275 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 21:50:33.577275 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 21:50:33.577275 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPKo-ln9523hGjik6efbNIsBZPXFxTLqGBuFcWCKjxuW1p1evQNKO_Uyff6cDRYbZa6WI6XvxbfG3eUM6j7dp79zYbjcyduRTyVhI8BgLq8de552QDbCx15COQpRJimlMG4NhjchhlltTp5_5UxkZkLafVbBjmnPUJzBfVZabhSWYBEs Oct 04 21:50:33.577275 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 21:50:33.577275 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 21:50:33.577275 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 21:50:33.577275 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 21:50:33.577275 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 21:50:33.577275 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 21:50:33.577275 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: 758fcafb5db74075b183978a97b7c4ee Oct 04 21:50:33.577275 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-87315922 Oct 04 21:50:33.577275 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 21:50:33.577275 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 21:50:33.577275 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/758fcafb5db74075b183978a97b7c4ee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_758fcafb5db74075b183978a97b7c4ee", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/758fcafb5db74075b183978a97b7c4ee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/758fcafb5db74075b183978a97b7c4ee"}]}] Oct 04 21:50:33.577275 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-87315922 Oct 04 21:50:33.577275 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: 758fcafb5db74075b183978a97b7c4ee Oct 04 21:50:33.577275 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-87315922 Oct 04 21:50:33.577275 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-FloatingIPsAssociationTestJSON-87315922-project Oct 04 21:50:33.577275 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 21:50:33.577275 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 21:50:33.577275 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 56d66a6a9c5c4c57ba0d25a37323f37f Oct 04 21:50:33.577275 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-87315922-project Oct 04 21:50:33.577275 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 21:50:33.577275 n-d-860284-1 devstack@n-api.service[134101]: exception: Instance fdc82b91-5dfa-44cf-b8c5-402922265d88 could not be found. Oct 04 21:50:33.577275 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': 'fdc82b91-5dfa-44cf-b8c5-402922265d88'} Oct 04 21:50:33.577275 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:50:33.577275 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:50:33.577275 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:50:33.577275 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:50:33.577275 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:50:33.577275 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:50:33.577275 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:50:33.577275 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:50:33.577275 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:50:33.577275 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:50:33.577275 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fdc82b91-5dfa-44cf-b8c5-402922265d88 could not be found. Oct 04 21:50:33.577275 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:50:33.577275 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:50:33.577275 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:50:33.577275 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:50:33.577275 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:50:33.577275 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:50:33.577275 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:50:33.577275 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:50:33.577275 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:50:33.577275 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:50:33.577275 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:50:33.577275 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:50:33.577275 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:50:33.577275 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:50:33.577275 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:50:33.577275 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:50:33.577275 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fdc82b91-5dfa-44cf-b8c5-402922265d88 could not be found. Oct 04 21:50:33.577275 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:50:33.577275 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:50:33.582093 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:50:33.582093 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:50:33.582093 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:50:33.582093 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:50:33.582093 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:50:33.582093 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:50:33.582093 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fdc82b91-5dfa-44cf-b8c5-402922265d88 could not be found. Oct 04 21:50:33.582093 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:50:33.588897 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-839e77df-0488-4bf5-8938-5a04f6c41315 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] Returning 404 to user: Instance fdc82b91-5dfa-44cf-b8c5-402922265d88 could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:50:33.591590 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-839e77df-0488-4bf5-8938-5a04f6c41315 tempest-FloatingIPsAssociationTestJSON-87315922 tempest-FloatingIPsAssociationTestJSON-87315922-project] 10.222.0.43 "GET /compute/v2.1/servers/fdc82b91-5dfa-44cf-b8c5-402922265d88" status: 404 len: 111 microversion: 2.1 time: 0.122994 Oct 04 21:50:33.596129 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 883/1834] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:50:33 2022] GET /compute/v2.1/servers/fdc82b91-5dfa-44cf-b8c5-402922265d88 => generated 111 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 21:50:33.752065 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-5ae443c0-e027-467d-837f-97cd5a8011ef tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ad048becf474fb972d4291422d810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dcfc7024fc49388c4bd5f25f03e60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:33.765594 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-5ae443c0-e027-467d-837f-97cd5a8011ef tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/3f0a02bc-7993-4849-8b3c-7572327b4799" status: 200 len: 1716 microversion: 2.1 time: 0.781687 Oct 04 21:50:33.766220 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 952/1835] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:50:32 2022] GET /compute/v2.1/servers/3f0a02bc-7993-4849-8b3c-7572327b4799 => generated 1716 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:50:33.847430 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-b33044ac-5e9a-4853-b679-3b33b450cf88 req-134584bd-b133-4614-a9a5-303156467b45 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a50a2117-fefe-499b-a2d4-b57e264a5a51", "tag": "be4ecfc6-29dd-49c4-9fc3-83e38314144a"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:50:33.881419 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-b33044ac-5e9a-4853-b679-3b33b450cf88 req-134584bd-b133-4614-a9a5-303156467b45 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:33.883664 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-b33044ac-5e9a-4853-b679-3b33b450cf88 req-134584bd-b133-4614-a9a5-303156467b45 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:33.884495 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-b33044ac-5e9a-4853-b679-3b33b450cf88 req-134584bd-b133-4614-a9a5-303156467b45 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:33.911414 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-ab8c706e-100b-4eac-9184-8ddf3138cfb4 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:50:33.928749 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-ab8c706e-100b-4eac-9184-8ddf3138cfb4 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] [instance: d4abcd04-329d-40a8-8d6e-4383bef437ae] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:50:33.950500 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ab8c706e-100b-4eac-9184-8ddf3138cfb4 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:33.952140 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-b33044ac-5e9a-4853-b679-3b33b450cf88 req-134584bd-b133-4614-a9a5-303156467b45 service nova] Creating event network-changed:be4ecfc6-29dd-49c4-9fc3-83e38314144a for instance a50a2117-fefe-499b-a2d4-b57e264a5a51 on n-h1-860284-1 Oct 04 21:50:33.954082 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ab8c706e-100b-4eac-9184-8ddf3138cfb4 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:33.962318 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ab8c706e-100b-4eac-9184-8ddf3138cfb4 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:33.963530 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ab8c706e-100b-4eac-9184-8ddf3138cfb4 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:33.965887 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ab8c706e-100b-4eac-9184-8ddf3138cfb4 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:33.967336 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ab8c706e-100b-4eac-9184-8ddf3138cfb4 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:33.981568 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-b33044ac-5e9a-4853-b679-3b33b450cf88 req-134584bd-b133-4614-a9a5-303156467b45 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.139081 Oct 04 21:50:33.983495 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 884/1836] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:50:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:50:34.070618 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-ab8c706e-100b-4eac-9184-8ddf3138cfb4 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] 10.222.0.43 "GET /compute/v2.1/servers/d4abcd04-329d-40a8-8d6e-4383bef437ae/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.164695 Oct 04 21:50:34.074720 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 953/1837] 10.222.0.43 () {60 vars in 1343 bytes} [Tue Oct 4 21:50:33 2022] GET /compute/v2.1/servers/d4abcd04-329d-40a8-8d6e-4383bef437ae/os-volume_attachments => generated 197 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 21:50:34.085148 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-7bcf613e-0882-40cd-a1de-d7700aa8605a tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:50:34.086004 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-7bcf613e-0882-40cd-a1de-d7700aa8605a tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] [instance: 3f80e8f0-dba3-4403-83f8-0473c5d7d29b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:50:34.113732 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7bcf613e-0882-40cd-a1de-d7700aa8605a tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:34.121331 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7bcf613e-0882-40cd-a1de-d7700aa8605a tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:34.121991 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7bcf613e-0882-40cd-a1de-d7700aa8605a tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:34.123856 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7bcf613e-0882-40cd-a1de-d7700aa8605a tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:34.125887 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7bcf613e-0882-40cd-a1de-d7700aa8605a tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:34.130497 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7bcf613e-0882-40cd-a1de-d7700aa8605a tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:34.417540 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-7bcf613e-0882-40cd-a1de-d7700aa8605a tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43653f2aea4e4884b5001dea5ec12be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b700f614a8b4cfba9b4abea45a06f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:34.435751 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-7bcf613e-0882-40cd-a1de-d7700aa8605a tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43653f2aea4e4884b5001dea5ec12be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b700f614a8b4cfba9b4abea45a06f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:34.445578 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-7bcf613e-0882-40cd-a1de-d7700aa8605a tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43653f2aea4e4884b5001dea5ec12be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b700f614a8b4cfba9b4abea45a06f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:34.467460 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-7bcf613e-0882-40cd-a1de-d7700aa8605a tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] 10.222.0.43 "GET /compute/v2.1/servers/3f80e8f0-dba3-4403-83f8-0473c5d7d29b" status: 200 len: 1444 microversion: 2.75 time: 0.388250 Oct 04 21:50:34.498087 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 885/1838] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:50:34 2022] GET /compute/v2.1/servers/3f80e8f0-dba3-4403-83f8-0473c5d7d29b => generated 1444 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:50:34.790494 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-d80729b0-eb22-408c-963e-7414af890e86 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:50:34.791415 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-d80729b0-eb22-408c-963e-7414af890e86 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 3f0a02bc-7993-4849-8b3c-7572327b4799] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:50:34.808703 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d80729b0-eb22-408c-963e-7414af890e86 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:34.809751 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d80729b0-eb22-408c-963e-7414af890e86 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:34.810398 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d80729b0-eb22-408c-963e-7414af890e86 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:34.811347 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d80729b0-eb22-408c-963e-7414af890e86 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:34.811988 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d80729b0-eb22-408c-963e-7414af890e86 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:34.812580 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d80729b0-eb22-408c-963e-7414af890e86 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:35.083619 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-26bf15d8-d3e4-488a-9e00-f1197d314440 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:50:35.087352 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-26bf15d8-d3e4-488a-9e00-f1197d314440 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] [instance: d4abcd04-329d-40a8-8d6e-4383bef437ae] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:50:35.097745 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-26bf15d8-d3e4-488a-9e00-f1197d314440 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:35.110704 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-26bf15d8-d3e4-488a-9e00-f1197d314440 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:35.111406 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-26bf15d8-d3e4-488a-9e00-f1197d314440 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:35.112316 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-26bf15d8-d3e4-488a-9e00-f1197d314440 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:35.112902 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-26bf15d8-d3e4-488a-9e00-f1197d314440 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:35.113444 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-26bf15d8-d3e4-488a-9e00-f1197d314440 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:35.166384 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-26bf15d8-d3e4-488a-9e00-f1197d314440 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] 10.222.0.43 "GET /compute/v2.1/servers/d4abcd04-329d-40a8-8d6e-4383bef437ae/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.087145 Oct 04 21:50:35.169833 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 886/1839] 10.222.0.43 () {60 vars in 1343 bytes} [Tue Oct 4 21:50:35 2022] GET /compute/v2.1/servers/d4abcd04-329d-40a8-8d6e-4383bef437ae/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 21:50:35.185931 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-d80729b0-eb22-408c-963e-7414af890e86 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ad048becf474fb972d4291422d810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dcfc7024fc49388c4bd5f25f03e60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:35.200910 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-d80729b0-eb22-408c-963e-7414af890e86 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/3f0a02bc-7993-4849-8b3c-7572327b4799" status: 200 len: 1716 microversion: 2.1 time: 0.414967 Oct 04 21:50:35.203893 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 954/1840] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:50:34 2022] GET /compute/v2.1/servers/3f0a02bc-7993-4849-8b3c-7572327b4799 => generated 1716 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:50:35.506302 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-74c78ae2-9ecb-49d0-a07a-b61a969038b5 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:50:35.507352 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-74c78ae2-9ecb-49d0-a07a-b61a969038b5 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] [instance: 3f80e8f0-dba3-4403-83f8-0473c5d7d29b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:50:35.515446 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:50:35.524732 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-74c78ae2-9ecb-49d0-a07a-b61a969038b5 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:35.527552 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-74c78ae2-9ecb-49d0-a07a-b61a969038b5 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:35.527552 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-74c78ae2-9ecb-49d0-a07a-b61a969038b5 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:35.534590 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-74c78ae2-9ecb-49d0-a07a-b61a969038b5 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:35.535472 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-74c78ae2-9ecb-49d0-a07a-b61a969038b5 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:35.536163 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-74c78ae2-9ecb-49d0-a07a-b61a969038b5 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:35.624783 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-74c78ae2-9ecb-49d0-a07a-b61a969038b5 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43653f2aea4e4884b5001dea5ec12be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b700f614a8b4cfba9b4abea45a06f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:35.637680 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-74c78ae2-9ecb-49d0-a07a-b61a969038b5 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43653f2aea4e4884b5001dea5ec12be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b700f614a8b4cfba9b4abea45a06f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:35.643017 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-74c78ae2-9ecb-49d0-a07a-b61a969038b5 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43653f2aea4e4884b5001dea5ec12be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b700f614a8b4cfba9b4abea45a06f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:35.656595 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-74c78ae2-9ecb-49d0-a07a-b61a969038b5 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] 10.222.0.43 "GET /compute/v2.1/servers/3f80e8f0-dba3-4403-83f8-0473c5d7d29b" status: 200 len: 1444 microversion: 2.75 time: 0.155235 Oct 04 21:50:35.671112 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 887/1841] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:50:35 2022] GET /compute/v2.1/servers/3f80e8f0-dba3-4403-83f8-0473c5d7d29b => generated 1444 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:50:36.183552 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-4022594c-00e8-4ca6-957e-ac1acc79769e tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:50:36.193839 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-4022594c-00e8-4ca6-957e-ac1acc79769e tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] [instance: d4abcd04-329d-40a8-8d6e-4383bef437ae] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:50:36.214089 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4022594c-00e8-4ca6-957e-ac1acc79769e tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:36.214990 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4022594c-00e8-4ca6-957e-ac1acc79769e tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:36.215636 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4022594c-00e8-4ca6-957e-ac1acc79769e tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:36.216551 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4022594c-00e8-4ca6-957e-ac1acc79769e tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:36.217693 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4022594c-00e8-4ca6-957e-ac1acc79769e tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:36.218870 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4022594c-00e8-4ca6-957e-ac1acc79769e tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:36.231513 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-a15473aa-c4ac-43b3-a5b8-70862a5d6157 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:50:36.232145 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-a15473aa-c4ac-43b3-a5b8-70862a5d6157 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 3f0a02bc-7993-4849-8b3c-7572327b4799] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:50:36.255606 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a15473aa-c4ac-43b3-a5b8-70862a5d6157 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:36.256131 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a15473aa-c4ac-43b3-a5b8-70862a5d6157 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:36.256587 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a15473aa-c4ac-43b3-a5b8-70862a5d6157 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:36.257332 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a15473aa-c4ac-43b3-a5b8-70862a5d6157 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:36.257802 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a15473aa-c4ac-43b3-a5b8-70862a5d6157 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:36.258237 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a15473aa-c4ac-43b3-a5b8-70862a5d6157 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:36.274891 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-4022594c-00e8-4ca6-957e-ac1acc79769e tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] 10.222.0.43 "GET /compute/v2.1/servers/d4abcd04-329d-40a8-8d6e-4383bef437ae/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.097236 Oct 04 21:50:36.281524 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 955/1842] 10.222.0.43 () {60 vars in 1343 bytes} [Tue Oct 4 21:50:36 2022] GET /compute/v2.1/servers/d4abcd04-329d-40a8-8d6e-4383bef437ae/os-volume_attachments => generated 197 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:50:36.600510 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-a15473aa-c4ac-43b3-a5b8-70862a5d6157 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ad048becf474fb972d4291422d810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dcfc7024fc49388c4bd5f25f03e60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:36.620611 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-a15473aa-c4ac-43b3-a5b8-70862a5d6157 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/3f0a02bc-7993-4849-8b3c-7572327b4799" status: 200 len: 1716 microversion: 2.1 time: 0.393533 Oct 04 21:50:36.629335 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 888/1843] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:50:36 2022] GET /compute/v2.1/servers/3f0a02bc-7993-4849-8b3c-7572327b4799 => generated 1716 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:50:36.698430 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-63c11284-fe31-4cf1-915d-b1b10b437b6e tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:50:36.699329 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-63c11284-fe31-4cf1-915d-b1b10b437b6e tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] [instance: 3f80e8f0-dba3-4403-83f8-0473c5d7d29b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:50:36.712618 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-63c11284-fe31-4cf1-915d-b1b10b437b6e tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:36.713408 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-63c11284-fe31-4cf1-915d-b1b10b437b6e tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:36.715974 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-63c11284-fe31-4cf1-915d-b1b10b437b6e tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:36.719839 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-63c11284-fe31-4cf1-915d-b1b10b437b6e tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:36.720953 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-63c11284-fe31-4cf1-915d-b1b10b437b6e tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:36.723588 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-63c11284-fe31-4cf1-915d-b1b10b437b6e tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:37.079304 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-63c11284-fe31-4cf1-915d-b1b10b437b6e tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43653f2aea4e4884b5001dea5ec12be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b700f614a8b4cfba9b4abea45a06f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:37.100576 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-63c11284-fe31-4cf1-915d-b1b10b437b6e tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43653f2aea4e4884b5001dea5ec12be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b700f614a8b4cfba9b4abea45a06f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:37.102975 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-63c11284-fe31-4cf1-915d-b1b10b437b6e tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43653f2aea4e4884b5001dea5ec12be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b700f614a8b4cfba9b4abea45a06f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:37.112426 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-63c11284-fe31-4cf1-915d-b1b10b437b6e tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] 10.222.0.43 "GET /compute/v2.1/servers/3f80e8f0-dba3-4403-83f8-0473c5d7d29b" status: 200 len: 1444 microversion: 2.75 time: 0.417602 Oct 04 21:50:37.113709 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 956/1844] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:50:36 2022] GET /compute/v2.1/servers/3f80e8f0-dba3-4403-83f8-0473c5d7d29b => generated 1444 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:50:37.290520 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e9406ddb-629d-4e6d-bfbb-bccc86525710 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:50:37.292822 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-e9406ddb-629d-4e6d-bfbb-bccc86525710 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] [instance: d4abcd04-329d-40a8-8d6e-4383bef437ae] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:50:37.307193 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e9406ddb-629d-4e6d-bfbb-bccc86525710 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:37.307700 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e9406ddb-629d-4e6d-bfbb-bccc86525710 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:37.308148 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e9406ddb-629d-4e6d-bfbb-bccc86525710 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:37.312797 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e9406ddb-629d-4e6d-bfbb-bccc86525710 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:37.313298 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e9406ddb-629d-4e6d-bfbb-bccc86525710 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:37.313785 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e9406ddb-629d-4e6d-bfbb-bccc86525710 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:37.397257 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-e9406ddb-629d-4e6d-bfbb-bccc86525710 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] 10.222.0.43 "GET /compute/v2.1/servers/d4abcd04-329d-40a8-8d6e-4383bef437ae/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.109820 Oct 04 21:50:37.397902 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 889/1845] 10.222.0.43 () {60 vars in 1343 bytes} [Tue Oct 4 21:50:37 2022] GET /compute/v2.1/servers/d4abcd04-329d-40a8-8d6e-4383bef437ae/os-volume_attachments => generated 197 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:50:37.653624 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-77f00097-f012-4d19-922a-f20f5ed040ab tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:50:37.654247 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-77f00097-f012-4d19-922a-f20f5ed040ab tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 3f0a02bc-7993-4849-8b3c-7572327b4799] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:50:37.667593 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-77f00097-f012-4d19-922a-f20f5ed040ab tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:37.668096 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-77f00097-f012-4d19-922a-f20f5ed040ab tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:37.668542 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-77f00097-f012-4d19-922a-f20f5ed040ab tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:37.669410 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-77f00097-f012-4d19-922a-f20f5ed040ab tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:37.670611 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-77f00097-f012-4d19-922a-f20f5ed040ab tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:37.671219 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-77f00097-f012-4d19-922a-f20f5ed040ab tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:38.102182 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-77f00097-f012-4d19-922a-f20f5ed040ab tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ad048becf474fb972d4291422d810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dcfc7024fc49388c4bd5f25f03e60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:38.128347 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-77f00097-f012-4d19-922a-f20f5ed040ab tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/3f0a02bc-7993-4849-8b3c-7572327b4799" status: 200 len: 1716 microversion: 2.1 time: 0.476655 Oct 04 21:50:38.129592 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 957/1846] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:50:37 2022] GET /compute/v2.1/servers/3f0a02bc-7993-4849-8b3c-7572327b4799 => generated 1716 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:50:38.152172 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-c4e6eca5-85ec-42ea-8b24-9fa9b870167d tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:50:38.153013 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-c4e6eca5-85ec-42ea-8b24-9fa9b870167d tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] [instance: 3f80e8f0-dba3-4403-83f8-0473c5d7d29b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:50:38.163885 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c4e6eca5-85ec-42ea-8b24-9fa9b870167d tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:38.164398 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c4e6eca5-85ec-42ea-8b24-9fa9b870167d tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:38.164845 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c4e6eca5-85ec-42ea-8b24-9fa9b870167d tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:38.165592 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c4e6eca5-85ec-42ea-8b24-9fa9b870167d tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:38.166261 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c4e6eca5-85ec-42ea-8b24-9fa9b870167d tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:38.183027 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c4e6eca5-85ec-42ea-8b24-9fa9b870167d tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:38.359775 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-c4e6eca5-85ec-42ea-8b24-9fa9b870167d tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43653f2aea4e4884b5001dea5ec12be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b700f614a8b4cfba9b4abea45a06f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:38.381233 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-c4e6eca5-85ec-42ea-8b24-9fa9b870167d tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43653f2aea4e4884b5001dea5ec12be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b700f614a8b4cfba9b4abea45a06f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:38.390882 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-c4e6eca5-85ec-42ea-8b24-9fa9b870167d tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43653f2aea4e4884b5001dea5ec12be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b700f614a8b4cfba9b4abea45a06f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:38.405236 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-c4e6eca5-85ec-42ea-8b24-9fa9b870167d tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] 10.222.0.43 "GET /compute/v2.1/servers/3f80e8f0-dba3-4403-83f8-0473c5d7d29b" status: 200 len: 1444 microversion: 2.75 time: 0.256861 Oct 04 21:50:38.405848 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 890/1847] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:50:38 2022] GET /compute/v2.1/servers/3f80e8f0-dba3-4403-83f8-0473c5d7d29b => generated 1444 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:50:38.409969 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-805b75e2-4257-444b-94ae-79f2bde24d8b tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:50:38.412437 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-805b75e2-4257-444b-94ae-79f2bde24d8b tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] [instance: d4abcd04-329d-40a8-8d6e-4383bef437ae] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:50:38.424446 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-805b75e2-4257-444b-94ae-79f2bde24d8b tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:38.425197 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-805b75e2-4257-444b-94ae-79f2bde24d8b tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:38.425818 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-805b75e2-4257-444b-94ae-79f2bde24d8b tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:38.426996 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-805b75e2-4257-444b-94ae-79f2bde24d8b tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:38.427646 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-805b75e2-4257-444b-94ae-79f2bde24d8b tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:38.428247 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-805b75e2-4257-444b-94ae-79f2bde24d8b tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:38.509784 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-805b75e2-4257-444b-94ae-79f2bde24d8b tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] 10.222.0.43 "GET /compute/v2.1/servers/d4abcd04-329d-40a8-8d6e-4383bef437ae/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.104447 Oct 04 21:50:38.518708 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 958/1848] 10.222.0.43 () {60 vars in 1343 bytes} [Tue Oct 4 21:50:38 2022] GET /compute/v2.1/servers/d4abcd04-329d-40a8-8d6e-4383bef437ae/os-volume_attachments => generated 197 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 21:50:39.153098 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-a8ae3e2b-3916-4b0d-a950-f4ae50635cf3 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:50:39.155289 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-a8ae3e2b-3916-4b0d-a950-f4ae50635cf3 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 3f0a02bc-7993-4849-8b3c-7572327b4799] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:50:39.176164 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a8ae3e2b-3916-4b0d-a950-f4ae50635cf3 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:39.184959 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a8ae3e2b-3916-4b0d-a950-f4ae50635cf3 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:39.186358 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a8ae3e2b-3916-4b0d-a950-f4ae50635cf3 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:39.191201 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a8ae3e2b-3916-4b0d-a950-f4ae50635cf3 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:39.191953 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a8ae3e2b-3916-4b0d-a950-f4ae50635cf3 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:39.192574 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a8ae3e2b-3916-4b0d-a950-f4ae50635cf3 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:39.320619 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell0:SELECT=2 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:50:39.551713 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-e3166003-18a9-4959-bab6-4715d8a3d4d1 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Action: 'create', calling method: .version_select at 0x7fbb3724e280>, body: {"keypair": {"name": "tempest-keypair-830493452", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLHvRxiN6EwfuvbK8LHCu0rvwrr0vStvGSEYxQByb/VSB0jeg+ATYoAhM7s3lKRt333kFCzICBu3hfBh9b8n9NCVOtjZGloRdU6pyS6jo67ov1HIuHvWOM9b+NZ5vcSKtg=="}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:50:39.557023 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-a8ae3e2b-3916-4b0d-a950-f4ae50635cf3 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ad048becf474fb972d4291422d810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dcfc7024fc49388c4bd5f25f03e60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:39.567426 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-a8ae3e2b-3916-4b0d-a950-f4ae50635cf3 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/3f0a02bc-7993-4849-8b3c-7572327b4799" status: 200 len: 1716 microversion: 2.1 time: 0.418528 Oct 04 21:50:39.573609 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 891/1849] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:50:39 2022] GET /compute/v2.1/servers/3f0a02bc-7993-4849-8b3c-7572327b4799 => generated 1716 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:50:39.585179 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-e3166003-18a9-4959-bab6-4715d8a3d4d1 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Getting quotas for project 0f529360dc1742a89d62a9fe42bc9848. Resources: {'key_pairs'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:50:39.588364 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-7f25caf5-408f-4b53-9fd1-293c55a8274a tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:50:39.588976 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-7f25caf5-408f-4b53-9fd1-293c55a8274a tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] [instance: 3f80e8f0-dba3-4403-83f8-0473c5d7d29b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:50:39.593908 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-e3166003-18a9-4959-bab6-4715d8a3d4d1 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Getting quotas for user b12f87ae29534b2c9171ee7b0dcab372 and project 0f529360dc1742a89d62a9fe42bc9848. Resources: {'key_pairs'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:50:39.598222 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7f25caf5-408f-4b53-9fd1-293c55a8274a tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:39.598770 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7f25caf5-408f-4b53-9fd1-293c55a8274a tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:39.599206 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7f25caf5-408f-4b53-9fd1-293c55a8274a tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:39.602697 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7f25caf5-408f-4b53-9fd1-293c55a8274a tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:39.603385 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7f25caf5-408f-4b53-9fd1-293c55a8274a tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:39.606908 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7f25caf5-408f-4b53-9fd1-293c55a8274a tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:39.632944 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-e3166003-18a9-4959-bab6-4715d8a3d4d1 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.415496 Oct 04 21:50:39.655281 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 959/1850] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Oct 4 21:50:39 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:50:39.665000 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-2e58f7a6-83f0-4b46-88bc-5efabe9daa8f tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:50:39.669399 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-2e58f7a6-83f0-4b46-88bc-5efabe9daa8f tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] [instance: d4abcd04-329d-40a8-8d6e-4383bef437ae] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:50:39.683667 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2e58f7a6-83f0-4b46-88bc-5efabe9daa8f tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:39.685406 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2e58f7a6-83f0-4b46-88bc-5efabe9daa8f tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:39.686287 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2e58f7a6-83f0-4b46-88bc-5efabe9daa8f tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:39.690546 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2e58f7a6-83f0-4b46-88bc-5efabe9daa8f tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:39.691485 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2e58f7a6-83f0-4b46-88bc-5efabe9daa8f tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:39.692817 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2e58f7a6-83f0-4b46-88bc-5efabe9daa8f tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:39.742005 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-7f25caf5-408f-4b53-9fd1-293c55a8274a tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43653f2aea4e4884b5001dea5ec12be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b700f614a8b4cfba9b4abea45a06f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:39.750148 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=100 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:50:39.757401 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-7f25caf5-408f-4b53-9fd1-293c55a8274a tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43653f2aea4e4884b5001dea5ec12be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b700f614a8b4cfba9b4abea45a06f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:39.765022 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-7f25caf5-408f-4b53-9fd1-293c55a8274a tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43653f2aea4e4884b5001dea5ec12be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b700f614a8b4cfba9b4abea45a06f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:39.783757 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-7f25caf5-408f-4b53-9fd1-293c55a8274a tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] 10.222.0.43 "GET /compute/v2.1/servers/3f80e8f0-dba3-4403-83f8-0473c5d7d29b" status: 200 len: 1444 microversion: 2.75 time: 0.208729 Oct 04 21:50:39.785173 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 892/1851] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:50:39 2022] GET /compute/v2.1/servers/3f80e8f0-dba3-4403-83f8-0473c5d7d29b => generated 1444 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:50:39.788364 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-2e58f7a6-83f0-4b46-88bc-5efabe9daa8f tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] 10.222.0.43 "GET /compute/v2.1/servers/d4abcd04-329d-40a8-8d6e-4383bef437ae/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.131538 Oct 04 21:50:39.794842 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 960/1852] 10.222.0.43 () {60 vars in 1343 bytes} [Tue Oct 4 21:50:39 2022] GET /compute/v2.1/servers/d4abcd04-329d-40a8-8d6e-4383bef437ae/os-volume_attachments => generated 197 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:50:40.597362 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-9da2d9e5-d646-4a10-a83a-1943c0794627 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:50:40.599278 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-9da2d9e5-d646-4a10-a83a-1943c0794627 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 3f0a02bc-7993-4849-8b3c-7572327b4799] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:50:40.629941 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9da2d9e5-d646-4a10-a83a-1943c0794627 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:40.631737 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9da2d9e5-d646-4a10-a83a-1943c0794627 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:40.635686 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9da2d9e5-d646-4a10-a83a-1943c0794627 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:40.639687 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9da2d9e5-d646-4a10-a83a-1943c0794627 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:40.644494 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9da2d9e5-d646-4a10-a83a-1943c0794627 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:40.647618 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9da2d9e5-d646-4a10-a83a-1943c0794627 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:40.804021 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-d8c8261b-1a08-4eec-824c-a3c0df907977 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:50:40.814573 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-d8c8261b-1a08-4eec-824c-a3c0df907977 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] [instance: d4abcd04-329d-40a8-8d6e-4383bef437ae] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:50:40.841272 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d8c8261b-1a08-4eec-824c-a3c0df907977 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:40.842131 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d8c8261b-1a08-4eec-824c-a3c0df907977 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:40.842860 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d8c8261b-1a08-4eec-824c-a3c0df907977 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:40.844726 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d8c8261b-1a08-4eec-824c-a3c0df907977 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:40.846422 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d8c8261b-1a08-4eec-824c-a3c0df907977 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:40.848986 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d8c8261b-1a08-4eec-824c-a3c0df907977 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:40.913464 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-d8c8261b-1a08-4eec-824c-a3c0df907977 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] 10.222.0.43 "GET /compute/v2.1/servers/d4abcd04-329d-40a8-8d6e-4383bef437ae/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.115228 Oct 04 21:50:40.914434 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 961/1853] 10.222.0.43 () {60 vars in 1343 bytes} [Tue Oct 4 21:50:40 2022] GET /compute/v2.1/servers/d4abcd04-329d-40a8-8d6e-4383bef437ae/os-volume_attachments => generated 25 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:50:40.936850 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-5e2c3c49-02d2-4ce4-a3a7-55804ed9b3b4 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:50:40.937892 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-5e2c3c49-02d2-4ce4-a3a7-55804ed9b3b4 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] [instance: 3f80e8f0-dba3-4403-83f8-0473c5d7d29b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:50:40.955406 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5e2c3c49-02d2-4ce4-a3a7-55804ed9b3b4 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:40.957000 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5e2c3c49-02d2-4ce4-a3a7-55804ed9b3b4 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:40.957662 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5e2c3c49-02d2-4ce4-a3a7-55804ed9b3b4 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:40.958659 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5e2c3c49-02d2-4ce4-a3a7-55804ed9b3b4 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:40.960990 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5e2c3c49-02d2-4ce4-a3a7-55804ed9b3b4 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:40.965619 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5e2c3c49-02d2-4ce4-a3a7-55804ed9b3b4 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:41.024399 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-9da2d9e5-d646-4a10-a83a-1943c0794627 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ad048becf474fb972d4291422d810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dcfc7024fc49388c4bd5f25f03e60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:41.040803 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-9da2d9e5-d646-4a10-a83a-1943c0794627 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/3f0a02bc-7993-4849-8b3c-7572327b4799" status: 200 len: 1716 microversion: 2.1 time: 0.448002 Oct 04 21:50:41.043228 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 893/1854] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:50:40 2022] GET /compute/v2.1/servers/3f0a02bc-7993-4849-8b3c-7572327b4799 => generated 1716 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:50:41.140167 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-5e2c3c49-02d2-4ce4-a3a7-55804ed9b3b4 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43653f2aea4e4884b5001dea5ec12be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b700f614a8b4cfba9b4abea45a06f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:41.151393 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-5e2c3c49-02d2-4ce4-a3a7-55804ed9b3b4 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43653f2aea4e4884b5001dea5ec12be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b700f614a8b4cfba9b4abea45a06f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:41.152848 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-5e2c3c49-02d2-4ce4-a3a7-55804ed9b3b4 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43653f2aea4e4884b5001dea5ec12be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b700f614a8b4cfba9b4abea45a06f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:41.161727 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-5e2c3c49-02d2-4ce4-a3a7-55804ed9b3b4 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] 10.222.0.43 "GET /compute/v2.1/servers/3f80e8f0-dba3-4403-83f8-0473c5d7d29b" status: 200 len: 1444 microversion: 2.75 time: 0.245229 Oct 04 21:50:41.162489 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 962/1855] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:50:40 2022] GET /compute/v2.1/servers/3f80e8f0-dba3-4403-83f8-0473c5d7d29b => generated 1444 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:50:42.078482 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-1a2f044d-6e9d-435d-8115-9266af910bab tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:50:42.081361 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-1a2f044d-6e9d-435d-8115-9266af910bab tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 3f0a02bc-7993-4849-8b3c-7572327b4799] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:50:42.096206 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1a2f044d-6e9d-435d-8115-9266af910bab tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:42.103429 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1a2f044d-6e9d-435d-8115-9266af910bab tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:42.104107 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1a2f044d-6e9d-435d-8115-9266af910bab tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:42.105038 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1a2f044d-6e9d-435d-8115-9266af910bab tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:42.107105 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1a2f044d-6e9d-435d-8115-9266af910bab tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:42.108719 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1a2f044d-6e9d-435d-8115-9266af910bab tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:42.196045 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-cb9ad851-171a-44f7-9d08-34295e050e5c tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:50:42.197516 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-cb9ad851-171a-44f7-9d08-34295e050e5c tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] [instance: 3f80e8f0-dba3-4403-83f8-0473c5d7d29b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:50:42.221085 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cb9ad851-171a-44f7-9d08-34295e050e5c tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:42.221690 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cb9ad851-171a-44f7-9d08-34295e050e5c tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:42.222135 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cb9ad851-171a-44f7-9d08-34295e050e5c tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:42.242776 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cb9ad851-171a-44f7-9d08-34295e050e5c tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:42.243496 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cb9ad851-171a-44f7-9d08-34295e050e5c tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:42.243962 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cb9ad851-171a-44f7-9d08-34295e050e5c tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:43.160688 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-cb9ad851-171a-44f7-9d08-34295e050e5c tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43653f2aea4e4884b5001dea5ec12be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b700f614a8b4cfba9b4abea45a06f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:43.176317 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-cb9ad851-171a-44f7-9d08-34295e050e5c tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43653f2aea4e4884b5001dea5ec12be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b700f614a8b4cfba9b4abea45a06f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:43.190231 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-cb9ad851-171a-44f7-9d08-34295e050e5c tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43653f2aea4e4884b5001dea5ec12be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b700f614a8b4cfba9b4abea45a06f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:43.220600 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-cb9ad851-171a-44f7-9d08-34295e050e5c tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] 10.222.0.43 "GET /compute/v2.1/servers/3f80e8f0-dba3-4403-83f8-0473c5d7d29b" status: 200 len: 1444 microversion: 2.75 time: 1.028799 Oct 04 21:50:43.230400 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 963/1856] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:50:42 2022] GET /compute/v2.1/servers/3f80e8f0-dba3-4403-83f8-0473c5d7d29b => generated 1444 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:50:44.011835 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-1a2f044d-6e9d-435d-8115-9266af910bab tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ad048becf474fb972d4291422d810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dcfc7024fc49388c4bd5f25f03e60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:44.024612 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=100 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:50:44.037238 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-1a2f044d-6e9d-435d-8115-9266af910bab tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/3f0a02bc-7993-4849-8b3c-7572327b4799" status: 200 len: 1716 microversion: 2.1 time: 1.962091 Oct 04 21:50:44.055856 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 894/1857] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:50:42 2022] GET /compute/v2.1/servers/3f0a02bc-7993-4849-8b3c-7572327b4799 => generated 1716 bytes in 1968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:50:44.270062 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-2fc8453b-c64c-4763-9e1c-28e05d71755e tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:50:44.271245 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-2fc8453b-c64c-4763-9e1c-28e05d71755e tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] [instance: 3f80e8f0-dba3-4403-83f8-0473c5d7d29b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:50:44.289831 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-7fd26b5c-7a94-4ede-9eee-52220019d4e4 tempest-SecurityGroupRulesNegativeTestJSON-1904938195 tempest-SecurityGroupRulesNegativeTestJSON-1904938195-project] Action: 'create', calling method: .version_select at 0x7fbb2ea508b0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-93623596", "description": "tempest-description-110727042"}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:50:44.304303 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2fc8453b-c64c-4763-9e1c-28e05d71755e tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:44.304812 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2fc8453b-c64c-4763-9e1c-28e05d71755e tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:44.305497 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2fc8453b-c64c-4763-9e1c-28e05d71755e tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:44.305967 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2fc8453b-c64c-4763-9e1c-28e05d71755e tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:44.307137 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2fc8453b-c64c-4763-9e1c-28e05d71755e tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:44.307645 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2fc8453b-c64c-4763-9e1c-28e05d71755e tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:44.703032 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-2fc8453b-c64c-4763-9e1c-28e05d71755e tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43653f2aea4e4884b5001dea5ec12be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b700f614a8b4cfba9b4abea45a06f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:44.719090 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-2fc8453b-c64c-4763-9e1c-28e05d71755e tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43653f2aea4e4884b5001dea5ec12be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b700f614a8b4cfba9b4abea45a06f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:44.723426 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-2fc8453b-c64c-4763-9e1c-28e05d71755e tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43653f2aea4e4884b5001dea5ec12be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b700f614a8b4cfba9b4abea45a06f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:44.737417 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-2fc8453b-c64c-4763-9e1c-28e05d71755e tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] 10.222.0.43 "GET /compute/v2.1/servers/3f80e8f0-dba3-4403-83f8-0473c5d7d29b" status: 200 len: 1444 microversion: 2.75 time: 0.475927 Oct 04 21:50:44.742513 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 895/1858] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:50:44 2022] GET /compute/v2.1/servers/3f80e8f0-dba3-4403-83f8-0473c5d7d29b => generated 1444 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:50:45.068176 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-6d760da8-60ba-4cd4-be63-3151957188b2 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:50:45.069020 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-6d760da8-60ba-4cd4-be63-3151957188b2 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 3f0a02bc-7993-4849-8b3c-7572327b4799] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:50:45.084931 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6d760da8-60ba-4cd4-be63-3151957188b2 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:45.085653 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6d760da8-60ba-4cd4-be63-3151957188b2 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:45.086429 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6d760da8-60ba-4cd4-be63-3151957188b2 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:45.094462 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6d760da8-60ba-4cd4-be63-3151957188b2 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:45.095822 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6d760da8-60ba-4cd4-be63-3151957188b2 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:45.097483 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6d760da8-60ba-4cd4-be63-3151957188b2 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:45.890534 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-6d760da8-60ba-4cd4-be63-3151957188b2 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ad048becf474fb972d4291422d810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dcfc7024fc49388c4bd5f25f03e60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:45.908134 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-6d760da8-60ba-4cd4-be63-3151957188b2 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/3f0a02bc-7993-4849-8b3c-7572327b4799" status: 200 len: 1716 microversion: 2.1 time: 0.843505 Oct 04 21:50:45.912566 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-7fd26b5c-7a94-4ede-9eee-52220019d4e4 tempest-SecurityGroupRulesNegativeTestJSON-1904938195 tempest-SecurityGroupRulesNegativeTestJSON-1904938195-project] 10.222.0.43 "POST /compute/v2.1/os-security-groups" status: 200 len: 253 microversion: 2.1 time: 1.729711 Oct 04 21:50:45.913180 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 964/1859] 10.222.0.43 () {60 vars in 1180 bytes} [Tue Oct 4 21:50:44 2022] POST /compute/v2.1/os-security-groups => generated 253 bytes in 1731 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:50:45.914065 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 896/1860] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:50:45 2022] GET /compute/v2.1/servers/3f0a02bc-7993-4849-8b3c-7572327b4799 => generated 1716 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:50:45.919844 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-da5fffc2-3f7f-41db-9319-7a5ffc0d3de1 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:50:45.921429 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-da5fffc2-3f7f-41db-9319-7a5ffc0d3de1 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] [instance: 3f80e8f0-dba3-4403-83f8-0473c5d7d29b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:50:45.941528 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-da5fffc2-3f7f-41db-9319-7a5ffc0d3de1 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:45.944714 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-a8f560ef-beb9-40c0-8203-96619975cc91 tempest-SecurityGroupRulesNegativeTestJSON-1904938195 tempest-SecurityGroupRulesNegativeTestJSON-1904938195-project] Action: 'create', calling method: .version_select at 0x7fbb2e7ee5e0>, body: {"security_group_rule": {"parent_group_id": "b1d18fc0-16c9-4b91-9127-0eea7a28006e", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:50:45.950245 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-da5fffc2-3f7f-41db-9319-7a5ffc0d3de1 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:45.952432 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-da5fffc2-3f7f-41db-9319-7a5ffc0d3de1 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:45.955437 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-da5fffc2-3f7f-41db-9319-7a5ffc0d3de1 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:45.955939 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-da5fffc2-3f7f-41db-9319-7a5ffc0d3de1 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:45.966059 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-da5fffc2-3f7f-41db-9319-7a5ffc0d3de1 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:46.163464 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-da5fffc2-3f7f-41db-9319-7a5ffc0d3de1 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43653f2aea4e4884b5001dea5ec12be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b700f614a8b4cfba9b4abea45a06f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:46.209475 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-da5fffc2-3f7f-41db-9319-7a5ffc0d3de1 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43653f2aea4e4884b5001dea5ec12be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b700f614a8b4cfba9b4abea45a06f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:46.212757 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-da5fffc2-3f7f-41db-9319-7a5ffc0d3de1 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43653f2aea4e4884b5001dea5ec12be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b700f614a8b4cfba9b4abea45a06f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:46.228986 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-da5fffc2-3f7f-41db-9319-7a5ffc0d3de1 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] 10.222.0.43 "GET /compute/v2.1/servers/3f80e8f0-dba3-4403-83f8-0473c5d7d29b" status: 200 len: 1450 microversion: 2.75 time: 0.314276 Oct 04 21:50:46.229577 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 965/1861] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:50:45 2022] GET /compute/v2.1/servers/3f80e8f0-dba3-4403-83f8-0473c5d7d29b => generated 1450 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:50:46.949411 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-add36046-20dc-4d26-82f7-e1aa749eaa60 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:50:46.950075 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-add36046-20dc-4d26-82f7-e1aa749eaa60 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 3f0a02bc-7993-4849-8b3c-7572327b4799] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:50:46.966061 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-add36046-20dc-4d26-82f7-e1aa749eaa60 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:46.966856 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-add36046-20dc-4d26-82f7-e1aa749eaa60 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:46.967466 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-add36046-20dc-4d26-82f7-e1aa749eaa60 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:46.968352 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-add36046-20dc-4d26-82f7-e1aa749eaa60 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:46.968985 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-add36046-20dc-4d26-82f7-e1aa749eaa60 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:46.970130 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-add36046-20dc-4d26-82f7-e1aa749eaa60 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:47.034695 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-a8f560ef-beb9-40c0-8203-96619975cc91 tempest-SecurityGroupRulesNegativeTestJSON-1904938195 tempest-SecurityGroupRulesNegativeTestJSON-1904938195-project] 10.222.0.43 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 1.094363 Oct 04 21:50:47.036199 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 897/1862] 10.222.0.43 () {60 vars in 1195 bytes} [Tue Oct 4 21:50:45 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:50:47.051292 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-8b88d6ac-7eb3-4a2c-8de0-013944eb74d5 tempest-SecurityGroupRulesNegativeTestJSON-1904938195 tempest-SecurityGroupRulesNegativeTestJSON-1904938195-project] Action: 'create', calling method: .version_select at 0x7fbb372164c0>, body: {"security_group_rule": {"parent_group_id": "b1d18fc0-16c9-4b91-9127-0eea7a28006e", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:50:47.309825 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-add36046-20dc-4d26-82f7-e1aa749eaa60 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ad048becf474fb972d4291422d810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dcfc7024fc49388c4bd5f25f03e60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:47.323789 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-add36046-20dc-4d26-82f7-e1aa749eaa60 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/3f0a02bc-7993-4849-8b3c-7572327b4799" status: 200 len: 1716 microversion: 2.1 time: 0.373495 Oct 04 21:50:47.327352 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 966/1863] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:50:46 2022] GET /compute/v2.1/servers/3f0a02bc-7993-4849-8b3c-7572327b4799 => generated 1716 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:50:47.336481 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-8b88d6ac-7eb3-4a2c-8de0-013944eb74d5 tempest-SecurityGroupRulesNegativeTestJSON-1904938195 tempest-SecurityGroupRulesNegativeTestJSON-1904938195-project] HTTP exception thrown: This rule already exists in group b1d18fc0-16c9-4b91-9127-0eea7a28006e Oct 04 21:50:47.338087 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-8b88d6ac-7eb3-4a2c-8de0-013944eb74d5 tempest-SecurityGroupRulesNegativeTestJSON-1904938195 tempest-SecurityGroupRulesNegativeTestJSON-1904938195-project] Request method failure captured: Oct 04 21:50:47.338087 n-d-860284-1 devstack@n-api.service[134101]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 04 21:50:47.338087 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 21:50:47.338087 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 21:50:47.338087 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 21:50:47.338087 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 138 Oct 04 21:50:47.338087 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 21:50:47.338087 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 21:50:47.338087 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 21:50:47.338087 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 21:50:47.338087 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPKq0IsLz6MtzxymfmAA4T5LQGf2rcxkSRLwvGIY1f3-7_jBOHLPGHRC1D8HMnjABRyfrqMlOPxBYB7xFt5-ol3G2iacFQfDIClAItXLqJ3MRHsosGEh4_0o7TLbjlNtnZQXLLokdI_Muh3kOjxF1xyfn8csxDCNc9E-TR9UrTjfQcnY Oct 04 21:50:47.338087 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 21:50:47.338087 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 21:50:47.338087 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 21:50:47.338087 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 21:50:47.338087 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 21:50:47.338087 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 21:50:47.338087 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: 5516f39d751e41c2a225725f986c034b Oct 04 21:50:47.338087 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1904938195 Oct 04 21:50:47.338087 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 21:50:47.338087 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 21:50:47.338087 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5516f39d751e41c2a225725f986c034b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_5516f39d751e41c2a225725f986c034b", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5516f39d751e41c2a225725f986c034b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/5516f39d751e41c2a225725f986c034b"}]}] Oct 04 21:50:47.338087 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1904938195 Oct 04 21:50:47.338087 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: 5516f39d751e41c2a225725f986c034b Oct 04 21:50:47.338087 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1904938195 Oct 04 21:50:47.338087 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1904938195-project Oct 04 21:50:47.338087 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 21:50:47.338087 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 21:50:47.338087 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 70d34373679649f1a353fe9bb7a962e9 Oct 04 21:50:47.338087 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1904938195-project Oct 04 21:50:47.338087 n-d-860284-1 devstack@n-api.service[134101]: Oct 04 21:50:47.338087 n-d-860284-1 devstack@n-api.service[134101]: {"security_group_rule": {"parent_group_id": "b1d18fc0-16c9-4b91-9127-0eea7a28006e", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 04 21:50:47.338087 n-d-860284-1 devstack@n-api.service[134101]: method: Oct 04 21:50:47.338087 n-d-860284-1 devstack@n-api.service[134101]: exception: This rule already exists in group b1d18fc0-16c9-4b91-9127-0eea7a28006e Oct 04 21:50:47.338087 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'b1d18fc0-16c9-4b91-9127-0eea7a28006e', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 04 21:50:47.338087 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:50:47.338087 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:50:47.338087 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create Oct 04 21:50:47.338087 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( Oct 04 21:50:47.338087 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule Oct 04 21:50:47.338087 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Oct 04 21:50:47.338087 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group b1d18fc0-16c9-4b91-9127-0eea7a28006e Oct 04 21:50:47.338087 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:50:47.338087 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:50:47.338087 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:50:47.338087 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:50:47.338087 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:50:47.338087 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:50:47.338087 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:50:47.338087 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:50:47.338087 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:50:47.338087 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:50:47.338087 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:50:47.338087 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:50:47.338087 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create Oct 04 21:50:47.338087 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 04 21:50:47.338087 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group b1d18fc0-16c9-4b91-9127-0eea7a28006e Oct 04 21:50:47.338087 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:50:47.338087 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:50:47.338087 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:50:47.338087 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:50:47.338087 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:50:47.338087 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:50:47.342676 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:50:47.342676 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:50:47.342676 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group b1d18fc0-16c9-4b91-9127-0eea7a28006e Oct 04 21:50:47.342676 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:50:47.342676 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-8b88d6ac-7eb3-4a2c-8de0-013944eb74d5 tempest-SecurityGroupRulesNegativeTestJSON-1904938195 tempest-SecurityGroupRulesNegativeTestJSON-1904938195-project] Returning 400 to user: This rule already exists in group b1d18fc0-16c9-4b91-9127-0eea7a28006e {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:50:47.342676 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-8b88d6ac-7eb3-4a2c-8de0-013944eb74d5 tempest-SecurityGroupRulesNegativeTestJSON-1904938195 tempest-SecurityGroupRulesNegativeTestJSON-1904938195-project] 10.222.0.43 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.295479 Oct 04 21:50:47.342676 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 898/1864] 10.222.0.43 () {60 vars in 1195 bytes} [Tue Oct 4 21:50:47 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 297 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 21:50:47.345445 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-302791bd-3212-4bb8-bec0-44f15de2a992 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1419686148", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "631d6f6f-6c24-4f73-a10b-be4ea1e728d0"}], "security_groups": [{"name": "tempest-securitygroup--227810382"}], "key_name": "tempest-keypair-830493452", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:50:47.357087 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-06879697-2a48-420d-a9bb-470090c7fc94 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:50:47.359268 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-06879697-2a48-420d-a9bb-470090c7fc94 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] [instance: 3f80e8f0-dba3-4403-83f8-0473c5d7d29b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:50:47.388980 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-06879697-2a48-420d-a9bb-470090c7fc94 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:47.389497 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-06879697-2a48-420d-a9bb-470090c7fc94 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:47.389950 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-06879697-2a48-420d-a9bb-470090c7fc94 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:47.401684 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-06879697-2a48-420d-a9bb-470090c7fc94 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:47.406009 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-06879697-2a48-420d-a9bb-470090c7fc94 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:47.409369 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-06879697-2a48-420d-a9bb-470090c7fc94 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:47.610431 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-06879697-2a48-420d-a9bb-470090c7fc94 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43653f2aea4e4884b5001dea5ec12be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b700f614a8b4cfba9b4abea45a06f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:47.623206 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.network.neutron [None req-302791bd-3212-4bb8-bec0-44f15de2a992 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] validate_networks() for [('631d6f6f-6c24-4f73-a10b-be4ea1e728d0', None, None, None, None, None)] {{(pid=134102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:50:47.640781 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-06879697-2a48-420d-a9bb-470090c7fc94 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43653f2aea4e4884b5001dea5ec12be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b700f614a8b4cfba9b4abea45a06f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:47.644240 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-06879697-2a48-420d-a9bb-470090c7fc94 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43653f2aea4e4884b5001dea5ec12be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b700f614a8b4cfba9b4abea45a06f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:47.660545 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-06879697-2a48-420d-a9bb-470090c7fc94 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] 10.222.0.43 "GET /compute/v2.1/servers/3f80e8f0-dba3-4403-83f8-0473c5d7d29b" status: 200 len: 1450 microversion: 2.75 time: 0.317986 Oct 04 21:50:47.663952 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 899/1865] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:50:47 2022] GET /compute/v2.1/servers/3f80e8f0-dba3-4403-83f8-0473c5d7d29b => generated 1450 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:50:47.677999 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-1d5adfcc-94df-456c-854d-5b91e6d13f7e tempest-SecurityGroupRulesNegativeTestJSON-1904938195 tempest-SecurityGroupRulesNegativeTestJSON-1904938195-project] Calling method '.version_select at 0x7fbb37247f70>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:50:48.351170 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-1d5adfcc-94df-456c-854d-5b91e6d13f7e tempest-SecurityGroupRulesNegativeTestJSON-1904938195 tempest-SecurityGroupRulesNegativeTestJSON-1904938195-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-group-rules/d855689e-f23b-4c14-92cf-211f4ca4b639" status: 202 len: 0 microversion: 2.1 time: 0.685835 Oct 04 21:50:48.351866 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 900/1866] 10.222.0.43 () {58 vars in 1287 bytes} [Tue Oct 4 21:50:47 2022] DELETE /compute/v2.1/os-security-group-rules/d855689e-f23b-4c14-92cf-211f4ca4b639 => generated 0 bytes in 687 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:50:48.357289 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-b8933dbd-49c8-4bf9-a3d9-2aeeb36fea7c tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:50:48.358187 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-b8933dbd-49c8-4bf9-a3d9-2aeeb36fea7c tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 3f0a02bc-7993-4849-8b3c-7572327b4799] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:50:48.373424 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b8933dbd-49c8-4bf9-a3d9-2aeeb36fea7c tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:48.374285 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b8933dbd-49c8-4bf9-a3d9-2aeeb36fea7c tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:48.374927 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b8933dbd-49c8-4bf9-a3d9-2aeeb36fea7c tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:48.375883 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b8933dbd-49c8-4bf9-a3d9-2aeeb36fea7c tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:48.378412 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b8933dbd-49c8-4bf9-a3d9-2aeeb36fea7c tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:48.379057 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b8933dbd-49c8-4bf9-a3d9-2aeeb36fea7c tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:48.654290 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-302791bd-3212-4bb8-bec0-44f15de2a992 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Getting quotas for project 0f529360dc1742a89d62a9fe42bc9848. Resources: dict_keys(['metadata_items']) {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:50:48.664628 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-302791bd-3212-4bb8-bec0-44f15de2a992 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Getting quotas for user b12f87ae29534b2c9171ee7b0dcab372 and project 0f529360dc1742a89d62a9fe42bc9848. Resources: dict_keys(['metadata_items']) {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:50:48.695758 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-302791bd-3212-4bb8-bec0-44f15de2a992 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Flavor limits 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:50:48.696211 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-302791bd-3212-4bb8-bec0-44f15de2a992 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Image limits 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:50:48.696914 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-302791bd-3212-4bb8-bec0-44f15de2a992 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Flavor pref 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:50:48.697330 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-302791bd-3212-4bb8-bec0-44f15de2a992 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Image pref 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:50:48.697745 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-302791bd-3212-4bb8-bec0-44f15de2a992 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:50:48.734822 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-302791bd-3212-4bb8-bec0-44f15de2a992 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:48.735886 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-302791bd-3212-4bb8-bec0-44f15de2a992 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:48.736327 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-302791bd-3212-4bb8-bec0-44f15de2a992 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:48.739983 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-302791bd-3212-4bb8-bec0-44f15de2a992 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:48.742271 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-302791bd-3212-4bb8-bec0-44f15de2a992 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:48.742951 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-302791bd-3212-4bb8-bec0-44f15de2a992 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:48.791038 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-b8933dbd-49c8-4bf9-a3d9-2aeeb36fea7c tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ad048becf474fb972d4291422d810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dcfc7024fc49388c4bd5f25f03e60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:48.805785 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-b8933dbd-49c8-4bf9-a3d9-2aeeb36fea7c tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/3f0a02bc-7993-4849-8b3c-7572327b4799" status: 200 len: 1716 microversion: 2.1 time: 0.452845 Oct 04 21:50:48.805938 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-302791bd-3212-4bb8-bec0-44f15de2a992 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Getting quotas for project 0f529360dc1742a89d62a9fe42bc9848. Resources: {'instances', 'ram', 'cores'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:50:48.811799 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 901/1867] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:50:48 2022] GET /compute/v2.1/servers/3f0a02bc-7993-4849-8b3c-7572327b4799 => generated 1716 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:50:48.820334 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-919ab7b3-5282-4901-a46f-62a29e4e6ad8 tempest-SecurityGroupRulesNegativeTestJSON-1904938195 tempest-SecurityGroupRulesNegativeTestJSON-1904938195-project] Action: 'create', calling method: .version_select at 0x7fbb372ad670>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1815685699", "description": "tempest-description-1348612027"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:50:48.832892 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-302791bd-3212-4bb8-bec0-44f15de2a992 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Getting quotas for user b12f87ae29534b2c9171ee7b0dcab372 and project 0f529360dc1742a89d62a9fe42bc9848. Resources: {'instances', 'ram', 'cores'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:50:48.856101 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-302791bd-3212-4bb8-bec0-44f15de2a992 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Going to run 1 instances... {{(pid=134102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:50:48.858638 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-302791bd-3212-4bb8-bec0-44f15de2a992 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] [instance: 4709e5d7-52a3-4a79-8835-d651dce0c34a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='58548514-5dac-426c-81f5-19e3fba33e23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:50:48.926612 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-302791bd-3212-4bb8-bec0-44f15de2a992 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.598075 Oct 04 21:50:48.928706 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 967/1868] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 21:50:47 2022] POST /compute/v2.1/servers => generated 406 bytes in 1600 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:50:48.939284 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-2967f89e-6c6c-453c-845a-b3bd22c82d33 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:50:48.940896 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-2967f89e-6c6c-453c-845a-b3bd22c82d33 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] [instance: 3f80e8f0-dba3-4403-83f8-0473c5d7d29b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:50:48.949158 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2967f89e-6c6c-453c-845a-b3bd22c82d33 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:48.950112 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2967f89e-6c6c-453c-845a-b3bd22c82d33 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:48.951190 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2967f89e-6c6c-453c-845a-b3bd22c82d33 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:48.955673 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2967f89e-6c6c-453c-845a-b3bd22c82d33 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:48.956848 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2967f89e-6c6c-453c-845a-b3bd22c82d33 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:48.957572 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2967f89e-6c6c-453c-845a-b3bd22c82d33 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:49.070934 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-2967f89e-6c6c-453c-845a-b3bd22c82d33 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43653f2aea4e4884b5001dea5ec12be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b700f614a8b4cfba9b4abea45a06f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:49.081649 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-2967f89e-6c6c-453c-845a-b3bd22c82d33 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43653f2aea4e4884b5001dea5ec12be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b700f614a8b4cfba9b4abea45a06f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:49.086828 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-2967f89e-6c6c-453c-845a-b3bd22c82d33 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43653f2aea4e4884b5001dea5ec12be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b700f614a8b4cfba9b4abea45a06f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:49.106232 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-2967f89e-6c6c-453c-845a-b3bd22c82d33 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] 10.222.0.43 "GET /compute/v2.1/servers/3f80e8f0-dba3-4403-83f8-0473c5d7d29b" status: 200 len: 1450 microversion: 2.75 time: 0.176147 Oct 04 21:50:49.118394 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 968/1869] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:50:48 2022] GET /compute/v2.1/servers/3f80e8f0-dba3-4403-83f8-0473c5d7d29b => generated 1450 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:50:49.118394 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-6d03efd1-59c2-4c79-93ad-acecfc9f6518 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:50:49.118394 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-6d03efd1-59c2-4c79-93ad-acecfc9f6518 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] [instance: 4709e5d7-52a3-4a79-8835-d651dce0c34a] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:50:49.182536 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-919ab7b3-5282-4901-a46f-62a29e4e6ad8 tempest-SecurityGroupRulesNegativeTestJSON-1904938195 tempest-SecurityGroupRulesNegativeTestJSON-1904938195-project] 10.222.0.43 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.369434 Oct 04 21:50:49.183148 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 902/1870] 10.222.0.43 () {60 vars in 1180 bytes} [Tue Oct 4 21:50:48 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:50:49.199390 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-09219f80-5ad6-4595-93e0-52a77f7e5b82 tempest-SecurityGroupRulesNegativeTestJSON-1904938195 tempest-SecurityGroupRulesNegativeTestJSON-1904938195-project] Action: 'create', calling method: .version_select at 0x7fbb2e7f7430>, body: {"security_group_rule": {"parent_group_id": "cbe723fc-b0bd-4263-9217-43e3e749d54c", "ip_protocol": "tcp", "from_port": 1421653344, "to_port": 22}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:50:49.419061 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-6d03efd1-59c2-4c79-93ad-acecfc9f6518 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12f87ae29534b2c9171ee7b0dcab372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f529360dc1742a89d62a9fe42bc9848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:49.434564 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-6d03efd1-59c2-4c79-93ad-acecfc9f6518 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] 10.222.0.43 "GET /compute/v2.1/servers/4709e5d7-52a3-4a79-8835-d651dce0c34a" status: 200 len: 1269 microversion: 2.1 time: 0.326056 Oct 04 21:50:49.438190 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 969/1871] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:50:49 2022] GET /compute/v2.1/servers/4709e5d7-52a3-4a79-8835-d651dce0c34a => generated 1269 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:50:49.443251 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-09219f80-5ad6-4595-93e0-52a77f7e5b82 tempest-SecurityGroupRulesNegativeTestJSON-1904938195 tempest-SecurityGroupRulesNegativeTestJSON-1904938195-project] HTTP exception thrown: Invalid port range 1421653344:22. Former value cannot be greater than the later Oct 04 21:50:49.445454 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-09219f80-5ad6-4595-93e0-52a77f7e5b82 tempest-SecurityGroupRulesNegativeTestJSON-1904938195 tempest-SecurityGroupRulesNegativeTestJSON-1904938195-project] Request method failure captured: Oct 04 21:50:49.445454 n-d-860284-1 devstack@n-api.service[134101]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 04 21:50:49.445454 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 21:50:49.445454 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 21:50:49.445454 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 21:50:49.445454 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 146 Oct 04 21:50:49.445454 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 21:50:49.445454 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 21:50:49.445454 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 21:50:49.445454 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 21:50:49.445454 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPKq0IsLz6MtzxymfmAA4T5LQGf2rcxkSRLwvGIY1f3-7_jBOHLPGHRC1D8HMnjABRyfrqMlOPxBYB7xFt5-ol3G2iacFQfDIClAItXLqJ3MRHsosGEh4_0o7TLbjlNtnZQXLLokdI_Muh3kOjxF1xyfn8csxDCNc9E-TR9UrTjfQcnY Oct 04 21:50:49.445454 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 21:50:49.445454 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 21:50:49.445454 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 21:50:49.445454 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 21:50:49.445454 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 21:50:49.445454 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 21:50:49.445454 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: 5516f39d751e41c2a225725f986c034b Oct 04 21:50:49.445454 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1904938195 Oct 04 21:50:49.445454 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 21:50:49.445454 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 21:50:49.445454 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5516f39d751e41c2a225725f986c034b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_5516f39d751e41c2a225725f986c034b", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5516f39d751e41c2a225725f986c034b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/5516f39d751e41c2a225725f986c034b"}]}] Oct 04 21:50:49.445454 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1904938195 Oct 04 21:50:49.445454 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: 5516f39d751e41c2a225725f986c034b Oct 04 21:50:49.445454 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1904938195 Oct 04 21:50:49.445454 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1904938195-project Oct 04 21:50:49.445454 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 21:50:49.445454 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 21:50:49.445454 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 70d34373679649f1a353fe9bb7a962e9 Oct 04 21:50:49.445454 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1904938195-project Oct 04 21:50:49.445454 n-d-860284-1 devstack@n-api.service[134101]: Oct 04 21:50:49.445454 n-d-860284-1 devstack@n-api.service[134101]: {"security_group_rule": {"parent_group_id": "cbe723fc-b0bd-4263-9217-43e3e749d54c", "ip_protocol": "tcp", "from_port": 1421653344, "to_port": 22}} Oct 04 21:50:49.445454 n-d-860284-1 devstack@n-api.service[134101]: method: Oct 04 21:50:49.445454 n-d-860284-1 devstack@n-api.service[134101]: exception: Invalid port range 1421653344:22. Former value cannot be greater than the later Oct 04 21:50:49.445454 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'cbe723fc-b0bd-4263-9217-43e3e749d54c', 'ip_protocol': 'tcp', 'from_port': 1421653344, 'to_port': 22}}} Oct 04 21:50:49.445454 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:50:49.445454 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:50:49.445454 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 04 21:50:49.445454 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 04 21:50:49.445454 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 04 21:50:49.445454 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 04 21:50:49.445454 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 04 21:50:49.445454 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 04 21:50:49.445454 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Oct 04 21:50:49.445454 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 04 21:50:49.445454 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 1421653344:22. Former value cannot be greater than the later Oct 04 21:50:49.445454 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:50:49.445454 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:50:49.445454 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:50:49.445454 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:50:49.445454 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:50:49.445454 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:50:49.445454 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:50:49.445454 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:50:49.445454 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:50:49.445454 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:50:49.445454 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:50:49.445454 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:50:49.445454 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 04 21:50:49.445454 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 04 21:50:49.445454 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 1421653344:22. Former value cannot be greater than the later Oct 04 21:50:49.445454 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:50:49.451350 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:50:49.451350 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:50:49.451350 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:50:49.451350 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:50:49.451350 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:50:49.451350 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:50:49.451350 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:50:49.451350 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 1421653344:22. Former value cannot be greater than the later Oct 04 21:50:49.451350 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:50:49.454031 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-09219f80-5ad6-4595-93e0-52a77f7e5b82 tempest-SecurityGroupRulesNegativeTestJSON-1904938195 tempest-SecurityGroupRulesNegativeTestJSON-1904938195-project] Returning 400 to user: Invalid port range 1421653344:22. Former value cannot be greater than the later {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:50:49.455180 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-09219f80-5ad6-4595-93e0-52a77f7e5b82 tempest-SecurityGroupRulesNegativeTestJSON-1904938195 tempest-SecurityGroupRulesNegativeTestJSON-1904938195-project] 10.222.0.43 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 123 microversion: 2.1 time: 0.260204 Oct 04 21:50:49.460518 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 903/1872] 10.222.0.43 () {60 vars in 1195 bytes} [Tue Oct 4 21:50:49 2022] POST /compute/v2.1/os-security-group-rules => generated 123 bytes in 266 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 21:50:49.478017 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-7f2c06d8-d01a-48d4-b9f3-7bb22c0066e7 tempest-SecurityGroupRulesNegativeTestJSON-1904938195 tempest-SecurityGroupRulesNegativeTestJSON-1904938195-project] Action: 'create', calling method: .version_select at 0x7fbb372b18b0>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-454655163", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:50:49.490319 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-7f2c06d8-d01a-48d4-b9f3-7bb22c0066e7 tempest-SecurityGroupRulesNegativeTestJSON-1904938195 tempest-SecurityGroupRulesNegativeTestJSON-1904938195-project] HTTP exception thrown: Security group id should be uuid Oct 04 21:50:49.492649 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-7f2c06d8-d01a-48d4-b9f3-7bb22c0066e7 tempest-SecurityGroupRulesNegativeTestJSON-1904938195 tempest-SecurityGroupRulesNegativeTestJSON-1904938195-project] Request method failure captured: Oct 04 21:50:49.492649 n-d-860284-1 devstack@n-api.service[134102]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 04 21:50:49.492649 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 21:50:49.492649 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 21:50:49.492649 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 21:50:49.492649 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 130 Oct 04 21:50:49.492649 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 21:50:49.492649 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 21:50:49.492649 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 21:50:49.492649 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 21:50:49.492649 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPKq0IsLz6MtzxymfmAA4T5LQGf2rcxkSRLwvGIY1f3-7_jBOHLPGHRC1D8HMnjABRyfrqMlOPxBYB7xFt5-ol3G2iacFQfDIClAItXLqJ3MRHsosGEh4_0o7TLbjlNtnZQXLLokdI_Muh3kOjxF1xyfn8csxDCNc9E-TR9UrTjfQcnY Oct 04 21:50:49.492649 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 21:50:49.492649 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 21:50:49.492649 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 21:50:49.492649 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 21:50:49.492649 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 21:50:49.492649 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 21:50:49.492649 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: 5516f39d751e41c2a225725f986c034b Oct 04 21:50:49.492649 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1904938195 Oct 04 21:50:49.492649 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 21:50:49.492649 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 21:50:49.492649 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5516f39d751e41c2a225725f986c034b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_5516f39d751e41c2a225725f986c034b", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5516f39d751e41c2a225725f986c034b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/5516f39d751e41c2a225725f986c034b"}]}] Oct 04 21:50:49.492649 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1904938195 Oct 04 21:50:49.492649 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: 5516f39d751e41c2a225725f986c034b Oct 04 21:50:49.492649 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1904938195 Oct 04 21:50:49.492649 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1904938195-project Oct 04 21:50:49.492649 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 21:50:49.492649 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 21:50:49.492649 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: 70d34373679649f1a353fe9bb7a962e9 Oct 04 21:50:49.492649 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1904938195-project Oct 04 21:50:49.492649 n-d-860284-1 devstack@n-api.service[134102]: Oct 04 21:50:49.492649 n-d-860284-1 devstack@n-api.service[134102]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-454655163", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 04 21:50:49.492649 n-d-860284-1 devstack@n-api.service[134102]: method: Oct 04 21:50:49.492649 n-d-860284-1 devstack@n-api.service[134102]: exception: Security group id should be uuid Oct 04 21:50:49.492649 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-454655163', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 04 21:50:49.492649 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:50:49.492649 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:50:49.492649 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create Oct 04 21:50:49.492649 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( Oct 04 21:50:49.492649 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id Oct 04 21:50:49.492649 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Oct 04 21:50:49.492649 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid Oct 04 21:50:49.492649 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:50:49.492649 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:50:49.492649 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:50:49.492649 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:50:49.492649 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:50:49.492649 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:50:49.492649 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:50:49.492649 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:50:49.492649 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:50:49.492649 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:50:49.492649 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:50:49.492649 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:50:49.492649 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 04 21:50:49.492649 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 04 21:50:49.492649 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid Oct 04 21:50:49.492649 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:50:49.492649 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:50:49.492649 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:50:49.492649 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:50:49.492649 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:50:49.492649 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:50:49.492649 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:50:49.492649 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:50:49.497176 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid Oct 04 21:50:49.497176 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:50:49.497176 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-7f2c06d8-d01a-48d4-b9f3-7bb22c0066e7 tempest-SecurityGroupRulesNegativeTestJSON-1904938195 tempest-SecurityGroupRulesNegativeTestJSON-1904938195-project] Returning 400 to user: Security group id should be uuid {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:50:49.497176 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-7f2c06d8-d01a-48d4-b9f3-7bb22c0066e7 tempest-SecurityGroupRulesNegativeTestJSON-1904938195 tempest-SecurityGroupRulesNegativeTestJSON-1904938195-project] 10.222.0.43 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.034235 Oct 04 21:50:49.507697 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-b4ac0e5f-57f9-4951-a333-633b87fc8691 tempest-SecurityGroupRulesNegativeTestJSON-1904938195 tempest-SecurityGroupRulesNegativeTestJSON-1904938195-project] Action: 'create', calling method: .version_select at 0x7fbb2e785430>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1433443796", "description": "tempest-description-1662409038"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:50:49.513872 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 970/1873] 10.222.0.43 () {60 vars in 1195 bytes} [Tue Oct 4 21:50:49 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 50 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 04 21:50:49.737935 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-1779eb01-80ab-4634-b5c4-f45800beee6b tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-1356721234", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452", "networks": [{"uuid": "6768125a-cd82-476e-8cda-025ae09064af"}]}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:50:49.840095 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.network.neutron [None req-1779eb01-80ab-4634-b5c4-f45800beee6b tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] validate_networks() for [('6768125a-cd82-476e-8cda-025ae09064af', None, None, None, None, None)] {{(pid=134102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:50:49.883921 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-b4ac0e5f-57f9-4951-a333-633b87fc8691 tempest-SecurityGroupRulesNegativeTestJSON-1904938195 tempest-SecurityGroupRulesNegativeTestJSON-1904938195-project] 10.222.0.43 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.379248 Oct 04 21:50:49.894347 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 904/1874] 10.222.0.43 () {60 vars in 1180 bytes} [Tue Oct 4 21:50:49 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:50:49.899325 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-93892331-9d34-465f-8832-95377566822a tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:50:49.900199 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-93892331-9d34-465f-8832-95377566822a tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 3f0a02bc-7993-4849-8b3c-7572327b4799] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:50:49.923710 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-93892331-9d34-465f-8832-95377566822a tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:49.925245 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-93892331-9d34-465f-8832-95377566822a tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:49.926400 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-93892331-9d34-465f-8832-95377566822a tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:49.927412 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-93892331-9d34-465f-8832-95377566822a tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:49.930077 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-93892331-9d34-465f-8832-95377566822a tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:49.930736 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-93892331-9d34-465f-8832-95377566822a tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:50.567311 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-93892331-9d34-465f-8832-95377566822a tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ad048becf474fb972d4291422d810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dcfc7024fc49388c4bd5f25f03e60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:50.582396 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-93892331-9d34-465f-8832-95377566822a tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/3f0a02bc-7993-4849-8b3c-7572327b4799" status: 200 len: 1716 microversion: 2.1 time: 0.686788 Oct 04 21:50:50.590799 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 905/1875] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:50:49 2022] GET /compute/v2.1/servers/3f0a02bc-7993-4849-8b3c-7572327b4799 => generated 1716 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:50:50.607419 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-a3a0547d-1393-41a6-ad90-a800cbb5e551 tempest-SecurityGroupRulesNegativeTestJSON-1904938195 tempest-SecurityGroupRulesNegativeTestJSON-1904938195-project] Action: 'create', calling method: .version_select at 0x7fbb2e785a60>, body: {"security_group_rule": {"parent_group_id": "a6643927-874b-439b-8311-40bc00817920", "ip_protocol": "tempest-999-607759421", "from_port": 22, "to_port": 22}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:50:50.737649 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-a3a0547d-1393-41a6-ad90-a800cbb5e551 tempest-SecurityGroupRulesNegativeTestJSON-1904938195 tempest-SecurityGroupRulesNegativeTestJSON-1904938195-project] HTTP exception thrown: Invalid IP protocol tempest-999-607759421. Oct 04 21:50:50.739504 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-a3a0547d-1393-41a6-ad90-a800cbb5e551 tempest-SecurityGroupRulesNegativeTestJSON-1904938195 tempest-SecurityGroupRulesNegativeTestJSON-1904938195-project] Request method failure captured: Oct 04 21:50:50.739504 n-d-860284-1 devstack@n-api.service[134101]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 04 21:50:50.739504 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 21:50:50.739504 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 21:50:50.739504 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 21:50:50.739504 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 156 Oct 04 21:50:50.739504 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 21:50:50.739504 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 21:50:50.739504 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 21:50:50.739504 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 21:50:50.739504 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPKq0IsLz6MtzxymfmAA4T5LQGf2rcxkSRLwvGIY1f3-7_jBOHLPGHRC1D8HMnjABRyfrqMlOPxBYB7xFt5-ol3G2iacFQfDIClAItXLqJ3MRHsosGEh4_0o7TLbjlNtnZQXLLokdI_Muh3kOjxF1xyfn8csxDCNc9E-TR9UrTjfQcnY Oct 04 21:50:50.739504 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 21:50:50.739504 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 21:50:50.739504 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 21:50:50.739504 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 21:50:50.739504 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 21:50:50.739504 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 21:50:50.739504 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: 5516f39d751e41c2a225725f986c034b Oct 04 21:50:50.739504 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1904938195 Oct 04 21:50:50.739504 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 21:50:50.739504 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 21:50:50.739504 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5516f39d751e41c2a225725f986c034b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_5516f39d751e41c2a225725f986c034b", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5516f39d751e41c2a225725f986c034b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/5516f39d751e41c2a225725f986c034b"}]}] Oct 04 21:50:50.739504 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1904938195 Oct 04 21:50:50.739504 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: 5516f39d751e41c2a225725f986c034b Oct 04 21:50:50.739504 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1904938195 Oct 04 21:50:50.739504 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1904938195-project Oct 04 21:50:50.739504 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 21:50:50.739504 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 21:50:50.739504 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 70d34373679649f1a353fe9bb7a962e9 Oct 04 21:50:50.739504 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1904938195-project Oct 04 21:50:50.739504 n-d-860284-1 devstack@n-api.service[134101]: Oct 04 21:50:50.739504 n-d-860284-1 devstack@n-api.service[134101]: {"security_group_rule": {"parent_group_id": "a6643927-874b-439b-8311-40bc00817920", "ip_protocol": "tempest-999-607759421", "from_port": 22, "to_port": 22}} Oct 04 21:50:50.739504 n-d-860284-1 devstack@n-api.service[134101]: method: Oct 04 21:50:50.739504 n-d-860284-1 devstack@n-api.service[134101]: exception: Invalid IP protocol tempest-999-607759421. Oct 04 21:50:50.739504 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'a6643927-874b-439b-8311-40bc00817920', 'ip_protocol': 'tempest-999-607759421', 'from_port': 22, 'to_port': 22}}} Oct 04 21:50:50.739504 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:50:50.739504 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:50:50.739504 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 04 21:50:50.739504 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 04 21:50:50.739504 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 04 21:50:50.739504 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 04 21:50:50.739504 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 04 21:50:50.739504 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 04 21:50:50.739504 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule Oct 04 21:50:50.739504 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) Oct 04 21:50:50.739504 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-607759421. Oct 04 21:50:50.739504 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:50:50.739504 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:50:50.739504 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:50:50.739504 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:50:50.739504 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:50:50.739504 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:50:50.739504 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:50:50.739504 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:50:50.739504 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:50:50.739504 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:50:50.739504 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:50:50.739504 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:50:50.739504 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 04 21:50:50.739504 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 04 21:50:50.739504 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-607759421. Oct 04 21:50:50.739504 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:50:50.739504 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:50:50.744749 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:50:50.744749 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:50:50.744749 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:50:50.744749 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:50:50.744749 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:50:50.744749 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:50:50.744749 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-607759421. Oct 04 21:50:50.744749 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:50:50.746168 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-a3a0547d-1393-41a6-ad90-a800cbb5e551 tempest-SecurityGroupRulesNegativeTestJSON-1904938195 tempest-SecurityGroupRulesNegativeTestJSON-1904938195-project] Returning 400 to user: Invalid IP protocol tempest-999-607759421. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:50:50.747284 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-a3a0547d-1393-41a6-ad90-a800cbb5e551 tempest-SecurityGroupRulesNegativeTestJSON-1904938195 tempest-SecurityGroupRulesNegativeTestJSON-1904938195-project] 10.222.0.43 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 86 microversion: 2.1 time: 0.155236 Oct 04 21:50:50.748388 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 906/1876] 10.222.0.43 () {60 vars in 1195 bytes} [Tue Oct 4 21:50:50 2022] POST /compute/v2.1/os-security-group-rules => generated 86 bytes in 157 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 04 21:50:50.763925 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-fd3d776e-5823-4308-a6e9-913f1817cb18 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:50:50.764811 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-fd3d776e-5823-4308-a6e9-913f1817cb18 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] [instance: 3f80e8f0-dba3-4403-83f8-0473c5d7d29b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:50:50.787316 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fd3d776e-5823-4308-a6e9-913f1817cb18 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:50.788358 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fd3d776e-5823-4308-a6e9-913f1817cb18 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:50.788978 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fd3d776e-5823-4308-a6e9-913f1817cb18 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:50.789907 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fd3d776e-5823-4308-a6e9-913f1817cb18 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:50.799309 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fd3d776e-5823-4308-a6e9-913f1817cb18 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:50.801716 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fd3d776e-5823-4308-a6e9-913f1817cb18 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:51.027551 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-1779eb01-80ab-4634-b5c4-f45800beee6b tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Flavor limits 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:50:51.027973 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-1779eb01-80ab-4634-b5c4-f45800beee6b tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Image limits 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:50:51.028440 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-1779eb01-80ab-4634-b5c4-f45800beee6b tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Flavor pref 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:50:51.028852 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-1779eb01-80ab-4634-b5c4-f45800beee6b tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Image pref 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:50:51.029267 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-1779eb01-80ab-4634-b5c4-f45800beee6b tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:50:51.033694 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:50:51.073827 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1779eb01-80ab-4634-b5c4-f45800beee6b tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:51.074351 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1779eb01-80ab-4634-b5c4-f45800beee6b tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:51.074809 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1779eb01-80ab-4634-b5c4-f45800beee6b tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:51.075577 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1779eb01-80ab-4634-b5c4-f45800beee6b tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:51.076035 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1779eb01-80ab-4634-b5c4-f45800beee6b tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:51.076460 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1779eb01-80ab-4634-b5c4-f45800beee6b tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:51.153374 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-1779eb01-80ab-4634-b5c4-f45800beee6b tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Getting quotas for project 4fbc93887563467dba31d09e3803b962. Resources: {'instances', 'ram', 'cores'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:50:51.164055 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-1779eb01-80ab-4634-b5c4-f45800beee6b tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Getting quotas for user 301902a6e7bd419db1dc37123e2626aa and project 4fbc93887563467dba31d09e3803b962. Resources: {'instances', 'ram', 'cores'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:50:51.173263 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-fd3d776e-5823-4308-a6e9-913f1817cb18 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43653f2aea4e4884b5001dea5ec12be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b700f614a8b4cfba9b4abea45a06f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:51.188179 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-fd3d776e-5823-4308-a6e9-913f1817cb18 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43653f2aea4e4884b5001dea5ec12be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b700f614a8b4cfba9b4abea45a06f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:51.191594 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-fd3d776e-5823-4308-a6e9-913f1817cb18 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43653f2aea4e4884b5001dea5ec12be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b700f614a8b4cfba9b4abea45a06f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:51.204570 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-fd3d776e-5823-4308-a6e9-913f1817cb18 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] 10.222.0.43 "GET /compute/v2.1/servers/3f80e8f0-dba3-4403-83f8-0473c5d7d29b" status: 200 len: 1435 microversion: 2.75 time: 0.452929 Oct 04 21:50:51.219544 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 907/1877] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:50:50 2022] GET /compute/v2.1/servers/3f80e8f0-dba3-4403-83f8-0473c5d7d29b => generated 1435 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:50:51.228142 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-cc763867-f985-4a00-afc8-ebdaf280a975 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:50:51.231674 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-cc763867-f985-4a00-afc8-ebdaf280a975 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] [instance: 4709e5d7-52a3-4a79-8835-d651dce0c34a] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:50:51.247835 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cc763867-f985-4a00-afc8-ebdaf280a975 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:51.254600 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cc763867-f985-4a00-afc8-ebdaf280a975 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:51.255384 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cc763867-f985-4a00-afc8-ebdaf280a975 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:51.256490 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cc763867-f985-4a00-afc8-ebdaf280a975 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:51.257251 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cc763867-f985-4a00-afc8-ebdaf280a975 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:51.257893 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cc763867-f985-4a00-afc8-ebdaf280a975 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:51.308569 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-1779eb01-80ab-4634-b5c4-f45800beee6b tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Going to run 1 instances... {{(pid=134102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:50:51.318593 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-1779eb01-80ab-4634-b5c4-f45800beee6b tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] [instance: 26a08c55-8019-43e6-aa28-fdf938ad0798] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='58548514-5dac-426c-81f5-19e3fba33e23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:50:51.442681 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-cc763867-f985-4a00-afc8-ebdaf280a975 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12f87ae29534b2c9171ee7b0dcab372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f529360dc1742a89d62a9fe42bc9848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:51.456842 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-cc763867-f985-4a00-afc8-ebdaf280a975 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] 10.222.0.43 "GET /compute/v2.1/servers/4709e5d7-52a3-4a79-8835-d651dce0c34a" status: 200 len: 1321 microversion: 2.1 time: 0.231135 Oct 04 21:50:51.458343 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 908/1878] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:50:51 2022] GET /compute/v2.1/servers/4709e5d7-52a3-4a79-8835-d651dce0c34a => generated 1321 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:50:51.476371 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-b216f63e-7d3d-4567-8c17-ffd1c489f8bf tempest-SecurityGroupRulesNegativeTestJSON-1904938195 tempest-SecurityGroupRulesNegativeTestJSON-1904938195-project] Action: 'create', calling method: .version_select at 0x7fbb372ad430>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-279970038", "description": "tempest-description-1802460614"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:50:51.500005 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-1779eb01-80ab-4634-b5c4-f45800beee6b tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 1.857000 Oct 04 21:50:51.502662 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 971/1879] 10.222.0.43 () {62 vars in 1188 bytes} [Tue Oct 4 21:50:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 1861 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Oct 04 21:50:51.872216 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-b216f63e-7d3d-4567-8c17-ffd1c489f8bf tempest-SecurityGroupRulesNegativeTestJSON-1904938195 tempest-SecurityGroupRulesNegativeTestJSON-1904938195-project] 10.222.0.43 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.410260 Oct 04 21:50:51.874603 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 909/1880] 10.222.0.43 () {60 vars in 1180 bytes} [Tue Oct 4 21:50:51 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:50:51.880155 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-9e55e91d-cd42-432f-a823-ce9ca1eaaf55 tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:50:51.881039 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-9e55e91d-cd42-432f-a823-ce9ca1eaaf55 tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] [instance: 26a08c55-8019-43e6-aa28-fdf938ad0798] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:50:52.070861 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-9e55e91d-cd42-432f-a823-ce9ca1eaaf55 tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '301902a6e7bd419db1dc37123e2626aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fbc93887563467dba31d09e3803b962', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:52.093089 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-9e55e91d-cd42-432f-a823-ce9ca1eaaf55 tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '301902a6e7bd419db1dc37123e2626aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fbc93887563467dba31d09e3803b962', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:52.099564 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-9e55e91d-cd42-432f-a823-ce9ca1eaaf55 tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '301902a6e7bd419db1dc37123e2626aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fbc93887563467dba31d09e3803b962', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:52.111629 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-9e55e91d-cd42-432f-a823-ce9ca1eaaf55 tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] 10.222.0.43 "GET /compute/v2.1/servers/26a08c55-8019-43e6-aa28-fdf938ad0798" status: 200 len: 1259 microversion: 2.21 time: 0.235762 Oct 04 21:50:52.114285 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 910/1881] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:50:51 2022] GET /compute/v2.1/servers/26a08c55-8019-43e6-aa28-fdf938ad0798 => generated 1259 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:50:52.129955 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-f336f37d-a16f-4b68-a20a-cefa9009d3db tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:50:52.132181 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-f336f37d-a16f-4b68-a20a-cefa9009d3db tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 3f0a02bc-7993-4849-8b3c-7572327b4799] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:50:52.159442 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f336f37d-a16f-4b68-a20a-cefa9009d3db tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:52.164520 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f336f37d-a16f-4b68-a20a-cefa9009d3db tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:52.165259 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f336f37d-a16f-4b68-a20a-cefa9009d3db tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:52.166279 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f336f37d-a16f-4b68-a20a-cefa9009d3db tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:52.166995 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f336f37d-a16f-4b68-a20a-cefa9009d3db tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:52.167963 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f336f37d-a16f-4b68-a20a-cefa9009d3db tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:52.316188 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-4da9dc65-bac6-4f37-b2f3-1c6d8210d84b tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "58548514-5dac-426c-81f5-19e3fba33e23"}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:50:52.319660 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-4da9dc65-bac6-4f37-b2f3-1c6d8210d84b tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] [instance: 3f80e8f0-dba3-4403-83f8-0473c5d7d29b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:50:52.347289 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4da9dc65-bac6-4f37-b2f3-1c6d8210d84b tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:52.350298 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4da9dc65-bac6-4f37-b2f3-1c6d8210d84b tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:52.351014 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4da9dc65-bac6-4f37-b2f3-1c6d8210d84b tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:52.353327 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4da9dc65-bac6-4f37-b2f3-1c6d8210d84b tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:52.356450 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4da9dc65-bac6-4f37-b2f3-1c6d8210d84b tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:52.362040 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4da9dc65-bac6-4f37-b2f3-1c6d8210d84b tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:52.633253 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-4da9dc65-bac6-4f37-b2f3-1c6d8210d84b tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Flavor limits 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:50:52.637528 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-4da9dc65-bac6-4f37-b2f3-1c6d8210d84b tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Image limits 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:50:52.638220 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-4da9dc65-bac6-4f37-b2f3-1c6d8210d84b tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Flavor pref 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:50:52.638831 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-4da9dc65-bac6-4f37-b2f3-1c6d8210d84b tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Image pref 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:50:52.640631 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-4da9dc65-bac6-4f37-b2f3-1c6d8210d84b tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:50:52.872527 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-4da9dc65-bac6-4f37-b2f3-1c6d8210d84b tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] [instance: 3f80e8f0-dba3-4403-83f8-0473c5d7d29b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:50:52.903686 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4da9dc65-bac6-4f37-b2f3-1c6d8210d84b tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:52.908616 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4da9dc65-bac6-4f37-b2f3-1c6d8210d84b tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:52.911481 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4da9dc65-bac6-4f37-b2f3-1c6d8210d84b tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:52.914424 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4da9dc65-bac6-4f37-b2f3-1c6d8210d84b tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:52.917658 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4da9dc65-bac6-4f37-b2f3-1c6d8210d84b tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:52.919577 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4da9dc65-bac6-4f37-b2f3-1c6d8210d84b tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:53.148491 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-f336f37d-a16f-4b68-a20a-cefa9009d3db tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ad048becf474fb972d4291422d810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dcfc7024fc49388c4bd5f25f03e60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:53.162630 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-f336f37d-a16f-4b68-a20a-cefa9009d3db tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/3f0a02bc-7993-4849-8b3c-7572327b4799" status: 200 len: 1716 microversion: 2.1 time: 1.046957 Oct 04 21:50:53.181000 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 911/1882] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:50:52 2022] GET /compute/v2.1/servers/3f0a02bc-7993-4849-8b3c-7572327b4799 => generated 1716 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:50:53.195039 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-14672635-01ad-4356-975b-84fccb301e67 tempest-SecurityGroupRulesNegativeTestJSON-1904938195 tempest-SecurityGroupRulesNegativeTestJSON-1904938195-project] Action: 'create', calling method: .version_select at 0x7fbb37373af0>, body: {"security_group_rule": {"parent_group_id": "7d103c28-dabd-4820-bc29-fb1cc824bf2c", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:50:54.035378 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-14672635-01ad-4356-975b-84fccb301e67 tempest-SecurityGroupRulesNegativeTestJSON-1904938195 tempest-SecurityGroupRulesNegativeTestJSON-1904938195-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Oct 04 21:50:54.037158 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-14672635-01ad-4356-975b-84fccb301e67 tempest-SecurityGroupRulesNegativeTestJSON-1904938195 tempest-SecurityGroupRulesNegativeTestJSON-1904938195-project] Request method failure captured: Oct 04 21:50:54.037158 n-d-860284-1 devstack@n-api.service[134101]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 04 21:50:54.037158 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 21:50:54.037158 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 21:50:54.037158 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 21:50:54.037158 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 138 Oct 04 21:50:54.037158 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 21:50:54.037158 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 21:50:54.037158 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 21:50:54.037158 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 21:50:54.037158 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPKq0IsLz6MtzxymfmAA4T5LQGf2rcxkSRLwvGIY1f3-7_jBOHLPGHRC1D8HMnjABRyfrqMlOPxBYB7xFt5-ol3G2iacFQfDIClAItXLqJ3MRHsosGEh4_0o7TLbjlNtnZQXLLokdI_Muh3kOjxF1xyfn8csxDCNc9E-TR9UrTjfQcnY Oct 04 21:50:54.037158 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 21:50:54.037158 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 21:50:54.037158 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 21:50:54.037158 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 21:50:54.037158 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 21:50:54.037158 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 21:50:54.037158 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: 5516f39d751e41c2a225725f986c034b Oct 04 21:50:54.037158 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1904938195 Oct 04 21:50:54.037158 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 21:50:54.037158 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 21:50:54.037158 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5516f39d751e41c2a225725f986c034b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_5516f39d751e41c2a225725f986c034b", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5516f39d751e41c2a225725f986c034b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/5516f39d751e41c2a225725f986c034b"}]}] Oct 04 21:50:54.037158 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1904938195 Oct 04 21:50:54.037158 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: 5516f39d751e41c2a225725f986c034b Oct 04 21:50:54.037158 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1904938195 Oct 04 21:50:54.037158 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1904938195-project Oct 04 21:50:54.037158 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 21:50:54.037158 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 21:50:54.037158 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 70d34373679649f1a353fe9bb7a962e9 Oct 04 21:50:54.037158 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1904938195-project Oct 04 21:50:54.037158 n-d-860284-1 devstack@n-api.service[134101]: Oct 04 21:50:54.037158 n-d-860284-1 devstack@n-api.service[134101]: {"security_group_rule": {"parent_group_id": "7d103c28-dabd-4820-bc29-fb1cc824bf2c", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} Oct 04 21:50:54.037158 n-d-860284-1 devstack@n-api.service[134101]: method: Oct 04 21:50:54.037158 n-d-860284-1 devstack@n-api.service[134101]: exception: Invalid port range 22:21. Former value cannot be greater than the later Oct 04 21:50:54.037158 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'body': {'security_group_rule': {'parent_group_id': '7d103c28-dabd-4820-bc29-fb1cc824bf2c', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} Oct 04 21:50:54.037158 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:50:54.037158 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:50:54.037158 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 04 21:50:54.037158 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 04 21:50:54.037158 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 04 21:50:54.037158 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 04 21:50:54.037158 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 04 21:50:54.037158 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 04 21:50:54.037158 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Oct 04 21:50:54.037158 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 04 21:50:54.037158 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later Oct 04 21:50:54.037158 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:50:54.037158 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:50:54.037158 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:50:54.037158 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:50:54.037158 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:50:54.037158 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:50:54.037158 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:50:54.037158 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:50:54.037158 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:50:54.037158 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:50:54.037158 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:50:54.037158 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:50:54.037158 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 04 21:50:54.037158 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 04 21:50:54.037158 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later Oct 04 21:50:54.037158 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:50:54.042271 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:50:54.042271 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:50:54.042271 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:50:54.042271 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:50:54.042271 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:50:54.042271 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:50:54.042271 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:50:54.042271 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later Oct 04 21:50:54.042271 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:50:54.042271 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-14672635-01ad-4356-975b-84fccb301e67 tempest-SecurityGroupRulesNegativeTestJSON-1904938195 tempest-SecurityGroupRulesNegativeTestJSON-1904938195-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:50:54.042271 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-14672635-01ad-4356-975b-84fccb301e67 tempest-SecurityGroupRulesNegativeTestJSON-1904938195 tempest-SecurityGroupRulesNegativeTestJSON-1904938195-project] 10.222.0.43 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.854632 Oct 04 21:50:54.042271 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 912/1883] 10.222.0.43 () {60 vars in 1195 bytes} [Tue Oct 4 21:50:53 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 858 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 21:50:54.052835 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.objects.instance [None req-4da9dc65-bac6-4f37-b2f3-1c6d8210d84b tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Lazy-loading 'services' on Instance uuid 3f80e8f0-dba3-4403-83f8-0473c5d7d29b {{(pid=134102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:50:54.092084 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-8697034a-eca1-4e73-a050-1535fcc62e7b tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:50:54.092731 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-8697034a-eca1-4e73-a050-1535fcc62e7b tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] [instance: 4709e5d7-52a3-4a79-8835-d651dce0c34a] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:50:54.109316 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-4da9dc65-bac6-4f37-b2f3-1c6d8210d84b tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] 10.222.0.43 "POST /compute/v2.1/servers/3f80e8f0-dba3-4403-83f8-0473c5d7d29b/action" status: 202 len: 1936 microversion: 2.75 time: 2.603555 Oct 04 21:50:54.110549 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 972/1884] 10.222.0.43 () {62 vars in 1319 bytes} [Tue Oct 4 21:50:51 2022] POST /compute/v2.1/servers/3f80e8f0-dba3-4403-83f8-0473c5d7d29b/action => generated 1936 bytes in 2606 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 04 21:50:54.122670 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8697034a-eca1-4e73-a050-1535fcc62e7b tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:54.126833 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8697034a-eca1-4e73-a050-1535fcc62e7b tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:54.127744 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8697034a-eca1-4e73-a050-1535fcc62e7b tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:54.130186 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8697034a-eca1-4e73-a050-1535fcc62e7b tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:54.132120 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8697034a-eca1-4e73-a050-1535fcc62e7b tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:54.137757 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8697034a-eca1-4e73-a050-1535fcc62e7b tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:54.148094 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-c7e23552-9765-4004-a495-fb871a44286c req-765830fd-433a-4bd2-bb1b-3ed937f2705f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f0a02bc-7993-4849-8b3c-7572327b4799", "name": "network-vif-unplugged", "status": "completed", "tag": "c2e7099f-7aa9-4be4-9b2d-631622cf5151"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:50:54.173571 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-c7e23552-9765-4004-a495-fb871a44286c req-765830fd-433a-4bd2-bb1b-3ed937f2705f service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:54.174056 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-c7e23552-9765-4004-a495-fb871a44286c req-765830fd-433a-4bd2-bb1b-3ed937f2705f service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:54.174511 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-c7e23552-9765-4004-a495-fb871a44286c req-765830fd-433a-4bd2-bb1b-3ed937f2705f service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:54.203264 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-c7e23552-9765-4004-a495-fb871a44286c req-765830fd-433a-4bd2-bb1b-3ed937f2705f service nova] Creating event network-vif-unplugged:c2e7099f-7aa9-4be4-9b2d-631622cf5151 for instance 3f0a02bc-7993-4849-8b3c-7572327b4799 on n-h1-860284-1 Oct 04 21:50:54.240371 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-c7e23552-9765-4004-a495-fb871a44286c req-765830fd-433a-4bd2-bb1b-3ed937f2705f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.099753 Oct 04 21:50:54.250008 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 973/1885] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:50:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:50:54.273428 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-f9bc2ff3-c1e6-4c94-ab7b-d4fac5a8eee6 tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:50:54.274152 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-f9bc2ff3-c1e6-4c94-ab7b-d4fac5a8eee6 tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] [instance: 26a08c55-8019-43e6-aa28-fdf938ad0798] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:50:54.289771 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f9bc2ff3-c1e6-4c94-ab7b-d4fac5a8eee6 tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:54.295246 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f9bc2ff3-c1e6-4c94-ab7b-d4fac5a8eee6 tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:54.296021 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f9bc2ff3-c1e6-4c94-ab7b-d4fac5a8eee6 tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:54.312806 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f9bc2ff3-c1e6-4c94-ab7b-d4fac5a8eee6 tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:54.313394 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f9bc2ff3-c1e6-4c94-ab7b-d4fac5a8eee6 tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:54.313841 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f9bc2ff3-c1e6-4c94-ab7b-d4fac5a8eee6 tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:54.411946 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-8697034a-eca1-4e73-a050-1535fcc62e7b tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12f87ae29534b2c9171ee7b0dcab372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f529360dc1742a89d62a9fe42bc9848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:54.426514 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-8697034a-eca1-4e73-a050-1535fcc62e7b tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] 10.222.0.43 "GET /compute/v2.1/servers/4709e5d7-52a3-4a79-8835-d651dce0c34a" status: 200 len: 1327 microversion: 2.1 time: 0.382069 Oct 04 21:50:54.429294 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 913/1886] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:50:54 2022] GET /compute/v2.1/servers/4709e5d7-52a3-4a79-8835-d651dce0c34a => generated 1327 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:50:54.464571 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-520879cb-9637-45ab-b239-e4abe9e18559 tempest-SecurityGroupRulesNegativeTestJSON-1904938195 tempest-SecurityGroupRulesNegativeTestJSON-1904938195-project] Action: 'create', calling method: .version_select at 0x7fbb372169d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-458815090", "description": "tempest-description-876924729"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:50:54.741557 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-f9bc2ff3-c1e6-4c94-ab7b-d4fac5a8eee6 tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '301902a6e7bd419db1dc37123e2626aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fbc93887563467dba31d09e3803b962', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:54.751503 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-f9bc2ff3-c1e6-4c94-ab7b-d4fac5a8eee6 tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '301902a6e7bd419db1dc37123e2626aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fbc93887563467dba31d09e3803b962', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:54.752935 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-f9bc2ff3-c1e6-4c94-ab7b-d4fac5a8eee6 tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '301902a6e7bd419db1dc37123e2626aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fbc93887563467dba31d09e3803b962', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:54.754114 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-f9bc2ff3-c1e6-4c94-ab7b-d4fac5a8eee6 tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] 10.222.0.43 "GET /compute/v2.1/servers/26a08c55-8019-43e6-aa28-fdf938ad0798" status: 200 len: 1319 microversion: 2.21 time: 0.491741 Oct 04 21:50:54.778747 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 974/1887] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:50:54 2022] GET /compute/v2.1/servers/26a08c55-8019-43e6-aa28-fdf938ad0798 => generated 1319 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:50:54.784103 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-e39d3283-f9a3-4ea4-bf90-d2ebd79bb374 tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:50:54.785080 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-e39d3283-f9a3-4ea4-bf90-d2ebd79bb374 tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] [instance: 3f80e8f0-dba3-4403-83f8-0473c5d7d29b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:50:54.808743 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e39d3283-f9a3-4ea4-bf90-d2ebd79bb374 tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:54.809246 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e39d3283-f9a3-4ea4-bf90-d2ebd79bb374 tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:54.809681 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e39d3283-f9a3-4ea4-bf90-d2ebd79bb374 tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:54.810407 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e39d3283-f9a3-4ea4-bf90-d2ebd79bb374 tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:54.810866 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e39d3283-f9a3-4ea4-bf90-d2ebd79bb374 tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:54.811292 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e39d3283-f9a3-4ea4-bf90-d2ebd79bb374 tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:55.258512 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.objects.instance [None req-e39d3283-f9a3-4ea4-bf90-d2ebd79bb374 tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Lazy-loading 'services' on Instance uuid 3f80e8f0-dba3-4403-83f8-0473c5d7d29b {{(pid=134102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:50:55.315891 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-e39d3283-f9a3-4ea4-bf90-d2ebd79bb374 tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/3f80e8f0-dba3-4403-83f8-0473c5d7d29b" status: 200 len: 1923 microversion: 2.75 time: 0.535732 Oct 04 21:50:55.331120 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 975/1888] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:50:54 2022] GET /compute/v2.1/servers/3f80e8f0-dba3-4403-83f8-0473c5d7d29b => generated 1923 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:50:55.343103 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-7dfe3da9-2642-4df2-89e7-6d7a77117469 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:50:55.344003 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-7dfe3da9-2642-4df2-89e7-6d7a77117469 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 3f0a02bc-7993-4849-8b3c-7572327b4799] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:50:55.352335 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7dfe3da9-2642-4df2-89e7-6d7a77117469 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:55.353928 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7dfe3da9-2642-4df2-89e7-6d7a77117469 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:55.355535 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7dfe3da9-2642-4df2-89e7-6d7a77117469 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:55.359323 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7dfe3da9-2642-4df2-89e7-6d7a77117469 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:55.361661 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7dfe3da9-2642-4df2-89e7-6d7a77117469 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:55.363174 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7dfe3da9-2642-4df2-89e7-6d7a77117469 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:55.611210 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-520879cb-9637-45ab-b239-e4abe9e18559 tempest-SecurityGroupRulesNegativeTestJSON-1904938195 tempest-SecurityGroupRulesNegativeTestJSON-1904938195-project] 10.222.0.43 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 1.180019 Oct 04 21:50:55.612418 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 914/1889] 10.222.0.43 () {60 vars in 1180 bytes} [Tue Oct 4 21:50:54 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 1182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:50:55.617736 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-86f30eba-5f27-4a2d-8431-78bdd7a2bb34 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:50:55.618632 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-86f30eba-5f27-4a2d-8431-78bdd7a2bb34 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] [instance: 4709e5d7-52a3-4a79-8835-d651dce0c34a] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:50:55.635120 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-86f30eba-5f27-4a2d-8431-78bdd7a2bb34 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:55.643047 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-86f30eba-5f27-4a2d-8431-78bdd7a2bb34 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:55.643873 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-86f30eba-5f27-4a2d-8431-78bdd7a2bb34 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:55.644854 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-86f30eba-5f27-4a2d-8431-78bdd7a2bb34 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:55.648247 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-86f30eba-5f27-4a2d-8431-78bdd7a2bb34 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:55.649814 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-86f30eba-5f27-4a2d-8431-78bdd7a2bb34 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:55.925837 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-7dfe3da9-2642-4df2-89e7-6d7a77117469 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ad048becf474fb972d4291422d810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dcfc7024fc49388c4bd5f25f03e60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:55.937117 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-7dfe3da9-2642-4df2-89e7-6d7a77117469 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/3f0a02bc-7993-4849-8b3c-7572327b4799" status: 200 len: 1716 microversion: 2.1 time: 0.604775 Oct 04 21:50:55.939965 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 976/1890] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:50:55 2022] GET /compute/v2.1/servers/3f0a02bc-7993-4849-8b3c-7572327b4799 => generated 1716 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:50:55.946106 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-f0d57c73-73f1-425a-b7fd-6472c4daf7a6 tempest-SecurityGroupRulesNegativeTestJSON-1904938195 tempest-SecurityGroupRulesNegativeTestJSON-1904938195-project] Action: 'create', calling method: .version_select at 0x7fbb2ea50b80>, body: {"security_group_rule": {"parent_group_id": "adf20219-f381-40b3-903b-ff746af79f57", "ip_protocol": "tcp", "from_port": 22, "to_port": 2087887628}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:50:56.082930 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-86f30eba-5f27-4a2d-8431-78bdd7a2bb34 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12f87ae29534b2c9171ee7b0dcab372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f529360dc1742a89d62a9fe42bc9848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:56.098270 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-86f30eba-5f27-4a2d-8431-78bdd7a2bb34 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] 10.222.0.43 "GET /compute/v2.1/servers/4709e5d7-52a3-4a79-8835-d651dce0c34a" status: 200 len: 1394 microversion: 2.1 time: 0.484546 Oct 04 21:50:56.108840 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-f0d57c73-73f1-425a-b7fd-6472c4daf7a6 tempest-SecurityGroupRulesNegativeTestJSON-1904938195 tempest-SecurityGroupRulesNegativeTestJSON-1904938195-project] HTTP exception thrown: Invalid port range 22:2087887628. Valid TCP ports should be between 1-65535 Oct 04 21:50:56.115004 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-f0d57c73-73f1-425a-b7fd-6472c4daf7a6 tempest-SecurityGroupRulesNegativeTestJSON-1904938195 tempest-SecurityGroupRulesNegativeTestJSON-1904938195-project] Request method failure captured: Oct 04 21:50:56.115004 n-d-860284-1 devstack@n-api.service[134102]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 04 21:50:56.115004 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 21:50:56.115004 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 21:50:56.115004 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 21:50:56.115004 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 146 Oct 04 21:50:56.115004 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 21:50:56.115004 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 21:50:56.115004 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 21:50:56.115004 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 21:50:56.115004 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPKq0IsLz6MtzxymfmAA4T5LQGf2rcxkSRLwvGIY1f3-7_jBOHLPGHRC1D8HMnjABRyfrqMlOPxBYB7xFt5-ol3G2iacFQfDIClAItXLqJ3MRHsosGEh4_0o7TLbjlNtnZQXLLokdI_Muh3kOjxF1xyfn8csxDCNc9E-TR9UrTjfQcnY Oct 04 21:50:56.115004 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 21:50:56.115004 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 21:50:56.115004 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 21:50:56.115004 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 21:50:56.115004 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 21:50:56.115004 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 21:50:56.115004 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: 5516f39d751e41c2a225725f986c034b Oct 04 21:50:56.115004 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1904938195 Oct 04 21:50:56.115004 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 21:50:56.115004 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 21:50:56.115004 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5516f39d751e41c2a225725f986c034b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_5516f39d751e41c2a225725f986c034b", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5516f39d751e41c2a225725f986c034b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/5516f39d751e41c2a225725f986c034b"}]}] Oct 04 21:50:56.115004 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1904938195 Oct 04 21:50:56.115004 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: 5516f39d751e41c2a225725f986c034b Oct 04 21:50:56.115004 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1904938195 Oct 04 21:50:56.115004 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1904938195-project Oct 04 21:50:56.115004 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 21:50:56.115004 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 21:50:56.115004 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: 70d34373679649f1a353fe9bb7a962e9 Oct 04 21:50:56.115004 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1904938195-project Oct 04 21:50:56.115004 n-d-860284-1 devstack@n-api.service[134102]: Oct 04 21:50:56.115004 n-d-860284-1 devstack@n-api.service[134102]: {"security_group_rule": {"parent_group_id": "adf20219-f381-40b3-903b-ff746af79f57", "ip_protocol": "tcp", "from_port": 22, "to_port": 2087887628}} Oct 04 21:50:56.115004 n-d-860284-1 devstack@n-api.service[134102]: method: Oct 04 21:50:56.115004 n-d-860284-1 devstack@n-api.service[134102]: exception: Invalid port range 22:2087887628. Valid TCP ports should be between 1-65535 Oct 04 21:50:56.115004 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'adf20219-f381-40b3-903b-ff746af79f57', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 2087887628}}} Oct 04 21:50:56.115004 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:50:56.115004 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:50:56.115004 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 04 21:50:56.115004 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 04 21:50:56.115004 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 04 21:50:56.115004 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 04 21:50:56.115004 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 04 21:50:56.115004 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 04 21:50:56.115004 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule Oct 04 21:50:56.115004 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 04 21:50:56.115004 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:2087887628. Valid TCP ports should be between 1-65535 Oct 04 21:50:56.115004 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:50:56.115004 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:50:56.115004 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:50:56.115004 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:50:56.115004 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:50:56.115004 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:50:56.115004 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:50:56.115004 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:50:56.115004 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:50:56.115004 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:50:56.115004 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:50:56.115004 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:50:56.115004 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 04 21:50:56.115004 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 04 21:50:56.115004 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:2087887628. Valid TCP ports should be between 1-65535 Oct 04 21:50:56.115004 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:50:56.120304 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:50:56.120304 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:50:56.120304 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:50:56.120304 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:50:56.120304 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:50:56.120304 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:50:56.120304 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:50:56.120304 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:2087887628. Valid TCP ports should be between 1-65535 Oct 04 21:50:56.120304 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:50:56.122237 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-f0d57c73-73f1-425a-b7fd-6472c4daf7a6 tempest-SecurityGroupRulesNegativeTestJSON-1904938195 tempest-SecurityGroupRulesNegativeTestJSON-1904938195-project] Returning 400 to user: Invalid port range 22:2087887628. Valid TCP ports should be between 1-65535 {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:50:56.124793 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-f0d57c73-73f1-425a-b7fd-6472c4daf7a6 tempest-SecurityGroupRulesNegativeTestJSON-1904938195 tempest-SecurityGroupRulesNegativeTestJSON-1904938195-project] 10.222.0.43 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 119 microversion: 2.1 time: 0.182494 Oct 04 21:50:56.126497 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 977/1891] 10.222.0.43 () {60 vars in 1195 bytes} [Tue Oct 4 21:50:55 2022] POST /compute/v2.1/os-security-group-rules => generated 119 bytes in 185 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 21:50:56.130764 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 915/1892] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:50:55 2022] GET /compute/v2.1/servers/4709e5d7-52a3-4a79-8835-d651dce0c34a => generated 1394 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:50:56.136125 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-7a6b21f0-bb05-4634-b71f-dd54980a11bf tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:50:56.138473 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-7a6b21f0-bb05-4634-b71f-dd54980a11bf tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] [instance: 26a08c55-8019-43e6-aa28-fdf938ad0798] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:50:56.155261 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-a3f9d8d0-266e-4268-924e-064e14eb87fa tempest-SecurityGroupRulesNegativeTestJSON-1904938195 tempest-SecurityGroupRulesNegativeTestJSON-1904938195-project] Action: 'create', calling method: .version_select at 0x7fbb2f622e50>, body: {"security_group_rule": {"parent_group_id": "4bdd405c-26bf-4677-81b9-8222cbf9b27a", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:50:56.183810 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7a6b21f0-bb05-4634-b71f-dd54980a11bf tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:56.191472 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7a6b21f0-bb05-4634-b71f-dd54980a11bf tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:56.192121 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7a6b21f0-bb05-4634-b71f-dd54980a11bf tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:56.192991 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7a6b21f0-bb05-4634-b71f-dd54980a11bf tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:56.193584 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7a6b21f0-bb05-4634-b71f-dd54980a11bf tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:56.194167 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7a6b21f0-bb05-4634-b71f-dd54980a11bf tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:56.202715 n-d-860284-1 devstack@n-api.service[134101]: DEBUG neutronclient.v2_0.client [None req-a3f9d8d0-266e-4268-924e-064e14eb87fa tempest-SecurityGroupRulesNegativeTestJSON-1904938195 tempest-SecurityGroupRulesNegativeTestJSON-1904938195-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 4bdd405c-26bf-4677-81b9-8222cbf9b27a does not exist", "detail": ""}} {{(pid=134101) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 21:50:56.203798 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.network.security_group_api [None req-a3f9d8d0-266e-4268-924e-064e14eb87fa tempest-SecurityGroupRulesNegativeTestJSON-1904938195 tempest-SecurityGroupRulesNegativeTestJSON-1904938195-project] Neutron security group 4bdd405c-26bf-4677-81b9-8222cbf9b27a not found {{(pid=134101) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 04 21:50:56.204573 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-a3f9d8d0-266e-4268-924e-064e14eb87fa tempest-SecurityGroupRulesNegativeTestJSON-1904938195 tempest-SecurityGroupRulesNegativeTestJSON-1904938195-project] HTTP exception thrown: Security group 4bdd405c-26bf-4677-81b9-8222cbf9b27a does not exist Oct 04 21:50:56.204573 n-d-860284-1 devstack@n-api.service[134101]: Neutron server returns request_ids: ['req-684fcdbf-dd67-4b18-852a-685184019c9a'] Oct 04 21:50:56.207210 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-a3f9d8d0-266e-4268-924e-064e14eb87fa tempest-SecurityGroupRulesNegativeTestJSON-1904938195 tempest-SecurityGroupRulesNegativeTestJSON-1904938195-project] Request method failure captured: Oct 04 21:50:56.207210 n-d-860284-1 devstack@n-api.service[134101]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 04 21:50:56.207210 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 21:50:56.207210 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 21:50:56.207210 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 21:50:56.207210 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 138 Oct 04 21:50:56.207210 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 21:50:56.207210 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 21:50:56.207210 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 21:50:56.207210 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 21:50:56.207210 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPKq0IsLz6MtzxymfmAA4T5LQGf2rcxkSRLwvGIY1f3-7_jBOHLPGHRC1D8HMnjABRyfrqMlOPxBYB7xFt5-ol3G2iacFQfDIClAItXLqJ3MRHsosGEh4_0o7TLbjlNtnZQXLLokdI_Muh3kOjxF1xyfn8csxDCNc9E-TR9UrTjfQcnY Oct 04 21:50:56.207210 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 21:50:56.207210 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 21:50:56.207210 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 21:50:56.207210 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 21:50:56.207210 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 21:50:56.207210 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 21:50:56.207210 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: 5516f39d751e41c2a225725f986c034b Oct 04 21:50:56.207210 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1904938195 Oct 04 21:50:56.207210 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 21:50:56.207210 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 21:50:56.207210 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5516f39d751e41c2a225725f986c034b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_5516f39d751e41c2a225725f986c034b", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5516f39d751e41c2a225725f986c034b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/5516f39d751e41c2a225725f986c034b"}]}] Oct 04 21:50:56.207210 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1904938195 Oct 04 21:50:56.207210 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: 5516f39d751e41c2a225725f986c034b Oct 04 21:50:56.207210 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1904938195 Oct 04 21:50:56.207210 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1904938195-project Oct 04 21:50:56.207210 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 21:50:56.207210 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 21:50:56.207210 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 70d34373679649f1a353fe9bb7a962e9 Oct 04 21:50:56.207210 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1904938195-project Oct 04 21:50:56.207210 n-d-860284-1 devstack@n-api.service[134101]: Oct 04 21:50:56.207210 n-d-860284-1 devstack@n-api.service[134101]: {"security_group_rule": {"parent_group_id": "4bdd405c-26bf-4677-81b9-8222cbf9b27a", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 04 21:50:56.207210 n-d-860284-1 devstack@n-api.service[134101]: method: Oct 04 21:50:56.207210 n-d-860284-1 devstack@n-api.service[134101]: exception: Security group 4bdd405c-26bf-4677-81b9-8222cbf9b27a does not exist Oct 04 21:50:56.207210 n-d-860284-1 devstack@n-api.service[134101]: Neutron server returns request_ids: ['req-684fcdbf-dd67-4b18-852a-685184019c9a'] Oct 04 21:50:56.207210 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'body': {'security_group_rule': {'parent_group_id': '4bdd405c-26bf-4677-81b9-8222cbf9b27a', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 04 21:50:56.207210 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:50:56.207210 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:50:56.207210 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 04 21:50:56.207210 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 04 21:50:56.207210 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:50:56.207210 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:50:56.207210 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 04 21:50:56.207210 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 04 21:50:56.207210 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:50:56.207210 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:50:56.207210 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 21:50:56.207210 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 21:50:56.207210 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:50:56.207210 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:50:56.207210 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 21:50:56.207210 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 21:50:56.207210 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:50:56.207210 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:50:56.207210 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 21:50:56.207210 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 21:50:56.207210 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:50:56.207210 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:50:56.207210 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 21:50:56.207210 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 21:50:56.207210 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 21:50:56.212180 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 21:50:56.212180 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 4bdd405c-26bf-4677-81b9-8222cbf9b27a does not exist Oct 04 21:50:56.212180 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-684fcdbf-dd67-4b18-852a-685184019c9a'] Oct 04 21:50:56.212180 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:50:56.212180 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:50:56.212180 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:50:56.212180 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:50:56.212180 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create Oct 04 21:50:56.212180 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( Oct 04 21:50:56.212180 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 04 21:50:56.212180 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 21:50:56.212180 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 4bdd405c-26bf-4677-81b9-8222cbf9b27a does not exist Oct 04 21:50:56.212180 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-684fcdbf-dd67-4b18-852a-685184019c9a'] Oct 04 21:50:56.212180 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:50:56.212180 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:50:56.212180 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:50:56.212180 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:50:56.212180 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:50:56.212180 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:50:56.212180 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:50:56.212180 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:50:56.212180 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:50:56.212180 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:50:56.212180 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:50:56.212180 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:50:56.212180 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create Oct 04 21:50:56.212180 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 21:50:56.212180 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 4bdd405c-26bf-4677-81b9-8222cbf9b27a does not exist Oct 04 21:50:56.212180 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-684fcdbf-dd67-4b18-852a-685184019c9a'] Oct 04 21:50:56.212180 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:50:56.212180 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:50:56.212180 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:50:56.212180 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:50:56.212180 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:50:56.212180 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:50:56.212180 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:50:56.212180 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:50:56.212180 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 4bdd405c-26bf-4677-81b9-8222cbf9b27a does not exist Oct 04 21:50:56.212180 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-684fcdbf-dd67-4b18-852a-685184019c9a'] Oct 04 21:50:56.212180 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:50:56.212180 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-a3f9d8d0-266e-4268-924e-064e14eb87fa tempest-SecurityGroupRulesNegativeTestJSON-1904938195 tempest-SecurityGroupRulesNegativeTestJSON-1904938195-project] Returning 404 to user: Security group 4bdd405c-26bf-4677-81b9-8222cbf9b27a does not exist Oct 04 21:50:56.212180 n-d-860284-1 devstack@n-api.service[134101]: Neutron server returns request_ids: ['req-684fcdbf-dd67-4b18-852a-685184019c9a'] {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:50:56.223146 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-a3f9d8d0-266e-4268-924e-064e14eb87fa tempest-SecurityGroupRulesNegativeTestJSON-1904938195 tempest-SecurityGroupRulesNegativeTestJSON-1904938195-project] 10.222.0.43 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.076826 Oct 04 21:50:56.223146 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 916/1893] 10.222.0.43 () {60 vars in 1195 bytes} [Tue Oct 4 21:50:56 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:50:56.231772 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-3bd5e1b7-b12c-4b65-8a34-39339b1fb79a tempest-SecurityGroupRulesNegativeTestJSON-1904938195 tempest-SecurityGroupRulesNegativeTestJSON-1904938195-project] Calling method '.version_select at 0x7fbb372453a0>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:50:56.275025 n-d-860284-1 devstack@n-api.service[134101]: DEBUG neutronclient.v2_0.client [None req-3bd5e1b7-b12c-4b65-8a34-39339b1fb79a tempest-SecurityGroupRulesNegativeTestJSON-1904938195 tempest-SecurityGroupRulesNegativeTestJSON-1904938195-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule 733707ca-46d5-43b5-96fd-f43ed4740b63 does not exist", "detail": ""}} {{(pid=134101) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 21:50:56.278796 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.network.security_group_api [None req-3bd5e1b7-b12c-4b65-8a34-39339b1fb79a tempest-SecurityGroupRulesNegativeTestJSON-1904938195 tempest-SecurityGroupRulesNegativeTestJSON-1904938195-project] Neutron security group rule 733707ca-46d5-43b5-96fd-f43ed4740b63 not found {{(pid=134101) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Oct 04 21:50:56.291633 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-3bd5e1b7-b12c-4b65-8a34-39339b1fb79a tempest-SecurityGroupRulesNegativeTestJSON-1904938195 tempest-SecurityGroupRulesNegativeTestJSON-1904938195-project] HTTP exception thrown: Security group rule 733707ca-46d5-43b5-96fd-f43ed4740b63 does not exist Oct 04 21:50:56.291633 n-d-860284-1 devstack@n-api.service[134101]: Neutron server returns request_ids: ['req-c90f2591-c7ee-4c8b-b019-1f67c51b6c74'] Oct 04 21:50:56.293771 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-3bd5e1b7-b12c-4b65-8a34-39339b1fb79a tempest-SecurityGroupRulesNegativeTestJSON-1904938195 tempest-SecurityGroupRulesNegativeTestJSON-1904938195-project] Request method failure captured: Oct 04 21:50:56.293771 n-d-860284-1 devstack@n-api.service[134101]: request: DELETE /compute/v2.1/os-security-group-rules/733707ca-46d5-43b5-96fd-f43ed4740b63 HTTP/1.1 Oct 04 21:50:56.293771 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 21:50:56.293771 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 21:50:56.293771 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 21:50:56.293771 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 21:50:56.293771 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 21:50:56.293771 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 21:50:56.293771 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 21:50:56.293771 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 21:50:56.293771 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPKq0IsLz6MtzxymfmAA4T5LQGf2rcxkSRLwvGIY1f3-7_jBOHLPGHRC1D8HMnjABRyfrqMlOPxBYB7xFt5-ol3G2iacFQfDIClAItXLqJ3MRHsosGEh4_0o7TLbjlNtnZQXLLokdI_Muh3kOjxF1xyfn8csxDCNc9E-TR9UrTjfQcnY Oct 04 21:50:56.293771 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 21:50:56.293771 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 21:50:56.293771 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 21:50:56.293771 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 21:50:56.293771 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 21:50:56.293771 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 21:50:56.293771 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: 5516f39d751e41c2a225725f986c034b Oct 04 21:50:56.293771 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1904938195 Oct 04 21:50:56.293771 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 21:50:56.293771 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 21:50:56.293771 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5516f39d751e41c2a225725f986c034b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_5516f39d751e41c2a225725f986c034b", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5516f39d751e41c2a225725f986c034b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/5516f39d751e41c2a225725f986c034b"}]}] Oct 04 21:50:56.293771 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1904938195 Oct 04 21:50:56.293771 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: 5516f39d751e41c2a225725f986c034b Oct 04 21:50:56.293771 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1904938195 Oct 04 21:50:56.293771 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1904938195-project Oct 04 21:50:56.293771 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 21:50:56.293771 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 21:50:56.293771 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 70d34373679649f1a353fe9bb7a962e9 Oct 04 21:50:56.293771 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1904938195-project Oct 04 21:50:56.293771 n-d-860284-1 devstack@n-api.service[134101]: method: Oct 04 21:50:56.293771 n-d-860284-1 devstack@n-api.service[134101]: exception: Security group rule 733707ca-46d5-43b5-96fd-f43ed4740b63 does not exist Oct 04 21:50:56.293771 n-d-860284-1 devstack@n-api.service[134101]: Neutron server returns request_ids: ['req-c90f2591-c7ee-4c8b-b019-1f67c51b6c74'] Oct 04 21:50:56.293771 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': '733707ca-46d5-43b5-96fd-f43ed4740b63'} Oct 04 21:50:56.293771 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:50:56.293771 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:50:56.293771 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule Oct 04 21:50:56.293771 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( Oct 04 21:50:56.293771 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:50:56.293771 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:50:56.293771 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1092, in show_security_group_rule Oct 04 21:50:56.293771 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), Oct 04 21:50:56.293771 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:50:56.293771 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:50:56.293771 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 21:50:56.293771 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 21:50:56.293771 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:50:56.293771 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:50:56.293771 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 21:50:56.293771 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 21:50:56.293771 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:50:56.293771 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:50:56.293771 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 21:50:56.293771 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 21:50:56.293771 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:50:56.293771 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:50:56.293771 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 21:50:56.293771 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 21:50:56.293771 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 21:50:56.293771 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 21:50:56.299821 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule 733707ca-46d5-43b5-96fd-f43ed4740b63 does not exist Oct 04 21:50:56.299821 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c90f2591-c7ee-4c8b-b019-1f67c51b6c74'] Oct 04 21:50:56.299821 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:50:56.299821 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:50:56.299821 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:50:56.299821 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:50:56.299821 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete Oct 04 21:50:56.299821 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) Oct 04 21:50:56.299821 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule Oct 04 21:50:56.299821 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 21:50:56.299821 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule 733707ca-46d5-43b5-96fd-f43ed4740b63 does not exist Oct 04 21:50:56.299821 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c90f2591-c7ee-4c8b-b019-1f67c51b6c74'] Oct 04 21:50:56.299821 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:50:56.299821 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:50:56.299821 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:50:56.299821 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:50:56.299821 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:50:56.299821 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:50:56.299821 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:50:56.299821 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:50:56.299821 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:50:56.299821 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:50:56.299821 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:50:56.299821 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:50:56.299821 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete Oct 04 21:50:56.299821 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 21:50:56.299821 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule 733707ca-46d5-43b5-96fd-f43ed4740b63 does not exist Oct 04 21:50:56.299821 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c90f2591-c7ee-4c8b-b019-1f67c51b6c74'] Oct 04 21:50:56.299821 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:50:56.299821 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:50:56.299821 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:50:56.299821 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:50:56.299821 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:50:56.299821 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:50:56.299821 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:50:56.299821 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:50:56.299821 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule 733707ca-46d5-43b5-96fd-f43ed4740b63 does not exist Oct 04 21:50:56.299821 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c90f2591-c7ee-4c8b-b019-1f67c51b6c74'] Oct 04 21:50:56.299821 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:50:56.299821 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-3bd5e1b7-b12c-4b65-8a34-39339b1fb79a tempest-SecurityGroupRulesNegativeTestJSON-1904938195 tempest-SecurityGroupRulesNegativeTestJSON-1904938195-project] Returning 404 to user: Security group rule 733707ca-46d5-43b5-96fd-f43ed4740b63 does not exist Oct 04 21:50:56.299821 n-d-860284-1 devstack@n-api.service[134101]: Neutron server returns request_ids: ['req-c90f2591-c7ee-4c8b-b019-1f67c51b6c74'] {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:50:56.303404 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-3bd5e1b7-b12c-4b65-8a34-39339b1fb79a tempest-SecurityGroupRulesNegativeTestJSON-1904938195 tempest-SecurityGroupRulesNegativeTestJSON-1904938195-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-group-rules/733707ca-46d5-43b5-96fd-f43ed4740b63" status: 404 len: 199 microversion: 2.1 time: 0.076326 Oct 04 21:50:56.310392 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 917/1894] 10.222.0.43 () {58 vars in 1287 bytes} [Tue Oct 4 21:50:56 2022] DELETE /compute/v2.1/os-security-group-rules/733707ca-46d5-43b5-96fd-f43ed4740b63 => generated 199 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 21:50:56.318895 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-a79b4046-5653-40d2-bee2-e26ff86f72d9 tempest-SecurityGroupRulesNegativeTestJSON-1904938195 tempest-SecurityGroupRulesNegativeTestJSON-1904938195-project] Calling method '.version_select at 0x7fbb37373ca0>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:50:56.391933 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-7a6b21f0-bb05-4634-b71f-dd54980a11bf tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '301902a6e7bd419db1dc37123e2626aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fbc93887563467dba31d09e3803b962', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:56.410466 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-7a6b21f0-bb05-4634-b71f-dd54980a11bf tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '301902a6e7bd419db1dc37123e2626aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fbc93887563467dba31d09e3803b962', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:56.412047 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-7a6b21f0-bb05-4634-b71f-dd54980a11bf tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '301902a6e7bd419db1dc37123e2626aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fbc93887563467dba31d09e3803b962', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:56.413254 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-7a6b21f0-bb05-4634-b71f-dd54980a11bf tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] 10.222.0.43 "GET /compute/v2.1/servers/26a08c55-8019-43e6-aa28-fdf938ad0798" status: 200 len: 1317 microversion: 2.21 time: 0.284296 Oct 04 21:50:56.417506 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 978/1895] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:50:56 2022] GET /compute/v2.1/servers/26a08c55-8019-43e6-aa28-fdf938ad0798 => generated 1317 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:50:56.435707 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-7b5c8384-4cdb-4060-8adc-5a778425dae0 req-d1ae9c04-a9b0-429d-ad9f-9b4dd6249800 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f0a02bc-7993-4849-8b3c-7572327b4799", "tag": "c2e7099f-7aa9-4be4-9b2d-631622cf5151"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:50:56.458482 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-7b5c8384-4cdb-4060-8adc-5a778425dae0 req-d1ae9c04-a9b0-429d-ad9f-9b4dd6249800 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:56.461610 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-7b5c8384-4cdb-4060-8adc-5a778425dae0 req-d1ae9c04-a9b0-429d-ad9f-9b4dd6249800 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:56.462903 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-7b5c8384-4cdb-4060-8adc-5a778425dae0 req-d1ae9c04-a9b0-429d-ad9f-9b4dd6249800 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:56.496713 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-7b5c8384-4cdb-4060-8adc-5a778425dae0 req-d1ae9c04-a9b0-429d-ad9f-9b4dd6249800 service nova] Creating event network-changed:c2e7099f-7aa9-4be4-9b2d-631622cf5151 for instance 3f0a02bc-7993-4849-8b3c-7572327b4799 on n-h1-860284-1 Oct 04 21:50:56.505558 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-7b5c8384-4cdb-4060-8adc-5a778425dae0 req-d1ae9c04-a9b0-429d-ad9f-9b4dd6249800 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081342 Oct 04 21:50:56.506178 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 979/1896] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:50:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:50:56.511476 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-b27a2991-b822-4faa-a234-c570ab588b8e tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:50:56.512228 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-b27a2991-b822-4faa-a234-c570ab588b8e tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] [instance: 3f80e8f0-dba3-4403-83f8-0473c5d7d29b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:50:56.536275 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b27a2991-b822-4faa-a234-c570ab588b8e tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:56.536767 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b27a2991-b822-4faa-a234-c570ab588b8e tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:56.537205 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b27a2991-b822-4faa-a234-c570ab588b8e tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:56.537931 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b27a2991-b822-4faa-a234-c570ab588b8e tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:56.538415 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b27a2991-b822-4faa-a234-c570ab588b8e tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:56.538860 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b27a2991-b822-4faa-a234-c570ab588b8e tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:56.682770 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-a79b4046-5653-40d2-bee2-e26ff86f72d9 tempest-SecurityGroupRulesNegativeTestJSON-1904938195 tempest-SecurityGroupRulesNegativeTestJSON-1904938195-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/adf20219-f381-40b3-903b-ff746af79f57" status: 202 len: 0 microversion: 2.1 time: 0.367841 Oct 04 21:50:56.683701 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 918/1897] 10.222.0.43 () {58 vars in 1272 bytes} [Tue Oct 4 21:50:56 2022] DELETE /compute/v2.1/os-security-groups/adf20219-f381-40b3-903b-ff746af79f57 => generated 0 bytes in 370 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:50:56.689294 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-24ccad13-a12f-49e8-ab20-627a1cdf92af tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Calling method '.version_select at 0x7fbb37247f70>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:50:56.693389 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.objects.instance [None req-b27a2991-b822-4faa-a234-c570ab588b8e tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Lazy-loading 'services' on Instance uuid 3f80e8f0-dba3-4403-83f8-0473c5d7d29b {{(pid=134102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:50:56.717662 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:50:56.727906 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-b27a2991-b822-4faa-a234-c570ab588b8e tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/3f80e8f0-dba3-4403-83f8-0473c5d7d29b" status: 200 len: 1923 microversion: 2.75 time: 0.220415 Oct 04 21:50:56.738883 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 980/1898] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:50:56 2022] GET /compute/v2.1/servers/3f80e8f0-dba3-4403-83f8-0473c5d7d29b => generated 1923 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:50:56.755441 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-4ed2382e-25e8-4f37-9cb2-795143268ff4 tempest-SecurityGroupRulesNegativeTestJSON-1904938195 tempest-SecurityGroupRulesNegativeTestJSON-1904938195-project] Calling method '.version_select at 0x7fbb2fefd430>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:50:56.794796 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-24ccad13-a12f-49e8-ab20-627a1cdf92af tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] 10.222.0.43 "GET /compute/v2.1/images/349017f0-8dbe-442c-9dc1-9e60148db893" status: 200 len: 662 microversion: 2.1 time: 0.109808 Oct 04 21:50:56.806127 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 919/1899] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:50:56 2022] GET /compute/v2.1/images/349017f0-8dbe-442c-9dc1-9e60148db893 => generated 662 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:50:56.815607 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-9eba7512-4ed2-457b-b552-466f82a80df6 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Calling method '.version_select at 0x7fbb372ccaf0>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:50:56.901008 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-9eba7512-4ed2-457b-b552-466f82a80df6 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] 10.222.0.43 "GET /compute/v2.1/images/349017f0-8dbe-442c-9dc1-9e60148db893" status: 200 len: 662 microversion: 2.1 time: 0.093313 Oct 04 21:50:56.901550 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 920/1900] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:50:56 2022] GET /compute/v2.1/images/349017f0-8dbe-442c-9dc1-9e60148db893 => generated 662 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:50:56.965097 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-a6786031-32bf-4bab-b785-a2e61295a303 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:50:56.966056 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-a6786031-32bf-4bab-b785-a2e61295a303 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 3f0a02bc-7993-4849-8b3c-7572327b4799] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:50:56.980085 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a6786031-32bf-4bab-b785-a2e61295a303 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:56.980850 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a6786031-32bf-4bab-b785-a2e61295a303 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:56.982677 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a6786031-32bf-4bab-b785-a2e61295a303 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:56.985844 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a6786031-32bf-4bab-b785-a2e61295a303 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:56.986850 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a6786031-32bf-4bab-b785-a2e61295a303 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:56.987502 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a6786031-32bf-4bab-b785-a2e61295a303 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:57.217321 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-4ed2382e-25e8-4f37-9cb2-795143268ff4 tempest-SecurityGroupRulesNegativeTestJSON-1904938195 tempest-SecurityGroupRulesNegativeTestJSON-1904938195-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/7d103c28-dabd-4820-bc29-fb1cc824bf2c" status: 202 len: 0 microversion: 2.1 time: 0.467418 Oct 04 21:50:57.221503 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 981/1901] 10.222.0.43 () {58 vars in 1272 bytes} [Tue Oct 4 21:50:56 2022] DELETE /compute/v2.1/os-security-groups/7d103c28-dabd-4820-bc29-fb1cc824bf2c => generated 0 bytes in 479 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:50:57.224727 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-19abafb1-b1da-4fdd-b5e8-81756dfefd8d tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:50:57.225355 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-19abafb1-b1da-4fdd-b5e8-81756dfefd8d tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] [instance: 4709e5d7-52a3-4a79-8835-d651dce0c34a] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:50:57.243103 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-19abafb1-b1da-4fdd-b5e8-81756dfefd8d tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:57.243214 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-19abafb1-b1da-4fdd-b5e8-81756dfefd8d tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:57.243588 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-19abafb1-b1da-4fdd-b5e8-81756dfefd8d tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:57.244306 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-19abafb1-b1da-4fdd-b5e8-81756dfefd8d tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:57.247434 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-19abafb1-b1da-4fdd-b5e8-81756dfefd8d tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:57.249211 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-19abafb1-b1da-4fdd-b5e8-81756dfefd8d tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:57.270195 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-a6786031-32bf-4bab-b785-a2e61295a303 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ad048becf474fb972d4291422d810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dcfc7024fc49388c4bd5f25f03e60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:57.281091 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-a6786031-32bf-4bab-b785-a2e61295a303 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/3f0a02bc-7993-4849-8b3c-7572327b4799" status: 200 len: 1716 microversion: 2.1 time: 0.319143 Oct 04 21:50:57.296900 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 921/1902] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:50:56 2022] GET /compute/v2.1/servers/3f0a02bc-7993-4849-8b3c-7572327b4799 => generated 1716 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:50:57.305730 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-87db8fbb-2d4f-491b-b771-8127f920e8be tempest-SecurityGroupRulesNegativeTestJSON-1904938195 tempest-SecurityGroupRulesNegativeTestJSON-1904938195-project] Calling method '.version_select at 0x7fbb2e7853a0>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:50:57.542205 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-19abafb1-b1da-4fdd-b5e8-81756dfefd8d tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12f87ae29534b2c9171ee7b0dcab372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f529360dc1742a89d62a9fe42bc9848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:57.563791 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-19abafb1-b1da-4fdd-b5e8-81756dfefd8d tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] 10.222.0.43 "GET /compute/v2.1/servers/4709e5d7-52a3-4a79-8835-d651dce0c34a" status: 200 len: 1394 microversion: 2.1 time: 0.342062 Oct 04 21:50:57.566723 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 982/1903] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:50:57 2022] GET /compute/v2.1/servers/4709e5d7-52a3-4a79-8835-d651dce0c34a => generated 1394 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:50:57.581372 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-ada1325e-8f55-45b2-8aee-463a3675a2d1 tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:50:57.582345 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-ada1325e-8f55-45b2-8aee-463a3675a2d1 tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] [instance: 26a08c55-8019-43e6-aa28-fdf938ad0798] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:50:57.596390 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ada1325e-8f55-45b2-8aee-463a3675a2d1 tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:57.597565 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ada1325e-8f55-45b2-8aee-463a3675a2d1 tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:57.598020 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ada1325e-8f55-45b2-8aee-463a3675a2d1 tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:57.598899 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ada1325e-8f55-45b2-8aee-463a3675a2d1 tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:57.599357 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ada1325e-8f55-45b2-8aee-463a3675a2d1 tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:57.600103 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ada1325e-8f55-45b2-8aee-463a3675a2d1 tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:57.709183 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-87db8fbb-2d4f-491b-b771-8127f920e8be tempest-SecurityGroupRulesNegativeTestJSON-1904938195 tempest-SecurityGroupRulesNegativeTestJSON-1904938195-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/a6643927-874b-439b-8311-40bc00817920" status: 202 len: 0 microversion: 2.1 time: 0.410366 Oct 04 21:50:57.709773 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 922/1904] 10.222.0.43 () {58 vars in 1272 bytes} [Tue Oct 4 21:50:57 2022] DELETE /compute/v2.1/os-security-groups/a6643927-874b-439b-8311-40bc00817920 => generated 0 bytes in 412 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:50:57.719878 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-8d6f965b-2c0f-4735-9350-426fdc5d27f2 req-d94e7aea-9176-47fa-8584-458135ef8f0c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4709e5d7-52a3-4a79-8835-d651dce0c34a", "tag": "bacddb90-9e3c-4a64-91f2-f0a88b83fec1"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:50:57.754188 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-8d6f965b-2c0f-4735-9350-426fdc5d27f2 req-d94e7aea-9176-47fa-8584-458135ef8f0c service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:57.754735 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-8d6f965b-2c0f-4735-9350-426fdc5d27f2 req-d94e7aea-9176-47fa-8584-458135ef8f0c service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:57.755167 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-8d6f965b-2c0f-4735-9350-426fdc5d27f2 req-d94e7aea-9176-47fa-8584-458135ef8f0c service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:57.777616 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-8d6f965b-2c0f-4735-9350-426fdc5d27f2 req-d94e7aea-9176-47fa-8584-458135ef8f0c service nova] Creating event network-changed:bacddb90-9e3c-4a64-91f2-f0a88b83fec1 for instance 4709e5d7-52a3-4a79-8835-d651dce0c34a on n-h2-860284-1 Oct 04 21:50:57.784693 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-8d6f965b-2c0f-4735-9350-426fdc5d27f2 req-d94e7aea-9176-47fa-8584-458135ef8f0c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067478 Oct 04 21:50:57.787472 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 923/1905] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:50:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:50:57.815906 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-840839ce-557c-4031-a6ac-69e522a69db5 tempest-SecurityGroupRulesNegativeTestJSON-1904938195 tempest-SecurityGroupRulesNegativeTestJSON-1904938195-project] Calling method '.version_select at 0x7fbb372cf700>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:50:57.830492 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-ada1325e-8f55-45b2-8aee-463a3675a2d1 tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '301902a6e7bd419db1dc37123e2626aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fbc93887563467dba31d09e3803b962', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:57.843476 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-ada1325e-8f55-45b2-8aee-463a3675a2d1 tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '301902a6e7bd419db1dc37123e2626aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fbc93887563467dba31d09e3803b962', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:57.845855 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-ada1325e-8f55-45b2-8aee-463a3675a2d1 tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '301902a6e7bd419db1dc37123e2626aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fbc93887563467dba31d09e3803b962', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:57.847020 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-ada1325e-8f55-45b2-8aee-463a3675a2d1 tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] 10.222.0.43 "GET /compute/v2.1/servers/26a08c55-8019-43e6-aa28-fdf938ad0798" status: 200 len: 1359 microversion: 2.21 time: 0.279021 Oct 04 21:50:57.849802 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 983/1906] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:50:57 2022] GET /compute/v2.1/servers/26a08c55-8019-43e6-aa28-fdf938ad0798 => generated 1359 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:50:57.854625 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-e597fb54-e0ed-4a45-9972-1c82b6487e2e tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:50:57.855420 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-e597fb54-e0ed-4a45-9972-1c82b6487e2e tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] [instance: 3f80e8f0-dba3-4403-83f8-0473c5d7d29b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:50:57.871338 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e597fb54-e0ed-4a45-9972-1c82b6487e2e tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:57.872095 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e597fb54-e0ed-4a45-9972-1c82b6487e2e tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:57.872691 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e597fb54-e0ed-4a45-9972-1c82b6487e2e tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:57.873588 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e597fb54-e0ed-4a45-9972-1c82b6487e2e tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:57.874195 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e597fb54-e0ed-4a45-9972-1c82b6487e2e tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:57.874919 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e597fb54-e0ed-4a45-9972-1c82b6487e2e tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:58.041028 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.objects.instance [None req-e597fb54-e0ed-4a45-9972-1c82b6487e2e tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Lazy-loading 'services' on Instance uuid 3f80e8f0-dba3-4403-83f8-0473c5d7d29b {{(pid=134102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:50:58.079950 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-e597fb54-e0ed-4a45-9972-1c82b6487e2e tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/3f80e8f0-dba3-4403-83f8-0473c5d7d29b" status: 200 len: 1923 microversion: 2.75 time: 0.227932 Oct 04 21:50:58.081895 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 984/1907] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:50:57 2022] GET /compute/v2.1/servers/3f80e8f0-dba3-4403-83f8-0473c5d7d29b => generated 1923 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:50:58.282107 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-840839ce-557c-4031-a6ac-69e522a69db5 tempest-SecurityGroupRulesNegativeTestJSON-1904938195 tempest-SecurityGroupRulesNegativeTestJSON-1904938195-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/cbe723fc-b0bd-4263-9217-43e3e749d54c" status: 202 len: 0 microversion: 2.1 time: 0.492356 Oct 04 21:50:58.282852 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 924/1908] 10.222.0.43 () {58 vars in 1272 bytes} [Tue Oct 4 21:50:57 2022] DELETE /compute/v2.1/os-security-groups/cbe723fc-b0bd-4263-9217-43e3e749d54c => generated 0 bytes in 494 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:50:58.292372 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-835e6f45-9567-4740-9969-2def49b2c686 tempest-SecurityGroupRulesNegativeTestJSON-1904938195 tempest-SecurityGroupRulesNegativeTestJSON-1904938195-project] Calling method '.version_select at 0x7fbb37282310>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:50:58.312596 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-408a721a-9c9c-4767-b649-91e9669bab61 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:50:58.313927 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-408a721a-9c9c-4767-b649-91e9669bab61 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 3f0a02bc-7993-4849-8b3c-7572327b4799] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:50:58.322210 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-408a721a-9c9c-4767-b649-91e9669bab61 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:58.334712 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-408a721a-9c9c-4767-b649-91e9669bab61 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:58.335481 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-408a721a-9c9c-4767-b649-91e9669bab61 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:58.336453 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-408a721a-9c9c-4767-b649-91e9669bab61 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:58.337126 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-408a721a-9c9c-4767-b649-91e9669bab61 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:58.339091 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-408a721a-9c9c-4767-b649-91e9669bab61 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:58.645681 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-408a721a-9c9c-4767-b649-91e9669bab61 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ad048becf474fb972d4291422d810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dcfc7024fc49388c4bd5f25f03e60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:58.654582 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-408a721a-9c9c-4767-b649-91e9669bab61 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/3f0a02bc-7993-4849-8b3c-7572327b4799" status: 200 len: 1716 microversion: 2.1 time: 0.345788 Oct 04 21:50:58.670850 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 925/1909] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:50:58 2022] GET /compute/v2.1/servers/3f0a02bc-7993-4849-8b3c-7572327b4799 => generated 1716 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:50:58.676893 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-67224e74-82de-4f9e-bc41-bb9b3a09ef2e tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Calling method '.version_select at 0x7fbb37216f70>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:50:58.740780 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-835e6f45-9567-4740-9969-2def49b2c686 tempest-SecurityGroupRulesNegativeTestJSON-1904938195 tempest-SecurityGroupRulesNegativeTestJSON-1904938195-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/b1d18fc0-16c9-4b91-9127-0eea7a28006e" status: 202 len: 0 microversion: 2.1 time: 0.452744 Oct 04 21:50:58.742190 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 985/1910] 10.222.0.43 () {58 vars in 1272 bytes} [Tue Oct 4 21:50:58 2022] DELETE /compute/v2.1/os-security-groups/b1d18fc0-16c9-4b91-9127-0eea7a28006e => generated 0 bytes in 455 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:50:58.755746 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-d5dacf72-c7e4-479d-8942-babe706594b0 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:50:58.763072 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-d5dacf72-c7e4-479d-8942-babe706594b0 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] [instance: 4709e5d7-52a3-4a79-8835-d651dce0c34a] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:50:58.770515 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-67224e74-82de-4f9e-bc41-bb9b3a09ef2e tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] 10.222.0.43 "GET /compute/v2.1/images/c413939e-3abe-410c-9b8d-c22990ecc1b2" status: 200 len: 662 microversion: 2.1 time: 0.098346 Oct 04 21:50:58.773687 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 926/1911] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:50:58 2022] GET /compute/v2.1/images/c413939e-3abe-410c-9b8d-c22990ecc1b2 => generated 662 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:50:58.785185 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d5dacf72-c7e4-479d-8942-babe706594b0 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:58.786578 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d5dacf72-c7e4-479d-8942-babe706594b0 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:58.787711 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d5dacf72-c7e4-479d-8942-babe706594b0 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:58.788240 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-43fe04bd-477b-40bf-8067-3e53c638a734 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Calling method '.version_select at 0x7fbb2e78d550>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:50:58.789156 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d5dacf72-c7e4-479d-8942-babe706594b0 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:58.789950 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d5dacf72-c7e4-479d-8942-babe706594b0 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:58.791260 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d5dacf72-c7e4-479d-8942-babe706594b0 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:58.856970 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-43fe04bd-477b-40bf-8067-3e53c638a734 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] 10.222.0.43 "GET /compute/v2.1/images/c413939e-3abe-410c-9b8d-c22990ecc1b2" status: 200 len: 662 microversion: 2.1 time: 0.072991 Oct 04 21:50:58.858001 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 927/1912] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:50:58 2022] GET /compute/v2.1/images/c413939e-3abe-410c-9b8d-c22990ecc1b2 => generated 662 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:50:58.877161 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-111536cf-cc21-4a5b-a057-d574d9b2cd80 tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:50:58.878480 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-111536cf-cc21-4a5b-a057-d574d9b2cd80 tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] [instance: 26a08c55-8019-43e6-aa28-fdf938ad0798] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:50:58.888062 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-111536cf-cc21-4a5b-a057-d574d9b2cd80 tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:58.889207 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-111536cf-cc21-4a5b-a057-d574d9b2cd80 tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:58.889992 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-111536cf-cc21-4a5b-a057-d574d9b2cd80 tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:58.893573 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-111536cf-cc21-4a5b-a057-d574d9b2cd80 tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:58.894902 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-111536cf-cc21-4a5b-a057-d574d9b2cd80 tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:58.895659 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-111536cf-cc21-4a5b-a057-d574d9b2cd80 tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:59.356447 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-111536cf-cc21-4a5b-a057-d574d9b2cd80 tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '301902a6e7bd419db1dc37123e2626aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fbc93887563467dba31d09e3803b962', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:59.382014 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-111536cf-cc21-4a5b-a057-d574d9b2cd80 tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '301902a6e7bd419db1dc37123e2626aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fbc93887563467dba31d09e3803b962', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:59.386494 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-111536cf-cc21-4a5b-a057-d574d9b2cd80 tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '301902a6e7bd419db1dc37123e2626aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fbc93887563467dba31d09e3803b962', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:59.388002 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-111536cf-cc21-4a5b-a057-d574d9b2cd80 tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] 10.222.0.43 "GET /compute/v2.1/servers/26a08c55-8019-43e6-aa28-fdf938ad0798" status: 200 len: 1359 microversion: 2.21 time: 0.514822 Oct 04 21:50:59.389004 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 928/1913] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:50:58 2022] GET /compute/v2.1/servers/26a08c55-8019-43e6-aa28-fdf938ad0798 => generated 1359 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:50:59.394276 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-053bf3be-b89a-4356-9dd0-cbf468c0341a tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:50:59.395439 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-053bf3be-b89a-4356-9dd0-cbf468c0341a tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] [instance: 3f80e8f0-dba3-4403-83f8-0473c5d7d29b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:50:59.405550 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-053bf3be-b89a-4356-9dd0-cbf468c0341a tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:59.407227 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-053bf3be-b89a-4356-9dd0-cbf468c0341a tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:59.407946 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-d5dacf72-c7e4-479d-8942-babe706594b0 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12f87ae29534b2c9171ee7b0dcab372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f529360dc1742a89d62a9fe42bc9848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:59.408389 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-053bf3be-b89a-4356-9dd0-cbf468c0341a tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:59.409364 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-053bf3be-b89a-4356-9dd0-cbf468c0341a tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:59.409852 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-053bf3be-b89a-4356-9dd0-cbf468c0341a tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:59.410836 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-053bf3be-b89a-4356-9dd0-cbf468c0341a tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:59.419528 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-d5dacf72-c7e4-479d-8942-babe706594b0 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] 10.222.0.43 "GET /compute/v2.1/servers/4709e5d7-52a3-4a79-8835-d651dce0c34a" status: 200 len: 1394 microversion: 2.1 time: 0.671932 Oct 04 21:50:59.421177 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 986/1914] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:50:58 2022] GET /compute/v2.1/servers/4709e5d7-52a3-4a79-8835-d651dce0c34a => generated 1394 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:50:59.647101 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.objects.instance [None req-053bf3be-b89a-4356-9dd0-cbf468c0341a tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Lazy-loading 'services' on Instance uuid 3f80e8f0-dba3-4403-83f8-0473c5d7d29b {{(pid=134101) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:50:59.685194 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-cb8a4d74-8106-4f02-9439-81366558f2db tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:50:59.686255 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-cb8a4d74-8106-4f02-9439-81366558f2db tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 3f0a02bc-7993-4849-8b3c-7572327b4799] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:50:59.697622 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-053bf3be-b89a-4356-9dd0-cbf468c0341a tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/3f80e8f0-dba3-4403-83f8-0473c5d7d29b" status: 200 len: 1923 microversion: 2.75 time: 0.307070 Oct 04 21:50:59.713839 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 929/1915] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:50:59 2022] GET /compute/v2.1/servers/3f80e8f0-dba3-4403-83f8-0473c5d7d29b => generated 1923 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:50:59.740099 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cb8a4d74-8106-4f02-9439-81366558f2db tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:59.740998 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cb8a4d74-8106-4f02-9439-81366558f2db tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:59.741836 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cb8a4d74-8106-4f02-9439-81366558f2db tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:59.744365 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cb8a4d74-8106-4f02-9439-81366558f2db tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:59.745370 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cb8a4d74-8106-4f02-9439-81366558f2db tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:59.748139 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cb8a4d74-8106-4f02-9439-81366558f2db tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:59.821912 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-b383c86b-57c5-433c-b7b9-58a6cf26c190 req-4cbce4e8-0836-4d7b-a07d-e56ab2f87876 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26a08c55-8019-43e6-aa28-fdf938ad0798", "tag": "d8a8ee90-a00c-4ea8-af05-ce15a6a5f49e"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:50:59.834614 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-b383c86b-57c5-433c-b7b9-58a6cf26c190 req-4cbce4e8-0836-4d7b-a07d-e56ab2f87876 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:59.836969 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-b383c86b-57c5-433c-b7b9-58a6cf26c190 req-4cbce4e8-0836-4d7b-a07d-e56ab2f87876 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:59.837649 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-b383c86b-57c5-433c-b7b9-58a6cf26c190 req-4cbce4e8-0836-4d7b-a07d-e56ab2f87876 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:59.851648 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-b383c86b-57c5-433c-b7b9-58a6cf26c190 req-4cbce4e8-0836-4d7b-a07d-e56ab2f87876 service nova] Creating event network-changed:d8a8ee90-a00c-4ea8-af05-ce15a6a5f49e for instance 26a08c55-8019-43e6-aa28-fdf938ad0798 on n-h1-860284-1 Oct 04 21:50:59.860226 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-b383c86b-57c5-433c-b7b9-58a6cf26c190 req-4cbce4e8-0836-4d7b-a07d-e56ab2f87876 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041911 Oct 04 21:50:59.861805 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 930/1916] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:50:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:51:00.056986 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-cb8a4d74-8106-4f02-9439-81366558f2db tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ad048becf474fb972d4291422d810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dcfc7024fc49388c4bd5f25f03e60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:00.069412 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-cb8a4d74-8106-4f02-9439-81366558f2db tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/3f0a02bc-7993-4849-8b3c-7572327b4799" status: 200 len: 1716 microversion: 2.1 time: 0.389617 Oct 04 21:51:00.070326 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 987/1917] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:50:59 2022] GET /compute/v2.1/servers/3f0a02bc-7993-4849-8b3c-7572327b4799 => generated 1716 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:51:00.371425 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-3896b497-ba1d-46f0-8722-f58adf22d38b tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Calling method '.version_select at 0x7fbb2e7ee790>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:00.414705 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-51d2ba26-241f-429e-bbe9-0fe982731d66 tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:00.415983 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-51d2ba26-241f-429e-bbe9-0fe982731d66 tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] [instance: 26a08c55-8019-43e6-aa28-fdf938ad0798] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:00.424611 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-51d2ba26-241f-429e-bbe9-0fe982731d66 tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:00.425476 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-51d2ba26-241f-429e-bbe9-0fe982731d66 tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:00.426117 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-51d2ba26-241f-429e-bbe9-0fe982731d66 tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:00.427203 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-51d2ba26-241f-429e-bbe9-0fe982731d66 tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:00.427605 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-51d2ba26-241f-429e-bbe9-0fe982731d66 tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:00.428110 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-51d2ba26-241f-429e-bbe9-0fe982731d66 tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:00.441254 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-3896b497-ba1d-46f0-8722-f58adf22d38b tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] 10.222.0.43 "GET /compute/v2.1/images/6c120060-4737-4dc9-aaac-e8a598761714" status: 200 len: 662 microversion: 2.1 time: 0.074988 Oct 04 21:51:00.442473 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 931/1918] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:51:00 2022] GET /compute/v2.1/images/6c120060-4737-4dc9-aaac-e8a598761714 => generated 662 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:51:00.447927 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-abe52c85-f868-487e-aa73-728e500e5ef1 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:00.448859 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-abe52c85-f868-487e-aa73-728e500e5ef1 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] [instance: 4709e5d7-52a3-4a79-8835-d651dce0c34a] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:00.457018 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-abe52c85-f868-487e-aa73-728e500e5ef1 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:00.457795 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-abe52c85-f868-487e-aa73-728e500e5ef1 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:00.458468 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-abe52c85-f868-487e-aa73-728e500e5ef1 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:00.459374 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-abe52c85-f868-487e-aa73-728e500e5ef1 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:00.460002 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-abe52c85-f868-487e-aa73-728e500e5ef1 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:00.461081 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-abe52c85-f868-487e-aa73-728e500e5ef1 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:00.794207 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-abe52c85-f868-487e-aa73-728e500e5ef1 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12f87ae29534b2c9171ee7b0dcab372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f529360dc1742a89d62a9fe42bc9848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:00.797439 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-51d2ba26-241f-429e-bbe9-0fe982731d66 tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '301902a6e7bd419db1dc37123e2626aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fbc93887563467dba31d09e3803b962', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:00.804566 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-abe52c85-f868-487e-aa73-728e500e5ef1 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] 10.222.0.43 "GET /compute/v2.1/servers/4709e5d7-52a3-4a79-8835-d651dce0c34a" status: 200 len: 1394 microversion: 2.1 time: 0.360785 Oct 04 21:51:00.808905 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-51d2ba26-241f-429e-bbe9-0fe982731d66 tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '301902a6e7bd419db1dc37123e2626aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fbc93887563467dba31d09e3803b962', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:00.810352 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-51d2ba26-241f-429e-bbe9-0fe982731d66 tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '301902a6e7bd419db1dc37123e2626aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fbc93887563467dba31d09e3803b962', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:00.811577 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-51d2ba26-241f-429e-bbe9-0fe982731d66 tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] 10.222.0.43 "GET /compute/v2.1/servers/26a08c55-8019-43e6-aa28-fdf938ad0798" status: 200 len: 1359 microversion: 2.21 time: 0.400835 Oct 04 21:51:00.812139 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 988/1919] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:51:00 2022] GET /compute/v2.1/servers/26a08c55-8019-43e6-aa28-fdf938ad0798 => generated 1359 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:51:00.818191 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-fa83c555-ff99-429a-876e-79cdeed9d603 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Calling method '.version_select at 0x7fbb2e9f41f0>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:00.819008 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 932/1920] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:51:00 2022] GET /compute/v2.1/servers/4709e5d7-52a3-4a79-8835-d651dce0c34a => generated 1394 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:51:00.834792 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-2d27ce69-2985-484a-8085-3e34d5d2bd71 tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:00.835454 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-2d27ce69-2985-484a-8085-3e34d5d2bd71 tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] [instance: 3f80e8f0-dba3-4403-83f8-0473c5d7d29b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:00.841964 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2d27ce69-2985-484a-8085-3e34d5d2bd71 tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:00.842750 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2d27ce69-2985-484a-8085-3e34d5d2bd71 tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:00.843196 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2d27ce69-2985-484a-8085-3e34d5d2bd71 tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:00.844733 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2d27ce69-2985-484a-8085-3e34d5d2bd71 tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:00.845816 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2d27ce69-2985-484a-8085-3e34d5d2bd71 tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:00.846273 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2d27ce69-2985-484a-8085-3e34d5d2bd71 tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:00.871146 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=100 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:51:00.875331 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-fa83c555-ff99-429a-876e-79cdeed9d603 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] 10.222.0.43 "GET /compute/v2.1/images/6c120060-4737-4dc9-aaac-e8a598761714" status: 200 len: 662 microversion: 2.1 time: 0.060846 Oct 04 21:51:00.876164 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 989/1921] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:51:00 2022] GET /compute/v2.1/images/6c120060-4737-4dc9-aaac-e8a598761714 => generated 662 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:51:00.939214 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-7b745fb9-f669-440c-ae5c-262436389954 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-474660377", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452"}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:51:00.959872 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.objects.instance [None req-2d27ce69-2985-484a-8085-3e34d5d2bd71 tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Lazy-loading 'services' on Instance uuid 3f80e8f0-dba3-4403-83f8-0473c5d7d29b {{(pid=134101) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:51:00.980221 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-2d27ce69-2985-484a-8085-3e34d5d2bd71 tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/3f80e8f0-dba3-4403-83f8-0473c5d7d29b" status: 200 len: 1923 microversion: 2.75 time: 0.159935 Oct 04 21:51:00.982843 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 933/1922] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:51:00 2022] GET /compute/v2.1/servers/3f80e8f0-dba3-4403-83f8-0473c5d7d29b => generated 1923 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:51:01.012505 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.network.neutron [None req-7b745fb9-f669-440c-ae5c-262436389954 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] validate_networks() for None {{(pid=134102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:51:01.108404 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-cdedd3b8-2630-4c12-9029-775a8eeab603 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:01.108745 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell0:SELECT=4 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:51:01.109349 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-cdedd3b8-2630-4c12-9029-775a8eeab603 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 3f0a02bc-7993-4849-8b3c-7572327b4799] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:01.125058 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cdedd3b8-2630-4c12-9029-775a8eeab603 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:01.126451 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cdedd3b8-2630-4c12-9029-775a8eeab603 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:01.126899 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cdedd3b8-2630-4c12-9029-775a8eeab603 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:01.127919 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cdedd3b8-2630-4c12-9029-775a8eeab603 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:01.135682 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cdedd3b8-2630-4c12-9029-775a8eeab603 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:01.136151 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cdedd3b8-2630-4c12-9029-775a8eeab603 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:01.237550 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell0:SELECT=22 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:51:01.400691 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-cdedd3b8-2630-4c12-9029-775a8eeab603 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ad048becf474fb972d4291422d810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dcfc7024fc49388c4bd5f25f03e60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:01.414034 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-cdedd3b8-2630-4c12-9029-775a8eeab603 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/3f0a02bc-7993-4849-8b3c-7572327b4799" status: 200 len: 1716 microversion: 2.1 time: 0.317331 Oct 04 21:51:01.415474 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 934/1923] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:51:01 2022] GET /compute/v2.1/servers/3f0a02bc-7993-4849-8b3c-7572327b4799 => generated 1716 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:51:01.475713 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-7b745fb9-f669-440c-ae5c-262436389954 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Flavor limits 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:51:01.476410 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-7b745fb9-f669-440c-ae5c-262436389954 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Image limits 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:51:01.477111 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-7b745fb9-f669-440c-ae5c-262436389954 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Flavor pref 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:51:01.479028 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-7b745fb9-f669-440c-ae5c-262436389954 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Image pref 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:51:01.480129 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-7b745fb9-f669-440c-ae5c-262436389954 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:51:01.495988 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7b745fb9-f669-440c-ae5c-262436389954 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:01.496734 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7b745fb9-f669-440c-ae5c-262436389954 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:01.497387 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7b745fb9-f669-440c-ae5c-262436389954 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:01.498479 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7b745fb9-f669-440c-ae5c-262436389954 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:01.499451 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7b745fb9-f669-440c-ae5c-262436389954 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:01.500163 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7b745fb9-f669-440c-ae5c-262436389954 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:01.562104 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-7b745fb9-f669-440c-ae5c-262436389954 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Getting quotas for project 94d03be22238422eba835ed522baf9c3. Resources: {'instances', 'ram', 'cores'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:51:01.569275 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-7b745fb9-f669-440c-ae5c-262436389954 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Getting quotas for user 47f11c77afc74a16bea945dd84e72ebe and project 94d03be22238422eba835ed522baf9c3. Resources: {'instances', 'ram', 'cores'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:51:01.586480 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-7b745fb9-f669-440c-ae5c-262436389954 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Going to run 1 instances... {{(pid=134102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:51:01.589161 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-7b745fb9-f669-440c-ae5c-262436389954 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] [instance: 6f8a46c4-3b6f-4f50-8227-77b69154fb57] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='58548514-5dac-426c-81f5-19e3fba33e23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:51:01.650793 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-7b745fb9-f669-440c-ae5c-262436389954 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.716568 Oct 04 21:51:01.662978 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 990/1924] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 21:51:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 718 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 21:51:01.724707 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-16a6b420-38e7-4d97-870e-bd5921f81e50 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1770480877", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:51:01.835023 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-59b1f408-9a74-44dd-aab2-16d681827bb1 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:01.836691 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.network.neutron [None req-16a6b420-38e7-4d97-870e-bd5921f81e50 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] validate_networks() for None {{(pid=134101) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:51:01.840900 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-59b1f408-9a74-44dd-aab2-16d681827bb1 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] [instance: 4709e5d7-52a3-4a79-8835-d651dce0c34a] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:01.865522 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-59b1f408-9a74-44dd-aab2-16d681827bb1 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:01.872261 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-59b1f408-9a74-44dd-aab2-16d681827bb1 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:01.873015 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-59b1f408-9a74-44dd-aab2-16d681827bb1 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:01.873954 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-59b1f408-9a74-44dd-aab2-16d681827bb1 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:01.874648 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-59b1f408-9a74-44dd-aab2-16d681827bb1 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:01.875865 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-59b1f408-9a74-44dd-aab2-16d681827bb1 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:02.082436 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=2 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:51:02.250908 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-59b1f408-9a74-44dd-aab2-16d681827bb1 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12f87ae29534b2c9171ee7b0dcab372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f529360dc1742a89d62a9fe42bc9848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:02.269002 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-59b1f408-9a74-44dd-aab2-16d681827bb1 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] 10.222.0.43 "GET /compute/v2.1/servers/4709e5d7-52a3-4a79-8835-d651dce0c34a" status: 200 len: 1394 microversion: 2.1 time: 0.441793 Oct 04 21:51:02.284777 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 991/1925] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:51:01 2022] GET /compute/v2.1/servers/4709e5d7-52a3-4a79-8835-d651dce0c34a => generated 1394 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:51:02.297798 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-3ee39609-6640-4fa6-985f-28aae653c2de tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:02.298740 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-3ee39609-6640-4fa6-985f-28aae653c2de tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] [instance: 26a08c55-8019-43e6-aa28-fdf938ad0798] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:02.314287 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-16a6b420-38e7-4d97-870e-bd5921f81e50 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Flavor limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:51:02.315201 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-16a6b420-38e7-4d97-870e-bd5921f81e50 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Image limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:51:02.315688 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-16a6b420-38e7-4d97-870e-bd5921f81e50 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Flavor pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:51:02.316097 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-16a6b420-38e7-4d97-870e-bd5921f81e50 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Image pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:51:02.316672 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-16a6b420-38e7-4d97-870e-bd5921f81e50 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:51:02.331095 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3ee39609-6640-4fa6-985f-28aae653c2de tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:02.331590 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3ee39609-6640-4fa6-985f-28aae653c2de tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:02.331959 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3ee39609-6640-4fa6-985f-28aae653c2de tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:02.334584 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3ee39609-6640-4fa6-985f-28aae653c2de tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:02.334584 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3ee39609-6640-4fa6-985f-28aae653c2de tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:02.334584 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3ee39609-6640-4fa6-985f-28aae653c2de tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:02.341857 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-16a6b420-38e7-4d97-870e-bd5921f81e50 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:02.343034 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-16a6b420-38e7-4d97-870e-bd5921f81e50 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:02.343480 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-16a6b420-38e7-4d97-870e-bd5921f81e50 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:02.348397 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-16a6b420-38e7-4d97-870e-bd5921f81e50 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:02.351713 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-16a6b420-38e7-4d97-870e-bd5921f81e50 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:02.352238 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-16a6b420-38e7-4d97-870e-bd5921f81e50 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:02.406463 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-16a6b420-38e7-4d97-870e-bd5921f81e50 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Getting quotas for project 94d03be22238422eba835ed522baf9c3. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:51:02.421063 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-16a6b420-38e7-4d97-870e-bd5921f81e50 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Getting quotas for user 47f11c77afc74a16bea945dd84e72ebe and project 94d03be22238422eba835ed522baf9c3. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:51:02.490722 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-16a6b420-38e7-4d97-870e-bd5921f81e50 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Going to run 1 instances... {{(pid=134101) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:51:02.506591 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-16a6b420-38e7-4d97-870e-bd5921f81e50 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] [instance: 7d0ed6d0-981a-48a7-a676-5910b1257301] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='58548514-5dac-426c-81f5-19e3fba33e23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134101) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:51:02.683011 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-16a6b420-38e7-4d97-870e-bd5921f81e50 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.962224 Oct 04 21:51:02.684417 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 935/1926] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 21:51:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 964 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:51:02.691636 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-ada39cc6-4671-4623-add3-c56b9f80ad4e tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:02.692664 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-ada39cc6-4671-4623-add3-c56b9f80ad4e tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] [instance: 3f80e8f0-dba3-4403-83f8-0473c5d7d29b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:02.701368 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ada39cc6-4671-4623-add3-c56b9f80ad4e tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:02.702196 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ada39cc6-4671-4623-add3-c56b9f80ad4e tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:02.703404 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ada39cc6-4671-4623-add3-c56b9f80ad4e tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:02.704944 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ada39cc6-4671-4623-add3-c56b9f80ad4e tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:02.706104 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ada39cc6-4671-4623-add3-c56b9f80ad4e tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:02.707381 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ada39cc6-4671-4623-add3-c56b9f80ad4e tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:02.756317 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-3ee39609-6640-4fa6-985f-28aae653c2de tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '301902a6e7bd419db1dc37123e2626aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fbc93887563467dba31d09e3803b962', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:02.769360 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-3ee39609-6640-4fa6-985f-28aae653c2de tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '301902a6e7bd419db1dc37123e2626aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fbc93887563467dba31d09e3803b962', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:02.804299 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-3ee39609-6640-4fa6-985f-28aae653c2de tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '301902a6e7bd419db1dc37123e2626aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fbc93887563467dba31d09e3803b962', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:02.821260 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-3ee39609-6640-4fa6-985f-28aae653c2de tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] 10.222.0.43 "GET /compute/v2.1/servers/26a08c55-8019-43e6-aa28-fdf938ad0798" status: 200 len: 1359 microversion: 2.21 time: 0.534814 Oct 04 21:51:02.822619 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 992/1927] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:51:02 2022] GET /compute/v2.1/servers/26a08c55-8019-43e6-aa28-fdf938ad0798 => generated 1359 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:51:02.855442 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-be400115-e414-4d9e-a6b7-670a11c5c92c tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:02.856197 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-be400115-e414-4d9e-a6b7-670a11c5c92c tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 3f0a02bc-7993-4849-8b3c-7572327b4799] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:02.869859 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-be400115-e414-4d9e-a6b7-670a11c5c92c tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:02.870954 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-be400115-e414-4d9e-a6b7-670a11c5c92c tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:02.881210 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-be400115-e414-4d9e-a6b7-670a11c5c92c tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:02.882277 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-be400115-e414-4d9e-a6b7-670a11c5c92c tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:02.883038 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-be400115-e414-4d9e-a6b7-670a11c5c92c tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:02.883659 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-be400115-e414-4d9e-a6b7-670a11c5c92c tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:02.914800 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.objects.instance [None req-ada39cc6-4671-4623-add3-c56b9f80ad4e tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Lazy-loading 'services' on Instance uuid 3f80e8f0-dba3-4403-83f8-0473c5d7d29b {{(pid=134101) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:51:02.962446 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-ada39cc6-4671-4623-add3-c56b9f80ad4e tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/3f80e8f0-dba3-4403-83f8-0473c5d7d29b" status: 200 len: 1923 microversion: 2.75 time: 0.276532 Oct 04 21:51:02.963183 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 936/1928] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:51:02 2022] GET /compute/v2.1/servers/3f80e8f0-dba3-4403-83f8-0473c5d7d29b => generated 1923 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:51:02.987316 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-86808d85-5484-4216-8ce9-a02e76d76b0a tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:02.988433 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-86808d85-5484-4216-8ce9-a02e76d76b0a tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] [instance: 7d0ed6d0-981a-48a7-a676-5910b1257301] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:03.084581 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-86808d85-5484-4216-8ce9-a02e76d76b0a tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f11c77afc74a16bea945dd84e72ebe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94d03be22238422eba835ed522baf9c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:03.103436 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-86808d85-5484-4216-8ce9-a02e76d76b0a tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] 10.222.0.43 "GET /compute/v2.1/servers/7d0ed6d0-981a-48a7-a676-5910b1257301" status: 200 len: 1218 microversion: 2.1 time: 0.138694 Oct 04 21:51:03.118912 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 937/1929] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:51:02 2022] GET /compute/v2.1/servers/7d0ed6d0-981a-48a7-a676-5910b1257301 => generated 1218 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:51:03.191724 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-be400115-e414-4d9e-a6b7-670a11c5c92c tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ad048becf474fb972d4291422d810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dcfc7024fc49388c4bd5f25f03e60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:03.201370 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-be400115-e414-4d9e-a6b7-670a11c5c92c tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/3f0a02bc-7993-4849-8b3c-7572327b4799" status: 200 len: 1716 microversion: 2.1 time: 0.377397 Oct 04 21:51:03.202308 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 993/1930] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:51:02 2022] GET /compute/v2.1/servers/3f0a02bc-7993-4849-8b3c-7572327b4799 => generated 1716 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:51:03.291466 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-2b7c8ccc-de3d-4947-852d-1b8843c60b22 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:03.292080 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-2b7c8ccc-de3d-4947-852d-1b8843c60b22 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] [instance: 4709e5d7-52a3-4a79-8835-d651dce0c34a] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:03.300879 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2b7c8ccc-de3d-4947-852d-1b8843c60b22 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:03.301739 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2b7c8ccc-de3d-4947-852d-1b8843c60b22 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:03.302820 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2b7c8ccc-de3d-4947-852d-1b8843c60b22 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:03.306877 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2b7c8ccc-de3d-4947-852d-1b8843c60b22 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:03.308091 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2b7c8ccc-de3d-4947-852d-1b8843c60b22 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:03.309435 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2b7c8ccc-de3d-4947-852d-1b8843c60b22 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:03.605788 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-2b7c8ccc-de3d-4947-852d-1b8843c60b22 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12f87ae29534b2c9171ee7b0dcab372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f529360dc1742a89d62a9fe42bc9848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:03.617302 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-2b7c8ccc-de3d-4947-852d-1b8843c60b22 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] 10.222.0.43 "GET /compute/v2.1/servers/4709e5d7-52a3-4a79-8835-d651dce0c34a" status: 200 len: 1394 microversion: 2.1 time: 0.330457 Oct 04 21:51:03.618779 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 938/1931] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:51:03 2022] GET /compute/v2.1/servers/4709e5d7-52a3-4a79-8835-d651dce0c34a => generated 1394 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:51:03.848688 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-c1941494-d178-421f-b952-cfbf281a6ff2 tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:03.849648 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-c1941494-d178-421f-b952-cfbf281a6ff2 tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] [instance: 26a08c55-8019-43e6-aa28-fdf938ad0798] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:03.862463 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c1941494-d178-421f-b952-cfbf281a6ff2 tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:03.867048 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c1941494-d178-421f-b952-cfbf281a6ff2 tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:03.869012 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c1941494-d178-421f-b952-cfbf281a6ff2 tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:03.869960 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c1941494-d178-421f-b952-cfbf281a6ff2 tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:03.872325 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c1941494-d178-421f-b952-cfbf281a6ff2 tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:03.872998 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c1941494-d178-421f-b952-cfbf281a6ff2 tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:03.994152 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-3660ac79-fadf-4668-9c2e-3f5b62f00ef8 tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:03.995081 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-3660ac79-fadf-4668-9c2e-3f5b62f00ef8 tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] [instance: 3f80e8f0-dba3-4403-83f8-0473c5d7d29b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:04.001826 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:51:04.026422 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3660ac79-fadf-4668-9c2e-3f5b62f00ef8 tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:04.028906 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3660ac79-fadf-4668-9c2e-3f5b62f00ef8 tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:04.040077 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3660ac79-fadf-4668-9c2e-3f5b62f00ef8 tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:04.043877 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3660ac79-fadf-4668-9c2e-3f5b62f00ef8 tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:04.044545 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3660ac79-fadf-4668-9c2e-3f5b62f00ef8 tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:04.045111 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3660ac79-fadf-4668-9c2e-3f5b62f00ef8 tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:04.650839 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.objects.instance [None req-3660ac79-fadf-4668-9c2e-3f5b62f00ef8 tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Lazy-loading 'services' on Instance uuid 3f80e8f0-dba3-4403-83f8-0473c5d7d29b {{(pid=134101) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:51:04.731026 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-3660ac79-fadf-4668-9c2e-3f5b62f00ef8 tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/3f80e8f0-dba3-4403-83f8-0473c5d7d29b" status: 200 len: 1923 microversion: 2.75 time: 0.742333 Oct 04 21:51:04.733785 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 939/1932] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:51:03 2022] GET /compute/v2.1/servers/3f80e8f0-dba3-4403-83f8-0473c5d7d29b => generated 1923 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:51:04.747154 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-255128e4-c28c-421f-9d04-858e73ed2486 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:04.749348 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-255128e4-c28c-421f-9d04-858e73ed2486 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] [instance: 7d0ed6d0-981a-48a7-a676-5910b1257301] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:04.760719 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-255128e4-c28c-421f-9d04-858e73ed2486 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:04.761497 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-255128e4-c28c-421f-9d04-858e73ed2486 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:04.762108 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-255128e4-c28c-421f-9d04-858e73ed2486 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:04.763015 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-255128e4-c28c-421f-9d04-858e73ed2486 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:04.763690 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-255128e4-c28c-421f-9d04-858e73ed2486 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:04.764316 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-255128e4-c28c-421f-9d04-858e73ed2486 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:04.936983 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-255128e4-c28c-421f-9d04-858e73ed2486 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f11c77afc74a16bea945dd84e72ebe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94d03be22238422eba835ed522baf9c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:04.951192 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-255128e4-c28c-421f-9d04-858e73ed2486 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] 10.222.0.43 "GET /compute/v2.1/servers/7d0ed6d0-981a-48a7-a676-5910b1257301" status: 200 len: 1270 microversion: 2.1 time: 0.213867 Oct 04 21:51:04.953939 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 940/1933] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:51:04 2022] GET /compute/v2.1/servers/7d0ed6d0-981a-48a7-a676-5910b1257301 => generated 1270 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:51:04.972650 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e28b2487-a300-4d4a-ae83-2e4e47cad580 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:04.973640 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-e28b2487-a300-4d4a-ae83-2e4e47cad580 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 3f0a02bc-7993-4849-8b3c-7572327b4799] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:04.980877 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-c1941494-d178-421f-b952-cfbf281a6ff2 tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '301902a6e7bd419db1dc37123e2626aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fbc93887563467dba31d09e3803b962', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:04.991074 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e28b2487-a300-4d4a-ae83-2e4e47cad580 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:04.991633 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e28b2487-a300-4d4a-ae83-2e4e47cad580 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:04.994201 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e28b2487-a300-4d4a-ae83-2e4e47cad580 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:04.995026 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e28b2487-a300-4d4a-ae83-2e4e47cad580 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:04.995543 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e28b2487-a300-4d4a-ae83-2e4e47cad580 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:04.995903 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e28b2487-a300-4d4a-ae83-2e4e47cad580 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:05.004914 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-c1941494-d178-421f-b952-cfbf281a6ff2 tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '301902a6e7bd419db1dc37123e2626aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fbc93887563467dba31d09e3803b962', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:05.009964 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-c1941494-d178-421f-b952-cfbf281a6ff2 tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '301902a6e7bd419db1dc37123e2626aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fbc93887563467dba31d09e3803b962', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:05.014168 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-c1941494-d178-421f-b952-cfbf281a6ff2 tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] 10.222.0.43 "GET /compute/v2.1/servers/26a08c55-8019-43e6-aa28-fdf938ad0798" status: 200 len: 1359 microversion: 2.21 time: 1.171185 Oct 04 21:51:05.017796 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 994/1934] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:51:03 2022] GET /compute/v2.1/servers/26a08c55-8019-43e6-aa28-fdf938ad0798 => generated 1359 bytes in 1175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:51:05.039311 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-54c96470-9595-4053-a50f-63fa09bcabf2 req-4418d998-03e6-426b-a47f-330fb3eb70b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4709e5d7-52a3-4a79-8835-d651dce0c34a", "name": "network-vif-plugged", "status": "completed", "tag": "bacddb90-9e3c-4a64-91f2-f0a88b83fec1"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:51:05.071461 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-54c96470-9595-4053-a50f-63fa09bcabf2 req-4418d998-03e6-426b-a47f-330fb3eb70b6 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:05.072540 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-54c96470-9595-4053-a50f-63fa09bcabf2 req-4418d998-03e6-426b-a47f-330fb3eb70b6 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:05.073201 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-54c96470-9595-4053-a50f-63fa09bcabf2 req-4418d998-03e6-426b-a47f-330fb3eb70b6 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:05.091549 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-54c96470-9595-4053-a50f-63fa09bcabf2 req-4418d998-03e6-426b-a47f-330fb3eb70b6 service nova] Creating event network-vif-plugged:bacddb90-9e3c-4a64-91f2-f0a88b83fec1 for instance 4709e5d7-52a3-4a79-8835-d651dce0c34a on n-h2-860284-1 Oct 04 21:51:05.098824 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-54c96470-9595-4053-a50f-63fa09bcabf2 req-4418d998-03e6-426b-a47f-330fb3eb70b6 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078148 Oct 04 21:51:05.100361 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 995/1935] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:51:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:51:05.124508 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-9565cf8a-3b46-46f3-961e-b6810d076dab tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:05.125862 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-9565cf8a-3b46-46f3-961e-b6810d076dab tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] [instance: 4709e5d7-52a3-4a79-8835-d651dce0c34a] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:05.152760 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9565cf8a-3b46-46f3-961e-b6810d076dab tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:05.153173 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9565cf8a-3b46-46f3-961e-b6810d076dab tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:05.153610 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9565cf8a-3b46-46f3-961e-b6810d076dab tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:05.154326 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9565cf8a-3b46-46f3-961e-b6810d076dab tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:05.154937 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9565cf8a-3b46-46f3-961e-b6810d076dab tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:05.155352 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9565cf8a-3b46-46f3-961e-b6810d076dab tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:05.411094 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-e28b2487-a300-4d4a-ae83-2e4e47cad580 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ad048becf474fb972d4291422d810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dcfc7024fc49388c4bd5f25f03e60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:05.420415 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-e28b2487-a300-4d4a-ae83-2e4e47cad580 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/3f0a02bc-7993-4849-8b3c-7572327b4799" status: 200 len: 1716 microversion: 2.1 time: 0.462424 Oct 04 21:51:05.428164 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 941/1936] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:51:04 2022] GET /compute/v2.1/servers/3f0a02bc-7993-4849-8b3c-7572327b4799 => generated 1716 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:51:05.586411 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-9565cf8a-3b46-46f3-961e-b6810d076dab tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12f87ae29534b2c9171ee7b0dcab372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f529360dc1742a89d62a9fe42bc9848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:05.603265 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-9565cf8a-3b46-46f3-961e-b6810d076dab tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] 10.222.0.43 "GET /compute/v2.1/servers/4709e5d7-52a3-4a79-8835-d651dce0c34a" status: 200 len: 1394 microversion: 2.1 time: 0.500240 Oct 04 21:51:05.604305 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 996/1937] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:51:05 2022] GET /compute/v2.1/servers/4709e5d7-52a3-4a79-8835-d651dce0c34a => generated 1394 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:51:05.761920 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-dd446952-c73e-496e-80ab-95f94fdc2dbc tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:05.763068 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-dd446952-c73e-496e-80ab-95f94fdc2dbc tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] [instance: 3f80e8f0-dba3-4403-83f8-0473c5d7d29b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:05.779433 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dd446952-c73e-496e-80ab-95f94fdc2dbc tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:05.780204 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dd446952-c73e-496e-80ab-95f94fdc2dbc tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:05.780894 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dd446952-c73e-496e-80ab-95f94fdc2dbc tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:05.781888 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dd446952-c73e-496e-80ab-95f94fdc2dbc tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:05.782604 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dd446952-c73e-496e-80ab-95f94fdc2dbc tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:05.785353 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dd446952-c73e-496e-80ab-95f94fdc2dbc tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:05.970124 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.objects.instance [None req-dd446952-c73e-496e-80ab-95f94fdc2dbc tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Lazy-loading 'services' on Instance uuid 3f80e8f0-dba3-4403-83f8-0473c5d7d29b {{(pid=134101) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:51:05.980195 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-b0e7b85d-3e97-49f5-a2f1-4e503d3d9c7c tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:05.980979 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-b0e7b85d-3e97-49f5-a2f1-4e503d3d9c7c tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] [instance: 7d0ed6d0-981a-48a7-a676-5910b1257301] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:05.995834 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b0e7b85d-3e97-49f5-a2f1-4e503d3d9c7c tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:05.998752 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b0e7b85d-3e97-49f5-a2f1-4e503d3d9c7c tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:06.000844 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b0e7b85d-3e97-49f5-a2f1-4e503d3d9c7c tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:06.003486 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b0e7b85d-3e97-49f5-a2f1-4e503d3d9c7c tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:06.006316 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b0e7b85d-3e97-49f5-a2f1-4e503d3d9c7c tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:06.009135 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b0e7b85d-3e97-49f5-a2f1-4e503d3d9c7c tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:06.034139 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-dd446952-c73e-496e-80ab-95f94fdc2dbc tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/3f80e8f0-dba3-4403-83f8-0473c5d7d29b" status: 200 len: 1923 microversion: 2.75 time: 0.275965 Oct 04 21:51:06.036953 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 942/1938] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:51:05 2022] GET /compute/v2.1/servers/3f80e8f0-dba3-4403-83f8-0473c5d7d29b => generated 1923 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:51:06.050626 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-f3a397d3-12aa-4135-996e-f0d3dafd22f0 tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:06.051459 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-f3a397d3-12aa-4135-996e-f0d3dafd22f0 tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] [instance: 26a08c55-8019-43e6-aa28-fdf938ad0798] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:06.061721 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f3a397d3-12aa-4135-996e-f0d3dafd22f0 tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:06.062633 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f3a397d3-12aa-4135-996e-f0d3dafd22f0 tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:06.071125 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f3a397d3-12aa-4135-996e-f0d3dafd22f0 tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:06.072336 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f3a397d3-12aa-4135-996e-f0d3dafd22f0 tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:06.073092 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f3a397d3-12aa-4135-996e-f0d3dafd22f0 tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:06.073776 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f3a397d3-12aa-4135-996e-f0d3dafd22f0 tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:06.208844 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-b0e7b85d-3e97-49f5-a2f1-4e503d3d9c7c tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f11c77afc74a16bea945dd84e72ebe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94d03be22238422eba835ed522baf9c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:06.221004 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-b0e7b85d-3e97-49f5-a2f1-4e503d3d9c7c tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] 10.222.0.43 "GET /compute/v2.1/servers/7d0ed6d0-981a-48a7-a676-5910b1257301" status: 200 len: 1276 microversion: 2.1 time: 0.245474 Oct 04 21:51:06.221835 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 997/1939] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:51:05 2022] GET /compute/v2.1/servers/7d0ed6d0-981a-48a7-a676-5910b1257301 => generated 1276 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:51:06.441516 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-f3a397d3-12aa-4135-996e-f0d3dafd22f0 tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '301902a6e7bd419db1dc37123e2626aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fbc93887563467dba31d09e3803b962', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:06.450018 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-f3a397d3-12aa-4135-996e-f0d3dafd22f0 tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '301902a6e7bd419db1dc37123e2626aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fbc93887563467dba31d09e3803b962', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:06.451499 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-f3a397d3-12aa-4135-996e-f0d3dafd22f0 tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '301902a6e7bd419db1dc37123e2626aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fbc93887563467dba31d09e3803b962', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:06.452615 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-f3a397d3-12aa-4135-996e-f0d3dafd22f0 tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] 10.222.0.43 "GET /compute/v2.1/servers/26a08c55-8019-43e6-aa28-fdf938ad0798" status: 200 len: 1359 microversion: 2.21 time: 0.411297 Oct 04 21:51:06.463513 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-325e5043-5eef-4864-910b-21a4346f087b tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:06.464123 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-325e5043-5eef-4864-910b-21a4346f087b tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 3f0a02bc-7993-4849-8b3c-7572327b4799] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:06.493463 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-325e5043-5eef-4864-910b-21a4346f087b tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:06.493958 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-325e5043-5eef-4864-910b-21a4346f087b tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:06.497096 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 943/1940] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:51:06 2022] GET /compute/v2.1/servers/26a08c55-8019-43e6-aa28-fdf938ad0798 => generated 1359 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:51:06.497262 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-325e5043-5eef-4864-910b-21a4346f087b tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:06.497950 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-325e5043-5eef-4864-910b-21a4346f087b tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:06.498702 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-325e5043-5eef-4864-910b-21a4346f087b tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:06.499302 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-325e5043-5eef-4864-910b-21a4346f087b tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:06.635398 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-07a0adb5-3fac-461a-9177-e90478d27c98 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:06.636017 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-07a0adb5-3fac-461a-9177-e90478d27c98 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] [instance: 4709e5d7-52a3-4a79-8835-d651dce0c34a] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:06.646321 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-07a0adb5-3fac-461a-9177-e90478d27c98 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:06.659801 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-07a0adb5-3fac-461a-9177-e90478d27c98 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:06.661690 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-07a0adb5-3fac-461a-9177-e90478d27c98 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:06.662856 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-07a0adb5-3fac-461a-9177-e90478d27c98 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:06.663776 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-07a0adb5-3fac-461a-9177-e90478d27c98 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:06.665067 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-07a0adb5-3fac-461a-9177-e90478d27c98 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:07.024200 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-325e5043-5eef-4864-910b-21a4346f087b tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ad048becf474fb972d4291422d810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dcfc7024fc49388c4bd5f25f03e60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:07.045863 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-325e5043-5eef-4864-910b-21a4346f087b tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/3f0a02bc-7993-4849-8b3c-7572327b4799" status: 200 len: 1716 microversion: 2.1 time: 0.587270 Oct 04 21:51:07.065958 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 998/1941] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:51:06 2022] GET /compute/v2.1/servers/3f0a02bc-7993-4849-8b3c-7572327b4799 => generated 1716 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:51:07.090412 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-e99bf2ab-b4e4-4599-b527-e3fa9af5af19 tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:07.091081 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-e99bf2ab-b4e4-4599-b527-e3fa9af5af19 tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] [instance: 3f80e8f0-dba3-4403-83f8-0473c5d7d29b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:07.102644 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e99bf2ab-b4e4-4599-b527-e3fa9af5af19 tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:07.103456 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e99bf2ab-b4e4-4599-b527-e3fa9af5af19 tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:07.104079 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e99bf2ab-b4e4-4599-b527-e3fa9af5af19 tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:07.105001 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e99bf2ab-b4e4-4599-b527-e3fa9af5af19 tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:07.105631 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e99bf2ab-b4e4-4599-b527-e3fa9af5af19 tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:07.106230 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e99bf2ab-b4e4-4599-b527-e3fa9af5af19 tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:07.124826 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-07a0adb5-3fac-461a-9177-e90478d27c98 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12f87ae29534b2c9171ee7b0dcab372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f529360dc1742a89d62a9fe42bc9848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:07.139780 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-07a0adb5-3fac-461a-9177-e90478d27c98 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] 10.222.0.43 "GET /compute/v2.1/servers/4709e5d7-52a3-4a79-8835-d651dce0c34a" status: 200 len: 1394 microversion: 2.1 time: 0.507984 Oct 04 21:51:07.143397 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 944/1942] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:51:06 2022] GET /compute/v2.1/servers/4709e5d7-52a3-4a79-8835-d651dce0c34a => generated 1394 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:51:07.248766 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e3625810-693c-43d4-ad17-5bed64a85c20 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:07.250697 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-e3625810-693c-43d4-ad17-5bed64a85c20 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] [instance: 7d0ed6d0-981a-48a7-a676-5910b1257301] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:07.277237 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e3625810-693c-43d4-ad17-5bed64a85c20 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:07.284311 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e3625810-693c-43d4-ad17-5bed64a85c20 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:07.285967 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e3625810-693c-43d4-ad17-5bed64a85c20 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:07.289234 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e3625810-693c-43d4-ad17-5bed64a85c20 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:07.289997 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e3625810-693c-43d4-ad17-5bed64a85c20 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:07.290722 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e3625810-693c-43d4-ad17-5bed64a85c20 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:07.329570 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.objects.instance [None req-e99bf2ab-b4e4-4599-b527-e3fa9af5af19 tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Lazy-loading 'services' on Instance uuid 3f80e8f0-dba3-4403-83f8-0473c5d7d29b {{(pid=134102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:51:07.377314 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-e99bf2ab-b4e4-4599-b527-e3fa9af5af19 tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/3f80e8f0-dba3-4403-83f8-0473c5d7d29b" status: 200 len: 1923 microversion: 2.75 time: 0.306952 Oct 04 21:51:07.382175 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 999/1943] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:51:07 2022] GET /compute/v2.1/servers/3f80e8f0-dba3-4403-83f8-0473c5d7d29b => generated 1923 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:51:07.505765 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-a69ce7b5-2dec-41f8-9ce6-dd26643b528c tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:07.507035 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-a69ce7b5-2dec-41f8-9ce6-dd26643b528c tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] [instance: 26a08c55-8019-43e6-aa28-fdf938ad0798] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:07.514092 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a69ce7b5-2dec-41f8-9ce6-dd26643b528c tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:07.515138 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a69ce7b5-2dec-41f8-9ce6-dd26643b528c tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:07.516377 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a69ce7b5-2dec-41f8-9ce6-dd26643b528c tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:07.517462 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a69ce7b5-2dec-41f8-9ce6-dd26643b528c tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:07.518318 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a69ce7b5-2dec-41f8-9ce6-dd26643b528c tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:07.520237 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a69ce7b5-2dec-41f8-9ce6-dd26643b528c tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:07.525195 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-e3625810-693c-43d4-ad17-5bed64a85c20 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f11c77afc74a16bea945dd84e72ebe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94d03be22238422eba835ed522baf9c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:07.555448 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-e3625810-693c-43d4-ad17-5bed64a85c20 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] 10.222.0.43 "GET /compute/v2.1/servers/7d0ed6d0-981a-48a7-a676-5910b1257301" status: 200 len: 1276 microversion: 2.1 time: 0.310796 Oct 04 21:51:07.571115 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 945/1944] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:51:07 2022] GET /compute/v2.1/servers/7d0ed6d0-981a-48a7-a676-5910b1257301 => generated 1276 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:51:07.954036 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-a69ce7b5-2dec-41f8-9ce6-dd26643b528c tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '301902a6e7bd419db1dc37123e2626aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fbc93887563467dba31d09e3803b962', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:07.966882 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-a69ce7b5-2dec-41f8-9ce6-dd26643b528c tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '301902a6e7bd419db1dc37123e2626aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fbc93887563467dba31d09e3803b962', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:07.977070 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-a69ce7b5-2dec-41f8-9ce6-dd26643b528c tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '301902a6e7bd419db1dc37123e2626aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fbc93887563467dba31d09e3803b962', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:07.978263 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-a69ce7b5-2dec-41f8-9ce6-dd26643b528c tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] 10.222.0.43 "GET /compute/v2.1/servers/26a08c55-8019-43e6-aa28-fdf938ad0798" status: 200 len: 1359 microversion: 2.21 time: 0.478081 Oct 04 21:51:07.979268 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1000/1945] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:51:07 2022] GET /compute/v2.1/servers/26a08c55-8019-43e6-aa28-fdf938ad0798 => generated 1359 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:51:08.083690 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-550bbe4a-aa4f-4fa5-adc4-356883c891e6 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:08.084789 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-550bbe4a-aa4f-4fa5-adc4-356883c891e6 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 3f0a02bc-7993-4849-8b3c-7572327b4799] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:08.101051 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-550bbe4a-aa4f-4fa5-adc4-356883c891e6 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:08.101853 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-550bbe4a-aa4f-4fa5-adc4-356883c891e6 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:08.113281 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-550bbe4a-aa4f-4fa5-adc4-356883c891e6 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:08.114253 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-550bbe4a-aa4f-4fa5-adc4-356883c891e6 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:08.114975 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-550bbe4a-aa4f-4fa5-adc4-356883c891e6 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:08.115600 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-550bbe4a-aa4f-4fa5-adc4-356883c891e6 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:08.167356 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-c8a25e3c-395b-4df5-9895-55852b26cd25 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:08.168821 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-c8a25e3c-395b-4df5-9895-55852b26cd25 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] [instance: 4709e5d7-52a3-4a79-8835-d651dce0c34a] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:08.180190 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c8a25e3c-395b-4df5-9895-55852b26cd25 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:08.181331 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c8a25e3c-395b-4df5-9895-55852b26cd25 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:08.182050 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c8a25e3c-395b-4df5-9895-55852b26cd25 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:08.183096 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c8a25e3c-395b-4df5-9895-55852b26cd25 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:08.184124 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c8a25e3c-395b-4df5-9895-55852b26cd25 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:08.184938 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c8a25e3c-395b-4df5-9895-55852b26cd25 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:08.195289 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=100 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:51:08.597963 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-550bbe4a-aa4f-4fa5-adc4-356883c891e6 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ad048becf474fb972d4291422d810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dcfc7024fc49388c4bd5f25f03e60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:08.615619 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-550bbe4a-aa4f-4fa5-adc4-356883c891e6 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/3f0a02bc-7993-4849-8b3c-7572327b4799" status: 200 len: 1716 microversion: 2.1 time: 0.536924 Oct 04 21:51:08.616205 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 946/1946] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:51:08 2022] GET /compute/v2.1/servers/3f0a02bc-7993-4849-8b3c-7572327b4799 => generated 1716 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:51:08.620924 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-83dd70e6-3113-4e06-87b5-472ed19739db tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:08.621778 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-83dd70e6-3113-4e06-87b5-472ed19739db tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] [instance: 3f80e8f0-dba3-4403-83f8-0473c5d7d29b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:08.636101 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-83dd70e6-3113-4e06-87b5-472ed19739db tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:08.643317 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-83dd70e6-3113-4e06-87b5-472ed19739db tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:08.643955 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-83dd70e6-3113-4e06-87b5-472ed19739db tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:08.644877 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-83dd70e6-3113-4e06-87b5-472ed19739db tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:08.645500 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-83dd70e6-3113-4e06-87b5-472ed19739db tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:08.646089 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-83dd70e6-3113-4e06-87b5-472ed19739db tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:08.659217 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-c8a25e3c-395b-4df5-9895-55852b26cd25 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12f87ae29534b2c9171ee7b0dcab372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f529360dc1742a89d62a9fe42bc9848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:08.668116 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-c8a25e3c-395b-4df5-9895-55852b26cd25 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] 10.222.0.43 "GET /compute/v2.1/servers/4709e5d7-52a3-4a79-8835-d651dce0c34a" status: 200 len: 1575 microversion: 2.1 time: 0.507047 Oct 04 21:51:08.673995 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1001/1947] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:51:08 2022] GET /compute/v2.1/servers/4709e5d7-52a3-4a79-8835-d651dce0c34a => generated 1575 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:51:08.705806 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-e9d151c5-c624-4de1-8301-54327d4357a1 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:08.716191 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-e9d151c5-c624-4de1-8301-54327d4357a1 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] [instance: 7d0ed6d0-981a-48a7-a676-5910b1257301] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:08.742722 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e9d151c5-c624-4de1-8301-54327d4357a1 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:08.743518 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e9d151c5-c624-4de1-8301-54327d4357a1 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:08.745958 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e9d151c5-c624-4de1-8301-54327d4357a1 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:08.748448 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e9d151c5-c624-4de1-8301-54327d4357a1 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:08.749109 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e9d151c5-c624-4de1-8301-54327d4357a1 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:08.750802 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e9d151c5-c624-4de1-8301-54327d4357a1 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:08.923560 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.objects.instance [None req-83dd70e6-3113-4e06-87b5-472ed19739db tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Lazy-loading 'services' on Instance uuid 3f80e8f0-dba3-4403-83f8-0473c5d7d29b {{(pid=134101) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:51:08.945915 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-83dd70e6-3113-4e06-87b5-472ed19739db tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/3f80e8f0-dba3-4403-83f8-0473c5d7d29b" status: 200 len: 1923 microversion: 2.75 time: 0.327611 Oct 04 21:51:08.947143 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 947/1948] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:51:08 2022] GET /compute/v2.1/servers/3f80e8f0-dba3-4403-83f8-0473c5d7d29b => generated 1923 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:51:08.952753 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-052e6cb8-0b0c-4a43-917d-b0158bff947c tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:08.954004 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-052e6cb8-0b0c-4a43-917d-b0158bff947c tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] [instance: 4709e5d7-52a3-4a79-8835-d651dce0c34a] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:08.961306 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-052e6cb8-0b0c-4a43-917d-b0158bff947c tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:08.975794 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-052e6cb8-0b0c-4a43-917d-b0158bff947c tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:08.977061 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-052e6cb8-0b0c-4a43-917d-b0158bff947c tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:08.978059 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-052e6cb8-0b0c-4a43-917d-b0158bff947c tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:08.978792 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-052e6cb8-0b0c-4a43-917d-b0158bff947c tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:08.979621 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-052e6cb8-0b0c-4a43-917d-b0158bff947c tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:09.234935 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-052e6cb8-0b0c-4a43-917d-b0158bff947c tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] 10.222.0.43 "GET /compute/v2.1/servers/4709e5d7-52a3-4a79-8835-d651dce0c34a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.285532 Oct 04 21:51:09.235878 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 948/1949] 10.222.0.43 () {58 vars in 1275 bytes} [Tue Oct 4 21:51:08 2022] GET /compute/v2.1/servers/4709e5d7-52a3-4a79-8835-d651dce0c34a/os-interface => generated 284 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:51:09.243561 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-eb42cad4-ae2f-4a74-8883-d50c24d7bdf1 req-4e88507b-015d-4718-89a9-13d175c75782 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26a08c55-8019-43e6-aa28-fdf938ad0798", "name": "network-vif-plugged", "status": "completed", "tag": "d8a8ee90-a00c-4ea8-af05-ce15a6a5f49e"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:51:09.264749 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-e9d151c5-c624-4de1-8301-54327d4357a1 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f11c77afc74a16bea945dd84e72ebe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94d03be22238422eba835ed522baf9c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:09.270612 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-eb42cad4-ae2f-4a74-8883-d50c24d7bdf1 req-4e88507b-015d-4718-89a9-13d175c75782 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:09.271746 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-eb42cad4-ae2f-4a74-8883-d50c24d7bdf1 req-4e88507b-015d-4718-89a9-13d175c75782 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:09.272610 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-eb42cad4-ae2f-4a74-8883-d50c24d7bdf1 req-4e88507b-015d-4718-89a9-13d175c75782 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:09.279517 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-e9d151c5-c624-4de1-8301-54327d4357a1 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] 10.222.0.43 "GET /compute/v2.1/servers/7d0ed6d0-981a-48a7-a676-5910b1257301" status: 200 len: 1318 microversion: 2.1 time: 0.604164 Oct 04 21:51:09.280125 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1002/1950] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:51:08 2022] GET /compute/v2.1/servers/7d0ed6d0-981a-48a7-a676-5910b1257301 => generated 1318 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:51:09.303736 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-35bfb2b1-6072-4cfd-bb4f-f0b960be01a2 tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:09.304348 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-35bfb2b1-6072-4cfd-bb4f-f0b960be01a2 tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] [instance: 26a08c55-8019-43e6-aa28-fdf938ad0798] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:09.313505 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-eb42cad4-ae2f-4a74-8883-d50c24d7bdf1 req-4e88507b-015d-4718-89a9-13d175c75782 service nova] Creating event network-vif-plugged:d8a8ee90-a00c-4ea8-af05-ce15a6a5f49e for instance 26a08c55-8019-43e6-aa28-fdf938ad0798 on n-h1-860284-1 Oct 04 21:51:09.319396 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-eb42cad4-ae2f-4a74-8883-d50c24d7bdf1 req-4e88507b-015d-4718-89a9-13d175c75782 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081956 Oct 04 21:51:09.320756 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 949/1951] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:51:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:51:09.323860 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-35bfb2b1-6072-4cfd-bb4f-f0b960be01a2 tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:09.325217 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-35bfb2b1-6072-4cfd-bb4f-f0b960be01a2 tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:09.325677 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-35bfb2b1-6072-4cfd-bb4f-f0b960be01a2 tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:09.326652 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-35bfb2b1-6072-4cfd-bb4f-f0b960be01a2 tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:09.327610 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-35bfb2b1-6072-4cfd-bb4f-f0b960be01a2 tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:09.337970 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-35bfb2b1-6072-4cfd-bb4f-f0b960be01a2 tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:09.643377 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-4b008cf9-088d-424d-92ed-5b892d39aceb tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:09.644855 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-4b008cf9-088d-424d-92ed-5b892d39aceb tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 3f0a02bc-7993-4849-8b3c-7572327b4799] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:09.655543 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4b008cf9-088d-424d-92ed-5b892d39aceb tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:09.657663 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4b008cf9-088d-424d-92ed-5b892d39aceb tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:09.659846 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4b008cf9-088d-424d-92ed-5b892d39aceb tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:09.668567 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4b008cf9-088d-424d-92ed-5b892d39aceb tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:09.669197 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4b008cf9-088d-424d-92ed-5b892d39aceb tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:09.669733 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4b008cf9-088d-424d-92ed-5b892d39aceb tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:09.815311 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-35bfb2b1-6072-4cfd-bb4f-f0b960be01a2 tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '301902a6e7bd419db1dc37123e2626aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fbc93887563467dba31d09e3803b962', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:09.830233 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-35bfb2b1-6072-4cfd-bb4f-f0b960be01a2 tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '301902a6e7bd419db1dc37123e2626aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fbc93887563467dba31d09e3803b962', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:09.831815 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-35bfb2b1-6072-4cfd-bb4f-f0b960be01a2 tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '301902a6e7bd419db1dc37123e2626aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fbc93887563467dba31d09e3803b962', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:09.832987 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-35bfb2b1-6072-4cfd-bb4f-f0b960be01a2 tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] 10.222.0.43 "GET /compute/v2.1/servers/26a08c55-8019-43e6-aa28-fdf938ad0798" status: 200 len: 1359 microversion: 2.21 time: 0.541345 Oct 04 21:51:09.833572 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1003/1952] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:51:09 2022] GET /compute/v2.1/servers/26a08c55-8019-43e6-aa28-fdf938ad0798 => generated 1359 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:51:09.851599 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-105c3533-e4d8-4c18-8dd0-4624ee389693 req-0d2925aa-fa29-4d9e-873e-918c4eec2413 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f8a46c4-3b6f-4f50-8227-77b69154fb57", "tag": "0b8186cd-d9f4-408f-9942-a8fcb3a46521"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:51:09.872609 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-105c3533-e4d8-4c18-8dd0-4624ee389693 req-0d2925aa-fa29-4d9e-873e-918c4eec2413 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:09.873379 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-105c3533-e4d8-4c18-8dd0-4624ee389693 req-0d2925aa-fa29-4d9e-873e-918c4eec2413 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:09.873982 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-105c3533-e4d8-4c18-8dd0-4624ee389693 req-0d2925aa-fa29-4d9e-873e-918c4eec2413 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:09.898232 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-105c3533-e4d8-4c18-8dd0-4624ee389693 req-0d2925aa-fa29-4d9e-873e-918c4eec2413 service nova] Creating event network-changed:0b8186cd-d9f4-408f-9942-a8fcb3a46521 for instance 6f8a46c4-3b6f-4f50-8227-77b69154fb57 on n-h2-860284-1 Oct 04 21:51:09.920436 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-105c3533-e4d8-4c18-8dd0-4624ee389693 req-0d2925aa-fa29-4d9e-873e-918c4eec2413 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077066 Oct 04 21:51:09.921480 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1004/1953] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:51:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:51:09.982092 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-298714a7-618f-488b-8bd2-18bc7a050169 tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:09.984683 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-298714a7-618f-488b-8bd2-18bc7a050169 tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] [instance: 3f80e8f0-dba3-4403-83f8-0473c5d7d29b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:10.006393 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:51:10.019595 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-298714a7-618f-488b-8bd2-18bc7a050169 tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:10.020849 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-298714a7-618f-488b-8bd2-18bc7a050169 tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:10.021465 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-298714a7-618f-488b-8bd2-18bc7a050169 tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:10.022802 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-298714a7-618f-488b-8bd2-18bc7a050169 tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:10.040549 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-298714a7-618f-488b-8bd2-18bc7a050169 tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:10.045374 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-298714a7-618f-488b-8bd2-18bc7a050169 tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:10.338273 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-4b008cf9-088d-424d-92ed-5b892d39aceb tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ad048becf474fb972d4291422d810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dcfc7024fc49388c4bd5f25f03e60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:10.352378 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-4b008cf9-088d-424d-92ed-5b892d39aceb tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/3f0a02bc-7993-4849-8b3c-7572327b4799" status: 200 len: 1716 microversion: 2.1 time: 0.713352 Oct 04 21:51:10.353596 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 950/1954] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:51:09 2022] GET /compute/v2.1/servers/3f0a02bc-7993-4849-8b3c-7572327b4799 => generated 1716 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:51:10.360426 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-8855097b-667d-413c-9185-cf0a532e7739 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:10.361258 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-8855097b-667d-413c-9185-cf0a532e7739 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] [instance: 7d0ed6d0-981a-48a7-a676-5910b1257301] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:10.368191 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8855097b-667d-413c-9185-cf0a532e7739 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:10.368877 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8855097b-667d-413c-9185-cf0a532e7739 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:10.369485 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8855097b-667d-413c-9185-cf0a532e7739 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:10.370410 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8855097b-667d-413c-9185-cf0a532e7739 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:10.371029 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8855097b-667d-413c-9185-cf0a532e7739 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:10.371649 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8855097b-667d-413c-9185-cf0a532e7739 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:10.395049 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.objects.instance [None req-298714a7-618f-488b-8bd2-18bc7a050169 tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Lazy-loading 'services' on Instance uuid 3f80e8f0-dba3-4403-83f8-0473c5d7d29b {{(pid=134102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:51:10.400268 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=100 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:51:10.444160 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-298714a7-618f-488b-8bd2-18bc7a050169 tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/3f80e8f0-dba3-4403-83f8-0473c5d7d29b" status: 200 len: 1923 microversion: 2.75 time: 0.472357 Oct 04 21:51:10.445314 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1005/1955] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:51:09 2022] GET /compute/v2.1/servers/3f80e8f0-dba3-4403-83f8-0473c5d7d29b => generated 1923 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:51:10.868730 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-f88f7d83-d1eb-4d69-ae68-5b279a53e872 tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:10.869787 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-f88f7d83-d1eb-4d69-ae68-5b279a53e872 tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] [instance: 26a08c55-8019-43e6-aa28-fdf938ad0798] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:10.880650 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f88f7d83-d1eb-4d69-ae68-5b279a53e872 tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:10.881196 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f88f7d83-d1eb-4d69-ae68-5b279a53e872 tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:10.881644 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f88f7d83-d1eb-4d69-ae68-5b279a53e872 tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:10.882818 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f88f7d83-d1eb-4d69-ae68-5b279a53e872 tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:10.883512 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f88f7d83-d1eb-4d69-ae68-5b279a53e872 tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:10.885577 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f88f7d83-d1eb-4d69-ae68-5b279a53e872 tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:11.263841 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-8855097b-667d-413c-9185-cf0a532e7739 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f11c77afc74a16bea945dd84e72ebe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94d03be22238422eba835ed522baf9c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:11.319585 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-8855097b-667d-413c-9185-cf0a532e7739 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] 10.222.0.43 "GET /compute/v2.1/servers/7d0ed6d0-981a-48a7-a676-5910b1257301" status: 200 len: 1318 microversion: 2.1 time: 0.964545 Oct 04 21:51:11.331677 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 951/1956] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:51:10 2022] GET /compute/v2.1/servers/7d0ed6d0-981a-48a7-a676-5910b1257301 => generated 1318 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:51:11.379603 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-d5848fac-742d-4599-a6cd-a13277fd3745 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:11.380377 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-d5848fac-742d-4599-a6cd-a13277fd3745 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 3f0a02bc-7993-4849-8b3c-7572327b4799] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:11.395053 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d5848fac-742d-4599-a6cd-a13277fd3745 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:11.396405 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d5848fac-742d-4599-a6cd-a13277fd3745 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:11.397374 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d5848fac-742d-4599-a6cd-a13277fd3745 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:11.398773 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d5848fac-742d-4599-a6cd-a13277fd3745 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:11.399472 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d5848fac-742d-4599-a6cd-a13277fd3745 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:11.400453 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d5848fac-742d-4599-a6cd-a13277fd3745 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:11.478848 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-f88f7d83-d1eb-4d69-ae68-5b279a53e872 tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '301902a6e7bd419db1dc37123e2626aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fbc93887563467dba31d09e3803b962', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:11.490592 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-f88f7d83-d1eb-4d69-ae68-5b279a53e872 tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '301902a6e7bd419db1dc37123e2626aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fbc93887563467dba31d09e3803b962', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:11.492039 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-f88f7d83-d1eb-4d69-ae68-5b279a53e872 tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '301902a6e7bd419db1dc37123e2626aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fbc93887563467dba31d09e3803b962', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:11.493162 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-f88f7d83-d1eb-4d69-ae68-5b279a53e872 tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] 10.222.0.43 "GET /compute/v2.1/servers/26a08c55-8019-43e6-aa28-fdf938ad0798" status: 200 len: 1359 microversion: 2.21 time: 0.632560 Oct 04 21:51:11.493724 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1006/1957] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:51:10 2022] GET /compute/v2.1/servers/26a08c55-8019-43e6-aa28-fdf938ad0798 => generated 1359 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:51:11.498445 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-1e930bee-d79d-46bb-a850-05772d27d487 tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:11.499336 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-1e930bee-d79d-46bb-a850-05772d27d487 tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] [instance: 3f80e8f0-dba3-4403-83f8-0473c5d7d29b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:11.507849 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1e930bee-d79d-46bb-a850-05772d27d487 tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:11.508556 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1e930bee-d79d-46bb-a850-05772d27d487 tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:11.509181 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1e930bee-d79d-46bb-a850-05772d27d487 tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:11.510099 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1e930bee-d79d-46bb-a850-05772d27d487 tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:11.510774 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1e930bee-d79d-46bb-a850-05772d27d487 tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:11.511198 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1e930bee-d79d-46bb-a850-05772d27d487 tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:11.548928 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell0:SELECT=2 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:51:11.580129 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell0:SELECT=6 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:51:11.677554 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.objects.instance [None req-1e930bee-d79d-46bb-a850-05772d27d487 tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Lazy-loading 'services' on Instance uuid 3f80e8f0-dba3-4403-83f8-0473c5d7d29b {{(pid=134102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:51:11.696420 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-1e930bee-d79d-46bb-a850-05772d27d487 tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/3f80e8f0-dba3-4403-83f8-0473c5d7d29b" status: 200 len: 1923 microversion: 2.75 time: 0.201372 Oct 04 21:51:11.697102 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1007/1958] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:51:11 2022] GET /compute/v2.1/servers/3f80e8f0-dba3-4403-83f8-0473c5d7d29b => generated 1923 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:51:11.709740 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-221b9bb3-bfac-4732-ba53-3e23c8c53bd0 req-a65837cc-9a81-4cbd-9517-41a0e8c0becb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d0ed6d0-981a-48a7-a676-5910b1257301", "tag": "0ba64ce4-a23d-464b-a37e-fdb0f8a91b4b"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:51:11.721709 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-221b9bb3-bfac-4732-ba53-3e23c8c53bd0 req-a65837cc-9a81-4cbd-9517-41a0e8c0becb service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:11.722278 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-221b9bb3-bfac-4732-ba53-3e23c8c53bd0 req-a65837cc-9a81-4cbd-9517-41a0e8c0becb service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:11.723126 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-221b9bb3-bfac-4732-ba53-3e23c8c53bd0 req-a65837cc-9a81-4cbd-9517-41a0e8c0becb service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:11.736336 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-221b9bb3-bfac-4732-ba53-3e23c8c53bd0 req-a65837cc-9a81-4cbd-9517-41a0e8c0becb service nova] Creating event network-changed:0ba64ce4-a23d-464b-a37e-fdb0f8a91b4b for instance 7d0ed6d0-981a-48a7-a676-5910b1257301 on n-h2-860284-1 Oct 04 21:51:11.744018 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-221b9bb3-bfac-4732-ba53-3e23c8c53bd0 req-a65837cc-9a81-4cbd-9517-41a0e8c0becb service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037985 Oct 04 21:51:11.744735 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1008/1959] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:51:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:51:11.927302 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-d5848fac-742d-4599-a6cd-a13277fd3745 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ad048becf474fb972d4291422d810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dcfc7024fc49388c4bd5f25f03e60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:11.935947 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-d5848fac-742d-4599-a6cd-a13277fd3745 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/3f0a02bc-7993-4849-8b3c-7572327b4799" status: 200 len: 1716 microversion: 2.1 time: 0.562358 Oct 04 21:51:11.936990 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 952/1960] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:51:11 2022] GET /compute/v2.1/servers/3f0a02bc-7993-4849-8b3c-7572327b4799 => generated 1716 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:51:12.176118 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-97a7979b-6cd8-4637-bd94-f0f2353d6400 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:12.176118 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-97a7979b-6cd8-4637-bd94-f0f2353d6400 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] [instance: 4709e5d7-52a3-4a79-8835-d651dce0c34a] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:12.183205 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-97a7979b-6cd8-4637-bd94-f0f2353d6400 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:12.183718 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-97a7979b-6cd8-4637-bd94-f0f2353d6400 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:12.184164 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-97a7979b-6cd8-4637-bd94-f0f2353d6400 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:12.184893 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-97a7979b-6cd8-4637-bd94-f0f2353d6400 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:12.185385 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-97a7979b-6cd8-4637-bd94-f0f2353d6400 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:12.185819 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-97a7979b-6cd8-4637-bd94-f0f2353d6400 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:12.348585 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-f27b46e8-2c0d-4356-8af8-7cba3529eeb6 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:12.349209 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-f27b46e8-2c0d-4356-8af8-7cba3529eeb6 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] [instance: 7d0ed6d0-981a-48a7-a676-5910b1257301] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:12.369429 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f27b46e8-2c0d-4356-8af8-7cba3529eeb6 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:12.369918 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f27b46e8-2c0d-4356-8af8-7cba3529eeb6 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:12.370355 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f27b46e8-2c0d-4356-8af8-7cba3529eeb6 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:12.371088 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f27b46e8-2c0d-4356-8af8-7cba3529eeb6 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:12.371544 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f27b46e8-2c0d-4356-8af8-7cba3529eeb6 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:12.371974 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f27b46e8-2c0d-4356-8af8-7cba3529eeb6 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:12.381338 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=2 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:51:12.620173 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-97a7979b-6cd8-4637-bd94-f0f2353d6400 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12f87ae29534b2c9171ee7b0dcab372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f529360dc1742a89d62a9fe42bc9848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:12.636990 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-97a7979b-6cd8-4637-bd94-f0f2353d6400 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] 10.222.0.43 "GET /compute/v2.1/servers/4709e5d7-52a3-4a79-8835-d651dce0c34a" status: 200 len: 1575 microversion: 2.1 time: 0.476847 Oct 04 21:51:12.650453 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1009/1961] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:51:12 2022] GET /compute/v2.1/servers/4709e5d7-52a3-4a79-8835-d651dce0c34a => generated 1575 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:51:12.654349 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-f2bf401d-5156-42e0-935e-d8e0e2af3829 tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:12.655234 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-f2bf401d-5156-42e0-935e-d8e0e2af3829 tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] [instance: 26a08c55-8019-43e6-aa28-fdf938ad0798] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:12.672001 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f2bf401d-5156-42e0-935e-d8e0e2af3829 tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:12.673655 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f2bf401d-5156-42e0-935e-d8e0e2af3829 tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:12.676066 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f2bf401d-5156-42e0-935e-d8e0e2af3829 tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:12.677017 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f2bf401d-5156-42e0-935e-d8e0e2af3829 tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:12.678604 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f2bf401d-5156-42e0-935e-d8e0e2af3829 tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:12.680952 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f2bf401d-5156-42e0-935e-d8e0e2af3829 tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:12.763443 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-f27b46e8-2c0d-4356-8af8-7cba3529eeb6 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f11c77afc74a16bea945dd84e72ebe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94d03be22238422eba835ed522baf9c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:12.774213 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-f27b46e8-2c0d-4356-8af8-7cba3529eeb6 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] 10.222.0.43 "GET /compute/v2.1/servers/7d0ed6d0-981a-48a7-a676-5910b1257301" status: 200 len: 1318 microversion: 2.1 time: 0.430776 Oct 04 21:51:12.782417 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 953/1962] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:51:12 2022] GET /compute/v2.1/servers/7d0ed6d0-981a-48a7-a676-5910b1257301 => generated 1318 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:51:12.790335 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-cd54fa91-35fc-4d8e-8a2d-93aa7b11d0e0 tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:12.795404 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-cd54fa91-35fc-4d8e-8a2d-93aa7b11d0e0 tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] [instance: 3f80e8f0-dba3-4403-83f8-0473c5d7d29b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:12.816019 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cd54fa91-35fc-4d8e-8a2d-93aa7b11d0e0 tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:12.816544 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cd54fa91-35fc-4d8e-8a2d-93aa7b11d0e0 tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:12.817107 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cd54fa91-35fc-4d8e-8a2d-93aa7b11d0e0 tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:12.819400 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cd54fa91-35fc-4d8e-8a2d-93aa7b11d0e0 tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:12.822741 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cd54fa91-35fc-4d8e-8a2d-93aa7b11d0e0 tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:12.825941 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cd54fa91-35fc-4d8e-8a2d-93aa7b11d0e0 tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:13.003597 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.objects.instance [None req-cd54fa91-35fc-4d8e-8a2d-93aa7b11d0e0 tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Lazy-loading 'services' on Instance uuid 3f80e8f0-dba3-4403-83f8-0473c5d7d29b {{(pid=134101) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:51:13.017346 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-f2bf401d-5156-42e0-935e-d8e0e2af3829 tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '301902a6e7bd419db1dc37123e2626aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fbc93887563467dba31d09e3803b962', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:13.037375 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-f2bf401d-5156-42e0-935e-d8e0e2af3829 tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '301902a6e7bd419db1dc37123e2626aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fbc93887563467dba31d09e3803b962', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:13.041484 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-f2bf401d-5156-42e0-935e-d8e0e2af3829 tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '301902a6e7bd419db1dc37123e2626aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fbc93887563467dba31d09e3803b962', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:13.044404 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-f2bf401d-5156-42e0-935e-d8e0e2af3829 tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] 10.222.0.43 "GET /compute/v2.1/servers/26a08c55-8019-43e6-aa28-fdf938ad0798" status: 200 len: 1552 microversion: 2.21 time: 0.400665 Oct 04 21:51:13.047005 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1010/1963] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:51:12 2022] GET /compute/v2.1/servers/26a08c55-8019-43e6-aa28-fdf938ad0798 => generated 1552 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:51:13.059069 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-f9dfb5bd-c055-4130-b6d3-04133783d894 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:13.061095 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-f9dfb5bd-c055-4130-b6d3-04133783d894 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 3f0a02bc-7993-4849-8b3c-7572327b4799] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:13.078912 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f9dfb5bd-c055-4130-b6d3-04133783d894 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:13.080997 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f9dfb5bd-c055-4130-b6d3-04133783d894 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:13.081838 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-cd54fa91-35fc-4d8e-8a2d-93aa7b11d0e0 tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/3f80e8f0-dba3-4403-83f8-0473c5d7d29b" status: 200 len: 1923 microversion: 2.75 time: 0.301896 Oct 04 21:51:13.082856 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f9dfb5bd-c055-4130-b6d3-04133783d894 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:13.083037 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 954/1964] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:51:12 2022] GET /compute/v2.1/servers/3f80e8f0-dba3-4403-83f8-0473c5d7d29b => generated 1923 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:51:13.086871 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f9dfb5bd-c055-4130-b6d3-04133783d894 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:13.087753 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f9dfb5bd-c055-4130-b6d3-04133783d894 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:13.092365 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f9dfb5bd-c055-4130-b6d3-04133783d894 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:13.093302 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-1d3b44bd-413c-4621-b0ac-010a2e85f7b3 tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:13.094922 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-1d3b44bd-413c-4621-b0ac-010a2e85f7b3 tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] [instance: 26a08c55-8019-43e6-aa28-fdf938ad0798] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:13.102246 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=8 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:51:13.104579 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1d3b44bd-413c-4621-b0ac-010a2e85f7b3 tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:13.105251 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1d3b44bd-413c-4621-b0ac-010a2e85f7b3 tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:13.105893 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1d3b44bd-413c-4621-b0ac-010a2e85f7b3 tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:13.106847 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1d3b44bd-413c-4621-b0ac-010a2e85f7b3 tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:13.107481 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1d3b44bd-413c-4621-b0ac-010a2e85f7b3 tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:13.108091 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1d3b44bd-413c-4621-b0ac-010a2e85f7b3 tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:13.162887 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-1d3b44bd-413c-4621-b0ac-010a2e85f7b3 tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] [instance: 26a08c55-8019-43e6-aa28-fdf938ad0798] Going to try to terminate instance {{(pid=134101) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:51:13.358242 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-1d3b44bd-413c-4621-b0ac-010a2e85f7b3 tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] 10.222.0.43 "DELETE /compute/v2.1/servers/26a08c55-8019-43e6-aa28-fdf938ad0798" status: 204 len: 0 microversion: 2.21 time: 0.273721 Oct 04 21:51:13.362480 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 955/1965] 10.222.0.43 () {60 vars in 1280 bytes} [Tue Oct 4 21:51:13 2022] DELETE /compute/v2.1/servers/26a08c55-8019-43e6-aa28-fdf938ad0798 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 21:51:13.375197 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e3f8a2cc-bbaa-40c8-a49a-a819f4ed8ed4 tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:13.376602 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-e3f8a2cc-bbaa-40c8-a49a-a819f4ed8ed4 tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] [instance: 26a08c55-8019-43e6-aa28-fdf938ad0798] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:13.403372 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e3f8a2cc-bbaa-40c8-a49a-a819f4ed8ed4 tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:13.407156 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e3f8a2cc-bbaa-40c8-a49a-a819f4ed8ed4 tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:13.407623 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e3f8a2cc-bbaa-40c8-a49a-a819f4ed8ed4 tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:13.408387 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e3f8a2cc-bbaa-40c8-a49a-a819f4ed8ed4 tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:13.413769 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e3f8a2cc-bbaa-40c8-a49a-a819f4ed8ed4 tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:13.414236 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e3f8a2cc-bbaa-40c8-a49a-a819f4ed8ed4 tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:13.712405 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-e3f8a2cc-bbaa-40c8-a49a-a819f4ed8ed4 tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '301902a6e7bd419db1dc37123e2626aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fbc93887563467dba31d09e3803b962', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:13.722578 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-e3f8a2cc-bbaa-40c8-a49a-a819f4ed8ed4 tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '301902a6e7bd419db1dc37123e2626aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fbc93887563467dba31d09e3803b962', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:13.731906 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-e3f8a2cc-bbaa-40c8-a49a-a819f4ed8ed4 tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '301902a6e7bd419db1dc37123e2626aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fbc93887563467dba31d09e3803b962', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:13.733441 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-e3f8a2cc-bbaa-40c8-a49a-a819f4ed8ed4 tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] 10.222.0.43 "GET /compute/v2.1/servers/26a08c55-8019-43e6-aa28-fdf938ad0798" status: 200 len: 1558 microversion: 2.21 time: 0.367198 Oct 04 21:51:13.758791 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 956/1966] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:51:13 2022] GET /compute/v2.1/servers/26a08c55-8019-43e6-aa28-fdf938ad0798 => generated 1558 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:51:13.776537 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-cb0140cc-4d5c-4a5d-8d63-398444e35000 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1096043456", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "42a7af1a-ab70-4431-afd7-8915bdbe4cf9"}], "block_device_mapping_v2": [{"uuid": "5e73a680-d81c-4148-8eb2-8fed93d96017", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:51:13.913980 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.network.neutron [None req-cb0140cc-4d5c-4a5d-8d63-398444e35000 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] validate_networks() for [('42a7af1a-ab70-4431-afd7-8915bdbe4cf9', None, None, None, None, None)] {{(pid=134101) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:51:14.080491 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-f9dfb5bd-c055-4130-b6d3-04133783d894 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ad048becf474fb972d4291422d810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dcfc7024fc49388c4bd5f25f03e60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:14.096614 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-f9dfb5bd-c055-4130-b6d3-04133783d894 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/3f0a02bc-7993-4849-8b3c-7572327b4799" status: 200 len: 1716 microversion: 2.1 time: 1.048035 Oct 04 21:51:14.098466 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1011/1967] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:51:13 2022] GET /compute/v2.1/servers/3f0a02bc-7993-4849-8b3c-7572327b4799 => generated 1716 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:51:14.107880 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-405229b5-74e3-4875-9589-86f4083f2aad tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:14.108762 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-405229b5-74e3-4875-9589-86f4083f2aad tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] [instance: 7d0ed6d0-981a-48a7-a676-5910b1257301] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:14.130939 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-405229b5-74e3-4875-9589-86f4083f2aad tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:14.149046 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-405229b5-74e3-4875-9589-86f4083f2aad tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:14.149967 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-405229b5-74e3-4875-9589-86f4083f2aad tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:14.150953 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-405229b5-74e3-4875-9589-86f4083f2aad tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:14.152413 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-405229b5-74e3-4875-9589-86f4083f2aad tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:14.153078 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-405229b5-74e3-4875-9589-86f4083f2aad tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:14.743882 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-405229b5-74e3-4875-9589-86f4083f2aad tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f11c77afc74a16bea945dd84e72ebe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94d03be22238422eba835ed522baf9c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:14.755677 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-405229b5-74e3-4875-9589-86f4083f2aad tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] 10.222.0.43 "GET /compute/v2.1/servers/7d0ed6d0-981a-48a7-a676-5910b1257301" status: 200 len: 1318 microversion: 2.1 time: 0.655839 Oct 04 21:51:14.776326 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1012/1968] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:51:14 2022] GET /compute/v2.1/servers/7d0ed6d0-981a-48a7-a676-5910b1257301 => generated 1318 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:51:14.791977 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-64e46b5c-41af-41bc-be14-922cad8f7ba7 req-b66a9a4f-c63c-4aa5-adb8-5323fe21e912 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4709e5d7-52a3-4a79-8835-d651dce0c34a", "tag": "bacddb90-9e3c-4a64-91f2-f0a88b83fec1"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:51:14.829183 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-64e46b5c-41af-41bc-be14-922cad8f7ba7 req-b66a9a4f-c63c-4aa5-adb8-5323fe21e912 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:14.829957 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-64e46b5c-41af-41bc-be14-922cad8f7ba7 req-b66a9a4f-c63c-4aa5-adb8-5323fe21e912 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:14.830580 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-64e46b5c-41af-41bc-be14-922cad8f7ba7 req-b66a9a4f-c63c-4aa5-adb8-5323fe21e912 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:14.855835 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-64e46b5c-41af-41bc-be14-922cad8f7ba7 req-b66a9a4f-c63c-4aa5-adb8-5323fe21e912 service nova] Creating event network-changed:bacddb90-9e3c-4a64-91f2-f0a88b83fec1 for instance 4709e5d7-52a3-4a79-8835-d651dce0c34a on n-h2-860284-1 Oct 04 21:51:14.916425 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-64e46b5c-41af-41bc-be14-922cad8f7ba7 req-b66a9a4f-c63c-4aa5-adb8-5323fe21e912 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.136693 Oct 04 21:51:14.923310 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1013/1969] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:51:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:51:14.936623 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-cd7de456-d474-4553-bb97-cafd0178989e tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:14.937562 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-cd7de456-d474-4553-bb97-cafd0178989e tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] [instance: 3f80e8f0-dba3-4403-83f8-0473c5d7d29b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:14.966035 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cd7de456-d474-4553-bb97-cafd0178989e tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:14.966561 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cd7de456-d474-4553-bb97-cafd0178989e tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:14.966994 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cd7de456-d474-4553-bb97-cafd0178989e tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:14.970294 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cd7de456-d474-4553-bb97-cafd0178989e tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:14.970831 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cd7de456-d474-4553-bb97-cafd0178989e tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:14.971264 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cd7de456-d474-4553-bb97-cafd0178989e tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:15.141861 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.objects.instance [None req-cd7de456-d474-4553-bb97-cafd0178989e tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Lazy-loading 'services' on Instance uuid 3f80e8f0-dba3-4403-83f8-0473c5d7d29b {{(pid=134102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:51:15.160711 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-cd7de456-d474-4553-bb97-cafd0178989e tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/3f80e8f0-dba3-4403-83f8-0473c5d7d29b" status: 200 len: 1923 microversion: 2.75 time: 0.235359 Oct 04 21:51:15.166256 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1014/1970] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:51:14 2022] GET /compute/v2.1/servers/3f80e8f0-dba3-4403-83f8-0473c5d7d29b => generated 1923 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:51:15.178398 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-680104a3-c248-4a30-9da8-4e43d46e76ae tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:15.179613 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-680104a3-c248-4a30-9da8-4e43d46e76ae tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] [instance: 26a08c55-8019-43e6-aa28-fdf938ad0798] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:15.188965 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-680104a3-c248-4a30-9da8-4e43d46e76ae tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:15.190005 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-680104a3-c248-4a30-9da8-4e43d46e76ae tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:15.191005 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-680104a3-c248-4a30-9da8-4e43d46e76ae tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:15.191676 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-680104a3-c248-4a30-9da8-4e43d46e76ae tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:15.192256 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-680104a3-c248-4a30-9da8-4e43d46e76ae tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:15.192865 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-680104a3-c248-4a30-9da8-4e43d46e76ae tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:15.834670 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-cb0140cc-4d5c-4a5d-8d63-398444e35000 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Flavor limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:51:15.837401 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-cb0140cc-4d5c-4a5d-8d63-398444e35000 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Image limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:51:15.838851 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-cb0140cc-4d5c-4a5d-8d63-398444e35000 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Flavor pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:51:15.839930 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-cb0140cc-4d5c-4a5d-8d63-398444e35000 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Image pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:51:15.840759 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-cb0140cc-4d5c-4a5d-8d63-398444e35000 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:51:15.855308 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cb0140cc-4d5c-4a5d-8d63-398444e35000 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:15.856295 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cb0140cc-4d5c-4a5d-8d63-398444e35000 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:15.857809 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cb0140cc-4d5c-4a5d-8d63-398444e35000 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:15.859570 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cb0140cc-4d5c-4a5d-8d63-398444e35000 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:15.861609 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cb0140cc-4d5c-4a5d-8d63-398444e35000 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:15.862428 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cb0140cc-4d5c-4a5d-8d63-398444e35000 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:15.890094 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-cb0140cc-4d5c-4a5d-8d63-398444e35000 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Getting quotas for project f17fee483fd14b07977669df199f3018. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:51:15.893013 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-680104a3-c248-4a30-9da8-4e43d46e76ae tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '301902a6e7bd419db1dc37123e2626aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fbc93887563467dba31d09e3803b962', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:15.903136 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-cb0140cc-4d5c-4a5d-8d63-398444e35000 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Getting quotas for user f529f881a037459d9405bd14afd7a639 and project f17fee483fd14b07977669df199f3018. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:51:15.909247 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-680104a3-c248-4a30-9da8-4e43d46e76ae tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '301902a6e7bd419db1dc37123e2626aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fbc93887563467dba31d09e3803b962', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:15.910828 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-680104a3-c248-4a30-9da8-4e43d46e76ae tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '301902a6e7bd419db1dc37123e2626aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fbc93887563467dba31d09e3803b962', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:15.911924 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-680104a3-c248-4a30-9da8-4e43d46e76ae tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] 10.222.0.43 "GET /compute/v2.1/servers/26a08c55-8019-43e6-aa28-fdf938ad0798" status: 200 len: 1558 microversion: 2.21 time: 0.743571 Oct 04 21:51:15.912508 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1015/1971] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:51:15 2022] GET /compute/v2.1/servers/26a08c55-8019-43e6-aa28-fdf938ad0798 => generated 1558 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:51:15.917294 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-53db11a6-5a56-4c69-907a-09477af4b529 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:15.918169 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-53db11a6-5a56-4c69-907a-09477af4b529 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 3f0a02bc-7993-4849-8b3c-7572327b4799] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:15.926100 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-53db11a6-5a56-4c69-907a-09477af4b529 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:15.926954 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-53db11a6-5a56-4c69-907a-09477af4b529 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:15.927605 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-53db11a6-5a56-4c69-907a-09477af4b529 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:15.928534 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-53db11a6-5a56-4c69-907a-09477af4b529 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:15.929164 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-53db11a6-5a56-4c69-907a-09477af4b529 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:15.929761 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-53db11a6-5a56-4c69-907a-09477af4b529 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:16.041128 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-cb0140cc-4d5c-4a5d-8d63-398444e35000 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Going to run 1 instances... {{(pid=134101) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:51:16.045209 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-cb0140cc-4d5c-4a5d-8d63-398444e35000 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] [instance: b646f5b5-a266-44df-80e6-5d1b2a3b91d7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5e73a680-d81c-4148-8eb2-8fed93d96017',volume_size=None,volume_type=None)] {{(pid=134101) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:51:16.120671 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-53db11a6-5a56-4c69-907a-09477af4b529 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ad048becf474fb972d4291422d810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dcfc7024fc49388c4bd5f25f03e60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:16.137593 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-53db11a6-5a56-4c69-907a-09477af4b529 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/3f0a02bc-7993-4849-8b3c-7572327b4799" status: 200 len: 1716 microversion: 2.1 time: 0.223776 Oct 04 21:51:16.139551 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1016/1972] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:51:15 2022] GET /compute/v2.1/servers/3f0a02bc-7993-4849-8b3c-7572327b4799 => generated 1716 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:51:16.155309 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-e77a08fd-6526-42de-bb42-9aa4f4052094 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:16.156480 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-e77a08fd-6526-42de-bb42-9aa4f4052094 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] [instance: 7d0ed6d0-981a-48a7-a676-5910b1257301] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:16.164351 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e77a08fd-6526-42de-bb42-9aa4f4052094 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:16.165152 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e77a08fd-6526-42de-bb42-9aa4f4052094 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:16.165743 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e77a08fd-6526-42de-bb42-9aa4f4052094 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:16.166716 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e77a08fd-6526-42de-bb42-9aa4f4052094 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:16.167357 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e77a08fd-6526-42de-bb42-9aa4f4052094 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:16.167945 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e77a08fd-6526-42de-bb42-9aa4f4052094 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:16.340866 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-cb0140cc-4d5c-4a5d-8d63-398444e35000 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 2.572550 Oct 04 21:51:16.344852 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 957/1973] 10.222.0.43 () {62 vars in 1188 bytes} [Tue Oct 4 21:51:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 2585 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 04 21:51:16.366973 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-f439a560-dddc-4b8d-8792-ded2cd77de30 tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:16.369835 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-f439a560-dddc-4b8d-8792-ded2cd77de30 tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] [instance: 3f80e8f0-dba3-4403-83f8-0473c5d7d29b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:16.407613 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f439a560-dddc-4b8d-8792-ded2cd77de30 tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:16.408126 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f439a560-dddc-4b8d-8792-ded2cd77de30 tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:16.408778 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f439a560-dddc-4b8d-8792-ded2cd77de30 tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:16.409698 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f439a560-dddc-4b8d-8792-ded2cd77de30 tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:16.410956 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f439a560-dddc-4b8d-8792-ded2cd77de30 tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:16.413486 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f439a560-dddc-4b8d-8792-ded2cd77de30 tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:16.612003 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.objects.instance [None req-f439a560-dddc-4b8d-8792-ded2cd77de30 tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Lazy-loading 'services' on Instance uuid 3f80e8f0-dba3-4403-83f8-0473c5d7d29b {{(pid=134101) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:51:16.616333 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-e77a08fd-6526-42de-bb42-9aa4f4052094 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f11c77afc74a16bea945dd84e72ebe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94d03be22238422eba835ed522baf9c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:16.629918 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-e77a08fd-6526-42de-bb42-9aa4f4052094 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] 10.222.0.43 "GET /compute/v2.1/servers/7d0ed6d0-981a-48a7-a676-5910b1257301" status: 200 len: 1318 microversion: 2.1 time: 0.486780 Oct 04 21:51:16.636301 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1017/1974] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:51:16 2022] GET /compute/v2.1/servers/7d0ed6d0-981a-48a7-a676-5910b1257301 => generated 1318 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:51:16.644931 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-f439a560-dddc-4b8d-8792-ded2cd77de30 tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/3f80e8f0-dba3-4403-83f8-0473c5d7d29b" status: 200 len: 1923 microversion: 2.75 time: 0.297258 Oct 04 21:51:16.650346 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-a0c03fa2-e9b2-4dd6-bad0-357c3a2a1be3 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:16.656636 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 958/1975] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:51:16 2022] GET /compute/v2.1/servers/3f80e8f0-dba3-4403-83f8-0473c5d7d29b => generated 1923 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:51:16.658501 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-a0c03fa2-e9b2-4dd6-bad0-357c3a2a1be3 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] [instance: b646f5b5-a266-44df-80e6-5d1b2a3b91d7] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:16.747228 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-a0c03fa2-e9b2-4dd6-bad0-357c3a2a1be3 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:16.755405 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-a0c03fa2-e9b2-4dd6-bad0-357c3a2a1be3 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:16.757249 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-a0c03fa2-e9b2-4dd6-bad0-357c3a2a1be3 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:16.758635 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-a0c03fa2-e9b2-4dd6-bad0-357c3a2a1be3 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] 10.222.0.43 "GET /compute/v2.1/servers/b646f5b5-a266-44df-80e6-5d1b2a3b91d7" status: 200 len: 1104 microversion: 2.25 time: 0.119113 Oct 04 21:51:16.760106 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1018/1976] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:51:16 2022] GET /compute/v2.1/servers/b646f5b5-a266-44df-80e6-5d1b2a3b91d7 => generated 1104 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:51:16.944992 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-305a92a8-4e80-452b-aac0-150fbdad725b tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:16.946465 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-305a92a8-4e80-452b-aac0-150fbdad725b tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] [instance: 26a08c55-8019-43e6-aa28-fdf938ad0798] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:16.960952 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-305a92a8-4e80-452b-aac0-150fbdad725b tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:16.961886 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-305a92a8-4e80-452b-aac0-150fbdad725b tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:16.962791 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-305a92a8-4e80-452b-aac0-150fbdad725b tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:16.964074 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-305a92a8-4e80-452b-aac0-150fbdad725b tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:16.964836 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-305a92a8-4e80-452b-aac0-150fbdad725b tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:16.965542 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-305a92a8-4e80-452b-aac0-150fbdad725b tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:17.070752 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-1f51e836-35dc-4058-aacd-d363b6cfd7a4 req-8d43534d-49f0-4d58-b9a9-22a45866f061 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26a08c55-8019-43e6-aa28-fdf938ad0798", "name": "network-vif-deleted", "tag": "d8a8ee90-a00c-4ea8-af05-ce15a6a5f49e"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:51:17.099245 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-305a92a8-4e80-452b-aac0-150fbdad725b tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '301902a6e7bd419db1dc37123e2626aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fbc93887563467dba31d09e3803b962', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:17.139655 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-305a92a8-4e80-452b-aac0-150fbdad725b tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '301902a6e7bd419db1dc37123e2626aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fbc93887563467dba31d09e3803b962', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:17.149488 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-305a92a8-4e80-452b-aac0-150fbdad725b tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '301902a6e7bd419db1dc37123e2626aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fbc93887563467dba31d09e3803b962', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:17.155291 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-305a92a8-4e80-452b-aac0-150fbdad725b tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] 10.222.0.43 "GET /compute/v2.1/servers/26a08c55-8019-43e6-aa28-fdf938ad0798" status: 200 len: 1516 microversion: 2.21 time: 0.215903 Oct 04 21:51:17.160515 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-1f51e836-35dc-4058-aacd-d363b6cfd7a4 req-8d43534d-49f0-4d58-b9a9-22a45866f061 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:17.162027 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 959/1977] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:51:16 2022] GET /compute/v2.1/servers/26a08c55-8019-43e6-aa28-fdf938ad0798 => generated 1516 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:51:17.178803 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-1f51e836-35dc-4058-aacd-d363b6cfd7a4 req-8d43534d-49f0-4d58-b9a9-22a45866f061 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:17.181423 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-a72756bb-7a6c-42bf-bf41-f2f7b550d071 req-53f72fd2-56c3-41ad-91a1-9df05cb5ce89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f8a46c4-3b6f-4f50-8227-77b69154fb57", "name": "network-vif-plugged", "status": "completed", "tag": "0b8186cd-d9f4-408f-9942-a8fcb3a46521"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:51:17.183252 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-1f51e836-35dc-4058-aacd-d363b6cfd7a4 req-8d43534d-49f0-4d58-b9a9-22a45866f061 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:17.209584 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-a72756bb-7a6c-42bf-bf41-f2f7b550d071 req-53f72fd2-56c3-41ad-91a1-9df05cb5ce89 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:17.212697 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-a72756bb-7a6c-42bf-bf41-f2f7b550d071 req-53f72fd2-56c3-41ad-91a1-9df05cb5ce89 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:17.213467 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-a72756bb-7a6c-42bf-bf41-f2f7b550d071 req-53f72fd2-56c3-41ad-91a1-9df05cb5ce89 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:17.221262 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-1f51e836-35dc-4058-aacd-d363b6cfd7a4 req-8d43534d-49f0-4d58-b9a9-22a45866f061 service nova] Creating event network-vif-deleted:d8a8ee90-a00c-4ea8-af05-ce15a6a5f49e for instance 26a08c55-8019-43e6-aa28-fdf938ad0798 on n-h1-860284-1 Oct 04 21:51:17.234134 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-1f51e836-35dc-4058-aacd-d363b6cfd7a4 req-8d43534d-49f0-4d58-b9a9-22a45866f061 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.167258 Oct 04 21:51:17.236273 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1019/1978] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:51:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:51:17.245344 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-96c8f8da-bf7c-402b-840a-18778d3c6a8a tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:17.246439 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-96c8f8da-bf7c-402b-840a-18778d3c6a8a tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 3f0a02bc-7993-4849-8b3c-7572327b4799] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:17.248244 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-a72756bb-7a6c-42bf-bf41-f2f7b550d071 req-53f72fd2-56c3-41ad-91a1-9df05cb5ce89 service nova] Creating event network-vif-plugged:0b8186cd-d9f4-408f-9942-a8fcb3a46521 for instance 6f8a46c4-3b6f-4f50-8227-77b69154fb57 on n-h2-860284-1 Oct 04 21:51:17.260743 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-96c8f8da-bf7c-402b-840a-18778d3c6a8a tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:17.262456 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-a72756bb-7a6c-42bf-bf41-f2f7b550d071 req-53f72fd2-56c3-41ad-91a1-9df05cb5ce89 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097230 Oct 04 21:51:17.266052 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 960/1979] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:51:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:51:17.271764 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-96c8f8da-bf7c-402b-840a-18778d3c6a8a tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:17.272476 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-96c8f8da-bf7c-402b-840a-18778d3c6a8a tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:17.273248 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-96c8f8da-bf7c-402b-840a-18778d3c6a8a tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:17.275253 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-96c8f8da-bf7c-402b-840a-18778d3c6a8a tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:17.276251 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-96c8f8da-bf7c-402b-840a-18778d3c6a8a tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:17.319883 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=100 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:51:17.636976 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-96c8f8da-bf7c-402b-840a-18778d3c6a8a tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ad048becf474fb972d4291422d810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dcfc7024fc49388c4bd5f25f03e60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:17.651569 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-96c8f8da-bf7c-402b-840a-18778d3c6a8a tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/3f0a02bc-7993-4849-8b3c-7572327b4799" status: 200 len: 1706 microversion: 2.1 time: 0.413882 Oct 04 21:51:17.652190 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1020/1980] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:51:17 2022] GET /compute/v2.1/servers/3f0a02bc-7993-4849-8b3c-7572327b4799 => generated 1706 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:51:17.663581 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-b193f7a3-859b-4944-b4d5-829fef9d6b37 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:17.665778 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-b193f7a3-859b-4944-b4d5-829fef9d6b37 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] [instance: 7d0ed6d0-981a-48a7-a676-5910b1257301] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:17.680366 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-cefef18d-e8fd-4385-854f-d4f0ff054eb0 tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:17.680769 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-cefef18d-e8fd-4385-854f-d4f0ff054eb0 tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] [instance: 3f80e8f0-dba3-4403-83f8-0473c5d7d29b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:17.681253 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b193f7a3-859b-4944-b4d5-829fef9d6b37 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:17.682053 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b193f7a3-859b-4944-b4d5-829fef9d6b37 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:17.682777 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b193f7a3-859b-4944-b4d5-829fef9d6b37 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:17.683843 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b193f7a3-859b-4944-b4d5-829fef9d6b37 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:17.685064 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b193f7a3-859b-4944-b4d5-829fef9d6b37 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:17.685670 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b193f7a3-859b-4944-b4d5-829fef9d6b37 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:17.688937 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cefef18d-e8fd-4385-854f-d4f0ff054eb0 tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:17.689254 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cefef18d-e8fd-4385-854f-d4f0ff054eb0 tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:17.689806 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cefef18d-e8fd-4385-854f-d4f0ff054eb0 tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:17.690655 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cefef18d-e8fd-4385-854f-d4f0ff054eb0 tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:17.691139 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cefef18d-e8fd-4385-854f-d4f0ff054eb0 tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:17.692428 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cefef18d-e8fd-4385-854f-d4f0ff054eb0 tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:17.830679 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.objects.instance [None req-cefef18d-e8fd-4385-854f-d4f0ff054eb0 tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Lazy-loading 'services' on Instance uuid 3f80e8f0-dba3-4403-83f8-0473c5d7d29b {{(pid=134102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:51:17.851778 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-cefef18d-e8fd-4385-854f-d4f0ff054eb0 tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/3f80e8f0-dba3-4403-83f8-0473c5d7d29b" status: 200 len: 1923 microversion: 2.75 time: 0.178849 Oct 04 21:51:17.852390 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1021/1981] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:51:17 2022] GET /compute/v2.1/servers/3f80e8f0-dba3-4403-83f8-0473c5d7d29b => generated 1923 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:51:17.859706 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-e1365e4b-67fa-4357-89de-3de4bee4af25 tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Calling method '.version_select at 0x7fbb2e958ee0>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:17.864275 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e1365e4b-67fa-4357-89de-3de4bee4af25 tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:17.865924 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e1365e4b-67fa-4357-89de-3de4bee4af25 tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:17.866705 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e1365e4b-67fa-4357-89de-3de4bee4af25 tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:17.883853 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-e1365e4b-67fa-4357-89de-3de4bee4af25 tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] 10.222.0.43 "GET /compute/v2.1/os-migrations" status: 200 len: 2319 microversion: 2.1 time: 0.030159 Oct 04 21:51:17.885404 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1022/1982] 10.222.0.43 () {58 vars in 1143 bytes} [Tue Oct 4 21:51:17 2022] GET /compute/v2.1/os-migrations => generated 2319 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:51:17.891660 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-32955457-e50c-422d-92e0-68b31f7ff623 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:17.892611 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-32955457-e50c-422d-92e0-68b31f7ff623 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] [instance: b646f5b5-a266-44df-80e6-5d1b2a3b91d7] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:17.900080 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-32955457-e50c-422d-92e0-68b31f7ff623 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:17.900876 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-32955457-e50c-422d-92e0-68b31f7ff623 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:17.901525 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-32955457-e50c-422d-92e0-68b31f7ff623 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:17.902524 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-32955457-e50c-422d-92e0-68b31f7ff623 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:17.903241 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-32955457-e50c-422d-92e0-68b31f7ff623 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:17.903853 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-32955457-e50c-422d-92e0-68b31f7ff623 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:17.995909 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-32955457-e50c-422d-92e0-68b31f7ff623 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:18.009538 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-32955457-e50c-422d-92e0-68b31f7ff623 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:18.011682 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-32955457-e50c-422d-92e0-68b31f7ff623 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:18.020385 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-32955457-e50c-422d-92e0-68b31f7ff623 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] 10.222.0.43 "GET /compute/v2.1/servers/b646f5b5-a266-44df-80e6-5d1b2a3b91d7" status: 200 len: 1177 microversion: 2.25 time: 0.133018 Oct 04 21:51:18.021450 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-b193f7a3-859b-4944-b4d5-829fef9d6b37 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f11c77afc74a16bea945dd84e72ebe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94d03be22238422eba835ed522baf9c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:18.027142 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1023/1983] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:51:17 2022] GET /compute/v2.1/servers/b646f5b5-a266-44df-80e6-5d1b2a3b91d7 => generated 1177 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:51:18.033262 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-e7ae7ed9-7240-41f8-8432-12bd06b0998d tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:18.034786 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-e7ae7ed9-7240-41f8-8432-12bd06b0998d tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] [instance: 3f0a02bc-7993-4849-8b3c-7572327b4799] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:18.044057 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e7ae7ed9-7240-41f8-8432-12bd06b0998d tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:18.044900 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e7ae7ed9-7240-41f8-8432-12bd06b0998d tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:18.045513 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e7ae7ed9-7240-41f8-8432-12bd06b0998d tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:18.047069 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e7ae7ed9-7240-41f8-8432-12bd06b0998d tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:18.047787 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e7ae7ed9-7240-41f8-8432-12bd06b0998d tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:18.048446 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e7ae7ed9-7240-41f8-8432-12bd06b0998d tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:18.056640 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-b193f7a3-859b-4944-b4d5-829fef9d6b37 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] 10.222.0.43 "GET /compute/v2.1/servers/7d0ed6d0-981a-48a7-a676-5910b1257301" status: 200 len: 1318 microversion: 2.1 time: 0.396068 Oct 04 21:51:18.057660 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 961/1984] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:51:17 2022] GET /compute/v2.1/servers/7d0ed6d0-981a-48a7-a676-5910b1257301 => generated 1318 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:51:18.201085 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-8e86a1ea-2be7-47ad-8821-8b4abae759ba tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:18.201936 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-8e86a1ea-2be7-47ad-8821-8b4abae759ba tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] [instance: 26a08c55-8019-43e6-aa28-fdf938ad0798] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:18.212543 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8e86a1ea-2be7-47ad-8821-8b4abae759ba tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:18.223089 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8e86a1ea-2be7-47ad-8821-8b4abae759ba tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:18.223709 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8e86a1ea-2be7-47ad-8821-8b4abae759ba tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:18.224603 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8e86a1ea-2be7-47ad-8821-8b4abae759ba tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:18.225172 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8e86a1ea-2be7-47ad-8821-8b4abae759ba tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:18.225731 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8e86a1ea-2be7-47ad-8821-8b4abae759ba tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:18.304034 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8e86a1ea-2be7-47ad-8821-8b4abae759ba tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:18.305603 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8e86a1ea-2be7-47ad-8821-8b4abae759ba tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:18.307013 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8e86a1ea-2be7-47ad-8821-8b4abae759ba tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:18.307661 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.objects.instance [None req-8e86a1ea-2be7-47ad-8821-8b4abae759ba tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Lazy-loading 'fault' on Instance uuid 26a08c55-8019-43e6-aa28-fdf938ad0798 {{(pid=134101) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:51:18.313917 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-e7ae7ed9-7240-41f8-8432-12bd06b0998d tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/3f0a02bc-7993-4849-8b3c-7572327b4799" status: 200 len: 1857 microversion: 2.1 time: 0.285204 Oct 04 21:51:18.315164 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1024/1985] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:51:18 2022] GET /compute/v2.1/servers/3f0a02bc-7993-4849-8b3c-7572327b4799 => generated 1857 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:51:18.338829 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-35a6a262-3fb4-4cc9-8821-781dac600e9e tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:18.339456 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-35a6a262-3fb4-4cc9-8821-781dac600e9e tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] [instance: 3f0a02bc-7993-4849-8b3c-7572327b4799] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:18.346040 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-35a6a262-3fb4-4cc9-8821-781dac600e9e tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:18.346570 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-35a6a262-3fb4-4cc9-8821-781dac600e9e tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:18.347015 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-35a6a262-3fb4-4cc9-8821-781dac600e9e tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:18.347726 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-35a6a262-3fb4-4cc9-8821-781dac600e9e tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:18.349400 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-35a6a262-3fb4-4cc9-8821-781dac600e9e tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:18.350021 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-35a6a262-3fb4-4cc9-8821-781dac600e9e tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:18.371718 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-8e86a1ea-2be7-47ad-8821-8b4abae759ba tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '301902a6e7bd419db1dc37123e2626aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fbc93887563467dba31d09e3803b962', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:18.392253 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-8e86a1ea-2be7-47ad-8821-8b4abae759ba tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '301902a6e7bd419db1dc37123e2626aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fbc93887563467dba31d09e3803b962', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:18.393998 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-8e86a1ea-2be7-47ad-8821-8b4abae759ba tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '301902a6e7bd419db1dc37123e2626aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fbc93887563467dba31d09e3803b962', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:18.395244 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-8e86a1ea-2be7-47ad-8821-8b4abae759ba tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] 10.222.0.43 "GET /compute/v2.1/servers/26a08c55-8019-43e6-aa28-fdf938ad0798" status: 200 len: 1349 microversion: 2.21 time: 0.201901 Oct 04 21:51:18.403696 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 962/1986] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:51:18 2022] GET /compute/v2.1/servers/26a08c55-8019-43e6-aa28-fdf938ad0798 => generated 1349 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:51:18.795595 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-35a6a262-3fb4-4cc9-8821-781dac600e9e tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/3f0a02bc-7993-4849-8b3c-7572327b4799" status: 200 len: 1857 microversion: 2.1 time: 0.460937 Oct 04 21:51:18.796991 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1025/1987] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:51:18 2022] GET /compute/v2.1/servers/3f0a02bc-7993-4849-8b3c-7572327b4799 => generated 1857 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:51:18.884218 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-6eca6852-ab67-4ab1-b0f6-d698b150a39d tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:18.885042 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-6eca6852-ab67-4ab1-b0f6-d698b150a39d tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] [instance: 3f80e8f0-dba3-4403-83f8-0473c5d7d29b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:18.894807 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6eca6852-ab67-4ab1-b0f6-d698b150a39d tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:18.895307 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6eca6852-ab67-4ab1-b0f6-d698b150a39d tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:18.895818 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6eca6852-ab67-4ab1-b0f6-d698b150a39d tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:18.896685 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6eca6852-ab67-4ab1-b0f6-d698b150a39d tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:18.897200 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6eca6852-ab67-4ab1-b0f6-d698b150a39d tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:18.897772 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6eca6852-ab67-4ab1-b0f6-d698b150a39d tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:18.902133 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-3fd7319b-e340-4a8f-9863-78002a4a60e0 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:18.902691 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-3fd7319b-e340-4a8f-9863-78002a4a60e0 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 3f0a02bc-7993-4849-8b3c-7572327b4799] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:18.910135 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3fd7319b-e340-4a8f-9863-78002a4a60e0 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:18.910906 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3fd7319b-e340-4a8f-9863-78002a4a60e0 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:18.911560 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3fd7319b-e340-4a8f-9863-78002a4a60e0 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:18.912752 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3fd7319b-e340-4a8f-9863-78002a4a60e0 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:18.913375 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3fd7319b-e340-4a8f-9863-78002a4a60e0 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:18.913968 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3fd7319b-e340-4a8f-9863-78002a4a60e0 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:19.001062 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.objects.instance [None req-6eca6852-ab67-4ab1-b0f6-d698b150a39d tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Lazy-loading 'services' on Instance uuid 3f80e8f0-dba3-4403-83f8-0473c5d7d29b {{(pid=134101) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:51:19.033614 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-6eca6852-ab67-4ab1-b0f6-d698b150a39d tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/3f80e8f0-dba3-4403-83f8-0473c5d7d29b" status: 200 len: 1923 microversion: 2.75 time: 0.152869 Oct 04 21:51:19.036536 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 963/1988] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:51:18 2022] GET /compute/v2.1/servers/3f80e8f0-dba3-4403-83f8-0473c5d7d29b => generated 1923 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:51:19.052509 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-f8a1959d-ca80-472b-8e1b-552ec5f336bb tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:19.053696 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-f8a1959d-ca80-472b-8e1b-552ec5f336bb tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] [instance: b646f5b5-a266-44df-80e6-5d1b2a3b91d7] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:19.060515 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f8a1959d-ca80-472b-8e1b-552ec5f336bb tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:19.061396 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f8a1959d-ca80-472b-8e1b-552ec5f336bb tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:19.061936 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f8a1959d-ca80-472b-8e1b-552ec5f336bb tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:19.063027 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f8a1959d-ca80-472b-8e1b-552ec5f336bb tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:19.063596 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f8a1959d-ca80-472b-8e1b-552ec5f336bb tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:19.064049 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f8a1959d-ca80-472b-8e1b-552ec5f336bb tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:19.079264 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.objects.instance [None req-3fd7319b-e340-4a8f-9863-78002a4a60e0 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lazy-loading 'services' on Instance uuid 3f0a02bc-7993-4849-8b3c-7572327b4799 {{(pid=134102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:51:19.161970 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-f8a1959d-ca80-472b-8e1b-552ec5f336bb tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:19.184768 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-f8a1959d-ca80-472b-8e1b-552ec5f336bb tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:19.186557 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-f8a1959d-ca80-472b-8e1b-552ec5f336bb tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:19.188621 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-f8a1959d-ca80-472b-8e1b-552ec5f336bb tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] 10.222.0.43 "GET /compute/v2.1/servers/b646f5b5-a266-44df-80e6-5d1b2a3b91d7" status: 200 len: 1241 microversion: 2.25 time: 0.140562 Oct 04 21:51:19.189303 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 964/1989] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:51:19 2022] GET /compute/v2.1/servers/b646f5b5-a266-44df-80e6-5d1b2a3b91d7 => generated 1241 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:51:19.198598 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-f758b0a6-30f7-43d3-b25e-549e05b372cf tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:19.200846 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-f758b0a6-30f7-43d3-b25e-549e05b372cf tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] [instance: 7d0ed6d0-981a-48a7-a676-5910b1257301] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:19.215233 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f758b0a6-30f7-43d3-b25e-549e05b372cf tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:19.216928 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f758b0a6-30f7-43d3-b25e-549e05b372cf tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:19.217764 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f758b0a6-30f7-43d3-b25e-549e05b372cf tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:19.219509 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f758b0a6-30f7-43d3-b25e-549e05b372cf tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:19.220138 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f758b0a6-30f7-43d3-b25e-549e05b372cf tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:19.220684 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f758b0a6-30f7-43d3-b25e-549e05b372cf tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:19.260954 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-3fd7319b-e340-4a8f-9863-78002a4a60e0 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "DELETE /compute/v2.1/servers/3f0a02bc-7993-4849-8b3c-7572327b4799/os-volume_attachments/7c49ea41-da52-4911-8ad8-b4d606e49777" status: 202 len: 0 microversion: 2.1 time: 0.367076 Oct 04 21:51:19.261634 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1026/1990] 10.222.0.43 () {58 vars in 1416 bytes} [Tue Oct 4 21:51:18 2022] DELETE /compute/v2.1/servers/3f0a02bc-7993-4849-8b3c-7572327b4799/os-volume_attachments/7c49ea41-da52-4911-8ad8-b4d606e49777 => generated 0 bytes in 369 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 21:51:19.276184 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-f374b24c-36f8-42cf-a0e5-b99231a172b6 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:19.283349 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-f374b24c-36f8-42cf-a0e5-b99231a172b6 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 3f0a02bc-7993-4849-8b3c-7572327b4799] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:19.298058 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f374b24c-36f8-42cf-a0e5-b99231a172b6 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:19.298606 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f374b24c-36f8-42cf-a0e5-b99231a172b6 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:19.299052 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f374b24c-36f8-42cf-a0e5-b99231a172b6 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:19.300034 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f374b24c-36f8-42cf-a0e5-b99231a172b6 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:19.300505 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f374b24c-36f8-42cf-a0e5-b99231a172b6 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:19.300902 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f374b24c-36f8-42cf-a0e5-b99231a172b6 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:19.346095 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-f374b24c-36f8-42cf-a0e5-b99231a172b6 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/3f0a02bc-7993-4849-8b3c-7572327b4799/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076766 Oct 04 21:51:19.347483 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1027/1991] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 21:51:19 2022] GET /compute/v2.1/servers/3f0a02bc-7993-4849-8b3c-7572327b4799/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:51:19.429547 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-02140e55-a1f2-4ee4-bdcb-2d3d8d6f8a19 tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:19.430726 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-02140e55-a1f2-4ee4-bdcb-2d3d8d6f8a19 tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] [instance: 26a08c55-8019-43e6-aa28-fdf938ad0798] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:19.441515 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-02140e55-a1f2-4ee4-bdcb-2d3d8d6f8a19 tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:19.442180 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-02140e55-a1f2-4ee4-bdcb-2d3d8d6f8a19 tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:19.442659 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-02140e55-a1f2-4ee4-bdcb-2d3d8d6f8a19 tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:19.443657 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-02140e55-a1f2-4ee4-bdcb-2d3d8d6f8a19 tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:19.448439 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-02140e55-a1f2-4ee4-bdcb-2d3d8d6f8a19 tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:19.449401 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-02140e55-a1f2-4ee4-bdcb-2d3d8d6f8a19 tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:19.473196 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-f758b0a6-30f7-43d3-b25e-549e05b372cf tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f11c77afc74a16bea945dd84e72ebe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94d03be22238422eba835ed522baf9c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:19.479202 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-02140e55-a1f2-4ee4-bdcb-2d3d8d6f8a19 tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] HTTP exception thrown: Instance 26a08c55-8019-43e6-aa28-fdf938ad0798 could not be found. Oct 04 21:51:19.481072 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-02140e55-a1f2-4ee4-bdcb-2d3d8d6f8a19 tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Request method failure captured: Oct 04 21:51:19.481072 n-d-860284-1 devstack@n-api.service[134102]: request: GET /compute/v2.1/servers/26a08c55-8019-43e6-aa28-fdf938ad0798 HTTP/1.1 Oct 04 21:51:19.481072 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 21:51:19.481072 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 21:51:19.481072 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 21:51:19.481072 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 21:51:19.481072 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 21:51:19.481072 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 21:51:19.481072 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 21:51:19.481072 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 21:51:19.481072 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPKq5Lt8_cX4TPN6QbGtLAgE1Px9vmMFr7K5a7XfMtQsvTuWQGBxiUQJzCK4EK1tb930dgVylRZrZzmaNzgcyWXXwS1EjEdjK6m-dd0Kk1fa0NbIUriFGrYRp1myYWsQ6ioGtG59c7nLXtUttAq2_q3v8i2kJRLrrEl7s4oEV7Ol86R0 Oct 04 21:51:19.481072 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 21:51:19.481072 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 21:51:19.481072 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 21:51:19.481072 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 21:51:19.481072 n-d-860284-1 devstack@n-api.service[134102]: X-Openstack-Nova-Api-Version: 2.21 Oct 04 21:51:19.481072 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 21:51:19.481072 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 21:51:19.481072 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: 4fbc93887563467dba31d09e3803b962 Oct 04 21:51:19.481072 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-InstanceActionsV221TestJSON-2117819383 Oct 04 21:51:19.481072 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 21:51:19.481072 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 21:51:19.481072 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4fbc93887563467dba31d09e3803b962"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_4fbc93887563467dba31d09e3803b962", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4fbc93887563467dba31d09e3803b962"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/4fbc93887563467dba31d09e3803b962"}]}] Oct 04 21:51:19.481072 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-InstanceActionsV221TestJSON-2117819383 Oct 04 21:51:19.481072 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: 4fbc93887563467dba31d09e3803b962 Oct 04 21:51:19.481072 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-2117819383 Oct 04 21:51:19.481072 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-InstanceActionsV221TestJSON-2117819383-project Oct 04 21:51:19.481072 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 21:51:19.481072 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 21:51:19.481072 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: 301902a6e7bd419db1dc37123e2626aa Oct 04 21:51:19.481072 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-InstanceActionsV221TestJSON-2117819383-project Oct 04 21:51:19.481072 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 21:51:19.481072 n-d-860284-1 devstack@n-api.service[134102]: exception: Instance 26a08c55-8019-43e6-aa28-fdf938ad0798 could not be found. Oct 04 21:51:19.481072 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': '26a08c55-8019-43e6-aa28-fdf938ad0798'} Oct 04 21:51:19.481072 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:51:19.481072 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:51:19.481072 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:51:19.481072 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:51:19.481072 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:51:19.481072 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:51:19.481072 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:51:19.481072 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:51:19.481072 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:51:19.481072 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:51:19.481072 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26a08c55-8019-43e6-aa28-fdf938ad0798 could not be found. Oct 04 21:51:19.481072 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:51:19.481072 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:51:19.481072 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:51:19.481072 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:51:19.481072 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:51:19.481072 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:51:19.481072 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:51:19.481072 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:51:19.481072 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:51:19.481072 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:51:19.481072 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:51:19.481072 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:51:19.481072 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:51:19.481072 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:51:19.481072 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:51:19.481072 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:51:19.481072 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26a08c55-8019-43e6-aa28-fdf938ad0798 could not be found. Oct 04 21:51:19.481072 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:51:19.481072 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:51:19.487763 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:51:19.487763 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:51:19.487763 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:51:19.487763 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:51:19.487763 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:51:19.487763 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:51:19.487763 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26a08c55-8019-43e6-aa28-fdf938ad0798 could not be found. Oct 04 21:51:19.487763 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:51:19.487763 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-02140e55-a1f2-4ee4-bdcb-2d3d8d6f8a19 tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Returning 404 to user: Instance 26a08c55-8019-43e6-aa28-fdf938ad0798 could not be found. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:51:19.487763 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-02140e55-a1f2-4ee4-bdcb-2d3d8d6f8a19 tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] 10.222.0.43 "GET /compute/v2.1/servers/26a08c55-8019-43e6-aa28-fdf938ad0798" status: 404 len: 111 microversion: 2.21 time: 0.061300 Oct 04 21:51:19.490205 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1028/1992] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:51:19 2022] GET /compute/v2.1/servers/26a08c55-8019-43e6-aa28-fdf938ad0798 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 04 21:51:19.496250 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-f758b0a6-30f7-43d3-b25e-549e05b372cf tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] 10.222.0.43 "GET /compute/v2.1/servers/7d0ed6d0-981a-48a7-a676-5910b1257301" status: 200 len: 1318 microversion: 2.1 time: 0.303244 Oct 04 21:51:19.510393 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 965/1993] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:51:19 2022] GET /compute/v2.1/servers/7d0ed6d0-981a-48a7-a676-5910b1257301 => generated 1318 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:51:19.519650 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-332da635-9d13-45fd-8ea6-3336b8c4d7c0 tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Calling method '.version_select at 0x7fbb2e97a550>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:19.520338 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-332da635-9d13-45fd-8ea6-3336b8c4d7c0 tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] [instance: 26a08c55-8019-43e6-aa28-fdf938ad0798] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:19.532599 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-332da635-9d13-45fd-8ea6-3336b8c4d7c0 tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:19.537300 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-332da635-9d13-45fd-8ea6-3336b8c4d7c0 tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:19.537791 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-332da635-9d13-45fd-8ea6-3336b8c4d7c0 tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:19.538641 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-332da635-9d13-45fd-8ea6-3336b8c4d7c0 tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:19.539171 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-332da635-9d13-45fd-8ea6-3336b8c4d7c0 tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:19.539665 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-332da635-9d13-45fd-8ea6-3336b8c4d7c0 tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:19.639684 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-332da635-9d13-45fd-8ea6-3336b8c4d7c0 tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] 10.222.0.43 "GET /compute/v2.1/servers/26a08c55-8019-43e6-aa28-fdf938ad0798/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.136580 Oct 04 21:51:19.643359 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1029/1994] 10.222.0.43 () {60 vars in 1337 bytes} [Tue Oct 4 21:51:19 2022] GET /compute/v2.1/servers/26a08c55-8019-43e6-aa28-fdf938ad0798/os-instance-actions => generated 611 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:51:19.658966 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-90528e86-8b2a-45a9-8a22-9e95d09b1e23 tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:19.659568 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-90528e86-8b2a-45a9-8a22-9e95d09b1e23 tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] [instance: 26a08c55-8019-43e6-aa28-fdf938ad0798] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:19.667683 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-90528e86-8b2a-45a9-8a22-9e95d09b1e23 tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:19.668267 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-90528e86-8b2a-45a9-8a22-9e95d09b1e23 tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:19.668793 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-90528e86-8b2a-45a9-8a22-9e95d09b1e23 tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:19.669579 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-90528e86-8b2a-45a9-8a22-9e95d09b1e23 tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:19.670112 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-90528e86-8b2a-45a9-8a22-9e95d09b1e23 tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:19.670788 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-90528e86-8b2a-45a9-8a22-9e95d09b1e23 tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:19.674272 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:51:19.705805 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-90528e86-8b2a-45a9-8a22-9e95d09b1e23 tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] HTTP exception thrown: Instance 26a08c55-8019-43e6-aa28-fdf938ad0798 could not be found. Oct 04 21:51:19.708223 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-90528e86-8b2a-45a9-8a22-9e95d09b1e23 tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Request method failure captured: Oct 04 21:51:19.708223 n-d-860284-1 devstack@n-api.service[134101]: request: DELETE /compute/v2.1/servers/26a08c55-8019-43e6-aa28-fdf938ad0798 HTTP/1.1 Oct 04 21:51:19.708223 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 21:51:19.708223 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 21:51:19.708223 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 21:51:19.708223 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 21:51:19.708223 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 21:51:19.708223 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 21:51:19.708223 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 21:51:19.708223 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 21:51:19.708223 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPKq5Lt8_cX4TPN6QbGtLAgE1Px9vmMFr7K5a7XfMtQsvTuWQGBxiUQJzCK4EK1tb930dgVylRZrZzmaNzgcyWXXwS1EjEdjK6m-dd0Kk1fa0NbIUriFGrYRp1myYWsQ6ioGtG59c7nLXtUttAq2_q3v8i2kJRLrrEl7s4oEV7Ol86R0 Oct 04 21:51:19.708223 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 21:51:19.708223 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 21:51:19.708223 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 21:51:19.708223 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 21:51:19.708223 n-d-860284-1 devstack@n-api.service[134101]: X-Openstack-Nova-Api-Version: 2.21 Oct 04 21:51:19.708223 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 21:51:19.708223 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 21:51:19.708223 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: 4fbc93887563467dba31d09e3803b962 Oct 04 21:51:19.708223 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-InstanceActionsV221TestJSON-2117819383 Oct 04 21:51:19.708223 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 21:51:19.708223 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 21:51:19.708223 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4fbc93887563467dba31d09e3803b962"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_4fbc93887563467dba31d09e3803b962", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4fbc93887563467dba31d09e3803b962"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/4fbc93887563467dba31d09e3803b962"}]}] Oct 04 21:51:19.708223 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-InstanceActionsV221TestJSON-2117819383 Oct 04 21:51:19.708223 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: 4fbc93887563467dba31d09e3803b962 Oct 04 21:51:19.708223 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-2117819383 Oct 04 21:51:19.708223 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-InstanceActionsV221TestJSON-2117819383-project Oct 04 21:51:19.708223 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 21:51:19.708223 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 21:51:19.708223 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 301902a6e7bd419db1dc37123e2626aa Oct 04 21:51:19.708223 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-InstanceActionsV221TestJSON-2117819383-project Oct 04 21:51:19.708223 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 21:51:19.708223 n-d-860284-1 devstack@n-api.service[134101]: exception: Instance 26a08c55-8019-43e6-aa28-fdf938ad0798 could not be found. Oct 04 21:51:19.708223 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': '26a08c55-8019-43e6-aa28-fdf938ad0798'} Oct 04 21:51:19.708223 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:51:19.708223 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:51:19.708223 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:51:19.708223 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:51:19.708223 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:51:19.708223 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:51:19.708223 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:51:19.708223 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:51:19.708223 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:51:19.708223 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:51:19.708223 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26a08c55-8019-43e6-aa28-fdf938ad0798 could not be found. Oct 04 21:51:19.708223 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:51:19.708223 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:51:19.708223 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:51:19.708223 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:51:19.708223 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:51:19.708223 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:51:19.708223 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:51:19.708223 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:51:19.708223 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:51:19.708223 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:51:19.708223 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 21:51:19.708223 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 21:51:19.708223 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 21:51:19.708223 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 21:51:19.708223 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:51:19.708223 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:51:19.708223 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:51:19.708223 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:51:19.714324 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26a08c55-8019-43e6-aa28-fdf938ad0798 could not be found. Oct 04 21:51:19.714324 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:51:19.714324 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:51:19.714324 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:51:19.714324 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:51:19.714324 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:51:19.714324 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:51:19.714324 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:51:19.714324 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:51:19.714324 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26a08c55-8019-43e6-aa28-fdf938ad0798 could not be found. Oct 04 21:51:19.714324 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:51:19.727457 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-90528e86-8b2a-45a9-8a22-9e95d09b1e23 tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Returning 404 to user: Instance 26a08c55-8019-43e6-aa28-fdf938ad0798 could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:51:19.727457 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-90528e86-8b2a-45a9-8a22-9e95d09b1e23 tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] 10.222.0.43 "DELETE /compute/v2.1/servers/26a08c55-8019-43e6-aa28-fdf938ad0798" status: 404 len: 111 microversion: 2.21 time: 0.071812 Oct 04 21:51:19.727457 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 966/1995] 10.222.0.43 () {60 vars in 1280 bytes} [Tue Oct 4 21:51:19 2022] DELETE /compute/v2.1/servers/26a08c55-8019-43e6-aa28-fdf938ad0798 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 21:51:19.744920 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-0f22567f-9e7b-4cc4-b439-2c6acd6ca8bc tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:19.745684 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-0f22567f-9e7b-4cc4-b439-2c6acd6ca8bc tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] [instance: 26a08c55-8019-43e6-aa28-fdf938ad0798] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:19.752920 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0f22567f-9e7b-4cc4-b439-2c6acd6ca8bc tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:19.753811 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0f22567f-9e7b-4cc4-b439-2c6acd6ca8bc tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:19.767230 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0f22567f-9e7b-4cc4-b439-2c6acd6ca8bc tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:19.769724 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0f22567f-9e7b-4cc4-b439-2c6acd6ca8bc tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:19.770737 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0f22567f-9e7b-4cc4-b439-2c6acd6ca8bc tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:19.771430 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0f22567f-9e7b-4cc4-b439-2c6acd6ca8bc tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:19.792323 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-0f22567f-9e7b-4cc4-b439-2c6acd6ca8bc tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] HTTP exception thrown: Instance 26a08c55-8019-43e6-aa28-fdf938ad0798 could not be found. Oct 04 21:51:19.794038 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-0f22567f-9e7b-4cc4-b439-2c6acd6ca8bc tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Request method failure captured: Oct 04 21:51:19.794038 n-d-860284-1 devstack@n-api.service[134102]: request: GET /compute/v2.1/servers/26a08c55-8019-43e6-aa28-fdf938ad0798 HTTP/1.1 Oct 04 21:51:19.794038 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 21:51:19.794038 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 21:51:19.794038 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 21:51:19.794038 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 21:51:19.794038 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 21:51:19.794038 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 21:51:19.794038 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 21:51:19.794038 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 21:51:19.794038 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPKq5Lt8_cX4TPN6QbGtLAgE1Px9vmMFr7K5a7XfMtQsvTuWQGBxiUQJzCK4EK1tb930dgVylRZrZzmaNzgcyWXXwS1EjEdjK6m-dd0Kk1fa0NbIUriFGrYRp1myYWsQ6ioGtG59c7nLXtUttAq2_q3v8i2kJRLrrEl7s4oEV7Ol86R0 Oct 04 21:51:19.794038 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 21:51:19.794038 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 21:51:19.794038 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 21:51:19.794038 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 21:51:19.794038 n-d-860284-1 devstack@n-api.service[134102]: X-Openstack-Nova-Api-Version: 2.21 Oct 04 21:51:19.794038 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 21:51:19.794038 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 21:51:19.794038 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: 4fbc93887563467dba31d09e3803b962 Oct 04 21:51:19.794038 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-InstanceActionsV221TestJSON-2117819383 Oct 04 21:51:19.794038 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 21:51:19.794038 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 21:51:19.794038 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4fbc93887563467dba31d09e3803b962"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_4fbc93887563467dba31d09e3803b962", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4fbc93887563467dba31d09e3803b962"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/4fbc93887563467dba31d09e3803b962"}]}] Oct 04 21:51:19.794038 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-InstanceActionsV221TestJSON-2117819383 Oct 04 21:51:19.794038 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: 4fbc93887563467dba31d09e3803b962 Oct 04 21:51:19.794038 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-2117819383 Oct 04 21:51:19.794038 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-InstanceActionsV221TestJSON-2117819383-project Oct 04 21:51:19.794038 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 21:51:19.794038 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 21:51:19.794038 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: 301902a6e7bd419db1dc37123e2626aa Oct 04 21:51:19.794038 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-InstanceActionsV221TestJSON-2117819383-project Oct 04 21:51:19.794038 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 21:51:19.794038 n-d-860284-1 devstack@n-api.service[134102]: exception: Instance 26a08c55-8019-43e6-aa28-fdf938ad0798 could not be found. Oct 04 21:51:19.794038 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': '26a08c55-8019-43e6-aa28-fdf938ad0798'} Oct 04 21:51:19.794038 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:51:19.794038 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:51:19.794038 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:51:19.794038 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:51:19.794038 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:51:19.794038 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:51:19.794038 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:51:19.794038 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:51:19.794038 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:51:19.794038 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:51:19.794038 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26a08c55-8019-43e6-aa28-fdf938ad0798 could not be found. Oct 04 21:51:19.794038 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:51:19.794038 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:51:19.794038 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:51:19.794038 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:51:19.794038 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:51:19.794038 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:51:19.794038 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:51:19.794038 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:51:19.794038 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:51:19.794038 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:51:19.794038 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:51:19.794038 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:51:19.794038 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:51:19.794038 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:51:19.794038 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:51:19.794038 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:51:19.794038 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26a08c55-8019-43e6-aa28-fdf938ad0798 could not be found. Oct 04 21:51:19.794038 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:51:19.794038 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:51:19.801187 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:51:19.801187 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:51:19.801187 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:51:19.801187 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:51:19.801187 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:51:19.801187 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:51:19.801187 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26a08c55-8019-43e6-aa28-fdf938ad0798 could not be found. Oct 04 21:51:19.801187 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:51:19.801187 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-0f22567f-9e7b-4cc4-b439-2c6acd6ca8bc tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] Returning 404 to user: Instance 26a08c55-8019-43e6-aa28-fdf938ad0798 could not be found. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:51:19.801187 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-0f22567f-9e7b-4cc4-b439-2c6acd6ca8bc tempest-InstanceActionsV221TestJSON-2117819383 tempest-InstanceActionsV221TestJSON-2117819383-project] 10.222.0.43 "GET /compute/v2.1/servers/26a08c55-8019-43e6-aa28-fdf938ad0798" status: 404 len: 111 microversion: 2.21 time: 0.063758 Oct 04 21:51:19.801983 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1030/1996] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:51:19 2022] GET /compute/v2.1/servers/26a08c55-8019-43e6-aa28-fdf938ad0798 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 21:51:20.065776 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-cf9a41e2-2458-440d-9a25-991cfc0ba041 tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:20.066624 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-cf9a41e2-2458-440d-9a25-991cfc0ba041 tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] [instance: 3f80e8f0-dba3-4403-83f8-0473c5d7d29b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:20.082732 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cf9a41e2-2458-440d-9a25-991cfc0ba041 tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:20.083878 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cf9a41e2-2458-440d-9a25-991cfc0ba041 tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:20.085835 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cf9a41e2-2458-440d-9a25-991cfc0ba041 tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:20.090707 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cf9a41e2-2458-440d-9a25-991cfc0ba041 tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:20.091407 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cf9a41e2-2458-440d-9a25-991cfc0ba041 tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:20.092704 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cf9a41e2-2458-440d-9a25-991cfc0ba041 tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:20.224950 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-aefd6a9e-0eda-49b3-847a-628db06328cd tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:20.225732 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-aefd6a9e-0eda-49b3-847a-628db06328cd tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] [instance: b646f5b5-a266-44df-80e6-5d1b2a3b91d7] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:20.243865 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.objects.instance [None req-cf9a41e2-2458-440d-9a25-991cfc0ba041 tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Lazy-loading 'services' on Instance uuid 3f80e8f0-dba3-4403-83f8-0473c5d7d29b {{(pid=134101) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:51:20.246654 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-aefd6a9e-0eda-49b3-847a-628db06328cd tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:20.251512 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-aefd6a9e-0eda-49b3-847a-628db06328cd tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:20.252317 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-aefd6a9e-0eda-49b3-847a-628db06328cd tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:20.253484 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-aefd6a9e-0eda-49b3-847a-628db06328cd tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:20.254164 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-aefd6a9e-0eda-49b3-847a-628db06328cd tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:20.255765 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-aefd6a9e-0eda-49b3-847a-628db06328cd tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:20.303684 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-cf9a41e2-2458-440d-9a25-991cfc0ba041 tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/3f80e8f0-dba3-4403-83f8-0473c5d7d29b" status: 200 len: 1923 microversion: 2.75 time: 0.240930 Oct 04 21:51:20.306862 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 967/1997] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:51:20 2022] GET /compute/v2.1/servers/3f80e8f0-dba3-4403-83f8-0473c5d7d29b => generated 1923 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:51:20.361459 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-4b45da72-3159-43a9-8f1f-a4b0441bbba7 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:20.364815 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-4b45da72-3159-43a9-8f1f-a4b0441bbba7 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 3f0a02bc-7993-4849-8b3c-7572327b4799] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:20.380069 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4b45da72-3159-43a9-8f1f-a4b0441bbba7 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:20.383913 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4b45da72-3159-43a9-8f1f-a4b0441bbba7 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:20.384523 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4b45da72-3159-43a9-8f1f-a4b0441bbba7 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:20.388818 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4b45da72-3159-43a9-8f1f-a4b0441bbba7 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:20.389632 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4b45da72-3159-43a9-8f1f-a4b0441bbba7 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:20.400573 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4b45da72-3159-43a9-8f1f-a4b0441bbba7 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:20.524404 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-4b45da72-3159-43a9-8f1f-a4b0441bbba7 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/3f0a02bc-7993-4849-8b3c-7572327b4799/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.168770 Oct 04 21:51:20.528474 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 968/1998] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 21:51:20 2022] GET /compute/v2.1/servers/3f0a02bc-7993-4849-8b3c-7572327b4799/os-volume_attachments => generated 197 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:51:20.543659 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-50bde0b4-7f27-47e2-aedb-05b9d986ac2a tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:20.547293 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-50bde0b4-7f27-47e2-aedb-05b9d986ac2a tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] [instance: 7d0ed6d0-981a-48a7-a676-5910b1257301] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:20.568372 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-50bde0b4-7f27-47e2-aedb-05b9d986ac2a tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:20.568959 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-50bde0b4-7f27-47e2-aedb-05b9d986ac2a tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:20.574382 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-50bde0b4-7f27-47e2-aedb-05b9d986ac2a tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:20.575292 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-50bde0b4-7f27-47e2-aedb-05b9d986ac2a tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:20.578895 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-50bde0b4-7f27-47e2-aedb-05b9d986ac2a tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:20.579350 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-50bde0b4-7f27-47e2-aedb-05b9d986ac2a tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:20.915288 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-aefd6a9e-0eda-49b3-847a-628db06328cd tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:20.930494 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-aefd6a9e-0eda-49b3-847a-628db06328cd tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:20.932828 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-aefd6a9e-0eda-49b3-847a-628db06328cd tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:20.943978 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-aefd6a9e-0eda-49b3-847a-628db06328cd tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] 10.222.0.43 "GET /compute/v2.1/servers/b646f5b5-a266-44df-80e6-5d1b2a3b91d7" status: 200 len: 1293 microversion: 2.25 time: 0.728281 Oct 04 21:51:20.944695 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1031/1999] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:51:20 2022] GET /compute/v2.1/servers/b646f5b5-a266-44df-80e6-5d1b2a3b91d7 => generated 1293 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:51:21.009487 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-50bde0b4-7f27-47e2-aedb-05b9d986ac2a tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f11c77afc74a16bea945dd84e72ebe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94d03be22238422eba835ed522baf9c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:21.023313 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-50bde0b4-7f27-47e2-aedb-05b9d986ac2a tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] 10.222.0.43 "GET /compute/v2.1/servers/7d0ed6d0-981a-48a7-a676-5910b1257301" status: 200 len: 1318 microversion: 2.1 time: 0.492653 Oct 04 21:51:21.026118 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 969/2000] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:51:20 2022] GET /compute/v2.1/servers/7d0ed6d0-981a-48a7-a676-5910b1257301 => generated 1318 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:51:21.338279 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-0872691d-7161-4e5c-9755-ca8d7b53d1f1 tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:21.339056 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-0872691d-7161-4e5c-9755-ca8d7b53d1f1 tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] [instance: 3f80e8f0-dba3-4403-83f8-0473c5d7d29b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:21.356120 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0872691d-7161-4e5c-9755-ca8d7b53d1f1 tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:21.357024 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0872691d-7161-4e5c-9755-ca8d7b53d1f1 tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:21.357699 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0872691d-7161-4e5c-9755-ca8d7b53d1f1 tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:21.358751 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0872691d-7161-4e5c-9755-ca8d7b53d1f1 tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:21.359454 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0872691d-7161-4e5c-9755-ca8d7b53d1f1 tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:21.360270 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0872691d-7161-4e5c-9755-ca8d7b53d1f1 tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:21.538126 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.objects.instance [None req-0872691d-7161-4e5c-9755-ca8d7b53d1f1 tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Lazy-loading 'services' on Instance uuid 3f80e8f0-dba3-4403-83f8-0473c5d7d29b {{(pid=134102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:51:21.542642 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-2ef27534-ced8-4d74-beb9-9633a19c54f6 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:21.546275 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-2ef27534-ced8-4d74-beb9-9633a19c54f6 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 3f0a02bc-7993-4849-8b3c-7572327b4799] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:21.567827 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2ef27534-ced8-4d74-beb9-9633a19c54f6 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:21.570682 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2ef27534-ced8-4d74-beb9-9633a19c54f6 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:21.571455 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2ef27534-ced8-4d74-beb9-9633a19c54f6 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:21.572410 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2ef27534-ced8-4d74-beb9-9633a19c54f6 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:21.574877 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2ef27534-ced8-4d74-beb9-9633a19c54f6 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:21.575728 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2ef27534-ced8-4d74-beb9-9633a19c54f6 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:21.596234 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-0872691d-7161-4e5c-9755-ca8d7b53d1f1 tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/3f80e8f0-dba3-4403-83f8-0473c5d7d29b" status: 200 len: 1929 microversion: 2.75 time: 0.262921 Oct 04 21:51:21.600541 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1032/2001] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:51:21 2022] GET /compute/v2.1/servers/3f80e8f0-dba3-4403-83f8-0473c5d7d29b => generated 1929 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:51:21.655031 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-2ef27534-ced8-4d74-beb9-9633a19c54f6 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/3f0a02bc-7993-4849-8b3c-7572327b4799/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.119014 Oct 04 21:51:21.656783 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 970/2002] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 21:51:21 2022] GET /compute/v2.1/servers/3f0a02bc-7993-4849-8b3c-7572327b4799/os-volume_attachments => generated 197 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:51:21.975030 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-eb9fdf87-51eb-402a-b30e-8888fee646bb tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:21.975653 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-eb9fdf87-51eb-402a-b30e-8888fee646bb tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] [instance: b646f5b5-a266-44df-80e6-5d1b2a3b91d7] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:21.982924 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-eb9fdf87-51eb-402a-b30e-8888fee646bb tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:21.984366 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-eb9fdf87-51eb-402a-b30e-8888fee646bb tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:21.985181 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-eb9fdf87-51eb-402a-b30e-8888fee646bb tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:21.988360 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-eb9fdf87-51eb-402a-b30e-8888fee646bb tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:21.989042 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-eb9fdf87-51eb-402a-b30e-8888fee646bb tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:21.989661 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-eb9fdf87-51eb-402a-b30e-8888fee646bb tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:22.053490 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-7b232a78-c352-40ae-83a3-ddfcb67d5b61 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:22.054195 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-7b232a78-c352-40ae-83a3-ddfcb67d5b61 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] [instance: 7d0ed6d0-981a-48a7-a676-5910b1257301] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:22.057441 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:51:22.075247 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7b232a78-c352-40ae-83a3-ddfcb67d5b61 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:22.075983 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7b232a78-c352-40ae-83a3-ddfcb67d5b61 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:22.076680 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7b232a78-c352-40ae-83a3-ddfcb67d5b61 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:22.078057 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7b232a78-c352-40ae-83a3-ddfcb67d5b61 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:22.078565 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7b232a78-c352-40ae-83a3-ddfcb67d5b61 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:22.081750 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7b232a78-c352-40ae-83a3-ddfcb67d5b61 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:22.962920 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-eb9fdf87-51eb-402a-b30e-8888fee646bb tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:22.976719 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-eb9fdf87-51eb-402a-b30e-8888fee646bb tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:22.982988 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-eb9fdf87-51eb-402a-b30e-8888fee646bb tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:22.989460 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-eb9fdf87-51eb-402a-b30e-8888fee646bb tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] 10.222.0.43 "GET /compute/v2.1/servers/b646f5b5-a266-44df-80e6-5d1b2a3b91d7" status: 200 len: 1293 microversion: 2.25 time: 1.016381 Oct 04 21:51:22.990428 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1033/2003] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:51:21 2022] GET /compute/v2.1/servers/b646f5b5-a266-44df-80e6-5d1b2a3b91d7 => generated 1293 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:51:23.001584 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-ca4b533e-484d-4ae4-97ac-150c5d5519e5 tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:23.004141 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-ca4b533e-484d-4ae4-97ac-150c5d5519e5 tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] [instance: 3f80e8f0-dba3-4403-83f8-0473c5d7d29b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:23.023467 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ca4b533e-484d-4ae4-97ac-150c5d5519e5 tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:23.024505 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ca4b533e-484d-4ae4-97ac-150c5d5519e5 tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:23.025201 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ca4b533e-484d-4ae4-97ac-150c5d5519e5 tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:23.027801 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ca4b533e-484d-4ae4-97ac-150c5d5519e5 tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:23.028550 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ca4b533e-484d-4ae4-97ac-150c5d5519e5 tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:23.030197 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ca4b533e-484d-4ae4-97ac-150c5d5519e5 tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:23.256148 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-7b232a78-c352-40ae-83a3-ddfcb67d5b61 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f11c77afc74a16bea945dd84e72ebe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94d03be22238422eba835ed522baf9c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:23.273501 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.objects.instance [None req-ca4b533e-484d-4ae4-97ac-150c5d5519e5 tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Lazy-loading 'services' on Instance uuid 3f80e8f0-dba3-4403-83f8-0473c5d7d29b {{(pid=134102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:51:23.274619 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-7b232a78-c352-40ae-83a3-ddfcb67d5b61 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] 10.222.0.43 "GET /compute/v2.1/servers/7d0ed6d0-981a-48a7-a676-5910b1257301" status: 200 len: 1318 microversion: 2.1 time: 1.223856 Oct 04 21:51:23.278703 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 971/2004] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:51:22 2022] GET /compute/v2.1/servers/7d0ed6d0-981a-48a7-a676-5910b1257301 => generated 1318 bytes in 1231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:51:23.288527 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-df341a1d-75f3-471e-a74d-263865b5e441 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:23.307738 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-df341a1d-75f3-471e-a74d-263865b5e441 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 3f0a02bc-7993-4849-8b3c-7572327b4799] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:23.329597 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-df341a1d-75f3-471e-a74d-263865b5e441 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:23.331347 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-df341a1d-75f3-471e-a74d-263865b5e441 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:23.333648 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-df341a1d-75f3-471e-a74d-263865b5e441 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:23.335523 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-df341a1d-75f3-471e-a74d-263865b5e441 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:23.339025 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-df341a1d-75f3-471e-a74d-263865b5e441 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:23.341771 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-df341a1d-75f3-471e-a74d-263865b5e441 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:23.342324 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-ca4b533e-484d-4ae4-97ac-150c5d5519e5 tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/3f80e8f0-dba3-4403-83f8-0473c5d7d29b" status: 200 len: 1929 microversion: 2.75 time: 0.348317 Oct 04 21:51:23.344422 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1034/2005] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:51:22 2022] GET /compute/v2.1/servers/3f80e8f0-dba3-4403-83f8-0473c5d7d29b => generated 1929 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:51:23.359512 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-25ecdd90-7770-4bcd-8888-0cf1796d9793 req-1e650be8-024b-4221-89f9-10ddccac091d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b646f5b5-a266-44df-80e6-5d1b2a3b91d7", "tag": "433775b7-13ed-49fa-86e4-2e7c2fe9e176"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:51:23.391922 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-25ecdd90-7770-4bcd-8888-0cf1796d9793 req-1e650be8-024b-4221-89f9-10ddccac091d service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:23.393897 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-25ecdd90-7770-4bcd-8888-0cf1796d9793 req-1e650be8-024b-4221-89f9-10ddccac091d service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:23.398084 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-25ecdd90-7770-4bcd-8888-0cf1796d9793 req-1e650be8-024b-4221-89f9-10ddccac091d service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:23.418626 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-25ecdd90-7770-4bcd-8888-0cf1796d9793 req-1e650be8-024b-4221-89f9-10ddccac091d service nova] Creating event network-changed:433775b7-13ed-49fa-86e4-2e7c2fe9e176 for instance b646f5b5-a266-44df-80e6-5d1b2a3b91d7 on n-h1-860284-1 Oct 04 21:51:23.425461 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-25ecdd90-7770-4bcd-8888-0cf1796d9793 req-1e650be8-024b-4221-89f9-10ddccac091d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077928 Oct 04 21:51:23.426561 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1035/2006] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:51:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:51:23.440168 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-df341a1d-75f3-471e-a74d-263865b5e441 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/3f0a02bc-7993-4849-8b3c-7572327b4799/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.159909 Oct 04 21:51:23.444975 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 972/2007] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 21:51:23 2022] GET /compute/v2.1/servers/3f0a02bc-7993-4849-8b3c-7572327b4799/os-volume_attachments => generated 197 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:51:23.813081 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-4b30d824-c212-4c0d-847f-4181c06127a3 req-58941fd2-7f16-41ec-b104-394c3f4d4f6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d0ed6d0-981a-48a7-a676-5910b1257301", "name": "network-vif-plugged", "status": "completed", "tag": "0ba64ce4-a23d-464b-a37e-fdb0f8a91b4b"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:51:23.849363 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-4b30d824-c212-4c0d-847f-4181c06127a3 req-58941fd2-7f16-41ec-b104-394c3f4d4f6b service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:23.852423 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-4b30d824-c212-4c0d-847f-4181c06127a3 req-58941fd2-7f16-41ec-b104-394c3f4d4f6b service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:23.853206 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-4b30d824-c212-4c0d-847f-4181c06127a3 req-58941fd2-7f16-41ec-b104-394c3f4d4f6b service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:23.891555 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-4b30d824-c212-4c0d-847f-4181c06127a3 req-58941fd2-7f16-41ec-b104-394c3f4d4f6b service nova] Creating event network-vif-plugged:0ba64ce4-a23d-464b-a37e-fdb0f8a91b4b for instance 7d0ed6d0-981a-48a7-a676-5910b1257301 on n-h2-860284-1 Oct 04 21:51:23.906692 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-4b30d824-c212-4c0d-847f-4181c06127a3 req-58941fd2-7f16-41ec-b104-394c3f4d4f6b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097548 Oct 04 21:51:23.908705 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1036/2008] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:51:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:51:24.019428 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-250f8a46-b811-48a0-b36d-acec926abbf7 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:24.020223 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-250f8a46-b811-48a0-b36d-acec926abbf7 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] [instance: b646f5b5-a266-44df-80e6-5d1b2a3b91d7] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:24.033631 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-250f8a46-b811-48a0-b36d-acec926abbf7 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:24.037193 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-250f8a46-b811-48a0-b36d-acec926abbf7 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:24.037848 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-250f8a46-b811-48a0-b36d-acec926abbf7 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:24.038768 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-250f8a46-b811-48a0-b36d-acec926abbf7 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:24.039535 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-250f8a46-b811-48a0-b36d-acec926abbf7 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:24.040079 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-250f8a46-b811-48a0-b36d-acec926abbf7 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:24.304689 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-55a77047-d427-4fa1-951e-b0f25a0be523 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:24.305565 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-55a77047-d427-4fa1-951e-b0f25a0be523 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] [instance: 7d0ed6d0-981a-48a7-a676-5910b1257301] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:24.322993 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-55a77047-d427-4fa1-951e-b0f25a0be523 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:24.323673 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-55a77047-d427-4fa1-951e-b0f25a0be523 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:24.324219 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-55a77047-d427-4fa1-951e-b0f25a0be523 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:24.325165 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-55a77047-d427-4fa1-951e-b0f25a0be523 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:24.325773 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-55a77047-d427-4fa1-951e-b0f25a0be523 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:24.326312 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-55a77047-d427-4fa1-951e-b0f25a0be523 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:24.501630 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-250f8a46-b811-48a0-b36d-acec926abbf7 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:24.516481 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-250f8a46-b811-48a0-b36d-acec926abbf7 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:24.518338 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-250f8a46-b811-48a0-b36d-acec926abbf7 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:24.526318 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-250f8a46-b811-48a0-b36d-acec926abbf7 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] 10.222.0.43 "GET /compute/v2.1/servers/b646f5b5-a266-44df-80e6-5d1b2a3b91d7" status: 200 len: 1293 microversion: 2.25 time: 0.512496 Oct 04 21:51:24.533596 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 973/2009] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:51:24 2022] GET /compute/v2.1/servers/b646f5b5-a266-44df-80e6-5d1b2a3b91d7 => generated 1293 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:51:24.552105 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-6ecb33ef-89ae-4dc6-bf0c-90162afd5bc6 tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:24.555526 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-6ecb33ef-89ae-4dc6-bf0c-90162afd5bc6 tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] [instance: 3f80e8f0-dba3-4403-83f8-0473c5d7d29b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:24.576563 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6ecb33ef-89ae-4dc6-bf0c-90162afd5bc6 tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:24.579264 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6ecb33ef-89ae-4dc6-bf0c-90162afd5bc6 tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:24.580460 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6ecb33ef-89ae-4dc6-bf0c-90162afd5bc6 tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:24.582668 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6ecb33ef-89ae-4dc6-bf0c-90162afd5bc6 tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:24.594102 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6ecb33ef-89ae-4dc6-bf0c-90162afd5bc6 tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:24.594592 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6ecb33ef-89ae-4dc6-bf0c-90162afd5bc6 tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:24.807736 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.objects.instance [None req-6ecb33ef-89ae-4dc6-bf0c-90162afd5bc6 tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Lazy-loading 'services' on Instance uuid 3f80e8f0-dba3-4403-83f8-0473c5d7d29b {{(pid=134101) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:51:24.853544 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-6ecb33ef-89ae-4dc6-bf0c-90162afd5bc6 tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/3f80e8f0-dba3-4403-83f8-0473c5d7d29b" status: 200 len: 1929 microversion: 2.75 time: 0.318522 Oct 04 21:51:24.854150 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 974/2010] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:51:24 2022] GET /compute/v2.1/servers/3f80e8f0-dba3-4403-83f8-0473c5d7d29b => generated 1929 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:51:24.866293 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-d2341718-7087-48ae-8e77-e8e2abb834d4 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:24.868958 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-d2341718-7087-48ae-8e77-e8e2abb834d4 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 3f0a02bc-7993-4849-8b3c-7572327b4799] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:24.883204 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d2341718-7087-48ae-8e77-e8e2abb834d4 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:24.885704 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d2341718-7087-48ae-8e77-e8e2abb834d4 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:24.886333 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d2341718-7087-48ae-8e77-e8e2abb834d4 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:24.887346 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d2341718-7087-48ae-8e77-e8e2abb834d4 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:24.890577 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d2341718-7087-48ae-8e77-e8e2abb834d4 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:24.892124 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d2341718-7087-48ae-8e77-e8e2abb834d4 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:24.970877 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-d2341718-7087-48ae-8e77-e8e2abb834d4 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/3f0a02bc-7993-4849-8b3c-7572327b4799/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.110782 Oct 04 21:51:24.971898 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 975/2011] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 21:51:24 2022] GET /compute/v2.1/servers/3f0a02bc-7993-4849-8b3c-7572327b4799/os-volume_attachments => generated 197 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:51:25.550127 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-55a77047-d427-4fa1-951e-b0f25a0be523 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f11c77afc74a16bea945dd84e72ebe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94d03be22238422eba835ed522baf9c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:25.561159 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-55a77047-d427-4fa1-951e-b0f25a0be523 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] 10.222.0.43 "GET /compute/v2.1/servers/7d0ed6d0-981a-48a7-a676-5910b1257301" status: 200 len: 1318 microversion: 2.1 time: 1.260123 Oct 04 21:51:25.562045 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1037/2012] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:51:24 2022] GET /compute/v2.1/servers/7d0ed6d0-981a-48a7-a676-5910b1257301 => generated 1318 bytes in 1263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:51:25.564984 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-2ef93f24-8a2c-400a-8e2c-61524b6233b9 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:25.566329 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-2ef93f24-8a2c-400a-8e2c-61524b6233b9 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] [instance: b646f5b5-a266-44df-80e6-5d1b2a3b91d7] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:25.590151 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2ef93f24-8a2c-400a-8e2c-61524b6233b9 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:25.602402 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2ef93f24-8a2c-400a-8e2c-61524b6233b9 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:25.603232 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2ef93f24-8a2c-400a-8e2c-61524b6233b9 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:25.604238 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2ef93f24-8a2c-400a-8e2c-61524b6233b9 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:25.605654 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2ef93f24-8a2c-400a-8e2c-61524b6233b9 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:25.606484 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2ef93f24-8a2c-400a-8e2c-61524b6233b9 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:25.880490 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=2 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:51:25.885033 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-b630434b-25d3-4da4-b6ec-ee30bec3ce1f tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:25.885630 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-b630434b-25d3-4da4-b6ec-ee30bec3ce1f tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] [instance: 3f80e8f0-dba3-4403-83f8-0473c5d7d29b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:25.904896 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b630434b-25d3-4da4-b6ec-ee30bec3ce1f tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:25.905495 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b630434b-25d3-4da4-b6ec-ee30bec3ce1f tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:25.905935 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b630434b-25d3-4da4-b6ec-ee30bec3ce1f tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:25.906848 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b630434b-25d3-4da4-b6ec-ee30bec3ce1f tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:25.907359 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b630434b-25d3-4da4-b6ec-ee30bec3ce1f tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:25.907740 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b630434b-25d3-4da4-b6ec-ee30bec3ce1f tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:25.911213 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=6 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:51:26.219087 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-2ef93f24-8a2c-400a-8e2c-61524b6233b9 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:26.226888 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:51:26.231269 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-2ef93f24-8a2c-400a-8e2c-61524b6233b9 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:26.237393 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.objects.instance [None req-b630434b-25d3-4da4-b6ec-ee30bec3ce1f tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Lazy-loading 'services' on Instance uuid 3f80e8f0-dba3-4403-83f8-0473c5d7d29b {{(pid=134102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:51:26.238307 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-2ef93f24-8a2c-400a-8e2c-61524b6233b9 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:26.239778 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-2ef93f24-8a2c-400a-8e2c-61524b6233b9 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] 10.222.0.43 "GET /compute/v2.1/servers/b646f5b5-a266-44df-80e6-5d1b2a3b91d7" status: 200 len: 1293 microversion: 2.25 time: 0.679397 Oct 04 21:51:26.240744 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 976/2013] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:51:25 2022] GET /compute/v2.1/servers/b646f5b5-a266-44df-80e6-5d1b2a3b91d7 => generated 1293 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:51:26.262588 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-bc12e083-1f3d-48d1-a208-0e677159f25a tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:26.265341 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-bc12e083-1f3d-48d1-a208-0e677159f25a tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 3f0a02bc-7993-4849-8b3c-7572327b4799] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:26.281972 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bc12e083-1f3d-48d1-a208-0e677159f25a tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:26.282609 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bc12e083-1f3d-48d1-a208-0e677159f25a tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:26.283261 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bc12e083-1f3d-48d1-a208-0e677159f25a tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:26.284347 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bc12e083-1f3d-48d1-a208-0e677159f25a tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:26.284983 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bc12e083-1f3d-48d1-a208-0e677159f25a tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:26.285611 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bc12e083-1f3d-48d1-a208-0e677159f25a tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:26.286701 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-b630434b-25d3-4da4-b6ec-ee30bec3ce1f tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/3f80e8f0-dba3-4403-83f8-0473c5d7d29b" status: 200 len: 1929 microversion: 2.75 time: 0.405409 Oct 04 21:51:26.288736 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1038/2014] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:51:25 2022] GET /compute/v2.1/servers/3f80e8f0-dba3-4403-83f8-0473c5d7d29b => generated 1929 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:51:26.348533 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-bc12e083-1f3d-48d1-a208-0e677159f25a tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/3f0a02bc-7993-4849-8b3c-7572327b4799/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.105754 Oct 04 21:51:26.359249 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 977/2015] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 21:51:26 2022] GET /compute/v2.1/servers/3f0a02bc-7993-4849-8b3c-7572327b4799/os-volume_attachments => generated 197 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:51:26.584487 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-31d27b21-0ddb-4d37-b456-4818666eda22 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:26.585276 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-31d27b21-0ddb-4d37-b456-4818666eda22 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] [instance: 7d0ed6d0-981a-48a7-a676-5910b1257301] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:26.598111 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-31d27b21-0ddb-4d37-b456-4818666eda22 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:26.598831 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-31d27b21-0ddb-4d37-b456-4818666eda22 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:26.599388 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-31d27b21-0ddb-4d37-b456-4818666eda22 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:26.602660 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-31d27b21-0ddb-4d37-b456-4818666eda22 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:26.603576 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-31d27b21-0ddb-4d37-b456-4818666eda22 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:26.606570 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-31d27b21-0ddb-4d37-b456-4818666eda22 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:26.752067 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell0:SELECT=2 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:51:27.113094 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-31d27b21-0ddb-4d37-b456-4818666eda22 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f11c77afc74a16bea945dd84e72ebe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94d03be22238422eba835ed522baf9c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:27.139297 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-31d27b21-0ddb-4d37-b456-4818666eda22 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] 10.222.0.43 "GET /compute/v2.1/servers/7d0ed6d0-981a-48a7-a676-5910b1257301" status: 200 len: 1318 microversion: 2.1 time: 0.559169 Oct 04 21:51:27.145396 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1039/2016] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:51:26 2022] GET /compute/v2.1/servers/7d0ed6d0-981a-48a7-a676-5910b1257301 => generated 1318 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:51:27.280076 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-c47746a6-0e66-4510-8687-5dd6560487d5 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:27.281570 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-c47746a6-0e66-4510-8687-5dd6560487d5 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] [instance: b646f5b5-a266-44df-80e6-5d1b2a3b91d7] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:27.320404 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-71f67710-8ae3-4bc3-91ac-01edd107f64e tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:27.321043 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-71f67710-8ae3-4bc3-91ac-01edd107f64e tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] [instance: 3f80e8f0-dba3-4403-83f8-0473c5d7d29b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:27.332748 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-71f67710-8ae3-4bc3-91ac-01edd107f64e tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:27.338513 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c47746a6-0e66-4510-8687-5dd6560487d5 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:27.342189 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-71f67710-8ae3-4bc3-91ac-01edd107f64e tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:27.342189 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-71f67710-8ae3-4bc3-91ac-01edd107f64e tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:27.342794 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c47746a6-0e66-4510-8687-5dd6560487d5 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:27.344511 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c47746a6-0e66-4510-8687-5dd6560487d5 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:27.347421 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-71f67710-8ae3-4bc3-91ac-01edd107f64e tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:27.348171 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c47746a6-0e66-4510-8687-5dd6560487d5 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:27.348707 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c47746a6-0e66-4510-8687-5dd6560487d5 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:27.352025 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-71f67710-8ae3-4bc3-91ac-01edd107f64e tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:27.352571 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-71f67710-8ae3-4bc3-91ac-01edd107f64e tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:27.356006 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c47746a6-0e66-4510-8687-5dd6560487d5 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:27.580094 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.objects.instance [None req-71f67710-8ae3-4bc3-91ac-01edd107f64e tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Lazy-loading 'services' on Instance uuid 3f80e8f0-dba3-4403-83f8-0473c5d7d29b {{(pid=134102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:51:27.623583 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-71f67710-8ae3-4bc3-91ac-01edd107f64e tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/3f80e8f0-dba3-4403-83f8-0473c5d7d29b" status: 200 len: 1929 microversion: 2.75 time: 0.307963 Oct 04 21:51:27.625250 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1040/2017] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:51:27 2022] GET /compute/v2.1/servers/3f80e8f0-dba3-4403-83f8-0473c5d7d29b => generated 1929 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:51:27.634060 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-ca34a2f2-c65f-4e9a-bcfd-5ba0f45c5547 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:27.646543 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-ca34a2f2-c65f-4e9a-bcfd-5ba0f45c5547 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 3f0a02bc-7993-4849-8b3c-7572327b4799] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:27.653802 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ca34a2f2-c65f-4e9a-bcfd-5ba0f45c5547 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:27.658771 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ca34a2f2-c65f-4e9a-bcfd-5ba0f45c5547 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:27.659456 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ca34a2f2-c65f-4e9a-bcfd-5ba0f45c5547 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:27.660373 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ca34a2f2-c65f-4e9a-bcfd-5ba0f45c5547 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:27.661371 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ca34a2f2-c65f-4e9a-bcfd-5ba0f45c5547 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:27.674864 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ca34a2f2-c65f-4e9a-bcfd-5ba0f45c5547 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:27.750346 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-ca34a2f2-c65f-4e9a-bcfd-5ba0f45c5547 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/3f0a02bc-7993-4849-8b3c-7572327b4799/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.122933 Oct 04 21:51:27.754824 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1041/2018] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 21:51:27 2022] GET /compute/v2.1/servers/3f0a02bc-7993-4849-8b3c-7572327b4799/os-volume_attachments => generated 197 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:51:27.804516 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-c47746a6-0e66-4510-8687-5dd6560487d5 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:27.813754 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-c47746a6-0e66-4510-8687-5dd6560487d5 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:27.821070 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-c47746a6-0e66-4510-8687-5dd6560487d5 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:27.825575 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-c47746a6-0e66-4510-8687-5dd6560487d5 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] 10.222.0.43 "GET /compute/v2.1/servers/b646f5b5-a266-44df-80e6-5d1b2a3b91d7" status: 200 len: 1293 microversion: 2.25 time: 0.562475 Oct 04 21:51:27.828497 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 978/2019] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:51:27 2022] GET /compute/v2.1/servers/b646f5b5-a266-44df-80e6-5d1b2a3b91d7 => generated 1293 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:51:28.175591 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-31b31296-43e1-484f-a25b-7424faad9840 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:28.176684 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-31b31296-43e1-484f-a25b-7424faad9840 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] [instance: 7d0ed6d0-981a-48a7-a676-5910b1257301] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:28.193196 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-31b31296-43e1-484f-a25b-7424faad9840 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:28.194824 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-31b31296-43e1-484f-a25b-7424faad9840 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:28.198391 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-31b31296-43e1-484f-a25b-7424faad9840 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:28.201717 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-31b31296-43e1-484f-a25b-7424faad9840 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:28.203601 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-31b31296-43e1-484f-a25b-7424faad9840 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:28.204661 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-31b31296-43e1-484f-a25b-7424faad9840 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:28.654153 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-0494ac8c-9aa1-47cc-b65a-caebb80ae757 tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:28.654850 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-0494ac8c-9aa1-47cc-b65a-caebb80ae757 tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] [instance: 3f80e8f0-dba3-4403-83f8-0473c5d7d29b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:28.667756 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0494ac8c-9aa1-47cc-b65a-caebb80ae757 tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:28.669268 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0494ac8c-9aa1-47cc-b65a-caebb80ae757 tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:28.669717 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0494ac8c-9aa1-47cc-b65a-caebb80ae757 tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:28.673798 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0494ac8c-9aa1-47cc-b65a-caebb80ae757 tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:28.674864 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0494ac8c-9aa1-47cc-b65a-caebb80ae757 tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:28.675477 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0494ac8c-9aa1-47cc-b65a-caebb80ae757 tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:28.757261 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-31b31296-43e1-484f-a25b-7424faad9840 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f11c77afc74a16bea945dd84e72ebe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94d03be22238422eba835ed522baf9c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:28.768626 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-31b31296-43e1-484f-a25b-7424faad9840 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] 10.222.0.43 "GET /compute/v2.1/servers/7d0ed6d0-981a-48a7-a676-5910b1257301" status: 200 len: 1467 microversion: 2.1 time: 0.597922 Oct 04 21:51:28.775112 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1042/2020] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:51:28 2022] GET /compute/v2.1/servers/7d0ed6d0-981a-48a7-a676-5910b1257301 => generated 1467 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:51:28.781024 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-67e558f0-f889-48e8-a89d-f9839a6c136a tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:28.792804 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-67e558f0-f889-48e8-a89d-f9839a6c136a tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 3f0a02bc-7993-4849-8b3c-7572327b4799] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:28.808871 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-67e558f0-f889-48e8-a89d-f9839a6c136a tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:28.812116 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-67e558f0-f889-48e8-a89d-f9839a6c136a tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:28.812747 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-67e558f0-f889-48e8-a89d-f9839a6c136a tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:28.813647 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-67e558f0-f889-48e8-a89d-f9839a6c136a tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:28.819193 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-67e558f0-f889-48e8-a89d-f9839a6c136a tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:28.821521 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-67e558f0-f889-48e8-a89d-f9839a6c136a tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:28.845497 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.objects.instance [None req-0494ac8c-9aa1-47cc-b65a-caebb80ae757 tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] Lazy-loading 'services' on Instance uuid 3f80e8f0-dba3-4403-83f8-0473c5d7d29b {{(pid=134101) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:51:28.909241 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-0494ac8c-9aa1-47cc-b65a-caebb80ae757 tempest-ServersAdmin275Test-878715256 tempest-ServersAdmin275Test-878715256-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/3f80e8f0-dba3-4403-83f8-0473c5d7d29b" status: 200 len: 1914 microversion: 2.75 time: 0.255802 Oct 04 21:51:28.910220 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 979/2021] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:51:28 2022] GET /compute/v2.1/servers/3f80e8f0-dba3-4403-83f8-0473c5d7d29b => generated 1914 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:51:28.915733 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-83ee3e23-8db5-445b-a168-9dae43272236 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:28.924336 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-67e558f0-f889-48e8-a89d-f9839a6c136a tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/3f0a02bc-7993-4849-8b3c-7572327b4799/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.147770 Oct 04 21:51:28.925692 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-83ee3e23-8db5-445b-a168-9dae43272236 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] [instance: 6f8a46c4-3b6f-4f50-8227-77b69154fb57] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:28.938761 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1043/2022] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 21:51:28 2022] GET /compute/v2.1/servers/3f0a02bc-7993-4849-8b3c-7572327b4799/os-volume_attachments => generated 197 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:51:28.944022 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-33254d71-ff09-4662-be27-17483ac6f098 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:28.952397 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-83ee3e23-8db5-445b-a168-9dae43272236 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:28.953337 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-83ee3e23-8db5-445b-a168-9dae43272236 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:28.953955 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-83ee3e23-8db5-445b-a168-9dae43272236 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:28.954942 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-83ee3e23-8db5-445b-a168-9dae43272236 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:28.955576 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-83ee3e23-8db5-445b-a168-9dae43272236 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:28.957271 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-83ee3e23-8db5-445b-a168-9dae43272236 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:28.962284 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-33254d71-ff09-4662-be27-17483ac6f098 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] [instance: b646f5b5-a266-44df-80e6-5d1b2a3b91d7] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:28.972312 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-33254d71-ff09-4662-be27-17483ac6f098 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:28.973240 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-33254d71-ff09-4662-be27-17483ac6f098 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:28.984495 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-33254d71-ff09-4662-be27-17483ac6f098 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:28.985364 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-33254d71-ff09-4662-be27-17483ac6f098 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:28.985850 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-33254d71-ff09-4662-be27-17483ac6f098 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:28.986286 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-33254d71-ff09-4662-be27-17483ac6f098 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:29.401512 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-83ee3e23-8db5-445b-a168-9dae43272236 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f11c77afc74a16bea945dd84e72ebe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94d03be22238422eba835ed522baf9c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:29.412448 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-33254d71-ff09-4662-be27-17483ac6f098 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:29.434693 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-33254d71-ff09-4662-be27-17483ac6f098 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:29.439138 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-83ee3e23-8db5-445b-a168-9dae43272236 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] 10.222.0.43 "GET /compute/v2.1/servers/6f8a46c4-3b6f-4f50-8227-77b69154fb57" status: 200 len: 1467 microversion: 2.1 time: 0.526449 Oct 04 21:51:29.441598 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 980/2023] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:51:28 2022] GET /compute/v2.1/servers/6f8a46c4-3b6f-4f50-8227-77b69154fb57 => generated 1467 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:51:29.443419 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-33254d71-ff09-4662-be27-17483ac6f098 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:29.445693 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-33254d71-ff09-4662-be27-17483ac6f098 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] 10.222.0.43 "GET /compute/v2.1/servers/b646f5b5-a266-44df-80e6-5d1b2a3b91d7" status: 200 len: 1293 microversion: 2.25 time: 0.504950 Oct 04 21:51:29.464158 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1044/2024] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:51:28 2022] GET /compute/v2.1/servers/b646f5b5-a266-44df-80e6-5d1b2a3b91d7 => generated 1293 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:51:29.468518 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-ecf1cb10-9920-4b57-9ab0-df39fa75e2e6 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:29.469228 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-ecf1cb10-9920-4b57-9ab0-df39fa75e2e6 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] [instance: 3f80e8f0-dba3-4403-83f8-0473c5d7d29b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:29.470499 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-6a824aee-0b40-4111-9e2d-50a29f00df03 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-832491167"}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:51:29.473723 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-6a824aee-0b40-4111-9e2d-50a29f00df03 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] [instance: 6f8a46c4-3b6f-4f50-8227-77b69154fb57] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:29.478675 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ecf1cb10-9920-4b57-9ab0-df39fa75e2e6 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:29.479168 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ecf1cb10-9920-4b57-9ab0-df39fa75e2e6 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:29.482521 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6a824aee-0b40-4111-9e2d-50a29f00df03 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:29.484371 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6a824aee-0b40-4111-9e2d-50a29f00df03 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:29.485245 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6a824aee-0b40-4111-9e2d-50a29f00df03 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:29.486199 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ecf1cb10-9920-4b57-9ab0-df39fa75e2e6 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:29.486431 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ecf1cb10-9920-4b57-9ab0-df39fa75e2e6 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:29.487546 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ecf1cb10-9920-4b57-9ab0-df39fa75e2e6 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:29.487938 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6a824aee-0b40-4111-9e2d-50a29f00df03 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:29.488392 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ecf1cb10-9920-4b57-9ab0-df39fa75e2e6 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:29.488547 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6a824aee-0b40-4111-9e2d-50a29f00df03 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:29.489532 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6a824aee-0b40-4111-9e2d-50a29f00df03 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:29.553078 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-ecf1cb10-9920-4b57-9ab0-df39fa75e2e6 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] [instance: 3f80e8f0-dba3-4403-83f8-0473c5d7d29b] Going to try to terminate instance {{(pid=134101) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:51:29.606505 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=100 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:51:29.717494 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-ecf1cb10-9920-4b57-9ab0-df39fa75e2e6 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] 10.222.0.43 "DELETE /compute/v2.1/servers/3f80e8f0-dba3-4403-83f8-0473c5d7d29b" status: 204 len: 0 microversion: 2.75 time: 0.273623 Oct 04 21:51:29.719395 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 981/2025] 10.222.0.43 () {60 vars in 1280 bytes} [Tue Oct 4 21:51:29 2022] DELETE /compute/v2.1/servers/3f80e8f0-dba3-4403-83f8-0473c5d7d29b => generated 0 bytes in 277 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 21:51:29.728653 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-3b2edb2c-3a60-4bfe-9540-c29670777545 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:29.729681 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-3b2edb2c-3a60-4bfe-9540-c29670777545 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] [instance: 3f80e8f0-dba3-4403-83f8-0473c5d7d29b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:29.739045 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3b2edb2c-3a60-4bfe-9540-c29670777545 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:29.740609 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3b2edb2c-3a60-4bfe-9540-c29670777545 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:29.741357 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3b2edb2c-3a60-4bfe-9540-c29670777545 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:29.742618 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3b2edb2c-3a60-4bfe-9540-c29670777545 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:29.743328 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3b2edb2c-3a60-4bfe-9540-c29670777545 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:29.744153 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3b2edb2c-3a60-4bfe-9540-c29670777545 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:29.771376 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-6a824aee-0b40-4111-9e2d-50a29f00df03 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] 10.222.0.43 "POST /compute/v2.1/servers/6f8a46c4-3b6f-4f50-8227-77b69154fb57/action" status: 202 len: 0 microversion: 2.1 time: 0.309681 Oct 04 21:51:29.782914 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1045/2026] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 21:51:29 2022] POST /compute/v2.1/servers/6f8a46c4-3b6f-4f50-8227-77b69154fb57/action => generated 0 bytes in 322 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 04 21:51:29.791581 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-f0612682-4759-4a6f-91e8-7147db8fc2a5 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Calling method '.version_select at 0x7fbb2e93f430>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:29.883686 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-f0612682-4759-4a6f-91e8-7147db8fc2a5 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] 10.222.0.43 "GET /compute/v2.1/images/e62b2cc2-812b-4ec4-bba4-5703d4b65e48" status: 200 len: 1454 microversion: 2.1 time: 0.099377 Oct 04 21:51:29.884276 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1046/2027] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:51:29 2022] GET /compute/v2.1/images/e62b2cc2-812b-4ec4-bba4-5703d4b65e48 => generated 1454 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:51:29.945104 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-224cecc3-455b-40d6-a27e-4eb83bf18746 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:29.947560 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-224cecc3-455b-40d6-a27e-4eb83bf18746 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 3f0a02bc-7993-4849-8b3c-7572327b4799] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:29.959940 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-224cecc3-455b-40d6-a27e-4eb83bf18746 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:29.964224 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-224cecc3-455b-40d6-a27e-4eb83bf18746 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:29.966061 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-224cecc3-455b-40d6-a27e-4eb83bf18746 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:29.974237 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-224cecc3-455b-40d6-a27e-4eb83bf18746 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:29.974774 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-224cecc3-455b-40d6-a27e-4eb83bf18746 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:29.975263 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-224cecc3-455b-40d6-a27e-4eb83bf18746 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:30.003913 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-3b2edb2c-3a60-4bfe-9540-c29670777545 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43653f2aea4e4884b5001dea5ec12be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b700f614a8b4cfba9b4abea45a06f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:30.019351 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-3b2edb2c-3a60-4bfe-9540-c29670777545 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43653f2aea4e4884b5001dea5ec12be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b700f614a8b4cfba9b4abea45a06f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:30.021291 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-3b2edb2c-3a60-4bfe-9540-c29670777545 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43653f2aea4e4884b5001dea5ec12be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b700f614a8b4cfba9b4abea45a06f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:30.045078 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-3b2edb2c-3a60-4bfe-9540-c29670777545 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] 10.222.0.43 "GET /compute/v2.1/servers/3f80e8f0-dba3-4403-83f8-0473c5d7d29b" status: 200 len: 1441 microversion: 2.75 time: 0.320215 Oct 04 21:51:30.045342 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-224cecc3-455b-40d6-a27e-4eb83bf18746 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/3f0a02bc-7993-4849-8b3c-7572327b4799/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.095921 Oct 04 21:51:30.050225 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1047/2028] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 21:51:29 2022] GET /compute/v2.1/servers/3f0a02bc-7993-4849-8b3c-7572327b4799/os-volume_attachments => generated 197 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:51:30.059315 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 982/2029] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:51:29 2022] GET /compute/v2.1/servers/3f80e8f0-dba3-4403-83f8-0473c5d7d29b => generated 1441 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:51:30.472474 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-963434d2-51bf-4c39-bb70-0bc4e56e7f42 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:30.473410 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-963434d2-51bf-4c39-bb70-0bc4e56e7f42 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] [instance: b646f5b5-a266-44df-80e6-5d1b2a3b91d7] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:30.476015 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_api:SELECT=100 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:51:30.495778 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-963434d2-51bf-4c39-bb70-0bc4e56e7f42 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:30.496333 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-963434d2-51bf-4c39-bb70-0bc4e56e7f42 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:30.496776 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-963434d2-51bf-4c39-bb70-0bc4e56e7f42 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:30.497498 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-963434d2-51bf-4c39-bb70-0bc4e56e7f42 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:30.497951 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-963434d2-51bf-4c39-bb70-0bc4e56e7f42 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:30.498397 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-963434d2-51bf-4c39-bb70-0bc4e56e7f42 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:30.902111 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-60b3fbfc-59e9-4d11-ba2a-830d2b154a57 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Calling method '.version_select at 0x7fbb2e6e0700>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:30.971172 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-60b3fbfc-59e9-4d11-ba2a-830d2b154a57 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] 10.222.0.43 "GET /compute/v2.1/images/e62b2cc2-812b-4ec4-bba4-5703d4b65e48" status: 200 len: 1454 microversion: 2.1 time: 0.075332 Oct 04 21:51:30.988324 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 983/2030] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:51:30 2022] GET /compute/v2.1/images/e62b2cc2-812b-4ec4-bba4-5703d4b65e48 => generated 1454 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:51:31.061158 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-316cc678-0852-4658-b404-5b14ab7600a0 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:31.064400 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-316cc678-0852-4658-b404-5b14ab7600a0 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 3f0a02bc-7993-4849-8b3c-7572327b4799] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:31.072863 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-316cc678-0852-4658-b404-5b14ab7600a0 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:31.073873 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-316cc678-0852-4658-b404-5b14ab7600a0 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:31.074757 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-316cc678-0852-4658-b404-5b14ab7600a0 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:31.075736 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-316cc678-0852-4658-b404-5b14ab7600a0 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:31.076413 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-316cc678-0852-4658-b404-5b14ab7600a0 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:31.077794 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-316cc678-0852-4658-b404-5b14ab7600a0 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:31.146099 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-316cc678-0852-4658-b404-5b14ab7600a0 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/3f0a02bc-7993-4849-8b3c-7572327b4799/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.089086 Oct 04 21:51:31.147349 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 984/2031] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 21:51:31 2022] GET /compute/v2.1/servers/3f0a02bc-7993-4849-8b3c-7572327b4799/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:51:31.152188 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-8b094955-0a66-4edf-8b31-f65af26f6daa tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:31.153040 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-8b094955-0a66-4edf-8b31-f65af26f6daa tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] [instance: 3f80e8f0-dba3-4403-83f8-0473c5d7d29b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:31.169280 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8b094955-0a66-4edf-8b31-f65af26f6daa tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:31.169863 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8b094955-0a66-4edf-8b31-f65af26f6daa tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:31.170320 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8b094955-0a66-4edf-8b31-f65af26f6daa tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:31.171470 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8b094955-0a66-4edf-8b31-f65af26f6daa tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:31.172101 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8b094955-0a66-4edf-8b31-f65af26f6daa tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:31.172546 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8b094955-0a66-4edf-8b31-f65af26f6daa tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:31.387073 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-8b094955-0a66-4edf-8b31-f65af26f6daa tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43653f2aea4e4884b5001dea5ec12be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b700f614a8b4cfba9b4abea45a06f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:31.411891 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-8b094955-0a66-4edf-8b31-f65af26f6daa tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43653f2aea4e4884b5001dea5ec12be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b700f614a8b4cfba9b4abea45a06f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:31.413669 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-963434d2-51bf-4c39-bb70-0bc4e56e7f42 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:31.415080 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-8b094955-0a66-4edf-8b31-f65af26f6daa tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43653f2aea4e4884b5001dea5ec12be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b700f614a8b4cfba9b4abea45a06f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:31.430029 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-8b094955-0a66-4edf-8b31-f65af26f6daa tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] 10.222.0.43 "GET /compute/v2.1/servers/3f80e8f0-dba3-4403-83f8-0473c5d7d29b" status: 200 len: 1441 microversion: 2.75 time: 0.281359 Oct 04 21:51:31.431895 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 985/2032] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:51:31 2022] GET /compute/v2.1/servers/3f80e8f0-dba3-4403-83f8-0473c5d7d29b => generated 1441 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:51:31.442701 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-963434d2-51bf-4c39-bb70-0bc4e56e7f42 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:31.442701 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-963434d2-51bf-4c39-bb70-0bc4e56e7f42 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:31.442701 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-963434d2-51bf-4c39-bb70-0bc4e56e7f42 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] 10.222.0.43 "GET /compute/v2.1/servers/b646f5b5-a266-44df-80e6-5d1b2a3b91d7" status: 200 len: 1293 microversion: 2.25 time: 0.968037 Oct 04 21:51:31.442701 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1048/2033] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:51:30 2022] GET /compute/v2.1/servers/b646f5b5-a266-44df-80e6-5d1b2a3b91d7 => generated 1293 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:51:31.986958 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-c67eda02-4439-41ab-aa94-5407a8d53501 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Calling method '.version_select at 0x7fbb2e8e75e0>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:32.069007 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-c67eda02-4439-41ab-aa94-5407a8d53501 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] 10.222.0.43 "GET /compute/v2.1/images/e62b2cc2-812b-4ec4-bba4-5703d4b65e48" status: 200 len: 1454 microversion: 2.1 time: 0.085634 Oct 04 21:51:32.070618 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1049/2034] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:51:31 2022] GET /compute/v2.1/images/e62b2cc2-812b-4ec4-bba4-5703d4b65e48 => generated 1454 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:51:32.159968 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-b3f9edad-d028-4e19-8c68-b9546fbe4992 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:32.162631 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-b3f9edad-d028-4e19-8c68-b9546fbe4992 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 3f0a02bc-7993-4849-8b3c-7572327b4799] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:32.182094 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b3f9edad-d028-4e19-8c68-b9546fbe4992 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:32.185336 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b3f9edad-d028-4e19-8c68-b9546fbe4992 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:32.186008 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b3f9edad-d028-4e19-8c68-b9546fbe4992 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:32.188624 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b3f9edad-d028-4e19-8c68-b9546fbe4992 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:32.189541 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b3f9edad-d028-4e19-8c68-b9546fbe4992 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:32.192714 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b3f9edad-d028-4e19-8c68-b9546fbe4992 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:32.284001 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-b3f9edad-d028-4e19-8c68-b9546fbe4992 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/3f0a02bc-7993-4849-8b3c-7572327b4799/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.128827 Oct 04 21:51:32.289993 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 986/2035] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 21:51:32 2022] GET /compute/v2.1/servers/3f0a02bc-7993-4849-8b3c-7572327b4799/os-volume_attachments => generated 197 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:51:32.464495 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-bcc30a5f-9d93-4a0a-b2ce-02ba91f7d43b tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:32.465396 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-bcc30a5f-9d93-4a0a-b2ce-02ba91f7d43b tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] [instance: b646f5b5-a266-44df-80e6-5d1b2a3b91d7] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:32.467388 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-960ade48-d1a0-4c89-a1e7-424e3ff34d14 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:32.468122 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-960ade48-d1a0-4c89-a1e7-424e3ff34d14 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] [instance: 3f80e8f0-dba3-4403-83f8-0473c5d7d29b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:32.474823 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bcc30a5f-9d93-4a0a-b2ce-02ba91f7d43b tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:32.476913 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-960ade48-d1a0-4c89-a1e7-424e3ff34d14 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:32.477108 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bcc30a5f-9d93-4a0a-b2ce-02ba91f7d43b tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:32.477527 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-960ade48-d1a0-4c89-a1e7-424e3ff34d14 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:32.478053 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-960ade48-d1a0-4c89-a1e7-424e3ff34d14 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:32.478185 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bcc30a5f-9d93-4a0a-b2ce-02ba91f7d43b tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:32.478931 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-960ade48-d1a0-4c89-a1e7-424e3ff34d14 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:32.479615 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-960ade48-d1a0-4c89-a1e7-424e3ff34d14 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:32.480343 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-960ade48-d1a0-4c89-a1e7-424e3ff34d14 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:32.480580 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bcc30a5f-9d93-4a0a-b2ce-02ba91f7d43b tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:32.484415 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bcc30a5f-9d93-4a0a-b2ce-02ba91f7d43b tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:32.485900 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bcc30a5f-9d93-4a0a-b2ce-02ba91f7d43b tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:32.663614 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-960ade48-d1a0-4c89-a1e7-424e3ff34d14 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43653f2aea4e4884b5001dea5ec12be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b700f614a8b4cfba9b4abea45a06f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:32.687610 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-960ade48-d1a0-4c89-a1e7-424e3ff34d14 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43653f2aea4e4884b5001dea5ec12be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b700f614a8b4cfba9b4abea45a06f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:32.699462 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-960ade48-d1a0-4c89-a1e7-424e3ff34d14 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43653f2aea4e4884b5001dea5ec12be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b700f614a8b4cfba9b4abea45a06f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:32.732578 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-960ade48-d1a0-4c89-a1e7-424e3ff34d14 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] 10.222.0.43 "GET /compute/v2.1/servers/3f80e8f0-dba3-4403-83f8-0473c5d7d29b" status: 200 len: 1441 microversion: 2.75 time: 0.270391 Oct 04 21:51:32.754659 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1050/2036] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:51:32 2022] GET /compute/v2.1/servers/3f80e8f0-dba3-4403-83f8-0473c5d7d29b => generated 1441 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:51:32.934099 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-bcc30a5f-9d93-4a0a-b2ce-02ba91f7d43b tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:32.943397 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-bcc30a5f-9d93-4a0a-b2ce-02ba91f7d43b tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:32.944836 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-bcc30a5f-9d93-4a0a-b2ce-02ba91f7d43b tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:32.945967 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-bcc30a5f-9d93-4a0a-b2ce-02ba91f7d43b tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] 10.222.0.43 "GET /compute/v2.1/servers/b646f5b5-a266-44df-80e6-5d1b2a3b91d7" status: 200 len: 1293 microversion: 2.25 time: 0.485687 Oct 04 21:51:32.974897 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 987/2037] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:51:32 2022] GET /compute/v2.1/servers/b646f5b5-a266-44df-80e6-5d1b2a3b91d7 => generated 1293 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:51:33.091241 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-d84d1b8c-c4b6-48c3-a8cd-d2d162530051 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Calling method '.version_select at 0x7fbb2e881a60>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:33.194324 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-d84d1b8c-c4b6-48c3-a8cd-d2d162530051 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] 10.222.0.43 "GET /compute/v2.1/images/e62b2cc2-812b-4ec4-bba4-5703d4b65e48" status: 200 len: 1454 microversion: 2.1 time: 0.112788 Oct 04 21:51:33.195193 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1051/2038] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:51:33 2022] GET /compute/v2.1/images/e62b2cc2-812b-4ec4-bba4-5703d4b65e48 => generated 1454 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:51:33.301741 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-4c7e595a-e406-4f1c-8607-11d0711b7e3c tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:33.305774 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-4c7e595a-e406-4f1c-8607-11d0711b7e3c tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 3f0a02bc-7993-4849-8b3c-7572327b4799] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:33.323951 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4c7e595a-e406-4f1c-8607-11d0711b7e3c tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:33.324370 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4c7e595a-e406-4f1c-8607-11d0711b7e3c tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:33.324798 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4c7e595a-e406-4f1c-8607-11d0711b7e3c tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:33.325513 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4c7e595a-e406-4f1c-8607-11d0711b7e3c tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:33.325958 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4c7e595a-e406-4f1c-8607-11d0711b7e3c tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:33.326557 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4c7e595a-e406-4f1c-8607-11d0711b7e3c tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:33.416292 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-4c7e595a-e406-4f1c-8607-11d0711b7e3c tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/3f0a02bc-7993-4849-8b3c-7572327b4799/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.123550 Oct 04 21:51:33.416896 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 988/2039] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 21:51:33 2022] GET /compute/v2.1/servers/3f0a02bc-7993-4849-8b3c-7572327b4799/os-volume_attachments => generated 25 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 04 21:51:33.768594 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-5811c238-4b0f-49fd-98d8-83d73cb38551 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:33.770533 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-5811c238-4b0f-49fd-98d8-83d73cb38551 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] [instance: 3f80e8f0-dba3-4403-83f8-0473c5d7d29b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:33.792185 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5811c238-4b0f-49fd-98d8-83d73cb38551 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:33.795246 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5811c238-4b0f-49fd-98d8-83d73cb38551 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:33.796733 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5811c238-4b0f-49fd-98d8-83d73cb38551 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:33.804769 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5811c238-4b0f-49fd-98d8-83d73cb38551 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:33.806750 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5811c238-4b0f-49fd-98d8-83d73cb38551 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:33.809073 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5811c238-4b0f-49fd-98d8-83d73cb38551 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:33.866662 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-5811c238-4b0f-49fd-98d8-83d73cb38551 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] HTTP exception thrown: Instance 3f80e8f0-dba3-4403-83f8-0473c5d7d29b could not be found. Oct 04 21:51:33.868201 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-5811c238-4b0f-49fd-98d8-83d73cb38551 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Request method failure captured: Oct 04 21:51:33.868201 n-d-860284-1 devstack@n-api.service[134102]: request: GET /compute/v2.1/servers/3f80e8f0-dba3-4403-83f8-0473c5d7d29b HTTP/1.1 Oct 04 21:51:33.868201 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 21:51:33.868201 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 21:51:33.868201 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 21:51:33.868201 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 21:51:33.868201 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 21:51:33.868201 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 21:51:33.868201 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 21:51:33.868201 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 21:51:33.868201 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPKqJosAKsq-DJfTJ6pZk6GX-t8EfMdFNm9ukPung4V4eaMZsb070f-sHcM4cVTC2H7s_jf-osUFekQOR-uiYJwa0wTzRZrZ487kgWAJocNwSn_pMrfYUOIGlBJjaEUgaRCcjJLAKJhChhwsWRU5SNgY_hsp4vDojyHLALYXk0Sr2tyE Oct 04 21:51:33.868201 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 21:51:33.868201 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 21:51:33.868201 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 21:51:33.868201 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 21:51:33.868201 n-d-860284-1 devstack@n-api.service[134102]: X-Openstack-Nova-Api-Version: 2.75 Oct 04 21:51:33.868201 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 21:51:33.868201 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 21:51:33.868201 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: 1b700f614a8b4cfba9b4abea45a06f30 Oct 04 21:51:33.868201 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-ServersAdmin275Test-1266273475 Oct 04 21:51:33.868201 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 21:51:33.868201 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 21:51:33.868201 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1b700f614a8b4cfba9b4abea45a06f30"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_1b700f614a8b4cfba9b4abea45a06f30", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1b700f614a8b4cfba9b4abea45a06f30"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/1b700f614a8b4cfba9b4abea45a06f30"}]}] Oct 04 21:51:33.868201 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-ServersAdmin275Test-1266273475 Oct 04 21:51:33.868201 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: 1b700f614a8b4cfba9b4abea45a06f30 Oct 04 21:51:33.868201 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-ServersAdmin275Test-1266273475 Oct 04 21:51:33.868201 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-ServersAdmin275Test-1266273475-project Oct 04 21:51:33.868201 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 21:51:33.868201 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 21:51:33.868201 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: 43653f2aea4e4884b5001dea5ec12be2 Oct 04 21:51:33.868201 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-ServersAdmin275Test-1266273475-project Oct 04 21:51:33.868201 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 21:51:33.868201 n-d-860284-1 devstack@n-api.service[134102]: exception: Instance 3f80e8f0-dba3-4403-83f8-0473c5d7d29b could not be found. Oct 04 21:51:33.868201 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': '3f80e8f0-dba3-4403-83f8-0473c5d7d29b'} Oct 04 21:51:33.868201 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:51:33.868201 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:51:33.868201 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:51:33.868201 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:51:33.868201 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:51:33.868201 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:51:33.868201 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:51:33.868201 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:51:33.868201 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:51:33.868201 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:51:33.868201 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f80e8f0-dba3-4403-83f8-0473c5d7d29b could not be found. Oct 04 21:51:33.868201 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:51:33.868201 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:51:33.868201 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:51:33.868201 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:51:33.868201 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:51:33.868201 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:51:33.868201 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:51:33.868201 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:51:33.868201 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:51:33.868201 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:51:33.868201 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:51:33.868201 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:51:33.868201 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:51:33.868201 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:51:33.868201 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:51:33.868201 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:51:33.868201 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f80e8f0-dba3-4403-83f8-0473c5d7d29b could not be found. Oct 04 21:51:33.868201 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:51:33.868201 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:51:33.868201 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:51:33.879956 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:51:33.879956 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:51:33.879956 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:51:33.879956 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:51:33.879956 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:51:33.879956 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f80e8f0-dba3-4403-83f8-0473c5d7d29b could not be found. Oct 04 21:51:33.879956 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:51:33.879956 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-5811c238-4b0f-49fd-98d8-83d73cb38551 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] Returning 404 to user: Instance 3f80e8f0-dba3-4403-83f8-0473c5d7d29b could not be found. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:51:33.893364 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-5811c238-4b0f-49fd-98d8-83d73cb38551 tempest-ServersAdmin275Test-1266273475 tempest-ServersAdmin275Test-1266273475-project] 10.222.0.43 "GET /compute/v2.1/servers/3f80e8f0-dba3-4403-83f8-0473c5d7d29b" status: 404 len: 111 microversion: 2.75 time: 0.109401 Oct 04 21:51:33.898600 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1052/2040] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:51:33 2022] GET /compute/v2.1/servers/3f80e8f0-dba3-4403-83f8-0473c5d7d29b => generated 111 bytes in 139 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 21:51:33.982562 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-f971f6d8-ce6f-494b-9e0b-670e984901dd tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:33.984248 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-f971f6d8-ce6f-494b-9e0b-670e984901dd tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] [instance: b646f5b5-a266-44df-80e6-5d1b2a3b91d7] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:34.000232 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f971f6d8-ce6f-494b-9e0b-670e984901dd tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:34.001325 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f971f6d8-ce6f-494b-9e0b-670e984901dd tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:34.003038 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f971f6d8-ce6f-494b-9e0b-670e984901dd tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:34.022262 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f971f6d8-ce6f-494b-9e0b-670e984901dd tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:34.024556 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f971f6d8-ce6f-494b-9e0b-670e984901dd tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:34.025989 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f971f6d8-ce6f-494b-9e0b-670e984901dd tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:34.211889 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-13087c2c-2664-48ea-a88c-7c283667c6df tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Calling method '.version_select at 0x7fbb2e881b80>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:34.315168 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-13087c2c-2664-48ea-a88c-7c283667c6df tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] 10.222.0.43 "GET /compute/v2.1/images/e62b2cc2-812b-4ec4-bba4-5703d4b65e48" status: 200 len: 1454 microversion: 2.1 time: 0.107785 Oct 04 21:51:34.320376 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1053/2041] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:51:34 2022] GET /compute/v2.1/images/e62b2cc2-812b-4ec4-bba4-5703d4b65e48 => generated 1454 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:51:34.701035 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-f971f6d8-ce6f-494b-9e0b-670e984901dd tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:34.721783 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-f971f6d8-ce6f-494b-9e0b-670e984901dd tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:34.724406 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-f971f6d8-ce6f-494b-9e0b-670e984901dd tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:34.725561 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-f971f6d8-ce6f-494b-9e0b-670e984901dd tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] 10.222.0.43 "GET /compute/v2.1/servers/b646f5b5-a266-44df-80e6-5d1b2a3b91d7" status: 200 len: 1293 microversion: 2.25 time: 0.749226 Oct 04 21:51:34.732786 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 989/2042] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:51:33 2022] GET /compute/v2.1/servers/b646f5b5-a266-44df-80e6-5d1b2a3b91d7 => generated 1293 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:51:35.337275 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-7d852421-9acd-457a-a06a-bbc1de5c354e tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Calling method '.version_select at 0x7fbb2e881c10>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:35.431249 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-7d852421-9acd-457a-a06a-bbc1de5c354e tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] 10.222.0.43 "GET /compute/v2.1/images/e62b2cc2-812b-4ec4-bba4-5703d4b65e48" status: 200 len: 1454 microversion: 2.1 time: 0.098709 Oct 04 21:51:35.431845 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1054/2043] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:51:35 2022] GET /compute/v2.1/images/e62b2cc2-812b-4ec4-bba4-5703d4b65e48 => generated 1454 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:51:35.751274 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-a79a546a-5224-48e1-8093-5e14b3f91312 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:35.752097 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-a79a546a-5224-48e1-8093-5e14b3f91312 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] [instance: b646f5b5-a266-44df-80e6-5d1b2a3b91d7] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:35.765081 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a79a546a-5224-48e1-8093-5e14b3f91312 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:35.768298 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a79a546a-5224-48e1-8093-5e14b3f91312 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:35.768917 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a79a546a-5224-48e1-8093-5e14b3f91312 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:35.770905 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a79a546a-5224-48e1-8093-5e14b3f91312 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:35.771487 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a79a546a-5224-48e1-8093-5e14b3f91312 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:35.773689 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a79a546a-5224-48e1-8093-5e14b3f91312 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:36.141143 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-a79a546a-5224-48e1-8093-5e14b3f91312 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:36.181978 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-a79a546a-5224-48e1-8093-5e14b3f91312 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:36.189708 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-a79a546a-5224-48e1-8093-5e14b3f91312 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:36.193467 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-a79a546a-5224-48e1-8093-5e14b3f91312 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] 10.222.0.43 "GET /compute/v2.1/servers/b646f5b5-a266-44df-80e6-5d1b2a3b91d7" status: 200 len: 1293 microversion: 2.25 time: 0.446620 Oct 04 21:51:36.197403 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 990/2044] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:51:35 2022] GET /compute/v2.1/servers/b646f5b5-a266-44df-80e6-5d1b2a3b91d7 => generated 1293 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:51:36.448500 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-236b30d1-6013-47cf-8526-7127759e5e06 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Calling method '.version_select at 0x7fbb2e97a0d0>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:37.219655 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-80b8ca43-43d4-45d0-9402-e93b2af2400b tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:37.221141 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-80b8ca43-43d4-45d0-9402-e93b2af2400b tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] [instance: b646f5b5-a266-44df-80e6-5d1b2a3b91d7] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:37.231398 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-80b8ca43-43d4-45d0-9402-e93b2af2400b tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:37.241458 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-80b8ca43-43d4-45d0-9402-e93b2af2400b tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:37.243651 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-80b8ca43-43d4-45d0-9402-e93b2af2400b tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:37.244697 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-80b8ca43-43d4-45d0-9402-e93b2af2400b tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:37.246781 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-80b8ca43-43d4-45d0-9402-e93b2af2400b tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:37.249072 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-80b8ca43-43d4-45d0-9402-e93b2af2400b tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:37.575967 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-80b8ca43-43d4-45d0-9402-e93b2af2400b tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:37.591284 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-80b8ca43-43d4-45d0-9402-e93b2af2400b tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:37.600097 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-80b8ca43-43d4-45d0-9402-e93b2af2400b tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:37.605777 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-80b8ca43-43d4-45d0-9402-e93b2af2400b tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] 10.222.0.43 "GET /compute/v2.1/servers/b646f5b5-a266-44df-80e6-5d1b2a3b91d7" status: 200 len: 1281 microversion: 2.25 time: 0.389098 Oct 04 21:51:37.620980 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 991/2045] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:51:37 2022] GET /compute/v2.1/servers/b646f5b5-a266-44df-80e6-5d1b2a3b91d7 => generated 1281 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:51:38.641000 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-f6335678-4e76-4202-842d-b69487b0ba5e tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:38.641982 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-f6335678-4e76-4202-842d-b69487b0ba5e tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] [instance: b646f5b5-a266-44df-80e6-5d1b2a3b91d7] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:38.656577 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f6335678-4e76-4202-842d-b69487b0ba5e tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:38.657083 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f6335678-4e76-4202-842d-b69487b0ba5e tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:38.659743 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f6335678-4e76-4202-842d-b69487b0ba5e tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:38.664311 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f6335678-4e76-4202-842d-b69487b0ba5e tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:38.664822 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f6335678-4e76-4202-842d-b69487b0ba5e tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:38.665273 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f6335678-4e76-4202-842d-b69487b0ba5e tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:38.957350 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-f6335678-4e76-4202-842d-b69487b0ba5e tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:38.970527 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-f6335678-4e76-4202-842d-b69487b0ba5e tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:38.972567 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-f6335678-4e76-4202-842d-b69487b0ba5e tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:38.973934 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-f6335678-4e76-4202-842d-b69487b0ba5e tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] 10.222.0.43 "GET /compute/v2.1/servers/b646f5b5-a266-44df-80e6-5d1b2a3b91d7" status: 200 len: 1281 microversion: 2.25 time: 0.340122 Oct 04 21:51:38.976127 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 992/2046] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:51:38 2022] GET /compute/v2.1/servers/b646f5b5-a266-44df-80e6-5d1b2a3b91d7 => generated 1281 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:51:40.010448 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-1687331f-4ef8-423f-93d3-578c3dd4f2a4 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:40.011988 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-1687331f-4ef8-423f-93d3-578c3dd4f2a4 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] [instance: b646f5b5-a266-44df-80e6-5d1b2a3b91d7] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:40.022197 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1687331f-4ef8-423f-93d3-578c3dd4f2a4 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:40.023104 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1687331f-4ef8-423f-93d3-578c3dd4f2a4 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:40.024569 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1687331f-4ef8-423f-93d3-578c3dd4f2a4 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:40.025754 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1687331f-4ef8-423f-93d3-578c3dd4f2a4 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:40.026483 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1687331f-4ef8-423f-93d3-578c3dd4f2a4 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:40.027438 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1687331f-4ef8-423f-93d3-578c3dd4f2a4 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:40.471839 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-1687331f-4ef8-423f-93d3-578c3dd4f2a4 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:40.484114 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-1687331f-4ef8-423f-93d3-578c3dd4f2a4 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:40.487656 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-1687331f-4ef8-423f-93d3-578c3dd4f2a4 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:40.490470 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-1687331f-4ef8-423f-93d3-578c3dd4f2a4 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] 10.222.0.43 "GET /compute/v2.1/servers/b646f5b5-a266-44df-80e6-5d1b2a3b91d7" status: 200 len: 1281 microversion: 2.25 time: 0.488144 Oct 04 21:51:40.491760 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 993/2047] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:51:40 2022] GET /compute/v2.1/servers/b646f5b5-a266-44df-80e6-5d1b2a3b91d7 => generated 1281 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:51:40.496598 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-8190d7d7-66e1-485b-b182-e66b7373c5a9 req-a84b9cfe-af5c-4a0b-ab2e-4ccb2800586a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f8a46c4-3b6f-4f50-8227-77b69154fb57", "name": "network-vif-plugged", "status": "completed", "tag": "0b8186cd-d9f4-408f-9942-a8fcb3a46521"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:51:40.507854 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-8190d7d7-66e1-485b-b182-e66b7373c5a9 req-a84b9cfe-af5c-4a0b-ab2e-4ccb2800586a service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:40.508670 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-8190d7d7-66e1-485b-b182-e66b7373c5a9 req-a84b9cfe-af5c-4a0b-ab2e-4ccb2800586a service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:40.509553 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-8190d7d7-66e1-485b-b182-e66b7373c5a9 req-a84b9cfe-af5c-4a0b-ab2e-4ccb2800586a service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:40.523737 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-8190d7d7-66e1-485b-b182-e66b7373c5a9 req-a84b9cfe-af5c-4a0b-ab2e-4ccb2800586a service nova] Creating event network-vif-plugged:0b8186cd-d9f4-408f-9942-a8fcb3a46521 for instance 6f8a46c4-3b6f-4f50-8227-77b69154fb57 on n-h2-860284-1 Oct 04 21:51:40.529902 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-8190d7d7-66e1-485b-b182-e66b7373c5a9 req-a84b9cfe-af5c-4a0b-ab2e-4ccb2800586a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036654 Oct 04 21:51:40.531380 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 994/2048] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:51:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:51:40.858635 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-5c505a9e-8a79-4ab2-aea8-86ecd7a6931b tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-439169324", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452", "networks": [{"uuid": "b2d5ff4b-2608-4509-b08b-a756c3083faa"}]}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:51:41.155321 n-d-860284-1 devstack@n-api.service[134101]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 21:51:41.156547 n-d-860284-1 devstack@n-api.service[134101]: Tue Oct 4 21:51:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.43) !!! Oct 04 21:51:43.789348 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_api:SELECT=7 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:51:43.825274 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:51:50.514886 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:51:50.870899 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=1 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:51:58.070867 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.network.neutron [None req-5c505a9e-8a79-4ab2-aea8-86ecd7a6931b tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] validate_networks() for [('b2d5ff4b-2608-4509-b08b-a756c3083faa', None, None, None, None, None)] {{(pid=134101) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:51:58.077262 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-236b30d1-6013-47cf-8526-7127759e5e06 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] 10.222.0.43 "GET /compute/v2.1/images/e62b2cc2-812b-4ec4-bba4-5703d4b65e48" status: 200 len: 1454 microversion: 2.1 time: 21.632566 Oct 04 21:51:58.078042 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1055/2049] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:51:36 2022] GET /compute/v2.1/images/e62b2cc2-812b-4ec4-bba4-5703d4b65e48 => generated 1454 bytes in 21635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:51:58.089693 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-70320abd-f55c-41e2-9b67-a67d6e5d11cd tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:58.091066 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-70320abd-f55c-41e2-9b67-a67d6e5d11cd tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] [instance: b646f5b5-a266-44df-80e6-5d1b2a3b91d7] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:58.104705 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-70320abd-f55c-41e2-9b67-a67d6e5d11cd tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:58.106327 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-70320abd-f55c-41e2-9b67-a67d6e5d11cd tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:58.108634 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-70320abd-f55c-41e2-9b67-a67d6e5d11cd tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:58.110618 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-70320abd-f55c-41e2-9b67-a67d6e5d11cd tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:58.112011 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-70320abd-f55c-41e2-9b67-a67d6e5d11cd tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:58.116280 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-70320abd-f55c-41e2-9b67-a67d6e5d11cd tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:58.595785 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-70320abd-f55c-41e2-9b67-a67d6e5d11cd tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:58.610421 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-70320abd-f55c-41e2-9b67-a67d6e5d11cd tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:58.612460 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-70320abd-f55c-41e2-9b67-a67d6e5d11cd tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:58.615832 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-70320abd-f55c-41e2-9b67-a67d6e5d11cd tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] 10.222.0.43 "GET /compute/v2.1/servers/b646f5b5-a266-44df-80e6-5d1b2a3b91d7" status: 200 len: 1281 microversion: 2.25 time: 0.535800 Oct 04 21:51:58.626477 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1056/2050] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:51:58 2022] GET /compute/v2.1/servers/b646f5b5-a266-44df-80e6-5d1b2a3b91d7 => generated 1281 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:51:58.644662 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-3e5faa00-332d-4ad6-9168-0262c6e06637 tempest-ServersTestFqdnHostnames-1740621305 tempest-ServersTestFqdnHostnames-1740621305-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:58.646169 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-3e5faa00-332d-4ad6-9168-0262c6e06637 tempest-ServersTestFqdnHostnames-1740621305 tempest-ServersTestFqdnHostnames-1740621305-project] [instance: a50a2117-fefe-499b-a2d4-b57e264a5a51] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:58.666348 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3e5faa00-332d-4ad6-9168-0262c6e06637 tempest-ServersTestFqdnHostnames-1740621305 tempest-ServersTestFqdnHostnames-1740621305-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:58.667901 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3e5faa00-332d-4ad6-9168-0262c6e06637 tempest-ServersTestFqdnHostnames-1740621305 tempest-ServersTestFqdnHostnames-1740621305-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:58.669308 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3e5faa00-332d-4ad6-9168-0262c6e06637 tempest-ServersTestFqdnHostnames-1740621305 tempest-ServersTestFqdnHostnames-1740621305-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:58.675561 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3e5faa00-332d-4ad6-9168-0262c6e06637 tempest-ServersTestFqdnHostnames-1740621305 tempest-ServersTestFqdnHostnames-1740621305-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:58.682251 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3e5faa00-332d-4ad6-9168-0262c6e06637 tempest-ServersTestFqdnHostnames-1740621305 tempest-ServersTestFqdnHostnames-1740621305-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:58.684578 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3e5faa00-332d-4ad6-9168-0262c6e06637 tempest-ServersTestFqdnHostnames-1740621305 tempest-ServersTestFqdnHostnames-1740621305-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:58.749513 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-3e5faa00-332d-4ad6-9168-0262c6e06637 tempest-ServersTestFqdnHostnames-1740621305 tempest-ServersTestFqdnHostnames-1740621305-project] [instance: a50a2117-fefe-499b-a2d4-b57e264a5a51] Going to try to terminate instance {{(pid=134102) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:51:58.863152 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-3e5faa00-332d-4ad6-9168-0262c6e06637 tempest-ServersTestFqdnHostnames-1740621305 tempest-ServersTestFqdnHostnames-1740621305-project] 10.222.0.43 "DELETE /compute/v2.1/servers/a50a2117-fefe-499b-a2d4-b57e264a5a51" status: 204 len: 0 microversion: 2.1 time: 0.232814 Oct 04 21:51:58.864893 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1057/2051] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 21:51:58 2022] DELETE /compute/v2.1/servers/a50a2117-fefe-499b-a2d4-b57e264a5a51 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:51:58.867094 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-5c505a9e-8a79-4ab2-aea8-86ecd7a6931b tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] Flavor limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:51:58.867603 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-5c505a9e-8a79-4ab2-aea8-86ecd7a6931b tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] Image limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:51:58.868402 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-5c505a9e-8a79-4ab2-aea8-86ecd7a6931b tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] Flavor pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:51:58.868835 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-5c505a9e-8a79-4ab2-aea8-86ecd7a6931b tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] Image pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:51:58.869274 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-5c505a9e-8a79-4ab2-aea8-86ecd7a6931b tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:51:58.894148 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-6fac7f20-35dc-47a2-abe3-1e07e8baf47b req-7a46cf09-879a-4f27-b358-aa00539a51b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b646f5b5-a266-44df-80e6-5d1b2a3b91d7", "name": "network-vif-plugged", "status": "completed", "tag": "433775b7-13ed-49fa-86e4-2e7c2fe9e176"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:51:58.894637 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5c505a9e-8a79-4ab2-aea8-86ecd7a6931b tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:58.895086 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5c505a9e-8a79-4ab2-aea8-86ecd7a6931b tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:58.895638 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5c505a9e-8a79-4ab2-aea8-86ecd7a6931b tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:58.896512 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5c505a9e-8a79-4ab2-aea8-86ecd7a6931b tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:58.897084 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5c505a9e-8a79-4ab2-aea8-86ecd7a6931b tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:58.905647 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5c505a9e-8a79-4ab2-aea8-86ecd7a6931b tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:58.915042 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-6fac7f20-35dc-47a2-abe3-1e07e8baf47b req-7a46cf09-879a-4f27-b358-aa00539a51b6 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:58.916809 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-6fac7f20-35dc-47a2-abe3-1e07e8baf47b req-7a46cf09-879a-4f27-b358-aa00539a51b6 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:58.918225 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-6fac7f20-35dc-47a2-abe3-1e07e8baf47b req-7a46cf09-879a-4f27-b358-aa00539a51b6 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:58.942725 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-6fac7f20-35dc-47a2-abe3-1e07e8baf47b req-7a46cf09-879a-4f27-b358-aa00539a51b6 service nova] Creating event network-vif-plugged:433775b7-13ed-49fa-86e4-2e7c2fe9e176 for instance b646f5b5-a266-44df-80e6-5d1b2a3b91d7 on n-h1-860284-1 Oct 04 21:51:58.948211 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-6fac7f20-35dc-47a2-abe3-1e07e8baf47b req-7a46cf09-879a-4f27-b358-aa00539a51b6 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081370 Oct 04 21:51:58.948836 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1058/2052] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:51:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:51:58.964122 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-5c505a9e-8a79-4ab2-aea8-86ecd7a6931b tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] Getting quotas for project 71c6e52760ea4396a95a3ffb7db2a9a3. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:51:58.974358 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-5c505a9e-8a79-4ab2-aea8-86ecd7a6931b tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] Getting quotas for user fa551b85109f42b299665382695c6b17 and project 71c6e52760ea4396a95a3ffb7db2a9a3. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:51:58.998903 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-5c505a9e-8a79-4ab2-aea8-86ecd7a6931b tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] Going to run 1 instances... {{(pid=134101) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:51:59.001922 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-5c505a9e-8a79-4ab2-aea8-86ecd7a6931b tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] [instance: a600603a-de4c-4991-8827-9fec3dead821] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='58548514-5dac-426c-81f5-19e3fba33e23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134101) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:51:59.082184 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-5c505a9e-8a79-4ab2-aea8-86ecd7a6931b tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 18.547624 Oct 04 21:51:59.086348 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 995/2053] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 21:51:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 18554 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:51:59.102780 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e6d66c9a-ff77-4972-94e9-8e6eb4171157 tempest-ServersTestFqdnHostnames-1740621305 tempest-ServersTestFqdnHostnames-1740621305-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:59.104011 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-e6d66c9a-ff77-4972-94e9-8e6eb4171157 tempest-ServersTestFqdnHostnames-1740621305 tempest-ServersTestFqdnHostnames-1740621305-project] [instance: a50a2117-fefe-499b-a2d4-b57e264a5a51] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:59.121229 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e6d66c9a-ff77-4972-94e9-8e6eb4171157 tempest-ServersTestFqdnHostnames-1740621305 tempest-ServersTestFqdnHostnames-1740621305-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:59.121995 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e6d66c9a-ff77-4972-94e9-8e6eb4171157 tempest-ServersTestFqdnHostnames-1740621305 tempest-ServersTestFqdnHostnames-1740621305-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:59.123321 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e6d66c9a-ff77-4972-94e9-8e6eb4171157 tempest-ServersTestFqdnHostnames-1740621305 tempest-ServersTestFqdnHostnames-1740621305-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:59.126003 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e6d66c9a-ff77-4972-94e9-8e6eb4171157 tempest-ServersTestFqdnHostnames-1740621305 tempest-ServersTestFqdnHostnames-1740621305-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:59.157664 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e6d66c9a-ff77-4972-94e9-8e6eb4171157 tempest-ServersTestFqdnHostnames-1740621305 tempest-ServersTestFqdnHostnames-1740621305-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:59.160229 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e6d66c9a-ff77-4972-94e9-8e6eb4171157 tempest-ServersTestFqdnHostnames-1740621305 tempest-ServersTestFqdnHostnames-1740621305-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.032s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:59.299812 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-fdd6d92c-1ca2-420a-ac9d-b200c342dd76 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Action: 'create', calling method: .version_select at 0x7fbb2ea0dca0>, body: {"keypair": {"name": "tempest-keypair-1665435488", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEllGKR56GBDu7sMnMvZCrFHvL8Hn80CB2/zFR1KJx9I5aRnJgdJi1wSVPTBYvyDMzN8STA50TS+QdBr+bm1tXHyw8Cgg4Ih8pF52PmPoH1hc2KG/iofz4xyEb2SqbGG0g=="}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:51:59.330355 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-fdd6d92c-1ca2-420a-ac9d-b200c342dd76 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Getting quotas for project 1c4335ce6fd64a0397fbfb13e1b255ef. Resources: {'key_pairs'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:51:59.343648 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-fdd6d92c-1ca2-420a-ac9d-b200c342dd76 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Getting quotas for user 921f934be12045b3ac0b2c6ed5101bec and project 1c4335ce6fd64a0397fbfb13e1b255ef. Resources: {'key_pairs'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:51:59.406972 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-fdd6d92c-1ca2-420a-ac9d-b200c342dd76 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.455104 Oct 04 21:51:59.412096 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1059/2054] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Oct 4 21:51:58 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:51:59.433628 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-7cc995bf-46e7-440e-ab3b-066dee0ef072 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Calling method '.version_select at 0x7fbb2e93d1f0>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:59.536293 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-7cc995bf-46e7-440e-ab3b-066dee0ef072 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] 10.222.0.43 "GET /compute/v2.1/images/e62b2cc2-812b-4ec4-bba4-5703d4b65e48" status: 200 len: 1454 microversion: 2.1 time: 0.112625 Oct 04 21:51:59.537202 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1060/2055] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:51:59 2022] GET /compute/v2.1/images/e62b2cc2-812b-4ec4-bba4-5703d4b65e48 => generated 1454 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:51:59.553444 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-42dfa64f-6f93-46df-9d1b-4b63a40ab9c4 tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:59.553444 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-42dfa64f-6f93-46df-9d1b-4b63a40ab9c4 tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] [instance: a600603a-de4c-4991-8827-9fec3dead821] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:59.702487 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-e6d66c9a-ff77-4972-94e9-8e6eb4171157 tempest-ServersTestFqdnHostnames-1740621305 tempest-ServersTestFqdnHostnames-1740621305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ade6e5b885f4e7db1fef86de59a08de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dbdc46c0aa4d07a1eb5ade5b3a7212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:59.717929 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-42dfa64f-6f93-46df-9d1b-4b63a40ab9c4 tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa551b85109f42b299665382695c6b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c6e52760ea4396a95a3ffb7db2a9a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:59.723410 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-e6d66c9a-ff77-4972-94e9-8e6eb4171157 tempest-ServersTestFqdnHostnames-1740621305 tempest-ServersTestFqdnHostnames-1740621305-project] 10.222.0.43 "GET /compute/v2.1/servers/a50a2117-fefe-499b-a2d4-b57e264a5a51" status: 200 len: 1666 microversion: 2.1 time: 0.624697 Oct 04 21:51:59.727499 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-42dfa64f-6f93-46df-9d1b-4b63a40ab9c4 tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] 10.222.0.43 "GET /compute/v2.1/servers/a600603a-de4c-4991-8827-9fec3dead821" status: 200 len: 1224 microversion: 2.1 time: 0.187524 Oct 04 21:51:59.730357 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 996/2056] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:51:59 2022] GET /compute/v2.1/servers/a50a2117-fefe-499b-a2d4-b57e264a5a51 => generated 1666 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:51:59.730762 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1061/2057] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:51:59 2022] GET /compute/v2.1/servers/a600603a-de4c-4991-8827-9fec3dead821 => generated 1224 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:51:59.736397 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-16cfb54f-d641-4a21-855d-9c0d8605bf49 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:59.737364 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-16cfb54f-d641-4a21-855d-9c0d8605bf49 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] [instance: b646f5b5-a266-44df-80e6-5d1b2a3b91d7] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:59.744643 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-16cfb54f-d641-4a21-855d-9c0d8605bf49 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:59.745551 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-16cfb54f-d641-4a21-855d-9c0d8605bf49 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:59.746298 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-16cfb54f-d641-4a21-855d-9c0d8605bf49 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:59.747359 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-16cfb54f-d641-4a21-855d-9c0d8605bf49 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:59.748836 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-16cfb54f-d641-4a21-855d-9c0d8605bf49 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:59.749592 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-16cfb54f-d641-4a21-855d-9c0d8605bf49 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:00.321434 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-16cfb54f-d641-4a21-855d-9c0d8605bf49 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:00.332106 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-16cfb54f-d641-4a21-855d-9c0d8605bf49 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:00.350775 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-16cfb54f-d641-4a21-855d-9c0d8605bf49 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:00.352006 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-16cfb54f-d641-4a21-855d-9c0d8605bf49 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] 10.222.0.43 "GET /compute/v2.1/servers/b646f5b5-a266-44df-80e6-5d1b2a3b91d7" status: 200 len: 1281 microversion: 2.25 time: 0.620066 Oct 04 21:52:00.362431 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 997/2058] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:51:59 2022] GET /compute/v2.1/servers/b646f5b5-a266-44df-80e6-5d1b2a3b91d7 => generated 1281 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:52:00.562394 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-92cf91db-3b50-4981-9d32-f12f658056d9 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Calling method '.version_select at 0x7fbb2e89cee0>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:00.703985 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-92cf91db-3b50-4981-9d32-f12f658056d9 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] 10.222.0.43 "GET /compute/v2.1/images/e62b2cc2-812b-4ec4-bba4-5703d4b65e48" status: 200 len: 1454 microversion: 2.1 time: 0.146100 Oct 04 21:52:00.705705 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1062/2059] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:52:00 2022] GET /compute/v2.1/images/e62b2cc2-812b-4ec4-bba4-5703d4b65e48 => generated 1454 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:52:00.763865 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-ae7e3bf7-cb29-4556-b7db-1c1542bf1f1c tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:00.765371 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-faadca84-1a52-4680-8bdf-c432682dd5b1 tempest-ServersTestFqdnHostnames-1740621305 tempest-ServersTestFqdnHostnames-1740621305-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:00.766332 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-ae7e3bf7-cb29-4556-b7db-1c1542bf1f1c tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] [instance: a600603a-de4c-4991-8827-9fec3dead821] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:52:00.767215 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-faadca84-1a52-4680-8bdf-c432682dd5b1 tempest-ServersTestFqdnHostnames-1740621305 tempest-ServersTestFqdnHostnames-1740621305-project] [instance: a50a2117-fefe-499b-a2d4-b57e264a5a51] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:52:00.829543 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ae7e3bf7-cb29-4556-b7db-1c1542bf1f1c tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:00.830392 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ae7e3bf7-cb29-4556-b7db-1c1542bf1f1c tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:00.841691 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-faadca84-1a52-4680-8bdf-c432682dd5b1 tempest-ServersTestFqdnHostnames-1740621305 tempest-ServersTestFqdnHostnames-1740621305-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:00.856494 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ae7e3bf7-cb29-4556-b7db-1c1542bf1f1c tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:00.856494 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ae7e3bf7-cb29-4556-b7db-1c1542bf1f1c tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:00.856738 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-faadca84-1a52-4680-8bdf-c432682dd5b1 tempest-ServersTestFqdnHostnames-1740621305 tempest-ServersTestFqdnHostnames-1740621305-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:00.856738 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-faadca84-1a52-4680-8bdf-c432682dd5b1 tempest-ServersTestFqdnHostnames-1740621305 tempest-ServersTestFqdnHostnames-1740621305-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:00.856738 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-faadca84-1a52-4680-8bdf-c432682dd5b1 tempest-ServersTestFqdnHostnames-1740621305 tempest-ServersTestFqdnHostnames-1740621305-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:00.862029 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ae7e3bf7-cb29-4556-b7db-1c1542bf1f1c tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:00.863739 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-faadca84-1a52-4680-8bdf-c432682dd5b1 tempest-ServersTestFqdnHostnames-1740621305 tempest-ServersTestFqdnHostnames-1740621305-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:00.865153 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-faadca84-1a52-4680-8bdf-c432682dd5b1 tempest-ServersTestFqdnHostnames-1740621305 tempest-ServersTestFqdnHostnames-1740621305-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:00.866477 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ae7e3bf7-cb29-4556-b7db-1c1542bf1f1c tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:01.155667 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-ae7e3bf7-cb29-4556-b7db-1c1542bf1f1c tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa551b85109f42b299665382695c6b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c6e52760ea4396a95a3ffb7db2a9a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:01.168814 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-ae7e3bf7-cb29-4556-b7db-1c1542bf1f1c tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] 10.222.0.43 "GET /compute/v2.1/servers/a600603a-de4c-4991-8827-9fec3dead821" status: 200 len: 1228 microversion: 2.1 time: 0.412781 Oct 04 21:52:01.169610 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 998/2060] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:52:00 2022] GET /compute/v2.1/servers/a600603a-de4c-4991-8827-9fec3dead821 => generated 1228 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:52:01.380251 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-faadca84-1a52-4680-8bdf-c432682dd5b1 tempest-ServersTestFqdnHostnames-1740621305 tempest-ServersTestFqdnHostnames-1740621305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ade6e5b885f4e7db1fef86de59a08de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dbdc46c0aa4d07a1eb5ade5b3a7212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:01.387247 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-66eda765-8e7d-4b77-9aed-6aa23169df40 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:01.392140 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-66eda765-8e7d-4b77-9aed-6aa23169df40 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] [instance: b646f5b5-a266-44df-80e6-5d1b2a3b91d7] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:52:01.406206 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-faadca84-1a52-4680-8bdf-c432682dd5b1 tempest-ServersTestFqdnHostnames-1740621305 tempest-ServersTestFqdnHostnames-1740621305-project] 10.222.0.43 "GET /compute/v2.1/servers/a50a2117-fefe-499b-a2d4-b57e264a5a51" status: 200 len: 1666 microversion: 2.1 time: 0.652624 Oct 04 21:52:01.408933 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-66eda765-8e7d-4b77-9aed-6aa23169df40 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:01.424765 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-66eda765-8e7d-4b77-9aed-6aa23169df40 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:01.425165 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1063/2061] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:52:00 2022] GET /compute/v2.1/servers/a50a2117-fefe-499b-a2d4-b57e264a5a51 => generated 1666 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:52:01.425385 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-66eda765-8e7d-4b77-9aed-6aa23169df40 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:01.430897 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-66eda765-8e7d-4b77-9aed-6aa23169df40 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:01.431446 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-66eda765-8e7d-4b77-9aed-6aa23169df40 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:01.434802 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-66eda765-8e7d-4b77-9aed-6aa23169df40 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:01.741480 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-55b9d511-fb27-463d-8faf-5b188e9eb69e tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Calling method '.version_select at 0x7fbb2e884ca0>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:01.789670 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-66eda765-8e7d-4b77-9aed-6aa23169df40 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:01.845697 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-66eda765-8e7d-4b77-9aed-6aa23169df40 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:01.867208 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-66eda765-8e7d-4b77-9aed-6aa23169df40 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:01.869662 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-66eda765-8e7d-4b77-9aed-6aa23169df40 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] 10.222.0.43 "GET /compute/v2.1/servers/b646f5b5-a266-44df-80e6-5d1b2a3b91d7" status: 200 len: 1281 microversion: 2.25 time: 0.493764 Oct 04 21:52:01.908869 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 999/2062] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:52:01 2022] GET /compute/v2.1/servers/b646f5b5-a266-44df-80e6-5d1b2a3b91d7 => generated 1281 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:52:01.931670 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-55b9d511-fb27-463d-8faf-5b188e9eb69e tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] 10.222.0.43 "GET /compute/v2.1/images/e62b2cc2-812b-4ec4-bba4-5703d4b65e48" status: 200 len: 1454 microversion: 2.1 time: 0.200041 Oct 04 21:52:01.937012 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1064/2063] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:52:01 2022] GET /compute/v2.1/images/e62b2cc2-812b-4ec4-bba4-5703d4b65e48 => generated 1454 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:52:02.193838 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-66b7d252-96ca-4feb-8308-f3242d8ab3a5 tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:02.194843 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-66b7d252-96ca-4feb-8308-f3242d8ab3a5 tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] [instance: a600603a-de4c-4991-8827-9fec3dead821] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:52:02.209957 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-66b7d252-96ca-4feb-8308-f3242d8ab3a5 tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:02.219495 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-66b7d252-96ca-4feb-8308-f3242d8ab3a5 tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:02.233002 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-66b7d252-96ca-4feb-8308-f3242d8ab3a5 tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:02.249616 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-66b7d252-96ca-4feb-8308-f3242d8ab3a5 tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:02.250408 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-66b7d252-96ca-4feb-8308-f3242d8ab3a5 tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:02.251055 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-66b7d252-96ca-4feb-8308-f3242d8ab3a5 tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:02.444863 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-680be433-12a1-4e54-b524-89ed5d0eb20c tempest-ServersTestFqdnHostnames-1740621305 tempest-ServersTestFqdnHostnames-1740621305-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:02.445507 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-680be433-12a1-4e54-b524-89ed5d0eb20c tempest-ServersTestFqdnHostnames-1740621305 tempest-ServersTestFqdnHostnames-1740621305-project] [instance: a50a2117-fefe-499b-a2d4-b57e264a5a51] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:52:02.485389 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-66b7d252-96ca-4feb-8308-f3242d8ab3a5 tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa551b85109f42b299665382695c6b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c6e52760ea4396a95a3ffb7db2a9a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:02.501841 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-66b7d252-96ca-4feb-8308-f3242d8ab3a5 tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] 10.222.0.43 "GET /compute/v2.1/servers/a600603a-de4c-4991-8827-9fec3dead821" status: 200 len: 1276 microversion: 2.1 time: 0.312710 Oct 04 21:52:02.507559 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1000/2064] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:52:02 2022] GET /compute/v2.1/servers/a600603a-de4c-4991-8827-9fec3dead821 => generated 1276 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:52:02.940230 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-a3b4096c-9d24-4118-9a84-3274729320f0 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:02.941580 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-a3b4096c-9d24-4118-9a84-3274729320f0 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] [instance: b646f5b5-a266-44df-80e6-5d1b2a3b91d7] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:52:02.968638 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a3b4096c-9d24-4118-9a84-3274729320f0 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:02.969151 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a3b4096c-9d24-4118-9a84-3274729320f0 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:02.969811 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a3b4096c-9d24-4118-9a84-3274729320f0 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:02.971746 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a3b4096c-9d24-4118-9a84-3274729320f0 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:02.978405 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a3b4096c-9d24-4118-9a84-3274729320f0 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:02.979203 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a3b4096c-9d24-4118-9a84-3274729320f0 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:03.209251 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-680be433-12a1-4e54-b524-89ed5d0eb20c tempest-ServersTestFqdnHostnames-1740621305 tempest-ServersTestFqdnHostnames-1740621305-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:03.210573 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-680be433-12a1-4e54-b524-89ed5d0eb20c tempest-ServersTestFqdnHostnames-1740621305 tempest-ServersTestFqdnHostnames-1740621305-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:03.211303 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-680be433-12a1-4e54-b524-89ed5d0eb20c tempest-ServersTestFqdnHostnames-1740621305 tempest-ServersTestFqdnHostnames-1740621305-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:03.212365 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-680be433-12a1-4e54-b524-89ed5d0eb20c tempest-ServersTestFqdnHostnames-1740621305 tempest-ServersTestFqdnHostnames-1740621305-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:03.222567 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-680be433-12a1-4e54-b524-89ed5d0eb20c tempest-ServersTestFqdnHostnames-1740621305 tempest-ServersTestFqdnHostnames-1740621305-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:03.223298 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-680be433-12a1-4e54-b524-89ed5d0eb20c tempest-ServersTestFqdnHostnames-1740621305 tempest-ServersTestFqdnHostnames-1740621305-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:03.590297 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-a3b4096c-9d24-4118-9a84-3274729320f0 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:03.633089 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-a3b4096c-9d24-4118-9a84-3274729320f0 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:03.647623 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-a3b4096c-9d24-4118-9a84-3274729320f0 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:03.649780 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-a3b4096c-9d24-4118-9a84-3274729320f0 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] 10.222.0.43 "GET /compute/v2.1/servers/b646f5b5-a266-44df-80e6-5d1b2a3b91d7" status: 200 len: 1477 microversion: 2.25 time: 0.716737 Oct 04 21:52:03.650814 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1001/2065] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:52:02 2022] GET /compute/v2.1/servers/b646f5b5-a266-44df-80e6-5d1b2a3b91d7 => generated 1477 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:52:03.711310 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-087e5ee5-7ba5-45d1-be18-48826cc1e94d tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Calling method '.version_select at 0x7fbb2e693700>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:03.849377 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-680be433-12a1-4e54-b524-89ed5d0eb20c tempest-ServersTestFqdnHostnames-1740621305 tempest-ServersTestFqdnHostnames-1740621305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ade6e5b885f4e7db1fef86de59a08de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dbdc46c0aa4d07a1eb5ade5b3a7212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:03.871322 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-087e5ee5-7ba5-45d1-be18-48826cc1e94d tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] 10.222.0.43 "GET /compute/v2.1/images/e62b2cc2-812b-4ec4-bba4-5703d4b65e48" status: 200 len: 1454 microversion: 2.1 time: 0.205808 Oct 04 21:52:03.875681 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1002/2066] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:52:03 2022] GET /compute/v2.1/images/e62b2cc2-812b-4ec4-bba4-5703d4b65e48 => generated 1454 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:52:03.908449 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-1d63784b-7940-41f1-97ad-a29e3e6de5c2 tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:03.909627 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-1d63784b-7940-41f1-97ad-a29e3e6de5c2 tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] [instance: a600603a-de4c-4991-8827-9fec3dead821] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:52:03.913719 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-680be433-12a1-4e54-b524-89ed5d0eb20c tempest-ServersTestFqdnHostnames-1740621305 tempest-ServersTestFqdnHostnames-1740621305-project] 10.222.0.43 "GET /compute/v2.1/servers/a50a2117-fefe-499b-a2d4-b57e264a5a51" status: 200 len: 1666 microversion: 2.1 time: 1.467641 Oct 04 21:52:03.914460 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1065/2067] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:52:02 2022] GET /compute/v2.1/servers/a50a2117-fefe-499b-a2d4-b57e264a5a51 => generated 1666 bytes in 1475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:52:03.920438 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1d63784b-7940-41f1-97ad-a29e3e6de5c2 tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:03.921351 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1d63784b-7940-41f1-97ad-a29e3e6de5c2 tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:03.922052 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1d63784b-7940-41f1-97ad-a29e3e6de5c2 tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:03.925005 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1d63784b-7940-41f1-97ad-a29e3e6de5c2 tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:03.926695 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1d63784b-7940-41f1-97ad-a29e3e6de5c2 tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:03.928041 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1d63784b-7940-41f1-97ad-a29e3e6de5c2 tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:04.142247 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-1d63784b-7940-41f1-97ad-a29e3e6de5c2 tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa551b85109f42b299665382695c6b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c6e52760ea4396a95a3ffb7db2a9a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:04.158749 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-1d63784b-7940-41f1-97ad-a29e3e6de5c2 tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] 10.222.0.43 "GET /compute/v2.1/servers/a600603a-de4c-4991-8827-9fec3dead821" status: 200 len: 1282 microversion: 2.1 time: 0.271119 Oct 04 21:52:04.161736 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1003/2068] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:52:03 2022] GET /compute/v2.1/servers/a600603a-de4c-4991-8827-9fec3dead821 => generated 1282 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:52:04.393280 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-517de8b3-a2cf-45e8-b847-3ef86cc4dbc4 tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:04.394046 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-517de8b3-a2cf-45e8-b847-3ef86cc4dbc4 tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] [instance: b646f5b5-a266-44df-80e6-5d1b2a3b91d7] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:52:04.408477 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-517de8b3-a2cf-45e8-b847-3ef86cc4dbc4 tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:04.409011 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-517de8b3-a2cf-45e8-b847-3ef86cc4dbc4 tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:04.412885 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-517de8b3-a2cf-45e8-b847-3ef86cc4dbc4 tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:04.413690 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-517de8b3-a2cf-45e8-b847-3ef86cc4dbc4 tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:04.414177 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-517de8b3-a2cf-45e8-b847-3ef86cc4dbc4 tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:04.414709 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-517de8b3-a2cf-45e8-b847-3ef86cc4dbc4 tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:04.738712 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.objects.instance [None req-517de8b3-a2cf-45e8-b847-3ef86cc4dbc4 tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Lazy-loading 'services' on Instance uuid b646f5b5-a266-44df-80e6-5d1b2a3b91d7 {{(pid=134102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:52:04.770136 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-517de8b3-a2cf-45e8-b847-3ef86cc4dbc4 tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/b646f5b5-a266-44df-80e6-5d1b2a3b91d7" status: 200 len: 1970 microversion: 2.25 time: 0.854313 Oct 04 21:52:04.771283 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1066/2069] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:52:03 2022] GET /compute/v2.1/servers/b646f5b5-a266-44df-80e6-5d1b2a3b91d7 => generated 1970 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:52:04.818867 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-35e5729e-465c-4d01-9ae0-2b353557ba19 tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:04.827508 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-35e5729e-465c-4d01-9ae0-2b353557ba19 tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] [instance: b646f5b5-a266-44df-80e6-5d1b2a3b91d7] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:52:04.868431 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-35e5729e-465c-4d01-9ae0-2b353557ba19 tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:04.869127 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-35e5729e-465c-4d01-9ae0-2b353557ba19 tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:04.869841 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-35e5729e-465c-4d01-9ae0-2b353557ba19 tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:04.871081 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-35e5729e-465c-4d01-9ae0-2b353557ba19 tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:04.871917 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-35e5729e-465c-4d01-9ae0-2b353557ba19 tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:04.873627 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-35e5729e-465c-4d01-9ae0-2b353557ba19 tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:04.893718 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-4208298a-bbd6-4c96-8e73-d9fac073b78b tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Calling method '.version_select at 0x7fbb2fefd430>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:04.997087 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-4208298a-bbd6-4c96-8e73-d9fac073b78b tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] 10.222.0.43 "GET /compute/v2.1/images/e62b2cc2-812b-4ec4-bba4-5703d4b65e48" status: 200 len: 1454 microversion: 2.1 time: 0.109045 Oct 04 21:52:04.998947 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1067/2070] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:52:04 2022] GET /compute/v2.1/images/e62b2cc2-812b-4ec4-bba4-5703d4b65e48 => generated 1454 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:52:05.015068 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-db597c63-cf5b-4b4e-84c6-5bf775800cbf tempest-ServersTestFqdnHostnames-1740621305 tempest-ServersTestFqdnHostnames-1740621305-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:05.016010 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-db597c63-cf5b-4b4e-84c6-5bf775800cbf tempest-ServersTestFqdnHostnames-1740621305 tempest-ServersTestFqdnHostnames-1740621305-project] [instance: a50a2117-fefe-499b-a2d4-b57e264a5a51] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:52:05.043268 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-db597c63-cf5b-4b4e-84c6-5bf775800cbf tempest-ServersTestFqdnHostnames-1740621305 tempest-ServersTestFqdnHostnames-1740621305-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:05.044296 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-db597c63-cf5b-4b4e-84c6-5bf775800cbf tempest-ServersTestFqdnHostnames-1740621305 tempest-ServersTestFqdnHostnames-1740621305-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:05.045125 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-db597c63-cf5b-4b4e-84c6-5bf775800cbf tempest-ServersTestFqdnHostnames-1740621305 tempest-ServersTestFqdnHostnames-1740621305-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:05.046494 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-db597c63-cf5b-4b4e-84c6-5bf775800cbf tempest-ServersTestFqdnHostnames-1740621305 tempest-ServersTestFqdnHostnames-1740621305-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:05.047378 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-db597c63-cf5b-4b4e-84c6-5bf775800cbf tempest-ServersTestFqdnHostnames-1740621305 tempest-ServersTestFqdnHostnames-1740621305-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:05.048181 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-db597c63-cf5b-4b4e-84c6-5bf775800cbf tempest-ServersTestFqdnHostnames-1740621305 tempest-ServersTestFqdnHostnames-1740621305-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:05.467914 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-db597c63-cf5b-4b4e-84c6-5bf775800cbf tempest-ServersTestFqdnHostnames-1740621305 tempest-ServersTestFqdnHostnames-1740621305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ade6e5b885f4e7db1fef86de59a08de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dbdc46c0aa4d07a1eb5ade5b3a7212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:05.481464 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-db597c63-cf5b-4b4e-84c6-5bf775800cbf tempest-ServersTestFqdnHostnames-1740621305 tempest-ServersTestFqdnHostnames-1740621305-project] 10.222.0.43 "GET /compute/v2.1/servers/a50a2117-fefe-499b-a2d4-b57e264a5a51" status: 200 len: 1599 microversion: 2.1 time: 0.474002 Oct 04 21:52:05.484412 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1068/2071] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:52:04 2022] GET /compute/v2.1/servers/a50a2117-fefe-499b-a2d4-b57e264a5a51 => generated 1599 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:52:05.494199 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-0f404f36-3d7c-46de-adbf-4d8f8c7357ce tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:05.495132 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-0f404f36-3d7c-46de-adbf-4d8f8c7357ce tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] [instance: a600603a-de4c-4991-8827-9fec3dead821] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:52:05.502723 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0f404f36-3d7c-46de-adbf-4d8f8c7357ce tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:05.503530 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0f404f36-3d7c-46de-adbf-4d8f8c7357ce tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:05.504171 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0f404f36-3d7c-46de-adbf-4d8f8c7357ce tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:05.505097 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0f404f36-3d7c-46de-adbf-4d8f8c7357ce tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:05.505742 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0f404f36-3d7c-46de-adbf-4d8f8c7357ce tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:05.506438 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0f404f36-3d7c-46de-adbf-4d8f8c7357ce tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:05.508668 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.objects.instance [None req-35e5729e-465c-4d01-9ae0-2b353557ba19 tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Lazy-loading 'services' on Instance uuid b646f5b5-a266-44df-80e6-5d1b2a3b91d7 {{(pid=134101) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:52:05.575988 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-35e5729e-465c-4d01-9ae0-2b353557ba19 tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/b646f5b5-a266-44df-80e6-5d1b2a3b91d7" status: 200 len: 1970 microversion: 2.25 time: 0.767257 Oct 04 21:52:05.575988 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1004/2072] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:52:04 2022] GET /compute/v2.1/servers/b646f5b5-a266-44df-80e6-5d1b2a3b91d7 => generated 1970 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:52:05.620165 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-810a9c30-8c94-4bbf-8942-3f6e6c410f0b tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:05.624421 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-810a9c30-8c94-4bbf-8942-3f6e6c410f0b tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:05.626027 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-810a9c30-8c94-4bbf-8942-3f6e6c410f0b tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:05.627334 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-810a9c30-8c94-4bbf-8942-3f6e6c410f0b tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:05.628405 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-810a9c30-8c94-4bbf-8942-3f6e6c410f0b tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:05.629130 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-810a9c30-8c94-4bbf-8942-3f6e6c410f0b tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:05.629812 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-810a9c30-8c94-4bbf-8942-3f6e6c410f0b tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:05.672132 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-810a9c30-8c94-4bbf-8942-3f6e6c410f0b tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] 10.222.0.43 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.055511 Oct 04 21:52:05.682341 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1005/2073] 10.222.0.43 () {60 vars in 1217 bytes} [Tue Oct 4 21:52:05 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 21:52:05.691351 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-2a05bc6b-e39d-4c52-8d29-bda57592de38 tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-860284-1", "block_migration": "auto"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:52:05.695332 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-2a05bc6b-e39d-4c52-8d29-bda57592de38 tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] [instance: b646f5b5-a266-44df-80e6-5d1b2a3b91d7] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:52:05.709159 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2a05bc6b-e39d-4c52-8d29-bda57592de38 tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:05.711769 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2a05bc6b-e39d-4c52-8d29-bda57592de38 tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:05.712673 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2a05bc6b-e39d-4c52-8d29-bda57592de38 tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:05.713785 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2a05bc6b-e39d-4c52-8d29-bda57592de38 tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:05.714415 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2a05bc6b-e39d-4c52-8d29-bda57592de38 tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:05.715115 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2a05bc6b-e39d-4c52-8d29-bda57592de38 tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:05.828146 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.objects.instance [None req-2a05bc6b-e39d-4c52-8d29-bda57592de38 tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Lazy-loading 'flavor' on Instance uuid b646f5b5-a266-44df-80e6-5d1b2a3b91d7 {{(pid=134101) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:52:05.836360 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-2a05bc6b-e39d-4c52-8d29-bda57592de38 tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] [instance: b646f5b5-a266-44df-80e6-5d1b2a3b91d7] Going to try to live migrate instance to n-h2-860284-1 {{(pid=134101) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 04 21:52:05.943608 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-0f404f36-3d7c-46de-adbf-4d8f8c7357ce tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa551b85109f42b299665382695c6b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c6e52760ea4396a95a3ffb7db2a9a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:05.957297 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-0f404f36-3d7c-46de-adbf-4d8f8c7357ce tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] 10.222.0.43 "GET /compute/v2.1/servers/a600603a-de4c-4991-8827-9fec3dead821" status: 200 len: 1324 microversion: 2.1 time: 0.466508 Oct 04 21:52:05.958182 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1069/2074] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:52:05 2022] GET /compute/v2.1/servers/a600603a-de4c-4991-8827-9fec3dead821 => generated 1324 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:52:06.026520 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-a21da781-80d3-488b-92cc-910ca533760e tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Calling method '.version_select at 0x7fbb2fcf0700>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:06.131165 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-a21da781-80d3-488b-92cc-910ca533760e tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] 10.222.0.43 "GET /compute/v2.1/images/e62b2cc2-812b-4ec4-bba4-5703d4b65e48" status: 200 len: 1454 microversion: 2.1 time: 0.110568 Oct 04 21:52:06.144815 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1070/2075] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:52:06 2022] GET /compute/v2.1/images/e62b2cc2-812b-4ec4-bba4-5703d4b65e48 => generated 1454 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:52:06.515256 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-01477fff-e3e2-4100-b9f2-73f871054e13 tempest-ServersTestFqdnHostnames-1740621305 tempest-ServersTestFqdnHostnames-1740621305-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:06.515983 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-01477fff-e3e2-4100-b9f2-73f871054e13 tempest-ServersTestFqdnHostnames-1740621305 tempest-ServersTestFqdnHostnames-1740621305-project] [instance: a50a2117-fefe-499b-a2d4-b57e264a5a51] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:52:06.531402 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-01477fff-e3e2-4100-b9f2-73f871054e13 tempest-ServersTestFqdnHostnames-1740621305 tempest-ServersTestFqdnHostnames-1740621305-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:06.531915 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-01477fff-e3e2-4100-b9f2-73f871054e13 tempest-ServersTestFqdnHostnames-1740621305 tempest-ServersTestFqdnHostnames-1740621305-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:06.532424 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-01477fff-e3e2-4100-b9f2-73f871054e13 tempest-ServersTestFqdnHostnames-1740621305 tempest-ServersTestFqdnHostnames-1740621305-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:06.533129 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-01477fff-e3e2-4100-b9f2-73f871054e13 tempest-ServersTestFqdnHostnames-1740621305 tempest-ServersTestFqdnHostnames-1740621305-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:06.539996 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-01477fff-e3e2-4100-b9f2-73f871054e13 tempest-ServersTestFqdnHostnames-1740621305 tempest-ServersTestFqdnHostnames-1740621305-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:06.540802 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-01477fff-e3e2-4100-b9f2-73f871054e13 tempest-ServersTestFqdnHostnames-1740621305 tempest-ServersTestFqdnHostnames-1740621305-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:06.684367 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-01477fff-e3e2-4100-b9f2-73f871054e13 tempest-ServersTestFqdnHostnames-1740621305 tempest-ServersTestFqdnHostnames-1740621305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ade6e5b885f4e7db1fef86de59a08de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dbdc46c0aa4d07a1eb5ade5b3a7212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:06.694416 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-01477fff-e3e2-4100-b9f2-73f871054e13 tempest-ServersTestFqdnHostnames-1740621305 tempest-ServersTestFqdnHostnames-1740621305-project] 10.222.0.43 "GET /compute/v2.1/servers/a50a2117-fefe-499b-a2d4-b57e264a5a51" status: 200 len: 1599 microversion: 2.1 time: 0.186012 Oct 04 21:52:06.702523 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1071/2076] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:52:06 2022] GET /compute/v2.1/servers/a50a2117-fefe-499b-a2d4-b57e264a5a51 => generated 1599 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:52:06.982268 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-46271ee6-c4db-49ad-900a-adc42ec72c0a tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:06.983442 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-46271ee6-c4db-49ad-900a-adc42ec72c0a tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] [instance: a600603a-de4c-4991-8827-9fec3dead821] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:52:07.000122 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-46271ee6-c4db-49ad-900a-adc42ec72c0a tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:07.000924 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-46271ee6-c4db-49ad-900a-adc42ec72c0a tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:07.001607 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-46271ee6-c4db-49ad-900a-adc42ec72c0a tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:07.002658 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-46271ee6-c4db-49ad-900a-adc42ec72c0a tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:07.003343 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-46271ee6-c4db-49ad-900a-adc42ec72c0a tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:07.003963 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-46271ee6-c4db-49ad-900a-adc42ec72c0a tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:07.342567 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-46271ee6-c4db-49ad-900a-adc42ec72c0a tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa551b85109f42b299665382695c6b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c6e52760ea4396a95a3ffb7db2a9a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:07.354093 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-46271ee6-c4db-49ad-900a-adc42ec72c0a tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] 10.222.0.43 "GET /compute/v2.1/servers/a600603a-de4c-4991-8827-9fec3dead821" status: 200 len: 1324 microversion: 2.1 time: 0.376595 Oct 04 21:52:07.354759 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1072/2077] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:52:06 2022] GET /compute/v2.1/servers/a600603a-de4c-4991-8827-9fec3dead821 => generated 1324 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:52:07.374016 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-378fc3a7-b3de-4520-9501-36164b5593d1 req-8839b7d6-0c65-4856-abf6-44245e4179ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a50a2117-fefe-499b-a2d4-b57e264a5a51", "name": "network-vif-deleted", "tag": "be4ecfc6-29dd-49c4-9fc3-83e38314144a"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:52:07.397814 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-378fc3a7-b3de-4520-9501-36164b5593d1 req-8839b7d6-0c65-4856-abf6-44245e4179ef service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:07.403422 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-378fc3a7-b3de-4520-9501-36164b5593d1 req-8839b7d6-0c65-4856-abf6-44245e4179ef service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:07.404846 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-378fc3a7-b3de-4520-9501-36164b5593d1 req-8839b7d6-0c65-4856-abf6-44245e4179ef service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:07.436874 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-378fc3a7-b3de-4520-9501-36164b5593d1 req-8839b7d6-0c65-4856-abf6-44245e4179ef service nova] Creating event network-vif-deleted:be4ecfc6-29dd-49c4-9fc3-83e38314144a for instance a50a2117-fefe-499b-a2d4-b57e264a5a51 on n-h1-860284-1 Oct 04 21:52:07.447064 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-378fc3a7-b3de-4520-9501-36164b5593d1 req-8839b7d6-0c65-4856-abf6-44245e4179ef service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086679 Oct 04 21:52:07.452892 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1073/2078] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:52:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:52:07.467873 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-edd1233f-26eb-4e5d-8707-a6ded403332f tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Calling method '.version_select at 0x7fbb2ea031f0>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:07.597164 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-edd1233f-26eb-4e5d-8707-a6ded403332f tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] 10.222.0.43 "GET /compute/v2.1/images/e62b2cc2-812b-4ec4-bba4-5703d4b65e48" status: 200 len: 1454 microversion: 2.1 time: 0.142530 Oct 04 21:52:07.598227 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1074/2079] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:52:07 2022] GET /compute/v2.1/images/e62b2cc2-812b-4ec4-bba4-5703d4b65e48 => generated 1454 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:52:07.622114 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-b596d412-e9bc-4531-b4b4-181e8025d13e tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1238741243", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452", "networks": [{"uuid": "bf1f73ec-4710-4924-88d6-e14d942458bc"}], "security_groups": [{"name": "tempest-securitygroup--1772509516"}], "key_name": "tempest-keypair-1665435488", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:52:07.977519 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.network.neutron [None req-b596d412-e9bc-4531-b4b4-181e8025d13e tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] validate_networks() for [('bf1f73ec-4710-4924-88d6-e14d942458bc', None, None, None, None, None)] {{(pid=134102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:52:08.989112 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=6 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:52:09.571049 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-b596d412-e9bc-4531-b4b4-181e8025d13e tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Flavor limits 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:52:09.572380 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-b596d412-e9bc-4531-b4b4-181e8025d13e tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Image limits 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:52:09.573038 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-b596d412-e9bc-4531-b4b4-181e8025d13e tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Flavor pref 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:52:09.574278 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-b596d412-e9bc-4531-b4b4-181e8025d13e tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Image pref 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:52:09.576390 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-b596d412-e9bc-4531-b4b4-181e8025d13e tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:52:09.590641 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b596d412-e9bc-4531-b4b4-181e8025d13e tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:09.595255 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b596d412-e9bc-4531-b4b4-181e8025d13e tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:09.595974 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b596d412-e9bc-4531-b4b4-181e8025d13e tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:09.597844 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b596d412-e9bc-4531-b4b4-181e8025d13e tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:09.599953 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b596d412-e9bc-4531-b4b4-181e8025d13e tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:09.600610 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b596d412-e9bc-4531-b4b4-181e8025d13e tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:09.654836 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-b596d412-e9bc-4531-b4b4-181e8025d13e tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Getting quotas for project 1c4335ce6fd64a0397fbfb13e1b255ef. Resources: {'instances', 'ram', 'cores'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:52:09.673905 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-b596d412-e9bc-4531-b4b4-181e8025d13e tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Getting quotas for user 921f934be12045b3ac0b2c6ed5101bec and project 1c4335ce6fd64a0397fbfb13e1b255ef. Resources: {'instances', 'ram', 'cores'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:52:09.697066 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-b596d412-e9bc-4531-b4b4-181e8025d13e tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Going to run 1 instances... {{(pid=134102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:52:09.703037 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-b596d412-e9bc-4531-b4b4-181e8025d13e tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] [instance: 128b12e0-8fde-4113-95e9-0ecba563d8ec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='58548514-5dac-426c-81f5-19e3fba33e23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:52:09.796540 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-b596d412-e9bc-4531-b4b4-181e8025d13e tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.196123 Oct 04 21:52:09.797667 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1075/2080] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 21:52:07 2022] POST /compute/v2.1/servers => generated 406 bytes in 2199 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:52:09.809095 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-8545b802-ef19-4134-a1e7-d09d13eac48d tempest-ServersTestFqdnHostnames-1740621305 tempest-ServersTestFqdnHostnames-1740621305-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:09.816962 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-8545b802-ef19-4134-a1e7-d09d13eac48d tempest-ServersTestFqdnHostnames-1740621305 tempest-ServersTestFqdnHostnames-1740621305-project] [instance: a50a2117-fefe-499b-a2d4-b57e264a5a51] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:52:09.845494 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8545b802-ef19-4134-a1e7-d09d13eac48d tempest-ServersTestFqdnHostnames-1740621305 tempest-ServersTestFqdnHostnames-1740621305-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:09.846288 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8545b802-ef19-4134-a1e7-d09d13eac48d tempest-ServersTestFqdnHostnames-1740621305 tempest-ServersTestFqdnHostnames-1740621305-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:09.847585 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8545b802-ef19-4134-a1e7-d09d13eac48d tempest-ServersTestFqdnHostnames-1740621305 tempest-ServersTestFqdnHostnames-1740621305-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:09.848889 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8545b802-ef19-4134-a1e7-d09d13eac48d tempest-ServersTestFqdnHostnames-1740621305 tempest-ServersTestFqdnHostnames-1740621305-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:09.849590 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8545b802-ef19-4134-a1e7-d09d13eac48d tempest-ServersTestFqdnHostnames-1740621305 tempest-ServersTestFqdnHostnames-1740621305-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:09.850247 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8545b802-ef19-4134-a1e7-d09d13eac48d tempest-ServersTestFqdnHostnames-1740621305 tempest-ServersTestFqdnHostnames-1740621305-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:09.869145 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-8545b802-ef19-4134-a1e7-d09d13eac48d tempest-ServersTestFqdnHostnames-1740621305 tempest-ServersTestFqdnHostnames-1740621305-project] HTTP exception thrown: Instance a50a2117-fefe-499b-a2d4-b57e264a5a51 could not be found. Oct 04 21:52:09.881373 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-8545b802-ef19-4134-a1e7-d09d13eac48d tempest-ServersTestFqdnHostnames-1740621305 tempest-ServersTestFqdnHostnames-1740621305-project] Request method failure captured: Oct 04 21:52:09.881373 n-d-860284-1 devstack@n-api.service[134102]: request: GET /compute/v2.1/servers/a50a2117-fefe-499b-a2d4-b57e264a5a51 HTTP/1.1 Oct 04 21:52:09.881373 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 21:52:09.881373 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 21:52:09.881373 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 21:52:09.881373 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 21:52:09.881373 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 21:52:09.881373 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 21:52:09.881373 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 21:52:09.881373 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 21:52:09.881373 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPKqL4QhABPZJtKBrm2w9-zvCqEr5WPMxdNiSUBKh9WE9G1ZqiRBYJ30Q_mJVQk_-kZXXyDpJMBbZxUy2R1kdFmOzqzM0Dg5mZp-Cv97rDdXBCy3kS3NBsI5DVD5Zz_kXmkBRHsm0IhlCf_XjwQ7husNUAyGdksW0sbTM2EY5yJBJqfk Oct 04 21:52:09.881373 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 21:52:09.881373 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 21:52:09.881373 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 21:52:09.881373 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 21:52:09.881373 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 21:52:09.881373 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 21:52:09.881373 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: 60dbdc46c0aa4d07a1eb5ade5b3a7212 Oct 04 21:52:09.881373 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-ServersTestFqdnHostnames-1740621305 Oct 04 21:52:09.881373 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 21:52:09.881373 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 21:52:09.881373 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/60dbdc46c0aa4d07a1eb5ade5b3a7212"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_60dbdc46c0aa4d07a1eb5ade5b3a7212", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/60dbdc46c0aa4d07a1eb5ade5b3a7212"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/60dbdc46c0aa4d07a1eb5ade5b3a7212"}]}] Oct 04 21:52:09.881373 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-ServersTestFqdnHostnames-1740621305 Oct 04 21:52:09.881373 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: 60dbdc46c0aa4d07a1eb5ade5b3a7212 Oct 04 21:52:09.881373 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-1740621305 Oct 04 21:52:09.881373 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-ServersTestFqdnHostnames-1740621305-project Oct 04 21:52:09.881373 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 21:52:09.881373 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 21:52:09.881373 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: 5ade6e5b885f4e7db1fef86de59a08de Oct 04 21:52:09.881373 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-ServersTestFqdnHostnames-1740621305-project Oct 04 21:52:09.881373 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 21:52:09.881373 n-d-860284-1 devstack@n-api.service[134102]: exception: Instance a50a2117-fefe-499b-a2d4-b57e264a5a51 could not be found. Oct 04 21:52:09.881373 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': 'a50a2117-fefe-499b-a2d4-b57e264a5a51'} Oct 04 21:52:09.881373 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:52:09.881373 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:52:09.881373 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:52:09.881373 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:52:09.881373 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:52:09.881373 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:52:09.881373 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:52:09.881373 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:52:09.881373 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:52:09.881373 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:52:09.881373 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a50a2117-fefe-499b-a2d4-b57e264a5a51 could not be found. Oct 04 21:52:09.881373 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:52:09.881373 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:52:09.881373 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:52:09.881373 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:52:09.881373 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:52:09.881373 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:52:09.881373 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:52:09.881373 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:52:09.881373 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:52:09.881373 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:52:09.881373 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:52:09.881373 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:52:09.881373 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:52:09.881373 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:52:09.881373 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:52:09.881373 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:52:09.881373 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a50a2117-fefe-499b-a2d4-b57e264a5a51 could not be found. Oct 04 21:52:09.881373 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:52:09.881373 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:52:09.881373 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:52:09.889127 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:52:09.889127 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:52:09.889127 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:52:09.889127 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:52:09.889127 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:52:09.889127 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a50a2117-fefe-499b-a2d4-b57e264a5a51 could not be found. Oct 04 21:52:09.889127 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:52:09.891182 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-8545b802-ef19-4134-a1e7-d09d13eac48d tempest-ServersTestFqdnHostnames-1740621305 tempest-ServersTestFqdnHostnames-1740621305-project] Returning 404 to user: Instance a50a2117-fefe-499b-a2d4-b57e264a5a51 could not be found. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:52:09.892448 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-8545b802-ef19-4134-a1e7-d09d13eac48d tempest-ServersTestFqdnHostnames-1740621305 tempest-ServersTestFqdnHostnames-1740621305-project] 10.222.0.43 "GET /compute/v2.1/servers/a50a2117-fefe-499b-a2d4-b57e264a5a51" status: 404 len: 111 microversion: 2.1 time: 0.092403 Oct 04 21:52:09.893295 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1076/2081] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:52:09 2022] GET /compute/v2.1/servers/a50a2117-fefe-499b-a2d4-b57e264a5a51 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:52:09.903379 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-2a1f05c9-9cf9-44c9-a011-17f66733b529 tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:09.904986 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-2a1f05c9-9cf9-44c9-a011-17f66733b529 tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] [instance: a600603a-de4c-4991-8827-9fec3dead821] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:52:09.912016 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2a1f05c9-9cf9-44c9-a011-17f66733b529 tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:09.912803 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2a1f05c9-9cf9-44c9-a011-17f66733b529 tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:09.913496 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2a1f05c9-9cf9-44c9-a011-17f66733b529 tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:09.914543 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2a1f05c9-9cf9-44c9-a011-17f66733b529 tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:09.915258 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2a1f05c9-9cf9-44c9-a011-17f66733b529 tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:09.915924 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2a1f05c9-9cf9-44c9-a011-17f66733b529 tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:09.981350 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-2a05bc6b-e39d-4c52-8d29-bda57592de38 tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] 10.222.0.43 "POST /compute/v2.1/servers/b646f5b5-a266-44df-80e6-5d1b2a3b91d7/action" status: 202 len: 0 microversion: 2.25 time: 4.297330 Oct 04 21:52:09.982981 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1006/2082] 10.222.0.43 () {62 vars in 1319 bytes} [Tue Oct 4 21:52:05 2022] POST /compute/v2.1/servers/b646f5b5-a266-44df-80e6-5d1b2a3b91d7/action => generated 0 bytes in 4300 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:52:09.988330 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-ab02e325-3edb-4c32-8f56-c2f75d38e9b1 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Calling method '.version_select at 0x7fbb2e68e1f0>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:10.129666 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-ab02e325-3edb-4c32-8f56-c2f75d38e9b1 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] 10.222.0.43 "GET /compute/v2.1/images/e62b2cc2-812b-4ec4-bba4-5703d4b65e48" status: 200 len: 1454 microversion: 2.1 time: 0.145371 Oct 04 21:52:10.148733 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1007/2083] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:52:09 2022] GET /compute/v2.1/images/e62b2cc2-812b-4ec4-bba4-5703d4b65e48 => generated 1454 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:52:10.163476 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-48f8ccbe-9ec5-4ffb-8c22-4ca4082ac134 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:10.170997 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-48f8ccbe-9ec5-4ffb-8c22-4ca4082ac134 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] [instance: 128b12e0-8fde-4113-95e9-0ecba563d8ec] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:52:10.490463 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-2a1f05c9-9cf9-44c9-a011-17f66733b529 tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa551b85109f42b299665382695c6b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c6e52760ea4396a95a3ffb7db2a9a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:10.511449 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-48f8ccbe-9ec5-4ffb-8c22-4ca4082ac134 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921f934be12045b3ac0b2c6ed5101bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4335ce6fd64a0397fbfb13e1b255ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:10.524096 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-48f8ccbe-9ec5-4ffb-8c22-4ca4082ac134 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] 10.222.0.43 "GET /compute/v2.1/servers/128b12e0-8fde-4113-95e9-0ecba563d8ec" status: 200 len: 1242 microversion: 2.1 time: 0.374110 Oct 04 21:52:10.534009 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-2a1f05c9-9cf9-44c9-a011-17f66733b529 tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] 10.222.0.43 "GET /compute/v2.1/servers/a600603a-de4c-4991-8827-9fec3dead821" status: 200 len: 1324 microversion: 2.1 time: 0.635655 Oct 04 21:52:10.546764 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1008/2084] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:52:10 2022] GET /compute/v2.1/servers/128b12e0-8fde-4113-95e9-0ecba563d8ec => generated 1242 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:52:10.563103 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1077/2085] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:52:09 2022] GET /compute/v2.1/servers/a600603a-de4c-4991-8827-9fec3dead821 => generated 1324 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:52:10.565266 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-2cb5ff98-479f-4235-af8a-ca38081366c4 tempest-ServersTestFqdnHostnames-1740621305 tempest-ServersTestFqdnHostnames-1740621305-project] Calling method '.version_select at 0x7fbb2e6fe430>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:10.585033 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-5728f6aa-fb8e-4f41-9b38-6aeb14735ede tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:10.586347 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-5728f6aa-fb8e-4f41-9b38-6aeb14735ede tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] [instance: b646f5b5-a266-44df-80e6-5d1b2a3b91d7] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:52:10.657092 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-2cb5ff98-479f-4235-af8a-ca38081366c4 tempest-ServersTestFqdnHostnames-1740621305 tempest-ServersTestFqdnHostnames-1740621305-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1617412126" status: 202 len: 0 microversion: 2.1 time: 0.108742 Oct 04 21:52:10.658227 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1009/2086] 10.222.0.43 () {58 vars in 1221 bytes} [Tue Oct 4 21:52:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1617412126 => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:52:10.664058 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5728f6aa-fb8e-4f41-9b38-6aeb14735ede tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:10.667372 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5728f6aa-fb8e-4f41-9b38-6aeb14735ede tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:10.671293 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5728f6aa-fb8e-4f41-9b38-6aeb14735ede tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:10.673741 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5728f6aa-fb8e-4f41-9b38-6aeb14735ede tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:10.675150 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-7b2c2761-0aa0-4ccd-aa6e-f262df7b21f5 req-b896ce8e-c05c-4475-b471-5885cf3f32f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a600603a-de4c-4991-8827-9fec3dead821", "tag": "de912ec2-9e98-4a72-bf22-fce014c1fc6a"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:52:10.675407 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5728f6aa-fb8e-4f41-9b38-6aeb14735ede tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:10.676581 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5728f6aa-fb8e-4f41-9b38-6aeb14735ede tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:10.718786 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-7b2c2761-0aa0-4ccd-aa6e-f262df7b21f5 req-b896ce8e-c05c-4475-b471-5885cf3f32f5 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:10.721815 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-7b2c2761-0aa0-4ccd-aa6e-f262df7b21f5 req-b896ce8e-c05c-4475-b471-5885cf3f32f5 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:10.725207 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-7b2c2761-0aa0-4ccd-aa6e-f262df7b21f5 req-b896ce8e-c05c-4475-b471-5885cf3f32f5 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:10.772174 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-7b2c2761-0aa0-4ccd-aa6e-f262df7b21f5 req-b896ce8e-c05c-4475-b471-5885cf3f32f5 service nova] Creating event network-changed:de912ec2-9e98-4a72-bf22-fce014c1fc6a for instance a600603a-de4c-4991-8827-9fec3dead821 on n-h1-860284-1 Oct 04 21:52:10.799589 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-7b2c2761-0aa0-4ccd-aa6e-f262df7b21f5 req-b896ce8e-c05c-4475-b471-5885cf3f32f5 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.137687 Oct 04 21:52:10.800751 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1010/2087] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:52:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:52:11.151538 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-3fe3797a-7302-4165-99af-a113ed6160b2 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Calling method '.version_select at 0x7fbb2e69a3a0>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:11.385583 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-3fe3797a-7302-4165-99af-a113ed6160b2 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] 10.222.0.43 "GET /compute/v2.1/images/e62b2cc2-812b-4ec4-bba4-5703d4b65e48" status: 200 len: 1454 microversion: 2.1 time: 0.243982 Oct 04 21:52:11.398496 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1011/2088] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:52:11 2022] GET /compute/v2.1/images/e62b2cc2-812b-4ec4-bba4-5703d4b65e48 => generated 1454 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:52:11.555820 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-7fb0639c-5eee-4b80-8664-103cceba4238 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:11.556567 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-7fb0639c-5eee-4b80-8664-103cceba4238 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] [instance: 128b12e0-8fde-4113-95e9-0ecba563d8ec] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:52:11.581412 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7fb0639c-5eee-4b80-8664-103cceba4238 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:11.585744 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7fb0639c-5eee-4b80-8664-103cceba4238 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:11.586601 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7fb0639c-5eee-4b80-8664-103cceba4238 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:11.589274 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7fb0639c-5eee-4b80-8664-103cceba4238 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:11.595944 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7fb0639c-5eee-4b80-8664-103cceba4238 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:11.598406 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7fb0639c-5eee-4b80-8664-103cceba4238 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:11.868180 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-5728f6aa-fb8e-4f41-9b38-6aeb14735ede tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:11.883945 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-7fb0639c-5eee-4b80-8664-103cceba4238 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921f934be12045b3ac0b2c6ed5101bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4335ce6fd64a0397fbfb13e1b255ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:11.886716 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-5728f6aa-fb8e-4f41-9b38-6aeb14735ede tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:11.888281 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-5728f6aa-fb8e-4f41-9b38-6aeb14735ede tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:11.889530 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-5728f6aa-fb8e-4f41-9b38-6aeb14735ede tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] 10.222.0.43 "GET /compute/v2.1/servers/b646f5b5-a266-44df-80e6-5d1b2a3b91d7" status: 200 len: 1487 microversion: 2.25 time: 1.325145 Oct 04 21:52:11.890141 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1078/2089] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:52:10 2022] GET /compute/v2.1/servers/b646f5b5-a266-44df-80e6-5d1b2a3b91d7 => generated 1487 bytes in 1327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:52:11.904956 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-7fb0639c-5eee-4b80-8664-103cceba4238 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] 10.222.0.43 "GET /compute/v2.1/servers/128b12e0-8fde-4113-95e9-0ecba563d8ec" status: 200 len: 1246 microversion: 2.1 time: 0.349630 Oct 04 21:52:11.916667 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-a790a010-a49c-4b48-bb03-b1a2550318a2 tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:11.918129 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-a790a010-a49c-4b48-bb03-b1a2550318a2 tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] [instance: a600603a-de4c-4991-8827-9fec3dead821] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:52:11.921169 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1012/2090] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:52:11 2022] GET /compute/v2.1/servers/128b12e0-8fde-4113-95e9-0ecba563d8ec => generated 1246 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:52:11.932829 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a790a010-a49c-4b48-bb03-b1a2550318a2 tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:11.937057 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a790a010-a49c-4b48-bb03-b1a2550318a2 tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:11.940694 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a790a010-a49c-4b48-bb03-b1a2550318a2 tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:11.942521 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a790a010-a49c-4b48-bb03-b1a2550318a2 tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:11.946507 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a790a010-a49c-4b48-bb03-b1a2550318a2 tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:11.947789 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a790a010-a49c-4b48-bb03-b1a2550318a2 tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:12.405768 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-12f80224-17ee-46f2-b8f6-d6252a3ca17d tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Calling method '.version_select at 0x7fbb3727aaf0>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:12.559485 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-12f80224-17ee-46f2-b8f6-d6252a3ca17d tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] 10.222.0.43 "GET /compute/v2.1/images/e62b2cc2-812b-4ec4-bba4-5703d4b65e48" status: 200 len: 1454 microversion: 2.1 time: 0.156284 Oct 04 21:52:12.574307 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1013/2091] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:52:12 2022] GET /compute/v2.1/images/e62b2cc2-812b-4ec4-bba4-5703d4b65e48 => generated 1454 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:52:12.920843 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-6048d1fd-b958-4751-b78a-2ae62f963a48 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:12.922650 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-6048d1fd-b958-4751-b78a-2ae62f963a48 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] [instance: b646f5b5-a266-44df-80e6-5d1b2a3b91d7] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:52:12.932538 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6048d1fd-b958-4751-b78a-2ae62f963a48 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:12.933443 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6048d1fd-b958-4751-b78a-2ae62f963a48 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:12.934123 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6048d1fd-b958-4751-b78a-2ae62f963a48 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:12.935352 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6048d1fd-b958-4751-b78a-2ae62f963a48 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:12.936104 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6048d1fd-b958-4751-b78a-2ae62f963a48 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:12.936900 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6048d1fd-b958-4751-b78a-2ae62f963a48 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:13.317078 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-a790a010-a49c-4b48-bb03-b1a2550318a2 tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa551b85109f42b299665382695c6b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c6e52760ea4396a95a3ffb7db2a9a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:13.379427 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-a790a010-a49c-4b48-bb03-b1a2550318a2 tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] 10.222.0.43 "GET /compute/v2.1/servers/a600603a-de4c-4991-8827-9fec3dead821" status: 200 len: 1324 microversion: 2.1 time: 1.474077 Oct 04 21:52:13.405956 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1079/2092] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:52:11 2022] GET /compute/v2.1/servers/a600603a-de4c-4991-8827-9fec3dead821 => generated 1324 bytes in 1515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:52:13.468657 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-77f02ebd-5686-4ad0-b133-c461f4192a68 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:13.482682 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-77f02ebd-5686-4ad0-b133-c461f4192a68 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] [instance: 128b12e0-8fde-4113-95e9-0ecba563d8ec] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:52:13.565500 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-77f02ebd-5686-4ad0-b133-c461f4192a68 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:13.566945 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-77f02ebd-5686-4ad0-b133-c461f4192a68 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:13.568179 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-77f02ebd-5686-4ad0-b133-c461f4192a68 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:13.569791 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-77f02ebd-5686-4ad0-b133-c461f4192a68 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:13.572984 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-77f02ebd-5686-4ad0-b133-c461f4192a68 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:13.574858 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-77f02ebd-5686-4ad0-b133-c461f4192a68 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:13.648372 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-6048d1fd-b958-4751-b78a-2ae62f963a48 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:13.713838 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-6048d1fd-b958-4751-b78a-2ae62f963a48 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:13.727940 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-6048d1fd-b958-4751-b78a-2ae62f963a48 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:13.735596 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-6048d1fd-b958-4751-b78a-2ae62f963a48 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] 10.222.0.43 "GET /compute/v2.1/servers/b646f5b5-a266-44df-80e6-5d1b2a3b91d7" status: 200 len: 1487 microversion: 2.25 time: 0.821031 Oct 04 21:52:13.763502 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1014/2093] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:52:12 2022] GET /compute/v2.1/servers/b646f5b5-a266-44df-80e6-5d1b2a3b91d7 => generated 1487 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:52:13.803718 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-7a0c3129-5b9b-44db-a773-3e5c9eae7d56 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Calling method '.version_select at 0x7fbb2e6c00d0>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:13.950504 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-7a0c3129-5b9b-44db-a773-3e5c9eae7d56 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] 10.222.0.43 "GET /compute/v2.1/images/e62b2cc2-812b-4ec4-bba4-5703d4b65e48" status: 200 len: 1454 microversion: 2.1 time: 0.179158 Oct 04 21:52:13.951505 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1015/2094] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:52:13 2022] GET /compute/v2.1/images/e62b2cc2-812b-4ec4-bba4-5703d4b65e48 => generated 1454 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:52:14.432180 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-28697f93-312c-4110-8963-07a94046d806 tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:14.437969 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-28697f93-312c-4110-8963-07a94046d806 tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] [instance: a600603a-de4c-4991-8827-9fec3dead821] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:52:14.498685 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-28697f93-312c-4110-8963-07a94046d806 tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:14.499554 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-28697f93-312c-4110-8963-07a94046d806 tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.033s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:14.500540 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-28697f93-312c-4110-8963-07a94046d806 tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:14.509609 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-28697f93-312c-4110-8963-07a94046d806 tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:14.518321 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-28697f93-312c-4110-8963-07a94046d806 tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:14.519146 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-28697f93-312c-4110-8963-07a94046d806 tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:14.746355 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-77f02ebd-5686-4ad0-b133-c461f4192a68 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921f934be12045b3ac0b2c6ed5101bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4335ce6fd64a0397fbfb13e1b255ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:14.761509 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-77f02ebd-5686-4ad0-b133-c461f4192a68 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] 10.222.0.43 "GET /compute/v2.1/servers/128b12e0-8fde-4113-95e9-0ecba563d8ec" status: 200 len: 1294 microversion: 2.1 time: 1.353340 Oct 04 21:52:14.764954 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1080/2095] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:52:13 2022] GET /compute/v2.1/servers/128b12e0-8fde-4113-95e9-0ecba563d8ec => generated 1294 bytes in 1358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:52:14.804414 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-be9783cb-6846-4aae-9fc4-21d0dc1f04ce tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:14.804750 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-be9783cb-6846-4aae-9fc4-21d0dc1f04ce tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] [instance: b646f5b5-a266-44df-80e6-5d1b2a3b91d7] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:52:14.816085 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-be9783cb-6846-4aae-9fc4-21d0dc1f04ce tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:14.820121 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-be9783cb-6846-4aae-9fc4-21d0dc1f04ce tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:14.823931 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-be9783cb-6846-4aae-9fc4-21d0dc1f04ce tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:14.826592 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-be9783cb-6846-4aae-9fc4-21d0dc1f04ce tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:14.828466 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-be9783cb-6846-4aae-9fc4-21d0dc1f04ce tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:14.830993 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-be9783cb-6846-4aae-9fc4-21d0dc1f04ce tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:14.913078 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:52:15.474616 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-28697f93-312c-4110-8963-07a94046d806 tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa551b85109f42b299665382695c6b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c6e52760ea4396a95a3ffb7db2a9a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:15.486095 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-28697f93-312c-4110-8963-07a94046d806 tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] 10.222.0.43 "GET /compute/v2.1/servers/a600603a-de4c-4991-8827-9fec3dead821" status: 200 len: 1324 microversion: 2.1 time: 1.066930 Oct 04 21:52:15.489709 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1016/2096] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:52:14 2022] GET /compute/v2.1/servers/a600603a-de4c-4991-8827-9fec3dead821 => generated 1324 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:52:15.501953 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-dc7f26d7-ccd9-4a89-a404-87c678d7b7e8 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Calling method '.version_select at 0x7fbb2e6cb820>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:15.568074 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-be9783cb-6846-4aae-9fc4-21d0dc1f04ce tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:15.581883 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-dc7f26d7-ccd9-4a89-a404-87c678d7b7e8 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] 10.222.0.43 "GET /compute/v2.1/images/e62b2cc2-812b-4ec4-bba4-5703d4b65e48" status: 200 len: 1454 microversion: 2.1 time: 0.090031 Oct 04 21:52:15.582827 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1017/2097] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:52:15 2022] GET /compute/v2.1/images/e62b2cc2-812b-4ec4-bba4-5703d4b65e48 => generated 1454 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:52:15.600724 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-be9783cb-6846-4aae-9fc4-21d0dc1f04ce tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:15.612051 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-be9783cb-6846-4aae-9fc4-21d0dc1f04ce tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:15.618019 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-be9783cb-6846-4aae-9fc4-21d0dc1f04ce tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] 10.222.0.43 "GET /compute/v2.1/servers/b646f5b5-a266-44df-80e6-5d1b2a3b91d7" status: 200 len: 1487 microversion: 2.25 time: 0.818612 Oct 04 21:52:15.642480 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1081/2098] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:52:14 2022] GET /compute/v2.1/servers/b646f5b5-a266-44df-80e6-5d1b2a3b91d7 => generated 1487 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:52:15.792341 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-dc77521c-35d6-4701-a977-787799df7c74 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:15.793279 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-dc77521c-35d6-4701-a977-787799df7c74 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] [instance: 128b12e0-8fde-4113-95e9-0ecba563d8ec] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:52:15.796897 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=4 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:52:15.817732 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dc77521c-35d6-4701-a977-787799df7c74 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:15.818692 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dc77521c-35d6-4701-a977-787799df7c74 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:15.819355 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dc77521c-35d6-4701-a977-787799df7c74 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:15.820327 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dc77521c-35d6-4701-a977-787799df7c74 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:15.821100 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dc77521c-35d6-4701-a977-787799df7c74 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:15.822139 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dc77521c-35d6-4701-a977-787799df7c74 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:16.035964 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-1b9f21b3-ac27-4249-8bd7-f81e3ee0f80e tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-594688649", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "7c037080-0b8b-4757-a710-31df9b3a21f4"}], "block_device_mapping_v2": [{"uuid": "ccd6e61b-41d9-4ef1-9275-0779d27e4ba0", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:52:16.053378 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-dc77521c-35d6-4701-a977-787799df7c74 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921f934be12045b3ac0b2c6ed5101bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4335ce6fd64a0397fbfb13e1b255ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:16.077313 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-dc77521c-35d6-4701-a977-787799df7c74 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] 10.222.0.43 "GET /compute/v2.1/servers/128b12e0-8fde-4113-95e9-0ecba563d8ec" status: 200 len: 1300 microversion: 2.1 time: 0.288923 Oct 04 21:52:16.085088 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1018/2099] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:52:15 2022] GET /compute/v2.1/servers/128b12e0-8fde-4113-95e9-0ecba563d8ec => generated 1300 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:52:16.152718 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.network.neutron [None req-1b9f21b3-ac27-4249-8bd7-f81e3ee0f80e tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] validate_networks() for [('7c037080-0b8b-4757-a710-31df9b3a21f4', None, None, None, None, None)] {{(pid=134102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:52:16.517640 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-1350ab6f-02f1-438a-a274-b95ca0ac79b5 tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:16.518967 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-1350ab6f-02f1-438a-a274-b95ca0ac79b5 tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] [instance: a600603a-de4c-4991-8827-9fec3dead821] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:52:16.529384 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1350ab6f-02f1-438a-a274-b95ca0ac79b5 tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:16.533289 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1350ab6f-02f1-438a-a274-b95ca0ac79b5 tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:16.533950 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1350ab6f-02f1-438a-a274-b95ca0ac79b5 tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:16.535413 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1350ab6f-02f1-438a-a274-b95ca0ac79b5 tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:16.537668 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1350ab6f-02f1-438a-a274-b95ca0ac79b5 tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:16.538324 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1350ab6f-02f1-438a-a274-b95ca0ac79b5 tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:16.551921 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:52:17.444654 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-1350ab6f-02f1-438a-a274-b95ca0ac79b5 tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa551b85109f42b299665382695c6b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c6e52760ea4396a95a3ffb7db2a9a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:17.462249 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-1350ab6f-02f1-438a-a274-b95ca0ac79b5 tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] 10.222.0.43 "GET /compute/v2.1/servers/a600603a-de4c-4991-8827-9fec3dead821" status: 200 len: 1324 microversion: 2.1 time: 0.950471 Oct 04 21:52:17.483065 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1019/2100] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:52:16 2022] GET /compute/v2.1/servers/a600603a-de4c-4991-8827-9fec3dead821 => generated 1324 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:52:17.492354 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-fabffc99-b82f-4b8b-b859-f6a527a2fd8a tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Calling method '.version_select at 0x7fbb2e6a1550>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:17.604647 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-fabffc99-b82f-4b8b-b859-f6a527a2fd8a tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] 10.222.0.43 "GET /compute/v2.1/images/e62b2cc2-812b-4ec4-bba4-5703d4b65e48" status: 200 len: 1454 microversion: 2.1 time: 0.130324 Oct 04 21:52:17.607980 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1020/2101] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:52:17 2022] GET /compute/v2.1/images/e62b2cc2-812b-4ec4-bba4-5703d4b65e48 => generated 1454 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:52:17.622285 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-4a5519c0-feb6-47b7-8c81-9c109a4ba58a tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:17.624199 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-4a5519c0-feb6-47b7-8c81-9c109a4ba58a tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] [instance: b646f5b5-a266-44df-80e6-5d1b2a3b91d7] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:52:17.649328 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4a5519c0-feb6-47b7-8c81-9c109a4ba58a tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:17.649842 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4a5519c0-feb6-47b7-8c81-9c109a4ba58a tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:17.650290 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4a5519c0-feb6-47b7-8c81-9c109a4ba58a tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:17.651065 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4a5519c0-feb6-47b7-8c81-9c109a4ba58a tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:17.659196 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4a5519c0-feb6-47b7-8c81-9c109a4ba58a tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:17.662117 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4a5519c0-feb6-47b7-8c81-9c109a4ba58a tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:19.009348 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-4a5519c0-feb6-47b7-8c81-9c109a4ba58a tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:19.040356 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-4a5519c0-feb6-47b7-8c81-9c109a4ba58a tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:19.045189 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-4a5519c0-feb6-47b7-8c81-9c109a4ba58a tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:19.046595 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-4a5519c0-feb6-47b7-8c81-9c109a4ba58a tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] 10.222.0.43 "GET /compute/v2.1/servers/b646f5b5-a266-44df-80e6-5d1b2a3b91d7" status: 200 len: 1487 microversion: 2.25 time: 1.437467 Oct 04 21:52:19.047184 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1021/2102] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:52:17 2022] GET /compute/v2.1/servers/b646f5b5-a266-44df-80e6-5d1b2a3b91d7 => generated 1487 bytes in 1439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:52:19.058473 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-a1c95cff-f399-418e-a226-35b38e71e836 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:19.061027 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-a1c95cff-f399-418e-a226-35b38e71e836 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] [instance: 128b12e0-8fde-4113-95e9-0ecba563d8ec] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:52:19.077543 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a1c95cff-f399-418e-a226-35b38e71e836 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:19.078044 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a1c95cff-f399-418e-a226-35b38e71e836 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:19.078562 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a1c95cff-f399-418e-a226-35b38e71e836 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:19.079303 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a1c95cff-f399-418e-a226-35b38e71e836 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:19.080006 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a1c95cff-f399-418e-a226-35b38e71e836 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:19.080670 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a1c95cff-f399-418e-a226-35b38e71e836 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:19.365016 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-1b9f21b3-ac27-4249-8bd7-f81e3ee0f80e tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Flavor limits 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:52:19.365530 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-1b9f21b3-ac27-4249-8bd7-f81e3ee0f80e tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Image limits 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:52:19.365917 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-1b9f21b3-ac27-4249-8bd7-f81e3ee0f80e tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Flavor pref 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:52:19.366592 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-1b9f21b3-ac27-4249-8bd7-f81e3ee0f80e tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Image pref 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:52:19.367201 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-1b9f21b3-ac27-4249-8bd7-f81e3ee0f80e tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:52:19.401934 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1b9f21b3-ac27-4249-8bd7-f81e3ee0f80e tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:19.404519 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1b9f21b3-ac27-4249-8bd7-f81e3ee0f80e tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:19.405198 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1b9f21b3-ac27-4249-8bd7-f81e3ee0f80e tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:19.410895 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1b9f21b3-ac27-4249-8bd7-f81e3ee0f80e tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:19.411685 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1b9f21b3-ac27-4249-8bd7-f81e3ee0f80e tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:19.412294 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1b9f21b3-ac27-4249-8bd7-f81e3ee0f80e tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:19.490046 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-1b9f21b3-ac27-4249-8bd7-f81e3ee0f80e tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Getting quotas for project 78dcfc7024fc49388c4bd5f25f03e60d. Resources: {'instances', 'ram', 'cores'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:52:19.501006 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-1b9f21b3-ac27-4249-8bd7-f81e3ee0f80e tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Getting quotas for user bb7ad048becf474fb972d4291422d810 and project 78dcfc7024fc49388c4bd5f25f03e60d. Resources: {'instances', 'ram', 'cores'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:52:19.668665 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-a1c95cff-f399-418e-a226-35b38e71e836 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921f934be12045b3ac0b2c6ed5101bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4335ce6fd64a0397fbfb13e1b255ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:19.685569 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-a1c95cff-f399-418e-a226-35b38e71e836 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] 10.222.0.43 "GET /compute/v2.1/servers/128b12e0-8fde-4113-95e9-0ecba563d8ec" status: 200 len: 1368 microversion: 2.1 time: 0.633855 Oct 04 21:52:19.702446 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1022/2103] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:52:19 2022] GET /compute/v2.1/servers/128b12e0-8fde-4113-95e9-0ecba563d8ec => generated 1368 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:52:19.705008 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-764a69ba-1efc-47ec-a435-c71e09856b45 req-c08f3992-22e5-41b0-aaae-41a84a5007b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a600603a-de4c-4991-8827-9fec3dead821", "name": "network-vif-plugged", "status": "completed", "tag": "de912ec2-9e98-4a72-bf22-fce014c1fc6a"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:52:19.733974 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-764a69ba-1efc-47ec-a435-c71e09856b45 req-c08f3992-22e5-41b0-aaae-41a84a5007b0 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:19.738866 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-764a69ba-1efc-47ec-a435-c71e09856b45 req-c08f3992-22e5-41b0-aaae-41a84a5007b0 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:19.739537 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-764a69ba-1efc-47ec-a435-c71e09856b45 req-c08f3992-22e5-41b0-aaae-41a84a5007b0 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:19.761437 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-764a69ba-1efc-47ec-a435-c71e09856b45 req-c08f3992-22e5-41b0-aaae-41a84a5007b0 service nova] Creating event network-vif-plugged:de912ec2-9e98-4a72-bf22-fce014c1fc6a for instance a600603a-de4c-4991-8827-9fec3dead821 on n-h1-860284-1 Oct 04 21:52:19.769976 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-764a69ba-1efc-47ec-a435-c71e09856b45 req-c08f3992-22e5-41b0-aaae-41a84a5007b0 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077692 Oct 04 21:52:19.771345 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1023/2104] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:52:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:52:19.780288 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-a19c397d-8248-4f65-b656-80d7caa840d6 tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:19.796873 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-a19c397d-8248-4f65-b656-80d7caa840d6 tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] [instance: a600603a-de4c-4991-8827-9fec3dead821] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:52:19.829681 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a19c397d-8248-4f65-b656-80d7caa840d6 tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:19.829995 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a19c397d-8248-4f65-b656-80d7caa840d6 tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:19.833063 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a19c397d-8248-4f65-b656-80d7caa840d6 tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:19.836805 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a19c397d-8248-4f65-b656-80d7caa840d6 tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:19.837115 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a19c397d-8248-4f65-b656-80d7caa840d6 tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:19.838928 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a19c397d-8248-4f65-b656-80d7caa840d6 tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:20.155099 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-1b9f21b3-ac27-4249-8bd7-f81e3ee0f80e tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Going to run 1 instances... {{(pid=134102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:52:20.157592 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-1b9f21b3-ac27-4249-8bd7-f81e3ee0f80e tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 152003e4-2a7b-4801-8656-73093cd566ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ccd6e61b-41d9-4ef1-9275-0779d27e4ba0',volume_size=None,volume_type=None)] {{(pid=134102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:52:20.322881 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-a19c397d-8248-4f65-b656-80d7caa840d6 tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa551b85109f42b299665382695c6b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c6e52760ea4396a95a3ffb7db2a9a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:20.334507 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-a19c397d-8248-4f65-b656-80d7caa840d6 tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] 10.222.0.43 "GET /compute/v2.1/servers/a600603a-de4c-4991-8827-9fec3dead821" status: 200 len: 1324 microversion: 2.1 time: 0.561445 Oct 04 21:52:20.335550 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1024/2105] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:52:19 2022] GET /compute/v2.1/servers/a600603a-de4c-4991-8827-9fec3dead821 => generated 1324 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:52:20.344268 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-ab78e195-16f3-4cf0-889e-db5f7e5b47e8 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Calling method '.version_select at 0x7fbb2e6cbb80>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:20.519292 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=2 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:52:20.585513 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-ab78e195-16f3-4cf0-889e-db5f7e5b47e8 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] 10.222.0.43 "GET /compute/v2.1/images/e62b2cc2-812b-4ec4-bba4-5703d4b65e48" status: 200 len: 1454 microversion: 2.1 time: 0.246198 Oct 04 21:52:20.597014 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1025/2106] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:52:20 2022] GET /compute/v2.1/images/e62b2cc2-812b-4ec4-bba4-5703d4b65e48 => generated 1454 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:52:20.618623 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-a8ed67c6-6d96-4ba7-8035-bd038a516213 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:20.619440 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-a8ed67c6-6d96-4ba7-8035-bd038a516213 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] [instance: b646f5b5-a266-44df-80e6-5d1b2a3b91d7] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:52:20.628900 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a8ed67c6-6d96-4ba7-8035-bd038a516213 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:20.629273 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a8ed67c6-6d96-4ba7-8035-bd038a516213 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:20.629776 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a8ed67c6-6d96-4ba7-8035-bd038a516213 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:20.631148 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a8ed67c6-6d96-4ba7-8035-bd038a516213 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:20.631625 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a8ed67c6-6d96-4ba7-8035-bd038a516213 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:20.632065 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a8ed67c6-6d96-4ba7-8035-bd038a516213 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:20.870669 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-1b9f21b3-ac27-4249-8bd7-f81e3ee0f80e tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.840040 Oct 04 21:52:20.886040 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1082/2107] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 21:52:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 4856 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:52:20.892107 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-db536ee7-cd0c-4fc8-af70-a03f5ddc6f99 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:20.912846 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-db536ee7-cd0c-4fc8-af70-a03f5ddc6f99 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] [instance: 128b12e0-8fde-4113-95e9-0ecba563d8ec] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:52:20.961486 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-db536ee7-cd0c-4fc8-af70-a03f5ddc6f99 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:20.980228 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-db536ee7-cd0c-4fc8-af70-a03f5ddc6f99 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:20.980928 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-db536ee7-cd0c-4fc8-af70-a03f5ddc6f99 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:20.985186 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-db536ee7-cd0c-4fc8-af70-a03f5ddc6f99 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:20.991066 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-db536ee7-cd0c-4fc8-af70-a03f5ddc6f99 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:20.995887 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-db536ee7-cd0c-4fc8-af70-a03f5ddc6f99 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:21.304957 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-a8ed67c6-6d96-4ba7-8035-bd038a516213 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:21.333405 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-a8ed67c6-6d96-4ba7-8035-bd038a516213 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:21.341957 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-a8ed67c6-6d96-4ba7-8035-bd038a516213 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:21.343238 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-a8ed67c6-6d96-4ba7-8035-bd038a516213 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] 10.222.0.43 "GET /compute/v2.1/servers/b646f5b5-a266-44df-80e6-5d1b2a3b91d7" status: 200 len: 1487 microversion: 2.25 time: 0.756037 Oct 04 21:52:21.343931 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1026/2108] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:52:20 2022] GET /compute/v2.1/servers/b646f5b5-a266-44df-80e6-5d1b2a3b91d7 => generated 1487 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:52:21.361420 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-ed19de7d-def7-4671-bbe1-77e08d3dcf6d tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:21.369916 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-ed19de7d-def7-4671-bbe1-77e08d3dcf6d tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 152003e4-2a7b-4801-8656-73093cd566ed] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:52:21.394253 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:52:21.803870 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-ed19de7d-def7-4671-bbe1-77e08d3dcf6d tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ad048becf474fb972d4291422d810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dcfc7024fc49388c4bd5f25f03e60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:21.832568 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-ed19de7d-def7-4671-bbe1-77e08d3dcf6d tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/152003e4-2a7b-4801-8656-73093cd566ed" status: 200 len: 1052 microversion: 2.1 time: 0.475032 Oct 04 21:52:21.836126 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1027/2109] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:52:21 2022] GET /compute/v2.1/servers/152003e4-2a7b-4801-8656-73093cd566ed => generated 1052 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:52:21.861099 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-bc6288e1-feeb-48d1-90e0-123e929aaa3a tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:21.862401 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-bc6288e1-feeb-48d1-90e0-123e929aaa3a tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] [instance: a600603a-de4c-4991-8827-9fec3dead821] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:52:21.913285 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bc6288e1-feeb-48d1-90e0-123e929aaa3a tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:21.913761 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bc6288e1-feeb-48d1-90e0-123e929aaa3a tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:21.917444 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bc6288e1-feeb-48d1-90e0-123e929aaa3a tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:21.918221 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bc6288e1-feeb-48d1-90e0-123e929aaa3a tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:21.925419 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bc6288e1-feeb-48d1-90e0-123e929aaa3a tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:21.925917 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bc6288e1-feeb-48d1-90e0-123e929aaa3a tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:22.153870 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-db536ee7-cd0c-4fc8-af70-a03f5ddc6f99 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921f934be12045b3ac0b2c6ed5101bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4335ce6fd64a0397fbfb13e1b255ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:22.171297 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-db536ee7-cd0c-4fc8-af70-a03f5ddc6f99 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] 10.222.0.43 "GET /compute/v2.1/servers/128b12e0-8fde-4113-95e9-0ecba563d8ec" status: 200 len: 1368 microversion: 2.1 time: 1.283421 Oct 04 21:52:22.172315 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1083/2110] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:52:20 2022] GET /compute/v2.1/servers/128b12e0-8fde-4113-95e9-0ecba563d8ec => generated 1368 bytes in 1285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:52:22.192738 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-93928306-6cc0-4f19-b3f5-c5f0b4e3f938 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Calling method '.version_select at 0x7fbb2e93d1f0>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:22.282347 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-93928306-6cc0-4f19-b3f5-c5f0b4e3f938 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] 10.222.0.43 "GET /compute/v2.1/images/e62b2cc2-812b-4ec4-bba4-5703d4b65e48" status: 200 len: 1454 microversion: 2.1 time: 0.106847 Oct 04 21:52:22.284041 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1084/2111] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:52:22 2022] GET /compute/v2.1/images/e62b2cc2-812b-4ec4-bba4-5703d4b65e48 => generated 1454 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:52:22.297117 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-b3399d1b-6b8e-402c-a7d3-1d00823c4e34 req-3077b7f3-6f9a-4df1-bdae-6710bf8a5eb8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "128b12e0-8fde-4113-95e9-0ecba563d8ec", "tag": "df2ad55d-ccdf-4548-8a65-744068b2ae9a"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:52:22.326765 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-b3399d1b-6b8e-402c-a7d3-1d00823c4e34 req-3077b7f3-6f9a-4df1-bdae-6710bf8a5eb8 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:22.327674 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-b3399d1b-6b8e-402c-a7d3-1d00823c4e34 req-3077b7f3-6f9a-4df1-bdae-6710bf8a5eb8 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:22.328430 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-b3399d1b-6b8e-402c-a7d3-1d00823c4e34 req-3077b7f3-6f9a-4df1-bdae-6710bf8a5eb8 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:22.352866 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-b3399d1b-6b8e-402c-a7d3-1d00823c4e34 req-3077b7f3-6f9a-4df1-bdae-6710bf8a5eb8 service nova] Creating event network-changed:df2ad55d-ccdf-4548-8a65-744068b2ae9a for instance 128b12e0-8fde-4113-95e9-0ecba563d8ec on n-h2-860284-1 Oct 04 21:52:22.375948 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-b3399d1b-6b8e-402c-a7d3-1d00823c4e34 req-3077b7f3-6f9a-4df1-bdae-6710bf8a5eb8 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089114 Oct 04 21:52:22.378304 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1085/2112] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:52:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:52:22.394857 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-ccdd4d4c-ae7c-4562-acf2-381ed0312f98 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:22.395886 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-ccdd4d4c-ae7c-4562-acf2-381ed0312f98 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] [instance: b646f5b5-a266-44df-80e6-5d1b2a3b91d7] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:52:22.407377 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ccdd4d4c-ae7c-4562-acf2-381ed0312f98 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:22.408064 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ccdd4d4c-ae7c-4562-acf2-381ed0312f98 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:22.410164 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ccdd4d4c-ae7c-4562-acf2-381ed0312f98 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:22.411790 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ccdd4d4c-ae7c-4562-acf2-381ed0312f98 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:22.413500 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ccdd4d4c-ae7c-4562-acf2-381ed0312f98 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:22.414108 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ccdd4d4c-ae7c-4562-acf2-381ed0312f98 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:22.706229 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-bc6288e1-feeb-48d1-90e0-123e929aaa3a tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa551b85109f42b299665382695c6b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c6e52760ea4396a95a3ffb7db2a9a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:22.724244 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-bc6288e1-feeb-48d1-90e0-123e929aaa3a tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] 10.222.0.43 "GET /compute/v2.1/servers/a600603a-de4c-4991-8827-9fec3dead821" status: 200 len: 1324 microversion: 2.1 time: 0.878150 Oct 04 21:52:22.727995 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1028/2113] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:52:21 2022] GET /compute/v2.1/servers/a600603a-de4c-4991-8827-9fec3dead821 => generated 1324 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:52:22.862476 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-51ef589f-d1fa-482f-aa32-966348d592fa tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:22.863496 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-51ef589f-d1fa-482f-aa32-966348d592fa tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 152003e4-2a7b-4801-8656-73093cd566ed] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:52:22.877586 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-51ef589f-d1fa-482f-aa32-966348d592fa tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:22.881379 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-51ef589f-d1fa-482f-aa32-966348d592fa tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:22.894256 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-51ef589f-d1fa-482f-aa32-966348d592fa tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:22.896066 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-51ef589f-d1fa-482f-aa32-966348d592fa tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:22.897697 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-51ef589f-d1fa-482f-aa32-966348d592fa tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:22.899890 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-51ef589f-d1fa-482f-aa32-966348d592fa tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:23.145177 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-51ef589f-d1fa-482f-aa32-966348d592fa tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ad048becf474fb972d4291422d810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dcfc7024fc49388c4bd5f25f03e60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:23.166132 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-51ef589f-d1fa-482f-aa32-966348d592fa tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/152003e4-2a7b-4801-8656-73093cd566ed" status: 200 len: 1150 microversion: 2.1 time: 0.307090 Oct 04 21:52:23.171066 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1029/2114] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:52:22 2022] GET /compute/v2.1/servers/152003e4-2a7b-4801-8656-73093cd566ed => generated 1150 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:52:23.209369 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-13e27ce1-3da3-4b8b-b939-a812c3b54f29 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:23.210165 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-13e27ce1-3da3-4b8b-b939-a812c3b54f29 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] [instance: 128b12e0-8fde-4113-95e9-0ecba563d8ec] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:52:23.227340 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-13e27ce1-3da3-4b8b-b939-a812c3b54f29 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:23.228380 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-13e27ce1-3da3-4b8b-b939-a812c3b54f29 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:23.229245 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-13e27ce1-3da3-4b8b-b939-a812c3b54f29 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:23.230561 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-13e27ce1-3da3-4b8b-b939-a812c3b54f29 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:23.232020 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-13e27ce1-3da3-4b8b-b939-a812c3b54f29 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:23.232850 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-13e27ce1-3da3-4b8b-b939-a812c3b54f29 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:23.287929 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-ccdd4d4c-ae7c-4562-acf2-381ed0312f98 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:23.306217 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-ccdd4d4c-ae7c-4562-acf2-381ed0312f98 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:23.312811 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-ccdd4d4c-ae7c-4562-acf2-381ed0312f98 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:23.314623 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-ccdd4d4c-ae7c-4562-acf2-381ed0312f98 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] 10.222.0.43 "GET /compute/v2.1/servers/b646f5b5-a266-44df-80e6-5d1b2a3b91d7" status: 200 len: 1487 microversion: 2.25 time: 0.934183 Oct 04 21:52:23.315977 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1086/2115] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:52:22 2022] GET /compute/v2.1/servers/b646f5b5-a266-44df-80e6-5d1b2a3b91d7 => generated 1487 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:52:23.326086 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-38539693-e37d-46cf-8089-834c71cddbf3 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Calling method '.version_select at 0x7fbb372b1c10>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:23.417552 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-38539693-e37d-46cf-8089-834c71cddbf3 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] 10.222.0.43 "GET /compute/v2.1/images/e62b2cc2-812b-4ec4-bba4-5703d4b65e48" status: 200 len: 1454 microversion: 2.1 time: 0.098759 Oct 04 21:52:23.418161 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1087/2116] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:52:23 2022] GET /compute/v2.1/images/e62b2cc2-812b-4ec4-bba4-5703d4b65e48 => generated 1454 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:52:23.696920 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-13e27ce1-3da3-4b8b-b939-a812c3b54f29 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921f934be12045b3ac0b2c6ed5101bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4335ce6fd64a0397fbfb13e1b255ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:23.735739 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-13e27ce1-3da3-4b8b-b939-a812c3b54f29 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] 10.222.0.43 "GET /compute/v2.1/servers/128b12e0-8fde-4113-95e9-0ecba563d8ec" status: 200 len: 1368 microversion: 2.1 time: 0.537817 Oct 04 21:52:23.753875 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-645e1db0-a0c0-4ea5-9b74-50b8e71767c9 tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:23.754540 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-645e1db0-a0c0-4ea5-9b74-50b8e71767c9 tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] [instance: a600603a-de4c-4991-8827-9fec3dead821] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:52:23.759447 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1030/2117] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:52:23 2022] GET /compute/v2.1/servers/128b12e0-8fde-4113-95e9-0ecba563d8ec => generated 1368 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:52:23.773557 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-645e1db0-a0c0-4ea5-9b74-50b8e71767c9 tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:23.777523 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-645e1db0-a0c0-4ea5-9b74-50b8e71767c9 tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:23.778588 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-645e1db0-a0c0-4ea5-9b74-50b8e71767c9 tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:23.779510 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-645e1db0-a0c0-4ea5-9b74-50b8e71767c9 tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:23.780321 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-645e1db0-a0c0-4ea5-9b74-50b8e71767c9 tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:23.781025 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-645e1db0-a0c0-4ea5-9b74-50b8e71767c9 tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:24.196895 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-67810956-0805-475c-9f41-c882497ebd16 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:24.201805 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-67810956-0805-475c-9f41-c882497ebd16 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 152003e4-2a7b-4801-8656-73093cd566ed] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:52:24.219864 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-67810956-0805-475c-9f41-c882497ebd16 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:24.244509 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-67810956-0805-475c-9f41-c882497ebd16 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:24.245621 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-67810956-0805-475c-9f41-c882497ebd16 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:24.247336 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-67810956-0805-475c-9f41-c882497ebd16 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:24.250713 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-67810956-0805-475c-9f41-c882497ebd16 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:24.252708 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-67810956-0805-475c-9f41-c882497ebd16 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:24.477374 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-67810956-0805-475c-9f41-c882497ebd16 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ad048becf474fb972d4291422d810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dcfc7024fc49388c4bd5f25f03e60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:24.493066 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-67810956-0805-475c-9f41-c882497ebd16 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/152003e4-2a7b-4801-8656-73093cd566ed" status: 200 len: 1168 microversion: 2.1 time: 0.302745 Oct 04 21:52:24.495847 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1031/2118] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:52:24 2022] GET /compute/v2.1/servers/152003e4-2a7b-4801-8656-73093cd566ed => generated 1168 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:52:24.498868 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-645e1db0-a0c0-4ea5-9b74-50b8e71767c9 tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa551b85109f42b299665382695c6b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c6e52760ea4396a95a3ffb7db2a9a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:24.505536 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-0f685008-397f-4a39-84e6-605ff3053408 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:24.515805 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-0f685008-397f-4a39-84e6-605ff3053408 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] [instance: b646f5b5-a266-44df-80e6-5d1b2a3b91d7] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:52:24.518466 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-645e1db0-a0c0-4ea5-9b74-50b8e71767c9 tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] 10.222.0.43 "GET /compute/v2.1/servers/a600603a-de4c-4991-8827-9fec3dead821" status: 200 len: 1522 microversion: 2.1 time: 0.769345 Oct 04 21:52:24.521284 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1088/2119] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:52:23 2022] GET /compute/v2.1/servers/a600603a-de4c-4991-8827-9fec3dead821 => generated 1522 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:52:24.526891 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-a99caf2a-97e6-414e-92b1-d55fce76d0e0 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Calling method '.version_select at 0x7fbb372b1d30>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:24.557123 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0f685008-397f-4a39-84e6-605ff3053408 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:24.557243 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0f685008-397f-4a39-84e6-605ff3053408 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:24.557685 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0f685008-397f-4a39-84e6-605ff3053408 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:24.558447 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0f685008-397f-4a39-84e6-605ff3053408 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:24.558910 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0f685008-397f-4a39-84e6-605ff3053408 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:24.572648 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0f685008-397f-4a39-84e6-605ff3053408 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:24.613434 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-a99caf2a-97e6-414e-92b1-d55fce76d0e0 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] 10.222.0.43 "GET /compute/v2.1/images/e62b2cc2-812b-4ec4-bba4-5703d4b65e48" status: 200 len: 1454 microversion: 2.1 time: 0.090420 Oct 04 21:52:24.615291 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1089/2120] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:52:24 2022] GET /compute/v2.1/images/e62b2cc2-812b-4ec4-bba4-5703d4b65e48 => generated 1454 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:52:24.620893 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-26a4319b-ca89-40a3-b1f7-99b481ec662a tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:24.622274 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-26a4319b-ca89-40a3-b1f7-99b481ec662a tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] [instance: a600603a-de4c-4991-8827-9fec3dead821] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:52:24.626535 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=1,nova_api:INSERT=7 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:52:24.635640 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-26a4319b-ca89-40a3-b1f7-99b481ec662a tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:24.636460 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-26a4319b-ca89-40a3-b1f7-99b481ec662a tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:24.638062 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-26a4319b-ca89-40a3-b1f7-99b481ec662a tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:24.639330 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-26a4319b-ca89-40a3-b1f7-99b481ec662a tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:24.640069 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-26a4319b-ca89-40a3-b1f7-99b481ec662a tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:24.643936 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-26a4319b-ca89-40a3-b1f7-99b481ec662a tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:24.712988 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-26a4319b-ca89-40a3-b1f7-99b481ec662a tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] HTTP exception thrown: Action 999 not found Oct 04 21:52:24.724228 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-26a4319b-ca89-40a3-b1f7-99b481ec662a tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] Request method failure captured: Oct 04 21:52:24.724228 n-d-860284-1 devstack@n-api.service[134102]: request: GET /compute/v2.1/servers/a600603a-de4c-4991-8827-9fec3dead821/os-instance-actions/999 HTTP/1.1 Oct 04 21:52:24.724228 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 21:52:24.724228 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 21:52:24.724228 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 21:52:24.724228 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 21:52:24.724228 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 21:52:24.724228 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 21:52:24.724228 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 21:52:24.724228 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 21:52:24.724228 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPKrskVE9HROTEQossGsXoRvBzbz7S6RmzoWkV9fXxGJJy86VfD-4Fan6lZA_6XfenfVM2wCnY734cuSKt91aSb0AocrH7jVRrNNEW5TDaJgCwrFSLOGW0qBZBDMhz7n5G5Jsfc_Bd8jBl3cgu6D3UVgXT_xO67sR5xO0iijYeuiGJm8 Oct 04 21:52:24.724228 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 21:52:24.724228 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 21:52:24.724228 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 21:52:24.724228 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 21:52:24.724228 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 21:52:24.724228 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 21:52:24.724228 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: 71c6e52760ea4396a95a3ffb7db2a9a3 Oct 04 21:52:24.724228 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1836254795 Oct 04 21:52:24.724228 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 21:52:24.724228 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 21:52:24.724228 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/71c6e52760ea4396a95a3ffb7db2a9a3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_71c6e52760ea4396a95a3ffb7db2a9a3", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/71c6e52760ea4396a95a3ffb7db2a9a3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/71c6e52760ea4396a95a3ffb7db2a9a3"}]}] Oct 04 21:52:24.724228 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1836254795 Oct 04 21:52:24.724228 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: 71c6e52760ea4396a95a3ffb7db2a9a3 Oct 04 21:52:24.724228 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1836254795 Oct 04 21:52:24.724228 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-InstanceActionsNegativeTestJSON-1836254795-project Oct 04 21:52:24.724228 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 21:52:24.724228 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 21:52:24.724228 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: fa551b85109f42b299665382695c6b17 Oct 04 21:52:24.724228 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1836254795-project Oct 04 21:52:24.724228 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 21:52:24.724228 n-d-860284-1 devstack@n-api.service[134102]: exception: Action 999 not found Oct 04 21:52:24.724228 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'server_id': 'a600603a-de4c-4991-8827-9fec3dead821', 'id': '999'} Oct 04 21:52:24.724228 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:52:24.724228 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:52:24.724228 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:52:24.724228 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:52:24.724228 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:52:24.724228 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:52:24.724228 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:52:24.724228 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:52:24.724228 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 152, in show Oct 04 21:52:24.724228 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 04 21:52:24.724228 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Action 999 not found Oct 04 21:52:24.724228 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:52:24.724228 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:52:24.724228 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:52:24.724228 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:52:24.724228 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:52:24.724228 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:52:24.724228 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:52:24.724228 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:52:24.724228 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Action 999 not found Oct 04 21:52:24.724228 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:52:24.734617 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-26a4319b-ca89-40a3-b1f7-99b481ec662a tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] Returning 404 to user: Action 999 not found {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:52:24.736513 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-26a4319b-ca89-40a3-b1f7-99b481ec662a tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] 10.222.0.43 "GET /compute/v2.1/servers/a600603a-de4c-4991-8827-9fec3dead821/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.119764 Oct 04 21:52:24.738673 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1090/2121] 10.222.0.43 () {58 vars in 1308 bytes} [Tue Oct 4 21:52:24 2022] GET /compute/v2.1/servers/a600603a-de4c-4991-8827-9fec3dead821/os-instance-actions/999 => generated 66 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 21:52:24.751473 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-e99e9013-61d8-40d8-bb11-1a573202e44c tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] Calling method '.version_select at 0x7fbb2ea03670>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:24.752412 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-e99e9013-61d8-40d8-bb11-1a573202e44c tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] [instance: cea1927a-9e12-495b-803c-19f88030bdce] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:52:24.761141 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-e99e9013-61d8-40d8-bb11-1a573202e44c tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] HTTP exception thrown: Instance cea1927a-9e12-495b-803c-19f88030bdce could not be found. Oct 04 21:52:24.764420 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-e99e9013-61d8-40d8-bb11-1a573202e44c tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] Request method failure captured: Oct 04 21:52:24.764420 n-d-860284-1 devstack@n-api.service[134102]: request: GET /compute/v2.1/servers/cea1927a-9e12-495b-803c-19f88030bdce/os-instance-actions HTTP/1.1 Oct 04 21:52:24.764420 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 21:52:24.764420 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 21:52:24.764420 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 21:52:24.764420 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 21:52:24.764420 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 21:52:24.764420 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 21:52:24.764420 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 21:52:24.764420 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 21:52:24.764420 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPKrskVE9HROTEQossGsXoRvBzbz7S6RmzoWkV9fXxGJJy86VfD-4Fan6lZA_6XfenfVM2wCnY734cuSKt91aSb0AocrH7jVRrNNEW5TDaJgCwrFSLOGW0qBZBDMhz7n5G5Jsfc_Bd8jBl3cgu6D3UVgXT_xO67sR5xO0iijYeuiGJm8 Oct 04 21:52:24.764420 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 21:52:24.764420 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 21:52:24.764420 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 21:52:24.764420 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 21:52:24.764420 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 21:52:24.764420 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 21:52:24.764420 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: 71c6e52760ea4396a95a3ffb7db2a9a3 Oct 04 21:52:24.764420 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1836254795 Oct 04 21:52:24.764420 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 21:52:24.764420 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 21:52:24.764420 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/71c6e52760ea4396a95a3ffb7db2a9a3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_71c6e52760ea4396a95a3ffb7db2a9a3", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/71c6e52760ea4396a95a3ffb7db2a9a3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/71c6e52760ea4396a95a3ffb7db2a9a3"}]}] Oct 04 21:52:24.764420 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1836254795 Oct 04 21:52:24.764420 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: 71c6e52760ea4396a95a3ffb7db2a9a3 Oct 04 21:52:24.764420 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1836254795 Oct 04 21:52:24.764420 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-InstanceActionsNegativeTestJSON-1836254795-project Oct 04 21:52:24.764420 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 21:52:24.764420 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 21:52:24.764420 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: fa551b85109f42b299665382695c6b17 Oct 04 21:52:24.764420 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1836254795-project Oct 04 21:52:24.764420 n-d-860284-1 devstack@n-api.service[134102]: method: Oct 04 21:52:24.764420 n-d-860284-1 devstack@n-api.service[134102]: exception: Instance cea1927a-9e12-495b-803c-19f88030bdce could not be found. Oct 04 21:52:24.764420 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'server_id': 'cea1927a-9e12-495b-803c-19f88030bdce'} Oct 04 21:52:24.764420 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:52:24.764420 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:52:24.764420 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:52:24.764420 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:52:24.764420 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:52:24.764420 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:52:24.764420 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 21:52:24.764420 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 21:52:24.764420 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cea1927a-9e12-495b-803c-19f88030bdce could not be found. Oct 04 21:52:24.764420 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:52:24.764420 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:52:24.764420 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:52:24.764420 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:52:24.764420 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:52:24.764420 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:52:24.764420 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:52:24.764420 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:52:24.764420 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:52:24.764420 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:52:24.764420 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:52:24.764420 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:52:24.764420 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 89, in index Oct 04 21:52:24.764420 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(req, context, server_id) Oct 04 21:52:24.764420 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:52:24.764420 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:52:24.764420 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 77, in _get_instance Oct 04 21:52:24.764420 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return common.get_instance(self.compute_api, context, server_id) Oct 04 21:52:24.764420 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:52:24.764420 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:52:24.768919 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cea1927a-9e12-495b-803c-19f88030bdce could not be found. Oct 04 21:52:24.768919 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:52:24.768919 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:52:24.768919 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:52:24.768919 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:52:24.768919 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:52:24.768919 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:52:24.768919 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:52:24.768919 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:52:24.768919 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cea1927a-9e12-495b-803c-19f88030bdce could not be found. Oct 04 21:52:24.768919 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:52:24.771359 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-e99e9013-61d8-40d8-bb11-1a573202e44c tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] Returning 404 to user: Instance cea1927a-9e12-495b-803c-19f88030bdce could not be found. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:52:24.772505 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-e99e9013-61d8-40d8-bb11-1a573202e44c tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] 10.222.0.43 "GET /compute/v2.1/servers/cea1927a-9e12-495b-803c-19f88030bdce/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.026974 Oct 04 21:52:24.774110 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1091/2122] 10.222.0.43 () {58 vars in 1296 bytes} [Tue Oct 4 21:52:24 2022] GET /compute/v2.1/servers/cea1927a-9e12-495b-803c-19f88030bdce/os-instance-actions => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:52:24.782613 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-3668e2fa-17d7-4193-8ee2-e438d3b28411 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:24.783646 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-3668e2fa-17d7-4193-8ee2-e438d3b28411 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] [instance: 128b12e0-8fde-4113-95e9-0ecba563d8ec] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:52:24.792013 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3668e2fa-17d7-4193-8ee2-e438d3b28411 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:24.792874 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3668e2fa-17d7-4193-8ee2-e438d3b28411 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:24.793766 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3668e2fa-17d7-4193-8ee2-e438d3b28411 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:24.795305 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3668e2fa-17d7-4193-8ee2-e438d3b28411 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:24.795997 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3668e2fa-17d7-4193-8ee2-e438d3b28411 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:24.796648 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3668e2fa-17d7-4193-8ee2-e438d3b28411 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:25.222803 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-0f685008-397f-4a39-84e6-605ff3053408 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:25.241424 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-0f685008-397f-4a39-84e6-605ff3053408 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:25.250166 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-0f685008-397f-4a39-84e6-605ff3053408 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:25.266598 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-0f685008-397f-4a39-84e6-605ff3053408 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] 10.222.0.43 "GET /compute/v2.1/servers/b646f5b5-a266-44df-80e6-5d1b2a3b91d7" status: 200 len: 1487 microversion: 2.25 time: 0.767786 Oct 04 21:52:25.267552 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1032/2123] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:52:24 2022] GET /compute/v2.1/servers/b646f5b5-a266-44df-80e6-5d1b2a3b91d7 => generated 1487 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:52:25.272536 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-acf7bf26-2811-48ba-aa0d-31203127a9d6 tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:25.277680 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-acf7bf26-2811-48ba-aa0d-31203127a9d6 tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] [instance: a600603a-de4c-4991-8827-9fec3dead821] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:52:25.304966 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-3668e2fa-17d7-4193-8ee2-e438d3b28411 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921f934be12045b3ac0b2c6ed5101bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4335ce6fd64a0397fbfb13e1b255ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:25.322751 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-acf7bf26-2811-48ba-aa0d-31203127a9d6 tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:25.327992 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-3668e2fa-17d7-4193-8ee2-e438d3b28411 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] 10.222.0.43 "GET /compute/v2.1/servers/128b12e0-8fde-4113-95e9-0ecba563d8ec" status: 200 len: 1368 microversion: 2.1 time: 0.548450 Oct 04 21:52:25.333844 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-acf7bf26-2811-48ba-aa0d-31203127a9d6 tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:25.335025 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-acf7bf26-2811-48ba-aa0d-31203127a9d6 tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:25.335415 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1092/2124] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:52:24 2022] GET /compute/v2.1/servers/128b12e0-8fde-4113-95e9-0ecba563d8ec => generated 1368 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:52:25.337515 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-acf7bf26-2811-48ba-aa0d-31203127a9d6 tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:25.342037 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-acf7bf26-2811-48ba-aa0d-31203127a9d6 tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:25.344422 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-acf7bf26-2811-48ba-aa0d-31203127a9d6 tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:25.432360 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-acf7bf26-2811-48ba-aa0d-31203127a9d6 tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] [instance: a600603a-de4c-4991-8827-9fec3dead821] Going to try to terminate instance {{(pid=134101) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:52:25.518467 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-026cf9ef-e818-4fe1-bff8-75f474ae8441 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:25.519938 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-026cf9ef-e818-4fe1-bff8-75f474ae8441 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 152003e4-2a7b-4801-8656-73093cd566ed] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:52:25.532781 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-026cf9ef-e818-4fe1-bff8-75f474ae8441 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:25.533639 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-026cf9ef-e818-4fe1-bff8-75f474ae8441 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:25.534298 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-026cf9ef-e818-4fe1-bff8-75f474ae8441 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:25.537670 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-026cf9ef-e818-4fe1-bff8-75f474ae8441 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:25.538452 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-026cf9ef-e818-4fe1-bff8-75f474ae8441 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:25.539377 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-026cf9ef-e818-4fe1-bff8-75f474ae8441 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:25.777224 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-acf7bf26-2811-48ba-aa0d-31203127a9d6 tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] 10.222.0.43 "DELETE /compute/v2.1/servers/a600603a-de4c-4991-8827-9fec3dead821" status: 204 len: 0 microversion: 2.1 time: 0.507770 Oct 04 21:52:25.781147 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1033/2125] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 21:52:25 2022] DELETE /compute/v2.1/servers/a600603a-de4c-4991-8827-9fec3dead821 => generated 0 bytes in 511 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:52:25.805510 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-a0d7fd04-dfa8-4e8d-baa5-2bcd90c3075c tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Calling method '.version_select at 0x7fbb2ef75e50>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:26.020936 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-a0d7fd04-dfa8-4e8d-baa5-2bcd90c3075c tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] 10.222.0.43 "GET /compute/v2.1/images/e62b2cc2-812b-4ec4-bba4-5703d4b65e48" status: 200 len: 1454 microversion: 2.1 time: 0.238369 Oct 04 21:52:26.022704 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1034/2126] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:52:25 2022] GET /compute/v2.1/images/e62b2cc2-812b-4ec4-bba4-5703d4b65e48 => generated 1454 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:52:26.031430 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e8b48fe1-5c94-40ed-b956-47a1ab64fa7b tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:26.039314 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-e8b48fe1-5c94-40ed-b956-47a1ab64fa7b tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] [instance: a600603a-de4c-4991-8827-9fec3dead821] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:52:26.047147 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e8b48fe1-5c94-40ed-b956-47a1ab64fa7b tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:26.047655 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e8b48fe1-5c94-40ed-b956-47a1ab64fa7b tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:26.048360 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e8b48fe1-5c94-40ed-b956-47a1ab64fa7b tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:26.049113 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e8b48fe1-5c94-40ed-b956-47a1ab64fa7b tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:26.049579 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e8b48fe1-5c94-40ed-b956-47a1ab64fa7b tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:26.050015 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e8b48fe1-5c94-40ed-b956-47a1ab64fa7b tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:26.259034 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-026cf9ef-e818-4fe1-bff8-75f474ae8441 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ad048becf474fb972d4291422d810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dcfc7024fc49388c4bd5f25f03e60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:26.270220 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-026cf9ef-e818-4fe1-bff8-75f474ae8441 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/152003e4-2a7b-4801-8656-73093cd566ed" status: 200 len: 1210 microversion: 2.1 time: 0.755991 Oct 04 21:52:26.276090 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1093/2127] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:52:25 2022] GET /compute/v2.1/servers/152003e4-2a7b-4801-8656-73093cd566ed => generated 1210 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:52:26.304682 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-6ecf79ad-be0f-492f-aa94-dd4918fbb9f9 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:26.307649 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-6ecf79ad-be0f-492f-aa94-dd4918fbb9f9 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] [instance: b646f5b5-a266-44df-80e6-5d1b2a3b91d7] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:52:26.319887 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6ecf79ad-be0f-492f-aa94-dd4918fbb9f9 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:26.322768 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6ecf79ad-be0f-492f-aa94-dd4918fbb9f9 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:26.323441 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6ecf79ad-be0f-492f-aa94-dd4918fbb9f9 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:26.327355 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6ecf79ad-be0f-492f-aa94-dd4918fbb9f9 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:26.328094 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6ecf79ad-be0f-492f-aa94-dd4918fbb9f9 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:26.328740 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6ecf79ad-be0f-492f-aa94-dd4918fbb9f9 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:26.865602 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-e8b48fe1-5c94-40ed-b956-47a1ab64fa7b tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa551b85109f42b299665382695c6b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c6e52760ea4396a95a3ffb7db2a9a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:26.876938 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-e8b48fe1-5c94-40ed-b956-47a1ab64fa7b tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] 10.222.0.43 "GET /compute/v2.1/servers/a600603a-de4c-4991-8827-9fec3dead821" status: 200 len: 1528 microversion: 2.1 time: 0.853144 Oct 04 21:52:26.882066 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1035/2128] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:52:26 2022] GET /compute/v2.1/servers/a600603a-de4c-4991-8827-9fec3dead821 => generated 1528 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:52:26.892908 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-4d66beea-c848-48d8-8af1-e211700ee962 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:26.896868 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-4d66beea-c848-48d8-8af1-e211700ee962 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] [instance: 128b12e0-8fde-4113-95e9-0ecba563d8ec] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:52:26.923639 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4d66beea-c848-48d8-8af1-e211700ee962 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:26.932209 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4d66beea-c848-48d8-8af1-e211700ee962 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:26.935947 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4d66beea-c848-48d8-8af1-e211700ee962 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:26.942043 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4d66beea-c848-48d8-8af1-e211700ee962 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:26.943761 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4d66beea-c848-48d8-8af1-e211700ee962 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:26.945553 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4d66beea-c848-48d8-8af1-e211700ee962 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:27.490304 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-6ecf79ad-be0f-492f-aa94-dd4918fbb9f9 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:27.514970 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-6ecf79ad-be0f-492f-aa94-dd4918fbb9f9 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:27.519577 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-6ecf79ad-be0f-492f-aa94-dd4918fbb9f9 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:27.520874 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-6ecf79ad-be0f-492f-aa94-dd4918fbb9f9 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] 10.222.0.43 "GET /compute/v2.1/servers/b646f5b5-a266-44df-80e6-5d1b2a3b91d7" status: 200 len: 1487 microversion: 2.25 time: 1.228529 Oct 04 21:52:27.521466 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1094/2129] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:52:26 2022] GET /compute/v2.1/servers/b646f5b5-a266-44df-80e6-5d1b2a3b91d7 => generated 1487 bytes in 1230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:52:27.545977 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-dc70c72a-0b37-412e-ac68-05c997703022 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Calling method '.version_select at 0x7fbb2e884160>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:27.578864 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-4d66beea-c848-48d8-8af1-e211700ee962 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921f934be12045b3ac0b2c6ed5101bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4335ce6fd64a0397fbfb13e1b255ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:27.595085 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-4d66beea-c848-48d8-8af1-e211700ee962 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] 10.222.0.43 "GET /compute/v2.1/servers/128b12e0-8fde-4113-95e9-0ecba563d8ec" status: 200 len: 1368 microversion: 2.1 time: 0.706207 Oct 04 21:52:27.596682 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1036/2130] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:52:26 2022] GET /compute/v2.1/servers/128b12e0-8fde-4113-95e9-0ecba563d8ec => generated 1368 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:52:27.605171 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-b76c779f-1415-4644-8a30-9533f421aa9c tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:27.618303 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-b76c779f-1415-4644-8a30-9533f421aa9c tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 152003e4-2a7b-4801-8656-73093cd566ed] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:52:27.639048 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b76c779f-1415-4644-8a30-9533f421aa9c tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:27.639836 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b76c779f-1415-4644-8a30-9533f421aa9c tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:27.640452 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b76c779f-1415-4644-8a30-9533f421aa9c tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:27.641675 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b76c779f-1415-4644-8a30-9533f421aa9c tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:27.643131 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b76c779f-1415-4644-8a30-9533f421aa9c tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:27.646205 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b76c779f-1415-4644-8a30-9533f421aa9c tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:27.675670 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-dc70c72a-0b37-412e-ac68-05c997703022 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] 10.222.0.43 "GET /compute/v2.1/images/e62b2cc2-812b-4ec4-bba4-5703d4b65e48" status: 200 len: 1454 microversion: 2.1 time: 0.149879 Oct 04 21:52:27.676270 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1095/2131] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:52:27 2022] GET /compute/v2.1/images/e62b2cc2-812b-4ec4-bba4-5703d4b65e48 => generated 1454 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:52:27.719793 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-0f651086-07d4-46d3-8f81-a3ee8e78143a req-9e1d61c9-f70b-4e83-97f6-7078685d0a0a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "152003e4-2a7b-4801-8656-73093cd566ed", "tag": "eefc2731-0f05-444f-9e84-6aab2807b291"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:52:27.744259 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-0f651086-07d4-46d3-8f81-a3ee8e78143a req-9e1d61c9-f70b-4e83-97f6-7078685d0a0a service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:27.744752 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-0f651086-07d4-46d3-8f81-a3ee8e78143a req-9e1d61c9-f70b-4e83-97f6-7078685d0a0a service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:27.745204 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-0f651086-07d4-46d3-8f81-a3ee8e78143a req-9e1d61c9-f70b-4e83-97f6-7078685d0a0a service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:27.794596 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-0f651086-07d4-46d3-8f81-a3ee8e78143a req-9e1d61c9-f70b-4e83-97f6-7078685d0a0a service nova] Creating event network-changed:eefc2731-0f05-444f-9e84-6aab2807b291 for instance 152003e4-2a7b-4801-8656-73093cd566ed on n-h1-860284-1 Oct 04 21:52:27.806310 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-0f651086-07d4-46d3-8f81-a3ee8e78143a req-9e1d61c9-f70b-4e83-97f6-7078685d0a0a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091237 Oct 04 21:52:27.812396 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1096/2132] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:52:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:52:27.914675 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-590bf921-cf06-4adb-ad12-ccee83bb375e tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:27.916245 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-590bf921-cf06-4adb-ad12-ccee83bb375e tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] [instance: a600603a-de4c-4991-8827-9fec3dead821] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:52:27.951779 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-590bf921-cf06-4adb-ad12-ccee83bb375e tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:27.952400 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-590bf921-cf06-4adb-ad12-ccee83bb375e tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:27.954839 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-590bf921-cf06-4adb-ad12-ccee83bb375e tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:27.955672 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-590bf921-cf06-4adb-ad12-ccee83bb375e tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:27.963618 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-590bf921-cf06-4adb-ad12-ccee83bb375e tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:27.965438 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-590bf921-cf06-4adb-ad12-ccee83bb375e tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:28.288731 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-590bf921-cf06-4adb-ad12-ccee83bb375e tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa551b85109f42b299665382695c6b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c6e52760ea4396a95a3ffb7db2a9a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:28.303837 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-590bf921-cf06-4adb-ad12-ccee83bb375e tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] 10.222.0.43 "GET /compute/v2.1/servers/a600603a-de4c-4991-8827-9fec3dead821" status: 200 len: 1528 microversion: 2.1 time: 0.397957 Oct 04 21:52:28.305555 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1097/2133] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:52:27 2022] GET /compute/v2.1/servers/a600603a-de4c-4991-8827-9fec3dead821 => generated 1528 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:52:28.490028 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-b76c779f-1415-4644-8a30-9533f421aa9c tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ad048becf474fb972d4291422d810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dcfc7024fc49388c4bd5f25f03e60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:28.504937 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-b76c779f-1415-4644-8a30-9533f421aa9c tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/152003e4-2a7b-4801-8656-73093cd566ed" status: 200 len: 1210 microversion: 2.1 time: 0.907006 Oct 04 21:52:28.508352 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1037/2134] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:52:27 2022] GET /compute/v2.1/servers/152003e4-2a7b-4801-8656-73093cd566ed => generated 1210 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:52:28.555880 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-d7663193-0dfd-47cf-99a6-7a2b37e566da tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:28.558166 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-d7663193-0dfd-47cf-99a6-7a2b37e566da tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] [instance: b646f5b5-a266-44df-80e6-5d1b2a3b91d7] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:52:28.572413 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d7663193-0dfd-47cf-99a6-7a2b37e566da tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:28.575746 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d7663193-0dfd-47cf-99a6-7a2b37e566da tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:28.576623 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d7663193-0dfd-47cf-99a6-7a2b37e566da tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:28.578803 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d7663193-0dfd-47cf-99a6-7a2b37e566da tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:28.580961 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d7663193-0dfd-47cf-99a6-7a2b37e566da tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:28.583502 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d7663193-0dfd-47cf-99a6-7a2b37e566da tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:28.692175 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-36c79e26-fe28-4d31-ad25-09a9353a77ea tempest-MultipleCreateNegativeTestJSON-332148889 tempest-MultipleCreateNegativeTestJSON-332148889-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1038845444", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:52:28.703066 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-36c79e26-fe28-4d31-ad25-09a9353a77ea tempest-MultipleCreateNegativeTestJSON-332148889 tempest-MultipleCreateNegativeTestJSON-332148889-project] HTTP exception thrown: min_count must be <= max_count Oct 04 21:52:28.710900 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-36c79e26-fe28-4d31-ad25-09a9353a77ea tempest-MultipleCreateNegativeTestJSON-332148889 tempest-MultipleCreateNegativeTestJSON-332148889-project] Request method failure captured: Oct 04 21:52:28.710900 n-d-860284-1 devstack@n-api.service[134102]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 21:52:28.710900 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 21:52:28.710900 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 21:52:28.710900 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 21:52:28.710900 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 184 Oct 04 21:52:28.710900 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 21:52:28.710900 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 21:52:28.710900 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 21:52:28.710900 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 21:52:28.710900 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPKsb9YTsCLl73rHZe9lpdZfGlDHaMNG2p6pgcud381E5yFVlCGP7cSFJ_dXQTrVaLxVeqHeCNGDUviym0kENq0DXZnQtkNzJlmhEjJcyPg2W6F4Rlm9iN3d-ufqbwgrTI1Ovw_Ibjiqj_Pb3ar9Vp0zMW9N7K6Om5cZwWmZHs0rYm3w Oct 04 21:52:28.710900 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 21:52:28.710900 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 21:52:28.710900 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 21:52:28.710900 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 21:52:28.710900 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 21:52:28.710900 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 21:52:28.710900 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: 9d857e796f7640c08653e2c6788ab865 Oct 04 21:52:28.710900 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-332148889 Oct 04 21:52:28.710900 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 21:52:28.710900 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 21:52:28.710900 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/9d857e796f7640c08653e2c6788ab865"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_9d857e796f7640c08653e2c6788ab865", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/9d857e796f7640c08653e2c6788ab865"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/9d857e796f7640c08653e2c6788ab865"}]}] Oct 04 21:52:28.710900 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-332148889 Oct 04 21:52:28.710900 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: 9d857e796f7640c08653e2c6788ab865 Oct 04 21:52:28.710900 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-332148889 Oct 04 21:52:28.710900 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-MultipleCreateNegativeTestJSON-332148889-project Oct 04 21:52:28.710900 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 21:52:28.710900 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 21:52:28.710900 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: 195f2bcfd678465c856695b911afd12e Oct 04 21:52:28.710900 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-332148889-project Oct 04 21:52:28.710900 n-d-860284-1 devstack@n-api.service[134102]: Oct 04 21:52:28.710900 n-d-860284-1 devstack@n-api.service[134102]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1038845444", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452", "min_count": 3, "max_count": 2}} Oct 04 21:52:28.710900 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 21:52:28.710900 n-d-860284-1 devstack@n-api.service[134102]: exception: min_count must be <= max_count Oct 04 21:52:28.710900 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1038845444', 'imageRef': '58548514-5dac-426c-81f5-19e3fba33e23', 'flavorRef': '452', 'min_count': 3, 'max_count': 2}}} Oct 04 21:52:28.710900 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:52:28.710900 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:52:28.710900 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:52:28.710900 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:52:28.710900 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:52:28.710900 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:52:28.710900 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:52:28.710900 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:52:28.710900 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:52:28.710900 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:52:28.710900 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:52:28.710900 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:52:28.710900 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:52:28.710900 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:52:28.710900 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 21:52:28.710900 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 726, in create Oct 04 21:52:28.710900 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 04 21:52:28.710900 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: min_count must be <= max_count Oct 04 21:52:28.710900 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:52:28.710900 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:52:28.710900 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:52:28.710900 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:52:28.710900 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:52:28.710900 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:52:28.710900 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:52:28.710900 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:52:28.710900 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: min_count must be <= max_count Oct 04 21:52:28.710900 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:52:28.723950 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-36c79e26-fe28-4d31-ad25-09a9353a77ea tempest-MultipleCreateNegativeTestJSON-332148889 tempest-MultipleCreateNegativeTestJSON-332148889-project] Returning 400 to user: min_count must be <= max_count {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:52:28.726917 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-36c79e26-fe28-4d31-ad25-09a9353a77ea tempest-MultipleCreateNegativeTestJSON-332148889 tempest-MultipleCreateNegativeTestJSON-332148889-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.415807 Oct 04 21:52:28.729418 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1098/2135] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 21:52:28 2022] POST /compute/v2.1/servers => generated 74 bytes in 423 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 04 21:52:28.755530 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-584e4c8e-7b2d-49a2-b138-e6aa43bc8581 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:28.759692 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-584e4c8e-7b2d-49a2-b138-e6aa43bc8581 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] [instance: 128b12e0-8fde-4113-95e9-0ecba563d8ec] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:52:28.797717 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-584e4c8e-7b2d-49a2-b138-e6aa43bc8581 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:28.802747 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-584e4c8e-7b2d-49a2-b138-e6aa43bc8581 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:28.803763 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-584e4c8e-7b2d-49a2-b138-e6aa43bc8581 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:28.805802 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-584e4c8e-7b2d-49a2-b138-e6aa43bc8581 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:28.809837 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-584e4c8e-7b2d-49a2-b138-e6aa43bc8581 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:28.810497 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-584e4c8e-7b2d-49a2-b138-e6aa43bc8581 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:29.179220 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-d7663193-0dfd-47cf-99a6-7a2b37e566da tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:29.184414 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:52:29.200423 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-d7663193-0dfd-47cf-99a6-7a2b37e566da tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:29.202763 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-d7663193-0dfd-47cf-99a6-7a2b37e566da tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:29.204940 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-d7663193-0dfd-47cf-99a6-7a2b37e566da tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] 10.222.0.43 "GET /compute/v2.1/servers/b646f5b5-a266-44df-80e6-5d1b2a3b91d7" status: 200 len: 1487 microversion: 2.25 time: 0.653669 Oct 04 21:52:29.209028 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1038/2136] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:52:28 2022] GET /compute/v2.1/servers/b646f5b5-a266-44df-80e6-5d1b2a3b91d7 => generated 1487 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:52:29.216417 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-7818a82e-2596-4e6b-95cf-f5d398b92aac tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Calling method '.version_select at 0x7fbb3727a820>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:29.290860 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-7818a82e-2596-4e6b-95cf-f5d398b92aac tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] 10.222.0.43 "GET /compute/v2.1/images/e62b2cc2-812b-4ec4-bba4-5703d4b65e48" status: 200 len: 1454 microversion: 2.1 time: 0.079828 Oct 04 21:52:29.291501 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1039/2137] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:52:29 2022] GET /compute/v2.1/images/e62b2cc2-812b-4ec4-bba4-5703d4b65e48 => generated 1454 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:52:29.299826 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-584e4c8e-7b2d-49a2-b138-e6aa43bc8581 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921f934be12045b3ac0b2c6ed5101bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4335ce6fd64a0397fbfb13e1b255ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:29.311922 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-584e4c8e-7b2d-49a2-b138-e6aa43bc8581 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] 10.222.0.43 "GET /compute/v2.1/servers/128b12e0-8fde-4113-95e9-0ecba563d8ec" status: 200 len: 1368 microversion: 2.1 time: 0.579819 Oct 04 21:52:29.313684 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1099/2138] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:52:28 2022] GET /compute/v2.1/servers/128b12e0-8fde-4113-95e9-0ecba563d8ec => generated 1368 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:52:29.316122 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-d3c99bac-a6b7-4425-99e5-c7e5c612a52d tempest-MultipleCreateNegativeTestJSON-332148889 tempest-MultipleCreateNegativeTestJSON-332148889-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1282848642", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452", "max_count": 0}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:52:29.322896 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-d3c99bac-a6b7-4425-99e5-c7e5c612a52d tempest-MultipleCreateNegativeTestJSON-332148889 tempest-MultipleCreateNegativeTestJSON-332148889-project] Request method failure captured: Oct 04 21:52:29.322896 n-d-860284-1 devstack@n-api.service[134101]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 21:52:29.322896 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 21:52:29.322896 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 21:52:29.322896 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 21:52:29.322896 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 168 Oct 04 21:52:29.322896 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 21:52:29.322896 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 21:52:29.322896 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 21:52:29.322896 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 21:52:29.322896 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPKsb9YTsCLl73rHZe9lpdZfGlDHaMNG2p6pgcud381E5yFVlCGP7cSFJ_dXQTrVaLxVeqHeCNGDUviym0kENq0DXZnQtkNzJlmhEjJcyPg2W6F4Rlm9iN3d-ufqbwgrTI1Ovw_Ibjiqj_Pb3ar9Vp0zMW9N7K6Om5cZwWmZHs0rYm3w Oct 04 21:52:29.322896 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 21:52:29.322896 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 21:52:29.322896 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 21:52:29.322896 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 21:52:29.322896 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 21:52:29.322896 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 21:52:29.322896 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: 9d857e796f7640c08653e2c6788ab865 Oct 04 21:52:29.322896 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-332148889 Oct 04 21:52:29.322896 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 21:52:29.322896 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 21:52:29.322896 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/9d857e796f7640c08653e2c6788ab865"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_9d857e796f7640c08653e2c6788ab865", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/9d857e796f7640c08653e2c6788ab865"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/9d857e796f7640c08653e2c6788ab865"}]}] Oct 04 21:52:29.322896 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-332148889 Oct 04 21:52:29.322896 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: 9d857e796f7640c08653e2c6788ab865 Oct 04 21:52:29.322896 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-332148889 Oct 04 21:52:29.322896 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-MultipleCreateNegativeTestJSON-332148889-project Oct 04 21:52:29.322896 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 21:52:29.322896 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 21:52:29.322896 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 195f2bcfd678465c856695b911afd12e Oct 04 21:52:29.322896 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-332148889-project Oct 04 21:52:29.322896 n-d-860284-1 devstack@n-api.service[134101]: Oct 04 21:52:29.322896 n-d-860284-1 devstack@n-api.service[134101]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1282848642", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452", "max_count": 0}} Oct 04 21:52:29.322896 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 21:52:29.322896 n-d-860284-1 devstack@n-api.service[134101]: exception: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 04 21:52:29.322896 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1282848642', 'imageRef': '58548514-5dac-426c-81f5-19e3fba33e23', 'flavorRef': '452', 'max_count': 0}}} Oct 04 21:52:29.322896 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:52:29.322896 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:52:29.322896 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 21:52:29.322896 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 21:52:29.322896 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 21:52:29.322896 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise error Oct 04 21:52:29.322896 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 04 21:52:29.322896 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:52:29.322896 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['max_count']: Oct 04 21:52:29.322896 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 04 21:52:29.322896 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 04 21:52:29.322896 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 04 21:52:29.322896 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 04 21:52:29.322896 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:52:29.322896 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 21:52:29.322896 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi 0 Oct 04 21:52:29.322896 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:52:29.322896 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:52:29.322896 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:52:29.322896 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:52:29.322896 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:52:29.322896 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:52:29.322896 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:52:29.322896 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:52:29.322896 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:52:29.322896 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:52:29.322896 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:52:29.322896 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:52:29.322896 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 21:52:29.322896 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 21:52:29.330300 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 21:52:29.330300 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 21:52:29.330300 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 21:52:29.330300 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 21:52:29.330300 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 04 21:52:29.330300 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:52:29.330300 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:52:29.330300 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:52:29.330300 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:52:29.330300 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:52:29.330300 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:52:29.330300 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 21:52:29.330300 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 21:52:29.330300 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 04 21:52:29.330300 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:52:29.340879 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-3c7d280b-e0e7-41d4-b85a-78dca5a09aba tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:29.342575 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-3c7d280b-e0e7-41d4-b85a-78dca5a09aba tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] [instance: a600603a-de4c-4991-8827-9fec3dead821] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:52:29.352631 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-d3c99bac-a6b7-4425-99e5-c7e5c612a52d tempest-MultipleCreateNegativeTestJSON-332148889 tempest-MultipleCreateNegativeTestJSON-332148889-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:52:29.355309 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-d3c99bac-a6b7-4425-99e5-c7e5c612a52d tempest-MultipleCreateNegativeTestJSON-332148889 tempest-MultipleCreateNegativeTestJSON-332148889-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.062742 Oct 04 21:52:29.357199 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1040/2139] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 21:52:29 2022] POST /compute/v2.1/servers => generated 130 bytes in 65 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 21:52:29.369692 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3c7d280b-e0e7-41d4-b85a-78dca5a09aba tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:29.370166 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3c7d280b-e0e7-41d4-b85a-78dca5a09aba tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:29.370664 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3c7d280b-e0e7-41d4-b85a-78dca5a09aba tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:29.372089 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3c7d280b-e0e7-41d4-b85a-78dca5a09aba tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:29.372583 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3c7d280b-e0e7-41d4-b85a-78dca5a09aba tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:29.373056 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3c7d280b-e0e7-41d4-b85a-78dca5a09aba tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:29.429275 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell0:SELECT=4 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:52:29.459837 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-4c671048-e9de-4936-adf6-c2c03ff6b907 tempest-MultipleCreateNegativeTestJSON-332148889 tempest-MultipleCreateNegativeTestJSON-332148889-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-894238317", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452", "max_count": 2.5}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:52:29.499460 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-4c671048-e9de-4936-adf6-c2c03ff6b907 tempest-MultipleCreateNegativeTestJSON-332148889 tempest-MultipleCreateNegativeTestJSON-332148889-project] Request method failure captured: Oct 04 21:52:29.499460 n-d-860284-1 devstack@n-api.service[134101]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 21:52:29.499460 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 21:52:29.499460 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 21:52:29.499460 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 21:52:29.499460 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 169 Oct 04 21:52:29.499460 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 21:52:29.499460 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 21:52:29.499460 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 21:52:29.499460 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 21:52:29.499460 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPKsb9YTsCLl73rHZe9lpdZfGlDHaMNG2p6pgcud381E5yFVlCGP7cSFJ_dXQTrVaLxVeqHeCNGDUviym0kENq0DXZnQtkNzJlmhEjJcyPg2W6F4Rlm9iN3d-ufqbwgrTI1Ovw_Ibjiqj_Pb3ar9Vp0zMW9N7K6Om5cZwWmZHs0rYm3w Oct 04 21:52:29.499460 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 21:52:29.499460 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 21:52:29.499460 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 21:52:29.499460 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 21:52:29.499460 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 21:52:29.499460 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 21:52:29.499460 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: 9d857e796f7640c08653e2c6788ab865 Oct 04 21:52:29.499460 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-332148889 Oct 04 21:52:29.499460 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 21:52:29.499460 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 21:52:29.499460 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/9d857e796f7640c08653e2c6788ab865"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_9d857e796f7640c08653e2c6788ab865", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/9d857e796f7640c08653e2c6788ab865"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/9d857e796f7640c08653e2c6788ab865"}]}] Oct 04 21:52:29.499460 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-332148889 Oct 04 21:52:29.499460 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: 9d857e796f7640c08653e2c6788ab865 Oct 04 21:52:29.499460 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-332148889 Oct 04 21:52:29.499460 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-MultipleCreateNegativeTestJSON-332148889-project Oct 04 21:52:29.499460 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 21:52:29.499460 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 21:52:29.499460 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 195f2bcfd678465c856695b911afd12e Oct 04 21:52:29.499460 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-332148889-project Oct 04 21:52:29.499460 n-d-860284-1 devstack@n-api.service[134101]: Oct 04 21:52:29.499460 n-d-860284-1 devstack@n-api.service[134101]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-894238317", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452", "max_count": 2.5}} Oct 04 21:52:29.499460 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 21:52:29.499460 n-d-860284-1 devstack@n-api.service[134101]: exception: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 04 21:52:29.499460 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-894238317', 'imageRef': '58548514-5dac-426c-81f5-19e3fba33e23', 'flavorRef': '452', 'max_count': 2.5}}} Oct 04 21:52:29.499460 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:52:29.499460 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:52:29.499460 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 21:52:29.499460 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 21:52:29.499460 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 21:52:29.499460 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise error Oct 04 21:52:29.499460 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Oct 04 21:52:29.499460 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:52:29.499460 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['max_count']: Oct 04 21:52:29.499460 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 04 21:52:29.499460 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 04 21:52:29.499460 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 04 21:52:29.499460 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 04 21:52:29.499460 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:52:29.499460 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 21:52:29.499460 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi 2.5 Oct 04 21:52:29.499460 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:52:29.499460 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:52:29.499460 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:52:29.499460 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:52:29.499460 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:52:29.499460 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:52:29.499460 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:52:29.499460 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:52:29.499460 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:52:29.499460 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:52:29.499460 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:52:29.499460 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:52:29.499460 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 21:52:29.499460 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 21:52:29.505000 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 21:52:29.505000 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 21:52:29.505000 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 21:52:29.505000 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 21:52:29.505000 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 04 21:52:29.505000 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:52:29.505000 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:52:29.505000 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:52:29.505000 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:52:29.505000 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:52:29.505000 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:52:29.505000 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 21:52:29.505000 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 21:52:29.505000 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 04 21:52:29.505000 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:52:29.505000 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-4c671048-e9de-4936-adf6-c2c03ff6b907 tempest-MultipleCreateNegativeTestJSON-332148889 tempest-MultipleCreateNegativeTestJSON-332148889-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:52:29.511499 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-4c671048-e9de-4936-adf6-c2c03ff6b907 tempest-MultipleCreateNegativeTestJSON-332148889 tempest-MultipleCreateNegativeTestJSON-332148889-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.057796 Oct 04 21:52:29.515843 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell0:SELECT=18 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:52:29.529655 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1041/2140] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 21:52:29 2022] POST /compute/v2.1/servers => generated 139 bytes in 77 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 21:52:29.544993 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-b6d8c947-2cd3-4350-a0b7-8e72fcd0aa5d tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:29.549126 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-b6d8c947-2cd3-4350-a0b7-8e72fcd0aa5d tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 152003e4-2a7b-4801-8656-73093cd566ed] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:52:29.565805 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b6d8c947-2cd3-4350-a0b7-8e72fcd0aa5d tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:29.566342 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b6d8c947-2cd3-4350-a0b7-8e72fcd0aa5d tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:29.569309 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b6d8c947-2cd3-4350-a0b7-8e72fcd0aa5d tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:29.571792 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b6d8c947-2cd3-4350-a0b7-8e72fcd0aa5d tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:29.572411 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b6d8c947-2cd3-4350-a0b7-8e72fcd0aa5d tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:29.574122 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b6d8c947-2cd3-4350-a0b7-8e72fcd0aa5d tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:29.772142 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-3c7d280b-e0e7-41d4-b85a-78dca5a09aba tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa551b85109f42b299665382695c6b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c6e52760ea4396a95a3ffb7db2a9a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:29.785010 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-3c7d280b-e0e7-41d4-b85a-78dca5a09aba tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] 10.222.0.43 "GET /compute/v2.1/servers/a600603a-de4c-4991-8827-9fec3dead821" status: 200 len: 1528 microversion: 2.1 time: 0.451204 Oct 04 21:52:29.788158 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1100/2141] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:52:29 2022] GET /compute/v2.1/servers/a600603a-de4c-4991-8827-9fec3dead821 => generated 1528 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:52:29.800370 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-38ee5d95-bd43-4adb-9687-f745c8f45032 tempest-MultipleCreateNegativeTestJSON-332148889 tempest-MultipleCreateNegativeTestJSON-332148889-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1061600366", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452", "min_count": 0}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:52:29.805391 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-38ee5d95-bd43-4adb-9687-f745c8f45032 tempest-MultipleCreateNegativeTestJSON-332148889 tempest-MultipleCreateNegativeTestJSON-332148889-project] Request method failure captured: Oct 04 21:52:29.805391 n-d-860284-1 devstack@n-api.service[134102]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 21:52:29.805391 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 21:52:29.805391 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 21:52:29.805391 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 21:52:29.805391 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 168 Oct 04 21:52:29.805391 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 21:52:29.805391 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 21:52:29.805391 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 21:52:29.805391 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 21:52:29.805391 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPKsb9YTsCLl73rHZe9lpdZfGlDHaMNG2p6pgcud381E5yFVlCGP7cSFJ_dXQTrVaLxVeqHeCNGDUviym0kENq0DXZnQtkNzJlmhEjJcyPg2W6F4Rlm9iN3d-ufqbwgrTI1Ovw_Ibjiqj_Pb3ar9Vp0zMW9N7K6Om5cZwWmZHs0rYm3w Oct 04 21:52:29.805391 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 21:52:29.805391 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 21:52:29.805391 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 21:52:29.805391 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 21:52:29.805391 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 21:52:29.805391 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 21:52:29.805391 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: 9d857e796f7640c08653e2c6788ab865 Oct 04 21:52:29.805391 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-332148889 Oct 04 21:52:29.805391 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 21:52:29.805391 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 21:52:29.805391 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/9d857e796f7640c08653e2c6788ab865"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_9d857e796f7640c08653e2c6788ab865", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/9d857e796f7640c08653e2c6788ab865"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/9d857e796f7640c08653e2c6788ab865"}]}] Oct 04 21:52:29.805391 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-332148889 Oct 04 21:52:29.805391 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: 9d857e796f7640c08653e2c6788ab865 Oct 04 21:52:29.805391 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-332148889 Oct 04 21:52:29.805391 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-MultipleCreateNegativeTestJSON-332148889-project Oct 04 21:52:29.805391 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 21:52:29.805391 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 21:52:29.805391 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: 195f2bcfd678465c856695b911afd12e Oct 04 21:52:29.805391 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-332148889-project Oct 04 21:52:29.805391 n-d-860284-1 devstack@n-api.service[134102]: Oct 04 21:52:29.805391 n-d-860284-1 devstack@n-api.service[134102]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1061600366", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452", "min_count": 0}} Oct 04 21:52:29.805391 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 21:52:29.805391 n-d-860284-1 devstack@n-api.service[134102]: exception: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 04 21:52:29.805391 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1061600366', 'imageRef': '58548514-5dac-426c-81f5-19e3fba33e23', 'flavorRef': '452', 'min_count': 0}}} Oct 04 21:52:29.805391 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:52:29.805391 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:52:29.805391 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 21:52:29.805391 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 21:52:29.805391 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 21:52:29.805391 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise error Oct 04 21:52:29.805391 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 04 21:52:29.805391 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:52:29.805391 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['min_count']: Oct 04 21:52:29.805391 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 04 21:52:29.805391 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 04 21:52:29.805391 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 04 21:52:29.805391 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 04 21:52:29.805391 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:52:29.805391 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 21:52:29.805391 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi 0 Oct 04 21:52:29.805391 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:52:29.805391 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:52:29.805391 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:52:29.805391 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:52:29.805391 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:52:29.805391 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:52:29.805391 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:52:29.805391 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:52:29.805391 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:52:29.805391 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:52:29.805391 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:52:29.805391 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:52:29.805391 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 21:52:29.805391 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 21:52:29.813161 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 21:52:29.813161 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 21:52:29.813161 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 21:52:29.813161 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 21:52:29.813161 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 04 21:52:29.813161 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:52:29.813161 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:52:29.813161 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:52:29.813161 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:52:29.813161 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:52:29.813161 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:52:29.813161 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 21:52:29.813161 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 21:52:29.813161 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 04 21:52:29.813161 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:52:29.816435 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-38ee5d95-bd43-4adb-9687-f745c8f45032 tempest-MultipleCreateNegativeTestJSON-332148889 tempest-MultipleCreateNegativeTestJSON-332148889-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:52:29.817565 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-38ee5d95-bd43-4adb-9687-f745c8f45032 tempest-MultipleCreateNegativeTestJSON-332148889 tempest-MultipleCreateNegativeTestJSON-332148889-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.028128 Oct 04 21:52:29.818713 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1101/2142] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 21:52:29 2022] POST /compute/v2.1/servers => generated 130 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 21:52:29.884348 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-abbe0d8a-8d7d-411f-b73f-19645f09e89b tempest-MultipleCreateNegativeTestJSON-332148889 tempest-MultipleCreateNegativeTestJSON-332148889-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1089789265", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452", "min_count": 2.5}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:52:29.894094 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-abbe0d8a-8d7d-411f-b73f-19645f09e89b tempest-MultipleCreateNegativeTestJSON-332148889 tempest-MultipleCreateNegativeTestJSON-332148889-project] Request method failure captured: Oct 04 21:52:29.894094 n-d-860284-1 devstack@n-api.service[134102]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 21:52:29.894094 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 21:52:29.894094 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 21:52:29.894094 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 21:52:29.894094 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 170 Oct 04 21:52:29.894094 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 21:52:29.894094 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 21:52:29.894094 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 21:52:29.894094 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 21:52:29.894094 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPKsb9YTsCLl73rHZe9lpdZfGlDHaMNG2p6pgcud381E5yFVlCGP7cSFJ_dXQTrVaLxVeqHeCNGDUviym0kENq0DXZnQtkNzJlmhEjJcyPg2W6F4Rlm9iN3d-ufqbwgrTI1Ovw_Ibjiqj_Pb3ar9Vp0zMW9N7K6Om5cZwWmZHs0rYm3w Oct 04 21:52:29.894094 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 21:52:29.894094 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 21:52:29.894094 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 21:52:29.894094 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 21:52:29.894094 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 21:52:29.894094 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 21:52:29.894094 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: 9d857e796f7640c08653e2c6788ab865 Oct 04 21:52:29.894094 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-332148889 Oct 04 21:52:29.894094 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 21:52:29.894094 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 21:52:29.894094 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/9d857e796f7640c08653e2c6788ab865"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_9d857e796f7640c08653e2c6788ab865", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/9d857e796f7640c08653e2c6788ab865"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/9d857e796f7640c08653e2c6788ab865"}]}] Oct 04 21:52:29.894094 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-332148889 Oct 04 21:52:29.894094 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: 9d857e796f7640c08653e2c6788ab865 Oct 04 21:52:29.894094 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-332148889 Oct 04 21:52:29.894094 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-MultipleCreateNegativeTestJSON-332148889-project Oct 04 21:52:29.894094 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 21:52:29.894094 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 21:52:29.894094 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: 195f2bcfd678465c856695b911afd12e Oct 04 21:52:29.894094 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-332148889-project Oct 04 21:52:29.894094 n-d-860284-1 devstack@n-api.service[134102]: Oct 04 21:52:29.894094 n-d-860284-1 devstack@n-api.service[134102]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1089789265", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452", "min_count": 2.5}} Oct 04 21:52:29.894094 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 21:52:29.894094 n-d-860284-1 devstack@n-api.service[134102]: exception: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 04 21:52:29.894094 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1089789265', 'imageRef': '58548514-5dac-426c-81f5-19e3fba33e23', 'flavorRef': '452', 'min_count': 2.5}}} Oct 04 21:52:29.894094 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:52:29.894094 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:52:29.894094 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 21:52:29.894094 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 21:52:29.894094 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 21:52:29.894094 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise error Oct 04 21:52:29.894094 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Oct 04 21:52:29.894094 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:52:29.894094 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['min_count']: Oct 04 21:52:29.894094 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 04 21:52:29.894094 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 04 21:52:29.894094 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 04 21:52:29.894094 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 04 21:52:29.894094 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:52:29.894094 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 21:52:29.894094 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi 2.5 Oct 04 21:52:29.894094 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:52:29.894094 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:52:29.894094 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:52:29.894094 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:52:29.894094 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:52:29.894094 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:52:29.894094 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:52:29.894094 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:52:29.894094 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:52:29.894094 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:52:29.894094 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:52:29.894094 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:52:29.894094 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 21:52:29.894094 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 21:52:29.908063 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 21:52:29.908063 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 21:52:29.908063 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 21:52:29.908063 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 21:52:29.908063 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 04 21:52:29.908063 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:52:29.908063 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:52:29.908063 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:52:29.908063 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:52:29.908063 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:52:29.908063 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:52:29.908063 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 21:52:29.908063 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 21:52:29.908063 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 04 21:52:29.908063 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:52:29.909602 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-b6d8c947-2cd3-4350-a0b7-8e72fcd0aa5d tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ad048becf474fb972d4291422d810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dcfc7024fc49388c4bd5f25f03e60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:29.914569 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-abbe0d8a-8d7d-411f-b73f-19645f09e89b tempest-MultipleCreateNegativeTestJSON-332148889 tempest-MultipleCreateNegativeTestJSON-332148889-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:52:29.917860 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-abbe0d8a-8d7d-411f-b73f-19645f09e89b tempest-MultipleCreateNegativeTestJSON-332148889 tempest-MultipleCreateNegativeTestJSON-332148889-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.039588 Oct 04 21:52:29.919825 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1102/2143] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 21:52:29 2022] POST /compute/v2.1/servers => generated 139 bytes in 45 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 04 21:52:29.929589 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-b6d8c947-2cd3-4350-a0b7-8e72fcd0aa5d tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/152003e4-2a7b-4801-8656-73093cd566ed" status: 200 len: 1210 microversion: 2.1 time: 0.397334 Oct 04 21:52:29.932357 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1042/2144] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:52:29 2022] GET /compute/v2.1/servers/152003e4-2a7b-4801-8656-73093cd566ed => generated 1210 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:52:30.195033 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-7ca5c122-4173-4d81-ae11-a9063e452bb5 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:30.206005 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-7ca5c122-4173-4d81-ae11-a9063e452bb5 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b12f87ae29534b2c9171ee7b0dcab372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f529360dc1742a89d62a9fe42bc9848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:30.211154 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-7ca5c122-4173-4d81-ae11-a9063e452bb5 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Searching by: {'deleted': False, 'project_id': '0f529360dc1742a89d62a9fe42bc9848'} {{(pid=134102) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 21:52:30.232972 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7ca5c122-4173-4d81-ae11-a9063e452bb5 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:30.235733 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7ca5c122-4173-4d81-ae11-a9063e452bb5 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:30.236290 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7ca5c122-4173-4d81-ae11-a9063e452bb5 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:30.237345 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7ca5c122-4173-4d81-ae11-a9063e452bb5 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:30.239051 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7ca5c122-4173-4d81-ae11-a9063e452bb5 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:30.239567 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7ca5c122-4173-4d81-ae11-a9063e452bb5 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:30.242716 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-f154307e-7eb5-4171-8042-8953f0ab225c tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:30.244235 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-f154307e-7eb5-4171-8042-8953f0ab225c tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] [instance: b646f5b5-a266-44df-80e6-5d1b2a3b91d7] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:52:30.263619 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f154307e-7eb5-4171-8042-8953f0ab225c tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:30.266095 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f154307e-7eb5-4171-8042-8953f0ab225c tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:30.267370 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f154307e-7eb5-4171-8042-8953f0ab225c tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:30.270095 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f154307e-7eb5-4171-8042-8953f0ab225c tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:30.272922 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f154307e-7eb5-4171-8042-8953f0ab225c tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:30.273810 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f154307e-7eb5-4171-8042-8953f0ab225c tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:30.315425 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.multi_cell_list [None req-7ca5c122-4173-4d81-ae11-a9063e452bb5 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=134102) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 21:52:30.379020 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-7ca5c122-4173-4d81-ae11-a9063e452bb5 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] 10.222.0.43 "GET /compute/v2.1/servers" status: 200 len: 334 microversion: 2.1 time: 0.198900 Oct 04 21:52:30.383385 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1103/2145] 10.222.0.43 () {58 vars in 1125 bytes} [Tue Oct 4 21:52:30 2022] GET /compute/v2.1/servers => generated 334 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:52:30.392724 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-3d58db1f-2299-4808-988b-073df7e842ce tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Calling method '.version_select at 0x7fbb2e881af0>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:30.526485 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-3d58db1f-2299-4808-988b-073df7e842ce tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] 10.222.0.43 "GET /compute/v2.1/images/e62b2cc2-812b-4ec4-bba4-5703d4b65e48" status: 200 len: 1454 microversion: 2.1 time: 0.136275 Oct 04 21:52:30.527273 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1104/2146] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:52:30 2022] GET /compute/v2.1/images/e62b2cc2-812b-4ec4-bba4-5703d4b65e48 => generated 1454 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:52:30.544579 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-17074bdd-1d10-4ebb-be5e-da0e017ddede tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:30.546345 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-17074bdd-1d10-4ebb-be5e-da0e017ddede tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] [instance: 128b12e0-8fde-4113-95e9-0ecba563d8ec] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:52:30.559937 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-17074bdd-1d10-4ebb-be5e-da0e017ddede tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:30.561031 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-17074bdd-1d10-4ebb-be5e-da0e017ddede tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:30.562871 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-17074bdd-1d10-4ebb-be5e-da0e017ddede tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:30.566334 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-17074bdd-1d10-4ebb-be5e-da0e017ddede tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:30.567132 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-17074bdd-1d10-4ebb-be5e-da0e017ddede tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:30.567774 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-17074bdd-1d10-4ebb-be5e-da0e017ddede tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:30.589482 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-f154307e-7eb5-4171-8042-8953f0ab225c tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:30.599048 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-f154307e-7eb5-4171-8042-8953f0ab225c tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:30.600510 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-f154307e-7eb5-4171-8042-8953f0ab225c tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:30.611881 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-f154307e-7eb5-4171-8042-8953f0ab225c tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] 10.222.0.43 "GET /compute/v2.1/servers/b646f5b5-a266-44df-80e6-5d1b2a3b91d7" status: 200 len: 1487 microversion: 2.25 time: 0.374200 Oct 04 21:52:30.618754 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1043/2147] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:52:30 2022] GET /compute/v2.1/servers/b646f5b5-a266-44df-80e6-5d1b2a3b91d7 => generated 1487 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:52:30.629880 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-2d119513-3884-45df-b9ca-b371ac0a44d4 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:30.647434 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-2d119513-3884-45df-b9ca-b371ac0a44d4 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b12f87ae29534b2c9171ee7b0dcab372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f529360dc1742a89d62a9fe42bc9848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:30.676145 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-2d119513-3884-45df-b9ca-b371ac0a44d4 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Searching by: {'deleted': False, 'project_id': '0f529360dc1742a89d62a9fe42bc9848'} {{(pid=134101) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 21:52:30.696173 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2d119513-3884-45df-b9ca-b371ac0a44d4 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:30.696787 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2d119513-3884-45df-b9ca-b371ac0a44d4 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:30.703064 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2d119513-3884-45df-b9ca-b371ac0a44d4 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:30.711289 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2d119513-3884-45df-b9ca-b371ac0a44d4 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:30.714279 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2d119513-3884-45df-b9ca-b371ac0a44d4 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:30.715326 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2d119513-3884-45df-b9ca-b371ac0a44d4 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:30.787154 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.multi_cell_list [None req-2d119513-3884-45df-b9ca-b371ac0a44d4 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=134101) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 21:52:30.896152 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-17074bdd-1d10-4ebb-be5e-da0e017ddede tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921f934be12045b3ac0b2c6ed5101bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4335ce6fd64a0397fbfb13e1b255ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:30.906113 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-17074bdd-1d10-4ebb-be5e-da0e017ddede tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] 10.222.0.43 "GET /compute/v2.1/servers/128b12e0-8fde-4113-95e9-0ecba563d8ec" status: 200 len: 1368 microversion: 2.1 time: 0.375004 Oct 04 21:52:30.906735 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1105/2148] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:52:30 2022] GET /compute/v2.1/servers/128b12e0-8fde-4113-95e9-0ecba563d8ec => generated 1368 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:52:30.908279 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-2d119513-3884-45df-b9ca-b371ac0a44d4 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12f87ae29534b2c9171ee7b0dcab372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f529360dc1742a89d62a9fe42bc9848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:30.916808 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2d119513-3884-45df-b9ca-b371ac0a44d4 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:30.917536 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2d119513-3884-45df-b9ca-b371ac0a44d4 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:30.919124 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2d119513-3884-45df-b9ca-b371ac0a44d4 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:30.920136 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-eac86d87-5982-4b74-bf42-1a0355602cf4 tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:30.924630 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-eac86d87-5982-4b74-bf42-1a0355602cf4 tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] [instance: a600603a-de4c-4991-8827-9fec3dead821] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:52:30.936117 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-eac86d87-5982-4b74-bf42-1a0355602cf4 tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:30.936620 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-eac86d87-5982-4b74-bf42-1a0355602cf4 tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:30.937062 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-eac86d87-5982-4b74-bf42-1a0355602cf4 tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:30.937779 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-eac86d87-5982-4b74-bf42-1a0355602cf4 tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:30.938236 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-eac86d87-5982-4b74-bf42-1a0355602cf4 tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:30.938688 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-eac86d87-5982-4b74-bf42-1a0355602cf4 tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:31.260616 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-eac86d87-5982-4b74-bf42-1a0355602cf4 tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa551b85109f42b299665382695c6b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c6e52760ea4396a95a3ffb7db2a9a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:31.277104 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-eac86d87-5982-4b74-bf42-1a0355602cf4 tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] 10.222.0.43 "GET /compute/v2.1/servers/a600603a-de4c-4991-8827-9fec3dead821" status: 200 len: 1486 microversion: 2.1 time: 0.365667 Oct 04 21:52:31.282820 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1106/2149] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:52:30 2022] GET /compute/v2.1/servers/a600603a-de4c-4991-8827-9fec3dead821 => generated 1486 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:52:31.320978 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-0960714e-93b4-42d9-865b-619a692a7ce1 req-73bc9f9b-945d-4cb2-8483-d992587d9d17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "128b12e0-8fde-4113-95e9-0ecba563d8ec", "name": "network-vif-plugged", "status": "completed", "tag": "df2ad55d-ccdf-4548-8a65-744068b2ae9a"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:52:31.394697 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-0960714e-93b4-42d9-865b-619a692a7ce1 req-73bc9f9b-945d-4cb2-8483-d992587d9d17 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:31.395234 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-0960714e-93b4-42d9-865b-619a692a7ce1 req-73bc9f9b-945d-4cb2-8483-d992587d9d17 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:31.403298 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-0960714e-93b4-42d9-865b-619a692a7ce1 req-73bc9f9b-945d-4cb2-8483-d992587d9d17 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:31.423454 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-0960714e-93b4-42d9-865b-619a692a7ce1 req-73bc9f9b-945d-4cb2-8483-d992587d9d17 service nova] Creating event network-vif-plugged:df2ad55d-ccdf-4548-8a65-744068b2ae9a for instance 128b12e0-8fde-4113-95e9-0ecba563d8ec on n-h2-860284-1 Oct 04 21:52:31.444314 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-0960714e-93b4-42d9-865b-619a692a7ce1 req-73bc9f9b-945d-4cb2-8483-d992587d9d17 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.140051 Oct 04 21:52:31.446276 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1107/2150] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:52:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:52:31.463080 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-bf12a1df-4ace-4b81-8c5c-2f3e800e93e4 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:31.463284 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-2d119513-3884-45df-b9ca-b371ac0a44d4 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] 10.222.0.43 "GET /compute/v2.1/servers/detail" status: 200 len: 1696 microversion: 2.1 time: 0.843022 Oct 04 21:52:31.464125 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1044/2151] 10.222.0.43 () {58 vars in 1146 bytes} [Tue Oct 4 21:52:30 2022] GET /compute/v2.1/servers/detail => generated 1696 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:52:31.469933 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-bf12a1df-4ace-4b81-8c5c-2f3e800e93e4 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 152003e4-2a7b-4801-8656-73093cd566ed] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:52:31.483977 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bf12a1df-4ace-4b81-8c5c-2f3e800e93e4 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:31.487275 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bf12a1df-4ace-4b81-8c5c-2f3e800e93e4 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:31.487920 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bf12a1df-4ace-4b81-8c5c-2f3e800e93e4 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:31.488866 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bf12a1df-4ace-4b81-8c5c-2f3e800e93e4 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:31.490489 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bf12a1df-4ace-4b81-8c5c-2f3e800e93e4 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:31.502484 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-13cb0e34-f83c-4109-afd5-947aee1d9eb6 req-040c7c28-502a-4dc6-8c93-6d7597aebedf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a600603a-de4c-4991-8827-9fec3dead821", "name": "network-vif-deleted", "tag": "de912ec2-9e98-4a72-bf22-fce014c1fc6a"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:52:31.506329 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bf12a1df-4ace-4b81-8c5c-2f3e800e93e4 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:31.556251 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-13cb0e34-f83c-4109-afd5-947aee1d9eb6 req-040c7c28-502a-4dc6-8c93-6d7597aebedf service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:31.568253 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-13cb0e34-f83c-4109-afd5-947aee1d9eb6 req-040c7c28-502a-4dc6-8c93-6d7597aebedf service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:31.576372 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-13cb0e34-f83c-4109-afd5-947aee1d9eb6 req-040c7c28-502a-4dc6-8c93-6d7597aebedf service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:31.664106 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-13cb0e34-f83c-4109-afd5-947aee1d9eb6 req-040c7c28-502a-4dc6-8c93-6d7597aebedf service nova] Creating event network-vif-deleted:de912ec2-9e98-4a72-bf22-fce014c1fc6a for instance a600603a-de4c-4991-8827-9fec3dead821 on n-h1-860284-1 Oct 04 21:52:31.681157 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-13cb0e34-f83c-4109-afd5-947aee1d9eb6 req-040c7c28-502a-4dc6-8c93-6d7597aebedf service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.187603 Oct 04 21:52:31.685735 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1045/2152] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:52:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:52:31.719744 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-f165a73b-b102-4806-b016-2800ab0311a0 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:31.747712 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-f165a73b-b102-4806-b016-2800ab0311a0 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] 10.222.0.43 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.055647 Oct 04 21:52:31.754807 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1046/2153] 10.222.0.43 () {58 vars in 1137 bytes} [Tue Oct 4 21:52:31 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:52:31.766406 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-8d7206e5-8d29-4ddc-9a66-f312ece54677 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Calling method '.version_select at 0x7fbb2e6c0a60>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:31.897483 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-8d7206e5-8d29-4ddc-9a66-f312ece54677 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] 10.222.0.43 "GET /compute/v2.1/images/e62b2cc2-812b-4ec4-bba4-5703d4b65e48" status: 200 len: 1454 microversion: 2.1 time: 0.137866 Oct 04 21:52:31.914804 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1047/2154] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:52:31 2022] GET /compute/v2.1/images/e62b2cc2-812b-4ec4-bba4-5703d4b65e48 => generated 1454 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:52:31.977113 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-48da7894-f2ad-41fd-bdb1-d94644984ae2 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:31.983155 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-48da7894-f2ad-41fd-bdb1-d94644984ae2 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] [instance: b646f5b5-a266-44df-80e6-5d1b2a3b91d7] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:52:32.081980 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-48da7894-f2ad-41fd-bdb1-d94644984ae2 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:32.081980 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-48da7894-f2ad-41fd-bdb1-d94644984ae2 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:32.081980 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-48da7894-f2ad-41fd-bdb1-d94644984ae2 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:32.081980 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-48da7894-f2ad-41fd-bdb1-d94644984ae2 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:32.081980 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-48da7894-f2ad-41fd-bdb1-d94644984ae2 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:32.081980 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-48da7894-f2ad-41fd-bdb1-d94644984ae2 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:33.036901 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-48da7894-f2ad-41fd-bdb1-d94644984ae2 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:33.052252 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-48da7894-f2ad-41fd-bdb1-d94644984ae2 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:33.056703 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-48da7894-f2ad-41fd-bdb1-d94644984ae2 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:33.059811 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-48da7894-f2ad-41fd-bdb1-d94644984ae2 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] 10.222.0.43 "GET /compute/v2.1/servers/b646f5b5-a266-44df-80e6-5d1b2a3b91d7" status: 200 len: 1487 microversion: 2.25 time: 1.139883 Oct 04 21:52:33.060659 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1048/2155] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:52:31 2022] GET /compute/v2.1/servers/b646f5b5-a266-44df-80e6-5d1b2a3b91d7 => generated 1487 bytes in 1145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:52:33.078767 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-14219457-e189-4971-b1e6-366659ebae60 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:33.079947 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-14219457-e189-4971-b1e6-366659ebae60 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] [instance: 128b12e0-8fde-4113-95e9-0ecba563d8ec] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:52:33.094825 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-14219457-e189-4971-b1e6-366659ebae60 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:33.097828 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-14219457-e189-4971-b1e6-366659ebae60 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:33.098611 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-14219457-e189-4971-b1e6-366659ebae60 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:33.099577 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-14219457-e189-4971-b1e6-366659ebae60 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:33.101446 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-14219457-e189-4971-b1e6-366659ebae60 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:33.103040 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-14219457-e189-4971-b1e6-366659ebae60 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:33.151137 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-bf12a1df-4ace-4b81-8c5c-2f3e800e93e4 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ad048becf474fb972d4291422d810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dcfc7024fc49388c4bd5f25f03e60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:33.166537 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-bf12a1df-4ace-4b81-8c5c-2f3e800e93e4 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/152003e4-2a7b-4801-8656-73093cd566ed" status: 200 len: 1210 microversion: 2.1 time: 1.713383 Oct 04 21:52:33.167699 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1108/2156] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:52:31 2022] GET /compute/v2.1/servers/152003e4-2a7b-4801-8656-73093cd566ed => generated 1210 bytes in 1721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:52:33.187907 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-14177803-2131-4486-a8e5-759685a27451 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:33.188797 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-14177803-2131-4486-a8e5-759685a27451 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] [instance: 4709e5d7-52a3-4a79-8835-d651dce0c34a] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:52:33.217665 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-14177803-2131-4486-a8e5-759685a27451 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:33.218452 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-14177803-2131-4486-a8e5-759685a27451 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:33.219095 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-14177803-2131-4486-a8e5-759685a27451 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:33.219991 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-14177803-2131-4486-a8e5-759685a27451 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:33.220596 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-14177803-2131-4486-a8e5-759685a27451 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:33.221171 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-14177803-2131-4486-a8e5-759685a27451 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:33.230081 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=100 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:52:33.289724 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-14177803-2131-4486-a8e5-759685a27451 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] [instance: 4709e5d7-52a3-4a79-8835-d651dce0c34a] Going to try to terminate instance {{(pid=134102) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:52:33.424426 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-14219457-e189-4971-b1e6-366659ebae60 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921f934be12045b3ac0b2c6ed5101bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4335ce6fd64a0397fbfb13e1b255ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:33.437758 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-14219457-e189-4971-b1e6-366659ebae60 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] 10.222.0.43 "GET /compute/v2.1/servers/128b12e0-8fde-4113-95e9-0ecba563d8ec" status: 200 len: 1368 microversion: 2.1 time: 0.371881 Oct 04 21:52:33.439136 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1049/2157] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:52:33 2022] GET /compute/v2.1/servers/128b12e0-8fde-4113-95e9-0ecba563d8ec => generated 1368 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:52:33.459946 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-4aded849-ea73-48f2-866c-7669c3be393d tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:33.460976 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-4aded849-ea73-48f2-866c-7669c3be393d tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] [instance: a600603a-de4c-4991-8827-9fec3dead821] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:52:33.468650 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4aded849-ea73-48f2-866c-7669c3be393d tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:33.469163 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4aded849-ea73-48f2-866c-7669c3be393d tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:33.469665 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4aded849-ea73-48f2-866c-7669c3be393d tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:33.470412 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4aded849-ea73-48f2-866c-7669c3be393d tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:33.470880 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4aded849-ea73-48f2-866c-7669c3be393d tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:33.471466 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4aded849-ea73-48f2-866c-7669c3be393d tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:33.486770 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-14177803-2131-4486-a8e5-759685a27451 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] 10.222.0.43 "DELETE /compute/v2.1/servers/4709e5d7-52a3-4a79-8835-d651dce0c34a" status: 204 len: 0 microversion: 2.1 time: 0.315091 Oct 04 21:52:33.488753 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1109/2158] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 21:52:33 2022] DELETE /compute/v2.1/servers/4709e5d7-52a3-4a79-8835-d651dce0c34a => generated 0 bytes in 318 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:52:33.495435 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-594e439e-75e1-4cde-92e4-fbd9843bb6a4 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Calling method '.version_select at 0x7fbb2ea03a60>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:33.497101 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-4aded849-ea73-48f2-866c-7669c3be393d tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] HTTP exception thrown: Instance a600603a-de4c-4991-8827-9fec3dead821 could not be found. Oct 04 21:52:33.499474 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-4aded849-ea73-48f2-866c-7669c3be393d tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] Request method failure captured: Oct 04 21:52:33.499474 n-d-860284-1 devstack@n-api.service[134101]: request: GET /compute/v2.1/servers/a600603a-de4c-4991-8827-9fec3dead821 HTTP/1.1 Oct 04 21:52:33.499474 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 21:52:33.499474 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 21:52:33.499474 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 21:52:33.499474 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 21:52:33.499474 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 21:52:33.499474 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 21:52:33.499474 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 21:52:33.499474 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 21:52:33.499474 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPKrskVE9HROTEQossGsXoRvBzbz7S6RmzoWkV9fXxGJJy86VfD-4Fan6lZA_6XfenfVM2wCnY734cuSKt91aSb0AocrH7jVRrNNEW5TDaJgCwrFSLOGW0qBZBDMhz7n5G5Jsfc_Bd8jBl3cgu6D3UVgXT_xO67sR5xO0iijYeuiGJm8 Oct 04 21:52:33.499474 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 21:52:33.499474 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 21:52:33.499474 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 21:52:33.499474 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 21:52:33.499474 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 21:52:33.499474 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 21:52:33.499474 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: 71c6e52760ea4396a95a3ffb7db2a9a3 Oct 04 21:52:33.499474 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1836254795 Oct 04 21:52:33.499474 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 21:52:33.499474 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 21:52:33.499474 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/71c6e52760ea4396a95a3ffb7db2a9a3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_71c6e52760ea4396a95a3ffb7db2a9a3", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/71c6e52760ea4396a95a3ffb7db2a9a3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/71c6e52760ea4396a95a3ffb7db2a9a3"}]}] Oct 04 21:52:33.499474 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1836254795 Oct 04 21:52:33.499474 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: 71c6e52760ea4396a95a3ffb7db2a9a3 Oct 04 21:52:33.499474 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1836254795 Oct 04 21:52:33.499474 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-InstanceActionsNegativeTestJSON-1836254795-project Oct 04 21:52:33.499474 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 21:52:33.499474 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 21:52:33.499474 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: fa551b85109f42b299665382695c6b17 Oct 04 21:52:33.499474 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1836254795-project Oct 04 21:52:33.499474 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 21:52:33.499474 n-d-860284-1 devstack@n-api.service[134101]: exception: Instance a600603a-de4c-4991-8827-9fec3dead821 could not be found. Oct 04 21:52:33.499474 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': 'a600603a-de4c-4991-8827-9fec3dead821'} Oct 04 21:52:33.499474 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:52:33.499474 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:52:33.499474 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:52:33.499474 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:52:33.499474 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:52:33.499474 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:52:33.499474 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:52:33.499474 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:52:33.499474 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:52:33.499474 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:52:33.499474 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a600603a-de4c-4991-8827-9fec3dead821 could not be found. Oct 04 21:52:33.499474 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:52:33.499474 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:52:33.499474 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:52:33.499474 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:52:33.499474 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:52:33.499474 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:52:33.499474 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:52:33.499474 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:52:33.499474 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:52:33.499474 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:52:33.499474 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:52:33.499474 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:52:33.499474 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:52:33.499474 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:52:33.499474 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:52:33.499474 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:52:33.499474 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a600603a-de4c-4991-8827-9fec3dead821 could not be found. Oct 04 21:52:33.499474 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:52:33.499474 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:52:33.502465 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:52:33.502465 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:52:33.502465 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:52:33.502465 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:52:33.502465 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:52:33.502465 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:52:33.502465 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a600603a-de4c-4991-8827-9fec3dead821 could not be found. Oct 04 21:52:33.502465 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:52:33.502465 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-4aded849-ea73-48f2-866c-7669c3be393d tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] Returning 404 to user: Instance a600603a-de4c-4991-8827-9fec3dead821 could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:52:33.502465 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-4aded849-ea73-48f2-866c-7669c3be393d tempest-InstanceActionsNegativeTestJSON-1836254795 tempest-InstanceActionsNegativeTestJSON-1836254795-project] 10.222.0.43 "GET /compute/v2.1/servers/a600603a-de4c-4991-8827-9fec3dead821" status: 404 len: 111 microversion: 2.1 time: 0.060433 Oct 04 21:52:33.502465 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1050/2159] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:52:33 2022] GET /compute/v2.1/servers/a600603a-de4c-4991-8827-9fec3dead821 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:52:33.507840 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-467e2c00-7e92-4522-af5e-0bdb1339f173 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:33.508795 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-467e2c00-7e92-4522-af5e-0bdb1339f173 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] [instance: 4709e5d7-52a3-4a79-8835-d651dce0c34a] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:52:33.515998 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-467e2c00-7e92-4522-af5e-0bdb1339f173 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:33.516783 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-467e2c00-7e92-4522-af5e-0bdb1339f173 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:33.517473 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-467e2c00-7e92-4522-af5e-0bdb1339f173 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:33.518328 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-467e2c00-7e92-4522-af5e-0bdb1339f173 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:33.519227 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-467e2c00-7e92-4522-af5e-0bdb1339f173 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:33.519807 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-467e2c00-7e92-4522-af5e-0bdb1339f173 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:33.620430 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-594e439e-75e1-4cde-92e4-fbd9843bb6a4 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] 10.222.0.43 "GET /compute/v2.1/images/e62b2cc2-812b-4ec4-bba4-5703d4b65e48" status: 200 len: 1463 microversion: 2.1 time: 0.123394 Oct 04 21:52:33.622794 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1110/2160] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:52:33 2022] GET /compute/v2.1/images/e62b2cc2-812b-4ec4-bba4-5703d4b65e48 => generated 1463 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:52:33.638501 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-8123a359-6b33-47f7-8696-08715307d3d4 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Calling method '.version_select at 0x7fbb2e8844c0>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:33.730298 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-8123a359-6b33-47f7-8696-08715307d3d4 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] 10.222.0.43 "GET /compute/v2.1/images/e62b2cc2-812b-4ec4-bba4-5703d4b65e48" status: 200 len: 1463 microversion: 2.1 time: 0.096199 Oct 04 21:52:33.734671 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1111/2161] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:52:33 2022] GET /compute/v2.1/images/e62b2cc2-812b-4ec4-bba4-5703d4b65e48 => generated 1463 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:52:33.752455 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-3a14f536-c642-47dd-a167-6585e36272da tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:33.753883 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-3a14f536-c642-47dd-a167-6585e36272da tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] [instance: 6f8a46c4-3b6f-4f50-8227-77b69154fb57] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:52:33.776809 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3a14f536-c642-47dd-a167-6585e36272da tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:33.778854 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3a14f536-c642-47dd-a167-6585e36272da tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:33.779524 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3a14f536-c642-47dd-a167-6585e36272da tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:33.780752 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3a14f536-c642-47dd-a167-6585e36272da tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:33.781806 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3a14f536-c642-47dd-a167-6585e36272da tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:33.784049 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3a14f536-c642-47dd-a167-6585e36272da tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:34.431846 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-467e2c00-7e92-4522-af5e-0bdb1339f173 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12f87ae29534b2c9171ee7b0dcab372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f529360dc1742a89d62a9fe42bc9848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:34.457946 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-467e2c00-7e92-4522-af5e-0bdb1339f173 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] 10.222.0.43 "GET /compute/v2.1/servers/4709e5d7-52a3-4a79-8835-d651dce0c34a" status: 200 len: 1699 microversion: 2.1 time: 0.951621 Oct 04 21:52:34.462322 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1051/2162] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:52:33 2022] GET /compute/v2.1/servers/4709e5d7-52a3-4a79-8835-d651dce0c34a => generated 1699 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:52:34.501658 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-9f5484f6-3cbf-44aa-9839-77fe00a72c02 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:34.503492 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-9f5484f6-3cbf-44aa-9839-77fe00a72c02 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] [instance: b646f5b5-a266-44df-80e6-5d1b2a3b91d7] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:52:34.510906 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-3a14f536-c642-47dd-a167-6585e36272da tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f11c77afc74a16bea945dd84e72ebe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94d03be22238422eba835ed522baf9c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:34.532265 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-3a14f536-c642-47dd-a167-6585e36272da tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] 10.222.0.43 "GET /compute/v2.1/servers/6f8a46c4-3b6f-4f50-8227-77b69154fb57" status: 200 len: 1467 microversion: 2.1 time: 0.784736 Oct 04 21:52:34.535866 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1112/2163] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:52:33 2022] GET /compute/v2.1/servers/6f8a46c4-3b6f-4f50-8227-77b69154fb57 => generated 1467 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:52:34.538654 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9f5484f6-3cbf-44aa-9839-77fe00a72c02 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:34.539903 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9f5484f6-3cbf-44aa-9839-77fe00a72c02 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:34.542107 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9f5484f6-3cbf-44aa-9839-77fe00a72c02 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:34.544083 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9f5484f6-3cbf-44aa-9839-77fe00a72c02 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:34.551648 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9f5484f6-3cbf-44aa-9839-77fe00a72c02 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:34.555067 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-73e92c76-01a5-43f5-a2fe-6ca0679cdff1 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:34.555869 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9f5484f6-3cbf-44aa-9839-77fe00a72c02 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:34.561338 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-73e92c76-01a5-43f5-a2fe-6ca0679cdff1 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 152003e4-2a7b-4801-8656-73093cd566ed] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:52:34.586563 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-73e92c76-01a5-43f5-a2fe-6ca0679cdff1 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:34.594611 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-73e92c76-01a5-43f5-a2fe-6ca0679cdff1 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:34.595960 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-73e92c76-01a5-43f5-a2fe-6ca0679cdff1 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:34.599309 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-73e92c76-01a5-43f5-a2fe-6ca0679cdff1 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:34.600129 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-73e92c76-01a5-43f5-a2fe-6ca0679cdff1 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:34.601710 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-73e92c76-01a5-43f5-a2fe-6ca0679cdff1 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:35.191917 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-9f5484f6-3cbf-44aa-9839-77fe00a72c02 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:35.206891 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-9f5484f6-3cbf-44aa-9839-77fe00a72c02 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:35.211544 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-9f5484f6-3cbf-44aa-9839-77fe00a72c02 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:35.213772 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-9f5484f6-3cbf-44aa-9839-77fe00a72c02 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] 10.222.0.43 "GET /compute/v2.1/servers/b646f5b5-a266-44df-80e6-5d1b2a3b91d7" status: 200 len: 1487 microversion: 2.25 time: 0.727990 Oct 04 21:52:35.216125 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1052/2164] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:52:34 2022] GET /compute/v2.1/servers/b646f5b5-a266-44df-80e6-5d1b2a3b91d7 => generated 1487 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:52:35.231634 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-6fd055ee-ac5b-48b2-be0b-6bcac36b9c9d tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:35.247824 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-6fd055ee-ac5b-48b2-be0b-6bcac36b9c9d tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] [instance: 128b12e0-8fde-4113-95e9-0ecba563d8ec] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:52:35.255829 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6fd055ee-ac5b-48b2-be0b-6bcac36b9c9d tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:35.256374 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6fd055ee-ac5b-48b2-be0b-6bcac36b9c9d tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:35.256899 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6fd055ee-ac5b-48b2-be0b-6bcac36b9c9d tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:35.258270 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6fd055ee-ac5b-48b2-be0b-6bcac36b9c9d tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:35.258786 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6fd055ee-ac5b-48b2-be0b-6bcac36b9c9d tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:35.259229 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6fd055ee-ac5b-48b2-be0b-6bcac36b9c9d tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:35.275474 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-73e92c76-01a5-43f5-a2fe-6ca0679cdff1 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ad048becf474fb972d4291422d810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dcfc7024fc49388c4bd5f25f03e60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:35.288516 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-73e92c76-01a5-43f5-a2fe-6ca0679cdff1 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/152003e4-2a7b-4801-8656-73093cd566ed" status: 200 len: 1210 microversion: 2.1 time: 0.747275 Oct 04 21:52:35.290925 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1113/2165] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:52:34 2022] GET /compute/v2.1/servers/152003e4-2a7b-4801-8656-73093cd566ed => generated 1210 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:52:35.301512 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-edf0e4df-f602-42ce-b71f-30e9c564be18 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-714843375"}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:52:35.306091 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-edf0e4df-f602-42ce-b71f-30e9c564be18 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] [instance: 7d0ed6d0-981a-48a7-a676-5910b1257301] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:52:35.322768 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-edf0e4df-f602-42ce-b71f-30e9c564be18 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:35.323457 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-edf0e4df-f602-42ce-b71f-30e9c564be18 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:35.324854 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-edf0e4df-f602-42ce-b71f-30e9c564be18 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:35.325833 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-edf0e4df-f602-42ce-b71f-30e9c564be18 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:35.326407 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-edf0e4df-f602-42ce-b71f-30e9c564be18 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:35.327111 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-edf0e4df-f602-42ce-b71f-30e9c564be18 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:35.531245 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-6fd055ee-ac5b-48b2-be0b-6bcac36b9c9d tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921f934be12045b3ac0b2c6ed5101bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4335ce6fd64a0397fbfb13e1b255ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:35.560714 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-6fd055ee-ac5b-48b2-be0b-6bcac36b9c9d tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] 10.222.0.43 "GET /compute/v2.1/servers/128b12e0-8fde-4113-95e9-0ecba563d8ec" status: 200 len: 1368 microversion: 2.1 time: 0.337352 Oct 04 21:52:35.563298 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1053/2166] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:52:35 2022] GET /compute/v2.1/servers/128b12e0-8fde-4113-95e9-0ecba563d8ec => generated 1368 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:52:35.572702 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-1c5eb25f-2156-47ab-9ef3-8e1007177f4f tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Action: 'create', calling method: .version_select at 0x7fbb2e6030d0>, body: {"keypair": {"name": "tempest-keypair-1876914950", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIbHzPcl07H3lDbFuDGH5aW8JWCFJEa9T+lHxpT0yQykZq5TLOkFKqUWLpXtGxp6ZYaN8rL0ULtaUnKvUvxJgSo+wmG7pQwDtVEtNbYj+oJwuteu0zm66qP2+ZFZVt3paQ=="}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:52:35.630746 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-1c5eb25f-2156-47ab-9ef3-8e1007177f4f tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Getting quotas for project 2dd1e35c3cb643e3ad2afbe7edbbce8d. Resources: {'key_pairs'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:52:35.642885 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-1c5eb25f-2156-47ab-9ef3-8e1007177f4f tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Getting quotas for user 2bb934f4dc53470d8e35d71cccd756d9 and project 2dd1e35c3cb643e3ad2afbe7edbbce8d. Resources: {'key_pairs'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:52:35.682735 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-1c5eb25f-2156-47ab-9ef3-8e1007177f4f tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.42 time: 0.116910 Oct 04 21:52:35.692268 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1054/2167] 10.222.0.43 () {62 vars in 1200 bytes} [Tue Oct 4 21:52:35 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 128 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 04 21:52:35.702421 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-bca48262-eb7f-41ac-9f56-19a77b897f05 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:35.703500 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-bca48262-eb7f-41ac-9f56-19a77b897f05 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] [instance: 4709e5d7-52a3-4a79-8835-d651dce0c34a] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:52:35.724017 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-edf0e4df-f602-42ce-b71f-30e9c564be18 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] 10.222.0.43 "POST /compute/v2.1/servers/7d0ed6d0-981a-48a7-a676-5910b1257301/action" status: 202 len: 0 microversion: 2.1 time: 0.427301 Oct 04 21:52:35.726054 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1114/2168] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 21:52:35 2022] POST /compute/v2.1/servers/7d0ed6d0-981a-48a7-a676-5910b1257301/action => generated 0 bytes in 434 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 04 21:52:35.727506 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bca48262-eb7f-41ac-9f56-19a77b897f05 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:35.727993 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bca48262-eb7f-41ac-9f56-19a77b897f05 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:35.728436 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bca48262-eb7f-41ac-9f56-19a77b897f05 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:35.734239 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bca48262-eb7f-41ac-9f56-19a77b897f05 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:35.735106 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bca48262-eb7f-41ac-9f56-19a77b897f05 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:35.735701 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bca48262-eb7f-41ac-9f56-19a77b897f05 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:35.739319 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-bf49737d-8cfb-42c1-9f60-674685de489f tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Calling method '.version_select at 0x7fbb2ea7a820>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:35.819792 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-bf49737d-8cfb-42c1-9f60-674685de489f tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] 10.222.0.43 "GET /compute/v2.1/images/147c04e5-7d17-4421-8f9d-3336bdcbaf2e" status: 200 len: 1454 microversion: 2.1 time: 0.081817 Oct 04 21:52:35.820494 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1115/2169] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:52:35 2022] GET /compute/v2.1/images/147c04e5-7d17-4421-8f9d-3336bdcbaf2e => generated 1454 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:52:36.196930 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-5acedfae-19bb-4be7-ad94-cb633af737e5 req-2174655f-1efd-460b-8a05-d1288ac89684 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4709e5d7-52a3-4a79-8835-d651dce0c34a", "name": "network-vif-unplugged", "status": "completed", "tag": "bacddb90-9e3c-4a64-91f2-f0a88b83fec1"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:52:36.222540 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-5acedfae-19bb-4be7-ad94-cb633af737e5 req-2174655f-1efd-460b-8a05-d1288ac89684 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:36.223368 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-5acedfae-19bb-4be7-ad94-cb633af737e5 req-2174655f-1efd-460b-8a05-d1288ac89684 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:36.224224 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-5acedfae-19bb-4be7-ad94-cb633af737e5 req-2174655f-1efd-460b-8a05-d1288ac89684 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:36.244248 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-5acedfae-19bb-4be7-ad94-cb633af737e5 req-2174655f-1efd-460b-8a05-d1288ac89684 service nova] Creating event network-vif-unplugged:bacddb90-9e3c-4a64-91f2-f0a88b83fec1 for instance 4709e5d7-52a3-4a79-8835-d651dce0c34a on n-h2-860284-1 Oct 04 21:52:36.251515 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-5acedfae-19bb-4be7-ad94-cb633af737e5 req-2174655f-1efd-460b-8a05-d1288ac89684 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.059092 Oct 04 21:52:36.252942 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1116/2170] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:52:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:52:36.263564 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-c9653e2e-258b-40dd-9c6a-0abffd5e5bf9 req-30e039ee-55ab-458f-9124-470e6011c28f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b646f5b5-a266-44df-80e6-5d1b2a3b91d7", "name": "network-vif-unplugged", "status": "completed", "tag": "433775b7-13ed-49fa-86e4-2e7c2fe9e176"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:52:36.279350 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-c9653e2e-258b-40dd-9c6a-0abffd5e5bf9 req-30e039ee-55ab-458f-9124-470e6011c28f service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:36.280232 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-c9653e2e-258b-40dd-9c6a-0abffd5e5bf9 req-30e039ee-55ab-458f-9124-470e6011c28f service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:36.280909 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-c9653e2e-258b-40dd-9c6a-0abffd5e5bf9 req-30e039ee-55ab-458f-9124-470e6011c28f service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:36.298292 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-c9653e2e-258b-40dd-9c6a-0abffd5e5bf9 req-30e039ee-55ab-458f-9124-470e6011c28f service nova] Creating event network-vif-unplugged:433775b7-13ed-49fa-86e4-2e7c2fe9e176 for instance b646f5b5-a266-44df-80e6-5d1b2a3b91d7 on n-h1-860284-1 Oct 04 21:52:36.306208 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-c9653e2e-258b-40dd-9c6a-0abffd5e5bf9 req-30e039ee-55ab-458f-9124-470e6011c28f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.051516 Oct 04 21:52:36.313716 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1117/2171] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:52:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:52:36.331071 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-693b2b39-97c2-4b18-86b8-3f04dd9b265c tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:36.331973 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-693b2b39-97c2-4b18-86b8-3f04dd9b265c tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] [instance: b646f5b5-a266-44df-80e6-5d1b2a3b91d7] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:52:36.342300 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-693b2b39-97c2-4b18-86b8-3f04dd9b265c tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:36.343369 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-693b2b39-97c2-4b18-86b8-3f04dd9b265c tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:36.344425 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-693b2b39-97c2-4b18-86b8-3f04dd9b265c tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:36.347064 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-693b2b39-97c2-4b18-86b8-3f04dd9b265c tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:36.347751 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-693b2b39-97c2-4b18-86b8-3f04dd9b265c tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:36.348637 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-693b2b39-97c2-4b18-86b8-3f04dd9b265c tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:36.607198 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-bca48262-eb7f-41ac-9f56-19a77b897f05 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12f87ae29534b2c9171ee7b0dcab372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f529360dc1742a89d62a9fe42bc9848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:36.626134 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-bca48262-eb7f-41ac-9f56-19a77b897f05 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] 10.222.0.43 "GET /compute/v2.1/servers/4709e5d7-52a3-4a79-8835-d651dce0c34a" status: 200 len: 1699 microversion: 2.1 time: 0.930483 Oct 04 21:52:36.626779 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1055/2172] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:52:35 2022] GET /compute/v2.1/servers/4709e5d7-52a3-4a79-8835-d651dce0c34a => generated 1699 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:52:36.672150 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-a7eae940-ac10-4ffc-a0de-a28d0cdcece1 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:36.674820 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-a7eae940-ac10-4ffc-a0de-a28d0cdcece1 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 152003e4-2a7b-4801-8656-73093cd566ed] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:52:36.692448 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a7eae940-ac10-4ffc-a0de-a28d0cdcece1 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:36.693501 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a7eae940-ac10-4ffc-a0de-a28d0cdcece1 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:36.694184 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a7eae940-ac10-4ffc-a0de-a28d0cdcece1 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:36.695730 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a7eae940-ac10-4ffc-a0de-a28d0cdcece1 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:36.696432 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a7eae940-ac10-4ffc-a0de-a28d0cdcece1 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:36.697088 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a7eae940-ac10-4ffc-a0de-a28d0cdcece1 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:37.072588 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-693b2b39-97c2-4b18-86b8-3f04dd9b265c tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:37.087162 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-693b2b39-97c2-4b18-86b8-3f04dd9b265c tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:37.089031 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-693b2b39-97c2-4b18-86b8-3f04dd9b265c tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:37.096363 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-693b2b39-97c2-4b18-86b8-3f04dd9b265c tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] 10.222.0.43 "GET /compute/v2.1/servers/b646f5b5-a266-44df-80e6-5d1b2a3b91d7" status: 200 len: 1487 microversion: 2.25 time: 0.780694 Oct 04 21:52:37.097072 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1118/2173] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:52:36 2022] GET /compute/v2.1/servers/b646f5b5-a266-44df-80e6-5d1b2a3b91d7 => generated 1487 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:52:37.122116 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-bc1477b0-43fd-4c97-af49-ccc282bb7ffb tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:37.122905 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-bc1477b0-43fd-4c97-af49-ccc282bb7ffb tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] [instance: 128b12e0-8fde-4113-95e9-0ecba563d8ec] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:52:37.132765 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bc1477b0-43fd-4c97-af49-ccc282bb7ffb tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:37.134206 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bc1477b0-43fd-4c97-af49-ccc282bb7ffb tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:37.134874 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bc1477b0-43fd-4c97-af49-ccc282bb7ffb tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:37.135755 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bc1477b0-43fd-4c97-af49-ccc282bb7ffb tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:37.137504 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bc1477b0-43fd-4c97-af49-ccc282bb7ffb tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:37.138227 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bc1477b0-43fd-4c97-af49-ccc282bb7ffb tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:37.486307 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-a7eae940-ac10-4ffc-a0de-a28d0cdcece1 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ad048becf474fb972d4291422d810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dcfc7024fc49388c4bd5f25f03e60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:37.531739 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-a7eae940-ac10-4ffc-a0de-a28d0cdcece1 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/152003e4-2a7b-4801-8656-73093cd566ed" status: 200 len: 1198 microversion: 2.1 time: 0.890452 Oct 04 21:52:37.534259 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1056/2174] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:52:36 2022] GET /compute/v2.1/servers/152003e4-2a7b-4801-8656-73093cd566ed => generated 1198 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:52:37.545602 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-75c8b9ce-997e-471b-8cb6-6e0f303e2013 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Calling method '.version_select at 0x7fbb2e603a60>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:37.614911 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-75c8b9ce-997e-471b-8cb6-6e0f303e2013 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] 10.222.0.43 "GET /compute/v2.1/images/147c04e5-7d17-4421-8f9d-3336bdcbaf2e" status: 200 len: 1454 microversion: 2.1 time: 0.079284 Oct 04 21:52:37.617173 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1057/2175] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:52:37 2022] GET /compute/v2.1/images/147c04e5-7d17-4421-8f9d-3336bdcbaf2e => generated 1454 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:52:37.656573 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-85840f79-7c4a-4cc7-ada4-94c43ba96888 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:37.658098 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-85840f79-7c4a-4cc7-ada4-94c43ba96888 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] [instance: 4709e5d7-52a3-4a79-8835-d651dce0c34a] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:52:37.665594 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-85840f79-7c4a-4cc7-ada4-94c43ba96888 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:37.667519 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-85840f79-7c4a-4cc7-ada4-94c43ba96888 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:37.669375 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-85840f79-7c4a-4cc7-ada4-94c43ba96888 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:37.670388 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-85840f79-7c4a-4cc7-ada4-94c43ba96888 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:37.671013 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-85840f79-7c4a-4cc7-ada4-94c43ba96888 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:37.671598 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-85840f79-7c4a-4cc7-ada4-94c43ba96888 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:38.068577 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-bc1477b0-43fd-4c97-af49-ccc282bb7ffb tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921f934be12045b3ac0b2c6ed5101bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4335ce6fd64a0397fbfb13e1b255ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:38.079261 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-bc1477b0-43fd-4c97-af49-ccc282bb7ffb tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] 10.222.0.43 "GET /compute/v2.1/servers/128b12e0-8fde-4113-95e9-0ecba563d8ec" status: 200 len: 1559 microversion: 2.1 time: 0.961454 Oct 04 21:52:38.086346 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1119/2176] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:52:37 2022] GET /compute/v2.1/servers/128b12e0-8fde-4113-95e9-0ecba563d8ec => generated 1559 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:52:38.111521 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-b6ca2507-d146-4c99-8461-cb48598789f7 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:38.111753 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-b6ca2507-d146-4c99-8461-cb48598789f7 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] [instance: 128b12e0-8fde-4113-95e9-0ecba563d8ec] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:52:38.135976 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b6ca2507-d146-4c99-8461-cb48598789f7 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:38.137029 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b6ca2507-d146-4c99-8461-cb48598789f7 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:38.139074 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b6ca2507-d146-4c99-8461-cb48598789f7 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:38.139987 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b6ca2507-d146-4c99-8461-cb48598789f7 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:38.144135 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b6ca2507-d146-4c99-8461-cb48598789f7 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:38.147280 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b6ca2507-d146-4c99-8461-cb48598789f7 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:38.355976 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-b6ca2507-d146-4c99-8461-cb48598789f7 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] 10.222.0.43 "GET /compute/v2.1/servers/128b12e0-8fde-4113-95e9-0ecba563d8ec/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.248141 Oct 04 21:52:38.357230 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1120/2177] 10.222.0.43 () {58 vars in 1275 bytes} [Tue Oct 4 21:52:38 2022] GET /compute/v2.1/servers/128b12e0-8fde-4113-95e9-0ecba563d8ec/os-interface => generated 285 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:52:38.362242 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-ce1760fc-860a-4130-a454-97c943f6a49d tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:38.363078 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-ce1760fc-860a-4130-a454-97c943f6a49d tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] [instance: b646f5b5-a266-44df-80e6-5d1b2a3b91d7] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:52:38.363369 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-85840f79-7c4a-4cc7-ada4-94c43ba96888 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12f87ae29534b2c9171ee7b0dcab372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f529360dc1742a89d62a9fe42bc9848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:38.370298 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ce1760fc-860a-4130-a454-97c943f6a49d tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:38.370825 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ce1760fc-860a-4130-a454-97c943f6a49d tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:38.371356 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ce1760fc-860a-4130-a454-97c943f6a49d tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:38.372067 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ce1760fc-860a-4130-a454-97c943f6a49d tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:38.372679 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ce1760fc-860a-4130-a454-97c943f6a49d tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:38.373101 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ce1760fc-860a-4130-a454-97c943f6a49d tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:38.379080 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-85840f79-7c4a-4cc7-ada4-94c43ba96888 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] 10.222.0.43 "GET /compute/v2.1/servers/4709e5d7-52a3-4a79-8835-d651dce0c34a" status: 200 len: 1699 microversion: 2.1 time: 0.727490 Oct 04 21:52:38.394391 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1058/2178] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:52:37 2022] GET /compute/v2.1/servers/4709e5d7-52a3-4a79-8835-d651dce0c34a => generated 1699 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:52:38.398548 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-a243da10-cf50-455f-adb8-515a0d46c9e9 req-112eef31-2f4f-40f2-a5a0-859a7777ea3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f8a46c4-3b6f-4f50-8227-77b69154fb57", "name": "network-vif-unplugged", "status": "completed", "tag": "0b8186cd-d9f4-408f-9942-a8fcb3a46521"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:52:38.411725 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-a243da10-cf50-455f-adb8-515a0d46c9e9 req-112eef31-2f4f-40f2-a5a0-859a7777ea3d service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:38.423376 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-a243da10-cf50-455f-adb8-515a0d46c9e9 req-112eef31-2f4f-40f2-a5a0-859a7777ea3d service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:38.423820 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-a243da10-cf50-455f-adb8-515a0d46c9e9 req-112eef31-2f4f-40f2-a5a0-859a7777ea3d service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:38.437025 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-a243da10-cf50-455f-adb8-515a0d46c9e9 req-112eef31-2f4f-40f2-a5a0-859a7777ea3d service nova] Creating event network-vif-unplugged:0b8186cd-d9f4-408f-9942-a8fcb3a46521 for instance 6f8a46c4-3b6f-4f50-8227-77b69154fb57 on n-h2-860284-1 Oct 04 21:52:38.447520 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-a243da10-cf50-455f-adb8-515a0d46c9e9 req-112eef31-2f4f-40f2-a5a0-859a7777ea3d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.065520 Oct 04 21:52:38.452108 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1059/2179] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:52:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:52:38.464591 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-dc393d28-6a3b-42a2-8740-ce5996630c23 req-c9075460-a773-4dc7-b406-2762d5bf49f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b646f5b5-a266-44df-80e6-5d1b2a3b91d7", "tag": "433775b7-13ed-49fa-86e4-2e7c2fe9e176"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:52:38.496323 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-dc393d28-6a3b-42a2-8740-ce5996630c23 req-c9075460-a773-4dc7-b406-2762d5bf49f1 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:38.497302 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-dc393d28-6a3b-42a2-8740-ce5996630c23 req-c9075460-a773-4dc7-b406-2762d5bf49f1 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:38.498630 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-dc393d28-6a3b-42a2-8740-ce5996630c23 req-c9075460-a773-4dc7-b406-2762d5bf49f1 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:38.517736 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-dc393d28-6a3b-42a2-8740-ce5996630c23 req-c9075460-a773-4dc7-b406-2762d5bf49f1 service nova] Creating event network-changed:433775b7-13ed-49fa-86e4-2e7c2fe9e176 for instance b646f5b5-a266-44df-80e6-5d1b2a3b91d7 on n-h1-860284-1 Oct 04 21:52:38.525303 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-dc393d28-6a3b-42a2-8740-ce5996630c23 req-c9075460-a773-4dc7-b406-2762d5bf49f1 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069899 Oct 04 21:52:38.527642 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1060/2180] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:52:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:52:38.568252 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-9dc826e5-4460-4f90-b4ac-e6f4004e6bf2 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:38.570469 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-9dc826e5-4460-4f90-b4ac-e6f4004e6bf2 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 152003e4-2a7b-4801-8656-73093cd566ed] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:52:38.584579 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9dc826e5-4460-4f90-b4ac-e6f4004e6bf2 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:38.585995 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9dc826e5-4460-4f90-b4ac-e6f4004e6bf2 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:38.587882 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9dc826e5-4460-4f90-b4ac-e6f4004e6bf2 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:38.591567 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9dc826e5-4460-4f90-b4ac-e6f4004e6bf2 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:38.592415 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9dc826e5-4460-4f90-b4ac-e6f4004e6bf2 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:38.593267 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9dc826e5-4460-4f90-b4ac-e6f4004e6bf2 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:39.005975 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-ce1760fc-860a-4130-a454-97c943f6a49d tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:39.016509 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-ce1760fc-860a-4130-a454-97c943f6a49d tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:39.018959 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-ce1760fc-860a-4130-a454-97c943f6a49d tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:39.020458 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-ce1760fc-860a-4130-a454-97c943f6a49d tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] 10.222.0.43 "GET /compute/v2.1/servers/b646f5b5-a266-44df-80e6-5d1b2a3b91d7" status: 200 len: 1487 microversion: 2.25 time: 0.661759 Oct 04 21:52:39.021512 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1121/2181] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:52:38 2022] GET /compute/v2.1/servers/b646f5b5-a266-44df-80e6-5d1b2a3b91d7 => generated 1487 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:52:39.028787 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-36da742d-1c4d-400f-a065-37d7e1244dd4 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Calling method '.version_select at 0x7fbb372f5a60>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:39.085298 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-36da742d-1c4d-400f-a065-37d7e1244dd4 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] 10.222.0.43 "GET /compute/v2.1/images/147c04e5-7d17-4421-8f9d-3336bdcbaf2e" status: 200 len: 1454 microversion: 2.1 time: 0.062276 Oct 04 21:52:39.087495 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1122/2182] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:52:39 2022] GET /compute/v2.1/images/147c04e5-7d17-4421-8f9d-3336bdcbaf2e => generated 1454 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:52:39.162053 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-9dc826e5-4460-4f90-b4ac-e6f4004e6bf2 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ad048becf474fb972d4291422d810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dcfc7024fc49388c4bd5f25f03e60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:39.179471 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-9dc826e5-4460-4f90-b4ac-e6f4004e6bf2 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/152003e4-2a7b-4801-8656-73093cd566ed" status: 200 len: 1198 microversion: 2.1 time: 0.623797 Oct 04 21:52:39.183265 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1061/2183] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:52:38 2022] GET /compute/v2.1/servers/152003e4-2a7b-4801-8656-73093cd566ed => generated 1198 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:52:39.412062 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-aa465546-361a-4a12-a753-3754f6793b92 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:39.418605 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-aa465546-361a-4a12-a753-3754f6793b92 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] [instance: 4709e5d7-52a3-4a79-8835-d651dce0c34a] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:52:39.440517 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-aa465546-361a-4a12-a753-3754f6793b92 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:39.442107 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-aa465546-361a-4a12-a753-3754f6793b92 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:39.446018 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-aa465546-361a-4a12-a753-3754f6793b92 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:39.447009 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-aa465546-361a-4a12-a753-3754f6793b92 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:39.447643 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-aa465546-361a-4a12-a753-3754f6793b92 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:39.448233 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-aa465546-361a-4a12-a753-3754f6793b92 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:39.646867 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-aa465546-361a-4a12-a753-3754f6793b92 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12f87ae29534b2c9171ee7b0dcab372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f529360dc1742a89d62a9fe42bc9848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:39.656839 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-aa465546-361a-4a12-a753-3754f6793b92 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] 10.222.0.43 "GET /compute/v2.1/servers/4709e5d7-52a3-4a79-8835-d651dce0c34a" status: 200 len: 1632 microversion: 2.1 time: 0.249789 Oct 04 21:52:39.657440 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1123/2184] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:52:39 2022] GET /compute/v2.1/servers/4709e5d7-52a3-4a79-8835-d651dce0c34a => generated 1632 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:52:40.053838 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-59f202b8-8d6a-41f1-9a3a-e9f422414527 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:40.055010 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-59f202b8-8d6a-41f1-9a3a-e9f422414527 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] [instance: b646f5b5-a266-44df-80e6-5d1b2a3b91d7] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:52:40.063388 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-59f202b8-8d6a-41f1-9a3a-e9f422414527 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:40.064097 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-59f202b8-8d6a-41f1-9a3a-e9f422414527 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:40.066954 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-59f202b8-8d6a-41f1-9a3a-e9f422414527 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:40.067889 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-59f202b8-8d6a-41f1-9a3a-e9f422414527 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:40.068359 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-59f202b8-8d6a-41f1-9a3a-e9f422414527 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:40.068975 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-59f202b8-8d6a-41f1-9a3a-e9f422414527 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:40.113670 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-a2bfe61b-183f-4fd4-8a98-3d131bf7b2d4 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Calling method '.version_select at 0x7fbb37257ca0>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:40.195615 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-a2bfe61b-183f-4fd4-8a98-3d131bf7b2d4 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] 10.222.0.43 "GET /compute/v2.1/images/147c04e5-7d17-4421-8f9d-3336bdcbaf2e" status: 200 len: 1454 microversion: 2.1 time: 0.094921 Oct 04 21:52:40.205507 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1124/2185] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:52:40 2022] GET /compute/v2.1/images/147c04e5-7d17-4421-8f9d-3336bdcbaf2e => generated 1454 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:52:40.219741 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-8c27fa8d-1e7b-4a22-a31a-aa2f5dfe6f02 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:40.220669 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-8c27fa8d-1e7b-4a22-a31a-aa2f5dfe6f02 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 152003e4-2a7b-4801-8656-73093cd566ed] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:52:40.230164 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8c27fa8d-1e7b-4a22-a31a-aa2f5dfe6f02 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:40.231089 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8c27fa8d-1e7b-4a22-a31a-aa2f5dfe6f02 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:40.231850 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8c27fa8d-1e7b-4a22-a31a-aa2f5dfe6f02 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:40.232817 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8c27fa8d-1e7b-4a22-a31a-aa2f5dfe6f02 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:40.233502 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8c27fa8d-1e7b-4a22-a31a-aa2f5dfe6f02 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:40.234334 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8c27fa8d-1e7b-4a22-a31a-aa2f5dfe6f02 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:40.270986 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell0:SELECT=2 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:52:40.736121 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=2 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:52:41.148835 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-59f202b8-8d6a-41f1-9a3a-e9f422414527 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:41.163760 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-59f202b8-8d6a-41f1-9a3a-e9f422414527 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:41.165630 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-59f202b8-8d6a-41f1-9a3a-e9f422414527 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:41.167249 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-59f202b8-8d6a-41f1-9a3a-e9f422414527 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] 10.222.0.43 "GET /compute/v2.1/servers/b646f5b5-a266-44df-80e6-5d1b2a3b91d7" status: 200 len: 1487 microversion: 2.25 time: 1.117368 Oct 04 21:52:41.168449 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1062/2186] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:52:40 2022] GET /compute/v2.1/servers/b646f5b5-a266-44df-80e6-5d1b2a3b91d7 => generated 1487 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:52:41.174581 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-3b830bed-1402-44df-876e-92bf267b3477 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-330928429", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "ea45b1d8-5802-47c1-b8eb-0bd048ba9d6f"}, {"port": "655956e8-ae26-4dcc-9d3e-b8894103890e", "tag": "port-1"}, {"port": "adbb4038-b82a-4af8-902c-9694d969d663", "tag": "port-2"}, {"uuid": "66c6d4b2-b6d2-4443-9a03-c9be6f963765", "tag": "net-1"}, {"uuid": "66c6d4b2-b6d2-4443-9a03-c9be6f963765"}, {"uuid": "3d685b18-6763-41cd-a045-23bf25ecf76b", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "3d685b18-6763-41cd-a045-23bf25ecf76b", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "675c4d6b-3f44-47bd-897f-a97d4c640bd9", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "82071b78-631e-44f1-a241-0fe10a62c190", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "a4ec8bb1-5b16-4f4e-bc60-a4358d7e2bd7", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--401828367"}], "key_name": "tempest-keypair-1876914950", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:52:41.498832 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-8c27fa8d-1e7b-4a22-a31a-aa2f5dfe6f02 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ad048becf474fb972d4291422d810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dcfc7024fc49388c4bd5f25f03e60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:41.526930 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-8c27fa8d-1e7b-4a22-a31a-aa2f5dfe6f02 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/152003e4-2a7b-4801-8656-73093cd566ed" status: 200 len: 1198 microversion: 2.1 time: 1.311394 Oct 04 21:52:41.549423 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1125/2187] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:52:40 2022] GET /compute/v2.1/servers/152003e4-2a7b-4801-8656-73093cd566ed => generated 1198 bytes in 1337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:52:41.561546 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-35eae373-7ca5-4a36-8dbb-fbff463fd6c5 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:41.565083 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-35eae373-7ca5-4a36-8dbb-fbff463fd6c5 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] [instance: 4709e5d7-52a3-4a79-8835-d651dce0c34a] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:52:41.581710 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-35eae373-7ca5-4a36-8dbb-fbff463fd6c5 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:41.584416 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-35eae373-7ca5-4a36-8dbb-fbff463fd6c5 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:41.585125 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-35eae373-7ca5-4a36-8dbb-fbff463fd6c5 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:41.587633 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-35eae373-7ca5-4a36-8dbb-fbff463fd6c5 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:41.589108 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-35eae373-7ca5-4a36-8dbb-fbff463fd6c5 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:41.589848 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-35eae373-7ca5-4a36-8dbb-fbff463fd6c5 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:41.844501 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.network.neutron [None req-3b830bed-1402-44df-876e-92bf267b3477 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] validate_networks() for [('ea45b1d8-5802-47c1-b8eb-0bd048ba9d6f', None, None, None, None, None), (None, None, '655956e8-ae26-4dcc-9d3e-b8894103890e', None, None, None), (None, None, 'adbb4038-b82a-4af8-902c-9694d969d663', None, None, None), ('66c6d4b2-b6d2-4443-9a03-c9be6f963765', None, None, None, None, None), ('66c6d4b2-b6d2-4443-9a03-c9be6f963765', None, None, None, None, None), ('3d685b18-6763-41cd-a045-23bf25ecf76b', '10.2.2.100', None, None, None, None), ('3d685b18-6763-41cd-a045-23bf25ecf76b', '10.2.2.200', None, None, None, None)] {{(pid=134101) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:52:41.854989 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-35eae373-7ca5-4a36-8dbb-fbff463fd6c5 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12f87ae29534b2c9171ee7b0dcab372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f529360dc1742a89d62a9fe42bc9848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:41.867751 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-35eae373-7ca5-4a36-8dbb-fbff463fd6c5 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] 10.222.0.43 "GET /compute/v2.1/servers/4709e5d7-52a3-4a79-8835-d651dce0c34a" status: 200 len: 1354 microversion: 2.1 time: 0.316844 Oct 04 21:52:41.872652 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1126/2188] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:52:41 2022] GET /compute/v2.1/servers/4709e5d7-52a3-4a79-8835-d651dce0c34a => generated 1354 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:52:41.887962 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-829be525-29fb-4340-b7f4-5c2450dfa195 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Calling method '.version_select at 0x7fbb2f185940>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:42.005777 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-829be525-29fb-4340-b7f4-5c2450dfa195 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] 10.222.0.43 "GET /compute/v2.1/images/147c04e5-7d17-4421-8f9d-3336bdcbaf2e" status: 200 len: 1454 microversion: 2.1 time: 0.125334 Oct 04 21:52:42.006801 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1127/2189] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:52:41 2022] GET /compute/v2.1/images/147c04e5-7d17-4421-8f9d-3336bdcbaf2e => generated 1454 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:52:42.023685 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-50ceceb7-fcf6-4eb5-86d3-01308b94f6ed req-27b1bad4-acc5-4032-8dcf-880765eeba8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4709e5d7-52a3-4a79-8835-d651dce0c34a", "name": "network-vif-deleted", "tag": "bacddb90-9e3c-4a64-91f2-f0a88b83fec1"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:52:42.073238 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-50ceceb7-fcf6-4eb5-86d3-01308b94f6ed req-27b1bad4-acc5-4032-8dcf-880765eeba8d service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:42.074630 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-50ceceb7-fcf6-4eb5-86d3-01308b94f6ed req-27b1bad4-acc5-4032-8dcf-880765eeba8d service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:42.077969 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-50ceceb7-fcf6-4eb5-86d3-01308b94f6ed req-27b1bad4-acc5-4032-8dcf-880765eeba8d service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:42.108090 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-50ceceb7-fcf6-4eb5-86d3-01308b94f6ed req-27b1bad4-acc5-4032-8dcf-880765eeba8d service nova] Creating event network-vif-deleted:bacddb90-9e3c-4a64-91f2-f0a88b83fec1 for instance 4709e5d7-52a3-4a79-8835-d651dce0c34a on n-h2-860284-1 Oct 04 21:52:42.165386 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-50ceceb7-fcf6-4eb5-86d3-01308b94f6ed req-27b1bad4-acc5-4032-8dcf-880765eeba8d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.152733 Oct 04 21:52:42.169762 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1128/2190] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:52:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:52:42.205679 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-be785082-ecd0-46b1-9248-13b4b79b6ca6 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:42.209538 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-be785082-ecd0-46b1-9248-13b4b79b6ca6 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] [instance: b646f5b5-a266-44df-80e6-5d1b2a3b91d7] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:52:42.225653 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-be785082-ecd0-46b1-9248-13b4b79b6ca6 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:42.230160 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-be785082-ecd0-46b1-9248-13b4b79b6ca6 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:42.230979 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-be785082-ecd0-46b1-9248-13b4b79b6ca6 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:42.232414 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-be785082-ecd0-46b1-9248-13b4b79b6ca6 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:42.235236 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-be785082-ecd0-46b1-9248-13b4b79b6ca6 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:42.236371 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-be785082-ecd0-46b1-9248-13b4b79b6ca6 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:42.882957 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-be785082-ecd0-46b1-9248-13b4b79b6ca6 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:42.902220 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-be785082-ecd0-46b1-9248-13b4b79b6ca6 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:42.905135 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-be785082-ecd0-46b1-9248-13b4b79b6ca6 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:42.906695 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-be785082-ecd0-46b1-9248-13b4b79b6ca6 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] 10.222.0.43 "GET /compute/v2.1/servers/b646f5b5-a266-44df-80e6-5d1b2a3b91d7" status: 200 len: 1487 microversion: 2.25 time: 0.708127 Oct 04 21:52:42.911325 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1129/2191] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:52:42 2022] GET /compute/v2.1/servers/b646f5b5-a266-44df-80e6-5d1b2a3b91d7 => generated 1487 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:52:42.924856 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-3a4e4e0c-4cef-43cc-bca9-193cae8297b9 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:42.926136 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-3a4e4e0c-4cef-43cc-bca9-193cae8297b9 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 152003e4-2a7b-4801-8656-73093cd566ed] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:52:42.946563 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3a4e4e0c-4cef-43cc-bca9-193cae8297b9 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:42.955872 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3a4e4e0c-4cef-43cc-bca9-193cae8297b9 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:42.956556 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3a4e4e0c-4cef-43cc-bca9-193cae8297b9 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:42.958949 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3a4e4e0c-4cef-43cc-bca9-193cae8297b9 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:42.966255 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3a4e4e0c-4cef-43cc-bca9-193cae8297b9 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:42.967047 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3a4e4e0c-4cef-43cc-bca9-193cae8297b9 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:43.529775 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-3a4e4e0c-4cef-43cc-bca9-193cae8297b9 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ad048becf474fb972d4291422d810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dcfc7024fc49388c4bd5f25f03e60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:43.546746 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-3a4e4e0c-4cef-43cc-bca9-193cae8297b9 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/152003e4-2a7b-4801-8656-73093cd566ed" status: 200 len: 1198 microversion: 2.1 time: 0.631309 Oct 04 21:52:43.551872 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1130/2192] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:52:42 2022] GET /compute/v2.1/servers/152003e4-2a7b-4801-8656-73093cd566ed => generated 1198 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:52:43.568628 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-0ee0504a-eae9-4438-a9ce-7626f40cef35 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:43.571141 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-0ee0504a-eae9-4438-a9ce-7626f40cef35 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] [instance: 4709e5d7-52a3-4a79-8835-d651dce0c34a] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:52:43.603651 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0ee0504a-eae9-4438-a9ce-7626f40cef35 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:43.604188 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0ee0504a-eae9-4438-a9ce-7626f40cef35 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:43.604635 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0ee0504a-eae9-4438-a9ce-7626f40cef35 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:43.606130 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0ee0504a-eae9-4438-a9ce-7626f40cef35 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:43.606775 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0ee0504a-eae9-4438-a9ce-7626f40cef35 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:43.607213 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0ee0504a-eae9-4438-a9ce-7626f40cef35 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:43.624604 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:52:43.643586 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-0ee0504a-eae9-4438-a9ce-7626f40cef35 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] HTTP exception thrown: Instance 4709e5d7-52a3-4a79-8835-d651dce0c34a could not be found. Oct 04 21:52:43.651143 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-0ee0504a-eae9-4438-a9ce-7626f40cef35 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Request method failure captured: Oct 04 21:52:43.651143 n-d-860284-1 devstack@n-api.service[134102]: request: GET /compute/v2.1/servers/4709e5d7-52a3-4a79-8835-d651dce0c34a HTTP/1.1 Oct 04 21:52:43.651143 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 21:52:43.651143 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 21:52:43.651143 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 21:52:43.651143 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 21:52:43.651143 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 21:52:43.651143 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 21:52:43.651143 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 21:52:43.651143 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 21:52:43.651143 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPKqvHrdlItpivE7fZ5qWOqfDZfd-IH2GUxAScU9mfaMcUjOB-n805HE34N7uAY8-7Ca75Tn1gOrQubFsAZdyOdrJVpx1Hs5loi0dgVDgquCIZOyIc_J-v2xMtBixXf79IW12RFevbqkhupnYLrXUzAg9PswZobWJjFRnvmpXTDFZJvI Oct 04 21:52:43.651143 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 21:52:43.651143 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 21:52:43.651143 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 21:52:43.651143 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 21:52:43.651143 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 21:52:43.651143 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 21:52:43.651143 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: 0f529360dc1742a89d62a9fe42bc9848 Oct 04 21:52:43.651143 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-ServersTestJSON-2101377906 Oct 04 21:52:43.651143 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 21:52:43.651143 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 21:52:43.651143 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0f529360dc1742a89d62a9fe42bc9848"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_0f529360dc1742a89d62a9fe42bc9848", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0f529360dc1742a89d62a9fe42bc9848"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/0f529360dc1742a89d62a9fe42bc9848"}]}] Oct 04 21:52:43.651143 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-ServersTestJSON-2101377906 Oct 04 21:52:43.651143 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: 0f529360dc1742a89d62a9fe42bc9848 Oct 04 21:52:43.651143 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-ServersTestJSON-2101377906 Oct 04 21:52:43.651143 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-ServersTestJSON-2101377906-project Oct 04 21:52:43.651143 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 21:52:43.651143 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 21:52:43.651143 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: b12f87ae29534b2c9171ee7b0dcab372 Oct 04 21:52:43.651143 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-ServersTestJSON-2101377906-project Oct 04 21:52:43.651143 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 21:52:43.651143 n-d-860284-1 devstack@n-api.service[134102]: exception: Instance 4709e5d7-52a3-4a79-8835-d651dce0c34a could not be found. Oct 04 21:52:43.651143 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': '4709e5d7-52a3-4a79-8835-d651dce0c34a'} Oct 04 21:52:43.651143 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:52:43.651143 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:52:43.651143 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:52:43.651143 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:52:43.651143 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:52:43.651143 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:52:43.651143 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:52:43.651143 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:52:43.651143 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:52:43.651143 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:52:43.651143 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4709e5d7-52a3-4a79-8835-d651dce0c34a could not be found. Oct 04 21:52:43.651143 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:52:43.651143 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:52:43.651143 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:52:43.651143 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:52:43.651143 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:52:43.651143 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:52:43.651143 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:52:43.651143 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:52:43.651143 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:52:43.651143 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:52:43.651143 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:52:43.651143 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:52:43.651143 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:52:43.651143 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:52:43.651143 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:52:43.651143 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:52:43.651143 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4709e5d7-52a3-4a79-8835-d651dce0c34a could not be found. Oct 04 21:52:43.651143 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:52:43.651143 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:52:43.651143 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:52:43.655500 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:52:43.655500 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:52:43.655500 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:52:43.655500 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:52:43.655500 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:52:43.655500 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4709e5d7-52a3-4a79-8835-d651dce0c34a could not be found. Oct 04 21:52:43.655500 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:52:43.658110 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-0ee0504a-eae9-4438-a9ce-7626f40cef35 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Returning 404 to user: Instance 4709e5d7-52a3-4a79-8835-d651dce0c34a could not be found. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:52:43.660567 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-0ee0504a-eae9-4438-a9ce-7626f40cef35 tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] 10.222.0.43 "GET /compute/v2.1/servers/4709e5d7-52a3-4a79-8835-d651dce0c34a" status: 404 len: 111 microversion: 2.1 time: 0.107304 Oct 04 21:52:43.662295 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1131/2193] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:52:43 2022] GET /compute/v2.1/servers/4709e5d7-52a3-4a79-8835-d651dce0c34a => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:52:43.672183 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-43925141-9b19-4bca-bdf8-da91ca0b2e35 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Calling method '.version_select at 0x7fbb2e9b4790>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:43.752510 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-43925141-9b19-4bca-bdf8-da91ca0b2e35 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] 10.222.0.43 "GET /compute/v2.1/images/147c04e5-7d17-4421-8f9d-3336bdcbaf2e" status: 200 len: 1454 microversion: 2.1 time: 0.088295 Oct 04 21:52:43.763594 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1132/2194] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:52:43 2022] GET /compute/v2.1/images/147c04e5-7d17-4421-8f9d-3336bdcbaf2e => generated 1454 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:52:43.770154 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-0e444bc4-c4a2-4067-ac82-d8dada36a52c tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] Calling method '.version_select at 0x7fbb2ea50ee0>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:43.815814 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-0e444bc4-c4a2-4067-ac82-d8dada36a52c tempest-ServersTestJSON-2101377906 tempest-ServersTestJSON-2101377906-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-830493452" status: 202 len: 0 microversion: 2.1 time: 0.050412 Oct 04 21:52:43.816493 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1133/2195] 10.222.0.43 () {58 vars in 1218 bytes} [Tue Oct 4 21:52:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-830493452 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:52:43.941929 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-2e029b72-50ca-49b7-934a-bbbf64a1e396 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:43.942626 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-2e029b72-50ca-49b7-934a-bbbf64a1e396 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] [instance: b646f5b5-a266-44df-80e6-5d1b2a3b91d7] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:52:43.957237 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2e029b72-50ca-49b7-934a-bbbf64a1e396 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:43.959768 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2e029b72-50ca-49b7-934a-bbbf64a1e396 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:43.960239 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2e029b72-50ca-49b7-934a-bbbf64a1e396 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:43.961010 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2e029b72-50ca-49b7-934a-bbbf64a1e396 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:43.961481 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2e029b72-50ca-49b7-934a-bbbf64a1e396 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:43.961921 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2e029b72-50ca-49b7-934a-bbbf64a1e396 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:44.380106 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-2e029b72-50ca-49b7-934a-bbbf64a1e396 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:44.392194 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-2e029b72-50ca-49b7-934a-bbbf64a1e396 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:44.394943 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-2e029b72-50ca-49b7-934a-bbbf64a1e396 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:44.396452 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-2e029b72-50ca-49b7-934a-bbbf64a1e396 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] 10.222.0.43 "GET /compute/v2.1/servers/b646f5b5-a266-44df-80e6-5d1b2a3b91d7" status: 200 len: 1487 microversion: 2.25 time: 0.458834 Oct 04 21:52:44.419853 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1134/2196] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:52:43 2022] GET /compute/v2.1/servers/b646f5b5-a266-44df-80e6-5d1b2a3b91d7 => generated 1487 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:52:44.429683 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-cc5fe5e8-24cb-444c-ab24-47e6d8875504 req-4c5e844f-8b16-48d6-83fb-6c3bdf10a049 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "128b12e0-8fde-4113-95e9-0ecba563d8ec", "tag": "df2ad55d-ccdf-4548-8a65-744068b2ae9a"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:52:44.449585 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-cc5fe5e8-24cb-444c-ab24-47e6d8875504 req-4c5e844f-8b16-48d6-83fb-6c3bdf10a049 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:44.450504 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-cc5fe5e8-24cb-444c-ab24-47e6d8875504 req-4c5e844f-8b16-48d6-83fb-6c3bdf10a049 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:44.454529 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-cc5fe5e8-24cb-444c-ab24-47e6d8875504 req-4c5e844f-8b16-48d6-83fb-6c3bdf10a049 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:44.478105 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-cc5fe5e8-24cb-444c-ab24-47e6d8875504 req-4c5e844f-8b16-48d6-83fb-6c3bdf10a049 service nova] Creating event network-changed:df2ad55d-ccdf-4548-8a65-744068b2ae9a for instance 128b12e0-8fde-4113-95e9-0ecba563d8ec on n-h2-860284-1 Oct 04 21:52:44.485683 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-cc5fe5e8-24cb-444c-ab24-47e6d8875504 req-4c5e844f-8b16-48d6-83fb-6c3bdf10a049 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060109 Oct 04 21:52:44.486668 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1135/2197] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:52:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:52:44.577325 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-948b1bc0-1001-4dbb-946c-a816e6d9a38b tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:44.578293 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-948b1bc0-1001-4dbb-946c-a816e6d9a38b tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 152003e4-2a7b-4801-8656-73093cd566ed] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:52:44.597200 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-948b1bc0-1001-4dbb-946c-a816e6d9a38b tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:44.602841 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-948b1bc0-1001-4dbb-946c-a816e6d9a38b tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:44.603329 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-948b1bc0-1001-4dbb-946c-a816e6d9a38b tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:44.604675 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-948b1bc0-1001-4dbb-946c-a816e6d9a38b tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:44.607416 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-948b1bc0-1001-4dbb-946c-a816e6d9a38b tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:44.610027 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-948b1bc0-1001-4dbb-946c-a816e6d9a38b tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:45.033734 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-948b1bc0-1001-4dbb-946c-a816e6d9a38b tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ad048becf474fb972d4291422d810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dcfc7024fc49388c4bd5f25f03e60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:45.052067 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-948b1bc0-1001-4dbb-946c-a816e6d9a38b tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/152003e4-2a7b-4801-8656-73093cd566ed" status: 200 len: 1198 microversion: 2.1 time: 0.481181 Oct 04 21:52:45.055506 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1136/2198] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:52:44 2022] GET /compute/v2.1/servers/152003e4-2a7b-4801-8656-73093cd566ed => generated 1198 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:52:45.067478 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-387f59d2-a7e8-43ba-a2a0-ad6b86ab6489 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Calling method '.version_select at 0x7fbb2e9b4940>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:45.199954 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-387f59d2-a7e8-43ba-a2a0-ad6b86ab6489 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] 10.222.0.43 "GET /compute/v2.1/images/147c04e5-7d17-4421-8f9d-3336bdcbaf2e" status: 200 len: 1454 microversion: 2.1 time: 0.141727 Oct 04 21:52:45.202964 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1137/2199] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:52:45 2022] GET /compute/v2.1/images/147c04e5-7d17-4421-8f9d-3336bdcbaf2e => generated 1454 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:52:45.205789 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-387f59d2-a7e8-43ba-a2a0-ad6b86ab6489 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:45.207200 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-387f59d2-a7e8-43ba-a2a0-ad6b86ab6489 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] 10.222.0.43 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001931 Oct 04 21:52:45.207738 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1138/2200] 10.222.0.43 () {56 vars in 886 bytes} [Tue Oct 4 21:52:45 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 04 21:52:45.426349 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-e3d7a8a8-9652-4ca0-8c4d-01df3a94e33f tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:45.426992 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-e3d7a8a8-9652-4ca0-8c4d-01df3a94e33f tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] [instance: b646f5b5-a266-44df-80e6-5d1b2a3b91d7] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:52:45.437039 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e3d7a8a8-9652-4ca0-8c4d-01df3a94e33f tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:45.437534 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e3d7a8a8-9652-4ca0-8c4d-01df3a94e33f tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:45.437974 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e3d7a8a8-9652-4ca0-8c4d-01df3a94e33f tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:45.448155 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e3d7a8a8-9652-4ca0-8c4d-01df3a94e33f tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:45.450611 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e3d7a8a8-9652-4ca0-8c4d-01df3a94e33f tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:45.451171 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e3d7a8a8-9652-4ca0-8c4d-01df3a94e33f tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:45.651292 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=8 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:52:46.673762 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-e3d7a8a8-9652-4ca0-8c4d-01df3a94e33f tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:46.690333 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-e3d7a8a8-9652-4ca0-8c4d-01df3a94e33f tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:46.699928 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-e3d7a8a8-9652-4ca0-8c4d-01df3a94e33f tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:46.705465 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-e3d7a8a8-9652-4ca0-8c4d-01df3a94e33f tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] 10.222.0.43 "GET /compute/v2.1/servers/b646f5b5-a266-44df-80e6-5d1b2a3b91d7" status: 200 len: 1487 microversion: 2.25 time: 1.282135 Oct 04 21:52:46.706506 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1139/2201] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:52:45 2022] GET /compute/v2.1/servers/b646f5b5-a266-44df-80e6-5d1b2a3b91d7 => generated 1487 bytes in 1286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:52:46.719364 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-cb69242e-b189-408e-b993-41efafc3055c tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:46.721983 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-cb69242e-b189-408e-b993-41efafc3055c tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 152003e4-2a7b-4801-8656-73093cd566ed] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:52:46.738797 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cb69242e-b189-408e-b993-41efafc3055c tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:46.741875 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cb69242e-b189-408e-b993-41efafc3055c tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:46.742655 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cb69242e-b189-408e-b993-41efafc3055c tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:46.743746 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cb69242e-b189-408e-b993-41efafc3055c tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:46.746909 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cb69242e-b189-408e-b993-41efafc3055c tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:46.749097 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cb69242e-b189-408e-b993-41efafc3055c tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:47.898278 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-cb69242e-b189-408e-b993-41efafc3055c tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ad048becf474fb972d4291422d810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dcfc7024fc49388c4bd5f25f03e60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:47.909441 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-cb69242e-b189-408e-b993-41efafc3055c tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/152003e4-2a7b-4801-8656-73093cd566ed" status: 200 len: 1198 microversion: 2.1 time: 1.200925 Oct 04 21:52:47.916430 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1140/2202] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:52:46 2022] GET /compute/v2.1/servers/152003e4-2a7b-4801-8656-73093cd566ed => generated 1198 bytes in 1208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:52:47.934115 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-a0a15c25-2a53-48de-ab31-365f04412770 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Calling method '.version_select at 0x7fbb372b1310>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:48.041841 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-a0a15c25-2a53-48de-ab31-365f04412770 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] 10.222.0.43 "GET /compute/v2.1/images/147c04e5-7d17-4421-8f9d-3336bdcbaf2e" status: 200 len: 1454 microversion: 2.1 time: 0.124015 Oct 04 21:52:48.044640 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1141/2203] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:52:47 2022] GET /compute/v2.1/images/147c04e5-7d17-4421-8f9d-3336bdcbaf2e => generated 1454 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:52:48.063417 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-83210b03-f443-43e1-ab45-7bc5e522d9b2 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:48.064657 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-83210b03-f443-43e1-ab45-7bc5e522d9b2 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] [instance: b646f5b5-a266-44df-80e6-5d1b2a3b91d7] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:52:48.103096 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-83210b03-f443-43e1-ab45-7bc5e522d9b2 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:48.107246 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-83210b03-f443-43e1-ab45-7bc5e522d9b2 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:48.107815 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-83210b03-f443-43e1-ab45-7bc5e522d9b2 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:48.110214 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-83210b03-f443-43e1-ab45-7bc5e522d9b2 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:48.114965 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-83210b03-f443-43e1-ab45-7bc5e522d9b2 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:48.117116 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-83210b03-f443-43e1-ab45-7bc5e522d9b2 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:49.033782 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-83210b03-f443-43e1-ab45-7bc5e522d9b2 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:49.067806 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-83210b03-f443-43e1-ab45-7bc5e522d9b2 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:49.078497 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-83210b03-f443-43e1-ab45-7bc5e522d9b2 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:49.084742 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-83210b03-f443-43e1-ab45-7bc5e522d9b2 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] 10.222.0.43 "GET /compute/v2.1/servers/b646f5b5-a266-44df-80e6-5d1b2a3b91d7" status: 200 len: 1487 microversion: 2.25 time: 1.036916 Oct 04 21:52:49.088174 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1142/2204] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:52:48 2022] GET /compute/v2.1/servers/b646f5b5-a266-44df-80e6-5d1b2a3b91d7 => generated 1487 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:52:49.107398 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-81ccd57b-1c05-4029-92ce-371b422d6e14 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:49.108035 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-81ccd57b-1c05-4029-92ce-371b422d6e14 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 152003e4-2a7b-4801-8656-73093cd566ed] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:52:49.145376 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-81ccd57b-1c05-4029-92ce-371b422d6e14 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:49.146322 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-81ccd57b-1c05-4029-92ce-371b422d6e14 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:49.147080 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-81ccd57b-1c05-4029-92ce-371b422d6e14 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:49.148187 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-81ccd57b-1c05-4029-92ce-371b422d6e14 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:49.149477 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-81ccd57b-1c05-4029-92ce-371b422d6e14 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:49.150768 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-81ccd57b-1c05-4029-92ce-371b422d6e14 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:49.623237 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-81ccd57b-1c05-4029-92ce-371b422d6e14 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ad048becf474fb972d4291422d810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dcfc7024fc49388c4bd5f25f03e60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:49.642959 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-81ccd57b-1c05-4029-92ce-371b422d6e14 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/152003e4-2a7b-4801-8656-73093cd566ed" status: 200 len: 1198 microversion: 2.1 time: 0.553519 Oct 04 21:52:49.645451 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1143/2205] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:52:49 2022] GET /compute/v2.1/servers/152003e4-2a7b-4801-8656-73093cd566ed => generated 1198 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:52:49.661297 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-f23f6ae0-b98f-44b5-828e-1fc0f23db2c7 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Calling method '.version_select at 0x7fbb372b1550>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:49.756080 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-f23f6ae0-b98f-44b5-828e-1fc0f23db2c7 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] 10.222.0.43 "GET /compute/v2.1/images/147c04e5-7d17-4421-8f9d-3336bdcbaf2e" status: 200 len: 1454 microversion: 2.1 time: 0.106895 Oct 04 21:52:49.760557 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1144/2206] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:52:49 2022] GET /compute/v2.1/images/147c04e5-7d17-4421-8f9d-3336bdcbaf2e => generated 1454 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:52:49.772560 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-4b1141c2-e0ad-48df-94d2-4cc4286e3dbe req-73401277-4e22-4736-9af1-8c7164fde391 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d0ed6d0-981a-48a7-a676-5910b1257301", "name": "network-vif-plugged", "status": "completed", "tag": "0ba64ce4-a23d-464b-a37e-fdb0f8a91b4b"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:52:49.808603 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-4b1141c2-e0ad-48df-94d2-4cc4286e3dbe req-73401277-4e22-4736-9af1-8c7164fde391 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:49.809813 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-4b1141c2-e0ad-48df-94d2-4cc4286e3dbe req-73401277-4e22-4736-9af1-8c7164fde391 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:49.810294 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-4b1141c2-e0ad-48df-94d2-4cc4286e3dbe req-73401277-4e22-4736-9af1-8c7164fde391 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:49.848103 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-4b1141c2-e0ad-48df-94d2-4cc4286e3dbe req-73401277-4e22-4736-9af1-8c7164fde391 service nova] Creating event network-vif-plugged:0ba64ce4-a23d-464b-a37e-fdb0f8a91b4b for instance 7d0ed6d0-981a-48a7-a676-5910b1257301 on n-h2-860284-1 Oct 04 21:52:49.856910 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-4b1141c2-e0ad-48df-94d2-4cc4286e3dbe req-73401277-4e22-4736-9af1-8c7164fde391 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093532 Oct 04 21:52:49.858138 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1145/2207] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:52:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:52:50.123008 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-300d2bd2-9433-44e5-b5ab-258aec7f2304 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:50.123729 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-300d2bd2-9433-44e5-b5ab-258aec7f2304 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] [instance: b646f5b5-a266-44df-80e6-5d1b2a3b91d7] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:52:50.139421 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-300d2bd2-9433-44e5-b5ab-258aec7f2304 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:50.140486 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-300d2bd2-9433-44e5-b5ab-258aec7f2304 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:50.140486 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-300d2bd2-9433-44e5-b5ab-258aec7f2304 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:50.141087 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-300d2bd2-9433-44e5-b5ab-258aec7f2304 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:50.141955 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-300d2bd2-9433-44e5-b5ab-258aec7f2304 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:50.141955 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-300d2bd2-9433-44e5-b5ab-258aec7f2304 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:50.627310 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-300d2bd2-9433-44e5-b5ab-258aec7f2304 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:50.640421 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-300d2bd2-9433-44e5-b5ab-258aec7f2304 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:50.645326 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-300d2bd2-9433-44e5-b5ab-258aec7f2304 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:50.648627 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-300d2bd2-9433-44e5-b5ab-258aec7f2304 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] 10.222.0.43 "GET /compute/v2.1/servers/b646f5b5-a266-44df-80e6-5d1b2a3b91d7" status: 200 len: 1487 microversion: 2.25 time: 0.536724 Oct 04 21:52:50.651707 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1146/2208] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:52:50 2022] GET /compute/v2.1/servers/b646f5b5-a266-44df-80e6-5d1b2a3b91d7 => generated 1487 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:52:50.671823 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-96936c12-7223-4f71-984e-004958ac636b tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:50.672920 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-96936c12-7223-4f71-984e-004958ac636b tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 152003e4-2a7b-4801-8656-73093cd566ed] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:52:50.687112 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-96936c12-7223-4f71-984e-004958ac636b tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:50.687805 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-96936c12-7223-4f71-984e-004958ac636b tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:50.688365 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-96936c12-7223-4f71-984e-004958ac636b tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:50.689208 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-96936c12-7223-4f71-984e-004958ac636b tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:50.689776 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-96936c12-7223-4f71-984e-004958ac636b tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:50.690791 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-96936c12-7223-4f71-984e-004958ac636b tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:50.987124 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-3b830bed-1402-44df-876e-92bf267b3477 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Flavor limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:52:50.987629 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-3b830bed-1402-44df-876e-92bf267b3477 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Image limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:52:50.988113 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-3b830bed-1402-44df-876e-92bf267b3477 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Flavor pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:52:50.988539 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-3b830bed-1402-44df-876e-92bf267b3477 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Image pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:52:50.988954 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-3b830bed-1402-44df-876e-92bf267b3477 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:52:51.006970 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3b830bed-1402-44df-876e-92bf267b3477 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:51.007784 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3b830bed-1402-44df-876e-92bf267b3477 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:51.008461 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3b830bed-1402-44df-876e-92bf267b3477 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:51.009557 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3b830bed-1402-44df-876e-92bf267b3477 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:51.010233 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3b830bed-1402-44df-876e-92bf267b3477 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:51.012225 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3b830bed-1402-44df-876e-92bf267b3477 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:51.084081 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-3b830bed-1402-44df-876e-92bf267b3477 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Getting quotas for project 2dd1e35c3cb643e3ad2afbe7edbbce8d. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:52:51.118412 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-3b830bed-1402-44df-876e-92bf267b3477 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Getting quotas for user 2bb934f4dc53470d8e35d71cccd756d9 and project 2dd1e35c3cb643e3ad2afbe7edbbce8d. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:52:51.180419 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-96936c12-7223-4f71-984e-004958ac636b tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ad048becf474fb972d4291422d810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dcfc7024fc49388c4bd5f25f03e60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:51.193863 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-96936c12-7223-4f71-984e-004958ac636b tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/152003e4-2a7b-4801-8656-73093cd566ed" status: 200 len: 1198 microversion: 2.1 time: 0.525634 Oct 04 21:52:51.202766 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1147/2209] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:52:50 2022] GET /compute/v2.1/servers/152003e4-2a7b-4801-8656-73093cd566ed => generated 1198 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:52:51.207934 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-dd8418da-83cc-4ace-871c-58ae19498e61 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Calling method '.version_select at 0x7fbb2efd2e50>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:51.309668 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-dd8418da-83cc-4ace-871c-58ae19498e61 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] 10.222.0.43 "GET /compute/v2.1/images/147c04e5-7d17-4421-8f9d-3336bdcbaf2e" status: 200 len: 1454 microversion: 2.1 time: 0.105411 Oct 04 21:52:51.310275 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1148/2210] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:52:51 2022] GET /compute/v2.1/images/147c04e5-7d17-4421-8f9d-3336bdcbaf2e => generated 1454 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:52:51.518273 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-3b830bed-1402-44df-876e-92bf267b3477 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Going to run 1 instances... {{(pid=134101) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:52:51.521846 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-3b830bed-1402-44df-876e-92bf267b3477 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] [instance: 830de6ad-adc6-4d16-ae9d-a29ae85e6cd2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='675c4d6b-3f44-47bd-897f-a97d4c640bd9',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='82071b78-631e-44f1-a241-0fe10a62c190',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a4ec8bb1-5b16-4f4e-bc60-a4358d7e2bd7',volume_size=None,volume_type=None)] {{(pid=134101) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:52:51.686353 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-025f0067-7d15-441e-bb0c-96de50710f3d tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:51.687126 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-025f0067-7d15-441e-bb0c-96de50710f3d tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] [instance: b646f5b5-a266-44df-80e6-5d1b2a3b91d7] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:52:51.703535 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-025f0067-7d15-441e-bb0c-96de50710f3d tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:51.704415 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-025f0067-7d15-441e-bb0c-96de50710f3d tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:51.704908 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-025f0067-7d15-441e-bb0c-96de50710f3d tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:51.707675 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-025f0067-7d15-441e-bb0c-96de50710f3d tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:51.708191 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-025f0067-7d15-441e-bb0c-96de50710f3d tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:51.708646 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-025f0067-7d15-441e-bb0c-96de50710f3d tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:52.349527 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:52:52.517042 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-3b830bed-1402-44df-876e-92bf267b3477 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.42 time: 11.347299 Oct 04 21:52:52.524547 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1063/2211] 10.222.0.43 () {62 vars in 1189 bytes} [Tue Oct 4 21:52:41 2022] POST /compute/v2.1/servers => generated 405 bytes in 11355 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 04 21:52:52.532809 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-20155654-3677-4c6a-8ddf-a0bba5149001 req-836cb9ad-b5ca-484a-8830-37dc48c83139 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "152003e4-2a7b-4801-8656-73093cd566ed", "name": "network-vif-plugged", "status": "completed", "tag": "eefc2731-0f05-444f-9e84-6aab2807b291"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:52:52.567344 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-20155654-3677-4c6a-8ddf-a0bba5149001 req-836cb9ad-b5ca-484a-8830-37dc48c83139 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:52.572319 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-20155654-3677-4c6a-8ddf-a0bba5149001 req-836cb9ad-b5ca-484a-8830-37dc48c83139 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:52.572966 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-20155654-3677-4c6a-8ddf-a0bba5149001 req-836cb9ad-b5ca-484a-8830-37dc48c83139 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:52.596893 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-20155654-3677-4c6a-8ddf-a0bba5149001 req-836cb9ad-b5ca-484a-8830-37dc48c83139 service nova] Creating event network-vif-plugged:eefc2731-0f05-444f-9e84-6aab2807b291 for instance 152003e4-2a7b-4801-8656-73093cd566ed on n-h1-860284-1 Oct 04 21:52:52.616007 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-20155654-3677-4c6a-8ddf-a0bba5149001 req-836cb9ad-b5ca-484a-8830-37dc48c83139 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087506 Oct 04 21:52:52.617162 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1064/2212] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:52:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:52:52.626488 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-ee3beb32-7c3e-4f16-af57-c0950340675c tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:52.627388 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-ee3beb32-7c3e-4f16-af57-c0950340675c tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 152003e4-2a7b-4801-8656-73093cd566ed] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:52:52.644012 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ee3beb32-7c3e-4f16-af57-c0950340675c tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:52.644718 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ee3beb32-7c3e-4f16-af57-c0950340675c tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:52.656662 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ee3beb32-7c3e-4f16-af57-c0950340675c tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:52.664419 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ee3beb32-7c3e-4f16-af57-c0950340675c tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:52.666119 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ee3beb32-7c3e-4f16-af57-c0950340675c tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:52.666835 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ee3beb32-7c3e-4f16-af57-c0950340675c tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:53.223757 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-025f0067-7d15-441e-bb0c-96de50710f3d tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:53.241306 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-025f0067-7d15-441e-bb0c-96de50710f3d tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:53.246274 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-025f0067-7d15-441e-bb0c-96de50710f3d tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:53.249526 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-025f0067-7d15-441e-bb0c-96de50710f3d tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] 10.222.0.43 "GET /compute/v2.1/servers/b646f5b5-a266-44df-80e6-5d1b2a3b91d7" status: 200 len: 1487 microversion: 2.25 time: 1.571832 Oct 04 21:52:53.251587 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1149/2213] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:52:51 2022] GET /compute/v2.1/servers/b646f5b5-a266-44df-80e6-5d1b2a3b91d7 => generated 1487 bytes in 1575 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:52:53.264281 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-eb41596e-8757-4787-aab8-8c9f66d8c9a2 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Calling method '.version_select at 0x7fbb2ea5d3a0>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:53.365955 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-eb41596e-8757-4787-aab8-8c9f66d8c9a2 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] 10.222.0.43 "GET /compute/v2.1/images/147c04e5-7d17-4421-8f9d-3336bdcbaf2e" status: 200 len: 1454 microversion: 2.1 time: 0.113229 Oct 04 21:52:53.366899 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1150/2214] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:52:53 2022] GET /compute/v2.1/images/147c04e5-7d17-4421-8f9d-3336bdcbaf2e => generated 1454 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:52:53.376970 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-ee3beb32-7c3e-4f16-af57-c0950340675c tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ad048becf474fb972d4291422d810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dcfc7024fc49388c4bd5f25f03e60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:53.381840 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-58ad57a1-c417-440e-b77c-c96d817f487d tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:53.382722 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-58ad57a1-c417-440e-b77c-c96d817f487d tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] [instance: 830de6ad-adc6-4d16-ae9d-a29ae85e6cd2] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:52:53.385422 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=100 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:52:53.398099 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-ee3beb32-7c3e-4f16-af57-c0950340675c tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/152003e4-2a7b-4801-8656-73093cd566ed" status: 200 len: 1198 microversion: 2.1 time: 0.778450 Oct 04 21:52:53.398909 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1065/2215] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:52:52 2022] GET /compute/v2.1/servers/152003e4-2a7b-4801-8656-73093cd566ed => generated 1198 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:52:53.687223 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-58ad57a1-c417-440e-b77c-c96d817f487d tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:53.707430 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-58ad57a1-c417-440e-b77c-c96d817f487d tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:53.713386 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-58ad57a1-c417-440e-b77c-c96d817f487d tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:53.715022 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-58ad57a1-c417-440e-b77c-c96d817f487d tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] 10.222.0.43 "GET /compute/v2.1/servers/830de6ad-adc6-4d16-ae9d-a29ae85e6cd2" status: 200 len: 1285 microversion: 2.42 time: 0.346885 Oct 04 21:52:53.733024 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1151/2216] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:52:53 2022] GET /compute/v2.1/servers/830de6ad-adc6-4d16-ae9d-a29ae85e6cd2 => generated 1285 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:52:54.290133 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-7d99054c-5626-497b-ac2e-c0df1c1101b5 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:54.295799 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-7d99054c-5626-497b-ac2e-c0df1c1101b5 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] [instance: b646f5b5-a266-44df-80e6-5d1b2a3b91d7] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:52:54.358886 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7d99054c-5626-497b-ac2e-c0df1c1101b5 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:54.365921 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7d99054c-5626-497b-ac2e-c0df1c1101b5 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:54.367611 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7d99054c-5626-497b-ac2e-c0df1c1101b5 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:54.368604 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7d99054c-5626-497b-ac2e-c0df1c1101b5 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:54.371791 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7d99054c-5626-497b-ac2e-c0df1c1101b5 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:54.372542 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7d99054c-5626-497b-ac2e-c0df1c1101b5 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:54.386508 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-b0f5f22b-ee7b-4369-807a-b222be74147b tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Calling method '.version_select at 0x7fbb2ea5d670>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:54.565557 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-b0f5f22b-ee7b-4369-807a-b222be74147b tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] 10.222.0.43 "GET /compute/v2.1/images/147c04e5-7d17-4421-8f9d-3336bdcbaf2e" status: 200 len: 1454 microversion: 2.1 time: 0.185859 Oct 04 21:52:54.567547 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1152/2217] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:52:54 2022] GET /compute/v2.1/images/147c04e5-7d17-4421-8f9d-3336bdcbaf2e => generated 1454 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:52:54.573497 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-a876e3bb-3297-431c-8290-b2325b27258c tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:54.574532 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-a876e3bb-3297-431c-8290-b2325b27258c tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 152003e4-2a7b-4801-8656-73093cd566ed] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:52:54.590908 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a876e3bb-3297-431c-8290-b2325b27258c tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:54.593839 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a876e3bb-3297-431c-8290-b2325b27258c tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:54.597795 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a876e3bb-3297-431c-8290-b2325b27258c tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:54.599894 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a876e3bb-3297-431c-8290-b2325b27258c tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:54.602266 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a876e3bb-3297-431c-8290-b2325b27258c tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:54.604310 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a876e3bb-3297-431c-8290-b2325b27258c tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:55.476127 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-a876e3bb-3297-431c-8290-b2325b27258c tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ad048becf474fb972d4291422d810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dcfc7024fc49388c4bd5f25f03e60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:55.487153 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-a876e3bb-3297-431c-8290-b2325b27258c tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/152003e4-2a7b-4801-8656-73093cd566ed" status: 200 len: 1380 microversion: 2.1 time: 0.918154 Oct 04 21:52:55.490876 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1153/2218] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:52:54 2022] GET /compute/v2.1/servers/152003e4-2a7b-4801-8656-73093cd566ed => generated 1380 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:52:55.502561 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-7d99054c-5626-497b-ac2e-c0df1c1101b5 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:55.503202 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-0fb43776-d419-4935-ba71-7be4bcc47708 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:55.503202 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-0fb43776-d419-4935-ba71-7be4bcc47708 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] [instance: 830de6ad-adc6-4d16-ae9d-a29ae85e6cd2] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:52:55.519366 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-7d99054c-5626-497b-ac2e-c0df1c1101b5 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:55.521103 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:52:55.523958 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0fb43776-d419-4935-ba71-7be4bcc47708 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:55.524473 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0fb43776-d419-4935-ba71-7be4bcc47708 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:55.524924 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0fb43776-d419-4935-ba71-7be4bcc47708 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:55.525663 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0fb43776-d419-4935-ba71-7be4bcc47708 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:55.526132 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0fb43776-d419-4935-ba71-7be4bcc47708 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:55.526788 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0fb43776-d419-4935-ba71-7be4bcc47708 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:55.527496 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-7d99054c-5626-497b-ac2e-c0df1c1101b5 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:55.538076 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-7d99054c-5626-497b-ac2e-c0df1c1101b5 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] 10.222.0.43 "GET /compute/v2.1/servers/b646f5b5-a266-44df-80e6-5d1b2a3b91d7" status: 200 len: 1477 microversion: 2.25 time: 1.261128 Oct 04 21:52:55.541297 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1066/2219] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:52:54 2022] GET /compute/v2.1/servers/b646f5b5-a266-44df-80e6-5d1b2a3b91d7 => generated 1477 bytes in 1267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:52:55.571237 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-725dc730-0b63-4ec5-8049-7be7cd2681dc tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:55.574554 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-725dc730-0b63-4ec5-8049-7be7cd2681dc tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] [instance: 152003e4-2a7b-4801-8656-73093cd566ed] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:52:55.589550 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-725dc730-0b63-4ec5-8049-7be7cd2681dc tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:55.592100 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-725dc730-0b63-4ec5-8049-7be7cd2681dc tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:55.592825 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-725dc730-0b63-4ec5-8049-7be7cd2681dc tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:55.595004 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-725dc730-0b63-4ec5-8049-7be7cd2681dc tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:55.596973 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-725dc730-0b63-4ec5-8049-7be7cd2681dc tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:55.600242 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-725dc730-0b63-4ec5-8049-7be7cd2681dc tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:55.987332 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-0fb43776-d419-4935-ba71-7be4bcc47708 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:56.004707 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-0fb43776-d419-4935-ba71-7be4bcc47708 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:56.014454 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-0fb43776-d419-4935-ba71-7be4bcc47708 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:56.016364 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-0fb43776-d419-4935-ba71-7be4bcc47708 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] 10.222.0.43 "GET /compute/v2.1/servers/830de6ad-adc6-4d16-ae9d-a29ae85e6cd2" status: 200 len: 1575 microversion: 2.42 time: 0.524424 Oct 04 21:52:56.019078 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1154/2220] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:52:55 2022] GET /compute/v2.1/servers/830de6ad-adc6-4d16-ae9d-a29ae85e6cd2 => generated 1575 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:52:56.031045 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-e04db9f3-80fc-434e-b7f5-49bdd70c8b82 tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Calling method '.version_select at 0x7fbb373f44c0>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:56.046678 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e04db9f3-80fc-434e-b7f5-49bdd70c8b82 tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:56.049291 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e04db9f3-80fc-434e-b7f5-49bdd70c8b82 tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:56.050921 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e04db9f3-80fc-434e-b7f5-49bdd70c8b82 tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:56.121223 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-e04db9f3-80fc-434e-b7f5-49bdd70c8b82 tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] 10.222.0.43 "GET /compute/v2.1/os-migrations" status: 200 len: 3204 microversion: 2.25 time: 0.096021 Oct 04 21:52:56.128679 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1155/2221] 10.222.0.43 () {60 vars in 1184 bytes} [Tue Oct 4 21:52:56 2022] GET /compute/v2.1/os-migrations => generated 3204 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:52:56.156474 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-ec06492d-0454-4651-8b27-21c844ec2d32 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Calling method '.version_select at 0x7fbb37257ca0>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:56.263606 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-ec06492d-0454-4651-8b27-21c844ec2d32 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] 10.222.0.43 "GET /compute/v2.1/images/147c04e5-7d17-4421-8f9d-3336bdcbaf2e" status: 200 len: 1454 microversion: 2.1 time: 0.131217 Oct 04 21:52:56.274761 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1156/2222] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:52:56 2022] GET /compute/v2.1/images/147c04e5-7d17-4421-8f9d-3336bdcbaf2e => generated 1454 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:52:56.280108 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-9d96b0df-f078-4458-bee0-f1eb50e75f9e tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:56.280909 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-9d96b0df-f078-4458-bee0-f1eb50e75f9e tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] [instance: b646f5b5-a266-44df-80e6-5d1b2a3b91d7] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:52:56.299374 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9d96b0df-f078-4458-bee0-f1eb50e75f9e tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:56.307176 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9d96b0df-f078-4458-bee0-f1eb50e75f9e tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:56.308574 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9d96b0df-f078-4458-bee0-f1eb50e75f9e tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:56.309569 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9d96b0df-f078-4458-bee0-f1eb50e75f9e tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:56.319181 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9d96b0df-f078-4458-bee0-f1eb50e75f9e tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:56.321846 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9d96b0df-f078-4458-bee0-f1eb50e75f9e tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:56.465672 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-725dc730-0b63-4ec5-8049-7be7cd2681dc tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/152003e4-2a7b-4801-8656-73093cd566ed" status: 200 len: 1531 microversion: 2.1 time: 0.916842 Oct 04 21:52:56.472351 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1067/2223] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:52:55 2022] GET /compute/v2.1/servers/152003e4-2a7b-4801-8656-73093cd566ed => generated 1531 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:52:56.494190 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-4dede0fe-3d36-40c2-9768-eae3ed60ea28 tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:56.495353 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-4dede0fe-3d36-40c2-9768-eae3ed60ea28 tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] [instance: 152003e4-2a7b-4801-8656-73093cd566ed] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:52:56.506612 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4dede0fe-3d36-40c2-9768-eae3ed60ea28 tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:56.512942 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4dede0fe-3d36-40c2-9768-eae3ed60ea28 tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:56.513795 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4dede0fe-3d36-40c2-9768-eae3ed60ea28 tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:56.514808 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4dede0fe-3d36-40c2-9768-eae3ed60ea28 tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:56.515503 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4dede0fe-3d36-40c2-9768-eae3ed60ea28 tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:56.516186 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4dede0fe-3d36-40c2-9768-eae3ed60ea28 tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:56.998928 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-4dede0fe-3d36-40c2-9768-eae3ed60ea28 tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/152003e4-2a7b-4801-8656-73093cd566ed" status: 200 len: 1531 microversion: 2.1 time: 0.503754 Oct 04 21:52:57.000284 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1068/2224] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:52:56 2022] GET /compute/v2.1/servers/152003e4-2a7b-4801-8656-73093cd566ed => generated 1531 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:52:57.026421 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-16b833c5-f04f-4dfc-89c9-2acec5594934 tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:57.031439 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-16b833c5-f04f-4dfc-89c9-2acec5594934 tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:57.034435 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-16b833c5-f04f-4dfc-89c9-2acec5594934 tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:57.035157 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-16b833c5-f04f-4dfc-89c9-2acec5594934 tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:57.036198 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-16b833c5-f04f-4dfc-89c9-2acec5594934 tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:57.041095 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-16b833c5-f04f-4dfc-89c9-2acec5594934 tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:57.045494 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-16b833c5-f04f-4dfc-89c9-2acec5594934 tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:57.119851 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-16b833c5-f04f-4dfc-89c9-2acec5594934 tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] 10.222.0.43 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.097397 Oct 04 21:52:57.124508 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1069/2225] 10.222.0.43 () {58 vars in 1176 bytes} [Tue Oct 4 21:52:57 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:52:57.149964 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-a5ca68df-6ca4-4935-b981-9c4b77362cc8 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:57.151109 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-a5ca68df-6ca4-4935-b981-9c4b77362cc8 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] [instance: 830de6ad-adc6-4d16-ae9d-a29ae85e6cd2] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:52:57.169678 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a5ca68df-6ca4-4935-b981-9c4b77362cc8 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:57.170508 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a5ca68df-6ca4-4935-b981-9c4b77362cc8 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:57.171139 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a5ca68df-6ca4-4935-b981-9c4b77362cc8 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:57.172351 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a5ca68df-6ca4-4935-b981-9c4b77362cc8 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:57.173065 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a5ca68df-6ca4-4935-b981-9c4b77362cc8 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:57.173704 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a5ca68df-6ca4-4935-b981-9c4b77362cc8 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:57.581970 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.objects.instance [None req-9d96b0df-f078-4458-bee0-f1eb50e75f9e tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] Lazy-loading 'services' on Instance uuid b646f5b5-a266-44df-80e6-5d1b2a3b91d7 {{(pid=134102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:52:57.632794 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-9d96b0df-f078-4458-bee0-f1eb50e75f9e tempest-LiveAutoBlockMigrationV225Test-1159044015 tempest-LiveAutoBlockMigrationV225Test-1159044015-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/b646f5b5-a266-44df-80e6-5d1b2a3b91d7" status: 200 len: 1970 microversion: 2.25 time: 1.356198 Oct 04 21:52:57.637050 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1157/2226] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:52:56 2022] GET /compute/v2.1/servers/b646f5b5-a266-44df-80e6-5d1b2a3b91d7 => generated 1970 bytes in 1362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:52:57.652432 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-0e7dfd9a-1828-4899-8998-04a18ee3db9c tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-860284-1", "block_migration": false, "disk_over_commit": false}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:52:57.661548 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-0e7dfd9a-1828-4899-8998-04a18ee3db9c tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] [instance: 152003e4-2a7b-4801-8656-73093cd566ed] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:52:57.677473 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0e7dfd9a-1828-4899-8998-04a18ee3db9c tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:57.679187 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0e7dfd9a-1828-4899-8998-04a18ee3db9c tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:57.681069 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0e7dfd9a-1828-4899-8998-04a18ee3db9c tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:57.684446 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0e7dfd9a-1828-4899-8998-04a18ee3db9c tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:57.685194 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0e7dfd9a-1828-4899-8998-04a18ee3db9c tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:57.686528 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0e7dfd9a-1828-4899-8998-04a18ee3db9c tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:57.734465 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-a5ca68df-6ca4-4935-b981-9c4b77362cc8 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:57.749419 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-a5ca68df-6ca4-4935-b981-9c4b77362cc8 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:57.752212 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-a5ca68df-6ca4-4935-b981-9c4b77362cc8 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:57.760195 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-a5ca68df-6ca4-4935-b981-9c4b77362cc8 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] 10.222.0.43 "GET /compute/v2.1/servers/830de6ad-adc6-4d16-ae9d-a29ae85e6cd2" status: 200 len: 1593 microversion: 2.42 time: 0.620461 Oct 04 21:52:57.768836 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1070/2227] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:52:57 2022] GET /compute/v2.1/servers/830de6ad-adc6-4d16-ae9d-a29ae85e6cd2 => generated 1593 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:52:57.774480 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.objects.instance [None req-0e7dfd9a-1828-4899-8998-04a18ee3db9c tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Lazy-loading 'flavor' on Instance uuid 152003e4-2a7b-4801-8656-73093cd566ed {{(pid=134102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:52:57.780376 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-98300dd2-1c48-41f7-a04a-3bf0b5c7f1e6 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Calling method '.version_select at 0x7fbb2e603c10>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:57.840720 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-0e7dfd9a-1828-4899-8998-04a18ee3db9c tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] [instance: 152003e4-2a7b-4801-8656-73093cd566ed] Going to try to live migrate instance to n-h2-860284-1 {{(pid=134102) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 04 21:52:57.913872 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-98300dd2-1c48-41f7-a04a-3bf0b5c7f1e6 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] 10.222.0.43 "GET /compute/v2.1/images/147c04e5-7d17-4421-8f9d-3336bdcbaf2e" status: 200 len: 1454 microversion: 2.1 time: 0.143693 Oct 04 21:52:57.915158 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1071/2228] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:52:57 2022] GET /compute/v2.1/images/147c04e5-7d17-4421-8f9d-3336bdcbaf2e => generated 1454 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:52:57.920122 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-6002cc8e-225e-457d-9312-c2b6505671ad tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:57.920630 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-6002cc8e-225e-457d-9312-c2b6505671ad tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] [instance: b646f5b5-a266-44df-80e6-5d1b2a3b91d7] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:52:57.959548 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6002cc8e-225e-457d-9312-c2b6505671ad tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:57.960099 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6002cc8e-225e-457d-9312-c2b6505671ad tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:57.960511 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6002cc8e-225e-457d-9312-c2b6505671ad tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:57.961351 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6002cc8e-225e-457d-9312-c2b6505671ad tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:57.961816 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6002cc8e-225e-457d-9312-c2b6505671ad tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:57.962254 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6002cc8e-225e-457d-9312-c2b6505671ad tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:58.096683 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-6002cc8e-225e-457d-9312-c2b6505671ad tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] [instance: b646f5b5-a266-44df-80e6-5d1b2a3b91d7] Going to try to terminate instance {{(pid=134101) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:52:58.341899 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-6002cc8e-225e-457d-9312-c2b6505671ad tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] 10.222.0.43 "DELETE /compute/v2.1/servers/b646f5b5-a266-44df-80e6-5d1b2a3b91d7" status: 204 len: 0 microversion: 2.25 time: 0.425270 Oct 04 21:52:58.342817 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1072/2229] 10.222.0.43 () {60 vars in 1280 bytes} [Tue Oct 4 21:52:57 2022] DELETE /compute/v2.1/servers/b646f5b5-a266-44df-80e6-5d1b2a3b91d7 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 21:52:58.353082 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-603f532e-b580-463e-8a60-d82b370fe4e4 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:58.354204 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-603f532e-b580-463e-8a60-d82b370fe4e4 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] [instance: b646f5b5-a266-44df-80e6-5d1b2a3b91d7] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:52:58.377303 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-603f532e-b580-463e-8a60-d82b370fe4e4 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:58.377807 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-603f532e-b580-463e-8a60-d82b370fe4e4 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:58.378243 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-603f532e-b580-463e-8a60-d82b370fe4e4 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:58.382108 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-603f532e-b580-463e-8a60-d82b370fe4e4 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:58.391719 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-603f532e-b580-463e-8a60-d82b370fe4e4 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:58.392963 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-603f532e-b580-463e-8a60-d82b370fe4e4 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:59.097113 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-603f532e-b580-463e-8a60-d82b370fe4e4 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:59.112597 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-603f532e-b580-463e-8a60-d82b370fe4e4 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:59.120614 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-603f532e-b580-463e-8a60-d82b370fe4e4 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:59.128156 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-603f532e-b580-463e-8a60-d82b370fe4e4 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] 10.222.0.43 "GET /compute/v2.1/servers/b646f5b5-a266-44df-80e6-5d1b2a3b91d7" status: 200 len: 1483 microversion: 2.25 time: 0.776206 Oct 04 21:52:59.147405 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1073/2230] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:52:58 2022] GET /compute/v2.1/servers/b646f5b5-a266-44df-80e6-5d1b2a3b91d7 => generated 1483 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:52:59.147405 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-2b31c8e6-778d-48c2-bc7e-a3032d44ffcb tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:59.147405 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-2b31c8e6-778d-48c2-bc7e-a3032d44ffcb tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] [instance: 830de6ad-adc6-4d16-ae9d-a29ae85e6cd2] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:52:59.174694 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2b31c8e6-778d-48c2-bc7e-a3032d44ffcb tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:59.175206 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2b31c8e6-778d-48c2-bc7e-a3032d44ffcb tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:59.175655 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2b31c8e6-778d-48c2-bc7e-a3032d44ffcb tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:59.176388 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2b31c8e6-778d-48c2-bc7e-a3032d44ffcb tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:59.176852 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2b31c8e6-778d-48c2-bc7e-a3032d44ffcb tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:59.177301 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2b31c8e6-778d-48c2-bc7e-a3032d44ffcb tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:59.383356 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-2b31c8e6-778d-48c2-bc7e-a3032d44ffcb tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:59.404591 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-2b31c8e6-778d-48c2-bc7e-a3032d44ffcb tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:59.406101 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-2b31c8e6-778d-48c2-bc7e-a3032d44ffcb tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:59.407342 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-2b31c8e6-778d-48c2-bc7e-a3032d44ffcb tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] 10.222.0.43 "GET /compute/v2.1/servers/830de6ad-adc6-4d16-ae9d-a29ae85e6cd2" status: 200 len: 1593 microversion: 2.42 time: 0.265243 Oct 04 21:52:59.422990 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1074/2231] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:52:59 2022] GET /compute/v2.1/servers/830de6ad-adc6-4d16-ae9d-a29ae85e6cd2 => generated 1593 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:52:59.431365 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-cce11b82-30a0-4c91-8875-7fd434bbf826 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Calling method '.version_select at 0x7fbb2e68d280>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:59.582465 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-cce11b82-30a0-4c91-8875-7fd434bbf826 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] 10.222.0.43 "GET /compute/v2.1/images/147c04e5-7d17-4421-8f9d-3336bdcbaf2e" status: 200 len: 1454 microversion: 2.1 time: 0.153973 Oct 04 21:52:59.585073 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1075/2232] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:52:59 2022] GET /compute/v2.1/images/147c04e5-7d17-4421-8f9d-3336bdcbaf2e => generated 1454 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:53:00.154884 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-c6fbfbe8-3a7d-43d5-8c81-b9bc5eda9f45 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:00.155810 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-c6fbfbe8-3a7d-43d5-8c81-b9bc5eda9f45 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] [instance: b646f5b5-a266-44df-80e6-5d1b2a3b91d7] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:53:00.170798 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c6fbfbe8-3a7d-43d5-8c81-b9bc5eda9f45 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:00.175809 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c6fbfbe8-3a7d-43d5-8c81-b9bc5eda9f45 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:00.176280 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c6fbfbe8-3a7d-43d5-8c81-b9bc5eda9f45 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:00.177145 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c6fbfbe8-3a7d-43d5-8c81-b9bc5eda9f45 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:00.177642 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c6fbfbe8-3a7d-43d5-8c81-b9bc5eda9f45 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:00.178083 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c6fbfbe8-3a7d-43d5-8c81-b9bc5eda9f45 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:01.133204 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-c6fbfbe8-3a7d-43d5-8c81-b9bc5eda9f45 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:01.155922 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-c6fbfbe8-3a7d-43d5-8c81-b9bc5eda9f45 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:01.157655 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-c6fbfbe8-3a7d-43d5-8c81-b9bc5eda9f45 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:01.158913 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-c6fbfbe8-3a7d-43d5-8c81-b9bc5eda9f45 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] 10.222.0.43 "GET /compute/v2.1/servers/b646f5b5-a266-44df-80e6-5d1b2a3b91d7" status: 200 len: 1483 microversion: 2.25 time: 1.009265 Oct 04 21:53:01.191927 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1076/2233] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:53:00 2022] GET /compute/v2.1/servers/b646f5b5-a266-44df-80e6-5d1b2a3b91d7 => generated 1483 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:53:01.218417 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-a7ba70b9-9f15-4be4-ae8f-be46e6ca8fea tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:01.221797 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-a7ba70b9-9f15-4be4-ae8f-be46e6ca8fea tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] [instance: 830de6ad-adc6-4d16-ae9d-a29ae85e6cd2] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:53:01.233605 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=6 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:53:01.260046 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a7ba70b9-9f15-4be4-ae8f-be46e6ca8fea tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:01.261794 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a7ba70b9-9f15-4be4-ae8f-be46e6ca8fea tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:01.264975 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a7ba70b9-9f15-4be4-ae8f-be46e6ca8fea tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:01.269012 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a7ba70b9-9f15-4be4-ae8f-be46e6ca8fea tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:01.273093 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a7ba70b9-9f15-4be4-ae8f-be46e6ca8fea tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:01.276782 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a7ba70b9-9f15-4be4-ae8f-be46e6ca8fea tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:01.484053 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-0e7dfd9a-1828-4899-8998-04a18ee3db9c tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] 10.222.0.43 "POST /compute/v2.1/servers/152003e4-2a7b-4801-8656-73093cd566ed/action" status: 202 len: 0 microversion: 2.1 time: 3.845286 Oct 04 21:53:01.484807 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1158/2234] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 21:52:57 2022] POST /compute/v2.1/servers/152003e4-2a7b-4801-8656-73093cd566ed/action => generated 0 bytes in 3847 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:53:01.491628 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-dff84872-e767-4db0-b990-1f4fecba1ea4 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Calling method '.version_select at 0x7fbb372573a0>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:01.590955 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-dff84872-e767-4db0-b990-1f4fecba1ea4 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] 10.222.0.43 "GET /compute/v2.1/images/147c04e5-7d17-4421-8f9d-3336bdcbaf2e" status: 200 len: 1454 microversion: 2.1 time: 0.104452 Oct 04 21:53:01.591566 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1159/2235] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:53:01 2022] GET /compute/v2.1/images/147c04e5-7d17-4421-8f9d-3336bdcbaf2e => generated 1454 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:53:01.640533 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-db71c43c-0aac-431e-ad38-a4417c10cbc2 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:01.644242 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-db71c43c-0aac-431e-ad38-a4417c10cbc2 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 152003e4-2a7b-4801-8656-73093cd566ed] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:53:01.694245 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-db71c43c-0aac-431e-ad38-a4417c10cbc2 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:01.694854 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-db71c43c-0aac-431e-ad38-a4417c10cbc2 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:01.695351 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-db71c43c-0aac-431e-ad38-a4417c10cbc2 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:01.703451 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-db71c43c-0aac-431e-ad38-a4417c10cbc2 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:01.712045 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-db71c43c-0aac-431e-ad38-a4417c10cbc2 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:01.715286 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-db71c43c-0aac-431e-ad38-a4417c10cbc2 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:01.805562 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:53:02.781797 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-a7ba70b9-9f15-4be4-ae8f-be46e6ca8fea tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:02.815477 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-a7ba70b9-9f15-4be4-ae8f-be46e6ca8fea tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:02.824396 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-a7ba70b9-9f15-4be4-ae8f-be46e6ca8fea tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:02.829093 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-a7ba70b9-9f15-4be4-ae8f-be46e6ca8fea tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] 10.222.0.43 "GET /compute/v2.1/servers/830de6ad-adc6-4d16-ae9d-a29ae85e6cd2" status: 200 len: 1593 microversion: 2.42 time: 1.635926 Oct 04 21:53:02.835210 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1077/2236] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:53:01 2022] GET /compute/v2.1/servers/830de6ad-adc6-4d16-ae9d-a29ae85e6cd2 => generated 1593 bytes in 1643 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:53:02.842176 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-0e3a9c4c-5827-46b3-9bd9-3892c0882fe4 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:02.843939 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-0e3a9c4c-5827-46b3-9bd9-3892c0882fe4 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] [instance: b646f5b5-a266-44df-80e6-5d1b2a3b91d7] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:53:02.851426 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0e3a9c4c-5827-46b3-9bd9-3892c0882fe4 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:02.852198 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0e3a9c4c-5827-46b3-9bd9-3892c0882fe4 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:02.852993 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0e3a9c4c-5827-46b3-9bd9-3892c0882fe4 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:02.854125 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0e3a9c4c-5827-46b3-9bd9-3892c0882fe4 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:02.854989 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0e3a9c4c-5827-46b3-9bd9-3892c0882fe4 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:02.855843 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0e3a9c4c-5827-46b3-9bd9-3892c0882fe4 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:02.894228 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-db71c43c-0aac-431e-ad38-a4417c10cbc2 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ad048becf474fb972d4291422d810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dcfc7024fc49388c4bd5f25f03e60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:02.905086 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-db71c43c-0aac-431e-ad38-a4417c10cbc2 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/152003e4-2a7b-4801-8656-73093cd566ed" status: 200 len: 1390 microversion: 2.1 time: 1.294358 Oct 04 21:53:02.909324 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1160/2237] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:53:01 2022] GET /compute/v2.1/servers/152003e4-2a7b-4801-8656-73093cd566ed => generated 1390 bytes in 1299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:53:02.921832 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-5e097877-0685-40ea-9b51-9c7bb0ce79cd tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Calling method '.version_select at 0x7fbb2f053040>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:02.976958 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-0e3a9c4c-5827-46b3-9bd9-3892c0882fe4 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:02.997329 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-0e3a9c4c-5827-46b3-9bd9-3892c0882fe4 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:03.004223 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-0e3a9c4c-5827-46b3-9bd9-3892c0882fe4 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:03.013207 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-0e3a9c4c-5827-46b3-9bd9-3892c0882fe4 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] 10.222.0.43 "GET /compute/v2.1/servers/b646f5b5-a266-44df-80e6-5d1b2a3b91d7" status: 200 len: 1266 microversion: 2.25 time: 0.176172 Oct 04 21:53:03.013964 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1078/2238] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:53:02 2022] GET /compute/v2.1/servers/b646f5b5-a266-44df-80e6-5d1b2a3b91d7 => generated 1266 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:53:03.045556 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-ec488e16-af53-4e6f-bf8c-3aa3a1c383ef req-114fc5a1-5e38-41c3-ab02-f01dd60f7791 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b646f5b5-a266-44df-80e6-5d1b2a3b91d7", "name": "network-vif-deleted", "tag": "433775b7-13ed-49fa-86e4-2e7c2fe9e176"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:53:03.058727 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-5e097877-0685-40ea-9b51-9c7bb0ce79cd tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] 10.222.0.43 "GET /compute/v2.1/images/147c04e5-7d17-4421-8f9d-3336bdcbaf2e" status: 200 len: 1454 microversion: 2.1 time: 0.142501 Oct 04 21:53:03.061968 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1161/2239] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:53:02 2022] GET /compute/v2.1/images/147c04e5-7d17-4421-8f9d-3336bdcbaf2e => generated 1454 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:53:03.073586 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-ec488e16-af53-4e6f-bf8c-3aa3a1c383ef req-114fc5a1-5e38-41c3-ab02-f01dd60f7791 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:03.074465 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-ec488e16-af53-4e6f-bf8c-3aa3a1c383ef req-114fc5a1-5e38-41c3-ab02-f01dd60f7791 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:03.076506 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-ec488e16-af53-4e6f-bf8c-3aa3a1c383ef req-114fc5a1-5e38-41c3-ab02-f01dd60f7791 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:03.096159 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-ec488e16-af53-4e6f-bf8c-3aa3a1c383ef req-114fc5a1-5e38-41c3-ab02-f01dd60f7791 service nova] Creating event network-vif-deleted:433775b7-13ed-49fa-86e4-2e7c2fe9e176 for instance b646f5b5-a266-44df-80e6-5d1b2a3b91d7 on n-h2-860284-1 Oct 04 21:53:03.107210 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-ec488e16-af53-4e6f-bf8c-3aa3a1c383ef req-114fc5a1-5e38-41c3-ab02-f01dd60f7791 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091705 Oct 04 21:53:03.114234 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1079/2240] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:53:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:53:03.865120 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-91a8c482-dad1-43f2-81d7-b7e8f45b873f tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:03.865884 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-91a8c482-dad1-43f2-81d7-b7e8f45b873f tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] [instance: 830de6ad-adc6-4d16-ae9d-a29ae85e6cd2] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:53:03.876915 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell0:SELECT=2 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:53:03.880552 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-91a8c482-dad1-43f2-81d7-b7e8f45b873f tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:03.887009 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-91a8c482-dad1-43f2-81d7-b7e8f45b873f tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:03.887628 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-91a8c482-dad1-43f2-81d7-b7e8f45b873f tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:03.888486 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-91a8c482-dad1-43f2-81d7-b7e8f45b873f tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:03.890047 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-91a8c482-dad1-43f2-81d7-b7e8f45b873f tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:03.890771 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-91a8c482-dad1-43f2-81d7-b7e8f45b873f tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:03.934013 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-153ca4c0-55c6-40ac-8f77-6c814986e68c tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:03.934796 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-153ca4c0-55c6-40ac-8f77-6c814986e68c tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 152003e4-2a7b-4801-8656-73093cd566ed] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:53:03.970698 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-153ca4c0-55c6-40ac-8f77-6c814986e68c tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:03.973306 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-153ca4c0-55c6-40ac-8f77-6c814986e68c tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:03.973866 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-153ca4c0-55c6-40ac-8f77-6c814986e68c tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:03.983423 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-153ca4c0-55c6-40ac-8f77-6c814986e68c tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:03.983697 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-153ca4c0-55c6-40ac-8f77-6c814986e68c tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:03.984188 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-153ca4c0-55c6-40ac-8f77-6c814986e68c tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:04.613829 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-91a8c482-dad1-43f2-81d7-b7e8f45b873f tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:04.637477 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-91a8c482-dad1-43f2-81d7-b7e8f45b873f tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:04.643562 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-91a8c482-dad1-43f2-81d7-b7e8f45b873f tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:04.647467 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-91a8c482-dad1-43f2-81d7-b7e8f45b873f tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] 10.222.0.43 "GET /compute/v2.1/servers/830de6ad-adc6-4d16-ae9d-a29ae85e6cd2" status: 200 len: 1660 microversion: 2.42 time: 0.787544 Oct 04 21:53:04.649613 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1162/2241] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:53:03 2022] GET /compute/v2.1/servers/830de6ad-adc6-4d16-ae9d-a29ae85e6cd2 => generated 1660 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:53:04.660620 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-4027874a-b7b8-4683-81e1-9c322d919204 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:04.661717 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-4027874a-b7b8-4683-81e1-9c322d919204 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] [instance: b646f5b5-a266-44df-80e6-5d1b2a3b91d7] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:53:04.674732 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4027874a-b7b8-4683-81e1-9c322d919204 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:04.678413 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4027874a-b7b8-4683-81e1-9c322d919204 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:04.679129 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4027874a-b7b8-4683-81e1-9c322d919204 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:04.680166 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4027874a-b7b8-4683-81e1-9c322d919204 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:04.683283 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4027874a-b7b8-4683-81e1-9c322d919204 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:04.684000 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4027874a-b7b8-4683-81e1-9c322d919204 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:04.800544 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-153ca4c0-55c6-40ac-8f77-6c814986e68c tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ad048becf474fb972d4291422d810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dcfc7024fc49388c4bd5f25f03e60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:04.817547 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-153ca4c0-55c6-40ac-8f77-6c814986e68c tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/152003e4-2a7b-4801-8656-73093cd566ed" status: 200 len: 1390 microversion: 2.1 time: 0.889600 Oct 04 21:53:04.822674 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1080/2242] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:53:03 2022] GET /compute/v2.1/servers/152003e4-2a7b-4801-8656-73093cd566ed => generated 1390 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:53:04.852364 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-0d5cfe88-96fb-445e-a681-acfce51bc80a tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Calling method '.version_select at 0x7fbb2e616940>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:04.925669 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-0d5cfe88-96fb-445e-a681-acfce51bc80a tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] 10.222.0.43 "GET /compute/v2.1/images/147c04e5-7d17-4421-8f9d-3336bdcbaf2e" status: 200 len: 1454 microversion: 2.1 time: 0.099480 Oct 04 21:53:04.926327 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1081/2243] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:53:04 2022] GET /compute/v2.1/images/147c04e5-7d17-4421-8f9d-3336bdcbaf2e => generated 1454 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:53:04.956187 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-4027874a-b7b8-4683-81e1-9c322d919204 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:04.983240 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-4027874a-b7b8-4683-81e1-9c322d919204 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:04.983240 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-4027874a-b7b8-4683-81e1-9c322d919204 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:04.983240 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-4027874a-b7b8-4683-81e1-9c322d919204 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] 10.222.0.43 "GET /compute/v2.1/servers/b646f5b5-a266-44df-80e6-5d1b2a3b91d7" status: 200 len: 1266 microversion: 2.25 time: 0.327870 Oct 04 21:53:04.983240 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1163/2244] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:53:04 2022] GET /compute/v2.1/servers/b646f5b5-a266-44df-80e6-5d1b2a3b91d7 => generated 1266 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:53:05.690866 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-6591eef4-8cee-42c0-9e58-ecf5a377e926 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:05.692504 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-6591eef4-8cee-42c0-9e58-ecf5a377e926 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] [instance: 830de6ad-adc6-4d16-ae9d-a29ae85e6cd2] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:53:05.729191 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6591eef4-8cee-42c0-9e58-ecf5a377e926 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:05.729902 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6591eef4-8cee-42c0-9e58-ecf5a377e926 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:05.731390 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6591eef4-8cee-42c0-9e58-ecf5a377e926 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:05.733710 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6591eef4-8cee-42c0-9e58-ecf5a377e926 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:05.737550 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6591eef4-8cee-42c0-9e58-ecf5a377e926 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:05.739350 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6591eef4-8cee-42c0-9e58-ecf5a377e926 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:05.860741 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-faca1a9e-1869-4096-a498-efe55ba152c6 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:05.863334 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-faca1a9e-1869-4096-a498-efe55ba152c6 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 152003e4-2a7b-4801-8656-73093cd566ed] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:53:05.920456 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-faca1a9e-1869-4096-a498-efe55ba152c6 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:05.921355 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-faca1a9e-1869-4096-a498-efe55ba152c6 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:05.923771 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-faca1a9e-1869-4096-a498-efe55ba152c6 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:05.929149 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-faca1a9e-1869-4096-a498-efe55ba152c6 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:05.934104 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-faca1a9e-1869-4096-a498-efe55ba152c6 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:05.935775 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-faca1a9e-1869-4096-a498-efe55ba152c6 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:06.527139 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-faca1a9e-1869-4096-a498-efe55ba152c6 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ad048becf474fb972d4291422d810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dcfc7024fc49388c4bd5f25f03e60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:06.541825 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-faca1a9e-1869-4096-a498-efe55ba152c6 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/152003e4-2a7b-4801-8656-73093cd566ed" status: 200 len: 1390 microversion: 2.1 time: 0.686552 Oct 04 21:53:06.545129 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1164/2245] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:53:05 2022] GET /compute/v2.1/servers/152003e4-2a7b-4801-8656-73093cd566ed => generated 1390 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:53:06.558276 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-6591eef4-8cee-42c0-9e58-ecf5a377e926 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:06.566807 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-d6b947ec-64d1-4ed9-8cea-ee600b98ea95 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Calling method '.version_select at 0x7fbb2f865160>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:06.580999 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-6591eef4-8cee-42c0-9e58-ecf5a377e926 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:06.586295 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-6591eef4-8cee-42c0-9e58-ecf5a377e926 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:06.592171 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-6591eef4-8cee-42c0-9e58-ecf5a377e926 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] 10.222.0.43 "GET /compute/v2.1/servers/830de6ad-adc6-4d16-ae9d-a29ae85e6cd2" status: 200 len: 1660 microversion: 2.42 time: 0.908302 Oct 04 21:53:06.594921 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1082/2246] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:53:05 2022] GET /compute/v2.1/servers/830de6ad-adc6-4d16-ae9d-a29ae85e6cd2 => generated 1660 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:53:06.614789 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-41e64eb3-5471-49b9-9e85-9843cc897bce tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:06.617283 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-41e64eb3-5471-49b9-9e85-9843cc897bce tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] [instance: b646f5b5-a266-44df-80e6-5d1b2a3b91d7] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:53:06.643557 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-41e64eb3-5471-49b9-9e85-9843cc897bce tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:06.645231 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-41e64eb3-5471-49b9-9e85-9843cc897bce tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:06.648047 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-41e64eb3-5471-49b9-9e85-9843cc897bce tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:06.652637 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-41e64eb3-5471-49b9-9e85-9843cc897bce tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:06.653207 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-41e64eb3-5471-49b9-9e85-9843cc897bce tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:06.653666 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-41e64eb3-5471-49b9-9e85-9843cc897bce tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:06.658265 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-d6b947ec-64d1-4ed9-8cea-ee600b98ea95 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] 10.222.0.43 "GET /compute/v2.1/images/147c04e5-7d17-4421-8f9d-3336bdcbaf2e" status: 200 len: 1454 microversion: 2.1 time: 0.111974 Oct 04 21:53:06.659745 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1165/2247] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:53:06 2022] GET /compute/v2.1/images/147c04e5-7d17-4421-8f9d-3336bdcbaf2e => generated 1454 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:53:06.869889 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-41e64eb3-5471-49b9-9e85-9843cc897bce tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:06.890767 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-41e64eb3-5471-49b9-9e85-9843cc897bce tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:06.896186 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-41e64eb3-5471-49b9-9e85-9843cc897bce tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:06.900004 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-41e64eb3-5471-49b9-9e85-9843cc897bce tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] 10.222.0.43 "GET /compute/v2.1/servers/b646f5b5-a266-44df-80e6-5d1b2a3b91d7" status: 200 len: 1266 microversion: 2.25 time: 0.302696 Oct 04 21:53:06.900830 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1083/2248] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:53:06 2022] GET /compute/v2.1/servers/b646f5b5-a266-44df-80e6-5d1b2a3b91d7 => generated 1266 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:53:07.572482 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-17f828c3-67c0-4a16-9fa0-b175fabb817e tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:07.573947 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-17f828c3-67c0-4a16-9fa0-b175fabb817e tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 152003e4-2a7b-4801-8656-73093cd566ed] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:53:07.589333 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-17f828c3-67c0-4a16-9fa0-b175fabb817e tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:07.590979 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-17f828c3-67c0-4a16-9fa0-b175fabb817e tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:07.591619 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-17f828c3-67c0-4a16-9fa0-b175fabb817e tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:07.597010 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-17f828c3-67c0-4a16-9fa0-b175fabb817e tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:07.597781 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-17f828c3-67c0-4a16-9fa0-b175fabb817e tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:07.598708 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-17f828c3-67c0-4a16-9fa0-b175fabb817e tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:07.637140 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-421a270b-c1af-4da8-ba99-54f932e94c87 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:07.639216 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-421a270b-c1af-4da8-ba99-54f932e94c87 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] [instance: 830de6ad-adc6-4d16-ae9d-a29ae85e6cd2] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:53:07.657829 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=4 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:53:07.683692 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-421a270b-c1af-4da8-ba99-54f932e94c87 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:07.688146 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-421a270b-c1af-4da8-ba99-54f932e94c87 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:07.688975 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-421a270b-c1af-4da8-ba99-54f932e94c87 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:07.689896 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-421a270b-c1af-4da8-ba99-54f932e94c87 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:07.694535 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-421a270b-c1af-4da8-ba99-54f932e94c87 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:07.695960 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-421a270b-c1af-4da8-ba99-54f932e94c87 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:08.801204 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-17f828c3-67c0-4a16-9fa0-b175fabb817e tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ad048becf474fb972d4291422d810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dcfc7024fc49388c4bd5f25f03e60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:08.831530 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-17f828c3-67c0-4a16-9fa0-b175fabb817e tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/152003e4-2a7b-4801-8656-73093cd566ed" status: 200 len: 1390 microversion: 2.1 time: 1.247758 Oct 04 21:53:08.832335 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1166/2249] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:53:07 2022] GET /compute/v2.1/servers/152003e4-2a7b-4801-8656-73093cd566ed => generated 1390 bytes in 1267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:53:08.837842 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-0f1f3a78-017c-444b-b20b-696307a408fc tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Calling method '.version_select at 0x7fbb2e8d31f0>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:08.935595 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-0f1f3a78-017c-444b-b20b-696307a408fc tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] 10.222.0.43 "GET /compute/v2.1/images/147c04e5-7d17-4421-8f9d-3336bdcbaf2e" status: 200 len: 1454 microversion: 2.1 time: 0.098421 Oct 04 21:53:08.946287 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1167/2250] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:53:08 2022] GET /compute/v2.1/images/147c04e5-7d17-4421-8f9d-3336bdcbaf2e => generated 1454 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:53:09.168114 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-421a270b-c1af-4da8-ba99-54f932e94c87 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:09.206883 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-421a270b-c1af-4da8-ba99-54f932e94c87 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:09.213043 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-421a270b-c1af-4da8-ba99-54f932e94c87 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:09.218001 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-421a270b-c1af-4da8-ba99-54f932e94c87 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] 10.222.0.43 "GET /compute/v2.1/servers/830de6ad-adc6-4d16-ae9d-a29ae85e6cd2" status: 200 len: 1706 microversion: 2.42 time: 1.591272 Oct 04 21:53:09.242098 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1084/2251] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:53:07 2022] GET /compute/v2.1/servers/830de6ad-adc6-4d16-ae9d-a29ae85e6cd2 => generated 1706 bytes in 1616 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:53:09.260233 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-d0f93545-6eeb-457c-a983-ae002e4a6c18 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:09.266200 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-d0f93545-6eeb-457c-a983-ae002e4a6c18 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] [instance: b646f5b5-a266-44df-80e6-5d1b2a3b91d7] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:53:09.282922 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d0f93545-6eeb-457c-a983-ae002e4a6c18 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:09.283766 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d0f93545-6eeb-457c-a983-ae002e4a6c18 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:09.285053 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d0f93545-6eeb-457c-a983-ae002e4a6c18 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:09.287394 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d0f93545-6eeb-457c-a983-ae002e4a6c18 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:09.290574 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d0f93545-6eeb-457c-a983-ae002e4a6c18 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:09.291739 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d0f93545-6eeb-457c-a983-ae002e4a6c18 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:09.305052 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:53:09.431258 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-e6c7b41b-c63b-4d6e-b678-f6bb898d570e tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-9206463", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "e85ea60d-b923-44e9-89b0-0219674139d3"}]}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:53:09.520513 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-d0f93545-6eeb-457c-a983-ae002e4a6c18 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:09.542047 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-d0f93545-6eeb-457c-a983-ae002e4a6c18 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:09.544336 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-d0f93545-6eeb-457c-a983-ae002e4a6c18 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:09.547411 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-d0f93545-6eeb-457c-a983-ae002e4a6c18 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] 10.222.0.43 "GET /compute/v2.1/servers/b646f5b5-a266-44df-80e6-5d1b2a3b91d7" status: 200 len: 1266 microversion: 2.25 time: 0.297358 Oct 04 21:53:09.560050 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1085/2252] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:53:09 2022] GET /compute/v2.1/servers/b646f5b5-a266-44df-80e6-5d1b2a3b91d7 => generated 1266 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:53:09.586352 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.network.neutron [None req-e6c7b41b-c63b-4d6e-b678-f6bb898d570e tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] validate_networks() for [('e85ea60d-b923-44e9-89b0-0219674139d3', None, None, None, None, None)] {{(pid=134102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:53:09.865333 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-0a458d57-f614-4fe1-ba9b-017504c04b58 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:09.873013 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-0a458d57-f614-4fe1-ba9b-017504c04b58 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 152003e4-2a7b-4801-8656-73093cd566ed] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:53:09.898010 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0a458d57-f614-4fe1-ba9b-017504c04b58 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:09.905911 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0a458d57-f614-4fe1-ba9b-017504c04b58 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:09.907166 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0a458d57-f614-4fe1-ba9b-017504c04b58 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:09.908650 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0a458d57-f614-4fe1-ba9b-017504c04b58 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:09.911363 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0a458d57-f614-4fe1-ba9b-017504c04b58 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:09.911993 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0a458d57-f614-4fe1-ba9b-017504c04b58 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:10.564993 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-0a458d57-f614-4fe1-ba9b-017504c04b58 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ad048becf474fb972d4291422d810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dcfc7024fc49388c4bd5f25f03e60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:10.579504 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-0a458d57-f614-4fe1-ba9b-017504c04b58 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/152003e4-2a7b-4801-8656-73093cd566ed" status: 200 len: 1390 microversion: 2.1 time: 0.722912 Oct 04 21:53:10.580102 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1086/2253] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:53:09 2022] GET /compute/v2.1/servers/152003e4-2a7b-4801-8656-73093cd566ed => generated 1390 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:53:10.637409 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-0bf23b2a-6acf-4087-a22c-a8af57c3ae3e tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Calling method '.version_select at 0x7fbb2e6a1b80>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:10.777717 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-0bf23b2a-6acf-4087-a22c-a8af57c3ae3e tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] 10.222.0.43 "GET /compute/v2.1/images/147c04e5-7d17-4421-8f9d-3336bdcbaf2e" status: 200 len: 1454 microversion: 2.1 time: 0.183742 Oct 04 21:53:10.778989 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1087/2254] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:53:10 2022] GET /compute/v2.1/images/147c04e5-7d17-4421-8f9d-3336bdcbaf2e => generated 1454 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:53:10.785168 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-df47ef73-cf9d-4012-a772-aa5ebdd58821 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:10.790506 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-df47ef73-cf9d-4012-a772-aa5ebdd58821 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] [instance: 830de6ad-adc6-4d16-ae9d-a29ae85e6cd2] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:53:10.811295 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-df47ef73-cf9d-4012-a772-aa5ebdd58821 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:10.818832 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-df47ef73-cf9d-4012-a772-aa5ebdd58821 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:10.819899 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-df47ef73-cf9d-4012-a772-aa5ebdd58821 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:10.820887 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-df47ef73-cf9d-4012-a772-aa5ebdd58821 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:10.821583 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-df47ef73-cf9d-4012-a772-aa5ebdd58821 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:10.822228 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-df47ef73-cf9d-4012-a772-aa5ebdd58821 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:11.250605 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-e6c7b41b-c63b-4d6e-b678-f6bb898d570e tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Flavor limits 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:53:11.251102 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-e6c7b41b-c63b-4d6e-b678-f6bb898d570e tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Image limits 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:53:11.251565 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-e6c7b41b-c63b-4d6e-b678-f6bb898d570e tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Flavor pref 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:53:11.252327 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-e6c7b41b-c63b-4d6e-b678-f6bb898d570e tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Image pref 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:53:11.253418 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-e6c7b41b-c63b-4d6e-b678-f6bb898d570e tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:53:11.272038 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e6c7b41b-c63b-4d6e-b678-f6bb898d570e tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:11.278710 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e6c7b41b-c63b-4d6e-b678-f6bb898d570e tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:11.279273 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e6c7b41b-c63b-4d6e-b678-f6bb898d570e tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:11.282654 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e6c7b41b-c63b-4d6e-b678-f6bb898d570e tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:11.284022 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e6c7b41b-c63b-4d6e-b678-f6bb898d570e tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:11.286605 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e6c7b41b-c63b-4d6e-b678-f6bb898d570e tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:11.336017 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-e6c7b41b-c63b-4d6e-b678-f6bb898d570e tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Getting quotas for project 2865c04294884d1081c9b1b6fc8f8e09. Resources: {'instances', 'ram', 'cores'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:53:11.340673 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-df47ef73-cf9d-4012-a772-aa5ebdd58821 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:11.363617 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-df47ef73-cf9d-4012-a772-aa5ebdd58821 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:11.366877 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-e6c7b41b-c63b-4d6e-b678-f6bb898d570e tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Getting quotas for user 927913a1e0cc4d74b42cb209ec932286 and project 2865c04294884d1081c9b1b6fc8f8e09. Resources: {'instances', 'ram', 'cores'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:53:11.368515 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-df47ef73-cf9d-4012-a772-aa5ebdd58821 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:11.372648 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-df47ef73-cf9d-4012-a772-aa5ebdd58821 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] 10.222.0.43 "GET /compute/v2.1/servers/830de6ad-adc6-4d16-ae9d-a29ae85e6cd2" status: 200 len: 1798 microversion: 2.42 time: 0.592539 Oct 04 21:53:11.397330 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1088/2255] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:53:10 2022] GET /compute/v2.1/servers/830de6ad-adc6-4d16-ae9d-a29ae85e6cd2 => generated 1798 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:53:11.415196 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-0ad6a55f-d671-4a04-aec3-b393f313f667 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:11.417938 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-0ad6a55f-d671-4a04-aec3-b393f313f667 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] [instance: b646f5b5-a266-44df-80e6-5d1b2a3b91d7] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:53:11.432954 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0ad6a55f-d671-4a04-aec3-b393f313f667 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:11.433806 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0ad6a55f-d671-4a04-aec3-b393f313f667 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:11.434522 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0ad6a55f-d671-4a04-aec3-b393f313f667 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:11.435703 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0ad6a55f-d671-4a04-aec3-b393f313f667 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:11.436387 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0ad6a55f-d671-4a04-aec3-b393f313f667 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:11.437119 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0ad6a55f-d671-4a04-aec3-b393f313f667 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:11.447939 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-e6c7b41b-c63b-4d6e-b678-f6bb898d570e tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Going to run 3 instances... {{(pid=134102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:53:11.459836 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-e6c7b41b-c63b-4d6e-b678-f6bb898d570e tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] [instance: a120b0ad-f6e3-4ecb-9312-e92d5c115fd3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='58548514-5dac-426c-81f5-19e3fba33e23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:53:11.550464 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-e6c7b41b-c63b-4d6e-b678-f6bb898d570e tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] [instance: 75061d5c-d642-48c4-8b19-b9252812b2cc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='58548514-5dac-426c-81f5-19e3fba33e23',instance=,instance_uuid=a120b0ad-f6e3-4ecb-9312-e92d5c115fd3,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:53:11.649619 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-e6c7b41b-c63b-4d6e-b678-f6bb898d570e tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] [instance: 12f775af-b918-467b-a6d1-3ca8a7957f37] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='58548514-5dac-426c-81f5-19e3fba33e23',instance=,instance_uuid=75061d5c-d642-48c4-8b19-b9252812b2cc,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:53:11.680417 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-0ad6a55f-d671-4a04-aec3-b393f313f667 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:11.722108 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-0ad6a55f-d671-4a04-aec3-b393f313f667 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:11.725337 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-0ad6a55f-d671-4a04-aec3-b393f313f667 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:11.727428 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-0ad6a55f-d671-4a04-aec3-b393f313f667 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] 10.222.0.43 "GET /compute/v2.1/servers/b646f5b5-a266-44df-80e6-5d1b2a3b91d7" status: 200 len: 1266 microversion: 2.25 time: 0.325241 Oct 04 21:53:11.730077 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1089/2256] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:53:11 2022] GET /compute/v2.1/servers/b646f5b5-a266-44df-80e6-5d1b2a3b91d7 => generated 1266 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:53:11.756093 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-759fcfa9-3dc7-4157-94c0-5c5bcd012d1e tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:11.759458 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-759fcfa9-3dc7-4157-94c0-5c5bcd012d1e tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 152003e4-2a7b-4801-8656-73093cd566ed] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:53:11.784404 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-e6c7b41b-c63b-4d6e-b678-f6bb898d570e tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.836277 Oct 04 21:53:11.786400 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1168/2257] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 21:53:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 2839 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:53:11.799163 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-6d190725-bcff-47e3-8bc4-a65526075060 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Calling method '.version_select at 0x7fbb2efd2b80>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:11.811596 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-759fcfa9-3dc7-4157-94c0-5c5bcd012d1e tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:11.814787 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-759fcfa9-3dc7-4157-94c0-5c5bcd012d1e tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:11.822597 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-759fcfa9-3dc7-4157-94c0-5c5bcd012d1e tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:11.828626 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-759fcfa9-3dc7-4157-94c0-5c5bcd012d1e tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:11.831380 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-759fcfa9-3dc7-4157-94c0-5c5bcd012d1e tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:11.833080 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-759fcfa9-3dc7-4157-94c0-5c5bcd012d1e tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:11.904234 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-6d190725-bcff-47e3-8bc4-a65526075060 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] 10.222.0.43 "GET /compute/v2.1/images/147c04e5-7d17-4421-8f9d-3336bdcbaf2e" status: 200 len: 1454 microversion: 2.1 time: 0.111172 Oct 04 21:53:11.923002 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1169/2258] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:53:11 2022] GET /compute/v2.1/images/147c04e5-7d17-4421-8f9d-3336bdcbaf2e => generated 1454 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:53:11.936672 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-86b615cf-b3e4-4740-b577-809081cd0b70 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:11.972096 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-86b615cf-b3e4-4740-b577-809081cd0b70 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '927913a1e0cc4d74b42cb209ec932286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2865c04294884d1081c9b1b6fc8f8e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:11.974231 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-86b615cf-b3e4-4740-b577-809081cd0b70 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Searching by: {'deleted': False, 'project_id': '2865c04294884d1081c9b1b6fc8f8e09'} {{(pid=134102) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 21:53:12.017091 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-86b615cf-b3e4-4740-b577-809081cd0b70 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:12.017587 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-86b615cf-b3e4-4740-b577-809081cd0b70 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:12.018026 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-86b615cf-b3e4-4740-b577-809081cd0b70 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:12.018786 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-86b615cf-b3e4-4740-b577-809081cd0b70 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:12.019241 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-86b615cf-b3e4-4740-b577-809081cd0b70 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:12.019663 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-86b615cf-b3e4-4740-b577-809081cd0b70 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:12.066376 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-86b615cf-b3e4-4740-b577-809081cd0b70 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] 10.222.0.43 "GET /compute/v2.1/servers" status: 200 len: 1009 microversion: 2.1 time: 0.141762 Oct 04 21:53:12.067318 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1170/2259] 10.222.0.43 () {58 vars in 1125 bytes} [Tue Oct 4 21:53:11 2022] GET /compute/v2.1/servers => generated 1009 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:53:12.086310 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-77d7f535-9531-469d-822c-83c8ed64d166 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:12.087134 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-77d7f535-9531-469d-822c-83c8ed64d166 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] [instance: 12f775af-b918-467b-a6d1-3ca8a7957f37] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:53:12.696478 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-77d7f535-9531-469d-822c-83c8ed64d166 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927913a1e0cc4d74b42cb209ec932286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2865c04294884d1081c9b1b6fc8f8e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:12.723400 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-77d7f535-9531-469d-822c-83c8ed64d166 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] 10.222.0.43 "GET /compute/v2.1/servers/12f775af-b918-467b-a6d1-3ca8a7957f37" status: 200 len: 1220 microversion: 2.1 time: 0.624372 Oct 04 21:53:12.725377 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1171/2260] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:53:12 2022] GET /compute/v2.1/servers/12f775af-b918-467b-a6d1-3ca8a7957f37 => generated 1220 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:53:12.749381 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-27533a35-56f1-49ce-ba08-ddb0fe54e213 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:12.750099 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-27533a35-56f1-49ce-ba08-ddb0fe54e213 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] [instance: 830de6ad-adc6-4d16-ae9d-a29ae85e6cd2] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:53:12.788008 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-27533a35-56f1-49ce-ba08-ddb0fe54e213 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:12.788602 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-27533a35-56f1-49ce-ba08-ddb0fe54e213 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:12.789136 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-27533a35-56f1-49ce-ba08-ddb0fe54e213 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:12.789974 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-27533a35-56f1-49ce-ba08-ddb0fe54e213 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:12.802278 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-27533a35-56f1-49ce-ba08-ddb0fe54e213 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:12.802894 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-27533a35-56f1-49ce-ba08-ddb0fe54e213 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:14.187946 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-759fcfa9-3dc7-4157-94c0-5c5bcd012d1e tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ad048becf474fb972d4291422d810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dcfc7024fc49388c4bd5f25f03e60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:14.239125 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-759fcfa9-3dc7-4157-94c0-5c5bcd012d1e tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/152003e4-2a7b-4801-8656-73093cd566ed" status: 200 len: 1390 microversion: 2.1 time: 2.504205 Oct 04 21:53:14.244250 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1090/2261] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:53:11 2022] GET /compute/v2.1/servers/152003e4-2a7b-4801-8656-73093cd566ed => generated 1390 bytes in 2513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:53:14.279354 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-2b99ec6a-cb84-48f6-9717-9a420c7df2f9 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:14.285031 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-2b99ec6a-cb84-48f6-9717-9a420c7df2f9 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] [instance: b646f5b5-a266-44df-80e6-5d1b2a3b91d7] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:53:14.303865 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-27533a35-56f1-49ce-ba08-ddb0fe54e213 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:14.329618 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2b99ec6a-cb84-48f6-9717-9a420c7df2f9 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:14.330099 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2b99ec6a-cb84-48f6-9717-9a420c7df2f9 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:14.330596 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2b99ec6a-cb84-48f6-9717-9a420c7df2f9 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:14.342494 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2b99ec6a-cb84-48f6-9717-9a420c7df2f9 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:14.343050 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2b99ec6a-cb84-48f6-9717-9a420c7df2f9 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:14.343178 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-27533a35-56f1-49ce-ba08-ddb0fe54e213 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:14.343509 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2b99ec6a-cb84-48f6-9717-9a420c7df2f9 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:14.344794 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-27533a35-56f1-49ce-ba08-ddb0fe54e213 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:14.346035 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-27533a35-56f1-49ce-ba08-ddb0fe54e213 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] 10.222.0.43 "GET /compute/v2.1/servers/830de6ad-adc6-4d16-ae9d-a29ae85e6cd2" status: 200 len: 1844 microversion: 2.42 time: 1.619616 Oct 04 21:53:14.346692 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1172/2262] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:53:12 2022] GET /compute/v2.1/servers/830de6ad-adc6-4d16-ae9d-a29ae85e6cd2 => generated 1844 bytes in 1621 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:53:14.386311 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-1c25ef17-3006-46c5-ae5a-65192284a9dd tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Calling method '.version_select at 0x7fbb2f5d00d0>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:14.501597 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-1c25ef17-3006-46c5-ae5a-65192284a9dd tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] 10.222.0.43 "GET /compute/v2.1/images/147c04e5-7d17-4421-8f9d-3336bdcbaf2e" status: 200 len: 1454 microversion: 2.1 time: 0.153069 Oct 04 21:53:14.517326 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1173/2263] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:53:14 2022] GET /compute/v2.1/images/147c04e5-7d17-4421-8f9d-3336bdcbaf2e => generated 1454 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:53:14.525388 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-a64022e2-ec05-4c50-8911-a57bf49ebe2c tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:14.530389 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-a64022e2-ec05-4c50-8911-a57bf49ebe2c tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] [instance: 12f775af-b918-467b-a6d1-3ca8a7957f37] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:53:14.573579 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a64022e2-ec05-4c50-8911-a57bf49ebe2c tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:14.578893 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a64022e2-ec05-4c50-8911-a57bf49ebe2c tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:14.588939 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a64022e2-ec05-4c50-8911-a57bf49ebe2c tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:14.595899 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a64022e2-ec05-4c50-8911-a57bf49ebe2c tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:14.598567 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a64022e2-ec05-4c50-8911-a57bf49ebe2c tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:14.605317 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a64022e2-ec05-4c50-8911-a57bf49ebe2c tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:15.159679 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-a64022e2-ec05-4c50-8911-a57bf49ebe2c tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927913a1e0cc4d74b42cb209ec932286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2865c04294884d1081c9b1b6fc8f8e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:15.177079 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-a64022e2-ec05-4c50-8911-a57bf49ebe2c tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] 10.222.0.43 "GET /compute/v2.1/servers/12f775af-b918-467b-a6d1-3ca8a7957f37" status: 200 len: 1224 microversion: 2.1 time: 0.655586 Oct 04 21:53:15.181588 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1174/2264] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:53:14 2022] GET /compute/v2.1/servers/12f775af-b918-467b-a6d1-3ca8a7957f37 => generated 1224 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:53:15.515217 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-2b99ec6a-cb84-48f6-9717-9a420c7df2f9 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:15.537226 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-827b3545-a992-455d-95ee-fa8af97bd654 tempest-ComputeTenantNetworksTest-965085513 tempest-ComputeTenantNetworksTest-965085513-project] Calling method '.version_select at 0x7fbb372b1d30>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:15.551769 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-2b99ec6a-cb84-48f6-9717-9a420c7df2f9 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:15.553338 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-2b99ec6a-cb84-48f6-9717-9a420c7df2f9 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:15.567771 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-2b99ec6a-cb84-48f6-9717-9a420c7df2f9 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] 10.222.0.43 "GET /compute/v2.1/servers/b646f5b5-a266-44df-80e6-5d1b2a3b91d7" status: 200 len: 1266 microversion: 2.25 time: 1.309142 Oct 04 21:53:15.568510 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1091/2265] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:53:14 2022] GET /compute/v2.1/servers/b646f5b5-a266-44df-80e6-5d1b2a3b91d7 => generated 1266 bytes in 1324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:53:15.586715 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-bb218824-6497-495c-b53e-41a136dde47c tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:15.587912 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-bb218824-6497-495c-b53e-41a136dde47c tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 152003e4-2a7b-4801-8656-73093cd566ed] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:53:15.607623 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bb218824-6497-495c-b53e-41a136dde47c tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:15.611371 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bb218824-6497-495c-b53e-41a136dde47c tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:15.612215 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bb218824-6497-495c-b53e-41a136dde47c tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:15.613175 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bb218824-6497-495c-b53e-41a136dde47c tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:15.613942 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bb218824-6497-495c-b53e-41a136dde47c tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:15.617163 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bb218824-6497-495c-b53e-41a136dde47c tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:16.582352 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-bb218824-6497-495c-b53e-41a136dde47c tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ad048becf474fb972d4291422d810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dcfc7024fc49388c4bd5f25f03e60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:16.614895 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-bb218824-6497-495c-b53e-41a136dde47c tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/152003e4-2a7b-4801-8656-73093cd566ed" status: 200 len: 1390 microversion: 2.1 time: 1.031144 Oct 04 21:53:16.618259 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1092/2266] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:53:15 2022] GET /compute/v2.1/servers/152003e4-2a7b-4801-8656-73093cd566ed => generated 1390 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:53:16.634496 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-0c68dc87-dd7a-43ae-95cc-77f65f4d0f90 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:16.636176 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-0c68dc87-dd7a-43ae-95cc-77f65f4d0f90 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] [instance: 830de6ad-adc6-4d16-ae9d-a29ae85e6cd2] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:53:16.678284 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0c68dc87-dd7a-43ae-95cc-77f65f4d0f90 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:16.681205 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0c68dc87-dd7a-43ae-95cc-77f65f4d0f90 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:16.682097 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0c68dc87-dd7a-43ae-95cc-77f65f4d0f90 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:16.691317 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0c68dc87-dd7a-43ae-95cc-77f65f4d0f90 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:16.691685 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0c68dc87-dd7a-43ae-95cc-77f65f4d0f90 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:16.692137 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0c68dc87-dd7a-43ae-95cc-77f65f4d0f90 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:16.816632 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-827b3545-a992-455d-95ee-fa8af97bd654 tempest-ComputeTenantNetworksTest-965085513 tempest-ComputeTenantNetworksTest-965085513-project] 10.222.0.43 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 309 microversion: 2.1 time: 1.629473 Oct 04 21:53:16.818461 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1175/2267] 10.222.0.43 () {58 vars in 1158 bytes} [Tue Oct 4 21:53:15 2022] GET /compute/v2.1/os-tenant-networks => generated 309 bytes in 1636 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:53:16.830666 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-82a165ff-2548-4aaf-b30d-9fbfa1c61aff tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Calling method '.version_select at 0x7fbb3735c310>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:16.976081 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-82a165ff-2548-4aaf-b30d-9fbfa1c61aff tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] 10.222.0.43 "GET /compute/v2.1/images/147c04e5-7d17-4421-8f9d-3336bdcbaf2e" status: 200 len: 1454 microversion: 2.1 time: 0.149180 Oct 04 21:53:16.990766 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1176/2268] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:53:16 2022] GET /compute/v2.1/images/147c04e5-7d17-4421-8f9d-3336bdcbaf2e => generated 1454 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:53:16.997253 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-cc78f1e3-5acd-4b0f-ba67-0a2eed5bc259 req-3541b7cd-ba3e-4971-92bd-565caf5431e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "830de6ad-adc6-4d16-ae9d-a29ae85e6cd2", "tag": "480ee163-2b8b-42e9-80e8-28254bda8c68"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:53:17.011732 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-cc78f1e3-5acd-4b0f-ba67-0a2eed5bc259 req-3541b7cd-ba3e-4971-92bd-565caf5431e6 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:17.014100 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-cc78f1e3-5acd-4b0f-ba67-0a2eed5bc259 req-3541b7cd-ba3e-4971-92bd-565caf5431e6 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:17.014990 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-cc78f1e3-5acd-4b0f-ba67-0a2eed5bc259 req-3541b7cd-ba3e-4971-92bd-565caf5431e6 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:17.038274 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-cc78f1e3-5acd-4b0f-ba67-0a2eed5bc259 req-3541b7cd-ba3e-4971-92bd-565caf5431e6 service nova] Creating event network-changed:480ee163-2b8b-42e9-80e8-28254bda8c68 for instance 830de6ad-adc6-4d16-ae9d-a29ae85e6cd2 on n-h1-860284-1 Oct 04 21:53:17.056498 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-cc78f1e3-5acd-4b0f-ba67-0a2eed5bc259 req-3541b7cd-ba3e-4971-92bd-565caf5431e6 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058414 Oct 04 21:53:17.058893 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1177/2269] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:53:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:53:17.069151 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-d989651d-305c-48eb-889e-cbc0def10ccd tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:17.073819 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-d989651d-305c-48eb-889e-cbc0def10ccd tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] [instance: 12f775af-b918-467b-a6d1-3ca8a7957f37] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:53:17.082670 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d989651d-305c-48eb-889e-cbc0def10ccd tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:17.083585 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d989651d-305c-48eb-889e-cbc0def10ccd tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:17.085187 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d989651d-305c-48eb-889e-cbc0def10ccd tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:17.086244 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d989651d-305c-48eb-889e-cbc0def10ccd tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:17.087452 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d989651d-305c-48eb-889e-cbc0def10ccd tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:17.088058 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d989651d-305c-48eb-889e-cbc0def10ccd tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:17.391882 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-d989651d-305c-48eb-889e-cbc0def10ccd tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927913a1e0cc4d74b42cb209ec932286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2865c04294884d1081c9b1b6fc8f8e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:17.406037 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-d989651d-305c-48eb-889e-cbc0def10ccd tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] 10.222.0.43 "GET /compute/v2.1/servers/12f775af-b918-467b-a6d1-3ca8a7957f37" status: 200 len: 1272 microversion: 2.1 time: 0.341864 Oct 04 21:53:17.421183 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1178/2270] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:53:17 2022] GET /compute/v2.1/servers/12f775af-b918-467b-a6d1-3ca8a7957f37 => generated 1272 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:53:17.452384 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-b7152182-dca4-4e6b-8133-344ab77dbf6d tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:17.454284 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-b7152182-dca4-4e6b-8133-344ab77dbf6d tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] [instance: b646f5b5-a266-44df-80e6-5d1b2a3b91d7] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:53:17.478510 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b7152182-dca4-4e6b-8133-344ab77dbf6d tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:17.479630 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b7152182-dca4-4e6b-8133-344ab77dbf6d tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:17.484919 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b7152182-dca4-4e6b-8133-344ab77dbf6d tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:17.487977 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b7152182-dca4-4e6b-8133-344ab77dbf6d tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:17.488789 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b7152182-dca4-4e6b-8133-344ab77dbf6d tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:17.490566 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b7152182-dca4-4e6b-8133-344ab77dbf6d tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:17.897916 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-0c68dc87-dd7a-43ae-95cc-77f65f4d0f90 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:17.912540 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-0c68dc87-dd7a-43ae-95cc-77f65f4d0f90 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:17.918134 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-0c68dc87-dd7a-43ae-95cc-77f65f4d0f90 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:17.919609 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-0c68dc87-dd7a-43ae-95cc-77f65f4d0f90 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] 10.222.0.43 "GET /compute/v2.1/servers/830de6ad-adc6-4d16-ae9d-a29ae85e6cd2" status: 200 len: 1844 microversion: 2.42 time: 1.299836 Oct 04 21:53:17.925718 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1093/2271] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:53:16 2022] GET /compute/v2.1/servers/830de6ad-adc6-4d16-ae9d-a29ae85e6cd2 => generated 1844 bytes in 1306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:53:17.934037 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-14c4f433-91dd-4dc0-b623-688520a9c5f2 tempest-ComputeTenantNetworksTest-965085513 tempest-ComputeTenantNetworksTest-965085513-project] Calling method '.version_select at 0x7fbb2e5a24c0>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:17.992949 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-b7152182-dca4-4e6b-8133-344ab77dbf6d tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:18.006767 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-b7152182-dca4-4e6b-8133-344ab77dbf6d tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:18.011385 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-b7152182-dca4-4e6b-8133-344ab77dbf6d tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:18.012898 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-b7152182-dca4-4e6b-8133-344ab77dbf6d tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] 10.222.0.43 "GET /compute/v2.1/servers/b646f5b5-a266-44df-80e6-5d1b2a3b91d7" status: 200 len: 1266 microversion: 2.25 time: 0.588251 Oct 04 21:53:18.013709 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1179/2272] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:53:17 2022] GET /compute/v2.1/servers/b646f5b5-a266-44df-80e6-5d1b2a3b91d7 => generated 1266 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:53:18.056926 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-2e558bf5-f704-41c8-9a3c-ed6c89a8c52b tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:18.059568 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-2e558bf5-f704-41c8-9a3c-ed6c89a8c52b tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 152003e4-2a7b-4801-8656-73093cd566ed] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:53:18.091095 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2e558bf5-f704-41c8-9a3c-ed6c89a8c52b tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:18.092268 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2e558bf5-f704-41c8-9a3c-ed6c89a8c52b tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:18.093273 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2e558bf5-f704-41c8-9a3c-ed6c89a8c52b tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:18.094965 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2e558bf5-f704-41c8-9a3c-ed6c89a8c52b tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:18.096148 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2e558bf5-f704-41c8-9a3c-ed6c89a8c52b tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:18.097158 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2e558bf5-f704-41c8-9a3c-ed6c89a8c52b tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:18.441479 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-14c4f433-91dd-4dc0-b623-688520a9c5f2 tempest-ComputeTenantNetworksTest-965085513 tempest-ComputeTenantNetworksTest-965085513-project] 10.222.0.43 "GET /compute/v2.1/os-tenant-networks/31100b1d-1ae1-497d-be5f-06b75e0bf89b" status: 200 len: 140 microversion: 2.1 time: 0.513636 Oct 04 21:53:18.442147 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1094/2273] 10.222.0.43 () {58 vars in 1269 bytes} [Tue Oct 4 21:53:17 2022] GET /compute/v2.1/os-tenant-networks/31100b1d-1ae1-497d-be5f-06b75e0bf89b => generated 140 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:53:18.447704 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-a3f0b681-734d-4158-9e43-aac35ec2c365 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Calling method '.version_select at 0x7fbb2e7551f0>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:18.517432 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-a3f0b681-734d-4158-9e43-aac35ec2c365 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] 10.222.0.43 "GET /compute/v2.1/images/147c04e5-7d17-4421-8f9d-3336bdcbaf2e" status: 200 len: 1463 microversion: 2.1 time: 0.073765 Oct 04 21:53:18.518629 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1095/2274] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:53:18 2022] GET /compute/v2.1/images/147c04e5-7d17-4421-8f9d-3336bdcbaf2e => generated 1463 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:53:18.523717 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-46b2e8ac-5cfd-4ee0-915b-5d5ae34fa4dc tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:18.524532 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-46b2e8ac-5cfd-4ee0-915b-5d5ae34fa4dc tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] [instance: 12f775af-b918-467b-a6d1-3ca8a7957f37] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:53:18.532527 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-46b2e8ac-5cfd-4ee0-915b-5d5ae34fa4dc tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:18.533287 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-46b2e8ac-5cfd-4ee0-915b-5d5ae34fa4dc tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:18.534009 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-46b2e8ac-5cfd-4ee0-915b-5d5ae34fa4dc tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:18.535628 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-46b2e8ac-5cfd-4ee0-915b-5d5ae34fa4dc tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:18.536297 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-46b2e8ac-5cfd-4ee0-915b-5d5ae34fa4dc tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:18.537046 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-46b2e8ac-5cfd-4ee0-915b-5d5ae34fa4dc tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:18.781231 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-46b2e8ac-5cfd-4ee0-915b-5d5ae34fa4dc tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927913a1e0cc4d74b42cb209ec932286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2865c04294884d1081c9b1b6fc8f8e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:18.840320 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-46b2e8ac-5cfd-4ee0-915b-5d5ae34fa4dc tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] 10.222.0.43 "GET /compute/v2.1/servers/12f775af-b918-467b-a6d1-3ca8a7957f37" status: 200 len: 1278 microversion: 2.1 time: 0.320177 Oct 04 21:53:18.842570 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1096/2275] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:53:18 2022] GET /compute/v2.1/servers/12f775af-b918-467b-a6d1-3ca8a7957f37 => generated 1278 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:53:18.852378 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-503467f0-47a1-42ec-9457-073fd2b93180 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Calling method '.version_select at 0x7fbb2e641790>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:18.960151 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-503467f0-47a1-42ec-9457-073fd2b93180 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] 10.222.0.43 "GET /compute/v2.1/images/147c04e5-7d17-4421-8f9d-3336bdcbaf2e" status: 200 len: 1463 microversion: 2.1 time: 0.114521 Oct 04 21:53:18.964702 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1097/2276] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:53:18 2022] GET /compute/v2.1/images/147c04e5-7d17-4421-8f9d-3336bdcbaf2e => generated 1463 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:53:18.981152 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-b87d6821-d563-47fd-83d1-f8cfbc344ef0 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:18.982911 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-b87d6821-d563-47fd-83d1-f8cfbc344ef0 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] [instance: 830de6ad-adc6-4d16-ae9d-a29ae85e6cd2] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:53:19.005420 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b87d6821-d563-47fd-83d1-f8cfbc344ef0 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:19.006192 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b87d6821-d563-47fd-83d1-f8cfbc344ef0 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:19.006932 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b87d6821-d563-47fd-83d1-f8cfbc344ef0 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:19.007875 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b87d6821-d563-47fd-83d1-f8cfbc344ef0 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:19.009133 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b87d6821-d563-47fd-83d1-f8cfbc344ef0 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:19.009728 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b87d6821-d563-47fd-83d1-f8cfbc344ef0 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:19.095070 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-2e558bf5-f704-41c8-9a3c-ed6c89a8c52b tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ad048becf474fb972d4291422d810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dcfc7024fc49388c4bd5f25f03e60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:19.108059 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-2e558bf5-f704-41c8-9a3c-ed6c89a8c52b tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/152003e4-2a7b-4801-8656-73093cd566ed" status: 200 len: 1390 microversion: 2.1 time: 1.073946 Oct 04 21:53:19.108978 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1180/2277] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:53:18 2022] GET /compute/v2.1/servers/152003e4-2a7b-4801-8656-73093cd566ed => generated 1390 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:53:19.126448 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-d18c2c2d-054b-459e-ae92-44276ab54159 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:19.127081 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-d18c2c2d-054b-459e-ae92-44276ab54159 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] [instance: 7d0ed6d0-981a-48a7-a676-5910b1257301] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:53:19.133518 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d18c2c2d-054b-459e-ae92-44276ab54159 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:19.134020 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d18c2c2d-054b-459e-ae92-44276ab54159 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:19.134494 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d18c2c2d-054b-459e-ae92-44276ab54159 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:19.135825 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d18c2c2d-054b-459e-ae92-44276ab54159 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:19.136656 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d18c2c2d-054b-459e-ae92-44276ab54159 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:19.137113 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d18c2c2d-054b-459e-ae92-44276ab54159 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:20.792789 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-b87d6821-d563-47fd-83d1-f8cfbc344ef0 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:20.815156 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-b87d6821-d563-47fd-83d1-f8cfbc344ef0 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:20.817311 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-b87d6821-d563-47fd-83d1-f8cfbc344ef0 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:20.819092 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-b87d6821-d563-47fd-83d1-f8cfbc344ef0 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] 10.222.0.43 "GET /compute/v2.1/servers/830de6ad-adc6-4d16-ae9d-a29ae85e6cd2" status: 200 len: 1865 microversion: 2.42 time: 1.850640 Oct 04 21:53:20.821172 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1098/2278] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:53:18 2022] GET /compute/v2.1/servers/830de6ad-adc6-4d16-ae9d-a29ae85e6cd2 => generated 1865 bytes in 1855 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:53:20.837337 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-6fecbf73-c241-4caa-94d0-f0b2b1fa01cb tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:20.838624 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-6fecbf73-c241-4caa-94d0-f0b2b1fa01cb tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] [instance: b646f5b5-a266-44df-80e6-5d1b2a3b91d7] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:53:20.849851 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6fecbf73-c241-4caa-94d0-f0b2b1fa01cb tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:20.855232 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6fecbf73-c241-4caa-94d0-f0b2b1fa01cb tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:20.856263 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6fecbf73-c241-4caa-94d0-f0b2b1fa01cb tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:20.857320 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6fecbf73-c241-4caa-94d0-f0b2b1fa01cb tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:20.858060 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6fecbf73-c241-4caa-94d0-f0b2b1fa01cb tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:20.862958 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6fecbf73-c241-4caa-94d0-f0b2b1fa01cb tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:20.913663 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-6fecbf73-c241-4caa-94d0-f0b2b1fa01cb tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] HTTP exception thrown: Instance b646f5b5-a266-44df-80e6-5d1b2a3b91d7 could not be found. Oct 04 21:53:20.921359 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-6fecbf73-c241-4caa-94d0-f0b2b1fa01cb tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Request method failure captured: Oct 04 21:53:20.921359 n-d-860284-1 devstack@n-api.service[134101]: request: GET /compute/v2.1/servers/b646f5b5-a266-44df-80e6-5d1b2a3b91d7 HTTP/1.1 Oct 04 21:53:20.921359 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 21:53:20.921359 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 21:53:20.921359 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 21:53:20.921359 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 21:53:20.921359 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 21:53:20.921359 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 21:53:20.921359 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 21:53:20.921359 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 21:53:20.921359 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPKlMyaAXDvUTID1IzmmSywCvuysT3aI_a5P3CwNV1RlnNDYDfurU0jpixzpaKj5sOoQgCtK8oEEPLd6IixW0SOcr8dqp0RNwGHWp6j9yDPQZ2lsf_JdMcGPWfUMhVnyczlDBdJXpSneu7x_nFwY0L7QA-CqDJHoDoK7jdZ7w20lPxmA Oct 04 21:53:20.921359 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 21:53:20.921359 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 21:53:20.921359 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 21:53:20.921359 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 21:53:20.921359 n-d-860284-1 devstack@n-api.service[134101]: X-Openstack-Nova-Api-Version: 2.25 Oct 04 21:53:20.921359 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 21:53:20.921359 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 21:53:20.921359 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: f17fee483fd14b07977669df199f3018 Oct 04 21:53:20.921359 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-2121064375 Oct 04 21:53:20.921359 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 21:53:20.921359 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 21:53:20.921359 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f17fee483fd14b07977669df199f3018"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_f17fee483fd14b07977669df199f3018", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f17fee483fd14b07977669df199f3018"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/f17fee483fd14b07977669df199f3018"}]}] Oct 04 21:53:20.921359 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-2121064375 Oct 04 21:53:20.921359 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: f17fee483fd14b07977669df199f3018 Oct 04 21:53:20.921359 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-2121064375 Oct 04 21:53:20.921359 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-LiveAutoBlockMigrationV225Test-2121064375-project Oct 04 21:53:20.921359 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 21:53:20.921359 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 21:53:20.921359 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: f529f881a037459d9405bd14afd7a639 Oct 04 21:53:20.921359 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-2121064375-project Oct 04 21:53:20.921359 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 21:53:20.921359 n-d-860284-1 devstack@n-api.service[134101]: exception: Instance b646f5b5-a266-44df-80e6-5d1b2a3b91d7 could not be found. Oct 04 21:53:20.921359 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': 'b646f5b5-a266-44df-80e6-5d1b2a3b91d7'} Oct 04 21:53:20.921359 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:53:20.921359 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:53:20.921359 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:53:20.921359 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:53:20.921359 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:53:20.921359 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:53:20.921359 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:53:20.921359 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:53:20.921359 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:53:20.921359 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:53:20.921359 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b646f5b5-a266-44df-80e6-5d1b2a3b91d7 could not be found. Oct 04 21:53:20.921359 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:53:20.921359 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:53:20.921359 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:53:20.921359 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:53:20.921359 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:53:20.921359 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:53:20.921359 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:53:20.921359 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:53:20.921359 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:53:20.921359 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:53:20.921359 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:53:20.921359 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:53:20.921359 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:53:20.921359 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:53:20.921359 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:53:20.921359 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:53:20.921359 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b646f5b5-a266-44df-80e6-5d1b2a3b91d7 could not be found. Oct 04 21:53:20.921359 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:53:20.925311 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:53:20.925311 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:53:20.925311 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:53:20.925311 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:53:20.925311 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:53:20.925311 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:53:20.925311 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:53:20.925311 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b646f5b5-a266-44df-80e6-5d1b2a3b91d7 could not be found. Oct 04 21:53:20.925311 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:53:20.930338 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-6fecbf73-c241-4caa-94d0-f0b2b1fa01cb tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Returning 404 to user: Instance b646f5b5-a266-44df-80e6-5d1b2a3b91d7 could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:53:20.932836 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-6fecbf73-c241-4caa-94d0-f0b2b1fa01cb tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] 10.222.0.43 "GET /compute/v2.1/servers/b646f5b5-a266-44df-80e6-5d1b2a3b91d7" status: 404 len: 111 microversion: 2.25 time: 0.109100 Oct 04 21:53:20.934673 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1099/2279] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:53:20 2022] GET /compute/v2.1/servers/b646f5b5-a266-44df-80e6-5d1b2a3b91d7 => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 21:53:20.952584 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-a51dc1c7-a680-4899-98ec-f15f751a0f7c req-020ea76b-4c76-4058-a720-5b518d03995c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "830de6ad-adc6-4d16-ae9d-a29ae85e6cd2", "tag": "655956e8-ae26-4dcc-9d3e-b8894103890e"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:53:20.975405 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-a51dc1c7-a680-4899-98ec-f15f751a0f7c req-020ea76b-4c76-4058-a720-5b518d03995c service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:20.977824 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-a51dc1c7-a680-4899-98ec-f15f751a0f7c req-020ea76b-4c76-4058-a720-5b518d03995c service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:20.978443 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-a51dc1c7-a680-4899-98ec-f15f751a0f7c req-020ea76b-4c76-4058-a720-5b518d03995c service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:21.015277 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-a51dc1c7-a680-4899-98ec-f15f751a0f7c req-020ea76b-4c76-4058-a720-5b518d03995c service nova] Creating event network-changed:655956e8-ae26-4dcc-9d3e-b8894103890e for instance 830de6ad-adc6-4d16-ae9d-a29ae85e6cd2 on n-h1-860284-1 Oct 04 21:53:21.023195 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-a51dc1c7-a680-4899-98ec-f15f751a0f7c req-020ea76b-4c76-4058-a720-5b518d03995c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086389 Oct 04 21:53:21.024340 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1100/2280] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:53:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:53:21.033722 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-dba84148-25ef-4470-a9c3-7d8c9e32b295 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:21.047619 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-dba84148-25ef-4470-a9c3-7d8c9e32b295 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] [instance: 12f775af-b918-467b-a6d1-3ca8a7957f37] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:53:21.055137 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dba84148-25ef-4470-a9c3-7d8c9e32b295 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:21.055988 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dba84148-25ef-4470-a9c3-7d8c9e32b295 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:21.056972 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dba84148-25ef-4470-a9c3-7d8c9e32b295 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:21.067539 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dba84148-25ef-4470-a9c3-7d8c9e32b295 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:21.068208 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dba84148-25ef-4470-a9c3-7d8c9e32b295 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:21.068857 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dba84148-25ef-4470-a9c3-7d8c9e32b295 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:21.113803 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-d18c2c2d-054b-459e-ae92-44276ab54159 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f11c77afc74a16bea945dd84e72ebe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94d03be22238422eba835ed522baf9c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:21.146098 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-d18c2c2d-054b-459e-ae92-44276ab54159 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] 10.222.0.43 "GET /compute/v2.1/servers/7d0ed6d0-981a-48a7-a676-5910b1257301" status: 200 len: 1467 microversion: 2.1 time: 2.019219 Oct 04 21:53:21.151526 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1181/2281] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:53:19 2022] GET /compute/v2.1/servers/7d0ed6d0-981a-48a7-a676-5910b1257301 => generated 1467 bytes in 2040 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:53:21.163818 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-85b101fd-076a-4506-a257-e3b6b402fc66 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:21.167886 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-85b101fd-076a-4506-a257-e3b6b402fc66 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 152003e4-2a7b-4801-8656-73093cd566ed] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:53:21.191525 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-85b101fd-076a-4506-a257-e3b6b402fc66 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:21.193400 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-85b101fd-076a-4506-a257-e3b6b402fc66 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:21.196104 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-85b101fd-076a-4506-a257-e3b6b402fc66 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:21.199141 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-85b101fd-076a-4506-a257-e3b6b402fc66 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:21.200932 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-85b101fd-076a-4506-a257-e3b6b402fc66 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:21.201997 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-85b101fd-076a-4506-a257-e3b6b402fc66 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:21.274443 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-dba84148-25ef-4470-a9c3-7d8c9e32b295 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927913a1e0cc4d74b42cb209ec932286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2865c04294884d1081c9b1b6fc8f8e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:21.285279 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-dba84148-25ef-4470-a9c3-7d8c9e32b295 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] 10.222.0.43 "GET /compute/v2.1/servers/12f775af-b918-467b-a6d1-3ca8a7957f37" status: 200 len: 1278 microversion: 2.1 time: 0.259503 Oct 04 21:53:21.306002 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1101/2282] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:53:21 2022] GET /compute/v2.1/servers/12f775af-b918-467b-a6d1-3ca8a7957f37 => generated 1278 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:53:21.318753 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-fb6a764f-6198-4944-bf4d-d3369fc7c5d2 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1401371434"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:53:21.321179 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-fb6a764f-6198-4944-bf4d-d3369fc7c5d2 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] [instance: 6f8a46c4-3b6f-4f50-8227-77b69154fb57] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:53:21.351548 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fb6a764f-6198-4944-bf4d-d3369fc7c5d2 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:21.359281 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fb6a764f-6198-4944-bf4d-d3369fc7c5d2 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:21.360001 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fb6a764f-6198-4944-bf4d-d3369fc7c5d2 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:21.363168 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fb6a764f-6198-4944-bf4d-d3369fc7c5d2 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:21.363652 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fb6a764f-6198-4944-bf4d-d3369fc7c5d2 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:21.364110 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fb6a764f-6198-4944-bf4d-d3369fc7c5d2 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:21.842828 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-fb6a764f-6198-4944-bf4d-d3369fc7c5d2 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] 10.222.0.43 "POST /compute/v2.1/servers/6f8a46c4-3b6f-4f50-8227-77b69154fb57/action" status: 202 len: 0 microversion: 2.1 time: 0.535177 Oct 04 21:53:21.852209 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1102/2283] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 21:53:21 2022] POST /compute/v2.1/servers/6f8a46c4-3b6f-4f50-8227-77b69154fb57/action => generated 0 bytes in 545 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 04 21:53:21.861113 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-cfae8d4d-feab-4097-9e4f-f1ab6b9ee3e4 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:21.862495 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-cfae8d4d-feab-4097-9e4f-f1ab6b9ee3e4 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] [instance: 830de6ad-adc6-4d16-ae9d-a29ae85e6cd2] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:53:21.872152 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cfae8d4d-feab-4097-9e4f-f1ab6b9ee3e4 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:21.872921 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cfae8d4d-feab-4097-9e4f-f1ab6b9ee3e4 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:21.873547 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cfae8d4d-feab-4097-9e4f-f1ab6b9ee3e4 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:21.874472 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cfae8d4d-feab-4097-9e4f-f1ab6b9ee3e4 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:21.875138 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cfae8d4d-feab-4097-9e4f-f1ab6b9ee3e4 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:21.875917 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cfae8d4d-feab-4097-9e4f-f1ab6b9ee3e4 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:22.053035 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell0:SELECT=4 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:53:22.073871 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-85b101fd-076a-4506-a257-e3b6b402fc66 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ad048becf474fb972d4291422d810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dcfc7024fc49388c4bd5f25f03e60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:22.087262 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-85b101fd-076a-4506-a257-e3b6b402fc66 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/152003e4-2a7b-4801-8656-73093cd566ed" status: 200 len: 1390 microversion: 2.1 time: 0.932139 Oct 04 21:53:22.098939 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1182/2284] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:53:21 2022] GET /compute/v2.1/servers/152003e4-2a7b-4801-8656-73093cd566ed => generated 1390 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:53:22.114809 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-35dfb895-6172-4595-a944-41147d1136d9 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Calling method '.version_select at 0x7fbb2e8d3f70>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:22.208337 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-35dfb895-6172-4595-a944-41147d1136d9 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] 10.222.0.43 "GET /compute/v2.1/images/5157f1c6-d263-427d-84cc-3320cbd286d5" status: 200 len: 1455 microversion: 2.1 time: 0.116453 Oct 04 21:53:22.210762 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1183/2285] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:53:22 2022] GET /compute/v2.1/images/5157f1c6-d263-427d-84cc-3320cbd286d5 => generated 1455 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:53:22.344120 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-eafdc334-48b6-4317-b6e2-7b98ab173572 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:22.345302 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-eafdc334-48b6-4317-b6e2-7b98ab173572 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] [instance: 12f775af-b918-467b-a6d1-3ca8a7957f37] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:53:22.360055 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-eafdc334-48b6-4317-b6e2-7b98ab173572 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:22.361635 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-eafdc334-48b6-4317-b6e2-7b98ab173572 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:22.362200 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-eafdc334-48b6-4317-b6e2-7b98ab173572 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:22.364248 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-eafdc334-48b6-4317-b6e2-7b98ab173572 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:22.365404 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-eafdc334-48b6-4317-b6e2-7b98ab173572 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:22.366191 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-eafdc334-48b6-4317-b6e2-7b98ab173572 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:22.609677 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-eafdc334-48b6-4317-b6e2-7b98ab173572 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927913a1e0cc4d74b42cb209ec932286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2865c04294884d1081c9b1b6fc8f8e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:22.648702 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-eafdc334-48b6-4317-b6e2-7b98ab173572 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] 10.222.0.43 "GET /compute/v2.1/servers/12f775af-b918-467b-a6d1-3ca8a7957f37" status: 200 len: 1278 microversion: 2.1 time: 0.308894 Oct 04 21:53:22.652178 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1184/2286] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:53:22 2022] GET /compute/v2.1/servers/12f775af-b918-467b-a6d1-3ca8a7957f37 => generated 1278 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:53:23.116309 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-0e600f34-72ec-47c0-9d4f-c69e342f4b2a tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:23.116980 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-0e600f34-72ec-47c0-9d4f-c69e342f4b2a tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 152003e4-2a7b-4801-8656-73093cd566ed] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:53:23.121014 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell0:SELECT=8 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:53:23.133501 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0e600f34-72ec-47c0-9d4f-c69e342f4b2a tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:23.138916 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0e600f34-72ec-47c0-9d4f-c69e342f4b2a tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:23.139652 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0e600f34-72ec-47c0-9d4f-c69e342f4b2a tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:23.140611 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0e600f34-72ec-47c0-9d4f-c69e342f4b2a tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:23.142303 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0e600f34-72ec-47c0-9d4f-c69e342f4b2a tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:23.144009 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0e600f34-72ec-47c0-9d4f-c69e342f4b2a tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:23.210127 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-cfae8d4d-feab-4097-9e4f-f1ab6b9ee3e4 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:23.227315 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-cfae8d4d-feab-4097-9e4f-f1ab6b9ee3e4 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:23.233396 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-cfae8d4d-feab-4097-9e4f-f1ab6b9ee3e4 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:23.235814 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-cfae8d4d-feab-4097-9e4f-f1ab6b9ee3e4 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] 10.222.0.43 "GET /compute/v2.1/servers/830de6ad-adc6-4d16-ae9d-a29ae85e6cd2" status: 200 len: 1865 microversion: 2.42 time: 1.380227 Oct 04 21:53:23.237559 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1103/2287] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:53:21 2022] GET /compute/v2.1/servers/830de6ad-adc6-4d16-ae9d-a29ae85e6cd2 => generated 1865 bytes in 1384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:53:23.251451 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-bcdc41ee-7ea1-4af5-93ca-269267176a77 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Calling method '.version_select at 0x7fbb3739e790>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:23.332097 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-bcdc41ee-7ea1-4af5-93ca-269267176a77 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] 10.222.0.43 "GET /compute/v2.1/images/5157f1c6-d263-427d-84cc-3320cbd286d5" status: 200 len: 1455 microversion: 2.1 time: 0.093303 Oct 04 21:53:23.338779 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1104/2288] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:53:23 2022] GET /compute/v2.1/images/5157f1c6-d263-427d-84cc-3320cbd286d5 => generated 1455 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:53:23.344976 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-61e2ef02-72d7-4c5d-8692-f5b6245a78ca req-f77a1062-0dd7-406f-aecc-6f5745b168c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d0ed6d0-981a-48a7-a676-5910b1257301", "name": "network-vif-unplugged", "status": "completed", "tag": "0ba64ce4-a23d-464b-a37e-fdb0f8a91b4b"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:53:23.375452 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=74,nova_api:UPDATE=1 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:53:23.388301 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-61e2ef02-72d7-4c5d-8692-f5b6245a78ca req-f77a1062-0dd7-406f-aecc-6f5745b168c2 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:23.389031 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-61e2ef02-72d7-4c5d-8692-f5b6245a78ca req-f77a1062-0dd7-406f-aecc-6f5745b168c2 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:23.389601 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-61e2ef02-72d7-4c5d-8692-f5b6245a78ca req-f77a1062-0dd7-406f-aecc-6f5745b168c2 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:23.418825 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-61e2ef02-72d7-4c5d-8692-f5b6245a78ca req-f77a1062-0dd7-406f-aecc-6f5745b168c2 service nova] Creating event network-vif-unplugged:0ba64ce4-a23d-464b-a37e-fdb0f8a91b4b for instance 7d0ed6d0-981a-48a7-a676-5910b1257301 on n-h2-860284-1 Oct 04 21:53:23.428736 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-61e2ef02-72d7-4c5d-8692-f5b6245a78ca req-f77a1062-0dd7-406f-aecc-6f5745b168c2 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.087440 Oct 04 21:53:23.438394 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1105/2289] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:53:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:53:23.689976 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-43854a94-8a4c-4175-9b37-18aa3fa3a5ba tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:23.691136 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-43854a94-8a4c-4175-9b37-18aa3fa3a5ba tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] [instance: 12f775af-b918-467b-a6d1-3ca8a7957f37] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:53:23.712499 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-43854a94-8a4c-4175-9b37-18aa3fa3a5ba tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:23.714147 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-43854a94-8a4c-4175-9b37-18aa3fa3a5ba tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:23.717139 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-43854a94-8a4c-4175-9b37-18aa3fa3a5ba tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:23.720034 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-43854a94-8a4c-4175-9b37-18aa3fa3a5ba tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:23.721468 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-43854a94-8a4c-4175-9b37-18aa3fa3a5ba tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:23.724586 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-43854a94-8a4c-4175-9b37-18aa3fa3a5ba tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:23.970192 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-0e600f34-72ec-47c0-9d4f-c69e342f4b2a tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ad048becf474fb972d4291422d810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dcfc7024fc49388c4bd5f25f03e60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:23.989758 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-0e600f34-72ec-47c0-9d4f-c69e342f4b2a tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/152003e4-2a7b-4801-8656-73093cd566ed" status: 200 len: 1390 microversion: 2.1 time: 0.878595 Oct 04 21:53:23.993081 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1185/2290] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:53:23 2022] GET /compute/v2.1/servers/152003e4-2a7b-4801-8656-73093cd566ed => generated 1390 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:53:24.007149 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-1508fb37-c7a0-43a4-9370-fa8960ba896a req-3e2339dd-0d92-4a16-9482-93da5c9ba94b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "830de6ad-adc6-4d16-ae9d-a29ae85e6cd2", "tag": "adbb4038-b82a-4af8-902c-9694d969d663"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:53:24.039999 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-1508fb37-c7a0-43a4-9370-fa8960ba896a req-3e2339dd-0d92-4a16-9482-93da5c9ba94b service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:24.042968 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-1508fb37-c7a0-43a4-9370-fa8960ba896a req-3e2339dd-0d92-4a16-9482-93da5c9ba94b service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:24.043872 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-1508fb37-c7a0-43a4-9370-fa8960ba896a req-3e2339dd-0d92-4a16-9482-93da5c9ba94b service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:24.082617 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-1508fb37-c7a0-43a4-9370-fa8960ba896a req-3e2339dd-0d92-4a16-9482-93da5c9ba94b service nova] Creating event network-changed:adbb4038-b82a-4af8-902c-9694d969d663 for instance 830de6ad-adc6-4d16-ae9d-a29ae85e6cd2 on n-h1-860284-1 Oct 04 21:53:24.102147 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-1508fb37-c7a0-43a4-9370-fa8960ba896a req-3e2339dd-0d92-4a16-9482-93da5c9ba94b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105375 Oct 04 21:53:24.123048 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1186/2291] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:53:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:53:24.266250 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-c16cc7bf-31f3-4d09-b2dd-be1a629077f6 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:24.267571 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-c16cc7bf-31f3-4d09-b2dd-be1a629077f6 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] [instance: 830de6ad-adc6-4d16-ae9d-a29ae85e6cd2] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:53:24.287298 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c16cc7bf-31f3-4d09-b2dd-be1a629077f6 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:24.289039 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c16cc7bf-31f3-4d09-b2dd-be1a629077f6 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:24.289498 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c16cc7bf-31f3-4d09-b2dd-be1a629077f6 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:24.295165 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c16cc7bf-31f3-4d09-b2dd-be1a629077f6 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:24.295949 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c16cc7bf-31f3-4d09-b2dd-be1a629077f6 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:24.297693 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c16cc7bf-31f3-4d09-b2dd-be1a629077f6 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:24.467330 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-43854a94-8a4c-4175-9b37-18aa3fa3a5ba tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927913a1e0cc4d74b42cb209ec932286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2865c04294884d1081c9b1b6fc8f8e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:24.482731 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-43854a94-8a4c-4175-9b37-18aa3fa3a5ba tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] 10.222.0.43 "GET /compute/v2.1/servers/12f775af-b918-467b-a6d1-3ca8a7957f37" status: 200 len: 1320 microversion: 2.1 time: 0.807769 Oct 04 21:53:24.485069 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1106/2292] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:53:23 2022] GET /compute/v2.1/servers/12f775af-b918-467b-a6d1-3ca8a7957f37 => generated 1320 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:53:24.491097 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-581b59fe-876f-444f-b839-746cd2037bf0 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Calling method '.version_select at 0x7fbb2e7551f0>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:24.560316 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-581b59fe-876f-444f-b839-746cd2037bf0 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] 10.222.0.43 "GET /compute/v2.1/images/5157f1c6-d263-427d-84cc-3320cbd286d5" status: 200 len: 1455 microversion: 2.1 time: 0.073177 Oct 04 21:53:24.560918 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1107/2293] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:53:24 2022] GET /compute/v2.1/images/5157f1c6-d263-427d-84cc-3320cbd286d5 => generated 1455 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:53:25.023970 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-bba9a6df-bba9-4eca-b931-e6efe3fb7680 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:25.024958 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-bba9a6df-bba9-4eca-b931-e6efe3fb7680 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 152003e4-2a7b-4801-8656-73093cd566ed] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:53:25.044134 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-c16cc7bf-31f3-4d09-b2dd-be1a629077f6 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:25.049612 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bba9a6df-bba9-4eca-b931-e6efe3fb7680 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:25.053421 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bba9a6df-bba9-4eca-b931-e6efe3fb7680 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:25.055070 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bba9a6df-bba9-4eca-b931-e6efe3fb7680 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:25.055841 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bba9a6df-bba9-4eca-b931-e6efe3fb7680 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:25.056320 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bba9a6df-bba9-4eca-b931-e6efe3fb7680 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:25.060101 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-c16cc7bf-31f3-4d09-b2dd-be1a629077f6 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:25.062183 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bba9a6df-bba9-4eca-b931-e6efe3fb7680 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:25.063297 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-c16cc7bf-31f3-4d09-b2dd-be1a629077f6 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:25.066155 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-c16cc7bf-31f3-4d09-b2dd-be1a629077f6 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] 10.222.0.43 "GET /compute/v2.1/servers/830de6ad-adc6-4d16-ae9d-a29ae85e6cd2" status: 200 len: 1886 microversion: 2.42 time: 0.805295 Oct 04 21:53:25.067408 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1187/2294] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:53:24 2022] GET /compute/v2.1/servers/830de6ad-adc6-4d16-ae9d-a29ae85e6cd2 => generated 1886 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:53:25.121036 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:53:25.173935 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-c16cc7bf-31f3-4d09-b2dd-be1a629077f6 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:25.175713 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-c16cc7bf-31f3-4d09-b2dd-be1a629077f6 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] 10.222.0.43 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002403 Oct 04 21:53:25.176572 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1188/2295] 10.222.0.43 () {56 vars in 886 bytes} [Tue Oct 4 21:53:25 2022] GET /compute/ => generated 377 bytes in 4 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 04 21:53:25.186643 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-c16cc7bf-31f3-4d09-b2dd-be1a629077f6 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:25.188221 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-c16cc7bf-31f3-4d09-b2dd-be1a629077f6 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] 10.222.0.43 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.002979 Oct 04 21:53:25.198956 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1189/2296] 10.222.0.43 () {54 vars in 1035 bytes} [Tue Oct 4 21:53:25 2022] GET /compute/v2/ => generated 379 bytes in 14 msecs (HTTP/1.1 200) 5 headers in 221 bytes (1 switches on core 0) Oct 04 21:53:25.200608 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-c16cc7bf-31f3-4d09-b2dd-be1a629077f6 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:25.201929 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-c16cc7bf-31f3-4d09-b2dd-be1a629077f6 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] 10.222.0.43 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001762 Oct 04 21:53:25.212457 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1190/2297] 10.222.0.43 () {54 vars in 1041 bytes} [Tue Oct 4 21:53:25 2022] GET /compute/v2.1/ => generated 388 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:53:25.214283 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-c16cc7bf-31f3-4d09-b2dd-be1a629077f6 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:25.215433 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-c16cc7bf-31f3-4d09-b2dd-be1a629077f6 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] 10.222.0.43 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001412 Oct 04 21:53:25.225042 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1191/2298] 10.222.0.43 () {56 vars in 886 bytes} [Tue Oct 4 21:53:25 2022] GET /compute/ => generated 377 bytes in 12 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 04 21:53:25.513170 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-bba9a6df-bba9-4eca-b931-e6efe3fb7680 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ad048becf474fb972d4291422d810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dcfc7024fc49388c4bd5f25f03e60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:25.522039 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-2a1fbfa2-e5ce-465e-ac1d-5e0aa76a0b6c tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:25.523881 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-2a1fbfa2-e5ce-465e-ac1d-5e0aa76a0b6c tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] [instance: 12f775af-b918-467b-a6d1-3ca8a7957f37] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:53:25.546070 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-bba9a6df-bba9-4eca-b931-e6efe3fb7680 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/152003e4-2a7b-4801-8656-73093cd566ed" status: 200 len: 1390 microversion: 2.1 time: 0.521484 Oct 04 21:53:25.547366 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1108/2299] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:53:25 2022] GET /compute/v2.1/servers/152003e4-2a7b-4801-8656-73093cd566ed => generated 1390 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:53:25.548258 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2a1fbfa2-e5ce-465e-ac1d-5e0aa76a0b6c tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:25.549594 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2a1fbfa2-e5ce-465e-ac1d-5e0aa76a0b6c tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:25.550209 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2a1fbfa2-e5ce-465e-ac1d-5e0aa76a0b6c tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:25.552291 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2a1fbfa2-e5ce-465e-ac1d-5e0aa76a0b6c tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:25.552931 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2a1fbfa2-e5ce-465e-ac1d-5e0aa76a0b6c tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:25.553686 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2a1fbfa2-e5ce-465e-ac1d-5e0aa76a0b6c tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:25.578854 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-4a9b3d11-92ef-4cb1-ba06-abc909049806 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Calling method '.version_select at 0x7fbb2e724af0>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:25.611594 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=100 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:53:25.644775 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-4a9b3d11-92ef-4cb1-ba06-abc909049806 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] 10.222.0.43 "GET /compute/v2.1/images/5157f1c6-d263-427d-84cc-3320cbd286d5" status: 200 len: 1455 microversion: 2.1 time: 0.072236 Oct 04 21:53:25.647610 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1109/2300] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:53:25 2022] GET /compute/v2.1/images/5157f1c6-d263-427d-84cc-3320cbd286d5 => generated 1455 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:53:26.094416 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-53e0178a-f618-41e8-8aec-ccb623b59411 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:26.096010 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-53e0178a-f618-41e8-8aec-ccb623b59411 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] [instance: 830de6ad-adc6-4d16-ae9d-a29ae85e6cd2] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:53:26.116115 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-53e0178a-f618-41e8-8aec-ccb623b59411 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:26.118801 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-53e0178a-f618-41e8-8aec-ccb623b59411 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:26.123876 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-53e0178a-f618-41e8-8aec-ccb623b59411 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:26.125004 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-53e0178a-f618-41e8-8aec-ccb623b59411 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:26.125668 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-53e0178a-f618-41e8-8aec-ccb623b59411 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:26.126349 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-53e0178a-f618-41e8-8aec-ccb623b59411 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:26.589337 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-2a1fbfa2-e5ce-465e-ac1d-5e0aa76a0b6c tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927913a1e0cc4d74b42cb209ec932286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2865c04294884d1081c9b1b6fc8f8e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:26.605425 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-2a1fbfa2-e5ce-465e-ac1d-5e0aa76a0b6c tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] 10.222.0.43 "GET /compute/v2.1/servers/12f775af-b918-467b-a6d1-3ca8a7957f37" status: 200 len: 1320 microversion: 2.1 time: 1.095771 Oct 04 21:53:26.623135 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1192/2301] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:53:25 2022] GET /compute/v2.1/servers/12f775af-b918-467b-a6d1-3ca8a7957f37 => generated 1320 bytes in 1115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:53:26.634033 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-79a08cf6-ed2d-4756-a8ed-c167f7dd396b req-9f829c32-dcdc-4400-831b-22c3c37c232d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75061d5c-d642-48c4-8b19-b9252812b2cc", "tag": "56b627cb-784d-4dfc-8862-7083e7643d23"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:53:26.647251 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=9 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:53:26.652424 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-79a08cf6-ed2d-4756-a8ed-c167f7dd396b req-9f829c32-dcdc-4400-831b-22c3c37c232d service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:26.653108 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-79a08cf6-ed2d-4756-a8ed-c167f7dd396b req-9f829c32-dcdc-4400-831b-22c3c37c232d service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:26.653921 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-79a08cf6-ed2d-4756-a8ed-c167f7dd396b req-9f829c32-dcdc-4400-831b-22c3c37c232d service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:26.678026 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-79a08cf6-ed2d-4756-a8ed-c167f7dd396b req-9f829c32-dcdc-4400-831b-22c3c37c232d service nova] Creating event network-changed:56b627cb-784d-4dfc-8862-7083e7643d23 for instance 75061d5c-d642-48c4-8b19-b9252812b2cc on n-h2-860284-1 Oct 04 21:53:26.692732 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-79a08cf6-ed2d-4756-a8ed-c167f7dd396b req-9f829c32-dcdc-4400-831b-22c3c37c232d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065421 Oct 04 21:53:26.693682 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1193/2302] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:53:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:53:26.701692 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-4e05705d-d946-40fe-8b4a-f6006c9fdc18 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:26.702585 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-4e05705d-d946-40fe-8b4a-f6006c9fdc18 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 152003e4-2a7b-4801-8656-73093cd566ed] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:53:26.711424 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4e05705d-d946-40fe-8b4a-f6006c9fdc18 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:26.712197 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4e05705d-d946-40fe-8b4a-f6006c9fdc18 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:26.713367 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4e05705d-d946-40fe-8b4a-f6006c9fdc18 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:26.714516 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4e05705d-d946-40fe-8b4a-f6006c9fdc18 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:26.715751 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4e05705d-d946-40fe-8b4a-f6006c9fdc18 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:26.716346 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4e05705d-d946-40fe-8b4a-f6006c9fdc18 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:26.896237 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-53e0178a-f618-41e8-8aec-ccb623b59411 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:26.916019 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-53e0178a-f618-41e8-8aec-ccb623b59411 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:26.921397 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-53e0178a-f618-41e8-8aec-ccb623b59411 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:26.923683 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-53e0178a-f618-41e8-8aec-ccb623b59411 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] 10.222.0.43 "GET /compute/v2.1/servers/830de6ad-adc6-4d16-ae9d-a29ae85e6cd2" status: 200 len: 1886 microversion: 2.42 time: 0.833610 Oct 04 21:53:26.924903 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1110/2303] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:53:26 2022] GET /compute/v2.1/servers/830de6ad-adc6-4d16-ae9d-a29ae85e6cd2 => generated 1886 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:53:26.932339 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-a42b09fd-7ee8-4337-8483-b62750b45931 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Calling method '.version_select at 0x7fbb2e6a18b0>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:27.089275 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-a42b09fd-7ee8-4337-8483-b62750b45931 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] 10.222.0.43 "GET /compute/v2.1/images/5157f1c6-d263-427d-84cc-3320cbd286d5" status: 200 len: 1455 microversion: 2.1 time: 0.159946 Oct 04 21:53:27.090048 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1111/2304] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:53:26 2022] GET /compute/v2.1/images/5157f1c6-d263-427d-84cc-3320cbd286d5 => generated 1455 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:53:27.548172 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-4e05705d-d946-40fe-8b4a-f6006c9fdc18 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ad048becf474fb972d4291422d810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dcfc7024fc49388c4bd5f25f03e60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:27.569236 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-4e05705d-d946-40fe-8b4a-f6006c9fdc18 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/152003e4-2a7b-4801-8656-73093cd566ed" status: 200 len: 1390 microversion: 2.1 time: 0.873495 Oct 04 21:53:27.593202 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1194/2305] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:53:26 2022] GET /compute/v2.1/servers/152003e4-2a7b-4801-8656-73093cd566ed => generated 1390 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:53:27.633891 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-7222f312-a861-4387-ba8f-8228a7da3218 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:27.636853 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-7222f312-a861-4387-ba8f-8228a7da3218 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] [instance: 12f775af-b918-467b-a6d1-3ca8a7957f37] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:53:27.653078 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7222f312-a861-4387-ba8f-8228a7da3218 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:27.654232 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7222f312-a861-4387-ba8f-8228a7da3218 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:27.654737 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7222f312-a861-4387-ba8f-8228a7da3218 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:27.657228 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7222f312-a861-4387-ba8f-8228a7da3218 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:27.657721 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7222f312-a861-4387-ba8f-8228a7da3218 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:27.658172 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7222f312-a861-4387-ba8f-8228a7da3218 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:27.959848 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-fe18c519-a785-4a82-bb64-f2660b6fc959 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:27.960540 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-fe18c519-a785-4a82-bb64-f2660b6fc959 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] [instance: 830de6ad-adc6-4d16-ae9d-a29ae85e6cd2] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:53:27.985867 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fe18c519-a785-4a82-bb64-f2660b6fc959 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:27.991797 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fe18c519-a785-4a82-bb64-f2660b6fc959 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:27.992577 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fe18c519-a785-4a82-bb64-f2660b6fc959 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:28.040020 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fe18c519-a785-4a82-bb64-f2660b6fc959 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:28.042827 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fe18c519-a785-4a82-bb64-f2660b6fc959 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.049s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:28.043521 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fe18c519-a785-4a82-bb64-f2660b6fc959 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:28.104314 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-7222f312-a861-4387-ba8f-8228a7da3218 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927913a1e0cc4d74b42cb209ec932286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2865c04294884d1081c9b1b6fc8f8e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:28.120908 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-7222f312-a861-4387-ba8f-8228a7da3218 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] 10.222.0.43 "GET /compute/v2.1/servers/12f775af-b918-467b-a6d1-3ca8a7957f37" status: 200 len: 1320 microversion: 2.1 time: 0.489430 Oct 04 21:53:28.122711 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1112/2306] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:53:27 2022] GET /compute/v2.1/servers/12f775af-b918-467b-a6d1-3ca8a7957f37 => generated 1320 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:53:28.134222 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-41ab3905-3ac9-4351-bad1-80603948ad5b req-d755cdc9-3398-47e2-9548-2eab4291dec6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12f775af-b918-467b-a6d1-3ca8a7957f37", "tag": "f26bd1ab-0812-4c55-bd30-aafbfbf55ec2"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:53:28.168761 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-41ab3905-3ac9-4351-bad1-80603948ad5b req-d755cdc9-3398-47e2-9548-2eab4291dec6 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:28.169597 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-41ab3905-3ac9-4351-bad1-80603948ad5b req-d755cdc9-3398-47e2-9548-2eab4291dec6 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:28.174528 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-41ab3905-3ac9-4351-bad1-80603948ad5b req-d755cdc9-3398-47e2-9548-2eab4291dec6 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:28.215781 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-41ab3905-3ac9-4351-bad1-80603948ad5b req-d755cdc9-3398-47e2-9548-2eab4291dec6 service nova] Creating event network-changed:f26bd1ab-0812-4c55-bd30-aafbfbf55ec2 for instance 12f775af-b918-467b-a6d1-3ca8a7957f37 on n-h1-860284-1 Oct 04 21:53:28.237460 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-41ab3905-3ac9-4351-bad1-80603948ad5b req-d755cdc9-3398-47e2-9548-2eab4291dec6 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113129 Oct 04 21:53:28.238515 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1113/2307] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:53:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:53:28.244340 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-aa18cc12-3c1a-4fa1-855e-0f822e19f5cc tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Calling method '.version_select at 0x7fbb2e7ee160>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:28.336181 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-aa18cc12-3c1a-4fa1-855e-0f822e19f5cc tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] 10.222.0.43 "GET /compute/v2.1/images/5157f1c6-d263-427d-84cc-3320cbd286d5" status: 200 len: 1455 microversion: 2.1 time: 0.096385 Oct 04 21:53:28.337040 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1114/2308] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:53:28 2022] GET /compute/v2.1/images/5157f1c6-d263-427d-84cc-3320cbd286d5 => generated 1455 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:53:28.658564 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-fe18c519-a785-4a82-bb64-f2660b6fc959 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:28.670017 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-fe18c519-a785-4a82-bb64-f2660b6fc959 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:28.672090 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-fe18c519-a785-4a82-bb64-f2660b6fc959 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:28.673593 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-fe18c519-a785-4a82-bb64-f2660b6fc959 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] 10.222.0.43 "GET /compute/v2.1/servers/830de6ad-adc6-4d16-ae9d-a29ae85e6cd2" status: 200 len: 1886 microversion: 2.42 time: 0.721785 Oct 04 21:53:28.695751 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1195/2309] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:53:27 2022] GET /compute/v2.1/servers/830de6ad-adc6-4d16-ae9d-a29ae85e6cd2 => generated 1886 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:53:28.703507 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-776048d7-8b23-45a2-9694-d9872bf6ce87 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:28.704123 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-776048d7-8b23-45a2-9694-d9872bf6ce87 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 152003e4-2a7b-4801-8656-73093cd566ed] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:53:28.724681 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-776048d7-8b23-45a2-9694-d9872bf6ce87 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:28.725191 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-776048d7-8b23-45a2-9694-d9872bf6ce87 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:28.725639 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-776048d7-8b23-45a2-9694-d9872bf6ce87 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:28.726384 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-776048d7-8b23-45a2-9694-d9872bf6ce87 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:28.729535 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-776048d7-8b23-45a2-9694-d9872bf6ce87 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:28.730260 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-776048d7-8b23-45a2-9694-d9872bf6ce87 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:28.967822 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-776048d7-8b23-45a2-9694-d9872bf6ce87 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ad048becf474fb972d4291422d810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dcfc7024fc49388c4bd5f25f03e60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:28.977485 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-7172517d-4a36-48d8-916f-261b5b5d8305 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1338222688", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:53:28.980049 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-776048d7-8b23-45a2-9694-d9872bf6ce87 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/152003e4-2a7b-4801-8656-73093cd566ed" status: 200 len: 1390 microversion: 2.1 time: 0.286196 Oct 04 21:53:28.980891 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1196/2310] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:53:28 2022] GET /compute/v2.1/servers/152003e4-2a7b-4801-8656-73093cd566ed => generated 1390 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:53:28.987181 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-7658b20b-b6ea-4aa2-a5a3-7dfa7d1d94fe req-9b1d2871-999f-47af-8865-1e9d79cb5a6d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "830de6ad-adc6-4d16-ae9d-a29ae85e6cd2", "tag": "40124c44-6941-426e-92ed-972b6680a618"}, {"name": "network-changed", "server_uuid": "a120b0ad-f6e3-4ecb-9312-e92d5c115fd3", "tag": "67d021b1-9a40-436e-9b43-a6c18c852905"}, {"name": "network-changed", "server_uuid": "830de6ad-adc6-4d16-ae9d-a29ae85e6cd2", "tag": "50799c10-da56-4cd6-bf7b-3175d2e729a5"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:53:29.000772 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-7658b20b-b6ea-4aa2-a5a3-7dfa7d1d94fe req-9b1d2871-999f-47af-8865-1e9d79cb5a6d service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:29.001617 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-7658b20b-b6ea-4aa2-a5a3-7dfa7d1d94fe req-9b1d2871-999f-47af-8865-1e9d79cb5a6d service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:29.002286 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-7658b20b-b6ea-4aa2-a5a3-7dfa7d1d94fe req-9b1d2871-999f-47af-8865-1e9d79cb5a6d service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:29.020934 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-7658b20b-b6ea-4aa2-a5a3-7dfa7d1d94fe req-9b1d2871-999f-47af-8865-1e9d79cb5a6d service nova] Creating event network-changed:40124c44-6941-426e-92ed-972b6680a618 for instance 830de6ad-adc6-4d16-ae9d-a29ae85e6cd2 on n-h1-860284-1 Oct 04 21:53:29.021752 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-7658b20b-b6ea-4aa2-a5a3-7dfa7d1d94fe req-9b1d2871-999f-47af-8865-1e9d79cb5a6d service nova] Creating event network-changed:67d021b1-9a40-436e-9b43-a6c18c852905 for instance a120b0ad-f6e3-4ecb-9312-e92d5c115fd3 on n-h1-860284-1 Oct 04 21:53:29.022390 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-7658b20b-b6ea-4aa2-a5a3-7dfa7d1d94fe req-9b1d2871-999f-47af-8865-1e9d79cb5a6d service nova] Creating event network-changed:50799c10-da56-4cd6-bf7b-3175d2e729a5 for instance 830de6ad-adc6-4d16-ae9d-a29ae85e6cd2 on n-h1-860284-1 Oct 04 21:53:29.038120 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-7658b20b-b6ea-4aa2-a5a3-7dfa7d1d94fe req-9b1d2871-999f-47af-8865-1e9d79cb5a6d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 513 microversion: 2.1 time: 0.054723 Oct 04 21:53:29.039345 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1197/2311] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:53:28 2022] POST /compute/v2.1/os-server-external-events => generated 513 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:53:29.063288 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.network.neutron [None req-7172517d-4a36-48d8-916f-261b5b5d8305 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] validate_networks() for [('315123d0-c9a7-4f3e-ba0c-4d1ba39ebdfa', None, None, None, None, None)] {{(pid=134101) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:53:29.148610 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-fecce0ca-ed5e-4c63-82ea-48d09b367e59 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:29.149318 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-fecce0ca-ed5e-4c63-82ea-48d09b367e59 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] [instance: 12f775af-b918-467b-a6d1-3ca8a7957f37] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:53:29.157393 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fecce0ca-ed5e-4c63-82ea-48d09b367e59 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:29.158259 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fecce0ca-ed5e-4c63-82ea-48d09b367e59 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:29.159064 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fecce0ca-ed5e-4c63-82ea-48d09b367e59 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:29.160044 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fecce0ca-ed5e-4c63-82ea-48d09b367e59 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:29.160565 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fecce0ca-ed5e-4c63-82ea-48d09b367e59 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:29.161012 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fecce0ca-ed5e-4c63-82ea-48d09b367e59 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:29.617810 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-fecce0ca-ed5e-4c63-82ea-48d09b367e59 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927913a1e0cc4d74b42cb209ec932286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2865c04294884d1081c9b1b6fc8f8e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:29.635962 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-fecce0ca-ed5e-4c63-82ea-48d09b367e59 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] 10.222.0.43 "GET /compute/v2.1/servers/12f775af-b918-467b-a6d1-3ca8a7957f37" status: 200 len: 1320 microversion: 2.1 time: 0.493001 Oct 04 21:53:29.653060 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1198/2312] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:53:29 2022] GET /compute/v2.1/servers/12f775af-b918-467b-a6d1-3ca8a7957f37 => generated 1320 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:53:29.672650 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-44dba5af-6946-476c-b524-d7edf3b7c5ba tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Calling method '.version_select at 0x7fbb2f8c15e0>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:29.774870 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-7172517d-4a36-48d8-916f-261b5b5d8305 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Flavor limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:53:29.775562 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-7172517d-4a36-48d8-916f-261b5b5d8305 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Image limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:53:29.776015 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-7172517d-4a36-48d8-916f-261b5b5d8305 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Flavor pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:53:29.776531 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-7172517d-4a36-48d8-916f-261b5b5d8305 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Image pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:53:29.777160 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-7172517d-4a36-48d8-916f-261b5b5d8305 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:53:29.784670 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-44dba5af-6946-476c-b524-d7edf3b7c5ba tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] 10.222.0.43 "GET /compute/v2.1/images/5157f1c6-d263-427d-84cc-3320cbd286d5" status: 200 len: 1455 microversion: 2.1 time: 0.126993 Oct 04 21:53:29.785276 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1199/2313] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:53:29 2022] GET /compute/v2.1/images/5157f1c6-d263-427d-84cc-3320cbd286d5 => generated 1455 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:53:29.791763 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7172517d-4a36-48d8-916f-261b5b5d8305 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:29.792330 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7172517d-4a36-48d8-916f-261b5b5d8305 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:29.792868 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7172517d-4a36-48d8-916f-261b5b5d8305 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:29.793676 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7172517d-4a36-48d8-916f-261b5b5d8305 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:29.794203 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7172517d-4a36-48d8-916f-261b5b5d8305 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:29.794770 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7172517d-4a36-48d8-916f-261b5b5d8305 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:29.797552 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-8a15038e-7457-4baf-bb03-6724626e102c req-3fc1226a-bdf8-4836-be8d-c88a3caa550f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f8a46c4-3b6f-4f50-8227-77b69154fb57", "name": "network-vif-plugged", "status": "completed", "tag": "0b8186cd-d9f4-408f-9942-a8fcb3a46521"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:53:29.820959 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-7172517d-4a36-48d8-916f-261b5b5d8305 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Getting quotas for project 43659cf5fed541e8883664bf17aced70. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:53:29.828029 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-7172517d-4a36-48d8-916f-261b5b5d8305 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Getting quotas for user 47fbc4a6920d451cb1a2ad170de04921 and project 43659cf5fed541e8883664bf17aced70. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:53:29.828665 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-8a15038e-7457-4baf-bb03-6724626e102c req-3fc1226a-bdf8-4836-be8d-c88a3caa550f service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:29.829163 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-8a15038e-7457-4baf-bb03-6724626e102c req-3fc1226a-bdf8-4836-be8d-c88a3caa550f service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:29.829606 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-8a15038e-7457-4baf-bb03-6724626e102c req-3fc1226a-bdf8-4836-be8d-c88a3caa550f service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:29.843687 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-7172517d-4a36-48d8-916f-261b5b5d8305 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Going to run 1 instances... {{(pid=134101) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:53:29.846726 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-7172517d-4a36-48d8-916f-261b5b5d8305 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] [instance: eb6e098d-966d-478b-a69c-3746584e5509] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='58548514-5dac-426c-81f5-19e3fba33e23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134101) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:53:29.856874 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-8a15038e-7457-4baf-bb03-6724626e102c req-3fc1226a-bdf8-4836-be8d-c88a3caa550f service nova] Creating event network-vif-plugged:0b8186cd-d9f4-408f-9942-a8fcb3a46521 for instance 6f8a46c4-3b6f-4f50-8227-77b69154fb57 on n-h2-860284-1 Oct 04 21:53:29.862817 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-8a15038e-7457-4baf-bb03-6724626e102c req-3fc1226a-bdf8-4836-be8d-c88a3caa550f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076265 Oct 04 21:53:29.863628 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1200/2314] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:53:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:53:29.868825 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-a840e754-4df1-42d1-a27e-e7d206e2120e tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:29.870148 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-a840e754-4df1-42d1-a27e-e7d206e2120e tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] [instance: 830de6ad-adc6-4d16-ae9d-a29ae85e6cd2] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:53:29.889141 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a840e754-4df1-42d1-a27e-e7d206e2120e tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:29.890023 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a840e754-4df1-42d1-a27e-e7d206e2120e tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:29.890137 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a840e754-4df1-42d1-a27e-e7d206e2120e tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:29.890822 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a840e754-4df1-42d1-a27e-e7d206e2120e tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:29.891287 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a840e754-4df1-42d1-a27e-e7d206e2120e tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:29.891722 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a840e754-4df1-42d1-a27e-e7d206e2120e tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:29.907506 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-7172517d-4a36-48d8-916f-261b5b5d8305 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.569397 Oct 04 21:53:29.909625 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1115/2315] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 21:53:28 2022] POST /compute/v2.1/servers => generated 383 bytes in 1572 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:53:29.927490 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e0445cde-6e15-414f-bebc-1aec97dd0a70 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:29.928114 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-e0445cde-6e15-414f-bebc-1aec97dd0a70 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] [instance: eb6e098d-966d-478b-a69c-3746584e5509] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:53:30.054117 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-e0445cde-6e15-414f-bebc-1aec97dd0a70 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47fbc4a6920d451cb1a2ad170de04921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43659cf5fed541e8883664bf17aced70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:30.066278 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-e0445cde-6e15-414f-bebc-1aec97dd0a70 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] 10.222.0.43 "GET /compute/v2.1/servers/eb6e098d-966d-478b-a69c-3746584e5509" status: 200 len: 1214 microversion: 2.1 time: 0.149294 Oct 04 21:53:30.073352 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1116/2316] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:53:29 2022] GET /compute/v2.1/servers/eb6e098d-966d-478b-a69c-3746584e5509 => generated 1214 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:53:30.094850 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-4daabe4a-156c-4eb1-a644-c04455797920 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:30.098683 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-4daabe4a-156c-4eb1-a644-c04455797920 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 152003e4-2a7b-4801-8656-73093cd566ed] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:53:30.117590 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4daabe4a-156c-4eb1-a644-c04455797920 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:30.120566 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4daabe4a-156c-4eb1-a644-c04455797920 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:30.122710 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4daabe4a-156c-4eb1-a644-c04455797920 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:30.123642 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4daabe4a-156c-4eb1-a644-c04455797920 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:30.125070 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4daabe4a-156c-4eb1-a644-c04455797920 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:30.125511 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4daabe4a-156c-4eb1-a644-c04455797920 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:30.246631 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-a840e754-4df1-42d1-a27e-e7d206e2120e tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:30.261960 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-a840e754-4df1-42d1-a27e-e7d206e2120e tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:30.263462 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-a840e754-4df1-42d1-a27e-e7d206e2120e tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:30.270722 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-a840e754-4df1-42d1-a27e-e7d206e2120e tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] 10.222.0.43 "GET /compute/v2.1/servers/830de6ad-adc6-4d16-ae9d-a29ae85e6cd2" status: 200 len: 1886 microversion: 2.42 time: 0.405947 Oct 04 21:53:30.312679 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1201/2317] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:53:29 2022] GET /compute/v2.1/servers/830de6ad-adc6-4d16-ae9d-a29ae85e6cd2 => generated 1886 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:53:30.356803 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-4daabe4a-156c-4eb1-a644-c04455797920 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ad048becf474fb972d4291422d810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dcfc7024fc49388c4bd5f25f03e60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:30.365633 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-4daabe4a-156c-4eb1-a644-c04455797920 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/152003e4-2a7b-4801-8656-73093cd566ed" status: 200 len: 1390 microversion: 2.1 time: 0.290685 Oct 04 21:53:30.367614 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1117/2318] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:53:30 2022] GET /compute/v2.1/servers/152003e4-2a7b-4801-8656-73093cd566ed => generated 1390 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:53:30.664408 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-6c4304f4-985c-45ef-b255-bdfc61869ce1 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:30.665036 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-6c4304f4-985c-45ef-b255-bdfc61869ce1 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] [instance: 12f775af-b918-467b-a6d1-3ca8a7957f37] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:53:30.683309 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6c4304f4-985c-45ef-b255-bdfc61869ce1 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:30.684678 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6c4304f4-985c-45ef-b255-bdfc61869ce1 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:30.684678 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6c4304f4-985c-45ef-b255-bdfc61869ce1 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:30.701395 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6c4304f4-985c-45ef-b255-bdfc61869ce1 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:30.706228 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6c4304f4-985c-45ef-b255-bdfc61869ce1 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:30.708806 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6c4304f4-985c-45ef-b255-bdfc61869ce1 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:30.805308 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-3534a9ba-6f48-4408-9c7d-759174d3e249 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Calling method '.version_select at 0x7fbb372100d0>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:30.884559 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-3534a9ba-6f48-4408-9c7d-759174d3e249 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] 10.222.0.43 "GET /compute/v2.1/images/5157f1c6-d263-427d-84cc-3320cbd286d5" status: 200 len: 1455 microversion: 2.1 time: 0.084238 Oct 04 21:53:30.890741 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1118/2319] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:53:30 2022] GET /compute/v2.1/images/5157f1c6-d263-427d-84cc-3320cbd286d5 => generated 1455 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:53:31.092719 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-194287c6-7be4-4e29-bec4-db7d36d6217d tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:31.096661 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-194287c6-7be4-4e29-bec4-db7d36d6217d tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] [instance: eb6e098d-966d-478b-a69c-3746584e5509] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:53:31.129753 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-6c4304f4-985c-45ef-b255-bdfc61869ce1 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927913a1e0cc4d74b42cb209ec932286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2865c04294884d1081c9b1b6fc8f8e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:31.141675 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-6c4304f4-985c-45ef-b255-bdfc61869ce1 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] 10.222.0.43 "GET /compute/v2.1/servers/12f775af-b918-467b-a6d1-3ca8a7957f37" status: 200 len: 1320 microversion: 2.1 time: 0.481842 Oct 04 21:53:31.167619 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1202/2320] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:53:30 2022] GET /compute/v2.1/servers/12f775af-b918-467b-a6d1-3ca8a7957f37 => generated 1320 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:53:31.308300 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-293677b4-a287-461e-8a53-ff38c93efa06 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:31.309387 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-293677b4-a287-461e-8a53-ff38c93efa06 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] [instance: 830de6ad-adc6-4d16-ae9d-a29ae85e6cd2] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:53:31.316031 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-194287c6-7be4-4e29-bec4-db7d36d6217d tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47fbc4a6920d451cb1a2ad170de04921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43659cf5fed541e8883664bf17aced70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:31.327777 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-194287c6-7be4-4e29-bec4-db7d36d6217d tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] 10.222.0.43 "GET /compute/v2.1/servers/eb6e098d-966d-478b-a69c-3746584e5509" status: 200 len: 1214 microversion: 2.1 time: 0.239846 Oct 04 21:53:31.330662 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1119/2321] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:53:31 2022] GET /compute/v2.1/servers/eb6e098d-966d-478b-a69c-3746584e5509 => generated 1214 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:53:31.334721 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-293677b4-a287-461e-8a53-ff38c93efa06 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:31.335448 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-293677b4-a287-461e-8a53-ff38c93efa06 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:31.336014 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-293677b4-a287-461e-8a53-ff38c93efa06 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:31.336928 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-293677b4-a287-461e-8a53-ff38c93efa06 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:31.341360 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-293677b4-a287-461e-8a53-ff38c93efa06 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:31.342116 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-293677b4-a287-461e-8a53-ff38c93efa06 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:31.390969 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-efacb50c-cf20-4be9-8fee-69eacb7e73ac tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:31.391603 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-efacb50c-cf20-4be9-8fee-69eacb7e73ac tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 152003e4-2a7b-4801-8656-73093cd566ed] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:53:31.399360 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-efacb50c-cf20-4be9-8fee-69eacb7e73ac tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:31.427234 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-efacb50c-cf20-4be9-8fee-69eacb7e73ac tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:31.428072 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-efacb50c-cf20-4be9-8fee-69eacb7e73ac tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:31.437602 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-efacb50c-cf20-4be9-8fee-69eacb7e73ac tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:31.439898 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-efacb50c-cf20-4be9-8fee-69eacb7e73ac tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:31.445646 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-efacb50c-cf20-4be9-8fee-69eacb7e73ac tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:32.432560 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-efacb50c-cf20-4be9-8fee-69eacb7e73ac tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ad048becf474fb972d4291422d810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dcfc7024fc49388c4bd5f25f03e60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:32.455240 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-efacb50c-cf20-4be9-8fee-69eacb7e73ac tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/152003e4-2a7b-4801-8656-73093cd566ed" status: 200 len: 1390 microversion: 2.1 time: 1.068152 Oct 04 21:53:32.475865 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1120/2322] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:53:31 2022] GET /compute/v2.1/servers/152003e4-2a7b-4801-8656-73093cd566ed => generated 1390 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:53:32.485646 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-9a6891e1-9fa3-41d7-9f4d-ce66a76a9ea5 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Calling method '.version_select at 0x7fbb372100d0>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:32.537535 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-293677b4-a287-461e-8a53-ff38c93efa06 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:32.560187 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-293677b4-a287-461e-8a53-ff38c93efa06 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:32.562308 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-293677b4-a287-461e-8a53-ff38c93efa06 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:32.562933 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-9a6891e1-9fa3-41d7-9f4d-ce66a76a9ea5 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] 10.222.0.43 "GET /compute/v2.1/images/5157f1c6-d263-427d-84cc-3320cbd286d5" status: 200 len: 1455 microversion: 2.1 time: 0.084455 Oct 04 21:53:32.563818 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1121/2323] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:53:32 2022] GET /compute/v2.1/images/5157f1c6-d263-427d-84cc-3320cbd286d5 => generated 1455 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:53:32.568478 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-293677b4-a287-461e-8a53-ff38c93efa06 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] 10.222.0.43 "GET /compute/v2.1/servers/830de6ad-adc6-4d16-ae9d-a29ae85e6cd2" status: 200 len: 1886 microversion: 2.42 time: 1.269238 Oct 04 21:53:32.569545 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1203/2324] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:53:31 2022] GET /compute/v2.1/servers/830de6ad-adc6-4d16-ae9d-a29ae85e6cd2 => generated 1886 bytes in 1271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:53:32.571123 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-ff3725f7-6944-4ccb-9bcc-ce3a715ea69d tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:32.572511 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-ff3725f7-6944-4ccb-9bcc-ce3a715ea69d tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] [instance: 12f775af-b918-467b-a6d1-3ca8a7957f37] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:53:32.580774 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ff3725f7-6944-4ccb-9bcc-ce3a715ea69d tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:32.581677 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ff3725f7-6944-4ccb-9bcc-ce3a715ea69d tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:32.582390 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ff3725f7-6944-4ccb-9bcc-ce3a715ea69d tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:32.583546 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-2ee8b69b-c7e0-496e-9dee-917848038449 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:32.584042 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ff3725f7-6944-4ccb-9bcc-ce3a715ea69d tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:32.584331 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-2ee8b69b-c7e0-496e-9dee-917848038449 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] [instance: eb6e098d-966d-478b-a69c-3746584e5509] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:53:32.585196 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ff3725f7-6944-4ccb-9bcc-ce3a715ea69d tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:32.585879 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ff3725f7-6944-4ccb-9bcc-ce3a715ea69d tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:32.593710 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2ee8b69b-c7e0-496e-9dee-917848038449 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:32.594210 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2ee8b69b-c7e0-496e-9dee-917848038449 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:32.594685 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2ee8b69b-c7e0-496e-9dee-917848038449 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:32.595415 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2ee8b69b-c7e0-496e-9dee-917848038449 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:32.595873 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2ee8b69b-c7e0-496e-9dee-917848038449 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:32.596313 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2ee8b69b-c7e0-496e-9dee-917848038449 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:32.871552 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-2ee8b69b-c7e0-496e-9dee-917848038449 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47fbc4a6920d451cb1a2ad170de04921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43659cf5fed541e8883664bf17aced70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:32.900940 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-2ee8b69b-c7e0-496e-9dee-917848038449 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] 10.222.0.43 "GET /compute/v2.1/servers/eb6e098d-966d-478b-a69c-3746584e5509" status: 200 len: 1274 microversion: 2.1 time: 0.330277 Oct 04 21:53:32.924032 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1204/2325] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:53:32 2022] GET /compute/v2.1/servers/eb6e098d-966d-478b-a69c-3746584e5509 => generated 1274 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:53:33.011463 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-ff3725f7-6944-4ccb-9bcc-ce3a715ea69d tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927913a1e0cc4d74b42cb209ec932286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2865c04294884d1081c9b1b6fc8f8e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:33.023972 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-ff3725f7-6944-4ccb-9bcc-ce3a715ea69d tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] 10.222.0.43 "GET /compute/v2.1/servers/12f775af-b918-467b-a6d1-3ca8a7957f37" status: 200 len: 1320 microversion: 2.1 time: 0.458743 Oct 04 21:53:33.045450 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1122/2326] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:53:32 2022] GET /compute/v2.1/servers/12f775af-b918-467b-a6d1-3ca8a7957f37 => generated 1320 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:53:33.488549 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-02c138d7-1bd0-47dd-8120-cb1de6deaeee tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:33.489420 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-02c138d7-1bd0-47dd-8120-cb1de6deaeee tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 152003e4-2a7b-4801-8656-73093cd566ed] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:53:33.501875 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-02c138d7-1bd0-47dd-8120-cb1de6deaeee tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:33.502490 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-02c138d7-1bd0-47dd-8120-cb1de6deaeee tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:33.503194 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-02c138d7-1bd0-47dd-8120-cb1de6deaeee tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:33.505583 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-02c138d7-1bd0-47dd-8120-cb1de6deaeee tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:33.506429 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-02c138d7-1bd0-47dd-8120-cb1de6deaeee tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:33.507739 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-02c138d7-1bd0-47dd-8120-cb1de6deaeee tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:33.579501 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-725ce60b-30f7-48e4-a4f5-0fe4a335883b tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Calling method '.version_select at 0x7fbb2e785430>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:33.672744 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-725ce60b-30f7-48e4-a4f5-0fe4a335883b tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] 10.222.0.43 "GET /compute/v2.1/images/5157f1c6-d263-427d-84cc-3320cbd286d5" status: 200 len: 1455 microversion: 2.1 time: 0.097168 Oct 04 21:53:33.676386 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1123/2327] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:53:33 2022] GET /compute/v2.1/images/5157f1c6-d263-427d-84cc-3320cbd286d5 => generated 1455 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:53:33.692875 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-1d9abe03-3786-4650-8d48-775df502e505 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:33.696958 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-1d9abe03-3786-4650-8d48-775df502e505 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] [instance: 830de6ad-adc6-4d16-ae9d-a29ae85e6cd2] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:53:33.722654 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1d9abe03-3786-4650-8d48-775df502e505 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:33.723160 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1d9abe03-3786-4650-8d48-775df502e505 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:33.723606 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1d9abe03-3786-4650-8d48-775df502e505 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:33.724323 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1d9abe03-3786-4650-8d48-775df502e505 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:33.730385 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1d9abe03-3786-4650-8d48-775df502e505 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:33.730918 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1d9abe03-3786-4650-8d48-775df502e505 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:33.982662 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-02c138d7-1bd0-47dd-8120-cb1de6deaeee tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ad048becf474fb972d4291422d810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dcfc7024fc49388c4bd5f25f03e60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:34.003508 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-02c138d7-1bd0-47dd-8120-cb1de6deaeee tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/152003e4-2a7b-4801-8656-73093cd566ed" status: 200 len: 1390 microversion: 2.1 time: 0.515599 Oct 04 21:53:34.027823 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1205/2328] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:53:33 2022] GET /compute/v2.1/servers/152003e4-2a7b-4801-8656-73093cd566ed => generated 1390 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:53:34.042144 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-60f35c7e-e4ca-4afe-a3e3-431584b93bc4 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:34.045242 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-60f35c7e-e4ca-4afe-a3e3-431584b93bc4 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] [instance: eb6e098d-966d-478b-a69c-3746584e5509] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:53:34.060127 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-60f35c7e-e4ca-4afe-a3e3-431584b93bc4 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:34.061990 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-60f35c7e-e4ca-4afe-a3e3-431584b93bc4 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:34.064459 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-60f35c7e-e4ca-4afe-a3e3-431584b93bc4 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:34.065700 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-60f35c7e-e4ca-4afe-a3e3-431584b93bc4 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:34.066336 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-60f35c7e-e4ca-4afe-a3e3-431584b93bc4 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:34.067810 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-60f35c7e-e4ca-4afe-a3e3-431584b93bc4 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:34.296174 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-60f35c7e-e4ca-4afe-a3e3-431584b93bc4 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47fbc4a6920d451cb1a2ad170de04921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43659cf5fed541e8883664bf17aced70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:34.311776 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-60f35c7e-e4ca-4afe-a3e3-431584b93bc4 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] 10.222.0.43 "GET /compute/v2.1/servers/eb6e098d-966d-478b-a69c-3746584e5509" status: 200 len: 1274 microversion: 2.1 time: 0.275643 Oct 04 21:53:34.315409 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1206/2329] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:53:34 2022] GET /compute/v2.1/servers/eb6e098d-966d-478b-a69c-3746584e5509 => generated 1274 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:53:34.335976 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-6930b341-6706-4644-89d1-cb284ba38898 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:34.336621 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-6930b341-6706-4644-89d1-cb284ba38898 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] [instance: 12f775af-b918-467b-a6d1-3ca8a7957f37] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:53:34.362886 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6930b341-6706-4644-89d1-cb284ba38898 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:34.363403 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6930b341-6706-4644-89d1-cb284ba38898 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:34.363854 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6930b341-6706-4644-89d1-cb284ba38898 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:34.364585 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6930b341-6706-4644-89d1-cb284ba38898 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:34.365053 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6930b341-6706-4644-89d1-cb284ba38898 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:34.365490 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6930b341-6706-4644-89d1-cb284ba38898 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:34.373800 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-1d9abe03-3786-4650-8d48-775df502e505 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:34.395886 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-1d9abe03-3786-4650-8d48-775df502e505 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:34.422159 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-1d9abe03-3786-4650-8d48-775df502e505 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:34.427904 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-1d9abe03-3786-4650-8d48-775df502e505 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] 10.222.0.43 "GET /compute/v2.1/servers/830de6ad-adc6-4d16-ae9d-a29ae85e6cd2" status: 200 len: 1886 microversion: 2.42 time: 0.746093 Oct 04 21:53:34.430170 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1124/2330] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:53:33 2022] GET /compute/v2.1/servers/830de6ad-adc6-4d16-ae9d-a29ae85e6cd2 => generated 1886 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:53:34.465407 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-d4c6c778-f265-47cb-8688-07a992cc35c0 req-50b6b50e-e7b9-4055-810d-6c452c8e5e3b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "830de6ad-adc6-4d16-ae9d-a29ae85e6cd2", "tag": "d7975b45-e2eb-4527-a16c-14ce6defb614"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:53:34.502219 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-d4c6c778-f265-47cb-8688-07a992cc35c0 req-50b6b50e-e7b9-4055-810d-6c452c8e5e3b service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:34.502732 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-d4c6c778-f265-47cb-8688-07a992cc35c0 req-50b6b50e-e7b9-4055-810d-6c452c8e5e3b service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:34.508097 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-d4c6c778-f265-47cb-8688-07a992cc35c0 req-50b6b50e-e7b9-4055-810d-6c452c8e5e3b service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:34.565487 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-d4c6c778-f265-47cb-8688-07a992cc35c0 req-50b6b50e-e7b9-4055-810d-6c452c8e5e3b service nova] Creating event network-changed:d7975b45-e2eb-4527-a16c-14ce6defb614 for instance 830de6ad-adc6-4d16-ae9d-a29ae85e6cd2 on n-h1-860284-1 Oct 04 21:53:34.597234 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-d4c6c778-f265-47cb-8688-07a992cc35c0 req-50b6b50e-e7b9-4055-810d-6c452c8e5e3b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.165045 Oct 04 21:53:34.597870 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1125/2331] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:53:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:53:34.696606 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-735d9022-877c-4e7f-aca3-ab0df9bd2c88 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Calling method '.version_select at 0x7fbb3739eca0>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:34.842145 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-735d9022-877c-4e7f-aca3-ab0df9bd2c88 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] 10.222.0.43 "GET /compute/v2.1/images/5157f1c6-d263-427d-84cc-3320cbd286d5" status: 200 len: 1455 microversion: 2.1 time: 0.153446 Oct 04 21:53:34.845697 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1126/2332] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:53:34 2022] GET /compute/v2.1/images/5157f1c6-d263-427d-84cc-3320cbd286d5 => generated 1455 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:53:35.025970 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-6930b341-6706-4644-89d1-cb284ba38898 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927913a1e0cc4d74b42cb209ec932286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2865c04294884d1081c9b1b6fc8f8e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:35.045241 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-6930b341-6706-4644-89d1-cb284ba38898 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] 10.222.0.43 "GET /compute/v2.1/servers/12f775af-b918-467b-a6d1-3ca8a7957f37" status: 200 len: 1320 microversion: 2.1 time: 0.727751 Oct 04 21:53:35.065780 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1207/2333] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:53:34 2022] GET /compute/v2.1/servers/12f775af-b918-467b-a6d1-3ca8a7957f37 => generated 1320 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:53:35.065897 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-1fbc1b01-55ee-40a1-9bc2-fa279c85659c tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:35.065897 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-1fbc1b01-55ee-40a1-9bc2-fa279c85659c tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 152003e4-2a7b-4801-8656-73093cd566ed] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:53:35.098745 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1fbc1b01-55ee-40a1-9bc2-fa279c85659c tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:35.099175 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1fbc1b01-55ee-40a1-9bc2-fa279c85659c tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:35.099633 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1fbc1b01-55ee-40a1-9bc2-fa279c85659c tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:35.100370 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1fbc1b01-55ee-40a1-9bc2-fa279c85659c tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:35.105804 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1fbc1b01-55ee-40a1-9bc2-fa279c85659c tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:35.107842 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1fbc1b01-55ee-40a1-9bc2-fa279c85659c tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:35.339803 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-46e0c298-6f1c-419f-ad9b-5a9eb1787205 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:35.340704 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-46e0c298-6f1c-419f-ad9b-5a9eb1787205 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] [instance: eb6e098d-966d-478b-a69c-3746584e5509] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:53:35.353913 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-46e0c298-6f1c-419f-ad9b-5a9eb1787205 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:35.356490 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-46e0c298-6f1c-419f-ad9b-5a9eb1787205 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:35.359122 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-46e0c298-6f1c-419f-ad9b-5a9eb1787205 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:35.360587 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-46e0c298-6f1c-419f-ad9b-5a9eb1787205 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:35.363573 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-46e0c298-6f1c-419f-ad9b-5a9eb1787205 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:35.364999 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-46e0c298-6f1c-419f-ad9b-5a9eb1787205 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:35.800132 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-46e0c298-6f1c-419f-ad9b-5a9eb1787205 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47fbc4a6920d451cb1a2ad170de04921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43659cf5fed541e8883664bf17aced70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:35.815485 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-46e0c298-6f1c-419f-ad9b-5a9eb1787205 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] 10.222.0.43 "GET /compute/v2.1/servers/eb6e098d-966d-478b-a69c-3746584e5509" status: 200 len: 1272 microversion: 2.1 time: 0.480094 Oct 04 21:53:35.818418 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1208/2334] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:53:35 2022] GET /compute/v2.1/servers/eb6e098d-966d-478b-a69c-3746584e5509 => generated 1272 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:53:35.834477 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-a94c84e1-3063-4e96-861c-3f1bd11f8dbc tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:35.835360 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-a94c84e1-3063-4e96-861c-3f1bd11f8dbc tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] [instance: 830de6ad-adc6-4d16-ae9d-a29ae85e6cd2] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:53:35.850212 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a94c84e1-3063-4e96-861c-3f1bd11f8dbc tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:35.852157 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a94c84e1-3063-4e96-861c-3f1bd11f8dbc tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:35.855780 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a94c84e1-3063-4e96-861c-3f1bd11f8dbc tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:35.858525 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a94c84e1-3063-4e96-861c-3f1bd11f8dbc tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:35.860764 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a94c84e1-3063-4e96-861c-3f1bd11f8dbc tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:35.861549 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a94c84e1-3063-4e96-861c-3f1bd11f8dbc tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:36.250683 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-1fbc1b01-55ee-40a1-9bc2-fa279c85659c tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ad048becf474fb972d4291422d810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dcfc7024fc49388c4bd5f25f03e60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:36.263374 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-1fbc1b01-55ee-40a1-9bc2-fa279c85659c tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/152003e4-2a7b-4801-8656-73093cd566ed" status: 200 len: 1390 microversion: 2.1 time: 1.225471 Oct 04 21:53:36.277239 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1127/2335] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:53:35 2022] GET /compute/v2.1/servers/152003e4-2a7b-4801-8656-73093cd566ed => generated 1390 bytes in 1243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:53:36.292171 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-7d251f2d-594a-4a57-b307-6c3da92010c6 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Calling method '.version_select at 0x7fbb2e724820>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:36.437440 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-7d251f2d-594a-4a57-b307-6c3da92010c6 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] 10.222.0.43 "GET /compute/v2.1/images/5157f1c6-d263-427d-84cc-3320cbd286d5" status: 200 len: 1455 microversion: 2.1 time: 0.158567 Oct 04 21:53:36.439344 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1128/2336] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:53:36 2022] GET /compute/v2.1/images/5157f1c6-d263-427d-84cc-3320cbd286d5 => generated 1455 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:53:36.464782 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-798dc05c-ce43-465f-a639-6c6bcef44cbf tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:36.466848 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-798dc05c-ce43-465f-a639-6c6bcef44cbf tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] [instance: 12f775af-b918-467b-a6d1-3ca8a7957f37] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:53:36.485624 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-798dc05c-ce43-465f-a639-6c6bcef44cbf tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:36.486511 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-798dc05c-ce43-465f-a639-6c6bcef44cbf tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:36.488680 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-798dc05c-ce43-465f-a639-6c6bcef44cbf tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:36.492434 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-798dc05c-ce43-465f-a639-6c6bcef44cbf tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:36.493185 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-798dc05c-ce43-465f-a639-6c6bcef44cbf tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:36.494963 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-798dc05c-ce43-465f-a639-6c6bcef44cbf tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:37.230192 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-a94c84e1-3063-4e96-861c-3f1bd11f8dbc tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:37.252022 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-a94c84e1-3063-4e96-861c-3f1bd11f8dbc tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:37.261512 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-a94c84e1-3063-4e96-861c-3f1bd11f8dbc tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:37.266286 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-a94c84e1-3063-4e96-861c-3f1bd11f8dbc tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] 10.222.0.43 "GET /compute/v2.1/servers/830de6ad-adc6-4d16-ae9d-a29ae85e6cd2" status: 200 len: 1886 microversion: 2.42 time: 1.439547 Oct 04 21:53:37.268717 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1209/2337] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:53:35 2022] GET /compute/v2.1/servers/830de6ad-adc6-4d16-ae9d-a29ae85e6cd2 => generated 1886 bytes in 1449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:53:37.287543 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-6245fb26-db67-42dd-b94e-36cc4b7fc1d7 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:37.294312 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-6245fb26-db67-42dd-b94e-36cc4b7fc1d7 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] [instance: eb6e098d-966d-478b-a69c-3746584e5509] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:53:37.318210 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6245fb26-db67-42dd-b94e-36cc4b7fc1d7 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:37.319225 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6245fb26-db67-42dd-b94e-36cc4b7fc1d7 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:37.322699 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6245fb26-db67-42dd-b94e-36cc4b7fc1d7 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:37.327639 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6245fb26-db67-42dd-b94e-36cc4b7fc1d7 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:37.328786 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6245fb26-db67-42dd-b94e-36cc4b7fc1d7 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:37.335751 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6245fb26-db67-42dd-b94e-36cc4b7fc1d7 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:37.761823 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-6245fb26-db67-42dd-b94e-36cc4b7fc1d7 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47fbc4a6920d451cb1a2ad170de04921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43659cf5fed541e8883664bf17aced70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:37.777176 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-6245fb26-db67-42dd-b94e-36cc4b7fc1d7 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] 10.222.0.43 "GET /compute/v2.1/servers/eb6e098d-966d-478b-a69c-3746584e5509" status: 200 len: 1272 microversion: 2.1 time: 0.505583 Oct 04 21:53:37.810787 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1210/2338] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:53:37 2022] GET /compute/v2.1/servers/eb6e098d-966d-478b-a69c-3746584e5509 => generated 1272 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:53:37.830891 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-18ae74e8-e64c-41e9-9ef0-84eb9ac9a2d9 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:37.833079 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-18ae74e8-e64c-41e9-9ef0-84eb9ac9a2d9 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 152003e4-2a7b-4801-8656-73093cd566ed] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:53:37.862136 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-18ae74e8-e64c-41e9-9ef0-84eb9ac9a2d9 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:37.862711 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-18ae74e8-e64c-41e9-9ef0-84eb9ac9a2d9 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:37.863108 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-18ae74e8-e64c-41e9-9ef0-84eb9ac9a2d9 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:37.876615 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-18ae74e8-e64c-41e9-9ef0-84eb9ac9a2d9 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:37.879855 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-18ae74e8-e64c-41e9-9ef0-84eb9ac9a2d9 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:37.880603 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-18ae74e8-e64c-41e9-9ef0-84eb9ac9a2d9 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:37.937520 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-798dc05c-ce43-465f-a639-6c6bcef44cbf tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927913a1e0cc4d74b42cb209ec932286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2865c04294884d1081c9b1b6fc8f8e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:37.951358 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-798dc05c-ce43-465f-a639-6c6bcef44cbf tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] 10.222.0.43 "GET /compute/v2.1/servers/12f775af-b918-467b-a6d1-3ca8a7957f37" status: 200 len: 1320 microversion: 2.1 time: 1.502794 Oct 04 21:53:37.967118 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1129/2339] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:53:36 2022] GET /compute/v2.1/servers/12f775af-b918-467b-a6d1-3ca8a7957f37 => generated 1320 bytes in 1527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:53:37.973976 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-8e06f2bf-c475-49bc-9b7d-e445a995b349 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Calling method '.version_select at 0x7fbb37210af0>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:38.050767 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-8e06f2bf-c475-49bc-9b7d-e445a995b349 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] 10.222.0.43 "GET /compute/v2.1/images/5157f1c6-d263-427d-84cc-3320cbd286d5" status: 200 len: 1455 microversion: 2.1 time: 0.081779 Oct 04 21:53:38.054732 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1130/2340] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:53:37 2022] GET /compute/v2.1/images/5157f1c6-d263-427d-84cc-3320cbd286d5 => generated 1455 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:53:38.298691 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-54f37543-9838-484e-b45a-f1aec8795b07 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:38.299598 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-54f37543-9838-484e-b45a-f1aec8795b07 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] [instance: 830de6ad-adc6-4d16-ae9d-a29ae85e6cd2] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:53:38.324130 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-54f37543-9838-484e-b45a-f1aec8795b07 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:38.328442 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-54f37543-9838-484e-b45a-f1aec8795b07 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:38.335256 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-54f37543-9838-484e-b45a-f1aec8795b07 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:38.344636 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-54f37543-9838-484e-b45a-f1aec8795b07 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:38.346552 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-54f37543-9838-484e-b45a-f1aec8795b07 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:38.350573 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-54f37543-9838-484e-b45a-f1aec8795b07 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:38.987618 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-18ae74e8-e64c-41e9-9ef0-84eb9ac9a2d9 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ad048becf474fb972d4291422d810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dcfc7024fc49388c4bd5f25f03e60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:39.005814 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-18ae74e8-e64c-41e9-9ef0-84eb9ac9a2d9 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/152003e4-2a7b-4801-8656-73093cd566ed" status: 200 len: 1390 microversion: 2.1 time: 1.193601 Oct 04 21:53:39.020419 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1211/2341] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:53:37 2022] GET /compute/v2.1/servers/152003e4-2a7b-4801-8656-73093cd566ed => generated 1390 bytes in 1206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:53:39.025871 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-55d2d9bc-f050-4edd-a984-718009add5d8 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:39.042078 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-55d2d9bc-f050-4edd-a984-718009add5d8 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] [instance: eb6e098d-966d-478b-a69c-3746584e5509] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:53:39.055548 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-55d2d9bc-f050-4edd-a984-718009add5d8 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:39.060191 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-55d2d9bc-f050-4edd-a984-718009add5d8 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:39.064976 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-55d2d9bc-f050-4edd-a984-718009add5d8 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:39.071059 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-55d2d9bc-f050-4edd-a984-718009add5d8 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:39.072906 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-55d2d9bc-f050-4edd-a984-718009add5d8 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:39.074487 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-55d2d9bc-f050-4edd-a984-718009add5d8 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:39.094190 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=100 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:53:39.291455 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-54f37543-9838-484e-b45a-f1aec8795b07 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:39.310869 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-54f37543-9838-484e-b45a-f1aec8795b07 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:39.313880 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-54f37543-9838-484e-b45a-f1aec8795b07 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:39.316537 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-54f37543-9838-484e-b45a-f1aec8795b07 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] 10.222.0.43 "GET /compute/v2.1/servers/830de6ad-adc6-4d16-ae9d-a29ae85e6cd2" status: 200 len: 1886 microversion: 2.42 time: 1.023163 Oct 04 21:53:39.320782 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1131/2342] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:53:38 2022] GET /compute/v2.1/servers/830de6ad-adc6-4d16-ae9d-a29ae85e6cd2 => generated 1886 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:53:39.327040 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-8aa23bfb-4017-4b52-8ad1-0d4ec3e8645d tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:39.327898 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-8aa23bfb-4017-4b52-8ad1-0d4ec3e8645d tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] [instance: 12f775af-b918-467b-a6d1-3ca8a7957f37] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:53:39.350834 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8aa23bfb-4017-4b52-8ad1-0d4ec3e8645d tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:39.351800 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8aa23bfb-4017-4b52-8ad1-0d4ec3e8645d tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:39.354509 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8aa23bfb-4017-4b52-8ad1-0d4ec3e8645d tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:39.356141 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8aa23bfb-4017-4b52-8ad1-0d4ec3e8645d tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:39.358025 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8aa23bfb-4017-4b52-8ad1-0d4ec3e8645d tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:39.359250 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8aa23bfb-4017-4b52-8ad1-0d4ec3e8645d tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:39.810458 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=2 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:53:40.113900 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-8aa23bfb-4017-4b52-8ad1-0d4ec3e8645d tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927913a1e0cc4d74b42cb209ec932286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2865c04294884d1081c9b1b6fc8f8e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:40.133138 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-8aa23bfb-4017-4b52-8ad1-0d4ec3e8645d tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] 10.222.0.43 "GET /compute/v2.1/servers/12f775af-b918-467b-a6d1-3ca8a7957f37" status: 200 len: 1320 microversion: 2.1 time: 0.810145 Oct 04 21:53:40.153614 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1132/2343] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:53:39 2022] GET /compute/v2.1/servers/12f775af-b918-467b-a6d1-3ca8a7957f37 => generated 1320 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:53:40.160329 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-152eaebb-d448-4678-b641-40681e57f683 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Calling method '.version_select at 0x7fbb2e641b80>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:40.259080 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-152eaebb-d448-4678-b641-40681e57f683 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] 10.222.0.43 "GET /compute/v2.1/images/5157f1c6-d263-427d-84cc-3320cbd286d5" status: 200 len: 1455 microversion: 2.1 time: 0.103275 Oct 04 21:53:40.261136 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1133/2344] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:53:40 2022] GET /compute/v2.1/images/5157f1c6-d263-427d-84cc-3320cbd286d5 => generated 1455 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:53:40.278826 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-5ed5a7fe-bab3-40f0-a1bd-eb52e3746807 req-2ce1aa5c-24ef-4878-a748-cdb9863c0953 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a120b0ad-f6e3-4ecb-9312-e92d5c115fd3", "name": "network-vif-plugged", "status": "completed", "tag": "67d021b1-9a40-436e-9b43-a6c18c852905"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:53:40.308285 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-55d2d9bc-f050-4edd-a984-718009add5d8 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47fbc4a6920d451cb1a2ad170de04921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43659cf5fed541e8883664bf17aced70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:40.318966 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-55d2d9bc-f050-4edd-a984-718009add5d8 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] 10.222.0.43 "GET /compute/v2.1/servers/eb6e098d-966d-478b-a69c-3746584e5509" status: 200 len: 1314 microversion: 2.1 time: 1.296122 Oct 04 21:53:40.323226 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1212/2345] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:53:39 2022] GET /compute/v2.1/servers/eb6e098d-966d-478b-a69c-3746584e5509 => generated 1314 bytes in 1302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:53:40.350526 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-b69ca93a-5216-4a3f-be0a-cdd0a5b4c5b5 req-cbb63ce2-1265-4a69-a404-cf55b6d2eef6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "830de6ad-adc6-4d16-ae9d-a29ae85e6cd2", "tag": "e9d774f8-8705-408f-87ab-9a4e3cdf9653"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:53:40.359943 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-5ed5a7fe-bab3-40f0-a1bd-eb52e3746807 req-2ce1aa5c-24ef-4878-a748-cdb9863c0953 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:40.361041 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-5ed5a7fe-bab3-40f0-a1bd-eb52e3746807 req-2ce1aa5c-24ef-4878-a748-cdb9863c0953 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:40.361674 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-5ed5a7fe-bab3-40f0-a1bd-eb52e3746807 req-2ce1aa5c-24ef-4878-a748-cdb9863c0953 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:40.383951 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-b69ca93a-5216-4a3f-be0a-cdd0a5b4c5b5 req-cbb63ce2-1265-4a69-a404-cf55b6d2eef6 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:40.384948 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-b69ca93a-5216-4a3f-be0a-cdd0a5b4c5b5 req-cbb63ce2-1265-4a69-a404-cf55b6d2eef6 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:40.387223 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-b69ca93a-5216-4a3f-be0a-cdd0a5b4c5b5 req-cbb63ce2-1265-4a69-a404-cf55b6d2eef6 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:40.392305 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-5ed5a7fe-bab3-40f0-a1bd-eb52e3746807 req-2ce1aa5c-24ef-4878-a748-cdb9863c0953 service nova] Creating event network-vif-plugged:67d021b1-9a40-436e-9b43-a6c18c852905 for instance a120b0ad-f6e3-4ecb-9312-e92d5c115fd3 on n-h1-860284-1 Oct 04 21:53:40.409887 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-5ed5a7fe-bab3-40f0-a1bd-eb52e3746807 req-2ce1aa5c-24ef-4878-a748-cdb9863c0953 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.147329 Oct 04 21:53:40.413400 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1134/2346] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:53:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:53:40.416815 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-b69ca93a-5216-4a3f-be0a-cdd0a5b4c5b5 req-cbb63ce2-1265-4a69-a404-cf55b6d2eef6 service nova] Creating event network-changed:e9d774f8-8705-408f-87ab-9a4e3cdf9653 for instance 830de6ad-adc6-4d16-ae9d-a29ae85e6cd2 on n-h1-860284-1 Oct 04 21:53:40.429608 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-9384768f-467f-41a8-8c89-775578b8b8a1 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:40.436190 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-9384768f-467f-41a8-8c89-775578b8b8a1 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 152003e4-2a7b-4801-8656-73093cd566ed] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:53:40.439581 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-b69ca93a-5216-4a3f-be0a-cdd0a5b4c5b5 req-cbb63ce2-1265-4a69-a404-cf55b6d2eef6 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102738 Oct 04 21:53:40.440797 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1213/2347] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:53:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:53:40.449780 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-f903801f-e6a0-4c40-808e-696cb7eba18f tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:40.451761 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-f903801f-e6a0-4c40-808e-696cb7eba18f tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] [instance: 830de6ad-adc6-4d16-ae9d-a29ae85e6cd2] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:53:40.467556 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f903801f-e6a0-4c40-808e-696cb7eba18f tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:40.473877 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f903801f-e6a0-4c40-808e-696cb7eba18f tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:40.475909 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f903801f-e6a0-4c40-808e-696cb7eba18f tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:40.476952 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f903801f-e6a0-4c40-808e-696cb7eba18f tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:40.478821 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f903801f-e6a0-4c40-808e-696cb7eba18f tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:40.480319 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f903801f-e6a0-4c40-808e-696cb7eba18f tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:40.485966 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9384768f-467f-41a8-8c89-775578b8b8a1 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:40.489142 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9384768f-467f-41a8-8c89-775578b8b8a1 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:40.490402 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9384768f-467f-41a8-8c89-775578b8b8a1 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:40.492033 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9384768f-467f-41a8-8c89-775578b8b8a1 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:40.496760 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9384768f-467f-41a8-8c89-775578b8b8a1 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:40.497412 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9384768f-467f-41a8-8c89-775578b8b8a1 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:41.320764 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=10 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:53:42.106480 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-f903801f-e6a0-4c40-808e-696cb7eba18f tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:42.125145 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-f903801f-e6a0-4c40-808e-696cb7eba18f tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:42.131974 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-f903801f-e6a0-4c40-808e-696cb7eba18f tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:42.134275 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-f903801f-e6a0-4c40-808e-696cb7eba18f tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] 10.222.0.43 "GET /compute/v2.1/servers/830de6ad-adc6-4d16-ae9d-a29ae85e6cd2" status: 200 len: 1886 microversion: 2.42 time: 1.692017 Oct 04 21:53:42.136557 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1214/2348] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:53:40 2022] GET /compute/v2.1/servers/830de6ad-adc6-4d16-ae9d-a29ae85e6cd2 => generated 1886 bytes in 1695 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:53:42.148717 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-8750289c-e208-4520-a04e-809115ea2934 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:42.155143 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-8750289c-e208-4520-a04e-809115ea2934 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] [instance: 12f775af-b918-467b-a6d1-3ca8a7957f37] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:53:42.173985 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8750289c-e208-4520-a04e-809115ea2934 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:42.174887 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8750289c-e208-4520-a04e-809115ea2934 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:42.175833 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8750289c-e208-4520-a04e-809115ea2934 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:42.176784 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8750289c-e208-4520-a04e-809115ea2934 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:42.177893 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8750289c-e208-4520-a04e-809115ea2934 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:42.178736 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8750289c-e208-4520-a04e-809115ea2934 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:42.408250 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-9384768f-467f-41a8-8c89-775578b8b8a1 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ad048becf474fb972d4291422d810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dcfc7024fc49388c4bd5f25f03e60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:42.417968 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-9384768f-467f-41a8-8c89-775578b8b8a1 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/152003e4-2a7b-4801-8656-73093cd566ed" status: 200 len: 1390 microversion: 2.1 time: 2.002341 Oct 04 21:53:42.432145 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1135/2349] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:53:40 2022] GET /compute/v2.1/servers/152003e4-2a7b-4801-8656-73093cd566ed => generated 1390 bytes in 2017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:53:42.446293 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-7105b118-efac-4e46-8e67-95ca119a524b tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Calling method '.version_select at 0x7fbb37210af0>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:42.532095 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-7105b118-efac-4e46-8e67-95ca119a524b tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] 10.222.0.43 "GET /compute/v2.1/images/5157f1c6-d263-427d-84cc-3320cbd286d5" status: 200 len: 1455 microversion: 2.1 time: 0.098659 Oct 04 21:53:42.532693 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1136/2350] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:53:42 2022] GET /compute/v2.1/images/5157f1c6-d263-427d-84cc-3320cbd286d5 => generated 1455 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:53:42.544967 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-af73c719-528b-414e-a486-1d7d09903722 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:42.546847 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-af73c719-528b-414e-a486-1d7d09903722 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] [instance: eb6e098d-966d-478b-a69c-3746584e5509] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:53:42.565876 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-af73c719-528b-414e-a486-1d7d09903722 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:42.566653 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-af73c719-528b-414e-a486-1d7d09903722 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:42.567436 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-af73c719-528b-414e-a486-1d7d09903722 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:42.568388 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-af73c719-528b-414e-a486-1d7d09903722 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:42.568998 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-af73c719-528b-414e-a486-1d7d09903722 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:42.569600 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-af73c719-528b-414e-a486-1d7d09903722 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:42.756892 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-8750289c-e208-4520-a04e-809115ea2934 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927913a1e0cc4d74b42cb209ec932286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2865c04294884d1081c9b1b6fc8f8e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:42.767293 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-8750289c-e208-4520-a04e-809115ea2934 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] 10.222.0.43 "GET /compute/v2.1/servers/12f775af-b918-467b-a6d1-3ca8a7957f37" status: 200 len: 1320 microversion: 2.1 time: 0.627512 Oct 04 21:53:42.773678 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1215/2351] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:53:42 2022] GET /compute/v2.1/servers/12f775af-b918-467b-a6d1-3ca8a7957f37 => generated 1320 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:53:42.791067 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-f722c407-261c-4904-90f8-a20673af7cd4 req-cfdff64f-05af-497f-a804-1ae0af9f265a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75061d5c-d642-48c4-8b19-b9252812b2cc", "name": "network-vif-plugged", "status": "completed", "tag": "56b627cb-784d-4dfc-8862-7083e7643d23"}, {"server_uuid": "12f775af-b918-467b-a6d1-3ca8a7957f37", "name": "network-vif-plugged", "status": "completed", "tag": "f26bd1ab-0812-4c55-bd30-aafbfbf55ec2"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:53:42.809222 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-f722c407-261c-4904-90f8-a20673af7cd4 req-cfdff64f-05af-497f-a804-1ae0af9f265a service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:42.815135 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-f722c407-261c-4904-90f8-a20673af7cd4 req-cfdff64f-05af-497f-a804-1ae0af9f265a service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:42.815942 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-f722c407-261c-4904-90f8-a20673af7cd4 req-cfdff64f-05af-497f-a804-1ae0af9f265a service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:42.841690 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-f722c407-261c-4904-90f8-a20673af7cd4 req-cfdff64f-05af-497f-a804-1ae0af9f265a service nova] Creating event network-vif-plugged:56b627cb-784d-4dfc-8862-7083e7643d23 for instance 75061d5c-d642-48c4-8b19-b9252812b2cc on n-h2-860284-1 Oct 04 21:53:42.848937 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-f722c407-261c-4904-90f8-a20673af7cd4 req-cfdff64f-05af-497f-a804-1ae0af9f265a service nova] Creating event network-vif-plugged:f26bd1ab-0812-4c55-bd30-aafbfbf55ec2 for instance 12f775af-b918-467b-a6d1-3ca8a7957f37 on n-h1-860284-1 Oct 04 21:53:42.865312 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-f722c407-261c-4904-90f8-a20673af7cd4 req-cfdff64f-05af-497f-a804-1ae0af9f265a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.089881 Oct 04 21:53:42.877833 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1216/2352] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:53:42 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:53:42.897045 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-12b3d1bf-d56b-4a7d-be03-a6bffc0bcdfd req-49aec1d0-efec-473d-a3af-7578a22a81d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "152003e4-2a7b-4801-8656-73093cd566ed", "name": "network-vif-unplugged", "status": "completed", "tag": "eefc2731-0f05-444f-9e84-6aab2807b291"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:53:42.928850 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-12b3d1bf-d56b-4a7d-be03-a6bffc0bcdfd req-49aec1d0-efec-473d-a3af-7578a22a81d3 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:42.929622 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-12b3d1bf-d56b-4a7d-be03-a6bffc0bcdfd req-49aec1d0-efec-473d-a3af-7578a22a81d3 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:42.931837 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-12b3d1bf-d56b-4a7d-be03-a6bffc0bcdfd req-49aec1d0-efec-473d-a3af-7578a22a81d3 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:42.964880 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-12b3d1bf-d56b-4a7d-be03-a6bffc0bcdfd req-49aec1d0-efec-473d-a3af-7578a22a81d3 service nova] Creating event network-vif-unplugged:eefc2731-0f05-444f-9e84-6aab2807b291 for instance 152003e4-2a7b-4801-8656-73093cd566ed on n-h1-860284-1 Oct 04 21:53:42.980091 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-12b3d1bf-d56b-4a7d-be03-a6bffc0bcdfd req-49aec1d0-efec-473d-a3af-7578a22a81d3 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.092783 Oct 04 21:53:42.986416 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1217/2353] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:53:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:53:43.169830 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-a655e674-3bd1-4aa3-8223-2e298d6dfabf tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:43.171592 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-a655e674-3bd1-4aa3-8223-2e298d6dfabf tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] [instance: 830de6ad-adc6-4d16-ae9d-a29ae85e6cd2] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:53:43.192484 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a655e674-3bd1-4aa3-8223-2e298d6dfabf tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:43.193272 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a655e674-3bd1-4aa3-8223-2e298d6dfabf tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:43.193894 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a655e674-3bd1-4aa3-8223-2e298d6dfabf tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:43.194816 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a655e674-3bd1-4aa3-8223-2e298d6dfabf tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:43.200771 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a655e674-3bd1-4aa3-8223-2e298d6dfabf tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:43.201498 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a655e674-3bd1-4aa3-8223-2e298d6dfabf tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:43.231705 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-af73c719-528b-414e-a486-1d7d09903722 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47fbc4a6920d451cb1a2ad170de04921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43659cf5fed541e8883664bf17aced70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:43.248279 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-af73c719-528b-414e-a486-1d7d09903722 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] 10.222.0.43 "GET /compute/v2.1/servers/eb6e098d-966d-478b-a69c-3746584e5509" status: 200 len: 1314 microversion: 2.1 time: 0.713657 Oct 04 21:53:43.252683 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1137/2354] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:53:42 2022] GET /compute/v2.1/servers/eb6e098d-966d-478b-a69c-3746584e5509 => generated 1314 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:53:43.457786 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-5ccc9fb1-8c4c-46cf-a709-1d8e5f21ec8a tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:43.459124 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-5ccc9fb1-8c4c-46cf-a709-1d8e5f21ec8a tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 152003e4-2a7b-4801-8656-73093cd566ed] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:53:43.468693 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5ccc9fb1-8c4c-46cf-a709-1d8e5f21ec8a tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:43.477350 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5ccc9fb1-8c4c-46cf-a709-1d8e5f21ec8a tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:43.480601 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5ccc9fb1-8c4c-46cf-a709-1d8e5f21ec8a tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:43.481586 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5ccc9fb1-8c4c-46cf-a709-1d8e5f21ec8a tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:43.482216 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5ccc9fb1-8c4c-46cf-a709-1d8e5f21ec8a tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:43.482976 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5ccc9fb1-8c4c-46cf-a709-1d8e5f21ec8a tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:44.372967 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-a655e674-3bd1-4aa3-8223-2e298d6dfabf tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:44.385620 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-a655e674-3bd1-4aa3-8223-2e298d6dfabf tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:44.387415 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-a655e674-3bd1-4aa3-8223-2e298d6dfabf tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:44.389000 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-a655e674-3bd1-4aa3-8223-2e298d6dfabf tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] 10.222.0.43 "GET /compute/v2.1/servers/830de6ad-adc6-4d16-ae9d-a29ae85e6cd2" status: 200 len: 1886 microversion: 2.42 time: 1.223789 Oct 04 21:53:44.407458 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1218/2355] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:53:43 2022] GET /compute/v2.1/servers/830de6ad-adc6-4d16-ae9d-a29ae85e6cd2 => generated 1886 bytes in 1243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:53:44.414167 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-1c945f92-15aa-4c1a-a52a-f14474aa3a79 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Calling method '.version_select at 0x7fbb2efd2160>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:44.513237 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-1c945f92-15aa-4c1a-a52a-f14474aa3a79 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] 10.222.0.43 "GET /compute/v2.1/images/5157f1c6-d263-427d-84cc-3320cbd286d5" status: 200 len: 1455 microversion: 2.1 time: 0.104536 Oct 04 21:53:44.514677 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1219/2356] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:53:44 2022] GET /compute/v2.1/images/5157f1c6-d263-427d-84cc-3320cbd286d5 => generated 1455 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:53:44.520892 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-620dae82-ad77-4e82-9358-fb2f9eaed640 req-2a3557c1-6c07-41fb-9e90-b2b3620538aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb6e098d-966d-478b-a69c-3746584e5509", "tag": "14556cef-915d-4e87-b47d-67e1cacff2c9"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:53:44.586506 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-620dae82-ad77-4e82-9358-fb2f9eaed640 req-2a3557c1-6c07-41fb-9e90-b2b3620538aa service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:44.587389 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-620dae82-ad77-4e82-9358-fb2f9eaed640 req-2a3557c1-6c07-41fb-9e90-b2b3620538aa service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:44.588124 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-620dae82-ad77-4e82-9358-fb2f9eaed640 req-2a3557c1-6c07-41fb-9e90-b2b3620538aa service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:44.624831 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-620dae82-ad77-4e82-9358-fb2f9eaed640 req-2a3557c1-6c07-41fb-9e90-b2b3620538aa service nova] Creating event network-changed:14556cef-915d-4e87-b47d-67e1cacff2c9 for instance eb6e098d-966d-478b-a69c-3746584e5509 on n-h1-860284-1 Oct 04 21:53:44.641635 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-620dae82-ad77-4e82-9358-fb2f9eaed640 req-2a3557c1-6c07-41fb-9e90-b2b3620538aa service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.125563 Oct 04 21:53:44.651852 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1220/2357] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:53:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:53:44.672001 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-634e6cf3-8383-41b0-86be-7f8cc4ada3e0 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:44.688055 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-634e6cf3-8383-41b0-86be-7f8cc4ada3e0 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] [instance: 12f775af-b918-467b-a6d1-3ca8a7957f37] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:53:44.708997 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-634e6cf3-8383-41b0-86be-7f8cc4ada3e0 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:44.709900 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-634e6cf3-8383-41b0-86be-7f8cc4ada3e0 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:44.710805 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-634e6cf3-8383-41b0-86be-7f8cc4ada3e0 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:44.711790 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-634e6cf3-8383-41b0-86be-7f8cc4ada3e0 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:44.713269 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-634e6cf3-8383-41b0-86be-7f8cc4ada3e0 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:44.714168 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-634e6cf3-8383-41b0-86be-7f8cc4ada3e0 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:44.968108 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-5ccc9fb1-8c4c-46cf-a709-1d8e5f21ec8a tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ad048becf474fb972d4291422d810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dcfc7024fc49388c4bd5f25f03e60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:44.977329 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-5ccc9fb1-8c4c-46cf-a709-1d8e5f21ec8a tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/152003e4-2a7b-4801-8656-73093cd566ed" status: 200 len: 1390 microversion: 2.1 time: 1.523703 Oct 04 21:53:44.984056 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1138/2358] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:53:43 2022] GET /compute/v2.1/servers/152003e4-2a7b-4801-8656-73093cd566ed => generated 1390 bytes in 1530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:53:44.994909 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-8dbcd1fe-1464-4cc7-8af5-6ac758f79c1c tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:44.996121 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-8dbcd1fe-1464-4cc7-8af5-6ac758f79c1c tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] [instance: eb6e098d-966d-478b-a69c-3746584e5509] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:53:45.003533 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-634e6cf3-8383-41b0-86be-7f8cc4ada3e0 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927913a1e0cc4d74b42cb209ec932286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2865c04294884d1081c9b1b6fc8f8e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:45.011439 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8dbcd1fe-1464-4cc7-8af5-6ac758f79c1c tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:45.013643 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8dbcd1fe-1464-4cc7-8af5-6ac758f79c1c tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:45.014405 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-634e6cf3-8383-41b0-86be-7f8cc4ada3e0 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] 10.222.0.43 "GET /compute/v2.1/servers/12f775af-b918-467b-a6d1-3ca8a7957f37" status: 200 len: 1320 microversion: 2.1 time: 0.360654 Oct 04 21:53:45.015153 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8dbcd1fe-1464-4cc7-8af5-6ac758f79c1c tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:45.015768 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1221/2359] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:53:44 2022] GET /compute/v2.1/servers/12f775af-b918-467b-a6d1-3ca8a7957f37 => generated 1320 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:53:45.018098 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8dbcd1fe-1464-4cc7-8af5-6ac758f79c1c tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:45.031262 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8dbcd1fe-1464-4cc7-8af5-6ac758f79c1c tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:45.031971 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8dbcd1fe-1464-4cc7-8af5-6ac758f79c1c tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:45.051653 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-3734e85f-3574-45ba-bed5-5725b59175d9 req-1fb8c35e-b3b4-459c-b7e0-e4a7448a6baf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "152003e4-2a7b-4801-8656-73093cd566ed", "tag": "eefc2731-0f05-444f-9e84-6aab2807b291"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:53:45.089470 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-3734e85f-3574-45ba-bed5-5725b59175d9 req-1fb8c35e-b3b4-459c-b7e0-e4a7448a6baf service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:45.091054 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-3734e85f-3574-45ba-bed5-5725b59175d9 req-1fb8c35e-b3b4-459c-b7e0-e4a7448a6baf service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:45.093669 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-3734e85f-3574-45ba-bed5-5725b59175d9 req-1fb8c35e-b3b4-459c-b7e0-e4a7448a6baf service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:45.125056 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-3734e85f-3574-45ba-bed5-5725b59175d9 req-1fb8c35e-b3b4-459c-b7e0-e4a7448a6baf service nova] Creating event network-changed:eefc2731-0f05-444f-9e84-6aab2807b291 for instance 152003e4-2a7b-4801-8656-73093cd566ed on n-h1-860284-1 Oct 04 21:53:45.135865 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-3734e85f-3574-45ba-bed5-5725b59175d9 req-1fb8c35e-b3b4-459c-b7e0-e4a7448a6baf service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093101 Oct 04 21:53:45.137290 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1222/2360] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:53:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:53:45.335781 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-8dbcd1fe-1464-4cc7-8af5-6ac758f79c1c tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47fbc4a6920d451cb1a2ad170de04921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43659cf5fed541e8883664bf17aced70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:45.344748 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-8dbcd1fe-1464-4cc7-8af5-6ac758f79c1c tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] 10.222.0.43 "GET /compute/v2.1/servers/eb6e098d-966d-478b-a69c-3746584e5509" status: 200 len: 1314 microversion: 2.1 time: 0.359236 Oct 04 21:53:45.356281 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1139/2361] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:53:44 2022] GET /compute/v2.1/servers/eb6e098d-966d-478b-a69c-3746584e5509 => generated 1314 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:53:45.420787 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-7c215227-6258-489b-a39d-74715ee4d182 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:45.422793 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-7c215227-6258-489b-a39d-74715ee4d182 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] [instance: 830de6ad-adc6-4d16-ae9d-a29ae85e6cd2] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:53:45.441766 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7c215227-6258-489b-a39d-74715ee4d182 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:45.449148 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7c215227-6258-489b-a39d-74715ee4d182 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:45.455874 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7c215227-6258-489b-a39d-74715ee4d182 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:45.458710 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7c215227-6258-489b-a39d-74715ee4d182 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:45.459645 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7c215227-6258-489b-a39d-74715ee4d182 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:45.461613 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7c215227-6258-489b-a39d-74715ee4d182 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:45.530159 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-7fd8c46e-e2bc-48f3-bc02-244ce21b6634 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Calling method '.version_select at 0x7fbb2e724d30>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:45.603738 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-7fd8c46e-e2bc-48f3-bc02-244ce21b6634 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] 10.222.0.43 "GET /compute/v2.1/images/5157f1c6-d263-427d-84cc-3320cbd286d5" status: 200 len: 1455 microversion: 2.1 time: 0.077540 Oct 04 21:53:45.605815 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1140/2362] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:53:45 2022] GET /compute/v2.1/images/5157f1c6-d263-427d-84cc-3320cbd286d5 => generated 1455 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:53:46.010936 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-a548a7aa-9e87-4c23-8624-8e369f631133 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:46.012405 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-a548a7aa-9e87-4c23-8624-8e369f631133 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 152003e4-2a7b-4801-8656-73093cd566ed] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:53:46.039654 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a548a7aa-9e87-4c23-8624-8e369f631133 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:46.040817 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a548a7aa-9e87-4c23-8624-8e369f631133 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:46.041443 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a548a7aa-9e87-4c23-8624-8e369f631133 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:46.042393 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a548a7aa-9e87-4c23-8624-8e369f631133 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:46.042880 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a548a7aa-9e87-4c23-8624-8e369f631133 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:46.043570 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a548a7aa-9e87-4c23-8624-8e369f631133 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:46.349231 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-7c215227-6258-489b-a39d-74715ee4d182 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:46.382392 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-7c215227-6258-489b-a39d-74715ee4d182 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:46.391634 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-7c215227-6258-489b-a39d-74715ee4d182 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:46.393854 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-7c215227-6258-489b-a39d-74715ee4d182 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] 10.222.0.43 "GET /compute/v2.1/servers/830de6ad-adc6-4d16-ae9d-a29ae85e6cd2" status: 200 len: 1886 microversion: 2.42 time: 0.977894 Oct 04 21:53:46.400159 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1223/2363] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:53:45 2022] GET /compute/v2.1/servers/830de6ad-adc6-4d16-ae9d-a29ae85e6cd2 => generated 1886 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:53:46.409945 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-29f0b328-eef3-40f4-a06b-ed6197f4decb tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:46.410972 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-29f0b328-eef3-40f4-a06b-ed6197f4decb tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] [instance: 12f775af-b918-467b-a6d1-3ca8a7957f37] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:53:46.429026 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-29f0b328-eef3-40f4-a06b-ed6197f4decb tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:46.435466 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-29f0b328-eef3-40f4-a06b-ed6197f4decb tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:46.436390 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-29f0b328-eef3-40f4-a06b-ed6197f4decb tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:46.437385 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-29f0b328-eef3-40f4-a06b-ed6197f4decb tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:46.443369 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-29f0b328-eef3-40f4-a06b-ed6197f4decb tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:46.444622 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-29f0b328-eef3-40f4-a06b-ed6197f4decb tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:46.662128 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-a548a7aa-9e87-4c23-8624-8e369f631133 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ad048becf474fb972d4291422d810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dcfc7024fc49388c4bd5f25f03e60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:46.666860 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=100 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:53:46.675917 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-a548a7aa-9e87-4c23-8624-8e369f631133 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/152003e4-2a7b-4801-8656-73093cd566ed" status: 200 len: 1390 microversion: 2.1 time: 0.670767 Oct 04 21:53:46.681593 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1141/2364] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:53:46 2022] GET /compute/v2.1/servers/152003e4-2a7b-4801-8656-73093cd566ed => generated 1390 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:53:46.695604 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-9fe08093-80f4-4f7c-9182-0627d24e4189 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:46.696575 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-9fe08093-80f4-4f7c-9182-0627d24e4189 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] [instance: eb6e098d-966d-478b-a69c-3746584e5509] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:53:46.706876 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9fe08093-80f4-4f7c-9182-0627d24e4189 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:46.709498 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9fe08093-80f4-4f7c-9182-0627d24e4189 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:46.713936 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9fe08093-80f4-4f7c-9182-0627d24e4189 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:46.715147 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9fe08093-80f4-4f7c-9182-0627d24e4189 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:46.715813 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9fe08093-80f4-4f7c-9182-0627d24e4189 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:46.716413 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9fe08093-80f4-4f7c-9182-0627d24e4189 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:46.928065 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-29f0b328-eef3-40f4-a06b-ed6197f4decb tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927913a1e0cc4d74b42cb209ec932286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2865c04294884d1081c9b1b6fc8f8e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:46.945770 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-29f0b328-eef3-40f4-a06b-ed6197f4decb tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] 10.222.0.43 "GET /compute/v2.1/servers/12f775af-b918-467b-a6d1-3ca8a7957f37" status: 200 len: 1513 microversion: 2.1 time: 0.537897 Oct 04 21:53:46.950209 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1224/2365] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:53:46 2022] GET /compute/v2.1/servers/12f775af-b918-467b-a6d1-3ca8a7957f37 => generated 1513 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:53:46.958275 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-c997bcc0-0e39-46cc-8ed0-e31891235ed0 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Calling method '.version_select at 0x7fbb373dc310>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:47.077364 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-c997bcc0-0e39-46cc-8ed0-e31891235ed0 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] 10.222.0.43 "GET /compute/v2.1/images/5157f1c6-d263-427d-84cc-3320cbd286d5" status: 200 len: 1455 microversion: 2.1 time: 0.125810 Oct 04 21:53:47.080176 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1225/2366] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:53:46 2022] GET /compute/v2.1/images/5157f1c6-d263-427d-84cc-3320cbd286d5 => generated 1455 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:53:47.097440 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-8d686555-6812-4901-a6e8-667779a5a2aa tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:47.098323 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-8d686555-6812-4901-a6e8-667779a5a2aa tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] [instance: 75061d5c-d642-48c4-8b19-b9252812b2cc] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:53:47.122967 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8d686555-6812-4901-a6e8-667779a5a2aa tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:47.123938 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8d686555-6812-4901-a6e8-667779a5a2aa tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:47.124712 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8d686555-6812-4901-a6e8-667779a5a2aa tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:47.125706 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8d686555-6812-4901-a6e8-667779a5a2aa tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:47.126349 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8d686555-6812-4901-a6e8-667779a5a2aa tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:47.126961 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8d686555-6812-4901-a6e8-667779a5a2aa tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:47.188255 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-9fe08093-80f4-4f7c-9182-0627d24e4189 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47fbc4a6920d451cb1a2ad170de04921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43659cf5fed541e8883664bf17aced70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:47.198295 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-9fe08093-80f4-4f7c-9182-0627d24e4189 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] 10.222.0.43 "GET /compute/v2.1/servers/eb6e098d-966d-478b-a69c-3746584e5509" status: 200 len: 1314 microversion: 2.1 time: 0.515295 Oct 04 21:53:47.199499 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1142/2367] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:53:46 2022] GET /compute/v2.1/servers/eb6e098d-966d-478b-a69c-3746584e5509 => generated 1314 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:53:47.254695 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-91ecdd63-75f7-469f-85a6-ca7bed75d80f tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:47.256437 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-91ecdd63-75f7-469f-85a6-ca7bed75d80f tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] [instance: d4abcd04-329d-40a8-8d6e-4383bef437ae] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:53:47.283647 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-91ecdd63-75f7-469f-85a6-ca7bed75d80f tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:47.285738 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-91ecdd63-75f7-469f-85a6-ca7bed75d80f tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:47.286432 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-91ecdd63-75f7-469f-85a6-ca7bed75d80f tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:47.287325 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-91ecdd63-75f7-469f-85a6-ca7bed75d80f tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:47.287948 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-91ecdd63-75f7-469f-85a6-ca7bed75d80f tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:47.289675 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-91ecdd63-75f7-469f-85a6-ca7bed75d80f tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:47.324950 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-91ecdd63-75f7-469f-85a6-ca7bed75d80f tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] [instance: d4abcd04-329d-40a8-8d6e-4383bef437ae] Going to try to terminate instance {{(pid=134101) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:53:47.474296 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-91ecdd63-75f7-469f-85a6-ca7bed75d80f tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] 10.222.0.43 "DELETE /compute/v2.1/servers/d4abcd04-329d-40a8-8d6e-4383bef437ae" status: 204 len: 0 microversion: 2.25 time: 0.269538 Oct 04 21:53:47.479614 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1143/2368] 10.222.0.43 () {60 vars in 1280 bytes} [Tue Oct 4 21:53:47 2022] DELETE /compute/v2.1/servers/d4abcd04-329d-40a8-8d6e-4383bef437ae => generated 0 bytes in 279 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 21:53:47.490588 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-59fcd7c5-93a4-4430-b688-9ddaec6dc111 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:47.492038 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-59fcd7c5-93a4-4430-b688-9ddaec6dc111 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] [instance: 830de6ad-adc6-4d16-ae9d-a29ae85e6cd2] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:53:47.507561 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-59fcd7c5-93a4-4430-b688-9ddaec6dc111 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:47.508273 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-59fcd7c5-93a4-4430-b688-9ddaec6dc111 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:47.508785 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-59fcd7c5-93a4-4430-b688-9ddaec6dc111 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:47.509718 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-59fcd7c5-93a4-4430-b688-9ddaec6dc111 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:47.510492 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-59fcd7c5-93a4-4430-b688-9ddaec6dc111 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:47.511023 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-59fcd7c5-93a4-4430-b688-9ddaec6dc111 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:47.527865 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-8d686555-6812-4901-a6e8-667779a5a2aa tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927913a1e0cc4d74b42cb209ec932286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2865c04294884d1081c9b1b6fc8f8e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:47.537230 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-8d686555-6812-4901-a6e8-667779a5a2aa tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] 10.222.0.43 "GET /compute/v2.1/servers/75061d5c-d642-48c4-8b19-b9252812b2cc" status: 200 len: 1513 microversion: 2.1 time: 0.453519 Oct 04 21:53:47.553202 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1226/2369] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:53:47 2022] GET /compute/v2.1/servers/75061d5c-d642-48c4-8b19-b9252812b2cc => generated 1513 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:53:47.567194 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-18f922ce-afd3-485b-ab6a-44580f0d651c tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:47.567969 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-18f922ce-afd3-485b-ab6a-44580f0d651c tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] [instance: d4abcd04-329d-40a8-8d6e-4383bef437ae] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:53:47.591371 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-18f922ce-afd3-485b-ab6a-44580f0d651c tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:47.591865 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-18f922ce-afd3-485b-ab6a-44580f0d651c tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:47.592311 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-18f922ce-afd3-485b-ab6a-44580f0d651c tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:47.593017 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-18f922ce-afd3-485b-ab6a-44580f0d651c tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:47.593476 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-18f922ce-afd3-485b-ab6a-44580f0d651c tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:47.593902 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-18f922ce-afd3-485b-ab6a-44580f0d651c tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:47.937877 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-18f922ce-afd3-485b-ab6a-44580f0d651c tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:47.952416 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-59fcd7c5-93a4-4430-b688-9ddaec6dc111 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:47.953706 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-18f922ce-afd3-485b-ab6a-44580f0d651c tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:47.955550 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-18f922ce-afd3-485b-ab6a-44580f0d651c tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:47.956950 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-18f922ce-afd3-485b-ab6a-44580f0d651c tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] 10.222.0.43 "GET /compute/v2.1/servers/d4abcd04-329d-40a8-8d6e-4383bef437ae" status: 200 len: 1732 microversion: 2.25 time: 0.408997 Oct 04 21:53:47.962777 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1227/2370] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:53:47 2022] GET /compute/v2.1/servers/d4abcd04-329d-40a8-8d6e-4383bef437ae => generated 1732 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:53:47.967732 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-536d3d41-0c0b-4450-b0f4-91c5bc84aa42 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:47.971271 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-536d3d41-0c0b-4450-b0f4-91c5bc84aa42 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] [instance: a120b0ad-f6e3-4ecb-9312-e92d5c115fd3] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:53:47.984255 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-536d3d41-0c0b-4450-b0f4-91c5bc84aa42 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:47.991627 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-536d3d41-0c0b-4450-b0f4-91c5bc84aa42 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:47.992194 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-536d3d41-0c0b-4450-b0f4-91c5bc84aa42 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:47.993035 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-536d3d41-0c0b-4450-b0f4-91c5bc84aa42 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:47.994124 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-536d3d41-0c0b-4450-b0f4-91c5bc84aa42 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:47.994661 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-536d3d41-0c0b-4450-b0f4-91c5bc84aa42 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:47.996180 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-59fcd7c5-93a4-4430-b688-9ddaec6dc111 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:47.997340 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-59fcd7c5-93a4-4430-b688-9ddaec6dc111 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:47.998692 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-59fcd7c5-93a4-4430-b688-9ddaec6dc111 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] 10.222.0.43 "GET /compute/v2.1/servers/830de6ad-adc6-4d16-ae9d-a29ae85e6cd2" status: 200 len: 1886 microversion: 2.42 time: 0.517500 Oct 04 21:53:47.999678 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1144/2371] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:53:47 2022] GET /compute/v2.1/servers/830de6ad-adc6-4d16-ae9d-a29ae85e6cd2 => generated 1886 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:53:48.019878 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-02882e14-f2f8-4ad0-bc87-a5e14b3ffa43 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:48.021173 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-02882e14-f2f8-4ad0-bc87-a5e14b3ffa43 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 152003e4-2a7b-4801-8656-73093cd566ed] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:53:48.042089 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-02882e14-f2f8-4ad0-bc87-a5e14b3ffa43 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:48.043227 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-02882e14-f2f8-4ad0-bc87-a5e14b3ffa43 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:48.043807 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-02882e14-f2f8-4ad0-bc87-a5e14b3ffa43 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:48.045001 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-02882e14-f2f8-4ad0-bc87-a5e14b3ffa43 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:48.045600 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-02882e14-f2f8-4ad0-bc87-a5e14b3ffa43 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:48.046298 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-02882e14-f2f8-4ad0-bc87-a5e14b3ffa43 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:48.397304 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-02882e14-f2f8-4ad0-bc87-a5e14b3ffa43 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ad048becf474fb972d4291422d810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dcfc7024fc49388c4bd5f25f03e60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:48.435760 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-02882e14-f2f8-4ad0-bc87-a5e14b3ffa43 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/152003e4-2a7b-4801-8656-73093cd566ed" status: 200 len: 1390 microversion: 2.1 time: 0.424045 Oct 04 21:53:48.436435 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1145/2372] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:53:47 2022] GET /compute/v2.1/servers/152003e4-2a7b-4801-8656-73093cd566ed => generated 1390 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:53:48.458488 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-8dba7dcd-ed6d-4229-ae82-d605fc273478 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Calling method '.version_select at 0x7fbb2e785d30>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:48.506781 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-536d3d41-0c0b-4450-b0f4-91c5bc84aa42 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927913a1e0cc4d74b42cb209ec932286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2865c04294884d1081c9b1b6fc8f8e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:48.524066 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-536d3d41-0c0b-4450-b0f4-91c5bc84aa42 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] 10.222.0.43 "GET /compute/v2.1/servers/a120b0ad-f6e3-4ecb-9312-e92d5c115fd3" status: 200 len: 1512 microversion: 2.1 time: 0.559818 Oct 04 21:53:48.527102 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1228/2373] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:53:47 2022] GET /compute/v2.1/servers/a120b0ad-f6e3-4ecb-9312-e92d5c115fd3 => generated 1512 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:53:48.585260 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-61e48807-a426-4a39-8ecb-55ed5b3b47e2 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:48.603694 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-8dba7dcd-ed6d-4229-ae82-d605fc273478 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] 10.222.0.43 "GET /compute/v2.1/images/5157f1c6-d263-427d-84cc-3320cbd286d5" status: 200 len: 1455 microversion: 2.1 time: 0.162751 Oct 04 21:53:48.605176 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-61e48807-a426-4a39-8ecb-55ed5b3b47e2 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] [instance: eb6e098d-966d-478b-a69c-3746584e5509] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:53:48.606582 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1146/2374] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:53:48 2022] GET /compute/v2.1/images/5157f1c6-d263-427d-84cc-3320cbd286d5 => generated 1455 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:53:48.620939 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-84280fb8-0bd7-4cea-8ba0-6cc1e6d03184 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:48.622268 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-84280fb8-0bd7-4cea-8ba0-6cc1e6d03184 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] [instance: a120b0ad-f6e3-4ecb-9312-e92d5c115fd3] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:53:48.623779 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-61e48807-a426-4a39-8ecb-55ed5b3b47e2 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:48.624464 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-61e48807-a426-4a39-8ecb-55ed5b3b47e2 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:48.624903 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-61e48807-a426-4a39-8ecb-55ed5b3b47e2 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:48.627766 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-61e48807-a426-4a39-8ecb-55ed5b3b47e2 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:48.628894 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-61e48807-a426-4a39-8ecb-55ed5b3b47e2 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:48.630750 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-61e48807-a426-4a39-8ecb-55ed5b3b47e2 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:48.641181 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-84280fb8-0bd7-4cea-8ba0-6cc1e6d03184 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:48.641730 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-84280fb8-0bd7-4cea-8ba0-6cc1e6d03184 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:48.642922 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-84280fb8-0bd7-4cea-8ba0-6cc1e6d03184 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:48.643833 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-84280fb8-0bd7-4cea-8ba0-6cc1e6d03184 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:48.646709 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-84280fb8-0bd7-4cea-8ba0-6cc1e6d03184 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:48.649004 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-84280fb8-0bd7-4cea-8ba0-6cc1e6d03184 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:48.735686 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-84280fb8-0bd7-4cea-8ba0-6cc1e6d03184 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] [instance: a120b0ad-f6e3-4ecb-9312-e92d5c115fd3] Going to try to terminate instance {{(pid=134101) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:53:48.866116 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-84280fb8-0bd7-4cea-8ba0-6cc1e6d03184 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] 10.222.0.43 "DELETE /compute/v2.1/servers/a120b0ad-f6e3-4ecb-9312-e92d5c115fd3" status: 204 len: 0 microversion: 2.1 time: 0.258019 Oct 04 21:53:48.867992 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1147/2375] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 21:53:48 2022] DELETE /compute/v2.1/servers/a120b0ad-f6e3-4ecb-9312-e92d5c115fd3 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:53:48.891370 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-a1e22b83-86b2-4fbe-b241-f449e96aeb93 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:48.895893 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-a1e22b83-86b2-4fbe-b241-f449e96aeb93 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] [instance: a120b0ad-f6e3-4ecb-9312-e92d5c115fd3] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:53:48.906210 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a1e22b83-86b2-4fbe-b241-f449e96aeb93 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:48.906924 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a1e22b83-86b2-4fbe-b241-f449e96aeb93 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:48.908706 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a1e22b83-86b2-4fbe-b241-f449e96aeb93 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:48.910183 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a1e22b83-86b2-4fbe-b241-f449e96aeb93 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:48.910895 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a1e22b83-86b2-4fbe-b241-f449e96aeb93 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:48.911495 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a1e22b83-86b2-4fbe-b241-f449e96aeb93 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:48.983515 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-61e48807-a426-4a39-8ecb-55ed5b3b47e2 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47fbc4a6920d451cb1a2ad170de04921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43659cf5fed541e8883664bf17aced70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:48.996917 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-61e48807-a426-4a39-8ecb-55ed5b3b47e2 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] 10.222.0.43 "GET /compute/v2.1/servers/eb6e098d-966d-478b-a69c-3746584e5509" status: 200 len: 1314 microversion: 2.1 time: 0.434042 Oct 04 21:53:48.997550 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1229/2376] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:53:48 2022] GET /compute/v2.1/servers/eb6e098d-966d-478b-a69c-3746584e5509 => generated 1314 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:53:49.009220 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-5f00d9d4-847d-46a7-9c38-8b1c430a967e tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:49.009847 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-5f00d9d4-847d-46a7-9c38-8b1c430a967e tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] [instance: d4abcd04-329d-40a8-8d6e-4383bef437ae] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:53:49.027848 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5f00d9d4-847d-46a7-9c38-8b1c430a967e tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:49.028595 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5f00d9d4-847d-46a7-9c38-8b1c430a967e tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:49.029482 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5f00d9d4-847d-46a7-9c38-8b1c430a967e tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:49.030449 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5f00d9d4-847d-46a7-9c38-8b1c430a967e tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:49.031319 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5f00d9d4-847d-46a7-9c38-8b1c430a967e tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:49.032099 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5f00d9d4-847d-46a7-9c38-8b1c430a967e tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:49.126498 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-a1e22b83-86b2-4fbe-b241-f449e96aeb93 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927913a1e0cc4d74b42cb209ec932286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2865c04294884d1081c9b1b6fc8f8e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:49.143595 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-a1e22b83-86b2-4fbe-b241-f449e96aeb93 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] 10.222.0.43 "GET /compute/v2.1/servers/a120b0ad-f6e3-4ecb-9312-e92d5c115fd3" status: 200 len: 1518 microversion: 2.1 time: 0.269752 Oct 04 21:53:49.150797 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1148/2377] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:53:48 2022] GET /compute/v2.1/servers/a120b0ad-f6e3-4ecb-9312-e92d5c115fd3 => generated 1518 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:53:49.167224 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-0f48d778-26c7-499e-a2bf-f5d8d19df882 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:49.168040 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-0f48d778-26c7-499e-a2bf-f5d8d19df882 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] [instance: 830de6ad-adc6-4d16-ae9d-a29ae85e6cd2] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:53:49.179050 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0f48d778-26c7-499e-a2bf-f5d8d19df882 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:49.183304 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0f48d778-26c7-499e-a2bf-f5d8d19df882 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:49.183898 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0f48d778-26c7-499e-a2bf-f5d8d19df882 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:49.184852 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0f48d778-26c7-499e-a2bf-f5d8d19df882 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:49.185429 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0f48d778-26c7-499e-a2bf-f5d8d19df882 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:49.186252 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0f48d778-26c7-499e-a2bf-f5d8d19df882 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:49.500394 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-5f00d9d4-847d-46a7-9c38-8b1c430a967e tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:49.516440 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-5f00d9d4-847d-46a7-9c38-8b1c430a967e tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:49.521187 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-5f00d9d4-847d-46a7-9c38-8b1c430a967e tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:49.523014 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-5f00d9d4-847d-46a7-9c38-8b1c430a967e tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] 10.222.0.43 "GET /compute/v2.1/servers/d4abcd04-329d-40a8-8d6e-4383bef437ae" status: 200 len: 1732 microversion: 2.25 time: 0.520034 Oct 04 21:53:49.527484 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1230/2378] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:53:48 2022] GET /compute/v2.1/servers/d4abcd04-329d-40a8-8d6e-4383bef437ae => generated 1732 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:53:49.553843 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-7144fbb5-ad42-40e3-8981-8d235b10ffe9 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:49.554491 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-7144fbb5-ad42-40e3-8981-8d235b10ffe9 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 152003e4-2a7b-4801-8656-73093cd566ed] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:53:49.576056 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7144fbb5-ad42-40e3-8981-8d235b10ffe9 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:49.580441 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7144fbb5-ad42-40e3-8981-8d235b10ffe9 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:49.580911 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7144fbb5-ad42-40e3-8981-8d235b10ffe9 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:49.583455 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7144fbb5-ad42-40e3-8981-8d235b10ffe9 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:49.584013 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7144fbb5-ad42-40e3-8981-8d235b10ffe9 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:49.586705 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7144fbb5-ad42-40e3-8981-8d235b10ffe9 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:49.677190 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-0f48d778-26c7-499e-a2bf-f5d8d19df882 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:49.717928 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-0f48d778-26c7-499e-a2bf-f5d8d19df882 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:49.722087 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-0f48d778-26c7-499e-a2bf-f5d8d19df882 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:49.736671 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-0f48d778-26c7-499e-a2bf-f5d8d19df882 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] 10.222.0.43 "GET /compute/v2.1/servers/830de6ad-adc6-4d16-ae9d-a29ae85e6cd2" status: 200 len: 1886 microversion: 2.42 time: 0.576642 Oct 04 21:53:49.739362 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1149/2379] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:53:49 2022] GET /compute/v2.1/servers/830de6ad-adc6-4d16-ae9d-a29ae85e6cd2 => generated 1886 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:53:49.749439 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-2cea0aae-32e4-4482-a338-f98deebc7ead tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Calling method '.version_select at 0x7fbb37210a60>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:49.845285 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-2cea0aae-32e4-4482-a338-f98deebc7ead tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] 10.222.0.43 "GET /compute/v2.1/images/5157f1c6-d263-427d-84cc-3320cbd286d5" status: 200 len: 1455 microversion: 2.1 time: 0.099516 Oct 04 21:53:49.860050 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1150/2380] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:53:49 2022] GET /compute/v2.1/images/5157f1c6-d263-427d-84cc-3320cbd286d5 => generated 1455 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:53:50.022224 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-61b025e8-204a-4fd9-b02a-403699d7a4c4 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:50.023949 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-61b025e8-204a-4fd9-b02a-403699d7a4c4 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] [instance: eb6e098d-966d-478b-a69c-3746584e5509] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:53:50.057737 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-61b025e8-204a-4fd9-b02a-403699d7a4c4 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:50.059246 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-61b025e8-204a-4fd9-b02a-403699d7a4c4 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:50.059898 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-61b025e8-204a-4fd9-b02a-403699d7a4c4 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:50.060784 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-61b025e8-204a-4fd9-b02a-403699d7a4c4 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:50.061696 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-61b025e8-204a-4fd9-b02a-403699d7a4c4 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:50.062282 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-61b025e8-204a-4fd9-b02a-403699d7a4c4 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:50.265833 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-7144fbb5-ad42-40e3-8981-8d235b10ffe9 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ad048becf474fb972d4291422d810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dcfc7024fc49388c4bd5f25f03e60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:50.274572 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-7144fbb5-ad42-40e3-8981-8d235b10ffe9 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/152003e4-2a7b-4801-8656-73093cd566ed" status: 200 len: 1390 microversion: 2.1 time: 0.745637 Oct 04 21:53:50.283436 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1231/2381] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:53:49 2022] GET /compute/v2.1/servers/152003e4-2a7b-4801-8656-73093cd566ed => generated 1390 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:53:50.299969 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-6b14131d-c835-43d4-9636-c0d0ac77c73a tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:50.300774 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-6b14131d-c835-43d4-9636-c0d0ac77c73a tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] [instance: a120b0ad-f6e3-4ecb-9312-e92d5c115fd3] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:53:50.311372 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6b14131d-c835-43d4-9636-c0d0ac77c73a tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:50.311879 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6b14131d-c835-43d4-9636-c0d0ac77c73a tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:50.312337 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6b14131d-c835-43d4-9636-c0d0ac77c73a tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:50.313634 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6b14131d-c835-43d4-9636-c0d0ac77c73a tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:50.314124 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6b14131d-c835-43d4-9636-c0d0ac77c73a tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:50.314604 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6b14131d-c835-43d4-9636-c0d0ac77c73a tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:50.439020 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-61b025e8-204a-4fd9-b02a-403699d7a4c4 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47fbc4a6920d451cb1a2ad170de04921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43659cf5fed541e8883664bf17aced70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:50.475415 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-61b025e8-204a-4fd9-b02a-403699d7a4c4 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] 10.222.0.43 "GET /compute/v2.1/servers/eb6e098d-966d-478b-a69c-3746584e5509" status: 200 len: 1314 microversion: 2.1 time: 0.459415 Oct 04 21:53:50.478978 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1151/2382] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:53:50 2022] GET /compute/v2.1/servers/eb6e098d-966d-478b-a69c-3746584e5509 => generated 1314 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:53:50.532972 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-6b14131d-c835-43d4-9636-c0d0ac77c73a tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927913a1e0cc4d74b42cb209ec932286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2865c04294884d1081c9b1b6fc8f8e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:50.544014 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-6b14131d-c835-43d4-9636-c0d0ac77c73a tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] 10.222.0.43 "GET /compute/v2.1/servers/a120b0ad-f6e3-4ecb-9312-e92d5c115fd3" status: 200 len: 1518 microversion: 2.1 time: 0.259360 Oct 04 21:53:50.546965 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1232/2383] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:53:50 2022] GET /compute/v2.1/servers/a120b0ad-f6e3-4ecb-9312-e92d5c115fd3 => generated 1518 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:53:50.554912 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-10d267ae-c8ec-4e8f-8c93-a3fc55ee1d3e tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:50.555691 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-10d267ae-c8ec-4e8f-8c93-a3fc55ee1d3e tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] [instance: d4abcd04-329d-40a8-8d6e-4383bef437ae] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:53:50.563781 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-10d267ae-c8ec-4e8f-8c93-a3fc55ee1d3e tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:50.563998 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-10d267ae-c8ec-4e8f-8c93-a3fc55ee1d3e tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:50.564436 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-10d267ae-c8ec-4e8f-8c93-a3fc55ee1d3e tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:50.567316 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-10d267ae-c8ec-4e8f-8c93-a3fc55ee1d3e tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:50.567788 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-10d267ae-c8ec-4e8f-8c93-a3fc55ee1d3e tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:50.568222 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-10d267ae-c8ec-4e8f-8c93-a3fc55ee1d3e tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:50.702695 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-10d267ae-c8ec-4e8f-8c93-a3fc55ee1d3e tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:50.721731 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-10d267ae-c8ec-4e8f-8c93-a3fc55ee1d3e tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:50.725254 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-10d267ae-c8ec-4e8f-8c93-a3fc55ee1d3e tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:50.726800 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-10d267ae-c8ec-4e8f-8c93-a3fc55ee1d3e tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] 10.222.0.43 "GET /compute/v2.1/servers/d4abcd04-329d-40a8-8d6e-4383bef437ae" status: 200 len: 1665 microversion: 2.25 time: 0.176733 Oct 04 21:53:50.731147 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1152/2384] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:53:50 2022] GET /compute/v2.1/servers/d4abcd04-329d-40a8-8d6e-4383bef437ae => generated 1665 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:53:50.771564 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-01c0f89f-16b5-4067-b8ca-96363f898c1e tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:50.772174 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-01c0f89f-16b5-4067-b8ca-96363f898c1e tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] [instance: 830de6ad-adc6-4d16-ae9d-a29ae85e6cd2] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:53:50.812454 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-01c0f89f-16b5-4067-b8ca-96363f898c1e tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:50.816879 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-01c0f89f-16b5-4067-b8ca-96363f898c1e tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:50.817390 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-01c0f89f-16b5-4067-b8ca-96363f898c1e tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:50.818138 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-01c0f89f-16b5-4067-b8ca-96363f898c1e tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:50.818621 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-01c0f89f-16b5-4067-b8ca-96363f898c1e tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:50.819050 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-01c0f89f-16b5-4067-b8ca-96363f898c1e tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:50.861167 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e3242092-5e81-47d7-bdf4-c2ff5dd9644c tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Calling method '.version_select at 0x7fbb37210820>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:51.018106 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-e3242092-5e81-47d7-bdf4-c2ff5dd9644c tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] 10.222.0.43 "GET /compute/v2.1/images/5157f1c6-d263-427d-84cc-3320cbd286d5" status: 200 len: 1455 microversion: 2.1 time: 0.160637 Oct 04 21:53:51.018778 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1153/2385] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:53:50 2022] GET /compute/v2.1/images/5157f1c6-d263-427d-84cc-3320cbd286d5 => generated 1455 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:53:51.045701 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-4a4666f6-5262-4294-b667-57983a8f0563 req-1e2ba91f-f4b7-4e49-ab62-93647de4919f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4abcd04-329d-40a8-8d6e-4383bef437ae", "name": "network-vif-deleted", "tag": "000d4b8f-4676-41c0-a0c8-303e63366262"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:53:51.084153 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-4a4666f6-5262-4294-b667-57983a8f0563 req-1e2ba91f-f4b7-4e49-ab62-93647de4919f service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:51.084647 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-4a4666f6-5262-4294-b667-57983a8f0563 req-1e2ba91f-f4b7-4e49-ab62-93647de4919f service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:51.085129 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-4a4666f6-5262-4294-b667-57983a8f0563 req-1e2ba91f-f4b7-4e49-ab62-93647de4919f service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:51.129686 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-4a4666f6-5262-4294-b667-57983a8f0563 req-1e2ba91f-f4b7-4e49-ab62-93647de4919f service nova] Creating event network-vif-deleted:000d4b8f-4676-41c0-a0c8-303e63366262 for instance d4abcd04-329d-40a8-8d6e-4383bef437ae on n-h2-860284-1 Oct 04 21:53:51.155886 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-4a4666f6-5262-4294-b667-57983a8f0563 req-1e2ba91f-f4b7-4e49-ab62-93647de4919f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127196 Oct 04 21:53:51.163187 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1154/2386] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:53:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:53:51.311819 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-2a0003f2-27b8-45e3-a1a0-654a6d6a134f tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:51.312776 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-2a0003f2-27b8-45e3-a1a0-654a6d6a134f tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 152003e4-2a7b-4801-8656-73093cd566ed] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:53:51.326264 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2a0003f2-27b8-45e3-a1a0-654a6d6a134f tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:51.332377 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2a0003f2-27b8-45e3-a1a0-654a6d6a134f tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:51.336035 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2a0003f2-27b8-45e3-a1a0-654a6d6a134f tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:51.339935 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2a0003f2-27b8-45e3-a1a0-654a6d6a134f tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:51.343391 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2a0003f2-27b8-45e3-a1a0-654a6d6a134f tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:51.348264 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2a0003f2-27b8-45e3-a1a0-654a6d6a134f tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:51.804180 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-01c0f89f-16b5-4067-b8ca-96363f898c1e tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:51.828937 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-01c0f89f-16b5-4067-b8ca-96363f898c1e tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:51.833474 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-01c0f89f-16b5-4067-b8ca-96363f898c1e tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:51.844448 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-01c0f89f-16b5-4067-b8ca-96363f898c1e tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] 10.222.0.43 "GET /compute/v2.1/servers/830de6ad-adc6-4d16-ae9d-a29ae85e6cd2" status: 200 len: 1886 microversion: 2.42 time: 1.075008 Oct 04 21:53:51.845417 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1233/2387] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:53:50 2022] GET /compute/v2.1/servers/830de6ad-adc6-4d16-ae9d-a29ae85e6cd2 => generated 1886 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:53:51.866850 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-a828f287-fb76-4d4e-8369-9526d0da5363 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:51.867723 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-a828f287-fb76-4d4e-8369-9526d0da5363 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] [instance: eb6e098d-966d-478b-a69c-3746584e5509] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:53:51.891185 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a828f287-fb76-4d4e-8369-9526d0da5363 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:51.895665 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a828f287-fb76-4d4e-8369-9526d0da5363 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:51.896580 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a828f287-fb76-4d4e-8369-9526d0da5363 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:51.899962 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a828f287-fb76-4d4e-8369-9526d0da5363 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:51.902630 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a828f287-fb76-4d4e-8369-9526d0da5363 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:51.903408 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a828f287-fb76-4d4e-8369-9526d0da5363 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:51.922668 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=100 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:53:51.928618 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-2a0003f2-27b8-45e3-a1a0-654a6d6a134f tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ad048becf474fb972d4291422d810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dcfc7024fc49388c4bd5f25f03e60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:51.942203 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-2a0003f2-27b8-45e3-a1a0-654a6d6a134f tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/152003e4-2a7b-4801-8656-73093cd566ed" status: 200 len: 1390 microversion: 2.1 time: 0.634673 Oct 04 21:53:51.943739 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1155/2388] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:53:51 2022] GET /compute/v2.1/servers/152003e4-2a7b-4801-8656-73093cd566ed => generated 1390 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:53:51.950866 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-62017144-e49a-49c5-9dc5-0ace5bb96fd7 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:51.951901 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-62017144-e49a-49c5-9dc5-0ace5bb96fd7 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] [instance: a120b0ad-f6e3-4ecb-9312-e92d5c115fd3] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:53:51.958489 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:53:51.960226 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-62017144-e49a-49c5-9dc5-0ace5bb96fd7 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:51.961046 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-62017144-e49a-49c5-9dc5-0ace5bb96fd7 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:51.962753 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-62017144-e49a-49c5-9dc5-0ace5bb96fd7 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:51.966634 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-62017144-e49a-49c5-9dc5-0ace5bb96fd7 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:51.969434 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-62017144-e49a-49c5-9dc5-0ace5bb96fd7 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:51.970106 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-62017144-e49a-49c5-9dc5-0ace5bb96fd7 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:53.047683 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-62017144-e49a-49c5-9dc5-0ace5bb96fd7 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927913a1e0cc4d74b42cb209ec932286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2865c04294884d1081c9b1b6fc8f8e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:53.069506 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-a828f287-fb76-4d4e-8369-9526d0da5363 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47fbc4a6920d451cb1a2ad170de04921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43659cf5fed541e8883664bf17aced70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:53.082143 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-62017144-e49a-49c5-9dc5-0ace5bb96fd7 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] 10.222.0.43 "GET /compute/v2.1/servers/a120b0ad-f6e3-4ecb-9312-e92d5c115fd3" status: 200 len: 1518 microversion: 2.1 time: 1.137035 Oct 04 21:53:53.085273 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1156/2389] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:53:51 2022] GET /compute/v2.1/servers/a120b0ad-f6e3-4ecb-9312-e92d5c115fd3 => generated 1518 bytes in 1140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:53:53.085519 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-a828f287-fb76-4d4e-8369-9526d0da5363 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] 10.222.0.43 "GET /compute/v2.1/servers/eb6e098d-966d-478b-a69c-3746584e5509" status: 200 len: 1314 microversion: 2.1 time: 1.231709 Oct 04 21:53:53.087653 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1234/2390] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:53:51 2022] GET /compute/v2.1/servers/eb6e098d-966d-478b-a69c-3746584e5509 => generated 1314 bytes in 1241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:53:53.107022 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-189af53c-0780-4fe9-bc47-8ec830e16be5 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Calling method '.version_select at 0x7fbb2efc03a0>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:53.110312 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-6a68cd01-98fc-4773-acf1-51a8f4df2837 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:53.110987 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-6a68cd01-98fc-4773-acf1-51a8f4df2837 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] [instance: d4abcd04-329d-40a8-8d6e-4383bef437ae] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:53:53.148381 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6a68cd01-98fc-4773-acf1-51a8f4df2837 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:53.148381 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6a68cd01-98fc-4773-acf1-51a8f4df2837 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:53.148810 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6a68cd01-98fc-4773-acf1-51a8f4df2837 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:53.151182 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6a68cd01-98fc-4773-acf1-51a8f4df2837 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:53.153511 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6a68cd01-98fc-4773-acf1-51a8f4df2837 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:53.153965 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6a68cd01-98fc-4773-acf1-51a8f4df2837 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:53.181828 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-6a68cd01-98fc-4773-acf1-51a8f4df2837 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] HTTP exception thrown: Instance d4abcd04-329d-40a8-8d6e-4383bef437ae could not be found. Oct 04 21:53:53.191921 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-6a68cd01-98fc-4773-acf1-51a8f4df2837 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Request method failure captured: Oct 04 21:53:53.191921 n-d-860284-1 devstack@n-api.service[134101]: request: GET /compute/v2.1/servers/d4abcd04-329d-40a8-8d6e-4383bef437ae HTTP/1.1 Oct 04 21:53:53.191921 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 21:53:53.191921 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 21:53:53.191921 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 21:53:53.191921 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 21:53:53.191921 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 21:53:53.191921 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 21:53:53.191921 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 21:53:53.191921 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 21:53:53.191921 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPKlMyaAXDvUTID1IzmmSywCvuysT3aI_a5P3CwNV1RlnNDYDfurU0jpixzpaKj5sOoQgCtK8oEEPLd6IixW0SOcr8dqp0RNwGHWp6j9yDPQZ2lsf_JdMcGPWfUMhVnyczlDBdJXpSneu7x_nFwY0L7QA-CqDJHoDoK7jdZ7w20lPxmA Oct 04 21:53:53.191921 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 21:53:53.191921 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 21:53:53.191921 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 21:53:53.191921 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 21:53:53.191921 n-d-860284-1 devstack@n-api.service[134101]: X-Openstack-Nova-Api-Version: 2.25 Oct 04 21:53:53.191921 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 21:53:53.191921 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 21:53:53.191921 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: f17fee483fd14b07977669df199f3018 Oct 04 21:53:53.191921 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-2121064375 Oct 04 21:53:53.191921 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 21:53:53.191921 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 21:53:53.191921 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f17fee483fd14b07977669df199f3018"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_f17fee483fd14b07977669df199f3018", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f17fee483fd14b07977669df199f3018"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/f17fee483fd14b07977669df199f3018"}]}] Oct 04 21:53:53.191921 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-2121064375 Oct 04 21:53:53.191921 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: f17fee483fd14b07977669df199f3018 Oct 04 21:53:53.191921 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-2121064375 Oct 04 21:53:53.191921 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-LiveAutoBlockMigrationV225Test-2121064375-project Oct 04 21:53:53.191921 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 21:53:53.191921 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 21:53:53.191921 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: f529f881a037459d9405bd14afd7a639 Oct 04 21:53:53.191921 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-2121064375-project Oct 04 21:53:53.191921 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 21:53:53.191921 n-d-860284-1 devstack@n-api.service[134101]: exception: Instance d4abcd04-329d-40a8-8d6e-4383bef437ae could not be found. Oct 04 21:53:53.191921 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': 'd4abcd04-329d-40a8-8d6e-4383bef437ae'} Oct 04 21:53:53.191921 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:53:53.191921 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:53:53.191921 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:53:53.191921 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:53:53.191921 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:53:53.191921 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:53:53.191921 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:53:53.191921 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:53:53.191921 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:53:53.191921 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:53:53.191921 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4abcd04-329d-40a8-8d6e-4383bef437ae could not be found. Oct 04 21:53:53.191921 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:53:53.191921 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:53:53.191921 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:53:53.191921 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:53:53.191921 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:53:53.191921 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:53:53.191921 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:53:53.191921 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:53:53.191921 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:53:53.191921 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:53:53.191921 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:53:53.191921 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:53:53.191921 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:53:53.191921 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:53:53.191921 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:53:53.191921 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:53:53.191921 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4abcd04-329d-40a8-8d6e-4383bef437ae could not be found. Oct 04 21:53:53.191921 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:53:53.196223 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:53:53.196223 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:53:53.196223 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:53:53.196223 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:53:53.196223 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:53:53.196223 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:53:53.196223 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:53:53.196223 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4abcd04-329d-40a8-8d6e-4383bef437ae could not be found. Oct 04 21:53:53.196223 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:53:53.196223 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-6a68cd01-98fc-4773-acf1-51a8f4df2837 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Returning 404 to user: Instance d4abcd04-329d-40a8-8d6e-4383bef437ae could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:53:53.213769 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-189af53c-0780-4fe9-bc47-8ec830e16be5 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] 10.222.0.43 "GET /compute/v2.1/images/5157f1c6-d263-427d-84cc-3320cbd286d5" status: 200 len: 1455 microversion: 2.1 time: 0.124848 Oct 04 21:53:53.214444 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1235/2391] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:53:53 2022] GET /compute/v2.1/images/5157f1c6-d263-427d-84cc-3320cbd286d5 => generated 1455 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:53:53.223581 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-6a68cd01-98fc-4773-acf1-51a8f4df2837 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] 10.222.0.43 "GET /compute/v2.1/servers/d4abcd04-329d-40a8-8d6e-4383bef437ae" status: 404 len: 111 microversion: 2.25 time: 0.136812 Oct 04 21:53:53.224194 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1157/2392] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:53:53 2022] GET /compute/v2.1/servers/d4abcd04-329d-40a8-8d6e-4383bef437ae => generated 111 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 21:53:53.246633 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-3ff2d2a7-03df-401c-9e32-272414a7b28b tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:53.251587 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-c64d6d29-4f9a-49cd-b0e1-50988002b22b tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:53.258136 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-c64d6d29-4f9a-49cd-b0e1-50988002b22b tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] [instance: 830de6ad-adc6-4d16-ae9d-a29ae85e6cd2] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:53:53.260948 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-3ff2d2a7-03df-401c-9e32-272414a7b28b tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 152003e4-2a7b-4801-8656-73093cd566ed] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:53:53.294881 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c64d6d29-4f9a-49cd-b0e1-50988002b22b tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:53.295498 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c64d6d29-4f9a-49cd-b0e1-50988002b22b tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:53.296217 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c64d6d29-4f9a-49cd-b0e1-50988002b22b tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:53.296974 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c64d6d29-4f9a-49cd-b0e1-50988002b22b tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:53.297441 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c64d6d29-4f9a-49cd-b0e1-50988002b22b tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:53.297871 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c64d6d29-4f9a-49cd-b0e1-50988002b22b tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:53.299942 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3ff2d2a7-03df-401c-9e32-272414a7b28b tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:53.300439 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3ff2d2a7-03df-401c-9e32-272414a7b28b tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:53.300882 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3ff2d2a7-03df-401c-9e32-272414a7b28b tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:53.310522 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3ff2d2a7-03df-401c-9e32-272414a7b28b tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:53.311035 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3ff2d2a7-03df-401c-9e32-272414a7b28b tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:53.318764 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3ff2d2a7-03df-401c-9e32-272414a7b28b tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:54.092966 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-c64d6d29-4f9a-49cd-b0e1-50988002b22b tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:54.117210 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-c64d6d29-4f9a-49cd-b0e1-50988002b22b tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:54.124676 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-c64d6d29-4f9a-49cd-b0e1-50988002b22b tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:54.136115 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-c64d6d29-4f9a-49cd-b0e1-50988002b22b tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] 10.222.0.43 "GET /compute/v2.1/servers/830de6ad-adc6-4d16-ae9d-a29ae85e6cd2" status: 200 len: 1874 microversion: 2.42 time: 0.901527 Oct 04 21:53:54.150781 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1236/2393] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:53:53 2022] GET /compute/v2.1/servers/830de6ad-adc6-4d16-ae9d-a29ae85e6cd2 => generated 1874 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:53:54.172902 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-86bc6550-d244-42f2-b11d-0518bc6d77f0 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Calling method '.version_select at 0x7fbb2f97bdc0>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:54.234141 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-86bc6550-d244-42f2-b11d-0518bc6d77f0 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-821678649" status: 204 len: 0 microversion: 2.25 time: 0.079763 Oct 04 21:53:54.234834 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1237/2394] 10.222.0.43 () {60 vars in 1259 bytes} [Tue Oct 4 21:53:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-821678649 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 21:53:54.261201 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-6f3ca65e-8e3b-415f-8707-6363d6e34416 req-c8c0a63a-4ce5-4ef6-9bda-b5c19113b4f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a120b0ad-f6e3-4ecb-9312-e92d5c115fd3", "name": "network-vif-deleted", "tag": "67d021b1-9a40-436e-9b43-a6c18c852905"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:53:54.300723 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-6f3ca65e-8e3b-415f-8707-6363d6e34416 req-c8c0a63a-4ce5-4ef6-9bda-b5c19113b4f0 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:54.305471 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-6f3ca65e-8e3b-415f-8707-6363d6e34416 req-c8c0a63a-4ce5-4ef6-9bda-b5c19113b4f0 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:54.309092 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-6f3ca65e-8e3b-415f-8707-6363d6e34416 req-c8c0a63a-4ce5-4ef6-9bda-b5c19113b4f0 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:54.337088 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-6f3ca65e-8e3b-415f-8707-6363d6e34416 req-c8c0a63a-4ce5-4ef6-9bda-b5c19113b4f0 service nova] Creating event network-vif-deleted:67d021b1-9a40-436e-9b43-a6c18c852905 for instance a120b0ad-f6e3-4ecb-9312-e92d5c115fd3 on n-h1-860284-1 Oct 04 21:53:54.360117 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-6f3ca65e-8e3b-415f-8707-6363d6e34416 req-c8c0a63a-4ce5-4ef6-9bda-b5c19113b4f0 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116368 Oct 04 21:53:54.361358 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1238/2395] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:53:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:53:54.370287 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-5c7ce0f9-2682-419e-84ce-3cdee857d0dc tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:54.375037 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-5c7ce0f9-2682-419e-84ce-3cdee857d0dc tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] [instance: eb6e098d-966d-478b-a69c-3746584e5509] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:53:54.389923 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5c7ce0f9-2682-419e-84ce-3cdee857d0dc tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:54.399068 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5c7ce0f9-2682-419e-84ce-3cdee857d0dc tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:54.400546 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5c7ce0f9-2682-419e-84ce-3cdee857d0dc tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:54.401592 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5c7ce0f9-2682-419e-84ce-3cdee857d0dc tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:54.402219 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5c7ce0f9-2682-419e-84ce-3cdee857d0dc tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:54.403024 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5c7ce0f9-2682-419e-84ce-3cdee857d0dc tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:54.412561 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-3ff2d2a7-03df-401c-9e32-272414a7b28b tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ad048becf474fb972d4291422d810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dcfc7024fc49388c4bd5f25f03e60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:54.431828 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-3ff2d2a7-03df-401c-9e32-272414a7b28b tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/152003e4-2a7b-4801-8656-73093cd566ed" status: 200 len: 1390 microversion: 2.1 time: 1.201538 Oct 04 21:53:54.449549 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1158/2396] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:53:53 2022] GET /compute/v2.1/servers/152003e4-2a7b-4801-8656-73093cd566ed => generated 1390 bytes in 1220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:53:54.461151 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-c6a5abc3-ad7c-47c9-84c5-8921a8b22697 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:54.464574 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-c6a5abc3-ad7c-47c9-84c5-8921a8b22697 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] [instance: a120b0ad-f6e3-4ecb-9312-e92d5c115fd3] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:53:54.480747 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c6a5abc3-ad7c-47c9-84c5-8921a8b22697 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:54.481636 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c6a5abc3-ad7c-47c9-84c5-8921a8b22697 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:54.482946 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c6a5abc3-ad7c-47c9-84c5-8921a8b22697 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:54.485174 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c6a5abc3-ad7c-47c9-84c5-8921a8b22697 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:54.487504 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c6a5abc3-ad7c-47c9-84c5-8921a8b22697 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:54.488288 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c6a5abc3-ad7c-47c9-84c5-8921a8b22697 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:54.546290 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:53:54.589710 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c6a5abc3-ad7c-47c9-84c5-8921a8b22697 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:54.590809 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c6a5abc3-ad7c-47c9-84c5-8921a8b22697 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:54.592171 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c6a5abc3-ad7c-47c9-84c5-8921a8b22697 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:54.597046 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.objects.instance [None req-c6a5abc3-ad7c-47c9-84c5-8921a8b22697 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Lazy-loading 'fault' on Instance uuid a120b0ad-f6e3-4ecb-9312-e92d5c115fd3 {{(pid=134101) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:53:54.861236 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-c6a5abc3-ad7c-47c9-84c5-8921a8b22697 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927913a1e0cc4d74b42cb209ec932286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2865c04294884d1081c9b1b6fc8f8e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:54.873220 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-c6a5abc3-ad7c-47c9-84c5-8921a8b22697 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] 10.222.0.43 "GET /compute/v2.1/servers/a120b0ad-f6e3-4ecb-9312-e92d5c115fd3" status: 200 len: 1310 microversion: 2.1 time: 0.422285 Oct 04 21:53:54.873857 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1159/2397] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:53:54 2022] GET /compute/v2.1/servers/a120b0ad-f6e3-4ecb-9312-e92d5c115fd3 => generated 1310 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:53:54.905788 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-d90d2ac1-d31e-407c-ac3c-5f5547d1ded4 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Calling method '.version_select at 0x7fbb37373d30>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:54.956910 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-5c7ce0f9-2682-419e-84ce-3cdee857d0dc tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47fbc4a6920d451cb1a2ad170de04921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43659cf5fed541e8883664bf17aced70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:54.969757 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-5c7ce0f9-2682-419e-84ce-3cdee857d0dc tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] 10.222.0.43 "GET /compute/v2.1/servers/eb6e098d-966d-478b-a69c-3746584e5509" status: 200 len: 1314 microversion: 2.1 time: 0.606922 Oct 04 21:53:54.990239 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1239/2398] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:53:54 2022] GET /compute/v2.1/servers/eb6e098d-966d-478b-a69c-3746584e5509 => generated 1314 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:53:55.001269 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-d90d2ac1-d31e-407c-ac3c-5f5547d1ded4 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] 10.222.0.43 "GET /compute/v2.1/images/5157f1c6-d263-427d-84cc-3320cbd286d5" status: 200 len: 1455 microversion: 2.1 time: 0.125304 Oct 04 21:53:55.002582 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1160/2399] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:53:54 2022] GET /compute/v2.1/images/5157f1c6-d263-427d-84cc-3320cbd286d5 => generated 1455 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:53:55.167920 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-8e6202ea-eb03-448b-a6c0-7a39eb9804fa tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:55.168542 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-8e6202ea-eb03-448b-a6c0-7a39eb9804fa tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] [instance: 830de6ad-adc6-4d16-ae9d-a29ae85e6cd2] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:53:55.182480 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8e6202ea-eb03-448b-a6c0-7a39eb9804fa tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:55.183007 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8e6202ea-eb03-448b-a6c0-7a39eb9804fa tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:55.183544 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8e6202ea-eb03-448b-a6c0-7a39eb9804fa tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:55.189911 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8e6202ea-eb03-448b-a6c0-7a39eb9804fa tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:55.191941 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8e6202ea-eb03-448b-a6c0-7a39eb9804fa tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:55.192409 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8e6202ea-eb03-448b-a6c0-7a39eb9804fa tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:55.269446 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-6165c06e-329c-43d4-bf58-fb1e235bcd47 req-68fd4f9d-1d31-4bb5-b50e-df93203fd7f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb6e098d-966d-478b-a69c-3746584e5509", "name": "network-vif-plugged", "status": "completed", "tag": "14556cef-915d-4e87-b47d-67e1cacff2c9"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:53:55.289771 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-6165c06e-329c-43d4-bf58-fb1e235bcd47 req-68fd4f9d-1d31-4bb5-b50e-df93203fd7f1 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:55.290572 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-6165c06e-329c-43d4-bf58-fb1e235bcd47 req-68fd4f9d-1d31-4bb5-b50e-df93203fd7f1 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:55.292031 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-6165c06e-329c-43d4-bf58-fb1e235bcd47 req-68fd4f9d-1d31-4bb5-b50e-df93203fd7f1 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:55.309487 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-6165c06e-329c-43d4-bf58-fb1e235bcd47 req-68fd4f9d-1d31-4bb5-b50e-df93203fd7f1 service nova] Creating event network-vif-plugged:14556cef-915d-4e87-b47d-67e1cacff2c9 for instance eb6e098d-966d-478b-a69c-3746584e5509 on n-h1-860284-1 Oct 04 21:53:55.326717 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-6165c06e-329c-43d4-bf58-fb1e235bcd47 req-68fd4f9d-1d31-4bb5-b50e-df93203fd7f1 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055422 Oct 04 21:53:55.328141 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1161/2400] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:53:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:53:55.463732 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-5f111266-7e9f-4fab-a194-36730046922e tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:55.464508 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-5f111266-7e9f-4fab-a194-36730046922e tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 152003e4-2a7b-4801-8656-73093cd566ed] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:53:55.495405 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5f111266-7e9f-4fab-a194-36730046922e tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:55.504122 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5f111266-7e9f-4fab-a194-36730046922e tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:55.504737 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5f111266-7e9f-4fab-a194-36730046922e tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:55.505515 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5f111266-7e9f-4fab-a194-36730046922e tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:55.506000 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5f111266-7e9f-4fab-a194-36730046922e tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:55.506463 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5f111266-7e9f-4fab-a194-36730046922e tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:56.361534 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-8e6202ea-eb03-448b-a6c0-7a39eb9804fa tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:56.420174 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-8e6202ea-eb03-448b-a6c0-7a39eb9804fa tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:56.432954 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-8e6202ea-eb03-448b-a6c0-7a39eb9804fa tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:56.441465 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-8e6202ea-eb03-448b-a6c0-7a39eb9804fa tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] 10.222.0.43 "GET /compute/v2.1/servers/830de6ad-adc6-4d16-ae9d-a29ae85e6cd2" status: 200 len: 1874 microversion: 2.42 time: 1.275270 Oct 04 21:53:56.445695 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1240/2401] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:53:55 2022] GET /compute/v2.1/servers/830de6ad-adc6-4d16-ae9d-a29ae85e6cd2 => generated 1874 bytes in 1283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:53:56.462642 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-80733424-a2cd-4bd8-953f-409f5ad64851 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:56.467943 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-80733424-a2cd-4bd8-953f-409f5ad64851 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] [instance: a120b0ad-f6e3-4ecb-9312-e92d5c115fd3] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:53:56.499529 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-80733424-a2cd-4bd8-953f-409f5ad64851 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:56.500027 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-80733424-a2cd-4bd8-953f-409f5ad64851 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:56.500467 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-80733424-a2cd-4bd8-953f-409f5ad64851 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:56.501188 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-80733424-a2cd-4bd8-953f-409f5ad64851 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:56.501646 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-80733424-a2cd-4bd8-953f-409f5ad64851 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:56.502073 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-80733424-a2cd-4bd8-953f-409f5ad64851 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:56.581480 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-80733424-a2cd-4bd8-953f-409f5ad64851 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] HTTP exception thrown: Instance a120b0ad-f6e3-4ecb-9312-e92d5c115fd3 could not be found. Oct 04 21:53:56.585880 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-80733424-a2cd-4bd8-953f-409f5ad64851 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Request method failure captured: Oct 04 21:53:56.585880 n-d-860284-1 devstack@n-api.service[134102]: request: GET /compute/v2.1/servers/a120b0ad-f6e3-4ecb-9312-e92d5c115fd3 HTTP/1.1 Oct 04 21:53:56.585880 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 21:53:56.585880 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 21:53:56.585880 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 21:53:56.585880 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 21:53:56.585880 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 21:53:56.585880 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 21:53:56.585880 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 21:53:56.585880 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 21:53:56.585880 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPKtD8tW6r1XpqIR5pzjO07FOJSn-VfYbZy21TQA3uSwCHlUYadhC1qn1i9q8TReiVykhcj_LcTzvxccj4TlBUnGJgCer8k2_7vdW7V9qfXRiLtbrjmaVq2juzQhHiH65IW7fAeWNQr2oOshFXph7O4U8TUbgXX2MigXDDhpQwtGXHPQ Oct 04 21:53:56.585880 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 21:53:56.585880 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 21:53:56.585880 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 21:53:56.585880 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 21:53:56.585880 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 21:53:56.585880 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 21:53:56.585880 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: 2865c04294884d1081c9b1b6fc8f8e09 Oct 04 21:53:56.585880 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-ListServersNegativeTestJSON-201044971 Oct 04 21:53:56.585880 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 21:53:56.585880 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 21:53:56.585880 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/2865c04294884d1081c9b1b6fc8f8e09"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_2865c04294884d1081c9b1b6fc8f8e09", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/2865c04294884d1081c9b1b6fc8f8e09"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/2865c04294884d1081c9b1b6fc8f8e09"}]}] Oct 04 21:53:56.585880 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-ListServersNegativeTestJSON-201044971 Oct 04 21:53:56.585880 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: 2865c04294884d1081c9b1b6fc8f8e09 Oct 04 21:53:56.585880 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-201044971 Oct 04 21:53:56.585880 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-ListServersNegativeTestJSON-201044971-project Oct 04 21:53:56.585880 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 21:53:56.585880 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 21:53:56.585880 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: 927913a1e0cc4d74b42cb209ec932286 Oct 04 21:53:56.585880 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-ListServersNegativeTestJSON-201044971-project Oct 04 21:53:56.585880 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 21:53:56.585880 n-d-860284-1 devstack@n-api.service[134102]: exception: Instance a120b0ad-f6e3-4ecb-9312-e92d5c115fd3 could not be found. Oct 04 21:53:56.585880 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': 'a120b0ad-f6e3-4ecb-9312-e92d5c115fd3'} Oct 04 21:53:56.585880 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:53:56.585880 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:53:56.585880 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:53:56.585880 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:53:56.585880 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:53:56.585880 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:53:56.585880 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:53:56.585880 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:53:56.585880 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:53:56.585880 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:53:56.585880 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a120b0ad-f6e3-4ecb-9312-e92d5c115fd3 could not be found. Oct 04 21:53:56.585880 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:53:56.585880 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:53:56.585880 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:53:56.585880 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:53:56.585880 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:53:56.585880 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:53:56.585880 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:53:56.585880 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:53:56.585880 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:53:56.585880 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:53:56.585880 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:53:56.585880 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:53:56.585880 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:53:56.585880 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:53:56.585880 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:53:56.585880 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:53:56.585880 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a120b0ad-f6e3-4ecb-9312-e92d5c115fd3 could not be found. Oct 04 21:53:56.585880 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:53:56.585880 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:53:56.589931 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:53:56.589931 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:53:56.589931 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:53:56.589931 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:53:56.589931 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:53:56.589931 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:53:56.589931 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a120b0ad-f6e3-4ecb-9312-e92d5c115fd3 could not be found. Oct 04 21:53:56.589931 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:53:56.597380 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-80733424-a2cd-4bd8-953f-409f5ad64851 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Returning 404 to user: Instance a120b0ad-f6e3-4ecb-9312-e92d5c115fd3 could not be found. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:53:56.605414 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-80733424-a2cd-4bd8-953f-409f5ad64851 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] 10.222.0.43 "GET /compute/v2.1/servers/a120b0ad-f6e3-4ecb-9312-e92d5c115fd3" status: 404 len: 111 microversion: 2.1 time: 0.155948 Oct 04 21:53:56.612469 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1241/2402] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:53:56 2022] GET /compute/v2.1/servers/a120b0ad-f6e3-4ecb-9312-e92d5c115fd3 => generated 111 bytes in 165 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:53:56.626699 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-adbff849-40ce-45c6-b808-260f7a0de444 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:56.627632 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-adbff849-40ce-45c6-b808-260f7a0de444 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] [instance: eb6e098d-966d-478b-a69c-3746584e5509] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:53:56.636276 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-adbff849-40ce-45c6-b808-260f7a0de444 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:56.637489 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-adbff849-40ce-45c6-b808-260f7a0de444 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:56.638205 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-adbff849-40ce-45c6-b808-260f7a0de444 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:56.639447 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-adbff849-40ce-45c6-b808-260f7a0de444 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:56.640081 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-adbff849-40ce-45c6-b808-260f7a0de444 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:56.640863 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-adbff849-40ce-45c6-b808-260f7a0de444 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:56.783820 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-5f111266-7e9f-4fab-a194-36730046922e tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ad048becf474fb972d4291422d810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dcfc7024fc49388c4bd5f25f03e60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:56.797022 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-5f111266-7e9f-4fab-a194-36730046922e tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/152003e4-2a7b-4801-8656-73093cd566ed" status: 200 len: 1390 microversion: 2.1 time: 1.339015 Oct 04 21:53:56.801121 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1162/2403] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:53:55 2022] GET /compute/v2.1/servers/152003e4-2a7b-4801-8656-73093cd566ed => generated 1390 bytes in 1344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:53:56.835275 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-c1784761-5f65-48ad-b0f7-33f6ee10b168 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Calling method '.version_select at 0x7fbb37373550>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:56.944550 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-c1784761-5f65-48ad-b0f7-33f6ee10b168 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] 10.222.0.43 "GET /compute/v2.1/images/5157f1c6-d263-427d-84cc-3320cbd286d5" status: 200 len: 1455 microversion: 2.1 time: 0.121414 Oct 04 21:53:56.945315 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1163/2404] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:53:56 2022] GET /compute/v2.1/images/5157f1c6-d263-427d-84cc-3320cbd286d5 => generated 1455 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:53:56.959516 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-dfd82e1a-51fb-451f-9704-156efb618e05 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:56.974627 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-dfd82e1a-51fb-451f-9704-156efb618e05 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '927913a1e0cc4d74b42cb209ec932286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2865c04294884d1081c9b1b6fc8f8e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:56.975950 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-dfd82e1a-51fb-451f-9704-156efb618e05 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': '2865c04294884d1081c9b1b6fc8f8e09'} {{(pid=134101) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 21:53:56.983398 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dfd82e1a-51fb-451f-9704-156efb618e05 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:56.984218 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dfd82e1a-51fb-451f-9704-156efb618e05 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:56.984939 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dfd82e1a-51fb-451f-9704-156efb618e05 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:56.986831 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dfd82e1a-51fb-451f-9704-156efb618e05 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:56.987510 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dfd82e1a-51fb-451f-9704-156efb618e05 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:56.988127 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dfd82e1a-51fb-451f-9704-156efb618e05 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:57.028362 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-adbff849-40ce-45c6-b808-260f7a0de444 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47fbc4a6920d451cb1a2ad170de04921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43659cf5fed541e8883664bf17aced70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:57.047383 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-adbff849-40ce-45c6-b808-260f7a0de444 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] 10.222.0.43 "GET /compute/v2.1/servers/eb6e098d-966d-478b-a69c-3746584e5509" status: 200 len: 1314 microversion: 2.1 time: 0.433179 Oct 04 21:53:57.050627 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1242/2405] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:53:56 2022] GET /compute/v2.1/servers/eb6e098d-966d-478b-a69c-3746584e5509 => generated 1314 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:53:57.226840 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-dfd82e1a-51fb-451f-9704-156efb618e05 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] 10.222.0.43 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.278260 Oct 04 21:53:57.241722 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1164/2406] 10.222.0.43 () {58 vars in 1230 bytes} [Tue Oct 4 21:53:56 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 21:53:57.244868 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-b94f22ea-b819-4ed8-bc2a-fd32d406af32 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:57.252248 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-b94f22ea-b819-4ed8-bc2a-fd32d406af32 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Request method failure captured: Oct 04 21:53:57.252248 n-d-860284-1 devstack@n-api.service[134102]: request: GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 HTTP/1.1 Oct 04 21:53:57.252248 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 21:53:57.252248 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 21:53:57.252248 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 21:53:57.252248 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 21:53:57.252248 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 21:53:57.252248 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 21:53:57.252248 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 21:53:57.252248 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 21:53:57.252248 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPKtD8tW6r1XpqIR5pzjO07FOJSn-VfYbZy21TQA3uSwCHlUYadhC1qn1i9q8TReiVykhcj_LcTzvxccj4TlBUnGJgCer8k2_7vdW7V9qfXRiLtbrjmaVq2juzQhHiH65IW7fAeWNQr2oOshFXph7O4U8TUbgXX2MigXDDhpQwtGXHPQ Oct 04 21:53:57.252248 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 21:53:57.252248 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 21:53:57.252248 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 21:53:57.252248 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 21:53:57.252248 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 21:53:57.252248 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 21:53:57.252248 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: 2865c04294884d1081c9b1b6fc8f8e09 Oct 04 21:53:57.252248 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-ListServersNegativeTestJSON-201044971 Oct 04 21:53:57.252248 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 21:53:57.252248 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 21:53:57.252248 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/2865c04294884d1081c9b1b6fc8f8e09"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_2865c04294884d1081c9b1b6fc8f8e09", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/2865c04294884d1081c9b1b6fc8f8e09"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/2865c04294884d1081c9b1b6fc8f8e09"}]}] Oct 04 21:53:57.252248 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-ListServersNegativeTestJSON-201044971 Oct 04 21:53:57.252248 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: 2865c04294884d1081c9b1b6fc8f8e09 Oct 04 21:53:57.252248 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-201044971 Oct 04 21:53:57.252248 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-ListServersNegativeTestJSON-201044971-project Oct 04 21:53:57.252248 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 21:53:57.252248 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 21:53:57.252248 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: 927913a1e0cc4d74b42cb209ec932286 Oct 04 21:53:57.252248 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-ListServersNegativeTestJSON-201044971-project Oct 04 21:53:57.252248 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 21:53:57.252248 n-d-860284-1 devstack@n-api.service[134102]: exception: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 04 21:53:57.252248 n-d-860284-1 devstack@n-api.service[134102]: action_args: {} Oct 04 21:53:57.252248 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:53:57.252248 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:53:57.252248 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 21:53:57.252248 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 21:53:57.252248 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 21:53:57.252248 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise error Oct 04 21:53:57.252248 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '2011/01/01' is not a 'date-time' Oct 04 21:53:57.252248 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:53:57.252248 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['changes-since']['items']: Oct 04 21:53:57.252248 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi {'format': 'date-time', 'type': 'string'} Oct 04 21:53:57.252248 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:53:57.252248 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 04 21:53:57.252248 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi '2011/01/01' Oct 04 21:53:57.252248 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:53:57.252248 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:53:57.252248 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:53:57.252248 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:53:57.252248 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:53:57.252248 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:53:57.252248 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:53:57.252248 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:53:57.252248 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:53:57.252248 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:53:57.252248 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 21:53:57.252248 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:53:57.252248 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 21:53:57.252248 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:53:57.252248 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 21:53:57.252248 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:53:57.252248 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 04 21:53:57.252248 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 04 21:53:57.252248 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 04 21:53:57.252248 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 21:53:57.257793 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 21:53:57.257793 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 21:53:57.257793 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 21:53:57.257793 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 04 21:53:57.257793 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:53:57.257793 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:53:57.257793 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:53:57.257793 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:53:57.257793 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:53:57.257793 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:53:57.257793 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 21:53:57.257793 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 21:53:57.257793 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 04 21:53:57.257793 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:53:57.257793 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-b94f22ea-b819-4ed8-bc2a-fd32d406af32 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:53:57.260723 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-b94f22ea-b819-4ed8-bc2a-fd32d406af32 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] 10.222.0.43 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.022670 Oct 04 21:53:57.267648 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1243/2407] 10.222.0.43 () {58 vars in 1182 bytes} [Tue Oct 4 21:53:57 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 21:53:57.279955 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-f11053ed-e181-4d25-8306-07fd07735db3 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:57.285358 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-f11053ed-e181-4d25-8306-07fd07735db3 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] [instance: 7512d9d6-ab41-453e-bb9d-8e0861aa37f7] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:53:57.304432 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=1 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:53:57.310493 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f11053ed-e181-4d25-8306-07fd07735db3 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:57.314094 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f11053ed-e181-4d25-8306-07fd07735db3 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:57.314973 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f11053ed-e181-4d25-8306-07fd07735db3 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:57.317981 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f11053ed-e181-4d25-8306-07fd07735db3 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:57.318982 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-01828455-b818-459d-9a25-eaac18ee3989 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:57.319700 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f11053ed-e181-4d25-8306-07fd07735db3 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:57.324785 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f11053ed-e181-4d25-8306-07fd07735db3 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:57.339985 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-01828455-b818-459d-9a25-eaac18ee3989 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '927913a1e0cc4d74b42cb209ec932286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2865c04294884d1081c9b1b6fc8f8e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:57.344157 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-01828455-b818-459d-9a25-eaac18ee3989 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Searching by: {'deleted': False, 'project_id': '2865c04294884d1081c9b1b6fc8f8e09'} {{(pid=134101) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 21:53:57.363564 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-01828455-b818-459d-9a25-eaac18ee3989 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:57.366466 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-01828455-b818-459d-9a25-eaac18ee3989 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:57.368459 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-01828455-b818-459d-9a25-eaac18ee3989 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:57.369977 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-01828455-b818-459d-9a25-eaac18ee3989 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:57.373137 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-01828455-b818-459d-9a25-eaac18ee3989 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:57.373936 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-01828455-b818-459d-9a25-eaac18ee3989 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:57.402310 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-f11053ed-e181-4d25-8306-07fd07735db3 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] [instance: 7512d9d6-ab41-453e-bb9d-8e0861aa37f7] Going to try to terminate instance {{(pid=134102) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:53:57.466102 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.multi_cell_list [None req-01828455-b818-459d-9a25-eaac18ee3989 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=134101) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 21:53:57.588621 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-01828455-b818-459d-9a25-eaac18ee3989 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] 10.222.0.43 "GET /compute/v2.1/servers" status: 200 len: 677 microversion: 2.1 time: 0.312918 Oct 04 21:53:57.589232 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1165/2408] 10.222.0.43 () {58 vars in 1125 bytes} [Tue Oct 4 21:53:57 2022] GET /compute/v2.1/servers => generated 677 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:53:57.621632 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-054b26ec-91bb-423d-879a-dae68dee7979 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:57.622419 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-054b26ec-91bb-423d-879a-dae68dee7979 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] [instance: 830de6ad-adc6-4d16-ae9d-a29ae85e6cd2] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:53:57.650350 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-054b26ec-91bb-423d-879a-dae68dee7979 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:57.650941 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-054b26ec-91bb-423d-879a-dae68dee7979 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:57.651391 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-054b26ec-91bb-423d-879a-dae68dee7979 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:57.652124 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-054b26ec-91bb-423d-879a-dae68dee7979 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:57.652586 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-054b26ec-91bb-423d-879a-dae68dee7979 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:57.653019 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-054b26ec-91bb-423d-879a-dae68dee7979 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:57.702763 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-f11053ed-e181-4d25-8306-07fd07735db3 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] 10.222.0.43 "DELETE /compute/v2.1/servers/7512d9d6-ab41-453e-bb9d-8e0861aa37f7" status: 204 len: 0 microversion: 2.25 time: 0.428722 Oct 04 21:53:57.704215 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1244/2409] 10.222.0.43 () {60 vars in 1280 bytes} [Tue Oct 4 21:53:57 2022] DELETE /compute/v2.1/servers/7512d9d6-ab41-453e-bb9d-8e0861aa37f7 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 21:53:57.724126 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-5a5e2bef-b52b-4696-8222-2a6478f456ee tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:57.734155 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-5a5e2bef-b52b-4696-8222-2a6478f456ee tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '927913a1e0cc4d74b42cb209ec932286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2865c04294884d1081c9b1b6fc8f8e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:57.736904 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.compute.servers [None req-5a5e2bef-b52b-4696-8222-2a6478f456ee tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Removing options 'limit' from query {{(pid=134102) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 04 21:53:57.745286 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-5a5e2bef-b52b-4696-8222-2a6478f456ee tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Searching by: {'deleted': False, 'project_id': '2865c04294884d1081c9b1b6fc8f8e09'} {{(pid=134102) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 21:53:57.763707 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5a5e2bef-b52b-4696-8222-2a6478f456ee tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:57.764329 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5a5e2bef-b52b-4696-8222-2a6478f456ee tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:57.764879 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5a5e2bef-b52b-4696-8222-2a6478f456ee tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:57.766442 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5a5e2bef-b52b-4696-8222-2a6478f456ee tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:57.767462 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5a5e2bef-b52b-4696-8222-2a6478f456ee tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:57.768490 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5a5e2bef-b52b-4696-8222-2a6478f456ee tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:57.847702 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.multi_cell_list [None req-5a5e2bef-b52b-4696-8222-2a6478f456ee tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=134102) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 21:53:57.920064 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-5a5e2bef-b52b-4696-8222-2a6478f456ee tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] 10.222.0.43 "GET /compute/v2.1/servers?limit=102" status: 200 len: 677 microversion: 2.1 time: 0.211262 Oct 04 21:53:57.923114 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1245/2410] 10.222.0.43 () {58 vars in 1144 bytes} [Tue Oct 4 21:53:57 2022] GET /compute/v2.1/servers?limit=102 => generated 677 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:53:57.941441 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-738dfce2-fb33-43c0-b10e-e6edb3de5093 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:57.943919 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-738dfce2-fb33-43c0-b10e-e6edb3de5093 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] [instance: 7512d9d6-ab41-453e-bb9d-8e0861aa37f7] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:53:57.954695 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-738dfce2-fb33-43c0-b10e-e6edb3de5093 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:57.955262 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-738dfce2-fb33-43c0-b10e-e6edb3de5093 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:57.956194 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-738dfce2-fb33-43c0-b10e-e6edb3de5093 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:57.957095 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-738dfce2-fb33-43c0-b10e-e6edb3de5093 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:57.957728 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-738dfce2-fb33-43c0-b10e-e6edb3de5093 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:57.958342 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-738dfce2-fb33-43c0-b10e-e6edb3de5093 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:58.217715 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-054b26ec-91bb-423d-879a-dae68dee7979 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:58.233329 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-054b26ec-91bb-423d-879a-dae68dee7979 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:58.237452 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-054b26ec-91bb-423d-879a-dae68dee7979 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:58.238835 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-054b26ec-91bb-423d-879a-dae68dee7979 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] 10.222.0.43 "GET /compute/v2.1/servers/830de6ad-adc6-4d16-ae9d-a29ae85e6cd2" status: 200 len: 1874 microversion: 2.42 time: 0.648556 Oct 04 21:53:58.239949 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1166/2411] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:53:57 2022] GET /compute/v2.1/servers/830de6ad-adc6-4d16-ae9d-a29ae85e6cd2 => generated 1874 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:53:58.256663 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-6f3ffa54-9a14-44ac-8d93-3cf74f76e1f6 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:58.257351 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-6f3ffa54-9a14-44ac-8d93-3cf74f76e1f6 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 152003e4-2a7b-4801-8656-73093cd566ed] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:53:58.263690 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-738dfce2-fb33-43c0-b10e-e6edb3de5093 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:58.275319 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6f3ffa54-9a14-44ac-8d93-3cf74f76e1f6 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:58.275942 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6f3ffa54-9a14-44ac-8d93-3cf74f76e1f6 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:58.276398 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6f3ffa54-9a14-44ac-8d93-3cf74f76e1f6 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:58.277155 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6f3ffa54-9a14-44ac-8d93-3cf74f76e1f6 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:58.277620 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6f3ffa54-9a14-44ac-8d93-3cf74f76e1f6 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:58.278054 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6f3ffa54-9a14-44ac-8d93-3cf74f76e1f6 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:58.321748 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-738dfce2-fb33-43c0-b10e-e6edb3de5093 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:58.332037 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-738dfce2-fb33-43c0-b10e-e6edb3de5093 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:58.334701 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-738dfce2-fb33-43c0-b10e-e6edb3de5093 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] 10.222.0.43 "GET /compute/v2.1/servers/7512d9d6-ab41-453e-bb9d-8e0861aa37f7" status: 200 len: 1550 microversion: 2.25 time: 0.410070 Oct 04 21:53:58.337321 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1246/2412] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:53:57 2022] GET /compute/v2.1/servers/7512d9d6-ab41-453e-bb9d-8e0861aa37f7 => generated 1550 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:53:58.346068 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-24f50411-e978-42ee-b247-3f48eba46241 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:58.365921 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-24f50411-e978-42ee-b247-3f48eba46241 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Request method failure captured: Oct 04 21:53:58.365921 n-d-860284-1 devstack@n-api.service[134102]: request: GET /compute/v2.1/servers?limit=-1 HTTP/1.1 Oct 04 21:53:58.365921 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 21:53:58.365921 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 21:53:58.365921 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 21:53:58.365921 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 21:53:58.365921 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 21:53:58.365921 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 21:53:58.365921 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 21:53:58.365921 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 21:53:58.365921 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPKtD8tW6r1XpqIR5pzjO07FOJSn-VfYbZy21TQA3uSwCHlUYadhC1qn1i9q8TReiVykhcj_LcTzvxccj4TlBUnGJgCer8k2_7vdW7V9qfXRiLtbrjmaVq2juzQhHiH65IW7fAeWNQr2oOshFXph7O4U8TUbgXX2MigXDDhpQwtGXHPQ Oct 04 21:53:58.365921 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 21:53:58.365921 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 21:53:58.365921 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 21:53:58.365921 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 21:53:58.365921 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 21:53:58.365921 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 21:53:58.365921 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: 2865c04294884d1081c9b1b6fc8f8e09 Oct 04 21:53:58.365921 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-ListServersNegativeTestJSON-201044971 Oct 04 21:53:58.365921 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 21:53:58.365921 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 21:53:58.365921 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/2865c04294884d1081c9b1b6fc8f8e09"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_2865c04294884d1081c9b1b6fc8f8e09", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/2865c04294884d1081c9b1b6fc8f8e09"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/2865c04294884d1081c9b1b6fc8f8e09"}]}] Oct 04 21:53:58.365921 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-ListServersNegativeTestJSON-201044971 Oct 04 21:53:58.365921 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: 2865c04294884d1081c9b1b6fc8f8e09 Oct 04 21:53:58.365921 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-201044971 Oct 04 21:53:58.365921 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-ListServersNegativeTestJSON-201044971-project Oct 04 21:53:58.365921 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 21:53:58.365921 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 21:53:58.365921 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: 927913a1e0cc4d74b42cb209ec932286 Oct 04 21:53:58.365921 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-ListServersNegativeTestJSON-201044971-project Oct 04 21:53:58.365921 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 21:53:58.365921 n-d-860284-1 devstack@n-api.service[134102]: exception: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 04 21:53:58.365921 n-d-860284-1 devstack@n-api.service[134102]: action_args: {} Oct 04 21:53:58.365921 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:53:58.365921 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:53:58.365921 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 21:53:58.365921 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 21:53:58.365921 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 21:53:58.365921 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise error Oct 04 21:53:58.365921 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '-1' does not match '^[0-9]*$' Oct 04 21:53:58.365921 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:53:58.365921 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Oct 04 21:53:58.365921 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 04 21:53:58.365921 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi 'minimum': 0, Oct 04 21:53:58.365921 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 04 21:53:58.365921 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 04 21:53:58.365921 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:53:58.365921 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 04 21:53:58.365921 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi '-1' Oct 04 21:53:58.365921 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:53:58.365921 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:53:58.365921 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:53:58.365921 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:53:58.365921 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:53:58.365921 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:53:58.365921 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:53:58.365921 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:53:58.365921 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:53:58.365921 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:53:58.365921 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 21:53:58.365921 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:53:58.365921 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 21:53:58.365921 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:53:58.365921 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 21:53:58.365921 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:53:58.365921 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 04 21:53:58.365921 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 04 21:53:58.365921 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 04 21:53:58.376074 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 21:53:58.376074 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 21:53:58.376074 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 21:53:58.376074 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 21:53:58.376074 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 04 21:53:58.376074 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:53:58.376074 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:53:58.376074 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:53:58.376074 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:53:58.376074 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:53:58.376074 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:53:58.376074 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 21:53:58.376074 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 21:53:58.376074 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 04 21:53:58.376074 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:53:58.382586 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-24f50411-e978-42ee-b247-3f48eba46241 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:53:58.388731 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-24f50411-e978-42ee-b247-3f48eba46241 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] 10.222.0.43 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.048061 Oct 04 21:53:58.392338 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1247/2413] 10.222.0.43 () {58 vars in 1142 bytes} [Tue Oct 4 21:53:58 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 54 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 21:53:58.416181 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-9fa3765f-2086-42d2-8f0b-b964f5733dc7 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Calling method '.version_select at 0x7fbb2f69e430>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:58.498323 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-9fa3765f-2086-42d2-8f0b-b964f5733dc7 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] 10.222.0.43 "GET /compute/v2.1/images/5157f1c6-d263-427d-84cc-3320cbd286d5" status: 200 len: 1455 microversion: 2.1 time: 0.102194 Oct 04 21:53:58.510604 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1248/2414] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:53:58 2022] GET /compute/v2.1/images/5157f1c6-d263-427d-84cc-3320cbd286d5 => generated 1455 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:53:58.525403 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-eb5d2423-de13-4d3c-940d-8847280b5c07 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:58.531727 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-eb5d2423-de13-4d3c-940d-8847280b5c07 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] [instance: eb6e098d-966d-478b-a69c-3746584e5509] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:53:58.558806 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-eb5d2423-de13-4d3c-940d-8847280b5c07 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:58.564156 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-eb5d2423-de13-4d3c-940d-8847280b5c07 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:58.571828 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-eb5d2423-de13-4d3c-940d-8847280b5c07 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:58.572914 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-eb5d2423-de13-4d3c-940d-8847280b5c07 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:58.573678 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-eb5d2423-de13-4d3c-940d-8847280b5c07 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:58.574346 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-eb5d2423-de13-4d3c-940d-8847280b5c07 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:58.731867 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-6f3ffa54-9a14-44ac-8d93-3cf74f76e1f6 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ad048becf474fb972d4291422d810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dcfc7024fc49388c4bd5f25f03e60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:58.742811 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-6f3ffa54-9a14-44ac-8d93-3cf74f76e1f6 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/152003e4-2a7b-4801-8656-73093cd566ed" status: 200 len: 1390 microversion: 2.1 time: 0.501694 Oct 04 21:53:58.756532 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1167/2415] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:53:58 2022] GET /compute/v2.1/servers/152003e4-2a7b-4801-8656-73093cd566ed => generated 1390 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:53:58.778770 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e3224a1e-7e81-481d-99bf-e4896e940b81 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:58.828076 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e3224a1e-7e81-481d-99bf-e4896e940b81 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Request method failure captured: Oct 04 21:53:58.828076 n-d-860284-1 devstack@n-api.service[134101]: request: GET /compute/v2.1/servers?limit=testing HTTP/1.1 Oct 04 21:53:58.828076 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 21:53:58.828076 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 21:53:58.828076 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 21:53:58.828076 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 21:53:58.828076 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 21:53:58.828076 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 21:53:58.828076 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 21:53:58.828076 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 21:53:58.828076 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPKtD8tW6r1XpqIR5pzjO07FOJSn-VfYbZy21TQA3uSwCHlUYadhC1qn1i9q8TReiVykhcj_LcTzvxccj4TlBUnGJgCer8k2_7vdW7V9qfXRiLtbrjmaVq2juzQhHiH65IW7fAeWNQr2oOshFXph7O4U8TUbgXX2MigXDDhpQwtGXHPQ Oct 04 21:53:58.828076 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 21:53:58.828076 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 21:53:58.828076 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 21:53:58.828076 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 21:53:58.828076 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 21:53:58.828076 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 21:53:58.828076 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: 2865c04294884d1081c9b1b6fc8f8e09 Oct 04 21:53:58.828076 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-ListServersNegativeTestJSON-201044971 Oct 04 21:53:58.828076 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 21:53:58.828076 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 21:53:58.828076 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/2865c04294884d1081c9b1b6fc8f8e09"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_2865c04294884d1081c9b1b6fc8f8e09", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/2865c04294884d1081c9b1b6fc8f8e09"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/2865c04294884d1081c9b1b6fc8f8e09"}]}] Oct 04 21:53:58.828076 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-ListServersNegativeTestJSON-201044971 Oct 04 21:53:58.828076 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: 2865c04294884d1081c9b1b6fc8f8e09 Oct 04 21:53:58.828076 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-201044971 Oct 04 21:53:58.828076 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-ListServersNegativeTestJSON-201044971-project Oct 04 21:53:58.828076 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 21:53:58.828076 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 21:53:58.828076 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 927913a1e0cc4d74b42cb209ec932286 Oct 04 21:53:58.828076 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-ListServersNegativeTestJSON-201044971-project Oct 04 21:53:58.828076 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 21:53:58.828076 n-d-860284-1 devstack@n-api.service[134101]: exception: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 04 21:53:58.828076 n-d-860284-1 devstack@n-api.service[134101]: action_args: {} Oct 04 21:53:58.828076 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:53:58.828076 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:53:58.828076 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 21:53:58.828076 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 21:53:58.828076 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 21:53:58.828076 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise error Oct 04 21:53:58.828076 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'testing' does not match '^[0-9]*$' Oct 04 21:53:58.828076 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:53:58.828076 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Oct 04 21:53:58.828076 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 04 21:53:58.828076 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi 'minimum': 0, Oct 04 21:53:58.828076 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 04 21:53:58.828076 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 04 21:53:58.828076 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:53:58.828076 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 04 21:53:58.828076 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi 'testing' Oct 04 21:53:58.828076 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:53:58.828076 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:53:58.828076 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:53:58.828076 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:53:58.828076 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:53:58.828076 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:53:58.828076 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:53:58.828076 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:53:58.828076 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:53:58.828076 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:53:58.828076 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 21:53:58.828076 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:53:58.828076 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 21:53:58.828076 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:53:58.828076 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 21:53:58.828076 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:53:58.828076 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 04 21:53:58.828076 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 04 21:53:58.828076 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 04 21:53:58.836202 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 21:53:58.836202 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 21:53:58.836202 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 21:53:58.836202 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 21:53:58.836202 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 04 21:53:58.836202 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:53:58.836202 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:53:58.836202 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:53:58.836202 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:53:58.836202 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:53:58.836202 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:53:58.836202 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 21:53:58.836202 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 21:53:58.836202 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 04 21:53:58.836202 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:53:58.836202 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e3224a1e-7e81-481d-99bf-e4896e940b81 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:53:58.842608 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-e3224a1e-7e81-481d-99bf-e4896e940b81 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] 10.222.0.43 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.078550 Oct 04 21:53:58.847262 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1168/2416] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Oct 4 21:53:58 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 90 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 21:53:58.864659 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-57769689-d070-437c-8b86-7acc2df20a84 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:58.875445 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-57769689-d070-437c-8b86-7acc2df20a84 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '927913a1e0cc4d74b42cb209ec932286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2865c04294884d1081c9b1b6fc8f8e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:58.876138 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-57769689-d070-437c-8b86-7acc2df20a84 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': '2865c04294884d1081c9b1b6fc8f8e09'} {{(pid=134101) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 21:53:58.916368 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.compute.servers [None req-57769689-d070-437c-8b86-7acc2df20a84 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Flavor 'non_existing_flavor' could not be found {{(pid=134101) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:336}} Oct 04 21:53:58.917478 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-57769689-d070-437c-8b86-7acc2df20a84 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] 10.222.0.43 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.064727 Oct 04 21:53:58.928994 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1169/2417] 10.222.0.43 () {58 vars in 1178 bytes} [Tue Oct 4 21:53:58 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 21:53:58.951142 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-f68f75c8-c63f-44aa-8bce-11e399adce5d tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:58.963692 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-f68f75c8-c63f-44aa-8bce-11e399adce5d tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '927913a1e0cc4d74b42cb209ec932286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2865c04294884d1081c9b1b6fc8f8e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:58.965262 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-f68f75c8-c63f-44aa-8bce-11e399adce5d tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': '2865c04294884d1081c9b1b6fc8f8e09'} {{(pid=134101) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 21:53:58.971174 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f68f75c8-c63f-44aa-8bce-11e399adce5d tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:58.971902 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f68f75c8-c63f-44aa-8bce-11e399adce5d tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:58.972922 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f68f75c8-c63f-44aa-8bce-11e399adce5d tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:58.973898 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f68f75c8-c63f-44aa-8bce-11e399adce5d tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:58.974555 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f68f75c8-c63f-44aa-8bce-11e399adce5d tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:58.975143 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f68f75c8-c63f-44aa-8bce-11e399adce5d tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:59.146860 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-eb5d2423-de13-4d3c-940d-8847280b5c07 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47fbc4a6920d451cb1a2ad170de04921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43659cf5fed541e8883664bf17aced70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:59.167178 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-eb5d2423-de13-4d3c-940d-8847280b5c07 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] 10.222.0.43 "GET /compute/v2.1/servers/eb6e098d-966d-478b-a69c-3746584e5509" status: 200 len: 1500 microversion: 2.1 time: 0.654662 Oct 04 21:53:59.181677 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1249/2418] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:53:58 2022] GET /compute/v2.1/servers/eb6e098d-966d-478b-a69c-3746584e5509 => generated 1500 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:53:59.222850 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-f68f75c8-c63f-44aa-8bce-11e399adce5d tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] 10.222.0.43 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.284063 Oct 04 21:53:59.238045 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1170/2419] 10.222.0.43 () {58 vars in 1174 bytes} [Tue Oct 4 21:53:58 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 21:53:59.249891 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-3ab80a89-226a-4610-a9c4-fee5dd10473e tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:53:59.250449 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-13055bc8-85b5-4077-9ed7-defbd6bad298 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:59.263659 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-13055bc8-85b5-4077-9ed7-defbd6bad298 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '927913a1e0cc4d74b42cb209ec932286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2865c04294884d1081c9b1b6fc8f8e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:59.267082 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-13055bc8-85b5-4077-9ed7-defbd6bad298 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': '2865c04294884d1081c9b1b6fc8f8e09'} {{(pid=134101) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 21:53:59.267413 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-3ab80a89-226a-4610-a9c4-fee5dd10473e tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] [instance: eb6e098d-966d-478b-a69c-3746584e5509] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:53:59.279724 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-13055bc8-85b5-4077-9ed7-defbd6bad298 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:59.285575 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-13055bc8-85b5-4077-9ed7-defbd6bad298 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:59.286455 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-13055bc8-85b5-4077-9ed7-defbd6bad298 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:59.290539 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-13055bc8-85b5-4077-9ed7-defbd6bad298 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:59.291911 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-13055bc8-85b5-4077-9ed7-defbd6bad298 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:59.292636 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-13055bc8-85b5-4077-9ed7-defbd6bad298 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:59.308541 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3ab80a89-226a-4610-a9c4-fee5dd10473e tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:59.311360 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3ab80a89-226a-4610-a9c4-fee5dd10473e tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:59.312849 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3ab80a89-226a-4610-a9c4-fee5dd10473e tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:59.317010 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3ab80a89-226a-4610-a9c4-fee5dd10473e tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:59.318214 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3ab80a89-226a-4610-a9c4-fee5dd10473e tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:59.319041 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3ab80a89-226a-4610-a9c4-fee5dd10473e tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:59.414226 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.objects.instance [None req-3ab80a89-226a-4610-a9c4-fee5dd10473e tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lazy-loading 'flavor' on Instance uuid eb6e098d-966d-478b-a69c-3746584e5509 {{(pid=134102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:53:59.537721 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-13055bc8-85b5-4077-9ed7-defbd6bad298 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] 10.222.0.43 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.297849 Oct 04 21:53:59.543170 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1171/2420] 10.222.0.43 () {58 vars in 1184 bytes} [Tue Oct 4 21:53:59 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 21:53:59.548719 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-9901f25f-5a66-499a-b734-583ce0b40bbf tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:59.555018 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-9901f25f-5a66-499a-b734-583ce0b40bbf tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] [instance: 830de6ad-adc6-4d16-ae9d-a29ae85e6cd2] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:53:59.572937 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9901f25f-5a66-499a-b734-583ce0b40bbf tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:59.573786 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9901f25f-5a66-499a-b734-583ce0b40bbf tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:59.574558 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9901f25f-5a66-499a-b734-583ce0b40bbf tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:59.575531 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9901f25f-5a66-499a-b734-583ce0b40bbf tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:59.577012 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9901f25f-5a66-499a-b734-583ce0b40bbf tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:59.577657 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9901f25f-5a66-499a-b734-583ce0b40bbf tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:59.610892 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-3ab80a89-226a-4610-a9c4-fee5dd10473e tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] 10.222.0.43 "POST /compute/v2.1/servers/eb6e098d-966d-478b-a69c-3746584e5509/action" status: 200 len: 32 microversion: 2.1 time: 0.383375 Oct 04 21:53:59.616726 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1250/2421] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 21:53:59 2022] POST /compute/v2.1/servers/eb6e098d-966d-478b-a69c-3746584e5509/action => generated 32 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 21:53:59.635441 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-dffcac84-ddca-4e37-bfe2-27faa34fa975 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:59.637579 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-dffcac84-ddca-4e37-bfe2-27faa34fa975 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] [instance: 7512d9d6-ab41-453e-bb9d-8e0861aa37f7] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:53:59.656789 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dffcac84-ddca-4e37-bfe2-27faa34fa975 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:59.663153 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dffcac84-ddca-4e37-bfe2-27faa34fa975 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:59.664318 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dffcac84-ddca-4e37-bfe2-27faa34fa975 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:59.665511 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dffcac84-ddca-4e37-bfe2-27faa34fa975 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:59.666151 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dffcac84-ddca-4e37-bfe2-27faa34fa975 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:59.666784 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dffcac84-ddca-4e37-bfe2-27faa34fa975 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:00.128152 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-9901f25f-5a66-499a-b734-583ce0b40bbf tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:00.147789 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-9901f25f-5a66-499a-b734-583ce0b40bbf tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:00.160356 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-9901f25f-5a66-499a-b734-583ce0b40bbf tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:00.161717 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-9901f25f-5a66-499a-b734-583ce0b40bbf tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] 10.222.0.43 "GET /compute/v2.1/servers/830de6ad-adc6-4d16-ae9d-a29ae85e6cd2" status: 200 len: 1874 microversion: 2.42 time: 0.617144 Oct 04 21:54:00.162418 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1172/2422] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:53:59 2022] GET /compute/v2.1/servers/830de6ad-adc6-4d16-ae9d-a29ae85e6cd2 => generated 1874 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:54:00.167926 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-0af0ab38-38fb-47f4-b91e-fed26ab37074 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Calling method '.version_select at 0x7fbb2ef753a0>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:00.311248 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-dffcac84-ddca-4e37-bfe2-27faa34fa975 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:00.330310 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-dffcac84-ddca-4e37-bfe2-27faa34fa975 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:00.338161 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-dffcac84-ddca-4e37-bfe2-27faa34fa975 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:00.345435 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-dffcac84-ddca-4e37-bfe2-27faa34fa975 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] 10.222.0.43 "GET /compute/v2.1/servers/7512d9d6-ab41-453e-bb9d-8e0861aa37f7" status: 200 len: 1550 microversion: 2.25 time: 0.721318 Oct 04 21:54:00.351485 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1251/2423] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:53:59 2022] GET /compute/v2.1/servers/7512d9d6-ab41-453e-bb9d-8e0861aa37f7 => generated 1550 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:54:00.357556 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-dbd0a256-2767-4146-901c-ddead2b7e1eb tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:00.364328 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-dbd0a256-2767-4146-901c-ddead2b7e1eb tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '927913a1e0cc4d74b42cb209ec932286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2865c04294884d1081c9b1b6fc8f8e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:00.366515 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-dbd0a256-2767-4146-901c-ddead2b7e1eb tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Searching by: {'deleted': False, 'project_id': '2865c04294884d1081c9b1b6fc8f8e09'} {{(pid=134102) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 21:54:00.373737 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dbd0a256-2767-4146-901c-ddead2b7e1eb tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:00.374513 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dbd0a256-2767-4146-901c-ddead2b7e1eb tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:00.397709 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-0af0ab38-38fb-47f4-b91e-fed26ab37074 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] 10.222.0.43 "GET /compute/v2.1/images/5157f1c6-d263-427d-84cc-3320cbd286d5" status: 200 len: 1455 microversion: 2.1 time: 0.234200 Oct 04 21:54:00.404779 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dbd0a256-2767-4146-901c-ddead2b7e1eb tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:00.406448 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1173/2424] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:54:00 2022] GET /compute/v2.1/images/5157f1c6-d263-427d-84cc-3320cbd286d5 => generated 1455 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:54:00.418097 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dbd0a256-2767-4146-901c-ddead2b7e1eb tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:00.420064 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-930b8545-75f8-492a-a3c1-d4401cbbf146 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:00.420368 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dbd0a256-2767-4146-901c-ddead2b7e1eb tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:00.421227 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dbd0a256-2767-4146-901c-ddead2b7e1eb tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:00.422862 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-930b8545-75f8-492a-a3c1-d4401cbbf146 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] [instance: eb6e098d-966d-478b-a69c-3746584e5509] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:00.440728 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-930b8545-75f8-492a-a3c1-d4401cbbf146 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:00.443881 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-930b8545-75f8-492a-a3c1-d4401cbbf146 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:00.446339 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-930b8545-75f8-492a-a3c1-d4401cbbf146 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:00.447297 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-930b8545-75f8-492a-a3c1-d4401cbbf146 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:00.448596 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-930b8545-75f8-492a-a3c1-d4401cbbf146 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:00.449198 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-930b8545-75f8-492a-a3c1-d4401cbbf146 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:00.463290 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.multi_cell_list [None req-dbd0a256-2767-4146-901c-ddead2b7e1eb tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=134102) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 21:54:00.550015 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:54:00.564502 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-dbd0a256-2767-4146-901c-ddead2b7e1eb tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927913a1e0cc4d74b42cb209ec932286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2865c04294884d1081c9b1b6fc8f8e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:00.577188 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dbd0a256-2767-4146-901c-ddead2b7e1eb tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:00.578342 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dbd0a256-2767-4146-901c-ddead2b7e1eb tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:00.579969 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dbd0a256-2767-4146-901c-ddead2b7e1eb tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:00.841216 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-930b8545-75f8-492a-a3c1-d4401cbbf146 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47fbc4a6920d451cb1a2ad170de04921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43659cf5fed541e8883664bf17aced70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:00.850236 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-930b8545-75f8-492a-a3c1-d4401cbbf146 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] 10.222.0.43 "GET /compute/v2.1/servers/eb6e098d-966d-478b-a69c-3746584e5509" status: 200 len: 1506 microversion: 2.1 time: 0.442479 Oct 04 21:54:00.867299 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1174/2425] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:54:00 2022] GET /compute/v2.1/servers/eb6e098d-966d-478b-a69c-3746584e5509 => generated 1506 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:54:00.876070 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-dbd0a256-2767-4146-901c-ddead2b7e1eb tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] 10.222.0.43 "GET /compute/v2.1/servers/detail" status: 200 len: 3019 microversion: 2.1 time: 0.522326 Oct 04 21:54:00.891075 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1252/2426] 10.222.0.43 () {58 vars in 1146 bytes} [Tue Oct 4 21:54:00 2022] GET /compute/v2.1/servers/detail => generated 3019 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:54:00.891075 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-03cc3b75-ca10-4c6b-8ec3-3e6b832565e9 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c2363bfd-2097-4d53-adf1-8981fac17fc4"}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:54:00.891075 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-03cc3b75-ca10-4c6b-8ec3-3e6b832565e9 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] [instance: 128b12e0-8fde-4113-95e9-0ecba563d8ec] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:00.893278 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-25c34ec7-bc5e-41b6-a1b3-5e5cd5b6d78a tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:00.894255 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-25c34ec7-bc5e-41b6-a1b3-5e5cd5b6d78a tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 152003e4-2a7b-4801-8656-73093cd566ed] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:00.894723 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-03cc3b75-ca10-4c6b-8ec3-3e6b832565e9 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:00.895534 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-03cc3b75-ca10-4c6b-8ec3-3e6b832565e9 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:00.896218 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-03cc3b75-ca10-4c6b-8ec3-3e6b832565e9 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:00.897194 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-03cc3b75-ca10-4c6b-8ec3-3e6b832565e9 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:00.897876 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-03cc3b75-ca10-4c6b-8ec3-3e6b832565e9 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:00.898600 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-03cc3b75-ca10-4c6b-8ec3-3e6b832565e9 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:00.909995 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-25c34ec7-bc5e-41b6-a1b3-5e5cd5b6d78a tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:00.910553 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-25c34ec7-bc5e-41b6-a1b3-5e5cd5b6d78a tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:00.911016 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-25c34ec7-bc5e-41b6-a1b3-5e5cd5b6d78a tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:00.911808 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-25c34ec7-bc5e-41b6-a1b3-5e5cd5b6d78a tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:00.912250 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-25c34ec7-bc5e-41b6-a1b3-5e5cd5b6d78a tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:00.912698 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-25c34ec7-bc5e-41b6-a1b3-5e5cd5b6d78a tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:01.113404 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-25c34ec7-bc5e-41b6-a1b3-5e5cd5b6d78a tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ad048becf474fb972d4291422d810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dcfc7024fc49388c4bd5f25f03e60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:01.163480 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-25c34ec7-bc5e-41b6-a1b3-5e5cd5b6d78a tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/152003e4-2a7b-4801-8656-73093cd566ed" status: 200 len: 1380 microversion: 2.1 time: 0.285283 Oct 04 21:54:01.164517 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1175/2427] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:54:00 2022] GET /compute/v2.1/servers/152003e4-2a7b-4801-8656-73093cd566ed => generated 1380 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:54:01.615293 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-03cc3b75-ca10-4c6b-8ec3-3e6b832565e9 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] 10.222.0.43 "POST /compute/v2.1/servers/128b12e0-8fde-4113-95e9-0ecba563d8ec/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.736531 Oct 04 21:54:01.651801 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1253/2428] 10.222.0.43 () {60 vars in 1323 bytes} [Tue Oct 4 21:54:00 2022] POST /compute/v2.1/servers/128b12e0-8fde-4113-95e9-0ecba563d8ec/os-volume_attachments => generated 194 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:54:01.679884 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-c898413f-7d27-4eab-b8f5-7f03d7b84e4b req-8250cf8c-01a5-48a5-a220-46f69cd1588f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7512d9d6-ab41-453e-bb9d-8e0861aa37f7", "name": "network-vif-deleted", "tag": "330dc731-c16a-47f0-a849-93d182a330a4"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:54:01.685326 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-eede32da-b658-40a8-b09e-79d4a0647323 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:01.700014 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-eede32da-b658-40a8-b09e-79d4a0647323 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '927913a1e0cc4d74b42cb209ec932286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2865c04294884d1081c9b1b6fc8f8e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:01.704305 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-eede32da-b658-40a8-b09e-79d4a0647323 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] 10.222.0.43 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.049653 Oct 04 21:54:01.709012 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-c898413f-7d27-4eab-b8f5-7f03d7b84e4b req-8250cf8c-01a5-48a5-a220-46f69cd1588f service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:01.710983 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-c898413f-7d27-4eab-b8f5-7f03d7b84e4b req-8250cf8c-01a5-48a5-a220-46f69cd1588f service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:01.712850 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-c898413f-7d27-4eab-b8f5-7f03d7b84e4b req-8250cf8c-01a5-48a5-a220-46f69cd1588f service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:01.714397 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1254/2429] 10.222.0.43 () {58 vars in 1178 bytes} [Tue Oct 4 21:54:01 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 21:54:01.753075 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-5283b07e-dea6-421f-b518-2e8b203c60ed tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Calling method '.version_select at 0x7fbb2e884c10>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:01.760331 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-c898413f-7d27-4eab-b8f5-7f03d7b84e4b req-8250cf8c-01a5-48a5-a220-46f69cd1588f service nova] Creating event network-vif-deleted:330dc731-c16a-47f0-a849-93d182a330a4 for instance 7512d9d6-ab41-453e-bb9d-8e0861aa37f7 on n-h1-860284-1 Oct 04 21:54:01.764229 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5283b07e-dea6-421f-b518-2e8b203c60ed tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:01.765675 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5283b07e-dea6-421f-b518-2e8b203c60ed tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:01.766307 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5283b07e-dea6-421f-b518-2e8b203c60ed tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:01.776862 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-c898413f-7d27-4eab-b8f5-7f03d7b84e4b req-8250cf8c-01a5-48a5-a220-46f69cd1588f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.608693 Oct 04 21:54:01.786099 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1176/2430] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:54:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:54:01.791594 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-5283b07e-dea6-421f-b518-2e8b203c60ed tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] 10.222.0.43 "GET /compute/v2.1/os-migrations" status: 200 len: 2322 microversion: 2.1 time: 0.072759 Oct 04 21:54:01.795445 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1255/2431] 10.222.0.43 () {58 vars in 1143 bytes} [Tue Oct 4 21:54:01 2022] GET /compute/v2.1/os-migrations => generated 2322 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:54:01.802063 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e97b2597-5b2d-4cd2-924d-2ef8af91a4e2 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:01.802910 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-e97b2597-5b2d-4cd2-924d-2ef8af91a4e2 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] [instance: 830de6ad-adc6-4d16-ae9d-a29ae85e6cd2] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:01.809334 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-891d7e9f-fef7-4074-bddf-24fa0a66405c tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:01.810085 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-891d7e9f-fef7-4074-bddf-24fa0a66405c tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] [instance: 7512d9d6-ab41-453e-bb9d-8e0861aa37f7] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:01.826648 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e97b2597-5b2d-4cd2-924d-2ef8af91a4e2 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:01.827510 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e97b2597-5b2d-4cd2-924d-2ef8af91a4e2 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:01.828366 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e97b2597-5b2d-4cd2-924d-2ef8af91a4e2 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:01.829515 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e97b2597-5b2d-4cd2-924d-2ef8af91a4e2 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:01.831938 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e97b2597-5b2d-4cd2-924d-2ef8af91a4e2 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:01.832669 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e97b2597-5b2d-4cd2-924d-2ef8af91a4e2 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:01.843476 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-891d7e9f-fef7-4074-bddf-24fa0a66405c tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:01.844000 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-891d7e9f-fef7-4074-bddf-24fa0a66405c tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:01.844543 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-891d7e9f-fef7-4074-bddf-24fa0a66405c tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:01.852715 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-891d7e9f-fef7-4074-bddf-24fa0a66405c tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:01.853607 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-891d7e9f-fef7-4074-bddf-24fa0a66405c tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:01.853739 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-891d7e9f-fef7-4074-bddf-24fa0a66405c tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:01.916312 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-891d7e9f-fef7-4074-bddf-24fa0a66405c tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:01.916885 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-891d7e9f-fef7-4074-bddf-24fa0a66405c tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:01.921748 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-891d7e9f-fef7-4074-bddf-24fa0a66405c tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:01.922274 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.objects.instance [None req-891d7e9f-fef7-4074-bddf-24fa0a66405c tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lazy-loading 'fault' on Instance uuid 7512d9d6-ab41-453e-bb9d-8e0861aa37f7 {{(pid=134102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:54:02.096933 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-891d7e9f-fef7-4074-bddf-24fa0a66405c tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:02.115018 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-891d7e9f-fef7-4074-bddf-24fa0a66405c tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:02.118134 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-891d7e9f-fef7-4074-bddf-24fa0a66405c tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:02.120235 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-891d7e9f-fef7-4074-bddf-24fa0a66405c tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] 10.222.0.43 "GET /compute/v2.1/servers/7512d9d6-ab41-453e-bb9d-8e0861aa37f7" status: 200 len: 1352 microversion: 2.25 time: 0.322429 Oct 04 21:54:02.140178 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1256/2432] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:54:01 2022] GET /compute/v2.1/servers/7512d9d6-ab41-453e-bb9d-8e0861aa37f7 => generated 1352 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:54:02.152633 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-732b6d7c-5455-4259-9800-5af17cd081a3 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Calling method '.version_select at 0x7fbb2efc09d0>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:02.187868 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-e97b2597-5b2d-4cd2-924d-2ef8af91a4e2 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:02.207773 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-e97b2597-5b2d-4cd2-924d-2ef8af91a4e2 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:02.209269 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-e97b2597-5b2d-4cd2-924d-2ef8af91a4e2 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:02.210541 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-e97b2597-5b2d-4cd2-924d-2ef8af91a4e2 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] 10.222.0.43 "GET /compute/v2.1/servers/830de6ad-adc6-4d16-ae9d-a29ae85e6cd2" status: 200 len: 1874 microversion: 2.42 time: 0.422693 Oct 04 21:54:02.211319 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1177/2433] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:54:01 2022] GET /compute/v2.1/servers/830de6ad-adc6-4d16-ae9d-a29ae85e6cd2 => generated 1874 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:54:02.217513 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-8ff13903-4f72-4874-be69-ac2ff655c7ab tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:02.223588 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-8ff13903-4f72-4874-be69-ac2ff655c7ab tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '927913a1e0cc4d74b42cb209ec932286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2865c04294884d1081c9b1b6fc8f8e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:02.224758 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-8ff13903-4f72-4874-be69-ac2ff655c7ab tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Searching by: {'deleted': False, 'project_id': '2865c04294884d1081c9b1b6fc8f8e09'} {{(pid=134101) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 21:54:02.231843 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8ff13903-4f72-4874-be69-ac2ff655c7ab tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:02.232942 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8ff13903-4f72-4874-be69-ac2ff655c7ab tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:02.233789 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8ff13903-4f72-4874-be69-ac2ff655c7ab tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:02.234957 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8ff13903-4f72-4874-be69-ac2ff655c7ab tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:02.235595 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8ff13903-4f72-4874-be69-ac2ff655c7ab tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:02.236245 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8ff13903-4f72-4874-be69-ac2ff655c7ab tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:02.282217 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.multi_cell_list [None req-8ff13903-4f72-4874-be69-ac2ff655c7ab tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=134101) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 21:54:02.327072 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-8ff13903-4f72-4874-be69-ac2ff655c7ab tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] 10.222.0.43 "GET /compute/v2.1/servers" status: 200 len: 677 microversion: 2.1 time: 0.113122 Oct 04 21:54:02.338613 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1178/2434] 10.222.0.43 () {58 vars in 1125 bytes} [Tue Oct 4 21:54:02 2022] GET /compute/v2.1/servers => generated 677 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:54:02.343864 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-463d32b2-fca2-44f8-be37-bdf70d2a3fe1 tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:02.344744 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-463d32b2-fca2-44f8-be37-bdf70d2a3fe1 tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] [instance: 152003e4-2a7b-4801-8656-73093cd566ed] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:02.353516 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-463d32b2-fca2-44f8-be37-bdf70d2a3fe1 tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:02.354294 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-463d32b2-fca2-44f8-be37-bdf70d2a3fe1 tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:02.354964 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-463d32b2-fca2-44f8-be37-bdf70d2a3fe1 tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:02.355856 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-463d32b2-fca2-44f8-be37-bdf70d2a3fe1 tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:02.356479 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-463d32b2-fca2-44f8-be37-bdf70d2a3fe1 tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:02.357084 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-463d32b2-fca2-44f8-be37-bdf70d2a3fe1 tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:02.448573 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-732b6d7c-5455-4259-9800-5af17cd081a3 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] 10.222.0.43 "GET /compute/v2.1/images/5157f1c6-d263-427d-84cc-3320cbd286d5" status: 200 len: 1455 microversion: 2.1 time: 0.301103 Oct 04 21:54:02.449165 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1257/2435] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:54:02 2022] GET /compute/v2.1/images/5157f1c6-d263-427d-84cc-3320cbd286d5 => generated 1455 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:54:02.465546 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-60515336-3d98-4a93-851a-916027eaae19 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:02.466502 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-60515336-3d98-4a93-851a-916027eaae19 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] [instance: eb6e098d-966d-478b-a69c-3746584e5509] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:02.478110 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-60515336-3d98-4a93-851a-916027eaae19 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:02.479444 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-60515336-3d98-4a93-851a-916027eaae19 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:02.481046 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-60515336-3d98-4a93-851a-916027eaae19 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:02.485106 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-60515336-3d98-4a93-851a-916027eaae19 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:02.485825 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-60515336-3d98-4a93-851a-916027eaae19 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:02.487417 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-60515336-3d98-4a93-851a-916027eaae19 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:02.642068 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-463d32b2-fca2-44f8-be37-bdf70d2a3fe1 tempest-LiveMigrationTest-2096496809 tempest-LiveMigrationTest-2096496809-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/152003e4-2a7b-4801-8656-73093cd566ed" status: 200 len: 1531 microversion: 2.1 time: 0.302022 Oct 04 21:54:02.654435 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1179/2436] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:54:02 2022] GET /compute/v2.1/servers/152003e4-2a7b-4801-8656-73093cd566ed => generated 1531 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:54:02.654435 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-6465bfef-cee6-4a59-b112-3c88fc18203d tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:02.655334 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-6465bfef-cee6-4a59-b112-3c88fc18203d tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] [instance: a120b0ad-f6e3-4ecb-9312-e92d5c115fd3] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:02.667344 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6465bfef-cee6-4a59-b112-3c88fc18203d tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:02.667344 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6465bfef-cee6-4a59-b112-3c88fc18203d tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:02.667754 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6465bfef-cee6-4a59-b112-3c88fc18203d tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:02.668423 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6465bfef-cee6-4a59-b112-3c88fc18203d tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:02.671905 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6465bfef-cee6-4a59-b112-3c88fc18203d tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:02.678240 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6465bfef-cee6-4a59-b112-3c88fc18203d tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:02.709949 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-6465bfef-cee6-4a59-b112-3c88fc18203d tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] HTTP exception thrown: Instance a120b0ad-f6e3-4ecb-9312-e92d5c115fd3 could not be found. Oct 04 21:54:02.712660 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-6465bfef-cee6-4a59-b112-3c88fc18203d tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Request method failure captured: Oct 04 21:54:02.712660 n-d-860284-1 devstack@n-api.service[134101]: request: DELETE /compute/v2.1/servers/a120b0ad-f6e3-4ecb-9312-e92d5c115fd3 HTTP/1.1 Oct 04 21:54:02.712660 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 21:54:02.712660 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 21:54:02.712660 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 21:54:02.712660 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 21:54:02.712660 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 21:54:02.712660 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 21:54:02.712660 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 21:54:02.712660 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 21:54:02.712660 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPKtD8tW6r1XpqIR5pzjO07FOJSn-VfYbZy21TQA3uSwCHlUYadhC1qn1i9q8TReiVykhcj_LcTzvxccj4TlBUnGJgCer8k2_7vdW7V9qfXRiLtbrjmaVq2juzQhHiH65IW7fAeWNQr2oOshFXph7O4U8TUbgXX2MigXDDhpQwtGXHPQ Oct 04 21:54:02.712660 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 21:54:02.712660 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 21:54:02.712660 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 21:54:02.712660 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 21:54:02.712660 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 21:54:02.712660 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 21:54:02.712660 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: 2865c04294884d1081c9b1b6fc8f8e09 Oct 04 21:54:02.712660 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-ListServersNegativeTestJSON-201044971 Oct 04 21:54:02.712660 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 21:54:02.712660 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 21:54:02.712660 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/2865c04294884d1081c9b1b6fc8f8e09"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_2865c04294884d1081c9b1b6fc8f8e09", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/2865c04294884d1081c9b1b6fc8f8e09"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/2865c04294884d1081c9b1b6fc8f8e09"}]}] Oct 04 21:54:02.712660 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-ListServersNegativeTestJSON-201044971 Oct 04 21:54:02.712660 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: 2865c04294884d1081c9b1b6fc8f8e09 Oct 04 21:54:02.712660 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-201044971 Oct 04 21:54:02.712660 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-ListServersNegativeTestJSON-201044971-project Oct 04 21:54:02.712660 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 21:54:02.712660 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 21:54:02.712660 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 927913a1e0cc4d74b42cb209ec932286 Oct 04 21:54:02.712660 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-ListServersNegativeTestJSON-201044971-project Oct 04 21:54:02.712660 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 21:54:02.712660 n-d-860284-1 devstack@n-api.service[134101]: exception: Instance a120b0ad-f6e3-4ecb-9312-e92d5c115fd3 could not be found. Oct 04 21:54:02.712660 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': 'a120b0ad-f6e3-4ecb-9312-e92d5c115fd3'} Oct 04 21:54:02.712660 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:54:02.712660 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:54:02.712660 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:54:02.712660 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:54:02.712660 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:54:02.712660 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:54:02.712660 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:54:02.712660 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:54:02.712660 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:54:02.712660 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:54:02.712660 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a120b0ad-f6e3-4ecb-9312-e92d5c115fd3 could not be found. Oct 04 21:54:02.712660 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:54:02.712660 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:54:02.712660 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:54:02.712660 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:54:02.712660 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:54:02.712660 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:54:02.712660 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:54:02.712660 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:54:02.712660 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:54:02.712660 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:54:02.712660 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 21:54:02.712660 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 21:54:02.712660 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 21:54:02.712660 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 21:54:02.712660 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:54:02.712660 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:54:02.712660 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:54:02.712660 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:54:02.716067 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a120b0ad-f6e3-4ecb-9312-e92d5c115fd3 could not be found. Oct 04 21:54:02.716067 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:54:02.716067 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:54:02.716067 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:54:02.716067 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:54:02.716067 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:54:02.716067 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:54:02.716067 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:54:02.716067 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:54:02.716067 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a120b0ad-f6e3-4ecb-9312-e92d5c115fd3 could not be found. Oct 04 21:54:02.716067 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:54:02.716067 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-6465bfef-cee6-4a59-b112-3c88fc18203d tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Returning 404 to user: Instance a120b0ad-f6e3-4ecb-9312-e92d5c115fd3 could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:54:02.716067 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-6465bfef-cee6-4a59-b112-3c88fc18203d tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] 10.222.0.43 "DELETE /compute/v2.1/servers/a120b0ad-f6e3-4ecb-9312-e92d5c115fd3" status: 404 len: 111 microversion: 2.1 time: 0.070447 Oct 04 21:54:02.716067 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1180/2437] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 21:54:02 2022] DELETE /compute/v2.1/servers/a120b0ad-f6e3-4ecb-9312-e92d5c115fd3 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:54:02.720488 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-7e7521ad-f37d-47be-bce2-153d2f741c2f tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:02.720998 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-7e7521ad-f37d-47be-bce2-153d2f741c2f tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 152003e4-2a7b-4801-8656-73093cd566ed] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:02.728970 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7e7521ad-f37d-47be-bce2-153d2f741c2f tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:02.729475 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7e7521ad-f37d-47be-bce2-153d2f741c2f tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:02.729916 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7e7521ad-f37d-47be-bce2-153d2f741c2f tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:02.730666 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7e7521ad-f37d-47be-bce2-153d2f741c2f tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:02.731124 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7e7521ad-f37d-47be-bce2-153d2f741c2f tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:02.731747 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7e7521ad-f37d-47be-bce2-153d2f741c2f tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:02.752414 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-60515336-3d98-4a93-851a-916027eaae19 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47fbc4a6920d451cb1a2ad170de04921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43659cf5fed541e8883664bf17aced70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:02.764285 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-60515336-3d98-4a93-851a-916027eaae19 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] 10.222.0.43 "GET /compute/v2.1/servers/eb6e098d-966d-478b-a69c-3746584e5509" status: 200 len: 1506 microversion: 2.1 time: 0.310763 Oct 04 21:54:02.765431 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1258/2438] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:54:02 2022] GET /compute/v2.1/servers/eb6e098d-966d-478b-a69c-3746584e5509 => generated 1506 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:54:02.769477 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-7e7521ad-f37d-47be-bce2-153d2f741c2f tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 152003e4-2a7b-4801-8656-73093cd566ed] Going to try to terminate instance {{(pid=134101) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:54:02.772974 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-d64b7286-cbb3-46f0-befa-43bd309ccbed tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:02.773767 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-d64b7286-cbb3-46f0-befa-43bd309ccbed tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] [instance: 75061d5c-d642-48c4-8b19-b9252812b2cc] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:02.782354 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d64b7286-cbb3-46f0-befa-43bd309ccbed tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:02.783134 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d64b7286-cbb3-46f0-befa-43bd309ccbed tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:02.783823 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d64b7286-cbb3-46f0-befa-43bd309ccbed tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:02.784798 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d64b7286-cbb3-46f0-befa-43bd309ccbed tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:02.785434 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d64b7286-cbb3-46f0-befa-43bd309ccbed tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:02.786228 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d64b7286-cbb3-46f0-befa-43bd309ccbed tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:02.826118 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-d64b7286-cbb3-46f0-befa-43bd309ccbed tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] [instance: 75061d5c-d642-48c4-8b19-b9252812b2cc] Going to try to terminate instance {{(pid=134102) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:54:02.945667 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-d64b7286-cbb3-46f0-befa-43bd309ccbed tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] 10.222.0.43 "DELETE /compute/v2.1/servers/75061d5c-d642-48c4-8b19-b9252812b2cc" status: 204 len: 0 microversion: 2.1 time: 0.178273 Oct 04 21:54:02.947499 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1259/2439] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 21:54:02 2022] DELETE /compute/v2.1/servers/75061d5c-d642-48c4-8b19-b9252812b2cc => generated 0 bytes in 181 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:54:02.960324 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-7922e8da-ff18-4ce5-8d28-ede1feaf73a0 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:02.962512 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-7922e8da-ff18-4ce5-8d28-ede1feaf73a0 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] [instance: 12f775af-b918-467b-a6d1-3ca8a7957f37] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:02.964466 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-7e7521ad-f37d-47be-bce2-153d2f741c2f tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "DELETE /compute/v2.1/servers/152003e4-2a7b-4801-8656-73093cd566ed" status: 204 len: 0 microversion: 2.1 time: 0.247928 Oct 04 21:54:02.969014 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1181/2440] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 21:54:02 2022] DELETE /compute/v2.1/servers/152003e4-2a7b-4801-8656-73093cd566ed => generated 0 bytes in 250 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:54:02.970759 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7922e8da-ff18-4ce5-8d28-ede1feaf73a0 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:02.971515 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7922e8da-ff18-4ce5-8d28-ede1feaf73a0 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:02.972032 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7922e8da-ff18-4ce5-8d28-ede1feaf73a0 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:02.972889 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7922e8da-ff18-4ce5-8d28-ede1feaf73a0 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:02.973485 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7922e8da-ff18-4ce5-8d28-ede1feaf73a0 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:02.974124 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7922e8da-ff18-4ce5-8d28-ede1feaf73a0 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:02.977330 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-40a0ab3e-2a1b-4105-b641-920b37713963 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:02.978913 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-40a0ab3e-2a1b-4105-b641-920b37713963 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 152003e4-2a7b-4801-8656-73093cd566ed] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:02.986051 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-40a0ab3e-2a1b-4105-b641-920b37713963 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:02.986635 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-40a0ab3e-2a1b-4105-b641-920b37713963 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:02.987084 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-40a0ab3e-2a1b-4105-b641-920b37713963 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:02.987803 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-40a0ab3e-2a1b-4105-b641-920b37713963 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:02.988266 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-40a0ab3e-2a1b-4105-b641-920b37713963 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:02.988703 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-40a0ab3e-2a1b-4105-b641-920b37713963 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:03.007953 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-7922e8da-ff18-4ce5-8d28-ede1feaf73a0 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] [instance: 12f775af-b918-467b-a6d1-3ca8a7957f37] Going to try to terminate instance {{(pid=134102) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:54:03.018441 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:54:03.125171 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-7922e8da-ff18-4ce5-8d28-ede1feaf73a0 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] 10.222.0.43 "DELETE /compute/v2.1/servers/12f775af-b918-467b-a6d1-3ca8a7957f37" status: 204 len: 0 microversion: 2.1 time: 0.172516 Oct 04 21:54:03.126044 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1260/2441] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 21:54:02 2022] DELETE /compute/v2.1/servers/12f775af-b918-467b-a6d1-3ca8a7957f37 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:54:03.140147 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-03cf684d-cd56-4c0c-8e95-a6d6c88e6035 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:03.140884 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-03cf684d-cd56-4c0c-8e95-a6d6c88e6035 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] [instance: a120b0ad-f6e3-4ecb-9312-e92d5c115fd3] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:03.156752 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-03cf684d-cd56-4c0c-8e95-a6d6c88e6035 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:03.157376 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-03cf684d-cd56-4c0c-8e95-a6d6c88e6035 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:03.157787 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-03cf684d-cd56-4c0c-8e95-a6d6c88e6035 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:03.161044 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-03cf684d-cd56-4c0c-8e95-a6d6c88e6035 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:03.162406 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-03cf684d-cd56-4c0c-8e95-a6d6c88e6035 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:03.162530 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-03cf684d-cd56-4c0c-8e95-a6d6c88e6035 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:03.194182 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-03cf684d-cd56-4c0c-8e95-a6d6c88e6035 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] HTTP exception thrown: Instance a120b0ad-f6e3-4ecb-9312-e92d5c115fd3 could not be found. Oct 04 21:54:03.197502 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-03cf684d-cd56-4c0c-8e95-a6d6c88e6035 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Request method failure captured: Oct 04 21:54:03.197502 n-d-860284-1 devstack@n-api.service[134102]: request: GET /compute/v2.1/servers/a120b0ad-f6e3-4ecb-9312-e92d5c115fd3 HTTP/1.1 Oct 04 21:54:03.197502 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 21:54:03.197502 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 21:54:03.197502 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 21:54:03.197502 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 21:54:03.197502 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 21:54:03.197502 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 21:54:03.197502 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 21:54:03.197502 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 21:54:03.197502 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPKtD8tW6r1XpqIR5pzjO07FOJSn-VfYbZy21TQA3uSwCHlUYadhC1qn1i9q8TReiVykhcj_LcTzvxccj4TlBUnGJgCer8k2_7vdW7V9qfXRiLtbrjmaVq2juzQhHiH65IW7fAeWNQr2oOshFXph7O4U8TUbgXX2MigXDDhpQwtGXHPQ Oct 04 21:54:03.197502 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 21:54:03.197502 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 21:54:03.197502 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 21:54:03.197502 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 21:54:03.197502 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 21:54:03.197502 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 21:54:03.197502 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: 2865c04294884d1081c9b1b6fc8f8e09 Oct 04 21:54:03.197502 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-ListServersNegativeTestJSON-201044971 Oct 04 21:54:03.197502 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 21:54:03.197502 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 21:54:03.197502 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/2865c04294884d1081c9b1b6fc8f8e09"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_2865c04294884d1081c9b1b6fc8f8e09", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/2865c04294884d1081c9b1b6fc8f8e09"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/2865c04294884d1081c9b1b6fc8f8e09"}]}] Oct 04 21:54:03.197502 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-ListServersNegativeTestJSON-201044971 Oct 04 21:54:03.197502 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: 2865c04294884d1081c9b1b6fc8f8e09 Oct 04 21:54:03.197502 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-201044971 Oct 04 21:54:03.197502 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-ListServersNegativeTestJSON-201044971-project Oct 04 21:54:03.197502 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 21:54:03.197502 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 21:54:03.197502 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: 927913a1e0cc4d74b42cb209ec932286 Oct 04 21:54:03.197502 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-ListServersNegativeTestJSON-201044971-project Oct 04 21:54:03.197502 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 21:54:03.197502 n-d-860284-1 devstack@n-api.service[134102]: exception: Instance a120b0ad-f6e3-4ecb-9312-e92d5c115fd3 could not be found. Oct 04 21:54:03.197502 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': 'a120b0ad-f6e3-4ecb-9312-e92d5c115fd3'} Oct 04 21:54:03.197502 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:54:03.197502 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:54:03.197502 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:54:03.197502 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:54:03.197502 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:54:03.197502 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:54:03.197502 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:54:03.197502 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:54:03.197502 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:54:03.197502 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:54:03.197502 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a120b0ad-f6e3-4ecb-9312-e92d5c115fd3 could not be found. Oct 04 21:54:03.197502 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:54:03.197502 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:54:03.197502 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:54:03.197502 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:54:03.197502 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:54:03.197502 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:54:03.197502 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:54:03.197502 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:54:03.197502 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:54:03.197502 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:54:03.197502 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:54:03.197502 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:54:03.197502 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:54:03.197502 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:54:03.197502 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:54:03.197502 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:54:03.197502 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a120b0ad-f6e3-4ecb-9312-e92d5c115fd3 could not be found. Oct 04 21:54:03.197502 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:54:03.197502 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:54:03.201018 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:54:03.201018 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:54:03.201018 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:54:03.201018 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:54:03.201018 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:54:03.201018 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:54:03.201018 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a120b0ad-f6e3-4ecb-9312-e92d5c115fd3 could not be found. Oct 04 21:54:03.201018 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:54:03.201478 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-40a0ab3e-2a1b-4105-b641-920b37713963 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ad048becf474fb972d4291422d810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dcfc7024fc49388c4bd5f25f03e60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:03.203409 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-03cf684d-cd56-4c0c-8e95-a6d6c88e6035 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Returning 404 to user: Instance a120b0ad-f6e3-4ecb-9312-e92d5c115fd3 could not be found. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:54:03.204475 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-03cf684d-cd56-4c0c-8e95-a6d6c88e6035 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] 10.222.0.43 "GET /compute/v2.1/servers/a120b0ad-f6e3-4ecb-9312-e92d5c115fd3" status: 404 len: 111 microversion: 2.1 time: 0.073800 Oct 04 21:54:03.205537 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1261/2442] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:54:03 2022] GET /compute/v2.1/servers/a120b0ad-f6e3-4ecb-9312-e92d5c115fd3 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 21:54:03.211168 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-40a0ab3e-2a1b-4105-b641-920b37713963 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/152003e4-2a7b-4801-8656-73093cd566ed" status: 200 len: 1386 microversion: 2.1 time: 0.240547 Oct 04 21:54:03.212152 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1182/2443] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:54:02 2022] GET /compute/v2.1/servers/152003e4-2a7b-4801-8656-73093cd566ed => generated 1386 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:54:03.213735 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-e84ee2e1-e82f-471f-ae83-5c2a9017c2cc tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:03.214865 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-e84ee2e1-e82f-471f-ae83-5c2a9017c2cc tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] [instance: 7512d9d6-ab41-453e-bb9d-8e0861aa37f7] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:03.217159 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-45f6fc81-049f-402d-91fd-f5c1e7e791ca tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:03.217786 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-45f6fc81-049f-402d-91fd-f5c1e7e791ca tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] [instance: 75061d5c-d642-48c4-8b19-b9252812b2cc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:03.226839 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-45f6fc81-049f-402d-91fd-f5c1e7e791ca tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:03.226839 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-45f6fc81-049f-402d-91fd-f5c1e7e791ca tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:03.226839 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-45f6fc81-049f-402d-91fd-f5c1e7e791ca tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:03.226839 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-45f6fc81-049f-402d-91fd-f5c1e7e791ca tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:03.227277 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-45f6fc81-049f-402d-91fd-f5c1e7e791ca tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:03.227569 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-45f6fc81-049f-402d-91fd-f5c1e7e791ca tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:03.229339 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e84ee2e1-e82f-471f-ae83-5c2a9017c2cc tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:03.230041 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e84ee2e1-e82f-471f-ae83-5c2a9017c2cc tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:03.231067 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e84ee2e1-e82f-471f-ae83-5c2a9017c2cc tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:03.231999 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e84ee2e1-e82f-471f-ae83-5c2a9017c2cc tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:03.232652 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e84ee2e1-e82f-471f-ae83-5c2a9017c2cc tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:03.233123 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e84ee2e1-e82f-471f-ae83-5c2a9017c2cc tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:03.249908 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-e84ee2e1-e82f-471f-ae83-5c2a9017c2cc tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] HTTP exception thrown: Instance 7512d9d6-ab41-453e-bb9d-8e0861aa37f7 could not be found. Oct 04 21:54:03.251637 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-e84ee2e1-e82f-471f-ae83-5c2a9017c2cc tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Request method failure captured: Oct 04 21:54:03.251637 n-d-860284-1 devstack@n-api.service[134102]: request: GET /compute/v2.1/servers/7512d9d6-ab41-453e-bb9d-8e0861aa37f7 HTTP/1.1 Oct 04 21:54:03.251637 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 21:54:03.251637 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 21:54:03.251637 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 21:54:03.251637 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 21:54:03.251637 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 21:54:03.251637 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 21:54:03.251637 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 21:54:03.251637 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 21:54:03.251637 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPKlMyaAXDvUTID1IzmmSywCvuysT3aI_a5P3CwNV1RlnNDYDfurU0jpixzpaKj5sOoQgCtK8oEEPLd6IixW0SOcr8dqp0RNwGHWp6j9yDPQZ2lsf_JdMcGPWfUMhVnyczlDBdJXpSneu7x_nFwY0L7QA-CqDJHoDoK7jdZ7w20lPxmA Oct 04 21:54:03.251637 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 21:54:03.251637 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 21:54:03.251637 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 21:54:03.251637 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 21:54:03.251637 n-d-860284-1 devstack@n-api.service[134102]: X-Openstack-Nova-Api-Version: 2.25 Oct 04 21:54:03.251637 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 21:54:03.251637 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 21:54:03.251637 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: f17fee483fd14b07977669df199f3018 Oct 04 21:54:03.251637 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-2121064375 Oct 04 21:54:03.251637 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 21:54:03.251637 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 21:54:03.251637 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f17fee483fd14b07977669df199f3018"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_f17fee483fd14b07977669df199f3018", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f17fee483fd14b07977669df199f3018"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/f17fee483fd14b07977669df199f3018"}]}] Oct 04 21:54:03.251637 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-2121064375 Oct 04 21:54:03.251637 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: f17fee483fd14b07977669df199f3018 Oct 04 21:54:03.251637 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-2121064375 Oct 04 21:54:03.251637 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-LiveAutoBlockMigrationV225Test-2121064375-project Oct 04 21:54:03.251637 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 21:54:03.251637 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 21:54:03.251637 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: f529f881a037459d9405bd14afd7a639 Oct 04 21:54:03.251637 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-2121064375-project Oct 04 21:54:03.251637 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 21:54:03.251637 n-d-860284-1 devstack@n-api.service[134102]: exception: Instance 7512d9d6-ab41-453e-bb9d-8e0861aa37f7 could not be found. Oct 04 21:54:03.251637 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': '7512d9d6-ab41-453e-bb9d-8e0861aa37f7'} Oct 04 21:54:03.251637 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:54:03.251637 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:54:03.251637 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:54:03.251637 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:54:03.251637 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:54:03.251637 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:54:03.251637 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:54:03.251637 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:54:03.251637 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:54:03.251637 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:54:03.251637 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7512d9d6-ab41-453e-bb9d-8e0861aa37f7 could not be found. Oct 04 21:54:03.251637 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:54:03.251637 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:54:03.251637 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:54:03.251637 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:54:03.251637 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:54:03.251637 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:54:03.251637 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:54:03.251637 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:54:03.251637 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:54:03.251637 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:54:03.251637 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:54:03.251637 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:54:03.251637 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:54:03.251637 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:54:03.251637 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:54:03.251637 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:54:03.251637 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7512d9d6-ab41-453e-bb9d-8e0861aa37f7 could not be found. Oct 04 21:54:03.251637 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:54:03.261239 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:54:03.261239 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:54:03.261239 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:54:03.261239 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:54:03.261239 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:54:03.261239 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:54:03.261239 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:54:03.261239 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7512d9d6-ab41-453e-bb9d-8e0861aa37f7 could not be found. Oct 04 21:54:03.261239 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:54:03.261239 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-e84ee2e1-e82f-471f-ae83-5c2a9017c2cc tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Returning 404 to user: Instance 7512d9d6-ab41-453e-bb9d-8e0861aa37f7 could not be found. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:54:03.261239 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-e84ee2e1-e82f-471f-ae83-5c2a9017c2cc tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] 10.222.0.43 "GET /compute/v2.1/servers/7512d9d6-ab41-453e-bb9d-8e0861aa37f7" status: 404 len: 111 microversion: 2.25 time: 0.046308 Oct 04 21:54:03.261239 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1262/2444] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:54:03 2022] GET /compute/v2.1/servers/7512d9d6-ab41-453e-bb9d-8e0861aa37f7 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 21:54:03.264257 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-b791c11b-6acd-4ea9-9e1f-d949d5935c43 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:03.264968 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-b791c11b-6acd-4ea9-9e1f-d949d5935c43 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] [instance: 830de6ad-adc6-4d16-ae9d-a29ae85e6cd2] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:03.271508 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b791c11b-6acd-4ea9-9e1f-d949d5935c43 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:03.272232 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b791c11b-6acd-4ea9-9e1f-d949d5935c43 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:03.272875 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b791c11b-6acd-4ea9-9e1f-d949d5935c43 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:03.273698 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b791c11b-6acd-4ea9-9e1f-d949d5935c43 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:03.274927 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b791c11b-6acd-4ea9-9e1f-d949d5935c43 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:03.275439 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b791c11b-6acd-4ea9-9e1f-d949d5935c43 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:03.519426 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-45f6fc81-049f-402d-91fd-f5c1e7e791ca tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927913a1e0cc4d74b42cb209ec932286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2865c04294884d1081c9b1b6fc8f8e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:03.532001 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-45f6fc81-049f-402d-91fd-f5c1e7e791ca tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] 10.222.0.43 "GET /compute/v2.1/servers/75061d5c-d642-48c4-8b19-b9252812b2cc" status: 200 len: 1519 microversion: 2.1 time: 0.318618 Oct 04 21:54:03.539382 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1183/2445] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:54:03 2022] GET /compute/v2.1/servers/75061d5c-d642-48c4-8b19-b9252812b2cc => generated 1519 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:54:03.545930 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-efe18588-5f27-42c2-b547-94f332602332 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:03.546696 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-efe18588-5f27-42c2-b547-94f332602332 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] [instance: 659208f3-1bef-41f7-9616-50c2db9f46ba] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:03.554261 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-efe18588-5f27-42c2-b547-94f332602332 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:03.555153 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-efe18588-5f27-42c2-b547-94f332602332 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:03.556503 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-efe18588-5f27-42c2-b547-94f332602332 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:03.557547 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-efe18588-5f27-42c2-b547-94f332602332 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:03.558225 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-efe18588-5f27-42c2-b547-94f332602332 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:03.558863 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-efe18588-5f27-42c2-b547-94f332602332 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:03.565974 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-b791c11b-6acd-4ea9-9e1f-d949d5935c43 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:03.576243 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-b791c11b-6acd-4ea9-9e1f-d949d5935c43 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:03.578504 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-b791c11b-6acd-4ea9-9e1f-d949d5935c43 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:03.579892 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-b791c11b-6acd-4ea9-9e1f-d949d5935c43 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] 10.222.0.43 "GET /compute/v2.1/servers/830de6ad-adc6-4d16-ae9d-a29ae85e6cd2" status: 200 len: 1874 microversion: 2.42 time: 0.324797 Oct 04 21:54:03.580975 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1263/2446] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:54:03 2022] GET /compute/v2.1/servers/830de6ad-adc6-4d16-ae9d-a29ae85e6cd2 => generated 1874 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:54:03.585830 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-fcd2d5c5-5781-4d2e-8612-8fb297eda2c3 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Calling method '.version_select at 0x7fbb2efc0b80>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:03.606154 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-efe18588-5f27-42c2-b547-94f332602332 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] [instance: 659208f3-1bef-41f7-9616-50c2db9f46ba] Going to try to terminate instance {{(pid=134101) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:54:03.648501 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-fcd2d5c5-5781-4d2e-8612-8fb297eda2c3 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] 10.222.0.43 "GET /compute/v2.1/images/5157f1c6-d263-427d-84cc-3320cbd286d5" status: 200 len: 1464 microversion: 2.1 time: 0.066413 Oct 04 21:54:03.649692 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1264/2447] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:54:03 2022] GET /compute/v2.1/images/5157f1c6-d263-427d-84cc-3320cbd286d5 => generated 1464 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:54:03.664334 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-180f63b5-c7cd-4e7c-8565-c12809d61061 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Calling method '.version_select at 0x7fbb2f91b280>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:03.715975 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-efe18588-5f27-42c2-b547-94f332602332 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] 10.222.0.43 "DELETE /compute/v2.1/servers/659208f3-1bef-41f7-9616-50c2db9f46ba" status: 204 len: 0 microversion: 2.25 time: 0.174534 Oct 04 21:54:03.716585 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1184/2448] 10.222.0.43 () {60 vars in 1280 bytes} [Tue Oct 4 21:54:03 2022] DELETE /compute/v2.1/servers/659208f3-1bef-41f7-9616-50c2db9f46ba => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 21:54:03.730560 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-8f1bb055-c306-4f31-8c5a-5afa988785b5 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:03.731280 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-8f1bb055-c306-4f31-8c5a-5afa988785b5 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] [instance: 659208f3-1bef-41f7-9616-50c2db9f46ba] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:03.737963 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8f1bb055-c306-4f31-8c5a-5afa988785b5 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:03.738981 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8f1bb055-c306-4f31-8c5a-5afa988785b5 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:03.739438 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8f1bb055-c306-4f31-8c5a-5afa988785b5 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:03.740303 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8f1bb055-c306-4f31-8c5a-5afa988785b5 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:03.740765 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8f1bb055-c306-4f31-8c5a-5afa988785b5 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:03.741186 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8f1bb055-c306-4f31-8c5a-5afa988785b5 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:03.747922 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-180f63b5-c7cd-4e7c-8565-c12809d61061 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] 10.222.0.43 "GET /compute/v2.1/images/5157f1c6-d263-427d-84cc-3320cbd286d5" status: 200 len: 1464 microversion: 2.1 time: 0.087877 Oct 04 21:54:03.750432 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1265/2449] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:54:03 2022] GET /compute/v2.1/images/5157f1c6-d263-427d-84cc-3320cbd286d5 => generated 1464 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:54:03.765726 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-cf322029-3d5c-44f5-a28f-83a93721e3c8 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:03.767773 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-cf322029-3d5c-44f5-a28f-83a93721e3c8 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] [instance: 6f8a46c4-3b6f-4f50-8227-77b69154fb57] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:03.776105 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cf322029-3d5c-44f5-a28f-83a93721e3c8 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:03.776676 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cf322029-3d5c-44f5-a28f-83a93721e3c8 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:03.777213 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cf322029-3d5c-44f5-a28f-83a93721e3c8 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:03.778087 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cf322029-3d5c-44f5-a28f-83a93721e3c8 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:03.778650 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cf322029-3d5c-44f5-a28f-83a93721e3c8 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:03.779273 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cf322029-3d5c-44f5-a28f-83a93721e3c8 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:04.055245 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-8f1bb055-c306-4f31-8c5a-5afa988785b5 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:04.063859 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-8f1bb055-c306-4f31-8c5a-5afa988785b5 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:04.065396 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-8f1bb055-c306-4f31-8c5a-5afa988785b5 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:04.066665 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-8f1bb055-c306-4f31-8c5a-5afa988785b5 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] 10.222.0.43 "GET /compute/v2.1/servers/659208f3-1bef-41f7-9616-50c2db9f46ba" status: 200 len: 1564 microversion: 2.25 time: 0.345450 Oct 04 21:54:04.067438 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1185/2450] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:54:03 2022] GET /compute/v2.1/servers/659208f3-1bef-41f7-9616-50c2db9f46ba => generated 1564 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:54:04.077844 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-cf322029-3d5c-44f5-a28f-83a93721e3c8 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f11c77afc74a16bea945dd84e72ebe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94d03be22238422eba835ed522baf9c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:04.083788 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-3bfd6a97-ca73-43bd-b82a-c559ca012387 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:04.084787 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-3bfd6a97-ca73-43bd-b82a-c559ca012387 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] [instance: eb6e098d-966d-478b-a69c-3746584e5509] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:04.094610 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-cf322029-3d5c-44f5-a28f-83a93721e3c8 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] 10.222.0.43 "GET /compute/v2.1/servers/6f8a46c4-3b6f-4f50-8227-77b69154fb57" status: 200 len: 1480 microversion: 2.1 time: 0.334346 Oct 04 21:54:04.095562 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3bfd6a97-ca73-43bd-b82a-c559ca012387 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:04.098674 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1266/2451] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:54:03 2022] GET /compute/v2.1/servers/6f8a46c4-3b6f-4f50-8227-77b69154fb57 => generated 1480 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:54:04.100404 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3bfd6a97-ca73-43bd-b82a-c559ca012387 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:04.101409 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3bfd6a97-ca73-43bd-b82a-c559ca012387 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:04.104712 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3bfd6a97-ca73-43bd-b82a-c559ca012387 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:04.105490 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3bfd6a97-ca73-43bd-b82a-c559ca012387 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:04.106512 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3bfd6a97-ca73-43bd-b82a-c559ca012387 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:04.238016 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-2c00655e-d568-4ec4-9550-521c81dde84d tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:04.239179 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-2c00655e-d568-4ec4-9550-521c81dde84d tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 152003e4-2a7b-4801-8656-73093cd566ed] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:04.250565 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2c00655e-d568-4ec4-9550-521c81dde84d tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:04.251682 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2c00655e-d568-4ec4-9550-521c81dde84d tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:04.252376 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2c00655e-d568-4ec4-9550-521c81dde84d tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:04.253441 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2c00655e-d568-4ec4-9550-521c81dde84d tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:04.254140 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2c00655e-d568-4ec4-9550-521c81dde84d tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:04.254835 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2c00655e-d568-4ec4-9550-521c81dde84d tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:04.328741 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-3bfd6a97-ca73-43bd-b82a-c559ca012387 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47fbc4a6920d451cb1a2ad170de04921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43659cf5fed541e8883664bf17aced70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:04.337018 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-3bfd6a97-ca73-43bd-b82a-c559ca012387 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] 10.222.0.43 "GET /compute/v2.1/servers/eb6e098d-966d-478b-a69c-3746584e5509" status: 200 len: 1506 microversion: 2.1 time: 0.268335 Oct 04 21:54:04.337730 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1186/2452] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:54:04 2022] GET /compute/v2.1/servers/eb6e098d-966d-478b-a69c-3746584e5509 => generated 1506 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:54:04.438304 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-2c00655e-d568-4ec4-9550-521c81dde84d tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ad048becf474fb972d4291422d810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dcfc7024fc49388c4bd5f25f03e60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:04.449879 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-2c00655e-d568-4ec4-9550-521c81dde84d tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/152003e4-2a7b-4801-8656-73093cd566ed" status: 200 len: 1386 microversion: 2.1 time: 0.217248 Oct 04 21:54:04.462156 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1267/2453] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:54:04 2022] GET /compute/v2.1/servers/152003e4-2a7b-4801-8656-73093cd566ed => generated 1386 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:54:04.570331 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-01c8bbb0-896d-4ee7-8695-6d822e7f8788 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:04.572104 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-01c8bbb0-896d-4ee7-8695-6d822e7f8788 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] [instance: 75061d5c-d642-48c4-8b19-b9252812b2cc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:04.584875 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-01c8bbb0-896d-4ee7-8695-6d822e7f8788 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:04.586140 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-01c8bbb0-896d-4ee7-8695-6d822e7f8788 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:04.587646 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-01c8bbb0-896d-4ee7-8695-6d822e7f8788 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:04.588925 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-01c8bbb0-896d-4ee7-8695-6d822e7f8788 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:04.589636 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-01c8bbb0-896d-4ee7-8695-6d822e7f8788 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:04.590445 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-01c8bbb0-896d-4ee7-8695-6d822e7f8788 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:04.614453 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-3b779c86-bf9a-404f-9123-2e7ae58796cc tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:04.616194 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-3b779c86-bf9a-404f-9123-2e7ae58796cc tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] [instance: 830de6ad-adc6-4d16-ae9d-a29ae85e6cd2] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:04.629670 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3b779c86-bf9a-404f-9123-2e7ae58796cc tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:04.630981 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3b779c86-bf9a-404f-9123-2e7ae58796cc tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:04.631971 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3b779c86-bf9a-404f-9123-2e7ae58796cc tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:04.633711 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3b779c86-bf9a-404f-9123-2e7ae58796cc tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:04.634974 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3b779c86-bf9a-404f-9123-2e7ae58796cc tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:04.635972 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3b779c86-bf9a-404f-9123-2e7ae58796cc tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:04.922870 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-01c8bbb0-896d-4ee7-8695-6d822e7f8788 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927913a1e0cc4d74b42cb209ec932286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2865c04294884d1081c9b1b6fc8f8e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:04.938572 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-01c8bbb0-896d-4ee7-8695-6d822e7f8788 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] 10.222.0.43 "GET /compute/v2.1/servers/75061d5c-d642-48c4-8b19-b9252812b2cc" status: 200 len: 1519 microversion: 2.1 time: 0.375985 Oct 04 21:54:04.939487 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1187/2454] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:54:04 2022] GET /compute/v2.1/servers/75061d5c-d642-48c4-8b19-b9252812b2cc => generated 1519 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:54:04.988240 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-3b779c86-bf9a-404f-9123-2e7ae58796cc tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:05.030930 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-3b779c86-bf9a-404f-9123-2e7ae58796cc tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:05.044633 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-3b779c86-bf9a-404f-9123-2e7ae58796cc tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:05.047492 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-3b779c86-bf9a-404f-9123-2e7ae58796cc tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] 10.222.0.43 "GET /compute/v2.1/servers/830de6ad-adc6-4d16-ae9d-a29ae85e6cd2" status: 200 len: 1874 microversion: 2.42 time: 0.439662 Oct 04 21:54:05.049101 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1268/2455] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:54:04 2022] GET /compute/v2.1/servers/830de6ad-adc6-4d16-ae9d-a29ae85e6cd2 => generated 1874 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:54:05.096683 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-ca8738be-49dd-4150-8ab3-85acd0aacdaf tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:05.097514 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-ca8738be-49dd-4150-8ab3-85acd0aacdaf tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] [instance: 659208f3-1bef-41f7-9616-50c2db9f46ba] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:05.110306 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ca8738be-49dd-4150-8ab3-85acd0aacdaf tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:05.111417 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ca8738be-49dd-4150-8ab3-85acd0aacdaf tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:05.112447 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ca8738be-49dd-4150-8ab3-85acd0aacdaf tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:05.121774 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ca8738be-49dd-4150-8ab3-85acd0aacdaf tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:05.123136 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ca8738be-49dd-4150-8ab3-85acd0aacdaf tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:05.123824 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ca8738be-49dd-4150-8ab3-85acd0aacdaf tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:05.131676 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-9374404c-fa24-49bd-8de1-b9cd15f78f98 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:05.135033 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-9374404c-fa24-49bd-8de1-b9cd15f78f98 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] [instance: 6f8a46c4-3b6f-4f50-8227-77b69154fb57] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:05.151403 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9374404c-fa24-49bd-8de1-b9cd15f78f98 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:05.152920 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9374404c-fa24-49bd-8de1-b9cd15f78f98 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:05.153551 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9374404c-fa24-49bd-8de1-b9cd15f78f98 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:05.154667 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9374404c-fa24-49bd-8de1-b9cd15f78f98 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:05.155293 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9374404c-fa24-49bd-8de1-b9cd15f78f98 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:05.155903 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9374404c-fa24-49bd-8de1-b9cd15f78f98 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:05.699228 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-9374404c-fa24-49bd-8de1-b9cd15f78f98 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f11c77afc74a16bea945dd84e72ebe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94d03be22238422eba835ed522baf9c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:05.713058 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-9374404c-fa24-49bd-8de1-b9cd15f78f98 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] 10.222.0.43 "GET /compute/v2.1/servers/6f8a46c4-3b6f-4f50-8227-77b69154fb57" status: 200 len: 1467 microversion: 2.1 time: 0.592673 Oct 04 21:54:05.718901 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1269/2456] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:54:05 2022] GET /compute/v2.1/servers/6f8a46c4-3b6f-4f50-8227-77b69154fb57 => generated 1467 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:54:05.738522 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-981253ba-7a63-4a9d-809e-38cda5379909 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:05.739417 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-981253ba-7a63-4a9d-809e-38cda5379909 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] [instance: eb6e098d-966d-478b-a69c-3746584e5509] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:05.747412 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-981253ba-7a63-4a9d-809e-38cda5379909 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:05.749574 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-981253ba-7a63-4a9d-809e-38cda5379909 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:05.750203 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-981253ba-7a63-4a9d-809e-38cda5379909 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:05.753241 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-981253ba-7a63-4a9d-809e-38cda5379909 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:05.753962 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-981253ba-7a63-4a9d-809e-38cda5379909 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:05.760808 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-981253ba-7a63-4a9d-809e-38cda5379909 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:05.767226 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:54:05.956732 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-ca8738be-49dd-4150-8ab3-85acd0aacdaf tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:05.972882 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-ca8738be-49dd-4150-8ab3-85acd0aacdaf tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:05.980079 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-ca8738be-49dd-4150-8ab3-85acd0aacdaf tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:05.981696 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-ca8738be-49dd-4150-8ab3-85acd0aacdaf tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] 10.222.0.43 "GET /compute/v2.1/servers/659208f3-1bef-41f7-9616-50c2db9f46ba" status: 200 len: 1564 microversion: 2.25 time: 0.891721 Oct 04 21:54:05.982665 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1188/2457] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:54:05 2022] GET /compute/v2.1/servers/659208f3-1bef-41f7-9616-50c2db9f46ba => generated 1564 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:54:06.001540 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-516c4ddb-5bcd-44c0-a41f-71377aa91401 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:06.002490 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-516c4ddb-5bcd-44c0-a41f-71377aa91401 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 152003e4-2a7b-4801-8656-73093cd566ed] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:06.009776 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-516c4ddb-5bcd-44c0-a41f-71377aa91401 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:06.010566 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-516c4ddb-5bcd-44c0-a41f-71377aa91401 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:06.012114 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-516c4ddb-5bcd-44c0-a41f-71377aa91401 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:06.013728 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-516c4ddb-5bcd-44c0-a41f-71377aa91401 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:06.022085 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-516c4ddb-5bcd-44c0-a41f-71377aa91401 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:06.022890 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-516c4ddb-5bcd-44c0-a41f-71377aa91401 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:07.059818 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-981253ba-7a63-4a9d-809e-38cda5379909 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47fbc4a6920d451cb1a2ad170de04921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43659cf5fed541e8883664bf17aced70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:07.069711 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-981253ba-7a63-4a9d-809e-38cda5379909 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] 10.222.0.43 "GET /compute/v2.1/servers/eb6e098d-966d-478b-a69c-3746584e5509" status: 200 len: 1506 microversion: 2.1 time: 1.349404 Oct 04 21:54:07.074524 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1270/2458] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:54:05 2022] GET /compute/v2.1/servers/eb6e098d-966d-478b-a69c-3746584e5509 => generated 1506 bytes in 1355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:54:07.081912 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-da4434be-197a-4f0d-a8b7-943118429851 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Calling method '.version_select at 0x7fbb2efd2430>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:07.103712 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-516c4ddb-5bcd-44c0-a41f-71377aa91401 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ad048becf474fb972d4291422d810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dcfc7024fc49388c4bd5f25f03e60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:07.144340 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-516c4ddb-5bcd-44c0-a41f-71377aa91401 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/152003e4-2a7b-4801-8656-73093cd566ed" status: 200 len: 1386 microversion: 2.1 time: 1.158863 Oct 04 21:54:07.158696 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1189/2459] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:54:05 2022] GET /compute/v2.1/servers/152003e4-2a7b-4801-8656-73093cd566ed => generated 1386 bytes in 1164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:54:07.159131 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-42b999a2-503a-447c-a5ed-3f16b4ce640d tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:07.160761 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-42b999a2-503a-447c-a5ed-3f16b4ce640d tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] [instance: 75061d5c-d642-48c4-8b19-b9252812b2cc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:07.181475 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-42b999a2-503a-447c-a5ed-3f16b4ce640d tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:07.182588 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-42b999a2-503a-447c-a5ed-3f16b4ce640d tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:07.184037 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-42b999a2-503a-447c-a5ed-3f16b4ce640d tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:07.186728 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-42b999a2-503a-447c-a5ed-3f16b4ce640d tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:07.189044 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-42b999a2-503a-447c-a5ed-3f16b4ce640d tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:07.191403 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-42b999a2-503a-447c-a5ed-3f16b4ce640d tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:07.281321 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-42b999a2-503a-447c-a5ed-3f16b4ce640d tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:07.282124 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-42b999a2-503a-447c-a5ed-3f16b4ce640d tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:07.282946 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-42b999a2-503a-447c-a5ed-3f16b4ce640d tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:07.283675 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.objects.instance [None req-42b999a2-503a-447c-a5ed-3f16b4ce640d tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Lazy-loading 'fault' on Instance uuid 75061d5c-d642-48c4-8b19-b9252812b2cc {{(pid=134101) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:54:07.338337 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-da4434be-197a-4f0d-a8b7-943118429851 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] 10.222.0.43 "GET /compute/v2.1/images?changes-since=2022-10-04T21%3A50%3A59Z" status: 200 len: 1902 microversion: 2.1 time: 0.255471 Oct 04 21:54:07.339103 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1271/2460] 10.222.0.43 () {58 vars in 1199 bytes} [Tue Oct 4 21:54:07 2022] GET /compute/v2.1/images?changes-since=2022-10-04T21%3A50%3A59Z => generated 1902 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:54:07.346447 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-19837231-9c36-42e9-b504-fc6c70b3b8aa tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:07.355583 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-19837231-9c36-42e9-b504-fc6c70b3b8aa tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] [instance: 830de6ad-adc6-4d16-ae9d-a29ae85e6cd2] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:07.370753 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-19837231-9c36-42e9-b504-fc6c70b3b8aa tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:07.371960 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-19837231-9c36-42e9-b504-fc6c70b3b8aa tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:07.373898 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-19837231-9c36-42e9-b504-fc6c70b3b8aa tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:07.375397 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-19837231-9c36-42e9-b504-fc6c70b3b8aa tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:07.376511 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-19837231-9c36-42e9-b504-fc6c70b3b8aa tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:07.377218 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-19837231-9c36-42e9-b504-fc6c70b3b8aa tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:07.528867 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-42b999a2-503a-447c-a5ed-3f16b4ce640d tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927913a1e0cc4d74b42cb209ec932286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2865c04294884d1081c9b1b6fc8f8e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:07.558160 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-42b999a2-503a-447c-a5ed-3f16b4ce640d tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] 10.222.0.43 "GET /compute/v2.1/servers/75061d5c-d642-48c4-8b19-b9252812b2cc" status: 200 len: 1310 microversion: 2.1 time: 0.408968 Oct 04 21:54:07.563682 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1190/2461] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:54:07 2022] GET /compute/v2.1/servers/75061d5c-d642-48c4-8b19-b9252812b2cc => generated 1310 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:54:08.041005 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-fc77744a-a42b-42d0-97e3-c4b6d5cafe84 req-678bf226-18ae-4d3b-b134-08799ed32aa6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75061d5c-d642-48c4-8b19-b9252812b2cc", "name": "network-vif-deleted", "tag": "56b627cb-784d-4dfc-8862-7083e7643d23"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:54:08.075347 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-fc77744a-a42b-42d0-97e3-c4b6d5cafe84 req-678bf226-18ae-4d3b-b134-08799ed32aa6 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:08.079210 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-fc77744a-a42b-42d0-97e3-c4b6d5cafe84 req-678bf226-18ae-4d3b-b134-08799ed32aa6 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:08.079903 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-fc77744a-a42b-42d0-97e3-c4b6d5cafe84 req-678bf226-18ae-4d3b-b134-08799ed32aa6 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:08.152043 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-fc77744a-a42b-42d0-97e3-c4b6d5cafe84 req-678bf226-18ae-4d3b-b134-08799ed32aa6 service nova] Creating event network-vif-deleted:56b627cb-784d-4dfc-8862-7083e7643d23 for instance 75061d5c-d642-48c4-8b19-b9252812b2cc on n-h2-860284-1 Oct 04 21:54:08.165185 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-fc77744a-a42b-42d0-97e3-c4b6d5cafe84 req-678bf226-18ae-4d3b-b134-08799ed32aa6 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.598427 Oct 04 21:54:08.167197 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1191/2462] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:54:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:54:08.185501 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-207cc3ac-0f2c-46ac-8f5c-3c3f5fc25df0 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:08.187388 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-207cc3ac-0f2c-46ac-8f5c-3c3f5fc25df0 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] [instance: 659208f3-1bef-41f7-9616-50c2db9f46ba] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:08.204767 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-207cc3ac-0f2c-46ac-8f5c-3c3f5fc25df0 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:08.206184 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-207cc3ac-0f2c-46ac-8f5c-3c3f5fc25df0 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:08.207765 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-207cc3ac-0f2c-46ac-8f5c-3c3f5fc25df0 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:08.210532 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-207cc3ac-0f2c-46ac-8f5c-3c3f5fc25df0 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:08.211785 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-207cc3ac-0f2c-46ac-8f5c-3c3f5fc25df0 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:08.213516 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-207cc3ac-0f2c-46ac-8f5c-3c3f5fc25df0 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:08.226298 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-19837231-9c36-42e9-b504-fc6c70b3b8aa tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:08.268839 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-19837231-9c36-42e9-b504-fc6c70b3b8aa tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:08.274095 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-19837231-9c36-42e9-b504-fc6c70b3b8aa tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:08.276087 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-19837231-9c36-42e9-b504-fc6c70b3b8aa tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] 10.222.0.43 "GET /compute/v2.1/servers/830de6ad-adc6-4d16-ae9d-a29ae85e6cd2" status: 200 len: 1874 microversion: 2.42 time: 0.935688 Oct 04 21:54:08.279264 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1272/2463] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:54:07 2022] GET /compute/v2.1/servers/830de6ad-adc6-4d16-ae9d-a29ae85e6cd2 => generated 1874 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:54:08.291763 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-1a0cf192-2d0d-4c50-8e9d-c7032a617f93 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Calling method '.version_select at 0x7fbb37280ca0>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:08.319809 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-207cc3ac-0f2c-46ac-8f5c-3c3f5fc25df0 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:08.320962 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-207cc3ac-0f2c-46ac-8f5c-3c3f5fc25df0 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:08.322258 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-207cc3ac-0f2c-46ac-8f5c-3c3f5fc25df0 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:08.324633 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.objects.instance [None req-207cc3ac-0f2c-46ac-8f5c-3c3f5fc25df0 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lazy-loading 'fault' on Instance uuid 659208f3-1bef-41f7-9616-50c2db9f46ba {{(pid=134101) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:54:08.385202 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-207cc3ac-0f2c-46ac-8f5c-3c3f5fc25df0 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:08.397575 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-207cc3ac-0f2c-46ac-8f5c-3c3f5fc25df0 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:08.400229 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-207cc3ac-0f2c-46ac-8f5c-3c3f5fc25df0 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f529f881a037459d9405bd14afd7a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17fee483fd14b07977669df199f3018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:08.401719 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-207cc3ac-0f2c-46ac-8f5c-3c3f5fc25df0 tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] 10.222.0.43 "GET /compute/v2.1/servers/659208f3-1bef-41f7-9616-50c2db9f46ba" status: 200 len: 1352 microversion: 2.25 time: 0.232085 Oct 04 21:54:08.402848 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1192/2464] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:54:08 2022] GET /compute/v2.1/servers/659208f3-1bef-41f7-9616-50c2db9f46ba => generated 1352 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:54:08.408717 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-734d85e4-2ec5-4afa-9aec-e30fd0bed5b6 req-53479716-6376-4833-aa95-61863b15a1b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "659208f3-1bef-41f7-9616-50c2db9f46ba", "name": "network-vif-deleted", "tag": "368ea7da-0153-4a50-967c-853fb135f91d"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:54:08.422873 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-734d85e4-2ec5-4afa-9aec-e30fd0bed5b6 req-53479716-6376-4833-aa95-61863b15a1b5 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:08.424012 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-734d85e4-2ec5-4afa-9aec-e30fd0bed5b6 req-53479716-6376-4833-aa95-61863b15a1b5 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:08.425118 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-734d85e4-2ec5-4afa-9aec-e30fd0bed5b6 req-53479716-6376-4833-aa95-61863b15a1b5 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:08.448782 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-734d85e4-2ec5-4afa-9aec-e30fd0bed5b6 req-53479716-6376-4833-aa95-61863b15a1b5 service nova] Creating event network-vif-deleted:368ea7da-0153-4a50-967c-853fb135f91d for instance 659208f3-1bef-41f7-9616-50c2db9f46ba on n-h1-860284-1 Oct 04 21:54:08.464947 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-734d85e4-2ec5-4afa-9aec-e30fd0bed5b6 req-53479716-6376-4833-aa95-61863b15a1b5 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060298 Oct 04 21:54:08.465567 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1193/2465] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:54:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:54:08.472894 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e4d5fdb7-95c3-4815-934f-68787851d4a7 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:08.473959 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-e4d5fdb7-95c3-4815-934f-68787851d4a7 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] [instance: eb6e098d-966d-478b-a69c-3746584e5509] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:08.483985 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-1a0cf192-2d0d-4c50-8e9d-c7032a617f93 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] 10.222.0.43 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1275467888" status: 200 len: 485 microversion: 2.1 time: 0.201391 Oct 04 21:54:08.486081 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e4d5fdb7-95c3-4815-934f-68787851d4a7 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:08.486976 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1273/2466] 10.222.0.43 () {58 vars in 1231 bytes} [Tue Oct 4 21:54:08 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1275467888 => generated 485 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:54:08.498976 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e4d5fdb7-95c3-4815-934f-68787851d4a7 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:08.499666 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e4d5fdb7-95c3-4815-934f-68787851d4a7 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:08.500655 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e4d5fdb7-95c3-4815-934f-68787851d4a7 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:08.501312 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e4d5fdb7-95c3-4815-934f-68787851d4a7 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:08.501919 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e4d5fdb7-95c3-4815-934f-68787851d4a7 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:08.503726 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-8e436f57-e2a8-42e1-9a25-93214a711235 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:08.504913 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-8e436f57-e2a8-42e1-9a25-93214a711235 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 152003e4-2a7b-4801-8656-73093cd566ed] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:08.516708 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8e436f57-e2a8-42e1-9a25-93214a711235 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:08.517693 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8e436f57-e2a8-42e1-9a25-93214a711235 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:08.518151 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8e436f57-e2a8-42e1-9a25-93214a711235 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:08.519263 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8e436f57-e2a8-42e1-9a25-93214a711235 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:08.519978 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8e436f57-e2a8-42e1-9a25-93214a711235 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:08.520658 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8e436f57-e2a8-42e1-9a25-93214a711235 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:08.687165 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-8e436f57-e2a8-42e1-9a25-93214a711235 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ad048becf474fb972d4291422d810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dcfc7024fc49388c4bd5f25f03e60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:08.699434 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-8e436f57-e2a8-42e1-9a25-93214a711235 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/152003e4-2a7b-4801-8656-73093cd566ed" status: 200 len: 1183 microversion: 2.1 time: 0.205683 Oct 04 21:54:08.700742 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1274/2467] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:54:08 2022] GET /compute/v2.1/servers/152003e4-2a7b-4801-8656-73093cd566ed => generated 1183 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:54:08.707458 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-d9128fa9-705a-4617-a7e7-ce3fcad37a4b tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Calling method '.version_select at 0x7fbb2f869550>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:08.830008 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-e4d5fdb7-95c3-4815-934f-68787851d4a7 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47fbc4a6920d451cb1a2ad170de04921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43659cf5fed541e8883664bf17aced70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:08.853101 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-e4d5fdb7-95c3-4815-934f-68787851d4a7 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] 10.222.0.43 "GET /compute/v2.1/servers/eb6e098d-966d-478b-a69c-3746584e5509" status: 200 len: 1506 microversion: 2.1 time: 0.382088 Oct 04 21:54:08.856463 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1194/2468] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:54:08 2022] GET /compute/v2.1/servers/eb6e098d-966d-478b-a69c-3746584e5509 => generated 1506 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:54:08.863453 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-73ed0154-994e-4081-adc8-0bed8e26797a req-da0b8ee7-d15c-49c5-ac07-7ea944d51b08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f8a46c4-3b6f-4f50-8227-77b69154fb57", "name": "network-vif-unplugged", "status": "completed", "tag": "0b8186cd-d9f4-408f-9942-a8fcb3a46521"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:54:08.881481 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-d9128fa9-705a-4617-a7e7-ce3fcad37a4b tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] 10.222.0.43 "GET /compute/v2.1/images?server=6f8a46c4-3b6f-4f50-8227-77b69154fb57" status: 200 len: 957 microversion: 2.1 time: 0.178564 Oct 04 21:54:08.885366 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1275/2469] 10.222.0.43 () {58 vars in 1209 bytes} [Tue Oct 4 21:54:08 2022] GET /compute/v2.1/images?server=6f8a46c4-3b6f-4f50-8227-77b69154fb57 => generated 957 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:54:08.886259 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-73ed0154-994e-4081-adc8-0bed8e26797a req-da0b8ee7-d15c-49c5-ac07-7ea944d51b08 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:08.887190 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-73ed0154-994e-4081-adc8-0bed8e26797a req-da0b8ee7-d15c-49c5-ac07-7ea944d51b08 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:08.887906 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-73ed0154-994e-4081-adc8-0bed8e26797a req-da0b8ee7-d15c-49c5-ac07-7ea944d51b08 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:08.903046 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-02eedf05-7df4-4df5-80bd-2bd5d349f917 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:08.903834 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-02eedf05-7df4-4df5-80bd-2bd5d349f917 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] [instance: 75061d5c-d642-48c4-8b19-b9252812b2cc] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:08.908759 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-73ed0154-994e-4081-adc8-0bed8e26797a req-da0b8ee7-d15c-49c5-ac07-7ea944d51b08 service nova] Creating event network-vif-unplugged:0b8186cd-d9f4-408f-9942-a8fcb3a46521 for instance 6f8a46c4-3b6f-4f50-8227-77b69154fb57 on n-h2-860284-1 Oct 04 21:54:08.912639 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-02eedf05-7df4-4df5-80bd-2bd5d349f917 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:08.913058 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-02eedf05-7df4-4df5-80bd-2bd5d349f917 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:08.913599 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-02eedf05-7df4-4df5-80bd-2bd5d349f917 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:08.923250 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-73ed0154-994e-4081-adc8-0bed8e26797a req-da0b8ee7-d15c-49c5-ac07-7ea944d51b08 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.060541 Oct 04 21:54:08.923250 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1195/2470] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:54:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:54:08.928897 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-02eedf05-7df4-4df5-80bd-2bd5d349f917 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:08.929403 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-02eedf05-7df4-4df5-80bd-2bd5d349f917 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:08.929867 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-02eedf05-7df4-4df5-80bd-2bd5d349f917 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:08.934460 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-6c801499-a361-40a7-a3f1-7ed86dd9a52b tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Calling method '.version_select at 0x7fbb2ef75dc0>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:08.958666 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-02eedf05-7df4-4df5-80bd-2bd5d349f917 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] HTTP exception thrown: Instance 75061d5c-d642-48c4-8b19-b9252812b2cc could not be found. Oct 04 21:54:08.960425 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-02eedf05-7df4-4df5-80bd-2bd5d349f917 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Request method failure captured: Oct 04 21:54:08.960425 n-d-860284-1 devstack@n-api.service[134102]: request: GET /compute/v2.1/servers/75061d5c-d642-48c4-8b19-b9252812b2cc HTTP/1.1 Oct 04 21:54:08.960425 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 21:54:08.960425 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 21:54:08.960425 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 21:54:08.960425 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 21:54:08.960425 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 21:54:08.960425 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 21:54:08.960425 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 21:54:08.960425 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 21:54:08.960425 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPKtD8tW6r1XpqIR5pzjO07FOJSn-VfYbZy21TQA3uSwCHlUYadhC1qn1i9q8TReiVykhcj_LcTzvxccj4TlBUnGJgCer8k2_7vdW7V9qfXRiLtbrjmaVq2juzQhHiH65IW7fAeWNQr2oOshFXph7O4U8TUbgXX2MigXDDhpQwtGXHPQ Oct 04 21:54:08.960425 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 21:54:08.960425 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 21:54:08.960425 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 21:54:08.960425 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 21:54:08.960425 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 21:54:08.960425 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 21:54:08.960425 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: 2865c04294884d1081c9b1b6fc8f8e09 Oct 04 21:54:08.960425 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-ListServersNegativeTestJSON-201044971 Oct 04 21:54:08.960425 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 21:54:08.960425 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 21:54:08.960425 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/2865c04294884d1081c9b1b6fc8f8e09"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_2865c04294884d1081c9b1b6fc8f8e09", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/2865c04294884d1081c9b1b6fc8f8e09"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/2865c04294884d1081c9b1b6fc8f8e09"}]}] Oct 04 21:54:08.960425 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-ListServersNegativeTestJSON-201044971 Oct 04 21:54:08.960425 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: 2865c04294884d1081c9b1b6fc8f8e09 Oct 04 21:54:08.960425 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-201044971 Oct 04 21:54:08.960425 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-ListServersNegativeTestJSON-201044971-project Oct 04 21:54:08.960425 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 21:54:08.960425 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 21:54:08.960425 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: 927913a1e0cc4d74b42cb209ec932286 Oct 04 21:54:08.960425 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-ListServersNegativeTestJSON-201044971-project Oct 04 21:54:08.960425 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 21:54:08.960425 n-d-860284-1 devstack@n-api.service[134102]: exception: Instance 75061d5c-d642-48c4-8b19-b9252812b2cc could not be found. Oct 04 21:54:08.960425 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': '75061d5c-d642-48c4-8b19-b9252812b2cc'} Oct 04 21:54:08.960425 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:54:08.960425 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:54:08.960425 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:54:08.960425 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:54:08.960425 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:54:08.960425 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:54:08.960425 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:54:08.960425 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:54:08.960425 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:54:08.960425 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:54:08.960425 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75061d5c-d642-48c4-8b19-b9252812b2cc could not be found. Oct 04 21:54:08.960425 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:54:08.960425 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:54:08.960425 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:54:08.960425 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:54:08.960425 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:54:08.960425 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:54:08.960425 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:54:08.960425 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:54:08.960425 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:54:08.960425 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:54:08.960425 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:54:08.960425 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:54:08.960425 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:54:08.960425 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:54:08.960425 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:54:08.960425 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:54:08.960425 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75061d5c-d642-48c4-8b19-b9252812b2cc could not be found. Oct 04 21:54:08.960425 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:54:08.960425 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:54:08.976103 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:54:08.976103 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:54:08.976103 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:54:08.976103 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:54:08.976103 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:54:08.976103 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:54:08.976103 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75061d5c-d642-48c4-8b19-b9252812b2cc could not be found. Oct 04 21:54:08.976103 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:54:08.976103 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-02eedf05-7df4-4df5-80bd-2bd5d349f917 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Returning 404 to user: Instance 75061d5c-d642-48c4-8b19-b9252812b2cc could not be found. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:54:08.976103 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-02eedf05-7df4-4df5-80bd-2bd5d349f917 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] 10.222.0.43 "GET /compute/v2.1/servers/75061d5c-d642-48c4-8b19-b9252812b2cc" status: 404 len: 111 microversion: 2.1 time: 0.075381 Oct 04 21:54:08.976103 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1276/2471] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:54:08 2022] GET /compute/v2.1/servers/75061d5c-d642-48c4-8b19-b9252812b2cc => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:54:08.981850 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-e0a998c5-1289-4610-8421-bf7e7f42a543 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:08.985001 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-e0a998c5-1289-4610-8421-bf7e7f42a543 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] [instance: 12f775af-b918-467b-a6d1-3ca8a7957f37] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:08.997697 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e0a998c5-1289-4610-8421-bf7e7f42a543 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:08.998448 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e0a998c5-1289-4610-8421-bf7e7f42a543 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:08.999049 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e0a998c5-1289-4610-8421-bf7e7f42a543 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:08.999634 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e0a998c5-1289-4610-8421-bf7e7f42a543 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:09.000147 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e0a998c5-1289-4610-8421-bf7e7f42a543 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:09.000914 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e0a998c5-1289-4610-8421-bf7e7f42a543 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:09.015479 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-6c801499-a361-40a7-a3f1-7ed86dd9a52b tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] 10.222.0.43 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.43%2Fcompute%2Fv2.1%2Fservers%2F7d0ed6d0-981a-48a7-a676-5910b1257301" status: 200 len: 484 microversion: 2.1 time: 0.094404 Oct 04 21:54:09.016708 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1196/2472] 10.222.0.43 () {58 vars in 1317 bytes} [Tue Oct 4 21:54:08 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.43%2Fcompute%2Fv2.1%2Fservers%2F7d0ed6d0-981a-48a7-a676-5910b1257301 => generated 484 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:54:09.023150 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-e0a998c5-1289-4610-8421-bf7e7f42a543 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] HTTP exception thrown: Instance 12f775af-b918-467b-a6d1-3ca8a7957f37 could not be found. Oct 04 21:54:09.026837 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-e0a998c5-1289-4610-8421-bf7e7f42a543 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Request method failure captured: Oct 04 21:54:09.026837 n-d-860284-1 devstack@n-api.service[134102]: request: GET /compute/v2.1/servers/12f775af-b918-467b-a6d1-3ca8a7957f37 HTTP/1.1 Oct 04 21:54:09.026837 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 21:54:09.026837 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 21:54:09.026837 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 21:54:09.026837 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 21:54:09.026837 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 21:54:09.026837 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 21:54:09.026837 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 21:54:09.026837 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 21:54:09.026837 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPKtD8tW6r1XpqIR5pzjO07FOJSn-VfYbZy21TQA3uSwCHlUYadhC1qn1i9q8TReiVykhcj_LcTzvxccj4TlBUnGJgCer8k2_7vdW7V9qfXRiLtbrjmaVq2juzQhHiH65IW7fAeWNQr2oOshFXph7O4U8TUbgXX2MigXDDhpQwtGXHPQ Oct 04 21:54:09.026837 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 21:54:09.026837 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 21:54:09.026837 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 21:54:09.026837 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 21:54:09.026837 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 21:54:09.026837 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 21:54:09.026837 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: 2865c04294884d1081c9b1b6fc8f8e09 Oct 04 21:54:09.026837 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-ListServersNegativeTestJSON-201044971 Oct 04 21:54:09.026837 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 21:54:09.026837 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 21:54:09.026837 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/2865c04294884d1081c9b1b6fc8f8e09"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_2865c04294884d1081c9b1b6fc8f8e09", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/2865c04294884d1081c9b1b6fc8f8e09"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/2865c04294884d1081c9b1b6fc8f8e09"}]}] Oct 04 21:54:09.026837 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-ListServersNegativeTestJSON-201044971 Oct 04 21:54:09.026837 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: 2865c04294884d1081c9b1b6fc8f8e09 Oct 04 21:54:09.026837 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-201044971 Oct 04 21:54:09.026837 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-ListServersNegativeTestJSON-201044971-project Oct 04 21:54:09.026837 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 21:54:09.026837 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 21:54:09.026837 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: 927913a1e0cc4d74b42cb209ec932286 Oct 04 21:54:09.026837 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-ListServersNegativeTestJSON-201044971-project Oct 04 21:54:09.026837 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 21:54:09.026837 n-d-860284-1 devstack@n-api.service[134102]: exception: Instance 12f775af-b918-467b-a6d1-3ca8a7957f37 could not be found. Oct 04 21:54:09.026837 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': '12f775af-b918-467b-a6d1-3ca8a7957f37'} Oct 04 21:54:09.026837 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:54:09.026837 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:54:09.026837 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:54:09.026837 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:54:09.026837 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:54:09.026837 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:54:09.026837 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:54:09.026837 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:54:09.026837 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:54:09.026837 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:54:09.026837 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 12f775af-b918-467b-a6d1-3ca8a7957f37 could not be found. Oct 04 21:54:09.026837 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:54:09.026837 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:54:09.026837 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:54:09.026837 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:54:09.026837 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:54:09.026837 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:54:09.026837 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:54:09.026837 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:54:09.026837 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:54:09.026837 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:54:09.026837 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:54:09.026837 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:54:09.026837 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:54:09.026837 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:54:09.026837 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:54:09.026837 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:54:09.026837 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 12f775af-b918-467b-a6d1-3ca8a7957f37 could not be found. Oct 04 21:54:09.026837 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:54:09.026837 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:54:09.030981 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:54:09.030981 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:54:09.030981 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:54:09.030981 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:54:09.030981 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:54:09.030981 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:54:09.030981 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 12f775af-b918-467b-a6d1-3ca8a7957f37 could not be found. Oct 04 21:54:09.030981 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:54:09.030981 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-e0a998c5-1289-4610-8421-bf7e7f42a543 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] Returning 404 to user: Instance 12f775af-b918-467b-a6d1-3ca8a7957f37 could not be found. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:54:09.030981 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-e0a998c5-1289-4610-8421-bf7e7f42a543 tempest-ListServersNegativeTestJSON-201044971 tempest-ListServersNegativeTestJSON-201044971-project] 10.222.0.43 "GET /compute/v2.1/servers/12f775af-b918-467b-a6d1-3ca8a7957f37" status: 404 len: 111 microversion: 2.1 time: 0.058105 Oct 04 21:54:09.030981 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1277/2473] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:54:08 2022] GET /compute/v2.1/servers/12f775af-b918-467b-a6d1-3ca8a7957f37 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:54:09.040222 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-193fbee1-d254-42ad-bc80-fec8ad69a10c tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Calling method '.version_select at 0x7fbb2f234820>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:09.109106 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-193fbee1-d254-42ad-bc80-fec8ad69a10c tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] 10.222.0.43 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.43%2Fcompute%2Fservers%2F7d0ed6d0-981a-48a7-a676-5910b1257301" status: 200 len: 484 microversion: 2.1 time: 0.074611 Oct 04 21:54:09.109877 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1197/2474] 10.222.0.43 () {58 vars in 1303 bytes} [Tue Oct 4 21:54:09 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.43%2Fcompute%2Fservers%2F7d0ed6d0-981a-48a7-a676-5910b1257301 => generated 484 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:54:09.127968 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-f9787381-7e94-44d9-8e90-0739604c7b06 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Calling method '.version_select at 0x7fbb2efd2280>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:09.313935 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-145758e5-aeb5-4176-9ce2-2302d05f9cc5 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:09.315555 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-145758e5-aeb5-4176-9ce2-2302d05f9cc5 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] [instance: 830de6ad-adc6-4d16-ae9d-a29ae85e6cd2] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:09.323361 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-145758e5-aeb5-4176-9ce2-2302d05f9cc5 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:09.324111 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-145758e5-aeb5-4176-9ce2-2302d05f9cc5 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:09.324720 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-145758e5-aeb5-4176-9ce2-2302d05f9cc5 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:09.325792 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-145758e5-aeb5-4176-9ce2-2302d05f9cc5 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:09.326702 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-145758e5-aeb5-4176-9ce2-2302d05f9cc5 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:09.327307 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-145758e5-aeb5-4176-9ce2-2302d05f9cc5 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:09.364846 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-f9787381-7e94-44d9-8e90-0739604c7b06 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] 10.222.0.43 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3281 microversion: 2.1 time: 0.240527 Oct 04 21:54:09.365935 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1278/2475] 10.222.0.43 () {58 vars in 1149 bytes} [Tue Oct 4 21:54:09 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3281 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:54:09.384366 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-e1905c90-e775-4e49-a5c1-02dac0ea2b85 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Calling method '.version_select at 0x7fbb3494edc0>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:09.555956 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-e1905c90-e775-4e49-a5c1-02dac0ea2b85 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] 10.222.0.43 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1429 microversion: 2.1 time: 0.176875 Oct 04 21:54:09.557030 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1279/2476] 10.222.0.43 () {58 vars in 1149 bytes} [Tue Oct 4 21:54:09 2022] GET /compute/v2.1/images?type=snapshot => generated 1429 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:54:09.564743 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-1022e81b-255a-4f7b-8933-e7f57a763b8a tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:09.565603 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-1022e81b-255a-4f7b-8933-e7f57a763b8a tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] [instance: 659208f3-1bef-41f7-9616-50c2db9f46ba] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:09.574780 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1022e81b-255a-4f7b-8933-e7f57a763b8a tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:09.575786 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1022e81b-255a-4f7b-8933-e7f57a763b8a tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:09.576500 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1022e81b-255a-4f7b-8933-e7f57a763b8a tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:09.577942 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1022e81b-255a-4f7b-8933-e7f57a763b8a tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:09.578946 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1022e81b-255a-4f7b-8933-e7f57a763b8a tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:09.579647 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1022e81b-255a-4f7b-8933-e7f57a763b8a tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:09.615009 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-1022e81b-255a-4f7b-8933-e7f57a763b8a tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] HTTP exception thrown: Instance 659208f3-1bef-41f7-9616-50c2db9f46ba could not be found. Oct 04 21:54:09.616905 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-1022e81b-255a-4f7b-8933-e7f57a763b8a tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Request method failure captured: Oct 04 21:54:09.616905 n-d-860284-1 devstack@n-api.service[134102]: request: GET /compute/v2.1/servers/659208f3-1bef-41f7-9616-50c2db9f46ba HTTP/1.1 Oct 04 21:54:09.616905 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 21:54:09.616905 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 21:54:09.616905 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 21:54:09.616905 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 21:54:09.616905 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 21:54:09.616905 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 21:54:09.616905 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 21:54:09.616905 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 21:54:09.616905 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPKlMyaAXDvUTID1IzmmSywCvuysT3aI_a5P3CwNV1RlnNDYDfurU0jpixzpaKj5sOoQgCtK8oEEPLd6IixW0SOcr8dqp0RNwGHWp6j9yDPQZ2lsf_JdMcGPWfUMhVnyczlDBdJXpSneu7x_nFwY0L7QA-CqDJHoDoK7jdZ7w20lPxmA Oct 04 21:54:09.616905 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 21:54:09.616905 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 21:54:09.616905 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 21:54:09.616905 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 21:54:09.616905 n-d-860284-1 devstack@n-api.service[134102]: X-Openstack-Nova-Api-Version: 2.25 Oct 04 21:54:09.616905 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 21:54:09.616905 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 21:54:09.616905 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: f17fee483fd14b07977669df199f3018 Oct 04 21:54:09.616905 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-2121064375 Oct 04 21:54:09.616905 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 21:54:09.616905 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 21:54:09.616905 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f17fee483fd14b07977669df199f3018"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_f17fee483fd14b07977669df199f3018", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f17fee483fd14b07977669df199f3018"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/f17fee483fd14b07977669df199f3018"}]}] Oct 04 21:54:09.616905 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-2121064375 Oct 04 21:54:09.616905 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: f17fee483fd14b07977669df199f3018 Oct 04 21:54:09.616905 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-2121064375 Oct 04 21:54:09.616905 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-LiveAutoBlockMigrationV225Test-2121064375-project Oct 04 21:54:09.616905 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 21:54:09.616905 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 21:54:09.616905 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: f529f881a037459d9405bd14afd7a639 Oct 04 21:54:09.616905 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-2121064375-project Oct 04 21:54:09.616905 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 21:54:09.616905 n-d-860284-1 devstack@n-api.service[134102]: exception: Instance 659208f3-1bef-41f7-9616-50c2db9f46ba could not be found. Oct 04 21:54:09.616905 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': '659208f3-1bef-41f7-9616-50c2db9f46ba'} Oct 04 21:54:09.616905 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:54:09.616905 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:54:09.616905 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:54:09.616905 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:54:09.616905 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:54:09.616905 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:54:09.616905 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:54:09.616905 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:54:09.616905 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:54:09.616905 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:54:09.616905 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 659208f3-1bef-41f7-9616-50c2db9f46ba could not be found. Oct 04 21:54:09.616905 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:54:09.616905 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:54:09.616905 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:54:09.616905 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:54:09.616905 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:54:09.616905 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:54:09.616905 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:54:09.616905 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:54:09.616905 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:54:09.616905 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:54:09.616905 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:54:09.616905 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:54:09.616905 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:54:09.616905 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:54:09.616905 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:54:09.616905 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:54:09.616905 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 659208f3-1bef-41f7-9616-50c2db9f46ba could not be found. Oct 04 21:54:09.616905 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:54:09.623195 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:54:09.623195 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:54:09.623195 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:54:09.623195 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:54:09.623195 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:54:09.623195 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:54:09.623195 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:54:09.623195 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 659208f3-1bef-41f7-9616-50c2db9f46ba could not be found. Oct 04 21:54:09.623195 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:54:09.623195 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-1022e81b-255a-4f7b-8933-e7f57a763b8a tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] Returning 404 to user: Instance 659208f3-1bef-41f7-9616-50c2db9f46ba could not be found. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:54:09.623195 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-1022e81b-255a-4f7b-8933-e7f57a763b8a tempest-LiveAutoBlockMigrationV225Test-2121064375 tempest-LiveAutoBlockMigrationV225Test-2121064375-project] 10.222.0.43 "GET /compute/v2.1/servers/659208f3-1bef-41f7-9616-50c2db9f46ba" status: 404 len: 111 microversion: 2.25 time: 0.060447 Oct 04 21:54:09.623195 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1280/2477] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:54:09 2022] GET /compute/v2.1/servers/659208f3-1bef-41f7-9616-50c2db9f46ba => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 21:54:09.643084 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-2e1e8259-981c-409c-b5b8-b81ce0f399dd tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Calling method '.version_select at 0x7fbb2f0730d0>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:09.760532 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-2e1e8259-981c-409c-b5b8-b81ce0f399dd tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] 10.222.0.43 "GET /compute/v2.1/images?limit=1" status: 200 len: 622 microversion: 2.1 time: 0.139882 Oct 04 21:54:09.764834 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1281/2478] 10.222.0.43 () {58 vars in 1137 bytes} [Tue Oct 4 21:54:09 2022] GET /compute/v2.1/images?limit=1 => generated 622 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:54:09.778863 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-ad438297-7b7a-4717-ad92-25f701bc70f4 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:09.779991 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-ad438297-7b7a-4717-ad92-25f701bc70f4 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 152003e4-2a7b-4801-8656-73093cd566ed] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:09.780160 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-145758e5-aeb5-4176-9ce2-2302d05f9cc5 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:09.797154 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-145758e5-aeb5-4176-9ce2-2302d05f9cc5 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:09.798783 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-145758e5-aeb5-4176-9ce2-2302d05f9cc5 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:09.799466 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ad438297-7b7a-4717-ad92-25f701bc70f4 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:09.799984 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ad438297-7b7a-4717-ad92-25f701bc70f4 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:09.802473 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ad438297-7b7a-4717-ad92-25f701bc70f4 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:09.803304 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ad438297-7b7a-4717-ad92-25f701bc70f4 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:09.803787 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ad438297-7b7a-4717-ad92-25f701bc70f4 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:09.804220 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ad438297-7b7a-4717-ad92-25f701bc70f4 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:09.808301 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-145758e5-aeb5-4176-9ce2-2302d05f9cc5 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] 10.222.0.43 "GET /compute/v2.1/servers/830de6ad-adc6-4d16-ae9d-a29ae85e6cd2" status: 200 len: 1874 microversion: 2.42 time: 0.493027 Oct 04 21:54:09.809376 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1198/2479] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:54:09 2022] GET /compute/v2.1/servers/830de6ad-adc6-4d16-ae9d-a29ae85e6cd2 => generated 1874 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:54:09.814771 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-a9777b1e-240a-4532-879e-e24839a8bc38 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Calling method '.version_select at 0x7fbb2f234ca0>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:10.008050 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-ad438297-7b7a-4717-ad92-25f701bc70f4 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ad048becf474fb972d4291422d810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dcfc7024fc49388c4bd5f25f03e60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:10.026186 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-a9777b1e-240a-4532-879e-e24839a8bc38 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] 10.222.0.43 "GET /compute/v2.1/images/detail?changes-since=2022-10-04T21%3A50%3A54Z" status: 200 len: 6334 microversion: 2.1 time: 0.215222 Oct 04 21:54:10.029514 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1199/2480] 10.222.0.43 () {58 vars in 1220 bytes} [Tue Oct 4 21:54:09 2022] GET /compute/v2.1/images/detail?changes-since=2022-10-04T21%3A50%3A54Z => generated 6334 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:54:10.035286 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-d6518474-60fa-4cd1-91ed-f1feee3d7754 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:10.036904 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-d6518474-60fa-4cd1-91ed-f1feee3d7754 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] [instance: eb6e098d-966d-478b-a69c-3746584e5509] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:10.057490 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-ad438297-7b7a-4717-ad92-25f701bc70f4 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/152003e4-2a7b-4801-8656-73093cd566ed" status: 200 len: 1183 microversion: 2.1 time: 0.288762 Oct 04 21:54:10.066421 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1282/2481] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:54:09 2022] GET /compute/v2.1/servers/152003e4-2a7b-4801-8656-73093cd566ed => generated 1183 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:54:10.073572 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d6518474-60fa-4cd1-91ed-f1feee3d7754 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:10.074096 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d6518474-60fa-4cd1-91ed-f1feee3d7754 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:10.074590 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d6518474-60fa-4cd1-91ed-f1feee3d7754 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:10.075323 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d6518474-60fa-4cd1-91ed-f1feee3d7754 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:10.075782 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d6518474-60fa-4cd1-91ed-f1feee3d7754 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:10.076213 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d6518474-60fa-4cd1-91ed-f1feee3d7754 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:10.077745 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-98e8a8d1-f3bc-4483-97c1-a760e38d01e0 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Calling method '.version_select at 0x7fbb37280dc0>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:10.254438 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-98e8a8d1-f3bc-4483-97c1-a760e38d01e0 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] 10.222.0.43 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1275467888" status: 200 len: 665 microversion: 2.1 time: 0.185126 Oct 04 21:54:10.256037 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1283/2482] 10.222.0.43 () {58 vars in 1252 bytes} [Tue Oct 4 21:54:10 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1275467888 => generated 665 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:54:10.295751 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-4f111110-e365-452f-afc8-1997471c5597 req-70ca23fc-09e5-42d3-b7f9-ea6c25146d81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12f775af-b918-467b-a6d1-3ca8a7957f37", "name": "network-vif-deleted", "tag": "f26bd1ab-0812-4c55-bd30-aafbfbf55ec2"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:54:10.329257 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-4f111110-e365-452f-afc8-1997471c5597 req-70ca23fc-09e5-42d3-b7f9-ea6c25146d81 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:10.332444 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-4f111110-e365-452f-afc8-1997471c5597 req-70ca23fc-09e5-42d3-b7f9-ea6c25146d81 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:10.333187 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-4f111110-e365-452f-afc8-1997471c5597 req-70ca23fc-09e5-42d3-b7f9-ea6c25146d81 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:10.365986 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-4f111110-e365-452f-afc8-1997471c5597 req-70ca23fc-09e5-42d3-b7f9-ea6c25146d81 service nova] Creating event network-vif-deleted:f26bd1ab-0812-4c55-bd30-aafbfbf55ec2 for instance 12f775af-b918-467b-a6d1-3ca8a7957f37 on n-h1-860284-1 Oct 04 21:54:10.380096 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-4f111110-e365-452f-afc8-1997471c5597 req-70ca23fc-09e5-42d3-b7f9-ea6c25146d81 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107670 Oct 04 21:54:10.380917 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1284/2483] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:54:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:54:10.389355 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-77cdafc5-45a4-4583-a313-402e19fef18d tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Calling method '.version_select at 0x7fbb37280dc0>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:10.450474 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell0:SELECT=4 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:54:10.466486 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-d6518474-60fa-4cd1-91ed-f1feee3d7754 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47fbc4a6920d451cb1a2ad170de04921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43659cf5fed541e8883664bf17aced70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:10.478239 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-d6518474-60fa-4cd1-91ed-f1feee3d7754 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] 10.222.0.43 "GET /compute/v2.1/servers/eb6e098d-966d-478b-a69c-3746584e5509" status: 200 len: 1506 microversion: 2.1 time: 0.447170 Oct 04 21:54:10.481686 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1200/2484] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:54:10 2022] GET /compute/v2.1/servers/eb6e098d-966d-478b-a69c-3746584e5509 => generated 1506 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:54:10.503255 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-93b735b7-acc4-4516-8e1e-678ac58eec08 req-1d2b1b89-6b1a-4a30-b37c-60e18ca987f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "152003e4-2a7b-4801-8656-73093cd566ed", "name": "network-vif-deleted", "tag": "eefc2731-0f05-444f-9e84-6aab2807b291"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:54:10.533962 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-93b735b7-acc4-4516-8e1e-678ac58eec08 req-1d2b1b89-6b1a-4a30-b37c-60e18ca987f5 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:10.534673 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-93b735b7-acc4-4516-8e1e-678ac58eec08 req-1d2b1b89-6b1a-4a30-b37c-60e18ca987f5 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:10.535228 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-93b735b7-acc4-4516-8e1e-678ac58eec08 req-1d2b1b89-6b1a-4a30-b37c-60e18ca987f5 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:10.559195 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-77cdafc5-45a4-4583-a313-402e19fef18d tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] 10.222.0.43 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.43%2Fcompute%2Fv2.1%2Fservers%2F7d0ed6d0-981a-48a7-a676-5910b1257301" status: 200 len: 1466 microversion: 2.1 time: 0.176502 Oct 04 21:54:10.577265 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1285/2485] 10.222.0.43 () {58 vars in 1338 bytes} [Tue Oct 4 21:54:10 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.43%2Fcompute%2Fv2.1%2Fservers%2F7d0ed6d0-981a-48a7-a676-5910b1257301 => generated 1466 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:54:10.586662 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-93b735b7-acc4-4516-8e1e-678ac58eec08 req-1d2b1b89-6b1a-4a30-b37c-60e18ca987f5 service nova] Creating event network-vif-deleted:eefc2731-0f05-444f-9e84-6aab2807b291 for instance 152003e4-2a7b-4801-8656-73093cd566ed on n-h2-860284-1 Oct 04 21:54:10.597257 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-a69bafff-5b8c-4e75-abb0-2cb9a4a2ea5a tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Calling method '.version_select at 0x7fbb2e9b2ee0>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:10.613882 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-93b735b7-acc4-4516-8e1e-678ac58eec08 req-1d2b1b89-6b1a-4a30-b37c-60e18ca987f5 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104710 Oct 04 21:54:10.616465 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1201/2486] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:54:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:54:10.622131 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell0:SELECT=2 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:54:10.717466 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-a69bafff-5b8c-4e75-abb0-2cb9a4a2ea5a tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] 10.222.0.43 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.43%2Fcompute%2Fservers%2F7d0ed6d0-981a-48a7-a676-5910b1257301" status: 200 len: 1466 microversion: 2.1 time: 0.137589 Oct 04 21:54:10.729256 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1286/2487] 10.222.0.43 () {58 vars in 1324 bytes} [Tue Oct 4 21:54:10 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.43%2Fcompute%2Fservers%2F7d0ed6d0-981a-48a7-a676-5910b1257301 => generated 1466 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:54:10.739547 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-5f7ae1c7-27f6-4658-88bf-e3dd488fb5a7 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Calling method '.version_select at 0x7fbb2f1fa430>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:10.845976 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-eebd3904-9184-4579-a241-d16d850973fe tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:10.847324 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-eebd3904-9184-4579-a241-d16d850973fe tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] [instance: 830de6ad-adc6-4d16-ae9d-a29ae85e6cd2] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:10.862242 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-eebd3904-9184-4579-a241-d16d850973fe tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:10.864742 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-eebd3904-9184-4579-a241-d16d850973fe tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:10.866831 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-eebd3904-9184-4579-a241-d16d850973fe tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:10.869605 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-eebd3904-9184-4579-a241-d16d850973fe tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:10.872315 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-eebd3904-9184-4579-a241-d16d850973fe tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:10.873047 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-eebd3904-9184-4579-a241-d16d850973fe tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:10.911142 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-5f7ae1c7-27f6-4658-88bf-e3dd488fb5a7 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] 10.222.0.43 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7109 microversion: 2.1 time: 0.175487 Oct 04 21:54:10.912271 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1202/2488] 10.222.0.43 () {58 vars in 1170 bytes} [Tue Oct 4 21:54:10 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7109 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:54:10.938540 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-8a043750-4160-4b20-8869-5752db863301 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Calling method '.version_select at 0x7fbb2f1fa940>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:11.045771 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-8a043750-4160-4b20-8869-5752db863301 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] 10.222.0.43 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4375 microversion: 2.1 time: 0.111325 Oct 04 21:54:11.051308 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1203/2489] 10.222.0.43 () {58 vars in 1170 bytes} [Tue Oct 4 21:54:10 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4375 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:54:11.069331 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-9d5298b2-ce60-4d3c-93db-8bfa98f4d117 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Calling method '.version_select at 0x7fbb2f3991f0>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:11.122114 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-9d5298b2-ce60-4d3c-93db-8bfa98f4d117 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] 10.222.0.43 "GET /compute/v2.1/images/58548514-5dac-426c-81f5-19e3fba33e23" status: 200 len: 784 microversion: 2.1 time: 0.057463 Oct 04 21:54:11.123653 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1204/2490] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:54:11 2022] GET /compute/v2.1/images/58548514-5dac-426c-81f5-19e3fba33e23 => generated 784 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:54:11.140036 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-c9e446c6-802c-426e-ae4c-27fe4a4564af tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:11.141781 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-c9e446c6-802c-426e-ae4c-27fe4a4564af tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 152003e4-2a7b-4801-8656-73093cd566ed] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:11.157613 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c9e446c6-802c-426e-ae4c-27fe4a4564af tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:11.158466 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c9e446c6-802c-426e-ae4c-27fe4a4564af tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:11.159172 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c9e446c6-802c-426e-ae4c-27fe4a4564af tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:11.160318 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c9e446c6-802c-426e-ae4c-27fe4a4564af tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:11.161045 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c9e446c6-802c-426e-ae4c-27fe4a4564af tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:11.161844 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c9e446c6-802c-426e-ae4c-27fe4a4564af tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:11.195093 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:54:11.933283 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-c9e446c6-802c-426e-ae4c-27fe4a4564af tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ad048becf474fb972d4291422d810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dcfc7024fc49388c4bd5f25f03e60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:11.946610 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-c9e446c6-802c-426e-ae4c-27fe4a4564af tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/152003e4-2a7b-4801-8656-73093cd566ed" status: 200 len: 1183 microversion: 2.1 time: 0.810447 Oct 04 21:54:11.947218 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1205/2491] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:54:11 2022] GET /compute/v2.1/servers/152003e4-2a7b-4801-8656-73093cd566ed => generated 1183 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:54:11.964928 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-97f09788-d962-4067-9990-c3a2daca7b55 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Calling method '.version_select at 0x7fbb2e5c4310>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:12.073320 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-97f09788-d962-4067-9990-c3a2daca7b55 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] 10.222.0.43 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1611 microversion: 2.1 time: 0.124989 Oct 04 21:54:12.073927 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1206/2492] 10.222.0.43 () {58 vars in 1158 bytes} [Tue Oct 4 21:54:11 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1611 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:54:12.077560 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-eebd3904-9184-4579-a241-d16d850973fe tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:12.096969 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-403290e4-765c-4375-a645-44c03e9293a9 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:12.097811 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-403290e4-765c-4375-a645-44c03e9293a9 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] [instance: eb6e098d-966d-478b-a69c-3746584e5509] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:12.098284 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-eebd3904-9184-4579-a241-d16d850973fe tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:12.105648 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-403290e4-765c-4375-a645-44c03e9293a9 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:12.106437 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-403290e4-765c-4375-a645-44c03e9293a9 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:12.107051 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-403290e4-765c-4375-a645-44c03e9293a9 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:12.107969 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-403290e4-765c-4375-a645-44c03e9293a9 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:12.108179 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-eebd3904-9184-4579-a241-d16d850973fe tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:12.108765 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-403290e4-765c-4375-a645-44c03e9293a9 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:12.109357 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-403290e4-765c-4375-a645-44c03e9293a9 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:12.109832 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-eebd3904-9184-4579-a241-d16d850973fe tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] 10.222.0.43 "GET /compute/v2.1/servers/830de6ad-adc6-4d16-ae9d-a29ae85e6cd2" status: 200 len: 1874 microversion: 2.42 time: 1.268585 Oct 04 21:54:12.114397 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1287/2493] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:54:10 2022] GET /compute/v2.1/servers/830de6ad-adc6-4d16-ae9d-a29ae85e6cd2 => generated 1874 bytes in 1274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:54:12.119833 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-d33870b7-db9c-4595-b3f3-234c8516f5db tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Calling method '.version_select at 0x7fbb2e9b2e50>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:12.245099 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=10 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:54:12.415146 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-403290e4-765c-4375-a645-44c03e9293a9 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47fbc4a6920d451cb1a2ad170de04921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43659cf5fed541e8883664bf17aced70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:12.427869 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-403290e4-765c-4375-a645-44c03e9293a9 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] 10.222.0.43 "GET /compute/v2.1/servers/eb6e098d-966d-478b-a69c-3746584e5509" status: 200 len: 1506 microversion: 2.1 time: 0.335677 Oct 04 21:54:12.430506 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1207/2494] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:54:12 2022] GET /compute/v2.1/servers/eb6e098d-966d-478b-a69c-3746584e5509 => generated 1506 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:54:12.971958 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-5519f2da-3306-4858-8a3b-c214490f1090 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:12.973287 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-5519f2da-3306-4858-8a3b-c214490f1090 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 152003e4-2a7b-4801-8656-73093cd566ed] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:12.976561 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:54:12.986321 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5519f2da-3306-4858-8a3b-c214490f1090 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:12.986864 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5519f2da-3306-4858-8a3b-c214490f1090 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:12.987326 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5519f2da-3306-4858-8a3b-c214490f1090 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:12.988023 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5519f2da-3306-4858-8a3b-c214490f1090 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:12.999475 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5519f2da-3306-4858-8a3b-c214490f1090 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:13.000200 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5519f2da-3306-4858-8a3b-c214490f1090 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:13.052430 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-d33870b7-db9c-4595-b3f3-234c8516f5db tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] 10.222.0.43 "DELETE /compute/v2.1/images/5157f1c6-d263-427d-84cc-3320cbd286d5" status: 204 len: 0 microversion: 2.1 time: 0.936570 Oct 04 21:54:13.056964 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1288/2495] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:54:12 2022] DELETE /compute/v2.1/images/5157f1c6-d263-427d-84cc-3320cbd286d5 => generated 0 bytes in 938 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:54:13.075723 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-c696c7a9-55b6-4eec-b8c5-49cce3971c8c tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Calling method '.version_select at 0x7fbb2e84ed30>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:13.512920 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-5519f2da-3306-4858-8a3b-c214490f1090 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ad048becf474fb972d4291422d810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dcfc7024fc49388c4bd5f25f03e60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:13.535466 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-5519f2da-3306-4858-8a3b-c214490f1090 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/152003e4-2a7b-4801-8656-73093cd566ed" status: 200 len: 1183 microversion: 2.1 time: 0.567737 Oct 04 21:54:13.536446 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1208/2496] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:54:12 2022] GET /compute/v2.1/servers/152003e4-2a7b-4801-8656-73093cd566ed => generated 1183 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:54:13.547383 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-8556e5a2-339f-464a-bb7a-efc13c802bc8 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:13.548017 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-8556e5a2-339f-464a-bb7a-efc13c802bc8 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] [instance: 830de6ad-adc6-4d16-ae9d-a29ae85e6cd2] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:13.563295 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8556e5a2-339f-464a-bb7a-efc13c802bc8 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:13.563818 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8556e5a2-339f-464a-bb7a-efc13c802bc8 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:13.564299 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8556e5a2-339f-464a-bb7a-efc13c802bc8 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:13.565022 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8556e5a2-339f-464a-bb7a-efc13c802bc8 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:13.565476 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8556e5a2-339f-464a-bb7a-efc13c802bc8 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:13.566655 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8556e5a2-339f-464a-bb7a-efc13c802bc8 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:13.867200 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-c696c7a9-55b6-4eec-b8c5-49cce3971c8c tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] 10.222.0.43 "DELETE /compute/v2.1/images/147c04e5-7d17-4421-8f9d-3336bdcbaf2e" status: 204 len: 0 microversion: 2.1 time: 0.808828 Oct 04 21:54:13.874425 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1289/2497] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:54:13 2022] DELETE /compute/v2.1/images/147c04e5-7d17-4421-8f9d-3336bdcbaf2e => generated 0 bytes in 811 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:54:13.880711 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-151b47d8-7b3d-4088-bf3e-ab094ce76b72 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:13.881349 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-151b47d8-7b3d-4088-bf3e-ab094ce76b72 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] [instance: eb6e098d-966d-478b-a69c-3746584e5509] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:13.893160 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-151b47d8-7b3d-4088-bf3e-ab094ce76b72 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:13.893722 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-151b47d8-7b3d-4088-bf3e-ab094ce76b72 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:13.894801 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-151b47d8-7b3d-4088-bf3e-ab094ce76b72 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:13.896262 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-151b47d8-7b3d-4088-bf3e-ab094ce76b72 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:13.897232 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-151b47d8-7b3d-4088-bf3e-ab094ce76b72 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:13.897832 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-151b47d8-7b3d-4088-bf3e-ab094ce76b72 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:14.570573 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-8556e5a2-339f-464a-bb7a-efc13c802bc8 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:14.587853 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-8556e5a2-339f-464a-bb7a-efc13c802bc8 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:14.595980 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-8556e5a2-339f-464a-bb7a-efc13c802bc8 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:14.597238 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-8556e5a2-339f-464a-bb7a-efc13c802bc8 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] 10.222.0.43 "GET /compute/v2.1/servers/830de6ad-adc6-4d16-ae9d-a29ae85e6cd2" status: 200 len: 1874 microversion: 2.42 time: 1.059739 Oct 04 21:54:14.611186 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1209/2498] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:54:13 2022] GET /compute/v2.1/servers/830de6ad-adc6-4d16-ae9d-a29ae85e6cd2 => generated 1874 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:54:14.639628 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-9d4af66c-9ed2-472d-96f2-0f5a7c38ee94 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Calling method '.version_select at 0x7fbb2ef750d0>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:14.727096 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-151b47d8-7b3d-4088-bf3e-ab094ce76b72 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47fbc4a6920d451cb1a2ad170de04921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43659cf5fed541e8883664bf17aced70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:14.738638 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-151b47d8-7b3d-4088-bf3e-ab094ce76b72 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] 10.222.0.43 "GET /compute/v2.1/servers/eb6e098d-966d-478b-a69c-3746584e5509" status: 200 len: 1506 microversion: 2.1 time: 0.862580 Oct 04 21:54:14.741534 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1290/2499] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:54:13 2022] GET /compute/v2.1/servers/eb6e098d-966d-478b-a69c-3746584e5509 => generated 1506 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:54:14.778654 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-dd89c21a-8a84-4ee5-8c42-720a1c758fe9 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:14.779277 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-dd89c21a-8a84-4ee5-8c42-720a1c758fe9 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 152003e4-2a7b-4801-8656-73093cd566ed] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:14.791129 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dd89c21a-8a84-4ee5-8c42-720a1c758fe9 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:14.792015 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dd89c21a-8a84-4ee5-8c42-720a1c758fe9 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:14.792798 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dd89c21a-8a84-4ee5-8c42-720a1c758fe9 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:14.793770 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dd89c21a-8a84-4ee5-8c42-720a1c758fe9 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:14.794427 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dd89c21a-8a84-4ee5-8c42-720a1c758fe9 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:14.795014 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dd89c21a-8a84-4ee5-8c42-720a1c758fe9 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:15.372907 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-dd89c21a-8a84-4ee5-8c42-720a1c758fe9 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ad048becf474fb972d4291422d810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dcfc7024fc49388c4bd5f25f03e60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:15.393687 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-dd89c21a-8a84-4ee5-8c42-720a1c758fe9 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/152003e4-2a7b-4801-8656-73093cd566ed" status: 200 len: 1183 microversion: 2.1 time: 0.624894 Oct 04 21:54:15.397958 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1291/2500] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:54:14 2022] GET /compute/v2.1/servers/152003e4-2a7b-4801-8656-73093cd566ed => generated 1183 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:54:15.564236 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-9d4af66c-9ed2-472d-96f2-0f5a7c38ee94 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] 10.222.0.43 "DELETE /compute/v2.1/images/e62b2cc2-812b-4ec4-bba4-5703d4b65e48" status: 204 len: 0 microversion: 2.1 time: 0.950011 Oct 04 21:54:15.568309 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1210/2501] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:54:14 2022] DELETE /compute/v2.1/images/e62b2cc2-812b-4ec4-bba4-5703d4b65e48 => generated 0 bytes in 953 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:54:15.575315 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-891f1acc-c926-4d71-b302-3baf86689bcc tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:15.575826 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-891f1acc-c926-4d71-b302-3baf86689bcc tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] [instance: 7d0ed6d0-981a-48a7-a676-5910b1257301] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:15.583554 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-891f1acc-c926-4d71-b302-3baf86689bcc tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:15.584330 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-891f1acc-c926-4d71-b302-3baf86689bcc tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:15.584840 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-891f1acc-c926-4d71-b302-3baf86689bcc tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:15.585568 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-891f1acc-c926-4d71-b302-3baf86689bcc tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:15.586136 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-891f1acc-c926-4d71-b302-3baf86689bcc tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:15.587041 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-891f1acc-c926-4d71-b302-3baf86689bcc tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:15.626079 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-891f1acc-c926-4d71-b302-3baf86689bcc tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] [instance: 7d0ed6d0-981a-48a7-a676-5910b1257301] Going to try to terminate instance {{(pid=134102) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:54:15.627625 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-f411e0ac-8e2c-43ee-9a89-5a415967efff tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:15.628257 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-f411e0ac-8e2c-43ee-9a89-5a415967efff tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] [instance: 830de6ad-adc6-4d16-ae9d-a29ae85e6cd2] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:15.638326 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f411e0ac-8e2c-43ee-9a89-5a415967efff tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:15.638946 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f411e0ac-8e2c-43ee-9a89-5a415967efff tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:15.643132 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f411e0ac-8e2c-43ee-9a89-5a415967efff tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:15.643936 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f411e0ac-8e2c-43ee-9a89-5a415967efff tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:15.648515 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f411e0ac-8e2c-43ee-9a89-5a415967efff tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:15.649139 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f411e0ac-8e2c-43ee-9a89-5a415967efff tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:15.805656 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-891f1acc-c926-4d71-b302-3baf86689bcc tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] 10.222.0.43 "DELETE /compute/v2.1/servers/7d0ed6d0-981a-48a7-a676-5910b1257301" status: 204 len: 0 microversion: 2.1 time: 0.234263 Oct 04 21:54:15.806993 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1292/2502] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 21:54:15 2022] DELETE /compute/v2.1/servers/7d0ed6d0-981a-48a7-a676-5910b1257301 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:54:15.824247 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-004c75f9-d3a2-4a0d-838f-06197328fbe1 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:15.827050 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-004c75f9-d3a2-4a0d-838f-06197328fbe1 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] [instance: eb6e098d-966d-478b-a69c-3746584e5509] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:15.844701 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-004c75f9-d3a2-4a0d-838f-06197328fbe1 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:15.845450 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-004c75f9-d3a2-4a0d-838f-06197328fbe1 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:15.846077 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-004c75f9-d3a2-4a0d-838f-06197328fbe1 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:15.847187 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-004c75f9-d3a2-4a0d-838f-06197328fbe1 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:15.854762 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-004c75f9-d3a2-4a0d-838f-06197328fbe1 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:15.855512 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-004c75f9-d3a2-4a0d-838f-06197328fbe1 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:16.986635 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-004c75f9-d3a2-4a0d-838f-06197328fbe1 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47fbc4a6920d451cb1a2ad170de04921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43659cf5fed541e8883664bf17aced70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:17.011299 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-004c75f9-d3a2-4a0d-838f-06197328fbe1 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] 10.222.0.43 "GET /compute/v2.1/servers/eb6e098d-966d-478b-a69c-3746584e5509" status: 200 len: 1506 microversion: 2.1 time: 1.198904 Oct 04 21:54:17.012942 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1293/2503] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:54:15 2022] GET /compute/v2.1/servers/eb6e098d-966d-478b-a69c-3746584e5509 => generated 1506 bytes in 1205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:54:17.022309 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-09936c2b-b121-455e-b9c0-3f16ed890be7 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:17.023382 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-09936c2b-b121-455e-b9c0-3f16ed890be7 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] [instance: 7d0ed6d0-981a-48a7-a676-5910b1257301] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:17.050927 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-09936c2b-b121-455e-b9c0-3f16ed890be7 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:17.052753 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-09936c2b-b121-455e-b9c0-3f16ed890be7 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:17.054181 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-09936c2b-b121-455e-b9c0-3f16ed890be7 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:17.055132 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-09936c2b-b121-455e-b9c0-3f16ed890be7 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:17.058048 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-09936c2b-b121-455e-b9c0-3f16ed890be7 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:17.058886 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-09936c2b-b121-455e-b9c0-3f16ed890be7 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:17.138943 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-f411e0ac-8e2c-43ee-9a89-5a415967efff tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:17.171511 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-f411e0ac-8e2c-43ee-9a89-5a415967efff tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:17.185209 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-f411e0ac-8e2c-43ee-9a89-5a415967efff tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:17.191197 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-f411e0ac-8e2c-43ee-9a89-5a415967efff tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] 10.222.0.43 "GET /compute/v2.1/servers/830de6ad-adc6-4d16-ae9d-a29ae85e6cd2" status: 200 len: 1874 microversion: 2.42 time: 1.566876 Oct 04 21:54:17.192270 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1211/2504] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:54:15 2022] GET /compute/v2.1/servers/830de6ad-adc6-4d16-ae9d-a29ae85e6cd2 => generated 1874 bytes in 1569 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:54:17.192270 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-ddf926bd-7000-41d5-9735-d38c04805206 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:17.192270 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-ddf926bd-7000-41d5-9735-d38c04805206 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 152003e4-2a7b-4801-8656-73093cd566ed] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:17.206976 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ddf926bd-7000-41d5-9735-d38c04805206 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:17.207747 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ddf926bd-7000-41d5-9735-d38c04805206 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:17.208359 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ddf926bd-7000-41d5-9735-d38c04805206 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:17.209305 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ddf926bd-7000-41d5-9735-d38c04805206 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:17.209946 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ddf926bd-7000-41d5-9735-d38c04805206 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:17.211472 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ddf926bd-7000-41d5-9735-d38c04805206 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:17.433613 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-ddf926bd-7000-41d5-9735-d38c04805206 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ad048becf474fb972d4291422d810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dcfc7024fc49388c4bd5f25f03e60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:17.452462 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-ddf926bd-7000-41d5-9735-d38c04805206 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/152003e4-2a7b-4801-8656-73093cd566ed" status: 200 len: 1183 microversion: 2.1 time: 0.252112 Oct 04 21:54:17.454068 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1212/2505] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:54:17 2022] GET /compute/v2.1/servers/152003e4-2a7b-4801-8656-73093cd566ed => generated 1183 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:54:17.541213 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-09936c2b-b121-455e-b9c0-3f16ed890be7 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f11c77afc74a16bea945dd84e72ebe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94d03be22238422eba835ed522baf9c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:17.569424 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-09936c2b-b121-455e-b9c0-3f16ed890be7 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] 10.222.0.43 "GET /compute/v2.1/servers/7d0ed6d0-981a-48a7-a676-5910b1257301" status: 200 len: 1473 microversion: 2.1 time: 0.549067 Oct 04 21:54:17.572027 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1294/2506] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:54:17 2022] GET /compute/v2.1/servers/7d0ed6d0-981a-48a7-a676-5910b1257301 => generated 1473 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:54:18.062251 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-37e7920c-2ce6-48ff-86fa-fee6296019b4 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:18.065774 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-37e7920c-2ce6-48ff-86fa-fee6296019b4 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] [instance: eb6e098d-966d-478b-a69c-3746584e5509] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:18.076279 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-37e7920c-2ce6-48ff-86fa-fee6296019b4 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:18.077203 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-37e7920c-2ce6-48ff-86fa-fee6296019b4 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:18.077869 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-37e7920c-2ce6-48ff-86fa-fee6296019b4 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:18.078931 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-37e7920c-2ce6-48ff-86fa-fee6296019b4 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:18.079605 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-37e7920c-2ce6-48ff-86fa-fee6296019b4 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:18.080502 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-37e7920c-2ce6-48ff-86fa-fee6296019b4 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:18.315145 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-545caef3-ad26-4437-b314-515def6b86e5 tempest-VolumesAdminNegativeTest-1219872418 tempest-VolumesAdminNegativeTest-1219872418-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "2747a9b0-c250-49a9-af42-94f2dc2c37d0"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:54:18.317803 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-545caef3-ad26-4437-b314-515def6b86e5 tempest-VolumesAdminNegativeTest-1219872418 tempest-VolumesAdminNegativeTest-1219872418-project-admin] [instance: 128b12e0-8fde-4113-95e9-0ecba563d8ec] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:18.333116 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-545caef3-ad26-4437-b314-515def6b86e5 tempest-VolumesAdminNegativeTest-1219872418 tempest-VolumesAdminNegativeTest-1219872418-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:18.335007 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-545caef3-ad26-4437-b314-515def6b86e5 tempest-VolumesAdminNegativeTest-1219872418 tempest-VolumesAdminNegativeTest-1219872418-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:18.336928 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-545caef3-ad26-4437-b314-515def6b86e5 tempest-VolumesAdminNegativeTest-1219872418 tempest-VolumesAdminNegativeTest-1219872418-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:18.337945 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-545caef3-ad26-4437-b314-515def6b86e5 tempest-VolumesAdminNegativeTest-1219872418 tempest-VolumesAdminNegativeTest-1219872418-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:18.338734 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-545caef3-ad26-4437-b314-515def6b86e5 tempest-VolumesAdminNegativeTest-1219872418 tempest-VolumesAdminNegativeTest-1219872418-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:18.339424 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-545caef3-ad26-4437-b314-515def6b86e5 tempest-VolumesAdminNegativeTest-1219872418 tempest-VolumesAdminNegativeTest-1219872418-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:18.580163 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-545caef3-ad26-4437-b314-515def6b86e5 tempest-VolumesAdminNegativeTest-1219872418 tempest-VolumesAdminNegativeTest-1219872418-project-admin] HTTP exception thrown: Volume 2747a9b0-c250-49a9-af42-94f2dc2c37d0 could not be found. Oct 04 21:54:18.622157 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-545caef3-ad26-4437-b314-515def6b86e5 tempest-VolumesAdminNegativeTest-1219872418 tempest-VolumesAdminNegativeTest-1219872418-project-admin] Request method failure captured: Oct 04 21:54:18.622157 n-d-860284-1 devstack@n-api.service[134101]: request: PUT /compute/v2.1/servers/128b12e0-8fde-4113-95e9-0ecba563d8ec/os-volume_attachments/c2363bfd-2097-4d53-adf1-8981fac17fc4 HTTP/1.1 Oct 04 21:54:18.622157 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 21:54:18.622157 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 21:54:18.622157 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 21:54:18.622157 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 74 Oct 04 21:54:18.622157 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 21:54:18.622157 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 21:54:18.622157 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 21:54:18.622157 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 21:54:18.622157 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPKr6KrEbitoFg_HCXt4kS0Drvml-G3ziJCM85x-IPH6sZmamd0mJanXcbANJ4xEwBTHvHUQ2SqnKstOgl7EMVPOfWcBGEF-9c8tp-0lfhjqi-CATe7Ue3wBiUSbQu2WDEbslngOsKVmtHhOyOfRf3tBNYZRxKICtcebPAz42Ud7oDf8 Oct 04 21:54:18.622157 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 21:54:18.622157 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 21:54:18.622157 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 21:54:18.622157 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 21:54:18.622157 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 21:54:18.622157 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 21:54:18.622157 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: d0e95077b3704059a537a6fb934ba283 Oct 04 21:54:18.622157 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-VolumesAdminNegativeTest-1219872418 Oct 04 21:54:18.622157 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,admin,member Oct 04 21:54:18.622157 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,admin,member Oct 04 21:54:18.622157 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d0e95077b3704059a537a6fb934ba283"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_d0e95077b3704059a537a6fb934ba283", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d0e95077b3704059a537a6fb934ba283"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/d0e95077b3704059a537a6fb934ba283"}]}] Oct 04 21:54:18.622157 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-VolumesAdminNegativeTest-1219872418 Oct 04 21:54:18.622157 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: d0e95077b3704059a537a6fb934ba283 Oct 04 21:54:18.622157 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1219872418 Oct 04 21:54:18.622157 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-VolumesAdminNegativeTest-1219872418-project-admin Oct 04 21:54:18.622157 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 21:54:18.622157 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 21:54:18.622157 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 0b11981fa4c04207a5965b434ee86f5c Oct 04 21:54:18.622157 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-VolumesAdminNegativeTest-1219872418-project-admin Oct 04 21:54:18.622157 n-d-860284-1 devstack@n-api.service[134101]: Oct 04 21:54:18.622157 n-d-860284-1 devstack@n-api.service[134101]: {"volumeAttachment": {"volumeId": "2747a9b0-c250-49a9-af42-94f2dc2c37d0"}} Oct 04 21:54:18.622157 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 21:54:18.622157 n-d-860284-1 devstack@n-api.service[134101]: exception: Volume 2747a9b0-c250-49a9-af42-94f2dc2c37d0 could not be found. Oct 04 21:54:18.622157 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'server_id': '128b12e0-8fde-4113-95e9-0ecba563d8ec', 'id': 'c2363bfd-2097-4d53-adf1-8981fac17fc4', 'body': {'volumeAttachment': {'volumeId': '2747a9b0-c250-49a9-af42-94f2dc2c37d0'}}} Oct 04 21:54:18.622157 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:54:18.622157 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:54:18.622157 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 21:54:18.622157 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 21:54:18.622157 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 21:54:18.622157 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 21:54:18.622157 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 21:54:18.622157 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 21:54:18.622157 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 21:54:18.622157 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 21:54:18.622157 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 21:54:18.622157 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 21:54:18.622157 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 21:54:18.622157 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 21:54:18.622157 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 21:54:18.622157 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 21:54:18.622157 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2747a9b0-c250-49a9-af42-94f2dc2c37d0 could not be found. (HTTP 404) (Request-ID: req-02c8c8c8-2c9f-4230-a25e-56f1ad60157a) Oct 04 21:54:18.622157 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:54:18.622157 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:54:18.622157 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:54:18.622157 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:54:18.622157 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Oct 04 21:54:18.622157 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Oct 04 21:54:18.622157 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 04 21:54:18.622157 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 04 21:54:18.622157 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 04 21:54:18.626327 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 04 21:54:18.626327 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 04 21:54:18.626327 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 04 21:54:18.626327 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 21:54:18.626327 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 21:54:18.626327 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 21:54:18.626327 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 21:54:18.626327 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 21:54:18.626327 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 21:54:18.626327 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 21:54:18.626327 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 21:54:18.626327 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 21:54:18.626327 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 21:54:18.626327 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 21:54:18.626327 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 21:54:18.626327 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 21:54:18.626327 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 21:54:18.626327 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2747a9b0-c250-49a9-af42-94f2dc2c37d0 could not be found. Oct 04 21:54:18.626327 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:54:18.626327 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:54:18.626327 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:54:18.626327 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:54:18.626327 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:54:18.626327 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:54:18.626327 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:54:18.626327 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:54:18.626327 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:54:18.626327 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:54:18.626327 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:54:18.626327 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:54:18.626327 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:54:18.626327 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:54:18.626327 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Oct 04 21:54:18.626327 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Oct 04 21:54:18.626327 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Oct 04 21:54:18.626327 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 04 21:54:18.626327 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume 2747a9b0-c250-49a9-af42-94f2dc2c37d0 could not be found. Oct 04 21:54:18.626327 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:54:18.626327 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:54:18.626327 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:54:18.626327 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:54:18.626327 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:54:18.626327 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:54:18.626327 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:54:18.626327 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:54:18.626327 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2747a9b0-c250-49a9-af42-94f2dc2c37d0 could not be found. Oct 04 21:54:18.626327 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:54:18.631367 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-545caef3-ad26-4437-b314-515def6b86e5 tempest-VolumesAdminNegativeTest-1219872418 tempest-VolumesAdminNegativeTest-1219872418-project-admin] Returning 400 to user: Volume 2747a9b0-c250-49a9-af42-94f2dc2c37d0 could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:54:18.631367 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-545caef3-ad26-4437-b314-515def6b86e5 tempest-VolumesAdminNegativeTest-1219872418 tempest-VolumesAdminNegativeTest-1219872418-project-admin] 10.222.0.43 "PUT /compute/v2.1/servers/128b12e0-8fde-4113-95e9-0ecba563d8ec/os-volume_attachments/c2363bfd-2097-4d53-adf1-8981fac17fc4" status: 400 len: 107 microversion: 2.1 time: 0.792928 Oct 04 21:54:18.635106 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1213/2507] 10.222.0.43 () {60 vars in 1433 bytes} [Tue Oct 4 21:54:17 2022] PUT /compute/v2.1/servers/128b12e0-8fde-4113-95e9-0ecba563d8ec/os-volume_attachments/c2363bfd-2097-4d53-adf1-8981fac17fc4 => generated 107 bytes in 799 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 21:54:18.654745 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-62a2a934-0c6e-4ef5-8d97-0da836191720 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:18.657681 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-62a2a934-0c6e-4ef5-8d97-0da836191720 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] [instance: 830de6ad-adc6-4d16-ae9d-a29ae85e6cd2] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:18.716028 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-62a2a934-0c6e-4ef5-8d97-0da836191720 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:18.718568 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-62a2a934-0c6e-4ef5-8d97-0da836191720 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:18.720023 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-62a2a934-0c6e-4ef5-8d97-0da836191720 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:18.720947 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-62a2a934-0c6e-4ef5-8d97-0da836191720 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:18.721570 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-62a2a934-0c6e-4ef5-8d97-0da836191720 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:18.722457 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-62a2a934-0c6e-4ef5-8d97-0da836191720 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:18.918929 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-37e7920c-2ce6-48ff-86fa-fee6296019b4 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47fbc4a6920d451cb1a2ad170de04921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43659cf5fed541e8883664bf17aced70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:18.931392 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-37e7920c-2ce6-48ff-86fa-fee6296019b4 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] 10.222.0.43 "GET /compute/v2.1/servers/eb6e098d-966d-478b-a69c-3746584e5509" status: 200 len: 1506 microversion: 2.1 time: 0.898329 Oct 04 21:54:18.939730 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1295/2508] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:54:18 2022] GET /compute/v2.1/servers/eb6e098d-966d-478b-a69c-3746584e5509 => generated 1506 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:54:18.950639 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-227256fc-6d66-4a24-af5c-35bf636efcc7 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:18.959365 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-227256fc-6d66-4a24-af5c-35bf636efcc7 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 152003e4-2a7b-4801-8656-73093cd566ed] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:18.968547 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-227256fc-6d66-4a24-af5c-35bf636efcc7 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:18.969247 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-227256fc-6d66-4a24-af5c-35bf636efcc7 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:18.979444 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-227256fc-6d66-4a24-af5c-35bf636efcc7 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:18.980482 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-227256fc-6d66-4a24-af5c-35bf636efcc7 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:18.981305 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-227256fc-6d66-4a24-af5c-35bf636efcc7 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:18.982728 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-227256fc-6d66-4a24-af5c-35bf636efcc7 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:19.326012 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-227256fc-6d66-4a24-af5c-35bf636efcc7 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ad048becf474fb972d4291422d810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dcfc7024fc49388c4bd5f25f03e60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:19.335262 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-227256fc-6d66-4a24-af5c-35bf636efcc7 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/152003e4-2a7b-4801-8656-73093cd566ed" status: 200 len: 1183 microversion: 2.1 time: 0.394210 Oct 04 21:54:19.344293 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1296/2509] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:54:18 2022] GET /compute/v2.1/servers/152003e4-2a7b-4801-8656-73093cd566ed => generated 1183 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:54:19.363612 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-a7040b39-9c52-4072-be56-193bcd39f062 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:19.364579 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-a7040b39-9c52-4072-be56-193bcd39f062 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] [instance: 7d0ed6d0-981a-48a7-a676-5910b1257301] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:19.378085 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a7040b39-9c52-4072-be56-193bcd39f062 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:19.382397 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a7040b39-9c52-4072-be56-193bcd39f062 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:19.383236 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a7040b39-9c52-4072-be56-193bcd39f062 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:19.384326 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a7040b39-9c52-4072-be56-193bcd39f062 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:19.384904 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a7040b39-9c52-4072-be56-193bcd39f062 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:19.385587 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a7040b39-9c52-4072-be56-193bcd39f062 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:19.599809 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-62a2a934-0c6e-4ef5-8d97-0da836191720 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:19.678502 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-62a2a934-0c6e-4ef5-8d97-0da836191720 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:19.685914 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-a7040b39-9c52-4072-be56-193bcd39f062 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f11c77afc74a16bea945dd84e72ebe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94d03be22238422eba835ed522baf9c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:19.702314 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-62a2a934-0c6e-4ef5-8d97-0da836191720 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:19.708042 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-a7040b39-9c52-4072-be56-193bcd39f062 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] 10.222.0.43 "GET /compute/v2.1/servers/7d0ed6d0-981a-48a7-a676-5910b1257301" status: 200 len: 1431 microversion: 2.1 time: 0.361295 Oct 04 21:54:19.710632 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-62a2a934-0c6e-4ef5-8d97-0da836191720 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] 10.222.0.43 "GET /compute/v2.1/servers/830de6ad-adc6-4d16-ae9d-a29ae85e6cd2" status: 200 len: 1874 microversion: 2.42 time: 1.071815 Oct 04 21:54:19.715787 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1214/2510] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:54:18 2022] GET /compute/v2.1/servers/830de6ad-adc6-4d16-ae9d-a29ae85e6cd2 => generated 1874 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:54:19.732563 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1297/2511] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:54:19 2022] GET /compute/v2.1/servers/7d0ed6d0-981a-48a7-a676-5910b1257301 => generated 1431 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:54:19.744393 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e2061e10-02b5-43aa-8de7-2fe792891dfb tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:19.747154 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-e2061e10-02b5-43aa-8de7-2fe792891dfb tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] [instance: 128b12e0-8fde-4113-95e9-0ecba563d8ec] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:19.750155 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-be44edfc-e239-40b7-a431-f9c8a7edfdc6 req-e54d0f69-567f-4f27-a8ca-71323b2613c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d0ed6d0-981a-48a7-a676-5910b1257301", "name": "network-vif-deleted", "tag": "0ba64ce4-a23d-464b-a37e-fdb0f8a91b4b"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:54:19.764882 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e2061e10-02b5-43aa-8de7-2fe792891dfb tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:19.767502 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e2061e10-02b5-43aa-8de7-2fe792891dfb tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:19.769352 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e2061e10-02b5-43aa-8de7-2fe792891dfb tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:19.771165 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e2061e10-02b5-43aa-8de7-2fe792891dfb tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:19.772976 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e2061e10-02b5-43aa-8de7-2fe792891dfb tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:19.774518 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e2061e10-02b5-43aa-8de7-2fe792891dfb tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:19.783207 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=4 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:54:19.791278 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-be44edfc-e239-40b7-a431-f9c8a7edfdc6 req-e54d0f69-567f-4f27-a8ca-71323b2613c4 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:19.796950 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-be44edfc-e239-40b7-a431-f9c8a7edfdc6 req-e54d0f69-567f-4f27-a8ca-71323b2613c4 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:19.797524 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-be44edfc-e239-40b7-a431-f9c8a7edfdc6 req-e54d0f69-567f-4f27-a8ca-71323b2613c4 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:19.841083 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-be44edfc-e239-40b7-a431-f9c8a7edfdc6 req-e54d0f69-567f-4f27-a8ca-71323b2613c4 service nova] Creating event network-vif-deleted:0ba64ce4-a23d-464b-a37e-fdb0f8a91b4b for instance 7d0ed6d0-981a-48a7-a676-5910b1257301 on n-h2-860284-1 Oct 04 21:54:19.862555 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-be44edfc-e239-40b7-a431-f9c8a7edfdc6 req-e54d0f69-567f-4f27-a8ca-71323b2613c4 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127894 Oct 04 21:54:19.864760 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1298/2512] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:54:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:54:19.963694 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-d8103b0d-8d92-4933-b12c-e6ec17c4c23c tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:19.965140 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-d8103b0d-8d92-4933-b12c-e6ec17c4c23c tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] [instance: eb6e098d-966d-478b-a69c-3746584e5509] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:19.977364 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d8103b0d-8d92-4933-b12c-e6ec17c4c23c tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:19.988885 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d8103b0d-8d92-4933-b12c-e6ec17c4c23c tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:19.989649 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d8103b0d-8d92-4933-b12c-e6ec17c4c23c tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:19.990930 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d8103b0d-8d92-4933-b12c-e6ec17c4c23c tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:19.993677 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d8103b0d-8d92-4933-b12c-e6ec17c4c23c tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:19.994509 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d8103b0d-8d92-4933-b12c-e6ec17c4c23c tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:20.060169 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.objects.instance [None req-e2061e10-02b5-43aa-8de7-2fe792891dfb tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lazy-loading 'services' on Instance uuid 128b12e0-8fde-4113-95e9-0ecba563d8ec {{(pid=134101) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:54:20.097475 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:54:20.232788 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-e2061e10-02b5-43aa-8de7-2fe792891dfb tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] 10.222.0.43 "DELETE /compute/v2.1/servers/128b12e0-8fde-4113-95e9-0ecba563d8ec/os-volume_attachments/c2363bfd-2097-4d53-adf1-8981fac17fc4" status: 202 len: 0 microversion: 2.1 time: 0.511299 Oct 04 21:54:20.235553 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1215/2513] 10.222.0.43 () {58 vars in 1416 bytes} [Tue Oct 4 21:54:19 2022] DELETE /compute/v2.1/servers/128b12e0-8fde-4113-95e9-0ecba563d8ec/os-volume_attachments/c2363bfd-2097-4d53-adf1-8981fac17fc4 => generated 0 bytes in 519 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:54:20.273134 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-57beaa45-4b60-48ec-9e1c-f376fccde909 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:20.284319 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-57beaa45-4b60-48ec-9e1c-f376fccde909 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] [instance: 128b12e0-8fde-4113-95e9-0ecba563d8ec] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:20.328284 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-57beaa45-4b60-48ec-9e1c-f376fccde909 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:20.329005 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-57beaa45-4b60-48ec-9e1c-f376fccde909 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:20.330233 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-57beaa45-4b60-48ec-9e1c-f376fccde909 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:20.331299 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-57beaa45-4b60-48ec-9e1c-f376fccde909 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:20.339534 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-57beaa45-4b60-48ec-9e1c-f376fccde909 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:20.340412 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-57beaa45-4b60-48ec-9e1c-f376fccde909 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:20.489956 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-57beaa45-4b60-48ec-9e1c-f376fccde909 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] 10.222.0.43 "GET /compute/v2.1/servers/128b12e0-8fde-4113-95e9-0ecba563d8ec/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.243874 Oct 04 21:54:20.491447 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1216/2514] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 21:54:20 2022] GET /compute/v2.1/servers/128b12e0-8fde-4113-95e9-0ecba563d8ec/os-volume_attachments => generated 197 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:54:20.528404 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-ab64c209-030a-416f-a559-78afe8c114e3 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:20.529318 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-ab64c209-030a-416f-a559-78afe8c114e3 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 152003e4-2a7b-4801-8656-73093cd566ed] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:20.549390 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ab64c209-030a-416f-a559-78afe8c114e3 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:20.551223 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ab64c209-030a-416f-a559-78afe8c114e3 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:20.552901 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ab64c209-030a-416f-a559-78afe8c114e3 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:20.555340 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ab64c209-030a-416f-a559-78afe8c114e3 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:20.557068 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ab64c209-030a-416f-a559-78afe8c114e3 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:20.557686 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ab64c209-030a-416f-a559-78afe8c114e3 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:20.614515 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-ab64c209-030a-416f-a559-78afe8c114e3 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] HTTP exception thrown: Instance 152003e4-2a7b-4801-8656-73093cd566ed could not be found. Oct 04 21:54:20.618697 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-ab64c209-030a-416f-a559-78afe8c114e3 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Request method failure captured: Oct 04 21:54:20.618697 n-d-860284-1 devstack@n-api.service[134101]: request: GET /compute/v2.1/servers/152003e4-2a7b-4801-8656-73093cd566ed HTTP/1.1 Oct 04 21:54:20.618697 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 21:54:20.618697 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 21:54:20.618697 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 21:54:20.618697 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 21:54:20.618697 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 21:54:20.618697 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 21:54:20.618697 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 21:54:20.618697 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 21:54:20.618697 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPKlsrwiQ9GesXhyqu67r1anP5Ibl0YaboKyeE7rK46nYSdK0TpUYcmL_wM01HTXcfIoJGuxcnLbc-VFhUn_6G-hdgqWaOF_j6r_rBrUrr7Ol7326k-Ze3kyxQxWppQH2Hmb4sX-zc9lQaszpgn74tbRppenQIsFu6fvipc6lYaDTkwQ Oct 04 21:54:20.618697 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 21:54:20.618697 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 21:54:20.618697 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 21:54:20.618697 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 21:54:20.618697 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 21:54:20.618697 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 21:54:20.618697 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: 78dcfc7024fc49388c4bd5f25f03e60d Oct 04 21:54:20.618697 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-LiveMigrationTest-87019555 Oct 04 21:54:20.618697 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 21:54:20.618697 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 21:54:20.618697 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/78dcfc7024fc49388c4bd5f25f03e60d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_78dcfc7024fc49388c4bd5f25f03e60d", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/78dcfc7024fc49388c4bd5f25f03e60d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/78dcfc7024fc49388c4bd5f25f03e60d"}]}] Oct 04 21:54:20.618697 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-LiveMigrationTest-87019555 Oct 04 21:54:20.618697 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: 78dcfc7024fc49388c4bd5f25f03e60d Oct 04 21:54:20.618697 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-LiveMigrationTest-87019555 Oct 04 21:54:20.618697 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-LiveMigrationTest-87019555-project Oct 04 21:54:20.618697 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 21:54:20.618697 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 21:54:20.618697 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: bb7ad048becf474fb972d4291422d810 Oct 04 21:54:20.618697 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-LiveMigrationTest-87019555-project Oct 04 21:54:20.618697 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 21:54:20.618697 n-d-860284-1 devstack@n-api.service[134101]: exception: Instance 152003e4-2a7b-4801-8656-73093cd566ed could not be found. Oct 04 21:54:20.618697 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': '152003e4-2a7b-4801-8656-73093cd566ed'} Oct 04 21:54:20.618697 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:54:20.618697 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:54:20.618697 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:54:20.618697 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:54:20.618697 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:54:20.618697 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:54:20.618697 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:54:20.618697 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:54:20.618697 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:54:20.618697 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:54:20.618697 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 152003e4-2a7b-4801-8656-73093cd566ed could not be found. Oct 04 21:54:20.618697 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:54:20.618697 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:54:20.618697 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:54:20.618697 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:54:20.618697 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:54:20.618697 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:54:20.618697 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:54:20.618697 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:54:20.618697 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:54:20.618697 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:54:20.618697 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:54:20.618697 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:54:20.618697 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:54:20.618697 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:54:20.618697 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:54:20.618697 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:54:20.618697 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 152003e4-2a7b-4801-8656-73093cd566ed could not be found. Oct 04 21:54:20.618697 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:54:20.618697 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:54:20.618697 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:54:20.623299 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:54:20.623299 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:54:20.623299 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:54:20.623299 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:54:20.623299 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:54:20.623299 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 152003e4-2a7b-4801-8656-73093cd566ed could not be found. Oct 04 21:54:20.623299 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:54:20.629501 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-ab64c209-030a-416f-a559-78afe8c114e3 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Returning 404 to user: Instance 152003e4-2a7b-4801-8656-73093cd566ed could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:54:20.630603 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-ab64c209-030a-416f-a559-78afe8c114e3 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/152003e4-2a7b-4801-8656-73093cd566ed" status: 404 len: 111 microversion: 2.1 time: 0.137427 Oct 04 21:54:20.633428 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1217/2515] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:54:20 2022] GET /compute/v2.1/servers/152003e4-2a7b-4801-8656-73093cd566ed => generated 111 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:54:20.749297 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-07ddc645-e581-4ccb-a5a5-b0017ac1ef52 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:20.750592 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-07ddc645-e581-4ccb-a5a5-b0017ac1ef52 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] [instance: 830de6ad-adc6-4d16-ae9d-a29ae85e6cd2] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:20.775378 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-07ddc645-e581-4ccb-a5a5-b0017ac1ef52 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:20.776149 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-07ddc645-e581-4ccb-a5a5-b0017ac1ef52 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:20.776817 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-07ddc645-e581-4ccb-a5a5-b0017ac1ef52 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:20.783299 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-07ddc645-e581-4ccb-a5a5-b0017ac1ef52 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:20.783958 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-07ddc645-e581-4ccb-a5a5-b0017ac1ef52 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:20.785739 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-07ddc645-e581-4ccb-a5a5-b0017ac1ef52 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:21.740247 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-d8103b0d-8d92-4933-b12c-e6ec17c4c23c tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47fbc4a6920d451cb1a2ad170de04921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43659cf5fed541e8883664bf17aced70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:21.755678 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-d8103b0d-8d92-4933-b12c-e6ec17c4c23c tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] 10.222.0.43 "GET /compute/v2.1/servers/eb6e098d-966d-478b-a69c-3746584e5509" status: 200 len: 1506 microversion: 2.1 time: 1.790566 Oct 04 21:54:21.756469 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1299/2516] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:54:19 2022] GET /compute/v2.1/servers/eb6e098d-966d-478b-a69c-3746584e5509 => generated 1506 bytes in 1800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:54:21.765463 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-a3035fea-35b6-4d27-8971-d13e69951539 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:21.766077 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-a3035fea-35b6-4d27-8971-d13e69951539 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] [instance: 7d0ed6d0-981a-48a7-a676-5910b1257301] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:21.803600 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a3035fea-35b6-4d27-8971-d13e69951539 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:21.807455 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a3035fea-35b6-4d27-8971-d13e69951539 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:21.809845 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a3035fea-35b6-4d27-8971-d13e69951539 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:21.811140 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a3035fea-35b6-4d27-8971-d13e69951539 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:21.823315 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a3035fea-35b6-4d27-8971-d13e69951539 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:21.825202 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a3035fea-35b6-4d27-8971-d13e69951539 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:21.838671 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-07ddc645-e581-4ccb-a5a5-b0017ac1ef52 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:21.852805 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-07ddc645-e581-4ccb-a5a5-b0017ac1ef52 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:21.854739 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-07ddc645-e581-4ccb-a5a5-b0017ac1ef52 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:21.856435 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-07ddc645-e581-4ccb-a5a5-b0017ac1ef52 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] 10.222.0.43 "GET /compute/v2.1/servers/830de6ad-adc6-4d16-ae9d-a29ae85e6cd2" status: 200 len: 1874 microversion: 2.42 time: 1.115521 Oct 04 21:54:21.857973 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1218/2517] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:54:20 2022] GET /compute/v2.1/servers/830de6ad-adc6-4d16-ae9d-a29ae85e6cd2 => generated 1874 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:54:21.864077 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-3589ef33-1c53-4bff-be0b-43d92afc9312 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:21.869236 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-3589ef33-1c53-4bff-be0b-43d92afc9312 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] [instance: 128b12e0-8fde-4113-95e9-0ecba563d8ec] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:21.875788 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-a3035fea-35b6-4d27-8971-d13e69951539 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] HTTP exception thrown: Instance 7d0ed6d0-981a-48a7-a676-5910b1257301 could not be found. Oct 04 21:54:21.877543 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3589ef33-1c53-4bff-be0b-43d92afc9312 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:21.877660 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-a3035fea-35b6-4d27-8971-d13e69951539 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Request method failure captured: Oct 04 21:54:21.877660 n-d-860284-1 devstack@n-api.service[134102]: request: GET /compute/v2.1/servers/7d0ed6d0-981a-48a7-a676-5910b1257301 HTTP/1.1 Oct 04 21:54:21.877660 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 21:54:21.877660 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 21:54:21.877660 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 21:54:21.877660 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 21:54:21.877660 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 21:54:21.877660 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 21:54:21.877660 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 21:54:21.877660 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 21:54:21.877660 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPKq93ZqVRaIACQndBifmNiShHC_F9H_8X907rVQmqAdPgEYMKRvfZhT8Bm3TfKcmWFjaw-4qo7T0u8lcMShGyAqW9V8s6F9I10oW5Dq5aH_oZVyM6q3oL3LmkK-KFMBVNHSMm4-LlmygsfaGU7_1csYB4KFWBg9eMSH1x8uiDa3uCXs Oct 04 21:54:21.877660 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 21:54:21.877660 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 21:54:21.877660 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 21:54:21.877660 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 21:54:21.877660 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 21:54:21.877660 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 21:54:21.877660 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: 94d03be22238422eba835ed522baf9c3 Oct 04 21:54:21.877660 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-ListImageFiltersTestJSON-1919215498 Oct 04 21:54:21.877660 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 21:54:21.877660 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 21:54:21.877660 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/94d03be22238422eba835ed522baf9c3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_94d03be22238422eba835ed522baf9c3", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/94d03be22238422eba835ed522baf9c3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/94d03be22238422eba835ed522baf9c3"}]}] Oct 04 21:54:21.877660 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-ListImageFiltersTestJSON-1919215498 Oct 04 21:54:21.877660 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: 94d03be22238422eba835ed522baf9c3 Oct 04 21:54:21.877660 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1919215498 Oct 04 21:54:21.877660 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-ListImageFiltersTestJSON-1919215498-project Oct 04 21:54:21.877660 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 21:54:21.877660 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 21:54:21.877660 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: 47f11c77afc74a16bea945dd84e72ebe Oct 04 21:54:21.877660 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-ListImageFiltersTestJSON-1919215498-project Oct 04 21:54:21.877660 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 21:54:21.877660 n-d-860284-1 devstack@n-api.service[134102]: exception: Instance 7d0ed6d0-981a-48a7-a676-5910b1257301 could not be found. Oct 04 21:54:21.877660 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': '7d0ed6d0-981a-48a7-a676-5910b1257301'} Oct 04 21:54:21.877660 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:54:21.877660 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:54:21.877660 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:54:21.877660 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:54:21.877660 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:54:21.877660 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:54:21.877660 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:54:21.877660 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:54:21.877660 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:54:21.877660 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:54:21.877660 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d0ed6d0-981a-48a7-a676-5910b1257301 could not be found. Oct 04 21:54:21.877660 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:54:21.877660 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:54:21.877660 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:54:21.877660 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:54:21.877660 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:54:21.877660 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:54:21.877660 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:54:21.877660 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:54:21.877660 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:54:21.877660 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:54:21.877660 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:54:21.877660 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:54:21.877660 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:54:21.877660 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:54:21.877660 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:54:21.877660 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:54:21.877660 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d0ed6d0-981a-48a7-a676-5910b1257301 could not be found. Oct 04 21:54:21.877660 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:54:21.877660 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:54:21.877660 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:54:21.881594 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:54:21.881594 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:54:21.881594 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:54:21.881594 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:54:21.881594 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:54:21.881594 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d0ed6d0-981a-48a7-a676-5910b1257301 could not be found. Oct 04 21:54:21.881594 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:54:21.881594 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-a3035fea-35b6-4d27-8971-d13e69951539 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Returning 404 to user: Instance 7d0ed6d0-981a-48a7-a676-5910b1257301 could not be found. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:54:21.883518 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-a3035fea-35b6-4d27-8971-d13e69951539 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] 10.222.0.43 "GET /compute/v2.1/servers/7d0ed6d0-981a-48a7-a676-5910b1257301" status: 404 len: 111 microversion: 2.1 time: 0.125570 Oct 04 21:54:21.884467 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1300/2518] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:54:21 2022] GET /compute/v2.1/servers/7d0ed6d0-981a-48a7-a676-5910b1257301 => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:54:21.885350 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3589ef33-1c53-4bff-be0b-43d92afc9312 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:21.886012 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3589ef33-1c53-4bff-be0b-43d92afc9312 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:21.887640 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3589ef33-1c53-4bff-be0b-43d92afc9312 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:21.888212 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3589ef33-1c53-4bff-be0b-43d92afc9312 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:21.888744 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3589ef33-1c53-4bff-be0b-43d92afc9312 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:21.904702 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-24003824-2c77-4c98-abcb-1b530edfb60b tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:21.905201 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-24003824-2c77-4c98-abcb-1b530edfb60b tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] [instance: 6f8a46c4-3b6f-4f50-8227-77b69154fb57] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:21.932269 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-24003824-2c77-4c98-abcb-1b530edfb60b tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:21.932734 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-24003824-2c77-4c98-abcb-1b530edfb60b tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:21.933189 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-24003824-2c77-4c98-abcb-1b530edfb60b tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:21.933937 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-24003824-2c77-4c98-abcb-1b530edfb60b tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:21.934408 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-24003824-2c77-4c98-abcb-1b530edfb60b tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:21.934835 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-24003824-2c77-4c98-abcb-1b530edfb60b tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:21.936092 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-3589ef33-1c53-4bff-be0b-43d92afc9312 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] 10.222.0.43 "GET /compute/v2.1/servers/128b12e0-8fde-4113-95e9-0ecba563d8ec/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076550 Oct 04 21:54:21.936932 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1219/2519] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 21:54:21 2022] GET /compute/v2.1/servers/128b12e0-8fde-4113-95e9-0ecba563d8ec/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:54:22.026352 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-24003824-2c77-4c98-abcb-1b530edfb60b tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] [instance: 6f8a46c4-3b6f-4f50-8227-77b69154fb57] Going to try to terminate instance {{(pid=134102) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:54:22.245805 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-24003824-2c77-4c98-abcb-1b530edfb60b tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] 10.222.0.43 "DELETE /compute/v2.1/servers/6f8a46c4-3b6f-4f50-8227-77b69154fb57" status: 204 len: 0 microversion: 2.1 time: 0.351470 Oct 04 21:54:22.252231 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1301/2520] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 21:54:21 2022] DELETE /compute/v2.1/servers/6f8a46c4-3b6f-4f50-8227-77b69154fb57 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:54:22.259176 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-377f21b1-4958-43bf-8368-6ac71d03afc7 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:22.260323 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-377f21b1-4958-43bf-8368-6ac71d03afc7 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] [instance: 6f8a46c4-3b6f-4f50-8227-77b69154fb57] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:22.282269 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-377f21b1-4958-43bf-8368-6ac71d03afc7 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:22.285450 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-377f21b1-4958-43bf-8368-6ac71d03afc7 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:22.286198 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-377f21b1-4958-43bf-8368-6ac71d03afc7 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:22.293508 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-377f21b1-4958-43bf-8368-6ac71d03afc7 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:22.294394 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-377f21b1-4958-43bf-8368-6ac71d03afc7 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:22.295840 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-377f21b1-4958-43bf-8368-6ac71d03afc7 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:22.676168 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-377f21b1-4958-43bf-8368-6ac71d03afc7 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f11c77afc74a16bea945dd84e72ebe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94d03be22238422eba835ed522baf9c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:22.690471 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-377f21b1-4958-43bf-8368-6ac71d03afc7 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] 10.222.0.43 "GET /compute/v2.1/servers/6f8a46c4-3b6f-4f50-8227-77b69154fb57" status: 200 len: 1473 microversion: 2.1 time: 0.434613 Oct 04 21:54:22.704363 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1220/2521] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:54:22 2022] GET /compute/v2.1/servers/6f8a46c4-3b6f-4f50-8227-77b69154fb57 => generated 1473 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:54:22.756081 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-a4c80ec5-ef25-406a-8e43-d5b85f6b191e req-82e1511b-0382-469f-866f-df8f87b7428f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "830de6ad-adc6-4d16-ae9d-a29ae85e6cd2", "name": "network-vif-plugged", "status": "completed", "tag": "480ee163-2b8b-42e9-80e8-28254bda8c68"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:54:22.776741 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-a4c80ec5-ef25-406a-8e43-d5b85f6b191e req-82e1511b-0382-469f-866f-df8f87b7428f service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:22.777975 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-a4c80ec5-ef25-406a-8e43-d5b85f6b191e req-82e1511b-0382-469f-866f-df8f87b7428f service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:22.778884 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-a4c80ec5-ef25-406a-8e43-d5b85f6b191e req-82e1511b-0382-469f-866f-df8f87b7428f service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:22.784731 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-070fb4b9-3edb-453a-836f-ac67e3fd565b tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:22.785950 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-070fb4b9-3edb-453a-836f-ac67e3fd565b tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] [instance: eb6e098d-966d-478b-a69c-3746584e5509] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:22.793551 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-070fb4b9-3edb-453a-836f-ac67e3fd565b tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:22.794043 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-070fb4b9-3edb-453a-836f-ac67e3fd565b tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:22.794558 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-070fb4b9-3edb-453a-836f-ac67e3fd565b tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:22.795677 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-070fb4b9-3edb-453a-836f-ac67e3fd565b tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:22.796301 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-070fb4b9-3edb-453a-836f-ac67e3fd565b tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:22.796669 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-070fb4b9-3edb-453a-836f-ac67e3fd565b tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:22.817298 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-a4c80ec5-ef25-406a-8e43-d5b85f6b191e req-82e1511b-0382-469f-866f-df8f87b7428f service nova] Creating event network-vif-plugged:480ee163-2b8b-42e9-80e8-28254bda8c68 for instance 830de6ad-adc6-4d16-ae9d-a29ae85e6cd2 on n-h1-860284-1 Oct 04 21:54:22.826175 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-a4c80ec5-ef25-406a-8e43-d5b85f6b191e req-82e1511b-0382-469f-866f-df8f87b7428f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.543480 Oct 04 21:54:22.826827 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1302/2522] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:54:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:54:22.887968 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-d5c5edbd-6c57-4884-8b03-1f2bd2ded987 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:22.889037 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-d5c5edbd-6c57-4884-8b03-1f2bd2ded987 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] [instance: 830de6ad-adc6-4d16-ae9d-a29ae85e6cd2] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:22.900412 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d5c5edbd-6c57-4884-8b03-1f2bd2ded987 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:22.904557 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d5c5edbd-6c57-4884-8b03-1f2bd2ded987 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:22.905090 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d5c5edbd-6c57-4884-8b03-1f2bd2ded987 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:22.908661 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d5c5edbd-6c57-4884-8b03-1f2bd2ded987 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:22.909171 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d5c5edbd-6c57-4884-8b03-1f2bd2ded987 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:22.910134 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d5c5edbd-6c57-4884-8b03-1f2bd2ded987 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:23.275726 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-d5c5edbd-6c57-4884-8b03-1f2bd2ded987 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:23.291376 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-d5c5edbd-6c57-4884-8b03-1f2bd2ded987 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:23.293490 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-d5c5edbd-6c57-4884-8b03-1f2bd2ded987 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:23.297798 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-d5c5edbd-6c57-4884-8b03-1f2bd2ded987 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] 10.222.0.43 "GET /compute/v2.1/servers/830de6ad-adc6-4d16-ae9d-a29ae85e6cd2" status: 200 len: 1874 microversion: 2.42 time: 0.415728 Oct 04 21:54:23.303173 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1303/2523] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:54:22 2022] GET /compute/v2.1/servers/830de6ad-adc6-4d16-ae9d-a29ae85e6cd2 => generated 1874 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:54:23.309212 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-1e2d6ae5-cda4-4c99-bd4a-8e7b2c297b28 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:23.317021 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-1e2d6ae5-cda4-4c99-bd4a-8e7b2c297b28 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] [instance: 128b12e0-8fde-4113-95e9-0ecba563d8ec] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:23.334422 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1e2d6ae5-cda4-4c99-bd4a-8e7b2c297b28 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:23.338743 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1e2d6ae5-cda4-4c99-bd4a-8e7b2c297b28 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:23.339447 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1e2d6ae5-cda4-4c99-bd4a-8e7b2c297b28 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:23.340411 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1e2d6ae5-cda4-4c99-bd4a-8e7b2c297b28 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:23.341102 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1e2d6ae5-cda4-4c99-bd4a-8e7b2c297b28 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:23.341780 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1e2d6ae5-cda4-4c99-bd4a-8e7b2c297b28 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:23.424399 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-1e2d6ae5-cda4-4c99-bd4a-8e7b2c297b28 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] 10.222.0.43 "GET /compute/v2.1/servers/128b12e0-8fde-4113-95e9-0ecba563d8ec/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.119750 Oct 04 21:54:23.429127 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1304/2524] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 21:54:23 2022] GET /compute/v2.1/servers/128b12e0-8fde-4113-95e9-0ecba563d8ec/os-volume_attachments => generated 197 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:54:23.444930 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-070fb4b9-3edb-453a-836f-ac67e3fd565b tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47fbc4a6920d451cb1a2ad170de04921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43659cf5fed541e8883664bf17aced70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:23.479940 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-070fb4b9-3edb-453a-836f-ac67e3fd565b tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] 10.222.0.43 "GET /compute/v2.1/servers/eb6e098d-966d-478b-a69c-3746584e5509" status: 200 len: 1506 microversion: 2.1 time: 0.700589 Oct 04 21:54:23.485880 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1221/2525] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:54:22 2022] GET /compute/v2.1/servers/eb6e098d-966d-478b-a69c-3746584e5509 => generated 1506 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:54:23.715792 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-67e78358-8ad3-4001-a41c-6a52c1837cde tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:23.717098 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-67e78358-8ad3-4001-a41c-6a52c1837cde tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] [instance: 6f8a46c4-3b6f-4f50-8227-77b69154fb57] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:23.729931 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-67e78358-8ad3-4001-a41c-6a52c1837cde tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:23.730986 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-67e78358-8ad3-4001-a41c-6a52c1837cde tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:23.731688 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-67e78358-8ad3-4001-a41c-6a52c1837cde tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:23.741230 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-67e78358-8ad3-4001-a41c-6a52c1837cde tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:23.744283 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-67e78358-8ad3-4001-a41c-6a52c1837cde tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:23.744981 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-67e78358-8ad3-4001-a41c-6a52c1837cde tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:24.343932 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e19c7536-f648-44d5-834f-445c0104f5e0 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:24.344600 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-e19c7536-f648-44d5-834f-445c0104f5e0 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] [instance: 830de6ad-adc6-4d16-ae9d-a29ae85e6cd2] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:24.391957 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e19c7536-f648-44d5-834f-445c0104f5e0 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:24.393460 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e19c7536-f648-44d5-834f-445c0104f5e0 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:24.396512 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e19c7536-f648-44d5-834f-445c0104f5e0 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:24.402633 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e19c7536-f648-44d5-834f-445c0104f5e0 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:24.419445 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e19c7536-f648-44d5-834f-445c0104f5e0 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:24.420779 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e19c7536-f648-44d5-834f-445c0104f5e0 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:24.483371 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-67e78358-8ad3-4001-a41c-6a52c1837cde tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f11c77afc74a16bea945dd84e72ebe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94d03be22238422eba835ed522baf9c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:24.498631 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-67e78358-8ad3-4001-a41c-6a52c1837cde tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] 10.222.0.43 "GET /compute/v2.1/servers/6f8a46c4-3b6f-4f50-8227-77b69154fb57" status: 200 len: 1473 microversion: 2.1 time: 0.787443 Oct 04 21:54:24.500848 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1305/2526] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:54:23 2022] GET /compute/v2.1/servers/6f8a46c4-3b6f-4f50-8227-77b69154fb57 => generated 1473 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:54:24.531495 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-4a8e506a-b6bd-4477-997d-a2ca4abb4ced tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:24.537436 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-4a8e506a-b6bd-4477-997d-a2ca4abb4ced tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] [instance: 128b12e0-8fde-4113-95e9-0ecba563d8ec] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:24.557174 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4a8e506a-b6bd-4477-997d-a2ca4abb4ced tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:24.559086 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4a8e506a-b6bd-4477-997d-a2ca4abb4ced tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:24.563184 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4a8e506a-b6bd-4477-997d-a2ca4abb4ced tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:24.564346 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4a8e506a-b6bd-4477-997d-a2ca4abb4ced tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:24.564987 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4a8e506a-b6bd-4477-997d-a2ca4abb4ced tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:24.565769 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4a8e506a-b6bd-4477-997d-a2ca4abb4ced tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:24.678698 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-4a8e506a-b6bd-4477-997d-a2ca4abb4ced tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] 10.222.0.43 "GET /compute/v2.1/servers/128b12e0-8fde-4113-95e9-0ecba563d8ec/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.176242 Oct 04 21:54:24.679316 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1306/2527] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 21:54:24 2022] GET /compute/v2.1/servers/128b12e0-8fde-4113-95e9-0ecba563d8ec/os-volume_attachments => generated 197 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:54:24.698929 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-21998add-f783-470d-a162-fa46ba8e2253 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:24.700669 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-21998add-f783-470d-a162-fa46ba8e2253 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] [instance: eb6e098d-966d-478b-a69c-3746584e5509] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:24.716113 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-21998add-f783-470d-a162-fa46ba8e2253 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:24.717084 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-21998add-f783-470d-a162-fa46ba8e2253 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:24.718677 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-21998add-f783-470d-a162-fa46ba8e2253 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:24.720281 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-21998add-f783-470d-a162-fa46ba8e2253 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:24.721378 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-21998add-f783-470d-a162-fa46ba8e2253 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:24.722164 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-21998add-f783-470d-a162-fa46ba8e2253 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:25.172003 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-e19c7536-f648-44d5-834f-445c0104f5e0 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:25.189183 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-e19c7536-f648-44d5-834f-445c0104f5e0 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:25.190707 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-e19c7536-f648-44d5-834f-445c0104f5e0 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:25.191927 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-e19c7536-f648-44d5-834f-445c0104f5e0 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] 10.222.0.43 "GET /compute/v2.1/servers/830de6ad-adc6-4d16-ae9d-a29ae85e6cd2" status: 200 len: 1874 microversion: 2.42 time: 0.859980 Oct 04 21:54:25.197241 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1222/2528] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:54:24 2022] GET /compute/v2.1/servers/830de6ad-adc6-4d16-ae9d-a29ae85e6cd2 => generated 1874 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:54:25.263318 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-21998add-f783-470d-a162-fa46ba8e2253 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47fbc4a6920d451cb1a2ad170de04921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43659cf5fed541e8883664bf17aced70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:25.279319 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-21998add-f783-470d-a162-fa46ba8e2253 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] 10.222.0.43 "GET /compute/v2.1/servers/eb6e098d-966d-478b-a69c-3746584e5509" status: 200 len: 1506 microversion: 2.1 time: 0.590840 Oct 04 21:54:25.282721 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1307/2529] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:54:24 2022] GET /compute/v2.1/servers/eb6e098d-966d-478b-a69c-3746584e5509 => generated 1506 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:54:25.526599 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-9391569f-c50f-4f96-b27e-265c674fe598 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:25.527242 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-9391569f-c50f-4f96-b27e-265c674fe598 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] [instance: 6f8a46c4-3b6f-4f50-8227-77b69154fb57] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:25.552102 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9391569f-c50f-4f96-b27e-265c674fe598 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:25.556135 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9391569f-c50f-4f96-b27e-265c674fe598 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:25.558676 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9391569f-c50f-4f96-b27e-265c674fe598 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:25.559579 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9391569f-c50f-4f96-b27e-265c674fe598 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:25.560404 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9391569f-c50f-4f96-b27e-265c674fe598 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:25.563313 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9391569f-c50f-4f96-b27e-265c674fe598 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:25.692821 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-61f95365-e2e1-438d-bb5b-3e083263ae99 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:25.696198 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-61f95365-e2e1-438d-bb5b-3e083263ae99 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] [instance: 128b12e0-8fde-4113-95e9-0ecba563d8ec] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:25.712036 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-61f95365-e2e1-438d-bb5b-3e083263ae99 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:25.712626 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-61f95365-e2e1-438d-bb5b-3e083263ae99 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:25.714880 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-61f95365-e2e1-438d-bb5b-3e083263ae99 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:25.716312 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-61f95365-e2e1-438d-bb5b-3e083263ae99 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:25.718133 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-61f95365-e2e1-438d-bb5b-3e083263ae99 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:25.719979 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-61f95365-e2e1-438d-bb5b-3e083263ae99 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:25.812729 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-61f95365-e2e1-438d-bb5b-3e083263ae99 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] 10.222.0.43 "GET /compute/v2.1/servers/128b12e0-8fde-4113-95e9-0ecba563d8ec/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.121615 Oct 04 21:54:25.814229 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1308/2530] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 21:54:25 2022] GET /compute/v2.1/servers/128b12e0-8fde-4113-95e9-0ecba563d8ec/os-volume_attachments => generated 197 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:54:26.221725 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-9e25f539-511f-40e9-a38c-a31b33c6bf5e tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:26.222651 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-9e25f539-511f-40e9-a38c-a31b33c6bf5e tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] [instance: 830de6ad-adc6-4d16-ae9d-a29ae85e6cd2] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:26.235462 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9e25f539-511f-40e9-a38c-a31b33c6bf5e tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:26.238596 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9e25f539-511f-40e9-a38c-a31b33c6bf5e tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:26.239322 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9e25f539-511f-40e9-a38c-a31b33c6bf5e tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:26.241113 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9e25f539-511f-40e9-a38c-a31b33c6bf5e tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:26.243180 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9e25f539-511f-40e9-a38c-a31b33c6bf5e tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:26.244253 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9e25f539-511f-40e9-a38c-a31b33c6bf5e tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:26.294712 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-9391569f-c50f-4f96-b27e-265c674fe598 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f11c77afc74a16bea945dd84e72ebe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94d03be22238422eba835ed522baf9c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:26.304035 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-9391569f-c50f-4f96-b27e-265c674fe598 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] 10.222.0.43 "GET /compute/v2.1/servers/6f8a46c4-3b6f-4f50-8227-77b69154fb57" status: 200 len: 1473 microversion: 2.1 time: 0.782868 Oct 04 21:54:26.322787 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1223/2531] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:54:25 2022] GET /compute/v2.1/servers/6f8a46c4-3b6f-4f50-8227-77b69154fb57 => generated 1473 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:54:26.329147 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-7e3ba753-30d6-47f4-8736-58297491a7c4 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:26.330088 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-7e3ba753-30d6-47f4-8736-58297491a7c4 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] [instance: eb6e098d-966d-478b-a69c-3746584e5509] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:26.337134 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7e3ba753-30d6-47f4-8736-58297491a7c4 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:26.337962 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7e3ba753-30d6-47f4-8736-58297491a7c4 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:26.338642 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7e3ba753-30d6-47f4-8736-58297491a7c4 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:26.339575 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7e3ba753-30d6-47f4-8736-58297491a7c4 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:26.340265 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7e3ba753-30d6-47f4-8736-58297491a7c4 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:26.340905 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7e3ba753-30d6-47f4-8736-58297491a7c4 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:26.402064 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:54:26.945689 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-9e25f539-511f-40e9-a38c-a31b33c6bf5e tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:26.961155 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-9e25f539-511f-40e9-a38c-a31b33c6bf5e tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:26.966467 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-9e25f539-511f-40e9-a38c-a31b33c6bf5e tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:26.967810 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-9e25f539-511f-40e9-a38c-a31b33c6bf5e tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] 10.222.0.43 "GET /compute/v2.1/servers/830de6ad-adc6-4d16-ae9d-a29ae85e6cd2" status: 200 len: 1874 microversion: 2.42 time: 0.751019 Oct 04 21:54:26.968402 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1309/2532] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:54:26 2022] GET /compute/v2.1/servers/830de6ad-adc6-4d16-ae9d-a29ae85e6cd2 => generated 1874 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:54:26.983912 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-ff818c99-0409-4530-af61-ac439249bdc3 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:26.986358 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-ff818c99-0409-4530-af61-ac439249bdc3 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] [instance: 128b12e0-8fde-4113-95e9-0ecba563d8ec] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:27.003556 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ff818c99-0409-4530-af61-ac439249bdc3 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:27.004043 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ff818c99-0409-4530-af61-ac439249bdc3 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:27.004472 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ff818c99-0409-4530-af61-ac439249bdc3 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:27.005173 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ff818c99-0409-4530-af61-ac439249bdc3 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:27.005621 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ff818c99-0409-4530-af61-ac439249bdc3 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:27.006039 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ff818c99-0409-4530-af61-ac439249bdc3 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:27.077867 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-ff818c99-0409-4530-af61-ac439249bdc3 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] 10.222.0.43 "GET /compute/v2.1/servers/128b12e0-8fde-4113-95e9-0ecba563d8ec/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.105124 Oct 04 21:54:27.082528 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1310/2533] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 21:54:26 2022] GET /compute/v2.1/servers/128b12e0-8fde-4113-95e9-0ecba563d8ec/os-volume_attachments => generated 197 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:54:27.254137 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-7e3ba753-30d6-47f4-8736-58297491a7c4 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47fbc4a6920d451cb1a2ad170de04921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43659cf5fed541e8883664bf17aced70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:27.263856 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-7e3ba753-30d6-47f4-8736-58297491a7c4 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] 10.222.0.43 "GET /compute/v2.1/servers/eb6e098d-966d-478b-a69c-3746584e5509" status: 200 len: 1506 microversion: 2.1 time: 0.939555 Oct 04 21:54:27.269153 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1224/2534] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:54:26 2022] GET /compute/v2.1/servers/eb6e098d-966d-478b-a69c-3746584e5509 => generated 1506 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:54:27.341709 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-9add75a6-7ba7-4868-a566-6ea5f585583f req-c4921ce5-e48f-447b-9814-fe0d5ff60e76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f8a46c4-3b6f-4f50-8227-77b69154fb57", "name": "network-vif-deleted", "tag": "0b8186cd-d9f4-408f-9942-a8fcb3a46521"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:54:27.344354 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-15d482d0-e399-472c-b3cd-0e4610019309 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:27.345127 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-15d482d0-e399-472c-b3cd-0e4610019309 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] [instance: 6f8a46c4-3b6f-4f50-8227-77b69154fb57] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:27.363930 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-15d482d0-e399-472c-b3cd-0e4610019309 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:27.365100 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-15d482d0-e399-472c-b3cd-0e4610019309 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:27.365832 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-15d482d0-e399-472c-b3cd-0e4610019309 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:27.368524 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-15d482d0-e399-472c-b3cd-0e4610019309 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:27.369430 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-15d482d0-e399-472c-b3cd-0e4610019309 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:27.370084 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-15d482d0-e399-472c-b3cd-0e4610019309 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:27.371478 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-9add75a6-7ba7-4868-a566-6ea5f585583f req-c4921ce5-e48f-447b-9814-fe0d5ff60e76 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:27.372179 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-9add75a6-7ba7-4868-a566-6ea5f585583f req-c4921ce5-e48f-447b-9814-fe0d5ff60e76 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:27.372771 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-9add75a6-7ba7-4868-a566-6ea5f585583f req-c4921ce5-e48f-447b-9814-fe0d5ff60e76 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:27.401836 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-9add75a6-7ba7-4868-a566-6ea5f585583f req-c4921ce5-e48f-447b-9814-fe0d5ff60e76 service nova] Creating event network-vif-deleted:0b8186cd-d9f4-408f-9942-a8fcb3a46521 for instance 6f8a46c4-3b6f-4f50-8227-77b69154fb57 on n-h2-860284-1 Oct 04 21:54:27.415044 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-9add75a6-7ba7-4868-a566-6ea5f585583f req-c4921ce5-e48f-447b-9814-fe0d5ff60e76 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078276 Oct 04 21:54:27.421079 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1225/2535] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:54:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:54:27.651240 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-15d482d0-e399-472c-b3cd-0e4610019309 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f11c77afc74a16bea945dd84e72ebe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94d03be22238422eba835ed522baf9c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:27.686406 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-15d482d0-e399-472c-b3cd-0e4610019309 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] 10.222.0.43 "GET /compute/v2.1/servers/6f8a46c4-3b6f-4f50-8227-77b69154fb57" status: 200 len: 1302 microversion: 2.1 time: 0.348774 Oct 04 21:54:27.691637 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1311/2536] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:54:27 2022] GET /compute/v2.1/servers/6f8a46c4-3b6f-4f50-8227-77b69154fb57 => generated 1302 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:54:27.997078 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-57fb713c-757d-4238-af75-50974be777fd tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:27.997784 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-57fb713c-757d-4238-af75-50974be777fd tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] [instance: 830de6ad-adc6-4d16-ae9d-a29ae85e6cd2] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:28.012521 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-57fb713c-757d-4238-af75-50974be777fd tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:28.014377 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-57fb713c-757d-4238-af75-50974be777fd tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:28.015066 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-57fb713c-757d-4238-af75-50974be777fd tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:28.018023 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-57fb713c-757d-4238-af75-50974be777fd tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:28.026438 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-57fb713c-757d-4238-af75-50974be777fd tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:28.026898 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-57fb713c-757d-4238-af75-50974be777fd tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:28.091988 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-75df58b4-cd0b-405e-b258-c88486f16c00 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:28.094688 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-75df58b4-cd0b-405e-b258-c88486f16c00 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] [instance: 128b12e0-8fde-4113-95e9-0ecba563d8ec] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:28.124703 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-75df58b4-cd0b-405e-b258-c88486f16c00 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:28.125199 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-75df58b4-cd0b-405e-b258-c88486f16c00 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:28.125636 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-75df58b4-cd0b-405e-b258-c88486f16c00 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:28.134864 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-75df58b4-cd0b-405e-b258-c88486f16c00 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:28.135538 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-75df58b4-cd0b-405e-b258-c88486f16c00 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:28.135982 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-75df58b4-cd0b-405e-b258-c88486f16c00 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:28.241341 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-75df58b4-cd0b-405e-b258-c88486f16c00 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] 10.222.0.43 "GET /compute/v2.1/servers/128b12e0-8fde-4113-95e9-0ecba563d8ec/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.151261 Oct 04 21:54:28.262517 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1312/2537] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 21:54:28 2022] GET /compute/v2.1/servers/128b12e0-8fde-4113-95e9-0ecba563d8ec/os-volume_attachments => generated 197 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:54:28.296856 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-4dd0970a-d1a5-4790-a942-a75f2fecefd9 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:28.297660 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-4dd0970a-d1a5-4790-a942-a75f2fecefd9 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] [instance: eb6e098d-966d-478b-a69c-3746584e5509] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:28.311656 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4dd0970a-d1a5-4790-a942-a75f2fecefd9 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:28.312808 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4dd0970a-d1a5-4790-a942-a75f2fecefd9 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:28.313848 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4dd0970a-d1a5-4790-a942-a75f2fecefd9 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:28.314885 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4dd0970a-d1a5-4790-a942-a75f2fecefd9 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:28.315510 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4dd0970a-d1a5-4790-a942-a75f2fecefd9 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:28.316087 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4dd0970a-d1a5-4790-a942-a75f2fecefd9 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:29.186125 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-4dd0970a-d1a5-4790-a942-a75f2fecefd9 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47fbc4a6920d451cb1a2ad170de04921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43659cf5fed541e8883664bf17aced70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:29.190833 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-57fb713c-757d-4238-af75-50974be777fd tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:29.200052 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-4dd0970a-d1a5-4790-a942-a75f2fecefd9 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] 10.222.0.43 "GET /compute/v2.1/servers/eb6e098d-966d-478b-a69c-3746584e5509" status: 200 len: 1506 microversion: 2.1 time: 0.908213 Oct 04 21:54:29.200585 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1313/2538] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:54:28 2022] GET /compute/v2.1/servers/eb6e098d-966d-478b-a69c-3746584e5509 => generated 1506 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:54:29.215648 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-57fb713c-757d-4238-af75-50974be777fd tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:29.215648 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-57fb713c-757d-4238-af75-50974be777fd tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:29.215648 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-57fb713c-757d-4238-af75-50974be777fd tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] 10.222.0.43 "GET /compute/v2.1/servers/830de6ad-adc6-4d16-ae9d-a29ae85e6cd2" status: 200 len: 1874 microversion: 2.42 time: 1.214771 Oct 04 21:54:29.224367 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-b73b5561-c08b-40e2-888e-b00f2d231401 req-31ec6f77-c231-42af-9199-12a0d9fab3fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "830de6ad-adc6-4d16-ae9d-a29ae85e6cd2", "name": "network-vif-plugged", "status": "completed", "tag": "50799c10-da56-4cd6-bf7b-3175d2e729a5"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:54:29.226710 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1226/2539] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:54:27 2022] GET /compute/v2.1/servers/830de6ad-adc6-4d16-ae9d-a29ae85e6cd2 => generated 1874 bytes in 1235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:54:29.231652 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-fc8e5cd4-d2c1-4a2d-affb-375636ad441c tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:29.232440 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-fc8e5cd4-d2c1-4a2d-affb-375636ad441c tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] [instance: 6f8a46c4-3b6f-4f50-8227-77b69154fb57] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:29.236477 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-b73b5561-c08b-40e2-888e-b00f2d231401 req-31ec6f77-c231-42af-9199-12a0d9fab3fd service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:29.237308 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-b73b5561-c08b-40e2-888e-b00f2d231401 req-31ec6f77-c231-42af-9199-12a0d9fab3fd service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:29.237899 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-b73b5561-c08b-40e2-888e-b00f2d231401 req-31ec6f77-c231-42af-9199-12a0d9fab3fd service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:29.248148 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fc8e5cd4-d2c1-4a2d-affb-375636ad441c tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:29.248931 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fc8e5cd4-d2c1-4a2d-affb-375636ad441c tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:29.249386 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fc8e5cd4-d2c1-4a2d-affb-375636ad441c tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:29.253355 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fc8e5cd4-d2c1-4a2d-affb-375636ad441c tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:29.254088 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fc8e5cd4-d2c1-4a2d-affb-375636ad441c tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:29.256364 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fc8e5cd4-d2c1-4a2d-affb-375636ad441c tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:29.267672 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-b73b5561-c08b-40e2-888e-b00f2d231401 req-31ec6f77-c231-42af-9199-12a0d9fab3fd service nova] Creating event network-vif-plugged:50799c10-da56-4cd6-bf7b-3175d2e729a5 for instance 830de6ad-adc6-4d16-ae9d-a29ae85e6cd2 on n-h1-860284-1 Oct 04 21:54:29.285153 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-b73b5561-c08b-40e2-888e-b00f2d231401 req-31ec6f77-c231-42af-9199-12a0d9fab3fd service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064977 Oct 04 21:54:29.287325 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1314/2540] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:54:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:54:29.310935 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-8df4f5da-750a-4571-be66-8541e23eabc3 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:29.311687 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-fc8e5cd4-d2c1-4a2d-affb-375636ad441c tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] HTTP exception thrown: Instance 6f8a46c4-3b6f-4f50-8227-77b69154fb57 could not be found. Oct 04 21:54:29.313292 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-8df4f5da-750a-4571-be66-8541e23eabc3 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 3f0a02bc-7993-4849-8b3c-7572327b4799] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:29.315185 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-fc8e5cd4-d2c1-4a2d-affb-375636ad441c tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Request method failure captured: Oct 04 21:54:29.315185 n-d-860284-1 devstack@n-api.service[134101]: request: GET /compute/v2.1/servers/6f8a46c4-3b6f-4f50-8227-77b69154fb57 HTTP/1.1 Oct 04 21:54:29.315185 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 21:54:29.315185 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 21:54:29.315185 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 21:54:29.315185 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 21:54:29.315185 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 21:54:29.315185 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 21:54:29.315185 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 21:54:29.315185 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 21:54:29.315185 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPKq93ZqVRaIACQndBifmNiShHC_F9H_8X907rVQmqAdPgEYMKRvfZhT8Bm3TfKcmWFjaw-4qo7T0u8lcMShGyAqW9V8s6F9I10oW5Dq5aH_oZVyM6q3oL3LmkK-KFMBVNHSMm4-LlmygsfaGU7_1csYB4KFWBg9eMSH1x8uiDa3uCXs Oct 04 21:54:29.315185 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 21:54:29.315185 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 21:54:29.315185 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 21:54:29.315185 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 21:54:29.315185 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 21:54:29.315185 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 21:54:29.315185 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: 94d03be22238422eba835ed522baf9c3 Oct 04 21:54:29.315185 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-ListImageFiltersTestJSON-1919215498 Oct 04 21:54:29.315185 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 21:54:29.315185 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 21:54:29.315185 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/94d03be22238422eba835ed522baf9c3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_94d03be22238422eba835ed522baf9c3", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/94d03be22238422eba835ed522baf9c3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/94d03be22238422eba835ed522baf9c3"}]}] Oct 04 21:54:29.315185 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-ListImageFiltersTestJSON-1919215498 Oct 04 21:54:29.315185 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: 94d03be22238422eba835ed522baf9c3 Oct 04 21:54:29.315185 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1919215498 Oct 04 21:54:29.315185 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-ListImageFiltersTestJSON-1919215498-project Oct 04 21:54:29.315185 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 21:54:29.315185 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 21:54:29.315185 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 47f11c77afc74a16bea945dd84e72ebe Oct 04 21:54:29.315185 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-ListImageFiltersTestJSON-1919215498-project Oct 04 21:54:29.315185 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 21:54:29.315185 n-d-860284-1 devstack@n-api.service[134101]: exception: Instance 6f8a46c4-3b6f-4f50-8227-77b69154fb57 could not be found. Oct 04 21:54:29.315185 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': '6f8a46c4-3b6f-4f50-8227-77b69154fb57'} Oct 04 21:54:29.315185 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:54:29.315185 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:54:29.315185 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:54:29.315185 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:54:29.315185 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:54:29.315185 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:54:29.315185 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:54:29.315185 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:54:29.315185 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:54:29.315185 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:54:29.315185 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f8a46c4-3b6f-4f50-8227-77b69154fb57 could not be found. Oct 04 21:54:29.315185 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:54:29.315185 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:54:29.315185 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:54:29.315185 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:54:29.315185 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:54:29.315185 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:54:29.315185 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:54:29.315185 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:54:29.315185 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:54:29.315185 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:54:29.315185 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:54:29.315185 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:54:29.315185 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:54:29.315185 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:54:29.315185 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:54:29.315185 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:54:29.315185 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f8a46c4-3b6f-4f50-8227-77b69154fb57 could not be found. Oct 04 21:54:29.315185 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:54:29.315185 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:54:29.315185 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:54:29.319414 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:54:29.319414 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:54:29.319414 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:54:29.319414 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:54:29.319414 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:54:29.319414 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f8a46c4-3b6f-4f50-8227-77b69154fb57 could not be found. Oct 04 21:54:29.319414 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:54:29.320741 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-fc8e5cd4-d2c1-4a2d-affb-375636ad441c tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Returning 404 to user: Instance 6f8a46c4-3b6f-4f50-8227-77b69154fb57 could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:54:29.321914 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-fc8e5cd4-d2c1-4a2d-affb-375636ad441c tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] 10.222.0.43 "GET /compute/v2.1/servers/6f8a46c4-3b6f-4f50-8227-77b69154fb57" status: 404 len: 111 microversion: 2.1 time: 0.094118 Oct 04 21:54:29.327416 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1227/2541] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:54:29 2022] GET /compute/v2.1/servers/6f8a46c4-3b6f-4f50-8227-77b69154fb57 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:54:29.329498 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8df4f5da-750a-4571-be66-8541e23eabc3 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:29.330016 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8df4f5da-750a-4571-be66-8541e23eabc3 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:29.333597 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8df4f5da-750a-4571-be66-8541e23eabc3 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:29.340136 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-ff622b20-6f8f-4f68-8888-c94c30d7638c tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:29.345862 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8df4f5da-750a-4571-be66-8541e23eabc3 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:29.348539 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-ff622b20-6f8f-4f68-8888-c94c30d7638c tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] [instance: 128b12e0-8fde-4113-95e9-0ecba563d8ec] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:29.348988 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8df4f5da-750a-4571-be66-8541e23eabc3 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:29.350283 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8df4f5da-750a-4571-be66-8541e23eabc3 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:29.362825 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ff622b20-6f8f-4f68-8888-c94c30d7638c tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:29.363566 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ff622b20-6f8f-4f68-8888-c94c30d7638c tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:29.364168 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ff622b20-6f8f-4f68-8888-c94c30d7638c tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:29.365065 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ff622b20-6f8f-4f68-8888-c94c30d7638c tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:29.368589 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ff622b20-6f8f-4f68-8888-c94c30d7638c tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:29.370974 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ff622b20-6f8f-4f68-8888-c94c30d7638c tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:29.417364 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-8df4f5da-750a-4571-be66-8541e23eabc3 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 3f0a02bc-7993-4849-8b3c-7572327b4799] Going to try to terminate instance {{(pid=134102) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:54:29.439119 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-ff622b20-6f8f-4f68-8888-c94c30d7638c tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] 10.222.0.43 "GET /compute/v2.1/servers/128b12e0-8fde-4113-95e9-0ecba563d8ec/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.110243 Oct 04 21:54:29.440329 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1228/2542] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 21:54:29 2022] GET /compute/v2.1/servers/128b12e0-8fde-4113-95e9-0ecba563d8ec/os-volume_attachments => generated 197 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:54:29.457195 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-805202b3-8cc2-41ad-955c-b7d37308663f tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Calling method '.version_select at 0x7fbb2ee88550>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:29.494404 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:54:29.622604 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-8df4f5da-750a-4571-be66-8541e23eabc3 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "DELETE /compute/v2.1/servers/3f0a02bc-7993-4849-8b3c-7572327b4799" status: 204 len: 0 microversion: 2.1 time: 0.329548 Oct 04 21:54:29.628485 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1315/2543] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 21:54:29 2022] DELETE /compute/v2.1/servers/3f0a02bc-7993-4849-8b3c-7572327b4799 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:54:29.642493 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-3e3a5aad-4bd2-44cd-9bef-b4879993104f tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:29.643250 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-3e3a5aad-4bd2-44cd-9bef-b4879993104f tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 3f0a02bc-7993-4849-8b3c-7572327b4799] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:29.655723 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3e3a5aad-4bd2-44cd-9bef-b4879993104f tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:29.656224 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3e3a5aad-4bd2-44cd-9bef-b4879993104f tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:29.656669 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3e3a5aad-4bd2-44cd-9bef-b4879993104f tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:29.658599 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3e3a5aad-4bd2-44cd-9bef-b4879993104f tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:29.659355 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3e3a5aad-4bd2-44cd-9bef-b4879993104f tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:29.659809 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3e3a5aad-4bd2-44cd-9bef-b4879993104f tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:30.313752 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-805202b3-8cc2-41ad-955c-b7d37308663f tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] 10.222.0.43 "DELETE /compute/v2.1/images/6c120060-4737-4dc9-aaac-e8a598761714" status: 204 len: 0 microversion: 2.1 time: 0.872018 Oct 04 21:54:30.315057 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1229/2544] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:54:29 2022] DELETE /compute/v2.1/images/6c120060-4737-4dc9-aaac-e8a598761714 => generated 0 bytes in 874 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:54:30.321840 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-b6664188-c73d-4306-92cc-f45e693692f3 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:30.322786 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-b6664188-c73d-4306-92cc-f45e693692f3 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] [instance: eb6e098d-966d-478b-a69c-3746584e5509] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:30.333842 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b6664188-c73d-4306-92cc-f45e693692f3 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:30.337110 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b6664188-c73d-4306-92cc-f45e693692f3 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:30.339036 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b6664188-c73d-4306-92cc-f45e693692f3 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:30.341022 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b6664188-c73d-4306-92cc-f45e693692f3 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:30.344404 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b6664188-c73d-4306-92cc-f45e693692f3 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:30.345122 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b6664188-c73d-4306-92cc-f45e693692f3 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:30.404315 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-3e3a5aad-4bd2-44cd-9bef-b4879993104f tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ad048becf474fb972d4291422d810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dcfc7024fc49388c4bd5f25f03e60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:30.417661 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-3e3a5aad-4bd2-44cd-9bef-b4879993104f tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/3f0a02bc-7993-4849-8b3c-7572327b4799" status: 200 len: 1666 microversion: 2.1 time: 0.787583 Oct 04 21:54:30.418057 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1316/2545] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:54:29 2022] GET /compute/v2.1/servers/3f0a02bc-7993-4849-8b3c-7572327b4799 => generated 1666 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:54:30.427417 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-28fbc93c-4708-4aec-b053-cedd2a696f38 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:30.432305 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-28fbc93c-4708-4aec-b053-cedd2a696f38 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] [instance: 830de6ad-adc6-4d16-ae9d-a29ae85e6cd2] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:30.448563 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-28fbc93c-4708-4aec-b053-cedd2a696f38 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:30.449053 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-28fbc93c-4708-4aec-b053-cedd2a696f38 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:30.449488 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-28fbc93c-4708-4aec-b053-cedd2a696f38 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:30.450205 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-28fbc93c-4708-4aec-b053-cedd2a696f38 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:30.456086 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-28fbc93c-4708-4aec-b053-cedd2a696f38 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:30.456587 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-28fbc93c-4708-4aec-b053-cedd2a696f38 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:30.942737 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-b6664188-c73d-4306-92cc-f45e693692f3 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47fbc4a6920d451cb1a2ad170de04921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43659cf5fed541e8883664bf17aced70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:30.953817 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-b6664188-c73d-4306-92cc-f45e693692f3 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] 10.222.0.43 "GET /compute/v2.1/servers/eb6e098d-966d-478b-a69c-3746584e5509" status: 200 len: 1506 microversion: 2.1 time: 0.637442 Oct 04 21:54:30.957814 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1230/2546] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:54:30 2022] GET /compute/v2.1/servers/eb6e098d-966d-478b-a69c-3746584e5509 => generated 1506 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:54:30.971633 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-3215245d-2d16-442f-931c-f0808c4ad5e8 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Calling method '.version_select at 0x7fbb2eec03a0>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:31.123420 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-28fbc93c-4708-4aec-b053-cedd2a696f38 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:31.140127 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-28fbc93c-4708-4aec-b053-cedd2a696f38 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:31.141836 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-28fbc93c-4708-4aec-b053-cedd2a696f38 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:31.148625 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-28fbc93c-4708-4aec-b053-cedd2a696f38 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] 10.222.0.43 "GET /compute/v2.1/servers/830de6ad-adc6-4d16-ae9d-a29ae85e6cd2" status: 200 len: 1874 microversion: 2.42 time: 0.728398 Oct 04 21:54:31.149358 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1317/2547] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:54:30 2022] GET /compute/v2.1/servers/830de6ad-adc6-4d16-ae9d-a29ae85e6cd2 => generated 1874 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:54:31.163074 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-f2afcdbd-e439-4b79-b97b-9de9732e2eb7 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:31.173725 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-f2afcdbd-e439-4b79-b97b-9de9732e2eb7 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] [instance: 128b12e0-8fde-4113-95e9-0ecba563d8ec] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:31.187546 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f2afcdbd-e439-4b79-b97b-9de9732e2eb7 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:31.188047 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f2afcdbd-e439-4b79-b97b-9de9732e2eb7 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:31.188485 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f2afcdbd-e439-4b79-b97b-9de9732e2eb7 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:31.189240 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f2afcdbd-e439-4b79-b97b-9de9732e2eb7 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:31.189719 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f2afcdbd-e439-4b79-b97b-9de9732e2eb7 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:31.196304 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f2afcdbd-e439-4b79-b97b-9de9732e2eb7 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:31.287229 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-f2afcdbd-e439-4b79-b97b-9de9732e2eb7 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] 10.222.0.43 "GET /compute/v2.1/servers/128b12e0-8fde-4113-95e9-0ecba563d8ec/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.133090 Oct 04 21:54:31.292496 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1318/2548] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 21:54:31 2022] GET /compute/v2.1/servers/128b12e0-8fde-4113-95e9-0ecba563d8ec/os-volume_attachments => generated 197 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:54:31.338958 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-be2fa4c6-b841-4d5a-ba66-650d65604fba req-9c92ab10-6dc7-46f9-ad63-84aab3b360d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "830de6ad-adc6-4d16-ae9d-a29ae85e6cd2", "name": "network-vif-plugged", "status": "completed", "tag": "e9d774f8-8705-408f-87ab-9a4e3cdf9653"}, {"server_uuid": "830de6ad-adc6-4d16-ae9d-a29ae85e6cd2", "name": "network-vif-plugged", "status": "completed", "tag": "655956e8-ae26-4dcc-9d3e-b8894103890e"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:54:31.367339 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-be2fa4c6-b841-4d5a-ba66-650d65604fba req-9c92ab10-6dc7-46f9-ad63-84aab3b360d5 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:31.367831 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-be2fa4c6-b841-4d5a-ba66-650d65604fba req-9c92ab10-6dc7-46f9-ad63-84aab3b360d5 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:31.368270 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-be2fa4c6-b841-4d5a-ba66-650d65604fba req-9c92ab10-6dc7-46f9-ad63-84aab3b360d5 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:31.428731 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-be2fa4c6-b841-4d5a-ba66-650d65604fba req-9c92ab10-6dc7-46f9-ad63-84aab3b360d5 service nova] Creating event network-vif-plugged:e9d774f8-8705-408f-87ab-9a4e3cdf9653 for instance 830de6ad-adc6-4d16-ae9d-a29ae85e6cd2 on n-h1-860284-1 Oct 04 21:54:31.433352 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-be2fa4c6-b841-4d5a-ba66-650d65604fba req-9c92ab10-6dc7-46f9-ad63-84aab3b360d5 service nova] Creating event network-vif-plugged:655956e8-ae26-4dcc-9d3e-b8894103890e for instance 830de6ad-adc6-4d16-ae9d-a29ae85e6cd2 on n-h1-860284-1 Oct 04 21:54:31.456714 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-be2fa4c6-b841-4d5a-ba66-650d65604fba req-9c92ab10-6dc7-46f9-ad63-84aab3b360d5 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.125091 Oct 04 21:54:31.459791 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1319/2549] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:54:31 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:54:31.466257 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-78a25db9-0f2c-423c-a7ab-54f7fa66e651 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:31.473663 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-78a25db9-0f2c-423c-a7ab-54f7fa66e651 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 3f0a02bc-7993-4849-8b3c-7572327b4799] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:31.500073 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-78a25db9-0f2c-423c-a7ab-54f7fa66e651 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:31.500580 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-78a25db9-0f2c-423c-a7ab-54f7fa66e651 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:31.504702 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-78a25db9-0f2c-423c-a7ab-54f7fa66e651 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:31.504702 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-78a25db9-0f2c-423c-a7ab-54f7fa66e651 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:31.504702 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-78a25db9-0f2c-423c-a7ab-54f7fa66e651 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:31.504702 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-78a25db9-0f2c-423c-a7ab-54f7fa66e651 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:32.190263 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-3215245d-2d16-442f-931c-f0808c4ad5e8 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] 10.222.0.43 "DELETE /compute/v2.1/images/c413939e-3abe-410c-9b8d-c22990ecc1b2" status: 204 len: 0 microversion: 2.1 time: 1.230308 Oct 04 21:54:32.191355 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1231/2550] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:54:30 2022] DELETE /compute/v2.1/images/c413939e-3abe-410c-9b8d-c22990ecc1b2 => generated 0 bytes in 1232 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:54:32.198837 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-33ed1970-0692-4caf-a1d2-bc9b8e6cb2bc tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:32.200530 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-33ed1970-0692-4caf-a1d2-bc9b8e6cb2bc tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] [instance: eb6e098d-966d-478b-a69c-3746584e5509] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:32.215782 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-33ed1970-0692-4caf-a1d2-bc9b8e6cb2bc tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:32.223109 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-33ed1970-0692-4caf-a1d2-bc9b8e6cb2bc tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:32.229671 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-33ed1970-0692-4caf-a1d2-bc9b8e6cb2bc tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:32.231067 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-33ed1970-0692-4caf-a1d2-bc9b8e6cb2bc tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:32.231809 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-33ed1970-0692-4caf-a1d2-bc9b8e6cb2bc tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:32.233451 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-33ed1970-0692-4caf-a1d2-bc9b8e6cb2bc tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:32.967835 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-78a25db9-0f2c-423c-a7ab-54f7fa66e651 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ad048becf474fb972d4291422d810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dcfc7024fc49388c4bd5f25f03e60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:32.978280 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-78a25db9-0f2c-423c-a7ab-54f7fa66e651 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/3f0a02bc-7993-4849-8b3c-7572327b4799" status: 200 len: 1666 microversion: 2.1 time: 1.515860 Oct 04 21:54:32.978560 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1320/2551] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:54:31 2022] GET /compute/v2.1/servers/3f0a02bc-7993-4849-8b3c-7572327b4799 => generated 1666 bytes in 1518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:54:33.001288 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-01743207-6377-4b26-92e0-756e81d5d560 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:33.003159 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-01743207-6377-4b26-92e0-756e81d5d560 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] [instance: 830de6ad-adc6-4d16-ae9d-a29ae85e6cd2] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:33.023690 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-01743207-6377-4b26-92e0-756e81d5d560 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:33.029213 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-01743207-6377-4b26-92e0-756e81d5d560 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:33.029853 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-01743207-6377-4b26-92e0-756e81d5d560 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:33.038467 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-01743207-6377-4b26-92e0-756e81d5d560 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:33.039271 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-01743207-6377-4b26-92e0-756e81d5d560 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:33.039896 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-01743207-6377-4b26-92e0-756e81d5d560 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:33.390814 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-33ed1970-0692-4caf-a1d2-bc9b8e6cb2bc tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47fbc4a6920d451cb1a2ad170de04921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43659cf5fed541e8883664bf17aced70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:33.412847 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-33ed1970-0692-4caf-a1d2-bc9b8e6cb2bc tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] 10.222.0.43 "GET /compute/v2.1/servers/eb6e098d-966d-478b-a69c-3746584e5509" status: 200 len: 1486 microversion: 2.1 time: 1.220055 Oct 04 21:54:33.415861 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1232/2552] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:54:32 2022] GET /compute/v2.1/servers/eb6e098d-966d-478b-a69c-3746584e5509 => generated 1486 bytes in 1224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:54:33.433730 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-2014fab7-ad6d-497c-b309-db65eeb7f340 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] Calling method '.version_select at 0x7fbb2f9e9b80>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:33.936553 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-01743207-6377-4b26-92e0-756e81d5d560 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:33.949863 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-01743207-6377-4b26-92e0-756e81d5d560 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:33.954736 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-01743207-6377-4b26-92e0-756e81d5d560 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:33.958075 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-01743207-6377-4b26-92e0-756e81d5d560 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] 10.222.0.43 "GET /compute/v2.1/servers/830de6ad-adc6-4d16-ae9d-a29ae85e6cd2" status: 200 len: 1874 microversion: 2.42 time: 0.972699 Oct 04 21:54:33.959133 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1321/2553] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:54:32 2022] GET /compute/v2.1/servers/830de6ad-adc6-4d16-ae9d-a29ae85e6cd2 => generated 1874 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:54:33.964524 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-42d59cc3-2171-4a97-8136-de098ebf661b tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:33.967079 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-42d59cc3-2171-4a97-8136-de098ebf661b tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] [instance: 128b12e0-8fde-4113-95e9-0ecba563d8ec] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:33.974867 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-42d59cc3-2171-4a97-8136-de098ebf661b tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:33.976006 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-42d59cc3-2171-4a97-8136-de098ebf661b tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:33.976616 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-42d59cc3-2171-4a97-8136-de098ebf661b tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:33.977473 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-42d59cc3-2171-4a97-8136-de098ebf661b tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:33.978068 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-42d59cc3-2171-4a97-8136-de098ebf661b tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:33.978800 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-42d59cc3-2171-4a97-8136-de098ebf661b tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:34.056532 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-42d59cc3-2171-4a97-8136-de098ebf661b tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] 10.222.0.43 "GET /compute/v2.1/servers/128b12e0-8fde-4113-95e9-0ecba563d8ec/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.095987 Oct 04 21:54:34.059425 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1322/2554] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 21:54:33 2022] GET /compute/v2.1/servers/128b12e0-8fde-4113-95e9-0ecba563d8ec/os-volume_attachments => generated 197 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:54:34.076855 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-42b0459d-541e-4ddd-9818-0d9d34276405 req-44f262c0-8a5b-4ce7-b060-65f5ec69f11a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f0a02bc-7993-4849-8b3c-7572327b4799", "name": "network-vif-deleted", "tag": "c2e7099f-7aa9-4be4-9b2d-631622cf5151"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:54:34.127083 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-42b0459d-541e-4ddd-9818-0d9d34276405 req-44f262c0-8a5b-4ce7-b060-65f5ec69f11a service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:34.130958 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-42b0459d-541e-4ddd-9818-0d9d34276405 req-44f262c0-8a5b-4ce7-b060-65f5ec69f11a service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:34.133652 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-42b0459d-541e-4ddd-9818-0d9d34276405 req-44f262c0-8a5b-4ce7-b060-65f5ec69f11a service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:34.173911 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-42b0459d-541e-4ddd-9818-0d9d34276405 req-44f262c0-8a5b-4ce7-b060-65f5ec69f11a service nova] Creating event network-vif-deleted:c2e7099f-7aa9-4be4-9b2d-631622cf5151 for instance 3f0a02bc-7993-4849-8b3c-7572327b4799 on n-h2-860284-1 Oct 04 21:54:34.190440 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-42b0459d-541e-4ddd-9818-0d9d34276405 req-44f262c0-8a5b-4ce7-b060-65f5ec69f11a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129680 Oct 04 21:54:34.191080 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1323/2555] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:54:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:54:34.230716 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-cb060f1b-9c20-40ce-b2a6-50b562781b4f req-7ae8aee0-56b2-45e8-a5bb-03b29f14b1a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "830de6ad-adc6-4d16-ae9d-a29ae85e6cd2", "name": "network-vif-plugged", "status": "completed", "tag": "40124c44-6941-426e-92ed-972b6680a618"}, {"server_uuid": "830de6ad-adc6-4d16-ae9d-a29ae85e6cd2", "name": "network-vif-plugged", "status": "completed", "tag": "d7975b45-e2eb-4527-a16c-14ce6defb614"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:54:34.259066 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-cb060f1b-9c20-40ce-b2a6-50b562781b4f req-7ae8aee0-56b2-45e8-a5bb-03b29f14b1a5 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:34.259066 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-cb060f1b-9c20-40ce-b2a6-50b562781b4f req-7ae8aee0-56b2-45e8-a5bb-03b29f14b1a5 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:34.259066 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-cb060f1b-9c20-40ce-b2a6-50b562781b4f req-7ae8aee0-56b2-45e8-a5bb-03b29f14b1a5 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:34.283910 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-cb060f1b-9c20-40ce-b2a6-50b562781b4f req-7ae8aee0-56b2-45e8-a5bb-03b29f14b1a5 service nova] Creating event network-vif-plugged:40124c44-6941-426e-92ed-972b6680a618 for instance 830de6ad-adc6-4d16-ae9d-a29ae85e6cd2 on n-h1-860284-1 Oct 04 21:54:34.289176 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-cb060f1b-9c20-40ce-b2a6-50b562781b4f req-7ae8aee0-56b2-45e8-a5bb-03b29f14b1a5 service nova] Creating event network-vif-plugged:d7975b45-e2eb-4527-a16c-14ce6defb614 for instance 830de6ad-adc6-4d16-ae9d-a29ae85e6cd2 on n-h1-860284-1 Oct 04 21:54:34.298774 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-cb060f1b-9c20-40ce-b2a6-50b562781b4f req-7ae8aee0-56b2-45e8-a5bb-03b29f14b1a5 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.095261 Oct 04 21:54:34.300875 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1324/2556] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:54:34 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:54:34.310337 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-5745aca8-b6a6-484e-9ce0-9e8ba836af34 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1486065996", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:54:34.431570 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.network.neutron [None req-5745aca8-b6a6-484e-9ce0-9e8ba836af34 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] validate_networks() for [('315123d0-c9a7-4f3e-ba0c-4d1ba39ebdfa', None, None, None, None, None)] {{(pid=134102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:54:34.677038 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-2014fab7-ad6d-497c-b309-db65eeb7f340 tempest-ListImageFiltersTestJSON-1919215498 tempest-ListImageFiltersTestJSON-1919215498-project] 10.222.0.43 "DELETE /compute/v2.1/images/349017f0-8dbe-442c-9dc1-9e60148db893" status: 204 len: 0 microversion: 2.1 time: 1.258141 Oct 04 21:54:34.677616 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1233/2557] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:54:33 2022] DELETE /compute/v2.1/images/349017f0-8dbe-442c-9dc1-9e60148db893 => generated 0 bytes in 1259 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:54:34.683831 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-51af4ed7-d3df-4462-8006-c2ca57867754 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:34.684694 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-51af4ed7-d3df-4462-8006-c2ca57867754 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 3f0a02bc-7993-4849-8b3c-7572327b4799] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:34.707652 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-51af4ed7-d3df-4462-8006-c2ca57867754 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:34.708168 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-51af4ed7-d3df-4462-8006-c2ca57867754 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:34.708751 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-51af4ed7-d3df-4462-8006-c2ca57867754 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:34.709517 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-51af4ed7-d3df-4462-8006-c2ca57867754 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:34.709776 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-51af4ed7-d3df-4462-8006-c2ca57867754 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:34.710742 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-51af4ed7-d3df-4462-8006-c2ca57867754 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:34.749108 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-51af4ed7-d3df-4462-8006-c2ca57867754 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] HTTP exception thrown: Instance 3f0a02bc-7993-4849-8b3c-7572327b4799 could not be found. Oct 04 21:54:34.750722 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-51af4ed7-d3df-4462-8006-c2ca57867754 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Request method failure captured: Oct 04 21:54:34.750722 n-d-860284-1 devstack@n-api.service[134101]: request: GET /compute/v2.1/servers/3f0a02bc-7993-4849-8b3c-7572327b4799 HTTP/1.1 Oct 04 21:54:34.750722 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 21:54:34.750722 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 21:54:34.750722 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 21:54:34.750722 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 21:54:34.750722 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 21:54:34.750722 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 21:54:34.750722 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 21:54:34.750722 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 21:54:34.750722 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPKlsrwiQ9GesXhyqu67r1anP5Ibl0YaboKyeE7rK46nYSdK0TpUYcmL_wM01HTXcfIoJGuxcnLbc-VFhUn_6G-hdgqWaOF_j6r_rBrUrr7Ol7326k-Ze3kyxQxWppQH2Hmb4sX-zc9lQaszpgn74tbRppenQIsFu6fvipc6lYaDTkwQ Oct 04 21:54:34.750722 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 21:54:34.750722 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 21:54:34.750722 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 21:54:34.750722 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 21:54:34.750722 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 21:54:34.750722 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 21:54:34.750722 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: 78dcfc7024fc49388c4bd5f25f03e60d Oct 04 21:54:34.750722 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-LiveMigrationTest-87019555 Oct 04 21:54:34.750722 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 21:54:34.750722 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 21:54:34.750722 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/78dcfc7024fc49388c4bd5f25f03e60d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_78dcfc7024fc49388c4bd5f25f03e60d", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/78dcfc7024fc49388c4bd5f25f03e60d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/78dcfc7024fc49388c4bd5f25f03e60d"}]}] Oct 04 21:54:34.750722 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-LiveMigrationTest-87019555 Oct 04 21:54:34.750722 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: 78dcfc7024fc49388c4bd5f25f03e60d Oct 04 21:54:34.750722 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-LiveMigrationTest-87019555 Oct 04 21:54:34.750722 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-LiveMigrationTest-87019555-project Oct 04 21:54:34.750722 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 21:54:34.750722 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 21:54:34.750722 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: bb7ad048becf474fb972d4291422d810 Oct 04 21:54:34.750722 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-LiveMigrationTest-87019555-project Oct 04 21:54:34.750722 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 21:54:34.750722 n-d-860284-1 devstack@n-api.service[134101]: exception: Instance 3f0a02bc-7993-4849-8b3c-7572327b4799 could not be found. Oct 04 21:54:34.750722 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': '3f0a02bc-7993-4849-8b3c-7572327b4799'} Oct 04 21:54:34.750722 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:54:34.750722 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:54:34.750722 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:54:34.750722 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:54:34.750722 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:54:34.750722 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:54:34.750722 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:54:34.750722 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:54:34.750722 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:54:34.750722 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:54:34.750722 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f0a02bc-7993-4849-8b3c-7572327b4799 could not be found. Oct 04 21:54:34.750722 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:54:34.750722 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:54:34.750722 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:54:34.750722 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:54:34.750722 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:54:34.750722 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:54:34.750722 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:54:34.750722 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:54:34.750722 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:54:34.750722 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:54:34.750722 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:54:34.750722 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:54:34.750722 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:54:34.750722 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:54:34.750722 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:54:34.750722 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:54:34.750722 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f0a02bc-7993-4849-8b3c-7572327b4799 could not be found. Oct 04 21:54:34.750722 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:54:34.750722 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:54:34.750722 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:54:34.755413 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:54:34.755413 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:54:34.755413 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:54:34.755413 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:54:34.755413 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:54:34.755413 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f0a02bc-7993-4849-8b3c-7572327b4799 could not be found. Oct 04 21:54:34.755413 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:54:34.755413 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-51af4ed7-d3df-4462-8006-c2ca57867754 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Returning 404 to user: Instance 3f0a02bc-7993-4849-8b3c-7572327b4799 could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:54:34.757220 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-51af4ed7-d3df-4462-8006-c2ca57867754 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/3f0a02bc-7993-4849-8b3c-7572327b4799" status: 404 len: 111 microversion: 2.1 time: 0.073226 Oct 04 21:54:34.757978 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1234/2558] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:54:34 2022] GET /compute/v2.1/servers/3f0a02bc-7993-4849-8b3c-7572327b4799 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:54:34.776526 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-bb198765-b1fb-437a-a533-4ae7d4a36414 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '.version_select at 0x7fbb34943d30>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:34.828328 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-bb198765-b1fb-437a-a533-4ae7d4a36414 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1394490439" status: 202 len: 0 microversion: 2.1 time: 0.064688 Oct 04 21:54:34.830745 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1235/2559] 10.222.0.43 () {58 vars in 1221 bytes} [Tue Oct 4 21:54:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1394490439 => generated 0 bytes in 68 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:54:34.992737 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-7ea981a0-596d-4ef6-a232-d91d80d69f6d tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:34.993515 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-7ea981a0-596d-4ef6-a232-d91d80d69f6d tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] [instance: 830de6ad-adc6-4d16-ae9d-a29ae85e6cd2] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:35.010297 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7ea981a0-596d-4ef6-a232-d91d80d69f6d tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:35.010899 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7ea981a0-596d-4ef6-a232-d91d80d69f6d tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:35.013833 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7ea981a0-596d-4ef6-a232-d91d80d69f6d tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:35.019080 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7ea981a0-596d-4ef6-a232-d91d80d69f6d tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:35.021020 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7ea981a0-596d-4ef6-a232-d91d80d69f6d tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:35.025904 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7ea981a0-596d-4ef6-a232-d91d80d69f6d tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:35.595597 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-7ea981a0-596d-4ef6-a232-d91d80d69f6d tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:35.609378 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-7ea981a0-596d-4ef6-a232-d91d80d69f6d tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:35.612317 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-7ea981a0-596d-4ef6-a232-d91d80d69f6d tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:35.613543 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-7ea981a0-596d-4ef6-a232-d91d80d69f6d tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] 10.222.0.43 "GET /compute/v2.1/servers/830de6ad-adc6-4d16-ae9d-a29ae85e6cd2" status: 200 len: 1874 microversion: 2.42 time: 0.625721 Oct 04 21:54:35.632526 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1236/2560] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:54:34 2022] GET /compute/v2.1/servers/830de6ad-adc6-4d16-ae9d-a29ae85e6cd2 => generated 1874 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:54:35.632526 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-c1eb8980-5a1f-4f7b-806d-78de88d616e3 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:35.634562 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-c1eb8980-5a1f-4f7b-806d-78de88d616e3 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] [instance: 128b12e0-8fde-4113-95e9-0ecba563d8ec] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:35.647444 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c1eb8980-5a1f-4f7b-806d-78de88d616e3 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:35.648626 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c1eb8980-5a1f-4f7b-806d-78de88d616e3 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:35.659125 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c1eb8980-5a1f-4f7b-806d-78de88d616e3 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:35.660582 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c1eb8980-5a1f-4f7b-806d-78de88d616e3 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:35.661080 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c1eb8980-5a1f-4f7b-806d-78de88d616e3 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:35.661522 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c1eb8980-5a1f-4f7b-806d-78de88d616e3 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:35.724441 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-c1eb8980-5a1f-4f7b-806d-78de88d616e3 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] 10.222.0.43 "GET /compute/v2.1/servers/128b12e0-8fde-4113-95e9-0ecba563d8ec/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.096277 Oct 04 21:54:35.726864 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1237/2561] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 21:54:35 2022] GET /compute/v2.1/servers/128b12e0-8fde-4113-95e9-0ecba563d8ec/os-volume_attachments => generated 25 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 21:54:35.846780 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-5745aca8-b6a6-484e-9ce0-9e8ba836af34 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Flavor limits 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:54:35.847291 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-5745aca8-b6a6-484e-9ce0-9e8ba836af34 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Image limits 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:54:35.847668 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-5745aca8-b6a6-484e-9ce0-9e8ba836af34 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Flavor pref 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:54:35.848083 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-5745aca8-b6a6-484e-9ce0-9e8ba836af34 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Image pref 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:54:35.848496 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-5745aca8-b6a6-484e-9ce0-9e8ba836af34 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:54:35.862144 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5745aca8-b6a6-484e-9ce0-9e8ba836af34 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:35.862873 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5745aca8-b6a6-484e-9ce0-9e8ba836af34 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:35.863483 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5745aca8-b6a6-484e-9ce0-9e8ba836af34 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:35.865825 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5745aca8-b6a6-484e-9ce0-9e8ba836af34 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:35.866580 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5745aca8-b6a6-484e-9ce0-9e8ba836af34 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:35.869593 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5745aca8-b6a6-484e-9ce0-9e8ba836af34 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:35.909789 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-5745aca8-b6a6-484e-9ce0-9e8ba836af34 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Getting quotas for project 43659cf5fed541e8883664bf17aced70. Resources: {'instances', 'ram', 'cores'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:54:35.921892 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-5745aca8-b6a6-484e-9ce0-9e8ba836af34 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Getting quotas for user 47fbc4a6920d451cb1a2ad170de04921 and project 43659cf5fed541e8883664bf17aced70. Resources: {'instances', 'ram', 'cores'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:54:35.950508 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-5745aca8-b6a6-484e-9ce0-9e8ba836af34 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Going to run 1 instances... {{(pid=134102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:54:35.953995 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-5745aca8-b6a6-484e-9ce0-9e8ba836af34 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] [instance: a2e7312a-4e0d-4c47-b7c6-e1490a3f99d3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='58548514-5dac-426c-81f5-19e3fba33e23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:54:36.074770 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-6ebd8ad5-bf61-451f-afc4-b1e8312fb906 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-833728008", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452", "networks": [{"uuid": "bf1f73ec-4710-4924-88d6-e14d942458bc"}]}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:54:36.113411 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-5745aca8-b6a6-484e-9ce0-9e8ba836af34 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.809904 Oct 04 21:54:36.148489 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1325/2562] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 21:54:34 2022] POST /compute/v2.1/servers => generated 383 bytes in 1844 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:54:36.154025 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-ac5a05b1-1d4b-4f08-8bf4-1c57679e4019 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:36.172519 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-ac5a05b1-1d4b-4f08-8bf4-1c57679e4019 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] [instance: a2e7312a-4e0d-4c47-b7c6-e1490a3f99d3] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:36.274604 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.network.neutron [None req-6ebd8ad5-bf61-451f-afc4-b1e8312fb906 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] validate_networks() for [('bf1f73ec-4710-4924-88d6-e14d942458bc', None, None, None, None, None)] {{(pid=134101) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:54:36.728741 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-ac5a05b1-1d4b-4f08-8bf4-1c57679e4019 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47fbc4a6920d451cb1a2ad170de04921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43659cf5fed541e8883664bf17aced70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:36.751607 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-ac5a05b1-1d4b-4f08-8bf4-1c57679e4019 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] 10.222.0.43 "GET /compute/v2.1/servers/a2e7312a-4e0d-4c47-b7c6-e1490a3f99d3" status: 200 len: 1214 microversion: 2.1 time: 0.599704 Oct 04 21:54:36.754734 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1326/2563] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:54:36 2022] GET /compute/v2.1/servers/a2e7312a-4e0d-4c47-b7c6-e1490a3f99d3 => generated 1214 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:54:36.766463 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-1d5b9c12-24aa-4fc3-994d-e0e3f78c5c5b req-681c6bdb-8d32-45fb-820d-bedad6f95091 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "830de6ad-adc6-4d16-ae9d-a29ae85e6cd2", "name": "network-vif-plugged", "status": "completed", "tag": "adbb4038-b82a-4af8-902c-9694d969d663"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:54:36.798946 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-1d5b9c12-24aa-4fc3-994d-e0e3f78c5c5b req-681c6bdb-8d32-45fb-820d-bedad6f95091 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:36.801274 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-1d5b9c12-24aa-4fc3-994d-e0e3f78c5c5b req-681c6bdb-8d32-45fb-820d-bedad6f95091 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:36.802342 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-1d5b9c12-24aa-4fc3-994d-e0e3f78c5c5b req-681c6bdb-8d32-45fb-820d-bedad6f95091 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:36.844027 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-1d5b9c12-24aa-4fc3-994d-e0e3f78c5c5b req-681c6bdb-8d32-45fb-820d-bedad6f95091 service nova] Creating event network-vif-plugged:adbb4038-b82a-4af8-902c-9694d969d663 for instance 830de6ad-adc6-4d16-ae9d-a29ae85e6cd2 on n-h1-860284-1 Oct 04 21:54:36.856633 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-1d5b9c12-24aa-4fc3-994d-e0e3f78c5c5b req-681c6bdb-8d32-45fb-820d-bedad6f95091 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100156 Oct 04 21:54:36.859585 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1327/2564] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:54:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:54:36.867160 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-2aae6f5b-728a-4eb0-8e47-d93c5d2763fc tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:36.868167 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-2aae6f5b-728a-4eb0-8e47-d93c5d2763fc tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] [instance: 830de6ad-adc6-4d16-ae9d-a29ae85e6cd2] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:36.875926 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2aae6f5b-728a-4eb0-8e47-d93c5d2763fc tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:36.876825 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2aae6f5b-728a-4eb0-8e47-d93c5d2763fc tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:36.877487 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2aae6f5b-728a-4eb0-8e47-d93c5d2763fc tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:36.878429 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2aae6f5b-728a-4eb0-8e47-d93c5d2763fc tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:36.879139 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2aae6f5b-728a-4eb0-8e47-d93c5d2763fc tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:36.880017 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2aae6f5b-728a-4eb0-8e47-d93c5d2763fc tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:37.733430 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-2aae6f5b-728a-4eb0-8e47-d93c5d2763fc tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:37.755666 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-2aae6f5b-728a-4eb0-8e47-d93c5d2763fc tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:37.764797 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-2aae6f5b-728a-4eb0-8e47-d93c5d2763fc tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:37.769486 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-2aae6f5b-728a-4eb0-8e47-d93c5d2763fc tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] 10.222.0.43 "GET /compute/v2.1/servers/830de6ad-adc6-4d16-ae9d-a29ae85e6cd2" status: 200 len: 1874 microversion: 2.42 time: 0.907095 Oct 04 21:54:37.772354 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1328/2565] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:54:36 2022] GET /compute/v2.1/servers/830de6ad-adc6-4d16-ae9d-a29ae85e6cd2 => generated 1874 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:54:37.783730 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-5e97a292-f691-406d-b7bb-1712164c9709 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:37.786851 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-5e97a292-f691-406d-b7bb-1712164c9709 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 4e8281d2-9de4-42eb-94cc-417be864315d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:37.808739 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5e97a292-f691-406d-b7bb-1712164c9709 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:37.808880 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5e97a292-f691-406d-b7bb-1712164c9709 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:37.811556 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5e97a292-f691-406d-b7bb-1712164c9709 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:37.815055 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5e97a292-f691-406d-b7bb-1712164c9709 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:37.817155 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5e97a292-f691-406d-b7bb-1712164c9709 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:37.817683 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5e97a292-f691-406d-b7bb-1712164c9709 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:37.865147 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-6ebd8ad5-bf61-451f-afc4-b1e8312fb906 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Flavor limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:54:37.865620 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-6ebd8ad5-bf61-451f-afc4-b1e8312fb906 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Image limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:54:37.866059 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-6ebd8ad5-bf61-451f-afc4-b1e8312fb906 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Flavor pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:54:37.867256 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-6ebd8ad5-bf61-451f-afc4-b1e8312fb906 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Image pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:54:37.867689 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-6ebd8ad5-bf61-451f-afc4-b1e8312fb906 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:54:37.895200 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6ebd8ad5-bf61-451f-afc4-b1e8312fb906 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:37.895930 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6ebd8ad5-bf61-451f-afc4-b1e8312fb906 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:37.896883 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-5e97a292-f691-406d-b7bb-1712164c9709 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 4e8281d2-9de4-42eb-94cc-417be864315d] Going to try to terminate instance {{(pid=134102) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:54:37.898123 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6ebd8ad5-bf61-451f-afc4-b1e8312fb906 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:37.899216 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6ebd8ad5-bf61-451f-afc4-b1e8312fb906 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:37.899676 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6ebd8ad5-bf61-451f-afc4-b1e8312fb906 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:37.900114 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6ebd8ad5-bf61-451f-afc4-b1e8312fb906 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:37.954425 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-6ebd8ad5-bf61-451f-afc4-b1e8312fb906 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Getting quotas for project 1c4335ce6fd64a0397fbfb13e1b255ef. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:54:37.965638 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-6ebd8ad5-bf61-451f-afc4-b1e8312fb906 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Getting quotas for user 921f934be12045b3ac0b2c6ed5101bec and project 1c4335ce6fd64a0397fbfb13e1b255ef. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:54:38.008274 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-6ebd8ad5-bf61-451f-afc4-b1e8312fb906 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Going to run 1 instances... {{(pid=134101) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:54:38.024246 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-6ebd8ad5-bf61-451f-afc4-b1e8312fb906 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] [instance: f032bafe-c1e0-4556-af70-8692d48dd2e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='58548514-5dac-426c-81f5-19e3fba33e23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134101) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:54:38.115925 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-5e97a292-f691-406d-b7bb-1712164c9709 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "DELETE /compute/v2.1/servers/4e8281d2-9de4-42eb-94cc-417be864315d" status: 204 len: 0 microversion: 2.1 time: 0.340584 Oct 04 21:54:38.121610 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1329/2566] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 21:54:37 2022] DELETE /compute/v2.1/servers/4e8281d2-9de4-42eb-94cc-417be864315d => generated 0 bytes in 345 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:54:38.141319 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-3a868c70-952b-4e2b-b9d3-581a1761e0c4 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:38.142928 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-3a868c70-952b-4e2b-b9d3-581a1761e0c4 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] [instance: a2e7312a-4e0d-4c47-b7c6-e1490a3f99d3] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:38.164741 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3a868c70-952b-4e2b-b9d3-581a1761e0c4 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:38.165712 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3a868c70-952b-4e2b-b9d3-581a1761e0c4 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:38.166343 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3a868c70-952b-4e2b-b9d3-581a1761e0c4 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:38.167286 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3a868c70-952b-4e2b-b9d3-581a1761e0c4 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:38.170772 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3a868c70-952b-4e2b-b9d3-581a1761e0c4 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:38.171489 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3a868c70-952b-4e2b-b9d3-581a1761e0c4 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:38.209826 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-6ebd8ad5-bf61-451f-afc4-b1e8312fb906 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.140208 Oct 04 21:54:38.216100 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1238/2567] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 21:54:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 2147 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 21:54:38.236799 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-3f82a889-ccca-4482-bc22-0a16ddd5309f tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:38.237391 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-3f82a889-ccca-4482-bc22-0a16ddd5309f tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 4e8281d2-9de4-42eb-94cc-417be864315d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:38.249558 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3f82a889-ccca-4482-bc22-0a16ddd5309f tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:38.250067 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3f82a889-ccca-4482-bc22-0a16ddd5309f tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:38.250544 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3f82a889-ccca-4482-bc22-0a16ddd5309f tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:38.256405 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3f82a889-ccca-4482-bc22-0a16ddd5309f tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:38.257263 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3f82a889-ccca-4482-bc22-0a16ddd5309f tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:38.257924 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3f82a889-ccca-4482-bc22-0a16ddd5309f tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:38.541905 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-3a868c70-952b-4e2b-b9d3-581a1761e0c4 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47fbc4a6920d451cb1a2ad170de04921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43659cf5fed541e8883664bf17aced70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:38.559342 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-3a868c70-952b-4e2b-b9d3-581a1761e0c4 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] 10.222.0.43 "GET /compute/v2.1/servers/a2e7312a-4e0d-4c47-b7c6-e1490a3f99d3" status: 200 len: 1266 microversion: 2.1 time: 0.435692 Oct 04 21:54:38.562872 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1330/2568] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:54:38 2022] GET /compute/v2.1/servers/a2e7312a-4e0d-4c47-b7c6-e1490a3f99d3 => generated 1266 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:54:38.579230 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-bbdda2bb-7156-49f7-a9df-83424d786000 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:38.579917 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-bbdda2bb-7156-49f7-a9df-83424d786000 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] [instance: f032bafe-c1e0-4556-af70-8692d48dd2e2] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:38.581943 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:54:38.776805 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-bbdda2bb-7156-49f7-a9df-83424d786000 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921f934be12045b3ac0b2c6ed5101bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4335ce6fd64a0397fbfb13e1b255ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:38.790856 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-bbdda2bb-7156-49f7-a9df-83424d786000 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] 10.222.0.43 "GET /compute/v2.1/servers/f032bafe-c1e0-4556-af70-8692d48dd2e2" status: 200 len: 1217 microversion: 2.1 time: 0.226274 Oct 04 21:54:38.792341 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1331/2569] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:54:38 2022] GET /compute/v2.1/servers/f032bafe-c1e0-4556-af70-8692d48dd2e2 => generated 1217 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:54:38.816336 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-80cde2d9-496c-49cb-85a9-8a3b68cfaee1 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:38.817202 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-80cde2d9-496c-49cb-85a9-8a3b68cfaee1 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] [instance: 830de6ad-adc6-4d16-ae9d-a29ae85e6cd2] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:38.832076 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-80cde2d9-496c-49cb-85a9-8a3b68cfaee1 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:38.832644 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-80cde2d9-496c-49cb-85a9-8a3b68cfaee1 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:38.833678 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-80cde2d9-496c-49cb-85a9-8a3b68cfaee1 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:38.834415 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-80cde2d9-496c-49cb-85a9-8a3b68cfaee1 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:38.834889 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-80cde2d9-496c-49cb-85a9-8a3b68cfaee1 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:38.835923 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-80cde2d9-496c-49cb-85a9-8a3b68cfaee1 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:39.074628 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-3f82a889-ccca-4482-bc22-0a16ddd5309f tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ad048becf474fb972d4291422d810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dcfc7024fc49388c4bd5f25f03e60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:39.090235 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-3f82a889-ccca-4482-bc22-0a16ddd5309f tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/4e8281d2-9de4-42eb-94cc-417be864315d" status: 200 len: 1484 microversion: 2.1 time: 0.858320 Oct 04 21:54:39.091946 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1239/2570] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:54:38 2022] GET /compute/v2.1/servers/4e8281d2-9de4-42eb-94cc-417be864315d => generated 1484 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:54:39.585812 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-503b3051-4a59-4ed5-bd59-c4b6bb05acee tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:39.595142 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-503b3051-4a59-4ed5-bd59-c4b6bb05acee tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] [instance: a2e7312a-4e0d-4c47-b7c6-e1490a3f99d3] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:39.607340 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-503b3051-4a59-4ed5-bd59-c4b6bb05acee tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:39.608100 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-503b3051-4a59-4ed5-bd59-c4b6bb05acee tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:39.610253 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-503b3051-4a59-4ed5-bd59-c4b6bb05acee tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:39.611538 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-503b3051-4a59-4ed5-bd59-c4b6bb05acee tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:39.612532 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-503b3051-4a59-4ed5-bd59-c4b6bb05acee tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:39.614565 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-503b3051-4a59-4ed5-bd59-c4b6bb05acee tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:39.826776 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-503b3051-4a59-4ed5-bd59-c4b6bb05acee tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47fbc4a6920d451cb1a2ad170de04921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43659cf5fed541e8883664bf17aced70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:39.839039 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-503b3051-4a59-4ed5-bd59-c4b6bb05acee tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] 10.222.0.43 "GET /compute/v2.1/servers/a2e7312a-4e0d-4c47-b7c6-e1490a3f99d3" status: 200 len: 1272 microversion: 2.1 time: 0.257782 Oct 04 21:54:39.842299 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1240/2571] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:54:39 2022] GET /compute/v2.1/servers/a2e7312a-4e0d-4c47-b7c6-e1490a3f99d3 => generated 1272 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:54:39.847892 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-014d4888-9658-4ea8-a610-b80d496b5613 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:39.848528 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-014d4888-9658-4ea8-a610-b80d496b5613 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] [instance: f032bafe-c1e0-4556-af70-8692d48dd2e2] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:39.865391 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-014d4888-9658-4ea8-a610-b80d496b5613 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:39.868969 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-014d4888-9658-4ea8-a610-b80d496b5613 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:39.869653 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-014d4888-9658-4ea8-a610-b80d496b5613 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:39.871905 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-014d4888-9658-4ea8-a610-b80d496b5613 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:39.872835 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-014d4888-9658-4ea8-a610-b80d496b5613 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:39.875061 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-014d4888-9658-4ea8-a610-b80d496b5613 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:39.892234 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-80cde2d9-496c-49cb-85a9-8a3b68cfaee1 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:39.916182 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-80cde2d9-496c-49cb-85a9-8a3b68cfaee1 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:39.918441 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-80cde2d9-496c-49cb-85a9-8a3b68cfaee1 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:39.920550 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-80cde2d9-496c-49cb-85a9-8a3b68cfaee1 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] 10.222.0.43 "GET /compute/v2.1/servers/830de6ad-adc6-4d16-ae9d-a29ae85e6cd2" status: 200 len: 1874 microversion: 2.42 time: 1.107863 Oct 04 21:54:39.921493 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1332/2572] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:54:38 2022] GET /compute/v2.1/servers/830de6ad-adc6-4d16-ae9d-a29ae85e6cd2 => generated 1874 bytes in 1110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:54:40.206401 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-014d4888-9658-4ea8-a610-b80d496b5613 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921f934be12045b3ac0b2c6ed5101bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4335ce6fd64a0397fbfb13e1b255ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:40.224490 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-014d4888-9658-4ea8-a610-b80d496b5613 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] 10.222.0.43 "GET /compute/v2.1/servers/f032bafe-c1e0-4556-af70-8692d48dd2e2" status: 200 len: 1269 microversion: 2.1 time: 0.379066 Oct 04 21:54:40.240178 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1241/2573] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:54:39 2022] GET /compute/v2.1/servers/f032bafe-c1e0-4556-af70-8692d48dd2e2 => generated 1269 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:54:40.256444 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e23cc572-236b-484b-8bf8-f3a87e42e5bc tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:40.258554 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-e23cc572-236b-484b-8bf8-f3a87e42e5bc tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 4e8281d2-9de4-42eb-94cc-417be864315d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:40.280230 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e23cc572-236b-484b-8bf8-f3a87e42e5bc tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:40.281987 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e23cc572-236b-484b-8bf8-f3a87e42e5bc tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:40.290036 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e23cc572-236b-484b-8bf8-f3a87e42e5bc tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:40.292245 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e23cc572-236b-484b-8bf8-f3a87e42e5bc tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:40.316121 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e23cc572-236b-484b-8bf8-f3a87e42e5bc tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:40.317911 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e23cc572-236b-484b-8bf8-f3a87e42e5bc tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:40.332130 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-5df33ff1-3cfb-4f52-ac1e-b5d4909fc162 tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-1110303292", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452", "networks": [{"uuid": "afcb26c8-7cc6-446d-af9a-c8c0e9edd8f2"}]}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:54:40.420272 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.network.neutron [None req-5df33ff1-3cfb-4f52-ac1e-b5d4909fc162 tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] validate_networks() for [('afcb26c8-7cc6-446d-af9a-c8c0e9edd8f2', None, None, None, None, None)] {{(pid=134102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:54:41.035090 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-e23cc572-236b-484b-8bf8-f3a87e42e5bc tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ad048becf474fb972d4291422d810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dcfc7024fc49388c4bd5f25f03e60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:41.046578 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-e23cc572-236b-484b-8bf8-f3a87e42e5bc tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/4e8281d2-9de4-42eb-94cc-417be864315d" status: 200 len: 1484 microversion: 2.1 time: 0.804414 Oct 04 21:54:41.047463 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1242/2574] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:54:40 2022] GET /compute/v2.1/servers/4e8281d2-9de4-42eb-94cc-417be864315d => generated 1484 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:54:41.068486 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-0675b5ef-5921-4ae6-8646-6d714003de38 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:41.069697 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-0675b5ef-5921-4ae6-8646-6d714003de38 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] [instance: a2e7312a-4e0d-4c47-b7c6-e1490a3f99d3] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:41.089480 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0675b5ef-5921-4ae6-8646-6d714003de38 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:41.090219 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0675b5ef-5921-4ae6-8646-6d714003de38 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:41.091581 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0675b5ef-5921-4ae6-8646-6d714003de38 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:41.094735 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0675b5ef-5921-4ae6-8646-6d714003de38 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:41.095719 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0675b5ef-5921-4ae6-8646-6d714003de38 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:41.096545 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0675b5ef-5921-4ae6-8646-6d714003de38 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:41.519723 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-0675b5ef-5921-4ae6-8646-6d714003de38 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47fbc4a6920d451cb1a2ad170de04921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43659cf5fed541e8883664bf17aced70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:41.533775 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-0675b5ef-5921-4ae6-8646-6d714003de38 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] 10.222.0.43 "GET /compute/v2.1/servers/a2e7312a-4e0d-4c47-b7c6-e1490a3f99d3" status: 200 len: 1314 microversion: 2.1 time: 0.484985 Oct 04 21:54:41.549700 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1243/2575] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:54:41 2022] GET /compute/v2.1/servers/a2e7312a-4e0d-4c47-b7c6-e1490a3f99d3 => generated 1314 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:54:41.556485 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-a9283ffb-31df-4688-a65a-bbfb9ba0dc73 req-f2843346-5900-4c3b-a049-1f25b671eb9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e8281d2-9de4-42eb-94cc-417be864315d", "name": "network-vif-deleted", "tag": "291eba78-3b41-496a-92b2-60808ec215af"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:54:41.566738 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-a9283ffb-31df-4688-a65a-bbfb9ba0dc73 req-f2843346-5900-4c3b-a049-1f25b671eb9b service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:41.567477 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-a9283ffb-31df-4688-a65a-bbfb9ba0dc73 req-f2843346-5900-4c3b-a049-1f25b671eb9b service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:41.568083 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-a9283ffb-31df-4688-a65a-bbfb9ba0dc73 req-f2843346-5900-4c3b-a049-1f25b671eb9b service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:41.580265 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-a9283ffb-31df-4688-a65a-bbfb9ba0dc73 req-f2843346-5900-4c3b-a049-1f25b671eb9b service nova] Creating event network-vif-deleted:291eba78-3b41-496a-92b2-60808ec215af for instance 4e8281d2-9de4-42eb-94cc-417be864315d on n-h2-860284-1 Oct 04 21:54:41.589116 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-a9283ffb-31df-4688-a65a-bbfb9ba0dc73 req-f2843346-5900-4c3b-a049-1f25b671eb9b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037890 Oct 04 21:54:41.589989 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1244/2576] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:54:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:54:41.595629 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-5e92798d-80c1-44ac-86b1-b99f1be373a5 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:41.596632 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-5e92798d-80c1-44ac-86b1-b99f1be373a5 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] [instance: 830de6ad-adc6-4d16-ae9d-a29ae85e6cd2] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:41.605097 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5e92798d-80c1-44ac-86b1-b99f1be373a5 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:41.605834 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5e92798d-80c1-44ac-86b1-b99f1be373a5 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:41.606509 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5e92798d-80c1-44ac-86b1-b99f1be373a5 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:41.607397 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5e92798d-80c1-44ac-86b1-b99f1be373a5 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:41.608219 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5e92798d-80c1-44ac-86b1-b99f1be373a5 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:41.609315 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5e92798d-80c1-44ac-86b1-b99f1be373a5 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:42.042869 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-5df33ff1-3cfb-4f52-ac1e-b5d4909fc162 tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Flavor limits 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:54:42.042869 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-5df33ff1-3cfb-4f52-ac1e-b5d4909fc162 tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Image limits 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:54:42.043489 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-5df33ff1-3cfb-4f52-ac1e-b5d4909fc162 tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Flavor pref 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:54:42.044029 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-5df33ff1-3cfb-4f52-ac1e-b5d4909fc162 tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Image pref 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:54:42.044448 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-5df33ff1-3cfb-4f52-ac1e-b5d4909fc162 tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:54:42.062184 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5df33ff1-3cfb-4f52-ac1e-b5d4909fc162 tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:42.063010 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5df33ff1-3cfb-4f52-ac1e-b5d4909fc162 tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:42.063814 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5df33ff1-3cfb-4f52-ac1e-b5d4909fc162 tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:42.066799 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5df33ff1-3cfb-4f52-ac1e-b5d4909fc162 tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:42.068201 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5df33ff1-3cfb-4f52-ac1e-b5d4909fc162 tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:42.068949 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5df33ff1-3cfb-4f52-ac1e-b5d4909fc162 tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:42.095320 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-5df33ff1-3cfb-4f52-ac1e-b5d4909fc162 tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Getting quotas for project b2bfbf40c0004c41abc1fc2072eb3db2. Resources: {'instances', 'ram', 'cores'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:54:42.104996 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-5df33ff1-3cfb-4f52-ac1e-b5d4909fc162 tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Getting quotas for user 25e92d45b97b406589310789798f03cc and project b2bfbf40c0004c41abc1fc2072eb3db2. Resources: {'instances', 'ram', 'cores'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:54:42.123148 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-5df33ff1-3cfb-4f52-ac1e-b5d4909fc162 tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Going to run 1 instances... {{(pid=134102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:54:42.126553 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-5df33ff1-3cfb-4f52-ac1e-b5d4909fc162 tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] [instance: 4ec41646-6e85-45ab-9daf-d932a8223ffd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='58548514-5dac-426c-81f5-19e3fba33e23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:54:42.222860 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-5df33ff1-3cfb-4f52-ac1e-b5d4909fc162 tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.144565 Oct 04 21:54:42.227497 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1333/2577] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 21:54:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 2152 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:54:42.241756 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-64a58eee-781a-4e60-97c1-1085a431df4a tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:42.263100 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-5e92798d-80c1-44ac-86b1-b99f1be373a5 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:42.269730 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-64a58eee-781a-4e60-97c1-1085a431df4a tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] [instance: f032bafe-c1e0-4556-af70-8692d48dd2e2] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:42.301433 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-5e92798d-80c1-44ac-86b1-b99f1be373a5 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:42.307105 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-64a58eee-781a-4e60-97c1-1085a431df4a tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:42.309548 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-64a58eee-781a-4e60-97c1-1085a431df4a tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:42.309785 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-5e92798d-80c1-44ac-86b1-b99f1be373a5 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:42.311443 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-64a58eee-781a-4e60-97c1-1085a431df4a tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:42.311608 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-5e92798d-80c1-44ac-86b1-b99f1be373a5 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] 10.222.0.43 "GET /compute/v2.1/servers/830de6ad-adc6-4d16-ae9d-a29ae85e6cd2" status: 200 len: 2833 microversion: 2.42 time: 0.720059 Oct 04 21:54:42.315661 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1245/2578] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:54:41 2022] GET /compute/v2.1/servers/830de6ad-adc6-4d16-ae9d-a29ae85e6cd2 => generated 2833 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:54:42.318186 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-64a58eee-781a-4e60-97c1-1085a431df4a tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:42.319647 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-64a58eee-781a-4e60-97c1-1085a431df4a tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:42.320645 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-64a58eee-781a-4e60-97c1-1085a431df4a tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:42.325729 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-eba1333e-0327-4b4c-8831-3cf5f9e2ba73 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:42.327566 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-eba1333e-0327-4b4c-8831-3cf5f9e2ba73 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 4e8281d2-9de4-42eb-94cc-417be864315d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:42.343677 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-eba1333e-0327-4b4c-8831-3cf5f9e2ba73 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:42.344190 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-eba1333e-0327-4b4c-8831-3cf5f9e2ba73 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:42.344656 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-eba1333e-0327-4b4c-8831-3cf5f9e2ba73 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:42.357971 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-eba1333e-0327-4b4c-8831-3cf5f9e2ba73 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:42.359419 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-eba1333e-0327-4b4c-8831-3cf5f9e2ba73 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:42.361842 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-eba1333e-0327-4b4c-8831-3cf5f9e2ba73 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:42.410962 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-eba1333e-0327-4b4c-8831-3cf5f9e2ba73 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] HTTP exception thrown: Instance 4e8281d2-9de4-42eb-94cc-417be864315d could not be found. Oct 04 21:54:42.417029 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-eba1333e-0327-4b4c-8831-3cf5f9e2ba73 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Request method failure captured: Oct 04 21:54:42.417029 n-d-860284-1 devstack@n-api.service[134101]: request: GET /compute/v2.1/servers/4e8281d2-9de4-42eb-94cc-417be864315d HTTP/1.1 Oct 04 21:54:42.417029 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 21:54:42.417029 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 21:54:42.417029 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 21:54:42.417029 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 21:54:42.417029 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 21:54:42.417029 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 21:54:42.417029 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 21:54:42.417029 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 21:54:42.417029 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPKlsrwiQ9GesXhyqu67r1anP5Ibl0YaboKyeE7rK46nYSdK0TpUYcmL_wM01HTXcfIoJGuxcnLbc-VFhUn_6G-hdgqWaOF_j6r_rBrUrr7Ol7326k-Ze3kyxQxWppQH2Hmb4sX-zc9lQaszpgn74tbRppenQIsFu6fvipc6lYaDTkwQ Oct 04 21:54:42.417029 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 21:54:42.417029 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 21:54:42.417029 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 21:54:42.417029 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 21:54:42.417029 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 21:54:42.417029 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 21:54:42.417029 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: 78dcfc7024fc49388c4bd5f25f03e60d Oct 04 21:54:42.417029 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-LiveMigrationTest-87019555 Oct 04 21:54:42.417029 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 21:54:42.417029 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 21:54:42.417029 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/78dcfc7024fc49388c4bd5f25f03e60d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_78dcfc7024fc49388c4bd5f25f03e60d", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/78dcfc7024fc49388c4bd5f25f03e60d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/78dcfc7024fc49388c4bd5f25f03e60d"}]}] Oct 04 21:54:42.417029 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-LiveMigrationTest-87019555 Oct 04 21:54:42.417029 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: 78dcfc7024fc49388c4bd5f25f03e60d Oct 04 21:54:42.417029 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-LiveMigrationTest-87019555 Oct 04 21:54:42.417029 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-LiveMigrationTest-87019555-project Oct 04 21:54:42.417029 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 21:54:42.417029 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 21:54:42.417029 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: bb7ad048becf474fb972d4291422d810 Oct 04 21:54:42.417029 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-LiveMigrationTest-87019555-project Oct 04 21:54:42.417029 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 21:54:42.417029 n-d-860284-1 devstack@n-api.service[134101]: exception: Instance 4e8281d2-9de4-42eb-94cc-417be864315d could not be found. Oct 04 21:54:42.417029 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': '4e8281d2-9de4-42eb-94cc-417be864315d'} Oct 04 21:54:42.417029 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:54:42.417029 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:54:42.417029 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:54:42.417029 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:54:42.417029 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:54:42.417029 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:54:42.417029 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:54:42.417029 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:54:42.417029 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:54:42.417029 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:54:42.417029 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e8281d2-9de4-42eb-94cc-417be864315d could not be found. Oct 04 21:54:42.417029 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:54:42.417029 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:54:42.417029 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:54:42.417029 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:54:42.417029 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:54:42.417029 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:54:42.417029 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:54:42.417029 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:54:42.417029 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:54:42.417029 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:54:42.417029 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:54:42.417029 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:54:42.417029 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:54:42.417029 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:54:42.417029 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:54:42.417029 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:54:42.417029 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e8281d2-9de4-42eb-94cc-417be864315d could not be found. Oct 04 21:54:42.417029 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:54:42.417029 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:54:42.417029 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:54:42.421039 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:54:42.421039 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:54:42.421039 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:54:42.421039 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:54:42.421039 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:54:42.421039 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e8281d2-9de4-42eb-94cc-417be864315d could not be found. Oct 04 21:54:42.421039 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:54:42.427150 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-eba1333e-0327-4b4c-8831-3cf5f9e2ba73 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Returning 404 to user: Instance 4e8281d2-9de4-42eb-94cc-417be864315d could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:54:42.428293 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-eba1333e-0327-4b4c-8831-3cf5f9e2ba73 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/4e8281d2-9de4-42eb-94cc-417be864315d" status: 404 len: 111 microversion: 2.1 time: 0.111382 Oct 04 21:54:42.430187 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1246/2579] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:54:42 2022] GET /compute/v2.1/servers/4e8281d2-9de4-42eb-94cc-417be864315d => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:54:42.446599 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-3d11b836-6eef-4192-b7a9-a60d508a65e0 tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:42.447484 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-3d11b836-6eef-4192-b7a9-a60d508a65e0 tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] [instance: 4ec41646-6e85-45ab-9daf-d932a8223ffd] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:42.808409 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-3d11b836-6eef-4192-b7a9-a60d508a65e0 tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25e92d45b97b406589310789798f03cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bfbf40c0004c41abc1fc2072eb3db2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:42.826329 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-3d11b836-6eef-4192-b7a9-a60d508a65e0 tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] 10.222.0.43 "GET /compute/v2.1/servers/4ec41646-6e85-45ab-9daf-d932a8223ffd" status: 200 len: 1217 microversion: 2.1 time: 0.387129 Oct 04 21:54:42.849434 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1247/2580] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:54:42 2022] GET /compute/v2.1/servers/4ec41646-6e85-45ab-9daf-d932a8223ffd => generated 1217 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:54:42.863602 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-c2d3d29e-68cc-4be1-9b8b-4a9d2a69f506 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:42.864161 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-c2d3d29e-68cc-4be1-9b8b-4a9d2a69f506 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] [instance: 830de6ad-adc6-4d16-ae9d-a29ae85e6cd2] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:42.880199 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c2d3d29e-68cc-4be1-9b8b-4a9d2a69f506 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:42.882781 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c2d3d29e-68cc-4be1-9b8b-4a9d2a69f506 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:42.884295 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c2d3d29e-68cc-4be1-9b8b-4a9d2a69f506 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:42.886670 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c2d3d29e-68cc-4be1-9b8b-4a9d2a69f506 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:42.891612 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c2d3d29e-68cc-4be1-9b8b-4a9d2a69f506 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:42.893909 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c2d3d29e-68cc-4be1-9b8b-4a9d2a69f506 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:43.178859 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-c2d3d29e-68cc-4be1-9b8b-4a9d2a69f506 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] 10.222.0.43 "GET /compute/v2.1/servers/830de6ad-adc6-4d16-ae9d-a29ae85e6cd2/os-interface" status: 200 len: 1832 microversion: 2.42 time: 0.327786 Oct 04 21:54:43.179807 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1248/2581] 10.222.0.43 () {60 vars in 1316 bytes} [Tue Oct 4 21:54:42 2022] GET /compute/v2.1/servers/830de6ad-adc6-4d16-ae9d-a29ae85e6cd2/os-interface => generated 1832 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:54:43.185066 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-a15802e5-5dfd-4faa-b233-a0af276453bd tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:43.185768 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-a15802e5-5dfd-4faa-b233-a0af276453bd tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 10062905-54d7-47e2-b621-522e0954b72b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:43.192508 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=88,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:54:43.217505 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a15802e5-5dfd-4faa-b233-a0af276453bd tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:43.218032 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a15802e5-5dfd-4faa-b233-a0af276453bd tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:43.218482 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a15802e5-5dfd-4faa-b233-a0af276453bd tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:43.219208 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a15802e5-5dfd-4faa-b233-a0af276453bd tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:43.219668 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a15802e5-5dfd-4faa-b233-a0af276453bd tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:43.220095 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a15802e5-5dfd-4faa-b233-a0af276453bd tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:43.305305 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-a15802e5-5dfd-4faa-b233-a0af276453bd tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 10062905-54d7-47e2-b621-522e0954b72b] Going to try to terminate instance {{(pid=134101) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:54:43.369710 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-64a58eee-781a-4e60-97c1-1085a431df4a tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921f934be12045b3ac0b2c6ed5101bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4335ce6fd64a0397fbfb13e1b255ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:43.387880 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-64a58eee-781a-4e60-97c1-1085a431df4a tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] 10.222.0.43 "GET /compute/v2.1/servers/f032bafe-c1e0-4556-af70-8692d48dd2e2" status: 200 len: 1317 microversion: 2.1 time: 1.158123 Oct 04 21:54:43.410890 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1334/2582] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:54:42 2022] GET /compute/v2.1/servers/f032bafe-c1e0-4556-af70-8692d48dd2e2 => generated 1317 bytes in 1182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:54:43.420399 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=100 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:54:43.427133 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-02cf8fb4-84ee-4eb9-a703-606b017aaf76 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:43.427969 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-02cf8fb4-84ee-4eb9-a703-606b017aaf76 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] [instance: a2e7312a-4e0d-4c47-b7c6-e1490a3f99d3] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:43.435152 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-02cf8fb4-84ee-4eb9-a703-606b017aaf76 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:43.435876 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-02cf8fb4-84ee-4eb9-a703-606b017aaf76 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:43.436506 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-02cf8fb4-84ee-4eb9-a703-606b017aaf76 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:43.439230 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-02cf8fb4-84ee-4eb9-a703-606b017aaf76 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:43.439878 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-02cf8fb4-84ee-4eb9-a703-606b017aaf76 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:43.440475 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-02cf8fb4-84ee-4eb9-a703-606b017aaf76 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:43.506568 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-a15802e5-5dfd-4faa-b233-a0af276453bd tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "DELETE /compute/v2.1/servers/10062905-54d7-47e2-b621-522e0954b72b" status: 204 len: 0 microversion: 2.1 time: 0.323166 Oct 04 21:54:43.507578 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1249/2583] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 21:54:43 2022] DELETE /compute/v2.1/servers/10062905-54d7-47e2-b621-522e0954b72b => generated 0 bytes in 327 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:54:43.514711 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-e02d2356-84bb-4884-b16f-fa0a152e3d12 req-4a93b475-2a3c-4d19-a883-97a357e9152b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2e7312a-4e0d-4c47-b7c6-e1490a3f99d3", "tag": "84329f78-5a5f-4079-a6af-5e53311debfa"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:54:43.531470 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-e02d2356-84bb-4884-b16f-fa0a152e3d12 req-4a93b475-2a3c-4d19-a883-97a357e9152b service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:43.532372 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-e02d2356-84bb-4884-b16f-fa0a152e3d12 req-4a93b475-2a3c-4d19-a883-97a357e9152b service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:43.533009 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-e02d2356-84bb-4884-b16f-fa0a152e3d12 req-4a93b475-2a3c-4d19-a883-97a357e9152b service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:43.551883 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-e02d2356-84bb-4884-b16f-fa0a152e3d12 req-4a93b475-2a3c-4d19-a883-97a357e9152b service nova] Creating event network-changed:84329f78-5a5f-4079-a6af-5e53311debfa for instance a2e7312a-4e0d-4c47-b7c6-e1490a3f99d3 on n-h2-860284-1 Oct 04 21:54:43.560218 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-e02d2356-84bb-4884-b16f-fa0a152e3d12 req-4a93b475-2a3c-4d19-a883-97a357e9152b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050975 Oct 04 21:54:43.561900 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1250/2584] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:54:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:54:43.571807 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-f6601d00-b9e2-4018-b3b8-8cb9abc01c8f tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:43.573030 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-f6601d00-b9e2-4018-b3b8-8cb9abc01c8f tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 10062905-54d7-47e2-b621-522e0954b72b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:43.599190 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f6601d00-b9e2-4018-b3b8-8cb9abc01c8f tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:43.601410 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f6601d00-b9e2-4018-b3b8-8cb9abc01c8f tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:43.602002 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f6601d00-b9e2-4018-b3b8-8cb9abc01c8f tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:43.605399 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f6601d00-b9e2-4018-b3b8-8cb9abc01c8f tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:43.605900 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f6601d00-b9e2-4018-b3b8-8cb9abc01c8f tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:43.606420 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f6601d00-b9e2-4018-b3b8-8cb9abc01c8f tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:44.104848 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-02cf8fb4-84ee-4eb9-a703-606b017aaf76 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47fbc4a6920d451cb1a2ad170de04921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43659cf5fed541e8883664bf17aced70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:44.108368 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:54:44.117753 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-02cf8fb4-84ee-4eb9-a703-606b017aaf76 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] 10.222.0.43 "GET /compute/v2.1/servers/a2e7312a-4e0d-4c47-b7c6-e1490a3f99d3" status: 200 len: 1314 microversion: 2.1 time: 0.705534 Oct 04 21:54:44.124676 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1335/2585] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:54:43 2022] GET /compute/v2.1/servers/a2e7312a-4e0d-4c47-b7c6-e1490a3f99d3 => generated 1314 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:54:44.149635 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-1c09d57c-e9eb-488c-9701-08c2b0edbd54 tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:44.150500 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-1c09d57c-e9eb-488c-9701-08c2b0edbd54 tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] [instance: 4ec41646-6e85-45ab-9daf-d932a8223ffd] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:44.161081 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1c09d57c-e9eb-488c-9701-08c2b0edbd54 tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:44.167462 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1c09d57c-e9eb-488c-9701-08c2b0edbd54 tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:44.168232 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1c09d57c-e9eb-488c-9701-08c2b0edbd54 tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:44.168998 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1c09d57c-e9eb-488c-9701-08c2b0edbd54 tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:44.170536 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1c09d57c-e9eb-488c-9701-08c2b0edbd54 tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:44.170993 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1c09d57c-e9eb-488c-9701-08c2b0edbd54 tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:44.555645 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-f6601d00-b9e2-4018-b3b8-8cb9abc01c8f tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ad048becf474fb972d4291422d810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dcfc7024fc49388c4bd5f25f03e60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:44.576545 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-f6601d00-b9e2-4018-b3b8-8cb9abc01c8f tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/10062905-54d7-47e2-b621-522e0954b72b" status: 200 len: 1499 microversion: 2.1 time: 1.012865 Oct 04 21:54:44.577682 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1251/2586] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:54:43 2022] GET /compute/v2.1/servers/10062905-54d7-47e2-b621-522e0954b72b => generated 1499 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:54:44.582672 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-a23580d6-d16c-4445-b108-66ffe41d621f tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:44.583614 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-a23580d6-d16c-4445-b108-66ffe41d621f tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] [instance: f032bafe-c1e0-4556-af70-8692d48dd2e2] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:44.591077 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a23580d6-d16c-4445-b108-66ffe41d621f tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:44.591906 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a23580d6-d16c-4445-b108-66ffe41d621f tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:44.592575 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a23580d6-d16c-4445-b108-66ffe41d621f tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:44.593534 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a23580d6-d16c-4445-b108-66ffe41d621f tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:44.594228 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a23580d6-d16c-4445-b108-66ffe41d621f tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:44.594895 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a23580d6-d16c-4445-b108-66ffe41d621f tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:44.765555 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-1c09d57c-e9eb-488c-9701-08c2b0edbd54 tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25e92d45b97b406589310789798f03cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bfbf40c0004c41abc1fc2072eb3db2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:44.776933 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-1c09d57c-e9eb-488c-9701-08c2b0edbd54 tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] 10.222.0.43 "GET /compute/v2.1/servers/4ec41646-6e85-45ab-9daf-d932a8223ffd" status: 200 len: 1269 microversion: 2.1 time: 0.650336 Oct 04 21:54:44.799056 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1336/2587] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:54:44 2022] GET /compute/v2.1/servers/4ec41646-6e85-45ab-9daf-d932a8223ffd => generated 1269 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:54:45.156641 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-76189eff-acc3-4523-a88d-47b02a6731a6 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:45.157470 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-76189eff-acc3-4523-a88d-47b02a6731a6 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] [instance: a2e7312a-4e0d-4c47-b7c6-e1490a3f99d3] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:45.171428 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-76189eff-acc3-4523-a88d-47b02a6731a6 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:45.171714 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-76189eff-acc3-4523-a88d-47b02a6731a6 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:45.174321 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-76189eff-acc3-4523-a88d-47b02a6731a6 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:45.175462 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-76189eff-acc3-4523-a88d-47b02a6731a6 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:45.183476 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-76189eff-acc3-4523-a88d-47b02a6731a6 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:45.184373 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-76189eff-acc3-4523-a88d-47b02a6731a6 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:46.529367 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-a23580d6-d16c-4445-b108-66ffe41d621f tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921f934be12045b3ac0b2c6ed5101bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4335ce6fd64a0397fbfb13e1b255ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:46.538907 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-a23580d6-d16c-4445-b108-66ffe41d621f tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] 10.222.0.43 "GET /compute/v2.1/servers/f032bafe-c1e0-4556-af70-8692d48dd2e2" status: 200 len: 1317 microversion: 2.1 time: 1.958963 Oct 04 21:54:46.539714 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1252/2588] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:54:44 2022] GET /compute/v2.1/servers/f032bafe-c1e0-4556-af70-8692d48dd2e2 => generated 1317 bytes in 1961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:54:46.581761 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-9bad103f-1ba3-42be-82d6-ffce56a7648e tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:46.583445 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-9bad103f-1ba3-42be-82d6-ffce56a7648e tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 10062905-54d7-47e2-b621-522e0954b72b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:46.608559 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9bad103f-1ba3-42be-82d6-ffce56a7648e tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:46.609104 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9bad103f-1ba3-42be-82d6-ffce56a7648e tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:46.609560 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9bad103f-1ba3-42be-82d6-ffce56a7648e tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:46.614423 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9bad103f-1ba3-42be-82d6-ffce56a7648e tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:46.615885 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9bad103f-1ba3-42be-82d6-ffce56a7648e tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:46.617651 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9bad103f-1ba3-42be-82d6-ffce56a7648e tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:46.853120 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-76189eff-acc3-4523-a88d-47b02a6731a6 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47fbc4a6920d451cb1a2ad170de04921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43659cf5fed541e8883664bf17aced70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:46.873920 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-76189eff-acc3-4523-a88d-47b02a6731a6 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] 10.222.0.43 "GET /compute/v2.1/servers/a2e7312a-4e0d-4c47-b7c6-e1490a3f99d3" status: 200 len: 1314 microversion: 2.1 time: 1.718812 Oct 04 21:54:46.877267 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1337/2589] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:54:45 2022] GET /compute/v2.1/servers/a2e7312a-4e0d-4c47-b7c6-e1490a3f99d3 => generated 1314 bytes in 1728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:54:46.886783 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-1d1b69cb-ea34-45fe-b033-7d1222ba4cbd tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:46.889914 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-1d1b69cb-ea34-45fe-b033-7d1222ba4cbd tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] [instance: 4ec41646-6e85-45ab-9daf-d932a8223ffd] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:46.911888 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1d1b69cb-ea34-45fe-b033-7d1222ba4cbd tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:46.914579 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1d1b69cb-ea34-45fe-b033-7d1222ba4cbd tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:46.915318 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1d1b69cb-ea34-45fe-b033-7d1222ba4cbd tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:46.917675 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1d1b69cb-ea34-45fe-b033-7d1222ba4cbd tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:46.918338 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1d1b69cb-ea34-45fe-b033-7d1222ba4cbd tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:46.918985 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1d1b69cb-ea34-45fe-b033-7d1222ba4cbd tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:47.114021 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-9bad103f-1ba3-42be-82d6-ffce56a7648e tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ad048becf474fb972d4291422d810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dcfc7024fc49388c4bd5f25f03e60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:47.129702 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-9bad103f-1ba3-42be-82d6-ffce56a7648e tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/10062905-54d7-47e2-b621-522e0954b72b" status: 200 len: 1499 microversion: 2.1 time: 0.561966 Oct 04 21:54:47.135379 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1253/2590] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:54:46 2022] GET /compute/v2.1/servers/10062905-54d7-47e2-b621-522e0954b72b => generated 1499 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:54:47.144038 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-2268252d-17e5-4e67-ba58-e94fd53ea9ed req-c747f451-e795-4d19-9b5b-607981413fb2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f032bafe-c1e0-4556-af70-8692d48dd2e2", "tag": "ad84d157-9907-4558-9f67-25a9f944e7ed"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:54:47.154303 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-1d1b69cb-ea34-45fe-b033-7d1222ba4cbd tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25e92d45b97b406589310789798f03cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bfbf40c0004c41abc1fc2072eb3db2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:47.169329 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-2268252d-17e5-4e67-ba58-e94fd53ea9ed req-c747f451-e795-4d19-9b5b-607981413fb2 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:47.169670 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-1d1b69cb-ea34-45fe-b033-7d1222ba4cbd tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] 10.222.0.43 "GET /compute/v2.1/servers/4ec41646-6e85-45ab-9daf-d932a8223ffd" status: 200 len: 1275 microversion: 2.1 time: 0.290522 Oct 04 21:54:47.170452 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-2268252d-17e5-4e67-ba58-e94fd53ea9ed req-c747f451-e795-4d19-9b5b-607981413fb2 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:47.170884 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-2268252d-17e5-4e67-ba58-e94fd53ea9ed req-c747f451-e795-4d19-9b5b-607981413fb2 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:47.171754 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1338/2591] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:54:46 2022] GET /compute/v2.1/servers/4ec41646-6e85-45ab-9daf-d932a8223ffd => generated 1275 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:54:47.203869 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-2268252d-17e5-4e67-ba58-e94fd53ea9ed req-c747f451-e795-4d19-9b5b-607981413fb2 service nova] Creating event network-changed:ad84d157-9907-4558-9f67-25a9f944e7ed for instance f032bafe-c1e0-4556-af70-8692d48dd2e2 on n-h2-860284-1 Oct 04 21:54:47.210422 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-2268252d-17e5-4e67-ba58-e94fd53ea9ed req-c747f451-e795-4d19-9b5b-607981413fb2 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073476 Oct 04 21:54:47.211670 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1254/2592] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:54:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:54:47.564971 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-aa189043-42fa-436a-b572-c9aa20355c8f tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:47.565592 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-aa189043-42fa-436a-b572-c9aa20355c8f tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] [instance: f032bafe-c1e0-4556-af70-8692d48dd2e2] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:47.579315 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-aa189043-42fa-436a-b572-c9aa20355c8f tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:47.579812 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-aa189043-42fa-436a-b572-c9aa20355c8f tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:47.585793 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-aa189043-42fa-436a-b572-c9aa20355c8f tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:47.590171 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-aa189043-42fa-436a-b572-c9aa20355c8f tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:47.590984 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-aa189043-42fa-436a-b572-c9aa20355c8f tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:47.591706 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-aa189043-42fa-436a-b572-c9aa20355c8f tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:47.905337 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-6bfa6c8b-aff5-44e2-aaae-75483894d624 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:47.906203 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-6bfa6c8b-aff5-44e2-aaae-75483894d624 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] [instance: a2e7312a-4e0d-4c47-b7c6-e1490a3f99d3] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:47.921719 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6bfa6c8b-aff5-44e2-aaae-75483894d624 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:47.922232 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6bfa6c8b-aff5-44e2-aaae-75483894d624 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:47.922730 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6bfa6c8b-aff5-44e2-aaae-75483894d624 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:47.923507 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6bfa6c8b-aff5-44e2-aaae-75483894d624 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:47.923998 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6bfa6c8b-aff5-44e2-aaae-75483894d624 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:47.924435 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6bfa6c8b-aff5-44e2-aaae-75483894d624 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:47.937756 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=2 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:54:48.481707 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-aa189043-42fa-436a-b572-c9aa20355c8f tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921f934be12045b3ac0b2c6ed5101bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4335ce6fd64a0397fbfb13e1b255ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:48.512873 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-aa189043-42fa-436a-b572-c9aa20355c8f tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] 10.222.0.43 "GET /compute/v2.1/servers/f032bafe-c1e0-4556-af70-8692d48dd2e2" status: 200 len: 1317 microversion: 2.1 time: 0.946669 Oct 04 21:54:48.515965 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1339/2593] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:54:47 2022] GET /compute/v2.1/servers/f032bafe-c1e0-4556-af70-8692d48dd2e2 => generated 1317 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:54:48.536236 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-f435a3de-b696-4d6c-9da6-138f4ce062a5 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:48.538779 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-f435a3de-b696-4d6c-9da6-138f4ce062a5 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 10062905-54d7-47e2-b621-522e0954b72b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:48.558907 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f435a3de-b696-4d6c-9da6-138f4ce062a5 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:48.560776 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f435a3de-b696-4d6c-9da6-138f4ce062a5 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:48.562154 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f435a3de-b696-4d6c-9da6-138f4ce062a5 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:48.565592 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f435a3de-b696-4d6c-9da6-138f4ce062a5 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:48.566249 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f435a3de-b696-4d6c-9da6-138f4ce062a5 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:48.568975 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f435a3de-b696-4d6c-9da6-138f4ce062a5 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:48.627782 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-6bfa6c8b-aff5-44e2-aaae-75483894d624 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47fbc4a6920d451cb1a2ad170de04921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43659cf5fed541e8883664bf17aced70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:48.638834 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-6bfa6c8b-aff5-44e2-aaae-75483894d624 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] 10.222.0.43 "GET /compute/v2.1/servers/a2e7312a-4e0d-4c47-b7c6-e1490a3f99d3" status: 200 len: 1314 microversion: 2.1 time: 0.739894 Oct 04 21:54:48.640576 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1255/2594] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:54:47 2022] GET /compute/v2.1/servers/a2e7312a-4e0d-4c47-b7c6-e1490a3f99d3 => generated 1314 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:54:48.651404 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-14cb4fb9-a808-490f-bd15-a29f15eff7bb tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:48.654929 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-14cb4fb9-a808-490f-bd15-a29f15eff7bb tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] [instance: 4ec41646-6e85-45ab-9daf-d932a8223ffd] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:48.660321 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f435a3de-b696-4d6c-9da6-138f4ce062a5 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:48.661088 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f435a3de-b696-4d6c-9da6-138f4ce062a5 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:48.663375 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f435a3de-b696-4d6c-9da6-138f4ce062a5 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:48.664308 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.objects.instance [None req-f435a3de-b696-4d6c-9da6-138f4ce062a5 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lazy-loading 'fault' on Instance uuid 10062905-54d7-47e2-b621-522e0954b72b {{(pid=134102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:54:48.668619 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-14cb4fb9-a808-490f-bd15-a29f15eff7bb tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:48.671465 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-14cb4fb9-a808-490f-bd15-a29f15eff7bb tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:48.672076 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-14cb4fb9-a808-490f-bd15-a29f15eff7bb tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:48.672964 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-14cb4fb9-a808-490f-bd15-a29f15eff7bb tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:48.675710 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-14cb4fb9-a808-490f-bd15-a29f15eff7bb tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:48.676460 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-14cb4fb9-a808-490f-bd15-a29f15eff7bb tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:49.099537 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-f435a3de-b696-4d6c-9da6-138f4ce062a5 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ad048becf474fb972d4291422d810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dcfc7024fc49388c4bd5f25f03e60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:49.118802 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-f435a3de-b696-4d6c-9da6-138f4ce062a5 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/10062905-54d7-47e2-b621-522e0954b72b" status: 200 len: 1301 microversion: 2.1 time: 0.599053 Oct 04 21:54:49.119652 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1340/2595] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:54:48 2022] GET /compute/v2.1/servers/10062905-54d7-47e2-b621-522e0954b72b => generated 1301 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:54:49.127878 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-9f0ccfe1-45bc-4fd0-b7a5-dd03624ab1d5 req-99103b06-a754-4803-a7c1-85e794219ec9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10062905-54d7-47e2-b621-522e0954b72b", "name": "network-vif-deleted", "tag": "f5b5fac6-bb2d-4a99-a6db-4f032a197633"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:54:49.145164 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-9f0ccfe1-45bc-4fd0-b7a5-dd03624ab1d5 req-99103b06-a754-4803-a7c1-85e794219ec9 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:49.146508 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-9f0ccfe1-45bc-4fd0-b7a5-dd03624ab1d5 req-99103b06-a754-4803-a7c1-85e794219ec9 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:49.147255 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-9f0ccfe1-45bc-4fd0-b7a5-dd03624ab1d5 req-99103b06-a754-4803-a7c1-85e794219ec9 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:49.175525 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-9f0ccfe1-45bc-4fd0-b7a5-dd03624ab1d5 req-99103b06-a754-4803-a7c1-85e794219ec9 service nova] Creating event network-vif-deleted:f5b5fac6-bb2d-4a99-a6db-4f032a197633 for instance 10062905-54d7-47e2-b621-522e0954b72b on n-h2-860284-1 Oct 04 21:54:49.188448 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-9f0ccfe1-45bc-4fd0-b7a5-dd03624ab1d5 req-99103b06-a754-4803-a7c1-85e794219ec9 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066977 Oct 04 21:54:49.189391 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1341/2596] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:54:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:54:49.267714 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-0da3d210-2571-4194-bd15-a02d2c317c2a req-a89ade99-5109-40ce-a203-b26f5c73f3fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "830de6ad-adc6-4d16-ae9d-a29ae85e6cd2", "tag": "480ee163-2b8b-42e9-80e8-28254bda8c68"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:54:49.287193 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-0da3d210-2571-4194-bd15-a02d2c317c2a req-a89ade99-5109-40ce-a203-b26f5c73f3fb service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:49.288778 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-0da3d210-2571-4194-bd15-a02d2c317c2a req-a89ade99-5109-40ce-a203-b26f5c73f3fb service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:49.290731 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-0da3d210-2571-4194-bd15-a02d2c317c2a req-a89ade99-5109-40ce-a203-b26f5c73f3fb service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:49.315038 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-0da3d210-2571-4194-bd15-a02d2c317c2a req-a89ade99-5109-40ce-a203-b26f5c73f3fb service nova] Creating event network-changed:480ee163-2b8b-42e9-80e8-28254bda8c68 for instance 830de6ad-adc6-4d16-ae9d-a29ae85e6cd2 on n-h1-860284-1 Oct 04 21:54:49.339613 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-0da3d210-2571-4194-bd15-a02d2c317c2a req-a89ade99-5109-40ce-a203-b26f5c73f3fb service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076337 Oct 04 21:54:49.340510 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1342/2597] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:54:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:54:49.476332 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-14cb4fb9-a808-490f-bd15-a29f15eff7bb tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25e92d45b97b406589310789798f03cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bfbf40c0004c41abc1fc2072eb3db2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:49.489203 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-14cb4fb9-a808-490f-bd15-a29f15eff7bb tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] 10.222.0.43 "GET /compute/v2.1/servers/4ec41646-6e85-45ab-9daf-d932a8223ffd" status: 200 len: 1317 microversion: 2.1 time: 0.847503 Oct 04 21:54:49.489802 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1256/2598] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:54:48 2022] GET /compute/v2.1/servers/4ec41646-6e85-45ab-9daf-d932a8223ffd => generated 1317 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:54:49.538987 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-38581361-ba08-4f32-bda2-035bbf3eaf05 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:49.541418 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-38581361-ba08-4f32-bda2-035bbf3eaf05 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] [instance: f032bafe-c1e0-4556-af70-8692d48dd2e2] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:49.549447 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-38581361-ba08-4f32-bda2-035bbf3eaf05 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:49.550203 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-38581361-ba08-4f32-bda2-035bbf3eaf05 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:49.550740 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-38581361-ba08-4f32-bda2-035bbf3eaf05 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:49.551692 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-38581361-ba08-4f32-bda2-035bbf3eaf05 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:49.552353 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-38581361-ba08-4f32-bda2-035bbf3eaf05 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:49.552967 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-38581361-ba08-4f32-bda2-035bbf3eaf05 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:49.665092 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-3e0735c6-4e19-41e9-bf27-f15b14944306 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:49.666104 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-3e0735c6-4e19-41e9-bf27-f15b14944306 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] [instance: a2e7312a-4e0d-4c47-b7c6-e1490a3f99d3] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:49.672841 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3e0735c6-4e19-41e9-bf27-f15b14944306 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:49.673473 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3e0735c6-4e19-41e9-bf27-f15b14944306 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:49.674176 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3e0735c6-4e19-41e9-bf27-f15b14944306 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:49.675026 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3e0735c6-4e19-41e9-bf27-f15b14944306 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:49.675604 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3e0735c6-4e19-41e9-bf27-f15b14944306 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:49.676237 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3e0735c6-4e19-41e9-bf27-f15b14944306 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:50.541313 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-38581361-ba08-4f32-bda2-035bbf3eaf05 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921f934be12045b3ac0b2c6ed5101bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4335ce6fd64a0397fbfb13e1b255ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:50.551910 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-38581361-ba08-4f32-bda2-035bbf3eaf05 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] 10.222.0.43 "GET /compute/v2.1/servers/f032bafe-c1e0-4556-af70-8692d48dd2e2" status: 200 len: 1317 microversion: 2.1 time: 1.018543 Oct 04 21:54:50.566389 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1343/2599] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:54:49 2022] GET /compute/v2.1/servers/f032bafe-c1e0-4556-af70-8692d48dd2e2 => generated 1317 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:54:50.569817 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-d56ffc17-6c35-4114-9aac-12a57077eca6 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:50.570547 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-d56ffc17-6c35-4114-9aac-12a57077eca6 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] [instance: 10062905-54d7-47e2-b621-522e0954b72b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:50.581804 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d56ffc17-6c35-4114-9aac-12a57077eca6 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:50.582734 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d56ffc17-6c35-4114-9aac-12a57077eca6 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:50.583329 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d56ffc17-6c35-4114-9aac-12a57077eca6 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:50.584098 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d56ffc17-6c35-4114-9aac-12a57077eca6 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:50.585772 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d56ffc17-6c35-4114-9aac-12a57077eca6 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:50.586277 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d56ffc17-6c35-4114-9aac-12a57077eca6 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:50.606877 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-d56ffc17-6c35-4114-9aac-12a57077eca6 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] HTTP exception thrown: Instance 10062905-54d7-47e2-b621-522e0954b72b could not be found. Oct 04 21:54:50.608317 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-3e0735c6-4e19-41e9-bf27-f15b14944306 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47fbc4a6920d451cb1a2ad170de04921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43659cf5fed541e8883664bf17aced70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:50.608913 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-d56ffc17-6c35-4114-9aac-12a57077eca6 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Request method failure captured: Oct 04 21:54:50.608913 n-d-860284-1 devstack@n-api.service[134102]: request: GET /compute/v2.1/servers/10062905-54d7-47e2-b621-522e0954b72b HTTP/1.1 Oct 04 21:54:50.608913 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 21:54:50.608913 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 21:54:50.608913 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 21:54:50.608913 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 21:54:50.608913 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 21:54:50.608913 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 21:54:50.608913 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 21:54:50.608913 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 21:54:50.608913 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPKlsrwiQ9GesXhyqu67r1anP5Ibl0YaboKyeE7rK46nYSdK0TpUYcmL_wM01HTXcfIoJGuxcnLbc-VFhUn_6G-hdgqWaOF_j6r_rBrUrr7Ol7326k-Ze3kyxQxWppQH2Hmb4sX-zc9lQaszpgn74tbRppenQIsFu6fvipc6lYaDTkwQ Oct 04 21:54:50.608913 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 21:54:50.608913 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 21:54:50.608913 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 21:54:50.608913 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 21:54:50.608913 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 21:54:50.608913 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 21:54:50.608913 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: 78dcfc7024fc49388c4bd5f25f03e60d Oct 04 21:54:50.608913 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-LiveMigrationTest-87019555 Oct 04 21:54:50.608913 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 21:54:50.608913 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 21:54:50.608913 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/78dcfc7024fc49388c4bd5f25f03e60d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_78dcfc7024fc49388c4bd5f25f03e60d", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/78dcfc7024fc49388c4bd5f25f03e60d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/78dcfc7024fc49388c4bd5f25f03e60d"}]}] Oct 04 21:54:50.608913 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-LiveMigrationTest-87019555 Oct 04 21:54:50.608913 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: 78dcfc7024fc49388c4bd5f25f03e60d Oct 04 21:54:50.608913 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-LiveMigrationTest-87019555 Oct 04 21:54:50.608913 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-LiveMigrationTest-87019555-project Oct 04 21:54:50.608913 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 21:54:50.608913 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 21:54:50.608913 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: bb7ad048becf474fb972d4291422d810 Oct 04 21:54:50.608913 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-LiveMigrationTest-87019555-project Oct 04 21:54:50.608913 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 21:54:50.608913 n-d-860284-1 devstack@n-api.service[134102]: exception: Instance 10062905-54d7-47e2-b621-522e0954b72b could not be found. Oct 04 21:54:50.608913 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': '10062905-54d7-47e2-b621-522e0954b72b'} Oct 04 21:54:50.608913 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:54:50.608913 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:54:50.608913 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:54:50.608913 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:54:50.608913 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:54:50.608913 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:54:50.608913 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:54:50.608913 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:54:50.608913 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:54:50.608913 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:54:50.608913 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10062905-54d7-47e2-b621-522e0954b72b could not be found. Oct 04 21:54:50.608913 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:54:50.608913 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:54:50.608913 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:54:50.608913 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:54:50.608913 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:54:50.608913 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:54:50.608913 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:54:50.608913 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:54:50.608913 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:54:50.608913 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:54:50.608913 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:54:50.608913 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:54:50.608913 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:54:50.608913 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:54:50.608913 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:54:50.608913 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:54:50.608913 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10062905-54d7-47e2-b621-522e0954b72b could not be found. Oct 04 21:54:50.608913 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:54:50.608913 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:54:50.608913 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:54:50.613294 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:54:50.613294 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:54:50.613294 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:54:50.613294 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:54:50.613294 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:54:50.613294 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10062905-54d7-47e2-b621-522e0954b72b could not be found. Oct 04 21:54:50.613294 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:54:50.614131 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-d56ffc17-6c35-4114-9aac-12a57077eca6 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] Returning 404 to user: Instance 10062905-54d7-47e2-b621-522e0954b72b could not be found. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:54:50.615136 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-d56ffc17-6c35-4114-9aac-12a57077eca6 tempest-LiveMigrationTest-87019555 tempest-LiveMigrationTest-87019555-project] 10.222.0.43 "GET /compute/v2.1/servers/10062905-54d7-47e2-b621-522e0954b72b" status: 404 len: 111 microversion: 2.1 time: 0.052055 Oct 04 21:54:50.616232 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1344/2600] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:54:50 2022] GET /compute/v2.1/servers/10062905-54d7-47e2-b621-522e0954b72b => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:54:50.622216 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-3e0735c6-4e19-41e9-bf27-f15b14944306 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] 10.222.0.43 "GET /compute/v2.1/servers/a2e7312a-4e0d-4c47-b7c6-e1490a3f99d3" status: 200 len: 1314 microversion: 2.1 time: 0.961820 Oct 04 21:54:50.622546 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-b723b740-5b22-4f88-b715-77616d2b2d4b tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:50.622843 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1257/2601] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:54:49 2022] GET /compute/v2.1/servers/a2e7312a-4e0d-4c47-b7c6-e1490a3f99d3 => generated 1314 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:54:50.625523 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-b723b740-5b22-4f88-b715-77616d2b2d4b tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] [instance: 4ec41646-6e85-45ab-9daf-d932a8223ffd] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:50.637917 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b723b740-5b22-4f88-b715-77616d2b2d4b tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:50.638735 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b723b740-5b22-4f88-b715-77616d2b2d4b tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:50.639377 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b723b740-5b22-4f88-b715-77616d2b2d4b tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:50.641666 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b723b740-5b22-4f88-b715-77616d2b2d4b tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:50.642456 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b723b740-5b22-4f88-b715-77616d2b2d4b tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:50.642912 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b723b740-5b22-4f88-b715-77616d2b2d4b tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:51.101990 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-b723b740-5b22-4f88-b715-77616d2b2d4b tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25e92d45b97b406589310789798f03cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bfbf40c0004c41abc1fc2072eb3db2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:51.112735 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-b723b740-5b22-4f88-b715-77616d2b2d4b tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] 10.222.0.43 "GET /compute/v2.1/servers/4ec41646-6e85-45ab-9daf-d932a8223ffd" status: 200 len: 1317 microversion: 2.1 time: 0.495172 Oct 04 21:54:51.114075 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1345/2602] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:54:50 2022] GET /compute/v2.1/servers/4ec41646-6e85-45ab-9daf-d932a8223ffd => generated 1317 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:54:51.576739 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-f2d16ff7-25bc-4ab1-8fd3-cf45276fea06 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:51.577534 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-f2d16ff7-25bc-4ab1-8fd3-cf45276fea06 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] [instance: f032bafe-c1e0-4556-af70-8692d48dd2e2] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:51.584981 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f2d16ff7-25bc-4ab1-8fd3-cf45276fea06 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:51.585834 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f2d16ff7-25bc-4ab1-8fd3-cf45276fea06 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:51.586452 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f2d16ff7-25bc-4ab1-8fd3-cf45276fea06 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:51.587336 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f2d16ff7-25bc-4ab1-8fd3-cf45276fea06 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:51.588186 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f2d16ff7-25bc-4ab1-8fd3-cf45276fea06 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:51.588727 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f2d16ff7-25bc-4ab1-8fd3-cf45276fea06 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:51.649405 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-eebefb54-ae5c-4eda-bae2-c5a831f2923c tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:51.650020 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-eebefb54-ae5c-4eda-bae2-c5a831f2923c tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] [instance: a2e7312a-4e0d-4c47-b7c6-e1490a3f99d3] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:51.657643 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-eebefb54-ae5c-4eda-bae2-c5a831f2923c tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:51.658707 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-eebefb54-ae5c-4eda-bae2-c5a831f2923c tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:51.659340 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-eebefb54-ae5c-4eda-bae2-c5a831f2923c tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:51.660218 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-eebefb54-ae5c-4eda-bae2-c5a831f2923c tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:51.660855 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-eebefb54-ae5c-4eda-bae2-c5a831f2923c tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:51.661417 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-eebefb54-ae5c-4eda-bae2-c5a831f2923c tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:52.082214 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell0:SELECT=4 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:54:52.117809 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell0:SELECT=16 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:54:52.239274 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-eebefb54-ae5c-4eda-bae2-c5a831f2923c tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47fbc4a6920d451cb1a2ad170de04921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43659cf5fed541e8883664bf17aced70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:52.251374 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-eebefb54-ae5c-4eda-bae2-c5a831f2923c tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] 10.222.0.43 "GET /compute/v2.1/servers/a2e7312a-4e0d-4c47-b7c6-e1490a3f99d3" status: 200 len: 1314 microversion: 2.1 time: 0.606301 Oct 04 21:54:52.253779 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1346/2603] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:54:51 2022] GET /compute/v2.1/servers/a2e7312a-4e0d-4c47-b7c6-e1490a3f99d3 => generated 1314 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:54:52.281353 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-f2d16ff7-25bc-4ab1-8fd3-cf45276fea06 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921f934be12045b3ac0b2c6ed5101bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4335ce6fd64a0397fbfb13e1b255ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:52.294317 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-70f0392e-2f2f-42a5-b1f0-1a6582a58502 tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:52.301957 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-f2d16ff7-25bc-4ab1-8fd3-cf45276fea06 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] 10.222.0.43 "GET /compute/v2.1/servers/f032bafe-c1e0-4556-af70-8692d48dd2e2" status: 200 len: 1317 microversion: 2.1 time: 0.728878 Oct 04 21:54:52.306267 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-70f0392e-2f2f-42a5-b1f0-1a6582a58502 tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] [instance: 4ec41646-6e85-45ab-9daf-d932a8223ffd] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:52.317363 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1258/2604] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:54:51 2022] GET /compute/v2.1/servers/f032bafe-c1e0-4556-af70-8692d48dd2e2 => generated 1317 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:54:52.326726 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-70f0392e-2f2f-42a5-b1f0-1a6582a58502 tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:52.327316 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-70f0392e-2f2f-42a5-b1f0-1a6582a58502 tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:52.327971 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-70f0392e-2f2f-42a5-b1f0-1a6582a58502 tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:52.328890 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-70f0392e-2f2f-42a5-b1f0-1a6582a58502 tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:52.330939 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-70f0392e-2f2f-42a5-b1f0-1a6582a58502 tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:52.331603 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-70f0392e-2f2f-42a5-b1f0-1a6582a58502 tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:52.352879 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-e22e70b6-c8be-4522-8341-7836b8184f19 req-71cb6b6d-e9d7-4036-b21a-4dc5ee24b945 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2e7312a-4e0d-4c47-b7c6-e1490a3f99d3", "name": "network-vif-plugged", "status": "completed", "tag": "84329f78-5a5f-4079-a6af-5e53311debfa"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:54:52.379544 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-e22e70b6-c8be-4522-8341-7836b8184f19 req-71cb6b6d-e9d7-4036-b21a-4dc5ee24b945 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:52.384004 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-e22e70b6-c8be-4522-8341-7836b8184f19 req-71cb6b6d-e9d7-4036-b21a-4dc5ee24b945 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:52.384744 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-e22e70b6-c8be-4522-8341-7836b8184f19 req-71cb6b6d-e9d7-4036-b21a-4dc5ee24b945 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:52.403260 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-e22e70b6-c8be-4522-8341-7836b8184f19 req-71cb6b6d-e9d7-4036-b21a-4dc5ee24b945 service nova] Creating event network-vif-plugged:84329f78-5a5f-4079-a6af-5e53311debfa for instance a2e7312a-4e0d-4c47-b7c6-e1490a3f99d3 on n-h2-860284-1 Oct 04 21:54:52.412678 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-e22e70b6-c8be-4522-8341-7836b8184f19 req-71cb6b6d-e9d7-4036-b21a-4dc5ee24b945 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063580 Oct 04 21:54:52.424090 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1259/2605] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:54:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:54:52.910813 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-70f0392e-2f2f-42a5-b1f0-1a6582a58502 tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25e92d45b97b406589310789798f03cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bfbf40c0004c41abc1fc2072eb3db2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:52.923600 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-70f0392e-2f2f-42a5-b1f0-1a6582a58502 tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] 10.222.0.43 "GET /compute/v2.1/servers/4ec41646-6e85-45ab-9daf-d932a8223ffd" status: 200 len: 1317 microversion: 2.1 time: 0.668357 Oct 04 21:54:52.924237 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1347/2606] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:54:52 2022] GET /compute/v2.1/servers/4ec41646-6e85-45ab-9daf-d932a8223ffd => generated 1317 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:54:53.104751 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=8 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:54:53.110545 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-93099403-5451-4f0c-b332-5349aa2ce190 req-b711696e-1da6-4fea-817c-d86dc116d56c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ec41646-6e85-45ab-9daf-d932a8223ffd", "tag": "9aaf07e9-a2ed-4db1-bf95-9442a049daf0"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:54:53.179965 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-93099403-5451-4f0c-b332-5349aa2ce190 req-b711696e-1da6-4fea-817c-d86dc116d56c service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:53.183488 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-93099403-5451-4f0c-b332-5349aa2ce190 req-b711696e-1da6-4fea-817c-d86dc116d56c service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:53.186508 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-93099403-5451-4f0c-b332-5349aa2ce190 req-b711696e-1da6-4fea-817c-d86dc116d56c service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:53.228803 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-93099403-5451-4f0c-b332-5349aa2ce190 req-b711696e-1da6-4fea-817c-d86dc116d56c service nova] Creating event network-changed:9aaf07e9-a2ed-4db1-bf95-9442a049daf0 for instance 4ec41646-6e85-45ab-9daf-d932a8223ffd on n-h1-860284-1 Oct 04 21:54:53.238384 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-93099403-5451-4f0c-b332-5349aa2ce190 req-b711696e-1da6-4fea-817c-d86dc116d56c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.135140 Oct 04 21:54:53.244183 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1260/2607] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:54:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:54:53.286915 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-e7bb1bee-2e93-470c-8f7a-9651ff681c12 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:53.290168 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-e7bb1bee-2e93-470c-8f7a-9651ff681c12 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] [instance: a2e7312a-4e0d-4c47-b7c6-e1490a3f99d3] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:53.322576 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e7bb1bee-2e93-470c-8f7a-9651ff681c12 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:53.325573 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-387911a1-7d51-4030-81d5-2ba1fee189b2 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:53.326463 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-387911a1-7d51-4030-81d5-2ba1fee189b2 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] [instance: f032bafe-c1e0-4556-af70-8692d48dd2e2] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:53.327863 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e7bb1bee-2e93-470c-8f7a-9651ff681c12 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:53.332564 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e7bb1bee-2e93-470c-8f7a-9651ff681c12 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:53.334423 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e7bb1bee-2e93-470c-8f7a-9651ff681c12 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:53.336648 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e7bb1bee-2e93-470c-8f7a-9651ff681c12 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:53.337148 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-387911a1-7d51-4030-81d5-2ba1fee189b2 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:53.338284 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-387911a1-7d51-4030-81d5-2ba1fee189b2 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:53.340580 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e7bb1bee-2e93-470c-8f7a-9651ff681c12 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:53.341189 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-387911a1-7d51-4030-81d5-2ba1fee189b2 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:53.342057 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-387911a1-7d51-4030-81d5-2ba1fee189b2 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:53.342679 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-387911a1-7d51-4030-81d5-2ba1fee189b2 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:53.344509 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-387911a1-7d51-4030-81d5-2ba1fee189b2 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:54.263051 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-387911a1-7d51-4030-81d5-2ba1fee189b2 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921f934be12045b3ac0b2c6ed5101bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4335ce6fd64a0397fbfb13e1b255ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:54.303825 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-387911a1-7d51-4030-81d5-2ba1fee189b2 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] 10.222.0.43 "GET /compute/v2.1/servers/f032bafe-c1e0-4556-af70-8692d48dd2e2" status: 200 len: 1317 microversion: 2.1 time: 0.982298 Oct 04 21:54:54.305845 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1261/2608] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:54:53 2022] GET /compute/v2.1/servers/f032bafe-c1e0-4556-af70-8692d48dd2e2 => generated 1317 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:54:54.313218 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-88c8b214-8b6b-4204-849e-85195ce01784 tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:54.314114 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-88c8b214-8b6b-4204-849e-85195ce01784 tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] [instance: 4ec41646-6e85-45ab-9daf-d932a8223ffd] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:54.324783 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-88c8b214-8b6b-4204-849e-85195ce01784 tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:54.326237 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-88c8b214-8b6b-4204-849e-85195ce01784 tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:54.327433 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-88c8b214-8b6b-4204-849e-85195ce01784 tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:54.328412 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-88c8b214-8b6b-4204-849e-85195ce01784 tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:54.329166 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-88c8b214-8b6b-4204-849e-85195ce01784 tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:54.330004 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-88c8b214-8b6b-4204-849e-85195ce01784 tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:55.027871 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-e7bb1bee-2e93-470c-8f7a-9651ff681c12 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47fbc4a6920d451cb1a2ad170de04921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43659cf5fed541e8883664bf17aced70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:55.049145 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-e7bb1bee-2e93-470c-8f7a-9651ff681c12 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] 10.222.0.43 "GET /compute/v2.1/servers/a2e7312a-4e0d-4c47-b7c6-e1490a3f99d3" status: 200 len: 1314 microversion: 2.1 time: 1.770769 Oct 04 21:54:55.050823 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1348/2609] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:54:53 2022] GET /compute/v2.1/servers/a2e7312a-4e0d-4c47-b7c6-e1490a3f99d3 => generated 1314 bytes in 1775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:54:55.312676 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-88c8b214-8b6b-4204-849e-85195ce01784 tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25e92d45b97b406589310789798f03cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bfbf40c0004c41abc1fc2072eb3db2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:55.330257 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-88c8b214-8b6b-4204-849e-85195ce01784 tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] 10.222.0.43 "GET /compute/v2.1/servers/4ec41646-6e85-45ab-9daf-d932a8223ffd" status: 200 len: 1317 microversion: 2.1 time: 1.023000 Oct 04 21:54:55.336215 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1262/2610] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:54:54 2022] GET /compute/v2.1/servers/4ec41646-6e85-45ab-9daf-d932a8223ffd => generated 1317 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:54:55.354136 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-a391d930-7b2d-40a4-acea-0442118d0f12 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:55.355305 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-a391d930-7b2d-40a4-acea-0442118d0f12 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] [instance: f032bafe-c1e0-4556-af70-8692d48dd2e2] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:55.375417 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a391d930-7b2d-40a4-acea-0442118d0f12 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:55.380194 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a391d930-7b2d-40a4-acea-0442118d0f12 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:55.385930 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a391d930-7b2d-40a4-acea-0442118d0f12 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:55.388903 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a391d930-7b2d-40a4-acea-0442118d0f12 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:55.396355 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a391d930-7b2d-40a4-acea-0442118d0f12 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:55.399183 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a391d930-7b2d-40a4-acea-0442118d0f12 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:55.831984 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-a391d930-7b2d-40a4-acea-0442118d0f12 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921f934be12045b3ac0b2c6ed5101bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4335ce6fd64a0397fbfb13e1b255ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:55.849857 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-a391d930-7b2d-40a4-acea-0442118d0f12 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] 10.222.0.43 "GET /compute/v2.1/servers/f032bafe-c1e0-4556-af70-8692d48dd2e2" status: 200 len: 1317 microversion: 2.1 time: 0.504874 Oct 04 21:54:55.862444 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1349/2611] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:54:55 2022] GET /compute/v2.1/servers/f032bafe-c1e0-4556-af70-8692d48dd2e2 => generated 1317 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:54:56.079367 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-9cc240ad-459b-402c-8953-836871c70a81 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:56.080459 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-9cc240ad-459b-402c-8953-836871c70a81 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] [instance: a2e7312a-4e0d-4c47-b7c6-e1490a3f99d3] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:56.091701 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9cc240ad-459b-402c-8953-836871c70a81 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:56.092215 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9cc240ad-459b-402c-8953-836871c70a81 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:56.092652 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9cc240ad-459b-402c-8953-836871c70a81 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:56.093376 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9cc240ad-459b-402c-8953-836871c70a81 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:56.093838 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9cc240ad-459b-402c-8953-836871c70a81 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:56.094273 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9cc240ad-459b-402c-8953-836871c70a81 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:56.356455 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-ca18b5e8-3200-4fad-96fb-ee0d2aeaa928 tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:56.357767 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-ca18b5e8-3200-4fad-96fb-ee0d2aeaa928 tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] [instance: 4ec41646-6e85-45ab-9daf-d932a8223ffd] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:56.378525 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ca18b5e8-3200-4fad-96fb-ee0d2aeaa928 tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:56.379105 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ca18b5e8-3200-4fad-96fb-ee0d2aeaa928 tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:56.380040 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ca18b5e8-3200-4fad-96fb-ee0d2aeaa928 tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:56.381138 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ca18b5e8-3200-4fad-96fb-ee0d2aeaa928 tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:56.382607 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ca18b5e8-3200-4fad-96fb-ee0d2aeaa928 tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:56.383220 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ca18b5e8-3200-4fad-96fb-ee0d2aeaa928 tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:56.738698 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-9cc240ad-459b-402c-8953-836871c70a81 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47fbc4a6920d451cb1a2ad170de04921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43659cf5fed541e8883664bf17aced70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:56.752216 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-9cc240ad-459b-402c-8953-836871c70a81 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] 10.222.0.43 "GET /compute/v2.1/servers/a2e7312a-4e0d-4c47-b7c6-e1490a3f99d3" status: 200 len: 1501 microversion: 2.1 time: 0.677531 Oct 04 21:54:56.756117 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1263/2612] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:54:56 2022] GET /compute/v2.1/servers/a2e7312a-4e0d-4c47-b7c6-e1490a3f99d3 => generated 1501 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:54:56.779215 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-f7741822-36e1-490a-825a-63b532ac3a24 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:54:56.782167 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-f7741822-36e1-490a-825a-63b532ac3a24 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] [instance: a2e7312a-4e0d-4c47-b7c6-e1490a3f99d3] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:56.804578 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f7741822-36e1-490a-825a-63b532ac3a24 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:56.805081 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f7741822-36e1-490a-825a-63b532ac3a24 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:56.805528 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f7741822-36e1-490a-825a-63b532ac3a24 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:56.806262 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f7741822-36e1-490a-825a-63b532ac3a24 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:56.806758 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f7741822-36e1-490a-825a-63b532ac3a24 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:56.807193 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f7741822-36e1-490a-825a-63b532ac3a24 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:56.841110 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-ca18b5e8-3200-4fad-96fb-ee0d2aeaa928 tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25e92d45b97b406589310789798f03cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bfbf40c0004c41abc1fc2072eb3db2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:56.862228 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.objects.instance [None req-f7741822-36e1-490a-825a-63b532ac3a24 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lazy-loading 'flavor' on Instance uuid a2e7312a-4e0d-4c47-b7c6-e1490a3f99d3 {{(pid=134101) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:54:56.863680 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-ca18b5e8-3200-4fad-96fb-ee0d2aeaa928 tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] 10.222.0.43 "GET /compute/v2.1/servers/4ec41646-6e85-45ab-9daf-d932a8223ffd" status: 200 len: 1317 microversion: 2.1 time: 0.511659 Oct 04 21:54:56.864838 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1350/2613] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:54:56 2022] GET /compute/v2.1/servers/4ec41646-6e85-45ab-9daf-d932a8223ffd => generated 1317 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:54:56.877821 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-8c0b28b1-38b9-4315-a1bd-0217d05c0000 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:56.878798 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-8c0b28b1-38b9-4315-a1bd-0217d05c0000 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] [instance: f032bafe-c1e0-4556-af70-8692d48dd2e2] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:56.888800 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8c0b28b1-38b9-4315-a1bd-0217d05c0000 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:56.899289 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8c0b28b1-38b9-4315-a1bd-0217d05c0000 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:56.900055 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8c0b28b1-38b9-4315-a1bd-0217d05c0000 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:56.901038 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8c0b28b1-38b9-4315-a1bd-0217d05c0000 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:56.901703 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8c0b28b1-38b9-4315-a1bd-0217d05c0000 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:56.902331 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8c0b28b1-38b9-4315-a1bd-0217d05c0000 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:57.166515 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-f7741822-36e1-490a-825a-63b532ac3a24 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] 10.222.0.43 "POST /compute/v2.1/servers/a2e7312a-4e0d-4c47-b7c6-e1490a3f99d3/action" status: 200 len: 32 microversion: 2.1 time: 0.391528 Oct 04 21:54:57.173980 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1264/2614] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 21:54:56 2022] POST /compute/v2.1/servers/a2e7312a-4e0d-4c47-b7c6-e1490a3f99d3/action => generated 32 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 04 21:54:57.191097 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-11cdbc82-df5b-48f0-af6a-c3f600d170ed req-9929e0c5-2c91-452d-a540-d243bb605238 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f032bafe-c1e0-4556-af70-8692d48dd2e2", "name": "network-vif-plugged", "status": "completed", "tag": "ad84d157-9907-4558-9f67-25a9f944e7ed"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:54:57.222952 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-11cdbc82-df5b-48f0-af6a-c3f600d170ed req-9929e0c5-2c91-452d-a540-d243bb605238 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:57.226748 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-11cdbc82-df5b-48f0-af6a-c3f600d170ed req-9929e0c5-2c91-452d-a540-d243bb605238 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:57.227203 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-11cdbc82-df5b-48f0-af6a-c3f600d170ed req-9929e0c5-2c91-452d-a540-d243bb605238 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:57.256675 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-11cdbc82-df5b-48f0-af6a-c3f600d170ed req-9929e0c5-2c91-452d-a540-d243bb605238 service nova] Creating event network-vif-plugged:ad84d157-9907-4558-9f67-25a9f944e7ed for instance f032bafe-c1e0-4556-af70-8692d48dd2e2 on n-h2-860284-1 Oct 04 21:54:57.266832 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-11cdbc82-df5b-48f0-af6a-c3f600d170ed req-9929e0c5-2c91-452d-a540-d243bb605238 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088535 Oct 04 21:54:57.268286 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1265/2615] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:54:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:54:57.275303 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-64a114e0-900d-4ef3-aac6-66152f180ed3 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:57.276035 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-64a114e0-900d-4ef3-aac6-66152f180ed3 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] [instance: a2e7312a-4e0d-4c47-b7c6-e1490a3f99d3] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:57.289697 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-64a114e0-900d-4ef3-aac6-66152f180ed3 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:57.290189 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-64a114e0-900d-4ef3-aac6-66152f180ed3 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:57.290892 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-64a114e0-900d-4ef3-aac6-66152f180ed3 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:57.291628 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-64a114e0-900d-4ef3-aac6-66152f180ed3 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:57.292145 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-64a114e0-900d-4ef3-aac6-66152f180ed3 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:57.292568 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-64a114e0-900d-4ef3-aac6-66152f180ed3 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:57.489865 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-8c0b28b1-38b9-4315-a1bd-0217d05c0000 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921f934be12045b3ac0b2c6ed5101bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4335ce6fd64a0397fbfb13e1b255ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:57.503311 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-8c0b28b1-38b9-4315-a1bd-0217d05c0000 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] 10.222.0.43 "GET /compute/v2.1/servers/f032bafe-c1e0-4556-af70-8692d48dd2e2" status: 200 len: 1317 microversion: 2.1 time: 0.630290 Oct 04 21:54:57.503920 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1351/2616] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:54:56 2022] GET /compute/v2.1/servers/f032bafe-c1e0-4556-af70-8692d48dd2e2 => generated 1317 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:54:57.706848 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-64a114e0-900d-4ef3-aac6-66152f180ed3 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47fbc4a6920d451cb1a2ad170de04921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43659cf5fed541e8883664bf17aced70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:57.712609 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=95,nova_cell1:INSERT=2 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:54:57.720628 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-64a114e0-900d-4ef3-aac6-66152f180ed3 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] 10.222.0.43 "GET /compute/v2.1/servers/a2e7312a-4e0d-4c47-b7c6-e1490a3f99d3" status: 200 len: 1507 microversion: 2.1 time: 0.450955 Oct 04 21:54:57.721235 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1266/2617] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:54:57 2022] GET /compute/v2.1/servers/a2e7312a-4e0d-4c47-b7c6-e1490a3f99d3 => generated 1507 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:54:57.896033 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-1563cc4d-9ab3-407f-b0fd-3c533e04e433 tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:57.897404 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-1563cc4d-9ab3-407f-b0fd-3c533e04e433 tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] [instance: 4ec41646-6e85-45ab-9daf-d932a8223ffd] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:57.943676 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1563cc4d-9ab3-407f-b0fd-3c533e04e433 tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:57.947374 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1563cc4d-9ab3-407f-b0fd-3c533e04e433 tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:57.948060 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1563cc4d-9ab3-407f-b0fd-3c533e04e433 tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:57.951591 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1563cc4d-9ab3-407f-b0fd-3c533e04e433 tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:57.953145 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1563cc4d-9ab3-407f-b0fd-3c533e04e433 tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:57.953977 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1563cc4d-9ab3-407f-b0fd-3c533e04e433 tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:58.529390 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-39b5e18d-4fc7-4c02-8141-23b574c19d0f tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:58.530106 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-39b5e18d-4fc7-4c02-8141-23b574c19d0f tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] [instance: f032bafe-c1e0-4556-af70-8692d48dd2e2] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:58.555572 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-39b5e18d-4fc7-4c02-8141-23b574c19d0f tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:58.556235 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-39b5e18d-4fc7-4c02-8141-23b574c19d0f tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:58.557098 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-39b5e18d-4fc7-4c02-8141-23b574c19d0f tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:58.557960 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-39b5e18d-4fc7-4c02-8141-23b574c19d0f tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:58.558573 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-39b5e18d-4fc7-4c02-8141-23b574c19d0f tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:58.559084 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-39b5e18d-4fc7-4c02-8141-23b574c19d0f tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:58.620000 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-1563cc4d-9ab3-407f-b0fd-3c533e04e433 tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25e92d45b97b406589310789798f03cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bfbf40c0004c41abc1fc2072eb3db2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:58.637767 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-1563cc4d-9ab3-407f-b0fd-3c533e04e433 tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] 10.222.0.43 "GET /compute/v2.1/servers/4ec41646-6e85-45ab-9daf-d932a8223ffd" status: 200 len: 1317 microversion: 2.1 time: 0.742317 Oct 04 21:54:58.638671 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1352/2618] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:54:57 2022] GET /compute/v2.1/servers/4ec41646-6e85-45ab-9daf-d932a8223ffd => generated 1317 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:54:58.743675 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-446ec748-953e-420f-8b37-bb63dec29563 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:58.744291 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-446ec748-953e-420f-8b37-bb63dec29563 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] [instance: a2e7312a-4e0d-4c47-b7c6-e1490a3f99d3] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:58.759892 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-446ec748-953e-420f-8b37-bb63dec29563 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:58.761747 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-446ec748-953e-420f-8b37-bb63dec29563 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:58.762432 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-446ec748-953e-420f-8b37-bb63dec29563 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:58.763308 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-446ec748-953e-420f-8b37-bb63dec29563 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:58.763980 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-446ec748-953e-420f-8b37-bb63dec29563 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:58.764586 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-446ec748-953e-420f-8b37-bb63dec29563 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:59.702510 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-39b5e18d-4fc7-4c02-8141-23b574c19d0f tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921f934be12045b3ac0b2c6ed5101bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4335ce6fd64a0397fbfb13e1b255ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:59.712528 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-39b5e18d-4fc7-4c02-8141-23b574c19d0f tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] 10.222.0.43 "GET /compute/v2.1/servers/f032bafe-c1e0-4556-af70-8692d48dd2e2" status: 200 len: 1317 microversion: 2.1 time: 1.189557 Oct 04 21:54:59.727822 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1267/2619] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:54:58 2022] GET /compute/v2.1/servers/f032bafe-c1e0-4556-af70-8692d48dd2e2 => generated 1317 bytes in 1206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:54:59.739064 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-0ad3aae5-33f0-4805-bc57-c1247dda800c tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:59.740045 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-0ad3aae5-33f0-4805-bc57-c1247dda800c tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] [instance: 4ec41646-6e85-45ab-9daf-d932a8223ffd] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:59.748018 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0ad3aae5-33f0-4805-bc57-c1247dda800c tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:59.748670 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0ad3aae5-33f0-4805-bc57-c1247dda800c tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:59.749273 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0ad3aae5-33f0-4805-bc57-c1247dda800c tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:59.750535 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0ad3aae5-33f0-4805-bc57-c1247dda800c tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:59.751088 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0ad3aae5-33f0-4805-bc57-c1247dda800c tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:59.751534 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0ad3aae5-33f0-4805-bc57-c1247dda800c tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:59.923467 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-446ec748-953e-420f-8b37-bb63dec29563 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47fbc4a6920d451cb1a2ad170de04921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43659cf5fed541e8883664bf17aced70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:59.934677 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-446ec748-953e-420f-8b37-bb63dec29563 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] 10.222.0.43 "GET /compute/v2.1/servers/a2e7312a-4e0d-4c47-b7c6-e1490a3f99d3" status: 200 len: 1507 microversion: 2.1 time: 1.195072 Oct 04 21:54:59.935656 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1353/2620] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:54:58 2022] GET /compute/v2.1/servers/a2e7312a-4e0d-4c47-b7c6-e1490a3f99d3 => generated 1507 bytes in 1197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:55:00.321560 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-0ad3aae5-33f0-4805-bc57-c1247dda800c tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25e92d45b97b406589310789798f03cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bfbf40c0004c41abc1fc2072eb3db2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:55:00.332265 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-0ad3aae5-33f0-4805-bc57-c1247dda800c tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] 10.222.0.43 "GET /compute/v2.1/servers/4ec41646-6e85-45ab-9daf-d932a8223ffd" status: 200 len: 1317 microversion: 2.1 time: 0.602554 Oct 04 21:55:00.332988 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1268/2621] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:54:59 2022] GET /compute/v2.1/servers/4ec41646-6e85-45ab-9daf-d932a8223ffd => generated 1317 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:55:00.746076 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-b5a5ddb3-cd42-49ca-8fef-1f86feb5a3a2 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:55:00.747360 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-b5a5ddb3-cd42-49ca-8fef-1f86feb5a3a2 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] [instance: f032bafe-c1e0-4556-af70-8692d48dd2e2] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:55:00.761474 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b5a5ddb3-cd42-49ca-8fef-1f86feb5a3a2 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:00.763006 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b5a5ddb3-cd42-49ca-8fef-1f86feb5a3a2 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:00.764646 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b5a5ddb3-cd42-49ca-8fef-1f86feb5a3a2 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:00.765761 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b5a5ddb3-cd42-49ca-8fef-1f86feb5a3a2 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:00.766593 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b5a5ddb3-cd42-49ca-8fef-1f86feb5a3a2 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:00.767229 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b5a5ddb3-cd42-49ca-8fef-1f86feb5a3a2 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:00.774790 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=100 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:55:00.960076 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-8a9a7218-b220-4d45-95b8-6ffaece1c528 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:55:00.961707 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-8a9a7218-b220-4d45-95b8-6ffaece1c528 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] [instance: a2e7312a-4e0d-4c47-b7c6-e1490a3f99d3] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:55:00.969124 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8a9a7218-b220-4d45-95b8-6ffaece1c528 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:00.969615 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8a9a7218-b220-4d45-95b8-6ffaece1c528 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:00.970149 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8a9a7218-b220-4d45-95b8-6ffaece1c528 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:00.970933 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8a9a7218-b220-4d45-95b8-6ffaece1c528 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:00.973657 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8a9a7218-b220-4d45-95b8-6ffaece1c528 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:00.974279 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8a9a7218-b220-4d45-95b8-6ffaece1c528 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:01.598326 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-b5a5ddb3-cd42-49ca-8fef-1f86feb5a3a2 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921f934be12045b3ac0b2c6ed5101bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4335ce6fd64a0397fbfb13e1b255ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:55:01.637581 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-b5a5ddb3-cd42-49ca-8fef-1f86feb5a3a2 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] 10.222.0.43 "GET /compute/v2.1/servers/f032bafe-c1e0-4556-af70-8692d48dd2e2" status: 200 len: 1507 microversion: 2.1 time: 0.900415 Oct 04 21:55:01.638788 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1354/2622] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:55:00 2022] GET /compute/v2.1/servers/f032bafe-c1e0-4556-af70-8692d48dd2e2 => generated 1507 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:55:01.644409 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-eb5d3dd6-e4a8-4a95-bd0d-4564d4131b59 tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:55:01.645455 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-eb5d3dd6-e4a8-4a95-bd0d-4564d4131b59 tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] [instance: 4ec41646-6e85-45ab-9daf-d932a8223ffd] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:55:01.652430 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-eb5d3dd6-e4a8-4a95-bd0d-4564d4131b59 tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:01.653088 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-eb5d3dd6-e4a8-4a95-bd0d-4564d4131b59 tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:01.653630 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-eb5d3dd6-e4a8-4a95-bd0d-4564d4131b59 tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:01.654471 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-eb5d3dd6-e4a8-4a95-bd0d-4564d4131b59 tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:01.655105 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-eb5d3dd6-e4a8-4a95-bd0d-4564d4131b59 tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:01.656482 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-eb5d3dd6-e4a8-4a95-bd0d-4564d4131b59 tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:01.786019 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-8a9a7218-b220-4d45-95b8-6ffaece1c528 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47fbc4a6920d451cb1a2ad170de04921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43659cf5fed541e8883664bf17aced70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:55:01.821145 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-8a9a7218-b220-4d45-95b8-6ffaece1c528 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] 10.222.0.43 "GET /compute/v2.1/servers/a2e7312a-4e0d-4c47-b7c6-e1490a3f99d3" status: 200 len: 1507 microversion: 2.1 time: 0.864274 Oct 04 21:55:01.826607 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1269/2623] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:55:00 2022] GET /compute/v2.1/servers/a2e7312a-4e0d-4c47-b7c6-e1490a3f99d3 => generated 1507 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:55:02.345215 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-22019b7b-addb-4679-9bda-f165a51a7009 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Action: 'create', calling method: .version_select at 0x7fbb2ee5edc0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1770451541", "description": "tempest-description-2142059514"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:55:02.597021 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-eb5d3dd6-e4a8-4a95-bd0d-4564d4131b59 tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25e92d45b97b406589310789798f03cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bfbf40c0004c41abc1fc2072eb3db2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:55:02.609669 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-eb5d3dd6-e4a8-4a95-bd0d-4564d4131b59 tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] 10.222.0.43 "GET /compute/v2.1/servers/4ec41646-6e85-45ab-9daf-d932a8223ffd" status: 200 len: 1317 microversion: 2.1 time: 0.969494 Oct 04 21:55:02.637349 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1355/2624] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:55:01 2022] GET /compute/v2.1/servers/4ec41646-6e85-45ab-9daf-d932a8223ffd => generated 1317 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:55:02.852299 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-1daea464-d32f-4378-8d6d-137b8a51c8e5 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:55:02.852938 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-1daea464-d32f-4378-8d6d-137b8a51c8e5 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] [instance: a2e7312a-4e0d-4c47-b7c6-e1490a3f99d3] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:55:02.868035 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1daea464-d32f-4378-8d6d-137b8a51c8e5 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:02.868546 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1daea464-d32f-4378-8d6d-137b8a51c8e5 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:02.868989 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1daea464-d32f-4378-8d6d-137b8a51c8e5 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:02.869715 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1daea464-d32f-4378-8d6d-137b8a51c8e5 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:02.874758 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1daea464-d32f-4378-8d6d-137b8a51c8e5 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:02.875307 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1daea464-d32f-4378-8d6d-137b8a51c8e5 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:03.036081 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-22019b7b-addb-4679-9bda-f165a51a7009 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] 10.222.0.43 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 1.203458 Oct 04 21:55:03.047540 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1270/2625] 10.222.0.43 () {60 vars in 1180 bytes} [Tue Oct 4 21:55:01 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 1220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:55:03.055456 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-d31c921f-290f-42af-9276-cf6bb7c737f7 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Action: 'create', calling method: .version_select at 0x7fbb2ee99040>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1126216832", "description": "tempest-description-266234494"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:55:03.307740 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-1daea464-d32f-4378-8d6d-137b8a51c8e5 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47fbc4a6920d451cb1a2ad170de04921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43659cf5fed541e8883664bf17aced70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:55:03.317247 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-1daea464-d32f-4378-8d6d-137b8a51c8e5 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] 10.222.0.43 "GET /compute/v2.1/servers/a2e7312a-4e0d-4c47-b7c6-e1490a3f99d3" status: 200 len: 1507 microversion: 2.1 time: 0.470231 Oct 04 21:55:03.331312 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1356/2626] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:55:02 2022] GET /compute/v2.1/servers/a2e7312a-4e0d-4c47-b7c6-e1490a3f99d3 => generated 1507 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:55:03.636511 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-fedd77a8-41a3-4883-aab8-ac839c7c4a35 tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:55:03.637251 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-fedd77a8-41a3-4883-aab8-ac839c7c4a35 tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] [instance: 4ec41646-6e85-45ab-9daf-d932a8223ffd] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:55:03.646350 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fedd77a8-41a3-4883-aab8-ac839c7c4a35 tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:03.648760 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fedd77a8-41a3-4883-aab8-ac839c7c4a35 tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:03.649387 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fedd77a8-41a3-4883-aab8-ac839c7c4a35 tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:03.650745 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fedd77a8-41a3-4883-aab8-ac839c7c4a35 tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:03.654131 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fedd77a8-41a3-4883-aab8-ac839c7c4a35 tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:03.656592 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fedd77a8-41a3-4883-aab8-ac839c7c4a35 tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:03.740289 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-d31c921f-290f-42af-9276-cf6bb7c737f7 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] 10.222.0.43 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.691533 Oct 04 21:55:03.742015 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1271/2627] 10.222.0.43 () {60 vars in 1180 bytes} [Tue Oct 4 21:55:03 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:55:03.892581 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-253695b3-9c18-45ed-b8e3-c46db4bcba84 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1285018473", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452", "networks": [{"uuid": "a15f9d08-1696-44bb-bb46-54f43e1a613e"}]}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:55:04.038973 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.network.neutron [None req-253695b3-9c18-45ed-b8e3-c46db4bcba84 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] validate_networks() for [('a15f9d08-1696-44bb-bb46-54f43e1a613e', None, None, None, None, None)] {{(pid=134101) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:55:04.398332 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-fedd77a8-41a3-4883-aab8-ac839c7c4a35 tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25e92d45b97b406589310789798f03cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bfbf40c0004c41abc1fc2072eb3db2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:55:04.440301 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-fedd77a8-41a3-4883-aab8-ac839c7c4a35 tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] 10.222.0.43 "GET /compute/v2.1/servers/4ec41646-6e85-45ab-9daf-d932a8223ffd" status: 200 len: 1317 microversion: 2.1 time: 0.807156 Oct 04 21:55:04.442107 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1357/2628] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:55:03 2022] GET /compute/v2.1/servers/4ec41646-6e85-45ab-9daf-d932a8223ffd => generated 1317 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:55:04.477338 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-90e9f48d-350c-44f7-8620-373ad5190e62 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:55:04.480615 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-90e9f48d-350c-44f7-8620-373ad5190e62 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] [instance: a2e7312a-4e0d-4c47-b7c6-e1490a3f99d3] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:55:04.487803 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-90e9f48d-350c-44f7-8620-373ad5190e62 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:04.494502 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-90e9f48d-350c-44f7-8620-373ad5190e62 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:04.495415 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-90e9f48d-350c-44f7-8620-373ad5190e62 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:04.501099 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-90e9f48d-350c-44f7-8620-373ad5190e62 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:04.501965 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-90e9f48d-350c-44f7-8620-373ad5190e62 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:04.502672 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-90e9f48d-350c-44f7-8620-373ad5190e62 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:05.408179 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-90e9f48d-350c-44f7-8620-373ad5190e62 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47fbc4a6920d451cb1a2ad170de04921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43659cf5fed541e8883664bf17aced70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:55:05.427451 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-90e9f48d-350c-44f7-8620-373ad5190e62 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] 10.222.0.43 "GET /compute/v2.1/servers/a2e7312a-4e0d-4c47-b7c6-e1490a3f99d3" status: 200 len: 1507 microversion: 2.1 time: 0.978110 Oct 04 21:55:05.427451 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1358/2629] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:55:04 2022] GET /compute/v2.1/servers/a2e7312a-4e0d-4c47-b7c6-e1490a3f99d3 => generated 1507 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:55:05.470628 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-8de9eea0-f2c8-45c5-9375-ec8fac47a18f tempest-VolumesAdminNegativeTest-1219872418 tempest-VolumesAdminNegativeTest-1219872418-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "92d494f6-ee19-4a50-8240-0866589c2233"}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:55:05.487345 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-8de9eea0-f2c8-45c5-9375-ec8fac47a18f tempest-VolumesAdminNegativeTest-1219872418 tempest-VolumesAdminNegativeTest-1219872418-project-admin] [instance: f032bafe-c1e0-4556-af70-8692d48dd2e2] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:55:05.516578 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8de9eea0-f2c8-45c5-9375-ec8fac47a18f tempest-VolumesAdminNegativeTest-1219872418 tempest-VolumesAdminNegativeTest-1219872418-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:05.519072 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8de9eea0-f2c8-45c5-9375-ec8fac47a18f tempest-VolumesAdminNegativeTest-1219872418 tempest-VolumesAdminNegativeTest-1219872418-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:05.527984 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8de9eea0-f2c8-45c5-9375-ec8fac47a18f tempest-VolumesAdminNegativeTest-1219872418 tempest-VolumesAdminNegativeTest-1219872418-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:05.528980 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8de9eea0-f2c8-45c5-9375-ec8fac47a18f tempest-VolumesAdminNegativeTest-1219872418 tempest-VolumesAdminNegativeTest-1219872418-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:05.529803 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8de9eea0-f2c8-45c5-9375-ec8fac47a18f tempest-VolumesAdminNegativeTest-1219872418 tempest-VolumesAdminNegativeTest-1219872418-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:05.530672 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8de9eea0-f2c8-45c5-9375-ec8fac47a18f tempest-VolumesAdminNegativeTest-1219872418 tempest-VolumesAdminNegativeTest-1219872418-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:05.665797 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-8de9eea0-f2c8-45c5-9375-ec8fac47a18f tempest-VolumesAdminNegativeTest-1219872418 tempest-VolumesAdminNegativeTest-1219872418-project-admin] HTTP exception thrown: Volume 62770916-7ad4-4606-86f5-a5cfadfc9dbf could not be found. Oct 04 21:55:05.670562 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-8de9eea0-f2c8-45c5-9375-ec8fac47a18f tempest-VolumesAdminNegativeTest-1219872418 tempest-VolumesAdminNegativeTest-1219872418-project-admin] Request method failure captured: Oct 04 21:55:05.670562 n-d-860284-1 devstack@n-api.service[134102]: request: PUT /compute/v2.1/servers/f032bafe-c1e0-4556-af70-8692d48dd2e2/os-volume_attachments/62770916-7ad4-4606-86f5-a5cfadfc9dbf HTTP/1.1 Oct 04 21:55:05.670562 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 21:55:05.670562 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 21:55:05.670562 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 21:55:05.670562 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 74 Oct 04 21:55:05.670562 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 21:55:05.670562 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 21:55:05.670562 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 21:55:05.670562 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 21:55:05.670562 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPKr6KrEbitoFg_HCXt4kS0Drvml-G3ziJCM85x-IPH6sZmamd0mJanXcbANJ4xEwBTHvHUQ2SqnKstOgl7EMVPOfWcBGEF-9c8tp-0lfhjqi-CATe7Ue3wBiUSbQu2WDEbslngOsKVmtHhOyOfRf3tBNYZRxKICtcebPAz42Ud7oDf8 Oct 04 21:55:05.670562 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 21:55:05.670562 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 21:55:05.670562 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 21:55:05.670562 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 21:55:05.670562 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 21:55:05.670562 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 21:55:05.670562 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: d0e95077b3704059a537a6fb934ba283 Oct 04 21:55:05.670562 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-VolumesAdminNegativeTest-1219872418 Oct 04 21:55:05.670562 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,admin,member Oct 04 21:55:05.670562 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,admin,member Oct 04 21:55:05.670562 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d0e95077b3704059a537a6fb934ba283"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_d0e95077b3704059a537a6fb934ba283", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d0e95077b3704059a537a6fb934ba283"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/d0e95077b3704059a537a6fb934ba283"}]}] Oct 04 21:55:05.670562 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-VolumesAdminNegativeTest-1219872418 Oct 04 21:55:05.670562 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: d0e95077b3704059a537a6fb934ba283 Oct 04 21:55:05.670562 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1219872418 Oct 04 21:55:05.670562 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-VolumesAdminNegativeTest-1219872418-project-admin Oct 04 21:55:05.670562 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 21:55:05.670562 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 21:55:05.670562 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: 0b11981fa4c04207a5965b434ee86f5c Oct 04 21:55:05.670562 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-VolumesAdminNegativeTest-1219872418-project-admin Oct 04 21:55:05.670562 n-d-860284-1 devstack@n-api.service[134102]: Oct 04 21:55:05.670562 n-d-860284-1 devstack@n-api.service[134102]: {"volumeAttachment": {"volumeId": "92d494f6-ee19-4a50-8240-0866589c2233"}} Oct 04 21:55:05.670562 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 21:55:05.670562 n-d-860284-1 devstack@n-api.service[134102]: exception: Volume 62770916-7ad4-4606-86f5-a5cfadfc9dbf could not be found. Oct 04 21:55:05.670562 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'server_id': 'f032bafe-c1e0-4556-af70-8692d48dd2e2', 'id': '62770916-7ad4-4606-86f5-a5cfadfc9dbf', 'body': {'volumeAttachment': {'volumeId': '92d494f6-ee19-4a50-8240-0866589c2233'}}} Oct 04 21:55:05.670562 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:55:05.670562 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:55:05.670562 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 21:55:05.670562 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 21:55:05.670562 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 21:55:05.670562 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 21:55:05.670562 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 21:55:05.670562 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 21:55:05.670562 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 21:55:05.670562 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 21:55:05.670562 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 21:55:05.670562 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 21:55:05.670562 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 21:55:05.670562 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 21:55:05.670562 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 21:55:05.670562 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 21:55:05.670562 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 62770916-7ad4-4606-86f5-a5cfadfc9dbf could not be found. (HTTP 404) (Request-ID: req-ff77dd9f-6ea7-4032-ad32-66e96e8322a4) Oct 04 21:55:05.670562 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:55:05.670562 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:55:05.670562 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:55:05.670562 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:55:05.670562 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Oct 04 21:55:05.670562 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Oct 04 21:55:05.670562 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 04 21:55:05.670562 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 04 21:55:05.670562 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 04 21:55:05.676896 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 04 21:55:05.676896 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 04 21:55:05.676896 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 04 21:55:05.676896 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 21:55:05.676896 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 21:55:05.676896 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 21:55:05.676896 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 21:55:05.676896 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 21:55:05.676896 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 21:55:05.676896 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 21:55:05.676896 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 21:55:05.676896 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 21:55:05.676896 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 21:55:05.676896 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 21:55:05.676896 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 21:55:05.676896 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 21:55:05.676896 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 21:55:05.676896 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 62770916-7ad4-4606-86f5-a5cfadfc9dbf could not be found. Oct 04 21:55:05.676896 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:55:05.676896 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:55:05.676896 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:55:05.676896 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:55:05.676896 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:55:05.676896 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:55:05.676896 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:55:05.676896 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:55:05.676896 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:55:05.676896 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:55:05.676896 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:55:05.676896 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:55:05.676896 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:55:05.676896 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:55:05.676896 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Oct 04 21:55:05.676896 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Oct 04 21:55:05.676896 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Oct 04 21:55:05.676896 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:55:05.676896 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 62770916-7ad4-4606-86f5-a5cfadfc9dbf could not be found. Oct 04 21:55:05.676896 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:55:05.676896 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:55:05.676896 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:55:05.676896 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:55:05.676896 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:55:05.676896 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:55:05.676896 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:55:05.676896 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:55:05.676896 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 62770916-7ad4-4606-86f5-a5cfadfc9dbf could not be found. Oct 04 21:55:05.676896 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:55:05.676896 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-8de9eea0-f2c8-45c5-9375-ec8fac47a18f tempest-VolumesAdminNegativeTest-1219872418 tempest-VolumesAdminNegativeTest-1219872418-project-admin] Returning 404 to user: Volume 62770916-7ad4-4606-86f5-a5cfadfc9dbf could not be found. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:55:05.676896 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-8de9eea0-f2c8-45c5-9375-ec8fac47a18f tempest-VolumesAdminNegativeTest-1219872418 tempest-VolumesAdminNegativeTest-1219872418-project-admin] 10.222.0.43 "PUT /compute/v2.1/servers/f032bafe-c1e0-4556-af70-8692d48dd2e2/os-volume_attachments/62770916-7ad4-4606-86f5-a5cfadfc9dbf" status: 404 len: 109 microversion: 2.1 time: 0.247398 Oct 04 21:55:05.687290 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1359/2630] 10.222.0.43 () {60 vars in 1433 bytes} [Tue Oct 4 21:55:05 2022] PUT /compute/v2.1/servers/f032bafe-c1e0-4556-af70-8692d48dd2e2/os-volume_attachments/62770916-7ad4-4606-86f5-a5cfadfc9dbf => generated 109 bytes in 256 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:55:05.706620 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-11acbfc8-3204-4315-ad60-232839de45ee tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:55:05.707539 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-11acbfc8-3204-4315-ad60-232839de45ee tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] [instance: 4ec41646-6e85-45ab-9daf-d932a8223ffd] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:55:05.730802 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-11acbfc8-3204-4315-ad60-232839de45ee tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:05.731305 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-11acbfc8-3204-4315-ad60-232839de45ee tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:05.731748 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-11acbfc8-3204-4315-ad60-232839de45ee tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:05.732546 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-11acbfc8-3204-4315-ad60-232839de45ee tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:05.733006 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-11acbfc8-3204-4315-ad60-232839de45ee tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:05.744440 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-11acbfc8-3204-4315-ad60-232839de45ee tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:06.884961 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-253695b3-9c18-45ed-b8e3-c46db4bcba84 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Flavor limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:55:06.885515 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-253695b3-9c18-45ed-b8e3-c46db4bcba84 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Image limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:55:06.885760 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-253695b3-9c18-45ed-b8e3-c46db4bcba84 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Flavor pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:55:06.886947 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-253695b3-9c18-45ed-b8e3-c46db4bcba84 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Image pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:55:06.892012 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-253695b3-9c18-45ed-b8e3-c46db4bcba84 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:55:06.948110 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-253695b3-9c18-45ed-b8e3-c46db4bcba84 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:06.950053 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-253695b3-9c18-45ed-b8e3-c46db4bcba84 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:06.955159 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-253695b3-9c18-45ed-b8e3-c46db4bcba84 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:06.956723 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-253695b3-9c18-45ed-b8e3-c46db4bcba84 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:06.958828 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-253695b3-9c18-45ed-b8e3-c46db4bcba84 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:06.959754 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-253695b3-9c18-45ed-b8e3-c46db4bcba84 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:07.022024 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-253695b3-9c18-45ed-b8e3-c46db4bcba84 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Getting quotas for project 51745fc19321469bb20afabe48b2185d. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:55:07.026788 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-11acbfc8-3204-4315-ad60-232839de45ee tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25e92d45b97b406589310789798f03cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bfbf40c0004c41abc1fc2072eb3db2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:55:07.032941 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-253695b3-9c18-45ed-b8e3-c46db4bcba84 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Getting quotas for user 4cca65ba35b14db8bf2187188de8c838 and project 51745fc19321469bb20afabe48b2185d. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:55:07.040608 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-11acbfc8-3204-4315-ad60-232839de45ee tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] 10.222.0.43 "GET /compute/v2.1/servers/4ec41646-6e85-45ab-9daf-d932a8223ffd" status: 200 len: 1317 microversion: 2.1 time: 1.351963 Oct 04 21:55:07.041229 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1360/2631] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:55:05 2022] GET /compute/v2.1/servers/4ec41646-6e85-45ab-9daf-d932a8223ffd => generated 1317 bytes in 1353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:55:07.057498 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-253695b3-9c18-45ed-b8e3-c46db4bcba84 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Going to run 1 instances... {{(pid=134101) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:55:07.063868 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-253695b3-9c18-45ed-b8e3-c46db4bcba84 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] [instance: e8900fd4-88c2-4800-baba-124e8ed0eac3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='58548514-5dac-426c-81f5-19e3fba33e23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134101) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:55:07.073170 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-7d3bda30-e6eb-43fd-83f4-9df1e72ceace req-54cef0e8-4722-4e64-b797-19f7f449e681 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ec41646-6e85-45ab-9daf-d932a8223ffd", "name": "network-vif-plugged", "status": "completed", "tag": "9aaf07e9-a2ed-4db1-bf95-9442a049daf0"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:55:07.099192 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-7d3bda30-e6eb-43fd-83f4-9df1e72ceace req-54cef0e8-4722-4e64-b797-19f7f449e681 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:07.100086 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-7d3bda30-e6eb-43fd-83f4-9df1e72ceace req-54cef0e8-4722-4e64-b797-19f7f449e681 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:07.113340 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-7d3bda30-e6eb-43fd-83f4-9df1e72ceace req-54cef0e8-4722-4e64-b797-19f7f449e681 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:07.208859 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-7d3bda30-e6eb-43fd-83f4-9df1e72ceace req-54cef0e8-4722-4e64-b797-19f7f449e681 service nova] Creating event network-vif-plugged:9aaf07e9-a2ed-4db1-bf95-9442a049daf0 for instance 4ec41646-6e85-45ab-9daf-d932a8223ffd on n-h1-860284-1 Oct 04 21:55:07.230182 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-253695b3-9c18-45ed-b8e3-c46db4bcba84 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.341941 Oct 04 21:55:07.235782 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1272/2632] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 21:55:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 3349 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 21:55:07.250852 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-7d3bda30-e6eb-43fd-83f4-9df1e72ceace req-54cef0e8-4722-4e64-b797-19f7f449e681 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.190683 Oct 04 21:55:07.256245 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1361/2633] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:55:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:55:07.266113 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-721949ea-b4eb-45cf-a2a5-37ea98eb305e tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:55:07.275454 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-721949ea-b4eb-45cf-a2a5-37ea98eb305e tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] [instance: e8900fd4-88c2-4800-baba-124e8ed0eac3] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:55:07.278775 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-8a87c921-2a90-48d3-9abf-59aba57cac6b tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:55:07.281811 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-8a87c921-2a90-48d3-9abf-59aba57cac6b tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] [instance: a2e7312a-4e0d-4c47-b7c6-e1490a3f99d3] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:55:07.327253 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8a87c921-2a90-48d3-9abf-59aba57cac6b tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:07.329965 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8a87c921-2a90-48d3-9abf-59aba57cac6b tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:07.331428 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8a87c921-2a90-48d3-9abf-59aba57cac6b tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:07.339975 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8a87c921-2a90-48d3-9abf-59aba57cac6b tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:07.345174 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8a87c921-2a90-48d3-9abf-59aba57cac6b tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:07.348434 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8a87c921-2a90-48d3-9abf-59aba57cac6b tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:07.664561 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-721949ea-b4eb-45cf-a2a5-37ea98eb305e tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cca65ba35b14db8bf2187188de8c838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51745fc19321469bb20afabe48b2185d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:55:07.684188 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-721949ea-b4eb-45cf-a2a5-37ea98eb305e tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] 10.222.0.43 "GET /compute/v2.1/servers/e8900fd4-88c2-4800-baba-124e8ed0eac3" status: 200 len: 1216 microversion: 2.1 time: 0.424665 Oct 04 21:55:07.702890 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1362/2634] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:55:07 2022] GET /compute/v2.1/servers/e8900fd4-88c2-4800-baba-124e8ed0eac3 => generated 1216 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:55:08.075280 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-41213e11-034d-48d6-a339-829c31c8abd3 tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:55:08.076621 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-41213e11-034d-48d6-a339-829c31c8abd3 tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] [instance: 4ec41646-6e85-45ab-9daf-d932a8223ffd] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:55:08.086156 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-8a87c921-2a90-48d3-9abf-59aba57cac6b tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47fbc4a6920d451cb1a2ad170de04921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43659cf5fed541e8883664bf17aced70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:55:08.086719 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-41213e11-034d-48d6-a339-829c31c8abd3 tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:08.087140 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-41213e11-034d-48d6-a339-829c31c8abd3 tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:08.087575 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-41213e11-034d-48d6-a339-829c31c8abd3 tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:08.088383 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-41213e11-034d-48d6-a339-829c31c8abd3 tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:08.088844 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-41213e11-034d-48d6-a339-829c31c8abd3 tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:08.098798 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-41213e11-034d-48d6-a339-829c31c8abd3 tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:08.100529 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-8a87c921-2a90-48d3-9abf-59aba57cac6b tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] 10.222.0.43 "GET /compute/v2.1/servers/a2e7312a-4e0d-4c47-b7c6-e1490a3f99d3" status: 200 len: 1507 microversion: 2.1 time: 0.862669 Oct 04 21:55:08.110662 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1273/2635] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:55:07 2022] GET /compute/v2.1/servers/a2e7312a-4e0d-4c47-b7c6-e1490a3f99d3 => generated 1507 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:55:08.440293 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-41213e11-034d-48d6-a339-829c31c8abd3 tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25e92d45b97b406589310789798f03cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bfbf40c0004c41abc1fc2072eb3db2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:55:08.464673 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-41213e11-034d-48d6-a339-829c31c8abd3 tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] 10.222.0.43 "GET /compute/v2.1/servers/4ec41646-6e85-45ab-9daf-d932a8223ffd" status: 200 len: 1317 microversion: 2.1 time: 0.387905 Oct 04 21:55:08.478397 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1363/2636] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:55:08 2022] GET /compute/v2.1/servers/4ec41646-6e85-45ab-9daf-d932a8223ffd => generated 1317 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:55:08.738971 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-d62f2e4f-fbe8-4b98-bc3f-b39ca17747ae tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:55:08.741811 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-d62f2e4f-fbe8-4b98-bc3f-b39ca17747ae tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] [instance: e8900fd4-88c2-4800-baba-124e8ed0eac3] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:55:08.752820 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d62f2e4f-fbe8-4b98-bc3f-b39ca17747ae tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:08.753629 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d62f2e4f-fbe8-4b98-bc3f-b39ca17747ae tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:08.754500 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d62f2e4f-fbe8-4b98-bc3f-b39ca17747ae tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:08.755450 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d62f2e4f-fbe8-4b98-bc3f-b39ca17747ae tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:08.756621 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d62f2e4f-fbe8-4b98-bc3f-b39ca17747ae tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:08.758031 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d62f2e4f-fbe8-4b98-bc3f-b39ca17747ae tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:08.892558 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-d62f2e4f-fbe8-4b98-bc3f-b39ca17747ae tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cca65ba35b14db8bf2187188de8c838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51745fc19321469bb20afabe48b2185d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:55:08.911071 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-d62f2e4f-fbe8-4b98-bc3f-b39ca17747ae tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] 10.222.0.43 "GET /compute/v2.1/servers/e8900fd4-88c2-4800-baba-124e8ed0eac3" status: 200 len: 1268 microversion: 2.1 time: 0.185369 Oct 04 21:55:08.913733 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1274/2637] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:55:08 2022] GET /compute/v2.1/servers/e8900fd4-88c2-4800-baba-124e8ed0eac3 => generated 1268 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:55:09.142735 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-536b15a3-349f-463c-beeb-40f783fb8958 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:55:09.143406 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-536b15a3-349f-463c-beeb-40f783fb8958 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] [instance: a2e7312a-4e0d-4c47-b7c6-e1490a3f99d3] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:55:09.147953 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=3 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:55:09.155428 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-536b15a3-349f-463c-beeb-40f783fb8958 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:09.156261 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-536b15a3-349f-463c-beeb-40f783fb8958 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:09.156931 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-536b15a3-349f-463c-beeb-40f783fb8958 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:09.158377 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-536b15a3-349f-463c-beeb-40f783fb8958 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:09.159328 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-536b15a3-349f-463c-beeb-40f783fb8958 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:09.159961 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-536b15a3-349f-463c-beeb-40f783fb8958 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:09.406256 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-536b15a3-349f-463c-beeb-40f783fb8958 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47fbc4a6920d451cb1a2ad170de04921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43659cf5fed541e8883664bf17aced70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:55:09.418083 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-536b15a3-349f-463c-beeb-40f783fb8958 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] 10.222.0.43 "GET /compute/v2.1/servers/a2e7312a-4e0d-4c47-b7c6-e1490a3f99d3" status: 200 len: 1507 microversion: 2.1 time: 0.280910 Oct 04 21:55:09.437422 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1364/2638] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:55:09 2022] GET /compute/v2.1/servers/a2e7312a-4e0d-4c47-b7c6-e1490a3f99d3 => generated 1507 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:55:09.497440 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-5eccdaa3-c00a-432c-9ecd-317cf2637ab9 tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:55:09.498124 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-5eccdaa3-c00a-432c-9ecd-317cf2637ab9 tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] [instance: 4ec41646-6e85-45ab-9daf-d932a8223ffd] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:55:09.524550 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5eccdaa3-c00a-432c-9ecd-317cf2637ab9 tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:09.526820 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5eccdaa3-c00a-432c-9ecd-317cf2637ab9 tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:09.529186 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5eccdaa3-c00a-432c-9ecd-317cf2637ab9 tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:09.530674 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5eccdaa3-c00a-432c-9ecd-317cf2637ab9 tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:09.535234 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5eccdaa3-c00a-432c-9ecd-317cf2637ab9 tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:09.536024 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5eccdaa3-c00a-432c-9ecd-317cf2637ab9 tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:09.857489 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-5eccdaa3-c00a-432c-9ecd-317cf2637ab9 tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25e92d45b97b406589310789798f03cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bfbf40c0004c41abc1fc2072eb3db2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:55:09.873139 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-5eccdaa3-c00a-432c-9ecd-317cf2637ab9 tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] 10.222.0.43 "GET /compute/v2.1/servers/4ec41646-6e85-45ab-9daf-d932a8223ffd" status: 200 len: 1506 microversion: 2.1 time: 0.382669 Oct 04 21:55:09.875117 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1275/2639] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:55:09 2022] GET /compute/v2.1/servers/4ec41646-6e85-45ab-9daf-d932a8223ffd => generated 1506 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:55:09.902106 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-5665d329-98aa-447b-a17d-f24f36314b87 tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:55:09.902919 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-5665d329-98aa-447b-a17d-f24f36314b87 tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] [instance: 4ec41646-6e85-45ab-9daf-d932a8223ffd] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:55:09.921004 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5665d329-98aa-447b-a17d-f24f36314b87 tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:09.921809 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5665d329-98aa-447b-a17d-f24f36314b87 tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:09.922466 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5665d329-98aa-447b-a17d-f24f36314b87 tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:09.923392 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5665d329-98aa-447b-a17d-f24f36314b87 tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:09.924032 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5665d329-98aa-447b-a17d-f24f36314b87 tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:09.924684 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5665d329-98aa-447b-a17d-f24f36314b87 tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:09.952024 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-243d5456-0c35-4b28-a1c5-ad3832b0fa92 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:55:09.952756 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-243d5456-0c35-4b28-a1c5-ad3832b0fa92 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] [instance: e8900fd4-88c2-4800-baba-124e8ed0eac3] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:55:09.974064 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-243d5456-0c35-4b28-a1c5-ad3832b0fa92 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:09.974652 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-243d5456-0c35-4b28-a1c5-ad3832b0fa92 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:09.975612 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-243d5456-0c35-4b28-a1c5-ad3832b0fa92 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:09.976528 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-243d5456-0c35-4b28-a1c5-ad3832b0fa92 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:09.977155 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-243d5456-0c35-4b28-a1c5-ad3832b0fa92 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:09.983235 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-243d5456-0c35-4b28-a1c5-ad3832b0fa92 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:10.039456 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-5665d329-98aa-447b-a17d-f24f36314b87 tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] 10.222.0.43 "GET /compute/v2.1/servers/4ec41646-6e85-45ab-9daf-d932a8223ffd/ips" status: 200 len: 109 microversion: 2.1 time: 0.141174 Oct 04 21:55:10.040293 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1365/2640] 10.222.0.43 () {58 vars in 1248 bytes} [Tue Oct 4 21:55:09 2022] GET /compute/v2.1/servers/4ec41646-6e85-45ab-9daf-d932a8223ffd/ips => generated 109 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:55:10.076859 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-ae0ab9ee-19f4-44ad-99ee-70106c5f4878 tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:55:10.077369 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-ae0ab9ee-19f4-44ad-99ee-70106c5f4878 tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] [instance: 4ec41646-6e85-45ab-9daf-d932a8223ffd] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:55:10.086409 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ae0ab9ee-19f4-44ad-99ee-70106c5f4878 tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:10.089181 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ae0ab9ee-19f4-44ad-99ee-70106c5f4878 tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:10.089873 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ae0ab9ee-19f4-44ad-99ee-70106c5f4878 tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:10.097386 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ae0ab9ee-19f4-44ad-99ee-70106c5f4878 tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:10.098136 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ae0ab9ee-19f4-44ad-99ee-70106c5f4878 tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:10.099428 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ae0ab9ee-19f4-44ad-99ee-70106c5f4878 tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:10.170751 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-ae0ab9ee-19f4-44ad-99ee-70106c5f4878 tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] 10.222.0.43 "GET /compute/v2.1/servers/4ec41646-6e85-45ab-9daf-d932a8223ffd/ips" status: 200 len: 109 microversion: 2.1 time: 0.117525 Oct 04 21:55:10.173042 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1366/2641] 10.222.0.43 () {58 vars in 1248 bytes} [Tue Oct 4 21:55:10 2022] GET /compute/v2.1/servers/4ec41646-6e85-45ab-9daf-d932a8223ffd/ips => generated 109 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:55:10.188366 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-783bc411-00bc-4966-8a13-6b5ac6a7a604 tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:55:10.189324 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-783bc411-00bc-4966-8a13-6b5ac6a7a604 tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] [instance: 4ec41646-6e85-45ab-9daf-d932a8223ffd] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:55:10.198049 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-783bc411-00bc-4966-8a13-6b5ac6a7a604 tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:10.198601 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-783bc411-00bc-4966-8a13-6b5ac6a7a604 tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:10.199184 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-783bc411-00bc-4966-8a13-6b5ac6a7a604 tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:10.199920 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-783bc411-00bc-4966-8a13-6b5ac6a7a604 tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:10.200379 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-783bc411-00bc-4966-8a13-6b5ac6a7a604 tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:10.201001 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-783bc411-00bc-4966-8a13-6b5ac6a7a604 tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:10.227849 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-243d5456-0c35-4b28-a1c5-ad3832b0fa92 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cca65ba35b14db8bf2187188de8c838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51745fc19321469bb20afabe48b2185d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:55:10.233807 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-783bc411-00bc-4966-8a13-6b5ac6a7a604 tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] 10.222.0.43 "GET /compute/v2.1/servers/4ec41646-6e85-45ab-9daf-d932a8223ffd/ips/tempest-ServerAddressesTestJSON-1885569911-network" status: 200 len: 94 microversion: 2.1 time: 0.049444 Oct 04 21:55:10.243624 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-243d5456-0c35-4b28-a1c5-ad3832b0fa92 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] 10.222.0.43 "GET /compute/v2.1/servers/e8900fd4-88c2-4800-baba-124e8ed0eac3" status: 200 len: 1274 microversion: 2.1 time: 0.296183 Oct 04 21:55:10.244547 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1276/2643] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:55:09 2022] GET /compute/v2.1/servers/e8900fd4-88c2-4800-baba-124e8ed0eac3 => generated 1274 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:55:10.245931 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1367/2643] 10.222.0.43 () {58 vars in 1401 bytes} [Tue Oct 4 21:55:10 2022] GET /compute/v2.1/servers/4ec41646-6e85-45ab-9daf-d932a8223ffd/ips/tempest-ServerAddressesTestJSON-1885569911-network => generated 94 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 21:55:10.266063 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-bd04227a-4b54-40ce-a1d3-e5009212ae21 tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:55:10.266969 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-bd04227a-4b54-40ce-a1d3-e5009212ae21 tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] [instance: 4ec41646-6e85-45ab-9daf-d932a8223ffd] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:55:10.287673 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bd04227a-4b54-40ce-a1d3-e5009212ae21 tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:10.288530 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bd04227a-4b54-40ce-a1d3-e5009212ae21 tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:10.289139 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bd04227a-4b54-40ce-a1d3-e5009212ae21 tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:10.290675 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bd04227a-4b54-40ce-a1d3-e5009212ae21 tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:10.291320 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bd04227a-4b54-40ce-a1d3-e5009212ae21 tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:10.292497 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bd04227a-4b54-40ce-a1d3-e5009212ae21 tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:10.334349 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-bd04227a-4b54-40ce-a1d3-e5009212ae21 tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] [instance: 4ec41646-6e85-45ab-9daf-d932a8223ffd] Going to try to terminate instance {{(pid=134101) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:55:10.444009 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-1335878c-7701-472b-9d2a-8a7e2fb61ccb tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:55:10.444665 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-1335878c-7701-472b-9d2a-8a7e2fb61ccb tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] [instance: a2e7312a-4e0d-4c47-b7c6-e1490a3f99d3] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:55:10.458282 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1335878c-7701-472b-9d2a-8a7e2fb61ccb tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:10.462279 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1335878c-7701-472b-9d2a-8a7e2fb61ccb tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:10.470670 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1335878c-7701-472b-9d2a-8a7e2fb61ccb tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:10.471439 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1335878c-7701-472b-9d2a-8a7e2fb61ccb tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:10.472250 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1335878c-7701-472b-9d2a-8a7e2fb61ccb tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:10.473021 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1335878c-7701-472b-9d2a-8a7e2fb61ccb tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:10.561193 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-bd04227a-4b54-40ce-a1d3-e5009212ae21 tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] 10.222.0.43 "DELETE /compute/v2.1/servers/4ec41646-6e85-45ab-9daf-d932a8223ffd" status: 204 len: 0 microversion: 2.1 time: 0.300415 Oct 04 21:55:10.562460 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1277/2644] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 21:55:10 2022] DELETE /compute/v2.1/servers/4ec41646-6e85-45ab-9daf-d932a8223ffd => generated 0 bytes in 303 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:55:10.572396 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-a9e0ede1-eb1b-4bd6-9b5e-a144e648d343 tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:55:10.573635 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-a9e0ede1-eb1b-4bd6-9b5e-a144e648d343 tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] [instance: 4ec41646-6e85-45ab-9daf-d932a8223ffd] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:55:10.595295 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a9e0ede1-eb1b-4bd6-9b5e-a144e648d343 tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:10.596163 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a9e0ede1-eb1b-4bd6-9b5e-a144e648d343 tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:10.596855 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a9e0ede1-eb1b-4bd6-9b5e-a144e648d343 tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:10.597826 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a9e0ede1-eb1b-4bd6-9b5e-a144e648d343 tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:10.598540 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a9e0ede1-eb1b-4bd6-9b5e-a144e648d343 tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:10.599414 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a9e0ede1-eb1b-4bd6-9b5e-a144e648d343 tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:10.946988 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-1335878c-7701-472b-9d2a-8a7e2fb61ccb tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47fbc4a6920d451cb1a2ad170de04921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43659cf5fed541e8883664bf17aced70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:55:10.956550 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-1335878c-7701-472b-9d2a-8a7e2fb61ccb tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] 10.222.0.43 "GET /compute/v2.1/servers/a2e7312a-4e0d-4c47-b7c6-e1490a3f99d3" status: 200 len: 1507 microversion: 2.1 time: 0.516697 Oct 04 21:55:10.961615 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1368/2645] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:55:10 2022] GET /compute/v2.1/servers/a2e7312a-4e0d-4c47-b7c6-e1490a3f99d3 => generated 1507 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:55:11.062920 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-a9e0ede1-eb1b-4bd6-9b5e-a144e648d343 tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25e92d45b97b406589310789798f03cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bfbf40c0004c41abc1fc2072eb3db2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:55:11.076682 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-a9e0ede1-eb1b-4bd6-9b5e-a144e648d343 tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] 10.222.0.43 "GET /compute/v2.1/servers/4ec41646-6e85-45ab-9daf-d932a8223ffd" status: 200 len: 1512 microversion: 2.1 time: 0.507558 Oct 04 21:55:11.093411 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1278/2646] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:55:10 2022] GET /compute/v2.1/servers/4ec41646-6e85-45ab-9daf-d932a8223ffd => generated 1512 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:55:11.279711 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-ed348c6c-a4a7-498f-9c12-9b50e0ec770a tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:55:11.280471 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-ed348c6c-a4a7-498f-9c12-9b50e0ec770a tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] [instance: e8900fd4-88c2-4800-baba-124e8ed0eac3] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:55:11.294020 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ed348c6c-a4a7-498f-9c12-9b50e0ec770a tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:11.294959 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ed348c6c-a4a7-498f-9c12-9b50e0ec770a tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:11.295513 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ed348c6c-a4a7-498f-9c12-9b50e0ec770a tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:11.296358 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ed348c6c-a4a7-498f-9c12-9b50e0ec770a tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:11.296938 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ed348c6c-a4a7-498f-9c12-9b50e0ec770a tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:11.299793 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ed348c6c-a4a7-498f-9c12-9b50e0ec770a tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:11.493484 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-ed348c6c-a4a7-498f-9c12-9b50e0ec770a tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cca65ba35b14db8bf2187188de8c838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51745fc19321469bb20afabe48b2185d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:55:11.507531 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-ed348c6c-a4a7-498f-9c12-9b50e0ec770a tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] 10.222.0.43 "GET /compute/v2.1/servers/e8900fd4-88c2-4800-baba-124e8ed0eac3" status: 200 len: 1274 microversion: 2.1 time: 0.231693 Oct 04 21:55:11.542972 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1369/2647] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:55:11 2022] GET /compute/v2.1/servers/e8900fd4-88c2-4800-baba-124e8ed0eac3 => generated 1274 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:55:11.577009 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-f062a0c0-3727-4798-8b1f-3ed67e0db1f8 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:55:11.577496 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-f062a0c0-3727-4798-8b1f-3ed67e0db1f8 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] [instance: f032bafe-c1e0-4556-af70-8692d48dd2e2] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:55:11.592243 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f062a0c0-3727-4798-8b1f-3ed67e0db1f8 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:11.593813 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f062a0c0-3727-4798-8b1f-3ed67e0db1f8 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:11.594514 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f062a0c0-3727-4798-8b1f-3ed67e0db1f8 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:11.595362 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f062a0c0-3727-4798-8b1f-3ed67e0db1f8 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:11.595710 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f062a0c0-3727-4798-8b1f-3ed67e0db1f8 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:11.596141 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f062a0c0-3727-4798-8b1f-3ed67e0db1f8 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:11.670623 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-f062a0c0-3727-4798-8b1f-3ed67e0db1f8 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] [instance: f032bafe-c1e0-4556-af70-8692d48dd2e2] Going to try to terminate instance {{(pid=134101) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:55:11.867305 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-f062a0c0-3727-4798-8b1f-3ed67e0db1f8 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] 10.222.0.43 "DELETE /compute/v2.1/servers/f032bafe-c1e0-4556-af70-8692d48dd2e2" status: 204 len: 0 microversion: 2.1 time: 0.292862 Oct 04 21:55:11.873207 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1279/2648] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 21:55:11 2022] DELETE /compute/v2.1/servers/f032bafe-c1e0-4556-af70-8692d48dd2e2 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:55:11.882169 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-9da9be3c-8406-49cd-a011-5d2cf33a4cac tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:55:11.883272 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-9da9be3c-8406-49cd-a011-5d2cf33a4cac tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] [instance: f032bafe-c1e0-4556-af70-8692d48dd2e2] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:55:11.894639 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9da9be3c-8406-49cd-a011-5d2cf33a4cac tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:11.899287 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9da9be3c-8406-49cd-a011-5d2cf33a4cac tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:11.900075 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9da9be3c-8406-49cd-a011-5d2cf33a4cac tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:11.901586 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9da9be3c-8406-49cd-a011-5d2cf33a4cac tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:11.903497 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9da9be3c-8406-49cd-a011-5d2cf33a4cac tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:11.906684 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9da9be3c-8406-49cd-a011-5d2cf33a4cac tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:11.988555 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-3dbc1344-cf33-45d6-a7c6-2628aeb86ee8 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:55:11.989275 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-3dbc1344-cf33-45d6-a7c6-2628aeb86ee8 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] [instance: a2e7312a-4e0d-4c47-b7c6-e1490a3f99d3] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:55:11.999883 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3dbc1344-cf33-45d6-a7c6-2628aeb86ee8 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:12.000394 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3dbc1344-cf33-45d6-a7c6-2628aeb86ee8 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:12.000842 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3dbc1344-cf33-45d6-a7c6-2628aeb86ee8 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:12.001567 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3dbc1344-cf33-45d6-a7c6-2628aeb86ee8 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:12.002030 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3dbc1344-cf33-45d6-a7c6-2628aeb86ee8 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:12.002484 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3dbc1344-cf33-45d6-a7c6-2628aeb86ee8 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:13.158312 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-9da9be3c-8406-49cd-a011-5d2cf33a4cac tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921f934be12045b3ac0b2c6ed5101bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4335ce6fd64a0397fbfb13e1b255ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:55:13.175463 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-9da9be3c-8406-49cd-a011-5d2cf33a4cac tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] 10.222.0.43 "GET /compute/v2.1/servers/f032bafe-c1e0-4556-af70-8692d48dd2e2" status: 200 len: 1513 microversion: 2.1 time: 1.300339 Oct 04 21:55:13.179229 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1370/2649] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:55:11 2022] GET /compute/v2.1/servers/f032bafe-c1e0-4556-af70-8692d48dd2e2 => generated 1513 bytes in 1305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:55:13.198493 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-eac79fcc-6a93-46a3-905b-69747e53d1a3 tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:55:13.199659 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-eac79fcc-6a93-46a3-905b-69747e53d1a3 tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] [instance: 4ec41646-6e85-45ab-9daf-d932a8223ffd] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:55:13.212828 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-eac79fcc-6a93-46a3-905b-69747e53d1a3 tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:13.217114 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-eac79fcc-6a93-46a3-905b-69747e53d1a3 tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:13.217912 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-eac79fcc-6a93-46a3-905b-69747e53d1a3 tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:13.222090 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-eac79fcc-6a93-46a3-905b-69747e53d1a3 tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:13.222874 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-eac79fcc-6a93-46a3-905b-69747e53d1a3 tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:13.223540 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-eac79fcc-6a93-46a3-905b-69747e53d1a3 tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:13.272959 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-3dbc1344-cf33-45d6-a7c6-2628aeb86ee8 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47fbc4a6920d451cb1a2ad170de04921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43659cf5fed541e8883664bf17aced70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:55:13.284441 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-3dbc1344-cf33-45d6-a7c6-2628aeb86ee8 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] 10.222.0.43 "GET /compute/v2.1/servers/a2e7312a-4e0d-4c47-b7c6-e1490a3f99d3" status: 200 len: 1507 microversion: 2.1 time: 1.300527 Oct 04 21:55:13.302398 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1280/2650] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:55:11 2022] GET /compute/v2.1/servers/a2e7312a-4e0d-4c47-b7c6-e1490a3f99d3 => generated 1507 bytes in 1305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:55:13.302398 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-a4819dd3-f03d-4e73-b536-d2a9345710fb tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:55:13.302398 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-a4819dd3-f03d-4e73-b536-d2a9345710fb tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] [instance: e8900fd4-88c2-4800-baba-124e8ed0eac3] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:55:13.309352 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=86,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:55:13.310988 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a4819dd3-f03d-4e73-b536-d2a9345710fb tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:13.311480 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a4819dd3-f03d-4e73-b536-d2a9345710fb tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:13.311984 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a4819dd3-f03d-4e73-b536-d2a9345710fb tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:13.312726 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a4819dd3-f03d-4e73-b536-d2a9345710fb tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:13.313193 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a4819dd3-f03d-4e73-b536-d2a9345710fb tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:13.313604 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a4819dd3-f03d-4e73-b536-d2a9345710fb tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:14.023585 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-eac79fcc-6a93-46a3-905b-69747e53d1a3 tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25e92d45b97b406589310789798f03cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bfbf40c0004c41abc1fc2072eb3db2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:55:14.040694 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-eac79fcc-6a93-46a3-905b-69747e53d1a3 tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] 10.222.0.43 "GET /compute/v2.1/servers/4ec41646-6e85-45ab-9daf-d932a8223ffd" status: 200 len: 1512 microversion: 2.1 time: 0.859154 Oct 04 21:55:14.042226 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1371/2651] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:55:13 2022] GET /compute/v2.1/servers/4ec41646-6e85-45ab-9daf-d932a8223ffd => generated 1512 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:55:14.167703 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-a4819dd3-f03d-4e73-b536-d2a9345710fb tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cca65ba35b14db8bf2187188de8c838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51745fc19321469bb20afabe48b2185d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:55:14.180226 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-a4819dd3-f03d-4e73-b536-d2a9345710fb tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] 10.222.0.43 "GET /compute/v2.1/servers/e8900fd4-88c2-4800-baba-124e8ed0eac3" status: 200 len: 1316 microversion: 2.1 time: 0.890484 Oct 04 21:55:14.194744 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1281/2652] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:55:13 2022] GET /compute/v2.1/servers/e8900fd4-88c2-4800-baba-124e8ed0eac3 => generated 1316 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:55:14.209188 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-cefec1ce-20cd-4189-8421-9e8bcb78cb28 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:55:14.210874 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-cefec1ce-20cd-4189-8421-9e8bcb78cb28 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] [instance: f032bafe-c1e0-4556-af70-8692d48dd2e2] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:55:14.219478 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cefec1ce-20cd-4189-8421-9e8bcb78cb28 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:14.220353 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cefec1ce-20cd-4189-8421-9e8bcb78cb28 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:14.221055 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cefec1ce-20cd-4189-8421-9e8bcb78cb28 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:14.222052 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cefec1ce-20cd-4189-8421-9e8bcb78cb28 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:14.222809 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cefec1ce-20cd-4189-8421-9e8bcb78cb28 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:14.223538 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cefec1ce-20cd-4189-8421-9e8bcb78cb28 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:14.316021 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-b03e8819-5bdd-4f9e-aaee-d9caae3720e1 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:55:14.317470 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-b03e8819-5bdd-4f9e-aaee-d9caae3720e1 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] [instance: a2e7312a-4e0d-4c47-b7c6-e1490a3f99d3] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:55:14.325705 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b03e8819-5bdd-4f9e-aaee-d9caae3720e1 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:14.331405 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b03e8819-5bdd-4f9e-aaee-d9caae3720e1 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:14.332025 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b03e8819-5bdd-4f9e-aaee-d9caae3720e1 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:14.333041 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b03e8819-5bdd-4f9e-aaee-d9caae3720e1 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:14.333623 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b03e8819-5bdd-4f9e-aaee-d9caae3720e1 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:14.338246 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b03e8819-5bdd-4f9e-aaee-d9caae3720e1 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:15.647674 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-b03e8819-5bdd-4f9e-aaee-d9caae3720e1 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47fbc4a6920d451cb1a2ad170de04921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43659cf5fed541e8883664bf17aced70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:55:15.660462 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:55:15.674532 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-cefec1ce-20cd-4189-8421-9e8bcb78cb28 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921f934be12045b3ac0b2c6ed5101bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4335ce6fd64a0397fbfb13e1b255ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:55:15.685038 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-cefec1ce-20cd-4189-8421-9e8bcb78cb28 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] 10.222.0.43 "GET /compute/v2.1/servers/f032bafe-c1e0-4556-af70-8692d48dd2e2" status: 200 len: 1513 microversion: 2.1 time: 1.481268 Oct 04 21:55:15.686235 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-b03e8819-5bdd-4f9e-aaee-d9caae3720e1 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] 10.222.0.43 "GET /compute/v2.1/servers/a2e7312a-4e0d-4c47-b7c6-e1490a3f99d3" status: 200 len: 1507 microversion: 2.1 time: 1.358901 Oct 04 21:55:15.691619 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1282/2653] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:55:14 2022] GET /compute/v2.1/servers/a2e7312a-4e0d-4c47-b7c6-e1490a3f99d3 => generated 1507 bytes in 1381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:55:15.697024 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1372/2654] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:55:14 2022] GET /compute/v2.1/servers/f032bafe-c1e0-4556-af70-8692d48dd2e2 => generated 1513 bytes in 1494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:55:15.749543 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-b6289da9-2235-4af6-b0c1-db22e37aa856 tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:55:15.752418 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-77604411-2c09-44ef-bcd2-5bd69de4482a tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:55:15.766009 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-b6289da9-2235-4af6-b0c1-db22e37aa856 tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] [instance: 4ec41646-6e85-45ab-9daf-d932a8223ffd] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:55:15.770781 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-77604411-2c09-44ef-bcd2-5bd69de4482a tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] [instance: e8900fd4-88c2-4800-baba-124e8ed0eac3] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:55:15.802206 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-77604411-2c09-44ef-bcd2-5bd69de4482a tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:15.806921 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-77604411-2c09-44ef-bcd2-5bd69de4482a tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:15.808022 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-77604411-2c09-44ef-bcd2-5bd69de4482a tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:15.808709 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b6289da9-2235-4af6-b0c1-db22e37aa856 tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:15.811316 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-77604411-2c09-44ef-bcd2-5bd69de4482a tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:15.811869 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b6289da9-2235-4af6-b0c1-db22e37aa856 tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:15.813067 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b6289da9-2235-4af6-b0c1-db22e37aa856 tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:15.815583 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b6289da9-2235-4af6-b0c1-db22e37aa856 tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:15.815959 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-77604411-2c09-44ef-bcd2-5bd69de4482a tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:15.816850 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-77604411-2c09-44ef-bcd2-5bd69de4482a tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:15.819943 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b6289da9-2235-4af6-b0c1-db22e37aa856 tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:15.821379 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b6289da9-2235-4af6-b0c1-db22e37aa856 tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:16.106618 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-b6289da9-2235-4af6-b0c1-db22e37aa856 tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25e92d45b97b406589310789798f03cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bfbf40c0004c41abc1fc2072eb3db2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:55:16.117293 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-b6289da9-2235-4af6-b0c1-db22e37aa856 tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] 10.222.0.43 "GET /compute/v2.1/servers/4ec41646-6e85-45ab-9daf-d932a8223ffd" status: 200 len: 1302 microversion: 2.1 time: 0.424545 Oct 04 21:55:16.135253 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1283/2655] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:55:15 2022] GET /compute/v2.1/servers/4ec41646-6e85-45ab-9daf-d932a8223ffd => generated 1302 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:55:16.154298 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-ddd0bc0d-5194-4adf-a8ea-3f837f388dae req-eb0c2b69-7b3e-4efc-a590-a6363bb32bd1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ec41646-6e85-45ab-9daf-d932a8223ffd", "name": "network-vif-deleted", "tag": "9aaf07e9-a2ed-4db1-bf95-9442a049daf0"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:55:16.211594 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-ddd0bc0d-5194-4adf-a8ea-3f837f388dae req-eb0c2b69-7b3e-4efc-a590-a6363bb32bd1 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:16.212445 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-ddd0bc0d-5194-4adf-a8ea-3f837f388dae req-eb0c2b69-7b3e-4efc-a590-a6363bb32bd1 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:16.213589 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-ddd0bc0d-5194-4adf-a8ea-3f837f388dae req-eb0c2b69-7b3e-4efc-a590-a6363bb32bd1 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:16.233270 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-ddd0bc0d-5194-4adf-a8ea-3f837f388dae req-eb0c2b69-7b3e-4efc-a590-a6363bb32bd1 service nova] Creating event network-vif-deleted:9aaf07e9-a2ed-4db1-bf95-9442a049daf0 for instance 4ec41646-6e85-45ab-9daf-d932a8223ffd on n-h1-860284-1 Oct 04 21:55:16.242765 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-ddd0bc0d-5194-4adf-a8ea-3f837f388dae req-eb0c2b69-7b3e-4efc-a590-a6363bb32bd1 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104729 Oct 04 21:55:16.244221 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1284/2656] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:55:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:55:16.723803 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-cee15b6a-104b-4472-8a29-0725ee79cb97 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:55:16.726528 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-cee15b6a-104b-4472-8a29-0725ee79cb97 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] [instance: a2e7312a-4e0d-4c47-b7c6-e1490a3f99d3] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:55:16.749088 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cee15b6a-104b-4472-8a29-0725ee79cb97 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:16.751021 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cee15b6a-104b-4472-8a29-0725ee79cb97 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:16.754724 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cee15b6a-104b-4472-8a29-0725ee79cb97 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:16.759131 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cee15b6a-104b-4472-8a29-0725ee79cb97 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:16.759983 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cee15b6a-104b-4472-8a29-0725ee79cb97 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:16.772579 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-77604411-2c09-44ef-bcd2-5bd69de4482a tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cca65ba35b14db8bf2187188de8c838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51745fc19321469bb20afabe48b2185d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:55:16.774182 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cee15b6a-104b-4472-8a29-0725ee79cb97 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:16.783806 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=100 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:55:16.804228 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-77604411-2c09-44ef-bcd2-5bd69de4482a tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] 10.222.0.43 "GET /compute/v2.1/servers/e8900fd4-88c2-4800-baba-124e8ed0eac3" status: 200 len: 1316 microversion: 2.1 time: 1.079336 Oct 04 21:55:16.811150 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1373/2657] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:55:15 2022] GET /compute/v2.1/servers/e8900fd4-88c2-4800-baba-124e8ed0eac3 => generated 1316 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:55:16.835237 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-dddddf0f-cce0-4b70-8f7d-b7efd37e9c74 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:55:16.836467 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-dddddf0f-cce0-4b70-8f7d-b7efd37e9c74 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] [instance: f032bafe-c1e0-4556-af70-8692d48dd2e2] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:55:16.866215 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dddddf0f-cce0-4b70-8f7d-b7efd37e9c74 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:16.875841 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dddddf0f-cce0-4b70-8f7d-b7efd37e9c74 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:16.877748 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dddddf0f-cce0-4b70-8f7d-b7efd37e9c74 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:16.884797 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dddddf0f-cce0-4b70-8f7d-b7efd37e9c74 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:16.890385 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dddddf0f-cce0-4b70-8f7d-b7efd37e9c74 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:16.893672 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dddddf0f-cce0-4b70-8f7d-b7efd37e9c74 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:16.996678 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=2 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:55:17.045333 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=6 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:55:17.083354 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-dddddf0f-cce0-4b70-8f7d-b7efd37e9c74 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921f934be12045b3ac0b2c6ed5101bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4335ce6fd64a0397fbfb13e1b255ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:55:17.097115 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-dddddf0f-cce0-4b70-8f7d-b7efd37e9c74 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] 10.222.0.43 "GET /compute/v2.1/servers/f032bafe-c1e0-4556-af70-8692d48dd2e2" status: 200 len: 1302 microversion: 2.1 time: 0.282680 Oct 04 21:55:17.098071 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1374/2658] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:55:16 2022] GET /compute/v2.1/servers/f032bafe-c1e0-4556-af70-8692d48dd2e2 => generated 1302 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:55:17.143950 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-d71499f7-465f-4b0b-9c05-4f0e2b2c9718 req-dc345eaa-da22-4fec-9705-990ffef45b5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f032bafe-c1e0-4556-af70-8692d48dd2e2", "name": "network-vif-deleted", "tag": "ad84d157-9907-4558-9f67-25a9f944e7ed"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:55:17.176905 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-d71499f7-465f-4b0b-9c05-4f0e2b2c9718 req-dc345eaa-da22-4fec-9705-990ffef45b5e service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:17.178692 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-d71499f7-465f-4b0b-9c05-4f0e2b2c9718 req-dc345eaa-da22-4fec-9705-990ffef45b5e service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:17.180631 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-d71499f7-465f-4b0b-9c05-4f0e2b2c9718 req-dc345eaa-da22-4fec-9705-990ffef45b5e service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:17.215333 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-d71499f7-465f-4b0b-9c05-4f0e2b2c9718 req-dc345eaa-da22-4fec-9705-990ffef45b5e service nova] Creating event network-vif-deleted:ad84d157-9907-4558-9f67-25a9f944e7ed for instance f032bafe-c1e0-4556-af70-8692d48dd2e2 on n-h2-860284-1 Oct 04 21:55:17.224326 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-d71499f7-465f-4b0b-9c05-4f0e2b2c9718 req-dc345eaa-da22-4fec-9705-990ffef45b5e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096657 Oct 04 21:55:17.225844 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1375/2659] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:55:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:55:17.235601 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-320b3cf6-ae71-49fc-9929-8fb4ad37100a tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:55:17.236771 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-320b3cf6-ae71-49fc-9929-8fb4ad37100a tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] [instance: 4ec41646-6e85-45ab-9daf-d932a8223ffd] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:55:17.245711 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-cee15b6a-104b-4472-8a29-0725ee79cb97 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47fbc4a6920d451cb1a2ad170de04921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43659cf5fed541e8883664bf17aced70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:55:17.247349 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-320b3cf6-ae71-49fc-9929-8fb4ad37100a tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:17.248145 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-320b3cf6-ae71-49fc-9929-8fb4ad37100a tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:17.248986 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-320b3cf6-ae71-49fc-9929-8fb4ad37100a tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:17.250041 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-320b3cf6-ae71-49fc-9929-8fb4ad37100a tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:17.252725 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-320b3cf6-ae71-49fc-9929-8fb4ad37100a tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:17.253558 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-320b3cf6-ae71-49fc-9929-8fb4ad37100a tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:17.257267 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-cee15b6a-104b-4472-8a29-0725ee79cb97 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] 10.222.0.43 "GET /compute/v2.1/servers/a2e7312a-4e0d-4c47-b7c6-e1490a3f99d3" status: 200 len: 1507 microversion: 2.1 time: 0.538945 Oct 04 21:55:17.258409 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1285/2660] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:55:16 2022] GET /compute/v2.1/servers/a2e7312a-4e0d-4c47-b7c6-e1490a3f99d3 => generated 1507 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:55:17.295100 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-320b3cf6-ae71-49fc-9929-8fb4ad37100a tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] HTTP exception thrown: Instance 4ec41646-6e85-45ab-9daf-d932a8223ffd could not be found. Oct 04 21:55:17.297696 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-320b3cf6-ae71-49fc-9929-8fb4ad37100a tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Request method failure captured: Oct 04 21:55:17.297696 n-d-860284-1 devstack@n-api.service[134102]: request: GET /compute/v2.1/servers/4ec41646-6e85-45ab-9daf-d932a8223ffd HTTP/1.1 Oct 04 21:55:17.297696 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 21:55:17.297696 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 21:55:17.297696 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 21:55:17.297696 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 21:55:17.297696 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 21:55:17.297696 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 21:55:17.297696 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 21:55:17.297696 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 21:55:17.297696 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPKufxKF8SqR7n52g_Z1dF3--KFXLNc8qhN6NcdxyjxZAV6NOP88XrSw4I7p-VKSaFcBSwXWqOW5r5HN12Bb4oCXERRT-aEXNh8tJSlDEnURhb1_t0hO_vR1CmfvVdyomYOv8mpa7ECXn0-hwSP2TmJxxAMaOk6c3vRiLmX1FZi-7y4M Oct 04 21:55:17.297696 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 21:55:17.297696 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 21:55:17.297696 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 21:55:17.297696 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 21:55:17.297696 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 21:55:17.297696 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 21:55:17.297696 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: b2bfbf40c0004c41abc1fc2072eb3db2 Oct 04 21:55:17.297696 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-ServerAddressesTestJSON-656443971 Oct 04 21:55:17.297696 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 21:55:17.297696 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 21:55:17.297696 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b2bfbf40c0004c41abc1fc2072eb3db2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_b2bfbf40c0004c41abc1fc2072eb3db2", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b2bfbf40c0004c41abc1fc2072eb3db2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/b2bfbf40c0004c41abc1fc2072eb3db2"}]}] Oct 04 21:55:17.297696 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-ServerAddressesTestJSON-656443971 Oct 04 21:55:17.297696 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: b2bfbf40c0004c41abc1fc2072eb3db2 Oct 04 21:55:17.297696 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-ServerAddressesTestJSON-656443971 Oct 04 21:55:17.297696 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-ServerAddressesTestJSON-656443971-project Oct 04 21:55:17.297696 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 21:55:17.297696 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 21:55:17.297696 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: 25e92d45b97b406589310789798f03cc Oct 04 21:55:17.297696 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-ServerAddressesTestJSON-656443971-project Oct 04 21:55:17.297696 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 21:55:17.297696 n-d-860284-1 devstack@n-api.service[134102]: exception: Instance 4ec41646-6e85-45ab-9daf-d932a8223ffd could not be found. Oct 04 21:55:17.297696 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': '4ec41646-6e85-45ab-9daf-d932a8223ffd'} Oct 04 21:55:17.297696 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:55:17.297696 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:55:17.297696 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:55:17.297696 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:55:17.297696 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:55:17.297696 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:55:17.297696 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:55:17.297696 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:55:17.297696 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:55:17.297696 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:55:17.297696 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ec41646-6e85-45ab-9daf-d932a8223ffd could not be found. Oct 04 21:55:17.297696 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:55:17.297696 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:55:17.297696 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:55:17.297696 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:55:17.297696 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:55:17.297696 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:55:17.297696 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:55:17.297696 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:55:17.297696 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:55:17.297696 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:55:17.297696 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:55:17.297696 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:55:17.297696 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:55:17.297696 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:55:17.297696 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:55:17.297696 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:55:17.297696 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ec41646-6e85-45ab-9daf-d932a8223ffd could not be found. Oct 04 21:55:17.297696 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:55:17.297696 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:55:17.297696 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:55:17.303788 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:55:17.303788 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:55:17.303788 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:55:17.303788 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:55:17.303788 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:55:17.303788 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ec41646-6e85-45ab-9daf-d932a8223ffd could not be found. Oct 04 21:55:17.303788 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:55:17.307364 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-320b3cf6-ae71-49fc-9929-8fb4ad37100a tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] Returning 404 to user: Instance 4ec41646-6e85-45ab-9daf-d932a8223ffd could not be found. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:55:17.309112 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-320b3cf6-ae71-49fc-9929-8fb4ad37100a tempest-ServerAddressesTestJSON-656443971 tempest-ServerAddressesTestJSON-656443971-project] 10.222.0.43 "GET /compute/v2.1/servers/4ec41646-6e85-45ab-9daf-d932a8223ffd" status: 404 len: 111 microversion: 2.1 time: 0.081712 Oct 04 21:55:17.310674 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1376/2661] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:55:17 2022] GET /compute/v2.1/servers/4ec41646-6e85-45ab-9daf-d932a8223ffd => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:55:17.835562 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-a92ddd3d-fa84-45ea-8985-2ff972d7a0c4 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:55:17.836257 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-a92ddd3d-fa84-45ea-8985-2ff972d7a0c4 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] [instance: e8900fd4-88c2-4800-baba-124e8ed0eac3] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:55:17.857655 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a92ddd3d-fa84-45ea-8985-2ff972d7a0c4 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:17.870118 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a92ddd3d-fa84-45ea-8985-2ff972d7a0c4 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:17.870774 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a92ddd3d-fa84-45ea-8985-2ff972d7a0c4 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:17.871614 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a92ddd3d-fa84-45ea-8985-2ff972d7a0c4 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:17.877056 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a92ddd3d-fa84-45ea-8985-2ff972d7a0c4 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:17.877532 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a92ddd3d-fa84-45ea-8985-2ff972d7a0c4 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:18.126798 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-e3a51763-a744-4686-ac71-96961505af53 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:55:18.127654 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-e3a51763-a744-4686-ac71-96961505af53 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] [instance: f032bafe-c1e0-4556-af70-8692d48dd2e2] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:55:18.131073 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell0:SELECT=2 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:55:18.144874 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e3a51763-a744-4686-ac71-96961505af53 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:18.145903 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e3a51763-a744-4686-ac71-96961505af53 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:18.145903 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e3a51763-a744-4686-ac71-96961505af53 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:18.150563 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e3a51763-a744-4686-ac71-96961505af53 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:18.151400 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e3a51763-a744-4686-ac71-96961505af53 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:18.151969 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e3a51763-a744-4686-ac71-96961505af53 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:18.174500 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-e3a51763-a744-4686-ac71-96961505af53 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] HTTP exception thrown: Instance f032bafe-c1e0-4556-af70-8692d48dd2e2 could not be found. Oct 04 21:55:18.176470 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-e3a51763-a744-4686-ac71-96961505af53 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Request method failure captured: Oct 04 21:55:18.176470 n-d-860284-1 devstack@n-api.service[134102]: request: GET /compute/v2.1/servers/f032bafe-c1e0-4556-af70-8692d48dd2e2 HTTP/1.1 Oct 04 21:55:18.176470 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 21:55:18.176470 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 21:55:18.176470 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 21:55:18.176470 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 21:55:18.176470 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 21:55:18.176470 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 21:55:18.176470 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 21:55:18.176470 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 21:55:18.176470 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPKryVGuW_QEc89YzzR_SWtV4W96U4o11TSygBxOM8VPWfNOdhdG8cGXbSCNroCoTAA1rvLvNpRRTlXEQ4nY1ApiqIvkHeKQNy3Y1rA-AASczqCR0Kl60Iiw5slt422nR2bVfEsDdrYNlMqJ3pv_et0i3qaaZ6B5NpNUj2rg4uauKosg Oct 04 21:55:18.176470 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 21:55:18.176470 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 21:55:18.176470 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 21:55:18.176470 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 21:55:18.176470 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 21:55:18.176470 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 21:55:18.176470 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: 1c4335ce6fd64a0397fbfb13e1b255ef Oct 04 21:55:18.176470 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-VolumesAdminNegativeTest-385569383 Oct 04 21:55:18.176470 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 21:55:18.176470 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 21:55:18.176470 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1c4335ce6fd64a0397fbfb13e1b255ef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_1c4335ce6fd64a0397fbfb13e1b255ef", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1c4335ce6fd64a0397fbfb13e1b255ef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/1c4335ce6fd64a0397fbfb13e1b255ef"}]}] Oct 04 21:55:18.176470 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-VolumesAdminNegativeTest-385569383 Oct 04 21:55:18.176470 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: 1c4335ce6fd64a0397fbfb13e1b255ef Oct 04 21:55:18.176470 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-385569383 Oct 04 21:55:18.176470 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-VolumesAdminNegativeTest-385569383-project Oct 04 21:55:18.176470 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 21:55:18.176470 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 21:55:18.176470 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: 921f934be12045b3ac0b2c6ed5101bec Oct 04 21:55:18.176470 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-VolumesAdminNegativeTest-385569383-project Oct 04 21:55:18.176470 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 21:55:18.176470 n-d-860284-1 devstack@n-api.service[134102]: exception: Instance f032bafe-c1e0-4556-af70-8692d48dd2e2 could not be found. Oct 04 21:55:18.176470 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': 'f032bafe-c1e0-4556-af70-8692d48dd2e2'} Oct 04 21:55:18.176470 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:55:18.176470 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:55:18.176470 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:55:18.176470 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:55:18.176470 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:55:18.176470 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:55:18.176470 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:55:18.176470 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:55:18.176470 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:55:18.176470 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:55:18.176470 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f032bafe-c1e0-4556-af70-8692d48dd2e2 could not be found. Oct 04 21:55:18.176470 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:55:18.176470 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:55:18.176470 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:55:18.176470 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:55:18.176470 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:55:18.176470 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:55:18.176470 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:55:18.176470 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:55:18.176470 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:55:18.176470 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:55:18.176470 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:55:18.176470 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:55:18.176470 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:55:18.176470 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:55:18.176470 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:55:18.176470 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:55:18.176470 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f032bafe-c1e0-4556-af70-8692d48dd2e2 could not be found. Oct 04 21:55:18.176470 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:55:18.176470 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:55:18.176470 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:55:18.181592 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:55:18.181592 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:55:18.181592 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:55:18.181592 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:55:18.181592 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:55:18.181592 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f032bafe-c1e0-4556-af70-8692d48dd2e2 could not be found. Oct 04 21:55:18.181592 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:55:18.181592 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-e3a51763-a744-4686-ac71-96961505af53 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Returning 404 to user: Instance f032bafe-c1e0-4556-af70-8692d48dd2e2 could not be found. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:55:18.181592 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-e3a51763-a744-4686-ac71-96961505af53 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] 10.222.0.43 "GET /compute/v2.1/servers/f032bafe-c1e0-4556-af70-8692d48dd2e2" status: 404 len: 111 microversion: 2.1 time: 0.056572 Oct 04 21:55:18.184507 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1377/2662] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:55:18 2022] GET /compute/v2.1/servers/f032bafe-c1e0-4556-af70-8692d48dd2e2 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 21:55:18.286092 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-5cf5d25a-7747-458e-ada8-aea5b872b3b2 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:55:18.286776 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-5cf5d25a-7747-458e-ada8-aea5b872b3b2 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] [instance: a2e7312a-4e0d-4c47-b7c6-e1490a3f99d3] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:55:18.300200 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5cf5d25a-7747-458e-ada8-aea5b872b3b2 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:18.300606 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5cf5d25a-7747-458e-ada8-aea5b872b3b2 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:18.301094 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5cf5d25a-7747-458e-ada8-aea5b872b3b2 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:18.301789 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5cf5d25a-7747-458e-ada8-aea5b872b3b2 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:18.303264 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5cf5d25a-7747-458e-ada8-aea5b872b3b2 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:18.304198 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5cf5d25a-7747-458e-ada8-aea5b872b3b2 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:18.512416 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-a92ddd3d-fa84-45ea-8985-2ff972d7a0c4 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cca65ba35b14db8bf2187188de8c838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51745fc19321469bb20afabe48b2185d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:55:18.531809 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-a92ddd3d-fa84-45ea-8985-2ff972d7a0c4 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] 10.222.0.43 "GET /compute/v2.1/servers/e8900fd4-88c2-4800-baba-124e8ed0eac3" status: 200 len: 1316 microversion: 2.1 time: 0.700227 Oct 04 21:55:18.533102 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1286/2663] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:55:17 2022] GET /compute/v2.1/servers/e8900fd4-88c2-4800-baba-124e8ed0eac3 => generated 1316 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:55:18.824174 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-5cf5d25a-7747-458e-ada8-aea5b872b3b2 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47fbc4a6920d451cb1a2ad170de04921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43659cf5fed541e8883664bf17aced70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:55:18.836091 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-5cf5d25a-7747-458e-ada8-aea5b872b3b2 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] 10.222.0.43 "GET /compute/v2.1/servers/a2e7312a-4e0d-4c47-b7c6-e1490a3f99d3" status: 200 len: 1507 microversion: 2.1 time: 0.553619 Oct 04 21:55:18.836614 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1378/2664] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:55:18 2022] GET /compute/v2.1/servers/a2e7312a-4e0d-4c47-b7c6-e1490a3f99d3 => generated 1507 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:55:19.564033 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-b170cccb-ad34-42b0-8f8e-993369129750 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:55:19.564950 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-b170cccb-ad34-42b0-8f8e-993369129750 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] [instance: e8900fd4-88c2-4800-baba-124e8ed0eac3] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:55:19.580939 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b170cccb-ad34-42b0-8f8e-993369129750 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:19.581656 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b170cccb-ad34-42b0-8f8e-993369129750 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:19.582223 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b170cccb-ad34-42b0-8f8e-993369129750 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:19.587296 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b170cccb-ad34-42b0-8f8e-993369129750 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:19.587946 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b170cccb-ad34-42b0-8f8e-993369129750 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:19.588498 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b170cccb-ad34-42b0-8f8e-993369129750 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:19.864407 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-c971f3bc-9e28-4812-94db-5f7d9c37fe3a tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:55:19.866407 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-c971f3bc-9e28-4812-94db-5f7d9c37fe3a tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] [instance: a2e7312a-4e0d-4c47-b7c6-e1490a3f99d3] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:55:19.882321 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c971f3bc-9e28-4812-94db-5f7d9c37fe3a tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:19.883312 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c971f3bc-9e28-4812-94db-5f7d9c37fe3a tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:19.883773 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c971f3bc-9e28-4812-94db-5f7d9c37fe3a tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:19.885897 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c971f3bc-9e28-4812-94db-5f7d9c37fe3a tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:19.886309 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c971f3bc-9e28-4812-94db-5f7d9c37fe3a tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:19.886778 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c971f3bc-9e28-4812-94db-5f7d9c37fe3a tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:20.115981 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-b170cccb-ad34-42b0-8f8e-993369129750 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cca65ba35b14db8bf2187188de8c838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51745fc19321469bb20afabe48b2185d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:55:20.129172 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-b170cccb-ad34-42b0-8f8e-993369129750 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] 10.222.0.43 "GET /compute/v2.1/servers/e8900fd4-88c2-4800-baba-124e8ed0eac3" status: 200 len: 1316 microversion: 2.1 time: 0.570114 Oct 04 21:55:20.129784 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1287/2665] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:55:19 2022] GET /compute/v2.1/servers/e8900fd4-88c2-4800-baba-124e8ed0eac3 => generated 1316 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:55:20.158030 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-2ae7a3d0-a64a-446a-b52f-df8055cec47f req-0d9f6c97-97d1-479a-8b63-36b2f6a41f68 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8900fd4-88c2-4800-baba-124e8ed0eac3", "tag": "958c011c-e3f5-4671-8e25-056b9b11ecfc"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:55:20.200041 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-2ae7a3d0-a64a-446a-b52f-df8055cec47f req-0d9f6c97-97d1-479a-8b63-36b2f6a41f68 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:20.200845 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-2ae7a3d0-a64a-446a-b52f-df8055cec47f req-0d9f6c97-97d1-479a-8b63-36b2f6a41f68 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:20.201297 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-2ae7a3d0-a64a-446a-b52f-df8055cec47f req-0d9f6c97-97d1-479a-8b63-36b2f6a41f68 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:20.233130 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-2ae7a3d0-a64a-446a-b52f-df8055cec47f req-0d9f6c97-97d1-479a-8b63-36b2f6a41f68 service nova] Creating event network-changed:958c011c-e3f5-4671-8e25-056b9b11ecfc for instance e8900fd4-88c2-4800-baba-124e8ed0eac3 on n-h2-860284-1 Oct 04 21:55:20.246706 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-2ae7a3d0-a64a-446a-b52f-df8055cec47f req-0d9f6c97-97d1-479a-8b63-36b2f6a41f68 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110400 Oct 04 21:55:20.248034 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1288/2666] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:55:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:55:20.499474 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-c971f3bc-9e28-4812-94db-5f7d9c37fe3a tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47fbc4a6920d451cb1a2ad170de04921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43659cf5fed541e8883664bf17aced70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:55:20.517411 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-c971f3bc-9e28-4812-94db-5f7d9c37fe3a tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] 10.222.0.43 "GET /compute/v2.1/servers/a2e7312a-4e0d-4c47-b7c6-e1490a3f99d3" status: 200 len: 1507 microversion: 2.1 time: 0.655136 Oct 04 21:55:20.518312 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1379/2667] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:55:19 2022] GET /compute/v2.1/servers/a2e7312a-4e0d-4c47-b7c6-e1490a3f99d3 => generated 1507 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:55:21.182775 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-f63f2f58-0f03-4f8d-84e1-9fb46a8fae5f tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:55:21.188554 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-f63f2f58-0f03-4f8d-84e1-9fb46a8fae5f tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] [instance: e8900fd4-88c2-4800-baba-124e8ed0eac3] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:55:21.220025 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f63f2f58-0f03-4f8d-84e1-9fb46a8fae5f tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:21.220670 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f63f2f58-0f03-4f8d-84e1-9fb46a8fae5f tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:21.221656 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f63f2f58-0f03-4f8d-84e1-9fb46a8fae5f tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:21.222899 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f63f2f58-0f03-4f8d-84e1-9fb46a8fae5f tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:21.223606 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f63f2f58-0f03-4f8d-84e1-9fb46a8fae5f tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:21.224352 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f63f2f58-0f03-4f8d-84e1-9fb46a8fae5f tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:21.545136 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-a3cef5bd-3344-4507-8478-3ffdd7ee80f5 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:55:21.545762 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-a3cef5bd-3344-4507-8478-3ffdd7ee80f5 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] [instance: a2e7312a-4e0d-4c47-b7c6-e1490a3f99d3] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:55:21.565345 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a3cef5bd-3344-4507-8478-3ffdd7ee80f5 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:21.570237 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a3cef5bd-3344-4507-8478-3ffdd7ee80f5 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:21.571591 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a3cef5bd-3344-4507-8478-3ffdd7ee80f5 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:21.574167 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a3cef5bd-3344-4507-8478-3ffdd7ee80f5 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:21.579715 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a3cef5bd-3344-4507-8478-3ffdd7ee80f5 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:21.581930 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a3cef5bd-3344-4507-8478-3ffdd7ee80f5 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:22.118392 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-f63f2f58-0f03-4f8d-84e1-9fb46a8fae5f tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cca65ba35b14db8bf2187188de8c838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51745fc19321469bb20afabe48b2185d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:55:22.134150 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-f63f2f58-0f03-4f8d-84e1-9fb46a8fae5f tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] 10.222.0.43 "GET /compute/v2.1/servers/e8900fd4-88c2-4800-baba-124e8ed0eac3" status: 200 len: 1316 microversion: 2.1 time: 0.977578 Oct 04 21:55:22.151262 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1289/2668] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:55:21 2022] GET /compute/v2.1/servers/e8900fd4-88c2-4800-baba-124e8ed0eac3 => generated 1316 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:55:22.459314 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-a3cef5bd-3344-4507-8478-3ffdd7ee80f5 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47fbc4a6920d451cb1a2ad170de04921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43659cf5fed541e8883664bf17aced70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:55:22.471915 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-a3cef5bd-3344-4507-8478-3ffdd7ee80f5 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] 10.222.0.43 "GET /compute/v2.1/servers/a2e7312a-4e0d-4c47-b7c6-e1490a3f99d3" status: 200 len: 1507 microversion: 2.1 time: 0.931236 Oct 04 21:55:22.472992 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1380/2669] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:55:21 2022] GET /compute/v2.1/servers/a2e7312a-4e0d-4c47-b7c6-e1490a3f99d3 => generated 1507 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:55:23.164441 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-83bb4822-7863-40ab-a257-27f0fae244a6 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:55:23.166516 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-83bb4822-7863-40ab-a257-27f0fae244a6 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] [instance: e8900fd4-88c2-4800-baba-124e8ed0eac3] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:55:23.196867 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-83bb4822-7863-40ab-a257-27f0fae244a6 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:23.197757 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-83bb4822-7863-40ab-a257-27f0fae244a6 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:23.198683 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-83bb4822-7863-40ab-a257-27f0fae244a6 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:23.201426 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-83bb4822-7863-40ab-a257-27f0fae244a6 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:23.202385 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-83bb4822-7863-40ab-a257-27f0fae244a6 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:23.203744 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-83bb4822-7863-40ab-a257-27f0fae244a6 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:23.508181 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-53cbb0e8-8dbc-46a1-a51b-82a7d843e514 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:55:23.510097 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-53cbb0e8-8dbc-46a1-a51b-82a7d843e514 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] [instance: a2e7312a-4e0d-4c47-b7c6-e1490a3f99d3] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:55:23.525991 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-53cbb0e8-8dbc-46a1-a51b-82a7d843e514 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:23.529797 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-53cbb0e8-8dbc-46a1-a51b-82a7d843e514 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:23.531497 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-53cbb0e8-8dbc-46a1-a51b-82a7d843e514 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:23.533675 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-53cbb0e8-8dbc-46a1-a51b-82a7d843e514 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:23.535671 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-53cbb0e8-8dbc-46a1-a51b-82a7d843e514 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:23.536379 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-53cbb0e8-8dbc-46a1-a51b-82a7d843e514 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:23.784786 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-83bb4822-7863-40ab-a257-27f0fae244a6 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cca65ba35b14db8bf2187188de8c838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51745fc19321469bb20afabe48b2185d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:55:23.795507 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-83bb4822-7863-40ab-a257-27f0fae244a6 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] 10.222.0.43 "GET /compute/v2.1/servers/e8900fd4-88c2-4800-baba-124e8ed0eac3" status: 200 len: 1316 microversion: 2.1 time: 0.636154 Oct 04 21:55:23.798391 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1290/2670] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:55:23 2022] GET /compute/v2.1/servers/e8900fd4-88c2-4800-baba-124e8ed0eac3 => generated 1316 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:55:24.094814 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-34bcb800-a1b8-4b4f-a5a1-b5f2d4aaa2ff tempest-ServicesAdminNegativeTestJSON-10227608 tempest-ServicesAdminNegativeTestJSON-10227608-project-admin] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:55:24.106429 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-34bcb800-a1b8-4b4f-a5a1-b5f2d4aaa2ff tempest-ServicesAdminNegativeTestJSON-10227608 tempest-ServicesAdminNegativeTestJSON-10227608-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:24.106940 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-34bcb800-a1b8-4b4f-a5a1-b5f2d4aaa2ff tempest-ServicesAdminNegativeTestJSON-10227608 tempest-ServicesAdminNegativeTestJSON-10227608-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:24.107392 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-34bcb800-a1b8-4b4f-a5a1-b5f2d4aaa2ff tempest-ServicesAdminNegativeTestJSON-10227608 tempest-ServicesAdminNegativeTestJSON-10227608-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:24.108156 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-34bcb800-a1b8-4b4f-a5a1-b5f2d4aaa2ff tempest-ServicesAdminNegativeTestJSON-10227608 tempest-ServicesAdminNegativeTestJSON-10227608-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:24.108621 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-34bcb800-a1b8-4b4f-a5a1-b5f2d4aaa2ff tempest-ServicesAdminNegativeTestJSON-10227608 tempest-ServicesAdminNegativeTestJSON-10227608-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:24.109055 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-34bcb800-a1b8-4b4f-a5a1-b5f2d4aaa2ff tempest-ServicesAdminNegativeTestJSON-10227608 tempest-ServicesAdminNegativeTestJSON-10227608-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:24.236424 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-34bcb800-a1b8-4b4f-a5a1-b5f2d4aaa2ff tempest-ServicesAdminNegativeTestJSON-10227608 tempest-ServicesAdminNegativeTestJSON-10227608-project-admin] 10.222.0.43 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.418593 Oct 04 21:55:24.245287 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1291/2671] 10.222.0.43 () {58 vars in 1137 bytes} [Tue Oct 4 21:55:23 2022] GET /compute/v2.1/os-services => generated 944 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:55:24.250068 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-7f3a9583-8905-40fc-9f83-c1bf8395d509 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:55:24.257578 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-7f3a9583-8905-40fc-9f83-c1bf8395d509 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] [instance: 128b12e0-8fde-4113-95e9-0ecba563d8ec] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:55:24.272751 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7f3a9583-8905-40fc-9f83-c1bf8395d509 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:24.273264 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7f3a9583-8905-40fc-9f83-c1bf8395d509 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:24.273719 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7f3a9583-8905-40fc-9f83-c1bf8395d509 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:24.274479 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7f3a9583-8905-40fc-9f83-c1bf8395d509 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:24.274949 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7f3a9583-8905-40fc-9f83-c1bf8395d509 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:24.275384 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7f3a9583-8905-40fc-9f83-c1bf8395d509 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:24.369359 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-7f3a9583-8905-40fc-9f83-c1bf8395d509 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] [instance: 128b12e0-8fde-4113-95e9-0ecba563d8ec] Going to try to terminate instance {{(pid=134101) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:55:24.420485 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-53cbb0e8-8dbc-46a1-a51b-82a7d843e514 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47fbc4a6920d451cb1a2ad170de04921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43659cf5fed541e8883664bf17aced70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:55:24.434907 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-53cbb0e8-8dbc-46a1-a51b-82a7d843e514 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] 10.222.0.43 "GET /compute/v2.1/servers/a2e7312a-4e0d-4c47-b7c6-e1490a3f99d3" status: 200 len: 1507 microversion: 2.1 time: 0.940088 Oct 04 21:55:24.437737 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1381/2672] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:55:23 2022] GET /compute/v2.1/servers/a2e7312a-4e0d-4c47-b7c6-e1490a3f99d3 => generated 1507 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:55:24.451582 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-6b70cf9e-cf20-4b5c-b377-b70f2f33ff15 tempest-ServicesAdminNegativeTestJSON-10227608 tempest-ServicesAdminNegativeTestJSON-10227608-project-admin] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:55:24.465195 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6b70cf9e-cf20-4b5c-b377-b70f2f33ff15 tempest-ServicesAdminNegativeTestJSON-10227608 tempest-ServicesAdminNegativeTestJSON-10227608-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:24.469083 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6b70cf9e-cf20-4b5c-b377-b70f2f33ff15 tempest-ServicesAdminNegativeTestJSON-10227608 tempest-ServicesAdminNegativeTestJSON-10227608-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:24.469821 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6b70cf9e-cf20-4b5c-b377-b70f2f33ff15 tempest-ServicesAdminNegativeTestJSON-10227608 tempest-ServicesAdminNegativeTestJSON-10227608-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:24.473095 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6b70cf9e-cf20-4b5c-b377-b70f2f33ff15 tempest-ServicesAdminNegativeTestJSON-10227608 tempest-ServicesAdminNegativeTestJSON-10227608-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:24.473796 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6b70cf9e-cf20-4b5c-b377-b70f2f33ff15 tempest-ServicesAdminNegativeTestJSON-10227608 tempest-ServicesAdminNegativeTestJSON-10227608-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:24.476634 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6b70cf9e-cf20-4b5c-b377-b70f2f33ff15 tempest-ServicesAdminNegativeTestJSON-10227608 tempest-ServicesAdminNegativeTestJSON-10227608-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:24.570799 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-6b70cf9e-cf20-4b5c-b377-b70f2f33ff15 tempest-ServicesAdminNegativeTestJSON-10227608 tempest-ServicesAdminNegativeTestJSON-10227608-project-admin] 10.222.0.43 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.130710 Oct 04 21:55:24.571447 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1382/2673] 10.222.0.43 () {58 vars in 1170 bytes} [Tue Oct 4 21:55:24 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 944 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:55:24.592712 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-48a74e5a-52fa-4aba-8d7e-5e54f379e757 tempest-ServicesAdminNegativeTestJSON-10227608 tempest-ServicesAdminNegativeTestJSON-10227608-project-admin] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:55:24.599478 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-7f3a9583-8905-40fc-9f83-c1bf8395d509 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] 10.222.0.43 "DELETE /compute/v2.1/servers/128b12e0-8fde-4113-95e9-0ecba563d8ec" status: 204 len: 0 microversion: 2.1 time: 0.349880 Oct 04 21:55:24.600111 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1292/2674] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 21:55:24 2022] DELETE /compute/v2.1/servers/128b12e0-8fde-4113-95e9-0ecba563d8ec => generated 0 bytes in 359 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:55:24.609567 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-48a74e5a-52fa-4aba-8d7e-5e54f379e757 tempest-ServicesAdminNegativeTestJSON-10227608 tempest-ServicesAdminNegativeTestJSON-10227608-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:24.610235 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-48a74e5a-52fa-4aba-8d7e-5e54f379e757 tempest-ServicesAdminNegativeTestJSON-10227608 tempest-ServicesAdminNegativeTestJSON-10227608-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:24.622823 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-48a74e5a-52fa-4aba-8d7e-5e54f379e757 tempest-ServicesAdminNegativeTestJSON-10227608 tempest-ServicesAdminNegativeTestJSON-10227608-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:24.623746 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-48a74e5a-52fa-4aba-8d7e-5e54f379e757 tempest-ServicesAdminNegativeTestJSON-10227608 tempest-ServicesAdminNegativeTestJSON-10227608-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:24.624237 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-48a74e5a-52fa-4aba-8d7e-5e54f379e757 tempest-ServicesAdminNegativeTestJSON-10227608 tempest-ServicesAdminNegativeTestJSON-10227608-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:24.624677 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-48a74e5a-52fa-4aba-8d7e-5e54f379e757 tempest-ServicesAdminNegativeTestJSON-10227608 tempest-ServicesAdminNegativeTestJSON-10227608-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:24.628095 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-8eb990ab-7067-4cca-b244-89206111b2cb tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:55:24.634915 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-8eb990ab-7067-4cca-b244-89206111b2cb tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] [instance: 128b12e0-8fde-4113-95e9-0ecba563d8ec] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:55:24.660823 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8eb990ab-7067-4cca-b244-89206111b2cb tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:24.682808 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8eb990ab-7067-4cca-b244-89206111b2cb tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:24.683506 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8eb990ab-7067-4cca-b244-89206111b2cb tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:24.684360 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8eb990ab-7067-4cca-b244-89206111b2cb tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:24.684886 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8eb990ab-7067-4cca-b244-89206111b2cb tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:24.685388 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8eb990ab-7067-4cca-b244-89206111b2cb tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:24.708112 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-48a74e5a-52fa-4aba-8d7e-5e54f379e757 tempest-ServicesAdminNegativeTestJSON-10227608 tempest-ServicesAdminNegativeTestJSON-10227608-project-admin] 10.222.0.43 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.127314 Oct 04 21:55:24.710439 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1383/2675] 10.222.0.43 () {58 vars in 1137 bytes} [Tue Oct 4 21:55:24 2022] GET /compute/v2.1/os-services => generated 944 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:55:24.728481 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-d7e1345a-43a8-4c97-9829-05dbe99c9fd7 tempest-ServicesAdminNegativeTestJSON-10227608 tempest-ServicesAdminNegativeTestJSON-10227608-project-admin] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:55:24.739552 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d7e1345a-43a8-4c97-9829-05dbe99c9fd7 tempest-ServicesAdminNegativeTestJSON-10227608 tempest-ServicesAdminNegativeTestJSON-10227608-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:24.743995 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d7e1345a-43a8-4c97-9829-05dbe99c9fd7 tempest-ServicesAdminNegativeTestJSON-10227608 tempest-ServicesAdminNegativeTestJSON-10227608-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:24.744764 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d7e1345a-43a8-4c97-9829-05dbe99c9fd7 tempest-ServicesAdminNegativeTestJSON-10227608 tempest-ServicesAdminNegativeTestJSON-10227608-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:24.745776 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d7e1345a-43a8-4c97-9829-05dbe99c9fd7 tempest-ServicesAdminNegativeTestJSON-10227608 tempest-ServicesAdminNegativeTestJSON-10227608-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:24.749106 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d7e1345a-43a8-4c97-9829-05dbe99c9fd7 tempest-ServicesAdminNegativeTestJSON-10227608 tempest-ServicesAdminNegativeTestJSON-10227608-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:24.749765 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d7e1345a-43a8-4c97-9829-05dbe99c9fd7 tempest-ServicesAdminNegativeTestJSON-10227608 tempest-ServicesAdminNegativeTestJSON-10227608-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:24.796174 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-d7e1345a-43a8-4c97-9829-05dbe99c9fd7 tempest-ServicesAdminNegativeTestJSON-10227608 tempest-ServicesAdminNegativeTestJSON-10227608-project-admin] 10.222.0.43 "GET /compute/v2.1/os-services?host=n-d-860284-1&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.077233 Oct 04 21:55:24.799301 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1384/2676] 10.222.0.43 () {58 vars in 1194 bytes} [Tue Oct 4 21:55:24 2022] GET /compute/v2.1/os-services?host=n-d-860284-1&binary=xxx => generated 16 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 21:55:24.812370 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-f2b1911f-69b4-4583-9533-65eb267f81a8 tempest-ServicesAdminNegativeTestJSON-10227608 tempest-ServicesAdminNegativeTestJSON-10227608-project-admin] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:55:24.827321 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f2b1911f-69b4-4583-9533-65eb267f81a8 tempest-ServicesAdminNegativeTestJSON-10227608 tempest-ServicesAdminNegativeTestJSON-10227608-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:24.828024 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f2b1911f-69b4-4583-9533-65eb267f81a8 tempest-ServicesAdminNegativeTestJSON-10227608 tempest-ServicesAdminNegativeTestJSON-10227608-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:24.830097 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f2b1911f-69b4-4583-9533-65eb267f81a8 tempest-ServicesAdminNegativeTestJSON-10227608 tempest-ServicesAdminNegativeTestJSON-10227608-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:24.831022 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f2b1911f-69b4-4583-9533-65eb267f81a8 tempest-ServicesAdminNegativeTestJSON-10227608 tempest-ServicesAdminNegativeTestJSON-10227608-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:24.831498 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f2b1911f-69b4-4583-9533-65eb267f81a8 tempest-ServicesAdminNegativeTestJSON-10227608 tempest-ServicesAdminNegativeTestJSON-10227608-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:24.832791 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f2b1911f-69b4-4583-9533-65eb267f81a8 tempest-ServicesAdminNegativeTestJSON-10227608 tempest-ServicesAdminNegativeTestJSON-10227608-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:24.868453 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-f2b1911f-69b4-4583-9533-65eb267f81a8 tempest-ServicesAdminNegativeTestJSON-10227608 tempest-ServicesAdminNegativeTestJSON-10227608-project-admin] 10.222.0.43 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.060463 Oct 04 21:55:24.869328 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1385/2677] 10.222.0.43 () {58 vars in 1137 bytes} [Tue Oct 4 21:55:24 2022] GET /compute/v2.1/os-services => generated 944 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:55:24.881152 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-ed67ffe4-ba44-4516-95f6-728d7efa5e28 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:55:24.882013 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-ed67ffe4-ba44-4516-95f6-728d7efa5e28 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] [instance: e8900fd4-88c2-4800-baba-124e8ed0eac3] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:55:24.889805 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ed67ffe4-ba44-4516-95f6-728d7efa5e28 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:24.890305 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ed67ffe4-ba44-4516-95f6-728d7efa5e28 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:24.890832 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ed67ffe4-ba44-4516-95f6-728d7efa5e28 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:24.891553 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ed67ffe4-ba44-4516-95f6-728d7efa5e28 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:24.892211 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ed67ffe4-ba44-4516-95f6-728d7efa5e28 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:24.892436 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ed67ffe4-ba44-4516-95f6-728d7efa5e28 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:25.289882 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-8eb990ab-7067-4cca-b244-89206111b2cb tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921f934be12045b3ac0b2c6ed5101bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4335ce6fd64a0397fbfb13e1b255ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:55:25.309715 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-8eb990ab-7067-4cca-b244-89206111b2cb tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] 10.222.0.43 "GET /compute/v2.1/servers/128b12e0-8fde-4113-95e9-0ecba563d8ec" status: 200 len: 1684 microversion: 2.1 time: 0.703598 Oct 04 21:55:25.310625 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1293/2678] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:55:24 2022] GET /compute/v2.1/servers/128b12e0-8fde-4113-95e9-0ecba563d8ec => generated 1684 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:55:25.326904 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-685fe1b2-676d-4596-bff1-0bc60a2f18d3 tempest-ServicesAdminNegativeTestJSON-10227608 tempest-ServicesAdminNegativeTestJSON-10227608-project-admin] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:55:25.336304 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-685fe1b2-676d-4596-bff1-0bc60a2f18d3 tempest-ServicesAdminNegativeTestJSON-10227608 tempest-ServicesAdminNegativeTestJSON-10227608-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:25.337023 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-685fe1b2-676d-4596-bff1-0bc60a2f18d3 tempest-ServicesAdminNegativeTestJSON-10227608 tempest-ServicesAdminNegativeTestJSON-10227608-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:25.337626 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-685fe1b2-676d-4596-bff1-0bc60a2f18d3 tempest-ServicesAdminNegativeTestJSON-10227608 tempest-ServicesAdminNegativeTestJSON-10227608-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:25.338559 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-685fe1b2-676d-4596-bff1-0bc60a2f18d3 tempest-ServicesAdminNegativeTestJSON-10227608 tempest-ServicesAdminNegativeTestJSON-10227608-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:25.339337 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-685fe1b2-676d-4596-bff1-0bc60a2f18d3 tempest-ServicesAdminNegativeTestJSON-10227608 tempest-ServicesAdminNegativeTestJSON-10227608-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:25.340175 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-685fe1b2-676d-4596-bff1-0bc60a2f18d3 tempest-ServicesAdminNegativeTestJSON-10227608 tempest-ServicesAdminNegativeTestJSON-10227608-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:25.414533 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-ed67ffe4-ba44-4516-95f6-728d7efa5e28 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cca65ba35b14db8bf2187188de8c838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51745fc19321469bb20afabe48b2185d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:55:25.418671 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-685fe1b2-676d-4596-bff1-0bc60a2f18d3 tempest-ServicesAdminNegativeTestJSON-10227608 tempest-ServicesAdminNegativeTestJSON-10227608-project-admin] 10.222.0.43 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.105596 Oct 04 21:55:25.420070 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1294/2679] 10.222.0.43 () {58 vars in 1198 bytes} [Tue Oct 4 21:55:25 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 21:55:25.426851 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-ed67ffe4-ba44-4516-95f6-728d7efa5e28 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] 10.222.0.43 "GET /compute/v2.1/servers/e8900fd4-88c2-4800-baba-124e8ed0eac3" status: 200 len: 1316 microversion: 2.1 time: 0.556403 Oct 04 21:55:25.431114 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1386/2680] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:55:24 2022] GET /compute/v2.1/servers/e8900fd4-88c2-4800-baba-124e8ed0eac3 => generated 1316 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:55:25.463265 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-bcdc6740-9732-4f80-9294-94833e27477d tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:55:25.464072 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-bcdc6740-9732-4f80-9294-94833e27477d tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] [instance: a2e7312a-4e0d-4c47-b7c6-e1490a3f99d3] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:55:25.493209 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bcdc6740-9732-4f80-9294-94833e27477d tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:25.493737 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bcdc6740-9732-4f80-9294-94833e27477d tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:25.496432 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bcdc6740-9732-4f80-9294-94833e27477d tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:25.497983 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bcdc6740-9732-4f80-9294-94833e27477d tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:25.499106 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bcdc6740-9732-4f80-9294-94833e27477d tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:25.499554 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bcdc6740-9732-4f80-9294-94833e27477d tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:25.687642 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-755ff077-79a9-4a21-bb5a-0ceee3eeb2e9 tempest-ServicesAdminNegativeTestJSON-1106322481 tempest-ServicesAdminNegativeTestJSON-1106322481-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:55:25.691887 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-755ff077-79a9-4a21-bb5a-0ceee3eeb2e9 tempest-ServicesAdminNegativeTestJSON-1106322481 tempest-ServicesAdminNegativeTestJSON-1106322481-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': 'ce29029737af4fefa249642a9b14d53c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39c662b40334a39afef9aef5aa08d2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:55:25.695310 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-755ff077-79a9-4a21-bb5a-0ceee3eeb2e9 tempest-ServicesAdminNegativeTestJSON-1106322481 tempest-ServicesAdminNegativeTestJSON-1106322481-project] Request method failure captured: Oct 04 21:55:25.695310 n-d-860284-1 devstack@n-api.service[134101]: request: GET /compute/v2.1/os-services HTTP/1.1 Oct 04 21:55:25.695310 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 21:55:25.695310 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 21:55:25.695310 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 21:55:25.695310 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 21:55:25.695310 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 21:55:25.695310 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 21:55:25.695310 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 21:55:25.695310 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 21:55:25.695310 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPKvKEH_nubrzPA6scHbJUvrLCLtY88dMrPsdEtYyY94B1aHTXw0350HQTwEETcAFHibPSqvmRDJSUwUTt01R0QckAVSOZiYPdjHBemuqTeVk2X4Dnnp9ja4ABmPBigNKMwSePbNOnZDgjCLrPXh85yrnO2Tw63q8HkoCQS-LZ3uMas4 Oct 04 21:55:25.695310 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 21:55:25.695310 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 21:55:25.695310 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 21:55:25.695310 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 21:55:25.695310 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 21:55:25.695310 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 21:55:25.695310 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: e39c662b40334a39afef9aef5aa08d2e Oct 04 21:55:25.695310 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-1106322481 Oct 04 21:55:25.695310 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 21:55:25.695310 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 21:55:25.695310 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/e39c662b40334a39afef9aef5aa08d2e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_e39c662b40334a39afef9aef5aa08d2e", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/e39c662b40334a39afef9aef5aa08d2e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/e39c662b40334a39afef9aef5aa08d2e"}]}] Oct 04 21:55:25.695310 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-1106322481 Oct 04 21:55:25.695310 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: e39c662b40334a39afef9aef5aa08d2e Oct 04 21:55:25.695310 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-1106322481 Oct 04 21:55:25.695310 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-ServicesAdminNegativeTestJSON-1106322481-project Oct 04 21:55:25.695310 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 21:55:25.695310 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 21:55:25.695310 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: ce29029737af4fefa249642a9b14d53c Oct 04 21:55:25.695310 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-1106322481-project Oct 04 21:55:25.695310 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 21:55:25.695310 n-d-860284-1 devstack@n-api.service[134101]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 04 21:55:25.695310 n-d-860284-1 devstack@n-api.service[134101]: action_args: {} Oct 04 21:55:25.695310 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:55:25.695310 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:55:25.695310 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:55:25.695310 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:55:25.695310 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:55:25.695310 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:55:25.695310 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 21:55:25.695310 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:55:25.695310 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 21:55:25.695310 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:55:25.695310 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:55:25.695310 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:55:25.695310 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Oct 04 21:55:25.695310 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Oct 04 21:55:25.695310 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 21:55:25.695310 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 21:55:25.695310 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 21:55:25.695310 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 21:55:25.695310 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 21:55:25.695310 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 21:55:25.695310 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 21:55:25.695310 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 21:55:25.695310 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 21:55:25.695310 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 21:55:25.695310 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 21:55:25.695310 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 21:55:25.695310 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 21:55:25.695310 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 21:55:25.695310 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 04 21:55:25.695310 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:55:25.701328 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:55:25.701328 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:55:25.701328 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:55:25.701328 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:55:25.701328 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:55:25.701328 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 21:55:25.701328 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 21:55:25.701328 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 04 21:55:25.701328 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:55:25.704637 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-755ff077-79a9-4a21-bb5a-0ceee3eeb2e9 tempest-ServicesAdminNegativeTestJSON-1106322481 tempest-ServicesAdminNegativeTestJSON-1106322481-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:55:25.705869 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-755ff077-79a9-4a21-bb5a-0ceee3eeb2e9 tempest-ServicesAdminNegativeTestJSON-1106322481 tempest-ServicesAdminNegativeTestJSON-1106322481-project] 10.222.0.43 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.276349 Oct 04 21:55:25.706644 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1295/2681] 10.222.0.43 () {58 vars in 1137 bytes} [Tue Oct 4 21:55:25 2022] GET /compute/v2.1/os-services => generated 112 bytes in 278 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:55:26.339598 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-4b8e734a-d32b-41ea-8fe3-dee323e86596 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:55:26.342311 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-4b8e734a-d32b-41ea-8fe3-dee323e86596 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] [instance: 128b12e0-8fde-4113-95e9-0ecba563d8ec] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:55:26.351931 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4b8e734a-d32b-41ea-8fe3-dee323e86596 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:26.353193 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4b8e734a-d32b-41ea-8fe3-dee323e86596 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:26.353717 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4b8e734a-d32b-41ea-8fe3-dee323e86596 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:26.355039 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4b8e734a-d32b-41ea-8fe3-dee323e86596 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:26.355805 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4b8e734a-d32b-41ea-8fe3-dee323e86596 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:26.356538 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4b8e734a-d32b-41ea-8fe3-dee323e86596 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:26.365634 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-bcdc6740-9732-4f80-9294-94833e27477d tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47fbc4a6920d451cb1a2ad170de04921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43659cf5fed541e8883664bf17aced70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:55:26.374033 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-bcdc6740-9732-4f80-9294-94833e27477d tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] 10.222.0.43 "GET /compute/v2.1/servers/a2e7312a-4e0d-4c47-b7c6-e1490a3f99d3" status: 200 len: 1507 microversion: 2.1 time: 0.915276 Oct 04 21:55:26.391302 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1387/2682] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:55:25 2022] GET /compute/v2.1/servers/a2e7312a-4e0d-4c47-b7c6-e1490a3f99d3 => generated 1507 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:55:26.458941 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-96475f1f-c846-4f8d-adf4-d8e7113eb831 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:55:26.459983 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-96475f1f-c846-4f8d-adf4-d8e7113eb831 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] [instance: e8900fd4-88c2-4800-baba-124e8ed0eac3] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:55:26.467790 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-96475f1f-c846-4f8d-adf4-d8e7113eb831 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:26.468678 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-96475f1f-c846-4f8d-adf4-d8e7113eb831 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:26.469603 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-96475f1f-c846-4f8d-adf4-d8e7113eb831 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:26.470742 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-96475f1f-c846-4f8d-adf4-d8e7113eb831 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:26.471353 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-96475f1f-c846-4f8d-adf4-d8e7113eb831 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:26.472107 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-96475f1f-c846-4f8d-adf4-d8e7113eb831 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:26.998472 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-4b8e734a-d32b-41ea-8fe3-dee323e86596 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921f934be12045b3ac0b2c6ed5101bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4335ce6fd64a0397fbfb13e1b255ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:55:27.011535 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-4b8e734a-d32b-41ea-8fe3-dee323e86596 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] 10.222.0.43 "GET /compute/v2.1/servers/128b12e0-8fde-4113-95e9-0ecba563d8ec" status: 200 len: 1684 microversion: 2.1 time: 0.680192 Oct 04 21:55:27.012632 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1296/2683] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:55:26 2022] GET /compute/v2.1/servers/128b12e0-8fde-4113-95e9-0ecba563d8ec => generated 1684 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:55:27.017891 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-f219862a-b6e4-44ba-af9e-88ccd7ee7788 req-ce618140-b245-4d87-9cef-5aaf8ba33bb4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8900fd4-88c2-4800-baba-124e8ed0eac3", "name": "network-vif-plugged", "status": "completed", "tag": "958c011c-e3f5-4671-8e25-056b9b11ecfc"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:55:27.041454 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-f219862a-b6e4-44ba-af9e-88ccd7ee7788 req-ce618140-b245-4d87-9cef-5aaf8ba33bb4 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:27.042123 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-f219862a-b6e4-44ba-af9e-88ccd7ee7788 req-ce618140-b245-4d87-9cef-5aaf8ba33bb4 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:27.043503 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-f219862a-b6e4-44ba-af9e-88ccd7ee7788 req-ce618140-b245-4d87-9cef-5aaf8ba33bb4 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:27.086949 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-f219862a-b6e4-44ba-af9e-88ccd7ee7788 req-ce618140-b245-4d87-9cef-5aaf8ba33bb4 service nova] Creating event network-vif-plugged:958c011c-e3f5-4671-8e25-056b9b11ecfc for instance e8900fd4-88c2-4800-baba-124e8ed0eac3 on n-h2-860284-1 Oct 04 21:55:27.098817 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-f219862a-b6e4-44ba-af9e-88ccd7ee7788 req-ce618140-b245-4d87-9cef-5aaf8ba33bb4 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083573 Oct 04 21:55:27.101676 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1297/2684] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:55:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:55:27.214051 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-96475f1f-c846-4f8d-adf4-d8e7113eb831 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cca65ba35b14db8bf2187188de8c838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51745fc19321469bb20afabe48b2185d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:55:27.241375 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-96475f1f-c846-4f8d-adf4-d8e7113eb831 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] 10.222.0.43 "GET /compute/v2.1/servers/e8900fd4-88c2-4800-baba-124e8ed0eac3" status: 200 len: 1316 microversion: 2.1 time: 0.786307 Oct 04 21:55:27.242690 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1388/2685] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:55:26 2022] GET /compute/v2.1/servers/e8900fd4-88c2-4800-baba-124e8ed0eac3 => generated 1316 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:55:27.401571 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-93404e43-309a-45c5-89e3-8b8bebb0d959 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:55:27.402393 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-93404e43-309a-45c5-89e3-8b8bebb0d959 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] [instance: a2e7312a-4e0d-4c47-b7c6-e1490a3f99d3] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:55:27.417381 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-93404e43-309a-45c5-89e3-8b8bebb0d959 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:27.418753 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-93404e43-309a-45c5-89e3-8b8bebb0d959 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:27.421558 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-93404e43-309a-45c5-89e3-8b8bebb0d959 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:27.425263 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-93404e43-309a-45c5-89e3-8b8bebb0d959 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:27.425810 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-93404e43-309a-45c5-89e3-8b8bebb0d959 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:27.427462 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-93404e43-309a-45c5-89e3-8b8bebb0d959 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:28.031873 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-93404e43-309a-45c5-89e3-8b8bebb0d959 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47fbc4a6920d451cb1a2ad170de04921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43659cf5fed541e8883664bf17aced70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:55:28.037586 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-1a2e3e30-a3dd-43d7-9b6e-69be4fd99230 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:55:28.038497 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-1a2e3e30-a3dd-43d7-9b6e-69be4fd99230 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] [instance: 128b12e0-8fde-4113-95e9-0ecba563d8ec] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:55:28.042688 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-93404e43-309a-45c5-89e3-8b8bebb0d959 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] 10.222.0.43 "GET /compute/v2.1/servers/a2e7312a-4e0d-4c47-b7c6-e1490a3f99d3" status: 200 len: 1507 microversion: 2.1 time: 0.647241 Oct 04 21:55:28.044630 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1298/2686] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:55:27 2022] GET /compute/v2.1/servers/a2e7312a-4e0d-4c47-b7c6-e1490a3f99d3 => generated 1507 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:55:28.046768 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1a2e3e30-a3dd-43d7-9b6e-69be4fd99230 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:28.047286 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1a2e3e30-a3dd-43d7-9b6e-69be4fd99230 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:28.047723 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1a2e3e30-a3dd-43d7-9b6e-69be4fd99230 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:28.048529 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1a2e3e30-a3dd-43d7-9b6e-69be4fd99230 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:28.049165 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1a2e3e30-a3dd-43d7-9b6e-69be4fd99230 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:28.049588 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1a2e3e30-a3dd-43d7-9b6e-69be4fd99230 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:28.265434 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-5fb2811b-6866-484a-9ead-cc6095fd5b81 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:55:28.272438 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-5fb2811b-6866-484a-9ead-cc6095fd5b81 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] [instance: e8900fd4-88c2-4800-baba-124e8ed0eac3] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:55:28.279172 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5fb2811b-6866-484a-9ead-cc6095fd5b81 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:28.279941 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5fb2811b-6866-484a-9ead-cc6095fd5b81 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:28.280382 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5fb2811b-6866-484a-9ead-cc6095fd5b81 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:28.281255 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5fb2811b-6866-484a-9ead-cc6095fd5b81 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:28.281716 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5fb2811b-6866-484a-9ead-cc6095fd5b81 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:28.282299 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5fb2811b-6866-484a-9ead-cc6095fd5b81 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:28.417626 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-1a2e3e30-a3dd-43d7-9b6e-69be4fd99230 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921f934be12045b3ac0b2c6ed5101bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4335ce6fd64a0397fbfb13e1b255ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:55:28.431621 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-1a2e3e30-a3dd-43d7-9b6e-69be4fd99230 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] 10.222.0.43 "GET /compute/v2.1/servers/128b12e0-8fde-4113-95e9-0ecba563d8ec" status: 200 len: 1684 microversion: 2.1 time: 0.398406 Oct 04 21:55:28.443850 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1389/2687] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:55:28 2022] GET /compute/v2.1/servers/128b12e0-8fde-4113-95e9-0ecba563d8ec => generated 1684 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:55:28.572471 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-5fb2811b-6866-484a-9ead-cc6095fd5b81 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cca65ba35b14db8bf2187188de8c838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51745fc19321469bb20afabe48b2185d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:55:28.591767 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-5fb2811b-6866-484a-9ead-cc6095fd5b81 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] 10.222.0.43 "GET /compute/v2.1/servers/e8900fd4-88c2-4800-baba-124e8ed0eac3" status: 200 len: 1316 microversion: 2.1 time: 0.330497 Oct 04 21:55:28.593539 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1299/2688] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:55:28 2022] GET /compute/v2.1/servers/e8900fd4-88c2-4800-baba-124e8ed0eac3 => generated 1316 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:55:29.069732 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-4d268bca-b228-40a3-a7eb-8e43c62b2a4d tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:55:29.070349 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-4d268bca-b228-40a3-a7eb-8e43c62b2a4d tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] [instance: a2e7312a-4e0d-4c47-b7c6-e1490a3f99d3] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:55:29.080114 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4d268bca-b228-40a3-a7eb-8e43c62b2a4d tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:29.080620 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4d268bca-b228-40a3-a7eb-8e43c62b2a4d tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:29.081066 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4d268bca-b228-40a3-a7eb-8e43c62b2a4d tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:29.081790 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4d268bca-b228-40a3-a7eb-8e43c62b2a4d tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:29.082254 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4d268bca-b228-40a3-a7eb-8e43c62b2a4d tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:29.085213 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4d268bca-b228-40a3-a7eb-8e43c62b2a4d tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:29.385444 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-4d268bca-b228-40a3-a7eb-8e43c62b2a4d tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47fbc4a6920d451cb1a2ad170de04921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43659cf5fed541e8883664bf17aced70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:55:29.402443 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-4d268bca-b228-40a3-a7eb-8e43c62b2a4d tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] 10.222.0.43 "GET /compute/v2.1/servers/a2e7312a-4e0d-4c47-b7c6-e1490a3f99d3" status: 200 len: 1507 microversion: 2.1 time: 0.336783 Oct 04 21:55:29.403236 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1390/2689] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:55:29 2022] GET /compute/v2.1/servers/a2e7312a-4e0d-4c47-b7c6-e1490a3f99d3 => generated 1507 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:55:29.468235 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-3533af1d-ae04-44bd-8b6b-a8da0afe5fd3 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:55:29.469967 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-3533af1d-ae04-44bd-8b6b-a8da0afe5fd3 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] [instance: 128b12e0-8fde-4113-95e9-0ecba563d8ec] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:55:29.497968 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3533af1d-ae04-44bd-8b6b-a8da0afe5fd3 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:29.497968 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3533af1d-ae04-44bd-8b6b-a8da0afe5fd3 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:29.508716 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3533af1d-ae04-44bd-8b6b-a8da0afe5fd3 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:29.510162 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3533af1d-ae04-44bd-8b6b-a8da0afe5fd3 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:29.518803 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3533af1d-ae04-44bd-8b6b-a8da0afe5fd3 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:29.519432 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3533af1d-ae04-44bd-8b6b-a8da0afe5fd3 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:29.628993 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-c9a4da3c-2e35-4367-9cd9-067738125bb9 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:55:29.644687 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-c9a4da3c-2e35-4367-9cd9-067738125bb9 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] [instance: e8900fd4-88c2-4800-baba-124e8ed0eac3] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:55:29.682175 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c9a4da3c-2e35-4367-9cd9-067738125bb9 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:29.683136 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-3533af1d-ae04-44bd-8b6b-a8da0afe5fd3 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921f934be12045b3ac0b2c6ed5101bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4335ce6fd64a0397fbfb13e1b255ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:55:29.686749 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c9a4da3c-2e35-4367-9cd9-067738125bb9 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:29.687531 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c9a4da3c-2e35-4367-9cd9-067738125bb9 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:29.688807 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c9a4da3c-2e35-4367-9cd9-067738125bb9 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:29.689529 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c9a4da3c-2e35-4367-9cd9-067738125bb9 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:29.690331 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c9a4da3c-2e35-4367-9cd9-067738125bb9 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:29.704753 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-3533af1d-ae04-44bd-8b6b-a8da0afe5fd3 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] 10.222.0.43 "GET /compute/v2.1/servers/128b12e0-8fde-4113-95e9-0ecba563d8ec" status: 200 len: 1616 microversion: 2.1 time: 0.249157 Oct 04 21:55:29.722490 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1300/2690] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:55:29 2022] GET /compute/v2.1/servers/128b12e0-8fde-4113-95e9-0ecba563d8ec => generated 1616 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:55:30.002229 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-c9a4da3c-2e35-4367-9cd9-067738125bb9 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cca65ba35b14db8bf2187188de8c838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51745fc19321469bb20afabe48b2185d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:55:30.012115 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-c9a4da3c-2e35-4367-9cd9-067738125bb9 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] 10.222.0.43 "GET /compute/v2.1/servers/e8900fd4-88c2-4800-baba-124e8ed0eac3" status: 200 len: 1504 microversion: 2.1 time: 0.395839 Oct 04 21:55:30.013105 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1391/2691] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:55:29 2022] GET /compute/v2.1/servers/e8900fd4-88c2-4800-baba-124e8ed0eac3 => generated 1504 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:55:30.036032 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-22c59f7a-aa1c-49fd-aba9-a5f38a702102 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1770451541"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:55:30.037641 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-22c59f7a-aa1c-49fd-aba9-a5f38a702102 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] [instance: e8900fd4-88c2-4800-baba-124e8ed0eac3] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:55:30.047735 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-22c59f7a-aa1c-49fd-aba9-a5f38a702102 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:30.049850 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-22c59f7a-aa1c-49fd-aba9-a5f38a702102 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:30.050669 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-22c59f7a-aa1c-49fd-aba9-a5f38a702102 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:30.053259 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-22c59f7a-aa1c-49fd-aba9-a5f38a702102 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:30.054794 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-22c59f7a-aa1c-49fd-aba9-a5f38a702102 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:30.055609 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-22c59f7a-aa1c-49fd-aba9-a5f38a702102 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:30.279734 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.network.security_group_api [None req-22c59f7a-aa1c-49fd-aba9-a5f38a702102 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Adding security group 573de4f5-425b-48b1-8892-a4d297115930 to port 958c011c-e3f5-4671-8e25-056b9b11ecfc Oct 04 21:55:30.334841 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-2262bb50-2cf8-4005-b88d-4143b1f95ced req-e0521f7a-d7fa-4188-96c4-b8fc55f32d9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "128b12e0-8fde-4113-95e9-0ecba563d8ec", "name": "network-vif-deleted", "tag": "df2ad55d-ccdf-4548-8a65-744068b2ae9a"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:55:30.359159 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-2262bb50-2cf8-4005-b88d-4143b1f95ced req-e0521f7a-d7fa-4188-96c4-b8fc55f32d9c service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:30.360880 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-2262bb50-2cf8-4005-b88d-4143b1f95ced req-e0521f7a-d7fa-4188-96c4-b8fc55f32d9c service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:30.364086 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-2262bb50-2cf8-4005-b88d-4143b1f95ced req-e0521f7a-d7fa-4188-96c4-b8fc55f32d9c service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:30.400406 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-2262bb50-2cf8-4005-b88d-4143b1f95ced req-e0521f7a-d7fa-4188-96c4-b8fc55f32d9c service nova] Creating event network-vif-deleted:df2ad55d-ccdf-4548-8a65-744068b2ae9a for instance 128b12e0-8fde-4113-95e9-0ecba563d8ec on n-h2-860284-1 Oct 04 21:55:30.412440 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-2262bb50-2cf8-4005-b88d-4143b1f95ced req-e0521f7a-d7fa-4188-96c4-b8fc55f32d9c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083563 Oct 04 21:55:30.421406 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1392/2692] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:55:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:55:30.433862 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-d4776cce-a06b-48af-a10f-878bd63744e7 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:55:30.435566 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-d4776cce-a06b-48af-a10f-878bd63744e7 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] [instance: a2e7312a-4e0d-4c47-b7c6-e1490a3f99d3] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:55:30.453701 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d4776cce-a06b-48af-a10f-878bd63744e7 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:30.454858 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d4776cce-a06b-48af-a10f-878bd63744e7 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:30.456896 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d4776cce-a06b-48af-a10f-878bd63744e7 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:30.457923 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d4776cce-a06b-48af-a10f-878bd63744e7 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:30.460104 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d4776cce-a06b-48af-a10f-878bd63744e7 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:30.461941 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d4776cce-a06b-48af-a10f-878bd63744e7 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:30.940640 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-d4776cce-a06b-48af-a10f-878bd63744e7 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47fbc4a6920d451cb1a2ad170de04921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43659cf5fed541e8883664bf17aced70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:55:30.966157 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-d4776cce-a06b-48af-a10f-878bd63744e7 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] 10.222.0.43 "GET /compute/v2.1/servers/a2e7312a-4e0d-4c47-b7c6-e1490a3f99d3" status: 200 len: 1487 microversion: 2.1 time: 0.534751 Oct 04 21:55:30.995223 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1393/2693] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:55:30 2022] GET /compute/v2.1/servers/a2e7312a-4e0d-4c47-b7c6-e1490a3f99d3 => generated 1487 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:55:31.004113 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-48655286-4dbb-4bd9-a2cb-43873109273c tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:55:31.005703 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-48655286-4dbb-4bd9-a2cb-43873109273c tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] [instance: 830de6ad-adc6-4d16-ae9d-a29ae85e6cd2] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:55:31.015928 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-48655286-4dbb-4bd9-a2cb-43873109273c tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:31.016664 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-48655286-4dbb-4bd9-a2cb-43873109273c tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:31.017266 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-48655286-4dbb-4bd9-a2cb-43873109273c tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:31.018261 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-48655286-4dbb-4bd9-a2cb-43873109273c tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:31.019810 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-48655286-4dbb-4bd9-a2cb-43873109273c tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:31.021567 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-48655286-4dbb-4bd9-a2cb-43873109273c tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:31.604115 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-22c59f7a-aa1c-49fd-aba9-a5f38a702102 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] 10.222.0.43 "POST /compute/v2.1/servers/e8900fd4-88c2-4800-baba-124e8ed0eac3/action" status: 202 len: 0 microversion: 2.1 time: 1.572836 Oct 04 21:55:31.605477 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1301/2694] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 21:55:30 2022] POST /compute/v2.1/servers/e8900fd4-88c2-4800-baba-124e8ed0eac3/action => generated 0 bytes in 1575 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:55:31.612207 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-4793802d-2317-4df0-8dc2-853677b73e91 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:55:31.613225 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-4793802d-2317-4df0-8dc2-853677b73e91 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] [instance: 128b12e0-8fde-4113-95e9-0ecba563d8ec] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:55:31.630085 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4793802d-2317-4df0-8dc2-853677b73e91 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:31.631875 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4793802d-2317-4df0-8dc2-853677b73e91 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:31.633721 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4793802d-2317-4df0-8dc2-853677b73e91 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:31.634841 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4793802d-2317-4df0-8dc2-853677b73e91 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:31.637693 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4793802d-2317-4df0-8dc2-853677b73e91 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:31.638321 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4793802d-2317-4df0-8dc2-853677b73e91 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:31.676640 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-4793802d-2317-4df0-8dc2-853677b73e91 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] HTTP exception thrown: Instance 128b12e0-8fde-4113-95e9-0ecba563d8ec could not be found. Oct 04 21:55:31.682452 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-4793802d-2317-4df0-8dc2-853677b73e91 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Request method failure captured: Oct 04 21:55:31.682452 n-d-860284-1 devstack@n-api.service[134101]: request: GET /compute/v2.1/servers/128b12e0-8fde-4113-95e9-0ecba563d8ec HTTP/1.1 Oct 04 21:55:31.682452 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 21:55:31.682452 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 21:55:31.682452 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 21:55:31.682452 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 21:55:31.682452 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 21:55:31.682452 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 21:55:31.682452 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 21:55:31.682452 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 21:55:31.682452 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPKryVGuW_QEc89YzzR_SWtV4W96U4o11TSygBxOM8VPWfNOdhdG8cGXbSCNroCoTAA1rvLvNpRRTlXEQ4nY1ApiqIvkHeKQNy3Y1rA-AASczqCR0Kl60Iiw5slt422nR2bVfEsDdrYNlMqJ3pv_et0i3qaaZ6B5NpNUj2rg4uauKosg Oct 04 21:55:31.682452 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 21:55:31.682452 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 21:55:31.682452 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 21:55:31.682452 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 21:55:31.682452 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 21:55:31.682452 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 21:55:31.682452 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: 1c4335ce6fd64a0397fbfb13e1b255ef Oct 04 21:55:31.682452 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-VolumesAdminNegativeTest-385569383 Oct 04 21:55:31.682452 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 21:55:31.682452 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 21:55:31.682452 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1c4335ce6fd64a0397fbfb13e1b255ef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_1c4335ce6fd64a0397fbfb13e1b255ef", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1c4335ce6fd64a0397fbfb13e1b255ef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/1c4335ce6fd64a0397fbfb13e1b255ef"}]}] Oct 04 21:55:31.682452 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-VolumesAdminNegativeTest-385569383 Oct 04 21:55:31.682452 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: 1c4335ce6fd64a0397fbfb13e1b255ef Oct 04 21:55:31.682452 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-385569383 Oct 04 21:55:31.682452 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-VolumesAdminNegativeTest-385569383-project Oct 04 21:55:31.682452 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 21:55:31.682452 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 21:55:31.682452 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 921f934be12045b3ac0b2c6ed5101bec Oct 04 21:55:31.682452 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-VolumesAdminNegativeTest-385569383-project Oct 04 21:55:31.682452 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 21:55:31.682452 n-d-860284-1 devstack@n-api.service[134101]: exception: Instance 128b12e0-8fde-4113-95e9-0ecba563d8ec could not be found. Oct 04 21:55:31.682452 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': '128b12e0-8fde-4113-95e9-0ecba563d8ec'} Oct 04 21:55:31.682452 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:55:31.682452 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:55:31.682452 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:55:31.682452 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:55:31.682452 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:55:31.682452 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:55:31.682452 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:55:31.682452 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:55:31.682452 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:55:31.682452 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:55:31.682452 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 128b12e0-8fde-4113-95e9-0ecba563d8ec could not be found. Oct 04 21:55:31.682452 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:55:31.682452 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:55:31.682452 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:55:31.682452 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:55:31.682452 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:55:31.682452 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:55:31.682452 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:55:31.682452 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:55:31.682452 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:55:31.682452 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:55:31.682452 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:55:31.682452 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:55:31.682452 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:55:31.682452 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:55:31.682452 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:55:31.682452 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:55:31.682452 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 128b12e0-8fde-4113-95e9-0ecba563d8ec could not be found. Oct 04 21:55:31.682452 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:55:31.682452 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:55:31.682452 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:55:31.686451 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:55:31.686451 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:55:31.686451 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:55:31.686451 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:55:31.686451 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:55:31.686451 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 128b12e0-8fde-4113-95e9-0ecba563d8ec could not be found. Oct 04 21:55:31.686451 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:55:31.686451 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-4793802d-2317-4df0-8dc2-853677b73e91 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Returning 404 to user: Instance 128b12e0-8fde-4113-95e9-0ecba563d8ec could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:55:31.686451 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-4793802d-2317-4df0-8dc2-853677b73e91 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] 10.222.0.43 "GET /compute/v2.1/servers/128b12e0-8fde-4113-95e9-0ecba563d8ec" status: 404 len: 111 microversion: 2.1 time: 0.077300 Oct 04 21:55:31.688144 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1302/2695] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:55:31 2022] GET /compute/v2.1/servers/128b12e0-8fde-4113-95e9-0ecba563d8ec => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:55:31.700683 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-be4b18b5-0d5e-47ed-a943-9552db0874a3 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:55:31.703601 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-be4b18b5-0d5e-47ed-a943-9552db0874a3 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] [instance: a2e7312a-4e0d-4c47-b7c6-e1490a3f99d3] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:55:31.716713 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-be4b18b5-0d5e-47ed-a943-9552db0874a3 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:31.719277 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-be4b18b5-0d5e-47ed-a943-9552db0874a3 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:31.721097 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-be4b18b5-0d5e-47ed-a943-9552db0874a3 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:31.722879 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-be4b18b5-0d5e-47ed-a943-9552db0874a3 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:31.725802 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-be4b18b5-0d5e-47ed-a943-9552db0874a3 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:31.727973 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-be4b18b5-0d5e-47ed-a943-9552db0874a3 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:31.742283 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:55:31.762442 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-48655286-4dbb-4bd9-a2cb-43873109273c tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:55:31.788243 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-48655286-4dbb-4bd9-a2cb-43873109273c tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:55:31.792138 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-48655286-4dbb-4bd9-a2cb-43873109273c tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:55:31.800150 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-48655286-4dbb-4bd9-a2cb-43873109273c tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] 10.222.0.43 "GET /compute/v2.1/servers/830de6ad-adc6-4d16-ae9d-a29ae85e6cd2" status: 200 len: 2952 microversion: 2.42 time: 0.800498 Oct 04 21:55:31.801940 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1394/2696] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:55:30 2022] GET /compute/v2.1/servers/830de6ad-adc6-4d16-ae9d-a29ae85e6cd2 => generated 2952 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:55:31.820179 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-1e9b8526-5ed8-465e-a735-1bcfadcd7b46 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1126216832"}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:55:31.827221 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-1e9b8526-5ed8-465e-a735-1bcfadcd7b46 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] [instance: e8900fd4-88c2-4800-baba-124e8ed0eac3] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:55:31.849135 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1e9b8526-5ed8-465e-a735-1bcfadcd7b46 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:31.856462 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1e9b8526-5ed8-465e-a735-1bcfadcd7b46 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:31.856937 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1e9b8526-5ed8-465e-a735-1bcfadcd7b46 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:31.857735 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1e9b8526-5ed8-465e-a735-1bcfadcd7b46 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:31.862640 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1e9b8526-5ed8-465e-a735-1bcfadcd7b46 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:31.863099 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1e9b8526-5ed8-465e-a735-1bcfadcd7b46 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:31.988388 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-be4b18b5-0d5e-47ed-a943-9552db0874a3 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] 10.222.0.43 "POST /compute/v2.1/servers/a2e7312a-4e0d-4c47-b7c6-e1490a3f99d3/action" status: 202 len: 0 microversion: 2.1 time: 0.298705 Oct 04 21:55:31.991202 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1303/2697] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 21:55:31 2022] POST /compute/v2.1/servers/a2e7312a-4e0d-4c47-b7c6-e1490a3f99d3/action => generated 0 bytes in 302 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:55:31.999363 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-646551d6-3487-476c-9b5c-f9cd9a7ecf88 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] Calling method '.version_select at 0x7fbb2f399670>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:55:32.025367 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-646551d6-3487-476c-9b5c-f9cd9a7ecf88 tempest-VolumesAdminNegativeTest-385569383 tempest-VolumesAdminNegativeTest-385569383-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1665435488" status: 202 len: 0 microversion: 2.1 time: 0.031560 Oct 04 21:55:32.026936 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1304/2698] 10.222.0.43 () {58 vars in 1221 bytes} [Tue Oct 4 21:55:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1665435488 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:55:32.035250 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-287a52b4-2ca3-45d1-9d17-0f095dc5b761 req-8430a5b7-8988-4124-9ffd-85ff2ee35e22 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8900fd4-88c2-4800-baba-124e8ed0eac3", "tag": "958c011c-e3f5-4671-8e25-056b9b11ecfc"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:55:32.051014 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-287a52b4-2ca3-45d1-9d17-0f095dc5b761 req-8430a5b7-8988-4124-9ffd-85ff2ee35e22 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:32.051512 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-287a52b4-2ca3-45d1-9d17-0f095dc5b761 req-8430a5b7-8988-4124-9ffd-85ff2ee35e22 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:32.052097 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-287a52b4-2ca3-45d1-9d17-0f095dc5b761 req-8430a5b7-8988-4124-9ffd-85ff2ee35e22 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:32.070153 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-287a52b4-2ca3-45d1-9d17-0f095dc5b761 req-8430a5b7-8988-4124-9ffd-85ff2ee35e22 service nova] Creating event network-changed:958c011c-e3f5-4671-8e25-056b9b11ecfc for instance e8900fd4-88c2-4800-baba-124e8ed0eac3 on n-h2-860284-1 Oct 04 21:55:32.076877 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-287a52b4-2ca3-45d1-9d17-0f095dc5b761 req-8430a5b7-8988-4124-9ffd-85ff2ee35e22 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048208 Oct 04 21:55:32.077885 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1305/2699] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:55:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:55:32.085866 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-da65b88a-47f1-45ff-baa5-b659be66e73d tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:55:32.086981 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-da65b88a-47f1-45ff-baa5-b659be66e73d tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] [instance: 830de6ad-adc6-4d16-ae9d-a29ae85e6cd2] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:55:32.095818 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-da65b88a-47f1-45ff-baa5-b659be66e73d tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:32.096638 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-da65b88a-47f1-45ff-baa5-b659be66e73d tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:32.097847 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-da65b88a-47f1-45ff-baa5-b659be66e73d tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:32.099773 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-da65b88a-47f1-45ff-baa5-b659be66e73d tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:32.100551 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-da65b88a-47f1-45ff-baa5-b659be66e73d tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:32.101240 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-da65b88a-47f1-45ff-baa5-b659be66e73d tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:32.407625 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-da65b88a-47f1-45ff-baa5-b659be66e73d tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] 10.222.0.43 "GET /compute/v2.1/servers/830de6ad-adc6-4d16-ae9d-a29ae85e6cd2/os-interface" status: 200 len: 1832 microversion: 2.42 time: 0.327617 Oct 04 21:55:32.408386 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1306/2700] 10.222.0.43 () {60 vars in 1316 bytes} [Tue Oct 4 21:55:32 2022] GET /compute/v2.1/servers/830de6ad-adc6-4d16-ae9d-a29ae85e6cd2/os-interface => generated 1832 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:55:32.416215 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-f40f281f-6588-453e-b58b-bd744e196001 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:55:32.418086 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-f40f281f-6588-453e-b58b-bd744e196001 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] [instance: a2e7312a-4e0d-4c47-b7c6-e1490a3f99d3] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:55:32.432707 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f40f281f-6588-453e-b58b-bd744e196001 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:32.434273 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f40f281f-6588-453e-b58b-bd744e196001 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:32.434636 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f40f281f-6588-453e-b58b-bd744e196001 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:32.437879 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f40f281f-6588-453e-b58b-bd744e196001 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:32.438689 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f40f281f-6588-453e-b58b-bd744e196001 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:32.443593 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f40f281f-6588-453e-b58b-bd744e196001 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:32.551213 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.network.security_group_api [None req-1e9b8526-5ed8-465e-a735-1bcfadcd7b46 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Adding security group 50557840-4dda-4b34-a5ed-cd73d440b7e9 to port 958c011c-e3f5-4671-8e25-056b9b11ecfc Oct 04 21:55:32.920078 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-f40f281f-6588-453e-b58b-bd744e196001 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47fbc4a6920d451cb1a2ad170de04921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43659cf5fed541e8883664bf17aced70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:55:32.935052 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-f40f281f-6588-453e-b58b-bd744e196001 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] 10.222.0.43 "GET /compute/v2.1/servers/a2e7312a-4e0d-4c47-b7c6-e1490a3f99d3" status: 200 len: 1495 microversion: 2.1 time: 0.525223 Oct 04 21:55:32.935966 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1307/2701] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:55:32 2022] GET /compute/v2.1/servers/a2e7312a-4e0d-4c47-b7c6-e1490a3f99d3 => generated 1495 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:55:33.110348 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-5c04087f-fa6b-48f4-9cbb-426f239558b8 tempest-TenantUsagesNegativeTestJSON-1380751471 tempest-TenantUsagesNegativeTestJSON-1380751471-project-admin] 10.222.0.43 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-10-03T21%3A55%3A32.162126&end=2022-10-05T21%3A55%3A32.162126" status: 404 len: 112 microversion: - time: 0.172990 Oct 04 21:55:33.111263 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1308/2702] 10.222.0.43 () {58 vars in 1316 bytes} [Tue Oct 4 21:55:32 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-10-03T21%3A55%3A32.162126&end=2022-10-05T21%3A55%3A32.162126 => generated 112 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 04 21:55:33.125161 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e7dc3238-8660-415e-856a-89965160425a tempest-TenantUsagesNegativeTestJSON-1380751471 tempest-TenantUsagesNegativeTestJSON-1380751471-project-admin] Calling method '.version_select at 0x7fbb2edf0a60>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:55:33.134757 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-e7dc3238-8660-415e-856a-89965160425a tempest-TenantUsagesNegativeTestJSON-1380751471 tempest-TenantUsagesNegativeTestJSON-1380751471-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Oct 04 21:55:33.148155 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e7dc3238-8660-415e-856a-89965160425a tempest-TenantUsagesNegativeTestJSON-1380751471 tempest-TenantUsagesNegativeTestJSON-1380751471-project-admin] Request method failure captured: Oct 04 21:55:33.148155 n-d-860284-1 devstack@n-api.service[134101]: request: GET /compute/v2.1/os-simple-tenant-usage/e9722642866642c0ba747a37faac0a56?start=2022-10-05T21%3A55%3A32.162126&end=2022-10-03T21%3A55%3A32.162126 HTTP/1.1 Oct 04 21:55:33.148155 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 21:55:33.148155 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 21:55:33.148155 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 21:55:33.148155 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 21:55:33.148155 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 21:55:33.148155 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 21:55:33.148155 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 21:55:33.148155 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 21:55:33.148155 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPKvTHvVGHk0N1S3kHvu4SpJa-Yej9OJikF-qT_7g4gerxLP9kN5dCxUwFGbV3tNQNHXZ6CC3Fa6KD5mox9gkpNDAksDxVlT7_X4LZexsE3znpjVBm_qJOJGtMr-yWIeB-PsroS2_WeTIsZramlgZbCeFgkF1qwsRLQxtHeEQMmj_s_Y Oct 04 21:55:33.148155 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 21:55:33.148155 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 21:55:33.148155 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 21:55:33.148155 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 21:55:33.148155 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 21:55:33.148155 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 21:55:33.148155 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: 4d9eeed82c764cd29d0deb411109f73b Oct 04 21:55:33.148155 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-1380751471 Oct 04 21:55:33.148155 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,admin,member Oct 04 21:55:33.148155 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,admin,member Oct 04 21:55:33.148155 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4d9eeed82c764cd29d0deb411109f73b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_4d9eeed82c764cd29d0deb411109f73b", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4d9eeed82c764cd29d0deb411109f73b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/4d9eeed82c764cd29d0deb411109f73b"}]}] Oct 04 21:55:33.148155 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-1380751471 Oct 04 21:55:33.148155 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: 4d9eeed82c764cd29d0deb411109f73b Oct 04 21:55:33.148155 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-1380751471 Oct 04 21:55:33.148155 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-TenantUsagesNegativeTestJSON-1380751471-project-admin Oct 04 21:55:33.148155 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 21:55:33.148155 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 21:55:33.148155 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: a641475a5b0d40c7b04da2bb131944f4 Oct 04 21:55:33.148155 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-1380751471-project-admin Oct 04 21:55:33.148155 n-d-860284-1 devstack@n-api.service[134101]: method: Oct 04 21:55:33.148155 n-d-860284-1 devstack@n-api.service[134101]: exception: Invalid start time. The start time cannot occur after the end time. Oct 04 21:55:33.148155 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': 'e9722642866642c0ba747a37faac0a56'} Oct 04 21:55:33.148155 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:55:33.148155 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:55:33.148155 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:55:33.148155 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:55:33.148155 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:55:33.148155 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:55:33.148155 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:55:33.148155 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:55:33.148155 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 21:55:33.148155 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:55:33.148155 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:55:33.148155 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:55:33.148155 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show Oct 04 21:55:33.148155 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 04 21:55:33.148155 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show Oct 04 21:55:33.148155 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( Oct 04 21:55:33.148155 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range Oct 04 21:55:33.148155 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 04 21:55:33.148155 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. Oct 04 21:55:33.148155 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:55:33.148155 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:55:33.148155 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:55:33.148155 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:55:33.148155 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:55:33.148155 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:55:33.148155 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:55:33.148155 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:55:33.148155 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. Oct 04 21:55:33.148155 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:55:33.151961 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e7dc3238-8660-415e-856a-89965160425a tempest-TenantUsagesNegativeTestJSON-1380751471 tempest-TenantUsagesNegativeTestJSON-1380751471-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:55:33.151961 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-e7dc3238-8660-415e-856a-89965160425a tempest-TenantUsagesNegativeTestJSON-1380751471 tempest-TenantUsagesNegativeTestJSON-1380751471-project-admin] 10.222.0.43 "GET /compute/v2.1/os-simple-tenant-usage/e9722642866642c0ba747a37faac0a56?start=2022-10-05T21%3A55%3A32.162126&end=2022-10-03T21%3A55%3A32.162126" status: 400 len: 111 microversion: 2.1 time: 0.034220 Oct 04 21:55:33.153006 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1309/2703] 10.222.0.43 () {58 vars in 1412 bytes} [Tue Oct 4 21:55:33 2022] GET /compute/v2.1/os-simple-tenant-usage/e9722642866642c0ba747a37faac0a56?start=2022-10-05T21%3A55%3A32.162126&end=2022-10-03T21%3A55%3A32.162126 => generated 111 bytes in 36 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 04 21:55:33.297981 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-a84290a4-119c-4e5a-bd45-588bf45193c6 tempest-TenantUsagesNegativeTestJSON-1058388017 tempest-TenantUsagesNegativeTestJSON-1058388017-project] Calling method '.version_select at 0x7fbb2f49a700>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:55:33.305819 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-a84290a4-119c-4e5a-bd45-588bf45193c6 tempest-TenantUsagesNegativeTestJSON-1058388017 tempest-TenantUsagesNegativeTestJSON-1058388017-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': 'da9861dd458b453381085b6170ab38f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9722642866642c0ba747a37faac0a56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:55:33.308869 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-a84290a4-119c-4e5a-bd45-588bf45193c6 tempest-TenantUsagesNegativeTestJSON-1058388017 tempest-TenantUsagesNegativeTestJSON-1058388017-project] Request method failure captured: Oct 04 21:55:33.308869 n-d-860284-1 devstack@n-api.service[134101]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-03T21%3A55%3A32.162126&end=2022-10-05T21%3A55%3A32.162126&detailed=1 HTTP/1.1 Oct 04 21:55:33.308869 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 21:55:33.308869 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 21:55:33.308869 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 21:55:33.308869 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 21:55:33.308869 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 21:55:33.308869 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 21:55:33.308869 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 21:55:33.308869 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 21:55:33.308869 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPKvSuc9JR_A4ZVvD0Hrtvwwwkun_zXz1-Chgil7KMIuyJE9jPPQb7VjOUaKQ4zwEqkbC4M0dVtgaGc7E78be6AW4J709Out27GpsR5IK-COs6MIXcC1JO_dFNI6l4rj-G_yHEBrFoUW_q9THRG_nHaJMQhPT2vIO2gmYN2FvojWRqA8 Oct 04 21:55:33.308869 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 21:55:33.308869 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 21:55:33.308869 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 21:55:33.308869 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 21:55:33.308869 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 21:55:33.308869 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 21:55:33.308869 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: e9722642866642c0ba747a37faac0a56 Oct 04 21:55:33.308869 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-1058388017 Oct 04 21:55:33.308869 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 21:55:33.308869 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 21:55:33.308869 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/e9722642866642c0ba747a37faac0a56"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_e9722642866642c0ba747a37faac0a56", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/e9722642866642c0ba747a37faac0a56"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/e9722642866642c0ba747a37faac0a56"}]}] Oct 04 21:55:33.308869 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-1058388017 Oct 04 21:55:33.308869 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: e9722642866642c0ba747a37faac0a56 Oct 04 21:55:33.308869 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-1058388017 Oct 04 21:55:33.308869 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-TenantUsagesNegativeTestJSON-1058388017-project Oct 04 21:55:33.308869 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 21:55:33.308869 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 21:55:33.308869 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: da9861dd458b453381085b6170ab38f3 Oct 04 21:55:33.308869 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-1058388017-project Oct 04 21:55:33.308869 n-d-860284-1 devstack@n-api.service[134101]: method: Oct 04 21:55:33.308869 n-d-860284-1 devstack@n-api.service[134101]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 04 21:55:33.308869 n-d-860284-1 devstack@n-api.service[134101]: action_args: {} Oct 04 21:55:33.308869 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:55:33.308869 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:55:33.308869 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:55:33.308869 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:55:33.308869 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:55:33.308869 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:55:33.308869 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:55:33.308869 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:55:33.308869 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 21:55:33.308869 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:55:33.308869 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:55:33.308869 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:55:33.308869 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index Oct 04 21:55:33.308869 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return self._index(req) Oct 04 21:55:33.308869 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index Oct 04 21:55:33.308869 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') Oct 04 21:55:33.308869 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 21:55:33.308869 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 21:55:33.308869 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 21:55:33.308869 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 21:55:33.308869 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 21:55:33.308869 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 21:55:33.308869 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 21:55:33.308869 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 21:55:33.308869 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 21:55:33.308869 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 21:55:33.308869 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 21:55:33.308869 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 21:55:33.308869 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 21:55:33.319132 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 21:55:33.319132 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 04 21:55:33.319132 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:55:33.319132 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:55:33.319132 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:55:33.319132 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:55:33.319132 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:55:33.319132 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:55:33.319132 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 21:55:33.319132 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 21:55:33.319132 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 04 21:55:33.319132 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:55:33.319132 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-a84290a4-119c-4e5a-bd45-588bf45193c6 tempest-TenantUsagesNegativeTestJSON-1058388017 tempest-TenantUsagesNegativeTestJSON-1058388017-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:55:33.319132 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-a84290a4-119c-4e5a-bd45-588bf45193c6 tempest-TenantUsagesNegativeTestJSON-1058388017 tempest-TenantUsagesNegativeTestJSON-1058388017-project] 10.222.0.43 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-03T21%3A55%3A32.162126&end=2022-10-05T21%3A55%3A32.162126&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.153037 Oct 04 21:55:33.319132 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1310/2704] 10.222.0.43 () {58 vars in 1335 bytes} [Tue Oct 4 21:55:33 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-03T21%3A55%3A32.162126&end=2022-10-05T21%3A55%3A32.162126&detailed=1 => generated 123 bytes in 155 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:55:33.961744 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-3b99ed8d-3a3e-452a-b0b2-3cbf24e807f8 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:55:33.962456 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-3b99ed8d-3a3e-452a-b0b2-3cbf24e807f8 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] [instance: a2e7312a-4e0d-4c47-b7c6-e1490a3f99d3] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:55:33.970739 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3b99ed8d-3a3e-452a-b0b2-3cbf24e807f8 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:33.971574 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3b99ed8d-3a3e-452a-b0b2-3cbf24e807f8 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:33.972205 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3b99ed8d-3a3e-452a-b0b2-3cbf24e807f8 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:33.973317 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3b99ed8d-3a3e-452a-b0b2-3cbf24e807f8 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:33.975152 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3b99ed8d-3a3e-452a-b0b2-3cbf24e807f8 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:33.975776 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3b99ed8d-3a3e-452a-b0b2-3cbf24e807f8 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:34.224638 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-1e9b8526-5ed8-465e-a735-1bcfadcd7b46 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] 10.222.0.43 "POST /compute/v2.1/servers/e8900fd4-88c2-4800-baba-124e8ed0eac3/action" status: 202 len: 0 microversion: 2.1 time: 2.417692 Oct 04 21:55:34.226298 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1395/2705] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 21:55:31 2022] POST /compute/v2.1/servers/e8900fd4-88c2-4800-baba-124e8ed0eac3/action => generated 0 bytes in 2421 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:55:34.237513 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-8de544a1-fd8e-44bf-93f6-99a3ebf01886 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:55:34.238923 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-8de544a1-fd8e-44bf-93f6-99a3ebf01886 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] [instance: e8900fd4-88c2-4800-baba-124e8ed0eac3] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:55:34.251788 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8de544a1-fd8e-44bf-93f6-99a3ebf01886 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:34.261637 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8de544a1-fd8e-44bf-93f6-99a3ebf01886 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:34.262327 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8de544a1-fd8e-44bf-93f6-99a3ebf01886 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:34.263316 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8de544a1-fd8e-44bf-93f6-99a3ebf01886 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:34.263962 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8de544a1-fd8e-44bf-93f6-99a3ebf01886 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:34.264636 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8de544a1-fd8e-44bf-93f6-99a3ebf01886 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:34.292850 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=100 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:55:34.707347 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-3b99ed8d-3a3e-452a-b0b2-3cbf24e807f8 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47fbc4a6920d451cb1a2ad170de04921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43659cf5fed541e8883664bf17aced70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:55:34.729465 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-3b99ed8d-3a3e-452a-b0b2-3cbf24e807f8 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] 10.222.0.43 "GET /compute/v2.1/servers/a2e7312a-4e0d-4c47-b7c6-e1490a3f99d3" status: 200 len: 1495 microversion: 2.1 time: 0.775140 Oct 04 21:55:34.731515 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1311/2706] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:55:33 2022] GET /compute/v2.1/servers/a2e7312a-4e0d-4c47-b7c6-e1490a3f99d3 => generated 1495 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:55:34.752673 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-9caa2e5f-f75c-4060-8130-e9b752d3c813 req-a26ed81b-c8c8-45f4-98e5-1fc2f959aa33 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8900fd4-88c2-4800-baba-124e8ed0eac3", "tag": "958c011c-e3f5-4671-8e25-056b9b11ecfc"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:55:34.763451 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-9caa2e5f-f75c-4060-8130-e9b752d3c813 req-a26ed81b-c8c8-45f4-98e5-1fc2f959aa33 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:34.764222 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-9caa2e5f-f75c-4060-8130-e9b752d3c813 req-a26ed81b-c8c8-45f4-98e5-1fc2f959aa33 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:34.764809 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-9caa2e5f-f75c-4060-8130-e9b752d3c813 req-a26ed81b-c8c8-45f4-98e5-1fc2f959aa33 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:34.780267 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-9caa2e5f-f75c-4060-8130-e9b752d3c813 req-a26ed81b-c8c8-45f4-98e5-1fc2f959aa33 service nova] Creating event network-changed:958c011c-e3f5-4671-8e25-056b9b11ecfc for instance e8900fd4-88c2-4800-baba-124e8ed0eac3 on n-h2-860284-1 Oct 04 21:55:34.785715 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-9caa2e5f-f75c-4060-8130-e9b752d3c813 req-a26ed81b-c8c8-45f4-98e5-1fc2f959aa33 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037150 Oct 04 21:55:34.787778 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1312/2707] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:55:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:55:34.823768 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-8de544a1-fd8e-44bf-93f6-99a3ebf01886 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] 10.222.0.43 "GET /compute/v2.1/servers/e8900fd4-88c2-4800-baba-124e8ed0eac3/os-security-groups" status: 200 len: 1158 microversion: 2.1 time: 0.592583 Oct 04 21:55:34.824436 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1396/2708] 10.222.0.43 () {58 vars in 1293 bytes} [Tue Oct 4 21:55:34 2022] GET /compute/v2.1/servers/e8900fd4-88c2-4800-baba-124e8ed0eac3/os-security-groups => generated 1158 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:55:34.841936 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-ec6c9ea7-413a-4614-9796-88860d91aa54 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Action: 'create', calling method: .version_select at 0x7fbb2e68e4c0>, body: {"security_group": {"name": " tempest-securitygroup -27094591 ", "description": "tempest-description-2005944222"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:55:35.259447 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-ec6c9ea7-413a-4614-9796-88860d91aa54 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] 10.222.0.43 "POST /compute/v2.1/os-security-groups" status: 200 len: 222 microversion: 2.1 time: 0.412463 Oct 04 21:55:35.262099 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1313/2709] 10.222.0.43 () {60 vars in 1180 bytes} [Tue Oct 4 21:55:34 2022] POST /compute/v2.1/os-security-groups => generated 222 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:55:35.272599 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell0:SELECT=8 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:55:35.278049 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-60a02fd7-4625-43bf-a14e-7d6ef67d47f0 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Calling method '.version_select at 0x7fbb2f8c15e0>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:55:35.467802 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-60a02fd7-4625-43bf-a14e-7d6ef67d47f0 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] 10.222.0.43 "GET /compute/v2.1/os-security-groups/b7245ff1-7be8-43a1-b2c8-453b7ec9e10b" status: 200 len: 222 microversion: 2.1 time: 0.195711 Oct 04 21:55:35.470045 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1397/2710] 10.222.0.43 () {58 vars in 1269 bytes} [Tue Oct 4 21:55:35 2022] GET /compute/v2.1/os-security-groups/b7245ff1-7be8-43a1-b2c8-453b7ec9e10b => generated 222 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:55:35.485439 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e1a97bf9-558a-45dd-b652-abf559ab2c3e tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Calling method '.version_select at 0x7fbb2f89f3a0>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:55:35.494656 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=4 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:55:35.755778 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-3f195858-73d2-46dd-b708-6842da414a09 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:55:35.756849 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-3f195858-73d2-46dd-b708-6842da414a09 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] [instance: a2e7312a-4e0d-4c47-b7c6-e1490a3f99d3] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:55:35.773710 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3f195858-73d2-46dd-b708-6842da414a09 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:35.774845 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3f195858-73d2-46dd-b708-6842da414a09 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:35.776705 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3f195858-73d2-46dd-b708-6842da414a09 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:35.778309 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3f195858-73d2-46dd-b708-6842da414a09 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:35.779471 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3f195858-73d2-46dd-b708-6842da414a09 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:35.782969 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3f195858-73d2-46dd-b708-6842da414a09 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:36.441970 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-3f195858-73d2-46dd-b708-6842da414a09 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47fbc4a6920d451cb1a2ad170de04921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43659cf5fed541e8883664bf17aced70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:55:36.452198 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-3f195858-73d2-46dd-b708-6842da414a09 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] 10.222.0.43 "GET /compute/v2.1/servers/a2e7312a-4e0d-4c47-b7c6-e1490a3f99d3" status: 200 len: 1495 microversion: 2.1 time: 0.701707 Oct 04 21:55:36.463355 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1398/2711] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:55:35 2022] GET /compute/v2.1/servers/a2e7312a-4e0d-4c47-b7c6-e1490a3f99d3 => generated 1495 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:55:36.816465 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-e1a97bf9-558a-45dd-b652-abf559ab2c3e tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/b7245ff1-7be8-43a1-b2c8-453b7ec9e10b" status: 202 len: 0 microversion: 2.1 time: 1.336423 Oct 04 21:55:36.817178 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1314/2712] 10.222.0.43 () {58 vars in 1272 bytes} [Tue Oct 4 21:55:35 2022] DELETE /compute/v2.1/os-security-groups/b7245ff1-7be8-43a1-b2c8-453b7ec9e10b => generated 0 bytes in 1338 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:55:36.826170 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-5f27473c-6e1f-40fd-b930-62d50bff5f1f tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Calling method '.version_select at 0x7fbb372809d0>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:55:36.950607 n-d-860284-1 devstack@n-api.service[134102]: DEBUG neutronclient.v2_0.client [None req-5f27473c-6e1f-40fd-b930-62d50bff5f1f tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group b7245ff1-7be8-43a1-b2c8-453b7ec9e10b does not exist", "detail": ""}} {{(pid=134102) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 21:55:36.951310 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.network.security_group_api [None req-5f27473c-6e1f-40fd-b930-62d50bff5f1f tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Neutron security group b7245ff1-7be8-43a1-b2c8-453b7ec9e10b not found {{(pid=134102) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 04 21:55:36.951929 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-5f27473c-6e1f-40fd-b930-62d50bff5f1f tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] HTTP exception thrown: Security group b7245ff1-7be8-43a1-b2c8-453b7ec9e10b does not exist Oct 04 21:55:36.951929 n-d-860284-1 devstack@n-api.service[134102]: Neutron server returns request_ids: ['req-1dedd4eb-9d72-492d-9cb1-c957fb89500b'] Oct 04 21:55:36.954213 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-5f27473c-6e1f-40fd-b930-62d50bff5f1f tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Request method failure captured: Oct 04 21:55:36.954213 n-d-860284-1 devstack@n-api.service[134102]: request: GET /compute/v2.1/os-security-groups/b7245ff1-7be8-43a1-b2c8-453b7ec9e10b HTTP/1.1 Oct 04 21:55:36.954213 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 21:55:36.954213 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 21:55:36.954213 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 21:55:36.954213 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 21:55:36.954213 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 21:55:36.954213 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 21:55:36.954213 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 21:55:36.954213 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 21:55:36.954213 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPKu1qJNzwuxRWdc7rP7w0gQHhoDMvT1hi4W6OphaRxhVehI7YxkRLmiRVTEcrGE4_kLVYYR9CLMgNAOGQEVIUg5ptFWtgovLZ1WXY_454sRPkZoUaMXWYK1EaSOxzAsp1QFRpLX6-NPmD2kPLhLIPCnWZqTYS8blSXJvj9wIhro38mc Oct 04 21:55:36.954213 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 21:55:36.954213 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 21:55:36.954213 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 21:55:36.954213 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 21:55:36.954213 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 21:55:36.954213 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 21:55:36.954213 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: 51745fc19321469bb20afabe48b2185d Oct 04 21:55:36.954213 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-SecurityGroupsTestJSON-367911468 Oct 04 21:55:36.954213 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 21:55:36.954213 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 21:55:36.954213 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/51745fc19321469bb20afabe48b2185d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_51745fc19321469bb20afabe48b2185d", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/51745fc19321469bb20afabe48b2185d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/51745fc19321469bb20afabe48b2185d"}]}] Oct 04 21:55:36.954213 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-SecurityGroupsTestJSON-367911468 Oct 04 21:55:36.954213 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: 51745fc19321469bb20afabe48b2185d Oct 04 21:55:36.954213 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-367911468 Oct 04 21:55:36.954213 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-SecurityGroupsTestJSON-367911468-project Oct 04 21:55:36.954213 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 21:55:36.954213 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 21:55:36.954213 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: 4cca65ba35b14db8bf2187188de8c838 Oct 04 21:55:36.954213 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-SecurityGroupsTestJSON-367911468-project Oct 04 21:55:36.954213 n-d-860284-1 devstack@n-api.service[134102]: method: Oct 04 21:55:36.954213 n-d-860284-1 devstack@n-api.service[134102]: exception: Security group b7245ff1-7be8-43a1-b2c8-453b7ec9e10b does not exist Oct 04 21:55:36.954213 n-d-860284-1 devstack@n-api.service[134102]: Neutron server returns request_ids: ['req-1dedd4eb-9d72-492d-9cb1-c957fb89500b'] Oct 04 21:55:36.954213 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': 'b7245ff1-7be8-43a1-b2c8-453b7ec9e10b'} Oct 04 21:55:36.954213 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:55:36.954213 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:55:36.954213 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 04 21:55:36.954213 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 04 21:55:36.954213 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:55:36.954213 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:55:36.954213 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 04 21:55:36.954213 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 04 21:55:36.954213 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:55:36.954213 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:55:36.954213 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 21:55:36.954213 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 21:55:36.954213 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:55:36.954213 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:55:36.954213 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 21:55:36.954213 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 21:55:36.954213 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:55:36.954213 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:55:36.954213 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 21:55:36.954213 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 21:55:36.954213 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:55:36.954213 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:55:36.954213 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 21:55:36.954213 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 21:55:36.954213 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 21:55:36.954213 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 21:55:36.954213 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group b7245ff1-7be8-43a1-b2c8-453b7ec9e10b does not exist Oct 04 21:55:36.960413 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1dedd4eb-9d72-492d-9cb1-c957fb89500b'] Oct 04 21:55:36.960413 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:55:36.960413 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:55:36.960413 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:55:36.960413 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:55:36.960413 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 04 21:55:36.960413 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 04 21:55:36.960413 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 04 21:55:36.960413 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 21:55:36.960413 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group b7245ff1-7be8-43a1-b2c8-453b7ec9e10b does not exist Oct 04 21:55:36.960413 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1dedd4eb-9d72-492d-9cb1-c957fb89500b'] Oct 04 21:55:36.960413 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:55:36.960413 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:55:36.960413 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:55:36.960413 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:55:36.960413 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:55:36.960413 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:55:36.960413 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:55:36.960413 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:55:36.960413 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:55:36.960413 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:55:36.960413 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:55:36.960413 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:55:36.960413 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 04 21:55:36.960413 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 21:55:36.960413 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group b7245ff1-7be8-43a1-b2c8-453b7ec9e10b does not exist Oct 04 21:55:36.960413 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1dedd4eb-9d72-492d-9cb1-c957fb89500b'] Oct 04 21:55:36.960413 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:55:36.960413 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:55:36.960413 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:55:36.960413 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:55:36.960413 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:55:36.960413 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:55:36.960413 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:55:36.960413 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:55:36.960413 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group b7245ff1-7be8-43a1-b2c8-453b7ec9e10b does not exist Oct 04 21:55:36.960413 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1dedd4eb-9d72-492d-9cb1-c957fb89500b'] Oct 04 21:55:36.960413 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:55:36.960413 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-5f27473c-6e1f-40fd-b930-62d50bff5f1f tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Returning 404 to user: Security group b7245ff1-7be8-43a1-b2c8-453b7ec9e10b does not exist Oct 04 21:55:36.960413 n-d-860284-1 devstack@n-api.service[134102]: Neutron server returns request_ids: ['req-1dedd4eb-9d72-492d-9cb1-c957fb89500b'] {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:55:36.960413 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-5f27473c-6e1f-40fd-b930-62d50bff5f1f tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] 10.222.0.43 "GET /compute/v2.1/os-security-groups/b7245ff1-7be8-43a1-b2c8-453b7ec9e10b" status: 404 len: 194 microversion: 2.1 time: 0.135039 Oct 04 21:55:36.960413 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1399/2713] 10.222.0.43 () {58 vars in 1269 bytes} [Tue Oct 4 21:55:36 2022] GET /compute/v2.1/os-security-groups/b7245ff1-7be8-43a1-b2c8-453b7ec9e10b => generated 194 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:55:36.974887 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-33db66b9-6cc4-4b19-a892-f032ec195d1f tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Action: 'create', calling method: .version_select at 0x7fbb2e626430>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-114088959", "description": "tempest-description-2118808918"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:55:37.488580 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-938fd917-99c4-417e-b77a-2aa83f79232d tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:55:37.490173 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-938fd917-99c4-417e-b77a-2aa83f79232d tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] [instance: a2e7312a-4e0d-4c47-b7c6-e1490a3f99d3] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:55:37.529227 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-938fd917-99c4-417e-b77a-2aa83f79232d tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:37.532839 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-938fd917-99c4-417e-b77a-2aa83f79232d tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:37.542300 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-938fd917-99c4-417e-b77a-2aa83f79232d tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:37.543119 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-938fd917-99c4-417e-b77a-2aa83f79232d tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:37.543636 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-938fd917-99c4-417e-b77a-2aa83f79232d tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:37.544414 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-938fd917-99c4-417e-b77a-2aa83f79232d tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:38.406932 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-938fd917-99c4-417e-b77a-2aa83f79232d tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47fbc4a6920d451cb1a2ad170de04921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43659cf5fed541e8883664bf17aced70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:55:38.415720 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-938fd917-99c4-417e-b77a-2aa83f79232d tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] 10.222.0.43 "GET /compute/v2.1/servers/a2e7312a-4e0d-4c47-b7c6-e1490a3f99d3" status: 200 len: 1501 microversion: 2.1 time: 0.933022 Oct 04 21:55:38.435277 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1400/2714] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:55:37 2022] GET /compute/v2.1/servers/a2e7312a-4e0d-4c47-b7c6-e1490a3f99d3 => generated 1501 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:55:38.459851 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-fe9fdb1f-493f-45b5-aaa4-cb1574520cb9 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:55:38.460774 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-fe9fdb1f-493f-45b5-aaa4-cb1574520cb9 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] [instance: a2e7312a-4e0d-4c47-b7c6-e1490a3f99d3] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:55:38.467648 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fe9fdb1f-493f-45b5-aaa4-cb1574520cb9 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:38.468495 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fe9fdb1f-493f-45b5-aaa4-cb1574520cb9 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:38.469180 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fe9fdb1f-493f-45b5-aaa4-cb1574520cb9 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:38.470137 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fe9fdb1f-493f-45b5-aaa4-cb1574520cb9 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:38.470862 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fe9fdb1f-493f-45b5-aaa4-cb1574520cb9 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:38.471569 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fe9fdb1f-493f-45b5-aaa4-cb1574520cb9 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:38.503047 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-fe9fdb1f-493f-45b5-aaa4-cb1574520cb9 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] [instance: a2e7312a-4e0d-4c47-b7c6-e1490a3f99d3] Going to try to terminate instance {{(pid=134102) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:55:38.619132 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-fe9fdb1f-493f-45b5-aaa4-cb1574520cb9 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] 10.222.0.43 "DELETE /compute/v2.1/servers/a2e7312a-4e0d-4c47-b7c6-e1490a3f99d3" status: 204 len: 0 microversion: 2.1 time: 0.160389 Oct 04 21:55:38.624017 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1401/2715] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 21:55:38 2022] DELETE /compute/v2.1/servers/a2e7312a-4e0d-4c47-b7c6-e1490a3f99d3 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 21:55:38.925897 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-f625c573-5b5e-46bd-8ebf-27e9c96ad00e tempest-ImagesMetadataNegativeTestJSON-1546074473 tempest-ImagesMetadataNegativeTestJSON-1546074473-project] Calling method '.version_select at 0x7fbb2efc0b80>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:55:38.970002 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-f625c573-5b5e-46bd-8ebf-27e9c96ad00e tempest-ImagesMetadataNegativeTestJSON-1546074473 tempest-ImagesMetadataNegativeTestJSON-1546074473-project] HTTP exception thrown: Image not found. Oct 04 21:55:38.983188 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-f625c573-5b5e-46bd-8ebf-27e9c96ad00e tempest-ImagesMetadataNegativeTestJSON-1546074473 tempest-ImagesMetadataNegativeTestJSON-1546074473-project] Request method failure captured: Oct 04 21:55:38.983188 n-d-860284-1 devstack@n-api.service[134102]: request: DELETE /compute/v2.1/images/39c86484-2080-493a-bf4f-b7aef94db3fc/metadata/os_distro HTTP/1.1 Oct 04 21:55:38.983188 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 21:55:38.983188 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 21:55:38.983188 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 21:55:38.983188 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 21:55:38.983188 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 21:55:38.983188 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 21:55:38.983188 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 21:55:38.983188 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 21:55:38.983188 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPKva4Sq4ryrJbTDkeOJ1fELRdG61LtchISbxe1ZiLkC18qGycK5oHbO7GturrlTYtJOXIhqaoul55Y4owjYm6oepJnfSlRkPP0N6oJsU5xAhnjtMha3WjF1DKSASKojAZMxvk9FSi-4C01pbyFGoDo9WvVzl58DV3TZ9-8EYqbC0uTA Oct 04 21:55:38.983188 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 21:55:38.983188 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 21:55:38.983188 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 21:55:38.983188 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 21:55:38.983188 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 21:55:38.983188 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 21:55:38.983188 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: 0607871278724c56934474161cc761a0 Oct 04 21:55:38.983188 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1546074473 Oct 04 21:55:38.983188 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 21:55:38.983188 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 21:55:38.983188 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0607871278724c56934474161cc761a0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_0607871278724c56934474161cc761a0", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0607871278724c56934474161cc761a0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/0607871278724c56934474161cc761a0"}]}] Oct 04 21:55:38.983188 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1546074473 Oct 04 21:55:38.983188 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: 0607871278724c56934474161cc761a0 Oct 04 21:55:38.983188 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1546074473 Oct 04 21:55:38.983188 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-ImagesMetadataNegativeTestJSON-1546074473-project Oct 04 21:55:38.983188 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 21:55:38.983188 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 21:55:38.983188 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: c0df6225e7bd42ae96cff1a76109075e Oct 04 21:55:38.983188 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1546074473-project Oct 04 21:55:38.983188 n-d-860284-1 devstack@n-api.service[134102]: method: Oct 04 21:55:38.983188 n-d-860284-1 devstack@n-api.service[134102]: exception: Image not found. Oct 04 21:55:38.983188 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'image_id': '39c86484-2080-493a-bf4f-b7aef94db3fc', 'id': 'os_distro'} Oct 04 21:55:38.983188 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:55:38.983188 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:55:38.983188 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 21:55:38.983188 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 21:55:38.983188 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 21:55:38.983188 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 21:55:38.983188 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 21:55:38.983188 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 21:55:38.983188 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 21:55:38.983188 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 21:55:38.983188 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 21:55:38.983188 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 21:55:38.983188 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 21:55:38.983188 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 21:55:38.983188 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 21:55:38.983188 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 21:55:38.983188 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 21:55:38.983188 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 21:55:38.983188 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 39c86484-2080-493a-bf4f-b7aef94db3fc Oct 04 21:55:38.983188 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:55:38.983188 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:55:38.983188 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:55:38.983188 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:55:38.983188 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 04 21:55:38.983188 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 04 21:55:38.983188 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 04 21:55:38.983188 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 04 21:55:38.983188 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 04 21:55:38.983188 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 04 21:55:38.988209 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 04 21:55:38.988209 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 04 21:55:38.988209 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 21:55:38.988209 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 21:55:38.988209 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 21:55:38.988209 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 21:55:38.988209 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 21:55:38.988209 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 21:55:38.988209 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 21:55:38.988209 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 21:55:38.988209 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 21:55:38.988209 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 21:55:38.988209 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 21:55:38.988209 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 21:55:38.988209 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 21:55:38.988209 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 21:55:38.988209 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 21:55:38.988209 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 21:55:38.988209 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 39c86484-2080-493a-bf4f-b7aef94db3fc could not be found. Oct 04 21:55:38.988209 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:55:38.988209 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:55:38.988209 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:55:38.988209 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:55:38.988209 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:55:38.988209 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:55:38.988209 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:55:38.988209 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:55:38.988209 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:55:38.988209 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:55:38.988209 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:55:38.988209 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:55:38.988209 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete Oct 04 21:55:38.988209 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 04 21:55:38.988209 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 04 21:55:38.988209 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 04 21:55:38.988209 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 21:55:38.988209 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:55:38.988209 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:55:38.988209 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:55:38.988209 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:55:38.988209 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:55:38.988209 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:55:38.988209 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:55:38.988209 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:55:38.988209 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 21:55:38.988209 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:55:38.988209 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-f625c573-5b5e-46bd-8ebf-27e9c96ad00e tempest-ImagesMetadataNegativeTestJSON-1546074473 tempest-ImagesMetadataNegativeTestJSON-1546074473-project] Returning 404 to user: Image not found. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:55:38.996552 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-f625c573-5b5e-46bd-8ebf-27e9c96ad00e tempest-ImagesMetadataNegativeTestJSON-1546074473 tempest-ImagesMetadataNegativeTestJSON-1546074473-project] 10.222.0.43 "DELETE /compute/v2.1/images/39c86484-2080-493a-bf4f-b7aef94db3fc/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.358247 Oct 04 21:55:38.996552 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1402/2716] 10.222.0.43 () {58 vars in 1293 bytes} [Tue Oct 4 21:55:38 2022] DELETE /compute/v2.1/images/39c86484-2080-493a-bf4f-b7aef94db3fc/metadata/os_distro => generated 62 bytes in 372 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 21:55:39.008999 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-f786635e-baef-4243-8e7e-cfb20bb29f78 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:55:39.012639 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-f786635e-baef-4243-8e7e-cfb20bb29f78 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] [instance: a2e7312a-4e0d-4c47-b7c6-e1490a3f99d3] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:55:39.016476 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-33db66b9-6cc4-4b19-a892-f032ec195d1f tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] 10.222.0.43 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 2.050510 Oct 04 21:55:39.017636 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1315/2717] 10.222.0.43 () {60 vars in 1180 bytes} [Tue Oct 4 21:55:36 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 2053 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:55:39.024751 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f786635e-baef-4243-8e7e-cfb20bb29f78 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:39.025940 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f786635e-baef-4243-8e7e-cfb20bb29f78 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:39.026807 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f786635e-baef-4243-8e7e-cfb20bb29f78 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:39.027827 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f786635e-baef-4243-8e7e-cfb20bb29f78 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:39.028495 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f786635e-baef-4243-8e7e-cfb20bb29f78 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:39.029122 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f786635e-baef-4243-8e7e-cfb20bb29f78 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:39.032911 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-7464a06d-6bcb-4ff3-8d9b-e03e547982b5 tempest-ImagesMetadataNegativeTestJSON-1546074473 tempest-ImagesMetadataNegativeTestJSON-1546074473-project] Calling method '.version_select at 0x7fbb2e6c00d0>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:55:39.095890 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-7464a06d-6bcb-4ff3-8d9b-e03e547982b5 tempest-ImagesMetadataNegativeTestJSON-1546074473 tempest-ImagesMetadataNegativeTestJSON-1546074473-project] HTTP exception thrown: Image not found. Oct 04 21:55:39.100710 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-7464a06d-6bcb-4ff3-8d9b-e03e547982b5 tempest-ImagesMetadataNegativeTestJSON-1546074473 tempest-ImagesMetadataNegativeTestJSON-1546074473-project] Request method failure captured: Oct 04 21:55:39.100710 n-d-860284-1 devstack@n-api.service[134101]: request: GET /compute/v2.1/images/564e1ee6-ee8d-4619-9bdf-7a29fd535a91/metadata/os_version HTTP/1.1 Oct 04 21:55:39.100710 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 21:55:39.100710 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 21:55:39.100710 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 21:55:39.100710 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 21:55:39.100710 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 21:55:39.100710 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 21:55:39.100710 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 21:55:39.100710 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 21:55:39.100710 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPKva4Sq4ryrJbTDkeOJ1fELRdG61LtchISbxe1ZiLkC18qGycK5oHbO7GturrlTYtJOXIhqaoul55Y4owjYm6oepJnfSlRkPP0N6oJsU5xAhnjtMha3WjF1DKSASKojAZMxvk9FSi-4C01pbyFGoDo9WvVzl58DV3TZ9-8EYqbC0uTA Oct 04 21:55:39.100710 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 21:55:39.100710 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 21:55:39.100710 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 21:55:39.100710 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 21:55:39.100710 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 21:55:39.100710 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 21:55:39.100710 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: 0607871278724c56934474161cc761a0 Oct 04 21:55:39.100710 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1546074473 Oct 04 21:55:39.100710 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 21:55:39.100710 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 21:55:39.100710 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0607871278724c56934474161cc761a0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_0607871278724c56934474161cc761a0", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0607871278724c56934474161cc761a0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/0607871278724c56934474161cc761a0"}]}] Oct 04 21:55:39.100710 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1546074473 Oct 04 21:55:39.100710 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: 0607871278724c56934474161cc761a0 Oct 04 21:55:39.100710 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1546074473 Oct 04 21:55:39.100710 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-ImagesMetadataNegativeTestJSON-1546074473-project Oct 04 21:55:39.100710 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 21:55:39.100710 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 21:55:39.100710 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: c0df6225e7bd42ae96cff1a76109075e Oct 04 21:55:39.100710 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1546074473-project Oct 04 21:55:39.100710 n-d-860284-1 devstack@n-api.service[134101]: method: Oct 04 21:55:39.100710 n-d-860284-1 devstack@n-api.service[134101]: exception: Image not found. Oct 04 21:55:39.100710 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'image_id': '564e1ee6-ee8d-4619-9bdf-7a29fd535a91', 'id': 'os_version'} Oct 04 21:55:39.100710 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:55:39.100710 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:55:39.100710 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 21:55:39.100710 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 21:55:39.100710 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 21:55:39.100710 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 21:55:39.100710 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 21:55:39.100710 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 21:55:39.100710 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 21:55:39.100710 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 21:55:39.100710 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 21:55:39.100710 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 21:55:39.100710 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 21:55:39.100710 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 21:55:39.100710 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 21:55:39.100710 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 21:55:39.100710 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 21:55:39.100710 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 21:55:39.100710 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 564e1ee6-ee8d-4619-9bdf-7a29fd535a91 Oct 04 21:55:39.100710 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:55:39.100710 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:55:39.100710 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:55:39.100710 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:55:39.100710 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 04 21:55:39.100710 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 04 21:55:39.100710 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 04 21:55:39.100710 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 04 21:55:39.100710 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 04 21:55:39.100710 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 04 21:55:39.106705 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 04 21:55:39.106705 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 04 21:55:39.106705 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 21:55:39.106705 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 21:55:39.106705 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 21:55:39.106705 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 21:55:39.106705 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 21:55:39.106705 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 21:55:39.106705 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 21:55:39.106705 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 21:55:39.106705 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 21:55:39.106705 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 21:55:39.106705 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 21:55:39.106705 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 21:55:39.106705 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 21:55:39.106705 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 21:55:39.106705 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 21:55:39.106705 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 21:55:39.106705 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 564e1ee6-ee8d-4619-9bdf-7a29fd535a91 could not be found. Oct 04 21:55:39.106705 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:55:39.106705 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:55:39.106705 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:55:39.106705 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:55:39.106705 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:55:39.106705 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:55:39.106705 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:55:39.106705 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:55:39.106705 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:55:39.106705 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:55:39.106705 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:55:39.106705 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:55:39.106705 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show Oct 04 21:55:39.106705 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Oct 04 21:55:39.106705 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 04 21:55:39.106705 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 04 21:55:39.106705 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 21:55:39.106705 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:55:39.106705 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:55:39.106705 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:55:39.106705 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:55:39.106705 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:55:39.106705 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:55:39.106705 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:55:39.106705 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:55:39.106705 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 21:55:39.106705 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:55:39.106705 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-7464a06d-6bcb-4ff3-8d9b-e03e547982b5 tempest-ImagesMetadataNegativeTestJSON-1546074473 tempest-ImagesMetadataNegativeTestJSON-1546074473-project] Returning 404 to user: Image not found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:55:39.106705 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-7464a06d-6bcb-4ff3-8d9b-e03e547982b5 tempest-ImagesMetadataNegativeTestJSON-1546074473 tempest-ImagesMetadataNegativeTestJSON-1546074473-project] 10.222.0.43 "GET /compute/v2.1/images/564e1ee6-ee8d-4619-9bdf-7a29fd535a91/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.083726 Oct 04 21:55:39.113321 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1316/2718] 10.222.0.43 () {58 vars in 1293 bytes} [Tue Oct 4 21:55:39 2022] GET /compute/v2.1/images/564e1ee6-ee8d-4619-9bdf-7a29fd535a91/metadata/os_version => generated 62 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 21:55:39.127078 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-b8e4f225-af6a-41dd-96bc-18a8f9a70bf0 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Action: 'create', calling method: .version_select at 0x7fbb2e6c0940>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-788759347", "description": "tempest-description-1306627443"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:55:39.734956 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-f786635e-baef-4243-8e7e-cfb20bb29f78 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47fbc4a6920d451cb1a2ad170de04921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43659cf5fed541e8883664bf17aced70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:55:39.754615 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-f786635e-baef-4243-8e7e-cfb20bb29f78 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] 10.222.0.43 "GET /compute/v2.1/servers/a2e7312a-4e0d-4c47-b7c6-e1490a3f99d3" status: 200 len: 1507 microversion: 2.1 time: 0.754030 Oct 04 21:55:39.756915 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1403/2719] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:55:38 2022] GET /compute/v2.1/servers/a2e7312a-4e0d-4c47-b7c6-e1490a3f99d3 => generated 1507 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:55:39.772908 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-7597ab72-1c82-484a-9e61-1463a4188aa5 tempest-ImagesMetadataNegativeTestJSON-1546074473 tempest-ImagesMetadataNegativeTestJSON-1546074473-project] Calling method '.version_select at 0x7fbb2e826430>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:55:39.814037 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-7597ab72-1c82-484a-9e61-1463a4188aa5 tempest-ImagesMetadataNegativeTestJSON-1546074473 tempest-ImagesMetadataNegativeTestJSON-1546074473-project] HTTP exception thrown: Image not found. Oct 04 21:55:39.816524 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-7597ab72-1c82-484a-9e61-1463a4188aa5 tempest-ImagesMetadataNegativeTestJSON-1546074473 tempest-ImagesMetadataNegativeTestJSON-1546074473-project] Request method failure captured: Oct 04 21:55:39.816524 n-d-860284-1 devstack@n-api.service[134102]: request: GET /compute/v2.1/images/a57f5972-17de-43c6-b796-29d3650b10f9/metadata HTTP/1.1 Oct 04 21:55:39.816524 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 21:55:39.816524 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 21:55:39.816524 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 21:55:39.816524 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 21:55:39.816524 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 21:55:39.816524 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 21:55:39.816524 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 21:55:39.816524 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 21:55:39.816524 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPKva4Sq4ryrJbTDkeOJ1fELRdG61LtchISbxe1ZiLkC18qGycK5oHbO7GturrlTYtJOXIhqaoul55Y4owjYm6oepJnfSlRkPP0N6oJsU5xAhnjtMha3WjF1DKSASKojAZMxvk9FSi-4C01pbyFGoDo9WvVzl58DV3TZ9-8EYqbC0uTA Oct 04 21:55:39.816524 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 21:55:39.816524 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 21:55:39.816524 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 21:55:39.816524 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 21:55:39.816524 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 21:55:39.816524 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 21:55:39.816524 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: 0607871278724c56934474161cc761a0 Oct 04 21:55:39.816524 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1546074473 Oct 04 21:55:39.816524 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 21:55:39.816524 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 21:55:39.816524 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0607871278724c56934474161cc761a0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_0607871278724c56934474161cc761a0", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0607871278724c56934474161cc761a0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/0607871278724c56934474161cc761a0"}]}] Oct 04 21:55:39.816524 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1546074473 Oct 04 21:55:39.816524 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: 0607871278724c56934474161cc761a0 Oct 04 21:55:39.816524 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1546074473 Oct 04 21:55:39.816524 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-ImagesMetadataNegativeTestJSON-1546074473-project Oct 04 21:55:39.816524 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 21:55:39.816524 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 21:55:39.816524 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: c0df6225e7bd42ae96cff1a76109075e Oct 04 21:55:39.816524 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1546074473-project Oct 04 21:55:39.816524 n-d-860284-1 devstack@n-api.service[134102]: method: Oct 04 21:55:39.816524 n-d-860284-1 devstack@n-api.service[134102]: exception: Image not found. Oct 04 21:55:39.816524 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'image_id': 'a57f5972-17de-43c6-b796-29d3650b10f9'} Oct 04 21:55:39.816524 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:55:39.816524 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:55:39.816524 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 21:55:39.816524 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 21:55:39.816524 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 21:55:39.816524 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 21:55:39.816524 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 21:55:39.816524 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 21:55:39.816524 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 21:55:39.816524 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 21:55:39.816524 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 21:55:39.816524 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 21:55:39.816524 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 21:55:39.816524 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 21:55:39.816524 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 21:55:39.816524 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 21:55:39.816524 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 21:55:39.816524 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 21:55:39.816524 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID a57f5972-17de-43c6-b796-29d3650b10f9 Oct 04 21:55:39.816524 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:55:39.816524 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:55:39.816524 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:55:39.816524 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:55:39.816524 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 04 21:55:39.816524 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 04 21:55:39.816524 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 04 21:55:39.816524 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 04 21:55:39.816524 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 04 21:55:39.816524 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 04 21:55:39.821791 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 04 21:55:39.821791 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 04 21:55:39.821791 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 21:55:39.821791 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 21:55:39.821791 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 21:55:39.821791 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 21:55:39.821791 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 21:55:39.821791 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 21:55:39.821791 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 21:55:39.821791 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 21:55:39.821791 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 21:55:39.821791 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 21:55:39.821791 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 21:55:39.821791 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 21:55:39.821791 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 21:55:39.821791 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 21:55:39.821791 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 21:55:39.821791 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 21:55:39.821791 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image a57f5972-17de-43c6-b796-29d3650b10f9 could not be found. Oct 04 21:55:39.821791 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:55:39.821791 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:55:39.821791 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:55:39.821791 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:55:39.821791 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:55:39.821791 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:55:39.821791 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:55:39.821791 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:55:39.821791 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:55:39.821791 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:55:39.821791 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:55:39.821791 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:55:39.821791 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index Oct 04 21:55:39.821791 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Oct 04 21:55:39.821791 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 04 21:55:39.821791 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 04 21:55:39.821791 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 21:55:39.821791 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:55:39.821791 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:55:39.821791 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:55:39.821791 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:55:39.821791 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:55:39.821791 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:55:39.821791 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:55:39.821791 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:55:39.821791 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 21:55:39.821791 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:55:39.825063 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-7597ab72-1c82-484a-9e61-1463a4188aa5 tempest-ImagesMetadataNegativeTestJSON-1546074473 tempest-ImagesMetadataNegativeTestJSON-1546074473-project] Returning 404 to user: Image not found. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:55:39.826059 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-7597ab72-1c82-484a-9e61-1463a4188aa5 tempest-ImagesMetadataNegativeTestJSON-1546074473 tempest-ImagesMetadataNegativeTestJSON-1546074473-project] 10.222.0.43 "GET /compute/v2.1/images/a57f5972-17de-43c6-b796-29d3650b10f9/metadata" status: 404 len: 62 microversion: 2.1 time: 0.065993 Oct 04 21:55:39.827228 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1404/2720] 10.222.0.43 () {58 vars in 1260 bytes} [Tue Oct 4 21:55:39 2022] GET /compute/v2.1/images/a57f5972-17de-43c6-b796-29d3650b10f9/metadata => generated 62 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 21:55:39.840412 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-778e0c20-c8c3-4a6b-8d64-f4429aad47de tempest-ImagesMetadataNegativeTestJSON-1546074473 tempest-ImagesMetadataNegativeTestJSON-1546074473-project] Action: 'update_all', calling method: .version_select at 0x7fbb2e70eaf0>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:55:39.866937 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-778e0c20-c8c3-4a6b-8d64-f4429aad47de tempest-ImagesMetadataNegativeTestJSON-1546074473 tempest-ImagesMetadataNegativeTestJSON-1546074473-project] HTTP exception thrown: Image not found. Oct 04 21:55:39.869270 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-778e0c20-c8c3-4a6b-8d64-f4429aad47de tempest-ImagesMetadataNegativeTestJSON-1546074473 tempest-ImagesMetadataNegativeTestJSON-1546074473-project] Request method failure captured: Oct 04 21:55:39.869270 n-d-860284-1 devstack@n-api.service[134102]: request: PUT /compute/v2.1/images/b3a4a26f-dcc5-4c5e-8faa-e21833e31668/metadata HTTP/1.1 Oct 04 21:55:39.869270 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 21:55:39.869270 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 21:55:39.869270 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 21:55:39.869270 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 57 Oct 04 21:55:39.869270 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 21:55:39.869270 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 21:55:39.869270 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 21:55:39.869270 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 21:55:39.869270 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPKva4Sq4ryrJbTDkeOJ1fELRdG61LtchISbxe1ZiLkC18qGycK5oHbO7GturrlTYtJOXIhqaoul55Y4owjYm6oepJnfSlRkPP0N6oJsU5xAhnjtMha3WjF1DKSASKojAZMxvk9FSi-4C01pbyFGoDo9WvVzl58DV3TZ9-8EYqbC0uTA Oct 04 21:55:39.869270 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 21:55:39.869270 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 21:55:39.869270 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 21:55:39.869270 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 21:55:39.869270 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 21:55:39.869270 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 21:55:39.869270 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: 0607871278724c56934474161cc761a0 Oct 04 21:55:39.869270 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1546074473 Oct 04 21:55:39.869270 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 21:55:39.869270 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 21:55:39.869270 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0607871278724c56934474161cc761a0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_0607871278724c56934474161cc761a0", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0607871278724c56934474161cc761a0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/0607871278724c56934474161cc761a0"}]}] Oct 04 21:55:39.869270 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1546074473 Oct 04 21:55:39.869270 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: 0607871278724c56934474161cc761a0 Oct 04 21:55:39.869270 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1546074473 Oct 04 21:55:39.869270 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-ImagesMetadataNegativeTestJSON-1546074473-project Oct 04 21:55:39.869270 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 21:55:39.869270 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 21:55:39.869270 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: c0df6225e7bd42ae96cff1a76109075e Oct 04 21:55:39.869270 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1546074473-project Oct 04 21:55:39.869270 n-d-860284-1 devstack@n-api.service[134102]: Oct 04 21:55:39.869270 n-d-860284-1 devstack@n-api.service[134102]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Oct 04 21:55:39.869270 n-d-860284-1 devstack@n-api.service[134102]: method: Oct 04 21:55:39.869270 n-d-860284-1 devstack@n-api.service[134102]: exception: Image not found. Oct 04 21:55:39.869270 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'image_id': 'b3a4a26f-dcc5-4c5e-8faa-e21833e31668', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Oct 04 21:55:39.869270 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:55:39.869270 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:55:39.869270 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 21:55:39.869270 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 21:55:39.869270 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 21:55:39.869270 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 21:55:39.869270 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 21:55:39.869270 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 21:55:39.869270 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 21:55:39.869270 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 21:55:39.869270 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 21:55:39.869270 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 21:55:39.869270 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 21:55:39.869270 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 21:55:39.869270 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 21:55:39.869270 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 21:55:39.869270 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 21:55:39.869270 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 21:55:39.869270 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID b3a4a26f-dcc5-4c5e-8faa-e21833e31668 Oct 04 21:55:39.869270 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:55:39.869270 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:55:39.869270 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:55:39.869270 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:55:39.869270 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 04 21:55:39.869270 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 04 21:55:39.869270 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 04 21:55:39.869270 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 04 21:55:39.869270 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 04 21:55:39.877685 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 04 21:55:39.877685 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 04 21:55:39.877685 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 04 21:55:39.877685 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 21:55:39.877685 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 21:55:39.877685 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 21:55:39.877685 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 21:55:39.877685 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 21:55:39.877685 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 21:55:39.877685 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 21:55:39.877685 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 21:55:39.877685 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 21:55:39.877685 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 21:55:39.877685 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 21:55:39.877685 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 21:55:39.877685 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 21:55:39.877685 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 21:55:39.877685 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 21:55:39.877685 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 21:55:39.877685 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image b3a4a26f-dcc5-4c5e-8faa-e21833e31668 could not be found. Oct 04 21:55:39.877685 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:55:39.877685 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:55:39.877685 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:55:39.877685 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:55:39.877685 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:55:39.877685 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:55:39.877685 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:55:39.877685 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:55:39.877685 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:55:39.877685 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:55:39.877685 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:55:39.877685 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:55:39.877685 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:55:39.877685 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:55:39.877685 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all Oct 04 21:55:39.877685 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 04 21:55:39.877685 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 04 21:55:39.877685 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 04 21:55:39.877685 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 21:55:39.877685 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:55:39.877685 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:55:39.877685 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:55:39.877685 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:55:39.877685 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:55:39.877685 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:55:39.877685 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:55:39.877685 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:55:39.877685 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 21:55:39.877685 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:55:39.877685 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-778e0c20-c8c3-4a6b-8d64-f4429aad47de tempest-ImagesMetadataNegativeTestJSON-1546074473 tempest-ImagesMetadataNegativeTestJSON-1546074473-project] Returning 404 to user: Image not found. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:55:39.877685 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-778e0c20-c8c3-4a6b-8d64-f4429aad47de tempest-ImagesMetadataNegativeTestJSON-1546074473 tempest-ImagesMetadataNegativeTestJSON-1546074473-project] 10.222.0.43 "PUT /compute/v2.1/images/b3a4a26f-dcc5-4c5e-8faa-e21833e31668/metadata" status: 404 len: 62 microversion: 2.1 time: 0.037199 Oct 04 21:55:39.877685 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1405/2721] 10.222.0.43 () {60 vars in 1280 bytes} [Tue Oct 4 21:55:39 2022] PUT /compute/v2.1/images/b3a4a26f-dcc5-4c5e-8faa-e21833e31668/metadata => generated 62 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 21:55:39.900458 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-98c5432f-622c-4653-9c03-f5ee93081b03 tempest-ImagesMetadataNegativeTestJSON-1546074473 tempest-ImagesMetadataNegativeTestJSON-1546074473-project] Action: 'update', calling method: .version_select at 0x7fbb2efc0b80>, body: {"meta": {"os_distro": "alt"}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:55:39.935522 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-98c5432f-622c-4653-9c03-f5ee93081b03 tempest-ImagesMetadataNegativeTestJSON-1546074473 tempest-ImagesMetadataNegativeTestJSON-1546074473-project] HTTP exception thrown: Image not found. Oct 04 21:55:39.941523 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-98c5432f-622c-4653-9c03-f5ee93081b03 tempest-ImagesMetadataNegativeTestJSON-1546074473 tempest-ImagesMetadataNegativeTestJSON-1546074473-project] Request method failure captured: Oct 04 21:55:39.941523 n-d-860284-1 devstack@n-api.service[134102]: request: PUT /compute/v2.1/images/14760e0b-5637-4bae-9a20-032e57fcc371/metadata/os_distro HTTP/1.1 Oct 04 21:55:39.941523 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 21:55:39.941523 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 21:55:39.941523 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 21:55:39.941523 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 30 Oct 04 21:55:39.941523 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 21:55:39.941523 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 21:55:39.941523 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 21:55:39.941523 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 21:55:39.941523 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPKva4Sq4ryrJbTDkeOJ1fELRdG61LtchISbxe1ZiLkC18qGycK5oHbO7GturrlTYtJOXIhqaoul55Y4owjYm6oepJnfSlRkPP0N6oJsU5xAhnjtMha3WjF1DKSASKojAZMxvk9FSi-4C01pbyFGoDo9WvVzl58DV3TZ9-8EYqbC0uTA Oct 04 21:55:39.941523 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 21:55:39.941523 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 21:55:39.941523 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 21:55:39.941523 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 21:55:39.941523 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 21:55:39.941523 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 21:55:39.941523 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: 0607871278724c56934474161cc761a0 Oct 04 21:55:39.941523 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1546074473 Oct 04 21:55:39.941523 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 21:55:39.941523 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 21:55:39.941523 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0607871278724c56934474161cc761a0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_0607871278724c56934474161cc761a0", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0607871278724c56934474161cc761a0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/0607871278724c56934474161cc761a0"}]}] Oct 04 21:55:39.941523 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1546074473 Oct 04 21:55:39.941523 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: 0607871278724c56934474161cc761a0 Oct 04 21:55:39.941523 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1546074473 Oct 04 21:55:39.941523 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-ImagesMetadataNegativeTestJSON-1546074473-project Oct 04 21:55:39.941523 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 21:55:39.941523 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 21:55:39.941523 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: c0df6225e7bd42ae96cff1a76109075e Oct 04 21:55:39.941523 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1546074473-project Oct 04 21:55:39.941523 n-d-860284-1 devstack@n-api.service[134102]: Oct 04 21:55:39.941523 n-d-860284-1 devstack@n-api.service[134102]: {"meta": {"os_distro": "alt"}} Oct 04 21:55:39.941523 n-d-860284-1 devstack@n-api.service[134102]: method: Oct 04 21:55:39.941523 n-d-860284-1 devstack@n-api.service[134102]: exception: Image not found. Oct 04 21:55:39.941523 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'image_id': '14760e0b-5637-4bae-9a20-032e57fcc371', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} Oct 04 21:55:39.941523 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:55:39.941523 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:55:39.941523 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 21:55:39.941523 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 21:55:39.941523 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 21:55:39.941523 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 21:55:39.941523 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 21:55:39.941523 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 21:55:39.941523 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 21:55:39.941523 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 21:55:39.941523 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 21:55:39.941523 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 21:55:39.941523 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 21:55:39.941523 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 21:55:39.941523 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 21:55:39.941523 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 21:55:39.941523 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 21:55:39.941523 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 21:55:39.941523 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 14760e0b-5637-4bae-9a20-032e57fcc371 Oct 04 21:55:39.941523 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:55:39.941523 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:55:39.941523 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:55:39.941523 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:55:39.941523 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 04 21:55:39.941523 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 04 21:55:39.941523 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 04 21:55:39.941523 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 04 21:55:39.941523 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 04 21:55:39.941523 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 04 21:55:39.948448 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 04 21:55:39.948448 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 04 21:55:39.948448 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 21:55:39.948448 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 21:55:39.948448 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 21:55:39.948448 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 21:55:39.948448 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 21:55:39.948448 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 21:55:39.948448 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 21:55:39.948448 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 21:55:39.948448 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 21:55:39.948448 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 21:55:39.948448 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 21:55:39.948448 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 21:55:39.948448 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 21:55:39.948448 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 21:55:39.948448 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 21:55:39.948448 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 21:55:39.948448 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 14760e0b-5637-4bae-9a20-032e57fcc371 could not be found. Oct 04 21:55:39.948448 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:55:39.948448 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:55:39.948448 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:55:39.948448 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:55:39.948448 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:55:39.948448 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:55:39.948448 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:55:39.948448 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:55:39.948448 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:55:39.948448 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:55:39.948448 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:55:39.948448 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:55:39.948448 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:55:39.948448 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:55:39.948448 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update Oct 04 21:55:39.948448 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 04 21:55:39.948448 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 04 21:55:39.948448 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 04 21:55:39.948448 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 21:55:39.948448 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:55:39.948448 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:55:39.948448 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:55:39.948448 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:55:39.948448 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:55:39.948448 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:55:39.948448 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:55:39.948448 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:55:39.948448 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 21:55:39.948448 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:55:39.960228 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-98c5432f-622c-4653-9c03-f5ee93081b03 tempest-ImagesMetadataNegativeTestJSON-1546074473 tempest-ImagesMetadataNegativeTestJSON-1546074473-project] Returning 404 to user: Image not found. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:55:39.960228 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-98c5432f-622c-4653-9c03-f5ee93081b03 tempest-ImagesMetadataNegativeTestJSON-1546074473 tempest-ImagesMetadataNegativeTestJSON-1546074473-project] 10.222.0.43 "PUT /compute/v2.1/images/14760e0b-5637-4bae-9a20-032e57fcc371/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.073244 Oct 04 21:55:39.960228 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1406/2722] 10.222.0.43 () {60 vars in 1310 bytes} [Tue Oct 4 21:55:39 2022] PUT /compute/v2.1/images/14760e0b-5637-4bae-9a20-032e57fcc371/metadata/os_distro => generated 62 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 21:55:39.970220 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-88c12215-a33d-411a-8ffb-6c618148e7bf tempest-ImagesMetadataNegativeTestJSON-1546074473 tempest-ImagesMetadataNegativeTestJSON-1546074473-project] Action: 'create', calling method: .version_select at 0x7fbb2e70ed30>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:55:39.998602 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-88c12215-a33d-411a-8ffb-6c618148e7bf tempest-ImagesMetadataNegativeTestJSON-1546074473 tempest-ImagesMetadataNegativeTestJSON-1546074473-project] HTTP exception thrown: Image not found. Oct 04 21:55:40.001605 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-88c12215-a33d-411a-8ffb-6c618148e7bf tempest-ImagesMetadataNegativeTestJSON-1546074473 tempest-ImagesMetadataNegativeTestJSON-1546074473-project] Request method failure captured: Oct 04 21:55:40.001605 n-d-860284-1 devstack@n-api.service[134102]: request: POST /compute/v2.1/images/f5254d5b-f7df-44a0-b715-8c45fdd06d25/metadata HTTP/1.1 Oct 04 21:55:40.001605 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 21:55:40.001605 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 21:55:40.001605 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 21:55:40.001605 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 57 Oct 04 21:55:40.001605 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 21:55:40.001605 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 21:55:40.001605 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 21:55:40.001605 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 21:55:40.001605 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPKva4Sq4ryrJbTDkeOJ1fELRdG61LtchISbxe1ZiLkC18qGycK5oHbO7GturrlTYtJOXIhqaoul55Y4owjYm6oepJnfSlRkPP0N6oJsU5xAhnjtMha3WjF1DKSASKojAZMxvk9FSi-4C01pbyFGoDo9WvVzl58DV3TZ9-8EYqbC0uTA Oct 04 21:55:40.001605 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 21:55:40.001605 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 21:55:40.001605 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 21:55:40.001605 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 21:55:40.001605 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 21:55:40.001605 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 21:55:40.001605 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: 0607871278724c56934474161cc761a0 Oct 04 21:55:40.001605 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1546074473 Oct 04 21:55:40.001605 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 21:55:40.001605 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 21:55:40.001605 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0607871278724c56934474161cc761a0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_0607871278724c56934474161cc761a0", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0607871278724c56934474161cc761a0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/0607871278724c56934474161cc761a0"}]}] Oct 04 21:55:40.001605 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1546074473 Oct 04 21:55:40.001605 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: 0607871278724c56934474161cc761a0 Oct 04 21:55:40.001605 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1546074473 Oct 04 21:55:40.001605 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-ImagesMetadataNegativeTestJSON-1546074473-project Oct 04 21:55:40.001605 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 21:55:40.001605 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 21:55:40.001605 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: c0df6225e7bd42ae96cff1a76109075e Oct 04 21:55:40.001605 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1546074473-project Oct 04 21:55:40.001605 n-d-860284-1 devstack@n-api.service[134102]: Oct 04 21:55:40.001605 n-d-860284-1 devstack@n-api.service[134102]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Oct 04 21:55:40.001605 n-d-860284-1 devstack@n-api.service[134102]: method: Oct 04 21:55:40.001605 n-d-860284-1 devstack@n-api.service[134102]: exception: Image not found. Oct 04 21:55:40.001605 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'image_id': 'f5254d5b-f7df-44a0-b715-8c45fdd06d25', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Oct 04 21:55:40.001605 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:55:40.001605 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:55:40.001605 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 21:55:40.001605 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 21:55:40.001605 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 21:55:40.001605 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 21:55:40.001605 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 21:55:40.001605 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 21:55:40.001605 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 21:55:40.001605 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 21:55:40.001605 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 21:55:40.001605 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 21:55:40.001605 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 21:55:40.001605 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 21:55:40.001605 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 21:55:40.001605 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 21:55:40.001605 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 21:55:40.001605 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 21:55:40.001605 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID f5254d5b-f7df-44a0-b715-8c45fdd06d25 Oct 04 21:55:40.001605 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:55:40.001605 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:55:40.001605 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:55:40.001605 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:55:40.001605 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 04 21:55:40.001605 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 04 21:55:40.001605 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 04 21:55:40.001605 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 04 21:55:40.001605 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 04 21:55:40.005704 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 04 21:55:40.005704 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 04 21:55:40.005704 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 04 21:55:40.005704 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 21:55:40.005704 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 21:55:40.005704 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 21:55:40.005704 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 21:55:40.005704 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 21:55:40.005704 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 21:55:40.005704 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 21:55:40.005704 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 21:55:40.005704 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 21:55:40.005704 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 21:55:40.005704 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 21:55:40.005704 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 21:55:40.005704 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 21:55:40.005704 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 21:55:40.005704 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 21:55:40.005704 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 21:55:40.005704 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image f5254d5b-f7df-44a0-b715-8c45fdd06d25 could not be found. Oct 04 21:55:40.005704 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:55:40.005704 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:55:40.005704 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:55:40.005704 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:55:40.005704 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:55:40.005704 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:55:40.005704 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:55:40.005704 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:55:40.005704 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:55:40.005704 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:55:40.005704 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:55:40.005704 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:55:40.005704 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:55:40.005704 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:55:40.005704 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create Oct 04 21:55:40.005704 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 04 21:55:40.005704 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 04 21:55:40.005704 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 04 21:55:40.005704 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 21:55:40.005704 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:55:40.005704 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:55:40.005704 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:55:40.005704 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:55:40.005704 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:55:40.005704 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:55:40.005704 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:55:40.005704 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:55:40.005704 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 21:55:40.005704 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:55:40.005704 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-88c12215-a33d-411a-8ffb-6c618148e7bf tempest-ImagesMetadataNegativeTestJSON-1546074473 tempest-ImagesMetadataNegativeTestJSON-1546074473-project] Returning 404 to user: Image not found. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:55:40.012281 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-88c12215-a33d-411a-8ffb-6c618148e7bf tempest-ImagesMetadataNegativeTestJSON-1546074473 tempest-ImagesMetadataNegativeTestJSON-1546074473-project] 10.222.0.43 "POST /compute/v2.1/images/f5254d5b-f7df-44a0-b715-8c45fdd06d25/metadata" status: 404 len: 62 microversion: 2.1 time: 0.041151 Oct 04 21:55:40.012281 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1407/2723] 10.222.0.43 () {60 vars in 1281 bytes} [Tue Oct 4 21:55:39 2022] POST /compute/v2.1/images/f5254d5b-f7df-44a0-b715-8c45fdd06d25/metadata => generated 62 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 21:55:40.140010 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-b8e4f225-af6a-41dd-96bc-18a8f9a70bf0 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] 10.222.0.43 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 1.026001 Oct 04 21:55:40.141813 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1317/2724] 10.222.0.43 () {60 vars in 1180 bytes} [Tue Oct 4 21:55:39 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:55:40.159213 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-6862fec3-4505-429f-b013-7dfe0fe4845a tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Action: 'create', calling method: .version_select at 0x7fbb2e7098b0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-891339469", "description": "tempest-description-939745421"}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:55:40.784026 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-0dfad964-918b-4b49-9a97-8daaa3725817 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:55:40.785022 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-0dfad964-918b-4b49-9a97-8daaa3725817 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] [instance: a2e7312a-4e0d-4c47-b7c6-e1490a3f99d3] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:55:40.805111 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0dfad964-918b-4b49-9a97-8daaa3725817 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:40.805616 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0dfad964-918b-4b49-9a97-8daaa3725817 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:40.806400 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0dfad964-918b-4b49-9a97-8daaa3725817 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:40.807308 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0dfad964-918b-4b49-9a97-8daaa3725817 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:40.807971 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0dfad964-918b-4b49-9a97-8daaa3725817 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:40.808394 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0dfad964-918b-4b49-9a97-8daaa3725817 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:41.063645 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-6862fec3-4505-429f-b013-7dfe0fe4845a tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] 10.222.0.43 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.912445 Oct 04 21:55:41.065295 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1408/2725] 10.222.0.43 () {60 vars in 1180 bytes} [Tue Oct 4 21:55:40 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:55:41.087571 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-d3f3eddc-6353-40bd-a977-3e77437f1e69 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Calling method '.version_select at 0x7fbb2e7935e0>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:55:41.539471 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-0dfad964-918b-4b49-9a97-8daaa3725817 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47fbc4a6920d451cb1a2ad170de04921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43659cf5fed541e8883664bf17aced70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:55:41.557088 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-0dfad964-918b-4b49-9a97-8daaa3725817 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] 10.222.0.43 "GET /compute/v2.1/servers/a2e7312a-4e0d-4c47-b7c6-e1490a3f99d3" status: 200 len: 1507 microversion: 2.1 time: 0.776962 Oct 04 21:55:41.557604 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1318/2726] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:55:40 2022] GET /compute/v2.1/servers/a2e7312a-4e0d-4c47-b7c6-e1490a3f99d3 => generated 1507 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:55:42.510114 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-d3f3eddc-6353-40bd-a977-3e77437f1e69 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] 10.222.0.43 "GET /compute/v2.1/os-security-groups" status: 200 len: 1832 microversion: 2.1 time: 1.430521 Oct 04 21:55:42.512054 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1409/2727] 10.222.0.43 () {58 vars in 1158 bytes} [Tue Oct 4 21:55:41 2022] GET /compute/v2.1/os-security-groups => generated 1832 bytes in 1433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:55:42.532182 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e3e594e7-25a5-47f4-8622-59d4c516eba4 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Calling method '.version_select at 0x7fbb2ee88ca0>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:55:42.591999 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-1527ad81-50a7-43a5-967a-952581b9842a tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:55:42.592793 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-1527ad81-50a7-43a5-967a-952581b9842a tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] [instance: a2e7312a-4e0d-4c47-b7c6-e1490a3f99d3] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:55:42.600727 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=1 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:55:42.614040 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1527ad81-50a7-43a5-967a-952581b9842a tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:42.614903 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1527ad81-50a7-43a5-967a-952581b9842a tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:42.623552 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1527ad81-50a7-43a5-967a-952581b9842a tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:42.624489 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1527ad81-50a7-43a5-967a-952581b9842a tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:42.625170 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1527ad81-50a7-43a5-967a-952581b9842a tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:42.625860 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1527ad81-50a7-43a5-967a-952581b9842a tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:43.404086 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-1527ad81-50a7-43a5-967a-952581b9842a tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47fbc4a6920d451cb1a2ad170de04921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43659cf5fed541e8883664bf17aced70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:55:43.420139 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-1527ad81-50a7-43a5-967a-952581b9842a tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] 10.222.0.43 "GET /compute/v2.1/servers/a2e7312a-4e0d-4c47-b7c6-e1490a3f99d3" status: 200 len: 1507 microversion: 2.1 time: 0.830857 Oct 04 21:55:43.422214 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1410/2728] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:55:42 2022] GET /compute/v2.1/servers/a2e7312a-4e0d-4c47-b7c6-e1490a3f99d3 => generated 1507 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:55:43.881696 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-e3e594e7-25a5-47f4-8622-59d4c516eba4 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/a7384102-cc16-4c29-9014-1ed2bfbe85f5" status: 202 len: 0 microversion: 2.1 time: 1.356115 Oct 04 21:55:43.886665 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1319/2729] 10.222.0.43 () {58 vars in 1272 bytes} [Tue Oct 4 21:55:42 2022] DELETE /compute/v2.1/os-security-groups/a7384102-cc16-4c29-9014-1ed2bfbe85f5 => generated 0 bytes in 1362 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:55:43.907013 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-33d1ad67-25cc-4fcf-b795-9f7a53341826 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Calling method '.version_select at 0x7fbb2e769700>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:55:44.216649 n-d-860284-1 devstack@n-api.service[134102]: DEBUG neutronclient.v2_0.client [None req-33d1ad67-25cc-4fcf-b795-9f7a53341826 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group a7384102-cc16-4c29-9014-1ed2bfbe85f5 does not exist", "detail": ""}} {{(pid=134102) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 21:55:44.219272 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.network.security_group_api [None req-33d1ad67-25cc-4fcf-b795-9f7a53341826 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Neutron security group a7384102-cc16-4c29-9014-1ed2bfbe85f5 not found {{(pid=134102) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 04 21:55:44.222625 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-33d1ad67-25cc-4fcf-b795-9f7a53341826 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] HTTP exception thrown: Security group a7384102-cc16-4c29-9014-1ed2bfbe85f5 does not exist Oct 04 21:55:44.222625 n-d-860284-1 devstack@n-api.service[134102]: Neutron server returns request_ids: ['req-1d28fc28-d0cf-400c-ad29-66c79fd9aba8'] Oct 04 21:55:44.232722 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-33d1ad67-25cc-4fcf-b795-9f7a53341826 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Request method failure captured: Oct 04 21:55:44.232722 n-d-860284-1 devstack@n-api.service[134102]: request: GET /compute/v2.1/os-security-groups/a7384102-cc16-4c29-9014-1ed2bfbe85f5 HTTP/1.1 Oct 04 21:55:44.232722 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 21:55:44.232722 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 21:55:44.232722 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 21:55:44.232722 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 21:55:44.232722 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 21:55:44.232722 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 21:55:44.232722 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 21:55:44.232722 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 21:55:44.232722 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPKu1qJNzwuxRWdc7rP7w0gQHhoDMvT1hi4W6OphaRxhVehI7YxkRLmiRVTEcrGE4_kLVYYR9CLMgNAOGQEVIUg5ptFWtgovLZ1WXY_454sRPkZoUaMXWYK1EaSOxzAsp1QFRpLX6-NPmD2kPLhLIPCnWZqTYS8blSXJvj9wIhro38mc Oct 04 21:55:44.232722 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 21:55:44.232722 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 21:55:44.232722 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 21:55:44.232722 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 21:55:44.232722 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 21:55:44.232722 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 21:55:44.232722 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: 51745fc19321469bb20afabe48b2185d Oct 04 21:55:44.232722 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-SecurityGroupsTestJSON-367911468 Oct 04 21:55:44.232722 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 21:55:44.232722 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 21:55:44.232722 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/51745fc19321469bb20afabe48b2185d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_51745fc19321469bb20afabe48b2185d", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/51745fc19321469bb20afabe48b2185d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/51745fc19321469bb20afabe48b2185d"}]}] Oct 04 21:55:44.232722 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-SecurityGroupsTestJSON-367911468 Oct 04 21:55:44.232722 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: 51745fc19321469bb20afabe48b2185d Oct 04 21:55:44.232722 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-367911468 Oct 04 21:55:44.232722 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-SecurityGroupsTestJSON-367911468-project Oct 04 21:55:44.232722 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 21:55:44.232722 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 21:55:44.232722 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: 4cca65ba35b14db8bf2187188de8c838 Oct 04 21:55:44.232722 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-SecurityGroupsTestJSON-367911468-project Oct 04 21:55:44.232722 n-d-860284-1 devstack@n-api.service[134102]: method: Oct 04 21:55:44.232722 n-d-860284-1 devstack@n-api.service[134102]: exception: Security group a7384102-cc16-4c29-9014-1ed2bfbe85f5 does not exist Oct 04 21:55:44.232722 n-d-860284-1 devstack@n-api.service[134102]: Neutron server returns request_ids: ['req-1d28fc28-d0cf-400c-ad29-66c79fd9aba8'] Oct 04 21:55:44.232722 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': 'a7384102-cc16-4c29-9014-1ed2bfbe85f5'} Oct 04 21:55:44.232722 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:55:44.232722 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:55:44.232722 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 04 21:55:44.232722 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 04 21:55:44.232722 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:55:44.232722 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:55:44.232722 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 04 21:55:44.232722 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 04 21:55:44.232722 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:55:44.232722 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:55:44.232722 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 21:55:44.232722 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 21:55:44.232722 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:55:44.232722 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:55:44.232722 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 21:55:44.232722 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 21:55:44.232722 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:55:44.232722 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:55:44.232722 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 21:55:44.232722 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 21:55:44.232722 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:55:44.232722 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:55:44.232722 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 21:55:44.232722 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 21:55:44.232722 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 21:55:44.232722 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 21:55:44.232722 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group a7384102-cc16-4c29-9014-1ed2bfbe85f5 does not exist Oct 04 21:55:44.245637 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1d28fc28-d0cf-400c-ad29-66c79fd9aba8'] Oct 04 21:55:44.245637 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:55:44.245637 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:55:44.245637 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:55:44.245637 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:55:44.245637 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 04 21:55:44.245637 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 04 21:55:44.245637 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 04 21:55:44.245637 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 21:55:44.245637 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group a7384102-cc16-4c29-9014-1ed2bfbe85f5 does not exist Oct 04 21:55:44.245637 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1d28fc28-d0cf-400c-ad29-66c79fd9aba8'] Oct 04 21:55:44.245637 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:55:44.245637 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:55:44.245637 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:55:44.245637 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:55:44.245637 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:55:44.245637 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:55:44.245637 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:55:44.245637 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:55:44.245637 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:55:44.245637 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:55:44.245637 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:55:44.245637 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:55:44.245637 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 04 21:55:44.245637 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 21:55:44.245637 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group a7384102-cc16-4c29-9014-1ed2bfbe85f5 does not exist Oct 04 21:55:44.245637 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1d28fc28-d0cf-400c-ad29-66c79fd9aba8'] Oct 04 21:55:44.245637 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:55:44.245637 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:55:44.245637 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:55:44.245637 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:55:44.245637 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:55:44.245637 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:55:44.245637 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:55:44.245637 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:55:44.245637 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group a7384102-cc16-4c29-9014-1ed2bfbe85f5 does not exist Oct 04 21:55:44.245637 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1d28fc28-d0cf-400c-ad29-66c79fd9aba8'] Oct 04 21:55:44.245637 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:55:44.260229 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-33d1ad67-25cc-4fcf-b795-9f7a53341826 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Returning 404 to user: Security group a7384102-cc16-4c29-9014-1ed2bfbe85f5 does not exist Oct 04 21:55:44.260229 n-d-860284-1 devstack@n-api.service[134102]: Neutron server returns request_ids: ['req-1d28fc28-d0cf-400c-ad29-66c79fd9aba8'] {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:55:44.262817 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-33d1ad67-25cc-4fcf-b795-9f7a53341826 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] 10.222.0.43 "GET /compute/v2.1/os-security-groups/a7384102-cc16-4c29-9014-1ed2bfbe85f5" status: 404 len: 194 microversion: 2.1 time: 0.359201 Oct 04 21:55:44.265722 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1411/2730] 10.222.0.43 () {58 vars in 1269 bytes} [Tue Oct 4 21:55:43 2022] GET /compute/v2.1/os-security-groups/a7384102-cc16-4c29-9014-1ed2bfbe85f5 => generated 194 bytes in 379 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:55:44.285879 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-ae9d69b5-f802-4b9b-a80b-70403e0abb1a tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Calling method '.version_select at 0x7fbb2e626550>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:55:44.455577 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-7bdb8652-27b9-47c3-bda1-5d945e251710 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:55:44.464374 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-7bdb8652-27b9-47c3-bda1-5d945e251710 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] [instance: a2e7312a-4e0d-4c47-b7c6-e1490a3f99d3] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:55:44.518032 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7bdb8652-27b9-47c3-bda1-5d945e251710 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:44.524338 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7bdb8652-27b9-47c3-bda1-5d945e251710 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:44.526945 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7bdb8652-27b9-47c3-bda1-5d945e251710 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:44.533168 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7bdb8652-27b9-47c3-bda1-5d945e251710 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:44.539754 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7bdb8652-27b9-47c3-bda1-5d945e251710 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:44.541005 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7bdb8652-27b9-47c3-bda1-5d945e251710 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:44.848100 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-7bdb8652-27b9-47c3-bda1-5d945e251710 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47fbc4a6920d451cb1a2ad170de04921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43659cf5fed541e8883664bf17aced70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:55:44.880880 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-7bdb8652-27b9-47c3-bda1-5d945e251710 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] 10.222.0.43 "GET /compute/v2.1/servers/a2e7312a-4e0d-4c47-b7c6-e1490a3f99d3" status: 200 len: 1465 microversion: 2.1 time: 0.438894 Oct 04 21:55:44.885070 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1412/2731] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:55:44 2022] GET /compute/v2.1/servers/a2e7312a-4e0d-4c47-b7c6-e1490a3f99d3 => generated 1465 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:55:45.175331 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-9489d25e-252e-449e-8d77-52ec1deeac5f tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-369867274", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452"}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:55:45.304363 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.network.neutron [None req-9489d25e-252e-449e-8d77-52ec1deeac5f tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] validate_networks() for None {{(pid=134102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:55:46.094475 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-ae9d69b5-f802-4b9b-a80b-70403e0abb1a tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/b9ec5d23-5d81-4cb1-b576-e917a2986031" status: 202 len: 0 microversion: 2.1 time: 1.819880 Oct 04 21:55:46.104133 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1320/2732] 10.222.0.43 () {58 vars in 1272 bytes} [Tue Oct 4 21:55:44 2022] DELETE /compute/v2.1/os-security-groups/b9ec5d23-5d81-4cb1-b576-e917a2986031 => generated 0 bytes in 1823 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:55:46.159080 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-398f2eb3-ba11-42b7-b54e-92267adeb13d req-1c90ae78-ff94-4c7a-81c4-41e31a626707 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2e7312a-4e0d-4c47-b7c6-e1490a3f99d3", "name": "network-vif-deleted", "tag": "84329f78-5a5f-4079-a6af-5e53311debfa"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:55:46.177268 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:55:46.223474 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-398f2eb3-ba11-42b7-b54e-92267adeb13d req-1c90ae78-ff94-4c7a-81c4-41e31a626707 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:46.224369 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-398f2eb3-ba11-42b7-b54e-92267adeb13d req-1c90ae78-ff94-4c7a-81c4-41e31a626707 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:46.225387 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-398f2eb3-ba11-42b7-b54e-92267adeb13d req-1c90ae78-ff94-4c7a-81c4-41e31a626707 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:46.250845 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-398f2eb3-ba11-42b7-b54e-92267adeb13d req-1c90ae78-ff94-4c7a-81c4-41e31a626707 service nova] Creating event network-vif-deleted:84329f78-5a5f-4079-a6af-5e53311debfa for instance a2e7312a-4e0d-4c47-b7c6-e1490a3f99d3 on n-h2-860284-1 Oct 04 21:55:46.277852 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-398f2eb3-ba11-42b7-b54e-92267adeb13d req-1c90ae78-ff94-4c7a-81c4-41e31a626707 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.172046 Oct 04 21:55:46.282636 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1321/2733] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:55:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:55:46.300971 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-04ae7df8-bd81-4ed6-be73-33d88e040bc6 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:55:46.302564 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-04ae7df8-bd81-4ed6-be73-33d88e040bc6 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] [instance: a2e7312a-4e0d-4c47-b7c6-e1490a3f99d3] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:55:46.315568 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-04ae7df8-bd81-4ed6-be73-33d88e040bc6 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:46.316955 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-04ae7df8-bd81-4ed6-be73-33d88e040bc6 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:46.321813 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-04ae7df8-bd81-4ed6-be73-33d88e040bc6 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:46.323414 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-04ae7df8-bd81-4ed6-be73-33d88e040bc6 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:46.327187 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-04ae7df8-bd81-4ed6-be73-33d88e040bc6 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:46.327889 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-04ae7df8-bd81-4ed6-be73-33d88e040bc6 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:46.356324 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-04ae7df8-bd81-4ed6-be73-33d88e040bc6 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] HTTP exception thrown: Instance a2e7312a-4e0d-4c47-b7c6-e1490a3f99d3 could not be found. Oct 04 21:55:46.358454 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-04ae7df8-bd81-4ed6-be73-33d88e040bc6 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Request method failure captured: Oct 04 21:55:46.358454 n-d-860284-1 devstack@n-api.service[134101]: request: GET /compute/v2.1/servers/a2e7312a-4e0d-4c47-b7c6-e1490a3f99d3 HTTP/1.1 Oct 04 21:55:46.358454 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 21:55:46.358454 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 21:55:46.358454 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 21:55:46.358454 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 21:55:46.358454 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 21:55:46.358454 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 21:55:46.358454 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 21:55:46.358454 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 21:55:46.358454 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPKtYopP8HDKXJZRcqCeswWNVLaWLaidz1OAW6yn0_RDqastM34kGrGuin0BKHDO8BPfc8_-bf0pCmHXKhYPCZ8ir53M9rqZXj9vPCFlwdHhyg1bLP4T7-aGT-bDoQyUmCSYJkgjep8fovlvsZrZUDrra7cR10iuKriN3BEpTWrU9_Eo Oct 04 21:55:46.358454 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 21:55:46.358454 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 21:55:46.358454 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 21:55:46.358454 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 21:55:46.358454 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 21:55:46.358454 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 21:55:46.358454 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: 43659cf5fed541e8883664bf17aced70 Oct 04 21:55:46.358454 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-ServerRescueTestJSON-1796524375 Oct 04 21:55:46.358454 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 21:55:46.358454 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 21:55:46.358454 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/43659cf5fed541e8883664bf17aced70"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_43659cf5fed541e8883664bf17aced70", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/43659cf5fed541e8883664bf17aced70"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/43659cf5fed541e8883664bf17aced70"}]}] Oct 04 21:55:46.358454 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-ServerRescueTestJSON-1796524375 Oct 04 21:55:46.358454 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: 43659cf5fed541e8883664bf17aced70 Oct 04 21:55:46.358454 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-ServerRescueTestJSON-1796524375 Oct 04 21:55:46.358454 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-ServerRescueTestJSON-1796524375-project Oct 04 21:55:46.358454 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 21:55:46.358454 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 21:55:46.358454 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 47fbc4a6920d451cb1a2ad170de04921 Oct 04 21:55:46.358454 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-ServerRescueTestJSON-1796524375-project Oct 04 21:55:46.358454 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 21:55:46.358454 n-d-860284-1 devstack@n-api.service[134101]: exception: Instance a2e7312a-4e0d-4c47-b7c6-e1490a3f99d3 could not be found. Oct 04 21:55:46.358454 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': 'a2e7312a-4e0d-4c47-b7c6-e1490a3f99d3'} Oct 04 21:55:46.358454 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:55:46.358454 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:55:46.358454 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:55:46.358454 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:55:46.358454 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:55:46.358454 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:55:46.358454 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:55:46.358454 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:55:46.358454 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:55:46.358454 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:55:46.358454 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2e7312a-4e0d-4c47-b7c6-e1490a3f99d3 could not be found. Oct 04 21:55:46.358454 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:55:46.358454 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:55:46.358454 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:55:46.358454 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:55:46.358454 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:55:46.358454 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:55:46.358454 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:55:46.358454 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:55:46.358454 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:55:46.358454 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:55:46.358454 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:55:46.358454 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:55:46.358454 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:55:46.358454 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:55:46.358454 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:55:46.358454 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:55:46.358454 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2e7312a-4e0d-4c47-b7c6-e1490a3f99d3 could not be found. Oct 04 21:55:46.358454 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:55:46.358454 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:55:46.358454 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:55:46.365082 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:55:46.365082 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:55:46.365082 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:55:46.365082 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:55:46.365082 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:55:46.365082 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2e7312a-4e0d-4c47-b7c6-e1490a3f99d3 could not be found. Oct 04 21:55:46.365082 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:55:46.365082 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-04ae7df8-bd81-4ed6-be73-33d88e040bc6 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Returning 404 to user: Instance a2e7312a-4e0d-4c47-b7c6-e1490a3f99d3 could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:55:46.365082 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-04ae7df8-bd81-4ed6-be73-33d88e040bc6 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] 10.222.0.43 "GET /compute/v2.1/servers/a2e7312a-4e0d-4c47-b7c6-e1490a3f99d3" status: 404 len: 111 microversion: 2.1 time: 0.070552 Oct 04 21:55:46.365082 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1322/2734] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:55:46 2022] GET /compute/v2.1/servers/a2e7312a-4e0d-4c47-b7c6-e1490a3f99d3 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:55:46.377221 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-93fa1947-3056-4bc8-a77a-4dab682f938f tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Calling method '.version_select at 0x7fbb3727aee0>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:55:46.462112 n-d-860284-1 devstack@n-api.service[134101]: DEBUG neutronclient.v2_0.client [None req-93fa1947-3056-4bc8-a77a-4dab682f938f tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group b9ec5d23-5d81-4cb1-b576-e917a2986031 does not exist", "detail": ""}} {{(pid=134101) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 21:55:46.463227 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.network.security_group_api [None req-93fa1947-3056-4bc8-a77a-4dab682f938f tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Neutron security group b9ec5d23-5d81-4cb1-b576-e917a2986031 not found {{(pid=134101) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 04 21:55:46.464308 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-93fa1947-3056-4bc8-a77a-4dab682f938f tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] HTTP exception thrown: Security group b9ec5d23-5d81-4cb1-b576-e917a2986031 does not exist Oct 04 21:55:46.464308 n-d-860284-1 devstack@n-api.service[134101]: Neutron server returns request_ids: ['req-9942bcaa-b1a5-4477-8c05-10090728a425'] Oct 04 21:55:46.467805 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-93fa1947-3056-4bc8-a77a-4dab682f938f tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Request method failure captured: Oct 04 21:55:46.467805 n-d-860284-1 devstack@n-api.service[134101]: request: GET /compute/v2.1/os-security-groups/b9ec5d23-5d81-4cb1-b576-e917a2986031 HTTP/1.1 Oct 04 21:55:46.467805 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 21:55:46.467805 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 21:55:46.467805 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 21:55:46.467805 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 21:55:46.467805 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 21:55:46.467805 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 21:55:46.467805 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 21:55:46.467805 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 21:55:46.467805 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPKu1qJNzwuxRWdc7rP7w0gQHhoDMvT1hi4W6OphaRxhVehI7YxkRLmiRVTEcrGE4_kLVYYR9CLMgNAOGQEVIUg5ptFWtgovLZ1WXY_454sRPkZoUaMXWYK1EaSOxzAsp1QFRpLX6-NPmD2kPLhLIPCnWZqTYS8blSXJvj9wIhro38mc Oct 04 21:55:46.467805 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 21:55:46.467805 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 21:55:46.467805 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 21:55:46.467805 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 21:55:46.467805 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 21:55:46.467805 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 21:55:46.467805 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: 51745fc19321469bb20afabe48b2185d Oct 04 21:55:46.467805 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-SecurityGroupsTestJSON-367911468 Oct 04 21:55:46.467805 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 21:55:46.467805 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 21:55:46.467805 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/51745fc19321469bb20afabe48b2185d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_51745fc19321469bb20afabe48b2185d", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/51745fc19321469bb20afabe48b2185d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/51745fc19321469bb20afabe48b2185d"}]}] Oct 04 21:55:46.467805 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-SecurityGroupsTestJSON-367911468 Oct 04 21:55:46.467805 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: 51745fc19321469bb20afabe48b2185d Oct 04 21:55:46.467805 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-367911468 Oct 04 21:55:46.467805 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-SecurityGroupsTestJSON-367911468-project Oct 04 21:55:46.467805 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 21:55:46.467805 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 21:55:46.467805 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 4cca65ba35b14db8bf2187188de8c838 Oct 04 21:55:46.467805 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-SecurityGroupsTestJSON-367911468-project Oct 04 21:55:46.467805 n-d-860284-1 devstack@n-api.service[134101]: method: Oct 04 21:55:46.467805 n-d-860284-1 devstack@n-api.service[134101]: exception: Security group b9ec5d23-5d81-4cb1-b576-e917a2986031 does not exist Oct 04 21:55:46.467805 n-d-860284-1 devstack@n-api.service[134101]: Neutron server returns request_ids: ['req-9942bcaa-b1a5-4477-8c05-10090728a425'] Oct 04 21:55:46.467805 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': 'b9ec5d23-5d81-4cb1-b576-e917a2986031'} Oct 04 21:55:46.467805 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:55:46.467805 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:55:46.467805 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 04 21:55:46.467805 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 04 21:55:46.467805 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:55:46.467805 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:55:46.467805 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 04 21:55:46.467805 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 04 21:55:46.467805 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:55:46.467805 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:55:46.467805 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 21:55:46.467805 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 21:55:46.467805 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:55:46.467805 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:55:46.467805 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 21:55:46.467805 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 21:55:46.467805 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:55:46.467805 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:55:46.467805 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 21:55:46.467805 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 21:55:46.467805 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:55:46.467805 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:55:46.467805 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 21:55:46.467805 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 21:55:46.467805 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 21:55:46.467805 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 21:55:46.467805 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group b9ec5d23-5d81-4cb1-b576-e917a2986031 does not exist Oct 04 21:55:46.472416 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9942bcaa-b1a5-4477-8c05-10090728a425'] Oct 04 21:55:46.472416 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:55:46.472416 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:55:46.472416 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:55:46.472416 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:55:46.472416 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 04 21:55:46.472416 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 04 21:55:46.472416 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 04 21:55:46.472416 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 21:55:46.472416 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group b9ec5d23-5d81-4cb1-b576-e917a2986031 does not exist Oct 04 21:55:46.472416 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9942bcaa-b1a5-4477-8c05-10090728a425'] Oct 04 21:55:46.472416 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:55:46.472416 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:55:46.472416 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:55:46.472416 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:55:46.472416 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:55:46.472416 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:55:46.472416 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:55:46.472416 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:55:46.472416 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:55:46.472416 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:55:46.472416 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:55:46.472416 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:55:46.472416 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 04 21:55:46.472416 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 21:55:46.472416 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group b9ec5d23-5d81-4cb1-b576-e917a2986031 does not exist Oct 04 21:55:46.472416 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9942bcaa-b1a5-4477-8c05-10090728a425'] Oct 04 21:55:46.472416 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:55:46.472416 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:55:46.472416 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:55:46.472416 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:55:46.472416 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:55:46.472416 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:55:46.472416 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:55:46.472416 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:55:46.472416 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group b9ec5d23-5d81-4cb1-b576-e917a2986031 does not exist Oct 04 21:55:46.472416 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9942bcaa-b1a5-4477-8c05-10090728a425'] Oct 04 21:55:46.472416 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:55:46.477620 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-93fa1947-3056-4bc8-a77a-4dab682f938f tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Returning 404 to user: Security group b9ec5d23-5d81-4cb1-b576-e917a2986031 does not exist Oct 04 21:55:46.477620 n-d-860284-1 devstack@n-api.service[134101]: Neutron server returns request_ids: ['req-9942bcaa-b1a5-4477-8c05-10090728a425'] {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:55:46.481254 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-93fa1947-3056-4bc8-a77a-4dab682f938f tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] 10.222.0.43 "GET /compute/v2.1/os-security-groups/b9ec5d23-5d81-4cb1-b576-e917a2986031" status: 404 len: 194 microversion: 2.1 time: 0.114604 Oct 04 21:55:46.482254 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1323/2735] 10.222.0.43 () {58 vars in 1269 bytes} [Tue Oct 4 21:55:46 2022] GET /compute/v2.1/os-security-groups/b9ec5d23-5d81-4cb1-b576-e917a2986031 => generated 194 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:55:46.493621 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e90117e7-655b-42e7-8cc3-2f83c90f3f2c tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:55:46.494897 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-e90117e7-655b-42e7-8cc3-2f83c90f3f2c tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] [instance: eb6e098d-966d-478b-a69c-3746584e5509] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:55:46.523253 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e90117e7-655b-42e7-8cc3-2f83c90f3f2c tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:46.524397 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e90117e7-655b-42e7-8cc3-2f83c90f3f2c tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:46.525136 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e90117e7-655b-42e7-8cc3-2f83c90f3f2c tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:46.528405 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e90117e7-655b-42e7-8cc3-2f83c90f3f2c tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:46.531041 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e90117e7-655b-42e7-8cc3-2f83c90f3f2c tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:46.531856 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e90117e7-655b-42e7-8cc3-2f83c90f3f2c tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:46.615907 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-e90117e7-655b-42e7-8cc3-2f83c90f3f2c tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] [instance: eb6e098d-966d-478b-a69c-3746584e5509] Going to try to terminate instance {{(pid=134101) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:55:46.822261 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-e90117e7-655b-42e7-8cc3-2f83c90f3f2c tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] 10.222.0.43 "DELETE /compute/v2.1/servers/eb6e098d-966d-478b-a69c-3746584e5509" status: 204 len: 0 microversion: 2.1 time: 0.337498 Oct 04 21:55:46.824072 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1324/2736] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 21:55:46 2022] DELETE /compute/v2.1/servers/eb6e098d-966d-478b-a69c-3746584e5509 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:55:46.830177 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-b62813f3-3140-4879-b415-d1f4a681f6bf tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Calling method '.version_select at 0x7fbb2e6cb940>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:55:46.910638 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-9489d25e-252e-449e-8d77-52ec1deeac5f tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Flavor limits 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:55:46.912801 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-9489d25e-252e-449e-8d77-52ec1deeac5f tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Image limits 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:55:46.913656 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-9489d25e-252e-449e-8d77-52ec1deeac5f tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Flavor pref 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:55:46.914279 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-9489d25e-252e-449e-8d77-52ec1deeac5f tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Image pref 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:55:46.915057 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-9489d25e-252e-449e-8d77-52ec1deeac5f tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:55:46.932012 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9489d25e-252e-449e-8d77-52ec1deeac5f tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:46.934623 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9489d25e-252e-449e-8d77-52ec1deeac5f tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:46.935364 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9489d25e-252e-449e-8d77-52ec1deeac5f tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:46.936435 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9489d25e-252e-449e-8d77-52ec1deeac5f tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:46.938641 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9489d25e-252e-449e-8d77-52ec1deeac5f tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:46.939297 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9489d25e-252e-449e-8d77-52ec1deeac5f tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:46.979942 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-9489d25e-252e-449e-8d77-52ec1deeac5f tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Getting quotas for project 520782b7e0a94e3fb552744cc4584119. Resources: {'instances', 'ram', 'cores'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:55:47.003441 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-9489d25e-252e-449e-8d77-52ec1deeac5f tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Getting quotas for user 7b45ebdb946b45c28fc4bca3dd5a3e5b and project 520782b7e0a94e3fb552744cc4584119. Resources: {'instances', 'ram', 'cores'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:55:47.038209 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-9489d25e-252e-449e-8d77-52ec1deeac5f tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Going to run 1 instances... {{(pid=134102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:55:47.043624 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-9489d25e-252e-449e-8d77-52ec1deeac5f tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] [instance: 4b3f3cb9-cdd4-4881-923f-bb3447b249b9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='58548514-5dac-426c-81f5-19e3fba33e23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:55:47.169899 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-9489d25e-252e-449e-8d77-52ec1deeac5f tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.282748 Oct 04 21:55:47.173772 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1413/2737] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 21:55:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 2287 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:55:47.180209 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-6e46c908-56f2-42c2-bcbd-a6e731de9350 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:55:47.181355 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-6e46c908-56f2-42c2-bcbd-a6e731de9350 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] [instance: eb6e098d-966d-478b-a69c-3746584e5509] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:55:47.188187 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6e46c908-56f2-42c2-bcbd-a6e731de9350 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:47.189491 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6e46c908-56f2-42c2-bcbd-a6e731de9350 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:47.190129 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6e46c908-56f2-42c2-bcbd-a6e731de9350 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:47.191334 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6e46c908-56f2-42c2-bcbd-a6e731de9350 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:47.193158 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6e46c908-56f2-42c2-bcbd-a6e731de9350 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:47.194061 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6e46c908-56f2-42c2-bcbd-a6e731de9350 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:47.611349 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-6e46c908-56f2-42c2-bcbd-a6e731de9350 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47fbc4a6920d451cb1a2ad170de04921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43659cf5fed541e8883664bf17aced70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:55:47.632308 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-6e46c908-56f2-42c2-bcbd-a6e731de9350 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] 10.222.0.43 "GET /compute/v2.1/servers/eb6e098d-966d-478b-a69c-3746584e5509" status: 200 len: 1492 microversion: 2.1 time: 0.455572 Oct 04 21:55:47.633644 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1414/2738] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:55:47 2022] GET /compute/v2.1/servers/eb6e098d-966d-478b-a69c-3746584e5509 => generated 1492 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:55:47.640528 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-2b078bda-e428-4de4-864f-7bb29aef54ff tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:55:47.641471 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-2b078bda-e428-4de4-864f-7bb29aef54ff tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] [instance: 4b3f3cb9-cdd4-4881-923f-bb3447b249b9] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:55:47.726679 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-2b078bda-e428-4de4-864f-7bb29aef54ff tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b45ebdb946b45c28fc4bca3dd5a3e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520782b7e0a94e3fb552744cc4584119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:55:47.735357 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-2b078bda-e428-4de4-864f-7bb29aef54ff tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] 10.222.0.43 "GET /compute/v2.1/servers/4b3f3cb9-cdd4-4881-923f-bb3447b249b9" status: 200 len: 1218 microversion: 2.1 time: 0.100227 Oct 04 21:55:47.736029 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1415/2739] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:55:47 2022] GET /compute/v2.1/servers/4b3f3cb9-cdd4-4881-923f-bb3447b249b9 => generated 1218 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:55:47.798888 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-b62813f3-3140-4879-b415-d1f4a681f6bf tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/c1c7c16c-681f-40b3-a40e-7ed02207c2dd" status: 202 len: 0 microversion: 2.1 time: 0.973183 Oct 04 21:55:47.799558 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1325/2740] 10.222.0.43 () {58 vars in 1272 bytes} [Tue Oct 4 21:55:46 2022] DELETE /compute/v2.1/os-security-groups/c1c7c16c-681f-40b3-a40e-7ed02207c2dd => generated 0 bytes in 975 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:55:47.810459 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-d8d62fe5-fca8-4d93-8400-8a5e50095aca tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Calling method '.version_select at 0x7fbb2e7691f0>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:55:47.873826 n-d-860284-1 devstack@n-api.service[134102]: DEBUG neutronclient.v2_0.client [None req-d8d62fe5-fca8-4d93-8400-8a5e50095aca tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group c1c7c16c-681f-40b3-a40e-7ed02207c2dd does not exist", "detail": ""}} {{(pid=134102) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 21:55:47.875401 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.network.security_group_api [None req-d8d62fe5-fca8-4d93-8400-8a5e50095aca tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Neutron security group c1c7c16c-681f-40b3-a40e-7ed02207c2dd not found {{(pid=134102) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 04 21:55:47.876612 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-d8d62fe5-fca8-4d93-8400-8a5e50095aca tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] HTTP exception thrown: Security group c1c7c16c-681f-40b3-a40e-7ed02207c2dd does not exist Oct 04 21:55:47.876612 n-d-860284-1 devstack@n-api.service[134102]: Neutron server returns request_ids: ['req-1d1ee40a-6eda-4bdd-9f72-7d860e78434f'] Oct 04 21:55:47.880852 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-d8d62fe5-fca8-4d93-8400-8a5e50095aca tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Request method failure captured: Oct 04 21:55:47.880852 n-d-860284-1 devstack@n-api.service[134102]: request: GET /compute/v2.1/os-security-groups/c1c7c16c-681f-40b3-a40e-7ed02207c2dd HTTP/1.1 Oct 04 21:55:47.880852 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 21:55:47.880852 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 21:55:47.880852 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 21:55:47.880852 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 21:55:47.880852 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 21:55:47.880852 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 21:55:47.880852 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 21:55:47.880852 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 21:55:47.880852 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPKu1qJNzwuxRWdc7rP7w0gQHhoDMvT1hi4W6OphaRxhVehI7YxkRLmiRVTEcrGE4_kLVYYR9CLMgNAOGQEVIUg5ptFWtgovLZ1WXY_454sRPkZoUaMXWYK1EaSOxzAsp1QFRpLX6-NPmD2kPLhLIPCnWZqTYS8blSXJvj9wIhro38mc Oct 04 21:55:47.880852 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 21:55:47.880852 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 21:55:47.880852 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 21:55:47.880852 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 21:55:47.880852 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 21:55:47.880852 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 21:55:47.880852 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: 51745fc19321469bb20afabe48b2185d Oct 04 21:55:47.880852 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-SecurityGroupsTestJSON-367911468 Oct 04 21:55:47.880852 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 21:55:47.880852 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 21:55:47.880852 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/51745fc19321469bb20afabe48b2185d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_51745fc19321469bb20afabe48b2185d", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/51745fc19321469bb20afabe48b2185d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/51745fc19321469bb20afabe48b2185d"}]}] Oct 04 21:55:47.880852 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-SecurityGroupsTestJSON-367911468 Oct 04 21:55:47.880852 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: 51745fc19321469bb20afabe48b2185d Oct 04 21:55:47.880852 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-367911468 Oct 04 21:55:47.880852 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-SecurityGroupsTestJSON-367911468-project Oct 04 21:55:47.880852 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 21:55:47.880852 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 21:55:47.880852 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: 4cca65ba35b14db8bf2187188de8c838 Oct 04 21:55:47.880852 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-SecurityGroupsTestJSON-367911468-project Oct 04 21:55:47.880852 n-d-860284-1 devstack@n-api.service[134102]: method: Oct 04 21:55:47.880852 n-d-860284-1 devstack@n-api.service[134102]: exception: Security group c1c7c16c-681f-40b3-a40e-7ed02207c2dd does not exist Oct 04 21:55:47.880852 n-d-860284-1 devstack@n-api.service[134102]: Neutron server returns request_ids: ['req-1d1ee40a-6eda-4bdd-9f72-7d860e78434f'] Oct 04 21:55:47.880852 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': 'c1c7c16c-681f-40b3-a40e-7ed02207c2dd'} Oct 04 21:55:47.880852 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:55:47.880852 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:55:47.880852 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 04 21:55:47.880852 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 04 21:55:47.880852 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:55:47.880852 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:55:47.880852 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 04 21:55:47.880852 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 04 21:55:47.880852 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:55:47.880852 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:55:47.880852 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 21:55:47.880852 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 21:55:47.880852 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:55:47.880852 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:55:47.880852 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 21:55:47.880852 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 21:55:47.880852 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:55:47.880852 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:55:47.880852 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 21:55:47.880852 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 21:55:47.880852 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:55:47.880852 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:55:47.880852 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 21:55:47.880852 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 21:55:47.880852 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 21:55:47.880852 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 21:55:47.880852 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group c1c7c16c-681f-40b3-a40e-7ed02207c2dd does not exist Oct 04 21:55:47.885780 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1d1ee40a-6eda-4bdd-9f72-7d860e78434f'] Oct 04 21:55:47.885780 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:55:47.885780 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:55:47.885780 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:55:47.885780 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:55:47.885780 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 04 21:55:47.885780 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 04 21:55:47.885780 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 04 21:55:47.885780 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 21:55:47.885780 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group c1c7c16c-681f-40b3-a40e-7ed02207c2dd does not exist Oct 04 21:55:47.885780 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1d1ee40a-6eda-4bdd-9f72-7d860e78434f'] Oct 04 21:55:47.885780 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:55:47.885780 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:55:47.885780 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:55:47.885780 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:55:47.885780 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:55:47.885780 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:55:47.885780 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:55:47.885780 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:55:47.885780 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:55:47.885780 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:55:47.885780 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:55:47.885780 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:55:47.885780 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 04 21:55:47.885780 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 21:55:47.885780 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group c1c7c16c-681f-40b3-a40e-7ed02207c2dd does not exist Oct 04 21:55:47.885780 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1d1ee40a-6eda-4bdd-9f72-7d860e78434f'] Oct 04 21:55:47.885780 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:55:47.885780 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:55:47.885780 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:55:47.885780 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:55:47.885780 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:55:47.885780 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:55:47.885780 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:55:47.885780 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:55:47.885780 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group c1c7c16c-681f-40b3-a40e-7ed02207c2dd does not exist Oct 04 21:55:47.885780 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1d1ee40a-6eda-4bdd-9f72-7d860e78434f'] Oct 04 21:55:47.885780 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:55:47.890051 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-d8d62fe5-fca8-4d93-8400-8a5e50095aca tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Returning 404 to user: Security group c1c7c16c-681f-40b3-a40e-7ed02207c2dd does not exist Oct 04 21:55:47.890051 n-d-860284-1 devstack@n-api.service[134102]: Neutron server returns request_ids: ['req-1d1ee40a-6eda-4bdd-9f72-7d860e78434f'] {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:55:47.891419 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-d8d62fe5-fca8-4d93-8400-8a5e50095aca tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] 10.222.0.43 "GET /compute/v2.1/os-security-groups/c1c7c16c-681f-40b3-a40e-7ed02207c2dd" status: 404 len: 194 microversion: 2.1 time: 0.086484 Oct 04 21:55:47.902647 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-15a18cb3-b5e7-4297-92b0-e65f8da73895 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Calling method '.version_select at 0x7fbb2ed0a430>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:55:47.919007 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1416/2741] 10.222.0.43 () {58 vars in 1269 bytes} [Tue Oct 4 21:55:47 2022] GET /compute/v2.1/os-security-groups/c1c7c16c-681f-40b3-a40e-7ed02207c2dd => generated 194 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:55:48.409289 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-15a18cb3-b5e7-4297-92b0-e65f8da73895 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] 10.222.0.43 "GET /compute/v2.1/os-security-groups" status: 200 len: 1158 microversion: 2.1 time: 0.511505 Oct 04 21:55:48.410696 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1326/2742] 10.222.0.43 () {58 vars in 1158 bytes} [Tue Oct 4 21:55:47 2022] GET /compute/v2.1/os-security-groups => generated 1158 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:55:48.433841 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-bddc1259-d611-4590-bc1c-5fe80cc987a8 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Action: 'create', calling method: .version_select at 0x7fbb2e79ca60>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-282483875", "description": "tempest-description-1424487777"}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:55:48.685464 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-1602dcd7-883e-44f0-a938-adfd5c3aa89b tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:55:48.686484 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-1602dcd7-883e-44f0-a938-adfd5c3aa89b tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] [instance: eb6e098d-966d-478b-a69c-3746584e5509] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:55:48.699242 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1602dcd7-883e-44f0-a938-adfd5c3aa89b tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:48.702240 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1602dcd7-883e-44f0-a938-adfd5c3aa89b tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:48.706580 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1602dcd7-883e-44f0-a938-adfd5c3aa89b tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:48.714634 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1602dcd7-883e-44f0-a938-adfd5c3aa89b tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:48.715670 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1602dcd7-883e-44f0-a938-adfd5c3aa89b tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:48.716302 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1602dcd7-883e-44f0-a938-adfd5c3aa89b tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:49.189729 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-bddc1259-d611-4590-bc1c-5fe80cc987a8 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] 10.222.0.43 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.759832 Oct 04 21:55:49.192814 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1417/2743] 10.222.0.43 () {60 vars in 1180 bytes} [Tue Oct 4 21:55:48 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:55:49.222110 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-9a8a57b4-c391-4549-b54e-f207d18aad93 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:55:49.223303 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-9a8a57b4-c391-4549-b54e-f207d18aad93 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] [instance: 4b3f3cb9-cdd4-4881-923f-bb3447b249b9] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:55:49.240443 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9a8a57b4-c391-4549-b54e-f207d18aad93 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:49.241438 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9a8a57b4-c391-4549-b54e-f207d18aad93 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:49.242294 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9a8a57b4-c391-4549-b54e-f207d18aad93 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:49.244130 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9a8a57b4-c391-4549-b54e-f207d18aad93 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:49.244988 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9a8a57b4-c391-4549-b54e-f207d18aad93 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:49.245836 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9a8a57b4-c391-4549-b54e-f207d18aad93 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:49.322060 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-1602dcd7-883e-44f0-a938-adfd5c3aa89b tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47fbc4a6920d451cb1a2ad170de04921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43659cf5fed541e8883664bf17aced70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:55:49.329803 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-1602dcd7-883e-44f0-a938-adfd5c3aa89b tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] 10.222.0.43 "GET /compute/v2.1/servers/eb6e098d-966d-478b-a69c-3746584e5509" status: 200 len: 1492 microversion: 2.1 time: 0.648448 Oct 04 21:55:49.336511 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1327/2744] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:55:48 2022] GET /compute/v2.1/servers/eb6e098d-966d-478b-a69c-3746584e5509 => generated 1492 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:55:49.353363 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-ce3c2890-7bea-4db4-99f0-b63a2dab8100 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Action: 'create', calling method: .version_select at 0x7fbb2e6fe040>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1180458121", "description": "tempest-description-587126703"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:55:49.450246 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-9a8a57b4-c391-4549-b54e-f207d18aad93 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b45ebdb946b45c28fc4bca3dd5a3e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520782b7e0a94e3fb552744cc4584119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:55:49.460253 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-9a8a57b4-c391-4549-b54e-f207d18aad93 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] 10.222.0.43 "GET /compute/v2.1/servers/4b3f3cb9-cdd4-4881-923f-bb3447b249b9" status: 200 len: 1270 microversion: 2.1 time: 0.249662 Oct 04 21:55:49.461325 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1418/2745] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:55:49 2022] GET /compute/v2.1/servers/4b3f3cb9-cdd4-4881-923f-bb3447b249b9 => generated 1270 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:55:50.106748 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-ce3c2890-7bea-4db4-99f0-b63a2dab8100 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] 10.222.0.43 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.768603 Oct 04 21:55:50.107862 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1328/2746] 10.222.0.43 () {60 vars in 1180 bytes} [Tue Oct 4 21:55:49 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:55:50.284086 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-9de5384d-8d2a-42d7-8a0c-6286d3bbdf2c tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-163407841", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452", "networks": [{"uuid": "a15f9d08-1696-44bb-bb46-54f43e1a613e"}]}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:55:50.353474 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.network.neutron [None req-9de5384d-8d2a-42d7-8a0c-6286d3bbdf2c tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] validate_networks() for [('a15f9d08-1696-44bb-bb46-54f43e1a613e', None, None, None, None, None)] {{(pid=134102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:55:50.356570 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-a61682f7-6692-4bbb-a272-9253e1203435 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:55:50.357170 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-a61682f7-6692-4bbb-a272-9253e1203435 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] [instance: eb6e098d-966d-478b-a69c-3746584e5509] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:55:50.368959 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a61682f7-6692-4bbb-a272-9253e1203435 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:50.369758 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a61682f7-6692-4bbb-a272-9253e1203435 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:50.370452 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a61682f7-6692-4bbb-a272-9253e1203435 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:50.371674 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a61682f7-6692-4bbb-a272-9253e1203435 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:50.372504 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a61682f7-6692-4bbb-a272-9253e1203435 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:50.373118 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a61682f7-6692-4bbb-a272-9253e1203435 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:50.912782 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-a61682f7-6692-4bbb-a272-9253e1203435 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47fbc4a6920d451cb1a2ad170de04921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43659cf5fed541e8883664bf17aced70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:55:50.968967 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-a61682f7-6692-4bbb-a272-9253e1203435 tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] 10.222.0.43 "GET /compute/v2.1/servers/eb6e098d-966d-478b-a69c-3746584e5509" status: 200 len: 1492 microversion: 2.1 time: 0.616671 Oct 04 21:55:50.985312 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1329/2747] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:55:50 2022] GET /compute/v2.1/servers/eb6e098d-966d-478b-a69c-3746584e5509 => generated 1492 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:55:51.006101 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-4dd8f680-8194-4585-a132-a834370b4c7e tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:55:51.007279 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-4dd8f680-8194-4585-a132-a834370b4c7e tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] [instance: 4b3f3cb9-cdd4-4881-923f-bb3447b249b9] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:55:51.015001 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4dd8f680-8194-4585-a132-a834370b4c7e tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:51.015828 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4dd8f680-8194-4585-a132-a834370b4c7e tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:51.016468 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4dd8f680-8194-4585-a132-a834370b4c7e tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:51.017638 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4dd8f680-8194-4585-a132-a834370b4c7e tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:51.018867 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4dd8f680-8194-4585-a132-a834370b4c7e tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:51.019529 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4dd8f680-8194-4585-a132-a834370b4c7e tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:51.177864 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-4dd8f680-8194-4585-a132-a834370b4c7e tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b45ebdb946b45c28fc4bca3dd5a3e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520782b7e0a94e3fb552744cc4584119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:55:51.190296 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-4dd8f680-8194-4585-a132-a834370b4c7e tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] 10.222.0.43 "GET /compute/v2.1/servers/4b3f3cb9-cdd4-4881-923f-bb3447b249b9" status: 200 len: 1276 microversion: 2.1 time: 0.203361 Oct 04 21:55:51.192074 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1330/2748] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:55:50 2022] GET /compute/v2.1/servers/4b3f3cb9-cdd4-4881-923f-bb3447b249b9 => generated 1276 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:55:51.643959 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-b7ff96e3-94ca-4068-856c-63a49e9ba73e tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Action: 'create', calling method: .version_select at 0x7fbb2e6c0550>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-59092883", "policies": ["affinity"]}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:55:51.675212 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-b7ff96e3-94ca-4068-856c-63a49e9ba73e tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Getting quotas for project eb891227dcd84bd49d7215af9dce2db3. Resources: {'server_groups'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:55:51.683935 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-b7ff96e3-94ca-4068-856c-63a49e9ba73e tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Getting quotas for user 18de0948626e4a5c8a28711f943ba46e and project eb891227dcd84bd49d7215af9dce2db3. Resources: {'server_groups'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:55:51.768812 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-b7ff96e3-94ca-4068-856c-63a49e9ba73e tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Getting quotas for project eb891227dcd84bd49d7215af9dce2db3. Resources: {'server_groups'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:55:51.778694 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-b7ff96e3-94ca-4068-856c-63a49e9ba73e tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Getting quotas for user 18de0948626e4a5c8a28711f943ba46e and project eb891227dcd84bd49d7215af9dce2db3. Resources: {'server_groups'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:55:51.806469 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-b7ff96e3-94ca-4068-856c-63a49e9ba73e tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] 10.222.0.43 "POST /compute/v2.1/os-server-groups" status: 200 len: 182 microversion: 2.1 time: 0.323435 Oct 04 21:55:51.819269 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1331/2749] 10.222.0.43 () {60 vars in 1174 bytes} [Tue Oct 4 21:55:51 2022] POST /compute/v2.1/os-server-groups => generated 182 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:55:51.830722 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-74723a6b-5678-4428-a1cc-c2ba4a9a51c4 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Action: 'create', calling method: .version_select at 0x7fbb2e6c0670>, body: {"server_group": {"name": "tempest-server-group-989869941", "policies": ["affinity"]}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:55:51.871617 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-74723a6b-5678-4428-a1cc-c2ba4a9a51c4 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Getting quotas for project eb891227dcd84bd49d7215af9dce2db3. Resources: {'server_groups'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:55:51.889034 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-74723a6b-5678-4428-a1cc-c2ba4a9a51c4 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Getting quotas for user 18de0948626e4a5c8a28711f943ba46e and project eb891227dcd84bd49d7215af9dce2db3. Resources: {'server_groups'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:55:51.998062 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-74723a6b-5678-4428-a1cc-c2ba4a9a51c4 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Getting quotas for project eb891227dcd84bd49d7215af9dce2db3. Resources: {'server_groups'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:55:52.016144 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-74723a6b-5678-4428-a1cc-c2ba4a9a51c4 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Getting quotas for user 18de0948626e4a5c8a28711f943ba46e and project eb891227dcd84bd49d7215af9dce2db3. Resources: {'server_groups'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:55:52.050427 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-74723a6b-5678-4428-a1cc-c2ba4a9a51c4 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] 10.222.0.43 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.227003 Oct 04 21:55:52.063740 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1332/2750] 10.222.0.43 () {60 vars in 1173 bytes} [Tue Oct 4 21:55:51 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:55:52.091149 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-07656898-e18f-4f64-902b-4cebde834729 req-f998bbbc-4c88-42bd-8147-ab1d20a3ceb4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb6e098d-966d-478b-a69c-3746584e5509", "name": "network-vif-deleted", "tag": "14556cef-915d-4e87-b47d-67e1cacff2c9"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:55:52.136933 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-07656898-e18f-4f64-902b-4cebde834729 req-f998bbbc-4c88-42bd-8147-ab1d20a3ceb4 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:52.142766 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-07656898-e18f-4f64-902b-4cebde834729 req-f998bbbc-4c88-42bd-8147-ab1d20a3ceb4 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:52.146849 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-07656898-e18f-4f64-902b-4cebde834729 req-f998bbbc-4c88-42bd-8147-ab1d20a3ceb4 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:52.197181 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-07656898-e18f-4f64-902b-4cebde834729 req-f998bbbc-4c88-42bd-8147-ab1d20a3ceb4 service nova] Creating event network-vif-deleted:14556cef-915d-4e87-b47d-67e1cacff2c9 for instance eb6e098d-966d-478b-a69c-3746584e5509 on n-h1-860284-1 Oct 04 21:55:52.210287 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-07656898-e18f-4f64-902b-4cebde834729 req-f998bbbc-4c88-42bd-8147-ab1d20a3ceb4 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142941 Oct 04 21:55:52.221529 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1333/2751] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:55:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:55:52.249898 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-9de5384d-8d2a-42d7-8a0c-6286d3bbdf2c tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Flavor limits 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:55:52.251017 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-9de5384d-8d2a-42d7-8a0c-6286d3bbdf2c tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Image limits 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:55:52.251708 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-9de5384d-8d2a-42d7-8a0c-6286d3bbdf2c tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Flavor pref 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:55:52.252672 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-9de5384d-8d2a-42d7-8a0c-6286d3bbdf2c tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Image pref 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:55:52.253265 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-9de5384d-8d2a-42d7-8a0c-6286d3bbdf2c tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:55:52.256754 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-8fb8fa07-19eb-4eaf-b133-1b1c7df3aa0c tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:55:52.262762 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-8fb8fa07-19eb-4eaf-b133-1b1c7df3aa0c tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] [instance: eb6e098d-966d-478b-a69c-3746584e5509] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:55:52.280923 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9de5384d-8d2a-42d7-8a0c-6286d3bbdf2c tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:52.281766 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9de5384d-8d2a-42d7-8a0c-6286d3bbdf2c tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:52.282430 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9de5384d-8d2a-42d7-8a0c-6286d3bbdf2c tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:52.283711 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9de5384d-8d2a-42d7-8a0c-6286d3bbdf2c tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:52.284443 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9de5384d-8d2a-42d7-8a0c-6286d3bbdf2c tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:52.285120 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9de5384d-8d2a-42d7-8a0c-6286d3bbdf2c tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:52.296043 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8fb8fa07-19eb-4eaf-b133-1b1c7df3aa0c tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:52.297302 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8fb8fa07-19eb-4eaf-b133-1b1c7df3aa0c tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:52.298322 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8fb8fa07-19eb-4eaf-b133-1b1c7df3aa0c tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:52.301367 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8fb8fa07-19eb-4eaf-b133-1b1c7df3aa0c tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:52.302738 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8fb8fa07-19eb-4eaf-b133-1b1c7df3aa0c tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:52.311812 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8fb8fa07-19eb-4eaf-b133-1b1c7df3aa0c tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:52.314044 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-9de5384d-8d2a-42d7-8a0c-6286d3bbdf2c tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Getting quotas for project 51745fc19321469bb20afabe48b2185d. Resources: {'instances', 'ram', 'cores'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:55:52.321756 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-9de5384d-8d2a-42d7-8a0c-6286d3bbdf2c tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Getting quotas for user 4cca65ba35b14db8bf2187188de8c838 and project 51745fc19321469bb20afabe48b2185d. Resources: {'instances', 'ram', 'cores'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:55:52.339741 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-9de5384d-8d2a-42d7-8a0c-6286d3bbdf2c tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Going to run 1 instances... {{(pid=134102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:55:52.342554 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-9de5384d-8d2a-42d7-8a0c-6286d3bbdf2c tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] [instance: 6188e227-0adf-4afd-897d-66578f442cae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='58548514-5dac-426c-81f5-19e3fba33e23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:55:52.419761 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8fb8fa07-19eb-4eaf-b133-1b1c7df3aa0c tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:52.420291 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8fb8fa07-19eb-4eaf-b133-1b1c7df3aa0c tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:52.425358 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-9de5384d-8d2a-42d7-8a0c-6286d3bbdf2c tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.145018 Oct 04 21:55:52.427935 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8fb8fa07-19eb-4eaf-b133-1b1c7df3aa0c tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:52.428636 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.objects.instance [None req-8fb8fa07-19eb-4eaf-b133-1b1c7df3aa0c tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lazy-loading 'fault' on Instance uuid eb6e098d-966d-478b-a69c-3746584e5509 {{(pid=134101) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:55:52.440374 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1419/2752] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 21:55:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 2161 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:55:52.452427 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-77c3f7ef-b2d3-4b46-ad8c-c2a03daaabb7 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Action: 'create', calling method: .version_select at 0x7fbb2f754040>, body: {"server_group": {"name": "tempest-server-group-989869941", "policies": ["affinity"]}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:55:52.527806 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-77c3f7ef-b2d3-4b46-ad8c-c2a03daaabb7 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Getting quotas for project eb891227dcd84bd49d7215af9dce2db3. Resources: {'server_groups'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:55:52.551673 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-77c3f7ef-b2d3-4b46-ad8c-c2a03daaabb7 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Getting quotas for user 18de0948626e4a5c8a28711f943ba46e and project eb891227dcd84bd49d7215af9dce2db3. Resources: {'server_groups'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:55:52.724070 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-77c3f7ef-b2d3-4b46-ad8c-c2a03daaabb7 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Getting quotas for project eb891227dcd84bd49d7215af9dce2db3. Resources: {'server_groups'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:55:52.732923 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-77c3f7ef-b2d3-4b46-ad8c-c2a03daaabb7 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Getting quotas for user 18de0948626e4a5c8a28711f943ba46e and project eb891227dcd84bd49d7215af9dce2db3. Resources: {'server_groups'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:55:52.773305 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-77c3f7ef-b2d3-4b46-ad8c-c2a03daaabb7 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] 10.222.0.43 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.330801 Oct 04 21:55:52.782079 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1420/2753] 10.222.0.43 () {60 vars in 1173 bytes} [Tue Oct 4 21:55:52 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:55:52.788433 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-21b63036-19d7-4b07-92f3-aca63654b9ce tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:55:52.789335 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-21b63036-19d7-4b07-92f3-aca63654b9ce tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] [instance: 4b3f3cb9-cdd4-4881-923f-bb3447b249b9] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:55:52.814025 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-21b63036-19d7-4b07-92f3-aca63654b9ce tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:52.819201 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-21b63036-19d7-4b07-92f3-aca63654b9ce tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:52.820032 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-21b63036-19d7-4b07-92f3-aca63654b9ce tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:52.821389 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-21b63036-19d7-4b07-92f3-aca63654b9ce tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:52.822248 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-21b63036-19d7-4b07-92f3-aca63654b9ce tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:52.829033 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-21b63036-19d7-4b07-92f3-aca63654b9ce tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:53.262781 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-8fb8fa07-19eb-4eaf-b133-1b1c7df3aa0c tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47fbc4a6920d451cb1a2ad170de04921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43659cf5fed541e8883664bf17aced70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:55:53.276670 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-8fb8fa07-19eb-4eaf-b133-1b1c7df3aa0c tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] 10.222.0.43 "GET /compute/v2.1/servers/eb6e098d-966d-478b-a69c-3746584e5509" status: 200 len: 1304 microversion: 2.1 time: 1.050086 Oct 04 21:55:53.295541 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1334/2754] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:55:52 2022] GET /compute/v2.1/servers/eb6e098d-966d-478b-a69c-3746584e5509 => generated 1304 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:55:53.310730 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-2cea7d4e-6fe9-47d5-a1fc-3c5d00907106 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:55:53.311419 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-2cea7d4e-6fe9-47d5-a1fc-3c5d00907106 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] [instance: 6188e227-0adf-4afd-897d-66578f442cae] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:55:53.331051 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2cea7d4e-6fe9-47d5-a1fc-3c5d00907106 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:53.331561 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2cea7d4e-6fe9-47d5-a1fc-3c5d00907106 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:53.332021 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2cea7d4e-6fe9-47d5-a1fc-3c5d00907106 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:53.336010 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2cea7d4e-6fe9-47d5-a1fc-3c5d00907106 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:53.338139 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2cea7d4e-6fe9-47d5-a1fc-3c5d00907106 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:53.338873 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2cea7d4e-6fe9-47d5-a1fc-3c5d00907106 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:53.603345 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-2cea7d4e-6fe9-47d5-a1fc-3c5d00907106 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cca65ba35b14db8bf2187188de8c838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51745fc19321469bb20afabe48b2185d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:55:53.612996 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-2cea7d4e-6fe9-47d5-a1fc-3c5d00907106 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] 10.222.0.43 "GET /compute/v2.1/servers/6188e227-0adf-4afd-897d-66578f442cae" status: 200 len: 1219 microversion: 2.1 time: 0.315906 Oct 04 21:55:53.638085 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1335/2755] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:55:53 2022] GET /compute/v2.1/servers/6188e227-0adf-4afd-897d-66578f442cae => generated 1219 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:55:53.645927 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-518162c8-7d13-4f5e-8d9f-5a26e72d21e6 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:55:53.713464 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-518162c8-7d13-4f5e-8d9f-5a26e72d21e6 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] 10.222.0.43 "DELETE /compute/v2.1/os-server-groups/4fdf4c4f-79fa-4120-8070-f41b7d58dc34" status: 204 len: 0 microversion: 2.1 time: 0.073671 Oct 04 21:55:53.717097 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1336/2756] 10.222.0.43 () {58 vars in 1266 bytes} [Tue Oct 4 21:55:53 2022] DELETE /compute/v2.1/os-server-groups/4fdf4c4f-79fa-4120-8070-f41b7d58dc34 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:55:53.723464 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-f147095a-9534-4abb-9ede-f2671801ef28 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:55:53.765556 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-f147095a-9534-4abb-9ede-f2671801ef28 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] 10.222.0.43 "GET /compute/v2.1/os-server-groups" status: 200 len: 332 microversion: 2.1 time: 0.046106 Oct 04 21:55:53.766485 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1337/2757] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Oct 4 21:55:53 2022] GET /compute/v2.1/os-server-groups => generated 332 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:55:53.780308 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-087cfbae-eaad-4b29-8f14-8e95e11ca55f tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:55:53.844435 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-087cfbae-eaad-4b29-8f14-8e95e11ca55f tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] 10.222.0.43 "DELETE /compute/v2.1/os-server-groups/c658a04c-9f67-4769-959a-c8a8bbc76015" status: 204 len: 0 microversion: 2.1 time: 0.068006 Oct 04 21:55:53.845686 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1338/2758] 10.222.0.43 () {58 vars in 1266 bytes} [Tue Oct 4 21:55:53 2022] DELETE /compute/v2.1/os-server-groups/c658a04c-9f67-4769-959a-c8a8bbc76015 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 21:55:53.854188 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-8fb3ce73-1a1d-49bf-9328-1704bc74afe3 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:55:53.884134 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-8fb3ce73-1a1d-49bf-9328-1704bc74afe3 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] 10.222.0.43 "GET /compute/v2.1/os-server-groups" status: 200 len: 185 microversion: 2.1 time: 0.033934 Oct 04 21:55:53.888163 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1339/2759] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Oct 4 21:55:53 2022] GET /compute/v2.1/os-server-groups => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:55:53.902079 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-522a547a-8b1b-40a2-8d40-4d1bfb13ac53 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Action: 'create', calling method: .version_select at 0x7fbb2e626700>, body: {"server_group": {"name": "tempest-server-group-818077216", "policies": ["affinity"]}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:55:53.920652 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=1,nova_api:INSERT=4,nova_api:DELETE=6 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:55:53.957594 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-522a547a-8b1b-40a2-8d40-4d1bfb13ac53 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Getting quotas for project eb891227dcd84bd49d7215af9dce2db3. Resources: {'server_groups'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:55:53.966409 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-522a547a-8b1b-40a2-8d40-4d1bfb13ac53 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Getting quotas for user 18de0948626e4a5c8a28711f943ba46e and project eb891227dcd84bd49d7215af9dce2db3. Resources: {'server_groups'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:55:54.077481 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-522a547a-8b1b-40a2-8d40-4d1bfb13ac53 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Getting quotas for project eb891227dcd84bd49d7215af9dce2db3. Resources: {'server_groups'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:55:54.089934 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-522a547a-8b1b-40a2-8d40-4d1bfb13ac53 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Getting quotas for user 18de0948626e4a5c8a28711f943ba46e and project eb891227dcd84bd49d7215af9dce2db3. Resources: {'server_groups'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:55:54.131707 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-522a547a-8b1b-40a2-8d40-4d1bfb13ac53 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] 10.222.0.43 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.232636 Oct 04 21:55:54.131707 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1340/2760] 10.222.0.43 () {60 vars in 1173 bytes} [Tue Oct 4 21:55:53 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:55:54.151752 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-21b63036-19d7-4b07-92f3-aca63654b9ce tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b45ebdb946b45c28fc4bca3dd5a3e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520782b7e0a94e3fb552744cc4584119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:55:54.155456 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-983e37c4-7812-4463-a964-51499513e549 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:55:54.196331 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-21b63036-19d7-4b07-92f3-aca63654b9ce tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] 10.222.0.43 "GET /compute/v2.1/servers/4b3f3cb9-cdd4-4881-923f-bb3447b249b9" status: 200 len: 1318 microversion: 2.1 time: 1.412658 Oct 04 21:55:54.199760 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1421/2761] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:55:52 2022] GET /compute/v2.1/servers/4b3f3cb9-cdd4-4881-923f-bb3447b249b9 => generated 1318 bytes in 1422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:55:54.218419 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-983e37c4-7812-4463-a964-51499513e549 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] 10.222.0.43 "DELETE /compute/v2.1/os-server-groups/6afb072d-aa26-44c4-b18b-316d8a134720" status: 204 len: 0 microversion: 2.1 time: 0.066583 Oct 04 21:55:54.224523 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1341/2762] 10.222.0.43 () {58 vars in 1266 bytes} [Tue Oct 4 21:55:54 2022] DELETE /compute/v2.1/os-server-groups/6afb072d-aa26-44c4-b18b-316d8a134720 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:55:54.234884 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-47207603-e8aa-4de1-91ab-71cc63c4b03a tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:55:54.258027 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-47207603-e8aa-4de1-91ab-71cc63c4b03a tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] 10.222.0.43 "GET /compute/v2.1/os-server-groups" status: 200 len: 185 microversion: 2.1 time: 0.031602 Oct 04 21:55:54.259196 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1422/2763] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Oct 4 21:55:54 2022] GET /compute/v2.1/os-server-groups => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:55:54.276429 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-ce3bbbd3-759f-41e2-b4b9-30ff548531a3 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Action: 'create', calling method: .version_select at 0x7fbb2f232280>, body: {"server_group": {"name": "tempest-server-group-1941172243", "policies": ["anti-affinity"]}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:55:54.317118 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-fd8023c9-5f0e-4e40-b6fc-9ff1a558faaa tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:55:54.323269 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-ce3bbbd3-759f-41e2-b4b9-30ff548531a3 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Getting quotas for project eb891227dcd84bd49d7215af9dce2db3. Resources: {'server_groups'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:55:54.323868 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-fd8023c9-5f0e-4e40-b6fc-9ff1a558faaa tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] [instance: eb6e098d-966d-478b-a69c-3746584e5509] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:55:54.344144 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fd8023c9-5f0e-4e40-b6fc-9ff1a558faaa tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:54.345368 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fd8023c9-5f0e-4e40-b6fc-9ff1a558faaa tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:54.350077 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fd8023c9-5f0e-4e40-b6fc-9ff1a558faaa tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:54.354817 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fd8023c9-5f0e-4e40-b6fc-9ff1a558faaa tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:54.356841 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-ce3bbbd3-759f-41e2-b4b9-30ff548531a3 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Getting quotas for user 18de0948626e4a5c8a28711f943ba46e and project eb891227dcd84bd49d7215af9dce2db3. Resources: {'server_groups'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:55:54.359643 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fd8023c9-5f0e-4e40-b6fc-9ff1a558faaa tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:54.360523 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fd8023c9-5f0e-4e40-b6fc-9ff1a558faaa tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:54.403436 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-fd8023c9-5f0e-4e40-b6fc-9ff1a558faaa tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] HTTP exception thrown: Instance eb6e098d-966d-478b-a69c-3746584e5509 could not be found. Oct 04 21:55:54.407031 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-fd8023c9-5f0e-4e40-b6fc-9ff1a558faaa tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Request method failure captured: Oct 04 21:55:54.407031 n-d-860284-1 devstack@n-api.service[134102]: request: GET /compute/v2.1/servers/eb6e098d-966d-478b-a69c-3746584e5509 HTTP/1.1 Oct 04 21:55:54.407031 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 21:55:54.407031 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 21:55:54.407031 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 21:55:54.407031 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 21:55:54.407031 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 21:55:54.407031 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 21:55:54.407031 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 21:55:54.407031 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 21:55:54.407031 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPKtYopP8HDKXJZRcqCeswWNVLaWLaidz1OAW6yn0_RDqastM34kGrGuin0BKHDO8BPfc8_-bf0pCmHXKhYPCZ8ir53M9rqZXj9vPCFlwdHhyg1bLP4T7-aGT-bDoQyUmCSYJkgjep8fovlvsZrZUDrra7cR10iuKriN3BEpTWrU9_Eo Oct 04 21:55:54.407031 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 21:55:54.407031 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 21:55:54.407031 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 21:55:54.407031 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 21:55:54.407031 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 21:55:54.407031 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 21:55:54.407031 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: 43659cf5fed541e8883664bf17aced70 Oct 04 21:55:54.407031 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-ServerRescueTestJSON-1796524375 Oct 04 21:55:54.407031 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 21:55:54.407031 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 21:55:54.407031 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/43659cf5fed541e8883664bf17aced70"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_43659cf5fed541e8883664bf17aced70", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/43659cf5fed541e8883664bf17aced70"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/43659cf5fed541e8883664bf17aced70"}]}] Oct 04 21:55:54.407031 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-ServerRescueTestJSON-1796524375 Oct 04 21:55:54.407031 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: 43659cf5fed541e8883664bf17aced70 Oct 04 21:55:54.407031 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-ServerRescueTestJSON-1796524375 Oct 04 21:55:54.407031 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-ServerRescueTestJSON-1796524375-project Oct 04 21:55:54.407031 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 21:55:54.407031 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 21:55:54.407031 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: 47fbc4a6920d451cb1a2ad170de04921 Oct 04 21:55:54.407031 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-ServerRescueTestJSON-1796524375-project Oct 04 21:55:54.407031 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 21:55:54.407031 n-d-860284-1 devstack@n-api.service[134102]: exception: Instance eb6e098d-966d-478b-a69c-3746584e5509 could not be found. Oct 04 21:55:54.407031 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': 'eb6e098d-966d-478b-a69c-3746584e5509'} Oct 04 21:55:54.407031 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:55:54.407031 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:55:54.407031 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:55:54.407031 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:55:54.407031 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:55:54.407031 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:55:54.407031 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:55:54.407031 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:55:54.407031 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:55:54.407031 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:55:54.407031 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb6e098d-966d-478b-a69c-3746584e5509 could not be found. Oct 04 21:55:54.407031 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:55:54.407031 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:55:54.407031 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:55:54.407031 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:55:54.407031 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:55:54.407031 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:55:54.407031 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:55:54.407031 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:55:54.407031 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:55:54.407031 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:55:54.407031 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:55:54.407031 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:55:54.407031 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:55:54.407031 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:55:54.407031 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:55:54.407031 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:55:54.407031 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb6e098d-966d-478b-a69c-3746584e5509 could not be found. Oct 04 21:55:54.407031 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:55:54.407031 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:55:54.407031 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:55:54.411971 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:55:54.411971 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:55:54.411971 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:55:54.411971 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:55:54.411971 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:55:54.411971 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb6e098d-966d-478b-a69c-3746584e5509 could not be found. Oct 04 21:55:54.411971 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:55:54.413517 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-fd8023c9-5f0e-4e40-b6fc-9ff1a558faaa tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] Returning 404 to user: Instance eb6e098d-966d-478b-a69c-3746584e5509 could not be found. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:55:54.416637 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-fd8023c9-5f0e-4e40-b6fc-9ff1a558faaa tempest-ServerRescueTestJSON-1796524375 tempest-ServerRescueTestJSON-1796524375-project] 10.222.0.43 "GET /compute/v2.1/servers/eb6e098d-966d-478b-a69c-3746584e5509" status: 404 len: 111 microversion: 2.1 time: 0.111223 Oct 04 21:55:54.420691 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1423/2764] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:55:54 2022] GET /compute/v2.1/servers/eb6e098d-966d-478b-a69c-3746584e5509 => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 21:55:54.467815 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-ce3bbbd3-759f-41e2-b4b9-30ff548531a3 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Getting quotas for project eb891227dcd84bd49d7215af9dce2db3. Resources: {'server_groups'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:55:54.474450 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-ce3bbbd3-759f-41e2-b4b9-30ff548531a3 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Getting quotas for user 18de0948626e4a5c8a28711f943ba46e and project eb891227dcd84bd49d7215af9dce2db3. Resources: {'server_groups'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:55:54.490742 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-ce3bbbd3-759f-41e2-b4b9-30ff548531a3 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] 10.222.0.43 "POST /compute/v2.1/os-server-groups" status: 200 len: 169 microversion: 2.1 time: 0.218401 Oct 04 21:55:54.492601 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1342/2765] 10.222.0.43 () {60 vars in 1173 bytes} [Tue Oct 4 21:55:54 2022] POST /compute/v2.1/os-server-groups => generated 169 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:55:54.568426 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-b8141432-d5a9-421d-b517-6d6a129aefdf tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:55:54.636166 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-b8141432-d5a9-421d-b517-6d6a129aefdf tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] 10.222.0.43 "DELETE /compute/v2.1/os-server-groups/68de3d71-5730-421b-9972-4a3aadda6059" status: 204 len: 0 microversion: 2.1 time: 0.133012 Oct 04 21:55:54.641365 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1424/2766] 10.222.0.43 () {58 vars in 1266 bytes} [Tue Oct 4 21:55:54 2022] DELETE /compute/v2.1/os-server-groups/68de3d71-5730-421b-9972-4a3aadda6059 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:55:54.644891 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-8e1e9e95-c2f3-4f8a-bb6d-ae074efe59d5 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:55:54.647047 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-8e1e9e95-c2f3-4f8a-bb6d-ae074efe59d5 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] [instance: 6188e227-0adf-4afd-897d-66578f442cae] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:55:54.652413 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-89330094-d03f-41e1-8659-553dad86f330 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:55:54.667838 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-89330094-d03f-41e1-8659-553dad86f330 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] 10.222.0.43 "GET /compute/v2.1/os-server-groups" status: 200 len: 185 microversion: 2.1 time: 0.020592 Oct 04 21:55:54.668896 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1425/2767] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Oct 4 21:55:54 2022] GET /compute/v2.1/os-server-groups => generated 185 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:55:54.670645 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8e1e9e95-c2f3-4f8a-bb6d-ae074efe59d5 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:54.675795 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8e1e9e95-c2f3-4f8a-bb6d-ae074efe59d5 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:54.678573 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8e1e9e95-c2f3-4f8a-bb6d-ae074efe59d5 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:54.680449 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8e1e9e95-c2f3-4f8a-bb6d-ae074efe59d5 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:54.692554 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8e1e9e95-c2f3-4f8a-bb6d-ae074efe59d5 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:54.696884 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8e1e9e95-c2f3-4f8a-bb6d-ae074efe59d5 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:54.761420 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-da5778b2-6cb6-461f-8324-f5c94172f751 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-44369532", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452", "networks": [{"uuid": "77a314b1-3687-408a-b58a-986966121eb3"}]}, "os:scheduler_hints": {"group": "1de10a59-897f-4699-bb15-bfe7e69e976c"}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:55:54.857018 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.network.neutron [None req-da5778b2-6cb6-461f-8324-f5c94172f751 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] validate_networks() for [('77a314b1-3687-408a-b58a-986966121eb3', None, None, None, None, None)] {{(pid=134102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:55:55.237762 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-8e1e9e95-c2f3-4f8a-bb6d-ae074efe59d5 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cca65ba35b14db8bf2187188de8c838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51745fc19321469bb20afabe48b2185d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:55:55.273756 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-8e1e9e95-c2f3-4f8a-bb6d-ae074efe59d5 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] 10.222.0.43 "GET /compute/v2.1/servers/6188e227-0adf-4afd-897d-66578f442cae" status: 200 len: 1285 microversion: 2.1 time: 0.632711 Oct 04 21:55:55.295240 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1343/2768] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:55:54 2022] GET /compute/v2.1/servers/6188e227-0adf-4afd-897d-66578f442cae => generated 1285 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:55:55.334196 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-3a3f65bf-8a94-479c-a982-dfa876a6cade tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:55:55.342255 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-3a3f65bf-8a94-479c-a982-dfa876a6cade tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] [instance: 4b3f3cb9-cdd4-4881-923f-bb3447b249b9] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:55:55.384197 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3a3f65bf-8a94-479c-a982-dfa876a6cade tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:55.385031 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3a3f65bf-8a94-479c-a982-dfa876a6cade tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:55.385803 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3a3f65bf-8a94-479c-a982-dfa876a6cade tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:55.395625 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3a3f65bf-8a94-479c-a982-dfa876a6cade tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:55.397774 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3a3f65bf-8a94-479c-a982-dfa876a6cade tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:55.400611 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3a3f65bf-8a94-479c-a982-dfa876a6cade tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:55.477406 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:55:56.462968 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-3a3f65bf-8a94-479c-a982-dfa876a6cade tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b45ebdb946b45c28fc4bca3dd5a3e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520782b7e0a94e3fb552744cc4584119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:55:56.483961 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-3a3f65bf-8a94-479c-a982-dfa876a6cade tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] 10.222.0.43 "GET /compute/v2.1/servers/4b3f3cb9-cdd4-4881-923f-bb3447b249b9" status: 200 len: 1318 microversion: 2.1 time: 1.179911 Oct 04 21:55:56.484572 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1344/2769] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:55:55 2022] GET /compute/v2.1/servers/4b3f3cb9-cdd4-4881-923f-bb3447b249b9 => generated 1318 bytes in 1189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:55:56.492795 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-8f7afa46-f57c-4228-a033-6945955c4f69 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:55:56.493436 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-8f7afa46-f57c-4228-a033-6945955c4f69 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] [instance: 6188e227-0adf-4afd-897d-66578f442cae] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:55:56.518061 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8f7afa46-f57c-4228-a033-6945955c4f69 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:56.518595 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8f7afa46-f57c-4228-a033-6945955c4f69 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:56.528243 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8f7afa46-f57c-4228-a033-6945955c4f69 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:56.530391 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8f7afa46-f57c-4228-a033-6945955c4f69 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:56.541175 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8f7afa46-f57c-4228-a033-6945955c4f69 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:56.543944 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8f7afa46-f57c-4228-a033-6945955c4f69 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:56.829078 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-8f7afa46-f57c-4228-a033-6945955c4f69 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cca65ba35b14db8bf2187188de8c838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51745fc19321469bb20afabe48b2185d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:55:56.858035 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-8f7afa46-f57c-4228-a033-6945955c4f69 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] 10.222.0.43 "GET /compute/v2.1/servers/6188e227-0adf-4afd-897d-66578f442cae" status: 200 len: 1273 microversion: 2.1 time: 0.372061 Oct 04 21:55:56.861783 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1345/2770] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:55:56 2022] GET /compute/v2.1/servers/6188e227-0adf-4afd-897d-66578f442cae => generated 1273 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:55:57.544917 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-34f14fa5-f247-4785-b604-7c2fab055197 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:55:57.547022 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-34f14fa5-f247-4785-b604-7c2fab055197 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] [instance: 4b3f3cb9-cdd4-4881-923f-bb3447b249b9] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:55:57.594100 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-34f14fa5-f247-4785-b604-7c2fab055197 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:57.595440 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-34f14fa5-f247-4785-b604-7c2fab055197 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:57.596362 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-34f14fa5-f247-4785-b604-7c2fab055197 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:57.604754 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-34f14fa5-f247-4785-b604-7c2fab055197 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:57.606433 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-34f14fa5-f247-4785-b604-7c2fab055197 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:57.615107 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-34f14fa5-f247-4785-b604-7c2fab055197 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:58.334933 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-da5778b2-6cb6-461f-8324-f5c94172f751 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Flavor limits 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:55:58.336864 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-da5778b2-6cb6-461f-8324-f5c94172f751 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Image limits 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:55:58.338833 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-da5778b2-6cb6-461f-8324-f5c94172f751 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Flavor pref 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:55:58.339657 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-da5778b2-6cb6-461f-8324-f5c94172f751 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Image pref 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:55:58.340444 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-da5778b2-6cb6-461f-8324-f5c94172f751 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:55:58.385245 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-da5778b2-6cb6-461f-8324-f5c94172f751 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:58.386358 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-da5778b2-6cb6-461f-8324-f5c94172f751 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:58.387130 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-da5778b2-6cb6-461f-8324-f5c94172f751 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:58.388164 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-da5778b2-6cb6-461f-8324-f5c94172f751 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:58.388935 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-da5778b2-6cb6-461f-8324-f5c94172f751 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:58.390033 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-da5778b2-6cb6-461f-8324-f5c94172f751 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:58.451459 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-da5778b2-6cb6-461f-8324-f5c94172f751 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Getting quotas for project eb891227dcd84bd49d7215af9dce2db3. Resources: {'instances', 'ram', 'cores'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:55:58.487653 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-da5778b2-6cb6-461f-8324-f5c94172f751 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Getting quotas for user 18de0948626e4a5c8a28711f943ba46e and project eb891227dcd84bd49d7215af9dce2db3. Resources: {'instances', 'ram', 'cores'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:55:58.560899 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=8,nova_api:DELETE=3 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:55:58.564885 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-da5778b2-6cb6-461f-8324-f5c94172f751 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Going to run 1 instances... {{(pid=134102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:55:58.571985 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-da5778b2-6cb6-461f-8324-f5c94172f751 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] [instance: 3b712221-0858-4ebc-a276-06d9c0c84fb7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='58548514-5dac-426c-81f5-19e3fba33e23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:55:58.672563 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-da5778b2-6cb6-461f-8324-f5c94172f751 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Getting quotas for project eb891227dcd84bd49d7215af9dce2db3. Resources: {'server_group_members'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:55:58.683988 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-da5778b2-6cb6-461f-8324-f5c94172f751 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Getting quotas for user 18de0948626e4a5c8a28711f943ba46e and project eb891227dcd84bd49d7215af9dce2db3. Resources: {'server_group_members'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:55:58.794080 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-da5778b2-6cb6-461f-8324-f5c94172f751 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Getting quotas for project eb891227dcd84bd49d7215af9dce2db3. Resources: {'server_group_members'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:55:58.794352 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-34f14fa5-f247-4785-b604-7c2fab055197 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b45ebdb946b45c28fc4bca3dd5a3e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520782b7e0a94e3fb552744cc4584119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:55:58.812956 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-da5778b2-6cb6-461f-8324-f5c94172f751 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Getting quotas for user 18de0948626e4a5c8a28711f943ba46e and project eb891227dcd84bd49d7215af9dce2db3. Resources: {'server_group_members'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:55:58.821936 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-34f14fa5-f247-4785-b604-7c2fab055197 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] 10.222.0.43 "GET /compute/v2.1/servers/4b3f3cb9-cdd4-4881-923f-bb3447b249b9" status: 200 len: 1318 microversion: 2.1 time: 1.295875 Oct 04 21:55:58.822597 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1346/2771] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:55:57 2022] GET /compute/v2.1/servers/4b3f3cb9-cdd4-4881-923f-bb3447b249b9 => generated 1318 bytes in 1298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:55:58.842604 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-afe9b77f-c093-4677-b120-ae6f5947478c tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:55:58.843249 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-afe9b77f-c093-4677-b120-ae6f5947478c tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] [instance: 6188e227-0adf-4afd-897d-66578f442cae] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:55:58.856885 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-afe9b77f-c093-4677-b120-ae6f5947478c tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:58.861047 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-afe9b77f-c093-4677-b120-ae6f5947478c tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:58.861520 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-afe9b77f-c093-4677-b120-ae6f5947478c tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:58.863991 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-afe9b77f-c093-4677-b120-ae6f5947478c tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:58.866966 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-afe9b77f-c093-4677-b120-ae6f5947478c tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:58.867658 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-afe9b77f-c093-4677-b120-ae6f5947478c tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:58.908084 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-da5778b2-6cb6-461f-8324-f5c94172f751 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.150489 Oct 04 21:55:58.911392 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1426/2772] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 21:55:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 4155 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 21:55:58.939321 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-bdcfc000-3e21-4f6c-aff4-36495d180350 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:55:58.941404 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-bdcfc000-3e21-4f6c-aff4-36495d180350 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] [instance: 3b712221-0858-4ebc-a276-06d9c0c84fb7] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:55:59.174085 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-afe9b77f-c093-4677-b120-ae6f5947478c tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cca65ba35b14db8bf2187188de8c838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51745fc19321469bb20afabe48b2185d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:55:59.187346 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-afe9b77f-c093-4677-b120-ae6f5947478c tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] 10.222.0.43 "GET /compute/v2.1/servers/6188e227-0adf-4afd-897d-66578f442cae" status: 200 len: 1273 microversion: 2.1 time: 0.362083 Oct 04 21:55:59.190935 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1347/2773] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:55:58 2022] GET /compute/v2.1/servers/6188e227-0adf-4afd-897d-66578f442cae => generated 1273 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:55:59.273339 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-bdcfc000-3e21-4f6c-aff4-36495d180350 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18de0948626e4a5c8a28711f943ba46e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb891227dcd84bd49d7215af9dce2db3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:55:59.286422 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-bdcfc000-3e21-4f6c-aff4-36495d180350 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] 10.222.0.43 "GET /compute/v2.1/servers/3b712221-0858-4ebc-a276-06d9c0c84fb7" status: 200 len: 1211 microversion: 2.1 time: 0.355054 Oct 04 21:55:59.298465 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1427/2774] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:55:58 2022] GET /compute/v2.1/servers/3b712221-0858-4ebc-a276-06d9c0c84fb7 => generated 1211 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:55:59.846927 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-63794a7b-cfc9-4ef6-81d0-bbbb4d3cd466 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:55:59.848597 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-63794a7b-cfc9-4ef6-81d0-bbbb4d3cd466 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] [instance: 4b3f3cb9-cdd4-4881-923f-bb3447b249b9] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:55:59.856821 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-63794a7b-cfc9-4ef6-81d0-bbbb4d3cd466 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:59.857997 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-63794a7b-cfc9-4ef6-81d0-bbbb4d3cd466 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:59.858910 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-63794a7b-cfc9-4ef6-81d0-bbbb4d3cd466 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:59.859935 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-63794a7b-cfc9-4ef6-81d0-bbbb4d3cd466 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:59.860576 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-63794a7b-cfc9-4ef6-81d0-bbbb4d3cd466 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:59.861167 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-63794a7b-cfc9-4ef6-81d0-bbbb4d3cd466 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:00.217211 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-43d092f9-a941-456c-9a36-c7baf58b151e tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:00.220642 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-43d092f9-a941-456c-9a36-c7baf58b151e tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] [instance: 6188e227-0adf-4afd-897d-66578f442cae] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:56:00.284193 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-43d092f9-a941-456c-9a36-c7baf58b151e tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:00.285358 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-43d092f9-a941-456c-9a36-c7baf58b151e tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:00.287143 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-43d092f9-a941-456c-9a36-c7baf58b151e tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:00.288403 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-43d092f9-a941-456c-9a36-c7baf58b151e tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:00.304055 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-43d092f9-a941-456c-9a36-c7baf58b151e tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:00.307091 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-43d092f9-a941-456c-9a36-c7baf58b151e tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:00.982830 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-63794a7b-cfc9-4ef6-81d0-bbbb4d3cd466 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b45ebdb946b45c28fc4bca3dd5a3e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520782b7e0a94e3fb552744cc4584119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:56:01.005934 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-63794a7b-cfc9-4ef6-81d0-bbbb4d3cd466 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] 10.222.0.43 "GET /compute/v2.1/servers/4b3f3cb9-cdd4-4881-923f-bb3447b249b9" status: 200 len: 1318 microversion: 2.1 time: 1.163734 Oct 04 21:56:01.007209 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1348/2775] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:55:59 2022] GET /compute/v2.1/servers/4b3f3cb9-cdd4-4881-923f-bb3447b249b9 => generated 1318 bytes in 1166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:56:01.025421 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-4c0c3fe0-a251-48c5-8675-51810d26e5c0 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:01.026619 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-4c0c3fe0-a251-48c5-8675-51810d26e5c0 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] [instance: 3b712221-0858-4ebc-a276-06d9c0c84fb7] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:56:01.036954 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4c0c3fe0-a251-48c5-8675-51810d26e5c0 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:01.037504 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4c0c3fe0-a251-48c5-8675-51810d26e5c0 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:01.037946 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4c0c3fe0-a251-48c5-8675-51810d26e5c0 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:01.038980 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4c0c3fe0-a251-48c5-8675-51810d26e5c0 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:01.039440 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4c0c3fe0-a251-48c5-8675-51810d26e5c0 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:01.040060 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4c0c3fe0-a251-48c5-8675-51810d26e5c0 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:01.549466 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-4c0c3fe0-a251-48c5-8675-51810d26e5c0 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18de0948626e4a5c8a28711f943ba46e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb891227dcd84bd49d7215af9dce2db3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:56:01.565996 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-4c0c3fe0-a251-48c5-8675-51810d26e5c0 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] 10.222.0.43 "GET /compute/v2.1/servers/3b712221-0858-4ebc-a276-06d9c0c84fb7" status: 200 len: 1263 microversion: 2.1 time: 0.557256 Oct 04 21:56:01.566667 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1349/2776] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:56:01 2022] GET /compute/v2.1/servers/3b712221-0858-4ebc-a276-06d9c0c84fb7 => generated 1263 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:56:01.580273 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-84e18350-0a50-4e69-8ded-04e3f2ca9fb2 req-c51186e5-c475-439c-9822-794de9f41f67 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b3f3cb9-cdd4-4881-923f-bb3447b249b9", "tag": "7addb5c8-b6f8-47ba-8b56-d1984891b962"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:56:01.605783 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-84e18350-0a50-4e69-8ded-04e3f2ca9fb2 req-c51186e5-c475-439c-9822-794de9f41f67 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:01.606281 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-84e18350-0a50-4e69-8ded-04e3f2ca9fb2 req-c51186e5-c475-439c-9822-794de9f41f67 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:01.606750 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-84e18350-0a50-4e69-8ded-04e3f2ca9fb2 req-c51186e5-c475-439c-9822-794de9f41f67 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:01.635989 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-84e18350-0a50-4e69-8ded-04e3f2ca9fb2 req-c51186e5-c475-439c-9822-794de9f41f67 service nova] Creating event network-changed:7addb5c8-b6f8-47ba-8b56-d1984891b962 for instance 4b3f3cb9-cdd4-4881-923f-bb3447b249b9 on n-h1-860284-1 Oct 04 21:56:01.644310 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-84e18350-0a50-4e69-8ded-04e3f2ca9fb2 req-c51186e5-c475-439c-9822-794de9f41f67 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073838 Oct 04 21:56:01.646518 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1350/2777] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:56:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:56:01.830875 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-43d092f9-a941-456c-9a36-c7baf58b151e tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cca65ba35b14db8bf2187188de8c838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51745fc19321469bb20afabe48b2185d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:56:01.841366 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-43d092f9-a941-456c-9a36-c7baf58b151e tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] 10.222.0.43 "GET /compute/v2.1/servers/6188e227-0adf-4afd-897d-66578f442cae" status: 200 len: 1315 microversion: 2.1 time: 1.630158 Oct 04 21:56:01.846649 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1428/2778] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:56:00 2022] GET /compute/v2.1/servers/6188e227-0adf-4afd-897d-66578f442cae => generated 1315 bytes in 1636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:56:01.937248 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-72c98d94-a51a-4023-a0b0-bd1c92d3e2b7 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-171160538", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452", "networks": [{"uuid": "7f0614ac-f6a1-4d4e-8554-b89cfa5772c4"}]}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:56:02.036707 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-956d2e30-64f5-4c4a-b207-c53fcc2c7b98 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:02.042767 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-956d2e30-64f5-4c4a-b207-c53fcc2c7b98 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] [instance: 4b3f3cb9-cdd4-4881-923f-bb3447b249b9] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:56:02.067065 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-956d2e30-64f5-4c4a-b207-c53fcc2c7b98 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:02.069838 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.network.neutron [None req-72c98d94-a51a-4023-a0b0-bd1c92d3e2b7 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] validate_networks() for [('7f0614ac-f6a1-4d4e-8554-b89cfa5772c4', None, None, None, None, None)] {{(pid=134101) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:56:02.070853 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-956d2e30-64f5-4c4a-b207-c53fcc2c7b98 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:02.073065 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-956d2e30-64f5-4c4a-b207-c53fcc2c7b98 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:02.077432 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-956d2e30-64f5-4c4a-b207-c53fcc2c7b98 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:02.083524 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-956d2e30-64f5-4c4a-b207-c53fcc2c7b98 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:02.085082 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-956d2e30-64f5-4c4a-b207-c53fcc2c7b98 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:03.561546 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-956d2e30-64f5-4c4a-b207-c53fcc2c7b98 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b45ebdb946b45c28fc4bca3dd5a3e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520782b7e0a94e3fb552744cc4584119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:56:03.592822 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-956d2e30-64f5-4c4a-b207-c53fcc2c7b98 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] 10.222.0.43 "GET /compute/v2.1/servers/4b3f3cb9-cdd4-4881-923f-bb3447b249b9" status: 200 len: 1318 microversion: 2.1 time: 1.565461 Oct 04 21:56:03.594181 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1429/2779] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:56:02 2022] GET /compute/v2.1/servers/4b3f3cb9-cdd4-4881-923f-bb3447b249b9 => generated 1318 bytes in 1568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:56:03.600940 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-bd9a938e-5446-4c61-a523-caf19ab71803 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:03.601786 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-bd9a938e-5446-4c61-a523-caf19ab71803 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] [instance: 3b712221-0858-4ebc-a276-06d9c0c84fb7] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:56:03.609489 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bd9a938e-5446-4c61-a523-caf19ab71803 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:03.610442 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bd9a938e-5446-4c61-a523-caf19ab71803 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:03.611086 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bd9a938e-5446-4c61-a523-caf19ab71803 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:03.611983 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bd9a938e-5446-4c61-a523-caf19ab71803 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:03.612663 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bd9a938e-5446-4c61-a523-caf19ab71803 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:03.613253 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bd9a938e-5446-4c61-a523-caf19ab71803 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:04.336599 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-bd9a938e-5446-4c61-a523-caf19ab71803 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18de0948626e4a5c8a28711f943ba46e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb891227dcd84bd49d7215af9dce2db3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:56:04.339965 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:56:04.353555 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-bd9a938e-5446-4c61-a523-caf19ab71803 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] 10.222.0.43 "GET /compute/v2.1/servers/3b712221-0858-4ebc-a276-06d9c0c84fb7" status: 200 len: 1311 microversion: 2.1 time: 0.757384 Oct 04 21:56:04.354960 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1430/2780] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:56:03 2022] GET /compute/v2.1/servers/3b712221-0858-4ebc-a276-06d9c0c84fb7 => generated 1311 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:56:04.359940 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-a8f1f4d7-df4c-4d6a-bf31-0cefb0d1f4ce tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:04.360847 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-a8f1f4d7-df4c-4d6a-bf31-0cefb0d1f4ce tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] [instance: 6188e227-0adf-4afd-897d-66578f442cae] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:56:04.389447 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a8f1f4d7-df4c-4d6a-bf31-0cefb0d1f4ce tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:04.390336 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a8f1f4d7-df4c-4d6a-bf31-0cefb0d1f4ce tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:04.391584 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a8f1f4d7-df4c-4d6a-bf31-0cefb0d1f4ce tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:04.399462 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a8f1f4d7-df4c-4d6a-bf31-0cefb0d1f4ce tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:04.401269 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a8f1f4d7-df4c-4d6a-bf31-0cefb0d1f4ce tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:04.405376 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a8f1f4d7-df4c-4d6a-bf31-0cefb0d1f4ce tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:04.482752 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=32 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:56:05.089531 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-72c98d94-a51a-4023-a0b0-bd1c92d3e2b7 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Flavor limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:56:05.089958 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-72c98d94-a51a-4023-a0b0-bd1c92d3e2b7 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Image limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:56:05.090457 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-72c98d94-a51a-4023-a0b0-bd1c92d3e2b7 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Flavor pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:56:05.093849 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-72c98d94-a51a-4023-a0b0-bd1c92d3e2b7 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Image pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:56:05.094509 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-72c98d94-a51a-4023-a0b0-bd1c92d3e2b7 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:56:05.115768 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-72c98d94-a51a-4023-a0b0-bd1c92d3e2b7 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:05.116655 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-72c98d94-a51a-4023-a0b0-bd1c92d3e2b7 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:05.118048 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-72c98d94-a51a-4023-a0b0-bd1c92d3e2b7 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:05.121001 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-72c98d94-a51a-4023-a0b0-bd1c92d3e2b7 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:05.121732 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-72c98d94-a51a-4023-a0b0-bd1c92d3e2b7 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:05.126111 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-72c98d94-a51a-4023-a0b0-bd1c92d3e2b7 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:05.178013 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-72c98d94-a51a-4023-a0b0-bd1c92d3e2b7 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Getting quotas for project 40071e45805146529fb8abd40629c2ae. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:56:05.194222 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-72c98d94-a51a-4023-a0b0-bd1c92d3e2b7 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Getting quotas for user f5e807c724cc4c3887a2d360f0584ffb and project 40071e45805146529fb8abd40629c2ae. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:56:05.214103 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-a8f1f4d7-df4c-4d6a-bf31-0cefb0d1f4ce tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cca65ba35b14db8bf2187188de8c838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51745fc19321469bb20afabe48b2185d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:56:05.226346 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-72c98d94-a51a-4023-a0b0-bd1c92d3e2b7 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Going to run 1 instances... {{(pid=134101) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:56:05.229619 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-a8f1f4d7-df4c-4d6a-bf31-0cefb0d1f4ce tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] 10.222.0.43 "GET /compute/v2.1/servers/6188e227-0adf-4afd-897d-66578f442cae" status: 200 len: 1315 microversion: 2.1 time: 0.873314 Oct 04 21:56:05.233784 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1431/2781] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:56:04 2022] GET /compute/v2.1/servers/6188e227-0adf-4afd-897d-66578f442cae => generated 1315 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:56:05.233923 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-72c98d94-a51a-4023-a0b0-bd1c92d3e2b7 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] [instance: b176215c-96d4-402b-9c63-7ce87fe04ff6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='58548514-5dac-426c-81f5-19e3fba33e23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134101) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:56:05.242806 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-9383207d-fab9-41fb-aaa4-f42cf58d7b9e req-b918d3c9-6636-4be8-9808-e92488d5b0f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b712221-0858-4ebc-a276-06d9c0c84fb7", "tag": "9ee6b655-7175-482a-9bcb-2aea4d306e09"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:56:05.276557 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-9383207d-fab9-41fb-aaa4-f42cf58d7b9e req-b918d3c9-6636-4be8-9808-e92488d5b0f5 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:05.277045 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-9383207d-fab9-41fb-aaa4-f42cf58d7b9e req-b918d3c9-6636-4be8-9808-e92488d5b0f5 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:05.277534 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-9383207d-fab9-41fb-aaa4-f42cf58d7b9e req-b918d3c9-6636-4be8-9808-e92488d5b0f5 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:05.297028 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-9383207d-fab9-41fb-aaa4-f42cf58d7b9e req-b918d3c9-6636-4be8-9808-e92488d5b0f5 service nova] Creating event network-changed:9ee6b655-7175-482a-9bcb-2aea4d306e09 for instance 3b712221-0858-4ebc-a276-06d9c0c84fb7 on n-h1-860284-1 Oct 04 21:56:05.317934 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-9383207d-fab9-41fb-aaa4-f42cf58d7b9e req-b918d3c9-6636-4be8-9808-e92488d5b0f5 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079244 Oct 04 21:56:05.320456 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1432/2782] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:56:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:56:05.336745 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-72c98d94-a51a-4023-a0b0-bd1c92d3e2b7 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.686019 Oct 04 21:56:05.337423 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1351/2783] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 21:56:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 3688 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:56:05.338866 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-5f12e54a-aa7e-418c-a3a4-d2cca62b6dbe tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:05.341347 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-5f12e54a-aa7e-418c-a3a4-d2cca62b6dbe tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] [instance: 4b3f3cb9-cdd4-4881-923f-bb3447b249b9] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:56:05.351693 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-b515b96f-1aa5-42f6-b303-feda0cc28acc tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:05.352983 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-b515b96f-1aa5-42f6-b303-feda0cc28acc tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] [instance: b176215c-96d4-402b-9c63-7ce87fe04ff6] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:56:05.370285 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5f12e54a-aa7e-418c-a3a4-d2cca62b6dbe tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:05.371339 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5f12e54a-aa7e-418c-a3a4-d2cca62b6dbe tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:05.373367 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5f12e54a-aa7e-418c-a3a4-d2cca62b6dbe tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:05.388177 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5f12e54a-aa7e-418c-a3a4-d2cca62b6dbe tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:05.392676 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5f12e54a-aa7e-418c-a3a4-d2cca62b6dbe tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:05.394310 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5f12e54a-aa7e-418c-a3a4-d2cca62b6dbe tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:05.528591 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-b515b96f-1aa5-42f6-b303-feda0cc28acc tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e807c724cc4c3887a2d360f0584ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40071e45805146529fb8abd40629c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:56:05.541587 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-b515b96f-1aa5-42f6-b303-feda0cc28acc tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] 10.222.0.43 "GET /compute/v2.1/servers/b176215c-96d4-402b-9c63-7ce87fe04ff6" status: 200 len: 1207 microversion: 2.1 time: 0.195509 Oct 04 21:56:05.542500 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1352/2784] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:56:05 2022] GET /compute/v2.1/servers/b176215c-96d4-402b-9c63-7ce87fe04ff6 => generated 1207 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:56:05.548809 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-83499d7b-3bcf-4d9f-addc-48d6ea19c74f tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:05.549526 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-83499d7b-3bcf-4d9f-addc-48d6ea19c74f tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] [instance: 3b712221-0858-4ebc-a276-06d9c0c84fb7] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:56:05.599328 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-83499d7b-3bcf-4d9f-addc-48d6ea19c74f tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:05.599328 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-83499d7b-3bcf-4d9f-addc-48d6ea19c74f tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:05.603865 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-83499d7b-3bcf-4d9f-addc-48d6ea19c74f tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:05.606977 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-83499d7b-3bcf-4d9f-addc-48d6ea19c74f tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:05.611000 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-83499d7b-3bcf-4d9f-addc-48d6ea19c74f tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:05.614357 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-83499d7b-3bcf-4d9f-addc-48d6ea19c74f tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:06.038217 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-5f12e54a-aa7e-418c-a3a4-d2cca62b6dbe tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b45ebdb946b45c28fc4bca3dd5a3e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520782b7e0a94e3fb552744cc4584119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:56:06.057507 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-5f12e54a-aa7e-418c-a3a4-d2cca62b6dbe tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] 10.222.0.43 "GET /compute/v2.1/servers/4b3f3cb9-cdd4-4881-923f-bb3447b249b9" status: 200 len: 1318 microversion: 2.1 time: 0.733350 Oct 04 21:56:06.059894 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1433/2785] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:56:05 2022] GET /compute/v2.1/servers/4b3f3cb9-cdd4-4881-923f-bb3447b249b9 => generated 1318 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:56:06.163556 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-2a0af7ab-2bea-4ee3-961c-d1ff021030ca req-836e8b1b-ffcb-4ed5-a180-993214f35b9d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6188e227-0adf-4afd-897d-66578f442cae", "tag": "3506c0a9-1b9f-478c-b518-015e52ed0a1a"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:56:06.184092 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-2a0af7ab-2bea-4ee3-961c-d1ff021030ca req-836e8b1b-ffcb-4ed5-a180-993214f35b9d service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:06.184661 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-2a0af7ab-2bea-4ee3-961c-d1ff021030ca req-836e8b1b-ffcb-4ed5-a180-993214f35b9d service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:06.196324 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-2a0af7ab-2bea-4ee3-961c-d1ff021030ca req-836e8b1b-ffcb-4ed5-a180-993214f35b9d service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:06.221751 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-2a0af7ab-2bea-4ee3-961c-d1ff021030ca req-836e8b1b-ffcb-4ed5-a180-993214f35b9d service nova] Creating event network-changed:3506c0a9-1b9f-478c-b518-015e52ed0a1a for instance 6188e227-0adf-4afd-897d-66578f442cae on n-h2-860284-1 Oct 04 21:56:06.245169 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-2a0af7ab-2bea-4ee3-961c-d1ff021030ca req-836e8b1b-ffcb-4ed5-a180-993214f35b9d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087070 Oct 04 21:56:06.246505 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1434/2786] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:56:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:56:06.268447 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-abade142-0ba2-4d08-b85f-897939cf27ad tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:06.269180 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-abade142-0ba2-4d08-b85f-897939cf27ad tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] [instance: 6188e227-0adf-4afd-897d-66578f442cae] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:56:06.294291 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-abade142-0ba2-4d08-b85f-897939cf27ad tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:06.298679 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-abade142-0ba2-4d08-b85f-897939cf27ad tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:06.299874 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-abade142-0ba2-4d08-b85f-897939cf27ad tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:06.302667 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-abade142-0ba2-4d08-b85f-897939cf27ad tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:06.303336 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-abade142-0ba2-4d08-b85f-897939cf27ad tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:06.305062 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-abade142-0ba2-4d08-b85f-897939cf27ad tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:06.714833 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-83499d7b-3bcf-4d9f-addc-48d6ea19c74f tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18de0948626e4a5c8a28711f943ba46e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb891227dcd84bd49d7215af9dce2db3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:56:06.742873 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-83499d7b-3bcf-4d9f-addc-48d6ea19c74f tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] 10.222.0.43 "GET /compute/v2.1/servers/3b712221-0858-4ebc-a276-06d9c0c84fb7" status: 200 len: 1311 microversion: 2.1 time: 1.196709 Oct 04 21:56:06.749391 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1353/2787] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:56:05 2022] GET /compute/v2.1/servers/3b712221-0858-4ebc-a276-06d9c0c84fb7 => generated 1311 bytes in 1204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:56:06.770876 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-8fb47a35-f350-4828-b479-d15a3fb3d8c4 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:06.790325 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-8fb47a35-f350-4828-b479-d15a3fb3d8c4 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] [instance: b176215c-96d4-402b-9c63-7ce87fe04ff6] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:56:06.792473 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=7,nova_api:DELETE=3 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:56:06.825832 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8fb47a35-f350-4828-b479-d15a3fb3d8c4 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:06.827940 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8fb47a35-f350-4828-b479-d15a3fb3d8c4 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:06.829348 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8fb47a35-f350-4828-b479-d15a3fb3d8c4 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:06.831799 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8fb47a35-f350-4828-b479-d15a3fb3d8c4 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:06.832748 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8fb47a35-f350-4828-b479-d15a3fb3d8c4 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:06.835393 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8fb47a35-f350-4828-b479-d15a3fb3d8c4 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:07.065723 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-8fb47a35-f350-4828-b479-d15a3fb3d8c4 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e807c724cc4c3887a2d360f0584ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40071e45805146529fb8abd40629c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:56:07.087245 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-8fb47a35-f350-4828-b479-d15a3fb3d8c4 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] 10.222.0.43 "GET /compute/v2.1/servers/b176215c-96d4-402b-9c63-7ce87fe04ff6" status: 200 len: 1259 microversion: 2.1 time: 0.330508 Oct 04 21:56:07.087912 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1354/2788] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:56:06 2022] GET /compute/v2.1/servers/b176215c-96d4-402b-9c63-7ce87fe04ff6 => generated 1259 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:56:07.093387 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-ecbd2e77-d00b-40d5-a839-9ced7c042c81 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:07.105466 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-ecbd2e77-d00b-40d5-a839-9ced7c042c81 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] [instance: 4b3f3cb9-cdd4-4881-923f-bb3447b249b9] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:56:07.143518 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ecbd2e77-d00b-40d5-a839-9ced7c042c81 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:07.144037 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ecbd2e77-d00b-40d5-a839-9ced7c042c81 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:07.144499 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ecbd2e77-d00b-40d5-a839-9ced7c042c81 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:07.147378 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ecbd2e77-d00b-40d5-a839-9ced7c042c81 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:07.148416 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ecbd2e77-d00b-40d5-a839-9ced7c042c81 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:07.151920 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ecbd2e77-d00b-40d5-a839-9ced7c042c81 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:07.321973 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-abade142-0ba2-4d08-b85f-897939cf27ad tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cca65ba35b14db8bf2187188de8c838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51745fc19321469bb20afabe48b2185d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:56:07.338724 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-abade142-0ba2-4d08-b85f-897939cf27ad tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] 10.222.0.43 "GET /compute/v2.1/servers/6188e227-0adf-4afd-897d-66578f442cae" status: 200 len: 1315 microversion: 2.1 time: 1.079153 Oct 04 21:56:07.355434 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1435/2789] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:56:06 2022] GET /compute/v2.1/servers/6188e227-0adf-4afd-897d-66578f442cae => generated 1315 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:56:07.739462 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-ecbd2e77-d00b-40d5-a839-9ced7c042c81 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b45ebdb946b45c28fc4bca3dd5a3e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520782b7e0a94e3fb552744cc4584119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:56:07.752930 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-ecbd2e77-d00b-40d5-a839-9ced7c042c81 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] 10.222.0.43 "GET /compute/v2.1/servers/4b3f3cb9-cdd4-4881-923f-bb3447b249b9" status: 200 len: 1318 microversion: 2.1 time: 0.662859 Oct 04 21:56:07.769063 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1355/2790] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:56:07 2022] GET /compute/v2.1/servers/4b3f3cb9-cdd4-4881-923f-bb3447b249b9 => generated 1318 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:56:07.779075 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-ce4f3859-b44f-451b-8d17-6e70fb01d6f3 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:07.779862 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-ce4f3859-b44f-451b-8d17-6e70fb01d6f3 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] [instance: 3b712221-0858-4ebc-a276-06d9c0c84fb7] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:56:07.815376 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ce4f3859-b44f-451b-8d17-6e70fb01d6f3 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:07.822586 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ce4f3859-b44f-451b-8d17-6e70fb01d6f3 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:07.824420 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ce4f3859-b44f-451b-8d17-6e70fb01d6f3 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:07.826053 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ce4f3859-b44f-451b-8d17-6e70fb01d6f3 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:07.827868 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ce4f3859-b44f-451b-8d17-6e70fb01d6f3 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:07.830878 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ce4f3859-b44f-451b-8d17-6e70fb01d6f3 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:08.113016 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-8e5a16e2-d750-46ec-a11e-c86090acd739 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:08.114234 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-8e5a16e2-d750-46ec-a11e-c86090acd739 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] [instance: b176215c-96d4-402b-9c63-7ce87fe04ff6] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:56:08.135217 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8e5a16e2-d750-46ec-a11e-c86090acd739 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:08.136723 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8e5a16e2-d750-46ec-a11e-c86090acd739 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:08.142958 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8e5a16e2-d750-46ec-a11e-c86090acd739 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:08.146450 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8e5a16e2-d750-46ec-a11e-c86090acd739 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:08.147192 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8e5a16e2-d750-46ec-a11e-c86090acd739 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:08.148074 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8e5a16e2-d750-46ec-a11e-c86090acd739 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:08.148850 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-ce4f3859-b44f-451b-8d17-6e70fb01d6f3 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18de0948626e4a5c8a28711f943ba46e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb891227dcd84bd49d7215af9dce2db3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:56:08.158607 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-ce4f3859-b44f-451b-8d17-6e70fb01d6f3 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] 10.222.0.43 "GET /compute/v2.1/servers/3b712221-0858-4ebc-a276-06d9c0c84fb7" status: 200 len: 1311 microversion: 2.1 time: 0.385163 Oct 04 21:56:08.170928 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1436/2791] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:56:07 2022] GET /compute/v2.1/servers/3b712221-0858-4ebc-a276-06d9c0c84fb7 => generated 1311 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:56:08.251174 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-8e5a16e2-d750-46ec-a11e-c86090acd739 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e807c724cc4c3887a2d360f0584ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40071e45805146529fb8abd40629c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:56:08.261532 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-8e5a16e2-d750-46ec-a11e-c86090acd739 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] 10.222.0.43 "GET /compute/v2.1/servers/b176215c-96d4-402b-9c63-7ce87fe04ff6" status: 200 len: 1265 microversion: 2.1 time: 0.154623 Oct 04 21:56:08.279047 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1356/2792] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:56:08 2022] GET /compute/v2.1/servers/b176215c-96d4-402b-9c63-7ce87fe04ff6 => generated 1265 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:56:08.370102 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-a97602e2-2cb7-4644-be58-8f17475e7156 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:08.372534 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-a97602e2-2cb7-4644-be58-8f17475e7156 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] [instance: 6188e227-0adf-4afd-897d-66578f442cae] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:56:08.384603 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a97602e2-2cb7-4644-be58-8f17475e7156 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:08.385556 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a97602e2-2cb7-4644-be58-8f17475e7156 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:08.386579 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a97602e2-2cb7-4644-be58-8f17475e7156 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:08.388215 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a97602e2-2cb7-4644-be58-8f17475e7156 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:08.389312 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a97602e2-2cb7-4644-be58-8f17475e7156 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:08.390091 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a97602e2-2cb7-4644-be58-8f17475e7156 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:08.433139 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell0:SELECT=6 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:56:08.780199 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-b561fc52-0d2b-4517-9d6c-203e1109d153 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:08.781758 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-b561fc52-0d2b-4517-9d6c-203e1109d153 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] [instance: 4b3f3cb9-cdd4-4881-923f-bb3447b249b9] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:56:08.796514 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b561fc52-0d2b-4517-9d6c-203e1109d153 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:08.798489 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b561fc52-0d2b-4517-9d6c-203e1109d153 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:08.802973 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b561fc52-0d2b-4517-9d6c-203e1109d153 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:08.804140 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b561fc52-0d2b-4517-9d6c-203e1109d153 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:08.805392 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b561fc52-0d2b-4517-9d6c-203e1109d153 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:08.806029 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b561fc52-0d2b-4517-9d6c-203e1109d153 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:08.826936 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-a97602e2-2cb7-4644-be58-8f17475e7156 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cca65ba35b14db8bf2187188de8c838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51745fc19321469bb20afabe48b2185d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:56:08.839379 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-a97602e2-2cb7-4644-be58-8f17475e7156 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] 10.222.0.43 "GET /compute/v2.1/servers/6188e227-0adf-4afd-897d-66578f442cae" status: 200 len: 1315 microversion: 2.1 time: 0.476058 Oct 04 21:56:08.840166 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1437/2793] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:56:08 2022] GET /compute/v2.1/servers/6188e227-0adf-4afd-897d-66578f442cae => generated 1315 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:56:09.158271 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-b561fc52-0d2b-4517-9d6c-203e1109d153 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b45ebdb946b45c28fc4bca3dd5a3e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520782b7e0a94e3fb552744cc4584119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:56:09.170921 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-b561fc52-0d2b-4517-9d6c-203e1109d153 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] 10.222.0.43 "GET /compute/v2.1/servers/4b3f3cb9-cdd4-4881-923f-bb3447b249b9" status: 200 len: 1318 microversion: 2.1 time: 0.394998 Oct 04 21:56:09.188372 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1357/2794] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:56:08 2022] GET /compute/v2.1/servers/4b3f3cb9-cdd4-4881-923f-bb3447b249b9 => generated 1318 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:56:09.200412 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-d7785ca3-af6c-42df-b8f1-9a7814a2a8cf tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:09.201557 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-d7785ca3-af6c-42df-b8f1-9a7814a2a8cf tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] [instance: 3b712221-0858-4ebc-a276-06d9c0c84fb7] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:56:09.212764 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d7785ca3-af6c-42df-b8f1-9a7814a2a8cf tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:09.213574 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d7785ca3-af6c-42df-b8f1-9a7814a2a8cf tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:09.214224 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d7785ca3-af6c-42df-b8f1-9a7814a2a8cf tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:09.215190 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d7785ca3-af6c-42df-b8f1-9a7814a2a8cf tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:09.216089 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d7785ca3-af6c-42df-b8f1-9a7814a2a8cf tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:09.216703 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d7785ca3-af6c-42df-b8f1-9a7814a2a8cf tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:09.282252 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell0:SELECT=38 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:56:09.286324 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-373a3139-2960-4b98-a040-94e22266bb75 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:09.287262 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-373a3139-2960-4b98-a040-94e22266bb75 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] [instance: b176215c-96d4-402b-9c63-7ce87fe04ff6] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:56:09.300405 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-373a3139-2960-4b98-a040-94e22266bb75 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:09.303031 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-373a3139-2960-4b98-a040-94e22266bb75 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:09.303672 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-373a3139-2960-4b98-a040-94e22266bb75 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:09.304561 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-373a3139-2960-4b98-a040-94e22266bb75 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:09.305178 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-373a3139-2960-4b98-a040-94e22266bb75 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:09.305843 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-373a3139-2960-4b98-a040-94e22266bb75 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:09.409666 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-373a3139-2960-4b98-a040-94e22266bb75 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e807c724cc4c3887a2d360f0584ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40071e45805146529fb8abd40629c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:56:09.427182 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-373a3139-2960-4b98-a040-94e22266bb75 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] 10.222.0.43 "GET /compute/v2.1/servers/b176215c-96d4-402b-9c63-7ce87fe04ff6" status: 200 len: 1265 microversion: 2.1 time: 0.144704 Oct 04 21:56:09.441573 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1358/2795] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:56:09 2022] GET /compute/v2.1/servers/b176215c-96d4-402b-9c63-7ce87fe04ff6 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:56:09.545584 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-d7785ca3-af6c-42df-b8f1-9a7814a2a8cf tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18de0948626e4a5c8a28711f943ba46e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb891227dcd84bd49d7215af9dce2db3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:56:09.560401 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-d7785ca3-af6c-42df-b8f1-9a7814a2a8cf tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] 10.222.0.43 "GET /compute/v2.1/servers/3b712221-0858-4ebc-a276-06d9c0c84fb7" status: 200 len: 1311 microversion: 2.1 time: 0.363438 Oct 04 21:56:09.562049 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1438/2796] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:56:09 2022] GET /compute/v2.1/servers/3b712221-0858-4ebc-a276-06d9c0c84fb7 => generated 1311 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:56:09.864891 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-8c8e5df7-2a6e-4991-9efb-a37a8ac7945b tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:09.865735 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-8c8e5df7-2a6e-4991-9efb-a37a8ac7945b tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] [instance: 6188e227-0adf-4afd-897d-66578f442cae] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:56:09.883124 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8c8e5df7-2a6e-4991-9efb-a37a8ac7945b tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:09.884049 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8c8e5df7-2a6e-4991-9efb-a37a8ac7945b tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:09.884766 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8c8e5df7-2a6e-4991-9efb-a37a8ac7945b tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:09.886921 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8c8e5df7-2a6e-4991-9efb-a37a8ac7945b tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:09.887400 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8c8e5df7-2a6e-4991-9efb-a37a8ac7945b tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:09.887838 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8c8e5df7-2a6e-4991-9efb-a37a8ac7945b tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:10.202666 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-8d1b13c4-e75b-45b4-9787-af5b5d7a86ac tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:10.203703 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-8d1b13c4-e75b-45b4-9787-af5b5d7a86ac tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] [instance: 4b3f3cb9-cdd4-4881-923f-bb3447b249b9] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:56:10.216927 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8d1b13c4-e75b-45b4-9787-af5b5d7a86ac tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:10.216927 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8d1b13c4-e75b-45b4-9787-af5b5d7a86ac tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:10.217373 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8d1b13c4-e75b-45b4-9787-af5b5d7a86ac tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:10.221764 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8d1b13c4-e75b-45b4-9787-af5b5d7a86ac tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:10.222328 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8d1b13c4-e75b-45b4-9787-af5b5d7a86ac tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:10.228627 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8d1b13c4-e75b-45b4-9787-af5b5d7a86ac tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:10.888920 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-8d1b13c4-e75b-45b4-9787-af5b5d7a86ac tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b45ebdb946b45c28fc4bca3dd5a3e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520782b7e0a94e3fb552744cc4584119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:56:10.904649 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-8d1b13c4-e75b-45b4-9787-af5b5d7a86ac tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] 10.222.0.43 "GET /compute/v2.1/servers/4b3f3cb9-cdd4-4881-923f-bb3447b249b9" status: 200 len: 1318 microversion: 2.1 time: 0.707074 Oct 04 21:56:10.905893 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1439/2797] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:56:10 2022] GET /compute/v2.1/servers/4b3f3cb9-cdd4-4881-923f-bb3447b249b9 => generated 1318 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:56:10.924303 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-5490ae6d-45b9-4629-bb4c-6e1187238c0f req-3fdf1f0d-690f-4cb6-abfe-a1012c3703ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b712221-0858-4ebc-a276-06d9c0c84fb7", "name": "network-vif-plugged", "status": "completed", "tag": "9ee6b655-7175-482a-9bcb-2aea4d306e09"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:56:10.939339 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-5490ae6d-45b9-4629-bb4c-6e1187238c0f req-3fdf1f0d-690f-4cb6-abfe-a1012c3703ac service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:10.939846 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-5490ae6d-45b9-4629-bb4c-6e1187238c0f req-3fdf1f0d-690f-4cb6-abfe-a1012c3703ac service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:10.940271 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-5490ae6d-45b9-4629-bb4c-6e1187238c0f req-3fdf1f0d-690f-4cb6-abfe-a1012c3703ac service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:10.955861 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-5490ae6d-45b9-4629-bb4c-6e1187238c0f req-3fdf1f0d-690f-4cb6-abfe-a1012c3703ac service nova] Creating event network-vif-plugged:9ee6b655-7175-482a-9bcb-2aea4d306e09 for instance 3b712221-0858-4ebc-a276-06d9c0c84fb7 on n-h1-860284-1 Oct 04 21:56:10.963284 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-5490ae6d-45b9-4629-bb4c-6e1187238c0f req-3fdf1f0d-690f-4cb6-abfe-a1012c3703ac service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055768 Oct 04 21:56:10.964784 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1440/2798] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:56:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:56:10.972866 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-c47bd0ae-f3b5-42ec-8d41-b6ca4547f26e tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:10.974005 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-c47bd0ae-f3b5-42ec-8d41-b6ca4547f26e tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] [instance: b176215c-96d4-402b-9c63-7ce87fe04ff6] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:56:10.984805 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c47bd0ae-f3b5-42ec-8d41-b6ca4547f26e tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:10.985686 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c47bd0ae-f3b5-42ec-8d41-b6ca4547f26e tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:10.986445 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c47bd0ae-f3b5-42ec-8d41-b6ca4547f26e tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:10.986621 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-8c8e5df7-2a6e-4991-9efb-a37a8ac7945b tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cca65ba35b14db8bf2187188de8c838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51745fc19321469bb20afabe48b2185d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:56:10.987683 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c47bd0ae-f3b5-42ec-8d41-b6ca4547f26e tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:10.989580 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c47bd0ae-f3b5-42ec-8d41-b6ca4547f26e tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:10.990266 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c47bd0ae-f3b5-42ec-8d41-b6ca4547f26e tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:11.012121 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-8c8e5df7-2a6e-4991-9efb-a37a8ac7945b tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] 10.222.0.43 "GET /compute/v2.1/servers/6188e227-0adf-4afd-897d-66578f442cae" status: 200 len: 1315 microversion: 2.1 time: 1.152626 Oct 04 21:56:11.012732 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1359/2799] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:56:09 2022] GET /compute/v2.1/servers/6188e227-0adf-4afd-897d-66578f442cae => generated 1315 bytes in 1154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:56:11.020756 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-858bf013-c92b-4dec-85e8-e8faa549b7cd tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:11.021368 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-858bf013-c92b-4dec-85e8-e8faa549b7cd tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] [instance: 3b712221-0858-4ebc-a276-06d9c0c84fb7] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:56:11.038248 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-858bf013-c92b-4dec-85e8-e8faa549b7cd tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:11.038871 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-858bf013-c92b-4dec-85e8-e8faa549b7cd tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:11.039250 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-858bf013-c92b-4dec-85e8-e8faa549b7cd tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:11.040121 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-858bf013-c92b-4dec-85e8-e8faa549b7cd tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:11.041083 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-858bf013-c92b-4dec-85e8-e8faa549b7cd tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:11.041524 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-858bf013-c92b-4dec-85e8-e8faa549b7cd tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:11.563275 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-c47bd0ae-f3b5-42ec-8d41-b6ca4547f26e tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e807c724cc4c3887a2d360f0584ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40071e45805146529fb8abd40629c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:56:11.582276 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-c47bd0ae-f3b5-42ec-8d41-b6ca4547f26e tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] 10.222.0.43 "GET /compute/v2.1/servers/b176215c-96d4-402b-9c63-7ce87fe04ff6" status: 200 len: 1307 microversion: 2.1 time: 0.615070 Oct 04 21:56:11.587177 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-858bf013-c92b-4dec-85e8-e8faa549b7cd tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18de0948626e4a5c8a28711f943ba46e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb891227dcd84bd49d7215af9dce2db3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:56:11.593847 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1441/2800] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:56:10 2022] GET /compute/v2.1/servers/b176215c-96d4-402b-9c63-7ce87fe04ff6 => generated 1307 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:56:11.608573 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-858bf013-c92b-4dec-85e8-e8faa549b7cd tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] 10.222.0.43 "GET /compute/v2.1/servers/3b712221-0858-4ebc-a276-06d9c0c84fb7" status: 200 len: 1311 microversion: 2.1 time: 0.594749 Oct 04 21:56:11.610513 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1360/2801] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:56:11 2022] GET /compute/v2.1/servers/3b712221-0858-4ebc-a276-06d9c0c84fb7 => generated 1311 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:56:11.765946 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-d0ec1ba9-7ce5-4c75-82f4-3edbfc084a73 req-6b7677e1-f28b-4c14-a828-c7cdc740676f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b176215c-96d4-402b-9c63-7ce87fe04ff6", "tag": "0efd69ff-4474-4aaa-b2fd-c82bb955cb23"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:56:11.783105 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-d0ec1ba9-7ce5-4c75-82f4-3edbfc084a73 req-6b7677e1-f28b-4c14-a828-c7cdc740676f service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:11.783851 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-d0ec1ba9-7ce5-4c75-82f4-3edbfc084a73 req-6b7677e1-f28b-4c14-a828-c7cdc740676f service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:11.784392 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-d0ec1ba9-7ce5-4c75-82f4-3edbfc084a73 req-6b7677e1-f28b-4c14-a828-c7cdc740676f service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:11.814947 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-d0ec1ba9-7ce5-4c75-82f4-3edbfc084a73 req-6b7677e1-f28b-4c14-a828-c7cdc740676f service nova] Creating event network-changed:0efd69ff-4474-4aaa-b2fd-c82bb955cb23 for instance b176215c-96d4-402b-9c63-7ce87fe04ff6 on n-h2-860284-1 Oct 04 21:56:11.823753 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-d0ec1ba9-7ce5-4c75-82f4-3edbfc084a73 req-6b7677e1-f28b-4c14-a828-c7cdc740676f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062436 Oct 04 21:56:11.824879 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1442/2802] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:56:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:56:11.931567 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-09d5720d-eaf5-49a9-8a8e-889e040d937d tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:11.932208 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-09d5720d-eaf5-49a9-8a8e-889e040d937d tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] [instance: 4b3f3cb9-cdd4-4881-923f-bb3447b249b9] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:56:11.945014 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-09d5720d-eaf5-49a9-8a8e-889e040d937d tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:11.945625 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-09d5720d-eaf5-49a9-8a8e-889e040d937d tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:11.949915 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-09d5720d-eaf5-49a9-8a8e-889e040d937d tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:11.950927 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-09d5720d-eaf5-49a9-8a8e-889e040d937d tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:11.951477 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-09d5720d-eaf5-49a9-8a8e-889e040d937d tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:11.952522 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-09d5720d-eaf5-49a9-8a8e-889e040d937d tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:12.237627 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-09d5720d-eaf5-49a9-8a8e-889e040d937d tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b45ebdb946b45c28fc4bca3dd5a3e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520782b7e0a94e3fb552744cc4584119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:56:12.249457 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-09d5720d-eaf5-49a9-8a8e-889e040d937d tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] 10.222.0.43 "GET /compute/v2.1/servers/4b3f3cb9-cdd4-4881-923f-bb3447b249b9" status: 200 len: 1318 microversion: 2.1 time: 0.321913 Oct 04 21:56:12.252234 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1361/2803] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:56:11 2022] GET /compute/v2.1/servers/4b3f3cb9-cdd4-4881-923f-bb3447b249b9 => generated 1318 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:56:12.260741 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-336145f1-febd-451f-976e-ed03209f86ed tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:12.261934 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-336145f1-febd-451f-976e-ed03209f86ed tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] [instance: 6188e227-0adf-4afd-897d-66578f442cae] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:56:12.275062 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-336145f1-febd-451f-976e-ed03209f86ed tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:12.276909 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-336145f1-febd-451f-976e-ed03209f86ed tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:12.284797 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-336145f1-febd-451f-976e-ed03209f86ed tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:12.286240 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-336145f1-febd-451f-976e-ed03209f86ed tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:12.286908 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-336145f1-febd-451f-976e-ed03209f86ed tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:12.287508 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-336145f1-febd-451f-976e-ed03209f86ed tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:12.315845 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-380596e0-2f1c-47b0-a672-7ac1caeaaf1e tempest-VolumesNegativeTest-188637456 tempest-VolumesNegativeTest-188637456-project] Action: 'create', calling method: .version_select at 0x7fbb2e7095e0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-824975560", "metadata": {"Type": "work"}}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:56:12.321620 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-380596e0-2f1c-47b0-a672-7ac1caeaaf1e tempest-VolumesNegativeTest-188637456 tempest-VolumesNegativeTest-188637456-project] Request method failure captured: Oct 04 21:56:12.321620 n-d-860284-1 devstack@n-api.service[134102]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 04 21:56:12.321620 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 21:56:12.321620 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 21:56:12.321620 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 21:56:12.321620 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 121 Oct 04 21:56:12.321620 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 21:56:12.321620 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 21:56:12.321620 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 21:56:12.321620 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 21:56:12.321620 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPKv7Zjihh7CLUe3WuwCOXj3FPOk7V20emG2kTZ0FVnTu_jfAJNmTQwXWxTttRdUyC5L7n_NKUrCvMG5rHL6vdkt0DmZaZiGh9QoPMXmeJXXEcVTOXWMi7rBpXie2-XEKA5ijVdmBjvWTWPvZZC1G1UVR0x92wDmk7BiIVsfgfJvwXNo Oct 04 21:56:12.321620 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 21:56:12.321620 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 21:56:12.321620 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 21:56:12.321620 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 21:56:12.321620 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 21:56:12.321620 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 21:56:12.321620 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: 8aca9938a0b9417fb6607ba27660674e Oct 04 21:56:12.321620 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-VolumesNegativeTest-188637456 Oct 04 21:56:12.321620 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 21:56:12.321620 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 21:56:12.321620 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8aca9938a0b9417fb6607ba27660674e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_8aca9938a0b9417fb6607ba27660674e", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8aca9938a0b9417fb6607ba27660674e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/8aca9938a0b9417fb6607ba27660674e"}]}] Oct 04 21:56:12.321620 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-VolumesNegativeTest-188637456 Oct 04 21:56:12.321620 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: 8aca9938a0b9417fb6607ba27660674e Oct 04 21:56:12.321620 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-VolumesNegativeTest-188637456 Oct 04 21:56:12.321620 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-VolumesNegativeTest-188637456-project Oct 04 21:56:12.321620 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 21:56:12.321620 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 21:56:12.321620 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: 3a7be5d707834134bef203b0200ba003 Oct 04 21:56:12.321620 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-VolumesNegativeTest-188637456-project Oct 04 21:56:12.321620 n-d-860284-1 devstack@n-api.service[134102]: Oct 04 21:56:12.321620 n-d-860284-1 devstack@n-api.service[134102]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-824975560", "metadata": {"Type": "work"}}} Oct 04 21:56:12.321620 n-d-860284-1 devstack@n-api.service[134102]: method: Oct 04 21:56:12.321620 n-d-860284-1 devstack@n-api.service[134102]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 04 21:56:12.321620 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-824975560', 'metadata': {'Type': 'work'}}}} Oct 04 21:56:12.321620 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:56:12.321620 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:56:12.321620 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 21:56:12.321620 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 21:56:12.321620 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 21:56:12.321620 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise error Oct 04 21:56:12.321620 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Oct 04 21:56:12.321620 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:56:12.321620 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 04 21:56:12.321620 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 04 21:56:12.321620 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:56:12.321620 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 04 21:56:12.321620 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi '#$%' Oct 04 21:56:12.321620 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:56:12.321620 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:56:12.321620 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:56:12.321620 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:56:12.321620 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:56:12.321620 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:56:12.321620 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:56:12.321620 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:56:12.321620 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:56:12.321620 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:56:12.321620 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:56:12.321620 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:56:12.321620 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 21:56:12.321620 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 21:56:12.321620 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 21:56:12.321620 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 21:56:12.321620 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 21:56:12.321620 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 21:56:12.327731 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 04 21:56:12.327731 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:56:12.327731 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:56:12.327731 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:56:12.327731 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:56:12.327731 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:56:12.327731 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:56:12.327731 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 21:56:12.327731 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 21:56:12.327731 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 04 21:56:12.327731 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:56:12.331090 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-380596e0-2f1c-47b0-a672-7ac1caeaaf1e tempest-VolumesNegativeTest-188637456 tempest-VolumesNegativeTest-188637456-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:56:12.335334 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-380596e0-2f1c-47b0-a672-7ac1caeaaf1e tempest-VolumesNegativeTest-188637456 tempest-VolumesNegativeTest-188637456-project] 10.222.0.43 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.319988 Oct 04 21:56:12.336211 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1443/2804] 10.222.0.43 () {60 vars in 1156 bytes} [Tue Oct 4 21:56:12 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 322 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 04 21:56:12.345975 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-c49e2acb-8508-415b-aafc-786090c5a215 tempest-VolumesNegativeTest-188637456 tempest-VolumesNegativeTest-188637456-project] Action: 'create', calling method: .version_select at 0x7fbb2e72e940>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1444503337", "metadata": {"Type": "work"}}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:56:12.360386 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-c49e2acb-8508-415b-aafc-786090c5a215 tempest-VolumesNegativeTest-188637456 tempest-VolumesNegativeTest-188637456-project] Request method failure captured: Oct 04 21:56:12.360386 n-d-860284-1 devstack@n-api.service[134102]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 04 21:56:12.360386 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 21:56:12.360386 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 21:56:12.360386 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 21:56:12.360386 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 120 Oct 04 21:56:12.360386 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 21:56:12.360386 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 21:56:12.360386 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 21:56:12.360386 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 21:56:12.360386 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPKv7Zjihh7CLUe3WuwCOXj3FPOk7V20emG2kTZ0FVnTu_jfAJNmTQwXWxTttRdUyC5L7n_NKUrCvMG5rHL6vdkt0DmZaZiGh9QoPMXmeJXXEcVTOXWMi7rBpXie2-XEKA5ijVdmBjvWTWPvZZC1G1UVR0x92wDmk7BiIVsfgfJvwXNo Oct 04 21:56:12.360386 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 21:56:12.360386 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 21:56:12.360386 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 21:56:12.360386 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 21:56:12.360386 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 21:56:12.360386 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 21:56:12.360386 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: 8aca9938a0b9417fb6607ba27660674e Oct 04 21:56:12.360386 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-VolumesNegativeTest-188637456 Oct 04 21:56:12.360386 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 21:56:12.360386 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 21:56:12.360386 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8aca9938a0b9417fb6607ba27660674e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_8aca9938a0b9417fb6607ba27660674e", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8aca9938a0b9417fb6607ba27660674e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/8aca9938a0b9417fb6607ba27660674e"}]}] Oct 04 21:56:12.360386 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-VolumesNegativeTest-188637456 Oct 04 21:56:12.360386 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: 8aca9938a0b9417fb6607ba27660674e Oct 04 21:56:12.360386 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-VolumesNegativeTest-188637456 Oct 04 21:56:12.360386 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-VolumesNegativeTest-188637456-project Oct 04 21:56:12.360386 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 21:56:12.360386 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 21:56:12.360386 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: 3a7be5d707834134bef203b0200ba003 Oct 04 21:56:12.360386 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-VolumesNegativeTest-188637456-project Oct 04 21:56:12.360386 n-d-860284-1 devstack@n-api.service[134102]: Oct 04 21:56:12.360386 n-d-860284-1 devstack@n-api.service[134102]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1444503337", "metadata": {"Type": "work"}}} Oct 04 21:56:12.360386 n-d-860284-1 devstack@n-api.service[134102]: method: Oct 04 21:56:12.360386 n-d-860284-1 devstack@n-api.service[134102]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 04 21:56:12.360386 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1444503337', 'metadata': {'Type': 'work'}}}} Oct 04 21:56:12.360386 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:56:12.360386 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:56:12.360386 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 21:56:12.360386 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 21:56:12.360386 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 21:56:12.360386 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise error Oct 04 21:56:12.360386 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 04 21:56:12.360386 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:56:12.360386 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Oct 04 21:56:12.360386 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 04 21:56:12.360386 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:56:12.360386 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 04 21:56:12.360386 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi '0' Oct 04 21:56:12.360386 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:56:12.360386 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:56:12.360386 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:56:12.360386 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:56:12.360386 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:56:12.360386 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:56:12.360386 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:56:12.360386 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:56:12.360386 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:56:12.360386 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:56:12.360386 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:56:12.360386 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:56:12.360386 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 21:56:12.360386 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 21:56:12.360386 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 21:56:12.360386 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 21:56:12.360386 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 21:56:12.360386 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 21:56:12.364586 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 04 21:56:12.364586 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:56:12.364586 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:56:12.364586 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:56:12.364586 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:56:12.364586 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:56:12.364586 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:56:12.364586 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 21:56:12.364586 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 21:56:12.364586 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 04 21:56:12.364586 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:56:12.366397 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-c49e2acb-8508-415b-aafc-786090c5a215 tempest-VolumesNegativeTest-188637456 tempest-VolumesNegativeTest-188637456-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:56:12.370642 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-c49e2acb-8508-415b-aafc-786090c5a215 tempest-VolumesNegativeTest-188637456 tempest-VolumesNegativeTest-188637456-project] 10.222.0.43 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.028467 Oct 04 21:56:12.376499 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1444/2805] 10.222.0.43 () {60 vars in 1156 bytes} [Tue Oct 4 21:56:12 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 21:56:12.386058 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-a8eed105-abd4-4091-9deb-3a1c057f8068 tempest-VolumesNegativeTest-188637456 tempest-VolumesNegativeTest-188637456-project] Action: 'create', calling method: .version_select at 0x7fbb2e7694c0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1748916551", "metadata": {"Type": "work"}}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:56:12.390163 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-a8eed105-abd4-4091-9deb-3a1c057f8068 tempest-VolumesNegativeTest-188637456 tempest-VolumesNegativeTest-188637456-project] Request method failure captured: Oct 04 21:56:12.390163 n-d-860284-1 devstack@n-api.service[134102]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 04 21:56:12.390163 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 21:56:12.390163 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 21:56:12.390163 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 21:56:12.390163 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 119 Oct 04 21:56:12.390163 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 21:56:12.390163 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 21:56:12.390163 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 21:56:12.390163 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 21:56:12.390163 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPKv7Zjihh7CLUe3WuwCOXj3FPOk7V20emG2kTZ0FVnTu_jfAJNmTQwXWxTttRdUyC5L7n_NKUrCvMG5rHL6vdkt0DmZaZiGh9QoPMXmeJXXEcVTOXWMi7rBpXie2-XEKA5ijVdmBjvWTWPvZZC1G1UVR0x92wDmk7BiIVsfgfJvwXNo Oct 04 21:56:12.390163 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 21:56:12.390163 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 21:56:12.390163 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 21:56:12.390163 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 21:56:12.390163 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 21:56:12.390163 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 21:56:12.390163 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: 8aca9938a0b9417fb6607ba27660674e Oct 04 21:56:12.390163 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-VolumesNegativeTest-188637456 Oct 04 21:56:12.390163 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 21:56:12.390163 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 21:56:12.390163 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8aca9938a0b9417fb6607ba27660674e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_8aca9938a0b9417fb6607ba27660674e", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8aca9938a0b9417fb6607ba27660674e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/8aca9938a0b9417fb6607ba27660674e"}]}] Oct 04 21:56:12.390163 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-VolumesNegativeTest-188637456 Oct 04 21:56:12.390163 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: 8aca9938a0b9417fb6607ba27660674e Oct 04 21:56:12.390163 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-VolumesNegativeTest-188637456 Oct 04 21:56:12.390163 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-VolumesNegativeTest-188637456-project Oct 04 21:56:12.390163 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 21:56:12.390163 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 21:56:12.390163 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: 3a7be5d707834134bef203b0200ba003 Oct 04 21:56:12.390163 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-VolumesNegativeTest-188637456-project Oct 04 21:56:12.390163 n-d-860284-1 devstack@n-api.service[134102]: Oct 04 21:56:12.390163 n-d-860284-1 devstack@n-api.service[134102]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1748916551", "metadata": {"Type": "work"}}} Oct 04 21:56:12.390163 n-d-860284-1 devstack@n-api.service[134102]: method: Oct 04 21:56:12.390163 n-d-860284-1 devstack@n-api.service[134102]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 04 21:56:12.390163 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1748916551', 'metadata': {'Type': 'work'}}}} Oct 04 21:56:12.390163 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:56:12.390163 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:56:12.390163 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 21:56:12.390163 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 21:56:12.390163 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 21:56:12.390163 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise error Oct 04 21:56:12.390163 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Oct 04 21:56:12.390163 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:56:12.390163 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 04 21:56:12.390163 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 04 21:56:12.390163 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:56:12.390163 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 04 21:56:12.390163 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi '' Oct 04 21:56:12.390163 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:56:12.390163 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:56:12.390163 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:56:12.390163 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:56:12.390163 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:56:12.390163 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:56:12.390163 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:56:12.390163 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:56:12.390163 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:56:12.390163 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:56:12.390163 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:56:12.390163 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:56:12.390163 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 21:56:12.390163 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 21:56:12.390163 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 21:56:12.390163 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 21:56:12.390163 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 21:56:12.390163 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 21:56:12.395763 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 04 21:56:12.395763 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:56:12.395763 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:56:12.395763 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:56:12.395763 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:56:12.395763 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:56:12.395763 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:56:12.395763 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 21:56:12.395763 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 21:56:12.395763 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 04 21:56:12.395763 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:56:12.400398 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-a8eed105-abd4-4091-9deb-3a1c057f8068 tempest-VolumesNegativeTest-188637456 tempest-VolumesNegativeTest-188637456-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:56:12.401442 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-a8eed105-abd4-4091-9deb-3a1c057f8068 tempest-VolumesNegativeTest-188637456 tempest-VolumesNegativeTest-188637456-project] 10.222.0.43 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.019375 Oct 04 21:56:12.402583 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1445/2806] 10.222.0.43 () {60 vars in 1156 bytes} [Tue Oct 4 21:56:12 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 04 21:56:12.414658 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-65a3d025-6f49-4954-a251-5bda82652941 tempest-VolumesNegativeTest-188637456 tempest-VolumesNegativeTest-188637456-project] Calling method '.version_select at 0x7fbb2e6ec040>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:12.455112 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-65a3d025-6f49-4954-a251-5bda82652941 tempest-VolumesNegativeTest-188637456 tempest-VolumesNegativeTest-188637456-project] HTTP exception thrown: Volume tempest-invalid-1350205725 could not be found. Oct 04 21:56:12.466213 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-65a3d025-6f49-4954-a251-5bda82652941 tempest-VolumesNegativeTest-188637456 tempest-VolumesNegativeTest-188637456-project] Request method failure captured: Oct 04 21:56:12.466213 n-d-860284-1 devstack@n-api.service[134102]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1350205725 HTTP/1.1 Oct 04 21:56:12.466213 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 21:56:12.466213 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 21:56:12.466213 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 21:56:12.466213 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 21:56:12.466213 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 21:56:12.466213 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 21:56:12.466213 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 21:56:12.466213 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 21:56:12.466213 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPKv7Zjihh7CLUe3WuwCOXj3FPOk7V20emG2kTZ0FVnTu_jfAJNmTQwXWxTttRdUyC5L7n_NKUrCvMG5rHL6vdkt0DmZaZiGh9QoPMXmeJXXEcVTOXWMi7rBpXie2-XEKA5ijVdmBjvWTWPvZZC1G1UVR0x92wDmk7BiIVsfgfJvwXNo Oct 04 21:56:12.466213 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 21:56:12.466213 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 21:56:12.466213 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 21:56:12.466213 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 21:56:12.466213 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 21:56:12.466213 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 21:56:12.466213 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: 8aca9938a0b9417fb6607ba27660674e Oct 04 21:56:12.466213 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-VolumesNegativeTest-188637456 Oct 04 21:56:12.466213 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 21:56:12.466213 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 21:56:12.466213 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8aca9938a0b9417fb6607ba27660674e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_8aca9938a0b9417fb6607ba27660674e", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8aca9938a0b9417fb6607ba27660674e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/8aca9938a0b9417fb6607ba27660674e"}]}] Oct 04 21:56:12.466213 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-VolumesNegativeTest-188637456 Oct 04 21:56:12.466213 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: 8aca9938a0b9417fb6607ba27660674e Oct 04 21:56:12.466213 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-VolumesNegativeTest-188637456 Oct 04 21:56:12.466213 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-VolumesNegativeTest-188637456-project Oct 04 21:56:12.466213 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 21:56:12.466213 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 21:56:12.466213 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: 3a7be5d707834134bef203b0200ba003 Oct 04 21:56:12.466213 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-VolumesNegativeTest-188637456-project Oct 04 21:56:12.466213 n-d-860284-1 devstack@n-api.service[134102]: method: Oct 04 21:56:12.466213 n-d-860284-1 devstack@n-api.service[134102]: exception: Volume tempest-invalid-1350205725 could not be found. Oct 04 21:56:12.466213 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': 'tempest-invalid-1350205725'} Oct 04 21:56:12.466213 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:56:12.466213 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:56:12.466213 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 21:56:12.466213 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 21:56:12.466213 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 04 21:56:12.466213 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 04 21:56:12.466213 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 04 21:56:12.466213 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 04 21:56:12.466213 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 04 21:56:12.466213 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 04 21:56:12.466213 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 04 21:56:12.466213 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 04 21:56:12.466213 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 21:56:12.466213 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 21:56:12.466213 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 21:56:12.466213 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 21:56:12.466213 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1350205725 could not be found. (HTTP 404) (Request-ID: req-ae4159bf-14ff-4b4d-be6a-9499c6c07f69) Oct 04 21:56:12.466213 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:56:12.466213 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:56:12.466213 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:56:12.466213 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:56:12.466213 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 04 21:56:12.466213 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 04 21:56:12.466213 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 04 21:56:12.466213 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 04 21:56:12.466213 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 04 21:56:12.466213 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 04 21:56:12.466213 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 04 21:56:12.466213 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 04 21:56:12.466213 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 21:56:12.470394 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 21:56:12.470394 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 04 21:56:12.470394 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 04 21:56:12.470394 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 04 21:56:12.470394 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 04 21:56:12.470394 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 04 21:56:12.470394 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 04 21:56:12.470394 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 04 21:56:12.470394 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 04 21:56:12.470394 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 21:56:12.470394 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 21:56:12.470394 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 21:56:12.470394 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 21:56:12.470394 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1350205725 could not be found. Oct 04 21:56:12.470394 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:56:12.470394 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:56:12.470394 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:56:12.470394 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:56:12.470394 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:56:12.470394 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:56:12.470394 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:56:12.470394 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:56:12.470394 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:56:12.470394 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:56:12.470394 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:56:12.470394 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:56:12.470394 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 04 21:56:12.470394 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:56:12.470394 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1350205725 could not be found. Oct 04 21:56:12.470394 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:56:12.470394 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:56:12.470394 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:56:12.470394 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:56:12.470394 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:56:12.470394 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:56:12.470394 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:56:12.470394 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:56:12.470394 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1350205725 could not be found. Oct 04 21:56:12.470394 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:56:12.476517 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-65a3d025-6f49-4954-a251-5bda82652941 tempest-VolumesNegativeTest-188637456 tempest-VolumesNegativeTest-188637456-project] Returning 404 to user: Volume tempest-invalid-1350205725 could not be found. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:56:12.477596 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-65a3d025-6f49-4954-a251-5bda82652941 tempest-VolumesNegativeTest-188637456 tempest-VolumesNegativeTest-188637456-project] 10.222.0.43 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1350205725" status: 404 len: 99 microversion: 2.1 time: 0.070313 Oct 04 21:56:12.479183 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1446/2807] 10.222.0.43 () {58 vars in 1218 bytes} [Tue Oct 4 21:56:12 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1350205725 => generated 99 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 04 21:56:12.490316 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-6cd73af9-7c5a-462f-8652-37626ff74944 tempest-VolumesNegativeTest-188637456 tempest-VolumesNegativeTest-188637456-project] 10.222.0.43 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005424 Oct 04 21:56:12.491276 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1447/2808] 10.222.0.43 () {58 vars in 1140 bytes} [Tue Oct 4 21:56:12 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 04 21:56:12.510719 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-eabbf95c-ce16-4206-8806-b9c47b9fa283 tempest-VolumesNegativeTest-188637456 tempest-VolumesNegativeTest-188637456-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.012547 Oct 04 21:56:12.515208 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1448/2809] 10.222.0.43 () {58 vars in 1137 bytes} [Tue Oct 4 21:56:12 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 19 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Oct 04 21:56:12.525735 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-625c91fd-a7bc-48e0-9b00-b771cec3d67a tempest-VolumesNegativeTest-188637456 tempest-VolumesNegativeTest-188637456-project] Calling method '.version_select at 0x7fbb2e79ca60>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:12.561620 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-625c91fd-a7bc-48e0-9b00-b771cec3d67a tempest-VolumesNegativeTest-188637456 tempest-VolumesNegativeTest-188637456-project] HTTP exception thrown: Volume dffc4031-c0b7-4c9c-a02e-fa694dd5ac45 could not be found. Oct 04 21:56:12.568133 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-625c91fd-a7bc-48e0-9b00-b771cec3d67a tempest-VolumesNegativeTest-188637456 tempest-VolumesNegativeTest-188637456-project] Request method failure captured: Oct 04 21:56:12.568133 n-d-860284-1 devstack@n-api.service[134102]: request: DELETE /compute/v2.1/os-volumes/dffc4031-c0b7-4c9c-a02e-fa694dd5ac45 HTTP/1.1 Oct 04 21:56:12.568133 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 21:56:12.568133 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 21:56:12.568133 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 21:56:12.568133 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 21:56:12.568133 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 21:56:12.568133 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 21:56:12.568133 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 21:56:12.568133 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 21:56:12.568133 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPKv7Zjihh7CLUe3WuwCOXj3FPOk7V20emG2kTZ0FVnTu_jfAJNmTQwXWxTttRdUyC5L7n_NKUrCvMG5rHL6vdkt0DmZaZiGh9QoPMXmeJXXEcVTOXWMi7rBpXie2-XEKA5ijVdmBjvWTWPvZZC1G1UVR0x92wDmk7BiIVsfgfJvwXNo Oct 04 21:56:12.568133 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 21:56:12.568133 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 21:56:12.568133 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 21:56:12.568133 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 21:56:12.568133 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 21:56:12.568133 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 21:56:12.568133 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: 8aca9938a0b9417fb6607ba27660674e Oct 04 21:56:12.568133 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-VolumesNegativeTest-188637456 Oct 04 21:56:12.568133 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 21:56:12.568133 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 21:56:12.568133 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8aca9938a0b9417fb6607ba27660674e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_8aca9938a0b9417fb6607ba27660674e", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8aca9938a0b9417fb6607ba27660674e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/8aca9938a0b9417fb6607ba27660674e"}]}] Oct 04 21:56:12.568133 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-VolumesNegativeTest-188637456 Oct 04 21:56:12.568133 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: 8aca9938a0b9417fb6607ba27660674e Oct 04 21:56:12.568133 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-VolumesNegativeTest-188637456 Oct 04 21:56:12.568133 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-VolumesNegativeTest-188637456-project Oct 04 21:56:12.568133 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 21:56:12.568133 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 21:56:12.568133 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: 3a7be5d707834134bef203b0200ba003 Oct 04 21:56:12.568133 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-VolumesNegativeTest-188637456-project Oct 04 21:56:12.568133 n-d-860284-1 devstack@n-api.service[134102]: method: Oct 04 21:56:12.568133 n-d-860284-1 devstack@n-api.service[134102]: exception: Volume dffc4031-c0b7-4c9c-a02e-fa694dd5ac45 could not be found. Oct 04 21:56:12.568133 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': 'dffc4031-c0b7-4c9c-a02e-fa694dd5ac45'} Oct 04 21:56:12.568133 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:56:12.568133 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:56:12.568133 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 21:56:12.568133 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 21:56:12.568133 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 04 21:56:12.568133 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 04 21:56:12.568133 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 04 21:56:12.568133 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 04 21:56:12.568133 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 04 21:56:12.568133 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 04 21:56:12.568133 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 04 21:56:12.568133 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 04 21:56:12.568133 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 21:56:12.568133 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 21:56:12.568133 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 21:56:12.568133 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 21:56:12.568133 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume dffc4031-c0b7-4c9c-a02e-fa694dd5ac45 could not be found. (HTTP 404) (Request-ID: req-276a9c45-ace7-4e11-a16f-c0ccc9e904d1) Oct 04 21:56:12.568133 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:56:12.568133 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:56:12.568133 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:56:12.568133 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:56:12.568133 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 04 21:56:12.568133 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 04 21:56:12.568133 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 04 21:56:12.568133 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 04 21:56:12.568133 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 04 21:56:12.568133 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 04 21:56:12.568133 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 04 21:56:12.568133 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 04 21:56:12.568133 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 21:56:12.572470 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 21:56:12.572470 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 04 21:56:12.572470 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 04 21:56:12.572470 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 04 21:56:12.572470 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 04 21:56:12.572470 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 04 21:56:12.572470 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 04 21:56:12.572470 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 04 21:56:12.572470 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 04 21:56:12.572470 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 21:56:12.572470 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 21:56:12.572470 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 21:56:12.572470 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 21:56:12.572470 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume dffc4031-c0b7-4c9c-a02e-fa694dd5ac45 could not be found. Oct 04 21:56:12.572470 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:56:12.572470 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:56:12.572470 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:56:12.572470 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:56:12.572470 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:56:12.572470 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:56:12.572470 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:56:12.572470 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:56:12.572470 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:56:12.572470 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:56:12.572470 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:56:12.572470 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:56:12.572470 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 04 21:56:12.572470 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:56:12.572470 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume dffc4031-c0b7-4c9c-a02e-fa694dd5ac45 could not be found. Oct 04 21:56:12.572470 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:56:12.572470 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:56:12.572470 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:56:12.572470 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:56:12.572470 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:56:12.572470 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:56:12.572470 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:56:12.572470 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:56:12.572470 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume dffc4031-c0b7-4c9c-a02e-fa694dd5ac45 could not be found. Oct 04 21:56:12.572470 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:56:12.572470 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-625c91fd-a7bc-48e0-9b00-b771cec3d67a tempest-VolumesNegativeTest-188637456 tempest-VolumesNegativeTest-188637456-project] Returning 404 to user: Volume dffc4031-c0b7-4c9c-a02e-fa694dd5ac45 could not be found. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:56:12.572470 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-625c91fd-a7bc-48e0-9b00-b771cec3d67a tempest-VolumesNegativeTest-188637456 tempest-VolumesNegativeTest-188637456-project] 10.222.0.43 "DELETE /compute/v2.1/os-volumes/dffc4031-c0b7-4c9c-a02e-fa694dd5ac45" status: 404 len: 109 microversion: 2.1 time: 0.052155 Oct 04 21:56:12.572470 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1449/2810] 10.222.0.43 () {58 vars in 1248 bytes} [Tue Oct 4 21:56:12 2022] DELETE /compute/v2.1/os-volumes/dffc4031-c0b7-4c9c-a02e-fa694dd5ac45 => generated 109 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:56:12.588401 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-c5b6209b-1877-4d08-b9e0-ff3ccbe9f9e6 tempest-VolumesNegativeTest-188637456 tempest-VolumesNegativeTest-188637456-project] Calling method '.version_select at 0x7fbb2e7095e0>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:12.594529 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-336145f1-febd-451f-976e-ed03209f86ed tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cca65ba35b14db8bf2187188de8c838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51745fc19321469bb20afabe48b2185d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:56:12.608708 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-336145f1-febd-451f-976e-ed03209f86ed tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] 10.222.0.43 "GET /compute/v2.1/servers/6188e227-0adf-4afd-897d-66578f442cae" status: 200 len: 1315 microversion: 2.1 time: 0.351956 Oct 04 21:56:12.609902 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1362/2811] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:56:12 2022] GET /compute/v2.1/servers/6188e227-0adf-4afd-897d-66578f442cae => generated 1315 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:56:12.629533 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e8f612ab-0aaf-4ef6-9645-34eda407c12c tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:12.632262 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-e8f612ab-0aaf-4ef6-9645-34eda407c12c tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] [instance: b176215c-96d4-402b-9c63-7ce87fe04ff6] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:56:12.641476 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-c5b6209b-1877-4d08-b9e0-ff3ccbe9f9e6 tempest-VolumesNegativeTest-188637456 tempest-VolumesNegativeTest-188637456-project] HTTP exception thrown: Volume b069dd99-2993-4b8c-a75e-06c340141e4f could not be found. Oct 04 21:56:12.643834 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-c5b6209b-1877-4d08-b9e0-ff3ccbe9f9e6 tempest-VolumesNegativeTest-188637456 tempest-VolumesNegativeTest-188637456-project] Request method failure captured: Oct 04 21:56:12.643834 n-d-860284-1 devstack@n-api.service[134102]: request: GET /compute/v2.1/os-volumes/b069dd99-2993-4b8c-a75e-06c340141e4f HTTP/1.1 Oct 04 21:56:12.643834 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 21:56:12.643834 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 21:56:12.643834 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 21:56:12.643834 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 21:56:12.643834 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 21:56:12.643834 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 21:56:12.643834 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 21:56:12.643834 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 21:56:12.643834 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPKv7Zjihh7CLUe3WuwCOXj3FPOk7V20emG2kTZ0FVnTu_jfAJNmTQwXWxTttRdUyC5L7n_NKUrCvMG5rHL6vdkt0DmZaZiGh9QoPMXmeJXXEcVTOXWMi7rBpXie2-XEKA5ijVdmBjvWTWPvZZC1G1UVR0x92wDmk7BiIVsfgfJvwXNo Oct 04 21:56:12.643834 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 21:56:12.643834 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 21:56:12.643834 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 21:56:12.643834 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 21:56:12.643834 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 21:56:12.643834 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 21:56:12.643834 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: 8aca9938a0b9417fb6607ba27660674e Oct 04 21:56:12.643834 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-VolumesNegativeTest-188637456 Oct 04 21:56:12.643834 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 21:56:12.643834 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 21:56:12.643834 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8aca9938a0b9417fb6607ba27660674e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_8aca9938a0b9417fb6607ba27660674e", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8aca9938a0b9417fb6607ba27660674e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/8aca9938a0b9417fb6607ba27660674e"}]}] Oct 04 21:56:12.643834 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-VolumesNegativeTest-188637456 Oct 04 21:56:12.643834 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: 8aca9938a0b9417fb6607ba27660674e Oct 04 21:56:12.643834 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-VolumesNegativeTest-188637456 Oct 04 21:56:12.643834 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-VolumesNegativeTest-188637456-project Oct 04 21:56:12.643834 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 21:56:12.643834 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 21:56:12.643834 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: 3a7be5d707834134bef203b0200ba003 Oct 04 21:56:12.643834 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-VolumesNegativeTest-188637456-project Oct 04 21:56:12.643834 n-d-860284-1 devstack@n-api.service[134102]: method: Oct 04 21:56:12.643834 n-d-860284-1 devstack@n-api.service[134102]: exception: Volume b069dd99-2993-4b8c-a75e-06c340141e4f could not be found. Oct 04 21:56:12.643834 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': 'b069dd99-2993-4b8c-a75e-06c340141e4f'} Oct 04 21:56:12.643834 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:56:12.643834 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:56:12.643834 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 21:56:12.643834 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 21:56:12.643834 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 21:56:12.643834 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 21:56:12.643834 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 21:56:12.643834 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 21:56:12.643834 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 21:56:12.643834 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 21:56:12.643834 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 21:56:12.643834 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 21:56:12.643834 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 21:56:12.643834 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 21:56:12.643834 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 21:56:12.643834 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 21:56:12.643834 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b069dd99-2993-4b8c-a75e-06c340141e4f could not be found. (HTTP 404) (Request-ID: req-554cedb2-9a26-4f19-b361-3d373c5334ce) Oct 04 21:56:12.643834 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:56:12.643834 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:56:12.643834 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:56:12.643834 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:56:12.643834 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 04 21:56:12.643834 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 04 21:56:12.643834 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 04 21:56:12.643834 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 04 21:56:12.643834 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 04 21:56:12.643834 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 04 21:56:12.643834 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 04 21:56:12.643834 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 04 21:56:12.643834 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 21:56:12.649246 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 21:56:12.649246 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 21:56:12.649246 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 21:56:12.649246 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 21:56:12.649246 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 21:56:12.649246 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 21:56:12.649246 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 21:56:12.649246 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 21:56:12.649246 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 21:56:12.649246 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 21:56:12.649246 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 21:56:12.649246 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 21:56:12.649246 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 21:56:12.649246 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b069dd99-2993-4b8c-a75e-06c340141e4f could not be found. Oct 04 21:56:12.649246 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:56:12.649246 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:56:12.649246 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:56:12.649246 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:56:12.649246 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:56:12.649246 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:56:12.649246 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:56:12.649246 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:56:12.649246 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:56:12.649246 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:56:12.649246 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:56:12.649246 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:56:12.649246 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 04 21:56:12.649246 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:56:12.649246 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b069dd99-2993-4b8c-a75e-06c340141e4f could not be found. Oct 04 21:56:12.649246 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:56:12.649246 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:56:12.649246 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:56:12.649246 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:56:12.649246 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:56:12.649246 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:56:12.649246 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:56:12.649246 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:56:12.649246 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b069dd99-2993-4b8c-a75e-06c340141e4f could not be found. Oct 04 21:56:12.649246 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:56:12.649246 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-c5b6209b-1877-4d08-b9e0-ff3ccbe9f9e6 tempest-VolumesNegativeTest-188637456 tempest-VolumesNegativeTest-188637456-project] Returning 404 to user: Volume b069dd99-2993-4b8c-a75e-06c340141e4f could not be found. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:56:12.649246 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-c5b6209b-1877-4d08-b9e0-ff3ccbe9f9e6 tempest-VolumesNegativeTest-188637456 tempest-VolumesNegativeTest-188637456-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/b069dd99-2993-4b8c-a75e-06c340141e4f" status: 404 len: 109 microversion: 2.1 time: 0.069318 Oct 04 21:56:12.649246 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1450/2812] 10.222.0.43 () {58 vars in 1245 bytes} [Tue Oct 4 21:56:12 2022] GET /compute/v2.1/os-volumes/b069dd99-2993-4b8c-a75e-06c340141e4f => generated 109 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:56:12.653877 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e8f612ab-0aaf-4ef6-9645-34eda407c12c tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:12.653877 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e8f612ab-0aaf-4ef6-9645-34eda407c12c tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:12.655922 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-477bab5f-53ca-401c-bdb4-3d1008f4625c tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:12.656737 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-477bab5f-53ca-401c-bdb4-3d1008f4625c tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] [instance: 3b712221-0858-4ebc-a276-06d9c0c84fb7] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:56:12.664337 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e8f612ab-0aaf-4ef6-9645-34eda407c12c tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:12.665405 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-477bab5f-53ca-401c-bdb4-3d1008f4625c tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:12.665908 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-477bab5f-53ca-401c-bdb4-3d1008f4625c tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:12.666429 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-477bab5f-53ca-401c-bdb4-3d1008f4625c tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:12.667287 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-477bab5f-53ca-401c-bdb4-3d1008f4625c tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:12.667809 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-477bab5f-53ca-401c-bdb4-3d1008f4625c tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:12.668552 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-477bab5f-53ca-401c-bdb4-3d1008f4625c tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:12.670983 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e8f612ab-0aaf-4ef6-9645-34eda407c12c tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:12.672006 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e8f612ab-0aaf-4ef6-9645-34eda407c12c tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:12.673514 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e8f612ab-0aaf-4ef6-9645-34eda407c12c tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:12.743887 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=100 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:56:13.024135 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-e8f612ab-0aaf-4ef6-9645-34eda407c12c tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e807c724cc4c3887a2d360f0584ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40071e45805146529fb8abd40629c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:56:13.033122 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-e8f612ab-0aaf-4ef6-9645-34eda407c12c tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] 10.222.0.43 "GET /compute/v2.1/servers/b176215c-96d4-402b-9c63-7ce87fe04ff6" status: 200 len: 1307 microversion: 2.1 time: 0.409152 Oct 04 21:56:13.052296 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1363/2813] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:56:12 2022] GET /compute/v2.1/servers/b176215c-96d4-402b-9c63-7ce87fe04ff6 => generated 1307 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:56:13.098529 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-477bab5f-53ca-401c-bdb4-3d1008f4625c tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18de0948626e4a5c8a28711f943ba46e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb891227dcd84bd49d7215af9dce2db3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:56:13.115215 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-477bab5f-53ca-401c-bdb4-3d1008f4625c tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] 10.222.0.43 "GET /compute/v2.1/servers/3b712221-0858-4ebc-a276-06d9c0c84fb7" status: 200 len: 1311 microversion: 2.1 time: 0.465850 Oct 04 21:56:13.135566 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1451/2814] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:56:12 2022] GET /compute/v2.1/servers/3b712221-0858-4ebc-a276-06d9c0c84fb7 => generated 1311 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:56:13.278329 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-a6576d43-fb13-403d-8e30-2e3a9bbfb249 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:13.281744 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-a6576d43-fb13-403d-8e30-2e3a9bbfb249 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] [instance: 4b3f3cb9-cdd4-4881-923f-bb3447b249b9] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:56:13.294114 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a6576d43-fb13-403d-8e30-2e3a9bbfb249 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:13.308499 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a6576d43-fb13-403d-8e30-2e3a9bbfb249 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:13.309360 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a6576d43-fb13-403d-8e30-2e3a9bbfb249 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:13.310501 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a6576d43-fb13-403d-8e30-2e3a9bbfb249 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:13.312755 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a6576d43-fb13-403d-8e30-2e3a9bbfb249 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:13.315937 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a6576d43-fb13-403d-8e30-2e3a9bbfb249 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:13.627267 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-a6576d43-fb13-403d-8e30-2e3a9bbfb249 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b45ebdb946b45c28fc4bca3dd5a3e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520782b7e0a94e3fb552744cc4584119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:56:13.637093 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-26a32d7d-1ded-4d61-a7bd-6b53191f1995 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:13.638934 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-26a32d7d-1ded-4d61-a7bd-6b53191f1995 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] [instance: 6188e227-0adf-4afd-897d-66578f442cae] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:56:13.639263 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-a6576d43-fb13-403d-8e30-2e3a9bbfb249 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] 10.222.0.43 "GET /compute/v2.1/servers/4b3f3cb9-cdd4-4881-923f-bb3447b249b9" status: 200 len: 1318 microversion: 2.1 time: 0.366872 Oct 04 21:56:13.649623 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-26a32d7d-1ded-4d61-a7bd-6b53191f1995 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:13.653035 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-26a32d7d-1ded-4d61-a7bd-6b53191f1995 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:13.654917 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-26a32d7d-1ded-4d61-a7bd-6b53191f1995 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:13.655845 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-26a32d7d-1ded-4d61-a7bd-6b53191f1995 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:13.657342 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-26a32d7d-1ded-4d61-a7bd-6b53191f1995 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:13.659858 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1364/2815] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:56:13 2022] GET /compute/v2.1/servers/4b3f3cb9-cdd4-4881-923f-bb3447b249b9 => generated 1318 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:56:13.661130 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-26a32d7d-1ded-4d61-a7bd-6b53191f1995 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:14.063810 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-d1c66635-dda6-4d8d-88ad-b82088aa914f tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:14.064443 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-d1c66635-dda6-4d8d-88ad-b82088aa914f tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] [instance: b176215c-96d4-402b-9c63-7ce87fe04ff6] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:56:14.076696 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d1c66635-dda6-4d8d-88ad-b82088aa914f tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:14.077197 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d1c66635-dda6-4d8d-88ad-b82088aa914f tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:14.077639 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d1c66635-dda6-4d8d-88ad-b82088aa914f tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:14.082222 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d1c66635-dda6-4d8d-88ad-b82088aa914f tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:14.099381 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d1c66635-dda6-4d8d-88ad-b82088aa914f tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:14.099841 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d1c66635-dda6-4d8d-88ad-b82088aa914f tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:14.109070 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-26a32d7d-1ded-4d61-a7bd-6b53191f1995 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cca65ba35b14db8bf2187188de8c838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51745fc19321469bb20afabe48b2185d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:56:14.121102 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-26a32d7d-1ded-4d61-a7bd-6b53191f1995 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] 10.222.0.43 "GET /compute/v2.1/servers/6188e227-0adf-4afd-897d-66578f442cae" status: 200 len: 1315 microversion: 2.1 time: 0.487719 Oct 04 21:56:14.130058 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1452/2816] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:56:13 2022] GET /compute/v2.1/servers/6188e227-0adf-4afd-897d-66578f442cae => generated 1315 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:56:14.148469 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-ef967517-04b7-4200-85a7-7cfc3c0b5b80 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:14.149366 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-ef967517-04b7-4200-85a7-7cfc3c0b5b80 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] [instance: 3b712221-0858-4ebc-a276-06d9c0c84fb7] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:56:14.161593 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ef967517-04b7-4200-85a7-7cfc3c0b5b80 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:14.162356 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ef967517-04b7-4200-85a7-7cfc3c0b5b80 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:14.163023 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ef967517-04b7-4200-85a7-7cfc3c0b5b80 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:14.167511 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ef967517-04b7-4200-85a7-7cfc3c0b5b80 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:14.168551 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ef967517-04b7-4200-85a7-7cfc3c0b5b80 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:14.169197 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ef967517-04b7-4200-85a7-7cfc3c0b5b80 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:14.583136 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-ef967517-04b7-4200-85a7-7cfc3c0b5b80 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18de0948626e4a5c8a28711f943ba46e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb891227dcd84bd49d7215af9dce2db3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:56:14.593104 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-ef967517-04b7-4200-85a7-7cfc3c0b5b80 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] 10.222.0.43 "GET /compute/v2.1/servers/3b712221-0858-4ebc-a276-06d9c0c84fb7" status: 200 len: 1497 microversion: 2.1 time: 0.448523 Oct 04 21:56:14.600515 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1453/2817] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:56:14 2022] GET /compute/v2.1/servers/3b712221-0858-4ebc-a276-06d9c0c84fb7 => generated 1497 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:56:14.620954 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-15c0caaa-56bc-4843-a121-3ba63ebcee92 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:14.675241 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.compute.server_groups [None req-15c0caaa-56bc-4843-a121-3ba63ebcee92 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Querying cell 1297bf18-d456-4d7b-91a9-0a07f1cafd2a(cell1) for 1 instances {{(pid=134102) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 04 21:56:14.678175 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-15c0caaa-56bc-4843-a121-3ba63ebcee92 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:14.678896 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-15c0caaa-56bc-4843-a121-3ba63ebcee92 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:14.686391 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-15c0caaa-56bc-4843-a121-3ba63ebcee92 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:14.725899 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-15c0caaa-56bc-4843-a121-3ba63ebcee92 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] 10.222.0.43 "GET /compute/v2.1/os-server-groups/1de10a59-897f-4699-bb15-bfe7e69e976c" status: 200 len: 220 microversion: 2.1 time: 0.109625 Oct 04 21:56:14.727116 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1454/2818] 10.222.0.43 () {58 vars in 1263 bytes} [Tue Oct 4 21:56:14 2022] GET /compute/v2.1/os-server-groups/1de10a59-897f-4699-bb15-bfe7e69e976c => generated 220 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:56:14.733715 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-3400a94a-7879-4ed9-a52e-b208bc0f9baa tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:14.734536 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-3400a94a-7879-4ed9-a52e-b208bc0f9baa tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] [instance: 4b3f3cb9-cdd4-4881-923f-bb3447b249b9] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:56:14.736317 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-d1c66635-dda6-4d8d-88ad-b82088aa914f tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e807c724cc4c3887a2d360f0584ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40071e45805146529fb8abd40629c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:56:14.742628 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3400a94a-7879-4ed9-a52e-b208bc0f9baa tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:14.743393 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3400a94a-7879-4ed9-a52e-b208bc0f9baa tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:14.744131 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3400a94a-7879-4ed9-a52e-b208bc0f9baa tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:14.745138 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3400a94a-7879-4ed9-a52e-b208bc0f9baa tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:14.745749 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3400a94a-7879-4ed9-a52e-b208bc0f9baa tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:14.746339 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3400a94a-7879-4ed9-a52e-b208bc0f9baa tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:14.747591 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-d1c66635-dda6-4d8d-88ad-b82088aa914f tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] 10.222.0.43 "GET /compute/v2.1/servers/b176215c-96d4-402b-9c63-7ce87fe04ff6" status: 200 len: 1307 microversion: 2.1 time: 0.688034 Oct 04 21:56:14.766503 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1365/2819] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:56:14 2022] GET /compute/v2.1/servers/b176215c-96d4-402b-9c63-7ce87fe04ff6 => generated 1307 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:56:14.774143 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-4291ea34-86f4-4f7f-b5a3-67e15bcda0a8 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:14.775159 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-4291ea34-86f4-4f7f-b5a3-67e15bcda0a8 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] [instance: 3b712221-0858-4ebc-a276-06d9c0c84fb7] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:56:14.783145 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4291ea34-86f4-4f7f-b5a3-67e15bcda0a8 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:14.783812 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4291ea34-86f4-4f7f-b5a3-67e15bcda0a8 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:14.784416 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4291ea34-86f4-4f7f-b5a3-67e15bcda0a8 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:14.785853 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4291ea34-86f4-4f7f-b5a3-67e15bcda0a8 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:14.786511 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4291ea34-86f4-4f7f-b5a3-67e15bcda0a8 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:14.787104 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4291ea34-86f4-4f7f-b5a3-67e15bcda0a8 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:14.816642 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-4291ea34-86f4-4f7f-b5a3-67e15bcda0a8 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] [instance: 3b712221-0858-4ebc-a276-06d9c0c84fb7] Going to try to terminate instance {{(pid=134101) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:56:14.999152 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-4291ea34-86f4-4f7f-b5a3-67e15bcda0a8 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] 10.222.0.43 "DELETE /compute/v2.1/servers/3b712221-0858-4ebc-a276-06d9c0c84fb7" status: 204 len: 0 microversion: 2.1 time: 0.231155 Oct 04 21:56:15.000719 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1366/2820] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 21:56:14 2022] DELETE /compute/v2.1/servers/3b712221-0858-4ebc-a276-06d9c0c84fb7 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:56:15.024531 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-49e4e0a2-776a-4765-93e4-80175042e954 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:15.027445 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-49e4e0a2-776a-4765-93e4-80175042e954 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] [instance: 3b712221-0858-4ebc-a276-06d9c0c84fb7] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:56:15.047229 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-49e4e0a2-776a-4765-93e4-80175042e954 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:15.047737 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-49e4e0a2-776a-4765-93e4-80175042e954 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:15.051363 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-49e4e0a2-776a-4765-93e4-80175042e954 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:15.053334 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-49e4e0a2-776a-4765-93e4-80175042e954 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:15.053852 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-49e4e0a2-776a-4765-93e4-80175042e954 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:15.069405 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-49e4e0a2-776a-4765-93e4-80175042e954 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:15.069754 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-3400a94a-7879-4ed9-a52e-b208bc0f9baa tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b45ebdb946b45c28fc4bca3dd5a3e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520782b7e0a94e3fb552744cc4584119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:56:15.099808 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-3400a94a-7879-4ed9-a52e-b208bc0f9baa tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] 10.222.0.43 "GET /compute/v2.1/servers/4b3f3cb9-cdd4-4881-923f-bb3447b249b9" status: 200 len: 1318 microversion: 2.1 time: 0.371042 Oct 04 21:56:15.118420 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1455/2821] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:56:14 2022] GET /compute/v2.1/servers/4b3f3cb9-cdd4-4881-923f-bb3447b249b9 => generated 1318 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:56:15.152596 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=2 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:56:15.159093 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-3e04fe48-8755-4332-a7e2-b89a10d20d3f tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:15.160728 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-3e04fe48-8755-4332-a7e2-b89a10d20d3f tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] [instance: 6188e227-0adf-4afd-897d-66578f442cae] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:56:15.183495 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3e04fe48-8755-4332-a7e2-b89a10d20d3f tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:15.186822 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3e04fe48-8755-4332-a7e2-b89a10d20d3f tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:15.189515 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3e04fe48-8755-4332-a7e2-b89a10d20d3f tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:15.195307 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3e04fe48-8755-4332-a7e2-b89a10d20d3f tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:15.199112 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3e04fe48-8755-4332-a7e2-b89a10d20d3f tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:15.201626 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3e04fe48-8755-4332-a7e2-b89a10d20d3f tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:15.382642 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-49e4e0a2-776a-4765-93e4-80175042e954 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18de0948626e4a5c8a28711f943ba46e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb891227dcd84bd49d7215af9dce2db3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:56:15.393643 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-49e4e0a2-776a-4765-93e4-80175042e954 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] 10.222.0.43 "GET /compute/v2.1/servers/3b712221-0858-4ebc-a276-06d9c0c84fb7" status: 200 len: 1503 microversion: 2.1 time: 0.387154 Oct 04 21:56:15.397421 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1367/2822] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:56:15 2022] GET /compute/v2.1/servers/3b712221-0858-4ebc-a276-06d9c0c84fb7 => generated 1503 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:56:15.528713 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-3e04fe48-8755-4332-a7e2-b89a10d20d3f tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cca65ba35b14db8bf2187188de8c838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51745fc19321469bb20afabe48b2185d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:56:15.538842 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-3e04fe48-8755-4332-a7e2-b89a10d20d3f tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] 10.222.0.43 "GET /compute/v2.1/servers/6188e227-0adf-4afd-897d-66578f442cae" status: 200 len: 1315 microversion: 2.1 time: 0.384007 Oct 04 21:56:15.550387 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1456/2823] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:56:15 2022] GET /compute/v2.1/servers/6188e227-0adf-4afd-897d-66578f442cae => generated 1315 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:56:15.774235 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-61038a40-0527-4d84-81b5-1999526fef18 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:15.774946 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-61038a40-0527-4d84-81b5-1999526fef18 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] [instance: b176215c-96d4-402b-9c63-7ce87fe04ff6] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:56:15.776878 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=8 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:56:15.789786 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-61038a40-0527-4d84-81b5-1999526fef18 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:15.791440 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-61038a40-0527-4d84-81b5-1999526fef18 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:15.791990 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-61038a40-0527-4d84-81b5-1999526fef18 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:15.795828 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-61038a40-0527-4d84-81b5-1999526fef18 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:15.796323 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-61038a40-0527-4d84-81b5-1999526fef18 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:15.797339 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-61038a40-0527-4d84-81b5-1999526fef18 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:16.133485 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-a31bc1fa-890e-40c2-b315-734a587315f5 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:16.135047 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-a31bc1fa-890e-40c2-b315-734a587315f5 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] [instance: 4b3f3cb9-cdd4-4881-923f-bb3447b249b9] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:56:16.161622 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a31bc1fa-890e-40c2-b315-734a587315f5 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:16.163202 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a31bc1fa-890e-40c2-b315-734a587315f5 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:16.164122 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a31bc1fa-890e-40c2-b315-734a587315f5 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:16.166573 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a31bc1fa-890e-40c2-b315-734a587315f5 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:16.167933 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a31bc1fa-890e-40c2-b315-734a587315f5 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:16.168735 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a31bc1fa-890e-40c2-b315-734a587315f5 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:16.677493 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-61038a40-0527-4d84-81b5-1999526fef18 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e807c724cc4c3887a2d360f0584ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40071e45805146529fb8abd40629c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:56:16.693244 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-61038a40-0527-4d84-81b5-1999526fef18 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] 10.222.0.43 "GET /compute/v2.1/servers/b176215c-96d4-402b-9c63-7ce87fe04ff6" status: 200 len: 1307 microversion: 2.1 time: 0.923498 Oct 04 21:56:16.696415 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1368/2824] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:56:15 2022] GET /compute/v2.1/servers/b176215c-96d4-402b-9c63-7ce87fe04ff6 => generated 1307 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:56:16.701247 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-a171f109-b5ff-4d91-b248-ab35b8d19f08 req-83c32601-5ac7-4e70-93fb-f4fa121080cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b3f3cb9-cdd4-4881-923f-bb3447b249b9", "name": "network-vif-plugged", "status": "completed", "tag": "7addb5c8-b6f8-47ba-8b56-d1984891b962"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:56:16.756188 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-a171f109-b5ff-4d91-b248-ab35b8d19f08 req-83c32601-5ac7-4e70-93fb-f4fa121080cb service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:16.756687 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-a171f109-b5ff-4d91-b248-ab35b8d19f08 req-83c32601-5ac7-4e70-93fb-f4fa121080cb service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:16.757128 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-a171f109-b5ff-4d91-b248-ab35b8d19f08 req-83c32601-5ac7-4e70-93fb-f4fa121080cb service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:16.789345 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-a171f109-b5ff-4d91-b248-ab35b8d19f08 req-83c32601-5ac7-4e70-93fb-f4fa121080cb service nova] Creating event network-vif-plugged:7addb5c8-b6f8-47ba-8b56-d1984891b962 for instance 4b3f3cb9-cdd4-4881-923f-bb3447b249b9 on n-h1-860284-1 Oct 04 21:56:16.798655 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-a171f109-b5ff-4d91-b248-ab35b8d19f08 req-83c32601-5ac7-4e70-93fb-f4fa121080cb service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100874 Oct 04 21:56:16.801787 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1369/2825] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:56:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:56:16.833636 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-9b0ff66f-a81c-4fba-8c85-ddd3789cf93b tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:16.846314 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-9b0ff66f-a81c-4fba-8c85-ddd3789cf93b tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] [instance: 3b712221-0858-4ebc-a276-06d9c0c84fb7] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:56:16.872420 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9b0ff66f-a81c-4fba-8c85-ddd3789cf93b tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:16.880708 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9b0ff66f-a81c-4fba-8c85-ddd3789cf93b tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:16.886345 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9b0ff66f-a81c-4fba-8c85-ddd3789cf93b tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:16.887566 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9b0ff66f-a81c-4fba-8c85-ddd3789cf93b tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:16.888485 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9b0ff66f-a81c-4fba-8c85-ddd3789cf93b tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:16.892858 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9b0ff66f-a81c-4fba-8c85-ddd3789cf93b tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:17.766650 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-a31bc1fa-890e-40c2-b315-734a587315f5 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b45ebdb946b45c28fc4bca3dd5a3e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520782b7e0a94e3fb552744cc4584119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:56:17.775003 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-a31bc1fa-890e-40c2-b315-734a587315f5 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] 10.222.0.43 "GET /compute/v2.1/servers/4b3f3cb9-cdd4-4881-923f-bb3447b249b9" status: 200 len: 1318 microversion: 2.1 time: 1.648552 Oct 04 21:56:17.781472 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1457/2826] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:56:16 2022] GET /compute/v2.1/servers/4b3f3cb9-cdd4-4881-923f-bb3447b249b9 => generated 1318 bytes in 1653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:56:17.786659 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-f82e11ab-5076-4547-a047-94f26c4cbbe5 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:17.791170 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-f82e11ab-5076-4547-a047-94f26c4cbbe5 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] [instance: 6188e227-0adf-4afd-897d-66578f442cae] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:56:17.804004 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f82e11ab-5076-4547-a047-94f26c4cbbe5 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:17.811259 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f82e11ab-5076-4547-a047-94f26c4cbbe5 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:17.812000 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f82e11ab-5076-4547-a047-94f26c4cbbe5 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:17.812962 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f82e11ab-5076-4547-a047-94f26c4cbbe5 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:17.813629 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f82e11ab-5076-4547-a047-94f26c4cbbe5 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:17.814293 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f82e11ab-5076-4547-a047-94f26c4cbbe5 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:17.853130 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=100 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:56:17.991428 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-9b0ff66f-a81c-4fba-8c85-ddd3789cf93b tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18de0948626e4a5c8a28711f943ba46e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb891227dcd84bd49d7215af9dce2db3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:56:18.005211 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-9b0ff66f-a81c-4fba-8c85-ddd3789cf93b tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] 10.222.0.43 "GET /compute/v2.1/servers/3b712221-0858-4ebc-a276-06d9c0c84fb7" status: 200 len: 1503 microversion: 2.1 time: 1.184728 Oct 04 21:56:18.005870 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1370/2827] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:56:16 2022] GET /compute/v2.1/servers/3b712221-0858-4ebc-a276-06d9c0c84fb7 => generated 1503 bytes in 1186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:56:18.030537 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-687a84e2-082d-4948-abcc-b18b4fe06394 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:18.031318 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-687a84e2-082d-4948-abcc-b18b4fe06394 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] [instance: b176215c-96d4-402b-9c63-7ce87fe04ff6] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:56:18.041106 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-687a84e2-082d-4948-abcc-b18b4fe06394 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:18.043082 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-687a84e2-082d-4948-abcc-b18b4fe06394 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:18.044338 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-687a84e2-082d-4948-abcc-b18b4fe06394 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:18.046224 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-687a84e2-082d-4948-abcc-b18b4fe06394 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:18.047227 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-687a84e2-082d-4948-abcc-b18b4fe06394 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:18.047855 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-687a84e2-082d-4948-abcc-b18b4fe06394 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:18.420004 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-f82e11ab-5076-4547-a047-94f26c4cbbe5 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cca65ba35b14db8bf2187188de8c838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51745fc19321469bb20afabe48b2185d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:56:18.434544 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-f82e11ab-5076-4547-a047-94f26c4cbbe5 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] 10.222.0.43 "GET /compute/v2.1/servers/6188e227-0adf-4afd-897d-66578f442cae" status: 200 len: 1315 microversion: 2.1 time: 0.650630 Oct 04 21:56:18.459202 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1458/2828] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:56:17 2022] GET /compute/v2.1/servers/6188e227-0adf-4afd-897d-66578f442cae => generated 1315 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:56:18.682175 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-687a84e2-082d-4948-abcc-b18b4fe06394 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e807c724cc4c3887a2d360f0584ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40071e45805146529fb8abd40629c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:56:18.697434 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-687a84e2-082d-4948-abcc-b18b4fe06394 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] 10.222.0.43 "GET /compute/v2.1/servers/b176215c-96d4-402b-9c63-7ce87fe04ff6" status: 200 len: 1307 microversion: 2.1 time: 0.672076 Oct 04 21:56:18.698394 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1371/2829] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:56:18 2022] GET /compute/v2.1/servers/b176215c-96d4-402b-9c63-7ce87fe04ff6 => generated 1307 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:56:18.797929 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-bec9692a-2df1-4fc7-b372-a7ec4596b6a0 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:18.798576 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-bec9692a-2df1-4fc7-b372-a7ec4596b6a0 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] [instance: 4b3f3cb9-cdd4-4881-923f-bb3447b249b9] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:56:18.817550 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bec9692a-2df1-4fc7-b372-a7ec4596b6a0 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:18.818454 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bec9692a-2df1-4fc7-b372-a7ec4596b6a0 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:18.819089 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bec9692a-2df1-4fc7-b372-a7ec4596b6a0 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:18.820006 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bec9692a-2df1-4fc7-b372-a7ec4596b6a0 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:18.825124 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bec9692a-2df1-4fc7-b372-a7ec4596b6a0 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:18.825890 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bec9692a-2df1-4fc7-b372-a7ec4596b6a0 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:18.862213 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-1c683e8e-95bf-4f33-a6ba-6ea5431e59db req-5a2ebe9c-df94-434c-b1d4-6cd947cf9e07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6188e227-0adf-4afd-897d-66578f442cae", "name": "network-vif-plugged", "status": "completed", "tag": "3506c0a9-1b9f-478c-b518-015e52ed0a1a"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:56:18.876064 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-1c683e8e-95bf-4f33-a6ba-6ea5431e59db req-5a2ebe9c-df94-434c-b1d4-6cd947cf9e07 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:18.877250 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-1c683e8e-95bf-4f33-a6ba-6ea5431e59db req-5a2ebe9c-df94-434c-b1d4-6cd947cf9e07 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:18.878133 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-1c683e8e-95bf-4f33-a6ba-6ea5431e59db req-5a2ebe9c-df94-434c-b1d4-6cd947cf9e07 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:18.892675 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-1c683e8e-95bf-4f33-a6ba-6ea5431e59db req-5a2ebe9c-df94-434c-b1d4-6cd947cf9e07 service nova] Creating event network-vif-plugged:3506c0a9-1b9f-478c-b518-015e52ed0a1a for instance 6188e227-0adf-4afd-897d-66578f442cae on n-h2-860284-1 Oct 04 21:56:18.899722 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-1c683e8e-95bf-4f33-a6ba-6ea5431e59db req-5a2ebe9c-df94-434c-b1d4-6cd947cf9e07 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043389 Oct 04 21:56:18.900729 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1372/2830] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:56:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:56:19.036099 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-351a65ef-be90-4c21-bf1e-bb5307a75617 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:19.037101 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-351a65ef-be90-4c21-bf1e-bb5307a75617 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] [instance: 3b712221-0858-4ebc-a276-06d9c0c84fb7] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:56:19.061667 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-351a65ef-be90-4c21-bf1e-bb5307a75617 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:19.066173 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-351a65ef-be90-4c21-bf1e-bb5307a75617 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:19.067722 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-351a65ef-be90-4c21-bf1e-bb5307a75617 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:19.071378 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-351a65ef-be90-4c21-bf1e-bb5307a75617 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:19.071960 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-351a65ef-be90-4c21-bf1e-bb5307a75617 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:19.075550 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-351a65ef-be90-4c21-bf1e-bb5307a75617 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:19.587607 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-bec9692a-2df1-4fc7-b372-a7ec4596b6a0 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b45ebdb946b45c28fc4bca3dd5a3e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520782b7e0a94e3fb552744cc4584119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:56:19.600253 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-bec9692a-2df1-4fc7-b372-a7ec4596b6a0 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] 10.222.0.43 "GET /compute/v2.1/servers/4b3f3cb9-cdd4-4881-923f-bb3447b249b9" status: 200 len: 1467 microversion: 2.1 time: 0.806117 Oct 04 21:56:19.608919 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-351a65ef-be90-4c21-bf1e-bb5307a75617 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18de0948626e4a5c8a28711f943ba46e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb891227dcd84bd49d7215af9dce2db3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:56:19.618524 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1459/2831] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:56:18 2022] GET /compute/v2.1/servers/4b3f3cb9-cdd4-4881-923f-bb3447b249b9 => generated 1467 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:56:19.620829 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-351a65ef-be90-4c21-bf1e-bb5307a75617 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] 10.222.0.43 "GET /compute/v2.1/servers/3b712221-0858-4ebc-a276-06d9c0c84fb7" status: 200 len: 1461 microversion: 2.1 time: 0.591619 Oct 04 21:56:19.625405 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1373/2832] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:56:19 2022] GET /compute/v2.1/servers/3b712221-0858-4ebc-a276-06d9c0c84fb7 => generated 1461 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:56:19.635962 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-f287e571-7b2b-42bd-9dc2-8a77032c5955 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:19.642947 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-f287e571-7b2b-42bd-9dc2-8a77032c5955 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] [instance: 6188e227-0adf-4afd-897d-66578f442cae] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:56:19.675136 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f287e571-7b2b-42bd-9dc2-8a77032c5955 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:19.675816 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f287e571-7b2b-42bd-9dc2-8a77032c5955 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:19.682397 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f287e571-7b2b-42bd-9dc2-8a77032c5955 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:19.684338 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f287e571-7b2b-42bd-9dc2-8a77032c5955 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:19.685111 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f287e571-7b2b-42bd-9dc2-8a77032c5955 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:19.685884 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f287e571-7b2b-42bd-9dc2-8a77032c5955 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:20.128268 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-f287e571-7b2b-42bd-9dc2-8a77032c5955 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cca65ba35b14db8bf2187188de8c838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51745fc19321469bb20afabe48b2185d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:56:20.160516 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-f287e571-7b2b-42bd-9dc2-8a77032c5955 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] 10.222.0.43 "GET /compute/v2.1/servers/6188e227-0adf-4afd-897d-66578f442cae" status: 200 len: 1315 microversion: 2.1 time: 0.538772 Oct 04 21:56:20.164578 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1460/2833] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:56:19 2022] GET /compute/v2.1/servers/6188e227-0adf-4afd-897d-66578f442cae => generated 1315 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:56:20.175506 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-376b8eef-7eb6-451a-ad9d-39e00630eba4 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:20.178878 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-376b8eef-7eb6-451a-ad9d-39e00630eba4 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] [instance: b176215c-96d4-402b-9c63-7ce87fe04ff6] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:56:20.192103 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-376b8eef-7eb6-451a-ad9d-39e00630eba4 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:20.196697 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-376b8eef-7eb6-451a-ad9d-39e00630eba4 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:20.197429 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-376b8eef-7eb6-451a-ad9d-39e00630eba4 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:20.199692 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-376b8eef-7eb6-451a-ad9d-39e00630eba4 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:20.201176 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-376b8eef-7eb6-451a-ad9d-39e00630eba4 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:20.202652 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-376b8eef-7eb6-451a-ad9d-39e00630eba4 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:20.505876 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-c746fce1-b546-42ee-8098-09eb87b14b69 tempest-LiveMigrationNegativeTest-1238186295 tempest-LiveMigrationNegativeTest-1238186295-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-584106502", "block_migration": true, "disk_over_commit": false}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:56:20.509242 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-c746fce1-b546-42ee-8098-09eb87b14b69 tempest-LiveMigrationNegativeTest-1238186295 tempest-LiveMigrationNegativeTest-1238186295-project-admin] [instance: 4b3f3cb9-cdd4-4881-923f-bb3447b249b9] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:56:20.531146 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c746fce1-b546-42ee-8098-09eb87b14b69 tempest-LiveMigrationNegativeTest-1238186295 tempest-LiveMigrationNegativeTest-1238186295-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:20.532968 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c746fce1-b546-42ee-8098-09eb87b14b69 tempest-LiveMigrationNegativeTest-1238186295 tempest-LiveMigrationNegativeTest-1238186295-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:20.533895 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c746fce1-b546-42ee-8098-09eb87b14b69 tempest-LiveMigrationNegativeTest-1238186295 tempest-LiveMigrationNegativeTest-1238186295-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:20.548566 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c746fce1-b546-42ee-8098-09eb87b14b69 tempest-LiveMigrationNegativeTest-1238186295 tempest-LiveMigrationNegativeTest-1238186295-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:20.550068 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c746fce1-b546-42ee-8098-09eb87b14b69 tempest-LiveMigrationNegativeTest-1238186295 tempest-LiveMigrationNegativeTest-1238186295-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:20.550230 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c746fce1-b546-42ee-8098-09eb87b14b69 tempest-LiveMigrationNegativeTest-1238186295 tempest-LiveMigrationNegativeTest-1238186295-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:20.677758 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-376b8eef-7eb6-451a-ad9d-39e00630eba4 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e807c724cc4c3887a2d360f0584ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40071e45805146529fb8abd40629c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:56:20.686916 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-376b8eef-7eb6-451a-ad9d-39e00630eba4 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] 10.222.0.43 "GET /compute/v2.1/servers/b176215c-96d4-402b-9c63-7ce87fe04ff6" status: 200 len: 1307 microversion: 2.1 time: 0.518394 Oct 04 21:56:20.697319 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1461/2834] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:56:20 2022] GET /compute/v2.1/servers/b176215c-96d4-402b-9c63-7ce87fe04ff6 => generated 1307 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:56:20.704806 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-18632946-16dc-4268-bea0-a9e385d6735c req-280eab0a-6fce-42b9-b1fe-7931d93f78ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b712221-0858-4ebc-a276-06d9c0c84fb7", "name": "network-vif-deleted", "tag": "9ee6b655-7175-482a-9bcb-2aea4d306e09"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:56:20.729118 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.objects.instance [None req-c746fce1-b546-42ee-8098-09eb87b14b69 tempest-LiveMigrationNegativeTest-1238186295 tempest-LiveMigrationNegativeTest-1238186295-project-admin] Lazy-loading 'flavor' on Instance uuid 4b3f3cb9-cdd4-4881-923f-bb3447b249b9 {{(pid=134101) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:56:20.755104 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-c746fce1-b546-42ee-8098-09eb87b14b69 tempest-LiveMigrationNegativeTest-1238186295 tempest-LiveMigrationNegativeTest-1238186295-project-admin] [instance: 4b3f3cb9-cdd4-4881-923f-bb3447b249b9] Going to try to live migrate instance to tempest-host-584106502 {{(pid=134101) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 04 21:56:20.763503 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-18632946-16dc-4268-bea0-a9e385d6735c req-280eab0a-6fce-42b9-b1fe-7931d93f78ed service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:20.773245 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-18632946-16dc-4268-bea0-a9e385d6735c req-280eab0a-6fce-42b9-b1fe-7931d93f78ed service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:20.775115 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-18632946-16dc-4268-bea0-a9e385d6735c req-280eab0a-6fce-42b9-b1fe-7931d93f78ed service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:20.791248 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-c746fce1-b546-42ee-8098-09eb87b14b69 tempest-LiveMigrationNegativeTest-1238186295 tempest-LiveMigrationNegativeTest-1238186295-project-admin] HTTP exception thrown: Compute host tempest-host-584106502 could not be found. Oct 04 21:56:20.808386 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-18632946-16dc-4268-bea0-a9e385d6735c req-280eab0a-6fce-42b9-b1fe-7931d93f78ed service nova] Creating event network-vif-deleted:9ee6b655-7175-482a-9bcb-2aea4d306e09 for instance 3b712221-0858-4ebc-a276-06d9c0c84fb7 on n-h1-860284-1 Oct 04 21:56:20.819495 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-18632946-16dc-4268-bea0-a9e385d6735c req-280eab0a-6fce-42b9-b1fe-7931d93f78ed service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120631 Oct 04 21:56:20.820877 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1462/2835] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:56:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:56:20.822746 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-c746fce1-b546-42ee-8098-09eb87b14b69 tempest-LiveMigrationNegativeTest-1238186295 tempest-LiveMigrationNegativeTest-1238186295-project-admin] Request method failure captured: Oct 04 21:56:20.822746 n-d-860284-1 devstack@n-api.service[134101]: request: POST /compute/v2.1/servers/4b3f3cb9-cdd4-4881-923f-bb3447b249b9/action HTTP/1.1 Oct 04 21:56:20.822746 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 21:56:20.822746 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 21:56:20.822746 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 21:56:20.822746 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 106 Oct 04 21:56:20.822746 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 21:56:20.822746 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 21:56:20.822746 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 21:56:20.822746 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 21:56:20.822746 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPKvguTZe3GlLTOE-KDXQxSCTXlD5MDmB2CT_4nAdnhn3MbWJAhS2IihaYaRXI9yhyXyAw1nAdsAFWavxw8codsA18nkYi6PdXOxV3TvuXhjWIjLiL1pCsX0qKCnLIkYHj4peo3W-R7-68yoadc37D3k3ihhAfgJV4XchdqRNFD5MLgY Oct 04 21:56:20.822746 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 21:56:20.822746 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 21:56:20.822746 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 21:56:20.822746 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 21:56:20.822746 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 21:56:20.822746 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 21:56:20.822746 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: c433c9a3922d4b08ba3ace5489208281 Oct 04 21:56:20.822746 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-LiveMigrationNegativeTest-1238186295 Oct 04 21:56:20.822746 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,admin,member Oct 04 21:56:20.822746 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,admin,member Oct 04 21:56:20.822746 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c433c9a3922d4b08ba3ace5489208281"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_c433c9a3922d4b08ba3ace5489208281", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c433c9a3922d4b08ba3ace5489208281"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/c433c9a3922d4b08ba3ace5489208281"}]}] Oct 04 21:56:20.822746 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-LiveMigrationNegativeTest-1238186295 Oct 04 21:56:20.822746 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: c433c9a3922d4b08ba3ace5489208281 Oct 04 21:56:20.822746 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1238186295 Oct 04 21:56:20.822746 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-LiveMigrationNegativeTest-1238186295-project-admin Oct 04 21:56:20.822746 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 21:56:20.822746 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 21:56:20.822746 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 6e6f35134c094f8aaa4c90e516580659 Oct 04 21:56:20.822746 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-LiveMigrationNegativeTest-1238186295-project-admin Oct 04 21:56:20.822746 n-d-860284-1 devstack@n-api.service[134101]: Oct 04 21:56:20.822746 n-d-860284-1 devstack@n-api.service[134101]: {"os-migrateLive": {"host": "tempest-host-584106502", "block_migration": true, "disk_over_commit": false}} Oct 04 21:56:20.822746 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 21:56:20.822746 n-d-860284-1 devstack@n-api.service[134101]: exception: Compute host tempest-host-584106502 could not be found. Oct 04 21:56:20.822746 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': '4b3f3cb9-cdd4-4881-923f-bb3447b249b9', 'body': {'os-migrateLive': {'host': 'tempest-host-584106502', 'block_migration': True, 'disk_over_commit': False}}} Oct 04 21:56:20.822746 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:56:20.822746 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:56:20.822746 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Oct 04 21:56:20.822746 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Oct 04 21:56:20.822746 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 04 21:56:20.822746 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 21:56:20.822746 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 04 21:56:20.822746 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 21:56:20.822746 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 04 21:56:20.822746 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 21:56:20.822746 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 04 21:56:20.822746 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 21:56:20.822746 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 04 21:56:20.822746 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 21:56:20.822746 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 04 21:56:20.822746 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 21:56:20.822746 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 21:56:20.822746 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 21:56:20.822746 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 04 21:56:20.822746 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 21:56:20.822746 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5488, in live_migrate Oct 04 21:56:20.822746 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nodes = objects.ComputeNodeList.get_all_by_host(context, host_name) Oct 04 21:56:20.822746 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 21:56:20.822746 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 21:56:20.822746 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 476, in get_all_by_host Oct 04 21:56:20.822746 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi db_computes = cls._db_compute_node_get_all_by_host(context, host, Oct 04 21:56:20.828126 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 179, in wrapper Oct 04 21:56:20.828126 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:56:20.828126 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 472, in _db_compute_node_get_all_by_host Oct 04 21:56:20.828126 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return db.compute_node_get_all_by_host(context, host) Oct 04 21:56:20.828126 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 241, in wrapper Oct 04 21:56:20.828126 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) Oct 04 21:56:20.828126 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 740, in compute_node_get_all_by_host Oct 04 21:56:20.828126 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host) Oct 04 21:56:20.828126 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-host-584106502 could not be found. Oct 04 21:56:20.828126 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:56:20.828126 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:56:20.828126 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:56:20.828126 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:56:20.828126 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:56:20.828126 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:56:20.828126 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:56:20.828126 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:56:20.828126 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:56:20.828126 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:56:20.828126 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:56:20.828126 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:56:20.828126 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:56:20.828126 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:56:20.828126 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:56:20.828126 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:56:20.828126 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 04 21:56:20.828126 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 150, in _migrate_live Oct 04 21:56:20.828126 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 04 21:56:20.828126 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Compute host tempest-host-584106502 could not be found. Oct 04 21:56:20.828126 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:56:20.828126 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:56:20.828126 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:56:20.828126 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:56:20.828126 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:56:20.828126 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:56:20.828126 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:56:20.828126 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:56:20.828126 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-host-584106502 could not be found. Oct 04 21:56:20.828126 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:56:20.833823 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-c746fce1-b546-42ee-8098-09eb87b14b69 tempest-LiveMigrationNegativeTest-1238186295 tempest-LiveMigrationNegativeTest-1238186295-project-admin] Returning 400 to user: Compute host tempest-host-584106502 could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:56:20.835460 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-c746fce1-b546-42ee-8098-09eb87b14b69 tempest-LiveMigrationNegativeTest-1238186295 tempest-LiveMigrationNegativeTest-1238186295-project-admin] 10.222.0.43 "POST /compute/v2.1/servers/4b3f3cb9-cdd4-4881-923f-bb3447b249b9/action" status: 400 len: 99 microversion: 2.1 time: 1.180951 Oct 04 21:56:20.836748 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1374/2836] 10.222.0.43 () {60 vars in 1279 bytes} [Tue Oct 4 21:56:19 2022] POST /compute/v2.1/servers/4b3f3cb9-cdd4-4881-923f-bb3447b249b9/action => generated 99 bytes in 1183 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 04 21:56:20.837995 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-43524172-1dde-4d5e-9bdf-93aae63871ce tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:20.839834 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-43524172-1dde-4d5e-9bdf-93aae63871ce tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] [instance: 3b712221-0858-4ebc-a276-06d9c0c84fb7] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:56:20.847166 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-43524172-1dde-4d5e-9bdf-93aae63871ce tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:20.848480 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-43524172-1dde-4d5e-9bdf-93aae63871ce tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:20.849246 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-43524172-1dde-4d5e-9bdf-93aae63871ce tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:20.850157 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-43524172-1dde-4d5e-9bdf-93aae63871ce tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:20.850912 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-43524172-1dde-4d5e-9bdf-93aae63871ce tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:20.851831 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-43524172-1dde-4d5e-9bdf-93aae63871ce tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:20.867269 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-fba1deed-15bd-4954-9d8f-e7dd22543bed tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:20.868214 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-fba1deed-15bd-4954-9d8f-e7dd22543bed tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] [instance: 4b3f3cb9-cdd4-4881-923f-bb3447b249b9] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:56:20.884498 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fba1deed-15bd-4954-9d8f-e7dd22543bed tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:20.885673 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fba1deed-15bd-4954-9d8f-e7dd22543bed tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:20.886475 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fba1deed-15bd-4954-9d8f-e7dd22543bed tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:20.887794 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fba1deed-15bd-4954-9d8f-e7dd22543bed tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:20.888529 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fba1deed-15bd-4954-9d8f-e7dd22543bed tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:20.889226 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fba1deed-15bd-4954-9d8f-e7dd22543bed tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:20.930477 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-43524172-1dde-4d5e-9bdf-93aae63871ce tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:20.930971 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-43524172-1dde-4d5e-9bdf-93aae63871ce tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:20.931481 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-43524172-1dde-4d5e-9bdf-93aae63871ce tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:20.935841 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.objects.instance [None req-43524172-1dde-4d5e-9bdf-93aae63871ce tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Lazy-loading 'fault' on Instance uuid 3b712221-0858-4ebc-a276-06d9c0c84fb7 {{(pid=134102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:56:21.108505 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-43524172-1dde-4d5e-9bdf-93aae63871ce tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18de0948626e4a5c8a28711f943ba46e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb891227dcd84bd49d7215af9dce2db3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:56:21.125162 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-43524172-1dde-4d5e-9bdf-93aae63871ce tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] 10.222.0.43 "GET /compute/v2.1/servers/3b712221-0858-4ebc-a276-06d9c0c84fb7" status: 200 len: 1301 microversion: 2.1 time: 0.302691 Oct 04 21:56:21.135764 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1463/2837] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:56:20 2022] GET /compute/v2.1/servers/3b712221-0858-4ebc-a276-06d9c0c84fb7 => generated 1301 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:56:21.192158 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-3c5869bb-ab6d-4ccd-8a04-16c6e5fbf010 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:21.193483 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-3c5869bb-ab6d-4ccd-8a04-16c6e5fbf010 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] [instance: 6188e227-0adf-4afd-897d-66578f442cae] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:56:21.205764 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3c5869bb-ab6d-4ccd-8a04-16c6e5fbf010 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:21.207363 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3c5869bb-ab6d-4ccd-8a04-16c6e5fbf010 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:21.210391 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3c5869bb-ab6d-4ccd-8a04-16c6e5fbf010 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:21.211556 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3c5869bb-ab6d-4ccd-8a04-16c6e5fbf010 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:21.213257 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3c5869bb-ab6d-4ccd-8a04-16c6e5fbf010 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:21.213909 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3c5869bb-ab6d-4ccd-8a04-16c6e5fbf010 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:21.668430 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-fba1deed-15bd-4954-9d8f-e7dd22543bed tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b45ebdb946b45c28fc4bca3dd5a3e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520782b7e0a94e3fb552744cc4584119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:56:21.680249 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-fba1deed-15bd-4954-9d8f-e7dd22543bed tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] 10.222.0.43 "GET /compute/v2.1/servers/4b3f3cb9-cdd4-4881-923f-bb3447b249b9" status: 200 len: 1467 microversion: 2.1 time: 0.828889 Oct 04 21:56:21.682518 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1375/2838] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:56:20 2022] GET /compute/v2.1/servers/4b3f3cb9-cdd4-4881-923f-bb3447b249b9 => generated 1467 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:56:21.688173 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-07cedef4-0a66-4394-8c92-89e9b005e363 req-7f0129e6-301c-4bc5-9ad3-e38f51573d2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b176215c-96d4-402b-9c63-7ce87fe04ff6", "name": "network-vif-plugged", "status": "completed", "tag": "0efd69ff-4474-4aaa-b2fd-c82bb955cb23"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:56:21.732787 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-07cedef4-0a66-4394-8c92-89e9b005e363 req-7f0129e6-301c-4bc5-9ad3-e38f51573d2d service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:21.733708 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-07cedef4-0a66-4394-8c92-89e9b005e363 req-7f0129e6-301c-4bc5-9ad3-e38f51573d2d service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:21.734669 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-07cedef4-0a66-4394-8c92-89e9b005e363 req-7f0129e6-301c-4bc5-9ad3-e38f51573d2d service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:21.759341 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-3c5869bb-ab6d-4ccd-8a04-16c6e5fbf010 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cca65ba35b14db8bf2187188de8c838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51745fc19321469bb20afabe48b2185d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:56:21.766834 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-3c5869bb-ab6d-4ccd-8a04-16c6e5fbf010 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] 10.222.0.43 "GET /compute/v2.1/servers/6188e227-0adf-4afd-897d-66578f442cae" status: 200 len: 1504 microversion: 2.1 time: 0.579310 Oct 04 21:56:21.767117 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-07cedef4-0a66-4394-8c92-89e9b005e363 req-7f0129e6-301c-4bc5-9ad3-e38f51573d2d service nova] Creating event network-vif-plugged:0efd69ff-4474-4aaa-b2fd-c82bb955cb23 for instance b176215c-96d4-402b-9c63-7ce87fe04ff6 on n-h2-860284-1 Oct 04 21:56:21.774173 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-07cedef4-0a66-4394-8c92-89e9b005e363 req-7f0129e6-301c-4bc5-9ad3-e38f51573d2d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089415 Oct 04 21:56:21.774846 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1376/2839] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:56:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:56:21.776259 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1464/2840] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:56:21 2022] GET /compute/v2.1/servers/6188e227-0adf-4afd-897d-66578f442cae => generated 1504 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:56:21.792794 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-567d9ea7-1862-40c2-a38f-1b39cd82f572 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:21.795880 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-567d9ea7-1862-40c2-a38f-1b39cd82f572 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] [instance: b176215c-96d4-402b-9c63-7ce87fe04ff6] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:56:21.799362 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-474e32e4-5dd9-4166-9619-f69ca326b687 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-282483875"}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:56:21.799968 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-474e32e4-5dd9-4166-9619-f69ca326b687 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] [instance: 6188e227-0adf-4afd-897d-66578f442cae] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:56:21.805971 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-567d9ea7-1862-40c2-a38f-1b39cd82f572 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:21.806856 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-567d9ea7-1862-40c2-a38f-1b39cd82f572 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:21.807499 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-567d9ea7-1862-40c2-a38f-1b39cd82f572 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:21.808395 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-567d9ea7-1862-40c2-a38f-1b39cd82f572 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:21.809062 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-567d9ea7-1862-40c2-a38f-1b39cd82f572 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:21.809667 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-567d9ea7-1862-40c2-a38f-1b39cd82f572 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:21.809813 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-474e32e4-5dd9-4166-9619-f69ca326b687 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:21.810252 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-474e32e4-5dd9-4166-9619-f69ca326b687 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:21.810719 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-474e32e4-5dd9-4166-9619-f69ca326b687 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:21.813273 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-474e32e4-5dd9-4166-9619-f69ca326b687 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:21.814732 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-474e32e4-5dd9-4166-9619-f69ca326b687 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:21.816017 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-474e32e4-5dd9-4166-9619-f69ca326b687 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:22.268436 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.network.security_group_api [None req-474e32e4-5dd9-4166-9619-f69ca326b687 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Adding security group 27294451-aded-4095-ab50-1237895ef2fe to port 3506c0a9-1b9f-478c-b518-015e52ed0a1a Oct 04 21:56:22.341069 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-567d9ea7-1862-40c2-a38f-1b39cd82f572 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e807c724cc4c3887a2d360f0584ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40071e45805146529fb8abd40629c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:56:22.349243 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-567d9ea7-1862-40c2-a38f-1b39cd82f572 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] 10.222.0.43 "GET /compute/v2.1/servers/b176215c-96d4-402b-9c63-7ce87fe04ff6" status: 200 len: 1307 microversion: 2.1 time: 0.567973 Oct 04 21:56:22.350428 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1377/2841] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:56:21 2022] GET /compute/v2.1/servers/b176215c-96d4-402b-9c63-7ce87fe04ff6 => generated 1307 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:56:22.373866 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-4fdcbb42-ff83-496e-95ef-550e2226f87b tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-620620150", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:56:22.464082 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.network.neutron [None req-4fdcbb42-ff83-496e-95ef-550e2226f87b tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] validate_networks() for None {{(pid=134101) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:56:22.970979 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-4fdcbb42-ff83-496e-95ef-550e2226f87b tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Flavor limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:56:22.973299 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-4fdcbb42-ff83-496e-95ef-550e2226f87b tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Image limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:56:22.974119 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-4fdcbb42-ff83-496e-95ef-550e2226f87b tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Flavor pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:56:22.975155 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-4fdcbb42-ff83-496e-95ef-550e2226f87b tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Image pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:56:22.975821 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-4fdcbb42-ff83-496e-95ef-550e2226f87b tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:56:22.989700 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4fdcbb42-ff83-496e-95ef-550e2226f87b tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:22.990615 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4fdcbb42-ff83-496e-95ef-550e2226f87b tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:22.991587 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4fdcbb42-ff83-496e-95ef-550e2226f87b tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:22.992728 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4fdcbb42-ff83-496e-95ef-550e2226f87b tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:22.993708 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4fdcbb42-ff83-496e-95ef-550e2226f87b tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:22.994424 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4fdcbb42-ff83-496e-95ef-550e2226f87b tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:23.053821 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-4fdcbb42-ff83-496e-95ef-550e2226f87b tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Getting quotas for project 520782b7e0a94e3fb552744cc4584119. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:56:23.065731 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-474e32e4-5dd9-4166-9619-f69ca326b687 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] 10.222.0.43 "POST /compute/v2.1/servers/6188e227-0adf-4afd-897d-66578f442cae/action" status: 202 len: 0 microversion: 2.1 time: 1.270427 Oct 04 21:56:23.067160 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1465/2842] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 21:56:21 2022] POST /compute/v2.1/servers/6188e227-0adf-4afd-897d-66578f442cae/action => generated 0 bytes in 1273 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 21:56:23.074532 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-7b41cd51-ab64-49f9-812f-07fe0806fa76 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:23.075753 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-7b41cd51-ab64-49f9-812f-07fe0806fa76 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] [instance: 3b712221-0858-4ebc-a276-06d9c0c84fb7] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:56:23.082965 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-4fdcbb42-ff83-496e-95ef-550e2226f87b tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Getting quotas for user 7b45ebdb946b45c28fc4bca3dd5a3e5b and project 520782b7e0a94e3fb552744cc4584119. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:56:23.094622 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7b41cd51-ab64-49f9-812f-07fe0806fa76 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:23.095129 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7b41cd51-ab64-49f9-812f-07fe0806fa76 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:23.099513 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7b41cd51-ab64-49f9-812f-07fe0806fa76 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:23.100526 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7b41cd51-ab64-49f9-812f-07fe0806fa76 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:23.101454 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7b41cd51-ab64-49f9-812f-07fe0806fa76 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:23.103793 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7b41cd51-ab64-49f9-812f-07fe0806fa76 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:23.137648 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-4fdcbb42-ff83-496e-95ef-550e2226f87b tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Going to run 1 instances... {{(pid=134101) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:56:23.140718 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-4fdcbb42-ff83-496e-95ef-550e2226f87b tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] [instance: db2a8355-6007-4f37-89e1-a45e7492618d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='58548514-5dac-426c-81f5-19e3fba33e23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134101) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:56:23.163848 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-7b41cd51-ab64-49f9-812f-07fe0806fa76 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] HTTP exception thrown: Instance 3b712221-0858-4ebc-a276-06d9c0c84fb7 could not be found. Oct 04 21:56:23.168032 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-7b41cd51-ab64-49f9-812f-07fe0806fa76 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Request method failure captured: Oct 04 21:56:23.168032 n-d-860284-1 devstack@n-api.service[134102]: request: GET /compute/v2.1/servers/3b712221-0858-4ebc-a276-06d9c0c84fb7 HTTP/1.1 Oct 04 21:56:23.168032 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 21:56:23.168032 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 21:56:23.168032 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 21:56:23.168032 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 21:56:23.168032 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 21:56:23.168032 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 21:56:23.168032 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 21:56:23.168032 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 21:56:23.168032 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPKvnOsQZGvKNpcPUu-_4UvKW_g8qAPyo5iKoUerSrDv4rDUrj8Nr0maVQE4p9Aop7hCQSLwtsgTZ_iKV2oZ6luxSjExu1fuEVZc6ZGAUDb2WsZTEhPrtZJwX9AobzBLEdGMpg1eWDNojjbcnI2PkmOcLN0OgQbJN9sWSxpacAXqseDU Oct 04 21:56:23.168032 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 21:56:23.168032 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 21:56:23.168032 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 21:56:23.168032 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 21:56:23.168032 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 21:56:23.168032 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 21:56:23.168032 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: eb891227dcd84bd49d7215af9dce2db3 Oct 04 21:56:23.168032 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-ServerGroupTestJSON-668440969 Oct 04 21:56:23.168032 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 21:56:23.168032 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 21:56:23.168032 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/eb891227dcd84bd49d7215af9dce2db3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_eb891227dcd84bd49d7215af9dce2db3", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/eb891227dcd84bd49d7215af9dce2db3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/eb891227dcd84bd49d7215af9dce2db3"}]}] Oct 04 21:56:23.168032 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-ServerGroupTestJSON-668440969 Oct 04 21:56:23.168032 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: eb891227dcd84bd49d7215af9dce2db3 Oct 04 21:56:23.168032 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-ServerGroupTestJSON-668440969 Oct 04 21:56:23.168032 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-ServerGroupTestJSON-668440969-project Oct 04 21:56:23.168032 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 21:56:23.168032 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 21:56:23.168032 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: 18de0948626e4a5c8a28711f943ba46e Oct 04 21:56:23.168032 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-ServerGroupTestJSON-668440969-project Oct 04 21:56:23.168032 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 21:56:23.168032 n-d-860284-1 devstack@n-api.service[134102]: exception: Instance 3b712221-0858-4ebc-a276-06d9c0c84fb7 could not be found. Oct 04 21:56:23.168032 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': '3b712221-0858-4ebc-a276-06d9c0c84fb7'} Oct 04 21:56:23.168032 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:56:23.168032 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:56:23.168032 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:56:23.168032 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:56:23.168032 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:56:23.168032 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:56:23.168032 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:56:23.168032 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:56:23.168032 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:56:23.168032 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:56:23.168032 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b712221-0858-4ebc-a276-06d9c0c84fb7 could not be found. Oct 04 21:56:23.168032 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:56:23.168032 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:56:23.168032 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:56:23.168032 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:56:23.168032 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:56:23.168032 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:56:23.168032 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:56:23.168032 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:56:23.168032 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:56:23.168032 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:56:23.168032 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:56:23.168032 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:56:23.168032 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:56:23.168032 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:56:23.168032 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:56:23.168032 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:56:23.168032 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b712221-0858-4ebc-a276-06d9c0c84fb7 could not be found. Oct 04 21:56:23.168032 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:56:23.168032 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:56:23.168032 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:56:23.172345 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:56:23.172345 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:56:23.172345 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:56:23.172345 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:56:23.172345 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:56:23.172345 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b712221-0858-4ebc-a276-06d9c0c84fb7 could not be found. Oct 04 21:56:23.172345 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:56:23.176184 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-7b41cd51-ab64-49f9-812f-07fe0806fa76 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Returning 404 to user: Instance 3b712221-0858-4ebc-a276-06d9c0c84fb7 could not be found. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:56:23.177706 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-7b41cd51-ab64-49f9-812f-07fe0806fa76 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] 10.222.0.43 "GET /compute/v2.1/servers/3b712221-0858-4ebc-a276-06d9c0c84fb7" status: 404 len: 111 microversion: 2.1 time: 0.108719 Oct 04 21:56:23.181205 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1466/2843] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:56:23 2022] GET /compute/v2.1/servers/3b712221-0858-4ebc-a276-06d9c0c84fb7 => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:56:23.205720 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-4fdcbb42-ff83-496e-95ef-550e2226f87b tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.853848 Oct 04 21:56:23.206611 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1378/2844] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 21:56:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 855 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:56:23.232531 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-fd78a9fc-a483-41b3-8349-5504a7d6b96f tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Calling method '.version_select at 0x7fbb2e78d700>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:23.683482 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-c809414b-57c2-47f1-b0e2-38182881f5b1 tempest-FloatingIPsNegativeTestJSON-623101595 tempest-FloatingIPsNegativeTestJSON-623101595-project] Calling method '.version_select at 0x7fbb2e72e940>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:23.791752 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-c809414b-57c2-47f1-b0e2-38182881f5b1 tempest-FloatingIPsNegativeTestJSON-623101595 tempest-FloatingIPsNegativeTestJSON-623101595-project] 10.222.0.43 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.608355 Oct 04 21:56:23.792506 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1467/2845] 10.222.0.43 () {58 vars in 1149 bytes} [Tue Oct 4 21:56:23 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 21:56:23.794982 n-d-860284-1 devstack@n-api.service[134101]: DEBUG neutronclient.v2_0.client [None req-fd78a9fc-a483-41b3-8349-5504a7d6b96f tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 27294451-aded-4095-ab50-1237895ef2fe in use.", "detail": ""}} {{(pid=134101) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 21:56:23.796002 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-fd78a9fc-a483-41b3-8349-5504a7d6b96f tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] HTTP exception thrown: Security Group 27294451-aded-4095-ab50-1237895ef2fe in use. Oct 04 21:56:23.796002 n-d-860284-1 devstack@n-api.service[134101]: Neutron server returns request_ids: ['req-9b7aadc0-45e3-4b7c-a517-53e05ecaa95b'] Oct 04 21:56:23.797997 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-d1eb91b2-d1da-456f-b9f2-c07c3e86c250 req-a7378845-f8fc-48dc-aa97-86bd990a335a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6188e227-0adf-4afd-897d-66578f442cae", "tag": "3506c0a9-1b9f-478c-b518-015e52ed0a1a"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:56:23.798810 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-fd78a9fc-a483-41b3-8349-5504a7d6b96f tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Request method failure captured: Oct 04 21:56:23.798810 n-d-860284-1 devstack@n-api.service[134101]: request: DELETE /compute/v2.1/os-security-groups/27294451-aded-4095-ab50-1237895ef2fe HTTP/1.1 Oct 04 21:56:23.798810 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 21:56:23.798810 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 21:56:23.798810 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 21:56:23.798810 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 21:56:23.798810 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 21:56:23.798810 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 21:56:23.798810 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 21:56:23.798810 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 21:56:23.798810 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPKu1qJNzwuxRWdc7rP7w0gQHhoDMvT1hi4W6OphaRxhVehI7YxkRLmiRVTEcrGE4_kLVYYR9CLMgNAOGQEVIUg5ptFWtgovLZ1WXY_454sRPkZoUaMXWYK1EaSOxzAsp1QFRpLX6-NPmD2kPLhLIPCnWZqTYS8blSXJvj9wIhro38mc Oct 04 21:56:23.798810 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 21:56:23.798810 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 21:56:23.798810 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 21:56:23.798810 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 21:56:23.798810 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 21:56:23.798810 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 21:56:23.798810 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: 51745fc19321469bb20afabe48b2185d Oct 04 21:56:23.798810 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-SecurityGroupsTestJSON-367911468 Oct 04 21:56:23.798810 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 21:56:23.798810 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 21:56:23.798810 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/51745fc19321469bb20afabe48b2185d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_51745fc19321469bb20afabe48b2185d", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/51745fc19321469bb20afabe48b2185d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/51745fc19321469bb20afabe48b2185d"}]}] Oct 04 21:56:23.798810 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-SecurityGroupsTestJSON-367911468 Oct 04 21:56:23.798810 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: 51745fc19321469bb20afabe48b2185d Oct 04 21:56:23.798810 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-367911468 Oct 04 21:56:23.798810 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-SecurityGroupsTestJSON-367911468-project Oct 04 21:56:23.798810 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 21:56:23.798810 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 21:56:23.798810 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 4cca65ba35b14db8bf2187188de8c838 Oct 04 21:56:23.798810 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-SecurityGroupsTestJSON-367911468-project Oct 04 21:56:23.798810 n-d-860284-1 devstack@n-api.service[134101]: method: Oct 04 21:56:23.798810 n-d-860284-1 devstack@n-api.service[134101]: exception: Security Group 27294451-aded-4095-ab50-1237895ef2fe in use. Oct 04 21:56:23.798810 n-d-860284-1 devstack@n-api.service[134101]: Neutron server returns request_ids: ['req-9b7aadc0-45e3-4b7c-a517-53e05ecaa95b'] Oct 04 21:56:23.798810 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': '27294451-aded-4095-ab50-1237895ef2fe'} Oct 04 21:56:23.798810 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:56:23.798810 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:56:23.798810 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 04 21:56:23.798810 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 04 21:56:23.798810 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:56:23.798810 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:56:23.798810 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 04 21:56:23.798810 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 04 21:56:23.798810 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:56:23.798810 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:56:23.798810 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 04 21:56:23.798810 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 04 21:56:23.798810 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:56:23.798810 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:56:23.798810 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 21:56:23.798810 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 21:56:23.798810 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:56:23.798810 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:56:23.798810 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 21:56:23.798810 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 21:56:23.798810 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:56:23.798810 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:56:23.798810 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 21:56:23.798810 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 21:56:23.798810 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 21:56:23.798810 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 21:56:23.798810 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 27294451-aded-4095-ab50-1237895ef2fe in use. Oct 04 21:56:23.803994 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9b7aadc0-45e3-4b7c-a517-53e05ecaa95b'] Oct 04 21:56:23.803994 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:56:23.803994 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:56:23.803994 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:56:23.803994 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:56:23.803994 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 04 21:56:23.803994 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 04 21:56:23.803994 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 04 21:56:23.803994 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 04 21:56:23.803994 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 27294451-aded-4095-ab50-1237895ef2fe in use. Oct 04 21:56:23.803994 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9b7aadc0-45e3-4b7c-a517-53e05ecaa95b'] Oct 04 21:56:23.803994 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:56:23.803994 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:56:23.803994 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:56:23.803994 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:56:23.803994 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:56:23.803994 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:56:23.803994 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:56:23.803994 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:56:23.803994 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:56:23.803994 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:56:23.803994 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:56:23.803994 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:56:23.803994 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 04 21:56:23.803994 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 04 21:56:23.803994 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 27294451-aded-4095-ab50-1237895ef2fe in use. Oct 04 21:56:23.803994 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9b7aadc0-45e3-4b7c-a517-53e05ecaa95b'] Oct 04 21:56:23.803994 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:56:23.803994 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:56:23.803994 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:56:23.803994 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:56:23.803994 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:56:23.803994 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:56:23.803994 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:56:23.803994 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:56:23.803994 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 27294451-aded-4095-ab50-1237895ef2fe in use. Oct 04 21:56:23.803994 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9b7aadc0-45e3-4b7c-a517-53e05ecaa95b'] Oct 04 21:56:23.803994 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:56:23.808143 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-fd78a9fc-a483-41b3-8349-5504a7d6b96f tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Returning 400 to user: Security Group 27294451-aded-4095-ab50-1237895ef2fe in use. Oct 04 21:56:23.808143 n-d-860284-1 devstack@n-api.service[134101]: Neutron server returns request_ids: ['req-9b7aadc0-45e3-4b7c-a517-53e05ecaa95b'] {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:56:23.809290 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-fd78a9fc-a483-41b3-8349-5504a7d6b96f tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/27294451-aded-4095-ab50-1237895ef2fe" status: 400 len: 185 microversion: 2.1 time: 0.594867 Oct 04 21:56:23.810461 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1379/2846] 10.222.0.43 () {58 vars in 1272 bytes} [Tue Oct 4 21:56:23 2022] DELETE /compute/v2.1/os-security-groups/27294451-aded-4095-ab50-1237895ef2fe => generated 185 bytes in 596 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 21:56:23.818971 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-3f8e6f30-d2b2-407a-afe4-b7c84a3eeff3 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:23.829586 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:56:23.833405 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-d1eb91b2-d1da-456f-b9f2-c07c3e86c250 req-a7378845-f8fc-48dc-aa97-86bd990a335a service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:23.835096 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-d1eb91b2-d1da-456f-b9f2-c07c3e86c250 req-a7378845-f8fc-48dc-aa97-86bd990a335a service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:23.835991 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-d1eb91b2-d1da-456f-b9f2-c07c3e86c250 req-a7378845-f8fc-48dc-aa97-86bd990a335a service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:23.840090 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.compute.server_groups [None req-3f8e6f30-d2b2-407a-afe4-b7c84a3eeff3 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Querying cell 1297bf18-d456-4d7b-91a9-0a07f1cafd2a(cell1) for 1 instances {{(pid=134101) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 04 21:56:23.840823 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3f8e6f30-d2b2-407a-afe4-b7c84a3eeff3 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:23.841312 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3f8e6f30-d2b2-407a-afe4-b7c84a3eeff3 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:23.841754 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3f8e6f30-d2b2-407a-afe4-b7c84a3eeff3 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:23.853921 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-3f8e6f30-d2b2-407a-afe4-b7c84a3eeff3 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] 10.222.0.43 "GET /compute/v2.1/os-server-groups" status: 200 len: 185 microversion: 2.1 time: 0.041292 Oct 04 21:56:23.855428 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-d1eb91b2-d1da-456f-b9f2-c07c3e86c250 req-a7378845-f8fc-48dc-aa97-86bd990a335a service nova] Creating event network-changed:3506c0a9-1b9f-478c-b518-015e52ed0a1a for instance 6188e227-0adf-4afd-897d-66578f442cae on n-h2-860284-1 Oct 04 21:56:23.862271 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1380/2847] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Oct 4 21:56:23 2022] GET /compute/v2.1/os-server-groups => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:56:23.870405 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-c45be412-ad5d-4911-b510-9301420a2539 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:23.871368 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-c45be412-ad5d-4911-b510-9301420a2539 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] [instance: db2a8355-6007-4f37-89e1-a45e7492618d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:56:23.878165 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-d1eb91b2-d1da-456f-b9f2-c07c3e86c250 req-a7378845-f8fc-48dc-aa97-86bd990a335a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082687 Oct 04 21:56:23.880139 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1468/2848] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:56:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:56:23.898154 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-f52300d1-8d94-40e4-8a3c-17d70d7b9707 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:23.899215 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-f52300d1-8d94-40e4-8a3c-17d70d7b9707 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] [instance: b176215c-96d4-402b-9c63-7ce87fe04ff6] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:56:23.913022 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f52300d1-8d94-40e4-8a3c-17d70d7b9707 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:23.914482 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f52300d1-8d94-40e4-8a3c-17d70d7b9707 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:23.916226 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f52300d1-8d94-40e4-8a3c-17d70d7b9707 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:23.919437 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f52300d1-8d94-40e4-8a3c-17d70d7b9707 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:23.920174 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f52300d1-8d94-40e4-8a3c-17d70d7b9707 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:23.921877 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f52300d1-8d94-40e4-8a3c-17d70d7b9707 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:23.979822 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-c45be412-ad5d-4911-b510-9301420a2539 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b45ebdb946b45c28fc4bca3dd5a3e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520782b7e0a94e3fb552744cc4584119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:56:23.992911 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-c45be412-ad5d-4911-b510-9301420a2539 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] 10.222.0.43 "GET /compute/v2.1/servers/db2a8355-6007-4f37-89e1-a45e7492618d" status: 200 len: 1218 microversion: 2.1 time: 0.125052 Oct 04 21:56:23.993860 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1381/2849] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:56:23 2022] GET /compute/v2.1/servers/db2a8355-6007-4f37-89e1-a45e7492618d => generated 1218 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:56:24.008791 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-5fbb48b9-e0b2-461f-8f21-2c4b87f36441 tempest-FloatingIPsNegativeTestJSON-623101595 tempest-FloatingIPsNegativeTestJSON-623101595-project] Action: 'create', calling method: .version_select at 0x7fbb2e6cbf70>, body: {"pool": "non_exist_pool"} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:56:24.181671 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-5fbb48b9-e0b2-461f-8f21-2c4b87f36441 tempest-FloatingIPsNegativeTestJSON-623101595 tempest-FloatingIPsNegativeTestJSON-623101595-project] HTTP exception thrown: Floating IP pool not found. Oct 04 21:56:24.183433 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-5fbb48b9-e0b2-461f-8f21-2c4b87f36441 tempest-FloatingIPsNegativeTestJSON-623101595 tempest-FloatingIPsNegativeTestJSON-623101595-project] Request method failure captured: Oct 04 21:56:24.183433 n-d-860284-1 devstack@n-api.service[134101]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 Oct 04 21:56:24.183433 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 21:56:24.183433 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 21:56:24.183433 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 21:56:24.183433 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 26 Oct 04 21:56:24.183433 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 21:56:24.183433 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 21:56:24.183433 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 21:56:24.183433 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 21:56:24.183433 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPKwGNPBoxNKQf9iSmurIDrUkmggu27Fw5-HeZFUT1bt97nQMPW-ORSo1s0oAwXwL-QRXCooQY8lUx04-1US_qnDuhMCXIlHqpITPhDqOr6cl5kDPLy-UeKbo9U-1tf52MwmvzbFFL4oo0y9iGFYJZMQWKQkrEOV9J1e73G7doOYYVE0 Oct 04 21:56:24.183433 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 21:56:24.183433 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 21:56:24.183433 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 21:56:24.183433 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 21:56:24.183433 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 21:56:24.183433 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 21:56:24.183433 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: fa79e3c91a034f78ad0bffa472278516 Oct 04 21:56:24.183433 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-623101595 Oct 04 21:56:24.183433 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 21:56:24.183433 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 21:56:24.183433 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/fa79e3c91a034f78ad0bffa472278516"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_fa79e3c91a034f78ad0bffa472278516", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/fa79e3c91a034f78ad0bffa472278516"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/fa79e3c91a034f78ad0bffa472278516"}]}] Oct 04 21:56:24.183433 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-623101595 Oct 04 21:56:24.183433 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: fa79e3c91a034f78ad0bffa472278516 Oct 04 21:56:24.183433 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-623101595 Oct 04 21:56:24.183433 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-FloatingIPsNegativeTestJSON-623101595-project Oct 04 21:56:24.183433 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 21:56:24.183433 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 21:56:24.183433 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 182e987f4cc143d4ac42cfdd849ed4d4 Oct 04 21:56:24.183433 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-623101595-project Oct 04 21:56:24.183433 n-d-860284-1 devstack@n-api.service[134101]: Oct 04 21:56:24.183433 n-d-860284-1 devstack@n-api.service[134101]: {"pool": "non_exist_pool"} Oct 04 21:56:24.183433 n-d-860284-1 devstack@n-api.service[134101]: method: Oct 04 21:56:24.183433 n-d-860284-1 devstack@n-api.service[134101]: exception: Floating IP pool not found. Oct 04 21:56:24.183433 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'body': {'pool': 'non_exist_pool'}} Oct 04 21:56:24.183433 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:56:24.183433 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:56:24.183433 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create Oct 04 21:56:24.183433 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) Oct 04 21:56:24.183433 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2972, in allocate_floating_ip Oct 04 21:56:24.183433 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) Oct 04 21:56:24.183433 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2962, in _get_floating_ip_pool_id_by_name_or_id Oct 04 21:56:24.183433 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() Oct 04 21:56:24.183433 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. Oct 04 21:56:24.183433 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:56:24.183433 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:56:24.183433 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:56:24.183433 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:56:24.183433 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:56:24.183433 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:56:24.183433 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:56:24.183433 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:56:24.183433 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:56:24.183433 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:56:24.183433 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:56:24.183433 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:56:24.183433 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create Oct 04 21:56:24.183433 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:56:24.183433 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. Oct 04 21:56:24.183433 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:56:24.183433 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:56:24.183433 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:56:24.183433 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:56:24.183433 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:56:24.183433 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:56:24.183433 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:56:24.183433 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:56:24.188157 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. Oct 04 21:56:24.188157 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:56:24.189190 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-5fbb48b9-e0b2-461f-8f21-2c4b87f36441 tempest-FloatingIPsNegativeTestJSON-623101595 tempest-FloatingIPsNegativeTestJSON-623101595-project] Returning 404 to user: Floating IP pool not found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:56:24.190220 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-5fbb48b9-e0b2-461f-8f21-2c4b87f36441 tempest-FloatingIPsNegativeTestJSON-623101595 tempest-FloatingIPsNegativeTestJSON-623101595-project] 10.222.0.43 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.194905 Oct 04 21:56:24.191804 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1382/2850] 10.222.0.43 () {60 vars in 1170 bytes} [Tue Oct 4 21:56:23 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 197 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 21:56:24.207957 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e88fea19-88bd-4fbc-93cb-29fa61f2f75d tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:56:24.212699 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-e88fea19-88bd-4fbc-93cb-29fa61f2f75d tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] [instance: 6188e227-0adf-4afd-897d-66578f442cae] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:56:24.235408 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e88fea19-88bd-4fbc-93cb-29fa61f2f75d tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:24.244522 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e88fea19-88bd-4fbc-93cb-29fa61f2f75d tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:24.245140 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e88fea19-88bd-4fbc-93cb-29fa61f2f75d tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:24.246119 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e88fea19-88bd-4fbc-93cb-29fa61f2f75d tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:24.246743 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e88fea19-88bd-4fbc-93cb-29fa61f2f75d tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:24.247717 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e88fea19-88bd-4fbc-93cb-29fa61f2f75d tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:24.355432 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:56:24.375819 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-f52300d1-8d94-40e4-8a3c-17d70d7b9707 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e807c724cc4c3887a2d360f0584ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40071e45805146529fb8abd40629c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:56:24.390967 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-f52300d1-8d94-40e4-8a3c-17d70d7b9707 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] 10.222.0.43 "GET /compute/v2.1/servers/b176215c-96d4-402b-9c63-7ce87fe04ff6" status: 200 len: 1487 microversion: 2.1 time: 0.506579 Oct 04 21:56:24.395739 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1469/2851] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:56:23 2022] GET /compute/v2.1/servers/b176215c-96d4-402b-9c63-7ce87fe04ff6 => generated 1487 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:56:24.400268 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-e88fea19-88bd-4fbc-93cb-29fa61f2f75d tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] 10.222.0.43 "POST /compute/v2.1/servers/6188e227-0adf-4afd-897d-66578f442cae/action" status: 202 len: 0 microversion: 2.1 time: 0.205813 Oct 04 21:56:24.404318 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1383/2852] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 21:56:24 2022] POST /compute/v2.1/servers/6188e227-0adf-4afd-897d-66578f442cae/action => generated 0 bytes in 212 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:56:24.408919 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-eee83654-3678-4188-9a1a-042b7a468880 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:24.426700 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-311e33b1-ad4f-4313-a5ef-675409b4d7f8 tempest-FloatingIPsNegativeTestJSON-623101595 tempest-FloatingIPsNegativeTestJSON-623101595-project] Calling method '.version_select at 0x7fbb2ed0a430>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:24.458713 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.compute.server_groups [None req-eee83654-3678-4188-9a1a-042b7a468880 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Querying cell 1297bf18-d456-4d7b-91a9-0a07f1cafd2a(cell1) for 1 instances {{(pid=134102) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 04 21:56:24.459646 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-eee83654-3678-4188-9a1a-042b7a468880 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:24.460451 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-eee83654-3678-4188-9a1a-042b7a468880 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:24.461095 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-eee83654-3678-4188-9a1a-042b7a468880 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:24.496429 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-eee83654-3678-4188-9a1a-042b7a468880 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] 10.222.0.43 "GET /compute/v2.1/os-server-groups/1de10a59-897f-4699-bb15-bfe7e69e976c" status: 200 len: 182 microversion: 2.1 time: 0.095390 Oct 04 21:56:24.497133 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1470/2853] 10.222.0.43 () {58 vars in 1263 bytes} [Tue Oct 4 21:56:24 2022] GET /compute/v2.1/os-server-groups/1de10a59-897f-4699-bb15-bfe7e69e976c => generated 182 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:56:24.522314 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-8dc2488a-203b-4017-8d7a-6c67dca3f28e tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:24.524199 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-8dc2488a-203b-4017-8d7a-6c67dca3f28e tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] [instance: 6188e227-0adf-4afd-897d-66578f442cae] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:56:24.540918 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8dc2488a-203b-4017-8d7a-6c67dca3f28e tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:24.542599 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8dc2488a-203b-4017-8d7a-6c67dca3f28e tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:24.545196 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8dc2488a-203b-4017-8d7a-6c67dca3f28e tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:24.549163 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8dc2488a-203b-4017-8d7a-6c67dca3f28e tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:24.550045 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8dc2488a-203b-4017-8d7a-6c67dca3f28e tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:24.552473 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8dc2488a-203b-4017-8d7a-6c67dca3f28e tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:24.608461 n-d-860284-1 devstack@n-api.service[134101]: DEBUG neutronclient.v2_0.client [None req-311e33b1-ad4f-4313-a5ef-675409b4d7f8 tempest-FloatingIPsNegativeTestJSON-623101595 tempest-FloatingIPsNegativeTestJSON-623101595-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 2567d63f-542b-4f6d-a418-8ae0e2953c63 could not be found", "detail": ""}} {{(pid=134101) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 21:56:24.609365 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-311e33b1-ad4f-4313-a5ef-675409b4d7f8 tempest-FloatingIPsNegativeTestJSON-623101595 tempest-FloatingIPsNegativeTestJSON-623101595-project] HTTP exception thrown: Floating IP not found for ID 2567d63f-542b-4f6d-a418-8ae0e2953c63 Oct 04 21:56:24.612233 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-311e33b1-ad4f-4313-a5ef-675409b4d7f8 tempest-FloatingIPsNegativeTestJSON-623101595 tempest-FloatingIPsNegativeTestJSON-623101595-project] Request method failure captured: Oct 04 21:56:24.612233 n-d-860284-1 devstack@n-api.service[134101]: request: DELETE /compute/v2.1/os-floating-ips/2567d63f-542b-4f6d-a418-8ae0e2953c63 HTTP/1.1 Oct 04 21:56:24.612233 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 21:56:24.612233 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 21:56:24.612233 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 21:56:24.612233 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 21:56:24.612233 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 21:56:24.612233 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 21:56:24.612233 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 21:56:24.612233 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 21:56:24.612233 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPKwGNPBoxNKQf9iSmurIDrUkmggu27Fw5-HeZFUT1bt97nQMPW-ORSo1s0oAwXwL-QRXCooQY8lUx04-1US_qnDuhMCXIlHqpITPhDqOr6cl5kDPLy-UeKbo9U-1tf52MwmvzbFFL4oo0y9iGFYJZMQWKQkrEOV9J1e73G7doOYYVE0 Oct 04 21:56:24.612233 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 21:56:24.612233 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 21:56:24.612233 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 21:56:24.612233 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 21:56:24.612233 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 21:56:24.612233 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 21:56:24.612233 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: fa79e3c91a034f78ad0bffa472278516 Oct 04 21:56:24.612233 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-623101595 Oct 04 21:56:24.612233 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 21:56:24.612233 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 21:56:24.612233 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/fa79e3c91a034f78ad0bffa472278516"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_fa79e3c91a034f78ad0bffa472278516", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/fa79e3c91a034f78ad0bffa472278516"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/fa79e3c91a034f78ad0bffa472278516"}]}] Oct 04 21:56:24.612233 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-623101595 Oct 04 21:56:24.612233 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: fa79e3c91a034f78ad0bffa472278516 Oct 04 21:56:24.612233 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-623101595 Oct 04 21:56:24.612233 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-FloatingIPsNegativeTestJSON-623101595-project Oct 04 21:56:24.612233 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 21:56:24.612233 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 21:56:24.612233 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 182e987f4cc143d4ac42cfdd849ed4d4 Oct 04 21:56:24.612233 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-623101595-project Oct 04 21:56:24.612233 n-d-860284-1 devstack@n-api.service[134101]: method: Oct 04 21:56:24.612233 n-d-860284-1 devstack@n-api.service[134101]: exception: Floating IP not found for ID 2567d63f-542b-4f6d-a418-8ae0e2953c63 Oct 04 21:56:24.612233 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': '2567d63f-542b-4f6d-a418-8ae0e2953c63'} Oct 04 21:56:24.612233 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:56:24.612233 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:56:24.612233 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 04 21:56:24.612233 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 04 21:56:24.612233 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:56:24.612233 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:56:24.612233 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 04 21:56:24.612233 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 04 21:56:24.612233 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:56:24.612233 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:56:24.612233 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 21:56:24.612233 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 21:56:24.612233 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:56:24.612233 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:56:24.612233 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 21:56:24.612233 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 21:56:24.612233 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:56:24.612233 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:56:24.612233 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 21:56:24.612233 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 21:56:24.612233 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:56:24.612233 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:56:24.612233 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 21:56:24.612233 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 21:56:24.612233 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 21:56:24.612233 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 21:56:24.612233 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 2567d63f-542b-4f6d-a418-8ae0e2953c63 could not be found Oct 04 21:56:24.612233 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-35519dc2-ea6e-42a5-b178-8dd2ab89635c'] Oct 04 21:56:24.618278 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:56:24.618278 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:56:24.618278 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:56:24.618278 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:56:24.618278 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Oct 04 21:56:24.618278 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 04 21:56:24.618278 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 04 21:56:24.618278 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 04 21:56:24.618278 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 2567d63f-542b-4f6d-a418-8ae0e2953c63. Oct 04 21:56:24.618278 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:56:24.618278 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:56:24.618278 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:56:24.618278 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:56:24.618278 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:56:24.618278 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:56:24.618278 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:56:24.618278 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:56:24.618278 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:56:24.618278 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:56:24.618278 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:56:24.618278 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:56:24.618278 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Oct 04 21:56:24.618278 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 04 21:56:24.618278 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 2567d63f-542b-4f6d-a418-8ae0e2953c63 Oct 04 21:56:24.618278 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:56:24.618278 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:56:24.618278 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:56:24.618278 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:56:24.618278 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:56:24.618278 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:56:24.618278 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:56:24.618278 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:56:24.618278 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 2567d63f-542b-4f6d-a418-8ae0e2953c63 Oct 04 21:56:24.618278 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:56:24.618278 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-311e33b1-ad4f-4313-a5ef-675409b4d7f8 tempest-FloatingIPsNegativeTestJSON-623101595 tempest-FloatingIPsNegativeTestJSON-623101595-project] Returning 404 to user: Floating IP not found for ID 2567d63f-542b-4f6d-a418-8ae0e2953c63 {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:56:24.618278 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-311e33b1-ad4f-4313-a5ef-675409b4d7f8 tempest-FloatingIPsNegativeTestJSON-623101595 tempest-FloatingIPsNegativeTestJSON-623101595-project] 10.222.0.43 "DELETE /compute/v2.1/os-floating-ips/2567d63f-542b-4f6d-a418-8ae0e2953c63" status: 404 len: 111 microversion: 2.1 time: 0.201421 Oct 04 21:56:24.618278 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1384/2854] 10.222.0.43 () {58 vars in 1263 bytes} [Tue Oct 4 21:56:24 2022] DELETE /compute/v2.1/os-floating-ips/2567d63f-542b-4f6d-a418-8ae0e2953c63 => generated 111 bytes in 210 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:56:24.626824 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-01dff7de-f3c2-40ed-88e7-291f62214bf0 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:56:24.626824 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-01dff7de-f3c2-40ed-88e7-291f62214bf0 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] [instance: b176215c-96d4-402b-9c63-7ce87fe04ff6] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:56:24.637188 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-01dff7de-f3c2-40ed-88e7-291f62214bf0 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:24.637840 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-01dff7de-f3c2-40ed-88e7-291f62214bf0 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:24.638465 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-01dff7de-f3c2-40ed-88e7-291f62214bf0 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:24.639265 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-01dff7de-f3c2-40ed-88e7-291f62214bf0 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:24.652874 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-01dff7de-f3c2-40ed-88e7-291f62214bf0 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:24.653589 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-01dff7de-f3c2-40ed-88e7-291f62214bf0 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:24.809906 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-01dff7de-f3c2-40ed-88e7-291f62214bf0 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] 10.222.0.43 "POST /compute/v2.1/servers/b176215c-96d4-402b-9c63-7ce87fe04ff6/action" status: 202 len: 0 microversion: 2.1 time: 0.192267 Oct 04 21:56:24.815301 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1385/2855] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 21:56:24 2022] POST /compute/v2.1/servers/b176215c-96d4-402b-9c63-7ce87fe04ff6/action => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:56:24.827759 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-d19308ba-88cd-40c1-851d-f791e61a0116 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:24.830890 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-d19308ba-88cd-40c1-851d-f791e61a0116 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] [instance: 3b712221-0858-4ebc-a276-06d9c0c84fb7] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:56:24.841736 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d19308ba-88cd-40c1-851d-f791e61a0116 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:24.842554 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d19308ba-88cd-40c1-851d-f791e61a0116 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:24.843517 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d19308ba-88cd-40c1-851d-f791e61a0116 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:24.844461 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d19308ba-88cd-40c1-851d-f791e61a0116 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:24.845253 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d19308ba-88cd-40c1-851d-f791e61a0116 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:24.846083 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d19308ba-88cd-40c1-851d-f791e61a0116 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:24.865787 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-d19308ba-88cd-40c1-851d-f791e61a0116 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] HTTP exception thrown: Instance 3b712221-0858-4ebc-a276-06d9c0c84fb7 could not be found. Oct 04 21:56:24.868759 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-d19308ba-88cd-40c1-851d-f791e61a0116 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Request method failure captured: Oct 04 21:56:24.868759 n-d-860284-1 devstack@n-api.service[134101]: request: DELETE /compute/v2.1/servers/3b712221-0858-4ebc-a276-06d9c0c84fb7 HTTP/1.1 Oct 04 21:56:24.868759 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 21:56:24.868759 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 21:56:24.868759 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 21:56:24.868759 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 21:56:24.868759 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 21:56:24.868759 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 21:56:24.868759 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 21:56:24.868759 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 21:56:24.868759 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPKvnOsQZGvKNpcPUu-_4UvKW_g8qAPyo5iKoUerSrDv4rDUrj8Nr0maVQE4p9Aop7hCQSLwtsgTZ_iKV2oZ6luxSjExu1fuEVZc6ZGAUDb2WsZTEhPrtZJwX9AobzBLEdGMpg1eWDNojjbcnI2PkmOcLN0OgQbJN9sWSxpacAXqseDU Oct 04 21:56:24.868759 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 21:56:24.868759 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 21:56:24.868759 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 21:56:24.868759 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 21:56:24.868759 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 21:56:24.868759 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 21:56:24.868759 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: eb891227dcd84bd49d7215af9dce2db3 Oct 04 21:56:24.868759 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-ServerGroupTestJSON-668440969 Oct 04 21:56:24.868759 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 21:56:24.868759 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 21:56:24.868759 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/eb891227dcd84bd49d7215af9dce2db3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_eb891227dcd84bd49d7215af9dce2db3", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/eb891227dcd84bd49d7215af9dce2db3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/eb891227dcd84bd49d7215af9dce2db3"}]}] Oct 04 21:56:24.868759 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-ServerGroupTestJSON-668440969 Oct 04 21:56:24.868759 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: eb891227dcd84bd49d7215af9dce2db3 Oct 04 21:56:24.868759 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-ServerGroupTestJSON-668440969 Oct 04 21:56:24.868759 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-ServerGroupTestJSON-668440969-project Oct 04 21:56:24.868759 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 21:56:24.868759 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 21:56:24.868759 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 18de0948626e4a5c8a28711f943ba46e Oct 04 21:56:24.868759 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-ServerGroupTestJSON-668440969-project Oct 04 21:56:24.868759 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 21:56:24.868759 n-d-860284-1 devstack@n-api.service[134101]: exception: Instance 3b712221-0858-4ebc-a276-06d9c0c84fb7 could not be found. Oct 04 21:56:24.868759 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': '3b712221-0858-4ebc-a276-06d9c0c84fb7'} Oct 04 21:56:24.868759 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:56:24.868759 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:56:24.868759 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:56:24.868759 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:56:24.868759 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:56:24.868759 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:56:24.868759 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:56:24.868759 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:56:24.868759 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:56:24.868759 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:56:24.868759 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b712221-0858-4ebc-a276-06d9c0c84fb7 could not be found. Oct 04 21:56:24.868759 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:56:24.868759 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:56:24.868759 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:56:24.868759 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:56:24.868759 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:56:24.868759 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:56:24.868759 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:56:24.868759 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:56:24.868759 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:56:24.868759 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:56:24.868759 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 21:56:24.868759 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 21:56:24.868759 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 21:56:24.868759 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 21:56:24.868759 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:56:24.868759 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:56:24.868759 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:56:24.868759 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:56:24.873791 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b712221-0858-4ebc-a276-06d9c0c84fb7 could not be found. Oct 04 21:56:24.873791 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:56:24.873791 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:56:24.873791 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:56:24.873791 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:56:24.873791 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:56:24.873791 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:56:24.873791 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:56:24.873791 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:56:24.873791 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b712221-0858-4ebc-a276-06d9c0c84fb7 could not be found. Oct 04 21:56:24.873791 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:56:24.873791 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-d19308ba-88cd-40c1-851d-f791e61a0116 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Returning 404 to user: Instance 3b712221-0858-4ebc-a276-06d9c0c84fb7 could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:56:24.875375 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-d19308ba-88cd-40c1-851d-f791e61a0116 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] 10.222.0.43 "DELETE /compute/v2.1/servers/3b712221-0858-4ebc-a276-06d9c0c84fb7" status: 404 len: 111 microversion: 2.1 time: 0.058912 Oct 04 21:56:24.878986 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1386/2856] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 21:56:24 2022] DELETE /compute/v2.1/servers/3b712221-0858-4ebc-a276-06d9c0c84fb7 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:56:24.893623 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-20a5ba31-58ba-446a-923a-e013db3ffc0f tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:24.894333 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-20a5ba31-58ba-446a-923a-e013db3ffc0f tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] [instance: b176215c-96d4-402b-9c63-7ce87fe04ff6] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:56:24.909648 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-20a5ba31-58ba-446a-923a-e013db3ffc0f tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:24.910707 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-20a5ba31-58ba-446a-923a-e013db3ffc0f tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:24.911205 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-20a5ba31-58ba-446a-923a-e013db3ffc0f tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:24.915073 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-20a5ba31-58ba-446a-923a-e013db3ffc0f tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:24.915601 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-20a5ba31-58ba-446a-923a-e013db3ffc0f tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:24.916047 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-20a5ba31-58ba-446a-923a-e013db3ffc0f tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:24.925208 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-8dc2488a-203b-4017-8d7a-6c67dca3f28e tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cca65ba35b14db8bf2187188de8c838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51745fc19321469bb20afabe48b2185d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:56:24.937155 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-8dc2488a-203b-4017-8d7a-6c67dca3f28e tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] 10.222.0.43 "GET /compute/v2.1/servers/6188e227-0adf-4afd-897d-66578f442cae" status: 200 len: 1574 microversion: 2.1 time: 0.435648 Oct 04 21:56:24.938005 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1471/2857] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:56:24 2022] GET /compute/v2.1/servers/6188e227-0adf-4afd-897d-66578f442cae => generated 1574 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:56:24.947484 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-dcb58afe-a1bd-4639-a998-d5a48e067d85 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:24.950452 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-dcb58afe-a1bd-4639-a998-d5a48e067d85 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] [instance: 3b712221-0858-4ebc-a276-06d9c0c84fb7] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:56:24.967865 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dcb58afe-a1bd-4639-a998-d5a48e067d85 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:24.970037 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dcb58afe-a1bd-4639-a998-d5a48e067d85 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:24.975022 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dcb58afe-a1bd-4639-a998-d5a48e067d85 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:24.975909 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dcb58afe-a1bd-4639-a998-d5a48e067d85 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:24.976388 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dcb58afe-a1bd-4639-a998-d5a48e067d85 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:24.976833 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dcb58afe-a1bd-4639-a998-d5a48e067d85 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:25.015086 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-dcb58afe-a1bd-4639-a998-d5a48e067d85 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] HTTP exception thrown: Instance 3b712221-0858-4ebc-a276-06d9c0c84fb7 could not be found. Oct 04 21:56:25.021616 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-dcb58afe-a1bd-4639-a998-d5a48e067d85 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Request method failure captured: Oct 04 21:56:25.021616 n-d-860284-1 devstack@n-api.service[134102]: request: GET /compute/v2.1/servers/3b712221-0858-4ebc-a276-06d9c0c84fb7 HTTP/1.1 Oct 04 21:56:25.021616 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 21:56:25.021616 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 21:56:25.021616 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 21:56:25.021616 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 21:56:25.021616 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 21:56:25.021616 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 21:56:25.021616 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 21:56:25.021616 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 21:56:25.021616 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPKvnOsQZGvKNpcPUu-_4UvKW_g8qAPyo5iKoUerSrDv4rDUrj8Nr0maVQE4p9Aop7hCQSLwtsgTZ_iKV2oZ6luxSjExu1fuEVZc6ZGAUDb2WsZTEhPrtZJwX9AobzBLEdGMpg1eWDNojjbcnI2PkmOcLN0OgQbJN9sWSxpacAXqseDU Oct 04 21:56:25.021616 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 21:56:25.021616 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 21:56:25.021616 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 21:56:25.021616 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 21:56:25.021616 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 21:56:25.021616 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 21:56:25.021616 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: eb891227dcd84bd49d7215af9dce2db3 Oct 04 21:56:25.021616 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-ServerGroupTestJSON-668440969 Oct 04 21:56:25.021616 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 21:56:25.021616 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 21:56:25.021616 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/eb891227dcd84bd49d7215af9dce2db3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_eb891227dcd84bd49d7215af9dce2db3", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/eb891227dcd84bd49d7215af9dce2db3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/eb891227dcd84bd49d7215af9dce2db3"}]}] Oct 04 21:56:25.021616 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-ServerGroupTestJSON-668440969 Oct 04 21:56:25.021616 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: eb891227dcd84bd49d7215af9dce2db3 Oct 04 21:56:25.021616 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-ServerGroupTestJSON-668440969 Oct 04 21:56:25.021616 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-ServerGroupTestJSON-668440969-project Oct 04 21:56:25.021616 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 21:56:25.021616 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 21:56:25.021616 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: 18de0948626e4a5c8a28711f943ba46e Oct 04 21:56:25.021616 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-ServerGroupTestJSON-668440969-project Oct 04 21:56:25.021616 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 21:56:25.021616 n-d-860284-1 devstack@n-api.service[134102]: exception: Instance 3b712221-0858-4ebc-a276-06d9c0c84fb7 could not be found. Oct 04 21:56:25.021616 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': '3b712221-0858-4ebc-a276-06d9c0c84fb7'} Oct 04 21:56:25.021616 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:56:25.021616 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:56:25.021616 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:56:25.021616 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:56:25.021616 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:56:25.021616 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:56:25.021616 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:56:25.021616 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:56:25.021616 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:56:25.021616 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:56:25.021616 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b712221-0858-4ebc-a276-06d9c0c84fb7 could not be found. Oct 04 21:56:25.021616 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:56:25.021616 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:56:25.021616 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:56:25.021616 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:56:25.021616 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:56:25.021616 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:56:25.021616 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:56:25.021616 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:56:25.021616 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:56:25.021616 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:56:25.021616 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:56:25.021616 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:56:25.021616 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:56:25.021616 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:56:25.021616 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:56:25.021616 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:56:25.021616 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b712221-0858-4ebc-a276-06d9c0c84fb7 could not be found. Oct 04 21:56:25.021616 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:56:25.021616 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:56:25.021616 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:56:25.027406 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:56:25.027406 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:56:25.027406 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:56:25.027406 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:56:25.027406 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:56:25.027406 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b712221-0858-4ebc-a276-06d9c0c84fb7 could not be found. Oct 04 21:56:25.027406 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:56:25.027406 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-dcb58afe-a1bd-4639-a998-d5a48e067d85 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Returning 404 to user: Instance 3b712221-0858-4ebc-a276-06d9c0c84fb7 could not be found. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:56:25.028622 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-dcb58afe-a1bd-4639-a998-d5a48e067d85 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] 10.222.0.43 "GET /compute/v2.1/servers/3b712221-0858-4ebc-a276-06d9c0c84fb7" status: 404 len: 111 microversion: 2.1 time: 0.089348 Oct 04 21:56:25.031921 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1472/2858] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:56:24 2022] GET /compute/v2.1/servers/3b712221-0858-4ebc-a276-06d9c0c84fb7 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:56:25.045683 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-268eec9b-cc72-4db2-a0e7-47e58d98b832 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:25.048742 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-268eec9b-cc72-4db2-a0e7-47e58d98b832 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] [instance: db2a8355-6007-4f37-89e1-a45e7492618d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:56:25.065020 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-268eec9b-cc72-4db2-a0e7-47e58d98b832 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:25.068724 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-268eec9b-cc72-4db2-a0e7-47e58d98b832 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:25.069229 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-268eec9b-cc72-4db2-a0e7-47e58d98b832 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:25.070043 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-268eec9b-cc72-4db2-a0e7-47e58d98b832 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:25.071833 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-268eec9b-cc72-4db2-a0e7-47e58d98b832 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:25.072300 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-268eec9b-cc72-4db2-a0e7-47e58d98b832 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:25.246587 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-268eec9b-cc72-4db2-a0e7-47e58d98b832 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b45ebdb946b45c28fc4bca3dd5a3e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520782b7e0a94e3fb552744cc4584119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:56:25.260228 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-268eec9b-cc72-4db2-a0e7-47e58d98b832 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] 10.222.0.43 "GET /compute/v2.1/servers/db2a8355-6007-4f37-89e1-a45e7492618d" status: 200 len: 1270 microversion: 2.1 time: 0.224504 Oct 04 21:56:25.263349 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1473/2859] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:56:25 2022] GET /compute/v2.1/servers/db2a8355-6007-4f37-89e1-a45e7492618d => generated 1270 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:56:25.286553 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-96193470-58bf-4397-a048-bfa881c498c5 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:25.302383 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-96193470-58bf-4397-a048-bfa881c498c5 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] HTTP exception thrown: Instance group 68de3d71-5730-421b-9972-4a3aadda6059 could not be found. Oct 04 21:56:25.311332 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-96193470-58bf-4397-a048-bfa881c498c5 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Request method failure captured: Oct 04 21:56:25.311332 n-d-860284-1 devstack@n-api.service[134102]: request: DELETE /compute/v2.1/os-server-groups/68de3d71-5730-421b-9972-4a3aadda6059 HTTP/1.1 Oct 04 21:56:25.311332 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 21:56:25.311332 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 21:56:25.311332 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 21:56:25.311332 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 21:56:25.311332 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 21:56:25.311332 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 21:56:25.311332 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 21:56:25.311332 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 21:56:25.311332 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPKvnOsQZGvKNpcPUu-_4UvKW_g8qAPyo5iKoUerSrDv4rDUrj8Nr0maVQE4p9Aop7hCQSLwtsgTZ_iKV2oZ6luxSjExu1fuEVZc6ZGAUDb2WsZTEhPrtZJwX9AobzBLEdGMpg1eWDNojjbcnI2PkmOcLN0OgQbJN9sWSxpacAXqseDU Oct 04 21:56:25.311332 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 21:56:25.311332 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 21:56:25.311332 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 21:56:25.311332 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 21:56:25.311332 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 21:56:25.311332 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 21:56:25.311332 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: eb891227dcd84bd49d7215af9dce2db3 Oct 04 21:56:25.311332 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-ServerGroupTestJSON-668440969 Oct 04 21:56:25.311332 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 21:56:25.311332 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 21:56:25.311332 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/eb891227dcd84bd49d7215af9dce2db3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_eb891227dcd84bd49d7215af9dce2db3", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/eb891227dcd84bd49d7215af9dce2db3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/eb891227dcd84bd49d7215af9dce2db3"}]}] Oct 04 21:56:25.311332 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-ServerGroupTestJSON-668440969 Oct 04 21:56:25.311332 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: eb891227dcd84bd49d7215af9dce2db3 Oct 04 21:56:25.311332 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-ServerGroupTestJSON-668440969 Oct 04 21:56:25.311332 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-ServerGroupTestJSON-668440969-project Oct 04 21:56:25.311332 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 21:56:25.311332 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 21:56:25.311332 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: 18de0948626e4a5c8a28711f943ba46e Oct 04 21:56:25.311332 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-ServerGroupTestJSON-668440969-project Oct 04 21:56:25.311332 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 21:56:25.311332 n-d-860284-1 devstack@n-api.service[134102]: exception: Instance group 68de3d71-5730-421b-9972-4a3aadda6059 could not be found. Oct 04 21:56:25.311332 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': '68de3d71-5730-421b-9972-4a3aadda6059'} Oct 04 21:56:25.311332 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:56:25.311332 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:56:25.311332 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 04 21:56:25.311332 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 04 21:56:25.311332 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 21:56:25.311332 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 21:56:25.311332 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 04 21:56:25.311332 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 04 21:56:25.311332 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 21:56:25.311332 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 21:56:25.311332 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 04 21:56:25.311332 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 04 21:56:25.311332 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 68de3d71-5730-421b-9972-4a3aadda6059 could not be found. Oct 04 21:56:25.311332 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:56:25.311332 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:56:25.311332 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:56:25.311332 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:56:25.311332 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:56:25.311332 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:56:25.311332 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:56:25.311332 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:56:25.311332 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:56:25.311332 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:56:25.311332 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 04 21:56:25.311332 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:56:25.311332 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 68de3d71-5730-421b-9972-4a3aadda6059 could not be found. Oct 04 21:56:25.311332 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:56:25.311332 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:56:25.311332 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:56:25.311332 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:56:25.319502 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:56:25.319502 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:56:25.319502 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:56:25.319502 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:56:25.319502 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 68de3d71-5730-421b-9972-4a3aadda6059 could not be found. Oct 04 21:56:25.319502 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:56:25.321891 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-96193470-58bf-4397-a048-bfa881c498c5 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Returning 404 to user: Instance group 68de3d71-5730-421b-9972-4a3aadda6059 could not be found. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:56:25.324382 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-96193470-58bf-4397-a048-bfa881c498c5 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] 10.222.0.43 "DELETE /compute/v2.1/os-server-groups/68de3d71-5730-421b-9972-4a3aadda6059" status: 404 len: 117 microversion: 2.1 time: 0.058261 Oct 04 21:56:25.328475 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1474/2860] 10.222.0.43 () {58 vars in 1266 bytes} [Tue Oct 4 21:56:25 2022] DELETE /compute/v2.1/os-server-groups/68de3d71-5730-421b-9972-4a3aadda6059 => generated 117 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:56:25.334533 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-bb24b338-5493-409b-9cee-f66c9ecb39b8 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:25.345706 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-bb24b338-5493-409b-9cee-f66c9ecb39b8 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] HTTP exception thrown: Instance group 6afb072d-aa26-44c4-b18b-316d8a134720 could not be found. Oct 04 21:56:25.347766 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-bb24b338-5493-409b-9cee-f66c9ecb39b8 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Request method failure captured: Oct 04 21:56:25.347766 n-d-860284-1 devstack@n-api.service[134102]: request: DELETE /compute/v2.1/os-server-groups/6afb072d-aa26-44c4-b18b-316d8a134720 HTTP/1.1 Oct 04 21:56:25.347766 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 21:56:25.347766 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 21:56:25.347766 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 21:56:25.347766 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 21:56:25.347766 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 21:56:25.347766 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 21:56:25.347766 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 21:56:25.347766 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 21:56:25.347766 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPKvnOsQZGvKNpcPUu-_4UvKW_g8qAPyo5iKoUerSrDv4rDUrj8Nr0maVQE4p9Aop7hCQSLwtsgTZ_iKV2oZ6luxSjExu1fuEVZc6ZGAUDb2WsZTEhPrtZJwX9AobzBLEdGMpg1eWDNojjbcnI2PkmOcLN0OgQbJN9sWSxpacAXqseDU Oct 04 21:56:25.347766 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 21:56:25.347766 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 21:56:25.347766 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 21:56:25.347766 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 21:56:25.347766 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 21:56:25.347766 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 21:56:25.347766 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: eb891227dcd84bd49d7215af9dce2db3 Oct 04 21:56:25.347766 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-ServerGroupTestJSON-668440969 Oct 04 21:56:25.347766 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 21:56:25.347766 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 21:56:25.347766 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/eb891227dcd84bd49d7215af9dce2db3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_eb891227dcd84bd49d7215af9dce2db3", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/eb891227dcd84bd49d7215af9dce2db3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/eb891227dcd84bd49d7215af9dce2db3"}]}] Oct 04 21:56:25.347766 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-ServerGroupTestJSON-668440969 Oct 04 21:56:25.347766 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: eb891227dcd84bd49d7215af9dce2db3 Oct 04 21:56:25.347766 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-ServerGroupTestJSON-668440969 Oct 04 21:56:25.347766 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-ServerGroupTestJSON-668440969-project Oct 04 21:56:25.347766 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 21:56:25.347766 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 21:56:25.347766 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: 18de0948626e4a5c8a28711f943ba46e Oct 04 21:56:25.347766 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-ServerGroupTestJSON-668440969-project Oct 04 21:56:25.347766 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 21:56:25.347766 n-d-860284-1 devstack@n-api.service[134102]: exception: Instance group 6afb072d-aa26-44c4-b18b-316d8a134720 could not be found. Oct 04 21:56:25.347766 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': '6afb072d-aa26-44c4-b18b-316d8a134720'} Oct 04 21:56:25.347766 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:56:25.347766 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:56:25.347766 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 04 21:56:25.347766 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 04 21:56:25.347766 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 21:56:25.347766 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 21:56:25.347766 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 04 21:56:25.347766 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 04 21:56:25.347766 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 21:56:25.347766 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 21:56:25.347766 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 04 21:56:25.347766 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 04 21:56:25.347766 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 6afb072d-aa26-44c4-b18b-316d8a134720 could not be found. Oct 04 21:56:25.347766 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:56:25.347766 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:56:25.347766 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:56:25.347766 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:56:25.347766 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:56:25.347766 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:56:25.347766 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:56:25.347766 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:56:25.347766 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:56:25.347766 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:56:25.347766 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 04 21:56:25.347766 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:56:25.347766 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 6afb072d-aa26-44c4-b18b-316d8a134720 could not be found. Oct 04 21:56:25.347766 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:56:25.347766 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:56:25.347766 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:56:25.347766 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:56:25.352145 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:56:25.352145 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:56:25.352145 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:56:25.352145 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:56:25.352145 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 6afb072d-aa26-44c4-b18b-316d8a134720 could not be found. Oct 04 21:56:25.352145 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:56:25.357392 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-bb24b338-5493-409b-9cee-f66c9ecb39b8 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Returning 404 to user: Instance group 6afb072d-aa26-44c4-b18b-316d8a134720 could not be found. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:56:25.358806 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-bb24b338-5493-409b-9cee-f66c9ecb39b8 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] 10.222.0.43 "DELETE /compute/v2.1/os-server-groups/6afb072d-aa26-44c4-b18b-316d8a134720" status: 404 len: 117 microversion: 2.1 time: 0.028964 Oct 04 21:56:25.359640 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1475/2861] 10.222.0.43 () {58 vars in 1266 bytes} [Tue Oct 4 21:56:25 2022] DELETE /compute/v2.1/os-server-groups/6afb072d-aa26-44c4-b18b-316d8a134720 => generated 117 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:56:25.391294 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-1b7fd8bb-2fc0-4b2d-8f14-b9201f9b2101 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:25.408840 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-1b7fd8bb-2fc0-4b2d-8f14-b9201f9b2101 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] HTTP exception thrown: Instance group c658a04c-9f67-4769-959a-c8a8bbc76015 could not be found. Oct 04 21:56:25.413362 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-1b7fd8bb-2fc0-4b2d-8f14-b9201f9b2101 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Request method failure captured: Oct 04 21:56:25.413362 n-d-860284-1 devstack@n-api.service[134102]: request: DELETE /compute/v2.1/os-server-groups/c658a04c-9f67-4769-959a-c8a8bbc76015 HTTP/1.1 Oct 04 21:56:25.413362 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 21:56:25.413362 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 21:56:25.413362 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 21:56:25.413362 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 21:56:25.413362 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 21:56:25.413362 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 21:56:25.413362 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 21:56:25.413362 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 21:56:25.413362 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPKvnOsQZGvKNpcPUu-_4UvKW_g8qAPyo5iKoUerSrDv4rDUrj8Nr0maVQE4p9Aop7hCQSLwtsgTZ_iKV2oZ6luxSjExu1fuEVZc6ZGAUDb2WsZTEhPrtZJwX9AobzBLEdGMpg1eWDNojjbcnI2PkmOcLN0OgQbJN9sWSxpacAXqseDU Oct 04 21:56:25.413362 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 21:56:25.413362 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 21:56:25.413362 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 21:56:25.413362 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 21:56:25.413362 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 21:56:25.413362 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 21:56:25.413362 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: eb891227dcd84bd49d7215af9dce2db3 Oct 04 21:56:25.413362 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-ServerGroupTestJSON-668440969 Oct 04 21:56:25.413362 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 21:56:25.413362 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 21:56:25.413362 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/eb891227dcd84bd49d7215af9dce2db3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_eb891227dcd84bd49d7215af9dce2db3", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/eb891227dcd84bd49d7215af9dce2db3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/eb891227dcd84bd49d7215af9dce2db3"}]}] Oct 04 21:56:25.413362 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-ServerGroupTestJSON-668440969 Oct 04 21:56:25.413362 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: eb891227dcd84bd49d7215af9dce2db3 Oct 04 21:56:25.413362 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-ServerGroupTestJSON-668440969 Oct 04 21:56:25.413362 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-ServerGroupTestJSON-668440969-project Oct 04 21:56:25.413362 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 21:56:25.413362 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 21:56:25.413362 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: 18de0948626e4a5c8a28711f943ba46e Oct 04 21:56:25.413362 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-ServerGroupTestJSON-668440969-project Oct 04 21:56:25.413362 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 21:56:25.413362 n-d-860284-1 devstack@n-api.service[134102]: exception: Instance group c658a04c-9f67-4769-959a-c8a8bbc76015 could not be found. Oct 04 21:56:25.413362 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': 'c658a04c-9f67-4769-959a-c8a8bbc76015'} Oct 04 21:56:25.413362 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:56:25.413362 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:56:25.413362 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 04 21:56:25.413362 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 04 21:56:25.413362 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 21:56:25.413362 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 21:56:25.413362 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 04 21:56:25.413362 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 04 21:56:25.413362 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 21:56:25.413362 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 21:56:25.413362 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 04 21:56:25.413362 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 04 21:56:25.413362 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group c658a04c-9f67-4769-959a-c8a8bbc76015 could not be found. Oct 04 21:56:25.413362 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:56:25.413362 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:56:25.413362 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:56:25.413362 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:56:25.413362 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:56:25.413362 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:56:25.413362 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:56:25.413362 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:56:25.413362 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:56:25.413362 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:56:25.413362 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 04 21:56:25.413362 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:56:25.413362 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group c658a04c-9f67-4769-959a-c8a8bbc76015 could not be found. Oct 04 21:56:25.413362 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:56:25.413362 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:56:25.413362 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:56:25.413362 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:56:25.417453 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:56:25.417453 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:56:25.417453 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:56:25.417453 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:56:25.417453 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group c658a04c-9f67-4769-959a-c8a8bbc76015 could not be found. Oct 04 21:56:25.417453 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:56:25.423403 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-1b7fd8bb-2fc0-4b2d-8f14-b9201f9b2101 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Returning 404 to user: Instance group c658a04c-9f67-4769-959a-c8a8bbc76015 could not be found. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:56:25.424915 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-1b7fd8bb-2fc0-4b2d-8f14-b9201f9b2101 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] 10.222.0.43 "DELETE /compute/v2.1/os-server-groups/c658a04c-9f67-4769-959a-c8a8bbc76015" status: 404 len: 117 microversion: 2.1 time: 0.047958 Oct 04 21:56:25.428233 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1476/2862] 10.222.0.43 () {58 vars in 1266 bytes} [Tue Oct 4 21:56:25 2022] DELETE /compute/v2.1/os-server-groups/c658a04c-9f67-4769-959a-c8a8bbc76015 => generated 117 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:56:25.442273 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-1f4adbc2-611d-4f76-b24b-ed2e59622e9c tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:25.450028 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-1f4adbc2-611d-4f76-b24b-ed2e59622e9c tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] HTTP exception thrown: Instance group 4fdf4c4f-79fa-4120-8070-f41b7d58dc34 could not be found. Oct 04 21:56:25.452197 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-1f4adbc2-611d-4f76-b24b-ed2e59622e9c tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Request method failure captured: Oct 04 21:56:25.452197 n-d-860284-1 devstack@n-api.service[134102]: request: DELETE /compute/v2.1/os-server-groups/4fdf4c4f-79fa-4120-8070-f41b7d58dc34 HTTP/1.1 Oct 04 21:56:25.452197 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 21:56:25.452197 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 21:56:25.452197 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 21:56:25.452197 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 21:56:25.452197 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 21:56:25.452197 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 21:56:25.452197 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 21:56:25.452197 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 21:56:25.452197 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPKvnOsQZGvKNpcPUu-_4UvKW_g8qAPyo5iKoUerSrDv4rDUrj8Nr0maVQE4p9Aop7hCQSLwtsgTZ_iKV2oZ6luxSjExu1fuEVZc6ZGAUDb2WsZTEhPrtZJwX9AobzBLEdGMpg1eWDNojjbcnI2PkmOcLN0OgQbJN9sWSxpacAXqseDU Oct 04 21:56:25.452197 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 21:56:25.452197 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 21:56:25.452197 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 21:56:25.452197 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 21:56:25.452197 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 21:56:25.452197 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 21:56:25.452197 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: eb891227dcd84bd49d7215af9dce2db3 Oct 04 21:56:25.452197 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-ServerGroupTestJSON-668440969 Oct 04 21:56:25.452197 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 21:56:25.452197 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 21:56:25.452197 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/eb891227dcd84bd49d7215af9dce2db3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_eb891227dcd84bd49d7215af9dce2db3", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/eb891227dcd84bd49d7215af9dce2db3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/eb891227dcd84bd49d7215af9dce2db3"}]}] Oct 04 21:56:25.452197 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-ServerGroupTestJSON-668440969 Oct 04 21:56:25.452197 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: eb891227dcd84bd49d7215af9dce2db3 Oct 04 21:56:25.452197 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-ServerGroupTestJSON-668440969 Oct 04 21:56:25.452197 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-ServerGroupTestJSON-668440969-project Oct 04 21:56:25.452197 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 21:56:25.452197 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 21:56:25.452197 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: 18de0948626e4a5c8a28711f943ba46e Oct 04 21:56:25.452197 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-ServerGroupTestJSON-668440969-project Oct 04 21:56:25.452197 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 21:56:25.452197 n-d-860284-1 devstack@n-api.service[134102]: exception: Instance group 4fdf4c4f-79fa-4120-8070-f41b7d58dc34 could not be found. Oct 04 21:56:25.452197 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': '4fdf4c4f-79fa-4120-8070-f41b7d58dc34'} Oct 04 21:56:25.452197 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:56:25.452197 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:56:25.452197 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 04 21:56:25.452197 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 04 21:56:25.452197 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 21:56:25.452197 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 21:56:25.452197 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 04 21:56:25.452197 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 04 21:56:25.452197 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 21:56:25.452197 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 21:56:25.452197 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 04 21:56:25.452197 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 04 21:56:25.452197 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 4fdf4c4f-79fa-4120-8070-f41b7d58dc34 could not be found. Oct 04 21:56:25.452197 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:56:25.452197 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:56:25.452197 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:56:25.452197 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:56:25.452197 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:56:25.452197 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:56:25.452197 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:56:25.452197 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:56:25.452197 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:56:25.452197 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:56:25.452197 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 04 21:56:25.452197 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:56:25.452197 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 4fdf4c4f-79fa-4120-8070-f41b7d58dc34 could not be found. Oct 04 21:56:25.452197 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:56:25.452197 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:56:25.452197 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:56:25.452197 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:56:25.456394 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:56:25.456394 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:56:25.456394 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:56:25.456394 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:56:25.456394 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 4fdf4c4f-79fa-4120-8070-f41b7d58dc34 could not be found. Oct 04 21:56:25.456394 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:56:25.459034 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-1f4adbc2-611d-4f76-b24b-ed2e59622e9c tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Returning 404 to user: Instance group 4fdf4c4f-79fa-4120-8070-f41b7d58dc34 could not be found. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:56:25.460394 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-1f4adbc2-611d-4f76-b24b-ed2e59622e9c tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] 10.222.0.43 "DELETE /compute/v2.1/os-server-groups/4fdf4c4f-79fa-4120-8070-f41b7d58dc34" status: 404 len: 117 microversion: 2.1 time: 0.027765 Oct 04 21:56:25.461533 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1477/2863] 10.222.0.43 () {58 vars in 1266 bytes} [Tue Oct 4 21:56:25 2022] DELETE /compute/v2.1/os-server-groups/4fdf4c4f-79fa-4120-8070-f41b7d58dc34 => generated 117 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 21:56:25.477059 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-bcb15b35-0ad4-4ed4-b5d9-70f21f6b3525 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:25.537063 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-bcb15b35-0ad4-4ed4-b5d9-70f21f6b3525 tempest-ServerGroupTestJSON-668440969 tempest-ServerGroupTestJSON-668440969-project] 10.222.0.43 "DELETE /compute/v2.1/os-server-groups/1de10a59-897f-4699-bb15-bfe7e69e976c" status: 204 len: 0 microversion: 2.1 time: 0.071517 Oct 04 21:56:25.542186 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1478/2864] 10.222.0.43 () {58 vars in 1266 bytes} [Tue Oct 4 21:56:25 2022] DELETE /compute/v2.1/os-server-groups/1de10a59-897f-4699-bb15-bfe7e69e976c => generated 0 bytes in 73 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:56:25.717793 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-20a5ba31-58ba-446a-923a-e013db3ffc0f tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e807c724cc4c3887a2d360f0584ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40071e45805146529fb8abd40629c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:56:25.733916 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-20a5ba31-58ba-446a-923a-e013db3ffc0f tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] 10.222.0.43 "GET /compute/v2.1/servers/b176215c-96d4-402b-9c63-7ce87fe04ff6" status: 200 len: 1492 microversion: 2.1 time: 0.853610 Oct 04 21:56:25.737557 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1387/2865] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:56:24 2022] GET /compute/v2.1/servers/b176215c-96d4-402b-9c63-7ce87fe04ff6 => generated 1492 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:56:25.963675 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-68e39324-eb74-42a4-980f-adf8ff3cb51e tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:25.965263 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-68e39324-eb74-42a4-980f-adf8ff3cb51e tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] [instance: 6188e227-0adf-4afd-897d-66578f442cae] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:56:25.977332 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-68e39324-eb74-42a4-980f-adf8ff3cb51e tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:25.980748 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-68e39324-eb74-42a4-980f-adf8ff3cb51e tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:25.982799 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-68e39324-eb74-42a4-980f-adf8ff3cb51e tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:25.984740 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-68e39324-eb74-42a4-980f-adf8ff3cb51e tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:25.985836 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-68e39324-eb74-42a4-980f-adf8ff3cb51e tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:25.988765 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-68e39324-eb74-42a4-980f-adf8ff3cb51e tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:26.299473 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-5adb39f6-2964-447c-852d-4dec53c741e1 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:26.301095 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-5adb39f6-2964-447c-852d-4dec53c741e1 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] [instance: db2a8355-6007-4f37-89e1-a45e7492618d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:56:26.319259 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5adb39f6-2964-447c-852d-4dec53c741e1 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:26.320376 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5adb39f6-2964-447c-852d-4dec53c741e1 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:26.321032 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5adb39f6-2964-447c-852d-4dec53c741e1 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:26.326877 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5adb39f6-2964-447c-852d-4dec53c741e1 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:26.330640 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5adb39f6-2964-447c-852d-4dec53c741e1 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:26.331339 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5adb39f6-2964-447c-852d-4dec53c741e1 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:26.632688 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-68e39324-eb74-42a4-980f-adf8ff3cb51e tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cca65ba35b14db8bf2187188de8c838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51745fc19321469bb20afabe48b2185d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:56:26.647864 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-68e39324-eb74-42a4-980f-adf8ff3cb51e tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] 10.222.0.43 "GET /compute/v2.1/servers/6188e227-0adf-4afd-897d-66578f442cae" status: 200 len: 1574 microversion: 2.1 time: 0.688598 Oct 04 21:56:26.653838 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1479/2866] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:56:25 2022] GET /compute/v2.1/servers/6188e227-0adf-4afd-897d-66578f442cae => generated 1574 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:56:26.673143 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-5adb39f6-2964-447c-852d-4dec53c741e1 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b45ebdb946b45c28fc4bca3dd5a3e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520782b7e0a94e3fb552744cc4584119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:56:26.688063 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-5adb39f6-2964-447c-852d-4dec53c741e1 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] 10.222.0.43 "GET /compute/v2.1/servers/db2a8355-6007-4f37-89e1-a45e7492618d" status: 200 len: 1276 microversion: 2.1 time: 0.403384 Oct 04 21:56:26.708116 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1388/2867] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:56:26 2022] GET /compute/v2.1/servers/db2a8355-6007-4f37-89e1-a45e7492618d => generated 1276 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:56:26.765724 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-52fecc25-47c1-4c3a-83f7-f684cf437fce tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:26.766114 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-52fecc25-47c1-4c3a-83f7-f684cf437fce tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] [instance: b176215c-96d4-402b-9c63-7ce87fe04ff6] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:56:26.787515 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-52fecc25-47c1-4c3a-83f7-f684cf437fce tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:26.788637 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-52fecc25-47c1-4c3a-83f7-f684cf437fce tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:26.791750 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-52fecc25-47c1-4c3a-83f7-f684cf437fce tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:26.792968 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-52fecc25-47c1-4c3a-83f7-f684cf437fce tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:26.797335 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-52fecc25-47c1-4c3a-83f7-f684cf437fce tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:26.804173 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-52fecc25-47c1-4c3a-83f7-f684cf437fce tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:27.149860 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-52fecc25-47c1-4c3a-83f7-f684cf437fce tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e807c724cc4c3887a2d360f0584ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40071e45805146529fb8abd40629c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:56:27.157922 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-52fecc25-47c1-4c3a-83f7-f684cf437fce tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] 10.222.0.43 "GET /compute/v2.1/servers/b176215c-96d4-402b-9c63-7ce87fe04ff6" status: 200 len: 1472 microversion: 2.1 time: 0.396254 Oct 04 21:56:27.166667 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1480/2868] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:56:26 2022] GET /compute/v2.1/servers/b176215c-96d4-402b-9c63-7ce87fe04ff6 => generated 1472 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:56:27.199909 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-0fb83014-7ca8-4a88-8559-588ac2410075 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1907376582"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:56:27.205438 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-0fb83014-7ca8-4a88-8559-588ac2410075 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] [instance: b176215c-96d4-402b-9c63-7ce87fe04ff6] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:56:27.230402 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0fb83014-7ca8-4a88-8559-588ac2410075 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:27.231254 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0fb83014-7ca8-4a88-8559-588ac2410075 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:27.231718 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0fb83014-7ca8-4a88-8559-588ac2410075 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:27.236988 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0fb83014-7ca8-4a88-8559-588ac2410075 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:27.239800 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0fb83014-7ca8-4a88-8559-588ac2410075 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:27.241439 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0fb83014-7ca8-4a88-8559-588ac2410075 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:27.680657 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-3ff2022d-8f43-45c0-89c0-a62f4264cc65 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:27.681635 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-3ff2022d-8f43-45c0-89c0-a62f4264cc65 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] [instance: 6188e227-0adf-4afd-897d-66578f442cae] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:56:27.696723 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3ff2022d-8f43-45c0-89c0-a62f4264cc65 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:27.699946 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3ff2022d-8f43-45c0-89c0-a62f4264cc65 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:27.700689 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3ff2022d-8f43-45c0-89c0-a62f4264cc65 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:27.701894 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3ff2022d-8f43-45c0-89c0-a62f4264cc65 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:27.704939 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3ff2022d-8f43-45c0-89c0-a62f4264cc65 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:27.708800 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3ff2022d-8f43-45c0-89c0-a62f4264cc65 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:27.726238 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-0fb83014-7ca8-4a88-8559-588ac2410075 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] 10.222.0.43 "POST /compute/v2.1/servers/b176215c-96d4-402b-9c63-7ce87fe04ff6/action" status: 202 len: 0 microversion: 2.1 time: 0.532964 Oct 04 21:56:27.732903 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1389/2869] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 21:56:27 2022] POST /compute/v2.1/servers/b176215c-96d4-402b-9c63-7ce87fe04ff6/action => generated 0 bytes in 538 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 04 21:56:27.742061 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-4e72579d-b08b-40e7-aff1-a2776e3c9665 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:27.752244 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-4e72579d-b08b-40e7-aff1-a2776e3c9665 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] [instance: db2a8355-6007-4f37-89e1-a45e7492618d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:56:27.760628 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4e72579d-b08b-40e7-aff1-a2776e3c9665 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:27.761232 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4e72579d-b08b-40e7-aff1-a2776e3c9665 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:27.761756 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4e72579d-b08b-40e7-aff1-a2776e3c9665 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:27.762611 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4e72579d-b08b-40e7-aff1-a2776e3c9665 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:27.767162 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4e72579d-b08b-40e7-aff1-a2776e3c9665 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:27.767631 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4e72579d-b08b-40e7-aff1-a2776e3c9665 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:28.289190 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-3ff2022d-8f43-45c0-89c0-a62f4264cc65 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cca65ba35b14db8bf2187188de8c838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51745fc19321469bb20afabe48b2185d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:56:28.303934 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-3ff2022d-8f43-45c0-89c0-a62f4264cc65 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] 10.222.0.43 "GET /compute/v2.1/servers/6188e227-0adf-4afd-897d-66578f442cae" status: 200 len: 1574 microversion: 2.1 time: 0.628557 Oct 04 21:56:28.306747 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1481/2870] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:56:27 2022] GET /compute/v2.1/servers/6188e227-0adf-4afd-897d-66578f442cae => generated 1574 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:56:28.320020 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-5e21c6f5-3877-48e1-a31a-896cf8811150 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Calling method '.version_select at 0x7fbb2e687e50>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:28.399260 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-5e21c6f5-3877-48e1-a31a-896cf8811150 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] 10.222.0.43 "GET /compute/v2.1/images/fc854dc3-25b4-4f91-a4ee-4aa1cce47c5b" status: 200 len: 1410 microversion: 2.1 time: 0.091338 Oct 04 21:56:28.412075 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1482/2871] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:56:28 2022] GET /compute/v2.1/images/fc854dc3-25b4-4f91-a4ee-4aa1cce47c5b => generated 1410 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:56:28.681643 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-4e72579d-b08b-40e7-aff1-a2776e3c9665 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b45ebdb946b45c28fc4bca3dd5a3e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520782b7e0a94e3fb552744cc4584119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:56:28.693553 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-4e72579d-b08b-40e7-aff1-a2776e3c9665 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] 10.222.0.43 "GET /compute/v2.1/servers/db2a8355-6007-4f37-89e1-a45e7492618d" status: 200 len: 1318 microversion: 2.1 time: 0.960615 Oct 04 21:56:28.694151 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1390/2872] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:56:27 2022] GET /compute/v2.1/servers/db2a8355-6007-4f37-89e1-a45e7492618d => generated 1318 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:56:29.341889 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-c922ef9d-f019-4bd0-a879-c8eda52c09c9 req-c0b470bf-cc2e-4c28-bab8-2b69614587af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db2a8355-6007-4f37-89e1-a45e7492618d", "tag": "3a4439f9-2712-4c8b-a461-2b7c04cc5978"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:56:29.345992 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-439af71b-ac06-43ad-847b-357ce67b7b9d tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:29.352256 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-439af71b-ac06-43ad-847b-357ce67b7b9d tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] [instance: 6188e227-0adf-4afd-897d-66578f442cae] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:56:29.372187 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-439af71b-ac06-43ad-847b-357ce67b7b9d tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:29.377254 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-c922ef9d-f019-4bd0-a879-c8eda52c09c9 req-c0b470bf-cc2e-4c28-bab8-2b69614587af service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:29.378697 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-439af71b-ac06-43ad-847b-357ce67b7b9d tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:29.381241 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-439af71b-ac06-43ad-847b-357ce67b7b9d tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:29.383102 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-c922ef9d-f019-4bd0-a879-c8eda52c09c9 req-c0b470bf-cc2e-4c28-bab8-2b69614587af service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:29.384492 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-439af71b-ac06-43ad-847b-357ce67b7b9d tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:29.387038 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-c922ef9d-f019-4bd0-a879-c8eda52c09c9 req-c0b470bf-cc2e-4c28-bab8-2b69614587af service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:29.387972 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-439af71b-ac06-43ad-847b-357ce67b7b9d tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:29.393221 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-439af71b-ac06-43ad-847b-357ce67b7b9d tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:29.431328 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-c922ef9d-f019-4bd0-a879-c8eda52c09c9 req-c0b470bf-cc2e-4c28-bab8-2b69614587af service nova] Creating event network-changed:3a4439f9-2712-4c8b-a461-2b7c04cc5978 for instance db2a8355-6007-4f37-89e1-a45e7492618d on n-h1-860284-1 Oct 04 21:56:29.444930 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-c922ef9d-f019-4bd0-a879-c8eda52c09c9 req-c0b470bf-cc2e-4c28-bab8-2b69614587af service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106526 Oct 04 21:56:29.449679 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1391/2873] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:56:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:56:29.470292 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-fea685e2-62da-4827-9f85-78b54c20de3f tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Calling method '.version_select at 0x7fbb2ef0cf70>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:29.558789 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-fea685e2-62da-4827-9f85-78b54c20de3f tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] 10.222.0.43 "GET /compute/v2.1/images/fc854dc3-25b4-4f91-a4ee-4aa1cce47c5b" status: 200 len: 1410 microversion: 2.1 time: 0.106142 Oct 04 21:56:29.559912 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1392/2874] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:56:29 2022] GET /compute/v2.1/images/fc854dc3-25b4-4f91-a4ee-4aa1cce47c5b => generated 1410 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:56:29.723328 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-0c8a8e7c-f9bd-4e26-ad44-6f711fa14def tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:29.724572 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-0c8a8e7c-f9bd-4e26-ad44-6f711fa14def tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] [instance: db2a8355-6007-4f37-89e1-a45e7492618d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:56:29.735767 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0c8a8e7c-f9bd-4e26-ad44-6f711fa14def tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:29.736272 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0c8a8e7c-f9bd-4e26-ad44-6f711fa14def tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:29.736725 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0c8a8e7c-f9bd-4e26-ad44-6f711fa14def tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:29.737444 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0c8a8e7c-f9bd-4e26-ad44-6f711fa14def tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:29.738925 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0c8a8e7c-f9bd-4e26-ad44-6f711fa14def tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:29.739360 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0c8a8e7c-f9bd-4e26-ad44-6f711fa14def tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:29.778182 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-439af71b-ac06-43ad-847b-357ce67b7b9d tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cca65ba35b14db8bf2187188de8c838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51745fc19321469bb20afabe48b2185d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:56:29.789089 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-439af71b-ac06-43ad-847b-357ce67b7b9d tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] 10.222.0.43 "GET /compute/v2.1/servers/6188e227-0adf-4afd-897d-66578f442cae" status: 200 len: 1574 microversion: 2.1 time: 0.458364 Oct 04 21:56:29.789690 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1483/2875] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:56:29 2022] GET /compute/v2.1/servers/6188e227-0adf-4afd-897d-66578f442cae => generated 1574 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:56:30.083052 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-0c8a8e7c-f9bd-4e26-ad44-6f711fa14def tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b45ebdb946b45c28fc4bca3dd5a3e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520782b7e0a94e3fb552744cc4584119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:56:30.095947 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-0c8a8e7c-f9bd-4e26-ad44-6f711fa14def tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] 10.222.0.43 "GET /compute/v2.1/servers/db2a8355-6007-4f37-89e1-a45e7492618d" status: 200 len: 1318 microversion: 2.1 time: 0.379008 Oct 04 21:56:30.096791 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1393/2876] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:56:29 2022] GET /compute/v2.1/servers/db2a8355-6007-4f37-89e1-a45e7492618d => generated 1318 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:56:30.576151 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-84f670e8-a943-49c7-9e3b-67968fbc757d tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Calling method '.version_select at 0x7fbb2e76e820>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:30.665849 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-84f670e8-a943-49c7-9e3b-67968fbc757d tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] 10.222.0.43 "GET /compute/v2.1/images/fc854dc3-25b4-4f91-a4ee-4aa1cce47c5b" status: 200 len: 1410 microversion: 2.1 time: 0.094445 Oct 04 21:56:30.671475 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1484/2877] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:56:30 2022] GET /compute/v2.1/images/fc854dc3-25b4-4f91-a4ee-4aa1cce47c5b => generated 1410 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:56:30.813254 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-25c1bcda-3790-4ee8-b1c5-cd2515fab375 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:30.813884 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-25c1bcda-3790-4ee8-b1c5-cd2515fab375 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] [instance: 6188e227-0adf-4afd-897d-66578f442cae] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:56:30.821982 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-25c1bcda-3790-4ee8-b1c5-cd2515fab375 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:30.822516 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-25c1bcda-3790-4ee8-b1c5-cd2515fab375 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:30.822967 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-25c1bcda-3790-4ee8-b1c5-cd2515fab375 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:30.823706 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-25c1bcda-3790-4ee8-b1c5-cd2515fab375 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:30.824175 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-25c1bcda-3790-4ee8-b1c5-cd2515fab375 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:30.824615 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-25c1bcda-3790-4ee8-b1c5-cd2515fab375 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:31.087171 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-25c1bcda-3790-4ee8-b1c5-cd2515fab375 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cca65ba35b14db8bf2187188de8c838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51745fc19321469bb20afabe48b2185d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:56:31.103053 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-25c1bcda-3790-4ee8-b1c5-cd2515fab375 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] 10.222.0.43 "GET /compute/v2.1/servers/6188e227-0adf-4afd-897d-66578f442cae" status: 200 len: 1579 microversion: 2.1 time: 0.292994 Oct 04 21:56:31.119338 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1394/2878] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:56:30 2022] GET /compute/v2.1/servers/6188e227-0adf-4afd-897d-66578f442cae => generated 1579 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:56:31.139048 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-6425fcfe-2de8-490e-86b6-c6d57303b414 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:31.142333 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-6425fcfe-2de8-490e-86b6-c6d57303b414 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] [instance: db2a8355-6007-4f37-89e1-a45e7492618d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:56:31.150402 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6425fcfe-2de8-490e-86b6-c6d57303b414 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:31.151139 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6425fcfe-2de8-490e-86b6-c6d57303b414 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:31.151776 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6425fcfe-2de8-490e-86b6-c6d57303b414 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:31.152675 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6425fcfe-2de8-490e-86b6-c6d57303b414 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:31.153136 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6425fcfe-2de8-490e-86b6-c6d57303b414 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:31.153732 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6425fcfe-2de8-490e-86b6-c6d57303b414 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:31.689284 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-77c9cae6-0c51-4781-859f-701987c34940 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Calling method '.version_select at 0x7fbb2e6039d0>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:31.758887 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-77c9cae6-0c51-4781-859f-701987c34940 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] 10.222.0.43 "GET /compute/v2.1/images/fc854dc3-25b4-4f91-a4ee-4aa1cce47c5b" status: 200 len: 1410 microversion: 2.1 time: 0.075341 Oct 04 21:56:31.768586 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1395/2879] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:56:31 2022] GET /compute/v2.1/images/fc854dc3-25b4-4f91-a4ee-4aa1cce47c5b => generated 1410 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:56:32.110887 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-6425fcfe-2de8-490e-86b6-c6d57303b414 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b45ebdb946b45c28fc4bca3dd5a3e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520782b7e0a94e3fb552744cc4584119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:56:32.130768 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-6393b2cc-7757-4ef7-a7cd-fd4fcfca54e3 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:32.131589 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-6425fcfe-2de8-490e-86b6-c6d57303b414 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] 10.222.0.43 "GET /compute/v2.1/servers/db2a8355-6007-4f37-89e1-a45e7492618d" status: 200 len: 1318 microversion: 2.1 time: 0.995857 Oct 04 21:56:32.131720 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-6393b2cc-7757-4ef7-a7cd-fd4fcfca54e3 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] [instance: 6188e227-0adf-4afd-897d-66578f442cae] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:56:32.132887 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1485/2880] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:56:31 2022] GET /compute/v2.1/servers/db2a8355-6007-4f37-89e1-a45e7492618d => generated 1318 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:56:32.171254 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6393b2cc-7757-4ef7-a7cd-fd4fcfca54e3 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:32.171677 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6393b2cc-7757-4ef7-a7cd-fd4fcfca54e3 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:32.172127 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6393b2cc-7757-4ef7-a7cd-fd4fcfca54e3 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:32.172855 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6393b2cc-7757-4ef7-a7cd-fd4fcfca54e3 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:32.173319 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6393b2cc-7757-4ef7-a7cd-fd4fcfca54e3 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:32.173752 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6393b2cc-7757-4ef7-a7cd-fd4fcfca54e3 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:32.689573 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-6393b2cc-7757-4ef7-a7cd-fd4fcfca54e3 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cca65ba35b14db8bf2187188de8c838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51745fc19321469bb20afabe48b2185d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:56:32.705090 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-6393b2cc-7757-4ef7-a7cd-fd4fcfca54e3 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] 10.222.0.43 "GET /compute/v2.1/servers/6188e227-0adf-4afd-897d-66578f442cae" status: 200 len: 1572 microversion: 2.1 time: 0.578403 Oct 04 21:56:32.711792 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1396/2881] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:56:32 2022] GET /compute/v2.1/servers/6188e227-0adf-4afd-897d-66578f442cae => generated 1572 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:56:32.742768 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-a1b71d71-6ecc-4116-9376-1fa136faebbd tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1180458121"}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:56:32.744138 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-a1b71d71-6ecc-4116-9376-1fa136faebbd tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] [instance: 6188e227-0adf-4afd-897d-66578f442cae] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:56:32.760724 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a1b71d71-6ecc-4116-9376-1fa136faebbd tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:32.761851 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a1b71d71-6ecc-4116-9376-1fa136faebbd tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:32.762980 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a1b71d71-6ecc-4116-9376-1fa136faebbd tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:32.766072 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a1b71d71-6ecc-4116-9376-1fa136faebbd tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:32.766901 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a1b71d71-6ecc-4116-9376-1fa136faebbd tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:32.767765 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a1b71d71-6ecc-4116-9376-1fa136faebbd tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:32.776893 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-7d2d5616-3ec1-4bf6-8961-cb5207e0460c tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Calling method '.version_select at 0x7fbb2ef195e0>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:32.817346 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=100 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:56:32.861117 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-7d2d5616-3ec1-4bf6-8961-cb5207e0460c tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] 10.222.0.43 "GET /compute/v2.1/images/fc854dc3-25b4-4f91-a4ee-4aa1cce47c5b" status: 200 len: 1410 microversion: 2.1 time: 0.088648 Oct 04 21:56:32.862332 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1397/2882] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:56:32 2022] GET /compute/v2.1/images/fc854dc3-25b4-4f91-a4ee-4aa1cce47c5b => generated 1410 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:56:33.161391 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-6c5517aa-650f-4c43-bff3-20284b7f7047 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:33.162062 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-6c5517aa-650f-4c43-bff3-20284b7f7047 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] [instance: db2a8355-6007-4f37-89e1-a45e7492618d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:56:33.174962 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=2 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:56:33.181173 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:56:33.186026 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6c5517aa-650f-4c43-bff3-20284b7f7047 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:33.187880 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6c5517aa-650f-4c43-bff3-20284b7f7047 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:33.191627 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6c5517aa-650f-4c43-bff3-20284b7f7047 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:33.194316 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6c5517aa-650f-4c43-bff3-20284b7f7047 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:33.195439 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6c5517aa-650f-4c43-bff3-20284b7f7047 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:33.198527 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6c5517aa-650f-4c43-bff3-20284b7f7047 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:33.329524 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.network.security_group_api [None req-a1b71d71-6ecc-4116-9376-1fa136faebbd tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Adding security group 70873e3f-251f-4952-81c2-f5f494449422 to port 3506c0a9-1b9f-478c-b518-015e52ed0a1a Oct 04 21:56:33.769677 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-6c5517aa-650f-4c43-bff3-20284b7f7047 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b45ebdb946b45c28fc4bca3dd5a3e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520782b7e0a94e3fb552744cc4584119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:56:33.791144 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-6c5517aa-650f-4c43-bff3-20284b7f7047 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] 10.222.0.43 "GET /compute/v2.1/servers/db2a8355-6007-4f37-89e1-a45e7492618d" status: 200 len: 1318 microversion: 2.1 time: 0.633419 Oct 04 21:56:33.794863 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1398/2883] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:56:33 2022] GET /compute/v2.1/servers/db2a8355-6007-4f37-89e1-a45e7492618d => generated 1318 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:56:33.880630 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-50f6c08b-a5b4-4783-90c2-0676c3077cd5 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Calling method '.version_select at 0x7fbb2e603a60>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:33.963929 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-50f6c08b-a5b4-4783-90c2-0676c3077cd5 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] 10.222.0.43 "GET /compute/v2.1/images/fc854dc3-25b4-4f91-a4ee-4aa1cce47c5b" status: 200 len: 1410 microversion: 2.1 time: 0.087674 Oct 04 21:56:33.966014 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1399/2884] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:56:33 2022] GET /compute/v2.1/images/fc854dc3-25b4-4f91-a4ee-4aa1cce47c5b => generated 1410 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:56:33.972644 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-1d0934a2-1f44-4045-af9d-2d3345dfe6e1 req-ea1b06a2-6262-4fee-bc2a-48aec8a03282 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b176215c-96d4-402b-9c63-7ce87fe04ff6", "name": "network-vif-plugged", "status": "completed", "tag": "0efd69ff-4474-4aaa-b2fd-c82bb955cb23"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:56:33.992497 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=8 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:56:34.000590 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-1d0934a2-1f44-4045-af9d-2d3345dfe6e1 req-ea1b06a2-6262-4fee-bc2a-48aec8a03282 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:34.002124 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-1d0934a2-1f44-4045-af9d-2d3345dfe6e1 req-ea1b06a2-6262-4fee-bc2a-48aec8a03282 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:34.002771 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-1d0934a2-1f44-4045-af9d-2d3345dfe6e1 req-ea1b06a2-6262-4fee-bc2a-48aec8a03282 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:34.039581 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-1d0934a2-1f44-4045-af9d-2d3345dfe6e1 req-ea1b06a2-6262-4fee-bc2a-48aec8a03282 service nova] Creating event network-vif-plugged:0efd69ff-4474-4aaa-b2fd-c82bb955cb23 for instance b176215c-96d4-402b-9c63-7ce87fe04ff6 on n-h2-860284-1 Oct 04 21:56:34.056598 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-1d0934a2-1f44-4045-af9d-2d3345dfe6e1 req-ea1b06a2-6262-4fee-bc2a-48aec8a03282 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087869 Oct 04 21:56:34.058680 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1400/2885] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:56:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:56:34.823908 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-94bd9609-f638-484a-840c-c50f9f6606d9 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:34.825390 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-94bd9609-f638-484a-840c-c50f9f6606d9 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] [instance: db2a8355-6007-4f37-89e1-a45e7492618d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:56:34.868416 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-94bd9609-f638-484a-840c-c50f9f6606d9 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:34.869260 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-94bd9609-f638-484a-840c-c50f9f6606d9 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:34.869989 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-94bd9609-f638-484a-840c-c50f9f6606d9 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:34.871397 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-94bd9609-f638-484a-840c-c50f9f6606d9 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:34.872356 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-94bd9609-f638-484a-840c-c50f9f6606d9 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:34.873573 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-94bd9609-f638-484a-840c-c50f9f6606d9 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:35.311147 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-a1b71d71-6ecc-4116-9376-1fa136faebbd tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] 10.222.0.43 "POST /compute/v2.1/servers/6188e227-0adf-4afd-897d-66578f442cae/action" status: 202 len: 0 microversion: 2.1 time: 2.572540 Oct 04 21:56:35.311147 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1486/2886] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 21:56:32 2022] POST /compute/v2.1/servers/6188e227-0adf-4afd-897d-66578f442cae/action => generated 0 bytes in 2574 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:56:35.317410 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-e647aca0-cad9-4bbf-8380-2e830e4671c9 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Calling method '.version_select at 0x7fbb2e821ee0>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:35.408512 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-e647aca0-cad9-4bbf-8380-2e830e4671c9 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] 10.222.0.43 "GET /compute/v2.1/images/fc854dc3-25b4-4f91-a4ee-4aa1cce47c5b" status: 200 len: 1410 microversion: 2.1 time: 0.097173 Oct 04 21:56:35.409113 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1487/2887] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:56:35 2022] GET /compute/v2.1/images/fc854dc3-25b4-4f91-a4ee-4aa1cce47c5b => generated 1410 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:56:35.417443 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-e719c2e0-65d5-4a98-a180-04dc6f4f95b3 req-8b19c23a-557b-4741-a256-f1aac30e9974 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6188e227-0adf-4afd-897d-66578f442cae", "tag": "3506c0a9-1b9f-478c-b518-015e52ed0a1a"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:56:35.459421 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-e719c2e0-65d5-4a98-a180-04dc6f4f95b3 req-8b19c23a-557b-4741-a256-f1aac30e9974 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:35.460059 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-e719c2e0-65d5-4a98-a180-04dc6f4f95b3 req-8b19c23a-557b-4741-a256-f1aac30e9974 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:35.460505 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-e719c2e0-65d5-4a98-a180-04dc6f4f95b3 req-8b19c23a-557b-4741-a256-f1aac30e9974 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:35.514418 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-e719c2e0-65d5-4a98-a180-04dc6f4f95b3 req-8b19c23a-557b-4741-a256-f1aac30e9974 service nova] Creating event network-changed:3506c0a9-1b9f-478c-b518-015e52ed0a1a for instance 6188e227-0adf-4afd-897d-66578f442cae on n-h2-860284-1 Oct 04 21:56:35.538462 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-e719c2e0-65d5-4a98-a180-04dc6f4f95b3 req-8b19c23a-557b-4741-a256-f1aac30e9974 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122977 Oct 04 21:56:35.539555 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1488/2888] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:56:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:56:35.558086 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-f82f8aec-d3be-4af9-96e3-bf19eebb0a3f tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Calling method '.version_select at 0x7fbb2e7095e0>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:35.570003 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-94bd9609-f638-484a-840c-c50f9f6606d9 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b45ebdb946b45c28fc4bca3dd5a3e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520782b7e0a94e3fb552744cc4584119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:56:35.583674 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-94bd9609-f638-484a-840c-c50f9f6606d9 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] 10.222.0.43 "GET /compute/v2.1/servers/db2a8355-6007-4f37-89e1-a45e7492618d" status: 200 len: 1318 microversion: 2.1 time: 0.767199 Oct 04 21:56:35.600287 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1401/2889] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:56:34 2022] GET /compute/v2.1/servers/db2a8355-6007-4f37-89e1-a45e7492618d => generated 1318 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:56:35.811561 n-d-860284-1 devstack@n-api.service[134102]: DEBUG neutronclient.v2_0.client [None req-f82f8aec-d3be-4af9-96e3-bf19eebb0a3f tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 70873e3f-251f-4952-81c2-f5f494449422 in use.", "detail": ""}} {{(pid=134102) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 21:56:35.812689 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-f82f8aec-d3be-4af9-96e3-bf19eebb0a3f tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] HTTP exception thrown: Security Group 70873e3f-251f-4952-81c2-f5f494449422 in use. Oct 04 21:56:35.812689 n-d-860284-1 devstack@n-api.service[134102]: Neutron server returns request_ids: ['req-27bf7135-ef24-48f6-a833-973da010e884'] Oct 04 21:56:35.815257 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-f82f8aec-d3be-4af9-96e3-bf19eebb0a3f tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Request method failure captured: Oct 04 21:56:35.815257 n-d-860284-1 devstack@n-api.service[134102]: request: DELETE /compute/v2.1/os-security-groups/70873e3f-251f-4952-81c2-f5f494449422 HTTP/1.1 Oct 04 21:56:35.815257 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 21:56:35.815257 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 21:56:35.815257 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 21:56:35.815257 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 21:56:35.815257 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 21:56:35.815257 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 21:56:35.815257 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 21:56:35.815257 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 21:56:35.815257 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPKu1qJNzwuxRWdc7rP7w0gQHhoDMvT1hi4W6OphaRxhVehI7YxkRLmiRVTEcrGE4_kLVYYR9CLMgNAOGQEVIUg5ptFWtgovLZ1WXY_454sRPkZoUaMXWYK1EaSOxzAsp1QFRpLX6-NPmD2kPLhLIPCnWZqTYS8blSXJvj9wIhro38mc Oct 04 21:56:35.815257 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 21:56:35.815257 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 21:56:35.815257 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 21:56:35.815257 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 21:56:35.815257 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 21:56:35.815257 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 21:56:35.815257 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: 51745fc19321469bb20afabe48b2185d Oct 04 21:56:35.815257 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-SecurityGroupsTestJSON-367911468 Oct 04 21:56:35.815257 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 21:56:35.815257 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 21:56:35.815257 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/51745fc19321469bb20afabe48b2185d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_51745fc19321469bb20afabe48b2185d", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/51745fc19321469bb20afabe48b2185d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/51745fc19321469bb20afabe48b2185d"}]}] Oct 04 21:56:35.815257 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-SecurityGroupsTestJSON-367911468 Oct 04 21:56:35.815257 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: 51745fc19321469bb20afabe48b2185d Oct 04 21:56:35.815257 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-367911468 Oct 04 21:56:35.815257 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-SecurityGroupsTestJSON-367911468-project Oct 04 21:56:35.815257 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 21:56:35.815257 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 21:56:35.815257 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: 4cca65ba35b14db8bf2187188de8c838 Oct 04 21:56:35.815257 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-SecurityGroupsTestJSON-367911468-project Oct 04 21:56:35.815257 n-d-860284-1 devstack@n-api.service[134102]: method: Oct 04 21:56:35.815257 n-d-860284-1 devstack@n-api.service[134102]: exception: Security Group 70873e3f-251f-4952-81c2-f5f494449422 in use. Oct 04 21:56:35.815257 n-d-860284-1 devstack@n-api.service[134102]: Neutron server returns request_ids: ['req-27bf7135-ef24-48f6-a833-973da010e884'] Oct 04 21:56:35.815257 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': '70873e3f-251f-4952-81c2-f5f494449422'} Oct 04 21:56:35.815257 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:56:35.815257 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:56:35.815257 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 04 21:56:35.815257 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 04 21:56:35.815257 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:56:35.815257 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:56:35.815257 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 04 21:56:35.815257 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 04 21:56:35.815257 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:56:35.815257 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:56:35.815257 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 04 21:56:35.815257 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 04 21:56:35.815257 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:56:35.815257 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:56:35.815257 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 21:56:35.815257 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 21:56:35.815257 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:56:35.815257 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:56:35.815257 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 21:56:35.815257 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 21:56:35.815257 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:56:35.815257 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:56:35.815257 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 21:56:35.815257 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 21:56:35.815257 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 21:56:35.815257 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 21:56:35.815257 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 70873e3f-251f-4952-81c2-f5f494449422 in use. Oct 04 21:56:35.822683 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-27bf7135-ef24-48f6-a833-973da010e884'] Oct 04 21:56:35.822683 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:56:35.822683 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:56:35.822683 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:56:35.822683 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:56:35.822683 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 04 21:56:35.822683 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 04 21:56:35.822683 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 04 21:56:35.822683 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 04 21:56:35.822683 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 70873e3f-251f-4952-81c2-f5f494449422 in use. Oct 04 21:56:35.822683 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-27bf7135-ef24-48f6-a833-973da010e884'] Oct 04 21:56:35.822683 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:56:35.822683 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:56:35.822683 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:56:35.822683 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:56:35.822683 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:56:35.822683 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:56:35.822683 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:56:35.822683 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:56:35.822683 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:56:35.822683 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:56:35.822683 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:56:35.822683 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:56:35.822683 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 04 21:56:35.822683 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 04 21:56:35.822683 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 70873e3f-251f-4952-81c2-f5f494449422 in use. Oct 04 21:56:35.822683 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-27bf7135-ef24-48f6-a833-973da010e884'] Oct 04 21:56:35.822683 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:56:35.822683 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:56:35.822683 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:56:35.822683 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:56:35.822683 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:56:35.822683 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:56:35.822683 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:56:35.822683 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:56:35.822683 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 70873e3f-251f-4952-81c2-f5f494449422 in use. Oct 04 21:56:35.822683 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-27bf7135-ef24-48f6-a833-973da010e884'] Oct 04 21:56:35.822683 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:56:35.822683 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-f82f8aec-d3be-4af9-96e3-bf19eebb0a3f tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Returning 400 to user: Security Group 70873e3f-251f-4952-81c2-f5f494449422 in use. Oct 04 21:56:35.822683 n-d-860284-1 devstack@n-api.service[134102]: Neutron server returns request_ids: ['req-27bf7135-ef24-48f6-a833-973da010e884'] {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:56:35.822683 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-f82f8aec-d3be-4af9-96e3-bf19eebb0a3f tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/70873e3f-251f-4952-81c2-f5f494449422" status: 400 len: 185 microversion: 2.1 time: 0.279384 Oct 04 21:56:35.829962 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1489/2890] 10.222.0.43 () {58 vars in 1272 bytes} [Tue Oct 4 21:56:35 2022] DELETE /compute/v2.1/os-security-groups/70873e3f-251f-4952-81c2-f5f494449422 => generated 185 bytes in 288 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 21:56:35.838754 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-3b3628cf-8c69-4ce1-931c-79ff029b3b59 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:35.839421 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-3b3628cf-8c69-4ce1-931c-79ff029b3b59 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] [instance: 6188e227-0adf-4afd-897d-66578f442cae] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:56:35.848784 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3b3628cf-8c69-4ce1-931c-79ff029b3b59 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:35.849743 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3b3628cf-8c69-4ce1-931c-79ff029b3b59 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:35.850550 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3b3628cf-8c69-4ce1-931c-79ff029b3b59 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:35.851582 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3b3628cf-8c69-4ce1-931c-79ff029b3b59 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:35.852407 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3b3628cf-8c69-4ce1-931c-79ff029b3b59 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:35.853334 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3b3628cf-8c69-4ce1-931c-79ff029b3b59 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:35.900046 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-3b3628cf-8c69-4ce1-931c-79ff029b3b59 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] [instance: 6188e227-0adf-4afd-897d-66578f442cae] Going to try to terminate instance {{(pid=134101) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:56:36.109975 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-3b3628cf-8c69-4ce1-931c-79ff029b3b59 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] 10.222.0.43 "DELETE /compute/v2.1/servers/6188e227-0adf-4afd-897d-66578f442cae" status: 204 len: 0 microversion: 2.1 time: 0.275257 Oct 04 21:56:36.112137 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1402/2891] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 21:56:35 2022] DELETE /compute/v2.1/servers/6188e227-0adf-4afd-897d-66578f442cae => generated 0 bytes in 279 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:56:36.130923 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-c42e1fd9-2e86-4b9c-8530-2cc1d47a2342 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:36.131690 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-c42e1fd9-2e86-4b9c-8530-2cc1d47a2342 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] [instance: 6188e227-0adf-4afd-897d-66578f442cae] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:56:36.147900 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c42e1fd9-2e86-4b9c-8530-2cc1d47a2342 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:36.148381 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c42e1fd9-2e86-4b9c-8530-2cc1d47a2342 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:36.149010 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c42e1fd9-2e86-4b9c-8530-2cc1d47a2342 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:36.153639 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c42e1fd9-2e86-4b9c-8530-2cc1d47a2342 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:36.154186 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c42e1fd9-2e86-4b9c-8530-2cc1d47a2342 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:36.158984 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c42e1fd9-2e86-4b9c-8530-2cc1d47a2342 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:36.426676 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e4cde9f2-4b3d-4dd3-8f3f-0b1aca40558e tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Calling method '.version_select at 0x7fbb2e368700>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:36.538246 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-e4cde9f2-4b3d-4dd3-8f3f-0b1aca40558e tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] 10.222.0.43 "GET /compute/v2.1/images/fc854dc3-25b4-4f91-a4ee-4aa1cce47c5b" status: 200 len: 1410 microversion: 2.1 time: 0.116823 Oct 04 21:56:36.546414 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1403/2892] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:56:36 2022] GET /compute/v2.1/images/fc854dc3-25b4-4f91-a4ee-4aa1cce47c5b => generated 1410 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:56:36.609780 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-7bc271d5-9671-467b-9815-b9c99a2dc68e tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:36.611570 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-7bc271d5-9671-467b-9815-b9c99a2dc68e tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] [instance: db2a8355-6007-4f37-89e1-a45e7492618d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:56:36.635933 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7bc271d5-9671-467b-9815-b9c99a2dc68e tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:36.639800 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7bc271d5-9671-467b-9815-b9c99a2dc68e tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:36.643043 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7bc271d5-9671-467b-9815-b9c99a2dc68e tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:36.645239 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7bc271d5-9671-467b-9815-b9c99a2dc68e tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:36.647064 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7bc271d5-9671-467b-9815-b9c99a2dc68e tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:36.649545 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7bc271d5-9671-467b-9815-b9c99a2dc68e tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:36.669935 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=4,nova_cell1:UPDATE=3 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:56:36.775718 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-c42e1fd9-2e86-4b9c-8530-2cc1d47a2342 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cca65ba35b14db8bf2187188de8c838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51745fc19321469bb20afabe48b2185d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:56:36.787342 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-c42e1fd9-2e86-4b9c-8530-2cc1d47a2342 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] 10.222.0.43 "GET /compute/v2.1/servers/6188e227-0adf-4afd-897d-66578f442cae" status: 200 len: 1647 microversion: 2.1 time: 0.664191 Oct 04 21:56:36.787936 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1490/2893] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:56:36 2022] GET /compute/v2.1/servers/6188e227-0adf-4afd-897d-66578f442cae => generated 1647 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:56:37.037406 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-7bc271d5-9671-467b-9815-b9c99a2dc68e tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b45ebdb946b45c28fc4bca3dd5a3e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520782b7e0a94e3fb552744cc4584119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:56:37.052269 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-7bc271d5-9671-467b-9815-b9c99a2dc68e tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] 10.222.0.43 "GET /compute/v2.1/servers/db2a8355-6007-4f37-89e1-a45e7492618d" status: 200 len: 1318 microversion: 2.1 time: 0.447624 Oct 04 21:56:37.053477 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1404/2894] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:56:36 2022] GET /compute/v2.1/servers/db2a8355-6007-4f37-89e1-a45e7492618d => generated 1318 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:56:37.556208 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-802c19a4-e915-45c9-819c-d9d32bddae6b tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Calling method '.version_select at 0x7fbb2e6b8940>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:37.640379 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-802c19a4-e915-45c9-819c-d9d32bddae6b tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] 10.222.0.43 "GET /compute/v2.1/images/fc854dc3-25b4-4f91-a4ee-4aa1cce47c5b" status: 200 len: 1410 microversion: 2.1 time: 0.089096 Oct 04 21:56:37.650058 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1491/2895] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:56:37 2022] GET /compute/v2.1/images/fc854dc3-25b4-4f91-a4ee-4aa1cce47c5b => generated 1410 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:56:37.819145 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-34e2c5ea-df26-4e1a-8738-60ac6b520a5a tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:37.820887 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-34e2c5ea-df26-4e1a-8738-60ac6b520a5a tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] [instance: 6188e227-0adf-4afd-897d-66578f442cae] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:56:37.832280 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-34e2c5ea-df26-4e1a-8738-60ac6b520a5a tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:37.835526 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-34e2c5ea-df26-4e1a-8738-60ac6b520a5a tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:37.837678 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-34e2c5ea-df26-4e1a-8738-60ac6b520a5a tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:37.840463 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-34e2c5ea-df26-4e1a-8738-60ac6b520a5a tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:37.841040 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-34e2c5ea-df26-4e1a-8738-60ac6b520a5a tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:37.841744 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-34e2c5ea-df26-4e1a-8738-60ac6b520a5a tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:38.077428 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-e5a5a170-ef48-4bb5-969f-fbb7fb1c7420 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:38.078044 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-e5a5a170-ef48-4bb5-969f-fbb7fb1c7420 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] [instance: db2a8355-6007-4f37-89e1-a45e7492618d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:56:38.092824 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e5a5a170-ef48-4bb5-969f-fbb7fb1c7420 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:38.093323 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e5a5a170-ef48-4bb5-969f-fbb7fb1c7420 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:38.110925 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e5a5a170-ef48-4bb5-969f-fbb7fb1c7420 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:38.111821 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e5a5a170-ef48-4bb5-969f-fbb7fb1c7420 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:38.112338 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e5a5a170-ef48-4bb5-969f-fbb7fb1c7420 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:38.113308 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e5a5a170-ef48-4bb5-969f-fbb7fb1c7420 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:38.923209 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-34e2c5ea-df26-4e1a-8738-60ac6b520a5a tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cca65ba35b14db8bf2187188de8c838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51745fc19321469bb20afabe48b2185d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:56:38.949580 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-34e2c5ea-df26-4e1a-8738-60ac6b520a5a tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] 10.222.0.43 "GET /compute/v2.1/servers/6188e227-0adf-4afd-897d-66578f442cae" status: 200 len: 1647 microversion: 2.1 time: 1.138572 Oct 04 21:56:38.954722 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1405/2896] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:56:37 2022] GET /compute/v2.1/servers/6188e227-0adf-4afd-897d-66578f442cae => generated 1647 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:56:38.964570 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-b906b4ee-485c-419a-a0f6-834bf4ca4d0d tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Calling method '.version_select at 0x7fbb2edffca0>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:39.039738 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-b906b4ee-485c-419a-a0f6-834bf4ca4d0d tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] 10.222.0.43 "GET /compute/v2.1/images/fc854dc3-25b4-4f91-a4ee-4aa1cce47c5b" status: 200 len: 1410 microversion: 2.1 time: 0.083234 Oct 04 21:56:39.040339 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1406/2897] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:56:38 2022] GET /compute/v2.1/images/fc854dc3-25b4-4f91-a4ee-4aa1cce47c5b => generated 1410 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:56:39.048071 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-d4271b77-7f4d-460d-b5eb-569787ca2f9e req-5d818273-b5c9-44aa-a0cb-c8638a401b95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db2a8355-6007-4f37-89e1-a45e7492618d", "name": "network-vif-plugged", "status": "completed", "tag": "3a4439f9-2712-4c8b-a461-2b7c04cc5978"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:56:39.059405 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-e5a5a170-ef48-4bb5-969f-fbb7fb1c7420 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b45ebdb946b45c28fc4bca3dd5a3e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520782b7e0a94e3fb552744cc4584119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:56:39.063559 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-d4271b77-7f4d-460d-b5eb-569787ca2f9e req-5d818273-b5c9-44aa-a0cb-c8638a401b95 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:39.064323 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-d4271b77-7f4d-460d-b5eb-569787ca2f9e req-5d818273-b5c9-44aa-a0cb-c8638a401b95 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:39.065014 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-d4271b77-7f4d-460d-b5eb-569787ca2f9e req-5d818273-b5c9-44aa-a0cb-c8638a401b95 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:39.068974 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-e5a5a170-ef48-4bb5-969f-fbb7fb1c7420 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] 10.222.0.43 "GET /compute/v2.1/servers/db2a8355-6007-4f37-89e1-a45e7492618d" status: 200 len: 1318 microversion: 2.1 time: 0.995559 Oct 04 21:56:39.072778 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1492/2898] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:56:38 2022] GET /compute/v2.1/servers/db2a8355-6007-4f37-89e1-a45e7492618d => generated 1318 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:56:39.088390 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-d4271b77-7f4d-460d-b5eb-569787ca2f9e req-5d818273-b5c9-44aa-a0cb-c8638a401b95 service nova] Creating event network-vif-plugged:3a4439f9-2712-4c8b-a461-2b7c04cc5978 for instance db2a8355-6007-4f37-89e1-a45e7492618d on n-h1-860284-1 Oct 04 21:56:39.100489 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-d4271b77-7f4d-460d-b5eb-569787ca2f9e req-5d818273-b5c9-44aa-a0cb-c8638a401b95 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057148 Oct 04 21:56:39.101225 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1407/2899] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:56:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:56:39.977180 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-ec7815c7-7707-4cf0-989c-b7836d5beff7 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:39.978647 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-ec7815c7-7707-4cf0-989c-b7836d5beff7 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] [instance: 6188e227-0adf-4afd-897d-66578f442cae] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:56:40.033476 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ec7815c7-7707-4cf0-989c-b7836d5beff7 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:40.037482 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ec7815c7-7707-4cf0-989c-b7836d5beff7 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:40.042553 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ec7815c7-7707-4cf0-989c-b7836d5beff7 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:40.044780 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ec7815c7-7707-4cf0-989c-b7836d5beff7 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:40.048674 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ec7815c7-7707-4cf0-989c-b7836d5beff7 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:40.050700 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ec7815c7-7707-4cf0-989c-b7836d5beff7 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:40.057400 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-258d5f7c-175a-4b48-86bc-7a1e959ddeb4 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Calling method '.version_select at 0x7fbb2e6fe790>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:40.156207 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-258d5f7c-175a-4b48-86bc-7a1e959ddeb4 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] 10.222.0.43 "GET /compute/v2.1/images/fc854dc3-25b4-4f91-a4ee-4aa1cce47c5b" status: 200 len: 1410 microversion: 2.1 time: 0.103258 Oct 04 21:56:40.157228 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1408/2900] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:56:40 2022] GET /compute/v2.1/images/fc854dc3-25b4-4f91-a4ee-4aa1cce47c5b => generated 1410 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:56:40.163489 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-225e8d00-e1ca-4c9a-a601-2b1609fdfcea tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:40.167188 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-225e8d00-e1ca-4c9a-a601-2b1609fdfcea tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] [instance: db2a8355-6007-4f37-89e1-a45e7492618d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:56:40.179291 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-225e8d00-e1ca-4c9a-a601-2b1609fdfcea tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:40.184611 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-225e8d00-e1ca-4c9a-a601-2b1609fdfcea tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:40.188174 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-225e8d00-e1ca-4c9a-a601-2b1609fdfcea tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:40.189169 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-225e8d00-e1ca-4c9a-a601-2b1609fdfcea tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:40.190255 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-225e8d00-e1ca-4c9a-a601-2b1609fdfcea tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:40.191998 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-225e8d00-e1ca-4c9a-a601-2b1609fdfcea tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:40.303216 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-ec7815c7-7707-4cf0-989c-b7836d5beff7 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cca65ba35b14db8bf2187188de8c838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51745fc19321469bb20afabe48b2185d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:56:40.346456 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-ec7815c7-7707-4cf0-989c-b7836d5beff7 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] 10.222.0.43 "GET /compute/v2.1/servers/6188e227-0adf-4afd-897d-66578f442cae" status: 200 len: 1468 microversion: 2.1 time: 0.374574 Oct 04 21:56:40.370410 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1493/2901] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:56:39 2022] GET /compute/v2.1/servers/6188e227-0adf-4afd-897d-66578f442cae => generated 1468 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:56:40.376802 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-9e8e57e3-389a-4270-8cbd-6069f67b2927 req-8951405a-fbfe-40ea-a051-5f52c0ab18e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6188e227-0adf-4afd-897d-66578f442cae", "name": "network-vif-deleted", "tag": "3506c0a9-1b9f-478c-b518-015e52ed0a1a"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:56:40.408555 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-9e8e57e3-389a-4270-8cbd-6069f67b2927 req-8951405a-fbfe-40ea-a051-5f52c0ab18e4 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:40.409065 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-9e8e57e3-389a-4270-8cbd-6069f67b2927 req-8951405a-fbfe-40ea-a051-5f52c0ab18e4 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:40.409546 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-9e8e57e3-389a-4270-8cbd-6069f67b2927 req-8951405a-fbfe-40ea-a051-5f52c0ab18e4 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:40.438388 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-225e8d00-e1ca-4c9a-a601-2b1609fdfcea tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b45ebdb946b45c28fc4bca3dd5a3e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520782b7e0a94e3fb552744cc4584119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:56:40.454981 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-225e8d00-e1ca-4c9a-a601-2b1609fdfcea tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] 10.222.0.43 "GET /compute/v2.1/servers/db2a8355-6007-4f37-89e1-a45e7492618d" status: 200 len: 1318 microversion: 2.1 time: 0.296638 Oct 04 21:56:40.458920 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1409/2902] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:56:40 2022] GET /compute/v2.1/servers/db2a8355-6007-4f37-89e1-a45e7492618d => generated 1318 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:56:40.511327 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-9e8e57e3-389a-4270-8cbd-6069f67b2927 req-8951405a-fbfe-40ea-a051-5f52c0ab18e4 service nova] Creating event network-vif-deleted:3506c0a9-1b9f-478c-b518-015e52ed0a1a for instance 6188e227-0adf-4afd-897d-66578f442cae on n-h2-860284-1 Oct 04 21:56:40.534718 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-9e8e57e3-389a-4270-8cbd-6069f67b2927 req-8951405a-fbfe-40ea-a051-5f52c0ab18e4 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.176010 Oct 04 21:56:40.535604 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1494/2903] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:56:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:56:41.174063 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-f2fc9905-62d9-4d20-8404-dbd641f2e1af tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Calling method '.version_select at 0x7fbb2edffa60>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:41.266973 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-f2fc9905-62d9-4d20-8404-dbd641f2e1af tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] 10.222.0.43 "GET /compute/v2.1/images/fc854dc3-25b4-4f91-a4ee-4aa1cce47c5b" status: 200 len: 1410 microversion: 2.1 time: 0.095681 Oct 04 21:56:41.270735 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1410/2904] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:56:41 2022] GET /compute/v2.1/images/fc854dc3-25b4-4f91-a4ee-4aa1cce47c5b => generated 1410 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:56:41.385495 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-af59757a-c5a8-4cf3-8272-74c1d1155bdd tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:41.386571 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-af59757a-c5a8-4cf3-8272-74c1d1155bdd tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] [instance: 6188e227-0adf-4afd-897d-66578f442cae] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:56:41.400707 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-af59757a-c5a8-4cf3-8272-74c1d1155bdd tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:41.401302 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-af59757a-c5a8-4cf3-8272-74c1d1155bdd tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:41.401814 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-af59757a-c5a8-4cf3-8272-74c1d1155bdd tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:41.407158 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-af59757a-c5a8-4cf3-8272-74c1d1155bdd tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:41.408637 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-af59757a-c5a8-4cf3-8272-74c1d1155bdd tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:41.409205 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-af59757a-c5a8-4cf3-8272-74c1d1155bdd tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:41.448990 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-af59757a-c5a8-4cf3-8272-74c1d1155bdd tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:41.449585 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-af59757a-c5a8-4cf3-8272-74c1d1155bdd tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:41.450097 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-af59757a-c5a8-4cf3-8272-74c1d1155bdd tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:41.450648 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.objects.instance [None req-af59757a-c5a8-4cf3-8272-74c1d1155bdd tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lazy-loading 'fault' on Instance uuid 6188e227-0adf-4afd-897d-66578f442cae {{(pid=134102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:56:41.516531 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-af59757a-c5a8-4cf3-8272-74c1d1155bdd tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cca65ba35b14db8bf2187188de8c838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51745fc19321469bb20afabe48b2185d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:56:41.535149 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-02eeed13-f847-4ffa-a7b1-5f977945bdfe tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:41.536230 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-02eeed13-f847-4ffa-a7b1-5f977945bdfe tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] [instance: db2a8355-6007-4f37-89e1-a45e7492618d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:56:41.553440 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-af59757a-c5a8-4cf3-8272-74c1d1155bdd tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] 10.222.0.43 "GET /compute/v2.1/servers/6188e227-0adf-4afd-897d-66578f442cae" status: 200 len: 1305 microversion: 2.1 time: 0.172243 Oct 04 21:56:41.556048 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1495/2905] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:56:41 2022] GET /compute/v2.1/servers/6188e227-0adf-4afd-897d-66578f442cae => generated 1305 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:56:41.557690 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-02eeed13-f847-4ffa-a7b1-5f977945bdfe tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:41.558190 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-02eeed13-f847-4ffa-a7b1-5f977945bdfe tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:41.558664 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-02eeed13-f847-4ffa-a7b1-5f977945bdfe tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:41.559347 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-02eeed13-f847-4ffa-a7b1-5f977945bdfe tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:41.559985 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-02eeed13-f847-4ffa-a7b1-5f977945bdfe tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:41.560580 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-02eeed13-f847-4ffa-a7b1-5f977945bdfe tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:41.804573 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-02eeed13-f847-4ffa-a7b1-5f977945bdfe tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b45ebdb946b45c28fc4bca3dd5a3e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520782b7e0a94e3fb552744cc4584119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:56:41.819623 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-02eeed13-f847-4ffa-a7b1-5f977945bdfe tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] 10.222.0.43 "GET /compute/v2.1/servers/db2a8355-6007-4f37-89e1-a45e7492618d" status: 200 len: 1467 microversion: 2.1 time: 0.310102 Oct 04 21:56:41.821783 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1411/2906] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:56:41 2022] GET /compute/v2.1/servers/db2a8355-6007-4f37-89e1-a45e7492618d => generated 1467 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:56:41.849900 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-e762ca66-acf3-472a-94e1-d1a3db05e0b8 tempest-LiveMigrationNegativeTest-1238186295 tempest-LiveMigrationNegativeTest-1238186295-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:56:41.850734 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-e762ca66-acf3-472a-94e1-d1a3db05e0b8 tempest-LiveMigrationNegativeTest-1238186295 tempest-LiveMigrationNegativeTest-1238186295-project-admin] [instance: db2a8355-6007-4f37-89e1-a45e7492618d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:56:41.857227 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e762ca66-acf3-472a-94e1-d1a3db05e0b8 tempest-LiveMigrationNegativeTest-1238186295 tempest-LiveMigrationNegativeTest-1238186295-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:41.857821 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e762ca66-acf3-472a-94e1-d1a3db05e0b8 tempest-LiveMigrationNegativeTest-1238186295 tempest-LiveMigrationNegativeTest-1238186295-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:41.858508 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e762ca66-acf3-472a-94e1-d1a3db05e0b8 tempest-LiveMigrationNegativeTest-1238186295 tempest-LiveMigrationNegativeTest-1238186295-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:41.859712 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e762ca66-acf3-472a-94e1-d1a3db05e0b8 tempest-LiveMigrationNegativeTest-1238186295 tempest-LiveMigrationNegativeTest-1238186295-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:41.861012 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e762ca66-acf3-472a-94e1-d1a3db05e0b8 tempest-LiveMigrationNegativeTest-1238186295 tempest-LiveMigrationNegativeTest-1238186295-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:41.861711 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e762ca66-acf3-472a-94e1-d1a3db05e0b8 tempest-LiveMigrationNegativeTest-1238186295 tempest-LiveMigrationNegativeTest-1238186295-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:41.899371 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.objects.instance [None req-e762ca66-acf3-472a-94e1-d1a3db05e0b8 tempest-LiveMigrationNegativeTest-1238186295 tempest-LiveMigrationNegativeTest-1238186295-project-admin] Lazy-loading 'flavor' on Instance uuid db2a8355-6007-4f37-89e1-a45e7492618d {{(pid=134102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:56:42.020082 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-e762ca66-acf3-472a-94e1-d1a3db05e0b8 tempest-LiveMigrationNegativeTest-1238186295 tempest-LiveMigrationNegativeTest-1238186295-project-admin] 10.222.0.43 "POST /compute/v2.1/servers/db2a8355-6007-4f37-89e1-a45e7492618d/action" status: 202 len: 0 microversion: 2.1 time: 0.175518 Oct 04 21:56:42.021371 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1496/2907] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 21:56:41 2022] POST /compute/v2.1/servers/db2a8355-6007-4f37-89e1-a45e7492618d/action => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:56:42.029843 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-3f23d399-e5e2-485e-9d26-0928ae90dadb tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:42.030643 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-3f23d399-e5e2-485e-9d26-0928ae90dadb tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] [instance: db2a8355-6007-4f37-89e1-a45e7492618d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:56:42.040579 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3f23d399-e5e2-485e-9d26-0928ae90dadb tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:42.041708 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3f23d399-e5e2-485e-9d26-0928ae90dadb tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:42.042264 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3f23d399-e5e2-485e-9d26-0928ae90dadb tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:42.043845 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3f23d399-e5e2-485e-9d26-0928ae90dadb tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:42.044799 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3f23d399-e5e2-485e-9d26-0928ae90dadb tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:42.045488 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3f23d399-e5e2-485e-9d26-0928ae90dadb tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:42.289285 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-a970733c-3c60-4b48-9752-d7a7506d22a0 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Calling method '.version_select at 0x7fbb2e7695e0>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:42.303836 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-3f23d399-e5e2-485e-9d26-0928ae90dadb tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b45ebdb946b45c28fc4bca3dd5a3e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520782b7e0a94e3fb552744cc4584119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:56:42.313276 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-3f23d399-e5e2-485e-9d26-0928ae90dadb tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] 10.222.0.43 "GET /compute/v2.1/servers/db2a8355-6007-4f37-89e1-a45e7492618d" status: 200 len: 1475 microversion: 2.1 time: 0.287702 Oct 04 21:56:42.322783 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1412/2908] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:56:42 2022] GET /compute/v2.1/servers/db2a8355-6007-4f37-89e1-a45e7492618d => generated 1475 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:56:42.350641 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-a970733c-3c60-4b48-9752-d7a7506d22a0 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] 10.222.0.43 "GET /compute/v2.1/images/fc854dc3-25b4-4f91-a4ee-4aa1cce47c5b" status: 200 len: 1410 microversion: 2.1 time: 0.069310 Oct 04 21:56:42.351567 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1497/2909] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:56:42 2022] GET /compute/v2.1/images/fc854dc3-25b4-4f91-a4ee-4aa1cce47c5b => generated 1410 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:56:42.583357 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-6c1924d3-273f-4497-863e-2c1eb40ffdcc tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:42.584272 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-6c1924d3-273f-4497-863e-2c1eb40ffdcc tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] [instance: 6188e227-0adf-4afd-897d-66578f442cae] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:56:42.610775 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6c1924d3-273f-4497-863e-2c1eb40ffdcc tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:42.611348 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6c1924d3-273f-4497-863e-2c1eb40ffdcc tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:42.611884 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6c1924d3-273f-4497-863e-2c1eb40ffdcc tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:42.612710 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6c1924d3-273f-4497-863e-2c1eb40ffdcc tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:42.616429 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6c1924d3-273f-4497-863e-2c1eb40ffdcc tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:42.619686 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6c1924d3-273f-4497-863e-2c1eb40ffdcc tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:42.660663 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-6c1924d3-273f-4497-863e-2c1eb40ffdcc tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] HTTP exception thrown: Instance 6188e227-0adf-4afd-897d-66578f442cae could not be found. Oct 04 21:56:42.663640 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-6c1924d3-273f-4497-863e-2c1eb40ffdcc tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Request method failure captured: Oct 04 21:56:42.663640 n-d-860284-1 devstack@n-api.service[134102]: request: GET /compute/v2.1/servers/6188e227-0adf-4afd-897d-66578f442cae HTTP/1.1 Oct 04 21:56:42.663640 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 21:56:42.663640 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 21:56:42.663640 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 21:56:42.663640 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 21:56:42.663640 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 21:56:42.663640 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 21:56:42.663640 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 21:56:42.663640 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 21:56:42.663640 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPKu1qJNzwuxRWdc7rP7w0gQHhoDMvT1hi4W6OphaRxhVehI7YxkRLmiRVTEcrGE4_kLVYYR9CLMgNAOGQEVIUg5ptFWtgovLZ1WXY_454sRPkZoUaMXWYK1EaSOxzAsp1QFRpLX6-NPmD2kPLhLIPCnWZqTYS8blSXJvj9wIhro38mc Oct 04 21:56:42.663640 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 21:56:42.663640 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 21:56:42.663640 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 21:56:42.663640 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 21:56:42.663640 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 21:56:42.663640 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 21:56:42.663640 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: 51745fc19321469bb20afabe48b2185d Oct 04 21:56:42.663640 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-SecurityGroupsTestJSON-367911468 Oct 04 21:56:42.663640 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 21:56:42.663640 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 21:56:42.663640 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/51745fc19321469bb20afabe48b2185d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_51745fc19321469bb20afabe48b2185d", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/51745fc19321469bb20afabe48b2185d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/51745fc19321469bb20afabe48b2185d"}]}] Oct 04 21:56:42.663640 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-SecurityGroupsTestJSON-367911468 Oct 04 21:56:42.663640 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: 51745fc19321469bb20afabe48b2185d Oct 04 21:56:42.663640 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-367911468 Oct 04 21:56:42.663640 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-SecurityGroupsTestJSON-367911468-project Oct 04 21:56:42.663640 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 21:56:42.663640 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 21:56:42.663640 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: 4cca65ba35b14db8bf2187188de8c838 Oct 04 21:56:42.663640 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-SecurityGroupsTestJSON-367911468-project Oct 04 21:56:42.663640 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 21:56:42.663640 n-d-860284-1 devstack@n-api.service[134102]: exception: Instance 6188e227-0adf-4afd-897d-66578f442cae could not be found. Oct 04 21:56:42.663640 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': '6188e227-0adf-4afd-897d-66578f442cae'} Oct 04 21:56:42.663640 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:56:42.663640 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:56:42.663640 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:56:42.663640 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:56:42.663640 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:56:42.663640 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:56:42.663640 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:56:42.663640 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:56:42.663640 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:56:42.663640 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:56:42.663640 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6188e227-0adf-4afd-897d-66578f442cae could not be found. Oct 04 21:56:42.663640 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:56:42.663640 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:56:42.663640 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:56:42.663640 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:56:42.663640 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:56:42.663640 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:56:42.663640 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:56:42.663640 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:56:42.663640 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:56:42.663640 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:56:42.663640 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:56:42.663640 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:56:42.663640 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:56:42.663640 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:56:42.663640 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:56:42.663640 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:56:42.663640 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6188e227-0adf-4afd-897d-66578f442cae could not be found. Oct 04 21:56:42.663640 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:56:42.663640 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:56:42.663640 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:56:42.669118 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:56:42.669118 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:56:42.669118 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:56:42.669118 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:56:42.669118 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:56:42.669118 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6188e227-0adf-4afd-897d-66578f442cae could not be found. Oct 04 21:56:42.669118 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:56:42.670715 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-6c1924d3-273f-4497-863e-2c1eb40ffdcc tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Returning 404 to user: Instance 6188e227-0adf-4afd-897d-66578f442cae could not be found. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:56:42.671832 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-6c1924d3-273f-4497-863e-2c1eb40ffdcc tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] 10.222.0.43 "GET /compute/v2.1/servers/6188e227-0adf-4afd-897d-66578f442cae" status: 404 len: 111 microversion: 2.1 time: 0.094602 Oct 04 21:56:42.677237 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1498/2910] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:56:42 2022] GET /compute/v2.1/servers/6188e227-0adf-4afd-897d-66578f442cae => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:56:42.683853 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-4e113210-0147-45a2-b1f0-982dcbe4c604 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Calling method '.version_select at 0x7fbb2e7694c0>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:42.985641 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-4e113210-0147-45a2-b1f0-982dcbe4c604 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/27294451-aded-4095-ab50-1237895ef2fe" status: 202 len: 0 microversion: 2.1 time: 0.306985 Oct 04 21:56:42.987344 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1499/2911] 10.222.0.43 () {58 vars in 1272 bytes} [Tue Oct 4 21:56:42 2022] DELETE /compute/v2.1/os-security-groups/27294451-aded-4095-ab50-1237895ef2fe => generated 0 bytes in 309 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:56:42.999322 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-e25aa38d-ae58-49cc-952d-8e2f080f9217 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Calling method '.version_select at 0x7fbb2e769160>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:43.244057 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-6743178f-417b-4d9e-a7f8-3f56fb8e64a0 tempest-AbsoluteLimitsNegativeTestJSON-150646884 tempest-AbsoluteLimitsNegativeTestJSON-150646884-project] Calling method '.version_select at 0x7fbb2e368430>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:43.275960 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6743178f-417b-4d9e-a7f8-3f56fb8e64a0 tempest-AbsoluteLimitsNegativeTestJSON-150646884 tempest-AbsoluteLimitsNegativeTestJSON-150646884-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:43.276978 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6743178f-417b-4d9e-a7f8-3f56fb8e64a0 tempest-AbsoluteLimitsNegativeTestJSON-150646884 tempest-AbsoluteLimitsNegativeTestJSON-150646884-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:43.277620 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6743178f-417b-4d9e-a7f8-3f56fb8e64a0 tempest-AbsoluteLimitsNegativeTestJSON-150646884 tempest-AbsoluteLimitsNegativeTestJSON-150646884-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:43.279340 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6743178f-417b-4d9e-a7f8-3f56fb8e64a0 tempest-AbsoluteLimitsNegativeTestJSON-150646884 tempest-AbsoluteLimitsNegativeTestJSON-150646884-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:43.280004 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6743178f-417b-4d9e-a7f8-3f56fb8e64a0 tempest-AbsoluteLimitsNegativeTestJSON-150646884 tempest-AbsoluteLimitsNegativeTestJSON-150646884-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:43.280629 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6743178f-417b-4d9e-a7f8-3f56fb8e64a0 tempest-AbsoluteLimitsNegativeTestJSON-150646884 tempest-AbsoluteLimitsNegativeTestJSON-150646884-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:43.323719 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-6743178f-417b-4d9e-a7f8-3f56fb8e64a0 tempest-AbsoluteLimitsNegativeTestJSON-150646884 tempest-AbsoluteLimitsNegativeTestJSON-150646884-project] 10.222.0.43 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.843213 Oct 04 21:56:43.325439 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1413/2912] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Oct 4 21:56:42 2022] GET /compute/v2.1/limits => generated 511 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:56:43.353085 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-8366bbdd-c3b9-4d5a-ba0f-9f49ab9e7593 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:43.354570 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-8366bbdd-c3b9-4d5a-ba0f-9f49ab9e7593 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] [instance: db2a8355-6007-4f37-89e1-a45e7492618d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:56:43.364873 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8366bbdd-c3b9-4d5a-ba0f-9f49ab9e7593 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:43.365566 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8366bbdd-c3b9-4d5a-ba0f-9f49ab9e7593 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:43.366189 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8366bbdd-c3b9-4d5a-ba0f-9f49ab9e7593 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:43.367639 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8366bbdd-c3b9-4d5a-ba0f-9f49ab9e7593 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:43.370400 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8366bbdd-c3b9-4d5a-ba0f-9f49ab9e7593 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:43.371152 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8366bbdd-c3b9-4d5a-ba0f-9f49ab9e7593 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:43.641714 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-e25aa38d-ae58-49cc-952d-8e2f080f9217 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/70873e3f-251f-4952-81c2-f5f494449422" status: 202 len: 0 microversion: 2.1 time: 0.648401 Oct 04 21:56:43.642820 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1500/2913] 10.222.0.43 () {58 vars in 1272 bytes} [Tue Oct 4 21:56:42 2022] DELETE /compute/v2.1/os-security-groups/70873e3f-251f-4952-81c2-f5f494449422 => generated 0 bytes in 651 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:56:43.651082 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-03b55d8d-6c46-4161-ac0e-c165e638e92a tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Calling method '.version_select at 0x7fbb372809d0>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:43.762212 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-03b55d8d-6c46-4161-ac0e-c165e638e92a tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] 10.222.0.43 "GET /compute/v2.1/images/fc854dc3-25b4-4f91-a4ee-4aa1cce47c5b" status: 200 len: 1410 microversion: 2.1 time: 0.116457 Oct 04 21:56:43.772819 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1501/2914] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:56:43 2022] GET /compute/v2.1/images/fc854dc3-25b4-4f91-a4ee-4aa1cce47c5b => generated 1410 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:56:43.779225 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-ffaf698f-fa06-4ba9-99c3-63189aca92fc tempest-AbsoluteLimitsNegativeTestJSON-150646884 tempest-AbsoluteLimitsNegativeTestJSON-150646884-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-1156179489", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:56:43.796329 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-8366bbdd-c3b9-4d5a-ba0f-9f49ab9e7593 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b45ebdb946b45c28fc4bca3dd5a3e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520782b7e0a94e3fb552744cc4584119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:56:43.812791 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-8366bbdd-c3b9-4d5a-ba0f-9f49ab9e7593 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] 10.222.0.43 "GET /compute/v2.1/servers/db2a8355-6007-4f37-89e1-a45e7492618d" status: 200 len: 1458 microversion: 2.1 time: 0.464566 Oct 04 21:56:43.816852 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1414/2915] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:56:43 2022] GET /compute/v2.1/servers/db2a8355-6007-4f37-89e1-a45e7492618d => generated 1458 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:56:43.825014 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-31e9cc30-5193-4652-a61b-bbbb688a46f0 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Action: 'create', calling method: .version_select at 0x7fbb2e368c10>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1111206005", "description": "tempest-description-2031922207"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:56:43.887534 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.network.neutron [None req-ffaf698f-fa06-4ba9-99c3-63189aca92fc tempest-AbsoluteLimitsNegativeTestJSON-150646884 tempest-AbsoluteLimitsNegativeTestJSON-150646884-project] validate_networks() for None {{(pid=134102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:56:44.602221 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-ffaf698f-fa06-4ba9-99c3-63189aca92fc tempest-AbsoluteLimitsNegativeTestJSON-150646884 tempest-AbsoluteLimitsNegativeTestJSON-150646884-project] Getting quotas for project cea69a95c0c54a64844a6dc655f26f40. Resources: dict_keys(['metadata_items']) {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:56:44.629506 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-ffaf698f-fa06-4ba9-99c3-63189aca92fc tempest-AbsoluteLimitsNegativeTestJSON-150646884 tempest-AbsoluteLimitsNegativeTestJSON-150646884-project] Getting quotas for user 13ea34cc5aba4f4cb1116bb11952f7f9 and project cea69a95c0c54a64844a6dc655f26f40. Resources: dict_keys(['metadata_items']) {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:56:44.669329 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-ffaf698f-fa06-4ba9-99c3-63189aca92fc tempest-AbsoluteLimitsNegativeTestJSON-150646884 tempest-AbsoluteLimitsNegativeTestJSON-150646884-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Oct 04 21:56:44.696526 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-ffaf698f-fa06-4ba9-99c3-63189aca92fc tempest-AbsoluteLimitsNegativeTestJSON-150646884 tempest-AbsoluteLimitsNegativeTestJSON-150646884-project] Request method failure captured: Oct 04 21:56:44.696526 n-d-860284-1 devstack@n-api.service[134102]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 21:56:44.696526 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 21:56:44.696526 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 21:56:44.696526 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 21:56:44.696526 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 1752 Oct 04 21:56:44.696526 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 21:56:44.696526 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 21:56:44.696526 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 21:56:44.696526 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 21:56:44.696526 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPKwadS9uvT_1th2ZHeSAWNLGpyKjy1rk54iSptftmvkhVtzGFsnGHu9w_xAkrRwFpZVJ94-CieOR4ruWrZq7ndQaqdADb_cPIOlOOEYSa0BEwB1CDnZc1RWEtblF8qIajR0gWWlR0sKp5Eu_xscl_ON4DDTN5n0J4u8mDM79ayiU7IY Oct 04 21:56:44.696526 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 21:56:44.696526 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 21:56:44.696526 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 21:56:44.696526 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 21:56:44.696526 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 21:56:44.696526 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 21:56:44.696526 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: cea69a95c0c54a64844a6dc655f26f40 Oct 04 21:56:44.696526 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-150646884 Oct 04 21:56:44.696526 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 21:56:44.696526 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 21:56:44.696526 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/cea69a95c0c54a64844a6dc655f26f40"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_cea69a95c0c54a64844a6dc655f26f40", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/cea69a95c0c54a64844a6dc655f26f40"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/cea69a95c0c54a64844a6dc655f26f40"}]}] Oct 04 21:56:44.696526 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-150646884 Oct 04 21:56:44.696526 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: cea69a95c0c54a64844a6dc655f26f40 Oct 04 21:56:44.696526 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-150646884 Oct 04 21:56:44.696526 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-150646884-project Oct 04 21:56:44.696526 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 21:56:44.696526 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 21:56:44.696526 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: 13ea34cc5aba4f4cb1116bb11952f7f9 Oct 04 21:56:44.696526 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-150646884-project Oct 04 21:56:44.696526 n-d-860284-1 devstack@n-api.service[134102]: Oct 04 21:56:44.696526 n-d-860284-1 devstack@n-api.service[134102]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-1156179489", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} Oct 04 21:56:44.696526 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 21:56:44.696526 n-d-860284-1 devstack@n-api.service[134102]: exception: Maximum number of metadata items exceeds 128 Oct 04 21:56:44.702957 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-1156179489', 'imageRef': '58548514-5dac-426c-81f5-19e3fba33e23', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} Oct 04 21:56:44.702957 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:56:44.702957 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:56:44.702957 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 476, in _check_metadata_properties_quota Oct 04 21:56:44.702957 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) Oct 04 21:56:44.702957 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 21:56:44.702957 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 21:56:44.702957 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check Oct 04 21:56:44.702957 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( Oct 04 21:56:44.702957 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check Oct 04 21:56:44.702957 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, Oct 04 21:56:44.702957 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check Oct 04 21:56:44.702957 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, Oct 04 21:56:44.702957 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] Oct 04 21:56:44.702957 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:56:44.702957 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:56:44.702957 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:56:44.702957 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:56:44.702957 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 21:56:44.702957 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 21:56:44.702957 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 21:56:44.702957 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 21:56:44.702957 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Oct 04 21:56:44.702957 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Oct 04 21:56:44.702957 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1016, in _checks_for_create_and_rebuild Oct 04 21:56:44.702957 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) Oct 04 21:56:44.702957 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 483, in _check_metadata_properties_quota Oct 04 21:56:44.702957 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) Oct 04 21:56:44.702957 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 Oct 04 21:56:44.702957 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:56:44.702957 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:56:44.702957 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:56:44.702957 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:56:44.702957 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:56:44.702957 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:56:44.702957 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:56:44.702957 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:56:44.702957 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:56:44.702957 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:56:44.702957 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:56:44.702957 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:56:44.702957 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:56:44.702957 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:56:44.702957 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:56:44.715800 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:56:44.715800 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 21:56:44.715800 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 04 21:56:44.715800 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 04 21:56:44.715800 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 Oct 04 21:56:44.715800 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:56:44.715800 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:56:44.715800 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:56:44.715800 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:56:44.715800 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:56:44.715800 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:56:44.715800 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:56:44.715800 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:56:44.715800 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 Oct 04 21:56:44.715800 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:56:44.715800 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-ffaf698f-fa06-4ba9-99c3-63189aca92fc tempest-AbsoluteLimitsNegativeTestJSON-150646884 tempest-AbsoluteLimitsNegativeTestJSON-150646884-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:56:44.719685 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-ffaf698f-fa06-4ba9-99c3-63189aca92fc tempest-AbsoluteLimitsNegativeTestJSON-150646884 tempest-AbsoluteLimitsNegativeTestJSON-150646884-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 0.944892 Oct 04 21:56:44.720915 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1502/2916] 10.222.0.43 () {60 vars in 1148 bytes} [Tue Oct 4 21:56:43 2022] POST /compute/v2.1/servers => generated 87 bytes in 947 msecs (HTTP/1.1 403) 9 headers in 378 bytes (1 switches on core 0) Oct 04 21:56:44.737602 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-ebbc1538-7e1e-437b-b15c-7d9a40359348 tempest-LiveMigrationNegativeTest-1238186295 tempest-LiveMigrationNegativeTest-1238186295-project-admin] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:44.739343 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-ebbc1538-7e1e-437b-b15c-7d9a40359348 tempest-LiveMigrationNegativeTest-1238186295 tempest-LiveMigrationNegativeTest-1238186295-project-admin] [instance: db2a8355-6007-4f37-89e1-a45e7492618d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:56:44.757293 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ebbc1538-7e1e-437b-b15c-7d9a40359348 tempest-LiveMigrationNegativeTest-1238186295 tempest-LiveMigrationNegativeTest-1238186295-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:44.758627 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ebbc1538-7e1e-437b-b15c-7d9a40359348 tempest-LiveMigrationNegativeTest-1238186295 tempest-LiveMigrationNegativeTest-1238186295-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:44.760062 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ebbc1538-7e1e-437b-b15c-7d9a40359348 tempest-LiveMigrationNegativeTest-1238186295 tempest-LiveMigrationNegativeTest-1238186295-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:44.762717 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ebbc1538-7e1e-437b-b15c-7d9a40359348 tempest-LiveMigrationNegativeTest-1238186295 tempest-LiveMigrationNegativeTest-1238186295-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:44.763742 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ebbc1538-7e1e-437b-b15c-7d9a40359348 tempest-LiveMigrationNegativeTest-1238186295 tempest-LiveMigrationNegativeTest-1238186295-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:44.764693 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ebbc1538-7e1e-437b-b15c-7d9a40359348 tempest-LiveMigrationNegativeTest-1238186295 tempest-LiveMigrationNegativeTest-1238186295-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:44.771950 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-31e9cc30-5193-4652-a61b-bbbb688a46f0 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] 10.222.0.43 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.953399 Oct 04 21:56:44.773562 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1415/2917] 10.222.0.43 () {60 vars in 1180 bytes} [Tue Oct 4 21:56:43 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:56:44.780987 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-c9972f25-3496-4adf-bdfe-e61bb668cd71 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Calling method '.version_select at 0x7fbb2e6cbee0>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:44.860353 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-c9972f25-3496-4adf-bdfe-e61bb668cd71 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] 10.222.0.43 "GET /compute/v2.1/images/fc854dc3-25b4-4f91-a4ee-4aa1cce47c5b" status: 200 len: 1410 microversion: 2.1 time: 0.084939 Oct 04 21:56:44.861241 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1416/2918] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:56:44 2022] GET /compute/v2.1/images/fc854dc3-25b4-4f91-a4ee-4aa1cce47c5b => generated 1410 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:56:44.873862 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-8f3953dd-c167-40ef-b13c-cb1864ddad5f tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Action: 'update', calling method: .version_select at 0x7fbb2e307550>, body: {"security_group": {"name": "tempest-sg-hth-536266037", "description": "tempest-description-hth-785519866"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:56:45.491186 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-ebbc1538-7e1e-437b-b15c-7d9a40359348 tempest-LiveMigrationNegativeTest-1238186295 tempest-LiveMigrationNegativeTest-1238186295-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/db2a8355-6007-4f37-89e1-a45e7492618d" status: 200 len: 1609 microversion: 2.1 time: 0.764864 Oct 04 21:56:45.497448 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1503/2919] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:56:44 2022] GET /compute/v2.1/servers/db2a8355-6007-4f37-89e1-a45e7492618d => generated 1609 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:56:45.529333 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-a591c518-67cd-482a-80c2-c27456bc39c8 tempest-LiveMigrationNegativeTest-1238186295 tempest-LiveMigrationNegativeTest-1238186295-project-admin] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:45.563494 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a591c518-67cd-482a-80c2-c27456bc39c8 tempest-LiveMigrationNegativeTest-1238186295 tempest-LiveMigrationNegativeTest-1238186295-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:45.568150 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a591c518-67cd-482a-80c2-c27456bc39c8 tempest-LiveMigrationNegativeTest-1238186295 tempest-LiveMigrationNegativeTest-1238186295-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:45.569286 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a591c518-67cd-482a-80c2-c27456bc39c8 tempest-LiveMigrationNegativeTest-1238186295 tempest-LiveMigrationNegativeTest-1238186295-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:45.573780 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a591c518-67cd-482a-80c2-c27456bc39c8 tempest-LiveMigrationNegativeTest-1238186295 tempest-LiveMigrationNegativeTest-1238186295-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:45.580289 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a591c518-67cd-482a-80c2-c27456bc39c8 tempest-LiveMigrationNegativeTest-1238186295 tempest-LiveMigrationNegativeTest-1238186295-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:45.582605 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a591c518-67cd-482a-80c2-c27456bc39c8 tempest-LiveMigrationNegativeTest-1238186295 tempest-LiveMigrationNegativeTest-1238186295-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:45.592307 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-8f3953dd-c167-40ef-b13c-cb1864ddad5f tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] 10.222.0.43 "PUT /compute/v2.1/os-security-groups/191f3d44-ba4f-47d4-9253-466fb9568720" status: 200 len: 216 microversion: 2.1 time: 0.729685 Oct 04 21:56:45.594908 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1417/2920] 10.222.0.43 () {60 vars in 1290 bytes} [Tue Oct 4 21:56:44 2022] PUT /compute/v2.1/os-security-groups/191f3d44-ba4f-47d4-9253-466fb9568720 => generated 216 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:56:45.608225 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-980e54a5-256c-4a1a-a739-ce00e35aec78 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Calling method '.version_select at 0x7fbb2e3680d0>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:45.712749 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-a591c518-67cd-482a-80c2-c27456bc39c8 tempest-LiveMigrationNegativeTest-1238186295 tempest-LiveMigrationNegativeTest-1238186295-project-admin] 10.222.0.43 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.190866 Oct 04 21:56:45.717638 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1504/2921] 10.222.0.43 () {58 vars in 1176 bytes} [Tue Oct 4 21:56:45 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:56:45.742410 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-61db2d19-3501-4d95-b3e6-c8677fa6dd0e tempest-LiveMigrationNegativeTest-1238186295 tempest-LiveMigrationNegativeTest-1238186295-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-860284-1", "block_migration": true, "disk_over_commit": false}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:56:45.754907 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-61db2d19-3501-4d95-b3e6-c8677fa6dd0e tempest-LiveMigrationNegativeTest-1238186295 tempest-LiveMigrationNegativeTest-1238186295-project-admin] [instance: db2a8355-6007-4f37-89e1-a45e7492618d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:56:45.762124 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-980e54a5-256c-4a1a-a739-ce00e35aec78 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] 10.222.0.43 "GET /compute/v2.1/os-security-groups/191f3d44-ba4f-47d4-9253-466fb9568720" status: 200 len: 216 microversion: 2.1 time: 0.156827 Oct 04 21:56:45.771793 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1418/2922] 10.222.0.43 () {58 vars in 1269 bytes} [Tue Oct 4 21:56:45 2022] GET /compute/v2.1/os-security-groups/191f3d44-ba4f-47d4-9253-466fb9568720 => generated 216 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:56:45.777164 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-4fa11b88-2e97-426e-a402-f52627a5eb52 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Calling method '.version_select at 0x7fbb2e35f4c0>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:45.783386 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-61db2d19-3501-4d95-b3e6-c8677fa6dd0e tempest-LiveMigrationNegativeTest-1238186295 tempest-LiveMigrationNegativeTest-1238186295-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:45.788151 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-61db2d19-3501-4d95-b3e6-c8677fa6dd0e tempest-LiveMigrationNegativeTest-1238186295 tempest-LiveMigrationNegativeTest-1238186295-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:45.791684 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-61db2d19-3501-4d95-b3e6-c8677fa6dd0e tempest-LiveMigrationNegativeTest-1238186295 tempest-LiveMigrationNegativeTest-1238186295-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:45.796504 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-61db2d19-3501-4d95-b3e6-c8677fa6dd0e tempest-LiveMigrationNegativeTest-1238186295 tempest-LiveMigrationNegativeTest-1238186295-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:45.799813 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-61db2d19-3501-4d95-b3e6-c8677fa6dd0e tempest-LiveMigrationNegativeTest-1238186295 tempest-LiveMigrationNegativeTest-1238186295-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:45.801448 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-61db2d19-3501-4d95-b3e6-c8677fa6dd0e tempest-LiveMigrationNegativeTest-1238186295 tempest-LiveMigrationNegativeTest-1238186295-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:45.913548 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.objects.instance [None req-61db2d19-3501-4d95-b3e6-c8677fa6dd0e tempest-LiveMigrationNegativeTest-1238186295 tempest-LiveMigrationNegativeTest-1238186295-project-admin] Lazy-loading 'flavor' on Instance uuid db2a8355-6007-4f37-89e1-a45e7492618d {{(pid=134102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:56:45.949167 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-61db2d19-3501-4d95-b3e6-c8677fa6dd0e tempest-LiveMigrationNegativeTest-1238186295 tempest-LiveMigrationNegativeTest-1238186295-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance db2a8355-6007-4f37-89e1-a45e7492618d while it is in vm_state suspended Oct 04 21:56:45.957390 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-61db2d19-3501-4d95-b3e6-c8677fa6dd0e tempest-LiveMigrationNegativeTest-1238186295 tempest-LiveMigrationNegativeTest-1238186295-project-admin] Request method failure captured: Oct 04 21:56:45.957390 n-d-860284-1 devstack@n-api.service[134102]: request: POST /compute/v2.1/servers/db2a8355-6007-4f37-89e1-a45e7492618d/action HTTP/1.1 Oct 04 21:56:45.957390 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 21:56:45.957390 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 21:56:45.957390 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 21:56:45.957390 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 97 Oct 04 21:56:45.957390 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 21:56:45.957390 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 21:56:45.957390 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 21:56:45.957390 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 21:56:45.957390 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPKvguTZe3GlLTOE-KDXQxSCTXlD5MDmB2CT_4nAdnhn3MbWJAhS2IihaYaRXI9yhyXyAw1nAdsAFWavxw8codsA18nkYi6PdXOxV3TvuXhjWIjLiL1pCsX0qKCnLIkYHj4peo3W-R7-68yoadc37D3k3ihhAfgJV4XchdqRNFD5MLgY Oct 04 21:56:45.957390 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 21:56:45.957390 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 21:56:45.957390 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 21:56:45.957390 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 21:56:45.957390 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 21:56:45.957390 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 21:56:45.957390 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: c433c9a3922d4b08ba3ace5489208281 Oct 04 21:56:45.957390 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-LiveMigrationNegativeTest-1238186295 Oct 04 21:56:45.957390 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,admin,member Oct 04 21:56:45.957390 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,admin,member Oct 04 21:56:45.957390 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c433c9a3922d4b08ba3ace5489208281"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_c433c9a3922d4b08ba3ace5489208281", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c433c9a3922d4b08ba3ace5489208281"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/c433c9a3922d4b08ba3ace5489208281"}]}] Oct 04 21:56:45.957390 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-LiveMigrationNegativeTest-1238186295 Oct 04 21:56:45.957390 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: c433c9a3922d4b08ba3ace5489208281 Oct 04 21:56:45.957390 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1238186295 Oct 04 21:56:45.957390 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-LiveMigrationNegativeTest-1238186295-project-admin Oct 04 21:56:45.957390 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 21:56:45.957390 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 21:56:45.957390 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: 6e6f35134c094f8aaa4c90e516580659 Oct 04 21:56:45.957390 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-LiveMigrationNegativeTest-1238186295-project-admin Oct 04 21:56:45.957390 n-d-860284-1 devstack@n-api.service[134102]: Oct 04 21:56:45.957390 n-d-860284-1 devstack@n-api.service[134102]: {"os-migrateLive": {"host": "n-h2-860284-1", "block_migration": true, "disk_over_commit": false}} Oct 04 21:56:45.957390 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 21:56:45.957390 n-d-860284-1 devstack@n-api.service[134102]: exception: Cannot 'os-migrateLive' instance db2a8355-6007-4f37-89e1-a45e7492618d while it is in vm_state suspended Oct 04 21:56:45.957390 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': 'db2a8355-6007-4f37-89e1-a45e7492618d', 'body': {'os-migrateLive': {'host': 'n-h2-860284-1', 'block_migration': True, 'disk_over_commit': False}}} Oct 04 21:56:45.957390 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:56:45.957390 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:56:45.957390 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Oct 04 21:56:45.957390 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Oct 04 21:56:45.957390 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 04 21:56:45.957390 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 21:56:45.957390 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 04 21:56:45.957390 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 21:56:45.957390 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 04 21:56:45.957390 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 21:56:45.957390 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 04 21:56:45.957390 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 21:56:45.957390 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 04 21:56:45.957390 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 21:56:45.957390 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 04 21:56:45.957390 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 21:56:45.957390 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 21:56:45.957390 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 21:56:45.957390 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 04 21:56:45.957390 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 04 21:56:45.957390 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance db2a8355-6007-4f37-89e1-a45e7492618d in vm_state suspended. Cannot live_migrate while the instance is in this state. Oct 04 21:56:45.957390 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:56:45.957390 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:56:45.957390 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:56:45.957390 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:56:45.957390 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:56:45.961565 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:56:45.961565 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:56:45.961565 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:56:45.961565 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:56:45.961565 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:56:45.961565 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:56:45.961565 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:56:45.961565 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:56:45.961565 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:56:45.961565 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:56:45.961565 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:56:45.961565 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 04 21:56:45.961565 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 152, in _migrate_live Oct 04 21:56:45.961565 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 04 21:56:45.961565 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 04 21:56:45.961565 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 21:56:45.961565 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'os-migrateLive' instance db2a8355-6007-4f37-89e1-a45e7492618d while it is in vm_state suspended Oct 04 21:56:45.961565 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:56:45.961565 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:56:45.961565 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:56:45.961565 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:56:45.961565 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:56:45.961565 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:56:45.961565 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:56:45.961565 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:56:45.961565 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'os-migrateLive' instance db2a8355-6007-4f37-89e1-a45e7492618d while it is in vm_state suspended Oct 04 21:56:45.961565 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:56:45.961565 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-61db2d19-3501-4d95-b3e6-c8677fa6dd0e tempest-LiveMigrationNegativeTest-1238186295 tempest-LiveMigrationNegativeTest-1238186295-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance db2a8355-6007-4f37-89e1-a45e7492618d while it is in vm_state suspended {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:56:45.963278 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-61db2d19-3501-4d95-b3e6-c8677fa6dd0e tempest-LiveMigrationNegativeTest-1238186295 tempest-LiveMigrationNegativeTest-1238186295-project-admin] 10.222.0.43 "POST /compute/v2.1/servers/db2a8355-6007-4f37-89e1-a45e7492618d/action" status: 409 len: 155 microversion: 2.1 time: 0.239194 Oct 04 21:56:45.970257 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1505/2923] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 21:56:45 2022] POST /compute/v2.1/servers/db2a8355-6007-4f37-89e1-a45e7492618d/action => generated 155 bytes in 248 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 21:56:45.982637 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-44003402-80f9-41f8-bb35-424b64de549c tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Calling method '.version_select at 0x7fbb2e6b9940>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:46.080278 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-44003402-80f9-41f8-bb35-424b64de549c tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] 10.222.0.43 "GET /compute/v2.1/images/fc854dc3-25b4-4f91-a4ee-4aa1cce47c5b" status: 200 len: 1410 microversion: 2.1 time: 0.108737 Oct 04 21:56:46.087961 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1506/2924] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:56:45 2022] GET /compute/v2.1/images/fc854dc3-25b4-4f91-a4ee-4aa1cce47c5b => generated 1410 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:56:46.102086 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-84c88458-82ae-491a-badd-65611360f423 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:46.114170 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-84c88458-82ae-491a-badd-65611360f423 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] [instance: db2a8355-6007-4f37-89e1-a45e7492618d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:56:46.152075 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-84c88458-82ae-491a-badd-65611360f423 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:46.154135 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-84c88458-82ae-491a-badd-65611360f423 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:46.154810 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-84c88458-82ae-491a-badd-65611360f423 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:46.158620 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-84c88458-82ae-491a-badd-65611360f423 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:46.159182 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-84c88458-82ae-491a-badd-65611360f423 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:46.160702 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-84c88458-82ae-491a-badd-65611360f423 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:46.269760 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-4fa11b88-2e97-426e-a402-f52627a5eb52 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/191f3d44-ba4f-47d4-9253-466fb9568720" status: 202 len: 0 microversion: 2.1 time: 0.495591 Oct 04 21:56:46.270735 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-84c88458-82ae-491a-badd-65611360f423 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] [instance: db2a8355-6007-4f37-89e1-a45e7492618d] Going to try to terminate instance {{(pid=134102) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:56:46.270940 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1419/2925] 10.222.0.43 () {58 vars in 1272 bytes} [Tue Oct 4 21:56:45 2022] DELETE /compute/v2.1/os-security-groups/191f3d44-ba4f-47d4-9253-466fb9568720 => generated 0 bytes in 498 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 21:56:46.291264 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-b766b58f-8969-4e03-ba91-8dcdcada1079 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:46.294015 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-b766b58f-8969-4e03-ba91-8dcdcada1079 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] [instance: 6188e227-0adf-4afd-897d-66578f442cae] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:56:46.317338 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b766b58f-8969-4e03-ba91-8dcdcada1079 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:46.317854 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b766b58f-8969-4e03-ba91-8dcdcada1079 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:46.318726 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b766b58f-8969-4e03-ba91-8dcdcada1079 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:46.322736 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b766b58f-8969-4e03-ba91-8dcdcada1079 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:46.325410 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b766b58f-8969-4e03-ba91-8dcdcada1079 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:46.326480 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b766b58f-8969-4e03-ba91-8dcdcada1079 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:46.362358 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-b766b58f-8969-4e03-ba91-8dcdcada1079 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] HTTP exception thrown: Instance 6188e227-0adf-4afd-897d-66578f442cae could not be found. Oct 04 21:56:46.367444 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-b766b58f-8969-4e03-ba91-8dcdcada1079 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Request method failure captured: Oct 04 21:56:46.367444 n-d-860284-1 devstack@n-api.service[134101]: request: DELETE /compute/v2.1/servers/6188e227-0adf-4afd-897d-66578f442cae HTTP/1.1 Oct 04 21:56:46.367444 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 21:56:46.367444 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 21:56:46.367444 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 21:56:46.367444 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 21:56:46.367444 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 21:56:46.367444 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 21:56:46.367444 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 21:56:46.367444 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 21:56:46.367444 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPKu1qJNzwuxRWdc7rP7w0gQHhoDMvT1hi4W6OphaRxhVehI7YxkRLmiRVTEcrGE4_kLVYYR9CLMgNAOGQEVIUg5ptFWtgovLZ1WXY_454sRPkZoUaMXWYK1EaSOxzAsp1QFRpLX6-NPmD2kPLhLIPCnWZqTYS8blSXJvj9wIhro38mc Oct 04 21:56:46.367444 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 21:56:46.367444 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 21:56:46.367444 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 21:56:46.367444 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 21:56:46.367444 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 21:56:46.367444 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 21:56:46.367444 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: 51745fc19321469bb20afabe48b2185d Oct 04 21:56:46.367444 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-SecurityGroupsTestJSON-367911468 Oct 04 21:56:46.367444 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 21:56:46.367444 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 21:56:46.367444 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/51745fc19321469bb20afabe48b2185d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_51745fc19321469bb20afabe48b2185d", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/51745fc19321469bb20afabe48b2185d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/51745fc19321469bb20afabe48b2185d"}]}] Oct 04 21:56:46.367444 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-SecurityGroupsTestJSON-367911468 Oct 04 21:56:46.367444 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: 51745fc19321469bb20afabe48b2185d Oct 04 21:56:46.367444 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-367911468 Oct 04 21:56:46.367444 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-SecurityGroupsTestJSON-367911468-project Oct 04 21:56:46.367444 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 21:56:46.367444 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 21:56:46.367444 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 4cca65ba35b14db8bf2187188de8c838 Oct 04 21:56:46.367444 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-SecurityGroupsTestJSON-367911468-project Oct 04 21:56:46.367444 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 21:56:46.367444 n-d-860284-1 devstack@n-api.service[134101]: exception: Instance 6188e227-0adf-4afd-897d-66578f442cae could not be found. Oct 04 21:56:46.367444 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': '6188e227-0adf-4afd-897d-66578f442cae'} Oct 04 21:56:46.367444 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:56:46.367444 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:56:46.367444 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:56:46.367444 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:56:46.367444 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:56:46.367444 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:56:46.367444 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:56:46.367444 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:56:46.367444 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:56:46.367444 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:56:46.367444 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6188e227-0adf-4afd-897d-66578f442cae could not be found. Oct 04 21:56:46.367444 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:56:46.367444 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:56:46.367444 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:56:46.367444 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:56:46.367444 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:56:46.367444 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:56:46.367444 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:56:46.367444 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:56:46.367444 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:56:46.367444 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:56:46.367444 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 21:56:46.367444 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 21:56:46.367444 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 21:56:46.367444 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 21:56:46.367444 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:56:46.367444 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:56:46.367444 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:56:46.367444 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:56:46.371365 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6188e227-0adf-4afd-897d-66578f442cae could not be found. Oct 04 21:56:46.371365 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:56:46.371365 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:56:46.371365 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:56:46.371365 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:56:46.371365 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:56:46.371365 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:56:46.371365 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:56:46.371365 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:56:46.371365 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6188e227-0adf-4afd-897d-66578f442cae could not be found. Oct 04 21:56:46.371365 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:56:46.371365 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-b766b58f-8969-4e03-ba91-8dcdcada1079 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Returning 404 to user: Instance 6188e227-0adf-4afd-897d-66578f442cae could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:56:46.371365 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-b766b58f-8969-4e03-ba91-8dcdcada1079 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] 10.222.0.43 "DELETE /compute/v2.1/servers/6188e227-0adf-4afd-897d-66578f442cae" status: 404 len: 111 microversion: 2.1 time: 0.093889 Oct 04 21:56:46.374337 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1420/2926] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 21:56:46 2022] DELETE /compute/v2.1/servers/6188e227-0adf-4afd-897d-66578f442cae => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 21:56:46.395642 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-8c9a0c7b-3eb4-4a68-b06f-4d2d98e75b18 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:46.398388 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-8c9a0c7b-3eb4-4a68-b06f-4d2d98e75b18 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] [instance: 6188e227-0adf-4afd-897d-66578f442cae] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:56:46.415913 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8c9a0c7b-3eb4-4a68-b06f-4d2d98e75b18 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:46.417353 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8c9a0c7b-3eb4-4a68-b06f-4d2d98e75b18 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:46.418826 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8c9a0c7b-3eb4-4a68-b06f-4d2d98e75b18 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:46.420906 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8c9a0c7b-3eb4-4a68-b06f-4d2d98e75b18 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:46.423819 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8c9a0c7b-3eb4-4a68-b06f-4d2d98e75b18 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:46.425374 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8c9a0c7b-3eb4-4a68-b06f-4d2d98e75b18 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:46.462333 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-8c9a0c7b-3eb4-4a68-b06f-4d2d98e75b18 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] HTTP exception thrown: Instance 6188e227-0adf-4afd-897d-66578f442cae could not be found. Oct 04 21:56:46.477739 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-8c9a0c7b-3eb4-4a68-b06f-4d2d98e75b18 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Request method failure captured: Oct 04 21:56:46.477739 n-d-860284-1 devstack@n-api.service[134101]: request: GET /compute/v2.1/servers/6188e227-0adf-4afd-897d-66578f442cae HTTP/1.1 Oct 04 21:56:46.477739 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 21:56:46.477739 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 21:56:46.477739 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 21:56:46.477739 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 21:56:46.477739 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 21:56:46.477739 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 21:56:46.477739 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 21:56:46.477739 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 21:56:46.477739 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPKu1qJNzwuxRWdc7rP7w0gQHhoDMvT1hi4W6OphaRxhVehI7YxkRLmiRVTEcrGE4_kLVYYR9CLMgNAOGQEVIUg5ptFWtgovLZ1WXY_454sRPkZoUaMXWYK1EaSOxzAsp1QFRpLX6-NPmD2kPLhLIPCnWZqTYS8blSXJvj9wIhro38mc Oct 04 21:56:46.477739 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 21:56:46.477739 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 21:56:46.477739 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 21:56:46.477739 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 21:56:46.477739 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 21:56:46.477739 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 21:56:46.477739 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: 51745fc19321469bb20afabe48b2185d Oct 04 21:56:46.477739 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-SecurityGroupsTestJSON-367911468 Oct 04 21:56:46.477739 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 21:56:46.477739 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 21:56:46.477739 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/51745fc19321469bb20afabe48b2185d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_51745fc19321469bb20afabe48b2185d", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/51745fc19321469bb20afabe48b2185d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/51745fc19321469bb20afabe48b2185d"}]}] Oct 04 21:56:46.477739 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-SecurityGroupsTestJSON-367911468 Oct 04 21:56:46.477739 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: 51745fc19321469bb20afabe48b2185d Oct 04 21:56:46.477739 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-367911468 Oct 04 21:56:46.477739 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-SecurityGroupsTestJSON-367911468-project Oct 04 21:56:46.477739 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 21:56:46.477739 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 21:56:46.477739 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 4cca65ba35b14db8bf2187188de8c838 Oct 04 21:56:46.477739 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-SecurityGroupsTestJSON-367911468-project Oct 04 21:56:46.477739 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 21:56:46.477739 n-d-860284-1 devstack@n-api.service[134101]: exception: Instance 6188e227-0adf-4afd-897d-66578f442cae could not be found. Oct 04 21:56:46.477739 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': '6188e227-0adf-4afd-897d-66578f442cae'} Oct 04 21:56:46.477739 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:56:46.477739 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:56:46.477739 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:56:46.477739 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:56:46.477739 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:56:46.477739 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:56:46.477739 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:56:46.477739 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:56:46.477739 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:56:46.477739 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:56:46.477739 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6188e227-0adf-4afd-897d-66578f442cae could not be found. Oct 04 21:56:46.477739 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:56:46.477739 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:56:46.477739 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:56:46.477739 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:56:46.477739 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:56:46.477739 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:56:46.477739 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:56:46.477739 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:56:46.477739 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:56:46.477739 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:56:46.477739 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:56:46.477739 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:56:46.477739 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:56:46.477739 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:56:46.477739 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:56:46.477739 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:56:46.477739 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6188e227-0adf-4afd-897d-66578f442cae could not be found. Oct 04 21:56:46.477739 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:56:46.477739 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:56:46.477739 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:56:46.483148 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:56:46.483148 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:56:46.483148 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:56:46.483148 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:56:46.483148 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:56:46.483148 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6188e227-0adf-4afd-897d-66578f442cae could not be found. Oct 04 21:56:46.483148 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:56:46.498101 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-8c9a0c7b-3eb4-4a68-b06f-4d2d98e75b18 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Returning 404 to user: Instance 6188e227-0adf-4afd-897d-66578f442cae could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:56:46.501383 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-8c9a0c7b-3eb4-4a68-b06f-4d2d98e75b18 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] 10.222.0.43 "GET /compute/v2.1/servers/6188e227-0adf-4afd-897d-66578f442cae" status: 404 len: 111 microversion: 2.1 time: 0.124648 Oct 04 21:56:46.505629 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1421/2927] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:56:46 2022] GET /compute/v2.1/servers/6188e227-0adf-4afd-897d-66578f442cae => generated 111 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:56:46.515249 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-423aacde-9902-404d-bb23-c19138039cbf tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Calling method '.version_select at 0x7fbb2e368ca0>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:46.664124 n-d-860284-1 devstack@n-api.service[134101]: DEBUG neutronclient.v2_0.client [None req-423aacde-9902-404d-bb23-c19138039cbf tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 70873e3f-251f-4952-81c2-f5f494449422 does not exist", "detail": ""}} {{(pid=134101) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 21:56:46.667195 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-84c88458-82ae-491a-badd-65611360f423 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] 10.222.0.43 "DELETE /compute/v2.1/servers/db2a8355-6007-4f37-89e1-a45e7492618d" status: 204 len: 0 microversion: 2.1 time: 0.566121 Oct 04 21:56:46.668410 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1507/2928] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 21:56:46 2022] DELETE /compute/v2.1/servers/db2a8355-6007-4f37-89e1-a45e7492618d => generated 0 bytes in 579 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:56:46.669157 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.network.security_group_api [None req-423aacde-9902-404d-bb23-c19138039cbf tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Neutron security group 70873e3f-251f-4952-81c2-f5f494449422 not found {{(pid=134101) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 04 21:56:46.670163 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-423aacde-9902-404d-bb23-c19138039cbf tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] HTTP exception thrown: Security group 70873e3f-251f-4952-81c2-f5f494449422 does not exist Oct 04 21:56:46.670163 n-d-860284-1 devstack@n-api.service[134101]: Neutron server returns request_ids: ['req-617d05fd-7cf0-4b91-a990-192bfc08cdd4'] Oct 04 21:56:46.676535 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-423aacde-9902-404d-bb23-c19138039cbf tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Request method failure captured: Oct 04 21:56:46.676535 n-d-860284-1 devstack@n-api.service[134101]: request: DELETE /compute/v2.1/os-security-groups/70873e3f-251f-4952-81c2-f5f494449422 HTTP/1.1 Oct 04 21:56:46.676535 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 21:56:46.676535 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 21:56:46.676535 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 21:56:46.676535 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 21:56:46.676535 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 21:56:46.676535 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 21:56:46.676535 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 21:56:46.676535 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 21:56:46.676535 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPKu1qJNzwuxRWdc7rP7w0gQHhoDMvT1hi4W6OphaRxhVehI7YxkRLmiRVTEcrGE4_kLVYYR9CLMgNAOGQEVIUg5ptFWtgovLZ1WXY_454sRPkZoUaMXWYK1EaSOxzAsp1QFRpLX6-NPmD2kPLhLIPCnWZqTYS8blSXJvj9wIhro38mc Oct 04 21:56:46.676535 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 21:56:46.676535 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 21:56:46.676535 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 21:56:46.676535 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 21:56:46.676535 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 21:56:46.676535 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 21:56:46.676535 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: 51745fc19321469bb20afabe48b2185d Oct 04 21:56:46.676535 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-SecurityGroupsTestJSON-367911468 Oct 04 21:56:46.676535 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 21:56:46.676535 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 21:56:46.676535 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/51745fc19321469bb20afabe48b2185d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_51745fc19321469bb20afabe48b2185d", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/51745fc19321469bb20afabe48b2185d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/51745fc19321469bb20afabe48b2185d"}]}] Oct 04 21:56:46.676535 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-SecurityGroupsTestJSON-367911468 Oct 04 21:56:46.676535 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: 51745fc19321469bb20afabe48b2185d Oct 04 21:56:46.676535 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-367911468 Oct 04 21:56:46.676535 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-SecurityGroupsTestJSON-367911468-project Oct 04 21:56:46.676535 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 21:56:46.676535 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 21:56:46.676535 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 4cca65ba35b14db8bf2187188de8c838 Oct 04 21:56:46.676535 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-SecurityGroupsTestJSON-367911468-project Oct 04 21:56:46.676535 n-d-860284-1 devstack@n-api.service[134101]: method: Oct 04 21:56:46.676535 n-d-860284-1 devstack@n-api.service[134101]: exception: Security group 70873e3f-251f-4952-81c2-f5f494449422 does not exist Oct 04 21:56:46.676535 n-d-860284-1 devstack@n-api.service[134101]: Neutron server returns request_ids: ['req-617d05fd-7cf0-4b91-a990-192bfc08cdd4'] Oct 04 21:56:46.676535 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': '70873e3f-251f-4952-81c2-f5f494449422'} Oct 04 21:56:46.676535 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:56:46.676535 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:56:46.676535 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 04 21:56:46.676535 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 04 21:56:46.676535 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:56:46.676535 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:56:46.676535 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 04 21:56:46.676535 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 04 21:56:46.676535 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:56:46.676535 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:56:46.676535 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 21:56:46.676535 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 21:56:46.676535 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:56:46.676535 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:56:46.676535 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 21:56:46.676535 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 21:56:46.676535 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:56:46.676535 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:56:46.676535 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 21:56:46.676535 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 21:56:46.676535 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:56:46.676535 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:56:46.676535 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 21:56:46.676535 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 21:56:46.676535 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 21:56:46.676535 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 21:56:46.676535 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 70873e3f-251f-4952-81c2-f5f494449422 does not exist Oct 04 21:56:46.680491 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-617d05fd-7cf0-4b91-a990-192bfc08cdd4'] Oct 04 21:56:46.680491 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:56:46.680491 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:56:46.680491 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:56:46.680491 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:56:46.680491 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 04 21:56:46.680491 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 04 21:56:46.680491 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 04 21:56:46.680491 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 21:56:46.680491 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 70873e3f-251f-4952-81c2-f5f494449422 does not exist Oct 04 21:56:46.680491 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-617d05fd-7cf0-4b91-a990-192bfc08cdd4'] Oct 04 21:56:46.680491 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:56:46.680491 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:56:46.680491 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:56:46.680491 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:56:46.680491 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:56:46.680491 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:56:46.680491 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:56:46.680491 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:56:46.680491 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:56:46.680491 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:56:46.680491 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:56:46.680491 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:56:46.680491 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 04 21:56:46.680491 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 21:56:46.680491 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 70873e3f-251f-4952-81c2-f5f494449422 does not exist Oct 04 21:56:46.680491 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-617d05fd-7cf0-4b91-a990-192bfc08cdd4'] Oct 04 21:56:46.680491 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:56:46.680491 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:56:46.680491 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:56:46.680491 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:56:46.680491 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:56:46.680491 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:56:46.680491 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:56:46.680491 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:56:46.680491 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 70873e3f-251f-4952-81c2-f5f494449422 does not exist Oct 04 21:56:46.680491 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-617d05fd-7cf0-4b91-a990-192bfc08cdd4'] Oct 04 21:56:46.680491 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:56:46.683203 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-c269a54e-38b8-4518-b239-43e6746e79c1 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:46.683203 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-c269a54e-38b8-4518-b239-43e6746e79c1 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] [instance: db2a8355-6007-4f37-89e1-a45e7492618d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:56:46.688745 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-423aacde-9902-404d-bb23-c19138039cbf tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Returning 404 to user: Security group 70873e3f-251f-4952-81c2-f5f494449422 does not exist Oct 04 21:56:46.688745 n-d-860284-1 devstack@n-api.service[134101]: Neutron server returns request_ids: ['req-617d05fd-7cf0-4b91-a990-192bfc08cdd4'] {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:56:46.690222 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-423aacde-9902-404d-bb23-c19138039cbf tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/70873e3f-251f-4952-81c2-f5f494449422" status: 404 len: 194 microversion: 2.1 time: 0.181693 Oct 04 21:56:46.699129 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1422/2929] 10.222.0.43 () {58 vars in 1272 bytes} [Tue Oct 4 21:56:46 2022] DELETE /compute/v2.1/os-security-groups/70873e3f-251f-4952-81c2-f5f494449422 => generated 194 bytes in 191 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:56:46.699889 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c269a54e-38b8-4518-b239-43e6746e79c1 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:46.700387 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c269a54e-38b8-4518-b239-43e6746e79c1 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:46.700829 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c269a54e-38b8-4518-b239-43e6746e79c1 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:46.702578 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c269a54e-38b8-4518-b239-43e6746e79c1 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:46.703069 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c269a54e-38b8-4518-b239-43e6746e79c1 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:46.703701 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c269a54e-38b8-4518-b239-43e6746e79c1 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:46.713701 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-20bb82d3-0e33-4807-94eb-5cb2ae389411 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Calling method '.version_select at 0x7fbb2ed0a3a0>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:46.809233 n-d-860284-1 devstack@n-api.service[134101]: DEBUG neutronclient.v2_0.client [None req-20bb82d3-0e33-4807-94eb-5cb2ae389411 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 27294451-aded-4095-ab50-1237895ef2fe does not exist", "detail": ""}} {{(pid=134101) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 21:56:46.809889 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.network.security_group_api [None req-20bb82d3-0e33-4807-94eb-5cb2ae389411 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Neutron security group 27294451-aded-4095-ab50-1237895ef2fe not found {{(pid=134101) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 04 21:56:46.810487 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-20bb82d3-0e33-4807-94eb-5cb2ae389411 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] HTTP exception thrown: Security group 27294451-aded-4095-ab50-1237895ef2fe does not exist Oct 04 21:56:46.810487 n-d-860284-1 devstack@n-api.service[134101]: Neutron server returns request_ids: ['req-c19780ed-4561-4a1a-b953-93b591883a73'] Oct 04 21:56:46.812427 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-20bb82d3-0e33-4807-94eb-5cb2ae389411 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Request method failure captured: Oct 04 21:56:46.812427 n-d-860284-1 devstack@n-api.service[134101]: request: DELETE /compute/v2.1/os-security-groups/27294451-aded-4095-ab50-1237895ef2fe HTTP/1.1 Oct 04 21:56:46.812427 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 21:56:46.812427 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 21:56:46.812427 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 21:56:46.812427 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 21:56:46.812427 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 21:56:46.812427 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 21:56:46.812427 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 21:56:46.812427 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 21:56:46.812427 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPKu1qJNzwuxRWdc7rP7w0gQHhoDMvT1hi4W6OphaRxhVehI7YxkRLmiRVTEcrGE4_kLVYYR9CLMgNAOGQEVIUg5ptFWtgovLZ1WXY_454sRPkZoUaMXWYK1EaSOxzAsp1QFRpLX6-NPmD2kPLhLIPCnWZqTYS8blSXJvj9wIhro38mc Oct 04 21:56:46.812427 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 21:56:46.812427 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 21:56:46.812427 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 21:56:46.812427 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 21:56:46.812427 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 21:56:46.812427 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 21:56:46.812427 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: 51745fc19321469bb20afabe48b2185d Oct 04 21:56:46.812427 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-SecurityGroupsTestJSON-367911468 Oct 04 21:56:46.812427 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 21:56:46.812427 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 21:56:46.812427 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/51745fc19321469bb20afabe48b2185d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_51745fc19321469bb20afabe48b2185d", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/51745fc19321469bb20afabe48b2185d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/51745fc19321469bb20afabe48b2185d"}]}] Oct 04 21:56:46.812427 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-SecurityGroupsTestJSON-367911468 Oct 04 21:56:46.812427 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: 51745fc19321469bb20afabe48b2185d Oct 04 21:56:46.812427 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-367911468 Oct 04 21:56:46.812427 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-SecurityGroupsTestJSON-367911468-project Oct 04 21:56:46.812427 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 21:56:46.812427 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 21:56:46.812427 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 4cca65ba35b14db8bf2187188de8c838 Oct 04 21:56:46.812427 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-SecurityGroupsTestJSON-367911468-project Oct 04 21:56:46.812427 n-d-860284-1 devstack@n-api.service[134101]: method: Oct 04 21:56:46.812427 n-d-860284-1 devstack@n-api.service[134101]: exception: Security group 27294451-aded-4095-ab50-1237895ef2fe does not exist Oct 04 21:56:46.812427 n-d-860284-1 devstack@n-api.service[134101]: Neutron server returns request_ids: ['req-c19780ed-4561-4a1a-b953-93b591883a73'] Oct 04 21:56:46.812427 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': '27294451-aded-4095-ab50-1237895ef2fe'} Oct 04 21:56:46.812427 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:56:46.812427 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:56:46.812427 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 04 21:56:46.812427 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 04 21:56:46.812427 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:56:46.812427 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:56:46.812427 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 04 21:56:46.812427 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 04 21:56:46.812427 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:56:46.812427 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:56:46.812427 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 21:56:46.812427 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 21:56:46.812427 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:56:46.812427 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:56:46.812427 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 21:56:46.812427 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 21:56:46.812427 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:56:46.812427 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:56:46.812427 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 21:56:46.812427 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 21:56:46.812427 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:56:46.812427 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:56:46.812427 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 21:56:46.812427 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 21:56:46.812427 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 21:56:46.812427 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 21:56:46.812427 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 27294451-aded-4095-ab50-1237895ef2fe does not exist Oct 04 21:56:46.817366 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c19780ed-4561-4a1a-b953-93b591883a73'] Oct 04 21:56:46.817366 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:56:46.817366 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:56:46.817366 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:56:46.817366 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:56:46.817366 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 04 21:56:46.817366 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 04 21:56:46.817366 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 04 21:56:46.817366 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 21:56:46.817366 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 27294451-aded-4095-ab50-1237895ef2fe does not exist Oct 04 21:56:46.817366 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c19780ed-4561-4a1a-b953-93b591883a73'] Oct 04 21:56:46.817366 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:56:46.817366 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:56:46.817366 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:56:46.817366 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:56:46.817366 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:56:46.817366 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:56:46.817366 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:56:46.817366 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:56:46.817366 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:56:46.817366 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:56:46.817366 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:56:46.817366 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:56:46.817366 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 04 21:56:46.817366 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 21:56:46.817366 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 27294451-aded-4095-ab50-1237895ef2fe does not exist Oct 04 21:56:46.817366 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c19780ed-4561-4a1a-b953-93b591883a73'] Oct 04 21:56:46.817366 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:56:46.817366 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:56:46.817366 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:56:46.817366 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:56:46.817366 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:56:46.817366 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:56:46.817366 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:56:46.817366 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:56:46.817366 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 27294451-aded-4095-ab50-1237895ef2fe does not exist Oct 04 21:56:46.817366 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c19780ed-4561-4a1a-b953-93b591883a73'] Oct 04 21:56:46.817366 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:56:46.817366 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-20bb82d3-0e33-4807-94eb-5cb2ae389411 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Returning 404 to user: Security group 27294451-aded-4095-ab50-1237895ef2fe does not exist Oct 04 21:56:46.817366 n-d-860284-1 devstack@n-api.service[134101]: Neutron server returns request_ids: ['req-c19780ed-4561-4a1a-b953-93b591883a73'] {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:56:46.817366 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-20bb82d3-0e33-4807-94eb-5cb2ae389411 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/27294451-aded-4095-ab50-1237895ef2fe" status: 404 len: 194 microversion: 2.1 time: 0.112635 Oct 04 21:56:46.820645 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1423/2930] 10.222.0.43 () {58 vars in 1272 bytes} [Tue Oct 4 21:56:46 2022] DELETE /compute/v2.1/os-security-groups/27294451-aded-4095-ab50-1237895ef2fe => generated 194 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:56:46.829475 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-4a7c7d03-4430-458f-925a-ff0b2e76e32b tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Calling method '.version_select at 0x7fbb2e303940>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:46.932687 n-d-860284-1 devstack@n-api.service[134101]: DEBUG neutronclient.v2_0.client [None req-4a7c7d03-4430-458f-925a-ff0b2e76e32b tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group c1c7c16c-681f-40b3-a40e-7ed02207c2dd does not exist", "detail": ""}} {{(pid=134101) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 21:56:46.933300 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.network.security_group_api [None req-4a7c7d03-4430-458f-925a-ff0b2e76e32b tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Neutron security group c1c7c16c-681f-40b3-a40e-7ed02207c2dd not found {{(pid=134101) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 04 21:56:46.933830 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-4a7c7d03-4430-458f-925a-ff0b2e76e32b tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] HTTP exception thrown: Security group c1c7c16c-681f-40b3-a40e-7ed02207c2dd does not exist Oct 04 21:56:46.933830 n-d-860284-1 devstack@n-api.service[134101]: Neutron server returns request_ids: ['req-41d5f87b-c230-43f3-980c-10af8694a146'] Oct 04 21:56:46.935818 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-4a7c7d03-4430-458f-925a-ff0b2e76e32b tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Request method failure captured: Oct 04 21:56:46.935818 n-d-860284-1 devstack@n-api.service[134101]: request: DELETE /compute/v2.1/os-security-groups/c1c7c16c-681f-40b3-a40e-7ed02207c2dd HTTP/1.1 Oct 04 21:56:46.935818 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 21:56:46.935818 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 21:56:46.935818 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 21:56:46.935818 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 21:56:46.935818 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 21:56:46.935818 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 21:56:46.935818 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 21:56:46.935818 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 21:56:46.935818 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPKu1qJNzwuxRWdc7rP7w0gQHhoDMvT1hi4W6OphaRxhVehI7YxkRLmiRVTEcrGE4_kLVYYR9CLMgNAOGQEVIUg5ptFWtgovLZ1WXY_454sRPkZoUaMXWYK1EaSOxzAsp1QFRpLX6-NPmD2kPLhLIPCnWZqTYS8blSXJvj9wIhro38mc Oct 04 21:56:46.935818 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 21:56:46.935818 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 21:56:46.935818 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 21:56:46.935818 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 21:56:46.935818 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 21:56:46.935818 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 21:56:46.935818 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: 51745fc19321469bb20afabe48b2185d Oct 04 21:56:46.935818 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-SecurityGroupsTestJSON-367911468 Oct 04 21:56:46.935818 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 21:56:46.935818 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 21:56:46.935818 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/51745fc19321469bb20afabe48b2185d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_51745fc19321469bb20afabe48b2185d", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/51745fc19321469bb20afabe48b2185d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/51745fc19321469bb20afabe48b2185d"}]}] Oct 04 21:56:46.935818 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-SecurityGroupsTestJSON-367911468 Oct 04 21:56:46.935818 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: 51745fc19321469bb20afabe48b2185d Oct 04 21:56:46.935818 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-367911468 Oct 04 21:56:46.935818 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-SecurityGroupsTestJSON-367911468-project Oct 04 21:56:46.935818 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 21:56:46.935818 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 21:56:46.935818 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 4cca65ba35b14db8bf2187188de8c838 Oct 04 21:56:46.935818 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-SecurityGroupsTestJSON-367911468-project Oct 04 21:56:46.935818 n-d-860284-1 devstack@n-api.service[134101]: method: Oct 04 21:56:46.935818 n-d-860284-1 devstack@n-api.service[134101]: exception: Security group c1c7c16c-681f-40b3-a40e-7ed02207c2dd does not exist Oct 04 21:56:46.935818 n-d-860284-1 devstack@n-api.service[134101]: Neutron server returns request_ids: ['req-41d5f87b-c230-43f3-980c-10af8694a146'] Oct 04 21:56:46.935818 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': 'c1c7c16c-681f-40b3-a40e-7ed02207c2dd'} Oct 04 21:56:46.935818 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:56:46.935818 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:56:46.935818 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 04 21:56:46.935818 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 04 21:56:46.935818 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:56:46.935818 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:56:46.935818 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 04 21:56:46.935818 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 04 21:56:46.935818 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:56:46.935818 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:56:46.935818 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 21:56:46.935818 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 21:56:46.935818 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:56:46.935818 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:56:46.935818 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 21:56:46.935818 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 21:56:46.935818 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:56:46.935818 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:56:46.935818 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 21:56:46.935818 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 21:56:46.935818 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:56:46.935818 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:56:46.935818 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 21:56:46.935818 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 21:56:46.935818 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 21:56:46.935818 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 21:56:46.935818 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group c1c7c16c-681f-40b3-a40e-7ed02207c2dd does not exist Oct 04 21:56:46.940386 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-41d5f87b-c230-43f3-980c-10af8694a146'] Oct 04 21:56:46.940386 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:56:46.940386 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:56:46.940386 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:56:46.940386 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:56:46.940386 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 04 21:56:46.940386 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 04 21:56:46.940386 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 04 21:56:46.940386 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 21:56:46.940386 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group c1c7c16c-681f-40b3-a40e-7ed02207c2dd does not exist Oct 04 21:56:46.940386 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-41d5f87b-c230-43f3-980c-10af8694a146'] Oct 04 21:56:46.940386 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:56:46.940386 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:56:46.940386 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:56:46.940386 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:56:46.940386 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:56:46.940386 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:56:46.940386 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:56:46.940386 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:56:46.940386 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:56:46.940386 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:56:46.940386 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:56:46.940386 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:56:46.940386 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 04 21:56:46.940386 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 21:56:46.940386 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group c1c7c16c-681f-40b3-a40e-7ed02207c2dd does not exist Oct 04 21:56:46.940386 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-41d5f87b-c230-43f3-980c-10af8694a146'] Oct 04 21:56:46.940386 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:56:46.940386 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:56:46.940386 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:56:46.940386 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:56:46.940386 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:56:46.940386 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:56:46.940386 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:56:46.940386 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:56:46.940386 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group c1c7c16c-681f-40b3-a40e-7ed02207c2dd does not exist Oct 04 21:56:46.940386 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-41d5f87b-c230-43f3-980c-10af8694a146'] Oct 04 21:56:46.940386 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:56:46.940386 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-4a7c7d03-4430-458f-925a-ff0b2e76e32b tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Returning 404 to user: Security group c1c7c16c-681f-40b3-a40e-7ed02207c2dd does not exist Oct 04 21:56:46.940386 n-d-860284-1 devstack@n-api.service[134101]: Neutron server returns request_ids: ['req-41d5f87b-c230-43f3-980c-10af8694a146'] {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:56:46.940386 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-4a7c7d03-4430-458f-925a-ff0b2e76e32b tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/c1c7c16c-681f-40b3-a40e-7ed02207c2dd" status: 404 len: 194 microversion: 2.1 time: 0.118175 Oct 04 21:56:46.944264 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1424/2931] 10.222.0.43 () {58 vars in 1272 bytes} [Tue Oct 4 21:56:46 2022] DELETE /compute/v2.1/os-security-groups/c1c7c16c-681f-40b3-a40e-7ed02207c2dd => generated 194 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:56:46.951781 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-555354a3-8d6e-44d1-b5fc-3a29fdb69180 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Calling method '.version_select at 0x7fbb2edffca0>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:47.031344 n-d-860284-1 devstack@n-api.service[134101]: DEBUG neutronclient.v2_0.client [None req-555354a3-8d6e-44d1-b5fc-3a29fdb69180 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group b9ec5d23-5d81-4cb1-b576-e917a2986031 does not exist", "detail": ""}} {{(pid=134101) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 21:56:47.032229 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.network.security_group_api [None req-555354a3-8d6e-44d1-b5fc-3a29fdb69180 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Neutron security group b9ec5d23-5d81-4cb1-b576-e917a2986031 not found {{(pid=134101) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 04 21:56:47.032929 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-555354a3-8d6e-44d1-b5fc-3a29fdb69180 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] HTTP exception thrown: Security group b9ec5d23-5d81-4cb1-b576-e917a2986031 does not exist Oct 04 21:56:47.032929 n-d-860284-1 devstack@n-api.service[134101]: Neutron server returns request_ids: ['req-8df9e856-dcef-42da-8eaa-14cca1030114'] Oct 04 21:56:47.035750 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-555354a3-8d6e-44d1-b5fc-3a29fdb69180 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Request method failure captured: Oct 04 21:56:47.035750 n-d-860284-1 devstack@n-api.service[134101]: request: DELETE /compute/v2.1/os-security-groups/b9ec5d23-5d81-4cb1-b576-e917a2986031 HTTP/1.1 Oct 04 21:56:47.035750 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 21:56:47.035750 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 21:56:47.035750 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 21:56:47.035750 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 21:56:47.035750 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 21:56:47.035750 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 21:56:47.035750 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 21:56:47.035750 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 21:56:47.035750 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPKu1qJNzwuxRWdc7rP7w0gQHhoDMvT1hi4W6OphaRxhVehI7YxkRLmiRVTEcrGE4_kLVYYR9CLMgNAOGQEVIUg5ptFWtgovLZ1WXY_454sRPkZoUaMXWYK1EaSOxzAsp1QFRpLX6-NPmD2kPLhLIPCnWZqTYS8blSXJvj9wIhro38mc Oct 04 21:56:47.035750 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 21:56:47.035750 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 21:56:47.035750 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 21:56:47.035750 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 21:56:47.035750 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 21:56:47.035750 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 21:56:47.035750 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: 51745fc19321469bb20afabe48b2185d Oct 04 21:56:47.035750 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-SecurityGroupsTestJSON-367911468 Oct 04 21:56:47.035750 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 21:56:47.035750 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 21:56:47.035750 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/51745fc19321469bb20afabe48b2185d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_51745fc19321469bb20afabe48b2185d", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/51745fc19321469bb20afabe48b2185d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/51745fc19321469bb20afabe48b2185d"}]}] Oct 04 21:56:47.035750 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-SecurityGroupsTestJSON-367911468 Oct 04 21:56:47.035750 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: 51745fc19321469bb20afabe48b2185d Oct 04 21:56:47.035750 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-367911468 Oct 04 21:56:47.035750 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-SecurityGroupsTestJSON-367911468-project Oct 04 21:56:47.035750 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 21:56:47.035750 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 21:56:47.035750 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 4cca65ba35b14db8bf2187188de8c838 Oct 04 21:56:47.035750 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-SecurityGroupsTestJSON-367911468-project Oct 04 21:56:47.035750 n-d-860284-1 devstack@n-api.service[134101]: method: Oct 04 21:56:47.035750 n-d-860284-1 devstack@n-api.service[134101]: exception: Security group b9ec5d23-5d81-4cb1-b576-e917a2986031 does not exist Oct 04 21:56:47.035750 n-d-860284-1 devstack@n-api.service[134101]: Neutron server returns request_ids: ['req-8df9e856-dcef-42da-8eaa-14cca1030114'] Oct 04 21:56:47.035750 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': 'b9ec5d23-5d81-4cb1-b576-e917a2986031'} Oct 04 21:56:47.035750 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:56:47.035750 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:56:47.035750 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 04 21:56:47.035750 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 04 21:56:47.035750 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:56:47.035750 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:56:47.035750 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 04 21:56:47.035750 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 04 21:56:47.035750 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:56:47.035750 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:56:47.035750 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 21:56:47.035750 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 21:56:47.035750 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:56:47.035750 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:56:47.035750 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 21:56:47.035750 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 21:56:47.035750 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:56:47.035750 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:56:47.035750 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 21:56:47.035750 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 21:56:47.035750 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:56:47.035750 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:56:47.035750 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 21:56:47.035750 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 21:56:47.035750 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 21:56:47.035750 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 21:56:47.035750 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group b9ec5d23-5d81-4cb1-b576-e917a2986031 does not exist Oct 04 21:56:47.041050 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8df9e856-dcef-42da-8eaa-14cca1030114'] Oct 04 21:56:47.041050 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:56:47.041050 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:56:47.041050 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:56:47.041050 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:56:47.041050 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 04 21:56:47.041050 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 04 21:56:47.041050 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 04 21:56:47.041050 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 21:56:47.041050 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group b9ec5d23-5d81-4cb1-b576-e917a2986031 does not exist Oct 04 21:56:47.041050 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8df9e856-dcef-42da-8eaa-14cca1030114'] Oct 04 21:56:47.041050 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:56:47.041050 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:56:47.041050 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:56:47.041050 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:56:47.041050 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:56:47.041050 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:56:47.041050 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:56:47.041050 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:56:47.041050 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:56:47.041050 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:56:47.041050 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:56:47.041050 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:56:47.041050 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 04 21:56:47.041050 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 21:56:47.041050 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group b9ec5d23-5d81-4cb1-b576-e917a2986031 does not exist Oct 04 21:56:47.041050 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8df9e856-dcef-42da-8eaa-14cca1030114'] Oct 04 21:56:47.041050 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:56:47.041050 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:56:47.041050 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:56:47.041050 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:56:47.041050 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:56:47.041050 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:56:47.041050 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:56:47.041050 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:56:47.041050 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group b9ec5d23-5d81-4cb1-b576-e917a2986031 does not exist Oct 04 21:56:47.041050 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8df9e856-dcef-42da-8eaa-14cca1030114'] Oct 04 21:56:47.041050 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:56:47.048759 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-555354a3-8d6e-44d1-b5fc-3a29fdb69180 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Returning 404 to user: Security group b9ec5d23-5d81-4cb1-b576-e917a2986031 does not exist Oct 04 21:56:47.048759 n-d-860284-1 devstack@n-api.service[134101]: Neutron server returns request_ids: ['req-8df9e856-dcef-42da-8eaa-14cca1030114'] {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:56:47.049526 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-555354a3-8d6e-44d1-b5fc-3a29fdb69180 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/b9ec5d23-5d81-4cb1-b576-e917a2986031" status: 404 len: 194 microversion: 2.1 time: 0.105564 Oct 04 21:56:47.054919 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1425/2932] 10.222.0.43 () {58 vars in 1272 bytes} [Tue Oct 4 21:56:46 2022] DELETE /compute/v2.1/os-security-groups/b9ec5d23-5d81-4cb1-b576-e917a2986031 => generated 194 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:56:47.067781 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-5eb3f3ac-66c2-49c9-9dd9-c87540dddd70 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Calling method '.version_select at 0x7fbb2e3039d0>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:47.154819 n-d-860284-1 devstack@n-api.service[134101]: DEBUG neutronclient.v2_0.client [None req-5eb3f3ac-66c2-49c9-9dd9-c87540dddd70 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group a7384102-cc16-4c29-9014-1ed2bfbe85f5 does not exist", "detail": ""}} {{(pid=134101) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 21:56:47.155874 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.network.security_group_api [None req-5eb3f3ac-66c2-49c9-9dd9-c87540dddd70 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Neutron security group a7384102-cc16-4c29-9014-1ed2bfbe85f5 not found {{(pid=134101) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 04 21:56:47.156904 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-5eb3f3ac-66c2-49c9-9dd9-c87540dddd70 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] HTTP exception thrown: Security group a7384102-cc16-4c29-9014-1ed2bfbe85f5 does not exist Oct 04 21:56:47.156904 n-d-860284-1 devstack@n-api.service[134101]: Neutron server returns request_ids: ['req-6a43be9f-d1b9-4894-b7d2-12ad618225a0'] Oct 04 21:56:47.160406 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-5eb3f3ac-66c2-49c9-9dd9-c87540dddd70 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Request method failure captured: Oct 04 21:56:47.160406 n-d-860284-1 devstack@n-api.service[134101]: request: DELETE /compute/v2.1/os-security-groups/a7384102-cc16-4c29-9014-1ed2bfbe85f5 HTTP/1.1 Oct 04 21:56:47.160406 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 21:56:47.160406 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 21:56:47.160406 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 21:56:47.160406 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 21:56:47.160406 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 21:56:47.160406 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 21:56:47.160406 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 21:56:47.160406 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 21:56:47.160406 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPKu1qJNzwuxRWdc7rP7w0gQHhoDMvT1hi4W6OphaRxhVehI7YxkRLmiRVTEcrGE4_kLVYYR9CLMgNAOGQEVIUg5ptFWtgovLZ1WXY_454sRPkZoUaMXWYK1EaSOxzAsp1QFRpLX6-NPmD2kPLhLIPCnWZqTYS8blSXJvj9wIhro38mc Oct 04 21:56:47.160406 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 21:56:47.160406 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 21:56:47.160406 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 21:56:47.160406 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 21:56:47.160406 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 21:56:47.160406 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 21:56:47.160406 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: 51745fc19321469bb20afabe48b2185d Oct 04 21:56:47.160406 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-SecurityGroupsTestJSON-367911468 Oct 04 21:56:47.160406 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 21:56:47.160406 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 21:56:47.160406 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/51745fc19321469bb20afabe48b2185d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_51745fc19321469bb20afabe48b2185d", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/51745fc19321469bb20afabe48b2185d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/51745fc19321469bb20afabe48b2185d"}]}] Oct 04 21:56:47.160406 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-SecurityGroupsTestJSON-367911468 Oct 04 21:56:47.160406 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: 51745fc19321469bb20afabe48b2185d Oct 04 21:56:47.160406 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-367911468 Oct 04 21:56:47.160406 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-SecurityGroupsTestJSON-367911468-project Oct 04 21:56:47.160406 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 21:56:47.160406 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 21:56:47.160406 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 4cca65ba35b14db8bf2187188de8c838 Oct 04 21:56:47.160406 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-SecurityGroupsTestJSON-367911468-project Oct 04 21:56:47.160406 n-d-860284-1 devstack@n-api.service[134101]: method: Oct 04 21:56:47.160406 n-d-860284-1 devstack@n-api.service[134101]: exception: Security group a7384102-cc16-4c29-9014-1ed2bfbe85f5 does not exist Oct 04 21:56:47.160406 n-d-860284-1 devstack@n-api.service[134101]: Neutron server returns request_ids: ['req-6a43be9f-d1b9-4894-b7d2-12ad618225a0'] Oct 04 21:56:47.160406 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': 'a7384102-cc16-4c29-9014-1ed2bfbe85f5'} Oct 04 21:56:47.160406 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:56:47.160406 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:56:47.160406 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 04 21:56:47.160406 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 04 21:56:47.160406 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:56:47.160406 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:56:47.160406 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 04 21:56:47.160406 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 04 21:56:47.160406 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:56:47.160406 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:56:47.160406 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 21:56:47.160406 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 21:56:47.160406 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:56:47.160406 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:56:47.160406 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 21:56:47.160406 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 21:56:47.160406 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:56:47.160406 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:56:47.160406 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 21:56:47.160406 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 21:56:47.160406 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:56:47.160406 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:56:47.160406 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 21:56:47.160406 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 21:56:47.160406 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 21:56:47.160406 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 21:56:47.160406 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group a7384102-cc16-4c29-9014-1ed2bfbe85f5 does not exist Oct 04 21:56:47.164263 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6a43be9f-d1b9-4894-b7d2-12ad618225a0'] Oct 04 21:56:47.164263 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:56:47.164263 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:56:47.164263 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:56:47.164263 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:56:47.164263 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 04 21:56:47.164263 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 04 21:56:47.164263 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 04 21:56:47.164263 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 21:56:47.164263 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group a7384102-cc16-4c29-9014-1ed2bfbe85f5 does not exist Oct 04 21:56:47.164263 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6a43be9f-d1b9-4894-b7d2-12ad618225a0'] Oct 04 21:56:47.164263 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:56:47.164263 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:56:47.164263 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:56:47.164263 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:56:47.164263 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:56:47.164263 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:56:47.164263 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:56:47.164263 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:56:47.164263 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:56:47.164263 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:56:47.164263 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:56:47.164263 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:56:47.164263 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 04 21:56:47.164263 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 21:56:47.164263 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group a7384102-cc16-4c29-9014-1ed2bfbe85f5 does not exist Oct 04 21:56:47.164263 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6a43be9f-d1b9-4894-b7d2-12ad618225a0'] Oct 04 21:56:47.164263 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:56:47.164263 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:56:47.164263 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:56:47.164263 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:56:47.164263 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:56:47.164263 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:56:47.164263 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:56:47.164263 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:56:47.164263 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group a7384102-cc16-4c29-9014-1ed2bfbe85f5 does not exist Oct 04 21:56:47.164263 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6a43be9f-d1b9-4894-b7d2-12ad618225a0'] Oct 04 21:56:47.164263 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:56:47.168814 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-5eb3f3ac-66c2-49c9-9dd9-c87540dddd70 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Returning 404 to user: Security group a7384102-cc16-4c29-9014-1ed2bfbe85f5 does not exist Oct 04 21:56:47.168814 n-d-860284-1 devstack@n-api.service[134101]: Neutron server returns request_ids: ['req-6a43be9f-d1b9-4894-b7d2-12ad618225a0'] {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:56:47.170233 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-5eb3f3ac-66c2-49c9-9dd9-c87540dddd70 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/a7384102-cc16-4c29-9014-1ed2bfbe85f5" status: 404 len: 194 microversion: 2.1 time: 0.113596 Oct 04 21:56:47.175392 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1426/2933] 10.222.0.43 () {58 vars in 1272 bytes} [Tue Oct 4 21:56:47 2022] DELETE /compute/v2.1/os-security-groups/a7384102-cc16-4c29-9014-1ed2bfbe85f5 => generated 194 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:56:47.181244 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-fa49838f-b276-4942-ae08-1e26622fefab tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Calling method '.version_select at 0x7fbb2e68dd30>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:47.250841 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-c269a54e-38b8-4518-b239-43e6746e79c1 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b45ebdb946b45c28fc4bca3dd5a3e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520782b7e0a94e3fb552744cc4584119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:56:47.265200 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-c269a54e-38b8-4518-b239-43e6746e79c1 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] 10.222.0.43 "GET /compute/v2.1/servers/db2a8355-6007-4f37-89e1-a45e7492618d" status: 200 len: 1464 microversion: 2.1 time: 0.592587 Oct 04 21:56:47.276420 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-fa49838f-b276-4942-ae08-1e26622fefab tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] 10.222.0.43 "GET /compute/v2.1/images/fc854dc3-25b4-4f91-a4ee-4aa1cce47c5b" status: 200 len: 1410 microversion: 2.1 time: 0.099450 Oct 04 21:56:47.286804 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1427/2934] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:56:47 2022] GET /compute/v2.1/images/fc854dc3-25b4-4f91-a4ee-4aa1cce47c5b => generated 1410 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:56:47.288504 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1508/2935] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:56:46 2022] GET /compute/v2.1/servers/db2a8355-6007-4f37-89e1-a45e7492618d => generated 1464 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:56:47.307627 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-bdae6fc3-f269-4b29-92a2-fc9938e7183c tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Calling method '.version_select at 0x7fbb2e303790>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:47.350303 n-d-860284-1 devstack@n-api.service[134101]: DEBUG neutronclient.v2_0.client [None req-bdae6fc3-f269-4b29-92a2-fc9938e7183c tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group b7245ff1-7be8-43a1-b2c8-453b7ec9e10b does not exist", "detail": ""}} {{(pid=134101) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 21:56:47.351576 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.network.security_group_api [None req-bdae6fc3-f269-4b29-92a2-fc9938e7183c tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Neutron security group b7245ff1-7be8-43a1-b2c8-453b7ec9e10b not found {{(pid=134101) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 04 21:56:47.352384 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-bdae6fc3-f269-4b29-92a2-fc9938e7183c tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] HTTP exception thrown: Security group b7245ff1-7be8-43a1-b2c8-453b7ec9e10b does not exist Oct 04 21:56:47.352384 n-d-860284-1 devstack@n-api.service[134101]: Neutron server returns request_ids: ['req-e5a3acc7-0788-4998-b40d-458b042cfd86'] Oct 04 21:56:47.356175 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-bdae6fc3-f269-4b29-92a2-fc9938e7183c tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Request method failure captured: Oct 04 21:56:47.356175 n-d-860284-1 devstack@n-api.service[134101]: request: DELETE /compute/v2.1/os-security-groups/b7245ff1-7be8-43a1-b2c8-453b7ec9e10b HTTP/1.1 Oct 04 21:56:47.356175 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 21:56:47.356175 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 21:56:47.356175 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 21:56:47.356175 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 21:56:47.356175 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 21:56:47.356175 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 21:56:47.356175 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 21:56:47.356175 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 21:56:47.356175 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPKu1qJNzwuxRWdc7rP7w0gQHhoDMvT1hi4W6OphaRxhVehI7YxkRLmiRVTEcrGE4_kLVYYR9CLMgNAOGQEVIUg5ptFWtgovLZ1WXY_454sRPkZoUaMXWYK1EaSOxzAsp1QFRpLX6-NPmD2kPLhLIPCnWZqTYS8blSXJvj9wIhro38mc Oct 04 21:56:47.356175 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 21:56:47.356175 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 21:56:47.356175 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 21:56:47.356175 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 21:56:47.356175 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 21:56:47.356175 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 21:56:47.356175 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: 51745fc19321469bb20afabe48b2185d Oct 04 21:56:47.356175 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-SecurityGroupsTestJSON-367911468 Oct 04 21:56:47.356175 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 21:56:47.356175 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 21:56:47.356175 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/51745fc19321469bb20afabe48b2185d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_51745fc19321469bb20afabe48b2185d", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/51745fc19321469bb20afabe48b2185d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/51745fc19321469bb20afabe48b2185d"}]}] Oct 04 21:56:47.356175 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-SecurityGroupsTestJSON-367911468 Oct 04 21:56:47.356175 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: 51745fc19321469bb20afabe48b2185d Oct 04 21:56:47.356175 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-367911468 Oct 04 21:56:47.356175 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-SecurityGroupsTestJSON-367911468-project Oct 04 21:56:47.356175 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 21:56:47.356175 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 21:56:47.356175 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 4cca65ba35b14db8bf2187188de8c838 Oct 04 21:56:47.356175 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-SecurityGroupsTestJSON-367911468-project Oct 04 21:56:47.356175 n-d-860284-1 devstack@n-api.service[134101]: method: Oct 04 21:56:47.356175 n-d-860284-1 devstack@n-api.service[134101]: exception: Security group b7245ff1-7be8-43a1-b2c8-453b7ec9e10b does not exist Oct 04 21:56:47.356175 n-d-860284-1 devstack@n-api.service[134101]: Neutron server returns request_ids: ['req-e5a3acc7-0788-4998-b40d-458b042cfd86'] Oct 04 21:56:47.356175 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': 'b7245ff1-7be8-43a1-b2c8-453b7ec9e10b'} Oct 04 21:56:47.356175 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:56:47.356175 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:56:47.356175 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 04 21:56:47.356175 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 04 21:56:47.356175 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:56:47.356175 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:56:47.356175 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 04 21:56:47.356175 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 04 21:56:47.356175 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:56:47.356175 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:56:47.356175 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 21:56:47.356175 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 21:56:47.356175 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:56:47.356175 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:56:47.356175 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 21:56:47.356175 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 21:56:47.356175 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:56:47.356175 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:56:47.356175 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 21:56:47.356175 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 21:56:47.356175 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:56:47.356175 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:56:47.356175 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 21:56:47.356175 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 21:56:47.356175 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 21:56:47.356175 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 21:56:47.356175 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group b7245ff1-7be8-43a1-b2c8-453b7ec9e10b does not exist Oct 04 21:56:47.360099 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e5a3acc7-0788-4998-b40d-458b042cfd86'] Oct 04 21:56:47.360099 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:56:47.360099 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:56:47.360099 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:56:47.360099 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:56:47.360099 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 04 21:56:47.360099 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 04 21:56:47.360099 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 04 21:56:47.360099 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 21:56:47.360099 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group b7245ff1-7be8-43a1-b2c8-453b7ec9e10b does not exist Oct 04 21:56:47.360099 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e5a3acc7-0788-4998-b40d-458b042cfd86'] Oct 04 21:56:47.360099 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:56:47.360099 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:56:47.360099 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:56:47.360099 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:56:47.360099 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:56:47.360099 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:56:47.360099 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:56:47.360099 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:56:47.360099 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:56:47.360099 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:56:47.360099 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:56:47.360099 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:56:47.360099 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 04 21:56:47.360099 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 21:56:47.360099 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group b7245ff1-7be8-43a1-b2c8-453b7ec9e10b does not exist Oct 04 21:56:47.360099 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e5a3acc7-0788-4998-b40d-458b042cfd86'] Oct 04 21:56:47.360099 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:56:47.360099 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:56:47.360099 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:56:47.360099 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:56:47.360099 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:56:47.360099 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:56:47.360099 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:56:47.360099 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:56:47.360099 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group b7245ff1-7be8-43a1-b2c8-453b7ec9e10b does not exist Oct 04 21:56:47.360099 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e5a3acc7-0788-4998-b40d-458b042cfd86'] Oct 04 21:56:47.360099 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:56:47.365228 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-bdae6fc3-f269-4b29-92a2-fc9938e7183c tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Returning 404 to user: Security group b7245ff1-7be8-43a1-b2c8-453b7ec9e10b does not exist Oct 04 21:56:47.365228 n-d-860284-1 devstack@n-api.service[134101]: Neutron server returns request_ids: ['req-e5a3acc7-0788-4998-b40d-458b042cfd86'] {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:56:47.366595 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-bdae6fc3-f269-4b29-92a2-fc9938e7183c tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/b7245ff1-7be8-43a1-b2c8-453b7ec9e10b" status: 404 len: 194 microversion: 2.1 time: 0.078454 Oct 04 21:56:47.370637 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1428/2936] 10.222.0.43 () {58 vars in 1272 bytes} [Tue Oct 4 21:56:47 2022] DELETE /compute/v2.1/os-security-groups/b7245ff1-7be8-43a1-b2c8-453b7ec9e10b => generated 194 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:56:47.380349 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-0bb4ea9f-f8f3-4e83-8ef8-cf816312d0d0 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:47.380965 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-0bb4ea9f-f8f3-4e83-8ef8-cf816312d0d0 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] [instance: e8900fd4-88c2-4800-baba-124e8ed0eac3] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:56:47.405366 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0bb4ea9f-f8f3-4e83-8ef8-cf816312d0d0 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:47.407043 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0bb4ea9f-f8f3-4e83-8ef8-cf816312d0d0 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:47.407522 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0bb4ea9f-f8f3-4e83-8ef8-cf816312d0d0 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:47.408293 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0bb4ea9f-f8f3-4e83-8ef8-cf816312d0d0 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:47.415052 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0bb4ea9f-f8f3-4e83-8ef8-cf816312d0d0 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:47.415605 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0bb4ea9f-f8f3-4e83-8ef8-cf816312d0d0 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:47.577043 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-0bb4ea9f-f8f3-4e83-8ef8-cf816312d0d0 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] [instance: e8900fd4-88c2-4800-baba-124e8ed0eac3] Going to try to terminate instance {{(pid=134102) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:56:47.902242 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:56:48.018435 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-0bb4ea9f-f8f3-4e83-8ef8-cf816312d0d0 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] 10.222.0.43 "DELETE /compute/v2.1/servers/e8900fd4-88c2-4800-baba-124e8ed0eac3" status: 204 len: 0 microversion: 2.1 time: 0.646139 Oct 04 21:56:48.022689 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1509/2937] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 21:56:47 2022] DELETE /compute/v2.1/servers/e8900fd4-88c2-4800-baba-124e8ed0eac3 => generated 0 bytes in 651 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:56:48.031838 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-a9ce9685-9f76-43d8-86e2-5c78872149be tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:48.032781 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-a9ce9685-9f76-43d8-86e2-5c78872149be tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] [instance: e8900fd4-88c2-4800-baba-124e8ed0eac3] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:56:48.083450 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a9ce9685-9f76-43d8-86e2-5c78872149be tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:48.093011 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a9ce9685-9f76-43d8-86e2-5c78872149be tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:48.094887 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a9ce9685-9f76-43d8-86e2-5c78872149be tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:48.100900 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a9ce9685-9f76-43d8-86e2-5c78872149be tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:48.105530 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a9ce9685-9f76-43d8-86e2-5c78872149be tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:48.109113 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a9ce9685-9f76-43d8-86e2-5c78872149be tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:48.312523 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-de8a638e-1e53-47d7-b65d-76db98a8cfd2 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Calling method '.version_select at 0x7fbb2e6468b0>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:48.437928 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-de8a638e-1e53-47d7-b65d-76db98a8cfd2 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] 10.222.0.43 "GET /compute/v2.1/images/fc854dc3-25b4-4f91-a4ee-4aa1cce47c5b" status: 200 len: 1410 microversion: 2.1 time: 0.147414 Oct 04 21:56:48.444036 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1510/2938] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:56:48 2022] GET /compute/v2.1/images/fc854dc3-25b4-4f91-a4ee-4aa1cce47c5b => generated 1410 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:56:48.460313 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-9859f5a3-d5c6-48e9-94a8-495b31d59b5f tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:48.468193 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-9859f5a3-d5c6-48e9-94a8-495b31d59b5f tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] [instance: db2a8355-6007-4f37-89e1-a45e7492618d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:56:48.488089 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9859f5a3-d5c6-48e9-94a8-495b31d59b5f tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:48.494356 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9859f5a3-d5c6-48e9-94a8-495b31d59b5f tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:48.495122 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9859f5a3-d5c6-48e9-94a8-495b31d59b5f tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:48.496180 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9859f5a3-d5c6-48e9-94a8-495b31d59b5f tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:48.497405 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9859f5a3-d5c6-48e9-94a8-495b31d59b5f tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:48.499264 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9859f5a3-d5c6-48e9-94a8-495b31d59b5f tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:48.839943 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-a9ce9685-9f76-43d8-86e2-5c78872149be tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cca65ba35b14db8bf2187188de8c838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51745fc19321469bb20afabe48b2185d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:56:48.874402 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-a9ce9685-9f76-43d8-86e2-5c78872149be tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] 10.222.0.43 "GET /compute/v2.1/servers/e8900fd4-88c2-4800-baba-124e8ed0eac3" status: 200 len: 1648 microversion: 2.1 time: 0.847696 Oct 04 21:56:48.875743 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1429/2939] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:56:48 2022] GET /compute/v2.1/servers/e8900fd4-88c2-4800-baba-124e8ed0eac3 => generated 1648 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:56:49.382669 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-9859f5a3-d5c6-48e9-94a8-495b31d59b5f tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b45ebdb946b45c28fc4bca3dd5a3e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520782b7e0a94e3fb552744cc4584119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:56:49.394141 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-9859f5a3-d5c6-48e9-94a8-495b31d59b5f tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] 10.222.0.43 "GET /compute/v2.1/servers/db2a8355-6007-4f37-89e1-a45e7492618d" status: 200 len: 1464 microversion: 2.1 time: 0.947896 Oct 04 21:56:49.406242 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1511/2940] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:56:48 2022] GET /compute/v2.1/servers/db2a8355-6007-4f37-89e1-a45e7492618d => generated 1464 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:56:49.454414 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-bfe77130-7732-47d0-89b1-3123accecb52 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Calling method '.version_select at 0x7fbb2e35f280>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:49.559943 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-bfe77130-7732-47d0-89b1-3123accecb52 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] 10.222.0.43 "GET /compute/v2.1/images/fc854dc3-25b4-4f91-a4ee-4aa1cce47c5b" status: 200 len: 1410 microversion: 2.1 time: 0.109457 Oct 04 21:56:49.560790 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1430/2941] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:56:49 2022] GET /compute/v2.1/images/fc854dc3-25b4-4f91-a4ee-4aa1cce47c5b => generated 1410 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:56:49.904940 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-e1413917-a086-4d6b-8e3b-01068a1534b2 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:49.905570 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-e1413917-a086-4d6b-8e3b-01068a1534b2 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] [instance: e8900fd4-88c2-4800-baba-124e8ed0eac3] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:56:49.929767 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e1413917-a086-4d6b-8e3b-01068a1534b2 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:49.930275 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e1413917-a086-4d6b-8e3b-01068a1534b2 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:49.939053 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e1413917-a086-4d6b-8e3b-01068a1534b2 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:49.939870 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e1413917-a086-4d6b-8e3b-01068a1534b2 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:49.946800 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e1413917-a086-4d6b-8e3b-01068a1534b2 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:49.947363 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e1413917-a086-4d6b-8e3b-01068a1534b2 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:50.449371 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-7f592453-7e9c-48a1-be19-90dd9cfa470f tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:50.450631 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-7f592453-7e9c-48a1-be19-90dd9cfa470f tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] [instance: db2a8355-6007-4f37-89e1-a45e7492618d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:56:50.475463 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7f592453-7e9c-48a1-be19-90dd9cfa470f tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:50.478892 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7f592453-7e9c-48a1-be19-90dd9cfa470f tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:50.479714 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7f592453-7e9c-48a1-be19-90dd9cfa470f tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:50.480798 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7f592453-7e9c-48a1-be19-90dd9cfa470f tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:50.483395 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7f592453-7e9c-48a1-be19-90dd9cfa470f tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:50.488409 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7f592453-7e9c-48a1-be19-90dd9cfa470f tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:51.598053 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-e1413917-a086-4d6b-8e3b-01068a1534b2 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cca65ba35b14db8bf2187188de8c838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51745fc19321469bb20afabe48b2185d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:56:51.612098 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-e1413917-a086-4d6b-8e3b-01068a1534b2 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] 10.222.0.43 "GET /compute/v2.1/servers/e8900fd4-88c2-4800-baba-124e8ed0eac3" status: 200 len: 1648 microversion: 2.1 time: 1.711653 Oct 04 21:56:51.613010 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1512/2942] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:56:49 2022] GET /compute/v2.1/servers/e8900fd4-88c2-4800-baba-124e8ed0eac3 => generated 1648 bytes in 1714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:56:51.624957 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-c9eebfa6-5552-42d2-bee2-1bff4dbce384 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Calling method '.version_select at 0x7fbb2e821940>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:51.736638 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-c9eebfa6-5552-42d2-bee2-1bff4dbce384 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] 10.222.0.43 "GET /compute/v2.1/images/fc854dc3-25b4-4f91-a4ee-4aa1cce47c5b" status: 200 len: 1410 microversion: 2.1 time: 0.122205 Oct 04 21:56:51.737440 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1513/2943] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:56:51 2022] GET /compute/v2.1/images/fc854dc3-25b4-4f91-a4ee-4aa1cce47c5b => generated 1410 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:56:52.637320 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-967c4dae-afc6-4538-8101-ecebc770cd66 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:52.638863 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-967c4dae-afc6-4538-8101-ecebc770cd66 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] [instance: e8900fd4-88c2-4800-baba-124e8ed0eac3] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:56:52.653150 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=3,nova_api:UPDATE=2 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:56:52.655105 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-967c4dae-afc6-4538-8101-ecebc770cd66 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:52.656950 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-967c4dae-afc6-4538-8101-ecebc770cd66 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:52.659041 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-967c4dae-afc6-4538-8101-ecebc770cd66 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:52.661890 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-967c4dae-afc6-4538-8101-ecebc770cd66 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:52.666918 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-967c4dae-afc6-4538-8101-ecebc770cd66 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:52.668022 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-967c4dae-afc6-4538-8101-ecebc770cd66 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:53.274972 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=2 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:56:53.306599 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=2 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:56:54.337164 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-7f592453-7e9c-48a1-be19-90dd9cfa470f tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b45ebdb946b45c28fc4bca3dd5a3e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520782b7e0a94e3fb552744cc4584119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:56:54.363773 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-7f592453-7e9c-48a1-be19-90dd9cfa470f tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] 10.222.0.43 "GET /compute/v2.1/servers/db2a8355-6007-4f37-89e1-a45e7492618d" status: 200 len: 1464 microversion: 2.1 time: 3.915030 Oct 04 21:56:54.368302 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1431/2944] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:56:50 2022] GET /compute/v2.1/servers/db2a8355-6007-4f37-89e1-a45e7492618d => generated 1464 bytes in 3924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:56:54.394997 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-8bc88d25-82c1-470b-a523-b75bc99dc580 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Calling method '.version_select at 0x7fbb2e348280>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:54.581413 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-8bc88d25-82c1-470b-a523-b75bc99dc580 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] 10.222.0.43 "GET /compute/v2.1/images/fc854dc3-25b4-4f91-a4ee-4aa1cce47c5b" status: 200 len: 1410 microversion: 2.1 time: 0.207255 Oct 04 21:56:54.587894 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1432/2945] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:56:54 2022] GET /compute/v2.1/images/fc854dc3-25b4-4f91-a4ee-4aa1cce47c5b => generated 1410 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:56:54.591951 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-967c4dae-afc6-4538-8101-ecebc770cd66 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cca65ba35b14db8bf2187188de8c838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51745fc19321469bb20afabe48b2185d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:56:54.616573 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-8bb68517-1da8-48ef-b680-c98fe86c2a25 req-6eb55b34-91f8-45c7-a781-b7cea9ebf467 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8900fd4-88c2-4800-baba-124e8ed0eac3", "name": "network-vif-unplugged", "status": "completed", "tag": "958c011c-e3f5-4671-8e25-056b9b11ecfc"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:56:54.651181 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-967c4dae-afc6-4538-8101-ecebc770cd66 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] 10.222.0.43 "GET /compute/v2.1/servers/e8900fd4-88c2-4800-baba-124e8ed0eac3" status: 200 len: 1648 microversion: 2.1 time: 2.016346 Oct 04 21:56:54.653545 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1514/2946] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:56:52 2022] GET /compute/v2.1/servers/e8900fd4-88c2-4800-baba-124e8ed0eac3 => generated 1648 bytes in 2021 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:56:54.673784 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-8bb68517-1da8-48ef-b680-c98fe86c2a25 req-6eb55b34-91f8-45c7-a781-b7cea9ebf467 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:54.678018 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-8bb68517-1da8-48ef-b680-c98fe86c2a25 req-6eb55b34-91f8-45c7-a781-b7cea9ebf467 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:54.679215 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-8bb68517-1da8-48ef-b680-c98fe86c2a25 req-6eb55b34-91f8-45c7-a781-b7cea9ebf467 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:54.755137 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-79b0506f-c4dc-4628-bc64-a4f6e6314ee3 req-70bdd0ef-faa3-4012-b80c-8ad64955b45b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db2a8355-6007-4f37-89e1-a45e7492618d", "name": "network-vif-deleted", "tag": "3a4439f9-2712-4c8b-a461-2b7c04cc5978"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:56:54.773157 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-8bb68517-1da8-48ef-b680-c98fe86c2a25 req-6eb55b34-91f8-45c7-a781-b7cea9ebf467 service nova] Creating event network-vif-unplugged:958c011c-e3f5-4671-8e25-056b9b11ecfc for instance e8900fd4-88c2-4800-baba-124e8ed0eac3 on n-h2-860284-1 Oct 04 21:56:54.785782 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell0:SELECT=4 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:56:54.796845 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-8bb68517-1da8-48ef-b680-c98fe86c2a25 req-6eb55b34-91f8-45c7-a781-b7cea9ebf467 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.204693 Oct 04 21:56:54.799510 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1433/2947] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:56:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:56:54.848704 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-79b0506f-c4dc-4628-bc64-a4f6e6314ee3 req-70bdd0ef-faa3-4012-b80c-8ad64955b45b service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:54.857449 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-79b0506f-c4dc-4628-bc64-a4f6e6314ee3 req-70bdd0ef-faa3-4012-b80c-8ad64955b45b service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:54.862519 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-79b0506f-c4dc-4628-bc64-a4f6e6314ee3 req-70bdd0ef-faa3-4012-b80c-8ad64955b45b service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:54.915307 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-79b0506f-c4dc-4628-bc64-a4f6e6314ee3 req-70bdd0ef-faa3-4012-b80c-8ad64955b45b service nova] Creating event network-vif-deleted:3a4439f9-2712-4c8b-a461-2b7c04cc5978 for instance db2a8355-6007-4f37-89e1-a45e7492618d on n-h1-860284-1 Oct 04 21:56:54.931870 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-79b0506f-c4dc-4628-bc64-a4f6e6314ee3 req-70bdd0ef-faa3-4012-b80c-8ad64955b45b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.184209 Oct 04 21:56:54.933295 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1515/2948] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:56:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:56:55.405542 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-c95a2356-f05a-43e9-875a-596a0a8dbbfc tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:55.412462 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-c95a2356-f05a-43e9-875a-596a0a8dbbfc tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] [instance: db2a8355-6007-4f37-89e1-a45e7492618d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:56:55.437797 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c95a2356-f05a-43e9-875a-596a0a8dbbfc tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:55.438312 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c95a2356-f05a-43e9-875a-596a0a8dbbfc tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:55.443154 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c95a2356-f05a-43e9-875a-596a0a8dbbfc tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:55.444239 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c95a2356-f05a-43e9-875a-596a0a8dbbfc tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:55.449510 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c95a2356-f05a-43e9-875a-596a0a8dbbfc tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:55.449990 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c95a2356-f05a-43e9-875a-596a0a8dbbfc tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:55.599637 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c95a2356-f05a-43e9-875a-596a0a8dbbfc tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:55.601198 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-e2f281d7-9276-4185-b13d-2b8e17bbdc66 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Calling method '.version_select at 0x7fbb2e826c10>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:55.620392 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c95a2356-f05a-43e9-875a-596a0a8dbbfc tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:55.624678 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c95a2356-f05a-43e9-875a-596a0a8dbbfc tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:55.625431 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.objects.instance [None req-c95a2356-f05a-43e9-875a-596a0a8dbbfc tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Lazy-loading 'fault' on Instance uuid db2a8355-6007-4f37-89e1-a45e7492618d {{(pid=134101) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:56:55.637993 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell0:SELECT=2 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:56:55.764261 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-e2f281d7-9276-4185-b13d-2b8e17bbdc66 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] 10.222.0.43 "GET /compute/v2.1/images/fc854dc3-25b4-4f91-a4ee-4aa1cce47c5b" status: 200 len: 1410 microversion: 2.1 time: 0.168198 Oct 04 21:56:55.768850 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1516/2949] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:56:55 2022] GET /compute/v2.1/images/fc854dc3-25b4-4f91-a4ee-4aa1cce47c5b => generated 1410 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:56:55.795531 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-a3dba838-ea00-4e9f-8784-59a408484657 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:55.796660 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-a3dba838-ea00-4e9f-8784-59a408484657 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] [instance: e8900fd4-88c2-4800-baba-124e8ed0eac3] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:56:55.824934 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a3dba838-ea00-4e9f-8784-59a408484657 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:55.825969 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a3dba838-ea00-4e9f-8784-59a408484657 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:55.826623 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a3dba838-ea00-4e9f-8784-59a408484657 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:55.831550 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a3dba838-ea00-4e9f-8784-59a408484657 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:55.834508 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a3dba838-ea00-4e9f-8784-59a408484657 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:55.835457 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a3dba838-ea00-4e9f-8784-59a408484657 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:55.932509 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-c95a2356-f05a-43e9-875a-596a0a8dbbfc tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b45ebdb946b45c28fc4bca3dd5a3e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520782b7e0a94e3fb552744cc4584119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:56:55.946135 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-c95a2356-f05a-43e9-875a-596a0a8dbbfc tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] 10.222.0.43 "GET /compute/v2.1/servers/db2a8355-6007-4f37-89e1-a45e7492618d" status: 200 len: 1308 microversion: 2.1 time: 0.553172 Oct 04 21:56:55.957917 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1434/2950] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:56:55 2022] GET /compute/v2.1/servers/db2a8355-6007-4f37-89e1-a45e7492618d => generated 1308 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:56:56.280852 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-a3dba838-ea00-4e9f-8784-59a408484657 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cca65ba35b14db8bf2187188de8c838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51745fc19321469bb20afabe48b2185d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:56:56.305216 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-a3dba838-ea00-4e9f-8784-59a408484657 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] 10.222.0.43 "GET /compute/v2.1/servers/e8900fd4-88c2-4800-baba-124e8ed0eac3" status: 200 len: 1301 microversion: 2.1 time: 0.528884 Oct 04 21:56:56.308381 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1517/2951] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:56:55 2022] GET /compute/v2.1/servers/e8900fd4-88c2-4800-baba-124e8ed0eac3 => generated 1301 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:56:56.785750 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-55bf9885-46a7-4391-82ee-c3db7f42c99d tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Calling method '.version_select at 0x7fbb2e307b80>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:56.894634 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-55bf9885-46a7-4391-82ee-c3db7f42c99d tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] 10.222.0.43 "GET /compute/v2.1/images/fc854dc3-25b4-4f91-a4ee-4aa1cce47c5b" status: 200 len: 1410 microversion: 2.1 time: 0.113688 Oct 04 21:56:56.895543 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1435/2952] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:56:56 2022] GET /compute/v2.1/images/fc854dc3-25b4-4f91-a4ee-4aa1cce47c5b => generated 1410 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:56:56.988883 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-e8e9eab9-9e1c-4e78-8b63-d7009459539d tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:56.990279 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-e8e9eab9-9e1c-4e78-8b63-d7009459539d tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] [instance: db2a8355-6007-4f37-89e1-a45e7492618d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:56:57.021893 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e8e9eab9-9e1c-4e78-8b63-d7009459539d tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:57.027707 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e8e9eab9-9e1c-4e78-8b63-d7009459539d tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:57.028516 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e8e9eab9-9e1c-4e78-8b63-d7009459539d tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:57.029310 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e8e9eab9-9e1c-4e78-8b63-d7009459539d tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:57.029787 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e8e9eab9-9e1c-4e78-8b63-d7009459539d tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:57.030228 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e8e9eab9-9e1c-4e78-8b63-d7009459539d tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:57.115442 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-e8e9eab9-9e1c-4e78-8b63-d7009459539d tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] HTTP exception thrown: Instance db2a8355-6007-4f37-89e1-a45e7492618d could not be found. Oct 04 21:56:57.121306 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-e8e9eab9-9e1c-4e78-8b63-d7009459539d tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Request method failure captured: Oct 04 21:56:57.121306 n-d-860284-1 devstack@n-api.service[134102]: request: GET /compute/v2.1/servers/db2a8355-6007-4f37-89e1-a45e7492618d HTTP/1.1 Oct 04 21:56:57.121306 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 21:56:57.121306 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 21:56:57.121306 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 21:56:57.121306 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 21:56:57.121306 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 21:56:57.121306 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 21:56:57.121306 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 21:56:57.121306 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 21:56:57.121306 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPKveJ8OAEZcy8hW-LjIusFhYFBUWu2tLD_yUnjiX8SUiLdWetP5uuYFeQ6IgcZFk7-IyZdTp9Y68VSfMAaIy8wZC342f6nUCCKtcwKZgCFJFnh0NUkguMMzzTpZDHMfHqgIXtdMblhRRicrhKtlmYGb_qO9K7pynlqgGsV9eIYUFMCA Oct 04 21:56:57.121306 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 21:56:57.121306 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 21:56:57.121306 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 21:56:57.121306 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 21:56:57.121306 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 21:56:57.121306 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 21:56:57.121306 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: 520782b7e0a94e3fb552744cc4584119 Oct 04 21:56:57.121306 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-LiveMigrationNegativeTest-362520990 Oct 04 21:56:57.121306 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 21:56:57.121306 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 21:56:57.121306 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/520782b7e0a94e3fb552744cc4584119"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_520782b7e0a94e3fb552744cc4584119", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/520782b7e0a94e3fb552744cc4584119"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/520782b7e0a94e3fb552744cc4584119"}]}] Oct 04 21:56:57.121306 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-LiveMigrationNegativeTest-362520990 Oct 04 21:56:57.121306 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: 520782b7e0a94e3fb552744cc4584119 Oct 04 21:56:57.121306 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-362520990 Oct 04 21:56:57.121306 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-LiveMigrationNegativeTest-362520990-project Oct 04 21:56:57.121306 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 21:56:57.121306 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 21:56:57.121306 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: 7b45ebdb946b45c28fc4bca3dd5a3e5b Oct 04 21:56:57.121306 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-LiveMigrationNegativeTest-362520990-project Oct 04 21:56:57.121306 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 21:56:57.121306 n-d-860284-1 devstack@n-api.service[134102]: exception: Instance db2a8355-6007-4f37-89e1-a45e7492618d could not be found. Oct 04 21:56:57.121306 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': 'db2a8355-6007-4f37-89e1-a45e7492618d'} Oct 04 21:56:57.121306 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:56:57.121306 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:56:57.121306 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:56:57.121306 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:56:57.121306 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:56:57.121306 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:56:57.121306 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:56:57.121306 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:56:57.121306 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:56:57.121306 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:56:57.121306 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db2a8355-6007-4f37-89e1-a45e7492618d could not be found. Oct 04 21:56:57.121306 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:56:57.121306 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:56:57.121306 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:56:57.121306 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:56:57.121306 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:56:57.121306 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:56:57.121306 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:56:57.121306 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:56:57.121306 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:56:57.121306 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:56:57.121306 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:56:57.121306 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:56:57.121306 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:56:57.121306 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:56:57.121306 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:56:57.121306 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:56:57.121306 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db2a8355-6007-4f37-89e1-a45e7492618d could not be found. Oct 04 21:56:57.121306 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:56:57.121306 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:56:57.121306 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:56:57.130527 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:56:57.130527 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:56:57.130527 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:56:57.130527 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:56:57.130527 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:56:57.130527 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db2a8355-6007-4f37-89e1-a45e7492618d could not be found. Oct 04 21:56:57.130527 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:56:57.130527 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-e8e9eab9-9e1c-4e78-8b63-d7009459539d tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Returning 404 to user: Instance db2a8355-6007-4f37-89e1-a45e7492618d could not be found. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:56:57.130527 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-e8e9eab9-9e1c-4e78-8b63-d7009459539d tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] 10.222.0.43 "GET /compute/v2.1/servers/db2a8355-6007-4f37-89e1-a45e7492618d" status: 404 len: 111 microversion: 2.1 time: 0.139987 Oct 04 21:56:57.130527 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1518/2953] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:56:56 2022] GET /compute/v2.1/servers/db2a8355-6007-4f37-89e1-a45e7492618d => generated 111 bytes in 144 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:56:57.134938 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-7c8b5e84-8004-4afc-9aba-ad2cbd74a33e tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:57.135453 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-7c8b5e84-8004-4afc-9aba-ad2cbd74a33e tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] [instance: 4b3f3cb9-cdd4-4881-923f-bb3447b249b9] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:56:57.153426 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7c8b5e84-8004-4afc-9aba-ad2cbd74a33e tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:57.153963 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7c8b5e84-8004-4afc-9aba-ad2cbd74a33e tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:57.160361 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7c8b5e84-8004-4afc-9aba-ad2cbd74a33e tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:57.162324 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7c8b5e84-8004-4afc-9aba-ad2cbd74a33e tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:57.168075 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7c8b5e84-8004-4afc-9aba-ad2cbd74a33e tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:57.168853 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7c8b5e84-8004-4afc-9aba-ad2cbd74a33e tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:57.222722 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-8bc5b564-485e-42d5-90a3-eb08eb823a76 req-c8b95fe8-8d1f-4287-8888-344bffbd9b20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8900fd4-88c2-4800-baba-124e8ed0eac3", "name": "network-vif-deleted", "tag": "958c011c-e3f5-4671-8e25-056b9b11ecfc"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:56:57.254990 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-8bc5b564-485e-42d5-90a3-eb08eb823a76 req-c8b95fe8-8d1f-4287-8888-344bffbd9b20 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:57.255499 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-8bc5b564-485e-42d5-90a3-eb08eb823a76 req-c8b95fe8-8d1f-4287-8888-344bffbd9b20 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:57.255948 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-8bc5b564-485e-42d5-90a3-eb08eb823a76 req-c8b95fe8-8d1f-4287-8888-344bffbd9b20 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:57.293845 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-7c8b5e84-8004-4afc-9aba-ad2cbd74a33e tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] [instance: 4b3f3cb9-cdd4-4881-923f-bb3447b249b9] Going to try to terminate instance {{(pid=134101) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:56:57.310969 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-8bc5b564-485e-42d5-90a3-eb08eb823a76 req-c8b95fe8-8d1f-4287-8888-344bffbd9b20 service nova] Creating event network-vif-deleted:958c011c-e3f5-4671-8e25-056b9b11ecfc for instance e8900fd4-88c2-4800-baba-124e8ed0eac3 on n-h2-860284-1 Oct 04 21:56:57.328669 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-8bc5b564-485e-42d5-90a3-eb08eb823a76 req-c8b95fe8-8d1f-4287-8888-344bffbd9b20 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109917 Oct 04 21:56:57.337193 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1519/2954] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:56:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:56:57.355100 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-f7d136fd-89d6-4e39-8405-48688916a6fd tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:57.355824 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-f7d136fd-89d6-4e39-8405-48688916a6fd tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] [instance: e8900fd4-88c2-4800-baba-124e8ed0eac3] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:56:57.378233 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f7d136fd-89d6-4e39-8405-48688916a6fd tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:57.387316 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f7d136fd-89d6-4e39-8405-48688916a6fd tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:57.387802 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f7d136fd-89d6-4e39-8405-48688916a6fd tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:57.388559 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f7d136fd-89d6-4e39-8405-48688916a6fd tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:57.389047 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f7d136fd-89d6-4e39-8405-48688916a6fd tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:57.389490 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f7d136fd-89d6-4e39-8405-48688916a6fd tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:57.449795 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-f7d136fd-89d6-4e39-8405-48688916a6fd tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] HTTP exception thrown: Instance e8900fd4-88c2-4800-baba-124e8ed0eac3 could not be found. Oct 04 21:56:57.464285 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-f7d136fd-89d6-4e39-8405-48688916a6fd tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Request method failure captured: Oct 04 21:56:57.464285 n-d-860284-1 devstack@n-api.service[134102]: request: GET /compute/v2.1/servers/e8900fd4-88c2-4800-baba-124e8ed0eac3 HTTP/1.1 Oct 04 21:56:57.464285 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 21:56:57.464285 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 21:56:57.464285 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 21:56:57.464285 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 21:56:57.464285 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 21:56:57.464285 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 21:56:57.464285 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 21:56:57.464285 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 21:56:57.464285 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPKu1qJNzwuxRWdc7rP7w0gQHhoDMvT1hi4W6OphaRxhVehI7YxkRLmiRVTEcrGE4_kLVYYR9CLMgNAOGQEVIUg5ptFWtgovLZ1WXY_454sRPkZoUaMXWYK1EaSOxzAsp1QFRpLX6-NPmD2kPLhLIPCnWZqTYS8blSXJvj9wIhro38mc Oct 04 21:56:57.464285 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 21:56:57.464285 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 21:56:57.464285 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 21:56:57.464285 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 21:56:57.464285 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 21:56:57.464285 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 21:56:57.464285 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: 51745fc19321469bb20afabe48b2185d Oct 04 21:56:57.464285 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-SecurityGroupsTestJSON-367911468 Oct 04 21:56:57.464285 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 21:56:57.464285 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 21:56:57.464285 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/51745fc19321469bb20afabe48b2185d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_51745fc19321469bb20afabe48b2185d", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/51745fc19321469bb20afabe48b2185d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/51745fc19321469bb20afabe48b2185d"}]}] Oct 04 21:56:57.464285 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-SecurityGroupsTestJSON-367911468 Oct 04 21:56:57.464285 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: 51745fc19321469bb20afabe48b2185d Oct 04 21:56:57.464285 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-367911468 Oct 04 21:56:57.464285 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-SecurityGroupsTestJSON-367911468-project Oct 04 21:56:57.464285 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 21:56:57.464285 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 21:56:57.464285 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: 4cca65ba35b14db8bf2187188de8c838 Oct 04 21:56:57.464285 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-SecurityGroupsTestJSON-367911468-project Oct 04 21:56:57.464285 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 21:56:57.464285 n-d-860284-1 devstack@n-api.service[134102]: exception: Instance e8900fd4-88c2-4800-baba-124e8ed0eac3 could not be found. Oct 04 21:56:57.464285 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': 'e8900fd4-88c2-4800-baba-124e8ed0eac3'} Oct 04 21:56:57.464285 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:56:57.464285 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:56:57.464285 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:56:57.464285 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:56:57.464285 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:56:57.464285 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:56:57.464285 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:56:57.464285 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:56:57.464285 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:56:57.464285 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:56:57.464285 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8900fd4-88c2-4800-baba-124e8ed0eac3 could not be found. Oct 04 21:56:57.464285 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:56:57.464285 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:56:57.464285 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:56:57.464285 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:56:57.464285 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:56:57.464285 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:56:57.464285 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:56:57.464285 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:56:57.464285 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:56:57.464285 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:56:57.464285 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:56:57.464285 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:56:57.464285 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:56:57.464285 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:56:57.464285 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:56:57.464285 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:56:57.464285 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8900fd4-88c2-4800-baba-124e8ed0eac3 could not be found. Oct 04 21:56:57.464285 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:56:57.464285 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:56:57.464285 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:56:57.469594 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:56:57.469594 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:56:57.469594 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:56:57.469594 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:56:57.469594 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:56:57.469594 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8900fd4-88c2-4800-baba-124e8ed0eac3 could not be found. Oct 04 21:56:57.469594 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:56:57.469594 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-f7d136fd-89d6-4e39-8405-48688916a6fd tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Returning 404 to user: Instance e8900fd4-88c2-4800-baba-124e8ed0eac3 could not be found. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:56:57.469594 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-f7d136fd-89d6-4e39-8405-48688916a6fd tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] 10.222.0.43 "GET /compute/v2.1/servers/e8900fd4-88c2-4800-baba-124e8ed0eac3" status: 404 len: 111 microversion: 2.1 time: 0.127537 Oct 04 21:56:57.472485 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1520/2955] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:56:57 2022] GET /compute/v2.1/servers/e8900fd4-88c2-4800-baba-124e8ed0eac3 => generated 111 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:56:57.503285 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-8412c6ed-c739-4ede-bc43-6bd0fa53f004 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Calling method '.version_select at 0x7fbb2e6b8940>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:57.593222 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-7c8b5e84-8004-4afc-9aba-ad2cbd74a33e tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] 10.222.0.43 "DELETE /compute/v2.1/servers/4b3f3cb9-cdd4-4881-923f-bb3447b249b9" status: 204 len: 0 microversion: 2.1 time: 0.461913 Oct 04 21:56:57.595678 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1436/2956] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 21:56:57 2022] DELETE /compute/v2.1/servers/4b3f3cb9-cdd4-4881-923f-bb3447b249b9 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:56:57.614040 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-942774a4-6a1e-468e-a284-673f9381a175 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:57.620668 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-942774a4-6a1e-468e-a284-673f9381a175 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] [instance: 4b3f3cb9-cdd4-4881-923f-bb3447b249b9] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:56:57.636886 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-942774a4-6a1e-468e-a284-673f9381a175 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:57.637516 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-942774a4-6a1e-468e-a284-673f9381a175 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:57.637964 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-942774a4-6a1e-468e-a284-673f9381a175 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:57.642760 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-942774a4-6a1e-468e-a284-673f9381a175 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:57.644072 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-942774a4-6a1e-468e-a284-673f9381a175 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:57.644865 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-942774a4-6a1e-468e-a284-673f9381a175 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:58.651861 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-942774a4-6a1e-468e-a284-673f9381a175 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b45ebdb946b45c28fc4bca3dd5a3e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520782b7e0a94e3fb552744cc4584119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:56:58.661016 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-942774a4-6a1e-468e-a284-673f9381a175 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] 10.222.0.43 "GET /compute/v2.1/servers/4b3f3cb9-cdd4-4881-923f-bb3447b249b9" status: 200 len: 1473 microversion: 2.1 time: 1.060252 Oct 04 21:56:58.682511 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-8412c6ed-c739-4ede-bc43-6bd0fa53f004 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/50557840-4dda-4b34-a5ed-cd73d440b7e9" status: 202 len: 0 microversion: 2.1 time: 1.194252 Oct 04 21:56:58.682511 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1521/2957] 10.222.0.43 () {58 vars in 1272 bytes} [Tue Oct 4 21:56:57 2022] DELETE /compute/v2.1/os-security-groups/50557840-4dda-4b34-a5ed-cd73d440b7e9 => generated 0 bytes in 1200 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:56:58.685205 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-a5cb58eb-c99e-4098-bb3a-6b34a5e64af4 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Calling method '.version_select at 0x7fbb2e6f2f70>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:58.685679 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1437/2958] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:56:57 2022] GET /compute/v2.1/servers/4b3f3cb9-cdd4-4881-923f-bb3447b249b9 => generated 1473 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:56:58.692411 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-675e4bd7-402a-42b7-bf2b-1eac54a771d9 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] Calling method '.version_select at 0x7fbb2e303310>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:58.757987 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-a5cb58eb-c99e-4098-bb3a-6b34a5e64af4 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] 10.222.0.43 "GET /compute/v2.1/images/fc854dc3-25b4-4f91-a4ee-4aa1cce47c5b" status: 200 len: 1410 microversion: 2.1 time: 0.084033 Oct 04 21:56:58.766504 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1522/2959] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:56:58 2022] GET /compute/v2.1/images/fc854dc3-25b4-4f91-a4ee-4aa1cce47c5b => generated 1410 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:56:59.692388 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-6e629251-1b5a-499b-9d40-321e96f8e938 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:59.693951 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-6e629251-1b5a-499b-9d40-321e96f8e938 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] [instance: 4b3f3cb9-cdd4-4881-923f-bb3447b249b9] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:56:59.729125 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6e629251-1b5a-499b-9d40-321e96f8e938 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:59.730388 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6e629251-1b5a-499b-9d40-321e96f8e938 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:59.734837 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6e629251-1b5a-499b-9d40-321e96f8e938 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:59.736167 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6e629251-1b5a-499b-9d40-321e96f8e938 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:59.737166 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6e629251-1b5a-499b-9d40-321e96f8e938 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:59.737854 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6e629251-1b5a-499b-9d40-321e96f8e938 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:00.828044 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-6e629251-1b5a-499b-9d40-321e96f8e938 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b45ebdb946b45c28fc4bca3dd5a3e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520782b7e0a94e3fb552744cc4584119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:57:00.856442 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-675e4bd7-402a-42b7-bf2b-1eac54a771d9 tempest-SecurityGroupsTestJSON-367911468 tempest-SecurityGroupsTestJSON-367911468-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/573de4f5-425b-48b1-8892-a4d297115930" status: 202 len: 0 microversion: 2.1 time: 2.168127 Oct 04 21:57:00.858567 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1438/2960] 10.222.0.43 () {58 vars in 1272 bytes} [Tue Oct 4 21:56:58 2022] DELETE /compute/v2.1/os-security-groups/573de4f5-425b-48b1-8892-a4d297115930 => generated 0 bytes in 2172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:57:00.869819 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-70d3a0f3-c458-40fe-ab1c-26bee7edb1c5 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Calling method '.version_select at 0x7fbb2f622e50>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:57:00.879648 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-6e629251-1b5a-499b-9d40-321e96f8e938 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] 10.222.0.43 "GET /compute/v2.1/servers/4b3f3cb9-cdd4-4881-923f-bb3447b249b9" status: 200 len: 1473 microversion: 2.1 time: 1.190798 Oct 04 21:57:00.881611 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1523/2961] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:56:59 2022] GET /compute/v2.1/servers/4b3f3cb9-cdd4-4881-923f-bb3447b249b9 => generated 1473 bytes in 1196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:57:00.998050 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-70d3a0f3-c458-40fe-ab1c-26bee7edb1c5 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] 10.222.0.43 "GET /compute/v2.1/images/fc854dc3-25b4-4f91-a4ee-4aa1cce47c5b" status: 200 len: 1410 microversion: 2.1 time: 0.138072 Oct 04 21:57:01.004890 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1439/2962] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:57:00 2022] GET /compute/v2.1/images/fc854dc3-25b4-4f91-a4ee-4aa1cce47c5b => generated 1410 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:57:01.911819 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-b6bde591-cf75-4fe3-bfaa-021a04d04c57 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:57:01.912560 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-b6bde591-cf75-4fe3-bfaa-021a04d04c57 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] [instance: 4b3f3cb9-cdd4-4881-923f-bb3447b249b9] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:57:01.940937 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b6bde591-cf75-4fe3-bfaa-021a04d04c57 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:01.942332 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b6bde591-cf75-4fe3-bfaa-021a04d04c57 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:01.949104 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b6bde591-cf75-4fe3-bfaa-021a04d04c57 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:01.955299 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b6bde591-cf75-4fe3-bfaa-021a04d04c57 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:01.970440 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b6bde591-cf75-4fe3-bfaa-021a04d04c57 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:01.977282 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b6bde591-cf75-4fe3-bfaa-021a04d04c57 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:02.029392 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-f70d40fc-9e5a-4daf-bde7-c71aad8c34c1 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Calling method '.version_select at 0x7fbb2e303ca0>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:57:02.250066 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-f70d40fc-9e5a-4daf-bde7-c71aad8c34c1 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] 10.222.0.43 "GET /compute/v2.1/images/fc854dc3-25b4-4f91-a4ee-4aa1cce47c5b" status: 200 len: 1410 microversion: 2.1 time: 0.232551 Oct 04 21:57:02.252106 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1440/2963] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:57:02 2022] GET /compute/v2.1/images/fc854dc3-25b4-4f91-a4ee-4aa1cce47c5b => generated 1410 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:57:02.897924 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-b6bde591-cf75-4fe3-bfaa-021a04d04c57 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b45ebdb946b45c28fc4bca3dd5a3e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520782b7e0a94e3fb552744cc4584119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:57:02.939869 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-b6bde591-cf75-4fe3-bfaa-021a04d04c57 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] 10.222.0.43 "GET /compute/v2.1/servers/4b3f3cb9-cdd4-4881-923f-bb3447b249b9" status: 200 len: 1473 microversion: 2.1 time: 1.028555 Oct 04 21:57:02.940690 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1524/2964] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:57:01 2022] GET /compute/v2.1/servers/4b3f3cb9-cdd4-4881-923f-bb3447b249b9 => generated 1473 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:57:03.277082 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-87369657-7c95-4cdc-a9bf-30e425ebea14 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Calling method '.version_select at 0x7fbb2e769310>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:57:03.367795 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-87369657-7c95-4cdc-a9bf-30e425ebea14 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] 10.222.0.43 "GET /compute/v2.1/images/fc854dc3-25b4-4f91-a4ee-4aa1cce47c5b" status: 200 len: 1410 microversion: 2.1 time: 0.094538 Oct 04 21:57:03.368655 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1525/2965] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:57:03 2022] GET /compute/v2.1/images/fc854dc3-25b4-4f91-a4ee-4aa1cce47c5b => generated 1410 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:57:03.435888 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-1472c956-cec1-4a1d-b4a3-86c6c218518a req-55985935-f9a7-4ef2-a1e6-5af529dfcad2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b3f3cb9-cdd4-4881-923f-bb3447b249b9", "name": "network-vif-deleted", "tag": "7addb5c8-b6f8-47ba-8b56-d1984891b962"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:57:03.512174 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-1472c956-cec1-4a1d-b4a3-86c6c218518a req-55985935-f9a7-4ef2-a1e6-5af529dfcad2 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:03.518939 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-1472c956-cec1-4a1d-b4a3-86c6c218518a req-55985935-f9a7-4ef2-a1e6-5af529dfcad2 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:03.520836 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-1472c956-cec1-4a1d-b4a3-86c6c218518a req-55985935-f9a7-4ef2-a1e6-5af529dfcad2 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:03.568830 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-c3a9c10e-e249-494b-b161-d59f2e46cca3 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-243659985", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452", "networks": [{"uuid": "300a434f-3ad3-472e-98dd-a1b7130cf104"}]}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:57:03.582658 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-1472c956-cec1-4a1d-b4a3-86c6c218518a req-55985935-f9a7-4ef2-a1e6-5af529dfcad2 service nova] Creating event network-vif-deleted:7addb5c8-b6f8-47ba-8b56-d1984891b962 for instance 4b3f3cb9-cdd4-4881-923f-bb3447b249b9 on n-h1-860284-1 Oct 04 21:57:03.621676 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-1472c956-cec1-4a1d-b4a3-86c6c218518a req-55985935-f9a7-4ef2-a1e6-5af529dfcad2 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.193111 Oct 04 21:57:03.638538 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1526/2966] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:57:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:57:03.638816 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=2 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:57:03.726431 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.network.neutron [None req-c3a9c10e-e249-494b-b161-d59f2e46cca3 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] validate_networks() for [('300a434f-3ad3-472e-98dd-a1b7130cf104', None, None, None, None, None)] {{(pid=134101) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:57:03.973639 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-2deeb318-b50b-4a83-a5fa-09a052956d19 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:57:03.978836 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-2deeb318-b50b-4a83-a5fa-09a052956d19 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] [instance: 4b3f3cb9-cdd4-4881-923f-bb3447b249b9] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:57:03.994527 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2deeb318-b50b-4a83-a5fa-09a052956d19 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:03.997843 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2deeb318-b50b-4a83-a5fa-09a052956d19 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:03.998390 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2deeb318-b50b-4a83-a5fa-09a052956d19 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:03.999223 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2deeb318-b50b-4a83-a5fa-09a052956d19 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:03.999760 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2deeb318-b50b-4a83-a5fa-09a052956d19 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:04.004482 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2deeb318-b50b-4a83-a5fa-09a052956d19 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:04.096392 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2deeb318-b50b-4a83-a5fa-09a052956d19 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:04.096886 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2deeb318-b50b-4a83-a5fa-09a052956d19 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:04.097479 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2deeb318-b50b-4a83-a5fa-09a052956d19 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:04.097944 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.objects.instance [None req-2deeb318-b50b-4a83-a5fa-09a052956d19 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Lazy-loading 'fault' on Instance uuid 4b3f3cb9-cdd4-4881-923f-bb3447b249b9 {{(pid=134102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:57:04.950603 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-2deeb318-b50b-4a83-a5fa-09a052956d19 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b45ebdb946b45c28fc4bca3dd5a3e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520782b7e0a94e3fb552744cc4584119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:57:04.978235 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-2deeb318-b50b-4a83-a5fa-09a052956d19 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] 10.222.0.43 "GET /compute/v2.1/servers/4b3f3cb9-cdd4-4881-923f-bb3447b249b9" status: 200 len: 1308 microversion: 2.1 time: 1.012431 Oct 04 21:57:04.991202 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1527/2967] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:57:03 2022] GET /compute/v2.1/servers/4b3f3cb9-cdd4-4881-923f-bb3447b249b9 => generated 1308 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:57:05.017301 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-8fb4ec79-57a4-4efe-9f5e-d92941177e4c tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Calling method '.version_select at 0x7fbb2e62fee0>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:57:05.228649 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-8fb4ec79-57a4-4efe-9f5e-d92941177e4c tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] 10.222.0.43 "GET /compute/v2.1/images/fc854dc3-25b4-4f91-a4ee-4aa1cce47c5b" status: 200 len: 1410 microversion: 2.1 time: 0.235456 Oct 04 21:57:05.229722 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1528/2968] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:57:04 2022] GET /compute/v2.1/images/fc854dc3-25b4-4f91-a4ee-4aa1cce47c5b => generated 1410 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:57:06.016968 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-42f62465-bdfc-4106-9073-c8c6c657a384 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:57:06.021370 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-42f62465-bdfc-4106-9073-c8c6c657a384 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] [instance: 4b3f3cb9-cdd4-4881-923f-bb3447b249b9] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:57:06.118760 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-42f62465-bdfc-4106-9073-c8c6c657a384 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:06.123409 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-42f62465-bdfc-4106-9073-c8c6c657a384 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:06.128596 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-42f62465-bdfc-4106-9073-c8c6c657a384 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:06.130473 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-42f62465-bdfc-4106-9073-c8c6c657a384 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:06.142102 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-42f62465-bdfc-4106-9073-c8c6c657a384 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:06.144389 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-42f62465-bdfc-4106-9073-c8c6c657a384 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:06.302857 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-42f62465-bdfc-4106-9073-c8c6c657a384 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] HTTP exception thrown: Instance 4b3f3cb9-cdd4-4881-923f-bb3447b249b9 could not be found. Oct 04 21:57:06.314013 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-42f62465-bdfc-4106-9073-c8c6c657a384 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Request method failure captured: Oct 04 21:57:06.314013 n-d-860284-1 devstack@n-api.service[134102]: request: GET /compute/v2.1/servers/4b3f3cb9-cdd4-4881-923f-bb3447b249b9 HTTP/1.1 Oct 04 21:57:06.314013 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 21:57:06.314013 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 21:57:06.314013 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 21:57:06.314013 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 21:57:06.314013 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 21:57:06.314013 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 21:57:06.314013 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 21:57:06.314013 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 21:57:06.314013 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPKveJ8OAEZcy8hW-LjIusFhYFBUWu2tLD_yUnjiX8SUiLdWetP5uuYFeQ6IgcZFk7-IyZdTp9Y68VSfMAaIy8wZC342f6nUCCKtcwKZgCFJFnh0NUkguMMzzTpZDHMfHqgIXtdMblhRRicrhKtlmYGb_qO9K7pynlqgGsV9eIYUFMCA Oct 04 21:57:06.314013 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 21:57:06.314013 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 21:57:06.314013 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 21:57:06.314013 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 21:57:06.314013 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 21:57:06.314013 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 21:57:06.314013 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: 520782b7e0a94e3fb552744cc4584119 Oct 04 21:57:06.314013 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-LiveMigrationNegativeTest-362520990 Oct 04 21:57:06.314013 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 21:57:06.314013 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 21:57:06.314013 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/520782b7e0a94e3fb552744cc4584119"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_520782b7e0a94e3fb552744cc4584119", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/520782b7e0a94e3fb552744cc4584119"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/520782b7e0a94e3fb552744cc4584119"}]}] Oct 04 21:57:06.314013 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-LiveMigrationNegativeTest-362520990 Oct 04 21:57:06.314013 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: 520782b7e0a94e3fb552744cc4584119 Oct 04 21:57:06.314013 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-362520990 Oct 04 21:57:06.314013 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-LiveMigrationNegativeTest-362520990-project Oct 04 21:57:06.314013 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 21:57:06.314013 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 21:57:06.314013 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: 7b45ebdb946b45c28fc4bca3dd5a3e5b Oct 04 21:57:06.314013 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-LiveMigrationNegativeTest-362520990-project Oct 04 21:57:06.314013 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 21:57:06.314013 n-d-860284-1 devstack@n-api.service[134102]: exception: Instance 4b3f3cb9-cdd4-4881-923f-bb3447b249b9 could not be found. Oct 04 21:57:06.314013 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': '4b3f3cb9-cdd4-4881-923f-bb3447b249b9'} Oct 04 21:57:06.314013 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:57:06.314013 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:57:06.314013 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:57:06.314013 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:57:06.314013 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:57:06.314013 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:57:06.314013 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:57:06.314013 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:57:06.314013 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:57:06.314013 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:57:06.314013 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b3f3cb9-cdd4-4881-923f-bb3447b249b9 could not be found. Oct 04 21:57:06.314013 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:57:06.314013 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:57:06.314013 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:57:06.314013 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:57:06.314013 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:57:06.314013 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:57:06.314013 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:57:06.314013 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:57:06.314013 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:57:06.314013 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:57:06.314013 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:57:06.314013 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:57:06.314013 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:57:06.314013 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:57:06.314013 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:57:06.314013 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:57:06.314013 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b3f3cb9-cdd4-4881-923f-bb3447b249b9 could not be found. Oct 04 21:57:06.314013 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:57:06.314013 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:57:06.314013 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:57:06.331318 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:57:06.331318 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:57:06.331318 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:57:06.331318 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:57:06.331318 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:57:06.331318 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b3f3cb9-cdd4-4881-923f-bb3447b249b9 could not be found. Oct 04 21:57:06.331318 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:57:06.332737 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-42f62465-bdfc-4106-9073-c8c6c657a384 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] Returning 404 to user: Instance 4b3f3cb9-cdd4-4881-923f-bb3447b249b9 could not be found. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:57:06.334116 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-42f62465-bdfc-4106-9073-c8c6c657a384 tempest-LiveMigrationNegativeTest-362520990 tempest-LiveMigrationNegativeTest-362520990-project] 10.222.0.43 "GET /compute/v2.1/servers/4b3f3cb9-cdd4-4881-923f-bb3447b249b9" status: 404 len: 111 microversion: 2.1 time: 0.332439 Oct 04 21:57:06.335355 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1529/2969] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:57:06 2022] GET /compute/v2.1/servers/4b3f3cb9-cdd4-4881-923f-bb3447b249b9 => generated 111 bytes in 335 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:57:06.372806 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-020c6886-ec50-4b8a-9284-ccf86bc3f98a tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Calling method '.version_select at 0x7fbb2e6b8040>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:57:06.609382 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-020c6886-ec50-4b8a-9284-ccf86bc3f98a tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] 10.222.0.43 "GET /compute/v2.1/images/fc854dc3-25b4-4f91-a4ee-4aa1cce47c5b" status: 200 len: 1410 microversion: 2.1 time: 0.260329 Oct 04 21:57:06.622834 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1530/2970] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:57:06 2022] GET /compute/v2.1/images/fc854dc3-25b4-4f91-a4ee-4aa1cce47c5b => generated 1410 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:57:06.699751 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-c3a9c10e-e249-494b-b161-d59f2e46cca3 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Flavor limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:57:06.701153 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-c3a9c10e-e249-494b-b161-d59f2e46cca3 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Image limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:57:06.701891 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-c3a9c10e-e249-494b-b161-d59f2e46cca3 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Flavor pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:57:06.702592 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-c3a9c10e-e249-494b-b161-d59f2e46cca3 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Image pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:57:06.704358 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-c3a9c10e-e249-494b-b161-d59f2e46cca3 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:57:06.748001 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c3a9c10e-e249-494b-b161-d59f2e46cca3 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:06.750943 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c3a9c10e-e249-494b-b161-d59f2e46cca3 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:06.752378 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c3a9c10e-e249-494b-b161-d59f2e46cca3 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:06.758709 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c3a9c10e-e249-494b-b161-d59f2e46cca3 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:06.762065 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c3a9c10e-e249-494b-b161-d59f2e46cca3 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:06.763399 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c3a9c10e-e249-494b-b161-d59f2e46cca3 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:06.814859 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:57:06.879223 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-c3a9c10e-e249-494b-b161-d59f2e46cca3 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Getting quotas for project cf07a17a482a4e92b6ddbdee463c8029. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:57:06.907802 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-c3a9c10e-e249-494b-b161-d59f2e46cca3 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Getting quotas for user 2facee4c6a40416e908083e126d2cfa3 and project cf07a17a482a4e92b6ddbdee463c8029. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:57:06.964675 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-c3a9c10e-e249-494b-b161-d59f2e46cca3 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Going to run 1 instances... {{(pid=134101) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:57:06.972902 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-c3a9c10e-e249-494b-b161-d59f2e46cca3 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: a4cf4fac-1e9b-4669-a6ff-30008ed3642d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='58548514-5dac-426c-81f5-19e3fba33e23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134101) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:57:07.187268 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-c3a9c10e-e249-494b-b161-d59f2e46cca3 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.203139 Oct 04 21:57:07.200683 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1441/2971] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 21:57:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 4218 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:57:07.212925 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-9bad65e9-42f0-4afe-b662-39a0af03f840 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:57:07.212925 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-9bad65e9-42f0-4afe-b662-39a0af03f840 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: a4cf4fac-1e9b-4669-a6ff-30008ed3642d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:57:07.352908 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-9bad65e9-42f0-4afe-b662-39a0af03f840 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2facee4c6a40416e908083e126d2cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07a17a482a4e92b6ddbdee463c8029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:57:07.365482 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-9bad65e9-42f0-4afe-b662-39a0af03f840 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d" status: 200 len: 1216 microversion: 2.1 time: 0.163274 Oct 04 21:57:07.367500 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1442/2972] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:57:07 2022] GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d => generated 1216 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:57:07.423271 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-2b32253e-6e07-459a-901a-bac1ddf05ea1 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-1879367692", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "025eb891-94c1-476d-9ec8-71616b849328"}]}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:57:07.623663 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.network.neutron [None req-2b32253e-6e07-459a-901a-bac1ddf05ea1 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] validate_networks() for [('025eb891-94c1-476d-9ec8-71616b849328', None, None, None, None, None)] {{(pid=134102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:57:07.633516 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-62b508c2-cbfa-48bc-beaf-b17a0a044739 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Calling method '.version_select at 0x7fbb2e6cbf70>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:57:07.739617 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-62b508c2-cbfa-48bc-beaf-b17a0a044739 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] 10.222.0.43 "GET /compute/v2.1/images/fc854dc3-25b4-4f91-a4ee-4aa1cce47c5b" status: 200 len: 1419 microversion: 2.1 time: 0.108540 Oct 04 21:57:07.741887 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1443/2973] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:57:07 2022] GET /compute/v2.1/images/fc854dc3-25b4-4f91-a4ee-4aa1cce47c5b => generated 1419 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:57:07.766278 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-8d6f8db4-cca0-4858-84d7-7b87fafbd872 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Calling method '.version_select at 0x7fbb2f399670>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:57:07.844075 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-8d6f8db4-cca0-4858-84d7-7b87fafbd872 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] 10.222.0.43 "GET /compute/v2.1/images/fc854dc3-25b4-4f91-a4ee-4aa1cce47c5b" status: 200 len: 1419 microversion: 2.1 time: 0.081698 Oct 04 21:57:07.845303 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1444/2974] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:57:07 2022] GET /compute/v2.1/images/fc854dc3-25b4-4f91-a4ee-4aa1cce47c5b => generated 1419 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:57:07.862435 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-63bc0fbd-894a-457c-a9d5-feb25166a664 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Calling method '.version_select at 0x7fbb2e368e50>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:57:10.460265 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-63bc0fbd-894a-457c-a9d5-feb25166a664 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] 10.222.0.43 "DELETE /compute/v2.1/images/fc854dc3-25b4-4f91-a4ee-4aa1cce47c5b" status: 204 len: 0 microversion: 2.1 time: 2.588048 Oct 04 21:57:10.461503 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1445/2975] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:57:07 2022] DELETE /compute/v2.1/images/fc854dc3-25b4-4f91-a4ee-4aa1cce47c5b => generated 0 bytes in 2606 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 21:57:10.556759 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-37661f9a-714d-43aa-b871-f1ebbd586d22 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:57:10.561867 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-37661f9a-714d-43aa-b871-f1ebbd586d22 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: a4cf4fac-1e9b-4669-a6ff-30008ed3642d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:57:10.583366 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-37661f9a-714d-43aa-b871-f1ebbd586d22 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:10.589322 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-37661f9a-714d-43aa-b871-f1ebbd586d22 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:10.589769 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-2b32253e-6e07-459a-901a-bac1ddf05ea1 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Flavor limits 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:57:10.590256 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-37661f9a-714d-43aa-b871-f1ebbd586d22 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:10.590601 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-2b32253e-6e07-459a-901a-bac1ddf05ea1 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Image limits 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:57:10.591294 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-37661f9a-714d-43aa-b871-f1ebbd586d22 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:10.591509 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-2b32253e-6e07-459a-901a-bac1ddf05ea1 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Flavor pref 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:57:10.592041 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-37661f9a-714d-43aa-b871-f1ebbd586d22 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:10.592661 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-2b32253e-6e07-459a-901a-bac1ddf05ea1 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Image pref 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:57:10.593221 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-37661f9a-714d-43aa-b871-f1ebbd586d22 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:10.593528 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-2b32253e-6e07-459a-901a-bac1ddf05ea1 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:57:10.664954 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2b32253e-6e07-459a-901a-bac1ddf05ea1 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:10.669797 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2b32253e-6e07-459a-901a-bac1ddf05ea1 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:10.670350 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2b32253e-6e07-459a-901a-bac1ddf05ea1 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:10.671218 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2b32253e-6e07-459a-901a-bac1ddf05ea1 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:10.675722 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2b32253e-6e07-459a-901a-bac1ddf05ea1 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:10.676213 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2b32253e-6e07-459a-901a-bac1ddf05ea1 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:10.727354 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-2b32253e-6e07-459a-901a-bac1ddf05ea1 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Getting quotas for project 857b9057c949472b9a1862182a01356c. Resources: {'instances', 'ram', 'cores'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:57:10.741306 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-2b32253e-6e07-459a-901a-bac1ddf05ea1 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Getting quotas for user 0a94113bec89469a844ede34890d6876 and project 857b9057c949472b9a1862182a01356c. Resources: {'instances', 'ram', 'cores'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:57:10.773768 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-2b32253e-6e07-459a-901a-bac1ddf05ea1 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Going to run 2 instances... {{(pid=134102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:57:10.777123 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-2b32253e-6e07-459a-901a-bac1ddf05ea1 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] [instance: f61f3b8b-9a3c-4d10-9dc4-8397e27f0237] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='58548514-5dac-426c-81f5-19e3fba33e23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:57:10.860420 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-2b32253e-6e07-459a-901a-bac1ddf05ea1 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] [instance: 16792146-aedb-4782-ba6f-5cbd7a7d0f62] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='58548514-5dac-426c-81f5-19e3fba33e23',instance=,instance_uuid=f61f3b8b-9a3c-4d10-9dc4-8397e27f0237,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:57:11.012486 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-2b32253e-6e07-459a-901a-bac1ddf05ea1 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.387550 Oct 04 21:57:11.016668 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1531/2976] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 21:57:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 4392 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:57:11.027979 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-608b6f72-49e0-4f99-a36e-50f66d86c52c tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:57:11.029816 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-608b6f72-49e0-4f99-a36e-50f66d86c52c tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] [instance: b176215c-96d4-402b-9c63-7ce87fe04ff6] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:57:11.054584 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-608b6f72-49e0-4f99-a36e-50f66d86c52c tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:11.055151 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-608b6f72-49e0-4f99-a36e-50f66d86c52c tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:11.055578 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-608b6f72-49e0-4f99-a36e-50f66d86c52c tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:11.056364 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-608b6f72-49e0-4f99-a36e-50f66d86c52c tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:11.067918 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-608b6f72-49e0-4f99-a36e-50f66d86c52c tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:11.068286 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-608b6f72-49e0-4f99-a36e-50f66d86c52c tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:11.144148 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-608b6f72-49e0-4f99-a36e-50f66d86c52c tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] [instance: b176215c-96d4-402b-9c63-7ce87fe04ff6] Going to try to terminate instance {{(pid=134102) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:57:11.290493 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-37661f9a-714d-43aa-b871-f1ebbd586d22 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2facee4c6a40416e908083e126d2cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07a17a482a4e92b6ddbdee463c8029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:57:11.304579 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-37661f9a-714d-43aa-b871-f1ebbd586d22 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d" status: 200 len: 1286 microversion: 2.1 time: 0.840538 Oct 04 21:57:11.305194 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1446/2977] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:57:10 2022] GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d => generated 1286 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:57:11.336714 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-608b6f72-49e0-4f99-a36e-50f66d86c52c tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] 10.222.0.43 "DELETE /compute/v2.1/servers/b176215c-96d4-402b-9c63-7ce87fe04ff6" status: 204 len: 0 microversion: 2.1 time: 0.317466 Oct 04 21:57:11.342754 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1532/2978] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 21:57:11 2022] DELETE /compute/v2.1/servers/b176215c-96d4-402b-9c63-7ce87fe04ff6 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:57:11.353539 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-727c67ca-fa1f-454c-a8cf-2bc83b1f3d9f tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:57:11.408077 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-727c67ca-fa1f-454c-a8cf-2bc83b1f3d9f tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0a94113bec89469a844ede34890d6876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857b9057c949472b9a1862182a01356c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:57:11.410213 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-727c67ca-fa1f-454c-a8cf-2bc83b1f3d9f tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Searching by: {'deleted': False, 'project_id': '857b9057c949472b9a1862182a01356c'} {{(pid=134101) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 21:57:11.473178 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-727c67ca-fa1f-454c-a8cf-2bc83b1f3d9f tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:11.474314 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-727c67ca-fa1f-454c-a8cf-2bc83b1f3d9f tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:11.475219 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-727c67ca-fa1f-454c-a8cf-2bc83b1f3d9f tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:11.479589 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-727c67ca-fa1f-454c-a8cf-2bc83b1f3d9f tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:11.480914 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-727c67ca-fa1f-454c-a8cf-2bc83b1f3d9f tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:11.482234 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-727c67ca-fa1f-454c-a8cf-2bc83b1f3d9f tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:11.567564 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-727c67ca-fa1f-454c-a8cf-2bc83b1f3d9f tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] 10.222.0.43 "GET /compute/v2.1/servers" status: 200 len: 677 microversion: 2.1 time: 0.238088 Oct 04 21:57:11.569096 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1447/2979] 10.222.0.43 () {58 vars in 1125 bytes} [Tue Oct 4 21:57:11 2022] GET /compute/v2.1/servers => generated 677 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:57:11.587653 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-d779900c-26f9-4dcc-b1c7-407071dd188e tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:57:11.597575 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-d779900c-26f9-4dcc-b1c7-407071dd188e tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] [instance: 16792146-aedb-4782-ba6f-5cbd7a7d0f62] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:57:12.025084 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-3fc3b824-bea1-499e-8d06-02d08a69eb6b tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-311343820", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452", "networks": [{"uuid": "7f0614ac-f6a1-4d4e-8554-b89cfa5772c4"}]}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:57:12.162889 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-d779900c-26f9-4dcc-b1c7-407071dd188e tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a94113bec89469a844ede34890d6876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857b9057c949472b9a1862182a01356c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:57:12.200402 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-d779900c-26f9-4dcc-b1c7-407071dd188e tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] 10.222.0.43 "GET /compute/v2.1/servers/16792146-aedb-4782-ba6f-5cbd7a7d0f62" status: 200 len: 1220 microversion: 2.1 time: 0.623454 Oct 04 21:57:12.202421 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1533/2980] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:57:11 2022] GET /compute/v2.1/servers/16792146-aedb-4782-ba6f-5cbd7a7d0f62 => generated 1220 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:57:12.249100 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.network.neutron [None req-3fc3b824-bea1-499e-8d06-02d08a69eb6b tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] validate_networks() for [('7f0614ac-f6a1-4d4e-8554-b89cfa5772c4', None, None, None, None, None)] {{(pid=134101) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:57:12.341374 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-f54b88d7-8daf-4786-9575-8067275a006b tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:57:12.344324 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-f54b88d7-8daf-4786-9575-8067275a006b tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: a4cf4fac-1e9b-4669-a6ff-30008ed3642d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:57:12.356887 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f54b88d7-8daf-4786-9575-8067275a006b tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:12.357566 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f54b88d7-8daf-4786-9575-8067275a006b tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:12.358391 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f54b88d7-8daf-4786-9575-8067275a006b tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:12.359799 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f54b88d7-8daf-4786-9575-8067275a006b tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:12.360732 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f54b88d7-8daf-4786-9575-8067275a006b tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:12.362525 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f54b88d7-8daf-4786-9575-8067275a006b tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:14.074307 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-f54b88d7-8daf-4786-9575-8067275a006b tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2facee4c6a40416e908083e126d2cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07a17a482a4e92b6ddbdee463c8029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:57:14.094876 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-f54b88d7-8daf-4786-9575-8067275a006b tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d" status: 200 len: 1316 microversion: 2.1 time: 1.764747 Oct 04 21:57:14.115962 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1534/2981] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:57:12 2022] GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d => generated 1316 bytes in 1787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:57:14.132563 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-3016dc95-ab98-4648-9733-aa4061cd4876 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:57:14.135651 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-3016dc95-ab98-4648-9733-aa4061cd4876 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] [instance: 16792146-aedb-4782-ba6f-5cbd7a7d0f62] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:57:14.157883 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3016dc95-ab98-4648-9733-aa4061cd4876 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:14.161724 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3016dc95-ab98-4648-9733-aa4061cd4876 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:14.171145 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3016dc95-ab98-4648-9733-aa4061cd4876 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:14.172253 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3016dc95-ab98-4648-9733-aa4061cd4876 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:14.172928 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3016dc95-ab98-4648-9733-aa4061cd4876 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:14.173701 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3016dc95-ab98-4648-9733-aa4061cd4876 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:14.569657 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-3016dc95-ab98-4648-9733-aa4061cd4876 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a94113bec89469a844ede34890d6876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857b9057c949472b9a1862182a01356c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:57:14.581985 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-3016dc95-ab98-4648-9733-aa4061cd4876 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] 10.222.0.43 "GET /compute/v2.1/servers/16792146-aedb-4782-ba6f-5cbd7a7d0f62" status: 200 len: 1272 microversion: 2.1 time: 0.461313 Oct 04 21:57:14.602345 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1535/2982] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:57:14 2022] GET /compute/v2.1/servers/16792146-aedb-4782-ba6f-5cbd7a7d0f62 => generated 1272 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:57:14.609897 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-10020be8-bcfb-4bd3-b997-c70c6a787358 req-d0b44393-4700-4702-9574-b58495933fe7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b176215c-96d4-402b-9c63-7ce87fe04ff6", "name": "network-vif-unplugged", "status": "completed", "tag": "0efd69ff-4474-4aaa-b2fd-c82bb955cb23"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:57:14.641496 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-10020be8-bcfb-4bd3-b997-c70c6a787358 req-d0b44393-4700-4702-9574-b58495933fe7 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:14.642286 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-10020be8-bcfb-4bd3-b997-c70c6a787358 req-d0b44393-4700-4702-9574-b58495933fe7 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:14.643491 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-10020be8-bcfb-4bd3-b997-c70c6a787358 req-d0b44393-4700-4702-9574-b58495933fe7 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:14.677210 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-10020be8-bcfb-4bd3-b997-c70c6a787358 req-d0b44393-4700-4702-9574-b58495933fe7 service nova] Creating event network-vif-unplugged:0efd69ff-4474-4aaa-b2fd-c82bb955cb23 for instance b176215c-96d4-402b-9c63-7ce87fe04ff6 on n-h2-860284-1 Oct 04 21:57:14.683380 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-10020be8-bcfb-4bd3-b997-c70c6a787358 req-d0b44393-4700-4702-9574-b58495933fe7 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.079182 Oct 04 21:57:14.687262 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1536/2983] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:57:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:57:15.121718 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-b1203f36-00a3-4ac6-9965-6a3549f6f87e tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:57:15.127552 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-b1203f36-00a3-4ac6-9965-6a3549f6f87e tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: a4cf4fac-1e9b-4669-a6ff-30008ed3642d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:57:15.155488 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b1203f36-00a3-4ac6-9965-6a3549f6f87e tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:15.156122 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b1203f36-00a3-4ac6-9965-6a3549f6f87e tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:15.156434 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b1203f36-00a3-4ac6-9965-6a3549f6f87e tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:15.157163 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b1203f36-00a3-4ac6-9965-6a3549f6f87e tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:15.157629 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b1203f36-00a3-4ac6-9965-6a3549f6f87e tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:15.158966 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b1203f36-00a3-4ac6-9965-6a3549f6f87e tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:17.317624 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-b1203f36-00a3-4ac6-9965-6a3549f6f87e tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2facee4c6a40416e908083e126d2cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07a17a482a4e92b6ddbdee463c8029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:57:17.337510 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-b1203f36-00a3-4ac6-9965-6a3549f6f87e tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d" status: 200 len: 1316 microversion: 2.1 time: 2.219923 Oct 04 21:57:17.338131 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1537/2984] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:57:15 2022] GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d => generated 1316 bytes in 2221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:57:17.359605 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=8 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:57:17.369311 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-d706f912-8f14-4b4d-a857-6a3186c38266 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:57:17.369938 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-d706f912-8f14-4b4d-a857-6a3186c38266 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] [instance: 16792146-aedb-4782-ba6f-5cbd7a7d0f62] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:57:17.396051 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d706f912-8f14-4b4d-a857-6a3186c38266 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:17.396561 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d706f912-8f14-4b4d-a857-6a3186c38266 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:17.397006 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d706f912-8f14-4b4d-a857-6a3186c38266 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:17.397738 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d706f912-8f14-4b4d-a857-6a3186c38266 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:17.398205 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d706f912-8f14-4b4d-a857-6a3186c38266 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:17.404396 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d706f912-8f14-4b4d-a857-6a3186c38266 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:17.870928 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-3fc3b824-bea1-499e-8d06-02d08a69eb6b tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Flavor limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:57:17.871283 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-3fc3b824-bea1-499e-8d06-02d08a69eb6b tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Image limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:57:17.871823 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-3fc3b824-bea1-499e-8d06-02d08a69eb6b tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Flavor pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:57:17.872617 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-3fc3b824-bea1-499e-8d06-02d08a69eb6b tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Image pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:57:17.872907 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-3fc3b824-bea1-499e-8d06-02d08a69eb6b tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:57:17.915202 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3fc3b824-bea1-499e-8d06-02d08a69eb6b tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:17.916632 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3fc3b824-bea1-499e-8d06-02d08a69eb6b tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:17.917269 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3fc3b824-bea1-499e-8d06-02d08a69eb6b tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:17.921456 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3fc3b824-bea1-499e-8d06-02d08a69eb6b tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:17.923400 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3fc3b824-bea1-499e-8d06-02d08a69eb6b tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:17.927190 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3fc3b824-bea1-499e-8d06-02d08a69eb6b tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:17.993602 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-d706f912-8f14-4b4d-a857-6a3186c38266 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a94113bec89469a844ede34890d6876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857b9057c949472b9a1862182a01356c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:57:17.995742 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-3fc3b824-bea1-499e-8d06-02d08a69eb6b tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Getting quotas for project 40071e45805146529fb8abd40629c2ae. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:57:18.000008 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=97,nova_cell1:UPDATE=1 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:57:18.021153 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-3fc3b824-bea1-499e-8d06-02d08a69eb6b tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Getting quotas for user f5e807c724cc4c3887a2d360f0584ffb and project 40071e45805146529fb8abd40629c2ae. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:57:18.027139 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-d706f912-8f14-4b4d-a857-6a3186c38266 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] 10.222.0.43 "GET /compute/v2.1/servers/16792146-aedb-4782-ba6f-5cbd7a7d0f62" status: 200 len: 1278 microversion: 2.1 time: 0.674989 Oct 04 21:57:18.043982 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1538/2985] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:57:17 2022] GET /compute/v2.1/servers/16792146-aedb-4782-ba6f-5cbd7a7d0f62 => generated 1278 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:57:18.126824 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-3fc3b824-bea1-499e-8d06-02d08a69eb6b tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Going to run 1 instances... {{(pid=134101) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:57:18.136540 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-3fc3b824-bea1-499e-8d06-02d08a69eb6b tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] [instance: dad442d9-d2e1-49ee-93ea-6e5090634df8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='58548514-5dac-426c-81f5-19e3fba33e23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134101) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:57:18.280521 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-bacd614d-b81b-4755-b892-c77ab2b69307 req-c59007ac-ba9d-43f9-96a9-dac2de554faa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b176215c-96d4-402b-9c63-7ce87fe04ff6", "name": "network-vif-deleted", "tag": "0efd69ff-4474-4aaa-b2fd-c82bb955cb23"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:57:18.328764 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-bacd614d-b81b-4755-b892-c77ab2b69307 req-c59007ac-ba9d-43f9-96a9-dac2de554faa service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:18.331566 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-3fc3b824-bea1-499e-8d06-02d08a69eb6b tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 6.311237 Oct 04 21:57:18.342716 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-bacd614d-b81b-4755-b892-c77ab2b69307 req-c59007ac-ba9d-43f9-96a9-dac2de554faa service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:18.343862 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-bacd614d-b81b-4755-b892-c77ab2b69307 req-c59007ac-ba9d-43f9-96a9-dac2de554faa service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:18.344749 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1448/2986] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 21:57:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 6325 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 21:57:18.353912 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-2a201e58-1a11-449b-bf85-9e6ba28a680f tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:57:18.354580 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-2a201e58-1a11-449b-bf85-9e6ba28a680f tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] [instance: dad442d9-d2e1-49ee-93ea-6e5090634df8] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:57:18.385706 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-bacd614d-b81b-4755-b892-c77ab2b69307 req-c59007ac-ba9d-43f9-96a9-dac2de554faa service nova] Creating event network-vif-deleted:0efd69ff-4474-4aaa-b2fd-c82bb955cb23 for instance b176215c-96d4-402b-9c63-7ce87fe04ff6 on n-h2-860284-1 Oct 04 21:57:18.431241 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-bacd614d-b81b-4755-b892-c77ab2b69307 req-c59007ac-ba9d-43f9-96a9-dac2de554faa service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142409 Oct 04 21:57:18.437189 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1539/2987] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:57:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:57:18.469569 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-bc57a7b1-1697-49f5-8027-00b7a9402969 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:57:18.470628 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-bc57a7b1-1697-49f5-8027-00b7a9402969 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: a4cf4fac-1e9b-4669-a6ff-30008ed3642d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:57:18.492071 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bc57a7b1-1697-49f5-8027-00b7a9402969 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:18.497124 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bc57a7b1-1697-49f5-8027-00b7a9402969 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:18.500273 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bc57a7b1-1697-49f5-8027-00b7a9402969 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:18.502476 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bc57a7b1-1697-49f5-8027-00b7a9402969 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:18.511674 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bc57a7b1-1697-49f5-8027-00b7a9402969 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:18.512540 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bc57a7b1-1697-49f5-8027-00b7a9402969 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:18.891938 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-2a201e58-1a11-449b-bf85-9e6ba28a680f tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e807c724cc4c3887a2d360f0584ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40071e45805146529fb8abd40629c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:57:18.942139 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-2a201e58-1a11-449b-bf85-9e6ba28a680f tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] 10.222.0.43 "GET /compute/v2.1/servers/dad442d9-d2e1-49ee-93ea-6e5090634df8" status: 200 len: 1207 microversion: 2.1 time: 0.596091 Oct 04 21:57:18.948643 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1449/2988] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:57:18 2022] GET /compute/v2.1/servers/dad442d9-d2e1-49ee-93ea-6e5090634df8 => generated 1207 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:57:19.075143 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-40a95d94-74c2-4df4-badb-ca28eec9ee59 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:57:19.077703 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-40a95d94-74c2-4df4-badb-ca28eec9ee59 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] [instance: 16792146-aedb-4782-ba6f-5cbd7a7d0f62] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:57:19.116246 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-40a95d94-74c2-4df4-badb-ca28eec9ee59 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:19.116769 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-40a95d94-74c2-4df4-badb-ca28eec9ee59 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:19.122928 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-40a95d94-74c2-4df4-badb-ca28eec9ee59 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:19.132919 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-40a95d94-74c2-4df4-badb-ca28eec9ee59 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:19.133485 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-40a95d94-74c2-4df4-badb-ca28eec9ee59 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:19.136558 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-40a95d94-74c2-4df4-badb-ca28eec9ee59 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:19.568349 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-bc57a7b1-1697-49f5-8027-00b7a9402969 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2facee4c6a40416e908083e126d2cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07a17a482a4e92b6ddbdee463c8029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:57:19.594750 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-bc57a7b1-1697-49f5-8027-00b7a9402969 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d" status: 200 len: 1316 microversion: 2.1 time: 1.149288 Oct 04 21:57:19.597914 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1540/2989] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:57:18 2022] GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d => generated 1316 bytes in 1159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:57:19.865092 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-40a95d94-74c2-4df4-badb-ca28eec9ee59 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a94113bec89469a844ede34890d6876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857b9057c949472b9a1862182a01356c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:57:19.886245 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-40a95d94-74c2-4df4-badb-ca28eec9ee59 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] 10.222.0.43 "GET /compute/v2.1/servers/16792146-aedb-4782-ba6f-5cbd7a7d0f62" status: 200 len: 1278 microversion: 2.1 time: 0.818137 Oct 04 21:57:19.887145 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1450/2990] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:57:19 2022] GET /compute/v2.1/servers/16792146-aedb-4782-ba6f-5cbd7a7d0f62 => generated 1278 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:57:19.973729 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-d564e433-931c-47b7-99e4-7c3087403072 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:57:19.974352 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-d564e433-931c-47b7-99e4-7c3087403072 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] [instance: dad442d9-d2e1-49ee-93ea-6e5090634df8] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:57:20.000972 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d564e433-931c-47b7-99e4-7c3087403072 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:20.008672 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d564e433-931c-47b7-99e4-7c3087403072 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:20.008672 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d564e433-931c-47b7-99e4-7c3087403072 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:20.009764 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d564e433-931c-47b7-99e4-7c3087403072 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:20.011730 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d564e433-931c-47b7-99e4-7c3087403072 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:20.011730 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d564e433-931c-47b7-99e4-7c3087403072 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:20.700341 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell0:SELECT=2 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:57:20.883068 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-d564e433-931c-47b7-99e4-7c3087403072 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e807c724cc4c3887a2d360f0584ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40071e45805146529fb8abd40629c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:57:20.899992 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-d564e433-931c-47b7-99e4-7c3087403072 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] 10.222.0.43 "GET /compute/v2.1/servers/dad442d9-d2e1-49ee-93ea-6e5090634df8" status: 200 len: 1203 microversion: 2.1 time: 0.930652 Oct 04 21:57:20.900620 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1541/2991] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:57:19 2022] GET /compute/v2.1/servers/dad442d9-d2e1-49ee-93ea-6e5090634df8 => generated 1203 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:57:20.920554 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-757d9cdc-958e-42b8-9ef9-622166b4c343 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:57:20.921299 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-757d9cdc-958e-42b8-9ef9-622166b4c343 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: a4cf4fac-1e9b-4669-a6ff-30008ed3642d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:57:20.941540 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-757d9cdc-958e-42b8-9ef9-622166b4c343 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:20.953729 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-757d9cdc-958e-42b8-9ef9-622166b4c343 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:20.954651 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-757d9cdc-958e-42b8-9ef9-622166b4c343 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:20.957794 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-757d9cdc-958e-42b8-9ef9-622166b4c343 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:20.958803 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-757d9cdc-958e-42b8-9ef9-622166b4c343 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:20.959561 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-757d9cdc-958e-42b8-9ef9-622166b4c343 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:21.018299 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-078d486c-b57d-46d5-8a33-8ab70e3ea4c8 tempest-QuotasAdminNegativeTest-568474115 tempest-QuotasAdminNegativeTest-568474115-project-admin] Calling method '.version_select at 0x7fbb2e3305e0>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:57:21.238194 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-078d486c-b57d-46d5-8a33-8ab70e3ea4c8 tempest-QuotasAdminNegativeTest-568474115 tempest-QuotasAdminNegativeTest-568474115-project-admin] 10.222.0.43 "GET /compute/v2.1/os-quota-sets/300ec767924b4db5a2103c5e7f38fcd4" status: 200 len: 371 microversion: 2.1 time: 1.228521 Oct 04 21:57:21.239202 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1451/2992] 10.222.0.43 () {58 vars in 1242 bytes} [Tue Oct 4 21:57:20 2022] GET /compute/v2.1/os-quota-sets/300ec767924b4db5a2103c5e7f38fcd4 => generated 371 bytes in 1230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:57:21.244172 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-599c1cc3-6f10-4fc4-b262-d93cdaf37e48 req-98b28033-973f-44cf-b601-c7e78396ec5d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4cf4fac-1e9b-4669-a6ff-30008ed3642d", "tag": "17823d3d-fc62-47ee-8e12-cf0154daa955"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:57:21.274259 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-599c1cc3-6f10-4fc4-b262-d93cdaf37e48 req-98b28033-973f-44cf-b601-c7e78396ec5d service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:21.275162 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-599c1cc3-6f10-4fc4-b262-d93cdaf37e48 req-98b28033-973f-44cf-b601-c7e78396ec5d service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:21.275812 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-599c1cc3-6f10-4fc4-b262-d93cdaf37e48 req-98b28033-973f-44cf-b601-c7e78396ec5d service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:21.332401 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-599c1cc3-6f10-4fc4-b262-d93cdaf37e48 req-98b28033-973f-44cf-b601-c7e78396ec5d service nova] Creating event network-changed:17823d3d-fc62-47ee-8e12-cf0154daa955 for instance a4cf4fac-1e9b-4669-a6ff-30008ed3642d on n-h1-860284-1 Oct 04 21:57:21.338864 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-599c1cc3-6f10-4fc4-b262-d93cdaf37e48 req-98b28033-973f-44cf-b601-c7e78396ec5d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098018 Oct 04 21:57:21.340651 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1452/2993] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:57:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:57:21.347435 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-157c5c42-d37b-42d6-b306-252f1dbf5e72 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:57:21.348380 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-157c5c42-d37b-42d6-b306-252f1dbf5e72 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] [instance: 16792146-aedb-4782-ba6f-5cbd7a7d0f62] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:57:21.359427 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-157c5c42-d37b-42d6-b306-252f1dbf5e72 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:21.362903 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-157c5c42-d37b-42d6-b306-252f1dbf5e72 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:21.364327 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-157c5c42-d37b-42d6-b306-252f1dbf5e72 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:21.365451 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-157c5c42-d37b-42d6-b306-252f1dbf5e72 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:21.366091 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-157c5c42-d37b-42d6-b306-252f1dbf5e72 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:21.366742 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-157c5c42-d37b-42d6-b306-252f1dbf5e72 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:21.856996 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-757d9cdc-958e-42b8-9ef9-622166b4c343 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2facee4c6a40416e908083e126d2cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07a17a482a4e92b6ddbdee463c8029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:57:21.865687 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-157c5c42-d37b-42d6-b306-252f1dbf5e72 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a94113bec89469a844ede34890d6876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857b9057c949472b9a1862182a01356c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:57:21.875197 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-157c5c42-d37b-42d6-b306-252f1dbf5e72 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] 10.222.0.43 "GET /compute/v2.1/servers/16792146-aedb-4782-ba6f-5cbd7a7d0f62" status: 200 len: 1320 microversion: 2.1 time: 0.533100 Oct 04 21:57:21.878805 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1453/2994] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:57:21 2022] GET /compute/v2.1/servers/16792146-aedb-4782-ba6f-5cbd7a7d0f62 => generated 1320 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:57:21.890916 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-757d9cdc-958e-42b8-9ef9-622166b4c343 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d" status: 200 len: 1316 microversion: 2.1 time: 0.979241 Oct 04 21:57:21.890916 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1542/2995] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:57:20 2022] GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d => generated 1316 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:57:21.893924 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-dd9e5bc6-e49f-4440-b939-cdac8fb5ca08 tempest-QuotasAdminNegativeTest-568474115 tempest-QuotasAdminNegativeTest-568474115-project-admin] Action: 'update', calling method: .version_select at 0x7fbb2e5c1d30>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:57:21.936382 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-5e2a86c3-ddc4-42a5-8a6f-9a528942e84e tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:57:21.937031 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-5e2a86c3-ddc4-42a5-8a6f-9a528942e84e tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] [instance: dad442d9-d2e1-49ee-93ea-6e5090634df8] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:57:21.948973 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5e2a86c3-ddc4-42a5-8a6f-9a528942e84e tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:21.949477 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5e2a86c3-ddc4-42a5-8a6f-9a528942e84e tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:21.949925 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5e2a86c3-ddc4-42a5-8a6f-9a528942e84e tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:21.950697 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5e2a86c3-ddc4-42a5-8a6f-9a528942e84e tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:21.951163 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5e2a86c3-ddc4-42a5-8a6f-9a528942e84e tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:21.951598 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5e2a86c3-ddc4-42a5-8a6f-9a528942e84e tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:22.030171 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dd9e5bc6-e49f-4440-b939-cdac8fb5ca08 tempest-QuotasAdminNegativeTest-568474115 tempest-QuotasAdminNegativeTest-568474115-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:22.030721 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dd9e5bc6-e49f-4440-b939-cdac8fb5ca08 tempest-QuotasAdminNegativeTest-568474115 tempest-QuotasAdminNegativeTest-568474115-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:22.031349 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dd9e5bc6-e49f-4440-b939-cdac8fb5ca08 tempest-QuotasAdminNegativeTest-568474115 tempest-QuotasAdminNegativeTest-568474115-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:22.032368 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dd9e5bc6-e49f-4440-b939-cdac8fb5ca08 tempest-QuotasAdminNegativeTest-568474115 tempest-QuotasAdminNegativeTest-568474115-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:22.033076 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dd9e5bc6-e49f-4440-b939-cdac8fb5ca08 tempest-QuotasAdminNegativeTest-568474115 tempest-QuotasAdminNegativeTest-568474115-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:22.033695 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dd9e5bc6-e49f-4440-b939-cdac8fb5ca08 tempest-QuotasAdminNegativeTest-568474115 tempest-QuotasAdminNegativeTest-568474115-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:22.058978 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-5e2a86c3-ddc4-42a5-8a6f-9a528942e84e tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e807c724cc4c3887a2d360f0584ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40071e45805146529fb8abd40629c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:57:22.072982 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-5e2a86c3-ddc4-42a5-8a6f-9a528942e84e tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] 10.222.0.43 "GET /compute/v2.1/servers/dad442d9-d2e1-49ee-93ea-6e5090634df8" status: 200 len: 1265 microversion: 2.1 time: 0.140847 Oct 04 21:57:22.077146 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1454/2996] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:57:21 2022] GET /compute/v2.1/servers/dad442d9-d2e1-49ee-93ea-6e5090634df8 => generated 1265 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:57:22.133278 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-dd9e5bc6-e49f-4440-b939-cdac8fb5ca08 tempest-QuotasAdminNegativeTest-568474115 tempest-QuotasAdminNegativeTest-568474115-project-admin] 10.222.0.43 "PUT /compute/v2.1/os-quota-sets/300ec767924b4db5a2103c5e7f38fcd4" status: 200 len: 328 microversion: 2.1 time: 0.249443 Oct 04 21:57:22.148600 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1543/2997] 10.222.0.43 () {60 vars in 1262 bytes} [Tue Oct 4 21:57:21 2022] PUT /compute/v2.1/os-quota-sets/300ec767924b4db5a2103c5e7f38fcd4 => generated 328 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:57:22.413655 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-1115994e-d55f-45f0-8587-bed8990cd97a tempest-QuotasAdminNegativeTest-273527032 tempest-QuotasAdminNegativeTest-273527032-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-655922563", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:57:22.514097 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.network.neutron [None req-1115994e-d55f-45f0-8587-bed8990cd97a tempest-QuotasAdminNegativeTest-273527032 tempest-QuotasAdminNegativeTest-273527032-project] validate_networks() for None {{(pid=134101) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:57:22.894207 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-1115994e-d55f-45f0-8587-bed8990cd97a tempest-QuotasAdminNegativeTest-273527032 tempest-QuotasAdminNegativeTest-273527032-project] Flavor limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:57:22.899044 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-1115994e-d55f-45f0-8587-bed8990cd97a tempest-QuotasAdminNegativeTest-273527032 tempest-QuotasAdminNegativeTest-273527032-project] Image limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:57:22.901507 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-1115994e-d55f-45f0-8587-bed8990cd97a tempest-QuotasAdminNegativeTest-273527032 tempest-QuotasAdminNegativeTest-273527032-project] Flavor pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:57:22.902211 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-1115994e-d55f-45f0-8587-bed8990cd97a tempest-QuotasAdminNegativeTest-273527032 tempest-QuotasAdminNegativeTest-273527032-project] Image pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:57:22.903396 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-1115994e-d55f-45f0-8587-bed8990cd97a tempest-QuotasAdminNegativeTest-273527032 tempest-QuotasAdminNegativeTest-273527032-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:57:22.904537 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-a3044e72-bd68-443f-b1e9-817282a8c410 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:57:22.905281 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-a3044e72-bd68-443f-b1e9-817282a8c410 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] [instance: 16792146-aedb-4782-ba6f-5cbd7a7d0f62] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:57:22.916744 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:57:22.923191 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1115994e-d55f-45f0-8587-bed8990cd97a tempest-QuotasAdminNegativeTest-273527032 tempest-QuotasAdminNegativeTest-273527032-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:22.926556 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1115994e-d55f-45f0-8587-bed8990cd97a tempest-QuotasAdminNegativeTest-273527032 tempest-QuotasAdminNegativeTest-273527032-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:22.927288 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1115994e-d55f-45f0-8587-bed8990cd97a tempest-QuotasAdminNegativeTest-273527032 tempest-QuotasAdminNegativeTest-273527032-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:22.928553 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1115994e-d55f-45f0-8587-bed8990cd97a tempest-QuotasAdminNegativeTest-273527032 tempest-QuotasAdminNegativeTest-273527032-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:22.929619 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1115994e-d55f-45f0-8587-bed8990cd97a tempest-QuotasAdminNegativeTest-273527032 tempest-QuotasAdminNegativeTest-273527032-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:22.930407 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1115994e-d55f-45f0-8587-bed8990cd97a tempest-QuotasAdminNegativeTest-273527032 tempest-QuotasAdminNegativeTest-273527032-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:22.931091 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a3044e72-bd68-443f-b1e9-817282a8c410 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:22.935115 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a3044e72-bd68-443f-b1e9-817282a8c410 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:22.947546 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a3044e72-bd68-443f-b1e9-817282a8c410 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:22.948872 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a3044e72-bd68-443f-b1e9-817282a8c410 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:22.949762 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a3044e72-bd68-443f-b1e9-817282a8c410 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:22.950567 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a3044e72-bd68-443f-b1e9-817282a8c410 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:22.979397 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-1115994e-d55f-45f0-8587-bed8990cd97a tempest-QuotasAdminNegativeTest-273527032 tempest-QuotasAdminNegativeTest-273527032-project] Getting quotas for project 300ec767924b4db5a2103c5e7f38fcd4. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:57:22.990547 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-1115994e-d55f-45f0-8587-bed8990cd97a tempest-QuotasAdminNegativeTest-273527032 tempest-QuotasAdminNegativeTest-273527032-project] Getting quotas for user b699234a248f4d0fb37cd875d445a210 and project 300ec767924b4db5a2103c5e7f38fcd4. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:57:23.010023 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.utils [None req-1115994e-d55f-45f0-8587-bed8990cd97a tempest-QuotasAdminNegativeTest-273527032 tempest-QuotasAdminNegativeTest-273527032-project] cores quota exceeded for 300ec767924b4db5a2103c5e7f38fcd4, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=134101) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 04 21:57:23.011320 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-1115994e-d55f-45f0-8587-bed8990cd97a tempest-QuotasAdminNegativeTest-273527032 tempest-QuotasAdminNegativeTest-273527032-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 04 21:57:23.023100 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-1115994e-d55f-45f0-8587-bed8990cd97a tempest-QuotasAdminNegativeTest-273527032 tempest-QuotasAdminNegativeTest-273527032-project] Request method failure captured: Oct 04 21:57:23.023100 n-d-860284-1 devstack@n-api.service[134101]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 21:57:23.023100 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 21:57:23.023100 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 21:57:23.023100 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 21:57:23.023100 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 144 Oct 04 21:57:23.023100 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 21:57:23.023100 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 21:57:23.023100 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 21:57:23.023100 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 21:57:23.023100 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPKw8n843GfAWMusMCpPvjh3Vu92PK7bRSP8Qdg64qIlaKSXJj_GQ8ITylNE-FHbZ7dX9elVPGjE0FsF3-V4ZnPMjc9S2THX647bOYBlXJcAvlUOiS92GonSE1CoIwirPY8kTQRNmYmv5lYFxMdXIORcKGuz_L7a-0Ut2kOycTFsLTX8 Oct 04 21:57:23.023100 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 21:57:23.023100 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 21:57:23.023100 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 21:57:23.023100 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 21:57:23.023100 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 21:57:23.023100 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 21:57:23.023100 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: 300ec767924b4db5a2103c5e7f38fcd4 Oct 04 21:57:23.023100 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-QuotasAdminNegativeTest-273527032 Oct 04 21:57:23.023100 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 21:57:23.023100 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 21:57:23.023100 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/300ec767924b4db5a2103c5e7f38fcd4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_300ec767924b4db5a2103c5e7f38fcd4", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/300ec767924b4db5a2103c5e7f38fcd4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/300ec767924b4db5a2103c5e7f38fcd4"}]}] Oct 04 21:57:23.023100 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-QuotasAdminNegativeTest-273527032 Oct 04 21:57:23.023100 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: 300ec767924b4db5a2103c5e7f38fcd4 Oct 04 21:57:23.023100 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-273527032 Oct 04 21:57:23.023100 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-QuotasAdminNegativeTest-273527032-project Oct 04 21:57:23.023100 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 21:57:23.023100 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 21:57:23.023100 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: b699234a248f4d0fb37cd875d445a210 Oct 04 21:57:23.023100 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-QuotasAdminNegativeTest-273527032-project Oct 04 21:57:23.023100 n-d-860284-1 devstack@n-api.service[134101]: Oct 04 21:57:23.023100 n-d-860284-1 devstack@n-api.service[134101]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-655922563", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452"}} Oct 04 21:57:23.023100 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 21:57:23.023100 n-d-860284-1 devstack@n-api.service[134101]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 04 21:57:23.023100 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-655922563', 'imageRef': '58548514-5dac-426c-81f5-19e3fba33e23', 'flavorRef': '452'}}} Oct 04 21:57:23.023100 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:57:23.023100 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:57:23.023100 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 04 21:57:23.023100 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 04 21:57:23.023100 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 21:57:23.023100 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 21:57:23.023100 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 04 21:57:23.023100 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc Oct 04 21:57:23.023100 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 04 21:57:23.023100 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 04 21:57:23.023100 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 21:57:23.023100 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 21:57:23.023100 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 04 21:57:23.023100 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 04 21:57:23.023100 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 04 21:57:23.023100 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 04 21:57:23.023100 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 04 21:57:23.023100 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 04 21:57:23.023100 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Oct 04 21:57:23.023100 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:57:23.023100 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:57:23.023100 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:57:23.023100 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:57:23.023100 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 21:57:23.023100 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 21:57:23.023100 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 21:57:23.023100 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 21:57:23.023100 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 04 21:57:23.027205 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 04 21:57:23.027205 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 04 21:57:23.027205 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 04 21:57:23.027205 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 04 21:57:23.027205 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 04 21:57:23.027205 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 04 21:57:23.027205 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:57:23.027205 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:57:23.027205 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:57:23.027205 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:57:23.027205 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:57:23.027205 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:57:23.027205 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:57:23.027205 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:57:23.027205 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:57:23.027205 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:57:23.027205 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:57:23.027205 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:57:23.027205 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:57:23.027205 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:57:23.027205 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:57:23.027205 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:57:23.027205 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 21:57:23.027205 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 04 21:57:23.027205 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 04 21:57:23.027205 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 04 21:57:23.027205 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:57:23.027205 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:57:23.027205 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:57:23.027205 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:57:23.027205 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:57:23.027205 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:57:23.027205 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:57:23.027205 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:57:23.027205 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 04 21:57:23.027205 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:57:23.027205 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-1115994e-d55f-45f0-8587-bed8990cd97a tempest-QuotasAdminNegativeTest-273527032 tempest-QuotasAdminNegativeTest-273527032-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:57:23.027205 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-1115994e-d55f-45f0-8587-bed8990cd97a tempest-QuotasAdminNegativeTest-273527032 tempest-QuotasAdminNegativeTest-273527032-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 0.734175 Oct 04 21:57:23.027205 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1455/2998] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 21:57:22 2022] POST /compute/v2.1/servers => generated 111 bytes in 736 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:57:23.043935 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-60bec730-3b2f-45ca-a0b8-a0010114069c tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:57:23.044877 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-60bec730-3b2f-45ca-a0b8-a0010114069c tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: a4cf4fac-1e9b-4669-a6ff-30008ed3642d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:57:23.069055 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-60bec730-3b2f-45ca-a0b8-a0010114069c tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:23.073165 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-60bec730-3b2f-45ca-a0b8-a0010114069c tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:23.073916 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-60bec730-3b2f-45ca-a0b8-a0010114069c tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:23.075007 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-60bec730-3b2f-45ca-a0b8-a0010114069c tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:23.079379 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-60bec730-3b2f-45ca-a0b8-a0010114069c tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:23.080295 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-60bec730-3b2f-45ca-a0b8-a0010114069c tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:23.313987 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-a3044e72-bd68-443f-b1e9-817282a8c410 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a94113bec89469a844ede34890d6876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857b9057c949472b9a1862182a01356c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:57:23.332354 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-a3044e72-bd68-443f-b1e9-817282a8c410 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] 10.222.0.43 "GET /compute/v2.1/servers/16792146-aedb-4782-ba6f-5cbd7a7d0f62" status: 200 len: 1320 microversion: 2.1 time: 0.431785 Oct 04 21:57:23.333394 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1544/2999] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:57:22 2022] GET /compute/v2.1/servers/16792146-aedb-4782-ba6f-5cbd7a7d0f62 => generated 1320 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:57:23.338787 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-6c0f66b8-d48b-4279-b075-40074b7f20fe tempest-QuotasAdminNegativeTest-568474115 tempest-QuotasAdminNegativeTest-568474115-project-admin] Action: 'update', calling method: .version_select at 0x7fbb2e6251f0>, body: {"quota_set": {"cores": 20}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:57:23.409521 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-60bec730-3b2f-45ca-a0b8-a0010114069c tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2facee4c6a40416e908083e126d2cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07a17a482a4e92b6ddbdee463c8029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:57:23.428685 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-60bec730-3b2f-45ca-a0b8-a0010114069c tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d" status: 200 len: 1316 microversion: 2.1 time: 0.401426 Oct 04 21:57:23.429601 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1456/3000] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:57:23 2022] GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d => generated 1316 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:57:23.444239 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-291c9eec-8fd6-4eff-8f75-dc60d1788d7e tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:57:23.445081 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-291c9eec-8fd6-4eff-8f75-dc60d1788d7e tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] [instance: dad442d9-d2e1-49ee-93ea-6e5090634df8] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:57:23.456492 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-291c9eec-8fd6-4eff-8f75-dc60d1788d7e tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:23.457268 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-291c9eec-8fd6-4eff-8f75-dc60d1788d7e tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:23.457715 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-291c9eec-8fd6-4eff-8f75-dc60d1788d7e tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:23.458979 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-291c9eec-8fd6-4eff-8f75-dc60d1788d7e tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:23.459687 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-291c9eec-8fd6-4eff-8f75-dc60d1788d7e tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:23.460195 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-291c9eec-8fd6-4eff-8f75-dc60d1788d7e tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:23.840956 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6c0f66b8-d48b-4279-b075-40074b7f20fe tempest-QuotasAdminNegativeTest-568474115 tempest-QuotasAdminNegativeTest-568474115-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:23.841882 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6c0f66b8-d48b-4279-b075-40074b7f20fe tempest-QuotasAdminNegativeTest-568474115 tempest-QuotasAdminNegativeTest-568474115-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:23.843164 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6c0f66b8-d48b-4279-b075-40074b7f20fe tempest-QuotasAdminNegativeTest-568474115 tempest-QuotasAdminNegativeTest-568474115-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:23.845014 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6c0f66b8-d48b-4279-b075-40074b7f20fe tempest-QuotasAdminNegativeTest-568474115 tempest-QuotasAdminNegativeTest-568474115-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:23.845803 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6c0f66b8-d48b-4279-b075-40074b7f20fe tempest-QuotasAdminNegativeTest-568474115 tempest-QuotasAdminNegativeTest-568474115-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:23.846511 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6c0f66b8-d48b-4279-b075-40074b7f20fe tempest-QuotasAdminNegativeTest-568474115 tempest-QuotasAdminNegativeTest-568474115-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:23.935186 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-6c0f66b8-d48b-4279-b075-40074b7f20fe tempest-QuotasAdminNegativeTest-568474115 tempest-QuotasAdminNegativeTest-568474115-project-admin] 10.222.0.43 "PUT /compute/v2.1/os-quota-sets/300ec767924b4db5a2103c5e7f38fcd4" status: 200 len: 329 microversion: 2.1 time: 0.599980 Oct 04 21:57:23.937130 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1545/3001] 10.222.0.43 () {60 vars in 1262 bytes} [Tue Oct 4 21:57:23 2022] PUT /compute/v2.1/os-quota-sets/300ec767924b4db5a2103c5e7f38fcd4 => generated 329 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:57:23.958444 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-9b62dac5-8303-4827-9160-c07d49c834d4 tempest-QuotasAdminNegativeTest-568474115 tempest-QuotasAdminNegativeTest-568474115-project-admin] Calling method '.version_select at 0x7fbb2e625a60>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:57:24.047665 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-291c9eec-8fd6-4eff-8f75-dc60d1788d7e tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e807c724cc4c3887a2d360f0584ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40071e45805146529fb8abd40629c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:57:24.080306 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-291c9eec-8fd6-4eff-8f75-dc60d1788d7e tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] 10.222.0.43 "GET /compute/v2.1/servers/dad442d9-d2e1-49ee-93ea-6e5090634df8" status: 200 len: 1265 microversion: 2.1 time: 0.649592 Oct 04 21:57:24.109001 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1457/3002] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:57:23 2022] GET /compute/v2.1/servers/dad442d9-d2e1-49ee-93ea-6e5090634df8 => generated 1265 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:57:24.218963 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-9b62dac5-8303-4827-9160-c07d49c834d4 tempest-QuotasAdminNegativeTest-568474115 tempest-QuotasAdminNegativeTest-568474115-project-admin] 10.222.0.43 "GET /compute/v2.1/os-quota-sets/300ec767924b4db5a2103c5e7f38fcd4" status: 200 len: 371 microversion: 2.1 time: 0.269567 Oct 04 21:57:24.220929 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1546/3003] 10.222.0.43 () {58 vars in 1242 bytes} [Tue Oct 4 21:57:23 2022] GET /compute/v2.1/os-quota-sets/300ec767924b4db5a2103c5e7f38fcd4 => generated 371 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:57:24.232918 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-87bf46d3-6cf4-4651-b21d-ce93469f6895 tempest-QuotasAdminNegativeTest-568474115 tempest-QuotasAdminNegativeTest-568474115-project-admin] Action: 'update', calling method: .version_select at 0x7fbb2e3760d0>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:57:24.344576 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-87bf46d3-6cf4-4651-b21d-ce93469f6895 tempest-QuotasAdminNegativeTest-568474115 tempest-QuotasAdminNegativeTest-568474115-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:24.346828 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-87bf46d3-6cf4-4651-b21d-ce93469f6895 tempest-QuotasAdminNegativeTest-568474115 tempest-QuotasAdminNegativeTest-568474115-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:24.347477 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-87bf46d3-6cf4-4651-b21d-ce93469f6895 tempest-QuotasAdminNegativeTest-568474115 tempest-QuotasAdminNegativeTest-568474115-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:24.348400 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-87bf46d3-6cf4-4651-b21d-ce93469f6895 tempest-QuotasAdminNegativeTest-568474115 tempest-QuotasAdminNegativeTest-568474115-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:24.349123 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-87bf46d3-6cf4-4651-b21d-ce93469f6895 tempest-QuotasAdminNegativeTest-568474115 tempest-QuotasAdminNegativeTest-568474115-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:24.349714 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-87bf46d3-6cf4-4651-b21d-ce93469f6895 tempest-QuotasAdminNegativeTest-568474115 tempest-QuotasAdminNegativeTest-568474115-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:24.360000 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-8513795a-7a29-431e-8aff-9426e7864013 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:57:24.360967 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-8513795a-7a29-431e-8aff-9426e7864013 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] [instance: 16792146-aedb-4782-ba6f-5cbd7a7d0f62] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:57:24.377527 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8513795a-7a29-431e-8aff-9426e7864013 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:24.378272 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8513795a-7a29-431e-8aff-9426e7864013 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:24.378976 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8513795a-7a29-431e-8aff-9426e7864013 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:24.379847 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8513795a-7a29-431e-8aff-9426e7864013 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:24.380956 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8513795a-7a29-431e-8aff-9426e7864013 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:24.381436 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8513795a-7a29-431e-8aff-9426e7864013 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:24.433371 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-87bf46d3-6cf4-4651-b21d-ce93469f6895 tempest-QuotasAdminNegativeTest-568474115 tempest-QuotasAdminNegativeTest-568474115-project-admin] 10.222.0.43 "PUT /compute/v2.1/os-quota-sets/300ec767924b4db5a2103c5e7f38fcd4" status: 200 len: 328 microversion: 2.1 time: 0.203610 Oct 04 21:57:24.434448 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1458/3004] 10.222.0.43 () {60 vars in 1262 bytes} [Tue Oct 4 21:57:24 2022] PUT /compute/v2.1/os-quota-sets/300ec767924b4db5a2103c5e7f38fcd4 => generated 328 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:57:24.457616 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-320d1a9a-7fe6-40fc-a14c-cffb42206975 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:57:24.458754 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-320d1a9a-7fe6-40fc-a14c-cffb42206975 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: a4cf4fac-1e9b-4669-a6ff-30008ed3642d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:57:24.477292 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-320d1a9a-7fe6-40fc-a14c-cffb42206975 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:24.477997 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-320d1a9a-7fe6-40fc-a14c-cffb42206975 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:24.478489 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-320d1a9a-7fe6-40fc-a14c-cffb42206975 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:24.479725 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-320d1a9a-7fe6-40fc-a14c-cffb42206975 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:24.480202 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-320d1a9a-7fe6-40fc-a14c-cffb42206975 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:24.480926 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-320d1a9a-7fe6-40fc-a14c-cffb42206975 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:24.822615 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-8513795a-7a29-431e-8aff-9426e7864013 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a94113bec89469a844ede34890d6876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857b9057c949472b9a1862182a01356c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:57:24.837050 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-8513795a-7a29-431e-8aff-9426e7864013 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] 10.222.0.43 "GET /compute/v2.1/servers/16792146-aedb-4782-ba6f-5cbd7a7d0f62" status: 200 len: 1320 microversion: 2.1 time: 0.481525 Oct 04 21:57:24.850394 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1547/3005] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:57:24 2022] GET /compute/v2.1/servers/16792146-aedb-4782-ba6f-5cbd7a7d0f62 => generated 1320 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:57:24.850394 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-f8e214bc-2da7-4478-96ac-c8f3c8305695 req-ae709c0b-73a8-4ba2-a8a5-eebf2c388375 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f61f3b8b-9a3c-4d10-9dc4-8397e27f0237", "tag": "efd3f13d-6466-4c86-aa3f-27dd6cbdcf88"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:57:24.870336 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-f8e214bc-2da7-4478-96ac-c8f3c8305695 req-ae709c0b-73a8-4ba2-a8a5-eebf2c388375 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:24.874315 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-f8e214bc-2da7-4478-96ac-c8f3c8305695 req-ae709c0b-73a8-4ba2-a8a5-eebf2c388375 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:24.875988 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-f8e214bc-2da7-4478-96ac-c8f3c8305695 req-ae709c0b-73a8-4ba2-a8a5-eebf2c388375 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:24.906626 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-f8e214bc-2da7-4478-96ac-c8f3c8305695 req-ae709c0b-73a8-4ba2-a8a5-eebf2c388375 service nova] Creating event network-changed:efd3f13d-6466-4c86-aa3f-27dd6cbdcf88 for instance f61f3b8b-9a3c-4d10-9dc4-8397e27f0237 on n-h2-860284-1 Oct 04 21:57:24.924672 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-f8e214bc-2da7-4478-96ac-c8f3c8305695 req-ae709c0b-73a8-4ba2-a8a5-eebf2c388375 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084826 Oct 04 21:57:24.925557 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1548/3006] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:57:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:57:24.936475 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-e198a54c-fd66-48c0-ab07-6c392d25f1fb tempest-QuotasAdminNegativeTest-273527032 tempest-QuotasAdminNegativeTest-273527032-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-167954674", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452"}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:57:25.070700 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.network.neutron [None req-e198a54c-fd66-48c0-ab07-6c392d25f1fb tempest-QuotasAdminNegativeTest-273527032 tempest-QuotasAdminNegativeTest-273527032-project] validate_networks() for None {{(pid=134102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:57:25.352079 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-320d1a9a-7fe6-40fc-a14c-cffb42206975 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2facee4c6a40416e908083e126d2cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07a17a482a4e92b6ddbdee463c8029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:57:25.367300 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-320d1a9a-7fe6-40fc-a14c-cffb42206975 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d" status: 200 len: 1316 microversion: 2.1 time: 0.914178 Oct 04 21:57:25.370274 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1459/3007] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:57:24 2022] GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d => generated 1316 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:57:25.400292 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-b384866d-3030-471e-8f59-19041fb35817 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:57:25.406861 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-b384866d-3030-471e-8f59-19041fb35817 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] [instance: dad442d9-d2e1-49ee-93ea-6e5090634df8] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:57:25.437957 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b384866d-3030-471e-8f59-19041fb35817 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:25.440893 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b384866d-3030-471e-8f59-19041fb35817 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:25.442888 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b384866d-3030-471e-8f59-19041fb35817 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:25.445978 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b384866d-3030-471e-8f59-19041fb35817 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:25.448226 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b384866d-3030-471e-8f59-19041fb35817 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:25.451261 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b384866d-3030-471e-8f59-19041fb35817 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:26.086563 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-b384866d-3030-471e-8f59-19041fb35817 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e807c724cc4c3887a2d360f0584ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40071e45805146529fb8abd40629c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:57:26.106484 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-b384866d-3030-471e-8f59-19041fb35817 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] 10.222.0.43 "GET /compute/v2.1/servers/dad442d9-d2e1-49ee-93ea-6e5090634df8" status: 200 len: 1307 microversion: 2.1 time: 0.734571 Oct 04 21:57:26.107672 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1460/3008] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:57:25 2022] GET /compute/v2.1/servers/dad442d9-d2e1-49ee-93ea-6e5090634df8 => generated 1307 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:57:26.124661 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-a5c4bb79-c51c-4602-9afc-a5a9579065f8 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:57:26.125578 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-a5c4bb79-c51c-4602-9afc-a5a9579065f8 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] [instance: 16792146-aedb-4782-ba6f-5cbd7a7d0f62] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:57:26.132703 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a5c4bb79-c51c-4602-9afc-a5a9579065f8 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:26.139009 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a5c4bb79-c51c-4602-9afc-a5a9579065f8 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:26.139756 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a5c4bb79-c51c-4602-9afc-a5a9579065f8 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:26.140696 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a5c4bb79-c51c-4602-9afc-a5a9579065f8 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:26.141936 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a5c4bb79-c51c-4602-9afc-a5a9579065f8 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:26.143727 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a5c4bb79-c51c-4602-9afc-a5a9579065f8 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:26.603018 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-e198a54c-fd66-48c0-ab07-6c392d25f1fb tempest-QuotasAdminNegativeTest-273527032 tempest-QuotasAdminNegativeTest-273527032-project] Flavor limits 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:57:26.604679 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-e198a54c-fd66-48c0-ab07-6c392d25f1fb tempest-QuotasAdminNegativeTest-273527032 tempest-QuotasAdminNegativeTest-273527032-project] Image limits 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:57:26.605418 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-e198a54c-fd66-48c0-ab07-6c392d25f1fb tempest-QuotasAdminNegativeTest-273527032 tempest-QuotasAdminNegativeTest-273527032-project] Flavor pref 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:57:26.606171 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-e198a54c-fd66-48c0-ab07-6c392d25f1fb tempest-QuotasAdminNegativeTest-273527032 tempest-QuotasAdminNegativeTest-273527032-project] Image pref 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:57:26.609337 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-e198a54c-fd66-48c0-ab07-6c392d25f1fb tempest-QuotasAdminNegativeTest-273527032 tempest-QuotasAdminNegativeTest-273527032-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:57:26.652860 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e198a54c-fd66-48c0-ab07-6c392d25f1fb tempest-QuotasAdminNegativeTest-273527032 tempest-QuotasAdminNegativeTest-273527032-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:26.653558 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e198a54c-fd66-48c0-ab07-6c392d25f1fb tempest-QuotasAdminNegativeTest-273527032 tempest-QuotasAdminNegativeTest-273527032-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:26.654340 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e198a54c-fd66-48c0-ab07-6c392d25f1fb tempest-QuotasAdminNegativeTest-273527032 tempest-QuotasAdminNegativeTest-273527032-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:26.656007 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e198a54c-fd66-48c0-ab07-6c392d25f1fb tempest-QuotasAdminNegativeTest-273527032 tempest-QuotasAdminNegativeTest-273527032-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:26.657268 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e198a54c-fd66-48c0-ab07-6c392d25f1fb tempest-QuotasAdminNegativeTest-273527032 tempest-QuotasAdminNegativeTest-273527032-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:26.658655 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e198a54c-fd66-48c0-ab07-6c392d25f1fb tempest-QuotasAdminNegativeTest-273527032 tempest-QuotasAdminNegativeTest-273527032-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:26.701263 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-a5c4bb79-c51c-4602-9afc-a5a9579065f8 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a94113bec89469a844ede34890d6876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857b9057c949472b9a1862182a01356c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:57:26.707169 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-e198a54c-fd66-48c0-ab07-6c392d25f1fb tempest-QuotasAdminNegativeTest-273527032 tempest-QuotasAdminNegativeTest-273527032-project] Getting quotas for project 300ec767924b4db5a2103c5e7f38fcd4. Resources: {'instances', 'ram', 'cores'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:57:26.711634 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-a5c4bb79-c51c-4602-9afc-a5a9579065f8 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] 10.222.0.43 "GET /compute/v2.1/servers/16792146-aedb-4782-ba6f-5cbd7a7d0f62" status: 200 len: 1320 microversion: 2.1 time: 0.602592 Oct 04 21:57:26.712230 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1461/3009] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:57:26 2022] GET /compute/v2.1/servers/16792146-aedb-4782-ba6f-5cbd7a7d0f62 => generated 1320 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:57:26.731295 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-d0b6ebf9-b8ca-49aa-9087-7b98481f7ab6 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:57:26.732730 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-d0b6ebf9-b8ca-49aa-9087-7b98481f7ab6 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: a4cf4fac-1e9b-4669-a6ff-30008ed3642d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:57:26.740008 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-e198a54c-fd66-48c0-ab07-6c392d25f1fb tempest-QuotasAdminNegativeTest-273527032 tempest-QuotasAdminNegativeTest-273527032-project] Getting quotas for user b699234a248f4d0fb37cd875d445a210 and project 300ec767924b4db5a2103c5e7f38fcd4. Resources: {'instances', 'ram', 'cores'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:57:26.754957 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d0b6ebf9-b8ca-49aa-9087-7b98481f7ab6 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:26.759795 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d0b6ebf9-b8ca-49aa-9087-7b98481f7ab6 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:26.761212 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.utils [None req-e198a54c-fd66-48c0-ab07-6c392d25f1fb tempest-QuotasAdminNegativeTest-273527032 tempest-QuotasAdminNegativeTest-273527032-project] instances quota exceeded for 300ec767924b4db5a2103c5e7f38fcd4, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=134102) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 04 21:57:26.761998 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-e198a54c-fd66-48c0-ab07-6c392d25f1fb tempest-QuotasAdminNegativeTest-273527032 tempest-QuotasAdminNegativeTest-273527032-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 04 21:57:26.762806 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d0b6ebf9-b8ca-49aa-9087-7b98481f7ab6 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:26.767875 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-e198a54c-fd66-48c0-ab07-6c392d25f1fb tempest-QuotasAdminNegativeTest-273527032 tempest-QuotasAdminNegativeTest-273527032-project] Request method failure captured: Oct 04 21:57:26.767875 n-d-860284-1 devstack@n-api.service[134102]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 21:57:26.767875 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 21:57:26.767875 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 21:57:26.767875 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 21:57:26.767875 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 144 Oct 04 21:57:26.767875 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 21:57:26.767875 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 21:57:26.767875 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 21:57:26.767875 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 21:57:26.767875 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPKw8n843GfAWMusMCpPvjh3Vu92PK7bRSP8Qdg64qIlaKSXJj_GQ8ITylNE-FHbZ7dX9elVPGjE0FsF3-V4ZnPMjc9S2THX647bOYBlXJcAvlUOiS92GonSE1CoIwirPY8kTQRNmYmv5lYFxMdXIORcKGuz_L7a-0Ut2kOycTFsLTX8 Oct 04 21:57:26.767875 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 21:57:26.767875 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 21:57:26.767875 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 21:57:26.767875 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 21:57:26.767875 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 21:57:26.767875 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 21:57:26.767875 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: 300ec767924b4db5a2103c5e7f38fcd4 Oct 04 21:57:26.767875 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-QuotasAdminNegativeTest-273527032 Oct 04 21:57:26.767875 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 21:57:26.767875 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 21:57:26.767875 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/300ec767924b4db5a2103c5e7f38fcd4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_300ec767924b4db5a2103c5e7f38fcd4", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/300ec767924b4db5a2103c5e7f38fcd4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/300ec767924b4db5a2103c5e7f38fcd4"}]}] Oct 04 21:57:26.767875 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-QuotasAdminNegativeTest-273527032 Oct 04 21:57:26.767875 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: 300ec767924b4db5a2103c5e7f38fcd4 Oct 04 21:57:26.767875 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-273527032 Oct 04 21:57:26.767875 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-QuotasAdminNegativeTest-273527032-project Oct 04 21:57:26.767875 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 21:57:26.767875 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 21:57:26.767875 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: b699234a248f4d0fb37cd875d445a210 Oct 04 21:57:26.767875 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-QuotasAdminNegativeTest-273527032-project Oct 04 21:57:26.767875 n-d-860284-1 devstack@n-api.service[134102]: Oct 04 21:57:26.767875 n-d-860284-1 devstack@n-api.service[134102]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-167954674", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452"}} Oct 04 21:57:26.767875 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 21:57:26.767875 n-d-860284-1 devstack@n-api.service[134102]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 04 21:57:26.767875 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-167954674', 'imageRef': '58548514-5dac-426c-81f5-19e3fba33e23', 'flavorRef': '452'}}} Oct 04 21:57:26.767875 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:57:26.767875 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:57:26.767875 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 04 21:57:26.767875 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 04 21:57:26.767875 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 21:57:26.767875 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 21:57:26.767875 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 04 21:57:26.767875 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc Oct 04 21:57:26.767875 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 04 21:57:26.767875 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 04 21:57:26.767875 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 21:57:26.767875 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 21:57:26.767875 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 04 21:57:26.767875 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 04 21:57:26.767875 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 04 21:57:26.767875 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 04 21:57:26.767875 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 04 21:57:26.767875 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 04 21:57:26.767875 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] Oct 04 21:57:26.767875 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:57:26.767875 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:57:26.767875 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:57:26.767875 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:57:26.767875 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 21:57:26.767875 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 21:57:26.767875 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 21:57:26.767875 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 21:57:26.767875 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 04 21:57:26.772478 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 04 21:57:26.772478 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 04 21:57:26.772478 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 04 21:57:26.772478 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 04 21:57:26.772478 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 04 21:57:26.772478 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 04 21:57:26.772478 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:57:26.772478 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:57:26.772478 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:57:26.772478 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:57:26.772478 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:57:26.772478 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:57:26.772478 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:57:26.772478 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:57:26.772478 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:57:26.772478 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:57:26.772478 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:57:26.772478 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:57:26.772478 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:57:26.772478 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:57:26.772478 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:57:26.772478 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:57:26.772478 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 21:57:26.772478 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 04 21:57:26.772478 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 04 21:57:26.772478 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 04 21:57:26.772478 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:57:26.772478 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:57:26.772478 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:57:26.772478 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:57:26.772478 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:57:26.772478 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:57:26.772478 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:57:26.772478 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:57:26.772478 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 04 21:57:26.772478 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:57:26.776777 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d0b6ebf9-b8ca-49aa-9087-7b98481f7ab6 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:26.776777 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d0b6ebf9-b8ca-49aa-9087-7b98481f7ab6 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:26.776777 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d0b6ebf9-b8ca-49aa-9087-7b98481f7ab6 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:26.779174 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-e198a54c-fd66-48c0-ab07-6c392d25f1fb tempest-QuotasAdminNegativeTest-273527032 tempest-QuotasAdminNegativeTest-273527032-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:57:26.780480 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-e198a54c-fd66-48c0-ab07-6c392d25f1fb tempest-QuotasAdminNegativeTest-273527032 tempest-QuotasAdminNegativeTest-273527032-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 1.853374 Oct 04 21:57:26.781752 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1549/3010] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 21:57:24 2022] POST /compute/v2.1/servers => generated 119 bytes in 1855 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:57:26.800463 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-2324d344-f9c3-42f7-a617-7672db6558f9 tempest-QuotasAdminNegativeTest-568474115 tempest-QuotasAdminNegativeTest-568474115-project-admin] Action: 'update', calling method: .version_select at 0x7fbb2e610310>, body: {"quota_set": {"instances": 10}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:57:27.287177 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2324d344-f9c3-42f7-a617-7672db6558f9 tempest-QuotasAdminNegativeTest-568474115 tempest-QuotasAdminNegativeTest-568474115-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:27.293246 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2324d344-f9c3-42f7-a617-7672db6558f9 tempest-QuotasAdminNegativeTest-568474115 tempest-QuotasAdminNegativeTest-568474115-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:27.294939 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2324d344-f9c3-42f7-a617-7672db6558f9 tempest-QuotasAdminNegativeTest-568474115 tempest-QuotasAdminNegativeTest-568474115-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:27.297142 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2324d344-f9c3-42f7-a617-7672db6558f9 tempest-QuotasAdminNegativeTest-568474115 tempest-QuotasAdminNegativeTest-568474115-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:27.300365 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2324d344-f9c3-42f7-a617-7672db6558f9 tempest-QuotasAdminNegativeTest-568474115 tempest-QuotasAdminNegativeTest-568474115-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:27.301125 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2324d344-f9c3-42f7-a617-7672db6558f9 tempest-QuotasAdminNegativeTest-568474115 tempest-QuotasAdminNegativeTest-568474115-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:27.365116 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-d0b6ebf9-b8ca-49aa-9087-7b98481f7ab6 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2facee4c6a40416e908083e126d2cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07a17a482a4e92b6ddbdee463c8029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:57:27.377257 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-d0b6ebf9-b8ca-49aa-9087-7b98481f7ab6 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d" status: 200 len: 1316 microversion: 2.1 time: 0.661572 Oct 04 21:57:27.377865 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1462/3011] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:57:26 2022] GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d => generated 1316 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:57:27.411341 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-fa6dde76-5361-4239-ba25-21a13e5fc4ee tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:57:27.412088 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-fa6dde76-5361-4239-ba25-21a13e5fc4ee tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] [instance: dad442d9-d2e1-49ee-93ea-6e5090634df8] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:57:27.432116 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fa6dde76-5361-4239-ba25-21a13e5fc4ee tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:27.432634 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fa6dde76-5361-4239-ba25-21a13e5fc4ee tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:27.433939 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fa6dde76-5361-4239-ba25-21a13e5fc4ee tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:27.438162 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fa6dde76-5361-4239-ba25-21a13e5fc4ee tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:27.438914 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fa6dde76-5361-4239-ba25-21a13e5fc4ee tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:27.441830 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fa6dde76-5361-4239-ba25-21a13e5fc4ee tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:27.498164 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-2324d344-f9c3-42f7-a617-7672db6558f9 tempest-QuotasAdminNegativeTest-568474115 tempest-QuotasAdminNegativeTest-568474115-project-admin] 10.222.0.43 "PUT /compute/v2.1/os-quota-sets/300ec767924b4db5a2103c5e7f38fcd4" status: 200 len: 329 microversion: 2.1 time: 0.711342 Oct 04 21:57:27.510281 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1550/3012] 10.222.0.43 () {60 vars in 1262 bytes} [Tue Oct 4 21:57:26 2022] PUT /compute/v2.1/os-quota-sets/300ec767924b4db5a2103c5e7f38fcd4 => generated 329 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:57:27.515548 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-51e28503-c734-4875-9bc2-1df1ba0f44e0 req-05552f14-93ef-4633-84dc-90d7c3dec6b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16792146-aedb-4782-ba6f-5cbd7a7d0f62", "tag": "08edbe4b-d2a0-4913-8c9e-e4477409197e"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:57:27.562048 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-51e28503-c734-4875-9bc2-1df1ba0f44e0 req-05552f14-93ef-4633-84dc-90d7c3dec6b5 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:27.562863 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-51e28503-c734-4875-9bc2-1df1ba0f44e0 req-05552f14-93ef-4633-84dc-90d7c3dec6b5 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:27.563478 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-51e28503-c734-4875-9bc2-1df1ba0f44e0 req-05552f14-93ef-4633-84dc-90d7c3dec6b5 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:27.586156 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-51e28503-c734-4875-9bc2-1df1ba0f44e0 req-05552f14-93ef-4633-84dc-90d7c3dec6b5 service nova] Creating event network-changed:08edbe4b-d2a0-4913-8c9e-e4477409197e for instance 16792146-aedb-4782-ba6f-5cbd7a7d0f62 on n-h1-860284-1 Oct 04 21:57:27.598939 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-51e28503-c734-4875-9bc2-1df1ba0f44e0 req-05552f14-93ef-4633-84dc-90d7c3dec6b5 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086321 Oct 04 21:57:27.604443 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1551/3013] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:57:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:57:27.616854 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-1cd839f9-2494-464c-86d0-b684975b5adc tempest-QuotasAdminNegativeTest-568474115 tempest-QuotasAdminNegativeTest-568474115-project-admin] Calling method '.version_select at 0x7fbb2e61cdc0>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:57:28.154321 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-1cd839f9-2494-464c-86d0-b684975b5adc tempest-QuotasAdminNegativeTest-568474115 tempest-QuotasAdminNegativeTest-568474115-project-admin] 10.222.0.43 "GET /compute/v2.1/os-quota-sets/300ec767924b4db5a2103c5e7f38fcd4" status: 200 len: 371 microversion: 2.1 time: 0.547702 Oct 04 21:57:28.154970 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1552/3014] 10.222.0.43 () {58 vars in 1242 bytes} [Tue Oct 4 21:57:27 2022] GET /compute/v2.1/os-quota-sets/300ec767924b4db5a2103c5e7f38fcd4 => generated 371 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:57:28.176840 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-a98dcb8c-ede5-45a2-b42f-2c13de92fc01 req-10d32f3f-0fd7-43e5-8192-922b3c61a39c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4cf4fac-1e9b-4669-a6ff-30008ed3642d", "name": "network-vif-plugged", "status": "completed", "tag": "17823d3d-fc62-47ee-8e12-cf0154daa955"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:57:28.201049 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-a98dcb8c-ede5-45a2-b42f-2c13de92fc01 req-10d32f3f-0fd7-43e5-8192-922b3c61a39c service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:28.201534 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-a98dcb8c-ede5-45a2-b42f-2c13de92fc01 req-10d32f3f-0fd7-43e5-8192-922b3c61a39c service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:28.201974 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-a98dcb8c-ede5-45a2-b42f-2c13de92fc01 req-10d32f3f-0fd7-43e5-8192-922b3c61a39c service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:28.236625 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-a98dcb8c-ede5-45a2-b42f-2c13de92fc01 req-10d32f3f-0fd7-43e5-8192-922b3c61a39c service nova] Creating event network-vif-plugged:17823d3d-fc62-47ee-8e12-cf0154daa955 for instance a4cf4fac-1e9b-4669-a6ff-30008ed3642d on n-h1-860284-1 Oct 04 21:57:28.242254 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-a98dcb8c-ede5-45a2-b42f-2c13de92fc01 req-10d32f3f-0fd7-43e5-8192-922b3c61a39c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070334 Oct 04 21:57:28.242919 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1553/3015] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:57:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:57:28.248427 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-49042d0f-8a0a-4556-b247-0f9c9cafd61c tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:57:28.256295 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-49042d0f-8a0a-4556-b247-0f9c9cafd61c tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] [instance: 16792146-aedb-4782-ba6f-5cbd7a7d0f62] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:57:28.277880 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-49042d0f-8a0a-4556-b247-0f9c9cafd61c tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:28.285271 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-49042d0f-8a0a-4556-b247-0f9c9cafd61c tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:28.286062 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-49042d0f-8a0a-4556-b247-0f9c9cafd61c tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:28.286861 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-49042d0f-8a0a-4556-b247-0f9c9cafd61c tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:28.287336 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-49042d0f-8a0a-4556-b247-0f9c9cafd61c tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:28.287772 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-49042d0f-8a0a-4556-b247-0f9c9cafd61c tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:28.443835 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-fa6dde76-5361-4239-ba25-21a13e5fc4ee tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e807c724cc4c3887a2d360f0584ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40071e45805146529fb8abd40629c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:57:28.460475 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-fa6dde76-5361-4239-ba25-21a13e5fc4ee tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] 10.222.0.43 "GET /compute/v2.1/servers/dad442d9-d2e1-49ee-93ea-6e5090634df8" status: 200 len: 1307 microversion: 2.1 time: 1.077567 Oct 04 21:57:28.461534 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1463/3016] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:57:27 2022] GET /compute/v2.1/servers/dad442d9-d2e1-49ee-93ea-6e5090634df8 => generated 1307 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:57:28.477606 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-c252d260-b3d8-45a9-aa18-2a0338538159 tempest-QuotasAdminNegativeTest-568474115 tempest-QuotasAdminNegativeTest-568474115-project-admin] Action: 'update', calling method: .version_select at 0x7fbb2e3685e0>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:57:29.213012 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-49042d0f-8a0a-4556-b247-0f9c9cafd61c tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a94113bec89469a844ede34890d6876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857b9057c949472b9a1862182a01356c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:57:29.232959 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-49042d0f-8a0a-4556-b247-0f9c9cafd61c tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] 10.222.0.43 "GET /compute/v2.1/servers/16792146-aedb-4782-ba6f-5cbd7a7d0f62" status: 200 len: 1320 microversion: 2.1 time: 0.988605 Oct 04 21:57:29.233737 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1554/3017] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:57:28 2022] GET /compute/v2.1/servers/16792146-aedb-4782-ba6f-5cbd7a7d0f62 => generated 1320 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:57:29.242301 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-cb920119-211c-4624-9320-fdcda15e5088 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:57:29.243307 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-cb920119-211c-4624-9320-fdcda15e5088 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: a4cf4fac-1e9b-4669-a6ff-30008ed3642d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:57:29.250309 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c252d260-b3d8-45a9-aa18-2a0338538159 tempest-QuotasAdminNegativeTest-568474115 tempest-QuotasAdminNegativeTest-568474115-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:29.254486 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cb920119-211c-4624-9320-fdcda15e5088 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:29.254486 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cb920119-211c-4624-9320-fdcda15e5088 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:29.257264 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c252d260-b3d8-45a9-aa18-2a0338538159 tempest-QuotasAdminNegativeTest-568474115 tempest-QuotasAdminNegativeTest-568474115-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:29.259352 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c252d260-b3d8-45a9-aa18-2a0338538159 tempest-QuotasAdminNegativeTest-568474115 tempest-QuotasAdminNegativeTest-568474115-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:29.260561 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c252d260-b3d8-45a9-aa18-2a0338538159 tempest-QuotasAdminNegativeTest-568474115 tempest-QuotasAdminNegativeTest-568474115-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:29.262608 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cb920119-211c-4624-9320-fdcda15e5088 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:29.263503 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cb920119-211c-4624-9320-fdcda15e5088 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:29.263989 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cb920119-211c-4624-9320-fdcda15e5088 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:29.264438 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cb920119-211c-4624-9320-fdcda15e5088 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:29.264852 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c252d260-b3d8-45a9-aa18-2a0338538159 tempest-QuotasAdminNegativeTest-568474115 tempest-QuotasAdminNegativeTest-568474115-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:29.265580 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c252d260-b3d8-45a9-aa18-2a0338538159 tempest-QuotasAdminNegativeTest-568474115 tempest-QuotasAdminNegativeTest-568474115-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:29.327609 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:57:29.422769 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-c252d260-b3d8-45a9-aa18-2a0338538159 tempest-QuotasAdminNegativeTest-568474115 tempest-QuotasAdminNegativeTest-568474115-project-admin] 10.222.0.43 "PUT /compute/v2.1/os-quota-sets/300ec767924b4db5a2103c5e7f38fcd4" status: 200 len: 325 microversion: 2.1 time: 0.957397 Oct 04 21:57:29.426223 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1464/3018] 10.222.0.43 () {60 vars in 1262 bytes} [Tue Oct 4 21:57:28 2022] PUT /compute/v2.1/os-quota-sets/300ec767924b4db5a2103c5e7f38fcd4 => generated 325 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:57:29.490108 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-8b11aa99-1545-4344-9b73-47bc21975d55 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:57:29.490943 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-8b11aa99-1545-4344-9b73-47bc21975d55 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] [instance: dad442d9-d2e1-49ee-93ea-6e5090634df8] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:57:29.504693 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8b11aa99-1545-4344-9b73-47bc21975d55 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:29.505201 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8b11aa99-1545-4344-9b73-47bc21975d55 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:29.506452 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8b11aa99-1545-4344-9b73-47bc21975d55 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:29.509757 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8b11aa99-1545-4344-9b73-47bc21975d55 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:29.511266 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8b11aa99-1545-4344-9b73-47bc21975d55 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:29.513629 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8b11aa99-1545-4344-9b73-47bc21975d55 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:29.685251 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-cb920119-211c-4624-9320-fdcda15e5088 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2facee4c6a40416e908083e126d2cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07a17a482a4e92b6ddbdee463c8029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:57:29.698115 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-cb920119-211c-4624-9320-fdcda15e5088 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d" status: 200 len: 1316 microversion: 2.1 time: 0.459567 Oct 04 21:57:29.701505 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1555/3019] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:57:29 2022] GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d => generated 1316 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:57:29.710031 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-4a437bc1-486f-4f0f-80cf-f98eaceee972 tempest-QuotasAdminNegativeTest-273527032 tempest-QuotasAdminNegativeTest-273527032-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1372643206", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452"}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:57:29.828824 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.network.neutron [None req-4a437bc1-486f-4f0f-80cf-f98eaceee972 tempest-QuotasAdminNegativeTest-273527032 tempest-QuotasAdminNegativeTest-273527032-project] validate_networks() for None {{(pid=134102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:57:30.037693 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-8b11aa99-1545-4344-9b73-47bc21975d55 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e807c724cc4c3887a2d360f0584ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40071e45805146529fb8abd40629c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:57:30.047248 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-8b11aa99-1545-4344-9b73-47bc21975d55 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] 10.222.0.43 "GET /compute/v2.1/servers/dad442d9-d2e1-49ee-93ea-6e5090634df8" status: 200 len: 1307 microversion: 2.1 time: 0.563310 Oct 04 21:57:30.048426 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1465/3020] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:57:29 2022] GET /compute/v2.1/servers/dad442d9-d2e1-49ee-93ea-6e5090634df8 => generated 1307 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:57:30.054516 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-4db671fb-d360-4ec7-a910-fca7002cd70e req-748f6e28-8049-4568-bb31-c604ee9dd1a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dad442d9-d2e1-49ee-93ea-6e5090634df8", "tag": "38ab1df9-0112-4774-abf7-063259d4b821"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:57:30.066450 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-4db671fb-d360-4ec7-a910-fca7002cd70e req-748f6e28-8049-4568-bb31-c604ee9dd1a6 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:30.066944 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-4db671fb-d360-4ec7-a910-fca7002cd70e req-748f6e28-8049-4568-bb31-c604ee9dd1a6 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:30.067586 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-4db671fb-d360-4ec7-a910-fca7002cd70e req-748f6e28-8049-4568-bb31-c604ee9dd1a6 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:30.081977 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-4db671fb-d360-4ec7-a910-fca7002cd70e req-748f6e28-8049-4568-bb31-c604ee9dd1a6 service nova] Creating event network-changed:38ab1df9-0112-4774-abf7-063259d4b821 for instance dad442d9-d2e1-49ee-93ea-6e5090634df8 on n-h2-860284-1 Oct 04 21:57:30.088156 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-4db671fb-d360-4ec7-a910-fca7002cd70e req-748f6e28-8049-4568-bb31-c604ee9dd1a6 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037143 Oct 04 21:57:30.089518 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1466/3021] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:57:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:57:30.262835 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-53bb3d26-96e6-4b8b-ab8a-797ffce3ec3e tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:57:30.263541 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-53bb3d26-96e6-4b8b-ab8a-797ffce3ec3e tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] [instance: 16792146-aedb-4782-ba6f-5cbd7a7d0f62] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:57:30.273067 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-53bb3d26-96e6-4b8b-ab8a-797ffce3ec3e tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:30.273722 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-53bb3d26-96e6-4b8b-ab8a-797ffce3ec3e tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:30.274215 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-53bb3d26-96e6-4b8b-ab8a-797ffce3ec3e tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:30.275050 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-53bb3d26-96e6-4b8b-ab8a-797ffce3ec3e tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:30.275499 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-53bb3d26-96e6-4b8b-ab8a-797ffce3ec3e tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:30.276103 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-53bb3d26-96e6-4b8b-ab8a-797ffce3ec3e tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:30.306397 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-4a437bc1-486f-4f0f-80cf-f98eaceee972 tempest-QuotasAdminNegativeTest-273527032 tempest-QuotasAdminNegativeTest-273527032-project] Flavor limits 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:57:30.306877 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-4a437bc1-486f-4f0f-80cf-f98eaceee972 tempest-QuotasAdminNegativeTest-273527032 tempest-QuotasAdminNegativeTest-273527032-project] Image limits 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:57:30.307325 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-4a437bc1-486f-4f0f-80cf-f98eaceee972 tempest-QuotasAdminNegativeTest-273527032 tempest-QuotasAdminNegativeTest-273527032-project] Flavor pref 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:57:30.308578 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-4a437bc1-486f-4f0f-80cf-f98eaceee972 tempest-QuotasAdminNegativeTest-273527032 tempest-QuotasAdminNegativeTest-273527032-project] Image pref 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:57:30.309007 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-4a437bc1-486f-4f0f-80cf-f98eaceee972 tempest-QuotasAdminNegativeTest-273527032 tempest-QuotasAdminNegativeTest-273527032-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:57:30.319802 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4a437bc1-486f-4f0f-80cf-f98eaceee972 tempest-QuotasAdminNegativeTest-273527032 tempest-QuotasAdminNegativeTest-273527032-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:30.320157 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4a437bc1-486f-4f0f-80cf-f98eaceee972 tempest-QuotasAdminNegativeTest-273527032 tempest-QuotasAdminNegativeTest-273527032-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:30.320593 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4a437bc1-486f-4f0f-80cf-f98eaceee972 tempest-QuotasAdminNegativeTest-273527032 tempest-QuotasAdminNegativeTest-273527032-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:30.321612 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4a437bc1-486f-4f0f-80cf-f98eaceee972 tempest-QuotasAdminNegativeTest-273527032 tempest-QuotasAdminNegativeTest-273527032-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:30.322266 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4a437bc1-486f-4f0f-80cf-f98eaceee972 tempest-QuotasAdminNegativeTest-273527032 tempest-QuotasAdminNegativeTest-273527032-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:30.322900 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4a437bc1-486f-4f0f-80cf-f98eaceee972 tempest-QuotasAdminNegativeTest-273527032 tempest-QuotasAdminNegativeTest-273527032-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:30.343044 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-4a437bc1-486f-4f0f-80cf-f98eaceee972 tempest-QuotasAdminNegativeTest-273527032 tempest-QuotasAdminNegativeTest-273527032-project] Getting quotas for project 300ec767924b4db5a2103c5e7f38fcd4. Resources: {'instances', 'ram', 'cores'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:57:30.350191 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-4a437bc1-486f-4f0f-80cf-f98eaceee972 tempest-QuotasAdminNegativeTest-273527032 tempest-QuotasAdminNegativeTest-273527032-project] Getting quotas for user b699234a248f4d0fb37cd875d445a210 and project 300ec767924b4db5a2103c5e7f38fcd4. Resources: {'instances', 'ram', 'cores'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:57:30.364829 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.utils [None req-4a437bc1-486f-4f0f-80cf-f98eaceee972 tempest-QuotasAdminNegativeTest-273527032 tempest-QuotasAdminNegativeTest-273527032-project] ram quota exceeded for 300ec767924b4db5a2103c5e7f38fcd4, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=134102) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 04 21:57:30.365358 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-4a437bc1-486f-4f0f-80cf-f98eaceee972 tempest-QuotasAdminNegativeTest-273527032 tempest-QuotasAdminNegativeTest-273527032-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 04 21:57:30.367947 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-4a437bc1-486f-4f0f-80cf-f98eaceee972 tempest-QuotasAdminNegativeTest-273527032 tempest-QuotasAdminNegativeTest-273527032-project] Request method failure captured: Oct 04 21:57:30.367947 n-d-860284-1 devstack@n-api.service[134102]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 21:57:30.367947 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 21:57:30.367947 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 21:57:30.367947 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 21:57:30.367947 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 145 Oct 04 21:57:30.367947 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 21:57:30.367947 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 21:57:30.367947 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 21:57:30.367947 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 21:57:30.367947 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPKw8n843GfAWMusMCpPvjh3Vu92PK7bRSP8Qdg64qIlaKSXJj_GQ8ITylNE-FHbZ7dX9elVPGjE0FsF3-V4ZnPMjc9S2THX647bOYBlXJcAvlUOiS92GonSE1CoIwirPY8kTQRNmYmv5lYFxMdXIORcKGuz_L7a-0Ut2kOycTFsLTX8 Oct 04 21:57:30.367947 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 21:57:30.367947 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 21:57:30.367947 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 21:57:30.367947 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 21:57:30.367947 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 21:57:30.367947 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 21:57:30.367947 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: 300ec767924b4db5a2103c5e7f38fcd4 Oct 04 21:57:30.367947 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-QuotasAdminNegativeTest-273527032 Oct 04 21:57:30.367947 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 21:57:30.367947 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 21:57:30.367947 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/300ec767924b4db5a2103c5e7f38fcd4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_300ec767924b4db5a2103c5e7f38fcd4", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/300ec767924b4db5a2103c5e7f38fcd4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/300ec767924b4db5a2103c5e7f38fcd4"}]}] Oct 04 21:57:30.367947 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-QuotasAdminNegativeTest-273527032 Oct 04 21:57:30.367947 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: 300ec767924b4db5a2103c5e7f38fcd4 Oct 04 21:57:30.367947 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-273527032 Oct 04 21:57:30.367947 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-QuotasAdminNegativeTest-273527032-project Oct 04 21:57:30.367947 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 21:57:30.367947 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 21:57:30.367947 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: b699234a248f4d0fb37cd875d445a210 Oct 04 21:57:30.367947 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-QuotasAdminNegativeTest-273527032-project Oct 04 21:57:30.367947 n-d-860284-1 devstack@n-api.service[134102]: Oct 04 21:57:30.367947 n-d-860284-1 devstack@n-api.service[134102]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1372643206", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452"}} Oct 04 21:57:30.367947 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 21:57:30.367947 n-d-860284-1 devstack@n-api.service[134102]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 04 21:57:30.367947 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1372643206', 'imageRef': '58548514-5dac-426c-81f5-19e3fba33e23', 'flavorRef': '452'}}} Oct 04 21:57:30.367947 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:57:30.367947 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:57:30.367947 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 04 21:57:30.367947 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 04 21:57:30.367947 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 21:57:30.367947 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 21:57:30.367947 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 04 21:57:30.367947 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc Oct 04 21:57:30.367947 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 04 21:57:30.367947 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 04 21:57:30.367947 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 21:57:30.367947 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 21:57:30.367947 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 04 21:57:30.367947 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 04 21:57:30.367947 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 04 21:57:30.367947 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 04 21:57:30.367947 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 04 21:57:30.367947 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 04 21:57:30.367947 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Oct 04 21:57:30.367947 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:57:30.367947 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:57:30.367947 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:57:30.367947 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:57:30.367947 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 21:57:30.367947 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 21:57:30.367947 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 21:57:30.367947 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 21:57:30.367947 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 04 21:57:30.372221 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 04 21:57:30.372221 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 04 21:57:30.372221 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 04 21:57:30.372221 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 04 21:57:30.372221 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 04 21:57:30.372221 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 04 21:57:30.372221 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:57:30.372221 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:57:30.372221 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:57:30.372221 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:57:30.372221 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:57:30.372221 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:57:30.372221 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:57:30.372221 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:57:30.372221 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:57:30.372221 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:57:30.372221 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:57:30.372221 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:57:30.372221 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:57:30.372221 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:57:30.372221 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:57:30.372221 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:57:30.372221 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 21:57:30.372221 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 04 21:57:30.372221 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 04 21:57:30.372221 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 04 21:57:30.372221 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:57:30.372221 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:57:30.372221 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:57:30.372221 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:57:30.372221 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:57:30.372221 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:57:30.372221 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:57:30.372221 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:57:30.372221 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 04 21:57:30.372221 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:57:30.375798 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-4a437bc1-486f-4f0f-80cf-f98eaceee972 tempest-QuotasAdminNegativeTest-273527032 tempest-QuotasAdminNegativeTest-273527032-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:57:30.377647 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-4a437bc1-486f-4f0f-80cf-f98eaceee972 tempest-QuotasAdminNegativeTest-273527032 tempest-QuotasAdminNegativeTest-273527032-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 0.674116 Oct 04 21:57:30.382077 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1556/3022] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 21:57:29 2022] POST /compute/v2.1/servers => generated 110 bytes in 680 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:57:30.386874 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-a460293c-6792-4a3d-b05a-7fdf9a51b8a8 tempest-QuotasAdminNegativeTest-568474115 tempest-QuotasAdminNegativeTest-568474115-project-admin] Action: 'update', calling method: .version_select at 0x7fbb2e6f23a0>, body: {"quota_set": {"ram": 51200}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:57:30.563461 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-53bb3d26-96e6-4b8b-ab8a-797ffce3ec3e tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a94113bec89469a844ede34890d6876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857b9057c949472b9a1862182a01356c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:57:30.572549 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-53bb3d26-96e6-4b8b-ab8a-797ffce3ec3e tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] 10.222.0.43 "GET /compute/v2.1/servers/16792146-aedb-4782-ba6f-5cbd7a7d0f62" status: 200 len: 1320 microversion: 2.1 time: 0.315286 Oct 04 21:57:30.590685 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1467/3023] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:57:30 2022] GET /compute/v2.1/servers/16792146-aedb-4782-ba6f-5cbd7a7d0f62 => generated 1320 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:57:30.734389 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-ad458804-f1b4-401c-9408-2de2394252fa tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:57:30.735441 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-ad458804-f1b4-401c-9408-2de2394252fa tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: a4cf4fac-1e9b-4669-a6ff-30008ed3642d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:57:30.754123 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ad458804-f1b4-401c-9408-2de2394252fa tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:30.754899 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ad458804-f1b4-401c-9408-2de2394252fa tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:30.755501 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ad458804-f1b4-401c-9408-2de2394252fa tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:30.756380 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ad458804-f1b4-401c-9408-2de2394252fa tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:30.757006 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ad458804-f1b4-401c-9408-2de2394252fa tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:30.757627 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ad458804-f1b4-401c-9408-2de2394252fa tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:30.880444 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a460293c-6792-4a3d-b05a-7fdf9a51b8a8 tempest-QuotasAdminNegativeTest-568474115 tempest-QuotasAdminNegativeTest-568474115-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:30.880938 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a460293c-6792-4a3d-b05a-7fdf9a51b8a8 tempest-QuotasAdminNegativeTest-568474115 tempest-QuotasAdminNegativeTest-568474115-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:30.884644 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a460293c-6792-4a3d-b05a-7fdf9a51b8a8 tempest-QuotasAdminNegativeTest-568474115 tempest-QuotasAdminNegativeTest-568474115-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:30.886195 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a460293c-6792-4a3d-b05a-7fdf9a51b8a8 tempest-QuotasAdminNegativeTest-568474115 tempest-QuotasAdminNegativeTest-568474115-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:30.887256 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a460293c-6792-4a3d-b05a-7fdf9a51b8a8 tempest-QuotasAdminNegativeTest-568474115 tempest-QuotasAdminNegativeTest-568474115-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:30.893022 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a460293c-6792-4a3d-b05a-7fdf9a51b8a8 tempest-QuotasAdminNegativeTest-568474115 tempest-QuotasAdminNegativeTest-568474115-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:31.030892 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-a460293c-6792-4a3d-b05a-7fdf9a51b8a8 tempest-QuotasAdminNegativeTest-568474115 tempest-QuotasAdminNegativeTest-568474115-project-admin] 10.222.0.43 "PUT /compute/v2.1/os-quota-sets/300ec767924b4db5a2103c5e7f38fcd4" status: 200 len: 329 microversion: 2.1 time: 0.646627 Oct 04 21:57:31.033545 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1557/3024] 10.222.0.43 () {60 vars in 1262 bytes} [Tue Oct 4 21:57:30 2022] PUT /compute/v2.1/os-quota-sets/300ec767924b4db5a2103c5e7f38fcd4 => generated 329 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:57:31.057857 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-6fda3f47-e376-45d4-9017-a4ffd247997f tempest-QuotasAdminNegativeTest-273527032 tempest-QuotasAdminNegativeTest-273527032-project] Action: 'update', calling method: .version_select at 0x7fbb2e72adc0>, body: {"quota_set": {"ram": 0}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:57:31.065132 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-6fda3f47-e376-45d4-9017-a4ffd247997f tempest-QuotasAdminNegativeTest-273527032 tempest-QuotasAdminNegativeTest-273527032-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': 'b699234a248f4d0fb37cd875d445a210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300ec767924b4db5a2103c5e7f38fcd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:57:31.083865 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-6fda3f47-e376-45d4-9017-a4ffd247997f tempest-QuotasAdminNegativeTest-273527032 tempest-QuotasAdminNegativeTest-273527032-project] Request method failure captured: Oct 04 21:57:31.083865 n-d-860284-1 devstack@n-api.service[134102]: request: PUT /compute/v2.1/os-quota-sets/300ec767924b4db5a2103c5e7f38fcd4 HTTP/1.1 Oct 04 21:57:31.083865 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 21:57:31.083865 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 21:57:31.083865 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 21:57:31.083865 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 25 Oct 04 21:57:31.083865 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 21:57:31.083865 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 21:57:31.083865 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 21:57:31.083865 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 21:57:31.083865 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPKw8n843GfAWMusMCpPvjh3Vu92PK7bRSP8Qdg64qIlaKSXJj_GQ8ITylNE-FHbZ7dX9elVPGjE0FsF3-V4ZnPMjc9S2THX647bOYBlXJcAvlUOiS92GonSE1CoIwirPY8kTQRNmYmv5lYFxMdXIORcKGuz_L7a-0Ut2kOycTFsLTX8 Oct 04 21:57:31.083865 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 21:57:31.083865 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 21:57:31.083865 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 21:57:31.083865 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 21:57:31.083865 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 21:57:31.083865 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 21:57:31.083865 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: 300ec767924b4db5a2103c5e7f38fcd4 Oct 04 21:57:31.083865 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-QuotasAdminNegativeTest-273527032 Oct 04 21:57:31.083865 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 21:57:31.083865 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 21:57:31.083865 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/300ec767924b4db5a2103c5e7f38fcd4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_300ec767924b4db5a2103c5e7f38fcd4", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/300ec767924b4db5a2103c5e7f38fcd4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/300ec767924b4db5a2103c5e7f38fcd4"}]}] Oct 04 21:57:31.083865 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-QuotasAdminNegativeTest-273527032 Oct 04 21:57:31.083865 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: 300ec767924b4db5a2103c5e7f38fcd4 Oct 04 21:57:31.083865 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-273527032 Oct 04 21:57:31.083865 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-QuotasAdminNegativeTest-273527032-project Oct 04 21:57:31.083865 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 21:57:31.083865 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 21:57:31.083865 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: b699234a248f4d0fb37cd875d445a210 Oct 04 21:57:31.083865 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-QuotasAdminNegativeTest-273527032-project Oct 04 21:57:31.083865 n-d-860284-1 devstack@n-api.service[134102]: Oct 04 21:57:31.083865 n-d-860284-1 devstack@n-api.service[134102]: {"quota_set": {"ram": 0}} Oct 04 21:57:31.083865 n-d-860284-1 devstack@n-api.service[134102]: method: Oct 04 21:57:31.083865 n-d-860284-1 devstack@n-api.service[134102]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 04 21:57:31.083865 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': '300ec767924b4db5a2103c5e7f38fcd4', 'body': {'quota_set': {'ram': 0}}} Oct 04 21:57:31.083865 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:57:31.083865 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:57:31.083865 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:57:31.083865 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:57:31.083865 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:57:31.083865 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:57:31.083865 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:57:31.083865 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:57:31.083865 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:57:31.083865 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:57:31.083865 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:57:31.083865 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:57:31.083865 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update Oct 04 21:57:31.083865 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) Oct 04 21:57:31.083865 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 21:57:31.083865 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:57:31.083865 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 21:57:31.083865 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:57:31.083865 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update Oct 04 21:57:31.083865 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) Oct 04 21:57:31.083865 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 21:57:31.083865 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 21:57:31.083865 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 21:57:31.083865 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 21:57:31.083865 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 21:57:31.083865 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 21:57:31.083865 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 21:57:31.083865 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 21:57:31.083865 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 21:57:31.083865 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 21:57:31.090099 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 21:57:31.090099 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 21:57:31.090099 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 21:57:31.090099 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 21:57:31.090099 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 04 21:57:31.090099 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:57:31.090099 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:57:31.090099 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:57:31.090099 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:57:31.090099 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:57:31.090099 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:57:31.090099 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 21:57:31.090099 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 21:57:31.090099 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 04 21:57:31.090099 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:57:31.094426 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-6fda3f47-e376-45d4-9017-a4ffd247997f tempest-QuotasAdminNegativeTest-273527032 tempest-QuotasAdminNegativeTest-273527032-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:57:31.096704 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-6fda3f47-e376-45d4-9017-a4ffd247997f tempest-QuotasAdminNegativeTest-273527032 tempest-QuotasAdminNegativeTest-273527032-project] 10.222.0.43 "PUT /compute/v2.1/os-quota-sets/300ec767924b4db5a2103c5e7f38fcd4" status: 403 len: 116 microversion: 2.1 time: 0.050898 Oct 04 21:57:31.105059 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1558/3025] 10.222.0.43 () {60 vars in 1262 bytes} [Tue Oct 4 21:57:31 2022] PUT /compute/v2.1/os-quota-sets/300ec767924b4db5a2103c5e7f38fcd4 => generated 116 bytes in 60 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:57:31.123717 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-8fbc1432-6893-447a-a191-c51df6bf2a77 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:57:31.125126 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-8fbc1432-6893-447a-a191-c51df6bf2a77 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] [instance: dad442d9-d2e1-49ee-93ea-6e5090634df8] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:57:31.127282 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-ad458804-f1b4-401c-9408-2de2394252fa tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2facee4c6a40416e908083e126d2cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07a17a482a4e92b6ddbdee463c8029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:57:31.138410 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-ad458804-f1b4-401c-9408-2de2394252fa tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d" status: 200 len: 1316 microversion: 2.1 time: 0.408397 Oct 04 21:57:31.142813 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1468/3026] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:57:30 2022] GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d => generated 1316 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:57:31.158407 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8fbc1432-6893-447a-a191-c51df6bf2a77 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:31.159112 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8fbc1432-6893-447a-a191-c51df6bf2a77 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:31.159614 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8fbc1432-6893-447a-a191-c51df6bf2a77 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:31.160495 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8fbc1432-6893-447a-a191-c51df6bf2a77 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:31.160967 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8fbc1432-6893-447a-a191-c51df6bf2a77 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:31.161477 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8fbc1432-6893-447a-a191-c51df6bf2a77 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:31.523372 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-8fbc1432-6893-447a-a191-c51df6bf2a77 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e807c724cc4c3887a2d360f0584ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40071e45805146529fb8abd40629c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:57:31.539491 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-8fbc1432-6893-447a-a191-c51df6bf2a77 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] 10.222.0.43 "GET /compute/v2.1/servers/dad442d9-d2e1-49ee-93ea-6e5090634df8" status: 200 len: 1307 microversion: 2.1 time: 0.429000 Oct 04 21:57:31.545323 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1559/3027] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:57:31 2022] GET /compute/v2.1/servers/dad442d9-d2e1-49ee-93ea-6e5090634df8 => generated 1307 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:57:31.604798 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-3d0b6c04-2e24-4cd0-9b7b-e8b8471d320a tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:57:31.606054 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-3d0b6c04-2e24-4cd0-9b7b-e8b8471d320a tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] [instance: 16792146-aedb-4782-ba6f-5cbd7a7d0f62] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:57:31.622402 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3d0b6c04-2e24-4cd0-9b7b-e8b8471d320a tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:31.625829 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3d0b6c04-2e24-4cd0-9b7b-e8b8471d320a tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:31.627596 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3d0b6c04-2e24-4cd0-9b7b-e8b8471d320a tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:31.632472 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3d0b6c04-2e24-4cd0-9b7b-e8b8471d320a tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:31.633978 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3d0b6c04-2e24-4cd0-9b7b-e8b8471d320a tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:31.636453 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3d0b6c04-2e24-4cd0-9b7b-e8b8471d320a tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:31.700879 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=100 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:57:31.969510 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-3d0b6c04-2e24-4cd0-9b7b-e8b8471d320a tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a94113bec89469a844ede34890d6876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857b9057c949472b9a1862182a01356c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:57:31.990629 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-3d0b6c04-2e24-4cd0-9b7b-e8b8471d320a tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] 10.222.0.43 "GET /compute/v2.1/servers/16792146-aedb-4782-ba6f-5cbd7a7d0f62" status: 200 len: 1320 microversion: 2.1 time: 0.388215 Oct 04 21:57:31.992072 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1469/3028] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:57:31 2022] GET /compute/v2.1/servers/16792146-aedb-4782-ba6f-5cbd7a7d0f62 => generated 1320 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:57:32.166290 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-12dffe86-b30c-4974-b5fa-415d4c44542c tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:57:32.169517 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-12dffe86-b30c-4974-b5fa-415d4c44542c tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: a4cf4fac-1e9b-4669-a6ff-30008ed3642d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:57:32.184196 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-12dffe86-b30c-4974-b5fa-415d4c44542c tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:32.185082 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-12dffe86-b30c-4974-b5fa-415d4c44542c tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:32.187263 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-12dffe86-b30c-4974-b5fa-415d4c44542c tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:32.191183 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-12dffe86-b30c-4974-b5fa-415d4c44542c tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:32.192130 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-12dffe86-b30c-4974-b5fa-415d4c44542c tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:32.194811 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-12dffe86-b30c-4974-b5fa-415d4c44542c tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:32.572683 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-0ae78f7a-7444-4a92-89d6-ca041469a027 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:57:32.573234 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-0ae78f7a-7444-4a92-89d6-ca041469a027 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] [instance: dad442d9-d2e1-49ee-93ea-6e5090634df8] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:57:32.585623 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0ae78f7a-7444-4a92-89d6-ca041469a027 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:32.593495 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0ae78f7a-7444-4a92-89d6-ca041469a027 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:32.599242 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0ae78f7a-7444-4a92-89d6-ca041469a027 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:32.600233 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0ae78f7a-7444-4a92-89d6-ca041469a027 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:32.600719 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0ae78f7a-7444-4a92-89d6-ca041469a027 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:32.601206 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0ae78f7a-7444-4a92-89d6-ca041469a027 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:33.952611 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-0ae78f7a-7444-4a92-89d6-ca041469a027 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e807c724cc4c3887a2d360f0584ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40071e45805146529fb8abd40629c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:57:33.962046 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-0ae78f7a-7444-4a92-89d6-ca041469a027 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] 10.222.0.43 "GET /compute/v2.1/servers/dad442d9-d2e1-49ee-93ea-6e5090634df8" status: 200 len: 1307 microversion: 2.1 time: 1.396192 Oct 04 21:57:33.962687 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1470/3029] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:57:32 2022] GET /compute/v2.1/servers/dad442d9-d2e1-49ee-93ea-6e5090634df8 => generated 1307 bytes in 1398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:57:34.013154 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-228e5610-f89d-49f2-aa36-fd07895206a9 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:57:34.018115 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-228e5610-f89d-49f2-aa36-fd07895206a9 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] [instance: 16792146-aedb-4782-ba6f-5cbd7a7d0f62] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:57:34.031507 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-228e5610-f89d-49f2-aa36-fd07895206a9 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:34.033019 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-228e5610-f89d-49f2-aa36-fd07895206a9 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:34.033904 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-228e5610-f89d-49f2-aa36-fd07895206a9 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:34.035698 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-228e5610-f89d-49f2-aa36-fd07895206a9 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:34.036720 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-228e5610-f89d-49f2-aa36-fd07895206a9 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:34.037690 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-228e5610-f89d-49f2-aa36-fd07895206a9 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:34.057272 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-12dffe86-b30c-4974-b5fa-415d4c44542c tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2facee4c6a40416e908083e126d2cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07a17a482a4e92b6ddbdee463c8029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:57:34.068696 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-12dffe86-b30c-4974-b5fa-415d4c44542c tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d" status: 200 len: 1316 microversion: 2.1 time: 1.907262 Oct 04 21:57:34.069567 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1560/3030] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:57:32 2022] GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d => generated 1316 bytes in 1909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:57:34.441788 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-228e5610-f89d-49f2-aa36-fd07895206a9 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a94113bec89469a844ede34890d6876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857b9057c949472b9a1862182a01356c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:57:34.459546 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-228e5610-f89d-49f2-aa36-fd07895206a9 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] 10.222.0.43 "GET /compute/v2.1/servers/16792146-aedb-4782-ba6f-5cbd7a7d0f62" status: 200 len: 1320 microversion: 2.1 time: 0.467032 Oct 04 21:57:34.460139 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1471/3031] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:57:33 2022] GET /compute/v2.1/servers/16792146-aedb-4782-ba6f-5cbd7a7d0f62 => generated 1320 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:57:34.999870 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-e1e7466e-ccef-460f-bac7-fcdfb6d8feea tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:57:35.000426 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-e1e7466e-ccef-460f-bac7-fcdfb6d8feea tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] [instance: dad442d9-d2e1-49ee-93ea-6e5090634df8] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:57:35.011639 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e1e7466e-ccef-460f-bac7-fcdfb6d8feea tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:35.011639 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e1e7466e-ccef-460f-bac7-fcdfb6d8feea tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:35.017687 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e1e7466e-ccef-460f-bac7-fcdfb6d8feea tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:35.019191 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e1e7466e-ccef-460f-bac7-fcdfb6d8feea tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:35.019862 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e1e7466e-ccef-460f-bac7-fcdfb6d8feea tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:35.020320 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e1e7466e-ccef-460f-bac7-fcdfb6d8feea tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:35.112636 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-196e9f23-51e9-463d-a128-2394913353ad tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:57:35.114231 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-196e9f23-51e9-463d-a128-2394913353ad tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: a4cf4fac-1e9b-4669-a6ff-30008ed3642d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:57:35.131490 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-196e9f23-51e9-463d-a128-2394913353ad tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:35.132555 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-196e9f23-51e9-463d-a128-2394913353ad tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:35.133169 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-196e9f23-51e9-463d-a128-2394913353ad tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:35.134149 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-196e9f23-51e9-463d-a128-2394913353ad tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:35.136401 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-196e9f23-51e9-463d-a128-2394913353ad tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:35.138223 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-196e9f23-51e9-463d-a128-2394913353ad tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:35.385437 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-196e9f23-51e9-463d-a128-2394913353ad tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2facee4c6a40416e908083e126d2cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07a17a482a4e92b6ddbdee463c8029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:57:35.405741 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-196e9f23-51e9-463d-a128-2394913353ad tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d" status: 200 len: 1504 microversion: 2.1 time: 0.296901 Oct 04 21:57:35.406429 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1472/3032] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:57:35 2022] GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d => generated 1504 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:57:35.443652 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-e1e7466e-ccef-460f-bac7-fcdfb6d8feea tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e807c724cc4c3887a2d360f0584ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40071e45805146529fb8abd40629c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:57:35.471717 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-e1e7466e-ccef-460f-bac7-fcdfb6d8feea tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] 10.222.0.43 "GET /compute/v2.1/servers/dad442d9-d2e1-49ee-93ea-6e5090634df8" status: 200 len: 1307 microversion: 2.1 time: 0.461179 Oct 04 21:57:35.480955 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1561/3033] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:57:34 2022] GET /compute/v2.1/servers/dad442d9-d2e1-49ee-93ea-6e5090634df8 => generated 1307 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:57:35.495925 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-539f55d8-90b2-4f73-bf1f-f4c1566a17cf tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:57:35.496875 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-539f55d8-90b2-4f73-bf1f-f4c1566a17cf tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] [instance: 16792146-aedb-4782-ba6f-5cbd7a7d0f62] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:57:35.508020 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-539f55d8-90b2-4f73-bf1f-f4c1566a17cf tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:35.510608 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-539f55d8-90b2-4f73-bf1f-f4c1566a17cf tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:35.512625 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-539f55d8-90b2-4f73-bf1f-f4c1566a17cf tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:35.514195 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-539f55d8-90b2-4f73-bf1f-f4c1566a17cf tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:35.515636 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-539f55d8-90b2-4f73-bf1f-f4c1566a17cf tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:35.518449 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-539f55d8-90b2-4f73-bf1f-f4c1566a17cf tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:35.879054 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-2166c36a-cc52-49cc-b896-d763ea196313 tempest-SecurityGroupsNegativeTestJSON-577554570 tempest-SecurityGroupsNegativeTestJSON-577554570-project] Calling method '.version_select at 0x7fbb2e6f2670>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:57:35.975325 n-d-860284-1 devstack@n-api.service[134102]: DEBUG neutronclient.v2_0.client [None req-2166c36a-cc52-49cc-b896-d763ea196313 tempest-SecurityGroupsNegativeTestJSON-577554570 tempest-SecurityGroupsNegativeTestJSON-577554570-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group d7fce395-8a75-4dbd-8cba-8f54ac387153 does not exist", "detail": ""}} {{(pid=134102) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 21:57:35.975959 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.network.security_group_api [None req-2166c36a-cc52-49cc-b896-d763ea196313 tempest-SecurityGroupsNegativeTestJSON-577554570 tempest-SecurityGroupsNegativeTestJSON-577554570-project] Neutron security group d7fce395-8a75-4dbd-8cba-8f54ac387153 not found {{(pid=134102) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 04 21:57:35.976494 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-2166c36a-cc52-49cc-b896-d763ea196313 tempest-SecurityGroupsNegativeTestJSON-577554570 tempest-SecurityGroupsNegativeTestJSON-577554570-project] HTTP exception thrown: Security group d7fce395-8a75-4dbd-8cba-8f54ac387153 does not exist Oct 04 21:57:35.976494 n-d-860284-1 devstack@n-api.service[134102]: Neutron server returns request_ids: ['req-e08438c1-4af5-4f04-b562-cd29b6a35bc7'] Oct 04 21:57:35.978354 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-2166c36a-cc52-49cc-b896-d763ea196313 tempest-SecurityGroupsNegativeTestJSON-577554570 tempest-SecurityGroupsNegativeTestJSON-577554570-project] Request method failure captured: Oct 04 21:57:35.978354 n-d-860284-1 devstack@n-api.service[134102]: request: DELETE /compute/v2.1/os-security-groups/d7fce395-8a75-4dbd-8cba-8f54ac387153 HTTP/1.1 Oct 04 21:57:35.978354 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 21:57:35.978354 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 21:57:35.978354 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 21:57:35.978354 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 21:57:35.978354 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 21:57:35.978354 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 21:57:35.978354 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 21:57:35.978354 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 21:57:35.978354 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPKxPxMBiGXB9R8dZ99o5OpEJRuNsJW-fFSW2A_NJfT0I6J-wFCHMzmo9iI-LNdvajjS2pMOfchf8QkDt6LPnu6a1jQWfCj2TbmXSGZ2VJ5k-VwpO11qzAiPHFSFtjVPbxHOqNygK7jGrQSWaX4AwvqxWQWntdL1h5EHQBi3Ic9IXKc0 Oct 04 21:57:35.978354 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 21:57:35.978354 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 21:57:35.978354 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 21:57:35.978354 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 21:57:35.978354 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 21:57:35.978354 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 21:57:35.978354 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: 5d2b809a672b457090c7f89f58f322be Oct 04 21:57:35.978354 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-577554570 Oct 04 21:57:35.978354 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 21:57:35.978354 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 21:57:35.978354 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5d2b809a672b457090c7f89f58f322be"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_5d2b809a672b457090c7f89f58f322be", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5d2b809a672b457090c7f89f58f322be"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/5d2b809a672b457090c7f89f58f322be"}]}] Oct 04 21:57:35.978354 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-577554570 Oct 04 21:57:35.978354 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: 5d2b809a672b457090c7f89f58f322be Oct 04 21:57:35.978354 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-577554570 Oct 04 21:57:35.978354 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-SecurityGroupsNegativeTestJSON-577554570-project Oct 04 21:57:35.978354 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 21:57:35.978354 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 21:57:35.978354 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: c2550ee7a7494717b9737710fe1199f9 Oct 04 21:57:35.978354 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-577554570-project Oct 04 21:57:35.978354 n-d-860284-1 devstack@n-api.service[134102]: method: Oct 04 21:57:35.978354 n-d-860284-1 devstack@n-api.service[134102]: exception: Security group d7fce395-8a75-4dbd-8cba-8f54ac387153 does not exist Oct 04 21:57:35.978354 n-d-860284-1 devstack@n-api.service[134102]: Neutron server returns request_ids: ['req-e08438c1-4af5-4f04-b562-cd29b6a35bc7'] Oct 04 21:57:35.978354 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': 'd7fce395-8a75-4dbd-8cba-8f54ac387153'} Oct 04 21:57:35.978354 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:57:35.978354 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:57:35.978354 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 04 21:57:35.978354 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 04 21:57:35.978354 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:57:35.978354 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:57:35.978354 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 04 21:57:35.978354 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 04 21:57:35.978354 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:57:35.978354 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:57:35.978354 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 21:57:35.978354 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 21:57:35.978354 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:57:35.978354 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:57:35.978354 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 21:57:35.978354 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 21:57:35.978354 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:57:35.978354 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:57:35.978354 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 21:57:35.978354 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 21:57:35.978354 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:57:35.978354 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:57:35.978354 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 21:57:35.978354 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 21:57:35.978354 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 21:57:35.978354 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 21:57:35.978354 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group d7fce395-8a75-4dbd-8cba-8f54ac387153 does not exist Oct 04 21:57:35.982264 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e08438c1-4af5-4f04-b562-cd29b6a35bc7'] Oct 04 21:57:35.982264 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:57:35.982264 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:57:35.982264 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:57:35.982264 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:57:35.982264 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 04 21:57:35.982264 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 04 21:57:35.982264 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 04 21:57:35.982264 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 21:57:35.982264 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group d7fce395-8a75-4dbd-8cba-8f54ac387153 does not exist Oct 04 21:57:35.982264 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e08438c1-4af5-4f04-b562-cd29b6a35bc7'] Oct 04 21:57:35.982264 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:57:35.982264 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:57:35.982264 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:57:35.982264 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:57:35.982264 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:57:35.982264 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:57:35.982264 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:57:35.982264 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:57:35.982264 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:57:35.982264 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:57:35.982264 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:57:35.982264 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:57:35.982264 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 04 21:57:35.982264 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 21:57:35.982264 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group d7fce395-8a75-4dbd-8cba-8f54ac387153 does not exist Oct 04 21:57:35.982264 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e08438c1-4af5-4f04-b562-cd29b6a35bc7'] Oct 04 21:57:35.982264 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:57:35.982264 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:57:35.982264 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:57:35.982264 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:57:35.982264 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:57:35.982264 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:57:35.982264 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:57:35.982264 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:57:35.982264 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group d7fce395-8a75-4dbd-8cba-8f54ac387153 does not exist Oct 04 21:57:35.982264 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e08438c1-4af5-4f04-b562-cd29b6a35bc7'] Oct 04 21:57:35.982264 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:57:35.982264 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-2166c36a-cc52-49cc-b896-d763ea196313 tempest-SecurityGroupsNegativeTestJSON-577554570 tempest-SecurityGroupsNegativeTestJSON-577554570-project] Returning 404 to user: Security group d7fce395-8a75-4dbd-8cba-8f54ac387153 does not exist Oct 04 21:57:35.982264 n-d-860284-1 devstack@n-api.service[134102]: Neutron server returns request_ids: ['req-e08438c1-4af5-4f04-b562-cd29b6a35bc7'] {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:57:35.982264 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-2166c36a-cc52-49cc-b896-d763ea196313 tempest-SecurityGroupsNegativeTestJSON-577554570 tempest-SecurityGroupsNegativeTestJSON-577554570-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/d7fce395-8a75-4dbd-8cba-8f54ac387153" status: 404 len: 194 microversion: 2.1 time: 0.443835 Oct 04 21:57:35.982264 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1562/3034] 10.222.0.43 () {58 vars in 1272 bytes} [Tue Oct 4 21:57:35 2022] DELETE /compute/v2.1/os-security-groups/d7fce395-8a75-4dbd-8cba-8f54ac387153 => generated 194 bytes in 447 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:57:35.992347 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-a1e08be9-61f5-4501-b144-bc8c86aa2447 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-151675241", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452", "networks": [{"uuid": "300a434f-3ad3-472e-98dd-a1b7130cf104"}]}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:57:36.009588 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-539f55d8-90b2-4f73-bf1f-f4c1566a17cf tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a94113bec89469a844ede34890d6876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857b9057c949472b9a1862182a01356c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:57:36.021510 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-539f55d8-90b2-4f73-bf1f-f4c1566a17cf tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] 10.222.0.43 "GET /compute/v2.1/servers/16792146-aedb-4782-ba6f-5cbd7a7d0f62" status: 200 len: 1320 microversion: 2.1 time: 0.540811 Oct 04 21:57:36.028339 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1473/3035] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:57:35 2022] GET /compute/v2.1/servers/16792146-aedb-4782-ba6f-5cbd7a7d0f62 => generated 1320 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:57:36.036813 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-deec52e3-0366-4f39-84d2-0cc142743ed3 tempest-SecurityGroupsNegativeTestJSON-577554570 tempest-SecurityGroupsNegativeTestJSON-577554570-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.005674 Oct 04 21:57:36.043275 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1474/3036] 10.222.0.43 () {58 vars in 1164 bytes} [Tue Oct 4 21:57:36 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 14 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 04 21:57:36.058695 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:UPDATE=3 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:57:36.067898 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-fdfe63ac-b323-452c-b418-0d7ba40362e4 tempest-SecurityGroupsNegativeTestJSON-577554570 tempest-SecurityGroupsNegativeTestJSON-577554570-project] Calling method '.version_select at 0x7fbb2e302ee0>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:57:36.158280 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.network.neutron [None req-a1e08be9-61f5-4501-b144-bc8c86aa2447 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] validate_networks() for [('300a434f-3ad3-472e-98dd-a1b7130cf104', None, None, None, None, None)] {{(pid=134102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:57:37.036524 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-fdfe63ac-b323-452c-b418-0d7ba40362e4 tempest-SecurityGroupsNegativeTestJSON-577554570 tempest-SecurityGroupsNegativeTestJSON-577554570-project] 10.222.0.43 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 0.979863 Oct 04 21:57:37.037432 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1475/3037] 10.222.0.43 () {58 vars in 1158 bytes} [Tue Oct 4 21:57:36 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:57:37.044679 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-eaa482cc-d716-486d-b66b-f16890fa77f8 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:57:37.045553 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-eaa482cc-d716-486d-b66b-f16890fa77f8 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] [instance: dad442d9-d2e1-49ee-93ea-6e5090634df8] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:57:37.067327 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-eaa482cc-d716-486d-b66b-f16890fa77f8 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:37.068076 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-eaa482cc-d716-486d-b66b-f16890fa77f8 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:37.069203 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-eaa482cc-d716-486d-b66b-f16890fa77f8 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:37.072166 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-eaa482cc-d716-486d-b66b-f16890fa77f8 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:37.072814 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-eaa482cc-d716-486d-b66b-f16890fa77f8 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:37.073412 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-eaa482cc-d716-486d-b66b-f16890fa77f8 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:37.391001 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-a1e08be9-61f5-4501-b144-bc8c86aa2447 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Flavor limits 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:57:37.393159 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-a1e08be9-61f5-4501-b144-bc8c86aa2447 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Image limits 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:57:37.394585 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-a1e08be9-61f5-4501-b144-bc8c86aa2447 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Flavor pref 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:57:37.395216 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-a1e08be9-61f5-4501-b144-bc8c86aa2447 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Image pref 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:57:37.396285 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-a1e08be9-61f5-4501-b144-bc8c86aa2447 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:57:37.408389 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell0:SELECT=57 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:57:37.412686 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a1e08be9-61f5-4501-b144-bc8c86aa2447 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:37.414589 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a1e08be9-61f5-4501-b144-bc8c86aa2447 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:37.415544 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a1e08be9-61f5-4501-b144-bc8c86aa2447 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:37.421109 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-eaa482cc-d716-486d-b66b-f16890fa77f8 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e807c724cc4c3887a2d360f0584ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40071e45805146529fb8abd40629c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:57:37.453924 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a1e08be9-61f5-4501-b144-bc8c86aa2447 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:37.456202 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a1e08be9-61f5-4501-b144-bc8c86aa2447 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:37.459387 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a1e08be9-61f5-4501-b144-bc8c86aa2447 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:37.467300 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-eaa482cc-d716-486d-b66b-f16890fa77f8 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] 10.222.0.43 "GET /compute/v2.1/servers/dad442d9-d2e1-49ee-93ea-6e5090634df8" status: 200 len: 1307 microversion: 2.1 time: 0.423466 Oct 04 21:57:37.471727 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1476/3038] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:57:37 2022] GET /compute/v2.1/servers/dad442d9-d2e1-49ee-93ea-6e5090634df8 => generated 1307 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:57:37.510873 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-a1e08be9-61f5-4501-b144-bc8c86aa2447 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Getting quotas for project cf07a17a482a4e92b6ddbdee463c8029. Resources: {'instances', 'ram', 'cores'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:57:37.522057 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-a1e08be9-61f5-4501-b144-bc8c86aa2447 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Getting quotas for user 2facee4c6a40416e908083e126d2cfa3 and project cf07a17a482a4e92b6ddbdee463c8029. Resources: {'instances', 'ram', 'cores'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:57:37.549661 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-a1e08be9-61f5-4501-b144-bc8c86aa2447 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Going to run 1 instances... {{(pid=134102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:57:37.553618 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-a1e08be9-61f5-4501-b144-bc8c86aa2447 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: dd1b7876-cc6f-4ed3-a0e4-cfe2213b332f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='58548514-5dac-426c-81f5-19e3fba33e23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:57:37.649832 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-a1e08be9-61f5-4501-b144-bc8c86aa2447 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.667369 Oct 04 21:57:37.651703 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1563/3039] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 21:57:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 1670 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:57:37.666442 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-77afa9ef-f342-4504-a5c5-22ea9e24e25f req-b538ca59-6e09-4339-a789-3f5769be248f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f61f3b8b-9a3c-4d10-9dc4-8397e27f0237", "name": "network-vif-plugged", "status": "completed", "tag": "efd3f13d-6466-4c86-aa3f-27dd6cbdcf88"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:57:37.683738 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-77afa9ef-f342-4504-a5c5-22ea9e24e25f req-b538ca59-6e09-4339-a789-3f5769be248f service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:37.684991 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-77afa9ef-f342-4504-a5c5-22ea9e24e25f req-b538ca59-6e09-4339-a789-3f5769be248f service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:37.685590 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-77afa9ef-f342-4504-a5c5-22ea9e24e25f req-b538ca59-6e09-4339-a789-3f5769be248f service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:37.721505 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-77afa9ef-f342-4504-a5c5-22ea9e24e25f req-b538ca59-6e09-4339-a789-3f5769be248f service nova] Creating event network-vif-plugged:efd3f13d-6466-4c86-aa3f-27dd6cbdcf88 for instance f61f3b8b-9a3c-4d10-9dc4-8397e27f0237 on n-h2-860284-1 Oct 04 21:57:37.730424 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-77afa9ef-f342-4504-a5c5-22ea9e24e25f req-b538ca59-6e09-4339-a789-3f5769be248f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076744 Oct 04 21:57:37.731918 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1564/3040] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:57:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:57:37.778735 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-45270db4-2e00-49d0-b976-18dfb6246806 tempest-SecurityGroupsNegativeTestJSON-577554570 tempest-SecurityGroupsNegativeTestJSON-577554570-project] Calling method '.version_select at 0x7fbb2e646af0>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:57:37.974418 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-0023fc16-efa1-4f23-8230-2434efb16b22 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:57:37.974925 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-0023fc16-efa1-4f23-8230-2434efb16b22 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] [instance: 830de6ad-adc6-4d16-ae9d-a29ae85e6cd2] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:57:37.988030 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0023fc16-efa1-4f23-8230-2434efb16b22 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:37.991561 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0023fc16-efa1-4f23-8230-2434efb16b22 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:37.992024 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0023fc16-efa1-4f23-8230-2434efb16b22 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:37.992931 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0023fc16-efa1-4f23-8230-2434efb16b22 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:37.993409 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0023fc16-efa1-4f23-8230-2434efb16b22 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:37.993839 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0023fc16-efa1-4f23-8230-2434efb16b22 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:38.061988 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-0023fc16-efa1-4f23-8230-2434efb16b22 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] [instance: 830de6ad-adc6-4d16-ae9d-a29ae85e6cd2] Going to try to terminate instance {{(pid=134101) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:57:38.210344 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-0023fc16-efa1-4f23-8230-2434efb16b22 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] 10.222.0.43 "DELETE /compute/v2.1/servers/830de6ad-adc6-4d16-ae9d-a29ae85e6cd2" status: 204 len: 0 microversion: 2.42 time: 0.736029 Oct 04 21:57:38.212885 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1477/3041] 10.222.0.43 () {60 vars in 1280 bytes} [Tue Oct 4 21:57:37 2022] DELETE /compute/v2.1/servers/830de6ad-adc6-4d16-ae9d-a29ae85e6cd2 => generated 0 bytes in 740 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 21:57:38.225575 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-227cf2f5-40f5-4d1a-aeb3-68b23d37cf90 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:57:38.226787 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-227cf2f5-40f5-4d1a-aeb3-68b23d37cf90 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] [instance: 16792146-aedb-4782-ba6f-5cbd7a7d0f62] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:57:38.237863 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-227cf2f5-40f5-4d1a-aeb3-68b23d37cf90 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:38.238692 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-227cf2f5-40f5-4d1a-aeb3-68b23d37cf90 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:38.239339 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-227cf2f5-40f5-4d1a-aeb3-68b23d37cf90 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:38.240317 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-227cf2f5-40f5-4d1a-aeb3-68b23d37cf90 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:38.240941 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-227cf2f5-40f5-4d1a-aeb3-68b23d37cf90 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:38.241681 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-227cf2f5-40f5-4d1a-aeb3-68b23d37cf90 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:38.520946 n-d-860284-1 devstack@n-api.service[134102]: DEBUG neutronclient.v2_0.client [None req-45270db4-2e00-49d0-b976-18dfb6246806 tempest-SecurityGroupsNegativeTestJSON-577554570 tempest-SecurityGroupsNegativeTestJSON-577554570-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=134102) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 21:57:38.522656 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-45270db4-2e00-49d0-b976-18dfb6246806 tempest-SecurityGroupsNegativeTestJSON-577554570 tempest-SecurityGroupsNegativeTestJSON-577554570-project] HTTP exception thrown: Insufficient rights for removing default security group. Oct 04 21:57:38.522656 n-d-860284-1 devstack@n-api.service[134102]: Neutron server returns request_ids: ['req-bc1ff8fb-1b1e-4c87-882c-f92b521f9469'] Oct 04 21:57:38.524951 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-45270db4-2e00-49d0-b976-18dfb6246806 tempest-SecurityGroupsNegativeTestJSON-577554570 tempest-SecurityGroupsNegativeTestJSON-577554570-project] Request method failure captured: Oct 04 21:57:38.524951 n-d-860284-1 devstack@n-api.service[134102]: request: DELETE /compute/v2.1/os-security-groups/56431422-700a-48cb-9283-9d3330f3181d HTTP/1.1 Oct 04 21:57:38.524951 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 21:57:38.524951 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 21:57:38.524951 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 21:57:38.524951 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 21:57:38.524951 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 21:57:38.524951 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 21:57:38.524951 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 21:57:38.524951 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 21:57:38.524951 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPKxPxMBiGXB9R8dZ99o5OpEJRuNsJW-fFSW2A_NJfT0I6J-wFCHMzmo9iI-LNdvajjS2pMOfchf8QkDt6LPnu6a1jQWfCj2TbmXSGZ2VJ5k-VwpO11qzAiPHFSFtjVPbxHOqNygK7jGrQSWaX4AwvqxWQWntdL1h5EHQBi3Ic9IXKc0 Oct 04 21:57:38.524951 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 21:57:38.524951 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 21:57:38.524951 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 21:57:38.524951 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 21:57:38.524951 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 21:57:38.524951 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 21:57:38.524951 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: 5d2b809a672b457090c7f89f58f322be Oct 04 21:57:38.524951 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-577554570 Oct 04 21:57:38.524951 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 21:57:38.524951 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 21:57:38.524951 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5d2b809a672b457090c7f89f58f322be"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_5d2b809a672b457090c7f89f58f322be", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5d2b809a672b457090c7f89f58f322be"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/5d2b809a672b457090c7f89f58f322be"}]}] Oct 04 21:57:38.524951 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-577554570 Oct 04 21:57:38.524951 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: 5d2b809a672b457090c7f89f58f322be Oct 04 21:57:38.524951 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-577554570 Oct 04 21:57:38.524951 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-SecurityGroupsNegativeTestJSON-577554570-project Oct 04 21:57:38.524951 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 21:57:38.524951 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 21:57:38.524951 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: c2550ee7a7494717b9737710fe1199f9 Oct 04 21:57:38.524951 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-577554570-project Oct 04 21:57:38.524951 n-d-860284-1 devstack@n-api.service[134102]: method: Oct 04 21:57:38.524951 n-d-860284-1 devstack@n-api.service[134102]: exception: Insufficient rights for removing default security group. Oct 04 21:57:38.524951 n-d-860284-1 devstack@n-api.service[134102]: Neutron server returns request_ids: ['req-bc1ff8fb-1b1e-4c87-882c-f92b521f9469'] Oct 04 21:57:38.524951 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': '56431422-700a-48cb-9283-9d3330f3181d'} Oct 04 21:57:38.524951 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:57:38.524951 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:57:38.524951 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 04 21:57:38.524951 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 04 21:57:38.524951 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:57:38.524951 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:57:38.524951 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 04 21:57:38.524951 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 04 21:57:38.524951 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:57:38.524951 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:57:38.524951 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 04 21:57:38.524951 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 04 21:57:38.524951 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:57:38.524951 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:57:38.524951 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 21:57:38.524951 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 21:57:38.524951 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:57:38.524951 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:57:38.524951 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 21:57:38.524951 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 21:57:38.524951 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:57:38.524951 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:57:38.524951 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 21:57:38.524951 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 21:57:38.524951 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 21:57:38.524951 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 21:57:38.524951 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. Oct 04 21:57:38.528797 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bc1ff8fb-1b1e-4c87-882c-f92b521f9469'] Oct 04 21:57:38.528797 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:57:38.528797 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:57:38.528797 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:57:38.528797 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:57:38.528797 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 04 21:57:38.528797 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 04 21:57:38.528797 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 04 21:57:38.528797 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 04 21:57:38.528797 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. Oct 04 21:57:38.528797 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bc1ff8fb-1b1e-4c87-882c-f92b521f9469'] Oct 04 21:57:38.528797 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:57:38.528797 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:57:38.528797 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:57:38.528797 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:57:38.528797 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:57:38.528797 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:57:38.528797 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:57:38.528797 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:57:38.528797 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:57:38.528797 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:57:38.528797 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:57:38.528797 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:57:38.528797 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 04 21:57:38.528797 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 04 21:57:38.528797 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. Oct 04 21:57:38.528797 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bc1ff8fb-1b1e-4c87-882c-f92b521f9469'] Oct 04 21:57:38.528797 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:57:38.528797 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:57:38.528797 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:57:38.528797 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:57:38.528797 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:57:38.528797 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:57:38.528797 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:57:38.528797 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:57:38.528797 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. Oct 04 21:57:38.528797 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bc1ff8fb-1b1e-4c87-882c-f92b521f9469'] Oct 04 21:57:38.528797 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:57:38.528797 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-45270db4-2e00-49d0-b976-18dfb6246806 tempest-SecurityGroupsNegativeTestJSON-577554570 tempest-SecurityGroupsNegativeTestJSON-577554570-project] Returning 400 to user: Insufficient rights for removing default security group. Oct 04 21:57:38.528797 n-d-860284-1 devstack@n-api.service[134102]: Neutron server returns request_ids: ['req-bc1ff8fb-1b1e-4c87-882c-f92b521f9469'] {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:57:38.528797 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-45270db4-2e00-49d0-b976-18dfb6246806 tempest-SecurityGroupsNegativeTestJSON-577554570 tempest-SecurityGroupsNegativeTestJSON-577554570-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/56431422-700a-48cb-9283-9d3330f3181d" status: 400 len: 182 microversion: 2.1 time: 0.787749 Oct 04 21:57:38.543245 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1565/3042] 10.222.0.43 () {58 vars in 1272 bytes} [Tue Oct 4 21:57:37 2022] DELETE /compute/v2.1/os-security-groups/56431422-700a-48cb-9283-9d3330f3181d => generated 182 bytes in 810 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 21:57:38.565970 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-77a768a1-5406-4197-aec5-530396184b6b tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:57:38.567693 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-77a768a1-5406-4197-aec5-530396184b6b tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: dd1b7876-cc6f-4ed3-a0e4-cfe2213b332f] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:57:38.592323 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-77a768a1-5406-4197-aec5-530396184b6b tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:38.593848 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-77a768a1-5406-4197-aec5-530396184b6b tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:38.595188 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-77a768a1-5406-4197-aec5-530396184b6b tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:38.596880 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-77a768a1-5406-4197-aec5-530396184b6b tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:38.608295 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-77a768a1-5406-4197-aec5-530396184b6b tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:38.608757 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-77a768a1-5406-4197-aec5-530396184b6b tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:38.885461 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-77a768a1-5406-4197-aec5-530396184b6b tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2facee4c6a40416e908083e126d2cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07a17a482a4e92b6ddbdee463c8029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:57:38.897610 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-77a768a1-5406-4197-aec5-530396184b6b tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/dd1b7876-cc6f-4ed3-a0e4-cfe2213b332f" status: 200 len: 1220 microversion: 2.1 time: 0.352864 Oct 04 21:57:38.900578 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1566/3043] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:57:38 2022] GET /compute/v2.1/servers/dd1b7876-cc6f-4ed3-a0e4-cfe2213b332f => generated 1220 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:57:38.914016 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-0c85d257-a72b-408b-a07a-61f347aa867c tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:57:38.916147 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-0c85d257-a72b-408b-a07a-61f347aa867c tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] [instance: 830de6ad-adc6-4d16-ae9d-a29ae85e6cd2] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:57:38.933249 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0c85d257-a72b-408b-a07a-61f347aa867c tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:38.942935 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0c85d257-a72b-408b-a07a-61f347aa867c tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:38.943613 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0c85d257-a72b-408b-a07a-61f347aa867c tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:38.944501 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0c85d257-a72b-408b-a07a-61f347aa867c tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:38.945142 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0c85d257-a72b-408b-a07a-61f347aa867c tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:38.945733 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0c85d257-a72b-408b-a07a-61f347aa867c tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:38.994829 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-227cf2f5-40f5-4d1a-aeb3-68b23d37cf90 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a94113bec89469a844ede34890d6876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857b9057c949472b9a1862182a01356c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:57:39.009240 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-227cf2f5-40f5-4d1a-aeb3-68b23d37cf90 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] 10.222.0.43 "GET /compute/v2.1/servers/16792146-aedb-4782-ba6f-5cbd7a7d0f62" status: 200 len: 1320 microversion: 2.1 time: 0.790719 Oct 04 21:57:39.014802 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1478/3044] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:57:38 2022] GET /compute/v2.1/servers/16792146-aedb-4782-ba6f-5cbd7a7d0f62 => generated 1320 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:57:39.027316 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-5b053cba-9cc7-4920-a15a-807defb9d4fd tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:57:39.028348 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-5b053cba-9cc7-4920-a15a-807defb9d4fd tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] [instance: dad442d9-d2e1-49ee-93ea-6e5090634df8] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:57:39.043800 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5b053cba-9cc7-4920-a15a-807defb9d4fd tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:39.046802 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5b053cba-9cc7-4920-a15a-807defb9d4fd tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:39.047547 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5b053cba-9cc7-4920-a15a-807defb9d4fd tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:39.049907 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5b053cba-9cc7-4920-a15a-807defb9d4fd tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:39.050774 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5b053cba-9cc7-4920-a15a-807defb9d4fd tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:39.051795 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5b053cba-9cc7-4920-a15a-807defb9d4fd tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:39.295771 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=12 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:57:39.408434 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=32 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:57:39.408607 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-0c85d257-a72b-408b-a07a-61f347aa867c tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:57:39.425118 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-0c85d257-a72b-408b-a07a-61f347aa867c tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:57:39.426633 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-0c85d257-a72b-408b-a07a-61f347aa867c tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:57:39.428583 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-0c85d257-a72b-408b-a07a-61f347aa867c tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] 10.222.0.43 "GET /compute/v2.1/servers/830de6ad-adc6-4d16-ae9d-a29ae85e6cd2" status: 200 len: 2958 microversion: 2.42 time: 0.526769 Oct 04 21:57:39.429767 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1567/3045] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:57:38 2022] GET /compute/v2.1/servers/830de6ad-adc6-4d16-ae9d-a29ae85e6cd2 => generated 2958 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:57:39.444333 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-2af28fe6-b7cc-46ee-b6d5-e79b060c88ee tempest-SecurityGroupsNegativeTestJSON-577554570 tempest-SecurityGroupsNegativeTestJSON-577554570-project] Calling method '.version_select at 0x7fbb2e6f2c10>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:57:39.505935 n-d-860284-1 devstack@n-api.service[134102]: DEBUG neutronclient.v2_0.client [None req-2af28fe6-b7cc-46ee-b6d5-e79b060c88ee tempest-SecurityGroupsNegativeTestJSON-577554570 tempest-SecurityGroupsNegativeTestJSON-577554570-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 63118041-3e67-4faf-834c-019decb68fde does not exist", "detail": ""}} {{(pid=134102) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 21:57:39.506635 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.network.security_group_api [None req-2af28fe6-b7cc-46ee-b6d5-e79b060c88ee tempest-SecurityGroupsNegativeTestJSON-577554570 tempest-SecurityGroupsNegativeTestJSON-577554570-project] Neutron security group 63118041-3e67-4faf-834c-019decb68fde not found {{(pid=134102) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 04 21:57:39.507488 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-2af28fe6-b7cc-46ee-b6d5-e79b060c88ee tempest-SecurityGroupsNegativeTestJSON-577554570 tempest-SecurityGroupsNegativeTestJSON-577554570-project] HTTP exception thrown: Security group 63118041-3e67-4faf-834c-019decb68fde does not exist Oct 04 21:57:39.507488 n-d-860284-1 devstack@n-api.service[134102]: Neutron server returns request_ids: ['req-f55765cf-cbdc-4a71-9af3-77412fd713e3'] Oct 04 21:57:39.509396 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-2af28fe6-b7cc-46ee-b6d5-e79b060c88ee tempest-SecurityGroupsNegativeTestJSON-577554570 tempest-SecurityGroupsNegativeTestJSON-577554570-project] Request method failure captured: Oct 04 21:57:39.509396 n-d-860284-1 devstack@n-api.service[134102]: request: GET /compute/v2.1/os-security-groups/63118041-3e67-4faf-834c-019decb68fde HTTP/1.1 Oct 04 21:57:39.509396 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 21:57:39.509396 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 21:57:39.509396 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 21:57:39.509396 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 21:57:39.509396 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 21:57:39.509396 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 21:57:39.509396 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 21:57:39.509396 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 21:57:39.509396 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPKxPxMBiGXB9R8dZ99o5OpEJRuNsJW-fFSW2A_NJfT0I6J-wFCHMzmo9iI-LNdvajjS2pMOfchf8QkDt6LPnu6a1jQWfCj2TbmXSGZ2VJ5k-VwpO11qzAiPHFSFtjVPbxHOqNygK7jGrQSWaX4AwvqxWQWntdL1h5EHQBi3Ic9IXKc0 Oct 04 21:57:39.509396 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 21:57:39.509396 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 21:57:39.509396 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 21:57:39.509396 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 21:57:39.509396 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 21:57:39.509396 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 21:57:39.509396 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: 5d2b809a672b457090c7f89f58f322be Oct 04 21:57:39.509396 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-577554570 Oct 04 21:57:39.509396 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 21:57:39.509396 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 21:57:39.509396 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5d2b809a672b457090c7f89f58f322be"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_5d2b809a672b457090c7f89f58f322be", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5d2b809a672b457090c7f89f58f322be"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/5d2b809a672b457090c7f89f58f322be"}]}] Oct 04 21:57:39.509396 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-577554570 Oct 04 21:57:39.509396 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: 5d2b809a672b457090c7f89f58f322be Oct 04 21:57:39.509396 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-577554570 Oct 04 21:57:39.509396 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-SecurityGroupsNegativeTestJSON-577554570-project Oct 04 21:57:39.509396 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 21:57:39.509396 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 21:57:39.509396 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: c2550ee7a7494717b9737710fe1199f9 Oct 04 21:57:39.509396 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-577554570-project Oct 04 21:57:39.509396 n-d-860284-1 devstack@n-api.service[134102]: method: Oct 04 21:57:39.509396 n-d-860284-1 devstack@n-api.service[134102]: exception: Security group 63118041-3e67-4faf-834c-019decb68fde does not exist Oct 04 21:57:39.509396 n-d-860284-1 devstack@n-api.service[134102]: Neutron server returns request_ids: ['req-f55765cf-cbdc-4a71-9af3-77412fd713e3'] Oct 04 21:57:39.509396 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': '63118041-3e67-4faf-834c-019decb68fde'} Oct 04 21:57:39.509396 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:57:39.509396 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:57:39.509396 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 04 21:57:39.509396 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 04 21:57:39.509396 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:57:39.509396 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:57:39.509396 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 04 21:57:39.509396 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 04 21:57:39.509396 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:57:39.509396 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:57:39.509396 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 21:57:39.509396 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 21:57:39.509396 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:57:39.509396 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:57:39.509396 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 21:57:39.509396 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 21:57:39.509396 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:57:39.509396 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:57:39.509396 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 21:57:39.509396 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 21:57:39.509396 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:57:39.509396 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:57:39.509396 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 21:57:39.509396 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 21:57:39.509396 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 21:57:39.509396 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 21:57:39.509396 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 63118041-3e67-4faf-834c-019decb68fde does not exist Oct 04 21:57:39.513936 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f55765cf-cbdc-4a71-9af3-77412fd713e3'] Oct 04 21:57:39.513936 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:57:39.513936 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:57:39.513936 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:57:39.513936 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:57:39.513936 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 04 21:57:39.513936 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 04 21:57:39.513936 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 04 21:57:39.513936 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 21:57:39.513936 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 63118041-3e67-4faf-834c-019decb68fde does not exist Oct 04 21:57:39.513936 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f55765cf-cbdc-4a71-9af3-77412fd713e3'] Oct 04 21:57:39.513936 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:57:39.513936 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:57:39.513936 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:57:39.513936 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:57:39.513936 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:57:39.513936 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:57:39.513936 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:57:39.513936 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:57:39.513936 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:57:39.513936 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:57:39.513936 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:57:39.513936 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:57:39.513936 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 04 21:57:39.513936 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 21:57:39.513936 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 63118041-3e67-4faf-834c-019decb68fde does not exist Oct 04 21:57:39.513936 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f55765cf-cbdc-4a71-9af3-77412fd713e3'] Oct 04 21:57:39.513936 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:57:39.513936 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:57:39.513936 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:57:39.513936 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:57:39.513936 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:57:39.513936 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:57:39.513936 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:57:39.513936 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:57:39.513936 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 63118041-3e67-4faf-834c-019decb68fde does not exist Oct 04 21:57:39.513936 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f55765cf-cbdc-4a71-9af3-77412fd713e3'] Oct 04 21:57:39.513936 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:57:39.513936 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-2af28fe6-b7cc-46ee-b6d5-e79b060c88ee tempest-SecurityGroupsNegativeTestJSON-577554570 tempest-SecurityGroupsNegativeTestJSON-577554570-project] Returning 404 to user: Security group 63118041-3e67-4faf-834c-019decb68fde does not exist Oct 04 21:57:39.513936 n-d-860284-1 devstack@n-api.service[134102]: Neutron server returns request_ids: ['req-f55765cf-cbdc-4a71-9af3-77412fd713e3'] {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:57:39.513936 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-2af28fe6-b7cc-46ee-b6d5-e79b060c88ee tempest-SecurityGroupsNegativeTestJSON-577554570 tempest-SecurityGroupsNegativeTestJSON-577554570-project] 10.222.0.43 "GET /compute/v2.1/os-security-groups/63118041-3e67-4faf-834c-019decb68fde" status: 404 len: 194 microversion: 2.1 time: 0.080096 Oct 04 21:57:39.519893 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-5b053cba-9cc7-4920-a15a-807defb9d4fd tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e807c724cc4c3887a2d360f0584ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40071e45805146529fb8abd40629c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:57:39.520141 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1568/3046] 10.222.0.43 () {58 vars in 1269 bytes} [Tue Oct 4 21:57:39 2022] GET /compute/v2.1/os-security-groups/63118041-3e67-4faf-834c-019decb68fde => generated 194 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:57:39.524360 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-5b053cba-9cc7-4920-a15a-807defb9d4fd tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] 10.222.0.43 "GET /compute/v2.1/servers/dad442d9-d2e1-49ee-93ea-6e5090634df8" status: 200 len: 1307 microversion: 2.1 time: 0.507742 Oct 04 21:57:39.525634 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1479/3047] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:57:39 2022] GET /compute/v2.1/servers/dad442d9-d2e1-49ee-93ea-6e5090634df8 => generated 1307 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:57:39.765991 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-edfd76c6-45d0-4870-8dec-a9524b8af78a tempest-SecurityGroupsTestAdminJSON-2116946367 tempest-SecurityGroupsTestAdminJSON-2116946367-project] Action: 'create', calling method: .version_select at 0x7fbb2e338160>, body: {"security_group": {"name": "tempest-securitygroup-881014116", "description": "tempest-description-600738005"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:57:39.766466 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-771d8c6b-fb67-4dd4-b380-55a3d749bc52 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-1839428662", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452", "networks": [{"uuid": "154b38c8-528d-49af-ac34-5dfa45e9154b"}]}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:57:39.834978 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.network.neutron [None req-771d8c6b-fb67-4dd4-b380-55a3d749bc52 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] validate_networks() for [('154b38c8-528d-49af-ac34-5dfa45e9154b', None, None, None, None, None)] {{(pid=134102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:57:40.295134 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-edfd76c6-45d0-4870-8dec-a9524b8af78a tempest-SecurityGroupsTestAdminJSON-2116946367 tempest-SecurityGroupsTestAdminJSON-2116946367-project] 10.222.0.43 "POST /compute/v2.1/os-security-groups" status: 200 len: 219 microversion: 2.1 time: 0.764411 Oct 04 21:57:40.303426 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1480/3048] 10.222.0.43 () {60 vars in 1180 bytes} [Tue Oct 4 21:57:39 2022] POST /compute/v2.1/os-security-groups => generated 219 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:57:40.310846 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-34a569ef-203d-48d7-8f29-752a3686a2b2 tempest-SecurityGroupsNegativeTestJSON-577554570 tempest-SecurityGroupsNegativeTestJSON-577554570-project] Action: 'update', calling method: .version_select at 0x7fbb2e348430>, body: {"security_group": {"name": "tempest-sg-193747333", "description": "tempest-description-1911029751"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:57:40.379355 n-d-860284-1 devstack@n-api.service[134101]: DEBUG neutronclient.v2_0.client [None req-34a569ef-203d-48d7-8f29-752a3686a2b2 tempest-SecurityGroupsNegativeTestJSON-577554570 tempest-SecurityGroupsNegativeTestJSON-577554570-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 8b192367-f4cd-4351-ae2c-c7d69a4d1c9f does not exist", "detail": ""}} {{(pid=134101) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 21:57:40.380173 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.network.security_group_api [None req-34a569ef-203d-48d7-8f29-752a3686a2b2 tempest-SecurityGroupsNegativeTestJSON-577554570 tempest-SecurityGroupsNegativeTestJSON-577554570-project] Neutron security group 8b192367-f4cd-4351-ae2c-c7d69a4d1c9f not found {{(pid=134101) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 04 21:57:40.380873 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-34a569ef-203d-48d7-8f29-752a3686a2b2 tempest-SecurityGroupsNegativeTestJSON-577554570 tempest-SecurityGroupsNegativeTestJSON-577554570-project] HTTP exception thrown: Security group 8b192367-f4cd-4351-ae2c-c7d69a4d1c9f does not exist Oct 04 21:57:40.380873 n-d-860284-1 devstack@n-api.service[134101]: Neutron server returns request_ids: ['req-1114e0e1-f662-49af-b9c7-ac8fac0c9fe4'] Oct 04 21:57:40.383273 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-34a569ef-203d-48d7-8f29-752a3686a2b2 tempest-SecurityGroupsNegativeTestJSON-577554570 tempest-SecurityGroupsNegativeTestJSON-577554570-project] Request method failure captured: Oct 04 21:57:40.383273 n-d-860284-1 devstack@n-api.service[134101]: request: PUT /compute/v2.1/os-security-groups/8b192367-f4cd-4351-ae2c-c7d69a4d1c9f HTTP/1.1 Oct 04 21:57:40.383273 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 21:57:40.383273 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 21:57:40.383273 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 21:57:40.383273 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 101 Oct 04 21:57:40.383273 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 21:57:40.383273 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 21:57:40.383273 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 21:57:40.383273 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 21:57:40.383273 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPKxPxMBiGXB9R8dZ99o5OpEJRuNsJW-fFSW2A_NJfT0I6J-wFCHMzmo9iI-LNdvajjS2pMOfchf8QkDt6LPnu6a1jQWfCj2TbmXSGZ2VJ5k-VwpO11qzAiPHFSFtjVPbxHOqNygK7jGrQSWaX4AwvqxWQWntdL1h5EHQBi3Ic9IXKc0 Oct 04 21:57:40.383273 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 21:57:40.383273 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 21:57:40.383273 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 21:57:40.383273 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 21:57:40.383273 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 21:57:40.383273 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 21:57:40.383273 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: 5d2b809a672b457090c7f89f58f322be Oct 04 21:57:40.383273 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-577554570 Oct 04 21:57:40.383273 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 21:57:40.383273 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 21:57:40.383273 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5d2b809a672b457090c7f89f58f322be"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_5d2b809a672b457090c7f89f58f322be", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5d2b809a672b457090c7f89f58f322be"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/5d2b809a672b457090c7f89f58f322be"}]}] Oct 04 21:57:40.383273 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-577554570 Oct 04 21:57:40.383273 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: 5d2b809a672b457090c7f89f58f322be Oct 04 21:57:40.383273 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-577554570 Oct 04 21:57:40.383273 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-SecurityGroupsNegativeTestJSON-577554570-project Oct 04 21:57:40.383273 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 21:57:40.383273 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 21:57:40.383273 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: c2550ee7a7494717b9737710fe1199f9 Oct 04 21:57:40.383273 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-577554570-project Oct 04 21:57:40.383273 n-d-860284-1 devstack@n-api.service[134101]: Oct 04 21:57:40.383273 n-d-860284-1 devstack@n-api.service[134101]: {"security_group": {"name": "tempest-sg-193747333", "description": "tempest-description-1911029751"}} Oct 04 21:57:40.383273 n-d-860284-1 devstack@n-api.service[134101]: method: Oct 04 21:57:40.383273 n-d-860284-1 devstack@n-api.service[134101]: exception: Security group 8b192367-f4cd-4351-ae2c-c7d69a4d1c9f does not exist Oct 04 21:57:40.383273 n-d-860284-1 devstack@n-api.service[134101]: Neutron server returns request_ids: ['req-1114e0e1-f662-49af-b9c7-ac8fac0c9fe4'] Oct 04 21:57:40.383273 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': '8b192367-f4cd-4351-ae2c-c7d69a4d1c9f', 'body': {'security_group': {'name': 'tempest-sg-193747333', 'description': 'tempest-description-1911029751'}}} Oct 04 21:57:40.383273 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:57:40.383273 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:57:40.383273 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 04 21:57:40.383273 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 04 21:57:40.383273 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:57:40.383273 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:57:40.383273 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 04 21:57:40.383273 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 04 21:57:40.383273 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:57:40.383273 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:57:40.383273 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 21:57:40.383273 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 21:57:40.383273 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:57:40.383273 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:57:40.383273 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 21:57:40.383273 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 21:57:40.383273 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:57:40.383273 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:57:40.383273 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 21:57:40.383273 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 21:57:40.383273 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:57:40.383273 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:57:40.383273 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 21:57:40.383273 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 21:57:40.383273 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 21:57:40.387603 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 21:57:40.387603 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 8b192367-f4cd-4351-ae2c-c7d69a4d1c9f does not exist Oct 04 21:57:40.387603 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1114e0e1-f662-49af-b9c7-ac8fac0c9fe4'] Oct 04 21:57:40.387603 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:57:40.387603 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:57:40.387603 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:57:40.387603 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:57:40.387603 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update Oct 04 21:57:40.387603 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 04 21:57:40.387603 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 04 21:57:40.387603 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 21:57:40.387603 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 8b192367-f4cd-4351-ae2c-c7d69a4d1c9f does not exist Oct 04 21:57:40.387603 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1114e0e1-f662-49af-b9c7-ac8fac0c9fe4'] Oct 04 21:57:40.387603 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:57:40.387603 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:57:40.387603 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:57:40.387603 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:57:40.387603 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:57:40.387603 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:57:40.387603 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:57:40.387603 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:57:40.387603 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:57:40.387603 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:57:40.387603 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:57:40.387603 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:57:40.387603 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update Oct 04 21:57:40.387603 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 21:57:40.387603 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 8b192367-f4cd-4351-ae2c-c7d69a4d1c9f does not exist Oct 04 21:57:40.387603 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1114e0e1-f662-49af-b9c7-ac8fac0c9fe4'] Oct 04 21:57:40.387603 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:57:40.387603 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:57:40.387603 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:57:40.387603 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:57:40.387603 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:57:40.387603 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:57:40.387603 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:57:40.387603 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:57:40.387603 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 8b192367-f4cd-4351-ae2c-c7d69a4d1c9f does not exist Oct 04 21:57:40.387603 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1114e0e1-f662-49af-b9c7-ac8fac0c9fe4'] Oct 04 21:57:40.387603 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:57:40.393406 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-34a569ef-203d-48d7-8f29-752a3686a2b2 tempest-SecurityGroupsNegativeTestJSON-577554570 tempest-SecurityGroupsNegativeTestJSON-577554570-project] Returning 404 to user: Security group 8b192367-f4cd-4351-ae2c-c7d69a4d1c9f does not exist Oct 04 21:57:40.393406 n-d-860284-1 devstack@n-api.service[134101]: Neutron server returns request_ids: ['req-1114e0e1-f662-49af-b9c7-ac8fac0c9fe4'] {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:57:40.395148 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-34a569ef-203d-48d7-8f29-752a3686a2b2 tempest-SecurityGroupsNegativeTestJSON-577554570 tempest-SecurityGroupsNegativeTestJSON-577554570-project] 10.222.0.43 "PUT /compute/v2.1/os-security-groups/8b192367-f4cd-4351-ae2c-c7d69a4d1c9f" status: 404 len: 194 microversion: 2.1 time: 0.089616 Oct 04 21:57:40.395902 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1481/3049] 10.222.0.43 () {60 vars in 1290 bytes} [Tue Oct 4 21:57:40 2022] PUT /compute/v2.1/os-security-groups/8b192367-f4cd-4351-ae2c-c7d69a4d1c9f => generated 194 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:57:40.410477 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-a65f4ae7-2813-4d9d-b1a8-f46aacd7c34d req-77c4bb60-a4b8-4bb5-8e9e-b3ae5491c271 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16792146-aedb-4782-ba6f-5cbd7a7d0f62", "name": "network-vif-plugged", "status": "completed", "tag": "08edbe4b-d2a0-4913-8c9e-e4477409197e"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:57:40.421616 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-a65f4ae7-2813-4d9d-b1a8-f46aacd7c34d req-77c4bb60-a4b8-4bb5-8e9e-b3ae5491c271 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:40.422823 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-a65f4ae7-2813-4d9d-b1a8-f46aacd7c34d req-77c4bb60-a4b8-4bb5-8e9e-b3ae5491c271 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:40.423489 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-a65f4ae7-2813-4d9d-b1a8-f46aacd7c34d req-77c4bb60-a4b8-4bb5-8e9e-b3ae5491c271 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:40.436945 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-a65f4ae7-2813-4d9d-b1a8-f46aacd7c34d req-77c4bb60-a4b8-4bb5-8e9e-b3ae5491c271 service nova] Creating event network-vif-plugged:08edbe4b-d2a0-4913-8c9e-e4477409197e for instance 16792146-aedb-4782-ba6f-5cbd7a7d0f62 on n-h1-860284-1 Oct 04 21:57:40.443083 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-a65f4ae7-2813-4d9d-b1a8-f46aacd7c34d req-77c4bb60-a4b8-4bb5-8e9e-b3ae5491c271 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045377 Oct 04 21:57:40.444279 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1482/3050] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:57:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:57:40.456773 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-970d6f5e-f097-40ea-b6c2-1c37c78cd843 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:57:40.457760 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-970d6f5e-f097-40ea-b6c2-1c37c78cd843 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: dd1b7876-cc6f-4ed3-a0e4-cfe2213b332f] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:57:40.465129 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-970d6f5e-f097-40ea-b6c2-1c37c78cd843 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:40.465824 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-970d6f5e-f097-40ea-b6c2-1c37c78cd843 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:40.466470 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-970d6f5e-f097-40ea-b6c2-1c37c78cd843 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:40.467332 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-970d6f5e-f097-40ea-b6c2-1c37c78cd843 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:40.467949 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-970d6f5e-f097-40ea-b6c2-1c37c78cd843 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:40.468531 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-970d6f5e-f097-40ea-b6c2-1c37c78cd843 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:40.618930 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-970d6f5e-f097-40ea-b6c2-1c37c78cd843 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2facee4c6a40416e908083e126d2cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07a17a482a4e92b6ddbdee463c8029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:57:40.628926 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-771d8c6b-fb67-4dd4-b380-55a3d749bc52 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Flavor limits 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:57:40.629466 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-771d8c6b-fb67-4dd4-b380-55a3d749bc52 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Image limits 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:57:40.630059 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-771d8c6b-fb67-4dd4-b380-55a3d749bc52 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Flavor pref 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:57:40.630628 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-771d8c6b-fb67-4dd4-b380-55a3d749bc52 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Image pref 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:57:40.631144 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-771d8c6b-fb67-4dd4-b380-55a3d749bc52 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:57:40.645929 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-970d6f5e-f097-40ea-b6c2-1c37c78cd843 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/dd1b7876-cc6f-4ed3-a0e4-cfe2213b332f" status: 200 len: 1220 microversion: 2.1 time: 0.196426 Oct 04 21:57:40.648507 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-771d8c6b-fb67-4dd4-b380-55a3d749bc52 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:40.649421 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-771d8c6b-fb67-4dd4-b380-55a3d749bc52 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:40.650787 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-771d8c6b-fb67-4dd4-b380-55a3d749bc52 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:40.651804 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-771d8c6b-fb67-4dd4-b380-55a3d749bc52 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:40.652376 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-771d8c6b-fb67-4dd4-b380-55a3d749bc52 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:40.652903 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-771d8c6b-fb67-4dd4-b380-55a3d749bc52 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:40.662775 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1483/3051] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:57:40 2022] GET /compute/v2.1/servers/dd1b7876-cc6f-4ed3-a0e4-cfe2213b332f => generated 1220 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:57:40.671598 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-3b4a3c1d-dc8d-4d0b-8cc2-d121be711256 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:57:40.672411 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-3b4a3c1d-dc8d-4d0b-8cc2-d121be711256 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] [instance: 16792146-aedb-4782-ba6f-5cbd7a7d0f62] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:57:40.679441 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3b4a3c1d-dc8d-4d0b-8cc2-d121be711256 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:40.680134 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3b4a3c1d-dc8d-4d0b-8cc2-d121be711256 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:40.680913 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3b4a3c1d-dc8d-4d0b-8cc2-d121be711256 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:40.681822 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3b4a3c1d-dc8d-4d0b-8cc2-d121be711256 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:40.682475 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3b4a3c1d-dc8d-4d0b-8cc2-d121be711256 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:40.683825 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3b4a3c1d-dc8d-4d0b-8cc2-d121be711256 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:40.696834 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-771d8c6b-fb67-4dd4-b380-55a3d749bc52 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Getting quotas for project b7d23c1f5719481483f4a28b76e45514. Resources: {'instances', 'ram', 'cores'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:57:40.703721 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-771d8c6b-fb67-4dd4-b380-55a3d749bc52 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Getting quotas for user 3c386b2ed7064073944085bf2a41f0de and project b7d23c1f5719481483f4a28b76e45514. Resources: {'instances', 'ram', 'cores'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:57:40.722181 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-771d8c6b-fb67-4dd4-b380-55a3d749bc52 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Going to run 1 instances... {{(pid=134102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:57:40.724670 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-771d8c6b-fb67-4dd4-b380-55a3d749bc52 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] [instance: 2764125d-9366-4c77-b1ee-7f188df21205] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='58548514-5dac-426c-81f5-19e3fba33e23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:57:40.785945 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-771d8c6b-fb67-4dd4-b380-55a3d749bc52 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.266683 Oct 04 21:57:40.787468 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1569/3052] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 21:57:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 1269 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:57:40.796710 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-3886bb82-f12c-4543-a7da-6187ac79f8df tempest-SecurityGroupsTestAdminJSON-2116946367 tempest-SecurityGroupsTestAdminJSON-2116946367-project] Action: 'create', calling method: .version_select at 0x7fbb2e625f70>, body: {"security_group": {"name": "tempest-securitygroup-1947698997", "description": "tempest-description-823400104"}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:57:41.003426 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-3b4a3c1d-dc8d-4d0b-8cc2-d121be711256 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a94113bec89469a844ede34890d6876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857b9057c949472b9a1862182a01356c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:57:41.012834 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-3b4a3c1d-dc8d-4d0b-8cc2-d121be711256 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] 10.222.0.43 "GET /compute/v2.1/servers/16792146-aedb-4782-ba6f-5cbd7a7d0f62" status: 200 len: 1320 microversion: 2.1 time: 0.348502 Oct 04 21:57:41.014122 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1484/3053] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:57:40 2022] GET /compute/v2.1/servers/16792146-aedb-4782-ba6f-5cbd7a7d0f62 => generated 1320 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:57:41.020184 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-f1a5aeff-21d8-43f0-800c-d533853442a0 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:57:41.021158 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-f1a5aeff-21d8-43f0-800c-d533853442a0 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] [instance: 830de6ad-adc6-4d16-ae9d-a29ae85e6cd2] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:57:41.028481 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f1a5aeff-21d8-43f0-800c-d533853442a0 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:41.029435 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f1a5aeff-21d8-43f0-800c-d533853442a0 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:41.030008 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f1a5aeff-21d8-43f0-800c-d533853442a0 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:41.030991 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f1a5aeff-21d8-43f0-800c-d533853442a0 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:41.031964 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f1a5aeff-21d8-43f0-800c-d533853442a0 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:41.033071 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f1a5aeff-21d8-43f0-800c-d533853442a0 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:41.593822 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-3886bb82-f12c-4543-a7da-6187ac79f8df tempest-SecurityGroupsTestAdminJSON-2116946367 tempest-SecurityGroupsTestAdminJSON-2116946367-project] 10.222.0.43 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.803851 Oct 04 21:57:41.595222 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1570/3054] 10.222.0.43 () {60 vars in 1180 bytes} [Tue Oct 4 21:57:40 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:57:41.614346 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-0bf1b73c-885a-4344-881a-487bf6726558 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:57:41.615258 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-0bf1b73c-885a-4344-881a-487bf6726558 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] [instance: dad442d9-d2e1-49ee-93ea-6e5090634df8] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:57:41.637673 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0bf1b73c-885a-4344-881a-487bf6726558 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:41.640466 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0bf1b73c-885a-4344-881a-487bf6726558 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:41.641141 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0bf1b73c-885a-4344-881a-487bf6726558 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:41.644122 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0bf1b73c-885a-4344-881a-487bf6726558 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:41.646639 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0bf1b73c-885a-4344-881a-487bf6726558 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:41.647434 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0bf1b73c-885a-4344-881a-487bf6726558 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:41.653340 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=100 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:57:41.779533 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-f1a5aeff-21d8-43f0-800c-d533853442a0 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:57:41.794416 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-f1a5aeff-21d8-43f0-800c-d533853442a0 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:57:41.796345 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-f1a5aeff-21d8-43f0-800c-d533853442a0 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:57:41.798771 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-f1a5aeff-21d8-43f0-800c-d533853442a0 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] 10.222.0.43 "GET /compute/v2.1/servers/830de6ad-adc6-4d16-ae9d-a29ae85e6cd2" status: 200 len: 2958 microversion: 2.42 time: 0.782712 Oct 04 21:57:41.799899 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1485/3055] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:57:41 2022] GET /compute/v2.1/servers/830de6ad-adc6-4d16-ae9d-a29ae85e6cd2 => generated 2958 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:57:41.806484 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-3432e62a-cc5f-4995-a2a2-6476ff8cad5b tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:57:41.807240 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-3432e62a-cc5f-4995-a2a2-6476ff8cad5b tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] [instance: 2764125d-9366-4c77-b1ee-7f188df21205] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:57:41.814634 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3432e62a-cc5f-4995-a2a2-6476ff8cad5b tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:41.815412 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3432e62a-cc5f-4995-a2a2-6476ff8cad5b tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:41.816242 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3432e62a-cc5f-4995-a2a2-6476ff8cad5b tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:41.817352 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3432e62a-cc5f-4995-a2a2-6476ff8cad5b tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:41.818158 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3432e62a-cc5f-4995-a2a2-6476ff8cad5b tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:41.818839 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3432e62a-cc5f-4995-a2a2-6476ff8cad5b tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:41.893906 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-0bf1b73c-885a-4344-881a-487bf6726558 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e807c724cc4c3887a2d360f0584ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40071e45805146529fb8abd40629c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:57:41.904456 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-0bf1b73c-885a-4344-881a-487bf6726558 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] 10.222.0.43 "GET /compute/v2.1/servers/dad442d9-d2e1-49ee-93ea-6e5090634df8" status: 200 len: 1307 microversion: 2.1 time: 0.307400 Oct 04 21:57:41.905850 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1571/3056] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:57:41 2022] GET /compute/v2.1/servers/dad442d9-d2e1-49ee-93ea-6e5090634df8 => generated 1307 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:57:41.926280 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-3432e62a-cc5f-4995-a2a2-6476ff8cad5b tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c386b2ed7064073944085bf2a41f0de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d23c1f5719481483f4a28b76e45514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:57:41.935966 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-3432e62a-cc5f-4995-a2a2-6476ff8cad5b tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] 10.222.0.43 "GET /compute/v2.1/servers/2764125d-9366-4c77-b1ee-7f188df21205" status: 200 len: 1267 microversion: 2.1 time: 0.134354 Oct 04 21:57:41.936929 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1486/3057] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:57:41 2022] GET /compute/v2.1/servers/2764125d-9366-4c77-b1ee-7f188df21205 => generated 1267 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:57:41.942276 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-a11ec69e-50cf-4547-a5fc-1d440b60be9b tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:57:41.943069 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-a11ec69e-50cf-4547-a5fc-1d440b60be9b tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: dd1b7876-cc6f-4ed3-a0e4-cfe2213b332f] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:57:41.955361 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a11ec69e-50cf-4547-a5fc-1d440b60be9b tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:41.959146 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a11ec69e-50cf-4547-a5fc-1d440b60be9b tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:41.959877 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a11ec69e-50cf-4547-a5fc-1d440b60be9b tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:41.960640 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a11ec69e-50cf-4547-a5fc-1d440b60be9b tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:41.961760 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a11ec69e-50cf-4547-a5fc-1d440b60be9b tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:41.963483 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a11ec69e-50cf-4547-a5fc-1d440b60be9b tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:42.042873 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-a11ec69e-50cf-4547-a5fc-1d440b60be9b tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2facee4c6a40416e908083e126d2cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07a17a482a4e92b6ddbdee463c8029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:57:42.053399 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-a11ec69e-50cf-4547-a5fc-1d440b60be9b tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/dd1b7876-cc6f-4ed3-a0e4-cfe2213b332f" status: 200 len: 1268 microversion: 2.1 time: 0.115070 Oct 04 21:57:42.055013 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1487/3058] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:57:41 2022] GET /compute/v2.1/servers/dd1b7876-cc6f-4ed3-a0e4-cfe2213b332f => generated 1268 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:57:42.072614 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-27cf591c-29c3-456c-9cd7-f9c3f36429ab tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:57:42.074783 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-27cf591c-29c3-456c-9cd7-f9c3f36429ab tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] [instance: 16792146-aedb-4782-ba6f-5cbd7a7d0f62] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:57:42.087733 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-27cf591c-29c3-456c-9cd7-f9c3f36429ab tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:42.088691 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-27cf591c-29c3-456c-9cd7-f9c3f36429ab tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:42.089287 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-27cf591c-29c3-456c-9cd7-f9c3f36429ab tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:42.090444 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-27cf591c-29c3-456c-9cd7-f9c3f36429ab tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:42.090911 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-27cf591c-29c3-456c-9cd7-f9c3f36429ab tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:42.091344 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-27cf591c-29c3-456c-9cd7-f9c3f36429ab tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:42.326095 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-b0e49955-f15a-4422-91ce-7270058b33ac tempest-SecurityGroupsTestAdminJSON-1137338736 tempest-SecurityGroupsTestAdminJSON-1137338736-project-admin] Action: 'create', calling method: .version_select at 0x7fbb2e594670>, body: {"security_group": {"name": "tempest-securitygroup-1782583955", "description": "tempest-description-1583015394"}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:57:42.345652 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-27cf591c-29c3-456c-9cd7-f9c3f36429ab tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a94113bec89469a844ede34890d6876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857b9057c949472b9a1862182a01356c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:57:42.348931 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:57:42.363445 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-27cf591c-29c3-456c-9cd7-f9c3f36429ab tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] 10.222.0.43 "GET /compute/v2.1/servers/16792146-aedb-4782-ba6f-5cbd7a7d0f62" status: 200 len: 1320 microversion: 2.1 time: 0.301774 Oct 04 21:57:42.365510 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1488/3059] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:57:42 2022] GET /compute/v2.1/servers/16792146-aedb-4782-ba6f-5cbd7a7d0f62 => generated 1320 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:57:42.462948 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-85662e96-53b5-4096-80d1-189de36cef36 req-c8c29b93-bea0-43ac-a75d-5ecc56290458 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dad442d9-d2e1-49ee-93ea-6e5090634df8", "name": "network-vif-plugged", "status": "completed", "tag": "38ab1df9-0112-4774-abf7-063259d4b821"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:57:42.493530 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-85662e96-53b5-4096-80d1-189de36cef36 req-c8c29b93-bea0-43ac-a75d-5ecc56290458 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:42.495995 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-85662e96-53b5-4096-80d1-189de36cef36 req-c8c29b93-bea0-43ac-a75d-5ecc56290458 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:42.496699 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-85662e96-53b5-4096-80d1-189de36cef36 req-c8c29b93-bea0-43ac-a75d-5ecc56290458 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:42.535273 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-85662e96-53b5-4096-80d1-189de36cef36 req-c8c29b93-bea0-43ac-a75d-5ecc56290458 service nova] Creating event network-vif-plugged:38ab1df9-0112-4774-abf7-063259d4b821 for instance dad442d9-d2e1-49ee-93ea-6e5090634df8 on n-h2-860284-1 Oct 04 21:57:42.549562 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-85662e96-53b5-4096-80d1-189de36cef36 req-c8c29b93-bea0-43ac-a75d-5ecc56290458 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089628 Oct 04 21:57:42.557339 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1489/3060] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:57:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:57:42.832901 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-46550083-5769-4b75-a3db-e8f3fe6d0b1d tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:57:42.833955 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-46550083-5769-4b75-a3db-e8f3fe6d0b1d tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] [instance: 830de6ad-adc6-4d16-ae9d-a29ae85e6cd2] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:57:42.852899 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-46550083-5769-4b75-a3db-e8f3fe6d0b1d tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:42.853406 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-46550083-5769-4b75-a3db-e8f3fe6d0b1d tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:42.855573 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-46550083-5769-4b75-a3db-e8f3fe6d0b1d tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:42.856344 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-46550083-5769-4b75-a3db-e8f3fe6d0b1d tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:42.856818 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-46550083-5769-4b75-a3db-e8f3fe6d0b1d tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:42.857269 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-46550083-5769-4b75-a3db-e8f3fe6d0b1d tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:43.535949 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-46550083-5769-4b75-a3db-e8f3fe6d0b1d tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:57:43.553931 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-b0e49955-f15a-4422-91ce-7270058b33ac tempest-SecurityGroupsTestAdminJSON-1137338736 tempest-SecurityGroupsTestAdminJSON-1137338736-project-admin] 10.222.0.43 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 1.643622 Oct 04 21:57:43.561460 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1572/3061] 10.222.0.43 () {60 vars in 1180 bytes} [Tue Oct 4 21:57:41 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 1655 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:57:43.573616 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-46550083-5769-4b75-a3db-e8f3fe6d0b1d tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:57:43.582083 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-46550083-5769-4b75-a3db-e8f3fe6d0b1d tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:57:43.583938 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-46550083-5769-4b75-a3db-e8f3fe6d0b1d tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] 10.222.0.43 "GET /compute/v2.1/servers/830de6ad-adc6-4d16-ae9d-a29ae85e6cd2" status: 200 len: 2958 microversion: 2.42 time: 0.756843 Oct 04 21:57:43.588772 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-e877bb58-37b5-4da6-8b3c-c8f7f6dec601 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:57:43.594074 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1490/3062] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:57:42 2022] GET /compute/v2.1/servers/830de6ad-adc6-4d16-ae9d-a29ae85e6cd2 => generated 2958 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:57:43.594558 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-e877bb58-37b5-4da6-8b3c-c8f7f6dec601 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] [instance: dad442d9-d2e1-49ee-93ea-6e5090634df8] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:57:43.615724 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-90b775f6-2587-49fd-b848-fe984cad40a0 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:57:43.616359 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-90b775f6-2587-49fd-b848-fe984cad40a0 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] [instance: 2764125d-9366-4c77-b1ee-7f188df21205] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:57:43.617869 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e877bb58-37b5-4da6-8b3c-c8f7f6dec601 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:43.619285 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e877bb58-37b5-4da6-8b3c-c8f7f6dec601 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:43.620289 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e877bb58-37b5-4da6-8b3c-c8f7f6dec601 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:43.621216 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e877bb58-37b5-4da6-8b3c-c8f7f6dec601 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:43.622562 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e877bb58-37b5-4da6-8b3c-c8f7f6dec601 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:43.623190 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e877bb58-37b5-4da6-8b3c-c8f7f6dec601 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:43.640332 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-90b775f6-2587-49fd-b848-fe984cad40a0 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:43.640847 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-90b775f6-2587-49fd-b848-fe984cad40a0 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:43.641295 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-90b775f6-2587-49fd-b848-fe984cad40a0 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:43.642226 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-90b775f6-2587-49fd-b848-fe984cad40a0 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:43.642726 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-90b775f6-2587-49fd-b848-fe984cad40a0 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:43.643161 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-90b775f6-2587-49fd-b848-fe984cad40a0 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:43.878454 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-90b775f6-2587-49fd-b848-fe984cad40a0 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c386b2ed7064073944085bf2a41f0de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d23c1f5719481483f4a28b76e45514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:57:43.887791 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-90b775f6-2587-49fd-b848-fe984cad40a0 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] 10.222.0.43 "GET /compute/v2.1/servers/2764125d-9366-4c77-b1ee-7f188df21205" status: 200 len: 1273 microversion: 2.1 time: 0.292451 Oct 04 21:57:43.902861 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1491/3063] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:57:43 2022] GET /compute/v2.1/servers/2764125d-9366-4c77-b1ee-7f188df21205 => generated 1273 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:57:43.911298 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-d541883f-25fb-44a0-b555-00d3aaaba484 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:57:43.912093 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-d541883f-25fb-44a0-b555-00d3aaaba484 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: dd1b7876-cc6f-4ed3-a0e4-cfe2213b332f] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:57:43.918953 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d541883f-25fb-44a0-b555-00d3aaaba484 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:43.919788 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d541883f-25fb-44a0-b555-00d3aaaba484 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:43.920402 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d541883f-25fb-44a0-b555-00d3aaaba484 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:43.921339 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d541883f-25fb-44a0-b555-00d3aaaba484 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:43.922004 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d541883f-25fb-44a0-b555-00d3aaaba484 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:43.922626 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d541883f-25fb-44a0-b555-00d3aaaba484 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:43.976322 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-e877bb58-37b5-4da6-8b3c-c8f7f6dec601 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e807c724cc4c3887a2d360f0584ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40071e45805146529fb8abd40629c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:57:43.985374 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-e877bb58-37b5-4da6-8b3c-c8f7f6dec601 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] 10.222.0.43 "GET /compute/v2.1/servers/dad442d9-d2e1-49ee-93ea-6e5090634df8" status: 200 len: 1307 microversion: 2.1 time: 0.421115 Oct 04 21:57:43.989409 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1573/3064] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:57:43 2022] GET /compute/v2.1/servers/dad442d9-d2e1-49ee-93ea-6e5090634df8 => generated 1307 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:57:44.004824 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-d5b3386f-7f59-4c8c-8e26-477e2f2c0169 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:57:44.005845 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-d5b3386f-7f59-4c8c-8e26-477e2f2c0169 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] [instance: 16792146-aedb-4782-ba6f-5cbd7a7d0f62] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:57:44.015736 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d5b3386f-7f59-4c8c-8e26-477e2f2c0169 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:44.020456 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d5b3386f-7f59-4c8c-8e26-477e2f2c0169 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:44.021203 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d5b3386f-7f59-4c8c-8e26-477e2f2c0169 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:44.022193 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d5b3386f-7f59-4c8c-8e26-477e2f2c0169 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:44.022909 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d5b3386f-7f59-4c8c-8e26-477e2f2c0169 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:44.023547 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d5b3386f-7f59-4c8c-8e26-477e2f2c0169 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:44.057677 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-d541883f-25fb-44a0-b555-00d3aaaba484 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2facee4c6a40416e908083e126d2cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07a17a482a4e92b6ddbdee463c8029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:57:44.071167 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-d541883f-25fb-44a0-b555-00d3aaaba484 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/dd1b7876-cc6f-4ed3-a0e4-cfe2213b332f" status: 200 len: 1274 microversion: 2.1 time: 0.166427 Oct 04 21:57:44.072550 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1492/3065] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:57:43 2022] GET /compute/v2.1/servers/dd1b7876-cc6f-4ed3-a0e4-cfe2213b332f => generated 1274 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:57:44.077986 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-c74fd95b-fe85-427f-b790-ef850c5de7a4 tempest-SecurityGroupsTestAdminJSON-1137338736 tempest-SecurityGroupsTestAdminJSON-1137338736-project-admin] Action: 'create', calling method: .version_select at 0x7fbb2ed0a3a0>, body: {"security_group": {"name": "tempest-securitygroup-238581906", "description": "tempest-description-2123954198"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:57:44.334433 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-d5b3386f-7f59-4c8c-8e26-477e2f2c0169 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a94113bec89469a844ede34890d6876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857b9057c949472b9a1862182a01356c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:57:44.345837 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-d5b3386f-7f59-4c8c-8e26-477e2f2c0169 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] 10.222.0.43 "GET /compute/v2.1/servers/16792146-aedb-4782-ba6f-5cbd7a7d0f62" status: 200 len: 1508 microversion: 2.1 time: 0.353504 Oct 04 21:57:44.360011 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1574/3066] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:57:43 2022] GET /compute/v2.1/servers/16792146-aedb-4782-ba6f-5cbd7a7d0f62 => generated 1508 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:57:44.373212 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-70068e52-b432-47da-8627-99f9d6da94ba tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:57:44.374642 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-70068e52-b432-47da-8627-99f9d6da94ba tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] [instance: f61f3b8b-9a3c-4d10-9dc4-8397e27f0237] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:57:44.383384 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-70068e52-b432-47da-8627-99f9d6da94ba tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:44.384259 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-70068e52-b432-47da-8627-99f9d6da94ba tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:44.385240 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-70068e52-b432-47da-8627-99f9d6da94ba tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:44.387207 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-70068e52-b432-47da-8627-99f9d6da94ba tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:44.387994 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-70068e52-b432-47da-8627-99f9d6da94ba tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:44.388750 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-70068e52-b432-47da-8627-99f9d6da94ba tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:44.508075 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-c74fd95b-fe85-427f-b790-ef850c5de7a4 tempest-SecurityGroupsTestAdminJSON-1137338736 tempest-SecurityGroupsTestAdminJSON-1137338736-project-admin] 10.222.0.43 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.434095 Oct 04 21:57:44.518920 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1493/3067] 10.222.0.43 () {60 vars in 1180 bytes} [Tue Oct 4 21:57:44 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:57:44.534391 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-81161883-b7ab-4105-b26e-f321ad1f3814 tempest-SecurityGroupsTestAdminJSON-1137338736 tempest-SecurityGroupsTestAdminJSON-1137338736-project-admin] Calling method '.version_select at 0x7fbb2e35f4c0>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:57:44.637276 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-70068e52-b432-47da-8627-99f9d6da94ba tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a94113bec89469a844ede34890d6876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857b9057c949472b9a1862182a01356c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:57:44.655678 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-70068e52-b432-47da-8627-99f9d6da94ba tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] 10.222.0.43 "GET /compute/v2.1/servers/f61f3b8b-9a3c-4d10-9dc4-8397e27f0237" status: 200 len: 1509 microversion: 2.1 time: 0.286612 Oct 04 21:57:44.660889 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1575/3068] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:57:44 2022] GET /compute/v2.1/servers/f61f3b8b-9a3c-4d10-9dc4-8397e27f0237 => generated 1509 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:57:44.671543 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-a7320af3-4273-4d88-85c1-f9c8734e99f4 req-aada2ee8-56d6-4253-afdd-beed00fc082e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "830de6ad-adc6-4d16-ae9d-a29ae85e6cd2", "name": "network-vif-unplugged", "status": "completed", "tag": "50799c10-da56-4cd6-bf7b-3175d2e729a5"}, {"server_uuid": "830de6ad-adc6-4d16-ae9d-a29ae85e6cd2", "name": "network-vif-unplugged", "status": "completed", "tag": "e9d774f8-8705-408f-87ab-9a4e3cdf9653"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:57:44.700416 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-a7320af3-4273-4d88-85c1-f9c8734e99f4 req-aada2ee8-56d6-4253-afdd-beed00fc082e service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:44.701159 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-a7320af3-4273-4d88-85c1-f9c8734e99f4 req-aada2ee8-56d6-4253-afdd-beed00fc082e service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:44.701844 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-a7320af3-4273-4d88-85c1-f9c8734e99f4 req-aada2ee8-56d6-4253-afdd-beed00fc082e service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:44.727185 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-a7320af3-4273-4d88-85c1-f9c8734e99f4 req-aada2ee8-56d6-4253-afdd-beed00fc082e service nova] Creating event network-vif-unplugged:50799c10-da56-4cd6-bf7b-3175d2e729a5 for instance 830de6ad-adc6-4d16-ae9d-a29ae85e6cd2 on n-h1-860284-1 Oct 04 21:57:44.732835 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-a7320af3-4273-4d88-85c1-f9c8734e99f4 req-aada2ee8-56d6-4253-afdd-beed00fc082e service nova] Creating event network-vif-unplugged:e9d774f8-8705-408f-87ab-9a4e3cdf9653 for instance 830de6ad-adc6-4d16-ae9d-a29ae85e6cd2 on n-h1-860284-1 Oct 04 21:57:44.748881 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-a7320af3-4273-4d88-85c1-f9c8734e99f4 req-aada2ee8-56d6-4253-afdd-beed00fc082e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.086241 Oct 04 21:57:44.750153 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1576/3069] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:57:44 2022] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:57:44.764818 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-ff1b0b2e-e51f-4795-80f0-8adcefaf63de tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:57:44.768959 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-ff1b0b2e-e51f-4795-80f0-8adcefaf63de tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] [instance: 830de6ad-adc6-4d16-ae9d-a29ae85e6cd2] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:57:44.782974 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ff1b0b2e-e51f-4795-80f0-8adcefaf63de tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:44.785914 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ff1b0b2e-e51f-4795-80f0-8adcefaf63de tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:44.786892 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ff1b0b2e-e51f-4795-80f0-8adcefaf63de tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:44.787707 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ff1b0b2e-e51f-4795-80f0-8adcefaf63de tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:44.788190 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ff1b0b2e-e51f-4795-80f0-8adcefaf63de tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:44.797783 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ff1b0b2e-e51f-4795-80f0-8adcefaf63de tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:45.197851 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-ff1b0b2e-e51f-4795-80f0-8adcefaf63de tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:57:45.229373 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-ff1b0b2e-e51f-4795-80f0-8adcefaf63de tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:57:45.244069 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-ff1b0b2e-e51f-4795-80f0-8adcefaf63de tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:57:45.246529 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-ff1b0b2e-e51f-4795-80f0-8adcefaf63de tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] 10.222.0.43 "GET /compute/v2.1/servers/830de6ad-adc6-4d16-ae9d-a29ae85e6cd2" status: 200 len: 2958 microversion: 2.42 time: 0.494314 Oct 04 21:57:45.247646 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1577/3070] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:57:44 2022] GET /compute/v2.1/servers/830de6ad-adc6-4d16-ae9d-a29ae85e6cd2 => generated 2958 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:57:45.258155 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-098f476b-0699-4788-8758-55f1c20ff58a tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:57:45.262510 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-098f476b-0699-4788-8758-55f1c20ff58a tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] [instance: f61f3b8b-9a3c-4d10-9dc4-8397e27f0237] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:57:45.277834 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-098f476b-0699-4788-8758-55f1c20ff58a tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:45.279790 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-098f476b-0699-4788-8758-55f1c20ff58a tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:45.281512 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-098f476b-0699-4788-8758-55f1c20ff58a tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:45.284882 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-098f476b-0699-4788-8758-55f1c20ff58a tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:45.287392 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-098f476b-0699-4788-8758-55f1c20ff58a tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:45.288181 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-098f476b-0699-4788-8758-55f1c20ff58a tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:45.361327 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-098f476b-0699-4788-8758-55f1c20ff58a tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] [instance: f61f3b8b-9a3c-4d10-9dc4-8397e27f0237] Going to try to terminate instance {{(pid=134102) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:57:45.544333 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-098f476b-0699-4788-8758-55f1c20ff58a tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] 10.222.0.43 "DELETE /compute/v2.1/servers/f61f3b8b-9a3c-4d10-9dc4-8397e27f0237" status: 204 len: 0 microversion: 2.1 time: 0.294146 Oct 04 21:57:45.545108 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1578/3071] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 21:57:45 2022] DELETE /compute/v2.1/servers/f61f3b8b-9a3c-4d10-9dc4-8397e27f0237 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:57:45.557522 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-d1005c17-5234-455c-b095-a09889755004 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:57:45.560034 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-d1005c17-5234-455c-b095-a09889755004 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] [instance: 2764125d-9366-4c77-b1ee-7f188df21205] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:57:45.572898 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d1005c17-5234-455c-b095-a09889755004 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:45.574426 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d1005c17-5234-455c-b095-a09889755004 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:45.577086 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d1005c17-5234-455c-b095-a09889755004 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:45.577804 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d1005c17-5234-455c-b095-a09889755004 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:45.578288 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d1005c17-5234-455c-b095-a09889755004 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:45.578753 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d1005c17-5234-455c-b095-a09889755004 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:45.880947 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-d1005c17-5234-455c-b095-a09889755004 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c386b2ed7064073944085bf2a41f0de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d23c1f5719481483f4a28b76e45514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:57:45.900677 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-d1005c17-5234-455c-b095-a09889755004 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] 10.222.0.43 "GET /compute/v2.1/servers/2764125d-9366-4c77-b1ee-7f188df21205" status: 200 len: 1315 microversion: 2.1 time: 0.353011 Oct 04 21:57:45.901549 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1579/3072] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:57:45 2022] GET /compute/v2.1/servers/2764125d-9366-4c77-b1ee-7f188df21205 => generated 1315 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:57:45.912467 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-e72b3442-ec30-4b21-ac9d-1670098e002c tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:57:45.913784 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-e72b3442-ec30-4b21-ac9d-1670098e002c tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] [instance: dad442d9-d2e1-49ee-93ea-6e5090634df8] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:57:45.936983 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e72b3442-ec30-4b21-ac9d-1670098e002c tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:45.944067 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e72b3442-ec30-4b21-ac9d-1670098e002c tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:45.944608 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e72b3442-ec30-4b21-ac9d-1670098e002c tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:45.945386 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e72b3442-ec30-4b21-ac9d-1670098e002c tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:45.946077 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e72b3442-ec30-4b21-ac9d-1670098e002c tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:45.946298 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e72b3442-ec30-4b21-ac9d-1670098e002c tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:46.195081 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-e72b3442-ec30-4b21-ac9d-1670098e002c tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e807c724cc4c3887a2d360f0584ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40071e45805146529fb8abd40629c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:57:46.207927 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-e72b3442-ec30-4b21-ac9d-1670098e002c tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] 10.222.0.43 "GET /compute/v2.1/servers/dad442d9-d2e1-49ee-93ea-6e5090634df8" status: 200 len: 1487 microversion: 2.1 time: 0.305080 Oct 04 21:57:46.209795 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1580/3073] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:57:45 2022] GET /compute/v2.1/servers/dad442d9-d2e1-49ee-93ea-6e5090634df8 => generated 1487 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:57:46.217298 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-c843cccf-d32c-4d38-a2af-a9310afac3fb tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:57:46.219151 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-c843cccf-d32c-4d38-a2af-a9310afac3fb tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: dd1b7876-cc6f-4ed3-a0e4-cfe2213b332f] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:57:46.228375 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c843cccf-d32c-4d38-a2af-a9310afac3fb tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:46.228874 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c843cccf-d32c-4d38-a2af-a9310afac3fb tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:46.229476 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c843cccf-d32c-4d38-a2af-a9310afac3fb tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:46.230203 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c843cccf-d32c-4d38-a2af-a9310afac3fb tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:46.230862 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c843cccf-d32c-4d38-a2af-a9310afac3fb tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:46.231340 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c843cccf-d32c-4d38-a2af-a9310afac3fb tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:46.522170 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-c843cccf-d32c-4d38-a2af-a9310afac3fb tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2facee4c6a40416e908083e126d2cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07a17a482a4e92b6ddbdee463c8029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:57:46.532047 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-c843cccf-d32c-4d38-a2af-a9310afac3fb tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/dd1b7876-cc6f-4ed3-a0e4-cfe2213b332f" status: 200 len: 1316 microversion: 2.1 time: 0.320609 Oct 04 21:57:46.532834 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1581/3074] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:57:46 2022] GET /compute/v2.1/servers/dd1b7876-cc6f-4ed3-a0e4-cfe2213b332f => generated 1316 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:57:46.538035 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-ecff2d81-f888-41aa-bb1e-7c6bcd904f12 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:57:46.538620 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-ecff2d81-f888-41aa-bb1e-7c6bcd904f12 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] [instance: 16792146-aedb-4782-ba6f-5cbd7a7d0f62] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:57:46.558302 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ecff2d81-f888-41aa-bb1e-7c6bcd904f12 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:46.559112 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ecff2d81-f888-41aa-bb1e-7c6bcd904f12 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:46.560350 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ecff2d81-f888-41aa-bb1e-7c6bcd904f12 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:46.560840 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ecff2d81-f888-41aa-bb1e-7c6bcd904f12 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:46.561463 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ecff2d81-f888-41aa-bb1e-7c6bcd904f12 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:46.561962 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ecff2d81-f888-41aa-bb1e-7c6bcd904f12 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:46.625665 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-ecff2d81-f888-41aa-bb1e-7c6bcd904f12 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] [instance: 16792146-aedb-4782-ba6f-5cbd7a7d0f62] Going to try to terminate instance {{(pid=134102) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:57:46.746214 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-ecff2d81-f888-41aa-bb1e-7c6bcd904f12 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] 10.222.0.43 "DELETE /compute/v2.1/servers/16792146-aedb-4782-ba6f-5cbd7a7d0f62" status: 204 len: 0 microversion: 2.1 time: 0.211911 Oct 04 21:57:46.747376 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1582/3075] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 21:57:46 2022] DELETE /compute/v2.1/servers/16792146-aedb-4782-ba6f-5cbd7a7d0f62 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:57:46.789067 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-fe5792a4-8e30-4ff8-a4f1-9e14a86524cc tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:57:46.807677 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fe5792a4-8e30-4ff8-a4f1-9e14a86524cc tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:46.810058 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fe5792a4-8e30-4ff8-a4f1-9e14a86524cc tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:46.811023 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fe5792a4-8e30-4ff8-a4f1-9e14a86524cc tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:46.904220 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-fe5792a4-8e30-4ff8-a4f1-9e14a86524cc tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] [instance: dad442d9-d2e1-49ee-93ea-6e5090634df8] Going to try to stop instance {{(pid=134102) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 04 21:57:46.996034 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-fe5792a4-8e30-4ff8-a4f1-9e14a86524cc tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] 10.222.0.43 "POST /compute/v2.1/servers/dad442d9-d2e1-49ee-93ea-6e5090634df8/action" status: 202 len: 0 microversion: 2.1 time: 0.217263 Oct 04 21:57:46.997807 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1583/3076] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 21:57:46 2022] POST /compute/v2.1/servers/dad442d9-d2e1-49ee-93ea-6e5090634df8/action => generated 0 bytes in 222 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:57:47.013822 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-62232cf2-aa8b-421f-833b-a17b8652a6a8 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:57:47.014404 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-62232cf2-aa8b-421f-833b-a17b8652a6a8 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] [instance: 830de6ad-adc6-4d16-ae9d-a29ae85e6cd2] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:57:47.038275 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-62232cf2-aa8b-421f-833b-a17b8652a6a8 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:47.038833 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-62232cf2-aa8b-421f-833b-a17b8652a6a8 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:47.039309 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-62232cf2-aa8b-421f-833b-a17b8652a6a8 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:47.040047 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-62232cf2-aa8b-421f-833b-a17b8652a6a8 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:47.040506 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-62232cf2-aa8b-421f-833b-a17b8652a6a8 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:47.040933 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-62232cf2-aa8b-421f-833b-a17b8652a6a8 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:47.362329 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-62232cf2-aa8b-421f-833b-a17b8652a6a8 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:57:47.379372 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-62232cf2-aa8b-421f-833b-a17b8652a6a8 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:57:47.382397 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-62232cf2-aa8b-421f-833b-a17b8652a6a8 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:57:47.385307 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-62232cf2-aa8b-421f-833b-a17b8652a6a8 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] 10.222.0.43 "GET /compute/v2.1/servers/830de6ad-adc6-4d16-ae9d-a29ae85e6cd2" status: 200 len: 2916 microversion: 2.42 time: 0.381385 Oct 04 21:57:47.386627 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1584/3077] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:57:47 2022] GET /compute/v2.1/servers/830de6ad-adc6-4d16-ae9d-a29ae85e6cd2 => generated 2916 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:57:47.392086 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-8a9c9804-6dbb-43b1-b88d-b4372f77caf1 req-2be0267b-08f7-4ed4-91c1-f83a261bf39c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "830de6ad-adc6-4d16-ae9d-a29ae85e6cd2", "name": "network-vif-unplugged", "status": "completed", "tag": "655956e8-ae26-4dcc-9d3e-b8894103890e"}, {"server_uuid": "830de6ad-adc6-4d16-ae9d-a29ae85e6cd2", "name": "network-vif-unplugged", "status": "completed", "tag": "480ee163-2b8b-42e9-80e8-28254bda8c68"}, {"server_uuid": "830de6ad-adc6-4d16-ae9d-a29ae85e6cd2", "name": "network-vif-unplugged", "status": "completed", "tag": "d7975b45-e2eb-4527-a16c-14ce6defb614"}, {"server_uuid": "830de6ad-adc6-4d16-ae9d-a29ae85e6cd2", "name": "network-vif-unplugged", "status": "completed", "tag": "40124c44-6941-426e-92ed-972b6680a618"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:57:47.416843 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-8a9c9804-6dbb-43b1-b88d-b4372f77caf1 req-2be0267b-08f7-4ed4-91c1-f83a261bf39c service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:47.417584 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-8a9c9804-6dbb-43b1-b88d-b4372f77caf1 req-2be0267b-08f7-4ed4-91c1-f83a261bf39c service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:47.418006 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-8a9c9804-6dbb-43b1-b88d-b4372f77caf1 req-2be0267b-08f7-4ed4-91c1-f83a261bf39c service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:47.719027 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:57:47.729056 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-8a9c9804-6dbb-43b1-b88d-b4372f77caf1 req-2be0267b-08f7-4ed4-91c1-f83a261bf39c service nova] Creating event network-vif-unplugged:655956e8-ae26-4dcc-9d3e-b8894103890e for instance 830de6ad-adc6-4d16-ae9d-a29ae85e6cd2 on n-h1-860284-1 Oct 04 21:57:47.729657 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-8a9c9804-6dbb-43b1-b88d-b4372f77caf1 req-2be0267b-08f7-4ed4-91c1-f83a261bf39c service nova] Creating event network-vif-unplugged:480ee163-2b8b-42e9-80e8-28254bda8c68 for instance 830de6ad-adc6-4d16-ae9d-a29ae85e6cd2 on n-h1-860284-1 Oct 04 21:57:47.730181 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-8a9c9804-6dbb-43b1-b88d-b4372f77caf1 req-2be0267b-08f7-4ed4-91c1-f83a261bf39c service nova] Creating event network-vif-unplugged:d7975b45-e2eb-4527-a16c-14ce6defb614 for instance 830de6ad-adc6-4d16-ae9d-a29ae85e6cd2 on n-h1-860284-1 Oct 04 21:57:47.733081 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-8a9c9804-6dbb-43b1-b88d-b4372f77caf1 req-2be0267b-08f7-4ed4-91c1-f83a261bf39c service nova] Creating event network-vif-unplugged:40124c44-6941-426e-92ed-972b6680a618 for instance 830de6ad-adc6-4d16-ae9d-a29ae85e6cd2 on n-h1-860284-1 Oct 04 21:57:47.751652 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-8a9c9804-6dbb-43b1-b88d-b4372f77caf1 req-2be0267b-08f7-4ed4-91c1-f83a261bf39c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 704 microversion: 2.1 time: 0.354799 Oct 04 21:57:47.752454 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1585/3078] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:57:47 2022] POST /compute/v2.1/os-server-external-events => generated 704 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:57:47.765135 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-0dc747e3-f2a7-48e8-8b02-590f4c3c1e81 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:57:47.765866 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-0dc747e3-f2a7-48e8-8b02-590f4c3c1e81 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] [instance: 2764125d-9366-4c77-b1ee-7f188df21205] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:57:47.778215 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0dc747e3-f2a7-48e8-8b02-590f4c3c1e81 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:47.779036 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0dc747e3-f2a7-48e8-8b02-590f4c3c1e81 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:47.779728 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0dc747e3-f2a7-48e8-8b02-590f4c3c1e81 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:47.780644 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0dc747e3-f2a7-48e8-8b02-590f4c3c1e81 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:47.781111 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0dc747e3-f2a7-48e8-8b02-590f4c3c1e81 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:47.781569 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0dc747e3-f2a7-48e8-8b02-590f4c3c1e81 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:48.428818 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-0dc747e3-f2a7-48e8-8b02-590f4c3c1e81 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c386b2ed7064073944085bf2a41f0de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d23c1f5719481483f4a28b76e45514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:57:48.444333 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-0dc747e3-f2a7-48e8-8b02-590f4c3c1e81 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] 10.222.0.43 "GET /compute/v2.1/servers/2764125d-9366-4c77-b1ee-7f188df21205" status: 200 len: 1315 microversion: 2.1 time: 0.689500 Oct 04 21:57:48.446445 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1586/3079] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:57:47 2022] GET /compute/v2.1/servers/2764125d-9366-4c77-b1ee-7f188df21205 => generated 1315 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:57:48.455987 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-ac5f184c-1f39-49c3-9a47-5ae642941f03 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-653582902", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "025eb891-94c1-476d-9ec8-71616b849328"}]}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:57:48.534884 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.network.neutron [None req-ac5f184c-1f39-49c3-9a47-5ae642941f03 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] validate_networks() for [('025eb891-94c1-476d-9ec8-71616b849328', None, None, None, None, None)] {{(pid=134102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:57:48.828167 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-81161883-b7ab-4105-b26e-f321ad1f3814 tempest-SecurityGroupsTestAdminJSON-1137338736 tempest-SecurityGroupsTestAdminJSON-1137338736-project-admin] 10.222.0.43 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 10367 microversion: 2.1 time: 4.300188 Oct 04 21:57:48.828906 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1494/3080] 10.222.0.43 () {58 vars in 1191 bytes} [Tue Oct 4 21:57:44 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 10367 bytes in 4302 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:57:48.835752 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-4c2375ca-3098-4514-8bc7-e62be5fdea84 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:57:48.838358 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-4c2375ca-3098-4514-8bc7-e62be5fdea84 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] [instance: dad442d9-d2e1-49ee-93ea-6e5090634df8] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:57:48.855218 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4c2375ca-3098-4514-8bc7-e62be5fdea84 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:48.856871 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4c2375ca-3098-4514-8bc7-e62be5fdea84 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:48.857557 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4c2375ca-3098-4514-8bc7-e62be5fdea84 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:48.858905 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4c2375ca-3098-4514-8bc7-e62be5fdea84 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:48.859605 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4c2375ca-3098-4514-8bc7-e62be5fdea84 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:48.862150 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4c2375ca-3098-4514-8bc7-e62be5fdea84 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:49.410042 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-4c2375ca-3098-4514-8bc7-e62be5fdea84 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e807c724cc4c3887a2d360f0584ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40071e45805146529fb8abd40629c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:57:49.448122 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-4c2375ca-3098-4514-8bc7-e62be5fdea84 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] 10.222.0.43 "GET /compute/v2.1/servers/dad442d9-d2e1-49ee-93ea-6e5090634df8" status: 200 len: 1497 microversion: 2.1 time: 0.614972 Oct 04 21:57:49.449477 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1495/3081] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:57:48 2022] GET /compute/v2.1/servers/dad442d9-d2e1-49ee-93ea-6e5090634df8 => generated 1497 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:57:49.464154 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e2f38439-a472-4440-b474-a20329da8908 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:57:49.464940 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-e2f38439-a472-4440-b474-a20329da8908 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: dd1b7876-cc6f-4ed3-a0e4-cfe2213b332f] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:57:49.511160 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e2f38439-a472-4440-b474-a20329da8908 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:49.511672 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e2f38439-a472-4440-b474-a20329da8908 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:49.512118 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e2f38439-a472-4440-b474-a20329da8908 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:49.522183 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e2f38439-a472-4440-b474-a20329da8908 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:49.524601 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e2f38439-a472-4440-b474-a20329da8908 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:49.525765 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e2f38439-a472-4440-b474-a20329da8908 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:49.676777 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-ac5f184c-1f39-49c3-9a47-5ae642941f03 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Flavor limits 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:57:49.677210 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-ac5f184c-1f39-49c3-9a47-5ae642941f03 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Image limits 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:57:49.677917 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-ac5f184c-1f39-49c3-9a47-5ae642941f03 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Flavor pref 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:57:49.678604 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-ac5f184c-1f39-49c3-9a47-5ae642941f03 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Image pref 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:57:49.679218 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-ac5f184c-1f39-49c3-9a47-5ae642941f03 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:57:49.690942 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ac5f184c-1f39-49c3-9a47-5ae642941f03 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:49.691674 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ac5f184c-1f39-49c3-9a47-5ae642941f03 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:49.692372 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ac5f184c-1f39-49c3-9a47-5ae642941f03 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:49.693489 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ac5f184c-1f39-49c3-9a47-5ae642941f03 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:49.694186 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ac5f184c-1f39-49c3-9a47-5ae642941f03 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:49.694885 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ac5f184c-1f39-49c3-9a47-5ae642941f03 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:49.721157 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-ac5f184c-1f39-49c3-9a47-5ae642941f03 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Getting quotas for project 857b9057c949472b9a1862182a01356c. Resources: {'instances', 'ram', 'cores'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:57:49.728304 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-ac5f184c-1f39-49c3-9a47-5ae642941f03 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Getting quotas for user 0a94113bec89469a844ede34890d6876 and project 857b9057c949472b9a1862182a01356c. Resources: {'instances', 'ram', 'cores'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:57:49.751153 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-ac5f184c-1f39-49c3-9a47-5ae642941f03 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Going to run 2 instances... {{(pid=134102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:57:49.754555 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-ac5f184c-1f39-49c3-9a47-5ae642941f03 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] [instance: 563105fe-37b7-495e-88bd-d524aa2395db] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='58548514-5dac-426c-81f5-19e3fba33e23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:57:49.832710 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-ac5f184c-1f39-49c3-9a47-5ae642941f03 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] [instance: 7618c19f-d7bb-4f37-8454-76570009eb30] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='58548514-5dac-426c-81f5-19e3fba33e23',instance=,instance_uuid=563105fe-37b7-495e-88bd-d524aa2395db,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:57:50.008380 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-ac5f184c-1f39-49c3-9a47-5ae642941f03 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.560197 Oct 04 21:57:50.028142 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1587/3082] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 21:57:48 2022] POST /compute/v2.1/servers => generated 32 bytes in 1580 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Oct 04 21:57:50.048896 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-3b22a456-79b8-4f40-80ac-2b8649aa0c65 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:57:50.051944 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-3b22a456-79b8-4f40-80ac-2b8649aa0c65 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] [instance: 830de6ad-adc6-4d16-ae9d-a29ae85e6cd2] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:57:50.061615 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=12,nova_api:UPDATE=2 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:57:50.064132 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3b22a456-79b8-4f40-80ac-2b8649aa0c65 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:50.065272 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3b22a456-79b8-4f40-80ac-2b8649aa0c65 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:50.065842 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3b22a456-79b8-4f40-80ac-2b8649aa0c65 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:50.074139 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3b22a456-79b8-4f40-80ac-2b8649aa0c65 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:50.076000 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3b22a456-79b8-4f40-80ac-2b8649aa0c65 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:50.076485 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3b22a456-79b8-4f40-80ac-2b8649aa0c65 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:50.127421 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-e2f38439-a472-4440-b474-a20329da8908 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2facee4c6a40416e908083e126d2cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07a17a482a4e92b6ddbdee463c8029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:57:50.149776 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-e2f38439-a472-4440-b474-a20329da8908 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/dd1b7876-cc6f-4ed3-a0e4-cfe2213b332f" status: 200 len: 1316 microversion: 2.1 time: 0.693671 Oct 04 21:57:50.150402 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1496/3083] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:57:49 2022] GET /compute/v2.1/servers/dd1b7876-cc6f-4ed3-a0e4-cfe2213b332f => generated 1316 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:57:50.169364 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-538ce2fc-a4ce-42b1-a498-786242d33dbf tempest-SecurityGroupsTestAdminJSON-2116946367 tempest-SecurityGroupsTestAdminJSON-2116946367-project] Calling method '.version_select at 0x7fbb2e311a60>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:57:50.523206 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-3b22a456-79b8-4f40-80ac-2b8649aa0c65 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:57:50.547346 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-3b22a456-79b8-4f40-80ac-2b8649aa0c65 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:57:50.556016 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-3b22a456-79b8-4f40-80ac-2b8649aa0c65 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:57:50.565791 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-3b22a456-79b8-4f40-80ac-2b8649aa0c65 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] 10.222.0.43 "GET /compute/v2.1/servers/830de6ad-adc6-4d16-ae9d-a29ae85e6cd2" status: 200 len: 2870 microversion: 2.42 time: 0.535907 Oct 04 21:57:50.583916 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1588/3084] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:57:50 2022] GET /compute/v2.1/servers/830de6ad-adc6-4d16-ae9d-a29ae85e6cd2 => generated 2870 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:57:50.596104 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-3be2a188-b815-4600-bdff-b1bc3c49f04d req-42ef4da2-c16e-4931-a96e-873cd31b5242 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f61f3b8b-9a3c-4d10-9dc4-8397e27f0237", "name": "network-vif-deleted", "tag": "efd3f13d-6466-4c86-aa3f-27dd6cbdcf88"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:57:50.607820 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-3be2a188-b815-4600-bdff-b1bc3c49f04d req-42ef4da2-c16e-4931-a96e-873cd31b5242 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:50.621167 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-3be2a188-b815-4600-bdff-b1bc3c49f04d req-42ef4da2-c16e-4931-a96e-873cd31b5242 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:50.622571 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-3be2a188-b815-4600-bdff-b1bc3c49f04d req-42ef4da2-c16e-4931-a96e-873cd31b5242 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:50.640722 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-3be2a188-b815-4600-bdff-b1bc3c49f04d req-42ef4da2-c16e-4931-a96e-873cd31b5242 service nova] Creating event network-vif-deleted:efd3f13d-6466-4c86-aa3f-27dd6cbdcf88 for instance f61f3b8b-9a3c-4d10-9dc4-8397e27f0237 on n-h2-860284-1 Oct 04 21:57:50.648898 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-3be2a188-b815-4600-bdff-b1bc3c49f04d req-42ef4da2-c16e-4931-a96e-873cd31b5242 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062773 Oct 04 21:57:50.649949 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1589/3085] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:57:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:57:50.662829 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-e564030a-2699-4205-93bc-610738b98dc6 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:57:50.664315 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-e564030a-2699-4205-93bc-610738b98dc6 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] [instance: 2764125d-9366-4c77-b1ee-7f188df21205] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:57:50.674240 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e564030a-2699-4205-93bc-610738b98dc6 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:50.674763 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e564030a-2699-4205-93bc-610738b98dc6 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:50.675495 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e564030a-2699-4205-93bc-610738b98dc6 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:50.676416 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e564030a-2699-4205-93bc-610738b98dc6 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:50.676883 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e564030a-2699-4205-93bc-610738b98dc6 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:50.677538 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e564030a-2699-4205-93bc-610738b98dc6 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:50.706615 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-538ce2fc-a4ce-42b1-a498-786242d33dbf tempest-SecurityGroupsTestAdminJSON-2116946367 tempest-SecurityGroupsTestAdminJSON-2116946367-project] 10.222.0.43 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1110 microversion: 2.1 time: 0.553626 Oct 04 21:57:50.717789 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1497/3086] 10.222.0.43 () {58 vars in 1191 bytes} [Tue Oct 4 21:57:50 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1110 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:57:50.725269 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-88f61249-43ca-4623-a39f-b7249cf5d2df req-b5da91e4-720c-4571-9a68-e20300c90161 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16792146-aedb-4782-ba6f-5cbd7a7d0f62", "name": "network-vif-deleted", "tag": "08edbe4b-d2a0-4913-8c9e-e4477409197e"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:57:50.741434 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-88f61249-43ca-4623-a39f-b7249cf5d2df req-b5da91e4-720c-4571-9a68-e20300c90161 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:50.741924 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-88f61249-43ca-4623-a39f-b7249cf5d2df req-b5da91e4-720c-4571-9a68-e20300c90161 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:50.742391 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-88f61249-43ca-4623-a39f-b7249cf5d2df req-b5da91e4-720c-4571-9a68-e20300c90161 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:50.762492 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-88f61249-43ca-4623-a39f-b7249cf5d2df req-b5da91e4-720c-4571-9a68-e20300c90161 service nova] Creating event network-vif-deleted:08edbe4b-d2a0-4913-8c9e-e4477409197e for instance 16792146-aedb-4782-ba6f-5cbd7a7d0f62 on n-h1-860284-1 Oct 04 21:57:50.784785 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-88f61249-43ca-4623-a39f-b7249cf5d2df req-b5da91e4-720c-4571-9a68-e20300c90161 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065460 Oct 04 21:57:50.787154 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1498/3087] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:57:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:57:50.796488 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e435dff2-e595-43a5-a6a8-0d565dc00b03 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:57:50.811754 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-e435dff2-e595-43a5-a6a8-0d565dc00b03 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0a94113bec89469a844ede34890d6876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857b9057c949472b9a1862182a01356c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:57:50.814254 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-e435dff2-e595-43a5-a6a8-0d565dc00b03 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Searching by: {'deleted': False, 'project_id': '857b9057c949472b9a1862182a01356c'} {{(pid=134101) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 21:57:50.854984 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e435dff2-e595-43a5-a6a8-0d565dc00b03 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:50.855350 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e435dff2-e595-43a5-a6a8-0d565dc00b03 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:50.855791 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e435dff2-e595-43a5-a6a8-0d565dc00b03 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:50.860320 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e435dff2-e595-43a5-a6a8-0d565dc00b03 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:50.862882 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e435dff2-e595-43a5-a6a8-0d565dc00b03 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:50.863365 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e435dff2-e595-43a5-a6a8-0d565dc00b03 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:50.898840 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.multi_cell_list [None req-e435dff2-e595-43a5-a6a8-0d565dc00b03 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Listed batch of 1 results from cell out of 998 limit. Returned 1 total so far. {{(pid=134101) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 21:57:50.936971 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-e435dff2-e595-43a5-a6a8-0d565dc00b03 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] 10.222.0.43 "GET /compute/v2.1/servers" status: 200 len: 1003 microversion: 2.1 time: 0.147168 Oct 04 21:57:50.937766 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1499/3088] 10.222.0.43 () {58 vars in 1125 bytes} [Tue Oct 4 21:57:50 2022] GET /compute/v2.1/servers => generated 1003 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:57:50.940917 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-e564030a-2699-4205-93bc-610738b98dc6 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c386b2ed7064073944085bf2a41f0de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d23c1f5719481483f4a28b76e45514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:57:50.943391 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-de205ce0-905b-4ba6-8bcf-0641911ebabc tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:57:50.944743 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-de205ce0-905b-4ba6-8bcf-0641911ebabc tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] [instance: dad442d9-d2e1-49ee-93ea-6e5090634df8] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:57:50.951551 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-e564030a-2699-4205-93bc-610738b98dc6 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] 10.222.0.43 "GET /compute/v2.1/servers/2764125d-9366-4c77-b1ee-7f188df21205" status: 200 len: 1315 microversion: 2.1 time: 0.299199 Oct 04 21:57:50.953052 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-de205ce0-905b-4ba6-8bcf-0641911ebabc tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:50.954789 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1590/3089] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:57:50 2022] GET /compute/v2.1/servers/2764125d-9366-4c77-b1ee-7f188df21205 => generated 1315 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:57:50.954936 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-de205ce0-905b-4ba6-8bcf-0641911ebabc tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:50.956396 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-de205ce0-905b-4ba6-8bcf-0641911ebabc tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:50.957396 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-de205ce0-905b-4ba6-8bcf-0641911ebabc tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:50.958177 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-de205ce0-905b-4ba6-8bcf-0641911ebabc tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:50.959142 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-de205ce0-905b-4ba6-8bcf-0641911ebabc tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:50.966202 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-71a5a21f-2db1-4bff-b14c-f52e36beb598 tempest-SecurityGroupsTestAdminJSON-1137338736 tempest-SecurityGroupsTestAdminJSON-1137338736-project-admin] Calling method '.version_select at 0x7fbb2e625040>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:57:51.332937 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-de205ce0-905b-4ba6-8bcf-0641911ebabc tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e807c724cc4c3887a2d360f0584ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40071e45805146529fb8abd40629c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:57:51.341686 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-de205ce0-905b-4ba6-8bcf-0641911ebabc tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] 10.222.0.43 "GET /compute/v2.1/servers/dad442d9-d2e1-49ee-93ea-6e5090634df8" status: 200 len: 1497 microversion: 2.1 time: 0.402583 Oct 04 21:57:51.346649 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1500/3090] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:57:50 2022] GET /compute/v2.1/servers/dad442d9-d2e1-49ee-93ea-6e5090634df8 => generated 1497 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:57:51.352267 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-0f96ffeb-3777-4af5-9ee9-618f707fe39c tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:57:51.355781 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-0f96ffeb-3777-4af5-9ee9-618f707fe39c tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] [instance: 7618c19f-d7bb-4f37-8454-76570009eb30] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:57:51.384031 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0f96ffeb-3777-4af5-9ee9-618f707fe39c tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:51.384520 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0f96ffeb-3777-4af5-9ee9-618f707fe39c tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:51.385113 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0f96ffeb-3777-4af5-9ee9-618f707fe39c tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:51.385909 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0f96ffeb-3777-4af5-9ee9-618f707fe39c tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:51.386403 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0f96ffeb-3777-4af5-9ee9-618f707fe39c tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:51.386867 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0f96ffeb-3777-4af5-9ee9-618f707fe39c tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:51.570279 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-71a5a21f-2db1-4bff-b14c-f52e36beb598 tempest-SecurityGroupsTestAdminJSON-1137338736 tempest-SecurityGroupsTestAdminJSON-1137338736-project-admin] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/9e169baa-b219-4a9e-a4ef-999bbcca7872" status: 202 len: 0 microversion: 2.1 time: 0.614330 Oct 04 21:57:51.573865 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1591/3091] 10.222.0.43 () {58 vars in 1272 bytes} [Tue Oct 4 21:57:50 2022] DELETE /compute/v2.1/os-security-groups/9e169baa-b219-4a9e-a4ef-999bbcca7872 => generated 0 bytes in 616 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:57:51.575963 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-08e390cb-880f-4bdc-9f81-b394e3fed149 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:57:51.576589 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-08e390cb-880f-4bdc-9f81-b394e3fed149 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: dd1b7876-cc6f-4ed3-a0e4-cfe2213b332f] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:57:51.590819 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-08e390cb-880f-4bdc-9f81-b394e3fed149 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:51.591325 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-08e390cb-880f-4bdc-9f81-b394e3fed149 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:51.591773 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-08e390cb-880f-4bdc-9f81-b394e3fed149 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:51.592495 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-08e390cb-880f-4bdc-9f81-b394e3fed149 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:51.592958 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-08e390cb-880f-4bdc-9f81-b394e3fed149 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:51.593388 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-08e390cb-880f-4bdc-9f81-b394e3fed149 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:51.633332 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-0f96ffeb-3777-4af5-9ee9-618f707fe39c tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a94113bec89469a844ede34890d6876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857b9057c949472b9a1862182a01356c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:57:51.653356 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-0f96ffeb-3777-4af5-9ee9-618f707fe39c tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] 10.222.0.43 "GET /compute/v2.1/servers/7618c19f-d7bb-4f37-8454-76570009eb30" status: 200 len: 1221 microversion: 2.1 time: 0.305261 Oct 04 21:57:51.658275 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1501/3092] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:57:51 2022] GET /compute/v2.1/servers/7618c19f-d7bb-4f37-8454-76570009eb30 => generated 1221 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:57:51.669944 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-63cce1d7-edfb-4371-ac5a-4bb49bb00b37 tempest-SecurityGroupsTestAdminJSON-1137338736 tempest-SecurityGroupsTestAdminJSON-1137338736-project-admin] Calling method '.version_select at 0x7fbb2e2a2ca0>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:57:52.052329 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-08e390cb-880f-4bdc-9f81-b394e3fed149 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2facee4c6a40416e908083e126d2cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07a17a482a4e92b6ddbdee463c8029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:57:52.061031 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-08e390cb-880f-4bdc-9f81-b394e3fed149 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/dd1b7876-cc6f-4ed3-a0e4-cfe2213b332f" status: 200 len: 1316 microversion: 2.1 time: 0.488757 Oct 04 21:57:52.061886 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1592/3093] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:57:51 2022] GET /compute/v2.1/servers/dd1b7876-cc6f-4ed3-a0e4-cfe2213b332f => generated 1316 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:57:52.068404 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-c4718c50-b7e0-4650-af8a-17adb7e277a8 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:57:52.075718 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-c4718c50-b7e0-4650-af8a-17adb7e277a8 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] [instance: 830de6ad-adc6-4d16-ae9d-a29ae85e6cd2] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:57:52.090951 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c4718c50-b7e0-4650-af8a-17adb7e277a8 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:52.092215 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c4718c50-b7e0-4650-af8a-17adb7e277a8 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:52.093248 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c4718c50-b7e0-4650-af8a-17adb7e277a8 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:52.096052 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c4718c50-b7e0-4650-af8a-17adb7e277a8 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:52.098980 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c4718c50-b7e0-4650-af8a-17adb7e277a8 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:52.101188 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c4718c50-b7e0-4650-af8a-17adb7e277a8 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:52.436490 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-63cce1d7-edfb-4371-ac5a-4bb49bb00b37 tempest-SecurityGroupsTestAdminJSON-1137338736 tempest-SecurityGroupsTestAdminJSON-1137338736-project-admin] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/bfd33727-291f-4b7b-81be-d416910dffe5" status: 202 len: 0 microversion: 2.1 time: 0.770323 Oct 04 21:57:52.438556 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1502/3094] 10.222.0.43 () {58 vars in 1272 bytes} [Tue Oct 4 21:57:51 2022] DELETE /compute/v2.1/os-security-groups/bfd33727-291f-4b7b-81be-d416910dffe5 => generated 0 bytes in 773 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:57:52.445540 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-19d0f3eb-a13d-44c2-a8c8-b77069adbc95 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:57:52.446711 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-19d0f3eb-a13d-44c2-a8c8-b77069adbc95 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] [instance: 2764125d-9366-4c77-b1ee-7f188df21205] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:57:52.457237 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-19d0f3eb-a13d-44c2-a8c8-b77069adbc95 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:52.458228 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-19d0f3eb-a13d-44c2-a8c8-b77069adbc95 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:52.458863 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-19d0f3eb-a13d-44c2-a8c8-b77069adbc95 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:52.459740 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-19d0f3eb-a13d-44c2-a8c8-b77069adbc95 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:52.460353 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-19d0f3eb-a13d-44c2-a8c8-b77069adbc95 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:52.460956 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-19d0f3eb-a13d-44c2-a8c8-b77069adbc95 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:52.532702 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-c4718c50-b7e0-4650-af8a-17adb7e277a8 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:57:52.547159 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-c4718c50-b7e0-4650-af8a-17adb7e277a8 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:57:52.552180 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-c4718c50-b7e0-4650-af8a-17adb7e277a8 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:57:52.555825 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-c4718c50-b7e0-4650-af8a-17adb7e277a8 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] 10.222.0.43 "GET /compute/v2.1/servers/830de6ad-adc6-4d16-ae9d-a29ae85e6cd2" status: 200 len: 2870 microversion: 2.42 time: 0.491291 Oct 04 21:57:52.566455 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1593/3095] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:57:52 2022] GET /compute/v2.1/servers/830de6ad-adc6-4d16-ae9d-a29ae85e6cd2 => generated 2870 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:57:52.588602 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-cfee0d41-7308-4697-9ca7-31379ff2834c tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:57:52.589709 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-cfee0d41-7308-4697-9ca7-31379ff2834c tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] [instance: dad442d9-d2e1-49ee-93ea-6e5090634df8] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:57:52.598177 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cfee0d41-7308-4697-9ca7-31379ff2834c tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:52.599070 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cfee0d41-7308-4697-9ca7-31379ff2834c tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:52.599804 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cfee0d41-7308-4697-9ca7-31379ff2834c tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:52.600784 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cfee0d41-7308-4697-9ca7-31379ff2834c tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:52.601531 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cfee0d41-7308-4697-9ca7-31379ff2834c tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:52.602224 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cfee0d41-7308-4697-9ca7-31379ff2834c tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:52.967798 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-cfee0d41-7308-4697-9ca7-31379ff2834c tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e807c724cc4c3887a2d360f0584ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40071e45805146529fb8abd40629c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:57:52.986415 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-cfee0d41-7308-4697-9ca7-31379ff2834c tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] 10.222.0.43 "GET /compute/v2.1/servers/dad442d9-d2e1-49ee-93ea-6e5090634df8" status: 200 len: 1497 microversion: 2.1 time: 0.412804 Oct 04 21:57:52.986719 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-19d0f3eb-a13d-44c2-a8c8-b77069adbc95 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c386b2ed7064073944085bf2a41f0de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d23c1f5719481483f4a28b76e45514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:57:52.987757 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1594/3096] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:57:52 2022] GET /compute/v2.1/servers/dad442d9-d2e1-49ee-93ea-6e5090634df8 => generated 1497 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:57:53.006670 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-3488d188-1b54-4291-a74b-64cbacf16571 tempest-SecurityGroupsTestAdminJSON-2116946367 tempest-SecurityGroupsTestAdminJSON-2116946367-project] Calling method '.version_select at 0x7fbb2e5c1430>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:57:53.008303 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-19d0f3eb-a13d-44c2-a8c8-b77069adbc95 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] 10.222.0.43 "GET /compute/v2.1/servers/2764125d-9366-4c77-b1ee-7f188df21205" status: 200 len: 1315 microversion: 2.1 time: 0.568375 Oct 04 21:57:53.008893 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1503/3097] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:57:52 2022] GET /compute/v2.1/servers/2764125d-9366-4c77-b1ee-7f188df21205 => generated 1315 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:57:53.017033 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e8a07625-c980-4445-af3b-6b7700d3a025 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:57:53.020806 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-e8a07625-c980-4445-af3b-6b7700d3a025 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] [instance: 7618c19f-d7bb-4f37-8454-76570009eb30] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:57:53.034975 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e8a07625-c980-4445-af3b-6b7700d3a025 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:53.035486 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e8a07625-c980-4445-af3b-6b7700d3a025 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:53.037788 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e8a07625-c980-4445-af3b-6b7700d3a025 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:53.038564 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e8a07625-c980-4445-af3b-6b7700d3a025 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:53.040572 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e8a07625-c980-4445-af3b-6b7700d3a025 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:53.041218 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e8a07625-c980-4445-af3b-6b7700d3a025 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:53.162344 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-e8a07625-c980-4445-af3b-6b7700d3a025 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a94113bec89469a844ede34890d6876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857b9057c949472b9a1862182a01356c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:57:53.175439 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-e8a07625-c980-4445-af3b-6b7700d3a025 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] 10.222.0.43 "GET /compute/v2.1/servers/7618c19f-d7bb-4f37-8454-76570009eb30" status: 200 len: 1269 microversion: 2.1 time: 0.163855 Oct 04 21:57:53.176989 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1504/3098] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:57:53 2022] GET /compute/v2.1/servers/7618c19f-d7bb-4f37-8454-76570009eb30 => generated 1269 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:57:53.182559 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-c27caf9f-7de4-4f4a-a18b-4ac27c187f06 req-187a7c51-9f8f-45f6-aefa-83e392e5d30c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2764125d-9366-4c77-b1ee-7f188df21205", "tag": "56748744-2cbd-4205-8496-e4ad97390937"}, {"name": "network-changed", "server_uuid": "dd1b7876-cc6f-4ed3-a0e4-cfe2213b332f", "tag": "16eb228b-5e10-4075-98df-9813f88f893f"}, {"server_uuid": "830de6ad-adc6-4d16-ae9d-a29ae85e6cd2", "name": "network-vif-deleted", "tag": "d7975b45-e2eb-4527-a16c-14ce6defb614"}, {"server_uuid": "830de6ad-adc6-4d16-ae9d-a29ae85e6cd2", "name": "network-vif-deleted", "tag": "50799c10-da56-4cd6-bf7b-3175d2e729a5"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:57:53.196130 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-c27caf9f-7de4-4f4a-a18b-4ac27c187f06 req-187a7c51-9f8f-45f6-aefa-83e392e5d30c service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:53.196991 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-c27caf9f-7de4-4f4a-a18b-4ac27c187f06 req-187a7c51-9f8f-45f6-aefa-83e392e5d30c service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:53.212498 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-c27caf9f-7de4-4f4a-a18b-4ac27c187f06 req-187a7c51-9f8f-45f6-aefa-83e392e5d30c service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:53.250474 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-c27caf9f-7de4-4f4a-a18b-4ac27c187f06 req-187a7c51-9f8f-45f6-aefa-83e392e5d30c service nova] Creating event network-changed:56748744-2cbd-4205-8496-e4ad97390937 for instance 2764125d-9366-4c77-b1ee-7f188df21205 on n-h2-860284-1 Oct 04 21:57:53.251845 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-c27caf9f-7de4-4f4a-a18b-4ac27c187f06 req-187a7c51-9f8f-45f6-aefa-83e392e5d30c service nova] Creating event network-changed:16eb228b-5e10-4075-98df-9813f88f893f for instance dd1b7876-cc6f-4ed3-a0e4-cfe2213b332f on n-h1-860284-1 Oct 04 21:57:53.252423 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-c27caf9f-7de4-4f4a-a18b-4ac27c187f06 req-187a7c51-9f8f-45f6-aefa-83e392e5d30c service nova] Creating event network-vif-deleted:d7975b45-e2eb-4527-a16c-14ce6defb614 for instance 830de6ad-adc6-4d16-ae9d-a29ae85e6cd2 on n-h1-860284-1 Oct 04 21:57:53.253200 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-c27caf9f-7de4-4f4a-a18b-4ac27c187f06 req-187a7c51-9f8f-45f6-aefa-83e392e5d30c service nova] Creating event network-vif-deleted:50799c10-da56-4cd6-bf7b-3175d2e729a5 for instance 830de6ad-adc6-4d16-ae9d-a29ae85e6cd2 on n-h1-860284-1 Oct 04 21:57:53.269013 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-c27caf9f-7de4-4f4a-a18b-4ac27c187f06 req-187a7c51-9f8f-45f6-aefa-83e392e5d30c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 688 microversion: 2.1 time: 0.090477 Oct 04 21:57:53.270109 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1505/3099] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:57:53 2022] POST /compute/v2.1/os-server-external-events => generated 688 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:57:53.278439 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-00337d7d-8ad6-4107-97ff-2cc4b57801bb tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:57:53.279515 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-00337d7d-8ad6-4107-97ff-2cc4b57801bb tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: dd1b7876-cc6f-4ed3-a0e4-cfe2213b332f] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:57:53.288264 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-00337d7d-8ad6-4107-97ff-2cc4b57801bb tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:53.288946 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-00337d7d-8ad6-4107-97ff-2cc4b57801bb tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:53.289618 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-00337d7d-8ad6-4107-97ff-2cc4b57801bb tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:53.290519 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-00337d7d-8ad6-4107-97ff-2cc4b57801bb tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:53.291417 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-00337d7d-8ad6-4107-97ff-2cc4b57801bb tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:53.292736 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-00337d7d-8ad6-4107-97ff-2cc4b57801bb tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:53.491205 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-3488d188-1b54-4291-a74b-64cbacf16571 tempest-SecurityGroupsTestAdminJSON-2116946367 tempest-SecurityGroupsTestAdminJSON-2116946367-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/dd1a691e-7aa5-4a4d-a015-837c774d9220" status: 202 len: 0 microversion: 2.1 time: 0.500211 Oct 04 21:57:53.493712 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1595/3100] 10.222.0.43 () {58 vars in 1272 bytes} [Tue Oct 4 21:57:52 2022] DELETE /compute/v2.1/os-security-groups/dd1a691e-7aa5-4a4d-a015-837c774d9220 => generated 0 bytes in 505 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:57:53.505481 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-f757ada6-57ea-4dc1-8250-7c6042eb0364 tempest-SecurityGroupsTestAdminJSON-2116946367 tempest-SecurityGroupsTestAdminJSON-2116946367-project] Calling method '.version_select at 0x7fbb2e646f70>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:57:53.547707 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-00337d7d-8ad6-4107-97ff-2cc4b57801bb tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2facee4c6a40416e908083e126d2cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07a17a482a4e92b6ddbdee463c8029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:57:53.571537 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-00337d7d-8ad6-4107-97ff-2cc4b57801bb tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/dd1b7876-cc6f-4ed3-a0e4-cfe2213b332f" status: 200 len: 1316 microversion: 2.1 time: 0.299141 Oct 04 21:57:53.573032 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1506/3101] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:57:53 2022] GET /compute/v2.1/servers/dd1b7876-cc6f-4ed3-a0e4-cfe2213b332f => generated 1316 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:57:53.595492 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-2eb0d7bb-d725-47bb-b0ab-82f146f4185a tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:57:53.596358 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-2eb0d7bb-d725-47bb-b0ab-82f146f4185a tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] [instance: 830de6ad-adc6-4d16-ae9d-a29ae85e6cd2] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:57:53.605437 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2eb0d7bb-d725-47bb-b0ab-82f146f4185a tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:53.606083 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2eb0d7bb-d725-47bb-b0ab-82f146f4185a tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:53.606577 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2eb0d7bb-d725-47bb-b0ab-82f146f4185a tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:53.607293 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2eb0d7bb-d725-47bb-b0ab-82f146f4185a tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:53.607754 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2eb0d7bb-d725-47bb-b0ab-82f146f4185a tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:53.608354 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2eb0d7bb-d725-47bb-b0ab-82f146f4185a tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:53.883517 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-2eb0d7bb-d725-47bb-b0ab-82f146f4185a tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:57:53.903764 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-2eb0d7bb-d725-47bb-b0ab-82f146f4185a tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:57:53.906762 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-2eb0d7bb-d725-47bb-b0ab-82f146f4185a tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:57:53.909157 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-2eb0d7bb-d725-47bb-b0ab-82f146f4185a tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] 10.222.0.43 "GET /compute/v2.1/servers/830de6ad-adc6-4d16-ae9d-a29ae85e6cd2" status: 200 len: 2778 microversion: 2.42 time: 0.317430 Oct 04 21:57:53.910597 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1507/3102] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:57:53 2022] GET /compute/v2.1/servers/830de6ad-adc6-4d16-ae9d-a29ae85e6cd2 => generated 2778 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:57:53.923356 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-f757ada6-57ea-4dc1-8250-7c6042eb0364 tempest-SecurityGroupsTestAdminJSON-2116946367 tempest-SecurityGroupsTestAdminJSON-2116946367-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/5e3977ff-a2c2-4560-ba45-0ec588727e81" status: 202 len: 0 microversion: 2.1 time: 0.424492 Oct 04 21:57:53.928708 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1596/3103] 10.222.0.43 () {58 vars in 1272 bytes} [Tue Oct 4 21:57:53 2022] DELETE /compute/v2.1/os-security-groups/5e3977ff-a2c2-4560-ba45-0ec588727e81 => generated 0 bytes in 431 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:57:54.013973 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-55dba74c-d413-45f5-b3d8-3043841e321d tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:57:54.014766 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-55dba74c-d413-45f5-b3d8-3043841e321d tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] [instance: dad442d9-d2e1-49ee-93ea-6e5090634df8] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:57:54.022825 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-55dba74c-d413-45f5-b3d8-3043841e321d tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:54.025078 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-55dba74c-d413-45f5-b3d8-3043841e321d tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:54.026168 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-55dba74c-d413-45f5-b3d8-3043841e321d tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:54.027157 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-55dba74c-d413-45f5-b3d8-3043841e321d tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:54.028003 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-55dba74c-d413-45f5-b3d8-3043841e321d tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:54.028810 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-55dba74c-d413-45f5-b3d8-3043841e321d tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:54.039395 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-69225eff-afab-4085-8b0c-609995d72f79 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:57:54.040467 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-69225eff-afab-4085-8b0c-609995d72f79 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] [instance: 2764125d-9366-4c77-b1ee-7f188df21205] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:57:54.053745 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-69225eff-afab-4085-8b0c-609995d72f79 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:54.054612 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-69225eff-afab-4085-8b0c-609995d72f79 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:54.055151 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-69225eff-afab-4085-8b0c-609995d72f79 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:54.058437 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-69225eff-afab-4085-8b0c-609995d72f79 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:54.059058 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-69225eff-afab-4085-8b0c-609995d72f79 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:54.059594 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-69225eff-afab-4085-8b0c-609995d72f79 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:54.331779 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-55dba74c-d413-45f5-b3d8-3043841e321d tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e807c724cc4c3887a2d360f0584ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40071e45805146529fb8abd40629c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:57:54.334154 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-69225eff-afab-4085-8b0c-609995d72f79 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c386b2ed7064073944085bf2a41f0de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d23c1f5719481483f4a28b76e45514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:57:54.341778 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-55dba74c-d413-45f5-b3d8-3043841e321d tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] 10.222.0.43 "GET /compute/v2.1/servers/dad442d9-d2e1-49ee-93ea-6e5090634df8" status: 200 len: 1497 microversion: 2.1 time: 0.332543 Oct 04 21:57:54.342295 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-69225eff-afab-4085-8b0c-609995d72f79 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] 10.222.0.43 "GET /compute/v2.1/servers/2764125d-9366-4c77-b1ee-7f188df21205" status: 200 len: 1315 microversion: 2.1 time: 0.306750 Oct 04 21:57:54.343962 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1597/3104] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:57:54 2022] GET /compute/v2.1/servers/2764125d-9366-4c77-b1ee-7f188df21205 => generated 1315 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:57:54.348730 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1508/3105] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:57:54 2022] GET /compute/v2.1/servers/dad442d9-d2e1-49ee-93ea-6e5090634df8 => generated 1497 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:57:54.363810 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-628348c0-0cc4-47b5-b1d5-41d0213fb487 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:57:54.364865 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-628348c0-0cc4-47b5-b1d5-41d0213fb487 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] [instance: 7618c19f-d7bb-4f37-8454-76570009eb30] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:57:54.376545 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-628348c0-0cc4-47b5-b1d5-41d0213fb487 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:54.377297 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-628348c0-0cc4-47b5-b1d5-41d0213fb487 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:54.377814 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-628348c0-0cc4-47b5-b1d5-41d0213fb487 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:54.378584 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-628348c0-0cc4-47b5-b1d5-41d0213fb487 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:54.379193 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-628348c0-0cc4-47b5-b1d5-41d0213fb487 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:54.379629 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-628348c0-0cc4-47b5-b1d5-41d0213fb487 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:54.456787 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-628348c0-0cc4-47b5-b1d5-41d0213fb487 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a94113bec89469a844ede34890d6876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857b9057c949472b9a1862182a01356c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:57:54.466680 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-628348c0-0cc4-47b5-b1d5-41d0213fb487 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] 10.222.0.43 "GET /compute/v2.1/servers/7618c19f-d7bb-4f37-8454-76570009eb30" status: 200 len: 1269 microversion: 2.1 time: 0.121338 Oct 04 21:57:54.468053 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1598/3106] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:57:54 2022] GET /compute/v2.1/servers/7618c19f-d7bb-4f37-8454-76570009eb30 => generated 1269 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:57:54.599300 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-4d3bf7e6-6aca-43fb-88f6-6d783692e0fe tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:57:54.600454 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-4d3bf7e6-6aca-43fb-88f6-6d783692e0fe tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: dd1b7876-cc6f-4ed3-a0e4-cfe2213b332f] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:57:54.607693 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4d3bf7e6-6aca-43fb-88f6-6d783692e0fe tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:54.608166 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4d3bf7e6-6aca-43fb-88f6-6d783692e0fe tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:54.608606 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4d3bf7e6-6aca-43fb-88f6-6d783692e0fe tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:54.609311 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4d3bf7e6-6aca-43fb-88f6-6d783692e0fe tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:54.609764 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4d3bf7e6-6aca-43fb-88f6-6d783692e0fe tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:54.610548 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4d3bf7e6-6aca-43fb-88f6-6d783692e0fe tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:54.901840 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-4d3bf7e6-6aca-43fb-88f6-6d783692e0fe tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2facee4c6a40416e908083e126d2cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07a17a482a4e92b6ddbdee463c8029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:57:54.922343 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-4d3bf7e6-6aca-43fb-88f6-6d783692e0fe tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/dd1b7876-cc6f-4ed3-a0e4-cfe2213b332f" status: 200 len: 1316 microversion: 2.1 time: 0.327343 Oct 04 21:57:54.923985 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1509/3107] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:57:54 2022] GET /compute/v2.1/servers/dd1b7876-cc6f-4ed3-a0e4-cfe2213b332f => generated 1316 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:57:54.946687 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-93a24ad8-a39b-48fb-ae4e-e52027f24e87 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:57:54.947950 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-93a24ad8-a39b-48fb-ae4e-e52027f24e87 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] [instance: 830de6ad-adc6-4d16-ae9d-a29ae85e6cd2] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:57:54.954955 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-93a24ad8-a39b-48fb-ae4e-e52027f24e87 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:54.955721 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-93a24ad8-a39b-48fb-ae4e-e52027f24e87 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:54.956323 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-93a24ad8-a39b-48fb-ae4e-e52027f24e87 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:54.957192 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-93a24ad8-a39b-48fb-ae4e-e52027f24e87 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:54.957807 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-93a24ad8-a39b-48fb-ae4e-e52027f24e87 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:54.958432 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-93a24ad8-a39b-48fb-ae4e-e52027f24e87 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:55.311175 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-9f77999c-cccc-44f8-9dd9-ba7642604767 req-05970036-0bc4-451e-9bd1-a67085899530 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "830de6ad-adc6-4d16-ae9d-a29ae85e6cd2", "name": "network-vif-deleted", "tag": "e9d774f8-8705-408f-87ab-9a4e3cdf9653"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:57:55.322292 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-9f77999c-cccc-44f8-9dd9-ba7642604767 req-05970036-0bc4-451e-9bd1-a67085899530 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:55.323095 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-9f77999c-cccc-44f8-9dd9-ba7642604767 req-05970036-0bc4-451e-9bd1-a67085899530 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:55.323703 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-9f77999c-cccc-44f8-9dd9-ba7642604767 req-05970036-0bc4-451e-9bd1-a67085899530 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:55.337086 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-9f77999c-cccc-44f8-9dd9-ba7642604767 req-05970036-0bc4-451e-9bd1-a67085899530 service nova] Creating event network-vif-deleted:e9d774f8-8705-408f-87ab-9a4e3cdf9653 for instance 830de6ad-adc6-4d16-ae9d-a29ae85e6cd2 on n-h1-860284-1 Oct 04 21:57:55.343000 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-9f77999c-cccc-44f8-9dd9-ba7642604767 req-05970036-0bc4-451e-9bd1-a67085899530 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035559 Oct 04 21:57:55.343999 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1510/3108] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:57:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:57:55.371915 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-93a24ad8-a39b-48fb-ae4e-e52027f24e87 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:57:55.382650 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-a5f5040c-55a6-4000-811b-32952e9f12c9 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:57:55.385209 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-a5f5040c-55a6-4000-811b-32952e9f12c9 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] [instance: dad442d9-d2e1-49ee-93ea-6e5090634df8] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:57:55.391301 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-93a24ad8-a39b-48fb-ae4e-e52027f24e87 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:57:55.393899 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-93a24ad8-a39b-48fb-ae4e-e52027f24e87 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:57:55.396164 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-93a24ad8-a39b-48fb-ae4e-e52027f24e87 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] 10.222.0.43 "GET /compute/v2.1/servers/830de6ad-adc6-4d16-ae9d-a29ae85e6cd2" status: 200 len: 2778 microversion: 2.42 time: 0.457717 Oct 04 21:57:55.397570 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1599/3109] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:57:54 2022] GET /compute/v2.1/servers/830de6ad-adc6-4d16-ae9d-a29ae85e6cd2 => generated 2778 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:57:55.402914 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a5f5040c-55a6-4000-811b-32952e9f12c9 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:55.403424 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a5f5040c-55a6-4000-811b-32952e9f12c9 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:55.405164 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a5f5040c-55a6-4000-811b-32952e9f12c9 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:55.406253 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a5f5040c-55a6-4000-811b-32952e9f12c9 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:55.407655 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a5f5040c-55a6-4000-811b-32952e9f12c9 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:55.408600 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-89238e75-c22b-49f8-8aad-b2b7679958c3 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:57:55.408803 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a5f5040c-55a6-4000-811b-32952e9f12c9 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:55.410823 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-89238e75-c22b-49f8-8aad-b2b7679958c3 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] [instance: 2764125d-9366-4c77-b1ee-7f188df21205] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:57:55.423104 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-89238e75-c22b-49f8-8aad-b2b7679958c3 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:55.424040 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-89238e75-c22b-49f8-8aad-b2b7679958c3 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:55.424698 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-89238e75-c22b-49f8-8aad-b2b7679958c3 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:55.426354 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-89238e75-c22b-49f8-8aad-b2b7679958c3 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:55.427083 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-89238e75-c22b-49f8-8aad-b2b7679958c3 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:55.428762 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-89238e75-c22b-49f8-8aad-b2b7679958c3 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:56.299452 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-a5f5040c-55a6-4000-811b-32952e9f12c9 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e807c724cc4c3887a2d360f0584ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40071e45805146529fb8abd40629c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:57:56.302491 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=100 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:57:56.334589 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-a5f5040c-55a6-4000-811b-32952e9f12c9 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] 10.222.0.43 "GET /compute/v2.1/servers/dad442d9-d2e1-49ee-93ea-6e5090634df8" status: 200 len: 1497 microversion: 2.1 time: 0.948515 Oct 04 21:57:56.336502 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1511/3110] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:57:55 2022] GET /compute/v2.1/servers/dad442d9-d2e1-49ee-93ea-6e5090634df8 => generated 1497 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:57:56.338801 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-89238e75-c22b-49f8-8aad-b2b7679958c3 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c386b2ed7064073944085bf2a41f0de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d23c1f5719481483f4a28b76e45514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:57:56.351140 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-a1b23767-4723-4204-b099-3ab5cf70e3e0 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:57:56.352201 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-a1b23767-4723-4204-b099-3ab5cf70e3e0 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] [instance: 7618c19f-d7bb-4f37-8454-76570009eb30] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:57:56.353955 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-89238e75-c22b-49f8-8aad-b2b7679958c3 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] 10.222.0.43 "GET /compute/v2.1/servers/2764125d-9366-4c77-b1ee-7f188df21205" status: 200 len: 1315 microversion: 2.1 time: 0.954855 Oct 04 21:57:56.354664 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1600/3111] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:57:55 2022] GET /compute/v2.1/servers/2764125d-9366-4c77-b1ee-7f188df21205 => generated 1315 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:57:56.364257 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a1b23767-4723-4204-b099-3ab5cf70e3e0 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:56.364916 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-aa4d6b32-cb31-43ed-8062-15ddd8149a47 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:57:56.365253 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a1b23767-4723-4204-b099-3ab5cf70e3e0 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:56.365557 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-aa4d6b32-cb31-43ed-8062-15ddd8149a47 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: dd1b7876-cc6f-4ed3-a0e4-cfe2213b332f] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:57:56.366944 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a1b23767-4723-4204-b099-3ab5cf70e3e0 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:56.369843 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a1b23767-4723-4204-b099-3ab5cf70e3e0 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:56.371320 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a1b23767-4723-4204-b099-3ab5cf70e3e0 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:56.372711 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a1b23767-4723-4204-b099-3ab5cf70e3e0 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:56.381574 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-aa4d6b32-cb31-43ed-8062-15ddd8149a47 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:56.382386 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-aa4d6b32-cb31-43ed-8062-15ddd8149a47 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:56.383129 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-aa4d6b32-cb31-43ed-8062-15ddd8149a47 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:56.384811 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-aa4d6b32-cb31-43ed-8062-15ddd8149a47 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:56.386452 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-aa4d6b32-cb31-43ed-8062-15ddd8149a47 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:56.388276 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-aa4d6b32-cb31-43ed-8062-15ddd8149a47 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:56.656042 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-a1b23767-4723-4204-b099-3ab5cf70e3e0 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a94113bec89469a844ede34890d6876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857b9057c949472b9a1862182a01356c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:57:56.669891 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-a1b23767-4723-4204-b099-3ab5cf70e3e0 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] 10.222.0.43 "GET /compute/v2.1/servers/7618c19f-d7bb-4f37-8454-76570009eb30" status: 200 len: 1275 microversion: 2.1 time: 0.331942 Oct 04 21:57:56.701148 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1512/3112] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:57:56 2022] GET /compute/v2.1/servers/7618c19f-d7bb-4f37-8454-76570009eb30 => generated 1275 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:57:56.710168 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-d025201f-5b9b-4283-ad0e-390a9490080b tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:57:56.710839 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-d025201f-5b9b-4283-ad0e-390a9490080b tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] [instance: 830de6ad-adc6-4d16-ae9d-a29ae85e6cd2] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:57:56.718227 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d025201f-5b9b-4283-ad0e-390a9490080b tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:56.718782 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d025201f-5b9b-4283-ad0e-390a9490080b tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:56.719693 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d025201f-5b9b-4283-ad0e-390a9490080b tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:56.720698 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d025201f-5b9b-4283-ad0e-390a9490080b tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:56.721170 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d025201f-5b9b-4283-ad0e-390a9490080b tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:56.721608 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d025201f-5b9b-4283-ad0e-390a9490080b tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:57.007080 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-aa4d6b32-cb31-43ed-8062-15ddd8149a47 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2facee4c6a40416e908083e126d2cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07a17a482a4e92b6ddbdee463c8029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:57:57.017508 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-aa4d6b32-cb31-43ed-8062-15ddd8149a47 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/dd1b7876-cc6f-4ed3-a0e4-cfe2213b332f" status: 200 len: 1316 microversion: 2.1 time: 0.661141 Oct 04 21:57:57.019714 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1601/3113] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:57:56 2022] GET /compute/v2.1/servers/dd1b7876-cc6f-4ed3-a0e4-cfe2213b332f => generated 1316 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:57:57.191581 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-d025201f-5b9b-4283-ad0e-390a9490080b tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:57:57.225496 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-d025201f-5b9b-4283-ad0e-390a9490080b tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:57:57.228101 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-d025201f-5b9b-4283-ad0e-390a9490080b tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:57:57.235669 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-d025201f-5b9b-4283-ad0e-390a9490080b tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] 10.222.0.43 "GET /compute/v2.1/servers/830de6ad-adc6-4d16-ae9d-a29ae85e6cd2" status: 200 len: 2664 microversion: 2.42 time: 0.529306 Oct 04 21:57:57.241021 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1513/3114] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:57:56 2022] GET /compute/v2.1/servers/830de6ad-adc6-4d16-ae9d-a29ae85e6cd2 => generated 2664 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:57:57.389088 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-b0406604-1a9e-4f1d-8e22-b45083e14178 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:57:57.389799 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-b0406604-1a9e-4f1d-8e22-b45083e14178 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] [instance: 2764125d-9366-4c77-b1ee-7f188df21205] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:57:57.392685 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-90758ba4-fc71-4644-abe3-4b93e2708b04 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:57:57.393314 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-90758ba4-fc71-4644-abe3-4b93e2708b04 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] [instance: dad442d9-d2e1-49ee-93ea-6e5090634df8] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:57:57.411053 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b0406604-1a9e-4f1d-8e22-b45083e14178 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:57.411570 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b0406604-1a9e-4f1d-8e22-b45083e14178 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:57.412020 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b0406604-1a9e-4f1d-8e22-b45083e14178 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:57.412764 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b0406604-1a9e-4f1d-8e22-b45083e14178 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:57.413275 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b0406604-1a9e-4f1d-8e22-b45083e14178 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:57.417407 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-90758ba4-fc71-4644-abe3-4b93e2708b04 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:57.417904 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-90758ba4-fc71-4644-abe3-4b93e2708b04 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:57.418347 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-90758ba4-fc71-4644-abe3-4b93e2708b04 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:57.419102 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-90758ba4-fc71-4644-abe3-4b93e2708b04 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:57.419557 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-90758ba4-fc71-4644-abe3-4b93e2708b04 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:57.420174 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-90758ba4-fc71-4644-abe3-4b93e2708b04 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:57.423791 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b0406604-1a9e-4f1d-8e22-b45083e14178 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:58.136376 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-90758ba4-fc71-4644-abe3-4b93e2708b04 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e807c724cc4c3887a2d360f0584ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40071e45805146529fb8abd40629c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:57:58.148990 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-90758ba4-fc71-4644-abe3-4b93e2708b04 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] 10.222.0.43 "GET /compute/v2.1/servers/dad442d9-d2e1-49ee-93ea-6e5090634df8" status: 200 len: 1497 microversion: 2.1 time: 0.767411 Oct 04 21:57:58.150196 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1602/3115] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:57:57 2022] GET /compute/v2.1/servers/dad442d9-d2e1-49ee-93ea-6e5090634df8 => generated 1497 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:57:58.155197 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-9ebef0fb-dfc6-4e50-b2bc-028bc55b9bec tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:57:58.156119 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-9ebef0fb-dfc6-4e50-b2bc-028bc55b9bec tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] [instance: 7618c19f-d7bb-4f37-8454-76570009eb30] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:57:58.169703 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9ebef0fb-dfc6-4e50-b2bc-028bc55b9bec tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:58.172139 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9ebef0fb-dfc6-4e50-b2bc-028bc55b9bec tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:58.173476 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9ebef0fb-dfc6-4e50-b2bc-028bc55b9bec tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:58.182912 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-b0406604-1a9e-4f1d-8e22-b45083e14178 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c386b2ed7064073944085bf2a41f0de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d23c1f5719481483f4a28b76e45514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:57:58.187560 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9ebef0fb-dfc6-4e50-b2bc-028bc55b9bec tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:58.193302 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-b0406604-1a9e-4f1d-8e22-b45083e14178 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] 10.222.0.43 "GET /compute/v2.1/servers/2764125d-9366-4c77-b1ee-7f188df21205" status: 200 len: 1315 microversion: 2.1 time: 0.808025 Oct 04 21:57:58.194312 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9ebef0fb-dfc6-4e50-b2bc-028bc55b9bec tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:58.195025 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9ebef0fb-dfc6-4e50-b2bc-028bc55b9bec tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:58.199069 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1514/3116] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:57:57 2022] GET /compute/v2.1/servers/2764125d-9366-4c77-b1ee-7f188df21205 => generated 1315 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:57:58.214569 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-7418a528-a567-4377-8474-70bb4662ad06 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:57:58.217315 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-7418a528-a567-4377-8474-70bb4662ad06 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: dd1b7876-cc6f-4ed3-a0e4-cfe2213b332f] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:57:58.228724 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:57:58.238309 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7418a528-a567-4377-8474-70bb4662ad06 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:58.246651 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7418a528-a567-4377-8474-70bb4662ad06 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:58.249056 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7418a528-a567-4377-8474-70bb4662ad06 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:58.252488 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7418a528-a567-4377-8474-70bb4662ad06 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:58.254677 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7418a528-a567-4377-8474-70bb4662ad06 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:58.255414 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7418a528-a567-4377-8474-70bb4662ad06 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:58.597195 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-7418a528-a567-4377-8474-70bb4662ad06 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2facee4c6a40416e908083e126d2cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07a17a482a4e92b6ddbdee463c8029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:57:58.611948 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-7418a528-a567-4377-8474-70bb4662ad06 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/dd1b7876-cc6f-4ed3-a0e4-cfe2213b332f" status: 200 len: 1316 microversion: 2.1 time: 0.411023 Oct 04 21:57:58.613609 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1515/3117] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:57:58 2022] GET /compute/v2.1/servers/dd1b7876-cc6f-4ed3-a0e4-cfe2213b332f => generated 1316 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:57:58.625743 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-9ebef0fb-dfc6-4e50-b2bc-028bc55b9bec tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a94113bec89469a844ede34890d6876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857b9057c949472b9a1862182a01356c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:57:58.642717 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-6b028231-83e3-4f2c-9ddc-81ec85355b1e tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:57:58.645333 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-9ebef0fb-dfc6-4e50-b2bc-028bc55b9bec tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] 10.222.0.43 "GET /compute/v2.1/servers/7618c19f-d7bb-4f37-8454-76570009eb30" status: 200 len: 1317 microversion: 2.1 time: 0.493695 Oct 04 21:57:58.649051 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-6b028231-83e3-4f2c-9ddc-81ec85355b1e tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] [instance: 830de6ad-adc6-4d16-ae9d-a29ae85e6cd2] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:57:58.650244 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1603/3118] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:57:58 2022] GET /compute/v2.1/servers/7618c19f-d7bb-4f37-8454-76570009eb30 => generated 1317 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:57:58.674155 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6b028231-83e3-4f2c-9ddc-81ec85355b1e tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:58.676544 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6b028231-83e3-4f2c-9ddc-81ec85355b1e tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:58.677709 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6b028231-83e3-4f2c-9ddc-81ec85355b1e tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:58.680384 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6b028231-83e3-4f2c-9ddc-81ec85355b1e tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:58.681229 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6b028231-83e3-4f2c-9ddc-81ec85355b1e tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:58.681972 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6b028231-83e3-4f2c-9ddc-81ec85355b1e tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:59.016084 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-6b028231-83e3-4f2c-9ddc-81ec85355b1e tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:57:59.044048 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-6b028231-83e3-4f2c-9ddc-81ec85355b1e tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:57:59.060300 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-6b028231-83e3-4f2c-9ddc-81ec85355b1e tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:57:59.067570 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-6b028231-83e3-4f2c-9ddc-81ec85355b1e tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] 10.222.0.43 "GET /compute/v2.1/servers/830de6ad-adc6-4d16-ae9d-a29ae85e6cd2" status: 200 len: 2504 microversion: 2.42 time: 0.449452 Oct 04 21:57:59.069806 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1516/3119] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:57:58 2022] GET /compute/v2.1/servers/830de6ad-adc6-4d16-ae9d-a29ae85e6cd2 => generated 2504 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:57:59.159044 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-067410ac-501d-4a41-86df-0d8200ca2c39 req-c4458082-a3bd-4ae1-8d83-9e9d43db3e47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd1b7876-cc6f-4ed3-a0e4-cfe2213b332f", "name": "network-vif-plugged", "status": "completed", "tag": "16eb228b-5e10-4075-98df-9813f88f893f"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:57:59.177912 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-95d9acef-a14b-4d85-9b70-dc07a7cbe343 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:57:59.178667 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-95d9acef-a14b-4d85-9b70-dc07a7cbe343 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] [instance: dad442d9-d2e1-49ee-93ea-6e5090634df8] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:57:59.194036 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-95d9acef-a14b-4d85-9b70-dc07a7cbe343 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:59.202101 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-95d9acef-a14b-4d85-9b70-dc07a7cbe343 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:59.202765 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-95d9acef-a14b-4d85-9b70-dc07a7cbe343 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:59.208419 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-95d9acef-a14b-4d85-9b70-dc07a7cbe343 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:59.209013 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-95d9acef-a14b-4d85-9b70-dc07a7cbe343 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:59.210795 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-95d9acef-a14b-4d85-9b70-dc07a7cbe343 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:59.217623 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-067410ac-501d-4a41-86df-0d8200ca2c39 req-c4458082-a3bd-4ae1-8d83-9e9d43db3e47 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:59.218478 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-067410ac-501d-4a41-86df-0d8200ca2c39 req-c4458082-a3bd-4ae1-8d83-9e9d43db3e47 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:59.223876 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-067410ac-501d-4a41-86df-0d8200ca2c39 req-c4458082-a3bd-4ae1-8d83-9e9d43db3e47 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:59.246159 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-067410ac-501d-4a41-86df-0d8200ca2c39 req-c4458082-a3bd-4ae1-8d83-9e9d43db3e47 service nova] Creating event network-vif-plugged:16eb228b-5e10-4075-98df-9813f88f893f for instance dd1b7876-cc6f-4ed3-a0e4-cfe2213b332f on n-h1-860284-1 Oct 04 21:57:59.258230 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-067410ac-501d-4a41-86df-0d8200ca2c39 req-c4458082-a3bd-4ae1-8d83-9e9d43db3e47 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106044 Oct 04 21:57:59.259620 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1604/3120] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:57:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:57:59.275459 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-0354118a-570f-43f1-a0da-ea17162774bb tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:57:59.276481 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-0354118a-570f-43f1-a0da-ea17162774bb tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] [instance: 2764125d-9366-4c77-b1ee-7f188df21205] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:57:59.287682 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0354118a-570f-43f1-a0da-ea17162774bb tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:59.288385 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0354118a-570f-43f1-a0da-ea17162774bb tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:59.288993 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0354118a-570f-43f1-a0da-ea17162774bb tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:59.289960 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0354118a-570f-43f1-a0da-ea17162774bb tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:59.290608 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0354118a-570f-43f1-a0da-ea17162774bb tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:59.291195 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0354118a-570f-43f1-a0da-ea17162774bb tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:59.706978 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell0:SELECT=18 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:57:59.738826 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell0:SELECT=17 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:58:00.037174 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-95d9acef-a14b-4d85-9b70-dc07a7cbe343 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e807c724cc4c3887a2d360f0584ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40071e45805146529fb8abd40629c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:00.055468 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-95d9acef-a14b-4d85-9b70-dc07a7cbe343 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] 10.222.0.43 "GET /compute/v2.1/servers/dad442d9-d2e1-49ee-93ea-6e5090634df8" status: 200 len: 1497 microversion: 2.1 time: 0.882788 Oct 04 21:58:00.056353 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1517/3121] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:57:59 2022] GET /compute/v2.1/servers/dad442d9-d2e1-49ee-93ea-6e5090634df8 => generated 1497 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:58:00.061312 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-93a58214-3741-47ff-8d1d-8d914ca9d99e tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:00.062140 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-93a58214-3741-47ff-8d1d-8d914ca9d99e tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: dd1b7876-cc6f-4ed3-a0e4-cfe2213b332f] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:00.082176 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-93a58214-3741-47ff-8d1d-8d914ca9d99e tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:00.082988 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-93a58214-3741-47ff-8d1d-8d914ca9d99e tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:00.083633 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-93a58214-3741-47ff-8d1d-8d914ca9d99e tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:00.084568 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-93a58214-3741-47ff-8d1d-8d914ca9d99e tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:00.086862 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-93a58214-3741-47ff-8d1d-8d914ca9d99e tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:00.087522 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-93a58214-3741-47ff-8d1d-8d914ca9d99e tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:00.212504 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-0354118a-570f-43f1-a0da-ea17162774bb tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c386b2ed7064073944085bf2a41f0de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d23c1f5719481483f4a28b76e45514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:00.221041 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-0354118a-570f-43f1-a0da-ea17162774bb tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] 10.222.0.43 "GET /compute/v2.1/servers/2764125d-9366-4c77-b1ee-7f188df21205" status: 200 len: 1315 microversion: 2.1 time: 0.960001 Oct 04 21:58:00.226671 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1605/3122] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:57:59 2022] GET /compute/v2.1/servers/2764125d-9366-4c77-b1ee-7f188df21205 => generated 1315 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:58:00.238519 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-858a95d1-d8ac-4a03-bcd8-d32a0458f36e tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:00.239747 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-858a95d1-d8ac-4a03-bcd8-d32a0458f36e tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] [instance: 7618c19f-d7bb-4f37-8454-76570009eb30] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:00.252758 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-858a95d1-d8ac-4a03-bcd8-d32a0458f36e tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:00.258308 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-858a95d1-d8ac-4a03-bcd8-d32a0458f36e tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:00.259690 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-858a95d1-d8ac-4a03-bcd8-d32a0458f36e tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:00.262652 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-858a95d1-d8ac-4a03-bcd8-d32a0458f36e tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:00.263369 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-858a95d1-d8ac-4a03-bcd8-d32a0458f36e tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:00.267184 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-858a95d1-d8ac-4a03-bcd8-d32a0458f36e tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:00.534931 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-93a58214-3741-47ff-8d1d-8d914ca9d99e tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2facee4c6a40416e908083e126d2cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07a17a482a4e92b6ddbdee463c8029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:00.550613 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-93a58214-3741-47ff-8d1d-8d914ca9d99e tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/dd1b7876-cc6f-4ed3-a0e4-cfe2213b332f" status: 200 len: 1316 microversion: 2.1 time: 0.486353 Oct 04 21:58:00.551529 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1518/3123] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:58:00 2022] GET /compute/v2.1/servers/dd1b7876-cc6f-4ed3-a0e4-cfe2213b332f => generated 1316 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:58:00.628792 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-858a95d1-d8ac-4a03-bcd8-d32a0458f36e tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a94113bec89469a844ede34890d6876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857b9057c949472b9a1862182a01356c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:00.638392 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-858a95d1-d8ac-4a03-bcd8-d32a0458f36e tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] 10.222.0.43 "GET /compute/v2.1/servers/7618c19f-d7bb-4f37-8454-76570009eb30" status: 200 len: 1317 microversion: 2.1 time: 0.410269 Oct 04 21:58:00.638985 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1606/3124] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:58:00 2022] GET /compute/v2.1/servers/7618c19f-d7bb-4f37-8454-76570009eb30 => generated 1317 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:58:00.659351 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-79e9b6f9-21b8-4b30-8be0-79abcddd00d5 req-9460525c-840b-492f-852e-39a6df4ba43c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "830de6ad-adc6-4d16-ae9d-a29ae85e6cd2", "name": "network-vif-deleted", "tag": "480ee163-2b8b-42e9-80e8-28254bda8c68"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:58:00.674279 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-79e9b6f9-21b8-4b30-8be0-79abcddd00d5 req-9460525c-840b-492f-852e-39a6df4ba43c service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:00.675051 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-79e9b6f9-21b8-4b30-8be0-79abcddd00d5 req-9460525c-840b-492f-852e-39a6df4ba43c service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:00.675745 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-79e9b6f9-21b8-4b30-8be0-79abcddd00d5 req-9460525c-840b-492f-852e-39a6df4ba43c service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:00.708552 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-79e9b6f9-21b8-4b30-8be0-79abcddd00d5 req-9460525c-840b-492f-852e-39a6df4ba43c service nova] Creating event network-vif-deleted:480ee163-2b8b-42e9-80e8-28254bda8c68 for instance 830de6ad-adc6-4d16-ae9d-a29ae85e6cd2 on n-h1-860284-1 Oct 04 21:58:00.714381 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-79e9b6f9-21b8-4b30-8be0-79abcddd00d5 req-9460525c-840b-492f-852e-39a6df4ba43c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063391 Oct 04 21:58:00.715344 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1607/3125] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:58:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:58:00.727367 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-bd8e5978-491b-4118-b487-d78195594ff1 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:00.728213 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-bd8e5978-491b-4118-b487-d78195594ff1 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] [instance: 830de6ad-adc6-4d16-ae9d-a29ae85e6cd2] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:00.743658 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bd8e5978-491b-4118-b487-d78195594ff1 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:00.744274 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bd8e5978-491b-4118-b487-d78195594ff1 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:00.746497 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bd8e5978-491b-4118-b487-d78195594ff1 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:00.747464 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bd8e5978-491b-4118-b487-d78195594ff1 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:00.748130 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bd8e5978-491b-4118-b487-d78195594ff1 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:00.752443 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bd8e5978-491b-4118-b487-d78195594ff1 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:00.757415 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=100 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:58:00.871647 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-5357b5bc-2c78-4d77-86ab-13154c4554ec tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-UnshelveToHostMultiNodesTest-server-866543682", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452", "networks": "none"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:58:00.889285 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=2 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:58:01.089823 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-5357b5bc-2c78-4d77-86ab-13154c4554ec tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Flavor limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:58:01.090499 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-5357b5bc-2c78-4d77-86ab-13154c4554ec tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Image limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:58:01.090724 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-5357b5bc-2c78-4d77-86ab-13154c4554ec tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Flavor pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:58:01.091182 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-5357b5bc-2c78-4d77-86ab-13154c4554ec tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Image pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:58:01.092159 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-5357b5bc-2c78-4d77-86ab-13154c4554ec tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:58:01.112964 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5357b5bc-2c78-4d77-86ab-13154c4554ec tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:01.117750 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5357b5bc-2c78-4d77-86ab-13154c4554ec tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:01.118575 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5357b5bc-2c78-4d77-86ab-13154c4554ec tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:01.119595 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5357b5bc-2c78-4d77-86ab-13154c4554ec tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:01.120334 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5357b5bc-2c78-4d77-86ab-13154c4554ec tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:01.120945 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5357b5bc-2c78-4d77-86ab-13154c4554ec tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:01.179804 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-5357b5bc-2c78-4d77-86ab-13154c4554ec tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Getting quotas for project f2d4f33667e74aa49c99d4741c179240. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:58:01.197096 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-5357b5bc-2c78-4d77-86ab-13154c4554ec tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Getting quotas for user 4290d9955ab347e0b690dc553ffb2058 and project f2d4f33667e74aa49c99d4741c179240. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:58:01.218796 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-5357b5bc-2c78-4d77-86ab-13154c4554ec tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Going to run 1 instances... {{(pid=134101) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:58:01.221988 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-5357b5bc-2c78-4d77-86ab-13154c4554ec tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] [instance: d0b1b757-4a4d-4a7a-9a06-08f178a02984] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='58548514-5dac-426c-81f5-19e3fba33e23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134101) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:58:01.307407 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-5357b5bc-2c78-4d77-86ab-13154c4554ec tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.91 time: 0.749079 Oct 04 21:58:01.311088 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1519/3126] 10.222.0.43 () {62 vars in 1188 bytes} [Tue Oct 4 21:58:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 753 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 04 21:58:01.332561 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-78ba9f5e-2a17-445a-86fb-56a5f55b5f09 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:01.333198 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-78ba9f5e-2a17-445a-86fb-56a5f55b5f09 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] [instance: dad442d9-d2e1-49ee-93ea-6e5090634df8] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:01.367489 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-78ba9f5e-2a17-445a-86fb-56a5f55b5f09 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:01.367955 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-78ba9f5e-2a17-445a-86fb-56a5f55b5f09 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:01.368452 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-78ba9f5e-2a17-445a-86fb-56a5f55b5f09 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:01.369368 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-78ba9f5e-2a17-445a-86fb-56a5f55b5f09 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:01.369839 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-78ba9f5e-2a17-445a-86fb-56a5f55b5f09 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:01.370272 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-78ba9f5e-2a17-445a-86fb-56a5f55b5f09 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:01.386276 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-bd8e5978-491b-4118-b487-d78195594ff1 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:01.405150 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-bd8e5978-491b-4118-b487-d78195594ff1 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:01.414586 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-bd8e5978-491b-4118-b487-d78195594ff1 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:01.430940 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-bd8e5978-491b-4118-b487-d78195594ff1 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] 10.222.0.43 "GET /compute/v2.1/servers/830de6ad-adc6-4d16-ae9d-a29ae85e6cd2" status: 200 len: 2504 microversion: 2.42 time: 0.714052 Oct 04 21:58:01.438831 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1608/3127] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:58:00 2022] GET /compute/v2.1/servers/830de6ad-adc6-4d16-ae9d-a29ae85e6cd2 => generated 2504 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:58:01.455727 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-d4a45664-fe6e-4e2d-a178-2f70cbfbbc28 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:01.471590 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-d4a45664-fe6e-4e2d-a178-2f70cbfbbc28 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] [instance: 2764125d-9366-4c77-b1ee-7f188df21205] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:01.508592 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d4a45664-fe6e-4e2d-a178-2f70cbfbbc28 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:01.510623 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d4a45664-fe6e-4e2d-a178-2f70cbfbbc28 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:01.512173 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d4a45664-fe6e-4e2d-a178-2f70cbfbbc28 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:01.515298 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d4a45664-fe6e-4e2d-a178-2f70cbfbbc28 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:01.523435 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d4a45664-fe6e-4e2d-a178-2f70cbfbbc28 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:01.531139 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d4a45664-fe6e-4e2d-a178-2f70cbfbbc28 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:02.328251 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-78ba9f5e-2a17-445a-86fb-56a5f55b5f09 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e807c724cc4c3887a2d360f0584ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40071e45805146529fb8abd40629c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:02.364410 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-78ba9f5e-2a17-445a-86fb-56a5f55b5f09 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] 10.222.0.43 "GET /compute/v2.1/servers/dad442d9-d2e1-49ee-93ea-6e5090634df8" status: 200 len: 1497 microversion: 2.1 time: 1.051735 Oct 04 21:58:02.364898 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1520/3128] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:58:01 2022] GET /compute/v2.1/servers/dad442d9-d2e1-49ee-93ea-6e5090634df8 => generated 1497 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:58:02.395791 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-1ece3302-c0b7-4a25-912d-81f4f4dbb06b req-ae9405cd-8100-44c0-837f-9653f6f38de1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2764125d-9366-4c77-b1ee-7f188df21205", "name": "network-vif-plugged", "status": "completed", "tag": "56748744-2cbd-4205-8496-e4ad97390937"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:58:02.444433 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-1ece3302-c0b7-4a25-912d-81f4f4dbb06b req-ae9405cd-8100-44c0-837f-9653f6f38de1 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:02.444939 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-1ece3302-c0b7-4a25-912d-81f4f4dbb06b req-ae9405cd-8100-44c0-837f-9653f6f38de1 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:02.445385 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-1ece3302-c0b7-4a25-912d-81f4f4dbb06b req-ae9405cd-8100-44c0-837f-9653f6f38de1 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:02.472791 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-1ece3302-c0b7-4a25-912d-81f4f4dbb06b req-ae9405cd-8100-44c0-837f-9653f6f38de1 service nova] Creating event network-vif-plugged:56748744-2cbd-4205-8496-e4ad97390937 for instance 2764125d-9366-4c77-b1ee-7f188df21205 on n-h2-860284-1 Oct 04 21:58:02.486769 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-d4a45664-fe6e-4e2d-a178-2f70cbfbbc28 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c386b2ed7064073944085bf2a41f0de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d23c1f5719481483f4a28b76e45514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:02.489376 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-1ece3302-c0b7-4a25-912d-81f4f4dbb06b req-ae9405cd-8100-44c0-837f-9653f6f38de1 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116563 Oct 04 21:58:02.495357 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1521/3129] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:58:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:58:02.500802 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-d4a45664-fe6e-4e2d-a178-2f70cbfbbc28 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] 10.222.0.43 "GET /compute/v2.1/servers/2764125d-9366-4c77-b1ee-7f188df21205" status: 200 len: 1315 microversion: 2.1 time: 1.060650 Oct 04 21:58:02.510280 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-6a92c70b-ba54-4bde-891c-b8d4a5f40931 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:02.512530 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-6a92c70b-ba54-4bde-891c-b8d4a5f40931 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] [instance: d0b1b757-4a4d-4a7a-9a06-08f178a02984] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:02.522552 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1609/3130] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:58:01 2022] GET /compute/v2.1/servers/2764125d-9366-4c77-b1ee-7f188df21205 => generated 1315 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:58:02.587049 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-ef8f18f3-a8bf-4bc8-b32b-e55d03d27f3f tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:02.590059 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-ef8f18f3-a8bf-4bc8-b32b-e55d03d27f3f tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: dd1b7876-cc6f-4ed3-a0e4-cfe2213b332f] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:02.616329 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ef8f18f3-a8bf-4bc8-b32b-e55d03d27f3f tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:02.624228 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ef8f18f3-a8bf-4bc8-b32b-e55d03d27f3f tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:02.626490 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ef8f18f3-a8bf-4bc8-b32b-e55d03d27f3f tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:02.632641 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ef8f18f3-a8bf-4bc8-b32b-e55d03d27f3f tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:02.633560 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ef8f18f3-a8bf-4bc8-b32b-e55d03d27f3f tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:02.634247 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ef8f18f3-a8bf-4bc8-b32b-e55d03d27f3f tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:02.796442 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-6a92c70b-ba54-4bde-891c-b8d4a5f40931 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:02.813752 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-6a92c70b-ba54-4bde-891c-b8d4a5f40931 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:02.815776 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-6a92c70b-ba54-4bde-891c-b8d4a5f40931 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:02.849923 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-6a92c70b-ba54-4bde-891c-b8d4a5f40931 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] 10.222.0.43 "GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984" status: 200 len: 1452 microversion: 2.91 time: 0.351871 Oct 04 21:58:02.850565 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1522/3131] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:58:02 2022] GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984 => generated 1452 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:58:02.883102 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-8a2e9384-e647-4e86-8a9f-95cc7440faaa tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:02.884240 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-8a2e9384-e647-4e86-8a9f-95cc7440faaa tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] [instance: 7618c19f-d7bb-4f37-8454-76570009eb30] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:02.901924 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8a2e9384-e647-4e86-8a9f-95cc7440faaa tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:02.902997 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8a2e9384-e647-4e86-8a9f-95cc7440faaa tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:02.904286 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8a2e9384-e647-4e86-8a9f-95cc7440faaa tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:02.907747 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8a2e9384-e647-4e86-8a9f-95cc7440faaa tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:02.910292 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8a2e9384-e647-4e86-8a9f-95cc7440faaa tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:02.912338 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8a2e9384-e647-4e86-8a9f-95cc7440faaa tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:03.810247 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-ef8f18f3-a8bf-4bc8-b32b-e55d03d27f3f tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2facee4c6a40416e908083e126d2cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07a17a482a4e92b6ddbdee463c8029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:03.831378 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-ef8f18f3-a8bf-4bc8-b32b-e55d03d27f3f tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/dd1b7876-cc6f-4ed3-a0e4-cfe2213b332f" status: 200 len: 1505 microversion: 2.1 time: 1.283478 Oct 04 21:58:03.842817 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1610/3132] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:58:02 2022] GET /compute/v2.1/servers/dd1b7876-cc6f-4ed3-a0e4-cfe2213b332f => generated 1505 bytes in 1319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:58:03.864493 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-b804df8e-3403-463b-8f45-1c171f6b2651 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:03.867263 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-b804df8e-3403-463b-8f45-1c171f6b2651 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] [instance: 830de6ad-adc6-4d16-ae9d-a29ae85e6cd2] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:03.881077 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b804df8e-3403-463b-8f45-1c171f6b2651 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:03.882902 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b804df8e-3403-463b-8f45-1c171f6b2651 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:03.884432 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b804df8e-3403-463b-8f45-1c171f6b2651 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:03.886789 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b804df8e-3403-463b-8f45-1c171f6b2651 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:03.889362 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b804df8e-3403-463b-8f45-1c171f6b2651 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:03.890058 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b804df8e-3403-463b-8f45-1c171f6b2651 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:03.955805 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-8a2e9384-e647-4e86-8a9f-95cc7440faaa tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a94113bec89469a844ede34890d6876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857b9057c949472b9a1862182a01356c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:03.982906 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-8a2e9384-e647-4e86-8a9f-95cc7440faaa tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] 10.222.0.43 "GET /compute/v2.1/servers/7618c19f-d7bb-4f37-8454-76570009eb30" status: 200 len: 1317 microversion: 2.1 time: 1.131065 Oct 04 21:58:03.984245 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1523/3133] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:58:02 2022] GET /compute/v2.1/servers/7618c19f-d7bb-4f37-8454-76570009eb30 => generated 1317 bytes in 1133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:58:04.001079 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-244c0bb8-414e-4f7f-935b-77283c981325 req-ffbf79ab-294a-4a06-9378-41a7422858b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "830de6ad-adc6-4d16-ae9d-a29ae85e6cd2", "name": "network-vif-deleted", "tag": "40124c44-6941-426e-92ed-972b6680a618"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:58:04.024817 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-244c0bb8-414e-4f7f-935b-77283c981325 req-ffbf79ab-294a-4a06-9378-41a7422858b6 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:04.026863 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-244c0bb8-414e-4f7f-935b-77283c981325 req-ffbf79ab-294a-4a06-9378-41a7422858b6 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:04.027567 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-244c0bb8-414e-4f7f-935b-77283c981325 req-ffbf79ab-294a-4a06-9378-41a7422858b6 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:04.059856 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-244c0bb8-414e-4f7f-935b-77283c981325 req-ffbf79ab-294a-4a06-9378-41a7422858b6 service nova] Creating event network-vif-deleted:40124c44-6941-426e-92ed-972b6680a618 for instance 830de6ad-adc6-4d16-ae9d-a29ae85e6cd2 on n-h1-860284-1 Oct 04 21:58:04.076890 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-244c0bb8-414e-4f7f-935b-77283c981325 req-ffbf79ab-294a-4a06-9378-41a7422858b6 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090419 Oct 04 21:58:04.084148 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1524/3134] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:58:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:58:04.106744 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-bfc389f1-5675-460c-b04a-d69271532725 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:04.126240 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-bfc389f1-5675-460c-b04a-d69271532725 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] [instance: dad442d9-d2e1-49ee-93ea-6e5090634df8] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:04.151961 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bfc389f1-5675-460c-b04a-d69271532725 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:04.152473 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bfc389f1-5675-460c-b04a-d69271532725 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:04.153103 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bfc389f1-5675-460c-b04a-d69271532725 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:04.153835 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bfc389f1-5675-460c-b04a-d69271532725 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:04.154290 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bfc389f1-5675-460c-b04a-d69271532725 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:04.154750 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bfc389f1-5675-460c-b04a-d69271532725 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:04.175264 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-b804df8e-3403-463b-8f45-1c171f6b2651 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:04.186293 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-b804df8e-3403-463b-8f45-1c171f6b2651 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:04.201876 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-b804df8e-3403-463b-8f45-1c171f6b2651 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:04.204245 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-b804df8e-3403-463b-8f45-1c171f6b2651 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] 10.222.0.43 "GET /compute/v2.1/servers/830de6ad-adc6-4d16-ae9d-a29ae85e6cd2" status: 200 len: 1604 microversion: 2.42 time: 0.359512 Oct 04 21:58:04.207034 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1611/3135] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:58:03 2022] GET /compute/v2.1/servers/830de6ad-adc6-4d16-ae9d-a29ae85e6cd2 => generated 1604 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:58:04.230354 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-a6b370ee-6348-4365-88fe-d603225d4f05 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:04.233689 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-a6b370ee-6348-4365-88fe-d603225d4f05 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] [instance: 2764125d-9366-4c77-b1ee-7f188df21205] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:04.264988 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a6b370ee-6348-4365-88fe-d603225d4f05 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:04.267368 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a6b370ee-6348-4365-88fe-d603225d4f05 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:04.268009 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a6b370ee-6348-4365-88fe-d603225d4f05 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:04.270182 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a6b370ee-6348-4365-88fe-d603225d4f05 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:04.272279 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a6b370ee-6348-4365-88fe-d603225d4f05 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:04.274048 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a6b370ee-6348-4365-88fe-d603225d4f05 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:04.683793 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-bfc389f1-5675-460c-b04a-d69271532725 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e807c724cc4c3887a2d360f0584ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40071e45805146529fb8abd40629c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:04.699115 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-bfc389f1-5675-460c-b04a-d69271532725 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] 10.222.0.43 "GET /compute/v2.1/servers/dad442d9-d2e1-49ee-93ea-6e5090634df8" status: 200 len: 1497 microversion: 2.1 time: 0.611469 Oct 04 21:58:04.701533 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1525/3136] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:58:04 2022] GET /compute/v2.1/servers/dad442d9-d2e1-49ee-93ea-6e5090634df8 => generated 1497 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:58:04.713146 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-8bb7ab09-b4a2-4a88-b9df-f999c91e8169 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:04.718101 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-8bb7ab09-b4a2-4a88-b9df-f999c91e8169 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: dd1b7876-cc6f-4ed3-a0e4-cfe2213b332f] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:04.738001 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8bb7ab09-b4a2-4a88-b9df-f999c91e8169 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:04.740057 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8bb7ab09-b4a2-4a88-b9df-f999c91e8169 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:04.742548 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8bb7ab09-b4a2-4a88-b9df-f999c91e8169 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:04.743508 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8bb7ab09-b4a2-4a88-b9df-f999c91e8169 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:04.746070 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8bb7ab09-b4a2-4a88-b9df-f999c91e8169 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:04.746750 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8bb7ab09-b4a2-4a88-b9df-f999c91e8169 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:04.794578 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-a6b370ee-6348-4365-88fe-d603225d4f05 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c386b2ed7064073944085bf2a41f0de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d23c1f5719481483f4a28b76e45514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:04.812150 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-a6b370ee-6348-4365-88fe-d603225d4f05 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] 10.222.0.43 "GET /compute/v2.1/servers/2764125d-9366-4c77-b1ee-7f188df21205" status: 200 len: 1315 microversion: 2.1 time: 0.599450 Oct 04 21:58:04.816233 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1612/3137] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:58:04 2022] GET /compute/v2.1/servers/2764125d-9366-4c77-b1ee-7f188df21205 => generated 1315 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:58:04.838201 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-3cd25eea-2082-4a59-977b-fae0eaa0d406 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:04.841386 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-8bb7ab09-b4a2-4a88-b9df-f999c91e8169 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: dd1b7876-cc6f-4ed3-a0e4-cfe2213b332f] Going to try to terminate instance {{(pid=134101) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:58:04.842634 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-3cd25eea-2082-4a59-977b-fae0eaa0d406 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] [instance: d0b1b757-4a4d-4a7a-9a06-08f178a02984] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:04.860790 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3cd25eea-2082-4a59-977b-fae0eaa0d406 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:04.864780 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3cd25eea-2082-4a59-977b-fae0eaa0d406 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:04.866807 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3cd25eea-2082-4a59-977b-fae0eaa0d406 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:04.868453 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3cd25eea-2082-4a59-977b-fae0eaa0d406 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:04.870086 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3cd25eea-2082-4a59-977b-fae0eaa0d406 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:04.871752 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3cd25eea-2082-4a59-977b-fae0eaa0d406 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:04.987435 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-3cd25eea-2082-4a59-977b-fae0eaa0d406 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:05.001761 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-3cd25eea-2082-4a59-977b-fae0eaa0d406 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:05.005553 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-3cd25eea-2082-4a59-977b-fae0eaa0d406 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:05.021171 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-8bb7ab09-b4a2-4a88-b9df-f999c91e8169 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "DELETE /compute/v2.1/servers/dd1b7876-cc6f-4ed3-a0e4-cfe2213b332f" status: 204 len: 0 microversion: 2.1 time: 0.317966 Oct 04 21:58:05.023044 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-3cd25eea-2082-4a59-977b-fae0eaa0d406 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] 10.222.0.43 "GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984" status: 200 len: 1510 microversion: 2.91 time: 0.196157 Oct 04 21:58:05.023417 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1526/3138] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 21:58:04 2022] DELETE /compute/v2.1/servers/dd1b7876-cc6f-4ed3-a0e4-cfe2213b332f => generated 0 bytes in 321 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:58:05.023858 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1613/3139] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:58:04 2022] GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984 => generated 1510 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:58:05.031209 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-0dd081be-78fd-4430-b3e0-2f215b3aacdd tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:05.033066 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-0dd081be-78fd-4430-b3e0-2f215b3aacdd tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: dd1b7876-cc6f-4ed3-a0e4-cfe2213b332f] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:05.043552 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-32112deb-615d-4d35-94c6-f1d0d9153c3a tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:05.044261 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-32112deb-615d-4d35-94c6-f1d0d9153c3a tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] [instance: 7618c19f-d7bb-4f37-8454-76570009eb30] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:05.046570 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0dd081be-78fd-4430-b3e0-2f215b3aacdd tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:05.053321 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0dd081be-78fd-4430-b3e0-2f215b3aacdd tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:05.053894 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0dd081be-78fd-4430-b3e0-2f215b3aacdd tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:05.056155 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0dd081be-78fd-4430-b3e0-2f215b3aacdd tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:05.057131 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0dd081be-78fd-4430-b3e0-2f215b3aacdd tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:05.058097 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-32112deb-615d-4d35-94c6-f1d0d9153c3a tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:05.058715 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-32112deb-615d-4d35-94c6-f1d0d9153c3a tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:05.059148 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-32112deb-615d-4d35-94c6-f1d0d9153c3a tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:05.060440 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-32112deb-615d-4d35-94c6-f1d0d9153c3a tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:05.060440 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-32112deb-615d-4d35-94c6-f1d0d9153c3a tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:05.060643 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-32112deb-615d-4d35-94c6-f1d0d9153c3a tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:05.065442 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0dd081be-78fd-4430-b3e0-2f215b3aacdd tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:05.432472 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-32112deb-615d-4d35-94c6-f1d0d9153c3a tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a94113bec89469a844ede34890d6876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857b9057c949472b9a1862182a01356c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:05.443508 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-32112deb-615d-4d35-94c6-f1d0d9153c3a tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] 10.222.0.43 "GET /compute/v2.1/servers/7618c19f-d7bb-4f37-8454-76570009eb30" status: 200 len: 1317 microversion: 2.1 time: 0.411775 Oct 04 21:58:05.444359 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1527/3140] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:58:05 2022] GET /compute/v2.1/servers/7618c19f-d7bb-4f37-8454-76570009eb30 => generated 1317 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:58:05.449206 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-97e27c90-e7c3-4e3c-af14-7a34b598f485 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:05.450024 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-97e27c90-e7c3-4e3c-af14-7a34b598f485 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] [instance: 830de6ad-adc6-4d16-ae9d-a29ae85e6cd2] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:05.457385 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-97e27c90-e7c3-4e3c-af14-7a34b598f485 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:05.458153 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-97e27c90-e7c3-4e3c-af14-7a34b598f485 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:05.458786 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-97e27c90-e7c3-4e3c-af14-7a34b598f485 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:05.459810 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-97e27c90-e7c3-4e3c-af14-7a34b598f485 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:05.460437 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-97e27c90-e7c3-4e3c-af14-7a34b598f485 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:05.461028 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-97e27c90-e7c3-4e3c-af14-7a34b598f485 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:05.496713 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-0dd081be-78fd-4430-b3e0-2f215b3aacdd tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2facee4c6a40416e908083e126d2cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07a17a482a4e92b6ddbdee463c8029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:05.512431 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-0dd081be-78fd-4430-b3e0-2f215b3aacdd tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/dd1b7876-cc6f-4ed3-a0e4-cfe2213b332f" status: 200 len: 1511 microversion: 2.1 time: 0.482996 Oct 04 21:58:05.514043 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1614/3141] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:58:05 2022] GET /compute/v2.1/servers/dd1b7876-cc6f-4ed3-a0e4-cfe2213b332f => generated 1511 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:58:05.595004 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-97e27c90-e7c3-4e3c-af14-7a34b598f485 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:05.605537 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-97e27c90-e7c3-4e3c-af14-7a34b598f485 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:05.607137 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-97e27c90-e7c3-4e3c-af14-7a34b598f485 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:05.608337 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-97e27c90-e7c3-4e3c-af14-7a34b598f485 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] 10.222.0.43 "GET /compute/v2.1/servers/830de6ad-adc6-4d16-ae9d-a29ae85e6cd2" status: 200 len: 1604 microversion: 2.42 time: 0.162889 Oct 04 21:58:05.608901 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1528/3142] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:58:05 2022] GET /compute/v2.1/servers/830de6ad-adc6-4d16-ae9d-a29ae85e6cd2 => generated 1604 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:58:05.729189 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-132436a2-e63c-4a38-9bfd-ad4e9aef99e4 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:05.730266 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-132436a2-e63c-4a38-9bfd-ad4e9aef99e4 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] [instance: dad442d9-d2e1-49ee-93ea-6e5090634df8] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:05.737469 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-132436a2-e63c-4a38-9bfd-ad4e9aef99e4 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:05.738358 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-132436a2-e63c-4a38-9bfd-ad4e9aef99e4 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:05.739099 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-132436a2-e63c-4a38-9bfd-ad4e9aef99e4 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:05.740111 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-132436a2-e63c-4a38-9bfd-ad4e9aef99e4 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:05.740807 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-132436a2-e63c-4a38-9bfd-ad4e9aef99e4 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:05.741470 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-132436a2-e63c-4a38-9bfd-ad4e9aef99e4 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:05.839923 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-8dc9bc19-45f0-4d82-99fe-fec2aa06c216 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:05.841094 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-8dc9bc19-45f0-4d82-99fe-fec2aa06c216 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] [instance: 2764125d-9366-4c77-b1ee-7f188df21205] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:05.849425 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8dc9bc19-45f0-4d82-99fe-fec2aa06c216 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:05.862712 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8dc9bc19-45f0-4d82-99fe-fec2aa06c216 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:05.863598 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8dc9bc19-45f0-4d82-99fe-fec2aa06c216 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:05.864377 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8dc9bc19-45f0-4d82-99fe-fec2aa06c216 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:05.864867 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8dc9bc19-45f0-4d82-99fe-fec2aa06c216 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:05.865303 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8dc9bc19-45f0-4d82-99fe-fec2aa06c216 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:05.900584 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-132436a2-e63c-4a38-9bfd-ad4e9aef99e4 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e807c724cc4c3887a2d360f0584ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40071e45805146529fb8abd40629c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:05.909452 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-132436a2-e63c-4a38-9bfd-ad4e9aef99e4 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] 10.222.0.43 "GET /compute/v2.1/servers/dad442d9-d2e1-49ee-93ea-6e5090634df8" status: 200 len: 1497 microversion: 2.1 time: 0.184260 Oct 04 21:58:05.914532 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1615/3143] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:58:05 2022] GET /compute/v2.1/servers/dad442d9-d2e1-49ee-93ea-6e5090634df8 => generated 1497 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:58:06.037956 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-8dc9bc19-45f0-4d82-99fe-fec2aa06c216 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c386b2ed7064073944085bf2a41f0de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d23c1f5719481483f4a28b76e45514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:06.040606 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:58:06.050016 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-8dc9bc19-45f0-4d82-99fe-fec2aa06c216 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] 10.222.0.43 "GET /compute/v2.1/servers/2764125d-9366-4c77-b1ee-7f188df21205" status: 200 len: 1502 microversion: 2.1 time: 0.214289 Oct 04 21:58:06.050871 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1529/3144] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:58:05 2022] GET /compute/v2.1/servers/2764125d-9366-4c77-b1ee-7f188df21205 => generated 1502 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:58:06.055047 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-548e5c5d-b39e-41ec-9a3b-c56aa5f52c4e tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:06.055789 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-548e5c5d-b39e-41ec-9a3b-c56aa5f52c4e tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] [instance: d0b1b757-4a4d-4a7a-9a06-08f178a02984] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:06.066653 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-548e5c5d-b39e-41ec-9a3b-c56aa5f52c4e tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:06.067693 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-548e5c5d-b39e-41ec-9a3b-c56aa5f52c4e tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:06.068549 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-548e5c5d-b39e-41ec-9a3b-c56aa5f52c4e tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:06.069449 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-548e5c5d-b39e-41ec-9a3b-c56aa5f52c4e tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:06.071055 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-548e5c5d-b39e-41ec-9a3b-c56aa5f52c4e tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:06.071983 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-548e5c5d-b39e-41ec-9a3b-c56aa5f52c4e tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:06.073928 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-20ea0286-6b71-4d47-8545-846de10324c0 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:06.074688 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-20ea0286-6b71-4d47-8545-846de10324c0 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] [instance: 2764125d-9366-4c77-b1ee-7f188df21205] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:06.086397 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-20ea0286-6b71-4d47-8545-846de10324c0 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:06.087924 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-20ea0286-6b71-4d47-8545-846de10324c0 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:06.089724 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-20ea0286-6b71-4d47-8545-846de10324c0 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:06.092083 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-20ea0286-6b71-4d47-8545-846de10324c0 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:06.092574 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-20ea0286-6b71-4d47-8545-846de10324c0 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:06.093016 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-20ea0286-6b71-4d47-8545-846de10324c0 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:06.174240 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-548e5c5d-b39e-41ec-9a3b-c56aa5f52c4e tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:06.183987 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-548e5c5d-b39e-41ec-9a3b-c56aa5f52c4e tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:06.186835 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-548e5c5d-b39e-41ec-9a3b-c56aa5f52c4e tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:06.198258 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-548e5c5d-b39e-41ec-9a3b-c56aa5f52c4e tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] 10.222.0.43 "GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984" status: 200 len: 1510 microversion: 2.91 time: 0.147171 Oct 04 21:58:06.202808 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1616/3145] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:58:06 2022] GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984 => generated 1510 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:58:06.314610 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-20ea0286-6b71-4d47-8545-846de10324c0 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c386b2ed7064073944085bf2a41f0de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d23c1f5719481483f4a28b76e45514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:06.330161 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-20ea0286-6b71-4d47-8545-846de10324c0 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] 10.222.0.43 "GET /compute/v2.1/servers/2764125d-9366-4c77-b1ee-7f188df21205" status: 200 len: 1502 microversion: 2.1 time: 0.259132 Oct 04 21:58:06.332276 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1530/3146] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:58:06 2022] GET /compute/v2.1/servers/2764125d-9366-4c77-b1ee-7f188df21205 => generated 1502 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:58:06.357901 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-fb1df049-4d72-43a8-b020-1a6a3f10fead tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:58:06.358906 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-fb1df049-4d72-43a8-b020-1a6a3f10fead tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] [instance: 2764125d-9366-4c77-b1ee-7f188df21205] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:06.368627 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fb1df049-4d72-43a8-b020-1a6a3f10fead tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:06.369576 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fb1df049-4d72-43a8-b020-1a6a3f10fead tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:06.371649 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fb1df049-4d72-43a8-b020-1a6a3f10fead tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:06.372635 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fb1df049-4d72-43a8-b020-1a6a3f10fead tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:06.374747 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fb1df049-4d72-43a8-b020-1a6a3f10fead tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:06.375551 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fb1df049-4d72-43a8-b020-1a6a3f10fead tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:06.414988 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.objects.instance [None req-fb1df049-4d72-43a8-b020-1a6a3f10fead tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Lazy-loading 'flavor' on Instance uuid 2764125d-9366-4c77-b1ee-7f188df21205 {{(pid=134102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:58:06.471947 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-53d2445d-f89a-475e-aaea-1a3a5539c1a5 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:06.473103 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-53d2445d-f89a-475e-aaea-1a3a5539c1a5 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] [instance: 7618c19f-d7bb-4f37-8454-76570009eb30] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:06.492700 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-53d2445d-f89a-475e-aaea-1a3a5539c1a5 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:06.498453 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-53d2445d-f89a-475e-aaea-1a3a5539c1a5 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:06.498931 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-53d2445d-f89a-475e-aaea-1a3a5539c1a5 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:06.499698 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-53d2445d-f89a-475e-aaea-1a3a5539c1a5 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:06.500174 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-53d2445d-f89a-475e-aaea-1a3a5539c1a5 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:06.500662 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-53d2445d-f89a-475e-aaea-1a3a5539c1a5 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:06.522500 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-fb1df049-4d72-43a8-b020-1a6a3f10fead tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] 10.222.0.43 "POST /compute/v2.1/servers/2764125d-9366-4c77-b1ee-7f188df21205/action" status: 202 len: 0 microversion: 2.1 time: 0.168553 Oct 04 21:58:06.523914 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1617/3147] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 21:58:06 2022] POST /compute/v2.1/servers/2764125d-9366-4c77-b1ee-7f188df21205/action => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:58:06.537109 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-e34558dc-3e70-461a-9b87-033e473a6e4c tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:06.538940 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-e34558dc-3e70-461a-9b87-033e473a6e4c tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] [instance: 2764125d-9366-4c77-b1ee-7f188df21205] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:06.551353 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e34558dc-3e70-461a-9b87-033e473a6e4c tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:06.551723 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e34558dc-3e70-461a-9b87-033e473a6e4c tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:06.552080 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e34558dc-3e70-461a-9b87-033e473a6e4c tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:06.552957 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e34558dc-3e70-461a-9b87-033e473a6e4c tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:06.553433 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e34558dc-3e70-461a-9b87-033e473a6e4c tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:06.553856 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e34558dc-3e70-461a-9b87-033e473a6e4c tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:07.128899 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-53d2445d-f89a-475e-aaea-1a3a5539c1a5 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a94113bec89469a844ede34890d6876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857b9057c949472b9a1862182a01356c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:07.149631 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-53d2445d-f89a-475e-aaea-1a3a5539c1a5 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] 10.222.0.43 "GET /compute/v2.1/servers/7618c19f-d7bb-4f37-8454-76570009eb30" status: 200 len: 1317 microversion: 2.1 time: 0.680215 Oct 04 21:58:07.150643 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1531/3148] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:58:06 2022] GET /compute/v2.1/servers/7618c19f-d7bb-4f37-8454-76570009eb30 => generated 1317 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:58:07.159775 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-850e0979-974d-403a-803a-07608fef7bd9 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:07.161152 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-850e0979-974d-403a-803a-07608fef7bd9 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: dd1b7876-cc6f-4ed3-a0e4-cfe2213b332f] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:07.174150 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-850e0979-974d-403a-803a-07608fef7bd9 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:07.175024 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-850e0979-974d-403a-803a-07608fef7bd9 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:07.175635 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-850e0979-974d-403a-803a-07608fef7bd9 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:07.176667 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-850e0979-974d-403a-803a-07608fef7bd9 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:07.177302 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-850e0979-974d-403a-803a-07608fef7bd9 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:07.178211 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-850e0979-974d-403a-803a-07608fef7bd9 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:07.208149 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-e34558dc-3e70-461a-9b87-033e473a6e4c tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c386b2ed7064073944085bf2a41f0de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d23c1f5719481483f4a28b76e45514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:07.221081 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-e34558dc-3e70-461a-9b87-033e473a6e4c tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] 10.222.0.43 "GET /compute/v2.1/servers/2764125d-9366-4c77-b1ee-7f188df21205" status: 200 len: 1510 microversion: 2.1 time: 0.692165 Oct 04 21:58:07.226660 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1618/3149] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:58:06 2022] GET /compute/v2.1/servers/2764125d-9366-4c77-b1ee-7f188df21205 => generated 1510 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:58:07.233594 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-83edf931-fad5-41ed-a36f-ac52c46497aa tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:07.235108 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-83edf931-fad5-41ed-a36f-ac52c46497aa tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] [instance: 830de6ad-adc6-4d16-ae9d-a29ae85e6cd2] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:07.253594 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-83edf931-fad5-41ed-a36f-ac52c46497aa tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:07.254376 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-83edf931-fad5-41ed-a36f-ac52c46497aa tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:07.255854 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-83edf931-fad5-41ed-a36f-ac52c46497aa tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:07.256770 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-83edf931-fad5-41ed-a36f-ac52c46497aa tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:07.257485 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-83edf931-fad5-41ed-a36f-ac52c46497aa tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:07.258219 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-83edf931-fad5-41ed-a36f-ac52c46497aa tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:07.379811 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-83edf931-fad5-41ed-a36f-ac52c46497aa tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:07.400894 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-83edf931-fad5-41ed-a36f-ac52c46497aa tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:07.409247 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-83edf931-fad5-41ed-a36f-ac52c46497aa tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:07.410822 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-83edf931-fad5-41ed-a36f-ac52c46497aa tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] 10.222.0.43 "GET /compute/v2.1/servers/830de6ad-adc6-4d16-ae9d-a29ae85e6cd2" status: 200 len: 1604 microversion: 2.42 time: 0.181495 Oct 04 21:58:07.437073 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1619/3150] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:58:07 2022] GET /compute/v2.1/servers/830de6ad-adc6-4d16-ae9d-a29ae85e6cd2 => generated 1604 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:58:07.443720 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-8b4806d6-82fe-4d84-9a92-ddb918256436 req-35e8a498-6465-44f8-b472-fa00c38c6902 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7618c19f-d7bb-4f37-8454-76570009eb30", "tag": "91e0e68c-517b-4d17-839d-fdcdae7c269b"}, {"name": "network-changed", "server_uuid": "563105fe-37b7-495e-88bd-d524aa2395db", "tag": "8efd08fb-4170-4168-9227-d8d2e4a16093"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:58:07.456282 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-8b4806d6-82fe-4d84-9a92-ddb918256436 req-35e8a498-6465-44f8-b472-fa00c38c6902 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:07.457014 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-8b4806d6-82fe-4d84-9a92-ddb918256436 req-35e8a498-6465-44f8-b472-fa00c38c6902 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:07.457613 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-8b4806d6-82fe-4d84-9a92-ddb918256436 req-35e8a498-6465-44f8-b472-fa00c38c6902 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:07.476964 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-8b4806d6-82fe-4d84-9a92-ddb918256436 req-35e8a498-6465-44f8-b472-fa00c38c6902 service nova] Creating event network-changed:91e0e68c-517b-4d17-839d-fdcdae7c269b for instance 7618c19f-d7bb-4f37-8454-76570009eb30 on n-h2-860284-1 Oct 04 21:58:07.481367 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-8b4806d6-82fe-4d84-9a92-ddb918256436 req-35e8a498-6465-44f8-b472-fa00c38c6902 service nova] Creating event network-changed:8efd08fb-4170-4168-9227-d8d2e4a16093 for instance 563105fe-37b7-495e-88bd-d524aa2395db on n-h1-860284-1 Oct 04 21:58:07.514480 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-8b4806d6-82fe-4d84-9a92-ddb918256436 req-35e8a498-6465-44f8-b472-fa00c38c6902 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.075114 Oct 04 21:58:07.519196 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1620/3151] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:58:07 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:58:07.536408 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-144c76e9-a85e-48f9-886d-9c63d7cbe81d tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:07.537237 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-144c76e9-a85e-48f9-886d-9c63d7cbe81d tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] [instance: dad442d9-d2e1-49ee-93ea-6e5090634df8] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:07.544940 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-144c76e9-a85e-48f9-886d-9c63d7cbe81d tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:07.545531 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-144c76e9-a85e-48f9-886d-9c63d7cbe81d tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:07.546038 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-144c76e9-a85e-48f9-886d-9c63d7cbe81d tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:07.547013 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-144c76e9-a85e-48f9-886d-9c63d7cbe81d tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:07.548659 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-144c76e9-a85e-48f9-886d-9c63d7cbe81d tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:07.549680 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-144c76e9-a85e-48f9-886d-9c63d7cbe81d tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:07.634568 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-850e0979-974d-403a-803a-07608fef7bd9 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2facee4c6a40416e908083e126d2cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07a17a482a4e92b6ddbdee463c8029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:07.649612 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-850e0979-974d-403a-803a-07608fef7bd9 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/dd1b7876-cc6f-4ed3-a0e4-cfe2213b332f" status: 200 len: 1511 microversion: 2.1 time: 0.497717 Oct 04 21:58:07.667985 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1532/3152] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:58:07 2022] GET /compute/v2.1/servers/dd1b7876-cc6f-4ed3-a0e4-cfe2213b332f => generated 1511 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:58:07.675685 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-89044567-5f2e-4cd3-8bd4-0e745eb05f91 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:07.676787 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-89044567-5f2e-4cd3-8bd4-0e745eb05f91 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] [instance: d0b1b757-4a4d-4a7a-9a06-08f178a02984] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:07.685182 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-89044567-5f2e-4cd3-8bd4-0e745eb05f91 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:07.686017 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-89044567-5f2e-4cd3-8bd4-0e745eb05f91 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:07.688658 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-89044567-5f2e-4cd3-8bd4-0e745eb05f91 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:07.692942 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-89044567-5f2e-4cd3-8bd4-0e745eb05f91 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:07.693599 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-89044567-5f2e-4cd3-8bd4-0e745eb05f91 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:07.694259 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-89044567-5f2e-4cd3-8bd4-0e745eb05f91 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:07.904173 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-89044567-5f2e-4cd3-8bd4-0e745eb05f91 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:07.921198 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-89044567-5f2e-4cd3-8bd4-0e745eb05f91 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:07.932178 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-89044567-5f2e-4cd3-8bd4-0e745eb05f91 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:07.944081 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-144c76e9-a85e-48f9-886d-9c63d7cbe81d tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e807c724cc4c3887a2d360f0584ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40071e45805146529fb8abd40629c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:07.953807 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-144c76e9-a85e-48f9-886d-9c63d7cbe81d tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] 10.222.0.43 "GET /compute/v2.1/servers/dad442d9-d2e1-49ee-93ea-6e5090634df8" status: 200 len: 1497 microversion: 2.1 time: 0.432903 Oct 04 21:58:07.960604 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-89044567-5f2e-4cd3-8bd4-0e745eb05f91 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] 10.222.0.43 "GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984" status: 200 len: 1510 microversion: 2.91 time: 0.291065 Oct 04 21:58:07.961198 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1533/3153] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:58:07 2022] GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984 => generated 1510 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:58:07.973547 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1621/3154] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:58:07 2022] GET /compute/v2.1/servers/dad442d9-d2e1-49ee-93ea-6e5090634df8 => generated 1497 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:58:08.178697 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-f34f6f13-274f-46ba-943a-2d02fcc2ba58 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:08.179918 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-f34f6f13-274f-46ba-943a-2d02fcc2ba58 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] [instance: 7618c19f-d7bb-4f37-8454-76570009eb30] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:08.196692 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f34f6f13-274f-46ba-943a-2d02fcc2ba58 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:08.197580 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f34f6f13-274f-46ba-943a-2d02fcc2ba58 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:08.198196 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f34f6f13-274f-46ba-943a-2d02fcc2ba58 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:08.201326 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f34f6f13-274f-46ba-943a-2d02fcc2ba58 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:08.202024 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f34f6f13-274f-46ba-943a-2d02fcc2ba58 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:08.203017 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f34f6f13-274f-46ba-943a-2d02fcc2ba58 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:08.252524 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-b7f0ef31-c72d-438c-9f69-6c998c19e83a tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:08.253948 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-b7f0ef31-c72d-438c-9f69-6c998c19e83a tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] [instance: 2764125d-9366-4c77-b1ee-7f188df21205] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:08.272623 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b7f0ef31-c72d-438c-9f69-6c998c19e83a tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:08.277467 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b7f0ef31-c72d-438c-9f69-6c998c19e83a tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:08.279555 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b7f0ef31-c72d-438c-9f69-6c998c19e83a tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:08.281232 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b7f0ef31-c72d-438c-9f69-6c998c19e83a tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:08.284781 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b7f0ef31-c72d-438c-9f69-6c998c19e83a tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:08.286998 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b7f0ef31-c72d-438c-9f69-6c998c19e83a tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:08.639963 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-b7f0ef31-c72d-438c-9f69-6c998c19e83a tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c386b2ed7064073944085bf2a41f0de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d23c1f5719481483f4a28b76e45514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:08.651003 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-f34f6f13-274f-46ba-943a-2d02fcc2ba58 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a94113bec89469a844ede34890d6876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857b9057c949472b9a1862182a01356c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:08.671183 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-f34f6f13-274f-46ba-943a-2d02fcc2ba58 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] 10.222.0.43 "GET /compute/v2.1/servers/7618c19f-d7bb-4f37-8454-76570009eb30" status: 200 len: 1317 microversion: 2.1 time: 0.497803 Oct 04 21:58:08.671795 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1534/3155] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:58:08 2022] GET /compute/v2.1/servers/7618c19f-d7bb-4f37-8454-76570009eb30 => generated 1317 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:58:08.674986 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-b7f0ef31-c72d-438c-9f69-6c998c19e83a tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] 10.222.0.43 "GET /compute/v2.1/servers/2764125d-9366-4c77-b1ee-7f188df21205" status: 200 len: 1510 microversion: 2.1 time: 0.426863 Oct 04 21:58:08.695303 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1622/3156] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:58:08 2022] GET /compute/v2.1/servers/2764125d-9366-4c77-b1ee-7f188df21205 => generated 1510 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:58:08.704210 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-4176e60c-0166-4e71-96d9-41c0dfc095b3 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:08.704472 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-9f72a27c-f9ef-4071-85d9-62c46b0046cd tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:08.705362 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-9f72a27c-f9ef-4071-85d9-62c46b0046cd tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: dd1b7876-cc6f-4ed3-a0e4-cfe2213b332f] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:08.706169 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-4176e60c-0166-4e71-96d9-41c0dfc095b3 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] [instance: 830de6ad-adc6-4d16-ae9d-a29ae85e6cd2] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:08.718624 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4176e60c-0166-4e71-96d9-41c0dfc095b3 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:08.720869 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9f72a27c-f9ef-4071-85d9-62c46b0046cd tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:08.721695 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4176e60c-0166-4e71-96d9-41c0dfc095b3 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:08.722318 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4176e60c-0166-4e71-96d9-41c0dfc095b3 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:08.723035 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9f72a27c-f9ef-4071-85d9-62c46b0046cd tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:08.723958 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4176e60c-0166-4e71-96d9-41c0dfc095b3 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:08.724617 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9f72a27c-f9ef-4071-85d9-62c46b0046cd tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:08.725564 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9f72a27c-f9ef-4071-85d9-62c46b0046cd tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:08.726275 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4176e60c-0166-4e71-96d9-41c0dfc095b3 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:08.726944 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4176e60c-0166-4e71-96d9-41c0dfc095b3 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:08.727631 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9f72a27c-f9ef-4071-85d9-62c46b0046cd tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:08.731307 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9f72a27c-f9ef-4071-85d9-62c46b0046cd tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:08.848757 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-4176e60c-0166-4e71-96d9-41c0dfc095b3 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:08.866898 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-4176e60c-0166-4e71-96d9-41c0dfc095b3 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:08.869005 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-4176e60c-0166-4e71-96d9-41c0dfc095b3 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:08.871844 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-4176e60c-0166-4e71-96d9-41c0dfc095b3 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] 10.222.0.43 "GET /compute/v2.1/servers/830de6ad-adc6-4d16-ae9d-a29ae85e6cd2" status: 200 len: 1604 microversion: 2.42 time: 0.180204 Oct 04 21:58:08.873652 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1535/3157] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:58:08 2022] GET /compute/v2.1/servers/830de6ad-adc6-4d16-ae9d-a29ae85e6cd2 => generated 1604 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:58:08.983469 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-6d990b64-7846-4a06-b90d-fdc158d6b656 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:08.983817 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-6d990b64-7846-4a06-b90d-fdc158d6b656 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] [instance: dad442d9-d2e1-49ee-93ea-6e5090634df8] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:09.003097 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6d990b64-7846-4a06-b90d-fdc158d6b656 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:09.003633 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6d990b64-7846-4a06-b90d-fdc158d6b656 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:09.004151 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6d990b64-7846-4a06-b90d-fdc158d6b656 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:09.004929 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6d990b64-7846-4a06-b90d-fdc158d6b656 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:09.005399 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6d990b64-7846-4a06-b90d-fdc158d6b656 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:09.005877 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6d990b64-7846-4a06-b90d-fdc158d6b656 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:09.040206 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-9f72a27c-f9ef-4071-85d9-62c46b0046cd tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2facee4c6a40416e908083e126d2cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07a17a482a4e92b6ddbdee463c8029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:09.044139 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:58:09.065430 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-9f72a27c-f9ef-4071-85d9-62c46b0046cd tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/dd1b7876-cc6f-4ed3-a0e4-cfe2213b332f" status: 200 len: 1511 microversion: 2.1 time: 0.367844 Oct 04 21:58:09.080834 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1623/3158] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:58:08 2022] GET /compute/v2.1/servers/dd1b7876-cc6f-4ed3-a0e4-cfe2213b332f => generated 1511 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:58:09.091656 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-20deeddf-87f5-4e5c-a66a-91ed72f8c460 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:09.092643 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-20deeddf-87f5-4e5c-a66a-91ed72f8c460 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] [instance: d0b1b757-4a4d-4a7a-9a06-08f178a02984] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:09.103373 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-20deeddf-87f5-4e5c-a66a-91ed72f8c460 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:09.104165 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-20deeddf-87f5-4e5c-a66a-91ed72f8c460 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:09.105503 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-20deeddf-87f5-4e5c-a66a-91ed72f8c460 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:09.106496 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-20deeddf-87f5-4e5c-a66a-91ed72f8c460 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:09.107166 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-20deeddf-87f5-4e5c-a66a-91ed72f8c460 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:09.107914 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-20deeddf-87f5-4e5c-a66a-91ed72f8c460 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:09.264031 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-20deeddf-87f5-4e5c-a66a-91ed72f8c460 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:09.273364 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-20deeddf-87f5-4e5c-a66a-91ed72f8c460 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:09.280515 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-20deeddf-87f5-4e5c-a66a-91ed72f8c460 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:09.295633 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-20deeddf-87f5-4e5c-a66a-91ed72f8c460 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] 10.222.0.43 "GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984" status: 200 len: 1510 microversion: 2.91 time: 0.213535 Oct 04 21:58:09.296539 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1624/3159] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:58:09 2022] GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984 => generated 1510 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:58:09.340961 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-6d990b64-7846-4a06-b90d-fdc158d6b656 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e807c724cc4c3887a2d360f0584ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40071e45805146529fb8abd40629c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:09.354232 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-6d990b64-7846-4a06-b90d-fdc158d6b656 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] 10.222.0.43 "GET /compute/v2.1/servers/dad442d9-d2e1-49ee-93ea-6e5090634df8" status: 200 len: 1497 microversion: 2.1 time: 0.377031 Oct 04 21:58:09.355340 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1536/3160] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:58:08 2022] GET /compute/v2.1/servers/dad442d9-d2e1-49ee-93ea-6e5090634df8 => generated 1497 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:58:09.693554 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-17ff5fcb-2722-4cb7-89a3-54772404ebed tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:09.694098 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-17ff5fcb-2722-4cb7-89a3-54772404ebed tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] [instance: 7618c19f-d7bb-4f37-8454-76570009eb30] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:09.702487 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-5443da6f-f9fe-411e-a50a-97c6e6b27a3f tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:09.703103 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-5443da6f-f9fe-411e-a50a-97c6e6b27a3f tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] [instance: 2764125d-9366-4c77-b1ee-7f188df21205] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:09.717327 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5443da6f-f9fe-411e-a50a-97c6e6b27a3f tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:09.717829 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5443da6f-f9fe-411e-a50a-97c6e6b27a3f tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:09.718265 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5443da6f-f9fe-411e-a50a-97c6e6b27a3f tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:09.719069 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5443da6f-f9fe-411e-a50a-97c6e6b27a3f tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:09.720065 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5443da6f-f9fe-411e-a50a-97c6e6b27a3f tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:09.720496 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5443da6f-f9fe-411e-a50a-97c6e6b27a3f tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:09.728975 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-17ff5fcb-2722-4cb7-89a3-54772404ebed tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:09.729472 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-17ff5fcb-2722-4cb7-89a3-54772404ebed tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:09.729922 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-17ff5fcb-2722-4cb7-89a3-54772404ebed tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:09.738925 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-17ff5fcb-2722-4cb7-89a3-54772404ebed tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:09.739513 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-17ff5fcb-2722-4cb7-89a3-54772404ebed tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:09.739987 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-17ff5fcb-2722-4cb7-89a3-54772404ebed tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:10.100350 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-5443da6f-f9fe-411e-a50a-97c6e6b27a3f tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c386b2ed7064073944085bf2a41f0de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d23c1f5719481483f4a28b76e45514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:10.112352 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-5443da6f-f9fe-411e-a50a-97c6e6b27a3f tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] 10.222.0.43 "GET /compute/v2.1/servers/2764125d-9366-4c77-b1ee-7f188df21205" status: 200 len: 1493 microversion: 2.1 time: 0.413745 Oct 04 21:58:10.120367 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-17ff5fcb-2722-4cb7-89a3-54772404ebed tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a94113bec89469a844ede34890d6876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857b9057c949472b9a1862182a01356c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:10.130837 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1537/3161] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:58:09 2022] GET /compute/v2.1/servers/2764125d-9366-4c77-b1ee-7f188df21205 => generated 1493 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:58:10.135575 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-17ff5fcb-2722-4cb7-89a3-54772404ebed tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] 10.222.0.43 "GET /compute/v2.1/servers/7618c19f-d7bb-4f37-8454-76570009eb30" status: 200 len: 1317 microversion: 2.1 time: 0.441302 Oct 04 21:58:10.142072 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1625/3162] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:58:09 2022] GET /compute/v2.1/servers/7618c19f-d7bb-4f37-8454-76570009eb30 => generated 1317 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:58:10.144385 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-3045b140-8057-4cca-995c-d574692aba9f tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:10.145290 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-3045b140-8057-4cca-995c-d574692aba9f tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] [instance: 830de6ad-adc6-4d16-ae9d-a29ae85e6cd2] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:10.147122 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-f1aed0a8-c5e0-4736-8527-4e4eaa47f7a0 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:10.147741 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-f1aed0a8-c5e0-4736-8527-4e4eaa47f7a0 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: dd1b7876-cc6f-4ed3-a0e4-cfe2213b332f] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:10.153544 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3045b140-8057-4cca-995c-d574692aba9f tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:10.154310 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3045b140-8057-4cca-995c-d574692aba9f tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:10.154985 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3045b140-8057-4cca-995c-d574692aba9f tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:10.155914 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3045b140-8057-4cca-995c-d574692aba9f tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:10.157198 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3045b140-8057-4cca-995c-d574692aba9f tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:10.157902 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3045b140-8057-4cca-995c-d574692aba9f tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:10.171551 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f1aed0a8-c5e0-4736-8527-4e4eaa47f7a0 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:10.172610 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f1aed0a8-c5e0-4736-8527-4e4eaa47f7a0 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:10.173579 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f1aed0a8-c5e0-4736-8527-4e4eaa47f7a0 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:10.174649 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f1aed0a8-c5e0-4736-8527-4e4eaa47f7a0 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:10.175388 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f1aed0a8-c5e0-4736-8527-4e4eaa47f7a0 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:10.179062 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f1aed0a8-c5e0-4736-8527-4e4eaa47f7a0 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:10.402881 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-3045b140-8057-4cca-995c-d574692aba9f tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:10.432413 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-3045b140-8057-4cca-995c-d574692aba9f tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:10.433910 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-3045b140-8057-4cca-995c-d574692aba9f tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:10.436034 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-3045b140-8057-4cca-995c-d574692aba9f tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] 10.222.0.43 "GET /compute/v2.1/servers/830de6ad-adc6-4d16-ae9d-a29ae85e6cd2" status: 200 len: 1604 microversion: 2.42 time: 0.303901 Oct 04 21:58:10.436628 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1538/3163] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:58:10 2022] GET /compute/v2.1/servers/830de6ad-adc6-4d16-ae9d-a29ae85e6cd2 => generated 1604 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:58:10.442315 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-c8ad7564-d7e3-405f-b09c-622fb1bc326a tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:58:10.442887 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-c8ad7564-d7e3-405f-b09c-622fb1bc326a tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] [instance: 2764125d-9366-4c77-b1ee-7f188df21205] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:10.452365 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c8ad7564-d7e3-405f-b09c-622fb1bc326a tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:10.452874 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c8ad7564-d7e3-405f-b09c-622fb1bc326a tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:10.453347 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c8ad7564-d7e3-405f-b09c-622fb1bc326a tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:10.454070 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c8ad7564-d7e3-405f-b09c-622fb1bc326a tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:10.454606 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c8ad7564-d7e3-405f-b09c-622fb1bc326a tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:10.455197 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c8ad7564-d7e3-405f-b09c-622fb1bc326a tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:10.558557 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-f1aed0a8-c5e0-4736-8527-4e4eaa47f7a0 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2facee4c6a40416e908083e126d2cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07a17a482a4e92b6ddbdee463c8029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:10.580409 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-f1aed0a8-c5e0-4736-8527-4e4eaa47f7a0 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/dd1b7876-cc6f-4ed3-a0e4-cfe2213b332f" status: 200 len: 1511 microversion: 2.1 time: 0.436949 Oct 04 21:58:10.581370 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1626/3164] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:58:10 2022] GET /compute/v2.1/servers/dd1b7876-cc6f-4ed3-a0e4-cfe2213b332f => generated 1511 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:58:10.586479 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-f37b72ef-158c-431d-80d5-bd2f8237d961 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:10.595504 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-f37b72ef-158c-431d-80d5-bd2f8237d961 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] [instance: d0b1b757-4a4d-4a7a-9a06-08f178a02984] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:10.605926 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f37b72ef-158c-431d-80d5-bd2f8237d961 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:10.606862 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f37b72ef-158c-431d-80d5-bd2f8237d961 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:10.607538 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f37b72ef-158c-431d-80d5-bd2f8237d961 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:10.608495 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f37b72ef-158c-431d-80d5-bd2f8237d961 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:10.609181 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f37b72ef-158c-431d-80d5-bd2f8237d961 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:10.622661 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f37b72ef-158c-431d-80d5-bd2f8237d961 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:10.661914 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-c8ad7564-d7e3-405f-b09c-622fb1bc326a tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] 10.222.0.43 "POST /compute/v2.1/servers/2764125d-9366-4c77-b1ee-7f188df21205/action" status: 202 len: 0 microversion: 2.1 time: 0.223977 Oct 04 21:58:10.663051 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1539/3165] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 21:58:10 2022] POST /compute/v2.1/servers/2764125d-9366-4c77-b1ee-7f188df21205/action => generated 0 bytes in 226 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:58:10.674003 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-f1df13a9-4d4f-4713-b03f-1dda8434a0c9 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:10.678456 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-f1df13a9-4d4f-4713-b03f-1dda8434a0c9 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] [instance: dad442d9-d2e1-49ee-93ea-6e5090634df8] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:10.699835 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f1df13a9-4d4f-4713-b03f-1dda8434a0c9 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:10.702766 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f1df13a9-4d4f-4713-b03f-1dda8434a0c9 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:10.704083 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f1df13a9-4d4f-4713-b03f-1dda8434a0c9 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:10.705185 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f1df13a9-4d4f-4713-b03f-1dda8434a0c9 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:10.708406 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f1df13a9-4d4f-4713-b03f-1dda8434a0c9 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:10.709196 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f1df13a9-4d4f-4713-b03f-1dda8434a0c9 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:10.847953 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-f37b72ef-158c-431d-80d5-bd2f8237d961 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:10.859151 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-f37b72ef-158c-431d-80d5-bd2f8237d961 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:10.861602 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-f37b72ef-158c-431d-80d5-bd2f8237d961 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:10.879791 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-f37b72ef-158c-431d-80d5-bd2f8237d961 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] 10.222.0.43 "GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984" status: 200 len: 1531 microversion: 2.91 time: 0.296976 Oct 04 21:58:10.882733 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1627/3166] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:58:10 2022] GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984 => generated 1531 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:58:10.902214 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-8f9e9083-5d30-466f-81b5-ab54d34daf50 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:10.903114 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-8f9e9083-5d30-466f-81b5-ab54d34daf50 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] [instance: 2764125d-9366-4c77-b1ee-7f188df21205] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:10.909695 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8f9e9083-5d30-466f-81b5-ab54d34daf50 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:10.910500 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8f9e9083-5d30-466f-81b5-ab54d34daf50 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:10.911096 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8f9e9083-5d30-466f-81b5-ab54d34daf50 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:10.911981 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8f9e9083-5d30-466f-81b5-ab54d34daf50 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:10.918047 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8f9e9083-5d30-466f-81b5-ab54d34daf50 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:10.918746 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8f9e9083-5d30-466f-81b5-ab54d34daf50 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:11.068149 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-f1df13a9-4d4f-4713-b03f-1dda8434a0c9 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e807c724cc4c3887a2d360f0584ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40071e45805146529fb8abd40629c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:11.078153 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-f1df13a9-4d4f-4713-b03f-1dda8434a0c9 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] 10.222.0.43 "GET /compute/v2.1/servers/dad442d9-d2e1-49ee-93ea-6e5090634df8" status: 200 len: 1497 microversion: 2.1 time: 0.412524 Oct 04 21:58:11.081765 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1540/3167] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:58:10 2022] GET /compute/v2.1/servers/dad442d9-d2e1-49ee-93ea-6e5090634df8 => generated 1497 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:58:11.149263 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=2 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:58:11.233050 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-2cd9d890-a68c-4dad-9e1a-b6a9515e234f tempest-UnshelveToHostMultiNodesTest-2056876790 tempest-UnshelveToHostMultiNodesTest-2056876790-project-admin] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:11.233659 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-2cd9d890-a68c-4dad-9e1a-b6a9515e234f tempest-UnshelveToHostMultiNodesTest-2056876790 tempest-UnshelveToHostMultiNodesTest-2056876790-project-admin] [instance: d0b1b757-4a4d-4a7a-9a06-08f178a02984] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:11.242025 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2cd9d890-a68c-4dad-9e1a-b6a9515e234f tempest-UnshelveToHostMultiNodesTest-2056876790 tempest-UnshelveToHostMultiNodesTest-2056876790-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:11.242553 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2cd9d890-a68c-4dad-9e1a-b6a9515e234f tempest-UnshelveToHostMultiNodesTest-2056876790 tempest-UnshelveToHostMultiNodesTest-2056876790-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:11.248938 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2cd9d890-a68c-4dad-9e1a-b6a9515e234f tempest-UnshelveToHostMultiNodesTest-2056876790 tempest-UnshelveToHostMultiNodesTest-2056876790-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:11.249985 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2cd9d890-a68c-4dad-9e1a-b6a9515e234f tempest-UnshelveToHostMultiNodesTest-2056876790 tempest-UnshelveToHostMultiNodesTest-2056876790-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:11.251061 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2cd9d890-a68c-4dad-9e1a-b6a9515e234f tempest-UnshelveToHostMultiNodesTest-2056876790 tempest-UnshelveToHostMultiNodesTest-2056876790-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:11.251503 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2cd9d890-a68c-4dad-9e1a-b6a9515e234f tempest-UnshelveToHostMultiNodesTest-2056876790 tempest-UnshelveToHostMultiNodesTest-2056876790-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:11.313639 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-8f9e9083-5d30-466f-81b5-ab54d34daf50 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c386b2ed7064073944085bf2a41f0de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d23c1f5719481483f4a28b76e45514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:11.323824 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-8f9e9083-5d30-466f-81b5-ab54d34daf50 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] 10.222.0.43 "GET /compute/v2.1/servers/2764125d-9366-4c77-b1ee-7f188df21205" status: 200 len: 1499 microversion: 2.1 time: 0.439334 Oct 04 21:58:11.324129 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1628/3168] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:58:10 2022] GET /compute/v2.1/servers/2764125d-9366-4c77-b1ee-7f188df21205 => generated 1499 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:58:11.336979 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-8230c83d-2f25-4ddd-baed-0dec0d18b7f9 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:11.340843 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-8230c83d-2f25-4ddd-baed-0dec0d18b7f9 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] [instance: 7618c19f-d7bb-4f37-8454-76570009eb30] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:11.356197 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8230c83d-2f25-4ddd-baed-0dec0d18b7f9 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:11.356700 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8230c83d-2f25-4ddd-baed-0dec0d18b7f9 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:11.357140 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8230c83d-2f25-4ddd-baed-0dec0d18b7f9 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:11.357859 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8230c83d-2f25-4ddd-baed-0dec0d18b7f9 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:11.358314 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8230c83d-2f25-4ddd-baed-0dec0d18b7f9 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:11.358769 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8230c83d-2f25-4ddd-baed-0dec0d18b7f9 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:11.374752 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.objects.instance [None req-2cd9d890-a68c-4dad-9e1a-b6a9515e234f tempest-UnshelveToHostMultiNodesTest-2056876790 tempest-UnshelveToHostMultiNodesTest-2056876790-project-admin] Lazy-loading 'services' on Instance uuid d0b1b757-4a4d-4a7a-9a06-08f178a02984 {{(pid=134101) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:58:11.399808 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-2cd9d890-a68c-4dad-9e1a-b6a9515e234f tempest-UnshelveToHostMultiNodesTest-2056876790 tempest-UnshelveToHostMultiNodesTest-2056876790-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984" status: 200 len: 1936 microversion: 2.91 time: 0.316394 Oct 04 21:58:11.400364 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1541/3169] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:58:11 2022] GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984 => generated 1936 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:58:11.431532 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-732de40f-42ff-4cfd-a55a-33815e1221d6 tempest-UnshelveToHostMultiNodesTest-2056876790 tempest-UnshelveToHostMultiNodesTest-2056876790-project-admin] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:11.432907 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-732de40f-42ff-4cfd-a55a-33815e1221d6 tempest-UnshelveToHostMultiNodesTest-2056876790 tempest-UnshelveToHostMultiNodesTest-2056876790-project-admin] [instance: d0b1b757-4a4d-4a7a-9a06-08f178a02984] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:11.442725 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-732de40f-42ff-4cfd-a55a-33815e1221d6 tempest-UnshelveToHostMultiNodesTest-2056876790 tempest-UnshelveToHostMultiNodesTest-2056876790-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:11.444232 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-732de40f-42ff-4cfd-a55a-33815e1221d6 tempest-UnshelveToHostMultiNodesTest-2056876790 tempest-UnshelveToHostMultiNodesTest-2056876790-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:11.444966 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-732de40f-42ff-4cfd-a55a-33815e1221d6 tempest-UnshelveToHostMultiNodesTest-2056876790 tempest-UnshelveToHostMultiNodesTest-2056876790-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:11.446046 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-732de40f-42ff-4cfd-a55a-33815e1221d6 tempest-UnshelveToHostMultiNodesTest-2056876790 tempest-UnshelveToHostMultiNodesTest-2056876790-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:11.446941 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-732de40f-42ff-4cfd-a55a-33815e1221d6 tempest-UnshelveToHostMultiNodesTest-2056876790 tempest-UnshelveToHostMultiNodesTest-2056876790-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:11.447579 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-732de40f-42ff-4cfd-a55a-33815e1221d6 tempest-UnshelveToHostMultiNodesTest-2056876790 tempest-UnshelveToHostMultiNodesTest-2056876790-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:11.640184 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.objects.instance [None req-732de40f-42ff-4cfd-a55a-33815e1221d6 tempest-UnshelveToHostMultiNodesTest-2056876790 tempest-UnshelveToHostMultiNodesTest-2056876790-project-admin] Lazy-loading 'services' on Instance uuid d0b1b757-4a4d-4a7a-9a06-08f178a02984 {{(pid=134101) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:58:11.668230 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-732de40f-42ff-4cfd-a55a-33815e1221d6 tempest-UnshelveToHostMultiNodesTest-2056876790 tempest-UnshelveToHostMultiNodesTest-2056876790-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984" status: 200 len: 1936 microversion: 2.91 time: 0.241754 Oct 04 21:58:11.678890 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1542/3170] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:58:11 2022] GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984 => generated 1936 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:58:11.681537 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-8230c83d-2f25-4ddd-baed-0dec0d18b7f9 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a94113bec89469a844ede34890d6876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857b9057c949472b9a1862182a01356c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:11.701452 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-8230c83d-2f25-4ddd-baed-0dec0d18b7f9 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] 10.222.0.43 "GET /compute/v2.1/servers/7618c19f-d7bb-4f37-8454-76570009eb30" status: 200 len: 1317 microversion: 2.1 time: 0.371202 Oct 04 21:58:11.702068 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-9af03130-79e4-40f5-9019-bdad0679a148 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:11.702903 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-9af03130-79e4-40f5-9019-bdad0679a148 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] [instance: 830de6ad-adc6-4d16-ae9d-a29ae85e6cd2] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:11.707800 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1629/3171] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:58:11 2022] GET /compute/v2.1/servers/7618c19f-d7bb-4f37-8454-76570009eb30 => generated 1317 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:58:11.710171 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9af03130-79e4-40f5-9019-bdad0679a148 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:11.711754 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9af03130-79e4-40f5-9019-bdad0679a148 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:11.712402 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9af03130-79e4-40f5-9019-bdad0679a148 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:11.713329 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9af03130-79e4-40f5-9019-bdad0679a148 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:11.713965 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9af03130-79e4-40f5-9019-bdad0679a148 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:11.717631 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9af03130-79e4-40f5-9019-bdad0679a148 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:11.720469 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-7e7f78d1-8e5b-46d2-b886-b2a6dda10820 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:11.721372 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-7e7f78d1-8e5b-46d2-b886-b2a6dda10820 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: dd1b7876-cc6f-4ed3-a0e4-cfe2213b332f] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:11.737015 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7e7f78d1-8e5b-46d2-b886-b2a6dda10820 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:11.741698 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7e7f78d1-8e5b-46d2-b886-b2a6dda10820 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:11.742315 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7e7f78d1-8e5b-46d2-b886-b2a6dda10820 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:11.743238 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7e7f78d1-8e5b-46d2-b886-b2a6dda10820 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:11.743808 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7e7f78d1-8e5b-46d2-b886-b2a6dda10820 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:11.744491 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7e7f78d1-8e5b-46d2-b886-b2a6dda10820 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:12.211266 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-9af03130-79e4-40f5-9019-bdad0679a148 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:12.223718 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-9af03130-79e4-40f5-9019-bdad0679a148 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:12.230082 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-9af03130-79e4-40f5-9019-bdad0679a148 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:12.232036 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-9af03130-79e4-40f5-9019-bdad0679a148 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] 10.222.0.43 "GET /compute/v2.1/servers/830de6ad-adc6-4d16-ae9d-a29ae85e6cd2" status: 200 len: 1604 microversion: 2.42 time: 0.533919 Oct 04 21:58:12.232812 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1543/3172] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:58:11 2022] GET /compute/v2.1/servers/830de6ad-adc6-4d16-ae9d-a29ae85e6cd2 => generated 1604 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:58:12.239310 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-f0226a28-f594-49cd-8d19-a90a6151c939 tempest-UnshelveToHostMultiNodesTest-2056876790 tempest-UnshelveToHostMultiNodesTest-2056876790-project-admin] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:12.243523 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f0226a28-f594-49cd-8d19-a90a6151c939 tempest-UnshelveToHostMultiNodesTest-2056876790 tempest-UnshelveToHostMultiNodesTest-2056876790-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:12.244524 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f0226a28-f594-49cd-8d19-a90a6151c939 tempest-UnshelveToHostMultiNodesTest-2056876790 tempest-UnshelveToHostMultiNodesTest-2056876790-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:12.245203 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f0226a28-f594-49cd-8d19-a90a6151c939 tempest-UnshelveToHostMultiNodesTest-2056876790 tempest-UnshelveToHostMultiNodesTest-2056876790-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:12.246301 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f0226a28-f594-49cd-8d19-a90a6151c939 tempest-UnshelveToHostMultiNodesTest-2056876790 tempest-UnshelveToHostMultiNodesTest-2056876790-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:12.247278 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f0226a28-f594-49cd-8d19-a90a6151c939 tempest-UnshelveToHostMultiNodesTest-2056876790 tempest-UnshelveToHostMultiNodesTest-2056876790-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:12.247900 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f0226a28-f594-49cd-8d19-a90a6151c939 tempest-UnshelveToHostMultiNodesTest-2056876790 tempest-UnshelveToHostMultiNodesTest-2056876790-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:12.284345 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-f0226a28-f594-49cd-8d19-a90a6151c939 tempest-UnshelveToHostMultiNodesTest-2056876790 tempest-UnshelveToHostMultiNodesTest-2056876790-project-admin] 10.222.0.43 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 498 microversion: 2.91 time: 0.050242 Oct 04 21:58:12.294621 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1544/3173] 10.222.0.43 () {60 vars in 1217 bytes} [Tue Oct 4 21:58:12 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 498 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:58:12.304829 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-bfc4dcfa-db98-43a1-87d9-597794e35b45 req-7ce63387-3639-480e-94d5-b7b92d233f43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7618c19f-d7bb-4f37-8454-76570009eb30", "name": "network-vif-plugged", "status": "completed", "tag": "91e0e68c-517b-4d17-839d-fdcdae7c269b"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:58:12.317550 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-bfc4dcfa-db98-43a1-87d9-597794e35b45 req-7ce63387-3639-480e-94d5-b7b92d233f43 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:12.318051 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-bfc4dcfa-db98-43a1-87d9-597794e35b45 req-7ce63387-3639-480e-94d5-b7b92d233f43 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:12.318537 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-bfc4dcfa-db98-43a1-87d9-597794e35b45 req-7ce63387-3639-480e-94d5-b7b92d233f43 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:12.337325 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-bfc4dcfa-db98-43a1-87d9-597794e35b45 req-7ce63387-3639-480e-94d5-b7b92d233f43 service nova] Creating event network-vif-plugged:91e0e68c-517b-4d17-839d-fdcdae7c269b for instance 7618c19f-d7bb-4f37-8454-76570009eb30 on n-h2-860284-1 Oct 04 21:58:12.343492 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-bfc4dcfa-db98-43a1-87d9-597794e35b45 req-7ce63387-3639-480e-94d5-b7b92d233f43 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047570 Oct 04 21:58:12.344796 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1545/3174] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:58:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:58:12.351186 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-3fe1868a-87c1-41e5-862a-9ddad0a8791b tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:12.351895 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-3fe1868a-87c1-41e5-862a-9ddad0a8791b tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] [instance: dad442d9-d2e1-49ee-93ea-6e5090634df8] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:12.360575 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3fe1868a-87c1-41e5-862a-9ddad0a8791b tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:12.361076 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3fe1868a-87c1-41e5-862a-9ddad0a8791b tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:12.361522 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3fe1868a-87c1-41e5-862a-9ddad0a8791b tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:12.362238 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3fe1868a-87c1-41e5-862a-9ddad0a8791b tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:12.362798 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3fe1868a-87c1-41e5-862a-9ddad0a8791b tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:12.363233 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3fe1868a-87c1-41e5-862a-9ddad0a8791b tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:12.392948 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:58:12.655543 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-7e7f78d1-8e5b-46d2-b886-b2a6dda10820 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2facee4c6a40416e908083e126d2cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07a17a482a4e92b6ddbdee463c8029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:12.668288 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-7e7f78d1-8e5b-46d2-b886-b2a6dda10820 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/dd1b7876-cc6f-4ed3-a0e4-cfe2213b332f" status: 200 len: 1511 microversion: 2.1 time: 0.959210 Oct 04 21:58:12.676024 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1630/3175] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:58:11 2022] GET /compute/v2.1/servers/dd1b7876-cc6f-4ed3-a0e4-cfe2213b332f => generated 1511 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:58:12.706511 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-721e4132-92cc-4643-83fc-6b5fd0490638 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:58:12.708739 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-721e4132-92cc-4643-83fc-6b5fd0490638 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] [instance: d0b1b757-4a4d-4a7a-9a06-08f178a02984] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:12.723972 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-721e4132-92cc-4643-83fc-6b5fd0490638 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:12.724805 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-721e4132-92cc-4643-83fc-6b5fd0490638 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:12.729770 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-721e4132-92cc-4643-83fc-6b5fd0490638 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:12.730992 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-721e4132-92cc-4643-83fc-6b5fd0490638 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:12.733451 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-721e4132-92cc-4643-83fc-6b5fd0490638 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:12.734115 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-721e4132-92cc-4643-83fc-6b5fd0490638 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:12.783530 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.objects.instance [None req-721e4132-92cc-4643-83fc-6b5fd0490638 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lazy-loading 'flavor' on Instance uuid d0b1b757-4a4d-4a7a-9a06-08f178a02984 {{(pid=134102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:58:12.802278 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=8 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:58:12.925213 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-3fe1868a-87c1-41e5-862a-9ddad0a8791b tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e807c724cc4c3887a2d360f0584ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40071e45805146529fb8abd40629c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:12.962562 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-3fe1868a-87c1-41e5-862a-9ddad0a8791b tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] 10.222.0.43 "GET /compute/v2.1/servers/dad442d9-d2e1-49ee-93ea-6e5090634df8" status: 200 len: 1497 microversion: 2.1 time: 0.616326 Oct 04 21:58:12.963183 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1546/3176] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:58:12 2022] GET /compute/v2.1/servers/dad442d9-d2e1-49ee-93ea-6e5090634df8 => generated 1497 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:58:12.986008 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-ada37799-d8c7-479f-9021-3bb06e9de196 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:12.987089 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-ada37799-d8c7-479f-9021-3bb06e9de196 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] [instance: 2764125d-9366-4c77-b1ee-7f188df21205] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:13.014731 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ada37799-d8c7-479f-9021-3bb06e9de196 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:13.016616 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ada37799-d8c7-479f-9021-3bb06e9de196 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:13.017074 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ada37799-d8c7-479f-9021-3bb06e9de196 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:13.020787 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ada37799-d8c7-479f-9021-3bb06e9de196 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:13.021342 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ada37799-d8c7-479f-9021-3bb06e9de196 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:13.021783 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ada37799-d8c7-479f-9021-3bb06e9de196 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:13.300679 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-721e4132-92cc-4643-83fc-6b5fd0490638 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] 10.222.0.43 "POST /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984/action" status: 202 len: 0 microversion: 2.91 time: 0.597465 Oct 04 21:58:13.304028 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1631/3177] 10.222.0.43 () {62 vars in 1319 bytes} [Tue Oct 4 21:58:12 2022] POST /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984/action => generated 0 bytes in 627 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:58:13.325509 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-01921b78-4956-450c-bf09-de59d913eab3 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:13.330884 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-01921b78-4956-450c-bf09-de59d913eab3 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] [instance: 7618c19f-d7bb-4f37-8454-76570009eb30] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:13.348139 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-01921b78-4956-450c-bf09-de59d913eab3 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:13.348844 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-01921b78-4956-450c-bf09-de59d913eab3 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:13.349468 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-01921b78-4956-450c-bf09-de59d913eab3 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:13.354760 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-01921b78-4956-450c-bf09-de59d913eab3 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:13.355532 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-01921b78-4956-450c-bf09-de59d913eab3 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:13.356321 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-01921b78-4956-450c-bf09-de59d913eab3 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:13.477540 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-ada37799-d8c7-479f-9021-3bb06e9de196 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c386b2ed7064073944085bf2a41f0de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d23c1f5719481483f4a28b76e45514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:13.487222 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-ada37799-d8c7-479f-9021-3bb06e9de196 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] 10.222.0.43 "GET /compute/v2.1/servers/2764125d-9366-4c77-b1ee-7f188df21205" status: 200 len: 1499 microversion: 2.1 time: 0.519905 Oct 04 21:58:13.489216 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1547/3178] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:58:12 2022] GET /compute/v2.1/servers/2764125d-9366-4c77-b1ee-7f188df21205 => generated 1499 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:58:13.494504 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-0f967c9b-74ec-4220-8afe-ea3c48d2a74f tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:13.495323 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-0f967c9b-74ec-4220-8afe-ea3c48d2a74f tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] [instance: 830de6ad-adc6-4d16-ae9d-a29ae85e6cd2] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:13.508331 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0f967c9b-74ec-4220-8afe-ea3c48d2a74f tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:13.509084 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0f967c9b-74ec-4220-8afe-ea3c48d2a74f tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:13.509681 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0f967c9b-74ec-4220-8afe-ea3c48d2a74f tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:13.510607 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0f967c9b-74ec-4220-8afe-ea3c48d2a74f tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:13.511218 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0f967c9b-74ec-4220-8afe-ea3c48d2a74f tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:13.511799 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0f967c9b-74ec-4220-8afe-ea3c48d2a74f tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:13.723089 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-0f967c9b-74ec-4220-8afe-ea3c48d2a74f tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:13.739960 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-0f967c9b-74ec-4220-8afe-ea3c48d2a74f tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:13.742011 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-0f967c9b-74ec-4220-8afe-ea3c48d2a74f tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:13.745827 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-0f967c9b-74ec-4220-8afe-ea3c48d2a74f tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] 10.222.0.43 "GET /compute/v2.1/servers/830de6ad-adc6-4d16-ae9d-a29ae85e6cd2" status: 200 len: 1604 microversion: 2.42 time: 0.255246 Oct 04 21:58:13.746657 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1548/3179] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:58:13 2022] GET /compute/v2.1/servers/830de6ad-adc6-4d16-ae9d-a29ae85e6cd2 => generated 1604 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:58:13.755783 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-a8cb2e12-c9be-4a24-8848-2ea67ee8b864 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:13.755987 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-a8cb2e12-c9be-4a24-8848-2ea67ee8b864 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] [instance: d0b1b757-4a4d-4a7a-9a06-08f178a02984] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:13.757762 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:58:13.776468 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a8cb2e12-c9be-4a24-8848-2ea67ee8b864 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:13.779015 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a8cb2e12-c9be-4a24-8848-2ea67ee8b864 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:13.779502 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a8cb2e12-c9be-4a24-8848-2ea67ee8b864 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:13.780388 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a8cb2e12-c9be-4a24-8848-2ea67ee8b864 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:13.780836 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a8cb2e12-c9be-4a24-8848-2ea67ee8b864 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:13.781268 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a8cb2e12-c9be-4a24-8848-2ea67ee8b864 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:13.964287 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-01921b78-4956-450c-bf09-de59d913eab3 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a94113bec89469a844ede34890d6876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857b9057c949472b9a1862182a01356c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:13.973335 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-01921b78-4956-450c-bf09-de59d913eab3 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] 10.222.0.43 "GET /compute/v2.1/servers/7618c19f-d7bb-4f37-8454-76570009eb30" status: 200 len: 1317 microversion: 2.1 time: 0.665913 Oct 04 21:58:13.974051 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1632/3180] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:58:13 2022] GET /compute/v2.1/servers/7618c19f-d7bb-4f37-8454-76570009eb30 => generated 1317 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:58:14.000932 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-83cd6e16-2a67-4150-be68-c775a1ffe761 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:14.002022 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-83cd6e16-2a67-4150-be68-c775a1ffe761 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: dd1b7876-cc6f-4ed3-a0e4-cfe2213b332f] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:14.032720 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-83cd6e16-2a67-4150-be68-c775a1ffe761 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:14.033524 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-83cd6e16-2a67-4150-be68-c775a1ffe761 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:14.034127 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-83cd6e16-2a67-4150-be68-c775a1ffe761 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:14.035082 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-83cd6e16-2a67-4150-be68-c775a1ffe761 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:14.035696 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-83cd6e16-2a67-4150-be68-c775a1ffe761 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:14.036280 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-83cd6e16-2a67-4150-be68-c775a1ffe761 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:14.057785 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-a8cb2e12-c9be-4a24-8848-2ea67ee8b864 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:14.093509 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-a8cb2e12-c9be-4a24-8848-2ea67ee8b864 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:14.108284 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-a8cb2e12-c9be-4a24-8848-2ea67ee8b864 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:14.144140 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-a8cb2e12-c9be-4a24-8848-2ea67ee8b864 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] 10.222.0.43 "GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984" status: 200 len: 1537 microversion: 2.91 time: 0.396577 Oct 04 21:58:14.144755 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1549/3181] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:58:13 2022] GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984 => generated 1537 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:58:14.175405 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-78c52f47-bfa5-40c4-a56c-6aee0998f8b2 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:14.175941 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-78c52f47-bfa5-40c4-a56c-6aee0998f8b2 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] [instance: dad442d9-d2e1-49ee-93ea-6e5090634df8] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:14.204237 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-78c52f47-bfa5-40c4-a56c-6aee0998f8b2 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:14.204739 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-78c52f47-bfa5-40c4-a56c-6aee0998f8b2 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:14.205171 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-78c52f47-bfa5-40c4-a56c-6aee0998f8b2 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:14.215385 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-78c52f47-bfa5-40c4-a56c-6aee0998f8b2 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:14.215765 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-78c52f47-bfa5-40c4-a56c-6aee0998f8b2 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:14.216217 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-78c52f47-bfa5-40c4-a56c-6aee0998f8b2 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:14.327489 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-83cd6e16-2a67-4150-be68-c775a1ffe761 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2facee4c6a40416e908083e126d2cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07a17a482a4e92b6ddbdee463c8029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:14.344787 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-83cd6e16-2a67-4150-be68-c775a1ffe761 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/dd1b7876-cc6f-4ed3-a0e4-cfe2213b332f" status: 200 len: 1469 microversion: 2.1 time: 0.354632 Oct 04 21:58:14.367337 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1633/3182] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:58:13 2022] GET /compute/v2.1/servers/dd1b7876-cc6f-4ed3-a0e4-cfe2213b332f => generated 1469 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:58:14.378805 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-2192d086-dd45-40d6-8813-871eb94577ba req-a1d0744d-df7a-4b5a-ae0d-722b2962bc10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd1b7876-cc6f-4ed3-a0e4-cfe2213b332f", "name": "network-vif-deleted", "tag": "16eb228b-5e10-4075-98df-9813f88f893f"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:58:14.408286 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-2192d086-dd45-40d6-8813-871eb94577ba req-a1d0744d-df7a-4b5a-ae0d-722b2962bc10 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:14.408781 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-2192d086-dd45-40d6-8813-871eb94577ba req-a1d0744d-df7a-4b5a-ae0d-722b2962bc10 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:14.409216 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-2192d086-dd45-40d6-8813-871eb94577ba req-a1d0744d-df7a-4b5a-ae0d-722b2962bc10 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:14.445096 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-2192d086-dd45-40d6-8813-871eb94577ba req-a1d0744d-df7a-4b5a-ae0d-722b2962bc10 service nova] Creating event network-vif-deleted:16eb228b-5e10-4075-98df-9813f88f893f for instance dd1b7876-cc6f-4ed3-a0e4-cfe2213b332f on n-h1-860284-1 Oct 04 21:58:14.460261 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-2192d086-dd45-40d6-8813-871eb94577ba req-a1d0744d-df7a-4b5a-ae0d-722b2962bc10 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091199 Oct 04 21:58:14.461206 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1634/3183] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:58:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:58:14.487951 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-4fcb45c7-c67d-4d4a-a133-2bb6c7575fca req-ba2f63ed-e2ea-4497-8c06-f1cfa099f8d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd1b7876-cc6f-4ed3-a0e4-cfe2213b332f", "name": "network-vif-unplugged", "status": "completed", "tag": "16eb228b-5e10-4075-98df-9813f88f893f"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:58:14.511940 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-4fcb45c7-c67d-4d4a-a133-2bb6c7575fca req-ba2f63ed-e2ea-4497-8c06-f1cfa099f8d1 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:14.516655 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-4fcb45c7-c67d-4d4a-a133-2bb6c7575fca req-ba2f63ed-e2ea-4497-8c06-f1cfa099f8d1 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:14.517465 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-4fcb45c7-c67d-4d4a-a133-2bb6c7575fca req-ba2f63ed-e2ea-4497-8c06-f1cfa099f8d1 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:14.546131 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-4fcb45c7-c67d-4d4a-a133-2bb6c7575fca req-ba2f63ed-e2ea-4497-8c06-f1cfa099f8d1 service nova] Creating event network-vif-unplugged:16eb228b-5e10-4075-98df-9813f88f893f for instance dd1b7876-cc6f-4ed3-a0e4-cfe2213b332f on n-h1-860284-1 Oct 04 21:58:14.564556 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-4fcb45c7-c67d-4d4a-a133-2bb6c7575fca req-ba2f63ed-e2ea-4497-8c06-f1cfa099f8d1 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.096570 Oct 04 21:58:14.565526 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1635/3184] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:58:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:58:14.573518 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-f179a1c1-a147-4d74-a992-313ebecb7e88 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:14.578006 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-f179a1c1-a147-4d74-a992-313ebecb7e88 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] [instance: 2764125d-9366-4c77-b1ee-7f188df21205] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:14.595378 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-78c52f47-bfa5-40c4-a56c-6aee0998f8b2 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e807c724cc4c3887a2d360f0584ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40071e45805146529fb8abd40629c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:14.599167 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f179a1c1-a147-4d74-a992-313ebecb7e88 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:14.599774 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f179a1c1-a147-4d74-a992-313ebecb7e88 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:14.602999 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f179a1c1-a147-4d74-a992-313ebecb7e88 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:14.603739 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f179a1c1-a147-4d74-a992-313ebecb7e88 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:14.607618 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-78c52f47-bfa5-40c4-a56c-6aee0998f8b2 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] 10.222.0.43 "GET /compute/v2.1/servers/dad442d9-d2e1-49ee-93ea-6e5090634df8" status: 200 len: 1474 microversion: 2.1 time: 0.461420 Oct 04 21:58:14.622915 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1550/3185] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:58:14 2022] GET /compute/v2.1/servers/dad442d9-d2e1-49ee-93ea-6e5090634df8 => generated 1474 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:58:14.623034 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f179a1c1-a147-4d74-a992-313ebecb7e88 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:14.623034 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f179a1c1-a147-4d74-a992-313ebecb7e88 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:14.641592 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-fd575ae9-6d76-44de-9b99-6504949fba80 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1209584991"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:58:14.644128 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-fd575ae9-6d76-44de-9b99-6504949fba80 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] [instance: dad442d9-d2e1-49ee-93ea-6e5090634df8] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:14.661773 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fd575ae9-6d76-44de-9b99-6504949fba80 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:14.662273 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fd575ae9-6d76-44de-9b99-6504949fba80 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:14.665081 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fd575ae9-6d76-44de-9b99-6504949fba80 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:14.666491 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fd575ae9-6d76-44de-9b99-6504949fba80 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:14.668420 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fd575ae9-6d76-44de-9b99-6504949fba80 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:14.669363 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fd575ae9-6d76-44de-9b99-6504949fba80 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:14.883092 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-f179a1c1-a147-4d74-a992-313ebecb7e88 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c386b2ed7064073944085bf2a41f0de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d23c1f5719481483f4a28b76e45514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:14.893169 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-f179a1c1-a147-4d74-a992-313ebecb7e88 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] 10.222.0.43 "GET /compute/v2.1/servers/2764125d-9366-4c77-b1ee-7f188df21205" status: 200 len: 1499 microversion: 2.1 time: 0.326194 Oct 04 21:58:14.894425 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1636/3186] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:58:14 2022] GET /compute/v2.1/servers/2764125d-9366-4c77-b1ee-7f188df21205 => generated 1499 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:58:14.898764 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-389de870-f861-4560-8bd6-6f6d2f4c2c49 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:14.899760 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-389de870-f861-4560-8bd6-6f6d2f4c2c49 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] [instance: 830de6ad-adc6-4d16-ae9d-a29ae85e6cd2] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:14.905184 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_api:SELECT=100 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:58:14.907310 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-389de870-f861-4560-8bd6-6f6d2f4c2c49 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:14.907838 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-389de870-f861-4560-8bd6-6f6d2f4c2c49 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:14.908442 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-389de870-f861-4560-8bd6-6f6d2f4c2c49 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:14.909312 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-389de870-f861-4560-8bd6-6f6d2f4c2c49 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:14.909973 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-389de870-f861-4560-8bd6-6f6d2f4c2c49 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:14.910594 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-389de870-f861-4560-8bd6-6f6d2f4c2c49 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:15.028302 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-389de870-f861-4560-8bd6-6f6d2f4c2c49 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:15.044104 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-389de870-f861-4560-8bd6-6f6d2f4c2c49 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:15.045607 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-389de870-f861-4560-8bd6-6f6d2f4c2c49 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:15.051092 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-389de870-f861-4560-8bd6-6f6d2f4c2c49 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] 10.222.0.43 "GET /compute/v2.1/servers/830de6ad-adc6-4d16-ae9d-a29ae85e6cd2" status: 200 len: 1604 microversion: 2.42 time: 0.156164 Oct 04 21:58:15.051893 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1637/3187] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:58:14 2022] GET /compute/v2.1/servers/830de6ad-adc6-4d16-ae9d-a29ae85e6cd2 => generated 1604 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:58:15.112250 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-fd575ae9-6d76-44de-9b99-6504949fba80 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] 10.222.0.43 "POST /compute/v2.1/servers/dad442d9-d2e1-49ee-93ea-6e5090634df8/action" status: 202 len: 0 microversion: 2.1 time: 0.481313 Oct 04 21:58:15.120607 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1551/3188] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 21:58:14 2022] POST /compute/v2.1/servers/dad442d9-d2e1-49ee-93ea-6e5090634df8/action => generated 0 bytes in 492 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 04 21:58:15.134139 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-58dc21b8-4b13-4e1f-bc75-c33325be7183 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:15.134997 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-58dc21b8-4b13-4e1f-bc75-c33325be7183 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] [instance: 7618c19f-d7bb-4f37-8454-76570009eb30] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:15.151309 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-58dc21b8-4b13-4e1f-bc75-c33325be7183 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:15.153951 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-58dc21b8-4b13-4e1f-bc75-c33325be7183 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:15.155269 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-58dc21b8-4b13-4e1f-bc75-c33325be7183 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:15.158343 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-58dc21b8-4b13-4e1f-bc75-c33325be7183 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:15.159062 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-58dc21b8-4b13-4e1f-bc75-c33325be7183 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:15.159516 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-58dc21b8-4b13-4e1f-bc75-c33325be7183 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:15.176123 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-f4c25351-818e-4aab-9f09-783163aaf73d tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Action: 'create', calling method: .version_select at 0x7fbb2e779ee0>, body: {"keypair": {"name": "tempest-keypair-965634969", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHxyv2xDitm1r2jixt4O4VoWuD3TQH5A6X/lBtsKQS+0Vd4gKhbXVnWAOnWzfvkssiVxx31eJzh8oLSBdVacEZyp0QV/+Crbun8PU/OsY+Tsv86QcLH2FImhUCt24hNMNQ=="}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:58:15.216141 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-f4c25351-818e-4aab-9f09-783163aaf73d tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Getting quotas for project 3994b89cac594e309926f1eaf785f7d3. Resources: {'key_pairs'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:58:15.223592 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-f4c25351-818e-4aab-9f09-783163aaf73d tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Getting quotas for user 08c7a1e7d6984644a68d967b5e3fe92e and project 3994b89cac594e309926f1eaf785f7d3. Resources: {'key_pairs'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:58:15.302383 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-f4c25351-818e-4aab-9f09-783163aaf73d tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.247870 Oct 04 21:58:15.303812 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1638/3189] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Oct 4 21:58:15 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:58:15.327904 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-8e279892-9892-4316-b34c-2335b26ec378 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Calling method '.version_select at 0x7fbb2e5fdee0>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:15.420663 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-8e279892-9892-4316-b34c-2335b26ec378 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] 10.222.0.43 "GET /compute/v2.1/images/683538fe-4fde-450b-94cb-f14e6f8483a3" status: 200 len: 1410 microversion: 2.1 time: 0.112504 Oct 04 21:58:15.430753 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1639/3190] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:58:15 2022] GET /compute/v2.1/images/683538fe-4fde-450b-94cb-f14e6f8483a3 => generated 1410 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:58:15.468224 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-50e5f59f-e14f-4cfa-a81c-cf0a4f20d105 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:15.469032 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-50e5f59f-e14f-4cfa-a81c-cf0a4f20d105 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] [instance: d0b1b757-4a4d-4a7a-9a06-08f178a02984] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:15.499344 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-50e5f59f-e14f-4cfa-a81c-cf0a4f20d105 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:15.501794 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-50e5f59f-e14f-4cfa-a81c-cf0a4f20d105 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:15.503516 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-50e5f59f-e14f-4cfa-a81c-cf0a4f20d105 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:15.507920 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-50e5f59f-e14f-4cfa-a81c-cf0a4f20d105 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:15.514219 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-50e5f59f-e14f-4cfa-a81c-cf0a4f20d105 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:15.518266 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-50e5f59f-e14f-4cfa-a81c-cf0a4f20d105 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:15.617458 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-58dc21b8-4b13-4e1f-bc75-c33325be7183 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a94113bec89469a844ede34890d6876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857b9057c949472b9a1862182a01356c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:15.627230 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-58dc21b8-4b13-4e1f-bc75-c33325be7183 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] 10.222.0.43 "GET /compute/v2.1/servers/7618c19f-d7bb-4f37-8454-76570009eb30" status: 200 len: 1505 microversion: 2.1 time: 0.505178 Oct 04 21:58:15.627894 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1552/3191] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:58:15 2022] GET /compute/v2.1/servers/7618c19f-d7bb-4f37-8454-76570009eb30 => generated 1505 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:58:15.656261 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-5a5feb90-2bb3-4608-ad8d-033b48c14271 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:15.658897 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-5a5feb90-2bb3-4608-ad8d-033b48c14271 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: dd1b7876-cc6f-4ed3-a0e4-cfe2213b332f] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:15.675149 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5a5feb90-2bb3-4608-ad8d-033b48c14271 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:15.675908 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5a5feb90-2bb3-4608-ad8d-033b48c14271 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:15.676587 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5a5feb90-2bb3-4608-ad8d-033b48c14271 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:15.683822 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-50e5f59f-e14f-4cfa-a81c-cf0a4f20d105 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:15.693771 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5a5feb90-2bb3-4608-ad8d-033b48c14271 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:15.694966 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5a5feb90-2bb3-4608-ad8d-033b48c14271 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:15.696816 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5a5feb90-2bb3-4608-ad8d-033b48c14271 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:15.701023 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-50e5f59f-e14f-4cfa-a81c-cf0a4f20d105 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:15.708826 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-50e5f59f-e14f-4cfa-a81c-cf0a4f20d105 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:15.729000 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-50e5f59f-e14f-4cfa-a81c-cf0a4f20d105 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] 10.222.0.43 "GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984" status: 200 len: 1537 microversion: 2.91 time: 0.281253 Oct 04 21:58:15.738404 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1640/3192] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:58:15 2022] GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984 => generated 1537 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:58:15.739542 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-4208d6df-5f5e-4ba6-bd04-557df71f64bc tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:15.746604 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-4208d6df-5f5e-4ba6-bd04-557df71f64bc tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] [instance: 563105fe-37b7-495e-88bd-d524aa2395db] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:15.755309 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4208d6df-5f5e-4ba6-bd04-557df71f64bc tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:15.755309 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4208d6df-5f5e-4ba6-bd04-557df71f64bc tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:15.755309 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4208d6df-5f5e-4ba6-bd04-557df71f64bc tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:15.755309 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4208d6df-5f5e-4ba6-bd04-557df71f64bc tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:15.755309 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4208d6df-5f5e-4ba6-bd04-557df71f64bc tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:15.755309 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4208d6df-5f5e-4ba6-bd04-557df71f64bc tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:15.779860 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5a5feb90-2bb3-4608-ad8d-033b48c14271 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:15.780657 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5a5feb90-2bb3-4608-ad8d-033b48c14271 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:15.782835 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5a5feb90-2bb3-4608-ad8d-033b48c14271 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:15.783365 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.objects.instance [None req-5a5feb90-2bb3-4608-ad8d-033b48c14271 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lazy-loading 'fault' on Instance uuid dd1b7876-cc6f-4ed3-a0e4-cfe2213b332f {{(pid=134101) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:58:15.926117 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-5a5feb90-2bb3-4608-ad8d-033b48c14271 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2facee4c6a40416e908083e126d2cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07a17a482a4e92b6ddbdee463c8029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:15.950484 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-5a5feb90-2bb3-4608-ad8d-033b48c14271 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/dd1b7876-cc6f-4ed3-a0e4-cfe2213b332f" status: 200 len: 1306 microversion: 2.1 time: 0.313385 Oct 04 21:58:15.971486 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1553/3193] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:58:15 2022] GET /compute/v2.1/servers/dd1b7876-cc6f-4ed3-a0e4-cfe2213b332f => generated 1306 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:58:15.971486 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-0b76536f-4385-40ce-8bf2-67b62880d1fc tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:15.971486 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-0b76536f-4385-40ce-8bf2-67b62880d1fc tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] [instance: 2764125d-9366-4c77-b1ee-7f188df21205] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:15.983662 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0b76536f-4385-40ce-8bf2-67b62880d1fc tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:15.984179 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0b76536f-4385-40ce-8bf2-67b62880d1fc tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:15.984836 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0b76536f-4385-40ce-8bf2-67b62880d1fc tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:15.985606 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0b76536f-4385-40ce-8bf2-67b62880d1fc tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:15.986076 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0b76536f-4385-40ce-8bf2-67b62880d1fc tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:15.986547 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0b76536f-4385-40ce-8bf2-67b62880d1fc tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:16.106179 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-4208d6df-5f5e-4ba6-bd04-557df71f64bc tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a94113bec89469a844ede34890d6876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857b9057c949472b9a1862182a01356c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:16.109087 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:58:16.125902 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-4208d6df-5f5e-4ba6-bd04-557df71f64bc tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] 10.222.0.43 "GET /compute/v2.1/servers/563105fe-37b7-495e-88bd-d524aa2395db" status: 200 len: 1317 microversion: 2.1 time: 0.393056 Oct 04 21:58:16.134961 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1641/3194] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:58:15 2022] GET /compute/v2.1/servers/563105fe-37b7-495e-88bd-d524aa2395db => generated 1317 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:58:16.159446 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-767e34fa-ff1d-4f31-8a94-01b7fdf6f835 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:16.162772 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-767e34fa-ff1d-4f31-8a94-01b7fdf6f835 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] [instance: 830de6ad-adc6-4d16-ae9d-a29ae85e6cd2] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:16.186757 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-767e34fa-ff1d-4f31-8a94-01b7fdf6f835 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:16.195654 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-767e34fa-ff1d-4f31-8a94-01b7fdf6f835 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:16.197544 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-767e34fa-ff1d-4f31-8a94-01b7fdf6f835 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:16.199036 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-767e34fa-ff1d-4f31-8a94-01b7fdf6f835 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:16.207007 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-767e34fa-ff1d-4f31-8a94-01b7fdf6f835 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:16.207624 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-767e34fa-ff1d-4f31-8a94-01b7fdf6f835 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:16.391911 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-767e34fa-ff1d-4f31-8a94-01b7fdf6f835 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:16.411938 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-767e34fa-ff1d-4f31-8a94-01b7fdf6f835 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:16.413811 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-767e34fa-ff1d-4f31-8a94-01b7fdf6f835 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:16.415241 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-767e34fa-ff1d-4f31-8a94-01b7fdf6f835 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] 10.222.0.43 "GET /compute/v2.1/servers/830de6ad-adc6-4d16-ae9d-a29ae85e6cd2" status: 200 len: 1604 microversion: 2.42 time: 0.278883 Oct 04 21:58:16.416288 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1642/3195] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:58:16 2022] GET /compute/v2.1/servers/830de6ad-adc6-4d16-ae9d-a29ae85e6cd2 => generated 1604 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:58:16.440958 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-06749cbe-6974-4d33-a6c1-2f16faf3d22b tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Calling method '.version_select at 0x7fbb2e76be50>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:16.499938 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-06749cbe-6974-4d33-a6c1-2f16faf3d22b tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] 10.222.0.43 "GET /compute/v2.1/images/683538fe-4fde-450b-94cb-f14e6f8483a3" status: 200 len: 1410 microversion: 2.1 time: 0.063255 Oct 04 21:58:16.514477 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1643/3196] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:58:16 2022] GET /compute/v2.1/images/683538fe-4fde-450b-94cb-f14e6f8483a3 => generated 1410 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:58:16.652750 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-0b76536f-4385-40ce-8bf2-67b62880d1fc tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c386b2ed7064073944085bf2a41f0de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d23c1f5719481483f4a28b76e45514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:16.665966 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-0b76536f-4385-40ce-8bf2-67b62880d1fc tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] 10.222.0.43 "GET /compute/v2.1/servers/2764125d-9366-4c77-b1ee-7f188df21205" status: 200 len: 1502 microversion: 2.1 time: 0.711565 Oct 04 21:58:16.667006 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1554/3197] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:58:15 2022] GET /compute/v2.1/servers/2764125d-9366-4c77-b1ee-7f188df21205 => generated 1502 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:58:16.692543 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-b24fc93a-b72a-4847-9948-4e6bae65d028 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:58:16.693279 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-b24fc93a-b72a-4847-9948-4e6bae65d028 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] [instance: 2764125d-9366-4c77-b1ee-7f188df21205] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:16.700370 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b24fc93a-b72a-4847-9948-4e6bae65d028 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:16.700775 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b24fc93a-b72a-4847-9948-4e6bae65d028 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:16.701258 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b24fc93a-b72a-4847-9948-4e6bae65d028 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:16.701977 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b24fc93a-b72a-4847-9948-4e6bae65d028 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:16.702461 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b24fc93a-b72a-4847-9948-4e6bae65d028 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:16.702889 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b24fc93a-b72a-4847-9948-4e6bae65d028 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:16.736591 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.objects.instance [None req-b24fc93a-b72a-4847-9948-4e6bae65d028 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Lazy-loading 'flavor' on Instance uuid 2764125d-9366-4c77-b1ee-7f188df21205 {{(pid=134102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:58:16.764017 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-d33a5fd8-6f51-40e1-a9a6-a2821583925b tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:16.764635 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-d33a5fd8-6f51-40e1-a9a6-a2821583925b tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] [instance: d0b1b757-4a4d-4a7a-9a06-08f178a02984] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:16.784039 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d33a5fd8-6f51-40e1-a9a6-a2821583925b tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:16.784884 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d33a5fd8-6f51-40e1-a9a6-a2821583925b tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:16.785496 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d33a5fd8-6f51-40e1-a9a6-a2821583925b tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:16.787102 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d33a5fd8-6f51-40e1-a9a6-a2821583925b tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:16.788963 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d33a5fd8-6f51-40e1-a9a6-a2821583925b tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:16.790813 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d33a5fd8-6f51-40e1-a9a6-a2821583925b tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:16.944920 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-b24fc93a-b72a-4847-9948-4e6bae65d028 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] 10.222.0.43 "POST /compute/v2.1/servers/2764125d-9366-4c77-b1ee-7f188df21205/action" status: 202 len: 0 microversion: 2.1 time: 0.252488 Oct 04 21:58:16.944920 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1644/3198] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 21:58:16 2022] POST /compute/v2.1/servers/2764125d-9366-4c77-b1ee-7f188df21205/action => generated 0 bytes in 255 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 21:58:16.950320 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-4239f4ee-1e66-4065-9a76-5306f720cfe8 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:16.951249 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-4239f4ee-1e66-4065-9a76-5306f720cfe8 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] [instance: 2764125d-9366-4c77-b1ee-7f188df21205] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:16.961587 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4239f4ee-1e66-4065-9a76-5306f720cfe8 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:16.962487 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4239f4ee-1e66-4065-9a76-5306f720cfe8 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:16.962819 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4239f4ee-1e66-4065-9a76-5306f720cfe8 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:16.964045 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4239f4ee-1e66-4065-9a76-5306f720cfe8 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:16.964830 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4239f4ee-1e66-4065-9a76-5306f720cfe8 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:16.965352 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4239f4ee-1e66-4065-9a76-5306f720cfe8 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:16.980249 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-d33a5fd8-6f51-40e1-a9a6-a2821583925b tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:16.995040 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-d33a5fd8-6f51-40e1-a9a6-a2821583925b tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:16.999864 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-d33a5fd8-6f51-40e1-a9a6-a2821583925b tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:17.013616 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-d33a5fd8-6f51-40e1-a9a6-a2821583925b tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] 10.222.0.43 "GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984" status: 200 len: 1537 microversion: 2.91 time: 0.254419 Oct 04 21:58:17.016971 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1555/3199] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:58:16 2022] GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984 => generated 1537 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:58:17.026019 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-164411c0-cbdc-403a-8ebb-3fe40fe141f0 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:17.027405 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-164411c0-cbdc-403a-8ebb-3fe40fe141f0 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: dd1b7876-cc6f-4ed3-a0e4-cfe2213b332f] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:17.057241 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-164411c0-cbdc-403a-8ebb-3fe40fe141f0 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:17.057737 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-164411c0-cbdc-403a-8ebb-3fe40fe141f0 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:17.058173 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-164411c0-cbdc-403a-8ebb-3fe40fe141f0 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:17.058925 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-164411c0-cbdc-403a-8ebb-3fe40fe141f0 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:17.059375 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-164411c0-cbdc-403a-8ebb-3fe40fe141f0 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:17.059823 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-164411c0-cbdc-403a-8ebb-3fe40fe141f0 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:17.077490 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-164411c0-cbdc-403a-8ebb-3fe40fe141f0 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] HTTP exception thrown: Instance dd1b7876-cc6f-4ed3-a0e4-cfe2213b332f could not be found. Oct 04 21:58:17.079227 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-164411c0-cbdc-403a-8ebb-3fe40fe141f0 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Request method failure captured: Oct 04 21:58:17.079227 n-d-860284-1 devstack@n-api.service[134101]: request: GET /compute/v2.1/servers/dd1b7876-cc6f-4ed3-a0e4-cfe2213b332f HTTP/1.1 Oct 04 21:58:17.079227 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 21:58:17.079227 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 21:58:17.079227 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 21:58:17.079227 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 21:58:17.079227 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 21:58:17.079227 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 21:58:17.079227 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 21:58:17.079227 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 21:58:17.079227 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPKwu4cpW6hhBuWb-qV_7iYlwjOTpf5XWCl53BJjoosjlcj4wkmmOFzemCJVdBntIx8zJ1SF_z6VrRY8UJr7E8TQDJCRnVQMdNnh0-lZwGdqUzjOWSO31Ryb6n87Cka0g238a21JWok3h3GEhLB-7oCbN3bbcOGmkhd6UFueRxRluk24 Oct 04 21:58:17.079227 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 21:58:17.079227 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 21:58:17.079227 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 21:58:17.079227 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 21:58:17.079227 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 21:58:17.079227 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 21:58:17.079227 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: cf07a17a482a4e92b6ddbdee463c8029 Oct 04 21:58:17.079227 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-ServersNegativeTestJSON-1933663319 Oct 04 21:58:17.079227 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 21:58:17.079227 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 21:58:17.079227 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/cf07a17a482a4e92b6ddbdee463c8029"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_cf07a17a482a4e92b6ddbdee463c8029", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/cf07a17a482a4e92b6ddbdee463c8029"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/cf07a17a482a4e92b6ddbdee463c8029"}]}] Oct 04 21:58:17.079227 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-ServersNegativeTestJSON-1933663319 Oct 04 21:58:17.079227 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: cf07a17a482a4e92b6ddbdee463c8029 Oct 04 21:58:17.079227 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1933663319 Oct 04 21:58:17.079227 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-ServersNegativeTestJSON-1933663319-project Oct 04 21:58:17.079227 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 21:58:17.079227 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 21:58:17.079227 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 2facee4c6a40416e908083e126d2cfa3 Oct 04 21:58:17.079227 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-ServersNegativeTestJSON-1933663319-project Oct 04 21:58:17.079227 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 21:58:17.079227 n-d-860284-1 devstack@n-api.service[134101]: exception: Instance dd1b7876-cc6f-4ed3-a0e4-cfe2213b332f could not be found. Oct 04 21:58:17.079227 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': 'dd1b7876-cc6f-4ed3-a0e4-cfe2213b332f'} Oct 04 21:58:17.079227 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:58:17.079227 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:58:17.079227 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:58:17.079227 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:58:17.079227 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:58:17.079227 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:58:17.079227 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:58:17.079227 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:58:17.079227 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:58:17.079227 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:58:17.079227 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd1b7876-cc6f-4ed3-a0e4-cfe2213b332f could not be found. Oct 04 21:58:17.079227 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:58:17.079227 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:58:17.079227 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:58:17.079227 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:58:17.079227 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:58:17.079227 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:58:17.079227 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:58:17.079227 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:58:17.079227 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:58:17.079227 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:58:17.079227 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:58:17.079227 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:58:17.079227 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:58:17.079227 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:58:17.079227 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:58:17.079227 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:58:17.079227 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd1b7876-cc6f-4ed3-a0e4-cfe2213b332f could not be found. Oct 04 21:58:17.079227 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:58:17.079227 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:58:17.079227 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:58:17.084537 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:58:17.084537 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:58:17.084537 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:58:17.084537 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:58:17.084537 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:58:17.084537 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd1b7876-cc6f-4ed3-a0e4-cfe2213b332f could not be found. Oct 04 21:58:17.084537 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:58:17.086248 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-164411c0-cbdc-403a-8ebb-3fe40fe141f0 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Returning 404 to user: Instance dd1b7876-cc6f-4ed3-a0e4-cfe2213b332f could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:58:17.087317 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-164411c0-cbdc-403a-8ebb-3fe40fe141f0 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/dd1b7876-cc6f-4ed3-a0e4-cfe2213b332f" status: 404 len: 111 microversion: 2.1 time: 0.069170 Oct 04 21:58:17.088385 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1556/3200] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:58:17 2022] GET /compute/v2.1/servers/dd1b7876-cc6f-4ed3-a0e4-cfe2213b332f => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:58:17.102117 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-60f512f0-73e7-4694-8320-ffd62e73baee tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:17.103017 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-60f512f0-73e7-4694-8320-ffd62e73baee tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: a4cf4fac-1e9b-4669-a6ff-30008ed3642d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:17.113739 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-60f512f0-73e7-4694-8320-ffd62e73baee tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:17.114569 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-60f512f0-73e7-4694-8320-ffd62e73baee tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:17.115298 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-60f512f0-73e7-4694-8320-ffd62e73baee tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:17.116208 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-60f512f0-73e7-4694-8320-ffd62e73baee tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:17.116845 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-60f512f0-73e7-4694-8320-ffd62e73baee tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:17.117439 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-60f512f0-73e7-4694-8320-ffd62e73baee tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:17.355334 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-4239f4ee-1e66-4065-9a76-5306f720cfe8 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c386b2ed7064073944085bf2a41f0de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d23c1f5719481483f4a28b76e45514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:17.369805 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-4239f4ee-1e66-4065-9a76-5306f720cfe8 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] 10.222.0.43 "GET /compute/v2.1/servers/2764125d-9366-4c77-b1ee-7f188df21205" status: 200 len: 1510 microversion: 2.1 time: 0.423574 Oct 04 21:58:17.371571 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1645/3201] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:58:16 2022] GET /compute/v2.1/servers/2764125d-9366-4c77-b1ee-7f188df21205 => generated 1510 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:58:17.387397 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-25cbed5d-3841-4301-b934-1f95847f9052 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:17.389448 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-25cbed5d-3841-4301-b934-1f95847f9052 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] [instance: 563105fe-37b7-495e-88bd-d524aa2395db] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:17.403254 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-25cbed5d-3841-4301-b934-1f95847f9052 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:17.404026 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-25cbed5d-3841-4301-b934-1f95847f9052 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:17.405516 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-25cbed5d-3841-4301-b934-1f95847f9052 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:17.408052 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-25cbed5d-3841-4301-b934-1f95847f9052 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:17.409949 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-25cbed5d-3841-4301-b934-1f95847f9052 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:17.410918 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-25cbed5d-3841-4301-b934-1f95847f9052 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:17.420711 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-60f512f0-73e7-4694-8320-ffd62e73baee tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2facee4c6a40416e908083e126d2cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07a17a482a4e92b6ddbdee463c8029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:17.437009 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-60f512f0-73e7-4694-8320-ffd62e73baee tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d" status: 200 len: 1504 microversion: 2.1 time: 0.342377 Oct 04 21:58:17.442426 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1557/3202] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:58:17 2022] GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d => generated 1504 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:58:17.448057 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-92fcfa9e-92ec-4fcf-b4fd-f1b24267c8ee tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:17.448874 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-92fcfa9e-92ec-4fcf-b4fd-f1b24267c8ee tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] [instance: 830de6ad-adc6-4d16-ae9d-a29ae85e6cd2] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:17.464344 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-92fcfa9e-92ec-4fcf-b4fd-f1b24267c8ee tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:17.465241 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-92fcfa9e-92ec-4fcf-b4fd-f1b24267c8ee tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:17.465330 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-92fcfa9e-92ec-4fcf-b4fd-f1b24267c8ee tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:17.466656 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-92fcfa9e-92ec-4fcf-b4fd-f1b24267c8ee tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:17.467204 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-92fcfa9e-92ec-4fcf-b4fd-f1b24267c8ee tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:17.467673 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-92fcfa9e-92ec-4fcf-b4fd-f1b24267c8ee tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:17.588948 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-92fcfa9e-92ec-4fcf-b4fd-f1b24267c8ee tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:17.620040 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-92fcfa9e-92ec-4fcf-b4fd-f1b24267c8ee tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:17.631066 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-92fcfa9e-92ec-4fcf-b4fd-f1b24267c8ee tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:17.654335 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-92fcfa9e-92ec-4fcf-b4fd-f1b24267c8ee tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] 10.222.0.43 "GET /compute/v2.1/servers/830de6ad-adc6-4d16-ae9d-a29ae85e6cd2" status: 200 len: 1604 microversion: 2.42 time: 0.191171 Oct 04 21:58:17.660370 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1558/3203] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:58:17 2022] GET /compute/v2.1/servers/830de6ad-adc6-4d16-ae9d-a29ae85e6cd2 => generated 1604 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:58:17.680722 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-64cb7609-8da9-4287-91b9-91f90a31fe7e tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Calling method '.version_select at 0x7fbb2e2755e0>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:17.765230 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-25cbed5d-3841-4301-b934-1f95847f9052 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a94113bec89469a844ede34890d6876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857b9057c949472b9a1862182a01356c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:17.777436 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-25cbed5d-3841-4301-b934-1f95847f9052 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] 10.222.0.43 "GET /compute/v2.1/servers/563105fe-37b7-495e-88bd-d524aa2395db" status: 200 len: 1317 microversion: 2.1 time: 0.397958 Oct 04 21:58:17.777644 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1646/3204] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:58:17 2022] GET /compute/v2.1/servers/563105fe-37b7-495e-88bd-d524aa2395db => generated 1317 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:58:17.789959 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-1bceff06-74e1-47a3-872c-5b588fd3b670 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452", "networks": [{"uuid": "300a434f-3ad3-472e-98dd-a1b7130cf104"}]}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:58:17.794995 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-1bceff06-74e1-47a3-872c-5b588fd3b670 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Request method failure captured: Oct 04 21:58:17.794995 n-d-860284-1 devstack@n-api.service[134102]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 21:58:17.794995 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 21:58:17.794995 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 21:58:17.794995 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 21:58:17.794995 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 163 Oct 04 21:58:17.794995 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 21:58:17.794995 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 21:58:17.794995 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 21:58:17.794995 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 21:58:17.794995 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPKwu4cpW6hhBuWb-qV_7iYlwjOTpf5XWCl53BJjoosjlcj4wkmmOFzemCJVdBntIx8zJ1SF_z6VrRY8UJr7E8TQDJCRnVQMdNnh0-lZwGdqUzjOWSO31Ryb6n87Cka0g238a21JWok3h3GEhLB-7oCbN3bbcOGmkhd6UFueRxRluk24 Oct 04 21:58:17.794995 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 21:58:17.794995 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 21:58:17.794995 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 21:58:17.794995 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 21:58:17.794995 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 21:58:17.794995 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 21:58:17.794995 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: cf07a17a482a4e92b6ddbdee463c8029 Oct 04 21:58:17.794995 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-ServersNegativeTestJSON-1933663319 Oct 04 21:58:17.794995 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 21:58:17.794995 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 21:58:17.794995 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/cf07a17a482a4e92b6ddbdee463c8029"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_cf07a17a482a4e92b6ddbdee463c8029", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/cf07a17a482a4e92b6ddbdee463c8029"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/cf07a17a482a4e92b6ddbdee463c8029"}]}] Oct 04 21:58:17.794995 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-ServersNegativeTestJSON-1933663319 Oct 04 21:58:17.794995 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: cf07a17a482a4e92b6ddbdee463c8029 Oct 04 21:58:17.794995 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1933663319 Oct 04 21:58:17.794995 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-ServersNegativeTestJSON-1933663319-project Oct 04 21:58:17.794995 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 21:58:17.794995 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 21:58:17.794995 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: 2facee4c6a40416e908083e126d2cfa3 Oct 04 21:58:17.794995 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-ServersNegativeTestJSON-1933663319-project Oct 04 21:58:17.794995 n-d-860284-1 devstack@n-api.service[134102]: Oct 04 21:58:17.794995 n-d-860284-1 devstack@n-api.service[134102]: {"server": {"name": 12345, "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452", "networks": [{"uuid": "300a434f-3ad3-472e-98dd-a1b7130cf104"}]}} Oct 04 21:58:17.794995 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 21:58:17.794995 n-d-860284-1 devstack@n-api.service[134102]: exception: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 04 21:58:17.794995 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'body': {'server': {'name': 12345, 'imageRef': '58548514-5dac-426c-81f5-19e3fba33e23', 'flavorRef': '452', 'networks': [{'uuid': '300a434f-3ad3-472e-98dd-a1b7130cf104'}]}}} Oct 04 21:58:17.794995 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:58:17.794995 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:58:17.794995 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 21:58:17.794995 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 21:58:17.794995 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 21:58:17.794995 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise error Oct 04 21:58:17.794995 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 12345 is not of type 'string' Oct 04 21:58:17.794995 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:58:17.794995 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['name']: Oct 04 21:58:17.794995 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 04 21:58:17.794995 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:58:17.794995 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 21:58:17.794995 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi 12345 Oct 04 21:58:17.794995 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:58:17.794995 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:58:17.794995 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:58:17.794995 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:58:17.794995 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:58:17.794995 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:58:17.794995 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:58:17.794995 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:58:17.794995 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:58:17.794995 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:58:17.794995 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:58:17.794995 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:58:17.794995 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 21:58:17.794995 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 21:58:17.794995 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 21:58:17.794995 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 21:58:17.794995 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 21:58:17.800665 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 21:58:17.800665 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 04 21:58:17.800665 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:58:17.800665 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:58:17.800665 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:58:17.800665 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:58:17.800665 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:58:17.800665 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:58:17.800665 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 21:58:17.800665 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 21:58:17.800665 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 04 21:58:17.800665 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:58:17.805691 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-1bceff06-74e1-47a3-872c-5b588fd3b670 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:58:17.809573 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-1bceff06-74e1-47a3-872c-5b588fd3b670 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.030923 Oct 04 21:58:17.811314 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-64cb7609-8da9-4287-91b9-91f90a31fe7e tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] 10.222.0.43 "GET /compute/v2.1/images/683538fe-4fde-450b-94cb-f14e6f8483a3" status: 200 len: 1410 microversion: 2.1 time: 0.148402 Oct 04 21:58:17.821837 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1559/3205] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:58:17 2022] GET /compute/v2.1/images/683538fe-4fde-450b-94cb-f14e6f8483a3 => generated 1410 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:58:17.821837 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-579b7810-7e37-41fd-85cf-916d2d2c6dc6 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:17.821837 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-579b7810-7e37-41fd-85cf-916d2d2c6dc6 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: a4cf4fac-1e9b-4669-a6ff-30008ed3642d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:17.822992 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1647/3206] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 21:58:17 2022] POST /compute/v2.1/servers => generated 127 bytes in 45 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 21:58:17.834917 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-579b7810-7e37-41fd-85cf-916d2d2c6dc6 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:17.848510 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-579b7810-7e37-41fd-85cf-916d2d2c6dc6 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:17.853175 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-579b7810-7e37-41fd-85cf-916d2d2c6dc6 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:17.854143 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-579b7810-7e37-41fd-85cf-916d2d2c6dc6 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:17.855018 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-579b7810-7e37-41fd-85cf-916d2d2c6dc6 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:17.855583 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-579b7810-7e37-41fd-85cf-916d2d2c6dc6 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:18.063748 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-551d3c3b-c690-4c90-808b-3dc2d79d98c1 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:18.064363 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-551d3c3b-c690-4c90-808b-3dc2d79d98c1 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] [instance: d0b1b757-4a4d-4a7a-9a06-08f178a02984] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:18.073247 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-551d3c3b-c690-4c90-808b-3dc2d79d98c1 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:18.073760 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-551d3c3b-c690-4c90-808b-3dc2d79d98c1 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:18.074201 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-551d3c3b-c690-4c90-808b-3dc2d79d98c1 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:18.074954 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-551d3c3b-c690-4c90-808b-3dc2d79d98c1 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:18.083474 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-551d3c3b-c690-4c90-808b-3dc2d79d98c1 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:18.083935 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-551d3c3b-c690-4c90-808b-3dc2d79d98c1 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:18.193376 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-579b7810-7e37-41fd-85cf-916d2d2c6dc6 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2facee4c6a40416e908083e126d2cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07a17a482a4e92b6ddbdee463c8029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:18.215622 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-579b7810-7e37-41fd-85cf-916d2d2c6dc6 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d" status: 200 len: 1504 microversion: 2.1 time: 0.399482 Oct 04 21:58:18.216218 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1560/3207] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:58:17 2022] GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d => generated 1504 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:58:18.249444 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-0e751fd2-571e-494f-8d0a-9c7f7d5b7feb tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:18.251589 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-0e751fd2-571e-494f-8d0a-9c7f7d5b7feb tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: a4cf4fac-1e9b-4669-a6ff-30008ed3642d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:18.262678 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-551d3c3b-c690-4c90-808b-3dc2d79d98c1 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:18.275164 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0e751fd2-571e-494f-8d0a-9c7f7d5b7feb tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:18.275164 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0e751fd2-571e-494f-8d0a-9c7f7d5b7feb tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:18.275164 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0e751fd2-571e-494f-8d0a-9c7f7d5b7feb tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:18.275164 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0e751fd2-571e-494f-8d0a-9c7f7d5b7feb tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:18.275790 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-551d3c3b-c690-4c90-808b-3dc2d79d98c1 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:18.278048 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-551d3c3b-c690-4c90-808b-3dc2d79d98c1 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:18.279036 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0e751fd2-571e-494f-8d0a-9c7f7d5b7feb tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:18.279519 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0e751fd2-571e-494f-8d0a-9c7f7d5b7feb tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:18.288297 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-551d3c3b-c690-4c90-808b-3dc2d79d98c1 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] 10.222.0.43 "GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984" status: 200 len: 1537 microversion: 2.91 time: 0.228860 Oct 04 21:58:18.290792 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1648/3208] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:58:18 2022] GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984 => generated 1537 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:58:18.397397 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-c893d4d1-f8f3-4145-814b-0271f4787222 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:18.398015 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-c893d4d1-f8f3-4145-814b-0271f4787222 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] [instance: 2764125d-9366-4c77-b1ee-7f188df21205] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:18.406042 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c893d4d1-f8f3-4145-814b-0271f4787222 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:18.409377 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c893d4d1-f8f3-4145-814b-0271f4787222 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:18.409867 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c893d4d1-f8f3-4145-814b-0271f4787222 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:18.411549 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c893d4d1-f8f3-4145-814b-0271f4787222 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:18.412599 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c893d4d1-f8f3-4145-814b-0271f4787222 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:18.413046 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c893d4d1-f8f3-4145-814b-0271f4787222 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:18.541291 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-0e751fd2-571e-494f-8d0a-9c7f7d5b7feb tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2facee4c6a40416e908083e126d2cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07a17a482a4e92b6ddbdee463c8029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:18.553915 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-0e751fd2-571e-494f-8d0a-9c7f7d5b7feb tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d" status: 200 len: 1504 microversion: 2.1 time: 0.309908 Oct 04 21:58:18.594315 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1561/3209] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:58:18 2022] GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d => generated 1504 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:58:18.687151 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-b23d0b18-0aa9-4ce7-a0ae-ea9c9d262f06 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:18.690847 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-b23d0b18-0aa9-4ce7-a0ae-ea9c9d262f06 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] [instance: 830de6ad-adc6-4d16-ae9d-a29ae85e6cd2] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:18.697590 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-c893d4d1-f8f3-4145-814b-0271f4787222 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c386b2ed7064073944085bf2a41f0de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d23c1f5719481483f4a28b76e45514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:18.709669 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b23d0b18-0aa9-4ce7-a0ae-ea9c9d262f06 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:18.711099 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-c893d4d1-f8f3-4145-814b-0271f4787222 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] 10.222.0.43 "GET /compute/v2.1/servers/2764125d-9366-4c77-b1ee-7f188df21205" status: 200 len: 1493 microversion: 2.1 time: 0.317716 Oct 04 21:58:18.712101 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1649/3210] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:58:18 2022] GET /compute/v2.1/servers/2764125d-9366-4c77-b1ee-7f188df21205 => generated 1493 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:58:18.712369 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b23d0b18-0aa9-4ce7-a0ae-ea9c9d262f06 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:18.713101 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b23d0b18-0aa9-4ce7-a0ae-ea9c9d262f06 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:18.714358 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b23d0b18-0aa9-4ce7-a0ae-ea9c9d262f06 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:18.715035 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b23d0b18-0aa9-4ce7-a0ae-ea9c9d262f06 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:18.715639 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b23d0b18-0aa9-4ce7-a0ae-ea9c9d262f06 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:18.736813 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-4f1d1533-43f7-4fa3-89b5-6f5e22d95018 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:58:18.737788 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-4f1d1533-43f7-4fa3-89b5-6f5e22d95018 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] [instance: 2764125d-9366-4c77-b1ee-7f188df21205] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:18.752188 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4f1d1533-43f7-4fa3-89b5-6f5e22d95018 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:18.752901 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4f1d1533-43f7-4fa3-89b5-6f5e22d95018 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:18.753521 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4f1d1533-43f7-4fa3-89b5-6f5e22d95018 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:18.754448 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4f1d1533-43f7-4fa3-89b5-6f5e22d95018 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:18.755106 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4f1d1533-43f7-4fa3-89b5-6f5e22d95018 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:18.755843 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4f1d1533-43f7-4fa3-89b5-6f5e22d95018 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:18.879321 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-4f1d1533-43f7-4fa3-89b5-6f5e22d95018 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] 10.222.0.43 "POST /compute/v2.1/servers/2764125d-9366-4c77-b1ee-7f188df21205/action" status: 202 len: 0 microversion: 2.1 time: 0.145858 Oct 04 21:58:18.880227 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1650/3211] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 21:58:18 2022] POST /compute/v2.1/servers/2764125d-9366-4c77-b1ee-7f188df21205/action => generated 0 bytes in 149 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 21:58:18.883680 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-b23d0b18-0aa9-4ce7-a0ae-ea9c9d262f06 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:18.886689 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:58:18.897511 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-b23d0b18-0aa9-4ce7-a0ae-ea9c9d262f06 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:18.904470 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-b23d0b18-0aa9-4ce7-a0ae-ea9c9d262f06 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:18.906127 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-b23d0b18-0aa9-4ce7-a0ae-ea9c9d262f06 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] 10.222.0.43 "GET /compute/v2.1/servers/830de6ad-adc6-4d16-ae9d-a29ae85e6cd2" status: 200 len: 1604 microversion: 2.42 time: 0.223827 Oct 04 21:58:18.919840 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-e82b2692-de0d-4d78-b20c-62ea8380f20d tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:18.924205 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-e82b2692-de0d-4d78-b20c-62ea8380f20d tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] [instance: 563105fe-37b7-495e-88bd-d524aa2395db] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:18.927304 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1562/3212] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:58:18 2022] GET /compute/v2.1/servers/830de6ad-adc6-4d16-ae9d-a29ae85e6cd2 => generated 1604 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:58:18.933417 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-3e9cd66c-c52f-482f-bfe1-10041444b73b tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Calling method '.version_select at 0x7fbb2e275ee0>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:18.933809 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e82b2692-de0d-4d78-b20c-62ea8380f20d tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:18.934526 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e82b2692-de0d-4d78-b20c-62ea8380f20d tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:18.935968 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e82b2692-de0d-4d78-b20c-62ea8380f20d tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:18.939089 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e82b2692-de0d-4d78-b20c-62ea8380f20d tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:18.939818 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e82b2692-de0d-4d78-b20c-62ea8380f20d tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:18.940720 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e82b2692-de0d-4d78-b20c-62ea8380f20d tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:18.989620 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-3e9cd66c-c52f-482f-bfe1-10041444b73b tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] 10.222.0.43 "GET /compute/v2.1/images/683538fe-4fde-450b-94cb-f14e6f8483a3" status: 200 len: 1410 microversion: 2.1 time: 0.060756 Oct 04 21:58:18.990677 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1563/3213] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:58:18 2022] GET /compute/v2.1/images/683538fe-4fde-450b-94cb-f14e6f8483a3 => generated 1410 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:58:18.995560 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-3529ff96-5bd9-493c-8ab2-4f4bbc98bba4 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:18.996543 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-3529ff96-5bd9-493c-8ab2-4f4bbc98bba4 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] [instance: 2764125d-9366-4c77-b1ee-7f188df21205] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:19.004655 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3529ff96-5bd9-493c-8ab2-4f4bbc98bba4 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:19.005548 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3529ff96-5bd9-493c-8ab2-4f4bbc98bba4 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:19.006261 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3529ff96-5bd9-493c-8ab2-4f4bbc98bba4 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:19.007355 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3529ff96-5bd9-493c-8ab2-4f4bbc98bba4 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:19.008312 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3529ff96-5bd9-493c-8ab2-4f4bbc98bba4 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:19.009039 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3529ff96-5bd9-493c-8ab2-4f4bbc98bba4 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:19.292680 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-e82b2692-de0d-4d78-b20c-62ea8380f20d tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a94113bec89469a844ede34890d6876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857b9057c949472b9a1862182a01356c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:19.302829 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-e82b2692-de0d-4d78-b20c-62ea8380f20d tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] 10.222.0.43 "GET /compute/v2.1/servers/563105fe-37b7-495e-88bd-d524aa2395db" status: 200 len: 1317 microversion: 2.1 time: 0.395407 Oct 04 21:58:19.314391 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1651/3214] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:58:18 2022] GET /compute/v2.1/servers/563105fe-37b7-495e-88bd-d524aa2395db => generated 1317 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:58:19.324206 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-dd0af8b2-f0ad-41dd-818b-4f8495b7457b tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:19.324847 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-dd0af8b2-f0ad-41dd-818b-4f8495b7457b tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] [instance: d0b1b757-4a4d-4a7a-9a06-08f178a02984] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:19.337568 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dd0af8b2-f0ad-41dd-818b-4f8495b7457b tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:19.337568 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dd0af8b2-f0ad-41dd-818b-4f8495b7457b tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:19.337921 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dd0af8b2-f0ad-41dd-818b-4f8495b7457b tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:19.341157 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dd0af8b2-f0ad-41dd-818b-4f8495b7457b tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:19.341652 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dd0af8b2-f0ad-41dd-818b-4f8495b7457b tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:19.342094 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dd0af8b2-f0ad-41dd-818b-4f8495b7457b tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:19.343365 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-3529ff96-5bd9-493c-8ab2-4f4bbc98bba4 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c386b2ed7064073944085bf2a41f0de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d23c1f5719481483f4a28b76e45514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:19.358639 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-3529ff96-5bd9-493c-8ab2-4f4bbc98bba4 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] 10.222.0.43 "GET /compute/v2.1/servers/2764125d-9366-4c77-b1ee-7f188df21205" status: 200 len: 1499 microversion: 2.1 time: 0.363075 Oct 04 21:58:19.359786 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1564/3215] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:58:18 2022] GET /compute/v2.1/servers/2764125d-9366-4c77-b1ee-7f188df21205 => generated 1499 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:58:19.493226 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-dd0af8b2-f0ad-41dd-818b-4f8495b7457b tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:19.507050 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-dd0af8b2-f0ad-41dd-818b-4f8495b7457b tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:19.510072 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-dd0af8b2-f0ad-41dd-818b-4f8495b7457b tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:19.530695 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-dd0af8b2-f0ad-41dd-818b-4f8495b7457b tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] 10.222.0.43 "GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984" status: 200 len: 1537 microversion: 2.91 time: 0.205207 Oct 04 21:58:19.549410 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1652/3216] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:58:19 2022] GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984 => generated 1537 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:58:19.933542 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-8eae5ec1-d0b2-490c-ad77-86192df88788 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:19.934471 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-8eae5ec1-d0b2-490c-ad77-86192df88788 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] [instance: 830de6ad-adc6-4d16-ae9d-a29ae85e6cd2] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:19.947367 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8eae5ec1-d0b2-490c-ad77-86192df88788 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:19.948242 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8eae5ec1-d0b2-490c-ad77-86192df88788 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:19.949238 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8eae5ec1-d0b2-490c-ad77-86192df88788 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:19.950789 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8eae5ec1-d0b2-490c-ad77-86192df88788 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:19.951869 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8eae5ec1-d0b2-490c-ad77-86192df88788 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:19.952540 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8eae5ec1-d0b2-490c-ad77-86192df88788 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:20.015980 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-ce6b601f-a431-43ce-ac3a-cb6b89c5f659 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Calling method '.version_select at 0x7fbb2e79ca60>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:20.151955 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-ce6b601f-a431-43ce-ac3a-cb6b89c5f659 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] 10.222.0.43 "GET /compute/v2.1/images/683538fe-4fde-450b-94cb-f14e6f8483a3" status: 200 len: 1410 microversion: 2.1 time: 0.140206 Oct 04 21:58:20.160377 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1653/3217] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:58:20 2022] GET /compute/v2.1/images/683538fe-4fde-450b-94cb-f14e6f8483a3 => generated 1410 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:58:20.221788 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-8eae5ec1-d0b2-490c-ad77-86192df88788 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:20.244341 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-8eae5ec1-d0b2-490c-ad77-86192df88788 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:20.250150 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-8eae5ec1-d0b2-490c-ad77-86192df88788 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:20.254426 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-8eae5ec1-d0b2-490c-ad77-86192df88788 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] 10.222.0.43 "GET /compute/v2.1/servers/830de6ad-adc6-4d16-ae9d-a29ae85e6cd2" status: 200 len: 1604 microversion: 2.42 time: 0.324893 Oct 04 21:58:20.256417 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1565/3218] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:58:19 2022] GET /compute/v2.1/servers/830de6ad-adc6-4d16-ae9d-a29ae85e6cd2 => generated 1604 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:58:20.330887 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-387e622a-dc9f-4d7e-aacb-6baecf9f9739 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:20.331510 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-387e622a-dc9f-4d7e-aacb-6baecf9f9739 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] [instance: 563105fe-37b7-495e-88bd-d524aa2395db] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:20.355362 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-387e622a-dc9f-4d7e-aacb-6baecf9f9739 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:20.356664 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-387e622a-dc9f-4d7e-aacb-6baecf9f9739 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:20.357808 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-387e622a-dc9f-4d7e-aacb-6baecf9f9739 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:20.362357 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-387e622a-dc9f-4d7e-aacb-6baecf9f9739 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:20.366979 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-387e622a-dc9f-4d7e-aacb-6baecf9f9739 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:20.368288 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-387e622a-dc9f-4d7e-aacb-6baecf9f9739 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:20.389267 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-3e11e449-9e7a-4169-a2b4-c3174e5e131f tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:20.393615 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-3e11e449-9e7a-4169-a2b4-c3174e5e131f tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] [instance: 2764125d-9366-4c77-b1ee-7f188df21205] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:20.403626 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3e11e449-9e7a-4169-a2b4-c3174e5e131f tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:20.404977 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3e11e449-9e7a-4169-a2b4-c3174e5e131f tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:20.405710 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3e11e449-9e7a-4169-a2b4-c3174e5e131f tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:20.407638 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3e11e449-9e7a-4169-a2b4-c3174e5e131f tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:20.408433 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3e11e449-9e7a-4169-a2b4-c3174e5e131f tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:20.409427 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3e11e449-9e7a-4169-a2b4-c3174e5e131f tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:21.103826 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-3e11e449-9e7a-4169-a2b4-c3174e5e131f tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c386b2ed7064073944085bf2a41f0de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d23c1f5719481483f4a28b76e45514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:21.120719 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-3e11e449-9e7a-4169-a2b4-c3174e5e131f tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] 10.222.0.43 "GET /compute/v2.1/servers/2764125d-9366-4c77-b1ee-7f188df21205" status: 200 len: 1499 microversion: 2.1 time: 0.737664 Oct 04 21:58:21.124390 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1566/3219] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:58:20 2022] GET /compute/v2.1/servers/2764125d-9366-4c77-b1ee-7f188df21205 => generated 1499 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:58:21.154596 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-b8cabcb7-02a9-4b95-bee8-a763517421cc tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:21.155493 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-b8cabcb7-02a9-4b95-bee8-a763517421cc tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] [instance: d0b1b757-4a4d-4a7a-9a06-08f178a02984] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:21.186204 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b8cabcb7-02a9-4b95-bee8-a763517421cc tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:21.190164 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b8cabcb7-02a9-4b95-bee8-a763517421cc tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:21.192646 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b8cabcb7-02a9-4b95-bee8-a763517421cc tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:21.196509 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b8cabcb7-02a9-4b95-bee8-a763517421cc tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:21.200313 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b8cabcb7-02a9-4b95-bee8-a763517421cc tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:21.201228 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b8cabcb7-02a9-4b95-bee8-a763517421cc tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:21.204104 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-387e622a-dc9f-4d7e-aacb-6baecf9f9739 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a94113bec89469a844ede34890d6876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857b9057c949472b9a1862182a01356c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:21.226298 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-387e622a-dc9f-4d7e-aacb-6baecf9f9739 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] 10.222.0.43 "GET /compute/v2.1/servers/563105fe-37b7-495e-88bd-d524aa2395db" status: 200 len: 1317 microversion: 2.1 time: 0.899497 Oct 04 21:58:21.228128 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1654/3220] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:58:20 2022] GET /compute/v2.1/servers/563105fe-37b7-495e-88bd-d524aa2395db => generated 1317 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:58:21.237237 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-bbd9fa98-b5ef-4f78-bc30-d3eaefad684a req-4f1e3290-5aa3-473a-ab2f-bd8febaf5ead service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "563105fe-37b7-495e-88bd-d524aa2395db", "name": "network-vif-plugged", "status": "completed", "tag": "8efd08fb-4170-4168-9227-d8d2e4a16093"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:58:21.258668 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-bbd9fa98-b5ef-4f78-bc30-d3eaefad684a req-4f1e3290-5aa3-473a-ab2f-bd8febaf5ead service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:21.260703 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-bbd9fa98-b5ef-4f78-bc30-d3eaefad684a req-4f1e3290-5aa3-473a-ab2f-bd8febaf5ead service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:21.261966 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-bbd9fa98-b5ef-4f78-bc30-d3eaefad684a req-4f1e3290-5aa3-473a-ab2f-bd8febaf5ead service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:21.328169 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-bbd9fa98-b5ef-4f78-bc30-d3eaefad684a req-4f1e3290-5aa3-473a-ab2f-bd8febaf5ead service nova] Creating event network-vif-plugged:8efd08fb-4170-4168-9227-d8d2e4a16093 for instance 563105fe-37b7-495e-88bd-d524aa2395db on n-h1-860284-1 Oct 04 21:58:21.355768 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-bbd9fa98-b5ef-4f78-bc30-d3eaefad684a req-4f1e3290-5aa3-473a-ab2f-bd8febaf5ead service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124939 Oct 04 21:58:21.360077 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1655/3221] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:58:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:58:21.387737 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-9c414c94-f744-43cf-8b63-f0927825db9b tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Calling method '.version_select at 0x7fbb2e769c10>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:21.434911 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-b8cabcb7-02a9-4b95-bee8-a763517421cc tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:21.457255 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-b8cabcb7-02a9-4b95-bee8-a763517421cc tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:21.468315 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-b8cabcb7-02a9-4b95-bee8-a763517421cc tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:21.481308 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-b8cabcb7-02a9-4b95-bee8-a763517421cc tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] 10.222.0.43 "GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984" status: 200 len: 1537 microversion: 2.91 time: 0.353803 Oct 04 21:58:21.504609 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1567/3222] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:58:21 2022] GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984 => generated 1537 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:58:21.517067 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-95998693-c389-4ac3-a1dc-7ea0f46ead76 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:21.519221 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-95998693-c389-4ac3-a1dc-7ea0f46ead76 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] [instance: 830de6ad-adc6-4d16-ae9d-a29ae85e6cd2] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:21.545283 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-95998693-c389-4ac3-a1dc-7ea0f46ead76 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:21.551114 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-95998693-c389-4ac3-a1dc-7ea0f46ead76 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:21.551867 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-95998693-c389-4ac3-a1dc-7ea0f46ead76 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:21.557079 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-95998693-c389-4ac3-a1dc-7ea0f46ead76 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:21.557774 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-95998693-c389-4ac3-a1dc-7ea0f46ead76 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:21.558405 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-95998693-c389-4ac3-a1dc-7ea0f46ead76 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:21.675230 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-9c414c94-f744-43cf-8b63-f0927825db9b tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] 10.222.0.43 "GET /compute/v2.1/images/683538fe-4fde-450b-94cb-f14e6f8483a3" status: 200 len: 1410 microversion: 2.1 time: 0.307481 Oct 04 21:58:21.676498 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1656/3223] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:58:21 2022] GET /compute/v2.1/images/683538fe-4fde-450b-94cb-f14e6f8483a3 => generated 1410 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:58:21.702084 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-95998693-c389-4ac3-a1dc-7ea0f46ead76 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:21.724464 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-95998693-c389-4ac3-a1dc-7ea0f46ead76 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:21.725907 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-95998693-c389-4ac3-a1dc-7ea0f46ead76 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:21.727119 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-95998693-c389-4ac3-a1dc-7ea0f46ead76 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] 10.222.0.43 "GET /compute/v2.1/servers/830de6ad-adc6-4d16-ae9d-a29ae85e6cd2" status: 200 len: 1604 microversion: 2.42 time: 0.220984 Oct 04 21:58:21.739233 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1568/3224] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:58:21 2022] GET /compute/v2.1/servers/830de6ad-adc6-4d16-ae9d-a29ae85e6cd2 => generated 1604 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:58:22.091723 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-5e9fbf69-6bbd-4438-83b4-dbc215b51a71 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1527228614", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "a54c3c12-33b8-47c4-81b7-5e41b3e26186", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "300a434f-3ad3-472e-98dd-a1b7130cf104"}]}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:58:22.177719 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-818f551c-8cd7-40e5-ad64-ecfbd8dbceae tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:22.179563 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-818f551c-8cd7-40e5-ad64-ecfbd8dbceae tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] [instance: 2764125d-9366-4c77-b1ee-7f188df21205] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:22.208284 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-818f551c-8cd7-40e5-ad64-ecfbd8dbceae tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:22.211132 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-818f551c-8cd7-40e5-ad64-ecfbd8dbceae tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:22.211910 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-818f551c-8cd7-40e5-ad64-ecfbd8dbceae tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:22.213083 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-818f551c-8cd7-40e5-ad64-ecfbd8dbceae tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:22.213853 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-818f551c-8cd7-40e5-ad64-ecfbd8dbceae tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:22.214605 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-818f551c-8cd7-40e5-ad64-ecfbd8dbceae tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:22.281649 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=2 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:58:22.599666 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-5e9fbf69-6bbd-4438-83b4-dbc215b51a71 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] HTTP exception thrown: Block Device a54c3c12-33b8-47c4-81b7-5e41b3e26186 is not bootable. Oct 04 21:58:22.612934 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-5e9fbf69-6bbd-4438-83b4-dbc215b51a71 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Request method failure captured: Oct 04 21:58:22.612934 n-d-860284-1 devstack@n-api.service[134102]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 21:58:22.612934 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 21:58:22.612934 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 21:58:22.612934 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 21:58:22.612934 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 358 Oct 04 21:58:22.612934 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 21:58:22.612934 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 21:58:22.612934 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 21:58:22.612934 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 21:58:22.612934 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPKwu4cpW6hhBuWb-qV_7iYlwjOTpf5XWCl53BJjoosjlcj4wkmmOFzemCJVdBntIx8zJ1SF_z6VrRY8UJr7E8TQDJCRnVQMdNnh0-lZwGdqUzjOWSO31Ryb6n87Cka0g238a21JWok3h3GEhLB-7oCbN3bbcOGmkhd6UFueRxRluk24 Oct 04 21:58:22.612934 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 21:58:22.612934 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 21:58:22.612934 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 21:58:22.612934 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 21:58:22.612934 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 21:58:22.612934 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 21:58:22.612934 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: cf07a17a482a4e92b6ddbdee463c8029 Oct 04 21:58:22.612934 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-ServersNegativeTestJSON-1933663319 Oct 04 21:58:22.612934 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 21:58:22.612934 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 21:58:22.612934 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/cf07a17a482a4e92b6ddbdee463c8029"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_cf07a17a482a4e92b6ddbdee463c8029", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/cf07a17a482a4e92b6ddbdee463c8029"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/cf07a17a482a4e92b6ddbdee463c8029"}]}] Oct 04 21:58:22.612934 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-ServersNegativeTestJSON-1933663319 Oct 04 21:58:22.612934 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: cf07a17a482a4e92b6ddbdee463c8029 Oct 04 21:58:22.612934 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1933663319 Oct 04 21:58:22.612934 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-ServersNegativeTestJSON-1933663319-project Oct 04 21:58:22.612934 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 21:58:22.612934 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 21:58:22.612934 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: 2facee4c6a40416e908083e126d2cfa3 Oct 04 21:58:22.612934 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-ServersNegativeTestJSON-1933663319-project Oct 04 21:58:22.612934 n-d-860284-1 devstack@n-api.service[134102]: Oct 04 21:58:22.612934 n-d-860284-1 devstack@n-api.service[134102]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1527228614", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "a54c3c12-33b8-47c4-81b7-5e41b3e26186", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "300a434f-3ad3-472e-98dd-a1b7130cf104"}]}} Oct 04 21:58:22.612934 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 21:58:22.612934 n-d-860284-1 devstack@n-api.service[134102]: exception: Block Device a54c3c12-33b8-47c4-81b7-5e41b3e26186 is not bootable. Oct 04 21:58:22.612934 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1527228614', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': 'a54c3c12-33b8-47c4-81b7-5e41b3e26186'}], 'networks': [{'uuid': '300a434f-3ad3-472e-98dd-a1b7130cf104'}]}}} Oct 04 21:58:22.612934 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:58:22.612934 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:58:22.612934 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 21:58:22.612934 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 21:58:22.612934 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 21:58:22.612934 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 21:58:22.612934 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1672, in _create_instance Oct 04 21:58:22.612934 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Oct 04 21:58:22.612934 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 664, in get_bdm_image_metadata Oct 04 21:58:22.612934 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Oct 04 21:58:22.612934 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device a54c3c12-33b8-47c4-81b7-5e41b3e26186 is not bootable. Oct 04 21:58:22.612934 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:58:22.612934 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:58:22.612934 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:58:22.612934 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:58:22.612934 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:58:22.612934 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:58:22.612934 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:58:22.612934 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:58:22.612934 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:58:22.612934 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:58:22.612934 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:58:22.612934 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:58:22.612934 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:58:22.631898 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:58:22.631898 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:58:22.631898 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:58:22.631898 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 21:58:22.631898 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 04 21:58:22.631898 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 04 21:58:22.631898 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device a54c3c12-33b8-47c4-81b7-5e41b3e26186 is not bootable. Oct 04 21:58:22.631898 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:58:22.631898 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:58:22.631898 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:58:22.631898 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:58:22.631898 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:58:22.631898 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:58:22.631898 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:58:22.631898 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:58:22.631898 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device a54c3c12-33b8-47c4-81b7-5e41b3e26186 is not bootable. Oct 04 21:58:22.631898 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:58:22.631898 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-5e9fbf69-6bbd-4438-83b4-dbc215b51a71 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Returning 400 to user: Block Device a54c3c12-33b8-47c4-81b7-5e41b3e26186 is not bootable. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:58:22.642886 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-5e9fbf69-6bbd-4438-83b4-dbc215b51a71 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.573763 Oct 04 21:58:22.645389 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1657/3225] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 21:58:22 2022] POST /compute/v2.1/servers => generated 110 bytes in 577 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 21:58:22.704884 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-14862d0a-8f55-42c4-98b8-23632367a644 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:22.709306 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-14862d0a-8f55-42c4-98b8-23632367a644 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] [instance: 563105fe-37b7-495e-88bd-d524aa2395db] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:22.739617 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-14862d0a-8f55-42c4-98b8-23632367a644 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:22.742457 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-14862d0a-8f55-42c4-98b8-23632367a644 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:22.744545 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-14862d0a-8f55-42c4-98b8-23632367a644 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:22.746754 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-14862d0a-8f55-42c4-98b8-23632367a644 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:22.748343 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-14862d0a-8f55-42c4-98b8-23632367a644 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:22.751393 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-14862d0a-8f55-42c4-98b8-23632367a644 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:23.276463 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-14862d0a-8f55-42c4-98b8-23632367a644 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a94113bec89469a844ede34890d6876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857b9057c949472b9a1862182a01356c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:23.293511 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-14862d0a-8f55-42c4-98b8-23632367a644 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] 10.222.0.43 "GET /compute/v2.1/servers/563105fe-37b7-495e-88bd-d524aa2395db" status: 200 len: 1317 microversion: 2.1 time: 0.637576 Oct 04 21:58:23.294122 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1658/3226] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:58:22 2022] GET /compute/v2.1/servers/563105fe-37b7-495e-88bd-d524aa2395db => generated 1317 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:58:23.328483 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-3d595c5f-804c-4612-9ef0-fc8aa3697796 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:23.330921 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-3d595c5f-804c-4612-9ef0-fc8aa3697796 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] [instance: d0b1b757-4a4d-4a7a-9a06-08f178a02984] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:23.360116 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3d595c5f-804c-4612-9ef0-fc8aa3697796 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:23.362153 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3d595c5f-804c-4612-9ef0-fc8aa3697796 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:23.364641 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3d595c5f-804c-4612-9ef0-fc8aa3697796 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:23.367431 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3d595c5f-804c-4612-9ef0-fc8aa3697796 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:23.368302 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3d595c5f-804c-4612-9ef0-fc8aa3697796 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:23.371505 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3d595c5f-804c-4612-9ef0-fc8aa3697796 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:23.436298 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-818f551c-8cd7-40e5-ad64-ecfbd8dbceae tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c386b2ed7064073944085bf2a41f0de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d23c1f5719481483f4a28b76e45514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:23.451279 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-818f551c-8cd7-40e5-ad64-ecfbd8dbceae tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] 10.222.0.43 "GET /compute/v2.1/servers/2764125d-9366-4c77-b1ee-7f188df21205" status: 200 len: 1499 microversion: 2.1 time: 1.276281 Oct 04 21:58:23.475942 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1569/3227] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:58:22 2022] GET /compute/v2.1/servers/2764125d-9366-4c77-b1ee-7f188df21205 => generated 1499 bytes in 1303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:58:23.506009 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-009f3bb9-6274-43bc-bfcd-97900748754a tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:23.507094 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-009f3bb9-6274-43bc-bfcd-97900748754a tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: a4cf4fac-1e9b-4669-a6ff-30008ed3642d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:23.536331 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-009f3bb9-6274-43bc-bfcd-97900748754a tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:23.537129 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-009f3bb9-6274-43bc-bfcd-97900748754a tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:23.538381 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-009f3bb9-6274-43bc-bfcd-97900748754a tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:23.539309 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-009f3bb9-6274-43bc-bfcd-97900748754a tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:23.539942 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-009f3bb9-6274-43bc-bfcd-97900748754a tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:23.545079 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-009f3bb9-6274-43bc-bfcd-97900748754a tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:23.588550 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-3d595c5f-804c-4612-9ef0-fc8aa3697796 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:23.598553 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-3d595c5f-804c-4612-9ef0-fc8aa3697796 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:23.604880 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-3d595c5f-804c-4612-9ef0-fc8aa3697796 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:23.634307 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-3d595c5f-804c-4612-9ef0-fc8aa3697796 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] 10.222.0.43 "GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984" status: 200 len: 1537 microversion: 2.91 time: 0.331357 Oct 04 21:58:23.635654 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1659/3228] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:58:23 2022] GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984 => generated 1537 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:58:23.651604 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-514e9669-c6cb-4bff-937e-b01115e2bf89 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Calling method '.version_select at 0x7fbb2e76bca0>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:24.385070 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-009f3bb9-6274-43bc-bfcd-97900748754a tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2facee4c6a40416e908083e126d2cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07a17a482a4e92b6ddbdee463c8029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:24.394770 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-009f3bb9-6274-43bc-bfcd-97900748754a tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d" status: 200 len: 1504 microversion: 2.1 time: 0.916226 Oct 04 21:58:24.410391 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1570/3229] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:58:23 2022] GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d => generated 1504 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:58:24.410391 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-028998e3-4a04-4276-b7d0-510c0e2a7ece tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:24.410391 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-028998e3-4a04-4276-b7d0-510c0e2a7ece tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] [instance: 830de6ad-adc6-4d16-ae9d-a29ae85e6cd2] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:24.410391 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-028998e3-4a04-4276-b7d0-510c0e2a7ece tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:24.410876 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-028998e3-4a04-4276-b7d0-510c0e2a7ece tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:24.411215 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-028998e3-4a04-4276-b7d0-510c0e2a7ece tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:24.412237 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-028998e3-4a04-4276-b7d0-510c0e2a7ece tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:24.412858 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-028998e3-4a04-4276-b7d0-510c0e2a7ece tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:24.413448 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-028998e3-4a04-4276-b7d0-510c0e2a7ece tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:24.534180 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-028998e3-4a04-4276-b7d0-510c0e2a7ece tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:24.548822 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-028998e3-4a04-4276-b7d0-510c0e2a7ece tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:24.550966 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-028998e3-4a04-4276-b7d0-510c0e2a7ece tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:24.553441 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-028998e3-4a04-4276-b7d0-510c0e2a7ece tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] 10.222.0.43 "GET /compute/v2.1/servers/830de6ad-adc6-4d16-ae9d-a29ae85e6cd2" status: 200 len: 1604 microversion: 2.42 time: 0.155052 Oct 04 21:58:24.560742 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1571/3230] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:58:24 2022] GET /compute/v2.1/servers/830de6ad-adc6-4d16-ae9d-a29ae85e6cd2 => generated 1604 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:58:24.578237 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-da28090c-5d56-4ace-aba6-6744cf03e42c req-51325c7b-7eea-453f-8c5f-60415cc22ae2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dad442d9-d2e1-49ee-93ea-6e5090634df8", "name": "network-vif-plugged", "status": "completed", "tag": "38ab1df9-0112-4774-abf7-063259d4b821"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:58:24.589993 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-da28090c-5d56-4ace-aba6-6744cf03e42c req-51325c7b-7eea-453f-8c5f-60415cc22ae2 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:24.590916 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-da28090c-5d56-4ace-aba6-6744cf03e42c req-51325c7b-7eea-453f-8c5f-60415cc22ae2 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:24.591483 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-da28090c-5d56-4ace-aba6-6744cf03e42c req-51325c7b-7eea-453f-8c5f-60415cc22ae2 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:24.605692 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-da28090c-5d56-4ace-aba6-6744cf03e42c req-51325c7b-7eea-453f-8c5f-60415cc22ae2 service nova] Creating event network-vif-plugged:38ab1df9-0112-4774-abf7-063259d4b821 for instance dad442d9-d2e1-49ee-93ea-6e5090634df8 on n-h2-860284-1 Oct 04 21:58:24.616870 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-da28090c-5d56-4ace-aba6-6744cf03e42c req-51325c7b-7eea-453f-8c5f-60415cc22ae2 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054092 Oct 04 21:58:24.622447 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1572/3231] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:58:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:58:24.630300 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-67c5b398-8dac-4c09-84e7-109f79ff85d3 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:24.631410 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-67c5b398-8dac-4c09-84e7-109f79ff85d3 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] [instance: 563105fe-37b7-495e-88bd-d524aa2395db] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:24.640312 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-67c5b398-8dac-4c09-84e7-109f79ff85d3 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:24.641757 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-67c5b398-8dac-4c09-84e7-109f79ff85d3 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:24.642624 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-67c5b398-8dac-4c09-84e7-109f79ff85d3 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:24.643665 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-67c5b398-8dac-4c09-84e7-109f79ff85d3 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:24.644542 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-67c5b398-8dac-4c09-84e7-109f79ff85d3 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:24.645239 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-67c5b398-8dac-4c09-84e7-109f79ff85d3 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:24.856883 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-67c5b398-8dac-4c09-84e7-109f79ff85d3 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a94113bec89469a844ede34890d6876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857b9057c949472b9a1862182a01356c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:24.867738 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-67c5b398-8dac-4c09-84e7-109f79ff85d3 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] 10.222.0.43 "GET /compute/v2.1/servers/563105fe-37b7-495e-88bd-d524aa2395db" status: 200 len: 1506 microversion: 2.1 time: 0.243629 Oct 04 21:58:24.869030 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1573/3232] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:58:24 2022] GET /compute/v2.1/servers/563105fe-37b7-495e-88bd-d524aa2395db => generated 1506 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:58:24.874273 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-244887f5-9cc0-4462-8e78-9475c8b57a6a tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:24.875732 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-244887f5-9cc0-4462-8e78-9475c8b57a6a tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: a4cf4fac-1e9b-4669-a6ff-30008ed3642d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:24.882868 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-244887f5-9cc0-4462-8e78-9475c8b57a6a tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:24.883852 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-244887f5-9cc0-4462-8e78-9475c8b57a6a tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:24.884466 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-244887f5-9cc0-4462-8e78-9475c8b57a6a tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:24.885668 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-244887f5-9cc0-4462-8e78-9475c8b57a6a tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:24.886184 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-244887f5-9cc0-4462-8e78-9475c8b57a6a tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:24.887040 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-244887f5-9cc0-4462-8e78-9475c8b57a6a tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:25.211497 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-244887f5-9cc0-4462-8e78-9475c8b57a6a tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2facee4c6a40416e908083e126d2cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07a17a482a4e92b6ddbdee463c8029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:25.226064 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-244887f5-9cc0-4462-8e78-9475c8b57a6a tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d" status: 200 len: 1504 microversion: 2.1 time: 0.354278 Oct 04 21:58:25.227461 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1574/3233] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:58:24 2022] GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d => generated 1504 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:58:25.236078 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-8f695651-db3b-4f10-8b2c-60f653aa3510 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:25.240571 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-8f695651-db3b-4f10-8b2c-60f653aa3510 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] [instance: 2764125d-9366-4c77-b1ee-7f188df21205] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:25.244204 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell0:SELECT=4 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:58:25.270948 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8f695651-db3b-4f10-8b2c-60f653aa3510 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:25.277734 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8f695651-db3b-4f10-8b2c-60f653aa3510 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:25.278571 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8f695651-db3b-4f10-8b2c-60f653aa3510 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:25.279444 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8f695651-db3b-4f10-8b2c-60f653aa3510 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:25.279939 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8f695651-db3b-4f10-8b2c-60f653aa3510 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:25.280383 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8f695651-db3b-4f10-8b2c-60f653aa3510 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:25.652019 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-8f695651-db3b-4f10-8b2c-60f653aa3510 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c386b2ed7064073944085bf2a41f0de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d23c1f5719481483f4a28b76e45514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:25.672659 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-8f695651-db3b-4f10-8b2c-60f653aa3510 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] 10.222.0.43 "GET /compute/v2.1/servers/2764125d-9366-4c77-b1ee-7f188df21205" status: 200 len: 1502 microversion: 2.1 time: 0.442846 Oct 04 21:58:25.678666 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1575/3234] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:58:25 2022] GET /compute/v2.1/servers/2764125d-9366-4c77-b1ee-7f188df21205 => generated 1502 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:58:25.699605 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-10ef2e16-477e-4fb9-abf3-82da1a7f3cbe tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:25.708951 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-10ef2e16-477e-4fb9-abf3-82da1a7f3cbe tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] [instance: d0b1b757-4a4d-4a7a-9a06-08f178a02984] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:25.731343 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-10ef2e16-477e-4fb9-abf3-82da1a7f3cbe tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:25.732131 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-10ef2e16-477e-4fb9-abf3-82da1a7f3cbe tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:25.732882 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-10ef2e16-477e-4fb9-abf3-82da1a7f3cbe tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:25.733871 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-10ef2e16-477e-4fb9-abf3-82da1a7f3cbe tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:25.735401 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-10ef2e16-477e-4fb9-abf3-82da1a7f3cbe tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:25.737042 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-10ef2e16-477e-4fb9-abf3-82da1a7f3cbe tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:26.029427 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-10ef2e16-477e-4fb9-abf3-82da1a7f3cbe tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:26.044768 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-10ef2e16-477e-4fb9-abf3-82da1a7f3cbe tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:26.050628 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-10ef2e16-477e-4fb9-abf3-82da1a7f3cbe tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:26.063785 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-10ef2e16-477e-4fb9-abf3-82da1a7f3cbe tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] 10.222.0.43 "GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984" status: 200 len: 1537 microversion: 2.91 time: 0.380622 Oct 04 21:58:26.065426 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1576/3235] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:58:25 2022] GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984 => generated 1537 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:58:26.079702 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-4d9a266f-3806-46a5-9835-fc5112e77495 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:26.080673 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-4d9a266f-3806-46a5-9835-fc5112e77495 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] [instance: 563105fe-37b7-495e-88bd-d524aa2395db] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:26.099890 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4d9a266f-3806-46a5-9835-fc5112e77495 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:26.100941 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4d9a266f-3806-46a5-9835-fc5112e77495 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:26.101783 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4d9a266f-3806-46a5-9835-fc5112e77495 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:26.104338 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4d9a266f-3806-46a5-9835-fc5112e77495 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:26.105513 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4d9a266f-3806-46a5-9835-fc5112e77495 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:26.106186 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4d9a266f-3806-46a5-9835-fc5112e77495 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:26.221754 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-4d9a266f-3806-46a5-9835-fc5112e77495 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] [instance: 563105fe-37b7-495e-88bd-d524aa2395db] Going to try to terminate instance {{(pid=134101) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:58:26.395593 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-4d9a266f-3806-46a5-9835-fc5112e77495 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] 10.222.0.43 "DELETE /compute/v2.1/servers/563105fe-37b7-495e-88bd-d524aa2395db" status: 204 len: 0 microversion: 2.1 time: 0.323847 Oct 04 21:58:26.397597 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1577/3236] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 21:58:26 2022] DELETE /compute/v2.1/servers/563105fe-37b7-495e-88bd-d524aa2395db => generated 0 bytes in 331 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:58:26.410475 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-408843ec-ab5a-4091-891d-88dec9eabaaf tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:26.412075 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-408843ec-ab5a-4091-891d-88dec9eabaaf tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] [instance: 830de6ad-adc6-4d16-ae9d-a29ae85e6cd2] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:26.424229 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-408843ec-ab5a-4091-891d-88dec9eabaaf tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:26.425231 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-408843ec-ab5a-4091-891d-88dec9eabaaf tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:26.425862 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-408843ec-ab5a-4091-891d-88dec9eabaaf tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:26.427145 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-408843ec-ab5a-4091-891d-88dec9eabaaf tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:26.427779 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-408843ec-ab5a-4091-891d-88dec9eabaaf tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:26.428448 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-408843ec-ab5a-4091-891d-88dec9eabaaf tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:26.584749 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-408843ec-ab5a-4091-891d-88dec9eabaaf tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:26.602778 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-408843ec-ab5a-4091-891d-88dec9eabaaf tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:26.604334 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-408843ec-ab5a-4091-891d-88dec9eabaaf tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:26.605596 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-408843ec-ab5a-4091-891d-88dec9eabaaf tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] 10.222.0.43 "GET /compute/v2.1/servers/830de6ad-adc6-4d16-ae9d-a29ae85e6cd2" status: 200 len: 1604 microversion: 2.42 time: 0.205862 Oct 04 21:58:26.610252 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1578/3237] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:58:26 2022] GET /compute/v2.1/servers/830de6ad-adc6-4d16-ae9d-a29ae85e6cd2 => generated 1604 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:58:26.621676 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-3560d866-e144-430c-8d35-5cb977a25a5f tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:26.622216 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-3560d866-e144-430c-8d35-5cb977a25a5f tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] [instance: 2764125d-9366-4c77-b1ee-7f188df21205] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:26.639878 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3560d866-e144-430c-8d35-5cb977a25a5f tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:26.641158 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3560d866-e144-430c-8d35-5cb977a25a5f tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:26.641773 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3560d866-e144-430c-8d35-5cb977a25a5f tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:26.642662 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3560d866-e144-430c-8d35-5cb977a25a5f tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:26.643124 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3560d866-e144-430c-8d35-5cb977a25a5f tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:26.643561 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3560d866-e144-430c-8d35-5cb977a25a5f tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:26.673307 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:58:26.721547 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-3560d866-e144-430c-8d35-5cb977a25a5f tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] [instance: 2764125d-9366-4c77-b1ee-7f188df21205] Going to try to terminate instance {{(pid=134101) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:58:26.898052 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-3560d866-e144-430c-8d35-5cb977a25a5f tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] 10.222.0.43 "DELETE /compute/v2.1/servers/2764125d-9366-4c77-b1ee-7f188df21205" status: 204 len: 0 microversion: 2.1 time: 0.286339 Oct 04 21:58:26.898984 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1579/3238] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 21:58:26 2022] DELETE /compute/v2.1/servers/2764125d-9366-4c77-b1ee-7f188df21205 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:58:26.907392 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-ad72eb1a-3191-4900-ad92-7cf94e44c070 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:26.907983 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-ad72eb1a-3191-4900-ad92-7cf94e44c070 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] [instance: 7618c19f-d7bb-4f37-8454-76570009eb30] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:26.925615 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ad72eb1a-3191-4900-ad92-7cf94e44c070 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:26.926036 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ad72eb1a-3191-4900-ad92-7cf94e44c070 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:26.926509 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ad72eb1a-3191-4900-ad92-7cf94e44c070 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:26.927227 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ad72eb1a-3191-4900-ad92-7cf94e44c070 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:26.927711 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ad72eb1a-3191-4900-ad92-7cf94e44c070 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:26.928154 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ad72eb1a-3191-4900-ad92-7cf94e44c070 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:26.991704 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-ad72eb1a-3191-4900-ad92-7cf94e44c070 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] [instance: 7618c19f-d7bb-4f37-8454-76570009eb30] Going to try to terminate instance {{(pid=134101) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:58:27.290690 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-ad72eb1a-3191-4900-ad92-7cf94e44c070 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] 10.222.0.43 "DELETE /compute/v2.1/servers/7618c19f-d7bb-4f37-8454-76570009eb30" status: 204 len: 0 microversion: 2.1 time: 0.389626 Oct 04 21:58:27.295434 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1580/3239] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 21:58:26 2022] DELETE /compute/v2.1/servers/7618c19f-d7bb-4f37-8454-76570009eb30 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:58:27.324424 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-2a1ecc84-264a-4d5d-a6bc-aa79861b5b92 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:27.328582 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-2a1ecc84-264a-4d5d-a6bc-aa79861b5b92 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] [instance: 2764125d-9366-4c77-b1ee-7f188df21205] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:27.353155 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2a1ecc84-264a-4d5d-a6bc-aa79861b5b92 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:27.355155 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2a1ecc84-264a-4d5d-a6bc-aa79861b5b92 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:27.356868 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2a1ecc84-264a-4d5d-a6bc-aa79861b5b92 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:27.359141 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2a1ecc84-264a-4d5d-a6bc-aa79861b5b92 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:27.363027 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2a1ecc84-264a-4d5d-a6bc-aa79861b5b92 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:27.365448 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2a1ecc84-264a-4d5d-a6bc-aa79861b5b92 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:27.706465 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-2a1ecc84-264a-4d5d-a6bc-aa79861b5b92 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c386b2ed7064073944085bf2a41f0de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d23c1f5719481483f4a28b76e45514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:27.716675 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-2a1ecc84-264a-4d5d-a6bc-aa79861b5b92 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] 10.222.0.43 "GET /compute/v2.1/servers/2764125d-9366-4c77-b1ee-7f188df21205" status: 200 len: 1508 microversion: 2.1 time: 0.418504 Oct 04 21:58:27.718718 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1581/3240] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:58:27 2022] GET /compute/v2.1/servers/2764125d-9366-4c77-b1ee-7f188df21205 => generated 1508 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:58:27.727436 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-96daa004-bab5-4f5b-96ff-acd032664f6e tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:27.738030 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-96daa004-bab5-4f5b-96ff-acd032664f6e tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] [instance: d0b1b757-4a4d-4a7a-9a06-08f178a02984] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:27.752629 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-96daa004-bab5-4f5b-96ff-acd032664f6e tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:27.753345 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-96daa004-bab5-4f5b-96ff-acd032664f6e tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:27.753881 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-96daa004-bab5-4f5b-96ff-acd032664f6e tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:27.754726 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-96daa004-bab5-4f5b-96ff-acd032664f6e tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:27.755269 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-96daa004-bab5-4f5b-96ff-acd032664f6e tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:27.755785 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-96daa004-bab5-4f5b-96ff-acd032664f6e tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:27.868902 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-96daa004-bab5-4f5b-96ff-acd032664f6e tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:27.884597 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-96daa004-bab5-4f5b-96ff-acd032664f6e tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:27.886832 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-96daa004-bab5-4f5b-96ff-acd032664f6e tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:27.894667 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-96daa004-bab5-4f5b-96ff-acd032664f6e tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] 10.222.0.43 "GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984" status: 200 len: 1537 microversion: 2.91 time: 0.173861 Oct 04 21:58:27.896127 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1582/3241] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:58:27 2022] GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984 => generated 1537 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:58:27.902241 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-17a53608-fd42-402c-b7ef-2780a2ba687f tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:27.903269 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-17a53608-fd42-402c-b7ef-2780a2ba687f tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] [instance: 563105fe-37b7-495e-88bd-d524aa2395db] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:27.916171 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-17a53608-fd42-402c-b7ef-2780a2ba687f tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:27.919484 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-17a53608-fd42-402c-b7ef-2780a2ba687f tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:27.920628 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-17a53608-fd42-402c-b7ef-2780a2ba687f tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:27.922985 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-17a53608-fd42-402c-b7ef-2780a2ba687f tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:27.924948 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-17a53608-fd42-402c-b7ef-2780a2ba687f tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:27.925638 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-17a53608-fd42-402c-b7ef-2780a2ba687f tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:28.298922 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-17a53608-fd42-402c-b7ef-2780a2ba687f tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a94113bec89469a844ede34890d6876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857b9057c949472b9a1862182a01356c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:28.310926 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-17a53608-fd42-402c-b7ef-2780a2ba687f tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] 10.222.0.43 "GET /compute/v2.1/servers/563105fe-37b7-495e-88bd-d524aa2395db" status: 200 len: 1512 microversion: 2.1 time: 0.413128 Oct 04 21:58:28.312066 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1583/3242] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:58:27 2022] GET /compute/v2.1/servers/563105fe-37b7-495e-88bd-d524aa2395db => generated 1512 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:58:28.320640 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-a1036987-db59-4ca3-81c2-4ea182f23ba4 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:28.321417 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-a1036987-db59-4ca3-81c2-4ea182f23ba4 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] [instance: 830de6ad-adc6-4d16-ae9d-a29ae85e6cd2] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:28.334624 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a1036987-db59-4ca3-81c2-4ea182f23ba4 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:28.335361 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a1036987-db59-4ca3-81c2-4ea182f23ba4 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:28.336051 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a1036987-db59-4ca3-81c2-4ea182f23ba4 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:28.336914 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a1036987-db59-4ca3-81c2-4ea182f23ba4 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:28.337733 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a1036987-db59-4ca3-81c2-4ea182f23ba4 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:28.338398 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a1036987-db59-4ca3-81c2-4ea182f23ba4 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:28.411245 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a1036987-db59-4ca3-81c2-4ea182f23ba4 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:28.412152 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a1036987-db59-4ca3-81c2-4ea182f23ba4 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:28.413963 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a1036987-db59-4ca3-81c2-4ea182f23ba4 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:28.414131 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.objects.instance [None req-a1036987-db59-4ca3-81c2-4ea182f23ba4 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lazy-loading 'fault' on Instance uuid 830de6ad-adc6-4d16-ae9d-a29ae85e6cd2 {{(pid=134101) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:58:28.490529 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-a1036987-db59-4ca3-81c2-4ea182f23ba4 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:28.504043 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-a1036987-db59-4ca3-81c2-4ea182f23ba4 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:28.505512 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-a1036987-db59-4ca3-81c2-4ea182f23ba4 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bb934f4dc53470d8e35d71cccd756d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd1e35c3cb643e3ad2afbe7edbbce8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:28.506753 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-a1036987-db59-4ca3-81c2-4ea182f23ba4 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] 10.222.0.43 "GET /compute/v2.1/servers/830de6ad-adc6-4d16-ae9d-a29ae85e6cd2" status: 200 len: 1609 microversion: 2.42 time: 0.192553 Oct 04 21:58:28.509774 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1584/3243] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:58:28 2022] GET /compute/v2.1/servers/830de6ad-adc6-4d16-ae9d-a29ae85e6cd2 => generated 1609 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:58:28.533212 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-8b74eb55-201d-4712-a24f-9001e65d00be tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1382854292", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "58548514-5dac-426c-81f5-19e3fba33e23", "destination_type": "local"}, {"source_type": "volume", "uuid": "9ecfa18c-c328-4a0b-9fc0-7f167393b580", "destination_type": "invalid"}], "networks": [{"uuid": "300a434f-3ad3-472e-98dd-a1b7130cf104"}]}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:58:28.538757 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-8b74eb55-201d-4712-a24f-9001e65d00be tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Request method failure captured: Oct 04 21:58:28.538757 n-d-860284-1 devstack@n-api.service[134101]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 21:58:28.538757 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 21:58:28.538757 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 21:58:28.538757 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 21:58:28.538757 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 495 Oct 04 21:58:28.538757 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 21:58:28.538757 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 21:58:28.538757 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 21:58:28.538757 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 21:58:28.538757 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPKwu4cpW6hhBuWb-qV_7iYlwjOTpf5XWCl53BJjoosjlcj4wkmmOFzemCJVdBntIx8zJ1SF_z6VrRY8UJr7E8TQDJCRnVQMdNnh0-lZwGdqUzjOWSO31Ryb6n87Cka0g238a21JWok3h3GEhLB-7oCbN3bbcOGmkhd6UFueRxRluk24 Oct 04 21:58:28.538757 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 21:58:28.538757 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 21:58:28.538757 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 21:58:28.538757 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 21:58:28.538757 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 21:58:28.538757 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 21:58:28.538757 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: cf07a17a482a4e92b6ddbdee463c8029 Oct 04 21:58:28.538757 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-ServersNegativeTestJSON-1933663319 Oct 04 21:58:28.538757 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 21:58:28.538757 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 21:58:28.538757 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/cf07a17a482a4e92b6ddbdee463c8029"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_cf07a17a482a4e92b6ddbdee463c8029", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/cf07a17a482a4e92b6ddbdee463c8029"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/cf07a17a482a4e92b6ddbdee463c8029"}]}] Oct 04 21:58:28.538757 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-ServersNegativeTestJSON-1933663319 Oct 04 21:58:28.538757 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: cf07a17a482a4e92b6ddbdee463c8029 Oct 04 21:58:28.538757 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1933663319 Oct 04 21:58:28.538757 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-ServersNegativeTestJSON-1933663319-project Oct 04 21:58:28.538757 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 21:58:28.538757 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 21:58:28.538757 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 2facee4c6a40416e908083e126d2cfa3 Oct 04 21:58:28.538757 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-ServersNegativeTestJSON-1933663319-project Oct 04 21:58:28.538757 n-d-860284-1 devstack@n-api.service[134101]: Oct 04 21:58:28.538757 n-d-860284-1 devstack@n-api.service[134101]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1382854292", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "58548514-5dac-426c-81f5-19e3fba33e23", "destination_type": "local"}, {"source_type": "volume", "uuid": "9ecfa18c-c328-4a0b-9fc0-7f167393b580", "destination_type": "invalid"}], "networks": [{"uuid": "300a434f-3ad3-472e-98dd-a1b7130cf104"}]}} Oct 04 21:58:28.538757 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 21:58:28.538757 n-d-860284-1 devstack@n-api.service[134101]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 04 21:58:28.538757 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1382854292', 'imageRef': '58548514-5dac-426c-81f5-19e3fba33e23', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': '58548514-5dac-426c-81f5-19e3fba33e23', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': '9ecfa18c-c328-4a0b-9fc0-7f167393b580', 'destination_type': 'invalid'}], 'networks': [{'uuid': '300a434f-3ad3-472e-98dd-a1b7130cf104'}]}}} Oct 04 21:58:28.538757 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:58:28.538757 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:58:28.538757 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 21:58:28.538757 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 21:58:28.538757 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 21:58:28.538757 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise error Oct 04 21:58:28.538757 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Oct 04 21:58:28.538757 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:58:28.538757 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Oct 04 21:58:28.538757 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Oct 04 21:58:28.538757 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:58:28.538757 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Oct 04 21:58:28.538757 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi 'invalid' Oct 04 21:58:28.538757 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:58:28.538757 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:58:28.538757 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:58:28.538757 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:58:28.538757 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:58:28.538757 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:58:28.538757 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:58:28.538757 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:58:28.538757 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:58:28.543449 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:58:28.543449 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:58:28.543449 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:58:28.543449 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 21:58:28.543449 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 21:58:28.543449 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 21:58:28.543449 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 21:58:28.543449 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 21:58:28.543449 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 21:58:28.543449 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 04 21:58:28.543449 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:58:28.543449 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:58:28.543449 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:58:28.543449 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:58:28.543449 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:58:28.543449 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:58:28.543449 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 21:58:28.543449 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 21:58:28.543449 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 04 21:58:28.543449 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:58:28.546446 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-8b74eb55-201d-4712-a24f-9001e65d00be tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:58:28.548356 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-8b74eb55-201d-4712-a24f-9001e65d00be tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.037613 Oct 04 21:58:28.549998 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1585/3244] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 21:58:28 2022] POST /compute/v2.1/servers => generated 155 bytes in 40 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 21:58:28.565205 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e8f6b7d5-055c-4931-87cf-a148cc82f57a tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:28.571031 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-e8f6b7d5-055c-4931-87cf-a148cc82f57a tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: a4cf4fac-1e9b-4669-a6ff-30008ed3642d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:28.573447 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:58:28.603407 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e8f6b7d5-055c-4931-87cf-a148cc82f57a tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:28.603916 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e8f6b7d5-055c-4931-87cf-a148cc82f57a tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:28.604356 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e8f6b7d5-055c-4931-87cf-a148cc82f57a tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:28.605084 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e8f6b7d5-055c-4931-87cf-a148cc82f57a tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:28.605543 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e8f6b7d5-055c-4931-87cf-a148cc82f57a tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:28.605980 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e8f6b7d5-055c-4931-87cf-a148cc82f57a tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:28.870075 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-e8f6b7d5-055c-4931-87cf-a148cc82f57a tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2facee4c6a40416e908083e126d2cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07a17a482a4e92b6ddbdee463c8029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:28.889184 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-e8f6b7d5-055c-4931-87cf-a148cc82f57a tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d" status: 200 len: 1504 microversion: 2.1 time: 0.333612 Oct 04 21:58:28.893227 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1586/3245] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:58:28 2022] GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d => generated 1504 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:58:28.907165 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-a1c63203-b8ad-4e61-b4ac-a6b9e335c792 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:28.909235 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-a1c63203-b8ad-4e61-b4ac-a6b9e335c792 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] [instance: 2764125d-9366-4c77-b1ee-7f188df21205] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:28.929141 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a1c63203-b8ad-4e61-b4ac-a6b9e335c792 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:28.931099 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a1c63203-b8ad-4e61-b4ac-a6b9e335c792 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:28.942522 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a1c63203-b8ad-4e61-b4ac-a6b9e335c792 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:28.942522 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a1c63203-b8ad-4e61-b4ac-a6b9e335c792 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:28.942522 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a1c63203-b8ad-4e61-b4ac-a6b9e335c792 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:28.942522 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a1c63203-b8ad-4e61-b4ac-a6b9e335c792 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:29.256205 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-a1c63203-b8ad-4e61-b4ac-a6b9e335c792 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c386b2ed7064073944085bf2a41f0de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d23c1f5719481483f4a28b76e45514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:29.279734 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-a1c63203-b8ad-4e61-b4ac-a6b9e335c792 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] 10.222.0.43 "GET /compute/v2.1/servers/2764125d-9366-4c77-b1ee-7f188df21205" status: 200 len: 1508 microversion: 2.1 time: 0.382856 Oct 04 21:58:29.290402 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1587/3246] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:58:28 2022] GET /compute/v2.1/servers/2764125d-9366-4c77-b1ee-7f188df21205 => generated 1508 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:58:29.296268 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e84d8e13-7b8b-4e04-b919-e4e581e6a503 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:29.297160 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-e84d8e13-7b8b-4e04-b919-e4e581e6a503 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: a4cf4fac-1e9b-4669-a6ff-30008ed3642d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:29.306165 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e84d8e13-7b8b-4e04-b919-e4e581e6a503 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:29.306968 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e84d8e13-7b8b-4e04-b919-e4e581e6a503 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:29.307747 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e84d8e13-7b8b-4e04-b919-e4e581e6a503 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:29.308636 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e84d8e13-7b8b-4e04-b919-e4e581e6a503 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:29.309729 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e84d8e13-7b8b-4e04-b919-e4e581e6a503 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:29.310506 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e84d8e13-7b8b-4e04-b919-e4e581e6a503 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:29.571415 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-e84d8e13-7b8b-4e04-b919-e4e581e6a503 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2facee4c6a40416e908083e126d2cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07a17a482a4e92b6ddbdee463c8029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:29.581861 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-e84d8e13-7b8b-4e04-b919-e4e581e6a503 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d" status: 200 len: 1504 microversion: 2.1 time: 0.296879 Oct 04 21:58:29.585297 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1588/3247] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:58:29 2022] GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d => generated 1504 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:58:29.641404 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-961e1f7b-4c3b-4efb-82bf-ae4aca60cd44 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:29.642599 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-961e1f7b-4c3b-4efb-82bf-ae4aca60cd44 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] [instance: d0b1b757-4a4d-4a7a-9a06-08f178a02984] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:29.692124 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-961e1f7b-4c3b-4efb-82bf-ae4aca60cd44 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:29.692695 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-961e1f7b-4c3b-4efb-82bf-ae4aca60cd44 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:29.693154 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-961e1f7b-4c3b-4efb-82bf-ae4aca60cd44 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:29.693900 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-961e1f7b-4c3b-4efb-82bf-ae4aca60cd44 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:29.702255 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-961e1f7b-4c3b-4efb-82bf-ae4aca60cd44 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:29.702255 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-961e1f7b-4c3b-4efb-82bf-ae4aca60cd44 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:29.963027 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-961e1f7b-4c3b-4efb-82bf-ae4aca60cd44 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:29.976074 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-961e1f7b-4c3b-4efb-82bf-ae4aca60cd44 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:29.984975 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-961e1f7b-4c3b-4efb-82bf-ae4aca60cd44 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:30.001787 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-961e1f7b-4c3b-4efb-82bf-ae4aca60cd44 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] 10.222.0.43 "GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984" status: 200 len: 1537 microversion: 2.91 time: 0.398334 Oct 04 21:58:30.028160 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1589/3248] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:58:29 2022] GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984 => generated 1537 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:58:30.034545 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-d5939af2-93b6-4b5a-9e09-8b2e39870503 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:30.035444 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-d5939af2-93b6-4b5a-9e09-8b2e39870503 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] [instance: 563105fe-37b7-495e-88bd-d524aa2395db] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:30.066936 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d5939af2-93b6-4b5a-9e09-8b2e39870503 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:30.067455 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d5939af2-93b6-4b5a-9e09-8b2e39870503 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:30.067911 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d5939af2-93b6-4b5a-9e09-8b2e39870503 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:30.068647 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d5939af2-93b6-4b5a-9e09-8b2e39870503 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:30.069113 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d5939af2-93b6-4b5a-9e09-8b2e39870503 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:30.069549 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d5939af2-93b6-4b5a-9e09-8b2e39870503 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:30.180803 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d5939af2-93b6-4b5a-9e09-8b2e39870503 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:30.183486 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d5939af2-93b6-4b5a-9e09-8b2e39870503 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:30.184670 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d5939af2-93b6-4b5a-9e09-8b2e39870503 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:30.185140 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.objects.instance [None req-d5939af2-93b6-4b5a-9e09-8b2e39870503 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lazy-loading 'fault' on Instance uuid 563105fe-37b7-495e-88bd-d524aa2395db {{(pid=134101) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:58:30.295264 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-d5939af2-93b6-4b5a-9e09-8b2e39870503 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a94113bec89469a844ede34890d6876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857b9057c949472b9a1862182a01356c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:30.309716 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-d5939af2-93b6-4b5a-9e09-8b2e39870503 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] 10.222.0.43 "GET /compute/v2.1/servers/563105fe-37b7-495e-88bd-d524aa2395db" status: 200 len: 1307 microversion: 2.1 time: 0.278648 Oct 04 21:58:30.311050 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1590/3249] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:58:30 2022] GET /compute/v2.1/servers/563105fe-37b7-495e-88bd-d524aa2395db => generated 1307 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:58:30.318377 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-fb9be80b-9bee-443a-a1c0-5547ae37e3f8 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:30.321763 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-fb9be80b-9bee-443a-a1c0-5547ae37e3f8 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] [instance: 830de6ad-adc6-4d16-ae9d-a29ae85e6cd2] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:30.337063 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fb9be80b-9bee-443a-a1c0-5547ae37e3f8 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:30.337745 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fb9be80b-9bee-443a-a1c0-5547ae37e3f8 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:30.340378 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fb9be80b-9bee-443a-a1c0-5547ae37e3f8 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:30.345620 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fb9be80b-9bee-443a-a1c0-5547ae37e3f8 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:30.346906 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fb9be80b-9bee-443a-a1c0-5547ae37e3f8 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:30.347369 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fb9be80b-9bee-443a-a1c0-5547ae37e3f8 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:30.373310 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-fb9be80b-9bee-443a-a1c0-5547ae37e3f8 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] HTTP exception thrown: Instance 830de6ad-adc6-4d16-ae9d-a29ae85e6cd2 could not be found. Oct 04 21:58:30.378404 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-fb9be80b-9bee-443a-a1c0-5547ae37e3f8 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Request method failure captured: Oct 04 21:58:30.378404 n-d-860284-1 devstack@n-api.service[134101]: request: GET /compute/v2.1/servers/830de6ad-adc6-4d16-ae9d-a29ae85e6cd2 HTTP/1.1 Oct 04 21:58:30.378404 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 21:58:30.378404 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 21:58:30.378404 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 21:58:30.378404 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 21:58:30.378404 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 21:58:30.378404 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 21:58:30.378404 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 21:58:30.378404 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 21:58:30.378404 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPKrZt3nblOdDsUFzAAZpDMMh8703cTcdQ0RDi0-vZIqNaW0VC8SgcCKzvg6od2lNB90Uf9KlBS5o4n9eJKBMAacfdhnSGze8EiYZLNbMV3g-RWdVfR_yf8g3HV5v2LMgZ0kkijL58bwvgRutnvuPtYMXM_DDTZnbhSxdRg3GzfZol4g Oct 04 21:58:30.378404 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 21:58:30.378404 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 21:58:30.378404 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 21:58:30.378404 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 21:58:30.378404 n-d-860284-1 devstack@n-api.service[134101]: X-Openstack-Nova-Api-Version: 2.42 Oct 04 21:58:30.378404 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 21:58:30.378404 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 21:58:30.378404 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: 2dd1e35c3cb643e3ad2afbe7edbbce8d Oct 04 21:58:30.378404 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-520322824 Oct 04 21:58:30.378404 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 21:58:30.378404 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 21:58:30.378404 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/2dd1e35c3cb643e3ad2afbe7edbbce8d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_2dd1e35c3cb643e3ad2afbe7edbbce8d", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/2dd1e35c3cb643e3ad2afbe7edbbce8d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/2dd1e35c3cb643e3ad2afbe7edbbce8d"}]}] Oct 04 21:58:30.378404 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-TaggedBootDevicesTest_v242-520322824 Oct 04 21:58:30.378404 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: 2dd1e35c3cb643e3ad2afbe7edbbce8d Oct 04 21:58:30.378404 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-520322824 Oct 04 21:58:30.378404 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-TaggedBootDevicesTest_v242-520322824-project Oct 04 21:58:30.378404 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 21:58:30.378404 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 21:58:30.378404 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 2bb934f4dc53470d8e35d71cccd756d9 Oct 04 21:58:30.378404 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-TaggedBootDevicesTest_v242-520322824-project Oct 04 21:58:30.378404 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 21:58:30.378404 n-d-860284-1 devstack@n-api.service[134101]: exception: Instance 830de6ad-adc6-4d16-ae9d-a29ae85e6cd2 could not be found. Oct 04 21:58:30.378404 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': '830de6ad-adc6-4d16-ae9d-a29ae85e6cd2'} Oct 04 21:58:30.378404 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:58:30.378404 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:58:30.378404 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:58:30.378404 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:58:30.378404 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:58:30.378404 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:58:30.378404 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:58:30.378404 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:58:30.378404 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:58:30.378404 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:58:30.378404 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 830de6ad-adc6-4d16-ae9d-a29ae85e6cd2 could not be found. Oct 04 21:58:30.378404 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:58:30.378404 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:58:30.378404 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:58:30.378404 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:58:30.378404 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:58:30.378404 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:58:30.378404 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:58:30.378404 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:58:30.378404 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:58:30.378404 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:58:30.378404 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:58:30.378404 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:58:30.378404 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:58:30.378404 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:58:30.378404 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:58:30.378404 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:58:30.378404 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 830de6ad-adc6-4d16-ae9d-a29ae85e6cd2 could not be found. Oct 04 21:58:30.378404 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:58:30.378404 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:58:30.385075 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:58:30.385075 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:58:30.385075 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:58:30.385075 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:58:30.385075 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:58:30.385075 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:58:30.385075 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 830de6ad-adc6-4d16-ae9d-a29ae85e6cd2 could not be found. Oct 04 21:58:30.385075 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:58:30.385075 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-fb9be80b-9bee-443a-a1c0-5547ae37e3f8 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Returning 404 to user: Instance 830de6ad-adc6-4d16-ae9d-a29ae85e6cd2 could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:58:30.385075 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-fb9be80b-9bee-443a-a1c0-5547ae37e3f8 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] 10.222.0.43 "GET /compute/v2.1/servers/830de6ad-adc6-4d16-ae9d-a29ae85e6cd2" status: 404 len: 111 microversion: 2.42 time: 0.064022 Oct 04 21:58:30.385075 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1591/3250] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:58:30 2022] GET /compute/v2.1/servers/830de6ad-adc6-4d16-ae9d-a29ae85e6cd2 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 21:58:30.388492 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-2ab5f2bd-70d3-4180-9fc3-5f07a2ae1632 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1646082295", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "300a434f-3ad3-472e-98dd-a1b7130cf104"}]}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:58:30.405774 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-2ab5f2bd-70d3-4180-9fc3-5f07a2ae1632 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Request method failure captured: Oct 04 21:58:30.405774 n-d-860284-1 devstack@n-api.service[134101]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 21:58:30.405774 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 21:58:30.405774 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 21:58:30.405774 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 21:58:30.405774 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 492 Oct 04 21:58:30.405774 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 21:58:30.405774 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 21:58:30.405774 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 21:58:30.405774 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 21:58:30.405774 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPKwu4cpW6hhBuWb-qV_7iYlwjOTpf5XWCl53BJjoosjlcj4wkmmOFzemCJVdBntIx8zJ1SF_z6VrRY8UJr7E8TQDJCRnVQMdNnh0-lZwGdqUzjOWSO31Ryb6n87Cka0g238a21JWok3h3GEhLB-7oCbN3bbcOGmkhd6UFueRxRluk24 Oct 04 21:58:30.405774 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 21:58:30.405774 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 21:58:30.405774 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 21:58:30.405774 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 21:58:30.405774 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 21:58:30.405774 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 21:58:30.405774 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: cf07a17a482a4e92b6ddbdee463c8029 Oct 04 21:58:30.405774 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-ServersNegativeTestJSON-1933663319 Oct 04 21:58:30.405774 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 21:58:30.405774 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 21:58:30.405774 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/cf07a17a482a4e92b6ddbdee463c8029"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_cf07a17a482a4e92b6ddbdee463c8029", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/cf07a17a482a4e92b6ddbdee463c8029"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/cf07a17a482a4e92b6ddbdee463c8029"}]}] Oct 04 21:58:30.405774 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-ServersNegativeTestJSON-1933663319 Oct 04 21:58:30.405774 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: cf07a17a482a4e92b6ddbdee463c8029 Oct 04 21:58:30.405774 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1933663319 Oct 04 21:58:30.405774 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-ServersNegativeTestJSON-1933663319-project Oct 04 21:58:30.405774 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 21:58:30.405774 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 21:58:30.405774 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 2facee4c6a40416e908083e126d2cfa3 Oct 04 21:58:30.405774 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-ServersNegativeTestJSON-1933663319-project Oct 04 21:58:30.405774 n-d-860284-1 devstack@n-api.service[134101]: Oct 04 21:58:30.405774 n-d-860284-1 devstack@n-api.service[134101]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1646082295", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "300a434f-3ad3-472e-98dd-a1b7130cf104"}]}} Oct 04 21:58:30.405774 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 21:58:30.405774 n-d-860284-1 devstack@n-api.service[134101]: exception: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 04 21:58:30.405774 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1646082295', 'imageRef': '58548514-5dac-426c-81f5-19e3fba33e23', 'flavorRef': '452', 'metadata': {'a': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}, 'networks': [{'uuid': '300a434f-3ad3-472e-98dd-a1b7130cf104'}]}}} Oct 04 21:58:30.405774 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:58:30.405774 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:58:30.405774 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 21:58:30.405774 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 21:58:30.405774 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 21:58:30.405774 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise error Oct 04 21:58:30.405774 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 04 21:58:30.405774 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:58:30.405774 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['metadata']['patternProperties']['^[a-zA-Z0-9-_:. ]{1,255}$']: Oct 04 21:58:30.405774 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi {'maxLength': 255, 'type': 'string'} Oct 04 21:58:30.405774 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:58:30.405774 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi On instance['server']['metadata']: Oct 04 21:58:30.410921 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' Oct 04 21:58:30.410921 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:58:30.410921 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:58:30.410921 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:58:30.410921 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:58:30.410921 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:58:30.410921 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:58:30.410921 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:58:30.410921 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:58:30.410921 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:58:30.410921 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:58:30.410921 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:58:30.410921 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:58:30.410921 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 21:58:30.410921 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 21:58:30.410921 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 21:58:30.410921 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 21:58:30.410921 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 21:58:30.410921 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 21:58:30.410921 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 04 21:58:30.410921 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:58:30.410921 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:58:30.410921 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:58:30.410921 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:58:30.410921 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:58:30.410921 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:58:30.410921 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 21:58:30.410921 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 21:58:30.410921 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 04 21:58:30.410921 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:58:30.410921 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-2ab5f2bd-70d3-4180-9fc3-5f07a2ae1632 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:58:30.410921 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-2ab5f2bd-70d3-4180-9fc3-5f07a2ae1632 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.025198 Oct 04 21:58:30.410921 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1592/3251] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 21:58:30 2022] POST /compute/v2.1/servers => generated 624 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 21:58:30.422722 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-cca5841b-2831-4677-9dab-8163d419fee4 req-c7e8678c-6863-40e8-ad86-5bfab687b692 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "563105fe-37b7-495e-88bd-d524aa2395db", "name": "network-vif-deleted", "tag": "8efd08fb-4170-4168-9227-d8d2e4a16093"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:58:30.444742 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-cca5841b-2831-4677-9dab-8163d419fee4 req-c7e8678c-6863-40e8-ad86-5bfab687b692 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:30.445598 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-cca5841b-2831-4677-9dab-8163d419fee4 req-c7e8678c-6863-40e8-ad86-5bfab687b692 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:30.446229 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-cca5841b-2831-4677-9dab-8163d419fee4 req-c7e8678c-6863-40e8-ad86-5bfab687b692 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:30.459741 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-cca5841b-2831-4677-9dab-8163d419fee4 req-c7e8678c-6863-40e8-ad86-5bfab687b692 service nova] Creating event network-vif-deleted:8efd08fb-4170-4168-9227-d8d2e4a16093 for instance 563105fe-37b7-495e-88bd-d524aa2395db on n-h1-860284-1 Oct 04 21:58:30.467279 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-cca5841b-2831-4677-9dab-8163d419fee4 req-c7e8678c-6863-40e8-ad86-5bfab687b692 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055591 Oct 04 21:58:30.468169 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1593/3252] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:58:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:58:30.477599 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-ebe93b97-9ea7-4245-b223-9b486eb6c5fc tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:30.478735 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-ebe93b97-9ea7-4245-b223-9b486eb6c5fc tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] [instance: 2764125d-9366-4c77-b1ee-7f188df21205] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:30.486882 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ebe93b97-9ea7-4245-b223-9b486eb6c5fc tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:30.487725 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ebe93b97-9ea7-4245-b223-9b486eb6c5fc tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:30.488497 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ebe93b97-9ea7-4245-b223-9b486eb6c5fc tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:30.491883 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ebe93b97-9ea7-4245-b223-9b486eb6c5fc tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:30.492884 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ebe93b97-9ea7-4245-b223-9b486eb6c5fc tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:30.493516 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ebe93b97-9ea7-4245-b223-9b486eb6c5fc tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:30.763043 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-ebe93b97-9ea7-4245-b223-9b486eb6c5fc tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c386b2ed7064073944085bf2a41f0de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d23c1f5719481483f4a28b76e45514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:30.780661 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-ebe93b97-9ea7-4245-b223-9b486eb6c5fc tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] 10.222.0.43 "GET /compute/v2.1/servers/2764125d-9366-4c77-b1ee-7f188df21205" status: 200 len: 1508 microversion: 2.1 time: 0.308677 Oct 04 21:58:30.800954 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1594/3253] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:58:30 2022] GET /compute/v2.1/servers/2764125d-9366-4c77-b1ee-7f188df21205 => generated 1508 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:58:30.810215 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-56a2e9d5-a3d4-45ca-b692-89fabb21b5c4 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Calling method '.version_select at 0x7fbb2e3cfe50>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:30.877254 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-56a2e9d5-a3d4-45ca-b692-89fabb21b5c4 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1876914950" status: 204 len: 0 microversion: 2.42 time: 0.074649 Oct 04 21:58:30.879775 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1595/3254] 10.222.0.43 () {60 vars in 1262 bytes} [Tue Oct 4 21:58:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1876914950 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 21:58:30.901063 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-31eb8706-1152-4238-98f4-12b85d8d8533 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:30.908107 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-31eb8706-1152-4238-98f4-12b85d8d8533 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: a4cf4fac-1e9b-4669-a6ff-30008ed3642d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:30.926038 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-31eb8706-1152-4238-98f4-12b85d8d8533 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:30.927830 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-31eb8706-1152-4238-98f4-12b85d8d8533 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:30.928300 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-31eb8706-1152-4238-98f4-12b85d8d8533 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:30.929021 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-31eb8706-1152-4238-98f4-12b85d8d8533 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:30.929794 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-31eb8706-1152-4238-98f4-12b85d8d8533 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:30.930534 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-31eb8706-1152-4238-98f4-12b85d8d8533 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:30.967215 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:58:31.158261 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-31eb8706-1152-4238-98f4-12b85d8d8533 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2facee4c6a40416e908083e126d2cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07a17a482a4e92b6ddbdee463c8029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:31.168620 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-31eb8706-1152-4238-98f4-12b85d8d8533 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d" status: 200 len: 1504 microversion: 2.1 time: 0.287493 Oct 04 21:58:31.183245 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1596/3255] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:58:30 2022] GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d => generated 1504 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:58:31.199026 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-6edf0332-02b4-41e1-b0e5-3c6fd533208e tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:31.200274 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-6edf0332-02b4-41e1-b0e5-3c6fd533208e tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] [instance: d0b1b757-4a4d-4a7a-9a06-08f178a02984] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:31.211660 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6edf0332-02b4-41e1-b0e5-3c6fd533208e tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:31.213209 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6edf0332-02b4-41e1-b0e5-3c6fd533208e tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:31.215533 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6edf0332-02b4-41e1-b0e5-3c6fd533208e tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:31.217555 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6edf0332-02b4-41e1-b0e5-3c6fd533208e tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:31.218279 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6edf0332-02b4-41e1-b0e5-3c6fd533208e tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:31.219059 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6edf0332-02b4-41e1-b0e5-3c6fd533208e tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:31.383168 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-6edf0332-02b4-41e1-b0e5-3c6fd533208e tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:31.393707 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-6edf0332-02b4-41e1-b0e5-3c6fd533208e tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:31.395571 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-6edf0332-02b4-41e1-b0e5-3c6fd533208e tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:31.407590 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-6edf0332-02b4-41e1-b0e5-3c6fd533208e tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] 10.222.0.43 "GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984" status: 200 len: 1537 microversion: 2.91 time: 0.222044 Oct 04 21:58:31.408198 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1597/3256] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:58:31 2022] GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984 => generated 1537 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:58:31.422506 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-34e4a37a-117c-4392-91d9-602a1f3a6e9a tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:31.423338 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-34e4a37a-117c-4392-91d9-602a1f3a6e9a tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: a4cf4fac-1e9b-4669-a6ff-30008ed3642d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:31.438674 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-34e4a37a-117c-4392-91d9-602a1f3a6e9a tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:31.439178 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-34e4a37a-117c-4392-91d9-602a1f3a6e9a tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:31.439625 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-34e4a37a-117c-4392-91d9-602a1f3a6e9a tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:31.440338 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-34e4a37a-117c-4392-91d9-602a1f3a6e9a tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:31.440801 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-34e4a37a-117c-4392-91d9-602a1f3a6e9a tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:31.441227 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-34e4a37a-117c-4392-91d9-602a1f3a6e9a tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:32.068654 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-34e4a37a-117c-4392-91d9-602a1f3a6e9a tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2facee4c6a40416e908083e126d2cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07a17a482a4e92b6ddbdee463c8029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:32.081190 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-34e4a37a-117c-4392-91d9-602a1f3a6e9a tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d" status: 200 len: 1504 microversion: 2.1 time: 0.667953 Oct 04 21:58:32.094418 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1598/3257] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:58:31 2022] GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d => generated 1504 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:58:32.094418 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-7c5de5cb-ae34-43a8-9393-9d5c4621cb29 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:32.094418 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-7c5de5cb-ae34-43a8-9393-9d5c4621cb29 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] [instance: 563105fe-37b7-495e-88bd-d524aa2395db] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:32.107953 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7c5de5cb-ae34-43a8-9393-9d5c4621cb29 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:32.107953 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7c5de5cb-ae34-43a8-9393-9d5c4621cb29 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:32.107953 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7c5de5cb-ae34-43a8-9393-9d5c4621cb29 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:32.108261 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7c5de5cb-ae34-43a8-9393-9d5c4621cb29 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:32.108506 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7c5de5cb-ae34-43a8-9393-9d5c4621cb29 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:32.114922 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7c5de5cb-ae34-43a8-9393-9d5c4621cb29 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:32.145040 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-7c5de5cb-ae34-43a8-9393-9d5c4621cb29 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] HTTP exception thrown: Instance 563105fe-37b7-495e-88bd-d524aa2395db could not be found. Oct 04 21:58:32.147036 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-7c5de5cb-ae34-43a8-9393-9d5c4621cb29 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Request method failure captured: Oct 04 21:58:32.147036 n-d-860284-1 devstack@n-api.service[134101]: request: GET /compute/v2.1/servers/563105fe-37b7-495e-88bd-d524aa2395db HTTP/1.1 Oct 04 21:58:32.147036 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 21:58:32.147036 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 21:58:32.147036 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 21:58:32.147036 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 21:58:32.147036 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 21:58:32.147036 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 21:58:32.147036 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 21:58:32.147036 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 21:58:32.147036 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPKwxHq-SLbr8plpIYAwHk55Zhpy6B1-YtGRWXNLl-1cwijkfXNkTw2AU5o7D_xPOQWmxGLD-APAfgD3kVxUVRGAKWpFR6h1KGphHUQtDunP3xcPTMgHc5WHubZfaiXYNUvC480KZ2YsIyxCqoTqii-1slOljU73CX1Q6KKqXZhRGn_U Oct 04 21:58:32.147036 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 21:58:32.147036 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 21:58:32.147036 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 21:58:32.147036 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 21:58:32.147036 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 21:58:32.147036 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 21:58:32.147036 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: 857b9057c949472b9a1862182a01356c Oct 04 21:58:32.147036 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-MultipleCreateTestJSON-1546607932 Oct 04 21:58:32.147036 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 21:58:32.147036 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 21:58:32.147036 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/857b9057c949472b9a1862182a01356c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_857b9057c949472b9a1862182a01356c", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/857b9057c949472b9a1862182a01356c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/857b9057c949472b9a1862182a01356c"}]}] Oct 04 21:58:32.147036 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-MultipleCreateTestJSON-1546607932 Oct 04 21:58:32.147036 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: 857b9057c949472b9a1862182a01356c Oct 04 21:58:32.147036 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1546607932 Oct 04 21:58:32.147036 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-MultipleCreateTestJSON-1546607932-project Oct 04 21:58:32.147036 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 21:58:32.147036 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 21:58:32.147036 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 0a94113bec89469a844ede34890d6876 Oct 04 21:58:32.147036 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-MultipleCreateTestJSON-1546607932-project Oct 04 21:58:32.147036 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 21:58:32.147036 n-d-860284-1 devstack@n-api.service[134101]: exception: Instance 563105fe-37b7-495e-88bd-d524aa2395db could not be found. Oct 04 21:58:32.147036 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': '563105fe-37b7-495e-88bd-d524aa2395db'} Oct 04 21:58:32.147036 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:58:32.147036 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:58:32.147036 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:58:32.147036 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:58:32.147036 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:58:32.147036 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:58:32.147036 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:58:32.147036 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:58:32.147036 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:58:32.147036 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:58:32.147036 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 563105fe-37b7-495e-88bd-d524aa2395db could not be found. Oct 04 21:58:32.147036 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:58:32.147036 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:58:32.147036 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:58:32.147036 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:58:32.147036 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:58:32.147036 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:58:32.147036 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:58:32.147036 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:58:32.147036 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:58:32.147036 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:58:32.147036 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:58:32.147036 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:58:32.147036 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:58:32.147036 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:58:32.147036 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:58:32.147036 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:58:32.147036 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 563105fe-37b7-495e-88bd-d524aa2395db could not be found. Oct 04 21:58:32.147036 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:58:32.147036 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:58:32.147036 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:58:32.152395 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:58:32.152395 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:58:32.152395 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:58:32.152395 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:58:32.152395 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:58:32.152395 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 563105fe-37b7-495e-88bd-d524aa2395db could not be found. Oct 04 21:58:32.152395 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:58:32.155185 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-7c5de5cb-ae34-43a8-9393-9d5c4621cb29 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Returning 404 to user: Instance 563105fe-37b7-495e-88bd-d524aa2395db could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:58:32.157185 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-7c5de5cb-ae34-43a8-9393-9d5c4621cb29 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] 10.222.0.43 "GET /compute/v2.1/servers/563105fe-37b7-495e-88bd-d524aa2395db" status: 404 len: 111 microversion: 2.1 time: 0.073497 Oct 04 21:58:32.162022 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1599/3258] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:58:32 2022] GET /compute/v2.1/servers/563105fe-37b7-495e-88bd-d524aa2395db => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:58:32.167865 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-9607c779-fc0d-4208-86bd-184c3d0ead8d tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:32.169357 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-9607c779-fc0d-4208-86bd-184c3d0ead8d tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] [instance: 2764125d-9366-4c77-b1ee-7f188df21205] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:32.181915 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9607c779-fc0d-4208-86bd-184c3d0ead8d tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:32.184106 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9607c779-fc0d-4208-86bd-184c3d0ead8d tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:32.184990 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9607c779-fc0d-4208-86bd-184c3d0ead8d tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:32.186271 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9607c779-fc0d-4208-86bd-184c3d0ead8d tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:32.186855 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9607c779-fc0d-4208-86bd-184c3d0ead8d tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:32.187626 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9607c779-fc0d-4208-86bd-184c3d0ead8d tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:32.361759 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-9607c779-fc0d-4208-86bd-184c3d0ead8d tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c386b2ed7064073944085bf2a41f0de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d23c1f5719481483f4a28b76e45514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:32.388052 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-9607c779-fc0d-4208-86bd-184c3d0ead8d tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] 10.222.0.43 "GET /compute/v2.1/servers/2764125d-9366-4c77-b1ee-7f188df21205" status: 200 len: 1466 microversion: 2.1 time: 0.224490 Oct 04 21:58:32.389808 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1600/3259] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:58:32 2022] GET /compute/v2.1/servers/2764125d-9366-4c77-b1ee-7f188df21205 => generated 1466 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:58:32.402119 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-810effac-f930-4e3c-8a93-34544d12c236 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:32.403446 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-810effac-f930-4e3c-8a93-34544d12c236 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] [instance: 7618c19f-d7bb-4f37-8454-76570009eb30] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:32.414520 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-810effac-f930-4e3c-8a93-34544d12c236 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:32.415406 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-810effac-f930-4e3c-8a93-34544d12c236 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:32.416009 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-810effac-f930-4e3c-8a93-34544d12c236 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:32.417557 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-810effac-f930-4e3c-8a93-34544d12c236 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:32.418188 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-810effac-f930-4e3c-8a93-34544d12c236 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:32.418914 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-810effac-f930-4e3c-8a93-34544d12c236 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:32.690810 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-810effac-f930-4e3c-8a93-34544d12c236 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a94113bec89469a844ede34890d6876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857b9057c949472b9a1862182a01356c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:32.700015 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-810effac-f930-4e3c-8a93-34544d12c236 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] 10.222.0.43 "GET /compute/v2.1/servers/7618c19f-d7bb-4f37-8454-76570009eb30" status: 200 len: 1302 microversion: 2.1 time: 0.302732 Oct 04 21:58:32.705815 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1601/3260] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:58:32 2022] GET /compute/v2.1/servers/7618c19f-d7bb-4f37-8454-76570009eb30 => generated 1302 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:58:32.711422 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-664ab2f5-9f7c-4054-b7c1-fe6c94c6b504 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452", "networks": [{"uuid": "300a434f-3ad3-472e-98dd-a1b7130cf104"}]}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:58:32.723363 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-664ab2f5-9f7c-4054-b7c1-fe6c94c6b504 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Request method failure captured: Oct 04 21:58:32.723363 n-d-860284-1 devstack@n-api.service[134101]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 21:58:32.723363 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 21:58:32.723363 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 21:58:32.723363 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 21:58:32.723363 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 416 Oct 04 21:58:32.723363 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 21:58:32.723363 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 21:58:32.723363 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 21:58:32.723363 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 21:58:32.723363 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPKwu4cpW6hhBuWb-qV_7iYlwjOTpf5XWCl53BJjoosjlcj4wkmmOFzemCJVdBntIx8zJ1SF_z6VrRY8UJr7E8TQDJCRnVQMdNnh0-lZwGdqUzjOWSO31Ryb6n87Cka0g238a21JWok3h3GEhLB-7oCbN3bbcOGmkhd6UFueRxRluk24 Oct 04 21:58:32.723363 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 21:58:32.723363 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 21:58:32.723363 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 21:58:32.723363 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 21:58:32.723363 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 21:58:32.723363 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 21:58:32.723363 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: cf07a17a482a4e92b6ddbdee463c8029 Oct 04 21:58:32.723363 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-ServersNegativeTestJSON-1933663319 Oct 04 21:58:32.723363 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 21:58:32.723363 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 21:58:32.723363 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/cf07a17a482a4e92b6ddbdee463c8029"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_cf07a17a482a4e92b6ddbdee463c8029", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/cf07a17a482a4e92b6ddbdee463c8029"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/cf07a17a482a4e92b6ddbdee463c8029"}]}] Oct 04 21:58:32.723363 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-ServersNegativeTestJSON-1933663319 Oct 04 21:58:32.723363 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: cf07a17a482a4e92b6ddbdee463c8029 Oct 04 21:58:32.723363 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1933663319 Oct 04 21:58:32.723363 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-ServersNegativeTestJSON-1933663319-project Oct 04 21:58:32.723363 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 21:58:32.723363 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 21:58:32.723363 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 2facee4c6a40416e908083e126d2cfa3 Oct 04 21:58:32.723363 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-ServersNegativeTestJSON-1933663319-project Oct 04 21:58:32.723363 n-d-860284-1 devstack@n-api.service[134101]: Oct 04 21:58:32.723363 n-d-860284-1 devstack@n-api.service[134101]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452", "networks": [{"uuid": "300a434f-3ad3-472e-98dd-a1b7130cf104"}]}} Oct 04 21:58:32.723363 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 21:58:32.723363 n-d-860284-1 devstack@n-api.service[134101]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 21:58:32.723363 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'imageRef': '58548514-5dac-426c-81f5-19e3fba33e23', 'flavorRef': '452', 'networks': [{'uuid': '300a434f-3ad3-472e-98dd-a1b7130cf104'}]}}} Oct 04 21:58:32.723363 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:58:32.723363 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:58:32.723363 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 21:58:32.723363 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 21:58:32.723363 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 21:58:32.723363 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise error Oct 04 21:58:32.723363 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 21:58:32.723363 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:58:32.723363 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Oct 04 21:58:32.723363 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 04 21:58:32.723363 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:58:32.723363 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 21:58:32.723363 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 04 21:58:32.723363 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:58:32.723363 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:58:32.727531 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:58:32.727531 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:58:32.727531 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:58:32.727531 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:58:32.727531 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:58:32.727531 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:58:32.727531 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:58:32.727531 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:58:32.727531 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:58:32.727531 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:58:32.727531 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 21:58:32.727531 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 21:58:32.727531 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 21:58:32.727531 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 21:58:32.727531 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 21:58:32.727531 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 21:58:32.727531 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 21:58:32.727531 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:58:32.727531 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:58:32.727531 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:58:32.727531 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:58:32.727531 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:58:32.727531 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:58:32.727531 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 21:58:32.727531 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 21:58:32.727531 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 21:58:32.727531 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:58:32.730588 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-664ab2f5-9f7c-4054-b7c1-fe6c94c6b504 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:58:32.731677 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-664ab2f5-9f7c-4054-b7c1-fe6c94c6b504 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.024489 Oct 04 21:58:32.736485 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1602/3261] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 21:58:32 2022] POST /compute/v2.1/servers => generated 619 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 21:58:32.742890 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-43e38fc0-6f68-42e4-80e1-1ac0add8c43f tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:32.744012 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-43e38fc0-6f68-42e4-80e1-1ac0add8c43f tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] [instance: d0b1b757-4a4d-4a7a-9a06-08f178a02984] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:32.752605 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-43e38fc0-6f68-42e4-80e1-1ac0add8c43f tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:32.753412 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-43e38fc0-6f68-42e4-80e1-1ac0add8c43f tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:32.754086 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-43e38fc0-6f68-42e4-80e1-1ac0add8c43f tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:32.755128 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-43e38fc0-6f68-42e4-80e1-1ac0add8c43f tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:32.755803 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-43e38fc0-6f68-42e4-80e1-1ac0add8c43f tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:32.756468 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-43e38fc0-6f68-42e4-80e1-1ac0add8c43f tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:32.946777 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-43e38fc0-6f68-42e4-80e1-1ac0add8c43f tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:32.959258 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-43e38fc0-6f68-42e4-80e1-1ac0add8c43f tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:32.963560 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-43e38fc0-6f68-42e4-80e1-1ac0add8c43f tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:32.985933 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-43e38fc0-6f68-42e4-80e1-1ac0add8c43f tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] 10.222.0.43 "GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984" status: 200 len: 1537 microversion: 2.91 time: 0.247963 Oct 04 21:58:32.987218 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1603/3262] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:58:32 2022] GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984 => generated 1537 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:58:32.992702 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-3408659b-7bf0-4f64-a60e-8a0dfeb77fd1 req-026c5596-6ea6-4314-89b9-18f1c93c8158 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7618c19f-d7bb-4f37-8454-76570009eb30", "name": "network-vif-deleted", "tag": "91e0e68c-517b-4d17-839d-fdcdae7c269b"}, {"server_uuid": "2764125d-9366-4c77-b1ee-7f188df21205", "name": "network-vif-deleted", "tag": "56748744-2cbd-4205-8496-e4ad97390937"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:58:33.006612 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-3408659b-7bf0-4f64-a60e-8a0dfeb77fd1 req-026c5596-6ea6-4314-89b9-18f1c93c8158 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:33.007350 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-3408659b-7bf0-4f64-a60e-8a0dfeb77fd1 req-026c5596-6ea6-4314-89b9-18f1c93c8158 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:33.007963 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-3408659b-7bf0-4f64-a60e-8a0dfeb77fd1 req-026c5596-6ea6-4314-89b9-18f1c93c8158 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:33.025883 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-3408659b-7bf0-4f64-a60e-8a0dfeb77fd1 req-026c5596-6ea6-4314-89b9-18f1c93c8158 service nova] Creating event network-vif-deleted:91e0e68c-517b-4d17-839d-fdcdae7c269b for instance 7618c19f-d7bb-4f37-8454-76570009eb30 on n-h2-860284-1 Oct 04 21:58:33.026626 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-3408659b-7bf0-4f64-a60e-8a0dfeb77fd1 req-026c5596-6ea6-4314-89b9-18f1c93c8158 service nova] Creating event network-vif-deleted:56748744-2cbd-4205-8496-e4ad97390937 for instance 2764125d-9366-4c77-b1ee-7f188df21205 on n-h2-860284-1 Oct 04 21:58:33.033757 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-3408659b-7bf0-4f64-a60e-8a0dfeb77fd1 req-026c5596-6ea6-4314-89b9-18f1c93c8158 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.045023 Oct 04 21:58:33.035841 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1604/3263] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:58:32 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:58:33.043759 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-380982ab-5bad-4e01-9d49-0080330d450e tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:33.044701 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-380982ab-5bad-4e01-9d49-0080330d450e tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: a4cf4fac-1e9b-4669-a6ff-30008ed3642d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:33.052961 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-380982ab-5bad-4e01-9d49-0080330d450e tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:33.053736 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-380982ab-5bad-4e01-9d49-0080330d450e tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:33.054577 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-380982ab-5bad-4e01-9d49-0080330d450e tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:33.055618 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-380982ab-5bad-4e01-9d49-0080330d450e tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:33.056238 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-380982ab-5bad-4e01-9d49-0080330d450e tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:33.056827 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-380982ab-5bad-4e01-9d49-0080330d450e tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:33.501219 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-380982ab-5bad-4e01-9d49-0080330d450e tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2facee4c6a40416e908083e126d2cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07a17a482a4e92b6ddbdee463c8029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:33.512379 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-380982ab-5bad-4e01-9d49-0080330d450e tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d" status: 200 len: 1504 microversion: 2.1 time: 0.474852 Oct 04 21:58:33.513302 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1605/3264] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:58:33 2022] GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d => generated 1504 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:58:33.521068 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-1fd5540b-1e16-42de-bbb4-fa4b517fb201 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:33.521704 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-1fd5540b-1e16-42de-bbb4-fa4b517fb201 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] [instance: 2764125d-9366-4c77-b1ee-7f188df21205] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:33.533762 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1fd5540b-1e16-42de-bbb4-fa4b517fb201 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:33.534267 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1fd5540b-1e16-42de-bbb4-fa4b517fb201 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:33.539103 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1fd5540b-1e16-42de-bbb4-fa4b517fb201 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:33.540764 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1fd5540b-1e16-42de-bbb4-fa4b517fb201 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:33.541823 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1fd5540b-1e16-42de-bbb4-fa4b517fb201 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:33.542551 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1fd5540b-1e16-42de-bbb4-fa4b517fb201 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:33.566103 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-1fd5540b-1e16-42de-bbb4-fa4b517fb201 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] HTTP exception thrown: Instance 2764125d-9366-4c77-b1ee-7f188df21205 could not be found. Oct 04 21:58:33.571869 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-1fd5540b-1e16-42de-bbb4-fa4b517fb201 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Request method failure captured: Oct 04 21:58:33.571869 n-d-860284-1 devstack@n-api.service[134101]: request: GET /compute/v2.1/servers/2764125d-9366-4c77-b1ee-7f188df21205 HTTP/1.1 Oct 04 21:58:33.571869 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 21:58:33.571869 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 21:58:33.571869 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 21:58:33.571869 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 21:58:33.571869 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 21:58:33.571869 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 21:58:33.571869 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 21:58:33.571869 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 21:58:33.571869 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPKxPeYtLmdnsClxZ1p2G5KlwdRbtWrDe5ncE8JYJpmVijm2h_Z8ZWtVWcDs1WnZZRHKQJFCqPFeX1QMkbZDawWh46Q7uxBxcSSXKSvd7aNCh5Xan8N0yc3AbT-QAuHIfFIEcrMqGP8ws0r4_q4m3RgrLM-qI_CxrWVRqfsZk551kPsw Oct 04 21:58:33.571869 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 21:58:33.571869 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 21:58:33.571869 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 21:58:33.571869 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 21:58:33.571869 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 21:58:33.571869 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 21:58:33.571869 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: b7d23c1f5719481483f4a28b76e45514 Oct 04 21:58:33.571869 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-TestServerAdvancedOps-1068430223 Oct 04 21:58:33.571869 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 21:58:33.571869 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 21:58:33.571869 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b7d23c1f5719481483f4a28b76e45514"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_b7d23c1f5719481483f4a28b76e45514", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b7d23c1f5719481483f4a28b76e45514"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/b7d23c1f5719481483f4a28b76e45514"}]}] Oct 04 21:58:33.571869 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-TestServerAdvancedOps-1068430223 Oct 04 21:58:33.571869 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: b7d23c1f5719481483f4a28b76e45514 Oct 04 21:58:33.571869 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-TestServerAdvancedOps-1068430223 Oct 04 21:58:33.571869 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-TestServerAdvancedOps-1068430223-project Oct 04 21:58:33.571869 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 21:58:33.571869 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 21:58:33.571869 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 3c386b2ed7064073944085bf2a41f0de Oct 04 21:58:33.571869 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-TestServerAdvancedOps-1068430223-project Oct 04 21:58:33.571869 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 21:58:33.571869 n-d-860284-1 devstack@n-api.service[134101]: exception: Instance 2764125d-9366-4c77-b1ee-7f188df21205 could not be found. Oct 04 21:58:33.571869 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': '2764125d-9366-4c77-b1ee-7f188df21205'} Oct 04 21:58:33.571869 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:58:33.571869 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:58:33.571869 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:58:33.571869 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:58:33.571869 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:58:33.571869 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:58:33.571869 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:58:33.571869 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:58:33.571869 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:58:33.571869 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:58:33.571869 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2764125d-9366-4c77-b1ee-7f188df21205 could not be found. Oct 04 21:58:33.571869 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:58:33.571869 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:58:33.571869 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:58:33.571869 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:58:33.571869 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:58:33.571869 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:58:33.571869 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:58:33.571869 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:58:33.571869 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:58:33.571869 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:58:33.571869 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:58:33.571869 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:58:33.571869 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:58:33.571869 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:58:33.571869 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:58:33.571869 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:58:33.571869 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2764125d-9366-4c77-b1ee-7f188df21205 could not be found. Oct 04 21:58:33.571869 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:58:33.571869 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:58:33.571869 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:58:33.577681 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:58:33.577681 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:58:33.577681 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:58:33.577681 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:58:33.577681 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:58:33.577681 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2764125d-9366-4c77-b1ee-7f188df21205 could not be found. Oct 04 21:58:33.577681 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:58:33.577681 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-1fd5540b-1e16-42de-bbb4-fa4b517fb201 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] Returning 404 to user: Instance 2764125d-9366-4c77-b1ee-7f188df21205 could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:58:33.577681 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-1fd5540b-1e16-42de-bbb4-fa4b517fb201 tempest-TestServerAdvancedOps-1068430223 tempest-TestServerAdvancedOps-1068430223-project] 10.222.0.43 "GET /compute/v2.1/servers/2764125d-9366-4c77-b1ee-7f188df21205" status: 404 len: 111 microversion: 2.1 time: 0.062555 Oct 04 21:58:33.582243 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1606/3265] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:58:33 2022] GET /compute/v2.1/servers/2764125d-9366-4c77-b1ee-7f188df21205 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:58:33.587233 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-dc85cf85-2c73-4720-926e-582be57c94ed tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:33.588016 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-dc85cf85-2c73-4720-926e-582be57c94ed tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: a4cf4fac-1e9b-4669-a6ff-30008ed3642d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:33.595697 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dc85cf85-2c73-4720-926e-582be57c94ed tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:33.596209 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dc85cf85-2c73-4720-926e-582be57c94ed tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:33.596658 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dc85cf85-2c73-4720-926e-582be57c94ed tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:33.597452 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:58:33.598104 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dc85cf85-2c73-4720-926e-582be57c94ed tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:33.598559 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dc85cf85-2c73-4720-926e-582be57c94ed tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:33.599172 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dc85cf85-2c73-4720-926e-582be57c94ed tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:33.622157 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=1 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:58:33.904864 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-dc85cf85-2c73-4720-926e-582be57c94ed tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2facee4c6a40416e908083e126d2cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07a17a482a4e92b6ddbdee463c8029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:33.917340 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-dc85cf85-2c73-4720-926e-582be57c94ed tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d" status: 200 len: 1504 microversion: 2.1 time: 0.333819 Oct 04 21:58:33.919798 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1607/3266] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:58:33 2022] GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d => generated 1504 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:58:33.934107 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-8de9930d-4fac-4808-9e8e-33703de935c6 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:33.934772 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-8de9930d-4fac-4808-9e8e-33703de935c6 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] [instance: 7618c19f-d7bb-4f37-8454-76570009eb30] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:33.956707 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8de9930d-4fac-4808-9e8e-33703de935c6 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:33.957228 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8de9930d-4fac-4808-9e8e-33703de935c6 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:33.957704 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8de9930d-4fac-4808-9e8e-33703de935c6 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:33.958669 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8de9930d-4fac-4808-9e8e-33703de935c6 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:33.959316 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8de9930d-4fac-4808-9e8e-33703de935c6 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:33.959956 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8de9930d-4fac-4808-9e8e-33703de935c6 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:33.988629 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-8de9930d-4fac-4808-9e8e-33703de935c6 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] HTTP exception thrown: Instance 7618c19f-d7bb-4f37-8454-76570009eb30 could not be found. Oct 04 21:58:33.993039 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-8de9930d-4fac-4808-9e8e-33703de935c6 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Request method failure captured: Oct 04 21:58:33.993039 n-d-860284-1 devstack@n-api.service[134101]: request: GET /compute/v2.1/servers/7618c19f-d7bb-4f37-8454-76570009eb30 HTTP/1.1 Oct 04 21:58:33.993039 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 21:58:33.993039 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 21:58:33.993039 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 21:58:33.993039 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 21:58:33.993039 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 21:58:33.993039 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 21:58:33.993039 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 21:58:33.993039 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 21:58:33.993039 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPKwxHq-SLbr8plpIYAwHk55Zhpy6B1-YtGRWXNLl-1cwijkfXNkTw2AU5o7D_xPOQWmxGLD-APAfgD3kVxUVRGAKWpFR6h1KGphHUQtDunP3xcPTMgHc5WHubZfaiXYNUvC480KZ2YsIyxCqoTqii-1slOljU73CX1Q6KKqXZhRGn_U Oct 04 21:58:33.993039 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 21:58:33.993039 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 21:58:33.993039 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 21:58:33.993039 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 21:58:33.993039 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 21:58:33.993039 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 21:58:33.993039 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: 857b9057c949472b9a1862182a01356c Oct 04 21:58:33.993039 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-MultipleCreateTestJSON-1546607932 Oct 04 21:58:33.993039 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 21:58:33.993039 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 21:58:33.993039 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/857b9057c949472b9a1862182a01356c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_857b9057c949472b9a1862182a01356c", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/857b9057c949472b9a1862182a01356c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/857b9057c949472b9a1862182a01356c"}]}] Oct 04 21:58:33.993039 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-MultipleCreateTestJSON-1546607932 Oct 04 21:58:33.993039 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: 857b9057c949472b9a1862182a01356c Oct 04 21:58:33.993039 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1546607932 Oct 04 21:58:33.993039 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-MultipleCreateTestJSON-1546607932-project Oct 04 21:58:33.993039 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 21:58:33.993039 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 21:58:33.993039 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 0a94113bec89469a844ede34890d6876 Oct 04 21:58:33.993039 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-MultipleCreateTestJSON-1546607932-project Oct 04 21:58:33.993039 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 21:58:33.993039 n-d-860284-1 devstack@n-api.service[134101]: exception: Instance 7618c19f-d7bb-4f37-8454-76570009eb30 could not be found. Oct 04 21:58:33.993039 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': '7618c19f-d7bb-4f37-8454-76570009eb30'} Oct 04 21:58:33.993039 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:58:33.993039 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:58:33.993039 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:58:33.993039 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:58:33.993039 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:58:33.993039 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:58:33.993039 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:58:33.993039 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:58:33.993039 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:58:33.993039 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:58:33.993039 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7618c19f-d7bb-4f37-8454-76570009eb30 could not be found. Oct 04 21:58:33.993039 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:58:33.993039 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:58:33.993039 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:58:33.993039 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:58:33.993039 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:58:33.993039 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:58:33.993039 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:58:33.993039 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:58:33.993039 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:58:33.993039 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:58:33.993039 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:58:33.993039 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:58:33.993039 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:58:33.993039 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:58:33.993039 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:58:33.993039 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:58:33.993039 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7618c19f-d7bb-4f37-8454-76570009eb30 could not be found. Oct 04 21:58:33.993039 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:58:33.993039 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:58:33.993039 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:58:33.998481 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:58:33.998481 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:58:33.998481 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:58:33.998481 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:58:33.998481 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:58:33.998481 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7618c19f-d7bb-4f37-8454-76570009eb30 could not be found. Oct 04 21:58:33.998481 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:58:34.001581 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-8de9930d-4fac-4808-9e8e-33703de935c6 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] Returning 404 to user: Instance 7618c19f-d7bb-4f37-8454-76570009eb30 could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:58:34.004834 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-8de9930d-4fac-4808-9e8e-33703de935c6 tempest-MultipleCreateTestJSON-1546607932 tempest-MultipleCreateTestJSON-1546607932-project] 10.222.0.43 "GET /compute/v2.1/servers/7618c19f-d7bb-4f37-8454-76570009eb30" status: 404 len: 111 microversion: 2.1 time: 0.074704 Oct 04 21:58:34.010293 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1608/3267] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:58:33 2022] GET /compute/v2.1/servers/7618c19f-d7bb-4f37-8454-76570009eb30 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:58:34.017248 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-918a6c0e-5659-48f3-bd4b-b7fa2641e900 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:34.018250 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-918a6c0e-5659-48f3-bd4b-b7fa2641e900 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] [instance: d0b1b757-4a4d-4a7a-9a06-08f178a02984] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:34.026989 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-918a6c0e-5659-48f3-bd4b-b7fa2641e900 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:34.028256 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-918a6c0e-5659-48f3-bd4b-b7fa2641e900 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:34.028938 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-918a6c0e-5659-48f3-bd4b-b7fa2641e900 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:34.030400 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-918a6c0e-5659-48f3-bd4b-b7fa2641e900 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:34.031639 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-918a6c0e-5659-48f3-bd4b-b7fa2641e900 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:34.032675 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-918a6c0e-5659-48f3-bd4b-b7fa2641e900 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:34.268382 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-918a6c0e-5659-48f3-bd4b-b7fa2641e900 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:34.294187 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-918a6c0e-5659-48f3-bd4b-b7fa2641e900 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:34.310445 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-918a6c0e-5659-48f3-bd4b-b7fa2641e900 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:34.343410 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-918a6c0e-5659-48f3-bd4b-b7fa2641e900 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] 10.222.0.43 "GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984" status: 200 len: 1537 microversion: 2.91 time: 0.331101 Oct 04 21:58:34.348470 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1609/3268] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:58:34 2022] GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984 => generated 1537 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:58:34.374412 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-ad166665-cdd8-4593-9b15-56b0b112d037 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2059515923", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": -1, "networks": [{"uuid": "300a434f-3ad3-472e-98dd-a1b7130cf104"}]}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:58:34.412591 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-ad166665-cdd8-4593-9b15-56b0b112d037 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] HTTP exception thrown: Flavor -1 could not be found. Oct 04 21:58:34.414837 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-ad166665-cdd8-4593-9b15-56b0b112d037 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Request method failure captured: Oct 04 21:58:34.414837 n-d-860284-1 devstack@n-api.service[134101]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 21:58:34.414837 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 21:58:34.414837 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 21:58:34.414837 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 21:58:34.414837 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 206 Oct 04 21:58:34.414837 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 21:58:34.414837 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 21:58:34.414837 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 21:58:34.414837 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 21:58:34.414837 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPKwu4cpW6hhBuWb-qV_7iYlwjOTpf5XWCl53BJjoosjlcj4wkmmOFzemCJVdBntIx8zJ1SF_z6VrRY8UJr7E8TQDJCRnVQMdNnh0-lZwGdqUzjOWSO31Ryb6n87Cka0g238a21JWok3h3GEhLB-7oCbN3bbcOGmkhd6UFueRxRluk24 Oct 04 21:58:34.414837 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 21:58:34.414837 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 21:58:34.414837 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 21:58:34.414837 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 21:58:34.414837 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 21:58:34.414837 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 21:58:34.414837 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: cf07a17a482a4e92b6ddbdee463c8029 Oct 04 21:58:34.414837 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-ServersNegativeTestJSON-1933663319 Oct 04 21:58:34.414837 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 21:58:34.414837 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 21:58:34.414837 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/cf07a17a482a4e92b6ddbdee463c8029"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_cf07a17a482a4e92b6ddbdee463c8029", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/cf07a17a482a4e92b6ddbdee463c8029"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/cf07a17a482a4e92b6ddbdee463c8029"}]}] Oct 04 21:58:34.414837 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-ServersNegativeTestJSON-1933663319 Oct 04 21:58:34.414837 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: cf07a17a482a4e92b6ddbdee463c8029 Oct 04 21:58:34.414837 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1933663319 Oct 04 21:58:34.414837 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-ServersNegativeTestJSON-1933663319-project Oct 04 21:58:34.414837 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 21:58:34.414837 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 21:58:34.414837 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 2facee4c6a40416e908083e126d2cfa3 Oct 04 21:58:34.414837 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-ServersNegativeTestJSON-1933663319-project Oct 04 21:58:34.414837 n-d-860284-1 devstack@n-api.service[134101]: Oct 04 21:58:34.414837 n-d-860284-1 devstack@n-api.service[134101]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2059515923", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": -1, "networks": [{"uuid": "300a434f-3ad3-472e-98dd-a1b7130cf104"}]}} Oct 04 21:58:34.414837 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 21:58:34.414837 n-d-860284-1 devstack@n-api.service[134101]: exception: Flavor -1 could not be found. Oct 04 21:58:34.414837 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-2059515923', 'imageRef': '58548514-5dac-426c-81f5-19e3fba33e23', 'flavorRef': -1, 'networks': [{'uuid': '300a434f-3ad3-472e-98dd-a1b7130cf104'}]}}} Oct 04 21:58:34.414837 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:58:34.414837 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:58:34.414837 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Oct 04 21:58:34.414837 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Oct 04 21:58:34.414837 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 04 21:58:34.414837 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 04 21:58:34.414837 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 21:58:34.414837 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 21:58:34.414837 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 04 21:58:34.414837 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 04 21:58:34.414837 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 04 21:58:34.414837 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:58:34.414837 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 04 21:58:34.414837 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 04 21:58:34.414837 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor -1 could not be found. Oct 04 21:58:34.414837 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:58:34.414837 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:58:34.414837 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:58:34.414837 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:58:34.414837 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:58:34.414837 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:58:34.414837 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:58:34.414837 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:58:34.414837 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:58:34.414837 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:58:34.414837 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:58:34.414837 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:58:34.420620 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:58:34.420620 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:58:34.420620 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:58:34.420620 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:58:34.420620 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 21:58:34.420620 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 04 21:58:34.420620 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 04 21:58:34.420620 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor -1 could not be found. Oct 04 21:58:34.420620 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:58:34.420620 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:58:34.420620 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:58:34.420620 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:58:34.420620 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:58:34.420620 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:58:34.420620 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:58:34.420620 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:58:34.420620 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor -1 could not be found. Oct 04 21:58:34.420620 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:58:34.420620 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-ad166665-cdd8-4593-9b15-56b0b112d037 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:58:34.420620 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-ad166665-cdd8-4593-9b15-56b0b112d037 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.070453 Oct 04 21:58:34.420620 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1610/3269] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 21:58:34 2022] POST /compute/v2.1/servers => generated 73 bytes in 72 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 04 21:58:34.428411 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-abcc4c33-0b7d-493f-8e3f-9dc03d121541 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:34.429073 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-abcc4c33-0b7d-493f-8e3f-9dc03d121541 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: a4cf4fac-1e9b-4669-a6ff-30008ed3642d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:34.435816 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-abcc4c33-0b7d-493f-8e3f-9dc03d121541 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:34.436375 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-abcc4c33-0b7d-493f-8e3f-9dc03d121541 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:34.436838 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-abcc4c33-0b7d-493f-8e3f-9dc03d121541 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:34.437948 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-abcc4c33-0b7d-493f-8e3f-9dc03d121541 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:34.438239 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-abcc4c33-0b7d-493f-8e3f-9dc03d121541 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:34.438766 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-abcc4c33-0b7d-493f-8e3f-9dc03d121541 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:35.503484 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-abcc4c33-0b7d-493f-8e3f-9dc03d121541 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2facee4c6a40416e908083e126d2cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07a17a482a4e92b6ddbdee463c8029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:35.518594 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-abcc4c33-0b7d-493f-8e3f-9dc03d121541 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d" status: 200 len: 1504 microversion: 2.1 time: 1.095598 Oct 04 21:58:35.538575 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1611/3270] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:58:34 2022] GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d => generated 1504 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:58:35.551373 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-ded7a879-efd2-4de9-b3a9-7675bffa3403 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:35.551926 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-ded7a879-efd2-4de9-b3a9-7675bffa3403 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] [instance: d0b1b757-4a4d-4a7a-9a06-08f178a02984] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:35.581361 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ded7a879-efd2-4de9-b3a9-7675bffa3403 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:35.581885 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ded7a879-efd2-4de9-b3a9-7675bffa3403 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:35.582343 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ded7a879-efd2-4de9-b3a9-7675bffa3403 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:35.585017 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ded7a879-efd2-4de9-b3a9-7675bffa3403 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:35.586786 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ded7a879-efd2-4de9-b3a9-7675bffa3403 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:35.588215 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ded7a879-efd2-4de9-b3a9-7675bffa3403 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:35.872499 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-ded7a879-efd2-4de9-b3a9-7675bffa3403 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:35.899285 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-ded7a879-efd2-4de9-b3a9-7675bffa3403 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:35.900629 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-ded7a879-efd2-4de9-b3a9-7675bffa3403 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:35.922956 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-ded7a879-efd2-4de9-b3a9-7675bffa3403 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] 10.222.0.43 "GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984" status: 200 len: 1537 microversion: 2.91 time: 0.382609 Oct 04 21:58:35.929392 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1612/3271] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:58:35 2022] GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984 => generated 1537 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:58:35.951416 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-c5dac667-aae9-4945-8145-692778fb2a31 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:35.954578 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-c5dac667-aae9-4945-8145-692778fb2a31 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: a4cf4fac-1e9b-4669-a6ff-30008ed3642d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:35.980785 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c5dac667-aae9-4945-8145-692778fb2a31 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:35.985080 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c5dac667-aae9-4945-8145-692778fb2a31 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:35.985599 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c5dac667-aae9-4945-8145-692778fb2a31 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:35.986411 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c5dac667-aae9-4945-8145-692778fb2a31 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:35.991962 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c5dac667-aae9-4945-8145-692778fb2a31 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:35.992457 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c5dac667-aae9-4945-8145-692778fb2a31 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:36.571560 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-c5dac667-aae9-4945-8145-692778fb2a31 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2facee4c6a40416e908083e126d2cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07a17a482a4e92b6ddbdee463c8029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:36.588573 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-c5dac667-aae9-4945-8145-692778fb2a31 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d" status: 200 len: 1504 microversion: 2.1 time: 0.657043 Oct 04 21:58:36.602394 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1613/3272] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:58:35 2022] GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d => generated 1504 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:58:36.733859 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-d983b7d2-ac83-4791-9627-bc65db45c1e4 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-457854718", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "300a434f-3ad3-472e-98dd-a1b7130cf104"}]}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:58:36.743089 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-d983b7d2-ac83-4791-9627-bc65db45c1e4 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Request method failure captured: Oct 04 21:58:36.743089 n-d-860284-1 devstack@n-api.service[134101]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 21:58:36.743089 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 21:58:36.743089 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 21:58:36.743089 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 21:58:36.743089 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 172 Oct 04 21:58:36.743089 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 21:58:36.743089 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 21:58:36.743089 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 21:58:36.743089 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 21:58:36.743089 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPKwu4cpW6hhBuWb-qV_7iYlwjOTpf5XWCl53BJjoosjlcj4wkmmOFzemCJVdBntIx8zJ1SF_z6VrRY8UJr7E8TQDJCRnVQMdNnh0-lZwGdqUzjOWSO31Ryb6n87Cka0g238a21JWok3h3GEhLB-7oCbN3bbcOGmkhd6UFueRxRluk24 Oct 04 21:58:36.743089 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 21:58:36.743089 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 21:58:36.743089 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 21:58:36.743089 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 21:58:36.743089 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 21:58:36.743089 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 21:58:36.743089 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: cf07a17a482a4e92b6ddbdee463c8029 Oct 04 21:58:36.743089 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-ServersNegativeTestJSON-1933663319 Oct 04 21:58:36.743089 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 21:58:36.743089 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 21:58:36.743089 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/cf07a17a482a4e92b6ddbdee463c8029"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_cf07a17a482a4e92b6ddbdee463c8029", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/cf07a17a482a4e92b6ddbdee463c8029"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/cf07a17a482a4e92b6ddbdee463c8029"}]}] Oct 04 21:58:36.743089 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-ServersNegativeTestJSON-1933663319 Oct 04 21:58:36.743089 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: cf07a17a482a4e92b6ddbdee463c8029 Oct 04 21:58:36.743089 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1933663319 Oct 04 21:58:36.743089 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-ServersNegativeTestJSON-1933663319-project Oct 04 21:58:36.743089 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 21:58:36.743089 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 21:58:36.743089 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 2facee4c6a40416e908083e126d2cfa3 Oct 04 21:58:36.743089 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-ServersNegativeTestJSON-1933663319-project Oct 04 21:58:36.743089 n-d-860284-1 devstack@n-api.service[134101]: Oct 04 21:58:36.743089 n-d-860284-1 devstack@n-api.service[134101]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-457854718", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "300a434f-3ad3-472e-98dd-a1b7130cf104"}]}} Oct 04 21:58:36.743089 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 21:58:36.743089 n-d-860284-1 devstack@n-api.service[134101]: exception: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 04 21:58:36.743089 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-457854718', 'imageRef': -1, 'flavorRef': '452', 'networks': [{'uuid': '300a434f-3ad3-472e-98dd-a1b7130cf104'}]}}} Oct 04 21:58:36.743089 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:58:36.743089 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:58:36.743089 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 21:58:36.743089 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 21:58:36.743089 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 21:58:36.743089 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise error Oct 04 21:58:36.743089 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: -1 is not valid under any of the given schemas Oct 04 21:58:36.743089 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:58:36.743089 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['server']['properties']['imageRef']: Oct 04 21:58:36.743089 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'uuid', 'type': 'string'}, Oct 04 21:58:36.743089 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi {'maxLength': 0, 'type': 'string'}]} Oct 04 21:58:36.743089 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:58:36.743089 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 21:58:36.743089 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi -1 Oct 04 21:58:36.743089 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:58:36.743089 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:58:36.743089 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:58:36.743089 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:58:36.743089 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:58:36.743089 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:58:36.743089 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:58:36.743089 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:58:36.743089 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:58:36.743089 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:58:36.743089 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:58:36.743089 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:58:36.743089 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 21:58:36.743089 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 21:58:36.743089 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 21:58:36.748873 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 21:58:36.748873 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 21:58:36.748873 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 21:58:36.748873 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 04 21:58:36.748873 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:58:36.748873 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:58:36.748873 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:58:36.748873 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:58:36.748873 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:58:36.748873 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:58:36.748873 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 21:58:36.748873 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 21:58:36.748873 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 04 21:58:36.748873 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:58:36.748873 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-d983b7d2-ac83-4791-9627-bc65db45c1e4 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:58:36.748873 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-d983b7d2-ac83-4791-9627-bc65db45c1e4 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.018656 Oct 04 21:58:36.751544 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1614/3273] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 21:58:36 2022] POST /compute/v2.1/servers => generated 145 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 21:58:36.764550 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-5d7a6107-9f4f-44eb-9fd3-67d16065df2f tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:36.765861 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-5d7a6107-9f4f-44eb-9fd3-67d16065df2f tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: a4cf4fac-1e9b-4669-a6ff-30008ed3642d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:36.799301 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5d7a6107-9f4f-44eb-9fd3-67d16065df2f tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:36.799851 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5d7a6107-9f4f-44eb-9fd3-67d16065df2f tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:36.800846 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5d7a6107-9f4f-44eb-9fd3-67d16065df2f tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:36.801841 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5d7a6107-9f4f-44eb-9fd3-67d16065df2f tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:36.803354 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5d7a6107-9f4f-44eb-9fd3-67d16065df2f tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:36.804223 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5d7a6107-9f4f-44eb-9fd3-67d16065df2f tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:37.196100 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-5d7a6107-9f4f-44eb-9fd3-67d16065df2f tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2facee4c6a40416e908083e126d2cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07a17a482a4e92b6ddbdee463c8029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:37.211323 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-5d7a6107-9f4f-44eb-9fd3-67d16065df2f tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d" status: 200 len: 1504 microversion: 2.1 time: 0.457325 Oct 04 21:58:37.212230 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1615/3274] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:58:36 2022] GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d => generated 1504 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:58:37.237620 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-cf106b04-18fc-455b-bd43-57a9670526b9 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:37.238378 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-cf106b04-18fc-455b-bd43-57a9670526b9 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] [instance: d0b1b757-4a4d-4a7a-9a06-08f178a02984] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:37.284620 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cf106b04-18fc-455b-bd43-57a9670526b9 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:37.286201 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cf106b04-18fc-455b-bd43-57a9670526b9 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:37.287226 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cf106b04-18fc-455b-bd43-57a9670526b9 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:37.289834 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cf106b04-18fc-455b-bd43-57a9670526b9 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:37.293722 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cf106b04-18fc-455b-bd43-57a9670526b9 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:37.295398 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cf106b04-18fc-455b-bd43-57a9670526b9 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:37.531165 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-cf106b04-18fc-455b-bd43-57a9670526b9 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:37.545179 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-cf106b04-18fc-455b-bd43-57a9670526b9 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:37.573780 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-cf106b04-18fc-455b-bd43-57a9670526b9 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:37.600574 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-cf106b04-18fc-455b-bd43-57a9670526b9 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] 10.222.0.43 "GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984" status: 200 len: 1537 microversion: 2.91 time: 0.387076 Oct 04 21:58:37.621307 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1616/3275] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:58:37 2022] GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984 => generated 1537 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:58:37.621307 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-48d09deb-a4b0-4fc2-a96a-ee9a36245cfb tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:37.621307 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-48d09deb-a4b0-4fc2-a96a-ee9a36245cfb tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: a4cf4fac-1e9b-4669-a6ff-30008ed3642d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:37.621307 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-48d09deb-a4b0-4fc2-a96a-ee9a36245cfb tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:37.621307 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-48d09deb-a4b0-4fc2-a96a-ee9a36245cfb tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:37.621307 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-48d09deb-a4b0-4fc2-a96a-ee9a36245cfb tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:37.621307 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-48d09deb-a4b0-4fc2-a96a-ee9a36245cfb tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:37.621307 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-48d09deb-a4b0-4fc2-a96a-ee9a36245cfb tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:37.621307 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-48d09deb-a4b0-4fc2-a96a-ee9a36245cfb tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:38.791070 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-48d09deb-a4b0-4fc2-a96a-ee9a36245cfb tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2facee4c6a40416e908083e126d2cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07a17a482a4e92b6ddbdee463c8029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:38.801826 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-48d09deb-a4b0-4fc2-a96a-ee9a36245cfb tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d" status: 200 len: 1504 microversion: 2.1 time: 1.197308 Oct 04 21:58:38.809369 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1617/3276] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:58:37 2022] GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d => generated 1504 bytes in 1207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:58:38.823743 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-568928ff-c007-43c2-978c-4437e0e00904 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:38.829393 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-568928ff-c007-43c2-978c-4437e0e00904 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] [instance: d0b1b757-4a4d-4a7a-9a06-08f178a02984] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:38.847528 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-568928ff-c007-43c2-978c-4437e0e00904 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:38.848430 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-568928ff-c007-43c2-978c-4437e0e00904 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:38.849185 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-568928ff-c007-43c2-978c-4437e0e00904 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:38.850151 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-568928ff-c007-43c2-978c-4437e0e00904 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:38.852923 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-568928ff-c007-43c2-978c-4437e0e00904 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:38.853635 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-568928ff-c007-43c2-978c-4437e0e00904 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:39.013028 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-568928ff-c007-43c2-978c-4437e0e00904 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:39.016974 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=100 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:58:39.029246 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-568928ff-c007-43c2-978c-4437e0e00904 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:39.035717 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-568928ff-c007-43c2-978c-4437e0e00904 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:39.050015 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-568928ff-c007-43c2-978c-4437e0e00904 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] 10.222.0.43 "GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984" status: 200 len: 1537 microversion: 2.91 time: 0.239100 Oct 04 21:58:39.057323 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1618/3277] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:58:38 2022] GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984 => generated 1537 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:58:39.313832 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-dff20ffd-05f6-4fe6-9625-98bec4f4c589 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1568912225", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:58:39.326331 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-dff20ffd-05f6-4fe6-9625-98bec4f4c589 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 04 21:58:39.332553 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-dff20ffd-05f6-4fe6-9625-98bec4f4c589 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Request method failure captured: Oct 04 21:58:39.332553 n-d-860284-1 devstack@n-api.service[134101]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 21:58:39.332553 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 21:58:39.332553 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 21:58:39.332553 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 21:58:39.332553 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 216 Oct 04 21:58:39.332553 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 21:58:39.332553 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 21:58:39.332553 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 21:58:39.332553 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 21:58:39.332553 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPKwu4cpW6hhBuWb-qV_7iYlwjOTpf5XWCl53BJjoosjlcj4wkmmOFzemCJVdBntIx8zJ1SF_z6VrRY8UJr7E8TQDJCRnVQMdNnh0-lZwGdqUzjOWSO31Ryb6n87Cka0g238a21JWok3h3GEhLB-7oCbN3bbcOGmkhd6UFueRxRluk24 Oct 04 21:58:39.332553 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 21:58:39.332553 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 21:58:39.332553 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 21:58:39.332553 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 21:58:39.332553 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 21:58:39.332553 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 21:58:39.332553 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: cf07a17a482a4e92b6ddbdee463c8029 Oct 04 21:58:39.332553 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-ServersNegativeTestJSON-1933663319 Oct 04 21:58:39.332553 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 21:58:39.332553 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 21:58:39.332553 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/cf07a17a482a4e92b6ddbdee463c8029"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_cf07a17a482a4e92b6ddbdee463c8029", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/cf07a17a482a4e92b6ddbdee463c8029"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/cf07a17a482a4e92b6ddbdee463c8029"}]}] Oct 04 21:58:39.332553 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-ServersNegativeTestJSON-1933663319 Oct 04 21:58:39.332553 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: cf07a17a482a4e92b6ddbdee463c8029 Oct 04 21:58:39.332553 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1933663319 Oct 04 21:58:39.332553 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-ServersNegativeTestJSON-1933663319-project Oct 04 21:58:39.332553 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 21:58:39.332553 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 21:58:39.332553 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 2facee4c6a40416e908083e126d2cfa3 Oct 04 21:58:39.332553 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-ServersNegativeTestJSON-1933663319-project Oct 04 21:58:39.332553 n-d-860284-1 devstack@n-api.service[134101]: Oct 04 21:58:39.332553 n-d-860284-1 devstack@n-api.service[134101]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1568912225", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} Oct 04 21:58:39.332553 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 21:58:39.332553 n-d-860284-1 devstack@n-api.service[134101]: exception: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 04 21:58:39.332553 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1568912225', 'imageRef': '58548514-5dac-426c-81f5-19e3fba33e23', 'flavorRef': '452', 'networks': [{'fixed_ip': '10.0.1.1', 'uuid': 'a-b-c-d-e-f-g-h-i-j'}]}}} Oct 04 21:58:39.332553 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:58:39.332553 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:58:39.332553 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:58:39.332553 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:58:39.332553 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:58:39.332553 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:58:39.332553 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:58:39.332553 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:58:39.332553 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:58:39.332553 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:58:39.332553 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:58:39.332553 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:58:39.332553 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:58:39.332553 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:58:39.332553 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 21:58:39.332553 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 773, in create Oct 04 21:58:39.332553 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi self._process_networks_for_create( Oct 04 21:58:39.332553 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 547, in _process_networks_for_create Oct 04 21:58:39.332553 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi requested_networks = self._get_requested_networks( Oct 04 21:58:39.332553 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 447, in _get_requested_networks Oct 04 21:58:39.332553 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi self._validate_network_id( Oct 04 21:58:39.332553 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 396, in _validate_network_id Oct 04 21:58:39.332553 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 04 21:58:39.332553 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 04 21:58:39.332553 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:58:39.332553 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:58:39.336957 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:58:39.336957 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:58:39.336957 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:58:39.336957 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:58:39.336957 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:58:39.336957 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:58:39.336957 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 04 21:58:39.336957 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:58:39.340465 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-dff20ffd-05f6-4fe6-9625-98bec4f4c589 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:58:39.349045 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-dff20ffd-05f6-4fe6-9625-98bec4f4c589 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.040440 Oct 04 21:58:39.350001 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1619/3278] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 21:58:39 2022] POST /compute/v2.1/servers => generated 123 bytes in 42 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 04 21:58:39.358931 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-edaf4d63-0e77-44d8-8743-cc8eeb49af50 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:39.359979 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-edaf4d63-0e77-44d8-8743-cc8eeb49af50 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: a4cf4fac-1e9b-4669-a6ff-30008ed3642d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:39.395966 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-edaf4d63-0e77-44d8-8743-cc8eeb49af50 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:39.396648 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-edaf4d63-0e77-44d8-8743-cc8eeb49af50 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:39.397109 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-edaf4d63-0e77-44d8-8743-cc8eeb49af50 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:39.397851 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-edaf4d63-0e77-44d8-8743-cc8eeb49af50 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:39.398851 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-edaf4d63-0e77-44d8-8743-cc8eeb49af50 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:39.399483 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-edaf4d63-0e77-44d8-8743-cc8eeb49af50 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:39.749022 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-edaf4d63-0e77-44d8-8743-cc8eeb49af50 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2facee4c6a40416e908083e126d2cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07a17a482a4e92b6ddbdee463c8029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:39.761728 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-edaf4d63-0e77-44d8-8743-cc8eeb49af50 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d" status: 200 len: 1504 microversion: 2.1 time: 0.407053 Oct 04 21:58:39.762677 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1620/3279] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:58:39 2022] GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d => generated 1504 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:58:39.798396 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-0bcd43e1-3588-4ef2-8d4e-bbfa3ae7f264 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:39.800092 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-0bcd43e1-3588-4ef2-8d4e-bbfa3ae7f264 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: a4cf4fac-1e9b-4669-a6ff-30008ed3642d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:39.819960 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0bcd43e1-3588-4ef2-8d4e-bbfa3ae7f264 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:39.823812 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0bcd43e1-3588-4ef2-8d4e-bbfa3ae7f264 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:39.824537 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0bcd43e1-3588-4ef2-8d4e-bbfa3ae7f264 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:39.825674 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0bcd43e1-3588-4ef2-8d4e-bbfa3ae7f264 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:39.827456 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0bcd43e1-3588-4ef2-8d4e-bbfa3ae7f264 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:39.829413 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0bcd43e1-3588-4ef2-8d4e-bbfa3ae7f264 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:40.473010 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-0bcd43e1-3588-4ef2-8d4e-bbfa3ae7f264 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2facee4c6a40416e908083e126d2cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07a17a482a4e92b6ddbdee463c8029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:40.482300 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-0bcd43e1-3588-4ef2-8d4e-bbfa3ae7f264 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d" status: 200 len: 1504 microversion: 2.1 time: 0.692570 Oct 04 21:58:40.486411 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1621/3280] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:58:39 2022] GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d => generated 1504 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:58:40.492668 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-aa1212a6-b7a1-4633-b124-07d1ce296ec5 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:40.493292 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-aa1212a6-b7a1-4633-b124-07d1ce296ec5 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] [instance: d0b1b757-4a4d-4a7a-9a06-08f178a02984] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:40.503060 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-aa1212a6-b7a1-4633-b124-07d1ce296ec5 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:40.507059 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-aa1212a6-b7a1-4633-b124-07d1ce296ec5 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:40.507776 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-aa1212a6-b7a1-4633-b124-07d1ce296ec5 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:40.509391 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-aa1212a6-b7a1-4633-b124-07d1ce296ec5 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:40.510084 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-aa1212a6-b7a1-4633-b124-07d1ce296ec5 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:40.511998 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-aa1212a6-b7a1-4633-b124-07d1ce296ec5 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:40.844324 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-aa1212a6-b7a1-4633-b124-07d1ce296ec5 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:40.860540 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-aa1212a6-b7a1-4633-b124-07d1ce296ec5 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:40.872394 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-aa1212a6-b7a1-4633-b124-07d1ce296ec5 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:40.955184 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-aa1212a6-b7a1-4633-b124-07d1ce296ec5 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] 10.222.0.43 "GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984" status: 200 len: 1537 microversion: 2.91 time: 0.467418 Oct 04 21:58:40.966745 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1622/3281] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:58:40 2022] GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984 => generated 1537 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:58:40.973759 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-8b9d4eae-5893-4b8b-96d6-7a576b7d0706 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-967168095", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452", "key_name": "tempest-key-1516305923", "networks": [{"uuid": "300a434f-3ad3-472e-98dd-a1b7130cf104"}]}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:58:44.435815 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-514e9669-c6cb-4bff-937e-b01115e2bf89 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] 10.222.0.43 "GET /compute/v2.1/images/683538fe-4fde-450b-94cb-f14e6f8483a3" status: 200 len: 1410 microversion: 2.1 time: 20.798649 Oct 04 21:58:44.436455 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1660/3282] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:58:23 2022] GET /compute/v2.1/images/683538fe-4fde-450b-94cb-f14e6f8483a3 => generated 1410 bytes in 20800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:58:44.470306 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.network.neutron [None req-8b9d4eae-5893-4b8b-96d6-7a576b7d0706 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] validate_networks() for [('300a434f-3ad3-472e-98dd-a1b7130cf104', None, None, None, None, None)] {{(pid=134101) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:58:44.471621 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-9999de4f-96f2-4584-bd9c-6981bf839284 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:44.471621 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-9999de4f-96f2-4584-bd9c-6981bf839284 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] [instance: d0b1b757-4a4d-4a7a-9a06-08f178a02984] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:44.499980 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9999de4f-96f2-4584-bd9c-6981bf839284 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:44.500574 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9999de4f-96f2-4584-bd9c-6981bf839284 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:44.502408 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9999de4f-96f2-4584-bd9c-6981bf839284 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:44.505076 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9999de4f-96f2-4584-bd9c-6981bf839284 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:44.505577 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9999de4f-96f2-4584-bd9c-6981bf839284 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:44.506028 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9999de4f-96f2-4584-bd9c-6981bf839284 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:44.623107 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-9999de4f-96f2-4584-bd9c-6981bf839284 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:44.638173 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-9999de4f-96f2-4584-bd9c-6981bf839284 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:44.642995 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-9999de4f-96f2-4584-bd9c-6981bf839284 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:44.657190 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-9999de4f-96f2-4584-bd9c-6981bf839284 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] 10.222.0.43 "GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984" status: 200 len: 1558 microversion: 2.91 time: 0.218084 Oct 04 21:58:44.673197 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1661/3283] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:58:44 2022] GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984 => generated 1558 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:58:44.699907 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-8788ad51-88bf-45c6-8ae5-284f0f1e9f41 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:44.702729 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-8788ad51-88bf-45c6-8ae5-284f0f1e9f41 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] [instance: 830de6ad-adc6-4d16-ae9d-a29ae85e6cd2] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:44.728989 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8788ad51-88bf-45c6-8ae5-284f0f1e9f41 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:44.739254 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8788ad51-88bf-45c6-8ae5-284f0f1e9f41 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:44.740443 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8788ad51-88bf-45c6-8ae5-284f0f1e9f41 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:44.741177 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8788ad51-88bf-45c6-8ae5-284f0f1e9f41 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:44.743486 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8788ad51-88bf-45c6-8ae5-284f0f1e9f41 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:44.750782 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8788ad51-88bf-45c6-8ae5-284f0f1e9f41 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:44.792182 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-8788ad51-88bf-45c6-8ae5-284f0f1e9f41 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] HTTP exception thrown: Instance 830de6ad-adc6-4d16-ae9d-a29ae85e6cd2 could not be found. Oct 04 21:58:44.793684 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-8788ad51-88bf-45c6-8ae5-284f0f1e9f41 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Request method failure captured: Oct 04 21:58:44.793684 n-d-860284-1 devstack@n-api.service[134102]: request: DELETE /compute/v2.1/servers/830de6ad-adc6-4d16-ae9d-a29ae85e6cd2 HTTP/1.1 Oct 04 21:58:44.793684 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 21:58:44.793684 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 21:58:44.793684 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 21:58:44.793684 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 21:58:44.793684 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 21:58:44.793684 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 21:58:44.793684 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 21:58:44.793684 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 21:58:44.793684 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPKrZt3nblOdDsUFzAAZpDMMh8703cTcdQ0RDi0-vZIqNaW0VC8SgcCKzvg6od2lNB90Uf9KlBS5o4n9eJKBMAacfdhnSGze8EiYZLNbMV3g-RWdVfR_yf8g3HV5v2LMgZ0kkijL58bwvgRutnvuPtYMXM_DDTZnbhSxdRg3GzfZol4g Oct 04 21:58:44.793684 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 21:58:44.793684 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 21:58:44.793684 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 21:58:44.793684 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 21:58:44.793684 n-d-860284-1 devstack@n-api.service[134102]: X-Openstack-Nova-Api-Version: 2.42 Oct 04 21:58:44.793684 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 21:58:44.793684 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 21:58:44.793684 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: 2dd1e35c3cb643e3ad2afbe7edbbce8d Oct 04 21:58:44.793684 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-520322824 Oct 04 21:58:44.793684 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 21:58:44.793684 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 21:58:44.793684 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/2dd1e35c3cb643e3ad2afbe7edbbce8d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_2dd1e35c3cb643e3ad2afbe7edbbce8d", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/2dd1e35c3cb643e3ad2afbe7edbbce8d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/2dd1e35c3cb643e3ad2afbe7edbbce8d"}]}] Oct 04 21:58:44.793684 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-TaggedBootDevicesTest_v242-520322824 Oct 04 21:58:44.793684 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: 2dd1e35c3cb643e3ad2afbe7edbbce8d Oct 04 21:58:44.793684 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-520322824 Oct 04 21:58:44.793684 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-TaggedBootDevicesTest_v242-520322824-project Oct 04 21:58:44.793684 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 21:58:44.793684 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 21:58:44.793684 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: 2bb934f4dc53470d8e35d71cccd756d9 Oct 04 21:58:44.793684 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-TaggedBootDevicesTest_v242-520322824-project Oct 04 21:58:44.793684 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 21:58:44.793684 n-d-860284-1 devstack@n-api.service[134102]: exception: Instance 830de6ad-adc6-4d16-ae9d-a29ae85e6cd2 could not be found. Oct 04 21:58:44.793684 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': '830de6ad-adc6-4d16-ae9d-a29ae85e6cd2'} Oct 04 21:58:44.793684 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:58:44.793684 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:58:44.793684 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:58:44.793684 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:58:44.793684 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:58:44.793684 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:58:44.793684 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:58:44.793684 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:58:44.793684 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:58:44.793684 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:58:44.793684 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 830de6ad-adc6-4d16-ae9d-a29ae85e6cd2 could not be found. Oct 04 21:58:44.793684 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:58:44.793684 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:58:44.793684 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:58:44.793684 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:58:44.793684 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:58:44.793684 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:58:44.793684 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:58:44.793684 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:58:44.793684 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:58:44.793684 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:58:44.793684 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 21:58:44.793684 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 21:58:44.793684 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 21:58:44.793684 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 21:58:44.793684 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:58:44.793684 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:58:44.793684 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:58:44.793684 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:58:44.799965 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 830de6ad-adc6-4d16-ae9d-a29ae85e6cd2 could not be found. Oct 04 21:58:44.799965 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:58:44.799965 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:58:44.799965 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:58:44.799965 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:58:44.799965 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:58:44.799965 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:58:44.799965 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:58:44.799965 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:58:44.799965 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 830de6ad-adc6-4d16-ae9d-a29ae85e6cd2 could not be found. Oct 04 21:58:44.799965 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:58:44.799965 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-8788ad51-88bf-45c6-8ae5-284f0f1e9f41 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Returning 404 to user: Instance 830de6ad-adc6-4d16-ae9d-a29ae85e6cd2 could not be found. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:58:44.799965 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-8788ad51-88bf-45c6-8ae5-284f0f1e9f41 tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] 10.222.0.43 "DELETE /compute/v2.1/servers/830de6ad-adc6-4d16-ae9d-a29ae85e6cd2" status: 404 len: 111 microversion: 2.42 time: 0.105248 Oct 04 21:58:44.799965 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1662/3284] 10.222.0.43 () {60 vars in 1280 bytes} [Tue Oct 4 21:58:44 2022] DELETE /compute/v2.1/servers/830de6ad-adc6-4d16-ae9d-a29ae85e6cd2 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 21:58:44.804411 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-bafcb384-7589-4c3d-afd5-27ff69d45fae tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:44.805032 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-bafcb384-7589-4c3d-afd5-27ff69d45fae tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] [instance: 830de6ad-adc6-4d16-ae9d-a29ae85e6cd2] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:44.814128 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bafcb384-7589-4c3d-afd5-27ff69d45fae tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:44.814658 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bafcb384-7589-4c3d-afd5-27ff69d45fae tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:44.815095 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bafcb384-7589-4c3d-afd5-27ff69d45fae tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:44.816120 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bafcb384-7589-4c3d-afd5-27ff69d45fae tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:44.816748 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bafcb384-7589-4c3d-afd5-27ff69d45fae tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:44.817342 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bafcb384-7589-4c3d-afd5-27ff69d45fae tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:44.848721 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-bafcb384-7589-4c3d-afd5-27ff69d45fae tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] HTTP exception thrown: Instance 830de6ad-adc6-4d16-ae9d-a29ae85e6cd2 could not be found. Oct 04 21:58:44.865702 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-8b9d4eae-5893-4b8b-96d6-7a576b7d0706 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] HTTP exception thrown: Invalid key_name provided. Oct 04 21:58:44.868111 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-8b9d4eae-5893-4b8b-96d6-7a576b7d0706 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Request method failure captured: Oct 04 21:58:44.868111 n-d-860284-1 devstack@n-api.service[134101]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 21:58:44.868111 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 21:58:44.868111 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 21:58:44.868111 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 21:58:44.868111 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 246 Oct 04 21:58:44.868111 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 21:58:44.868111 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 21:58:44.868111 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 21:58:44.868111 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 21:58:44.868111 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPKwu4cpW6hhBuWb-qV_7iYlwjOTpf5XWCl53BJjoosjlcj4wkmmOFzemCJVdBntIx8zJ1SF_z6VrRY8UJr7E8TQDJCRnVQMdNnh0-lZwGdqUzjOWSO31Ryb6n87Cka0g238a21JWok3h3GEhLB-7oCbN3bbcOGmkhd6UFueRxRluk24 Oct 04 21:58:44.868111 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 21:58:44.868111 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 21:58:44.868111 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 21:58:44.868111 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 21:58:44.868111 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 21:58:44.868111 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 21:58:44.868111 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: cf07a17a482a4e92b6ddbdee463c8029 Oct 04 21:58:44.868111 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-ServersNegativeTestJSON-1933663319 Oct 04 21:58:44.868111 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 21:58:44.868111 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 21:58:44.868111 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/cf07a17a482a4e92b6ddbdee463c8029"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_cf07a17a482a4e92b6ddbdee463c8029", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/cf07a17a482a4e92b6ddbdee463c8029"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/cf07a17a482a4e92b6ddbdee463c8029"}]}] Oct 04 21:58:44.868111 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-ServersNegativeTestJSON-1933663319 Oct 04 21:58:44.868111 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: cf07a17a482a4e92b6ddbdee463c8029 Oct 04 21:58:44.868111 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1933663319 Oct 04 21:58:44.868111 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-ServersNegativeTestJSON-1933663319-project Oct 04 21:58:44.868111 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 21:58:44.868111 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 21:58:44.868111 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 2facee4c6a40416e908083e126d2cfa3 Oct 04 21:58:44.868111 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-ServersNegativeTestJSON-1933663319-project Oct 04 21:58:44.868111 n-d-860284-1 devstack@n-api.service[134101]: Oct 04 21:58:44.868111 n-d-860284-1 devstack@n-api.service[134101]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-967168095", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452", "key_name": "tempest-key-1516305923", "networks": [{"uuid": "300a434f-3ad3-472e-98dd-a1b7130cf104"}]}} Oct 04 21:58:44.868111 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 21:58:44.868111 n-d-860284-1 devstack@n-api.service[134101]: exception: Invalid key_name provided. Oct 04 21:58:44.868111 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-967168095', 'imageRef': '58548514-5dac-426c-81f5-19e3fba33e23', 'flavorRef': '452', 'key_name': 'tempest-key-1516305923', 'networks': [{'uuid': '300a434f-3ad3-472e-98dd-a1b7130cf104'}]}}} Oct 04 21:58:44.868111 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:58:44.868111 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:58:44.868111 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 21:58:44.868111 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 21:58:44.868111 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 21:58:44.868111 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 21:58:44.868111 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 21:58:44.868111 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 21:58:44.868111 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1089, in _validate_and_build_base_options Oct 04 21:58:44.868111 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi key_pair = objects.KeyPair.get_by_name(context, Oct 04 21:58:44.868111 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 21:58:44.868111 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 21:58:44.868111 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Oct 04 21:58:44.868111 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Oct 04 21:58:44.868111 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Oct 04 21:58:44.868111 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Oct 04 21:58:44.868111 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 21:58:44.868111 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 21:58:44.868111 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Oct 04 21:58:44.868111 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Oct 04 21:58:44.868111 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-key-1516305923 not found for user 2facee4c6a40416e908083e126d2cfa3 Oct 04 21:58:44.868111 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:58:44.868111 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:58:44.868111 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:58:44.868111 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:58:44.868111 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:58:44.873433 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:58:44.873433 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:58:44.873433 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:58:44.873433 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:58:44.873433 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:58:44.873433 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:58:44.873433 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:58:44.873433 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:58:44.873433 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:58:44.873433 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:58:44.873433 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:58:44.873433 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 21:58:44.873433 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 807, in create Oct 04 21:58:44.873433 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 04 21:58:44.873433 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid key_name provided. Oct 04 21:58:44.873433 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:58:44.873433 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:58:44.873433 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:58:44.873433 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:58:44.873433 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:58:44.873433 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:58:44.873433 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:58:44.873433 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:58:44.873433 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid key_name provided. Oct 04 21:58:44.873433 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:58:44.873433 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-8b9d4eae-5893-4b8b-96d6-7a576b7d0706 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Returning 400 to user: Invalid key_name provided. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:58:44.880461 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-8b9d4eae-5893-4b8b-96d6-7a576b7d0706 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 3.905138 Oct 04 21:58:44.880461 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1623/3285] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 21:58:40 2022] POST /compute/v2.1/servers => generated 70 bytes in 3907 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 04 21:58:44.883331 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-bafcb384-7589-4c3d-afd5-27ff69d45fae tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Request method failure captured: Oct 04 21:58:44.883331 n-d-860284-1 devstack@n-api.service[134102]: request: GET /compute/v2.1/servers/830de6ad-adc6-4d16-ae9d-a29ae85e6cd2 HTTP/1.1 Oct 04 21:58:44.883331 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 21:58:44.883331 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 21:58:44.883331 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 21:58:44.883331 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 21:58:44.883331 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 21:58:44.883331 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 21:58:44.883331 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 21:58:44.883331 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 21:58:44.883331 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPKrZt3nblOdDsUFzAAZpDMMh8703cTcdQ0RDi0-vZIqNaW0VC8SgcCKzvg6od2lNB90Uf9KlBS5o4n9eJKBMAacfdhnSGze8EiYZLNbMV3g-RWdVfR_yf8g3HV5v2LMgZ0kkijL58bwvgRutnvuPtYMXM_DDTZnbhSxdRg3GzfZol4g Oct 04 21:58:44.883331 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 21:58:44.883331 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 21:58:44.883331 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 21:58:44.883331 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 21:58:44.883331 n-d-860284-1 devstack@n-api.service[134102]: X-Openstack-Nova-Api-Version: 2.42 Oct 04 21:58:44.883331 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 21:58:44.883331 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 21:58:44.883331 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: 2dd1e35c3cb643e3ad2afbe7edbbce8d Oct 04 21:58:44.883331 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-520322824 Oct 04 21:58:44.883331 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 21:58:44.883331 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 21:58:44.883331 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/2dd1e35c3cb643e3ad2afbe7edbbce8d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_2dd1e35c3cb643e3ad2afbe7edbbce8d", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/2dd1e35c3cb643e3ad2afbe7edbbce8d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/2dd1e35c3cb643e3ad2afbe7edbbce8d"}]}] Oct 04 21:58:44.883331 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-TaggedBootDevicesTest_v242-520322824 Oct 04 21:58:44.883331 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: 2dd1e35c3cb643e3ad2afbe7edbbce8d Oct 04 21:58:44.883331 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-520322824 Oct 04 21:58:44.883331 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-TaggedBootDevicesTest_v242-520322824-project Oct 04 21:58:44.883331 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 21:58:44.883331 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 21:58:44.883331 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: 2bb934f4dc53470d8e35d71cccd756d9 Oct 04 21:58:44.883331 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-TaggedBootDevicesTest_v242-520322824-project Oct 04 21:58:44.883331 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 21:58:44.883331 n-d-860284-1 devstack@n-api.service[134102]: exception: Instance 830de6ad-adc6-4d16-ae9d-a29ae85e6cd2 could not be found. Oct 04 21:58:44.883331 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': '830de6ad-adc6-4d16-ae9d-a29ae85e6cd2'} Oct 04 21:58:44.883331 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:58:44.883331 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:58:44.883331 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:58:44.883331 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:58:44.883331 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:58:44.883331 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:58:44.883331 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:58:44.883331 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:58:44.883331 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:58:44.883331 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:58:44.883331 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 830de6ad-adc6-4d16-ae9d-a29ae85e6cd2 could not be found. Oct 04 21:58:44.883331 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:58:44.883331 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:58:44.883331 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:58:44.883331 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:58:44.883331 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:58:44.883331 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:58:44.883331 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:58:44.883331 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:58:44.883331 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:58:44.883331 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:58:44.883331 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:58:44.883331 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:58:44.883331 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:58:44.883331 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:58:44.883331 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:58:44.883331 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:58:44.883331 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 830de6ad-adc6-4d16-ae9d-a29ae85e6cd2 could not be found. Oct 04 21:58:44.883331 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:58:44.883331 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:58:44.890480 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:58:44.890480 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:58:44.890480 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:58:44.890480 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:58:44.890480 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:58:44.890480 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:58:44.890480 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 830de6ad-adc6-4d16-ae9d-a29ae85e6cd2 could not be found. Oct 04 21:58:44.890480 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:58:44.891639 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-c71ef91d-ac45-41d1-986b-37ee982a7c47 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:44.891639 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-c71ef91d-ac45-41d1-986b-37ee982a7c47 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: a4cf4fac-1e9b-4669-a6ff-30008ed3642d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:44.893121 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-bafcb384-7589-4c3d-afd5-27ff69d45fae tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] Returning 404 to user: Instance 830de6ad-adc6-4d16-ae9d-a29ae85e6cd2 could not be found. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:58:44.894696 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-bafcb384-7589-4c3d-afd5-27ff69d45fae tempest-TaggedBootDevicesTest_v242-520322824 tempest-TaggedBootDevicesTest_v242-520322824-project] 10.222.0.43 "GET /compute/v2.1/servers/830de6ad-adc6-4d16-ae9d-a29ae85e6cd2" status: 404 len: 111 microversion: 2.42 time: 0.093678 Oct 04 21:58:44.896013 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1663/3286] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:58:44 2022] GET /compute/v2.1/servers/830de6ad-adc6-4d16-ae9d-a29ae85e6cd2 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 21:58:44.912949 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c71ef91d-ac45-41d1-986b-37ee982a7c47 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:44.913760 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c71ef91d-ac45-41d1-986b-37ee982a7c47 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:44.923809 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c71ef91d-ac45-41d1-986b-37ee982a7c47 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:44.925683 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c71ef91d-ac45-41d1-986b-37ee982a7c47 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:44.928686 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c71ef91d-ac45-41d1-986b-37ee982a7c47 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:44.930911 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c71ef91d-ac45-41d1-986b-37ee982a7c47 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:45.219233 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-c71ef91d-ac45-41d1-986b-37ee982a7c47 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2facee4c6a40416e908083e126d2cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07a17a482a4e92b6ddbdee463c8029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:45.236925 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-c71ef91d-ac45-41d1-986b-37ee982a7c47 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d" status: 200 len: 1504 microversion: 2.1 time: 0.351264 Oct 04 21:58:45.242559 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1624/3287] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:58:44 2022] GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d => generated 1504 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:58:45.267886 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-40b93092-1f48-4cf0-a249-2792512ec0ea tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:45.268940 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-40b93092-1f48-4cf0-a249-2792512ec0ea tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: a4cf4fac-1e9b-4669-a6ff-30008ed3642d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:45.279267 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-40b93092-1f48-4cf0-a249-2792512ec0ea tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:45.281457 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-40b93092-1f48-4cf0-a249-2792512ec0ea tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:45.284215 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-40b93092-1f48-4cf0-a249-2792512ec0ea tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:45.285660 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-40b93092-1f48-4cf0-a249-2792512ec0ea tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:45.287724 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-40b93092-1f48-4cf0-a249-2792512ec0ea tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:45.290230 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-40b93092-1f48-4cf0-a249-2792512ec0ea tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:45.451561 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-c116aa6b-0837-4595-83dd-c968d8d0ddd2 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Calling method '.version_select at 0x7fbb2e68e8b0>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:45.563884 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-c116aa6b-0837-4595-83dd-c968d8d0ddd2 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] 10.222.0.43 "GET /compute/v2.1/images/683538fe-4fde-450b-94cb-f14e6f8483a3" status: 200 len: 1410 microversion: 2.1 time: 0.116374 Oct 04 21:58:45.565196 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1625/3288] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:58:45 2022] GET /compute/v2.1/images/683538fe-4fde-450b-94cb-f14e6f8483a3 => generated 1410 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:58:45.645055 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-40b93092-1f48-4cf0-a249-2792512ec0ea tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2facee4c6a40416e908083e126d2cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07a17a482a4e92b6ddbdee463c8029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:45.662629 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-40b93092-1f48-4cf0-a249-2792512ec0ea tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d" status: 200 len: 1504 microversion: 2.1 time: 0.399066 Oct 04 21:58:45.684868 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1664/3289] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:58:45 2022] GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d => generated 1504 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:58:45.691253 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-89d2b167-d390-418e-aeb8-304bdb5f4ae1 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:45.691825 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-89d2b167-d390-418e-aeb8-304bdb5f4ae1 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] [instance: d0b1b757-4a4d-4a7a-9a06-08f178a02984] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:45.702168 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-89d2b167-d390-418e-aeb8-304bdb5f4ae1 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:45.702758 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-89d2b167-d390-418e-aeb8-304bdb5f4ae1 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:45.703210 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-89d2b167-d390-418e-aeb8-304bdb5f4ae1 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:45.703939 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-89d2b167-d390-418e-aeb8-304bdb5f4ae1 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:45.704427 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-89d2b167-d390-418e-aeb8-304bdb5f4ae1 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:45.704873 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-89d2b167-d390-418e-aeb8-304bdb5f4ae1 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:45.969744 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-89d2b167-d390-418e-aeb8-304bdb5f4ae1 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:45.985419 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-89d2b167-d390-418e-aeb8-304bdb5f4ae1 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:45.993503 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-89d2b167-d390-418e-aeb8-304bdb5f4ae1 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:46.016713 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-89d2b167-d390-418e-aeb8-304bdb5f4ae1 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] 10.222.0.43 "GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984" status: 200 len: 1558 microversion: 2.91 time: 0.331952 Oct 04 21:58:46.017328 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1626/3290] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:58:45 2022] GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984 => generated 1558 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:58:46.029340 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-962a4d6f-7bf6-46cd-9b50-4df8f7c2c2e7 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-558026265", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "300a434f-3ad3-472e-98dd-a1b7130cf104"}]}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:58:46.180873 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-8a889dc9-acc6-41b7-9068-8a5a70e82765 tempest-ServersAaction247Test-1008276901 tempest-ServersAaction247Test-1008276901-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-1571203315", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452", "networks": "none"}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:58:46.255922 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.network.security_group_api [None req-962a4d6f-7bf6-46cd-9b50-4df8f7c2c2e7 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Neutron security group does_not_exist not found {{(pid=134101) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Oct 04 21:58:46.256748 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-962a4d6f-7bf6-46cd-9b50-4df8f7c2c2e7 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Oct 04 21:58:46.263960 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-962a4d6f-7bf6-46cd-9b50-4df8f7c2c2e7 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Request method failure captured: Oct 04 21:58:46.263960 n-d-860284-1 devstack@n-api.service[134101]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 21:58:46.263960 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 21:58:46.263960 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 21:58:46.263960 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 21:58:46.263960 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 257 Oct 04 21:58:46.263960 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 21:58:46.263960 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 21:58:46.263960 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 21:58:46.263960 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 21:58:46.263960 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPKwu4cpW6hhBuWb-qV_7iYlwjOTpf5XWCl53BJjoosjlcj4wkmmOFzemCJVdBntIx8zJ1SF_z6VrRY8UJr7E8TQDJCRnVQMdNnh0-lZwGdqUzjOWSO31Ryb6n87Cka0g238a21JWok3h3GEhLB-7oCbN3bbcOGmkhd6UFueRxRluk24 Oct 04 21:58:46.263960 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 21:58:46.263960 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 21:58:46.263960 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 21:58:46.263960 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 21:58:46.263960 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 21:58:46.263960 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 21:58:46.263960 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: cf07a17a482a4e92b6ddbdee463c8029 Oct 04 21:58:46.263960 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-ServersNegativeTestJSON-1933663319 Oct 04 21:58:46.263960 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 21:58:46.263960 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 21:58:46.263960 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/cf07a17a482a4e92b6ddbdee463c8029"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_cf07a17a482a4e92b6ddbdee463c8029", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/cf07a17a482a4e92b6ddbdee463c8029"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/cf07a17a482a4e92b6ddbdee463c8029"}]}] Oct 04 21:58:46.263960 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-ServersNegativeTestJSON-1933663319 Oct 04 21:58:46.263960 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: cf07a17a482a4e92b6ddbdee463c8029 Oct 04 21:58:46.263960 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1933663319 Oct 04 21:58:46.263960 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-ServersNegativeTestJSON-1933663319-project Oct 04 21:58:46.263960 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 21:58:46.263960 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 21:58:46.263960 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 2facee4c6a40416e908083e126d2cfa3 Oct 04 21:58:46.263960 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-ServersNegativeTestJSON-1933663319-project Oct 04 21:58:46.263960 n-d-860284-1 devstack@n-api.service[134101]: Oct 04 21:58:46.263960 n-d-860284-1 devstack@n-api.service[134101]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-558026265", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "300a434f-3ad3-472e-98dd-a1b7130cf104"}]}} Oct 04 21:58:46.263960 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 21:58:46.263960 n-d-860284-1 devstack@n-api.service[134101]: exception: Unable to find security_group with name or id 'does_not_exist' Oct 04 21:58:46.263960 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-558026265', 'imageRef': '58548514-5dac-426c-81f5-19e3fba33e23', 'flavorRef': '452', 'security_groups': [{'name': 'does_not_exist'}], 'networks': [{'uuid': '300a434f-3ad3-472e-98dd-a1b7130cf104'}]}}} Oct 04 21:58:46.263960 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:58:46.263960 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:58:46.263960 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 476, in find_resource Oct 04 21:58:46.263960 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return self.find_resource_by_id(resource, name_or_id, Oct 04 21:58:46.263960 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:58:46.263960 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:58:46.263960 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 440, in find_resource_by_id Oct 04 21:58:46.263960 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Oct 04 21:58:46.263960 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with id 'does_not_exist' Oct 04 21:58:46.263960 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:58:46.263960 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:58:46.263960 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:58:46.263960 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:58:46.263960 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 480, in find_resource Oct 04 21:58:46.263960 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return self._find_resource_by_name( Oct 04 21:58:46.263960 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:58:46.263960 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:58:46.263960 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 469, in _find_resource_by_name Oct 04 21:58:46.263960 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Oct 04 21:58:46.263960 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name 'does_not_exist' Oct 04 21:58:46.263960 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:58:46.263960 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:58:46.263960 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:58:46.263960 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:58:46.263960 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 68, in validate_name Oct 04 21:58:46.263960 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return neutronv20.find_resourceid_by_name_or_id( Oct 04 21:58:46.269181 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 56, in find_resourceid_by_name_or_id Oct 04 21:58:46.269181 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return find_resource_by_name_or_id(client, resource, name_or_id, Oct 04 21:58:46.269181 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 49, in find_resource_by_name_or_id Oct 04 21:58:46.269181 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return client.find_resource(resource, name_or_id, project_id, Oct 04 21:58:46.269181 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:58:46.269181 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:58:46.269181 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 488, in find_resource Oct 04 21:58:46.269181 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound( Oct 04 21:58:46.269181 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name or id 'does_not_exist' Oct 04 21:58:46.269181 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:58:46.269181 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:58:46.269181 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:58:46.269181 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:58:46.269181 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 21:58:46.269181 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 21:58:46.269181 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 21:58:46.269181 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 21:58:46.269181 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 21:58:46.269181 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 21:58:46.269181 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1074, in _validate_and_build_base_options Oct 04 21:58:46.269181 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi security_groups = self._check_requested_secgroups( Oct 04 21:58:46.269181 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 521, in _check_requested_secgroups Oct 04 21:58:46.269181 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi secgroup_uuid = security_group_api.validate_name(context, secgroup) Oct 04 21:58:46.269181 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 75, in validate_name Oct 04 21:58:46.269181 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 21:58:46.269181 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Unable to find security_group with name or id 'does_not_exist' Oct 04 21:58:46.269181 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:58:46.269181 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:58:46.269181 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:58:46.269181 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:58:46.269181 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:58:46.269181 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:58:46.269181 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:58:46.269181 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:58:46.269181 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:58:46.269181 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:58:46.269181 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:58:46.269181 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:58:46.269181 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:58:46.269181 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:58:46.269181 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:58:46.269181 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:58:46.269181 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 21:58:46.269181 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 04 21:58:46.269181 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 04 21:58:46.269181 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Unable to find security_group with name or id 'does_not_exist' Oct 04 21:58:46.269181 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:58:46.269181 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:58:46.269181 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:58:46.269181 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:58:46.269181 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:58:46.269181 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:58:46.269181 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:58:46.269181 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:58:46.269181 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unable to find security_group with name or id 'does_not_exist' Oct 04 21:58:46.269181 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:58:46.269181 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-962a4d6f-7bf6-46cd-9b50-4df8f7c2c2e7 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:58:46.273937 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-962a4d6f-7bf6-46cd-9b50-4df8f7c2c2e7 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 0.247364 Oct 04 21:58:46.273937 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1627/3291] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 21:58:46 2022] POST /compute/v2.1/servers => generated 106 bytes in 248 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 21:58:46.275738 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-4974c3bd-b0cf-4e60-a32b-0f8103315118 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:46.276370 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-4974c3bd-b0cf-4e60-a32b-0f8103315118 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: a4cf4fac-1e9b-4669-a6ff-30008ed3642d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:46.289297 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4974c3bd-b0cf-4e60-a32b-0f8103315118 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:46.291715 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4974c3bd-b0cf-4e60-a32b-0f8103315118 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:46.292197 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4974c3bd-b0cf-4e60-a32b-0f8103315118 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:46.292950 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4974c3bd-b0cf-4e60-a32b-0f8103315118 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:46.293421 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4974c3bd-b0cf-4e60-a32b-0f8103315118 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:46.302828 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4974c3bd-b0cf-4e60-a32b-0f8103315118 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:46.337460 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-8a889dc9-acc6-41b7-9068-8a5a70e82765 tempest-ServersAaction247Test-1008276901 tempest-ServersAaction247Test-1008276901-project] Flavor limits 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:58:46.338250 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-8a889dc9-acc6-41b7-9068-8a5a70e82765 tempest-ServersAaction247Test-1008276901 tempest-ServersAaction247Test-1008276901-project] Image limits 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:58:46.339126 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-8a889dc9-acc6-41b7-9068-8a5a70e82765 tempest-ServersAaction247Test-1008276901 tempest-ServersAaction247Test-1008276901-project] Flavor pref 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:58:46.339919 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-8a889dc9-acc6-41b7-9068-8a5a70e82765 tempest-ServersAaction247Test-1008276901 tempest-ServersAaction247Test-1008276901-project] Image pref 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:58:46.340553 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-8a889dc9-acc6-41b7-9068-8a5a70e82765 tempest-ServersAaction247Test-1008276901 tempest-ServersAaction247Test-1008276901-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:58:46.354444 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8a889dc9-acc6-41b7-9068-8a5a70e82765 tempest-ServersAaction247Test-1008276901 tempest-ServersAaction247Test-1008276901-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:46.355222 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8a889dc9-acc6-41b7-9068-8a5a70e82765 tempest-ServersAaction247Test-1008276901 tempest-ServersAaction247Test-1008276901-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:46.355934 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8a889dc9-acc6-41b7-9068-8a5a70e82765 tempest-ServersAaction247Test-1008276901 tempest-ServersAaction247Test-1008276901-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:46.357185 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8a889dc9-acc6-41b7-9068-8a5a70e82765 tempest-ServersAaction247Test-1008276901 tempest-ServersAaction247Test-1008276901-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:46.357922 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8a889dc9-acc6-41b7-9068-8a5a70e82765 tempest-ServersAaction247Test-1008276901 tempest-ServersAaction247Test-1008276901-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:46.358691 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8a889dc9-acc6-41b7-9068-8a5a70e82765 tempest-ServersAaction247Test-1008276901 tempest-ServersAaction247Test-1008276901-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:46.417846 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-8a889dc9-acc6-41b7-9068-8a5a70e82765 tempest-ServersAaction247Test-1008276901 tempest-ServersAaction247Test-1008276901-project] Getting quotas for project 02d298ab75ea49598ddc5f969fa45adc. Resources: {'instances', 'ram', 'cores'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:58:46.432706 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-8a889dc9-acc6-41b7-9068-8a5a70e82765 tempest-ServersAaction247Test-1008276901 tempest-ServersAaction247Test-1008276901-project] Getting quotas for user a8e807b622044e0e919097335487944d and project 02d298ab75ea49598ddc5f969fa45adc. Resources: {'instances', 'ram', 'cores'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:58:46.461722 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-8a889dc9-acc6-41b7-9068-8a5a70e82765 tempest-ServersAaction247Test-1008276901 tempest-ServersAaction247Test-1008276901-project] Going to run 1 instances... {{(pid=134102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:58:46.474075 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-8a889dc9-acc6-41b7-9068-8a5a70e82765 tempest-ServersAaction247Test-1008276901 tempest-ServersAaction247Test-1008276901-project] [instance: d9c4a8c7-1ce2-401b-9e16-f93f6743cddd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='58548514-5dac-426c-81f5-19e3fba33e23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:58:46.543602 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-8a889dc9-acc6-41b7-9068-8a5a70e82765 tempest-ServersAaction247Test-1008276901 tempest-ServersAaction247Test-1008276901-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.786029 Oct 04 21:58:46.552435 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1665/3292] 10.222.0.43 () {62 vars in 1188 bytes} [Tue Oct 4 21:58:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 795 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 04 21:58:46.561206 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-5507ab2d-ae04-48d5-84a3-cc6fa22cb6f7 tempest-ServersAaction247Test-1008276901 tempest-ServersAaction247Test-1008276901-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:46.562739 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-5507ab2d-ae04-48d5-84a3-cc6fa22cb6f7 tempest-ServersAaction247Test-1008276901 tempest-ServersAaction247Test-1008276901-project] [instance: d9c4a8c7-1ce2-401b-9e16-f93f6743cddd] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:46.618061 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-4974c3bd-b0cf-4e60-a32b-0f8103315118 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2facee4c6a40416e908083e126d2cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07a17a482a4e92b6ddbdee463c8029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:46.644485 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-4974c3bd-b0cf-4e60-a32b-0f8103315118 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d" status: 200 len: 1504 microversion: 2.1 time: 0.372386 Oct 04 21:58:46.647449 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1628/3293] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:58:46 2022] GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d => generated 1504 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:58:46.664924 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-1d64460c-b0fb-4344-a99f-e7f9e9a8bff4 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Calling method '.version_select at 0x7fbb2f2321f0>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:46.699902 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-5507ab2d-ae04-48d5-84a3-cc6fa22cb6f7 tempest-ServersAaction247Test-1008276901 tempest-ServersAaction247Test-1008276901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8e807b622044e0e919097335487944d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d298ab75ea49598ddc5f969fa45adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:46.709079 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-5507ab2d-ae04-48d5-84a3-cc6fa22cb6f7 tempest-ServersAaction247Test-1008276901 tempest-ServersAaction247Test-1008276901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8e807b622044e0e919097335487944d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d298ab75ea49598ddc5f969fa45adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:46.710924 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-5507ab2d-ae04-48d5-84a3-cc6fa22cb6f7 tempest-ServersAaction247Test-1008276901 tempest-ServersAaction247Test-1008276901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8e807b622044e0e919097335487944d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d298ab75ea49598ddc5f969fa45adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:46.712444 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-5507ab2d-ae04-48d5-84a3-cc6fa22cb6f7 tempest-ServersAaction247Test-1008276901 tempest-ServersAaction247Test-1008276901-project] 10.222.0.43 "GET /compute/v2.1/servers/d9c4a8c7-1ce2-401b-9e16-f93f6743cddd" status: 200 len: 1281 microversion: 2.47 time: 0.156792 Oct 04 21:58:46.726915 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1666/3294] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:58:46 2022] GET /compute/v2.1/servers/d9c4a8c7-1ce2-401b-9e16-f93f6743cddd => generated 1281 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:58:46.746810 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-0e34fbe0-233f-4d79-a62d-8de8cf7e9571 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:46.747592 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-0e34fbe0-233f-4d79-a62d-8de8cf7e9571 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: a4cf4fac-1e9b-4669-a6ff-30008ed3642d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:46.754694 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-1d64460c-b0fb-4344-a99f-e7f9e9a8bff4 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] 10.222.0.43 "GET /compute/v2.1/images/683538fe-4fde-450b-94cb-f14e6f8483a3" status: 200 len: 1419 microversion: 2.1 time: 0.105807 Oct 04 21:58:46.755295 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1629/3295] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:58:46 2022] GET /compute/v2.1/images/683538fe-4fde-450b-94cb-f14e6f8483a3 => generated 1419 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:58:46.758217 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0e34fbe0-233f-4d79-a62d-8de8cf7e9571 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:46.758853 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0e34fbe0-233f-4d79-a62d-8de8cf7e9571 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:46.759462 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0e34fbe0-233f-4d79-a62d-8de8cf7e9571 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:46.760282 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0e34fbe0-233f-4d79-a62d-8de8cf7e9571 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:46.761677 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0e34fbe0-233f-4d79-a62d-8de8cf7e9571 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:46.762213 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0e34fbe0-233f-4d79-a62d-8de8cf7e9571 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:46.779777 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-54aabcdb-58b9-4f35-b723-994d717076cb tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Calling method '.version_select at 0x7fbb2edffdc0>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:46.867372 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-54aabcdb-58b9-4f35-b723-994d717076cb tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] 10.222.0.43 "GET /compute/v2.1/images/683538fe-4fde-450b-94cb-f14e6f8483a3" status: 200 len: 1419 microversion: 2.1 time: 0.089199 Oct 04 21:58:46.869579 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1630/3296] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:58:46 2022] GET /compute/v2.1/images/683538fe-4fde-450b-94cb-f14e6f8483a3 => generated 1419 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:58:46.895166 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-bc0f628a-a69d-4753-8f95-9ec5d5ae1fd5 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Calling method '.version_select at 0x7fbb2e221790>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:46.970004 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-0e34fbe0-233f-4d79-a62d-8de8cf7e9571 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2facee4c6a40416e908083e126d2cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07a17a482a4e92b6ddbdee463c8029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:46.979146 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-0e34fbe0-233f-4d79-a62d-8de8cf7e9571 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d" status: 200 len: 1504 microversion: 2.1 time: 0.250731 Oct 04 21:58:46.995165 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1667/3297] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:58:46 2022] GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d => generated 1504 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:58:47.009969 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-23cacc5e-e3c9-4f4d-a987-9ee794da7497 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:47.010984 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-23cacc5e-e3c9-4f4d-a987-9ee794da7497 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: 9551f9f7-6b26-4929-98df-3c8f81ca1931] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:47.019370 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-23cacc5e-e3c9-4f4d-a987-9ee794da7497 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] HTTP exception thrown: Instance 9551f9f7-6b26-4929-98df-3c8f81ca1931 could not be found. Oct 04 21:58:47.022227 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-23cacc5e-e3c9-4f4d-a987-9ee794da7497 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Request method failure captured: Oct 04 21:58:47.022227 n-d-860284-1 devstack@n-api.service[134102]: request: DELETE /compute/v2.1/servers/9551f9f7-6b26-4929-98df-3c8f81ca1931 HTTP/1.1 Oct 04 21:58:47.022227 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 21:58:47.022227 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 21:58:47.022227 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 21:58:47.022227 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 21:58:47.022227 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 21:58:47.022227 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 21:58:47.022227 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 21:58:47.022227 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 21:58:47.022227 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPKwu4cpW6hhBuWb-qV_7iYlwjOTpf5XWCl53BJjoosjlcj4wkmmOFzemCJVdBntIx8zJ1SF_z6VrRY8UJr7E8TQDJCRnVQMdNnh0-lZwGdqUzjOWSO31Ryb6n87Cka0g238a21JWok3h3GEhLB-7oCbN3bbcOGmkhd6UFueRxRluk24 Oct 04 21:58:47.022227 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 21:58:47.022227 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 21:58:47.022227 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 21:58:47.022227 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 21:58:47.022227 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 21:58:47.022227 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 21:58:47.022227 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: cf07a17a482a4e92b6ddbdee463c8029 Oct 04 21:58:47.022227 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-ServersNegativeTestJSON-1933663319 Oct 04 21:58:47.022227 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 21:58:47.022227 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 21:58:47.022227 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/cf07a17a482a4e92b6ddbdee463c8029"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_cf07a17a482a4e92b6ddbdee463c8029", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/cf07a17a482a4e92b6ddbdee463c8029"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/cf07a17a482a4e92b6ddbdee463c8029"}]}] Oct 04 21:58:47.022227 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-ServersNegativeTestJSON-1933663319 Oct 04 21:58:47.022227 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: cf07a17a482a4e92b6ddbdee463c8029 Oct 04 21:58:47.022227 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1933663319 Oct 04 21:58:47.022227 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-ServersNegativeTestJSON-1933663319-project Oct 04 21:58:47.022227 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 21:58:47.022227 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 21:58:47.022227 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: 2facee4c6a40416e908083e126d2cfa3 Oct 04 21:58:47.022227 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-ServersNegativeTestJSON-1933663319-project Oct 04 21:58:47.022227 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 21:58:47.022227 n-d-860284-1 devstack@n-api.service[134102]: exception: Instance 9551f9f7-6b26-4929-98df-3c8f81ca1931 could not be found. Oct 04 21:58:47.022227 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': '9551f9f7-6b26-4929-98df-3c8f81ca1931'} Oct 04 21:58:47.022227 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:58:47.022227 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:58:47.022227 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:58:47.022227 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:58:47.022227 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:58:47.022227 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:58:47.022227 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 21:58:47.022227 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 21:58:47.022227 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9551f9f7-6b26-4929-98df-3c8f81ca1931 could not be found. Oct 04 21:58:47.022227 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:58:47.022227 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:58:47.022227 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:58:47.022227 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:58:47.022227 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:58:47.022227 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:58:47.022227 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:58:47.022227 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:58:47.022227 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:58:47.022227 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:58:47.022227 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 21:58:47.022227 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 21:58:47.022227 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 21:58:47.022227 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 21:58:47.022227 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:58:47.022227 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:58:47.022227 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:58:47.022227 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:58:47.022227 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9551f9f7-6b26-4929-98df-3c8f81ca1931 could not be found. Oct 04 21:58:47.022227 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:58:47.022227 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:58:47.027009 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:58:47.027009 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:58:47.027009 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:58:47.027009 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:58:47.027009 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:58:47.027009 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:58:47.027009 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9551f9f7-6b26-4929-98df-3c8f81ca1931 could not be found. Oct 04 21:58:47.027009 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:58:47.030354 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-23cacc5e-e3c9-4f4d-a987-9ee794da7497 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Returning 404 to user: Instance 9551f9f7-6b26-4929-98df-3c8f81ca1931 could not be found. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:58:47.035786 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-23cacc5e-e3c9-4f4d-a987-9ee794da7497 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "DELETE /compute/v2.1/servers/9551f9f7-6b26-4929-98df-3c8f81ca1931" status: 404 len: 111 microversion: 2.1 time: 0.030968 Oct 04 21:58:47.039748 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1668/3298] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 21:58:47 2022] DELETE /compute/v2.1/servers/9551f9f7-6b26-4929-98df-3c8f81ca1931 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 21:58:47.055781 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-dcee9958-f98e-4e1c-b4bd-3692cf497def tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:47.059317 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-dcee9958-f98e-4e1c-b4bd-3692cf497def tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: a4cf4fac-1e9b-4669-a6ff-30008ed3642d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:47.074649 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dcee9958-f98e-4e1c-b4bd-3692cf497def tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:47.076871 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dcee9958-f98e-4e1c-b4bd-3692cf497def tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:47.079199 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dcee9958-f98e-4e1c-b4bd-3692cf497def tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:47.081886 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dcee9958-f98e-4e1c-b4bd-3692cf497def tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:47.083495 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dcee9958-f98e-4e1c-b4bd-3692cf497def tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:47.084683 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dcee9958-f98e-4e1c-b4bd-3692cf497def tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:47.479922 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-dcee9958-f98e-4e1c-b4bd-3692cf497def tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2facee4c6a40416e908083e126d2cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07a17a482a4e92b6ddbdee463c8029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:47.489759 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-dcee9958-f98e-4e1c-b4bd-3692cf497def tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d" status: 200 len: 1504 microversion: 2.1 time: 0.447352 Oct 04 21:58:47.492215 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1669/3299] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:58:47 2022] GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d => generated 1504 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:58:47.504972 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-5b0a9474-1e02-42ed-8341-bdc9891cc09f tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:47.506856 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-5b0a9474-1e02-42ed-8341-bdc9891cc09f tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] [instance: d0b1b757-4a4d-4a7a-9a06-08f178a02984] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:47.527687 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5b0a9474-1e02-42ed-8341-bdc9891cc09f tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:47.534674 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5b0a9474-1e02-42ed-8341-bdc9891cc09f tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:47.535419 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5b0a9474-1e02-42ed-8341-bdc9891cc09f tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:47.537318 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5b0a9474-1e02-42ed-8341-bdc9891cc09f tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:47.539670 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5b0a9474-1e02-42ed-8341-bdc9891cc09f tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:47.540349 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5b0a9474-1e02-42ed-8341-bdc9891cc09f tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:47.643453 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-5b0a9474-1e02-42ed-8341-bdc9891cc09f tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:47.656725 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-5b0a9474-1e02-42ed-8341-bdc9891cc09f tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:47.660052 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-5b0a9474-1e02-42ed-8341-bdc9891cc09f tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:47.667758 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-5b0a9474-1e02-42ed-8341-bdc9891cc09f tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] 10.222.0.43 "GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984" status: 200 len: 1558 microversion: 2.91 time: 0.170707 Oct 04 21:58:47.669299 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1670/3300] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:58:47 2022] GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984 => generated 1558 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:58:47.688011 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-945035be-a907-46e1-8d6c-8b40b4f2139d tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:47.688669 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-945035be-a907-46e1-8d6c-8b40b4f2139d tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: a4cf4fac-1e9b-4669-a6ff-30008ed3642d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:47.700801 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-945035be-a907-46e1-8d6c-8b40b4f2139d tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:47.701372 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-945035be-a907-46e1-8d6c-8b40b4f2139d tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:47.701646 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-945035be-a907-46e1-8d6c-8b40b4f2139d tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:47.702409 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-945035be-a907-46e1-8d6c-8b40b4f2139d tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:47.702882 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-945035be-a907-46e1-8d6c-8b40b4f2139d tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:47.703282 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-945035be-a907-46e1-8d6c-8b40b4f2139d tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:47.896234 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-bc0f628a-a69d-4753-8f95-9ec5d5ae1fd5 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] 10.222.0.43 "DELETE /compute/v2.1/images/683538fe-4fde-450b-94cb-f14e6f8483a3" status: 204 len: 0 microversion: 2.1 time: 1.014436 Oct 04 21:58:47.896869 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1631/3301] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:58:46 2022] DELETE /compute/v2.1/images/683538fe-4fde-450b-94cb-f14e6f8483a3 => generated 0 bytes in 1016 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:58:47.902722 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-ebe454bd-c850-4277-bd61-5456a440c70c tempest-ServersAaction247Test-1008276901 tempest-ServersAaction247Test-1008276901-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:47.903332 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-ebe454bd-c850-4277-bd61-5456a440c70c tempest-ServersAaction247Test-1008276901 tempest-ServersAaction247Test-1008276901-project] [instance: d9c4a8c7-1ce2-401b-9e16-f93f6743cddd] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:47.931577 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=99,nova_api:DELETE=1 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:58:48.042070 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-ebe454bd-c850-4277-bd61-5456a440c70c tempest-ServersAaction247Test-1008276901 tempest-ServersAaction247Test-1008276901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8e807b622044e0e919097335487944d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d298ab75ea49598ddc5f969fa45adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:48.051902 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-ebe454bd-c850-4277-bd61-5456a440c70c tempest-ServersAaction247Test-1008276901 tempest-ServersAaction247Test-1008276901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8e807b622044e0e919097335487944d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d298ab75ea49598ddc5f969fa45adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:48.053970 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-ebe454bd-c850-4277-bd61-5456a440c70c tempest-ServersAaction247Test-1008276901 tempest-ServersAaction247Test-1008276901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8e807b622044e0e919097335487944d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d298ab75ea49598ddc5f969fa45adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:48.055645 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-ebe454bd-c850-4277-bd61-5456a440c70c tempest-ServersAaction247Test-1008276901 tempest-ServersAaction247Test-1008276901-project] 10.222.0.43 "GET /compute/v2.1/servers/d9c4a8c7-1ce2-401b-9e16-f93f6743cddd" status: 200 len: 1281 microversion: 2.47 time: 0.157750 Oct 04 21:58:48.084778 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1632/3302] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:58:47 2022] GET /compute/v2.1/servers/d9c4a8c7-1ce2-401b-9e16-f93f6743cddd => generated 1281 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:58:48.098293 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-2255e3f1-b954-4232-82d8-e092cb661f1d tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:48.099336 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-2255e3f1-b954-4232-82d8-e092cb661f1d tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] [instance: dad442d9-d2e1-49ee-93ea-6e5090634df8] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:48.107623 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2255e3f1-b954-4232-82d8-e092cb661f1d tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:48.108554 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2255e3f1-b954-4232-82d8-e092cb661f1d tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:48.110418 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2255e3f1-b954-4232-82d8-e092cb661f1d tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:48.112009 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2255e3f1-b954-4232-82d8-e092cb661f1d tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:48.112725 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2255e3f1-b954-4232-82d8-e092cb661f1d tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:48.113407 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2255e3f1-b954-4232-82d8-e092cb661f1d tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:48.147065 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-2255e3f1-b954-4232-82d8-e092cb661f1d tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] [instance: dad442d9-d2e1-49ee-93ea-6e5090634df8] Going to try to terminate instance {{(pid=134101) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:58:48.245850 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-945035be-a907-46e1-8d6c-8b40b4f2139d tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2facee4c6a40416e908083e126d2cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07a17a482a4e92b6ddbdee463c8029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:48.279252 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-945035be-a907-46e1-8d6c-8b40b4f2139d tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d" status: 200 len: 1504 microversion: 2.1 time: 0.608470 Oct 04 21:58:48.283525 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1671/3303] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:58:47 2022] GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d => generated 1504 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:58:48.304787 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-75bcf977-ed27-4308-ae95-2ac73a745814 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:48.305709 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-75bcf977-ed27-4308-ae95-2ac73a745814 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Failed to fetch instance by id 9223372036854775808 {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 04 21:58:48.306944 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-75bcf977-ed27-4308-ae95-2ac73a745814 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Oct 04 21:58:48.310042 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-75bcf977-ed27-4308-ae95-2ac73a745814 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Request method failure captured: Oct 04 21:58:48.310042 n-d-860284-1 devstack@n-api.service[134102]: request: DELETE /compute/v2.1/servers/9223372036854775808 HTTP/1.1 Oct 04 21:58:48.310042 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 21:58:48.310042 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 21:58:48.310042 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 21:58:48.310042 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 21:58:48.310042 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 21:58:48.310042 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 21:58:48.310042 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 21:58:48.310042 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 21:58:48.310042 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPKwu4cpW6hhBuWb-qV_7iYlwjOTpf5XWCl53BJjoosjlcj4wkmmOFzemCJVdBntIx8zJ1SF_z6VrRY8UJr7E8TQDJCRnVQMdNnh0-lZwGdqUzjOWSO31Ryb6n87Cka0g238a21JWok3h3GEhLB-7oCbN3bbcOGmkhd6UFueRxRluk24 Oct 04 21:58:48.310042 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 21:58:48.310042 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 21:58:48.310042 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 21:58:48.310042 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 21:58:48.310042 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 21:58:48.310042 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 21:58:48.310042 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: cf07a17a482a4e92b6ddbdee463c8029 Oct 04 21:58:48.310042 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-ServersNegativeTestJSON-1933663319 Oct 04 21:58:48.310042 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 21:58:48.310042 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 21:58:48.310042 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/cf07a17a482a4e92b6ddbdee463c8029"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_cf07a17a482a4e92b6ddbdee463c8029", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/cf07a17a482a4e92b6ddbdee463c8029"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/cf07a17a482a4e92b6ddbdee463c8029"}]}] Oct 04 21:58:48.310042 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-ServersNegativeTestJSON-1933663319 Oct 04 21:58:48.310042 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: cf07a17a482a4e92b6ddbdee463c8029 Oct 04 21:58:48.310042 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1933663319 Oct 04 21:58:48.310042 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-ServersNegativeTestJSON-1933663319-project Oct 04 21:58:48.310042 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 21:58:48.310042 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 21:58:48.310042 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: 2facee4c6a40416e908083e126d2cfa3 Oct 04 21:58:48.310042 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-ServersNegativeTestJSON-1933663319-project Oct 04 21:58:48.310042 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 21:58:48.310042 n-d-860284-1 devstack@n-api.service[134102]: exception: Instance 9223372036854775808 could not be found. Oct 04 21:58:48.310042 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': '9223372036854775808'} Oct 04 21:58:48.310042 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:58:48.310042 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:58:48.310042 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:58:48.310042 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:58:48.310042 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 04 21:58:48.310042 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 04 21:58:48.310042 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9223372036854775808 could not be found. Oct 04 21:58:48.310042 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:58:48.310042 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:58:48.310042 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:58:48.310042 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:58:48.310042 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:58:48.310042 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:58:48.310042 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:58:48.310042 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:58:48.310042 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:58:48.310042 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:58:48.310042 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 21:58:48.310042 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 21:58:48.310042 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 21:58:48.310042 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 21:58:48.310042 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:58:48.310042 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:58:48.310042 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:58:48.310042 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:58:48.310042 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9223372036854775808 could not be found. Oct 04 21:58:48.310042 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:58:48.310042 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:58:48.310042 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:58:48.310042 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:58:48.310042 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:58:48.315317 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:58:48.315317 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:58:48.315317 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:58:48.315317 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9223372036854775808 could not be found. Oct 04 21:58:48.315317 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:58:48.315994 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-2255e3f1-b954-4232-82d8-e092cb661f1d tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] 10.222.0.43 "DELETE /compute/v2.1/servers/dad442d9-d2e1-49ee-93ea-6e5090634df8" status: 204 len: 0 microversion: 2.1 time: 0.224840 Oct 04 21:58:48.316126 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-75bcf977-ed27-4308-ae95-2ac73a745814 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:58:48.316252 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1633/3304] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 21:58:48 2022] DELETE /compute/v2.1/servers/dad442d9-d2e1-49ee-93ea-6e5090634df8 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:58:48.316535 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-75bcf977-ed27-4308-ae95-2ac73a745814 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.017231 Oct 04 21:58:48.318402 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1672/3305] 10.222.0.43 () {58 vars in 1188 bytes} [Tue Oct 4 21:58:48 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 04 21:58:48.340596 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-9d45f996-b1bd-4e5f-ab7c-cb4d0b2c51a8 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:48.341439 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-9d45f996-b1bd-4e5f-ab7c-cb4d0b2c51a8 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: a4cf4fac-1e9b-4669-a6ff-30008ed3642d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:48.354528 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9d45f996-b1bd-4e5f-ab7c-cb4d0b2c51a8 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:48.355841 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9d45f996-b1bd-4e5f-ab7c-cb4d0b2c51a8 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:48.366290 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9d45f996-b1bd-4e5f-ab7c-cb4d0b2c51a8 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:48.367127 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9d45f996-b1bd-4e5f-ab7c-cb4d0b2c51a8 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:48.367740 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9d45f996-b1bd-4e5f-ab7c-cb4d0b2c51a8 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:48.368191 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9d45f996-b1bd-4e5f-ab7c-cb4d0b2c51a8 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:48.698790 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-f9763e20-2859-4685-a35b-a9a4c0f70b69 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:48.699670 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-f9763e20-2859-4685-a35b-a9a4c0f70b69 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] [instance: d0b1b757-4a4d-4a7a-9a06-08f178a02984] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:48.723631 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f9763e20-2859-4685-a35b-a9a4c0f70b69 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:48.724960 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f9763e20-2859-4685-a35b-a9a4c0f70b69 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:48.725582 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f9763e20-2859-4685-a35b-a9a4c0f70b69 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:48.726525 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f9763e20-2859-4685-a35b-a9a4c0f70b69 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:48.728555 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f9763e20-2859-4685-a35b-a9a4c0f70b69 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:48.729004 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f9763e20-2859-4685-a35b-a9a4c0f70b69 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:48.917399 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-f9763e20-2859-4685-a35b-a9a4c0f70b69 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:48.921918 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-9d45f996-b1bd-4e5f-ab7c-cb4d0b2c51a8 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2facee4c6a40416e908083e126d2cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07a17a482a4e92b6ddbdee463c8029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:48.933410 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-9d45f996-b1bd-4e5f-ab7c-cb4d0b2c51a8 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d" status: 200 len: 1504 microversion: 2.1 time: 0.609601 Oct 04 21:58:48.946691 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1634/3306] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:58:48 2022] GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d => generated 1504 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:58:48.946950 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-f9763e20-2859-4685-a35b-a9a4c0f70b69 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:48.951050 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-35fc2731-43ea-4b32-befd-c6b8d40b2faa tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1059886108", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452", "networks": [{"uuid": "7f0614ac-f6a1-4d4e-8554-b89cfa5772c4"}]}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:58:48.951435 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-f9763e20-2859-4685-a35b-a9a4c0f70b69 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:48.980684 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-f9763e20-2859-4685-a35b-a9a4c0f70b69 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] 10.222.0.43 "GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984" status: 200 len: 1553 microversion: 2.91 time: 0.287158 Oct 04 21:58:48.983931 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1673/3307] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:58:48 2022] GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984 => generated 1553 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:58:48.989565 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-64a1ffbd-b9d7-4735-b50b-b7ecbe291584 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:48.989710 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-64a1ffbd-b9d7-4735-b50b-b7ecbe291584 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: a4cf4fac-1e9b-4669-a6ff-30008ed3642d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:49.016581 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-64a1ffbd-b9d7-4735-b50b-b7ecbe291584 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:49.017195 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-64a1ffbd-b9d7-4735-b50b-b7ecbe291584 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:49.017502 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-64a1ffbd-b9d7-4735-b50b-b7ecbe291584 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:49.018211 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-64a1ffbd-b9d7-4735-b50b-b7ecbe291584 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:49.018695 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-64a1ffbd-b9d7-4735-b50b-b7ecbe291584 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:49.019120 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-64a1ffbd-b9d7-4735-b50b-b7ecbe291584 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:49.092476 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.network.neutron [None req-35fc2731-43ea-4b32-befd-c6b8d40b2faa tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] validate_networks() for [('7f0614ac-f6a1-4d4e-8554-b89cfa5772c4', None, None, None, None, None)] {{(pid=134101) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:58:49.558094 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-64a1ffbd-b9d7-4735-b50b-b7ecbe291584 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2facee4c6a40416e908083e126d2cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07a17a482a4e92b6ddbdee463c8029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:49.571708 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-64a1ffbd-b9d7-4735-b50b-b7ecbe291584 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d" status: 200 len: 1504 microversion: 2.1 time: 0.586370 Oct 04 21:58:49.572313 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1674/3308] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:58:48 2022] GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d => generated 1504 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:58:49.582993 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-e9b5c092-d2fb-47e7-9d7b-e8b77007c021 tempest-ServersAaction247Test-1008276901 tempest-ServersAaction247Test-1008276901-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:49.583629 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-e9b5c092-d2fb-47e7-9d7b-e8b77007c021 tempest-ServersAaction247Test-1008276901 tempest-ServersAaction247Test-1008276901-project] [instance: d9c4a8c7-1ce2-401b-9e16-f93f6743cddd] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:49.602286 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e9b5c092-d2fb-47e7-9d7b-e8b77007c021 tempest-ServersAaction247Test-1008276901 tempest-ServersAaction247Test-1008276901-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:49.602895 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e9b5c092-d2fb-47e7-9d7b-e8b77007c021 tempest-ServersAaction247Test-1008276901 tempest-ServersAaction247Test-1008276901-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:49.603348 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e9b5c092-d2fb-47e7-9d7b-e8b77007c021 tempest-ServersAaction247Test-1008276901 tempest-ServersAaction247Test-1008276901-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:49.604082 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e9b5c092-d2fb-47e7-9d7b-e8b77007c021 tempest-ServersAaction247Test-1008276901 tempest-ServersAaction247Test-1008276901-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:49.604547 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e9b5c092-d2fb-47e7-9d7b-e8b77007c021 tempest-ServersAaction247Test-1008276901 tempest-ServersAaction247Test-1008276901-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:49.604980 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e9b5c092-d2fb-47e7-9d7b-e8b77007c021 tempest-ServersAaction247Test-1008276901 tempest-ServersAaction247Test-1008276901-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:49.791739 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-e9b5c092-d2fb-47e7-9d7b-e8b77007c021 tempest-ServersAaction247Test-1008276901 tempest-ServersAaction247Test-1008276901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8e807b622044e0e919097335487944d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d298ab75ea49598ddc5f969fa45adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:49.812245 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-e9b5c092-d2fb-47e7-9d7b-e8b77007c021 tempest-ServersAaction247Test-1008276901 tempest-ServersAaction247Test-1008276901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8e807b622044e0e919097335487944d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d298ab75ea49598ddc5f969fa45adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:49.813890 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-e9b5c092-d2fb-47e7-9d7b-e8b77007c021 tempest-ServersAaction247Test-1008276901 tempest-ServersAaction247Test-1008276901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8e807b622044e0e919097335487944d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d298ab75ea49598ddc5f969fa45adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:49.822998 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-e9b5c092-d2fb-47e7-9d7b-e8b77007c021 tempest-ServersAaction247Test-1008276901 tempest-ServersAaction247Test-1008276901-project] 10.222.0.43 "GET /compute/v2.1/servers/d9c4a8c7-1ce2-401b-9e16-f93f6743cddd" status: 200 len: 1333 microversion: 2.47 time: 0.241857 Oct 04 21:58:49.823665 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1675/3309] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:58:49 2022] GET /compute/v2.1/servers/d9c4a8c7-1ce2-401b-9e16-f93f6743cddd => generated 1333 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:58:49.841793 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-bd7e6880-e1ed-4557-ad63-7ed16e508295 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:49.842706 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-bd7e6880-e1ed-4557-ad63-7ed16e508295 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Failed to fetch instance by id -1 {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 04 21:58:49.843931 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-bd7e6880-e1ed-4557-ad63-7ed16e508295 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] HTTP exception thrown: Instance -1 could not be found. Oct 04 21:58:49.846947 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-bd7e6880-e1ed-4557-ad63-7ed16e508295 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Request method failure captured: Oct 04 21:58:49.846947 n-d-860284-1 devstack@n-api.service[134102]: request: DELETE /compute/v2.1/servers/-1 HTTP/1.1 Oct 04 21:58:49.846947 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 21:58:49.846947 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 21:58:49.846947 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 21:58:49.846947 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 21:58:49.846947 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 21:58:49.846947 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 21:58:49.846947 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 21:58:49.846947 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 21:58:49.846947 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPKwu4cpW6hhBuWb-qV_7iYlwjOTpf5XWCl53BJjoosjlcj4wkmmOFzemCJVdBntIx8zJ1SF_z6VrRY8UJr7E8TQDJCRnVQMdNnh0-lZwGdqUzjOWSO31Ryb6n87Cka0g238a21JWok3h3GEhLB-7oCbN3bbcOGmkhd6UFueRxRluk24 Oct 04 21:58:49.846947 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 21:58:49.846947 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 21:58:49.846947 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 21:58:49.846947 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 21:58:49.846947 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 21:58:49.846947 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 21:58:49.846947 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: cf07a17a482a4e92b6ddbdee463c8029 Oct 04 21:58:49.846947 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-ServersNegativeTestJSON-1933663319 Oct 04 21:58:49.846947 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 21:58:49.846947 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 21:58:49.846947 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/cf07a17a482a4e92b6ddbdee463c8029"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_cf07a17a482a4e92b6ddbdee463c8029", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/cf07a17a482a4e92b6ddbdee463c8029"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/cf07a17a482a4e92b6ddbdee463c8029"}]}] Oct 04 21:58:49.846947 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-ServersNegativeTestJSON-1933663319 Oct 04 21:58:49.846947 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: cf07a17a482a4e92b6ddbdee463c8029 Oct 04 21:58:49.846947 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1933663319 Oct 04 21:58:49.846947 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-ServersNegativeTestJSON-1933663319-project Oct 04 21:58:49.846947 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 21:58:49.846947 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 21:58:49.846947 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: 2facee4c6a40416e908083e126d2cfa3 Oct 04 21:58:49.846947 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-ServersNegativeTestJSON-1933663319-project Oct 04 21:58:49.846947 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 21:58:49.846947 n-d-860284-1 devstack@n-api.service[134102]: exception: Instance -1 could not be found. Oct 04 21:58:49.846947 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': '-1'} Oct 04 21:58:49.846947 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:58:49.846947 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:58:49.846947 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:58:49.846947 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:58:49.846947 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 04 21:58:49.846947 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 04 21:58:49.846947 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance -1 could not be found. Oct 04 21:58:49.846947 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:58:49.846947 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:58:49.846947 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:58:49.846947 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:58:49.846947 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:58:49.846947 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:58:49.846947 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:58:49.846947 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:58:49.846947 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:58:49.846947 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:58:49.846947 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 21:58:49.846947 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 21:58:49.846947 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 21:58:49.846947 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 21:58:49.846947 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:58:49.846947 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:58:49.846947 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:58:49.846947 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:58:49.846947 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance -1 could not be found. Oct 04 21:58:49.846947 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:58:49.846947 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:58:49.846947 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:58:49.846947 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:58:49.846947 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:58:49.846947 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:58:49.851150 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:58:49.851150 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:58:49.851150 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance -1 could not be found. Oct 04 21:58:49.851150 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:58:49.857908 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-bd7e6880-e1ed-4557-ad63-7ed16e508295 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Returning 404 to user: Instance -1 could not be found. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:58:49.860356 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-bd7e6880-e1ed-4557-ad63-7ed16e508295 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.034287 Oct 04 21:58:49.865886 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1676/3310] 10.222.0.43 () {58 vars in 1137 bytes} [Tue Oct 4 21:58:49 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 21:58:49.882347 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-ca13c444-dd4f-4a1f-9f95-059ba545265c tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:49.883319 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-ca13c444-dd4f-4a1f-9f95-059ba545265c tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: a4cf4fac-1e9b-4669-a6ff-30008ed3642d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:49.897398 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-35fc2731-43ea-4b32-befd-c6b8d40b2faa tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Flavor limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:58:49.898800 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-35fc2731-43ea-4b32-befd-c6b8d40b2faa tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Image limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:58:49.899542 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-35fc2731-43ea-4b32-befd-c6b8d40b2faa tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Flavor pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:58:49.900206 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-35fc2731-43ea-4b32-befd-c6b8d40b2faa tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Image pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:58:49.901768 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-35fc2731-43ea-4b32-befd-c6b8d40b2faa tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:58:49.912526 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ca13c444-dd4f-4a1f-9f95-059ba545265c tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:49.913050 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ca13c444-dd4f-4a1f-9f95-059ba545265c tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:49.913503 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ca13c444-dd4f-4a1f-9f95-059ba545265c tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:49.914234 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ca13c444-dd4f-4a1f-9f95-059ba545265c tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:49.914726 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ca13c444-dd4f-4a1f-9f95-059ba545265c tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:49.915167 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ca13c444-dd4f-4a1f-9f95-059ba545265c tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:49.943141 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-35fc2731-43ea-4b32-befd-c6b8d40b2faa tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:49.944629 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-35fc2731-43ea-4b32-befd-c6b8d40b2faa tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:49.946903 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-35fc2731-43ea-4b32-befd-c6b8d40b2faa tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:49.949160 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-35fc2731-43ea-4b32-befd-c6b8d40b2faa tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:49.950170 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-35fc2731-43ea-4b32-befd-c6b8d40b2faa tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:49.951554 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-35fc2731-43ea-4b32-befd-c6b8d40b2faa tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:50.022627 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-35fc2731-43ea-4b32-befd-c6b8d40b2faa tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Getting quotas for project 40071e45805146529fb8abd40629c2ae. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:58:50.048627 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-35fc2731-43ea-4b32-befd-c6b8d40b2faa tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Getting quotas for user f5e807c724cc4c3887a2d360f0584ffb and project 40071e45805146529fb8abd40629c2ae. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:58:50.132402 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-35fc2731-43ea-4b32-befd-c6b8d40b2faa tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Going to run 1 instances... {{(pid=134101) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:58:50.149914 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-35fc2731-43ea-4b32-befd-c6b8d40b2faa tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] [instance: e57b3eb4-9ac6-4f6b-bbe1-a8582bdf543b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='58548514-5dac-426c-81f5-19e3fba33e23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134101) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:58:50.236299 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-35fc2731-43ea-4b32-befd-c6b8d40b2faa tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.297126 Oct 04 21:58:50.239539 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1635/3311] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 21:58:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 1301 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:58:50.256598 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-c2c6c950-b119-4c3d-86a4-9e939cf8c343 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:50.259402 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-c2c6c950-b119-4c3d-86a4-9e939cf8c343 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] [instance: d0b1b757-4a4d-4a7a-9a06-08f178a02984] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:50.302133 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c2c6c950-b119-4c3d-86a4-9e939cf8c343 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:50.304300 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c2c6c950-b119-4c3d-86a4-9e939cf8c343 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:50.304826 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c2c6c950-b119-4c3d-86a4-9e939cf8c343 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:50.305909 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c2c6c950-b119-4c3d-86a4-9e939cf8c343 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:50.306038 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c2c6c950-b119-4c3d-86a4-9e939cf8c343 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:50.308184 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c2c6c950-b119-4c3d-86a4-9e939cf8c343 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:50.319812 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-ca13c444-dd4f-4a1f-9f95-059ba545265c tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2facee4c6a40416e908083e126d2cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07a17a482a4e92b6ddbdee463c8029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:50.328454 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-ca13c444-dd4f-4a1f-9f95-059ba545265c tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d" status: 200 len: 1504 microversion: 2.1 time: 0.461101 Oct 04 21:58:50.332729 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1677/3312] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:58:49 2022] GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d => generated 1504 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:58:50.357711 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-75144891-4143-470b-a6a5-b99a16a01994 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:50.358345 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-75144891-4143-470b-a6a5-b99a16a01994 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] [instance: e57b3eb4-9ac6-4f6b-bbe1-a8582bdf543b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:50.587319 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-75144891-4143-470b-a6a5-b99a16a01994 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e807c724cc4c3887a2d360f0584ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40071e45805146529fb8abd40629c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:50.596540 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-75144891-4143-470b-a6a5-b99a16a01994 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] 10.222.0.43 "GET /compute/v2.1/servers/e57b3eb4-9ac6-4f6b-bbe1-a8582bdf543b" status: 200 len: 1208 microversion: 2.1 time: 0.252513 Oct 04 21:58:50.618428 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-c2c6c950-b119-4c3d-86a4-9e939cf8c343 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:50.623345 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1678/3313] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:58:50 2022] GET /compute/v2.1/servers/e57b3eb4-9ac6-4f6b-bbe1-a8582bdf543b => generated 1208 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:58:50.630725 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-c2c6c950-b119-4c3d-86a4-9e939cf8c343 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:50.635229 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-8824cf3c-6a00-4eef-bd01-d4aac4213d09 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:50.636273 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-8824cf3c-6a00-4eef-bd01-d4aac4213d09 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: a4cf4fac-1e9b-4669-a6ff-30008ed3642d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:50.650408 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8824cf3c-6a00-4eef-bd01-d4aac4213d09 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:50.651134 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8824cf3c-6a00-4eef-bd01-d4aac4213d09 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:50.651894 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8824cf3c-6a00-4eef-bd01-d4aac4213d09 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:50.652899 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-c2c6c950-b119-4c3d-86a4-9e939cf8c343 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:50.653798 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8824cf3c-6a00-4eef-bd01-d4aac4213d09 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:50.654987 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8824cf3c-6a00-4eef-bd01-d4aac4213d09 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:50.656426 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8824cf3c-6a00-4eef-bd01-d4aac4213d09 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:50.674874 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-c2c6c950-b119-4c3d-86a4-9e939cf8c343 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] 10.222.0.43 "GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984" status: 200 len: 1553 microversion: 2.91 time: 0.433720 Oct 04 21:58:50.681801 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1636/3314] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:58:50 2022] GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984 => generated 1553 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:58:50.853284 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-9d398d50-b4bd-4b0f-96ad-917f8df4be75 tempest-ServersAaction247Test-1008276901 tempest-ServersAaction247Test-1008276901-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:50.853829 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-9d398d50-b4bd-4b0f-96ad-917f8df4be75 tempest-ServersAaction247Test-1008276901 tempest-ServersAaction247Test-1008276901-project] [instance: d9c4a8c7-1ce2-401b-9e16-f93f6743cddd] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:50.865524 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9d398d50-b4bd-4b0f-96ad-917f8df4be75 tempest-ServersAaction247Test-1008276901 tempest-ServersAaction247Test-1008276901-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:50.877642 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9d398d50-b4bd-4b0f-96ad-917f8df4be75 tempest-ServersAaction247Test-1008276901 tempest-ServersAaction247Test-1008276901-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:50.880829 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9d398d50-b4bd-4b0f-96ad-917f8df4be75 tempest-ServersAaction247Test-1008276901 tempest-ServersAaction247Test-1008276901-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:50.884547 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9d398d50-b4bd-4b0f-96ad-917f8df4be75 tempest-ServersAaction247Test-1008276901 tempest-ServersAaction247Test-1008276901-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:50.886948 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9d398d50-b4bd-4b0f-96ad-917f8df4be75 tempest-ServersAaction247Test-1008276901 tempest-ServersAaction247Test-1008276901-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:50.888300 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9d398d50-b4bd-4b0f-96ad-917f8df4be75 tempest-ServersAaction247Test-1008276901 tempest-ServersAaction247Test-1008276901-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:51.314149 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-8824cf3c-6a00-4eef-bd01-d4aac4213d09 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2facee4c6a40416e908083e126d2cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07a17a482a4e92b6ddbdee463c8029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:51.321144 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-9d398d50-b4bd-4b0f-96ad-917f8df4be75 tempest-ServersAaction247Test-1008276901 tempest-ServersAaction247Test-1008276901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8e807b622044e0e919097335487944d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d298ab75ea49598ddc5f969fa45adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:51.323033 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-8824cf3c-6a00-4eef-bd01-d4aac4213d09 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d" status: 200 len: 1504 microversion: 2.1 time: 0.698239 Oct 04 21:58:51.323627 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1679/3315] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:58:50 2022] GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d => generated 1504 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:58:51.349381 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-9d398d50-b4bd-4b0f-96ad-917f8df4be75 tempest-ServersAaction247Test-1008276901 tempest-ServersAaction247Test-1008276901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8e807b622044e0e919097335487944d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d298ab75ea49598ddc5f969fa45adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:51.360010 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-9d398d50-b4bd-4b0f-96ad-917f8df4be75 tempest-ServersAaction247Test-1008276901 tempest-ServersAaction247Test-1008276901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8e807b622044e0e919097335487944d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d298ab75ea49598ddc5f969fa45adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:51.360230 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-35cd05db-ee14-4627-af8e-4307b93d4dfb req-d1e57a65-99a0-40df-8d1c-a9a6623961bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dad442d9-d2e1-49ee-93ea-6e5090634df8", "name": "network-vif-deleted", "tag": "38ab1df9-0112-4774-abf7-063259d4b821"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:58:51.362242 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-9d398d50-b4bd-4b0f-96ad-917f8df4be75 tempest-ServersAaction247Test-1008276901 tempest-ServersAaction247Test-1008276901-project] 10.222.0.43 "GET /compute/v2.1/servers/d9c4a8c7-1ce2-401b-9e16-f93f6743cddd" status: 200 len: 1339 microversion: 2.47 time: 0.513042 Oct 04 21:58:51.363448 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1637/3316] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:58:50 2022] GET /compute/v2.1/servers/d9c4a8c7-1ce2-401b-9e16-f93f6743cddd => generated 1339 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:58:51.378542 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-bd43378d-15a3-483f-bc36-eaf727ca78c8 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:58:51.379488 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-bd43378d-15a3-483f-bc36-eaf727ca78c8 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: 37a9b38c-684b-44e1-8609-a99e8f5e2598] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:51.392024 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-bd43378d-15a3-483f-bc36-eaf727ca78c8 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] HTTP exception thrown: Instance 37a9b38c-684b-44e1-8609-a99e8f5e2598 could not be found. Oct 04 21:58:51.401735 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-bd43378d-15a3-483f-bc36-eaf727ca78c8 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Request method failure captured: Oct 04 21:58:51.401735 n-d-860284-1 devstack@n-api.service[134101]: request: POST /compute/v2.1/servers/37a9b38c-684b-44e1-8609-a99e8f5e2598/action HTTP/1.1 Oct 04 21:58:51.401735 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 21:58:51.401735 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 21:58:51.401735 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 21:58:51.401735 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 19 Oct 04 21:58:51.401735 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 21:58:51.401735 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 21:58:51.401735 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 21:58:51.401735 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 21:58:51.401735 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPKwu4cpW6hhBuWb-qV_7iYlwjOTpf5XWCl53BJjoosjlcj4wkmmOFzemCJVdBntIx8zJ1SF_z6VrRY8UJr7E8TQDJCRnVQMdNnh0-lZwGdqUzjOWSO31Ryb6n87Cka0g238a21JWok3h3GEhLB-7oCbN3bbcOGmkhd6UFueRxRluk24 Oct 04 21:58:51.401735 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 21:58:51.401735 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 21:58:51.401735 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 21:58:51.401735 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 21:58:51.401735 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 21:58:51.401735 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 21:58:51.401735 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: cf07a17a482a4e92b6ddbdee463c8029 Oct 04 21:58:51.401735 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-ServersNegativeTestJSON-1933663319 Oct 04 21:58:51.401735 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 21:58:51.401735 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 21:58:51.401735 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/cf07a17a482a4e92b6ddbdee463c8029"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_cf07a17a482a4e92b6ddbdee463c8029", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/cf07a17a482a4e92b6ddbdee463c8029"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/cf07a17a482a4e92b6ddbdee463c8029"}]}] Oct 04 21:58:51.401735 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-ServersNegativeTestJSON-1933663319 Oct 04 21:58:51.401735 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: cf07a17a482a4e92b6ddbdee463c8029 Oct 04 21:58:51.401735 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1933663319 Oct 04 21:58:51.401735 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-ServersNegativeTestJSON-1933663319-project Oct 04 21:58:51.401735 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 21:58:51.401735 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 21:58:51.401735 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 2facee4c6a40416e908083e126d2cfa3 Oct 04 21:58:51.401735 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-ServersNegativeTestJSON-1933663319-project Oct 04 21:58:51.401735 n-d-860284-1 devstack@n-api.service[134101]: Oct 04 21:58:51.401735 n-d-860284-1 devstack@n-api.service[134101]: {"forceDelete": {}} Oct 04 21:58:51.401735 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 21:58:51.401735 n-d-860284-1 devstack@n-api.service[134101]: exception: Instance 37a9b38c-684b-44e1-8609-a99e8f5e2598 could not be found. Oct 04 21:58:51.401735 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': '37a9b38c-684b-44e1-8609-a99e8f5e2598', 'body': {'forceDelete': {}}} Oct 04 21:58:51.401735 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:58:51.401735 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:58:51.401735 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:58:51.401735 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:58:51.401735 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:58:51.401735 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:58:51.401735 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 21:58:51.401735 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 21:58:51.401735 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37a9b38c-684b-44e1-8609-a99e8f5e2598 could not be found. Oct 04 21:58:51.401735 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:58:51.401735 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:58:51.401735 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:58:51.401735 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:58:51.401735 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:58:51.401735 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:58:51.401735 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:58:51.401735 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:58:51.401735 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:58:51.401735 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:58:51.401735 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 55, in _force_delete Oct 04 21:58:51.401735 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 04 21:58:51.401735 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:58:51.401735 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:58:51.401735 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37a9b38c-684b-44e1-8609-a99e8f5e2598 could not be found. Oct 04 21:58:51.401735 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:58:51.401735 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:58:51.401735 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:58:51.401735 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:58:51.401735 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:58:51.401735 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:58:51.408628 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:58:51.408628 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:58:51.408628 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37a9b38c-684b-44e1-8609-a99e8f5e2598 could not be found. Oct 04 21:58:51.408628 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:58:51.411196 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-bd43378d-15a3-483f-bc36-eaf727ca78c8 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Returning 404 to user: Instance 37a9b38c-684b-44e1-8609-a99e8f5e2598 could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:58:51.412755 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-bd43378d-15a3-483f-bc36-eaf727ca78c8 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "POST /compute/v2.1/servers/37a9b38c-684b-44e1-8609-a99e8f5e2598/action" status: 404 len: 111 microversion: 2.1 time: 0.047935 Oct 04 21:58:51.413562 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1638/3317] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 21:58:51 2022] POST /compute/v2.1/servers/37a9b38c-684b-44e1-8609-a99e8f5e2598/action => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:58:51.420094 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-35cd05db-ee14-4627-af8e-4307b93d4dfb req-d1e57a65-99a0-40df-8d1c-a9a6623961bb service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:51.422866 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-35cd05db-ee14-4627-af8e-4307b93d4dfb req-d1e57a65-99a0-40df-8d1c-a9a6623961bb service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:51.425080 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-071b1d3d-f018-4f74-b0f7-561f0c1cb477 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:51.425388 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-35cd05db-ee14-4627-af8e-4307b93d4dfb req-d1e57a65-99a0-40df-8d1c-a9a6623961bb service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:51.427142 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-071b1d3d-f018-4f74-b0f7-561f0c1cb477 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: a4cf4fac-1e9b-4669-a6ff-30008ed3642d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:51.444488 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-071b1d3d-f018-4f74-b0f7-561f0c1cb477 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:51.445382 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-071b1d3d-f018-4f74-b0f7-561f0c1cb477 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:51.446058 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-071b1d3d-f018-4f74-b0f7-561f0c1cb477 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:51.447525 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-071b1d3d-f018-4f74-b0f7-561f0c1cb477 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:51.449932 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-071b1d3d-f018-4f74-b0f7-561f0c1cb477 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:51.450606 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-071b1d3d-f018-4f74-b0f7-561f0c1cb477 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:51.461463 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-35cd05db-ee14-4627-af8e-4307b93d4dfb req-d1e57a65-99a0-40df-8d1c-a9a6623961bb service nova] Creating event network-vif-deleted:38ab1df9-0112-4774-abf7-063259d4b821 for instance dad442d9-d2e1-49ee-93ea-6e5090634df8 on n-h2-860284-1 Oct 04 21:58:51.470297 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-35cd05db-ee14-4627-af8e-4307b93d4dfb req-d1e57a65-99a0-40df-8d1c-a9a6623961bb service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133121 Oct 04 21:58:51.470960 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1680/3318] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:58:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:58:51.631586 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-e6864a19-26cf-4d86-b772-de42858418c3 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:51.632577 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-e6864a19-26cf-4d86-b772-de42858418c3 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] [instance: e57b3eb4-9ac6-4f6b-bbe1-a8582bdf543b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:51.642706 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e6864a19-26cf-4d86-b772-de42858418c3 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:51.647025 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e6864a19-26cf-4d86-b772-de42858418c3 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:51.647682 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e6864a19-26cf-4d86-b772-de42858418c3 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:51.648621 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e6864a19-26cf-4d86-b772-de42858418c3 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:51.649256 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e6864a19-26cf-4d86-b772-de42858418c3 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:51.651314 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e6864a19-26cf-4d86-b772-de42858418c3 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:51.843532 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-e6864a19-26cf-4d86-b772-de42858418c3 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e807c724cc4c3887a2d360f0584ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40071e45805146529fb8abd40629c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:51.854431 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-e6864a19-26cf-4d86-b772-de42858418c3 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] 10.222.0.43 "GET /compute/v2.1/servers/e57b3eb4-9ac6-4f6b-bbe1-a8582bdf543b" status: 200 len: 1212 microversion: 2.1 time: 0.227265 Oct 04 21:58:51.875348 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1681/3319] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:58:51 2022] GET /compute/v2.1/servers/e57b3eb4-9ac6-4f6b-bbe1-a8582bdf543b => generated 1212 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:58:51.903778 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-21c8447c-de6c-45da-b00f-501644b32a15 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:51.908023 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-21c8447c-de6c-45da-b00f-501644b32a15 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] [instance: d0b1b757-4a4d-4a7a-9a06-08f178a02984] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:51.925796 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-071b1d3d-f018-4f74-b0f7-561f0c1cb477 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2facee4c6a40416e908083e126d2cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07a17a482a4e92b6ddbdee463c8029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:51.934508 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-071b1d3d-f018-4f74-b0f7-561f0c1cb477 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d" status: 200 len: 1504 microversion: 2.1 time: 0.515913 Oct 04 21:58:51.942953 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-21c8447c-de6c-45da-b00f-501644b32a15 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:51.947069 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1639/3320] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:58:51 2022] GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d => generated 1504 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:58:51.950316 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-21c8447c-de6c-45da-b00f-501644b32a15 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:51.959599 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-21c8447c-de6c-45da-b00f-501644b32a15 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:51.960686 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-21c8447c-de6c-45da-b00f-501644b32a15 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:51.965379 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-c984f179-d9e4-4966-971c-25ef57535a44 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:51.966194 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-c984f179-d9e4-4966-971c-25ef57535a44 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: a4cf4fac-1e9b-4669-a6ff-30008ed3642d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:51.975199 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-21c8447c-de6c-45da-b00f-501644b32a15 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:51.975910 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-21c8447c-de6c-45da-b00f-501644b32a15 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:51.994579 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c984f179-d9e4-4966-971c-25ef57535a44 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:51.999676 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c984f179-d9e4-4966-971c-25ef57535a44 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:52.001182 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c984f179-d9e4-4966-971c-25ef57535a44 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:52.004018 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c984f179-d9e4-4966-971c-25ef57535a44 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:52.004746 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c984f179-d9e4-4966-971c-25ef57535a44 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:52.005436 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c984f179-d9e4-4966-971c-25ef57535a44 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:52.337515 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-21c8447c-de6c-45da-b00f-501644b32a15 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:52.353050 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-21c8447c-de6c-45da-b00f-501644b32a15 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:52.372997 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-21c8447c-de6c-45da-b00f-501644b32a15 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:52.397989 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-21c8447c-de6c-45da-b00f-501644b32a15 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] 10.222.0.43 "GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984" status: 200 len: 1553 microversion: 2.91 time: 0.519542 Oct 04 21:58:52.398696 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1682/3321] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:58:51 2022] GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984 => generated 1553 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:58:52.414762 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-c984f179-d9e4-4966-971c-25ef57535a44 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2facee4c6a40416e908083e126d2cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07a17a482a4e92b6ddbdee463c8029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:52.426579 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-86c3dded-54ca-40f7-ba9b-3d9cf805d60a tempest-ServersAaction247Test-1008276901 tempest-ServersAaction247Test-1008276901-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:52.427897 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-c984f179-d9e4-4966-971c-25ef57535a44 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d" status: 200 len: 1504 microversion: 2.1 time: 0.463230 Oct 04 21:58:52.428240 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-86c3dded-54ca-40f7-ba9b-3d9cf805d60a tempest-ServersAaction247Test-1008276901 tempest-ServersAaction247Test-1008276901-project] [instance: d9c4a8c7-1ce2-401b-9e16-f93f6743cddd] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:52.433461 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1640/3322] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:58:51 2022] GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d => generated 1504 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:58:52.435291 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-86c3dded-54ca-40f7-ba9b-3d9cf805d60a tempest-ServersAaction247Test-1008276901 tempest-ServersAaction247Test-1008276901-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:52.446606 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-86c3dded-54ca-40f7-ba9b-3d9cf805d60a tempest-ServersAaction247Test-1008276901 tempest-ServersAaction247Test-1008276901-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:52.449546 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-86c3dded-54ca-40f7-ba9b-3d9cf805d60a tempest-ServersAaction247Test-1008276901 tempest-ServersAaction247Test-1008276901-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:52.453459 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-86c3dded-54ca-40f7-ba9b-3d9cf805d60a tempest-ServersAaction247Test-1008276901 tempest-ServersAaction247Test-1008276901-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:52.454346 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-86c3dded-54ca-40f7-ba9b-3d9cf805d60a tempest-ServersAaction247Test-1008276901 tempest-ServersAaction247Test-1008276901-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:52.455073 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-86c3dded-54ca-40f7-ba9b-3d9cf805d60a tempest-ServersAaction247Test-1008276901 tempest-ServersAaction247Test-1008276901-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:52.455247 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-2c3ce35a-94d2-478f-b502-e2e569873fe0 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:58:52.457875 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-2c3ce35a-94d2-478f-b502-e2e569873fe0 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: 70978196-2165-4541-8a9f-ebb33a210fe9] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:52.472287 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-2c3ce35a-94d2-478f-b502-e2e569873fe0 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] HTTP exception thrown: Instance 70978196-2165-4541-8a9f-ebb33a210fe9 could not be found. Oct 04 21:58:52.487880 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-2c3ce35a-94d2-478f-b502-e2e569873fe0 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Request method failure captured: Oct 04 21:58:52.487880 n-d-860284-1 devstack@n-api.service[134101]: request: POST /compute/v2.1/servers/70978196-2165-4541-8a9f-ebb33a210fe9/action HTTP/1.1 Oct 04 21:58:52.487880 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 21:58:52.487880 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 21:58:52.487880 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 21:58:52.487880 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 39 Oct 04 21:58:52.487880 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 21:58:52.487880 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 21:58:52.487880 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 21:58:52.487880 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 21:58:52.487880 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPKwu4cpW6hhBuWb-qV_7iYlwjOTpf5XWCl53BJjoosjlcj4wkmmOFzemCJVdBntIx8zJ1SF_z6VrRY8UJr7E8TQDJCRnVQMdNnh0-lZwGdqUzjOWSO31Ryb6n87Cka0g238a21JWok3h3GEhLB-7oCbN3bbcOGmkhd6UFueRxRluk24 Oct 04 21:58:52.487880 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 21:58:52.487880 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 21:58:52.487880 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 21:58:52.487880 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 21:58:52.487880 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 21:58:52.487880 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 21:58:52.487880 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: cf07a17a482a4e92b6ddbdee463c8029 Oct 04 21:58:52.487880 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-ServersNegativeTestJSON-1933663319 Oct 04 21:58:52.487880 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 21:58:52.487880 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 21:58:52.487880 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/cf07a17a482a4e92b6ddbdee463c8029"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_cf07a17a482a4e92b6ddbdee463c8029", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/cf07a17a482a4e92b6ddbdee463c8029"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/cf07a17a482a4e92b6ddbdee463c8029"}]}] Oct 04 21:58:52.487880 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-ServersNegativeTestJSON-1933663319 Oct 04 21:58:52.487880 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: cf07a17a482a4e92b6ddbdee463c8029 Oct 04 21:58:52.487880 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1933663319 Oct 04 21:58:52.487880 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-ServersNegativeTestJSON-1933663319-project Oct 04 21:58:52.487880 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 21:58:52.487880 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 21:58:52.487880 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 2facee4c6a40416e908083e126d2cfa3 Oct 04 21:58:52.487880 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-ServersNegativeTestJSON-1933663319-project Oct 04 21:58:52.487880 n-d-860284-1 devstack@n-api.service[134101]: Oct 04 21:58:52.487880 n-d-860284-1 devstack@n-api.service[134101]: {"os-getConsoleOutput": {"length": 10}} Oct 04 21:58:52.487880 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 21:58:52.487880 n-d-860284-1 devstack@n-api.service[134101]: exception: Instance 70978196-2165-4541-8a9f-ebb33a210fe9 could not be found. Oct 04 21:58:52.487880 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': '70978196-2165-4541-8a9f-ebb33a210fe9', 'body': {'os-getConsoleOutput': {'length': 10}}} Oct 04 21:58:52.487880 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:58:52.487880 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:58:52.487880 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:58:52.487880 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:58:52.487880 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:58:52.487880 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:58:52.487880 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 21:58:52.487880 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 21:58:52.487880 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70978196-2165-4541-8a9f-ebb33a210fe9 could not be found. Oct 04 21:58:52.487880 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:58:52.487880 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:58:52.487880 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:58:52.487880 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:58:52.487880 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:58:52.487880 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:58:52.487880 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:58:52.487880 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:58:52.487880 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:58:52.487880 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:58:52.487880 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:58:52.487880 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:58:52.487880 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/console_output.py", line 41, in get_console_output Oct 04 21:58:52.487880 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 04 21:58:52.487880 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:58:52.487880 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:58:52.487880 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70978196-2165-4541-8a9f-ebb33a210fe9 could not be found. Oct 04 21:58:52.487880 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:58:52.487880 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:58:52.487880 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:58:52.487880 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:58:52.493236 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:58:52.493236 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:58:52.493236 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:58:52.493236 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:58:52.493236 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70978196-2165-4541-8a9f-ebb33a210fe9 could not be found. Oct 04 21:58:52.493236 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:58:52.498917 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-2c3ce35a-94d2-478f-b502-e2e569873fe0 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Returning 404 to user: Instance 70978196-2165-4541-8a9f-ebb33a210fe9 could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:58:52.501359 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-2c3ce35a-94d2-478f-b502-e2e569873fe0 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "POST /compute/v2.1/servers/70978196-2165-4541-8a9f-ebb33a210fe9/action" status: 404 len: 111 microversion: 2.1 time: 0.050963 Oct 04 21:58:52.502741 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1641/3323] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 21:58:52 2022] POST /compute/v2.1/servers/70978196-2165-4541-8a9f-ebb33a210fe9/action => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 21:58:52.524647 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-0c6521a5-57ac-47ec-b4ca-83eda3524b52 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:52.527104 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-0c6521a5-57ac-47ec-b4ca-83eda3524b52 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: a4cf4fac-1e9b-4669-a6ff-30008ed3642d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:52.556523 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0c6521a5-57ac-47ec-b4ca-83eda3524b52 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:52.557534 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0c6521a5-57ac-47ec-b4ca-83eda3524b52 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:52.558144 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0c6521a5-57ac-47ec-b4ca-83eda3524b52 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:52.560531 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0c6521a5-57ac-47ec-b4ca-83eda3524b52 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:52.561382 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0c6521a5-57ac-47ec-b4ca-83eda3524b52 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:52.562311 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0c6521a5-57ac-47ec-b4ca-83eda3524b52 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:52.595061 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-86c3dded-54ca-40f7-ba9b-3d9cf805d60a tempest-ServersAaction247Test-1008276901 tempest-ServersAaction247Test-1008276901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8e807b622044e0e919097335487944d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d298ab75ea49598ddc5f969fa45adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:52.610561 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-86c3dded-54ca-40f7-ba9b-3d9cf805d60a tempest-ServersAaction247Test-1008276901 tempest-ServersAaction247Test-1008276901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8e807b622044e0e919097335487944d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d298ab75ea49598ddc5f969fa45adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:52.615322 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-86c3dded-54ca-40f7-ba9b-3d9cf805d60a tempest-ServersAaction247Test-1008276901 tempest-ServersAaction247Test-1008276901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8e807b622044e0e919097335487944d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d298ab75ea49598ddc5f969fa45adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:52.618305 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-86c3dded-54ca-40f7-ba9b-3d9cf805d60a tempest-ServersAaction247Test-1008276901 tempest-ServersAaction247Test-1008276901-project] 10.222.0.43 "GET /compute/v2.1/servers/d9c4a8c7-1ce2-401b-9e16-f93f6743cddd" status: 200 len: 1339 microversion: 2.47 time: 0.200976 Oct 04 21:58:52.631951 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1683/3324] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:58:52 2022] GET /compute/v2.1/servers/d9c4a8c7-1ce2-401b-9e16-f93f6743cddd => generated 1339 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:58:52.881340 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-9e9a87c8-7dad-400a-9723-ad53d27851e1 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:52.882527 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-9e9a87c8-7dad-400a-9723-ad53d27851e1 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] [instance: e57b3eb4-9ac6-4f6b-bbe1-a8582bdf543b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:52.892801 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9e9a87c8-7dad-400a-9723-ad53d27851e1 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:52.899668 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9e9a87c8-7dad-400a-9723-ad53d27851e1 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:52.900384 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9e9a87c8-7dad-400a-9723-ad53d27851e1 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:52.904417 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9e9a87c8-7dad-400a-9723-ad53d27851e1 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:52.906973 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9e9a87c8-7dad-400a-9723-ad53d27851e1 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:52.908951 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9e9a87c8-7dad-400a-9723-ad53d27851e1 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:52.924318 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-0c6521a5-57ac-47ec-b4ca-83eda3524b52 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2facee4c6a40416e908083e126d2cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07a17a482a4e92b6ddbdee463c8029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:52.937384 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-0c6521a5-57ac-47ec-b4ca-83eda3524b52 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d" status: 200 len: 1504 microversion: 2.1 time: 0.430103 Oct 04 21:58:52.938573 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1642/3325] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:58:52 2022] GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d => generated 1504 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:58:52.964076 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-f4bd42fe-e511-46b9-ab78-b9990c71d982 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:52.965032 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-f4bd42fe-e511-46b9-ab78-b9990c71d982 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: a4cf4fac-1e9b-4669-a6ff-30008ed3642d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:52.980257 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f4bd42fe-e511-46b9-ab78-b9990c71d982 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:52.981033 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f4bd42fe-e511-46b9-ab78-b9990c71d982 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:52.981668 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f4bd42fe-e511-46b9-ab78-b9990c71d982 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:52.982606 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f4bd42fe-e511-46b9-ab78-b9990c71d982 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:52.983229 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f4bd42fe-e511-46b9-ab78-b9990c71d982 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:52.984746 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f4bd42fe-e511-46b9-ab78-b9990c71d982 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:53.248140 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-9e9a87c8-7dad-400a-9723-ad53d27851e1 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e807c724cc4c3887a2d360f0584ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40071e45805146529fb8abd40629c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:53.257158 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-9e9a87c8-7dad-400a-9723-ad53d27851e1 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] 10.222.0.43 "GET /compute/v2.1/servers/e57b3eb4-9ac6-4f6b-bbe1-a8582bdf543b" status: 200 len: 1278 microversion: 2.1 time: 0.379621 Oct 04 21:58:53.267755 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1684/3326] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:58:52 2022] GET /compute/v2.1/servers/e57b3eb4-9ac6-4f6b-bbe1-a8582bdf543b => generated 1278 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:58:53.472395 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-27c2350a-0a78-4d8e-aaf3-069e61a624bc tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:53.480190 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-27c2350a-0a78-4d8e-aaf3-069e61a624bc tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] [instance: d0b1b757-4a4d-4a7a-9a06-08f178a02984] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:53.497542 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-27c2350a-0a78-4d8e-aaf3-069e61a624bc tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:53.522461 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-27c2350a-0a78-4d8e-aaf3-069e61a624bc tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:53.526026 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-27c2350a-0a78-4d8e-aaf3-069e61a624bc tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:53.535422 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-27c2350a-0a78-4d8e-aaf3-069e61a624bc tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:53.536691 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-27c2350a-0a78-4d8e-aaf3-069e61a624bc tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:53.537163 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-27c2350a-0a78-4d8e-aaf3-069e61a624bc tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:53.566337 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=100 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:58:53.685780 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-f4bd42fe-e511-46b9-ab78-b9990c71d982 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2facee4c6a40416e908083e126d2cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07a17a482a4e92b6ddbdee463c8029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:53.695856 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-f4bd42fe-e511-46b9-ab78-b9990c71d982 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d" status: 200 len: 1504 microversion: 2.1 time: 0.736483 Oct 04 21:58:53.696464 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1643/3327] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:58:52 2022] GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d => generated 1504 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:58:53.714663 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-dfdd2ecb-9c77-4eec-b2a9-011b1065e8e2 tempest-ServersAaction247Test-1008276901 tempest-ServersAaction247Test-1008276901-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:53.719531 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-dfdd2ecb-9c77-4eec-b2a9-011b1065e8e2 tempest-ServersAaction247Test-1008276901 tempest-ServersAaction247Test-1008276901-project] [instance: d9c4a8c7-1ce2-401b-9e16-f93f6743cddd] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:53.732971 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dfdd2ecb-9c77-4eec-b2a9-011b1065e8e2 tempest-ServersAaction247Test-1008276901 tempest-ServersAaction247Test-1008276901-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:53.737840 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dfdd2ecb-9c77-4eec-b2a9-011b1065e8e2 tempest-ServersAaction247Test-1008276901 tempest-ServersAaction247Test-1008276901-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:53.740088 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dfdd2ecb-9c77-4eec-b2a9-011b1065e8e2 tempest-ServersAaction247Test-1008276901 tempest-ServersAaction247Test-1008276901-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:53.740908 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dfdd2ecb-9c77-4eec-b2a9-011b1065e8e2 tempest-ServersAaction247Test-1008276901 tempest-ServersAaction247Test-1008276901-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:53.755920 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dfdd2ecb-9c77-4eec-b2a9-011b1065e8e2 tempest-ServersAaction247Test-1008276901 tempest-ServersAaction247Test-1008276901-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:53.756448 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dfdd2ecb-9c77-4eec-b2a9-011b1065e8e2 tempest-ServersAaction247Test-1008276901 tempest-ServersAaction247Test-1008276901-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:53.806953 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:58:53.834237 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-27c2350a-0a78-4d8e-aaf3-069e61a624bc tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:53.848859 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-27c2350a-0a78-4d8e-aaf3-069e61a624bc tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:53.850901 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-27c2350a-0a78-4d8e-aaf3-069e61a624bc tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:53.869097 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-27c2350a-0a78-4d8e-aaf3-069e61a624bc tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] 10.222.0.43 "GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984" status: 200 len: 1553 microversion: 2.91 time: 0.437011 Oct 04 21:58:53.883758 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1685/3328] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:58:53 2022] GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984 => generated 1553 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:58:53.883758 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-4e605113-86d7-42c2-ad09-dcbc1361e849 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:53.883758 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-4e605113-86d7-42c2-ad09-dcbc1361e849 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: 66a69260-2cc2-499f-a1a9-ee9a8582f7fd] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:53.890580 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-4e605113-86d7-42c2-ad09-dcbc1361e849 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] HTTP exception thrown: Instance 66a69260-2cc2-499f-a1a9-ee9a8582f7fd could not be found. Oct 04 21:58:53.895669 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-4e605113-86d7-42c2-ad09-dcbc1361e849 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Request method failure captured: Oct 04 21:58:53.895669 n-d-860284-1 devstack@n-api.service[134102]: request: GET /compute/v2.1/servers/66a69260-2cc2-499f-a1a9-ee9a8582f7fd HTTP/1.1 Oct 04 21:58:53.895669 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 21:58:53.895669 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 21:58:53.895669 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 21:58:53.895669 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 21:58:53.895669 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 21:58:53.895669 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 21:58:53.895669 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 21:58:53.895669 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 21:58:53.895669 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPKwu4cpW6hhBuWb-qV_7iYlwjOTpf5XWCl53BJjoosjlcj4wkmmOFzemCJVdBntIx8zJ1SF_z6VrRY8UJr7E8TQDJCRnVQMdNnh0-lZwGdqUzjOWSO31Ryb6n87Cka0g238a21JWok3h3GEhLB-7oCbN3bbcOGmkhd6UFueRxRluk24 Oct 04 21:58:53.895669 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 21:58:53.895669 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 21:58:53.895669 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 21:58:53.895669 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 21:58:53.895669 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 21:58:53.895669 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 21:58:53.895669 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: cf07a17a482a4e92b6ddbdee463c8029 Oct 04 21:58:53.895669 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-ServersNegativeTestJSON-1933663319 Oct 04 21:58:53.895669 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 21:58:53.895669 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 21:58:53.895669 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/cf07a17a482a4e92b6ddbdee463c8029"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_cf07a17a482a4e92b6ddbdee463c8029", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/cf07a17a482a4e92b6ddbdee463c8029"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/cf07a17a482a4e92b6ddbdee463c8029"}]}] Oct 04 21:58:53.895669 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-ServersNegativeTestJSON-1933663319 Oct 04 21:58:53.895669 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: cf07a17a482a4e92b6ddbdee463c8029 Oct 04 21:58:53.895669 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1933663319 Oct 04 21:58:53.895669 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-ServersNegativeTestJSON-1933663319-project Oct 04 21:58:53.895669 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 21:58:53.895669 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 21:58:53.895669 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: 2facee4c6a40416e908083e126d2cfa3 Oct 04 21:58:53.895669 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-ServersNegativeTestJSON-1933663319-project Oct 04 21:58:53.895669 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 21:58:53.895669 n-d-860284-1 devstack@n-api.service[134102]: exception: Instance 66a69260-2cc2-499f-a1a9-ee9a8582f7fd could not be found. Oct 04 21:58:53.895669 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': '66a69260-2cc2-499f-a1a9-ee9a8582f7fd'} Oct 04 21:58:53.895669 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:58:53.895669 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:58:53.895669 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:58:53.895669 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:58:53.895669 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:58:53.895669 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:58:53.895669 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 21:58:53.895669 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 21:58:53.895669 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 66a69260-2cc2-499f-a1a9-ee9a8582f7fd could not be found. Oct 04 21:58:53.895669 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:58:53.895669 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:58:53.895669 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:58:53.895669 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:58:53.895669 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:58:53.895669 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:58:53.895669 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:58:53.895669 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:58:53.895669 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:58:53.895669 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:58:53.895669 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:58:53.895669 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:58:53.895669 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:58:53.895669 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:58:53.895669 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:58:53.895669 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:58:53.895669 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 66a69260-2cc2-499f-a1a9-ee9a8582f7fd could not be found. Oct 04 21:58:53.895669 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:58:53.895669 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:58:53.895669 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:58:53.895669 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:58:53.895669 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:58:53.901251 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:58:53.901251 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:58:53.901251 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:58:53.901251 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 66a69260-2cc2-499f-a1a9-ee9a8582f7fd could not be found. Oct 04 21:58:53.901251 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:58:53.901251 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-4e605113-86d7-42c2-ad09-dcbc1361e849 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Returning 404 to user: Instance 66a69260-2cc2-499f-a1a9-ee9a8582f7fd could not be found. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:58:53.901251 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-4e605113-86d7-42c2-ad09-dcbc1361e849 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/66a69260-2cc2-499f-a1a9-ee9a8582f7fd" status: 404 len: 111 microversion: 2.1 time: 0.018667 Oct 04 21:58:53.901251 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1686/3329] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:58:53 2022] GET /compute/v2.1/servers/66a69260-2cc2-499f-a1a9-ee9a8582f7fd => generated 111 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:58:53.924539 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-31b3f067-5f24-468e-8499-fbe9976cab35 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:53.925173 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-31b3f067-5f24-468e-8499-fbe9976cab35 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: a4cf4fac-1e9b-4669-a6ff-30008ed3642d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:53.945949 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-31b3f067-5f24-468e-8499-fbe9976cab35 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:53.946797 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-31b3f067-5f24-468e-8499-fbe9976cab35 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:53.947416 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-31b3f067-5f24-468e-8499-fbe9976cab35 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:53.948314 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-31b3f067-5f24-468e-8499-fbe9976cab35 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:53.948944 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-31b3f067-5f24-468e-8499-fbe9976cab35 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:53.949536 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-31b3f067-5f24-468e-8499-fbe9976cab35 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:53.957211 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-dfdd2ecb-9c77-4eec-b2a9-011b1065e8e2 tempest-ServersAaction247Test-1008276901 tempest-ServersAaction247Test-1008276901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8e807b622044e0e919097335487944d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d298ab75ea49598ddc5f969fa45adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:53.967837 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-dfdd2ecb-9c77-4eec-b2a9-011b1065e8e2 tempest-ServersAaction247Test-1008276901 tempest-ServersAaction247Test-1008276901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8e807b622044e0e919097335487944d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d298ab75ea49598ddc5f969fa45adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:53.982222 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-dfdd2ecb-9c77-4eec-b2a9-011b1065e8e2 tempest-ServersAaction247Test-1008276901 tempest-ServersAaction247Test-1008276901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8e807b622044e0e919097335487944d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d298ab75ea49598ddc5f969fa45adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:53.987888 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-dfdd2ecb-9c77-4eec-b2a9-011b1065e8e2 tempest-ServersAaction247Test-1008276901 tempest-ServersAaction247Test-1008276901-project] 10.222.0.43 "GET /compute/v2.1/servers/d9c4a8c7-1ce2-401b-9e16-f93f6743cddd" status: 200 len: 1339 microversion: 2.47 time: 0.281979 Oct 04 21:58:53.994897 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1644/3330] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:58:53 2022] GET /compute/v2.1/servers/d9c4a8c7-1ce2-401b-9e16-f93f6743cddd => generated 1339 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:58:54.174707 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-31b3f067-5f24-468e-8499-fbe9976cab35 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2facee4c6a40416e908083e126d2cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07a17a482a4e92b6ddbdee463c8029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:54.193220 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-31b3f067-5f24-468e-8499-fbe9976cab35 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d" status: 200 len: 1504 microversion: 2.1 time: 0.278813 Oct 04 21:58:54.195348 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1687/3331] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:58:53 2022] GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d => generated 1504 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:58:54.227614 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e4f2b02f-70fd-405f-b20d-700380519800 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:54.228248 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-e4f2b02f-70fd-405f-b20d-700380519800 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: a4cf4fac-1e9b-4669-a6ff-30008ed3642d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:54.246199 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e4f2b02f-70fd-405f-b20d-700380519800 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:54.250116 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e4f2b02f-70fd-405f-b20d-700380519800 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:54.252002 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e4f2b02f-70fd-405f-b20d-700380519800 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:54.252790 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e4f2b02f-70fd-405f-b20d-700380519800 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:54.253269 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e4f2b02f-70fd-405f-b20d-700380519800 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:54.253906 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e4f2b02f-70fd-405f-b20d-700380519800 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:54.298545 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-62536de7-d64d-4ee9-890f-85eb11ea9e9f tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:54.299389 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-62536de7-d64d-4ee9-890f-85eb11ea9e9f tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] [instance: e57b3eb4-9ac6-4f6b-bbe1-a8582bdf543b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:54.321150 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-62536de7-d64d-4ee9-890f-85eb11ea9e9f tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:54.321558 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-62536de7-d64d-4ee9-890f-85eb11ea9e9f tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:54.322419 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-62536de7-d64d-4ee9-890f-85eb11ea9e9f tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:54.322730 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-62536de7-d64d-4ee9-890f-85eb11ea9e9f tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:54.323187 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-62536de7-d64d-4ee9-890f-85eb11ea9e9f tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:54.325809 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-62536de7-d64d-4ee9-890f-85eb11ea9e9f tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:54.440396 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-62536de7-d64d-4ee9-890f-85eb11ea9e9f tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e807c724cc4c3887a2d360f0584ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40071e45805146529fb8abd40629c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:54.454863 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-62536de7-d64d-4ee9-890f-85eb11ea9e9f tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] 10.222.0.43 "GET /compute/v2.1/servers/e57b3eb4-9ac6-4f6b-bbe1-a8582bdf543b" status: 200 len: 1266 microversion: 2.1 time: 0.162702 Oct 04 21:58:54.470959 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1688/3332] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:58:54 2022] GET /compute/v2.1/servers/e57b3eb4-9ac6-4f6b-bbe1-a8582bdf543b => generated 1266 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:58:54.565126 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-e4f2b02f-70fd-405f-b20d-700380519800 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2facee4c6a40416e908083e126d2cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07a17a482a4e92b6ddbdee463c8029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:54.574676 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-e4f2b02f-70fd-405f-b20d-700380519800 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d" status: 200 len: 1504 microversion: 2.1 time: 0.351201 Oct 04 21:58:54.579236 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1645/3333] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:58:54 2022] GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d => generated 1504 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:58:54.849151 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-a89ca9d6-918d-4003-b1a3-a23542116fd4 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2122605393", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "300a434f-3ad3-472e-98dd-a1b7130cf104"}]}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:58:54.869823 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-a89ca9d6-918d-4003-b1a3-a23542116fd4 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Request method failure captured: Oct 04 21:58:54.869823 n-d-860284-1 devstack@n-api.service[134102]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 21:58:54.869823 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 21:58:54.869823 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 21:58:54.869823 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 21:58:54.869823 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 238 Oct 04 21:58:54.869823 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 21:58:54.869823 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 21:58:54.869823 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 21:58:54.869823 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 21:58:54.869823 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPKwu4cpW6hhBuWb-qV_7iYlwjOTpf5XWCl53BJjoosjlcj4wkmmOFzemCJVdBntIx8zJ1SF_z6VrRY8UJr7E8TQDJCRnVQMdNnh0-lZwGdqUzjOWSO31Ryb6n87Cka0g238a21JWok3h3GEhLB-7oCbN3bbcOGmkhd6UFueRxRluk24 Oct 04 21:58:54.869823 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 21:58:54.869823 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 21:58:54.869823 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 21:58:54.869823 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 21:58:54.869823 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 21:58:54.869823 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 21:58:54.869823 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: cf07a17a482a4e92b6ddbdee463c8029 Oct 04 21:58:54.869823 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-ServersNegativeTestJSON-1933663319 Oct 04 21:58:54.869823 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 21:58:54.869823 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 21:58:54.869823 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/cf07a17a482a4e92b6ddbdee463c8029"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_cf07a17a482a4e92b6ddbdee463c8029", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/cf07a17a482a4e92b6ddbdee463c8029"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/cf07a17a482a4e92b6ddbdee463c8029"}]}] Oct 04 21:58:54.869823 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-ServersNegativeTestJSON-1933663319 Oct 04 21:58:54.869823 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: cf07a17a482a4e92b6ddbdee463c8029 Oct 04 21:58:54.869823 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1933663319 Oct 04 21:58:54.869823 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-ServersNegativeTestJSON-1933663319-project Oct 04 21:58:54.869823 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 21:58:54.869823 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 21:58:54.869823 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: 2facee4c6a40416e908083e126d2cfa3 Oct 04 21:58:54.869823 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-ServersNegativeTestJSON-1933663319-project Oct 04 21:58:54.869823 n-d-860284-1 devstack@n-api.service[134102]: Oct 04 21:58:54.869823 n-d-860284-1 devstack@n-api.service[134102]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2122605393", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "300a434f-3ad3-472e-98dd-a1b7130cf104"}]}} Oct 04 21:58:54.869823 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 21:58:54.869823 n-d-860284-1 devstack@n-api.service[134102]: exception: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 04 21:58:54.869823 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-2122605393', 'imageRef': '58548514-5dac-426c-81f5-19e3fba33e23', 'flavorRef': '452', 'accessIPv4': '1.1.1.1.1.1', 'networks': [{'uuid': '300a434f-3ad3-472e-98dd-a1b7130cf104'}]}}} Oct 04 21:58:54.869823 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:58:54.869823 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:58:54.869823 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 04 21:58:54.869823 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 04 21:58:54.869823 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 253, in is_ipv4 Oct 04 21:58:54.869823 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return bool(ipaddress.IPv4Address(instance)) Oct 04 21:58:54.869823 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1257, in __init__ Oct 04 21:58:54.869823 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Oct 04 21:58:54.869823 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1144, in _ip_int_from_string Oct 04 21:58:54.869823 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise AddressValueError("Expected 4 octets in %r" % ip_str) Oct 04 21:58:54.869823 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: Expected 4 octets in '1.1.1.1.1.1' Oct 04 21:58:54.869823 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:58:54.869823 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 04 21:58:54.869823 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:58:54.869823 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:58:54.869823 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 21:58:54.869823 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 21:58:54.869823 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 21:58:54.869823 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise error Oct 04 21:58:54.869823 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '1.1.1.1.1.1' is not a 'ipv4' Oct 04 21:58:54.869823 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:58:54.869823 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv4']: Oct 04 21:58:54.869823 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi {'format': 'ipv4', 'type': 'string'} Oct 04 21:58:54.869823 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:58:54.869823 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 21:58:54.869823 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi '1.1.1.1.1.1' Oct 04 21:58:54.869823 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:58:54.869823 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:58:54.869823 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:58:54.869823 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:58:54.879016 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:58:54.879016 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:58:54.879016 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:58:54.879016 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:58:54.879016 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:58:54.879016 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:58:54.879016 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:58:54.879016 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:58:54.879016 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 21:58:54.879016 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 21:58:54.879016 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 21:58:54.879016 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 21:58:54.879016 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 21:58:54.879016 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 21:58:54.879016 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 04 21:58:54.879016 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:58:54.879016 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:58:54.879016 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:58:54.879016 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:58:54.879016 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:58:54.879016 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:58:54.879016 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 21:58:54.879016 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 21:58:54.879016 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 04 21:58:54.879016 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:58:54.885841 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-a89ca9d6-918d-4003-b1a3-a23542116fd4 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:58:54.887327 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-a89ca9d6-918d-4003-b1a3-a23542116fd4 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.043580 Oct 04 21:58:54.888532 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1689/3334] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 21:58:54 2022] POST /compute/v2.1/servers => generated 139 bytes in 46 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 21:58:54.898346 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-65f2a60c-fd5e-4911-84d5-2508080a35c9 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:54.901327 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-65f2a60c-fd5e-4911-84d5-2508080a35c9 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: a4cf4fac-1e9b-4669-a6ff-30008ed3642d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:54.906852 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-8e6a1bca-e0ec-4fe8-b46d-bcc5edbe7c09 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:54.907430 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-8e6a1bca-e0ec-4fe8-b46d-bcc5edbe7c09 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] [instance: d0b1b757-4a4d-4a7a-9a06-08f178a02984] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:54.915112 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-65f2a60c-fd5e-4911-84d5-2508080a35c9 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:54.916786 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-65f2a60c-fd5e-4911-84d5-2508080a35c9 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:54.931753 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-65f2a60c-fd5e-4911-84d5-2508080a35c9 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:54.937227 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-65f2a60c-fd5e-4911-84d5-2508080a35c9 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:54.937702 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8e6a1bca-e0ec-4fe8-b46d-bcc5edbe7c09 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:54.938199 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8e6a1bca-e0ec-4fe8-b46d-bcc5edbe7c09 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:54.938673 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8e6a1bca-e0ec-4fe8-b46d-bcc5edbe7c09 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:54.939390 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8e6a1bca-e0ec-4fe8-b46d-bcc5edbe7c09 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:54.939848 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8e6a1bca-e0ec-4fe8-b46d-bcc5edbe7c09 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:54.940200 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-65f2a60c-fd5e-4911-84d5-2508080a35c9 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:54.940337 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8e6a1bca-e0ec-4fe8-b46d-bcc5edbe7c09 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:54.941528 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-65f2a60c-fd5e-4911-84d5-2508080a35c9 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:55.259015 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-8e6a1bca-e0ec-4fe8-b46d-bcc5edbe7c09 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:55.293668 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-8e6a1bca-e0ec-4fe8-b46d-bcc5edbe7c09 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:55.295209 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-8e6a1bca-e0ec-4fe8-b46d-bcc5edbe7c09 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:55.333635 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-8e6a1bca-e0ec-4fe8-b46d-bcc5edbe7c09 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] 10.222.0.43 "GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984" status: 200 len: 1553 microversion: 2.91 time: 0.431942 Oct 04 21:58:55.337384 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1690/3335] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:58:54 2022] GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984 => generated 1553 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:58:55.347393 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-f40e40b0-045a-4660-a1e1-5eb88b5174d8 tempest-ServersAaction247Test-1008276901 tempest-ServersAaction247Test-1008276901-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:55.351109 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-f40e40b0-045a-4660-a1e1-5eb88b5174d8 tempest-ServersAaction247Test-1008276901 tempest-ServersAaction247Test-1008276901-project] [instance: d9c4a8c7-1ce2-401b-9e16-f93f6743cddd] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:55.373563 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f40e40b0-045a-4660-a1e1-5eb88b5174d8 tempest-ServersAaction247Test-1008276901 tempest-ServersAaction247Test-1008276901-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:55.375732 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f40e40b0-045a-4660-a1e1-5eb88b5174d8 tempest-ServersAaction247Test-1008276901 tempest-ServersAaction247Test-1008276901-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:55.377682 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f40e40b0-045a-4660-a1e1-5eb88b5174d8 tempest-ServersAaction247Test-1008276901 tempest-ServersAaction247Test-1008276901-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:55.382754 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f40e40b0-045a-4660-a1e1-5eb88b5174d8 tempest-ServersAaction247Test-1008276901 tempest-ServersAaction247Test-1008276901-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:55.383501 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f40e40b0-045a-4660-a1e1-5eb88b5174d8 tempest-ServersAaction247Test-1008276901 tempest-ServersAaction247Test-1008276901-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:55.383943 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f40e40b0-045a-4660-a1e1-5eb88b5174d8 tempest-ServersAaction247Test-1008276901 tempest-ServersAaction247Test-1008276901-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:55.555589 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-f40e40b0-045a-4660-a1e1-5eb88b5174d8 tempest-ServersAaction247Test-1008276901 tempest-ServersAaction247Test-1008276901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8e807b622044e0e919097335487944d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d298ab75ea49598ddc5f969fa45adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:55.574693 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-f40e40b0-045a-4660-a1e1-5eb88b5174d8 tempest-ServersAaction247Test-1008276901 tempest-ServersAaction247Test-1008276901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8e807b622044e0e919097335487944d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d298ab75ea49598ddc5f969fa45adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:55.575111 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-65f2a60c-fd5e-4911-84d5-2508080a35c9 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2facee4c6a40416e908083e126d2cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07a17a482a4e92b6ddbdee463c8029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:55.590125 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-65f2a60c-fd5e-4911-84d5-2508080a35c9 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d" status: 200 len: 1504 microversion: 2.1 time: 0.696936 Oct 04 21:58:55.590779 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-f40e40b0-045a-4660-a1e1-5eb88b5174d8 tempest-ServersAaction247Test-1008276901 tempest-ServersAaction247Test-1008276901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8e807b622044e0e919097335487944d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d298ab75ea49598ddc5f969fa45adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:55.592325 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1646/3336] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:58:54 2022] GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d => generated 1504 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:58:55.596983 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-f40e40b0-045a-4660-a1e1-5eb88b5174d8 tempest-ServersAaction247Test-1008276901 tempest-ServersAaction247Test-1008276901-project] 10.222.0.43 "GET /compute/v2.1/servers/d9c4a8c7-1ce2-401b-9e16-f93f6743cddd" status: 200 len: 1360 microversion: 2.47 time: 0.258073 Oct 04 21:58:55.625764 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-dd316779-64a0-422b-9648-1678f05a8c4b tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:55.627528 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-dd316779-64a0-422b-9648-1678f05a8c4b tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] [instance: e57b3eb4-9ac6-4f6b-bbe1-a8582bdf543b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:55.632377 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1691/3337] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:58:55 2022] GET /compute/v2.1/servers/d9c4a8c7-1ce2-401b-9e16-f93f6743cddd => generated 1360 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:58:55.638496 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-797714b6-78e2-4c4c-9c09-cf0f4de4006c tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:55.639234 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-797714b6-78e2-4c4c-9c09-cf0f4de4006c tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: a4cf4fac-1e9b-4669-a6ff-30008ed3642d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:55.649033 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dd316779-64a0-422b-9648-1678f05a8c4b tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:55.649946 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dd316779-64a0-422b-9648-1678f05a8c4b tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:55.651539 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dd316779-64a0-422b-9648-1678f05a8c4b tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:55.652638 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dd316779-64a0-422b-9648-1678f05a8c4b tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:55.660667 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-797714b6-78e2-4c4c-9c09-cf0f4de4006c tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:55.661524 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-797714b6-78e2-4c4c-9c09-cf0f4de4006c tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:55.662177 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-797714b6-78e2-4c4c-9c09-cf0f4de4006c tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:55.663160 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-797714b6-78e2-4c4c-9c09-cf0f4de4006c tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:55.665076 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-797714b6-78e2-4c4c-9c09-cf0f4de4006c tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:55.670531 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-797714b6-78e2-4c4c-9c09-cf0f4de4006c tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:55.672909 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dd316779-64a0-422b-9648-1678f05a8c4b tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:55.674878 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dd316779-64a0-422b-9648-1678f05a8c4b tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:56.373025 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell0:SELECT=2 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:58:56.456849 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-dd316779-64a0-422b-9648-1678f05a8c4b tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e807c724cc4c3887a2d360f0584ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40071e45805146529fb8abd40629c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:56.481827 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-dd316779-64a0-422b-9648-1678f05a8c4b tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] 10.222.0.43 "GET /compute/v2.1/servers/e57b3eb4-9ac6-4f6b-bbe1-a8582bdf543b" status: 200 len: 1308 microversion: 2.1 time: 0.887211 Oct 04 21:58:56.487145 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1647/3338] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:58:55 2022] GET /compute/v2.1/servers/e57b3eb4-9ac6-4f6b-bbe1-a8582bdf543b => generated 1308 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:58:56.504312 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-0d5ba772-c630-4a90-87cc-8f6ff202e446 tempest-ServersAaction247Test-1008276901 tempest-ServersAaction247Test-1008276901-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-1946220555"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:58:56.507986 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-0d5ba772-c630-4a90-87cc-8f6ff202e446 tempest-ServersAaction247Test-1008276901 tempest-ServersAaction247Test-1008276901-project] [instance: d9c4a8c7-1ce2-401b-9e16-f93f6743cddd] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:56.525516 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-797714b6-78e2-4c4c-9c09-cf0f4de4006c tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2facee4c6a40416e908083e126d2cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07a17a482a4e92b6ddbdee463c8029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:56.547432 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-797714b6-78e2-4c4c-9c09-cf0f4de4006c tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d" status: 200 len: 1504 microversion: 2.1 time: 0.904438 Oct 04 21:58:56.550212 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0d5ba772-c630-4a90-87cc-8f6ff202e446 tempest-ServersAaction247Test-1008276901 tempest-ServersAaction247Test-1008276901-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:56.551770 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0d5ba772-c630-4a90-87cc-8f6ff202e446 tempest-ServersAaction247Test-1008276901 tempest-ServersAaction247Test-1008276901-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:56.558583 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1692/3339] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:58:55 2022] GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d => generated 1504 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:58:56.562021 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0d5ba772-c630-4a90-87cc-8f6ff202e446 tempest-ServersAaction247Test-1008276901 tempest-ServersAaction247Test-1008276901-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:56.563626 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0d5ba772-c630-4a90-87cc-8f6ff202e446 tempest-ServersAaction247Test-1008276901 tempest-ServersAaction247Test-1008276901-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:56.571347 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0d5ba772-c630-4a90-87cc-8f6ff202e446 tempest-ServersAaction247Test-1008276901 tempest-ServersAaction247Test-1008276901-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:56.574630 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0d5ba772-c630-4a90-87cc-8f6ff202e446 tempest-ServersAaction247Test-1008276901 tempest-ServersAaction247Test-1008276901-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:56.581263 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-8a9a3902-3a70-4cdb-9110-8fdb87a7c985 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:56.581888 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-8a9a3902-3a70-4cdb-9110-8fdb87a7c985 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] [instance: d0b1b757-4a4d-4a7a-9a06-08f178a02984] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:56.605588 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8a9a3902-3a70-4cdb-9110-8fdb87a7c985 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:56.606448 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8a9a3902-3a70-4cdb-9110-8fdb87a7c985 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:56.607090 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8a9a3902-3a70-4cdb-9110-8fdb87a7c985 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:56.611468 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8a9a3902-3a70-4cdb-9110-8fdb87a7c985 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:56.612272 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8a9a3902-3a70-4cdb-9110-8fdb87a7c985 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:56.617018 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8a9a3902-3a70-4cdb-9110-8fdb87a7c985 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:56.794981 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-8a9a3902-3a70-4cdb-9110-8fdb87a7c985 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:56.817328 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-8a9a3902-3a70-4cdb-9110-8fdb87a7c985 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:56.821132 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-8a9a3902-3a70-4cdb-9110-8fdb87a7c985 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:56.838629 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-8a9a3902-3a70-4cdb-9110-8fdb87a7c985 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] 10.222.0.43 "GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984" status: 200 len: 1553 microversion: 2.91 time: 0.277797 Oct 04 21:58:56.857376 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1693/3340] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:58:56 2022] GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984 => generated 1553 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:58:56.882104 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-4c43c629-f9b2-4411-be51-b863132e4cc1 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-490599130", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "300a434f-3ad3-472e-98dd-a1b7130cf104"}]}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:58:56.908750 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-4c43c629-f9b2-4411-be51-b863132e4cc1 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Request method failure captured: Oct 04 21:58:56.908750 n-d-860284-1 devstack@n-api.service[134102]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 21:58:56.908750 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 21:58:56.908750 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 21:58:56.908750 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 21:58:56.908750 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 234 Oct 04 21:58:56.908750 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 21:58:56.908750 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 21:58:56.908750 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 21:58:56.908750 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 21:58:56.908750 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPKwu4cpW6hhBuWb-qV_7iYlwjOTpf5XWCl53BJjoosjlcj4wkmmOFzemCJVdBntIx8zJ1SF_z6VrRY8UJr7E8TQDJCRnVQMdNnh0-lZwGdqUzjOWSO31Ryb6n87Cka0g238a21JWok3h3GEhLB-7oCbN3bbcOGmkhd6UFueRxRluk24 Oct 04 21:58:56.908750 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 21:58:56.908750 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 21:58:56.908750 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 21:58:56.908750 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 21:58:56.908750 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 21:58:56.908750 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 21:58:56.908750 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: cf07a17a482a4e92b6ddbdee463c8029 Oct 04 21:58:56.908750 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-ServersNegativeTestJSON-1933663319 Oct 04 21:58:56.908750 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 21:58:56.908750 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 21:58:56.908750 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/cf07a17a482a4e92b6ddbdee463c8029"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_cf07a17a482a4e92b6ddbdee463c8029", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/cf07a17a482a4e92b6ddbdee463c8029"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/cf07a17a482a4e92b6ddbdee463c8029"}]}] Oct 04 21:58:56.908750 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-ServersNegativeTestJSON-1933663319 Oct 04 21:58:56.908750 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: cf07a17a482a4e92b6ddbdee463c8029 Oct 04 21:58:56.908750 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1933663319 Oct 04 21:58:56.908750 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-ServersNegativeTestJSON-1933663319-project Oct 04 21:58:56.908750 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 21:58:56.908750 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 21:58:56.908750 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: 2facee4c6a40416e908083e126d2cfa3 Oct 04 21:58:56.908750 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-ServersNegativeTestJSON-1933663319-project Oct 04 21:58:56.908750 n-d-860284-1 devstack@n-api.service[134102]: Oct 04 21:58:56.908750 n-d-860284-1 devstack@n-api.service[134102]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-490599130", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "300a434f-3ad3-472e-98dd-a1b7130cf104"}]}} Oct 04 21:58:56.908750 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 21:58:56.908750 n-d-860284-1 devstack@n-api.service[134102]: exception: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 04 21:58:56.908750 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-490599130', 'imageRef': '58548514-5dac-426c-81f5-19e3fba33e23', 'flavorRef': '452', 'accessIPv6': 'notvalid', 'networks': [{'uuid': '300a434f-3ad3-472e-98dd-a1b7130cf104'}]}}} Oct 04 21:58:56.908750 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:58:56.908750 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:58:56.908750 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 04 21:58:56.908750 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 04 21:58:56.908750 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 260, in is_ipv6 Oct 04 21:58:56.908750 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi address = ipaddress.IPv6Address(instance) Oct 04 21:58:56.908750 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1844, in __init__ Oct 04 21:58:56.908750 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Oct 04 21:58:56.908750 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1581, in _ip_int_from_string Oct 04 21:58:56.908750 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise AddressValueError(msg) Oct 04 21:58:56.908750 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: At least 3 parts expected in 'notvalid' Oct 04 21:58:56.908750 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:58:56.908750 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 04 21:58:56.908750 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:58:56.908750 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:58:56.908750 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 21:58:56.908750 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 21:58:56.908750 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 21:58:56.908750 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise error Oct 04 21:58:56.908750 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'notvalid' is not a 'ipv6' Oct 04 21:58:56.908750 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:58:56.908750 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv6']: Oct 04 21:58:56.908750 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi {'format': 'ipv6', 'type': 'string'} Oct 04 21:58:56.908750 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:58:56.908750 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 21:58:56.908750 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi 'notvalid' Oct 04 21:58:56.908750 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:58:56.908750 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:58:56.908750 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:58:56.908750 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:58:56.913262 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:58:56.913262 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:58:56.913262 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:58:56.913262 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:58:56.913262 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:58:56.913262 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:58:56.913262 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:58:56.913262 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:58:56.913262 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 21:58:56.913262 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 21:58:56.913262 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 21:58:56.913262 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 21:58:56.913262 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 21:58:56.913262 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 21:58:56.913262 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 04 21:58:56.913262 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:58:56.913262 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:58:56.913262 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:58:56.913262 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:58:56.913262 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:58:56.913262 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:58:56.913262 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 21:58:56.913262 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 21:58:56.913262 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 04 21:58:56.913262 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:58:56.913262 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-4c43c629-f9b2-4411-be51-b863132e4cc1 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:58:56.913262 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-4c43c629-f9b2-4411-be51-b863132e4cc1 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.051680 Oct 04 21:58:56.913262 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1694/3341] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 21:58:56 2022] POST /compute/v2.1/servers => generated 133 bytes in 53 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 21:58:56.932581 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-608b800c-a576-4ce4-a464-3b00855c93e2 req-a623bb8e-4cc6-4851-b779-0826d85d3bd4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e57b3eb4-9ac6-4f6b-bbe1-a8582bdf543b", "tag": "7bf70467-e6c6-44c5-b9e5-a3641cdfe409"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:58:56.968520 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-608b800c-a576-4ce4-a464-3b00855c93e2 req-a623bb8e-4cc6-4851-b779-0826d85d3bd4 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:56.969984 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-608b800c-a576-4ce4-a464-3b00855c93e2 req-a623bb8e-4cc6-4851-b779-0826d85d3bd4 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:56.970983 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-608b800c-a576-4ce4-a464-3b00855c93e2 req-a623bb8e-4cc6-4851-b779-0826d85d3bd4 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:57.004037 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-608b800c-a576-4ce4-a464-3b00855c93e2 req-a623bb8e-4cc6-4851-b779-0826d85d3bd4 service nova] Creating event network-changed:7bf70467-e6c6-44c5-b9e5-a3641cdfe409 for instance e57b3eb4-9ac6-4f6b-bbe1-a8582bdf543b on n-h1-860284-1 Oct 04 21:58:57.028111 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-608b800c-a576-4ce4-a464-3b00855c93e2 req-a623bb8e-4cc6-4851-b779-0826d85d3bd4 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101049 Oct 04 21:58:57.029892 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1695/3342] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:58:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:58:57.052742 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-d3873b27-3195-4a6a-affe-d42226a777aa tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:57.058600 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-d3873b27-3195-4a6a-affe-d42226a777aa tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: a4cf4fac-1e9b-4669-a6ff-30008ed3642d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:57.079678 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d3873b27-3195-4a6a-affe-d42226a777aa tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:57.081601 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d3873b27-3195-4a6a-affe-d42226a777aa tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:57.082869 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d3873b27-3195-4a6a-affe-d42226a777aa tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:57.084594 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d3873b27-3195-4a6a-affe-d42226a777aa tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:57.087883 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d3873b27-3195-4a6a-affe-d42226a777aa tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:57.088648 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d3873b27-3195-4a6a-affe-d42226a777aa tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:57.116573 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-0d5ba772-c630-4a90-87cc-8f6ff202e446 tempest-ServersAaction247Test-1008276901 tempest-ServersAaction247Test-1008276901-project] 10.222.0.43 "POST /compute/v2.1/servers/d9c4a8c7-1ce2-401b-9e16-f93f6743cddd/action" status: 202 len: 52 microversion: 2.47 time: 0.627486 Oct 04 21:58:57.126388 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1648/3343] 10.222.0.43 () {62 vars in 1319 bytes} [Tue Oct 4 21:58:56 2022] POST /compute/v2.1/servers/d9c4a8c7-1ce2-401b-9e16-f93f6743cddd/action => generated 52 bytes in 638 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Oct 04 21:58:57.141254 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-f67676cd-9215-4539-a9e0-a03ccb70594f tempest-ServersAaction247Test-1008276901 tempest-ServersAaction247Test-1008276901-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:57.142780 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-f67676cd-9215-4539-a9e0-a03ccb70594f tempest-ServersAaction247Test-1008276901 tempest-ServersAaction247Test-1008276901-project] [instance: d9c4a8c7-1ce2-401b-9e16-f93f6743cddd] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:57.160524 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f67676cd-9215-4539-a9e0-a03ccb70594f tempest-ServersAaction247Test-1008276901 tempest-ServersAaction247Test-1008276901-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:57.161657 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f67676cd-9215-4539-a9e0-a03ccb70594f tempest-ServersAaction247Test-1008276901 tempest-ServersAaction247Test-1008276901-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:57.162326 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f67676cd-9215-4539-a9e0-a03ccb70594f tempest-ServersAaction247Test-1008276901 tempest-ServersAaction247Test-1008276901-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:57.163317 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f67676cd-9215-4539-a9e0-a03ccb70594f tempest-ServersAaction247Test-1008276901 tempest-ServersAaction247Test-1008276901-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:57.164004 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f67676cd-9215-4539-a9e0-a03ccb70594f tempest-ServersAaction247Test-1008276901 tempest-ServersAaction247Test-1008276901-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:57.164643 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f67676cd-9215-4539-a9e0-a03ccb70594f tempest-ServersAaction247Test-1008276901 tempest-ServersAaction247Test-1008276901-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:57.226520 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-f67676cd-9215-4539-a9e0-a03ccb70594f tempest-ServersAaction247Test-1008276901 tempest-ServersAaction247Test-1008276901-project] [instance: d9c4a8c7-1ce2-401b-9e16-f93f6743cddd] Going to try to terminate instance {{(pid=134101) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:58:57.385759 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-f67676cd-9215-4539-a9e0-a03ccb70594f tempest-ServersAaction247Test-1008276901 tempest-ServersAaction247Test-1008276901-project] 10.222.0.43 "DELETE /compute/v2.1/servers/d9c4a8c7-1ce2-401b-9e16-f93f6743cddd" status: 204 len: 0 microversion: 2.47 time: 0.257623 Oct 04 21:58:57.399190 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1649/3344] 10.222.0.43 () {60 vars in 1280 bytes} [Tue Oct 4 21:58:57 2022] DELETE /compute/v2.1/servers/d9c4a8c7-1ce2-401b-9e16-f93f6743cddd => generated 0 bytes in 272 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 21:58:57.408725 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-2a5b0aa4-8fea-4b3e-b721-8b389e2eebd7 tempest-ServersAaction247Test-1008276901 tempest-ServersAaction247Test-1008276901-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:57.409921 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-2a5b0aa4-8fea-4b3e-b721-8b389e2eebd7 tempest-ServersAaction247Test-1008276901 tempest-ServersAaction247Test-1008276901-project] [instance: d9c4a8c7-1ce2-401b-9e16-f93f6743cddd] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:57.426094 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2a5b0aa4-8fea-4b3e-b721-8b389e2eebd7 tempest-ServersAaction247Test-1008276901 tempest-ServersAaction247Test-1008276901-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:57.427042 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2a5b0aa4-8fea-4b3e-b721-8b389e2eebd7 tempest-ServersAaction247Test-1008276901 tempest-ServersAaction247Test-1008276901-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:57.427736 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2a5b0aa4-8fea-4b3e-b721-8b389e2eebd7 tempest-ServersAaction247Test-1008276901 tempest-ServersAaction247Test-1008276901-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:57.428722 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2a5b0aa4-8fea-4b3e-b721-8b389e2eebd7 tempest-ServersAaction247Test-1008276901 tempest-ServersAaction247Test-1008276901-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:57.429441 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2a5b0aa4-8fea-4b3e-b721-8b389e2eebd7 tempest-ServersAaction247Test-1008276901 tempest-ServersAaction247Test-1008276901-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:57.430129 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2a5b0aa4-8fea-4b3e-b721-8b389e2eebd7 tempest-ServersAaction247Test-1008276901 tempest-ServersAaction247Test-1008276901-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:57.494559 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-d3873b27-3195-4a6a-affe-d42226a777aa tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2facee4c6a40416e908083e126d2cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07a17a482a4e92b6ddbdee463c8029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:57.508053 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-d3873b27-3195-4a6a-affe-d42226a777aa tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d" status: 200 len: 1504 microversion: 2.1 time: 0.472791 Oct 04 21:58:57.526135 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1696/3345] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:58:57 2022] GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d => generated 1504 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:58:57.549611 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-86a501ba-0f02-4b2a-a140-917494e3a5fd tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:57.551575 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-86a501ba-0f02-4b2a-a140-917494e3a5fd tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] [instance: e57b3eb4-9ac6-4f6b-bbe1-a8582bdf543b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:57.569661 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-86a501ba-0f02-4b2a-a140-917494e3a5fd tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:57.571627 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-86a501ba-0f02-4b2a-a140-917494e3a5fd tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:57.574235 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-86a501ba-0f02-4b2a-a140-917494e3a5fd tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:57.577787 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-86a501ba-0f02-4b2a-a140-917494e3a5fd tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:57.588945 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-86a501ba-0f02-4b2a-a140-917494e3a5fd tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:57.591021 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-86a501ba-0f02-4b2a-a140-917494e3a5fd tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:57.633078 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-2a5b0aa4-8fea-4b3e-b721-8b389e2eebd7 tempest-ServersAaction247Test-1008276901 tempest-ServersAaction247Test-1008276901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8e807b622044e0e919097335487944d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d298ab75ea49598ddc5f969fa45adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:57.659299 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-2a5b0aa4-8fea-4b3e-b721-8b389e2eebd7 tempest-ServersAaction247Test-1008276901 tempest-ServersAaction247Test-1008276901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8e807b622044e0e919097335487944d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d298ab75ea49598ddc5f969fa45adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:57.669933 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-2a5b0aa4-8fea-4b3e-b721-8b389e2eebd7 tempest-ServersAaction247Test-1008276901 tempest-ServersAaction247Test-1008276901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8e807b622044e0e919097335487944d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d298ab75ea49598ddc5f969fa45adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:57.672571 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-2a5b0aa4-8fea-4b3e-b721-8b389e2eebd7 tempest-ServersAaction247Test-1008276901 tempest-ServersAaction247Test-1008276901-project] 10.222.0.43 "GET /compute/v2.1/servers/d9c4a8c7-1ce2-401b-9e16-f93f6743cddd" status: 200 len: 1366 microversion: 2.47 time: 0.268773 Oct 04 21:58:57.674822 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1650/3346] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:58:57 2022] GET /compute/v2.1/servers/d9c4a8c7-1ce2-401b-9e16-f93f6743cddd => generated 1366 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:58:57.713505 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-4e2fa8e5-5e08-49ff-9def-2494dce4fadc tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:57.717146 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-4e2fa8e5-5e08-49ff-9def-2494dce4fadc tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: a4cf4fac-1e9b-4669-a6ff-30008ed3642d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:57.736918 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4e2fa8e5-5e08-49ff-9def-2494dce4fadc tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:57.740706 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4e2fa8e5-5e08-49ff-9def-2494dce4fadc tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:57.741412 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4e2fa8e5-5e08-49ff-9def-2494dce4fadc tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:57.742465 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4e2fa8e5-5e08-49ff-9def-2494dce4fadc tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:57.744754 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4e2fa8e5-5e08-49ff-9def-2494dce4fadc tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:57.746452 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4e2fa8e5-5e08-49ff-9def-2494dce4fadc tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:57.956908 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-86a501ba-0f02-4b2a-a140-917494e3a5fd tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e807c724cc4c3887a2d360f0584ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40071e45805146529fb8abd40629c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:57.976397 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-86a501ba-0f02-4b2a-a140-917494e3a5fd tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] 10.222.0.43 "GET /compute/v2.1/servers/e57b3eb4-9ac6-4f6b-bbe1-a8582bdf543b" status: 200 len: 1308 microversion: 2.1 time: 0.433789 Oct 04 21:58:57.981358 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1697/3347] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:58:57 2022] GET /compute/v2.1/servers/e57b3eb4-9ac6-4f6b-bbe1-a8582bdf543b => generated 1308 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:58:58.005972 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-ebd30df3-87eb-4217-871e-b653f9ac4f8a tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:58.009061 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-ebd30df3-87eb-4217-871e-b653f9ac4f8a tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] [instance: d0b1b757-4a4d-4a7a-9a06-08f178a02984] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:58.031438 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:58:58.044185 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ebd30df3-87eb-4217-871e-b653f9ac4f8a tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:58.044756 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ebd30df3-87eb-4217-871e-b653f9ac4f8a tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:58.047714 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ebd30df3-87eb-4217-871e-b653f9ac4f8a tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:58.048668 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ebd30df3-87eb-4217-871e-b653f9ac4f8a tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:58.053219 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ebd30df3-87eb-4217-871e-b653f9ac4f8a tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:58.053836 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ebd30df3-87eb-4217-871e-b653f9ac4f8a tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:58.168447 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-4e2fa8e5-5e08-49ff-9def-2494dce4fadc tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2facee4c6a40416e908083e126d2cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07a17a482a4e92b6ddbdee463c8029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:58.191675 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-4e2fa8e5-5e08-49ff-9def-2494dce4fadc tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d" status: 200 len: 1504 microversion: 2.1 time: 0.514866 Oct 04 21:58:58.202946 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1651/3348] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:58:57 2022] GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d => generated 1504 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:58:58.217307 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-a6b48294-bdd8-4304-9abc-96602f2368b2 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:58:58.218445 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-a6b48294-bdd8-4304-9abc-96602f2368b2 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: 06cd374f-6e54-4e67-baec-517838360a5e] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:58.225880 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-a6b48294-bdd8-4304-9abc-96602f2368b2 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] HTTP exception thrown: Instance 06cd374f-6e54-4e67-baec-517838360a5e could not be found. Oct 04 21:58:58.230759 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-a6b48294-bdd8-4304-9abc-96602f2368b2 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Request method failure captured: Oct 04 21:58:58.230759 n-d-860284-1 devstack@n-api.service[134101]: request: POST /compute/v2.1/servers/06cd374f-6e54-4e67-baec-517838360a5e/action HTTP/1.1 Oct 04 21:58:58.230759 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 21:58:58.230759 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 21:58:58.230759 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 21:58:58.230759 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 13 Oct 04 21:58:58.230759 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 21:58:58.230759 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 21:58:58.230759 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 21:58:58.230759 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 21:58:58.230759 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPKwu4cpW6hhBuWb-qV_7iYlwjOTpf5XWCl53BJjoosjlcj4wkmmOFzemCJVdBntIx8zJ1SF_z6VrRY8UJr7E8TQDJCRnVQMdNnh0-lZwGdqUzjOWSO31Ryb6n87Cka0g238a21JWok3h3GEhLB-7oCbN3bbcOGmkhd6UFueRxRluk24 Oct 04 21:58:58.230759 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 21:58:58.230759 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 21:58:58.230759 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 21:58:58.230759 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 21:58:58.230759 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 21:58:58.230759 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 21:58:58.230759 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: cf07a17a482a4e92b6ddbdee463c8029 Oct 04 21:58:58.230759 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-ServersNegativeTestJSON-1933663319 Oct 04 21:58:58.230759 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 21:58:58.230759 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 21:58:58.230759 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/cf07a17a482a4e92b6ddbdee463c8029"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_cf07a17a482a4e92b6ddbdee463c8029", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/cf07a17a482a4e92b6ddbdee463c8029"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/cf07a17a482a4e92b6ddbdee463c8029"}]}] Oct 04 21:58:58.230759 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-ServersNegativeTestJSON-1933663319 Oct 04 21:58:58.230759 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: cf07a17a482a4e92b6ddbdee463c8029 Oct 04 21:58:58.230759 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1933663319 Oct 04 21:58:58.230759 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-ServersNegativeTestJSON-1933663319-project Oct 04 21:58:58.230759 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 21:58:58.230759 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 21:58:58.230759 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 2facee4c6a40416e908083e126d2cfa3 Oct 04 21:58:58.230759 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-ServersNegativeTestJSON-1933663319-project Oct 04 21:58:58.230759 n-d-860284-1 devstack@n-api.service[134101]: Oct 04 21:58:58.230759 n-d-860284-1 devstack@n-api.service[134101]: {"pause": {}} Oct 04 21:58:58.230759 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 21:58:58.230759 n-d-860284-1 devstack@n-api.service[134101]: exception: Instance 06cd374f-6e54-4e67-baec-517838360a5e could not be found. Oct 04 21:58:58.230759 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': '06cd374f-6e54-4e67-baec-517838360a5e', 'body': {'pause': {}}} Oct 04 21:58:58.230759 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:58:58.230759 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:58:58.230759 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:58:58.230759 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:58:58.230759 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:58:58.230759 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:58:58.230759 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 21:58:58.230759 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 21:58:58.230759 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06cd374f-6e54-4e67-baec-517838360a5e could not be found. Oct 04 21:58:58.230759 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:58:58.230759 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:58:58.230759 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:58:58.230759 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:58:58.230759 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:58:58.230759 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:58:58.230759 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:58:58.230759 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:58:58.230759 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:58:58.230759 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:58:58.230759 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 36, in _pause Oct 04 21:58:58.230759 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Oct 04 21:58:58.230759 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:58:58.230759 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:58:58.230759 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06cd374f-6e54-4e67-baec-517838360a5e could not be found. Oct 04 21:58:58.230759 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:58:58.230759 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:58:58.230759 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:58:58.230759 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:58:58.230759 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:58:58.230759 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:58:58.240865 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:58:58.240865 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:58:58.240865 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06cd374f-6e54-4e67-baec-517838360a5e could not be found. Oct 04 21:58:58.240865 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:58:58.244496 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-a6b48294-bdd8-4304-9abc-96602f2368b2 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Returning 404 to user: Instance 06cd374f-6e54-4e67-baec-517838360a5e could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:58:58.247322 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-a6b48294-bdd8-4304-9abc-96602f2368b2 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "POST /compute/v2.1/servers/06cd374f-6e54-4e67-baec-517838360a5e/action" status: 404 len: 111 microversion: 2.1 time: 0.033290 Oct 04 21:58:58.250693 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1652/3349] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 21:58:58 2022] POST /compute/v2.1/servers/06cd374f-6e54-4e67-baec-517838360a5e/action => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:58:58.268270 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-ebd30df3-87eb-4217-871e-b653f9ac4f8a tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:58.278450 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-cccaa676-57e9-4c12-9662-f7ce5f039d51 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:58.279846 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-ebd30df3-87eb-4217-871e-b653f9ac4f8a tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:58.281482 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-cccaa676-57e9-4c12-9662-f7ce5f039d51 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: a4cf4fac-1e9b-4669-a6ff-30008ed3642d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:58.282311 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-ebd30df3-87eb-4217-871e-b653f9ac4f8a tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:58.289167 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-ebd30df3-87eb-4217-871e-b653f9ac4f8a tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] 10.222.0.43 "GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984" status: 200 len: 1553 microversion: 2.91 time: 0.304873 Oct 04 21:58:58.290680 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1698/3350] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:58:57 2022] GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984 => generated 1553 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:58:58.292217 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cccaa676-57e9-4c12-9662-f7ce5f039d51 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:58.292713 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cccaa676-57e9-4c12-9662-f7ce5f039d51 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:58.293154 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cccaa676-57e9-4c12-9662-f7ce5f039d51 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:58.293879 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cccaa676-57e9-4c12-9662-f7ce5f039d51 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:58.294342 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cccaa676-57e9-4c12-9662-f7ce5f039d51 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:58.294804 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cccaa676-57e9-4c12-9662-f7ce5f039d51 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:58.497414 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-cccaa676-57e9-4c12-9662-f7ce5f039d51 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2facee4c6a40416e908083e126d2cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07a17a482a4e92b6ddbdee463c8029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:58.507490 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-cccaa676-57e9-4c12-9662-f7ce5f039d51 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d" status: 200 len: 1504 microversion: 2.1 time: 0.245815 Oct 04 21:58:58.508069 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1653/3351] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:58:58 2022] GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d => generated 1504 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:58:58.537715 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-8cd84476-9082-4d34-a507-75a3303d6c91 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:58.539143 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-8cd84476-9082-4d34-a507-75a3303d6c91 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: a4cf4fac-1e9b-4669-a6ff-30008ed3642d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:58.550268 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8cd84476-9082-4d34-a507-75a3303d6c91 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:58.551112 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8cd84476-9082-4d34-a507-75a3303d6c91 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:58.551727 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8cd84476-9082-4d34-a507-75a3303d6c91 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:58.552614 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8cd84476-9082-4d34-a507-75a3303d6c91 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:58.553229 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8cd84476-9082-4d34-a507-75a3303d6c91 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:58.553821 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8cd84476-9082-4d34-a507-75a3303d6c91 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:58.700122 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-5b40a839-66ab-4c8c-9df9-9baba5059d8c tempest-ServersAaction247Test-1008276901 tempest-ServersAaction247Test-1008276901-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:58.701831 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-5b40a839-66ab-4c8c-9df9-9baba5059d8c tempest-ServersAaction247Test-1008276901 tempest-ServersAaction247Test-1008276901-project] [instance: d9c4a8c7-1ce2-401b-9e16-f93f6743cddd] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:58.716240 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5b40a839-66ab-4c8c-9df9-9baba5059d8c tempest-ServersAaction247Test-1008276901 tempest-ServersAaction247Test-1008276901-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:58.720423 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5b40a839-66ab-4c8c-9df9-9baba5059d8c tempest-ServersAaction247Test-1008276901 tempest-ServersAaction247Test-1008276901-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:58.721095 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5b40a839-66ab-4c8c-9df9-9baba5059d8c tempest-ServersAaction247Test-1008276901 tempest-ServersAaction247Test-1008276901-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:58.722349 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5b40a839-66ab-4c8c-9df9-9baba5059d8c tempest-ServersAaction247Test-1008276901 tempest-ServersAaction247Test-1008276901-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:58.723147 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5b40a839-66ab-4c8c-9df9-9baba5059d8c tempest-ServersAaction247Test-1008276901 tempest-ServersAaction247Test-1008276901-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:58.723929 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5b40a839-66ab-4c8c-9df9-9baba5059d8c tempest-ServersAaction247Test-1008276901 tempest-ServersAaction247Test-1008276901-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:58.786644 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-8cd84476-9082-4d34-a507-75a3303d6c91 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2facee4c6a40416e908083e126d2cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07a17a482a4e92b6ddbdee463c8029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:58.799364 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-8cd84476-9082-4d34-a507-75a3303d6c91 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d" status: 200 len: 1504 microversion: 2.1 time: 0.265492 Oct 04 21:58:58.800887 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1699/3352] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:58:58 2022] GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d => generated 1504 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:58:58.827672 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-f778b972-f582-4af2-9af9-a7a18c7b2c24 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:58:58.829138 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-f778b972-f582-4af2-9af9-a7a18c7b2c24 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: a4cf4fac-1e9b-4669-a6ff-30008ed3642d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:58.836785 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f778b972-f582-4af2-9af9-a7a18c7b2c24 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:58.839462 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f778b972-f582-4af2-9af9-a7a18c7b2c24 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:58.840986 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f778b972-f582-4af2-9af9-a7a18c7b2c24 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:58.843651 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f778b972-f582-4af2-9af9-a7a18c7b2c24 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:58.845351 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f778b972-f582-4af2-9af9-a7a18c7b2c24 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:58.846081 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f778b972-f582-4af2-9af9-a7a18c7b2c24 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:58.865821 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-5b40a839-66ab-4c8c-9df9-9baba5059d8c tempest-ServersAaction247Test-1008276901 tempest-ServersAaction247Test-1008276901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8e807b622044e0e919097335487944d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d298ab75ea49598ddc5f969fa45adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:58.879054 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-5b40a839-66ab-4c8c-9df9-9baba5059d8c tempest-ServersAaction247Test-1008276901 tempest-ServersAaction247Test-1008276901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8e807b622044e0e919097335487944d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d298ab75ea49598ddc5f969fa45adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:58.881192 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-5b40a839-66ab-4c8c-9df9-9baba5059d8c tempest-ServersAaction247Test-1008276901 tempest-ServersAaction247Test-1008276901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8e807b622044e0e919097335487944d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d298ab75ea49598ddc5f969fa45adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:58.882880 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-5b40a839-66ab-4c8c-9df9-9baba5059d8c tempest-ServersAaction247Test-1008276901 tempest-ServersAaction247Test-1008276901-project] 10.222.0.43 "GET /compute/v2.1/servers/d9c4a8c7-1ce2-401b-9e16-f93f6743cddd" status: 200 len: 1366 microversion: 2.47 time: 0.187191 Oct 04 21:58:58.901521 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1654/3353] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:58:58 2022] GET /compute/v2.1/servers/d9c4a8c7-1ce2-401b-9e16-f93f6743cddd => generated 1366 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:58:59.005224 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-877d7328-4174-494b-808c-8d55b0724a4e tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:59.005848 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-877d7328-4174-494b-808c-8d55b0724a4e tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] [instance: e57b3eb4-9ac6-4f6b-bbe1-a8582bdf543b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:59.021455 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-877d7328-4174-494b-808c-8d55b0724a4e tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:59.021968 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-877d7328-4174-494b-808c-8d55b0724a4e tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:59.022393 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-877d7328-4174-494b-808c-8d55b0724a4e tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:59.031970 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-f778b972-f582-4af2-9af9-a7a18c7b2c24 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "POST /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d/action" status: 202 len: 0 microversion: 2.1 time: 0.212516 Oct 04 21:58:59.035086 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-877d7328-4174-494b-808c-8d55b0724a4e tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:59.038730 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-877d7328-4174-494b-808c-8d55b0724a4e tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:59.039397 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-877d7328-4174-494b-808c-8d55b0724a4e tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:59.042211 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1700/3354] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 21:58:58 2022] POST /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d/action => generated 0 bytes in 224 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 21:58:59.087196 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-a2c01a2e-d089-4bdc-8d6d-f72f220d83fb tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:59.087920 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-a2c01a2e-d089-4bdc-8d6d-f72f220d83fb tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: a4cf4fac-1e9b-4669-a6ff-30008ed3642d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:59.095435 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a2c01a2e-d089-4bdc-8d6d-f72f220d83fb tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:59.096430 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a2c01a2e-d089-4bdc-8d6d-f72f220d83fb tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:59.096870 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a2c01a2e-d089-4bdc-8d6d-f72f220d83fb tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:59.097583 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a2c01a2e-d089-4bdc-8d6d-f72f220d83fb tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:59.101385 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a2c01a2e-d089-4bdc-8d6d-f72f220d83fb tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:59.101835 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a2c01a2e-d089-4bdc-8d6d-f72f220d83fb tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:59.482154 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-a2c01a2e-d089-4bdc-8d6d-f72f220d83fb tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2facee4c6a40416e908083e126d2cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07a17a482a4e92b6ddbdee463c8029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:59.494315 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-a2c01a2e-d089-4bdc-8d6d-f72f220d83fb tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d" status: 200 len: 1509 microversion: 2.1 time: 0.428919 Oct 04 21:58:59.498104 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1701/3355] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:58:59 2022] GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d => generated 1509 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:58:59.506820 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-877d7328-4174-494b-808c-8d55b0724a4e tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e807c724cc4c3887a2d360f0584ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40071e45805146529fb8abd40629c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:59.516406 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-877d7328-4174-494b-808c-8d55b0724a4e tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] 10.222.0.43 "GET /compute/v2.1/servers/e57b3eb4-9ac6-4f6b-bbe1-a8582bdf543b" status: 200 len: 1308 microversion: 2.1 time: 0.516209 Oct 04 21:58:59.519577 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1655/3356] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:58:58 2022] GET /compute/v2.1/servers/e57b3eb4-9ac6-4f6b-bbe1-a8582bdf543b => generated 1308 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:58:59.521319 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-55896ed1-4675-425a-8af4-b7c680954483 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-107932875", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "ba1e386d-edaa-48a4-ab87-e2a4c49ce617"}], "security_groups": [{"name": "tempest-securitygroup--1489197835"}], "key_name": "tempest-keypair-965634969", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "37f4f2b5-e641-41c7-87bc-2e7cc6bf09e8", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:58:59.542809 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-f1910d8f-183a-4bbe-ab53-2953fd00d9c6 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:59.543839 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-f1910d8f-183a-4bbe-ab53-2953fd00d9c6 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] [instance: d0b1b757-4a4d-4a7a-9a06-08f178a02984] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:59.565323 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f1910d8f-183a-4bbe-ab53-2953fd00d9c6 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:59.566675 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f1910d8f-183a-4bbe-ab53-2953fd00d9c6 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:59.570174 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f1910d8f-183a-4bbe-ab53-2953fd00d9c6 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:59.575183 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f1910d8f-183a-4bbe-ab53-2953fd00d9c6 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:59.578995 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f1910d8f-183a-4bbe-ab53-2953fd00d9c6 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:59.579927 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f1910d8f-183a-4bbe-ab53-2953fd00d9c6 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:59.818165 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-f1910d8f-183a-4bbe-ab53-2953fd00d9c6 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:59.837183 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-f1910d8f-183a-4bbe-ab53-2953fd00d9c6 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:59.839167 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-f1910d8f-183a-4bbe-ab53-2953fd00d9c6 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:59.855107 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-f1910d8f-183a-4bbe-ab53-2953fd00d9c6 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] 10.222.0.43 "GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984" status: 200 len: 1553 microversion: 2.91 time: 0.331169 Oct 04 21:58:59.858769 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1656/3357] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:58:59 2022] GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984 => generated 1553 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:58:59.913419 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-553859bf-ac79-461e-b468-d737d62f9165 tempest-ServersAaction247Test-1008276901 tempest-ServersAaction247Test-1008276901-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:59.914813 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-553859bf-ac79-461e-b468-d737d62f9165 tempest-ServersAaction247Test-1008276901 tempest-ServersAaction247Test-1008276901-project] [instance: d9c4a8c7-1ce2-401b-9e16-f93f6743cddd] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:59.930644 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-553859bf-ac79-461e-b468-d737d62f9165 tempest-ServersAaction247Test-1008276901 tempest-ServersAaction247Test-1008276901-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:59.931538 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-553859bf-ac79-461e-b468-d737d62f9165 tempest-ServersAaction247Test-1008276901 tempest-ServersAaction247Test-1008276901-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:59.932681 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-553859bf-ac79-461e-b468-d737d62f9165 tempest-ServersAaction247Test-1008276901 tempest-ServersAaction247Test-1008276901-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:59.934680 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-553859bf-ac79-461e-b468-d737d62f9165 tempest-ServersAaction247Test-1008276901 tempest-ServersAaction247Test-1008276901-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:59.935570 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-553859bf-ac79-461e-b468-d737d62f9165 tempest-ServersAaction247Test-1008276901 tempest-ServersAaction247Test-1008276901-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:59.936472 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-553859bf-ac79-461e-b468-d737d62f9165 tempest-ServersAaction247Test-1008276901 tempest-ServersAaction247Test-1008276901-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:59.973372 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.network.neutron [None req-55896ed1-4675-425a-8af4-b7c680954483 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] validate_networks() for [('ba1e386d-edaa-48a4-ab87-e2a4c49ce617', None, None, None, None, None)] {{(pid=134102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:58:59.984117 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=2 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:59:00.081589 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=8 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:59:00.154061 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-553859bf-ac79-461e-b468-d737d62f9165 tempest-ServersAaction247Test-1008276901 tempest-ServersAaction247Test-1008276901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8e807b622044e0e919097335487944d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d298ab75ea49598ddc5f969fa45adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:00.172009 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-553859bf-ac79-461e-b468-d737d62f9165 tempest-ServersAaction247Test-1008276901 tempest-ServersAaction247Test-1008276901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8e807b622044e0e919097335487944d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d298ab75ea49598ddc5f969fa45adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:00.173806 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-553859bf-ac79-461e-b468-d737d62f9165 tempest-ServersAaction247Test-1008276901 tempest-ServersAaction247Test-1008276901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8e807b622044e0e919097335487944d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d298ab75ea49598ddc5f969fa45adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:00.177931 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-553859bf-ac79-461e-b468-d737d62f9165 tempest-ServersAaction247Test-1008276901 tempest-ServersAaction247Test-1008276901-project] 10.222.0.43 "GET /compute/v2.1/servers/d9c4a8c7-1ce2-401b-9e16-f93f6743cddd" status: 200 len: 1366 microversion: 2.47 time: 0.269332 Oct 04 21:59:00.192102 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1657/3358] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:58:59 2022] GET /compute/v2.1/servers/d9c4a8c7-1ce2-401b-9e16-f93f6743cddd => generated 1366 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:59:00.525952 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-9b9a7fbc-1c07-480a-aa01-c932cfee8161 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:00.526529 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-9b9a7fbc-1c07-480a-aa01-c932cfee8161 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: a4cf4fac-1e9b-4669-a6ff-30008ed3642d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:00.540320 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9b9a7fbc-1c07-480a-aa01-c932cfee8161 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:00.540851 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9b9a7fbc-1c07-480a-aa01-c932cfee8161 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:00.541657 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9b9a7fbc-1c07-480a-aa01-c932cfee8161 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:00.542414 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9b9a7fbc-1c07-480a-aa01-c932cfee8161 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:00.549358 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9b9a7fbc-1c07-480a-aa01-c932cfee8161 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:00.549836 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9b9a7fbc-1c07-480a-aa01-c932cfee8161 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:00.592491 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell0:SELECT=10 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:59:00.977675 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-9b9a7fbc-1c07-480a-aa01-c932cfee8161 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2facee4c6a40416e908083e126d2cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07a17a482a4e92b6ddbdee463c8029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:00.990557 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-9b9a7fbc-1c07-480a-aa01-c932cfee8161 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d" status: 200 len: 1509 microversion: 2.1 time: 0.469722 Oct 04 21:59:00.992537 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1658/3359] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:59:00 2022] GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d => generated 1509 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:59:01.007472 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-55896ed1-4675-425a-8af4-b7c680954483 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Getting quotas for project 3994b89cac594e309926f1eaf785f7d3. Resources: dict_keys(['metadata_items']) {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:59:01.011569 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-20f20503-c11e-47ef-8366-1277faac135f tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:01.018539 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-20f20503-c11e-47ef-8366-1277faac135f tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] [instance: e57b3eb4-9ac6-4f6b-bbe1-a8582bdf543b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:01.036131 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-55896ed1-4675-425a-8af4-b7c680954483 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Getting quotas for user 08c7a1e7d6984644a68d967b5e3fe92e and project 3994b89cac594e309926f1eaf785f7d3. Resources: dict_keys(['metadata_items']) {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:59:01.047366 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-20f20503-c11e-47ef-8366-1277faac135f tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:01.048599 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-20f20503-c11e-47ef-8366-1277faac135f tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:01.049319 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-20f20503-c11e-47ef-8366-1277faac135f tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:01.050952 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-20f20503-c11e-47ef-8366-1277faac135f tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:01.051767 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-20f20503-c11e-47ef-8366-1277faac135f tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:01.052525 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-20f20503-c11e-47ef-8366-1277faac135f tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:01.055625 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-55896ed1-4675-425a-8af4-b7c680954483 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Flavor limits 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:59:01.056052 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-55896ed1-4675-425a-8af4-b7c680954483 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Image limits 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:59:01.056571 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-55896ed1-4675-425a-8af4-b7c680954483 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Flavor pref 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:59:01.057170 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-55896ed1-4675-425a-8af4-b7c680954483 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Image pref 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:59:01.057774 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-55896ed1-4675-425a-8af4-b7c680954483 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:59:01.070089 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-55896ed1-4675-425a-8af4-b7c680954483 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:01.071122 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-55896ed1-4675-425a-8af4-b7c680954483 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:01.071789 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-55896ed1-4675-425a-8af4-b7c680954483 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:01.073036 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-55896ed1-4675-425a-8af4-b7c680954483 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:01.073723 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-55896ed1-4675-425a-8af4-b7c680954483 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:01.074391 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-55896ed1-4675-425a-8af4-b7c680954483 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:01.097027 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-55896ed1-4675-425a-8af4-b7c680954483 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Getting quotas for project 3994b89cac594e309926f1eaf785f7d3. Resources: {'instances', 'ram', 'cores'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:59:01.104457 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-55896ed1-4675-425a-8af4-b7c680954483 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Getting quotas for user 08c7a1e7d6984644a68d967b5e3fe92e and project 3994b89cac594e309926f1eaf785f7d3. Resources: {'instances', 'ram', 'cores'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:59:01.119799 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:59:01.251531 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-55896ed1-4675-425a-8af4-b7c680954483 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Going to run 1 instances... {{(pid=134102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:59:01.253942 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-55896ed1-4675-425a-8af4-b7c680954483 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] [instance: 4c17a63b-8492-4c9b-a0c2-34bef7051f80] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='37f4f2b5-e641-41c7-87bc-2e7cc6bf09e8',volume_size=None,volume_type=None)] {{(pid=134102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:59:01.388003 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-20f20503-c11e-47ef-8366-1277faac135f tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e807c724cc4c3887a2d360f0584ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40071e45805146529fb8abd40629c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:01.402301 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-20f20503-c11e-47ef-8366-1277faac135f tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] 10.222.0.43 "GET /compute/v2.1/servers/e57b3eb4-9ac6-4f6b-bbe1-a8582bdf543b" status: 200 len: 1308 microversion: 2.1 time: 0.404542 Oct 04 21:59:01.403840 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1659/3360] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:59:00 2022] GET /compute/v2.1/servers/e57b3eb4-9ac6-4f6b-bbe1-a8582bdf543b => generated 1308 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:59:01.412255 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-53687f91-6bc2-42e7-a4a8-495f927481e1 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:01.413782 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-53687f91-6bc2-42e7-a4a8-495f927481e1 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] [instance: d0b1b757-4a4d-4a7a-9a06-08f178a02984] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:01.433341 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-53687f91-6bc2-42e7-a4a8-495f927481e1 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:01.433862 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-53687f91-6bc2-42e7-a4a8-495f927481e1 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:01.434317 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-53687f91-6bc2-42e7-a4a8-495f927481e1 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:01.447896 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-53687f91-6bc2-42e7-a4a8-495f927481e1 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:01.450028 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-53687f91-6bc2-42e7-a4a8-495f927481e1 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:01.452301 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-53687f91-6bc2-42e7-a4a8-495f927481e1 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:01.517144 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-55896ed1-4675-425a-8af4-b7c680954483 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 2.007356 Oct 04 21:59:01.518045 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1702/3361] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 21:58:59 2022] POST /compute/v2.1/servers => generated 407 bytes in 2020 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:59:01.537363 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-5f4a340e-53b3-40d3-b74a-f301e0de1761 tempest-ServersAaction247Test-1008276901 tempest-ServersAaction247Test-1008276901-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:01.548366 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-5f4a340e-53b3-40d3-b74a-f301e0de1761 tempest-ServersAaction247Test-1008276901 tempest-ServersAaction247Test-1008276901-project] [instance: d9c4a8c7-1ce2-401b-9e16-f93f6743cddd] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:01.569617 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5f4a340e-53b3-40d3-b74a-f301e0de1761 tempest-ServersAaction247Test-1008276901 tempest-ServersAaction247Test-1008276901-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:01.570179 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5f4a340e-53b3-40d3-b74a-f301e0de1761 tempest-ServersAaction247Test-1008276901 tempest-ServersAaction247Test-1008276901-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:01.570665 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5f4a340e-53b3-40d3-b74a-f301e0de1761 tempest-ServersAaction247Test-1008276901 tempest-ServersAaction247Test-1008276901-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:01.571438 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5f4a340e-53b3-40d3-b74a-f301e0de1761 tempest-ServersAaction247Test-1008276901 tempest-ServersAaction247Test-1008276901-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:01.572056 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5f4a340e-53b3-40d3-b74a-f301e0de1761 tempest-ServersAaction247Test-1008276901 tempest-ServersAaction247Test-1008276901-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:01.574010 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5f4a340e-53b3-40d3-b74a-f301e0de1761 tempest-ServersAaction247Test-1008276901 tempest-ServersAaction247Test-1008276901-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:01.677058 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-53687f91-6bc2-42e7-a4a8-495f927481e1 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:01.707964 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-53687f91-6bc2-42e7-a4a8-495f927481e1 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:01.710108 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-53687f91-6bc2-42e7-a4a8-495f927481e1 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:01.738772 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-53687f91-6bc2-42e7-a4a8-495f927481e1 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] 10.222.0.43 "GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984" status: 200 len: 1553 microversion: 2.91 time: 0.327231 Oct 04 21:59:01.739805 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1660/3362] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:59:01 2022] GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984 => generated 1553 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:59:01.761603 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-a39a72c6-9fcc-4940-b884-cf7e5dac4a8f tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:01.763285 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-a39a72c6-9fcc-4940-b884-cf7e5dac4a8f tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] [instance: 4c17a63b-8492-4c9b-a0c2-34bef7051f80] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:01.772052 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-5f4a340e-53b3-40d3-b74a-f301e0de1761 tempest-ServersAaction247Test-1008276901 tempest-ServersAaction247Test-1008276901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8e807b622044e0e919097335487944d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d298ab75ea49598ddc5f969fa45adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:01.785475 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-5f4a340e-53b3-40d3-b74a-f301e0de1761 tempest-ServersAaction247Test-1008276901 tempest-ServersAaction247Test-1008276901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8e807b622044e0e919097335487944d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d298ab75ea49598ddc5f969fa45adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:01.788266 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-5f4a340e-53b3-40d3-b74a-f301e0de1761 tempest-ServersAaction247Test-1008276901 tempest-ServersAaction247Test-1008276901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8e807b622044e0e919097335487944d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d298ab75ea49598ddc5f969fa45adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:01.789759 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-5f4a340e-53b3-40d3-b74a-f301e0de1761 tempest-ServersAaction247Test-1008276901 tempest-ServersAaction247Test-1008276901-project] 10.222.0.43 "GET /compute/v2.1/servers/d9c4a8c7-1ce2-401b-9e16-f93f6743cddd" status: 200 len: 1366 microversion: 2.47 time: 0.268165 Oct 04 21:59:01.813338 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1703/3363] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:59:01 2022] GET /compute/v2.1/servers/d9c4a8c7-1ce2-401b-9e16-f93f6743cddd => generated 1366 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:59:01.908582 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-a39a72c6-9fcc-4940-b884-cf7e5dac4a8f tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c7a1e7d6984644a68d967b5e3fe92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3994b89cac594e309926f1eaf785f7d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:01.928433 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-a39a72c6-9fcc-4940-b884-cf7e5dac4a8f tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] 10.222.0.43 "GET /compute/v2.1/servers/4c17a63b-8492-4c9b-a0c2-34bef7051f80" status: 200 len: 1120 microversion: 2.1 time: 0.185658 Oct 04 21:59:01.932836 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1661/3364] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:59:01 2022] GET /compute/v2.1/servers/4c17a63b-8492-4c9b-a0c2-34bef7051f80 => generated 1120 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:59:02.018921 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-6297ee8d-1a9d-44ed-8bd5-3f31867d205d tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:02.020652 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-6297ee8d-1a9d-44ed-8bd5-3f31867d205d tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: a4cf4fac-1e9b-4669-a6ff-30008ed3642d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:02.045207 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6297ee8d-1a9d-44ed-8bd5-3f31867d205d tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:02.050003 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6297ee8d-1a9d-44ed-8bd5-3f31867d205d tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:02.050751 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6297ee8d-1a9d-44ed-8bd5-3f31867d205d tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:02.051716 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6297ee8d-1a9d-44ed-8bd5-3f31867d205d tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:02.052354 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6297ee8d-1a9d-44ed-8bd5-3f31867d205d tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:02.053165 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6297ee8d-1a9d-44ed-8bd5-3f31867d205d tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:02.407336 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-6297ee8d-1a9d-44ed-8bd5-3f31867d205d tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2facee4c6a40416e908083e126d2cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07a17a482a4e92b6ddbdee463c8029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:02.419470 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-6297ee8d-1a9d-44ed-8bd5-3f31867d205d tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d" status: 200 len: 1489 microversion: 2.1 time: 0.406561 Oct 04 21:59:02.428871 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-9110c14a-fa0e-4ce9-abb2-9dbfc254cbfd tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:02.430113 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-9110c14a-fa0e-4ce9-abb2-9dbfc254cbfd tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] [instance: e57b3eb4-9ac6-4f6b-bbe1-a8582bdf543b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:02.434718 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1704/3365] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:59:02 2022] GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d => generated 1489 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:59:02.444209 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9110c14a-fa0e-4ce9-abb2-9dbfc254cbfd tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:02.448259 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9110c14a-fa0e-4ce9-abb2-9dbfc254cbfd tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:02.448855 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9110c14a-fa0e-4ce9-abb2-9dbfc254cbfd tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:02.449824 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9110c14a-fa0e-4ce9-abb2-9dbfc254cbfd tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:02.451040 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9110c14a-fa0e-4ce9-abb2-9dbfc254cbfd tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:02.451620 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9110c14a-fa0e-4ce9-abb2-9dbfc254cbfd tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:02.455967 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-5bfd1bbb-71db-4030-a0bd-3f0904d87fcf tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:59:02.467324 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-5bfd1bbb-71db-4030-a0bd-3f0904d87fcf tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: a4cf4fac-1e9b-4669-a6ff-30008ed3642d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:02.475650 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5bfd1bbb-71db-4030-a0bd-3f0904d87fcf tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:02.480379 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5bfd1bbb-71db-4030-a0bd-3f0904d87fcf tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:02.485211 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5bfd1bbb-71db-4030-a0bd-3f0904d87fcf tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:02.496632 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5bfd1bbb-71db-4030-a0bd-3f0904d87fcf tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:02.497379 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5bfd1bbb-71db-4030-a0bd-3f0904d87fcf tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:02.498023 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5bfd1bbb-71db-4030-a0bd-3f0904d87fcf tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:02.503452 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:59:02.528008 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-5bfd1bbb-71db-4030-a0bd-3f0904d87fcf tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] HTTP exception thrown: Cannot 'pause' instance a4cf4fac-1e9b-4669-a6ff-30008ed3642d while it is in vm_state paused Oct 04 21:59:02.530220 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-5bfd1bbb-71db-4030-a0bd-3f0904d87fcf tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Request method failure captured: Oct 04 21:59:02.530220 n-d-860284-1 devstack@n-api.service[134102]: request: POST /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d/action HTTP/1.1 Oct 04 21:59:02.530220 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 21:59:02.530220 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 21:59:02.530220 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 21:59:02.530220 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 13 Oct 04 21:59:02.530220 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 21:59:02.530220 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 21:59:02.530220 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 21:59:02.530220 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 21:59:02.530220 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPKwu4cpW6hhBuWb-qV_7iYlwjOTpf5XWCl53BJjoosjlcj4wkmmOFzemCJVdBntIx8zJ1SF_z6VrRY8UJr7E8TQDJCRnVQMdNnh0-lZwGdqUzjOWSO31Ryb6n87Cka0g238a21JWok3h3GEhLB-7oCbN3bbcOGmkhd6UFueRxRluk24 Oct 04 21:59:02.530220 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 21:59:02.530220 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 21:59:02.530220 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 21:59:02.530220 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 21:59:02.530220 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 21:59:02.530220 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 21:59:02.530220 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: cf07a17a482a4e92b6ddbdee463c8029 Oct 04 21:59:02.530220 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-ServersNegativeTestJSON-1933663319 Oct 04 21:59:02.530220 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 21:59:02.530220 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 21:59:02.530220 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/cf07a17a482a4e92b6ddbdee463c8029"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_cf07a17a482a4e92b6ddbdee463c8029", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/cf07a17a482a4e92b6ddbdee463c8029"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/cf07a17a482a4e92b6ddbdee463c8029"}]}] Oct 04 21:59:02.530220 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-ServersNegativeTestJSON-1933663319 Oct 04 21:59:02.530220 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: cf07a17a482a4e92b6ddbdee463c8029 Oct 04 21:59:02.530220 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1933663319 Oct 04 21:59:02.530220 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-ServersNegativeTestJSON-1933663319-project Oct 04 21:59:02.530220 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 21:59:02.530220 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 21:59:02.530220 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: 2facee4c6a40416e908083e126d2cfa3 Oct 04 21:59:02.530220 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-ServersNegativeTestJSON-1933663319-project Oct 04 21:59:02.530220 n-d-860284-1 devstack@n-api.service[134102]: Oct 04 21:59:02.530220 n-d-860284-1 devstack@n-api.service[134102]: {"pause": {}} Oct 04 21:59:02.530220 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 21:59:02.530220 n-d-860284-1 devstack@n-api.service[134102]: exception: Cannot 'pause' instance a4cf4fac-1e9b-4669-a6ff-30008ed3642d while it is in vm_state paused Oct 04 21:59:02.530220 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': 'a4cf4fac-1e9b-4669-a6ff-30008ed3642d', 'body': {'pause': {}}} Oct 04 21:59:02.530220 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:59:02.530220 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:59:02.530220 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 41, in _pause Oct 04 21:59:02.530220 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi self.compute_api.pause(ctxt, server) Oct 04 21:59:02.530220 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 21:59:02.530220 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 21:59:02.530220 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 04 21:59:02.530220 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 04 21:59:02.530220 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance a4cf4fac-1e9b-4669-a6ff-30008ed3642d in vm_state paused. Cannot pause while the instance is in this state. Oct 04 21:59:02.530220 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:59:02.530220 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:59:02.530220 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:59:02.530220 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:59:02.530220 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:59:02.530220 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:59:02.530220 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:59:02.530220 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:59:02.530220 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:59:02.530220 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:59:02.530220 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 45, in _pause Oct 04 21:59:02.530220 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 04 21:59:02.530220 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 04 21:59:02.530220 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 21:59:02.530220 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'pause' instance a4cf4fac-1e9b-4669-a6ff-30008ed3642d while it is in vm_state paused Oct 04 21:59:02.530220 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:59:02.530220 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:59:02.530220 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:59:02.530220 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:59:02.530220 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:59:02.535593 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:59:02.535593 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:59:02.535593 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:59:02.535593 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'pause' instance a4cf4fac-1e9b-4669-a6ff-30008ed3642d while it is in vm_state paused Oct 04 21:59:02.535593 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:59:02.536836 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-5bfd1bbb-71db-4030-a0bd-3f0904d87fcf tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Returning 409 to user: Cannot 'pause' instance a4cf4fac-1e9b-4669-a6ff-30008ed3642d while it is in vm_state paused {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:59:02.537899 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-5bfd1bbb-71db-4030-a0bd-3f0904d87fcf tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "POST /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d/action" status: 409 len: 143 microversion: 2.1 time: 0.094628 Oct 04 21:59:02.539050 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1705/3366] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 21:59:02 2022] POST /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d/action => generated 143 bytes in 96 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 21:59:02.548551 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-9ee82950-1676-41eb-853f-f8af7be371ec tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:59:02.549097 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-9ee82950-1676-41eb-853f-f8af7be371ec tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: a4cf4fac-1e9b-4669-a6ff-30008ed3642d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:02.560389 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9ee82950-1676-41eb-853f-f8af7be371ec tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:02.563210 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9ee82950-1676-41eb-853f-f8af7be371ec tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:02.565218 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9ee82950-1676-41eb-853f-f8af7be371ec tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:02.567358 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9ee82950-1676-41eb-853f-f8af7be371ec tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:02.570356 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9ee82950-1676-41eb-853f-f8af7be371ec tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:02.573717 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9ee82950-1676-41eb-853f-f8af7be371ec tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:02.646258 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-9110c14a-fa0e-4ce9-abb2-9dbfc254cbfd tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e807c724cc4c3887a2d360f0584ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40071e45805146529fb8abd40629c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:02.657912 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-9110c14a-fa0e-4ce9-abb2-9dbfc254cbfd tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] 10.222.0.43 "GET /compute/v2.1/servers/e57b3eb4-9ac6-4f6b-bbe1-a8582bdf543b" status: 200 len: 1308 microversion: 2.1 time: 0.234082 Oct 04 21:59:02.672900 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1662/3367] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:59:02 2022] GET /compute/v2.1/servers/e57b3eb4-9ac6-4f6b-bbe1-a8582bdf543b => generated 1308 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:59:02.777773 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-43c29014-0c16-4a31-8293-abfed79cc333 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:02.779807 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-43c29014-0c16-4a31-8293-abfed79cc333 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] [instance: d0b1b757-4a4d-4a7a-9a06-08f178a02984] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:02.780528 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-9ee82950-1676-41eb-853f-f8af7be371ec tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "POST /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d/action" status: 202 len: 0 microversion: 2.1 time: 0.235657 Oct 04 21:59:02.784705 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1706/3368] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 21:59:02 2022] POST /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d/action => generated 0 bytes in 241 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:59:02.790455 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-92c6a351-9ed0-429d-89a2-b327de511d36 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:02.797376 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-92c6a351-9ed0-429d-89a2-b327de511d36 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: a4cf4fac-1e9b-4669-a6ff-30008ed3642d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:02.798209 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-43c29014-0c16-4a31-8293-abfed79cc333 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:02.807147 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-43c29014-0c16-4a31-8293-abfed79cc333 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:02.808015 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-43c29014-0c16-4a31-8293-abfed79cc333 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:02.808956 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-43c29014-0c16-4a31-8293-abfed79cc333 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:02.818590 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-43c29014-0c16-4a31-8293-abfed79cc333 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:02.823207 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-43c29014-0c16-4a31-8293-abfed79cc333 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:02.842432 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-92c6a351-9ed0-429d-89a2-b327de511d36 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:02.843360 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-92c6a351-9ed0-429d-89a2-b327de511d36 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:02.844039 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-92c6a351-9ed0-429d-89a2-b327de511d36 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:02.844785 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-92c6a351-9ed0-429d-89a2-b327de511d36 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:02.856902 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-92c6a351-9ed0-429d-89a2-b327de511d36 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:02.858858 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-92c6a351-9ed0-429d-89a2-b327de511d36 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:03.126500 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-43c29014-0c16-4a31-8293-abfed79cc333 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:03.149896 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-43c29014-0c16-4a31-8293-abfed79cc333 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:03.154624 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-43c29014-0c16-4a31-8293-abfed79cc333 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:03.165418 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:59:03.169805 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-43c29014-0c16-4a31-8293-abfed79cc333 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] 10.222.0.43 "GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984" status: 200 len: 1553 microversion: 2.91 time: 0.402393 Oct 04 21:59:03.187927 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1663/3369] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:59:02 2022] GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984 => generated 1553 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:59:03.205344 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-decfddac-50d7-4050-bfca-4be95cd3df00 tempest-ServersAaction247Test-1008276901 tempest-ServersAaction247Test-1008276901-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:03.206672 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-decfddac-50d7-4050-bfca-4be95cd3df00 tempest-ServersAaction247Test-1008276901 tempest-ServersAaction247Test-1008276901-project] [instance: d9c4a8c7-1ce2-401b-9e16-f93f6743cddd] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:03.220608 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-decfddac-50d7-4050-bfca-4be95cd3df00 tempest-ServersAaction247Test-1008276901 tempest-ServersAaction247Test-1008276901-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:03.221474 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-decfddac-50d7-4050-bfca-4be95cd3df00 tempest-ServersAaction247Test-1008276901 tempest-ServersAaction247Test-1008276901-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:03.222091 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-decfddac-50d7-4050-bfca-4be95cd3df00 tempest-ServersAaction247Test-1008276901 tempest-ServersAaction247Test-1008276901-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:03.223060 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-decfddac-50d7-4050-bfca-4be95cd3df00 tempest-ServersAaction247Test-1008276901 tempest-ServersAaction247Test-1008276901-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:03.223679 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-decfddac-50d7-4050-bfca-4be95cd3df00 tempest-ServersAaction247Test-1008276901 tempest-ServersAaction247Test-1008276901-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:03.224270 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-decfddac-50d7-4050-bfca-4be95cd3df00 tempest-ServersAaction247Test-1008276901 tempest-ServersAaction247Test-1008276901-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:03.267903 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-decfddac-50d7-4050-bfca-4be95cd3df00 tempest-ServersAaction247Test-1008276901 tempest-ServersAaction247Test-1008276901-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:03.268763 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-decfddac-50d7-4050-bfca-4be95cd3df00 tempest-ServersAaction247Test-1008276901 tempest-ServersAaction247Test-1008276901-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:03.269439 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-decfddac-50d7-4050-bfca-4be95cd3df00 tempest-ServersAaction247Test-1008276901 tempest-ServersAaction247Test-1008276901-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:03.270056 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.objects.instance [None req-decfddac-50d7-4050-bfca-4be95cd3df00 tempest-ServersAaction247Test-1008276901 tempest-ServersAaction247Test-1008276901-project] Lazy-loading 'fault' on Instance uuid d9c4a8c7-1ce2-401b-9e16-f93f6743cddd {{(pid=134101) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:59:03.405686 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-92c6a351-9ed0-429d-89a2-b327de511d36 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2facee4c6a40416e908083e126d2cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07a17a482a4e92b6ddbdee463c8029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:03.424217 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-92c6a351-9ed0-429d-89a2-b327de511d36 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d" status: 200 len: 1496 microversion: 2.1 time: 0.637664 Oct 04 21:59:03.430004 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1707/3370] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:59:02 2022] GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d => generated 1496 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:59:03.445629 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-2bb5d541-9ade-450d-a242-aead71b061a1 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:03.448686 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-2bb5d541-9ade-450d-a242-aead71b061a1 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] [instance: 4c17a63b-8492-4c9b-a0c2-34bef7051f80] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:03.473415 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2bb5d541-9ade-450d-a242-aead71b061a1 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:03.476435 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2bb5d541-9ade-450d-a242-aead71b061a1 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:03.479446 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2bb5d541-9ade-450d-a242-aead71b061a1 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:03.481815 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2bb5d541-9ade-450d-a242-aead71b061a1 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:03.485463 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2bb5d541-9ade-450d-a242-aead71b061a1 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:03.486648 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2bb5d541-9ade-450d-a242-aead71b061a1 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:03.506851 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-decfddac-50d7-4050-bfca-4be95cd3df00 tempest-ServersAaction247Test-1008276901 tempest-ServersAaction247Test-1008276901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8e807b622044e0e919097335487944d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d298ab75ea49598ddc5f969fa45adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:03.525123 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-decfddac-50d7-4050-bfca-4be95cd3df00 tempest-ServersAaction247Test-1008276901 tempest-ServersAaction247Test-1008276901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8e807b622044e0e919097335487944d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d298ab75ea49598ddc5f969fa45adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:03.526519 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-decfddac-50d7-4050-bfca-4be95cd3df00 tempest-ServersAaction247Test-1008276901 tempest-ServersAaction247Test-1008276901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8e807b622044e0e919097335487944d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d298ab75ea49598ddc5f969fa45adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:03.535278 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-decfddac-50d7-4050-bfca-4be95cd3df00 tempest-ServersAaction247Test-1008276901 tempest-ServersAaction247Test-1008276901-project] 10.222.0.43 "GET /compute/v2.1/servers/d9c4a8c7-1ce2-401b-9e16-f93f6743cddd" status: 200 len: 1371 microversion: 2.47 time: 0.343868 Oct 04 21:59:03.567489 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1664/3371] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:59:03 2022] GET /compute/v2.1/servers/d9c4a8c7-1ce2-401b-9e16-f93f6743cddd => generated 1371 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:59:03.648410 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-2bb5d541-9ade-450d-a242-aead71b061a1 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c7a1e7d6984644a68d967b5e3fe92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3994b89cac594e309926f1eaf785f7d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:03.663484 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-2bb5d541-9ade-450d-a242-aead71b061a1 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] 10.222.0.43 "GET /compute/v2.1/servers/4c17a63b-8492-4c9b-a0c2-34bef7051f80" status: 200 len: 1226 microversion: 2.1 time: 0.229610 Oct 04 21:59:03.665114 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1708/3372] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:59:03 2022] GET /compute/v2.1/servers/4c17a63b-8492-4c9b-a0c2-34bef7051f80 => generated 1226 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:59:03.686795 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-3c2a1c5d-737e-4278-b637-20a158548f25 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:03.687768 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-3c2a1c5d-737e-4278-b637-20a158548f25 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] [instance: e57b3eb4-9ac6-4f6b-bbe1-a8582bdf543b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:03.696746 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3c2a1c5d-737e-4278-b637-20a158548f25 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:03.697687 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3c2a1c5d-737e-4278-b637-20a158548f25 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:03.709468 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3c2a1c5d-737e-4278-b637-20a158548f25 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:03.711457 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3c2a1c5d-737e-4278-b637-20a158548f25 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:03.712573 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3c2a1c5d-737e-4278-b637-20a158548f25 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:03.713267 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3c2a1c5d-737e-4278-b637-20a158548f25 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:03.935552 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-3c2a1c5d-737e-4278-b637-20a158548f25 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e807c724cc4c3887a2d360f0584ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40071e45805146529fb8abd40629c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:03.953704 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-3c2a1c5d-737e-4278-b637-20a158548f25 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] 10.222.0.43 "GET /compute/v2.1/servers/e57b3eb4-9ac6-4f6b-bbe1-a8582bdf543b" status: 200 len: 1308 microversion: 2.1 time: 0.271598 Oct 04 21:59:03.954283 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1665/3373] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:59:03 2022] GET /compute/v2.1/servers/e57b3eb4-9ac6-4f6b-bbe1-a8582bdf543b => generated 1308 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:59:04.205280 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-c76c94b1-db1b-4b72-98b2-1422d38a1582 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:04.205907 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-c76c94b1-db1b-4b72-98b2-1422d38a1582 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] [instance: d0b1b757-4a4d-4a7a-9a06-08f178a02984] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:04.228390 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c76c94b1-db1b-4b72-98b2-1422d38a1582 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:04.234827 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c76c94b1-db1b-4b72-98b2-1422d38a1582 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:04.235282 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c76c94b1-db1b-4b72-98b2-1422d38a1582 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:04.236353 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c76c94b1-db1b-4b72-98b2-1422d38a1582 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:04.244709 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c76c94b1-db1b-4b72-98b2-1422d38a1582 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:04.246989 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c76c94b1-db1b-4b72-98b2-1422d38a1582 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:04.454023 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-b04b8ec0-4333-4c7e-99ad-f9f42d0895c3 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:04.455059 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-b04b8ec0-4333-4c7e-99ad-f9f42d0895c3 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: a4cf4fac-1e9b-4669-a6ff-30008ed3642d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:04.466995 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-c76c94b1-db1b-4b72-98b2-1422d38a1582 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:04.472426 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b04b8ec0-4333-4c7e-99ad-f9f42d0895c3 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:04.473010 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b04b8ec0-4333-4c7e-99ad-f9f42d0895c3 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:04.474032 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b04b8ec0-4333-4c7e-99ad-f9f42d0895c3 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:04.475715 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b04b8ec0-4333-4c7e-99ad-f9f42d0895c3 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:04.477435 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b04b8ec0-4333-4c7e-99ad-f9f42d0895c3 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:04.478851 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b04b8ec0-4333-4c7e-99ad-f9f42d0895c3 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:04.479323 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-c76c94b1-db1b-4b72-98b2-1422d38a1582 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:04.482016 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-c76c94b1-db1b-4b72-98b2-1422d38a1582 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:04.489731 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-c76c94b1-db1b-4b72-98b2-1422d38a1582 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] 10.222.0.43 "GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984" status: 200 len: 1553 microversion: 2.91 time: 0.288455 Oct 04 21:59:04.521568 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1709/3374] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:59:04 2022] GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984 => generated 1553 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:59:04.587358 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-eb841138-b9cd-42a3-ad20-defb4ce2f5e1 tempest-ServersAaction247Test-1008276901 tempest-ServersAaction247Test-1008276901-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:04.588338 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-eb841138-b9cd-42a3-ad20-defb4ce2f5e1 tempest-ServersAaction247Test-1008276901 tempest-ServersAaction247Test-1008276901-project] [instance: d9c4a8c7-1ce2-401b-9e16-f93f6743cddd] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:04.600225 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-eb841138-b9cd-42a3-ad20-defb4ce2f5e1 tempest-ServersAaction247Test-1008276901 tempest-ServersAaction247Test-1008276901-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:04.603057 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-eb841138-b9cd-42a3-ad20-defb4ce2f5e1 tempest-ServersAaction247Test-1008276901 tempest-ServersAaction247Test-1008276901-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:04.606104 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-eb841138-b9cd-42a3-ad20-defb4ce2f5e1 tempest-ServersAaction247Test-1008276901 tempest-ServersAaction247Test-1008276901-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:04.607192 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-eb841138-b9cd-42a3-ad20-defb4ce2f5e1 tempest-ServersAaction247Test-1008276901 tempest-ServersAaction247Test-1008276901-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:04.607830 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-eb841138-b9cd-42a3-ad20-defb4ce2f5e1 tempest-ServersAaction247Test-1008276901 tempest-ServersAaction247Test-1008276901-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:04.609523 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-eb841138-b9cd-42a3-ad20-defb4ce2f5e1 tempest-ServersAaction247Test-1008276901 tempest-ServersAaction247Test-1008276901-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:04.672225 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-eb841138-b9cd-42a3-ad20-defb4ce2f5e1 tempest-ServersAaction247Test-1008276901 tempest-ServersAaction247Test-1008276901-project] HTTP exception thrown: Instance d9c4a8c7-1ce2-401b-9e16-f93f6743cddd could not be found. Oct 04 21:59:04.678562 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-eb841138-b9cd-42a3-ad20-defb4ce2f5e1 tempest-ServersAaction247Test-1008276901 tempest-ServersAaction247Test-1008276901-project] Request method failure captured: Oct 04 21:59:04.678562 n-d-860284-1 devstack@n-api.service[134102]: request: GET /compute/v2.1/servers/d9c4a8c7-1ce2-401b-9e16-f93f6743cddd HTTP/1.1 Oct 04 21:59:04.678562 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 21:59:04.678562 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 21:59:04.678562 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 21:59:04.678562 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 21:59:04.678562 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 21:59:04.678562 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 21:59:04.678562 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 21:59:04.678562 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 21:59:04.678562 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPKyVsbEth8x9_vbf8H-c1n97ZbwlIwRkjFkTn_PHegqS0MjdS1CANXK5gN0iF8eZNz53RGeqwpokp50NSS8iAH9yVUswliIV_Jse7OFP__NfKGS0xMg-xYip0UXPOWezriqFieGo_On1Y5biTqxKRhNoRiVdpizd1ZlD74YVK4yyZNA Oct 04 21:59:04.678562 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 21:59:04.678562 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 21:59:04.678562 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 21:59:04.678562 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 21:59:04.678562 n-d-860284-1 devstack@n-api.service[134102]: X-Openstack-Nova-Api-Version: 2.47 Oct 04 21:59:04.678562 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 21:59:04.678562 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 21:59:04.678562 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: 02d298ab75ea49598ddc5f969fa45adc Oct 04 21:59:04.678562 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-ServersAaction247Test-1008276901 Oct 04 21:59:04.678562 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 21:59:04.678562 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 21:59:04.678562 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/02d298ab75ea49598ddc5f969fa45adc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_02d298ab75ea49598ddc5f969fa45adc", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/02d298ab75ea49598ddc5f969fa45adc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/02d298ab75ea49598ddc5f969fa45adc"}]}] Oct 04 21:59:04.678562 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-ServersAaction247Test-1008276901 Oct 04 21:59:04.678562 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: 02d298ab75ea49598ddc5f969fa45adc Oct 04 21:59:04.678562 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-ServersAaction247Test-1008276901 Oct 04 21:59:04.678562 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-ServersAaction247Test-1008276901-project Oct 04 21:59:04.678562 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 21:59:04.678562 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 21:59:04.678562 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: a8e807b622044e0e919097335487944d Oct 04 21:59:04.678562 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-ServersAaction247Test-1008276901-project Oct 04 21:59:04.678562 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 21:59:04.678562 n-d-860284-1 devstack@n-api.service[134102]: exception: Instance d9c4a8c7-1ce2-401b-9e16-f93f6743cddd could not be found. Oct 04 21:59:04.678562 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': 'd9c4a8c7-1ce2-401b-9e16-f93f6743cddd'} Oct 04 21:59:04.678562 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:59:04.678562 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:59:04.678562 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:59:04.678562 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:59:04.678562 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:59:04.678562 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:59:04.678562 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:59:04.678562 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:59:04.678562 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:59:04.678562 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:59:04.678562 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9c4a8c7-1ce2-401b-9e16-f93f6743cddd could not be found. Oct 04 21:59:04.678562 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:59:04.678562 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:59:04.678562 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:59:04.678562 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:59:04.678562 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:59:04.678562 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:59:04.678562 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:59:04.678562 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:59:04.678562 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:59:04.678562 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:59:04.678562 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:59:04.678562 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:59:04.678562 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:59:04.678562 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:59:04.678562 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:59:04.678562 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:59:04.678562 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9c4a8c7-1ce2-401b-9e16-f93f6743cddd could not be found. Oct 04 21:59:04.678562 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:59:04.678562 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:59:04.683798 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:59:04.683798 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:59:04.683798 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:59:04.683798 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:59:04.683798 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:59:04.683798 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:59:04.683798 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9c4a8c7-1ce2-401b-9e16-f93f6743cddd could not be found. Oct 04 21:59:04.683798 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:59:04.687520 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-eb841138-b9cd-42a3-ad20-defb4ce2f5e1 tempest-ServersAaction247Test-1008276901 tempest-ServersAaction247Test-1008276901-project] Returning 404 to user: Instance d9c4a8c7-1ce2-401b-9e16-f93f6743cddd could not be found. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:59:04.689728 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-eb841138-b9cd-42a3-ad20-defb4ce2f5e1 tempest-ServersAaction247Test-1008276901 tempest-ServersAaction247Test-1008276901-project] 10.222.0.43 "GET /compute/v2.1/servers/d9c4a8c7-1ce2-401b-9e16-f93f6743cddd" status: 404 len: 111 microversion: 2.47 time: 0.107891 Oct 04 21:59:04.692032 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1710/3375] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:59:04 2022] GET /compute/v2.1/servers/d9c4a8c7-1ce2-401b-9e16-f93f6743cddd => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 04 21:59:04.706125 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-8dd177ad-9e27-44d5-87dd-5f41a642a5af tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:04.709473 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-8dd177ad-9e27-44d5-87dd-5f41a642a5af tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] [instance: 4c17a63b-8492-4c9b-a0c2-34bef7051f80] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:04.724177 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8dd177ad-9e27-44d5-87dd-5f41a642a5af tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:04.724810 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8dd177ad-9e27-44d5-87dd-5f41a642a5af tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:04.727913 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8dd177ad-9e27-44d5-87dd-5f41a642a5af tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:04.729053 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8dd177ad-9e27-44d5-87dd-5f41a642a5af tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:04.737765 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8dd177ad-9e27-44d5-87dd-5f41a642a5af tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:04.743702 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8dd177ad-9e27-44d5-87dd-5f41a642a5af tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:04.939546 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-b04b8ec0-4333-4c7e-99ad-f9f42d0895c3 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2facee4c6a40416e908083e126d2cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07a17a482a4e92b6ddbdee463c8029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:04.948103 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-8dd177ad-9e27-44d5-87dd-5f41a642a5af tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c7a1e7d6984644a68d967b5e3fe92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3994b89cac594e309926f1eaf785f7d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:04.959928 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-b04b8ec0-4333-4c7e-99ad-f9f42d0895c3 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d" status: 200 len: 1504 microversion: 2.1 time: 0.510374 Oct 04 21:59:04.964793 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-8dd177ad-9e27-44d5-87dd-5f41a642a5af tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] 10.222.0.43 "GET /compute/v2.1/servers/4c17a63b-8492-4c9b-a0c2-34bef7051f80" status: 200 len: 1236 microversion: 2.1 time: 0.271243 Oct 04 21:59:04.987774 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1711/3376] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:59:04 2022] GET /compute/v2.1/servers/4c17a63b-8492-4c9b-a0c2-34bef7051f80 => generated 1236 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:59:04.990743 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1666/3377] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:59:04 2022] GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d => generated 1504 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:59:04.993774 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-65656c18-e4cb-41ab-8727-a3ab4987492e req-a43c35ce-6267-4e73-9e25-84df4eecd3a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e57b3eb4-9ac6-4f6b-bbe1-a8582bdf543b", "name": "network-vif-plugged", "status": "completed", "tag": "7bf70467-e6c6-44c5-b9e5-a3641cdfe409"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:59:04.997197 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-1cf02f34-1e4e-449d-bae4-1b210c8716a5 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:05.001350 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-1cf02f34-1e4e-449d-bae4-1b210c8716a5 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] [instance: e57b3eb4-9ac6-4f6b-bbe1-a8582bdf543b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:05.007792 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-65656c18-e4cb-41ab-8727-a3ab4987492e req-a43c35ce-6267-4e73-9e25-84df4eecd3a3 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:05.008591 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-65656c18-e4cb-41ab-8727-a3ab4987492e req-a43c35ce-6267-4e73-9e25-84df4eecd3a3 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:05.009242 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-65656c18-e4cb-41ab-8727-a3ab4987492e req-a43c35ce-6267-4e73-9e25-84df4eecd3a3 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:05.013898 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1cf02f34-1e4e-449d-bae4-1b210c8716a5 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:05.016727 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1cf02f34-1e4e-449d-bae4-1b210c8716a5 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:05.017490 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1cf02f34-1e4e-449d-bae4-1b210c8716a5 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:05.019400 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1cf02f34-1e4e-449d-bae4-1b210c8716a5 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:05.021223 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1cf02f34-1e4e-449d-bae4-1b210c8716a5 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:05.021953 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1cf02f34-1e4e-449d-bae4-1b210c8716a5 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:05.040052 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-65656c18-e4cb-41ab-8727-a3ab4987492e req-a43c35ce-6267-4e73-9e25-84df4eecd3a3 service nova] Creating event network-vif-plugged:7bf70467-e6c6-44c5-b9e5-a3641cdfe409 for instance e57b3eb4-9ac6-4f6b-bbe1-a8582bdf543b on n-h1-860284-1 Oct 04 21:59:05.048948 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-65656c18-e4cb-41ab-8727-a3ab4987492e req-a43c35ce-6267-4e73-9e25-84df4eecd3a3 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058682 Oct 04 21:59:05.050279 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1712/3378] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:59:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:59:05.058809 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-9b783a46-8ae7-493e-bec9-b49747669575 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:05.059823 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-9b783a46-8ae7-493e-bec9-b49747669575 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: a4cf4fac-1e9b-4669-a6ff-30008ed3642d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:05.090394 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9b783a46-8ae7-493e-bec9-b49747669575 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:05.091909 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9b783a46-8ae7-493e-bec9-b49747669575 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:05.093506 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9b783a46-8ae7-493e-bec9-b49747669575 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:05.097359 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9b783a46-8ae7-493e-bec9-b49747669575 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:05.103941 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9b783a46-8ae7-493e-bec9-b49747669575 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:05.104749 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9b783a46-8ae7-493e-bec9-b49747669575 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:05.473621 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-1cf02f34-1e4e-449d-bae4-1b210c8716a5 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e807c724cc4c3887a2d360f0584ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40071e45805146529fb8abd40629c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:05.487740 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-1cf02f34-1e4e-449d-bae4-1b210c8716a5 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] 10.222.0.43 "GET /compute/v2.1/servers/e57b3eb4-9ac6-4f6b-bbe1-a8582bdf543b" status: 200 len: 1308 microversion: 2.1 time: 0.495513 Oct 04 21:59:05.492184 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1667/3379] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:59:04 2022] GET /compute/v2.1/servers/e57b3eb4-9ac6-4f6b-bbe1-a8582bdf543b => generated 1308 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:59:05.520470 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-6ea8ba73-0c09-46e6-90f2-054614362407 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:05.523689 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-6ea8ba73-0c09-46e6-90f2-054614362407 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] [instance: d0b1b757-4a4d-4a7a-9a06-08f178a02984] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:05.537684 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6ea8ba73-0c09-46e6-90f2-054614362407 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:05.543566 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6ea8ba73-0c09-46e6-90f2-054614362407 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:05.544385 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6ea8ba73-0c09-46e6-90f2-054614362407 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:05.546750 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6ea8ba73-0c09-46e6-90f2-054614362407 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:05.553918 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6ea8ba73-0c09-46e6-90f2-054614362407 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:05.554896 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6ea8ba73-0c09-46e6-90f2-054614362407 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:05.664653 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-9b783a46-8ae7-493e-bec9-b49747669575 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2facee4c6a40416e908083e126d2cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07a17a482a4e92b6ddbdee463c8029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:05.679471 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-9b783a46-8ae7-493e-bec9-b49747669575 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d" status: 200 len: 1504 microversion: 2.1 time: 0.627513 Oct 04 21:59:05.683003 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1713/3380] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:59:05 2022] GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d => generated 1504 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:59:05.710048 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-1ae5f455-6d14-4180-9e82-44276d4f0807 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:59:05.713074 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-1ae5f455-6d14-4180-9e82-44276d4f0807 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: dd1b7876-cc6f-4ed3-a0e4-cfe2213b332f] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:05.726413 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1ae5f455-6d14-4180-9e82-44276d4f0807 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:05.737257 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1ae5f455-6d14-4180-9e82-44276d4f0807 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:05.740006 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1ae5f455-6d14-4180-9e82-44276d4f0807 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:05.740934 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1ae5f455-6d14-4180-9e82-44276d4f0807 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:05.744065 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1ae5f455-6d14-4180-9e82-44276d4f0807 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:05.744744 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1ae5f455-6d14-4180-9e82-44276d4f0807 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:05.780823 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-1ae5f455-6d14-4180-9e82-44276d4f0807 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] HTTP exception thrown: Instance dd1b7876-cc6f-4ed3-a0e4-cfe2213b332f could not be found. Oct 04 21:59:05.783617 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-1ae5f455-6d14-4180-9e82-44276d4f0807 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Request method failure captured: Oct 04 21:59:05.783617 n-d-860284-1 devstack@n-api.service[134102]: request: POST /compute/v2.1/servers/dd1b7876-cc6f-4ed3-a0e4-cfe2213b332f/action HTTP/1.1 Oct 04 21:59:05.783617 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 21:59:05.783617 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 21:59:05.783617 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 21:59:05.783617 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 28 Oct 04 21:59:05.783617 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 21:59:05.783617 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 21:59:05.783617 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 21:59:05.783617 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 21:59:05.783617 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPKwu4cpW6hhBuWb-qV_7iYlwjOTpf5XWCl53BJjoosjlcj4wkmmOFzemCJVdBntIx8zJ1SF_z6VrRY8UJr7E8TQDJCRnVQMdNnh0-lZwGdqUzjOWSO31Ryb6n87Cka0g238a21JWok3h3GEhLB-7oCbN3bbcOGmkhd6UFueRxRluk24 Oct 04 21:59:05.783617 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 21:59:05.783617 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 21:59:05.783617 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 21:59:05.783617 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 21:59:05.783617 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 21:59:05.783617 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 21:59:05.783617 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: cf07a17a482a4e92b6ddbdee463c8029 Oct 04 21:59:05.783617 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-ServersNegativeTestJSON-1933663319 Oct 04 21:59:05.783617 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 21:59:05.783617 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 21:59:05.783617 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/cf07a17a482a4e92b6ddbdee463c8029"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_cf07a17a482a4e92b6ddbdee463c8029", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/cf07a17a482a4e92b6ddbdee463c8029"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/cf07a17a482a4e92b6ddbdee463c8029"}]}] Oct 04 21:59:05.783617 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-ServersNegativeTestJSON-1933663319 Oct 04 21:59:05.783617 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: cf07a17a482a4e92b6ddbdee463c8029 Oct 04 21:59:05.783617 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1933663319 Oct 04 21:59:05.783617 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-ServersNegativeTestJSON-1933663319-project Oct 04 21:59:05.783617 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 21:59:05.783617 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 21:59:05.783617 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: 2facee4c6a40416e908083e126d2cfa3 Oct 04 21:59:05.783617 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-ServersNegativeTestJSON-1933663319-project Oct 04 21:59:05.783617 n-d-860284-1 devstack@n-api.service[134102]: Oct 04 21:59:05.783617 n-d-860284-1 devstack@n-api.service[134102]: {"reboot": {"type": "SOFT"}} Oct 04 21:59:05.783617 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 21:59:05.783617 n-d-860284-1 devstack@n-api.service[134102]: exception: Instance dd1b7876-cc6f-4ed3-a0e4-cfe2213b332f could not be found. Oct 04 21:59:05.783617 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': 'dd1b7876-cc6f-4ed3-a0e4-cfe2213b332f', 'body': {'reboot': {'type': 'SOFT'}}} Oct 04 21:59:05.783617 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:59:05.783617 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:59:05.783617 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:59:05.783617 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:59:05.783617 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:59:05.783617 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:59:05.783617 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:59:05.783617 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:59:05.783617 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:59:05.783617 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:59:05.783617 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd1b7876-cc6f-4ed3-a0e4-cfe2213b332f could not be found. Oct 04 21:59:05.783617 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:59:05.783617 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:59:05.783617 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:59:05.783617 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:59:05.783617 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:59:05.783617 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:59:05.783617 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:59:05.783617 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:59:05.783617 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:59:05.783617 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:59:05.783617 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:59:05.783617 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:59:05.783617 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Oct 04 21:59:05.783617 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 04 21:59:05.783617 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:59:05.783617 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:59:05.783617 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:59:05.783617 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:59:05.788731 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd1b7876-cc6f-4ed3-a0e4-cfe2213b332f could not be found. Oct 04 21:59:05.788731 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:59:05.788731 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:59:05.788731 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:59:05.788731 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:59:05.788731 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:59:05.788731 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:59:05.788731 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:59:05.788731 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:59:05.788731 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd1b7876-cc6f-4ed3-a0e4-cfe2213b332f could not be found. Oct 04 21:59:05.788731 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:59:05.791633 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-1ae5f455-6d14-4180-9e82-44276d4f0807 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Returning 404 to user: Instance dd1b7876-cc6f-4ed3-a0e4-cfe2213b332f could not be found. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:59:05.792838 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-1ae5f455-6d14-4180-9e82-44276d4f0807 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "POST /compute/v2.1/servers/dd1b7876-cc6f-4ed3-a0e4-cfe2213b332f/action" status: 404 len: 111 microversion: 2.1 time: 0.087057 Oct 04 21:59:05.793869 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1714/3381] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 21:59:05 2022] POST /compute/v2.1/servers/dd1b7876-cc6f-4ed3-a0e4-cfe2213b332f/action => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 21:59:05.803108 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-2dbd5aa3-4e46-41d2-81ca-b23b416101ad tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:05.803916 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-2dbd5aa3-4e46-41d2-81ca-b23b416101ad tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: a4cf4fac-1e9b-4669-a6ff-30008ed3642d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:05.808506 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-6ea8ba73-0c09-46e6-90f2-054614362407 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:05.810731 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2dbd5aa3-4e46-41d2-81ca-b23b416101ad tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:05.811874 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2dbd5aa3-4e46-41d2-81ca-b23b416101ad tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:05.812313 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2dbd5aa3-4e46-41d2-81ca-b23b416101ad tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:05.813177 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2dbd5aa3-4e46-41d2-81ca-b23b416101ad tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:05.813635 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2dbd5aa3-4e46-41d2-81ca-b23b416101ad tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:05.814241 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2dbd5aa3-4e46-41d2-81ca-b23b416101ad tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:05.831536 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-6ea8ba73-0c09-46e6-90f2-054614362407 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:05.834736 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-6ea8ba73-0c09-46e6-90f2-054614362407 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:05.847179 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-6ea8ba73-0c09-46e6-90f2-054614362407 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] 10.222.0.43 "GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984" status: 200 len: 1553 microversion: 2.91 time: 0.332098 Oct 04 21:59:05.850690 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1668/3382] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:59:05 2022] GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984 => generated 1553 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:59:05.994532 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-2ef1af8d-8796-424f-801b-4e1746bb4e74 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:05.995240 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-2ef1af8d-8796-424f-801b-4e1746bb4e74 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] [instance: 4c17a63b-8492-4c9b-a0c2-34bef7051f80] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:06.009590 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2ef1af8d-8796-424f-801b-4e1746bb4e74 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:06.010481 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2ef1af8d-8796-424f-801b-4e1746bb4e74 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:06.011160 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2ef1af8d-8796-424f-801b-4e1746bb4e74 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:06.012126 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2ef1af8d-8796-424f-801b-4e1746bb4e74 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:06.012799 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2ef1af8d-8796-424f-801b-4e1746bb4e74 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:06.013441 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2ef1af8d-8796-424f-801b-4e1746bb4e74 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:06.215105 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-2ef1af8d-8796-424f-801b-4e1746bb4e74 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c7a1e7d6984644a68d967b5e3fe92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3994b89cac594e309926f1eaf785f7d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:06.231036 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-2ef1af8d-8796-424f-801b-4e1746bb4e74 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] 10.222.0.43 "GET /compute/v2.1/servers/4c17a63b-8492-4c9b-a0c2-34bef7051f80" status: 200 len: 1236 microversion: 2.1 time: 0.240500 Oct 04 21:59:06.234778 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1669/3383] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:59:05 2022] GET /compute/v2.1/servers/4c17a63b-8492-4c9b-a0c2-34bef7051f80 => generated 1236 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:59:06.453338 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-2dbd5aa3-4e46-41d2-81ca-b23b416101ad tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2facee4c6a40416e908083e126d2cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07a17a482a4e92b6ddbdee463c8029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:06.463488 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-2dbd5aa3-4e46-41d2-81ca-b23b416101ad tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d" status: 200 len: 1504 microversion: 2.1 time: 0.664450 Oct 04 21:59:06.482188 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1715/3384] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:59:05 2022] GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d => generated 1504 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:59:06.509421 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-874f4331-3b00-4cb8-bc88-720ecca11ceb tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:06.510608 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-874f4331-3b00-4cb8-bc88-720ecca11ceb tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: a4cf4fac-1e9b-4669-a6ff-30008ed3642d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:06.519529 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-ba2c3c22-390f-442f-8686-b0544cfe4527 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:06.520208 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-ba2c3c22-390f-442f-8686-b0544cfe4527 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] [instance: e57b3eb4-9ac6-4f6b-bbe1-a8582bdf543b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:06.522141 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-874f4331-3b00-4cb8-bc88-720ecca11ceb tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:06.527200 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-874f4331-3b00-4cb8-bc88-720ecca11ceb tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:06.528042 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-874f4331-3b00-4cb8-bc88-720ecca11ceb tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:06.528983 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-874f4331-3b00-4cb8-bc88-720ecca11ceb tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:06.529619 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-874f4331-3b00-4cb8-bc88-720ecca11ceb tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:06.530770 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-874f4331-3b00-4cb8-bc88-720ecca11ceb tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:06.539889 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ba2c3c22-390f-442f-8686-b0544cfe4527 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:06.540548 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ba2c3c22-390f-442f-8686-b0544cfe4527 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:06.541355 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ba2c3c22-390f-442f-8686-b0544cfe4527 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:06.542223 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ba2c3c22-390f-442f-8686-b0544cfe4527 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:06.543229 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ba2c3c22-390f-442f-8686-b0544cfe4527 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:06.543768 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ba2c3c22-390f-442f-8686-b0544cfe4527 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:07.537807 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-874f4331-3b00-4cb8-bc88-720ecca11ceb tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2facee4c6a40416e908083e126d2cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07a17a482a4e92b6ddbdee463c8029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:07.555267 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-874f4331-3b00-4cb8-bc88-720ecca11ceb tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d" status: 200 len: 1504 microversion: 2.1 time: 1.049599 Oct 04 21:59:07.556441 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1670/3385] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:59:06 2022] GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d => generated 1504 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:59:07.561665 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-22daab12-42fc-4836-b871-5b6aaf4e5026 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:07.562526 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-22daab12-42fc-4836-b871-5b6aaf4e5026 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] [instance: d0b1b757-4a4d-4a7a-9a06-08f178a02984] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:07.571236 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-ba2c3c22-390f-442f-8686-b0544cfe4527 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e807c724cc4c3887a2d360f0584ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40071e45805146529fb8abd40629c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:07.577545 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-22daab12-42fc-4836-b871-5b6aaf4e5026 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:07.578042 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-22daab12-42fc-4836-b871-5b6aaf4e5026 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:07.580691 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-22daab12-42fc-4836-b871-5b6aaf4e5026 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:07.585190 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-ba2c3c22-390f-442f-8686-b0544cfe4527 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] 10.222.0.43 "GET /compute/v2.1/servers/e57b3eb4-9ac6-4f6b-bbe1-a8582bdf543b" status: 200 len: 1308 microversion: 2.1 time: 1.070076 Oct 04 21:59:07.585826 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-22daab12-42fc-4836-b871-5b6aaf4e5026 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:07.586324 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-22daab12-42fc-4836-b871-5b6aaf4e5026 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:07.586894 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-22daab12-42fc-4836-b871-5b6aaf4e5026 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:07.590166 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1716/3386] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:59:06 2022] GET /compute/v2.1/servers/e57b3eb4-9ac6-4f6b-bbe1-a8582bdf543b => generated 1308 bytes in 1076 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:59:07.610022 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-2562d294-c48e-4402-9a52-dd72ef92624b tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:07.613531 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-2562d294-c48e-4402-9a52-dd72ef92624b tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] [instance: 4c17a63b-8492-4c9b-a0c2-34bef7051f80] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:07.629905 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2562d294-c48e-4402-9a52-dd72ef92624b tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:07.631192 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2562d294-c48e-4402-9a52-dd72ef92624b tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:07.633661 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2562d294-c48e-4402-9a52-dd72ef92624b tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:07.635025 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2562d294-c48e-4402-9a52-dd72ef92624b tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:07.639083 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2562d294-c48e-4402-9a52-dd72ef92624b tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:07.640772 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2562d294-c48e-4402-9a52-dd72ef92624b tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:07.784206 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-22daab12-42fc-4836-b871-5b6aaf4e5026 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:07.800555 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-22daab12-42fc-4836-b871-5b6aaf4e5026 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:07.802096 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-22daab12-42fc-4836-b871-5b6aaf4e5026 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:07.818823 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-22daab12-42fc-4836-b871-5b6aaf4e5026 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] 10.222.0.43 "GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984" status: 200 len: 1553 microversion: 2.91 time: 0.256586 Oct 04 21:59:07.819531 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1671/3387] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:59:07 2022] GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984 => generated 1553 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:59:07.836794 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-b594f1c9-8064-43bc-b0a7-7dbac2a18908 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:59:07.839234 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-b594f1c9-8064-43bc-b0a7-7dbac2a18908 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: c097e349-fdc6-4ff9-b8a8-dddb4a7a15ec] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:07.851640 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-b594f1c9-8064-43bc-b0a7-7dbac2a18908 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] HTTP exception thrown: Instance c097e349-fdc6-4ff9-b8a8-dddb4a7a15ec could not be found. Oct 04 21:59:07.853257 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-b594f1c9-8064-43bc-b0a7-7dbac2a18908 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Request method failure captured: Oct 04 21:59:07.853257 n-d-860284-1 devstack@n-api.service[134101]: request: POST /compute/v2.1/servers/c097e349-fdc6-4ff9-b8a8-dddb4a7a15ec/action HTTP/1.1 Oct 04 21:59:07.853257 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 21:59:07.853257 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 21:59:07.853257 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 21:59:07.853257 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 28 Oct 04 21:59:07.853257 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 21:59:07.853257 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 21:59:07.853257 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 21:59:07.853257 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 21:59:07.853257 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPKwu4cpW6hhBuWb-qV_7iYlwjOTpf5XWCl53BJjoosjlcj4wkmmOFzemCJVdBntIx8zJ1SF_z6VrRY8UJr7E8TQDJCRnVQMdNnh0-lZwGdqUzjOWSO31Ryb6n87Cka0g238a21JWok3h3GEhLB-7oCbN3bbcOGmkhd6UFueRxRluk24 Oct 04 21:59:07.853257 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 21:59:07.853257 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 21:59:07.853257 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 21:59:07.853257 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 21:59:07.853257 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 21:59:07.853257 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 21:59:07.853257 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: cf07a17a482a4e92b6ddbdee463c8029 Oct 04 21:59:07.853257 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-ServersNegativeTestJSON-1933663319 Oct 04 21:59:07.853257 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 21:59:07.853257 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 21:59:07.853257 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/cf07a17a482a4e92b6ddbdee463c8029"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_cf07a17a482a4e92b6ddbdee463c8029", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/cf07a17a482a4e92b6ddbdee463c8029"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/cf07a17a482a4e92b6ddbdee463c8029"}]}] Oct 04 21:59:07.853257 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-ServersNegativeTestJSON-1933663319 Oct 04 21:59:07.853257 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: cf07a17a482a4e92b6ddbdee463c8029 Oct 04 21:59:07.853257 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1933663319 Oct 04 21:59:07.853257 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-ServersNegativeTestJSON-1933663319-project Oct 04 21:59:07.853257 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 21:59:07.853257 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 21:59:07.853257 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 2facee4c6a40416e908083e126d2cfa3 Oct 04 21:59:07.853257 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-ServersNegativeTestJSON-1933663319-project Oct 04 21:59:07.853257 n-d-860284-1 devstack@n-api.service[134101]: Oct 04 21:59:07.853257 n-d-860284-1 devstack@n-api.service[134101]: {"reboot": {"type": "SOFT"}} Oct 04 21:59:07.853257 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 21:59:07.853257 n-d-860284-1 devstack@n-api.service[134101]: exception: Instance c097e349-fdc6-4ff9-b8a8-dddb4a7a15ec could not be found. Oct 04 21:59:07.853257 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': 'c097e349-fdc6-4ff9-b8a8-dddb4a7a15ec', 'body': {'reboot': {'type': 'SOFT'}}} Oct 04 21:59:07.853257 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:59:07.853257 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:59:07.853257 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:59:07.853257 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:59:07.853257 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:59:07.853257 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:59:07.853257 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 21:59:07.853257 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 21:59:07.853257 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c097e349-fdc6-4ff9-b8a8-dddb4a7a15ec could not be found. Oct 04 21:59:07.853257 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:59:07.853257 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:59:07.853257 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:59:07.853257 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:59:07.853257 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:59:07.853257 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:59:07.853257 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:59:07.853257 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:59:07.853257 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:59:07.853257 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:59:07.853257 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:59:07.853257 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:59:07.853257 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Oct 04 21:59:07.853257 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 04 21:59:07.853257 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:59:07.853257 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:59:07.853257 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:59:07.853257 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:59:07.853257 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c097e349-fdc6-4ff9-b8a8-dddb4a7a15ec could not be found. Oct 04 21:59:07.853257 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:59:07.858545 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:59:07.858545 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:59:07.858545 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:59:07.858545 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:59:07.858545 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:59:07.858545 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:59:07.858545 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:59:07.858545 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c097e349-fdc6-4ff9-b8a8-dddb4a7a15ec could not be found. Oct 04 21:59:07.858545 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:59:07.858545 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-b594f1c9-8064-43bc-b0a7-7dbac2a18908 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Returning 404 to user: Instance c097e349-fdc6-4ff9-b8a8-dddb4a7a15ec could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:59:07.858545 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-b594f1c9-8064-43bc-b0a7-7dbac2a18908 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "POST /compute/v2.1/servers/c097e349-fdc6-4ff9-b8a8-dddb4a7a15ec/action" status: 404 len: 111 microversion: 2.1 time: 0.034180 Oct 04 21:59:07.861225 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1672/3388] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 21:59:07 2022] POST /compute/v2.1/servers/c097e349-fdc6-4ff9-b8a8-dddb4a7a15ec/action => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:59:07.869762 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-3cd39e5a-5473-4be8-bd28-58353a366ce7 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:07.882669 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-3cd39e5a-5473-4be8-bd28-58353a366ce7 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: a4cf4fac-1e9b-4669-a6ff-30008ed3642d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:07.907025 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3cd39e5a-5473-4be8-bd28-58353a366ce7 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:07.907546 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3cd39e5a-5473-4be8-bd28-58353a366ce7 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:07.908003 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3cd39e5a-5473-4be8-bd28-58353a366ce7 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:07.908737 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3cd39e5a-5473-4be8-bd28-58353a366ce7 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:07.909240 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3cd39e5a-5473-4be8-bd28-58353a366ce7 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:07.909781 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3cd39e5a-5473-4be8-bd28-58353a366ce7 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:08.074909 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-2562d294-c48e-4402-9a52-dd72ef92624b tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c7a1e7d6984644a68d967b5e3fe92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3994b89cac594e309926f1eaf785f7d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:08.089485 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-2562d294-c48e-4402-9a52-dd72ef92624b tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] 10.222.0.43 "GET /compute/v2.1/servers/4c17a63b-8492-4c9b-a0c2-34bef7051f80" status: 200 len: 1304 microversion: 2.1 time: 0.495209 Oct 04 21:59:08.109796 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1717/3389] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:59:07 2022] GET /compute/v2.1/servers/4c17a63b-8492-4c9b-a0c2-34bef7051f80 => generated 1304 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:59:08.620166 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-21a4f716-117e-4e8a-a275-a3c1cccbf5c0 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:08.620883 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-21a4f716-117e-4e8a-a275-a3c1cccbf5c0 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] [instance: e57b3eb4-9ac6-4f6b-bbe1-a8582bdf543b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:08.641617 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-21a4f716-117e-4e8a-a275-a3c1cccbf5c0 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:08.642590 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-21a4f716-117e-4e8a-a275-a3c1cccbf5c0 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:08.643937 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-21a4f716-117e-4e8a-a275-a3c1cccbf5c0 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:08.647600 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-21a4f716-117e-4e8a-a275-a3c1cccbf5c0 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:08.650345 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-21a4f716-117e-4e8a-a275-a3c1cccbf5c0 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:08.651092 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-21a4f716-117e-4e8a-a275-a3c1cccbf5c0 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:09.214996 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-3cd39e5a-5473-4be8-bd28-58353a366ce7 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2facee4c6a40416e908083e126d2cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07a17a482a4e92b6ddbdee463c8029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:09.232491 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-3cd39e5a-5473-4be8-bd28-58353a366ce7 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d" status: 200 len: 1504 microversion: 2.1 time: 1.370105 Oct 04 21:59:09.236387 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1673/3390] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:59:07 2022] GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d => generated 1504 bytes in 1374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:59:09.245385 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-11385e84-400e-417b-a9b5-b83ce3aca39e tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:09.246872 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-11385e84-400e-417b-a9b5-b83ce3aca39e tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] [instance: d0b1b757-4a4d-4a7a-9a06-08f178a02984] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:09.264293 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-11385e84-400e-417b-a9b5-b83ce3aca39e tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:09.283919 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-11385e84-400e-417b-a9b5-b83ce3aca39e tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:09.284554 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-11385e84-400e-417b-a9b5-b83ce3aca39e tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:09.285166 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-11385e84-400e-417b-a9b5-b83ce3aca39e tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:09.285634 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-11385e84-400e-417b-a9b5-b83ce3aca39e tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:09.286684 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-11385e84-400e-417b-a9b5-b83ce3aca39e tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:09.511139 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-21a4f716-117e-4e8a-a275-a3c1cccbf5c0 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e807c724cc4c3887a2d360f0584ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40071e45805146529fb8abd40629c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:09.524048 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-21a4f716-117e-4e8a-a275-a3c1cccbf5c0 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] 10.222.0.43 "GET /compute/v2.1/servers/e57b3eb4-9ac6-4f6b-bbe1-a8582bdf543b" status: 200 len: 1488 microversion: 2.1 time: 0.906727 Oct 04 21:59:09.524707 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1718/3391] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:59:08 2022] GET /compute/v2.1/servers/e57b3eb4-9ac6-4f6b-bbe1-a8582bdf543b => generated 1488 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:59:09.538012 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-83b42c42-647e-40e3-b5f5-2b99ca5c05c3 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:09.539054 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-83b42c42-647e-40e3-b5f5-2b99ca5c05c3 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] [instance: 4c17a63b-8492-4c9b-a0c2-34bef7051f80] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:09.558744 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-83b42c42-647e-40e3-b5f5-2b99ca5c05c3 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:09.562298 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-83b42c42-647e-40e3-b5f5-2b99ca5c05c3 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:09.563132 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-83b42c42-647e-40e3-b5f5-2b99ca5c05c3 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:09.566775 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-83b42c42-647e-40e3-b5f5-2b99ca5c05c3 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:09.567456 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-83b42c42-647e-40e3-b5f5-2b99ca5c05c3 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:09.568078 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-83b42c42-647e-40e3-b5f5-2b99ca5c05c3 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:09.684287 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-11385e84-400e-417b-a9b5-b83ce3aca39e tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:09.713450 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-11385e84-400e-417b-a9b5-b83ce3aca39e tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:09.728863 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-11385e84-400e-417b-a9b5-b83ce3aca39e tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:09.787109 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-11385e84-400e-417b-a9b5-b83ce3aca39e tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] 10.222.0.43 "GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984" status: 200 len: 1553 microversion: 2.91 time: 0.543469 Oct 04 21:59:09.826539 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1674/3392] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:59:09 2022] GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984 => generated 1553 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:59:09.832080 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-ea6964e0-e460-4cbc-aa73-51cf9b3c8172 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:09.832984 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-ea6964e0-e460-4cbc-aa73-51cf9b3c8172 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: a4cf4fac-1e9b-4669-a6ff-30008ed3642d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:09.850159 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ea6964e0-e460-4cbc-aa73-51cf9b3c8172 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:09.851001 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ea6964e0-e460-4cbc-aa73-51cf9b3c8172 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:09.851445 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ea6964e0-e460-4cbc-aa73-51cf9b3c8172 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:09.852367 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ea6964e0-e460-4cbc-aa73-51cf9b3c8172 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:09.852831 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ea6964e0-e460-4cbc-aa73-51cf9b3c8172 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:09.853268 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ea6964e0-e460-4cbc-aa73-51cf9b3c8172 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:09.971714 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-83b42c42-647e-40e3-b5f5-2b99ca5c05c3 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c7a1e7d6984644a68d967b5e3fe92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3994b89cac594e309926f1eaf785f7d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:10.009936 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-83b42c42-647e-40e3-b5f5-2b99ca5c05c3 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] 10.222.0.43 "GET /compute/v2.1/servers/4c17a63b-8492-4c9b-a0c2-34bef7051f80" status: 200 len: 1304 microversion: 2.1 time: 0.476965 Oct 04 21:59:10.012031 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1719/3393] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:59:09 2022] GET /compute/v2.1/servers/4c17a63b-8492-4c9b-a0c2-34bef7051f80 => generated 1304 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:59:10.046202 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-35d4f538-44c4-4d14-98aa-aa04e9ba8174 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:59:10.056122 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-35d4f538-44c4-4d14-98aa-aa04e9ba8174 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] [instance: e57b3eb4-9ac6-4f6b-bbe1-a8582bdf543b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:10.066335 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-35d4f538-44c4-4d14-98aa-aa04e9ba8174 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:10.067824 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-35d4f538-44c4-4d14-98aa-aa04e9ba8174 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:10.068842 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-35d4f538-44c4-4d14-98aa-aa04e9ba8174 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:10.070678 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-35d4f538-44c4-4d14-98aa-aa04e9ba8174 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:10.072449 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-35d4f538-44c4-4d14-98aa-aa04e9ba8174 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:10.073460 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-35d4f538-44c4-4d14-98aa-aa04e9ba8174 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:10.118059 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.objects.instance [None req-35d4f538-44c4-4d14-98aa-aa04e9ba8174 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lazy-loading 'flavor' on Instance uuid e57b3eb4-9ac6-4f6b-bbe1-a8582bdf543b {{(pid=134102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:59:10.260626 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-ea6964e0-e460-4cbc-aa73-51cf9b3c8172 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2facee4c6a40416e908083e126d2cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07a17a482a4e92b6ddbdee463c8029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:10.275846 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-ea6964e0-e460-4cbc-aa73-51cf9b3c8172 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d" status: 200 len: 1504 microversion: 2.1 time: 0.446893 Oct 04 21:59:10.276886 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1675/3394] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:59:09 2022] GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d => generated 1504 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:59:10.370889 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-35d4f538-44c4-4d14-98aa-aa04e9ba8174 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] 10.222.0.43 "POST /compute/v2.1/servers/e57b3eb4-9ac6-4f6b-bbe1-a8582bdf543b/action" status: 202 len: 0 microversion: 2.1 time: 0.319895 Oct 04 21:59:10.377466 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1720/3395] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 21:59:10 2022] POST /compute/v2.1/servers/e57b3eb4-9ac6-4f6b-bbe1-a8582bdf543b/action => generated 0 bytes in 360 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:59:10.402081 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-2dcdb90d-5591-485b-aca4-da2d4f0af016 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "58548514-5dac-426c-81f5-19e3fba33e23"}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:59:10.414426 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-2dcdb90d-5591-485b-aca4-da2d4f0af016 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: dd1b7876-cc6f-4ed3-a0e4-cfe2213b332f] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:10.427014 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2dcdb90d-5591-485b-aca4-da2d4f0af016 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:10.428128 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2dcdb90d-5591-485b-aca4-da2d4f0af016 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:10.429761 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2dcdb90d-5591-485b-aca4-da2d4f0af016 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:10.431470 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2dcdb90d-5591-485b-aca4-da2d4f0af016 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:10.432390 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2dcdb90d-5591-485b-aca4-da2d4f0af016 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:10.433042 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2dcdb90d-5591-485b-aca4-da2d4f0af016 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:10.466072 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-2dcdb90d-5591-485b-aca4-da2d4f0af016 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] HTTP exception thrown: Instance dd1b7876-cc6f-4ed3-a0e4-cfe2213b332f could not be found. Oct 04 21:59:10.474007 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-2dcdb90d-5591-485b-aca4-da2d4f0af016 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Request method failure captured: Oct 04 21:59:10.474007 n-d-860284-1 devstack@n-api.service[134102]: request: POST /compute/v2.1/servers/dd1b7876-cc6f-4ed3-a0e4-cfe2213b332f/action HTTP/1.1 Oct 04 21:59:10.474007 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 21:59:10.474007 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 21:59:10.474007 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 21:59:10.474007 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 65 Oct 04 21:59:10.474007 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 21:59:10.474007 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 21:59:10.474007 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 21:59:10.474007 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 21:59:10.474007 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPKwu4cpW6hhBuWb-qV_7iYlwjOTpf5XWCl53BJjoosjlcj4wkmmOFzemCJVdBntIx8zJ1SF_z6VrRY8UJr7E8TQDJCRnVQMdNnh0-lZwGdqUzjOWSO31Ryb6n87Cka0g238a21JWok3h3GEhLB-7oCbN3bbcOGmkhd6UFueRxRluk24 Oct 04 21:59:10.474007 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 21:59:10.474007 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 21:59:10.474007 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 21:59:10.474007 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 21:59:10.474007 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 21:59:10.474007 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 21:59:10.474007 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: cf07a17a482a4e92b6ddbdee463c8029 Oct 04 21:59:10.474007 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-ServersNegativeTestJSON-1933663319 Oct 04 21:59:10.474007 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 21:59:10.474007 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 21:59:10.474007 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/cf07a17a482a4e92b6ddbdee463c8029"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_cf07a17a482a4e92b6ddbdee463c8029", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/cf07a17a482a4e92b6ddbdee463c8029"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/cf07a17a482a4e92b6ddbdee463c8029"}]}] Oct 04 21:59:10.474007 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-ServersNegativeTestJSON-1933663319 Oct 04 21:59:10.474007 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: cf07a17a482a4e92b6ddbdee463c8029 Oct 04 21:59:10.474007 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1933663319 Oct 04 21:59:10.474007 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-ServersNegativeTestJSON-1933663319-project Oct 04 21:59:10.474007 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 21:59:10.474007 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 21:59:10.474007 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: 2facee4c6a40416e908083e126d2cfa3 Oct 04 21:59:10.474007 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-ServersNegativeTestJSON-1933663319-project Oct 04 21:59:10.474007 n-d-860284-1 devstack@n-api.service[134102]: Oct 04 21:59:10.474007 n-d-860284-1 devstack@n-api.service[134102]: {"rebuild": {"imageRef": "58548514-5dac-426c-81f5-19e3fba33e23"}} Oct 04 21:59:10.474007 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 21:59:10.474007 n-d-860284-1 devstack@n-api.service[134102]: exception: Instance dd1b7876-cc6f-4ed3-a0e4-cfe2213b332f could not be found. Oct 04 21:59:10.474007 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': 'dd1b7876-cc6f-4ed3-a0e4-cfe2213b332f', 'body': {'rebuild': {'imageRef': '58548514-5dac-426c-81f5-19e3fba33e23'}}} Oct 04 21:59:10.474007 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:59:10.474007 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:59:10.474007 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:59:10.474007 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:59:10.474007 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:59:10.474007 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:59:10.474007 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:59:10.474007 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:59:10.474007 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:59:10.474007 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:59:10.474007 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd1b7876-cc6f-4ed3-a0e4-cfe2213b332f could not be found. Oct 04 21:59:10.474007 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:59:10.474007 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:59:10.474007 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:59:10.474007 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:59:10.474007 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:59:10.474007 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:59:10.474007 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:59:10.474007 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:59:10.474007 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:59:10.474007 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:59:10.474007 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:59:10.474007 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:59:10.474007 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:59:10.474007 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:59:10.474007 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:59:10.474007 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:59:10.474007 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 04 21:59:10.474007 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Oct 04 21:59:10.479365 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 04 21:59:10.479365 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:59:10.479365 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:59:10.479365 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:59:10.479365 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:59:10.479365 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd1b7876-cc6f-4ed3-a0e4-cfe2213b332f could not be found. Oct 04 21:59:10.479365 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:59:10.479365 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:59:10.479365 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:59:10.479365 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:59:10.479365 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:59:10.479365 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:59:10.479365 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:59:10.479365 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:59:10.479365 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd1b7876-cc6f-4ed3-a0e4-cfe2213b332f could not be found. Oct 04 21:59:10.479365 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:59:10.481415 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-2dcdb90d-5591-485b-aca4-da2d4f0af016 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Returning 404 to user: Instance dd1b7876-cc6f-4ed3-a0e4-cfe2213b332f could not be found. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:59:10.484337 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-2dcdb90d-5591-485b-aca4-da2d4f0af016 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "POST /compute/v2.1/servers/dd1b7876-cc6f-4ed3-a0e4-cfe2213b332f/action" status: 404 len: 111 microversion: 2.1 time: 0.102504 Oct 04 21:59:10.485686 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1721/3396] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 21:59:10 2022] POST /compute/v2.1/servers/dd1b7876-cc6f-4ed3-a0e4-cfe2213b332f/action => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:59:10.496377 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-5d20f758-4ac1-4bf4-a827-51b27bd4aa3e tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:10.497195 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-5d20f758-4ac1-4bf4-a827-51b27bd4aa3e tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] [instance: e57b3eb4-9ac6-4f6b-bbe1-a8582bdf543b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:10.504497 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5d20f758-4ac1-4bf4-a827-51b27bd4aa3e tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:10.505243 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5d20f758-4ac1-4bf4-a827-51b27bd4aa3e tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:10.505878 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5d20f758-4ac1-4bf4-a827-51b27bd4aa3e tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:10.506818 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5d20f758-4ac1-4bf4-a827-51b27bd4aa3e tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:10.507450 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5d20f758-4ac1-4bf4-a827-51b27bd4aa3e tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:10.509409 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5d20f758-4ac1-4bf4-a827-51b27bd4aa3e tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:10.514843 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:59:10.634752 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-91671a6d-c547-422e-a010-1465d5dc5e4c req-ea6eda42-6b9a-418c-b4d9-bbbec6eff9b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c17a63b-8492-4c9b-a0c2-34bef7051f80", "tag": "353bf1c2-20f1-4ba8-8856-cc01db923973"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:59:10.649919 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-91671a6d-c547-422e-a010-1465d5dc5e4c req-ea6eda42-6b9a-418c-b4d9-bbbec6eff9b8 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:10.650728 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-91671a6d-c547-422e-a010-1465d5dc5e4c req-ea6eda42-6b9a-418c-b4d9-bbbec6eff9b8 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:10.651401 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-91671a6d-c547-422e-a010-1465d5dc5e4c req-ea6eda42-6b9a-418c-b4d9-bbbec6eff9b8 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:10.664533 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-91671a6d-c547-422e-a010-1465d5dc5e4c req-ea6eda42-6b9a-418c-b4d9-bbbec6eff9b8 service nova] Creating event network-changed:353bf1c2-20f1-4ba8-8856-cc01db923973 for instance 4c17a63b-8492-4c9b-a0c2-34bef7051f80 on n-h2-860284-1 Oct 04 21:59:10.671407 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-91671a6d-c547-422e-a010-1465d5dc5e4c req-ea6eda42-6b9a-418c-b4d9-bbbec6eff9b8 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.390971 Oct 04 21:59:10.672605 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1676/3397] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:59:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:59:10.678792 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-abf39887-ff9f-4ebb-bcf9-8edaa9c493cf tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:10.679811 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-abf39887-ff9f-4ebb-bcf9-8edaa9c493cf tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: a4cf4fac-1e9b-4669-a6ff-30008ed3642d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:10.688653 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-abf39887-ff9f-4ebb-bcf9-8edaa9c493cf tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:10.689512 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-abf39887-ff9f-4ebb-bcf9-8edaa9c493cf tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:10.690172 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-abf39887-ff9f-4ebb-bcf9-8edaa9c493cf tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:10.691506 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-abf39887-ff9f-4ebb-bcf9-8edaa9c493cf tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:10.692189 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-abf39887-ff9f-4ebb-bcf9-8edaa9c493cf tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:10.692829 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-abf39887-ff9f-4ebb-bcf9-8edaa9c493cf tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:11.084076 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-5d20f758-4ac1-4bf4-a827-51b27bd4aa3e tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e807c724cc4c3887a2d360f0584ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40071e45805146529fb8abd40629c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:11.088039 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell0:SELECT=2 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:59:11.097748 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-5d20f758-4ac1-4bf4-a827-51b27bd4aa3e tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] 10.222.0.43 "GET /compute/v2.1/servers/e57b3eb4-9ac6-4f6b-bbe1-a8582bdf543b" status: 200 len: 1496 microversion: 2.1 time: 0.610701 Oct 04 21:59:11.119889 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1722/3398] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:59:10 2022] GET /compute/v2.1/servers/e57b3eb4-9ac6-4f6b-bbe1-a8582bdf543b => generated 1496 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:59:11.138735 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-7ec10246-6bda-4537-b97b-36b06eda4877 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:11.140097 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-7ec10246-6bda-4537-b97b-36b06eda4877 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] [instance: d0b1b757-4a4d-4a7a-9a06-08f178a02984] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:11.170391 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell0:SELECT=10 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:59:11.178684 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7ec10246-6bda-4537-b97b-36b06eda4877 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:11.180967 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-abf39887-ff9f-4ebb-bcf9-8edaa9c493cf tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2facee4c6a40416e908083e126d2cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07a17a482a4e92b6ddbdee463c8029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:11.183650 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7ec10246-6bda-4537-b97b-36b06eda4877 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:11.184846 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7ec10246-6bda-4537-b97b-36b06eda4877 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:11.187322 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7ec10246-6bda-4537-b97b-36b06eda4877 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:11.191586 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7ec10246-6bda-4537-b97b-36b06eda4877 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:11.193974 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7ec10246-6bda-4537-b97b-36b06eda4877 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:11.197885 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-abf39887-ff9f-4ebb-bcf9-8edaa9c493cf tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d" status: 200 len: 1504 microversion: 2.1 time: 0.521095 Oct 04 21:59:11.202565 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1677/3399] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:59:10 2022] GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d => generated 1504 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:59:11.220215 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-f28fdb8b-232e-43f2-ad51-9d0d457b1fd5 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:11.223383 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-f28fdb8b-232e-43f2-ad51-9d0d457b1fd5 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] [instance: 4c17a63b-8492-4c9b-a0c2-34bef7051f80] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:11.245246 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f28fdb8b-232e-43f2-ad51-9d0d457b1fd5 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:11.247719 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f28fdb8b-232e-43f2-ad51-9d0d457b1fd5 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:11.249135 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f28fdb8b-232e-43f2-ad51-9d0d457b1fd5 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:11.254296 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f28fdb8b-232e-43f2-ad51-9d0d457b1fd5 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:11.257085 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f28fdb8b-232e-43f2-ad51-9d0d457b1fd5 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:11.259245 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f28fdb8b-232e-43f2-ad51-9d0d457b1fd5 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:11.262609 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=100 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:59:11.564814 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-7ec10246-6bda-4537-b97b-36b06eda4877 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:11.576379 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-7ec10246-6bda-4537-b97b-36b06eda4877 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:11.582101 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-7ec10246-6bda-4537-b97b-36b06eda4877 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:11.591724 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-7ec10246-6bda-4537-b97b-36b06eda4877 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] 10.222.0.43 "GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984" status: 200 len: 1553 microversion: 2.91 time: 0.468248 Oct 04 21:59:11.593360 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1723/3400] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:59:11 2022] GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984 => generated 1553 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:59:11.600482 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-a085090c-8b61-4c6c-8a4c-b92e22354098 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:11.601507 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-a085090c-8b61-4c6c-8a4c-b92e22354098 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: a4cf4fac-1e9b-4669-a6ff-30008ed3642d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:11.611960 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a085090c-8b61-4c6c-8a4c-b92e22354098 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:11.612924 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a085090c-8b61-4c6c-8a4c-b92e22354098 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:11.613953 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a085090c-8b61-4c6c-8a4c-b92e22354098 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:11.616234 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a085090c-8b61-4c6c-8a4c-b92e22354098 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:11.617042 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a085090c-8b61-4c6c-8a4c-b92e22354098 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:11.617842 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a085090c-8b61-4c6c-8a4c-b92e22354098 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:11.913474 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=2 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:59:11.986872 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-f28fdb8b-232e-43f2-ad51-9d0d457b1fd5 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c7a1e7d6984644a68d967b5e3fe92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3994b89cac594e309926f1eaf785f7d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:11.995737 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-f28fdb8b-232e-43f2-ad51-9d0d457b1fd5 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] 10.222.0.43 "GET /compute/v2.1/servers/4c17a63b-8492-4c9b-a0c2-34bef7051f80" status: 200 len: 1304 microversion: 2.1 time: 0.790789 Oct 04 21:59:12.015591 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1678/3401] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:59:11 2022] GET /compute/v2.1/servers/4c17a63b-8492-4c9b-a0c2-34bef7051f80 => generated 1304 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:59:12.146267 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-8db41f2f-d57d-42c8-8167-032282ca9383 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:12.146997 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-8db41f2f-d57d-42c8-8167-032282ca9383 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] [instance: e57b3eb4-9ac6-4f6b-bbe1-a8582bdf543b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:12.156799 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8db41f2f-d57d-42c8-8167-032282ca9383 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:12.159969 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-a085090c-8b61-4c6c-8a4c-b92e22354098 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2facee4c6a40416e908083e126d2cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07a17a482a4e92b6ddbdee463c8029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:12.163257 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8db41f2f-d57d-42c8-8167-032282ca9383 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:12.165240 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8db41f2f-d57d-42c8-8167-032282ca9383 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:12.170760 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-a085090c-8b61-4c6c-8a4c-b92e22354098 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d" status: 200 len: 1504 microversion: 2.1 time: 0.574821 Oct 04 21:59:12.171982 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8db41f2f-d57d-42c8-8167-032282ca9383 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:12.172648 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8db41f2f-d57d-42c8-8167-032282ca9383 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:12.173292 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8db41f2f-d57d-42c8-8167-032282ca9383 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:12.177351 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1724/3402] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:59:11 2022] GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d => generated 1504 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:59:12.204746 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-3126633a-caaa-4836-98b8-22fdb30e7550 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "58548514-5dac-426c-81f5-19e3fba33e23"}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:59:12.207612 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-3126633a-caaa-4836-98b8-22fdb30e7550 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: 429cea90-45f0-48e1-9618-46f6d509de47] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:12.224881 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-3126633a-caaa-4836-98b8-22fdb30e7550 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] HTTP exception thrown: Instance 429cea90-45f0-48e1-9618-46f6d509de47 could not be found. Oct 04 21:59:12.228759 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-3126633a-caaa-4836-98b8-22fdb30e7550 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Request method failure captured: Oct 04 21:59:12.228759 n-d-860284-1 devstack@n-api.service[134102]: request: POST /compute/v2.1/servers/429cea90-45f0-48e1-9618-46f6d509de47/action HTTP/1.1 Oct 04 21:59:12.228759 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 21:59:12.228759 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 21:59:12.228759 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 21:59:12.228759 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 65 Oct 04 21:59:12.228759 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 21:59:12.228759 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 21:59:12.228759 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 21:59:12.228759 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 21:59:12.228759 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPKwu4cpW6hhBuWb-qV_7iYlwjOTpf5XWCl53BJjoosjlcj4wkmmOFzemCJVdBntIx8zJ1SF_z6VrRY8UJr7E8TQDJCRnVQMdNnh0-lZwGdqUzjOWSO31Ryb6n87Cka0g238a21JWok3h3GEhLB-7oCbN3bbcOGmkhd6UFueRxRluk24 Oct 04 21:59:12.228759 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 21:59:12.228759 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 21:59:12.228759 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 21:59:12.228759 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 21:59:12.228759 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 21:59:12.228759 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 21:59:12.228759 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: cf07a17a482a4e92b6ddbdee463c8029 Oct 04 21:59:12.228759 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-ServersNegativeTestJSON-1933663319 Oct 04 21:59:12.228759 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 21:59:12.228759 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 21:59:12.228759 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/cf07a17a482a4e92b6ddbdee463c8029"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_cf07a17a482a4e92b6ddbdee463c8029", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/cf07a17a482a4e92b6ddbdee463c8029"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/cf07a17a482a4e92b6ddbdee463c8029"}]}] Oct 04 21:59:12.228759 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-ServersNegativeTestJSON-1933663319 Oct 04 21:59:12.228759 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: cf07a17a482a4e92b6ddbdee463c8029 Oct 04 21:59:12.228759 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1933663319 Oct 04 21:59:12.228759 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-ServersNegativeTestJSON-1933663319-project Oct 04 21:59:12.228759 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 21:59:12.228759 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 21:59:12.228759 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: 2facee4c6a40416e908083e126d2cfa3 Oct 04 21:59:12.228759 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-ServersNegativeTestJSON-1933663319-project Oct 04 21:59:12.228759 n-d-860284-1 devstack@n-api.service[134102]: Oct 04 21:59:12.228759 n-d-860284-1 devstack@n-api.service[134102]: {"rebuild": {"imageRef": "58548514-5dac-426c-81f5-19e3fba33e23"}} Oct 04 21:59:12.228759 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 21:59:12.228759 n-d-860284-1 devstack@n-api.service[134102]: exception: Instance 429cea90-45f0-48e1-9618-46f6d509de47 could not be found. Oct 04 21:59:12.228759 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': '429cea90-45f0-48e1-9618-46f6d509de47', 'body': {'rebuild': {'imageRef': '58548514-5dac-426c-81f5-19e3fba33e23'}}} Oct 04 21:59:12.228759 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:59:12.228759 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:59:12.228759 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:59:12.228759 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:59:12.228759 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:59:12.228759 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:59:12.228759 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 21:59:12.228759 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 21:59:12.228759 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 429cea90-45f0-48e1-9618-46f6d509de47 could not be found. Oct 04 21:59:12.228759 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:59:12.228759 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:59:12.228759 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:59:12.228759 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:59:12.228759 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:59:12.228759 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:59:12.228759 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:59:12.228759 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:59:12.228759 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:59:12.228759 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:59:12.228759 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:59:12.228759 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:59:12.228759 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:59:12.228759 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:59:12.228759 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:59:12.228759 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:59:12.228759 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 04 21:59:12.228759 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Oct 04 21:59:12.228759 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 04 21:59:12.228759 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:59:12.234565 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:59:12.234565 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:59:12.234565 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:59:12.234565 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 429cea90-45f0-48e1-9618-46f6d509de47 could not be found. Oct 04 21:59:12.234565 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:59:12.234565 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:59:12.234565 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:59:12.234565 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:59:12.234565 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:59:12.234565 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:59:12.234565 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:59:12.234565 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:59:12.234565 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 429cea90-45f0-48e1-9618-46f6d509de47 could not be found. Oct 04 21:59:12.234565 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:59:12.234565 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-3126633a-caaa-4836-98b8-22fdb30e7550 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Returning 404 to user: Instance 429cea90-45f0-48e1-9618-46f6d509de47 could not be found. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:59:12.238646 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-3126633a-caaa-4836-98b8-22fdb30e7550 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "POST /compute/v2.1/servers/429cea90-45f0-48e1-9618-46f6d509de47/action" status: 404 len: 111 microversion: 2.1 time: 0.030648 Oct 04 21:59:12.239647 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1725/3403] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 21:59:12 2022] POST /compute/v2.1/servers/429cea90-45f0-48e1-9618-46f6d509de47/action => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 21:59:12.249585 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-208762a1-fa78-48f4-b040-26f5febc5f1d tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:12.250215 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-208762a1-fa78-48f4-b040-26f5febc5f1d tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: a4cf4fac-1e9b-4669-a6ff-30008ed3642d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:12.279481 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-208762a1-fa78-48f4-b040-26f5febc5f1d tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:12.281036 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-208762a1-fa78-48f4-b040-26f5febc5f1d tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:12.282015 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-208762a1-fa78-48f4-b040-26f5febc5f1d tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:12.283353 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-208762a1-fa78-48f4-b040-26f5febc5f1d tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:12.284143 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-208762a1-fa78-48f4-b040-26f5febc5f1d tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:12.284909 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-208762a1-fa78-48f4-b040-26f5febc5f1d tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:12.966465 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-8db41f2f-d57d-42c8-8167-032282ca9383 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e807c724cc4c3887a2d360f0584ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40071e45805146529fb8abd40629c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:12.976866 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-8db41f2f-d57d-42c8-8167-032282ca9383 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] 10.222.0.43 "GET /compute/v2.1/servers/e57b3eb4-9ac6-4f6b-bbe1-a8582bdf543b" status: 200 len: 1479 microversion: 2.1 time: 0.835140 Oct 04 21:59:12.987972 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1679/3404] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:59:12 2022] GET /compute/v2.1/servers/e57b3eb4-9ac6-4f6b-bbe1-a8582bdf543b => generated 1479 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:59:13.003614 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-dbdc4644-eec8-4072-935f-ad2adefb65b5 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:13.013371 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-dbdc4644-eec8-4072-935f-ad2adefb65b5 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] [instance: d0b1b757-4a4d-4a7a-9a06-08f178a02984] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:13.049399 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dbdc4644-eec8-4072-935f-ad2adefb65b5 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:13.055872 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dbdc4644-eec8-4072-935f-ad2adefb65b5 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:13.059624 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dbdc4644-eec8-4072-935f-ad2adefb65b5 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:13.065975 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dbdc4644-eec8-4072-935f-ad2adefb65b5 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:13.070802 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dbdc4644-eec8-4072-935f-ad2adefb65b5 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:13.073940 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dbdc4644-eec8-4072-935f-ad2adefb65b5 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:13.233270 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-208762a1-fa78-48f4-b040-26f5febc5f1d tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2facee4c6a40416e908083e126d2cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07a17a482a4e92b6ddbdee463c8029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:13.247131 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-208762a1-fa78-48f4-b040-26f5febc5f1d tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d" status: 200 len: 1504 microversion: 2.1 time: 1.000519 Oct 04 21:59:13.249416 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1726/3405] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:59:12 2022] GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d => generated 1504 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:59:13.283462 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-ea41c42a-1bee-4add-91c1-2a5877b65d25 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1370160117"}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:59:13.288223 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-ea41c42a-1bee-4add-91c1-2a5877b65d25 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] [instance: e57b3eb4-9ac6-4f6b-bbe1-a8582bdf543b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:13.310990 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ea41c42a-1bee-4add-91c1-2a5877b65d25 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:13.311799 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ea41c42a-1bee-4add-91c1-2a5877b65d25 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:13.313246 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ea41c42a-1bee-4add-91c1-2a5877b65d25 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:13.314244 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ea41c42a-1bee-4add-91c1-2a5877b65d25 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:13.315057 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ea41c42a-1bee-4add-91c1-2a5877b65d25 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:13.315799 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ea41c42a-1bee-4add-91c1-2a5877b65d25 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:13.349426 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-dbdc4644-eec8-4072-935f-ad2adefb65b5 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:13.363590 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-dbdc4644-eec8-4072-935f-ad2adefb65b5 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:13.365076 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-dbdc4644-eec8-4072-935f-ad2adefb65b5 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:13.387656 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-dbdc4644-eec8-4072-935f-ad2adefb65b5 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] 10.222.0.43 "GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984" status: 200 len: 1553 microversion: 2.91 time: 0.396292 Oct 04 21:59:13.388268 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1680/3406] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:59:12 2022] GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984 => generated 1553 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:59:13.414526 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-08e35700-e19b-4bb5-9ccf-4c11e0216e19 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:13.419614 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-08e35700-e19b-4bb5-9ccf-4c11e0216e19 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] [instance: 4c17a63b-8492-4c9b-a0c2-34bef7051f80] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:13.432023 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-08e35700-e19b-4bb5-9ccf-4c11e0216e19 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:13.434393 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-08e35700-e19b-4bb5-9ccf-4c11e0216e19 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:13.435202 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-08e35700-e19b-4bb5-9ccf-4c11e0216e19 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:13.439081 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-08e35700-e19b-4bb5-9ccf-4c11e0216e19 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:13.439857 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-08e35700-e19b-4bb5-9ccf-4c11e0216e19 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:13.441116 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-08e35700-e19b-4bb5-9ccf-4c11e0216e19 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:13.807357 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-ea41c42a-1bee-4add-91c1-2a5877b65d25 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] 10.222.0.43 "POST /compute/v2.1/servers/e57b3eb4-9ac6-4f6b-bbe1-a8582bdf543b/action" status: 202 len: 0 microversion: 2.1 time: 0.556087 Oct 04 21:59:13.810216 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1727/3407] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 21:59:13 2022] POST /compute/v2.1/servers/e57b3eb4-9ac6-4f6b-bbe1-a8582bdf543b/action => generated 0 bytes in 560 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 04 21:59:13.825480 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-ea6bcaa6-d5ee-4ad0-ae4f-26ff279c67c6 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:13.826906 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-ea6bcaa6-d5ee-4ad0-ae4f-26ff279c67c6 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: a4cf4fac-1e9b-4669-a6ff-30008ed3642d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:13.847467 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ea6bcaa6-d5ee-4ad0-ae4f-26ff279c67c6 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:13.847968 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ea6bcaa6-d5ee-4ad0-ae4f-26ff279c67c6 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:13.849403 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ea6bcaa6-d5ee-4ad0-ae4f-26ff279c67c6 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:13.850215 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ea6bcaa6-d5ee-4ad0-ae4f-26ff279c67c6 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:13.850728 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ea6bcaa6-d5ee-4ad0-ae4f-26ff279c67c6 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:13.851350 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ea6bcaa6-d5ee-4ad0-ae4f-26ff279c67c6 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:14.220328 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-08e35700-e19b-4bb5-9ccf-4c11e0216e19 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c7a1e7d6984644a68d967b5e3fe92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3994b89cac594e309926f1eaf785f7d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:14.237472 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-08e35700-e19b-4bb5-9ccf-4c11e0216e19 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] 10.222.0.43 "GET /compute/v2.1/servers/4c17a63b-8492-4c9b-a0c2-34bef7051f80" status: 200 len: 1304 microversion: 2.1 time: 0.840492 Oct 04 21:59:14.241773 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1681/3408] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:59:13 2022] GET /compute/v2.1/servers/4c17a63b-8492-4c9b-a0c2-34bef7051f80 => generated 1304 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:59:14.254925 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-d00642b5-84f4-42d2-ab7b-30db9ed9ec0a tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Calling method '.version_select at 0x7fbb2ee551f0>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:14.340429 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-d00642b5-84f4-42d2-ab7b-30db9ed9ec0a tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] 10.222.0.43 "GET /compute/v2.1/images/a67847c0-608b-45c9-a5ac-a6e6f0e06b3a" status: 200 len: 1436 microversion: 2.1 time: 0.095968 Oct 04 21:59:14.354599 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1682/3409] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:59:14 2022] GET /compute/v2.1/images/a67847c0-608b-45c9-a5ac-a6e6f0e06b3a => generated 1436 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:59:14.435364 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-79fc45ac-8724-4b2e-b8e9-7420a3889489 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:14.437080 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-79fc45ac-8724-4b2e-b8e9-7420a3889489 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] [instance: d0b1b757-4a4d-4a7a-9a06-08f178a02984] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:14.445391 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-79fc45ac-8724-4b2e-b8e9-7420a3889489 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:14.446654 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-79fc45ac-8724-4b2e-b8e9-7420a3889489 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:14.447286 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-79fc45ac-8724-4b2e-b8e9-7420a3889489 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:14.448218 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-79fc45ac-8724-4b2e-b8e9-7420a3889489 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:14.452326 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-79fc45ac-8724-4b2e-b8e9-7420a3889489 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:14.452991 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-79fc45ac-8724-4b2e-b8e9-7420a3889489 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:14.768730 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-79fc45ac-8724-4b2e-b8e9-7420a3889489 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:14.837732 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-79fc45ac-8724-4b2e-b8e9-7420a3889489 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:14.845335 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-79fc45ac-8724-4b2e-b8e9-7420a3889489 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:14.851843 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-79fc45ac-8724-4b2e-b8e9-7420a3889489 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] 10.222.0.43 "GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984" status: 200 len: 1553 microversion: 2.91 time: 0.433772 Oct 04 21:59:14.854121 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1683/3410] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:59:14 2022] GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984 => generated 1553 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:59:15.025296 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-ea6bcaa6-d5ee-4ad0-ae4f-26ff279c67c6 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2facee4c6a40416e908083e126d2cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07a17a482a4e92b6ddbdee463c8029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:15.034433 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-ea6bcaa6-d5ee-4ad0-ae4f-26ff279c67c6 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d" status: 200 len: 1504 microversion: 2.1 time: 1.222690 Oct 04 21:59:15.038511 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1728/3411] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:59:13 2022] GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d => generated 1504 bytes in 1228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:59:15.072921 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-821aaedc-e517-4934-9ecb-c4182aa68921 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:59:15.073477 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-821aaedc-e517-4934-9ecb-c4182aa68921 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: 6df92fa6-f621-43ef-9804-8674c4b4e414] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:15.081049 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-821aaedc-e517-4934-9ecb-c4182aa68921 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] HTTP exception thrown: Instance 6df92fa6-f621-43ef-9804-8674c4b4e414 could not be found. Oct 04 21:59:15.083309 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-821aaedc-e517-4934-9ecb-c4182aa68921 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Request method failure captured: Oct 04 21:59:15.083309 n-d-860284-1 devstack@n-api.service[134101]: request: POST /compute/v2.1/servers/6df92fa6-f621-43ef-9804-8674c4b4e414/action HTTP/1.1 Oct 04 21:59:15.083309 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 21:59:15.083309 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 21:59:15.083309 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 21:59:15.083309 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 15 Oct 04 21:59:15.083309 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 21:59:15.083309 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 21:59:15.083309 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 21:59:15.083309 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 21:59:15.083309 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPKwu4cpW6hhBuWb-qV_7iYlwjOTpf5XWCl53BJjoosjlcj4wkmmOFzemCJVdBntIx8zJ1SF_z6VrRY8UJr7E8TQDJCRnVQMdNnh0-lZwGdqUzjOWSO31Ryb6n87Cka0g238a21JWok3h3GEhLB-7oCbN3bbcOGmkhd6UFueRxRluk24 Oct 04 21:59:15.083309 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 21:59:15.083309 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 21:59:15.083309 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 21:59:15.083309 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 21:59:15.083309 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 21:59:15.083309 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 21:59:15.083309 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: cf07a17a482a4e92b6ddbdee463c8029 Oct 04 21:59:15.083309 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-ServersNegativeTestJSON-1933663319 Oct 04 21:59:15.083309 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 21:59:15.083309 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 21:59:15.083309 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/cf07a17a482a4e92b6ddbdee463c8029"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_cf07a17a482a4e92b6ddbdee463c8029", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/cf07a17a482a4e92b6ddbdee463c8029"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/cf07a17a482a4e92b6ddbdee463c8029"}]}] Oct 04 21:59:15.083309 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-ServersNegativeTestJSON-1933663319 Oct 04 21:59:15.083309 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: cf07a17a482a4e92b6ddbdee463c8029 Oct 04 21:59:15.083309 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1933663319 Oct 04 21:59:15.083309 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-ServersNegativeTestJSON-1933663319-project Oct 04 21:59:15.083309 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 21:59:15.083309 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 21:59:15.083309 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 2facee4c6a40416e908083e126d2cfa3 Oct 04 21:59:15.083309 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-ServersNegativeTestJSON-1933663319-project Oct 04 21:59:15.083309 n-d-860284-1 devstack@n-api.service[134101]: Oct 04 21:59:15.083309 n-d-860284-1 devstack@n-api.service[134101]: {"restore": {}} Oct 04 21:59:15.083309 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 21:59:15.083309 n-d-860284-1 devstack@n-api.service[134101]: exception: Instance 6df92fa6-f621-43ef-9804-8674c4b4e414 could not be found. Oct 04 21:59:15.083309 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': '6df92fa6-f621-43ef-9804-8674c4b4e414', 'body': {'restore': {}}} Oct 04 21:59:15.083309 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:59:15.083309 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:59:15.083309 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:59:15.083309 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:59:15.083309 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:59:15.083309 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:59:15.083309 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 21:59:15.083309 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 21:59:15.083309 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6df92fa6-f621-43ef-9804-8674c4b4e414 could not be found. Oct 04 21:59:15.083309 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:59:15.083309 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:59:15.083309 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:59:15.083309 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:59:15.083309 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:59:15.083309 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:59:15.083309 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:59:15.083309 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:59:15.083309 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:59:15.083309 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:59:15.083309 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 38, in _restore Oct 04 21:59:15.083309 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 04 21:59:15.083309 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:59:15.083309 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:59:15.083309 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6df92fa6-f621-43ef-9804-8674c4b4e414 could not be found. Oct 04 21:59:15.083309 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:59:15.083309 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:59:15.083309 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:59:15.083309 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:59:15.083309 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:59:15.083309 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:59:15.087891 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:59:15.087891 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:59:15.087891 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6df92fa6-f621-43ef-9804-8674c4b4e414 could not be found. Oct 04 21:59:15.087891 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:59:15.087891 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-821aaedc-e517-4934-9ecb-c4182aa68921 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Returning 404 to user: Instance 6df92fa6-f621-43ef-9804-8674c4b4e414 could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:59:15.087891 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-821aaedc-e517-4934-9ecb-c4182aa68921 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "POST /compute/v2.1/servers/6df92fa6-f621-43ef-9804-8674c4b4e414/action" status: 404 len: 111 microversion: 2.1 time: 0.019056 Oct 04 21:59:15.099444 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-775ae192-2d16-4498-b39d-fd90c052f533 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:15.099986 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1684/3412] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 21:59:15 2022] POST /compute/v2.1/servers/6df92fa6-f621-43ef-9804-8674c4b4e414/action => generated 111 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:59:15.101436 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-775ae192-2d16-4498-b39d-fd90c052f533 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: a4cf4fac-1e9b-4669-a6ff-30008ed3642d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:15.114632 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-775ae192-2d16-4498-b39d-fd90c052f533 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:15.115124 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-775ae192-2d16-4498-b39d-fd90c052f533 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:15.115575 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-775ae192-2d16-4498-b39d-fd90c052f533 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:15.116298 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-775ae192-2d16-4498-b39d-fd90c052f533 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:15.116761 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-775ae192-2d16-4498-b39d-fd90c052f533 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:15.117192 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-775ae192-2d16-4498-b39d-fd90c052f533 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:15.268963 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-6fce89a7-5a4f-4723-bf88-b53aa046c9eb tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:15.269792 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-6fce89a7-5a4f-4723-bf88-b53aa046c9eb tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] [instance: 4c17a63b-8492-4c9b-a0c2-34bef7051f80] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:15.304477 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6fce89a7-5a4f-4723-bf88-b53aa046c9eb tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:15.305314 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6fce89a7-5a4f-4723-bf88-b53aa046c9eb tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:15.306068 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6fce89a7-5a4f-4723-bf88-b53aa046c9eb tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:15.307398 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6fce89a7-5a4f-4723-bf88-b53aa046c9eb tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:15.328693 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6fce89a7-5a4f-4723-bf88-b53aa046c9eb tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:15.333924 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6fce89a7-5a4f-4723-bf88-b53aa046c9eb tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:16.103813 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-775ae192-2d16-4498-b39d-fd90c052f533 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2facee4c6a40416e908083e126d2cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07a17a482a4e92b6ddbdee463c8029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:16.141177 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-775ae192-2d16-4498-b39d-fd90c052f533 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d" status: 200 len: 1504 microversion: 2.1 time: 1.050298 Oct 04 21:59:16.145218 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1729/3413] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:59:15 2022] GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d => generated 1504 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:59:16.163501 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-4af098f0-28ce-4e21-9975-d2086e69507c tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Calling method '.version_select at 0x7fbb2e779670>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:16.262573 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-6fce89a7-5a4f-4723-bf88-b53aa046c9eb tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c7a1e7d6984644a68d967b5e3fe92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3994b89cac594e309926f1eaf785f7d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:16.265924 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-4af098f0-28ce-4e21-9975-d2086e69507c tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] 10.222.0.43 "GET /compute/v2.1/images/a67847c0-608b-45c9-a5ac-a6e6f0e06b3a" status: 200 len: 1436 microversion: 2.1 time: 0.118213 Oct 04 21:59:16.274715 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-6fce89a7-5a4f-4723-bf88-b53aa046c9eb tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] 10.222.0.43 "GET /compute/v2.1/servers/4c17a63b-8492-4c9b-a0c2-34bef7051f80" status: 200 len: 1304 microversion: 2.1 time: 1.012259 Oct 04 21:59:16.276133 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1730/3414] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:59:16 2022] GET /compute/v2.1/images/a67847c0-608b-45c9-a5ac-a6e6f0e06b3a => generated 1436 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:59:16.282721 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-608a2003-3554-4dae-a113-bded09e02c54 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:16.283856 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-608a2003-3554-4dae-a113-bded09e02c54 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] [instance: d0b1b757-4a4d-4a7a-9a06-08f178a02984] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:16.291669 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-608a2003-3554-4dae-a113-bded09e02c54 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:16.292583 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-608a2003-3554-4dae-a113-bded09e02c54 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:16.293463 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-608a2003-3554-4dae-a113-bded09e02c54 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:16.295071 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-608a2003-3554-4dae-a113-bded09e02c54 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:16.296508 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1685/3415] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:59:15 2022] GET /compute/v2.1/servers/4c17a63b-8492-4c9b-a0c2-34bef7051f80 => generated 1304 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:59:16.297245 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-608a2003-3554-4dae-a113-bded09e02c54 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:16.298056 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-608a2003-3554-4dae-a113-bded09e02c54 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:16.306576 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-6c68d9c6-1d7f-4f5d-a882-38d83a9ec719 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:16.307554 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-6c68d9c6-1d7f-4f5d-a882-38d83a9ec719 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: a4cf4fac-1e9b-4669-a6ff-30008ed3642d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:16.317459 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6c68d9c6-1d7f-4f5d-a882-38d83a9ec719 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:16.320634 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6c68d9c6-1d7f-4f5d-a882-38d83a9ec719 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:16.323051 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6c68d9c6-1d7f-4f5d-a882-38d83a9ec719 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:16.323835 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6c68d9c6-1d7f-4f5d-a882-38d83a9ec719 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:16.324322 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6c68d9c6-1d7f-4f5d-a882-38d83a9ec719 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:16.324769 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6c68d9c6-1d7f-4f5d-a882-38d83a9ec719 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:16.412988 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-608a2003-3554-4dae-a113-bded09e02c54 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:16.428725 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-608a2003-3554-4dae-a113-bded09e02c54 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:16.430464 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-608a2003-3554-4dae-a113-bded09e02c54 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:16.446934 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-608a2003-3554-4dae-a113-bded09e02c54 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] 10.222.0.43 "GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984" status: 200 len: 1553 microversion: 2.91 time: 0.168816 Oct 04 21:59:16.447913 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1731/3416] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:59:16 2022] GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984 => generated 1553 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:59:16.737348 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-6c68d9c6-1d7f-4f5d-a882-38d83a9ec719 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2facee4c6a40416e908083e126d2cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07a17a482a4e92b6ddbdee463c8029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:16.746713 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-6c68d9c6-1d7f-4f5d-a882-38d83a9ec719 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d" status: 200 len: 1504 microversion: 2.1 time: 0.448845 Oct 04 21:59:16.747972 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1686/3417] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:59:16 2022] GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d => generated 1504 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:59:16.774559 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-ccdd27b7-32e7-4207-9270-9632dbbfcc98 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:59:16.783702 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-ccdd27b7-32e7-4207-9270-9632dbbfcc98 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: a4cf4fac-1e9b-4669-a6ff-30008ed3642d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:16.799048 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ccdd27b7-32e7-4207-9270-9632dbbfcc98 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:16.802106 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ccdd27b7-32e7-4207-9270-9632dbbfcc98 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:16.804130 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ccdd27b7-32e7-4207-9270-9632dbbfcc98 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:16.805141 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ccdd27b7-32e7-4207-9270-9632dbbfcc98 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:16.807248 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ccdd27b7-32e7-4207-9270-9632dbbfcc98 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:16.809055 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ccdd27b7-32e7-4207-9270-9632dbbfcc98 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:16.880582 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-ccdd27b7-32e7-4207-9270-9632dbbfcc98 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] HTTP exception thrown: Cannot 'restore' instance a4cf4fac-1e9b-4669-a6ff-30008ed3642d while it is in vm_state active Oct 04 21:59:16.882512 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-ccdd27b7-32e7-4207-9270-9632dbbfcc98 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Request method failure captured: Oct 04 21:59:16.882512 n-d-860284-1 devstack@n-api.service[134102]: request: POST /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d/action HTTP/1.1 Oct 04 21:59:16.882512 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 21:59:16.882512 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 21:59:16.882512 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 21:59:16.882512 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 15 Oct 04 21:59:16.882512 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 21:59:16.882512 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 21:59:16.882512 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 21:59:16.882512 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 21:59:16.882512 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPKwu4cpW6hhBuWb-qV_7iYlwjOTpf5XWCl53BJjoosjlcj4wkmmOFzemCJVdBntIx8zJ1SF_z6VrRY8UJr7E8TQDJCRnVQMdNnh0-lZwGdqUzjOWSO31Ryb6n87Cka0g238a21JWok3h3GEhLB-7oCbN3bbcOGmkhd6UFueRxRluk24 Oct 04 21:59:16.882512 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 21:59:16.882512 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 21:59:16.882512 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 21:59:16.882512 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 21:59:16.882512 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 21:59:16.882512 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 21:59:16.882512 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: cf07a17a482a4e92b6ddbdee463c8029 Oct 04 21:59:16.882512 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-ServersNegativeTestJSON-1933663319 Oct 04 21:59:16.882512 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 21:59:16.882512 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 21:59:16.882512 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/cf07a17a482a4e92b6ddbdee463c8029"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_cf07a17a482a4e92b6ddbdee463c8029", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/cf07a17a482a4e92b6ddbdee463c8029"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/cf07a17a482a4e92b6ddbdee463c8029"}]}] Oct 04 21:59:16.882512 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-ServersNegativeTestJSON-1933663319 Oct 04 21:59:16.882512 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: cf07a17a482a4e92b6ddbdee463c8029 Oct 04 21:59:16.882512 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1933663319 Oct 04 21:59:16.882512 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-ServersNegativeTestJSON-1933663319-project Oct 04 21:59:16.882512 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 21:59:16.882512 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 21:59:16.882512 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: 2facee4c6a40416e908083e126d2cfa3 Oct 04 21:59:16.882512 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-ServersNegativeTestJSON-1933663319-project Oct 04 21:59:16.882512 n-d-860284-1 devstack@n-api.service[134102]: Oct 04 21:59:16.882512 n-d-860284-1 devstack@n-api.service[134102]: {"restore": {}} Oct 04 21:59:16.882512 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 21:59:16.882512 n-d-860284-1 devstack@n-api.service[134102]: exception: Cannot 'restore' instance a4cf4fac-1e9b-4669-a6ff-30008ed3642d while it is in vm_state active Oct 04 21:59:16.882512 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': 'a4cf4fac-1e9b-4669-a6ff-30008ed3642d', 'body': {'restore': {}}} Oct 04 21:59:16.882512 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:59:16.882512 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:59:16.882512 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 42, in _restore Oct 04 21:59:16.882512 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi self.compute_api.restore(context, instance) Oct 04 21:59:16.882512 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 21:59:16.882512 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 21:59:16.882512 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 04 21:59:16.882512 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 04 21:59:16.882512 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance a4cf4fac-1e9b-4669-a6ff-30008ed3642d in vm_state active. Cannot restore while the instance is in this state. Oct 04 21:59:16.882512 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:59:16.882512 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:59:16.882512 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:59:16.882512 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:59:16.882512 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:59:16.882512 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:59:16.882512 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:59:16.882512 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:59:16.882512 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:59:16.882512 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:59:16.882512 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 46, in _restore Oct 04 21:59:16.882512 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 04 21:59:16.882512 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 04 21:59:16.882512 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 21:59:16.882512 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'restore' instance a4cf4fac-1e9b-4669-a6ff-30008ed3642d while it is in vm_state active Oct 04 21:59:16.882512 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:59:16.882512 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:59:16.882512 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:59:16.882512 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:59:16.882512 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:59:16.886950 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:59:16.886950 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:59:16.886950 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:59:16.886950 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'restore' instance a4cf4fac-1e9b-4669-a6ff-30008ed3642d while it is in vm_state active Oct 04 21:59:16.886950 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:59:16.886950 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-ccdd27b7-32e7-4207-9270-9632dbbfcc98 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Returning 409 to user: Cannot 'restore' instance a4cf4fac-1e9b-4669-a6ff-30008ed3642d while it is in vm_state active {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:59:16.886950 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-ccdd27b7-32e7-4207-9270-9632dbbfcc98 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "POST /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d/action" status: 409 len: 145 microversion: 2.1 time: 0.114532 Oct 04 21:59:16.893954 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-a55f1dde-b68a-4737-b6b3-b2849db719b3 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:16.894742 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-a55f1dde-b68a-4737-b6b3-b2849db719b3 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: a4cf4fac-1e9b-4669-a6ff-30008ed3642d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:16.895764 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1732/3418] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 21:59:16 2022] POST /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d/action => generated 145 bytes in 126 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 21:59:16.910315 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a55f1dde-b68a-4737-b6b3-b2849db719b3 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:16.911004 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a55f1dde-b68a-4737-b6b3-b2849db719b3 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:16.911589 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a55f1dde-b68a-4737-b6b3-b2849db719b3 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:16.912436 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a55f1dde-b68a-4737-b6b3-b2849db719b3 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:16.913022 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a55f1dde-b68a-4737-b6b3-b2849db719b3 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:16.913550 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a55f1dde-b68a-4737-b6b3-b2849db719b3 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:17.230578 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-a55f1dde-b68a-4737-b6b3-b2849db719b3 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2facee4c6a40416e908083e126d2cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07a17a482a4e92b6ddbdee463c8029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:17.244375 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-a55f1dde-b68a-4737-b6b3-b2849db719b3 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d" status: 200 len: 1504 microversion: 2.1 time: 0.354675 Oct 04 21:59:17.245716 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1687/3419] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:59:16 2022] GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d => generated 1504 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:59:17.273198 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-c1dbbe47-cc63-4d96-91d5-d50f14c000bc tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:17.274766 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-c1dbbe47-cc63-4d96-91d5-d50f14c000bc tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: a4cf4fac-1e9b-4669-a6ff-30008ed3642d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:17.284463 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-9ada0ed1-fc94-456c-b8fa-b987fc683a99 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Calling method '.version_select at 0x7fbb2ef468b0>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:17.286094 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:59:17.287834 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c1dbbe47-cc63-4d96-91d5-d50f14c000bc tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:17.291345 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c1dbbe47-cc63-4d96-91d5-d50f14c000bc tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:17.292040 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c1dbbe47-cc63-4d96-91d5-d50f14c000bc tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:17.295009 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c1dbbe47-cc63-4d96-91d5-d50f14c000bc tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:17.295885 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c1dbbe47-cc63-4d96-91d5-d50f14c000bc tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:17.300743 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c1dbbe47-cc63-4d96-91d5-d50f14c000bc tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:17.644821 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-9ada0ed1-fc94-456c-b8fa-b987fc683a99 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] 10.222.0.43 "GET /compute/v2.1/images/a67847c0-608b-45c9-a5ac-a6e6f0e06b3a" status: 200 len: 1436 microversion: 2.1 time: 0.366562 Oct 04 21:59:17.646069 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1688/3420] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:59:17 2022] GET /compute/v2.1/images/a67847c0-608b-45c9-a5ac-a6e6f0e06b3a => generated 1436 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:59:17.661891 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-a2c9d4ab-a8b4-4da8-8823-dd98b05a19e9 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:17.662625 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-a2c9d4ab-a8b4-4da8-8823-dd98b05a19e9 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] [instance: 4c17a63b-8492-4c9b-a0c2-34bef7051f80] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:17.680685 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a2c9d4ab-a8b4-4da8-8823-dd98b05a19e9 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:17.683113 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a2c9d4ab-a8b4-4da8-8823-dd98b05a19e9 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:17.689606 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a2c9d4ab-a8b4-4da8-8823-dd98b05a19e9 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:17.690405 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a2c9d4ab-a8b4-4da8-8823-dd98b05a19e9 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:17.690889 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a2c9d4ab-a8b4-4da8-8823-dd98b05a19e9 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:17.691340 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a2c9d4ab-a8b4-4da8-8823-dd98b05a19e9 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:17.880226 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-c1dbbe47-cc63-4d96-91d5-d50f14c000bc tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2facee4c6a40416e908083e126d2cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07a17a482a4e92b6ddbdee463c8029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:17.891080 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-c1dbbe47-cc63-4d96-91d5-d50f14c000bc tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d" status: 200 len: 1504 microversion: 2.1 time: 0.621674 Oct 04 21:59:17.892182 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1733/3421] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:59:17 2022] GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d => generated 1504 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:59:17.897166 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-628b1422-1d54-4447-859c-2428dd16446f tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:17.897779 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-628b1422-1d54-4447-859c-2428dd16446f tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] [instance: d0b1b757-4a4d-4a7a-9a06-08f178a02984] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:17.904151 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-628b1422-1d54-4447-859c-2428dd16446f tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:17.904922 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-628b1422-1d54-4447-859c-2428dd16446f tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:17.905542 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-628b1422-1d54-4447-859c-2428dd16446f tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:17.906512 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-628b1422-1d54-4447-859c-2428dd16446f tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:17.907209 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-628b1422-1d54-4447-859c-2428dd16446f tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:17.907877 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-628b1422-1d54-4447-859c-2428dd16446f tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:18.124678 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-628b1422-1d54-4447-859c-2428dd16446f tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:18.137678 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-628b1422-1d54-4447-859c-2428dd16446f tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:18.141976 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-628b1422-1d54-4447-859c-2428dd16446f tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:18.153301 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-628b1422-1d54-4447-859c-2428dd16446f tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] 10.222.0.43 "GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984" status: 200 len: 1553 microversion: 2.91 time: 0.259792 Oct 04 21:59:18.154233 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1734/3422] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:59:17 2022] GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984 => generated 1553 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:59:18.162578 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-40317d4e-b0d1-47a2-be71-e8dea4d6ed25 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:59:18.175265 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-40317d4e-b0d1-47a2-be71-e8dea4d6ed25 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: 661df8b5-4632-42e2-8ab8-ad7eecc77e57] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:18.182140 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-40317d4e-b0d1-47a2-be71-e8dea4d6ed25 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] HTTP exception thrown: Instance 661df8b5-4632-42e2-8ab8-ad7eecc77e57 could not be found. Oct 04 21:59:18.189423 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-40317d4e-b0d1-47a2-be71-e8dea4d6ed25 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Request method failure captured: Oct 04 21:59:18.189423 n-d-860284-1 devstack@n-api.service[134102]: request: POST /compute/v2.1/servers/661df8b5-4632-42e2-8ab8-ad7eecc77e57/action HTTP/1.1 Oct 04 21:59:18.189423 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 21:59:18.189423 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 21:59:18.189423 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 21:59:18.189423 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 14 Oct 04 21:59:18.189423 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 21:59:18.189423 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 21:59:18.189423 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 21:59:18.189423 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 21:59:18.189423 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPKwu4cpW6hhBuWb-qV_7iYlwjOTpf5XWCl53BJjoosjlcj4wkmmOFzemCJVdBntIx8zJ1SF_z6VrRY8UJr7E8TQDJCRnVQMdNnh0-lZwGdqUzjOWSO31Ryb6n87Cka0g238a21JWok3h3GEhLB-7oCbN3bbcOGmkhd6UFueRxRluk24 Oct 04 21:59:18.189423 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 21:59:18.189423 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 21:59:18.189423 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 21:59:18.189423 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 21:59:18.189423 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 21:59:18.189423 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 21:59:18.189423 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: cf07a17a482a4e92b6ddbdee463c8029 Oct 04 21:59:18.189423 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-ServersNegativeTestJSON-1933663319 Oct 04 21:59:18.189423 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 21:59:18.189423 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 21:59:18.189423 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/cf07a17a482a4e92b6ddbdee463c8029"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_cf07a17a482a4e92b6ddbdee463c8029", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/cf07a17a482a4e92b6ddbdee463c8029"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/cf07a17a482a4e92b6ddbdee463c8029"}]}] Oct 04 21:59:18.189423 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-ServersNegativeTestJSON-1933663319 Oct 04 21:59:18.189423 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: cf07a17a482a4e92b6ddbdee463c8029 Oct 04 21:59:18.189423 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1933663319 Oct 04 21:59:18.189423 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-ServersNegativeTestJSON-1933663319-project Oct 04 21:59:18.189423 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 21:59:18.189423 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 21:59:18.189423 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: 2facee4c6a40416e908083e126d2cfa3 Oct 04 21:59:18.189423 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-ServersNegativeTestJSON-1933663319-project Oct 04 21:59:18.189423 n-d-860284-1 devstack@n-api.service[134102]: Oct 04 21:59:18.189423 n-d-860284-1 devstack@n-api.service[134102]: {"resume": {}} Oct 04 21:59:18.189423 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 21:59:18.189423 n-d-860284-1 devstack@n-api.service[134102]: exception: Instance 661df8b5-4632-42e2-8ab8-ad7eecc77e57 could not be found. Oct 04 21:59:18.189423 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': '661df8b5-4632-42e2-8ab8-ad7eecc77e57', 'body': {'resume': {}}} Oct 04 21:59:18.189423 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:59:18.189423 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:59:18.189423 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:59:18.189423 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:59:18.189423 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:59:18.189423 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:59:18.189423 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 21:59:18.189423 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 21:59:18.189423 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 661df8b5-4632-42e2-8ab8-ad7eecc77e57 could not be found. Oct 04 21:59:18.189423 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:59:18.189423 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:59:18.189423 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:59:18.189423 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:59:18.189423 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:59:18.189423 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:59:18.189423 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:59:18.189423 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:59:18.189423 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:59:18.189423 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:59:18.189423 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 55, in _resume Oct 04 21:59:18.189423 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Oct 04 21:59:18.189423 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:59:18.189423 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:59:18.189423 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 661df8b5-4632-42e2-8ab8-ad7eecc77e57 could not be found. Oct 04 21:59:18.189423 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:59:18.189423 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:59:18.189423 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:59:18.189423 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:59:18.189423 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:59:18.189423 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:59:18.194176 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:59:18.194176 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:59:18.194176 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 661df8b5-4632-42e2-8ab8-ad7eecc77e57 could not be found. Oct 04 21:59:18.194176 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:59:18.196543 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-40317d4e-b0d1-47a2-be71-e8dea4d6ed25 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Returning 404 to user: Instance 661df8b5-4632-42e2-8ab8-ad7eecc77e57 could not be found. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:59:18.198059 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-40317d4e-b0d1-47a2-be71-e8dea4d6ed25 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "POST /compute/v2.1/servers/661df8b5-4632-42e2-8ab8-ad7eecc77e57/action" status: 404 len: 111 microversion: 2.1 time: 0.042028 Oct 04 21:59:18.199622 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1735/3423] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 21:59:18 2022] POST /compute/v2.1/servers/661df8b5-4632-42e2-8ab8-ad7eecc77e57/action => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:59:18.209537 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-0607638e-a72f-40d3-ba1b-ecd1c7f71de1 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:18.210614 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-0607638e-a72f-40d3-ba1b-ecd1c7f71de1 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: a4cf4fac-1e9b-4669-a6ff-30008ed3642d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:18.219439 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0607638e-a72f-40d3-ba1b-ecd1c7f71de1 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:18.220376 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0607638e-a72f-40d3-ba1b-ecd1c7f71de1 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:18.221045 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0607638e-a72f-40d3-ba1b-ecd1c7f71de1 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:18.222027 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0607638e-a72f-40d3-ba1b-ecd1c7f71de1 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:18.223056 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0607638e-a72f-40d3-ba1b-ecd1c7f71de1 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:18.223753 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0607638e-a72f-40d3-ba1b-ecd1c7f71de1 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:18.462300 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-a2c9d4ab-a8b4-4da8-8823-dd98b05a19e9 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c7a1e7d6984644a68d967b5e3fe92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3994b89cac594e309926f1eaf785f7d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:18.481333 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-a2c9d4ab-a8b4-4da8-8823-dd98b05a19e9 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] 10.222.0.43 "GET /compute/v2.1/servers/4c17a63b-8492-4c9b-a0c2-34bef7051f80" status: 200 len: 1292 microversion: 2.1 time: 0.833887 Oct 04 21:59:18.481944 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1689/3424] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:59:17 2022] GET /compute/v2.1/servers/4c17a63b-8492-4c9b-a0c2-34bef7051f80 => generated 1292 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:59:18.493650 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-27563b8e-e650-459a-9aee-562b0d34b98b req-a4805662-8c17-4695-a2e0-c7097c2d4c96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e57b3eb4-9ac6-4f6b-bbe1-a8582bdf543b", "name": "network-vif-plugged", "status": "completed", "tag": "7bf70467-e6c6-44c5-b9e5-a3641cdfe409"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:59:18.535090 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-27563b8e-e650-459a-9aee-562b0d34b98b req-a4805662-8c17-4695-a2e0-c7097c2d4c96 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:18.535897 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-27563b8e-e650-459a-9aee-562b0d34b98b req-a4805662-8c17-4695-a2e0-c7097c2d4c96 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:18.536591 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-27563b8e-e650-459a-9aee-562b0d34b98b req-a4805662-8c17-4695-a2e0-c7097c2d4c96 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:18.575860 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-27563b8e-e650-459a-9aee-562b0d34b98b req-a4805662-8c17-4695-a2e0-c7097c2d4c96 service nova] Creating event network-vif-plugged:7bf70467-e6c6-44c5-b9e5-a3641cdfe409 for instance e57b3eb4-9ac6-4f6b-bbe1-a8582bdf543b on n-h1-860284-1 Oct 04 21:59:18.591679 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-27563b8e-e650-459a-9aee-562b0d34b98b req-a4805662-8c17-4695-a2e0-c7097c2d4c96 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101704 Oct 04 21:59:18.595352 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1690/3425] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:59:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:59:18.663065 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-a25a3183-aa8a-4837-a166-fd3f5f08930f tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Calling method '.version_select at 0x7fbb2f1a40d0>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:18.749060 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-a25a3183-aa8a-4837-a166-fd3f5f08930f tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] 10.222.0.43 "GET /compute/v2.1/images/a67847c0-608b-45c9-a5ac-a6e6f0e06b3a" status: 200 len: 1436 microversion: 2.1 time: 0.090289 Oct 04 21:59:18.757917 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1691/3426] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:59:18 2022] GET /compute/v2.1/images/a67847c0-608b-45c9-a5ac-a6e6f0e06b3a => generated 1436 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:59:18.936668 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-0607638e-a72f-40d3-ba1b-ecd1c7f71de1 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2facee4c6a40416e908083e126d2cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07a17a482a4e92b6ddbdee463c8029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:18.952377 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-0607638e-a72f-40d3-ba1b-ecd1c7f71de1 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d" status: 200 len: 1504 microversion: 2.1 time: 0.747047 Oct 04 21:59:18.970405 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1736/3427] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:59:18 2022] GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d => generated 1504 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:59:18.982066 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-674e1482-6fe3-4028-bd51-ece567fcdd30 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:18.986854 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-674e1482-6fe3-4028-bd51-ece567fcdd30 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: a4cf4fac-1e9b-4669-a6ff-30008ed3642d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:18.998154 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-674e1482-6fe3-4028-bd51-ece567fcdd30 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:18.999494 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-674e1482-6fe3-4028-bd51-ece567fcdd30 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:19.000218 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-674e1482-6fe3-4028-bd51-ece567fcdd30 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:19.002411 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-674e1482-6fe3-4028-bd51-ece567fcdd30 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:19.003410 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-674e1482-6fe3-4028-bd51-ece567fcdd30 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:19.004383 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-674e1482-6fe3-4028-bd51-ece567fcdd30 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:19.182350 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-dd4b3ef4-0b0e-4ae3-baa5-8d3b4a68bc8a tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:19.183204 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-dd4b3ef4-0b0e-4ae3-baa5-8d3b4a68bc8a tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] [instance: d0b1b757-4a4d-4a7a-9a06-08f178a02984] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:19.191086 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dd4b3ef4-0b0e-4ae3-baa5-8d3b4a68bc8a tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:19.191594 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dd4b3ef4-0b0e-4ae3-baa5-8d3b4a68bc8a tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:19.192045 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dd4b3ef4-0b0e-4ae3-baa5-8d3b4a68bc8a tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:19.192780 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dd4b3ef4-0b0e-4ae3-baa5-8d3b4a68bc8a tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:19.193245 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dd4b3ef4-0b0e-4ae3-baa5-8d3b4a68bc8a tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:19.193678 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dd4b3ef4-0b0e-4ae3-baa5-8d3b4a68bc8a tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:19.355680 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-dd4b3ef4-0b0e-4ae3-baa5-8d3b4a68bc8a tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:19.373013 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-dd4b3ef4-0b0e-4ae3-baa5-8d3b4a68bc8a tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:19.385936 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-dd4b3ef4-0b0e-4ae3-baa5-8d3b4a68bc8a tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:19.392140 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-dd4b3ef4-0b0e-4ae3-baa5-8d3b4a68bc8a tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] 10.222.0.43 "GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984" status: 200 len: 1535 microversion: 2.91 time: 0.213690 Oct 04 21:59:19.393028 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1737/3428] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:59:19 2022] GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984 => generated 1535 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:59:19.427120 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-674e1482-6fe3-4028-bd51-ece567fcdd30 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2facee4c6a40416e908083e126d2cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07a17a482a4e92b6ddbdee463c8029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:19.447025 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-674e1482-6fe3-4028-bd51-ece567fcdd30 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d" status: 200 len: 1504 microversion: 2.1 time: 0.468676 Oct 04 21:59:19.470622 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1692/3429] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:59:18 2022] GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d => generated 1504 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:59:19.479445 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-f4f7cce3-b21a-4cb6-acd5-9f9f890bb684 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:59:19.480040 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-f4f7cce3-b21a-4cb6-acd5-9f9f890bb684 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: a4cf4fac-1e9b-4669-a6ff-30008ed3642d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:19.493552 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f4f7cce3-b21a-4cb6-acd5-9f9f890bb684 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:19.494061 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f4f7cce3-b21a-4cb6-acd5-9f9f890bb684 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:19.494545 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f4f7cce3-b21a-4cb6-acd5-9f9f890bb684 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:19.495274 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f4f7cce3-b21a-4cb6-acd5-9f9f890bb684 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:19.495737 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f4f7cce3-b21a-4cb6-acd5-9f9f890bb684 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:19.496959 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f4f7cce3-b21a-4cb6-acd5-9f9f890bb684 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:19.506569 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-365b5b22-7d6a-4d0c-b55c-cc883b8006a5 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:19.507568 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-365b5b22-7d6a-4d0c-b55c-cc883b8006a5 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] [instance: 4c17a63b-8492-4c9b-a0c2-34bef7051f80] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:19.520266 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-365b5b22-7d6a-4d0c-b55c-cc883b8006a5 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:19.522213 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-365b5b22-7d6a-4d0c-b55c-cc883b8006a5 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:19.524310 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-365b5b22-7d6a-4d0c-b55c-cc883b8006a5 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:19.527088 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-365b5b22-7d6a-4d0c-b55c-cc883b8006a5 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:19.532038 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-365b5b22-7d6a-4d0c-b55c-cc883b8006a5 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:19.534699 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-365b5b22-7d6a-4d0c-b55c-cc883b8006a5 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:19.603237 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-f4f7cce3-b21a-4cb6-acd5-9f9f890bb684 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] HTTP exception thrown: Cannot 'resume' instance a4cf4fac-1e9b-4669-a6ff-30008ed3642d while it is in vm_state active Oct 04 21:59:19.604867 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-f4f7cce3-b21a-4cb6-acd5-9f9f890bb684 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Request method failure captured: Oct 04 21:59:19.604867 n-d-860284-1 devstack@n-api.service[134102]: request: POST /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d/action HTTP/1.1 Oct 04 21:59:19.604867 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 21:59:19.604867 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 21:59:19.604867 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 21:59:19.604867 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 14 Oct 04 21:59:19.604867 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 21:59:19.604867 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 21:59:19.604867 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 21:59:19.604867 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 21:59:19.604867 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPKwu4cpW6hhBuWb-qV_7iYlwjOTpf5XWCl53BJjoosjlcj4wkmmOFzemCJVdBntIx8zJ1SF_z6VrRY8UJr7E8TQDJCRnVQMdNnh0-lZwGdqUzjOWSO31Ryb6n87Cka0g238a21JWok3h3GEhLB-7oCbN3bbcOGmkhd6UFueRxRluk24 Oct 04 21:59:19.604867 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 21:59:19.604867 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 21:59:19.604867 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 21:59:19.604867 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 21:59:19.604867 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 21:59:19.604867 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 21:59:19.604867 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: cf07a17a482a4e92b6ddbdee463c8029 Oct 04 21:59:19.604867 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-ServersNegativeTestJSON-1933663319 Oct 04 21:59:19.604867 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 21:59:19.604867 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 21:59:19.604867 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/cf07a17a482a4e92b6ddbdee463c8029"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_cf07a17a482a4e92b6ddbdee463c8029", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/cf07a17a482a4e92b6ddbdee463c8029"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/cf07a17a482a4e92b6ddbdee463c8029"}]}] Oct 04 21:59:19.604867 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-ServersNegativeTestJSON-1933663319 Oct 04 21:59:19.604867 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: cf07a17a482a4e92b6ddbdee463c8029 Oct 04 21:59:19.604867 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1933663319 Oct 04 21:59:19.604867 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-ServersNegativeTestJSON-1933663319-project Oct 04 21:59:19.604867 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 21:59:19.604867 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 21:59:19.604867 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: 2facee4c6a40416e908083e126d2cfa3 Oct 04 21:59:19.604867 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-ServersNegativeTestJSON-1933663319-project Oct 04 21:59:19.604867 n-d-860284-1 devstack@n-api.service[134102]: Oct 04 21:59:19.604867 n-d-860284-1 devstack@n-api.service[134102]: {"resume": {}} Oct 04 21:59:19.604867 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 21:59:19.604867 n-d-860284-1 devstack@n-api.service[134102]: exception: Cannot 'resume' instance a4cf4fac-1e9b-4669-a6ff-30008ed3642d while it is in vm_state active Oct 04 21:59:19.604867 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': 'a4cf4fac-1e9b-4669-a6ff-30008ed3642d', 'body': {'resume': {}}} Oct 04 21:59:19.604867 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:59:19.604867 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:59:19.604867 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 59, in _resume Oct 04 21:59:19.604867 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi self.compute_api.resume(context, server) Oct 04 21:59:19.604867 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 21:59:19.604867 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 21:59:19.604867 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 04 21:59:19.604867 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 21:59:19.604867 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 04 21:59:19.604867 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 04 21:59:19.604867 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance a4cf4fac-1e9b-4669-a6ff-30008ed3642d in vm_state active. Cannot resume while the instance is in this state. Oct 04 21:59:19.604867 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:59:19.604867 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:59:19.604867 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:59:19.604867 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:59:19.604867 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:59:19.604867 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:59:19.604867 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:59:19.604867 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:59:19.604867 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:59:19.604867 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:59:19.604867 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 63, in _resume Oct 04 21:59:19.604867 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 04 21:59:19.604867 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 04 21:59:19.604867 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 21:59:19.604867 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'resume' instance a4cf4fac-1e9b-4669-a6ff-30008ed3642d while it is in vm_state active Oct 04 21:59:19.604867 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:59:19.604867 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:59:19.604867 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:59:19.610248 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:59:19.610248 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:59:19.610248 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:59:19.610248 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:59:19.610248 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:59:19.610248 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'resume' instance a4cf4fac-1e9b-4669-a6ff-30008ed3642d while it is in vm_state active Oct 04 21:59:19.610248 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:59:19.610248 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-f4f7cce3-b21a-4cb6-acd5-9f9f890bb684 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Returning 409 to user: Cannot 'resume' instance a4cf4fac-1e9b-4669-a6ff-30008ed3642d while it is in vm_state active {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:59:19.610248 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-f4f7cce3-b21a-4cb6-acd5-9f9f890bb684 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "POST /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d/action" status: 409 len: 144 microversion: 2.1 time: 0.131632 Oct 04 21:59:19.610248 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1738/3430] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 21:59:19 2022] POST /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d/action => generated 144 bytes in 136 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 21:59:19.622788 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-400d4852-390d-49d8-a2bb-8ad71a13d2d2 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:19.624101 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-400d4852-390d-49d8-a2bb-8ad71a13d2d2 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: a4cf4fac-1e9b-4669-a6ff-30008ed3642d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:19.647182 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-400d4852-390d-49d8-a2bb-8ad71a13d2d2 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:19.649347 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-400d4852-390d-49d8-a2bb-8ad71a13d2d2 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:19.649956 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-400d4852-390d-49d8-a2bb-8ad71a13d2d2 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:19.650763 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-400d4852-390d-49d8-a2bb-8ad71a13d2d2 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:19.651245 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-400d4852-390d-49d8-a2bb-8ad71a13d2d2 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:19.653957 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-400d4852-390d-49d8-a2bb-8ad71a13d2d2 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:20.178992 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-365b5b22-7d6a-4d0c-b55c-cc883b8006a5 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c7a1e7d6984644a68d967b5e3fe92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3994b89cac594e309926f1eaf785f7d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:20.193785 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-365b5b22-7d6a-4d0c-b55c-cc883b8006a5 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] 10.222.0.43 "GET /compute/v2.1/servers/4c17a63b-8492-4c9b-a0c2-34bef7051f80" status: 200 len: 1292 microversion: 2.1 time: 0.691921 Oct 04 21:59:20.199298 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1693/3431] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:59:19 2022] GET /compute/v2.1/servers/4c17a63b-8492-4c9b-a0c2-34bef7051f80 => generated 1292 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:59:20.210226 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-4c7936f9-b605-44da-a589-2f19d41498ad tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Calling method '.version_select at 0x7fbb2f1a48b0>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:20.297863 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-4c7936f9-b605-44da-a589-2f19d41498ad tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] 10.222.0.43 "GET /compute/v2.1/images/a67847c0-608b-45c9-a5ac-a6e6f0e06b3a" status: 200 len: 1436 microversion: 2.1 time: 0.097020 Oct 04 21:59:20.306276 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1694/3432] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:59:20 2022] GET /compute/v2.1/images/a67847c0-608b-45c9-a5ac-a6e6f0e06b3a => generated 1436 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:59:20.349193 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-400d4852-390d-49d8-a2bb-8ad71a13d2d2 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2facee4c6a40416e908083e126d2cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07a17a482a4e92b6ddbdee463c8029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:20.361734 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-400d4852-390d-49d8-a2bb-8ad71a13d2d2 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d" status: 200 len: 1504 microversion: 2.1 time: 0.742956 Oct 04 21:59:20.364135 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1739/3433] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:59:19 2022] GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d => generated 1504 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:59:20.388726 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-4af2712d-aa2a-4b13-9705-5e19169e2834 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:20.389897 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-4af2712d-aa2a-4b13-9705-5e19169e2834 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: a4cf4fac-1e9b-4669-a6ff-30008ed3642d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:20.403052 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4af2712d-aa2a-4b13-9705-5e19169e2834 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:20.404139 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4af2712d-aa2a-4b13-9705-5e19169e2834 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:20.404139 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4af2712d-aa2a-4b13-9705-5e19169e2834 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:20.405579 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4af2712d-aa2a-4b13-9705-5e19169e2834 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:20.406280 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4af2712d-aa2a-4b13-9705-5e19169e2834 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:20.406789 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4af2712d-aa2a-4b13-9705-5e19169e2834 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:20.421426 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-eaa0bd31-745d-4848-80b1-dc994c48f92d tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:20.422061 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-eaa0bd31-745d-4848-80b1-dc994c48f92d tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] [instance: d0b1b757-4a4d-4a7a-9a06-08f178a02984] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:20.438786 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-eaa0bd31-745d-4848-80b1-dc994c48f92d tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:20.439555 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-eaa0bd31-745d-4848-80b1-dc994c48f92d tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:20.445112 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-eaa0bd31-745d-4848-80b1-dc994c48f92d tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:20.452258 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-eaa0bd31-745d-4848-80b1-dc994c48f92d tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:20.460030 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-eaa0bd31-745d-4848-80b1-dc994c48f92d tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:20.460743 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-eaa0bd31-745d-4848-80b1-dc994c48f92d tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:20.643357 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-eaa0bd31-745d-4848-80b1-dc994c48f92d tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:20.653564 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-eaa0bd31-745d-4848-80b1-dc994c48f92d tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:20.658996 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-eaa0bd31-745d-4848-80b1-dc994c48f92d tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:20.675715 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-eaa0bd31-745d-4848-80b1-dc994c48f92d tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] 10.222.0.43 "GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984" status: 200 len: 1535 microversion: 2.91 time: 0.259461 Oct 04 21:59:20.676443 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1740/3434] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:59:20 2022] GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984 => generated 1535 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:59:20.830463 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-4af2712d-aa2a-4b13-9705-5e19169e2834 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2facee4c6a40416e908083e126d2cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07a17a482a4e92b6ddbdee463c8029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:20.855524 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-4af2712d-aa2a-4b13-9705-5e19169e2834 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d" status: 200 len: 1504 microversion: 2.1 time: 0.470678 Oct 04 21:59:20.859677 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1695/3435] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:59:20 2022] GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d => generated 1504 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:59:21.169721 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-2d2bfb25-3f7f-497e-95e6-658100a79f54 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452", "networks": [{"uuid": "300a434f-3ad3-472e-98dd-a1b7130cf104"}]}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:59:21.173908 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-2d2bfb25-3f7f-497e-95e6-658100a79f54 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Request method failure captured: Oct 04 21:59:21.173908 n-d-860284-1 devstack@n-api.service[134102]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 21:59:21.173908 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 21:59:21.173908 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 21:59:21.173908 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 21:59:21.173908 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 160 Oct 04 21:59:21.173908 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 21:59:21.173908 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 21:59:21.173908 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 21:59:21.173908 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 21:59:21.173908 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPKwu4cpW6hhBuWb-qV_7iYlwjOTpf5XWCl53BJjoosjlcj4wkmmOFzemCJVdBntIx8zJ1SF_z6VrRY8UJr7E8TQDJCRnVQMdNnh0-lZwGdqUzjOWSO31Ryb6n87Cka0g238a21JWok3h3GEhLB-7oCbN3bbcOGmkhd6UFueRxRluk24 Oct 04 21:59:21.173908 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 21:59:21.173908 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 21:59:21.173908 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 21:59:21.173908 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 21:59:21.173908 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 21:59:21.173908 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 21:59:21.173908 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: cf07a17a482a4e92b6ddbdee463c8029 Oct 04 21:59:21.173908 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-ServersNegativeTestJSON-1933663319 Oct 04 21:59:21.173908 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 21:59:21.173908 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 21:59:21.173908 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/cf07a17a482a4e92b6ddbdee463c8029"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_cf07a17a482a4e92b6ddbdee463c8029", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/cf07a17a482a4e92b6ddbdee463c8029"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/cf07a17a482a4e92b6ddbdee463c8029"}]}] Oct 04 21:59:21.173908 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-ServersNegativeTestJSON-1933663319 Oct 04 21:59:21.173908 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: cf07a17a482a4e92b6ddbdee463c8029 Oct 04 21:59:21.173908 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1933663319 Oct 04 21:59:21.173908 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-ServersNegativeTestJSON-1933663319-project Oct 04 21:59:21.173908 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 21:59:21.173908 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 21:59:21.173908 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: 2facee4c6a40416e908083e126d2cfa3 Oct 04 21:59:21.173908 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-ServersNegativeTestJSON-1933663319-project Oct 04 21:59:21.173908 n-d-860284-1 devstack@n-api.service[134102]: Oct 04 21:59:21.173908 n-d-860284-1 devstack@n-api.service[134102]: {"server": {"name": "", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452", "networks": [{"uuid": "300a434f-3ad3-472e-98dd-a1b7130cf104"}]}} Oct 04 21:59:21.173908 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 21:59:21.173908 n-d-860284-1 devstack@n-api.service[134102]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 04 21:59:21.173908 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'body': {'server': {'name': '', 'imageRef': '58548514-5dac-426c-81f5-19e3fba33e23', 'flavorRef': '452', 'networks': [{'uuid': '300a434f-3ad3-472e-98dd-a1b7130cf104'}]}}} Oct 04 21:59:21.173908 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:59:21.173908 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:59:21.173908 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 21:59:21.173908 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 21:59:21.173908 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 21:59:21.173908 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise error Oct 04 21:59:21.173908 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 04 21:59:21.173908 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:59:21.173908 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Oct 04 21:59:21.173908 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 04 21:59:21.173908 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:59:21.173908 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 21:59:21.173908 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi '' Oct 04 21:59:21.173908 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:59:21.173908 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:59:21.173908 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:59:21.173908 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:59:21.173908 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:59:21.173908 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:59:21.173908 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:59:21.173908 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:59:21.173908 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:59:21.173908 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:59:21.173908 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:59:21.173908 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:59:21.173908 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 21:59:21.173908 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 21:59:21.173908 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 21:59:21.173908 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 21:59:21.173908 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 21:59:21.180138 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 21:59:21.180138 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 04 21:59:21.180138 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:59:21.180138 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:59:21.180138 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:59:21.180138 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:59:21.180138 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:59:21.180138 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:59:21.180138 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 21:59:21.180138 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 21:59:21.180138 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 04 21:59:21.180138 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:59:21.180138 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-2d2bfb25-3f7f-497e-95e6-658100a79f54 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:59:21.180138 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-2d2bfb25-3f7f-497e-95e6-658100a79f54 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.012580 Oct 04 21:59:21.180138 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1741/3436] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 21:59:21 2022] POST /compute/v2.1/servers => generated 108 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 04 21:59:21.189631 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-95865de4-8928-4a09-8c1a-849cc6fb40fc tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:21.190275 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-95865de4-8928-4a09-8c1a-849cc6fb40fc tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: a4cf4fac-1e9b-4669-a6ff-30008ed3642d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:21.200721 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-95865de4-8928-4a09-8c1a-849cc6fb40fc tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:21.201141 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-95865de4-8928-4a09-8c1a-849cc6fb40fc tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:21.202168 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-95865de4-8928-4a09-8c1a-849cc6fb40fc tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:21.203519 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-95865de4-8928-4a09-8c1a-849cc6fb40fc tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:21.203716 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-95865de4-8928-4a09-8c1a-849cc6fb40fc tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:21.223134 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-71b97b0d-4439-4b02-acc6-89c4084f5b15 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:21.224787 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-71b97b0d-4439-4b02-acc6-89c4084f5b15 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] [instance: 4c17a63b-8492-4c9b-a0c2-34bef7051f80] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:21.226012 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-95865de4-8928-4a09-8c1a-849cc6fb40fc tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:21.243856 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-71b97b0d-4439-4b02-acc6-89c4084f5b15 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:21.244670 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-71b97b0d-4439-4b02-acc6-89c4084f5b15 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:21.247567 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-71b97b0d-4439-4b02-acc6-89c4084f5b15 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:21.249078 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-71b97b0d-4439-4b02-acc6-89c4084f5b15 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:21.249562 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-71b97b0d-4439-4b02-acc6-89c4084f5b15 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:21.250001 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-71b97b0d-4439-4b02-acc6-89c4084f5b15 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:21.258000 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:59:22.231491 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-71b97b0d-4439-4b02-acc6-89c4084f5b15 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c7a1e7d6984644a68d967b5e3fe92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3994b89cac594e309926f1eaf785f7d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:22.241821 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-71b97b0d-4439-4b02-acc6-89c4084f5b15 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] 10.222.0.43 "GET /compute/v2.1/servers/4c17a63b-8492-4c9b-a0c2-34bef7051f80" status: 200 len: 1292 microversion: 2.1 time: 1.024390 Oct 04 21:59:22.252037 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1742/3437] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:59:21 2022] GET /compute/v2.1/servers/4c17a63b-8492-4c9b-a0c2-34bef7051f80 => generated 1292 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:59:22.265982 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-454b8122-2fe6-402e-a3ac-17ab3159d286 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Calling method '.version_select at 0x7fbb2e779700>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:22.360327 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-454b8122-2fe6-402e-a3ac-17ab3159d286 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] 10.222.0.43 "GET /compute/v2.1/images/a67847c0-608b-45c9-a5ac-a6e6f0e06b3a" status: 200 len: 1436 microversion: 2.1 time: 0.106585 Oct 04 21:59:22.361829 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1743/3438] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:59:22 2022] GET /compute/v2.1/images/a67847c0-608b-45c9-a5ac-a6e6f0e06b3a => generated 1436 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:59:22.366692 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-573bb4b6-cb9f-452c-97b6-a9a201d7591e tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:22.375634 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-573bb4b6-cb9f-452c-97b6-a9a201d7591e tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] [instance: d0b1b757-4a4d-4a7a-9a06-08f178a02984] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:22.389673 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-573bb4b6-cb9f-452c-97b6-a9a201d7591e tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:22.390934 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-573bb4b6-cb9f-452c-97b6-a9a201d7591e tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:22.391565 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-573bb4b6-cb9f-452c-97b6-a9a201d7591e tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:22.392503 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-573bb4b6-cb9f-452c-97b6-a9a201d7591e tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:22.398563 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-573bb4b6-cb9f-452c-97b6-a9a201d7591e tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:22.399477 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-573bb4b6-cb9f-452c-97b6-a9a201d7591e tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:22.649597 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-95865de4-8928-4a09-8c1a-849cc6fb40fc tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2facee4c6a40416e908083e126d2cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07a17a482a4e92b6ddbdee463c8029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:22.673228 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-95865de4-8928-4a09-8c1a-849cc6fb40fc tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d" status: 200 len: 1504 microversion: 2.1 time: 1.487644 Oct 04 21:59:22.674424 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1696/3439] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:59:21 2022] GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d => generated 1504 bytes in 1489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:59:22.700125 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-f2d21e4e-3246-4d1a-9829-d935232064a2 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:22.700953 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-f2d21e4e-3246-4d1a-9829-d935232064a2 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: a4cf4fac-1e9b-4669-a6ff-30008ed3642d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:22.715568 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f2d21e4e-3246-4d1a-9829-d935232064a2 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:22.716222 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f2d21e4e-3246-4d1a-9829-d935232064a2 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:22.716781 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f2d21e4e-3246-4d1a-9829-d935232064a2 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:22.720237 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f2d21e4e-3246-4d1a-9829-d935232064a2 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:22.720841 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f2d21e4e-3246-4d1a-9829-d935232064a2 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:22.721526 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f2d21e4e-3246-4d1a-9829-d935232064a2 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:22.739772 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-573bb4b6-cb9f-452c-97b6-a9a201d7591e tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:22.757041 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-573bb4b6-cb9f-452c-97b6-a9a201d7591e tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:22.762074 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-573bb4b6-cb9f-452c-97b6-a9a201d7591e tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:22.786056 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-573bb4b6-cb9f-452c-97b6-a9a201d7591e tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] 10.222.0.43 "GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984" status: 200 len: 1478 microversion: 2.91 time: 0.423032 Oct 04 21:59:22.796668 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1744/3440] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:59:22 2022] GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984 => generated 1478 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:59:22.824867 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-510c5daa-3bd3-4b9c-a8d1-78ff2d04744d tempest-UnshelveToHostMultiNodesTest-2056876790 tempest-UnshelveToHostMultiNodesTest-2056876790-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h1-860284-1"}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:59:22.830269 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-510c5daa-3bd3-4b9c-a8d1-78ff2d04744d tempest-UnshelveToHostMultiNodesTest-2056876790 tempest-UnshelveToHostMultiNodesTest-2056876790-project-admin] [instance: d0b1b757-4a4d-4a7a-9a06-08f178a02984] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:22.861074 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-510c5daa-3bd3-4b9c-a8d1-78ff2d04744d tempest-UnshelveToHostMultiNodesTest-2056876790 tempest-UnshelveToHostMultiNodesTest-2056876790-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:22.861584 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-510c5daa-3bd3-4b9c-a8d1-78ff2d04744d tempest-UnshelveToHostMultiNodesTest-2056876790 tempest-UnshelveToHostMultiNodesTest-2056876790-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:22.862035 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-510c5daa-3bd3-4b9c-a8d1-78ff2d04744d tempest-UnshelveToHostMultiNodesTest-2056876790 tempest-UnshelveToHostMultiNodesTest-2056876790-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:22.868342 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-510c5daa-3bd3-4b9c-a8d1-78ff2d04744d tempest-UnshelveToHostMultiNodesTest-2056876790 tempest-UnshelveToHostMultiNodesTest-2056876790-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:22.869243 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-510c5daa-3bd3-4b9c-a8d1-78ff2d04744d tempest-UnshelveToHostMultiNodesTest-2056876790 tempest-UnshelveToHostMultiNodesTest-2056876790-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:22.870637 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-510c5daa-3bd3-4b9c-a8d1-78ff2d04744d tempest-UnshelveToHostMultiNodesTest-2056876790 tempest-UnshelveToHostMultiNodesTest-2056876790-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:23.037372 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-510c5daa-3bd3-4b9c-a8d1-78ff2d04744d tempest-UnshelveToHostMultiNodesTest-2056876790 tempest-UnshelveToHostMultiNodesTest-2056876790-project-admin] [instance: d0b1b757-4a4d-4a7a-9a06-08f178a02984] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "n-h1-860284-1". {{(pid=134102) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 04 21:59:23.256561 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-510c5daa-3bd3-4b9c-a8d1-78ff2d04744d tempest-UnshelveToHostMultiNodesTest-2056876790 tempest-UnshelveToHostMultiNodesTest-2056876790-project-admin] 10.222.0.43 "POST /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984/action" status: 202 len: 0 microversion: 2.91 time: 0.436312 Oct 04 21:59:23.261237 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1745/3441] 10.222.0.43 () {62 vars in 1319 bytes} [Tue Oct 4 21:59:22 2022] POST /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984/action => generated 0 bytes in 439 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 04 21:59:23.271102 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-130bc855-b206-4a94-b872-ccc2bc911299 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:23.271746 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-130bc855-b206-4a94-b872-ccc2bc911299 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] [instance: d0b1b757-4a4d-4a7a-9a06-08f178a02984] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:23.292088 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-130bc855-b206-4a94-b872-ccc2bc911299 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:23.292606 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-130bc855-b206-4a94-b872-ccc2bc911299 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:23.294221 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-130bc855-b206-4a94-b872-ccc2bc911299 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:23.296548 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-130bc855-b206-4a94-b872-ccc2bc911299 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:23.297039 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-130bc855-b206-4a94-b872-ccc2bc911299 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:23.297486 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-130bc855-b206-4a94-b872-ccc2bc911299 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:23.302976 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-f2d21e4e-3246-4d1a-9829-d935232064a2 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2facee4c6a40416e908083e126d2cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07a17a482a4e92b6ddbdee463c8029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:23.314108 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-f2d21e4e-3246-4d1a-9829-d935232064a2 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d" status: 200 len: 1504 microversion: 2.1 time: 0.618472 Oct 04 21:59:23.327445 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1697/3442] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:59:22 2022] GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d => generated 1504 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:59:23.344606 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-881f45b3-a6f1-496b-9010-627cf65b4a8a tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:23.345237 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-881f45b3-a6f1-496b-9010-627cf65b4a8a tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] [instance: 4c17a63b-8492-4c9b-a0c2-34bef7051f80] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:23.358333 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-881f45b3-a6f1-496b-9010-627cf65b4a8a tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:23.358838 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-881f45b3-a6f1-496b-9010-627cf65b4a8a tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:23.359293 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-881f45b3-a6f1-496b-9010-627cf65b4a8a tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:23.364103 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-881f45b3-a6f1-496b-9010-627cf65b4a8a tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:23.367389 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-881f45b3-a6f1-496b-9010-627cf65b4a8a tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:23.367859 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-881f45b3-a6f1-496b-9010-627cf65b4a8a tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:23.615898 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-130bc855-b206-4a94-b872-ccc2bc911299 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:23.635106 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-130bc855-b206-4a94-b872-ccc2bc911299 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:23.636912 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-130bc855-b206-4a94-b872-ccc2bc911299 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:23.643650 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-130bc855-b206-4a94-b872-ccc2bc911299 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] 10.222.0.43 "GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984" status: 200 len: 1486 microversion: 2.91 time: 0.380498 Oct 04 21:59:23.659086 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1746/3443] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:59:23 2022] GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984 => generated 1486 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:59:23.680460 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-adccb7cf-fdad-4f93-87b0-572068ba689b tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:59:23.682073 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-adccb7cf-fdad-4f93-87b0-572068ba689b tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: 01cfe0d6-a95d-4ca6-a159-531767810748] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:23.691578 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-adccb7cf-fdad-4f93-87b0-572068ba689b tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] HTTP exception thrown: Instance 01cfe0d6-a95d-4ca6-a159-531767810748 could not be found. Oct 04 21:59:23.696347 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-adccb7cf-fdad-4f93-87b0-572068ba689b tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Request method failure captured: Oct 04 21:59:23.696347 n-d-860284-1 devstack@n-api.service[134102]: request: POST /compute/v2.1/servers/01cfe0d6-a95d-4ca6-a159-531767810748/action HTTP/1.1 Oct 04 21:59:23.696347 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 21:59:23.696347 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 21:59:23.696347 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 21:59:23.696347 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 14 Oct 04 21:59:23.696347 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 21:59:23.696347 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 21:59:23.696347 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 21:59:23.696347 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 21:59:23.696347 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPKwu4cpW6hhBuWb-qV_7iYlwjOTpf5XWCl53BJjoosjlcj4wkmmOFzemCJVdBntIx8zJ1SF_z6VrRY8UJr7E8TQDJCRnVQMdNnh0-lZwGdqUzjOWSO31Ryb6n87Cka0g238a21JWok3h3GEhLB-7oCbN3bbcOGmkhd6UFueRxRluk24 Oct 04 21:59:23.696347 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 21:59:23.696347 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 21:59:23.696347 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 21:59:23.696347 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 21:59:23.696347 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 21:59:23.696347 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 21:59:23.696347 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: cf07a17a482a4e92b6ddbdee463c8029 Oct 04 21:59:23.696347 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-ServersNegativeTestJSON-1933663319 Oct 04 21:59:23.696347 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 21:59:23.696347 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 21:59:23.696347 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/cf07a17a482a4e92b6ddbdee463c8029"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_cf07a17a482a4e92b6ddbdee463c8029", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/cf07a17a482a4e92b6ddbdee463c8029"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/cf07a17a482a4e92b6ddbdee463c8029"}]}] Oct 04 21:59:23.696347 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-ServersNegativeTestJSON-1933663319 Oct 04 21:59:23.696347 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: cf07a17a482a4e92b6ddbdee463c8029 Oct 04 21:59:23.696347 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1933663319 Oct 04 21:59:23.696347 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-ServersNegativeTestJSON-1933663319-project Oct 04 21:59:23.696347 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 21:59:23.696347 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 21:59:23.696347 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: 2facee4c6a40416e908083e126d2cfa3 Oct 04 21:59:23.696347 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-ServersNegativeTestJSON-1933663319-project Oct 04 21:59:23.696347 n-d-860284-1 devstack@n-api.service[134102]: Oct 04 21:59:23.696347 n-d-860284-1 devstack@n-api.service[134102]: {"shelve": {}} Oct 04 21:59:23.696347 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 21:59:23.696347 n-d-860284-1 devstack@n-api.service[134102]: exception: Instance 01cfe0d6-a95d-4ca6-a159-531767810748 could not be found. Oct 04 21:59:23.696347 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': '01cfe0d6-a95d-4ca6-a159-531767810748', 'body': {'shelve': {}}} Oct 04 21:59:23.696347 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:59:23.696347 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:59:23.696347 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:59:23.696347 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:59:23.696347 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:59:23.696347 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:59:23.696347 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 21:59:23.696347 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 21:59:23.696347 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01cfe0d6-a95d-4ca6-a159-531767810748 could not be found. Oct 04 21:59:23.696347 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:59:23.696347 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:59:23.696347 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:59:23.696347 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:59:23.696347 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:59:23.696347 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:59:23.696347 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:59:23.696347 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:59:23.696347 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:59:23.696347 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:59:23.696347 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 44, in _shelve Oct 04 21:59:23.696347 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 04 21:59:23.696347 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:59:23.696347 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:59:23.696347 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01cfe0d6-a95d-4ca6-a159-531767810748 could not be found. Oct 04 21:59:23.696347 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:59:23.696347 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:59:23.696347 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:59:23.696347 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:59:23.696347 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:59:23.696347 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:59:23.704657 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:59:23.704657 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:59:23.704657 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01cfe0d6-a95d-4ca6-a159-531767810748 could not be found. Oct 04 21:59:23.704657 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:59:23.720754 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-adccb7cf-fdad-4f93-87b0-572068ba689b tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Returning 404 to user: Instance 01cfe0d6-a95d-4ca6-a159-531767810748 could not be found. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:59:23.721840 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-adccb7cf-fdad-4f93-87b0-572068ba689b tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "POST /compute/v2.1/servers/01cfe0d6-a95d-4ca6-a159-531767810748/action" status: 404 len: 111 microversion: 2.1 time: 0.061266 Oct 04 21:59:23.727364 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1747/3444] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 21:59:23 2022] POST /compute/v2.1/servers/01cfe0d6-a95d-4ca6-a159-531767810748/action => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:59:23.734262 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-97a818f3-8d52-4f65-a074-6d70bebb7c04 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Calling method '.version_select at 0x7fbb37280b80>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:23.822840 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-881f45b3-a6f1-496b-9010-627cf65b4a8a tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c7a1e7d6984644a68d967b5e3fe92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3994b89cac594e309926f1eaf785f7d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:23.825400 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-97a818f3-8d52-4f65-a074-6d70bebb7c04 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] 10.222.0.43 "GET /compute/v2.1/images/a67847c0-608b-45c9-a5ac-a6e6f0e06b3a" status: 200 len: 1436 microversion: 2.1 time: 0.096581 Oct 04 21:59:23.827431 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1748/3445] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:59:23 2022] GET /compute/v2.1/images/a67847c0-608b-45c9-a5ac-a6e6f0e06b3a => generated 1436 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:59:23.849403 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-881f45b3-a6f1-496b-9010-627cf65b4a8a tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] 10.222.0.43 "GET /compute/v2.1/servers/4c17a63b-8492-4c9b-a0c2-34bef7051f80" status: 200 len: 1292 microversion: 2.1 time: 0.513444 Oct 04 21:59:23.852528 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1698/3446] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:59:23 2022] GET /compute/v2.1/servers/4c17a63b-8492-4c9b-a0c2-34bef7051f80 => generated 1292 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:59:23.874006 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-f35d5648-ed9e-4033-806a-9ad91e9d81c0 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:23.877387 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-f35d5648-ed9e-4033-806a-9ad91e9d81c0 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: a4cf4fac-1e9b-4669-a6ff-30008ed3642d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:23.891682 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f35d5648-ed9e-4033-806a-9ad91e9d81c0 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:23.892219 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f35d5648-ed9e-4033-806a-9ad91e9d81c0 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:23.892672 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f35d5648-ed9e-4033-806a-9ad91e9d81c0 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:23.895662 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f35d5648-ed9e-4033-806a-9ad91e9d81c0 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:23.896166 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f35d5648-ed9e-4033-806a-9ad91e9d81c0 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:23.896620 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f35d5648-ed9e-4033-806a-9ad91e9d81c0 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:23.915148 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-97342e9e-4689-4584-bb2b-690dfac4085f tempest-ServerMetadataNegativeTestJSON-1726578604 tempest-ServerMetadataNegativeTestJSON-1726578604-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-980851944", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "007ad08c-9157-4f93-9f8e-95a8ac2cb59c"}]}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:59:24.011282 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.network.neutron [None req-97342e9e-4689-4584-bb2b-690dfac4085f tempest-ServerMetadataNegativeTestJSON-1726578604 tempest-ServerMetadataNegativeTestJSON-1726578604-project] validate_networks() for [('007ad08c-9157-4f93-9f8e-95a8ac2cb59c', None, None, None, None, None)] {{(pid=134102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:59:24.418389 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-f35d5648-ed9e-4033-806a-9ad91e9d81c0 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2facee4c6a40416e908083e126d2cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07a17a482a4e92b6ddbdee463c8029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:24.427814 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-f35d5648-ed9e-4033-806a-9ad91e9d81c0 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d" status: 200 len: 1504 microversion: 2.1 time: 0.573376 Oct 04 21:59:24.433195 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1699/3447] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:59:23 2022] GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d => generated 1504 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:59:24.460592 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-3436db60-2dfb-4e2b-a422-b298ab8e73d1 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:24.461610 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-3436db60-2dfb-4e2b-a422-b298ab8e73d1 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: a4cf4fac-1e9b-4669-a6ff-30008ed3642d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:24.476406 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3436db60-2dfb-4e2b-a422-b298ab8e73d1 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:24.477146 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3436db60-2dfb-4e2b-a422-b298ab8e73d1 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:24.477790 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3436db60-2dfb-4e2b-a422-b298ab8e73d1 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:24.479061 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3436db60-2dfb-4e2b-a422-b298ab8e73d1 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:24.479736 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3436db60-2dfb-4e2b-a422-b298ab8e73d1 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:24.480498 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3436db60-2dfb-4e2b-a422-b298ab8e73d1 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:24.518621 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=100 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:59:26.485780 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-3436db60-2dfb-4e2b-a422-b298ab8e73d1 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2facee4c6a40416e908083e126d2cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07a17a482a4e92b6ddbdee463c8029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:26.496776 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-3436db60-2dfb-4e2b-a422-b298ab8e73d1 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d" status: 200 len: 1504 microversion: 2.1 time: 2.040498 Oct 04 21:59:26.511096 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1700/3448] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:59:24 2022] GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d => generated 1504 bytes in 2055 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:59:26.516564 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-a94e6c58-eb6e-417c-a37d-3751ed06db88 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:26.524362 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-a94e6c58-eb6e-417c-a37d-3751ed06db88 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] [instance: d0b1b757-4a4d-4a7a-9a06-08f178a02984] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:26.540378 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a94e6c58-eb6e-417c-a37d-3751ed06db88 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:26.545669 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a94e6c58-eb6e-417c-a37d-3751ed06db88 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:26.547168 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a94e6c58-eb6e-417c-a37d-3751ed06db88 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:26.548285 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a94e6c58-eb6e-417c-a37d-3751ed06db88 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:26.549021 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a94e6c58-eb6e-417c-a37d-3751ed06db88 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:26.551415 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a94e6c58-eb6e-417c-a37d-3751ed06db88 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:26.594784 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-97342e9e-4689-4584-bb2b-690dfac4085f tempest-ServerMetadataNegativeTestJSON-1726578604 tempest-ServerMetadataNegativeTestJSON-1726578604-project] Flavor limits 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:59:26.595903 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-97342e9e-4689-4584-bb2b-690dfac4085f tempest-ServerMetadataNegativeTestJSON-1726578604 tempest-ServerMetadataNegativeTestJSON-1726578604-project] Image limits 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:59:26.596581 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-97342e9e-4689-4584-bb2b-690dfac4085f tempest-ServerMetadataNegativeTestJSON-1726578604 tempest-ServerMetadataNegativeTestJSON-1726578604-project] Flavor pref 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:59:26.597178 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-97342e9e-4689-4584-bb2b-690dfac4085f tempest-ServerMetadataNegativeTestJSON-1726578604 tempest-ServerMetadataNegativeTestJSON-1726578604-project] Image pref 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:59:26.597806 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-97342e9e-4689-4584-bb2b-690dfac4085f tempest-ServerMetadataNegativeTestJSON-1726578604 tempest-ServerMetadataNegativeTestJSON-1726578604-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:59:26.621642 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-97342e9e-4689-4584-bb2b-690dfac4085f tempest-ServerMetadataNegativeTestJSON-1726578604 tempest-ServerMetadataNegativeTestJSON-1726578604-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:26.622442 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-97342e9e-4689-4584-bb2b-690dfac4085f tempest-ServerMetadataNegativeTestJSON-1726578604 tempest-ServerMetadataNegativeTestJSON-1726578604-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:26.623388 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-97342e9e-4689-4584-bb2b-690dfac4085f tempest-ServerMetadataNegativeTestJSON-1726578604 tempest-ServerMetadataNegativeTestJSON-1726578604-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:26.624948 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-97342e9e-4689-4584-bb2b-690dfac4085f tempest-ServerMetadataNegativeTestJSON-1726578604 tempest-ServerMetadataNegativeTestJSON-1726578604-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:26.625733 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-97342e9e-4689-4584-bb2b-690dfac4085f tempest-ServerMetadataNegativeTestJSON-1726578604 tempest-ServerMetadataNegativeTestJSON-1726578604-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:26.626932 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-97342e9e-4689-4584-bb2b-690dfac4085f tempest-ServerMetadataNegativeTestJSON-1726578604 tempest-ServerMetadataNegativeTestJSON-1726578604-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:26.717707 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-97342e9e-4689-4584-bb2b-690dfac4085f tempest-ServerMetadataNegativeTestJSON-1726578604 tempest-ServerMetadataNegativeTestJSON-1726578604-project] Getting quotas for project c8b3066186614f7fbf7644a0f5d6c953. Resources: {'instances', 'ram', 'cores'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:59:26.734526 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-97342e9e-4689-4584-bb2b-690dfac4085f tempest-ServerMetadataNegativeTestJSON-1726578604 tempest-ServerMetadataNegativeTestJSON-1726578604-project] Getting quotas for user f361ccb8eb4246f0bae1097edfe65096 and project c8b3066186614f7fbf7644a0f5d6c953. Resources: {'instances', 'ram', 'cores'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:59:26.771899 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-97342e9e-4689-4584-bb2b-690dfac4085f tempest-ServerMetadataNegativeTestJSON-1726578604 tempest-ServerMetadataNegativeTestJSON-1726578604-project] Going to run 1 instances... {{(pid=134102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:59:26.774717 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-97342e9e-4689-4584-bb2b-690dfac4085f tempest-ServerMetadataNegativeTestJSON-1726578604 tempest-ServerMetadataNegativeTestJSON-1726578604-project] [instance: 34e510e1-0dd2-4799-8626-782c5f1912ba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='58548514-5dac-426c-81f5-19e3fba33e23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:59:26.822019 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-a94e6c58-eb6e-417c-a37d-3751ed06db88 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:26.840686 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-a94e6c58-eb6e-417c-a37d-3751ed06db88 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:26.842516 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-a94e6c58-eb6e-417c-a37d-3751ed06db88 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:26.862798 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-a94e6c58-eb6e-417c-a37d-3751ed06db88 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] 10.222.0.43 "GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984" status: 200 len: 1544 microversion: 2.91 time: 0.350408 Oct 04 21:59:26.867275 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1701/3449] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:59:26 2022] GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984 => generated 1544 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:59:26.892227 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-b6ac5a40-b5c1-47d4-942f-1fe3f2ef2b79 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Calling method '.version_select at 0x7fbb2f2bb700>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:26.905542 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-97342e9e-4689-4584-bb2b-690dfac4085f tempest-ServerMetadataNegativeTestJSON-1726578604 tempest-ServerMetadataNegativeTestJSON-1726578604-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.075592 Oct 04 21:59:26.907133 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1749/3450] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 21:59:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 3079 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:59:26.942113 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-f1dc2b2e-dcee-467f-b903-4488ab7e3432 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:26.943147 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-f1dc2b2e-dcee-467f-b903-4488ab7e3432 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] [instance: 4c17a63b-8492-4c9b-a0c2-34bef7051f80] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:26.953118 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f1dc2b2e-dcee-467f-b903-4488ab7e3432 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:26.953898 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f1dc2b2e-dcee-467f-b903-4488ab7e3432 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:26.954909 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f1dc2b2e-dcee-467f-b903-4488ab7e3432 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:26.955825 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f1dc2b2e-dcee-467f-b903-4488ab7e3432 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:26.956447 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f1dc2b2e-dcee-467f-b903-4488ab7e3432 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:26.957040 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f1dc2b2e-dcee-467f-b903-4488ab7e3432 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:27.070872 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-b6ac5a40-b5c1-47d4-942f-1fe3f2ef2b79 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] 10.222.0.43 "GET /compute/v2.1/images/a67847c0-608b-45c9-a5ac-a6e6f0e06b3a" status: 200 len: 1436 microversion: 2.1 time: 0.192960 Oct 04 21:59:27.072769 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1702/3451] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:59:26 2022] GET /compute/v2.1/images/a67847c0-608b-45c9-a5ac-a6e6f0e06b3a => generated 1436 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:59:27.089129 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-712a56d6-bf19-412e-9e33-64b89a881273 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:59:27.089671 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-712a56d6-bf19-412e-9e33-64b89a881273 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: a4cf4fac-1e9b-4669-a6ff-30008ed3642d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:27.125253 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-712a56d6-bf19-412e-9e33-64b89a881273 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:27.127187 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-712a56d6-bf19-412e-9e33-64b89a881273 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:27.135284 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-712a56d6-bf19-412e-9e33-64b89a881273 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:27.141414 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-712a56d6-bf19-412e-9e33-64b89a881273 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:27.142531 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-712a56d6-bf19-412e-9e33-64b89a881273 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:27.144270 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-712a56d6-bf19-412e-9e33-64b89a881273 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:27.239569 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.objects.instance [None req-712a56d6-bf19-412e-9e33-64b89a881273 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lazy-loading 'flavor' on Instance uuid a4cf4fac-1e9b-4669-a6ff-30008ed3642d {{(pid=134101) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:59:27.687740 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-f1dc2b2e-dcee-467f-b903-4488ab7e3432 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c7a1e7d6984644a68d967b5e3fe92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3994b89cac594e309926f1eaf785f7d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:27.704596 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-f1dc2b2e-dcee-467f-b903-4488ab7e3432 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] 10.222.0.43 "GET /compute/v2.1/servers/4c17a63b-8492-4c9b-a0c2-34bef7051f80" status: 200 len: 1292 microversion: 2.1 time: 0.796126 Oct 04 21:59:27.720672 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1750/3452] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:59:26 2022] GET /compute/v2.1/servers/4c17a63b-8492-4c9b-a0c2-34bef7051f80 => generated 1292 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:59:27.746466 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-6489fa13-340e-4fac-8788-d5b5eaf489f0 tempest-ServerMetadataNegativeTestJSON-1726578604 tempest-ServerMetadataNegativeTestJSON-1726578604-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:27.747748 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-6489fa13-340e-4fac-8788-d5b5eaf489f0 tempest-ServerMetadataNegativeTestJSON-1726578604 tempest-ServerMetadataNegativeTestJSON-1726578604-project] [instance: 34e510e1-0dd2-4799-8626-782c5f1912ba] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:28.311774 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-6489fa13-340e-4fac-8788-d5b5eaf489f0 tempest-ServerMetadataNegativeTestJSON-1726578604 tempest-ServerMetadataNegativeTestJSON-1726578604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f361ccb8eb4246f0bae1097edfe65096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8b3066186614f7fbf7644a0f5d6c953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:28.324355 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-6489fa13-340e-4fac-8788-d5b5eaf489f0 tempest-ServerMetadataNegativeTestJSON-1726578604 tempest-ServerMetadataNegativeTestJSON-1726578604-project] 10.222.0.43 "GET /compute/v2.1/servers/34e510e1-0dd2-4799-8626-782c5f1912ba" status: 200 len: 1223 microversion: 2.1 time: 0.594000 Oct 04 21:59:28.338957 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1751/3453] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:59:27 2022] GET /compute/v2.1/servers/34e510e1-0dd2-4799-8626-782c5f1912ba => generated 1223 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:59:28.365576 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-f2aca7dc-d19b-45c8-9f7e-652a6e08dace tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:28.368994 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-f2aca7dc-d19b-45c8-9f7e-652a6e08dace tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] [instance: d0b1b757-4a4d-4a7a-9a06-08f178a02984] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:28.389516 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f2aca7dc-d19b-45c8-9f7e-652a6e08dace tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:28.390209 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f2aca7dc-d19b-45c8-9f7e-652a6e08dace tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:28.394051 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f2aca7dc-d19b-45c8-9f7e-652a6e08dace tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:28.395014 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f2aca7dc-d19b-45c8-9f7e-652a6e08dace tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:28.395580 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f2aca7dc-d19b-45c8-9f7e-652a6e08dace tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:28.396268 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f2aca7dc-d19b-45c8-9f7e-652a6e08dace tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:28.647803 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-f2aca7dc-d19b-45c8-9f7e-652a6e08dace tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:28.715234 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-f2aca7dc-d19b-45c8-9f7e-652a6e08dace tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:28.730527 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-f2aca7dc-d19b-45c8-9f7e-652a6e08dace tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:28.758881 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-f2aca7dc-d19b-45c8-9f7e-652a6e08dace tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] 10.222.0.43 "GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984" status: 200 len: 1544 microversion: 2.91 time: 0.400755 Oct 04 21:59:28.760175 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1752/3454] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:59:28 2022] GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984 => generated 1544 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:59:29.032642 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-35d4ee61-3826-412d-9f7e-f0f98975dbf7 req-89a04f87-19fb-46f1-b73a-c23023cfc628 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c17a63b-8492-4c9b-a0c2-34bef7051f80", "name": "network-vif-plugged", "status": "completed", "tag": "353bf1c2-20f1-4ba8-8856-cc01db923973"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:59:29.092169 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-35d4ee61-3826-412d-9f7e-f0f98975dbf7 req-89a04f87-19fb-46f1-b73a-c23023cfc628 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:29.095764 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-35d4ee61-3826-412d-9f7e-f0f98975dbf7 req-89a04f87-19fb-46f1-b73a-c23023cfc628 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:29.097108 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-35d4ee61-3826-412d-9f7e-f0f98975dbf7 req-89a04f87-19fb-46f1-b73a-c23023cfc628 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:29.159324 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-35d4ee61-3826-412d-9f7e-f0f98975dbf7 req-89a04f87-19fb-46f1-b73a-c23023cfc628 service nova] Creating event network-vif-plugged:353bf1c2-20f1-4ba8-8856-cc01db923973 for instance 4c17a63b-8492-4c9b-a0c2-34bef7051f80 on n-h2-860284-1 Oct 04 21:59:29.187428 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-35d4ee61-3826-412d-9f7e-f0f98975dbf7 req-89a04f87-19fb-46f1-b73a-c23023cfc628 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.425842 Oct 04 21:59:29.188073 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1753/3455] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:59:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:59:29.226082 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-28926f64-251e-423d-98d8-fc87af905aea tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Calling method '.version_select at 0x7fbb2f0b7c10>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:36.697067 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell0:SELECT=2 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:59:37.122516 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=85 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:59:37.414133 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:59:38.316736 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell0:SELECT=8 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:59:39.088027 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:59:39.116950 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:59:43.271842 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-712a56d6-bf19-412e-9e33-64b89a881273 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "POST /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d/action" status: 202 len: 0 microversion: 2.1 time: 16.192273 Oct 04 21:59:43.271842 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1703/3456] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 21:59:27 2022] POST /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d/action => generated 0 bytes in 16198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:59:43.283373 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-9bc53df3-6e4f-414f-bcd6-8a71571f43f8 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:43.284343 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-9bc53df3-6e4f-414f-bcd6-8a71571f43f8 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] [instance: 4c17a63b-8492-4c9b-a0c2-34bef7051f80] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:43.297051 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-28926f64-251e-423d-98d8-fc87af905aea tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] 10.222.0.43 "GET /compute/v2.1/images/a67847c0-608b-45c9-a5ac-a6e6f0e06b3a" status: 200 len: 1445 microversion: 2.1 time: 14.104479 Oct 04 21:59:43.302340 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1754/3457] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:59:29 2022] GET /compute/v2.1/images/a67847c0-608b-45c9-a5ac-a6e6f0e06b3a => generated 1445 bytes in 14113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:59:43.303431 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9bc53df3-6e4f-414f-bcd6-8a71571f43f8 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:43.307037 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9bc53df3-6e4f-414f-bcd6-8a71571f43f8 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:43.312773 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9bc53df3-6e4f-414f-bcd6-8a71571f43f8 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:43.314064 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9bc53df3-6e4f-414f-bcd6-8a71571f43f8 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:43.316941 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9bc53df3-6e4f-414f-bcd6-8a71571f43f8 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:43.317188 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-1233da46-f5b3-437c-9c83-abc12573c831 tempest-ServerMetadataNegativeTestJSON-1726578604 tempest-ServerMetadataNegativeTestJSON-1726578604-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:43.317562 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9bc53df3-6e4f-414f-bcd6-8a71571f43f8 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:43.322620 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-1233da46-f5b3-437c-9c83-abc12573c831 tempest-ServerMetadataNegativeTestJSON-1726578604 tempest-ServerMetadataNegativeTestJSON-1726578604-project] [instance: 34e510e1-0dd2-4799-8626-782c5f1912ba] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:43.360929 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1233da46-f5b3-437c-9c83-abc12573c831 tempest-ServerMetadataNegativeTestJSON-1726578604 tempest-ServerMetadataNegativeTestJSON-1726578604-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:43.364357 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1233da46-f5b3-437c-9c83-abc12573c831 tempest-ServerMetadataNegativeTestJSON-1726578604 tempest-ServerMetadataNegativeTestJSON-1726578604-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:43.364357 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1233da46-f5b3-437c-9c83-abc12573c831 tempest-ServerMetadataNegativeTestJSON-1726578604 tempest-ServerMetadataNegativeTestJSON-1726578604-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:43.368427 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1233da46-f5b3-437c-9c83-abc12573c831 tempest-ServerMetadataNegativeTestJSON-1726578604 tempest-ServerMetadataNegativeTestJSON-1726578604-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:43.369140 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1233da46-f5b3-437c-9c83-abc12573c831 tempest-ServerMetadataNegativeTestJSON-1726578604 tempest-ServerMetadataNegativeTestJSON-1726578604-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:43.370403 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1233da46-f5b3-437c-9c83-abc12573c831 tempest-ServerMetadataNegativeTestJSON-1726578604 tempest-ServerMetadataNegativeTestJSON-1726578604-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:43.929717 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-1233da46-f5b3-437c-9c83-abc12573c831 tempest-ServerMetadataNegativeTestJSON-1726578604 tempest-ServerMetadataNegativeTestJSON-1726578604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f361ccb8eb4246f0bae1097edfe65096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8b3066186614f7fbf7644a0f5d6c953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:43.960917 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-1233da46-f5b3-437c-9c83-abc12573c831 tempest-ServerMetadataNegativeTestJSON-1726578604 tempest-ServerMetadataNegativeTestJSON-1726578604-project] 10.222.0.43 "GET /compute/v2.1/servers/34e510e1-0dd2-4799-8626-782c5f1912ba" status: 200 len: 1323 microversion: 2.1 time: 0.653310 Oct 04 21:59:43.979541 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-9bc53df3-6e4f-414f-bcd6-8a71571f43f8 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c7a1e7d6984644a68d967b5e3fe92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3994b89cac594e309926f1eaf785f7d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:43.987794 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1755/3458] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:59:43 2022] GET /compute/v2.1/servers/34e510e1-0dd2-4799-8626-782c5f1912ba => generated 1323 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:59:43.999879 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-9bc53df3-6e4f-414f-bcd6-8a71571f43f8 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] 10.222.0.43 "GET /compute/v2.1/servers/4c17a63b-8492-4c9b-a0c2-34bef7051f80" status: 200 len: 1482 microversion: 2.1 time: 0.726976 Oct 04 21:59:44.000547 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1704/3459] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:59:43 2022] GET /compute/v2.1/servers/4c17a63b-8492-4c9b-a0c2-34bef7051f80 => generated 1482 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:59:44.012769 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-cd97331c-dda3-4271-8481-6a1d71eb7bd4 req-3e5657dd-8684-4aa1-b3d6-6d7793b08663 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34e510e1-0dd2-4799-8626-782c5f1912ba", "tag": "453141a6-ef52-47a6-a94e-ec4b7ea37b8e"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:59:44.015653 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-c1b67796-1cf6-4a28-82d1-93fa783a307b tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:44.016300 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-c1b67796-1cf6-4a28-82d1-93fa783a307b tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] [instance: d0b1b757-4a4d-4a7a-9a06-08f178a02984] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:44.058546 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-cd97331c-dda3-4271-8481-6a1d71eb7bd4 req-3e5657dd-8684-4aa1-b3d6-6d7793b08663 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:44.063990 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c1b67796-1cf6-4a28-82d1-93fa783a307b tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:44.064884 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c1b67796-1cf6-4a28-82d1-93fa783a307b tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:44.065915 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-cd97331c-dda3-4271-8481-6a1d71eb7bd4 req-3e5657dd-8684-4aa1-b3d6-6d7793b08663 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:44.072482 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-cd97331c-dda3-4271-8481-6a1d71eb7bd4 req-3e5657dd-8684-4aa1-b3d6-6d7793b08663 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:44.072758 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c1b67796-1cf6-4a28-82d1-93fa783a307b tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:44.074008 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c1b67796-1cf6-4a28-82d1-93fa783a307b tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:44.078175 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c1b67796-1cf6-4a28-82d1-93fa783a307b tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:44.085332 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c1b67796-1cf6-4a28-82d1-93fa783a307b tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:44.098491 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-cd97331c-dda3-4271-8481-6a1d71eb7bd4 req-3e5657dd-8684-4aa1-b3d6-6d7793b08663 service nova] Creating event network-changed:453141a6-ef52-47a6-a94e-ec4b7ea37b8e for instance 34e510e1-0dd2-4799-8626-782c5f1912ba on n-h1-860284-1 Oct 04 21:59:44.108525 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-cd97331c-dda3-4271-8481-6a1d71eb7bd4 req-3e5657dd-8684-4aa1-b3d6-6d7793b08663 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105779 Oct 04 21:59:44.117351 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1705/3460] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:59:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:59:44.124723 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-4059cb64-e4f8-4731-aa4a-e7c39bc6d5c6 req-a10d15ba-84a1-4864-ad47-91d6edf647ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34e510e1-0dd2-4799-8626-782c5f1912ba", "name": "network-vif-plugged", "status": "completed", "tag": "453141a6-ef52-47a6-a94e-ec4b7ea37b8e"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:59:44.152234 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-4059cb64-e4f8-4731-aa4a-e7c39bc6d5c6 req-a10d15ba-84a1-4864-ad47-91d6edf647ee service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:44.153058 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-4059cb64-e4f8-4731-aa4a-e7c39bc6d5c6 req-a10d15ba-84a1-4864-ad47-91d6edf647ee service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:44.157201 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-4059cb64-e4f8-4731-aa4a-e7c39bc6d5c6 req-a10d15ba-84a1-4864-ad47-91d6edf647ee service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:44.184764 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-4059cb64-e4f8-4731-aa4a-e7c39bc6d5c6 req-a10d15ba-84a1-4864-ad47-91d6edf647ee service nova] Creating event network-vif-plugged:453141a6-ef52-47a6-a94e-ec4b7ea37b8e for instance 34e510e1-0dd2-4799-8626-782c5f1912ba on n-h1-860284-1 Oct 04 21:59:44.199289 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-4059cb64-e4f8-4731-aa4a-e7c39bc6d5c6 req-a10d15ba-84a1-4864-ad47-91d6edf647ee service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079973 Oct 04 21:59:44.200498 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1706/3461] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:59:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:59:44.206786 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-7f247928-7841-431c-9a1b-05f0ac7da99f tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:44.218665 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-7f247928-7841-431c-9a1b-05f0ac7da99f tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: a4cf4fac-1e9b-4669-a6ff-30008ed3642d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:44.225872 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7f247928-7841-431c-9a1b-05f0ac7da99f tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:44.228149 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7f247928-7841-431c-9a1b-05f0ac7da99f tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:44.228849 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7f247928-7841-431c-9a1b-05f0ac7da99f tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:44.232588 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7f247928-7841-431c-9a1b-05f0ac7da99f tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:44.234672 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7f247928-7841-431c-9a1b-05f0ac7da99f tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:44.235379 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7f247928-7841-431c-9a1b-05f0ac7da99f tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:44.337618 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-c1b67796-1cf6-4a28-82d1-93fa783a307b tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:44.356741 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-c1b67796-1cf6-4a28-82d1-93fa783a307b tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:44.370223 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-c1b67796-1cf6-4a28-82d1-93fa783a307b tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:44.405848 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-c1b67796-1cf6-4a28-82d1-93fa783a307b tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] 10.222.0.43 "GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984" status: 200 len: 1544 microversion: 2.91 time: 0.413015 Oct 04 21:59:44.410724 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1756/3462] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:59:43 2022] GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984 => generated 1544 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:59:44.448291 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-e64f51e3-1b6d-41a0-93b1-f84ace13abf1 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Calling method '.version_select at 0x7fbb2efef9d0>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:44.573720 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-7f247928-7841-431c-9a1b-05f0ac7da99f tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2facee4c6a40416e908083e126d2cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07a17a482a4e92b6ddbdee463c8029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:44.597386 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-7f247928-7841-431c-9a1b-05f0ac7da99f tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d" status: 200 len: 1510 microversion: 2.1 time: 0.394707 Oct 04 21:59:44.600732 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1707/3463] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:59:44 2022] GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d => generated 1510 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:59:44.615778 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-f35ab1cf-973e-46f8-b5f1-1527d2aafb1b tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:44.616660 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-f35ab1cf-973e-46f8-b5f1-1527d2aafb1b tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] [instance: 4c17a63b-8492-4c9b-a0c2-34bef7051f80] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:44.625755 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-e64f51e3-1b6d-41a0-93b1-f84ace13abf1 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] 10.222.0.43 "GET /compute/v2.1/images/a67847c0-608b-45c9-a5ac-a6e6f0e06b3a" status: 200 len: 1445 microversion: 2.1 time: 0.207581 Oct 04 21:59:44.633286 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f35ab1cf-973e-46f8-b5f1-1527d2aafb1b tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:44.634599 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f35ab1cf-973e-46f8-b5f1-1527d2aafb1b tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:44.635643 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f35ab1cf-973e-46f8-b5f1-1527d2aafb1b tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:44.639396 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f35ab1cf-973e-46f8-b5f1-1527d2aafb1b tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:44.640344 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f35ab1cf-973e-46f8-b5f1-1527d2aafb1b tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:44.640981 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f35ab1cf-973e-46f8-b5f1-1527d2aafb1b tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:44.641318 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1757/3464] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 21:59:44 2022] GET /compute/v2.1/images/a67847c0-608b-45c9-a5ac-a6e6f0e06b3a => generated 1445 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:59:44.677111 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-3ed922ae-8e37-4ebf-a9ec-0d01402bfb29 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Calling method '.version_select at 0x7fbb2efc0dc0>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:45.509836 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-f35ab1cf-973e-46f8-b5f1-1527d2aafb1b tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] 10.222.0.43 "GET /compute/v2.1/servers/4c17a63b-8492-4c9b-a0c2-34bef7051f80/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.902158 Oct 04 21:59:45.509836 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1708/3465] 10.222.0.43 () {58 vars in 1275 bytes} [Tue Oct 4 21:59:44 2022] GET /compute/v2.1/servers/4c17a63b-8492-4c9b-a0c2-34bef7051f80/os-interface => generated 284 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:59:45.514603 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-03a3190e-acff-4aad-b070-dc76a4a65943 tempest-ServerMetadataNegativeTestJSON-1726578604 tempest-ServerMetadataNegativeTestJSON-1726578604-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:45.515663 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-03a3190e-acff-4aad-b070-dc76a4a65943 tempest-ServerMetadataNegativeTestJSON-1726578604 tempest-ServerMetadataNegativeTestJSON-1726578604-project] [instance: 34e510e1-0dd2-4799-8626-782c5f1912ba] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:45.527633 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-03a3190e-acff-4aad-b070-dc76a4a65943 tempest-ServerMetadataNegativeTestJSON-1726578604 tempest-ServerMetadataNegativeTestJSON-1726578604-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:45.528729 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-03a3190e-acff-4aad-b070-dc76a4a65943 tempest-ServerMetadataNegativeTestJSON-1726578604 tempest-ServerMetadataNegativeTestJSON-1726578604-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:45.530013 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-03a3190e-acff-4aad-b070-dc76a4a65943 tempest-ServerMetadataNegativeTestJSON-1726578604 tempest-ServerMetadataNegativeTestJSON-1726578604-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:45.531414 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-03a3190e-acff-4aad-b070-dc76a4a65943 tempest-ServerMetadataNegativeTestJSON-1726578604 tempest-ServerMetadataNegativeTestJSON-1726578604-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:45.532150 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-03a3190e-acff-4aad-b070-dc76a4a65943 tempest-ServerMetadataNegativeTestJSON-1726578604 tempest-ServerMetadataNegativeTestJSON-1726578604-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:45.532824 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-03a3190e-acff-4aad-b070-dc76a4a65943 tempest-ServerMetadataNegativeTestJSON-1726578604 tempest-ServerMetadataNegativeTestJSON-1726578604-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:46.381513 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-03a3190e-acff-4aad-b070-dc76a4a65943 tempest-ServerMetadataNegativeTestJSON-1726578604 tempest-ServerMetadataNegativeTestJSON-1726578604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f361ccb8eb4246f0bae1097edfe65096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8b3066186614f7fbf7644a0f5d6c953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:46.399700 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-03a3190e-acff-4aad-b070-dc76a4a65943 tempest-ServerMetadataNegativeTestJSON-1726578604 tempest-ServerMetadataNegativeTestJSON-1726578604-project] 10.222.0.43 "GET /compute/v2.1/servers/34e510e1-0dd2-4799-8626-782c5f1912ba" status: 200 len: 1323 microversion: 2.1 time: 0.891087 Oct 04 21:59:46.400506 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1709/3466] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:59:45 2022] GET /compute/v2.1/servers/34e510e1-0dd2-4799-8626-782c5f1912ba => generated 1323 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:59:46.412028 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-57b9c337-1083-43a0-8127-a84ecc869791 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:46.416345 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-57b9c337-1083-43a0-8127-a84ecc869791 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] [instance: d0b1b757-4a4d-4a7a-9a06-08f178a02984] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:46.431373 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-57b9c337-1083-43a0-8127-a84ecc869791 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:46.433536 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-57b9c337-1083-43a0-8127-a84ecc869791 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:46.435064 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-57b9c337-1083-43a0-8127-a84ecc869791 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:46.439335 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-57b9c337-1083-43a0-8127-a84ecc869791 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:46.440238 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-57b9c337-1083-43a0-8127-a84ecc869791 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:46.441069 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-57b9c337-1083-43a0-8127-a84ecc869791 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:46.447503 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-3ed922ae-8e37-4ebf-a9ec-0d01402bfb29 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] 10.222.0.43 "DELETE /compute/v2.1/images/a67847c0-608b-45c9-a5ac-a6e6f0e06b3a" status: 204 len: 0 microversion: 2.1 time: 1.786365 Oct 04 21:59:46.449141 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1758/3467] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:59:44 2022] DELETE /compute/v2.1/images/a67847c0-608b-45c9-a5ac-a6e6f0e06b3a => generated 0 bytes in 1791 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:59:46.456740 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-9b05bc5c-f901-455c-afbc-4604e6e372df tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:46.457397 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-9b05bc5c-f901-455c-afbc-4604e6e372df tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: a4cf4fac-1e9b-4669-a6ff-30008ed3642d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:46.464855 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9b05bc5c-f901-455c-afbc-4604e6e372df tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:46.465439 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9b05bc5c-f901-455c-afbc-4604e6e372df tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:46.465962 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9b05bc5c-f901-455c-afbc-4604e6e372df tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:46.467537 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9b05bc5c-f901-455c-afbc-4604e6e372df tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:46.470019 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9b05bc5c-f901-455c-afbc-4604e6e372df tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:46.471515 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9b05bc5c-f901-455c-afbc-4604e6e372df tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:46.726053 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-57b9c337-1083-43a0-8127-a84ecc869791 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:46.741285 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-57b9c337-1083-43a0-8127-a84ecc869791 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:46.744137 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-57b9c337-1083-43a0-8127-a84ecc869791 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:46.765974 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-57b9c337-1083-43a0-8127-a84ecc869791 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] 10.222.0.43 "GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984" status: 200 len: 1544 microversion: 2.91 time: 0.363680 Oct 04 21:59:46.768096 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1710/3468] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:59:46 2022] GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984 => generated 1544 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:59:46.783394 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-624bd863-44c4-4ae5-9955-006896f16b7f tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:46.784230 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-624bd863-44c4-4ae5-9955-006896f16b7f tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] [instance: e57b3eb4-9ac6-4f6b-bbe1-a8582bdf543b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:46.797223 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-624bd863-44c4-4ae5-9955-006896f16b7f tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:46.797947 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-624bd863-44c4-4ae5-9955-006896f16b7f tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:46.799614 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-624bd863-44c4-4ae5-9955-006896f16b7f tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:46.801553 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-624bd863-44c4-4ae5-9955-006896f16b7f tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:46.803374 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-624bd863-44c4-4ae5-9955-006896f16b7f tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:46.804183 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-624bd863-44c4-4ae5-9955-006896f16b7f tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:46.867668 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-624bd863-44c4-4ae5-9955-006896f16b7f tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] [instance: e57b3eb4-9ac6-4f6b-bbe1-a8582bdf543b] Going to try to terminate instance {{(pid=134101) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:59:47.033686 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-9b05bc5c-f901-455c-afbc-4604e6e372df tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2facee4c6a40416e908083e126d2cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07a17a482a4e92b6ddbdee463c8029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:47.054146 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-9b05bc5c-f901-455c-afbc-4604e6e372df tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d" status: 200 len: 1510 microversion: 2.1 time: 0.603154 Oct 04 21:59:47.056519 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1759/3469] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:59:46 2022] GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d => generated 1510 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:59:47.107165 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-624bd863-44c4-4ae5-9955-006896f16b7f tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] 10.222.0.43 "DELETE /compute/v2.1/servers/e57b3eb4-9ac6-4f6b-bbe1-a8582bdf543b" status: 204 len: 0 microversion: 2.1 time: 0.337464 Oct 04 21:59:47.108306 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1711/3470] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 21:59:46 2022] DELETE /compute/v2.1/servers/e57b3eb4-9ac6-4f6b-bbe1-a8582bdf543b => generated 0 bytes in 340 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:59:47.360011 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-a9dc1080-ece6-4e60-a853-3684c3324ef9 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-488521068", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452", "networks": [{"uuid": "7f0614ac-f6a1-4d4e-8554-b89cfa5772c4"}]}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:59:47.432750 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-cba7173d-6a7c-40b9-932e-fec18f25574f tempest-ServerMetadataNegativeTestJSON-1726578604 tempest-ServerMetadataNegativeTestJSON-1726578604-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:47.434793 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-cba7173d-6a7c-40b9-932e-fec18f25574f tempest-ServerMetadataNegativeTestJSON-1726578604 tempest-ServerMetadataNegativeTestJSON-1726578604-project] [instance: 34e510e1-0dd2-4799-8626-782c5f1912ba] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:47.473120 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cba7173d-6a7c-40b9-932e-fec18f25574f tempest-ServerMetadataNegativeTestJSON-1726578604 tempest-ServerMetadataNegativeTestJSON-1726578604-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:47.485278 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cba7173d-6a7c-40b9-932e-fec18f25574f tempest-ServerMetadataNegativeTestJSON-1726578604 tempest-ServerMetadataNegativeTestJSON-1726578604-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:47.490805 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cba7173d-6a7c-40b9-932e-fec18f25574f tempest-ServerMetadataNegativeTestJSON-1726578604 tempest-ServerMetadataNegativeTestJSON-1726578604-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:47.493771 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cba7173d-6a7c-40b9-932e-fec18f25574f tempest-ServerMetadataNegativeTestJSON-1726578604 tempest-ServerMetadataNegativeTestJSON-1726578604-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:47.496029 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.network.neutron [None req-a9dc1080-ece6-4e60-a853-3684c3324ef9 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] validate_networks() for [('7f0614ac-f6a1-4d4e-8554-b89cfa5772c4', None, None, None, None, None)] {{(pid=134102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:59:47.497420 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cba7173d-6a7c-40b9-932e-fec18f25574f tempest-ServerMetadataNegativeTestJSON-1726578604 tempest-ServerMetadataNegativeTestJSON-1726578604-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:47.499337 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cba7173d-6a7c-40b9-932e-fec18f25574f tempest-ServerMetadataNegativeTestJSON-1726578604 tempest-ServerMetadataNegativeTestJSON-1726578604-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:48.920625 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-cba7173d-6a7c-40b9-932e-fec18f25574f tempest-ServerMetadataNegativeTestJSON-1726578604 tempest-ServerMetadataNegativeTestJSON-1726578604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f361ccb8eb4246f0bae1097edfe65096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8b3066186614f7fbf7644a0f5d6c953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:48.939276 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-cba7173d-6a7c-40b9-932e-fec18f25574f tempest-ServerMetadataNegativeTestJSON-1726578604 tempest-ServerMetadataNegativeTestJSON-1726578604-project] 10.222.0.43 "GET /compute/v2.1/servers/34e510e1-0dd2-4799-8626-782c5f1912ba" status: 200 len: 1323 microversion: 2.1 time: 1.515271 Oct 04 21:59:48.950843 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1712/3471] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:59:47 2022] GET /compute/v2.1/servers/34e510e1-0dd2-4799-8626-782c5f1912ba => generated 1323 bytes in 1524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:59:48.954662 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-3149e208-aaaf-4d56-a8d2-59702252bb46 req-1efc05f8-6330-4040-b812-e9d5cb8cd273 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e57b3eb4-9ac6-4f6b-bbe1-a8582bdf543b", "name": "network-vif-unplugged", "status": "completed", "tag": "7bf70467-e6c6-44c5-b9e5-a3641cdfe409"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:59:48.981303 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-3149e208-aaaf-4d56-a8d2-59702252bb46 req-1efc05f8-6330-4040-b812-e9d5cb8cd273 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:48.981901 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-3149e208-aaaf-4d56-a8d2-59702252bb46 req-1efc05f8-6330-4040-b812-e9d5cb8cd273 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:48.984157 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-3149e208-aaaf-4d56-a8d2-59702252bb46 req-1efc05f8-6330-4040-b812-e9d5cb8cd273 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:49.002475 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-3149e208-aaaf-4d56-a8d2-59702252bb46 req-1efc05f8-6330-4040-b812-e9d5cb8cd273 service nova] Creating event network-vif-unplugged:7bf70467-e6c6-44c5-b9e5-a3641cdfe409 for instance e57b3eb4-9ac6-4f6b-bbe1-a8582bdf543b on n-h1-860284-1 Oct 04 21:59:49.008308 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-3149e208-aaaf-4d56-a8d2-59702252bb46 req-1efc05f8-6330-4040-b812-e9d5cb8cd273 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.059574 Oct 04 21:59:49.009520 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1713/3472] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:59:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:59:49.024935 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-30ce79ff-db41-412f-b449-74977895ed4e tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:49.026081 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-30ce79ff-db41-412f-b449-74977895ed4e tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] [instance: d0b1b757-4a4d-4a7a-9a06-08f178a02984] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:49.034915 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-30ce79ff-db41-412f-b449-74977895ed4e tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:49.035813 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-30ce79ff-db41-412f-b449-74977895ed4e tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:49.036518 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-30ce79ff-db41-412f-b449-74977895ed4e tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:49.038141 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-30ce79ff-db41-412f-b449-74977895ed4e tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:49.039226 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-30ce79ff-db41-412f-b449-74977895ed4e tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:49.039934 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-30ce79ff-db41-412f-b449-74977895ed4e tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:49.246053 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-30ce79ff-db41-412f-b449-74977895ed4e tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:49.257656 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-30ce79ff-db41-412f-b449-74977895ed4e tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:49.260812 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-30ce79ff-db41-412f-b449-74977895ed4e tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:49.267939 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-30ce79ff-db41-412f-b449-74977895ed4e tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] 10.222.0.43 "GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984" status: 200 len: 1544 microversion: 2.91 time: 0.255935 Oct 04 21:59:49.268640 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1714/3473] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:59:49 2022] GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984 => generated 1544 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:59:49.296768 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-92a81cf4-9f1d-4011-add4-d810a6fab84c tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:49.297323 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-92a81cf4-9f1d-4011-add4-d810a6fab84c tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: a4cf4fac-1e9b-4669-a6ff-30008ed3642d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:49.303734 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-92a81cf4-9f1d-4011-add4-d810a6fab84c tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:49.304286 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-92a81cf4-9f1d-4011-add4-d810a6fab84c tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:49.304729 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-92a81cf4-9f1d-4011-add4-d810a6fab84c tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:49.305568 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-92a81cf4-9f1d-4011-add4-d810a6fab84c tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:49.306046 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-92a81cf4-9f1d-4011-add4-d810a6fab84c tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:49.306529 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-92a81cf4-9f1d-4011-add4-d810a6fab84c tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:49.600402 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-a9dc1080-ece6-4e60-a853-3684c3324ef9 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Flavor limits 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:59:49.601857 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-a9dc1080-ece6-4e60-a853-3684c3324ef9 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Image limits 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:59:49.602623 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-a9dc1080-ece6-4e60-a853-3684c3324ef9 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Flavor pref 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:59:49.603463 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-a9dc1080-ece6-4e60-a853-3684c3324ef9 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Image pref 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:59:49.604077 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-a9dc1080-ece6-4e60-a853-3684c3324ef9 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:59:49.621581 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a9dc1080-ece6-4e60-a853-3684c3324ef9 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:49.622295 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a9dc1080-ece6-4e60-a853-3684c3324ef9 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:49.623324 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a9dc1080-ece6-4e60-a853-3684c3324ef9 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:49.624745 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a9dc1080-ece6-4e60-a853-3684c3324ef9 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:49.635974 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a9dc1080-ece6-4e60-a853-3684c3324ef9 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:49.637875 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a9dc1080-ece6-4e60-a853-3684c3324ef9 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:49.666071 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-a9dc1080-ece6-4e60-a853-3684c3324ef9 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Getting quotas for project 40071e45805146529fb8abd40629c2ae. Resources: {'instances', 'ram', 'cores'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:59:49.672257 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-a9dc1080-ece6-4e60-a853-3684c3324ef9 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Getting quotas for user f5e807c724cc4c3887a2d360f0584ffb and project 40071e45805146529fb8abd40629c2ae. Resources: {'instances', 'ram', 'cores'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:59:49.689158 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-a9dc1080-ece6-4e60-a853-3684c3324ef9 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Going to run 1 instances... {{(pid=134102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:59:49.692213 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-a9dc1080-ece6-4e60-a853-3684c3324ef9 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] [instance: 1b71cb4e-4f72-4c5d-a936-2ffc991910d9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='58548514-5dac-426c-81f5-19e3fba33e23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:59:49.768146 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-92a81cf4-9f1d-4011-add4-d810a6fab84c tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2facee4c6a40416e908083e126d2cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07a17a482a4e92b6ddbdee463c8029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:49.783300 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-a9dc1080-ece6-4e60-a853-3684c3324ef9 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.425160 Oct 04 21:59:49.791331 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1760/3474] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 21:59:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 2431 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:59:49.791622 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-92a81cf4-9f1d-4011-add4-d810a6fab84c tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d" status: 200 len: 1510 microversion: 2.1 time: 0.504109 Oct 04 21:59:49.791622 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1715/3475] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:59:49 2022] GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d => generated 1510 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:59:49.808181 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-e3435f79-84cc-40d4-b7b4-fb0a57ccf676 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:49.812132 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-e3435f79-84cc-40d4-b7b4-fb0a57ccf676 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] [instance: 1b71cb4e-4f72-4c5d-a936-2ffc991910d9] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:49.949307 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-e3435f79-84cc-40d4-b7b4-fb0a57ccf676 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e807c724cc4c3887a2d360f0584ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40071e45805146529fb8abd40629c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:49.959238 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-e3435f79-84cc-40d4-b7b4-fb0a57ccf676 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] 10.222.0.43 "GET /compute/v2.1/servers/1b71cb4e-4f72-4c5d-a936-2ffc991910d9" status: 200 len: 1207 microversion: 2.1 time: 0.155062 Oct 04 21:59:49.981549 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-4dc28ac5-d35e-4c6b-a75b-60baebe95f03 tempest-ServerMetadataNegativeTestJSON-1726578604 tempest-ServerMetadataNegativeTestJSON-1726578604-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:49.984198 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-4dc28ac5-d35e-4c6b-a75b-60baebe95f03 tempest-ServerMetadataNegativeTestJSON-1726578604 tempest-ServerMetadataNegativeTestJSON-1726578604-project] [instance: 34e510e1-0dd2-4799-8626-782c5f1912ba] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:49.990389 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1761/3476] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:59:49 2022] GET /compute/v2.1/servers/1b71cb4e-4f72-4c5d-a936-2ffc991910d9 => generated 1207 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:59:49.993072 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4dc28ac5-d35e-4c6b-a75b-60baebe95f03 tempest-ServerMetadataNegativeTestJSON-1726578604 tempest-ServerMetadataNegativeTestJSON-1726578604-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:49.994207 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4dc28ac5-d35e-4c6b-a75b-60baebe95f03 tempest-ServerMetadataNegativeTestJSON-1726578604 tempest-ServerMetadataNegativeTestJSON-1726578604-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:49.995047 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4dc28ac5-d35e-4c6b-a75b-60baebe95f03 tempest-ServerMetadataNegativeTestJSON-1726578604 tempest-ServerMetadataNegativeTestJSON-1726578604-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:49.995374 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4dc28ac5-d35e-4c6b-a75b-60baebe95f03 tempest-ServerMetadataNegativeTestJSON-1726578604 tempest-ServerMetadataNegativeTestJSON-1726578604-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:49.995834 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4dc28ac5-d35e-4c6b-a75b-60baebe95f03 tempest-ServerMetadataNegativeTestJSON-1726578604 tempest-ServerMetadataNegativeTestJSON-1726578604-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:49.996511 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4dc28ac5-d35e-4c6b-a75b-60baebe95f03 tempest-ServerMetadataNegativeTestJSON-1726578604 tempest-ServerMetadataNegativeTestJSON-1726578604-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:50.302053 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-d64fe04c-55c9-412d-b929-60a2ae0ef51c tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:50.303124 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-d64fe04c-55c9-412d-b929-60a2ae0ef51c tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] [instance: d0b1b757-4a4d-4a7a-9a06-08f178a02984] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:50.311347 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d64fe04c-55c9-412d-b929-60a2ae0ef51c tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:50.312244 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d64fe04c-55c9-412d-b929-60a2ae0ef51c tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:50.312885 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d64fe04c-55c9-412d-b929-60a2ae0ef51c tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:50.314031 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d64fe04c-55c9-412d-b929-60a2ae0ef51c tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:50.314886 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d64fe04c-55c9-412d-b929-60a2ae0ef51c tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:50.315835 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d64fe04c-55c9-412d-b929-60a2ae0ef51c tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:50.396892 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-4dc28ac5-d35e-4c6b-a75b-60baebe95f03 tempest-ServerMetadataNegativeTestJSON-1726578604 tempest-ServerMetadataNegativeTestJSON-1726578604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f361ccb8eb4246f0bae1097edfe65096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8b3066186614f7fbf7644a0f5d6c953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:50.407009 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-4dc28ac5-d35e-4c6b-a75b-60baebe95f03 tempest-ServerMetadataNegativeTestJSON-1726578604 tempest-ServerMetadataNegativeTestJSON-1726578604-project] 10.222.0.43 "GET /compute/v2.1/servers/34e510e1-0dd2-4799-8626-782c5f1912ba" status: 200 len: 1518 microversion: 2.1 time: 0.430751 Oct 04 21:59:50.419552 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1716/3477] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:59:49 2022] GET /compute/v2.1/servers/34e510e1-0dd2-4799-8626-782c5f1912ba => generated 1518 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:59:50.429937 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-21dd6eda-e22a-41d2-903a-8c2fc3abc308 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:50.430873 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-21dd6eda-e22a-41d2-903a-8c2fc3abc308 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] [instance: 4c17a63b-8492-4c9b-a0c2-34bef7051f80] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:50.440789 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-21dd6eda-e22a-41d2-903a-8c2fc3abc308 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:50.441501 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-21dd6eda-e22a-41d2-903a-8c2fc3abc308 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:50.445003 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-21dd6eda-e22a-41d2-903a-8c2fc3abc308 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:50.445960 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-21dd6eda-e22a-41d2-903a-8c2fc3abc308 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:50.446642 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-21dd6eda-e22a-41d2-903a-8c2fc3abc308 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:50.447263 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-21dd6eda-e22a-41d2-903a-8c2fc3abc308 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:50.501928 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-d64fe04c-55c9-412d-b929-60a2ae0ef51c tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:50.526995 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-d64fe04c-55c9-412d-b929-60a2ae0ef51c tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:50.535763 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-d64fe04c-55c9-412d-b929-60a2ae0ef51c tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:50.550589 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-d64fe04c-55c9-412d-b929-60a2ae0ef51c tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] 10.222.0.43 "GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984" status: 200 len: 1544 microversion: 2.91 time: 0.253077 Oct 04 21:59:50.554033 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1762/3478] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:59:50 2022] GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984 => generated 1544 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:59:50.700149 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-21dd6eda-e22a-41d2-903a-8c2fc3abc308 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c7a1e7d6984644a68d967b5e3fe92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3994b89cac594e309926f1eaf785f7d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:50.713603 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-21dd6eda-e22a-41d2-903a-8c2fc3abc308 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] 10.222.0.43 "GET /compute/v2.1/servers/4c17a63b-8492-4c9b-a0c2-34bef7051f80" status: 200 len: 1482 microversion: 2.1 time: 0.287490 Oct 04 21:59:50.715341 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1717/3479] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:59:50 2022] GET /compute/v2.1/servers/4c17a63b-8492-4c9b-a0c2-34bef7051f80 => generated 1482 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:59:50.753705 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-1e93866e-4e31-4543-8ff4-3d20b5c4b73c tempest-ServerMetadataNegativeTestJSON-1726578604 tempest-ServerMetadataNegativeTestJSON-1726578604-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-788150196", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "007ad08c-9157-4f93-9f8e-95a8ac2cb59c"}]}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:59:50.758403 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-1e93866e-4e31-4543-8ff4-3d20b5c4b73c tempest-ServerMetadataNegativeTestJSON-1726578604 tempest-ServerMetadataNegativeTestJSON-1726578604-project] Request method failure captured: Oct 04 21:59:50.758403 n-d-860284-1 devstack@n-api.service[134101]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 21:59:50.758403 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 21:59:50.758403 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 21:59:50.758403 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 21:59:50.758403 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 242 Oct 04 21:59:50.758403 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 21:59:50.758403 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 21:59:50.758403 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 21:59:50.758403 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 21:59:50.758403 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPKy7U6KAomJVBMOi5c5sKO1DBIOQh-o-PMZPWGelB_lBNhsk9b6911Uzvij9WsUDS6Gs7utGKR5vevcxUgdjq23D7vwWQGpYYY17XbHFHztBSH6tvk25FXD4JKeR3_F1kgR8sz9CLO6rH89FA0ZY5dajygvMxvM-WA3iHcAihgiByEw Oct 04 21:59:50.758403 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 21:59:50.758403 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 21:59:50.758403 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 21:59:50.758403 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 21:59:50.758403 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 21:59:50.758403 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 21:59:50.758403 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: c8b3066186614f7fbf7644a0f5d6c953 Oct 04 21:59:50.758403 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1726578604 Oct 04 21:59:50.758403 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 21:59:50.758403 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 21:59:50.758403 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c8b3066186614f7fbf7644a0f5d6c953"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_c8b3066186614f7fbf7644a0f5d6c953", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c8b3066186614f7fbf7644a0f5d6c953"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/c8b3066186614f7fbf7644a0f5d6c953"}]}] Oct 04 21:59:50.758403 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1726578604 Oct 04 21:59:50.758403 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: c8b3066186614f7fbf7644a0f5d6c953 Oct 04 21:59:50.758403 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1726578604 Oct 04 21:59:50.758403 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-ServerMetadataNegativeTestJSON-1726578604-project Oct 04 21:59:50.758403 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 21:59:50.758403 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 21:59:50.758403 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: f361ccb8eb4246f0bae1097edfe65096 Oct 04 21:59:50.758403 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1726578604-project Oct 04 21:59:50.758403 n-d-860284-1 devstack@n-api.service[134101]: Oct 04 21:59:50.758403 n-d-860284-1 devstack@n-api.service[134101]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-788150196", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "007ad08c-9157-4f93-9f8e-95a8ac2cb59c"}]}} Oct 04 21:59:50.758403 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 21:59:50.758403 n-d-860284-1 devstack@n-api.service[134101]: exception: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 21:59:50.758403 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-788150196', 'imageRef': '58548514-5dac-426c-81f5-19e3fba33e23', 'flavorRef': '452', 'metadata': {'': 'data1'}, 'networks': [{'uuid': '007ad08c-9157-4f93-9f8e-95a8ac2cb59c'}]}}} Oct 04 21:59:50.758403 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:59:50.758403 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:59:50.758403 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 21:59:50.758403 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 21:59:50.758403 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 21:59:50.758403 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise error Oct 04 21:59:50.758403 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 21:59:50.758403 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:59:50.758403 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 04 21:59:50.758403 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 04 21:59:50.758403 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 04 21:59:50.758403 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 04 21:59:50.758403 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 04 21:59:50.758403 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:59:50.758403 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 21:59:50.758403 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi {'': 'data1'} Oct 04 21:59:50.758403 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:59:50.758403 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:59:50.758403 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:59:50.758403 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:59:50.758403 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:59:50.758403 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:59:50.758403 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:59:50.758403 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:59:50.758403 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:59:50.758403 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:59:50.758403 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:59:50.764235 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:59:50.764235 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 21:59:50.764235 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 21:59:50.764235 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 21:59:50.764235 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 21:59:50.764235 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 21:59:50.764235 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 21:59:50.764235 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 21:59:50.764235 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:59:50.764235 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:59:50.764235 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:59:50.764235 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:59:50.764235 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:59:50.764235 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:59:50.764235 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 21:59:50.764235 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 21:59:50.764235 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 21:59:50.764235 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:59:50.767229 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-1e93866e-4e31-4543-8ff4-3d20b5c4b73c tempest-ServerMetadataNegativeTestJSON-1726578604 tempest-ServerMetadataNegativeTestJSON-1726578604-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:59:50.768339 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-1e93866e-4e31-4543-8ff4-3d20b5c4b73c tempest-ServerMetadataNegativeTestJSON-1726578604 tempest-ServerMetadataNegativeTestJSON-1726578604-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.019021 Oct 04 21:59:50.769476 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1718/3480] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 21:59:50 2022] POST /compute/v2.1/servers => generated 175 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 04 21:59:50.782015 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-7164c1e6-79c0-4576-a5d1-d10a79e6f07a tempest-ServerMetadataNegativeTestJSON-1726578604 tempest-ServerMetadataNegativeTestJSON-1726578604-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:50.783769 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-7164c1e6-79c0-4576-a5d1-d10a79e6f07a tempest-ServerMetadataNegativeTestJSON-1726578604 tempest-ServerMetadataNegativeTestJSON-1726578604-project] [instance: 01d3d74c-7c90-4a1a-807d-33814c129330] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:50.792917 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-7164c1e6-79c0-4576-a5d1-d10a79e6f07a tempest-ServerMetadataNegativeTestJSON-1726578604 tempest-ServerMetadataNegativeTestJSON-1726578604-project] HTTP exception thrown: Instance 01d3d74c-7c90-4a1a-807d-33814c129330 could not be found. Oct 04 21:59:50.799723 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-7164c1e6-79c0-4576-a5d1-d10a79e6f07a tempest-ServerMetadataNegativeTestJSON-1726578604 tempest-ServerMetadataNegativeTestJSON-1726578604-project] Request method failure captured: Oct 04 21:59:50.799723 n-d-860284-1 devstack@n-api.service[134101]: request: GET /compute/v2.1/servers/01d3d74c-7c90-4a1a-807d-33814c129330/metadata HTTP/1.1 Oct 04 21:59:50.799723 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 21:59:50.799723 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 21:59:50.799723 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 21:59:50.799723 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 21:59:50.799723 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 21:59:50.799723 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 21:59:50.799723 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 21:59:50.799723 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 21:59:50.799723 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPKy7U6KAomJVBMOi5c5sKO1DBIOQh-o-PMZPWGelB_lBNhsk9b6911Uzvij9WsUDS6Gs7utGKR5vevcxUgdjq23D7vwWQGpYYY17XbHFHztBSH6tvk25FXD4JKeR3_F1kgR8sz9CLO6rH89FA0ZY5dajygvMxvM-WA3iHcAihgiByEw Oct 04 21:59:50.799723 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 21:59:50.799723 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 21:59:50.799723 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 21:59:50.799723 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 21:59:50.799723 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 21:59:50.799723 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 21:59:50.799723 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: c8b3066186614f7fbf7644a0f5d6c953 Oct 04 21:59:50.799723 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1726578604 Oct 04 21:59:50.799723 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 21:59:50.799723 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 21:59:50.799723 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c8b3066186614f7fbf7644a0f5d6c953"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_c8b3066186614f7fbf7644a0f5d6c953", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c8b3066186614f7fbf7644a0f5d6c953"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/c8b3066186614f7fbf7644a0f5d6c953"}]}] Oct 04 21:59:50.799723 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1726578604 Oct 04 21:59:50.799723 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: c8b3066186614f7fbf7644a0f5d6c953 Oct 04 21:59:50.799723 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1726578604 Oct 04 21:59:50.799723 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-ServerMetadataNegativeTestJSON-1726578604-project Oct 04 21:59:50.799723 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 21:59:50.799723 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 21:59:50.799723 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: f361ccb8eb4246f0bae1097edfe65096 Oct 04 21:59:50.799723 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1726578604-project Oct 04 21:59:50.799723 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 21:59:50.799723 n-d-860284-1 devstack@n-api.service[134101]: exception: Instance 01d3d74c-7c90-4a1a-807d-33814c129330 could not be found. Oct 04 21:59:50.799723 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'server_id': '01d3d74c-7c90-4a1a-807d-33814c129330'} Oct 04 21:59:50.799723 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:59:50.799723 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:59:50.799723 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:59:50.799723 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:59:50.799723 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:59:50.799723 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:59:50.799723 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 21:59:50.799723 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 21:59:50.799723 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01d3d74c-7c90-4a1a-807d-33814c129330 could not be found. Oct 04 21:59:50.799723 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:59:50.799723 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:59:50.799723 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:59:50.799723 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:59:50.799723 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:59:50.799723 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:59:50.799723 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:59:50.799723 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:59:50.799723 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:59:50.799723 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:59:50.799723 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 54, in index Oct 04 21:59:50.799723 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Oct 04 21:59:50.799723 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:59:50.799723 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:59:50.799723 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01d3d74c-7c90-4a1a-807d-33814c129330 could not be found. Oct 04 21:59:50.799723 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:59:50.799723 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:59:50.799723 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:59:50.799723 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:59:50.799723 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:59:50.799723 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:59:50.804373 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:59:50.804373 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:59:50.804373 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01d3d74c-7c90-4a1a-807d-33814c129330 could not be found. Oct 04 21:59:50.804373 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 21:59:50.805759 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-7164c1e6-79c0-4576-a5d1-d10a79e6f07a tempest-ServerMetadataNegativeTestJSON-1726578604 tempest-ServerMetadataNegativeTestJSON-1726578604-project] Returning 404 to user: Instance 01d3d74c-7c90-4a1a-807d-33814c129330 could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:59:50.806869 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-7164c1e6-79c0-4576-a5d1-d10a79e6f07a tempest-ServerMetadataNegativeTestJSON-1726578604 tempest-ServerMetadataNegativeTestJSON-1726578604-project] 10.222.0.43 "GET /compute/v2.1/servers/01d3d74c-7c90-4a1a-807d-33814c129330/metadata" status: 404 len: 111 microversion: 2.1 time: 0.030634 Oct 04 21:59:50.808849 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1719/3481] 10.222.0.43 () {58 vars in 1263 bytes} [Tue Oct 4 21:59:50 2022] GET /compute/v2.1/servers/01d3d74c-7c90-4a1a-807d-33814c129330/metadata => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 21:59:50.916578 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-ebcb2b31-dcba-4a3f-ac06-2ef5c842d26f req-18e671d6-02b0-4b6d-b608-ec6c40b2bcef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c17a63b-8492-4c9b-a0c2-34bef7051f80", "tag": "353bf1c2-20f1-4ba8-8856-cc01db923973"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:59:50.954341 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-ebcb2b31-dcba-4a3f-ac06-2ef5c842d26f req-18e671d6-02b0-4b6d-b608-ec6c40b2bcef service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:50.955119 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-ebcb2b31-dcba-4a3f-ac06-2ef5c842d26f req-18e671d6-02b0-4b6d-b608-ec6c40b2bcef service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:50.961329 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-ebcb2b31-dcba-4a3f-ac06-2ef5c842d26f req-18e671d6-02b0-4b6d-b608-ec6c40b2bcef service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:50.978062 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-9458037f-f99d-453a-aa9e-a6cddc58422e tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1322222176", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452", "networks": [{"uuid": "605d261e-cb88-4730-8571-b0febea58d72"}]}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:59:51.000570 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-ebcb2b31-dcba-4a3f-ac06-2ef5c842d26f req-18e671d6-02b0-4b6d-b608-ec6c40b2bcef service nova] Creating event network-changed:353bf1c2-20f1-4ba8-8856-cc01db923973 for instance 4c17a63b-8492-4c9b-a0c2-34bef7051f80 on n-h2-860284-1 Oct 04 21:59:51.009139 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-ebcb2b31-dcba-4a3f-ac06-2ef5c842d26f req-18e671d6-02b0-4b6d-b608-ec6c40b2bcef service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.453688 Oct 04 21:59:51.015201 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1763/3482] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:59:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:59:51.021612 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-a6c8d6de-f899-4d1e-9b5b-f282d5879442 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:51.022664 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-a6c8d6de-f899-4d1e-9b5b-f282d5879442 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: a4cf4fac-1e9b-4669-a6ff-30008ed3642d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:51.035968 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a6c8d6de-f899-4d1e-9b5b-f282d5879442 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:51.035968 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a6c8d6de-f899-4d1e-9b5b-f282d5879442 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:51.035968 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a6c8d6de-f899-4d1e-9b5b-f282d5879442 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:51.035968 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a6c8d6de-f899-4d1e-9b5b-f282d5879442 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:51.035968 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a6c8d6de-f899-4d1e-9b5b-f282d5879442 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:51.035968 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a6c8d6de-f899-4d1e-9b5b-f282d5879442 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:51.114811 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.network.neutron [None req-9458037f-f99d-453a-aa9e-a6cddc58422e tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] validate_networks() for [('605d261e-cb88-4730-8571-b0febea58d72', None, None, None, None, None)] {{(pid=134101) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:59:51.409773 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-a6c8d6de-f899-4d1e-9b5b-f282d5879442 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2facee4c6a40416e908083e126d2cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07a17a482a4e92b6ddbdee463c8029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:51.428930 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-a6c8d6de-f899-4d1e-9b5b-f282d5879442 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d" status: 200 len: 1510 microversion: 2.1 time: 0.411940 Oct 04 21:59:51.433579 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1764/3483] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:59:51 2022] GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d => generated 1510 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:59:51.449263 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-37493d20-3640-4707-a495-913747c4599a tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:51.453489 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-37493d20-3640-4707-a495-913747c4599a tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] [instance: 1b71cb4e-4f72-4c5d-a936-2ffc991910d9] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:51.475443 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-37493d20-3640-4707-a495-913747c4599a tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:51.476308 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-37493d20-3640-4707-a495-913747c4599a tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:51.479644 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-37493d20-3640-4707-a495-913747c4599a tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:51.487469 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-37493d20-3640-4707-a495-913747c4599a tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:51.488277 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-37493d20-3640-4707-a495-913747c4599a tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:51.489539 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-37493d20-3640-4707-a495-913747c4599a tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:51.830675 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-37493d20-3640-4707-a495-913747c4599a tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e807c724cc4c3887a2d360f0584ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40071e45805146529fb8abd40629c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:51.841587 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-9458037f-f99d-453a-aa9e-a6cddc58422e tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Flavor limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:59:51.842017 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-9458037f-f99d-453a-aa9e-a6cddc58422e tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Image limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:59:51.842536 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-9458037f-f99d-453a-aa9e-a6cddc58422e tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Flavor pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:59:51.844256 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-9458037f-f99d-453a-aa9e-a6cddc58422e tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Image pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:59:51.845026 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-9458037f-f99d-453a-aa9e-a6cddc58422e tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:59:51.861379 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-37493d20-3640-4707-a495-913747c4599a tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] 10.222.0.43 "GET /compute/v2.1/servers/1b71cb4e-4f72-4c5d-a936-2ffc991910d9" status: 200 len: 1259 microversion: 2.1 time: 0.425903 Oct 04 21:59:51.862575 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1765/3484] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:59:51 2022] GET /compute/v2.1/servers/1b71cb4e-4f72-4c5d-a936-2ffc991910d9 => generated 1259 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:59:51.872329 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9458037f-f99d-453a-aa9e-a6cddc58422e tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:51.873874 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9458037f-f99d-453a-aa9e-a6cddc58422e tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:51.874931 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9458037f-f99d-453a-aa9e-a6cddc58422e tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:51.877783 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9458037f-f99d-453a-aa9e-a6cddc58422e tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:51.878647 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-5b10b1ca-86e0-48b3-9ab5-be8355f6b22b tempest-ServerMetadataNegativeTestJSON-1726578604 tempest-ServerMetadataNegativeTestJSON-1726578604-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-284428130", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "007ad08c-9157-4f93-9f8e-95a8ac2cb59c"}]}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:59:51.881976 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9458037f-f99d-453a-aa9e-a6cddc58422e tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:51.882825 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9458037f-f99d-453a-aa9e-a6cddc58422e tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:51.893881 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-5b10b1ca-86e0-48b3-9ab5-be8355f6b22b tempest-ServerMetadataNegativeTestJSON-1726578604 tempest-ServerMetadataNegativeTestJSON-1726578604-project] Request method failure captured: Oct 04 21:59:51.893881 n-d-860284-1 devstack@n-api.service[134102]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 21:59:51.893881 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 21:59:51.893881 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 21:59:51.893881 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 21:59:51.893881 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 498 Oct 04 21:59:51.893881 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 21:59:51.893881 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 21:59:51.893881 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 21:59:51.893881 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 21:59:51.893881 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPKy7U6KAomJVBMOi5c5sKO1DBIOQh-o-PMZPWGelB_lBNhsk9b6911Uzvij9WsUDS6Gs7utGKR5vevcxUgdjq23D7vwWQGpYYY17XbHFHztBSH6tvk25FXD4JKeR3_F1kgR8sz9CLO6rH89FA0ZY5dajygvMxvM-WA3iHcAihgiByEw Oct 04 21:59:51.893881 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 21:59:51.893881 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 21:59:51.893881 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 21:59:51.893881 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 21:59:51.893881 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 21:59:51.893881 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 21:59:51.893881 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: c8b3066186614f7fbf7644a0f5d6c953 Oct 04 21:59:51.893881 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1726578604 Oct 04 21:59:51.893881 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 21:59:51.893881 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 21:59:51.893881 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c8b3066186614f7fbf7644a0f5d6c953"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_c8b3066186614f7fbf7644a0f5d6c953", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c8b3066186614f7fbf7644a0f5d6c953"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/c8b3066186614f7fbf7644a0f5d6c953"}]}] Oct 04 21:59:51.893881 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1726578604 Oct 04 21:59:51.893881 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: c8b3066186614f7fbf7644a0f5d6c953 Oct 04 21:59:51.893881 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1726578604 Oct 04 21:59:51.893881 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-ServerMetadataNegativeTestJSON-1726578604-project Oct 04 21:59:51.893881 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 21:59:51.893881 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 21:59:51.893881 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: f361ccb8eb4246f0bae1097edfe65096 Oct 04 21:59:51.893881 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1726578604-project Oct 04 21:59:51.893881 n-d-860284-1 devstack@n-api.service[134102]: Oct 04 21:59:51.893881 n-d-860284-1 devstack@n-api.service[134102]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-284428130", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "007ad08c-9157-4f93-9f8e-95a8ac2cb59c"}]}} Oct 04 21:59:51.893881 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 21:59:51.893881 n-d-860284-1 devstack@n-api.service[134102]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 21:59:51.893881 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-284428130', 'imageRef': '58548514-5dac-426c-81f5-19e3fba33e23', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '007ad08c-9157-4f93-9f8e-95a8ac2cb59c'}]}}} Oct 04 21:59:51.893881 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:59:51.893881 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:59:51.893881 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 21:59:51.893881 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 21:59:51.893881 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 21:59:51.893881 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise error Oct 04 21:59:51.893881 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 21:59:51.893881 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:59:51.893881 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 04 21:59:51.893881 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 04 21:59:51.893881 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 04 21:59:51.893881 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 04 21:59:51.897843 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 04 21:59:51.897843 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:59:51.897843 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 21:59:51.897843 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 04 21:59:51.897843 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:59:51.897843 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:59:51.897843 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:59:51.897843 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:59:51.897843 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:59:51.897843 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:59:51.897843 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:59:51.897843 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:59:51.897843 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:59:51.897843 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:59:51.897843 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:59:51.897843 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:59:51.897843 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 21:59:51.897843 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 21:59:51.897843 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 21:59:51.897843 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 21:59:51.897843 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 21:59:51.897843 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 21:59:51.897843 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 21:59:51.897843 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:59:51.897843 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:59:51.897843 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:59:51.897843 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:59:51.897843 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:59:51.897843 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:59:51.897843 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 21:59:51.897843 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 21:59:51.897843 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 21:59:51.897843 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:59:51.907289 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-5b10b1ca-86e0-48b3-9ab5-be8355f6b22b tempest-ServerMetadataNegativeTestJSON-1726578604 tempest-ServerMetadataNegativeTestJSON-1726578604-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:59:51.907289 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-5b10b1ca-86e0-48b3-9ab5-be8355f6b22b tempest-ServerMetadataNegativeTestJSON-1726578604 tempest-ServerMetadataNegativeTestJSON-1726578604-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.039716 Oct 04 21:59:51.910056 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1766/3485] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 21:59:51 2022] POST /compute/v2.1/servers => generated 687 bytes in 46 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 21:59:51.934615 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-2fbc06e1-1d9b-400d-9d7a-d4dd3ebb131d tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:51.937796 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-2fbc06e1-1d9b-400d-9d7a-d4dd3ebb131d tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] [instance: d0b1b757-4a4d-4a7a-9a06-08f178a02984] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:51.971378 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2fbc06e1-1d9b-400d-9d7a-d4dd3ebb131d tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:51.973677 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-9458037f-f99d-453a-aa9e-a6cddc58422e tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Getting quotas for project aa89499d833a4a00805164f4f79ed522. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:59:51.974036 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2fbc06e1-1d9b-400d-9d7a-d4dd3ebb131d tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:51.979059 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2fbc06e1-1d9b-400d-9d7a-d4dd3ebb131d tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:51.979886 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2fbc06e1-1d9b-400d-9d7a-d4dd3ebb131d tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:51.983280 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-9458037f-f99d-453a-aa9e-a6cddc58422e tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Getting quotas for user 2034fc9060874868bc5d27370a1c351c and project aa89499d833a4a00805164f4f79ed522. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:59:51.985620 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2fbc06e1-1d9b-400d-9d7a-d4dd3ebb131d tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:51.986237 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2fbc06e1-1d9b-400d-9d7a-d4dd3ebb131d tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:52.005947 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-9458037f-f99d-453a-aa9e-a6cddc58422e tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Going to run 1 instances... {{(pid=134101) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:59:52.010552 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-9458037f-f99d-453a-aa9e-a6cddc58422e tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] [instance: df147c22-6a7f-4081-83e7-97620b23700c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='58548514-5dac-426c-81f5-19e3fba33e23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134101) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:59:52.086633 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-9458037f-f99d-453a-aa9e-a6cddc58422e tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.271462 Oct 04 21:59:52.088094 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1720/3486] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 21:59:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 1274 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:59:52.104486 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-6671ca15-cc4e-42e5-8edc-266a1745b84d tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:52.105677 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-6671ca15-cc4e-42e5-8edc-266a1745b84d tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] [instance: df147c22-6a7f-4081-83e7-97620b23700c] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:52.230675 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-2fbc06e1-1d9b-400d-9d7a-d4dd3ebb131d tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:52.249456 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-2fbc06e1-1d9b-400d-9d7a-d4dd3ebb131d tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:52.268884 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-2fbc06e1-1d9b-400d-9d7a-d4dd3ebb131d tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:52.288887 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-2fbc06e1-1d9b-400d-9d7a-d4dd3ebb131d tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] 10.222.0.43 "GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984" status: 200 len: 1544 microversion: 2.91 time: 0.377982 Oct 04 21:59:52.289872 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1767/3487] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:59:51 2022] GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984 => generated 1544 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:59:52.299082 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-b1de65a6-5f12-4bd2-be60-6aaa1479fca9 tempest-ServerMetadataNegativeTestJSON-1726578604 tempest-ServerMetadataNegativeTestJSON-1726578604-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-799386611", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "007ad08c-9157-4f93-9f8e-95a8ac2cb59c"}]}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:59:52.315073 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-6671ca15-cc4e-42e5-8edc-266a1745b84d tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2034fc9060874868bc5d27370a1c351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89499d833a4a00805164f4f79ed522', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:52.323571 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-6671ca15-cc4e-42e5-8edc-266a1745b84d tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] 10.222.0.43 "GET /compute/v2.1/servers/df147c22-6a7f-4081-83e7-97620b23700c" status: 200 len: 1218 microversion: 2.1 time: 0.225295 Oct 04 21:59:52.324767 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-b1de65a6-5f12-4bd2-be60-6aaa1479fca9 tempest-ServerMetadataNegativeTestJSON-1726578604 tempest-ServerMetadataNegativeTestJSON-1726578604-project] Request method failure captured: Oct 04 21:59:52.324767 n-d-860284-1 devstack@n-api.service[134102]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 21:59:52.324767 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 21:59:52.324767 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 21:59:52.324767 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 21:59:52.324767 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 499 Oct 04 21:59:52.324767 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 21:59:52.324767 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 21:59:52.324767 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 21:59:52.324767 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 21:59:52.324767 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPKy7U6KAomJVBMOi5c5sKO1DBIOQh-o-PMZPWGelB_lBNhsk9b6911Uzvij9WsUDS6Gs7utGKR5vevcxUgdjq23D7vwWQGpYYY17XbHFHztBSH6tvk25FXD4JKeR3_F1kgR8sz9CLO6rH89FA0ZY5dajygvMxvM-WA3iHcAihgiByEw Oct 04 21:59:52.324767 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 21:59:52.324767 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 21:59:52.324767 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 21:59:52.324767 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 21:59:52.324767 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 21:59:52.324767 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 21:59:52.324767 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: c8b3066186614f7fbf7644a0f5d6c953 Oct 04 21:59:52.324767 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1726578604 Oct 04 21:59:52.324767 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 21:59:52.324767 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 21:59:52.324767 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c8b3066186614f7fbf7644a0f5d6c953"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_c8b3066186614f7fbf7644a0f5d6c953", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c8b3066186614f7fbf7644a0f5d6c953"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/c8b3066186614f7fbf7644a0f5d6c953"}]}] Oct 04 21:59:52.324767 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1726578604 Oct 04 21:59:52.324767 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: c8b3066186614f7fbf7644a0f5d6c953 Oct 04 21:59:52.324767 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1726578604 Oct 04 21:59:52.324767 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-ServerMetadataNegativeTestJSON-1726578604-project Oct 04 21:59:52.324767 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 21:59:52.324767 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 21:59:52.324767 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: f361ccb8eb4246f0bae1097edfe65096 Oct 04 21:59:52.324767 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1726578604-project Oct 04 21:59:52.324767 n-d-860284-1 devstack@n-api.service[134102]: Oct 04 21:59:52.324767 n-d-860284-1 devstack@n-api.service[134102]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-799386611", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "007ad08c-9157-4f93-9f8e-95a8ac2cb59c"}]}} Oct 04 21:59:52.324767 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 21:59:52.324767 n-d-860284-1 devstack@n-api.service[134102]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 21:59:52.324767 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-799386611', 'imageRef': '58548514-5dac-426c-81f5-19e3fba33e23', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '007ad08c-9157-4f93-9f8e-95a8ac2cb59c'}]}}} Oct 04 21:59:52.324767 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:59:52.324767 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:59:52.324767 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 21:59:52.324767 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 21:59:52.324767 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 21:59:52.324767 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise error Oct 04 21:59:52.324767 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 21:59:52.324767 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:59:52.324767 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 04 21:59:52.324767 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 04 21:59:52.324767 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 04 21:59:52.324767 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 04 21:59:52.329784 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 04 21:59:52.329784 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:59:52.329784 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 21:59:52.329784 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 04 21:59:52.329784 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:59:52.329784 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:59:52.329784 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:59:52.329784 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:59:52.329784 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:59:52.329784 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:59:52.329784 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:59:52.329784 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:59:52.329784 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:59:52.329784 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:59:52.329784 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:59:52.329784 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:59:52.329784 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 21:59:52.329784 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 21:59:52.329784 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 21:59:52.329784 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 21:59:52.329784 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 21:59:52.329784 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 21:59:52.329784 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 21:59:52.329784 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:59:52.329784 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:59:52.329784 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:59:52.329784 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:59:52.329784 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:59:52.329784 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:59:52.329784 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 21:59:52.329784 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 21:59:52.329784 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 21:59:52.329784 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:59:52.329784 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-b1de65a6-5f12-4bd2-be60-6aaa1479fca9 tempest-ServerMetadataNegativeTestJSON-1726578604 tempest-ServerMetadataNegativeTestJSON-1726578604-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:59:52.334979 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1721/3488] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:59:52 2022] GET /compute/v2.1/servers/df147c22-6a7f-4081-83e7-97620b23700c => generated 1218 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:59:52.335222 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-b1de65a6-5f12-4bd2-be60-6aaa1479fca9 tempest-ServerMetadataNegativeTestJSON-1726578604 tempest-ServerMetadataNegativeTestJSON-1726578604-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.041104 Oct 04 21:59:52.346863 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1768/3489] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 21:59:52 2022] POST /compute/v2.1/servers => generated 689 bytes in 56 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 21:59:52.459204 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-6722b479-9bec-4602-9c3c-effd41c9949f tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:52.459204 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-6722b479-9bec-4602-9c3c-effd41c9949f tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: a4cf4fac-1e9b-4669-a6ff-30008ed3642d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:52.471713 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6722b479-9bec-4602-9c3c-effd41c9949f tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:52.472688 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6722b479-9bec-4602-9c3c-effd41c9949f tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:52.473152 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6722b479-9bec-4602-9c3c-effd41c9949f tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:52.476190 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6722b479-9bec-4602-9c3c-effd41c9949f tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:52.477353 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6722b479-9bec-4602-9c3c-effd41c9949f tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:52.480471 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6722b479-9bec-4602-9c3c-effd41c9949f tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:52.681372 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-37b82229-3e1c-4773-9d4a-f130fcc75a90 tempest-ServerMetadataNegativeTestJSON-1726578604 tempest-ServerMetadataNegativeTestJSON-1726578604-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1738352721", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "007ad08c-9157-4f93-9f8e-95a8ac2cb59c"}]}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:59:52.690639 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-37b82229-3e1c-4773-9d4a-f130fcc75a90 tempest-ServerMetadataNegativeTestJSON-1726578604 tempest-ServerMetadataNegativeTestJSON-1726578604-project] Request method failure captured: Oct 04 21:59:52.690639 n-d-860284-1 devstack@n-api.service[134102]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 21:59:52.690639 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 21:59:52.690639 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 21:59:52.690639 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 21:59:52.690639 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 754 Oct 04 21:59:52.690639 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 21:59:52.690639 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 21:59:52.690639 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 21:59:52.690639 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 21:59:52.690639 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPKy7U6KAomJVBMOi5c5sKO1DBIOQh-o-PMZPWGelB_lBNhsk9b6911Uzvij9WsUDS6Gs7utGKR5vevcxUgdjq23D7vwWQGpYYY17XbHFHztBSH6tvk25FXD4JKeR3_F1kgR8sz9CLO6rH89FA0ZY5dajygvMxvM-WA3iHcAihgiByEw Oct 04 21:59:52.690639 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 21:59:52.690639 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 21:59:52.690639 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 21:59:52.690639 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 21:59:52.690639 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 21:59:52.690639 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 21:59:52.690639 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: c8b3066186614f7fbf7644a0f5d6c953 Oct 04 21:59:52.690639 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1726578604 Oct 04 21:59:52.690639 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 21:59:52.690639 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 21:59:52.690639 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c8b3066186614f7fbf7644a0f5d6c953"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_c8b3066186614f7fbf7644a0f5d6c953", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c8b3066186614f7fbf7644a0f5d6c953"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/c8b3066186614f7fbf7644a0f5d6c953"}]}] Oct 04 21:59:52.690639 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1726578604 Oct 04 21:59:52.690639 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: c8b3066186614f7fbf7644a0f5d6c953 Oct 04 21:59:52.690639 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1726578604 Oct 04 21:59:52.690639 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-ServerMetadataNegativeTestJSON-1726578604-project Oct 04 21:59:52.690639 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 21:59:52.690639 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 21:59:52.690639 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: f361ccb8eb4246f0bae1097edfe65096 Oct 04 21:59:52.690639 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1726578604-project Oct 04 21:59:52.690639 n-d-860284-1 devstack@n-api.service[134102]: Oct 04 21:59:52.690639 n-d-860284-1 devstack@n-api.service[134102]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1738352721", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "007ad08c-9157-4f93-9f8e-95a8ac2cb59c"}]}} Oct 04 21:59:52.690639 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 21:59:52.690639 n-d-860284-1 devstack@n-api.service[134102]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 21:59:52.690639 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1738352721', 'imageRef': '58548514-5dac-426c-81f5-19e3fba33e23', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '007ad08c-9157-4f93-9f8e-95a8ac2cb59c'}]}}} Oct 04 21:59:52.690639 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:59:52.690639 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:59:52.690639 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 21:59:52.690639 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 21:59:52.693749 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 21:59:52.693749 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise error Oct 04 21:59:52.693749 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 21:59:52.693749 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:59:52.693749 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 04 21:59:52.693749 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 04 21:59:52.693749 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 04 21:59:52.693749 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 04 21:59:52.693749 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 04 21:59:52.693749 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:59:52.693749 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 21:59:52.693749 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 04 21:59:52.693749 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:59:52.693749 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:59:52.693749 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:59:52.693749 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:59:52.693749 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:59:52.693749 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:59:52.693749 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:59:52.693749 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:59:52.693749 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:59:52.693749 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:59:52.693749 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:59:52.693749 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:59:52.693749 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 21:59:52.693749 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 21:59:52.693749 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 21:59:52.693749 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 21:59:52.693749 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 21:59:52.693749 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 21:59:52.693749 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 21:59:52.693749 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:59:52.693749 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:59:52.693749 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:59:52.693749 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:59:52.693749 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:59:52.693749 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:59:52.693749 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 21:59:52.693749 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 21:59:52.697060 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 21:59:52.697060 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:59:52.698854 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-37b82229-3e1c-4773-9d4a-f130fcc75a90 tempest-ServerMetadataNegativeTestJSON-1726578604 tempest-ServerMetadataNegativeTestJSON-1726578604-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:59:52.700075 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-37b82229-3e1c-4773-9d4a-f130fcc75a90 tempest-ServerMetadataNegativeTestJSON-1726578604 tempest-ServerMetadataNegativeTestJSON-1726578604-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.023875 Oct 04 21:59:52.719276 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1769/3490] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 21:59:52 2022] POST /compute/v2.1/servers => generated 1197 bytes in 43 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Oct 04 21:59:52.887571 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-6722b479-9bec-4602-9c3c-effd41c9949f tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2facee4c6a40416e908083e126d2cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07a17a482a4e92b6ddbdee463c8029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:52.891140 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-141e7274-57d5-4e1b-8621-d60ad2b9f66e tempest-ServerMetadataNegativeTestJSON-1726578604 tempest-ServerMetadataNegativeTestJSON-1726578604-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1587087286", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "007ad08c-9157-4f93-9f8e-95a8ac2cb59c"}]}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:59:52.900725 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-141e7274-57d5-4e1b-8621-d60ad2b9f66e tempest-ServerMetadataNegativeTestJSON-1726578604 tempest-ServerMetadataNegativeTestJSON-1726578604-project] Request method failure captured: Oct 04 21:59:52.900725 n-d-860284-1 devstack@n-api.service[134102]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 21:59:52.900725 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 21:59:52.900725 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 21:59:52.900725 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 21:59:52.900725 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 1266 Oct 04 21:59:52.900725 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 21:59:52.900725 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 21:59:52.900725 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 21:59:52.900725 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 21:59:52.900725 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPKy7U6KAomJVBMOi5c5sKO1DBIOQh-o-PMZPWGelB_lBNhsk9b6911Uzvij9WsUDS6Gs7utGKR5vevcxUgdjq23D7vwWQGpYYY17XbHFHztBSH6tvk25FXD4JKeR3_F1kgR8sz9CLO6rH89FA0ZY5dajygvMxvM-WA3iHcAihgiByEw Oct 04 21:59:52.900725 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 21:59:52.900725 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 21:59:52.900725 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 21:59:52.900725 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 21:59:52.900725 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 21:59:52.900725 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 21:59:52.900725 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: c8b3066186614f7fbf7644a0f5d6c953 Oct 04 21:59:52.900725 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1726578604 Oct 04 21:59:52.900725 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 21:59:52.900725 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 21:59:52.900725 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c8b3066186614f7fbf7644a0f5d6c953"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_c8b3066186614f7fbf7644a0f5d6c953", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c8b3066186614f7fbf7644a0f5d6c953"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/c8b3066186614f7fbf7644a0f5d6c953"}]}] Oct 04 21:59:52.900725 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1726578604 Oct 04 21:59:52.900725 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: c8b3066186614f7fbf7644a0f5d6c953 Oct 04 21:59:52.900725 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1726578604 Oct 04 21:59:52.900725 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-ServerMetadataNegativeTestJSON-1726578604-project Oct 04 21:59:52.900725 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 21:59:52.900725 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 21:59:52.900725 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: f361ccb8eb4246f0bae1097edfe65096 Oct 04 21:59:52.900725 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1726578604-project Oct 04 21:59:52.900725 n-d-860284-1 devstack@n-api.service[134102]: Oct 04 21:59:52.900725 n-d-860284-1 devstack@n-api.service[134102]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1587087286", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "007ad08c-9157-4f93-9f8e-95a8ac2cb59c"}]}} Oct 04 21:59:52.900725 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 21:59:52.903786 n-d-860284-1 devstack@n-api.service[134102]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 21:59:52.903786 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1587087286', 'imageRef': '58548514-5dac-426c-81f5-19e3fba33e23', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '007ad08c-9157-4f93-9f8e-95a8ac2cb59c'}]}}} Oct 04 21:59:52.903786 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:59:52.903786 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:59:52.903786 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 21:59:52.903786 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 21:59:52.903786 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 21:59:52.903786 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise error Oct 04 21:59:52.903786 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 21:59:52.903786 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:59:52.903786 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 04 21:59:52.903786 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 04 21:59:52.903786 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 04 21:59:52.903786 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 04 21:59:52.903786 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 04 21:59:52.903786 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:59:52.903786 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 21:59:52.906970 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 04 21:59:52.906970 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:59:52.906970 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:59:52.906970 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:59:52.906970 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:59:52.906970 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:59:52.906970 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:59:52.906970 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:59:52.906970 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:59:52.906970 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:59:52.906970 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:59:52.906970 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:59:52.906970 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:59:52.906970 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 21:59:52.906970 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 21:59:52.906970 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 21:59:52.906970 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 21:59:52.906970 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 21:59:52.906970 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 21:59:52.906970 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 21:59:52.906970 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:59:52.906970 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:59:52.906970 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:59:52.906970 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:59:52.906970 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:59:52.906970 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:59:52.906970 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 21:59:52.906970 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 21:59:52.911015 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 21:59:52.911015 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:59:52.913644 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-141e7274-57d5-4e1b-8621-d60ad2b9f66e tempest-ServerMetadataNegativeTestJSON-1726578604 tempest-ServerMetadataNegativeTestJSON-1726578604-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:59:52.917834 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-141e7274-57d5-4e1b-8621-d60ad2b9f66e tempest-ServerMetadataNegativeTestJSON-1726578604 tempest-ServerMetadataNegativeTestJSON-1726578604-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.036467 Oct 04 21:59:52.918246 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-6722b479-9bec-4602-9c3c-effd41c9949f tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d" status: 200 len: 1510 microversion: 2.1 time: 0.462645 Oct 04 21:59:52.919070 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1722/3491] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:59:52 2022] GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d => generated 1510 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:59:52.921160 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1770/3492] 10.222.0.43 () {60 vars in 1148 bytes} [Tue Oct 4 21:59:52 2022] POST /compute/v2.1/servers => generated 2221 bytes in 46 msecs (HTTP/1.1 400) 9 headers in 382 bytes (2 switches on core 0) Oct 04 21:59:52.925849 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-0a889a67-2c16-45e1-9811-d9112339496b tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:52.928315 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-0a889a67-2c16-45e1-9811-d9112339496b tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] [instance: 1b71cb4e-4f72-4c5d-a936-2ffc991910d9] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:52.952354 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0a889a67-2c16-45e1-9811-d9112339496b tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:52.952582 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-46f3b847-de51-4a37-91b2-1f920e07ceca tempest-ServerMetadataNegativeTestJSON-1726578604 tempest-ServerMetadataNegativeTestJSON-1726578604-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:52.954442 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0a889a67-2c16-45e1-9811-d9112339496b tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:52.955308 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-46f3b847-de51-4a37-91b2-1f920e07ceca tempest-ServerMetadataNegativeTestJSON-1726578604 tempest-ServerMetadataNegativeTestJSON-1726578604-project] [instance: 3cfe2d82-2e72-4e37-bd00-3acd9b0348ac] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:52.956436 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0a889a67-2c16-45e1-9811-d9112339496b tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:52.958869 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0a889a67-2c16-45e1-9811-d9112339496b tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:52.959669 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0a889a67-2c16-45e1-9811-d9112339496b tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:52.960357 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0a889a67-2c16-45e1-9811-d9112339496b tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:52.977284 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-46f3b847-de51-4a37-91b2-1f920e07ceca tempest-ServerMetadataNegativeTestJSON-1726578604 tempest-ServerMetadataNegativeTestJSON-1726578604-project] HTTP exception thrown: Instance 3cfe2d82-2e72-4e37-bd00-3acd9b0348ac could not be found. Oct 04 21:59:52.988028 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-46f3b847-de51-4a37-91b2-1f920e07ceca tempest-ServerMetadataNegativeTestJSON-1726578604 tempest-ServerMetadataNegativeTestJSON-1726578604-project] Request method failure captured: Oct 04 21:59:52.988028 n-d-860284-1 devstack@n-api.service[134102]: request: GET /compute/v2.1/servers/3cfe2d82-2e72-4e37-bd00-3acd9b0348ac/metadata/test2 HTTP/1.1 Oct 04 21:59:52.988028 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 21:59:52.988028 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 21:59:52.988028 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 21:59:52.988028 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 21:59:52.988028 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 21:59:52.988028 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 21:59:52.988028 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 21:59:52.988028 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 21:59:52.988028 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPKy7U6KAomJVBMOi5c5sKO1DBIOQh-o-PMZPWGelB_lBNhsk9b6911Uzvij9WsUDS6Gs7utGKR5vevcxUgdjq23D7vwWQGpYYY17XbHFHztBSH6tvk25FXD4JKeR3_F1kgR8sz9CLO6rH89FA0ZY5dajygvMxvM-WA3iHcAihgiByEw Oct 04 21:59:52.988028 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 21:59:52.988028 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 21:59:52.988028 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 21:59:52.988028 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 21:59:52.988028 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 21:59:52.988028 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 21:59:52.988028 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: c8b3066186614f7fbf7644a0f5d6c953 Oct 04 21:59:52.988028 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1726578604 Oct 04 21:59:52.988028 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 21:59:52.988028 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 21:59:52.988028 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c8b3066186614f7fbf7644a0f5d6c953"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_c8b3066186614f7fbf7644a0f5d6c953", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c8b3066186614f7fbf7644a0f5d6c953"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/c8b3066186614f7fbf7644a0f5d6c953"}]}] Oct 04 21:59:52.988028 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1726578604 Oct 04 21:59:52.988028 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: c8b3066186614f7fbf7644a0f5d6c953 Oct 04 21:59:52.988028 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1726578604 Oct 04 21:59:52.988028 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-ServerMetadataNegativeTestJSON-1726578604-project Oct 04 21:59:52.988028 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 21:59:52.988028 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 21:59:52.988028 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: f361ccb8eb4246f0bae1097edfe65096 Oct 04 21:59:52.988028 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1726578604-project Oct 04 21:59:52.988028 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 21:59:52.988028 n-d-860284-1 devstack@n-api.service[134102]: exception: Instance 3cfe2d82-2e72-4e37-bd00-3acd9b0348ac could not be found. Oct 04 21:59:52.988028 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'server_id': '3cfe2d82-2e72-4e37-bd00-3acd9b0348ac', 'id': 'test2'} Oct 04 21:59:52.988028 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:59:52.988028 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:59:52.988028 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:59:52.988028 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:59:52.988028 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:59:52.988028 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:59:52.988028 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 21:59:52.988028 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 21:59:52.988028 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3cfe2d82-2e72-4e37-bd00-3acd9b0348ac could not be found. Oct 04 21:59:52.988028 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:59:52.988028 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:59:52.988028 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:59:52.988028 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:59:52.988028 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:59:52.988028 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:59:52.988028 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:59:52.988028 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:59:52.988028 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:59:52.988028 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:59:52.988028 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 129, in show Oct 04 21:59:52.988028 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Oct 04 21:59:52.988028 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:59:52.988028 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:59:52.988028 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3cfe2d82-2e72-4e37-bd00-3acd9b0348ac could not be found. Oct 04 21:59:52.988028 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:59:52.988028 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:59:52.988028 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:59:52.988028 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:59:52.988028 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:59:52.988028 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:59:52.992703 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:59:52.992703 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:59:52.992703 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3cfe2d82-2e72-4e37-bd00-3acd9b0348ac could not be found. Oct 04 21:59:52.992703 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 21:59:52.992703 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-46f3b847-de51-4a37-91b2-1f920e07ceca tempest-ServerMetadataNegativeTestJSON-1726578604 tempest-ServerMetadataNegativeTestJSON-1726578604-project] Returning 404 to user: Instance 3cfe2d82-2e72-4e37-bd00-3acd9b0348ac could not be found. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:59:52.993070 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-46f3b847-de51-4a37-91b2-1f920e07ceca tempest-ServerMetadataNegativeTestJSON-1726578604 tempest-ServerMetadataNegativeTestJSON-1726578604-project] 10.222.0.43 "GET /compute/v2.1/servers/3cfe2d82-2e72-4e37-bd00-3acd9b0348ac/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.044898 Oct 04 21:59:52.995400 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1771/3493] 10.222.0.43 () {58 vars in 1281 bytes} [Tue Oct 4 21:59:52 2022] GET /compute/v2.1/servers/3cfe2d82-2e72-4e37-bd00-3acd9b0348ac/metadata/test2 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:59:53.012910 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-8c7c6cea-4598-481c-82d1-10699295796a tempest-ServerMetadataNegativeTestJSON-1726578604 tempest-ServerMetadataNegativeTestJSON-1726578604-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:53.015271 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-8c7c6cea-4598-481c-82d1-10699295796a tempest-ServerMetadataNegativeTestJSON-1726578604 tempest-ServerMetadataNegativeTestJSON-1726578604-project] [instance: 34e510e1-0dd2-4799-8626-782c5f1912ba] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:53.031336 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8c7c6cea-4598-481c-82d1-10699295796a tempest-ServerMetadataNegativeTestJSON-1726578604 tempest-ServerMetadataNegativeTestJSON-1726578604-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:53.035009 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8c7c6cea-4598-481c-82d1-10699295796a tempest-ServerMetadataNegativeTestJSON-1726578604 tempest-ServerMetadataNegativeTestJSON-1726578604-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:53.036128 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8c7c6cea-4598-481c-82d1-10699295796a tempest-ServerMetadataNegativeTestJSON-1726578604 tempest-ServerMetadataNegativeTestJSON-1726578604-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:53.037412 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8c7c6cea-4598-481c-82d1-10699295796a tempest-ServerMetadataNegativeTestJSON-1726578604 tempest-ServerMetadataNegativeTestJSON-1726578604-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:53.040092 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8c7c6cea-4598-481c-82d1-10699295796a tempest-ServerMetadataNegativeTestJSON-1726578604 tempest-ServerMetadataNegativeTestJSON-1726578604-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:53.041383 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8c7c6cea-4598-481c-82d1-10699295796a tempest-ServerMetadataNegativeTestJSON-1726578604 tempest-ServerMetadataNegativeTestJSON-1726578604-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:53.145175 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-8c7c6cea-4598-481c-82d1-10699295796a tempest-ServerMetadataNegativeTestJSON-1726578604 tempest-ServerMetadataNegativeTestJSON-1726578604-project] [instance: 34e510e1-0dd2-4799-8626-782c5f1912ba] Going to try to terminate instance {{(pid=134102) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:59:53.182101 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-0a889a67-2c16-45e1-9811-d9112339496b tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e807c724cc4c3887a2d360f0584ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40071e45805146529fb8abd40629c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:53.203797 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-0a889a67-2c16-45e1-9811-d9112339496b tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] 10.222.0.43 "GET /compute/v2.1/servers/1b71cb4e-4f72-4c5d-a936-2ffc991910d9" status: 200 len: 1265 microversion: 2.1 time: 0.281018 Oct 04 21:59:53.205745 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1723/3494] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:59:52 2022] GET /compute/v2.1/servers/1b71cb4e-4f72-4c5d-a936-2ffc991910d9 => generated 1265 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:59:53.323382 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-5c199d40-a146-4e33-9f48-b9d457ffa56a tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:53.324847 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-5c199d40-a146-4e33-9f48-b9d457ffa56a tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] [instance: d0b1b757-4a4d-4a7a-9a06-08f178a02984] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:53.354992 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5c199d40-a146-4e33-9f48-b9d457ffa56a tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:53.363026 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5c199d40-a146-4e33-9f48-b9d457ffa56a tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:53.363628 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5c199d40-a146-4e33-9f48-b9d457ffa56a tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:53.368493 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5c199d40-a146-4e33-9f48-b9d457ffa56a tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:53.369694 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5c199d40-a146-4e33-9f48-b9d457ffa56a tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:53.372194 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5c199d40-a146-4e33-9f48-b9d457ffa56a tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:53.419989 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-8c7c6cea-4598-481c-82d1-10699295796a tempest-ServerMetadataNegativeTestJSON-1726578604 tempest-ServerMetadataNegativeTestJSON-1726578604-project] 10.222.0.43 "DELETE /compute/v2.1/servers/34e510e1-0dd2-4799-8626-782c5f1912ba" status: 204 len: 0 microversion: 2.1 time: 0.414331 Oct 04 21:59:53.426858 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1772/3495] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 21:59:53 2022] DELETE /compute/v2.1/servers/34e510e1-0dd2-4799-8626-782c5f1912ba => generated 0 bytes in 417 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:59:53.433105 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-ee882f04-2f77-44d0-81a1-b811341a2bde tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:53.433843 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-ee882f04-2f77-44d0-81a1-b811341a2bde tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] [instance: df147c22-6a7f-4081-83e7-97620b23700c] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:53.446807 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ee882f04-2f77-44d0-81a1-b811341a2bde tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:53.448614 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ee882f04-2f77-44d0-81a1-b811341a2bde tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:53.449678 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ee882f04-2f77-44d0-81a1-b811341a2bde tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:53.452220 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ee882f04-2f77-44d0-81a1-b811341a2bde tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:53.453351 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ee882f04-2f77-44d0-81a1-b811341a2bde tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:53.454465 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ee882f04-2f77-44d0-81a1-b811341a2bde tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:53.535502 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-5c199d40-a146-4e33-9f48-b9d457ffa56a tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:53.540935 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:59:53.550783 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-5c199d40-a146-4e33-9f48-b9d457ffa56a tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:53.553071 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-5c199d40-a146-4e33-9f48-b9d457ffa56a tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:53.562017 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-5c199d40-a146-4e33-9f48-b9d457ffa56a tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] 10.222.0.43 "GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984" status: 200 len: 1544 microversion: 2.91 time: 0.242542 Oct 04 21:59:53.563100 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1724/3496] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:59:53 2022] GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984 => generated 1544 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:59:53.582128 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-0ba560ff-c276-41e1-ba5f-65b6719aaa1a tempest-ServerMetadataNegativeTestJSON-1726578604 tempest-ServerMetadataNegativeTestJSON-1726578604-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:53.583417 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-0ba560ff-c276-41e1-ba5f-65b6719aaa1a tempest-ServerMetadataNegativeTestJSON-1726578604 tempest-ServerMetadataNegativeTestJSON-1726578604-project] [instance: 34e510e1-0dd2-4799-8626-782c5f1912ba] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:53.602610 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0ba560ff-c276-41e1-ba5f-65b6719aaa1a tempest-ServerMetadataNegativeTestJSON-1726578604 tempest-ServerMetadataNegativeTestJSON-1726578604-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:53.603291 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0ba560ff-c276-41e1-ba5f-65b6719aaa1a tempest-ServerMetadataNegativeTestJSON-1726578604 tempest-ServerMetadataNegativeTestJSON-1726578604-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:53.603844 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0ba560ff-c276-41e1-ba5f-65b6719aaa1a tempest-ServerMetadataNegativeTestJSON-1726578604 tempest-ServerMetadataNegativeTestJSON-1726578604-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:53.604703 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0ba560ff-c276-41e1-ba5f-65b6719aaa1a tempest-ServerMetadataNegativeTestJSON-1726578604 tempest-ServerMetadataNegativeTestJSON-1726578604-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:53.605402 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0ba560ff-c276-41e1-ba5f-65b6719aaa1a tempest-ServerMetadataNegativeTestJSON-1726578604 tempest-ServerMetadataNegativeTestJSON-1726578604-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:53.606063 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0ba560ff-c276-41e1-ba5f-65b6719aaa1a tempest-ServerMetadataNegativeTestJSON-1726578604 tempest-ServerMetadataNegativeTestJSON-1726578604-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:53.643271 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-ee882f04-2f77-44d0-81a1-b811341a2bde tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2034fc9060874868bc5d27370a1c351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89499d833a4a00805164f4f79ed522', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:53.658735 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-ee882f04-2f77-44d0-81a1-b811341a2bde tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] 10.222.0.43 "GET /compute/v2.1/servers/df147c22-6a7f-4081-83e7-97620b23700c" status: 200 len: 1222 microversion: 2.1 time: 0.230017 Oct 04 21:59:53.661575 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1773/3497] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:59:53 2022] GET /compute/v2.1/servers/df147c22-6a7f-4081-83e7-97620b23700c => generated 1222 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:59:53.691056 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-6cd21fcd-4fbf-4099-bda8-e783dea9d6ba req-8cdb3666-6bb4-4854-8eba-972013e73a3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e57b3eb4-9ac6-4f6b-bbe1-a8582bdf543b", "name": "network-vif-deleted", "tag": "7bf70467-e6c6-44c5-b9e5-a3641cdfe409"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:59:53.709457 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-6cd21fcd-4fbf-4099-bda8-e783dea9d6ba req-8cdb3666-6bb4-4854-8eba-972013e73a3c service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:53.710057 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-6cd21fcd-4fbf-4099-bda8-e783dea9d6ba req-8cdb3666-6bb4-4854-8eba-972013e73a3c service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:53.710408 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-6cd21fcd-4fbf-4099-bda8-e783dea9d6ba req-8cdb3666-6bb4-4854-8eba-972013e73a3c service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:53.736647 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-6cd21fcd-4fbf-4099-bda8-e783dea9d6ba req-8cdb3666-6bb4-4854-8eba-972013e73a3c service nova] Creating event network-vif-deleted:7bf70467-e6c6-44c5-b9e5-a3641cdfe409 for instance e57b3eb4-9ac6-4f6b-bbe1-a8582bdf543b on n-h1-860284-1 Oct 04 21:59:53.742232 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-6cd21fcd-4fbf-4099-bda8-e783dea9d6ba req-8cdb3666-6bb4-4854-8eba-972013e73a3c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063665 Oct 04 21:59:53.742947 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1774/3498] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:59:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:59:53.873554 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-0ba560ff-c276-41e1-ba5f-65b6719aaa1a tempest-ServerMetadataNegativeTestJSON-1726578604 tempest-ServerMetadataNegativeTestJSON-1726578604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f361ccb8eb4246f0bae1097edfe65096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8b3066186614f7fbf7644a0f5d6c953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:53.884440 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-0ba560ff-c276-41e1-ba5f-65b6719aaa1a tempest-ServerMetadataNegativeTestJSON-1726578604 tempest-ServerMetadataNegativeTestJSON-1726578604-project] 10.222.0.43 "GET /compute/v2.1/servers/34e510e1-0dd2-4799-8626-782c5f1912ba" status: 200 len: 1524 microversion: 2.1 time: 0.319942 Oct 04 21:59:53.885046 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1725/3499] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:59:53 2022] GET /compute/v2.1/servers/34e510e1-0dd2-4799-8626-782c5f1912ba => generated 1524 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:59:53.956765 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-8eba14d4-76db-47e0-b393-dc10e095460c tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:53.958718 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-8eba14d4-76db-47e0-b393-dc10e095460c tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: a4cf4fac-1e9b-4669-a6ff-30008ed3642d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:53.968002 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8eba14d4-76db-47e0-b393-dc10e095460c tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:53.968557 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8eba14d4-76db-47e0-b393-dc10e095460c tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:53.969052 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8eba14d4-76db-47e0-b393-dc10e095460c tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:53.969826 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8eba14d4-76db-47e0-b393-dc10e095460c tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:53.970270 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8eba14d4-76db-47e0-b393-dc10e095460c tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:53.970730 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8eba14d4-76db-47e0-b393-dc10e095460c tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:54.140407 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-8eba14d4-76db-47e0-b393-dc10e095460c tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2facee4c6a40416e908083e126d2cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07a17a482a4e92b6ddbdee463c8029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:54.149272 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-8eba14d4-76db-47e0-b393-dc10e095460c tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d" status: 200 len: 1510 microversion: 2.1 time: 0.199280 Oct 04 21:59:54.149938 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1775/3500] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:59:53 2022] GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d => generated 1510 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:59:54.230326 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-f456e0ae-bef7-4205-b25e-5cb1ae344842 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:54.231014 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-f456e0ae-bef7-4205-b25e-5cb1ae344842 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] [instance: 1b71cb4e-4f72-4c5d-a936-2ffc991910d9] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:54.271179 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f456e0ae-bef7-4205-b25e-5cb1ae344842 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:54.274869 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f456e0ae-bef7-4205-b25e-5cb1ae344842 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:54.276408 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f456e0ae-bef7-4205-b25e-5cb1ae344842 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:54.278072 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f456e0ae-bef7-4205-b25e-5cb1ae344842 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:54.278936 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f456e0ae-bef7-4205-b25e-5cb1ae344842 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:54.279698 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f456e0ae-bef7-4205-b25e-5cb1ae344842 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:54.617694 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-c2cc4343-1edf-42a2-b831-1dd866cd39cf tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:54.620033 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-c2cc4343-1edf-42a2-b831-1dd866cd39cf tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] [instance: d0b1b757-4a4d-4a7a-9a06-08f178a02984] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:54.646688 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c2cc4343-1edf-42a2-b831-1dd866cd39cf tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:54.647535 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c2cc4343-1edf-42a2-b831-1dd866cd39cf tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:54.647971 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c2cc4343-1edf-42a2-b831-1dd866cd39cf tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:54.648855 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c2cc4343-1edf-42a2-b831-1dd866cd39cf tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:54.649681 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c2cc4343-1edf-42a2-b831-1dd866cd39cf tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:54.650705 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c2cc4343-1edf-42a2-b831-1dd866cd39cf tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:55.459659 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-c2cc4343-1edf-42a2-b831-1dd866cd39cf tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:55.468058 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-f456e0ae-bef7-4205-b25e-5cb1ae344842 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e807c724cc4c3887a2d360f0584ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40071e45805146529fb8abd40629c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:55.471883 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-c2cc4343-1edf-42a2-b831-1dd866cd39cf tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:55.474016 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-c2cc4343-1edf-42a2-b831-1dd866cd39cf tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:55.480028 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-c2cc4343-1edf-42a2-b831-1dd866cd39cf tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] 10.222.0.43 "GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984" status: 200 len: 1544 microversion: 2.91 time: 0.871163 Oct 04 21:59:55.481448 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1776/3501] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:59:54 2022] GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984 => generated 1544 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:59:55.486032 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-f456e0ae-bef7-4205-b25e-5cb1ae344842 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] 10.222.0.43 "GET /compute/v2.1/servers/1b71cb4e-4f72-4c5d-a936-2ffc991910d9" status: 200 len: 1307 microversion: 2.1 time: 1.259527 Oct 04 21:59:55.487386 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1726/3502] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:59:54 2022] GET /compute/v2.1/servers/1b71cb4e-4f72-4c5d-a936-2ffc991910d9 => generated 1307 bytes in 1262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:59:55.487959 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-5b90bc2c-a10f-497d-bdf6-b64c4505d4b5 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:55.488869 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-5b90bc2c-a10f-497d-bdf6-b64c4505d4b5 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] [instance: df147c22-6a7f-4081-83e7-97620b23700c] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:55.495568 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5b90bc2c-a10f-497d-bdf6-b64c4505d4b5 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:55.496472 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5b90bc2c-a10f-497d-bdf6-b64c4505d4b5 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:55.497103 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5b90bc2c-a10f-497d-bdf6-b64c4505d4b5 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:55.498949 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5b90bc2c-a10f-497d-bdf6-b64c4505d4b5 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:55.499591 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5b90bc2c-a10f-497d-bdf6-b64c4505d4b5 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:55.500281 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5b90bc2c-a10f-497d-bdf6-b64c4505d4b5 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:55.501984 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-4e00f103-e603-4f89-b0d1-3385465820b8 tempest-ServerMetadataNegativeTestJSON-1726578604 tempest-ServerMetadataNegativeTestJSON-1726578604-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:55.505129 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-4e00f103-e603-4f89-b0d1-3385465820b8 tempest-ServerMetadataNegativeTestJSON-1726578604 tempest-ServerMetadataNegativeTestJSON-1726578604-project] [instance: 34e510e1-0dd2-4799-8626-782c5f1912ba] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:55.518093 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4e00f103-e603-4f89-b0d1-3385465820b8 tempest-ServerMetadataNegativeTestJSON-1726578604 tempest-ServerMetadataNegativeTestJSON-1726578604-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:55.520428 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4e00f103-e603-4f89-b0d1-3385465820b8 tempest-ServerMetadataNegativeTestJSON-1726578604 tempest-ServerMetadataNegativeTestJSON-1726578604-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:55.520916 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4e00f103-e603-4f89-b0d1-3385465820b8 tempest-ServerMetadataNegativeTestJSON-1726578604 tempest-ServerMetadataNegativeTestJSON-1726578604-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:55.521667 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4e00f103-e603-4f89-b0d1-3385465820b8 tempest-ServerMetadataNegativeTestJSON-1726578604 tempest-ServerMetadataNegativeTestJSON-1726578604-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:55.525538 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4e00f103-e603-4f89-b0d1-3385465820b8 tempest-ServerMetadataNegativeTestJSON-1726578604 tempest-ServerMetadataNegativeTestJSON-1726578604-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:55.526092 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4e00f103-e603-4f89-b0d1-3385465820b8 tempest-ServerMetadataNegativeTestJSON-1726578604 tempest-ServerMetadataNegativeTestJSON-1726578604-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:55.604258 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-5b90bc2c-a10f-497d-bdf6-b64c4505d4b5 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2034fc9060874868bc5d27370a1c351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89499d833a4a00805164f4f79ed522', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:55.620971 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-5b90bc2c-a10f-497d-bdf6-b64c4505d4b5 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] 10.222.0.43 "GET /compute/v2.1/servers/df147c22-6a7f-4081-83e7-97620b23700c" status: 200 len: 1222 microversion: 2.1 time: 0.137191 Oct 04 21:59:55.624617 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1777/3503] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:59:55 2022] GET /compute/v2.1/servers/df147c22-6a7f-4081-83e7-97620b23700c => generated 1222 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:59:55.636232 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-85bec4a2-c5ae-4b0b-9e07-7063f6ffa2af tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:55.637711 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-85bec4a2-c5ae-4b0b-9e07-7063f6ffa2af tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: a4cf4fac-1e9b-4669-a6ff-30008ed3642d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:55.668508 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-85bec4a2-c5ae-4b0b-9e07-7063f6ffa2af tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:55.670833 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-85bec4a2-c5ae-4b0b-9e07-7063f6ffa2af tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:55.671698 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-85bec4a2-c5ae-4b0b-9e07-7063f6ffa2af tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:55.682041 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-85bec4a2-c5ae-4b0b-9e07-7063f6ffa2af tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:55.686412 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-85bec4a2-c5ae-4b0b-9e07-7063f6ffa2af tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:55.687995 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-85bec4a2-c5ae-4b0b-9e07-7063f6ffa2af tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:55.972624 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-4e00f103-e603-4f89-b0d1-3385465820b8 tempest-ServerMetadataNegativeTestJSON-1726578604 tempest-ServerMetadataNegativeTestJSON-1726578604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f361ccb8eb4246f0bae1097edfe65096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8b3066186614f7fbf7644a0f5d6c953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:55.986910 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-4e00f103-e603-4f89-b0d1-3385465820b8 tempest-ServerMetadataNegativeTestJSON-1726578604 tempest-ServerMetadataNegativeTestJSON-1726578604-project] 10.222.0.43 "GET /compute/v2.1/servers/34e510e1-0dd2-4799-8626-782c5f1912ba" status: 200 len: 1524 microversion: 2.1 time: 0.497053 Oct 04 21:59:55.988343 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1727/3504] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:59:55 2022] GET /compute/v2.1/servers/34e510e1-0dd2-4799-8626-782c5f1912ba => generated 1524 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:59:56.024834 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-85bec4a2-c5ae-4b0b-9e07-7063f6ffa2af tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2facee4c6a40416e908083e126d2cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07a17a482a4e92b6ddbdee463c8029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:56.035512 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-85bec4a2-c5ae-4b0b-9e07-7063f6ffa2af tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d" status: 200 len: 1510 microversion: 2.1 time: 0.409475 Oct 04 21:59:56.036127 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1778/3505] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:59:55 2022] GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d => generated 1510 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:59:56.216390 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-fd368eca-58e4-462a-bd82-266c89b9288e req-a0d24a67-d10a-47b4-a461-88faa2b06726 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b71cb4e-4f72-4c5d-a936-2ffc991910d9", "tag": "06cfe69e-7185-4b0b-a3ae-8b095095aab5"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:59:56.232538 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-fd368eca-58e4-462a-bd82-266c89b9288e req-a0d24a67-d10a-47b4-a461-88faa2b06726 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:56.232930 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-fd368eca-58e4-462a-bd82-266c89b9288e req-a0d24a67-d10a-47b4-a461-88faa2b06726 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:56.233388 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-fd368eca-58e4-462a-bd82-266c89b9288e req-a0d24a67-d10a-47b4-a461-88faa2b06726 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:56.256743 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-fd368eca-58e4-462a-bd82-266c89b9288e req-a0d24a67-d10a-47b4-a461-88faa2b06726 service nova] Creating event network-changed:06cfe69e-7185-4b0b-a3ae-8b095095aab5 for instance 1b71cb4e-4f72-4c5d-a936-2ffc991910d9 on n-h2-860284-1 Oct 04 21:59:56.262500 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-fd368eca-58e4-462a-bd82-266c89b9288e req-a0d24a67-d10a-47b4-a461-88faa2b06726 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050267 Oct 04 21:59:56.263715 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1728/3506] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:59:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:59:56.550047 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-da923190-f088-4036-8aed-82c72cc3add4 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:56.551198 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-da923190-f088-4036-8aed-82c72cc3add4 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] [instance: 1b71cb4e-4f72-4c5d-a936-2ffc991910d9] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:56.566167 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-bbb80502-f560-427b-99a5-0dd9737a9285 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:56.566829 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-bbb80502-f560-427b-99a5-0dd9737a9285 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] [instance: d0b1b757-4a4d-4a7a-9a06-08f178a02984] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:56.570992 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-da923190-f088-4036-8aed-82c72cc3add4 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:56.571515 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-da923190-f088-4036-8aed-82c72cc3add4 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:56.571970 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-da923190-f088-4036-8aed-82c72cc3add4 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:56.572836 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-da923190-f088-4036-8aed-82c72cc3add4 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:56.573197 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-da923190-f088-4036-8aed-82c72cc3add4 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:56.573644 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-da923190-f088-4036-8aed-82c72cc3add4 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:56.596577 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bbb80502-f560-427b-99a5-0dd9737a9285 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:56.597226 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bbb80502-f560-427b-99a5-0dd9737a9285 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:56.597663 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bbb80502-f560-427b-99a5-0dd9737a9285 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:56.598469 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bbb80502-f560-427b-99a5-0dd9737a9285 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:56.600135 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bbb80502-f560-427b-99a5-0dd9737a9285 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:56.601041 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bbb80502-f560-427b-99a5-0dd9737a9285 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:56.863652 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-bbb80502-f560-427b-99a5-0dd9737a9285 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:56.888151 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-bbb80502-f560-427b-99a5-0dd9737a9285 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:56.891873 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-bbb80502-f560-427b-99a5-0dd9737a9285 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:56.908449 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-bbb80502-f560-427b-99a5-0dd9737a9285 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] 10.222.0.43 "GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984" status: 200 len: 1544 microversion: 2.91 time: 0.349634 Oct 04 21:59:56.909537 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1729/3507] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:59:56 2022] GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984 => generated 1544 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:59:56.914795 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-02fe496b-50a0-4929-83d6-e381e5417ebe tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:56.916015 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-02fe496b-50a0-4929-83d6-e381e5417ebe tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] [instance: df147c22-6a7f-4081-83e7-97620b23700c] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:56.926064 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-02fe496b-50a0-4929-83d6-e381e5417ebe tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:56.927216 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-02fe496b-50a0-4929-83d6-e381e5417ebe tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:56.928033 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-02fe496b-50a0-4929-83d6-e381e5417ebe tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:56.929028 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-02fe496b-50a0-4929-83d6-e381e5417ebe tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:56.929670 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-02fe496b-50a0-4929-83d6-e381e5417ebe tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:56.930540 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-02fe496b-50a0-4929-83d6-e381e5417ebe tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:57.059830 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-02fe496b-50a0-4929-83d6-e381e5417ebe tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2034fc9060874868bc5d27370a1c351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89499d833a4a00805164f4f79ed522', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:57.085169 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-02fe496b-50a0-4929-83d6-e381e5417ebe tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] 10.222.0.43 "GET /compute/v2.1/servers/df147c22-6a7f-4081-83e7-97620b23700c" status: 200 len: 1214 microversion: 2.1 time: 0.173535 Oct 04 21:59:57.086795 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1730/3508] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:59:56 2022] GET /compute/v2.1/servers/df147c22-6a7f-4081-83e7-97620b23700c => generated 1214 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:59:57.103460 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-da923190-f088-4036-8aed-82c72cc3add4 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e807c724cc4c3887a2d360f0584ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40071e45805146529fb8abd40629c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:57.113456 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:59:57.113815 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-5176b715-9434-431b-9d48-13ddc8b8bc71 tempest-ServerMetadataNegativeTestJSON-1726578604 tempest-ServerMetadataNegativeTestJSON-1726578604-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:57.114175 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-5176b715-9434-431b-9d48-13ddc8b8bc71 tempest-ServerMetadataNegativeTestJSON-1726578604 tempest-ServerMetadataNegativeTestJSON-1726578604-project] [instance: 34e510e1-0dd2-4799-8626-782c5f1912ba] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:57.124633 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-da923190-f088-4036-8aed-82c72cc3add4 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] 10.222.0.43 "GET /compute/v2.1/servers/1b71cb4e-4f72-4c5d-a936-2ffc991910d9" status: 200 len: 1307 microversion: 2.1 time: 0.578505 Oct 04 21:59:57.136485 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1779/3509] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:59:56 2022] GET /compute/v2.1/servers/1b71cb4e-4f72-4c5d-a936-2ffc991910d9 => generated 1307 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:59:57.141603 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5176b715-9434-431b-9d48-13ddc8b8bc71 tempest-ServerMetadataNegativeTestJSON-1726578604 tempest-ServerMetadataNegativeTestJSON-1726578604-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:57.143202 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5176b715-9434-431b-9d48-13ddc8b8bc71 tempest-ServerMetadataNegativeTestJSON-1726578604 tempest-ServerMetadataNegativeTestJSON-1726578604-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:57.144136 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5176b715-9434-431b-9d48-13ddc8b8bc71 tempest-ServerMetadataNegativeTestJSON-1726578604 tempest-ServerMetadataNegativeTestJSON-1726578604-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:57.147365 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5176b715-9434-431b-9d48-13ddc8b8bc71 tempest-ServerMetadataNegativeTestJSON-1726578604 tempest-ServerMetadataNegativeTestJSON-1726578604-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:57.158475 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-21787405-33f9-4eae-880f-aa2cb4bd49b9 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:57.159586 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-21787405-33f9-4eae-880f-aa2cb4bd49b9 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: a4cf4fac-1e9b-4669-a6ff-30008ed3642d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:57.163793 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5176b715-9434-431b-9d48-13ddc8b8bc71 tempest-ServerMetadataNegativeTestJSON-1726578604 tempest-ServerMetadataNegativeTestJSON-1726578604-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:57.164517 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5176b715-9434-431b-9d48-13ddc8b8bc71 tempest-ServerMetadataNegativeTestJSON-1726578604 tempest-ServerMetadataNegativeTestJSON-1726578604-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:57.169488 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-21787405-33f9-4eae-880f-aa2cb4bd49b9 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:57.170056 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-21787405-33f9-4eae-880f-aa2cb4bd49b9 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:57.170668 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-21787405-33f9-4eae-880f-aa2cb4bd49b9 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:57.171441 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-21787405-33f9-4eae-880f-aa2cb4bd49b9 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:57.171970 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-21787405-33f9-4eae-880f-aa2cb4bd49b9 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:57.172619 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-21787405-33f9-4eae-880f-aa2cb4bd49b9 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:57.631399 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-5176b715-9434-431b-9d48-13ddc8b8bc71 tempest-ServerMetadataNegativeTestJSON-1726578604 tempest-ServerMetadataNegativeTestJSON-1726578604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f361ccb8eb4246f0bae1097edfe65096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8b3066186614f7fbf7644a0f5d6c953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:57.643438 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-5176b715-9434-431b-9d48-13ddc8b8bc71 tempest-ServerMetadataNegativeTestJSON-1726578604 tempest-ServerMetadataNegativeTestJSON-1726578604-project] 10.222.0.43 "GET /compute/v2.1/servers/34e510e1-0dd2-4799-8626-782c5f1912ba" status: 200 len: 1524 microversion: 2.1 time: 0.554858 Oct 04 21:59:57.650805 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1731/3510] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:59:57 2022] GET /compute/v2.1/servers/34e510e1-0dd2-4799-8626-782c5f1912ba => generated 1524 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:59:57.652549 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-21787405-33f9-4eae-880f-aa2cb4bd49b9 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2facee4c6a40416e908083e126d2cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07a17a482a4e92b6ddbdee463c8029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:57.667409 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-21787405-33f9-4eae-880f-aa2cb4bd49b9 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d" status: 200 len: 1510 microversion: 2.1 time: 0.527491 Oct 04 21:59:57.688650 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1780/3511] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:59:57 2022] GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d => generated 1510 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:59:57.913277 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-ef51bf44-0905-4deb-b086-ec651dd61f2c req-dd44dec1-ddc7-4ec6-b662-e4a51f9ef512 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34e510e1-0dd2-4799-8626-782c5f1912ba", "name": "network-vif-deleted", "tag": "453141a6-ef52-47a6-a94e-ec4b7ea37b8e"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:59:57.926655 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-ef51bf44-0905-4deb-b086-ec651dd61f2c req-dd44dec1-ddc7-4ec6-b662-e4a51f9ef512 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:57.927148 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-ef51bf44-0905-4deb-b086-ec651dd61f2c req-dd44dec1-ddc7-4ec6-b662-e4a51f9ef512 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:57.927681 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-ef51bf44-0905-4deb-b086-ec651dd61f2c req-dd44dec1-ddc7-4ec6-b662-e4a51f9ef512 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:57.945834 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-ef51bf44-0905-4deb-b086-ec651dd61f2c req-dd44dec1-ddc7-4ec6-b662-e4a51f9ef512 service nova] Creating event network-vif-deleted:453141a6-ef52-47a6-a94e-ec4b7ea37b8e for instance 34e510e1-0dd2-4799-8626-782c5f1912ba on n-h1-860284-1 Oct 04 21:59:57.952806 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-ef51bf44-0905-4deb-b086-ec651dd61f2c req-dd44dec1-ddc7-4ec6-b662-e4a51f9ef512 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043743 Oct 04 21:59:57.956965 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1732/3512] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 21:59:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:59:57.963011 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-ae0887e4-282b-4360-bd06-c46c717cda98 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:57.964384 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-ae0887e4-282b-4360-bd06-c46c717cda98 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] [instance: d0b1b757-4a4d-4a7a-9a06-08f178a02984] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:57.981399 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ae0887e4-282b-4360-bd06-c46c717cda98 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:57.982482 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ae0887e4-282b-4360-bd06-c46c717cda98 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:57.983264 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ae0887e4-282b-4360-bd06-c46c717cda98 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:57.984596 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ae0887e4-282b-4360-bd06-c46c717cda98 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:57.985440 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ae0887e4-282b-4360-bd06-c46c717cda98 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:57.986266 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ae0887e4-282b-4360-bd06-c46c717cda98 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:58.121131 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e302b995-539b-46c2-b28c-5eb7dc07a59d tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:58.125480 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-e302b995-539b-46c2-b28c-5eb7dc07a59d tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] [instance: df147c22-6a7f-4081-83e7-97620b23700c] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:58.151895 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e302b995-539b-46c2-b28c-5eb7dc07a59d tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:58.153155 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e302b995-539b-46c2-b28c-5eb7dc07a59d tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:58.154840 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e302b995-539b-46c2-b28c-5eb7dc07a59d tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:58.156185 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e302b995-539b-46c2-b28c-5eb7dc07a59d tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:58.158522 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e302b995-539b-46c2-b28c-5eb7dc07a59d tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:58.159132 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e302b995-539b-46c2-b28c-5eb7dc07a59d tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:58.187974 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-ae0887e4-282b-4360-bd06-c46c717cda98 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:58.210023 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-ae0887e4-282b-4360-bd06-c46c717cda98 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:58.210023 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-ae0887e4-282b-4360-bd06-c46c717cda98 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:58.221366 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-ae0887e4-282b-4360-bd06-c46c717cda98 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] 10.222.0.43 "GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984" status: 200 len: 1544 microversion: 2.91 time: 0.270580 Oct 04 21:59:58.226454 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1781/3513] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:59:57 2022] GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984 => generated 1544 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:59:58.234278 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-8fb02f9c-4703-4f89-954e-d07f758065cd tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:58.242019 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-8fb02f9c-4703-4f89-954e-d07f758065cd tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] [instance: 1b71cb4e-4f72-4c5d-a936-2ffc991910d9] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:58.265366 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8fb02f9c-4703-4f89-954e-d07f758065cd tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:58.266060 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8fb02f9c-4703-4f89-954e-d07f758065cd tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:58.268857 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8fb02f9c-4703-4f89-954e-d07f758065cd tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:58.270138 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8fb02f9c-4703-4f89-954e-d07f758065cd tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:58.271061 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8fb02f9c-4703-4f89-954e-d07f758065cd tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:58.271840 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8fb02f9c-4703-4f89-954e-d07f758065cd tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:58.385609 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-e302b995-539b-46c2-b28c-5eb7dc07a59d tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2034fc9060874868bc5d27370a1c351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89499d833a4a00805164f4f79ed522', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:58.411081 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-e302b995-539b-46c2-b28c-5eb7dc07a59d tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] 10.222.0.43 "GET /compute/v2.1/servers/df147c22-6a7f-4081-83e7-97620b23700c" status: 200 len: 1270 microversion: 2.1 time: 0.294091 Oct 04 21:59:58.430401 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1733/3514] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:59:58 2022] GET /compute/v2.1/servers/df147c22-6a7f-4081-83e7-97620b23700c => generated 1270 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:59:58.670032 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-8fb02f9c-4703-4f89-954e-d07f758065cd tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e807c724cc4c3887a2d360f0584ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40071e45805146529fb8abd40629c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:58.680467 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-8fb02f9c-4703-4f89-954e-d07f758065cd tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] 10.222.0.43 "GET /compute/v2.1/servers/1b71cb4e-4f72-4c5d-a936-2ffc991910d9" status: 200 len: 1307 microversion: 2.1 time: 0.456207 Oct 04 21:59:58.681219 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1782/3515] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:59:58 2022] GET /compute/v2.1/servers/1b71cb4e-4f72-4c5d-a936-2ffc991910d9 => generated 1307 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:59:58.697605 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-45043042-1f8a-4a91-8c29-4b6ba44813fb tempest-ServerMetadataNegativeTestJSON-1726578604 tempest-ServerMetadataNegativeTestJSON-1726578604-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:58.699108 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-45043042-1f8a-4a91-8c29-4b6ba44813fb tempest-ServerMetadataNegativeTestJSON-1726578604 tempest-ServerMetadataNegativeTestJSON-1726578604-project] [instance: 34e510e1-0dd2-4799-8626-782c5f1912ba] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:58.704687 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-5c524b09-6bc5-4f6a-8bb9-5887ca341e42 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:58.705623 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-5c524b09-6bc5-4f6a-8bb9-5887ca341e42 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: a4cf4fac-1e9b-4669-a6ff-30008ed3642d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:58.711729 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-45043042-1f8a-4a91-8c29-4b6ba44813fb tempest-ServerMetadataNegativeTestJSON-1726578604 tempest-ServerMetadataNegativeTestJSON-1726578604-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:58.712686 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-45043042-1f8a-4a91-8c29-4b6ba44813fb tempest-ServerMetadataNegativeTestJSON-1726578604 tempest-ServerMetadataNegativeTestJSON-1726578604-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:58.712855 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5c524b09-6bc5-4f6a-8bb9-5887ca341e42 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:58.713581 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-45043042-1f8a-4a91-8c29-4b6ba44813fb tempest-ServerMetadataNegativeTestJSON-1726578604 tempest-ServerMetadataNegativeTestJSON-1726578604-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:58.713708 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5c524b09-6bc5-4f6a-8bb9-5887ca341e42 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:58.714062 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5c524b09-6bc5-4f6a-8bb9-5887ca341e42 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:58.714830 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5c524b09-6bc5-4f6a-8bb9-5887ca341e42 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:58.714960 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-45043042-1f8a-4a91-8c29-4b6ba44813fb tempest-ServerMetadataNegativeTestJSON-1726578604 tempest-ServerMetadataNegativeTestJSON-1726578604-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:58.715298 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5c524b09-6bc5-4f6a-8bb9-5887ca341e42 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:58.715736 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5c524b09-6bc5-4f6a-8bb9-5887ca341e42 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:58.715876 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-45043042-1f8a-4a91-8c29-4b6ba44813fb tempest-ServerMetadataNegativeTestJSON-1726578604 tempest-ServerMetadataNegativeTestJSON-1726578604-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:58.717481 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-45043042-1f8a-4a91-8c29-4b6ba44813fb tempest-ServerMetadataNegativeTestJSON-1726578604 tempest-ServerMetadataNegativeTestJSON-1726578604-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:58.767010 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-45043042-1f8a-4a91-8c29-4b6ba44813fb tempest-ServerMetadataNegativeTestJSON-1726578604 tempest-ServerMetadataNegativeTestJSON-1726578604-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:58.767628 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-45043042-1f8a-4a91-8c29-4b6ba44813fb tempest-ServerMetadataNegativeTestJSON-1726578604 tempest-ServerMetadataNegativeTestJSON-1726578604-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:58.768251 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-45043042-1f8a-4a91-8c29-4b6ba44813fb tempest-ServerMetadataNegativeTestJSON-1726578604 tempest-ServerMetadataNegativeTestJSON-1726578604-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:58.773584 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.objects.instance [None req-45043042-1f8a-4a91-8c29-4b6ba44813fb tempest-ServerMetadataNegativeTestJSON-1726578604 tempest-ServerMetadataNegativeTestJSON-1726578604-project] Lazy-loading 'fault' on Instance uuid 34e510e1-0dd2-4799-8626-782c5f1912ba {{(pid=134101) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:59:58.839329 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-45043042-1f8a-4a91-8c29-4b6ba44813fb tempest-ServerMetadataNegativeTestJSON-1726578604 tempest-ServerMetadataNegativeTestJSON-1726578604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f361ccb8eb4246f0bae1097edfe65096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8b3066186614f7fbf7644a0f5d6c953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:58.856344 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-45043042-1f8a-4a91-8c29-4b6ba44813fb tempest-ServerMetadataNegativeTestJSON-1726578604 tempest-ServerMetadataNegativeTestJSON-1726578604-project] 10.222.0.43 "GET /compute/v2.1/servers/34e510e1-0dd2-4799-8626-782c5f1912ba" status: 200 len: 1313 microversion: 2.1 time: 0.164612 Oct 04 21:59:58.861317 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1734/3516] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:59:58 2022] GET /compute/v2.1/servers/34e510e1-0dd2-4799-8626-782c5f1912ba => generated 1313 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:59:59.162674 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-5c524b09-6bc5-4f6a-8bb9-5887ca341e42 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2facee4c6a40416e908083e126d2cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07a17a482a4e92b6ddbdee463c8029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:59.174350 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-5c524b09-6bc5-4f6a-8bb9-5887ca341e42 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d" status: 200 len: 1510 microversion: 2.1 time: 0.473743 Oct 04 21:59:59.190221 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1783/3517] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:59:58 2022] GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d => generated 1510 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:59:59.255127 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-7fb3ebb7-f7d6-4a04-a8b6-76313c359786 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:59.256029 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-7fb3ebb7-f7d6-4a04-a8b6-76313c359786 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] [instance: d0b1b757-4a4d-4a7a-9a06-08f178a02984] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:59.270425 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7fb3ebb7-f7d6-4a04-a8b6-76313c359786 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:59.272782 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7fb3ebb7-f7d6-4a04-a8b6-76313c359786 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:59.273670 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7fb3ebb7-f7d6-4a04-a8b6-76313c359786 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:59.274972 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7fb3ebb7-f7d6-4a04-a8b6-76313c359786 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:59.275866 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7fb3ebb7-f7d6-4a04-a8b6-76313c359786 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:59.276595 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7fb3ebb7-f7d6-4a04-a8b6-76313c359786 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:59.385047 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-7fb3ebb7-f7d6-4a04-a8b6-76313c359786 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:59.398869 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-7fb3ebb7-f7d6-4a04-a8b6-76313c359786 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:59.402385 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-7fb3ebb7-f7d6-4a04-a8b6-76313c359786 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:59.415227 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-7fb3ebb7-f7d6-4a04-a8b6-76313c359786 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] 10.222.0.43 "GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984" status: 200 len: 1531 microversion: 2.91 time: 0.165735 Oct 04 21:59:59.416973 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1735/3518] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:59:59 2022] GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984 => generated 1531 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:59:59.446061 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-afcdbbab-8176-4382-b54d-bf79cafe42a1 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:59.447029 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-afcdbbab-8176-4382-b54d-bf79cafe42a1 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] [instance: df147c22-6a7f-4081-83e7-97620b23700c] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:59.451834 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-1b56e1e1-b713-47fd-86f3-6a71fe8f01a2 tempest-UnshelveToHostMultiNodesTest-2056876790 tempest-UnshelveToHostMultiNodesTest-2056876790-project-admin] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:59.453530 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-1b56e1e1-b713-47fd-86f3-6a71fe8f01a2 tempest-UnshelveToHostMultiNodesTest-2056876790 tempest-UnshelveToHostMultiNodesTest-2056876790-project-admin] [instance: d0b1b757-4a4d-4a7a-9a06-08f178a02984] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:59.455794 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-afcdbbab-8176-4382-b54d-bf79cafe42a1 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:59.456556 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-afcdbbab-8176-4382-b54d-bf79cafe42a1 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:59.457210 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-afcdbbab-8176-4382-b54d-bf79cafe42a1 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:59.458142 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-afcdbbab-8176-4382-b54d-bf79cafe42a1 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:59.458930 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-afcdbbab-8176-4382-b54d-bf79cafe42a1 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:59.459550 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-afcdbbab-8176-4382-b54d-bf79cafe42a1 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:59.469876 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1b56e1e1-b713-47fd-86f3-6a71fe8f01a2 tempest-UnshelveToHostMultiNodesTest-2056876790 tempest-UnshelveToHostMultiNodesTest-2056876790-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:59.470651 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1b56e1e1-b713-47fd-86f3-6a71fe8f01a2 tempest-UnshelveToHostMultiNodesTest-2056876790 tempest-UnshelveToHostMultiNodesTest-2056876790-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:59.473904 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1b56e1e1-b713-47fd-86f3-6a71fe8f01a2 tempest-UnshelveToHostMultiNodesTest-2056876790 tempest-UnshelveToHostMultiNodesTest-2056876790-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:59.475337 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1b56e1e1-b713-47fd-86f3-6a71fe8f01a2 tempest-UnshelveToHostMultiNodesTest-2056876790 tempest-UnshelveToHostMultiNodesTest-2056876790-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:59.476488 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1b56e1e1-b713-47fd-86f3-6a71fe8f01a2 tempest-UnshelveToHostMultiNodesTest-2056876790 tempest-UnshelveToHostMultiNodesTest-2056876790-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:59.477264 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1b56e1e1-b713-47fd-86f3-6a71fe8f01a2 tempest-UnshelveToHostMultiNodesTest-2056876790 tempest-UnshelveToHostMultiNodesTest-2056876790-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:59.632579 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.objects.instance [None req-1b56e1e1-b713-47fd-86f3-6a71fe8f01a2 tempest-UnshelveToHostMultiNodesTest-2056876790 tempest-UnshelveToHostMultiNodesTest-2056876790-project-admin] Lazy-loading 'services' on Instance uuid d0b1b757-4a4d-4a7a-9a06-08f178a02984 {{(pid=134101) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:59:59.653433 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell0:SELECT=2 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:59:59.678005 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-afcdbbab-8176-4382-b54d-bf79cafe42a1 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2034fc9060874868bc5d27370a1c351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89499d833a4a00805164f4f79ed522', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:59.700233 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:59:59.703018 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-1b56e1e1-b713-47fd-86f3-6a71fe8f01a2 tempest-UnshelveToHostMultiNodesTest-2056876790 tempest-UnshelveToHostMultiNodesTest-2056876790-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984" status: 200 len: 1936 microversion: 2.91 time: 0.257683 Oct 04 21:59:59.703827 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1736/3519] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 21:59:59 2022] GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984 => generated 1936 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:59:59.706230 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-afcdbbab-8176-4382-b54d-bf79cafe42a1 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] 10.222.0.43 "GET /compute/v2.1/servers/df147c22-6a7f-4081-83e7-97620b23700c" status: 200 len: 1276 microversion: 2.1 time: 0.264172 Oct 04 21:59:59.721787 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-899a33d6-f5ab-464c-9ab0-f5f2bed22e4b tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:59.727378 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-899a33d6-f5ab-464c-9ab0-f5f2bed22e4b tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] [instance: 1b71cb4e-4f72-4c5d-a936-2ffc991910d9] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:59.728273 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1784/3520] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:59:59 2022] GET /compute/v2.1/servers/df147c22-6a7f-4081-83e7-97620b23700c => generated 1276 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:59:59.744129 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-899a33d6-f5ab-464c-9ab0-f5f2bed22e4b tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:59.745219 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-899a33d6-f5ab-464c-9ab0-f5f2bed22e4b tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:59.745911 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-899a33d6-f5ab-464c-9ab0-f5f2bed22e4b tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:59.747338 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-899a33d6-f5ab-464c-9ab0-f5f2bed22e4b tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:59.748175 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-899a33d6-f5ab-464c-9ab0-f5f2bed22e4b tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:59.750987 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-899a33d6-f5ab-464c-9ab0-f5f2bed22e4b tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:59.761444 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-4623949b-4816-44ac-acbf-8bd24970086e tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:59:59.762298 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-4623949b-4816-44ac-acbf-8bd24970086e tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] [instance: d0b1b757-4a4d-4a7a-9a06-08f178a02984] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:59.777874 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4623949b-4816-44ac-acbf-8bd24970086e tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:59.779385 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4623949b-4816-44ac-acbf-8bd24970086e tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:59.781211 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4623949b-4816-44ac-acbf-8bd24970086e tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:59.783618 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4623949b-4816-44ac-acbf-8bd24970086e tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:59.785327 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4623949b-4816-44ac-acbf-8bd24970086e tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:59.786290 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4623949b-4816-44ac-acbf-8bd24970086e tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:59.851723 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.objects.instance [None req-4623949b-4816-44ac-acbf-8bd24970086e tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lazy-loading 'flavor' on Instance uuid d0b1b757-4a4d-4a7a-9a06-08f178a02984 {{(pid=134102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:59:59.966193 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell0:SELECT=8 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:00:00.156307 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-899a33d6-f5ab-464c-9ab0-f5f2bed22e4b tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e807c724cc4c3887a2d360f0584ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40071e45805146529fb8abd40629c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:00.206876 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-899a33d6-f5ab-464c-9ab0-f5f2bed22e4b tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] 10.222.0.43 "GET /compute/v2.1/servers/1b71cb4e-4f72-4c5d-a936-2ffc991910d9" status: 200 len: 1307 microversion: 2.1 time: 0.493277 Oct 04 22:00:00.220941 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1737/3521] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 21:59:59 2022] GET /compute/v2.1/servers/1b71cb4e-4f72-4c5d-a936-2ffc991910d9 => generated 1307 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:00:00.234958 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-fc72ee66-453f-491b-88a0-c17318595d97 tempest-ServerMetadataNegativeTestJSON-1726578604 tempest-ServerMetadataNegativeTestJSON-1726578604-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:00.236843 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-fc72ee66-453f-491b-88a0-c17318595d97 tempest-ServerMetadataNegativeTestJSON-1726578604 tempest-ServerMetadataNegativeTestJSON-1726578604-project] [instance: 34e510e1-0dd2-4799-8626-782c5f1912ba] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:00.261455 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fc72ee66-453f-491b-88a0-c17318595d97 tempest-ServerMetadataNegativeTestJSON-1726578604 tempest-ServerMetadataNegativeTestJSON-1726578604-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:00.262243 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fc72ee66-453f-491b-88a0-c17318595d97 tempest-ServerMetadataNegativeTestJSON-1726578604 tempest-ServerMetadataNegativeTestJSON-1726578604-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:00.263973 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fc72ee66-453f-491b-88a0-c17318595d97 tempest-ServerMetadataNegativeTestJSON-1726578604 tempest-ServerMetadataNegativeTestJSON-1726578604-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:00.265539 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fc72ee66-453f-491b-88a0-c17318595d97 tempest-ServerMetadataNegativeTestJSON-1726578604 tempest-ServerMetadataNegativeTestJSON-1726578604-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:00.267465 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fc72ee66-453f-491b-88a0-c17318595d97 tempest-ServerMetadataNegativeTestJSON-1726578604 tempest-ServerMetadataNegativeTestJSON-1726578604-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:00.268136 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fc72ee66-453f-491b-88a0-c17318595d97 tempest-ServerMetadataNegativeTestJSON-1726578604 tempest-ServerMetadataNegativeTestJSON-1726578604-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:00.277358 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-4623949b-4816-44ac-acbf-8bd24970086e tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] 10.222.0.43 "POST /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984/action" status: 202 len: 0 microversion: 2.91 time: 0.523017 Oct 04 22:00:00.280131 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1785/3522] 10.222.0.43 () {62 vars in 1319 bytes} [Tue Oct 4 21:59:59 2022] POST /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984/action => generated 0 bytes in 528 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 22:00:00.317714 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-d18e75cc-29c2-40aa-9eef-b80516a01769 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:00.320495 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-d18e75cc-29c2-40aa-9eef-b80516a01769 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: a4cf4fac-1e9b-4669-a6ff-30008ed3642d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:00.362923 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d18e75cc-29c2-40aa-9eef-b80516a01769 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:00.363775 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-fc72ee66-453f-491b-88a0-c17318595d97 tempest-ServerMetadataNegativeTestJSON-1726578604 tempest-ServerMetadataNegativeTestJSON-1726578604-project] HTTP exception thrown: Instance 34e510e1-0dd2-4799-8626-782c5f1912ba could not be found. Oct 04 22:00:00.375093 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d18e75cc-29c2-40aa-9eef-b80516a01769 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:00.375645 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-fc72ee66-453f-491b-88a0-c17318595d97 tempest-ServerMetadataNegativeTestJSON-1726578604 tempest-ServerMetadataNegativeTestJSON-1726578604-project] Request method failure captured: Oct 04 22:00:00.375645 n-d-860284-1 devstack@n-api.service[134101]: request: GET /compute/v2.1/servers/34e510e1-0dd2-4799-8626-782c5f1912ba HTTP/1.1 Oct 04 22:00:00.375645 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 22:00:00.375645 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 22:00:00.375645 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 22:00:00.375645 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 22:00:00.375645 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 22:00:00.375645 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 22:00:00.375645 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 22:00:00.375645 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 22:00:00.375645 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPKy7U6KAomJVBMOi5c5sKO1DBIOQh-o-PMZPWGelB_lBNhsk9b6911Uzvij9WsUDS6Gs7utGKR5vevcxUgdjq23D7vwWQGpYYY17XbHFHztBSH6tvk25FXD4JKeR3_F1kgR8sz9CLO6rH89FA0ZY5dajygvMxvM-WA3iHcAihgiByEw Oct 04 22:00:00.375645 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 22:00:00.375645 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 22:00:00.375645 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 22:00:00.375645 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 22:00:00.375645 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 22:00:00.375645 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 22:00:00.375645 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: c8b3066186614f7fbf7644a0f5d6c953 Oct 04 22:00:00.375645 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1726578604 Oct 04 22:00:00.375645 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 22:00:00.375645 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 22:00:00.375645 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c8b3066186614f7fbf7644a0f5d6c953"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_c8b3066186614f7fbf7644a0f5d6c953", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c8b3066186614f7fbf7644a0f5d6c953"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/c8b3066186614f7fbf7644a0f5d6c953"}]}] Oct 04 22:00:00.375645 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1726578604 Oct 04 22:00:00.375645 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: c8b3066186614f7fbf7644a0f5d6c953 Oct 04 22:00:00.375645 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1726578604 Oct 04 22:00:00.375645 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-ServerMetadataNegativeTestJSON-1726578604-project Oct 04 22:00:00.375645 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 22:00:00.375645 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 22:00:00.375645 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: f361ccb8eb4246f0bae1097edfe65096 Oct 04 22:00:00.375645 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1726578604-project Oct 04 22:00:00.375645 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 22:00:00.375645 n-d-860284-1 devstack@n-api.service[134101]: exception: Instance 34e510e1-0dd2-4799-8626-782c5f1912ba could not be found. Oct 04 22:00:00.375645 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': '34e510e1-0dd2-4799-8626-782c5f1912ba'} Oct 04 22:00:00.375645 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:00:00.375645 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:00:00.375645 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:00:00.375645 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:00:00.375645 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:00:00.375645 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:00:00.375645 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:00:00.375645 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:00:00.375645 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:00:00.375645 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:00:00.375645 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34e510e1-0dd2-4799-8626-782c5f1912ba could not be found. Oct 04 22:00:00.375645 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:00:00.375645 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:00:00.375645 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:00:00.375645 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:00:00.375645 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:00:00.375645 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:00:00.375645 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:00:00.375645 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:00:00.375645 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:00:00.375645 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:00:00.375645 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:00:00.375645 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:00:00.375645 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:00:00.375645 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:00:00.375645 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:00:00.375645 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:00:00.375645 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34e510e1-0dd2-4799-8626-782c5f1912ba could not be found. Oct 04 22:00:00.375645 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:00:00.375645 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:00:00.389552 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:00:00.389552 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:00:00.389552 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:00:00.389552 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:00:00.389552 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:00:00.389552 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:00:00.389552 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34e510e1-0dd2-4799-8626-782c5f1912ba could not be found. Oct 04 22:00:00.389552 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:00:00.389552 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-fc72ee66-453f-491b-88a0-c17318595d97 tempest-ServerMetadataNegativeTestJSON-1726578604 tempest-ServerMetadataNegativeTestJSON-1726578604-project] Returning 404 to user: Instance 34e510e1-0dd2-4799-8626-782c5f1912ba could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:00:00.389552 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-fc72ee66-453f-491b-88a0-c17318595d97 tempest-ServerMetadataNegativeTestJSON-1726578604 tempest-ServerMetadataNegativeTestJSON-1726578604-project] 10.222.0.43 "GET /compute/v2.1/servers/34e510e1-0dd2-4799-8626-782c5f1912ba" status: 404 len: 111 microversion: 2.1 time: 0.152566 Oct 04 22:00:00.389552 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1738/3523] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:00:00 2022] GET /compute/v2.1/servers/34e510e1-0dd2-4799-8626-782c5f1912ba => generated 111 bytes in 156 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:00:00.398572 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d18e75cc-29c2-40aa-9eef-b80516a01769 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:00.400154 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-01f96efe-dd5c-48dc-995c-8648037a18e6 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:00.400949 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-01f96efe-dd5c-48dc-995c-8648037a18e6 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] [instance: d0b1b757-4a4d-4a7a-9a06-08f178a02984] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:00.402760 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d18e75cc-29c2-40aa-9eef-b80516a01769 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:00.413603 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d18e75cc-29c2-40aa-9eef-b80516a01769 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:00.414072 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d18e75cc-29c2-40aa-9eef-b80516a01769 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:00.430244 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-01f96efe-dd5c-48dc-995c-8648037a18e6 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:00.441106 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-01f96efe-dd5c-48dc-995c-8648037a18e6 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:00.441806 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-01f96efe-dd5c-48dc-995c-8648037a18e6 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:00.444055 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-01f96efe-dd5c-48dc-995c-8648037a18e6 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:00.445975 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-01f96efe-dd5c-48dc-995c-8648037a18e6 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:00.447623 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-01f96efe-dd5c-48dc-995c-8648037a18e6 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:00.734075 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-01f96efe-dd5c-48dc-995c-8648037a18e6 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:00.749938 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-01f96efe-dd5c-48dc-995c-8648037a18e6 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:00.752014 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-01f96efe-dd5c-48dc-995c-8648037a18e6 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:00.758524 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-01f96efe-dd5c-48dc-995c-8648037a18e6 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] 10.222.0.43 "GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984" status: 200 len: 1537 microversion: 2.91 time: 0.372192 Oct 04 22:00:00.759929 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1739/3524] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:00:00 2022] GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984 => generated 1537 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:00:00.767556 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-60a375ff-b4c0-4438-bf94-cd313f98e8e7 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:00.768702 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-60a375ff-b4c0-4438-bf94-cd313f98e8e7 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] [instance: df147c22-6a7f-4081-83e7-97620b23700c] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:00.788059 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-60a375ff-b4c0-4438-bf94-cd313f98e8e7 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:00.789177 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-60a375ff-b4c0-4438-bf94-cd313f98e8e7 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:00.789870 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-60a375ff-b4c0-4438-bf94-cd313f98e8e7 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:00.790914 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-60a375ff-b4c0-4438-bf94-cd313f98e8e7 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:00.791395 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-60a375ff-b4c0-4438-bf94-cd313f98e8e7 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:00.792046 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-60a375ff-b4c0-4438-bf94-cd313f98e8e7 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:00.902802 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-d18e75cc-29c2-40aa-9eef-b80516a01769 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2facee4c6a40416e908083e126d2cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07a17a482a4e92b6ddbdee463c8029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:00.912717 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-d18e75cc-29c2-40aa-9eef-b80516a01769 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d" status: 200 len: 1510 microversion: 2.1 time: 0.626339 Oct 04 22:00:00.927170 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1786/3525] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:00:00 2022] GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d => generated 1510 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:00:01.071620 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-60a375ff-b4c0-4438-bf94-cd313f98e8e7 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2034fc9060874868bc5d27370a1c351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89499d833a4a00805164f4f79ed522', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:01.088416 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-60a375ff-b4c0-4438-bf94-cd313f98e8e7 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] 10.222.0.43 "GET /compute/v2.1/servers/df147c22-6a7f-4081-83e7-97620b23700c" status: 200 len: 1318 microversion: 2.1 time: 0.326084 Oct 04 22:00:01.098409 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1740/3526] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:00:00 2022] GET /compute/v2.1/servers/df147c22-6a7f-4081-83e7-97620b23700c => generated 1318 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:00:01.243742 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-7a4de0a9-c13e-4e36-b527-e758a10a7a38 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:01.245089 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-7a4de0a9-c13e-4e36-b527-e758a10a7a38 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] [instance: 1b71cb4e-4f72-4c5d-a936-2ffc991910d9] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:01.254578 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7a4de0a9-c13e-4e36-b527-e758a10a7a38 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:01.255409 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7a4de0a9-c13e-4e36-b527-e758a10a7a38 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:01.255930 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7a4de0a9-c13e-4e36-b527-e758a10a7a38 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:01.256890 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7a4de0a9-c13e-4e36-b527-e758a10a7a38 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:01.257345 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7a4de0a9-c13e-4e36-b527-e758a10a7a38 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:01.258112 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7a4de0a9-c13e-4e36-b527-e758a10a7a38 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:01.550773 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-7a4de0a9-c13e-4e36-b527-e758a10a7a38 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e807c724cc4c3887a2d360f0584ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40071e45805146529fb8abd40629c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:01.564603 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-7a4de0a9-c13e-4e36-b527-e758a10a7a38 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] 10.222.0.43 "GET /compute/v2.1/servers/1b71cb4e-4f72-4c5d-a936-2ffc991910d9" status: 200 len: 1307 microversion: 2.1 time: 0.330611 Oct 04 22:00:01.565245 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1787/3527] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:00:01 2022] GET /compute/v2.1/servers/1b71cb4e-4f72-4c5d-a936-2ffc991910d9 => generated 1307 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:00:01.789826 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-10a26b5e-c90e-4abd-bcdf-cb7985335e94 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:01.791402 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-10a26b5e-c90e-4abd-bcdf-cb7985335e94 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] [instance: d0b1b757-4a4d-4a7a-9a06-08f178a02984] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:01.793488 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-dc5bfef3-8d1e-43a6-acfa-15429aea9b08 req-aaef914a-84f7-40a6-a2a2-156f80f2a734 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b71cb4e-4f72-4c5d-a936-2ffc991910d9", "name": "network-vif-plugged", "status": "completed", "tag": "06cfe69e-7185-4b0b-a3ae-8b095095aab5"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:00:01.808471 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-10a26b5e-c90e-4abd-bcdf-cb7985335e94 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:01.808846 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-10a26b5e-c90e-4abd-bcdf-cb7985335e94 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:01.809190 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-10a26b5e-c90e-4abd-bcdf-cb7985335e94 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:01.810027 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-10a26b5e-c90e-4abd-bcdf-cb7985335e94 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:01.810546 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-10a26b5e-c90e-4abd-bcdf-cb7985335e94 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:01.813182 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-10a26b5e-c90e-4abd-bcdf-cb7985335e94 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:01.819893 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-dc5bfef3-8d1e-43a6-acfa-15429aea9b08 req-aaef914a-84f7-40a6-a2a2-156f80f2a734 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:01.820525 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-dc5bfef3-8d1e-43a6-acfa-15429aea9b08 req-aaef914a-84f7-40a6-a2a2-156f80f2a734 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:01.820997 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-dc5bfef3-8d1e-43a6-acfa-15429aea9b08 req-aaef914a-84f7-40a6-a2a2-156f80f2a734 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:01.856010 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-dc5bfef3-8d1e-43a6-acfa-15429aea9b08 req-aaef914a-84f7-40a6-a2a2-156f80f2a734 service nova] Creating event network-vif-plugged:06cfe69e-7185-4b0b-a3ae-8b095095aab5 for instance 1b71cb4e-4f72-4c5d-a936-2ffc991910d9 on n-h2-860284-1 Oct 04 22:00:01.863774 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-dc5bfef3-8d1e-43a6-acfa-15429aea9b08 req-aaef914a-84f7-40a6-a2a2-156f80f2a734 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075523 Oct 04 22:00:01.865073 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1788/3528] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:00:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:00:01.938094 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=2 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:00:01.945695 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-c557fdc2-4548-43ca-82f5-25b3fd3b6abb tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:01.947296 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-c557fdc2-4548-43ca-82f5-25b3fd3b6abb tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: a4cf4fac-1e9b-4669-a6ff-30008ed3642d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:01.956923 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c557fdc2-4548-43ca-82f5-25b3fd3b6abb tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:01.957811 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c557fdc2-4548-43ca-82f5-25b3fd3b6abb tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:01.958441 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c557fdc2-4548-43ca-82f5-25b3fd3b6abb tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:01.959400 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c557fdc2-4548-43ca-82f5-25b3fd3b6abb tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:01.960200 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c557fdc2-4548-43ca-82f5-25b3fd3b6abb tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:01.960888 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c557fdc2-4548-43ca-82f5-25b3fd3b6abb tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:02.055394 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-10a26b5e-c90e-4abd-bcdf-cb7985335e94 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:02.081316 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-10a26b5e-c90e-4abd-bcdf-cb7985335e94 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:02.091231 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-10a26b5e-c90e-4abd-bcdf-cb7985335e94 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:02.108279 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-10a26b5e-c90e-4abd-bcdf-cb7985335e94 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] 10.222.0.43 "GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984" status: 200 len: 1537 microversion: 2.91 time: 0.322917 Oct 04 22:00:02.109828 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1741/3529] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:00:01 2022] GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984 => generated 1537 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:00:02.129091 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-856b7f55-2761-496d-a966-a7c5b50dcdfe tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:02.129781 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-856b7f55-2761-496d-a966-a7c5b50dcdfe tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] [instance: df147c22-6a7f-4081-83e7-97620b23700c] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:02.147040 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-856b7f55-2761-496d-a966-a7c5b50dcdfe tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:02.155508 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-856b7f55-2761-496d-a966-a7c5b50dcdfe tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:02.156377 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-856b7f55-2761-496d-a966-a7c5b50dcdfe tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:02.157980 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-856b7f55-2761-496d-a966-a7c5b50dcdfe tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:02.159885 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-856b7f55-2761-496d-a966-a7c5b50dcdfe tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:02.161903 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-856b7f55-2761-496d-a966-a7c5b50dcdfe tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:02.322422 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=8 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:00:02.517207 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-c557fdc2-4548-43ca-82f5-25b3fd3b6abb tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2facee4c6a40416e908083e126d2cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07a17a482a4e92b6ddbdee463c8029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:02.527741 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-c557fdc2-4548-43ca-82f5-25b3fd3b6abb tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d" status: 200 len: 1510 microversion: 2.1 time: 0.589430 Oct 04 22:00:02.536603 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1789/3530] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:00:01 2022] GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d => generated 1510 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:00:02.544970 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-51bda77a-e3cd-4fe9-a69a-e7befa97bf5d req-c8f7a447-5fd1-44d4-9918-bc7e17b0c2e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df147c22-6a7f-4081-83e7-97620b23700c", "tag": "fdfe513a-ef00-4ef2-972c-073f6e43c48b"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:00:02.558817 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-51bda77a-e3cd-4fe9-a69a-e7befa97bf5d req-c8f7a447-5fd1-44d4-9918-bc7e17b0c2e2 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:02.560279 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-51bda77a-e3cd-4fe9-a69a-e7befa97bf5d req-c8f7a447-5fd1-44d4-9918-bc7e17b0c2e2 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:02.561079 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-51bda77a-e3cd-4fe9-a69a-e7befa97bf5d req-c8f7a447-5fd1-44d4-9918-bc7e17b0c2e2 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:02.581664 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-51bda77a-e3cd-4fe9-a69a-e7befa97bf5d req-c8f7a447-5fd1-44d4-9918-bc7e17b0c2e2 service nova] Creating event network-changed:fdfe513a-ef00-4ef2-972c-073f6e43c48b for instance df147c22-6a7f-4081-83e7-97620b23700c on n-h1-860284-1 Oct 04 22:00:02.592234 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-51bda77a-e3cd-4fe9-a69a-e7befa97bf5d req-c8f7a447-5fd1-44d4-9918-bc7e17b0c2e2 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053657 Oct 04 22:00:02.595175 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1790/3531] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:00:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:00:02.604670 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-8e9e8569-42a9-4d3b-93ea-9cd0c8d104ea tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:02.607062 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-8e9e8569-42a9-4d3b-93ea-9cd0c8d104ea tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] [instance: 1b71cb4e-4f72-4c5d-a936-2ffc991910d9] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:02.619584 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8e9e8569-42a9-4d3b-93ea-9cd0c8d104ea tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:02.620580 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8e9e8569-42a9-4d3b-93ea-9cd0c8d104ea tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:02.621375 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8e9e8569-42a9-4d3b-93ea-9cd0c8d104ea tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:02.623012 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8e9e8569-42a9-4d3b-93ea-9cd0c8d104ea tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:02.624795 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8e9e8569-42a9-4d3b-93ea-9cd0c8d104ea tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:02.625664 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8e9e8569-42a9-4d3b-93ea-9cd0c8d104ea tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:02.626805 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-856b7f55-2761-496d-a966-a7c5b50dcdfe tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2034fc9060874868bc5d27370a1c351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89499d833a4a00805164f4f79ed522', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:02.635283 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=100 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:00:02.640100 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-856b7f55-2761-496d-a966-a7c5b50dcdfe tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] 10.222.0.43 "GET /compute/v2.1/servers/df147c22-6a7f-4081-83e7-97620b23700c" status: 200 len: 1318 microversion: 2.1 time: 0.517831 Oct 04 22:00:02.641304 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1742/3532] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:00:02 2022] GET /compute/v2.1/servers/df147c22-6a7f-4081-83e7-97620b23700c => generated 1318 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:00:02.913727 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-8e9e8569-42a9-4d3b-93ea-9cd0c8d104ea tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e807c724cc4c3887a2d360f0584ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40071e45805146529fb8abd40629c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:02.924245 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-8e9e8569-42a9-4d3b-93ea-9cd0c8d104ea tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] 10.222.0.43 "GET /compute/v2.1/servers/1b71cb4e-4f72-4c5d-a936-2ffc991910d9" status: 200 len: 1307 microversion: 2.1 time: 0.325456 Oct 04 22:00:02.938506 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1791/3533] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:00:02 2022] GET /compute/v2.1/servers/1b71cb4e-4f72-4c5d-a936-2ffc991910d9 => generated 1307 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:00:03.146464 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-ee1191c4-5552-4a89-8135-9432f775f7a7 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:03.148022 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-ee1191c4-5552-4a89-8135-9432f775f7a7 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] [instance: d0b1b757-4a4d-4a7a-9a06-08f178a02984] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:03.157053 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ee1191c4-5552-4a89-8135-9432f775f7a7 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:03.160336 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ee1191c4-5552-4a89-8135-9432f775f7a7 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:03.160990 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ee1191c4-5552-4a89-8135-9432f775f7a7 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:03.162006 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ee1191c4-5552-4a89-8135-9432f775f7a7 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:03.162732 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ee1191c4-5552-4a89-8135-9432f775f7a7 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:03.164423 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ee1191c4-5552-4a89-8135-9432f775f7a7 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:03.287493 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-ee1191c4-5552-4a89-8135-9432f775f7a7 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:03.298208 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-ee1191c4-5552-4a89-8135-9432f775f7a7 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:03.300184 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-ee1191c4-5552-4a89-8135-9432f775f7a7 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:03.306420 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-ee1191c4-5552-4a89-8135-9432f775f7a7 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] 10.222.0.43 "GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984" status: 200 len: 1537 microversion: 2.91 time: 0.164953 Oct 04 22:00:03.307282 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1743/3534] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:00:03 2022] GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984 => generated 1537 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:00:03.565043 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-5184d621-fc2d-441a-9d5b-7b8e8f5b26dd tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:03.566735 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-5184d621-fc2d-441a-9d5b-7b8e8f5b26dd tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: a4cf4fac-1e9b-4669-a6ff-30008ed3642d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:03.581531 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5184d621-fc2d-441a-9d5b-7b8e8f5b26dd tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:03.582513 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5184d621-fc2d-441a-9d5b-7b8e8f5b26dd tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:03.583203 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5184d621-fc2d-441a-9d5b-7b8e8f5b26dd tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:03.587571 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5184d621-fc2d-441a-9d5b-7b8e8f5b26dd tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:03.588427 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5184d621-fc2d-441a-9d5b-7b8e8f5b26dd tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:03.589114 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5184d621-fc2d-441a-9d5b-7b8e8f5b26dd tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:03.670922 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-454a5f1e-d47a-42f2-93a1-036aff3c2102 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:03.672147 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-454a5f1e-d47a-42f2-93a1-036aff3c2102 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] [instance: df147c22-6a7f-4081-83e7-97620b23700c] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:03.683358 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-454a5f1e-d47a-42f2-93a1-036aff3c2102 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:03.683921 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-454a5f1e-d47a-42f2-93a1-036aff3c2102 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:03.685539 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-454a5f1e-d47a-42f2-93a1-036aff3c2102 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:03.687018 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-454a5f1e-d47a-42f2-93a1-036aff3c2102 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:03.688218 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-454a5f1e-d47a-42f2-93a1-036aff3c2102 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:03.689249 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-454a5f1e-d47a-42f2-93a1-036aff3c2102 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:03.836107 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-5184d621-fc2d-441a-9d5b-7b8e8f5b26dd tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2facee4c6a40416e908083e126d2cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07a17a482a4e92b6ddbdee463c8029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:03.845582 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-5184d621-fc2d-441a-9d5b-7b8e8f5b26dd tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d" status: 200 len: 1510 microversion: 2.1 time: 0.284547 Oct 04 22:00:03.846208 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1792/3535] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:00:03 2022] GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d => generated 1510 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:00:03.970343 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-941ab3d3-5534-4961-b177-d4045ed3dd17 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:03.970343 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-941ab3d3-5534-4961-b177-d4045ed3dd17 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] [instance: 1b71cb4e-4f72-4c5d-a936-2ffc991910d9] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:03.986476 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-941ab3d3-5534-4961-b177-d4045ed3dd17 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:03.986982 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-941ab3d3-5534-4961-b177-d4045ed3dd17 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:03.987422 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-941ab3d3-5534-4961-b177-d4045ed3dd17 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:03.988546 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-941ab3d3-5534-4961-b177-d4045ed3dd17 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:03.989332 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-941ab3d3-5534-4961-b177-d4045ed3dd17 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:03.990323 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-941ab3d3-5534-4961-b177-d4045ed3dd17 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:04.016682 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-454a5f1e-d47a-42f2-93a1-036aff3c2102 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2034fc9060874868bc5d27370a1c351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89499d833a4a00805164f4f79ed522', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:04.030579 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-454a5f1e-d47a-42f2-93a1-036aff3c2102 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] 10.222.0.43 "GET /compute/v2.1/servers/df147c22-6a7f-4081-83e7-97620b23700c" status: 200 len: 1318 microversion: 2.1 time: 0.367962 Oct 04 22:00:04.031338 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1744/3536] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:00:03 2022] GET /compute/v2.1/servers/df147c22-6a7f-4081-83e7-97620b23700c => generated 1318 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:00:04.190718 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-941ab3d3-5534-4961-b177-d4045ed3dd17 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e807c724cc4c3887a2d360f0584ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40071e45805146529fb8abd40629c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:04.200738 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-941ab3d3-5534-4961-b177-d4045ed3dd17 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] 10.222.0.43 "GET /compute/v2.1/servers/1b71cb4e-4f72-4c5d-a936-2ffc991910d9" status: 200 len: 1486 microversion: 2.1 time: 0.242467 Oct 04 22:00:04.201481 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1793/3537] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:00:03 2022] GET /compute/v2.1/servers/1b71cb4e-4f72-4c5d-a936-2ffc991910d9 => generated 1486 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:00:04.224385 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-1efc120d-0a21-409a-bdbf-8b4e1cd3029f tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-293393277"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:00:04.227726 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-1efc120d-0a21-409a-bdbf-8b4e1cd3029f tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] [instance: 1b71cb4e-4f72-4c5d-a936-2ffc991910d9] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:04.237340 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1efc120d-0a21-409a-bdbf-8b4e1cd3029f tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:04.238025 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1efc120d-0a21-409a-bdbf-8b4e1cd3029f tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:04.238497 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1efc120d-0a21-409a-bdbf-8b4e1cd3029f tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:04.239220 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1efc120d-0a21-409a-bdbf-8b4e1cd3029f tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:04.239684 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1efc120d-0a21-409a-bdbf-8b4e1cd3029f tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:04.240112 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1efc120d-0a21-409a-bdbf-8b4e1cd3029f tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:04.342590 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-6565662b-810f-430e-987c-1ff527d68e5f tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:04.343488 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-6565662b-810f-430e-987c-1ff527d68e5f tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] [instance: d0b1b757-4a4d-4a7a-9a06-08f178a02984] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:04.349538 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:00:04.351433 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6565662b-810f-430e-987c-1ff527d68e5f tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:04.352349 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6565662b-810f-430e-987c-1ff527d68e5f tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:04.353007 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6565662b-810f-430e-987c-1ff527d68e5f tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:04.353917 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6565662b-810f-430e-987c-1ff527d68e5f tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:04.354583 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6565662b-810f-430e-987c-1ff527d68e5f tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:04.355288 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6565662b-810f-430e-987c-1ff527d68e5f tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:04.443951 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-6565662b-810f-430e-987c-1ff527d68e5f tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:04.457294 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-6565662b-810f-430e-987c-1ff527d68e5f tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:04.459992 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-6565662b-810f-430e-987c-1ff527d68e5f tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:04.466159 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-6565662b-810f-430e-987c-1ff527d68e5f tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] 10.222.0.43 "GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984" status: 200 len: 1537 microversion: 2.91 time: 0.131695 Oct 04 22:00:04.483045 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1794/3538] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:00:04 2022] GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984 => generated 1537 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:00:04.520270 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-1efc120d-0a21-409a-bdbf-8b4e1cd3029f tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] 10.222.0.43 "POST /compute/v2.1/servers/1b71cb4e-4f72-4c5d-a936-2ffc991910d9/action" status: 202 len: 0 microversion: 2.1 time: 0.298783 Oct 04 22:00:04.551479 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1745/3539] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 22:00:04 2022] POST /compute/v2.1/servers/1b71cb4e-4f72-4c5d-a936-2ffc991910d9/action => generated 0 bytes in 332 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 04 22:00:04.556905 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-5333842f-92f2-4c86-acac-51194ae3638b tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Calling method '.version_select at 0x7fbb2f6fb040>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:04.660827 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-5333842f-92f2-4c86-acac-51194ae3638b tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] 10.222.0.43 "GET /compute/v2.1/images/6a0c8810-9135-4dea-a48a-c8adf2dbac3a" status: 200 len: 1409 microversion: 2.1 time: 0.108145 Oct 04 22:00:04.662252 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1795/3540] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 22:00:04 2022] GET /compute/v2.1/images/6a0c8810-9135-4dea-a48a-c8adf2dbac3a => generated 1409 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:00:04.677434 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-cfa5290f-ebba-4b66-977d-814c12ba93e1 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Calling method '.version_select at 0x7fbb2e68e280>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:04.737980 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-cfa5290f-ebba-4b66-977d-814c12ba93e1 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] 10.222.0.43 "GET /compute/v2.1/images/6a0c8810-9135-4dea-a48a-c8adf2dbac3a" status: 200 len: 1409 microversion: 2.1 time: 0.064690 Oct 04 22:00:04.738600 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1746/3541] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 22:00:04 2022] GET /compute/v2.1/images/6a0c8810-9135-4dea-a48a-c8adf2dbac3a => generated 1409 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:00:04.757160 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-7470eecb-ea2b-4923-9d84-a9f49d667c4f tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Calling method '.version_select at 0x7fbb2efc0280>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:04.872252 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e732f462-f805-47ef-8a59-625a8f190de0 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:04.873002 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-e732f462-f805-47ef-8a59-625a8f190de0 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: a4cf4fac-1e9b-4669-a6ff-30008ed3642d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:04.884493 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e732f462-f805-47ef-8a59-625a8f190de0 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:04.885012 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e732f462-f805-47ef-8a59-625a8f190de0 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:04.885462 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e732f462-f805-47ef-8a59-625a8f190de0 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:04.886192 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e732f462-f805-47ef-8a59-625a8f190de0 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:04.892537 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e732f462-f805-47ef-8a59-625a8f190de0 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:04.893265 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e732f462-f805-47ef-8a59-625a8f190de0 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:04.994015 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-7470eecb-ea2b-4923-9d84-a9f49d667c4f tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] 10.222.0.43 "DELETE /compute/v2.1/images/6a0c8810-9135-4dea-a48a-c8adf2dbac3a" status: 204 len: 0 microversion: 2.1 time: 0.243121 Oct 04 22:00:04.995353 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1796/3542] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:00:04 2022] DELETE /compute/v2.1/images/6a0c8810-9135-4dea-a48a-c8adf2dbac3a => generated 0 bytes in 245 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 22:00:05.015354 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-4a398719-324b-409c-ba91-c15fcaa5818b tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Calling method '.version_select at 0x7fbb2f0b7f70>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:05.045712 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-4a398719-324b-409c-ba91-c15fcaa5818b tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] HTTP exception thrown: Image not found. Oct 04 22:00:05.045712 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-4a398719-324b-409c-ba91-c15fcaa5818b tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Request method failure captured: Oct 04 22:00:05.045712 n-d-860284-1 devstack@n-api.service[134102]: request: GET /compute/v2.1/images/6a0c8810-9135-4dea-a48a-c8adf2dbac3a HTTP/1.1 Oct 04 22:00:05.045712 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 22:00:05.045712 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 22:00:05.045712 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 22:00:05.045712 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 22:00:05.045712 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 22:00:05.045712 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 22:00:05.045712 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 22:00:05.045712 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 22:00:05.045712 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPKvwRm5H229vYgT4QHRa2H3KJczD-aqhmeg0I-VS0SzH4LpkKkIiHtGK-ADawxjSM_n0nP8jiKarlV43x9RTjhXSdePJ8ObpL2_riw7qpbkit-jHniKDN-twWm_bE3Sp41ooGJIT8ljY8Dmm_FSvvYUKVYdQrj2kBYSVFTaeCRm4Bls Oct 04 22:00:05.045712 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 22:00:05.045712 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 22:00:05.045712 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 22:00:05.045712 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 22:00:05.045712 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 22:00:05.045712 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 22:00:05.045712 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: 40071e45805146529fb8abd40629c2ae Oct 04 22:00:05.045712 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-ImagesTestJSON-16557252 Oct 04 22:00:05.045712 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 22:00:05.045712 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 22:00:05.045712 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/40071e45805146529fb8abd40629c2ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_40071e45805146529fb8abd40629c2ae", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/40071e45805146529fb8abd40629c2ae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/40071e45805146529fb8abd40629c2ae"}]}] Oct 04 22:00:05.045712 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-ImagesTestJSON-16557252 Oct 04 22:00:05.045712 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: 40071e45805146529fb8abd40629c2ae Oct 04 22:00:05.045712 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-ImagesTestJSON-16557252 Oct 04 22:00:05.045712 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-ImagesTestJSON-16557252-project Oct 04 22:00:05.045712 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 22:00:05.045712 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 22:00:05.045712 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: f5e807c724cc4c3887a2d360f0584ffb Oct 04 22:00:05.045712 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-ImagesTestJSON-16557252-project Oct 04 22:00:05.045712 n-d-860284-1 devstack@n-api.service[134102]: method: Oct 04 22:00:05.045712 n-d-860284-1 devstack@n-api.service[134102]: exception: Image not found. Oct 04 22:00:05.045712 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': '6a0c8810-9135-4dea-a48a-c8adf2dbac3a'} Oct 04 22:00:05.045712 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:00:05.045712 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:00:05.045712 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 22:00:05.045712 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 22:00:05.045712 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 22:00:05.045712 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 22:00:05.045712 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 22:00:05.045712 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 22:00:05.045712 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 22:00:05.045712 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 22:00:05.045712 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 22:00:05.045712 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 22:00:05.045712 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 22:00:05.045712 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 22:00:05.045712 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 22:00:05.045712 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 22:00:05.045712 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 22:00:05.045712 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 22:00:05.045712 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 6a0c8810-9135-4dea-a48a-c8adf2dbac3a Oct 04 22:00:05.045712 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:00:05.045712 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:00:05.045712 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:00:05.045712 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:00:05.045712 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 04 22:00:05.045712 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 04 22:00:05.045712 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 04 22:00:05.045712 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 04 22:00:05.045712 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 04 22:00:05.045712 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 04 22:00:05.057384 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 04 22:00:05.057384 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 04 22:00:05.057384 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 22:00:05.057384 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 22:00:05.057384 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 22:00:05.057384 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 22:00:05.057384 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 22:00:05.057384 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 22:00:05.057384 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 22:00:05.057384 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 22:00:05.057384 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 22:00:05.057384 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 22:00:05.057384 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 22:00:05.057384 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 22:00:05.057384 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 22:00:05.057384 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 22:00:05.057384 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 22:00:05.057384 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 22:00:05.057384 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 6a0c8810-9135-4dea-a48a-c8adf2dbac3a could not be found. Oct 04 22:00:05.057384 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:00:05.057384 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:00:05.057384 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:00:05.057384 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:00:05.057384 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:00:05.057384 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:00:05.057384 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:00:05.057384 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:00:05.057384 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 22:00:05.057384 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 22:00:05.057384 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:00:05.057384 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:00:05.057384 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 04 22:00:05.057384 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 22:00:05.057384 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 22:00:05.057384 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:00:05.057384 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:00:05.057384 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:00:05.057384 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:00:05.057384 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:00:05.057384 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:00:05.057384 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:00:05.057384 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:00:05.057384 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 22:00:05.057384 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:00:05.057384 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-4a398719-324b-409c-ba91-c15fcaa5818b tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Returning 404 to user: Image not found. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:00:05.057384 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-4a398719-324b-409c-ba91-c15fcaa5818b tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] 10.222.0.43 "GET /compute/v2.1/images/6a0c8810-9135-4dea-a48a-c8adf2dbac3a" status: 404 len: 62 microversion: 2.1 time: 0.041989 Oct 04 22:00:05.057384 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1797/3543] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 22:00:04 2022] GET /compute/v2.1/images/6a0c8810-9135-4dea-a48a-c8adf2dbac3a => generated 62 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 22:00:05.070926 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-48088bd5-44f9-407e-b0d7-832be298c688 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:05.070926 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-48088bd5-44f9-407e-b0d7-832be298c688 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] [instance: df147c22-6a7f-4081-83e7-97620b23700c] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:05.074148 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-48088bd5-44f9-407e-b0d7-832be298c688 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:05.074741 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-48088bd5-44f9-407e-b0d7-832be298c688 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:05.075814 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-48088bd5-44f9-407e-b0d7-832be298c688 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:05.076678 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-48088bd5-44f9-407e-b0d7-832be298c688 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:05.077428 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-48088bd5-44f9-407e-b0d7-832be298c688 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:05.077947 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-48088bd5-44f9-407e-b0d7-832be298c688 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:05.253955 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-e732f462-f805-47ef-8a59-625a8f190de0 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2facee4c6a40416e908083e126d2cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07a17a482a4e92b6ddbdee463c8029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:05.262120 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-e732f462-f805-47ef-8a59-625a8f190de0 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d" status: 200 len: 1510 microversion: 2.1 time: 0.393711 Oct 04 22:00:05.263427 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1747/3544] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:00:04 2022] GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d => generated 1510 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:00:05.268416 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-bff8a1a2-4cbe-4208-9fe9-e1e139b70189 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:05.269036 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-bff8a1a2-4cbe-4208-9fe9-e1e139b70189 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] [instance: 1b71cb4e-4f72-4c5d-a936-2ffc991910d9] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:05.275961 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bff8a1a2-4cbe-4208-9fe9-e1e139b70189 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:05.276752 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bff8a1a2-4cbe-4208-9fe9-e1e139b70189 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:05.277418 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bff8a1a2-4cbe-4208-9fe9-e1e139b70189 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:05.278231 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bff8a1a2-4cbe-4208-9fe9-e1e139b70189 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:05.279436 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bff8a1a2-4cbe-4208-9fe9-e1e139b70189 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:05.279976 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bff8a1a2-4cbe-4208-9fe9-e1e139b70189 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:05.338057 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-48088bd5-44f9-407e-b0d7-832be298c688 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2034fc9060874868bc5d27370a1c351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89499d833a4a00805164f4f79ed522', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:05.342573 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:00:05.351651 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-48088bd5-44f9-407e-b0d7-832be298c688 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] 10.222.0.43 "GET /compute/v2.1/servers/df147c22-6a7f-4081-83e7-97620b23700c" status: 200 len: 1318 microversion: 2.1 time: 0.298728 Oct 04 22:00:05.352257 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1798/3545] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:00:05 2022] GET /compute/v2.1/servers/df147c22-6a7f-4081-83e7-97620b23700c => generated 1318 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:00:05.496460 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-1b2ce641-4f45-4b91-9fdf-70838815b22f tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:05.498877 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-1b2ce641-4f45-4b91-9fdf-70838815b22f tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] [instance: d0b1b757-4a4d-4a7a-9a06-08f178a02984] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:05.507333 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1b2ce641-4f45-4b91-9fdf-70838815b22f tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:05.510058 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1b2ce641-4f45-4b91-9fdf-70838815b22f tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:05.511502 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1b2ce641-4f45-4b91-9fdf-70838815b22f tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:05.512593 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1b2ce641-4f45-4b91-9fdf-70838815b22f tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:05.514428 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1b2ce641-4f45-4b91-9fdf-70838815b22f tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:05.514978 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1b2ce641-4f45-4b91-9fdf-70838815b22f tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:05.586481 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-bff8a1a2-4cbe-4208-9fe9-e1e139b70189 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e807c724cc4c3887a2d360f0584ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40071e45805146529fb8abd40629c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:05.601428 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-bff8a1a2-4cbe-4208-9fe9-e1e139b70189 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] 10.222.0.43 "GET /compute/v2.1/servers/1b71cb4e-4f72-4c5d-a936-2ffc991910d9" status: 200 len: 1498 microversion: 2.1 time: 0.336626 Oct 04 22:00:05.602254 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1748/3546] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:00:05 2022] GET /compute/v2.1/servers/1b71cb4e-4f72-4c5d-a936-2ffc991910d9 => generated 1498 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:00:06.000408 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-1b2ce641-4f45-4b91-9fdf-70838815b22f tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:06.011043 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-1b2ce641-4f45-4b91-9fdf-70838815b22f tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:06.012885 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-1b2ce641-4f45-4b91-9fdf-70838815b22f tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:06.020066 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-1b2ce641-4f45-4b91-9fdf-70838815b22f tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] 10.222.0.43 "GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984" status: 200 len: 1537 microversion: 2.91 time: 0.528768 Oct 04 22:00:06.020867 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1799/3547] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:00:05 2022] GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984 => generated 1537 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 22:00:06.288398 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e9135579-0f57-4ae2-a6fe-52a1de85e4ac tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:06.289331 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-e9135579-0f57-4ae2-a6fe-52a1de85e4ac tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: a4cf4fac-1e9b-4669-a6ff-30008ed3642d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:06.303216 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e9135579-0f57-4ae2-a6fe-52a1de85e4ac tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:06.306553 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e9135579-0f57-4ae2-a6fe-52a1de85e4ac tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:06.307275 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e9135579-0f57-4ae2-a6fe-52a1de85e4ac tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:06.308839 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e9135579-0f57-4ae2-a6fe-52a1de85e4ac tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:06.310584 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e9135579-0f57-4ae2-a6fe-52a1de85e4ac tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:06.311519 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e9135579-0f57-4ae2-a6fe-52a1de85e4ac tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:06.384033 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-3f9f300d-2d7f-4309-bdbf-6db7ee103eb2 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:06.384815 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-3f9f300d-2d7f-4309-bdbf-6db7ee103eb2 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] [instance: df147c22-6a7f-4081-83e7-97620b23700c] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:06.391987 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3f9f300d-2d7f-4309-bdbf-6db7ee103eb2 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:06.392490 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3f9f300d-2d7f-4309-bdbf-6db7ee103eb2 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:06.392960 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3f9f300d-2d7f-4309-bdbf-6db7ee103eb2 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:06.394078 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3f9f300d-2d7f-4309-bdbf-6db7ee103eb2 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:06.394652 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3f9f300d-2d7f-4309-bdbf-6db7ee103eb2 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:06.395090 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3f9f300d-2d7f-4309-bdbf-6db7ee103eb2 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:06.751748 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-3f9f300d-2d7f-4309-bdbf-6db7ee103eb2 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2034fc9060874868bc5d27370a1c351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89499d833a4a00805164f4f79ed522', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:06.768405 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-3f9f300d-2d7f-4309-bdbf-6db7ee103eb2 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] 10.222.0.43 "GET /compute/v2.1/servers/df147c22-6a7f-4081-83e7-97620b23700c" status: 200 len: 1318 microversion: 2.1 time: 0.393023 Oct 04 22:00:06.779064 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-e9135579-0f57-4ae2-a6fe-52a1de85e4ac tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2facee4c6a40416e908083e126d2cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07a17a482a4e92b6ddbdee463c8029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:06.780567 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1800/3548] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:00:06 2022] GET /compute/v2.1/servers/df147c22-6a7f-4081-83e7-97620b23700c => generated 1318 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:00:06.785921 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-72d47406-aa33-4462-83a3-a156d393fd81 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:06.787457 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-e9135579-0f57-4ae2-a6fe-52a1de85e4ac tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d" status: 200 len: 1510 microversion: 2.1 time: 0.503298 Oct 04 22:00:06.788856 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1749/3549] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:00:06 2022] GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d => generated 1510 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:00:06.799630 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-72d47406-aa33-4462-83a3-a156d393fd81 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] [instance: 1b71cb4e-4f72-4c5d-a936-2ffc991910d9] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:06.813953 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-72d47406-aa33-4462-83a3-a156d393fd81 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:06.814502 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-72d47406-aa33-4462-83a3-a156d393fd81 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:06.814959 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-72d47406-aa33-4462-83a3-a156d393fd81 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:06.815706 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-72d47406-aa33-4462-83a3-a156d393fd81 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:06.816176 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-72d47406-aa33-4462-83a3-a156d393fd81 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:06.816609 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-72d47406-aa33-4462-83a3-a156d393fd81 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:07.013726 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-72d47406-aa33-4462-83a3-a156d393fd81 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e807c724cc4c3887a2d360f0584ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40071e45805146529fb8abd40629c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:07.024502 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-72d47406-aa33-4462-83a3-a156d393fd81 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] 10.222.0.43 "GET /compute/v2.1/servers/1b71cb4e-4f72-4c5d-a936-2ffc991910d9" status: 200 len: 1504 microversion: 2.1 time: 0.242597 Oct 04 22:00:07.025369 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1801/3550] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:00:06 2022] GET /compute/v2.1/servers/1b71cb4e-4f72-4c5d-a936-2ffc991910d9 => generated 1504 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:00:07.051150 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-29e45308-196d-40e9-8e00-c5885131ea17 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:07.052155 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-29e45308-196d-40e9-8e00-c5885131ea17 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] [instance: d0b1b757-4a4d-4a7a-9a06-08f178a02984] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:07.065687 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-29e45308-196d-40e9-8e00-c5885131ea17 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:07.066424 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-29e45308-196d-40e9-8e00-c5885131ea17 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:07.067540 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-29e45308-196d-40e9-8e00-c5885131ea17 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:07.068290 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-29e45308-196d-40e9-8e00-c5885131ea17 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:07.068981 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-29e45308-196d-40e9-8e00-c5885131ea17 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:07.069933 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-29e45308-196d-40e9-8e00-c5885131ea17 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:07.204538 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-29e45308-196d-40e9-8e00-c5885131ea17 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:07.214209 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-29e45308-196d-40e9-8e00-c5885131ea17 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:07.215866 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-29e45308-196d-40e9-8e00-c5885131ea17 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:07.222563 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-29e45308-196d-40e9-8e00-c5885131ea17 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] 10.222.0.43 "GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984" status: 200 len: 1537 microversion: 2.91 time: 0.178071 Oct 04 22:00:07.230979 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1750/3551] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:00:07 2022] GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984 => generated 1537 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:00:07.803392 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-6e303647-ae1f-4998-8d77-f47257eb8cc1 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:07.805594 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-6e303647-ae1f-4998-8d77-f47257eb8cc1 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] [instance: df147c22-6a7f-4081-83e7-97620b23700c] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:07.815219 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-12063806-b7d4-4824-84a1-b3e59d412924 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:07.817681 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-12063806-b7d4-4824-84a1-b3e59d412924 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: a4cf4fac-1e9b-4669-a6ff-30008ed3642d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:07.832118 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-12063806-b7d4-4824-84a1-b3e59d412924 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:07.832618 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-12063806-b7d4-4824-84a1-b3e59d412924 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:07.835698 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6e303647-ae1f-4998-8d77-f47257eb8cc1 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:07.835698 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6e303647-ae1f-4998-8d77-f47257eb8cc1 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:07.836536 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-12063806-b7d4-4824-84a1-b3e59d412924 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:07.837493 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6e303647-ae1f-4998-8d77-f47257eb8cc1 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:07.839646 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6e303647-ae1f-4998-8d77-f47257eb8cc1 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:07.839646 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6e303647-ae1f-4998-8d77-f47257eb8cc1 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:07.839646 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6e303647-ae1f-4998-8d77-f47257eb8cc1 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:07.843262 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-12063806-b7d4-4824-84a1-b3e59d412924 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:07.844137 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-12063806-b7d4-4824-84a1-b3e59d412924 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:07.845133 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-12063806-b7d4-4824-84a1-b3e59d412924 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:08.174890 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-6e303647-ae1f-4998-8d77-f47257eb8cc1 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2034fc9060874868bc5d27370a1c351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89499d833a4a00805164f4f79ed522', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:08.190534 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-6e303647-ae1f-4998-8d77-f47257eb8cc1 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] 10.222.0.43 "GET /compute/v2.1/servers/df147c22-6a7f-4081-83e7-97620b23700c" status: 200 len: 1318 microversion: 2.1 time: 0.398648 Oct 04 22:00:08.191879 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1802/3552] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:00:07 2022] GET /compute/v2.1/servers/df147c22-6a7f-4081-83e7-97620b23700c => generated 1318 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:00:08.214457 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-12063806-b7d4-4824-84a1-b3e59d412924 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2facee4c6a40416e908083e126d2cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07a17a482a4e92b6ddbdee463c8029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:08.233002 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-12063806-b7d4-4824-84a1-b3e59d412924 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d" status: 200 len: 1531 microversion: 2.1 time: 0.422283 Oct 04 22:00:08.233322 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-32f72038-0b0d-43c9-b793-58fdd2701149 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:08.236105 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1751/3553] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:00:07 2022] GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d => generated 1531 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:00:08.236764 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-32f72038-0b0d-43c9-b793-58fdd2701149 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] [instance: 1b71cb4e-4f72-4c5d-a936-2ffc991910d9] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:08.249915 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-32f72038-0b0d-43c9-b793-58fdd2701149 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:08.251695 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-32f72038-0b0d-43c9-b793-58fdd2701149 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:08.253560 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-32f72038-0b0d-43c9-b793-58fdd2701149 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:08.265641 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-4e2bb3f5-acae-4acd-b206-54272d8c86ce tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:08.267670 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-4e2bb3f5-acae-4acd-b206-54272d8c86ce tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] [instance: d0b1b757-4a4d-4a7a-9a06-08f178a02984] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:08.271475 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-32f72038-0b0d-43c9-b793-58fdd2701149 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:08.273489 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-32f72038-0b0d-43c9-b793-58fdd2701149 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:08.275177 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-32f72038-0b0d-43c9-b793-58fdd2701149 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:08.283466 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4e2bb3f5-acae-4acd-b206-54272d8c86ce tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:08.286309 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4e2bb3f5-acae-4acd-b206-54272d8c86ce tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:08.287044 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4e2bb3f5-acae-4acd-b206-54272d8c86ce tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:08.289489 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4e2bb3f5-acae-4acd-b206-54272d8c86ce tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:08.290923 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4e2bb3f5-acae-4acd-b206-54272d8c86ce tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:08.293052 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4e2bb3f5-acae-4acd-b206-54272d8c86ce tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:08.436208 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-4e2bb3f5-acae-4acd-b206-54272d8c86ce tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:08.445178 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-4e2bb3f5-acae-4acd-b206-54272d8c86ce tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:08.447246 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-4e2bb3f5-acae-4acd-b206-54272d8c86ce tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:08.452762 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-4e2bb3f5-acae-4acd-b206-54272d8c86ce tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] 10.222.0.43 "GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984" status: 200 len: 1537 microversion: 2.91 time: 0.195933 Oct 04 22:00:08.453346 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1752/3554] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:00:08 2022] GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984 => generated 1537 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 22:00:08.621991 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-32f72038-0b0d-43c9-b793-58fdd2701149 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e807c724cc4c3887a2d360f0584ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40071e45805146529fb8abd40629c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:08.631454 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-32f72038-0b0d-43c9-b793-58fdd2701149 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] 10.222.0.43 "GET /compute/v2.1/servers/1b71cb4e-4f72-4c5d-a936-2ffc991910d9" status: 200 len: 1504 microversion: 2.1 time: 0.438122 Oct 04 22:00:08.634883 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1803/3555] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:00:08 2022] GET /compute/v2.1/servers/1b71cb4e-4f72-4c5d-a936-2ffc991910d9 => generated 1504 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:00:09.218885 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-2ede45e4-78e3-461b-ba6c-848fd04ebe9d tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:09.220055 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-2ede45e4-78e3-461b-ba6c-848fd04ebe9d tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] [instance: df147c22-6a7f-4081-83e7-97620b23700c] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:09.236404 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2ede45e4-78e3-461b-ba6c-848fd04ebe9d tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:09.236924 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2ede45e4-78e3-461b-ba6c-848fd04ebe9d tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:09.237385 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2ede45e4-78e3-461b-ba6c-848fd04ebe9d tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:09.238132 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2ede45e4-78e3-461b-ba6c-848fd04ebe9d tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:09.238626 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2ede45e4-78e3-461b-ba6c-848fd04ebe9d tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:09.239067 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2ede45e4-78e3-461b-ba6c-848fd04ebe9d tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:09.268056 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-fffc512c-1081-47a9-af2f-6d0a58ba0f0a tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:09.270260 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-fffc512c-1081-47a9-af2f-6d0a58ba0f0a tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: a4cf4fac-1e9b-4669-a6ff-30008ed3642d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:09.292883 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fffc512c-1081-47a9-af2f-6d0a58ba0f0a tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:09.293378 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fffc512c-1081-47a9-af2f-6d0a58ba0f0a tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:09.293876 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fffc512c-1081-47a9-af2f-6d0a58ba0f0a tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:09.294905 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fffc512c-1081-47a9-af2f-6d0a58ba0f0a tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:09.300321 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fffc512c-1081-47a9-af2f-6d0a58ba0f0a tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:09.302237 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fffc512c-1081-47a9-af2f-6d0a58ba0f0a tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:09.505195 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-fffc512c-1081-47a9-af2f-6d0a58ba0f0a tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2facee4c6a40416e908083e126d2cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07a17a482a4e92b6ddbdee463c8029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:09.518219 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-fffc512c-1081-47a9-af2f-6d0a58ba0f0a tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d" status: 200 len: 1531 microversion: 2.1 time: 0.257854 Oct 04 22:00:09.520951 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1804/3556] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:00:09 2022] GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d => generated 1531 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:00:09.532311 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-984939ef-0c57-4ac6-a635-6cb94073b3bb tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:09.537161 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-984939ef-0c57-4ac6-a635-6cb94073b3bb tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] [instance: d0b1b757-4a4d-4a7a-9a06-08f178a02984] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:09.555095 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-984939ef-0c57-4ac6-a635-6cb94073b3bb tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:09.560227 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-984939ef-0c57-4ac6-a635-6cb94073b3bb tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:09.560954 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-984939ef-0c57-4ac6-a635-6cb94073b3bb tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:09.561915 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-984939ef-0c57-4ac6-a635-6cb94073b3bb tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:09.565325 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-984939ef-0c57-4ac6-a635-6cb94073b3bb tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:09.566028 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-984939ef-0c57-4ac6-a635-6cb94073b3bb tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:09.743863 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-984939ef-0c57-4ac6-a635-6cb94073b3bb tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:09.760703 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-984939ef-0c57-4ac6-a635-6cb94073b3bb tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:09.765204 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-984939ef-0c57-4ac6-a635-6cb94073b3bb tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:09.776538 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-2ede45e4-78e3-461b-ba6c-848fd04ebe9d tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2034fc9060874868bc5d27370a1c351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89499d833a4a00805164f4f79ed522', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:09.783617 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-984939ef-0c57-4ac6-a635-6cb94073b3bb tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] 10.222.0.43 "GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984" status: 200 len: 1537 microversion: 2.91 time: 0.259885 Oct 04 22:00:09.786397 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1805/3557] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:00:09 2022] GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984 => generated 1537 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:00:09.793395 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-df683262-beee-41dc-a00a-33434cc71ac3 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:09.794977 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-df683262-beee-41dc-a00a-33434cc71ac3 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] [instance: 1b71cb4e-4f72-4c5d-a936-2ffc991910d9] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:09.796963 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-2ede45e4-78e3-461b-ba6c-848fd04ebe9d tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] 10.222.0.43 "GET /compute/v2.1/servers/df147c22-6a7f-4081-83e7-97620b23700c" status: 200 len: 1318 microversion: 2.1 time: 0.583182 Oct 04 22:00:09.802164 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-df683262-beee-41dc-a00a-33434cc71ac3 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:09.803035 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-df683262-beee-41dc-a00a-33434cc71ac3 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:09.803700 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-df683262-beee-41dc-a00a-33434cc71ac3 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:09.804686 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-df683262-beee-41dc-a00a-33434cc71ac3 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:09.805447 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-df683262-beee-41dc-a00a-33434cc71ac3 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:09.806152 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-df683262-beee-41dc-a00a-33434cc71ac3 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:09.818496 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1753/3558] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:00:09 2022] GET /compute/v2.1/servers/df147c22-6a7f-4081-83e7-97620b23700c => generated 1318 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:00:10.002139 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-df683262-beee-41dc-a00a-33434cc71ac3 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e807c724cc4c3887a2d360f0584ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40071e45805146529fb8abd40629c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:10.013691 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-df683262-beee-41dc-a00a-33434cc71ac3 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] 10.222.0.43 "GET /compute/v2.1/servers/1b71cb4e-4f72-4c5d-a936-2ffc991910d9" status: 200 len: 1499 microversion: 2.1 time: 0.224564 Oct 04 22:00:10.027384 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1806/3559] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:00:09 2022] GET /compute/v2.1/servers/1b71cb4e-4f72-4c5d-a936-2ffc991910d9 => generated 1499 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:00:10.246709 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-b59e24be-ca0f-4e79-a4a2-3a6080958bb0 req-8f7379ce-d9d2-4027-b91f-c1d9931712d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b71cb4e-4f72-4c5d-a936-2ffc991910d9", "name": "network-vif-plugged", "status": "completed", "tag": "06cfe69e-7185-4b0b-a3ae-8b095095aab5"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:00:10.265731 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-b59e24be-ca0f-4e79-a4a2-3a6080958bb0 req-8f7379ce-d9d2-4027-b91f-c1d9931712d0 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:10.279520 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-b59e24be-ca0f-4e79-a4a2-3a6080958bb0 req-8f7379ce-d9d2-4027-b91f-c1d9931712d0 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:10.280407 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-b59e24be-ca0f-4e79-a4a2-3a6080958bb0 req-8f7379ce-d9d2-4027-b91f-c1d9931712d0 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:10.308148 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-b59e24be-ca0f-4e79-a4a2-3a6080958bb0 req-8f7379ce-d9d2-4027-b91f-c1d9931712d0 service nova] Creating event network-vif-plugged:06cfe69e-7185-4b0b-a3ae-8b095095aab5 for instance 1b71cb4e-4f72-4c5d-a936-2ffc991910d9 on n-h2-860284-1 Oct 04 22:00:10.323447 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-b59e24be-ca0f-4e79-a4a2-3a6080958bb0 req-8f7379ce-d9d2-4027-b91f-c1d9931712d0 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079279 Oct 04 22:00:10.324328 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1754/3560] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:00:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:00:10.551732 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-d0d1a493-0e2b-494d-906a-87f617a27428 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:10.553529 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-d0d1a493-0e2b-494d-906a-87f617a27428 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: a4cf4fac-1e9b-4669-a6ff-30008ed3642d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:10.562197 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d0d1a493-0e2b-494d-906a-87f617a27428 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:10.575718 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d0d1a493-0e2b-494d-906a-87f617a27428 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:10.584260 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d0d1a493-0e2b-494d-906a-87f617a27428 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:10.586257 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d0d1a493-0e2b-494d-906a-87f617a27428 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:10.587561 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d0d1a493-0e2b-494d-906a-87f617a27428 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:10.589053 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d0d1a493-0e2b-494d-906a-87f617a27428 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:10.827240 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-df713123-2c4b-4f9c-bb0d-a57f057d84b2 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:10.828663 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-df713123-2c4b-4f9c-bb0d-a57f057d84b2 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] [instance: df147c22-6a7f-4081-83e7-97620b23700c] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:10.858770 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-df713123-2c4b-4f9c-bb0d-a57f057d84b2 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:10.867068 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-df713123-2c4b-4f9c-bb0d-a57f057d84b2 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:10.867577 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-df713123-2c4b-4f9c-bb0d-a57f057d84b2 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:10.872751 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-df713123-2c4b-4f9c-bb0d-a57f057d84b2 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:10.877327 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-df713123-2c4b-4f9c-bb0d-a57f057d84b2 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:10.880107 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-df713123-2c4b-4f9c-bb0d-a57f057d84b2 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:10.914178 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-d0d1a493-0e2b-494d-906a-87f617a27428 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2facee4c6a40416e908083e126d2cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07a17a482a4e92b6ddbdee463c8029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:10.935391 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-d0d1a493-0e2b-494d-906a-87f617a27428 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d" status: 200 len: 1531 microversion: 2.1 time: 0.386818 Oct 04 22:00:10.942006 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1807/3561] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:00:10 2022] GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d => generated 1531 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:00:10.959760 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-bb647650-f7d8-4032-a373-25c71a84a246 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:10.963296 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-bb647650-f7d8-4032-a373-25c71a84a246 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] [instance: d0b1b757-4a4d-4a7a-9a06-08f178a02984] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:10.977694 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bb647650-f7d8-4032-a373-25c71a84a246 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:10.978132 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bb647650-f7d8-4032-a373-25c71a84a246 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:10.978879 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bb647650-f7d8-4032-a373-25c71a84a246 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:10.979582 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bb647650-f7d8-4032-a373-25c71a84a246 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:10.983028 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bb647650-f7d8-4032-a373-25c71a84a246 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:10.983506 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bb647650-f7d8-4032-a373-25c71a84a246 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:11.190137 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-bb647650-f7d8-4032-a373-25c71a84a246 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:11.203115 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-bb647650-f7d8-4032-a373-25c71a84a246 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:11.204874 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-bb647650-f7d8-4032-a373-25c71a84a246 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:11.212705 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-bb647650-f7d8-4032-a373-25c71a84a246 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] 10.222.0.43 "GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984" status: 200 len: 1537 microversion: 2.91 time: 0.268595 Oct 04 22:00:11.228710 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1808/3562] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:00:10 2022] GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984 => generated 1537 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:00:11.244567 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-cfc90155-a1ed-406d-9535-87ec385670ab tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:11.245129 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-cfc90155-a1ed-406d-9535-87ec385670ab tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] [instance: 1b71cb4e-4f72-4c5d-a936-2ffc991910d9] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:11.257500 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cfc90155-a1ed-406d-9535-87ec385670ab tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:11.259178 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cfc90155-a1ed-406d-9535-87ec385670ab tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:11.259940 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cfc90155-a1ed-406d-9535-87ec385670ab tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:11.261145 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cfc90155-a1ed-406d-9535-87ec385670ab tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:11.261785 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cfc90155-a1ed-406d-9535-87ec385670ab tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:11.262600 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cfc90155-a1ed-406d-9535-87ec385670ab tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:11.302483 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-df713123-2c4b-4f9c-bb0d-a57f057d84b2 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2034fc9060874868bc5d27370a1c351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89499d833a4a00805164f4f79ed522', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:11.322931 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-df713123-2c4b-4f9c-bb0d-a57f057d84b2 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] 10.222.0.43 "GET /compute/v2.1/servers/df147c22-6a7f-4081-83e7-97620b23700c" status: 200 len: 1318 microversion: 2.1 time: 0.491732 Oct 04 22:00:11.323607 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1755/3563] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:00:10 2022] GET /compute/v2.1/servers/df147c22-6a7f-4081-83e7-97620b23700c => generated 1318 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:00:11.462337 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-cfc90155-a1ed-406d-9535-87ec385670ab tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e807c724cc4c3887a2d360f0584ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40071e45805146529fb8abd40629c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:11.473198 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-cfc90155-a1ed-406d-9535-87ec385670ab tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] 10.222.0.43 "GET /compute/v2.1/servers/1b71cb4e-4f72-4c5d-a936-2ffc991910d9" status: 200 len: 1486 microversion: 2.1 time: 0.243211 Oct 04 22:00:11.473776 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1809/3564] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:00:11 2022] GET /compute/v2.1/servers/1b71cb4e-4f72-4c5d-a936-2ffc991910d9 => generated 1486 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:00:11.521010 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-1636c4e6-8724-49a2-b80c-c4d24bd42ee4 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:11.521514 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-1636c4e6-8724-49a2-b80c-c4d24bd42ee4 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] [instance: 1b71cb4e-4f72-4c5d-a936-2ffc991910d9] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:11.532204 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1636c4e6-8724-49a2-b80c-c4d24bd42ee4 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:11.532710 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1636c4e6-8724-49a2-b80c-c4d24bd42ee4 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:11.533164 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1636c4e6-8724-49a2-b80c-c4d24bd42ee4 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:11.533892 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1636c4e6-8724-49a2-b80c-c4d24bd42ee4 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:11.534356 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1636c4e6-8724-49a2-b80c-c4d24bd42ee4 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:11.534816 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1636c4e6-8724-49a2-b80c-c4d24bd42ee4 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:11.564252 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-1636c4e6-8724-49a2-b80c-c4d24bd42ee4 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] [instance: 1b71cb4e-4f72-4c5d-a936-2ffc991910d9] Going to try to terminate instance {{(pid=134101) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 22:00:11.740539 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-1636c4e6-8724-49a2-b80c-c4d24bd42ee4 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] 10.222.0.43 "DELETE /compute/v2.1/servers/1b71cb4e-4f72-4c5d-a936-2ffc991910d9" status: 204 len: 0 microversion: 2.1 time: 0.223291 Oct 04 22:00:11.741512 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1756/3565] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 22:00:11 2022] DELETE /compute/v2.1/servers/1b71cb4e-4f72-4c5d-a936-2ffc991910d9 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 22:00:11.754065 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-970f6d59-10ea-4316-a348-151eeecd7cf1 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Calling method '.version_select at 0x7fbb37280940>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:11.796821 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-970f6d59-10ea-4316-a348-151eeecd7cf1 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] HTTP exception thrown: Image not found. Oct 04 22:00:11.799038 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-970f6d59-10ea-4316-a348-151eeecd7cf1 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Request method failure captured: Oct 04 22:00:11.799038 n-d-860284-1 devstack@n-api.service[134102]: request: DELETE /compute/v2.1/images/6a0c8810-9135-4dea-a48a-c8adf2dbac3a HTTP/1.1 Oct 04 22:00:11.799038 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 22:00:11.799038 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 22:00:11.799038 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 22:00:11.799038 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 22:00:11.799038 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 22:00:11.799038 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 22:00:11.799038 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 22:00:11.799038 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 22:00:11.799038 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPKvwRm5H229vYgT4QHRa2H3KJczD-aqhmeg0I-VS0SzH4LpkKkIiHtGK-ADawxjSM_n0nP8jiKarlV43x9RTjhXSdePJ8ObpL2_riw7qpbkit-jHniKDN-twWm_bE3Sp41ooGJIT8ljY8Dmm_FSvvYUKVYdQrj2kBYSVFTaeCRm4Bls Oct 04 22:00:11.799038 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 22:00:11.799038 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 22:00:11.799038 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 22:00:11.799038 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 22:00:11.799038 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 22:00:11.799038 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 22:00:11.799038 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: 40071e45805146529fb8abd40629c2ae Oct 04 22:00:11.799038 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-ImagesTestJSON-16557252 Oct 04 22:00:11.799038 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 22:00:11.799038 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 22:00:11.799038 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/40071e45805146529fb8abd40629c2ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_40071e45805146529fb8abd40629c2ae", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/40071e45805146529fb8abd40629c2ae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/40071e45805146529fb8abd40629c2ae"}]}] Oct 04 22:00:11.799038 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-ImagesTestJSON-16557252 Oct 04 22:00:11.799038 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: 40071e45805146529fb8abd40629c2ae Oct 04 22:00:11.799038 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-ImagesTestJSON-16557252 Oct 04 22:00:11.799038 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-ImagesTestJSON-16557252-project Oct 04 22:00:11.799038 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 22:00:11.799038 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 22:00:11.799038 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: f5e807c724cc4c3887a2d360f0584ffb Oct 04 22:00:11.799038 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-ImagesTestJSON-16557252-project Oct 04 22:00:11.799038 n-d-860284-1 devstack@n-api.service[134102]: method: Oct 04 22:00:11.799038 n-d-860284-1 devstack@n-api.service[134102]: exception: Image not found. Oct 04 22:00:11.799038 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': '6a0c8810-9135-4dea-a48a-c8adf2dbac3a'} Oct 04 22:00:11.799038 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:00:11.799038 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:00:11.799038 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 04 22:00:11.799038 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 04 22:00:11.799038 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 22:00:11.799038 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 22:00:11.799038 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 22:00:11.799038 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 22:00:11.799038 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 04 22:00:11.799038 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 04 22:00:11.799038 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 04 22:00:11.799038 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 04 22:00:11.799038 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 22:00:11.799038 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 22:00:11.799038 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 22:00:11.799038 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 22:00:11.799038 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 6a0c8810-9135-4dea-a48a-c8adf2dbac3a to delete Oct 04 22:00:11.799038 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:00:11.799038 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:00:11.799038 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:00:11.799038 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:00:11.799038 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 04 22:00:11.799038 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 04 22:00:11.799038 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 04 22:00:11.799038 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 04 22:00:11.799038 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 04 22:00:11.799038 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 04 22:00:11.799038 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 6a0c8810-9135-4dea-a48a-c8adf2dbac3a could not be found. Oct 04 22:00:11.799038 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:00:11.799038 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:00:11.799038 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:00:11.799038 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:00:11.805017 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:00:11.805017 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:00:11.805017 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:00:11.805017 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:00:11.805017 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 22:00:11.805017 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 22:00:11.805017 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:00:11.805017 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:00:11.805017 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 04 22:00:11.805017 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 22:00:11.805017 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 22:00:11.805017 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:00:11.805017 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:00:11.805017 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:00:11.805017 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:00:11.805017 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:00:11.805017 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:00:11.805017 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:00:11.805017 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:00:11.805017 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 22:00:11.805017 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:00:11.813954 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-970f6d59-10ea-4316-a348-151eeecd7cf1 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Returning 404 to user: Image not found. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:00:11.815453 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-970f6d59-10ea-4316-a348-151eeecd7cf1 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] 10.222.0.43 "DELETE /compute/v2.1/images/6a0c8810-9135-4dea-a48a-c8adf2dbac3a" status: 404 len: 62 microversion: 2.1 time: 0.065312 Oct 04 22:00:11.816406 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1810/3566] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:00:11 2022] DELETE /compute/v2.1/images/6a0c8810-9135-4dea-a48a-c8adf2dbac3a => generated 62 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 22:00:11.827886 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-6832a9ff-ee0c-4955-a02d-299b7de6d2d9 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:11.830192 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-6832a9ff-ee0c-4955-a02d-299b7de6d2d9 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] [instance: 1b71cb4e-4f72-4c5d-a936-2ffc991910d9] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:11.851751 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6832a9ff-ee0c-4955-a02d-299b7de6d2d9 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:11.856762 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6832a9ff-ee0c-4955-a02d-299b7de6d2d9 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:11.858060 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6832a9ff-ee0c-4955-a02d-299b7de6d2d9 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:11.859208 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6832a9ff-ee0c-4955-a02d-299b7de6d2d9 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:11.863084 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6832a9ff-ee0c-4955-a02d-299b7de6d2d9 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:11.863791 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6832a9ff-ee0c-4955-a02d-299b7de6d2d9 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:11.931714 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-6832a9ff-ee0c-4955-a02d-299b7de6d2d9 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] [instance: 1b71cb4e-4f72-4c5d-a936-2ffc991910d9] Going to try to terminate instance {{(pid=134101) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 22:00:11.970115 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-79e2bde2-e705-4ea0-8abd-a0cd698e9ff4 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:11.971101 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-79e2bde2-e705-4ea0-8abd-a0cd698e9ff4 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: a4cf4fac-1e9b-4669-a6ff-30008ed3642d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:11.995128 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-79e2bde2-e705-4ea0-8abd-a0cd698e9ff4 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:11.999363 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-79e2bde2-e705-4ea0-8abd-a0cd698e9ff4 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:12.000525 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-79e2bde2-e705-4ea0-8abd-a0cd698e9ff4 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:12.001636 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:00:12.004142 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-79e2bde2-e705-4ea0-8abd-a0cd698e9ff4 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:12.010347 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-79e2bde2-e705-4ea0-8abd-a0cd698e9ff4 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:12.011035 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-79e2bde2-e705-4ea0-8abd-a0cd698e9ff4 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:12.157849 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.compute.api [None req-6832a9ff-ee0c-4955-a02d-299b7de6d2d9 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] [instance: 1b71cb4e-4f72-4c5d-a936-2ffc991910d9] Instance is already in deleting state, ignoring this request Oct 04 22:00:12.165958 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-6832a9ff-ee0c-4955-a02d-299b7de6d2d9 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] 10.222.0.43 "DELETE /compute/v2.1/servers/1b71cb4e-4f72-4c5d-a936-2ffc991910d9" status: 204 len: 0 microversion: 2.1 time: 0.343595 Oct 04 22:00:12.166927 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1757/3567] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 22:00:11 2022] DELETE /compute/v2.1/servers/1b71cb4e-4f72-4c5d-a936-2ffc991910d9 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 22:00:12.181257 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-5329c79e-8f8f-4f94-8d7b-6bdb2fc7e751 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:12.188542 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-5329c79e-8f8f-4f94-8d7b-6bdb2fc7e751 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] [instance: 1b71cb4e-4f72-4c5d-a936-2ffc991910d9] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:12.220444 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5329c79e-8f8f-4f94-8d7b-6bdb2fc7e751 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:12.221238 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5329c79e-8f8f-4f94-8d7b-6bdb2fc7e751 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:12.221845 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5329c79e-8f8f-4f94-8d7b-6bdb2fc7e751 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:12.223794 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5329c79e-8f8f-4f94-8d7b-6bdb2fc7e751 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:12.224995 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5329c79e-8f8f-4f94-8d7b-6bdb2fc7e751 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:12.225436 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5329c79e-8f8f-4f94-8d7b-6bdb2fc7e751 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:12.458377 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-79e2bde2-e705-4ea0-8abd-a0cd698e9ff4 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2facee4c6a40416e908083e126d2cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07a17a482a4e92b6ddbdee463c8029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:12.471884 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-79e2bde2-e705-4ea0-8abd-a0cd698e9ff4 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d" status: 200 len: 1526 microversion: 2.1 time: 0.506017 Oct 04 22:00:12.474404 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1811/3568] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:00:11 2022] GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d => generated 1526 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:00:12.488988 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-8680b2fc-7a1a-46c9-8c35-00c9c9f95a65 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:12.500030 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-8680b2fc-7a1a-46c9-8c35-00c9c9f95a65 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] [instance: d0b1b757-4a4d-4a7a-9a06-08f178a02984] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:12.514082 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8680b2fc-7a1a-46c9-8c35-00c9c9f95a65 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:12.514650 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8680b2fc-7a1a-46c9-8c35-00c9c9f95a65 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:12.515128 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8680b2fc-7a1a-46c9-8c35-00c9c9f95a65 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:12.515836 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8680b2fc-7a1a-46c9-8c35-00c9c9f95a65 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:12.516298 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8680b2fc-7a1a-46c9-8c35-00c9c9f95a65 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:12.517000 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8680b2fc-7a1a-46c9-8c35-00c9c9f95a65 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:12.634270 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-5329c79e-8f8f-4f94-8d7b-6bdb2fc7e751 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e807c724cc4c3887a2d360f0584ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40071e45805146529fb8abd40629c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:12.644262 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-5329c79e-8f8f-4f94-8d7b-6bdb2fc7e751 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] 10.222.0.43 "GET /compute/v2.1/servers/1b71cb4e-4f72-4c5d-a936-2ffc991910d9" status: 200 len: 1492 microversion: 2.1 time: 0.470790 Oct 04 22:00:12.662439 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1758/3569] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:00:12 2022] GET /compute/v2.1/servers/1b71cb4e-4f72-4c5d-a936-2ffc991910d9 => generated 1492 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:00:12.677300 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-901b7f89-e4f2-478f-8863-e60c2806e23e tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:12.687677 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-901b7f89-e4f2-478f-8863-e60c2806e23e tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] [instance: df147c22-6a7f-4081-83e7-97620b23700c] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:12.715301 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-8680b2fc-7a1a-46c9-8c35-00c9c9f95a65 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:12.729088 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-8680b2fc-7a1a-46c9-8c35-00c9c9f95a65 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:12.733884 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-901b7f89-e4f2-478f-8863-e60c2806e23e tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:12.734403 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-901b7f89-e4f2-478f-8863-e60c2806e23e tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:12.734857 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-901b7f89-e4f2-478f-8863-e60c2806e23e tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:12.735578 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-901b7f89-e4f2-478f-8863-e60c2806e23e tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:12.736037 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-901b7f89-e4f2-478f-8863-e60c2806e23e tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:12.736372 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-8680b2fc-7a1a-46c9-8c35-00c9c9f95a65 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:12.736522 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-901b7f89-e4f2-478f-8863-e60c2806e23e tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:12.747560 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-8680b2fc-7a1a-46c9-8c35-00c9c9f95a65 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] 10.222.0.43 "GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984" status: 200 len: 1537 microversion: 2.91 time: 0.271742 Oct 04 22:00:12.750017 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1812/3570] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:00:12 2022] GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984 => generated 1537 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:00:12.774205 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-77739b5b-b922-4c65-8055-8c7e3c46186c req-b9959740-9280-4e3f-ad17-221cb54f2d96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df147c22-6a7f-4081-83e7-97620b23700c", "name": "network-vif-plugged", "status": "completed", "tag": "fdfe513a-ef00-4ef2-972c-073f6e43c48b"}, {"server_uuid": "a4cf4fac-1e9b-4669-a6ff-30008ed3642d", "name": "network-vif-plugged", "status": "completed", "tag": "17823d3d-fc62-47ee-8e12-cf0154daa955"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:00:12.798533 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-77739b5b-b922-4c65-8055-8c7e3c46186c req-b9959740-9280-4e3f-ad17-221cb54f2d96 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:12.801585 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-77739b5b-b922-4c65-8055-8c7e3c46186c req-b9959740-9280-4e3f-ad17-221cb54f2d96 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:12.802981 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-77739b5b-b922-4c65-8055-8c7e3c46186c req-b9959740-9280-4e3f-ad17-221cb54f2d96 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:12.831604 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-77739b5b-b922-4c65-8055-8c7e3c46186c req-b9959740-9280-4e3f-ad17-221cb54f2d96 service nova] Creating event network-vif-plugged:fdfe513a-ef00-4ef2-972c-073f6e43c48b for instance df147c22-6a7f-4081-83e7-97620b23700c on n-h1-860284-1 Oct 04 22:00:12.844872 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-77739b5b-b922-4c65-8055-8c7e3c46186c req-b9959740-9280-4e3f-ad17-221cb54f2d96 service nova] Creating event network-vif-plugged:17823d3d-fc62-47ee-8e12-cf0154daa955 for instance a4cf4fac-1e9b-4669-a6ff-30008ed3642d on n-h1-860284-1 Oct 04 22:00:12.868407 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-77739b5b-b922-4c65-8055-8c7e3c46186c req-b9959740-9280-4e3f-ad17-221cb54f2d96 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.115075 Oct 04 22:00:12.868407 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1813/3571] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:00:12 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:00:13.459888 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-901b7f89-e4f2-478f-8863-e60c2806e23e tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2034fc9060874868bc5d27370a1c351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89499d833a4a00805164f4f79ed522', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:13.470479 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-901b7f89-e4f2-478f-8863-e60c2806e23e tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] 10.222.0.43 "GET /compute/v2.1/servers/df147c22-6a7f-4081-83e7-97620b23700c" status: 200 len: 1318 microversion: 2.1 time: 0.804802 Oct 04 22:00:13.479545 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1759/3572] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:00:12 2022] GET /compute/v2.1/servers/df147c22-6a7f-4081-83e7-97620b23700c => generated 1318 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:00:13.500846 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-4c1c0ea1-f2a9-4670-bc45-a5041cf14de6 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:13.501632 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-4c1c0ea1-f2a9-4670-bc45-a5041cf14de6 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: a4cf4fac-1e9b-4669-a6ff-30008ed3642d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:13.514443 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4c1c0ea1-f2a9-4670-bc45-a5041cf14de6 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:13.515212 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4c1c0ea1-f2a9-4670-bc45-a5041cf14de6 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:13.515888 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4c1c0ea1-f2a9-4670-bc45-a5041cf14de6 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:13.518140 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4c1c0ea1-f2a9-4670-bc45-a5041cf14de6 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:13.523143 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4c1c0ea1-f2a9-4670-bc45-a5041cf14de6 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:13.524922 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4c1c0ea1-f2a9-4670-bc45-a5041cf14de6 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:13.694753 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-4c28579b-0969-42fe-96fc-ce52869d53c2 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:13.695565 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-4c28579b-0969-42fe-96fc-ce52869d53c2 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] [instance: 1b71cb4e-4f72-4c5d-a936-2ffc991910d9] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:13.732698 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4c28579b-0969-42fe-96fc-ce52869d53c2 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:13.743689 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4c28579b-0969-42fe-96fc-ce52869d53c2 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:13.744525 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4c28579b-0969-42fe-96fc-ce52869d53c2 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:13.751945 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4c28579b-0969-42fe-96fc-ce52869d53c2 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:13.752695 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4c28579b-0969-42fe-96fc-ce52869d53c2 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:13.756756 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4c28579b-0969-42fe-96fc-ce52869d53c2 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:14.543569 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-4c1c0ea1-f2a9-4670-bc45-a5041cf14de6 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2facee4c6a40416e908083e126d2cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07a17a482a4e92b6ddbdee463c8029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:14.576151 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-4c1c0ea1-f2a9-4670-bc45-a5041cf14de6 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d" status: 200 len: 1526 microversion: 2.1 time: 1.075438 Oct 04 22:00:14.580003 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1814/3573] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:00:13 2022] GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d => generated 1526 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:00:14.619440 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-5ec5adaa-0d44-4bc4-8329-f200471345db tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:14.627267 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-5ec5adaa-0d44-4bc4-8329-f200471345db tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] [instance: d0b1b757-4a4d-4a7a-9a06-08f178a02984] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:14.683375 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5ec5adaa-0d44-4bc4-8329-f200471345db tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:14.685191 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5ec5adaa-0d44-4bc4-8329-f200471345db tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:14.688008 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5ec5adaa-0d44-4bc4-8329-f200471345db tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:14.691707 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5ec5adaa-0d44-4bc4-8329-f200471345db tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:14.693242 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5ec5adaa-0d44-4bc4-8329-f200471345db tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:14.695976 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5ec5adaa-0d44-4bc4-8329-f200471345db tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:14.730943 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-4c28579b-0969-42fe-96fc-ce52869d53c2 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e807c724cc4c3887a2d360f0584ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40071e45805146529fb8abd40629c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:14.751337 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-4c28579b-0969-42fe-96fc-ce52869d53c2 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] 10.222.0.43 "GET /compute/v2.1/servers/1b71cb4e-4f72-4c5d-a936-2ffc991910d9" status: 200 len: 1492 microversion: 2.1 time: 1.062700 Oct 04 22:00:14.772554 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1760/3574] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:00:13 2022] GET /compute/v2.1/servers/1b71cb4e-4f72-4c5d-a936-2ffc991910d9 => generated 1492 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:00:14.801558 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-a5b1e267-840a-442e-87e1-12fda540c132 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:14.824208 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-a5b1e267-840a-442e-87e1-12fda540c132 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '08c7a1e7d6984644a68d967b5e3fe92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3994b89cac594e309926f1eaf785f7d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:14.828889 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-a5b1e267-840a-442e-87e1-12fda540c132 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Searching by: {'deleted': False, 'project_id': '3994b89cac594e309926f1eaf785f7d3'} {{(pid=134101) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 22:00:14.848948 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a5b1e267-840a-442e-87e1-12fda540c132 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:14.855480 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a5b1e267-840a-442e-87e1-12fda540c132 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:14.859819 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a5b1e267-840a-442e-87e1-12fda540c132 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:14.863289 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a5b1e267-840a-442e-87e1-12fda540c132 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:14.866599 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a5b1e267-840a-442e-87e1-12fda540c132 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:14.869743 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a5b1e267-840a-442e-87e1-12fda540c132 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:14.990450 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-5ec5adaa-0d44-4bc4-8329-f200471345db tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:14.991005 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.multi_cell_list [None req-a5b1e267-840a-442e-87e1-12fda540c132 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=134101) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 22:00:15.025159 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-5ec5adaa-0d44-4bc4-8329-f200471345db tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:15.046028 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-a5b1e267-840a-442e-87e1-12fda540c132 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] 10.222.0.43 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.272241 Oct 04 22:00:15.047586 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1761/3575] 10.222.0.43 () {58 vars in 1125 bytes} [Tue Oct 4 22:00:14 2022] GET /compute/v2.1/servers => generated 343 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:00:15.056688 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-5ec5adaa-0d44-4bc4-8329-f200471345db tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:15.063837 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-89b26751-02ae-4377-a3c4-1a0e6836deef tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:15.064743 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-89b26751-02ae-4377-a3c4-1a0e6836deef tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] [instance: df147c22-6a7f-4081-83e7-97620b23700c] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:15.077355 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-89b26751-02ae-4377-a3c4-1a0e6836deef tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:15.080037 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-5ec5adaa-0d44-4bc4-8329-f200471345db tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] 10.222.0.43 "GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984" status: 200 len: 1537 microversion: 2.91 time: 0.490605 Oct 04 22:00:15.083821 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-89b26751-02ae-4377-a3c4-1a0e6836deef tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:15.084518 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-89b26751-02ae-4377-a3c4-1a0e6836deef tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:15.086009 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-89b26751-02ae-4377-a3c4-1a0e6836deef tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:15.086686 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-89b26751-02ae-4377-a3c4-1a0e6836deef tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:15.087320 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-89b26751-02ae-4377-a3c4-1a0e6836deef tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:15.096933 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1815/3576] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:00:14 2022] GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984 => generated 1537 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:00:15.143904 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-328b97cc-1380-4aaa-b1c8-39ec392758bf tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:15.164616 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-328b97cc-1380-4aaa-b1c8-39ec392758bf tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '08c7a1e7d6984644a68d967b5e3fe92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3994b89cac594e309926f1eaf785f7d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:15.176149 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-328b97cc-1380-4aaa-b1c8-39ec392758bf tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Searching by: {'deleted': False, 'project_id': '3994b89cac594e309926f1eaf785f7d3'} {{(pid=134102) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 22:00:15.209606 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-328b97cc-1380-4aaa-b1c8-39ec392758bf tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:15.210801 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-328b97cc-1380-4aaa-b1c8-39ec392758bf tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:15.212289 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-328b97cc-1380-4aaa-b1c8-39ec392758bf tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:15.216335 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-328b97cc-1380-4aaa-b1c8-39ec392758bf tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:15.223514 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-328b97cc-1380-4aaa-b1c8-39ec392758bf tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:15.226800 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-328b97cc-1380-4aaa-b1c8-39ec392758bf tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:15.443168 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.multi_cell_list [None req-328b97cc-1380-4aaa-b1c8-39ec392758bf tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=134102) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 22:00:15.453339 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-89b26751-02ae-4377-a3c4-1a0e6836deef tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2034fc9060874868bc5d27370a1c351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89499d833a4a00805164f4f79ed522', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:15.469229 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-89b26751-02ae-4377-a3c4-1a0e6836deef tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] 10.222.0.43 "GET /compute/v2.1/servers/df147c22-6a7f-4081-83e7-97620b23700c" status: 200 len: 1318 microversion: 2.1 time: 0.405532 Oct 04 22:00:15.471482 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1762/3577] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:00:15 2022] GET /compute/v2.1/servers/df147c22-6a7f-4081-83e7-97620b23700c => generated 1318 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:00:15.605224 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=100 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:00:15.605801 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-c0a272f1-c648-4b6a-a035-87fcde1a8559 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:15.605932 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-c0a272f1-c648-4b6a-a035-87fcde1a8559 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: a4cf4fac-1e9b-4669-a6ff-30008ed3642d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:15.613330 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c0a272f1-c648-4b6a-a035-87fcde1a8559 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:15.613834 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c0a272f1-c648-4b6a-a035-87fcde1a8559 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:15.614276 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c0a272f1-c648-4b6a-a035-87fcde1a8559 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:15.615325 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c0a272f1-c648-4b6a-a035-87fcde1a8559 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:15.615956 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c0a272f1-c648-4b6a-a035-87fcde1a8559 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:15.616545 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c0a272f1-c648-4b6a-a035-87fcde1a8559 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:15.734254 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-328b97cc-1380-4aaa-b1c8-39ec392758bf tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c7a1e7d6984644a68d967b5e3fe92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3994b89cac594e309926f1eaf785f7d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:15.784583 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-328b97cc-1380-4aaa-b1c8-39ec392758bf tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:15.785076 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-328b97cc-1380-4aaa-b1c8-39ec392758bf tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:15.793127 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-328b97cc-1380-4aaa-b1c8-39ec392758bf tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:16.904104 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-328b97cc-1380-4aaa-b1c8-39ec392758bf tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] 10.222.0.43 "GET /compute/v2.1/servers/detail" status: 200 len: 1604 microversion: 2.1 time: 1.803513 Oct 04 22:00:16.905902 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1816/3578] 10.222.0.43 () {58 vars in 1146 bytes} [Tue Oct 4 22:00:15 2022] GET /compute/v2.1/servers/detail => generated 1604 bytes in 1808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:00:16.912967 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-2ad7ce2f-1a13-4286-b1d9-76a4d2541377 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:16.913904 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-2ad7ce2f-1a13-4286-b1d9-76a4d2541377 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] [instance: 1b71cb4e-4f72-4c5d-a936-2ffc991910d9] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:16.943921 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2ad7ce2f-1a13-4286-b1d9-76a4d2541377 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:16.944762 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2ad7ce2f-1a13-4286-b1d9-76a4d2541377 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:16.946781 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2ad7ce2f-1a13-4286-b1d9-76a4d2541377 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:16.947917 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2ad7ce2f-1a13-4286-b1d9-76a4d2541377 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:16.949231 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2ad7ce2f-1a13-4286-b1d9-76a4d2541377 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:16.950228 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-c0a272f1-c648-4b6a-a035-87fcde1a8559 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2facee4c6a40416e908083e126d2cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07a17a482a4e92b6ddbdee463c8029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:16.958884 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2ad7ce2f-1a13-4286-b1d9-76a4d2541377 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:16.966344 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-c0a272f1-c648-4b6a-a035-87fcde1a8559 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d" status: 200 len: 1526 microversion: 2.1 time: 1.364029 Oct 04 22:00:16.987597 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1763/3579] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:00:15 2022] GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d => generated 1526 bytes in 1387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:00:17.005997 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-7b3c36bc-6853-4342-8f9a-816bc08d6f73 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:17.007085 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-7b3c36bc-6853-4342-8f9a-816bc08d6f73 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] [instance: d0b1b757-4a4d-4a7a-9a06-08f178a02984] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:17.025964 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7b3c36bc-6853-4342-8f9a-816bc08d6f73 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:17.027326 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7b3c36bc-6853-4342-8f9a-816bc08d6f73 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:17.028886 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7b3c36bc-6853-4342-8f9a-816bc08d6f73 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:17.030585 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7b3c36bc-6853-4342-8f9a-816bc08d6f73 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:17.033756 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7b3c36bc-6853-4342-8f9a-816bc08d6f73 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:17.034502 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7b3c36bc-6853-4342-8f9a-816bc08d6f73 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:17.108879 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2ad7ce2f-1a13-4286-b1d9-76a4d2541377 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:17.109397 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2ad7ce2f-1a13-4286-b1d9-76a4d2541377 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:17.112865 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2ad7ce2f-1a13-4286-b1d9-76a4d2541377 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:17.112865 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.objects.instance [None req-2ad7ce2f-1a13-4286-b1d9-76a4d2541377 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lazy-loading 'fault' on Instance uuid 1b71cb4e-4f72-4c5d-a936-2ffc991910d9 {{(pid=134102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 22:00:17.233809 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-2ad7ce2f-1a13-4286-b1d9-76a4d2541377 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e807c724cc4c3887a2d360f0584ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40071e45805146529fb8abd40629c2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:17.251612 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-2ad7ce2f-1a13-4286-b1d9-76a4d2541377 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] 10.222.0.43 "GET /compute/v2.1/servers/1b71cb4e-4f72-4c5d-a936-2ffc991910d9" status: 200 len: 1297 microversion: 2.1 time: 0.344186 Oct 04 22:00:17.257621 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1817/3580] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:00:16 2022] GET /compute/v2.1/servers/1b71cb4e-4f72-4c5d-a936-2ffc991910d9 => generated 1297 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:00:17.269022 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-e28cf54a-28dd-4aee-ad08-744c1e4ff7a5 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:17.270472 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-e28cf54a-28dd-4aee-ad08-744c1e4ff7a5 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] [instance: df147c22-6a7f-4081-83e7-97620b23700c] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:17.286211 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e28cf54a-28dd-4aee-ad08-744c1e4ff7a5 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:17.286925 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e28cf54a-28dd-4aee-ad08-744c1e4ff7a5 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:17.287475 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e28cf54a-28dd-4aee-ad08-744c1e4ff7a5 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:17.288339 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e28cf54a-28dd-4aee-ad08-744c1e4ff7a5 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:17.288810 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e28cf54a-28dd-4aee-ad08-744c1e4ff7a5 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:17.297605 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e28cf54a-28dd-4aee-ad08-744c1e4ff7a5 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:17.388780 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-7b3c36bc-6853-4342-8f9a-816bc08d6f73 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:17.405264 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-7b3c36bc-6853-4342-8f9a-816bc08d6f73 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:17.410504 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-7b3c36bc-6853-4342-8f9a-816bc08d6f73 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:17.421719 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-7b3c36bc-6853-4342-8f9a-816bc08d6f73 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] 10.222.0.43 "GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984" status: 200 len: 1537 microversion: 2.91 time: 0.432769 Oct 04 22:00:17.424999 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1764/3581] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:00:16 2022] GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984 => generated 1537 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:00:17.459702 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-a1f75e9c-9d43-49e8-8e9d-2b066b4c3b75 req-feb3a6ca-c8ba-4fb7-b61c-4eb45c9bd1d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b71cb4e-4f72-4c5d-a936-2ffc991910d9", "name": "network-vif-deleted", "tag": "06cfe69e-7185-4b0b-a3ae-8b095095aab5"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:00:17.486625 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-a1f75e9c-9d43-49e8-8e9d-2b066b4c3b75 req-feb3a6ca-c8ba-4fb7-b61c-4eb45c9bd1d2 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:17.487136 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-a1f75e9c-9d43-49e8-8e9d-2b066b4c3b75 req-feb3a6ca-c8ba-4fb7-b61c-4eb45c9bd1d2 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:17.489842 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-a1f75e9c-9d43-49e8-8e9d-2b066b4c3b75 req-feb3a6ca-c8ba-4fb7-b61c-4eb45c9bd1d2 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:17.515616 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-a1f75e9c-9d43-49e8-8e9d-2b066b4c3b75 req-feb3a6ca-c8ba-4fb7-b61c-4eb45c9bd1d2 service nova] Creating event network-vif-deleted:06cfe69e-7185-4b0b-a3ae-8b095095aab5 for instance 1b71cb4e-4f72-4c5d-a936-2ffc991910d9 on n-h2-860284-1 Oct 04 22:00:17.532251 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-a1f75e9c-9d43-49e8-8e9d-2b066b4c3b75 req-feb3a6ca-c8ba-4fb7-b61c-4eb45c9bd1d2 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095146 Oct 04 22:00:17.534161 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1765/3582] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:00:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:00:17.548358 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-6045d248-b1de-4d78-aadb-b27bdc85d8a2 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:17.578997 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-6045d248-b1de-4d78-aadb-b27bdc85d8a2 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] 10.222.0.43 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.040503 Oct 04 22:00:17.586409 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1766/3583] 10.222.0.43 () {58 vars in 1137 bytes} [Tue Oct 4 22:00:17 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:00:17.650425 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-e28cf54a-28dd-4aee-ad08-744c1e4ff7a5 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2034fc9060874868bc5d27370a1c351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89499d833a4a00805164f4f79ed522', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:17.666850 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-e28cf54a-28dd-4aee-ad08-744c1e4ff7a5 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] 10.222.0.43 "GET /compute/v2.1/servers/df147c22-6a7f-4081-83e7-97620b23700c" status: 200 len: 1507 microversion: 2.1 time: 0.404075 Oct 04 22:00:17.667569 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1818/3584] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:00:17 2022] GET /compute/v2.1/servers/df147c22-6a7f-4081-83e7-97620b23700c => generated 1507 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:00:17.696924 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-1f07626a-18ae-421b-9642-314bb8b20fbd tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:17.702621 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-1f07626a-18ae-421b-9642-314bb8b20fbd tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] [instance: df147c22-6a7f-4081-83e7-97620b23700c] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:17.710455 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1f07626a-18ae-421b-9642-314bb8b20fbd tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:17.711483 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1f07626a-18ae-421b-9642-314bb8b20fbd tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:17.712625 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1f07626a-18ae-421b-9642-314bb8b20fbd tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:17.713893 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1f07626a-18ae-421b-9642-314bb8b20fbd tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:17.716221 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1f07626a-18ae-421b-9642-314bb8b20fbd tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:17.717044 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1f07626a-18ae-421b-9642-314bb8b20fbd tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:17.898972 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-68bdd2ba-4588-4295-b1f4-e3483881c003 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:17.900038 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-68bdd2ba-4588-4295-b1f4-e3483881c003 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] [instance: 4c17a63b-8492-4c9b-a0c2-34bef7051f80] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:17.912366 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-68bdd2ba-4588-4295-b1f4-e3483881c003 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:17.913723 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-68bdd2ba-4588-4295-b1f4-e3483881c003 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:17.914463 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-68bdd2ba-4588-4295-b1f4-e3483881c003 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:17.915716 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-68bdd2ba-4588-4295-b1f4-e3483881c003 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:17.916425 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-68bdd2ba-4588-4295-b1f4-e3483881c003 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:17.917261 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-68bdd2ba-4588-4295-b1f4-e3483881c003 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:17.975099 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-68bdd2ba-4588-4295-b1f4-e3483881c003 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] [instance: 4c17a63b-8492-4c9b-a0c2-34bef7051f80] Going to try to terminate instance {{(pid=134102) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 22:00:17.986830 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-1f07626a-18ae-421b-9642-314bb8b20fbd tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2034fc9060874868bc5d27370a1c351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89499d833a4a00805164f4f79ed522', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:18.006581 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-1f07626a-18ae-421b-9642-314bb8b20fbd tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] 10.222.0.43 "GET /compute/v2.1/servers/df147c22-6a7f-4081-83e7-97620b23700c" status: 200 len: 1507 microversion: 2.1 time: 0.309872 Oct 04 22:00:18.022434 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1767/3585] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:00:17 2022] GET /compute/v2.1/servers/df147c22-6a7f-4081-83e7-97620b23700c => generated 1507 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:00:18.031145 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-6821855d-e45a-4b1c-9d95-ccb90c2e75e4 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:18.032202 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-6821855d-e45a-4b1c-9d95-ccb90c2e75e4 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: a4cf4fac-1e9b-4669-a6ff-30008ed3642d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:18.040142 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6821855d-e45a-4b1c-9d95-ccb90c2e75e4 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:18.041082 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6821855d-e45a-4b1c-9d95-ccb90c2e75e4 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:18.041684 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6821855d-e45a-4b1c-9d95-ccb90c2e75e4 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:18.042660 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6821855d-e45a-4b1c-9d95-ccb90c2e75e4 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:18.043249 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6821855d-e45a-4b1c-9d95-ccb90c2e75e4 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:18.044878 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6821855d-e45a-4b1c-9d95-ccb90c2e75e4 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:18.202046 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-68bdd2ba-4588-4295-b1f4-e3483881c003 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] 10.222.0.43 "DELETE /compute/v2.1/servers/4c17a63b-8492-4c9b-a0c2-34bef7051f80" status: 204 len: 0 microversion: 2.1 time: 0.307414 Oct 04 22:00:18.207510 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1819/3586] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 22:00:17 2022] DELETE /compute/v2.1/servers/4c17a63b-8492-4c9b-a0c2-34bef7051f80 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 22:00:18.216937 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-a0c60576-1a25-4f4c-813e-a2bf1a1a6c30 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "OS-DCF:diskConfig": "AUTO"}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:00:18.224730 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-a0c60576-1a25-4f4c-813e-a2bf1a1a6c30 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] [instance: df147c22-6a7f-4081-83e7-97620b23700c] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:18.243976 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a0c60576-1a25-4f4c-813e-a2bf1a1a6c30 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:18.244481 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a0c60576-1a25-4f4c-813e-a2bf1a1a6c30 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:18.244925 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a0c60576-1a25-4f4c-813e-a2bf1a1a6c30 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:18.245642 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a0c60576-1a25-4f4c-813e-a2bf1a1a6c30 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:18.247844 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a0c60576-1a25-4f4c-813e-a2bf1a1a6c30 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:18.248600 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a0c60576-1a25-4f4c-813e-a2bf1a1a6c30 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:18.334788 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-6821855d-e45a-4b1c-9d95-ccb90c2e75e4 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2facee4c6a40416e908083e126d2cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07a17a482a4e92b6ddbdee463c8029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:18.346173 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-6821855d-e45a-4b1c-9d95-ccb90c2e75e4 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d" status: 200 len: 1526 microversion: 2.1 time: 0.336431 Oct 04 22:00:18.349901 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1768/3587] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:00:18 2022] GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d => generated 1526 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:00:18.377263 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-408ecbe3-ec59-4a96-92e7-03eb537aefa4 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:18.393039 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-408ecbe3-ec59-4a96-92e7-03eb537aefa4 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] [instance: 4c17a63b-8492-4c9b-a0c2-34bef7051f80] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:18.416399 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-408ecbe3-ec59-4a96-92e7-03eb537aefa4 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:18.421257 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-408ecbe3-ec59-4a96-92e7-03eb537aefa4 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:18.423228 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-408ecbe3-ec59-4a96-92e7-03eb537aefa4 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:18.427828 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-408ecbe3-ec59-4a96-92e7-03eb537aefa4 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:18.428522 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-408ecbe3-ec59-4a96-92e7-03eb537aefa4 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:18.429164 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-408ecbe3-ec59-4a96-92e7-03eb537aefa4 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:18.470387 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-a0c60576-1a25-4f4c-813e-a2bf1a1a6c30 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Flavor limits 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 22:00:18.471690 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-a0c60576-1a25-4f4c-813e-a2bf1a1a6c30 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Image limits 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 22:00:18.472238 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-a0c60576-1a25-4f4c-813e-a2bf1a1a6c30 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Flavor pref 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 22:00:18.474138 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-a0c60576-1a25-4f4c-813e-a2bf1a1a6c30 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Image pref 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 22:00:18.474545 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-a0c60576-1a25-4f4c-813e-a2bf1a1a6c30 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 22:00:18.689375 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-a0c60576-1a25-4f4c-813e-a2bf1a1a6c30 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] [instance: df147c22-6a7f-4081-83e7-97620b23700c] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:18.721887 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a0c60576-1a25-4f4c-813e-a2bf1a1a6c30 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:18.722704 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a0c60576-1a25-4f4c-813e-a2bf1a1a6c30 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:18.723188 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a0c60576-1a25-4f4c-813e-a2bf1a1a6c30 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:18.724026 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a0c60576-1a25-4f4c-813e-a2bf1a1a6c30 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:18.728604 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a0c60576-1a25-4f4c-813e-a2bf1a1a6c30 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:18.731947 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a0c60576-1a25-4f4c-813e-a2bf1a1a6c30 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:18.832947 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-a0c60576-1a25-4f4c-813e-a2bf1a1a6c30 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] 10.222.0.43 "POST /compute/v2.1/servers/df147c22-6a7f-4081-83e7-97620b23700c/action" status: 202 len: 1109 microversion: 2.1 time: 0.626131 Oct 04 22:00:18.835050 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1820/3588] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 22:00:18 2022] POST /compute/v2.1/servers/df147c22-6a7f-4081-83e7-97620b23700c/action => generated 1109 bytes in 630 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 04 22:00:18.854488 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-0a26252c-c4f2-4025-9bf5-5a17c730a860 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:18.856490 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-0a26252c-c4f2-4025-9bf5-5a17c730a860 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] [instance: 1b71cb4e-4f72-4c5d-a936-2ffc991910d9] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:18.866547 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0a26252c-c4f2-4025-9bf5-5a17c730a860 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:18.867538 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0a26252c-c4f2-4025-9bf5-5a17c730a860 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:18.869178 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0a26252c-c4f2-4025-9bf5-5a17c730a860 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:18.870728 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0a26252c-c4f2-4025-9bf5-5a17c730a860 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:18.871407 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0a26252c-c4f2-4025-9bf5-5a17c730a860 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:18.874086 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0a26252c-c4f2-4025-9bf5-5a17c730a860 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:18.891204 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-0a26252c-c4f2-4025-9bf5-5a17c730a860 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] HTTP exception thrown: Instance 1b71cb4e-4f72-4c5d-a936-2ffc991910d9 could not be found. Oct 04 22:00:18.892898 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-408ecbe3-ec59-4a96-92e7-03eb537aefa4 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c7a1e7d6984644a68d967b5e3fe92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3994b89cac594e309926f1eaf785f7d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:18.894567 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-0a26252c-c4f2-4025-9bf5-5a17c730a860 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Request method failure captured: Oct 04 22:00:18.894567 n-d-860284-1 devstack@n-api.service[134102]: request: GET /compute/v2.1/servers/1b71cb4e-4f72-4c5d-a936-2ffc991910d9 HTTP/1.1 Oct 04 22:00:18.894567 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 22:00:18.894567 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 22:00:18.894567 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 22:00:18.894567 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 22:00:18.894567 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 22:00:18.894567 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 22:00:18.894567 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 22:00:18.894567 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 22:00:18.894567 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPKvwRm5H229vYgT4QHRa2H3KJczD-aqhmeg0I-VS0SzH4LpkKkIiHtGK-ADawxjSM_n0nP8jiKarlV43x9RTjhXSdePJ8ObpL2_riw7qpbkit-jHniKDN-twWm_bE3Sp41ooGJIT8ljY8Dmm_FSvvYUKVYdQrj2kBYSVFTaeCRm4Bls Oct 04 22:00:18.894567 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 22:00:18.894567 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 22:00:18.894567 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 22:00:18.894567 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 22:00:18.894567 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 22:00:18.894567 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 22:00:18.894567 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: 40071e45805146529fb8abd40629c2ae Oct 04 22:00:18.894567 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-ImagesTestJSON-16557252 Oct 04 22:00:18.894567 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 22:00:18.894567 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 22:00:18.894567 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/40071e45805146529fb8abd40629c2ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_40071e45805146529fb8abd40629c2ae", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/40071e45805146529fb8abd40629c2ae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/40071e45805146529fb8abd40629c2ae"}]}] Oct 04 22:00:18.894567 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-ImagesTestJSON-16557252 Oct 04 22:00:18.894567 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: 40071e45805146529fb8abd40629c2ae Oct 04 22:00:18.894567 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-ImagesTestJSON-16557252 Oct 04 22:00:18.894567 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-ImagesTestJSON-16557252-project Oct 04 22:00:18.894567 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 22:00:18.894567 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 22:00:18.894567 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: f5e807c724cc4c3887a2d360f0584ffb Oct 04 22:00:18.894567 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-ImagesTestJSON-16557252-project Oct 04 22:00:18.894567 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 22:00:18.894567 n-d-860284-1 devstack@n-api.service[134102]: exception: Instance 1b71cb4e-4f72-4c5d-a936-2ffc991910d9 could not be found. Oct 04 22:00:18.894567 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': '1b71cb4e-4f72-4c5d-a936-2ffc991910d9'} Oct 04 22:00:18.894567 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:00:18.894567 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:00:18.894567 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:00:18.894567 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:00:18.894567 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:00:18.894567 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:00:18.894567 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:00:18.894567 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:00:18.894567 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:00:18.894567 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:00:18.894567 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b71cb4e-4f72-4c5d-a936-2ffc991910d9 could not be found. Oct 04 22:00:18.894567 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:00:18.894567 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:00:18.894567 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:00:18.894567 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:00:18.894567 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:00:18.894567 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:00:18.894567 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:00:18.894567 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:00:18.894567 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:00:18.894567 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:00:18.894567 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:00:18.894567 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:00:18.894567 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:00:18.894567 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:00:18.894567 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:00:18.894567 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:00:18.894567 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b71cb4e-4f72-4c5d-a936-2ffc991910d9 could not be found. Oct 04 22:00:18.894567 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:00:18.894567 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:00:18.894567 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:00:18.894567 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:00:18.899472 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:00:18.899472 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:00:18.899472 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:00:18.899472 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:00:18.899472 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b71cb4e-4f72-4c5d-a936-2ffc991910d9 could not be found. Oct 04 22:00:18.899472 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:00:18.901684 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-0a26252c-c4f2-4025-9bf5-5a17c730a860 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Returning 404 to user: Instance 1b71cb4e-4f72-4c5d-a936-2ffc991910d9 could not be found. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:00:18.902798 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-0a26252c-c4f2-4025-9bf5-5a17c730a860 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] 10.222.0.43 "GET /compute/v2.1/servers/1b71cb4e-4f72-4c5d-a936-2ffc991910d9" status: 404 len: 111 microversion: 2.1 time: 0.066142 Oct 04 22:00:18.904159 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1821/3589] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:00:18 2022] GET /compute/v2.1/servers/1b71cb4e-4f72-4c5d-a936-2ffc991910d9 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:00:18.910005 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-e55bd2a3-132f-4879-9643-a00056757953 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:18.912273 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-e55bd2a3-132f-4879-9643-a00056757953 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] [instance: d0b1b757-4a4d-4a7a-9a06-08f178a02984] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:18.914215 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-408ecbe3-ec59-4a96-92e7-03eb537aefa4 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] 10.222.0.43 "GET /compute/v2.1/servers/4c17a63b-8492-4c9b-a0c2-34bef7051f80" status: 200 len: 1607 microversion: 2.1 time: 0.540489 Oct 04 22:00:18.914511 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1769/3590] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:00:18 2022] GET /compute/v2.1/servers/4c17a63b-8492-4c9b-a0c2-34bef7051f80 => generated 1607 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:00:18.920310 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e55bd2a3-132f-4879-9643-a00056757953 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:18.920990 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e55bd2a3-132f-4879-9643-a00056757953 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:18.921258 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e55bd2a3-132f-4879-9643-a00056757953 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:18.922484 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e55bd2a3-132f-4879-9643-a00056757953 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:18.923292 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e55bd2a3-132f-4879-9643-a00056757953 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:18.924043 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e55bd2a3-132f-4879-9643-a00056757953 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:19.026795 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-e55bd2a3-132f-4879-9643-a00056757953 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:19.040134 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-e55bd2a3-132f-4879-9643-a00056757953 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:19.042504 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-e55bd2a3-132f-4879-9643-a00056757953 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:19.051392 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-e55bd2a3-132f-4879-9643-a00056757953 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] 10.222.0.43 "GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984" status: 200 len: 1537 microversion: 2.91 time: 0.145801 Oct 04 22:00:19.052875 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1822/3591] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:00:18 2022] GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984 => generated 1537 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:00:19.059005 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-84e3ee6f-2a96-4227-83e8-1280a274cf89 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:19.064103 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-84e3ee6f-2a96-4227-83e8-1280a274cf89 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] [instance: df147c22-6a7f-4081-83e7-97620b23700c] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:19.072776 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-84e3ee6f-2a96-4227-83e8-1280a274cf89 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:19.073642 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-84e3ee6f-2a96-4227-83e8-1280a274cf89 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:19.074621 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-84e3ee6f-2a96-4227-83e8-1280a274cf89 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:19.076487 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-84e3ee6f-2a96-4227-83e8-1280a274cf89 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:19.077204 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-84e3ee6f-2a96-4227-83e8-1280a274cf89 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:19.077878 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-84e3ee6f-2a96-4227-83e8-1280a274cf89 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:19.226218 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-7616b716-963b-48e9-8e85-0359e58eb5d7 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-960657871", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452", "networks": [{"uuid": "e9c2fdba-0f07-4eed-b16d-315c68facdd4"}]}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:00:19.345873 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.network.neutron [None req-7616b716-963b-48e9-8e85-0359e58eb5d7 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] validate_networks() for [('e9c2fdba-0f07-4eed-b16d-315c68facdd4', None, None, None, None, None)] {{(pid=134101) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 22:00:19.385311 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-84e3ee6f-2a96-4227-83e8-1280a274cf89 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2034fc9060874868bc5d27370a1c351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89499d833a4a00805164f4f79ed522', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:19.394290 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-84e3ee6f-2a96-4227-83e8-1280a274cf89 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] 10.222.0.43 "GET /compute/v2.1/servers/df147c22-6a7f-4081-83e7-97620b23700c" status: 200 len: 1514 microversion: 2.1 time: 0.339815 Oct 04 22:00:19.433411 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1823/3592] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:00:19 2022] GET /compute/v2.1/servers/df147c22-6a7f-4081-83e7-97620b23700c => generated 1514 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:00:19.445002 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-3f19745f-9fc9-4e11-a495-742742e0cba3 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Calling method '.version_select at 0x7fbb2fa94280>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:19.494727 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-3f19745f-9fc9-4e11-a495-742742e0cba3 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] HTTP exception thrown: Image not found. Oct 04 22:00:19.496846 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-3f19745f-9fc9-4e11-a495-742742e0cba3 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Request method failure captured: Oct 04 22:00:19.496846 n-d-860284-1 devstack@n-api.service[134102]: request: DELETE /compute/v2.1/images/a67847c0-608b-45c9-a5ac-a6e6f0e06b3a HTTP/1.1 Oct 04 22:00:19.496846 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 22:00:19.496846 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 22:00:19.496846 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 22:00:19.496846 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 22:00:19.496846 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 22:00:19.496846 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 22:00:19.496846 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 22:00:19.496846 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 22:00:19.496846 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPKvwRm5H229vYgT4QHRa2H3KJczD-aqhmeg0I-VS0SzH4LpkKkIiHtGK-ADawxjSM_n0nP8jiKarlV43x9RTjhXSdePJ8ObpL2_riw7qpbkit-jHniKDN-twWm_bE3Sp41ooGJIT8ljY8Dmm_FSvvYUKVYdQrj2kBYSVFTaeCRm4Bls Oct 04 22:00:19.496846 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 22:00:19.496846 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 22:00:19.496846 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 22:00:19.496846 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 22:00:19.496846 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 22:00:19.496846 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 22:00:19.496846 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: 40071e45805146529fb8abd40629c2ae Oct 04 22:00:19.496846 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-ImagesTestJSON-16557252 Oct 04 22:00:19.496846 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 22:00:19.496846 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 22:00:19.496846 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/40071e45805146529fb8abd40629c2ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_40071e45805146529fb8abd40629c2ae", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/40071e45805146529fb8abd40629c2ae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/40071e45805146529fb8abd40629c2ae"}]}] Oct 04 22:00:19.496846 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-ImagesTestJSON-16557252 Oct 04 22:00:19.496846 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: 40071e45805146529fb8abd40629c2ae Oct 04 22:00:19.496846 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-ImagesTestJSON-16557252 Oct 04 22:00:19.496846 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-ImagesTestJSON-16557252-project Oct 04 22:00:19.496846 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 22:00:19.496846 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 22:00:19.496846 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: f5e807c724cc4c3887a2d360f0584ffb Oct 04 22:00:19.496846 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-ImagesTestJSON-16557252-project Oct 04 22:00:19.496846 n-d-860284-1 devstack@n-api.service[134102]: method: Oct 04 22:00:19.496846 n-d-860284-1 devstack@n-api.service[134102]: exception: Image not found. Oct 04 22:00:19.496846 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': 'a67847c0-608b-45c9-a5ac-a6e6f0e06b3a'} Oct 04 22:00:19.496846 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:00:19.496846 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:00:19.496846 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 04 22:00:19.496846 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 04 22:00:19.496846 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 22:00:19.496846 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 22:00:19.496846 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 22:00:19.496846 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 22:00:19.496846 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 04 22:00:19.496846 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 04 22:00:19.496846 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 04 22:00:19.496846 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 04 22:00:19.496846 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 22:00:19.496846 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 22:00:19.496846 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 22:00:19.496846 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 22:00:19.496846 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image a67847c0-608b-45c9-a5ac-a6e6f0e06b3a to delete Oct 04 22:00:19.496846 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:00:19.496846 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:00:19.496846 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:00:19.496846 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:00:19.496846 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 04 22:00:19.496846 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 04 22:00:19.496846 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 04 22:00:19.496846 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 04 22:00:19.496846 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 04 22:00:19.496846 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 04 22:00:19.496846 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image a67847c0-608b-45c9-a5ac-a6e6f0e06b3a could not be found. Oct 04 22:00:19.496846 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:00:19.496846 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:00:19.496846 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:00:19.496846 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:00:19.503285 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:00:19.503285 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:00:19.503285 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:00:19.503285 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:00:19.503285 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 22:00:19.503285 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 22:00:19.503285 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:00:19.503285 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:00:19.503285 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 04 22:00:19.503285 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 22:00:19.503285 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 22:00:19.503285 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:00:19.503285 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:00:19.503285 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:00:19.503285 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:00:19.503285 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:00:19.503285 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:00:19.503285 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:00:19.503285 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:00:19.503285 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 22:00:19.503285 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:00:19.503285 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-3f19745f-9fc9-4e11-a495-742742e0cba3 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Returning 404 to user: Image not found. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:00:19.503285 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-3f19745f-9fc9-4e11-a495-742742e0cba3 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] 10.222.0.43 "DELETE /compute/v2.1/images/a67847c0-608b-45c9-a5ac-a6e6f0e06b3a" status: 404 len: 62 microversion: 2.1 time: 0.064412 Oct 04 22:00:19.505240 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1824/3593] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:00:19 2022] DELETE /compute/v2.1/images/a67847c0-608b-45c9-a5ac-a6e6f0e06b3a => generated 62 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 22:00:19.516925 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-07830ad6-9349-4d29-af09-8766d8642403 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:19.517838 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-07830ad6-9349-4d29-af09-8766d8642403 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: a4cf4fac-1e9b-4669-a6ff-30008ed3642d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:19.535304 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-07830ad6-9349-4d29-af09-8766d8642403 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:19.536172 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-07830ad6-9349-4d29-af09-8766d8642403 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:19.537112 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-07830ad6-9349-4d29-af09-8766d8642403 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:19.538498 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-07830ad6-9349-4d29-af09-8766d8642403 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:19.539668 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-07830ad6-9349-4d29-af09-8766d8642403 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:19.540800 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-07830ad6-9349-4d29-af09-8766d8642403 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:19.912180 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-07830ad6-9349-4d29-af09-8766d8642403 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2facee4c6a40416e908083e126d2cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07a17a482a4e92b6ddbdee463c8029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:19.928722 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-07830ad6-9349-4d29-af09-8766d8642403 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d" status: 200 len: 1526 microversion: 2.1 time: 0.424050 Oct 04 22:00:19.933834 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1825/3594] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:00:19 2022] GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d => generated 1526 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:00:19.943973 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-2975c233-ad32-4de7-8427-e7a2bdf0a4f2 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:19.949261 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-2975c233-ad32-4de7-8427-e7a2bdf0a4f2 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] [instance: e57b3eb4-9ac6-4f6b-bbe1-a8582bdf543b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:19.955847 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2975c233-ad32-4de7-8427-e7a2bdf0a4f2 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:19.956703 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2975c233-ad32-4de7-8427-e7a2bdf0a4f2 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:19.957475 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2975c233-ad32-4de7-8427-e7a2bdf0a4f2 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:19.958466 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2975c233-ad32-4de7-8427-e7a2bdf0a4f2 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:19.959144 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2975c233-ad32-4de7-8427-e7a2bdf0a4f2 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:19.959805 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2975c233-ad32-4de7-8427-e7a2bdf0a4f2 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:19.985094 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-2975c233-ad32-4de7-8427-e7a2bdf0a4f2 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] HTTP exception thrown: Instance e57b3eb4-9ac6-4f6b-bbe1-a8582bdf543b could not be found. Oct 04 22:00:19.986716 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-2975c233-ad32-4de7-8427-e7a2bdf0a4f2 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Request method failure captured: Oct 04 22:00:19.986716 n-d-860284-1 devstack@n-api.service[134102]: request: DELETE /compute/v2.1/servers/e57b3eb4-9ac6-4f6b-bbe1-a8582bdf543b HTTP/1.1 Oct 04 22:00:19.986716 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 22:00:19.986716 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 22:00:19.986716 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 22:00:19.986716 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 22:00:19.986716 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 22:00:19.986716 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 22:00:19.986716 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 22:00:19.986716 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 22:00:19.986716 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPKvwRm5H229vYgT4QHRa2H3KJczD-aqhmeg0I-VS0SzH4LpkKkIiHtGK-ADawxjSM_n0nP8jiKarlV43x9RTjhXSdePJ8ObpL2_riw7qpbkit-jHniKDN-twWm_bE3Sp41ooGJIT8ljY8Dmm_FSvvYUKVYdQrj2kBYSVFTaeCRm4Bls Oct 04 22:00:19.986716 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 22:00:19.986716 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 22:00:19.986716 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 22:00:19.986716 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 22:00:19.986716 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 22:00:19.986716 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 22:00:19.986716 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: 40071e45805146529fb8abd40629c2ae Oct 04 22:00:19.986716 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-ImagesTestJSON-16557252 Oct 04 22:00:19.986716 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 22:00:19.986716 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 22:00:19.986716 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/40071e45805146529fb8abd40629c2ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_40071e45805146529fb8abd40629c2ae", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/40071e45805146529fb8abd40629c2ae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/40071e45805146529fb8abd40629c2ae"}]}] Oct 04 22:00:19.986716 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-ImagesTestJSON-16557252 Oct 04 22:00:19.986716 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: 40071e45805146529fb8abd40629c2ae Oct 04 22:00:19.986716 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-ImagesTestJSON-16557252 Oct 04 22:00:19.986716 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-ImagesTestJSON-16557252-project Oct 04 22:00:19.986716 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 22:00:19.986716 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 22:00:19.986716 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: f5e807c724cc4c3887a2d360f0584ffb Oct 04 22:00:19.986716 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-ImagesTestJSON-16557252-project Oct 04 22:00:19.986716 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 22:00:19.986716 n-d-860284-1 devstack@n-api.service[134102]: exception: Instance e57b3eb4-9ac6-4f6b-bbe1-a8582bdf543b could not be found. Oct 04 22:00:19.986716 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': 'e57b3eb4-9ac6-4f6b-bbe1-a8582bdf543b'} Oct 04 22:00:19.986716 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:00:19.986716 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:00:19.986716 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:00:19.986716 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:00:19.986716 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:00:19.986716 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:00:19.986716 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:00:19.986716 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:00:19.986716 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:00:19.986716 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:00:19.986716 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e57b3eb4-9ac6-4f6b-bbe1-a8582bdf543b could not be found. Oct 04 22:00:19.986716 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:00:19.986716 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:00:19.986716 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:00:19.986716 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:00:19.986716 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:00:19.986716 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:00:19.986716 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:00:19.986716 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:00:19.986716 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:00:19.986716 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:00:19.986716 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 22:00:19.986716 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 22:00:19.986716 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 22:00:19.986716 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 22:00:19.986716 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:00:19.986716 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:00:19.986716 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:00:19.986716 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:00:19.986716 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e57b3eb4-9ac6-4f6b-bbe1-a8582bdf543b could not be found. Oct 04 22:00:19.991213 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:00:19.991213 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:00:19.991213 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:00:19.991213 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:00:19.991213 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:00:19.991213 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:00:19.991213 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:00:19.991213 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:00:19.991213 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e57b3eb4-9ac6-4f6b-bbe1-a8582bdf543b could not be found. Oct 04 22:00:19.991213 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:00:19.991213 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-2975c233-ad32-4de7-8427-e7a2bdf0a4f2 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Returning 404 to user: Instance e57b3eb4-9ac6-4f6b-bbe1-a8582bdf543b could not be found. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:00:19.991213 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-2975c233-ad32-4de7-8427-e7a2bdf0a4f2 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] 10.222.0.43 "DELETE /compute/v2.1/servers/e57b3eb4-9ac6-4f6b-bbe1-a8582bdf543b" status: 404 len: 111 microversion: 2.1 time: 0.051197 Oct 04 22:00:19.991213 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1826/3595] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 22:00:19 2022] DELETE /compute/v2.1/servers/e57b3eb4-9ac6-4f6b-bbe1-a8582bdf543b => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:00:20.002903 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-f12241fa-0382-4645-973b-3fa5ef7e794f tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:20.004918 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-f12241fa-0382-4645-973b-3fa5ef7e794f tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] [instance: 4c17a63b-8492-4c9b-a0c2-34bef7051f80] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:20.023482 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f12241fa-0382-4645-973b-3fa5ef7e794f tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:20.023974 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f12241fa-0382-4645-973b-3fa5ef7e794f tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:20.024672 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f12241fa-0382-4645-973b-3fa5ef7e794f tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:20.025611 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f12241fa-0382-4645-973b-3fa5ef7e794f tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:20.026285 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f12241fa-0382-4645-973b-3fa5ef7e794f tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:20.026950 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f12241fa-0382-4645-973b-3fa5ef7e794f tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:20.392267 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-f12241fa-0382-4645-973b-3fa5ef7e794f tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c7a1e7d6984644a68d967b5e3fe92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3994b89cac594e309926f1eaf785f7d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:20.414133 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-f12241fa-0382-4645-973b-3fa5ef7e794f tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] 10.222.0.43 "GET /compute/v2.1/servers/4c17a63b-8492-4c9b-a0c2-34bef7051f80" status: 200 len: 1607 microversion: 2.1 time: 0.421326 Oct 04 22:00:20.418187 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1827/3596] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:00:19 2022] GET /compute/v2.1/servers/4c17a63b-8492-4c9b-a0c2-34bef7051f80 => generated 1607 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:00:20.437937 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-2fd4c0bf-91b7-4a13-8fcd-712c881f2d72 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:20.447409 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-2fd4c0bf-91b7-4a13-8fcd-712c881f2d72 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] [instance: e57b3eb4-9ac6-4f6b-bbe1-a8582bdf543b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:20.471775 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2fd4c0bf-91b7-4a13-8fcd-712c881f2d72 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:20.473900 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2fd4c0bf-91b7-4a13-8fcd-712c881f2d72 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:20.474677 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2fd4c0bf-91b7-4a13-8fcd-712c881f2d72 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:20.477290 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2fd4c0bf-91b7-4a13-8fcd-712c881f2d72 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:20.484417 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2fd4c0bf-91b7-4a13-8fcd-712c881f2d72 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:20.485527 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2fd4c0bf-91b7-4a13-8fcd-712c881f2d72 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:20.506582 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-7616b716-963b-48e9-8e85-0359e58eb5d7 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Flavor limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 22:00:20.507122 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-7616b716-963b-48e9-8e85-0359e58eb5d7 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Image limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 22:00:20.507645 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-7616b716-963b-48e9-8e85-0359e58eb5d7 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Flavor pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 22:00:20.508290 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-7616b716-963b-48e9-8e85-0359e58eb5d7 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Image pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 22:00:20.508890 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-7616b716-963b-48e9-8e85-0359e58eb5d7 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 22:00:20.533623 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7616b716-963b-48e9-8e85-0359e58eb5d7 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:20.535086 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-2fd4c0bf-91b7-4a13-8fcd-712c881f2d72 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] HTTP exception thrown: Instance e57b3eb4-9ac6-4f6b-bbe1-a8582bdf543b could not be found. Oct 04 22:00:20.537106 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-2fd4c0bf-91b7-4a13-8fcd-712c881f2d72 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Request method failure captured: Oct 04 22:00:20.537106 n-d-860284-1 devstack@n-api.service[134102]: request: GET /compute/v2.1/servers/e57b3eb4-9ac6-4f6b-bbe1-a8582bdf543b HTTP/1.1 Oct 04 22:00:20.537106 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 22:00:20.537106 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 22:00:20.537106 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 22:00:20.537106 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 22:00:20.537106 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 22:00:20.537106 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 22:00:20.537106 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 22:00:20.537106 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 22:00:20.537106 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPKvwRm5H229vYgT4QHRa2H3KJczD-aqhmeg0I-VS0SzH4LpkKkIiHtGK-ADawxjSM_n0nP8jiKarlV43x9RTjhXSdePJ8ObpL2_riw7qpbkit-jHniKDN-twWm_bE3Sp41ooGJIT8ljY8Dmm_FSvvYUKVYdQrj2kBYSVFTaeCRm4Bls Oct 04 22:00:20.537106 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 22:00:20.537106 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 22:00:20.537106 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 22:00:20.537106 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 22:00:20.537106 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 22:00:20.537106 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 22:00:20.537106 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: 40071e45805146529fb8abd40629c2ae Oct 04 22:00:20.537106 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-ImagesTestJSON-16557252 Oct 04 22:00:20.537106 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 22:00:20.537106 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 22:00:20.537106 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/40071e45805146529fb8abd40629c2ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_40071e45805146529fb8abd40629c2ae", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/40071e45805146529fb8abd40629c2ae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/40071e45805146529fb8abd40629c2ae"}]}] Oct 04 22:00:20.537106 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-ImagesTestJSON-16557252 Oct 04 22:00:20.537106 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: 40071e45805146529fb8abd40629c2ae Oct 04 22:00:20.537106 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-ImagesTestJSON-16557252 Oct 04 22:00:20.537106 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-ImagesTestJSON-16557252-project Oct 04 22:00:20.537106 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 22:00:20.537106 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 22:00:20.537106 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: f5e807c724cc4c3887a2d360f0584ffb Oct 04 22:00:20.537106 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-ImagesTestJSON-16557252-project Oct 04 22:00:20.537106 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 22:00:20.537106 n-d-860284-1 devstack@n-api.service[134102]: exception: Instance e57b3eb4-9ac6-4f6b-bbe1-a8582bdf543b could not be found. Oct 04 22:00:20.537106 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': 'e57b3eb4-9ac6-4f6b-bbe1-a8582bdf543b'} Oct 04 22:00:20.537106 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:00:20.537106 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:00:20.537106 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:00:20.537106 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:00:20.537106 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:00:20.537106 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:00:20.537106 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:00:20.537106 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:00:20.537106 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:00:20.537106 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:00:20.537106 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e57b3eb4-9ac6-4f6b-bbe1-a8582bdf543b could not be found. Oct 04 22:00:20.537106 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:00:20.537106 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:00:20.537106 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:00:20.537106 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:00:20.537106 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:00:20.537106 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:00:20.537106 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:00:20.537106 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:00:20.537106 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:00:20.537106 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:00:20.537106 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:00:20.537106 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:00:20.537106 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:00:20.537106 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:00:20.537106 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:00:20.537106 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:00:20.537106 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e57b3eb4-9ac6-4f6b-bbe1-a8582bdf543b could not be found. Oct 04 22:00:20.537106 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:00:20.537106 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:00:20.537106 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:00:20.537106 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:00:20.544817 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:00:20.544817 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:00:20.544817 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:00:20.544817 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:00:20.544817 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e57b3eb4-9ac6-4f6b-bbe1-a8582bdf543b could not be found. Oct 04 22:00:20.544817 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:00:20.545905 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7616b716-963b-48e9-8e85-0359e58eb5d7 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:20.545905 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7616b716-963b-48e9-8e85-0359e58eb5d7 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:20.545905 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7616b716-963b-48e9-8e85-0359e58eb5d7 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:20.545905 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7616b716-963b-48e9-8e85-0359e58eb5d7 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:20.545905 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7616b716-963b-48e9-8e85-0359e58eb5d7 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:20.550191 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-2fd4c0bf-91b7-4a13-8fcd-712c881f2d72 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Returning 404 to user: Instance e57b3eb4-9ac6-4f6b-bbe1-a8582bdf543b could not be found. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:00:20.551956 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-2fd4c0bf-91b7-4a13-8fcd-712c881f2d72 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] 10.222.0.43 "GET /compute/v2.1/servers/e57b3eb4-9ac6-4f6b-bbe1-a8582bdf543b" status: 404 len: 111 microversion: 2.1 time: 0.131515 Oct 04 22:00:20.553457 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1828/3597] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:00:20 2022] GET /compute/v2.1/servers/e57b3eb4-9ac6-4f6b-bbe1-a8582bdf543b => generated 111 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:00:20.561122 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-175852d8-d4b8-4fea-b542-d14230d24cbe tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:20.562416 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-175852d8-d4b8-4fea-b542-d14230d24cbe tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] [instance: d0b1b757-4a4d-4a7a-9a06-08f178a02984] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:20.570593 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-175852d8-d4b8-4fea-b542-d14230d24cbe tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:20.571499 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-175852d8-d4b8-4fea-b542-d14230d24cbe tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:20.572195 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-175852d8-d4b8-4fea-b542-d14230d24cbe tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:20.573260 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-175852d8-d4b8-4fea-b542-d14230d24cbe tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:20.574074 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-175852d8-d4b8-4fea-b542-d14230d24cbe tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:20.574804 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-175852d8-d4b8-4fea-b542-d14230d24cbe tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:20.619712 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-7616b716-963b-48e9-8e85-0359e58eb5d7 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Getting quotas for project 5cad63eb782c43b19d642fa6adaffd71. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:00:20.631230 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-7616b716-963b-48e9-8e85-0359e58eb5d7 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Getting quotas for user d474da1382674cada32763825c7840f5 and project 5cad63eb782c43b19d642fa6adaffd71. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:00:20.666202 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-7616b716-963b-48e9-8e85-0359e58eb5d7 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Going to run 1 instances... {{(pid=134101) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 22:00:20.673319 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-7616b716-963b-48e9-8e85-0359e58eb5d7 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] [instance: 2d3d1574-f1b5-46a9-a3b7-205a905a90f1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='58548514-5dac-426c-81f5-19e3fba33e23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134101) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 22:00:20.676468 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-175852d8-d4b8-4fea-b542-d14230d24cbe tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:20.692178 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-175852d8-d4b8-4fea-b542-d14230d24cbe tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:20.694353 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-175852d8-d4b8-4fea-b542-d14230d24cbe tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:20.702946 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-175852d8-d4b8-4fea-b542-d14230d24cbe tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] 10.222.0.43 "GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984" status: 200 len: 1537 microversion: 2.91 time: 0.147227 Oct 04 22:00:20.722390 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1829/3598] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:00:20 2022] GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984 => generated 1537 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:00:20.722390 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-bc9f3163-2282-4b7f-b22c-c2d98390027d tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:20.722390 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-bc9f3163-2282-4b7f-b22c-c2d98390027d tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] [instance: df147c22-6a7f-4081-83e7-97620b23700c] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:20.722390 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bc9f3163-2282-4b7f-b22c-c2d98390027d tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:20.722390 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bc9f3163-2282-4b7f-b22c-c2d98390027d tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:20.722390 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bc9f3163-2282-4b7f-b22c-c2d98390027d tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:20.722390 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bc9f3163-2282-4b7f-b22c-c2d98390027d tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:20.722390 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bc9f3163-2282-4b7f-b22c-c2d98390027d tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:20.723293 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bc9f3163-2282-4b7f-b22c-c2d98390027d tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:20.848283 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-7616b716-963b-48e9-8e85-0359e58eb5d7 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.918257 Oct 04 22:00:20.849034 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1770/3599] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 22:00:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 1934 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 22:00:20.883723 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-1fa13b2a-58b5-4221-95eb-6246c73689b2 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Calling method '.version_select at 0x7fbb2ed5cc10>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:20.933173 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-1fa13b2a-58b5-4221-95eb-6246c73689b2 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] HTTP exception thrown: Image not found. Oct 04 22:00:20.937016 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-1fa13b2a-58b5-4221-95eb-6246c73689b2 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Request method failure captured: Oct 04 22:00:20.937016 n-d-860284-1 devstack@n-api.service[134101]: request: DELETE /compute/v2.1/images/683538fe-4fde-450b-94cb-f14e6f8483a3 HTTP/1.1 Oct 04 22:00:20.937016 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 22:00:20.937016 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 22:00:20.937016 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 22:00:20.937016 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 22:00:20.937016 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 22:00:20.937016 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 22:00:20.937016 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 22:00:20.937016 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 22:00:20.937016 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPKvwRm5H229vYgT4QHRa2H3KJczD-aqhmeg0I-VS0SzH4LpkKkIiHtGK-ADawxjSM_n0nP8jiKarlV43x9RTjhXSdePJ8ObpL2_riw7qpbkit-jHniKDN-twWm_bE3Sp41ooGJIT8ljY8Dmm_FSvvYUKVYdQrj2kBYSVFTaeCRm4Bls Oct 04 22:00:20.937016 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 22:00:20.937016 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 22:00:20.937016 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 22:00:20.937016 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 22:00:20.937016 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 22:00:20.937016 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 22:00:20.937016 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: 40071e45805146529fb8abd40629c2ae Oct 04 22:00:20.937016 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-ImagesTestJSON-16557252 Oct 04 22:00:20.937016 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 22:00:20.937016 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 22:00:20.937016 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/40071e45805146529fb8abd40629c2ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_40071e45805146529fb8abd40629c2ae", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/40071e45805146529fb8abd40629c2ae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/40071e45805146529fb8abd40629c2ae"}]}] Oct 04 22:00:20.937016 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-ImagesTestJSON-16557252 Oct 04 22:00:20.937016 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: 40071e45805146529fb8abd40629c2ae Oct 04 22:00:20.937016 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-ImagesTestJSON-16557252 Oct 04 22:00:20.937016 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-ImagesTestJSON-16557252-project Oct 04 22:00:20.937016 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 22:00:20.937016 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 22:00:20.937016 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: f5e807c724cc4c3887a2d360f0584ffb Oct 04 22:00:20.937016 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-ImagesTestJSON-16557252-project Oct 04 22:00:20.937016 n-d-860284-1 devstack@n-api.service[134101]: method: Oct 04 22:00:20.937016 n-d-860284-1 devstack@n-api.service[134101]: exception: Image not found. Oct 04 22:00:20.937016 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': '683538fe-4fde-450b-94cb-f14e6f8483a3'} Oct 04 22:00:20.937016 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:00:20.937016 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:00:20.937016 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 04 22:00:20.937016 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 04 22:00:20.937016 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 22:00:20.937016 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 22:00:20.937016 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 22:00:20.937016 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 22:00:20.937016 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 04 22:00:20.937016 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 04 22:00:20.937016 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 04 22:00:20.937016 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 04 22:00:20.937016 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 22:00:20.937016 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 22:00:20.937016 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 22:00:20.937016 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 22:00:20.937016 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 683538fe-4fde-450b-94cb-f14e6f8483a3 to delete Oct 04 22:00:20.937016 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:00:20.937016 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:00:20.937016 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:00:20.937016 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:00:20.937016 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 04 22:00:20.937016 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 04 22:00:20.937016 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 04 22:00:20.937016 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 04 22:00:20.937016 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 04 22:00:20.937016 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 04 22:00:20.937016 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 683538fe-4fde-450b-94cb-f14e6f8483a3 could not be found. Oct 04 22:00:20.937016 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:00:20.937016 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:00:20.937016 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:00:20.937016 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:00:20.941983 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:00:20.941983 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:00:20.941983 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:00:20.941983 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:00:20.941983 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 22:00:20.941983 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 22:00:20.941983 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:00:20.941983 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:00:20.941983 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 04 22:00:20.941983 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 22:00:20.941983 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 22:00:20.941983 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:00:20.941983 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:00:20.941983 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:00:20.941983 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:00:20.941983 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:00:20.941983 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:00:20.941983 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:00:20.941983 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:00:20.941983 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 22:00:20.941983 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:00:20.948534 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-1fa13b2a-58b5-4221-95eb-6246c73689b2 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Returning 404 to user: Image not found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:00:20.953717 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-1fa13b2a-58b5-4221-95eb-6246c73689b2 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] 10.222.0.43 "DELETE /compute/v2.1/images/683538fe-4fde-450b-94cb-f14e6f8483a3" status: 404 len: 62 microversion: 2.1 time: 0.092721 Oct 04 22:00:20.957754 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1771/3600] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:00:20 2022] DELETE /compute/v2.1/images/683538fe-4fde-450b-94cb-f14e6f8483a3 => generated 62 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 22:00:20.966476 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-0bc37927-3916-479c-9d49-e1a50fc3f7ad tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:20.978104 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-0bc37927-3916-479c-9d49-e1a50fc3f7ad tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] [instance: 2d3d1574-f1b5-46a9-a3b7-205a905a90f1] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:20.992928 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-bc9f3163-2282-4b7f-b22c-c2d98390027d tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2034fc9060874868bc5d27370a1c351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89499d833a4a00805164f4f79ed522', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:20.995308 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:00:21.004442 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-bc9f3163-2282-4b7f-b22c-c2d98390027d tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] 10.222.0.43 "GET /compute/v2.1/servers/df147c22-6a7f-4081-83e7-97620b23700c" status: 200 len: 1514 microversion: 2.1 time: 0.298739 Oct 04 22:00:21.005906 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1830/3601] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:00:20 2022] GET /compute/v2.1/servers/df147c22-6a7f-4081-83e7-97620b23700c => generated 1514 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:00:21.013532 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-64d9bae5-85be-4a06-af16-0d05c2358d66 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:21.014118 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-64d9bae5-85be-4a06-af16-0d05c2358d66 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: a4cf4fac-1e9b-4669-a6ff-30008ed3642d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:21.022074 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-64d9bae5-85be-4a06-af16-0d05c2358d66 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:21.022648 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-64d9bae5-85be-4a06-af16-0d05c2358d66 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:21.023088 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-64d9bae5-85be-4a06-af16-0d05c2358d66 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:21.023854 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-64d9bae5-85be-4a06-af16-0d05c2358d66 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:21.024318 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-64d9bae5-85be-4a06-af16-0d05c2358d66 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:21.024748 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-64d9bae5-85be-4a06-af16-0d05c2358d66 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:21.097798 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-0bc37927-3916-479c-9d49-e1a50fc3f7ad tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd474da1382674cada32763825c7840f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cad63eb782c43b19d642fa6adaffd71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:21.107550 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-0bc37927-3916-479c-9d49-e1a50fc3f7ad tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] 10.222.0.43 "GET /compute/v2.1/servers/2d3d1574-f1b5-46a9-a3b7-205a905a90f1" status: 200 len: 1215 microversion: 2.1 time: 0.147367 Oct 04 22:00:21.122566 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1772/3602] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:00:20 2022] GET /compute/v2.1/servers/2d3d1574-f1b5-46a9-a3b7-205a905a90f1 => generated 1215 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:00:21.122566 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-acf8683c-0d95-42b1-8f99-7c7ebabe71a5 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:21.122566 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-acf8683c-0d95-42b1-8f99-7c7ebabe71a5 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] [instance: dad442d9-d2e1-49ee-93ea-6e5090634df8] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:21.150077 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-acf8683c-0d95-42b1-8f99-7c7ebabe71a5 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:21.150636 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-acf8683c-0d95-42b1-8f99-7c7ebabe71a5 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:21.151095 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-acf8683c-0d95-42b1-8f99-7c7ebabe71a5 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:21.151836 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-acf8683c-0d95-42b1-8f99-7c7ebabe71a5 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:21.152401 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-acf8683c-0d95-42b1-8f99-7c7ebabe71a5 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:21.152727 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-acf8683c-0d95-42b1-8f99-7c7ebabe71a5 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:21.209839 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-acf8683c-0d95-42b1-8f99-7c7ebabe71a5 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] HTTP exception thrown: Instance dad442d9-d2e1-49ee-93ea-6e5090634df8 could not be found. Oct 04 22:00:21.211502 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-acf8683c-0d95-42b1-8f99-7c7ebabe71a5 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Request method failure captured: Oct 04 22:00:21.211502 n-d-860284-1 devstack@n-api.service[134101]: request: DELETE /compute/v2.1/servers/dad442d9-d2e1-49ee-93ea-6e5090634df8 HTTP/1.1 Oct 04 22:00:21.211502 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 22:00:21.211502 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 22:00:21.211502 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 22:00:21.211502 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 22:00:21.211502 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 22:00:21.211502 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 22:00:21.211502 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 22:00:21.211502 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 22:00:21.211502 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPKvwRm5H229vYgT4QHRa2H3KJczD-aqhmeg0I-VS0SzH4LpkKkIiHtGK-ADawxjSM_n0nP8jiKarlV43x9RTjhXSdePJ8ObpL2_riw7qpbkit-jHniKDN-twWm_bE3Sp41ooGJIT8ljY8Dmm_FSvvYUKVYdQrj2kBYSVFTaeCRm4Bls Oct 04 22:00:21.211502 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 22:00:21.211502 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 22:00:21.211502 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 22:00:21.211502 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 22:00:21.211502 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 22:00:21.211502 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 22:00:21.211502 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: 40071e45805146529fb8abd40629c2ae Oct 04 22:00:21.211502 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-ImagesTestJSON-16557252 Oct 04 22:00:21.211502 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 22:00:21.211502 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 22:00:21.211502 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/40071e45805146529fb8abd40629c2ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_40071e45805146529fb8abd40629c2ae", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/40071e45805146529fb8abd40629c2ae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/40071e45805146529fb8abd40629c2ae"}]}] Oct 04 22:00:21.211502 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-ImagesTestJSON-16557252 Oct 04 22:00:21.211502 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: 40071e45805146529fb8abd40629c2ae Oct 04 22:00:21.211502 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-ImagesTestJSON-16557252 Oct 04 22:00:21.211502 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-ImagesTestJSON-16557252-project Oct 04 22:00:21.211502 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 22:00:21.211502 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 22:00:21.211502 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: f5e807c724cc4c3887a2d360f0584ffb Oct 04 22:00:21.211502 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-ImagesTestJSON-16557252-project Oct 04 22:00:21.211502 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 22:00:21.211502 n-d-860284-1 devstack@n-api.service[134101]: exception: Instance dad442d9-d2e1-49ee-93ea-6e5090634df8 could not be found. Oct 04 22:00:21.211502 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': 'dad442d9-d2e1-49ee-93ea-6e5090634df8'} Oct 04 22:00:21.211502 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:00:21.211502 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:00:21.211502 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:00:21.211502 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:00:21.211502 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:00:21.211502 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:00:21.211502 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:00:21.211502 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:00:21.211502 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:00:21.211502 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:00:21.211502 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dad442d9-d2e1-49ee-93ea-6e5090634df8 could not be found. Oct 04 22:00:21.211502 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:00:21.211502 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:00:21.211502 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:00:21.211502 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:00:21.211502 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:00:21.211502 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:00:21.211502 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:00:21.211502 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:00:21.211502 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:00:21.211502 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:00:21.211502 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 22:00:21.211502 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 22:00:21.211502 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 22:00:21.211502 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 22:00:21.211502 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:00:21.211502 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:00:21.211502 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:00:21.211502 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:00:21.211502 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dad442d9-d2e1-49ee-93ea-6e5090634df8 could not be found. Oct 04 22:00:21.217377 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:00:21.217377 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:00:21.217377 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:00:21.217377 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:00:21.217377 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:00:21.217377 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:00:21.217377 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:00:21.217377 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:00:21.217377 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dad442d9-d2e1-49ee-93ea-6e5090634df8 could not be found. Oct 04 22:00:21.217377 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:00:21.221436 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-acf8683c-0d95-42b1-8f99-7c7ebabe71a5 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Returning 404 to user: Instance dad442d9-d2e1-49ee-93ea-6e5090634df8 could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:00:21.223436 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-acf8683c-0d95-42b1-8f99-7c7ebabe71a5 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] 10.222.0.43 "DELETE /compute/v2.1/servers/dad442d9-d2e1-49ee-93ea-6e5090634df8" status: 404 len: 111 microversion: 2.1 time: 0.112210 Oct 04 22:00:21.224348 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1773/3603] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 22:00:21 2022] DELETE /compute/v2.1/servers/dad442d9-d2e1-49ee-93ea-6e5090634df8 => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:00:21.244998 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-c4448841-7e61-4f30-952c-a5604f8f3558 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:21.248518 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-c4448841-7e61-4f30-952c-a5604f8f3558 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] [instance: dad442d9-d2e1-49ee-93ea-6e5090634df8] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:21.260191 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c4448841-7e61-4f30-952c-a5604f8f3558 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:21.263272 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c4448841-7e61-4f30-952c-a5604f8f3558 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:21.267288 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c4448841-7e61-4f30-952c-a5604f8f3558 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:21.268349 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c4448841-7e61-4f30-952c-a5604f8f3558 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:21.269206 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c4448841-7e61-4f30-952c-a5604f8f3558 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:21.271820 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c4448841-7e61-4f30-952c-a5604f8f3558 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:21.317949 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-c4448841-7e61-4f30-952c-a5604f8f3558 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] HTTP exception thrown: Instance dad442d9-d2e1-49ee-93ea-6e5090634df8 could not be found. Oct 04 22:00:21.319663 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-c4448841-7e61-4f30-952c-a5604f8f3558 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Request method failure captured: Oct 04 22:00:21.319663 n-d-860284-1 devstack@n-api.service[134101]: request: GET /compute/v2.1/servers/dad442d9-d2e1-49ee-93ea-6e5090634df8 HTTP/1.1 Oct 04 22:00:21.319663 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 22:00:21.319663 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 22:00:21.319663 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 22:00:21.319663 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 22:00:21.319663 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 22:00:21.319663 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 22:00:21.319663 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 22:00:21.319663 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 22:00:21.319663 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPKvwRm5H229vYgT4QHRa2H3KJczD-aqhmeg0I-VS0SzH4LpkKkIiHtGK-ADawxjSM_n0nP8jiKarlV43x9RTjhXSdePJ8ObpL2_riw7qpbkit-jHniKDN-twWm_bE3Sp41ooGJIT8ljY8Dmm_FSvvYUKVYdQrj2kBYSVFTaeCRm4Bls Oct 04 22:00:21.319663 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 22:00:21.319663 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 22:00:21.319663 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 22:00:21.319663 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 22:00:21.319663 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 22:00:21.319663 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 22:00:21.319663 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: 40071e45805146529fb8abd40629c2ae Oct 04 22:00:21.319663 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-ImagesTestJSON-16557252 Oct 04 22:00:21.319663 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 22:00:21.319663 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 22:00:21.319663 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/40071e45805146529fb8abd40629c2ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_40071e45805146529fb8abd40629c2ae", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/40071e45805146529fb8abd40629c2ae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/40071e45805146529fb8abd40629c2ae"}]}] Oct 04 22:00:21.319663 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-ImagesTestJSON-16557252 Oct 04 22:00:21.319663 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: 40071e45805146529fb8abd40629c2ae Oct 04 22:00:21.319663 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-ImagesTestJSON-16557252 Oct 04 22:00:21.319663 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-ImagesTestJSON-16557252-project Oct 04 22:00:21.319663 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 22:00:21.319663 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 22:00:21.319663 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: f5e807c724cc4c3887a2d360f0584ffb Oct 04 22:00:21.319663 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-ImagesTestJSON-16557252-project Oct 04 22:00:21.319663 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 22:00:21.319663 n-d-860284-1 devstack@n-api.service[134101]: exception: Instance dad442d9-d2e1-49ee-93ea-6e5090634df8 could not be found. Oct 04 22:00:21.319663 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': 'dad442d9-d2e1-49ee-93ea-6e5090634df8'} Oct 04 22:00:21.319663 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:00:21.319663 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:00:21.319663 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:00:21.319663 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:00:21.319663 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:00:21.319663 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:00:21.319663 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:00:21.319663 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:00:21.319663 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:00:21.319663 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:00:21.319663 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dad442d9-d2e1-49ee-93ea-6e5090634df8 could not be found. Oct 04 22:00:21.319663 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:00:21.319663 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:00:21.319663 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:00:21.319663 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:00:21.319663 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:00:21.319663 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:00:21.319663 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:00:21.319663 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:00:21.319663 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:00:21.319663 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:00:21.319663 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:00:21.319663 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:00:21.319663 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:00:21.319663 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:00:21.319663 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:00:21.319663 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:00:21.319663 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dad442d9-d2e1-49ee-93ea-6e5090634df8 could not be found. Oct 04 22:00:21.319663 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:00:21.319663 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:00:21.319663 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:00:21.319663 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:00:21.326009 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:00:21.326009 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:00:21.326009 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:00:21.326009 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:00:21.326009 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dad442d9-d2e1-49ee-93ea-6e5090634df8 could not be found. Oct 04 22:00:21.326009 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:00:21.326009 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-c4448841-7e61-4f30-952c-a5604f8f3558 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Returning 404 to user: Instance dad442d9-d2e1-49ee-93ea-6e5090634df8 could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:00:21.326009 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-c4448841-7e61-4f30-952c-a5604f8f3558 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] 10.222.0.43 "GET /compute/v2.1/servers/dad442d9-d2e1-49ee-93ea-6e5090634df8" status: 404 len: 111 microversion: 2.1 time: 0.084472 Oct 04 22:00:21.330923 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1774/3604] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:00:21 2022] GET /compute/v2.1/servers/dad442d9-d2e1-49ee-93ea-6e5090634df8 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:00:21.345146 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-a1b15133-19fa-4871-8aa2-93450aad8fb3 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Calling method '.version_select at 0x7fbb2e7e18b0>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:21.379403 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-a1b15133-19fa-4871-8aa2-93450aad8fb3 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] HTTP exception thrown: Image not found. Oct 04 22:00:21.381203 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-a1b15133-19fa-4871-8aa2-93450aad8fb3 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Request method failure captured: Oct 04 22:00:21.381203 n-d-860284-1 devstack@n-api.service[134101]: request: DELETE /compute/v2.1/images/fc854dc3-25b4-4f91-a4ee-4aa1cce47c5b HTTP/1.1 Oct 04 22:00:21.381203 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 22:00:21.381203 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 22:00:21.381203 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 22:00:21.381203 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 22:00:21.381203 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 22:00:21.381203 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 22:00:21.381203 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 22:00:21.381203 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 22:00:21.381203 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPKvwRm5H229vYgT4QHRa2H3KJczD-aqhmeg0I-VS0SzH4LpkKkIiHtGK-ADawxjSM_n0nP8jiKarlV43x9RTjhXSdePJ8ObpL2_riw7qpbkit-jHniKDN-twWm_bE3Sp41ooGJIT8ljY8Dmm_FSvvYUKVYdQrj2kBYSVFTaeCRm4Bls Oct 04 22:00:21.381203 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 22:00:21.381203 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 22:00:21.381203 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 22:00:21.381203 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 22:00:21.381203 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 22:00:21.381203 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 22:00:21.381203 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: 40071e45805146529fb8abd40629c2ae Oct 04 22:00:21.381203 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-ImagesTestJSON-16557252 Oct 04 22:00:21.381203 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 22:00:21.381203 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 22:00:21.381203 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/40071e45805146529fb8abd40629c2ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_40071e45805146529fb8abd40629c2ae", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/40071e45805146529fb8abd40629c2ae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/40071e45805146529fb8abd40629c2ae"}]}] Oct 04 22:00:21.381203 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-ImagesTestJSON-16557252 Oct 04 22:00:21.381203 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: 40071e45805146529fb8abd40629c2ae Oct 04 22:00:21.381203 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-ImagesTestJSON-16557252 Oct 04 22:00:21.381203 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-ImagesTestJSON-16557252-project Oct 04 22:00:21.381203 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 22:00:21.381203 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 22:00:21.381203 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: f5e807c724cc4c3887a2d360f0584ffb Oct 04 22:00:21.381203 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-ImagesTestJSON-16557252-project Oct 04 22:00:21.381203 n-d-860284-1 devstack@n-api.service[134101]: method: Oct 04 22:00:21.381203 n-d-860284-1 devstack@n-api.service[134101]: exception: Image not found. Oct 04 22:00:21.381203 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': 'fc854dc3-25b4-4f91-a4ee-4aa1cce47c5b'} Oct 04 22:00:21.381203 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:00:21.381203 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:00:21.381203 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 04 22:00:21.381203 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 04 22:00:21.381203 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 22:00:21.381203 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 22:00:21.381203 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 22:00:21.381203 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 22:00:21.381203 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 04 22:00:21.381203 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 04 22:00:21.381203 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 04 22:00:21.381203 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 04 22:00:21.381203 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 22:00:21.381203 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 22:00:21.381203 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 22:00:21.381203 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 22:00:21.381203 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image fc854dc3-25b4-4f91-a4ee-4aa1cce47c5b to delete Oct 04 22:00:21.381203 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:00:21.381203 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:00:21.381203 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:00:21.381203 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:00:21.381203 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 04 22:00:21.381203 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 04 22:00:21.381203 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 04 22:00:21.381203 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 04 22:00:21.381203 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 04 22:00:21.381203 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 04 22:00:21.381203 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image fc854dc3-25b4-4f91-a4ee-4aa1cce47c5b could not be found. Oct 04 22:00:21.381203 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:00:21.381203 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:00:21.381203 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:00:21.381203 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:00:21.387186 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:00:21.387186 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:00:21.387186 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:00:21.387186 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:00:21.387186 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 22:00:21.387186 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 22:00:21.387186 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:00:21.387186 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:00:21.387186 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 04 22:00:21.387186 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 22:00:21.387186 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 22:00:21.387186 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:00:21.387186 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:00:21.387186 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:00:21.387186 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:00:21.387186 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:00:21.387186 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:00:21.387186 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:00:21.387186 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:00:21.387186 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 22:00:21.387186 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:00:21.392960 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-a1b15133-19fa-4871-8aa2-93450aad8fb3 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Returning 404 to user: Image not found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:00:21.392960 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-a1b15133-19fa-4871-8aa2-93450aad8fb3 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] 10.222.0.43 "DELETE /compute/v2.1/images/fc854dc3-25b4-4f91-a4ee-4aa1cce47c5b" status: 404 len: 62 microversion: 2.1 time: 0.058848 Oct 04 22:00:21.396695 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1775/3605] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:00:21 2022] DELETE /compute/v2.1/images/fc854dc3-25b4-4f91-a4ee-4aa1cce47c5b => generated 62 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 22:00:21.403837 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-6dc38992-d931-4815-9652-4ed43cae72ec tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:21.411130 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-6dc38992-d931-4815-9652-4ed43cae72ec tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] [instance: b176215c-96d4-402b-9c63-7ce87fe04ff6] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:21.426047 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6dc38992-d931-4815-9652-4ed43cae72ec tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:21.431776 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-64d9bae5-85be-4a06-af16-0d05c2358d66 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2facee4c6a40416e908083e126d2cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07a17a482a4e92b6ddbdee463c8029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:21.441340 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-64d9bae5-85be-4a06-af16-0d05c2358d66 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d" status: 200 len: 1526 microversion: 2.1 time: 0.434152 Oct 04 22:00:21.444256 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6dc38992-d931-4815-9652-4ed43cae72ec tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:21.445396 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6dc38992-d931-4815-9652-4ed43cae72ec tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:21.447259 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6dc38992-d931-4815-9652-4ed43cae72ec tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:21.449482 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6dc38992-d931-4815-9652-4ed43cae72ec tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:21.453195 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6dc38992-d931-4815-9652-4ed43cae72ec tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:21.455007 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1831/3606] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:00:21 2022] GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d => generated 1526 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:00:21.474799 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-ade8e4dd-4600-4516-ab55-7d32c0d8e89c tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:21.475801 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-ade8e4dd-4600-4516-ab55-7d32c0d8e89c tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] [instance: 4c17a63b-8492-4c9b-a0c2-34bef7051f80] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:21.487811 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ade8e4dd-4600-4516-ab55-7d32c0d8e89c tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:21.489362 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-6dc38992-d931-4815-9652-4ed43cae72ec tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] HTTP exception thrown: Instance b176215c-96d4-402b-9c63-7ce87fe04ff6 could not be found. Oct 04 22:00:21.491282 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-6dc38992-d931-4815-9652-4ed43cae72ec tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Request method failure captured: Oct 04 22:00:21.491282 n-d-860284-1 devstack@n-api.service[134101]: request: DELETE /compute/v2.1/servers/b176215c-96d4-402b-9c63-7ce87fe04ff6 HTTP/1.1 Oct 04 22:00:21.491282 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 22:00:21.491282 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 22:00:21.491282 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 22:00:21.491282 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 22:00:21.491282 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 22:00:21.491282 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 22:00:21.491282 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 22:00:21.491282 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 22:00:21.491282 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPKvwRm5H229vYgT4QHRa2H3KJczD-aqhmeg0I-VS0SzH4LpkKkIiHtGK-ADawxjSM_n0nP8jiKarlV43x9RTjhXSdePJ8ObpL2_riw7qpbkit-jHniKDN-twWm_bE3Sp41ooGJIT8ljY8Dmm_FSvvYUKVYdQrj2kBYSVFTaeCRm4Bls Oct 04 22:00:21.491282 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 22:00:21.491282 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 22:00:21.491282 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 22:00:21.491282 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 22:00:21.491282 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 22:00:21.491282 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 22:00:21.491282 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: 40071e45805146529fb8abd40629c2ae Oct 04 22:00:21.491282 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-ImagesTestJSON-16557252 Oct 04 22:00:21.491282 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 22:00:21.491282 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 22:00:21.491282 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/40071e45805146529fb8abd40629c2ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_40071e45805146529fb8abd40629c2ae", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/40071e45805146529fb8abd40629c2ae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/40071e45805146529fb8abd40629c2ae"}]}] Oct 04 22:00:21.491282 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-ImagesTestJSON-16557252 Oct 04 22:00:21.491282 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: 40071e45805146529fb8abd40629c2ae Oct 04 22:00:21.491282 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-ImagesTestJSON-16557252 Oct 04 22:00:21.491282 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-ImagesTestJSON-16557252-project Oct 04 22:00:21.491282 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 22:00:21.491282 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 22:00:21.491282 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: f5e807c724cc4c3887a2d360f0584ffb Oct 04 22:00:21.491282 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-ImagesTestJSON-16557252-project Oct 04 22:00:21.491282 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 22:00:21.491282 n-d-860284-1 devstack@n-api.service[134101]: exception: Instance b176215c-96d4-402b-9c63-7ce87fe04ff6 could not be found. Oct 04 22:00:21.491282 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': 'b176215c-96d4-402b-9c63-7ce87fe04ff6'} Oct 04 22:00:21.491282 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:00:21.491282 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:00:21.491282 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:00:21.491282 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:00:21.491282 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:00:21.491282 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:00:21.491282 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:00:21.491282 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:00:21.491282 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:00:21.491282 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:00:21.491282 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b176215c-96d4-402b-9c63-7ce87fe04ff6 could not be found. Oct 04 22:00:21.491282 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:00:21.491282 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:00:21.491282 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:00:21.491282 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:00:21.491282 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:00:21.491282 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:00:21.491282 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:00:21.491282 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:00:21.491282 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:00:21.491282 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:00:21.491282 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 22:00:21.491282 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 22:00:21.491282 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 22:00:21.491282 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 22:00:21.491282 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:00:21.491282 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:00:21.491282 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:00:21.491282 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:00:21.491282 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b176215c-96d4-402b-9c63-7ce87fe04ff6 could not be found. Oct 04 22:00:21.498674 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:00:21.498674 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:00:21.498674 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:00:21.498674 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:00:21.498674 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:00:21.498674 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:00:21.498674 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:00:21.498674 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:00:21.498674 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b176215c-96d4-402b-9c63-7ce87fe04ff6 could not be found. Oct 04 22:00:21.498674 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:00:21.501052 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ade8e4dd-4600-4516-ab55-7d32c0d8e89c tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:21.501743 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ade8e4dd-4600-4516-ab55-7d32c0d8e89c tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:21.502783 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ade8e4dd-4600-4516-ab55-7d32c0d8e89c tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:21.503731 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-6dc38992-d931-4815-9652-4ed43cae72ec tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Returning 404 to user: Instance b176215c-96d4-402b-9c63-7ce87fe04ff6 could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:00:21.504699 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-6dc38992-d931-4815-9652-4ed43cae72ec tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] 10.222.0.43 "DELETE /compute/v2.1/servers/b176215c-96d4-402b-9c63-7ce87fe04ff6" status: 404 len: 111 microversion: 2.1 time: 0.106692 Oct 04 22:00:21.505259 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ade8e4dd-4600-4516-ab55-7d32c0d8e89c tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:21.505759 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ade8e4dd-4600-4516-ab55-7d32c0d8e89c tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:21.506439 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1776/3607] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 22:00:21 2022] DELETE /compute/v2.1/servers/b176215c-96d4-402b-9c63-7ce87fe04ff6 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:00:21.521333 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:00:21.526053 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-7eeb96f3-81d5-4fdf-8b3e-3d3513c1dff1 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:21.527513 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-7eeb96f3-81d5-4fdf-8b3e-3d3513c1dff1 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] [instance: b176215c-96d4-402b-9c63-7ce87fe04ff6] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:21.545416 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7eeb96f3-81d5-4fdf-8b3e-3d3513c1dff1 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:21.547604 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7eeb96f3-81d5-4fdf-8b3e-3d3513c1dff1 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:21.548320 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7eeb96f3-81d5-4fdf-8b3e-3d3513c1dff1 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:21.551176 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7eeb96f3-81d5-4fdf-8b3e-3d3513c1dff1 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:21.552017 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7eeb96f3-81d5-4fdf-8b3e-3d3513c1dff1 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:21.553926 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7eeb96f3-81d5-4fdf-8b3e-3d3513c1dff1 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:21.631494 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-7eeb96f3-81d5-4fdf-8b3e-3d3513c1dff1 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] HTTP exception thrown: Instance b176215c-96d4-402b-9c63-7ce87fe04ff6 could not be found. Oct 04 22:00:21.646063 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-7eeb96f3-81d5-4fdf-8b3e-3d3513c1dff1 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Request method failure captured: Oct 04 22:00:21.646063 n-d-860284-1 devstack@n-api.service[134101]: request: GET /compute/v2.1/servers/b176215c-96d4-402b-9c63-7ce87fe04ff6 HTTP/1.1 Oct 04 22:00:21.646063 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 22:00:21.646063 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 22:00:21.646063 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 22:00:21.646063 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 22:00:21.646063 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 22:00:21.646063 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 22:00:21.646063 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 22:00:21.646063 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 22:00:21.646063 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPKvwRm5H229vYgT4QHRa2H3KJczD-aqhmeg0I-VS0SzH4LpkKkIiHtGK-ADawxjSM_n0nP8jiKarlV43x9RTjhXSdePJ8ObpL2_riw7qpbkit-jHniKDN-twWm_bE3Sp41ooGJIT8ljY8Dmm_FSvvYUKVYdQrj2kBYSVFTaeCRm4Bls Oct 04 22:00:21.646063 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 22:00:21.646063 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 22:00:21.646063 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 22:00:21.646063 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 22:00:21.646063 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 22:00:21.646063 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 22:00:21.646063 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: 40071e45805146529fb8abd40629c2ae Oct 04 22:00:21.646063 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-ImagesTestJSON-16557252 Oct 04 22:00:21.646063 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 22:00:21.646063 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 22:00:21.646063 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/40071e45805146529fb8abd40629c2ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_40071e45805146529fb8abd40629c2ae", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/40071e45805146529fb8abd40629c2ae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/40071e45805146529fb8abd40629c2ae"}]}] Oct 04 22:00:21.646063 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-ImagesTestJSON-16557252 Oct 04 22:00:21.646063 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: 40071e45805146529fb8abd40629c2ae Oct 04 22:00:21.646063 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-ImagesTestJSON-16557252 Oct 04 22:00:21.646063 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-ImagesTestJSON-16557252-project Oct 04 22:00:21.646063 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 22:00:21.646063 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 22:00:21.646063 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: f5e807c724cc4c3887a2d360f0584ffb Oct 04 22:00:21.646063 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-ImagesTestJSON-16557252-project Oct 04 22:00:21.646063 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 22:00:21.646063 n-d-860284-1 devstack@n-api.service[134101]: exception: Instance b176215c-96d4-402b-9c63-7ce87fe04ff6 could not be found. Oct 04 22:00:21.646063 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': 'b176215c-96d4-402b-9c63-7ce87fe04ff6'} Oct 04 22:00:21.646063 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:00:21.646063 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:00:21.646063 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:00:21.646063 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:00:21.646063 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:00:21.646063 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:00:21.646063 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:00:21.646063 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:00:21.646063 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:00:21.646063 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:00:21.646063 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b176215c-96d4-402b-9c63-7ce87fe04ff6 could not be found. Oct 04 22:00:21.646063 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:00:21.646063 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:00:21.646063 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:00:21.646063 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:00:21.646063 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:00:21.646063 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:00:21.646063 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:00:21.646063 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:00:21.646063 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:00:21.646063 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:00:21.646063 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:00:21.646063 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:00:21.646063 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:00:21.646063 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:00:21.646063 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:00:21.646063 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:00:21.646063 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b176215c-96d4-402b-9c63-7ce87fe04ff6 could not be found. Oct 04 22:00:21.646063 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:00:21.646063 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:00:21.646063 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:00:21.646063 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:00:21.651459 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:00:21.651459 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:00:21.651459 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:00:21.651459 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:00:21.651459 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b176215c-96d4-402b-9c63-7ce87fe04ff6 could not be found. Oct 04 22:00:21.651459 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:00:21.658457 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-7eeb96f3-81d5-4fdf-8b3e-3d3513c1dff1 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] Returning 404 to user: Instance b176215c-96d4-402b-9c63-7ce87fe04ff6 could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:00:21.659605 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-7eeb96f3-81d5-4fdf-8b3e-3d3513c1dff1 tempest-ImagesTestJSON-16557252 tempest-ImagesTestJSON-16557252-project] 10.222.0.43 "GET /compute/v2.1/servers/b176215c-96d4-402b-9c63-7ce87fe04ff6" status: 404 len: 111 microversion: 2.1 time: 0.146655 Oct 04 22:00:21.664512 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1777/3608] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:00:21 2022] GET /compute/v2.1/servers/b176215c-96d4-402b-9c63-7ce87fe04ff6 => generated 111 bytes in 152 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:00:21.712479 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-ade8e4dd-4600-4516-ab55-7d32c0d8e89c tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c7a1e7d6984644a68d967b5e3fe92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3994b89cac594e309926f1eaf785f7d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:21.724059 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-ade8e4dd-4600-4516-ab55-7d32c0d8e89c tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] 10.222.0.43 "GET /compute/v2.1/servers/4c17a63b-8492-4c9b-a0c2-34bef7051f80" status: 200 len: 1539 microversion: 2.1 time: 0.267836 Oct 04 22:00:21.742768 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1832/3609] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:00:21 2022] GET /compute/v2.1/servers/4c17a63b-8492-4c9b-a0c2-34bef7051f80 => generated 1539 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:00:21.749845 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-b8a36ad5-8f46-43c8-9609-146c69dea6d1 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:21.750516 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-b8a36ad5-8f46-43c8-9609-146c69dea6d1 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] [instance: d0b1b757-4a4d-4a7a-9a06-08f178a02984] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:21.758323 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b8a36ad5-8f46-43c8-9609-146c69dea6d1 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:21.758958 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b8a36ad5-8f46-43c8-9609-146c69dea6d1 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:21.760346 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b8a36ad5-8f46-43c8-9609-146c69dea6d1 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:21.763062 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b8a36ad5-8f46-43c8-9609-146c69dea6d1 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:21.763841 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b8a36ad5-8f46-43c8-9609-146c69dea6d1 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:21.764525 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b8a36ad5-8f46-43c8-9609-146c69dea6d1 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:21.931102 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-b8a36ad5-8f46-43c8-9609-146c69dea6d1 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:21.943633 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-b8a36ad5-8f46-43c8-9609-146c69dea6d1 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:21.946322 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-b8a36ad5-8f46-43c8-9609-146c69dea6d1 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:21.952762 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-b8a36ad5-8f46-43c8-9609-146c69dea6d1 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] 10.222.0.43 "GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984" status: 200 len: 1537 microversion: 2.91 time: 0.215711 Oct 04 22:00:21.953989 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1778/3610] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:00:21 2022] GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984 => generated 1537 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:00:22.035175 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-46a0f6d9-1d4a-4694-beb6-c6c0504c88c6 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:22.035974 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-46a0f6d9-1d4a-4694-beb6-c6c0504c88c6 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] [instance: df147c22-6a7f-4081-83e7-97620b23700c] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:22.051704 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-46a0f6d9-1d4a-4694-beb6-c6c0504c88c6 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:22.052221 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-46a0f6d9-1d4a-4694-beb6-c6c0504c88c6 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:22.052671 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-46a0f6d9-1d4a-4694-beb6-c6c0504c88c6 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:22.056759 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-46a0f6d9-1d4a-4694-beb6-c6c0504c88c6 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:22.060367 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-46a0f6d9-1d4a-4694-beb6-c6c0504c88c6 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:22.060862 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-46a0f6d9-1d4a-4694-beb6-c6c0504c88c6 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:22.137049 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-ffbccc11-340e-4552-82d5-81f53e4421ec tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:22.138554 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-ffbccc11-340e-4552-82d5-81f53e4421ec tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] [instance: 2d3d1574-f1b5-46a9-a3b7-205a905a90f1] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:22.148083 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ffbccc11-340e-4552-82d5-81f53e4421ec tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:22.148940 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ffbccc11-340e-4552-82d5-81f53e4421ec tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:22.149563 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ffbccc11-340e-4552-82d5-81f53e4421ec tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:22.150830 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ffbccc11-340e-4552-82d5-81f53e4421ec tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:22.151749 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ffbccc11-340e-4552-82d5-81f53e4421ec tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:22.152396 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ffbccc11-340e-4552-82d5-81f53e4421ec tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:22.307187 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-ffbccc11-340e-4552-82d5-81f53e4421ec tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd474da1382674cada32763825c7840f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cad63eb782c43b19d642fa6adaffd71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:22.327551 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-ffbccc11-340e-4552-82d5-81f53e4421ec tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] 10.222.0.43 "GET /compute/v2.1/servers/2d3d1574-f1b5-46a9-a3b7-205a905a90f1" status: 200 len: 1211 microversion: 2.1 time: 0.186244 Oct 04 22:00:22.329391 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1779/3611] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:00:22 2022] GET /compute/v2.1/servers/2d3d1574-f1b5-46a9-a3b7-205a905a90f1 => generated 1211 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:00:22.362749 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-72ed6c6f-d094-4550-bdb6-faad6c8ba330 req-7c6bddd0-f693-4088-83c5-e4bad2bb08ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c17a63b-8492-4c9b-a0c2-34bef7051f80", "name": "network-vif-deleted", "tag": "353bf1c2-20f1-4ba8-8856-cc01db923973"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:00:22.395809 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-72ed6c6f-d094-4550-bdb6-faad6c8ba330 req-7c6bddd0-f693-4088-83c5-e4bad2bb08ca service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:22.396351 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-72ed6c6f-d094-4550-bdb6-faad6c8ba330 req-7c6bddd0-f693-4088-83c5-e4bad2bb08ca service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:22.396877 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-72ed6c6f-d094-4550-bdb6-faad6c8ba330 req-7c6bddd0-f693-4088-83c5-e4bad2bb08ca service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:22.428482 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-72ed6c6f-d094-4550-bdb6-faad6c8ba330 req-7c6bddd0-f693-4088-83c5-e4bad2bb08ca service nova] Creating event network-vif-deleted:353bf1c2-20f1-4ba8-8856-cc01db923973 for instance 4c17a63b-8492-4c9b-a0c2-34bef7051f80 on n-h2-860284-1 Oct 04 22:00:22.443869 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-72ed6c6f-d094-4550-bdb6-faad6c8ba330 req-7c6bddd0-f693-4088-83c5-e4bad2bb08ca service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086561 Oct 04 22:00:22.447489 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1780/3612] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:00:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:00:22.483037 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-c686981a-3401-458f-91d1-893f7d1364af tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:22.488890 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-c686981a-3401-458f-91d1-893f7d1364af tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: a4cf4fac-1e9b-4669-a6ff-30008ed3642d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:22.535197 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c686981a-3401-458f-91d1-893f7d1364af tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:22.540862 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c686981a-3401-458f-91d1-893f7d1364af tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:22.542962 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c686981a-3401-458f-91d1-893f7d1364af tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:22.546264 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c686981a-3401-458f-91d1-893f7d1364af tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:22.551944 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c686981a-3401-458f-91d1-893f7d1364af tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:22.552406 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c686981a-3401-458f-91d1-893f7d1364af tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:22.725520 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-46a0f6d9-1d4a-4694-beb6-c6c0504c88c6 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2034fc9060874868bc5d27370a1c351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89499d833a4a00805164f4f79ed522', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:22.740310 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-46a0f6d9-1d4a-4694-beb6-c6c0504c88c6 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] 10.222.0.43 "GET /compute/v2.1/servers/df147c22-6a7f-4081-83e7-97620b23700c" status: 200 len: 1514 microversion: 2.1 time: 0.711467 Oct 04 22:00:22.745586 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1833/3613] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:00:22 2022] GET /compute/v2.1/servers/df147c22-6a7f-4081-83e7-97620b23700c => generated 1514 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:00:22.793828 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-5d7106c2-1c66-47ab-b451-a4c193d18f0e tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:22.795202 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-5d7106c2-1c66-47ab-b451-a4c193d18f0e tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] [instance: 4c17a63b-8492-4c9b-a0c2-34bef7051f80] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:22.814177 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:00:22.819545 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5d7106c2-1c66-47ab-b451-a4c193d18f0e tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:22.823648 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5d7106c2-1c66-47ab-b451-a4c193d18f0e tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:22.826324 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5d7106c2-1c66-47ab-b451-a4c193d18f0e tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:22.827301 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5d7106c2-1c66-47ab-b451-a4c193d18f0e tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:22.840870 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5d7106c2-1c66-47ab-b451-a4c193d18f0e tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:22.843477 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5d7106c2-1c66-47ab-b451-a4c193d18f0e tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:23.046482 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-c686981a-3401-458f-91d1-893f7d1364af tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2facee4c6a40416e908083e126d2cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07a17a482a4e92b6ddbdee463c8029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:23.050687 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:00:23.091362 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-c686981a-3401-458f-91d1-893f7d1364af tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d" status: 200 len: 1526 microversion: 2.1 time: 0.624981 Oct 04 22:00:23.099198 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1781/3614] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:00:22 2022] GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d => generated 1526 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:00:23.104704 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-b95967b3-1376-4c8d-9e8b-c1d804316796 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:23.115104 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-b95967b3-1376-4c8d-9e8b-c1d804316796 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] [instance: d0b1b757-4a4d-4a7a-9a06-08f178a02984] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:23.133468 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b95967b3-1376-4c8d-9e8b-c1d804316796 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:23.140026 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b95967b3-1376-4c8d-9e8b-c1d804316796 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:23.140801 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b95967b3-1376-4c8d-9e8b-c1d804316796 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:23.141810 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b95967b3-1376-4c8d-9e8b-c1d804316796 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:23.142695 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b95967b3-1376-4c8d-9e8b-c1d804316796 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:23.143465 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b95967b3-1376-4c8d-9e8b-c1d804316796 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:23.163380 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-5d7106c2-1c66-47ab-b451-a4c193d18f0e tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c7a1e7d6984644a68d967b5e3fe92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3994b89cac594e309926f1eaf785f7d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:23.172412 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-5d7106c2-1c66-47ab-b451-a4c193d18f0e tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] 10.222.0.43 "GET /compute/v2.1/servers/4c17a63b-8492-4c9b-a0c2-34bef7051f80" status: 200 len: 1251 microversion: 2.1 time: 0.411134 Oct 04 22:00:23.177271 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1834/3615] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:00:22 2022] GET /compute/v2.1/servers/4c17a63b-8492-4c9b-a0c2-34bef7051f80 => generated 1251 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:00:23.354498 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-20937156-d7ae-4ab6-8fdd-3e2f368ddde1 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:23.355139 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-20937156-d7ae-4ab6-8fdd-3e2f368ddde1 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] [instance: 2d3d1574-f1b5-46a9-a3b7-205a905a90f1] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:23.357593 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-b95967b3-1376-4c8d-9e8b-c1d804316796 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:23.372125 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-20937156-d7ae-4ab6-8fdd-3e2f368ddde1 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:23.372702 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-20937156-d7ae-4ab6-8fdd-3e2f368ddde1 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:23.373146 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-20937156-d7ae-4ab6-8fdd-3e2f368ddde1 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:23.373892 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-20937156-d7ae-4ab6-8fdd-3e2f368ddde1 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:23.374193 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-b95967b3-1376-4c8d-9e8b-c1d804316796 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:23.386395 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-20937156-d7ae-4ab6-8fdd-3e2f368ddde1 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:23.386976 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-20937156-d7ae-4ab6-8fdd-3e2f368ddde1 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:23.388289 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-b95967b3-1376-4c8d-9e8b-c1d804316796 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:23.426176 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-b95967b3-1376-4c8d-9e8b-c1d804316796 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] 10.222.0.43 "GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984" status: 200 len: 1537 microversion: 2.91 time: 0.321007 Oct 04 22:00:23.429203 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1782/3616] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:00:23 2022] GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984 => generated 1537 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:00:23.617873 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-20937156-d7ae-4ab6-8fdd-3e2f368ddde1 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd474da1382674cada32763825c7840f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cad63eb782c43b19d642fa6adaffd71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:23.631353 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-20937156-d7ae-4ab6-8fdd-3e2f368ddde1 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] 10.222.0.43 "GET /compute/v2.1/servers/2d3d1574-f1b5-46a9-a3b7-205a905a90f1" status: 200 len: 1275 microversion: 2.1 time: 0.277085 Oct 04 22:00:23.646391 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1835/3617] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:00:23 2022] GET /compute/v2.1/servers/2d3d1574-f1b5-46a9-a3b7-205a905a90f1 => generated 1275 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:00:23.774136 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-ddfbed46-da69-4ca9-80ee-1699cad01865 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:23.775421 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-ddfbed46-da69-4ca9-80ee-1699cad01865 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] [instance: df147c22-6a7f-4081-83e7-97620b23700c] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:23.787443 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ddfbed46-da69-4ca9-80ee-1699cad01865 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:23.789057 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ddfbed46-da69-4ca9-80ee-1699cad01865 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:23.792069 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ddfbed46-da69-4ca9-80ee-1699cad01865 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:23.795454 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ddfbed46-da69-4ca9-80ee-1699cad01865 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:23.796196 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ddfbed46-da69-4ca9-80ee-1699cad01865 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:23.796646 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ddfbed46-da69-4ca9-80ee-1699cad01865 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:24.131961 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-3a8eafa2-71e8-4365-9290-049959ebe72d tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:24.132937 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-3a8eafa2-71e8-4365-9290-049959ebe72d tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: a4cf4fac-1e9b-4669-a6ff-30008ed3642d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:24.154791 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3a8eafa2-71e8-4365-9290-049959ebe72d tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:24.157040 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3a8eafa2-71e8-4365-9290-049959ebe72d tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:24.158834 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3a8eafa2-71e8-4365-9290-049959ebe72d tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:24.159917 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3a8eafa2-71e8-4365-9290-049959ebe72d tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:24.163481 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3a8eafa2-71e8-4365-9290-049959ebe72d tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:24.164995 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3a8eafa2-71e8-4365-9290-049959ebe72d tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:24.556819 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-ddfbed46-da69-4ca9-80ee-1699cad01865 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2034fc9060874868bc5d27370a1c351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89499d833a4a00805164f4f79ed522', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:24.574682 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-ddfbed46-da69-4ca9-80ee-1699cad01865 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] 10.222.0.43 "GET /compute/v2.1/servers/df147c22-6a7f-4081-83e7-97620b23700c" status: 200 len: 1514 microversion: 2.1 time: 0.804297 Oct 04 22:00:24.577459 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1783/3618] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:00:23 2022] GET /compute/v2.1/servers/df147c22-6a7f-4081-83e7-97620b23700c => generated 1514 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:00:24.595099 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-3b0bd2af-cdd5-442e-b269-281108d51a6a tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:24.596499 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-3b0bd2af-cdd5-442e-b269-281108d51a6a tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] [instance: 4c17a63b-8492-4c9b-a0c2-34bef7051f80] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:24.609774 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3b0bd2af-cdd5-442e-b269-281108d51a6a tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:24.612012 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3b0bd2af-cdd5-442e-b269-281108d51a6a tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:24.613200 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3b0bd2af-cdd5-442e-b269-281108d51a6a tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:24.615360 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3b0bd2af-cdd5-442e-b269-281108d51a6a tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:24.617967 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3b0bd2af-cdd5-442e-b269-281108d51a6a tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:24.618967 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3b0bd2af-cdd5-442e-b269-281108d51a6a tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:24.848041 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-3b0bd2af-cdd5-442e-b269-281108d51a6a tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c7a1e7d6984644a68d967b5e3fe92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3994b89cac594e309926f1eaf785f7d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:24.867254 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-3b0bd2af-cdd5-442e-b269-281108d51a6a tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] 10.222.0.43 "GET /compute/v2.1/servers/4c17a63b-8492-4c9b-a0c2-34bef7051f80" status: 200 len: 1251 microversion: 2.1 time: 0.286959 Oct 04 22:00:24.870760 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1784/3619] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:00:24 2022] GET /compute/v2.1/servers/4c17a63b-8492-4c9b-a0c2-34bef7051f80 => generated 1251 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:00:24.887965 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-ea7693bd-3369-42d9-b082-c63fbe36af12 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:24.889224 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-ea7693bd-3369-42d9-b082-c63fbe36af12 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] [instance: d0b1b757-4a4d-4a7a-9a06-08f178a02984] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:24.907604 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ea7693bd-3369-42d9-b082-c63fbe36af12 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:24.910287 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ea7693bd-3369-42d9-b082-c63fbe36af12 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:24.911497 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ea7693bd-3369-42d9-b082-c63fbe36af12 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:24.913842 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ea7693bd-3369-42d9-b082-c63fbe36af12 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:24.914553 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ea7693bd-3369-42d9-b082-c63fbe36af12 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:24.916417 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ea7693bd-3369-42d9-b082-c63fbe36af12 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:25.009923 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-3a8eafa2-71e8-4365-9290-049959ebe72d tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2facee4c6a40416e908083e126d2cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07a17a482a4e92b6ddbdee463c8029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:25.026872 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-3a8eafa2-71e8-4365-9290-049959ebe72d tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d" status: 200 len: 1526 microversion: 2.1 time: 0.902192 Oct 04 22:00:25.042488 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1836/3620] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:00:24 2022] GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d => generated 1526 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:00:25.048356 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-5f2989b4-2afc-40a8-9141-ccec5ec8f410 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:25.052481 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-5f2989b4-2afc-40a8-9141-ccec5ec8f410 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] [instance: 2d3d1574-f1b5-46a9-a3b7-205a905a90f1] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:25.081037 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5f2989b4-2afc-40a8-9141-ccec5ec8f410 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:25.083000 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5f2989b4-2afc-40a8-9141-ccec5ec8f410 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:25.099762 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5f2989b4-2afc-40a8-9141-ccec5ec8f410 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:25.102780 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5f2989b4-2afc-40a8-9141-ccec5ec8f410 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:25.103522 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5f2989b4-2afc-40a8-9141-ccec5ec8f410 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:25.107429 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5f2989b4-2afc-40a8-9141-ccec5ec8f410 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:25.340114 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell0:SELECT=2 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:00:25.724666 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell0:SELECT=2 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:00:26.385635 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-ea7693bd-3369-42d9-b082-c63fbe36af12 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:26.399739 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-ea7693bd-3369-42d9-b082-c63fbe36af12 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:26.409801 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-ea7693bd-3369-42d9-b082-c63fbe36af12 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:26.426151 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-ea7693bd-3369-42d9-b082-c63fbe36af12 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] 10.222.0.43 "GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984" status: 200 len: 1537 microversion: 2.91 time: 1.547035 Oct 04 22:00:26.430433 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1785/3621] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:00:24 2022] GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984 => generated 1537 bytes in 1558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:00:26.446465 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-faa1517d-cdb4-4eb3-8bff-915f056ec7aa tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:26.449203 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-faa1517d-cdb4-4eb3-8bff-915f056ec7aa tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] [instance: df147c22-6a7f-4081-83e7-97620b23700c] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:26.466348 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-faa1517d-cdb4-4eb3-8bff-915f056ec7aa tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:26.467186 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-faa1517d-cdb4-4eb3-8bff-915f056ec7aa tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:26.467846 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-faa1517d-cdb4-4eb3-8bff-915f056ec7aa tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:26.469673 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-faa1517d-cdb4-4eb3-8bff-915f056ec7aa tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:26.471045 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-faa1517d-cdb4-4eb3-8bff-915f056ec7aa tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:26.472584 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-faa1517d-cdb4-4eb3-8bff-915f056ec7aa tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:27.076879 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-faa1517d-cdb4-4eb3-8bff-915f056ec7aa tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2034fc9060874868bc5d27370a1c351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89499d833a4a00805164f4f79ed522', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:27.089551 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-faa1517d-cdb4-4eb3-8bff-915f056ec7aa tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] 10.222.0.43 "GET /compute/v2.1/servers/df147c22-6a7f-4081-83e7-97620b23700c" status: 200 len: 1514 microversion: 2.1 time: 0.657599 Oct 04 22:00:27.111579 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1786/3622] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:00:26 2022] GET /compute/v2.1/servers/df147c22-6a7f-4081-83e7-97620b23700c => generated 1514 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:00:27.120894 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-238d1249-f688-4a56-aeb7-a8b0dca889c0 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:27.120894 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-238d1249-f688-4a56-aeb7-a8b0dca889c0 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] [instance: 4c17a63b-8492-4c9b-a0c2-34bef7051f80] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:27.146080 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-238d1249-f688-4a56-aeb7-a8b0dca889c0 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:27.146629 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-238d1249-f688-4a56-aeb7-a8b0dca889c0 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:27.147080 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-238d1249-f688-4a56-aeb7-a8b0dca889c0 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:27.147819 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-238d1249-f688-4a56-aeb7-a8b0dca889c0 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:27.148280 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-238d1249-f688-4a56-aeb7-a8b0dca889c0 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:27.148708 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-238d1249-f688-4a56-aeb7-a8b0dca889c0 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:27.204076 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-5f2989b4-2afc-40a8-9141-ccec5ec8f410 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd474da1382674cada32763825c7840f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cad63eb782c43b19d642fa6adaffd71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:27.212593 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-5f2989b4-2afc-40a8-9141-ccec5ec8f410 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] 10.222.0.43 "GET /compute/v2.1/servers/2d3d1574-f1b5-46a9-a3b7-205a905a90f1" status: 200 len: 1315 microversion: 2.1 time: 2.179200 Oct 04 22:00:27.213315 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1837/3623] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:00:25 2022] GET /compute/v2.1/servers/2d3d1574-f1b5-46a9-a3b7-205a905a90f1 => generated 1315 bytes in 2185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:00:27.239382 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-39a89198-2122-42f9-a99a-e418a7ded39f tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:27.240012 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-39a89198-2122-42f9-a99a-e418a7ded39f tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: a4cf4fac-1e9b-4669-a6ff-30008ed3642d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:27.281244 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-39a89198-2122-42f9-a99a-e418a7ded39f tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:27.282956 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-39a89198-2122-42f9-a99a-e418a7ded39f tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:27.283755 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-39a89198-2122-42f9-a99a-e418a7ded39f tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:27.290476 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-39a89198-2122-42f9-a99a-e418a7ded39f tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:27.291459 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-39a89198-2122-42f9-a99a-e418a7ded39f tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:27.292081 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-39a89198-2122-42f9-a99a-e418a7ded39f tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:27.471023 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-238d1249-f688-4a56-aeb7-a8b0dca889c0 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c7a1e7d6984644a68d967b5e3fe92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3994b89cac594e309926f1eaf785f7d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:27.479659 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-238d1249-f688-4a56-aeb7-a8b0dca889c0 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] 10.222.0.43 "GET /compute/v2.1/servers/4c17a63b-8492-4c9b-a0c2-34bef7051f80" status: 200 len: 1251 microversion: 2.1 time: 0.382098 Oct 04 22:00:27.480249 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1787/3624] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:00:27 2022] GET /compute/v2.1/servers/4c17a63b-8492-4c9b-a0c2-34bef7051f80 => generated 1251 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:00:27.504702 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-d6a62960-eaf9-400f-ad9d-b3cad4b09c1f tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:27.505328 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-d6a62960-eaf9-400f-ad9d-b3cad4b09c1f tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] [instance: d0b1b757-4a4d-4a7a-9a06-08f178a02984] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:27.521687 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d6a62960-eaf9-400f-ad9d-b3cad4b09c1f tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:27.530510 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d6a62960-eaf9-400f-ad9d-b3cad4b09c1f tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:27.533872 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d6a62960-eaf9-400f-ad9d-b3cad4b09c1f tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:27.534872 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d6a62960-eaf9-400f-ad9d-b3cad4b09c1f tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:27.537842 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d6a62960-eaf9-400f-ad9d-b3cad4b09c1f tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:27.542649 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d6a62960-eaf9-400f-ad9d-b3cad4b09c1f tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:27.791342 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-d6a62960-eaf9-400f-ad9d-b3cad4b09c1f tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:27.807733 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-d6a62960-eaf9-400f-ad9d-b3cad4b09c1f tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:27.818523 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-d6a62960-eaf9-400f-ad9d-b3cad4b09c1f tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:27.838994 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-d6a62960-eaf9-400f-ad9d-b3cad4b09c1f tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] 10.222.0.43 "GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984" status: 200 len: 1558 microversion: 2.91 time: 0.357657 Oct 04 22:00:27.842745 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1788/3625] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:00:27 2022] GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984 => generated 1558 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:00:27.992964 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-39a89198-2122-42f9-a99a-e418a7ded39f tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2facee4c6a40416e908083e126d2cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07a17a482a4e92b6ddbdee463c8029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:28.010919 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-39a89198-2122-42f9-a99a-e418a7ded39f tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d" status: 200 len: 1526 microversion: 2.1 time: 0.792455 Oct 04 22:00:28.012353 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1838/3626] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:00:27 2022] GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d => generated 1526 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:00:28.138675 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-d8165b72-6408-43af-94dd-34f8b606b5f1 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:28.141208 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-d8165b72-6408-43af-94dd-34f8b606b5f1 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] [instance: df147c22-6a7f-4081-83e7-97620b23700c] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:28.173302 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d8165b72-6408-43af-94dd-34f8b606b5f1 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:28.176266 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d8165b72-6408-43af-94dd-34f8b606b5f1 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:28.176940 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d8165b72-6408-43af-94dd-34f8b606b5f1 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:28.211301 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d8165b72-6408-43af-94dd-34f8b606b5f1 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:28.212208 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d8165b72-6408-43af-94dd-34f8b606b5f1 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:28.214087 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d8165b72-6408-43af-94dd-34f8b606b5f1 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:28.242718 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-1efc4a53-cdfe-432c-9dbf-0adc63baeec6 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:28.245910 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-1efc4a53-cdfe-432c-9dbf-0adc63baeec6 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] [instance: 2d3d1574-f1b5-46a9-a3b7-205a905a90f1] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:28.258219 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1efc4a53-cdfe-432c-9dbf-0adc63baeec6 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:28.261369 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1efc4a53-cdfe-432c-9dbf-0adc63baeec6 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:28.264542 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1efc4a53-cdfe-432c-9dbf-0adc63baeec6 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:28.266065 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1efc4a53-cdfe-432c-9dbf-0adc63baeec6 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:28.267531 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1efc4a53-cdfe-432c-9dbf-0adc63baeec6 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:28.269505 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1efc4a53-cdfe-432c-9dbf-0adc63baeec6 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:29.273460 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-d8165b72-6408-43af-94dd-34f8b606b5f1 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2034fc9060874868bc5d27370a1c351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89499d833a4a00805164f4f79ed522', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:29.283329 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-d8165b72-6408-43af-94dd-34f8b606b5f1 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] 10.222.0.43 "GET /compute/v2.1/servers/df147c22-6a7f-4081-83e7-97620b23700c" status: 200 len: 1514 microversion: 2.1 time: 1.168572 Oct 04 22:00:29.290475 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1789/3627] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:00:28 2022] GET /compute/v2.1/servers/df147c22-6a7f-4081-83e7-97620b23700c => generated 1514 bytes in 1176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:00:29.302464 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-56f04a45-f4f4-4d22-aaba-971f2772edc3 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:29.315348 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-56f04a45-f4f4-4d22-aaba-971f2772edc3 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] [instance: 4c17a63b-8492-4c9b-a0c2-34bef7051f80] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:29.329225 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-56f04a45-f4f4-4d22-aaba-971f2772edc3 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:29.330029 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-56f04a45-f4f4-4d22-aaba-971f2772edc3 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:29.330673 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-56f04a45-f4f4-4d22-aaba-971f2772edc3 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:29.331573 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-56f04a45-f4f4-4d22-aaba-971f2772edc3 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:29.332210 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-56f04a45-f4f4-4d22-aaba-971f2772edc3 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:29.332818 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-56f04a45-f4f4-4d22-aaba-971f2772edc3 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:29.336801 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-1efc4a53-cdfe-432c-9dbf-0adc63baeec6 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd474da1382674cada32763825c7840f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cad63eb782c43b19d642fa6adaffd71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:29.345679 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-1efc4a53-cdfe-432c-9dbf-0adc63baeec6 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] 10.222.0.43 "GET /compute/v2.1/servers/2d3d1574-f1b5-46a9-a3b7-205a905a90f1" status: 200 len: 1315 microversion: 2.1 time: 1.108511 Oct 04 22:00:29.351171 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1839/3628] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:00:28 2022] GET /compute/v2.1/servers/2d3d1574-f1b5-46a9-a3b7-205a905a90f1 => generated 1315 bytes in 1115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:00:29.376672 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-c2032ddf-442f-477d-8c74-62f0b64266fc tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:29.380042 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-c2032ddf-442f-477d-8c74-62f0b64266fc tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] [instance: d0b1b757-4a4d-4a7a-9a06-08f178a02984] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:29.409574 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c2032ddf-442f-477d-8c74-62f0b64266fc tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:29.410090 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c2032ddf-442f-477d-8c74-62f0b64266fc tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:29.410571 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c2032ddf-442f-477d-8c74-62f0b64266fc tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:29.411298 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c2032ddf-442f-477d-8c74-62f0b64266fc tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:29.411765 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c2032ddf-442f-477d-8c74-62f0b64266fc tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:29.412202 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c2032ddf-442f-477d-8c74-62f0b64266fc tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:29.609779 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-c2032ddf-442f-477d-8c74-62f0b64266fc tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:29.619936 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-c2032ddf-442f-477d-8c74-62f0b64266fc tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:29.632284 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-c2032ddf-442f-477d-8c74-62f0b64266fc tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:29.646776 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-56f04a45-f4f4-4d22-aaba-971f2772edc3 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c7a1e7d6984644a68d967b5e3fe92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3994b89cac594e309926f1eaf785f7d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:29.648786 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-c2032ddf-442f-477d-8c74-62f0b64266fc tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] 10.222.0.43 "GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984" status: 200 len: 1558 microversion: 2.91 time: 0.290966 Oct 04 22:00:29.649935 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1840/3629] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:00:29 2022] GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984 => generated 1558 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:00:29.655475 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-ea90248b-409b-40f8-8edc-2f08f531d8b0 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:29.656475 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-ea90248b-409b-40f8-8edc-2f08f531d8b0 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: a4cf4fac-1e9b-4669-a6ff-30008ed3642d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:29.658705 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-56f04a45-f4f4-4d22-aaba-971f2772edc3 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] 10.222.0.43 "GET /compute/v2.1/servers/4c17a63b-8492-4c9b-a0c2-34bef7051f80" status: 200 len: 1251 microversion: 2.1 time: 0.366837 Oct 04 22:00:29.663866 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1790/3630] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:00:29 2022] GET /compute/v2.1/servers/4c17a63b-8492-4c9b-a0c2-34bef7051f80 => generated 1251 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:00:29.681717 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ea90248b-409b-40f8-8edc-2f08f531d8b0 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:29.683336 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ea90248b-409b-40f8-8edc-2f08f531d8b0 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:29.686959 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ea90248b-409b-40f8-8edc-2f08f531d8b0 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:29.689113 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ea90248b-409b-40f8-8edc-2f08f531d8b0 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:29.691536 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ea90248b-409b-40f8-8edc-2f08f531d8b0 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:29.692215 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ea90248b-409b-40f8-8edc-2f08f531d8b0 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:30.092285 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-ea90248b-409b-40f8-8edc-2f08f531d8b0 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2facee4c6a40416e908083e126d2cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07a17a482a4e92b6ddbdee463c8029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:30.104869 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-ea90248b-409b-40f8-8edc-2f08f531d8b0 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d" status: 200 len: 1526 microversion: 2.1 time: 0.453540 Oct 04 22:00:30.121410 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1841/3631] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:00:29 2022] GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d => generated 1526 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:00:30.252346 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-05985735-9b5e-4d7f-982e-7ea54f702922 req-8bb49c26-5c89-42ba-96e1-48945862eb4a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d3d1574-f1b5-46a9-a3b7-205a905a90f1", "tag": "c50abe74-5b16-4f5f-8682-58a99b7b2a0b"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:00:30.282137 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-05985735-9b5e-4d7f-982e-7ea54f702922 req-8bb49c26-5c89-42ba-96e1-48945862eb4a service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:30.282898 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-05985735-9b5e-4d7f-982e-7ea54f702922 req-8bb49c26-5c89-42ba-96e1-48945862eb4a service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:30.284474 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-05985735-9b5e-4d7f-982e-7ea54f702922 req-8bb49c26-5c89-42ba-96e1-48945862eb4a service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:30.300811 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-05985735-9b5e-4d7f-982e-7ea54f702922 req-8bb49c26-5c89-42ba-96e1-48945862eb4a service nova] Creating event network-changed:c50abe74-5b16-4f5f-8682-58a99b7b2a0b for instance 2d3d1574-f1b5-46a9-a3b7-205a905a90f1 on n-h1-860284-1 Oct 04 22:00:30.308658 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-05985735-9b5e-4d7f-982e-7ea54f702922 req-8bb49c26-5c89-42ba-96e1-48945862eb4a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061587 Oct 04 22:00:30.309866 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1791/3632] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:00:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:00:30.318094 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-ba68a0b7-22cc-421c-b563-ae60459171a9 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:30.319000 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-ba68a0b7-22cc-421c-b563-ae60459171a9 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] [instance: df147c22-6a7f-4081-83e7-97620b23700c] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:30.332523 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ba68a0b7-22cc-421c-b563-ae60459171a9 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:30.338246 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ba68a0b7-22cc-421c-b563-ae60459171a9 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:30.341516 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ba68a0b7-22cc-421c-b563-ae60459171a9 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:30.342946 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ba68a0b7-22cc-421c-b563-ae60459171a9 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:30.347086 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ba68a0b7-22cc-421c-b563-ae60459171a9 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:30.348872 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ba68a0b7-22cc-421c-b563-ae60459171a9 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:30.381467 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-7fa8a5b9-bd61-4473-b902-5dd65b2ab71f tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:30.382833 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-7fa8a5b9-bd61-4473-b902-5dd65b2ab71f tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] [instance: 2d3d1574-f1b5-46a9-a3b7-205a905a90f1] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:30.396294 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7fa8a5b9-bd61-4473-b902-5dd65b2ab71f tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:30.400904 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7fa8a5b9-bd61-4473-b902-5dd65b2ab71f tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:30.401897 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7fa8a5b9-bd61-4473-b902-5dd65b2ab71f tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:30.406038 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7fa8a5b9-bd61-4473-b902-5dd65b2ab71f tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:30.407480 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7fa8a5b9-bd61-4473-b902-5dd65b2ab71f tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:30.410668 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7fa8a5b9-bd61-4473-b902-5dd65b2ab71f tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:30.580174 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=4 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:00:30.805308 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-ba68a0b7-22cc-421c-b563-ae60459171a9 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2034fc9060874868bc5d27370a1c351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89499d833a4a00805164f4f79ed522', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:30.814150 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-ba68a0b7-22cc-421c-b563-ae60459171a9 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] 10.222.0.43 "GET /compute/v2.1/servers/df147c22-6a7f-4081-83e7-97620b23700c" status: 200 len: 1514 microversion: 2.1 time: 0.501764 Oct 04 22:00:30.819894 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1842/3633] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:00:30 2022] GET /compute/v2.1/servers/df147c22-6a7f-4081-83e7-97620b23700c => generated 1514 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:00:30.825766 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-e1bde3ca-11bc-4255-80db-76cae795a2a3 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:30.832089 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-e1bde3ca-11bc-4255-80db-76cae795a2a3 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] [instance: d0b1b757-4a4d-4a7a-9a06-08f178a02984] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:30.844294 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-7fa8a5b9-bd61-4473-b902-5dd65b2ab71f tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd474da1382674cada32763825c7840f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cad63eb782c43b19d642fa6adaffd71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:30.853822 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-7fa8a5b9-bd61-4473-b902-5dd65b2ab71f tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] 10.222.0.43 "GET /compute/v2.1/servers/2d3d1574-f1b5-46a9-a3b7-205a905a90f1" status: 200 len: 1315 microversion: 2.1 time: 0.480138 Oct 04 22:00:30.855499 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e1bde3ca-11bc-4255-80db-76cae795a2a3 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:30.858989 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e1bde3ca-11bc-4255-80db-76cae795a2a3 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:30.859905 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1792/3634] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:00:30 2022] GET /compute/v2.1/servers/2d3d1574-f1b5-46a9-a3b7-205a905a90f1 => generated 1315 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:00:30.860582 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e1bde3ca-11bc-4255-80db-76cae795a2a3 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:30.862813 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e1bde3ca-11bc-4255-80db-76cae795a2a3 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:30.865370 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e1bde3ca-11bc-4255-80db-76cae795a2a3 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:30.869146 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-d9df3cf4-49ff-4f87-ad63-23eff98ed5a9 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:30.869884 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e1bde3ca-11bc-4255-80db-76cae795a2a3 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:30.883211 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-d9df3cf4-49ff-4f87-ad63-23eff98ed5a9 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] [instance: 4c17a63b-8492-4c9b-a0c2-34bef7051f80] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:30.923082 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d9df3cf4-49ff-4f87-ad63-23eff98ed5a9 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:30.923871 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d9df3cf4-49ff-4f87-ad63-23eff98ed5a9 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:30.924491 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d9df3cf4-49ff-4f87-ad63-23eff98ed5a9 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:30.928021 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d9df3cf4-49ff-4f87-ad63-23eff98ed5a9 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:30.928707 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d9df3cf4-49ff-4f87-ad63-23eff98ed5a9 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:30.929356 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d9df3cf4-49ff-4f87-ad63-23eff98ed5a9 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:31.105863 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=8 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:00:31.241327 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-e1bde3ca-11bc-4255-80db-76cae795a2a3 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:31.251270 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-e1bde3ca-11bc-4255-80db-76cae795a2a3 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:31.256366 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-e1bde3ca-11bc-4255-80db-76cae795a2a3 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:31.270481 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-e1bde3ca-11bc-4255-80db-76cae795a2a3 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] 10.222.0.43 "GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984" status: 200 len: 1558 microversion: 2.91 time: 0.449091 Oct 04 22:00:31.273751 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1843/3635] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:00:30 2022] GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984 => generated 1558 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:00:31.284648 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-21d3eb12-ca4d-4b3d-ba72-77c17610ac87 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:31.285286 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-21d3eb12-ca4d-4b3d-ba72-77c17610ac87 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: a4cf4fac-1e9b-4669-a6ff-30008ed3642d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:31.305886 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-21d3eb12-ca4d-4b3d-ba72-77c17610ac87 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:31.308731 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-21d3eb12-ca4d-4b3d-ba72-77c17610ac87 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:31.309638 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-21d3eb12-ca4d-4b3d-ba72-77c17610ac87 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:31.310666 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-21d3eb12-ca4d-4b3d-ba72-77c17610ac87 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:31.315330 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-d9df3cf4-49ff-4f87-ad63-23eff98ed5a9 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c7a1e7d6984644a68d967b5e3fe92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3994b89cac594e309926f1eaf785f7d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:31.328298 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-21d3eb12-ca4d-4b3d-ba72-77c17610ac87 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:31.335080 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-21d3eb12-ca4d-4b3d-ba72-77c17610ac87 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:31.347263 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-d9df3cf4-49ff-4f87-ad63-23eff98ed5a9 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] 10.222.0.43 "GET /compute/v2.1/servers/4c17a63b-8492-4c9b-a0c2-34bef7051f80" status: 200 len: 1251 microversion: 2.1 time: 0.485325 Oct 04 22:00:31.347884 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1793/3636] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:00:30 2022] GET /compute/v2.1/servers/4c17a63b-8492-4c9b-a0c2-34bef7051f80 => generated 1251 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:00:31.710766 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-21d3eb12-ca4d-4b3d-ba72-77c17610ac87 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2facee4c6a40416e908083e126d2cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07a17a482a4e92b6ddbdee463c8029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:31.721009 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-21d3eb12-ca4d-4b3d-ba72-77c17610ac87 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d" status: 200 len: 1526 microversion: 2.1 time: 0.446107 Oct 04 22:00:31.725483 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1844/3637] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:00:31 2022] GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d => generated 1526 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:00:31.850526 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-52206a39-5341-4823-b1d2-c9ffd614bc0c tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:31.851254 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-52206a39-5341-4823-b1d2-c9ffd614bc0c tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] [instance: df147c22-6a7f-4081-83e7-97620b23700c] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:31.860417 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-52206a39-5341-4823-b1d2-c9ffd614bc0c tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:31.862724 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-52206a39-5341-4823-b1d2-c9ffd614bc0c tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:31.863821 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-52206a39-5341-4823-b1d2-c9ffd614bc0c tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:31.864730 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-52206a39-5341-4823-b1d2-c9ffd614bc0c tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:31.865848 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-52206a39-5341-4823-b1d2-c9ffd614bc0c tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:31.866501 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-52206a39-5341-4823-b1d2-c9ffd614bc0c tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:31.886764 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-0f1b2cbd-8212-4eb8-9880-98550bc7ce12 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:31.887443 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-0f1b2cbd-8212-4eb8-9880-98550bc7ce12 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] [instance: 2d3d1574-f1b5-46a9-a3b7-205a905a90f1] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:31.895547 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0f1b2cbd-8212-4eb8-9880-98550bc7ce12 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:31.898481 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0f1b2cbd-8212-4eb8-9880-98550bc7ce12 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:31.902322 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0f1b2cbd-8212-4eb8-9880-98550bc7ce12 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:31.903810 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0f1b2cbd-8212-4eb8-9880-98550bc7ce12 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:31.904532 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0f1b2cbd-8212-4eb8-9880-98550bc7ce12 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:31.906118 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0f1b2cbd-8212-4eb8-9880-98550bc7ce12 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:32.296583 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-52206a39-5341-4823-b1d2-c9ffd614bc0c tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2034fc9060874868bc5d27370a1c351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89499d833a4a00805164f4f79ed522', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:32.314943 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-52206a39-5341-4823-b1d2-c9ffd614bc0c tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] 10.222.0.43 "GET /compute/v2.1/servers/df147c22-6a7f-4081-83e7-97620b23700c" status: 200 len: 1514 microversion: 2.1 time: 0.468258 Oct 04 22:00:32.322990 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-0f1b2cbd-8212-4eb8-9880-98550bc7ce12 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd474da1382674cada32763825c7840f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cad63eb782c43b19d642fa6adaffd71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:32.331706 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1794/3638] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:00:31 2022] GET /compute/v2.1/servers/df147c22-6a7f-4081-83e7-97620b23700c => generated 1514 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:00:32.342470 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-26811ca1-fe04-456c-9d66-3410631690a8 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:32.343765 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-0f1b2cbd-8212-4eb8-9880-98550bc7ce12 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] 10.222.0.43 "GET /compute/v2.1/servers/2d3d1574-f1b5-46a9-a3b7-205a905a90f1" status: 200 len: 1315 microversion: 2.1 time: 0.456311 Oct 04 22:00:32.344605 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1845/3639] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:00:31 2022] GET /compute/v2.1/servers/2d3d1574-f1b5-46a9-a3b7-205a905a90f1 => generated 1315 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:00:32.350181 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-26811ca1-fe04-456c-9d66-3410631690a8 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] [instance: d0b1b757-4a4d-4a7a-9a06-08f178a02984] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:32.373054 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-36b669a2-b331-4d50-a8d0-0217f0b5a593 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:32.373907 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-36b669a2-b331-4d50-a8d0-0217f0b5a593 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] [instance: 4c17a63b-8492-4c9b-a0c2-34bef7051f80] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:32.374864 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-26811ca1-fe04-456c-9d66-3410631690a8 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:32.375955 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-26811ca1-fe04-456c-9d66-3410631690a8 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:32.381624 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-26811ca1-fe04-456c-9d66-3410631690a8 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:32.383071 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-26811ca1-fe04-456c-9d66-3410631690a8 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:32.384063 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-26811ca1-fe04-456c-9d66-3410631690a8 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:32.384963 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-26811ca1-fe04-456c-9d66-3410631690a8 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:32.402216 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-36b669a2-b331-4d50-a8d0-0217f0b5a593 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:32.405096 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-36b669a2-b331-4d50-a8d0-0217f0b5a593 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:32.407267 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-36b669a2-b331-4d50-a8d0-0217f0b5a593 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:32.408265 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-36b669a2-b331-4d50-a8d0-0217f0b5a593 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:32.410518 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-36b669a2-b331-4d50-a8d0-0217f0b5a593 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:32.412428 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-36b669a2-b331-4d50-a8d0-0217f0b5a593 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:32.627454 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-26811ca1-fe04-456c-9d66-3410631690a8 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:32.639027 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-36b669a2-b331-4d50-a8d0-0217f0b5a593 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c7a1e7d6984644a68d967b5e3fe92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3994b89cac594e309926f1eaf785f7d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:32.655883 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-36b669a2-b331-4d50-a8d0-0217f0b5a593 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] 10.222.0.43 "GET /compute/v2.1/servers/4c17a63b-8492-4c9b-a0c2-34bef7051f80" status: 200 len: 1251 microversion: 2.1 time: 0.288335 Oct 04 22:00:32.657964 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1846/3640] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:00:32 2022] GET /compute/v2.1/servers/4c17a63b-8492-4c9b-a0c2-34bef7051f80 => generated 1251 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:00:32.672210 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-26811ca1-fe04-456c-9d66-3410631690a8 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:32.673707 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-26811ca1-fe04-456c-9d66-3410631690a8 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:32.685467 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-26811ca1-fe04-456c-9d66-3410631690a8 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] 10.222.0.43 "GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984" status: 200 len: 1558 microversion: 2.91 time: 0.350322 Oct 04 22:00:32.686070 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1795/3641] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:00:32 2022] GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984 => generated 1558 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:00:32.752048 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-2f1553c8-25a2-4a73-8964-41ba481bb849 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:32.752962 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-2f1553c8-25a2-4a73-8964-41ba481bb849 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: a4cf4fac-1e9b-4669-a6ff-30008ed3642d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:32.765453 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2f1553c8-25a2-4a73-8964-41ba481bb849 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:32.766882 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2f1553c8-25a2-4a73-8964-41ba481bb849 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:32.767630 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2f1553c8-25a2-4a73-8964-41ba481bb849 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:32.772960 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2f1553c8-25a2-4a73-8964-41ba481bb849 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:32.773762 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2f1553c8-25a2-4a73-8964-41ba481bb849 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:32.774318 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2f1553c8-25a2-4a73-8964-41ba481bb849 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:33.048635 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-2f1553c8-25a2-4a73-8964-41ba481bb849 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2facee4c6a40416e908083e126d2cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07a17a482a4e92b6ddbdee463c8029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:33.059319 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-2f1553c8-25a2-4a73-8964-41ba481bb849 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d" status: 200 len: 1526 microversion: 2.1 time: 0.314704 Oct 04 22:00:33.060182 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1847/3642] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:00:32 2022] GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d => generated 1526 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:00:33.144713 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-f2d0fd4d-d297-44e5-9417-93a9c47c4667 tempest-KeyPairsV22TestJSON-1727730123 tempest-KeyPairsV22TestJSON-1727730123-project] Action: 'create', calling method: .version_select at 0x7fbb3739e670>, body: {"keypair": {"name": "tempest-keypair-1527272714", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBILE1kcKXLzCNK15cWMvH5VWLhrB5yncj/A8RV7qt9oAOmrC2WuUYhgdUjpPwoAu8EYun7oN1zyoTOHveVDkGgG6fqtIukYkzfYwQl0ALDXgF24T36rJxA6rUxYcNYBphg=="}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:00:33.165342 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-f2d0fd4d-d297-44e5-9417-93a9c47c4667 tempest-KeyPairsV22TestJSON-1727730123 tempest-KeyPairsV22TestJSON-1727730123-project] Getting quotas for project 09000cbdab6f4630a7e105de30d9bddf. Resources: {'key_pairs'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:00:33.172915 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-f2d0fd4d-d297-44e5-9417-93a9c47c4667 tempest-KeyPairsV22TestJSON-1727730123 tempest-KeyPairsV22TestJSON-1727730123-project] Getting quotas for user a8b6bea86114470c92d6bc7d8bba513a and project 09000cbdab6f4630a7e105de30d9bddf. Resources: {'key_pairs'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:00:33.210301 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-f2d0fd4d-d297-44e5-9417-93a9c47c4667 tempest-KeyPairsV22TestJSON-1727730123 tempest-KeyPairsV22TestJSON-1727730123-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.343663 Oct 04 22:00:33.211222 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1796/3643] 10.222.0.43 () {62 vars in 1199 bytes} [Tue Oct 4 22:00:32 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 345 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Oct 04 22:00:33.229813 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-47dc8943-9adf-4308-a9ff-564440bee7a2 tempest-KeyPairsV22TestJSON-1727730123 tempest-KeyPairsV22TestJSON-1727730123-project] Calling method '.version_select at 0x7fbb2f053820>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:33.242355 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-47dc8943-9adf-4308-a9ff-564440bee7a2 tempest-KeyPairsV22TestJSON-1727730123 tempest-KeyPairsV22TestJSON-1727730123-project] 10.222.0.43 "GET /compute/v2.1/os-keypairs/tempest-keypair-1527272714" status: 200 len: 513 microversion: 2.2 time: 0.022069 Oct 04 22:00:33.243346 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1848/3644] 10.222.0.43 () {60 vars in 1258 bytes} [Tue Oct 4 22:00:33 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1527272714 => generated 513 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:00:33.259820 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-b8ed216b-9e29-4650-9567-96109732511e tempest-KeyPairsV22TestJSON-1727730123 tempest-KeyPairsV22TestJSON-1727730123-project] Calling method '.version_select at 0x7fbb2e7ee280>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:33.290687 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-b8ed216b-9e29-4650-9567-96109732511e tempest-KeyPairsV22TestJSON-1727730123 tempest-KeyPairsV22TestJSON-1727730123-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1527272714" status: 204 len: 0 microversion: 2.2 time: 0.038484 Oct 04 22:00:33.291280 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1797/3645] 10.222.0.43 () {60 vars in 1261 bytes} [Tue Oct 4 22:00:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1527272714 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 22:00:33.305773 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-63aa10b7-0857-40b5-bca8-6e554f0008fe tempest-KeyPairsV22TestJSON-1727730123 tempest-KeyPairsV22TestJSON-1727730123-project] Action: 'create', calling method: .version_select at 0x7fbb2efd2940>, body: {"keypair": {"name": "tempest-keypair-942308278", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJnF89Msi6kbPe1wAAuIpXQpXejz/rofesS2YFzdqt+XJ9ZM6q5ZB1fJtddj1tveNGFkEc97OKYRYdLHV0H0A4/1DdvBpDU2zDG+B3WDBgLGFsppWpBJUNDFuUFsZxXBNQ=="}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:00:33.332456 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-63aa10b7-0857-40b5-bca8-6e554f0008fe tempest-KeyPairsV22TestJSON-1727730123 tempest-KeyPairsV22TestJSON-1727730123-project] Getting quotas for project 09000cbdab6f4630a7e105de30d9bddf. Resources: {'key_pairs'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:00:33.344408 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-63aa10b7-0857-40b5-bca8-6e554f0008fe tempest-KeyPairsV22TestJSON-1727730123 tempest-KeyPairsV22TestJSON-1727730123-project] Getting quotas for user a8b6bea86114470c92d6bc7d8bba513a and project 09000cbdab6f4630a7e105de30d9bddf. Resources: {'key_pairs'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:00:33.352308 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-bf4d3c1d-92c3-46a3-812f-0a2af29183b5 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:33.352934 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-bf4d3c1d-92c3-46a3-812f-0a2af29183b5 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] [instance: df147c22-6a7f-4081-83e7-97620b23700c] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:33.360367 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bf4d3c1d-92c3-46a3-812f-0a2af29183b5 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:33.360634 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bf4d3c1d-92c3-46a3-812f-0a2af29183b5 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:33.360980 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bf4d3c1d-92c3-46a3-812f-0a2af29183b5 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:33.361694 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bf4d3c1d-92c3-46a3-812f-0a2af29183b5 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:33.362154 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bf4d3c1d-92c3-46a3-812f-0a2af29183b5 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:33.371809 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bf4d3c1d-92c3-46a3-812f-0a2af29183b5 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:33.379158 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-63aa10b7-0857-40b5-bca8-6e554f0008fe tempest-KeyPairsV22TestJSON-1727730123 tempest-KeyPairsV22TestJSON-1727730123-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.079077 Oct 04 22:00:33.380529 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1849/3646] 10.222.0.43 () {62 vars in 1199 bytes} [Tue Oct 4 22:00:33 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 81 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 04 22:00:33.387528 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-65c35df1-6a66-4900-8fba-360f2fede352 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:33.388355 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-65c35df1-6a66-4900-8fba-360f2fede352 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] [instance: 2d3d1574-f1b5-46a9-a3b7-205a905a90f1] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:33.397549 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-65c35df1-6a66-4900-8fba-360f2fede352 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:33.398274 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-65c35df1-6a66-4900-8fba-360f2fede352 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:33.398827 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-65c35df1-6a66-4900-8fba-360f2fede352 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:33.399658 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-65c35df1-6a66-4900-8fba-360f2fede352 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:33.400209 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-65c35df1-6a66-4900-8fba-360f2fede352 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:33.401220 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-65c35df1-6a66-4900-8fba-360f2fede352 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:33.617328 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-bf4d3c1d-92c3-46a3-812f-0a2af29183b5 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2034fc9060874868bc5d27370a1c351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89499d833a4a00805164f4f79ed522', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:33.630719 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-bf4d3c1d-92c3-46a3-812f-0a2af29183b5 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] 10.222.0.43 "GET /compute/v2.1/servers/df147c22-6a7f-4081-83e7-97620b23700c" status: 200 len: 1514 microversion: 2.1 time: 0.282307 Oct 04 22:00:33.646894 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1798/3647] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:00:33 2022] GET /compute/v2.1/servers/df147c22-6a7f-4081-83e7-97620b23700c => generated 1514 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:00:33.653950 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-6e57d73f-e623-459e-b874-ffa27d376cbd tempest-KeyPairsV22TestJSON-1727730123 tempest-KeyPairsV22TestJSON-1727730123-project] Calling method '.version_select at 0x7fbb3739e310>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:33.681944 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-65c35df1-6a66-4900-8fba-360f2fede352 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd474da1382674cada32763825c7840f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cad63eb782c43b19d642fa6adaffd71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:33.686056 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-6e57d73f-e623-459e-b874-ffa27d376cbd tempest-KeyPairsV22TestJSON-1727730123 tempest-KeyPairsV22TestJSON-1727730123-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-942308278" status: 204 len: 0 microversion: 2.2 time: 0.037422 Oct 04 22:00:33.687869 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=100 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:00:33.688173 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1799/3648] 10.222.0.43 () {60 vars in 1258 bytes} [Tue Oct 4 22:00:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-942308278 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 22:00:33.693383 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-7a63c176-bf6f-4632-976f-2f82703009da tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:33.697998 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-7a63c176-bf6f-4632-976f-2f82703009da tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] [instance: 4c17a63b-8492-4c9b-a0c2-34bef7051f80] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:33.709416 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7a63c176-bf6f-4632-976f-2f82703009da tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:33.710059 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-65c35df1-6a66-4900-8fba-360f2fede352 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] 10.222.0.43 "GET /compute/v2.1/servers/2d3d1574-f1b5-46a9-a3b7-205a905a90f1" status: 200 len: 1315 microversion: 2.1 time: 0.323223 Oct 04 22:00:33.710636 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7a63c176-bf6f-4632-976f-2f82703009da tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:33.711258 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1850/3649] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:00:33 2022] GET /compute/v2.1/servers/2d3d1574-f1b5-46a9-a3b7-205a905a90f1 => generated 1315 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:00:33.719649 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7a63c176-bf6f-4632-976f-2f82703009da tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:33.721105 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-4fe9050d-7f84-46f2-a9fe-543eecfd75e0 tempest-KeyPairsV22TestJSON-1727730123 tempest-KeyPairsV22TestJSON-1727730123-project] Action: 'create', calling method: .version_select at 0x7fbb2f6bdf70>, body: {"keypair": {"name": "tempest-keypair-1646968532", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:00:33.724202 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7a63c176-bf6f-4632-976f-2f82703009da tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:33.725003 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7a63c176-bf6f-4632-976f-2f82703009da tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:33.728144 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7a63c176-bf6f-4632-976f-2f82703009da tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:33.744773 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-4fe9050d-7f84-46f2-a9fe-543eecfd75e0 tempest-KeyPairsV22TestJSON-1727730123 tempest-KeyPairsV22TestJSON-1727730123-project] Getting quotas for project 09000cbdab6f4630a7e105de30d9bddf. Resources: {'key_pairs'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:00:33.752126 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-4fe9050d-7f84-46f2-a9fe-543eecfd75e0 tempest-KeyPairsV22TestJSON-1727730123 tempest-KeyPairsV22TestJSON-1727730123-project] Getting quotas for user a8b6bea86114470c92d6bc7d8bba513a and project 09000cbdab6f4630a7e105de30d9bddf. Resources: {'key_pairs'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:00:33.798438 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-4fe9050d-7f84-46f2-a9fe-543eecfd75e0 tempest-KeyPairsV22TestJSON-1727730123 tempest-KeyPairsV22TestJSON-1727730123-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 201 len: 589 microversion: 2.2 time: 0.085555 Oct 04 22:00:33.800825 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1851/3650] 10.222.0.43 () {62 vars in 1199 bytes} [Tue Oct 4 22:00:33 2022] POST /compute/v2.1/os-keypairs => generated 589 bytes in 89 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 04 22:00:33.811544 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-1b4d5f69-d3ca-4224-ba30-06215874dd79 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:33.812325 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-1b4d5f69-d3ca-4224-ba30-06215874dd79 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] [instance: d0b1b757-4a4d-4a7a-9a06-08f178a02984] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:33.819672 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1b4d5f69-d3ca-4224-ba30-06215874dd79 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:33.821258 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1b4d5f69-d3ca-4224-ba30-06215874dd79 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:33.821725 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1b4d5f69-d3ca-4224-ba30-06215874dd79 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:33.823237 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1b4d5f69-d3ca-4224-ba30-06215874dd79 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:33.824075 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1b4d5f69-d3ca-4224-ba30-06215874dd79 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:33.824635 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1b4d5f69-d3ca-4224-ba30-06215874dd79 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:33.825944 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7a63c176-bf6f-4632-976f-2f82703009da tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:33.826677 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7a63c176-bf6f-4632-976f-2f82703009da tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:33.827327 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7a63c176-bf6f-4632-976f-2f82703009da tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:33.827972 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.objects.instance [None req-7a63c176-bf6f-4632-976f-2f82703009da tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Lazy-loading 'fault' on Instance uuid 4c17a63b-8492-4c9b-a0c2-34bef7051f80 {{(pid=134101) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 22:00:33.890172 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-7a63c176-bf6f-4632-976f-2f82703009da tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c7a1e7d6984644a68d967b5e3fe92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3994b89cac594e309926f1eaf785f7d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:33.898954 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-7a63c176-bf6f-4632-976f-2f82703009da tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] 10.222.0.43 "GET /compute/v2.1/servers/4c17a63b-8492-4c9b-a0c2-34bef7051f80" status: 200 len: 1256 microversion: 2.1 time: 0.209417 Oct 04 22:00:33.902749 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1800/3651] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:00:33 2022] GET /compute/v2.1/servers/4c17a63b-8492-4c9b-a0c2-34bef7051f80 => generated 1256 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:00:33.915953 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-fbfd87f5-7165-44c0-bc90-36fb792218f3 tempest-KeyPairsV22TestJSON-1727730123 tempest-KeyPairsV22TestJSON-1727730123-project] Calling method '.version_select at 0x7fbb372cf700>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:33.971091 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-fbfd87f5-7165-44c0-bc90-36fb792218f3 tempest-KeyPairsV22TestJSON-1727730123 tempest-KeyPairsV22TestJSON-1727730123-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1646968532" status: 204 len: 0 microversion: 2.2 time: 0.066422 Oct 04 22:00:33.972930 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1801/3652] 10.222.0.43 () {60 vars in 1261 bytes} [Tue Oct 4 22:00:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1646968532 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 22:00:33.973716 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-1b4d5f69-d3ca-4224-ba30-06215874dd79 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:33.997048 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-2ef11957-bc15-4f06-87fd-24633357bcf4 tempest-KeyPairsV22TestJSON-1727730123 tempest-KeyPairsV22TestJSON-1727730123-project] Action: 'create', calling method: .version_select at 0x7fbb2e7eeaf0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-2138097092", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCAnolzxNLZCfztB449jTpdIjw20oiSd1Ymx2Ixjlwuo+THDHOU8bg9rbPrHfrJIyTbMpvgOoIJXkucD8tbLtuh9xkYjgnPmbcpHECSyE9bNyD2q9Bqh9uOy4VA4VJhSVg=="}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:00:33.998605 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-1b4d5f69-d3ca-4224-ba30-06215874dd79 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:34.000315 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-1b4d5f69-d3ca-4224-ba30-06215874dd79 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:34.007081 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-1b4d5f69-d3ca-4224-ba30-06215874dd79 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] 10.222.0.43 "GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984" status: 200 len: 1558 microversion: 2.91 time: 0.203840 Oct 04 22:00:34.009321 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1852/3653] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:00:33 2022] GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984 => generated 1558 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:00:34.060744 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-2ef11957-bc15-4f06-87fd-24633357bcf4 tempest-KeyPairsV22TestJSON-1727730123 tempest-KeyPairsV22TestJSON-1727730123-project] Getting quotas for project 09000cbdab6f4630a7e105de30d9bddf. Resources: {'key_pairs'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:00:34.076978 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-2ef11957-bc15-4f06-87fd-24633357bcf4 tempest-KeyPairsV22TestJSON-1727730123 tempest-KeyPairsV22TestJSON-1727730123-project] Getting quotas for user a8b6bea86114470c92d6bc7d8bba513a and project 09000cbdab6f4630a7e105de30d9bddf. Resources: {'key_pairs'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:00:34.092409 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-4d55fa30-2ee5-403f-87bb-c5d7ac8d189e tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:34.093104 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-4d55fa30-2ee5-403f-87bb-c5d7ac8d189e tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: a4cf4fac-1e9b-4669-a6ff-30008ed3642d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:34.104294 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4d55fa30-2ee5-403f-87bb-c5d7ac8d189e tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:34.107622 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4d55fa30-2ee5-403f-87bb-c5d7ac8d189e tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:34.109757 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4d55fa30-2ee5-403f-87bb-c5d7ac8d189e tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:34.111416 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4d55fa30-2ee5-403f-87bb-c5d7ac8d189e tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:34.112524 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4d55fa30-2ee5-403f-87bb-c5d7ac8d189e tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:34.130591 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4d55fa30-2ee5-403f-87bb-c5d7ac8d189e tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:34.170728 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-2ef11957-bc15-4f06-87fd-24633357bcf4 tempest-KeyPairsV22TestJSON-1727730123 tempest-KeyPairsV22TestJSON-1727730123-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.189878 Oct 04 22:00:34.175339 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1802/3654] 10.222.0.43 () {62 vars in 1199 bytes} [Tue Oct 4 22:00:33 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 194 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 04 22:00:34.190857 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-ab2476d1-1c9f-4922-b1b8-89c7228101d5 tempest-KeyPairsV22TestJSON-1727730123 tempest-KeyPairsV22TestJSON-1727730123-project] Action: 'create', calling method: .version_select at 0x7fbb2e7ee790>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-2103819580", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC7wjG7cI7XGDyk+YoduCeZDc4p3UelgjaNq/JJSca86ZKvrgfm4R8J+Q7OUsaY1SqmA5K6r1WBlTwkcEug/q24YPk4eONJ80eA8NyBqnF7exhVfu3wihLrGuvubRnZ4Fw=="}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:00:34.215264 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=2,nova_api:DELETE=3 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:00:34.235439 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-ab2476d1-1c9f-4922-b1b8-89c7228101d5 tempest-KeyPairsV22TestJSON-1727730123 tempest-KeyPairsV22TestJSON-1727730123-project] Getting quotas for project 09000cbdab6f4630a7e105de30d9bddf. Resources: {'key_pairs'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:00:34.258826 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-ab2476d1-1c9f-4922-b1b8-89c7228101d5 tempest-KeyPairsV22TestJSON-1727730123 tempest-KeyPairsV22TestJSON-1727730123-project] Getting quotas for user a8b6bea86114470c92d6bc7d8bba513a and project 09000cbdab6f4630a7e105de30d9bddf. Resources: {'key_pairs'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:00:34.335765 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-ab2476d1-1c9f-4922-b1b8-89c7228101d5 tempest-KeyPairsV22TestJSON-1727730123 tempest-KeyPairsV22TestJSON-1727730123-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.153415 Oct 04 22:00:34.338770 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1803/3655] 10.222.0.43 () {62 vars in 1199 bytes} [Tue Oct 4 22:00:34 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 157 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 04 22:00:34.356900 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-76e2cda6-725b-4682-a1ed-9e8d1f7386bd tempest-KeyPairsV22TestJSON-1727730123 tempest-KeyPairsV22TestJSON-1727730123-project] Action: 'create', calling method: .version_select at 0x7fbb2e5b30d0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1808703717", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDigqBNlpHI8bJcXyMXSPWcEoMhwJo693Ekf5NzXkKPmy0P5rhF0EG07xOzxFiC4iGVzGQJAH+CV+HxxxN+wrXrmgutwzV4ubbWT8+lkJY63RSDwBUOkvWiz7281l38Hrg=="}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:00:34.454114 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-76e2cda6-725b-4682-a1ed-9e8d1f7386bd tempest-KeyPairsV22TestJSON-1727730123 tempest-KeyPairsV22TestJSON-1727730123-project] Getting quotas for project 09000cbdab6f4630a7e105de30d9bddf. Resources: {'key_pairs'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:00:34.482678 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-76e2cda6-725b-4682-a1ed-9e8d1f7386bd tempest-KeyPairsV22TestJSON-1727730123 tempest-KeyPairsV22TestJSON-1727730123-project] Getting quotas for user a8b6bea86114470c92d6bc7d8bba513a and project 09000cbdab6f4630a7e105de30d9bddf. Resources: {'key_pairs'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:00:34.545837 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-76e2cda6-725b-4682-a1ed-9e8d1f7386bd tempest-KeyPairsV22TestJSON-1727730123 tempest-KeyPairsV22TestJSON-1727730123-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.194743 Oct 04 22:00:34.547073 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1804/3656] 10.222.0.43 () {62 vars in 1199 bytes} [Tue Oct 4 22:00:34 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 197 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 04 22:00:34.564584 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-9c963760-f78b-459b-ae97-4282b7e82470 tempest-KeyPairsV22TestJSON-1727730123 tempest-KeyPairsV22TestJSON-1727730123-project] Calling method '.version_select at 0x7fbb2e6a1e50>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:34.590034 n-d-860284-1 devstack@n-api.service[134101]: WARNING oslo_db.sqlalchemy.utils [None req-9c963760-f78b-459b-ae97-4282b7e82470 tempest-KeyPairsV22TestJSON-1727730123 tempest-KeyPairsV22TestJSON-1727730123-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 04 22:00:34.609532 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-9c963760-f78b-459b-ae97-4282b7e82470 tempest-KeyPairsV22TestJSON-1727730123 tempest-KeyPairsV22TestJSON-1727730123-project] 10.222.0.43 "GET /compute/v2.1/os-keypairs" status: 200 len: 1142 microversion: 2.2 time: 0.055722 Oct 04 22:00:34.612351 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1805/3657] 10.222.0.43 () {60 vars in 1177 bytes} [Tue Oct 4 22:00:34 2022] GET /compute/v2.1/os-keypairs => generated 1142 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:00:34.623426 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-76607095-0570-414a-bdae-62226ad03868 tempest-KeyPairsV22TestJSON-1727730123 tempest-KeyPairsV22TestJSON-1727730123-project] Calling method '.version_select at 0x7fbb2f195d30>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:34.635820 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-4d55fa30-2ee5-403f-87bb-c5d7ac8d189e tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2facee4c6a40416e908083e126d2cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07a17a482a4e92b6ddbdee463c8029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:34.650453 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-4d55fa30-2ee5-403f-87bb-c5d7ac8d189e tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d" status: 200 len: 1526 microversion: 2.1 time: 0.566269 Oct 04 22:00:34.654055 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1853/3658] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:00:34 2022] GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d => generated 1526 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:00:34.668227 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-2f639717-653f-4960-88dd-2513240dee44 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:34.671572 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-2f639717-653f-4960-88dd-2513240dee44 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] [instance: df147c22-6a7f-4081-83e7-97620b23700c] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:34.685318 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2f639717-653f-4960-88dd-2513240dee44 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:34.686214 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2f639717-653f-4960-88dd-2513240dee44 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:34.688125 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2f639717-653f-4960-88dd-2513240dee44 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:34.690437 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2f639717-653f-4960-88dd-2513240dee44 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:34.692169 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2f639717-653f-4960-88dd-2513240dee44 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:34.693759 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2f639717-653f-4960-88dd-2513240dee44 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:34.699169 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-76607095-0570-414a-bdae-62226ad03868 tempest-KeyPairsV22TestJSON-1727730123 tempest-KeyPairsV22TestJSON-1727730123-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1808703717" status: 204 len: 0 microversion: 2.2 time: 0.077642 Oct 04 22:00:34.703283 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1806/3659] 10.222.0.43 () {60 vars in 1321 bytes} [Tue Oct 4 22:00:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1808703717 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 22:00:34.712668 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-3675c771-30a8-4e9a-b6b1-fd360bb150e6 tempest-KeyPairsV22TestJSON-1727730123 tempest-KeyPairsV22TestJSON-1727730123-project] Calling method '.version_select at 0x7fbb2e7ee790>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:34.757118 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-3675c771-30a8-4e9a-b6b1-fd360bb150e6 tempest-KeyPairsV22TestJSON-1727730123 tempest-KeyPairsV22TestJSON-1727730123-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-2103819580" status: 204 len: 0 microversion: 2.2 time: 0.048523 Oct 04 22:00:34.758105 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1807/3660] 10.222.0.43 () {60 vars in 1321 bytes} [Tue Oct 4 22:00:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-2103819580 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 22:00:34.764387 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-f8e60f13-1ab3-4f10-b739-991d532ebb1f tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:34.766769 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-f8e60f13-1ab3-4f10-b739-991d532ebb1f tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] [instance: 2d3d1574-f1b5-46a9-a3b7-205a905a90f1] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:34.783878 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f8e60f13-1ab3-4f10-b739-991d532ebb1f tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:34.784502 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f8e60f13-1ab3-4f10-b739-991d532ebb1f tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:34.785017 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f8e60f13-1ab3-4f10-b739-991d532ebb1f tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:34.785809 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f8e60f13-1ab3-4f10-b739-991d532ebb1f tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:34.786356 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f8e60f13-1ab3-4f10-b739-991d532ebb1f tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:34.786879 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f8e60f13-1ab3-4f10-b739-991d532ebb1f tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:35.084449 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-2f639717-653f-4960-88dd-2513240dee44 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2034fc9060874868bc5d27370a1c351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89499d833a4a00805164f4f79ed522', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:35.098560 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-2f639717-653f-4960-88dd-2513240dee44 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] 10.222.0.43 "GET /compute/v2.1/servers/df147c22-6a7f-4081-83e7-97620b23700c" status: 200 len: 1514 microversion: 2.1 time: 0.441839 Oct 04 22:00:35.114826 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1854/3661] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:00:34 2022] GET /compute/v2.1/servers/df147c22-6a7f-4081-83e7-97620b23700c => generated 1514 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:00:35.125539 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-67c133a3-bd50-4ff2-9337-27fe46e60a04 tempest-KeyPairsV22TestJSON-1727730123 tempest-KeyPairsV22TestJSON-1727730123-project] Calling method '.version_select at 0x7fbb2f053550>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:35.176724 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-f8e60f13-1ab3-4f10-b739-991d532ebb1f tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd474da1382674cada32763825c7840f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cad63eb782c43b19d642fa6adaffd71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:35.180505 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=100 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:00:35.186622 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-f8e60f13-1ab3-4f10-b739-991d532ebb1f tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] 10.222.0.43 "GET /compute/v2.1/servers/2d3d1574-f1b5-46a9-a3b7-205a905a90f1" status: 200 len: 1315 microversion: 2.1 time: 0.427256 Oct 04 22:00:35.187435 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1808/3662] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:00:34 2022] GET /compute/v2.1/servers/2d3d1574-f1b5-46a9-a3b7-205a905a90f1 => generated 1315 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:00:35.221315 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-67c133a3-bd50-4ff2-9337-27fe46e60a04 tempest-KeyPairsV22TestJSON-1727730123 tempest-KeyPairsV22TestJSON-1727730123-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-2138097092" status: 204 len: 0 microversion: 2.2 time: 0.104671 Oct 04 22:00:35.226146 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-88eb318f-e4e5-49a8-b026-269d886ee526 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:35.226810 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-88eb318f-e4e5-49a8-b026-269d886ee526 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] [instance: 4c17a63b-8492-4c9b-a0c2-34bef7051f80] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:35.230572 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1855/3663] 10.222.0.43 () {60 vars in 1321 bytes} [Tue Oct 4 22:00:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-2138097092 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 22:00:35.243467 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-a7131981-79b7-49be-b112-2c87cc0b1b82 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:35.244437 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-a7131981-79b7-49be-b112-2c87cc0b1b82 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] [instance: d0b1b757-4a4d-4a7a-9a06-08f178a02984] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:35.249099 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-88eb318f-e4e5-49a8-b026-269d886ee526 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:35.249603 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-88eb318f-e4e5-49a8-b026-269d886ee526 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:35.250050 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-88eb318f-e4e5-49a8-b026-269d886ee526 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:35.250802 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-88eb318f-e4e5-49a8-b026-269d886ee526 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:35.251267 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-88eb318f-e4e5-49a8-b026-269d886ee526 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:35.251699 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-88eb318f-e4e5-49a8-b026-269d886ee526 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:35.254025 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a7131981-79b7-49be-b112-2c87cc0b1b82 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:35.254828 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a7131981-79b7-49be-b112-2c87cc0b1b82 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:35.255773 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a7131981-79b7-49be-b112-2c87cc0b1b82 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:35.256736 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a7131981-79b7-49be-b112-2c87cc0b1b82 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:35.257560 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a7131981-79b7-49be-b112-2c87cc0b1b82 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:35.258183 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a7131981-79b7-49be-b112-2c87cc0b1b82 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:35.314610 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-88eb318f-e4e5-49a8-b026-269d886ee526 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] HTTP exception thrown: Instance 4c17a63b-8492-4c9b-a0c2-34bef7051f80 could not be found. Oct 04 22:00:35.316296 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-88eb318f-e4e5-49a8-b026-269d886ee526 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Request method failure captured: Oct 04 22:00:35.316296 n-d-860284-1 devstack@n-api.service[134101]: request: GET /compute/v2.1/servers/4c17a63b-8492-4c9b-a0c2-34bef7051f80 HTTP/1.1 Oct 04 22:00:35.316296 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 22:00:35.316296 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 22:00:35.316296 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 22:00:35.316296 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 22:00:35.316296 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 22:00:35.316296 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 22:00:35.316296 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 22:00:35.316296 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 22:00:35.316296 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPKx2lmxSmsA2O1spa423GotbmARUde_BoXJtdmD2J4XZeuQlqmo4UXkSV0w2uVeGYoEA2m2kq-I0BPDRcVbMHz4V5JMvO00P14251ma5dvTnArSlZI3T6WGOowS_Jn2cRVODTWqzBJONJLh4P2VNpyjuBIQ2OmDx1DS5s7SbUtpk_04 Oct 04 22:00:35.316296 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 22:00:35.316296 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 22:00:35.316296 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 22:00:35.316296 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 22:00:35.316296 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 22:00:35.316296 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 22:00:35.316296 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: 3994b89cac594e309926f1eaf785f7d3 Oct 04 22:00:35.316296 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-ServersTestBootFromVolume-2080170927 Oct 04 22:00:35.316296 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 22:00:35.316296 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 22:00:35.316296 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/3994b89cac594e309926f1eaf785f7d3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_3994b89cac594e309926f1eaf785f7d3", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/3994b89cac594e309926f1eaf785f7d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/3994b89cac594e309926f1eaf785f7d3"}]}] Oct 04 22:00:35.316296 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-ServersTestBootFromVolume-2080170927 Oct 04 22:00:35.316296 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: 3994b89cac594e309926f1eaf785f7d3 Oct 04 22:00:35.316296 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-ServersTestBootFromVolume-2080170927 Oct 04 22:00:35.316296 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-ServersTestBootFromVolume-2080170927-project Oct 04 22:00:35.316296 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 22:00:35.316296 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 22:00:35.316296 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 08c7a1e7d6984644a68d967b5e3fe92e Oct 04 22:00:35.316296 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-ServersTestBootFromVolume-2080170927-project Oct 04 22:00:35.316296 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 22:00:35.316296 n-d-860284-1 devstack@n-api.service[134101]: exception: Instance 4c17a63b-8492-4c9b-a0c2-34bef7051f80 could not be found. Oct 04 22:00:35.316296 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': '4c17a63b-8492-4c9b-a0c2-34bef7051f80'} Oct 04 22:00:35.316296 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:00:35.316296 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:00:35.316296 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:00:35.316296 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:00:35.316296 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:00:35.316296 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:00:35.316296 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:00:35.316296 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:00:35.316296 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:00:35.316296 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:00:35.316296 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c17a63b-8492-4c9b-a0c2-34bef7051f80 could not be found. Oct 04 22:00:35.316296 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:00:35.316296 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:00:35.316296 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:00:35.316296 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:00:35.316296 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:00:35.316296 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:00:35.316296 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:00:35.316296 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:00:35.316296 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:00:35.316296 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:00:35.316296 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:00:35.316296 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:00:35.316296 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:00:35.316296 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:00:35.316296 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:00:35.316296 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:00:35.316296 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c17a63b-8492-4c9b-a0c2-34bef7051f80 could not be found. Oct 04 22:00:35.316296 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:00:35.316296 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:00:35.316296 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:00:35.321735 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:00:35.321735 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:00:35.321735 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:00:35.321735 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:00:35.321735 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:00:35.321735 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c17a63b-8492-4c9b-a0c2-34bef7051f80 could not be found. Oct 04 22:00:35.321735 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:00:35.321735 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-88eb318f-e4e5-49a8-b026-269d886ee526 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Returning 404 to user: Instance 4c17a63b-8492-4c9b-a0c2-34bef7051f80 could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:00:35.321735 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-88eb318f-e4e5-49a8-b026-269d886ee526 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] 10.222.0.43 "GET /compute/v2.1/servers/4c17a63b-8492-4c9b-a0c2-34bef7051f80" status: 404 len: 111 microversion: 2.1 time: 0.108738 Oct 04 22:00:35.326684 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1809/3664] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:00:35 2022] GET /compute/v2.1/servers/4c17a63b-8492-4c9b-a0c2-34bef7051f80 => generated 111 bytes in 139 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:00:35.331937 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-0ccedabb-66c1-4111-8ce1-4d7391b107f9 tempest-KeyPairsV22TestJSON-1727730123 tempest-KeyPairsV22TestJSON-1727730123-project] Action: 'create', calling method: .version_select at 0x7fbb2e7ee160>, body: {"keypair": {"name": "tempest-keypair-10439130", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCfFn3VBElE4PymYg8gFm+gYPNlijN3E9oXdh6J2uUjVCQzIsNoUeTHSVrmWK9nTh8hl7UVZTUktx8JVuQw+QL3jZRWXQoLeUnYTWi1l52DBI0726+cILfMPKFmwAW9sgw=="}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:00:35.370399 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-0ccedabb-66c1-4111-8ce1-4d7391b107f9 tempest-KeyPairsV22TestJSON-1727730123 tempest-KeyPairsV22TestJSON-1727730123-project] Getting quotas for project 09000cbdab6f4630a7e105de30d9bddf. Resources: {'key_pairs'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:00:35.378832 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-0ccedabb-66c1-4111-8ce1-4d7391b107f9 tempest-KeyPairsV22TestJSON-1727730123 tempest-KeyPairsV22TestJSON-1727730123-project] Getting quotas for user a8b6bea86114470c92d6bc7d8bba513a and project 09000cbdab6f4630a7e105de30d9bddf. Resources: {'key_pairs'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:00:35.425659 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-0ccedabb-66c1-4111-8ce1-4d7391b107f9 tempest-KeyPairsV22TestJSON-1727730123 tempest-KeyPairsV22TestJSON-1727730123-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 201 len: 399 microversion: 2.2 time: 0.097717 Oct 04 22:00:35.427285 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1810/3665] 10.222.0.43 () {62 vars in 1199 bytes} [Tue Oct 4 22:00:35 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 100 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 04 22:00:35.432807 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-39b0fbcc-615f-48d4-9882-3c0bf427d614 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] Calling method '.version_select at 0x7fbb2e7eec10>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:35.441869 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-a7131981-79b7-49be-b112-2c87cc0b1b82 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:35.464500 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-a7131981-79b7-49be-b112-2c87cc0b1b82 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:35.474798 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-a7131981-79b7-49be-b112-2c87cc0b1b82 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:35.491481 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-39b0fbcc-615f-48d4-9882-3c0bf427d614 tempest-ServersTestBootFromVolume-2080170927 tempest-ServersTestBootFromVolume-2080170927-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-965634969" status: 202 len: 0 microversion: 2.1 time: 0.062593 Oct 04 22:00:35.492271 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1811/3666] 10.222.0.43 () {58 vars in 1218 bytes} [Tue Oct 4 22:00:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-965634969 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 22:00:35.493847 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-a7131981-79b7-49be-b112-2c87cc0b1b82 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] 10.222.0.43 "GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984" status: 200 len: 1553 microversion: 2.91 time: 0.261286 Oct 04 22:00:35.497280 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1856/3667] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:00:35 2022] GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984 => generated 1553 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:00:35.498555 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e849f127-38b7-4340-9566-944b86bcdc59 tempest-KeyPairsV22TestJSON-1727730123 tempest-KeyPairsV22TestJSON-1727730123-project] Calling method '.version_select at 0x7fbb2e6a1dc0>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:35.508690 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-e849f127-38b7-4340-9566-944b86bcdc59 tempest-KeyPairsV22TestJSON-1727730123 tempest-KeyPairsV22TestJSON-1727730123-project] 10.222.0.43 "GET /compute/v2.1/os-keypairs/tempest-keypair-10439130" status: 200 len: 511 microversion: 2.2 time: 0.015304 Oct 04 22:00:35.516087 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1812/3668] 10.222.0.43 () {60 vars in 1252 bytes} [Tue Oct 4 22:00:35 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-10439130 => generated 511 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:00:35.523096 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-662b2218-7771-4c89-8160-e4189d5199ab tempest-KeyPairsV22TestJSON-1727730123 tempest-KeyPairsV22TestJSON-1727730123-project] Calling method '.version_select at 0x7fbb2efd2940>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:35.547501 n-d-860284-1 devstack@n-api.service[134102]: WARNING oslo_db.sqlalchemy.utils [None req-662b2218-7771-4c89-8160-e4189d5199ab tempest-KeyPairsV22TestJSON-1727730123 tempest-KeyPairsV22TestJSON-1727730123-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 04 22:00:35.553703 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-662b2218-7771-4c89-8160-e4189d5199ab tempest-KeyPairsV22TestJSON-1727730123 tempest-KeyPairsV22TestJSON-1727730123-project] 10.222.0.43 "GET /compute/v2.1/os-keypairs" status: 200 len: 368 microversion: 2.2 time: 0.036234 Oct 04 22:00:35.554313 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1857/3669] 10.222.0.43 () {60 vars in 1177 bytes} [Tue Oct 4 22:00:35 2022] GET /compute/v2.1/os-keypairs => generated 368 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:00:35.576712 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-16c1947a-a09c-42fc-afc5-c50099bc7a34 tempest-KeyPairsV22TestJSON-1727730123 tempest-KeyPairsV22TestJSON-1727730123-project] Calling method '.version_select at 0x7fbb37373940>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:35.629087 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-16c1947a-a09c-42fc-afc5-c50099bc7a34 tempest-KeyPairsV22TestJSON-1727730123 tempest-KeyPairsV22TestJSON-1727730123-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-10439130" status: 204 len: 0 microversion: 2.2 time: 0.064402 Oct 04 22:00:35.632051 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1813/3670] 10.222.0.43 () {60 vars in 1255 bytes} [Tue Oct 4 22:00:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-10439130 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 22:00:35.641769 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-cb3fc637-fe2d-4855-b615-aeb38a112bf5 tempest-KeyPairsV22TestJSON-1727730123 tempest-KeyPairsV22TestJSON-1727730123-project] Action: 'create', calling method: .version_select at 0x7fbb2f5d0ee0>, body: {"keypair": {"name": "tempest-keypair-1892931568", "type": "x509"}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:00:35.681333 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-cb3fc637-fe2d-4855-b615-aeb38a112bf5 tempest-KeyPairsV22TestJSON-1727730123 tempest-KeyPairsV22TestJSON-1727730123-project] Getting quotas for project 09000cbdab6f4630a7e105de30d9bddf. Resources: {'key_pairs'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:00:35.685787 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-10f48110-e3c9-4226-a441-586bcb06fd63 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:35.686676 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-10f48110-e3c9-4226-a441-586bcb06fd63 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: a4cf4fac-1e9b-4669-a6ff-30008ed3642d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:35.699182 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-10f48110-e3c9-4226-a441-586bcb06fd63 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:35.700889 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-10f48110-e3c9-4226-a441-586bcb06fd63 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:35.701436 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-10f48110-e3c9-4226-a441-586bcb06fd63 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:35.702203 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-10f48110-e3c9-4226-a441-586bcb06fd63 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:35.702715 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-10f48110-e3c9-4226-a441-586bcb06fd63 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:35.703157 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-10f48110-e3c9-4226-a441-586bcb06fd63 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:35.718184 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-cb3fc637-fe2d-4855-b615-aeb38a112bf5 tempest-KeyPairsV22TestJSON-1727730123 tempest-KeyPairsV22TestJSON-1727730123-project] Getting quotas for user a8b6bea86114470c92d6bc7d8bba513a and project 09000cbdab6f4630a7e105de30d9bddf. Resources: {'key_pairs'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:00:35.785181 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.processutils [None req-cb3fc637-fe2d-4855-b615-aeb38a112bf5 tempest-KeyPairsV22TestJSON-1727730123 tempest-KeyPairsV22TestJSON-1727730123-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmpcfdvt06v/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpcfdvt06v/temp.key -subj /CN=a8b6bea86114470c92d6bc7d8bba513a -extensions v3_req_client {{(pid=134102) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 04 22:00:36.105027 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-10f48110-e3c9-4226-a441-586bcb06fd63 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2facee4c6a40416e908083e126d2cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07a17a482a4e92b6ddbdee463c8029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:36.136334 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-10f48110-e3c9-4226-a441-586bcb06fd63 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d" status: 200 len: 1526 microversion: 2.1 time: 0.458185 Oct 04 22:00:36.142261 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1814/3671] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:00:35 2022] GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d => generated 1526 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:00:36.158821 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-a51d2e42-4e4a-42d7-b6fe-4aba02d88e0c tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:36.162735 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-a51d2e42-4e4a-42d7-b6fe-4aba02d88e0c tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] [instance: df147c22-6a7f-4081-83e7-97620b23700c] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:36.184299 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a51d2e42-4e4a-42d7-b6fe-4aba02d88e0c tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:36.184820 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a51d2e42-4e4a-42d7-b6fe-4aba02d88e0c tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:36.194882 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a51d2e42-4e4a-42d7-b6fe-4aba02d88e0c tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:36.196042 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a51d2e42-4e4a-42d7-b6fe-4aba02d88e0c tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:36.196537 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a51d2e42-4e4a-42d7-b6fe-4aba02d88e0c tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:36.196987 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a51d2e42-4e4a-42d7-b6fe-4aba02d88e0c tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:36.346326 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.processutils [None req-cb3fc637-fe2d-4855-b615-aeb38a112bf5 tempest-KeyPairsV22TestJSON-1727730123 tempest-KeyPairsV22TestJSON-1727730123-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmpcfdvt06v/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpcfdvt06v/temp.key -subj /CN=a8b6bea86114470c92d6bc7d8bba513a -extensions v3_req_client" returned: 0 in 0.563s {{(pid=134102) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 04 22:00:36.351097 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.processutils [None req-cb3fc637-fe2d-4855-b615-aeb38a112bf5 tempest-KeyPairsV22TestJSON-1727730123 tempest-KeyPairsV22TestJSON-1727730123-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmpcfdvt06v/temp.key -password pass: {{(pid=134102) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 04 22:00:36.468317 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.processutils [None req-cb3fc637-fe2d-4855-b615-aeb38a112bf5 tempest-KeyPairsV22TestJSON-1727730123 tempest-KeyPairsV22TestJSON-1727730123-project] CMD "openssl pkcs12 -export -inkey /tmp/tmpcfdvt06v/temp.key -password pass:" returned: 0 in 0.117s {{(pid=134102) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 04 22:00:36.581152 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-cb3fc637-fe2d-4855-b615-aeb38a112bf5 tempest-KeyPairsV22TestJSON-1727730123 tempest-KeyPairsV22TestJSON-1727730123-project] Getting quotas for project 09000cbdab6f4630a7e105de30d9bddf. Resources: {'key_pairs'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:00:36.610193 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-cb3fc637-fe2d-4855-b615-aeb38a112bf5 tempest-KeyPairsV22TestJSON-1727730123 tempest-KeyPairsV22TestJSON-1727730123-project] Getting quotas for user a8b6bea86114470c92d6bc7d8bba513a and project 09000cbdab6f4630a7e105de30d9bddf. Resources: {'key_pairs'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:00:36.645250 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-a51d2e42-4e4a-42d7-b6fe-4aba02d88e0c tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2034fc9060874868bc5d27370a1c351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89499d833a4a00805164f4f79ed522', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:36.655767 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-a51d2e42-4e4a-42d7-b6fe-4aba02d88e0c tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] 10.222.0.43 "GET /compute/v2.1/servers/df147c22-6a7f-4081-83e7-97620b23700c" status: 200 len: 1514 microversion: 2.1 time: 0.512197 Oct 04 22:00:36.671162 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1815/3672] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:00:36 2022] GET /compute/v2.1/servers/df147c22-6a7f-4081-83e7-97620b23700c => generated 1514 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:00:36.677845 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-cb3fc637-fe2d-4855-b615-aeb38a112bf5 tempest-KeyPairsV22TestJSON-1727730123 tempest-KeyPairsV22TestJSON-1727730123-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 201 len: 4693 microversion: 2.2 time: 1.040513 Oct 04 22:00:36.681770 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-87be1c02-2f75-46e8-9ec9-29f3c017c231 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:36.689861 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1858/3673] 10.222.0.43 () {62 vars in 1198 bytes} [Tue Oct 4 22:00:35 2022] POST /compute/v2.1/os-keypairs => generated 4693 bytes in 1049 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Oct 04 22:00:36.691943 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-87be1c02-2f75-46e8-9ec9-29f3c017c231 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] [instance: 2d3d1574-f1b5-46a9-a3b7-205a905a90f1] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:36.713798 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-8f2786c8-2cd4-435b-81af-34e77dbe6ef7 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:36.722077 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-87be1c02-2f75-46e8-9ec9-29f3c017c231 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:36.727397 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-8f2786c8-2cd4-435b-81af-34e77dbe6ef7 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] [instance: d0b1b757-4a4d-4a7a-9a06-08f178a02984] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:36.739193 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:00:36.758977 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8f2786c8-2cd4-435b-81af-34e77dbe6ef7 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:36.760041 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-87be1c02-2f75-46e8-9ec9-29f3c017c231 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:36.763814 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-87be1c02-2f75-46e8-9ec9-29f3c017c231 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.038s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:36.765974 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-87be1c02-2f75-46e8-9ec9-29f3c017c231 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:36.766638 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-87be1c02-2f75-46e8-9ec9-29f3c017c231 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:36.767102 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-87be1c02-2f75-46e8-9ec9-29f3c017c231 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:36.776033 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8f2786c8-2cd4-435b-81af-34e77dbe6ef7 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:36.776592 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8f2786c8-2cd4-435b-81af-34e77dbe6ef7 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:36.777456 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8f2786c8-2cd4-435b-81af-34e77dbe6ef7 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:36.783703 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8f2786c8-2cd4-435b-81af-34e77dbe6ef7 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:36.796350 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8f2786c8-2cd4-435b-81af-34e77dbe6ef7 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:37.177555 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-8f2786c8-2cd4-435b-81af-34e77dbe6ef7 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:37.201086 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-8f2786c8-2cd4-435b-81af-34e77dbe6ef7 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:37.202613 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-8f2786c8-2cd4-435b-81af-34e77dbe6ef7 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:37.225990 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-8f2786c8-2cd4-435b-81af-34e77dbe6ef7 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] 10.222.0.43 "GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984" status: 200 len: 1553 microversion: 2.91 time: 0.538957 Oct 04 22:00:37.226651 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1859/3674] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:00:36 2022] GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984 => generated 1553 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:00:37.251864 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-cf78ac19-8c1d-47da-b88c-1ee9a3628aa3 tempest-KeyPairsV22TestJSON-1727730123 tempest-KeyPairsV22TestJSON-1727730123-project] Calling method '.version_select at 0x7fbb2e7f8040>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:37.300890 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-cf78ac19-8c1d-47da-b88c-1ee9a3628aa3 tempest-KeyPairsV22TestJSON-1727730123 tempest-KeyPairsV22TestJSON-1727730123-project] 10.222.0.43 "GET /compute/v2.1/os-keypairs/tempest-keypair-1892931568" status: 200 len: 1534 microversion: 2.2 time: 0.073093 Oct 04 22:00:37.316409 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1860/3675] 10.222.0.43 () {60 vars in 1258 bytes} [Tue Oct 4 22:00:37 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1892931568 => generated 1534 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:00:37.341391 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-baddf498-284b-4650-b79f-1e2bedc73b91 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:37.342043 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-baddf498-284b-4650-b79f-1e2bedc73b91 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: a4cf4fac-1e9b-4669-a6ff-30008ed3642d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:37.369988 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-baddf498-284b-4650-b79f-1e2bedc73b91 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:37.370713 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-baddf498-284b-4650-b79f-1e2bedc73b91 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:37.373372 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-baddf498-284b-4650-b79f-1e2bedc73b91 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:37.378391 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-baddf498-284b-4650-b79f-1e2bedc73b91 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:37.378908 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-baddf498-284b-4650-b79f-1e2bedc73b91 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:37.381158 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-baddf498-284b-4650-b79f-1e2bedc73b91 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:37.444058 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-87be1c02-2f75-46e8-9ec9-29f3c017c231 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd474da1382674cada32763825c7840f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cad63eb782c43b19d642fa6adaffd71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:37.453244 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-87be1c02-2f75-46e8-9ec9-29f3c017c231 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] 10.222.0.43 "GET /compute/v2.1/servers/2d3d1574-f1b5-46a9-a3b7-205a905a90f1" status: 200 len: 1315 microversion: 2.1 time: 0.780668 Oct 04 22:00:37.458911 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1816/3676] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:00:36 2022] GET /compute/v2.1/servers/2d3d1574-f1b5-46a9-a3b7-205a905a90f1 => generated 1315 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:00:37.464268 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-aa33ed96-f45f-4fdb-8b39-2cf8c0af997a tempest-KeyPairsV22TestJSON-1727730123 tempest-KeyPairsV22TestJSON-1727730123-project] Calling method '.version_select at 0x7fbb2e7e11f0>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:37.478908 n-d-860284-1 devstack@n-api.service[134101]: WARNING oslo_db.sqlalchemy.utils [None req-aa33ed96-f45f-4fdb-8b39-2cf8c0af997a tempest-KeyPairsV22TestJSON-1727730123 tempest-KeyPairsV22TestJSON-1727730123-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 04 22:00:37.536276 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-aa33ed96-f45f-4fdb-8b39-2cf8c0af997a tempest-KeyPairsV22TestJSON-1727730123 tempest-KeyPairsV22TestJSON-1727730123-project] 10.222.0.43 "GET /compute/v2.1/os-keypairs" status: 200 len: 1391 microversion: 2.2 time: 0.075906 Oct 04 22:00:37.536884 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1817/3677] 10.222.0.43 () {60 vars in 1177 bytes} [Tue Oct 4 22:00:37 2022] GET /compute/v2.1/os-keypairs => generated 1391 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:00:37.551394 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-020d48b7-0cc0-4ecb-993d-7955550e2168 tempest-KeyPairsV22TestJSON-1727730123 tempest-KeyPairsV22TestJSON-1727730123-project] Calling method '.version_select at 0x7fbb2e5b3040>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:37.627131 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-baddf498-284b-4650-b79f-1e2bedc73b91 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2facee4c6a40416e908083e126d2cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07a17a482a4e92b6ddbdee463c8029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:37.636051 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-baddf498-284b-4650-b79f-1e2bedc73b91 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d" status: 200 len: 1526 microversion: 2.1 time: 0.318421 Oct 04 22:00:37.638179 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1861/3678] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:00:37 2022] GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d => generated 1526 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:00:37.659079 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-020d48b7-0cc0-4ecb-993d-7955550e2168 tempest-KeyPairsV22TestJSON-1727730123 tempest-KeyPairsV22TestJSON-1727730123-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1892931568" status: 204 len: 0 microversion: 2.2 time: 0.111090 Oct 04 22:00:37.659917 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1818/3679] 10.222.0.43 () {60 vars in 1261 bytes} [Tue Oct 4 22:00:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1892931568 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 22:00:37.697888 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-06cb5915-28a5-470d-94c2-11d4b7be36a8 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:37.698859 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-06cb5915-28a5-470d-94c2-11d4b7be36a8 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] [instance: df147c22-6a7f-4081-83e7-97620b23700c] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:37.707334 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-06cb5915-28a5-470d-94c2-11d4b7be36a8 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:37.712571 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-06cb5915-28a5-470d-94c2-11d4b7be36a8 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:37.716964 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-06cb5915-28a5-470d-94c2-11d4b7be36a8 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:37.718038 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-06cb5915-28a5-470d-94c2-11d4b7be36a8 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:37.718736 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-06cb5915-28a5-470d-94c2-11d4b7be36a8 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:37.719280 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-06cb5915-28a5-470d-94c2-11d4b7be36a8 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:38.151476 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-06cb5915-28a5-470d-94c2-11d4b7be36a8 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2034fc9060874868bc5d27370a1c351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89499d833a4a00805164f4f79ed522', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:38.169077 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-06cb5915-28a5-470d-94c2-11d4b7be36a8 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] 10.222.0.43 "GET /compute/v2.1/servers/df147c22-6a7f-4081-83e7-97620b23700c" status: 200 len: 1514 microversion: 2.1 time: 0.475324 Oct 04 22:00:38.170317 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1862/3680] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:00:37 2022] GET /compute/v2.1/servers/df147c22-6a7f-4081-83e7-97620b23700c => generated 1514 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:00:38.261175 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-8c3cb97a-2b35-47a0-9ca6-844cd7d062d3 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:38.262790 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-8c3cb97a-2b35-47a0-9ca6-844cd7d062d3 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] [instance: d0b1b757-4a4d-4a7a-9a06-08f178a02984] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:38.272713 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8c3cb97a-2b35-47a0-9ca6-844cd7d062d3 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:38.284538 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8c3cb97a-2b35-47a0-9ca6-844cd7d062d3 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:38.285323 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8c3cb97a-2b35-47a0-9ca6-844cd7d062d3 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:38.286345 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8c3cb97a-2b35-47a0-9ca6-844cd7d062d3 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:38.287442 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8c3cb97a-2b35-47a0-9ca6-844cd7d062d3 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:38.296059 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8c3cb97a-2b35-47a0-9ca6-844cd7d062d3 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:38.421042 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-8c3cb97a-2b35-47a0-9ca6-844cd7d062d3 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:38.431281 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-8c3cb97a-2b35-47a0-9ca6-844cd7d062d3 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:38.437984 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-8c3cb97a-2b35-47a0-9ca6-844cd7d062d3 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:38.471738 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-8c3cb97a-2b35-47a0-9ca6-844cd7d062d3 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] 10.222.0.43 "GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984" status: 200 len: 1553 microversion: 2.91 time: 0.214397 Oct 04 22:00:38.475888 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1819/3681] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:00:38 2022] GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984 => generated 1553 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:00:38.488727 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-55728c59-602b-4fff-964a-403dee06a8cd tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:38.490139 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-55728c59-602b-4fff-964a-403dee06a8cd tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] [instance: 2d3d1574-f1b5-46a9-a3b7-205a905a90f1] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:38.498012 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-55728c59-602b-4fff-964a-403dee06a8cd tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:38.498938 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-55728c59-602b-4fff-964a-403dee06a8cd tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:38.499846 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-55728c59-602b-4fff-964a-403dee06a8cd tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:38.504284 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-55728c59-602b-4fff-964a-403dee06a8cd tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:38.508781 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-55728c59-602b-4fff-964a-403dee06a8cd tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:38.513376 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-55728c59-602b-4fff-964a-403dee06a8cd tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:38.670161 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-b9cc10c3-b280-41e9-a38c-1777f02f52cb tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:38.671630 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-b9cc10c3-b280-41e9-a38c-1777f02f52cb tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: a4cf4fac-1e9b-4669-a6ff-30008ed3642d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:38.711744 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b9cc10c3-b280-41e9-a38c-1777f02f52cb tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:38.736849 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b9cc10c3-b280-41e9-a38c-1777f02f52cb tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:38.737688 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b9cc10c3-b280-41e9-a38c-1777f02f52cb tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:38.738530 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b9cc10c3-b280-41e9-a38c-1777f02f52cb tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:38.739229 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b9cc10c3-b280-41e9-a38c-1777f02f52cb tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:38.739842 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b9cc10c3-b280-41e9-a38c-1777f02f52cb tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:39.352956 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-55728c59-602b-4fff-964a-403dee06a8cd tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd474da1382674cada32763825c7840f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cad63eb782c43b19d642fa6adaffd71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:39.369272 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-55728c59-602b-4fff-964a-403dee06a8cd tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] 10.222.0.43 "GET /compute/v2.1/servers/2d3d1574-f1b5-46a9-a3b7-205a905a90f1" status: 200 len: 1315 microversion: 2.1 time: 0.882999 Oct 04 22:00:39.372323 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1863/3682] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:00:38 2022] GET /compute/v2.1/servers/2d3d1574-f1b5-46a9-a3b7-205a905a90f1 => generated 1315 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:00:39.395015 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-762c5c50-bc82-4570-a947-3a4af719980a tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:39.395821 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-762c5c50-bc82-4570-a947-3a4af719980a tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] [instance: df147c22-6a7f-4081-83e7-97620b23700c] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:39.418343 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-762c5c50-bc82-4570-a947-3a4af719980a tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:39.418902 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-762c5c50-bc82-4570-a947-3a4af719980a tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:39.419355 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-762c5c50-bc82-4570-a947-3a4af719980a tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:39.427974 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-762c5c50-bc82-4570-a947-3a4af719980a tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:39.428518 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-762c5c50-bc82-4570-a947-3a4af719980a tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:39.429030 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-762c5c50-bc82-4570-a947-3a4af719980a tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:39.470157 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-b9cc10c3-b280-41e9-a38c-1777f02f52cb tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2facee4c6a40416e908083e126d2cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07a17a482a4e92b6ddbdee463c8029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:39.479027 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-b9cc10c3-b280-41e9-a38c-1777f02f52cb tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d" status: 200 len: 1526 microversion: 2.1 time: 0.814184 Oct 04 22:00:39.482734 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1820/3683] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:00:38 2022] GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d => generated 1526 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:00:39.499745 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-fd54c028-7d69-4297-9797-e905b4dbabe7 req-fecca141-3379-4d52-8d99-e493ba600938 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d3d1574-f1b5-46a9-a3b7-205a905a90f1", "name": "network-vif-plugged", "status": "completed", "tag": "c50abe74-5b16-4f5f-8682-58a99b7b2a0b"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:00:39.535430 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-fd54c028-7d69-4297-9797-e905b4dbabe7 req-fecca141-3379-4d52-8d99-e493ba600938 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:39.543944 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-fd54c028-7d69-4297-9797-e905b4dbabe7 req-fecca141-3379-4d52-8d99-e493ba600938 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:39.545146 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-fd54c028-7d69-4297-9797-e905b4dbabe7 req-fecca141-3379-4d52-8d99-e493ba600938 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:39.586352 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-fd54c028-7d69-4297-9797-e905b4dbabe7 req-fecca141-3379-4d52-8d99-e493ba600938 service nova] Creating event network-vif-plugged:c50abe74-5b16-4f5f-8682-58a99b7b2a0b for instance 2d3d1574-f1b5-46a9-a3b7-205a905a90f1 on n-h1-860284-1 Oct 04 22:00:39.610507 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-fd54c028-7d69-4297-9797-e905b4dbabe7 req-fecca141-3379-4d52-8d99-e493ba600938 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122005 Oct 04 22:00:39.611954 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1821/3684] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:00:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:00:39.631201 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-113a39ff-b519-4684-a949-af2f13b960a7 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:39.635225 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-113a39ff-b519-4684-a949-af2f13b960a7 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] [instance: d0b1b757-4a4d-4a7a-9a06-08f178a02984] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:39.645065 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-113a39ff-b519-4684-a949-af2f13b960a7 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:39.652146 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-113a39ff-b519-4684-a949-af2f13b960a7 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:39.653909 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-113a39ff-b519-4684-a949-af2f13b960a7 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:39.655926 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-113a39ff-b519-4684-a949-af2f13b960a7 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:39.662975 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-113a39ff-b519-4684-a949-af2f13b960a7 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:39.663790 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-113a39ff-b519-4684-a949-af2f13b960a7 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:40.821141 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-113a39ff-b519-4684-a949-af2f13b960a7 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:40.844550 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-113a39ff-b519-4684-a949-af2f13b960a7 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:40.852504 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-113a39ff-b519-4684-a949-af2f13b960a7 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:40.932268 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-113a39ff-b519-4684-a949-af2f13b960a7 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] 10.222.0.43 "GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984" status: 200 len: 1553 microversion: 2.91 time: 1.318648 Oct 04 22:00:40.947233 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1822/3685] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:00:39 2022] GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984 => generated 1553 bytes in 1334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:00:40.953453 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-627f3011-c322-44af-8d5b-1c4a70e26f05 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:40.961208 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-627f3011-c322-44af-8d5b-1c4a70e26f05 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] [instance: 2d3d1574-f1b5-46a9-a3b7-205a905a90f1] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:40.987213 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-627f3011-c322-44af-8d5b-1c4a70e26f05 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:40.988174 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-627f3011-c322-44af-8d5b-1c4a70e26f05 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:40.988887 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-627f3011-c322-44af-8d5b-1c4a70e26f05 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:40.992019 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-627f3011-c322-44af-8d5b-1c4a70e26f05 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:40.992814 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-627f3011-c322-44af-8d5b-1c4a70e26f05 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:40.995084 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-627f3011-c322-44af-8d5b-1c4a70e26f05 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:41.345523 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-762c5c50-bc82-4570-a947-3a4af719980a tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2034fc9060874868bc5d27370a1c351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89499d833a4a00805164f4f79ed522', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:41.357057 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-762c5c50-bc82-4570-a947-3a4af719980a tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] 10.222.0.43 "GET /compute/v2.1/servers/df147c22-6a7f-4081-83e7-97620b23700c" status: 200 len: 1514 microversion: 2.1 time: 1.983506 Oct 04 22:00:41.374405 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1864/3686] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:00:39 2022] GET /compute/v2.1/servers/df147c22-6a7f-4081-83e7-97620b23700c => generated 1514 bytes in 1989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:00:41.386389 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-cb744fcc-0568-4f43-b096-72d4a4631978 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:41.386389 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-cb744fcc-0568-4f43-b096-72d4a4631978 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: a4cf4fac-1e9b-4669-a6ff-30008ed3642d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:41.411780 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cb744fcc-0568-4f43-b096-72d4a4631978 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:41.415557 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cb744fcc-0568-4f43-b096-72d4a4631978 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:41.418679 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cb744fcc-0568-4f43-b096-72d4a4631978 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:41.425140 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cb744fcc-0568-4f43-b096-72d4a4631978 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:41.427812 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cb744fcc-0568-4f43-b096-72d4a4631978 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:41.428615 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cb744fcc-0568-4f43-b096-72d4a4631978 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:41.690831 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-627f3011-c322-44af-8d5b-1c4a70e26f05 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd474da1382674cada32763825c7840f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cad63eb782c43b19d642fa6adaffd71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:41.701171 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-627f3011-c322-44af-8d5b-1c4a70e26f05 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] 10.222.0.43 "GET /compute/v2.1/servers/2d3d1574-f1b5-46a9-a3b7-205a905a90f1" status: 200 len: 1315 microversion: 2.1 time: 0.752261 Oct 04 22:00:41.713293 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1823/3687] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:00:40 2022] GET /compute/v2.1/servers/2d3d1574-f1b5-46a9-a3b7-205a905a90f1 => generated 1315 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:00:41.979335 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-0b515004-00aa-4566-8f63-14d36a53adf8 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:41.980034 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-0b515004-00aa-4566-8f63-14d36a53adf8 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] [instance: d0b1b757-4a4d-4a7a-9a06-08f178a02984] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:41.995873 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0b515004-00aa-4566-8f63-14d36a53adf8 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:42.006077 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0b515004-00aa-4566-8f63-14d36a53adf8 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:42.009405 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0b515004-00aa-4566-8f63-14d36a53adf8 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:42.012886 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0b515004-00aa-4566-8f63-14d36a53adf8 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:42.015130 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0b515004-00aa-4566-8f63-14d36a53adf8 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:42.017164 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0b515004-00aa-4566-8f63-14d36a53adf8 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:42.414306 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-0b515004-00aa-4566-8f63-14d36a53adf8 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:42.424228 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-0b515004-00aa-4566-8f63-14d36a53adf8 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:42.427937 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-cb744fcc-0568-4f43-b096-72d4a4631978 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2facee4c6a40416e908083e126d2cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07a17a482a4e92b6ddbdee463c8029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:42.436650 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-0b515004-00aa-4566-8f63-14d36a53adf8 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:42.443602 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-cb744fcc-0568-4f43-b096-72d4a4631978 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d" status: 200 len: 1526 microversion: 2.1 time: 1.077017 Oct 04 22:00:42.456037 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-0b515004-00aa-4566-8f63-14d36a53adf8 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] 10.222.0.43 "GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984" status: 200 len: 1553 microversion: 2.91 time: 0.480884 Oct 04 22:00:42.466542 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1865/3688] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:00:41 2022] GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d => generated 1526 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:00:42.474669 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1824/3689] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:00:41 2022] GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984 => generated 1553 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:00:42.491551 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-b45b21c1-cfdb-4cdc-ad59-f0a1d3a549ef tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:42.494882 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-b45b21c1-cfdb-4cdc-ad59-f0a1d3a549ef tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] [instance: df147c22-6a7f-4081-83e7-97620b23700c] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:42.519918 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b45b21c1-cfdb-4cdc-ad59-f0a1d3a549ef tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:42.521720 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b45b21c1-cfdb-4cdc-ad59-f0a1d3a549ef tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:42.524215 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b45b21c1-cfdb-4cdc-ad59-f0a1d3a549ef tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:42.525231 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b45b21c1-cfdb-4cdc-ad59-f0a1d3a549ef tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:42.526917 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b45b21c1-cfdb-4cdc-ad59-f0a1d3a549ef tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:42.529683 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b45b21c1-cfdb-4cdc-ad59-f0a1d3a549ef tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:42.743546 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-cf9652d2-8af5-4690-baee-1e833da2fe29 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:42.744252 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-cf9652d2-8af5-4690-baee-1e833da2fe29 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] [instance: 2d3d1574-f1b5-46a9-a3b7-205a905a90f1] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:42.756114 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cf9652d2-8af5-4690-baee-1e833da2fe29 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:42.756618 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cf9652d2-8af5-4690-baee-1e833da2fe29 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:42.757069 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cf9652d2-8af5-4690-baee-1e833da2fe29 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:42.757796 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cf9652d2-8af5-4690-baee-1e833da2fe29 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:42.758260 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cf9652d2-8af5-4690-baee-1e833da2fe29 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:42.759675 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cf9652d2-8af5-4690-baee-1e833da2fe29 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:43.035432 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-b45b21c1-cfdb-4cdc-ad59-f0a1d3a549ef tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2034fc9060874868bc5d27370a1c351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89499d833a4a00805164f4f79ed522', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:43.042592 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-b45b21c1-cfdb-4cdc-ad59-f0a1d3a549ef tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] 10.222.0.43 "GET /compute/v2.1/servers/df147c22-6a7f-4081-83e7-97620b23700c" status: 200 len: 1514 microversion: 2.1 time: 0.574389 Oct 04 22:00:43.043486 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1866/3690] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:00:42 2022] GET /compute/v2.1/servers/df147c22-6a7f-4081-83e7-97620b23700c => generated 1514 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:00:43.110398 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-cf9652d2-8af5-4690-baee-1e833da2fe29 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd474da1382674cada32763825c7840f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cad63eb782c43b19d642fa6adaffd71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:43.132130 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-cf9652d2-8af5-4690-baee-1e833da2fe29 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] 10.222.0.43 "GET /compute/v2.1/servers/2d3d1574-f1b5-46a9-a3b7-205a905a90f1" status: 200 len: 1315 microversion: 2.1 time: 0.385302 Oct 04 22:00:43.135343 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1825/3691] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:00:42 2022] GET /compute/v2.1/servers/2d3d1574-f1b5-46a9-a3b7-205a905a90f1 => generated 1315 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:00:43.477486 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-8484e9c5-e48b-48aa-8c56-5ce31c4ceada tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:43.478111 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-8484e9c5-e48b-48aa-8c56-5ce31c4ceada tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: a4cf4fac-1e9b-4669-a6ff-30008ed3642d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:43.491799 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-44e21a7c-c4eb-4088-b68e-9d3cd2d1688a tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:43.494120 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-44e21a7c-c4eb-4088-b68e-9d3cd2d1688a tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] [instance: d0b1b757-4a4d-4a7a-9a06-08f178a02984] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:43.522089 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8484e9c5-e48b-48aa-8c56-5ce31c4ceada tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:43.528906 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8484e9c5-e48b-48aa-8c56-5ce31c4ceada tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:43.535214 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8484e9c5-e48b-48aa-8c56-5ce31c4ceada tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:43.537136 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8484e9c5-e48b-48aa-8c56-5ce31c4ceada tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:43.539307 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-44e21a7c-c4eb-4088-b68e-9d3cd2d1688a tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:43.540871 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8484e9c5-e48b-48aa-8c56-5ce31c4ceada tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:43.542624 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8484e9c5-e48b-48aa-8c56-5ce31c4ceada tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:43.545485 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-44e21a7c-c4eb-4088-b68e-9d3cd2d1688a tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:43.547049 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-44e21a7c-c4eb-4088-b68e-9d3cd2d1688a tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:43.550088 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-44e21a7c-c4eb-4088-b68e-9d3cd2d1688a tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:43.552480 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-44e21a7c-c4eb-4088-b68e-9d3cd2d1688a tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:43.554490 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-44e21a7c-c4eb-4088-b68e-9d3cd2d1688a tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:43.820889 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-44e21a7c-c4eb-4088-b68e-9d3cd2d1688a tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:43.840730 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-44e21a7c-c4eb-4088-b68e-9d3cd2d1688a tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:43.846788 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-44e21a7c-c4eb-4088-b68e-9d3cd2d1688a tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:43.863673 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-44e21a7c-c4eb-4088-b68e-9d3cd2d1688a tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] 10.222.0.43 "GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984" status: 200 len: 1553 microversion: 2.91 time: 0.374559 Oct 04 22:00:43.869988 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1826/3692] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:00:43 2022] GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984 => generated 1553 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:00:44.044212 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-8484e9c5-e48b-48aa-8c56-5ce31c4ceada tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2facee4c6a40416e908083e126d2cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07a17a482a4e92b6ddbdee463c8029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:44.055410 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-8484e9c5-e48b-48aa-8c56-5ce31c4ceada tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d" status: 200 len: 1526 microversion: 2.1 time: 0.583532 Oct 04 22:00:44.057057 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1867/3693] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:00:43 2022] GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d => generated 1526 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:00:44.072748 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-097d6aeb-13f7-4c01-88c0-9343268fff8e tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:44.073772 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-097d6aeb-13f7-4c01-88c0-9343268fff8e tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] [instance: df147c22-6a7f-4081-83e7-97620b23700c] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:44.100459 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-097d6aeb-13f7-4c01-88c0-9343268fff8e tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:44.101711 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-097d6aeb-13f7-4c01-88c0-9343268fff8e tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:44.103547 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-097d6aeb-13f7-4c01-88c0-9343268fff8e tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:44.104676 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-097d6aeb-13f7-4c01-88c0-9343268fff8e tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:44.106122 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-097d6aeb-13f7-4c01-88c0-9343268fff8e tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:44.107079 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-097d6aeb-13f7-4c01-88c0-9343268fff8e tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:44.171081 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-2575150e-e27b-4453-8581-d8ecff8441f3 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:44.172553 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-2575150e-e27b-4453-8581-d8ecff8441f3 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] [instance: 2d3d1574-f1b5-46a9-a3b7-205a905a90f1] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:44.195316 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2575150e-e27b-4453-8581-d8ecff8441f3 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:44.197500 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2575150e-e27b-4453-8581-d8ecff8441f3 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:44.198895 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2575150e-e27b-4453-8581-d8ecff8441f3 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:44.203165 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2575150e-e27b-4453-8581-d8ecff8441f3 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:44.203951 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2575150e-e27b-4453-8581-d8ecff8441f3 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:44.205925 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2575150e-e27b-4453-8581-d8ecff8441f3 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:44.491314 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-097d6aeb-13f7-4c01-88c0-9343268fff8e tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2034fc9060874868bc5d27370a1c351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89499d833a4a00805164f4f79ed522', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:44.504443 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-097d6aeb-13f7-4c01-88c0-9343268fff8e tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] 10.222.0.43 "GET /compute/v2.1/servers/df147c22-6a7f-4081-83e7-97620b23700c" status: 200 len: 1514 microversion: 2.1 time: 0.436225 Oct 04 22:00:44.521183 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1827/3694] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:00:44 2022] GET /compute/v2.1/servers/df147c22-6a7f-4081-83e7-97620b23700c => generated 1514 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:00:44.563113 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-2575150e-e27b-4453-8581-d8ecff8441f3 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd474da1382674cada32763825c7840f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cad63eb782c43b19d642fa6adaffd71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:44.576209 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-2575150e-e27b-4453-8581-d8ecff8441f3 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] 10.222.0.43 "GET /compute/v2.1/servers/2d3d1574-f1b5-46a9-a3b7-205a905a90f1" status: 200 len: 1502 microversion: 2.1 time: 0.420015 Oct 04 22:00:44.577859 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1868/3695] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:00:44 2022] GET /compute/v2.1/servers/2d3d1574-f1b5-46a9-a3b7-205a905a90f1 => generated 1502 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:00:44.604538 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-343d76ff-9a68-48b3-91d3-b10be767f9b7 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:44.605181 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-343d76ff-9a68-48b3-91d3-b10be767f9b7 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] [instance: 2d3d1574-f1b5-46a9-a3b7-205a905a90f1] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:44.616028 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-343d76ff-9a68-48b3-91d3-b10be767f9b7 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:44.616905 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-343d76ff-9a68-48b3-91d3-b10be767f9b7 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:44.617723 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-343d76ff-9a68-48b3-91d3-b10be767f9b7 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:44.618722 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-343d76ff-9a68-48b3-91d3-b10be767f9b7 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:44.619629 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-343d76ff-9a68-48b3-91d3-b10be767f9b7 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:44.621063 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-343d76ff-9a68-48b3-91d3-b10be767f9b7 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:44.752783 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-343d76ff-9a68-48b3-91d3-b10be767f9b7 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] 10.222.0.43 "DELETE /compute/v2.1/servers/2d3d1574-f1b5-46a9-a3b7-205a905a90f1/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.142481 Oct 04 22:00:44.754034 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1828/3696] 10.222.0.43 () {58 vars in 1296 bytes} [Tue Oct 4 22:00:44 2022] DELETE /compute/v2.1/servers/2d3d1574-f1b5-46a9-a3b7-205a905a90f1/os-server-password => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 22:00:44.764880 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-6a33f4e4-f5de-4302-8eaf-fbf935284282 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:44.765400 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-6a33f4e4-f5de-4302-8eaf-fbf935284282 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] [instance: 2d3d1574-f1b5-46a9-a3b7-205a905a90f1] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:44.777984 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6a33f4e4-f5de-4302-8eaf-fbf935284282 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:44.778534 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6a33f4e4-f5de-4302-8eaf-fbf935284282 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:44.778976 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6a33f4e4-f5de-4302-8eaf-fbf935284282 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:44.784316 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6a33f4e4-f5de-4302-8eaf-fbf935284282 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:44.785067 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6a33f4e4-f5de-4302-8eaf-fbf935284282 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:44.785881 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6a33f4e4-f5de-4302-8eaf-fbf935284282 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:44.856493 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-6a33f4e4-f5de-4302-8eaf-fbf935284282 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] 10.222.0.43 "GET /compute/v2.1/servers/2d3d1574-f1b5-46a9-a3b7-205a905a90f1/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.095612 Oct 04 22:00:44.857841 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1869/3697] 10.222.0.43 () {58 vars in 1293 bytes} [Tue Oct 4 22:00:44 2022] GET /compute/v2.1/servers/2d3d1574-f1b5-46a9-a3b7-205a905a90f1/os-server-password => generated 16 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 22:00:44.867465 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-c08341ed-0587-403c-941c-1acb2ae7a588 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:44.868326 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-c08341ed-0587-403c-941c-1acb2ae7a588 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] [instance: 2d3d1574-f1b5-46a9-a3b7-205a905a90f1] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:44.877658 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=3,nova_api:DELETE=5 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:00:44.880220 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c08341ed-0587-403c-941c-1acb2ae7a588 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:44.882407 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c08341ed-0587-403c-941c-1acb2ae7a588 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:44.883337 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c08341ed-0587-403c-941c-1acb2ae7a588 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:44.885380 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c08341ed-0587-403c-941c-1acb2ae7a588 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:44.886114 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c08341ed-0587-403c-941c-1acb2ae7a588 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:44.887079 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c08341ed-0587-403c-941c-1acb2ae7a588 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:44.901459 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-fc04d579-6035-4ebc-99b3-0268a9e31b40 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:44.903637 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-fc04d579-6035-4ebc-99b3-0268a9e31b40 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] [instance: d0b1b757-4a4d-4a7a-9a06-08f178a02984] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:44.919297 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fc04d579-6035-4ebc-99b3-0268a9e31b40 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:44.920343 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fc04d579-6035-4ebc-99b3-0268a9e31b40 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:44.921038 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fc04d579-6035-4ebc-99b3-0268a9e31b40 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:44.927587 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fc04d579-6035-4ebc-99b3-0268a9e31b40 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:44.928512 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fc04d579-6035-4ebc-99b3-0268a9e31b40 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:44.929200 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fc04d579-6035-4ebc-99b3-0268a9e31b40 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:44.968485 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-c08341ed-0587-403c-941c-1acb2ae7a588 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] [instance: 2d3d1574-f1b5-46a9-a3b7-205a905a90f1] Going to try to terminate instance {{(pid=134101) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 22:00:45.087830 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-fc04d579-6035-4ebc-99b3-0268a9e31b40 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:45.105608 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-fc04d579-6035-4ebc-99b3-0268a9e31b40 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:45.107852 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=2,nova_cell1:INSERT=5 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:00:45.110769 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-fc04d579-6035-4ebc-99b3-0268a9e31b40 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:45.120609 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-fc04d579-6035-4ebc-99b3-0268a9e31b40 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] 10.222.0.43 "GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984" status: 200 len: 1553 microversion: 2.91 time: 0.226186 Oct 04 22:00:45.127369 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1870/3698] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:00:44 2022] GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984 => generated 1553 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 22:00:45.135133 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-b0d2cfde-5278-4ca6-83a9-568f65ac06a4 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:45.136073 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-b0d2cfde-5278-4ca6-83a9-568f65ac06a4 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: a4cf4fac-1e9b-4669-a6ff-30008ed3642d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:45.147098 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b0d2cfde-5278-4ca6-83a9-568f65ac06a4 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:45.147934 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b0d2cfde-5278-4ca6-83a9-568f65ac06a4 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:45.148774 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b0d2cfde-5278-4ca6-83a9-568f65ac06a4 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:45.150844 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b0d2cfde-5278-4ca6-83a9-568f65ac06a4 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:45.151735 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b0d2cfde-5278-4ca6-83a9-568f65ac06a4 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:45.152293 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-c08341ed-0587-403c-941c-1acb2ae7a588 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] 10.222.0.43 "DELETE /compute/v2.1/servers/2d3d1574-f1b5-46a9-a3b7-205a905a90f1" status: 204 len: 0 microversion: 2.1 time: 0.288396 Oct 04 22:00:45.153415 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b0d2cfde-5278-4ca6-83a9-568f65ac06a4 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:45.154538 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1829/3699] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 22:00:44 2022] DELETE /compute/v2.1/servers/2d3d1574-f1b5-46a9-a3b7-205a905a90f1 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 22:00:45.164438 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-bb9294f9-549d-4e0d-8e0b-ab9ae43499dc tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:45.165546 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-bb9294f9-549d-4e0d-8e0b-ab9ae43499dc tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] [instance: 2d3d1574-f1b5-46a9-a3b7-205a905a90f1] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:45.172945 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bb9294f9-549d-4e0d-8e0b-ab9ae43499dc tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:45.173100 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bb9294f9-549d-4e0d-8e0b-ab9ae43499dc tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:45.174228 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bb9294f9-549d-4e0d-8e0b-ab9ae43499dc tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:45.175247 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bb9294f9-549d-4e0d-8e0b-ab9ae43499dc tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:45.176626 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bb9294f9-549d-4e0d-8e0b-ab9ae43499dc tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:45.177296 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bb9294f9-549d-4e0d-8e0b-ab9ae43499dc tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:45.393051 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=20 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:00:45.581975 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-bb9294f9-549d-4e0d-8e0b-ab9ae43499dc tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd474da1382674cada32763825c7840f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cad63eb782c43b19d642fa6adaffd71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:45.594167 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-bb9294f9-549d-4e0d-8e0b-ab9ae43499dc tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] 10.222.0.43 "GET /compute/v2.1/servers/2d3d1574-f1b5-46a9-a3b7-205a905a90f1" status: 200 len: 1508 microversion: 2.1 time: 0.435410 Oct 04 22:00:45.596098 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1830/3700] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:00:45 2022] GET /compute/v2.1/servers/2d3d1574-f1b5-46a9-a3b7-205a905a90f1 => generated 1508 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:00:45.610838 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-7907a86a-e3ba-4661-b6f6-b41c9cbece60 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:45.611703 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-7907a86a-e3ba-4661-b6f6-b41c9cbece60 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] [instance: df147c22-6a7f-4081-83e7-97620b23700c] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:45.626658 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7907a86a-e3ba-4661-b6f6-b41c9cbece60 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:45.628283 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7907a86a-e3ba-4661-b6f6-b41c9cbece60 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:45.630608 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7907a86a-e3ba-4661-b6f6-b41c9cbece60 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:45.631628 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7907a86a-e3ba-4661-b6f6-b41c9cbece60 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:45.632280 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7907a86a-e3ba-4661-b6f6-b41c9cbece60 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:45.634257 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7907a86a-e3ba-4661-b6f6-b41c9cbece60 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:45.673412 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-b0d2cfde-5278-4ca6-83a9-568f65ac06a4 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2facee4c6a40416e908083e126d2cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07a17a482a4e92b6ddbdee463c8029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:45.690108 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-b0d2cfde-5278-4ca6-83a9-568f65ac06a4 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d" status: 200 len: 1508 microversion: 2.1 time: 0.554925 Oct 04 22:00:45.692769 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1871/3701] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:00:45 2022] GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d => generated 1508 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:00:46.021612 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-7907a86a-e3ba-4661-b6f6-b41c9cbece60 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2034fc9060874868bc5d27370a1c351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89499d833a4a00805164f4f79ed522', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:46.036217 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-7907a86a-e3ba-4661-b6f6-b41c9cbece60 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] 10.222.0.43 "GET /compute/v2.1/servers/df147c22-6a7f-4081-83e7-97620b23700c" status: 200 len: 1514 microversion: 2.1 time: 0.436919 Oct 04 22:00:46.037954 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1831/3702] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:00:45 2022] GET /compute/v2.1/servers/df147c22-6a7f-4081-83e7-97620b23700c => generated 1514 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:00:46.164785 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-2c8730bf-c089-4dae-b481-f1516d9fb1c1 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:46.165990 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-2c8730bf-c089-4dae-b481-f1516d9fb1c1 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] [instance: d0b1b757-4a4d-4a7a-9a06-08f178a02984] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:46.180790 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2c8730bf-c089-4dae-b481-f1516d9fb1c1 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:46.182564 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2c8730bf-c089-4dae-b481-f1516d9fb1c1 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:46.184436 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2c8730bf-c089-4dae-b481-f1516d9fb1c1 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:46.187405 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2c8730bf-c089-4dae-b481-f1516d9fb1c1 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:46.188142 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2c8730bf-c089-4dae-b481-f1516d9fb1c1 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:46.191305 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2c8730bf-c089-4dae-b481-f1516d9fb1c1 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:46.309521 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-2c8730bf-c089-4dae-b481-f1516d9fb1c1 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:46.313178 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=100 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:00:46.319010 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-2c8730bf-c089-4dae-b481-f1516d9fb1c1 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:46.323618 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-2c8730bf-c089-4dae-b481-f1516d9fb1c1 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:46.337874 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-2c8730bf-c089-4dae-b481-f1516d9fb1c1 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] 10.222.0.43 "GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984" status: 200 len: 1553 microversion: 2.91 time: 0.177365 Oct 04 22:00:46.347417 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1872/3703] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:00:46 2022] GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984 => generated 1553 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:00:46.625405 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-63e84b14-3f7f-43cb-acf5-0ecb48023a62 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:46.626730 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-63e84b14-3f7f-43cb-acf5-0ecb48023a62 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] [instance: 2d3d1574-f1b5-46a9-a3b7-205a905a90f1] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:46.633346 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-63e84b14-3f7f-43cb-acf5-0ecb48023a62 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:46.639769 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-63e84b14-3f7f-43cb-acf5-0ecb48023a62 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:46.641521 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-63e84b14-3f7f-43cb-acf5-0ecb48023a62 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:46.642637 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-63e84b14-3f7f-43cb-acf5-0ecb48023a62 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:46.644729 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-63e84b14-3f7f-43cb-acf5-0ecb48023a62 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:46.645649 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-63e84b14-3f7f-43cb-acf5-0ecb48023a62 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:46.718515 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-a6a7417c-6ea9-462d-a7be-20b686f93a5c tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:46.719104 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-a6a7417c-6ea9-462d-a7be-20b686f93a5c tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: a4cf4fac-1e9b-4669-a6ff-30008ed3642d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:46.722491 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell0:SELECT=16 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:00:46.732129 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a6a7417c-6ea9-462d-a7be-20b686f93a5c tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:46.734415 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a6a7417c-6ea9-462d-a7be-20b686f93a5c tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:46.737341 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a6a7417c-6ea9-462d-a7be-20b686f93a5c tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:46.738528 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a6a7417c-6ea9-462d-a7be-20b686f93a5c tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:46.739344 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a6a7417c-6ea9-462d-a7be-20b686f93a5c tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:46.744639 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a6a7417c-6ea9-462d-a7be-20b686f93a5c tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:47.188524 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-63e84b14-3f7f-43cb-acf5-0ecb48023a62 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd474da1382674cada32763825c7840f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cad63eb782c43b19d642fa6adaffd71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:47.204195 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-63e84b14-3f7f-43cb-acf5-0ecb48023a62 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] 10.222.0.43 "GET /compute/v2.1/servers/2d3d1574-f1b5-46a9-a3b7-205a905a90f1" status: 200 len: 1508 microversion: 2.1 time: 0.585999 Oct 04 22:00:47.207311 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1832/3704] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:00:46 2022] GET /compute/v2.1/servers/2d3d1574-f1b5-46a9-a3b7-205a905a90f1 => generated 1508 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:00:47.225402 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-ebb2d772-8666-4177-983c-19fc6833abe7 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:47.227967 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-ebb2d772-8666-4177-983c-19fc6833abe7 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] [instance: df147c22-6a7f-4081-83e7-97620b23700c] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:47.250839 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ebb2d772-8666-4177-983c-19fc6833abe7 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:47.251344 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ebb2d772-8666-4177-983c-19fc6833abe7 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:47.251891 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ebb2d772-8666-4177-983c-19fc6833abe7 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:47.252496 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ebb2d772-8666-4177-983c-19fc6833abe7 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:47.252957 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ebb2d772-8666-4177-983c-19fc6833abe7 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:47.253388 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ebb2d772-8666-4177-983c-19fc6833abe7 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:47.273690 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-a6a7417c-6ea9-462d-a7be-20b686f93a5c tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2facee4c6a40416e908083e126d2cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07a17a482a4e92b6ddbdee463c8029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:47.285087 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-a6a7417c-6ea9-462d-a7be-20b686f93a5c tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d" status: 200 len: 1508 microversion: 2.1 time: 0.571989 Oct 04 22:00:47.291682 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1873/3705] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:00:46 2022] GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d => generated 1508 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:00:47.379487 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-e93999ff-1b8f-4841-8f82-2748d896cf13 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:47.380394 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-e93999ff-1b8f-4841-8f82-2748d896cf13 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] [instance: d0b1b757-4a4d-4a7a-9a06-08f178a02984] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:47.398909 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e93999ff-1b8f-4841-8f82-2748d896cf13 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:47.400017 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e93999ff-1b8f-4841-8f82-2748d896cf13 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:47.400647 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e93999ff-1b8f-4841-8f82-2748d896cf13 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:47.401824 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e93999ff-1b8f-4841-8f82-2748d896cf13 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:47.403049 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e93999ff-1b8f-4841-8f82-2748d896cf13 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:47.403686 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e93999ff-1b8f-4841-8f82-2748d896cf13 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:47.613587 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-e93999ff-1b8f-4841-8f82-2748d896cf13 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:47.636615 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-e93999ff-1b8f-4841-8f82-2748d896cf13 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:47.639372 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-e93999ff-1b8f-4841-8f82-2748d896cf13 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:47.652368 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-e93999ff-1b8f-4841-8f82-2748d896cf13 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] 10.222.0.43 "GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984" status: 200 len: 1553 microversion: 2.91 time: 0.276704 Oct 04 22:00:47.653498 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1874/3706] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:00:47 2022] GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984 => generated 1553 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 22:00:47.751197 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-ebb2d772-8666-4177-983c-19fc6833abe7 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2034fc9060874868bc5d27370a1c351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89499d833a4a00805164f4f79ed522', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:47.764171 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-ebb2d772-8666-4177-983c-19fc6833abe7 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] 10.222.0.43 "GET /compute/v2.1/servers/df147c22-6a7f-4081-83e7-97620b23700c" status: 200 len: 1520 microversion: 2.1 time: 0.554007 Oct 04 22:00:47.772060 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1833/3707] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:00:47 2022] GET /compute/v2.1/servers/df147c22-6a7f-4081-83e7-97620b23700c => generated 1520 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:00:48.229460 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-dc4cb604-998f-4d9d-987f-40c7321ec985 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:48.231620 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-dc4cb604-998f-4d9d-987f-40c7321ec985 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] [instance: 2d3d1574-f1b5-46a9-a3b7-205a905a90f1] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:48.254902 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dc4cb604-998f-4d9d-987f-40c7321ec985 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:48.256339 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dc4cb604-998f-4d9d-987f-40c7321ec985 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:48.256981 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dc4cb604-998f-4d9d-987f-40c7321ec985 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:48.257913 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dc4cb604-998f-4d9d-987f-40c7321ec985 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:48.262210 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dc4cb604-998f-4d9d-987f-40c7321ec985 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:48.264148 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dc4cb604-998f-4d9d-987f-40c7321ec985 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:48.312108 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-369e29ab-1998-4eb6-9e4e-a97dcf1388c5 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:48.312727 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-369e29ab-1998-4eb6-9e4e-a97dcf1388c5 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: a4cf4fac-1e9b-4669-a6ff-30008ed3642d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:48.321795 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-369e29ab-1998-4eb6-9e4e-a97dcf1388c5 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:48.322309 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-369e29ab-1998-4eb6-9e4e-a97dcf1388c5 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:48.322770 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-369e29ab-1998-4eb6-9e4e-a97dcf1388c5 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:48.328901 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-369e29ab-1998-4eb6-9e4e-a97dcf1388c5 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:48.330800 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-369e29ab-1998-4eb6-9e4e-a97dcf1388c5 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:48.336239 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-369e29ab-1998-4eb6-9e4e-a97dcf1388c5 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:48.645417 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-369e29ab-1998-4eb6-9e4e-a97dcf1388c5 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2facee4c6a40416e908083e126d2cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07a17a482a4e92b6ddbdee463c8029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:48.677512 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-369e29ab-1998-4eb6-9e4e-a97dcf1388c5 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d" status: 200 len: 1508 microversion: 2.1 time: 0.369693 Oct 04 22:00:48.680467 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1834/3708] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:00:48 2022] GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d => generated 1508 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:00:48.701180 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-cc39f49d-6e65-4938-b9d5-6e2b068a59a4 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:48.703201 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-cc39f49d-6e65-4938-b9d5-6e2b068a59a4 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] [instance: d0b1b757-4a4d-4a7a-9a06-08f178a02984] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:48.719208 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-dc4cb604-998f-4d9d-987f-40c7321ec985 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd474da1382674cada32763825c7840f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cad63eb782c43b19d642fa6adaffd71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:48.731469 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cc39f49d-6e65-4938-b9d5-6e2b068a59a4 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:48.732217 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cc39f49d-6e65-4938-b9d5-6e2b068a59a4 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:48.732752 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cc39f49d-6e65-4938-b9d5-6e2b068a59a4 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:48.734639 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cc39f49d-6e65-4938-b9d5-6e2b068a59a4 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:48.735625 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cc39f49d-6e65-4938-b9d5-6e2b068a59a4 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:48.736405 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cc39f49d-6e65-4938-b9d5-6e2b068a59a4 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:48.743103 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-dc4cb604-998f-4d9d-987f-40c7321ec985 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] 10.222.0.43 "GET /compute/v2.1/servers/2d3d1574-f1b5-46a9-a3b7-205a905a90f1" status: 200 len: 1508 microversion: 2.1 time: 0.514104 Oct 04 22:00:48.744266 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1875/3709] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:00:48 2022] GET /compute/v2.1/servers/2d3d1574-f1b5-46a9-a3b7-205a905a90f1 => generated 1508 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:00:48.802508 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-09c94a28-2b6e-4210-8504-3f2f5eaf8a89 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:48.806443 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-09c94a28-2b6e-4210-8504-3f2f5eaf8a89 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] [instance: df147c22-6a7f-4081-83e7-97620b23700c] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:48.837355 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-09c94a28-2b6e-4210-8504-3f2f5eaf8a89 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:48.841590 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-09c94a28-2b6e-4210-8504-3f2f5eaf8a89 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:48.844796 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-09c94a28-2b6e-4210-8504-3f2f5eaf8a89 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:48.845698 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-09c94a28-2b6e-4210-8504-3f2f5eaf8a89 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:48.849476 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-09c94a28-2b6e-4210-8504-3f2f5eaf8a89 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:48.852491 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-09c94a28-2b6e-4210-8504-3f2f5eaf8a89 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:48.889528 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-cc39f49d-6e65-4938-b9d5-6e2b068a59a4 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:48.904045 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-cc39f49d-6e65-4938-b9d5-6e2b068a59a4 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:48.906694 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-cc39f49d-6e65-4938-b9d5-6e2b068a59a4 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:48.923086 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-cc39f49d-6e65-4938-b9d5-6e2b068a59a4 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] 10.222.0.43 "GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984" status: 200 len: 1553 microversion: 2.91 time: 0.235738 Oct 04 22:00:48.924036 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1835/3710] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:00:48 2022] GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984 => generated 1553 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:00:49.289652 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-1ab4d72f-768e-484d-aa57-a3eb1e7a5a88 req-d7b11e50-a435-4403-b4a9-d9faadbc13a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4cf4fac-1e9b-4669-a6ff-30008ed3642d", "name": "network-vif-unplugged", "status": "completed", "tag": "17823d3d-fc62-47ee-8e12-cf0154daa955"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:00:49.302897 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-09c94a28-2b6e-4210-8504-3f2f5eaf8a89 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2034fc9060874868bc5d27370a1c351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89499d833a4a00805164f4f79ed522', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:49.336965 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-09c94a28-2b6e-4210-8504-3f2f5eaf8a89 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] 10.222.0.43 "GET /compute/v2.1/servers/df147c22-6a7f-4081-83e7-97620b23700c" status: 200 len: 1520 microversion: 2.1 time: 0.531121 Oct 04 22:00:49.344677 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1876/3711] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:00:48 2022] GET /compute/v2.1/servers/df147c22-6a7f-4081-83e7-97620b23700c => generated 1520 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:00:49.373317 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-1ab4d72f-768e-484d-aa57-a3eb1e7a5a88 req-d7b11e50-a435-4403-b4a9-d9faadbc13a4 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:49.373790 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-1ab4d72f-768e-484d-aa57-a3eb1e7a5a88 req-d7b11e50-a435-4403-b4a9-d9faadbc13a4 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:49.376255 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-1ab4d72f-768e-484d-aa57-a3eb1e7a5a88 req-d7b11e50-a435-4403-b4a9-d9faadbc13a4 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:49.413041 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-1ab4d72f-768e-484d-aa57-a3eb1e7a5a88 req-d7b11e50-a435-4403-b4a9-d9faadbc13a4 service nova] Creating event network-vif-unplugged:17823d3d-fc62-47ee-8e12-cf0154daa955 for instance a4cf4fac-1e9b-4669-a6ff-30008ed3642d on n-h1-860284-1 Oct 04 22:00:49.429072 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-1ab4d72f-768e-484d-aa57-a3eb1e7a5a88 req-d7b11e50-a435-4403-b4a9-d9faadbc13a4 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.143391 Oct 04 22:00:49.432533 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1836/3712] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:00:49 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:00:49.707650 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-caa081b8-6b33-4f0a-8b16-76d8c5d9175f tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:49.708282 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-caa081b8-6b33-4f0a-8b16-76d8c5d9175f tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: a4cf4fac-1e9b-4669-a6ff-30008ed3642d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:49.723405 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-caa081b8-6b33-4f0a-8b16-76d8c5d9175f tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:49.723898 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-caa081b8-6b33-4f0a-8b16-76d8c5d9175f tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:49.724334 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-caa081b8-6b33-4f0a-8b16-76d8c5d9175f tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:49.725063 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-caa081b8-6b33-4f0a-8b16-76d8c5d9175f tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:49.725497 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-caa081b8-6b33-4f0a-8b16-76d8c5d9175f tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:49.725938 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-caa081b8-6b33-4f0a-8b16-76d8c5d9175f tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:49.771937 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-048809d6-1269-4bd5-802c-466f57dc17f0 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:49.772647 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-048809d6-1269-4bd5-802c-466f57dc17f0 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] [instance: 2d3d1574-f1b5-46a9-a3b7-205a905a90f1] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:49.807041 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-048809d6-1269-4bd5-802c-466f57dc17f0 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:49.807350 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-048809d6-1269-4bd5-802c-466f57dc17f0 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:49.833311 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-048809d6-1269-4bd5-802c-466f57dc17f0 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:49.839517 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-048809d6-1269-4bd5-802c-466f57dc17f0 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:49.840832 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-048809d6-1269-4bd5-802c-466f57dc17f0 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:49.845588 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-048809d6-1269-4bd5-802c-466f57dc17f0 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:50.226032 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-048809d6-1269-4bd5-802c-466f57dc17f0 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd474da1382674cada32763825c7840f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cad63eb782c43b19d642fa6adaffd71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:50.240484 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-048809d6-1269-4bd5-802c-466f57dc17f0 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] 10.222.0.43 "GET /compute/v2.1/servers/2d3d1574-f1b5-46a9-a3b7-205a905a90f1" status: 200 len: 1466 microversion: 2.1 time: 0.471927 Oct 04 22:00:50.244345 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1837/3713] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:00:49 2022] GET /compute/v2.1/servers/2d3d1574-f1b5-46a9-a3b7-205a905a90f1 => generated 1466 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:00:50.252242 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-0e282895-870a-488f-8b5a-22f256fb65ce req-f1a1b93d-80ea-444c-9ef9-2d686abf8c07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d3d1574-f1b5-46a9-a3b7-205a905a90f1", "name": "network-vif-deleted", "tag": "c50abe74-5b16-4f5f-8682-58a99b7b2a0b"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:00:50.312773 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-0e282895-870a-488f-8b5a-22f256fb65ce req-f1a1b93d-80ea-444c-9ef9-2d686abf8c07 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:50.315325 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-0e282895-870a-488f-8b5a-22f256fb65ce req-f1a1b93d-80ea-444c-9ef9-2d686abf8c07 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:50.317584 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-0e282895-870a-488f-8b5a-22f256fb65ce req-f1a1b93d-80ea-444c-9ef9-2d686abf8c07 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:50.367910 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-0e282895-870a-488f-8b5a-22f256fb65ce req-f1a1b93d-80ea-444c-9ef9-2d686abf8c07 service nova] Creating event network-vif-deleted:c50abe74-5b16-4f5f-8682-58a99b7b2a0b for instance 2d3d1574-f1b5-46a9-a3b7-205a905a90f1 on n-h1-860284-1 Oct 04 22:00:50.387732 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-0e282895-870a-488f-8b5a-22f256fb65ce req-f1a1b93d-80ea-444c-9ef9-2d686abf8c07 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.140061 Oct 04 22:00:50.389735 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1838/3714] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:00:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:00:50.393741 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-caa081b8-6b33-4f0a-8b16-76d8c5d9175f tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2facee4c6a40416e908083e126d2cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07a17a482a4e92b6ddbdee463c8029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:50.407216 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-32bc2cbb-dd3d-4d68-8a9c-83f53a43aa1e tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:50.410136 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-32bc2cbb-dd3d-4d68-8a9c-83f53a43aa1e tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] [instance: d0b1b757-4a4d-4a7a-9a06-08f178a02984] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:50.410343 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-caa081b8-6b33-4f0a-8b16-76d8c5d9175f tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d" status: 200 len: 1508 microversion: 2.1 time: 0.701449 Oct 04 22:00:50.425966 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1877/3715] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:00:49 2022] GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d => generated 1508 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:00:50.425966 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-84269a17-57c0-4280-b5a1-e8a8d15d5b8b tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:50.425966 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-84269a17-57c0-4280-b5a1-e8a8d15d5b8b tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] [instance: df147c22-6a7f-4081-83e7-97620b23700c] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:50.428300 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-84269a17-57c0-4280-b5a1-e8a8d15d5b8b tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:50.428300 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-84269a17-57c0-4280-b5a1-e8a8d15d5b8b tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:50.428300 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-84269a17-57c0-4280-b5a1-e8a8d15d5b8b tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:50.428891 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-84269a17-57c0-4280-b5a1-e8a8d15d5b8b tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:50.429401 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-84269a17-57c0-4280-b5a1-e8a8d15d5b8b tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:50.430031 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-84269a17-57c0-4280-b5a1-e8a8d15d5b8b tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:50.500597 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-32bc2cbb-dd3d-4d68-8a9c-83f53a43aa1e tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:50.505980 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-32bc2cbb-dd3d-4d68-8a9c-83f53a43aa1e tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:50.506754 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-32bc2cbb-dd3d-4d68-8a9c-83f53a43aa1e tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:50.509089 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-32bc2cbb-dd3d-4d68-8a9c-83f53a43aa1e tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:50.509770 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-32bc2cbb-dd3d-4d68-8a9c-83f53a43aa1e tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:50.510445 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-32bc2cbb-dd3d-4d68-8a9c-83f53a43aa1e tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:50.754396 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-32bc2cbb-dd3d-4d68-8a9c-83f53a43aa1e tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:50.768685 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-32bc2cbb-dd3d-4d68-8a9c-83f53a43aa1e tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:50.774289 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-32bc2cbb-dd3d-4d68-8a9c-83f53a43aa1e tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:50.794238 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-32bc2cbb-dd3d-4d68-8a9c-83f53a43aa1e tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] 10.222.0.43 "GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984" status: 200 len: 1553 microversion: 2.91 time: 0.402029 Oct 04 22:00:50.797894 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1839/3716] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:00:50 2022] GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984 => generated 1553 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:00:51.004815 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-84269a17-57c0-4280-b5a1-e8a8d15d5b8b tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2034fc9060874868bc5d27370a1c351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89499d833a4a00805164f4f79ed522', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:51.021870 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-84269a17-57c0-4280-b5a1-e8a8d15d5b8b tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] 10.222.0.43 "GET /compute/v2.1/servers/df147c22-6a7f-4081-83e7-97620b23700c" status: 200 len: 1520 microversion: 2.1 time: 0.609247 Oct 04 22:00:51.026559 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1878/3717] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:00:50 2022] GET /compute/v2.1/servers/df147c22-6a7f-4081-83e7-97620b23700c => generated 1520 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:00:51.288954 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-2bb4de00-0021-4773-931a-2186345964b3 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:51.290661 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-2bb4de00-0021-4773-931a-2186345964b3 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] [instance: 2d3d1574-f1b5-46a9-a3b7-205a905a90f1] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:51.302920 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2bb4de00-0021-4773-931a-2186345964b3 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:51.303570 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2bb4de00-0021-4773-931a-2186345964b3 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:51.327750 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2bb4de00-0021-4773-931a-2186345964b3 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:51.332078 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2bb4de00-0021-4773-931a-2186345964b3 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:51.334187 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2bb4de00-0021-4773-931a-2186345964b3 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:51.338629 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2bb4de00-0021-4773-931a-2186345964b3 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:51.437735 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2bb4de00-0021-4773-931a-2186345964b3 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:51.441864 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2bb4de00-0021-4773-931a-2186345964b3 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:51.442789 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2bb4de00-0021-4773-931a-2186345964b3 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:51.445853 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.objects.instance [None req-2bb4de00-0021-4773-931a-2186345964b3 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Lazy-loading 'fault' on Instance uuid 2d3d1574-f1b5-46a9-a3b7-205a905a90f1 {{(pid=134101) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 22:00:51.460547 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-f2667f7d-9abf-4e59-a565-6e23f1719dd2 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:51.461171 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-f2667f7d-9abf-4e59-a565-6e23f1719dd2 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: a4cf4fac-1e9b-4669-a6ff-30008ed3642d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:51.474034 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f2667f7d-9abf-4e59-a565-6e23f1719dd2 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:51.479392 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f2667f7d-9abf-4e59-a565-6e23f1719dd2 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:51.481187 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f2667f7d-9abf-4e59-a565-6e23f1719dd2 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:51.484103 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f2667f7d-9abf-4e59-a565-6e23f1719dd2 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:51.485147 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f2667f7d-9abf-4e59-a565-6e23f1719dd2 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:51.486902 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f2667f7d-9abf-4e59-a565-6e23f1719dd2 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:51.582580 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-2bb4de00-0021-4773-931a-2186345964b3 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd474da1382674cada32763825c7840f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cad63eb782c43b19d642fa6adaffd71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:51.598011 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-2bb4de00-0021-4773-931a-2186345964b3 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] 10.222.0.43 "GET /compute/v2.1/servers/2d3d1574-f1b5-46a9-a3b7-205a905a90f1" status: 200 len: 1305 microversion: 2.1 time: 0.313051 Oct 04 22:00:51.599626 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1840/3718] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:00:51 2022] GET /compute/v2.1/servers/2d3d1574-f1b5-46a9-a3b7-205a905a90f1 => generated 1305 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:00:51.814207 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-f2667f7d-9abf-4e59-a565-6e23f1719dd2 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2facee4c6a40416e908083e126d2cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07a17a482a4e92b6ddbdee463c8029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:51.831120 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-115698b5-c7af-42c9-b225-ab134af88668 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:51.831914 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-115698b5-c7af-42c9-b225-ab134af88668 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] [instance: d0b1b757-4a4d-4a7a-9a06-08f178a02984] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:51.839590 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-f2667f7d-9abf-4e59-a565-6e23f1719dd2 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d" status: 200 len: 1508 microversion: 2.1 time: 0.383140 Oct 04 22:00:51.844665 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1879/3719] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:00:51 2022] GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d => generated 1508 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:00:51.859006 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-115698b5-c7af-42c9-b225-ab134af88668 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:51.859688 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-115698b5-c7af-42c9-b225-ab134af88668 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:51.860324 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-115698b5-c7af-42c9-b225-ab134af88668 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:51.861509 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-115698b5-c7af-42c9-b225-ab134af88668 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:51.863987 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-115698b5-c7af-42c9-b225-ab134af88668 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:51.864768 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-115698b5-c7af-42c9-b225-ab134af88668 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:51.919656 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-ac35ad55-7ec1-4fb0-b588-7b376be362c8 req-32eb4426-1985-4a89-aeea-9155c7be327b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df147c22-6a7f-4081-83e7-97620b23700c", "name": "network-vif-unplugged", "status": "completed", "tag": "fdfe513a-ef00-4ef2-972c-073f6e43c48b"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:00:51.952508 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-ac35ad55-7ec1-4fb0-b588-7b376be362c8 req-32eb4426-1985-4a89-aeea-9155c7be327b service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:51.953382 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-ac35ad55-7ec1-4fb0-b588-7b376be362c8 req-32eb4426-1985-4a89-aeea-9155c7be327b service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:51.967780 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-ac35ad55-7ec1-4fb0-b588-7b376be362c8 req-32eb4426-1985-4a89-aeea-9155c7be327b service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:52.003017 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-ac35ad55-7ec1-4fb0-b588-7b376be362c8 req-32eb4426-1985-4a89-aeea-9155c7be327b service nova] Creating event network-vif-unplugged:fdfe513a-ef00-4ef2-972c-073f6e43c48b for instance df147c22-6a7f-4081-83e7-97620b23700c on n-h1-860284-1 Oct 04 22:00:52.017882 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-ac35ad55-7ec1-4fb0-b588-7b376be362c8 req-32eb4426-1985-4a89-aeea-9155c7be327b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.103407 Oct 04 22:00:52.018967 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1880/3720] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:00:51 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:00:52.053079 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-f875becf-45ae-4ba6-95a4-0ac1d2bf34a2 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:52.054715 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-f875becf-45ae-4ba6-95a4-0ac1d2bf34a2 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] [instance: df147c22-6a7f-4081-83e7-97620b23700c] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:52.070995 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f875becf-45ae-4ba6-95a4-0ac1d2bf34a2 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:52.073495 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f875becf-45ae-4ba6-95a4-0ac1d2bf34a2 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:52.075294 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f875becf-45ae-4ba6-95a4-0ac1d2bf34a2 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:52.077967 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f875becf-45ae-4ba6-95a4-0ac1d2bf34a2 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:52.081203 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f875becf-45ae-4ba6-95a4-0ac1d2bf34a2 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:52.083627 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f875becf-45ae-4ba6-95a4-0ac1d2bf34a2 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:52.138287 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-115698b5-c7af-42c9-b225-ab134af88668 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:52.158427 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-115698b5-c7af-42c9-b225-ab134af88668 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:52.159858 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-115698b5-c7af-42c9-b225-ab134af88668 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:52.192168 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-115698b5-c7af-42c9-b225-ab134af88668 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] 10.222.0.43 "GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984" status: 200 len: 1553 microversion: 2.91 time: 0.365299 Oct 04 22:00:52.192805 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1841/3721] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:00:51 2022] GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984 => generated 1553 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:00:52.511345 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-f875becf-45ae-4ba6-95a4-0ac1d2bf34a2 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2034fc9060874868bc5d27370a1c351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89499d833a4a00805164f4f79ed522', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:52.532760 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-f875becf-45ae-4ba6-95a4-0ac1d2bf34a2 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] 10.222.0.43 "GET /compute/v2.1/servers/df147c22-6a7f-4081-83e7-97620b23700c" status: 200 len: 1520 microversion: 2.1 time: 0.478501 Oct 04 22:00:52.533851 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1881/3722] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:00:52 2022] GET /compute/v2.1/servers/df147c22-6a7f-4081-83e7-97620b23700c => generated 1520 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:00:52.629419 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-4d24a59a-b0cc-4fd8-845a-e75c5f9a8b23 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:52.630265 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-4d24a59a-b0cc-4fd8-845a-e75c5f9a8b23 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] [instance: 2d3d1574-f1b5-46a9-a3b7-205a905a90f1] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:52.639798 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4d24a59a-b0cc-4fd8-845a-e75c5f9a8b23 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:52.640297 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4d24a59a-b0cc-4fd8-845a-e75c5f9a8b23 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:52.640735 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4d24a59a-b0cc-4fd8-845a-e75c5f9a8b23 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:52.641447 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4d24a59a-b0cc-4fd8-845a-e75c5f9a8b23 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:52.641902 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4d24a59a-b0cc-4fd8-845a-e75c5f9a8b23 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:52.642325 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4d24a59a-b0cc-4fd8-845a-e75c5f9a8b23 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:52.747622 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4d24a59a-b0cc-4fd8-845a-e75c5f9a8b23 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:52.748426 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4d24a59a-b0cc-4fd8-845a-e75c5f9a8b23 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:52.749038 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4d24a59a-b0cc-4fd8-845a-e75c5f9a8b23 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:52.749827 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.objects.instance [None req-4d24a59a-b0cc-4fd8-845a-e75c5f9a8b23 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Lazy-loading 'fault' on Instance uuid 2d3d1574-f1b5-46a9-a3b7-205a905a90f1 {{(pid=134101) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 22:00:52.832889 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-4d24a59a-b0cc-4fd8-845a-e75c5f9a8b23 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd474da1382674cada32763825c7840f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cad63eb782c43b19d642fa6adaffd71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:52.845965 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-4d24a59a-b0cc-4fd8-845a-e75c5f9a8b23 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] 10.222.0.43 "GET /compute/v2.1/servers/2d3d1574-f1b5-46a9-a3b7-205a905a90f1" status: 200 len: 1305 microversion: 2.1 time: 0.221745 Oct 04 22:00:52.858552 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1842/3723] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:00:52 2022] GET /compute/v2.1/servers/2d3d1574-f1b5-46a9-a3b7-205a905a90f1 => generated 1305 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:00:52.870747 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-84676da8-d91f-4a5d-a772-04da9d1b3d46 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:52.871369 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-84676da8-d91f-4a5d-a772-04da9d1b3d46 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: a4cf4fac-1e9b-4669-a6ff-30008ed3642d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:52.888093 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-84676da8-d91f-4a5d-a772-04da9d1b3d46 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:52.898190 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-84676da8-d91f-4a5d-a772-04da9d1b3d46 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:52.898727 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-84676da8-d91f-4a5d-a772-04da9d1b3d46 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:52.899508 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-84676da8-d91f-4a5d-a772-04da9d1b3d46 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:52.899974 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-84676da8-d91f-4a5d-a772-04da9d1b3d46 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:52.900406 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-84676da8-d91f-4a5d-a772-04da9d1b3d46 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:53.234259 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-41a08e80-3254-4d90-be6e-1bc197b096ae tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:53.235292 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-41a08e80-3254-4d90-be6e-1bc197b096ae tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] [instance: d0b1b757-4a4d-4a7a-9a06-08f178a02984] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:53.243578 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-41a08e80-3254-4d90-be6e-1bc197b096ae tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:53.244464 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-41a08e80-3254-4d90-be6e-1bc197b096ae tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:53.245173 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-41a08e80-3254-4d90-be6e-1bc197b096ae tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:53.247516 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-41a08e80-3254-4d90-be6e-1bc197b096ae tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:53.248266 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-41a08e80-3254-4d90-be6e-1bc197b096ae tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:53.248938 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-41a08e80-3254-4d90-be6e-1bc197b096ae tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:53.285449 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-84676da8-d91f-4a5d-a772-04da9d1b3d46 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2facee4c6a40416e908083e126d2cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07a17a482a4e92b6ddbdee463c8029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:53.321552 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-84676da8-d91f-4a5d-a772-04da9d1b3d46 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d" status: 200 len: 1511 microversion: 2.1 time: 0.453166 Oct 04 22:00:53.325024 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1882/3724] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:00:52 2022] GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d => generated 1511 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:00:53.355160 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-bf7badcf-e735-4d53-8d7a-d80b5cc0f8ac tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:53.356635 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-bf7badcf-e735-4d53-8d7a-d80b5cc0f8ac tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: a4cf4fac-1e9b-4669-a6ff-30008ed3642d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:53.366507 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bf7badcf-e735-4d53-8d7a-d80b5cc0f8ac tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:53.368325 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bf7badcf-e735-4d53-8d7a-d80b5cc0f8ac tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:53.369612 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bf7badcf-e735-4d53-8d7a-d80b5cc0f8ac tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:53.372148 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bf7badcf-e735-4d53-8d7a-d80b5cc0f8ac tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:53.373195 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bf7badcf-e735-4d53-8d7a-d80b5cc0f8ac tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:53.373937 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bf7badcf-e735-4d53-8d7a-d80b5cc0f8ac tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:53.594662 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-41a08e80-3254-4d90-be6e-1bc197b096ae tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:53.609694 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-41a08e80-3254-4d90-be6e-1bc197b096ae tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:53.617409 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-41a08e80-3254-4d90-be6e-1bc197b096ae tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:53.665239 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-41a08e80-3254-4d90-be6e-1bc197b096ae tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] 10.222.0.43 "GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984" status: 200 len: 1553 microversion: 2.91 time: 0.440731 Oct 04 22:00:53.688561 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1843/3725] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:00:53 2022] GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984 => generated 1553 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:00:53.734516 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-f8742353-0318-4f9a-ba30-e02b0ad50531 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:53.736139 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-f8742353-0318-4f9a-ba30-e02b0ad50531 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] [instance: df147c22-6a7f-4081-83e7-97620b23700c] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:53.767644 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f8742353-0318-4f9a-ba30-e02b0ad50531 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:53.779657 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f8742353-0318-4f9a-ba30-e02b0ad50531 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:53.780686 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f8742353-0318-4f9a-ba30-e02b0ad50531 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:53.783805 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f8742353-0318-4f9a-ba30-e02b0ad50531 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:53.791565 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f8742353-0318-4f9a-ba30-e02b0ad50531 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:53.792603 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f8742353-0318-4f9a-ba30-e02b0ad50531 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:53.805522 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-bf7badcf-e735-4d53-8d7a-d80b5cc0f8ac tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2facee4c6a40416e908083e126d2cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07a17a482a4e92b6ddbdee463c8029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:53.826090 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-bf7badcf-e735-4d53-8d7a-d80b5cc0f8ac tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d" status: 200 len: 1511 microversion: 2.1 time: 0.477864 Oct 04 22:00:53.829743 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1883/3726] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:00:53 2022] GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d => generated 1511 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:00:53.881217 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-dc172e68-4b43-476e-8421-53d8291257e0 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:53.881845 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-dc172e68-4b43-476e-8421-53d8291257e0 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] [instance: 2d3d1574-f1b5-46a9-a3b7-205a905a90f1] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:53.901974 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dc172e68-4b43-476e-8421-53d8291257e0 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:53.903113 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dc172e68-4b43-476e-8421-53d8291257e0 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:53.903555 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dc172e68-4b43-476e-8421-53d8291257e0 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:53.918489 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dc172e68-4b43-476e-8421-53d8291257e0 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:53.920335 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dc172e68-4b43-476e-8421-53d8291257e0 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:53.921014 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dc172e68-4b43-476e-8421-53d8291257e0 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:53.989123 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-dc172e68-4b43-476e-8421-53d8291257e0 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] HTTP exception thrown: Instance 2d3d1574-f1b5-46a9-a3b7-205a905a90f1 could not be found. Oct 04 22:00:53.995013 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-dc172e68-4b43-476e-8421-53d8291257e0 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Request method failure captured: Oct 04 22:00:53.995013 n-d-860284-1 devstack@n-api.service[134102]: request: GET /compute/v2.1/servers/2d3d1574-f1b5-46a9-a3b7-205a905a90f1 HTTP/1.1 Oct 04 22:00:53.995013 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 22:00:53.995013 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 22:00:53.995013 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 22:00:53.995013 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 22:00:53.995013 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 22:00:53.995013 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 22:00:53.995013 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 22:00:53.995013 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 22:00:53.995013 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPKzyVyYk1N7FbDePieeRpYZou63eBYenbhG-9GYQKcJdYD7Za2nl4aJCzXrOpKgsJzQFQt1YoGadKnH93AFCykJAgP5NXYivz0_2lNROOuhJc6ST-bJjEzbsdFRxwEITxNH7xKEqCGF1DX6pqgSAiytwvzJ2DcJHm34US7ib6cnndPI Oct 04 22:00:53.995013 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 22:00:53.995013 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 22:00:53.995013 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 22:00:53.995013 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 22:00:53.995013 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 22:00:53.995013 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 22:00:53.995013 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: 5cad63eb782c43b19d642fa6adaffd71 Oct 04 22:00:53.995013 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-ServerPasswordTestJSON-1950754460 Oct 04 22:00:53.995013 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 22:00:53.995013 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 22:00:53.995013 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5cad63eb782c43b19d642fa6adaffd71"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_5cad63eb782c43b19d642fa6adaffd71", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5cad63eb782c43b19d642fa6adaffd71"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/5cad63eb782c43b19d642fa6adaffd71"}]}] Oct 04 22:00:53.995013 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-ServerPasswordTestJSON-1950754460 Oct 04 22:00:53.995013 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: 5cad63eb782c43b19d642fa6adaffd71 Oct 04 22:00:53.995013 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-ServerPasswordTestJSON-1950754460 Oct 04 22:00:53.995013 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-ServerPasswordTestJSON-1950754460-project Oct 04 22:00:53.995013 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 22:00:53.995013 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 22:00:53.995013 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: d474da1382674cada32763825c7840f5 Oct 04 22:00:53.995013 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-ServerPasswordTestJSON-1950754460-project Oct 04 22:00:53.995013 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 22:00:53.995013 n-d-860284-1 devstack@n-api.service[134102]: exception: Instance 2d3d1574-f1b5-46a9-a3b7-205a905a90f1 could not be found. Oct 04 22:00:53.995013 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': '2d3d1574-f1b5-46a9-a3b7-205a905a90f1'} Oct 04 22:00:53.995013 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:00:53.995013 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:00:53.995013 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:00:53.995013 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:00:53.995013 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:00:53.995013 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:00:53.995013 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:00:53.995013 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:00:53.995013 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:00:53.995013 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:00:53.995013 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d3d1574-f1b5-46a9-a3b7-205a905a90f1 could not be found. Oct 04 22:00:53.995013 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:00:53.995013 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:00:53.995013 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:00:53.995013 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:00:53.995013 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:00:53.995013 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:00:53.995013 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:00:53.995013 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:00:53.995013 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:00:53.995013 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:00:53.995013 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:00:53.995013 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:00:53.995013 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:00:53.995013 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:00:53.995013 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:00:53.995013 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:00:53.995013 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d3d1574-f1b5-46a9-a3b7-205a905a90f1 could not be found. Oct 04 22:00:53.995013 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:00:53.995013 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:00:53.995013 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:00:54.002775 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:00:54.002775 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:00:54.002775 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:00:54.002775 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:00:54.002775 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:00:54.002775 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d3d1574-f1b5-46a9-a3b7-205a905a90f1 could not be found. Oct 04 22:00:54.002775 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:00:54.002775 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-dc172e68-4b43-476e-8421-53d8291257e0 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] Returning 404 to user: Instance 2d3d1574-f1b5-46a9-a3b7-205a905a90f1 could not be found. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:00:54.002775 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-dc172e68-4b43-476e-8421-53d8291257e0 tempest-ServerPasswordTestJSON-1950754460 tempest-ServerPasswordTestJSON-1950754460-project] 10.222.0.43 "GET /compute/v2.1/servers/2d3d1574-f1b5-46a9-a3b7-205a905a90f1" status: 404 len: 111 microversion: 2.1 time: 0.124904 Oct 04 22:00:54.008194 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1884/3727] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:00:53 2022] GET /compute/v2.1/servers/2d3d1574-f1b5-46a9-a3b7-205a905a90f1 => generated 111 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 22:00:54.025465 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-70a035c8-fdf2-4504-a4c0-3446ef828f04 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:00:54.030241 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-70a035c8-fdf2-4504-a4c0-3446ef828f04 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: a4cf4fac-1e9b-4669-a6ff-30008ed3642d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:54.054945 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-70a035c8-fdf2-4504-a4c0-3446ef828f04 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:54.055821 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-70a035c8-fdf2-4504-a4c0-3446ef828f04 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:54.058948 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-70a035c8-fdf2-4504-a4c0-3446ef828f04 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:54.062303 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-70a035c8-fdf2-4504-a4c0-3446ef828f04 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:54.065127 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-70a035c8-fdf2-4504-a4c0-3446ef828f04 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:54.066104 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-70a035c8-fdf2-4504-a4c0-3446ef828f04 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:54.169307 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.objects.instance [None req-70a035c8-fdf2-4504-a4c0-3446ef828f04 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lazy-loading 'flavor' on Instance uuid a4cf4fac-1e9b-4669-a6ff-30008ed3642d {{(pid=134102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 22:00:54.219251 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-70a035c8-fdf2-4504-a4c0-3446ef828f04 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] HTTP exception thrown: Cannot 'shelve' instance a4cf4fac-1e9b-4669-a6ff-30008ed3642d while it is in vm_state shelved_offloaded Oct 04 22:00:54.226540 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-70a035c8-fdf2-4504-a4c0-3446ef828f04 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Request method failure captured: Oct 04 22:00:54.226540 n-d-860284-1 devstack@n-api.service[134102]: request: POST /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d/action HTTP/1.1 Oct 04 22:00:54.226540 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 22:00:54.226540 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 22:00:54.226540 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 22:00:54.226540 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 14 Oct 04 22:00:54.226540 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 22:00:54.226540 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 22:00:54.226540 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 22:00:54.226540 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 22:00:54.226540 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPKwu4cpW6hhBuWb-qV_7iYlwjOTpf5XWCl53BJjoosjlcj4wkmmOFzemCJVdBntIx8zJ1SF_z6VrRY8UJr7E8TQDJCRnVQMdNnh0-lZwGdqUzjOWSO31Ryb6n87Cka0g238a21JWok3h3GEhLB-7oCbN3bbcOGmkhd6UFueRxRluk24 Oct 04 22:00:54.226540 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 22:00:54.226540 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 22:00:54.226540 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 22:00:54.226540 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 22:00:54.226540 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 22:00:54.226540 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 22:00:54.226540 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: cf07a17a482a4e92b6ddbdee463c8029 Oct 04 22:00:54.226540 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-ServersNegativeTestJSON-1933663319 Oct 04 22:00:54.226540 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 22:00:54.226540 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 22:00:54.226540 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/cf07a17a482a4e92b6ddbdee463c8029"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_cf07a17a482a4e92b6ddbdee463c8029", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/cf07a17a482a4e92b6ddbdee463c8029"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/cf07a17a482a4e92b6ddbdee463c8029"}]}] Oct 04 22:00:54.226540 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-ServersNegativeTestJSON-1933663319 Oct 04 22:00:54.226540 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: cf07a17a482a4e92b6ddbdee463c8029 Oct 04 22:00:54.226540 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1933663319 Oct 04 22:00:54.226540 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-ServersNegativeTestJSON-1933663319-project Oct 04 22:00:54.226540 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 22:00:54.226540 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 22:00:54.226540 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: 2facee4c6a40416e908083e126d2cfa3 Oct 04 22:00:54.226540 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-ServersNegativeTestJSON-1933663319-project Oct 04 22:00:54.226540 n-d-860284-1 devstack@n-api.service[134102]: Oct 04 22:00:54.226540 n-d-860284-1 devstack@n-api.service[134102]: {"shelve": {}} Oct 04 22:00:54.226540 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 22:00:54.226540 n-d-860284-1 devstack@n-api.service[134102]: exception: Cannot 'shelve' instance a4cf4fac-1e9b-4669-a6ff-30008ed3642d while it is in vm_state shelved_offloaded Oct 04 22:00:54.226540 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': 'a4cf4fac-1e9b-4669-a6ff-30008ed3642d', 'body': {'shelve': {}}} Oct 04 22:00:54.226540 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:00:54.226540 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:00:54.226540 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 49, in _shelve Oct 04 22:00:54.226540 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi self.compute_api.shelve(context, instance) Oct 04 22:00:54.226540 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 04 22:00:54.226540 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 22:00:54.226540 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 04 22:00:54.226540 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 22:00:54.226540 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 04 22:00:54.226540 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 22:00:54.226540 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 22:00:54.226540 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 22:00:54.226540 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 04 22:00:54.226540 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 04 22:00:54.226540 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance a4cf4fac-1e9b-4669-a6ff-30008ed3642d in vm_state shelved_offloaded. Cannot shelve while the instance is in this state. Oct 04 22:00:54.226540 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:00:54.226540 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:00:54.226540 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:00:54.226540 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:00:54.226540 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:00:54.226540 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:00:54.226540 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:00:54.226540 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:00:54.226540 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:00:54.226540 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:00:54.226540 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 56, in _shelve Oct 04 22:00:54.226540 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 04 22:00:54.226540 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 04 22:00:54.231449 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 22:00:54.231449 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'shelve' instance a4cf4fac-1e9b-4669-a6ff-30008ed3642d while it is in vm_state shelved_offloaded Oct 04 22:00:54.231449 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:00:54.231449 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:00:54.231449 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:00:54.231449 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:00:54.231449 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:00:54.231449 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:00:54.231449 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:00:54.231449 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:00:54.231449 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'shelve' instance a4cf4fac-1e9b-4669-a6ff-30008ed3642d while it is in vm_state shelved_offloaded Oct 04 22:00:54.231449 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:00:54.231449 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-70a035c8-fdf2-4504-a4c0-3446ef828f04 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Returning 409 to user: Cannot 'shelve' instance a4cf4fac-1e9b-4669-a6ff-30008ed3642d while it is in vm_state shelved_offloaded {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:00:54.232438 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-70a035c8-fdf2-4504-a4c0-3446ef828f04 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "POST /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d/action" status: 409 len: 155 microversion: 2.1 time: 0.222400 Oct 04 22:00:54.250120 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1885/3728] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 22:00:54 2022] POST /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d/action => generated 155 bytes in 238 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 22:00:54.260084 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-2b1fe977-f155-4d71-84d7-b425799019c3 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:00:54.262231 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-2b1fe977-f155-4d71-84d7-b425799019c3 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: a4cf4fac-1e9b-4669-a6ff-30008ed3642d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:54.291101 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2b1fe977-f155-4d71-84d7-b425799019c3 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:54.292435 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2b1fe977-f155-4d71-84d7-b425799019c3 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:54.295135 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2b1fe977-f155-4d71-84d7-b425799019c3 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:54.297130 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2b1fe977-f155-4d71-84d7-b425799019c3 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:54.300342 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2b1fe977-f155-4d71-84d7-b425799019c3 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:54.302338 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2b1fe977-f155-4d71-84d7-b425799019c3 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:54.443744 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-2b1fe977-f155-4d71-84d7-b425799019c3 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: a4cf4fac-1e9b-4669-a6ff-30008ed3642d] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=134102) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 04 22:00:54.735174 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-2b1fe977-f155-4d71-84d7-b425799019c3 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "POST /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d/action" status: 202 len: 0 microversion: 2.1 time: 0.483268 Oct 04 22:00:54.736231 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1886/3729] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 22:00:54 2022] POST /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d/action => generated 0 bytes in 485 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 22:00:54.746508 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-85141e7f-461c-41d9-8cab-ab01a6ad9413 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:54.747607 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-85141e7f-461c-41d9-8cab-ab01a6ad9413 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] [instance: d0b1b757-4a4d-4a7a-9a06-08f178a02984] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:54.755712 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-85141e7f-461c-41d9-8cab-ab01a6ad9413 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:54.756612 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-85141e7f-461c-41d9-8cab-ab01a6ad9413 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:54.757340 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-85141e7f-461c-41d9-8cab-ab01a6ad9413 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:54.758304 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-85141e7f-461c-41d9-8cab-ab01a6ad9413 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:54.759033 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-85141e7f-461c-41d9-8cab-ab01a6ad9413 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:54.761237 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-85141e7f-461c-41d9-8cab-ab01a6ad9413 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:55.161623 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-f8742353-0318-4f9a-ba30-e02b0ad50531 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2034fc9060874868bc5d27370a1c351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89499d833a4a00805164f4f79ed522', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:55.170271 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-f8742353-0318-4f9a-ba30-e02b0ad50531 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] 10.222.0.43 "GET /compute/v2.1/servers/df147c22-6a7f-4081-83e7-97620b23700c" status: 200 len: 1520 microversion: 2.1 time: 1.479774 Oct 04 22:00:55.170940 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1844/3730] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:00:53 2022] GET /compute/v2.1/servers/df147c22-6a7f-4081-83e7-97620b23700c => generated 1520 bytes in 1481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:00:55.207524 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e5c38936-7957-43f6-a12a-d6ac76377250 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:55.208147 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-e5c38936-7957-43f6-a12a-d6ac76377250 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: a4cf4fac-1e9b-4669-a6ff-30008ed3642d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:55.220346 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-85141e7f-461c-41d9-8cab-ab01a6ad9413 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:55.227459 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e5c38936-7957-43f6-a12a-d6ac76377250 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:55.227960 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e5c38936-7957-43f6-a12a-d6ac76377250 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:55.228409 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e5c38936-7957-43f6-a12a-d6ac76377250 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:55.229122 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e5c38936-7957-43f6-a12a-d6ac76377250 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:55.229577 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e5c38936-7957-43f6-a12a-d6ac76377250 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:55.230007 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e5c38936-7957-43f6-a12a-d6ac76377250 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:55.240338 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-85141e7f-461c-41d9-8cab-ab01a6ad9413 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:55.244523 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-85141e7f-461c-41d9-8cab-ab01a6ad9413 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:55.270779 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-85141e7f-461c-41d9-8cab-ab01a6ad9413 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] 10.222.0.43 "GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984" status: 200 len: 1553 microversion: 2.91 time: 0.529140 Oct 04 22:00:55.285161 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1887/3731] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:00:54 2022] GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984 => generated 1553 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:00:56.194030 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-84aa043b-b3e6-46ef-80e6-d0bd99d47aac tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:56.195098 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-84aa043b-b3e6-46ef-80e6-d0bd99d47aac tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] [instance: df147c22-6a7f-4081-83e7-97620b23700c] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:56.220960 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-84aa043b-b3e6-46ef-80e6-d0bd99d47aac tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:56.221638 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-84aa043b-b3e6-46ef-80e6-d0bd99d47aac tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:56.221913 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-84aa043b-b3e6-46ef-80e6-d0bd99d47aac tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:56.224349 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-84aa043b-b3e6-46ef-80e6-d0bd99d47aac tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:56.227801 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-84aa043b-b3e6-46ef-80e6-d0bd99d47aac tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:56.235827 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-84aa043b-b3e6-46ef-80e6-d0bd99d47aac tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:57.377172 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-e5c38936-7957-43f6-a12a-d6ac76377250 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2facee4c6a40416e908083e126d2cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07a17a482a4e92b6ddbdee463c8029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:57.407686 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-e5c38936-7957-43f6-a12a-d6ac76377250 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d" status: 200 len: 1459 microversion: 2.1 time: 2.203968 Oct 04 22:00:57.408717 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1845/3732] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:00:55 2022] GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d => generated 1459 bytes in 2237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:00:57.424495 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-41b5a081-62f4-496f-b918-b9f43dd659c3 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:57.429449 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-41b5a081-62f4-496f-b918-b9f43dd659c3 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] [instance: d0b1b757-4a4d-4a7a-9a06-08f178a02984] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:57.444865 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-41b5a081-62f4-496f-b918-b9f43dd659c3 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:57.445800 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-41b5a081-62f4-496f-b918-b9f43dd659c3 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:57.446938 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-41b5a081-62f4-496f-b918-b9f43dd659c3 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:57.450283 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-41b5a081-62f4-496f-b918-b9f43dd659c3 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:57.451066 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-41b5a081-62f4-496f-b918-b9f43dd659c3 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:57.453184 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-41b5a081-62f4-496f-b918-b9f43dd659c3 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:57.724089 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-84aa043b-b3e6-46ef-80e6-d0bd99d47aac tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2034fc9060874868bc5d27370a1c351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89499d833a4a00805164f4f79ed522', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:57.759342 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-84aa043b-b3e6-46ef-80e6-d0bd99d47aac tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] 10.222.0.43 "GET /compute/v2.1/servers/df147c22-6a7f-4081-83e7-97620b23700c" status: 200 len: 1520 microversion: 2.1 time: 1.567162 Oct 04 22:00:57.762802 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1888/3733] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:00:56 2022] GET /compute/v2.1/servers/df147c22-6a7f-4081-83e7-97620b23700c => generated 1520 bytes in 1572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:00:57.781374 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-65be3126-ab3e-4913-bcb2-a76dd1916986 req-17b35d78-d314-4e15-9a6d-6d3bcbe12565 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df147c22-6a7f-4081-83e7-97620b23700c", "name": "network-vif-plugged", "status": "completed", "tag": "fdfe513a-ef00-4ef2-972c-073f6e43c48b"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:00:57.795480 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-65be3126-ab3e-4913-bcb2-a76dd1916986 req-17b35d78-d314-4e15-9a6d-6d3bcbe12565 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:57.796368 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-65be3126-ab3e-4913-bcb2-a76dd1916986 req-17b35d78-d314-4e15-9a6d-6d3bcbe12565 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:57.797061 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-65be3126-ab3e-4913-bcb2-a76dd1916986 req-17b35d78-d314-4e15-9a6d-6d3bcbe12565 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:57.811686 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-65be3126-ab3e-4913-bcb2-a76dd1916986 req-17b35d78-d314-4e15-9a6d-6d3bcbe12565 service nova] Creating event network-vif-plugged:fdfe513a-ef00-4ef2-972c-073f6e43c48b for instance df147c22-6a7f-4081-83e7-97620b23700c on n-h1-860284-1 Oct 04 22:00:57.824082 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-65be3126-ab3e-4913-bcb2-a76dd1916986 req-17b35d78-d314-4e15-9a6d-6d3bcbe12565 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054369 Oct 04 22:00:57.825291 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1889/3734] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:00:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:00:57.889171 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-41b5a081-62f4-496f-b918-b9f43dd659c3 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:57.907983 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-41b5a081-62f4-496f-b918-b9f43dd659c3 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:57.913881 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-41b5a081-62f4-496f-b918-b9f43dd659c3 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:57.931040 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-41b5a081-62f4-496f-b918-b9f43dd659c3 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] 10.222.0.43 "GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984" status: 200 len: 1553 microversion: 2.91 time: 0.520510 Oct 04 22:00:57.958623 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1846/3735] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:00:57 2022] GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984 => generated 1553 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:00:57.988216 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-5c73a7ff-3a87-4c80-aed3-de1aab518b93 tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Action: 'create', calling method: .version_select at 0x7fbb2f50e8b0>, body: {"keypair": {"name": "tempest-keypair-1713464007", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDYqW8Qsg1fgNXwqef4whPK9ZOxrntqyt7n+XPeVf6V/PbTKyiN/YfoMhcQTia3d/mfFfIMDX4Z5QdFa5+IKqNI8npks26yMcchoqTYWKgQfIBMtiDkYMsa6xCvTgzdDnA=="}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:00:58.034248 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-5c73a7ff-3a87-4c80-aed3-de1aab518b93 tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Getting quotas for project 49b79bc7a0ba4b3e9415590e7e6b7f02. Resources: {'key_pairs'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:00:58.048460 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-5c73a7ff-3a87-4c80-aed3-de1aab518b93 tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Getting quotas for user 8ec630399c5d4231ae3d3975c8370c55 and project 49b79bc7a0ba4b3e9415590e7e6b7f02. Resources: {'key_pairs'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:00:58.122459 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-5c73a7ff-3a87-4c80-aed3-de1aab518b93 tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.293451 Oct 04 22:00:58.130495 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1890/3736] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Oct 4 22:00:57 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:00:58.448561 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-60f1fa52-8aeb-4fd4-852a-66eb1208ec22 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:58.450273 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-60f1fa52-8aeb-4fd4-852a-66eb1208ec22 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: a4cf4fac-1e9b-4669-a6ff-30008ed3642d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:58.460603 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-60f1fa52-8aeb-4fd4-852a-66eb1208ec22 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:58.461152 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-60f1fa52-8aeb-4fd4-852a-66eb1208ec22 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:58.461651 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-60f1fa52-8aeb-4fd4-852a-66eb1208ec22 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:58.462508 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-60f1fa52-8aeb-4fd4-852a-66eb1208ec22 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:58.463947 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-60f1fa52-8aeb-4fd4-852a-66eb1208ec22 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:58.465307 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-60f1fa52-8aeb-4fd4-852a-66eb1208ec22 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:58.584474 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=100 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:00:58.787216 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-f08d75ee-2f7f-4af1-ae97-68da4b9324b3 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:58.788968 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-f08d75ee-2f7f-4af1-ae97-68da4b9324b3 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] [instance: df147c22-6a7f-4081-83e7-97620b23700c] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:58.807933 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f08d75ee-2f7f-4af1-ae97-68da4b9324b3 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:58.811410 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f08d75ee-2f7f-4af1-ae97-68da4b9324b3 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:58.811997 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f08d75ee-2f7f-4af1-ae97-68da4b9324b3 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:58.813341 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f08d75ee-2f7f-4af1-ae97-68da4b9324b3 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:58.816814 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f08d75ee-2f7f-4af1-ae97-68da4b9324b3 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:58.817394 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f08d75ee-2f7f-4af1-ae97-68da4b9324b3 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:58.857121 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:00:59.240293 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-60f1fa52-8aeb-4fd4-852a-66eb1208ec22 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2facee4c6a40416e908083e126d2cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07a17a482a4e92b6ddbdee463c8029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:59.249675 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-60f1fa52-8aeb-4fd4-852a-66eb1208ec22 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d" status: 200 len: 1517 microversion: 2.1 time: 0.810499 Oct 04 22:00:59.253622 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1847/3737] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:00:58 2022] GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d => generated 1517 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:00:59.266568 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-bb6d6d9c-62c1-4e42-a9ac-5f4f5c3fcd44 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:59.267578 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-bb6d6d9c-62c1-4e42-a9ac-5f4f5c3fcd44 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] [instance: d0b1b757-4a4d-4a7a-9a06-08f178a02984] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:59.281609 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bb6d6d9c-62c1-4e42-a9ac-5f4f5c3fcd44 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:59.282762 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bb6d6d9c-62c1-4e42-a9ac-5f4f5c3fcd44 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:59.283483 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bb6d6d9c-62c1-4e42-a9ac-5f4f5c3fcd44 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:59.289576 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bb6d6d9c-62c1-4e42-a9ac-5f4f5c3fcd44 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:59.293384 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bb6d6d9c-62c1-4e42-a9ac-5f4f5c3fcd44 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:59.294595 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bb6d6d9c-62c1-4e42-a9ac-5f4f5c3fcd44 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:59.404680 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-f08d75ee-2f7f-4af1-ae97-68da4b9324b3 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2034fc9060874868bc5d27370a1c351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89499d833a4a00805164f4f79ed522', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:59.430209 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-f08d75ee-2f7f-4af1-ae97-68da4b9324b3 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] 10.222.0.43 "GET /compute/v2.1/servers/df147c22-6a7f-4081-83e7-97620b23700c" status: 200 len: 1520 microversion: 2.1 time: 0.647452 Oct 04 22:00:59.431141 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1891/3738] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:00:58 2022] GET /compute/v2.1/servers/df147c22-6a7f-4081-83e7-97620b23700c => generated 1520 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:00:59.460149 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-bb6d6d9c-62c1-4e42-a9ac-5f4f5c3fcd44 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:59.486932 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-bb6d6d9c-62c1-4e42-a9ac-5f4f5c3fcd44 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:59.488693 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-bb6d6d9c-62c1-4e42-a9ac-5f4f5c3fcd44 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:59.516776 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-bb6d6d9c-62c1-4e42-a9ac-5f4f5c3fcd44 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] 10.222.0.43 "GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984" status: 200 len: 1553 microversion: 2.91 time: 0.261636 Oct 04 22:00:59.517392 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1848/3739] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:00:59 2022] GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984 => generated 1553 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:01:00.153257 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-07c2fc3d-1ba2-4994-b531-db142df74bc9 req-e655ea9a-baf2-4b21-b39e-51cff08c89b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4cf4fac-1e9b-4669-a6ff-30008ed3642d", "tag": "17823d3d-fc62-47ee-8e12-cf0154daa955"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:01:00.165417 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-07c2fc3d-1ba2-4994-b531-db142df74bc9 req-e655ea9a-baf2-4b21-b39e-51cff08c89b9 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:00.169511 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-07c2fc3d-1ba2-4994-b531-db142df74bc9 req-e655ea9a-baf2-4b21-b39e-51cff08c89b9 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:00.174597 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-07c2fc3d-1ba2-4994-b531-db142df74bc9 req-e655ea9a-baf2-4b21-b39e-51cff08c89b9 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:00.234854 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-07c2fc3d-1ba2-4994-b531-db142df74bc9 req-e655ea9a-baf2-4b21-b39e-51cff08c89b9 service nova] Creating event network-changed:17823d3d-fc62-47ee-8e12-cf0154daa955 for instance a4cf4fac-1e9b-4669-a6ff-30008ed3642d on n-h2-860284-1 Oct 04 22:01:00.252262 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-07c2fc3d-1ba2-4994-b531-db142df74bc9 req-e655ea9a-baf2-4b21-b39e-51cff08c89b9 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110712 Oct 04 22:01:00.255474 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1892/3740] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:01:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:01:00.281675 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-ea78b7ab-65bb-4d80-b38b-dfbdddc55d16 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:00.282896 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-ea78b7ab-65bb-4d80-b38b-dfbdddc55d16 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: a4cf4fac-1e9b-4669-a6ff-30008ed3642d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:00.311031 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ea78b7ab-65bb-4d80-b38b-dfbdddc55d16 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:00.311905 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ea78b7ab-65bb-4d80-b38b-dfbdddc55d16 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:00.312841 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ea78b7ab-65bb-4d80-b38b-dfbdddc55d16 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:00.314350 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ea78b7ab-65bb-4d80-b38b-dfbdddc55d16 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:00.320221 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ea78b7ab-65bb-4d80-b38b-dfbdddc55d16 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:00.321905 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ea78b7ab-65bb-4d80-b38b-dfbdddc55d16 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:00.457090 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-bf0fce14-a817-43ea-b810-af62edc4fa91 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:00.458218 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-bf0fce14-a817-43ea-b810-af62edc4fa91 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] [instance: df147c22-6a7f-4081-83e7-97620b23700c] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:00.476633 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bf0fce14-a817-43ea-b810-af62edc4fa91 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:00.477465 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bf0fce14-a817-43ea-b810-af62edc4fa91 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:00.478109 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bf0fce14-a817-43ea-b810-af62edc4fa91 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:00.479086 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bf0fce14-a817-43ea-b810-af62edc4fa91 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:00.479779 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bf0fce14-a817-43ea-b810-af62edc4fa91 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:00.481153 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bf0fce14-a817-43ea-b810-af62edc4fa91 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:01.457634 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-bf0fce14-a817-43ea-b810-af62edc4fa91 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2034fc9060874868bc5d27370a1c351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89499d833a4a00805164f4f79ed522', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:01.473366 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-bf0fce14-a817-43ea-b810-af62edc4fa91 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] 10.222.0.43 "GET /compute/v2.1/servers/df147c22-6a7f-4081-83e7-97620b23700c" status: 200 len: 1505 microversion: 2.1 time: 1.022903 Oct 04 22:01:01.476112 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1893/3741] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:01:00 2022] GET /compute/v2.1/servers/df147c22-6a7f-4081-83e7-97620b23700c => generated 1505 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:01:01.489508 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-08c0eba2-cc3d-46a5-a938-07d775b321bc tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:01.492060 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-08c0eba2-cc3d-46a5-a938-07d775b321bc tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] [instance: d0b1b757-4a4d-4a7a-9a06-08f178a02984] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:01.515707 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-08c0eba2-cc3d-46a5-a938-07d775b321bc tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:01.516549 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-08c0eba2-cc3d-46a5-a938-07d775b321bc tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:01.517375 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-08c0eba2-cc3d-46a5-a938-07d775b321bc tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:01.518605 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-08c0eba2-cc3d-46a5-a938-07d775b321bc tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:01.519377 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-08c0eba2-cc3d-46a5-a938-07d775b321bc tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:01.520206 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-08c0eba2-cc3d-46a5-a938-07d775b321bc tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:01.577914 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-ea78b7ab-65bb-4d80-b38b-dfbdddc55d16 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2facee4c6a40416e908083e126d2cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07a17a482a4e92b6ddbdee463c8029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:01.592652 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-ea78b7ab-65bb-4d80-b38b-dfbdddc55d16 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d" status: 200 len: 1517 microversion: 2.1 time: 1.313664 Oct 04 22:01:01.593613 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1849/3742] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:01:00 2022] GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d => generated 1517 bytes in 1319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:01:01.603717 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-53a44f91-3474-4a46-a9bb-96bde72580e8 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:01.605497 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-53a44f91-3474-4a46-a9bb-96bde72580e8 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] [instance: df147c22-6a7f-4081-83e7-97620b23700c] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:01.622271 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-53a44f91-3474-4a46-a9bb-96bde72580e8 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:01.623164 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-53a44f91-3474-4a46-a9bb-96bde72580e8 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:01.623839 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-53a44f91-3474-4a46-a9bb-96bde72580e8 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:01.624779 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-53a44f91-3474-4a46-a9bb-96bde72580e8 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:01.627698 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-53a44f91-3474-4a46-a9bb-96bde72580e8 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:01.628419 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-53a44f91-3474-4a46-a9bb-96bde72580e8 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:01.686935 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-08c0eba2-cc3d-46a5-a938-07d775b321bc tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:01.715690 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-08c0eba2-cc3d-46a5-a938-07d775b321bc tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:01.723531 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-08c0eba2-cc3d-46a5-a938-07d775b321bc tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:01.735825 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-08c0eba2-cc3d-46a5-a938-07d775b321bc tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] 10.222.0.43 "GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984" status: 200 len: 1553 microversion: 2.91 time: 0.257612 Oct 04 22:01:01.754396 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1894/3743] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:01:01 2022] GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984 => generated 1553 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:01:02.625756 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-51bfcf51-998b-452e-8ff4-07084b535f61 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:02.630044 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-51bfcf51-998b-452e-8ff4-07084b535f61 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: a4cf4fac-1e9b-4669-a6ff-30008ed3642d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:02.659702 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-51bfcf51-998b-452e-8ff4-07084b535f61 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:02.675598 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-51bfcf51-998b-452e-8ff4-07084b535f61 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:02.687464 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-51bfcf51-998b-452e-8ff4-07084b535f61 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:02.688238 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-51bfcf51-998b-452e-8ff4-07084b535f61 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:02.688730 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-51bfcf51-998b-452e-8ff4-07084b535f61 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:02.689171 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-51bfcf51-998b-452e-8ff4-07084b535f61 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:03.581633 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-53a44f91-3474-4a46-a9bb-96bde72580e8 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2034fc9060874868bc5d27370a1c351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89499d833a4a00805164f4f79ed522', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:03.595706 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-53a44f91-3474-4a46-a9bb-96bde72580e8 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] 10.222.0.43 "GET /compute/v2.1/servers/df147c22-6a7f-4081-83e7-97620b23700c" status: 200 len: 1505 microversion: 2.1 time: 2.000797 Oct 04 22:01:03.596312 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1850/3744] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:01:01 2022] GET /compute/v2.1/servers/df147c22-6a7f-4081-83e7-97620b23700c => generated 1505 bytes in 2002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:01:03.614274 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-1138674e-e3b2-46f7-9457-5b82db8ac71d tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:03.614274 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-1138674e-e3b2-46f7-9457-5b82db8ac71d tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] [instance: d0b1b757-4a4d-4a7a-9a06-08f178a02984] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:03.639156 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1138674e-e3b2-46f7-9457-5b82db8ac71d tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:03.639710 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1138674e-e3b2-46f7-9457-5b82db8ac71d tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:03.640178 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1138674e-e3b2-46f7-9457-5b82db8ac71d tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:03.640933 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1138674e-e3b2-46f7-9457-5b82db8ac71d tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:03.641405 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1138674e-e3b2-46f7-9457-5b82db8ac71d tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:03.641847 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1138674e-e3b2-46f7-9457-5b82db8ac71d tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:03.970403 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-51bfcf51-998b-452e-8ff4-07084b535f61 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2facee4c6a40416e908083e126d2cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07a17a482a4e92b6ddbdee463c8029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:03.985656 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-51bfcf51-998b-452e-8ff4-07084b535f61 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d" status: 200 len: 1517 microversion: 2.1 time: 1.371446 Oct 04 22:01:03.989051 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1895/3745] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:01:02 2022] GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d => generated 1517 bytes in 1377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:01:04.009627 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-1138674e-e3b2-46f7-9457-5b82db8ac71d tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:04.010963 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-020324da-0557-4c2f-baa5-f0edede0469d tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:04.012226 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-020324da-0557-4c2f-baa5-f0edede0469d tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] [instance: df147c22-6a7f-4081-83e7-97620b23700c] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:04.020539 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-1138674e-e3b2-46f7-9457-5b82db8ac71d tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:04.025870 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:01:04.028685 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-1138674e-e3b2-46f7-9457-5b82db8ac71d tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:04.035504 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-020324da-0557-4c2f-baa5-f0edede0469d tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:04.036069 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-020324da-0557-4c2f-baa5-f0edede0469d tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:04.040615 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-020324da-0557-4c2f-baa5-f0edede0469d tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:04.041976 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-020324da-0557-4c2f-baa5-f0edede0469d tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:04.044249 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-1138674e-e3b2-46f7-9457-5b82db8ac71d tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] 10.222.0.43 "GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984" status: 200 len: 1535 microversion: 2.91 time: 0.444917 Oct 04 22:01:04.044601 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-020324da-0557-4c2f-baa5-f0edede0469d tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:04.045365 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1851/3746] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:01:03 2022] GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984 => generated 1535 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:01:04.045747 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-020324da-0557-4c2f-baa5-f0edede0469d tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:04.063887 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-4af43c4f-bf61-4ffd-b2c1-21bae7348494 tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-606369099", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "eadee7e2-09db-4a5e-8990-b48b67ba32bd"}], "security_groups": [{"name": "tempest-securitygroup--1314977233"}], "key_name": "tempest-keypair-1713464007", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:01:04.099965 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-020324da-0557-4c2f-baa5-f0edede0469d tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] [instance: df147c22-6a7f-4081-83e7-97620b23700c] Going to try to terminate instance {{(pid=134102) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 22:01:04.285540 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-020324da-0557-4c2f-baa5-f0edede0469d tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] 10.222.0.43 "DELETE /compute/v2.1/servers/df147c22-6a7f-4081-83e7-97620b23700c" status: 204 len: 0 microversion: 2.1 time: 0.290136 Oct 04 22:01:04.288739 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1896/3747] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 22:01:03 2022] DELETE /compute/v2.1/servers/df147c22-6a7f-4081-83e7-97620b23700c => generated 0 bytes in 298 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 22:01:04.504381 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-1cb65cb6-e8b2-499b-821e-675f4583bb14 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1765710900", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452", "networks": [{"uuid": "605d261e-cb88-4730-8571-b0febea58d72"}]}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:01:04.611432 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.network.neutron [None req-4af43c4f-bf61-4ffd-b2c1-21bae7348494 tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] validate_networks() for [('eadee7e2-09db-4a5e-8990-b48b67ba32bd', None, None, None, None, None)] {{(pid=134101) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 22:01:04.615186 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.network.neutron [None req-1cb65cb6-e8b2-499b-821e-675f4583bb14 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] validate_networks() for [('605d261e-cb88-4730-8571-b0febea58d72', None, None, None, None, None)] {{(pid=134102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 22:01:08.080597 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell0:SELECT=4 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:01:08.505547 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-4af43c4f-bf61-4ffd-b2c1-21bae7348494 tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Getting quotas for project 49b79bc7a0ba4b3e9415590e7e6b7f02. Resources: dict_keys(['metadata_items']) {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:01:08.531683 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-4af43c4f-bf61-4ffd-b2c1-21bae7348494 tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Getting quotas for user 8ec630399c5d4231ae3d3975c8370c55 and project 49b79bc7a0ba4b3e9415590e7e6b7f02. Resources: dict_keys(['metadata_items']) {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:01:08.564411 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-4af43c4f-bf61-4ffd-b2c1-21bae7348494 tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Flavor limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 22:01:08.565202 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-4af43c4f-bf61-4ffd-b2c1-21bae7348494 tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Image limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 22:01:08.565955 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-4af43c4f-bf61-4ffd-b2c1-21bae7348494 tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Flavor pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 22:01:08.567154 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-4af43c4f-bf61-4ffd-b2c1-21bae7348494 tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Image pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 22:01:08.568397 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-4af43c4f-bf61-4ffd-b2c1-21bae7348494 tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 22:01:08.617802 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4af43c4f-bf61-4ffd-b2c1-21bae7348494 tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:08.619799 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4af43c4f-bf61-4ffd-b2c1-21bae7348494 tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:08.621543 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4af43c4f-bf61-4ffd-b2c1-21bae7348494 tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:08.624286 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4af43c4f-bf61-4ffd-b2c1-21bae7348494 tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:08.627615 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4af43c4f-bf61-4ffd-b2c1-21bae7348494 tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:08.628481 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4af43c4f-bf61-4ffd-b2c1-21bae7348494 tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:08.724182 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-4af43c4f-bf61-4ffd-b2c1-21bae7348494 tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Getting quotas for project 49b79bc7a0ba4b3e9415590e7e6b7f02. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:01:08.761778 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-4af43c4f-bf61-4ffd-b2c1-21bae7348494 tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Getting quotas for user 8ec630399c5d4231ae3d3975c8370c55 and project 49b79bc7a0ba4b3e9415590e7e6b7f02. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:01:08.818283 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-4af43c4f-bf61-4ffd-b2c1-21bae7348494 tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Going to run 1 instances... {{(pid=134101) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 22:01:08.830171 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-4af43c4f-bf61-4ffd-b2c1-21bae7348494 tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] [instance: 3626ed18-d2aa-4ec2-8a06-4e6c76114cfc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='58548514-5dac-426c-81f5-19e3fba33e23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134101) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 22:01:09.047020 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-4af43c4f-bf61-4ffd-b2c1-21bae7348494 tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 4.996464 Oct 04 22:01:09.057004 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1852/3748] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 22:01:04 2022] POST /compute/v2.1/servers => generated 409 bytes in 5001 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 22:01:09.070942 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-04b7a6b4-ce61-4f89-b9cf-f081090c45a5 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:09.071686 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-04b7a6b4-ce61-4f89-b9cf-f081090c45a5 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: a4cf4fac-1e9b-4669-a6ff-30008ed3642d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:09.102025 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-04b7a6b4-ce61-4f89-b9cf-f081090c45a5 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:09.103393 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-04b7a6b4-ce61-4f89-b9cf-f081090c45a5 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:09.104893 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-04b7a6b4-ce61-4f89-b9cf-f081090c45a5 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:09.106530 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-04b7a6b4-ce61-4f89-b9cf-f081090c45a5 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:09.114345 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-04b7a6b4-ce61-4f89-b9cf-f081090c45a5 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:09.123908 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-04b7a6b4-ce61-4f89-b9cf-f081090c45a5 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:09.290942 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-1cb65cb6-e8b2-499b-821e-675f4583bb14 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Flavor limits 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 22:01:09.292235 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-1cb65cb6-e8b2-499b-821e-675f4583bb14 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Image limits 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 22:01:09.293015 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-1cb65cb6-e8b2-499b-821e-675f4583bb14 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Flavor pref 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 22:01:09.293914 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-1cb65cb6-e8b2-499b-821e-675f4583bb14 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Image pref 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 22:01:09.294612 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-1cb65cb6-e8b2-499b-821e-675f4583bb14 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 22:01:09.320262 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1cb65cb6-e8b2-499b-821e-675f4583bb14 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:09.326824 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1cb65cb6-e8b2-499b-821e-675f4583bb14 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:09.330782 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1cb65cb6-e8b2-499b-821e-675f4583bb14 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:09.331782 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1cb65cb6-e8b2-499b-821e-675f4583bb14 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:09.343896 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1cb65cb6-e8b2-499b-821e-675f4583bb14 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:09.347107 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1cb65cb6-e8b2-499b-821e-675f4583bb14 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:09.400654 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-1cb65cb6-e8b2-499b-821e-675f4583bb14 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Getting quotas for project aa89499d833a4a00805164f4f79ed522. Resources: {'instances', 'ram', 'cores'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:01:09.448356 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-1cb65cb6-e8b2-499b-821e-675f4583bb14 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Getting quotas for user 2034fc9060874868bc5d27370a1c351c and project aa89499d833a4a00805164f4f79ed522. Resources: {'instances', 'ram', 'cores'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:01:09.536213 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-1cb65cb6-e8b2-499b-821e-675f4583bb14 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Going to run 1 instances... {{(pid=134102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 22:01:09.548247 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-1cb65cb6-e8b2-499b-821e-675f4583bb14 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] [instance: 3dbe541d-234a-4049-befd-dcd9a67dbd46] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='58548514-5dac-426c-81f5-19e3fba33e23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 22:01:09.577512 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-04b7a6b4-ce61-4f89-b9cf-f081090c45a5 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2facee4c6a40416e908083e126d2cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07a17a482a4e92b6ddbdee463c8029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:09.612271 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-04b7a6b4-ce61-4f89-b9cf-f081090c45a5 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d" status: 200 len: 1517 microversion: 2.1 time: 0.556531 Oct 04 22:01:09.631836 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1853/3749] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:01:09 2022] GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d => generated 1517 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:01:09.641134 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-7a923f8d-aa8c-45c3-8469-33b08c66259e tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:09.643092 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-7a923f8d-aa8c-45c3-8469-33b08c66259e tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] [instance: d0b1b757-4a4d-4a7a-9a06-08f178a02984] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:09.663909 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7a923f8d-aa8c-45c3-8469-33b08c66259e tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:09.664633 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7a923f8d-aa8c-45c3-8469-33b08c66259e tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:09.666219 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7a923f8d-aa8c-45c3-8469-33b08c66259e tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:09.671219 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7a923f8d-aa8c-45c3-8469-33b08c66259e tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:09.672937 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7a923f8d-aa8c-45c3-8469-33b08c66259e tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:09.673600 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7a923f8d-aa8c-45c3-8469-33b08c66259e tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:09.772862 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-1cb65cb6-e8b2-499b-821e-675f4583bb14 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.272666 Oct 04 22:01:09.782183 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1897/3750] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 22:01:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 5283 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 22:01:09.803918 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-9aa68ca4-8ee0-400e-b8aa-ec7802366caa tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:09.804522 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-9aa68ca4-8ee0-400e-b8aa-ec7802366caa tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] [instance: 3626ed18-d2aa-4ec2-8a06-4e6c76114cfc] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:09.866722 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-7a923f8d-aa8c-45c3-8469-33b08c66259e tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:09.877887 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-7a923f8d-aa8c-45c3-8469-33b08c66259e tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:09.879375 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-7a923f8d-aa8c-45c3-8469-33b08c66259e tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:09.920918 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:01:09.927795 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-7a923f8d-aa8c-45c3-8469-33b08c66259e tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] 10.222.0.43 "GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984" status: 200 len: 1478 microversion: 2.91 time: 0.293663 Oct 04 22:01:09.929116 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1854/3751] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:01:09 2022] GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984 => generated 1478 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:01:09.939746 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-89303918-f8d6-4be7-b433-28965e4b7f33 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:09.966243 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-89303918-f8d6-4be7-b433-28965e4b7f33 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] [instance: 3dbe541d-234a-4049-befd-dcd9a67dbd46] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:11.001574 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-9aa68ca4-8ee0-400e-b8aa-ec7802366caa tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ec630399c5d4231ae3d3975c8370c55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b79bc7a0ba4b3e9415590e7e6b7f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:11.012219 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-9aa68ca4-8ee0-400e-b8aa-ec7802366caa tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] 10.222.0.43 "GET /compute/v2.1/servers/3626ed18-d2aa-4ec2-8a06-4e6c76114cfc" status: 200 len: 1277 microversion: 2.1 time: 1.228739 Oct 04 22:01:11.016438 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1898/3752] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:01:09 2022] GET /compute/v2.1/servers/3626ed18-d2aa-4ec2-8a06-4e6c76114cfc => generated 1277 bytes in 1234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:01:11.030125 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-7a164341-1534-4d3b-991f-defb512518b4 req-f4c09724-48ac-43ea-9446-42b8c23e899c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df147c22-6a7f-4081-83e7-97620b23700c", "name": "network-vif-deleted", "tag": "fdfe513a-ef00-4ef2-972c-073f6e43c48b"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:01:11.035020 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-89303918-f8d6-4be7-b433-28965e4b7f33 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2034fc9060874868bc5d27370a1c351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89499d833a4a00805164f4f79ed522', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:11.060175 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-89303918-f8d6-4be7-b433-28965e4b7f33 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] 10.222.0.43 "GET /compute/v2.1/servers/3dbe541d-234a-4049-befd-dcd9a67dbd46" status: 200 len: 1218 microversion: 2.1 time: 1.129758 Oct 04 22:01:11.068969 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1855/3753] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:01:09 2022] GET /compute/v2.1/servers/3dbe541d-234a-4049-befd-dcd9a67dbd46 => generated 1218 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:01:11.098004 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-5eba7ea0-0dd2-413e-bfd7-ba75b16449b5 tempest-UnshelveToHostMultiNodesTest-2056876790 tempest-UnshelveToHostMultiNodesTest-2056876790-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h2-860284-1"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:01:11.148363 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-5eba7ea0-0dd2-413e-bfd7-ba75b16449b5 tempest-UnshelveToHostMultiNodesTest-2056876790 tempest-UnshelveToHostMultiNodesTest-2056876790-project-admin] [instance: d0b1b757-4a4d-4a7a-9a06-08f178a02984] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:11.159452 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-7a164341-1534-4d3b-991f-defb512518b4 req-f4c09724-48ac-43ea-9446-42b8c23e899c service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:11.162959 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-7a164341-1534-4d3b-991f-defb512518b4 req-f4c09724-48ac-43ea-9446-42b8c23e899c service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.035s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:11.164568 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-7a164341-1534-4d3b-991f-defb512518b4 req-f4c09724-48ac-43ea-9446-42b8c23e899c service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:11.186751 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5eba7ea0-0dd2-413e-bfd7-ba75b16449b5 tempest-UnshelveToHostMultiNodesTest-2056876790 tempest-UnshelveToHostMultiNodesTest-2056876790-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:11.187267 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5eba7ea0-0dd2-413e-bfd7-ba75b16449b5 tempest-UnshelveToHostMultiNodesTest-2056876790 tempest-UnshelveToHostMultiNodesTest-2056876790-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:11.187714 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5eba7ea0-0dd2-413e-bfd7-ba75b16449b5 tempest-UnshelveToHostMultiNodesTest-2056876790 tempest-UnshelveToHostMultiNodesTest-2056876790-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:11.188442 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5eba7ea0-0dd2-413e-bfd7-ba75b16449b5 tempest-UnshelveToHostMultiNodesTest-2056876790 tempest-UnshelveToHostMultiNodesTest-2056876790-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:11.199355 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5eba7ea0-0dd2-413e-bfd7-ba75b16449b5 tempest-UnshelveToHostMultiNodesTest-2056876790 tempest-UnshelveToHostMultiNodesTest-2056876790-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:11.199817 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5eba7ea0-0dd2-413e-bfd7-ba75b16449b5 tempest-UnshelveToHostMultiNodesTest-2056876790 tempest-UnshelveToHostMultiNodesTest-2056876790-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:11.233172 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-7a164341-1534-4d3b-991f-defb512518b4 req-f4c09724-48ac-43ea-9446-42b8c23e899c service nova] Creating event network-vif-deleted:fdfe513a-ef00-4ef2-972c-073f6e43c48b for instance df147c22-6a7f-4081-83e7-97620b23700c on n-h1-860284-1 Oct 04 22:01:11.258145 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-7a164341-1534-4d3b-991f-defb512518b4 req-f4c09724-48ac-43ea-9446-42b8c23e899c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.236906 Oct 04 22:01:11.263213 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1899/3754] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:01:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:01:11.288174 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-ad079361-4ff1-45f5-a3e3-6ed94af2a68f tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:11.299678 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-ad079361-4ff1-45f5-a3e3-6ed94af2a68f tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: a4cf4fac-1e9b-4669-a6ff-30008ed3642d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:11.319601 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ad079361-4ff1-45f5-a3e3-6ed94af2a68f tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:11.323013 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ad079361-4ff1-45f5-a3e3-6ed94af2a68f tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:11.334506 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ad079361-4ff1-45f5-a3e3-6ed94af2a68f tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:11.367193 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ad079361-4ff1-45f5-a3e3-6ed94af2a68f tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:11.370261 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ad079361-4ff1-45f5-a3e3-6ed94af2a68f tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:11.372272 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ad079361-4ff1-45f5-a3e3-6ed94af2a68f tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:11.447450 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-5eba7ea0-0dd2-413e-bfd7-ba75b16449b5 tempest-UnshelveToHostMultiNodesTest-2056876790 tempest-UnshelveToHostMultiNodesTest-2056876790-project-admin] [instance: d0b1b757-4a4d-4a7a-9a06-08f178a02984] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "n-h2-860284-1". {{(pid=134101) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 04 22:01:11.626897 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-5eba7ea0-0dd2-413e-bfd7-ba75b16449b5 tempest-UnshelveToHostMultiNodesTest-2056876790 tempest-UnshelveToHostMultiNodesTest-2056876790-project-admin] 10.222.0.43 "POST /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984/action" status: 202 len: 0 microversion: 2.91 time: 0.546729 Oct 04 22:01:11.631158 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1856/3755] 10.222.0.43 () {62 vars in 1319 bytes} [Tue Oct 4 22:01:11 2022] POST /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984/action => generated 0 bytes in 552 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 22:01:11.641308 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-2daed546-2f3a-44d6-b4b7-7c37fdc9478f tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:11.641822 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-2daed546-2f3a-44d6-b4b7-7c37fdc9478f tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] [instance: d0b1b757-4a4d-4a7a-9a06-08f178a02984] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:11.662973 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2daed546-2f3a-44d6-b4b7-7c37fdc9478f tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:11.663476 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2daed546-2f3a-44d6-b4b7-7c37fdc9478f tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:11.671189 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2daed546-2f3a-44d6-b4b7-7c37fdc9478f tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:11.674944 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2daed546-2f3a-44d6-b4b7-7c37fdc9478f tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:11.675453 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2daed546-2f3a-44d6-b4b7-7c37fdc9478f tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:11.675930 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2daed546-2f3a-44d6-b4b7-7c37fdc9478f tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:11.825394 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-ad079361-4ff1-45f5-a3e3-6ed94af2a68f tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2facee4c6a40416e908083e126d2cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07a17a482a4e92b6ddbdee463c8029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:11.833539 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-ad079361-4ff1-45f5-a3e3-6ed94af2a68f tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d" status: 200 len: 1517 microversion: 2.1 time: 0.568748 Oct 04 22:01:11.840401 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1900/3756] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:01:11 2022] GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d => generated 1517 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:01:11.885686 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-2daed546-2f3a-44d6-b4b7-7c37fdc9478f tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:11.898453 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-2daed546-2f3a-44d6-b4b7-7c37fdc9478f tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:11.904825 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-2daed546-2f3a-44d6-b4b7-7c37fdc9478f tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:11.928073 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-2daed546-2f3a-44d6-b4b7-7c37fdc9478f tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] 10.222.0.43 "GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984" status: 200 len: 1486 microversion: 2.91 time: 0.292024 Oct 04 22:01:11.933547 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1857/3757] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:01:11 2022] GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984 => generated 1486 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:01:12.045667 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-f3403eb5-3b98-4902-b2d8-4681ba12a710 tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:12.047715 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-f3403eb5-3b98-4902-b2d8-4681ba12a710 tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] [instance: 3626ed18-d2aa-4ec2-8a06-4e6c76114cfc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:12.078015 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f3403eb5-3b98-4902-b2d8-4681ba12a710 tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:12.078610 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f3403eb5-3b98-4902-b2d8-4681ba12a710 tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:12.079192 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f3403eb5-3b98-4902-b2d8-4681ba12a710 tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:12.080576 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f3403eb5-3b98-4902-b2d8-4681ba12a710 tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:12.083301 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f3403eb5-3b98-4902-b2d8-4681ba12a710 tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:12.083648 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f3403eb5-3b98-4902-b2d8-4681ba12a710 tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:12.220019 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-8c31ff7a-7483-4006-9351-2e8591a940ca tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1812203460", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452", "networks": [{"uuid": "948c65db-57fc-480e-9ddd-f1d8426ccd4e"}]}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:01:12.376185 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-f3403eb5-3b98-4902-b2d8-4681ba12a710 tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ec630399c5d4231ae3d3975c8370c55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b79bc7a0ba4b3e9415590e7e6b7f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:12.392206 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-f3403eb5-3b98-4902-b2d8-4681ba12a710 tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] 10.222.0.43 "GET /compute/v2.1/servers/3626ed18-d2aa-4ec2-8a06-4e6c76114cfc" status: 200 len: 1329 microversion: 2.1 time: 0.351067 Oct 04 22:01:12.399118 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1858/3758] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:01:12 2022] GET /compute/v2.1/servers/3626ed18-d2aa-4ec2-8a06-4e6c76114cfc => generated 1329 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:01:12.399712 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-d005d8bd-0614-435c-b32d-86ccbb913b0d tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:12.400239 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-d005d8bd-0614-435c-b32d-86ccbb913b0d tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] [instance: 3dbe541d-234a-4049-befd-dcd9a67dbd46] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:12.412341 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d005d8bd-0614-435c-b32d-86ccbb913b0d tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:12.413081 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d005d8bd-0614-435c-b32d-86ccbb913b0d tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:12.414260 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d005d8bd-0614-435c-b32d-86ccbb913b0d tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:12.429752 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d005d8bd-0614-435c-b32d-86ccbb913b0d tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:12.431034 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.network.neutron [None req-8c31ff7a-7483-4006-9351-2e8591a940ca tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] validate_networks() for [('948c65db-57fc-480e-9ddd-f1d8426ccd4e', None, None, None, None, None)] {{(pid=134102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 22:01:12.435721 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d005d8bd-0614-435c-b32d-86ccbb913b0d tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:12.436811 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d005d8bd-0614-435c-b32d-86ccbb913b0d tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:12.827149 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-d005d8bd-0614-435c-b32d-86ccbb913b0d tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2034fc9060874868bc5d27370a1c351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89499d833a4a00805164f4f79ed522', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:12.850759 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-d005d8bd-0614-435c-b32d-86ccbb913b0d tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] 10.222.0.43 "GET /compute/v2.1/servers/3dbe541d-234a-4049-befd-dcd9a67dbd46" status: 200 len: 1270 microversion: 2.1 time: 0.456400 Oct 04 22:01:12.871070 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1859/3759] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:01:12 2022] GET /compute/v2.1/servers/3dbe541d-234a-4049-befd-dcd9a67dbd46 => generated 1270 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:01:12.892211 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-730adaf6-330c-4e8a-90d9-c821d4df3523 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:12.892838 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-730adaf6-330c-4e8a-90d9-c821d4df3523 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: a4cf4fac-1e9b-4669-a6ff-30008ed3642d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:12.921901 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-730adaf6-330c-4e8a-90d9-c821d4df3523 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:12.922432 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-730adaf6-330c-4e8a-90d9-c821d4df3523 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:12.922878 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-730adaf6-330c-4e8a-90d9-c821d4df3523 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:12.923597 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-730adaf6-330c-4e8a-90d9-c821d4df3523 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:12.924058 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-730adaf6-330c-4e8a-90d9-c821d4df3523 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:12.924485 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-730adaf6-330c-4e8a-90d9-c821d4df3523 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:13.717232 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-730adaf6-330c-4e8a-90d9-c821d4df3523 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2facee4c6a40416e908083e126d2cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07a17a482a4e92b6ddbdee463c8029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:13.729887 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-730adaf6-330c-4e8a-90d9-c821d4df3523 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d" status: 200 len: 1517 microversion: 2.1 time: 0.857071 Oct 04 22:01:13.759598 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1860/3760] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:01:12 2022] GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d => generated 1517 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:01:13.769801 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-1900a35b-4f0c-4a86-818b-e4af35433b64 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:13.778240 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-1900a35b-4f0c-4a86-818b-e4af35433b64 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] [instance: d0b1b757-4a4d-4a7a-9a06-08f178a02984] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:13.800910 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1900a35b-4f0c-4a86-818b-e4af35433b64 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:13.801532 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1900a35b-4f0c-4a86-818b-e4af35433b64 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:13.802015 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1900a35b-4f0c-4a86-818b-e4af35433b64 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:13.802914 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1900a35b-4f0c-4a86-818b-e4af35433b64 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:13.803430 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1900a35b-4f0c-4a86-818b-e4af35433b64 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:13.847319 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1900a35b-4f0c-4a86-818b-e4af35433b64 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.044s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:14.843944 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-1900a35b-4f0c-4a86-818b-e4af35433b64 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:14.899071 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-1900a35b-4f0c-4a86-818b-e4af35433b64 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:14.907721 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-1900a35b-4f0c-4a86-818b-e4af35433b64 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:14.966126 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-1900a35b-4f0c-4a86-818b-e4af35433b64 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] 10.222.0.43 "GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984" status: 200 len: 1486 microversion: 2.91 time: 1.204290 Oct 04 22:01:15.012044 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1861/3761] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:01:13 2022] GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984 => generated 1486 bytes in 1251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:01:15.034265 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-f286a0bf-8ca3-4d4c-b870-6b8f4b3b92bd tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:15.043884 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-f286a0bf-8ca3-4d4c-b870-6b8f4b3b92bd tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] [instance: 3626ed18-d2aa-4ec2-8a06-4e6c76114cfc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:15.080335 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f286a0bf-8ca3-4d4c-b870-6b8f4b3b92bd tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:15.084529 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f286a0bf-8ca3-4d4c-b870-6b8f4b3b92bd tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:15.086057 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f286a0bf-8ca3-4d4c-b870-6b8f4b3b92bd tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:15.095517 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f286a0bf-8ca3-4d4c-b870-6b8f4b3b92bd tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:15.101154 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f286a0bf-8ca3-4d4c-b870-6b8f4b3b92bd tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:15.104106 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f286a0bf-8ca3-4d4c-b870-6b8f4b3b92bd tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:15.406567 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-f286a0bf-8ca3-4d4c-b870-6b8f4b3b92bd tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ec630399c5d4231ae3d3975c8370c55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b79bc7a0ba4b3e9415590e7e6b7f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:15.421956 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-f286a0bf-8ca3-4d4c-b870-6b8f4b3b92bd tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] 10.222.0.43 "GET /compute/v2.1/servers/3626ed18-d2aa-4ec2-8a06-4e6c76114cfc" status: 200 len: 1335 microversion: 2.1 time: 0.408268 Oct 04 22:01:15.439109 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1862/3762] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:01:15 2022] GET /compute/v2.1/servers/3626ed18-d2aa-4ec2-8a06-4e6c76114cfc => generated 1335 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:01:15.451082 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-c64942ef-9f90-4e74-b7a1-0611b3a37223 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:15.451082 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-c64942ef-9f90-4e74-b7a1-0611b3a37223 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] [instance: 3dbe541d-234a-4049-befd-dcd9a67dbd46] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:15.476703 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c64942ef-9f90-4e74-b7a1-0611b3a37223 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:15.477708 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c64942ef-9f90-4e74-b7a1-0611b3a37223 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:15.478254 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c64942ef-9f90-4e74-b7a1-0611b3a37223 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:15.479108 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c64942ef-9f90-4e74-b7a1-0611b3a37223 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:15.480275 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c64942ef-9f90-4e74-b7a1-0611b3a37223 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:15.485690 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c64942ef-9f90-4e74-b7a1-0611b3a37223 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:15.973256 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-c64942ef-9f90-4e74-b7a1-0611b3a37223 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2034fc9060874868bc5d27370a1c351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89499d833a4a00805164f4f79ed522', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:15.983425 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-c64942ef-9f90-4e74-b7a1-0611b3a37223 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] 10.222.0.43 "GET /compute/v2.1/servers/3dbe541d-234a-4049-befd-dcd9a67dbd46" status: 200 len: 1276 microversion: 2.1 time: 0.543183 Oct 04 22:01:16.003646 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1863/3763] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:01:15 2022] GET /compute/v2.1/servers/3dbe541d-234a-4049-befd-dcd9a67dbd46 => generated 1276 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:01:16.028347 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-4f153e98-214c-4c18-9459-ce2820499633 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:16.031913 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-4f153e98-214c-4c18-9459-ce2820499633 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: a4cf4fac-1e9b-4669-a6ff-30008ed3642d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:16.059777 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4f153e98-214c-4c18-9459-ce2820499633 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:16.061698 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4f153e98-214c-4c18-9459-ce2820499633 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:16.062892 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4f153e98-214c-4c18-9459-ce2820499633 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:16.064516 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4f153e98-214c-4c18-9459-ce2820499633 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:16.070490 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4f153e98-214c-4c18-9459-ce2820499633 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:16.071204 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4f153e98-214c-4c18-9459-ce2820499633 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:16.183488 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:01:17.556679 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-8c31ff7a-7483-4006-9351-2e8591a940ca tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Flavor limits 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 22:01:17.558623 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-8c31ff7a-7483-4006-9351-2e8591a940ca tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Image limits 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 22:01:17.559730 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-8c31ff7a-7483-4006-9351-2e8591a940ca tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Flavor pref 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 22:01:17.560407 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-8c31ff7a-7483-4006-9351-2e8591a940ca tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Image pref 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 22:01:17.561084 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-8c31ff7a-7483-4006-9351-2e8591a940ca tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 22:01:17.603025 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-4f153e98-214c-4c18-9459-ce2820499633 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2facee4c6a40416e908083e126d2cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07a17a482a4e92b6ddbdee463c8029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:17.610654 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8c31ff7a-7483-4006-9351-2e8591a940ca tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:17.612169 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-4f153e98-214c-4c18-9459-ce2820499633 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d" status: 200 len: 1517 microversion: 2.1 time: 1.607049 Oct 04 22:01:17.615055 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8c31ff7a-7483-4006-9351-2e8591a940ca tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:17.618216 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1864/3764] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:01:16 2022] GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d => generated 1517 bytes in 1614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:01:17.623721 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8c31ff7a-7483-4006-9351-2e8591a940ca tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:17.626479 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8c31ff7a-7483-4006-9351-2e8591a940ca tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:17.628303 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-4b9a464e-7cab-4839-848d-7ee17a2878b5 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:17.632320 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8c31ff7a-7483-4006-9351-2e8591a940ca tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:17.632796 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-4b9a464e-7cab-4839-848d-7ee17a2878b5 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] [instance: d0b1b757-4a4d-4a7a-9a06-08f178a02984] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:17.635580 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8c31ff7a-7483-4006-9351-2e8591a940ca tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:17.659455 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4b9a464e-7cab-4839-848d-7ee17a2878b5 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:17.659834 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4b9a464e-7cab-4839-848d-7ee17a2878b5 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:17.663101 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4b9a464e-7cab-4839-848d-7ee17a2878b5 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:17.664269 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4b9a464e-7cab-4839-848d-7ee17a2878b5 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:17.665806 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4b9a464e-7cab-4839-848d-7ee17a2878b5 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:17.668118 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4b9a464e-7cab-4839-848d-7ee17a2878b5 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:17.719705 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-8c31ff7a-7483-4006-9351-2e8591a940ca tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Getting quotas for project dfe9283584fc4d90b0715216d867ea2f. Resources: {'instances', 'ram', 'cores'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:01:17.744147 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-8c31ff7a-7483-4006-9351-2e8591a940ca tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Getting quotas for user 41a1c8d841104bc9b6910bcc2c0e2bb1 and project dfe9283584fc4d90b0715216d867ea2f. Resources: {'instances', 'ram', 'cores'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:01:17.778666 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-8c31ff7a-7483-4006-9351-2e8591a940ca tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Going to run 1 instances... {{(pid=134102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 22:01:17.791683 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-8c31ff7a-7483-4006-9351-2e8591a940ca tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: aef57343-eb2a-4379-87cd-aab5f82d2a37] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='58548514-5dac-426c-81f5-19e3fba33e23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 22:01:17.817431 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-4b9a464e-7cab-4839-848d-7ee17a2878b5 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:17.841019 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-4b9a464e-7cab-4839-848d-7ee17a2878b5 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:17.846825 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-4b9a464e-7cab-4839-848d-7ee17a2878b5 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:17.865361 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-4b9a464e-7cab-4839-848d-7ee17a2878b5 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] 10.222.0.43 "GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984" status: 200 len: 1544 microversion: 2.91 time: 0.245780 Oct 04 22:01:17.879356 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1865/3765] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:01:17 2022] GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984 => generated 1544 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:01:17.895885 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-7abaf794-272b-4f52-ad0a-444c35ecff17 tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:17.896824 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-7abaf794-272b-4f52-ad0a-444c35ecff17 tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] [instance: 3626ed18-d2aa-4ec2-8a06-4e6c76114cfc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:17.904720 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7abaf794-272b-4f52-ad0a-444c35ecff17 tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:17.907195 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7abaf794-272b-4f52-ad0a-444c35ecff17 tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:17.910792 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7abaf794-272b-4f52-ad0a-444c35ecff17 tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:17.912005 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7abaf794-272b-4f52-ad0a-444c35ecff17 tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:17.912986 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7abaf794-272b-4f52-ad0a-444c35ecff17 tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:17.915685 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7abaf794-272b-4f52-ad0a-444c35ecff17 tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:17.927445 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-8c31ff7a-7483-4006-9351-2e8591a940ca tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.905634 Oct 04 22:01:17.929462 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1901/3766] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 22:01:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 5910 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 22:01:17.941315 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-2c5289ee-e9f2-4d32-8ace-7759fd7745dd tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:17.955387 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-2c5289ee-e9f2-4d32-8ace-7759fd7745dd tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] [instance: 3dbe541d-234a-4049-befd-dcd9a67dbd46] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:17.975726 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2c5289ee-e9f2-4d32-8ace-7759fd7745dd tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:17.983238 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2c5289ee-e9f2-4d32-8ace-7759fd7745dd tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:17.984114 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2c5289ee-e9f2-4d32-8ace-7759fd7745dd tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:17.985150 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2c5289ee-e9f2-4d32-8ace-7759fd7745dd tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:17.985919 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2c5289ee-e9f2-4d32-8ace-7759fd7745dd tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:17.987254 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2c5289ee-e9f2-4d32-8ace-7759fd7745dd tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:18.676771 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=2 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:01:19.039902 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-7abaf794-272b-4f52-ad0a-444c35ecff17 tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ec630399c5d4231ae3d3975c8370c55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b79bc7a0ba4b3e9415590e7e6b7f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:19.072073 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-7abaf794-272b-4f52-ad0a-444c35ecff17 tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] 10.222.0.43 "GET /compute/v2.1/servers/3626ed18-d2aa-4ec2-8a06-4e6c76114cfc" status: 200 len: 1403 microversion: 2.1 time: 1.177311 Oct 04 22:01:19.078953 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1866/3767] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:01:17 2022] GET /compute/v2.1/servers/3626ed18-d2aa-4ec2-8a06-4e6c76114cfc => generated 1403 bytes in 1199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:01:19.105042 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-574c3a02-0ac5-4857-b9cf-7e37e82c1012 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:19.108669 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-574c3a02-0ac5-4857-b9cf-7e37e82c1012 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: aef57343-eb2a-4379-87cd-aab5f82d2a37] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:19.144521 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-2c5289ee-e9f2-4d32-8ace-7759fd7745dd tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2034fc9060874868bc5d27370a1c351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89499d833a4a00805164f4f79ed522', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:19.175735 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-2c5289ee-e9f2-4d32-8ace-7759fd7745dd tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] 10.222.0.43 "GET /compute/v2.1/servers/3dbe541d-234a-4049-befd-dcd9a67dbd46" status: 200 len: 1318 microversion: 2.1 time: 1.244734 Oct 04 22:01:19.179730 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1902/3768] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:01:17 2022] GET /compute/v2.1/servers/3dbe541d-234a-4049-befd-dcd9a67dbd46 => generated 1318 bytes in 1249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:01:19.186404 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-ee5bcab7-a42d-4a1f-8fad-4d18177cc009 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:19.188883 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-ee5bcab7-a42d-4a1f-8fad-4d18177cc009 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: a4cf4fac-1e9b-4669-a6ff-30008ed3642d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:19.198240 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ee5bcab7-a42d-4a1f-8fad-4d18177cc009 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:19.199267 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ee5bcab7-a42d-4a1f-8fad-4d18177cc009 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:19.199864 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ee5bcab7-a42d-4a1f-8fad-4d18177cc009 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:19.200948 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ee5bcab7-a42d-4a1f-8fad-4d18177cc009 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:19.201688 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ee5bcab7-a42d-4a1f-8fad-4d18177cc009 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:19.202347 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ee5bcab7-a42d-4a1f-8fad-4d18177cc009 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:19.547627 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-574c3a02-0ac5-4857-b9cf-7e37e82c1012 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a1c8d841104bc9b6910bcc2c0e2bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe9283584fc4d90b0715216d867ea2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:19.557761 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-574c3a02-0ac5-4857-b9cf-7e37e82c1012 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "GET /compute/v2.1/servers/aef57343-eb2a-4379-87cd-aab5f82d2a37" status: 200 len: 1215 microversion: 2.1 time: 0.472924 Oct 04 22:01:19.559757 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1867/3769] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:01:19 2022] GET /compute/v2.1/servers/aef57343-eb2a-4379-87cd-aab5f82d2a37 => generated 1215 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:01:19.572530 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-67b0cbb8-4d6f-478d-a158-73148009b080 req-6e25726a-c3ce-4541-aa6e-bf1c63928c8d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3626ed18-d2aa-4ec2-8a06-4e6c76114cfc", "tag": "94b1784b-5d0d-44f6-9098-f3342b1032e0"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:01:19.610711 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-67b0cbb8-4d6f-478d-a158-73148009b080 req-6e25726a-c3ce-4541-aa6e-bf1c63928c8d service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:19.616268 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-67b0cbb8-4d6f-478d-a158-73148009b080 req-6e25726a-c3ce-4541-aa6e-bf1c63928c8d service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:19.617237 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-67b0cbb8-4d6f-478d-a158-73148009b080 req-6e25726a-c3ce-4541-aa6e-bf1c63928c8d service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:19.649948 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-67b0cbb8-4d6f-478d-a158-73148009b080 req-6e25726a-c3ce-4541-aa6e-bf1c63928c8d service nova] Creating event network-changed:94b1784b-5d0d-44f6-9098-f3342b1032e0 for instance 3626ed18-d2aa-4ec2-8a06-4e6c76114cfc on n-h2-860284-1 Oct 04 22:01:19.664403 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-67b0cbb8-4d6f-478d-a158-73148009b080 req-6e25726a-c3ce-4541-aa6e-bf1c63928c8d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100629 Oct 04 22:01:19.666767 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1868/3770] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:01:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:01:19.691298 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-2e7ea1d7-ad73-4645-9f05-9f1356ed34d5 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:19.692973 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-2e7ea1d7-ad73-4645-9f05-9f1356ed34d5 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] [instance: d0b1b757-4a4d-4a7a-9a06-08f178a02984] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:19.711811 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2e7ea1d7-ad73-4645-9f05-9f1356ed34d5 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:19.716220 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2e7ea1d7-ad73-4645-9f05-9f1356ed34d5 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:19.717099 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2e7ea1d7-ad73-4645-9f05-9f1356ed34d5 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:19.718107 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2e7ea1d7-ad73-4645-9f05-9f1356ed34d5 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:19.718846 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2e7ea1d7-ad73-4645-9f05-9f1356ed34d5 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:19.719541 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2e7ea1d7-ad73-4645-9f05-9f1356ed34d5 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:19.863967 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-ee5bcab7-a42d-4a1f-8fad-4d18177cc009 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2facee4c6a40416e908083e126d2cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07a17a482a4e92b6ddbdee463c8029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:19.879766 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-ee5bcab7-a42d-4a1f-8fad-4d18177cc009 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d" status: 200 len: 1517 microversion: 2.1 time: 0.698623 Oct 04 22:01:19.895628 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1903/3771] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:01:19 2022] GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d => generated 1517 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:01:20.023856 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-2e7ea1d7-ad73-4645-9f05-9f1356ed34d5 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:20.040758 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-2e7ea1d7-ad73-4645-9f05-9f1356ed34d5 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:20.047245 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-2e7ea1d7-ad73-4645-9f05-9f1356ed34d5 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:20.069086 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-2e7ea1d7-ad73-4645-9f05-9f1356ed34d5 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] 10.222.0.43 "GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984" status: 200 len: 1544 microversion: 2.91 time: 0.399010 Oct 04 22:01:20.072352 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1869/3772] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:01:19 2022] GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984 => generated 1544 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:01:20.104436 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-25d20baa-1ed9-4501-9a98-5d48db243945 tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:20.109990 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-25d20baa-1ed9-4501-9a98-5d48db243945 tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] [instance: 3626ed18-d2aa-4ec2-8a06-4e6c76114cfc] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:20.137740 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-25d20baa-1ed9-4501-9a98-5d48db243945 tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:20.143187 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-25d20baa-1ed9-4501-9a98-5d48db243945 tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:20.143926 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-25d20baa-1ed9-4501-9a98-5d48db243945 tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:20.144977 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-25d20baa-1ed9-4501-9a98-5d48db243945 tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:20.146312 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-25d20baa-1ed9-4501-9a98-5d48db243945 tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:20.156759 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-25d20baa-1ed9-4501-9a98-5d48db243945 tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:20.207001 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-6cca39fb-56c9-416a-9b0a-aff727b19579 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:20.207926 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-6cca39fb-56c9-416a-9b0a-aff727b19579 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] [instance: 3dbe541d-234a-4049-befd-dcd9a67dbd46] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:20.219775 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6cca39fb-56c9-416a-9b0a-aff727b19579 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:20.220382 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6cca39fb-56c9-416a-9b0a-aff727b19579 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:20.220906 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6cca39fb-56c9-416a-9b0a-aff727b19579 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:20.223143 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6cca39fb-56c9-416a-9b0a-aff727b19579 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:20.223669 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6cca39fb-56c9-416a-9b0a-aff727b19579 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:20.225065 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6cca39fb-56c9-416a-9b0a-aff727b19579 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:20.694587 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-6cca39fb-56c9-416a-9b0a-aff727b19579 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2034fc9060874868bc5d27370a1c351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89499d833a4a00805164f4f79ed522', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:20.703870 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-6cca39fb-56c9-416a-9b0a-aff727b19579 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] 10.222.0.43 "GET /compute/v2.1/servers/3dbe541d-234a-4049-befd-dcd9a67dbd46" status: 200 len: 1318 microversion: 2.1 time: 0.501812 Oct 04 22:01:20.707192 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1870/3773] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:01:20 2022] GET /compute/v2.1/servers/3dbe541d-234a-4049-befd-dcd9a67dbd46 => generated 1318 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:01:20.717122 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-25d20baa-1ed9-4501-9a98-5d48db243945 tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ec630399c5d4231ae3d3975c8370c55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b79bc7a0ba4b3e9415590e7e6b7f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:20.721673 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-7764e589-27b7-48f3-9ee8-073e58128bc6 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:20.723088 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-7764e589-27b7-48f3-9ee8-073e58128bc6 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: aef57343-eb2a-4379-87cd-aab5f82d2a37] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:20.727206 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-25d20baa-1ed9-4501-9a98-5d48db243945 tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] 10.222.0.43 "GET /compute/v2.1/servers/3626ed18-d2aa-4ec2-8a06-4e6c76114cfc" status: 200 len: 1403 microversion: 2.1 time: 0.628430 Oct 04 22:01:20.728678 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1904/3774] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:01:20 2022] GET /compute/v2.1/servers/3626ed18-d2aa-4ec2-8a06-4e6c76114cfc => generated 1403 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:01:20.751265 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7764e589-27b7-48f3-9ee8-073e58128bc6 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:20.752309 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7764e589-27b7-48f3-9ee8-073e58128bc6 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:20.752924 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7764e589-27b7-48f3-9ee8-073e58128bc6 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:20.754259 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7764e589-27b7-48f3-9ee8-073e58128bc6 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:20.755302 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7764e589-27b7-48f3-9ee8-073e58128bc6 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:20.755921 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7764e589-27b7-48f3-9ee8-073e58128bc6 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:20.915713 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-636002ab-c3f0-4997-b6fe-469beda1324a tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:20.916822 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-636002ab-c3f0-4997-b6fe-469beda1324a tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: a4cf4fac-1e9b-4669-a6ff-30008ed3642d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:20.947928 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-636002ab-c3f0-4997-b6fe-469beda1324a tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:20.949346 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-636002ab-c3f0-4997-b6fe-469beda1324a tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:20.951744 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-636002ab-c3f0-4997-b6fe-469beda1324a tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:20.952887 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-636002ab-c3f0-4997-b6fe-469beda1324a tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:20.954725 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-636002ab-c3f0-4997-b6fe-469beda1324a tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:20.957013 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-636002ab-c3f0-4997-b6fe-469beda1324a tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:21.199404 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-7764e589-27b7-48f3-9ee8-073e58128bc6 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a1c8d841104bc9b6910bcc2c0e2bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe9283584fc4d90b0715216d867ea2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:21.208828 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-7764e589-27b7-48f3-9ee8-073e58128bc6 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "GET /compute/v2.1/servers/aef57343-eb2a-4379-87cd-aab5f82d2a37" status: 200 len: 1211 microversion: 2.1 time: 0.500215 Oct 04 22:01:21.209420 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1871/3775] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:01:20 2022] GET /compute/v2.1/servers/aef57343-eb2a-4379-87cd-aab5f82d2a37 => generated 1211 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:01:21.231411 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-6d9b3146-22b9-475c-8b3a-f1a2f6b9aa7e tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:21.244963 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-6d9b3146-22b9-475c-8b3a-f1a2f6b9aa7e tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] [instance: d0b1b757-4a4d-4a7a-9a06-08f178a02984] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:21.266079 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6d9b3146-22b9-475c-8b3a-f1a2f6b9aa7e tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:21.266913 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6d9b3146-22b9-475c-8b3a-f1a2f6b9aa7e tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:21.268450 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6d9b3146-22b9-475c-8b3a-f1a2f6b9aa7e tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:21.269922 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6d9b3146-22b9-475c-8b3a-f1a2f6b9aa7e tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:21.270709 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6d9b3146-22b9-475c-8b3a-f1a2f6b9aa7e tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:21.271457 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6d9b3146-22b9-475c-8b3a-f1a2f6b9aa7e tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:21.567108 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-6d9b3146-22b9-475c-8b3a-f1a2f6b9aa7e tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:21.580687 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-6d9b3146-22b9-475c-8b3a-f1a2f6b9aa7e tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:21.585262 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-6d9b3146-22b9-475c-8b3a-f1a2f6b9aa7e tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:21.592896 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-6d9b3146-22b9-475c-8b3a-f1a2f6b9aa7e tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] 10.222.0.43 "GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984" status: 200 len: 1544 microversion: 2.91 time: 0.374222 Oct 04 22:01:21.607142 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1872/3776] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:01:21 2022] GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984 => generated 1544 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:01:21.623918 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-636002ab-c3f0-4997-b6fe-469beda1324a tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2facee4c6a40416e908083e126d2cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07a17a482a4e92b6ddbdee463c8029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:21.650603 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-636002ab-c3f0-4997-b6fe-469beda1324a tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d" status: 200 len: 1517 microversion: 2.1 time: 0.743671 Oct 04 22:01:21.653102 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1905/3777] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:01:20 2022] GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d => generated 1517 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:01:21.729399 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-2ba1b7aa-7a3d-4ebd-a8d9-67294b4e8e0e tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:21.730655 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-2ba1b7aa-7a3d-4ebd-a8d9-67294b4e8e0e tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] [instance: 3dbe541d-234a-4049-befd-dcd9a67dbd46] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:21.737693 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2ba1b7aa-7a3d-4ebd-a8d9-67294b4e8e0e tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:21.738531 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2ba1b7aa-7a3d-4ebd-a8d9-67294b4e8e0e tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:21.738975 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2ba1b7aa-7a3d-4ebd-a8d9-67294b4e8e0e tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:21.739697 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2ba1b7aa-7a3d-4ebd-a8d9-67294b4e8e0e tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:21.740426 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2ba1b7aa-7a3d-4ebd-a8d9-67294b4e8e0e tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:21.741107 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2ba1b7aa-7a3d-4ebd-a8d9-67294b4e8e0e tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:21.759069 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-8ec5fbcd-1029-4806-9985-070763c70a66 tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:21.760747 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-8ec5fbcd-1029-4806-9985-070763c70a66 tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] [instance: 3626ed18-d2aa-4ec2-8a06-4e6c76114cfc] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:21.773331 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8ec5fbcd-1029-4806-9985-070763c70a66 tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:21.773331 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8ec5fbcd-1029-4806-9985-070763c70a66 tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:21.773526 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8ec5fbcd-1029-4806-9985-070763c70a66 tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:21.774806 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8ec5fbcd-1029-4806-9985-070763c70a66 tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:21.775275 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8ec5fbcd-1029-4806-9985-070763c70a66 tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:21.775702 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8ec5fbcd-1029-4806-9985-070763c70a66 tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:22.139293 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-2ba1b7aa-7a3d-4ebd-a8d9-67294b4e8e0e tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2034fc9060874868bc5d27370a1c351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89499d833a4a00805164f4f79ed522', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:22.160161 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-8ec5fbcd-1029-4806-9985-070763c70a66 tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ec630399c5d4231ae3d3975c8370c55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b79bc7a0ba4b3e9415590e7e6b7f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:22.168849 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-2ba1b7aa-7a3d-4ebd-a8d9-67294b4e8e0e tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] 10.222.0.43 "GET /compute/v2.1/servers/3dbe541d-234a-4049-befd-dcd9a67dbd46" status: 200 len: 1318 microversion: 2.1 time: 0.442873 Oct 04 22:01:22.172572 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1873/3778] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:01:21 2022] GET /compute/v2.1/servers/3dbe541d-234a-4049-befd-dcd9a67dbd46 => generated 1318 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:01:22.174107 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-8ec5fbcd-1029-4806-9985-070763c70a66 tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] 10.222.0.43 "GET /compute/v2.1/servers/3626ed18-d2aa-4ec2-8a06-4e6c76114cfc" status: 200 len: 1403 microversion: 2.1 time: 0.422352 Oct 04 22:01:22.191905 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1906/3779] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:01:21 2022] GET /compute/v2.1/servers/3626ed18-d2aa-4ec2-8a06-4e6c76114cfc => generated 1403 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:01:22.238555 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-426d28d7-856b-49da-9640-c95ede8b2572 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:22.239274 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-426d28d7-856b-49da-9640-c95ede8b2572 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: aef57343-eb2a-4379-87cd-aab5f82d2a37] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:22.247427 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-426d28d7-856b-49da-9640-c95ede8b2572 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:22.248583 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-426d28d7-856b-49da-9640-c95ede8b2572 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:22.249377 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-426d28d7-856b-49da-9640-c95ede8b2572 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:22.250512 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-426d28d7-856b-49da-9640-c95ede8b2572 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:22.252051 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-426d28d7-856b-49da-9640-c95ede8b2572 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:22.252568 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-426d28d7-856b-49da-9640-c95ede8b2572 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:22.329654 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-055afbd6-29c9-4065-8a5a-35e83b1536ff req-8154b699-609c-4706-96b9-529f6544b4b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3dbe541d-234a-4049-befd-dcd9a67dbd46", "tag": "f1ab3076-8442-4ba9-915a-127e680713f3"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:01:22.345054 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-055afbd6-29c9-4065-8a5a-35e83b1536ff req-8154b699-609c-4706-96b9-529f6544b4b8 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:22.346073 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-055afbd6-29c9-4065-8a5a-35e83b1536ff req-8154b699-609c-4706-96b9-529f6544b4b8 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:22.348148 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-055afbd6-29c9-4065-8a5a-35e83b1536ff req-8154b699-609c-4706-96b9-529f6544b4b8 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:22.372490 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-055afbd6-29c9-4065-8a5a-35e83b1536ff req-8154b699-609c-4706-96b9-529f6544b4b8 service nova] Creating event network-changed:f1ab3076-8442-4ba9-915a-127e680713f3 for instance 3dbe541d-234a-4049-befd-dcd9a67dbd46 on n-h1-860284-1 Oct 04 22:01:22.378693 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-055afbd6-29c9-4065-8a5a-35e83b1536ff req-8154b699-609c-4706-96b9-529f6544b4b8 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053804 Oct 04 22:01:22.379886 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1907/3780] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:01:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:01:22.447423 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-426d28d7-856b-49da-9640-c95ede8b2572 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a1c8d841104bc9b6910bcc2c0e2bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe9283584fc4d90b0715216d867ea2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:22.459195 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-426d28d7-856b-49da-9640-c95ede8b2572 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "GET /compute/v2.1/servers/aef57343-eb2a-4379-87cd-aab5f82d2a37" status: 200 len: 1273 microversion: 2.1 time: 0.226011 Oct 04 22:01:22.460793 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1874/3781] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:01:22 2022] GET /compute/v2.1/servers/aef57343-eb2a-4379-87cd-aab5f82d2a37 => generated 1273 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:01:22.626332 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-165d592c-8029-4e42-8a8a-11dce1e0e054 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:22.628400 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-165d592c-8029-4e42-8a8a-11dce1e0e054 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] [instance: d0b1b757-4a4d-4a7a-9a06-08f178a02984] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:22.640418 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-165d592c-8029-4e42-8a8a-11dce1e0e054 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:22.641352 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-165d592c-8029-4e42-8a8a-11dce1e0e054 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:22.642223 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-165d592c-8029-4e42-8a8a-11dce1e0e054 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:22.656120 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-165d592c-8029-4e42-8a8a-11dce1e0e054 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:22.658282 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-165d592c-8029-4e42-8a8a-11dce1e0e054 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:22.663782 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-165d592c-8029-4e42-8a8a-11dce1e0e054 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:22.679277 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-7154c32b-09e8-4a92-b2ed-8265b6cfc43a tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:22.679893 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-7154c32b-09e8-4a92-b2ed-8265b6cfc43a tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: a4cf4fac-1e9b-4669-a6ff-30008ed3642d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:22.693820 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7154c32b-09e8-4a92-b2ed-8265b6cfc43a tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:22.696077 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7154c32b-09e8-4a92-b2ed-8265b6cfc43a tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:22.696794 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7154c32b-09e8-4a92-b2ed-8265b6cfc43a tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:22.699924 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7154c32b-09e8-4a92-b2ed-8265b6cfc43a tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:22.700670 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7154c32b-09e8-4a92-b2ed-8265b6cfc43a tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:22.701356 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7154c32b-09e8-4a92-b2ed-8265b6cfc43a tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:22.970701 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-165d592c-8029-4e42-8a8a-11dce1e0e054 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:22.995884 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-165d592c-8029-4e42-8a8a-11dce1e0e054 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:23.000837 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-165d592c-8029-4e42-8a8a-11dce1e0e054 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:23.021817 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-165d592c-8029-4e42-8a8a-11dce1e0e054 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] 10.222.0.43 "GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984" status: 200 len: 1544 microversion: 2.91 time: 0.402954 Oct 04 22:01:23.024591 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1908/3782] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:01:22 2022] GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984 => generated 1544 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:01:23.199017 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-a9bb0f06-a130-4b40-a07e-72f8392c093e tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:23.199666 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-a9bb0f06-a130-4b40-a07e-72f8392c093e tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] [instance: 3dbe541d-234a-4049-befd-dcd9a67dbd46] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:23.212111 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a9bb0f06-a130-4b40-a07e-72f8392c093e tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:23.212610 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a9bb0f06-a130-4b40-a07e-72f8392c093e tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:23.213052 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a9bb0f06-a130-4b40-a07e-72f8392c093e tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:23.213800 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a9bb0f06-a130-4b40-a07e-72f8392c093e tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:23.214838 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a9bb0f06-a130-4b40-a07e-72f8392c093e tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:23.215271 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a9bb0f06-a130-4b40-a07e-72f8392c093e tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:23.619341 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-7154c32b-09e8-4a92-b2ed-8265b6cfc43a tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2facee4c6a40416e908083e126d2cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07a17a482a4e92b6ddbdee463c8029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:23.637852 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-7154c32b-09e8-4a92-b2ed-8265b6cfc43a tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d" status: 200 len: 1517 microversion: 2.1 time: 0.962466 Oct 04 22:01:23.651551 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1875/3783] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:01:22 2022] GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d => generated 1517 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:01:23.675708 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-7a646a49-f5d6-4100-a55b-c5250544cdbf tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:23.676688 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-7a646a49-f5d6-4100-a55b-c5250544cdbf tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] [instance: 3626ed18-d2aa-4ec2-8a06-4e6c76114cfc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:23.708349 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7a646a49-f5d6-4100-a55b-c5250544cdbf tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:23.713482 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7a646a49-f5d6-4100-a55b-c5250544cdbf tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:23.714276 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7a646a49-f5d6-4100-a55b-c5250544cdbf tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:23.723768 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7a646a49-f5d6-4100-a55b-c5250544cdbf tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:23.724689 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7a646a49-f5d6-4100-a55b-c5250544cdbf tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:23.725319 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7a646a49-f5d6-4100-a55b-c5250544cdbf tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:24.275745 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-a9bb0f06-a130-4b40-a07e-72f8392c093e tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2034fc9060874868bc5d27370a1c351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89499d833a4a00805164f4f79ed522', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:24.293092 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-a9bb0f06-a130-4b40-a07e-72f8392c093e tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] 10.222.0.43 "GET /compute/v2.1/servers/3dbe541d-234a-4049-befd-dcd9a67dbd46" status: 200 len: 1318 microversion: 2.1 time: 1.099743 Oct 04 22:01:24.302726 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1909/3784] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:01:23 2022] GET /compute/v2.1/servers/3dbe541d-234a-4049-befd-dcd9a67dbd46 => generated 1318 bytes in 1110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:01:24.331727 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-98dd373c-5334-4cfa-bb28-1d1f8214554d tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:24.341470 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-98dd373c-5334-4cfa-bb28-1d1f8214554d tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: aef57343-eb2a-4379-87cd-aab5f82d2a37] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:24.376724 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-98dd373c-5334-4cfa-bb28-1d1f8214554d tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:24.382811 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-98dd373c-5334-4cfa-bb28-1d1f8214554d tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:24.383384 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-98dd373c-5334-4cfa-bb28-1d1f8214554d tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:24.384161 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-98dd373c-5334-4cfa-bb28-1d1f8214554d tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:24.385263 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-98dd373c-5334-4cfa-bb28-1d1f8214554d tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:24.385845 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-98dd373c-5334-4cfa-bb28-1d1f8214554d tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:24.880444 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-7a646a49-f5d6-4100-a55b-c5250544cdbf tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ec630399c5d4231ae3d3975c8370c55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b79bc7a0ba4b3e9415590e7e6b7f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:24.891386 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-7a646a49-f5d6-4100-a55b-c5250544cdbf tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] 10.222.0.43 "GET /compute/v2.1/servers/3626ed18-d2aa-4ec2-8a06-4e6c76114cfc" status: 200 len: 1403 microversion: 2.1 time: 1.238453 Oct 04 22:01:24.920233 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1876/3785] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:01:23 2022] GET /compute/v2.1/servers/3626ed18-d2aa-4ec2-8a06-4e6c76114cfc => generated 1403 bytes in 1268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:01:24.945838 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-8404c251-d851-4b88-a8e5-041c907b2404 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:24.947040 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-8404c251-d851-4b88-a8e5-041c907b2404 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] [instance: d0b1b757-4a4d-4a7a-9a06-08f178a02984] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:24.960598 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8404c251-d851-4b88-a8e5-041c907b2404 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:24.962348 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8404c251-d851-4b88-a8e5-041c907b2404 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:24.963702 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8404c251-d851-4b88-a8e5-041c907b2404 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:24.966877 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8404c251-d851-4b88-a8e5-041c907b2404 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:24.967593 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8404c251-d851-4b88-a8e5-041c907b2404 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:24.971825 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8404c251-d851-4b88-a8e5-041c907b2404 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:25.152554 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-8404c251-d851-4b88-a8e5-041c907b2404 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:25.176656 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-8404c251-d851-4b88-a8e5-041c907b2404 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:25.181247 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-8404c251-d851-4b88-a8e5-041c907b2404 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:25.194327 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-8404c251-d851-4b88-a8e5-041c907b2404 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] 10.222.0.43 "GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984" status: 200 len: 1544 microversion: 2.91 time: 0.263773 Oct 04 22:01:25.197089 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1877/3786] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:01:24 2022] GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984 => generated 1544 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:01:25.212264 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-76ea79cb-f1f1-4c60-8e84-1ae8d83237a9 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:25.215132 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-76ea79cb-f1f1-4c60-8e84-1ae8d83237a9 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: a4cf4fac-1e9b-4669-a6ff-30008ed3642d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:25.223430 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-76ea79cb-f1f1-4c60-8e84-1ae8d83237a9 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:25.224716 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-76ea79cb-f1f1-4c60-8e84-1ae8d83237a9 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:25.226151 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-76ea79cb-f1f1-4c60-8e84-1ae8d83237a9 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:25.227268 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-76ea79cb-f1f1-4c60-8e84-1ae8d83237a9 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:25.227987 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-76ea79cb-f1f1-4c60-8e84-1ae8d83237a9 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:25.231347 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-76ea79cb-f1f1-4c60-8e84-1ae8d83237a9 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:25.233232 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-98dd373c-5334-4cfa-bb28-1d1f8214554d tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a1c8d841104bc9b6910bcc2c0e2bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe9283584fc4d90b0715216d867ea2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:25.239529 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:01:25.247979 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-98dd373c-5334-4cfa-bb28-1d1f8214554d tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "GET /compute/v2.1/servers/aef57343-eb2a-4379-87cd-aab5f82d2a37" status: 200 len: 1315 microversion: 2.1 time: 0.943456 Oct 04 22:01:25.248991 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1910/3787] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:01:24 2022] GET /compute/v2.1/servers/aef57343-eb2a-4379-87cd-aab5f82d2a37 => generated 1315 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:01:25.272529 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-0bd06bba-ccef-48e2-9619-64fd4ab1d0d5 req-7908da6b-3837-46db-bb32-d638c008ab31 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aef57343-eb2a-4379-87cd-aab5f82d2a37", "tag": "c71f5a1a-58f9-4373-a3a9-cbeab7214d77"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:01:25.311299 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-0bd06bba-ccef-48e2-9619-64fd4ab1d0d5 req-7908da6b-3837-46db-bb32-d638c008ab31 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:25.312359 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-0bd06bba-ccef-48e2-9619-64fd4ab1d0d5 req-7908da6b-3837-46db-bb32-d638c008ab31 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:25.312779 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-0bd06bba-ccef-48e2-9619-64fd4ab1d0d5 req-7908da6b-3837-46db-bb32-d638c008ab31 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:25.335634 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-0bd06bba-ccef-48e2-9619-64fd4ab1d0d5 req-7908da6b-3837-46db-bb32-d638c008ab31 service nova] Creating event network-changed:c71f5a1a-58f9-4373-a3a9-cbeab7214d77 for instance aef57343-eb2a-4379-87cd-aab5f82d2a37 on n-h1-860284-1 Oct 04 22:01:25.347820 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-0bd06bba-ccef-48e2-9619-64fd4ab1d0d5 req-7908da6b-3837-46db-bb32-d638c008ab31 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085962 Oct 04 22:01:25.349658 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1911/3788] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:01:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:01:25.363171 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-9943539b-da9c-4801-8be1-4434c4d996aa tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:25.364796 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-9943539b-da9c-4801-8be1-4434c4d996aa tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] [instance: 3dbe541d-234a-4049-befd-dcd9a67dbd46] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:25.377159 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9943539b-da9c-4801-8be1-4434c4d996aa tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:25.378476 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9943539b-da9c-4801-8be1-4434c4d996aa tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:25.379271 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9943539b-da9c-4801-8be1-4434c4d996aa tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:25.380513 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9943539b-da9c-4801-8be1-4434c4d996aa tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:25.381333 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9943539b-da9c-4801-8be1-4434c4d996aa tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:25.382100 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9943539b-da9c-4801-8be1-4434c4d996aa tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:25.650158 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-76ea79cb-f1f1-4c60-8e84-1ae8d83237a9 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2facee4c6a40416e908083e126d2cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07a17a482a4e92b6ddbdee463c8029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:25.690796 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-76ea79cb-f1f1-4c60-8e84-1ae8d83237a9 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d" status: 200 len: 1517 microversion: 2.1 time: 0.488947 Oct 04 22:01:25.693069 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1878/3789] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:01:25 2022] GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d => generated 1517 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:01:25.696812 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-9943539b-da9c-4801-8be1-4434c4d996aa tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2034fc9060874868bc5d27370a1c351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89499d833a4a00805164f4f79ed522', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:25.726908 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-9943539b-da9c-4801-8be1-4434c4d996aa tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] 10.222.0.43 "GET /compute/v2.1/servers/3dbe541d-234a-4049-befd-dcd9a67dbd46" status: 200 len: 1318 microversion: 2.1 time: 0.368598 Oct 04 22:01:25.730221 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1912/3790] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:01:25 2022] GET /compute/v2.1/servers/3dbe541d-234a-4049-befd-dcd9a67dbd46 => generated 1318 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:01:25.920649 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-9a2be3d5-059c-4eee-91d3-beebc1457b0a tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:25.921485 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-9a2be3d5-059c-4eee-91d3-beebc1457b0a tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] [instance: 3626ed18-d2aa-4ec2-8a06-4e6c76114cfc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:25.935776 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9a2be3d5-059c-4eee-91d3-beebc1457b0a tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:25.936284 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9a2be3d5-059c-4eee-91d3-beebc1457b0a tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:25.936735 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9a2be3d5-059c-4eee-91d3-beebc1457b0a tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:25.944080 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9a2be3d5-059c-4eee-91d3-beebc1457b0a tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:25.944708 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9a2be3d5-059c-4eee-91d3-beebc1457b0a tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:25.945170 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9a2be3d5-059c-4eee-91d3-beebc1457b0a tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:26.227427 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-4f24adb5-f58d-4a39-9d7f-f5aeab926775 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:26.228050 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-4f24adb5-f58d-4a39-9d7f-f5aeab926775 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] [instance: d0b1b757-4a4d-4a7a-9a06-08f178a02984] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:26.236438 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4f24adb5-f58d-4a39-9d7f-f5aeab926775 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:26.237326 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4f24adb5-f58d-4a39-9d7f-f5aeab926775 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:26.238004 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4f24adb5-f58d-4a39-9d7f-f5aeab926775 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:26.239127 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4f24adb5-f58d-4a39-9d7f-f5aeab926775 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:26.240037 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4f24adb5-f58d-4a39-9d7f-f5aeab926775 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:26.240719 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4f24adb5-f58d-4a39-9d7f-f5aeab926775 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:26.489951 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-4f24adb5-f58d-4a39-9d7f-f5aeab926775 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:26.517420 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-4f24adb5-f58d-4a39-9d7f-f5aeab926775 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:26.539783 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-4f24adb5-f58d-4a39-9d7f-f5aeab926775 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:26.557269 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-4f24adb5-f58d-4a39-9d7f-f5aeab926775 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] 10.222.0.43 "GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984" status: 200 len: 1544 microversion: 2.91 time: 0.331035 Oct 04 22:01:26.559868 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1913/3791] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:01:26 2022] GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984 => generated 1544 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 22:01:26.572436 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-8ae7dc3a-04c3-4182-b5d5-9803600a3f28 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:26.580433 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-8ae7dc3a-04c3-4182-b5d5-9803600a3f28 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: aef57343-eb2a-4379-87cd-aab5f82d2a37] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:26.591714 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8ae7dc3a-04c3-4182-b5d5-9803600a3f28 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:26.592759 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8ae7dc3a-04c3-4182-b5d5-9803600a3f28 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:26.593434 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8ae7dc3a-04c3-4182-b5d5-9803600a3f28 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:26.596618 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8ae7dc3a-04c3-4182-b5d5-9803600a3f28 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:26.597482 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8ae7dc3a-04c3-4182-b5d5-9803600a3f28 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:26.600242 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8ae7dc3a-04c3-4182-b5d5-9803600a3f28 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:26.770906 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-9a2be3d5-059c-4eee-91d3-beebc1457b0a tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ec630399c5d4231ae3d3975c8370c55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b79bc7a0ba4b3e9415590e7e6b7f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:26.786273 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-9a2be3d5-059c-4eee-91d3-beebc1457b0a tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] 10.222.0.43 "GET /compute/v2.1/servers/3626ed18-d2aa-4ec2-8a06-4e6c76114cfc" status: 200 len: 1403 microversion: 2.1 time: 0.870713 Oct 04 22:01:26.788220 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1879/3792] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:01:25 2022] GET /compute/v2.1/servers/3626ed18-d2aa-4ec2-8a06-4e6c76114cfc => generated 1403 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:01:26.800253 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e63c5b40-8357-4f22-8dca-379a9855e3b9 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:26.810073 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-e63c5b40-8357-4f22-8dca-379a9855e3b9 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: a4cf4fac-1e9b-4669-a6ff-30008ed3642d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:26.827110 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e63c5b40-8357-4f22-8dca-379a9855e3b9 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:26.827623 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e63c5b40-8357-4f22-8dca-379a9855e3b9 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:26.828077 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e63c5b40-8357-4f22-8dca-379a9855e3b9 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:26.828813 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e63c5b40-8357-4f22-8dca-379a9855e3b9 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:26.829289 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e63c5b40-8357-4f22-8dca-379a9855e3b9 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:26.829719 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e63c5b40-8357-4f22-8dca-379a9855e3b9 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:27.671070 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-8ae7dc3a-04c3-4182-b5d5-9803600a3f28 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a1c8d841104bc9b6910bcc2c0e2bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe9283584fc4d90b0715216d867ea2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:27.685437 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell0:SELECT=4 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:01:27.688983 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-8ae7dc3a-04c3-4182-b5d5-9803600a3f28 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "GET /compute/v2.1/servers/aef57343-eb2a-4379-87cd-aab5f82d2a37" status: 200 len: 1315 microversion: 2.1 time: 1.126393 Oct 04 22:01:27.689830 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1914/3793] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:01:26 2022] GET /compute/v2.1/servers/aef57343-eb2a-4379-87cd-aab5f82d2a37 => generated 1315 bytes in 1129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:01:27.701720 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-db03914b-6edc-44e8-87e0-b90b976bf984 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:27.702355 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-db03914b-6edc-44e8-87e0-b90b976bf984 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] [instance: 3dbe541d-234a-4049-befd-dcd9a67dbd46] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:27.716816 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-db03914b-6edc-44e8-87e0-b90b976bf984 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:27.721609 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-e63c5b40-8357-4f22-8dca-379a9855e3b9 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2facee4c6a40416e908083e126d2cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07a17a482a4e92b6ddbdee463c8029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:27.733964 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-db03914b-6edc-44e8-87e0-b90b976bf984 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:27.743223 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-db03914b-6edc-44e8-87e0-b90b976bf984 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:27.746264 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-e63c5b40-8357-4f22-8dca-379a9855e3b9 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d" status: 200 len: 1517 microversion: 2.1 time: 0.948995 Oct 04 22:01:27.747681 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-db03914b-6edc-44e8-87e0-b90b976bf984 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:27.753513 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-db03914b-6edc-44e8-87e0-b90b976bf984 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:27.754899 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1880/3794] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:01:26 2022] GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d => generated 1517 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:01:27.755899 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-db03914b-6edc-44e8-87e0-b90b976bf984 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:27.768245 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-2c768570-af6e-4f8c-9613-9363732fc793 req-5cc0684f-4725-4767-a023-f0acfdab07f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4cf4fac-1e9b-4669-a6ff-30008ed3642d", "name": "network-vif-plugged", "status": "completed", "tag": "17823d3d-fc62-47ee-8e12-cf0154daa955"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:01:27.783933 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell0:SELECT=14 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:01:27.807321 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-2c768570-af6e-4f8c-9613-9363732fc793 req-5cc0684f-4725-4767-a023-f0acfdab07f1 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:27.808778 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-2c768570-af6e-4f8c-9613-9363732fc793 req-5cc0684f-4725-4767-a023-f0acfdab07f1 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:27.809459 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-2c768570-af6e-4f8c-9613-9363732fc793 req-5cc0684f-4725-4767-a023-f0acfdab07f1 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:27.838251 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-2c768570-af6e-4f8c-9613-9363732fc793 req-5cc0684f-4725-4767-a023-f0acfdab07f1 service nova] Creating event network-vif-plugged:17823d3d-fc62-47ee-8e12-cf0154daa955 for instance a4cf4fac-1e9b-4669-a6ff-30008ed3642d on n-h2-860284-1 Oct 04 22:01:27.852250 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-2c768570-af6e-4f8c-9613-9363732fc793 req-5cc0684f-4725-4767-a023-f0acfdab07f1 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087973 Oct 04 22:01:27.860452 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1881/3795] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:01:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:01:27.875139 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-7c6e806b-4c7f-4e1e-893f-957a8522e7f5 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:27.882387 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-7c6e806b-4c7f-4e1e-893f-957a8522e7f5 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] [instance: d0b1b757-4a4d-4a7a-9a06-08f178a02984] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:27.899848 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7c6e806b-4c7f-4e1e-893f-957a8522e7f5 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:27.901553 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7c6e806b-4c7f-4e1e-893f-957a8522e7f5 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:27.902675 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7c6e806b-4c7f-4e1e-893f-957a8522e7f5 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:27.903657 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7c6e806b-4c7f-4e1e-893f-957a8522e7f5 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:27.906066 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7c6e806b-4c7f-4e1e-893f-957a8522e7f5 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:27.908175 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7c6e806b-4c7f-4e1e-893f-957a8522e7f5 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:28.262815 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-7c6e806b-4c7f-4e1e-893f-957a8522e7f5 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:28.349710 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-7c6e806b-4c7f-4e1e-893f-957a8522e7f5 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:28.357555 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-7c6e806b-4c7f-4e1e-893f-957a8522e7f5 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:28.375572 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-7c6e806b-4c7f-4e1e-893f-957a8522e7f5 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] 10.222.0.43 "GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984" status: 200 len: 1544 microversion: 2.91 time: 0.513179 Oct 04 22:01:28.380794 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1882/3796] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:01:27 2022] GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984 => generated 1544 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:01:28.390083 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-7b6febf9-592f-44cc-b1e2-876eab4f2d66 tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:28.398739 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-7b6febf9-592f-44cc-b1e2-876eab4f2d66 tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] [instance: 3626ed18-d2aa-4ec2-8a06-4e6c76114cfc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:28.415790 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7b6febf9-592f-44cc-b1e2-876eab4f2d66 tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:28.416582 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7b6febf9-592f-44cc-b1e2-876eab4f2d66 tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:28.418055 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7b6febf9-592f-44cc-b1e2-876eab4f2d66 tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:28.420243 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7b6febf9-592f-44cc-b1e2-876eab4f2d66 tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:28.420936 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7b6febf9-592f-44cc-b1e2-876eab4f2d66 tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:28.421721 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7b6febf9-592f-44cc-b1e2-876eab4f2d66 tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:28.492708 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=100 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:01:29.013823 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-db03914b-6edc-44e8-87e0-b90b976bf984 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2034fc9060874868bc5d27370a1c351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89499d833a4a00805164f4f79ed522', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:29.028864 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-db03914b-6edc-44e8-87e0-b90b976bf984 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] 10.222.0.43 "GET /compute/v2.1/servers/3dbe541d-234a-4049-befd-dcd9a67dbd46" status: 200 len: 1318 microversion: 2.1 time: 1.337668 Oct 04 22:01:29.046482 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1915/3797] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:01:27 2022] GET /compute/v2.1/servers/3dbe541d-234a-4049-befd-dcd9a67dbd46 => generated 1318 bytes in 1346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:01:29.046482 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-cc3f7c17-3259-46d1-a79a-4a577d4fb8d4 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:29.046482 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-cc3f7c17-3259-46d1-a79a-4a577d4fb8d4 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: aef57343-eb2a-4379-87cd-aab5f82d2a37] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:29.081455 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cc3f7c17-3259-46d1-a79a-4a577d4fb8d4 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:29.097231 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cc3f7c17-3259-46d1-a79a-4a577d4fb8d4 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:29.098635 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cc3f7c17-3259-46d1-a79a-4a577d4fb8d4 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:29.099651 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cc3f7c17-3259-46d1-a79a-4a577d4fb8d4 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:29.100480 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cc3f7c17-3259-46d1-a79a-4a577d4fb8d4 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:29.101424 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cc3f7c17-3259-46d1-a79a-4a577d4fb8d4 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:29.394506 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-7b6febf9-592f-44cc-b1e2-876eab4f2d66 tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ec630399c5d4231ae3d3975c8370c55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b79bc7a0ba4b3e9415590e7e6b7f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:29.409885 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-7b6febf9-592f-44cc-b1e2-876eab4f2d66 tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] 10.222.0.43 "GET /compute/v2.1/servers/3626ed18-d2aa-4ec2-8a06-4e6c76114cfc" status: 200 len: 1403 microversion: 2.1 time: 1.027605 Oct 04 22:01:29.410534 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1883/3798] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:01:28 2022] GET /compute/v2.1/servers/3626ed18-d2aa-4ec2-8a06-4e6c76114cfc => generated 1403 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:01:29.422121 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-48b0bff6-0975-4cc9-83fe-84307511f117 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:29.428394 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-48b0bff6-0975-4cc9-83fe-84307511f117 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: a4cf4fac-1e9b-4669-a6ff-30008ed3642d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:29.450625 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-48b0bff6-0975-4cc9-83fe-84307511f117 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:29.451414 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-48b0bff6-0975-4cc9-83fe-84307511f117 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:29.452057 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-48b0bff6-0975-4cc9-83fe-84307511f117 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:29.453187 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-48b0bff6-0975-4cc9-83fe-84307511f117 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:29.453835 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-48b0bff6-0975-4cc9-83fe-84307511f117 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:29.454488 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-48b0bff6-0975-4cc9-83fe-84307511f117 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:29.558255 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=14 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:01:30.378488 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-cc3f7c17-3259-46d1-a79a-4a577d4fb8d4 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a1c8d841104bc9b6910bcc2c0e2bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe9283584fc4d90b0715216d867ea2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:30.394980 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-cc3f7c17-3259-46d1-a79a-4a577d4fb8d4 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "GET /compute/v2.1/servers/aef57343-eb2a-4379-87cd-aab5f82d2a37" status: 200 len: 1315 microversion: 2.1 time: 1.353508 Oct 04 22:01:30.408331 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1916/3799] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:01:29 2022] GET /compute/v2.1/servers/aef57343-eb2a-4379-87cd-aab5f82d2a37 => generated 1315 bytes in 1370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:01:30.417324 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-7ecf2409-6766-4250-baeb-5ea55e6e49ba tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:30.429864 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-7ecf2409-6766-4250-baeb-5ea55e6e49ba tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] [instance: d0b1b757-4a4d-4a7a-9a06-08f178a02984] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:30.455258 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7ecf2409-6766-4250-baeb-5ea55e6e49ba tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:30.458502 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7ecf2409-6766-4250-baeb-5ea55e6e49ba tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:30.459132 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7ecf2409-6766-4250-baeb-5ea55e6e49ba tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:30.460680 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7ecf2409-6766-4250-baeb-5ea55e6e49ba tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:30.462379 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7ecf2409-6766-4250-baeb-5ea55e6e49ba tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:30.466990 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7ecf2409-6766-4250-baeb-5ea55e6e49ba tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:30.643124 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-7ecf2409-6766-4250-baeb-5ea55e6e49ba tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:30.656050 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-7ecf2409-6766-4250-baeb-5ea55e6e49ba tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:30.657700 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-7ecf2409-6766-4250-baeb-5ea55e6e49ba tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:30.665686 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-48b0bff6-0975-4cc9-83fe-84307511f117 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2facee4c6a40416e908083e126d2cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07a17a482a4e92b6ddbdee463c8029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:30.669052 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-7ecf2409-6766-4250-baeb-5ea55e6e49ba tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] 10.222.0.43 "GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984" status: 200 len: 1544 microversion: 2.91 time: 0.259141 Oct 04 22:01:30.670687 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1917/3800] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:01:30 2022] GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984 => generated 1544 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:01:30.685726 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-063111cf-09e8-4922-a5d1-07c893ab7cb0 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:30.690023 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-48b0bff6-0975-4cc9-83fe-84307511f117 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d" status: 200 len: 1517 microversion: 2.1 time: 1.273059 Oct 04 22:01:30.691544 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1884/3801] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:01:29 2022] GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d => generated 1517 bytes in 1275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:01:30.691964 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-063111cf-09e8-4922-a5d1-07c893ab7cb0 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] [instance: 3dbe541d-234a-4049-befd-dcd9a67dbd46] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:30.702458 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-b39eb699-ccef-4916-9ba8-a4610b148e00 tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:30.706112 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-b39eb699-ccef-4916-9ba8-a4610b148e00 tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] [instance: 3626ed18-d2aa-4ec2-8a06-4e6c76114cfc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:30.708827 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-063111cf-09e8-4922-a5d1-07c893ab7cb0 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:30.710103 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-063111cf-09e8-4922-a5d1-07c893ab7cb0 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:30.710593 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-063111cf-09e8-4922-a5d1-07c893ab7cb0 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:30.711337 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-063111cf-09e8-4922-a5d1-07c893ab7cb0 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:30.711804 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-063111cf-09e8-4922-a5d1-07c893ab7cb0 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:30.712239 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-063111cf-09e8-4922-a5d1-07c893ab7cb0 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:30.723633 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b39eb699-ccef-4916-9ba8-a4610b148e00 tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:30.724463 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b39eb699-ccef-4916-9ba8-a4610b148e00 tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:30.725113 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b39eb699-ccef-4916-9ba8-a4610b148e00 tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:30.726062 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b39eb699-ccef-4916-9ba8-a4610b148e00 tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:30.726742 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b39eb699-ccef-4916-9ba8-a4610b148e00 tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:30.727353 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b39eb699-ccef-4916-9ba8-a4610b148e00 tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:31.062347 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-063111cf-09e8-4922-a5d1-07c893ab7cb0 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2034fc9060874868bc5d27370a1c351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89499d833a4a00805164f4f79ed522', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:31.074988 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-063111cf-09e8-4922-a5d1-07c893ab7cb0 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] 10.222.0.43 "GET /compute/v2.1/servers/3dbe541d-234a-4049-befd-dcd9a67dbd46" status: 200 len: 1318 microversion: 2.1 time: 0.401513 Oct 04 22:01:31.077390 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1918/3802] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:01:30 2022] GET /compute/v2.1/servers/3dbe541d-234a-4049-befd-dcd9a67dbd46 => generated 1318 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:01:31.092324 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-f47eac48-cc9a-4f6e-9a59-dd52d9fa4604 req-eae43739-9a8c-4feb-9f32-782ea8c88e6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3626ed18-d2aa-4ec2-8a06-4e6c76114cfc", "name": "network-vif-plugged", "status": "completed", "tag": "94b1784b-5d0d-44f6-9098-f3342b1032e0"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:01:31.106519 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-f47eac48-cc9a-4f6e-9a59-dd52d9fa4604 req-eae43739-9a8c-4feb-9f32-782ea8c88e6f service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:31.106935 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-f47eac48-cc9a-4f6e-9a59-dd52d9fa4604 req-eae43739-9a8c-4feb-9f32-782ea8c88e6f service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:31.107571 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-f47eac48-cc9a-4f6e-9a59-dd52d9fa4604 req-eae43739-9a8c-4feb-9f32-782ea8c88e6f service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:31.153351 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-f47eac48-cc9a-4f6e-9a59-dd52d9fa4604 req-eae43739-9a8c-4feb-9f32-782ea8c88e6f service nova] Creating event network-vif-plugged:94b1784b-5d0d-44f6-9098-f3342b1032e0 for instance 3626ed18-d2aa-4ec2-8a06-4e6c76114cfc on n-h2-860284-1 Oct 04 22:01:31.153576 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-b39eb699-ccef-4916-9ba8-a4610b148e00 tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ec630399c5d4231ae3d3975c8370c55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b79bc7a0ba4b3e9415590e7e6b7f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:31.163840 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-f47eac48-cc9a-4f6e-9a59-dd52d9fa4604 req-eae43739-9a8c-4feb-9f32-782ea8c88e6f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081459 Oct 04 22:01:31.166004 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1919/3803] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:01:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:01:31.181158 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-b39eb699-ccef-4916-9ba8-a4610b148e00 tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] 10.222.0.43 "GET /compute/v2.1/servers/3626ed18-d2aa-4ec2-8a06-4e6c76114cfc" status: 200 len: 1403 microversion: 2.1 time: 0.487897 Oct 04 22:01:31.181764 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1885/3804] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:01:30 2022] GET /compute/v2.1/servers/3626ed18-d2aa-4ec2-8a06-4e6c76114cfc => generated 1403 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:01:31.438034 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-4a1e9462-90ef-4fca-96cd-6cac3ede8eb1 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:31.438983 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-4a1e9462-90ef-4fca-96cd-6cac3ede8eb1 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: aef57343-eb2a-4379-87cd-aab5f82d2a37] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:31.457986 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4a1e9462-90ef-4fca-96cd-6cac3ede8eb1 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:31.459007 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4a1e9462-90ef-4fca-96cd-6cac3ede8eb1 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:31.459790 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4a1e9462-90ef-4fca-96cd-6cac3ede8eb1 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:31.460814 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4a1e9462-90ef-4fca-96cd-6cac3ede8eb1 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:31.461558 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4a1e9462-90ef-4fca-96cd-6cac3ede8eb1 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:31.462230 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4a1e9462-90ef-4fca-96cd-6cac3ede8eb1 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:31.701209 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-ba5a6917-351b-44f7-b920-6ab0f6302c37 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:31.701856 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-ba5a6917-351b-44f7-b920-6ab0f6302c37 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] [instance: d0b1b757-4a4d-4a7a-9a06-08f178a02984] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:31.712394 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-4a1e9462-90ef-4fca-96cd-6cac3ede8eb1 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a1c8d841104bc9b6910bcc2c0e2bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe9283584fc4d90b0715216d867ea2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:31.716711 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ba5a6917-351b-44f7-b920-6ab0f6302c37 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:31.717286 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ba5a6917-351b-44f7-b920-6ab0f6302c37 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:31.717763 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ba5a6917-351b-44f7-b920-6ab0f6302c37 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:31.718536 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ba5a6917-351b-44f7-b920-6ab0f6302c37 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:31.719015 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ba5a6917-351b-44f7-b920-6ab0f6302c37 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:31.719881 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ba5a6917-351b-44f7-b920-6ab0f6302c37 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:31.758703 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-4a1e9462-90ef-4fca-96cd-6cac3ede8eb1 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "GET /compute/v2.1/servers/aef57343-eb2a-4379-87cd-aab5f82d2a37" status: 200 len: 1315 microversion: 2.1 time: 0.324085 Oct 04 22:01:31.762349 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1920/3805] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:01:31 2022] GET /compute/v2.1/servers/aef57343-eb2a-4379-87cd-aab5f82d2a37 => generated 1315 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:01:31.790244 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-11f403ff-5ec2-4cae-8a87-2966fadde079 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:31.796646 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-11f403ff-5ec2-4cae-8a87-2966fadde079 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: a4cf4fac-1e9b-4669-a6ff-30008ed3642d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:31.837263 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-11f403ff-5ec2-4cae-8a87-2966fadde079 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:31.838237 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-11f403ff-5ec2-4cae-8a87-2966fadde079 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:31.839069 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-11f403ff-5ec2-4cae-8a87-2966fadde079 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:31.844294 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-11f403ff-5ec2-4cae-8a87-2966fadde079 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:31.848263 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-11f403ff-5ec2-4cae-8a87-2966fadde079 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:31.849097 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-11f403ff-5ec2-4cae-8a87-2966fadde079 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:31.950797 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-ba5a6917-351b-44f7-b920-6ab0f6302c37 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:31.980421 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-ba5a6917-351b-44f7-b920-6ab0f6302c37 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:31.983130 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-ba5a6917-351b-44f7-b920-6ab0f6302c37 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:31.992165 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-ba5a6917-351b-44f7-b920-6ab0f6302c37 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] 10.222.0.43 "GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984" status: 200 len: 1544 microversion: 2.91 time: 0.295451 Oct 04 22:01:31.996290 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1886/3806] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:01:31 2022] GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984 => generated 1544 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 22:01:32.100072 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-ddf638a4-7f26-4f6d-8b7e-488076cad597 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:32.101185 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-ddf638a4-7f26-4f6d-8b7e-488076cad597 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] [instance: 3dbe541d-234a-4049-befd-dcd9a67dbd46] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:32.111702 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ddf638a4-7f26-4f6d-8b7e-488076cad597 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:32.116859 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ddf638a4-7f26-4f6d-8b7e-488076cad597 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:32.118702 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ddf638a4-7f26-4f6d-8b7e-488076cad597 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:32.128976 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ddf638a4-7f26-4f6d-8b7e-488076cad597 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:32.133483 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ddf638a4-7f26-4f6d-8b7e-488076cad597 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:32.138128 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ddf638a4-7f26-4f6d-8b7e-488076cad597 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:32.242505 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-11f403ff-5ec2-4cae-8a87-2966fadde079 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2facee4c6a40416e908083e126d2cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07a17a482a4e92b6ddbdee463c8029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:32.260387 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-11f403ff-5ec2-4cae-8a87-2966fadde079 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d" status: 200 len: 1517 microversion: 2.1 time: 0.496233 Oct 04 22:01:32.275565 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1921/3807] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:01:31 2022] GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d => generated 1517 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:01:32.284818 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-7e986183-70e5-4e8a-956b-c9a07b1155af tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:32.285443 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-7e986183-70e5-4e8a-956b-c9a07b1155af tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] [instance: 3626ed18-d2aa-4ec2-8a06-4e6c76114cfc] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:32.292422 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7e986183-70e5-4e8a-956b-c9a07b1155af tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:32.292921 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7e986183-70e5-4e8a-956b-c9a07b1155af tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:32.293363 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7e986183-70e5-4e8a-956b-c9a07b1155af tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:32.294085 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7e986183-70e5-4e8a-956b-c9a07b1155af tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:32.294749 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7e986183-70e5-4e8a-956b-c9a07b1155af tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:32.295190 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7e986183-70e5-4e8a-956b-c9a07b1155af tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:32.710313 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-ddf638a4-7f26-4f6d-8b7e-488076cad597 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2034fc9060874868bc5d27370a1c351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89499d833a4a00805164f4f79ed522', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:32.724875 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-ddf638a4-7f26-4f6d-8b7e-488076cad597 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] 10.222.0.43 "GET /compute/v2.1/servers/3dbe541d-234a-4049-befd-dcd9a67dbd46" status: 200 len: 1318 microversion: 2.1 time: 0.628693 Oct 04 22:01:32.725750 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1887/3808] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:01:32 2022] GET /compute/v2.1/servers/3dbe541d-234a-4049-befd-dcd9a67dbd46 => generated 1318 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:01:32.763876 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-7e986183-70e5-4e8a-956b-c9a07b1155af tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ec630399c5d4231ae3d3975c8370c55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b79bc7a0ba4b3e9415590e7e6b7f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:32.788254 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-aa11823f-ccfa-4d6a-b4e4-6d0d64298adc tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:32.789216 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-aa11823f-ccfa-4d6a-b4e4-6d0d64298adc tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: aef57343-eb2a-4379-87cd-aab5f82d2a37] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:32.796550 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-7e986183-70e5-4e8a-956b-c9a07b1155af tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] 10.222.0.43 "GET /compute/v2.1/servers/3626ed18-d2aa-4ec2-8a06-4e6c76114cfc" status: 200 len: 1403 microversion: 2.1 time: 0.518285 Oct 04 22:01:32.797527 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1922/3809] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:01:32 2022] GET /compute/v2.1/servers/3626ed18-d2aa-4ec2-8a06-4e6c76114cfc => generated 1403 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:01:32.806207 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-aa11823f-ccfa-4d6a-b4e4-6d0d64298adc tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:32.806919 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-aa11823f-ccfa-4d6a-b4e4-6d0d64298adc tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:32.808100 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-aa11823f-ccfa-4d6a-b4e4-6d0d64298adc tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:32.812767 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-aa11823f-ccfa-4d6a-b4e4-6d0d64298adc tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:32.813431 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-aa11823f-ccfa-4d6a-b4e4-6d0d64298adc tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:32.814054 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-aa11823f-ccfa-4d6a-b4e4-6d0d64298adc tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:33.032087 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-7c68ad9d-7509-4b77-a6f8-1769423800e2 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:33.034612 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-7c68ad9d-7509-4b77-a6f8-1769423800e2 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] [instance: d0b1b757-4a4d-4a7a-9a06-08f178a02984] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:33.092337 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7c68ad9d-7509-4b77-a6f8-1769423800e2 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:33.093352 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7c68ad9d-7509-4b77-a6f8-1769423800e2 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:33.094739 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7c68ad9d-7509-4b77-a6f8-1769423800e2 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:33.096570 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7c68ad9d-7509-4b77-a6f8-1769423800e2 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:33.097440 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7c68ad9d-7509-4b77-a6f8-1769423800e2 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:33.098452 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7c68ad9d-7509-4b77-a6f8-1769423800e2 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:33.184410 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-aa11823f-ccfa-4d6a-b4e4-6d0d64298adc tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a1c8d841104bc9b6910bcc2c0e2bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe9283584fc4d90b0715216d867ea2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:33.194643 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-aa11823f-ccfa-4d6a-b4e4-6d0d64298adc tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "GET /compute/v2.1/servers/aef57343-eb2a-4379-87cd-aab5f82d2a37" status: 200 len: 1315 microversion: 2.1 time: 0.410485 Oct 04 22:01:33.230253 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1888/3810] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:01:32 2022] GET /compute/v2.1/servers/aef57343-eb2a-4379-87cd-aab5f82d2a37 => generated 1315 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:01:33.291453 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-5789baa7-22c6-48b9-95fb-1f818dd3065e tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:33.292942 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-5789baa7-22c6-48b9-95fb-1f818dd3065e tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: a4cf4fac-1e9b-4669-a6ff-30008ed3642d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:33.310902 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5789baa7-22c6-48b9-95fb-1f818dd3065e tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:33.319192 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5789baa7-22c6-48b9-95fb-1f818dd3065e tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:33.319832 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5789baa7-22c6-48b9-95fb-1f818dd3065e tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:33.321907 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5789baa7-22c6-48b9-95fb-1f818dd3065e tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:33.323180 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5789baa7-22c6-48b9-95fb-1f818dd3065e tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:33.330277 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5789baa7-22c6-48b9-95fb-1f818dd3065e tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:33.345905 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-7c68ad9d-7509-4b77-a6f8-1769423800e2 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:33.364521 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-7c68ad9d-7509-4b77-a6f8-1769423800e2 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:33.366293 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-7c68ad9d-7509-4b77-a6f8-1769423800e2 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:33.412157 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-7c68ad9d-7509-4b77-a6f8-1769423800e2 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] 10.222.0.43 "GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984" status: 200 len: 1544 microversion: 2.91 time: 0.386050 Oct 04 22:01:33.414013 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1923/3811] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:01:33 2022] GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984 => generated 1544 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:01:33.667209 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-af3012f9-72e9-4f6f-a849-31eb52c6f827 req-c5296d98-6a1b-4290-b3e6-de44b77c8387 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3dbe541d-234a-4049-befd-dcd9a67dbd46", "name": "network-vif-plugged", "status": "completed", "tag": "f1ab3076-8442-4ba9-915a-127e680713f3"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:01:33.684860 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:01:33.693266 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-af3012f9-72e9-4f6f-a849-31eb52c6f827 req-c5296d98-6a1b-4290-b3e6-de44b77c8387 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:33.694141 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-af3012f9-72e9-4f6f-a849-31eb52c6f827 req-c5296d98-6a1b-4290-b3e6-de44b77c8387 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:33.700759 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-af3012f9-72e9-4f6f-a849-31eb52c6f827 req-c5296d98-6a1b-4290-b3e6-de44b77c8387 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:33.733848 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-af3012f9-72e9-4f6f-a849-31eb52c6f827 req-c5296d98-6a1b-4290-b3e6-de44b77c8387 service nova] Creating event network-vif-plugged:f1ab3076-8442-4ba9-915a-127e680713f3 for instance 3dbe541d-234a-4049-befd-dcd9a67dbd46 on n-h1-860284-1 Oct 04 22:01:33.748862 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-af3012f9-72e9-4f6f-a849-31eb52c6f827 req-c5296d98-6a1b-4290-b3e6-de44b77c8387 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086191 Oct 04 22:01:33.751543 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1924/3812] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:01:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:01:33.776908 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-aa7a23c7-d053-47e0-8a4f-1c08cc87684f tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:33.779232 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-aa7a23c7-d053-47e0-8a4f-1c08cc87684f tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] [instance: 3dbe541d-234a-4049-befd-dcd9a67dbd46] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:33.795839 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-aa7a23c7-d053-47e0-8a4f-1c08cc87684f tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:33.799160 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-aa7a23c7-d053-47e0-8a4f-1c08cc87684f tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:33.799815 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-aa7a23c7-d053-47e0-8a4f-1c08cc87684f tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:33.800751 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-aa7a23c7-d053-47e0-8a4f-1c08cc87684f tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:33.804542 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-aa7a23c7-d053-47e0-8a4f-1c08cc87684f tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:33.805333 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-aa7a23c7-d053-47e0-8a4f-1c08cc87684f tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:34.057492 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-5789baa7-22c6-48b9-95fb-1f818dd3065e tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2facee4c6a40416e908083e126d2cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07a17a482a4e92b6ddbdee463c8029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:34.071680 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-5789baa7-22c6-48b9-95fb-1f818dd3065e tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d" status: 200 len: 1517 microversion: 2.1 time: 0.785161 Oct 04 22:01:34.087047 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1889/3813] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:01:33 2022] GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d => generated 1517 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:01:34.103222 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-9ca67570-6fd0-45ba-8aa6-c318a641216b tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:34.104462 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-9ca67570-6fd0-45ba-8aa6-c318a641216b tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] [instance: 3626ed18-d2aa-4ec2-8a06-4e6c76114cfc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:34.113801 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9ca67570-6fd0-45ba-8aa6-c318a641216b tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:34.114295 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9ca67570-6fd0-45ba-8aa6-c318a641216b tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:34.115037 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9ca67570-6fd0-45ba-8aa6-c318a641216b tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:34.116003 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9ca67570-6fd0-45ba-8aa6-c318a641216b tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:34.116632 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9ca67570-6fd0-45ba-8aa6-c318a641216b tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:34.117258 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9ca67570-6fd0-45ba-8aa6-c318a641216b tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:34.555811 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-aa7a23c7-d053-47e0-8a4f-1c08cc87684f tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2034fc9060874868bc5d27370a1c351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89499d833a4a00805164f4f79ed522', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:34.567884 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-aa7a23c7-d053-47e0-8a4f-1c08cc87684f tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] 10.222.0.43 "GET /compute/v2.1/servers/3dbe541d-234a-4049-befd-dcd9a67dbd46" status: 200 len: 1318 microversion: 2.1 time: 0.814650 Oct 04 22:01:34.574626 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1925/3814] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:01:33 2022] GET /compute/v2.1/servers/3dbe541d-234a-4049-befd-dcd9a67dbd46 => generated 1318 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:01:34.598016 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-2362300f-0ab4-45e8-a5bd-533204e49a8d tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:34.604580 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-2362300f-0ab4-45e8-a5bd-533204e49a8d tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: aef57343-eb2a-4379-87cd-aab5f82d2a37] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:34.621738 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2362300f-0ab4-45e8-a5bd-533204e49a8d tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:34.622576 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2362300f-0ab4-45e8-a5bd-533204e49a8d tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:34.626771 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2362300f-0ab4-45e8-a5bd-533204e49a8d tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:34.627809 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2362300f-0ab4-45e8-a5bd-533204e49a8d tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:34.628579 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2362300f-0ab4-45e8-a5bd-533204e49a8d tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:34.629240 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2362300f-0ab4-45e8-a5bd-533204e49a8d tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:34.660309 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-9ca67570-6fd0-45ba-8aa6-c318a641216b tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ec630399c5d4231ae3d3975c8370c55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b79bc7a0ba4b3e9415590e7e6b7f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:34.674386 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-9ca67570-6fd0-45ba-8aa6-c318a641216b tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] 10.222.0.43 "GET /compute/v2.1/servers/3626ed18-d2aa-4ec2-8a06-4e6c76114cfc" status: 200 len: 1403 microversion: 2.1 time: 0.585791 Oct 04 22:01:34.675600 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1890/3815] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:01:34 2022] GET /compute/v2.1/servers/3626ed18-d2aa-4ec2-8a06-4e6c76114cfc => generated 1403 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:01:34.680897 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-91dc64de-cd27-4385-a474-ba70488618f1 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:34.683083 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-91dc64de-cd27-4385-a474-ba70488618f1 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] [instance: d0b1b757-4a4d-4a7a-9a06-08f178a02984] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:34.690057 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-91dc64de-cd27-4385-a474-ba70488618f1 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:34.691139 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-91dc64de-cd27-4385-a474-ba70488618f1 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:34.691792 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-91dc64de-cd27-4385-a474-ba70488618f1 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:34.693386 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-91dc64de-cd27-4385-a474-ba70488618f1 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:34.694263 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-91dc64de-cd27-4385-a474-ba70488618f1 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:34.694991 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-91dc64de-cd27-4385-a474-ba70488618f1 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:34.818194 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-91dc64de-cd27-4385-a474-ba70488618f1 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:34.835000 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-91dc64de-cd27-4385-a474-ba70488618f1 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:34.840818 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-91dc64de-cd27-4385-a474-ba70488618f1 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:34.848986 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=100 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:01:34.856889 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-91dc64de-cd27-4385-a474-ba70488618f1 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] 10.222.0.43 "GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984" status: 200 len: 1544 microversion: 2.91 time: 0.179936 Oct 04 22:01:34.889735 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1891/3816] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:01:34 2022] GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984 => generated 1544 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:01:35.102026 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-a7441e43-f05f-4717-85a6-5be66f9dd64a tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:35.102848 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-a7441e43-f05f-4717-85a6-5be66f9dd64a tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: a4cf4fac-1e9b-4669-a6ff-30008ed3642d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:35.116263 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a7441e43-f05f-4717-85a6-5be66f9dd64a tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:35.121988 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a7441e43-f05f-4717-85a6-5be66f9dd64a tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:35.123720 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a7441e43-f05f-4717-85a6-5be66f9dd64a tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:35.127300 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a7441e43-f05f-4717-85a6-5be66f9dd64a tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:35.132970 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a7441e43-f05f-4717-85a6-5be66f9dd64a tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:35.133787 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a7441e43-f05f-4717-85a6-5be66f9dd64a tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:35.208703 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-2362300f-0ab4-45e8-a5bd-533204e49a8d tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a1c8d841104bc9b6910bcc2c0e2bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe9283584fc4d90b0715216d867ea2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:35.228367 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-2362300f-0ab4-45e8-a5bd-533204e49a8d tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "GET /compute/v2.1/servers/aef57343-eb2a-4379-87cd-aab5f82d2a37" status: 200 len: 1315 microversion: 2.1 time: 0.649054 Oct 04 22:01:35.230024 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1926/3817] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:01:34 2022] GET /compute/v2.1/servers/aef57343-eb2a-4379-87cd-aab5f82d2a37 => generated 1315 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:01:35.613056 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-9421d53f-e556-4736-b198-33c389e6f1bb tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:35.613926 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-9421d53f-e556-4736-b198-33c389e6f1bb tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] [instance: 3dbe541d-234a-4049-befd-dcd9a67dbd46] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:35.644008 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9421d53f-e556-4736-b198-33c389e6f1bb tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:35.644598 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9421d53f-e556-4736-b198-33c389e6f1bb tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:35.645046 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9421d53f-e556-4736-b198-33c389e6f1bb tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:35.645775 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9421d53f-e556-4736-b198-33c389e6f1bb tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:35.657791 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9421d53f-e556-4736-b198-33c389e6f1bb tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:35.658264 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9421d53f-e556-4736-b198-33c389e6f1bb tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:35.706213 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-a7441e43-f05f-4717-85a6-5be66f9dd64a tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2facee4c6a40416e908083e126d2cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07a17a482a4e92b6ddbdee463c8029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:35.725431 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-a7441e43-f05f-4717-85a6-5be66f9dd64a tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d" status: 200 len: 1504 microversion: 2.1 time: 0.623995 Oct 04 22:01:35.726718 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1892/3818] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:01:35 2022] GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d => generated 1504 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:01:35.733549 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-f628a185-b289-4b43-9572-c052346c9579 tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:35.734594 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-f628a185-b289-4b43-9572-c052346c9579 tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] [instance: 3626ed18-d2aa-4ec2-8a06-4e6c76114cfc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:35.743235 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f628a185-b289-4b43-9572-c052346c9579 tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:35.744171 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f628a185-b289-4b43-9572-c052346c9579 tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:35.745735 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f628a185-b289-4b43-9572-c052346c9579 tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:35.747026 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f628a185-b289-4b43-9572-c052346c9579 tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:35.747740 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f628a185-b289-4b43-9572-c052346c9579 tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:35.748423 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f628a185-b289-4b43-9572-c052346c9579 tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:36.264389 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-9421d53f-e556-4736-b198-33c389e6f1bb tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2034fc9060874868bc5d27370a1c351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89499d833a4a00805164f4f79ed522', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:36.285020 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-9421d53f-e556-4736-b198-33c389e6f1bb tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] 10.222.0.43 "GET /compute/v2.1/servers/3dbe541d-234a-4049-befd-dcd9a67dbd46" status: 200 len: 1318 microversion: 2.1 time: 0.676782 Oct 04 22:01:36.285683 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1927/3819] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:01:35 2022] GET /compute/v2.1/servers/3dbe541d-234a-4049-befd-dcd9a67dbd46 => generated 1318 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:01:36.300052 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-ae324105-fd04-42c9-90a7-2ca8c3d21f5b tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:36.300720 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-ae324105-fd04-42c9-90a7-2ca8c3d21f5b tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: a4cf4fac-1e9b-4669-a6ff-30008ed3642d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:36.311105 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ae324105-fd04-42c9-90a7-2ca8c3d21f5b tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:36.311615 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ae324105-fd04-42c9-90a7-2ca8c3d21f5b tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:36.312069 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ae324105-fd04-42c9-90a7-2ca8c3d21f5b tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:36.312803 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ae324105-fd04-42c9-90a7-2ca8c3d21f5b tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:36.342467 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ae324105-fd04-42c9-90a7-2ca8c3d21f5b tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:36.343236 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ae324105-fd04-42c9-90a7-2ca8c3d21f5b tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.030s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:36.387311 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-f628a185-b289-4b43-9572-c052346c9579 tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ec630399c5d4231ae3d3975c8370c55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b79bc7a0ba4b3e9415590e7e6b7f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:36.402536 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-f628a185-b289-4b43-9572-c052346c9579 tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] 10.222.0.43 "GET /compute/v2.1/servers/3626ed18-d2aa-4ec2-8a06-4e6c76114cfc" status: 200 len: 1590 microversion: 2.1 time: 0.673625 Oct 04 22:01:36.403152 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1893/3820] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:01:35 2022] GET /compute/v2.1/servers/3626ed18-d2aa-4ec2-8a06-4e6c76114cfc => generated 1590 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:01:36.413151 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-761f44e3-390c-4b24-8a02-043aecbee288 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:36.432406 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-761f44e3-390c-4b24-8a02-043aecbee288 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] [instance: d0b1b757-4a4d-4a7a-9a06-08f178a02984] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:36.453409 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-761f44e3-390c-4b24-8a02-043aecbee288 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:36.457155 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-761f44e3-390c-4b24-8a02-043aecbee288 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:36.459894 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-761f44e3-390c-4b24-8a02-043aecbee288 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:36.467351 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-761f44e3-390c-4b24-8a02-043aecbee288 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:36.470454 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-761f44e3-390c-4b24-8a02-043aecbee288 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:36.471190 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-761f44e3-390c-4b24-8a02-043aecbee288 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:36.730584 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-761f44e3-390c-4b24-8a02-043aecbee288 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:36.746936 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-761f44e3-390c-4b24-8a02-043aecbee288 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:36.751651 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-761f44e3-390c-4b24-8a02-043aecbee288 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:36.767077 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-761f44e3-390c-4b24-8a02-043aecbee288 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] 10.222.0.43 "GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984" status: 200 len: 1544 microversion: 2.91 time: 0.357733 Oct 04 22:01:36.779613 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1894/3821] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:01:36 2022] GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984 => generated 1544 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:01:36.790631 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-6fc7e070-a59e-454c-826c-3183e1a31b67 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:36.791650 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-6fc7e070-a59e-454c-826c-3183e1a31b67 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: aef57343-eb2a-4379-87cd-aab5f82d2a37] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:36.794356 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-ae324105-fd04-42c9-90a7-2ca8c3d21f5b tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2facee4c6a40416e908083e126d2cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07a17a482a4e92b6ddbdee463c8029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:36.806146 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-ae324105-fd04-42c9-90a7-2ca8c3d21f5b tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d" status: 200 len: 1504 microversion: 2.1 time: 0.519306 Oct 04 22:01:36.813431 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6fc7e070-a59e-454c-826c-3183e1a31b67 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:36.814259 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6fc7e070-a59e-454c-826c-3183e1a31b67 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:36.815974 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6fc7e070-a59e-454c-826c-3183e1a31b67 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:36.816900 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6fc7e070-a59e-454c-826c-3183e1a31b67 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:36.818747 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6fc7e070-a59e-454c-826c-3183e1a31b67 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:36.820781 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6fc7e070-a59e-454c-826c-3183e1a31b67 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:36.823220 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1928/3822] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:01:36 2022] GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d => generated 1504 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:01:36.831511 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-32b8fdc6-2a0c-4aaa-81a8-cda4d3144d42 tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:36.833629 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-32b8fdc6-2a0c-4aaa-81a8-cda4d3144d42 tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] [instance: 3626ed18-d2aa-4ec2-8a06-4e6c76114cfc] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:36.845583 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-32b8fdc6-2a0c-4aaa-81a8-cda4d3144d42 tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:36.846450 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-32b8fdc6-2a0c-4aaa-81a8-cda4d3144d42 tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:36.847154 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-32b8fdc6-2a0c-4aaa-81a8-cda4d3144d42 tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:36.848040 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-32b8fdc6-2a0c-4aaa-81a8-cda4d3144d42 tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:36.848668 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-32b8fdc6-2a0c-4aaa-81a8-cda4d3144d42 tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:36.849337 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-32b8fdc6-2a0c-4aaa-81a8-cda4d3144d42 tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:36.891960 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=100 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:01:37.027564 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-32b8fdc6-2a0c-4aaa-81a8-cda4d3144d42 tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] 10.222.0.43 "GET /compute/v2.1/servers/3626ed18-d2aa-4ec2-8a06-4e6c76114cfc/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.201952 Oct 04 22:01:37.028687 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1929/3823] 10.222.0.43 () {58 vars in 1275 bytes} [Tue Oct 4 22:01:36 2022] GET /compute/v2.1/servers/3626ed18-d2aa-4ec2-8a06-4e6c76114cfc/os-interface => generated 284 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:01:37.300148 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-6fc7e070-a59e-454c-826c-3183e1a31b67 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a1c8d841104bc9b6910bcc2c0e2bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe9283584fc4d90b0715216d867ea2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:37.311950 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-6fc7e070-a59e-454c-826c-3183e1a31b67 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "GET /compute/v2.1/servers/aef57343-eb2a-4379-87cd-aab5f82d2a37" status: 200 len: 1315 microversion: 2.1 time: 0.530403 Oct 04 22:01:37.314062 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1895/3824] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:01:36 2022] GET /compute/v2.1/servers/aef57343-eb2a-4379-87cd-aab5f82d2a37 => generated 1315 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:01:37.318757 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-023d2805-97ba-42bc-a122-a0a6a0ab2f1b tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-1026255052", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452", "networks": [{"uuid": "935d8778-f843-4ef1-a024-c5cc5da5797f"}]}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:01:37.325514 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-17d628fc-2f8c-476f-aa8e-d3cc4bf94f4b tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:37.326496 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-17d628fc-2f8c-476f-aa8e-d3cc4bf94f4b tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: a4cf4fac-1e9b-4669-a6ff-30008ed3642d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:37.344389 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-17d628fc-2f8c-476f-aa8e-d3cc4bf94f4b tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:37.346053 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-17d628fc-2f8c-476f-aa8e-d3cc4bf94f4b tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:37.348136 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-17d628fc-2f8c-476f-aa8e-d3cc4bf94f4b tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:37.351874 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-17d628fc-2f8c-476f-aa8e-d3cc4bf94f4b tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:37.352731 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-17d628fc-2f8c-476f-aa8e-d3cc4bf94f4b tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:37.355468 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-17d628fc-2f8c-476f-aa8e-d3cc4bf94f4b tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:37.474092 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.network.neutron [None req-023d2805-97ba-42bc-a122-a0a6a0ab2f1b tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] validate_networks() for [('935d8778-f843-4ef1-a024-c5cc5da5797f', None, None, None, None, None)] {{(pid=134102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 22:01:38.399094 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-17d628fc-2f8c-476f-aa8e-d3cc4bf94f4b tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2facee4c6a40416e908083e126d2cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07a17a482a4e92b6ddbdee463c8029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:38.411259 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-17d628fc-2f8c-476f-aa8e-d3cc4bf94f4b tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d" status: 200 len: 1504 microversion: 2.1 time: 1.094898 Oct 04 22:01:38.420517 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1896/3825] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:01:37 2022] GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d => generated 1504 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:01:38.427891 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-592c97fa-d1af-4da7-828b-f6b6d8285489 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:38.429020 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-592c97fa-d1af-4da7-828b-f6b6d8285489 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] [instance: 3dbe541d-234a-4049-befd-dcd9a67dbd46] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:38.436311 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-592c97fa-d1af-4da7-828b-f6b6d8285489 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:38.437232 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-592c97fa-d1af-4da7-828b-f6b6d8285489 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:38.438022 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-592c97fa-d1af-4da7-828b-f6b6d8285489 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:38.438990 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-592c97fa-d1af-4da7-828b-f6b6d8285489 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:38.439872 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-592c97fa-d1af-4da7-828b-f6b6d8285489 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:38.440624 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-592c97fa-d1af-4da7-828b-f6b6d8285489 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:38.843805 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-592c97fa-d1af-4da7-828b-f6b6d8285489 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2034fc9060874868bc5d27370a1c351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89499d833a4a00805164f4f79ed522', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:38.853648 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-592c97fa-d1af-4da7-828b-f6b6d8285489 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] 10.222.0.43 "GET /compute/v2.1/servers/3dbe541d-234a-4049-befd-dcd9a67dbd46" status: 200 len: 1507 microversion: 2.1 time: 0.431439 Oct 04 22:01:38.855498 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1897/3826] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:01:38 2022] GET /compute/v2.1/servers/3dbe541d-234a-4049-befd-dcd9a67dbd46 => generated 1507 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:01:38.861406 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-19d05457-79de-4118-a5dd-30942f669201 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:38.862092 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-19d05457-79de-4118-a5dd-30942f669201 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] [instance: d0b1b757-4a4d-4a7a-9a06-08f178a02984] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:38.869102 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-19d05457-79de-4118-a5dd-30942f669201 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:38.870705 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-19d05457-79de-4118-a5dd-30942f669201 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:38.871388 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-19d05457-79de-4118-a5dd-30942f669201 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:38.872428 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-19d05457-79de-4118-a5dd-30942f669201 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:38.873203 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-19d05457-79de-4118-a5dd-30942f669201 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:38.873864 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-19d05457-79de-4118-a5dd-30942f669201 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:39.016562 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-19d05457-79de-4118-a5dd-30942f669201 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:39.026644 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-19d05457-79de-4118-a5dd-30942f669201 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:39.029566 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-19d05457-79de-4118-a5dd-30942f669201 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:39.036427 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-19d05457-79de-4118-a5dd-30942f669201 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] 10.222.0.43 "GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984" status: 200 len: 1544 microversion: 2.91 time: 0.179636 Oct 04 22:01:39.038049 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1898/3827] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:01:38 2022] GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984 => generated 1544 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:01:39.044079 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-becc5524-b008-4ee9-b0f6-12aa426b0711 req-db0bb80f-1063-4974-8a2c-975a07d45b47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aef57343-eb2a-4379-87cd-aab5f82d2a37", "name": "network-vif-plugged", "status": "completed", "tag": "c71f5a1a-58f9-4373-a3a9-cbeab7214d77"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:01:39.054910 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-becc5524-b008-4ee9-b0f6-12aa426b0711 req-db0bb80f-1063-4974-8a2c-975a07d45b47 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:39.055593 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-becc5524-b008-4ee9-b0f6-12aa426b0711 req-db0bb80f-1063-4974-8a2c-975a07d45b47 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:39.056123 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-becc5524-b008-4ee9-b0f6-12aa426b0711 req-db0bb80f-1063-4974-8a2c-975a07d45b47 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:39.069832 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-becc5524-b008-4ee9-b0f6-12aa426b0711 req-db0bb80f-1063-4974-8a2c-975a07d45b47 service nova] Creating event network-vif-plugged:c71f5a1a-58f9-4373-a3a9-cbeab7214d77 for instance aef57343-eb2a-4379-87cd-aab5f82d2a37 on n-h1-860284-1 Oct 04 22:01:39.076127 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-becc5524-b008-4ee9-b0f6-12aa426b0711 req-db0bb80f-1063-4974-8a2c-975a07d45b47 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036813 Oct 04 22:01:39.076925 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1899/3828] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:01:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:01:39.083738 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-4f4314b4-146e-4804-8fc8-4b513ff6deec tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:39.084542 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-4f4314b4-146e-4804-8fc8-4b513ff6deec tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: aef57343-eb2a-4379-87cd-aab5f82d2a37] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:39.092346 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4f4314b4-146e-4804-8fc8-4b513ff6deec tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:39.092849 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4f4314b4-146e-4804-8fc8-4b513ff6deec tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:39.093369 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4f4314b4-146e-4804-8fc8-4b513ff6deec tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:39.094500 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4f4314b4-146e-4804-8fc8-4b513ff6deec tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:39.095613 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4f4314b4-146e-4804-8fc8-4b513ff6deec tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:39.096674 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4f4314b4-146e-4804-8fc8-4b513ff6deec tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:39.124431 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=100 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:01:39.274319 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-023d2805-97ba-42bc-a122-a0a6a0ab2f1b tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Flavor limits 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 22:01:39.275009 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-023d2805-97ba-42bc-a122-a0a6a0ab2f1b tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Image limits 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 22:01:39.275440 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-023d2805-97ba-42bc-a122-a0a6a0ab2f1b tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Flavor pref 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 22:01:39.276125 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-023d2805-97ba-42bc-a122-a0a6a0ab2f1b tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Image pref 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 22:01:39.276774 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-023d2805-97ba-42bc-a122-a0a6a0ab2f1b tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 22:01:39.317448 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-023d2805-97ba-42bc-a122-a0a6a0ab2f1b tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:39.318248 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-023d2805-97ba-42bc-a122-a0a6a0ab2f1b tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:39.320912 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-023d2805-97ba-42bc-a122-a0a6a0ab2f1b tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:39.330973 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-023d2805-97ba-42bc-a122-a0a6a0ab2f1b tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:39.331495 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-023d2805-97ba-42bc-a122-a0a6a0ab2f1b tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:39.331948 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-023d2805-97ba-42bc-a122-a0a6a0ab2f1b tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:39.385000 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-023d2805-97ba-42bc-a122-a0a6a0ab2f1b tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Getting quotas for project b710cb6300854d8683bd52ddf56b787d. Resources: {'instances', 'ram', 'cores'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:01:39.393583 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-023d2805-97ba-42bc-a122-a0a6a0ab2f1b tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Getting quotas for user 3adbba85c5a448148833e69d6304e62e and project b710cb6300854d8683bd52ddf56b787d. Resources: {'instances', 'ram', 'cores'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:01:39.417798 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-023d2805-97ba-42bc-a122-a0a6a0ab2f1b tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Going to run 1 instances... {{(pid=134102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 22:01:39.420615 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-023d2805-97ba-42bc-a122-a0a6a0ab2f1b tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] [instance: 7285a94c-3dad-43f1-9052-63ccc9ac07ba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='58548514-5dac-426c-81f5-19e3fba33e23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 22:01:39.485753 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-023d2805-97ba-42bc-a122-a0a6a0ab2f1b tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 2.455560 Oct 04 22:01:39.493099 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1930/3829] 10.222.0.43 () {62 vars in 1188 bytes} [Tue Oct 4 22:01:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 2464 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 04 22:01:39.503819 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-d7c79267-e54f-4e7b-8303-95006c06213f tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:01:39.511424 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-d7c79267-e54f-4e7b-8303-95006c06213f tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] HTTP exception thrown: Instance 4d36879e-3caa-4f0d-9903-ad0194626d31 has no mapping to a cell. Oct 04 22:01:39.518941 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-d7c79267-e54f-4e7b-8303-95006c06213f tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Request method failure captured: Oct 04 22:01:39.518941 n-d-860284-1 devstack@n-api.service[134102]: request: POST /compute/v2.1/servers/4d36879e-3caa-4f0d-9903-ad0194626d31/action HTTP/1.1 Oct 04 22:01:39.518941 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 22:01:39.518941 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 22:01:39.518941 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 22:01:39.518941 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 15 Oct 04 22:01:39.518941 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 22:01:39.518941 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 22:01:39.518941 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 22:01:39.518941 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 22:01:39.518941 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPKwu4cpW6hhBuWb-qV_7iYlwjOTpf5XWCl53BJjoosjlcj4wkmmOFzemCJVdBntIx8zJ1SF_z6VrRY8UJr7E8TQDJCRnVQMdNnh0-lZwGdqUzjOWSO31Ryb6n87Cka0g238a21JWok3h3GEhLB-7oCbN3bbcOGmkhd6UFueRxRluk24 Oct 04 22:01:39.518941 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 22:01:39.518941 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 22:01:39.518941 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 22:01:39.518941 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 22:01:39.518941 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 22:01:39.518941 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 22:01:39.518941 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: cf07a17a482a4e92b6ddbdee463c8029 Oct 04 22:01:39.518941 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-ServersNegativeTestJSON-1933663319 Oct 04 22:01:39.518941 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 22:01:39.518941 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 22:01:39.518941 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/cf07a17a482a4e92b6ddbdee463c8029"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_cf07a17a482a4e92b6ddbdee463c8029", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/cf07a17a482a4e92b6ddbdee463c8029"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/cf07a17a482a4e92b6ddbdee463c8029"}]}] Oct 04 22:01:39.518941 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-ServersNegativeTestJSON-1933663319 Oct 04 22:01:39.518941 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: cf07a17a482a4e92b6ddbdee463c8029 Oct 04 22:01:39.518941 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1933663319 Oct 04 22:01:39.518941 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-ServersNegativeTestJSON-1933663319-project Oct 04 22:01:39.518941 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 22:01:39.518941 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 22:01:39.518941 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: 2facee4c6a40416e908083e126d2cfa3 Oct 04 22:01:39.518941 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-ServersNegativeTestJSON-1933663319-project Oct 04 22:01:39.518941 n-d-860284-1 devstack@n-api.service[134102]: Oct 04 22:01:39.518941 n-d-860284-1 devstack@n-api.service[134102]: {"os-stop": {}} Oct 04 22:01:39.518941 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 22:01:39.518941 n-d-860284-1 devstack@n-api.service[134102]: exception: Instance 4d36879e-3caa-4f0d-9903-ad0194626d31 has no mapping to a cell. Oct 04 22:01:39.518941 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': '4d36879e-3caa-4f0d-9903-ad0194626d31', 'body': {'os-stop': {}}} Oct 04 22:01:39.518941 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:01:39.518941 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:01:39.518941 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1411, in _get_instance Oct 04 22:01:39.518941 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi mapping = objects.InstanceMapping.get_by_instance_uuid( Oct 04 22:01:39.518941 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 22:01:39.518941 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 22:01:39.518941 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 112, in get_by_instance_uuid Oct 04 22:01:39.518941 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_instance_uuid_from_db(context, instance_uuid) Oct 04 22:01:39.518941 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 22:01:39.518941 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 22:01:39.518941 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 106, in _get_by_instance_uuid_from_db Oct 04 22:01:39.518941 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.InstanceMappingNotFound(uuid=instance_uuid) Oct 04 22:01:39.518941 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceMappingNotFound: Instance 4d36879e-3caa-4f0d-9903-ad0194626d31 has no mapping to a cell. Oct 04 22:01:39.518941 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:01:39.518941 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:01:39.518941 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:01:39.518941 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:01:39.518941 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:01:39.518941 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:01:39.518941 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:01:39.518941 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:01:39.518941 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:01:39.518941 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:01:39.518941 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1444, in _stop_server Oct 04 22:01:39.518941 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, id) Oct 04 22:01:39.518941 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1418, in _get_instance Oct 04 22:01:39.518941 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:01:39.518941 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d36879e-3caa-4f0d-9903-ad0194626d31 has no mapping to a cell. Oct 04 22:01:39.530977 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:01:39.530977 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:01:39.530977 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:01:39.530977 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:01:39.530977 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:01:39.530977 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:01:39.530977 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:01:39.530977 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:01:39.530977 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d36879e-3caa-4f0d-9903-ad0194626d31 has no mapping to a cell. Oct 04 22:01:39.530977 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:01:39.530977 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-d7c79267-e54f-4e7b-8303-95006c06213f tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Returning 404 to user: Instance 4d36879e-3caa-4f0d-9903-ad0194626d31 has no mapping to a cell. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:01:39.530977 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-d7c79267-e54f-4e7b-8303-95006c06213f tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "POST /compute/v2.1/servers/4d36879e-3caa-4f0d-9903-ad0194626d31/action" status: 404 len: 117 microversion: 2.1 time: 0.026028 Oct 04 22:01:39.533021 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-4f4314b4-146e-4804-8fc8-4b513ff6deec tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a1c8d841104bc9b6910bcc2c0e2bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe9283584fc4d90b0715216d867ea2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:39.533419 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1931/3830] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 22:01:39 2022] POST /compute/v2.1/servers/4d36879e-3caa-4f0d-9903-ad0194626d31/action => generated 117 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:01:39.533419 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-7398a0a5-c81b-4c8b-badc-4a98132a6ade tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:39.533419 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-7398a0a5-c81b-4c8b-badc-4a98132a6ade tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] [instance: 3dbe541d-234a-4049-befd-dcd9a67dbd46] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:39.540532 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7398a0a5-c81b-4c8b-badc-4a98132a6ade tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:39.541041 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7398a0a5-c81b-4c8b-badc-4a98132a6ade tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:39.542107 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7398a0a5-c81b-4c8b-badc-4a98132a6ade tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:39.542887 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7398a0a5-c81b-4c8b-badc-4a98132a6ade tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:39.543352 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7398a0a5-c81b-4c8b-badc-4a98132a6ade tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:39.543787 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7398a0a5-c81b-4c8b-badc-4a98132a6ade tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:39.546745 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-4f4314b4-146e-4804-8fc8-4b513ff6deec tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "GET /compute/v2.1/servers/aef57343-eb2a-4379-87cd-aab5f82d2a37" status: 200 len: 1315 microversion: 2.1 time: 0.465422 Oct 04 22:01:39.547388 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1900/3831] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:01:39 2022] GET /compute/v2.1/servers/aef57343-eb2a-4379-87cd-aab5f82d2a37 => generated 1315 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:01:39.552508 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-c5291191-cd1d-4bf4-88cd-212afa48a6a9 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:39.553136 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-c5291191-cd1d-4bf4-88cd-212afa48a6a9 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] [instance: 7285a94c-3dad-43f1-9052-63ccc9ac07ba] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:40.012953 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-c5291191-cd1d-4bf4-88cd-212afa48a6a9 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3adbba85c5a448148833e69d6304e62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b710cb6300854d8683bd52ddf56b787d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:40.031111 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-c5291191-cd1d-4bf4-88cd-212afa48a6a9 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3adbba85c5a448148833e69d6304e62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b710cb6300854d8683bd52ddf56b787d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:40.033160 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-c5291191-cd1d-4bf4-88cd-212afa48a6a9 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3adbba85c5a448148833e69d6304e62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b710cb6300854d8683bd52ddf56b787d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:40.035604 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-c5291191-cd1d-4bf4-88cd-212afa48a6a9 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] 10.222.0.43 "GET /compute/v2.1/servers/7285a94c-3dad-43f1-9052-63ccc9ac07ba" status: 200 len: 1262 microversion: 2.26 time: 0.487000 Oct 04 22:01:40.036297 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1901/3832] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:01:39 2022] GET /compute/v2.1/servers/7285a94c-3dad-43f1-9052-63ccc9ac07ba => generated 1262 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:01:40.043317 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-3df6d958-759a-4a64-a581-f059be6f992a tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:40.044088 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-3df6d958-759a-4a64-a581-f059be6f992a tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: a4cf4fac-1e9b-4669-a6ff-30008ed3642d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:40.052121 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3df6d958-759a-4a64-a581-f059be6f992a tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:40.052785 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3df6d958-759a-4a64-a581-f059be6f992a tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:40.053337 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3df6d958-759a-4a64-a581-f059be6f992a tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:40.054228 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3df6d958-759a-4a64-a581-f059be6f992a tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:40.054839 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3df6d958-759a-4a64-a581-f059be6f992a tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:40.055443 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3df6d958-759a-4a64-a581-f059be6f992a tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:40.220903 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-7398a0a5-c81b-4c8b-badc-4a98132a6ade tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2034fc9060874868bc5d27370a1c351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89499d833a4a00805164f4f79ed522', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:40.238653 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-7398a0a5-c81b-4c8b-badc-4a98132a6ade tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] 10.222.0.43 "GET /compute/v2.1/servers/3dbe541d-234a-4049-befd-dcd9a67dbd46" status: 200 len: 1507 microversion: 2.1 time: 0.711513 Oct 04 22:01:40.254391 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1932/3833] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:01:39 2022] GET /compute/v2.1/servers/3dbe541d-234a-4049-befd-dcd9a67dbd46 => generated 1507 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:01:40.254391 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-c6fb53ac-e250-45d2-909b-6785350cdf07 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:40.255042 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-c6fb53ac-e250-45d2-909b-6785350cdf07 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] [instance: d0b1b757-4a4d-4a7a-9a06-08f178a02984] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:40.263496 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c6fb53ac-e250-45d2-909b-6785350cdf07 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:40.264290 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c6fb53ac-e250-45d2-909b-6785350cdf07 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:40.264969 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c6fb53ac-e250-45d2-909b-6785350cdf07 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:40.266168 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c6fb53ac-e250-45d2-909b-6785350cdf07 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:40.267005 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c6fb53ac-e250-45d2-909b-6785350cdf07 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:40.267805 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c6fb53ac-e250-45d2-909b-6785350cdf07 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:40.385277 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-c6fb53ac-e250-45d2-909b-6785350cdf07 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:40.398103 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-c6fb53ac-e250-45d2-909b-6785350cdf07 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:40.403845 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-c6fb53ac-e250-45d2-909b-6785350cdf07 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:40.410909 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-3df6d958-759a-4a64-a581-f059be6f992a tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2facee4c6a40416e908083e126d2cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07a17a482a4e92b6ddbdee463c8029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:40.411180 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-c6fb53ac-e250-45d2-909b-6785350cdf07 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] 10.222.0.43 "GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984" status: 200 len: 1544 microversion: 2.91 time: 0.166335 Oct 04 22:01:40.418569 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1933/3834] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:01:40 2022] GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984 => generated 1544 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:01:40.423365 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-fb231a84-4b68-488c-b6be-08884c3ebc78 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:01:40.429964 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-fb231a84-4b68-488c-b6be-08884c3ebc78 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] [instance: 3dbe541d-234a-4049-befd-dcd9a67dbd46] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:40.443928 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-3df6d958-759a-4a64-a581-f059be6f992a tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d" status: 200 len: 1504 microversion: 2.1 time: 0.404811 Oct 04 22:01:40.451537 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1902/3835] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:01:40 2022] GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d => generated 1504 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:01:40.456103 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fb231a84-4b68-488c-b6be-08884c3ebc78 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:40.456990 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fb231a84-4b68-488c-b6be-08884c3ebc78 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:40.458876 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fb231a84-4b68-488c-b6be-08884c3ebc78 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:40.460463 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fb231a84-4b68-488c-b6be-08884c3ebc78 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:40.461138 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fb231a84-4b68-488c-b6be-08884c3ebc78 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:40.461979 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fb231a84-4b68-488c-b6be-08884c3ebc78 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:40.472875 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-7cbb0cf2-538e-4cac-8a5e-86f7c0583a90 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:40.473620 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-7cbb0cf2-538e-4cac-8a5e-86f7c0583a90 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: a4cf4fac-1e9b-4669-a6ff-30008ed3642d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:40.487696 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7cbb0cf2-538e-4cac-8a5e-86f7c0583a90 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:40.488204 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7cbb0cf2-538e-4cac-8a5e-86f7c0583a90 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:40.488753 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7cbb0cf2-538e-4cac-8a5e-86f7c0583a90 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:40.489478 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7cbb0cf2-538e-4cac-8a5e-86f7c0583a90 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:40.492020 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7cbb0cf2-538e-4cac-8a5e-86f7c0583a90 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:40.493104 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7cbb0cf2-538e-4cac-8a5e-86f7c0583a90 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:40.571923 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-fb231a84-4b68-488c-b6be-08884c3ebc78 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] 10.222.0.43 "PUT /compute/v2.1/servers/3dbe541d-234a-4049-befd-dcd9a67dbd46" status: 200 len: 1079 microversion: 2.1 time: 0.158563 Oct 04 22:01:40.575063 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1934/3836] 10.222.0.43 () {60 vars in 1256 bytes} [Tue Oct 4 22:01:40 2022] PUT /compute/v2.1/servers/3dbe541d-234a-4049-befd-dcd9a67dbd46 => generated 1079 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:01:40.580786 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-743a2339-03bd-4767-9d5a-230a5dc0a584 tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:40.581763 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-743a2339-03bd-4767-9d5a-230a5dc0a584 tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] [instance: 3626ed18-d2aa-4ec2-8a06-4e6c76114cfc] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:40.590406 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-743a2339-03bd-4767-9d5a-230a5dc0a584 tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:40.591988 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-743a2339-03bd-4767-9d5a-230a5dc0a584 tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:40.592595 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-743a2339-03bd-4767-9d5a-230a5dc0a584 tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:40.594108 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-743a2339-03bd-4767-9d5a-230a5dc0a584 tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:40.594792 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-743a2339-03bd-4767-9d5a-230a5dc0a584 tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:40.595656 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-743a2339-03bd-4767-9d5a-230a5dc0a584 tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:40.664893 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-7cbb0cf2-538e-4cac-8a5e-86f7c0583a90 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2facee4c6a40416e908083e126d2cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07a17a482a4e92b6ddbdee463c8029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:40.680631 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-7cbb0cf2-538e-4cac-8a5e-86f7c0583a90 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d" status: 200 len: 1504 microversion: 2.1 time: 0.214214 Oct 04 22:01:40.681234 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1903/3837] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:01:40 2022] GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d => generated 1504 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:01:40.704992 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-1f30e4e7-57e9-474a-b30f-e2a1fb99dae8 req-e4b28964-35a8-4db7-9b18-d1d71966c196 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3626ed18-d2aa-4ec2-8a06-4e6c76114cfc", "tag": "94b1784b-5d0d-44f6-9098-f3342b1032e0"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:01:40.731827 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-1f30e4e7-57e9-474a-b30f-e2a1fb99dae8 req-e4b28964-35a8-4db7-9b18-d1d71966c196 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:40.732326 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-1f30e4e7-57e9-474a-b30f-e2a1fb99dae8 req-e4b28964-35a8-4db7-9b18-d1d71966c196 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:40.732758 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-1f30e4e7-57e9-474a-b30f-e2a1fb99dae8 req-e4b28964-35a8-4db7-9b18-d1d71966c196 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:40.748809 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-1f30e4e7-57e9-474a-b30f-e2a1fb99dae8 req-e4b28964-35a8-4db7-9b18-d1d71966c196 service nova] Creating event network-changed:94b1784b-5d0d-44f6-9098-f3342b1032e0 for instance 3626ed18-d2aa-4ec2-8a06-4e6c76114cfc on n-h2-860284-1 Oct 04 22:01:40.756159 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-1f30e4e7-57e9-474a-b30f-e2a1fb99dae8 req-e4b28964-35a8-4db7-9b18-d1d71966c196 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073490 Oct 04 22:01:40.757084 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1904/3838] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:01:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:01:40.763681 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-1021d079-d855-4f65-a4ae-ffe22458a1ab tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:40.764394 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-1021d079-d855-4f65-a4ae-ffe22458a1ab tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: aef57343-eb2a-4379-87cd-aab5f82d2a37] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:40.771505 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1021d079-d855-4f65-a4ae-ffe22458a1ab tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:40.772010 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1021d079-d855-4f65-a4ae-ffe22458a1ab tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:40.772452 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1021d079-d855-4f65-a4ae-ffe22458a1ab tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:40.773166 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1021d079-d855-4f65-a4ae-ffe22458a1ab tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:40.773620 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1021d079-d855-4f65-a4ae-ffe22458a1ab tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:40.774199 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1021d079-d855-4f65-a4ae-ffe22458a1ab tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:40.948845 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-743a2339-03bd-4767-9d5a-230a5dc0a584 tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ec630399c5d4231ae3d3975c8370c55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b79bc7a0ba4b3e9415590e7e6b7f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:40.961674 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-743a2339-03bd-4767-9d5a-230a5dc0a584 tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] 10.222.0.43 "GET /compute/v2.1/servers/3626ed18-d2aa-4ec2-8a06-4e6c76114cfc" status: 200 len: 1590 microversion: 2.1 time: 0.385151 Oct 04 22:01:40.965560 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1935/3839] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:01:40 2022] GET /compute/v2.1/servers/3626ed18-d2aa-4ec2-8a06-4e6c76114cfc => generated 1590 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:01:40.979214 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-9159ae60-6460-421a-ae82-28befd111532 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:40.980356 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-9159ae60-6460-421a-ae82-28befd111532 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] [instance: 3dbe541d-234a-4049-befd-dcd9a67dbd46] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:40.996184 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9159ae60-6460-421a-ae82-28befd111532 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:40.997106 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9159ae60-6460-421a-ae82-28befd111532 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:40.997880 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9159ae60-6460-421a-ae82-28befd111532 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:40.998974 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9159ae60-6460-421a-ae82-28befd111532 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:40.999687 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9159ae60-6460-421a-ae82-28befd111532 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:41.000515 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9159ae60-6460-421a-ae82-28befd111532 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:41.094931 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-1021d079-d855-4f65-a4ae-ffe22458a1ab tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a1c8d841104bc9b6910bcc2c0e2bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe9283584fc4d90b0715216d867ea2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:41.104577 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-1021d079-d855-4f65-a4ae-ffe22458a1ab tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "GET /compute/v2.1/servers/aef57343-eb2a-4379-87cd-aab5f82d2a37" status: 200 len: 1315 microversion: 2.1 time: 0.346159 Oct 04 22:01:41.109189 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1905/3840] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:01:40 2022] GET /compute/v2.1/servers/aef57343-eb2a-4379-87cd-aab5f82d2a37 => generated 1315 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:01:41.128039 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-893eecb1-da08-4201-95f4-4e99395678f7 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:01:41.129027 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-893eecb1-da08-4201-95f4-4e99395678f7 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: 3b56a47b-b601-49a9-aeb7-1139c4625d15] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:41.138003 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-893eecb1-da08-4201-95f4-4e99395678f7 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] HTTP exception thrown: Instance 3b56a47b-b601-49a9-aeb7-1139c4625d15 could not be found. Oct 04 22:01:41.144448 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-893eecb1-da08-4201-95f4-4e99395678f7 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Request method failure captured: Oct 04 22:01:41.144448 n-d-860284-1 devstack@n-api.service[134101]: request: POST /compute/v2.1/servers/3b56a47b-b601-49a9-aeb7-1139c4625d15/action HTTP/1.1 Oct 04 22:01:41.144448 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 22:01:41.144448 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 22:01:41.144448 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 22:01:41.144448 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 15 Oct 04 22:01:41.144448 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 22:01:41.144448 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 22:01:41.144448 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 22:01:41.144448 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 22:01:41.144448 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPKwu4cpW6hhBuWb-qV_7iYlwjOTpf5XWCl53BJjoosjlcj4wkmmOFzemCJVdBntIx8zJ1SF_z6VrRY8UJr7E8TQDJCRnVQMdNnh0-lZwGdqUzjOWSO31Ryb6n87Cka0g238a21JWok3h3GEhLB-7oCbN3bbcOGmkhd6UFueRxRluk24 Oct 04 22:01:41.144448 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 22:01:41.144448 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 22:01:41.144448 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 22:01:41.144448 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 22:01:41.144448 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 22:01:41.144448 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 22:01:41.144448 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: cf07a17a482a4e92b6ddbdee463c8029 Oct 04 22:01:41.144448 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-ServersNegativeTestJSON-1933663319 Oct 04 22:01:41.144448 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 22:01:41.144448 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 22:01:41.144448 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/cf07a17a482a4e92b6ddbdee463c8029"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_cf07a17a482a4e92b6ddbdee463c8029", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/cf07a17a482a4e92b6ddbdee463c8029"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/cf07a17a482a4e92b6ddbdee463c8029"}]}] Oct 04 22:01:41.144448 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-ServersNegativeTestJSON-1933663319 Oct 04 22:01:41.144448 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: cf07a17a482a4e92b6ddbdee463c8029 Oct 04 22:01:41.144448 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1933663319 Oct 04 22:01:41.144448 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-ServersNegativeTestJSON-1933663319-project Oct 04 22:01:41.144448 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 22:01:41.144448 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 22:01:41.144448 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 2facee4c6a40416e908083e126d2cfa3 Oct 04 22:01:41.144448 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-ServersNegativeTestJSON-1933663319-project Oct 04 22:01:41.144448 n-d-860284-1 devstack@n-api.service[134101]: Oct 04 22:01:41.144448 n-d-860284-1 devstack@n-api.service[134101]: {"suspend": {}} Oct 04 22:01:41.144448 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 22:01:41.144448 n-d-860284-1 devstack@n-api.service[134101]: exception: Instance 3b56a47b-b601-49a9-aeb7-1139c4625d15 could not be found. Oct 04 22:01:41.144448 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': '3b56a47b-b601-49a9-aeb7-1139c4625d15', 'body': {'suspend': {}}} Oct 04 22:01:41.144448 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:01:41.144448 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:01:41.144448 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:01:41.144448 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:01:41.144448 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:01:41.144448 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:01:41.144448 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 22:01:41.144448 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 22:01:41.144448 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b56a47b-b601-49a9-aeb7-1139c4625d15 could not be found. Oct 04 22:01:41.144448 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:01:41.144448 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:01:41.144448 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:01:41.144448 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:01:41.144448 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:01:41.144448 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:01:41.144448 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:01:41.144448 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:01:41.144448 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:01:41.144448 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:01:41.144448 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 35, in _suspend Oct 04 22:01:41.144448 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Oct 04 22:01:41.144448 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:01:41.144448 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:01:41.144448 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b56a47b-b601-49a9-aeb7-1139c4625d15 could not be found. Oct 04 22:01:41.144448 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:01:41.144448 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:01:41.144448 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:01:41.144448 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:01:41.144448 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:01:41.144448 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:01:41.149306 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:01:41.149306 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:01:41.149306 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b56a47b-b601-49a9-aeb7-1139c4625d15 could not be found. Oct 04 22:01:41.149306 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:01:41.151805 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-893eecb1-da08-4201-95f4-4e99395678f7 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Returning 404 to user: Instance 3b56a47b-b601-49a9-aeb7-1139c4625d15 could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:01:41.152868 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-893eecb1-da08-4201-95f4-4e99395678f7 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "POST /compute/v2.1/servers/3b56a47b-b601-49a9-aeb7-1139c4625d15/action" status: 404 len: 111 microversion: 2.1 time: 0.042109 Oct 04 22:01:41.153468 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1906/3841] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 22:01:41 2022] POST /compute/v2.1/servers/3b56a47b-b601-49a9-aeb7-1139c4625d15/action => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:01:41.165242 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-85f87a40-1d0c-4f47-bbfe-693bffd2313e tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:41.166356 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-85f87a40-1d0c-4f47-bbfe-693bffd2313e tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] [instance: 7285a94c-3dad-43f1-9052-63ccc9ac07ba] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:41.174059 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-85f87a40-1d0c-4f47-bbfe-693bffd2313e tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:41.174602 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-85f87a40-1d0c-4f47-bbfe-693bffd2313e tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:41.175556 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-85f87a40-1d0c-4f47-bbfe-693bffd2313e tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:41.177123 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-85f87a40-1d0c-4f47-bbfe-693bffd2313e tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:41.177847 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-85f87a40-1d0c-4f47-bbfe-693bffd2313e tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:41.178536 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-85f87a40-1d0c-4f47-bbfe-693bffd2313e tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:41.268322 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-85f87a40-1d0c-4f47-bbfe-693bffd2313e tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3adbba85c5a448148833e69d6304e62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b710cb6300854d8683bd52ddf56b787d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:41.280060 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-85f87a40-1d0c-4f47-bbfe-693bffd2313e tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3adbba85c5a448148833e69d6304e62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b710cb6300854d8683bd52ddf56b787d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:41.282446 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-85f87a40-1d0c-4f47-bbfe-693bffd2313e tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3adbba85c5a448148833e69d6304e62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b710cb6300854d8683bd52ddf56b787d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:41.284328 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-85f87a40-1d0c-4f47-bbfe-693bffd2313e tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] 10.222.0.43 "GET /compute/v2.1/servers/7285a94c-3dad-43f1-9052-63ccc9ac07ba" status: 200 len: 1314 microversion: 2.26 time: 0.127014 Oct 04 22:01:41.285568 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1907/3842] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:01:41 2022] GET /compute/v2.1/servers/7285a94c-3dad-43f1-9052-63ccc9ac07ba => generated 1314 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:01:41.290916 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-9159ae60-6460-421a-ae82-28befd111532 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2034fc9060874868bc5d27370a1c351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89499d833a4a00805164f4f79ed522', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:41.304843 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-9159ae60-6460-421a-ae82-28befd111532 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] 10.222.0.43 "GET /compute/v2.1/servers/3dbe541d-234a-4049-befd-dcd9a67dbd46" status: 200 len: 1505 microversion: 2.1 time: 0.336877 Oct 04 22:01:41.305779 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1936/3843] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:01:40 2022] GET /compute/v2.1/servers/3dbe541d-234a-4049-befd-dcd9a67dbd46 => generated 1505 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:01:41.305958 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-d3bc5348-2a1c-40b6-bc86-9aaa280099d3 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:41.306731 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-d3bc5348-2a1c-40b6-bc86-9aaa280099d3 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: a4cf4fac-1e9b-4669-a6ff-30008ed3642d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:41.313650 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d3bc5348-2a1c-40b6-bc86-9aaa280099d3 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:41.314279 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d3bc5348-2a1c-40b6-bc86-9aaa280099d3 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:41.314808 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d3bc5348-2a1c-40b6-bc86-9aaa280099d3 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:41.315528 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d3bc5348-2a1c-40b6-bc86-9aaa280099d3 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:41.316044 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d3bc5348-2a1c-40b6-bc86-9aaa280099d3 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:41.317003 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d3bc5348-2a1c-40b6-bc86-9aaa280099d3 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:41.328644 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-f67ea1e0-e38c-406d-9673-f74e21666139 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:41.329268 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-f67ea1e0-e38c-406d-9673-f74e21666139 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] [instance: 3dbe541d-234a-4049-befd-dcd9a67dbd46] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:41.335748 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f67ea1e0-e38c-406d-9673-f74e21666139 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:41.336502 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f67ea1e0-e38c-406d-9673-f74e21666139 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:41.337162 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f67ea1e0-e38c-406d-9673-f74e21666139 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:41.338074 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f67ea1e0-e38c-406d-9673-f74e21666139 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:41.338609 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f67ea1e0-e38c-406d-9673-f74e21666139 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:41.339084 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f67ea1e0-e38c-406d-9673-f74e21666139 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:41.556326 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-d3bc5348-2a1c-40b6-bc86-9aaa280099d3 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2facee4c6a40416e908083e126d2cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07a17a482a4e92b6ddbdee463c8029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:41.567180 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-d3bc5348-2a1c-40b6-bc86-9aaa280099d3 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d" status: 200 len: 1504 microversion: 2.1 time: 0.280043 Oct 04 22:01:41.568184 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1908/3844] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:01:41 2022] GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d => generated 1504 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:01:41.575342 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-71fda744-3aed-4919-94e6-2a821a5be46f tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:41.576286 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-71fda744-3aed-4919-94e6-2a821a5be46f tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] [instance: d0b1b757-4a4d-4a7a-9a06-08f178a02984] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:41.582759 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-71fda744-3aed-4919-94e6-2a821a5be46f tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:41.583340 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-71fda744-3aed-4919-94e6-2a821a5be46f tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:41.584014 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-71fda744-3aed-4919-94e6-2a821a5be46f tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:41.584791 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-71fda744-3aed-4919-94e6-2a821a5be46f tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:41.585420 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-71fda744-3aed-4919-94e6-2a821a5be46f tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:41.586707 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-71fda744-3aed-4919-94e6-2a821a5be46f tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:41.646304 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-f67ea1e0-e38c-406d-9673-f74e21666139 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2034fc9060874868bc5d27370a1c351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89499d833a4a00805164f4f79ed522', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:41.657934 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-f67ea1e0-e38c-406d-9673-f74e21666139 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] 10.222.0.43 "GET /compute/v2.1/servers/3dbe541d-234a-4049-befd-dcd9a67dbd46" status: 200 len: 1505 microversion: 2.1 time: 0.333147 Oct 04 22:01:41.659579 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1937/3845] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:01:41 2022] GET /compute/v2.1/servers/3dbe541d-234a-4049-befd-dcd9a67dbd46 => generated 1505 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:01:41.665343 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-2545aa57-48a2-46f1-80d8-d1e79fee0097 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:41.666400 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-2545aa57-48a2-46f1-80d8-d1e79fee0097 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: a4cf4fac-1e9b-4669-a6ff-30008ed3642d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:41.674067 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2545aa57-48a2-46f1-80d8-d1e79fee0097 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:41.675037 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2545aa57-48a2-46f1-80d8-d1e79fee0097 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:41.675577 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2545aa57-48a2-46f1-80d8-d1e79fee0097 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:41.676382 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2545aa57-48a2-46f1-80d8-d1e79fee0097 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:41.676919 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2545aa57-48a2-46f1-80d8-d1e79fee0097 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:41.677423 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2545aa57-48a2-46f1-80d8-d1e79fee0097 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:41.697533 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-71fda744-3aed-4919-94e6-2a821a5be46f tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:41.715457 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-71fda744-3aed-4919-94e6-2a821a5be46f tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:41.717240 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-71fda744-3aed-4919-94e6-2a821a5be46f tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:41.728002 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-71fda744-3aed-4919-94e6-2a821a5be46f tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] 10.222.0.43 "GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984" status: 200 len: 1544 microversion: 2.91 time: 0.158240 Oct 04 22:01:41.729981 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1909/3846] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:01:41 2022] GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984 => generated 1544 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:01:41.737840 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-55d757ec-628e-4b41-a304-45b8a6d434a8 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:01:41.743222 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-55d757ec-628e-4b41-a304-45b8a6d434a8 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] [instance: 3dbe541d-234a-4049-befd-dcd9a67dbd46] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:41.750123 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-55d757ec-628e-4b41-a304-45b8a6d434a8 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:41.751046 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-55d757ec-628e-4b41-a304-45b8a6d434a8 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:41.751691 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-55d757ec-628e-4b41-a304-45b8a6d434a8 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:41.752579 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-55d757ec-628e-4b41-a304-45b8a6d434a8 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:41.753485 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-55d757ec-628e-4b41-a304-45b8a6d434a8 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:41.754106 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-55d757ec-628e-4b41-a304-45b8a6d434a8 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:41.859806 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-2545aa57-48a2-46f1-80d8-d1e79fee0097 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2facee4c6a40416e908083e126d2cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07a17a482a4e92b6ddbdee463c8029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:41.868947 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-2545aa57-48a2-46f1-80d8-d1e79fee0097 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d" status: 200 len: 1504 microversion: 2.1 time: 0.207767 Oct 04 22:01:41.869639 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1938/3847] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:01:41 2022] GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d => generated 1504 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:01:41.894658 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-431981d2-b247-401f-af49-7d7e0b323994 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:01:41.895227 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-431981d2-b247-401f-af49-7d7e0b323994 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: a4cf4fac-1e9b-4669-a6ff-30008ed3642d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:41.905873 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-431981d2-b247-401f-af49-7d7e0b323994 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:41.906671 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-431981d2-b247-401f-af49-7d7e0b323994 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:41.907289 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-431981d2-b247-401f-af49-7d7e0b323994 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:41.908180 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-431981d2-b247-401f-af49-7d7e0b323994 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:41.908822 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-431981d2-b247-401f-af49-7d7e0b323994 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:41.909453 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-431981d2-b247-401f-af49-7d7e0b323994 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:41.930096 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-55d757ec-628e-4b41-a304-45b8a6d434a8 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Flavor limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 22:01:41.930685 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-55d757ec-628e-4b41-a304-45b8a6d434a8 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Image limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 22:01:41.931415 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-55d757ec-628e-4b41-a304-45b8a6d434a8 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Flavor pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 22:01:41.933533 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-55d757ec-628e-4b41-a304-45b8a6d434a8 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Image pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 22:01:41.934486 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-55d757ec-628e-4b41-a304-45b8a6d434a8 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 22:01:41.951786 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.objects.instance [None req-431981d2-b247-401f-af49-7d7e0b323994 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lazy-loading 'flavor' on Instance uuid a4cf4fac-1e9b-4669-a6ff-30008ed3642d {{(pid=134102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 22:01:42.031063 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-55d757ec-628e-4b41-a304-45b8a6d434a8 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] [instance: 3dbe541d-234a-4049-befd-dcd9a67dbd46] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:42.056569 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-55d757ec-628e-4b41-a304-45b8a6d434a8 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:42.057350 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-55d757ec-628e-4b41-a304-45b8a6d434a8 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:42.058377 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-55d757ec-628e-4b41-a304-45b8a6d434a8 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:42.059311 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-55d757ec-628e-4b41-a304-45b8a6d434a8 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:42.060191 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-55d757ec-628e-4b41-a304-45b8a6d434a8 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:42.060856 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-55d757ec-628e-4b41-a304-45b8a6d434a8 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:42.063014 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-431981d2-b247-401f-af49-7d7e0b323994 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "POST /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d/action" status: 202 len: 0 microversion: 2.1 time: 0.173365 Oct 04 22:01:42.067500 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1939/3848] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 22:01:41 2022] POST /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d/action => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 22:01:42.073763 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-11cdf69e-7a81-4750-809a-e9f81b3e059e tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:42.074650 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-11cdf69e-7a81-4750-809a-e9f81b3e059e tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: a4cf4fac-1e9b-4669-a6ff-30008ed3642d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:42.082026 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-11cdf69e-7a81-4750-809a-e9f81b3e059e tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:42.082584 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-11cdf69e-7a81-4750-809a-e9f81b3e059e tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:42.083037 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-11cdf69e-7a81-4750-809a-e9f81b3e059e tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:42.083814 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-11cdf69e-7a81-4750-809a-e9f81b3e059e tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:42.084290 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-11cdf69e-7a81-4750-809a-e9f81b3e059e tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:42.084731 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-11cdf69e-7a81-4750-809a-e9f81b3e059e tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:42.112794 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-55d757ec-628e-4b41-a304-45b8a6d434a8 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] 10.222.0.43 "POST /compute/v2.1/servers/3dbe541d-234a-4049-befd-dcd9a67dbd46/action" status: 202 len: 1111 microversion: 2.1 time: 0.380207 Oct 04 22:01:42.113455 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1910/3849] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 22:01:41 2022] POST /compute/v2.1/servers/3dbe541d-234a-4049-befd-dcd9a67dbd46/action => generated 1111 bytes in 383 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 04 22:01:42.138682 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-9b11d463-51fe-4c8a-bfcb-5ce5fafe3728 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:42.143009 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-9b11d463-51fe-4c8a-bfcb-5ce5fafe3728 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] [instance: 3dbe541d-234a-4049-befd-dcd9a67dbd46] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:42.159433 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9b11d463-51fe-4c8a-bfcb-5ce5fafe3728 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:42.159954 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9b11d463-51fe-4c8a-bfcb-5ce5fafe3728 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:42.160809 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9b11d463-51fe-4c8a-bfcb-5ce5fafe3728 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:42.161543 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9b11d463-51fe-4c8a-bfcb-5ce5fafe3728 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:42.162009 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9b11d463-51fe-4c8a-bfcb-5ce5fafe3728 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:42.163655 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9b11d463-51fe-4c8a-bfcb-5ce5fafe3728 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:42.481355 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-11cdf69e-7a81-4750-809a-e9f81b3e059e tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2facee4c6a40416e908083e126d2cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07a17a482a4e92b6ddbdee463c8029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:42.497648 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-11cdf69e-7a81-4750-809a-e9f81b3e059e tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d" status: 200 len: 1512 microversion: 2.1 time: 0.427068 Oct 04 22:01:42.499487 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1940/3850] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:01:42 2022] GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d => generated 1512 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:01:42.513311 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-ceba64ee-f5e4-42db-adba-881bb390013e tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:42.514458 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-ceba64ee-f5e4-42db-adba-881bb390013e tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: aef57343-eb2a-4379-87cd-aab5f82d2a37] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:42.532581 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ceba64ee-f5e4-42db-adba-881bb390013e tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:42.533598 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ceba64ee-f5e4-42db-adba-881bb390013e tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:42.534134 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ceba64ee-f5e4-42db-adba-881bb390013e tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:42.537332 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ceba64ee-f5e4-42db-adba-881bb390013e tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:42.537966 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ceba64ee-f5e4-42db-adba-881bb390013e tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:42.538545 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ceba64ee-f5e4-42db-adba-881bb390013e tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:42.568821 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-9b11d463-51fe-4c8a-bfcb-5ce5fafe3728 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2034fc9060874868bc5d27370a1c351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89499d833a4a00805164f4f79ed522', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:42.579182 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-9b11d463-51fe-4c8a-bfcb-5ce5fafe3728 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] 10.222.0.43 "GET /compute/v2.1/servers/3dbe541d-234a-4049-befd-dcd9a67dbd46" status: 200 len: 1516 microversion: 2.1 time: 0.450284 Oct 04 22:01:42.605066 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1911/3851] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:01:42 2022] GET /compute/v2.1/servers/3dbe541d-234a-4049-befd-dcd9a67dbd46 => generated 1516 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:01:42.617113 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-27109139-9b9a-4dea-b2a4-293f8ecacfe8 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:42.624804 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-27109139-9b9a-4dea-b2a4-293f8ecacfe8 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] [instance: 7285a94c-3dad-43f1-9052-63ccc9ac07ba] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:42.638818 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-27109139-9b9a-4dea-b2a4-293f8ecacfe8 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:42.642002 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-27109139-9b9a-4dea-b2a4-293f8ecacfe8 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:42.642732 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-27109139-9b9a-4dea-b2a4-293f8ecacfe8 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:42.643527 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-27109139-9b9a-4dea-b2a4-293f8ecacfe8 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:42.645335 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-27109139-9b9a-4dea-b2a4-293f8ecacfe8 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:42.646128 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-27109139-9b9a-4dea-b2a4-293f8ecacfe8 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:42.811824 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-ceba64ee-f5e4-42db-adba-881bb390013e tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a1c8d841104bc9b6910bcc2c0e2bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe9283584fc4d90b0715216d867ea2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:42.816667 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-27109139-9b9a-4dea-b2a4-293f8ecacfe8 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3adbba85c5a448148833e69d6304e62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b710cb6300854d8683bd52ddf56b787d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:42.855616 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-27109139-9b9a-4dea-b2a4-293f8ecacfe8 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3adbba85c5a448148833e69d6304e62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b710cb6300854d8683bd52ddf56b787d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:42.859460 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-ceba64ee-f5e4-42db-adba-881bb390013e tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "GET /compute/v2.1/servers/aef57343-eb2a-4379-87cd-aab5f82d2a37" status: 200 len: 1503 microversion: 2.1 time: 0.356135 Oct 04 22:01:42.860449 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-27109139-9b9a-4dea-b2a4-293f8ecacfe8 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3adbba85c5a448148833e69d6304e62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b710cb6300854d8683bd52ddf56b787d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:42.861325 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1941/3852] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:01:42 2022] GET /compute/v2.1/servers/aef57343-eb2a-4379-87cd-aab5f82d2a37 => generated 1503 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:01:42.865216 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-27109139-9b9a-4dea-b2a4-293f8ecacfe8 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] 10.222.0.43 "GET /compute/v2.1/servers/7285a94c-3dad-43f1-9052-63ccc9ac07ba" status: 200 len: 1314 microversion: 2.26 time: 0.255093 Oct 04 22:01:42.869437 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1912/3853] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:01:42 2022] GET /compute/v2.1/servers/7285a94c-3dad-43f1-9052-63ccc9ac07ba => generated 1314 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:01:42.872269 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-8c4459e6-30d6-40aa-bef4-7b83a11f4cd4 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:42.873786 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-8c4459e6-30d6-40aa-bef4-7b83a11f4cd4 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] [instance: d0b1b757-4a4d-4a7a-9a06-08f178a02984] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:42.883333 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8c4459e6-30d6-40aa-bef4-7b83a11f4cd4 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:42.884771 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8c4459e6-30d6-40aa-bef4-7b83a11f4cd4 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:42.885549 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8c4459e6-30d6-40aa-bef4-7b83a11f4cd4 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:42.887456 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8c4459e6-30d6-40aa-bef4-7b83a11f4cd4 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:42.888693 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8c4459e6-30d6-40aa-bef4-7b83a11f4cd4 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:42.890354 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8c4459e6-30d6-40aa-bef4-7b83a11f4cd4 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:42.913550 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-a9251a52-823a-43cc-a895-ad0ebbe9a1c4 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:42.914070 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-a9251a52-823a-43cc-a895-ad0ebbe9a1c4 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: aef57343-eb2a-4379-87cd-aab5f82d2a37] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:42.923227 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a9251a52-823a-43cc-a895-ad0ebbe9a1c4 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:42.923752 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a9251a52-823a-43cc-a895-ad0ebbe9a1c4 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:42.924210 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a9251a52-823a-43cc-a895-ad0ebbe9a1c4 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:42.924970 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a9251a52-823a-43cc-a895-ad0ebbe9a1c4 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:42.925441 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a9251a52-823a-43cc-a895-ad0ebbe9a1c4 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:42.926755 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a9251a52-823a-43cc-a895-ad0ebbe9a1c4 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:42.963250 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-a9251a52-823a-43cc-a895-ad0ebbe9a1c4 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: aef57343-eb2a-4379-87cd-aab5f82d2a37] Going to try to terminate instance {{(pid=134101) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 22:01:43.056020 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-8c4459e6-30d6-40aa-bef4-7b83a11f4cd4 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:43.068423 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-8c4459e6-30d6-40aa-bef4-7b83a11f4cd4 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:43.070487 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-8c4459e6-30d6-40aa-bef4-7b83a11f4cd4 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:43.077685 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-8c4459e6-30d6-40aa-bef4-7b83a11f4cd4 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] 10.222.0.43 "GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984" status: 200 len: 1544 microversion: 2.91 time: 0.213579 Oct 04 22:01:43.080445 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1942/3854] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:01:42 2022] GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984 => generated 1544 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:01:43.124124 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-a9251a52-823a-43cc-a895-ad0ebbe9a1c4 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "DELETE /compute/v2.1/servers/aef57343-eb2a-4379-87cd-aab5f82d2a37" status: 204 len: 0 microversion: 2.1 time: 0.213249 Oct 04 22:01:43.125787 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1913/3855] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 22:01:42 2022] DELETE /compute/v2.1/servers/aef57343-eb2a-4379-87cd-aab5f82d2a37 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 22:01:43.139306 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-cad67976-48f8-4559-b154-e7eb6900e933 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:43.143584 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-cad67976-48f8-4559-b154-e7eb6900e933 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: aef57343-eb2a-4379-87cd-aab5f82d2a37] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:43.163764 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cad67976-48f8-4559-b154-e7eb6900e933 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:43.165647 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cad67976-48f8-4559-b154-e7eb6900e933 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:43.166563 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cad67976-48f8-4559-b154-e7eb6900e933 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:43.167729 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cad67976-48f8-4559-b154-e7eb6900e933 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:43.168260 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cad67976-48f8-4559-b154-e7eb6900e933 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:43.168761 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cad67976-48f8-4559-b154-e7eb6900e933 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:43.340686 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-cad67976-48f8-4559-b154-e7eb6900e933 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a1c8d841104bc9b6910bcc2c0e2bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe9283584fc4d90b0715216d867ea2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:43.348846 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-cad67976-48f8-4559-b154-e7eb6900e933 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "GET /compute/v2.1/servers/aef57343-eb2a-4379-87cd-aab5f82d2a37" status: 200 len: 1509 microversion: 2.1 time: 0.218304 Oct 04 22:01:43.349672 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1943/3856] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:01:43 2022] GET /compute/v2.1/servers/aef57343-eb2a-4379-87cd-aab5f82d2a37 => generated 1509 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:01:43.535228 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-f0784f55-dde8-4b2c-b0ff-f04fe9139b12 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:43.536677 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-f0784f55-dde8-4b2c-b0ff-f04fe9139b12 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: a4cf4fac-1e9b-4669-a6ff-30008ed3642d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:43.547690 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f0784f55-dde8-4b2c-b0ff-f04fe9139b12 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:43.548325 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f0784f55-dde8-4b2c-b0ff-f04fe9139b12 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:43.549043 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f0784f55-dde8-4b2c-b0ff-f04fe9139b12 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:43.550157 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f0784f55-dde8-4b2c-b0ff-f04fe9139b12 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:43.550733 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f0784f55-dde8-4b2c-b0ff-f04fe9139b12 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:43.551240 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f0784f55-dde8-4b2c-b0ff-f04fe9139b12 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:43.611601 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-a6c7aad2-ad00-4535-80b3-0525567068be tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:43.612218 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-a6c7aad2-ad00-4535-80b3-0525567068be tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] [instance: 3dbe541d-234a-4049-befd-dcd9a67dbd46] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:43.618771 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a6c7aad2-ad00-4535-80b3-0525567068be tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:43.619270 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a6c7aad2-ad00-4535-80b3-0525567068be tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:43.619848 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a6c7aad2-ad00-4535-80b3-0525567068be tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:43.620932 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a6c7aad2-ad00-4535-80b3-0525567068be tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:43.621399 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a6c7aad2-ad00-4535-80b3-0525567068be tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:43.621834 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a6c7aad2-ad00-4535-80b3-0525567068be tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:43.775011 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-f0784f55-dde8-4b2c-b0ff-f04fe9139b12 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2facee4c6a40416e908083e126d2cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07a17a482a4e92b6ddbdee463c8029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:43.784409 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-f0784f55-dde8-4b2c-b0ff-f04fe9139b12 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d" status: 200 len: 1512 microversion: 2.1 time: 0.256322 Oct 04 22:01:43.798916 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1914/3857] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:01:43 2022] GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d => generated 1512 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:01:43.853097 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-a6c7aad2-ad00-4535-80b3-0525567068be tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2034fc9060874868bc5d27370a1c351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89499d833a4a00805164f4f79ed522', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:43.863978 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-a6c7aad2-ad00-4535-80b3-0525567068be tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] 10.222.0.43 "GET /compute/v2.1/servers/3dbe541d-234a-4049-befd-dcd9a67dbd46" status: 200 len: 1516 microversion: 2.1 time: 0.256216 Oct 04 22:01:43.864578 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1944/3858] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:01:43 2022] GET /compute/v2.1/servers/3dbe541d-234a-4049-befd-dcd9a67dbd46 => generated 1516 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:01:43.896271 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-4a6ad7bf-37c2-41c4-be8d-b5824a48d20a tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:43.897056 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-4a6ad7bf-37c2-41c4-be8d-b5824a48d20a tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] [instance: 7285a94c-3dad-43f1-9052-63ccc9ac07ba] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:43.905057 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4a6ad7bf-37c2-41c4-be8d-b5824a48d20a tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:43.905552 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4a6ad7bf-37c2-41c4-be8d-b5824a48d20a tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:43.906427 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4a6ad7bf-37c2-41c4-be8d-b5824a48d20a tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:43.907418 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4a6ad7bf-37c2-41c4-be8d-b5824a48d20a tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:43.908077 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4a6ad7bf-37c2-41c4-be8d-b5824a48d20a tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:43.908553 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4a6ad7bf-37c2-41c4-be8d-b5824a48d20a tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:43.992469 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-4a6ad7bf-37c2-41c4-be8d-b5824a48d20a tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3adbba85c5a448148833e69d6304e62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b710cb6300854d8683bd52ddf56b787d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:44.006984 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-4a6ad7bf-37c2-41c4-be8d-b5824a48d20a tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3adbba85c5a448148833e69d6304e62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b710cb6300854d8683bd52ddf56b787d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:44.008852 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-4a6ad7bf-37c2-41c4-be8d-b5824a48d20a tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3adbba85c5a448148833e69d6304e62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b710cb6300854d8683bd52ddf56b787d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:44.010150 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-4a6ad7bf-37c2-41c4-be8d-b5824a48d20a tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] 10.222.0.43 "GET /compute/v2.1/servers/7285a94c-3dad-43f1-9052-63ccc9ac07ba" status: 200 len: 1314 microversion: 2.26 time: 0.118314 Oct 04 22:01:44.010767 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1915/3859] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:01:43 2022] GET /compute/v2.1/servers/7285a94c-3dad-43f1-9052-63ccc9ac07ba => generated 1314 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:01:44.108198 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-0730d366-b197-4702-8dd8-b4bdf7b550c6 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:44.108936 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-0730d366-b197-4702-8dd8-b4bdf7b550c6 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] [instance: d0b1b757-4a4d-4a7a-9a06-08f178a02984] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:44.122736 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0730d366-b197-4702-8dd8-b4bdf7b550c6 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:44.123379 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0730d366-b197-4702-8dd8-b4bdf7b550c6 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:44.124035 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0730d366-b197-4702-8dd8-b4bdf7b550c6 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:44.124632 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0730d366-b197-4702-8dd8-b4bdf7b550c6 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:44.125101 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0730d366-b197-4702-8dd8-b4bdf7b550c6 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:44.125644 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0730d366-b197-4702-8dd8-b4bdf7b550c6 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:44.240322 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-0730d366-b197-4702-8dd8-b4bdf7b550c6 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:44.244109 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:01:44.254086 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-0730d366-b197-4702-8dd8-b4bdf7b550c6 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:44.255845 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-0730d366-b197-4702-8dd8-b4bdf7b550c6 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:44.264776 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-0730d366-b197-4702-8dd8-b4bdf7b550c6 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] 10.222.0.43 "GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984" status: 200 len: 1544 microversion: 2.91 time: 0.160329 Oct 04 22:01:44.266419 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1945/3860] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:01:44 2022] GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984 => generated 1544 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:01:44.372189 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-7d35de8a-bd24-4bc4-ab6c-f6df343901e2 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:44.372799 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-7d35de8a-bd24-4bc4-ab6c-f6df343901e2 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: aef57343-eb2a-4379-87cd-aab5f82d2a37] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:44.378872 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7d35de8a-bd24-4bc4-ab6c-f6df343901e2 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:44.379356 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7d35de8a-bd24-4bc4-ab6c-f6df343901e2 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:44.379812 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7d35de8a-bd24-4bc4-ab6c-f6df343901e2 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:44.380501 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7d35de8a-bd24-4bc4-ab6c-f6df343901e2 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:44.380950 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7d35de8a-bd24-4bc4-ab6c-f6df343901e2 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:44.381371 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7d35de8a-bd24-4bc4-ab6c-f6df343901e2 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:44.386921 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:01:44.571231 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-7d35de8a-bd24-4bc4-ab6c-f6df343901e2 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a1c8d841104bc9b6910bcc2c0e2bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe9283584fc4d90b0715216d867ea2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:44.581633 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-7d35de8a-bd24-4bc4-ab6c-f6df343901e2 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "GET /compute/v2.1/servers/aef57343-eb2a-4379-87cd-aab5f82d2a37" status: 200 len: 1509 microversion: 2.1 time: 0.213344 Oct 04 22:01:44.583160 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1916/3861] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:01:44 2022] GET /compute/v2.1/servers/aef57343-eb2a-4379-87cd-aab5f82d2a37 => generated 1509 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:01:44.816610 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-94a7b49e-20f5-4c83-b59b-025470278d7d tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:44.841981 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-94a7b49e-20f5-4c83-b59b-025470278d7d tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: a4cf4fac-1e9b-4669-a6ff-30008ed3642d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:44.869180 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-94a7b49e-20f5-4c83-b59b-025470278d7d tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:44.871939 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-94a7b49e-20f5-4c83-b59b-025470278d7d tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:44.872434 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-94a7b49e-20f5-4c83-b59b-025470278d7d tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:44.873230 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-94a7b49e-20f5-4c83-b59b-025470278d7d tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:44.873710 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-94a7b49e-20f5-4c83-b59b-025470278d7d tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:44.874150 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-94a7b49e-20f5-4c83-b59b-025470278d7d tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:44.890148 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-4c71a2c5-4340-4ec0-b6aa-27da9c4d3dcf tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:44.891458 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-4c71a2c5-4340-4ec0-b6aa-27da9c4d3dcf tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] [instance: 3dbe541d-234a-4049-befd-dcd9a67dbd46] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:44.913632 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4c71a2c5-4340-4ec0-b6aa-27da9c4d3dcf tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:44.914264 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4c71a2c5-4340-4ec0-b6aa-27da9c4d3dcf tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:44.917568 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4c71a2c5-4340-4ec0-b6aa-27da9c4d3dcf tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:44.918663 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4c71a2c5-4340-4ec0-b6aa-27da9c4d3dcf tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:44.919160 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4c71a2c5-4340-4ec0-b6aa-27da9c4d3dcf tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:44.919607 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4c71a2c5-4340-4ec0-b6aa-27da9c4d3dcf tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:45.643625 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-4c71a2c5-4340-4ec0-b6aa-27da9c4d3dcf tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2034fc9060874868bc5d27370a1c351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89499d833a4a00805164f4f79ed522', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:45.652936 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-94a7b49e-20f5-4c83-b59b-025470278d7d tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2facee4c6a40416e908083e126d2cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07a17a482a4e92b6ddbdee463c8029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:45.654940 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-4c71a2c5-4340-4ec0-b6aa-27da9c4d3dcf tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] 10.222.0.43 "GET /compute/v2.1/servers/3dbe541d-234a-4049-befd-dcd9a67dbd46" status: 200 len: 1516 microversion: 2.1 time: 0.769795 Oct 04 22:01:45.656988 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1917/3862] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:01:44 2022] GET /compute/v2.1/servers/3dbe541d-234a-4049-befd-dcd9a67dbd46 => generated 1516 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:01:45.666024 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-41cec6bd-cef5-4691-ad35-e80a480bf434 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:45.669001 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-41cec6bd-cef5-4691-ad35-e80a480bf434 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] [instance: 7285a94c-3dad-43f1-9052-63ccc9ac07ba] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:45.683967 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-41cec6bd-cef5-4691-ad35-e80a480bf434 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:45.685620 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-41cec6bd-cef5-4691-ad35-e80a480bf434 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:45.687035 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-41cec6bd-cef5-4691-ad35-e80a480bf434 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:45.689628 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-41cec6bd-cef5-4691-ad35-e80a480bf434 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:45.690909 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-41cec6bd-cef5-4691-ad35-e80a480bf434 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:45.691859 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-41cec6bd-cef5-4691-ad35-e80a480bf434 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:45.694987 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-94a7b49e-20f5-4c83-b59b-025470278d7d tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d" status: 200 len: 1495 microversion: 2.1 time: 0.888951 Oct 04 22:01:45.722230 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1946/3863] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:01:44 2022] GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d => generated 1495 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:01:45.729017 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-61e6537a-83db-4513-9942-022019a6f745 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:45.731137 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-61e6537a-83db-4513-9942-022019a6f745 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] [instance: d0b1b757-4a4d-4a7a-9a06-08f178a02984] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:45.738902 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-61e6537a-83db-4513-9942-022019a6f745 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:45.740381 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-61e6537a-83db-4513-9942-022019a6f745 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:45.741821 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-61e6537a-83db-4513-9942-022019a6f745 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:45.742934 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-61e6537a-83db-4513-9942-022019a6f745 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:45.743662 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-61e6537a-83db-4513-9942-022019a6f745 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:45.745670 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-61e6537a-83db-4513-9942-022019a6f745 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:45.799207 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-41cec6bd-cef5-4691-ad35-e80a480bf434 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3adbba85c5a448148833e69d6304e62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b710cb6300854d8683bd52ddf56b787d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:45.827652 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-41cec6bd-cef5-4691-ad35-e80a480bf434 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3adbba85c5a448148833e69d6304e62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b710cb6300854d8683bd52ddf56b787d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:45.832273 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-41cec6bd-cef5-4691-ad35-e80a480bf434 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3adbba85c5a448148833e69d6304e62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b710cb6300854d8683bd52ddf56b787d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:45.834794 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-41cec6bd-cef5-4691-ad35-e80a480bf434 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] 10.222.0.43 "GET /compute/v2.1/servers/7285a94c-3dad-43f1-9052-63ccc9ac07ba" status: 200 len: 1320 microversion: 2.26 time: 0.175888 Oct 04 22:01:45.836111 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1918/3864] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:01:45 2022] GET /compute/v2.1/servers/7285a94c-3dad-43f1-9052-63ccc9ac07ba => generated 1320 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:01:45.851309 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-697e8f71-eb56-4dc7-ab5e-0486c6237b85 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:45.852819 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-697e8f71-eb56-4dc7-ab5e-0486c6237b85 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: aef57343-eb2a-4379-87cd-aab5f82d2a37] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:45.865352 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-697e8f71-eb56-4dc7-ab5e-0486c6237b85 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:45.866010 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-697e8f71-eb56-4dc7-ab5e-0486c6237b85 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:45.867028 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-697e8f71-eb56-4dc7-ab5e-0486c6237b85 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:45.867870 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-697e8f71-eb56-4dc7-ab5e-0486c6237b85 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:45.868621 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-697e8f71-eb56-4dc7-ab5e-0486c6237b85 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:45.869241 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-697e8f71-eb56-4dc7-ab5e-0486c6237b85 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:45.906289 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-61e6537a-83db-4513-9942-022019a6f745 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:45.917482 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-61e6537a-83db-4513-9942-022019a6f745 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:45.918456 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-61e6537a-83db-4513-9942-022019a6f745 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:45.925761 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-61e6537a-83db-4513-9942-022019a6f745 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] 10.222.0.43 "GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984" status: 200 len: 1544 microversion: 2.91 time: 0.201776 Oct 04 22:01:45.939165 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1947/3865] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:01:45 2022] GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984 => generated 1544 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:01:45.950648 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-293f8dea-0a7b-4b2e-869c-d1432fedb5bf tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:01:45.951148 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-293f8dea-0a7b-4b2e-869c-d1432fedb5bf tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: a4cf4fac-1e9b-4669-a6ff-30008ed3642d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:45.959483 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-293f8dea-0a7b-4b2e-869c-d1432fedb5bf tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:45.959987 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-293f8dea-0a7b-4b2e-869c-d1432fedb5bf tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:45.960427 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-293f8dea-0a7b-4b2e-869c-d1432fedb5bf tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:45.961155 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-293f8dea-0a7b-4b2e-869c-d1432fedb5bf tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:45.961616 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-293f8dea-0a7b-4b2e-869c-d1432fedb5bf tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:45.962137 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-293f8dea-0a7b-4b2e-869c-d1432fedb5bf tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:46.008616 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.objects.instance [None req-293f8dea-0a7b-4b2e-869c-d1432fedb5bf tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lazy-loading 'flavor' on Instance uuid a4cf4fac-1e9b-4669-a6ff-30008ed3642d {{(pid=134102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 22:01:46.030185 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-293f8dea-0a7b-4b2e-869c-d1432fedb5bf tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] HTTP exception thrown: Cannot 'suspend' instance a4cf4fac-1e9b-4669-a6ff-30008ed3642d while it is in vm_state suspended Oct 04 22:01:46.032227 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-293f8dea-0a7b-4b2e-869c-d1432fedb5bf tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Request method failure captured: Oct 04 22:01:46.032227 n-d-860284-1 devstack@n-api.service[134102]: request: POST /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d/action HTTP/1.1 Oct 04 22:01:46.032227 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 22:01:46.032227 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 22:01:46.032227 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 22:01:46.032227 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 15 Oct 04 22:01:46.032227 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 22:01:46.032227 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 22:01:46.032227 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 22:01:46.032227 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 22:01:46.032227 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPKwu4cpW6hhBuWb-qV_7iYlwjOTpf5XWCl53BJjoosjlcj4wkmmOFzemCJVdBntIx8zJ1SF_z6VrRY8UJr7E8TQDJCRnVQMdNnh0-lZwGdqUzjOWSO31Ryb6n87Cka0g238a21JWok3h3GEhLB-7oCbN3bbcOGmkhd6UFueRxRluk24 Oct 04 22:01:46.032227 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 22:01:46.032227 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 22:01:46.032227 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 22:01:46.032227 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 22:01:46.032227 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 22:01:46.032227 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 22:01:46.032227 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: cf07a17a482a4e92b6ddbdee463c8029 Oct 04 22:01:46.032227 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-ServersNegativeTestJSON-1933663319 Oct 04 22:01:46.032227 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 22:01:46.032227 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 22:01:46.032227 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/cf07a17a482a4e92b6ddbdee463c8029"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_cf07a17a482a4e92b6ddbdee463c8029", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/cf07a17a482a4e92b6ddbdee463c8029"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/cf07a17a482a4e92b6ddbdee463c8029"}]}] Oct 04 22:01:46.032227 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-ServersNegativeTestJSON-1933663319 Oct 04 22:01:46.032227 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: cf07a17a482a4e92b6ddbdee463c8029 Oct 04 22:01:46.032227 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1933663319 Oct 04 22:01:46.032227 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-ServersNegativeTestJSON-1933663319-project Oct 04 22:01:46.032227 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 22:01:46.032227 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 22:01:46.032227 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: 2facee4c6a40416e908083e126d2cfa3 Oct 04 22:01:46.032227 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-ServersNegativeTestJSON-1933663319-project Oct 04 22:01:46.032227 n-d-860284-1 devstack@n-api.service[134102]: Oct 04 22:01:46.032227 n-d-860284-1 devstack@n-api.service[134102]: {"suspend": {}} Oct 04 22:01:46.032227 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 22:01:46.032227 n-d-860284-1 devstack@n-api.service[134102]: exception: Cannot 'suspend' instance a4cf4fac-1e9b-4669-a6ff-30008ed3642d while it is in vm_state suspended Oct 04 22:01:46.032227 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': 'a4cf4fac-1e9b-4669-a6ff-30008ed3642d', 'body': {'suspend': {}}} Oct 04 22:01:46.032227 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:01:46.032227 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:01:46.032227 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 40, in _suspend Oct 04 22:01:46.032227 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi self.compute_api.suspend(context, server) Oct 04 22:01:46.032227 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 04 22:01:46.032227 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 22:01:46.032227 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 04 22:01:46.032227 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 22:01:46.032227 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 04 22:01:46.032227 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 22:01:46.032227 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 04 22:01:46.032227 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 22:01:46.032227 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 22:01:46.032227 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 22:01:46.032227 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 04 22:01:46.032227 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 04 22:01:46.032227 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance a4cf4fac-1e9b-4669-a6ff-30008ed3642d in vm_state suspended. Cannot suspend while the instance is in this state. Oct 04 22:01:46.032227 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:01:46.032227 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:01:46.032227 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:01:46.032227 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:01:46.032227 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:01:46.032227 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:01:46.032227 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:01:46.032227 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:01:46.032227 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:01:46.032227 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:01:46.032227 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 44, in _suspend Oct 04 22:01:46.032227 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 04 22:01:46.040181 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 04 22:01:46.040181 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 22:01:46.040181 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'suspend' instance a4cf4fac-1e9b-4669-a6ff-30008ed3642d while it is in vm_state suspended Oct 04 22:01:46.040181 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:01:46.040181 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:01:46.040181 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:01:46.040181 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:01:46.040181 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:01:46.040181 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:01:46.040181 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:01:46.040181 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:01:46.040181 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'suspend' instance a4cf4fac-1e9b-4669-a6ff-30008ed3642d while it is in vm_state suspended Oct 04 22:01:46.040181 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:01:46.040181 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-293f8dea-0a7b-4b2e-869c-d1432fedb5bf tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Returning 409 to user: Cannot 'suspend' instance a4cf4fac-1e9b-4669-a6ff-30008ed3642d while it is in vm_state suspended {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:01:46.040181 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-293f8dea-0a7b-4b2e-869c-d1432fedb5bf tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "POST /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d/action" status: 409 len: 148 microversion: 2.1 time: 0.094609 Oct 04 22:01:46.044286 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1948/3866] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 22:01:45 2022] POST /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d/action => generated 148 bytes in 102 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 22:01:46.048867 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-eb40e47a-65a8-42ff-9da7-ac08b9678754 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:01:46.049105 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-eb40e47a-65a8-42ff-9da7-ac08b9678754 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: a4cf4fac-1e9b-4669-a6ff-30008ed3642d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:46.055964 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-eb40e47a-65a8-42ff-9da7-ac08b9678754 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:46.058471 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-eb40e47a-65a8-42ff-9da7-ac08b9678754 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:46.059260 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-eb40e47a-65a8-42ff-9da7-ac08b9678754 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:46.060411 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-eb40e47a-65a8-42ff-9da7-ac08b9678754 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:46.060958 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-eb40e47a-65a8-42ff-9da7-ac08b9678754 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:46.061427 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-eb40e47a-65a8-42ff-9da7-ac08b9678754 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:46.183620 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-eb40e47a-65a8-42ff-9da7-ac08b9678754 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "POST /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d/action" status: 202 len: 0 microversion: 2.1 time: 0.139535 Oct 04 22:01:46.185493 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1949/3867] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 22:01:46 2022] POST /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d/action => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 22:01:46.207212 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-da4c3719-6ef2-4b8c-89a0-a0deb7eac5a5 req-0cbb0b3b-719b-4590-ad17-1ba2cf2664f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aef57343-eb2a-4379-87cd-aab5f82d2a37", "name": "network-vif-deleted", "tag": "c71f5a1a-58f9-4373-a3a9-cbeab7214d77"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:01:46.208255 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-697e8f71-eb56-4dc7-ab5e-0486c6237b85 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a1c8d841104bc9b6910bcc2c0e2bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe9283584fc4d90b0715216d867ea2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:46.220038 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-da4c3719-6ef2-4b8c-89a0-a0deb7eac5a5 req-0cbb0b3b-719b-4590-ad17-1ba2cf2664f3 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:46.220923 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-697e8f71-eb56-4dc7-ab5e-0486c6237b85 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "GET /compute/v2.1/servers/aef57343-eb2a-4379-87cd-aab5f82d2a37" status: 200 len: 1509 microversion: 2.1 time: 0.383040 Oct 04 22:01:46.221233 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-da4c3719-6ef2-4b8c-89a0-a0deb7eac5a5 req-0cbb0b3b-719b-4590-ad17-1ba2cf2664f3 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:46.221530 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1919/3868] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:01:45 2022] GET /compute/v2.1/servers/aef57343-eb2a-4379-87cd-aab5f82d2a37 => generated 1509 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:01:46.221845 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-da4c3719-6ef2-4b8c-89a0-a0deb7eac5a5 req-0cbb0b3b-719b-4590-ad17-1ba2cf2664f3 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:46.228692 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-353fa174-13f1-4ffe-adb9-700aecddc9ce tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:46.235097 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-353fa174-13f1-4ffe-adb9-700aecddc9ce tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: a4cf4fac-1e9b-4669-a6ff-30008ed3642d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:46.250547 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-da4c3719-6ef2-4b8c-89a0-a0deb7eac5a5 req-0cbb0b3b-719b-4590-ad17-1ba2cf2664f3 service nova] Creating event network-vif-deleted:c71f5a1a-58f9-4373-a3a9-cbeab7214d77 for instance aef57343-eb2a-4379-87cd-aab5f82d2a37 on n-h1-860284-1 Oct 04 22:01:46.252057 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-353fa174-13f1-4ffe-adb9-700aecddc9ce tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:46.254045 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-353fa174-13f1-4ffe-adb9-700aecddc9ce tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:46.256047 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-353fa174-13f1-4ffe-adb9-700aecddc9ce tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:46.256880 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-353fa174-13f1-4ffe-adb9-700aecddc9ce tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:46.257410 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-353fa174-13f1-4ffe-adb9-700aecddc9ce tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:46.257792 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-da4c3719-6ef2-4b8c-89a0-a0deb7eac5a5 req-0cbb0b3b-719b-4590-ad17-1ba2cf2664f3 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069836 Oct 04 22:01:46.257898 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-353fa174-13f1-4ffe-adb9-700aecddc9ce tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:46.259521 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1950/3869] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:01:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:01:46.464914 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-353fa174-13f1-4ffe-adb9-700aecddc9ce tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2facee4c6a40416e908083e126d2cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07a17a482a4e92b6ddbdee463c8029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:46.474863 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-353fa174-13f1-4ffe-adb9-700aecddc9ce tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d" status: 200 len: 1501 microversion: 2.1 time: 0.250805 Oct 04 22:01:46.475774 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1920/3870] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:01:46 2022] GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d => generated 1501 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:01:46.687224 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-6addc28f-7650-4fa3-87dc-0ab8387b7ad9 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:46.687940 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-6addc28f-7650-4fa3-87dc-0ab8387b7ad9 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] [instance: 3dbe541d-234a-4049-befd-dcd9a67dbd46] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:46.701979 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6addc28f-7650-4fa3-87dc-0ab8387b7ad9 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:46.702651 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6addc28f-7650-4fa3-87dc-0ab8387b7ad9 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:46.703629 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6addc28f-7650-4fa3-87dc-0ab8387b7ad9 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:46.704592 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6addc28f-7650-4fa3-87dc-0ab8387b7ad9 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:46.705273 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6addc28f-7650-4fa3-87dc-0ab8387b7ad9 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:46.705768 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6addc28f-7650-4fa3-87dc-0ab8387b7ad9 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:46.866793 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-a1ec4c16-a7ec-46cf-8c97-00c839c71453 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:46.867927 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-a1ec4c16-a7ec-46cf-8c97-00c839c71453 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] [instance: 7285a94c-3dad-43f1-9052-63ccc9ac07ba] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:46.886500 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a1ec4c16-a7ec-46cf-8c97-00c839c71453 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:46.891684 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a1ec4c16-a7ec-46cf-8c97-00c839c71453 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:46.892403 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a1ec4c16-a7ec-46cf-8c97-00c839c71453 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:46.895540 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a1ec4c16-a7ec-46cf-8c97-00c839c71453 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:46.899941 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a1ec4c16-a7ec-46cf-8c97-00c839c71453 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:46.900595 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a1ec4c16-a7ec-46cf-8c97-00c839c71453 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:47.089106 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-6addc28f-7650-4fa3-87dc-0ab8387b7ad9 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2034fc9060874868bc5d27370a1c351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89499d833a4a00805164f4f79ed522', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:47.118705 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-6addc28f-7650-4fa3-87dc-0ab8387b7ad9 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] 10.222.0.43 "GET /compute/v2.1/servers/3dbe541d-234a-4049-befd-dcd9a67dbd46" status: 200 len: 1516 microversion: 2.1 time: 0.432802 Oct 04 22:01:47.120568 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1951/3871] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:01:46 2022] GET /compute/v2.1/servers/3dbe541d-234a-4049-befd-dcd9a67dbd46 => generated 1516 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:01:47.187962 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-8c8024ae-bae7-4d9f-88ea-6459e5ddb193 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:47.189147 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-8c8024ae-bae7-4d9f-88ea-6459e5ddb193 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] [instance: d0b1b757-4a4d-4a7a-9a06-08f178a02984] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:47.222102 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8c8024ae-bae7-4d9f-88ea-6459e5ddb193 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:47.223497 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8c8024ae-bae7-4d9f-88ea-6459e5ddb193 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:47.226053 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8c8024ae-bae7-4d9f-88ea-6459e5ddb193 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:47.228037 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8c8024ae-bae7-4d9f-88ea-6459e5ddb193 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:47.229761 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8c8024ae-bae7-4d9f-88ea-6459e5ddb193 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:47.230895 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8c8024ae-bae7-4d9f-88ea-6459e5ddb193 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:47.319128 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-a1ec4c16-a7ec-46cf-8c97-00c839c71453 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3adbba85c5a448148833e69d6304e62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b710cb6300854d8683bd52ddf56b787d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:47.332853 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-a1ec4c16-a7ec-46cf-8c97-00c839c71453 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3adbba85c5a448148833e69d6304e62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b710cb6300854d8683bd52ddf56b787d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:47.337069 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-a1ec4c16-a7ec-46cf-8c97-00c839c71453 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3adbba85c5a448148833e69d6304e62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b710cb6300854d8683bd52ddf56b787d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:47.342434 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-a1ec4c16-a7ec-46cf-8c97-00c839c71453 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] 10.222.0.43 "GET /compute/v2.1/servers/7285a94c-3dad-43f1-9052-63ccc9ac07ba" status: 200 len: 1362 microversion: 2.26 time: 0.482905 Oct 04 22:01:47.345546 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1921/3872] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:01:46 2022] GET /compute/v2.1/servers/7285a94c-3dad-43f1-9052-63ccc9ac07ba => generated 1362 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:01:47.353562 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-99e1bf9a-444e-43eb-8a89-30d433135ffd tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:47.356807 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-99e1bf9a-444e-43eb-8a89-30d433135ffd tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: aef57343-eb2a-4379-87cd-aab5f82d2a37] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:47.381553 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-99e1bf9a-444e-43eb-8a89-30d433135ffd tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:47.385394 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-99e1bf9a-444e-43eb-8a89-30d433135ffd tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:47.385394 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-99e1bf9a-444e-43eb-8a89-30d433135ffd tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:47.388748 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-99e1bf9a-444e-43eb-8a89-30d433135ffd tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:47.388748 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-99e1bf9a-444e-43eb-8a89-30d433135ffd tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:47.388748 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-99e1bf9a-444e-43eb-8a89-30d433135ffd tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:47.432362 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-8c8024ae-bae7-4d9f-88ea-6459e5ddb193 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:47.462552 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-99e1bf9a-444e-43eb-8a89-30d433135ffd tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] HTTP exception thrown: Instance aef57343-eb2a-4379-87cd-aab5f82d2a37 could not be found. Oct 04 22:01:47.468484 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-8c8024ae-bae7-4d9f-88ea-6459e5ddb193 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:47.471721 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-8c8024ae-bae7-4d9f-88ea-6459e5ddb193 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:47.477579 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-99e1bf9a-444e-43eb-8a89-30d433135ffd tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Request method failure captured: Oct 04 22:01:47.477579 n-d-860284-1 devstack@n-api.service[134101]: request: GET /compute/v2.1/servers/aef57343-eb2a-4379-87cd-aab5f82d2a37 HTTP/1.1 Oct 04 22:01:47.477579 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 22:01:47.477579 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 22:01:47.477579 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 22:01:47.477579 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 22:01:47.477579 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 22:01:47.477579 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 22:01:47.477579 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 22:01:47.477579 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 22:01:47.477579 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPK0nBLOASIAc_jQKg5RCRqB87oRsJiRc3l4etfmNkfSSv1yHGR8RjgOAS-Q4KEeiZVVxJRa8Focu7VoHdbhzgEqV5pocnY2xPPRPWacaT4koizORav87v6vdxgR4HH-PmsbraTS232Q30lW73kM7RH3tINWZChDkcbwtTWeQlIO6TSk Oct 04 22:01:47.477579 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 22:01:47.477579 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 22:01:47.477579 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 22:01:47.477579 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 22:01:47.477579 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 22:01:47.477579 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 22:01:47.477579 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: dfe9283584fc4d90b0715216d867ea2f Oct 04 22:01:47.477579 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-DeleteServersTestJSON-2136146778 Oct 04 22:01:47.477579 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 22:01:47.477579 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 22:01:47.477579 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/dfe9283584fc4d90b0715216d867ea2f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_dfe9283584fc4d90b0715216d867ea2f", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/dfe9283584fc4d90b0715216d867ea2f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/dfe9283584fc4d90b0715216d867ea2f"}]}] Oct 04 22:01:47.477579 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-DeleteServersTestJSON-2136146778 Oct 04 22:01:47.477579 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: dfe9283584fc4d90b0715216d867ea2f Oct 04 22:01:47.477579 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-DeleteServersTestJSON-2136146778 Oct 04 22:01:47.477579 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-DeleteServersTestJSON-2136146778-project Oct 04 22:01:47.477579 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 22:01:47.477579 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 22:01:47.477579 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 41a1c8d841104bc9b6910bcc2c0e2bb1 Oct 04 22:01:47.477579 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-DeleteServersTestJSON-2136146778-project Oct 04 22:01:47.477579 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 22:01:47.477579 n-d-860284-1 devstack@n-api.service[134101]: exception: Instance aef57343-eb2a-4379-87cd-aab5f82d2a37 could not be found. Oct 04 22:01:47.477579 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': 'aef57343-eb2a-4379-87cd-aab5f82d2a37'} Oct 04 22:01:47.477579 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:01:47.477579 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:01:47.477579 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:01:47.477579 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:01:47.477579 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:01:47.477579 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:01:47.477579 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:01:47.477579 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:01:47.477579 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:01:47.477579 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:01:47.477579 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aef57343-eb2a-4379-87cd-aab5f82d2a37 could not be found. Oct 04 22:01:47.477579 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:01:47.477579 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:01:47.477579 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:01:47.477579 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:01:47.477579 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:01:47.477579 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:01:47.477579 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:01:47.477579 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:01:47.477579 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:01:47.477579 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:01:47.477579 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:01:47.477579 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:01:47.477579 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:01:47.477579 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:01:47.477579 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:01:47.477579 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:01:47.477579 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aef57343-eb2a-4379-87cd-aab5f82d2a37 could not be found. Oct 04 22:01:47.477579 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:01:47.477579 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:01:47.477579 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:01:47.483269 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:01:47.483269 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:01:47.483269 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:01:47.483269 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:01:47.483269 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:01:47.483269 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aef57343-eb2a-4379-87cd-aab5f82d2a37 could not be found. Oct 04 22:01:47.483269 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:01:47.483269 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-99e1bf9a-444e-43eb-8a89-30d433135ffd tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Returning 404 to user: Instance aef57343-eb2a-4379-87cd-aab5f82d2a37 could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:01:47.483269 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-99e1bf9a-444e-43eb-8a89-30d433135ffd tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "GET /compute/v2.1/servers/aef57343-eb2a-4379-87cd-aab5f82d2a37" status: 404 len: 111 microversion: 2.1 time: 0.131298 Oct 04 22:01:47.494828 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1922/3873] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:01:47 2022] GET /compute/v2.1/servers/aef57343-eb2a-4379-87cd-aab5f82d2a37 => generated 111 bytes in 149 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:01:47.505351 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-8c8024ae-bae7-4d9f-88ea-6459e5ddb193 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] 10.222.0.43 "GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984" status: 200 len: 1531 microversion: 2.91 time: 0.350541 Oct 04 22:01:47.506439 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1952/3874] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:01:47 2022] GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984 => generated 1531 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:01:47.509982 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-7babd80e-1279-4495-8d3a-78dff40eb221 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:47.511216 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-7babd80e-1279-4495-8d3a-78dff40eb221 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: a4cf4fac-1e9b-4669-a6ff-30008ed3642d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:47.540816 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7babd80e-1279-4495-8d3a-78dff40eb221 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:47.545472 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7babd80e-1279-4495-8d3a-78dff40eb221 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:47.546383 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7babd80e-1279-4495-8d3a-78dff40eb221 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:47.548316 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7babd80e-1279-4495-8d3a-78dff40eb221 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:47.548810 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7babd80e-1279-4495-8d3a-78dff40eb221 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:47.549256 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7babd80e-1279-4495-8d3a-78dff40eb221 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:47.559356 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-06126de6-8dc2-4c2a-a6da-160536f890e7 tempest-UnshelveToHostMultiNodesTest-2056876790 tempest-UnshelveToHostMultiNodesTest-2056876790-project-admin] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:47.560496 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-06126de6-8dc2-4c2a-a6da-160536f890e7 tempest-UnshelveToHostMultiNodesTest-2056876790 tempest-UnshelveToHostMultiNodesTest-2056876790-project-admin] [instance: d0b1b757-4a4d-4a7a-9a06-08f178a02984] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:47.575054 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-06126de6-8dc2-4c2a-a6da-160536f890e7 tempest-UnshelveToHostMultiNodesTest-2056876790 tempest-UnshelveToHostMultiNodesTest-2056876790-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:47.576236 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-06126de6-8dc2-4c2a-a6da-160536f890e7 tempest-UnshelveToHostMultiNodesTest-2056876790 tempest-UnshelveToHostMultiNodesTest-2056876790-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:47.577807 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-06126de6-8dc2-4c2a-a6da-160536f890e7 tempest-UnshelveToHostMultiNodesTest-2056876790 tempest-UnshelveToHostMultiNodesTest-2056876790-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:47.579352 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-06126de6-8dc2-4c2a-a6da-160536f890e7 tempest-UnshelveToHostMultiNodesTest-2056876790 tempest-UnshelveToHostMultiNodesTest-2056876790-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:47.581443 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-06126de6-8dc2-4c2a-a6da-160536f890e7 tempest-UnshelveToHostMultiNodesTest-2056876790 tempest-UnshelveToHostMultiNodesTest-2056876790-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:47.582458 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-06126de6-8dc2-4c2a-a6da-160536f890e7 tempest-UnshelveToHostMultiNodesTest-2056876790 tempest-UnshelveToHostMultiNodesTest-2056876790-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:47.774890 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.objects.instance [None req-06126de6-8dc2-4c2a-a6da-160536f890e7 tempest-UnshelveToHostMultiNodesTest-2056876790 tempest-UnshelveToHostMultiNodesTest-2056876790-project-admin] Lazy-loading 'services' on Instance uuid d0b1b757-4a4d-4a7a-9a06-08f178a02984 {{(pid=134102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 22:01:47.804132 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-06126de6-8dc2-4c2a-a6da-160536f890e7 tempest-UnshelveToHostMultiNodesTest-2056876790 tempest-UnshelveToHostMultiNodesTest-2056876790-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984" status: 200 len: 1936 microversion: 2.91 time: 0.253500 Oct 04 22:01:47.805546 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1953/3875] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:01:47 2022] GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984 => generated 1936 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:01:47.816540 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-7babd80e-1279-4495-8d3a-78dff40eb221 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2facee4c6a40416e908083e126d2cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07a17a482a4e92b6ddbdee463c8029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:47.830203 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-7babd80e-1279-4495-8d3a-78dff40eb221 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d" status: 200 len: 1501 microversion: 2.1 time: 0.331801 Oct 04 22:01:47.834103 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-236e0ba7-a7f9-4677-9bdd-fdf0df0bcdbc tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1229741373", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452", "networks": [{"uuid": "948c65db-57fc-480e-9ddd-f1d8426ccd4e"}]}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:01:47.841229 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1923/3876] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:01:47 2022] GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d => generated 1501 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:01:47.884688 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-8e275804-3873-4a28-995c-bc1a9ae68d36 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:47.886447 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-8e275804-3873-4a28-995c-bc1a9ae68d36 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] [instance: d0b1b757-4a4d-4a7a-9a06-08f178a02984] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:47.896563 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8e275804-3873-4a28-995c-bc1a9ae68d36 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:47.898397 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8e275804-3873-4a28-995c-bc1a9ae68d36 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:47.898847 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8e275804-3873-4a28-995c-bc1a9ae68d36 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:47.899625 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8e275804-3873-4a28-995c-bc1a9ae68d36 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:47.900064 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8e275804-3873-4a28-995c-bc1a9ae68d36 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:47.900492 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8e275804-3873-4a28-995c-bc1a9ae68d36 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:47.909914 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.network.neutron [None req-236e0ba7-a7f9-4677-9bdd-fdf0df0bcdbc tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] validate_networks() for [('948c65db-57fc-480e-9ddd-f1d8426ccd4e', None, None, None, None, None)] {{(pid=134102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 22:01:47.966865 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-8e275804-3873-4a28-995c-bc1a9ae68d36 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] [instance: d0b1b757-4a4d-4a7a-9a06-08f178a02984] Going to try to terminate instance {{(pid=134101) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 22:01:48.086309 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-8e275804-3873-4a28-995c-bc1a9ae68d36 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] 10.222.0.43 "DELETE /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984" status: 204 len: 0 microversion: 2.91 time: 0.212365 Oct 04 22:01:48.091437 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1924/3877] 10.222.0.43 () {60 vars in 1280 bytes} [Tue Oct 4 22:01:47 2022] DELETE /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 22:01:48.108138 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-ac2792e7-0210-461e-92ca-2d014328e0a2 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:48.109688 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-ac2792e7-0210-461e-92ca-2d014328e0a2 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] [instance: d0b1b757-4a4d-4a7a-9a06-08f178a02984] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:48.126757 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ac2792e7-0210-461e-92ca-2d014328e0a2 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:48.127602 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ac2792e7-0210-461e-92ca-2d014328e0a2 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:48.132283 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ac2792e7-0210-461e-92ca-2d014328e0a2 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:48.134153 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ac2792e7-0210-461e-92ca-2d014328e0a2 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:48.134946 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ac2792e7-0210-461e-92ca-2d014328e0a2 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:48.136712 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ac2792e7-0210-461e-92ca-2d014328e0a2 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:48.277456 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-ac2792e7-0210-461e-92ca-2d014328e0a2 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:48.292447 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-ac2792e7-0210-461e-92ca-2d014328e0a2 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:48.294451 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-ac2792e7-0210-461e-92ca-2d014328e0a2 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:48.300617 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-ac2792e7-0210-461e-92ca-2d014328e0a2 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] 10.222.0.43 "GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984" status: 200 len: 1537 microversion: 2.91 time: 0.204667 Oct 04 22:01:48.310690 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1925/3878] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:01:48 2022] GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984 => generated 1537 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:01:48.318520 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-7668f556-0d7b-4e78-9876-1f23c82fe99d tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:48.318520 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-7668f556-0d7b-4e78-9876-1f23c82fe99d tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] [instance: 3dbe541d-234a-4049-befd-dcd9a67dbd46] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:48.330296 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7668f556-0d7b-4e78-9876-1f23c82fe99d tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:48.332003 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7668f556-0d7b-4e78-9876-1f23c82fe99d tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:48.332486 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7668f556-0d7b-4e78-9876-1f23c82fe99d tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:48.337271 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7668f556-0d7b-4e78-9876-1f23c82fe99d tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:48.339470 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7668f556-0d7b-4e78-9876-1f23c82fe99d tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:48.340339 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7668f556-0d7b-4e78-9876-1f23c82fe99d tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:48.640505 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-236e0ba7-a7f9-4677-9bdd-fdf0df0bcdbc tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Flavor limits 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 22:01:48.641771 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-236e0ba7-a7f9-4677-9bdd-fdf0df0bcdbc tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Image limits 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 22:01:48.648121 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-7668f556-0d7b-4e78-9876-1f23c82fe99d tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2034fc9060874868bc5d27370a1c351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89499d833a4a00805164f4f79ed522', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:48.656977 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-236e0ba7-a7f9-4677-9bdd-fdf0df0bcdbc tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Flavor pref 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 22:01:48.657842 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-236e0ba7-a7f9-4677-9bdd-fdf0df0bcdbc tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Image pref 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 22:01:48.660190 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-236e0ba7-a7f9-4677-9bdd-fdf0df0bcdbc tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 22:01:48.685390 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-7668f556-0d7b-4e78-9876-1f23c82fe99d tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] 10.222.0.43 "GET /compute/v2.1/servers/3dbe541d-234a-4049-befd-dcd9a67dbd46" status: 200 len: 1516 microversion: 2.1 time: 0.382533 Oct 04 22:01:48.686210 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1926/3879] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:01:48 2022] GET /compute/v2.1/servers/3dbe541d-234a-4049-befd-dcd9a67dbd46 => generated 1516 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:01:48.701916 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-236e0ba7-a7f9-4677-9bdd-fdf0df0bcdbc tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:48.701916 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-236e0ba7-a7f9-4677-9bdd-fdf0df0bcdbc tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:48.701916 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-236e0ba7-a7f9-4677-9bdd-fdf0df0bcdbc tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:48.701916 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-236e0ba7-a7f9-4677-9bdd-fdf0df0bcdbc tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:48.701916 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-236e0ba7-a7f9-4677-9bdd-fdf0df0bcdbc tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:48.701916 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-236e0ba7-a7f9-4677-9bdd-fdf0df0bcdbc tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:48.709489 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-d94fa428-f0ce-4ada-86b0-77632c1d20c0 req-6b97a5c6-8d40-444d-b1cc-fdb295ae29b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7285a94c-3dad-43f1-9052-63ccc9ac07ba", "tag": "0f3ace44-c465-4e93-b2a0-48fc82b7381a"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:01:48.718210 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-236e0ba7-a7f9-4677-9bdd-fdf0df0bcdbc tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Getting quotas for project dfe9283584fc4d90b0715216d867ea2f. Resources: {'instances', 'ram', 'cores'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:01:48.725438 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-236e0ba7-a7f9-4677-9bdd-fdf0df0bcdbc tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Getting quotas for user 41a1c8d841104bc9b6910bcc2c0e2bb1 and project dfe9283584fc4d90b0715216d867ea2f. Resources: {'instances', 'ram', 'cores'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:01:48.725833 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-d94fa428-f0ce-4ada-86b0-77632c1d20c0 req-6b97a5c6-8d40-444d-b1cc-fdb295ae29b7 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:48.726339 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-d94fa428-f0ce-4ada-86b0-77632c1d20c0 req-6b97a5c6-8d40-444d-b1cc-fdb295ae29b7 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:48.726803 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-d94fa428-f0ce-4ada-86b0-77632c1d20c0 req-6b97a5c6-8d40-444d-b1cc-fdb295ae29b7 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:48.742020 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-d94fa428-f0ce-4ada-86b0-77632c1d20c0 req-6b97a5c6-8d40-444d-b1cc-fdb295ae29b7 service nova] Creating event network-changed:0f3ace44-c465-4e93-b2a0-48fc82b7381a for instance 7285a94c-3dad-43f1-9052-63ccc9ac07ba on n-h2-860284-1 Oct 04 22:01:48.742832 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-236e0ba7-a7f9-4677-9bdd-fdf0df0bcdbc tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Going to run 1 instances... {{(pid=134102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 22:01:48.747433 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-236e0ba7-a7f9-4677-9bdd-fdf0df0bcdbc tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: f9376877-b87d-4738-b940-2bf314c83337] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='58548514-5dac-426c-81f5-19e3fba33e23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 22:01:48.748326 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-d94fa428-f0ce-4ada-86b0-77632c1d20c0 req-6b97a5c6-8d40-444d-b1cc-fdb295ae29b7 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060413 Oct 04 22:01:48.749539 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1927/3880] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:01:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:01:48.763836 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-abc80a9f-0665-4427-8f67-ed1d9f26bc8a tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:48.765107 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-abc80a9f-0665-4427-8f67-ed1d9f26bc8a tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] [instance: 7285a94c-3dad-43f1-9052-63ccc9ac07ba] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:48.778235 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:01:48.781271 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-abc80a9f-0665-4427-8f67-ed1d9f26bc8a tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:48.782517 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-abc80a9f-0665-4427-8f67-ed1d9f26bc8a tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:48.783500 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-abc80a9f-0665-4427-8f67-ed1d9f26bc8a tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:48.784933 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-abc80a9f-0665-4427-8f67-ed1d9f26bc8a tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:48.785781 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-abc80a9f-0665-4427-8f67-ed1d9f26bc8a tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:48.786549 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-abc80a9f-0665-4427-8f67-ed1d9f26bc8a tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:48.795237 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:01:48.895571 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-236e0ba7-a7f9-4677-9bdd-fdf0df0bcdbc tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.076961 Oct 04 22:01:48.896953 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1954/3881] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 22:01:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 1083 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 22:01:48.913520 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-81c38b5e-792f-4b40-85b0-f206486c7444 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:48.914955 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-81c38b5e-792f-4b40-85b0-f206486c7444 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: a4cf4fac-1e9b-4669-a6ff-30008ed3642d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:48.925022 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-81c38b5e-792f-4b40-85b0-f206486c7444 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:48.926086 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-81c38b5e-792f-4b40-85b0-f206486c7444 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:48.927011 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-81c38b5e-792f-4b40-85b0-f206486c7444 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:48.928160 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-81c38b5e-792f-4b40-85b0-f206486c7444 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:48.928969 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-81c38b5e-792f-4b40-85b0-f206486c7444 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:48.929681 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-81c38b5e-792f-4b40-85b0-f206486c7444 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:49.201657 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-abc80a9f-0665-4427-8f67-ed1d9f26bc8a tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3adbba85c5a448148833e69d6304e62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b710cb6300854d8683bd52ddf56b787d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:49.230554 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-abc80a9f-0665-4427-8f67-ed1d9f26bc8a tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3adbba85c5a448148833e69d6304e62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b710cb6300854d8683bd52ddf56b787d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:49.238156 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-abc80a9f-0665-4427-8f67-ed1d9f26bc8a tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3adbba85c5a448148833e69d6304e62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b710cb6300854d8683bd52ddf56b787d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:49.239644 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-abc80a9f-0665-4427-8f67-ed1d9f26bc8a tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] 10.222.0.43 "GET /compute/v2.1/servers/7285a94c-3dad-43f1-9052-63ccc9ac07ba" status: 200 len: 1362 microversion: 2.26 time: 0.488674 Oct 04 22:01:49.240765 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1928/3882] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:01:48 2022] GET /compute/v2.1/servers/7285a94c-3dad-43f1-9052-63ccc9ac07ba => generated 1362 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:01:49.257500 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-8d1b6951-6342-4f49-98b3-253e2e2d93cb tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:49.259111 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-8d1b6951-6342-4f49-98b3-253e2e2d93cb tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: f9376877-b87d-4738-b940-2bf314c83337] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:49.288446 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-81c38b5e-792f-4b40-85b0-f206486c7444 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2facee4c6a40416e908083e126d2cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07a17a482a4e92b6ddbdee463c8029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:49.306249 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-81c38b5e-792f-4b40-85b0-f206486c7444 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d" status: 200 len: 1504 microversion: 2.1 time: 0.402091 Oct 04 22:01:49.307771 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1955/3883] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:01:48 2022] GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d => generated 1504 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:01:49.334539 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-6c6db0c9-9044-4b7c-a565-7acd4826b03d tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:49.337971 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-6c6db0c9-9044-4b7c-a565-7acd4826b03d tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: a4cf4fac-1e9b-4669-a6ff-30008ed3642d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:49.347618 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6c6db0c9-9044-4b7c-a565-7acd4826b03d tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:49.348423 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6c6db0c9-9044-4b7c-a565-7acd4826b03d tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:49.350279 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6c6db0c9-9044-4b7c-a565-7acd4826b03d tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:49.351358 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6c6db0c9-9044-4b7c-a565-7acd4826b03d tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:49.352127 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6c6db0c9-9044-4b7c-a565-7acd4826b03d tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:49.355537 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6c6db0c9-9044-4b7c-a565-7acd4826b03d tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:49.367133 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-8d1b6951-6342-4f49-98b3-253e2e2d93cb tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a1c8d841104bc9b6910bcc2c0e2bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe9283584fc4d90b0715216d867ea2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:49.382574 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-8d1b6951-6342-4f49-98b3-253e2e2d93cb tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "GET /compute/v2.1/servers/f9376877-b87d-4738-b940-2bf314c83337" status: 200 len: 1215 microversion: 2.1 time: 0.133357 Oct 04 22:01:49.383418 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1929/3884] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:01:49 2022] GET /compute/v2.1/servers/f9376877-b87d-4738-b940-2bf314c83337 => generated 1215 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:01:49.412144 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-88faabfa-1be9-457b-b79a-86e733ba8584 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:49.412949 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-88faabfa-1be9-457b-b79a-86e733ba8584 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] [instance: d0b1b757-4a4d-4a7a-9a06-08f178a02984] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:49.427295 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-88faabfa-1be9-457b-b79a-86e733ba8584 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:49.427906 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-88faabfa-1be9-457b-b79a-86e733ba8584 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:49.428450 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-88faabfa-1be9-457b-b79a-86e733ba8584 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:49.429464 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-88faabfa-1be9-457b-b79a-86e733ba8584 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:49.430122 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-88faabfa-1be9-457b-b79a-86e733ba8584 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:49.430717 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-88faabfa-1be9-457b-b79a-86e733ba8584 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:49.576463 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-88faabfa-1be9-457b-b79a-86e733ba8584 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:49.587843 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-88faabfa-1be9-457b-b79a-86e733ba8584 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:49.590424 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-88faabfa-1be9-457b-b79a-86e733ba8584 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:49.597901 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-88faabfa-1be9-457b-b79a-86e733ba8584 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] 10.222.0.43 "GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984" status: 200 len: 1537 microversion: 2.91 time: 0.195832 Oct 04 22:01:49.598966 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1930/3885] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:01:49 2022] GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984 => generated 1537 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:01:49.647307 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-6c6db0c9-9044-4b7c-a565-7acd4826b03d tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2facee4c6a40416e908083e126d2cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07a17a482a4e92b6ddbdee463c8029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:49.656099 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-6c6db0c9-9044-4b7c-a565-7acd4826b03d tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d" status: 200 len: 1504 microversion: 2.1 time: 0.325524 Oct 04 22:01:49.656765 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1956/3886] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:01:49 2022] GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d => generated 1504 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:01:49.683733 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-2f647768-75f7-475c-a20d-34f655b25750 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:01:49.684290 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-2f647768-75f7-475c-a20d-34f655b25750 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: adfeff75-1d1c-49f4-ae68-da499996f3a3] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:49.691700 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-2f647768-75f7-475c-a20d-34f655b25750 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] HTTP exception thrown: Instance adfeff75-1d1c-49f4-ae68-da499996f3a3 could not be found. Oct 04 22:01:49.693513 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-2f647768-75f7-475c-a20d-34f655b25750 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Request method failure captured: Oct 04 22:01:49.693513 n-d-860284-1 devstack@n-api.service[134101]: request: POST /compute/v2.1/servers/adfeff75-1d1c-49f4-ae68-da499996f3a3/action HTTP/1.1 Oct 04 22:01:49.693513 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 22:01:49.693513 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 22:01:49.693513 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 22:01:49.693513 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 15 Oct 04 22:01:49.693513 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 22:01:49.693513 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 22:01:49.693513 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 22:01:49.693513 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 22:01:49.693513 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPKwu4cpW6hhBuWb-qV_7iYlwjOTpf5XWCl53BJjoosjlcj4wkmmOFzemCJVdBntIx8zJ1SF_z6VrRY8UJr7E8TQDJCRnVQMdNnh0-lZwGdqUzjOWSO31Ryb6n87Cka0g238a21JWok3h3GEhLB-7oCbN3bbcOGmkhd6UFueRxRluk24 Oct 04 22:01:49.693513 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 22:01:49.693513 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 22:01:49.693513 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 22:01:49.693513 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 22:01:49.693513 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 22:01:49.693513 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 22:01:49.693513 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: cf07a17a482a4e92b6ddbdee463c8029 Oct 04 22:01:49.693513 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-ServersNegativeTestJSON-1933663319 Oct 04 22:01:49.693513 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 22:01:49.693513 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 22:01:49.693513 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/cf07a17a482a4e92b6ddbdee463c8029"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_cf07a17a482a4e92b6ddbdee463c8029", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/cf07a17a482a4e92b6ddbdee463c8029"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/cf07a17a482a4e92b6ddbdee463c8029"}]}] Oct 04 22:01:49.693513 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-ServersNegativeTestJSON-1933663319 Oct 04 22:01:49.693513 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: cf07a17a482a4e92b6ddbdee463c8029 Oct 04 22:01:49.693513 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1933663319 Oct 04 22:01:49.693513 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-ServersNegativeTestJSON-1933663319-project Oct 04 22:01:49.693513 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 22:01:49.693513 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 22:01:49.693513 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 2facee4c6a40416e908083e126d2cfa3 Oct 04 22:01:49.693513 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-ServersNegativeTestJSON-1933663319-project Oct 04 22:01:49.693513 n-d-860284-1 devstack@n-api.service[134101]: Oct 04 22:01:49.693513 n-d-860284-1 devstack@n-api.service[134101]: {"unpause": {}} Oct 04 22:01:49.693513 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 22:01:49.693513 n-d-860284-1 devstack@n-api.service[134101]: exception: Instance adfeff75-1d1c-49f4-ae68-da499996f3a3 could not be found. Oct 04 22:01:49.693513 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': 'adfeff75-1d1c-49f4-ae68-da499996f3a3', 'body': {'unpause': {}}} Oct 04 22:01:49.693513 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:01:49.693513 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:01:49.693513 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:01:49.693513 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:01:49.693513 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:01:49.693513 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:01:49.693513 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 22:01:49.693513 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 22:01:49.693513 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance adfeff75-1d1c-49f4-ae68-da499996f3a3 could not be found. Oct 04 22:01:49.693513 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:01:49.693513 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:01:49.693513 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:01:49.693513 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:01:49.693513 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:01:49.693513 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:01:49.693513 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:01:49.693513 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:01:49.693513 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:01:49.693513 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:01:49.693513 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 58, in _unpause Oct 04 22:01:49.693513 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Oct 04 22:01:49.693513 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:01:49.693513 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:01:49.693513 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance adfeff75-1d1c-49f4-ae68-da499996f3a3 could not be found. Oct 04 22:01:49.693513 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:01:49.693513 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:01:49.693513 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:01:49.693513 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:01:49.693513 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:01:49.693513 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:01:49.704857 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:01:49.704857 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:01:49.704857 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance adfeff75-1d1c-49f4-ae68-da499996f3a3 could not be found. Oct 04 22:01:49.704857 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:01:49.704857 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-2f647768-75f7-475c-a20d-34f655b25750 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Returning 404 to user: Instance adfeff75-1d1c-49f4-ae68-da499996f3a3 could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:01:49.704857 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-2f647768-75f7-475c-a20d-34f655b25750 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "POST /compute/v2.1/servers/adfeff75-1d1c-49f4-ae68-da499996f3a3/action" status: 404 len: 111 microversion: 2.1 time: 0.016611 Oct 04 22:01:49.704857 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1931/3887] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 22:01:49 2022] POST /compute/v2.1/servers/adfeff75-1d1c-49f4-ae68-da499996f3a3/action => generated 111 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:01:49.706544 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-8fe20267-2d3a-45b4-92cd-e8ae79f7fa4a tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:49.706544 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-8fe20267-2d3a-45b4-92cd-e8ae79f7fa4a tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: a4cf4fac-1e9b-4669-a6ff-30008ed3642d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:49.717582 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-9dfb6d0e-baff-4fbf-8528-96814927241f tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:49.723136 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-9dfb6d0e-baff-4fbf-8528-96814927241f tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] [instance: 3dbe541d-234a-4049-befd-dcd9a67dbd46] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:49.726333 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8fe20267-2d3a-45b4-92cd-e8ae79f7fa4a tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:49.727039 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8fe20267-2d3a-45b4-92cd-e8ae79f7fa4a tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:49.727500 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8fe20267-2d3a-45b4-92cd-e8ae79f7fa4a tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:49.728465 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8fe20267-2d3a-45b4-92cd-e8ae79f7fa4a tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:49.729874 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8fe20267-2d3a-45b4-92cd-e8ae79f7fa4a tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:49.730828 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8fe20267-2d3a-45b4-92cd-e8ae79f7fa4a tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:49.740835 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9dfb6d0e-baff-4fbf-8528-96814927241f tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:49.741351 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9dfb6d0e-baff-4fbf-8528-96814927241f tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:49.758977 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9dfb6d0e-baff-4fbf-8528-96814927241f tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:49.760785 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9dfb6d0e-baff-4fbf-8528-96814927241f tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:49.764857 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9dfb6d0e-baff-4fbf-8528-96814927241f tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:49.765694 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9dfb6d0e-baff-4fbf-8528-96814927241f tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:49.961746 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-8fe20267-2d3a-45b4-92cd-e8ae79f7fa4a tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2facee4c6a40416e908083e126d2cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07a17a482a4e92b6ddbdee463c8029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:49.983880 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-8fe20267-2d3a-45b4-92cd-e8ae79f7fa4a tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d" status: 200 len: 1504 microversion: 2.1 time: 0.282741 Oct 04 22:01:49.987083 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1957/3888] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:01:49 2022] GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d => generated 1504 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:01:49.988123 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-9dfb6d0e-baff-4fbf-8528-96814927241f tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2034fc9060874868bc5d27370a1c351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89499d833a4a00805164f4f79ed522', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:49.999126 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-9dfb6d0e-baff-4fbf-8528-96814927241f tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] 10.222.0.43 "GET /compute/v2.1/servers/3dbe541d-234a-4049-befd-dcd9a67dbd46" status: 200 len: 1516 microversion: 2.1 time: 0.289453 Oct 04 22:01:50.000249 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1932/3889] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:01:49 2022] GET /compute/v2.1/servers/3dbe541d-234a-4049-befd-dcd9a67dbd46 => generated 1516 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:01:50.016833 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-a1010887-a8ac-46dd-83a7-1c016322924c tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:50.017489 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-a1010887-a8ac-46dd-83a7-1c016322924c tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: a4cf4fac-1e9b-4669-a6ff-30008ed3642d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:50.027318 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a1010887-a8ac-46dd-83a7-1c016322924c tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:50.028853 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a1010887-a8ac-46dd-83a7-1c016322924c tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:50.029315 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a1010887-a8ac-46dd-83a7-1c016322924c tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:50.030353 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a1010887-a8ac-46dd-83a7-1c016322924c tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:50.030840 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a1010887-a8ac-46dd-83a7-1c016322924c tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:50.031551 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a1010887-a8ac-46dd-83a7-1c016322924c tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:50.217881 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-a1010887-a8ac-46dd-83a7-1c016322924c tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2facee4c6a40416e908083e126d2cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07a17a482a4e92b6ddbdee463c8029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:50.227080 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-a1010887-a8ac-46dd-83a7-1c016322924c tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d" status: 200 len: 1504 microversion: 2.1 time: 0.215002 Oct 04 22:01:50.227694 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1958/3890] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:01:50 2022] GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d => generated 1504 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:01:50.254586 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-bc39ca3e-8056-4f0f-a106-9f3e2d58b2c4 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:01:50.255201 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-bc39ca3e-8056-4f0f-a106-9f3e2d58b2c4 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: a4cf4fac-1e9b-4669-a6ff-30008ed3642d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:50.263583 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bc39ca3e-8056-4f0f-a106-9f3e2d58b2c4 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:50.265449 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bc39ca3e-8056-4f0f-a106-9f3e2d58b2c4 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:50.266179 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bc39ca3e-8056-4f0f-a106-9f3e2d58b2c4 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:50.267258 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bc39ca3e-8056-4f0f-a106-9f3e2d58b2c4 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:50.267725 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bc39ca3e-8056-4f0f-a106-9f3e2d58b2c4 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:50.267859 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-730782ea-fdeb-4a2a-9930-7d0e7426237f tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:50.268336 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bc39ca3e-8056-4f0f-a106-9f3e2d58b2c4 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:50.268643 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-730782ea-fdeb-4a2a-9930-7d0e7426237f tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] [instance: 7285a94c-3dad-43f1-9052-63ccc9ac07ba] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:50.277561 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-730782ea-fdeb-4a2a-9930-7d0e7426237f tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:50.278089 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-730782ea-fdeb-4a2a-9930-7d0e7426237f tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:50.278565 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-730782ea-fdeb-4a2a-9930-7d0e7426237f tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:50.279515 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-730782ea-fdeb-4a2a-9930-7d0e7426237f tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:50.279991 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-730782ea-fdeb-4a2a-9930-7d0e7426237f tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:50.280426 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-730782ea-fdeb-4a2a-9930-7d0e7426237f tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:50.306641 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-bc39ca3e-8056-4f0f-a106-9f3e2d58b2c4 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] HTTP exception thrown: Cannot 'unpause' instance a4cf4fac-1e9b-4669-a6ff-30008ed3642d while it is in vm_state active Oct 04 22:01:50.309394 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-bc39ca3e-8056-4f0f-a106-9f3e2d58b2c4 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Request method failure captured: Oct 04 22:01:50.309394 n-d-860284-1 devstack@n-api.service[134101]: request: POST /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d/action HTTP/1.1 Oct 04 22:01:50.309394 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 22:01:50.309394 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 22:01:50.309394 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 22:01:50.309394 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 15 Oct 04 22:01:50.309394 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 22:01:50.309394 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 22:01:50.309394 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 22:01:50.309394 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 22:01:50.309394 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPKwu4cpW6hhBuWb-qV_7iYlwjOTpf5XWCl53BJjoosjlcj4wkmmOFzemCJVdBntIx8zJ1SF_z6VrRY8UJr7E8TQDJCRnVQMdNnh0-lZwGdqUzjOWSO31Ryb6n87Cka0g238a21JWok3h3GEhLB-7oCbN3bbcOGmkhd6UFueRxRluk24 Oct 04 22:01:50.309394 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 22:01:50.309394 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 22:01:50.309394 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 22:01:50.309394 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 22:01:50.309394 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 22:01:50.309394 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 22:01:50.309394 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: cf07a17a482a4e92b6ddbdee463c8029 Oct 04 22:01:50.309394 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-ServersNegativeTestJSON-1933663319 Oct 04 22:01:50.309394 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 22:01:50.309394 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 22:01:50.309394 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/cf07a17a482a4e92b6ddbdee463c8029"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_cf07a17a482a4e92b6ddbdee463c8029", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/cf07a17a482a4e92b6ddbdee463c8029"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/cf07a17a482a4e92b6ddbdee463c8029"}]}] Oct 04 22:01:50.309394 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-ServersNegativeTestJSON-1933663319 Oct 04 22:01:50.309394 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: cf07a17a482a4e92b6ddbdee463c8029 Oct 04 22:01:50.309394 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1933663319 Oct 04 22:01:50.309394 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-ServersNegativeTestJSON-1933663319-project Oct 04 22:01:50.309394 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 22:01:50.309394 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 22:01:50.309394 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 2facee4c6a40416e908083e126d2cfa3 Oct 04 22:01:50.309394 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-ServersNegativeTestJSON-1933663319-project Oct 04 22:01:50.309394 n-d-860284-1 devstack@n-api.service[134101]: Oct 04 22:01:50.309394 n-d-860284-1 devstack@n-api.service[134101]: {"unpause": {}} Oct 04 22:01:50.309394 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 22:01:50.309394 n-d-860284-1 devstack@n-api.service[134101]: exception: Cannot 'unpause' instance a4cf4fac-1e9b-4669-a6ff-30008ed3642d while it is in vm_state active Oct 04 22:01:50.309394 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': 'a4cf4fac-1e9b-4669-a6ff-30008ed3642d', 'body': {'unpause': {}}} Oct 04 22:01:50.309394 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:01:50.309394 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:01:50.309394 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 62, in _unpause Oct 04 22:01:50.309394 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi self.compute_api.unpause(ctxt, server) Oct 04 22:01:50.309394 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 22:01:50.309394 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 22:01:50.309394 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 04 22:01:50.309394 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 04 22:01:50.309394 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance a4cf4fac-1e9b-4669-a6ff-30008ed3642d in vm_state active. Cannot unpause while the instance is in this state. Oct 04 22:01:50.309394 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:01:50.309394 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:01:50.309394 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:01:50.309394 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:01:50.309394 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:01:50.309394 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:01:50.309394 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:01:50.309394 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:01:50.309394 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:01:50.309394 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:01:50.309394 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 66, in _unpause Oct 04 22:01:50.309394 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 04 22:01:50.309394 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 04 22:01:50.309394 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 22:01:50.309394 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unpause' instance a4cf4fac-1e9b-4669-a6ff-30008ed3642d while it is in vm_state active Oct 04 22:01:50.309394 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:01:50.309394 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:01:50.309394 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:01:50.309394 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:01:50.309394 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:01:50.315533 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:01:50.315533 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:01:50.315533 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:01:50.315533 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unpause' instance a4cf4fac-1e9b-4669-a6ff-30008ed3642d while it is in vm_state active Oct 04 22:01:50.315533 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:01:50.315533 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-bc39ca3e-8056-4f0f-a106-9f3e2d58b2c4 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Returning 409 to user: Cannot 'unpause' instance a4cf4fac-1e9b-4669-a6ff-30008ed3642d while it is in vm_state active {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:01:50.315533 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-bc39ca3e-8056-4f0f-a106-9f3e2d58b2c4 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "POST /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d/action" status: 409 len: 145 microversion: 2.1 time: 0.060027 Oct 04 22:01:50.315533 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1933/3891] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 22:01:50 2022] POST /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d/action => generated 145 bytes in 61 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 22:01:50.320668 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e3ae2a7a-042e-4db3-a778-79186dddd0d6 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:50.321333 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-e3ae2a7a-042e-4db3-a778-79186dddd0d6 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: a4cf4fac-1e9b-4669-a6ff-30008ed3642d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:50.329777 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e3ae2a7a-042e-4db3-a778-79186dddd0d6 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:50.330413 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e3ae2a7a-042e-4db3-a778-79186dddd0d6 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:50.331134 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e3ae2a7a-042e-4db3-a778-79186dddd0d6 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:50.332141 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e3ae2a7a-042e-4db3-a778-79186dddd0d6 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:50.332849 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e3ae2a7a-042e-4db3-a778-79186dddd0d6 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:50.333607 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e3ae2a7a-042e-4db3-a778-79186dddd0d6 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:50.708076 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-730782ea-fdeb-4a2a-9930-7d0e7426237f tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3adbba85c5a448148833e69d6304e62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b710cb6300854d8683bd52ddf56b787d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:50.722065 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-730782ea-fdeb-4a2a-9930-7d0e7426237f tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3adbba85c5a448148833e69d6304e62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b710cb6300854d8683bd52ddf56b787d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:50.724037 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-730782ea-fdeb-4a2a-9930-7d0e7426237f tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3adbba85c5a448148833e69d6304e62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b710cb6300854d8683bd52ddf56b787d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:50.725340 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-730782ea-fdeb-4a2a-9930-7d0e7426237f tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] 10.222.0.43 "GET /compute/v2.1/servers/7285a94c-3dad-43f1-9052-63ccc9ac07ba" status: 200 len: 1362 microversion: 2.26 time: 0.463577 Oct 04 22:01:50.726009 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1959/3892] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:01:50 2022] GET /compute/v2.1/servers/7285a94c-3dad-43f1-9052-63ccc9ac07ba => generated 1362 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:01:50.733231 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-68366875-b59e-41d5-9bf5-49701a2dc3df tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:50.734290 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-68366875-b59e-41d5-9bf5-49701a2dc3df tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: f9376877-b87d-4738-b940-2bf314c83337] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:50.739745 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-e3ae2a7a-042e-4db3-a778-79186dddd0d6 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2facee4c6a40416e908083e126d2cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07a17a482a4e92b6ddbdee463c8029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:50.742413 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-68366875-b59e-41d5-9bf5-49701a2dc3df tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:50.743465 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-68366875-b59e-41d5-9bf5-49701a2dc3df tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:50.744289 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-68366875-b59e-41d5-9bf5-49701a2dc3df tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:50.746058 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-68366875-b59e-41d5-9bf5-49701a2dc3df tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:50.746810 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-68366875-b59e-41d5-9bf5-49701a2dc3df tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:50.747468 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-68366875-b59e-41d5-9bf5-49701a2dc3df tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:50.748956 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:01:50.755117 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-e3ae2a7a-042e-4db3-a778-79186dddd0d6 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d" status: 200 len: 1504 microversion: 2.1 time: 0.438649 Oct 04 22:01:50.756094 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1934/3893] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:01:50 2022] GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d => generated 1504 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:01:50.764798 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-c6a79148-7aea-4a0a-8e9e-c9143aa9b149 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:50.769073 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-c6a79148-7aea-4a0a-8e9e-c9143aa9b149 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] [instance: d0b1b757-4a4d-4a7a-9a06-08f178a02984] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:50.784805 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c6a79148-7aea-4a0a-8e9e-c9143aa9b149 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:50.786095 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c6a79148-7aea-4a0a-8e9e-c9143aa9b149 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:50.787365 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c6a79148-7aea-4a0a-8e9e-c9143aa9b149 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:50.788682 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c6a79148-7aea-4a0a-8e9e-c9143aa9b149 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:50.789843 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c6a79148-7aea-4a0a-8e9e-c9143aa9b149 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:50.790839 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c6a79148-7aea-4a0a-8e9e-c9143aa9b149 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:50.864919 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-68366875-b59e-41d5-9bf5-49701a2dc3df tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a1c8d841104bc9b6910bcc2c0e2bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe9283584fc4d90b0715216d867ea2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:50.878130 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-68366875-b59e-41d5-9bf5-49701a2dc3df tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "GET /compute/v2.1/servers/f9376877-b87d-4738-b940-2bf314c83337" status: 200 len: 1273 microversion: 2.1 time: 0.150603 Oct 04 22:01:50.886580 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1960/3894] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:01:50 2022] GET /compute/v2.1/servers/f9376877-b87d-4738-b940-2bf314c83337 => generated 1273 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:01:50.898656 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-130c2161-fed8-4e37-b955-1e33312af030 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:50.900466 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-130c2161-fed8-4e37-b955-1e33312af030 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: a4cf4fac-1e9b-4669-a6ff-30008ed3642d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:50.904042 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-c6a79148-7aea-4a0a-8e9e-c9143aa9b149 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:50.917322 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-c6a79148-7aea-4a0a-8e9e-c9143aa9b149 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:50.917865 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-130c2161-fed8-4e37-b955-1e33312af030 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:50.919526 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-130c2161-fed8-4e37-b955-1e33312af030 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:50.920497 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-130c2161-fed8-4e37-b955-1e33312af030 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:50.921210 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-c6a79148-7aea-4a0a-8e9e-c9143aa9b149 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:50.922595 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-130c2161-fed8-4e37-b955-1e33312af030 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:50.924026 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-130c2161-fed8-4e37-b955-1e33312af030 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:50.924845 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-130c2161-fed8-4e37-b955-1e33312af030 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:50.927901 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-c6a79148-7aea-4a0a-8e9e-c9143aa9b149 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] 10.222.0.43 "GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984" status: 200 len: 1537 microversion: 2.91 time: 0.170647 Oct 04 22:01:50.943043 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1935/3895] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:01:50 2022] GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984 => generated 1537 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:01:51.031463 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-8a4a5977-581a-4ec9-bde5-c0172ec2bc53 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:51.032419 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-8a4a5977-581a-4ec9-bde5-c0172ec2bc53 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] [instance: 3dbe541d-234a-4049-befd-dcd9a67dbd46] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:51.080860 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8a4a5977-581a-4ec9-bde5-c0172ec2bc53 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:51.080860 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8a4a5977-581a-4ec9-bde5-c0172ec2bc53 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:51.080860 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8a4a5977-581a-4ec9-bde5-c0172ec2bc53 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:51.080860 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8a4a5977-581a-4ec9-bde5-c0172ec2bc53 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:51.080860 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8a4a5977-581a-4ec9-bde5-c0172ec2bc53 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:51.080860 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8a4a5977-581a-4ec9-bde5-c0172ec2bc53 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:51.453771 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-8a4a5977-581a-4ec9-bde5-c0172ec2bc53 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2034fc9060874868bc5d27370a1c351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89499d833a4a00805164f4f79ed522', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:51.463130 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-8a4a5977-581a-4ec9-bde5-c0172ec2bc53 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] 10.222.0.43 "GET /compute/v2.1/servers/3dbe541d-234a-4049-befd-dcd9a67dbd46" status: 200 len: 1516 microversion: 2.1 time: 0.435527 Oct 04 22:01:51.464267 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1936/3896] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:01:51 2022] GET /compute/v2.1/servers/3dbe541d-234a-4049-befd-dcd9a67dbd46 => generated 1516 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:01:51.484938 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-130c2161-fed8-4e37-b955-1e33312af030 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2facee4c6a40416e908083e126d2cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07a17a482a4e92b6ddbdee463c8029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:51.496823 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-130c2161-fed8-4e37-b955-1e33312af030 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d" status: 200 len: 1504 microversion: 2.1 time: 0.607867 Oct 04 22:01:51.497850 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1961/3897] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:01:50 2022] GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d => generated 1504 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:01:51.524707 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-f7ea750e-140b-40d1-a2e6-c9625f5a0970 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:01:51.528316 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-f7ea750e-140b-40d1-a2e6-c9625f5a0970 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: f0114867-7744-491d-8d32-f4481f86b17c] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:51.534400 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-f7ea750e-140b-40d1-a2e6-c9625f5a0970 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] HTTP exception thrown: Instance f0114867-7744-491d-8d32-f4481f86b17c could not be found. Oct 04 22:01:51.536235 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-f7ea750e-140b-40d1-a2e6-c9625f5a0970 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Request method failure captured: Oct 04 22:01:51.536235 n-d-860284-1 devstack@n-api.service[134101]: request: POST /compute/v2.1/servers/f0114867-7744-491d-8d32-f4481f86b17c/action HTTP/1.1 Oct 04 22:01:51.536235 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 22:01:51.536235 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 22:01:51.536235 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 22:01:51.536235 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 18 Oct 04 22:01:51.536235 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 22:01:51.536235 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 22:01:51.536235 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 22:01:51.536235 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 22:01:51.536235 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPKwu4cpW6hhBuWb-qV_7iYlwjOTpf5XWCl53BJjoosjlcj4wkmmOFzemCJVdBntIx8zJ1SF_z6VrRY8UJr7E8TQDJCRnVQMdNnh0-lZwGdqUzjOWSO31Ryb6n87Cka0g238a21JWok3h3GEhLB-7oCbN3bbcOGmkhd6UFueRxRluk24 Oct 04 22:01:51.536235 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 22:01:51.536235 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 22:01:51.536235 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 22:01:51.536235 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 22:01:51.536235 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 22:01:51.536235 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 22:01:51.536235 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: cf07a17a482a4e92b6ddbdee463c8029 Oct 04 22:01:51.536235 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-ServersNegativeTestJSON-1933663319 Oct 04 22:01:51.536235 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 22:01:51.536235 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 22:01:51.536235 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/cf07a17a482a4e92b6ddbdee463c8029"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_cf07a17a482a4e92b6ddbdee463c8029", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/cf07a17a482a4e92b6ddbdee463c8029"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/cf07a17a482a4e92b6ddbdee463c8029"}]}] Oct 04 22:01:51.536235 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-ServersNegativeTestJSON-1933663319 Oct 04 22:01:51.536235 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: cf07a17a482a4e92b6ddbdee463c8029 Oct 04 22:01:51.536235 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1933663319 Oct 04 22:01:51.536235 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-ServersNegativeTestJSON-1933663319-project Oct 04 22:01:51.536235 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 22:01:51.536235 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 22:01:51.536235 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 2facee4c6a40416e908083e126d2cfa3 Oct 04 22:01:51.536235 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-ServersNegativeTestJSON-1933663319-project Oct 04 22:01:51.536235 n-d-860284-1 devstack@n-api.service[134101]: Oct 04 22:01:51.536235 n-d-860284-1 devstack@n-api.service[134101]: {"unshelve": null} Oct 04 22:01:51.536235 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 22:01:51.536235 n-d-860284-1 devstack@n-api.service[134101]: exception: Instance f0114867-7744-491d-8d32-f4481f86b17c could not be found. Oct 04 22:01:51.536235 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': 'f0114867-7744-491d-8d32-f4481f86b17c', 'body': {'unshelve': None}} Oct 04 22:01:51.536235 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:01:51.536235 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:01:51.536235 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:01:51.536235 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:01:51.536235 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:01:51.536235 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:01:51.536235 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 22:01:51.536235 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 22:01:51.536235 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f0114867-7744-491d-8d32-f4481f86b17c could not be found. Oct 04 22:01:51.536235 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:01:51.536235 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:01:51.536235 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:01:51.536235 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:01:51.536235 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:01:51.536235 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:01:51.536235 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:01:51.536235 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:01:51.536235 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:01:51.536235 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:01:51.536235 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 22:01:51.536235 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 22:01:51.536235 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 22:01:51.536235 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 22:01:51.536235 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 102, in _unshelve Oct 04 22:01:51.536235 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 04 22:01:51.536235 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:01:51.536235 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:01:51.536235 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f0114867-7744-491d-8d32-f4481f86b17c could not be found. Oct 04 22:01:51.536235 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:01:51.536235 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:01:51.540383 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:01:51.540383 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:01:51.540383 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:01:51.540383 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:01:51.540383 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:01:51.540383 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:01:51.540383 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f0114867-7744-491d-8d32-f4481f86b17c could not be found. Oct 04 22:01:51.540383 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:01:51.540383 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-f7ea750e-140b-40d1-a2e6-c9625f5a0970 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Returning 404 to user: Instance f0114867-7744-491d-8d32-f4481f86b17c could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:01:51.540383 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-f7ea750e-140b-40d1-a2e6-c9625f5a0970 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "POST /compute/v2.1/servers/f0114867-7744-491d-8d32-f4481f86b17c/action" status: 404 len: 111 microversion: 2.1 time: 0.019432 Oct 04 22:01:51.546721 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1937/3898] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 22:01:51 2022] POST /compute/v2.1/servers/f0114867-7744-491d-8d32-f4481f86b17c/action => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:01:51.548734 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-570a5717-c09e-431a-853e-7e88aec61ba3 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:51.549527 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-570a5717-c09e-431a-853e-7e88aec61ba3 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: a4cf4fac-1e9b-4669-a6ff-30008ed3642d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:51.563580 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-570a5717-c09e-431a-853e-7e88aec61ba3 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:51.564357 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-570a5717-c09e-431a-853e-7e88aec61ba3 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:51.565128 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-570a5717-c09e-431a-853e-7e88aec61ba3 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:51.566102 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-570a5717-c09e-431a-853e-7e88aec61ba3 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:51.566752 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-570a5717-c09e-431a-853e-7e88aec61ba3 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:51.567337 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-570a5717-c09e-431a-853e-7e88aec61ba3 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:51.594915 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:01:51.754887 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-57b49b85-3f16-4e6f-91b0-1e7f52dd9358 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:51.756066 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-57b49b85-3f16-4e6f-91b0-1e7f52dd9358 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] [instance: 7285a94c-3dad-43f1-9052-63ccc9ac07ba] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:51.763287 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-57b49b85-3f16-4e6f-91b0-1e7f52dd9358 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:51.763784 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-57b49b85-3f16-4e6f-91b0-1e7f52dd9358 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:51.764226 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-57b49b85-3f16-4e6f-91b0-1e7f52dd9358 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:51.765091 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-57b49b85-3f16-4e6f-91b0-1e7f52dd9358 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:51.765557 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-57b49b85-3f16-4e6f-91b0-1e7f52dd9358 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:51.765985 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-57b49b85-3f16-4e6f-91b0-1e7f52dd9358 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:51.878671 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-570a5717-c09e-431a-853e-7e88aec61ba3 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2facee4c6a40416e908083e126d2cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07a17a482a4e92b6ddbdee463c8029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:51.900562 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-570a5717-c09e-431a-853e-7e88aec61ba3 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d" status: 200 len: 1504 microversion: 2.1 time: 0.355344 Oct 04 22:01:51.902692 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1962/3899] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:01:51 2022] GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d => generated 1504 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:01:51.908381 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-fe94540d-20cc-4254-8dca-b3f406482429 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:51.909652 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-fe94540d-20cc-4254-8dca-b3f406482429 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: f9376877-b87d-4738-b940-2bf314c83337] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:51.918880 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fe94540d-20cc-4254-8dca-b3f406482429 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:51.920077 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fe94540d-20cc-4254-8dca-b3f406482429 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:51.920743 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fe94540d-20cc-4254-8dca-b3f406482429 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:51.921676 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fe94540d-20cc-4254-8dca-b3f406482429 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:51.922583 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fe94540d-20cc-4254-8dca-b3f406482429 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:51.923479 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fe94540d-20cc-4254-8dca-b3f406482429 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:52.038392 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-fe94540d-20cc-4254-8dca-b3f406482429 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a1c8d841104bc9b6910bcc2c0e2bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe9283584fc4d90b0715216d867ea2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:52.049004 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-fe94540d-20cc-4254-8dca-b3f406482429 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "GET /compute/v2.1/servers/f9376877-b87d-4738-b940-2bf314c83337" status: 200 len: 1273 microversion: 2.1 time: 0.145077 Oct 04 22:01:52.049726 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1963/3900] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:01:51 2022] GET /compute/v2.1/servers/f9376877-b87d-4738-b940-2bf314c83337 => generated 1273 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:01:52.055318 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-72385ae0-3fe1-43ef-82e3-56b2d196ff32 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:52.056134 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-72385ae0-3fe1-43ef-82e3-56b2d196ff32 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: a4cf4fac-1e9b-4669-a6ff-30008ed3642d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:52.063406 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-72385ae0-3fe1-43ef-82e3-56b2d196ff32 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:52.064299 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-72385ae0-3fe1-43ef-82e3-56b2d196ff32 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:52.064905 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-72385ae0-3fe1-43ef-82e3-56b2d196ff32 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:52.065795 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-72385ae0-3fe1-43ef-82e3-56b2d196ff32 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:52.066487 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-72385ae0-3fe1-43ef-82e3-56b2d196ff32 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:52.067111 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-72385ae0-3fe1-43ef-82e3-56b2d196ff32 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:52.096554 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-57b49b85-3f16-4e6f-91b0-1e7f52dd9358 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3adbba85c5a448148833e69d6304e62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b710cb6300854d8683bd52ddf56b787d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:52.174422 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-57b49b85-3f16-4e6f-91b0-1e7f52dd9358 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3adbba85c5a448148833e69d6304e62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b710cb6300854d8683bd52ddf56b787d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:52.181725 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-57b49b85-3f16-4e6f-91b0-1e7f52dd9358 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3adbba85c5a448148833e69d6304e62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b710cb6300854d8683bd52ddf56b787d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:52.186701 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-57b49b85-3f16-4e6f-91b0-1e7f52dd9358 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] 10.222.0.43 "GET /compute/v2.1/servers/7285a94c-3dad-43f1-9052-63ccc9ac07ba" status: 200 len: 1362 microversion: 2.26 time: 0.435695 Oct 04 22:01:52.201182 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1938/3901] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:01:51 2022] GET /compute/v2.1/servers/7285a94c-3dad-43f1-9052-63ccc9ac07ba => generated 1362 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 22:01:52.216574 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-450c403f-60d0-4d55-991a-38dbda674760 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:52.217376 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-450c403f-60d0-4d55-991a-38dbda674760 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] [instance: d0b1b757-4a4d-4a7a-9a06-08f178a02984] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:52.241414 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-450c403f-60d0-4d55-991a-38dbda674760 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:52.242124 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-450c403f-60d0-4d55-991a-38dbda674760 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:52.242789 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-450c403f-60d0-4d55-991a-38dbda674760 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:52.243690 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-450c403f-60d0-4d55-991a-38dbda674760 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:52.244320 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-450c403f-60d0-4d55-991a-38dbda674760 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:52.250173 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-450c403f-60d0-4d55-991a-38dbda674760 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:52.384944 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-72385ae0-3fe1-43ef-82e3-56b2d196ff32 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2facee4c6a40416e908083e126d2cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07a17a482a4e92b6ddbdee463c8029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:52.404965 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-72385ae0-3fe1-43ef-82e3-56b2d196ff32 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d" status: 200 len: 1504 microversion: 2.1 time: 0.353931 Oct 04 22:01:52.406080 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1964/3902] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:01:52 2022] GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d => generated 1504 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:01:52.420864 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-450c403f-60d0-4d55-991a-38dbda674760 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:52.431002 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-a2c99fe6-2fd2-4c85-b250-6a5a63d4a7b6 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:01:52.431193 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-450c403f-60d0-4d55-991a-38dbda674760 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:52.432846 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-a2c99fe6-2fd2-4c85-b250-6a5a63d4a7b6 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: a4cf4fac-1e9b-4669-a6ff-30008ed3642d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:52.433694 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-450c403f-60d0-4d55-991a-38dbda674760 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4290d9955ab347e0b690dc553ffb2058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d4f33667e74aa49c99d4741c179240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:52.439434 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-450c403f-60d0-4d55-991a-38dbda674760 tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] 10.222.0.43 "GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984" status: 200 len: 1537 microversion: 2.91 time: 0.234963 Oct 04 22:01:52.440023 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1939/3903] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:01:52 2022] GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984 => generated 1537 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:01:52.441028 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a2c99fe6-2fd2-4c85-b250-6a5a63d4a7b6 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:52.442301 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a2c99fe6-2fd2-4c85-b250-6a5a63d4a7b6 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:52.443124 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a2c99fe6-2fd2-4c85-b250-6a5a63d4a7b6 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:52.444765 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a2c99fe6-2fd2-4c85-b250-6a5a63d4a7b6 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:52.445394 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a2c99fe6-2fd2-4c85-b250-6a5a63d4a7b6 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:52.445958 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a2c99fe6-2fd2-4c85-b250-6a5a63d4a7b6 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:52.486889 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-a2c99fe6-2fd2-4c85-b250-6a5a63d4a7b6 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] HTTP exception thrown: Cannot 'unshelve' instance a4cf4fac-1e9b-4669-a6ff-30008ed3642d while it is in vm_state active Oct 04 22:01:52.492766 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-2e5eb8b4-3c53-408a-a64b-cbdf0a6bbea6 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:52.494516 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-2e5eb8b4-3c53-408a-a64b-cbdf0a6bbea6 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] [instance: 3dbe541d-234a-4049-befd-dcd9a67dbd46] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:52.500957 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-a2c99fe6-2fd2-4c85-b250-6a5a63d4a7b6 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Request method failure captured: Oct 04 22:01:52.500957 n-d-860284-1 devstack@n-api.service[134102]: request: POST /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d/action HTTP/1.1 Oct 04 22:01:52.500957 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 22:01:52.500957 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 22:01:52.500957 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 22:01:52.500957 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 18 Oct 04 22:01:52.500957 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 22:01:52.500957 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 22:01:52.500957 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 22:01:52.500957 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 22:01:52.500957 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPKwu4cpW6hhBuWb-qV_7iYlwjOTpf5XWCl53BJjoosjlcj4wkmmOFzemCJVdBntIx8zJ1SF_z6VrRY8UJr7E8TQDJCRnVQMdNnh0-lZwGdqUzjOWSO31Ryb6n87Cka0g238a21JWok3h3GEhLB-7oCbN3bbcOGmkhd6UFueRxRluk24 Oct 04 22:01:52.500957 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 22:01:52.500957 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 22:01:52.500957 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 22:01:52.500957 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 22:01:52.500957 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 22:01:52.500957 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 22:01:52.500957 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: cf07a17a482a4e92b6ddbdee463c8029 Oct 04 22:01:52.500957 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-ServersNegativeTestJSON-1933663319 Oct 04 22:01:52.500957 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 22:01:52.500957 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 22:01:52.500957 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/cf07a17a482a4e92b6ddbdee463c8029"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_cf07a17a482a4e92b6ddbdee463c8029", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/cf07a17a482a4e92b6ddbdee463c8029"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/cf07a17a482a4e92b6ddbdee463c8029"}]}] Oct 04 22:01:52.500957 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-ServersNegativeTestJSON-1933663319 Oct 04 22:01:52.500957 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: cf07a17a482a4e92b6ddbdee463c8029 Oct 04 22:01:52.500957 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1933663319 Oct 04 22:01:52.500957 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-ServersNegativeTestJSON-1933663319-project Oct 04 22:01:52.500957 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 22:01:52.500957 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 22:01:52.500957 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: 2facee4c6a40416e908083e126d2cfa3 Oct 04 22:01:52.500957 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-ServersNegativeTestJSON-1933663319-project Oct 04 22:01:52.500957 n-d-860284-1 devstack@n-api.service[134102]: Oct 04 22:01:52.500957 n-d-860284-1 devstack@n-api.service[134102]: {"unshelve": null} Oct 04 22:01:52.500957 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 22:01:52.500957 n-d-860284-1 devstack@n-api.service[134102]: exception: Cannot 'unshelve' instance a4cf4fac-1e9b-4669-a6ff-30008ed3642d while it is in vm_state active Oct 04 22:01:52.500957 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': 'a4cf4fac-1e9b-4669-a6ff-30008ed3642d', 'body': {'unshelve': None}} Oct 04 22:01:52.500957 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:01:52.500957 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:01:52.500957 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 124, in _unshelve Oct 04 22:01:52.500957 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi self.compute_api.unshelve( Oct 04 22:01:52.500957 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 04 22:01:52.500957 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 22:01:52.500957 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 22:01:52.500957 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 22:01:52.500957 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 04 22:01:52.500957 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 04 22:01:52.500957 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance a4cf4fac-1e9b-4669-a6ff-30008ed3642d in vm_state active. Cannot unshelve while the instance is in this state. Oct 04 22:01:52.500957 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:01:52.500957 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:01:52.500957 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:01:52.500957 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:01:52.500957 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:01:52.500957 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:01:52.500957 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:01:52.500957 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:01:52.500957 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:01:52.500957 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:01:52.500957 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 22:01:52.500957 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 22:01:52.500957 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 22:01:52.500957 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 22:01:52.500957 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 137, in _unshelve Oct 04 22:01:52.500957 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Oct 04 22:01:52.500957 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 04 22:01:52.500957 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 22:01:52.503882 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unshelve' instance a4cf4fac-1e9b-4669-a6ff-30008ed3642d while it is in vm_state active Oct 04 22:01:52.503882 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:01:52.503882 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:01:52.503882 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:01:52.503882 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:01:52.503882 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:01:52.503882 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:01:52.503882 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:01:52.503882 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:01:52.503882 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unshelve' instance a4cf4fac-1e9b-4669-a6ff-30008ed3642d while it is in vm_state active Oct 04 22:01:52.503882 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:01:52.503882 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-a2c99fe6-2fd2-4c85-b250-6a5a63d4a7b6 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Returning 409 to user: Cannot 'unshelve' instance a4cf4fac-1e9b-4669-a6ff-30008ed3642d while it is in vm_state active {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:01:52.506448 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-a2c99fe6-2fd2-4c85-b250-6a5a63d4a7b6 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "POST /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d/action" status: 409 len: 146 microversion: 2.1 time: 0.077242 Oct 04 22:01:52.509565 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1965/3904] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 22:01:52 2022] POST /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d/action => generated 146 bytes in 85 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 04 22:01:52.513675 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2e5eb8b4-3c53-408a-a64b-cbdf0a6bbea6 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:52.514608 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2e5eb8b4-3c53-408a-a64b-cbdf0a6bbea6 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:52.517152 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2e5eb8b4-3c53-408a-a64b-cbdf0a6bbea6 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:52.518228 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2e5eb8b4-3c53-408a-a64b-cbdf0a6bbea6 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:52.518925 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2e5eb8b4-3c53-408a-a64b-cbdf0a6bbea6 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:52.519596 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2e5eb8b4-3c53-408a-a64b-cbdf0a6bbea6 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:52.520998 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-ac53f19d-6868-4748-8b79-93ba8744d9f8 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:52.521862 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-ac53f19d-6868-4748-8b79-93ba8744d9f8 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: a4cf4fac-1e9b-4669-a6ff-30008ed3642d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:52.548502 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ac53f19d-6868-4748-8b79-93ba8744d9f8 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:52.549280 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ac53f19d-6868-4748-8b79-93ba8744d9f8 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:52.549864 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ac53f19d-6868-4748-8b79-93ba8744d9f8 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:52.550764 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ac53f19d-6868-4748-8b79-93ba8744d9f8 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:52.551376 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ac53f19d-6868-4748-8b79-93ba8744d9f8 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:52.551961 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ac53f19d-6868-4748-8b79-93ba8744d9f8 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:52.973950 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-2e5eb8b4-3c53-408a-a64b-cbdf0a6bbea6 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2034fc9060874868bc5d27370a1c351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89499d833a4a00805164f4f79ed522', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:52.987006 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-2e5eb8b4-3c53-408a-a64b-cbdf0a6bbea6 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] 10.222.0.43 "GET /compute/v2.1/servers/3dbe541d-234a-4049-befd-dcd9a67dbd46" status: 200 len: 1516 microversion: 2.1 time: 0.503045 Oct 04 22:01:52.992664 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-ac53f19d-6868-4748-8b79-93ba8744d9f8 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2facee4c6a40416e908083e126d2cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07a17a482a4e92b6ddbdee463c8029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:53.000873 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1940/3905] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:01:52 2022] GET /compute/v2.1/servers/3dbe541d-234a-4049-befd-dcd9a67dbd46 => generated 1516 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:01:53.003354 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-ac53f19d-6868-4748-8b79-93ba8744d9f8 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d" status: 200 len: 1504 microversion: 2.1 time: 0.488809 Oct 04 22:01:53.003945 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1966/3906] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:01:52 2022] GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d => generated 1504 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:01:53.037026 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-4df7d7f8-1bf3-4f2a-9b52-5150748ef621 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:53.042521 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-4df7d7f8-1bf3-4f2a-9b52-5150748ef621 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: a4cf4fac-1e9b-4669-a6ff-30008ed3642d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:53.062928 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4df7d7f8-1bf3-4f2a-9b52-5150748ef621 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:53.063401 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4df7d7f8-1bf3-4f2a-9b52-5150748ef621 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:53.063841 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4df7d7f8-1bf3-4f2a-9b52-5150748ef621 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:53.064563 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4df7d7f8-1bf3-4f2a-9b52-5150748ef621 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:53.065020 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4df7d7f8-1bf3-4f2a-9b52-5150748ef621 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:53.065453 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4df7d7f8-1bf3-4f2a-9b52-5150748ef621 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:53.077590 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-59201506-7035-4b8a-b4ed-547c430135d4 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:53.078228 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-59201506-7035-4b8a-b4ed-547c430135d4 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: f9376877-b87d-4738-b940-2bf314c83337] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:53.104797 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-59201506-7035-4b8a-b4ed-547c430135d4 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:53.105305 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-59201506-7035-4b8a-b4ed-547c430135d4 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:53.105758 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-59201506-7035-4b8a-b4ed-547c430135d4 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:53.106518 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-59201506-7035-4b8a-b4ed-547c430135d4 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:53.106984 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-59201506-7035-4b8a-b4ed-547c430135d4 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:53.107414 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-59201506-7035-4b8a-b4ed-547c430135d4 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:53.403899 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-59201506-7035-4b8a-b4ed-547c430135d4 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a1c8d841104bc9b6910bcc2c0e2bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe9283584fc4d90b0715216d867ea2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:53.413786 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-59201506-7035-4b8a-b4ed-547c430135d4 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "GET /compute/v2.1/servers/f9376877-b87d-4738-b940-2bf314c83337" status: 200 len: 1315 microversion: 2.1 time: 0.342323 Oct 04 22:01:53.415040 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1967/3907] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:01:53 2022] GET /compute/v2.1/servers/f9376877-b87d-4738-b940-2bf314c83337 => generated 1315 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:01:53.422293 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-6d86995a-dee0-416c-8c80-34324551a740 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:53.423001 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-6d86995a-dee0-416c-8c80-34324551a740 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] [instance: 7285a94c-3dad-43f1-9052-63ccc9ac07ba] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:53.434431 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-4df7d7f8-1bf3-4f2a-9b52-5150748ef621 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2facee4c6a40416e908083e126d2cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07a17a482a4e92b6ddbdee463c8029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:53.442216 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6d86995a-dee0-416c-8c80-34324551a740 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:53.442724 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6d86995a-dee0-416c-8c80-34324551a740 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:53.446202 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-4df7d7f8-1bf3-4f2a-9b52-5150748ef621 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d" status: 200 len: 1504 microversion: 2.1 time: 0.417106 Oct 04 22:01:53.455409 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6d86995a-dee0-416c-8c80-34324551a740 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:53.456790 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6d86995a-dee0-416c-8c80-34324551a740 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:53.456790 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6d86995a-dee0-416c-8c80-34324551a740 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:53.468417 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1941/3908] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:01:53 2022] GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d => generated 1504 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:01:53.469420 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6d86995a-dee0-416c-8c80-34324551a740 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:53.481937 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-9644d865-c1dd-4889-bfe5-66beef85786b tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:53.484007 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-9644d865-c1dd-4889-bfe5-66beef85786b tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] [instance: d0b1b757-4a4d-4a7a-9a06-08f178a02984] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:53.498871 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9644d865-c1dd-4889-bfe5-66beef85786b tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:53.499377 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9644d865-c1dd-4889-bfe5-66beef85786b tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:53.499825 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9644d865-c1dd-4889-bfe5-66beef85786b tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:53.500554 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9644d865-c1dd-4889-bfe5-66beef85786b tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:53.501013 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9644d865-c1dd-4889-bfe5-66beef85786b tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:53.501450 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9644d865-c1dd-4889-bfe5-66beef85786b tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:53.535615 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-9644d865-c1dd-4889-bfe5-66beef85786b tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] HTTP exception thrown: Instance d0b1b757-4a4d-4a7a-9a06-08f178a02984 could not be found. Oct 04 22:01:53.538880 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-9644d865-c1dd-4889-bfe5-66beef85786b tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Request method failure captured: Oct 04 22:01:53.538880 n-d-860284-1 devstack@n-api.service[134101]: request: GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984 HTTP/1.1 Oct 04 22:01:53.538880 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 22:01:53.538880 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 22:01:53.538880 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 22:01:53.538880 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 22:01:53.538880 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 22:01:53.538880 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 22:01:53.538880 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 22:01:53.538880 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 22:01:53.538880 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPKxmnbA8vAbkLEPspobL90DFmoxHo76MOqYIsH4tH7X_nu8rAnzFUwXLF3U8aBioyefF9iMZFH1CMau-JShckZEwioMiB3_a5OMSRjvGT2nJ1CLdS_PBCDf8H6CTKPRNTJq3Qgj0WxXgUvjZFItwVWOlGSgdlXVYRVYz7sXbDtQmEIA Oct 04 22:01:53.538880 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 22:01:53.538880 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 22:01:53.538880 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 22:01:53.538880 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 22:01:53.538880 n-d-860284-1 devstack@n-api.service[134101]: X-Openstack-Nova-Api-Version: 2.91 Oct 04 22:01:53.538880 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 22:01:53.538880 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 22:01:53.538880 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: f2d4f33667e74aa49c99d4741c179240 Oct 04 22:01:53.538880 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-UnshelveToHostMultiNodesTest-1777935353 Oct 04 22:01:53.538880 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 22:01:53.538880 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 22:01:53.538880 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f2d4f33667e74aa49c99d4741c179240"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_f2d4f33667e74aa49c99d4741c179240", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f2d4f33667e74aa49c99d4741c179240"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/f2d4f33667e74aa49c99d4741c179240"}]}] Oct 04 22:01:53.538880 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-UnshelveToHostMultiNodesTest-1777935353 Oct 04 22:01:53.538880 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: f2d4f33667e74aa49c99d4741c179240 Oct 04 22:01:53.538880 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-UnshelveToHostMultiNodesTest-1777935353 Oct 04 22:01:53.538880 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-UnshelveToHostMultiNodesTest-1777935353-project Oct 04 22:01:53.538880 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 22:01:53.538880 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 22:01:53.538880 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 4290d9955ab347e0b690dc553ffb2058 Oct 04 22:01:53.538880 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-UnshelveToHostMultiNodesTest-1777935353-project Oct 04 22:01:53.538880 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 22:01:53.538880 n-d-860284-1 devstack@n-api.service[134101]: exception: Instance d0b1b757-4a4d-4a7a-9a06-08f178a02984 could not be found. Oct 04 22:01:53.538880 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': 'd0b1b757-4a4d-4a7a-9a06-08f178a02984'} Oct 04 22:01:53.538880 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:01:53.538880 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:01:53.538880 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:01:53.538880 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:01:53.538880 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:01:53.538880 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:01:53.538880 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:01:53.538880 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:01:53.538880 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:01:53.538880 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:01:53.538880 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0b1b757-4a4d-4a7a-9a06-08f178a02984 could not be found. Oct 04 22:01:53.538880 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:01:53.538880 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:01:53.538880 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:01:53.538880 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:01:53.538880 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:01:53.538880 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:01:53.538880 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:01:53.538880 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:01:53.538880 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:01:53.538880 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:01:53.538880 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:01:53.538880 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:01:53.538880 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:01:53.538880 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:01:53.538880 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:01:53.538880 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:01:53.538880 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0b1b757-4a4d-4a7a-9a06-08f178a02984 could not be found. Oct 04 22:01:53.538880 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:01:53.546636 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:01:53.546636 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:01:53.546636 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:01:53.546636 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:01:53.546636 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:01:53.546636 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:01:53.546636 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:01:53.546636 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0b1b757-4a4d-4a7a-9a06-08f178a02984 could not be found. Oct 04 22:01:53.546636 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:01:53.546636 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-9644d865-c1dd-4889-bfe5-66beef85786b tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] Returning 404 to user: Instance d0b1b757-4a4d-4a7a-9a06-08f178a02984 could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:01:53.546636 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-9644d865-c1dd-4889-bfe5-66beef85786b tempest-UnshelveToHostMultiNodesTest-1777935353 tempest-UnshelveToHostMultiNodesTest-1777935353-project] 10.222.0.43 "GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984" status: 404 len: 111 microversion: 2.91 time: 0.070592 Oct 04 22:01:53.546636 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1942/3909] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:01:53 2022] GET /compute/v2.1/servers/d0b1b757-4a4d-4a7a-9a06-08f178a02984 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 22:01:53.562153 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-221fb1c1-a999-42d9-b032-50a1c7021c04 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-78767476_updated"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:01:53.566456 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-221fb1c1-a999-42d9-b032-50a1c7021c04 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: 480e77da-f4b7-4d24-89e3-6f79d6d8c7d2] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:53.576650 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-221fb1c1-a999-42d9-b032-50a1c7021c04 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] HTTP exception thrown: Instance 480e77da-f4b7-4d24-89e3-6f79d6d8c7d2 could not be found. Oct 04 22:01:53.580475 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-221fb1c1-a999-42d9-b032-50a1c7021c04 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Request method failure captured: Oct 04 22:01:53.580475 n-d-860284-1 devstack@n-api.service[134101]: request: PUT /compute/v2.1/servers/480e77da-f4b7-4d24-89e3-6f79d6d8c7d2 HTTP/1.1 Oct 04 22:01:53.580475 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 22:01:53.580475 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 22:01:53.580475 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 22:01:53.580475 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 79 Oct 04 22:01:53.580475 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 22:01:53.580475 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 22:01:53.580475 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 22:01:53.580475 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 22:01:53.580475 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPKwu4cpW6hhBuWb-qV_7iYlwjOTpf5XWCl53BJjoosjlcj4wkmmOFzemCJVdBntIx8zJ1SF_z6VrRY8UJr7E8TQDJCRnVQMdNnh0-lZwGdqUzjOWSO31Ryb6n87Cka0g238a21JWok3h3GEhLB-7oCbN3bbcOGmkhd6UFueRxRluk24 Oct 04 22:01:53.580475 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 22:01:53.580475 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 22:01:53.580475 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 22:01:53.580475 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 22:01:53.580475 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 22:01:53.580475 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 22:01:53.580475 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: cf07a17a482a4e92b6ddbdee463c8029 Oct 04 22:01:53.580475 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-ServersNegativeTestJSON-1933663319 Oct 04 22:01:53.580475 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 22:01:53.580475 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 22:01:53.580475 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/cf07a17a482a4e92b6ddbdee463c8029"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_cf07a17a482a4e92b6ddbdee463c8029", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/cf07a17a482a4e92b6ddbdee463c8029"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/cf07a17a482a4e92b6ddbdee463c8029"}]}] Oct 04 22:01:53.580475 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-ServersNegativeTestJSON-1933663319 Oct 04 22:01:53.580475 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: cf07a17a482a4e92b6ddbdee463c8029 Oct 04 22:01:53.580475 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1933663319 Oct 04 22:01:53.580475 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-ServersNegativeTestJSON-1933663319-project Oct 04 22:01:53.580475 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 22:01:53.580475 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 22:01:53.580475 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 2facee4c6a40416e908083e126d2cfa3 Oct 04 22:01:53.580475 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-ServersNegativeTestJSON-1933663319-project Oct 04 22:01:53.580475 n-d-860284-1 devstack@n-api.service[134101]: Oct 04 22:01:53.580475 n-d-860284-1 devstack@n-api.service[134101]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-78767476_updated"}} Oct 04 22:01:53.580475 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 22:01:53.580475 n-d-860284-1 devstack@n-api.service[134101]: exception: Instance 480e77da-f4b7-4d24-89e3-6f79d6d8c7d2 could not be found. Oct 04 22:01:53.580475 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': '480e77da-f4b7-4d24-89e3-6f79d6d8c7d2', 'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-78767476_updated'}}} Oct 04 22:01:53.580475 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:01:53.580475 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:01:53.580475 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:01:53.580475 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:01:53.580475 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:01:53.580475 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:01:53.580475 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 22:01:53.580475 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 22:01:53.580475 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 480e77da-f4b7-4d24-89e3-6f79d6d8c7d2 could not be found. Oct 04 22:01:53.580475 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:01:53.580475 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:01:53.580475 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:01:53.580475 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:01:53.580475 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:01:53.580475 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:01:53.580475 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:01:53.580475 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:01:53.580475 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:01:53.580475 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:01:53.580475 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 22:01:53.580475 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 22:01:53.580475 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 22:01:53.580475 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 22:01:53.580475 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 22:01:53.580475 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 22:01:53.580475 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 04 22:01:53.580475 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Oct 04 22:01:53.580475 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Oct 04 22:01:53.580475 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:01:53.585709 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:01:53.585709 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:01:53.585709 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:01:53.585709 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 480e77da-f4b7-4d24-89e3-6f79d6d8c7d2 could not be found. Oct 04 22:01:53.585709 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:01:53.585709 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:01:53.585709 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:01:53.585709 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:01:53.585709 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:01:53.585709 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:01:53.585709 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:01:53.585709 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:01:53.585709 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 480e77da-f4b7-4d24-89e3-6f79d6d8c7d2 could not be found. Oct 04 22:01:53.585709 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:01:53.585709 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-221fb1c1-a999-42d9-b032-50a1c7021c04 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Returning 404 to user: Instance 480e77da-f4b7-4d24-89e3-6f79d6d8c7d2 could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:01:53.585709 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-221fb1c1-a999-42d9-b032-50a1c7021c04 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "PUT /compute/v2.1/servers/480e77da-f4b7-4d24-89e3-6f79d6d8c7d2" status: 404 len: 111 microversion: 2.1 time: 0.028777 Oct 04 22:01:53.585709 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1943/3910] 10.222.0.43 () {60 vars in 1256 bytes} [Tue Oct 4 22:01:53 2022] PUT /compute/v2.1/servers/480e77da-f4b7-4d24-89e3-6f79d6d8c7d2 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:01:53.595553 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-fcc8f2ae-4a85-4c46-b754-e4dca207e70b tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:53.596402 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-fcc8f2ae-4a85-4c46-b754-e4dca207e70b tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: a4cf4fac-1e9b-4669-a6ff-30008ed3642d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:53.604211 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fcc8f2ae-4a85-4c46-b754-e4dca207e70b tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:53.604779 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fcc8f2ae-4a85-4c46-b754-e4dca207e70b tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:53.605232 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fcc8f2ae-4a85-4c46-b754-e4dca207e70b tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:53.605951 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fcc8f2ae-4a85-4c46-b754-e4dca207e70b tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:53.606538 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fcc8f2ae-4a85-4c46-b754-e4dca207e70b tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:53.607198 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fcc8f2ae-4a85-4c46-b754-e4dca207e70b tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:53.813627 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-6d86995a-dee0-416c-8c80-34324551a740 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3adbba85c5a448148833e69d6304e62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b710cb6300854d8683bd52ddf56b787d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:53.823584 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-6d86995a-dee0-416c-8c80-34324551a740 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3adbba85c5a448148833e69d6304e62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b710cb6300854d8683bd52ddf56b787d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:53.825254 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-6d86995a-dee0-416c-8c80-34324551a740 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3adbba85c5a448148833e69d6304e62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b710cb6300854d8683bd52ddf56b787d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:53.826654 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-6d86995a-dee0-416c-8c80-34324551a740 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] 10.222.0.43 "GET /compute/v2.1/servers/7285a94c-3dad-43f1-9052-63ccc9ac07ba" status: 200 len: 1362 microversion: 2.26 time: 0.410602 Oct 04 22:01:53.827229 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1968/3911] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:01:53 2022] GET /compute/v2.1/servers/7285a94c-3dad-43f1-9052-63ccc9ac07ba => generated 1362 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:01:53.875722 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-fcc8f2ae-4a85-4c46-b754-e4dca207e70b tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2facee4c6a40416e908083e126d2cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07a17a482a4e92b6ddbdee463c8029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:53.886272 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-fcc8f2ae-4a85-4c46-b754-e4dca207e70b tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d" status: 200 len: 1504 microversion: 2.1 time: 0.295114 Oct 04 22:01:53.887350 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1944/3912] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:01:53 2022] GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d => generated 1504 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:01:53.921739 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-1d138522-3df5-47b5-a0e2-ee9b469eecdc tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:53.923615 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-1d138522-3df5-47b5-a0e2-ee9b469eecdc tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: a4cf4fac-1e9b-4669-a6ff-30008ed3642d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:53.936002 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1d138522-3df5-47b5-a0e2-ee9b469eecdc tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:53.936748 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1d138522-3df5-47b5-a0e2-ee9b469eecdc tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:53.937419 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1d138522-3df5-47b5-a0e2-ee9b469eecdc tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:53.938277 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1d138522-3df5-47b5-a0e2-ee9b469eecdc tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:53.938903 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1d138522-3df5-47b5-a0e2-ee9b469eecdc tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:53.939602 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1d138522-3df5-47b5-a0e2-ee9b469eecdc tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:53.991810 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-82a4b2a0-2ba8-43e3-8938-b0a29880fe66 req-663e7433-e0dc-4b43-8d04-9822900b12b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f9376877-b87d-4738-b940-2bf314c83337", "tag": "c1424a9c-7ef8-4143-88f4-7519c96678b1"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:01:54.025266 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-82a4b2a0-2ba8-43e3-8938-b0a29880fe66 req-663e7433-e0dc-4b43-8d04-9822900b12b4 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:54.026797 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-82a4b2a0-2ba8-43e3-8938-b0a29880fe66 req-663e7433-e0dc-4b43-8d04-9822900b12b4 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:54.027588 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-82a4b2a0-2ba8-43e3-8938-b0a29880fe66 req-663e7433-e0dc-4b43-8d04-9822900b12b4 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:54.050857 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-82a4b2a0-2ba8-43e3-8938-b0a29880fe66 req-663e7433-e0dc-4b43-8d04-9822900b12b4 service nova] Creating event network-changed:c1424a9c-7ef8-4143-88f4-7519c96678b1 for instance f9376877-b87d-4738-b940-2bf314c83337 on n-h1-860284-1 Oct 04 22:01:54.063565 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-82a4b2a0-2ba8-43e3-8938-b0a29880fe66 req-663e7433-e0dc-4b43-8d04-9822900b12b4 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075370 Oct 04 22:01:54.064741 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1945/3913] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:01:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:01:54.070400 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-1d3c6e3c-ca89-4a54-97b9-34eaf6260cb4 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:54.071316 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-1d3c6e3c-ca89-4a54-97b9-34eaf6260cb4 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] [instance: 3dbe541d-234a-4049-befd-dcd9a67dbd46] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:54.080128 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1d3c6e3c-ca89-4a54-97b9-34eaf6260cb4 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:54.080774 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1d3c6e3c-ca89-4a54-97b9-34eaf6260cb4 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:54.081358 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1d3c6e3c-ca89-4a54-97b9-34eaf6260cb4 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:54.082209 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1d3c6e3c-ca89-4a54-97b9-34eaf6260cb4 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:54.082824 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1d3c6e3c-ca89-4a54-97b9-34eaf6260cb4 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:54.083392 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1d3c6e3c-ca89-4a54-97b9-34eaf6260cb4 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:54.324406 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-1d138522-3df5-47b5-a0e2-ee9b469eecdc tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2facee4c6a40416e908083e126d2cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07a17a482a4e92b6ddbdee463c8029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:54.335573 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-1d138522-3df5-47b5-a0e2-ee9b469eecdc tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d" status: 200 len: 1504 microversion: 2.1 time: 0.427230 Oct 04 22:01:54.348046 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1969/3914] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:01:53 2022] GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d => generated 1504 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:01:54.360893 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-63a1ccd5-bb65-4446-90be-b8c7187837b1 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:01:54.365936 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-63a1ccd5-bb65-4446-90be-b8c7187837b1 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Request method failure captured: Oct 04 22:01:54.365936 n-d-860284-1 devstack@n-api.service[134102]: request: PUT /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d HTTP/1.1 Oct 04 22:01:54.365936 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 22:01:54.365936 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 22:01:54.365936 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 22:01:54.365936 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 280 Oct 04 22:01:54.365936 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 22:01:54.365936 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 22:01:54.365936 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 22:01:54.365936 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 22:01:54.365936 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPKwu4cpW6hhBuWb-qV_7iYlwjOTpf5XWCl53BJjoosjlcj4wkmmOFzemCJVdBntIx8zJ1SF_z6VrRY8UJr7E8TQDJCRnVQMdNnh0-lZwGdqUzjOWSO31Ryb6n87Cka0g238a21JWok3h3GEhLB-7oCbN3bbcOGmkhd6UFueRxRluk24 Oct 04 22:01:54.365936 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 22:01:54.365936 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 22:01:54.365936 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 22:01:54.365936 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 22:01:54.365936 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 22:01:54.365936 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 22:01:54.365936 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: cf07a17a482a4e92b6ddbdee463c8029 Oct 04 22:01:54.365936 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-ServersNegativeTestJSON-1933663319 Oct 04 22:01:54.365936 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 22:01:54.365936 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 22:01:54.365936 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/cf07a17a482a4e92b6ddbdee463c8029"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_cf07a17a482a4e92b6ddbdee463c8029", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/cf07a17a482a4e92b6ddbdee463c8029"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/cf07a17a482a4e92b6ddbdee463c8029"}]}] Oct 04 22:01:54.365936 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-ServersNegativeTestJSON-1933663319 Oct 04 22:01:54.365936 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: cf07a17a482a4e92b6ddbdee463c8029 Oct 04 22:01:54.365936 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1933663319 Oct 04 22:01:54.365936 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-ServersNegativeTestJSON-1933663319-project Oct 04 22:01:54.365936 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 22:01:54.365936 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 22:01:54.365936 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: 2facee4c6a40416e908083e126d2cfa3 Oct 04 22:01:54.365936 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-ServersNegativeTestJSON-1933663319-project Oct 04 22:01:54.365936 n-d-860284-1 devstack@n-api.service[134102]: Oct 04 22:01:54.365936 n-d-860284-1 devstack@n-api.service[134102]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 04 22:01:54.365936 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 22:01:54.365936 n-d-860284-1 devstack@n-api.service[134102]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 22:01:54.365936 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': 'a4cf4fac-1e9b-4669-a6ff-30008ed3642d', 'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 04 22:01:54.365936 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:01:54.365936 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:01:54.365936 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 22:01:54.365936 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 22:01:54.365936 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 22:01:54.365936 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise error Oct 04 22:01:54.365936 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 22:01:54.365936 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:01:54.365936 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Oct 04 22:01:54.365936 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 04 22:01:54.365936 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:01:54.365936 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 22:01:54.365936 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 04 22:01:54.365936 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:01:54.365936 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:01:54.365936 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:01:54.365936 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:01:54.368705 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:01:54.368705 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:01:54.368705 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:01:54.368705 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:01:54.368705 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:01:54.368705 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:01:54.368705 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 22:01:54.368705 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 22:01:54.368705 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 22:01:54.368705 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 22:01:54.368705 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 22:01:54.368705 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 22:01:54.368705 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 22:01:54.368705 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 22:01:54.368705 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 22:01:54.368705 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:01:54.368705 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:01:54.368705 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:01:54.368705 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:01:54.368705 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:01:54.368705 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:01:54.368705 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 22:01:54.368705 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 22:01:54.368705 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 22:01:54.368705 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:01:54.371629 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-63a1ccd5-bb65-4446-90be-b8c7187837b1 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:01:54.372637 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-63a1ccd5-bb65-4446-90be-b8c7187837b1 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "PUT /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d" status: 400 len: 619 microversion: 2.1 time: 0.016492 Oct 04 22:01:54.373397 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1970/3915] 10.222.0.43 () {60 vars in 1257 bytes} [Tue Oct 4 22:01:54 2022] PUT /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d => generated 619 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 22:01:54.377762 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-1d3c6e3c-ca89-4a54-97b9-34eaf6260cb4 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2034fc9060874868bc5d27370a1c351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89499d833a4a00805164f4f79ed522', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:54.383373 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-6c2853c5-8735-4ae9-bfa4-cf2a8b353123 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:54.384468 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-6c2853c5-8735-4ae9-bfa4-cf2a8b353123 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: a4cf4fac-1e9b-4669-a6ff-30008ed3642d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:54.386489 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-1d3c6e3c-ca89-4a54-97b9-34eaf6260cb4 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] 10.222.0.43 "GET /compute/v2.1/servers/3dbe541d-234a-4049-befd-dcd9a67dbd46" status: 200 len: 1516 microversion: 2.1 time: 0.320411 Oct 04 22:01:54.388845 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1946/3916] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:01:54 2022] GET /compute/v2.1/servers/3dbe541d-234a-4049-befd-dcd9a67dbd46 => generated 1516 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:01:54.392946 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6c2853c5-8735-4ae9-bfa4-cf2a8b353123 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:54.393611 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6c2853c5-8735-4ae9-bfa4-cf2a8b353123 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:54.394527 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6c2853c5-8735-4ae9-bfa4-cf2a8b353123 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:54.395161 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6c2853c5-8735-4ae9-bfa4-cf2a8b353123 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:54.395808 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6c2853c5-8735-4ae9-bfa4-cf2a8b353123 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:54.396381 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6c2853c5-8735-4ae9-bfa4-cf2a8b353123 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:54.455908 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-304d72f8-474b-4c7c-919b-6ae027132f16 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:54.456897 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-304d72f8-474b-4c7c-919b-6ae027132f16 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: f9376877-b87d-4738-b940-2bf314c83337] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:54.469862 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-304d72f8-474b-4c7c-919b-6ae027132f16 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:54.470386 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-304d72f8-474b-4c7c-919b-6ae027132f16 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:54.470891 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-304d72f8-474b-4c7c-919b-6ae027132f16 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:54.471959 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-304d72f8-474b-4c7c-919b-6ae027132f16 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:54.472440 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-304d72f8-474b-4c7c-919b-6ae027132f16 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:54.472926 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-304d72f8-474b-4c7c-919b-6ae027132f16 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:54.787215 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-6c2853c5-8735-4ae9-bfa4-cf2a8b353123 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2facee4c6a40416e908083e126d2cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07a17a482a4e92b6ddbdee463c8029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:54.800483 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-6c2853c5-8735-4ae9-bfa4-cf2a8b353123 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d" status: 200 len: 1504 microversion: 2.1 time: 0.422288 Oct 04 22:01:54.801317 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1971/3917] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:01:54 2022] GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d => generated 1504 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:01:54.832280 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-d07dabec-311c-47f6-8152-23364bbeee62 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:54.833485 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-d07dabec-311c-47f6-8152-23364bbeee62 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: a4cf4fac-1e9b-4669-a6ff-30008ed3642d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:54.841621 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-304d72f8-474b-4c7c-919b-6ae027132f16 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a1c8d841104bc9b6910bcc2c0e2bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe9283584fc4d90b0715216d867ea2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:54.851916 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d07dabec-311c-47f6-8152-23364bbeee62 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:54.852737 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d07dabec-311c-47f6-8152-23364bbeee62 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:54.853382 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d07dabec-311c-47f6-8152-23364bbeee62 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:54.854889 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-304d72f8-474b-4c7c-919b-6ae027132f16 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "GET /compute/v2.1/servers/f9376877-b87d-4738-b940-2bf314c83337" status: 200 len: 1315 microversion: 2.1 time: 0.402524 Oct 04 22:01:54.858726 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d07dabec-311c-47f6-8152-23364bbeee62 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:54.859615 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d07dabec-311c-47f6-8152-23364bbeee62 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:54.860282 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d07dabec-311c-47f6-8152-23364bbeee62 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:54.868007 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1947/3918] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:01:54 2022] GET /compute/v2.1/servers/f9376877-b87d-4738-b940-2bf314c83337 => generated 1315 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:01:54.880215 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-7a61e29e-066c-4e5a-bdd7-ff5b9a7bdf55 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:54.881056 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-7a61e29e-066c-4e5a-bdd7-ff5b9a7bdf55 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] [instance: 7285a94c-3dad-43f1-9052-63ccc9ac07ba] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:54.888232 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7a61e29e-066c-4e5a-bdd7-ff5b9a7bdf55 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:54.888942 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7a61e29e-066c-4e5a-bdd7-ff5b9a7bdf55 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:54.889645 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7a61e29e-066c-4e5a-bdd7-ff5b9a7bdf55 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:54.890649 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7a61e29e-066c-4e5a-bdd7-ff5b9a7bdf55 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:54.891259 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7a61e29e-066c-4e5a-bdd7-ff5b9a7bdf55 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:54.892406 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7a61e29e-066c-4e5a-bdd7-ff5b9a7bdf55 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:55.168850 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-d07dabec-311c-47f6-8152-23364bbeee62 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2facee4c6a40416e908083e126d2cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07a17a482a4e92b6ddbdee463c8029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:55.183447 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-d07dabec-311c-47f6-8152-23364bbeee62 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d" status: 200 len: 1504 microversion: 2.1 time: 0.355042 Oct 04 22:01:55.184545 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1972/3919] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:01:54 2022] GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d => generated 1504 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:01:55.193469 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-7a61e29e-066c-4e5a-bdd7-ff5b9a7bdf55 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3adbba85c5a448148833e69d6304e62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b710cb6300854d8683bd52ddf56b787d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:55.204613 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-7a61e29e-066c-4e5a-bdd7-ff5b9a7bdf55 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3adbba85c5a448148833e69d6304e62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b710cb6300854d8683bd52ddf56b787d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:55.209331 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-0ef6987c-a16b-41b0-a240-f82e8e468745 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:01:55.214686 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-0ef6987c-a16b-41b0-a240-f82e8e468745 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Request method failure captured: Oct 04 22:01:55.214686 n-d-860284-1 devstack@n-api.service[134102]: request: PUT /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d HTTP/1.1 Oct 04 22:01:55.214686 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 22:01:55.214686 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 22:01:55.214686 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 22:01:55.214686 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 24 Oct 04 22:01:55.214686 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 22:01:55.214686 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 22:01:55.214686 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 22:01:55.214686 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 22:01:55.214686 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPKwu4cpW6hhBuWb-qV_7iYlwjOTpf5XWCl53BJjoosjlcj4wkmmOFzemCJVdBntIx8zJ1SF_z6VrRY8UJr7E8TQDJCRnVQMdNnh0-lZwGdqUzjOWSO31Ryb6n87Cka0g238a21JWok3h3GEhLB-7oCbN3bbcOGmkhd6UFueRxRluk24 Oct 04 22:01:55.214686 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 22:01:55.214686 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 22:01:55.214686 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 22:01:55.214686 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 22:01:55.214686 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 22:01:55.214686 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 22:01:55.214686 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: cf07a17a482a4e92b6ddbdee463c8029 Oct 04 22:01:55.214686 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-ServersNegativeTestJSON-1933663319 Oct 04 22:01:55.214686 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 22:01:55.214686 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 22:01:55.214686 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/cf07a17a482a4e92b6ddbdee463c8029"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_cf07a17a482a4e92b6ddbdee463c8029", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/cf07a17a482a4e92b6ddbdee463c8029"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/cf07a17a482a4e92b6ddbdee463c8029"}]}] Oct 04 22:01:55.214686 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-ServersNegativeTestJSON-1933663319 Oct 04 22:01:55.214686 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: cf07a17a482a4e92b6ddbdee463c8029 Oct 04 22:01:55.214686 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1933663319 Oct 04 22:01:55.214686 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-ServersNegativeTestJSON-1933663319-project Oct 04 22:01:55.214686 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 22:01:55.214686 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 22:01:55.214686 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: 2facee4c6a40416e908083e126d2cfa3 Oct 04 22:01:55.214686 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-ServersNegativeTestJSON-1933663319-project Oct 04 22:01:55.214686 n-d-860284-1 devstack@n-api.service[134102]: Oct 04 22:01:55.214686 n-d-860284-1 devstack@n-api.service[134102]: {"server": {"name": ""}} Oct 04 22:01:55.214686 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 22:01:55.214686 n-d-860284-1 devstack@n-api.service[134102]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 04 22:01:55.214686 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': 'a4cf4fac-1e9b-4669-a6ff-30008ed3642d', 'body': {'server': {'name': ''}}} Oct 04 22:01:55.214686 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:01:55.214686 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:01:55.214686 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 22:01:55.214686 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 22:01:55.214686 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 22:01:55.214686 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise error Oct 04 22:01:55.214686 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 04 22:01:55.214686 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:01:55.214686 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Oct 04 22:01:55.214686 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 04 22:01:55.214686 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:01:55.214686 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 22:01:55.214686 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi '' Oct 04 22:01:55.214686 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:01:55.214686 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:01:55.214686 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:01:55.214686 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:01:55.214686 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:01:55.214686 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:01:55.214686 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:01:55.214686 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:01:55.214686 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:01:55.214686 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:01:55.214686 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 22:01:55.214686 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 22:01:55.214686 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 22:01:55.214686 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 22:01:55.214686 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 22:01:55.214686 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 22:01:55.214686 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 22:01:55.214686 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 22:01:55.217733 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 04 22:01:55.217733 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:01:55.217733 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:01:55.217733 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:01:55.217733 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:01:55.217733 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:01:55.217733 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:01:55.217733 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 22:01:55.217733 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 22:01:55.217733 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 04 22:01:55.217733 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:01:55.219807 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-0ef6987c-a16b-41b0-a240-f82e8e468745 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:01:55.220156 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-7a61e29e-066c-4e5a-bdd7-ff5b9a7bdf55 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3adbba85c5a448148833e69d6304e62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b710cb6300854d8683bd52ddf56b787d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:55.221708 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-0ef6987c-a16b-41b0-a240-f82e8e468745 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "PUT /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d" status: 400 len: 108 microversion: 2.1 time: 0.017378 Oct 04 22:01:55.221815 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-7a61e29e-066c-4e5a-bdd7-ff5b9a7bdf55 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] 10.222.0.43 "GET /compute/v2.1/servers/7285a94c-3dad-43f1-9052-63ccc9ac07ba" status: 200 len: 1362 microversion: 2.26 time: 0.352597 Oct 04 22:01:55.222973 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1973/3920] 10.222.0.43 () {60 vars in 1256 bytes} [Tue Oct 4 22:01:55 2022] PUT /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d => generated 108 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 22:01:55.232840 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-bc71247f-9005-4b92-b864-1448c53c3579 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:55.233755 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-bc71247f-9005-4b92-b864-1448c53c3579 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: a4cf4fac-1e9b-4669-a6ff-30008ed3642d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:55.235110 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1948/3921] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:01:54 2022] GET /compute/v2.1/servers/7285a94c-3dad-43f1-9052-63ccc9ac07ba => generated 1362 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:01:55.241997 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bc71247f-9005-4b92-b864-1448c53c3579 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:55.242650 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bc71247f-9005-4b92-b864-1448c53c3579 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:55.243310 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bc71247f-9005-4b92-b864-1448c53c3579 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:55.244207 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bc71247f-9005-4b92-b864-1448c53c3579 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:55.244918 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bc71247f-9005-4b92-b864-1448c53c3579 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:55.245550 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bc71247f-9005-4b92-b864-1448c53c3579 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:55.430344 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-15450c0a-a871-49b0-bac5-ca15f4beefa0 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:55.431003 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-15450c0a-a871-49b0-bac5-ca15f4beefa0 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] [instance: 3dbe541d-234a-4049-befd-dcd9a67dbd46] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:55.445790 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-15450c0a-a871-49b0-bac5-ca15f4beefa0 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:55.446286 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-15450c0a-a871-49b0-bac5-ca15f4beefa0 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:55.448459 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-15450c0a-a871-49b0-bac5-ca15f4beefa0 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:55.449586 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-15450c0a-a871-49b0-bac5-ca15f4beefa0 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:55.453908 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-15450c0a-a871-49b0-bac5-ca15f4beefa0 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:55.458106 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-15450c0a-a871-49b0-bac5-ca15f4beefa0 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:55.505574 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-bc71247f-9005-4b92-b864-1448c53c3579 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2facee4c6a40416e908083e126d2cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07a17a482a4e92b6ddbdee463c8029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:55.519253 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-bc71247f-9005-4b92-b864-1448c53c3579 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d" status: 200 len: 1504 microversion: 2.1 time: 0.291897 Oct 04 22:01:55.520019 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1974/3922] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:01:55 2022] GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d => generated 1504 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:01:55.654624 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-15450c0a-a871-49b0-bac5-ca15f4beefa0 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2034fc9060874868bc5d27370a1c351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89499d833a4a00805164f4f79ed522', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:55.669618 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-15450c0a-a871-49b0-bac5-ca15f4beefa0 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] 10.222.0.43 "GET /compute/v2.1/servers/3dbe541d-234a-4049-befd-dcd9a67dbd46" status: 200 len: 1516 microversion: 2.1 time: 0.243339 Oct 04 22:01:55.671294 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1949/3923] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:01:55 2022] GET /compute/v2.1/servers/3dbe541d-234a-4049-befd-dcd9a67dbd46 => generated 1516 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:01:55.890067 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-a37979bb-d729-4af3-8d65-705024aa51f7 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:55.891675 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-a37979bb-d729-4af3-8d65-705024aa51f7 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: f9376877-b87d-4738-b940-2bf314c83337] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:55.899179 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a37979bb-d729-4af3-8d65-705024aa51f7 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:55.899973 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a37979bb-d729-4af3-8d65-705024aa51f7 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:55.913518 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a37979bb-d729-4af3-8d65-705024aa51f7 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:55.914759 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a37979bb-d729-4af3-8d65-705024aa51f7 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:55.915894 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a37979bb-d729-4af3-8d65-705024aa51f7 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:55.917013 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a37979bb-d729-4af3-8d65-705024aa51f7 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:56.134342 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-a37979bb-d729-4af3-8d65-705024aa51f7 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a1c8d841104bc9b6910bcc2c0e2bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe9283584fc4d90b0715216d867ea2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:56.151735 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-a37979bb-d729-4af3-8d65-705024aa51f7 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "GET /compute/v2.1/servers/f9376877-b87d-4738-b940-2bf314c83337" status: 200 len: 1315 microversion: 2.1 time: 0.269858 Oct 04 22:01:56.153951 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1975/3924] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:01:55 2022] GET /compute/v2.1/servers/f9376877-b87d-4738-b940-2bf314c83337 => generated 1315 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:01:56.251852 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-b0477122-ed6b-47eb-ab38-ebf8d1831407 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:56.252985 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-b0477122-ed6b-47eb-ab38-ebf8d1831407 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] [instance: 7285a94c-3dad-43f1-9052-63ccc9ac07ba] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:56.261679 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b0477122-ed6b-47eb-ab38-ebf8d1831407 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:56.262387 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b0477122-ed6b-47eb-ab38-ebf8d1831407 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:56.262959 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b0477122-ed6b-47eb-ab38-ebf8d1831407 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:56.263811 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b0477122-ed6b-47eb-ab38-ebf8d1831407 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:56.264413 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b0477122-ed6b-47eb-ab38-ebf8d1831407 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:56.264995 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b0477122-ed6b-47eb-ab38-ebf8d1831407 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:56.462345 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-b0477122-ed6b-47eb-ab38-ebf8d1831407 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3adbba85c5a448148833e69d6304e62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b710cb6300854d8683bd52ddf56b787d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:56.477459 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-b0477122-ed6b-47eb-ab38-ebf8d1831407 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3adbba85c5a448148833e69d6304e62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b710cb6300854d8683bd52ddf56b787d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:56.481398 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-b0477122-ed6b-47eb-ab38-ebf8d1831407 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3adbba85c5a448148833e69d6304e62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b710cb6300854d8683bd52ddf56b787d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:56.483104 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-b0477122-ed6b-47eb-ab38-ebf8d1831407 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] 10.222.0.43 "GET /compute/v2.1/servers/7285a94c-3dad-43f1-9052-63ccc9ac07ba" status: 200 len: 1362 microversion: 2.26 time: 0.234987 Oct 04 22:01:56.484281 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1950/3925] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:01:56 2022] GET /compute/v2.1/servers/7285a94c-3dad-43f1-9052-63ccc9ac07ba => generated 1362 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 22:01:56.695695 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-edb9c601-6629-468b-9219-ba1b55d2fa06 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:56.696424 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-edb9c601-6629-468b-9219-ba1b55d2fa06 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] [instance: 3dbe541d-234a-4049-befd-dcd9a67dbd46] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:56.707929 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-edb9c601-6629-468b-9219-ba1b55d2fa06 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:56.709438 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-edb9c601-6629-468b-9219-ba1b55d2fa06 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:56.710811 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-edb9c601-6629-468b-9219-ba1b55d2fa06 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:56.714769 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-edb9c601-6629-468b-9219-ba1b55d2fa06 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:56.716296 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-edb9c601-6629-468b-9219-ba1b55d2fa06 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:56.716897 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-edb9c601-6629-468b-9219-ba1b55d2fa06 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:56.762789 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-00e43dbd-be88-414b-aa4c-2c77fbc6280b req-cd63b23d-baaa-42e7-a336-924660371719 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7285a94c-3dad-43f1-9052-63ccc9ac07ba", "name": "network-vif-plugged", "status": "completed", "tag": "0f3ace44-c465-4e93-b2a0-48fc82b7381a"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:01:56.782190 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-00e43dbd-be88-414b-aa4c-2c77fbc6280b req-cd63b23d-baaa-42e7-a336-924660371719 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:56.783341 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-00e43dbd-be88-414b-aa4c-2c77fbc6280b req-cd63b23d-baaa-42e7-a336-924660371719 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:56.784200 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-00e43dbd-be88-414b-aa4c-2c77fbc6280b req-cd63b23d-baaa-42e7-a336-924660371719 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:56.836522 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-00e43dbd-be88-414b-aa4c-2c77fbc6280b req-cd63b23d-baaa-42e7-a336-924660371719 service nova] Creating event network-vif-plugged:0f3ace44-c465-4e93-b2a0-48fc82b7381a for instance 7285a94c-3dad-43f1-9052-63ccc9ac07ba on n-h2-860284-1 Oct 04 22:01:56.854902 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-00e43dbd-be88-414b-aa4c-2c77fbc6280b req-cd63b23d-baaa-42e7-a336-924660371719 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095296 Oct 04 22:01:56.855990 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1951/3926] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:01:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:01:57.078299 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-edb9c601-6629-468b-9219-ba1b55d2fa06 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2034fc9060874868bc5d27370a1c351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89499d833a4a00805164f4f79ed522', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:57.089208 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-edb9c601-6629-468b-9219-ba1b55d2fa06 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] 10.222.0.43 "GET /compute/v2.1/servers/3dbe541d-234a-4049-befd-dcd9a67dbd46" status: 200 len: 1516 microversion: 2.1 time: 0.398457 Oct 04 22:01:57.099276 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1976/3927] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:01:56 2022] GET /compute/v2.1/servers/3dbe541d-234a-4049-befd-dcd9a67dbd46 => generated 1516 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:01:57.190680 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-65eaa1aa-4f4c-47e4-a6d8-74a7d2792ac9 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:57.192376 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-65eaa1aa-4f4c-47e4-a6d8-74a7d2792ac9 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: f9376877-b87d-4738-b940-2bf314c83337] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:57.218526 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-65eaa1aa-4f4c-47e4-a6d8-74a7d2792ac9 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:57.219530 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-65eaa1aa-4f4c-47e4-a6d8-74a7d2792ac9 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:57.220639 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-65eaa1aa-4f4c-47e4-a6d8-74a7d2792ac9 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:57.227708 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-65eaa1aa-4f4c-47e4-a6d8-74a7d2792ac9 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:57.230474 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-65eaa1aa-4f4c-47e4-a6d8-74a7d2792ac9 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:57.235263 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-65eaa1aa-4f4c-47e4-a6d8-74a7d2792ac9 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:57.509401 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-5353add8-59b1-440b-a12c-976153a6068e tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:57.510589 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-5353add8-59b1-440b-a12c-976153a6068e tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] [instance: 7285a94c-3dad-43f1-9052-63ccc9ac07ba] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:57.516863 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5353add8-59b1-440b-a12c-976153a6068e tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:57.517553 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5353add8-59b1-440b-a12c-976153a6068e tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:57.518128 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5353add8-59b1-440b-a12c-976153a6068e tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:57.519014 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5353add8-59b1-440b-a12c-976153a6068e tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:57.519609 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5353add8-59b1-440b-a12c-976153a6068e tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:57.520180 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5353add8-59b1-440b-a12c-976153a6068e tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:57.600909 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-65eaa1aa-4f4c-47e4-a6d8-74a7d2792ac9 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a1c8d841104bc9b6910bcc2c0e2bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe9283584fc4d90b0715216d867ea2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:57.630275 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-65eaa1aa-4f4c-47e4-a6d8-74a7d2792ac9 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "GET /compute/v2.1/servers/f9376877-b87d-4738-b940-2bf314c83337" status: 200 len: 1315 microversion: 2.1 time: 0.452609 Oct 04 22:01:57.633536 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1952/3928] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:01:57 2022] GET /compute/v2.1/servers/f9376877-b87d-4738-b940-2bf314c83337 => generated 1315 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:01:57.834164 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-5353add8-59b1-440b-a12c-976153a6068e tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3adbba85c5a448148833e69d6304e62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b710cb6300854d8683bd52ddf56b787d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:57.850456 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-5353add8-59b1-440b-a12c-976153a6068e tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3adbba85c5a448148833e69d6304e62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b710cb6300854d8683bd52ddf56b787d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:57.852753 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-5353add8-59b1-440b-a12c-976153a6068e tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3adbba85c5a448148833e69d6304e62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b710cb6300854d8683bd52ddf56b787d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:57.855288 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-5353add8-59b1-440b-a12c-976153a6068e tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] 10.222.0.43 "GET /compute/v2.1/servers/7285a94c-3dad-43f1-9052-63ccc9ac07ba" status: 200 len: 1362 microversion: 2.26 time: 0.349847 Oct 04 22:01:57.870424 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1977/3929] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:01:57 2022] GET /compute/v2.1/servers/7285a94c-3dad-43f1-9052-63ccc9ac07ba => generated 1362 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 22:01:58.123866 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-07436d11-ee37-4899-8465-1c22ea46937f tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:58.124739 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-07436d11-ee37-4899-8465-1c22ea46937f tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] [instance: 3dbe541d-234a-4049-befd-dcd9a67dbd46] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:58.141683 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-07436d11-ee37-4899-8465-1c22ea46937f tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:58.143188 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-07436d11-ee37-4899-8465-1c22ea46937f tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:58.146006 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-07436d11-ee37-4899-8465-1c22ea46937f tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:58.151967 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-07436d11-ee37-4899-8465-1c22ea46937f tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:58.153083 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-07436d11-ee37-4899-8465-1c22ea46937f tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:58.155268 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-07436d11-ee37-4899-8465-1c22ea46937f tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:58.466185 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-07436d11-ee37-4899-8465-1c22ea46937f tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2034fc9060874868bc5d27370a1c351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89499d833a4a00805164f4f79ed522', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:58.476503 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-07436d11-ee37-4899-8465-1c22ea46937f tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] 10.222.0.43 "GET /compute/v2.1/servers/3dbe541d-234a-4049-befd-dcd9a67dbd46" status: 200 len: 1516 microversion: 2.1 time: 0.357105 Oct 04 22:01:58.477588 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1953/3930] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:01:58 2022] GET /compute/v2.1/servers/3dbe541d-234a-4049-befd-dcd9a67dbd46 => generated 1516 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:01:58.660711 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-7d23e4fb-c8cd-4666-9d3d-bc2ea5581155 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:58.661698 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-7d23e4fb-c8cd-4666-9d3d-bc2ea5581155 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: f9376877-b87d-4738-b940-2bf314c83337] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:58.676509 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7d23e4fb-c8cd-4666-9d3d-bc2ea5581155 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:58.677253 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7d23e4fb-c8cd-4666-9d3d-bc2ea5581155 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:58.678002 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7d23e4fb-c8cd-4666-9d3d-bc2ea5581155 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:58.678928 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7d23e4fb-c8cd-4666-9d3d-bc2ea5581155 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:58.679538 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7d23e4fb-c8cd-4666-9d3d-bc2ea5581155 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:58.680153 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7d23e4fb-c8cd-4666-9d3d-bc2ea5581155 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:58.724375 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell0:SELECT=4 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:01:58.741822 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell0:SELECT=12 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:01:58.884202 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-de6ac306-cf8b-41e1-a700-098cdf34b0cc tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:58.886077 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-de6ac306-cf8b-41e1-a700-098cdf34b0cc tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] [instance: 7285a94c-3dad-43f1-9052-63ccc9ac07ba] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:58.899252 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-de6ac306-cf8b-41e1-a700-098cdf34b0cc tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:58.902793 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-de6ac306-cf8b-41e1-a700-098cdf34b0cc tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:58.903736 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-de6ac306-cf8b-41e1-a700-098cdf34b0cc tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:58.904645 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-de6ac306-cf8b-41e1-a700-098cdf34b0cc tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:58.908539 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-de6ac306-cf8b-41e1-a700-098cdf34b0cc tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:58.909200 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-de6ac306-cf8b-41e1-a700-098cdf34b0cc tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:59.378798 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=4 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:01:59.515263 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-7d23e4fb-c8cd-4666-9d3d-bc2ea5581155 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a1c8d841104bc9b6910bcc2c0e2bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe9283584fc4d90b0715216d867ea2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:59.525123 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-7d23e4fb-c8cd-4666-9d3d-bc2ea5581155 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "GET /compute/v2.1/servers/f9376877-b87d-4738-b940-2bf314c83337" status: 200 len: 1315 microversion: 2.1 time: 0.874760 Oct 04 22:01:59.532213 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1978/3931] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:01:58 2022] GET /compute/v2.1/servers/f9376877-b87d-4738-b940-2bf314c83337 => generated 1315 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:01:59.550128 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-de6ac306-cf8b-41e1-a700-098cdf34b0cc tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3adbba85c5a448148833e69d6304e62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b710cb6300854d8683bd52ddf56b787d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:59.551064 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-cfbb5f8f-3def-4011-aaa7-4426e51c1d08 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:59.551687 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-cfbb5f8f-3def-4011-aaa7-4426e51c1d08 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] [instance: 3dbe541d-234a-4049-befd-dcd9a67dbd46] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:59.565080 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cfbb5f8f-3def-4011-aaa7-4426e51c1d08 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:59.565582 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cfbb5f8f-3def-4011-aaa7-4426e51c1d08 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:59.566191 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cfbb5f8f-3def-4011-aaa7-4426e51c1d08 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:59.567106 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cfbb5f8f-3def-4011-aaa7-4426e51c1d08 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:59.567704 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cfbb5f8f-3def-4011-aaa7-4426e51c1d08 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:59.568279 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cfbb5f8f-3def-4011-aaa7-4426e51c1d08 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:59.571851 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-de6ac306-cf8b-41e1-a700-098cdf34b0cc tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3adbba85c5a448148833e69d6304e62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b710cb6300854d8683bd52ddf56b787d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:59.574415 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-de6ac306-cf8b-41e1-a700-098cdf34b0cc tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3adbba85c5a448148833e69d6304e62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b710cb6300854d8683bd52ddf56b787d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:59.580687 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-de6ac306-cf8b-41e1-a700-098cdf34b0cc tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] 10.222.0.43 "GET /compute/v2.1/servers/7285a94c-3dad-43f1-9052-63ccc9ac07ba" status: 200 len: 1546 microversion: 2.26 time: 0.700947 Oct 04 22:01:59.584387 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1954/3932] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:01:58 2022] GET /compute/v2.1/servers/7285a94c-3dad-43f1-9052-63ccc9ac07ba => generated 1546 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:01:59.618590 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-871d6ee1-e492-44e8-bd73-cc1d57fa7fbf tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Calling method '.version_select at 0x7fbb2e1eb820>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:59.652674 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-871d6ee1-e492-44e8-bd73-cc1d57fa7fbf tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:59.656122 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-871d6ee1-e492-44e8-bd73-cc1d57fa7fbf tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:59.660383 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-871d6ee1-e492-44e8-bd73-cc1d57fa7fbf tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:59.664941 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-871d6ee1-e492-44e8-bd73-cc1d57fa7fbf tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] [instance: 7285a94c-3dad-43f1-9052-63ccc9ac07ba] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:59.694008 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-871d6ee1-e492-44e8-bd73-cc1d57fa7fbf tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:59.694894 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-871d6ee1-e492-44e8-bd73-cc1d57fa7fbf tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:59.695617 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-871d6ee1-e492-44e8-bd73-cc1d57fa7fbf tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:59.696549 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-871d6ee1-e492-44e8-bd73-cc1d57fa7fbf tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:59.697202 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-871d6ee1-e492-44e8-bd73-cc1d57fa7fbf tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:59.697868 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-871d6ee1-e492-44e8-bd73-cc1d57fa7fbf tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:59.750190 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=100 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:01:59.778341 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-871d6ee1-e492-44e8-bd73-cc1d57fa7fbf tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:59.781399 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-871d6ee1-e492-44e8-bd73-cc1d57fa7fbf tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:59.782064 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-871d6ee1-e492-44e8-bd73-cc1d57fa7fbf tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:59.813699 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-871d6ee1-e492-44e8-bd73-cc1d57fa7fbf tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:59.817650 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-871d6ee1-e492-44e8-bd73-cc1d57fa7fbf tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:59.818393 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-871d6ee1-e492-44e8-bd73-cc1d57fa7fbf tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:59.844895 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-cfbb5f8f-3def-4011-aaa7-4426e51c1d08 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2034fc9060874868bc5d27370a1c351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89499d833a4a00805164f4f79ed522', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:59.868434 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-cfbb5f8f-3def-4011-aaa7-4426e51c1d08 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] 10.222.0.43 "GET /compute/v2.1/servers/3dbe541d-234a-4049-befd-dcd9a67dbd46" status: 200 len: 1522 microversion: 2.1 time: 0.328689 Oct 04 22:01:59.869072 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1979/3933] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:01:59 2022] GET /compute/v2.1/servers/3dbe541d-234a-4049-befd-dcd9a67dbd46 => generated 1522 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:01:59.895506 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.objects.instance [None req-871d6ee1-e492-44e8-bd73-cc1d57fa7fbf tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lazy-loading 'flavor' on Instance uuid 7285a94c-3dad-43f1-9052-63ccc9ac07ba {{(pid=134101) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 22:01:59.945229 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-871d6ee1-e492-44e8-bd73-cc1d57fa7fbf tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] 10.222.0.43 "PUT /compute/v2.1/servers/7285a94c-3dad-43f1-9052-63ccc9ac07ba/tags/tempest-tag-1925996008" status: 201 len: 0 microversion: 2.26 time: 0.328493 Oct 04 22:01:59.947158 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1955/3934] 10.222.0.43 () {62 vars in 1380 bytes} [Tue Oct 4 22:01:59 2022] PUT /compute/v2.1/servers/7285a94c-3dad-43f1-9052-63ccc9ac07ba/tags/tempest-tag-1925996008 => generated 0 bytes in 335 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Oct 04 22:01:59.956221 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-fdc12529-4f2b-4195-8c29-3084b03c7cab tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Calling method '.version_select at 0x7fbb2f523b80>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:59.965389 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fdc12529-4f2b-4195-8c29-3084b03c7cab tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:59.971344 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fdc12529-4f2b-4195-8c29-3084b03c7cab tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:59.972471 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fdc12529-4f2b-4195-8c29-3084b03c7cab tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:00.009099 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-fdc12529-4f2b-4195-8c29-3084b03c7cab tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] 10.222.0.43 "GET /compute/v2.1/servers/7285a94c-3dad-43f1-9052-63ccc9ac07ba/tags/tempest-tag-1925996008" status: 204 len: 0 microversion: 2.26 time: 0.057244 Oct 04 22:02:00.016039 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1980/3935] 10.222.0.43 () {60 vars in 1361 bytes} [Tue Oct 4 22:01:59 2022] GET /compute/v2.1/servers/7285a94c-3dad-43f1-9052-63ccc9ac07ba/tags/tempest-tag-1925996008 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 22:02:00.027123 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-345fc1f0-9600-4917-8adb-2b17b0527cf9 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Calling method '.version_select at 0x7fbb2e18cca0>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:02:00.045717 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-345fc1f0-9600-4917-8adb-2b17b0527cf9 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:00.047578 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-345fc1f0-9600-4917-8adb-2b17b0527cf9 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:00.048166 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-345fc1f0-9600-4917-8adb-2b17b0527cf9 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:00.049721 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-345fc1f0-9600-4917-8adb-2b17b0527cf9 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] [instance: 7285a94c-3dad-43f1-9052-63ccc9ac07ba] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:02:00.066015 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-345fc1f0-9600-4917-8adb-2b17b0527cf9 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:00.066724 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-345fc1f0-9600-4917-8adb-2b17b0527cf9 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:00.067294 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-345fc1f0-9600-4917-8adb-2b17b0527cf9 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:00.069441 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-345fc1f0-9600-4917-8adb-2b17b0527cf9 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:00.070053 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-345fc1f0-9600-4917-8adb-2b17b0527cf9 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:00.073923 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-345fc1f0-9600-4917-8adb-2b17b0527cf9 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:00.130509 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-345fc1f0-9600-4917-8adb-2b17b0527cf9 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:00.130509 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-345fc1f0-9600-4917-8adb-2b17b0527cf9 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:00.134458 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-345fc1f0-9600-4917-8adb-2b17b0527cf9 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:00.169331 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.objects.instance [None req-345fc1f0-9600-4917-8adb-2b17b0527cf9 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lazy-loading 'flavor' on Instance uuid 7285a94c-3dad-43f1-9052-63ccc9ac07ba {{(pid=134101) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 22:02:00.202615 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-345fc1f0-9600-4917-8adb-2b17b0527cf9 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] 10.222.0.43 "DELETE /compute/v2.1/servers/7285a94c-3dad-43f1-9052-63ccc9ac07ba/tags" status: 204 len: 0 microversion: 2.26 time: 0.182044 Oct 04 22:02:00.204659 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1956/3936] 10.222.0.43 () {60 vars in 1295 bytes} [Tue Oct 4 22:02:00 2022] DELETE /compute/v2.1/servers/7285a94c-3dad-43f1-9052-63ccc9ac07ba/tags => generated 0 bytes in 185 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 22:02:00.215315 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-e1f33083-c454-46d8-9313-a850af22b30c tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Calling method '.version_select at 0x7fbb2e6b8ee0>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:02:00.223942 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e1f33083-c454-46d8-9313-a850af22b30c tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:00.224832 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e1f33083-c454-46d8-9313-a850af22b30c tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:00.225506 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e1f33083-c454-46d8-9313-a850af22b30c tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:00.243421 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-e1f33083-c454-46d8-9313-a850af22b30c tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] 10.222.0.43 "GET /compute/v2.1/servers/7285a94c-3dad-43f1-9052-63ccc9ac07ba/tags" status: 200 len: 12 microversion: 2.26 time: 0.032334 Oct 04 22:02:00.244675 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1981/3937] 10.222.0.43 () {60 vars in 1292 bytes} [Tue Oct 4 22:02:00 2022] GET /compute/v2.1/servers/7285a94c-3dad-43f1-9052-63ccc9ac07ba/tags => generated 12 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:02:00.254630 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-87e30b0b-9fde-486b-9d86-5c39007bbb72 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Calling method '.version_select at 0x7fbb2e1ebca0>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:02:00.267058 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-87e30b0b-9fde-486b-9d86-5c39007bbb72 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:00.267213 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-87e30b0b-9fde-486b-9d86-5c39007bbb72 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:00.267649 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-87e30b0b-9fde-486b-9d86-5c39007bbb72 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:00.268137 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-87e30b0b-9fde-486b-9d86-5c39007bbb72 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] [instance: 7285a94c-3dad-43f1-9052-63ccc9ac07ba] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:02:00.274304 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-87e30b0b-9fde-486b-9d86-5c39007bbb72 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:00.277304 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-87e30b0b-9fde-486b-9d86-5c39007bbb72 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:00.277743 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-87e30b0b-9fde-486b-9d86-5c39007bbb72 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:00.278539 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-87e30b0b-9fde-486b-9d86-5c39007bbb72 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:00.279009 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-87e30b0b-9fde-486b-9d86-5c39007bbb72 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:00.279445 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-87e30b0b-9fde-486b-9d86-5c39007bbb72 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:00.314938 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-87e30b0b-9fde-486b-9d86-5c39007bbb72 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:00.315437 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-87e30b0b-9fde-486b-9d86-5c39007bbb72 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:00.315930 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-87e30b0b-9fde-486b-9d86-5c39007bbb72 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:00.345163 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-87e30b0b-9fde-486b-9d86-5c39007bbb72 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:00.347429 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-2a885377-0a90-4ce9-9a87-f1fb603caf09 req-750167c4-6170-40dd-8f91-b1d2cd40537e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9376877-b87d-4738-b940-2bf314c83337", "name": "network-vif-plugged", "status": "completed", "tag": "c1424a9c-7ef8-4143-88f4-7519c96678b1"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:02:00.358989 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-87e30b0b-9fde-486b-9d86-5c39007bbb72 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:00.359606 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-87e30b0b-9fde-486b-9d86-5c39007bbb72 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:00.364327 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-2a885377-0a90-4ce9-9a87-f1fb603caf09 req-750167c4-6170-40dd-8f91-b1d2cd40537e service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:00.370503 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-2a885377-0a90-4ce9-9a87-f1fb603caf09 req-750167c4-6170-40dd-8f91-b1d2cd40537e service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:00.371281 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-2a885377-0a90-4ce9-9a87-f1fb603caf09 req-750167c4-6170-40dd-8f91-b1d2cd40537e service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:00.406699 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-2a885377-0a90-4ce9-9a87-f1fb603caf09 req-750167c4-6170-40dd-8f91-b1d2cd40537e service nova] Creating event network-vif-plugged:c1424a9c-7ef8-4143-88f4-7519c96678b1 for instance f9376877-b87d-4738-b940-2bf314c83337 on n-h1-860284-1 Oct 04 22:02:00.418529 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.objects.instance [None req-87e30b0b-9fde-486b-9d86-5c39007bbb72 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lazy-loading 'flavor' on Instance uuid 7285a94c-3dad-43f1-9052-63ccc9ac07ba {{(pid=134101) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 22:02:00.419751 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-2a885377-0a90-4ce9-9a87-f1fb603caf09 req-750167c4-6170-40dd-8f91-b1d2cd40537e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088375 Oct 04 22:02:00.423182 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1982/3938] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:02:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:02:00.455290 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-87e30b0b-9fde-486b-9d86-5c39007bbb72 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] 10.222.0.43 "PUT /compute/v2.1/servers/7285a94c-3dad-43f1-9052-63ccc9ac07ba/tags/tempest-tag-197419377" status: 201 len: 0 microversion: 2.26 time: 0.204541 Oct 04 22:02:00.456294 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1957/3939] 10.222.0.43 () {62 vars in 1377 bytes} [Tue Oct 4 22:02:00 2022] PUT /compute/v2.1/servers/7285a94c-3dad-43f1-9052-63ccc9ac07ba/tags/tempest-tag-197419377 => generated 0 bytes in 206 msecs (HTTP/1.1 201) 10 headers in 485 bytes (2 switches on core 0) Oct 04 22:02:00.467673 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-3faab931-7484-4c29-80b8-7d4f521e6eea tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Calling method '.version_select at 0x7fbb2ea03820>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:02:00.484335 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3faab931-7484-4c29-80b8-7d4f521e6eea tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:00.485472 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3faab931-7484-4c29-80b8-7d4f521e6eea tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:00.486946 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3faab931-7484-4c29-80b8-7d4f521e6eea tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:00.493399 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=100 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:02:00.521234 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-3faab931-7484-4c29-80b8-7d4f521e6eea tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] 10.222.0.43 "GET /compute/v2.1/servers/7285a94c-3dad-43f1-9052-63ccc9ac07ba/tags" status: 200 len: 35 microversion: 2.26 time: 0.057650 Oct 04 22:02:00.523899 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1983/3940] 10.222.0.43 () {60 vars in 1292 bytes} [Tue Oct 4 22:02:00 2022] GET /compute/v2.1/servers/7285a94c-3dad-43f1-9052-63ccc9ac07ba/tags => generated 35 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:02:00.533506 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-1a1d140b-0fb1-43c1-bb60-5b4fc721ff14 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Calling method '.version_select at 0x7fbb2e18c280>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:02:00.546201 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1a1d140b-0fb1-43c1-bb60-5b4fc721ff14 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:00.546741 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1a1d140b-0fb1-43c1-bb60-5b4fc721ff14 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:00.547350 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1a1d140b-0fb1-43c1-bb60-5b4fc721ff14 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:00.548041 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-1a1d140b-0fb1-43c1-bb60-5b4fc721ff14 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] [instance: 7285a94c-3dad-43f1-9052-63ccc9ac07ba] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:02:00.555361 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-aaf9481a-a339-499c-b3a8-2012fed11bd0 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:02:00.556104 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-aaf9481a-a339-499c-b3a8-2012fed11bd0 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: f9376877-b87d-4738-b940-2bf314c83337] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:02:00.573507 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-aaf9481a-a339-499c-b3a8-2012fed11bd0 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:00.575849 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1a1d140b-0fb1-43c1-bb60-5b4fc721ff14 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:00.576143 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-aaf9481a-a339-499c-b3a8-2012fed11bd0 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:00.576951 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1a1d140b-0fb1-43c1-bb60-5b4fc721ff14 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:00.577896 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-aaf9481a-a339-499c-b3a8-2012fed11bd0 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:00.579051 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-aaf9481a-a339-499c-b3a8-2012fed11bd0 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:00.579872 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1a1d140b-0fb1-43c1-bb60-5b4fc721ff14 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:00.580835 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1a1d140b-0fb1-43c1-bb60-5b4fc721ff14 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:00.581669 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-aaf9481a-a339-499c-b3a8-2012fed11bd0 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:00.582323 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1a1d140b-0fb1-43c1-bb60-5b4fc721ff14 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:00.582879 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-aaf9481a-a339-499c-b3a8-2012fed11bd0 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:00.584654 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1a1d140b-0fb1-43c1-bb60-5b4fc721ff14 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:00.643234 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1a1d140b-0fb1-43c1-bb60-5b4fc721ff14 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:00.643691 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1a1d140b-0fb1-43c1-bb60-5b4fc721ff14 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:00.644384 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1a1d140b-0fb1-43c1-bb60-5b4fc721ff14 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:00.702673 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.objects.instance [None req-1a1d140b-0fb1-43c1-bb60-5b4fc721ff14 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lazy-loading 'flavor' on Instance uuid 7285a94c-3dad-43f1-9052-63ccc9ac07ba {{(pid=134101) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 22:02:00.738425 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-1a1d140b-0fb1-43c1-bb60-5b4fc721ff14 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] 10.222.0.43 "DELETE /compute/v2.1/servers/7285a94c-3dad-43f1-9052-63ccc9ac07ba/tags/tempest-tag-197419377" status: 204 len: 0 microversion: 2.26 time: 0.209342 Oct 04 22:02:00.739387 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1958/3941] 10.222.0.43 () {60 vars in 1361 bytes} [Tue Oct 4 22:02:00 2022] DELETE /compute/v2.1/servers/7285a94c-3dad-43f1-9052-63ccc9ac07ba/tags/tempest-tag-197419377 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 22:02:00.751118 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-fd98ae60-b20d-418b-8ff7-74cfc4a2f135 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Calling method '.version_select at 0x7fbb2e19fee0>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:02:00.778076 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fd98ae60-b20d-418b-8ff7-74cfc4a2f135 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:00.782948 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fd98ae60-b20d-418b-8ff7-74cfc4a2f135 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:00.791335 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fd98ae60-b20d-418b-8ff7-74cfc4a2f135 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:00.823050 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-fd98ae60-b20d-418b-8ff7-74cfc4a2f135 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] 10.222.0.43 "GET /compute/v2.1/servers/7285a94c-3dad-43f1-9052-63ccc9ac07ba/tags" status: 200 len: 12 microversion: 2.26 time: 0.078614 Oct 04 22:02:00.832702 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1959/3942] 10.222.0.43 () {60 vars in 1292 bytes} [Tue Oct 4 22:02:00 2022] GET /compute/v2.1/servers/7285a94c-3dad-43f1-9052-63ccc9ac07ba/tags => generated 12 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:02:00.855377 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-9076696a-f5cc-42ba-a305-20d92a040f9d tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Calling method '.version_select at 0x7fbb2e1af820>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:02:00.873086 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9076696a-f5cc-42ba-a305-20d92a040f9d tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:00.873584 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9076696a-f5cc-42ba-a305-20d92a040f9d tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:00.874073 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9076696a-f5cc-42ba-a305-20d92a040f9d tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:00.874583 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-9076696a-f5cc-42ba-a305-20d92a040f9d tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] [instance: 7285a94c-3dad-43f1-9052-63ccc9ac07ba] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:02:00.891614 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9076696a-f5cc-42ba-a305-20d92a040f9d tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:00.892113 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9076696a-f5cc-42ba-a305-20d92a040f9d tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:00.892557 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9076696a-f5cc-42ba-a305-20d92a040f9d tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:00.893269 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9076696a-f5cc-42ba-a305-20d92a040f9d tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:00.893728 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9076696a-f5cc-42ba-a305-20d92a040f9d tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:00.894159 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9076696a-f5cc-42ba-a305-20d92a040f9d tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:00.921335 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-aaf9481a-a339-499c-b3a8-2012fed11bd0 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a1c8d841104bc9b6910bcc2c0e2bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe9283584fc4d90b0715216d867ea2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:02:00.933424 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-aaf9481a-a339-499c-b3a8-2012fed11bd0 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "GET /compute/v2.1/servers/f9376877-b87d-4738-b940-2bf314c83337" status: 200 len: 1315 microversion: 2.1 time: 0.382189 Oct 04 22:02:00.954609 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1984/3943] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:02:00 2022] GET /compute/v2.1/servers/f9376877-b87d-4738-b940-2bf314c83337 => generated 1315 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:02:00.964822 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-6fdc35ac-d9e0-4f88-8e0e-18691045488a tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:02:00.965181 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9076696a-f5cc-42ba-a305-20d92a040f9d tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:00.965633 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-6fdc35ac-d9e0-4f88-8e0e-18691045488a tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] [instance: 3dbe541d-234a-4049-befd-dcd9a67dbd46] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:02:00.965741 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9076696a-f5cc-42ba-a305-20d92a040f9d tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:00.966059 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9076696a-f5cc-42ba-a305-20d92a040f9d tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:00.981129 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.objects.instance [None req-9076696a-f5cc-42ba-a305-20d92a040f9d tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lazy-loading 'flavor' on Instance uuid 7285a94c-3dad-43f1-9052-63ccc9ac07ba {{(pid=134101) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 22:02:00.984251 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6fdc35ac-d9e0-4f88-8e0e-18691045488a tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:00.984770 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6fdc35ac-d9e0-4f88-8e0e-18691045488a tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:00.985228 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6fdc35ac-d9e0-4f88-8e0e-18691045488a tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:00.987533 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6fdc35ac-d9e0-4f88-8e0e-18691045488a tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:00.988214 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6fdc35ac-d9e0-4f88-8e0e-18691045488a tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:00.988807 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6fdc35ac-d9e0-4f88-8e0e-18691045488a tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:01.002513 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-9076696a-f5cc-42ba-a305-20d92a040f9d tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] 10.222.0.43 "DELETE /compute/v2.1/servers/7285a94c-3dad-43f1-9052-63ccc9ac07ba/tags" status: 204 len: 0 microversion: 2.26 time: 0.164220 Oct 04 22:02:01.007415 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1960/3944] 10.222.0.43 () {60 vars in 1295 bytes} [Tue Oct 4 22:02:00 2022] DELETE /compute/v2.1/servers/7285a94c-3dad-43f1-9052-63ccc9ac07ba/tags => generated 0 bytes in 166 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 04 22:02:01.014035 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-b5785a76-4c43-422a-be7e-08cfb867ba7c tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Calling method '.version_select at 0x7fbb2e311ca0>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:02:01.025523 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b5785a76-4c43-422a-be7e-08cfb867ba7c tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:01.026815 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b5785a76-4c43-422a-be7e-08cfb867ba7c tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:01.027262 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b5785a76-4c43-422a-be7e-08cfb867ba7c tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:01.027746 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-b5785a76-4c43-422a-be7e-08cfb867ba7c tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] [instance: 7285a94c-3dad-43f1-9052-63ccc9ac07ba] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:02:01.034797 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b5785a76-4c43-422a-be7e-08cfb867ba7c tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:01.035427 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b5785a76-4c43-422a-be7e-08cfb867ba7c tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:01.035879 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b5785a76-4c43-422a-be7e-08cfb867ba7c tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:01.036590 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b5785a76-4c43-422a-be7e-08cfb867ba7c tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:01.037045 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b5785a76-4c43-422a-be7e-08cfb867ba7c tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:01.038079 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b5785a76-4c43-422a-be7e-08cfb867ba7c tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:01.138416 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b5785a76-4c43-422a-be7e-08cfb867ba7c tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:01.138416 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b5785a76-4c43-422a-be7e-08cfb867ba7c tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:01.138416 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b5785a76-4c43-422a-be7e-08cfb867ba7c tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:01.168841 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b5785a76-4c43-422a-be7e-08cfb867ba7c tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:01.169335 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b5785a76-4c43-422a-be7e-08cfb867ba7c tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:01.169782 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b5785a76-4c43-422a-be7e-08cfb867ba7c tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:01.227144 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.objects.instance [None req-b5785a76-4c43-422a-be7e-08cfb867ba7c tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lazy-loading 'flavor' on Instance uuid 7285a94c-3dad-43f1-9052-63ccc9ac07ba {{(pid=134101) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 22:02:01.264097 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-b5785a76-4c43-422a-be7e-08cfb867ba7c tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] 10.222.0.43 "PUT /compute/v2.1/servers/7285a94c-3dad-43f1-9052-63ccc9ac07ba/tags/tempest-tag-316151478" status: 201 len: 0 microversion: 2.26 time: 0.255103 Oct 04 22:02:01.264975 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1961/3945] 10.222.0.43 () {62 vars in 1377 bytes} [Tue Oct 4 22:02:01 2022] PUT /compute/v2.1/servers/7285a94c-3dad-43f1-9052-63ccc9ac07ba/tags/tempest-tag-316151478 => generated 0 bytes in 256 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Oct 04 22:02:01.285288 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e0fcae4e-5639-4079-a22e-9d009399a902 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Calling method '.version_select at 0x7fbb2e199160>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:02:01.295922 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e0fcae4e-5639-4079-a22e-9d009399a902 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:01.296419 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e0fcae4e-5639-4079-a22e-9d009399a902 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:01.296865 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e0fcae4e-5639-4079-a22e-9d009399a902 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:01.297355 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-e0fcae4e-5639-4079-a22e-9d009399a902 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] [instance: 7285a94c-3dad-43f1-9052-63ccc9ac07ba] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:02:01.315504 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e0fcae4e-5639-4079-a22e-9d009399a902 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:01.316231 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e0fcae4e-5639-4079-a22e-9d009399a902 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:01.316668 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e0fcae4e-5639-4079-a22e-9d009399a902 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:01.323416 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e0fcae4e-5639-4079-a22e-9d009399a902 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:01.324069 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e0fcae4e-5639-4079-a22e-9d009399a902 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:01.324659 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e0fcae4e-5639-4079-a22e-9d009399a902 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:01.354340 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e0fcae4e-5639-4079-a22e-9d009399a902 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:01.355339 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e0fcae4e-5639-4079-a22e-9d009399a902 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:01.355997 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e0fcae4e-5639-4079-a22e-9d009399a902 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:01.367711 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-6fdc35ac-d9e0-4f88-8e0e-18691045488a tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2034fc9060874868bc5d27370a1c351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89499d833a4a00805164f4f79ed522', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:02:01.374031 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e0fcae4e-5639-4079-a22e-9d009399a902 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:01.378748 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-6fdc35ac-d9e0-4f88-8e0e-18691045488a tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] 10.222.0.43 "GET /compute/v2.1/servers/3dbe541d-234a-4049-befd-dcd9a67dbd46" status: 200 len: 1522 microversion: 2.1 time: 0.425488 Oct 04 22:02:01.379236 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e0fcae4e-5639-4079-a22e-9d009399a902 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:01.380599 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e0fcae4e-5639-4079-a22e-9d009399a902 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:01.381007 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1985/3946] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:02:00 2022] GET /compute/v2.1/servers/3dbe541d-234a-4049-befd-dcd9a67dbd46 => generated 1522 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:02:01.409400 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.objects.instance [None req-e0fcae4e-5639-4079-a22e-9d009399a902 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lazy-loading 'flavor' on Instance uuid 7285a94c-3dad-43f1-9052-63ccc9ac07ba {{(pid=134101) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 22:02:01.426771 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-e0fcae4e-5639-4079-a22e-9d009399a902 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] 10.222.0.43 "PUT /compute/v2.1/servers/7285a94c-3dad-43f1-9052-63ccc9ac07ba/tags/tempest-tag-1754556098" status: 201 len: 0 microversion: 2.26 time: 0.145378 Oct 04 22:02:01.427709 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1962/3947] 10.222.0.43 () {62 vars in 1380 bytes} [Tue Oct 4 22:02:01 2022] PUT /compute/v2.1/servers/7285a94c-3dad-43f1-9052-63ccc9ac07ba/tags/tempest-tag-1754556098 => generated 0 bytes in 147 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Oct 04 22:02:01.437653 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-18f133e8-e456-4cd2-8d5a-183b23e5d651 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Calling method '.version_select at 0x7fbb2ea03550>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:02:01.446270 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-18f133e8-e456-4cd2-8d5a-183b23e5d651 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:01.447068 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-18f133e8-e456-4cd2-8d5a-183b23e5d651 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:01.457704 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-18f133e8-e456-4cd2-8d5a-183b23e5d651 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:01.459809 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-18f133e8-e456-4cd2-8d5a-183b23e5d651 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] [instance: 7285a94c-3dad-43f1-9052-63ccc9ac07ba] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:02:01.474778 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-18f133e8-e456-4cd2-8d5a-183b23e5d651 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:01.475602 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-18f133e8-e456-4cd2-8d5a-183b23e5d651 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:01.476250 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-18f133e8-e456-4cd2-8d5a-183b23e5d651 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:01.477356 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-18f133e8-e456-4cd2-8d5a-183b23e5d651 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:01.478036 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-18f133e8-e456-4cd2-8d5a-183b23e5d651 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:01.479337 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-18f133e8-e456-4cd2-8d5a-183b23e5d651 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:01.513793 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-18f133e8-e456-4cd2-8d5a-183b23e5d651 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:01.514685 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-18f133e8-e456-4cd2-8d5a-183b23e5d651 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:01.515349 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-18f133e8-e456-4cd2-8d5a-183b23e5d651 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:01.544362 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.objects.instance [None req-18f133e8-e456-4cd2-8d5a-183b23e5d651 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lazy-loading 'flavor' on Instance uuid 7285a94c-3dad-43f1-9052-63ccc9ac07ba {{(pid=134102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 22:02:01.580015 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-18f133e8-e456-4cd2-8d5a-183b23e5d651 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] 10.222.0.43 "DELETE /compute/v2.1/servers/7285a94c-3dad-43f1-9052-63ccc9ac07ba/tags" status: 204 len: 0 microversion: 2.26 time: 0.146300 Oct 04 22:02:01.584210 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1986/3948] 10.222.0.43 () {60 vars in 1295 bytes} [Tue Oct 4 22:02:01 2022] DELETE /compute/v2.1/servers/7285a94c-3dad-43f1-9052-63ccc9ac07ba/tags => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 22:02:01.592839 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-06684e44-4a9c-424f-90bc-b1e5b958ffdf tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Calling method '.version_select at 0x7fbb2e1eb430>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:02:01.604809 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-06684e44-4a9c-424f-90bc-b1e5b958ffdf tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:01.605448 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-06684e44-4a9c-424f-90bc-b1e5b958ffdf tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:01.605897 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-06684e44-4a9c-424f-90bc-b1e5b958ffdf tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:01.613413 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=85,nova_cell1:SAVEPOINT=4,nova_cell1:INSERT=4,nova_cell1:RELEASE=4,nova_cell1:DELETE=3 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:02:01.617397 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-06684e44-4a9c-424f-90bc-b1e5b958ffdf tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] 10.222.0.43 "GET /compute/v2.1/servers/7285a94c-3dad-43f1-9052-63ccc9ac07ba/tags" status: 200 len: 12 microversion: 2.26 time: 0.032008 Oct 04 22:02:01.618420 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1963/3949] 10.222.0.43 () {60 vars in 1292 bytes} [Tue Oct 4 22:02:01 2022] GET /compute/v2.1/servers/7285a94c-3dad-43f1-9052-63ccc9ac07ba/tags => generated 12 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:02:01.628578 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-90b33788-8aaa-4ad4-873b-556223beacbb tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Calling method '.version_select at 0x7fbb37282b80>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:02:01.637278 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-90b33788-8aaa-4ad4-873b-556223beacbb tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:01.637768 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-90b33788-8aaa-4ad4-873b-556223beacbb tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:01.638269 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-90b33788-8aaa-4ad4-873b-556223beacbb tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:01.638821 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-90b33788-8aaa-4ad4-873b-556223beacbb tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] [instance: 7285a94c-3dad-43f1-9052-63ccc9ac07ba] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:02:01.647229 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-90b33788-8aaa-4ad4-873b-556223beacbb tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:01.647737 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-90b33788-8aaa-4ad4-873b-556223beacbb tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:01.648185 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-90b33788-8aaa-4ad4-873b-556223beacbb tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:01.648918 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-90b33788-8aaa-4ad4-873b-556223beacbb tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:01.649379 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-90b33788-8aaa-4ad4-873b-556223beacbb tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:01.649811 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-90b33788-8aaa-4ad4-873b-556223beacbb tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:01.695242 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-90b33788-8aaa-4ad4-873b-556223beacbb tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:01.695922 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-90b33788-8aaa-4ad4-873b-556223beacbb tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:01.696381 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-90b33788-8aaa-4ad4-873b-556223beacbb tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:01.712832 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.objects.instance [None req-90b33788-8aaa-4ad4-873b-556223beacbb tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lazy-loading 'flavor' on Instance uuid 7285a94c-3dad-43f1-9052-63ccc9ac07ba {{(pid=134102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 22:02:01.737845 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-90b33788-8aaa-4ad4-873b-556223beacbb tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] 10.222.0.43 "DELETE /compute/v2.1/servers/7285a94c-3dad-43f1-9052-63ccc9ac07ba/tags" status: 204 len: 0 microversion: 2.26 time: 0.113328 Oct 04 22:02:01.738833 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1987/3950] 10.222.0.43 () {60 vars in 1295 bytes} [Tue Oct 4 22:02:01 2022] DELETE /compute/v2.1/servers/7285a94c-3dad-43f1-9052-63ccc9ac07ba/tags => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 22:02:01.754851 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-56627411-ca82-44a0-bd36-e8ba7b28d0ac tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Calling method '.version_select at 0x7fbb2e199550>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:02:01.768473 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-56627411-ca82-44a0-bd36-e8ba7b28d0ac tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:01.769352 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-56627411-ca82-44a0-bd36-e8ba7b28d0ac tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:01.769920 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-56627411-ca82-44a0-bd36-e8ba7b28d0ac tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:01.770647 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-56627411-ca82-44a0-bd36-e8ba7b28d0ac tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] [instance: 7285a94c-3dad-43f1-9052-63ccc9ac07ba] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:02:01.780936 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-56627411-ca82-44a0-bd36-e8ba7b28d0ac tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:01.781606 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-56627411-ca82-44a0-bd36-e8ba7b28d0ac tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:01.782534 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-56627411-ca82-44a0-bd36-e8ba7b28d0ac tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:01.783381 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-56627411-ca82-44a0-bd36-e8ba7b28d0ac tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:01.784387 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-56627411-ca82-44a0-bd36-e8ba7b28d0ac tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:01.785400 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-56627411-ca82-44a0-bd36-e8ba7b28d0ac tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:01.825509 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-56627411-ca82-44a0-bd36-e8ba7b28d0ac tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:01.826533 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-56627411-ca82-44a0-bd36-e8ba7b28d0ac tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:01.827244 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-56627411-ca82-44a0-bd36-e8ba7b28d0ac tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:01.841474 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-56627411-ca82-44a0-bd36-e8ba7b28d0ac tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:01.842115 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-56627411-ca82-44a0-bd36-e8ba7b28d0ac tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:01.842968 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-56627411-ca82-44a0-bd36-e8ba7b28d0ac tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:01.927204 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.objects.instance [None req-56627411-ca82-44a0-bd36-e8ba7b28d0ac tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lazy-loading 'flavor' on Instance uuid 7285a94c-3dad-43f1-9052-63ccc9ac07ba {{(pid=134101) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 22:02:01.965781 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-f2db17a2-dc60-4a5c-b190-3d3f12842c85 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:02:01.966706 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-f2db17a2-dc60-4a5c-b190-3d3f12842c85 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: f9376877-b87d-4738-b940-2bf314c83337] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:02:01.985392 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f2db17a2-dc60-4a5c-b190-3d3f12842c85 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:01.988466 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f2db17a2-dc60-4a5c-b190-3d3f12842c85 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:01.989764 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f2db17a2-dc60-4a5c-b190-3d3f12842c85 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:01.991909 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f2db17a2-dc60-4a5c-b190-3d3f12842c85 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:01.993069 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-56627411-ca82-44a0-bd36-e8ba7b28d0ac tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] 10.222.0.43 "PUT /compute/v2.1/servers/7285a94c-3dad-43f1-9052-63ccc9ac07ba/tags/tempest-tag-1318718516" status: 201 len: 0 microversion: 2.26 time: 0.244859 Oct 04 22:02:01.995051 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f2db17a2-dc60-4a5c-b190-3d3f12842c85 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:01.999161 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1964/3951] 10.222.0.43 () {62 vars in 1380 bytes} [Tue Oct 4 22:02:01 2022] PUT /compute/v2.1/servers/7285a94c-3dad-43f1-9052-63ccc9ac07ba/tags/tempest-tag-1318718516 => generated 0 bytes in 255 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Oct 04 22:02:02.000155 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f2db17a2-dc60-4a5c-b190-3d3f12842c85 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:02.021170 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-ee76d558-adad-4a0b-b825-675d178a2e13 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Calling method '.version_select at 0x7fbb2e242430>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:02:02.061047 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ee76d558-adad-4a0b-b825-675d178a2e13 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:02.067400 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ee76d558-adad-4a0b-b825-675d178a2e13 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:02.068142 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ee76d558-adad-4a0b-b825-675d178a2e13 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:02.068653 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-ee76d558-adad-4a0b-b825-675d178a2e13 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] [instance: 7285a94c-3dad-43f1-9052-63ccc9ac07ba] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:02:02.081352 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=100 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:02:02.082827 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ee76d558-adad-4a0b-b825-675d178a2e13 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:02.089212 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ee76d558-adad-4a0b-b825-675d178a2e13 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:02.089808 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ee76d558-adad-4a0b-b825-675d178a2e13 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:02.090611 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ee76d558-adad-4a0b-b825-675d178a2e13 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:02.091092 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ee76d558-adad-4a0b-b825-675d178a2e13 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:02.091529 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ee76d558-adad-4a0b-b825-675d178a2e13 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:02.177751 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ee76d558-adad-4a0b-b825-675d178a2e13 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:02.178252 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ee76d558-adad-4a0b-b825-675d178a2e13 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:02.178754 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ee76d558-adad-4a0b-b825-675d178a2e13 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:02.208007 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ee76d558-adad-4a0b-b825-675d178a2e13 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:02.208437 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ee76d558-adad-4a0b-b825-675d178a2e13 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:02.208888 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ee76d558-adad-4a0b-b825-675d178a2e13 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:02.299744 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.objects.instance [None req-ee76d558-adad-4a0b-b825-675d178a2e13 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lazy-loading 'flavor' on Instance uuid 7285a94c-3dad-43f1-9052-63ccc9ac07ba {{(pid=134101) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 22:02:02.324425 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-ee76d558-adad-4a0b-b825-675d178a2e13 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] 10.222.0.43 "PUT /compute/v2.1/servers/7285a94c-3dad-43f1-9052-63ccc9ac07ba/tags/tempest-tag-376920021" status: 201 len: 0 microversion: 2.26 time: 0.318348 Oct 04 22:02:02.325876 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1965/3952] 10.222.0.43 () {62 vars in 1377 bytes} [Tue Oct 4 22:02:02 2022] PUT /compute/v2.1/servers/7285a94c-3dad-43f1-9052-63ccc9ac07ba/tags/tempest-tag-376920021 => generated 0 bytes in 321 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Oct 04 22:02:02.337252 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-9298c58c-4015-49b8-82ad-ed1ea5e2a860 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Action: 'update_all', calling method: .version_select at 0x7fbb2e19f4c0>, body: {"tags": ["tempest-tag-152357449", "tempest-tag-929589843"]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:02:02.351149 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9298c58c-4015-49b8-82ad-ed1ea5e2a860 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:02.351921 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9298c58c-4015-49b8-82ad-ed1ea5e2a860 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:02.352723 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9298c58c-4015-49b8-82ad-ed1ea5e2a860 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:02.353434 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-9298c58c-4015-49b8-82ad-ed1ea5e2a860 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] [instance: 7285a94c-3dad-43f1-9052-63ccc9ac07ba] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:02:02.361662 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9298c58c-4015-49b8-82ad-ed1ea5e2a860 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:02.362525 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9298c58c-4015-49b8-82ad-ed1ea5e2a860 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:02.363111 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9298c58c-4015-49b8-82ad-ed1ea5e2a860 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:02.363972 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9298c58c-4015-49b8-82ad-ed1ea5e2a860 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:02.364744 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9298c58c-4015-49b8-82ad-ed1ea5e2a860 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:02.365830 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9298c58c-4015-49b8-82ad-ed1ea5e2a860 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:02.377616 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-f2db17a2-dc60-4a5c-b190-3d3f12842c85 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a1c8d841104bc9b6910bcc2c0e2bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe9283584fc4d90b0715216d867ea2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:02:02.387495 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-f2db17a2-dc60-4a5c-b190-3d3f12842c85 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "GET /compute/v2.1/servers/f9376877-b87d-4738-b940-2bf314c83337" status: 200 len: 1315 microversion: 2.1 time: 0.428018 Oct 04 22:02:02.399699 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1988/3953] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:02:01 2022] GET /compute/v2.1/servers/f9376877-b87d-4738-b940-2bf314c83337 => generated 1315 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:02:02.405707 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9298c58c-4015-49b8-82ad-ed1ea5e2a860 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:02.406689 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9298c58c-4015-49b8-82ad-ed1ea5e2a860 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:02.407209 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9298c58c-4015-49b8-82ad-ed1ea5e2a860 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:02.412949 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-c8bb1ce5-f7c5-4fa7-9114-f38c989c13ed tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:02:02.413692 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-c8bb1ce5-f7c5-4fa7-9114-f38c989c13ed tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] [instance: 3dbe541d-234a-4049-befd-dcd9a67dbd46] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:02:02.437417 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c8bb1ce5-f7c5-4fa7-9114-f38c989c13ed tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:02.438309 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c8bb1ce5-f7c5-4fa7-9114-f38c989c13ed tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:02.439017 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c8bb1ce5-f7c5-4fa7-9114-f38c989c13ed tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:02.440825 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c8bb1ce5-f7c5-4fa7-9114-f38c989c13ed tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:02.441569 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c8bb1ce5-f7c5-4fa7-9114-f38c989c13ed tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:02.442205 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c8bb1ce5-f7c5-4fa7-9114-f38c989c13ed tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:02.443944 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.objects.instance [None req-9298c58c-4015-49b8-82ad-ed1ea5e2a860 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lazy-loading 'flavor' on Instance uuid 7285a94c-3dad-43f1-9052-63ccc9ac07ba {{(pid=134101) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 22:02:02.482570 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-9298c58c-4015-49b8-82ad-ed1ea5e2a860 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] 10.222.0.43 "PUT /compute/v2.1/servers/7285a94c-3dad-43f1-9052-63ccc9ac07ba/tags" status: 200 len: 60 microversion: 2.26 time: 0.149746 Oct 04 22:02:02.483241 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1966/3954] 10.222.0.43 () {62 vars in 1312 bytes} [Tue Oct 4 22:02:02 2022] PUT /compute/v2.1/servers/7285a94c-3dad-43f1-9052-63ccc9ac07ba/tags => generated 60 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:02:02.487835 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-4539957d-2dde-459e-baee-bbe479028277 req-2a4a5ceb-6928-4e43-a4e6-5754de5c174b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3dbe541d-234a-4049-befd-dcd9a67dbd46", "name": "network-vif-unplugged", "status": "completed", "tag": "f1ab3076-8442-4ba9-915a-127e680713f3"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:02:02.514594 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-4539957d-2dde-459e-baee-bbe479028277 req-2a4a5ceb-6928-4e43-a4e6-5754de5c174b service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:02.515082 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-4539957d-2dde-459e-baee-bbe479028277 req-2a4a5ceb-6928-4e43-a4e6-5754de5c174b service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:02.515517 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-4539957d-2dde-459e-baee-bbe479028277 req-2a4a5ceb-6928-4e43-a4e6-5754de5c174b service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:02.546455 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-4539957d-2dde-459e-baee-bbe479028277 req-2a4a5ceb-6928-4e43-a4e6-5754de5c174b service nova] Creating event network-vif-unplugged:f1ab3076-8442-4ba9-915a-127e680713f3 for instance 3dbe541d-234a-4049-befd-dcd9a67dbd46 on n-h1-860284-1 Oct 04 22:02:02.551983 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-4539957d-2dde-459e-baee-bbe479028277 req-2a4a5ceb-6928-4e43-a4e6-5754de5c174b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.067528 Oct 04 22:02:02.552609 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1967/3955] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:02:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:02:02.558114 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-440c3ba9-0911-48b9-8dee-b4e4bc8f16a9 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Calling method '.version_select at 0x7fbb2e243a60>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:02:02.581364 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-440c3ba9-0911-48b9-8dee-b4e4bc8f16a9 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:02.581877 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-440c3ba9-0911-48b9-8dee-b4e4bc8f16a9 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:02.582296 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-440c3ba9-0911-48b9-8dee-b4e4bc8f16a9 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:02.612295 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-440c3ba9-0911-48b9-8dee-b4e4bc8f16a9 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] 10.222.0.43 "GET /compute/v2.1/servers/7285a94c-3dad-43f1-9052-63ccc9ac07ba/tags" status: 200 len: 60 microversion: 2.26 time: 0.057869 Oct 04 22:02:02.612988 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1968/3956] 10.222.0.43 () {60 vars in 1292 bytes} [Tue Oct 4 22:02:02 2022] GET /compute/v2.1/servers/7285a94c-3dad-43f1-9052-63ccc9ac07ba/tags => generated 60 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:02:02.625547 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e94ba070-112e-47f5-9f4b-f60f8b91e009 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Calling method '.version_select at 0x7fbb2e6c0040>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:02:02.638940 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e94ba070-112e-47f5-9f4b-f60f8b91e009 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:02.639437 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e94ba070-112e-47f5-9f4b-f60f8b91e009 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:02.639882 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e94ba070-112e-47f5-9f4b-f60f8b91e009 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:02.640489 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-e94ba070-112e-47f5-9f4b-f60f8b91e009 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] [instance: 7285a94c-3dad-43f1-9052-63ccc9ac07ba] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:02:02.659454 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e94ba070-112e-47f5-9f4b-f60f8b91e009 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:02.659956 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e94ba070-112e-47f5-9f4b-f60f8b91e009 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:02.660398 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e94ba070-112e-47f5-9f4b-f60f8b91e009 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:02.660958 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-c8bb1ce5-f7c5-4fa7-9114-f38c989c13ed tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2034fc9060874868bc5d27370a1c351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89499d833a4a00805164f4f79ed522', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:02:02.674578 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e94ba070-112e-47f5-9f4b-f60f8b91e009 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:02.674578 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e94ba070-112e-47f5-9f4b-f60f8b91e009 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:02.674578 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e94ba070-112e-47f5-9f4b-f60f8b91e009 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:02.674854 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-c8bb1ce5-f7c5-4fa7-9114-f38c989c13ed tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] 10.222.0.43 "GET /compute/v2.1/servers/3dbe541d-234a-4049-befd-dcd9a67dbd46" status: 200 len: 1522 microversion: 2.1 time: 0.267263 Oct 04 22:02:02.674854 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1989/3957] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:02:02 2022] GET /compute/v2.1/servers/3dbe541d-234a-4049-befd-dcd9a67dbd46 => generated 1522 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:02:02.746331 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e94ba070-112e-47f5-9f4b-f60f8b91e009 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:02.746902 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e94ba070-112e-47f5-9f4b-f60f8b91e009 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:02.747375 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e94ba070-112e-47f5-9f4b-f60f8b91e009 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:02.793492 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.objects.instance [None req-e94ba070-112e-47f5-9f4b-f60f8b91e009 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lazy-loading 'flavor' on Instance uuid 7285a94c-3dad-43f1-9052-63ccc9ac07ba {{(pid=134101) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 22:02:02.819928 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-e94ba070-112e-47f5-9f4b-f60f8b91e009 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] 10.222.0.43 "DELETE /compute/v2.1/servers/7285a94c-3dad-43f1-9052-63ccc9ac07ba/tags" status: 204 len: 0 microversion: 2.26 time: 0.200396 Oct 04 22:02:02.820777 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1969/3958] 10.222.0.43 () {60 vars in 1295 bytes} [Tue Oct 4 22:02:02 2022] DELETE /compute/v2.1/servers/7285a94c-3dad-43f1-9052-63ccc9ac07ba/tags => generated 0 bytes in 202 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 04 22:02:02.832158 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-ec20154c-d817-4c53-a7a7-db8a7a28bd33 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:02:02.832743 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-ec20154c-d817-4c53-a7a7-db8a7a28bd33 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] [instance: 7285a94c-3dad-43f1-9052-63ccc9ac07ba] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:02:02.847680 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ec20154c-d817-4c53-a7a7-db8a7a28bd33 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:02.856725 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ec20154c-d817-4c53-a7a7-db8a7a28bd33 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:02.857237 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ec20154c-d817-4c53-a7a7-db8a7a28bd33 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:02.858019 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ec20154c-d817-4c53-a7a7-db8a7a28bd33 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:02.858545 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ec20154c-d817-4c53-a7a7-db8a7a28bd33 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:02.858985 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ec20154c-d817-4c53-a7a7-db8a7a28bd33 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:02.890797 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-ec20154c-d817-4c53-a7a7-db8a7a28bd33 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] [instance: 7285a94c-3dad-43f1-9052-63ccc9ac07ba] Going to try to terminate instance {{(pid=134102) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 22:02:03.081819 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-ec20154c-d817-4c53-a7a7-db8a7a28bd33 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] 10.222.0.43 "DELETE /compute/v2.1/servers/7285a94c-3dad-43f1-9052-63ccc9ac07ba" status: 204 len: 0 microversion: 2.26 time: 0.254632 Oct 04 22:02:03.082636 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1990/3959] 10.222.0.43 () {60 vars in 1280 bytes} [Tue Oct 4 22:02:02 2022] DELETE /compute/v2.1/servers/7285a94c-3dad-43f1-9052-63ccc9ac07ba => generated 0 bytes in 256 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 22:02:03.093001 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-1e96cc80-777d-469b-b330-c3f18353221c tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:02:03.093637 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-1e96cc80-777d-469b-b330-c3f18353221c tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] [instance: 7285a94c-3dad-43f1-9052-63ccc9ac07ba] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:02:03.110188 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1e96cc80-777d-469b-b330-c3f18353221c tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:03.110997 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1e96cc80-777d-469b-b330-c3f18353221c tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:03.111652 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1e96cc80-777d-469b-b330-c3f18353221c tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:03.112589 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1e96cc80-777d-469b-b330-c3f18353221c tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:03.113244 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1e96cc80-777d-469b-b330-c3f18353221c tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:03.113856 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1e96cc80-777d-469b-b330-c3f18353221c tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:03.415287 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-5e574cae-39c3-48d1-a6f5-cfe5c63d2128 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:02:03.416065 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-5e574cae-39c3-48d1-a6f5-cfe5c63d2128 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: f9376877-b87d-4738-b940-2bf314c83337] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:02:03.425745 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5e574cae-39c3-48d1-a6f5-cfe5c63d2128 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:03.426675 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5e574cae-39c3-48d1-a6f5-cfe5c63d2128 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:03.427360 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5e574cae-39c3-48d1-a6f5-cfe5c63d2128 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:03.428307 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5e574cae-39c3-48d1-a6f5-cfe5c63d2128 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:03.428985 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5e574cae-39c3-48d1-a6f5-cfe5c63d2128 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:03.429781 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5e574cae-39c3-48d1-a6f5-cfe5c63d2128 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:04.021361 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-5e574cae-39c3-48d1-a6f5-cfe5c63d2128 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a1c8d841104bc9b6910bcc2c0e2bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe9283584fc4d90b0715216d867ea2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:02:04.030870 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-5e574cae-39c3-48d1-a6f5-cfe5c63d2128 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "GET /compute/v2.1/servers/f9376877-b87d-4738-b940-2bf314c83337" status: 200 len: 1315 microversion: 2.1 time: 0.621174 Oct 04 22:02:04.031479 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1991/3960] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:02:03 2022] GET /compute/v2.1/servers/f9376877-b87d-4738-b940-2bf314c83337 => generated 1315 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:02:04.037873 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-b7c92ed9-1008-4ea2-af8c-3e1e6ed91407 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:02:04.042645 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-b7c92ed9-1008-4ea2-af8c-3e1e6ed91407 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] [instance: 3dbe541d-234a-4049-befd-dcd9a67dbd46] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:02:04.048407 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-1e96cc80-777d-469b-b330-c3f18353221c tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3adbba85c5a448148833e69d6304e62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b710cb6300854d8683bd52ddf56b787d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:02:04.060910 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-1e96cc80-777d-469b-b330-c3f18353221c tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3adbba85c5a448148833e69d6304e62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b710cb6300854d8683bd52ddf56b787d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:02:04.062352 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-1e96cc80-777d-469b-b330-c3f18353221c tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3adbba85c5a448148833e69d6304e62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b710cb6300854d8683bd52ddf56b787d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:02:04.066875 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b7c92ed9-1008-4ea2-af8c-3e1e6ed91407 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:04.067387 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b7c92ed9-1008-4ea2-af8c-3e1e6ed91407 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:04.067839 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b7c92ed9-1008-4ea2-af8c-3e1e6ed91407 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:04.068584 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b7c92ed9-1008-4ea2-af8c-3e1e6ed91407 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:04.069043 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b7c92ed9-1008-4ea2-af8c-3e1e6ed91407 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:04.069475 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b7c92ed9-1008-4ea2-af8c-3e1e6ed91407 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:04.070450 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-1e96cc80-777d-469b-b330-c3f18353221c tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] 10.222.0.43 "GET /compute/v2.1/servers/7285a94c-3dad-43f1-9052-63ccc9ac07ba" status: 200 len: 1552 microversion: 2.26 time: 0.982437 Oct 04 22:02:04.075937 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1970/3961] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:02:03 2022] GET /compute/v2.1/servers/7285a94c-3dad-43f1-9052-63ccc9ac07ba => generated 1552 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:02:04.080731 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-23a3f6d2-0e5d-4ba5-ae9f-912004134a00 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:02:04.081229 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-23a3f6d2-0e5d-4ba5-ae9f-912004134a00 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: dd1b7876-cc6f-4ed3-a0e4-cfe2213b332f] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:02:04.098080 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-23a3f6d2-0e5d-4ba5-ae9f-912004134a00 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:04.098692 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-23a3f6d2-0e5d-4ba5-ae9f-912004134a00 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:04.099062 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-23a3f6d2-0e5d-4ba5-ae9f-912004134a00 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:04.099764 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-23a3f6d2-0e5d-4ba5-ae9f-912004134a00 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:04.100220 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-23a3f6d2-0e5d-4ba5-ae9f-912004134a00 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:04.100642 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-23a3f6d2-0e5d-4ba5-ae9f-912004134a00 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:04.154476 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-23a3f6d2-0e5d-4ba5-ae9f-912004134a00 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] HTTP exception thrown: Instance dd1b7876-cc6f-4ed3-a0e4-cfe2213b332f could not be found. Oct 04 22:02:04.159196 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-23a3f6d2-0e5d-4ba5-ae9f-912004134a00 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Request method failure captured: Oct 04 22:02:04.159196 n-d-860284-1 devstack@n-api.service[134101]: request: DELETE /compute/v2.1/servers/dd1b7876-cc6f-4ed3-a0e4-cfe2213b332f HTTP/1.1 Oct 04 22:02:04.159196 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 22:02:04.159196 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 22:02:04.159196 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 22:02:04.159196 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 22:02:04.159196 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 22:02:04.159196 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 22:02:04.159196 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 22:02:04.159196 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 22:02:04.159196 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPKwu4cpW6hhBuWb-qV_7iYlwjOTpf5XWCl53BJjoosjlcj4wkmmOFzemCJVdBntIx8zJ1SF_z6VrRY8UJr7E8TQDJCRnVQMdNnh0-lZwGdqUzjOWSO31Ryb6n87Cka0g238a21JWok3h3GEhLB-7oCbN3bbcOGmkhd6UFueRxRluk24 Oct 04 22:02:04.159196 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 22:02:04.159196 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 22:02:04.159196 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 22:02:04.159196 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 22:02:04.159196 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 22:02:04.159196 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 22:02:04.159196 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: cf07a17a482a4e92b6ddbdee463c8029 Oct 04 22:02:04.159196 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-ServersNegativeTestJSON-1933663319 Oct 04 22:02:04.159196 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 22:02:04.159196 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 22:02:04.159196 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/cf07a17a482a4e92b6ddbdee463c8029"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_cf07a17a482a4e92b6ddbdee463c8029", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/cf07a17a482a4e92b6ddbdee463c8029"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/cf07a17a482a4e92b6ddbdee463c8029"}]}] Oct 04 22:02:04.159196 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-ServersNegativeTestJSON-1933663319 Oct 04 22:02:04.159196 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: cf07a17a482a4e92b6ddbdee463c8029 Oct 04 22:02:04.159196 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1933663319 Oct 04 22:02:04.159196 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-ServersNegativeTestJSON-1933663319-project Oct 04 22:02:04.159196 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 22:02:04.159196 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 22:02:04.159196 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 2facee4c6a40416e908083e126d2cfa3 Oct 04 22:02:04.159196 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-ServersNegativeTestJSON-1933663319-project Oct 04 22:02:04.159196 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 22:02:04.159196 n-d-860284-1 devstack@n-api.service[134101]: exception: Instance dd1b7876-cc6f-4ed3-a0e4-cfe2213b332f could not be found. Oct 04 22:02:04.159196 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': 'dd1b7876-cc6f-4ed3-a0e4-cfe2213b332f'} Oct 04 22:02:04.159196 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:02:04.159196 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:02:04.159196 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:02:04.159196 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:02:04.159196 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:02:04.159196 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:02:04.159196 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:02:04.159196 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:02:04.159196 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:02:04.159196 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:02:04.159196 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd1b7876-cc6f-4ed3-a0e4-cfe2213b332f could not be found. Oct 04 22:02:04.159196 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:02:04.159196 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:02:04.159196 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:02:04.159196 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:02:04.159196 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:02:04.159196 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:02:04.159196 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:02:04.159196 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:02:04.159196 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:02:04.159196 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:02:04.159196 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 22:02:04.159196 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 22:02:04.159196 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 22:02:04.159196 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 22:02:04.159196 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:02:04.159196 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:02:04.159196 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:02:04.159196 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:02:04.162182 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd1b7876-cc6f-4ed3-a0e4-cfe2213b332f could not be found. Oct 04 22:02:04.162182 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:02:04.162182 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:02:04.162182 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:02:04.162182 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:02:04.162182 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:02:04.162182 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:02:04.162182 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:02:04.162182 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:02:04.162182 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd1b7876-cc6f-4ed3-a0e4-cfe2213b332f could not be found. Oct 04 22:02:04.162182 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:02:04.162182 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-23a3f6d2-0e5d-4ba5-ae9f-912004134a00 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Returning 404 to user: Instance dd1b7876-cc6f-4ed3-a0e4-cfe2213b332f could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:02:04.162182 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-23a3f6d2-0e5d-4ba5-ae9f-912004134a00 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "DELETE /compute/v2.1/servers/dd1b7876-cc6f-4ed3-a0e4-cfe2213b332f" status: 404 len: 111 microversion: 2.1 time: 0.083797 Oct 04 22:02:04.162182 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1971/3962] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 22:02:04 2022] DELETE /compute/v2.1/servers/dd1b7876-cc6f-4ed3-a0e4-cfe2213b332f => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:02:04.194727 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-97ccf3d7-9234-4184-aa58-b2778f297ff6 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:02:04.196300 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-97ccf3d7-9234-4184-aa58-b2778f297ff6 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: dd1b7876-cc6f-4ed3-a0e4-cfe2213b332f] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:02:04.218104 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-97ccf3d7-9234-4184-aa58-b2778f297ff6 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:04.218716 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-97ccf3d7-9234-4184-aa58-b2778f297ff6 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:04.219506 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-97ccf3d7-9234-4184-aa58-b2778f297ff6 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:04.220787 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-97ccf3d7-9234-4184-aa58-b2778f297ff6 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:04.221622 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-97ccf3d7-9234-4184-aa58-b2778f297ff6 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:04.222435 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-97ccf3d7-9234-4184-aa58-b2778f297ff6 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:04.256216 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-97ccf3d7-9234-4184-aa58-b2778f297ff6 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] HTTP exception thrown: Instance dd1b7876-cc6f-4ed3-a0e4-cfe2213b332f could not be found. Oct 04 22:02:04.257952 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-97ccf3d7-9234-4184-aa58-b2778f297ff6 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Request method failure captured: Oct 04 22:02:04.257952 n-d-860284-1 devstack@n-api.service[134101]: request: GET /compute/v2.1/servers/dd1b7876-cc6f-4ed3-a0e4-cfe2213b332f HTTP/1.1 Oct 04 22:02:04.257952 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 22:02:04.257952 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 22:02:04.257952 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 22:02:04.257952 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 22:02:04.257952 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 22:02:04.257952 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 22:02:04.257952 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 22:02:04.257952 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 22:02:04.257952 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPKwu4cpW6hhBuWb-qV_7iYlwjOTpf5XWCl53BJjoosjlcj4wkmmOFzemCJVdBntIx8zJ1SF_z6VrRY8UJr7E8TQDJCRnVQMdNnh0-lZwGdqUzjOWSO31Ryb6n87Cka0g238a21JWok3h3GEhLB-7oCbN3bbcOGmkhd6UFueRxRluk24 Oct 04 22:02:04.257952 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 22:02:04.257952 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 22:02:04.257952 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 22:02:04.257952 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 22:02:04.257952 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 22:02:04.257952 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 22:02:04.257952 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: cf07a17a482a4e92b6ddbdee463c8029 Oct 04 22:02:04.257952 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-ServersNegativeTestJSON-1933663319 Oct 04 22:02:04.257952 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 22:02:04.257952 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 22:02:04.257952 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/cf07a17a482a4e92b6ddbdee463c8029"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_cf07a17a482a4e92b6ddbdee463c8029", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/cf07a17a482a4e92b6ddbdee463c8029"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/cf07a17a482a4e92b6ddbdee463c8029"}]}] Oct 04 22:02:04.257952 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-ServersNegativeTestJSON-1933663319 Oct 04 22:02:04.257952 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: cf07a17a482a4e92b6ddbdee463c8029 Oct 04 22:02:04.257952 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1933663319 Oct 04 22:02:04.257952 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-ServersNegativeTestJSON-1933663319-project Oct 04 22:02:04.257952 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 22:02:04.257952 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 22:02:04.257952 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 2facee4c6a40416e908083e126d2cfa3 Oct 04 22:02:04.257952 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-ServersNegativeTestJSON-1933663319-project Oct 04 22:02:04.257952 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 22:02:04.257952 n-d-860284-1 devstack@n-api.service[134101]: exception: Instance dd1b7876-cc6f-4ed3-a0e4-cfe2213b332f could not be found. Oct 04 22:02:04.257952 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': 'dd1b7876-cc6f-4ed3-a0e4-cfe2213b332f'} Oct 04 22:02:04.257952 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:02:04.257952 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:02:04.257952 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:02:04.257952 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:02:04.257952 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:02:04.257952 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:02:04.257952 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:02:04.257952 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:02:04.257952 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:02:04.257952 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:02:04.257952 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd1b7876-cc6f-4ed3-a0e4-cfe2213b332f could not be found. Oct 04 22:02:04.257952 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:02:04.257952 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:02:04.257952 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:02:04.257952 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:02:04.257952 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:02:04.257952 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:02:04.257952 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:02:04.257952 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:02:04.257952 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:02:04.257952 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:02:04.257952 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:02:04.257952 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:02:04.257952 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:02:04.257952 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:02:04.257952 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:02:04.257952 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:02:04.257952 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd1b7876-cc6f-4ed3-a0e4-cfe2213b332f could not be found. Oct 04 22:02:04.257952 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:02:04.257952 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:02:04.257952 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:02:04.261036 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:02:04.261036 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:02:04.261036 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:02:04.261036 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:02:04.261036 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:02:04.261036 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd1b7876-cc6f-4ed3-a0e4-cfe2213b332f could not be found. Oct 04 22:02:04.261036 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:02:04.261036 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-97ccf3d7-9234-4184-aa58-b2778f297ff6 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Returning 404 to user: Instance dd1b7876-cc6f-4ed3-a0e4-cfe2213b332f could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:02:04.261036 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-97ccf3d7-9234-4184-aa58-b2778f297ff6 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/dd1b7876-cc6f-4ed3-a0e4-cfe2213b332f" status: 404 len: 111 microversion: 2.1 time: 0.083015 Oct 04 22:02:04.263620 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1972/3963] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:02:04 2022] GET /compute/v2.1/servers/dd1b7876-cc6f-4ed3-a0e4-cfe2213b332f => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:02:04.274261 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-b67f8fa6-8367-442d-be2b-fafac5c2682d tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:02:04.274869 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-b67f8fa6-8367-442d-be2b-fafac5c2682d tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: a4cf4fac-1e9b-4669-a6ff-30008ed3642d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:02:04.288453 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b67f8fa6-8367-442d-be2b-fafac5c2682d tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:04.288884 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b67f8fa6-8367-442d-be2b-fafac5c2682d tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:04.289677 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b67f8fa6-8367-442d-be2b-fafac5c2682d tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:04.290577 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b67f8fa6-8367-442d-be2b-fafac5c2682d tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:04.291869 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b67f8fa6-8367-442d-be2b-fafac5c2682d tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:04.292320 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b67f8fa6-8367-442d-be2b-fafac5c2682d tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:04.325209 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-b67f8fa6-8367-442d-be2b-fafac5c2682d tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: a4cf4fac-1e9b-4669-a6ff-30008ed3642d] Going to try to terminate instance {{(pid=134101) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 22:02:04.455468 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-b67f8fa6-8367-442d-be2b-fafac5c2682d tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "DELETE /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d" status: 204 len: 0 microversion: 2.1 time: 0.190284 Oct 04 22:02:04.460374 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1973/3964] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 22:02:04 2022] DELETE /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d => generated 0 bytes in 192 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 22:02:04.469856 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-d82282f7-c286-4796-a1c7-297c7ec97cb4 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:02:04.470868 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-d82282f7-c286-4796-a1c7-297c7ec97cb4 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: a4cf4fac-1e9b-4669-a6ff-30008ed3642d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:02:04.480869 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d82282f7-c286-4796-a1c7-297c7ec97cb4 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:04.481458 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d82282f7-c286-4796-a1c7-297c7ec97cb4 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:04.482252 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d82282f7-c286-4796-a1c7-297c7ec97cb4 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:04.484541 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d82282f7-c286-4796-a1c7-297c7ec97cb4 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:04.485092 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d82282f7-c286-4796-a1c7-297c7ec97cb4 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:04.485525 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d82282f7-c286-4796-a1c7-297c7ec97cb4 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:04.690838 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-b7c92ed9-1008-4ea2-af8c-3e1e6ed91407 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2034fc9060874868bc5d27370a1c351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89499d833a4a00805164f4f79ed522', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:02:04.706646 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-b7c92ed9-1008-4ea2-af8c-3e1e6ed91407 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] 10.222.0.43 "GET /compute/v2.1/servers/3dbe541d-234a-4049-befd-dcd9a67dbd46" status: 200 len: 1522 microversion: 2.1 time: 0.673507 Oct 04 22:02:04.707991 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1992/3965] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:02:04 2022] GET /compute/v2.1/servers/3dbe541d-234a-4049-befd-dcd9a67dbd46 => generated 1522 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:02:04.800485 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-d82282f7-c286-4796-a1c7-297c7ec97cb4 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2facee4c6a40416e908083e126d2cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07a17a482a4e92b6ddbdee463c8029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:02:04.818102 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-d82282f7-c286-4796-a1c7-297c7ec97cb4 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d" status: 200 len: 1510 microversion: 2.1 time: 0.356173 Oct 04 22:02:04.837723 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1974/3966] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:02:04 2022] GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d => generated 1510 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:02:05.061666 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-04ad9959-c483-4545-aab5-aa9954dad7dc tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:02:05.062951 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-04ad9959-c483-4545-aab5-aa9954dad7dc tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: f9376877-b87d-4738-b940-2bf314c83337] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:02:05.070237 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-04ad9959-c483-4545-aab5-aa9954dad7dc tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:05.071076 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-04ad9959-c483-4545-aab5-aa9954dad7dc tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:05.071620 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-04ad9959-c483-4545-aab5-aa9954dad7dc tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:05.072668 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-04ad9959-c483-4545-aab5-aa9954dad7dc tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:05.073401 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-04ad9959-c483-4545-aab5-aa9954dad7dc tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:05.074042 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-04ad9959-c483-4545-aab5-aa9954dad7dc tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:05.104728 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-220ae854-39ba-4e42-93c4-e8ca6eb29d75 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:02:05.105370 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-220ae854-39ba-4e42-93c4-e8ca6eb29d75 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] [instance: 7285a94c-3dad-43f1-9052-63ccc9ac07ba] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:02:05.112195 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-220ae854-39ba-4e42-93c4-e8ca6eb29d75 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:05.113011 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-220ae854-39ba-4e42-93c4-e8ca6eb29d75 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:05.113700 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-220ae854-39ba-4e42-93c4-e8ca6eb29d75 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:05.115536 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-220ae854-39ba-4e42-93c4-e8ca6eb29d75 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:05.116228 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-220ae854-39ba-4e42-93c4-e8ca6eb29d75 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:05.116874 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-220ae854-39ba-4e42-93c4-e8ca6eb29d75 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:05.509422 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-220ae854-39ba-4e42-93c4-e8ca6eb29d75 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3adbba85c5a448148833e69d6304e62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b710cb6300854d8683bd52ddf56b787d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:02:05.524072 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-220ae854-39ba-4e42-93c4-e8ca6eb29d75 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3adbba85c5a448148833e69d6304e62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b710cb6300854d8683bd52ddf56b787d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:02:05.526101 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-220ae854-39ba-4e42-93c4-e8ca6eb29d75 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3adbba85c5a448148833e69d6304e62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b710cb6300854d8683bd52ddf56b787d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:02:05.527586 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-220ae854-39ba-4e42-93c4-e8ca6eb29d75 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] 10.222.0.43 "GET /compute/v2.1/servers/7285a94c-3dad-43f1-9052-63ccc9ac07ba" status: 200 len: 1552 microversion: 2.26 time: 0.427427 Oct 04 22:02:05.530999 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1975/3967] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:02:05 2022] GET /compute/v2.1/servers/7285a94c-3dad-43f1-9052-63ccc9ac07ba => generated 1552 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 22:02:05.554758 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-04ad9959-c483-4545-aab5-aa9954dad7dc tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a1c8d841104bc9b6910bcc2c0e2bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe9283584fc4d90b0715216d867ea2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:02:05.578155 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-04ad9959-c483-4545-aab5-aa9954dad7dc tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "GET /compute/v2.1/servers/f9376877-b87d-4738-b940-2bf314c83337" status: 200 len: 1503 microversion: 2.1 time: 0.521564 Oct 04 22:02:05.582031 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1993/3968] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:02:05 2022] GET /compute/v2.1/servers/f9376877-b87d-4738-b940-2bf314c83337 => generated 1503 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:02:05.745542 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-d574b96a-0154-4dbf-836a-b7d5ab2da7dc tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:02:05.746125 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-d574b96a-0154-4dbf-836a-b7d5ab2da7dc tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] [instance: 3dbe541d-234a-4049-befd-dcd9a67dbd46] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:02:05.757968 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d574b96a-0154-4dbf-836a-b7d5ab2da7dc tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:05.758493 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d574b96a-0154-4dbf-836a-b7d5ab2da7dc tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:05.767862 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d574b96a-0154-4dbf-836a-b7d5ab2da7dc tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:05.768893 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d574b96a-0154-4dbf-836a-b7d5ab2da7dc tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:05.771289 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d574b96a-0154-4dbf-836a-b7d5ab2da7dc tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:05.771754 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d574b96a-0154-4dbf-836a-b7d5ab2da7dc tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:05.779832 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=89,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=4,nova_cell1:RELEASE=2,nova_cell1:DELETE=2,nova_cell1:UPDATE=1 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:02:05.846533 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-3174acae-ce3b-49fa-b17e-1b9235ff9696 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:02:05.847274 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-3174acae-ce3b-49fa-b17e-1b9235ff9696 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: a4cf4fac-1e9b-4669-a6ff-30008ed3642d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:02:05.857810 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3174acae-ce3b-49fa-b17e-1b9235ff9696 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:05.860726 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3174acae-ce3b-49fa-b17e-1b9235ff9696 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:05.864025 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3174acae-ce3b-49fa-b17e-1b9235ff9696 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:05.867411 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3174acae-ce3b-49fa-b17e-1b9235ff9696 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:05.867967 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3174acae-ce3b-49fa-b17e-1b9235ff9696 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:05.868403 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3174acae-ce3b-49fa-b17e-1b9235ff9696 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:06.230742 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-d574b96a-0154-4dbf-836a-b7d5ab2da7dc tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2034fc9060874868bc5d27370a1c351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89499d833a4a00805164f4f79ed522', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:02:06.243840 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-d574b96a-0154-4dbf-836a-b7d5ab2da7dc tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] 10.222.0.43 "GET /compute/v2.1/servers/3dbe541d-234a-4049-befd-dcd9a67dbd46" status: 200 len: 1522 microversion: 2.1 time: 0.502535 Oct 04 22:02:06.254545 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1976/3969] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:02:05 2022] GET /compute/v2.1/servers/3dbe541d-234a-4049-befd-dcd9a67dbd46 => generated 1522 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:02:06.281447 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-3174acae-ce3b-49fa-b17e-1b9235ff9696 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2facee4c6a40416e908083e126d2cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07a17a482a4e92b6ddbdee463c8029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:02:06.293223 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-3174acae-ce3b-49fa-b17e-1b9235ff9696 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d" status: 200 len: 1510 microversion: 2.1 time: 0.451265 Oct 04 22:02:06.296303 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1994/3970] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:02:05 2022] GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d => generated 1510 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:02:06.558494 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-8d8664aa-0f32-495f-b9d1-c03803c61b9e tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:02:06.558494 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-8d8664aa-0f32-495f-b9d1-c03803c61b9e tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] [instance: 7285a94c-3dad-43f1-9052-63ccc9ac07ba] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:02:06.574247 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8d8664aa-0f32-495f-b9d1-c03803c61b9e tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:06.585964 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8d8664aa-0f32-495f-b9d1-c03803c61b9e tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:06.586627 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8d8664aa-0f32-495f-b9d1-c03803c61b9e tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:06.587419 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8d8664aa-0f32-495f-b9d1-c03803c61b9e tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:06.646806 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8d8664aa-0f32-495f-b9d1-c03803c61b9e tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:06.647951 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8d8664aa-0f32-495f-b9d1-c03803c61b9e tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.060s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:06.845795 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-9630d9c4-ef2e-4363-8d84-ca5ab7f115a8 req-3ce68f8d-8ffe-46d8-bbf9-d2737376775b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3dbe541d-234a-4049-befd-dcd9a67dbd46", "name": "network-vif-plugged", "status": "completed", "tag": "f1ab3076-8442-4ba9-915a-127e680713f3"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:02:06.879633 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-9630d9c4-ef2e-4363-8d84-ca5ab7f115a8 req-3ce68f8d-8ffe-46d8-bbf9-d2737376775b service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:06.882912 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-9630d9c4-ef2e-4363-8d84-ca5ab7f115a8 req-3ce68f8d-8ffe-46d8-bbf9-d2737376775b service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:06.883684 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-9630d9c4-ef2e-4363-8d84-ca5ab7f115a8 req-3ce68f8d-8ffe-46d8-bbf9-d2737376775b service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:06.915745 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-9630d9c4-ef2e-4363-8d84-ca5ab7f115a8 req-3ce68f8d-8ffe-46d8-bbf9-d2737376775b service nova] Creating event network-vif-plugged:f1ab3076-8442-4ba9-915a-127e680713f3 for instance 3dbe541d-234a-4049-befd-dcd9a67dbd46 on n-h1-860284-1 Oct 04 22:02:06.927693 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-9630d9c4-ef2e-4363-8d84-ca5ab7f115a8 req-3ce68f8d-8ffe-46d8-bbf9-d2737376775b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086842 Oct 04 22:02:06.928771 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1995/3971] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:02:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:02:07.271588 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-fe2a0212-484a-4385-8fed-28b012def30a tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:02:07.272711 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-fe2a0212-484a-4385-8fed-28b012def30a tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] [instance: 3dbe541d-234a-4049-befd-dcd9a67dbd46] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:02:07.297707 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fe2a0212-484a-4385-8fed-28b012def30a tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:07.298491 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fe2a0212-484a-4385-8fed-28b012def30a tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:07.300856 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fe2a0212-484a-4385-8fed-28b012def30a tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:07.305443 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fe2a0212-484a-4385-8fed-28b012def30a tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:07.309282 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fe2a0212-484a-4385-8fed-28b012def30a tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:07.311319 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fe2a0212-484a-4385-8fed-28b012def30a tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:07.369567 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-8d8664aa-0f32-495f-b9d1-c03803c61b9e tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3adbba85c5a448148833e69d6304e62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b710cb6300854d8683bd52ddf56b787d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:02:07.381721 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-8d8664aa-0f32-495f-b9d1-c03803c61b9e tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3adbba85c5a448148833e69d6304e62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b710cb6300854d8683bd52ddf56b787d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:02:07.389772 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-8d8664aa-0f32-495f-b9d1-c03803c61b9e tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3adbba85c5a448148833e69d6304e62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b710cb6300854d8683bd52ddf56b787d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:02:07.393167 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-8d8664aa-0f32-495f-b9d1-c03803c61b9e tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] 10.222.0.43 "GET /compute/v2.1/servers/7285a94c-3dad-43f1-9052-63ccc9ac07ba" status: 200 len: 1552 microversion: 2.26 time: 0.840665 Oct 04 22:02:07.394801 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1977/3972] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:02:06 2022] GET /compute/v2.1/servers/7285a94c-3dad-43f1-9052-63ccc9ac07ba => generated 1552 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:02:07.400922 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-b8106a11-135b-475f-8799-2ee69203e68e tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:02:07.402001 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-b8106a11-135b-475f-8799-2ee69203e68e tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: a4cf4fac-1e9b-4669-a6ff-30008ed3642d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:02:07.418067 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b8106a11-135b-475f-8799-2ee69203e68e tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:07.422702 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b8106a11-135b-475f-8799-2ee69203e68e tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:07.423196 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b8106a11-135b-475f-8799-2ee69203e68e tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:07.423949 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b8106a11-135b-475f-8799-2ee69203e68e tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:07.424418 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b8106a11-135b-475f-8799-2ee69203e68e tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:07.424846 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b8106a11-135b-475f-8799-2ee69203e68e tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:08.017799 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-b8106a11-135b-475f-8799-2ee69203e68e tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2facee4c6a40416e908083e126d2cfa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07a17a482a4e92b6ddbdee463c8029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:02:08.048128 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-b8106a11-135b-475f-8799-2ee69203e68e tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d" status: 200 len: 1468 microversion: 2.1 time: 0.651902 Oct 04 22:02:08.058454 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1978/3973] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:02:07 2022] GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d => generated 1468 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:02:08.059602 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-2761a718-2e1c-44d4-a744-a91bdccf0a43 req-835fb387-6bfc-43e2-9b6d-5bc3f59a6cb0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4cf4fac-1e9b-4669-a6ff-30008ed3642d", "name": "network-vif-deleted", "tag": "17823d3d-fc62-47ee-8e12-cf0154daa955"}, {"server_uuid": "7285a94c-3dad-43f1-9052-63ccc9ac07ba", "name": "network-vif-deleted", "tag": "0f3ace44-c465-4e93-b2a0-48fc82b7381a"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:02:08.100547 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-2761a718-2e1c-44d4-a744-a91bdccf0a43 req-835fb387-6bfc-43e2-9b6d-5bc3f59a6cb0 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:08.104555 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-2761a718-2e1c-44d4-a744-a91bdccf0a43 req-835fb387-6bfc-43e2-9b6d-5bc3f59a6cb0 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:08.105836 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-2761a718-2e1c-44d4-a744-a91bdccf0a43 req-835fb387-6bfc-43e2-9b6d-5bc3f59a6cb0 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:08.161732 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-fe2a0212-484a-4385-8fed-28b012def30a tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2034fc9060874868bc5d27370a1c351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89499d833a4a00805164f4f79ed522', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:02:08.168386 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-2761a718-2e1c-44d4-a744-a91bdccf0a43 req-835fb387-6bfc-43e2-9b6d-5bc3f59a6cb0 service nova] Creating event network-vif-deleted:17823d3d-fc62-47ee-8e12-cf0154daa955 for instance a4cf4fac-1e9b-4669-a6ff-30008ed3642d on n-h2-860284-1 Oct 04 22:02:08.178222 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-2761a718-2e1c-44d4-a744-a91bdccf0a43 req-835fb387-6bfc-43e2-9b6d-5bc3f59a6cb0 service nova] Creating event network-vif-deleted:0f3ace44-c465-4e93-b2a0-48fc82b7381a for instance 7285a94c-3dad-43f1-9052-63ccc9ac07ba on n-h2-860284-1 Oct 04 22:02:08.188909 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-fe2a0212-484a-4385-8fed-28b012def30a tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] 10.222.0.43 "GET /compute/v2.1/servers/3dbe541d-234a-4049-befd-dcd9a67dbd46" status: 200 len: 1522 microversion: 2.1 time: 0.923288 Oct 04 22:02:08.189533 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1996/3974] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:02:07 2022] GET /compute/v2.1/servers/3dbe541d-234a-4049-befd-dcd9a67dbd46 => generated 1522 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:02:08.192443 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-2761a718-2e1c-44d4-a744-a91bdccf0a43 req-835fb387-6bfc-43e2-9b6d-5bc3f59a6cb0 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.139686 Oct 04 22:02:08.193543 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1979/3975] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:02:08 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:02:08.421056 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-a3fb640d-b657-442b-b869-630f55227f5b tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:02:08.421801 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-a3fb640d-b657-442b-b869-630f55227f5b tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] [instance: 7285a94c-3dad-43f1-9052-63ccc9ac07ba] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:02:08.438163 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a3fb640d-b657-442b-b869-630f55227f5b tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:08.445922 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a3fb640d-b657-442b-b869-630f55227f5b tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:08.446533 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a3fb640d-b657-442b-b869-630f55227f5b tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:08.447450 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a3fb640d-b657-442b-b869-630f55227f5b tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:08.447946 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a3fb640d-b657-442b-b869-630f55227f5b tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:08.448487 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a3fb640d-b657-442b-b869-630f55227f5b tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:08.551439 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a3fb640d-b657-442b-b869-630f55227f5b tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:08.552104 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a3fb640d-b657-442b-b869-630f55227f5b tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:08.552651 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a3fb640d-b657-442b-b869-630f55227f5b tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:08.553332 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.objects.instance [None req-a3fb640d-b657-442b-b869-630f55227f5b tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lazy-loading 'fault' on Instance uuid 7285a94c-3dad-43f1-9052-63ccc9ac07ba {{(pid=134101) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 22:02:08.573769 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-ef8ce6e6-c4c9-4086-ae47-2cb5c1064343 tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-913418677", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452", "networks": [{"uuid": "127690ac-f36b-46d5-a87d-a2ce7681c8ef"}]}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:02:08.645757 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-a3fb640d-b657-442b-b869-630f55227f5b tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3adbba85c5a448148833e69d6304e62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b710cb6300854d8683bd52ddf56b787d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:02:08.669394 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-a3fb640d-b657-442b-b869-630f55227f5b tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3adbba85c5a448148833e69d6304e62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b710cb6300854d8683bd52ddf56b787d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:02:08.674391 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-a3fb640d-b657-442b-b869-630f55227f5b tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3adbba85c5a448148833e69d6304e62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b710cb6300854d8683bd52ddf56b787d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:02:08.680787 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-a3fb640d-b657-442b-b869-630f55227f5b tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] 10.222.0.43 "GET /compute/v2.1/servers/7285a94c-3dad-43f1-9052-63ccc9ac07ba" status: 200 len: 1352 microversion: 2.26 time: 0.261917 Oct 04 22:02:08.683380 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1980/3976] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:02:08 2022] GET /compute/v2.1/servers/7285a94c-3dad-43f1-9052-63ccc9ac07ba => generated 1352 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 22:02:08.696217 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-49a5e9e4-3324-460b-ae7c-fa948643396c tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b87f0484-fb3f-41be-802c-881df6379344"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:02:08.703503 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.network.neutron [None req-ef8ce6e6-c4c9-4086-ae47-2cb5c1064343 tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] validate_networks() for [('127690ac-f36b-46d5-a87d-a2ce7681c8ef', None, None, None, None, None)] {{(pid=134102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 22:02:08.724250 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-49a5e9e4-3324-460b-ae7c-fa948643396c tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: f9376877-b87d-4738-b940-2bf314c83337] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:02:08.737789 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-49a5e9e4-3324-460b-ae7c-fa948643396c tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:08.738293 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-49a5e9e4-3324-460b-ae7c-fa948643396c tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:08.742717 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-49a5e9e4-3324-460b-ae7c-fa948643396c tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:08.743628 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-49a5e9e4-3324-460b-ae7c-fa948643396c tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:08.744682 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-49a5e9e4-3324-460b-ae7c-fa948643396c tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:08.745173 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-49a5e9e4-3324-460b-ae7c-fa948643396c tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:09.358103 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-ef8ce6e6-c4c9-4086-ae47-2cb5c1064343 tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Flavor limits 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 22:02:09.358660 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-ef8ce6e6-c4c9-4086-ae47-2cb5c1064343 tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Image limits 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 22:02:09.359240 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-ef8ce6e6-c4c9-4086-ae47-2cb5c1064343 tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Flavor pref 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 22:02:09.359897 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-ef8ce6e6-c4c9-4086-ae47-2cb5c1064343 tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Image pref 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 22:02:09.360729 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-ef8ce6e6-c4c9-4086-ae47-2cb5c1064343 tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 22:02:09.379657 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ef8ce6e6-c4c9-4086-ae47-2cb5c1064343 tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:09.380171 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ef8ce6e6-c4c9-4086-ae47-2cb5c1064343 tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:09.381160 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ef8ce6e6-c4c9-4086-ae47-2cb5c1064343 tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:09.382703 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ef8ce6e6-c4c9-4086-ae47-2cb5c1064343 tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:09.383219 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ef8ce6e6-c4c9-4086-ae47-2cb5c1064343 tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:09.383776 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ef8ce6e6-c4c9-4086-ae47-2cb5c1064343 tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:09.408697 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-49a5e9e4-3324-460b-ae7c-fa948643396c tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "POST /compute/v2.1/servers/f9376877-b87d-4738-b940-2bf314c83337/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.723517 Oct 04 22:02:09.409443 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1981/3977] 10.222.0.43 () {60 vars in 1323 bytes} [Tue Oct 4 22:02:08 2022] POST /compute/v2.1/servers/f9376877-b87d-4738-b940-2bf314c83337/os-volume_attachments => generated 194 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:02:09.417309 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-415c558d-17ba-4b6e-8ab4-ca259af9a786 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:02:09.418780 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-415c558d-17ba-4b6e-8ab4-ca259af9a786 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] [instance: a4cf4fac-1e9b-4669-a6ff-30008ed3642d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:02:09.420225 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-ef8ce6e6-c4c9-4086-ae47-2cb5c1064343 tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Getting quotas for project bad5849b558042d1a5288e8a4443fb53. Resources: {'instances', 'ram', 'cores'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:02:09.427357 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-415c558d-17ba-4b6e-8ab4-ca259af9a786 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:09.428123 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-415c558d-17ba-4b6e-8ab4-ca259af9a786 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:09.428788 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-415c558d-17ba-4b6e-8ab4-ca259af9a786 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:09.429543 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-415c558d-17ba-4b6e-8ab4-ca259af9a786 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:09.430006 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-415c558d-17ba-4b6e-8ab4-ca259af9a786 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:09.432269 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-ef8ce6e6-c4c9-4086-ae47-2cb5c1064343 tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Getting quotas for user 1f50bbed6deb45e1a2d081745777596c and project bad5849b558042d1a5288e8a4443fb53. Resources: {'instances', 'ram', 'cores'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:02:09.434818 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-415c558d-17ba-4b6e-8ab4-ca259af9a786 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:09.456420 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-415c558d-17ba-4b6e-8ab4-ca259af9a786 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] HTTP exception thrown: Instance a4cf4fac-1e9b-4669-a6ff-30008ed3642d could not be found. Oct 04 22:02:09.456992 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_api:INSERT=1,nova_api:SELECT=98,nova_api:UPDATE=1 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:02:09.458855 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-415c558d-17ba-4b6e-8ab4-ca259af9a786 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Request method failure captured: Oct 04 22:02:09.458855 n-d-860284-1 devstack@n-api.service[134101]: request: GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d HTTP/1.1 Oct 04 22:02:09.458855 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 22:02:09.458855 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 22:02:09.458855 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 22:02:09.458855 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 22:02:09.458855 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 22:02:09.458855 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 22:02:09.458855 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 22:02:09.458855 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 22:02:09.458855 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPKwu4cpW6hhBuWb-qV_7iYlwjOTpf5XWCl53BJjoosjlcj4wkmmOFzemCJVdBntIx8zJ1SF_z6VrRY8UJr7E8TQDJCRnVQMdNnh0-lZwGdqUzjOWSO31Ryb6n87Cka0g238a21JWok3h3GEhLB-7oCbN3bbcOGmkhd6UFueRxRluk24 Oct 04 22:02:09.458855 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 22:02:09.458855 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 22:02:09.458855 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 22:02:09.458855 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 22:02:09.458855 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 22:02:09.458855 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 22:02:09.458855 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: cf07a17a482a4e92b6ddbdee463c8029 Oct 04 22:02:09.458855 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-ServersNegativeTestJSON-1933663319 Oct 04 22:02:09.458855 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 22:02:09.458855 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 22:02:09.458855 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/cf07a17a482a4e92b6ddbdee463c8029"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_cf07a17a482a4e92b6ddbdee463c8029", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/cf07a17a482a4e92b6ddbdee463c8029"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/cf07a17a482a4e92b6ddbdee463c8029"}]}] Oct 04 22:02:09.458855 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-ServersNegativeTestJSON-1933663319 Oct 04 22:02:09.458855 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: cf07a17a482a4e92b6ddbdee463c8029 Oct 04 22:02:09.458855 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1933663319 Oct 04 22:02:09.458855 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-ServersNegativeTestJSON-1933663319-project Oct 04 22:02:09.458855 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 22:02:09.458855 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 22:02:09.458855 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 2facee4c6a40416e908083e126d2cfa3 Oct 04 22:02:09.458855 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-ServersNegativeTestJSON-1933663319-project Oct 04 22:02:09.458855 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 22:02:09.458855 n-d-860284-1 devstack@n-api.service[134101]: exception: Instance a4cf4fac-1e9b-4669-a6ff-30008ed3642d could not be found. Oct 04 22:02:09.458855 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': 'a4cf4fac-1e9b-4669-a6ff-30008ed3642d'} Oct 04 22:02:09.458855 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:02:09.458855 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:02:09.458855 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:02:09.458855 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:02:09.458855 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:02:09.458855 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:02:09.458855 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:02:09.458855 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:02:09.458855 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:02:09.458855 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:02:09.458855 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4cf4fac-1e9b-4669-a6ff-30008ed3642d could not be found. Oct 04 22:02:09.458855 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:02:09.458855 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:02:09.458855 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:02:09.458855 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:02:09.458855 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:02:09.458855 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:02:09.458855 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:02:09.458855 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:02:09.458855 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:02:09.458855 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:02:09.458855 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:02:09.458855 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:02:09.458855 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:02:09.458855 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:02:09.458855 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:02:09.458855 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:02:09.458855 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4cf4fac-1e9b-4669-a6ff-30008ed3642d could not be found. Oct 04 22:02:09.458855 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:02:09.458855 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:02:09.458855 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:02:09.462253 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:02:09.462253 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:02:09.462253 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:02:09.462253 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:02:09.462253 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:02:09.462253 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4cf4fac-1e9b-4669-a6ff-30008ed3642d could not be found. Oct 04 22:02:09.462253 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:02:09.462253 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-415c558d-17ba-4b6e-8ab4-ca259af9a786 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] Returning 404 to user: Instance a4cf4fac-1e9b-4669-a6ff-30008ed3642d could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:02:09.462253 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-415c558d-17ba-4b6e-8ab4-ca259af9a786 tempest-ServersNegativeTestJSON-1933663319 tempest-ServersNegativeTestJSON-1933663319-project] 10.222.0.43 "GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d" status: 404 len: 111 microversion: 2.1 time: 0.049193 Oct 04 22:02:09.469530 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1982/3978] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:02:09 2022] GET /compute/v2.1/servers/a4cf4fac-1e9b-4669-a6ff-30008ed3642d => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:02:09.473025 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-ef8ce6e6-c4c9-4086-ae47-2cb5c1064343 tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Going to run 1 instances... {{(pid=134102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 22:02:09.475915 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-ef8ce6e6-c4c9-4086-ae47-2cb5c1064343 tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] [instance: 49298a04-d3ab-4bb1-b8ed-ca7db4e028f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='58548514-5dac-426c-81f5-19e3fba33e23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 22:02:09.476381 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-a1893e72-53fb-489d-a61c-b20664e048aa tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:02:09.477227 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-a1893e72-53fb-489d-a61c-b20664e048aa tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] [instance: 3dbe541d-234a-4049-befd-dcd9a67dbd46] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:02:09.500261 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a1893e72-53fb-489d-a61c-b20664e048aa tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:09.501066 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a1893e72-53fb-489d-a61c-b20664e048aa tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:09.502214 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a1893e72-53fb-489d-a61c-b20664e048aa tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:09.506216 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a1893e72-53fb-489d-a61c-b20664e048aa tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:09.506974 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a1893e72-53fb-489d-a61c-b20664e048aa tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:09.509548 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a1893e72-53fb-489d-a61c-b20664e048aa tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:09.557261 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-ef8ce6e6-c4c9-4086-ae47-2cb5c1064343 tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.276259 Oct 04 22:02:09.559452 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1997/3979] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 22:02:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 1280 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 22:02:09.592734 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-0454d3db-488d-4c81-ae98-00c2f31b9753 tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:02:09.593498 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-0454d3db-488d-4c81-ae98-00c2f31b9753 tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] [instance: 49298a04-d3ab-4bb1-b8ed-ca7db4e028f3] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:02:09.748266 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-0454d3db-488d-4c81-ae98-00c2f31b9753 tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f50bbed6deb45e1a2d081745777596c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bad5849b558042d1a5288e8a4443fb53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:02:09.763777 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-0454d3db-488d-4c81-ae98-00c2f31b9753 tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] 10.222.0.43 "GET /compute/v2.1/servers/49298a04-d3ab-4bb1-b8ed-ca7db4e028f3" status: 200 len: 1231 microversion: 2.1 time: 0.195897 Oct 04 22:02:09.767242 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1998/3980] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:02:09 2022] GET /compute/v2.1/servers/49298a04-d3ab-4bb1-b8ed-ca7db4e028f3 => generated 1231 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:02:09.780735 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-7d6a72b5-bb2b-4f24-bca9-dd12e4c69e94 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:02:09.788264 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-7d6a72b5-bb2b-4f24-bca9-dd12e4c69e94 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] [instance: 7285a94c-3dad-43f1-9052-63ccc9ac07ba] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:02:09.803747 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7d6a72b5-bb2b-4f24-bca9-dd12e4c69e94 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:09.807679 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7d6a72b5-bb2b-4f24-bca9-dd12e4c69e94 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:09.808258 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7d6a72b5-bb2b-4f24-bca9-dd12e4c69e94 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:09.809371 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7d6a72b5-bb2b-4f24-bca9-dd12e4c69e94 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:09.809971 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7d6a72b5-bb2b-4f24-bca9-dd12e4c69e94 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:09.811449 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7d6a72b5-bb2b-4f24-bca9-dd12e4c69e94 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:09.845966 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-7d6a72b5-bb2b-4f24-bca9-dd12e4c69e94 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] HTTP exception thrown: Instance 7285a94c-3dad-43f1-9052-63ccc9ac07ba could not be found. Oct 04 22:02:09.855626 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-7d6a72b5-bb2b-4f24-bca9-dd12e4c69e94 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Request method failure captured: Oct 04 22:02:09.855626 n-d-860284-1 devstack@n-api.service[134102]: request: GET /compute/v2.1/servers/7285a94c-3dad-43f1-9052-63ccc9ac07ba HTTP/1.1 Oct 04 22:02:09.855626 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 22:02:09.855626 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 22:02:09.855626 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 22:02:09.855626 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 22:02:09.855626 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 22:02:09.855626 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 22:02:09.855626 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 22:02:09.855626 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 22:02:09.855626 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPK0_PcWawlIrEjnmczzbugqgrv2CWhN7fpJWloLcLZ0fKWPZoia53mNHuXaJuZyOcd-3XGTq3Xnqalymd3ViYvbuA3QRJJgBVDd5rMuUoDD6vS8jVtn-r9GOtSG563IWxkgS6_Xa2mUKdLT6Mw9RIQzFaKheFVQFBDeyLFGnsGWznNw Oct 04 22:02:09.855626 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 22:02:09.855626 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 22:02:09.855626 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 22:02:09.855626 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 22:02:09.855626 n-d-860284-1 devstack@n-api.service[134102]: X-Openstack-Nova-Api-Version: 2.26 Oct 04 22:02:09.855626 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 22:02:09.855626 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 22:02:09.855626 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: b710cb6300854d8683bd52ddf56b787d Oct 04 22:02:09.855626 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-ServerTagsTestJSON-1611474825 Oct 04 22:02:09.855626 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 22:02:09.855626 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 22:02:09.855626 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b710cb6300854d8683bd52ddf56b787d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_b710cb6300854d8683bd52ddf56b787d", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b710cb6300854d8683bd52ddf56b787d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/b710cb6300854d8683bd52ddf56b787d"}]}] Oct 04 22:02:09.855626 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-ServerTagsTestJSON-1611474825 Oct 04 22:02:09.855626 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: b710cb6300854d8683bd52ddf56b787d Oct 04 22:02:09.855626 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-ServerTagsTestJSON-1611474825 Oct 04 22:02:09.855626 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-ServerTagsTestJSON-1611474825-project Oct 04 22:02:09.855626 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 22:02:09.855626 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 22:02:09.855626 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: 3adbba85c5a448148833e69d6304e62e Oct 04 22:02:09.855626 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-ServerTagsTestJSON-1611474825-project Oct 04 22:02:09.855626 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 22:02:09.855626 n-d-860284-1 devstack@n-api.service[134102]: exception: Instance 7285a94c-3dad-43f1-9052-63ccc9ac07ba could not be found. Oct 04 22:02:09.855626 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': '7285a94c-3dad-43f1-9052-63ccc9ac07ba'} Oct 04 22:02:09.855626 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:02:09.855626 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:02:09.855626 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:02:09.855626 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:02:09.855626 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:02:09.855626 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:02:09.855626 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:02:09.855626 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:02:09.855626 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:02:09.855626 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:02:09.855626 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7285a94c-3dad-43f1-9052-63ccc9ac07ba could not be found. Oct 04 22:02:09.855626 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:02:09.855626 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:02:09.855626 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:02:09.855626 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:02:09.855626 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:02:09.855626 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:02:09.855626 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:02:09.855626 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:02:09.855626 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:02:09.855626 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:02:09.855626 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:02:09.855626 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:02:09.855626 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:02:09.855626 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:02:09.855626 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:02:09.855626 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:02:09.855626 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7285a94c-3dad-43f1-9052-63ccc9ac07ba could not be found. Oct 04 22:02:09.855626 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:02:09.855626 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:02:09.855626 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:02:09.859695 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:02:09.859695 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:02:09.859695 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:02:09.859695 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:02:09.859695 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:02:09.859695 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7285a94c-3dad-43f1-9052-63ccc9ac07ba could not be found. Oct 04 22:02:09.859695 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:02:09.860929 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-7d6a72b5-bb2b-4f24-bca9-dd12e4c69e94 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] Returning 404 to user: Instance 7285a94c-3dad-43f1-9052-63ccc9ac07ba could not be found. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:02:09.862107 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-7d6a72b5-bb2b-4f24-bca9-dd12e4c69e94 tempest-ServerTagsTestJSON-1611474825 tempest-ServerTagsTestJSON-1611474825-project] 10.222.0.43 "GET /compute/v2.1/servers/7285a94c-3dad-43f1-9052-63ccc9ac07ba" status: 404 len: 111 microversion: 2.26 time: 0.087009 Oct 04 22:02:09.862838 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 1999/3981] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:02:09 2022] GET /compute/v2.1/servers/7285a94c-3dad-43f1-9052-63ccc9ac07ba => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 22:02:10.036338 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-a1893e72-53fb-489d-a61c-b20664e048aa tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2034fc9060874868bc5d27370a1c351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89499d833a4a00805164f4f79ed522', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:02:10.051468 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-a1893e72-53fb-489d-a61c-b20664e048aa tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] 10.222.0.43 "GET /compute/v2.1/servers/3dbe541d-234a-4049-befd-dcd9a67dbd46" status: 200 len: 1522 microversion: 2.1 time: 0.575300 Oct 04 22:02:10.059521 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1983/3982] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:02:09 2022] GET /compute/v2.1/servers/3dbe541d-234a-4049-befd-dcd9a67dbd46 => generated 1522 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:02:10.792347 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-9903ee9b-efe0-490b-9f17-8e28ef09cddc tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:02:10.793100 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-9903ee9b-efe0-490b-9f17-8e28ef09cddc tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] [instance: 49298a04-d3ab-4bb1-b8ed-ca7db4e028f3] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:02:10.804331 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9903ee9b-efe0-490b-9f17-8e28ef09cddc tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:10.804841 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9903ee9b-efe0-490b-9f17-8e28ef09cddc tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:10.805297 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9903ee9b-efe0-490b-9f17-8e28ef09cddc tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:10.806058 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9903ee9b-efe0-490b-9f17-8e28ef09cddc tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:10.809483 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9903ee9b-efe0-490b-9f17-8e28ef09cddc tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:10.811269 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9903ee9b-efe0-490b-9f17-8e28ef09cddc tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:11.008858 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-9903ee9b-efe0-490b-9f17-8e28ef09cddc tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f50bbed6deb45e1a2d081745777596c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bad5849b558042d1a5288e8a4443fb53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:02:11.012394 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=96,nova_cell1:DELETE=2,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:02:11.040173 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-9903ee9b-efe0-490b-9f17-8e28ef09cddc tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] 10.222.0.43 "GET /compute/v2.1/servers/49298a04-d3ab-4bb1-b8ed-ca7db4e028f3" status: 200 len: 1227 microversion: 2.1 time: 0.239992 Oct 04 22:02:11.042826 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2000/3983] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:02:10 2022] GET /compute/v2.1/servers/49298a04-d3ab-4bb1-b8ed-ca7db4e028f3 => generated 1227 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:02:11.082235 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-40172d66-ec32-44cc-9635-495a7e98e5b6 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:02:11.083050 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-40172d66-ec32-44cc-9635-495a7e98e5b6 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] [instance: 3dbe541d-234a-4049-befd-dcd9a67dbd46] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:02:11.095126 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-40172d66-ec32-44cc-9635-495a7e98e5b6 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:11.095632 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-40172d66-ec32-44cc-9635-495a7e98e5b6 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:11.096068 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-40172d66-ec32-44cc-9635-495a7e98e5b6 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:11.096785 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-40172d66-ec32-44cc-9635-495a7e98e5b6 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:11.111269 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-40172d66-ec32-44cc-9635-495a7e98e5b6 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:11.111773 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-40172d66-ec32-44cc-9635-495a7e98e5b6 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:11.437434 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-40172d66-ec32-44cc-9635-495a7e98e5b6 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2034fc9060874868bc5d27370a1c351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89499d833a4a00805164f4f79ed522', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:02:11.462163 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-40172d66-ec32-44cc-9635-495a7e98e5b6 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] 10.222.0.43 "GET /compute/v2.1/servers/3dbe541d-234a-4049-befd-dcd9a67dbd46" status: 200 len: 1507 microversion: 2.1 time: 0.384552 Oct 04 22:02:11.464410 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1984/3984] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:02:11 2022] GET /compute/v2.1/servers/3dbe541d-234a-4049-befd-dcd9a67dbd46 => generated 1507 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:02:11.489874 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-700ac774-7453-4407-a504-419c65f01d44 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:02:11.491152 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-700ac774-7453-4407-a504-419c65f01d44 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] [instance: 3dbe541d-234a-4049-befd-dcd9a67dbd46] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:02:11.501479 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-700ac774-7453-4407-a504-419c65f01d44 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:11.502251 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-700ac774-7453-4407-a504-419c65f01d44 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:11.502903 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-700ac774-7453-4407-a504-419c65f01d44 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:11.503874 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-700ac774-7453-4407-a504-419c65f01d44 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:11.504576 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-700ac774-7453-4407-a504-419c65f01d44 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:11.505257 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-700ac774-7453-4407-a504-419c65f01d44 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:12.073782 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-56376aa0-c953-4486-bebe-bf84182889cd tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:02:12.074727 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-56376aa0-c953-4486-bebe-bf84182889cd tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] [instance: 49298a04-d3ab-4bb1-b8ed-ca7db4e028f3] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:02:12.107206 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-56376aa0-c953-4486-bebe-bf84182889cd tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:12.109538 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-56376aa0-c953-4486-bebe-bf84182889cd tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:12.111394 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-56376aa0-c953-4486-bebe-bf84182889cd tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:12.116484 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-56376aa0-c953-4486-bebe-bf84182889cd tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:12.118440 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-56376aa0-c953-4486-bebe-bf84182889cd tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:12.119993 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-56376aa0-c953-4486-bebe-bf84182889cd tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:12.412096 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-56376aa0-c953-4486-bebe-bf84182889cd tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f50bbed6deb45e1a2d081745777596c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bad5849b558042d1a5288e8a4443fb53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:02:12.430987 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-56376aa0-c953-4486-bebe-bf84182889cd tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] 10.222.0.43 "GET /compute/v2.1/servers/49298a04-d3ab-4bb1-b8ed-ca7db4e028f3" status: 200 len: 1289 microversion: 2.1 time: 0.362891 Oct 04 22:02:12.448547 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1985/3985] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:02:12 2022] GET /compute/v2.1/servers/49298a04-d3ab-4bb1-b8ed-ca7db4e028f3 => generated 1289 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:02:12.945227 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-700ac774-7453-4407-a504-419c65f01d44 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2034fc9060874868bc5d27370a1c351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89499d833a4a00805164f4f79ed522', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:02:12.961108 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-700ac774-7453-4407-a504-419c65f01d44 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] 10.222.0.43 "GET /compute/v2.1/servers/3dbe541d-234a-4049-befd-dcd9a67dbd46" status: 200 len: 1507 microversion: 2.1 time: 1.475665 Oct 04 22:02:12.980221 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2001/3986] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:02:11 2022] GET /compute/v2.1/servers/3dbe541d-234a-4049-befd-dcd9a67dbd46 => generated 1507 bytes in 1496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:02:12.993986 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-c545904a-67b8-418b-b524-8eb000fbbbc5 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:02:12.996430 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-c545904a-67b8-418b-b524-8eb000fbbbc5 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] [instance: 3dbe541d-234a-4049-befd-dcd9a67dbd46] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:02:13.013175 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c545904a-67b8-418b-b524-8eb000fbbbc5 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:13.013873 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c545904a-67b8-418b-b524-8eb000fbbbc5 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:13.014509 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c545904a-67b8-418b-b524-8eb000fbbbc5 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:13.017066 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c545904a-67b8-418b-b524-8eb000fbbbc5 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:13.023142 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c545904a-67b8-418b-b524-8eb000fbbbc5 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:13.027937 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c545904a-67b8-418b-b524-8eb000fbbbc5 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:13.148421 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-c545904a-67b8-418b-b524-8eb000fbbbc5 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] [instance: 3dbe541d-234a-4049-befd-dcd9a67dbd46] Going to try to terminate instance {{(pid=134101) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 22:02:13.364975 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-c545904a-67b8-418b-b524-8eb000fbbbc5 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] 10.222.0.43 "DELETE /compute/v2.1/servers/3dbe541d-234a-4049-befd-dcd9a67dbd46" status: 204 len: 0 microversion: 2.1 time: 0.378056 Oct 04 22:02:13.366114 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1986/3987] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 22:02:12 2022] DELETE /compute/v2.1/servers/3dbe541d-234a-4049-befd-dcd9a67dbd46 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 22:02:13.455517 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-348ddde3-f30f-490c-898d-650f9d53ad6a tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:02:13.456331 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-348ddde3-f30f-490c-898d-650f9d53ad6a tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] [instance: 49298a04-d3ab-4bb1-b8ed-ca7db4e028f3] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:02:13.472542 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-348ddde3-f30f-490c-898d-650f9d53ad6a tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:13.480128 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-348ddde3-f30f-490c-898d-650f9d53ad6a tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:13.480765 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-348ddde3-f30f-490c-898d-650f9d53ad6a tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:13.481712 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-348ddde3-f30f-490c-898d-650f9d53ad6a tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:13.482954 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-348ddde3-f30f-490c-898d-650f9d53ad6a tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:13.483512 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-348ddde3-f30f-490c-898d-650f9d53ad6a tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:13.595368 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-4d2e8104-8a84-4a0d-bc09-8e94d2a020d7 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1443467065", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452", "networks": [{"uuid": "605d261e-cb88-4730-8571-b0febea58d72"}]}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:02:13.689633 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.network.neutron [None req-4d2e8104-8a84-4a0d-bc09-8e94d2a020d7 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] validate_networks() for [('605d261e-cb88-4730-8571-b0febea58d72', None, None, None, None, None)] {{(pid=134101) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 22:02:14.267617 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-348ddde3-f30f-490c-898d-650f9d53ad6a tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f50bbed6deb45e1a2d081745777596c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bad5849b558042d1a5288e8a4443fb53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:02:14.312378 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-348ddde3-f30f-490c-898d-650f9d53ad6a tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] 10.222.0.43 "GET /compute/v2.1/servers/49298a04-d3ab-4bb1-b8ed-ca7db4e028f3" status: 200 len: 1289 microversion: 2.1 time: 0.860847 Oct 04 22:02:14.313676 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2002/3988] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:02:13 2022] GET /compute/v2.1/servers/49298a04-d3ab-4bb1-b8ed-ca7db4e028f3 => generated 1289 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:02:15.341385 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-05911950-78e2-46d9-a479-2c518b54e027 tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:02:15.342781 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-05911950-78e2-46d9-a479-2c518b54e027 tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] [instance: 49298a04-d3ab-4bb1-b8ed-ca7db4e028f3] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:02:15.380004 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-05911950-78e2-46d9-a479-2c518b54e027 tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:15.387772 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-05911950-78e2-46d9-a479-2c518b54e027 tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:15.394276 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-05911950-78e2-46d9-a479-2c518b54e027 tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:15.396945 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-05911950-78e2-46d9-a479-2c518b54e027 tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:15.408987 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-05911950-78e2-46d9-a479-2c518b54e027 tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:15.410466 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-05911950-78e2-46d9-a479-2c518b54e027 tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:16.545457 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-4d2e8104-8a84-4a0d-bc09-8e94d2a020d7 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Flavor limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 22:02:16.546000 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-4d2e8104-8a84-4a0d-bc09-8e94d2a020d7 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Image limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 22:02:16.547946 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-4d2e8104-8a84-4a0d-bc09-8e94d2a020d7 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Flavor pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 22:02:16.548408 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-4d2e8104-8a84-4a0d-bc09-8e94d2a020d7 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Image pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 22:02:16.548827 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-4d2e8104-8a84-4a0d-bc09-8e94d2a020d7 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 22:02:16.576181 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4d2e8104-8a84-4a0d-bc09-8e94d2a020d7 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:16.576662 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4d2e8104-8a84-4a0d-bc09-8e94d2a020d7 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:16.577102 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4d2e8104-8a84-4a0d-bc09-8e94d2a020d7 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:16.577877 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4d2e8104-8a84-4a0d-bc09-8e94d2a020d7 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:16.580330 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4d2e8104-8a84-4a0d-bc09-8e94d2a020d7 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:16.581999 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4d2e8104-8a84-4a0d-bc09-8e94d2a020d7 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:16.612870 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-4d2e8104-8a84-4a0d-bc09-8e94d2a020d7 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Getting quotas for project aa89499d833a4a00805164f4f79ed522. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:02:16.626804 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-05911950-78e2-46d9-a479-2c518b54e027 tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f50bbed6deb45e1a2d081745777596c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bad5849b558042d1a5288e8a4443fb53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:02:16.639707 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-4d2e8104-8a84-4a0d-bc09-8e94d2a020d7 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Getting quotas for user 2034fc9060874868bc5d27370a1c351c and project aa89499d833a4a00805164f4f79ed522. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:02:16.646478 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-05911950-78e2-46d9-a479-2c518b54e027 tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] 10.222.0.43 "GET /compute/v2.1/servers/49298a04-d3ab-4bb1-b8ed-ca7db4e028f3" status: 200 len: 1331 microversion: 2.1 time: 1.307844 Oct 04 22:02:16.649123 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2003/3989] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:02:15 2022] GET /compute/v2.1/servers/49298a04-d3ab-4bb1-b8ed-ca7db4e028f3 => generated 1331 bytes in 1314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:02:16.672288 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-4d2e8104-8a84-4a0d-bc09-8e94d2a020d7 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Going to run 1 instances... {{(pid=134101) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 22:02:16.675775 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-4d2e8104-8a84-4a0d-bc09-8e94d2a020d7 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] [instance: 19a673aa-44db-47a4-8642-5bc88f96b86b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='58548514-5dac-426c-81f5-19e3fba33e23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134101) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 22:02:16.739723 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-4d2e8104-8a84-4a0d-bc09-8e94d2a020d7 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.149365 Oct 04 22:02:16.753111 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-30faa4f3-32f6-4532-9ca6-cb4dc29678a6 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:02:16.753748 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-30faa4f3-32f6-4532-9ca6-cb4dc29678a6 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] [instance: 19a673aa-44db-47a4-8642-5bc88f96b86b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:02:16.758404 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1987/3990] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 22:02:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 3169 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 22:02:17.189547 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-30faa4f3-32f6-4532-9ca6-cb4dc29678a6 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2034fc9060874868bc5d27370a1c351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89499d833a4a00805164f4f79ed522', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:02:17.200036 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-30faa4f3-32f6-4532-9ca6-cb4dc29678a6 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] 10.222.0.43 "GET /compute/v2.1/servers/19a673aa-44db-47a4-8642-5bc88f96b86b" status: 200 len: 1218 microversion: 2.1 time: 0.451565 Oct 04 22:02:17.220967 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2004/3991] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:02:16 2022] GET /compute/v2.1/servers/19a673aa-44db-47a4-8642-5bc88f96b86b => generated 1218 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:02:17.686457 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-575b310b-31e0-44ea-a902-17dedb3ef703 tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:02:17.687621 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-575b310b-31e0-44ea-a902-17dedb3ef703 tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] [instance: 49298a04-d3ab-4bb1-b8ed-ca7db4e028f3] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:02:17.721931 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-575b310b-31e0-44ea-a902-17dedb3ef703 tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:17.722739 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-575b310b-31e0-44ea-a902-17dedb3ef703 tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:17.723355 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-575b310b-31e0-44ea-a902-17dedb3ef703 tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:17.724275 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-575b310b-31e0-44ea-a902-17dedb3ef703 tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:17.724754 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-575b310b-31e0-44ea-a902-17dedb3ef703 tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:17.725195 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-575b310b-31e0-44ea-a902-17dedb3ef703 tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:18.091857 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-89d9bbca-d44a-4493-bd3d-3041eb18a608 req-ed00f33b-de46-4a82-962c-c41b4c2f778b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49298a04-d3ab-4bb1-b8ed-ca7db4e028f3", "tag": "4db0b86a-68bb-4021-8879-799b566c6728"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:02:18.121298 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-89d9bbca-d44a-4493-bd3d-3041eb18a608 req-ed00f33b-de46-4a82-962c-c41b4c2f778b service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:18.129836 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-89d9bbca-d44a-4493-bd3d-3041eb18a608 req-ed00f33b-de46-4a82-962c-c41b4c2f778b service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:18.130882 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-89d9bbca-d44a-4493-bd3d-3041eb18a608 req-ed00f33b-de46-4a82-962c-c41b4c2f778b service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:18.170741 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-89d9bbca-d44a-4493-bd3d-3041eb18a608 req-ed00f33b-de46-4a82-962c-c41b4c2f778b service nova] Creating event network-changed:4db0b86a-68bb-4021-8879-799b566c6728 for instance 49298a04-d3ab-4bb1-b8ed-ca7db4e028f3 on n-h2-860284-1 Oct 04 22:02:18.192905 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-89d9bbca-d44a-4493-bd3d-3041eb18a608 req-ed00f33b-de46-4a82-962c-c41b4c2f778b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105357 Oct 04 22:02:18.199624 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2005/3992] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:02:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:02:18.229842 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-9f25b337-2076-4169-ae4e-c97d8014c5f0 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:02:18.230834 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-9f25b337-2076-4169-ae4e-c97d8014c5f0 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] [instance: 19a673aa-44db-47a4-8642-5bc88f96b86b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:02:18.240870 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9f25b337-2076-4169-ae4e-c97d8014c5f0 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:18.241383 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9f25b337-2076-4169-ae4e-c97d8014c5f0 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:18.241843 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9f25b337-2076-4169-ae4e-c97d8014c5f0 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:18.247146 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9f25b337-2076-4169-ae4e-c97d8014c5f0 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:18.248030 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9f25b337-2076-4169-ae4e-c97d8014c5f0 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:18.249157 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9f25b337-2076-4169-ae4e-c97d8014c5f0 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:18.835023 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-9f25b337-2076-4169-ae4e-c97d8014c5f0 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2034fc9060874868bc5d27370a1c351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89499d833a4a00805164f4f79ed522', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:02:18.851092 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-9f25b337-2076-4169-ae4e-c97d8014c5f0 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] 10.222.0.43 "GET /compute/v2.1/servers/19a673aa-44db-47a4-8642-5bc88f96b86b" status: 200 len: 1214 microversion: 2.1 time: 0.620178 Oct 04 22:02:18.854617 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2006/3993] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:02:18 2022] GET /compute/v2.1/servers/19a673aa-44db-47a4-8642-5bc88f96b86b => generated 1214 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:02:18.876293 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-f5c08581-d8d1-4006-99d3-52dd5e656d07 req-2614ee00-f3b7-434c-8a40-c0da29039bb5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3dbe541d-234a-4049-befd-dcd9a67dbd46", "name": "network-vif-deleted", "tag": "f1ab3076-8442-4ba9-915a-127e680713f3"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:02:18.890429 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-f5c08581-d8d1-4006-99d3-52dd5e656d07 req-2614ee00-f3b7-434c-8a40-c0da29039bb5 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:18.891350 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-f5c08581-d8d1-4006-99d3-52dd5e656d07 req-2614ee00-f3b7-434c-8a40-c0da29039bb5 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:18.891946 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-f5c08581-d8d1-4006-99d3-52dd5e656d07 req-2614ee00-f3b7-434c-8a40-c0da29039bb5 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:18.905937 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-f5c08581-d8d1-4006-99d3-52dd5e656d07 req-2614ee00-f3b7-434c-8a40-c0da29039bb5 service nova] Creating event network-vif-deleted:f1ab3076-8442-4ba9-915a-127e680713f3 for instance 3dbe541d-234a-4049-befd-dcd9a67dbd46 on n-h1-860284-1 Oct 04 22:02:18.911986 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-f5c08581-d8d1-4006-99d3-52dd5e656d07 req-2614ee00-f3b7-434c-8a40-c0da29039bb5 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053415 Oct 04 22:02:18.913143 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2007/3994] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:02:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:02:18.985456 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-575b310b-31e0-44ea-a902-17dedb3ef703 tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f50bbed6deb45e1a2d081745777596c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bad5849b558042d1a5288e8a4443fb53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:02:19.018140 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-575b310b-31e0-44ea-a902-17dedb3ef703 tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] 10.222.0.43 "GET /compute/v2.1/servers/49298a04-d3ab-4bb1-b8ed-ca7db4e028f3" status: 200 len: 1331 microversion: 2.1 time: 1.348766 Oct 04 22:02:19.022194 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1988/3995] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:02:17 2022] GET /compute/v2.1/servers/49298a04-d3ab-4bb1-b8ed-ca7db4e028f3 => generated 1331 bytes in 1356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:02:19.879280 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-c98fdeff-ef71-454a-a6a1-818a63e0fe4f tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:02:19.880884 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-c98fdeff-ef71-454a-a6a1-818a63e0fe4f tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] [instance: 19a673aa-44db-47a4-8642-5bc88f96b86b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:02:19.887709 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell0:SELECT=2 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:02:19.932598 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c98fdeff-ef71-454a-a6a1-818a63e0fe4f tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:19.940665 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c98fdeff-ef71-454a-a6a1-818a63e0fe4f tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:19.941242 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c98fdeff-ef71-454a-a6a1-818a63e0fe4f tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:19.950998 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c98fdeff-ef71-454a-a6a1-818a63e0fe4f tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:19.953749 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c98fdeff-ef71-454a-a6a1-818a63e0fe4f tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:19.954434 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c98fdeff-ef71-454a-a6a1-818a63e0fe4f tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:20.049361 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-affb8816-50c8-4e76-8cd8-e351bb51fc57 tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:02:20.051167 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-affb8816-50c8-4e76-8cd8-e351bb51fc57 tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] [instance: 49298a04-d3ab-4bb1-b8ed-ca7db4e028f3] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:02:20.069212 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-affb8816-50c8-4e76-8cd8-e351bb51fc57 tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:20.071373 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-affb8816-50c8-4e76-8cd8-e351bb51fc57 tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:20.076339 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-affb8816-50c8-4e76-8cd8-e351bb51fc57 tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:20.077571 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-affb8816-50c8-4e76-8cd8-e351bb51fc57 tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:20.080387 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-affb8816-50c8-4e76-8cd8-e351bb51fc57 tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:20.083006 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-affb8816-50c8-4e76-8cd8-e351bb51fc57 tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:20.339677 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-c98fdeff-ef71-454a-a6a1-818a63e0fe4f tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2034fc9060874868bc5d27370a1c351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89499d833a4a00805164f4f79ed522', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:02:20.348597 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-c98fdeff-ef71-454a-a6a1-818a63e0fe4f tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] 10.222.0.43 "GET /compute/v2.1/servers/19a673aa-44db-47a4-8642-5bc88f96b86b" status: 200 len: 1276 microversion: 2.1 time: 0.473818 Oct 04 22:02:20.352381 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2008/3996] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:02:19 2022] GET /compute/v2.1/servers/19a673aa-44db-47a4-8642-5bc88f96b86b => generated 1276 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:02:20.534104 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-affb8816-50c8-4e76-8cd8-e351bb51fc57 tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f50bbed6deb45e1a2d081745777596c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bad5849b558042d1a5288e8a4443fb53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:02:20.547212 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-affb8816-50c8-4e76-8cd8-e351bb51fc57 tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] 10.222.0.43 "GET /compute/v2.1/servers/49298a04-d3ab-4bb1-b8ed-ca7db4e028f3" status: 200 len: 1331 microversion: 2.1 time: 0.503077 Oct 04 22:02:20.548298 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1989/3997] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:02:20 2022] GET /compute/v2.1/servers/49298a04-d3ab-4bb1-b8ed-ca7db4e028f3 => generated 1331 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:02:21.379327 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-81a2e43d-8bf9-4ff7-a15d-08b4734961c9 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:02:21.380584 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-81a2e43d-8bf9-4ff7-a15d-08b4734961c9 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] [instance: 19a673aa-44db-47a4-8642-5bc88f96b86b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:02:21.393698 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-81a2e43d-8bf9-4ff7-a15d-08b4734961c9 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:21.395558 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-81a2e43d-8bf9-4ff7-a15d-08b4734961c9 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:21.396047 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-81a2e43d-8bf9-4ff7-a15d-08b4734961c9 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:21.396789 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-81a2e43d-8bf9-4ff7-a15d-08b4734961c9 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:21.399808 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-81a2e43d-8bf9-4ff7-a15d-08b4734961c9 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:21.401611 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-81a2e43d-8bf9-4ff7-a15d-08b4734961c9 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:21.570683 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-28e08c21-afad-4f79-b865-4ccf0cd7b2bf tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:02:21.572501 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-28e08c21-afad-4f79-b865-4ccf0cd7b2bf tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] [instance: 49298a04-d3ab-4bb1-b8ed-ca7db4e028f3] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:02:21.585106 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-28e08c21-afad-4f79-b865-4ccf0cd7b2bf tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:21.585605 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-28e08c21-afad-4f79-b865-4ccf0cd7b2bf tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:21.586056 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-28e08c21-afad-4f79-b865-4ccf0cd7b2bf tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:21.586809 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-28e08c21-afad-4f79-b865-4ccf0cd7b2bf tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:21.587272 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-28e08c21-afad-4f79-b865-4ccf0cd7b2bf tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:21.588383 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-28e08c21-afad-4f79-b865-4ccf0cd7b2bf tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:21.895961 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-28e08c21-afad-4f79-b865-4ccf0cd7b2bf tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f50bbed6deb45e1a2d081745777596c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bad5849b558042d1a5288e8a4443fb53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:02:21.905788 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-28e08c21-afad-4f79-b865-4ccf0cd7b2bf tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] 10.222.0.43 "GET /compute/v2.1/servers/49298a04-d3ab-4bb1-b8ed-ca7db4e028f3" status: 200 len: 1331 microversion: 2.1 time: 0.340131 Oct 04 22:02:21.927744 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1990/3998] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:02:21 2022] GET /compute/v2.1/servers/49298a04-d3ab-4bb1-b8ed-ca7db4e028f3 => generated 1331 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:02:21.985592 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-81a2e43d-8bf9-4ff7-a15d-08b4734961c9 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2034fc9060874868bc5d27370a1c351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89499d833a4a00805164f4f79ed522', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:02:21.997626 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-81a2e43d-8bf9-4ff7-a15d-08b4734961c9 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] 10.222.0.43 "GET /compute/v2.1/servers/19a673aa-44db-47a4-8642-5bc88f96b86b" status: 200 len: 1318 microversion: 2.1 time: 0.625069 Oct 04 22:02:21.998246 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2009/3999] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:02:21 2022] GET /compute/v2.1/servers/19a673aa-44db-47a4-8642-5bc88f96b86b => generated 1318 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:02:22.641693 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-054fb783-d34f-4919-bf19-4b5f286e3ee3 req-fea360c9-ecf3-4705-b832-6d5c6e0ebbf5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19a673aa-44db-47a4-8642-5bc88f96b86b", "tag": "eaa121f9-c4cc-46aa-8ab0-8bccbe96fc5d"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:02:22.682920 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-054fb783-d34f-4919-bf19-4b5f286e3ee3 req-fea360c9-ecf3-4705-b832-6d5c6e0ebbf5 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:22.683588 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-054fb783-d34f-4919-bf19-4b5f286e3ee3 req-fea360c9-ecf3-4705-b832-6d5c6e0ebbf5 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:22.685609 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-054fb783-d34f-4919-bf19-4b5f286e3ee3 req-fea360c9-ecf3-4705-b832-6d5c6e0ebbf5 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:22.715016 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-054fb783-d34f-4919-bf19-4b5f286e3ee3 req-fea360c9-ecf3-4705-b832-6d5c6e0ebbf5 service nova] Creating event network-changed:eaa121f9-c4cc-46aa-8ab0-8bccbe96fc5d for instance 19a673aa-44db-47a4-8642-5bc88f96b86b on n-h1-860284-1 Oct 04 22:02:22.730854 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-054fb783-d34f-4919-bf19-4b5f286e3ee3 req-fea360c9-ecf3-4705-b832-6d5c6e0ebbf5 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094755 Oct 04 22:02:22.734289 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1991/4000] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:02:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:02:22.938378 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-b34ba7d3-f446-4064-8161-daa5e86a3233 tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:02:22.940093 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-b34ba7d3-f446-4064-8161-daa5e86a3233 tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] [instance: 49298a04-d3ab-4bb1-b8ed-ca7db4e028f3] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:02:22.950800 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b34ba7d3-f446-4064-8161-daa5e86a3233 tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:22.951291 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b34ba7d3-f446-4064-8161-daa5e86a3233 tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:22.951948 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b34ba7d3-f446-4064-8161-daa5e86a3233 tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:22.952954 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b34ba7d3-f446-4064-8161-daa5e86a3233 tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:22.953589 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b34ba7d3-f446-4064-8161-daa5e86a3233 tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:22.954215 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b34ba7d3-f446-4064-8161-daa5e86a3233 tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:23.177466 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-517cebfc-40e1-4652-a12e-bcd8729db457 tempest-ExtensionsTest-449601907 tempest-ExtensionsTest-449601907-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:02:23.180102 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-517cebfc-40e1-4652-a12e-bcd8729db457 tempest-ExtensionsTest-449601907 tempest-ExtensionsTest-449601907-project] 10.222.0.43 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.178691 Oct 04 22:02:23.180762 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1992/4001] 10.222.0.43 () {58 vars in 1170 bytes} [Tue Oct 4 22:02:22 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:02:23.199596 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-9f0a7b14-3b30-4e7e-a12e-8b192be5a7a7 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:02:23.200675 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-9f0a7b14-3b30-4e7e-a12e-8b192be5a7a7 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] [instance: 19a673aa-44db-47a4-8642-5bc88f96b86b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:02:23.208968 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9f0a7b14-3b30-4e7e-a12e-8b192be5a7a7 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:23.209759 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9f0a7b14-3b30-4e7e-a12e-8b192be5a7a7 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:23.210457 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9f0a7b14-3b30-4e7e-a12e-8b192be5a7a7 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:23.211362 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9f0a7b14-3b30-4e7e-a12e-8b192be5a7a7 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:23.212035 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9f0a7b14-3b30-4e7e-a12e-8b192be5a7a7 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:23.212707 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9f0a7b14-3b30-4e7e-a12e-8b192be5a7a7 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:23.244817 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:02:23.251095 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-b34ba7d3-f446-4064-8161-daa5e86a3233 tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f50bbed6deb45e1a2d081745777596c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bad5849b558042d1a5288e8a4443fb53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:02:23.266472 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-b34ba7d3-f446-4064-8161-daa5e86a3233 tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] 10.222.0.43 "GET /compute/v2.1/servers/49298a04-d3ab-4bb1-b8ed-ca7db4e028f3" status: 200 len: 1331 microversion: 2.1 time: 0.336266 Oct 04 22:02:23.271488 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2010/4002] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:02:22 2022] GET /compute/v2.1/servers/49298a04-d3ab-4bb1-b8ed-ca7db4e028f3 => generated 1331 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:02:23.286676 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-b0a53099-7ccd-49a7-b120-11993d4b389e tempest-ExtensionsTest-449601907 tempest-ExtensionsTest-449601907-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:02:23.293897 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-b0a53099-7ccd-49a7-b120-11993d4b389e tempest-ExtensionsTest-449601907 tempest-ExtensionsTest-449601907-project] 10.222.0.43 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.019875 Oct 04 22:02:23.294894 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2011/4003] 10.222.0.43 () {58 vars in 1134 bytes} [Tue Oct 4 22:02:23 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 22:02:23.555358 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-9f0a7b14-3b30-4e7e-a12e-8b192be5a7a7 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2034fc9060874868bc5d27370a1c351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89499d833a4a00805164f4f79ed522', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:02:23.569090 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-9f0a7b14-3b30-4e7e-a12e-8b192be5a7a7 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] 10.222.0.43 "GET /compute/v2.1/servers/19a673aa-44db-47a4-8642-5bc88f96b86b" status: 200 len: 1318 microversion: 2.1 time: 0.385761 Oct 04 22:02:23.574748 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1993/4004] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:02:23 2022] GET /compute/v2.1/servers/19a673aa-44db-47a4-8642-5bc88f96b86b => generated 1318 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:02:24.159199 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-e7e6354a-c34a-49f1-8141-63e06da98c4c tempest-QuotasTestJSON-1414250712 tempest-QuotasTestJSON-1414250712-project] Calling method '.version_select at 0x7fbb2e486820>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:02:24.241181 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-e7e6354a-c34a-49f1-8141-63e06da98c4c tempest-QuotasTestJSON-1414250712 tempest-QuotasTestJSON-1414250712-project] 10.222.0.43 "GET /compute/v2.1/os-quota-sets/4776864af3bf4485a477479efc0fea03/defaults" status: 200 len: 371 microversion: 2.1 time: 0.284833 Oct 04 22:02:24.241804 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2012/4005] 10.222.0.43 () {58 vars in 1269 bytes} [Tue Oct 4 22:02:23 2022] GET /compute/v2.1/os-quota-sets/4776864af3bf4485a477479efc0fea03/defaults => generated 371 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:02:24.254258 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-c038d445-1657-4869-a473-d67f15d64802 tempest-QuotasTestJSON-1414250712 tempest-QuotasTestJSON-1414250712-project] Calling method '.version_select at 0x7fbb2e243310>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:02:24.295586 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-db063100-e35e-46c7-a440-b8f637250a17 tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:02:24.296385 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-db063100-e35e-46c7-a440-b8f637250a17 tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] [instance: 49298a04-d3ab-4bb1-b8ed-ca7db4e028f3] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:02:24.305186 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-db063100-e35e-46c7-a440-b8f637250a17 tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:24.305722 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-db063100-e35e-46c7-a440-b8f637250a17 tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:24.306785 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-db063100-e35e-46c7-a440-b8f637250a17 tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:24.307749 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-db063100-e35e-46c7-a440-b8f637250a17 tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:24.308377 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-db063100-e35e-46c7-a440-b8f637250a17 tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:24.309116 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-db063100-e35e-46c7-a440-b8f637250a17 tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:24.496223 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-db063100-e35e-46c7-a440-b8f637250a17 tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f50bbed6deb45e1a2d081745777596c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bad5849b558042d1a5288e8a4443fb53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:02:24.509739 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-db063100-e35e-46c7-a440-b8f637250a17 tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] 10.222.0.43 "GET /compute/v2.1/servers/49298a04-d3ab-4bb1-b8ed-ca7db4e028f3" status: 200 len: 1331 microversion: 2.1 time: 0.220828 Oct 04 22:02:24.511375 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2013/4006] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:02:24 2022] GET /compute/v2.1/servers/49298a04-d3ab-4bb1-b8ed-ca7db4e028f3 => generated 1331 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:02:24.582026 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-c038d445-1657-4869-a473-d67f15d64802 tempest-QuotasTestJSON-1414250712 tempest-QuotasTestJSON-1414250712-project] 10.222.0.43 "GET /compute/v2.1/os-quota-sets/4776864af3bf4485a477479efc0fea03" status: 200 len: 371 microversion: 2.1 time: 0.331529 Oct 04 22:02:24.583096 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1994/4007] 10.222.0.43 () {58 vars in 1242 bytes} [Tue Oct 4 22:02:24 2022] GET /compute/v2.1/os-quota-sets/4776864af3bf4485a477479efc0fea03 => generated 371 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:02:24.597985 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-d9f278e4-ce8a-4f4c-9029-cb9b7e9aca05 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:02:24.598629 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-d9f278e4-ce8a-4f4c-9029-cb9b7e9aca05 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] [instance: 19a673aa-44db-47a4-8642-5bc88f96b86b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:02:24.599185 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-2f6ff822-6eb1-4e55-8eba-bba1700ebc74 tempest-QuotasTestJSON-1414250712 tempest-QuotasTestJSON-1414250712-project] Calling method '.version_select at 0x7fbb2e152430>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:02:24.605860 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d9f278e4-ce8a-4f4c-9029-cb9b7e9aca05 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:24.606663 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d9f278e4-ce8a-4f4c-9029-cb9b7e9aca05 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:24.607255 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d9f278e4-ce8a-4f4c-9029-cb9b7e9aca05 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:24.608112 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d9f278e4-ce8a-4f4c-9029-cb9b7e9aca05 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:24.608711 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d9f278e4-ce8a-4f4c-9029-cb9b7e9aca05 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:24.609442 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d9f278e4-ce8a-4f4c-9029-cb9b7e9aca05 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:24.799173 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-d9f278e4-ce8a-4f4c-9029-cb9b7e9aca05 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2034fc9060874868bc5d27370a1c351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89499d833a4a00805164f4f79ed522', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:02:24.812407 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-d9f278e4-ce8a-4f4c-9029-cb9b7e9aca05 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] 10.222.0.43 "GET /compute/v2.1/servers/19a673aa-44db-47a4-8642-5bc88f96b86b" status: 200 len: 1318 microversion: 2.1 time: 0.218570 Oct 04 22:02:24.813268 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2014/4008] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:02:24 2022] GET /compute/v2.1/servers/19a673aa-44db-47a4-8642-5bc88f96b86b => generated 1318 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:02:24.867251 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-c8da39ed-b02c-46a3-ad85-3cf89e15634f req-783e5e44-4511-4ce4-bcd4-0c4775233ab1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49298a04-d3ab-4bb1-b8ed-ca7db4e028f3", "name": "network-vif-plugged", "status": "completed", "tag": "4db0b86a-68bb-4021-8879-799b566c6728"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:02:24.878683 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-c8da39ed-b02c-46a3-ad85-3cf89e15634f req-783e5e44-4511-4ce4-bcd4-0c4775233ab1 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:24.879361 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-c8da39ed-b02c-46a3-ad85-3cf89e15634f req-783e5e44-4511-4ce4-bcd4-0c4775233ab1 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:24.879794 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-c8da39ed-b02c-46a3-ad85-3cf89e15634f req-783e5e44-4511-4ce4-bcd4-0c4775233ab1 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:24.895275 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-c8da39ed-b02c-46a3-ad85-3cf89e15634f req-783e5e44-4511-4ce4-bcd4-0c4775233ab1 service nova] Creating event network-vif-plugged:4db0b86a-68bb-4021-8879-799b566c6728 for instance 49298a04-d3ab-4bb1-b8ed-ca7db4e028f3 on n-h2-860284-1 Oct 04 22:02:24.900845 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-c8da39ed-b02c-46a3-ad85-3cf89e15634f req-783e5e44-4511-4ce4-bcd4-0c4775233ab1 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036721 Oct 04 22:02:24.901671 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2015/4009] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:02:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:02:24.957192 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-2f6ff822-6eb1-4e55-8eba-bba1700ebc74 tempest-QuotasTestJSON-1414250712 tempest-QuotasTestJSON-1414250712-project] 10.222.0.43 "GET /compute/v2.1/os-quota-sets/4776864af3bf4485a477479efc0fea03/defaults" status: 200 len: 371 microversion: 2.1 time: 0.362853 Oct 04 22:02:24.968913 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1995/4010] 10.222.0.43 () {58 vars in 1269 bytes} [Tue Oct 4 22:02:24 2022] GET /compute/v2.1/os-quota-sets/4776864af3bf4485a477479efc0fea03/defaults => generated 371 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:02:24.975932 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-b8adbeea-2280-49ab-88be-3dcc2b6d3248 tempest-QuotasTestJSON-1414250712 tempest-QuotasTestJSON-1414250712-project] Calling method '.version_select at 0x7fbb2e4f78b0>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:02:25.250215 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-b8adbeea-2280-49ab-88be-3dcc2b6d3248 tempest-QuotasTestJSON-1414250712 tempest-QuotasTestJSON-1414250712-project] 10.222.0.43 "GET /compute/v2.1/os-quota-sets/4776864af3bf4485a477479efc0fea03" status: 200 len: 371 microversion: 2.1 time: 0.279895 Oct 04 22:02:25.251286 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2016/4011] 10.222.0.43 () {58 vars in 1242 bytes} [Tue Oct 4 22:02:24 2022] GET /compute/v2.1/os-quota-sets/4776864af3bf4485a477479efc0fea03 => generated 371 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:02:25.266298 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-23daa512-f0f6-4c97-8a4e-d417c513c1c8 tempest-QuotasTestJSON-1414250712 tempest-QuotasTestJSON-1414250712-project] Calling method '.version_select at 0x7fbb2e18ce50>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:02:25.534692 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-775e53e7-2ab7-437e-859a-3e62105a2244 tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:02:25.535709 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-775e53e7-2ab7-437e-859a-3e62105a2244 tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] [instance: 49298a04-d3ab-4bb1-b8ed-ca7db4e028f3] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:02:25.543927 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-775e53e7-2ab7-437e-859a-3e62105a2244 tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:25.544594 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-775e53e7-2ab7-437e-859a-3e62105a2244 tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:25.545186 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-775e53e7-2ab7-437e-859a-3e62105a2244 tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:25.546061 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-775e53e7-2ab7-437e-859a-3e62105a2244 tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:25.546696 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-775e53e7-2ab7-437e-859a-3e62105a2244 tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:25.547264 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-775e53e7-2ab7-437e-859a-3e62105a2244 tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:25.591430 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-23daa512-f0f6-4c97-8a4e-d417c513c1c8 tempest-QuotasTestJSON-1414250712 tempest-QuotasTestJSON-1414250712-project] 10.222.0.43 "GET /compute/v2.1/os-quota-sets/4776864af3bf4485a477479efc0fea03?user_id=6a3b33a5a450418db0282970365aa95b" status: 200 len: 371 microversion: 2.1 time: 0.331834 Oct 04 22:02:25.592321 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1996/4012] 10.222.0.43 () {58 vars in 1323 bytes} [Tue Oct 4 22:02:25 2022] GET /compute/v2.1/os-quota-sets/4776864af3bf4485a477479efc0fea03?user_id=6a3b33a5a450418db0282970365aa95b => generated 371 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:02:25.702089 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-775e53e7-2ab7-437e-859a-3e62105a2244 tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f50bbed6deb45e1a2d081745777596c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bad5849b558042d1a5288e8a4443fb53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:02:25.710480 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-775e53e7-2ab7-437e-859a-3e62105a2244 tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] 10.222.0.43 "GET /compute/v2.1/servers/49298a04-d3ab-4bb1-b8ed-ca7db4e028f3" status: 200 len: 1331 microversion: 2.1 time: 0.179678 Oct 04 22:02:25.711344 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2017/4013] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:02:25 2022] GET /compute/v2.1/servers/49298a04-d3ab-4bb1-b8ed-ca7db4e028f3 => generated 1331 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:02:25.839284 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-bc873a70-4495-4807-af84-356736dfcf60 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:02:25.840106 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-bc873a70-4495-4807-af84-356736dfcf60 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] [instance: 19a673aa-44db-47a4-8642-5bc88f96b86b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:02:25.845214 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:02:25.857779 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bc873a70-4495-4807-af84-356736dfcf60 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:25.858906 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bc873a70-4495-4807-af84-356736dfcf60 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:25.859559 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bc873a70-4495-4807-af84-356736dfcf60 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:25.860566 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bc873a70-4495-4807-af84-356736dfcf60 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:25.865664 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bc873a70-4495-4807-af84-356736dfcf60 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:25.866532 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bc873a70-4495-4807-af84-356736dfcf60 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:26.206852 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-bc873a70-4495-4807-af84-356736dfcf60 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2034fc9060874868bc5d27370a1c351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89499d833a4a00805164f4f79ed522', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:02:26.218190 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-bc873a70-4495-4807-af84-356736dfcf60 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] 10.222.0.43 "GET /compute/v2.1/servers/19a673aa-44db-47a4-8642-5bc88f96b86b" status: 200 len: 1318 microversion: 2.1 time: 0.386592 Oct 04 22:02:26.238389 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1997/4014] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:02:25 2022] GET /compute/v2.1/servers/19a673aa-44db-47a4-8642-5bc88f96b86b => generated 1318 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:02:26.736656 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-31f1638d-26cc-4265-babb-b76ec6c0e198 tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:02:26.738650 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-31f1638d-26cc-4265-babb-b76ec6c0e198 tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] [instance: 49298a04-d3ab-4bb1-b8ed-ca7db4e028f3] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:02:26.752907 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-31f1638d-26cc-4265-babb-b76ec6c0e198 tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:26.753806 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-31f1638d-26cc-4265-babb-b76ec6c0e198 tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:26.754596 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-31f1638d-26cc-4265-babb-b76ec6c0e198 tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:26.756423 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-31f1638d-26cc-4265-babb-b76ec6c0e198 tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:26.758094 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-31f1638d-26cc-4265-babb-b76ec6c0e198 tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:26.758852 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-31f1638d-26cc-4265-babb-b76ec6c0e198 tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:27.154419 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-31f1638d-26cc-4265-babb-b76ec6c0e198 tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f50bbed6deb45e1a2d081745777596c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bad5849b558042d1a5288e8a4443fb53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:02:27.180349 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-31f1638d-26cc-4265-babb-b76ec6c0e198 tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] 10.222.0.43 "GET /compute/v2.1/servers/49298a04-d3ab-4bb1-b8ed-ca7db4e028f3" status: 200 len: 1535 microversion: 2.1 time: 0.445575 Oct 04 22:02:27.180349 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2018/4015] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:02:26 2022] GET /compute/v2.1/servers/49298a04-d3ab-4bb1-b8ed-ca7db4e028f3 => generated 1535 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:02:27.202199 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-682b9a76-1346-48a7-923a-0572af6a4c54 tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Action: 'create', calling method: .version_select at 0x7fbb2e15b790>, body: {"pool": "24746097-fcdf-4b45-9e46-271eb6b454d7"} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:02:27.211223 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=2 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:02:27.251732 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-35cb5053-ab89-4963-ae4f-38704f042ae2 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:02:27.252356 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-35cb5053-ab89-4963-ae4f-38704f042ae2 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] [instance: 19a673aa-44db-47a4-8642-5bc88f96b86b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:02:27.260893 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-35cb5053-ab89-4963-ae4f-38704f042ae2 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:27.262311 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-35cb5053-ab89-4963-ae4f-38704f042ae2 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:27.263191 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-35cb5053-ab89-4963-ae4f-38704f042ae2 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:27.263980 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-35cb5053-ab89-4963-ae4f-38704f042ae2 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:27.264421 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-35cb5053-ab89-4963-ae4f-38704f042ae2 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:27.273147 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-35cb5053-ab89-4963-ae4f-38704f042ae2 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:27.864419 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-35cb5053-ab89-4963-ae4f-38704f042ae2 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2034fc9060874868bc5d27370a1c351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89499d833a4a00805164f4f79ed522', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:02:27.879360 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-35cb5053-ab89-4963-ae4f-38704f042ae2 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] 10.222.0.43 "GET /compute/v2.1/servers/19a673aa-44db-47a4-8642-5bc88f96b86b" status: 200 len: 1318 microversion: 2.1 time: 0.631679 Oct 04 22:02:27.880394 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2019/4016] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:02:27 2022] GET /compute/v2.1/servers/19a673aa-44db-47a4-8642-5bc88f96b86b => generated 1318 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:02:27.885725 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-621dc48a-422a-459f-aad1-f03745d7bed5 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:02:27.886241 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-621dc48a-422a-459f-aad1-f03745d7bed5 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: f9376877-b87d-4738-b940-2bf314c83337] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:02:27.905974 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-621dc48a-422a-459f-aad1-f03745d7bed5 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:27.907136 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-621dc48a-422a-459f-aad1-f03745d7bed5 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:27.907765 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-621dc48a-422a-459f-aad1-f03745d7bed5 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:27.909515 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-621dc48a-422a-459f-aad1-f03745d7bed5 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:27.910589 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-621dc48a-422a-459f-aad1-f03745d7bed5 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:27.911752 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-621dc48a-422a-459f-aad1-f03745d7bed5 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:27.972141 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-621dc48a-422a-459f-aad1-f03745d7bed5 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: f9376877-b87d-4738-b940-2bf314c83337] Going to try to terminate instance {{(pid=134102) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 22:02:28.207302 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-621dc48a-422a-459f-aad1-f03745d7bed5 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "DELETE /compute/v2.1/servers/f9376877-b87d-4738-b940-2bf314c83337" status: 204 len: 0 microversion: 2.1 time: 0.325329 Oct 04 22:02:28.208893 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2020/4017] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 22:02:27 2022] DELETE /compute/v2.1/servers/f9376877-b87d-4738-b940-2bf314c83337 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 22:02:28.223488 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-91204272-7c3b-41b5-ae41-bf7e27858132 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:02:28.224419 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-91204272-7c3b-41b5-ae41-bf7e27858132 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: f9376877-b87d-4738-b940-2bf314c83337] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:02:28.231451 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-91204272-7c3b-41b5-ae41-bf7e27858132 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:28.232240 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-91204272-7c3b-41b5-ae41-bf7e27858132 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:28.232870 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-91204272-7c3b-41b5-ae41-bf7e27858132 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:28.233841 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-91204272-7c3b-41b5-ae41-bf7e27858132 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:28.234550 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-91204272-7c3b-41b5-ae41-bf7e27858132 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:28.235196 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-91204272-7c3b-41b5-ae41-bf7e27858132 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:28.824742 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-91204272-7c3b-41b5-ae41-bf7e27858132 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a1c8d841104bc9b6910bcc2c0e2bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe9283584fc4d90b0715216d867ea2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:02:28.831862 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:02:28.850732 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-91204272-7c3b-41b5-ae41-bf7e27858132 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "GET /compute/v2.1/servers/f9376877-b87d-4738-b940-2bf314c83337" status: 200 len: 1555 microversion: 2.1 time: 0.635817 Oct 04 22:02:28.860319 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2021/4018] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:02:28 2022] GET /compute/v2.1/servers/f9376877-b87d-4738-b940-2bf314c83337 => generated 1555 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:02:28.870697 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-3bf2a527-a121-4815-b1b2-54eb189b107d req-be9c6ea0-51ec-4038-ae28-ab05c06f5af2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19a673aa-44db-47a4-8642-5bc88f96b86b", "name": "network-vif-plugged", "status": "completed", "tag": "eaa121f9-c4cc-46aa-8ab0-8bccbe96fc5d"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:02:28.888527 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-3bf2a527-a121-4815-b1b2-54eb189b107d req-be9c6ea0-51ec-4038-ae28-ab05c06f5af2 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:28.889401 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-3bf2a527-a121-4815-b1b2-54eb189b107d req-be9c6ea0-51ec-4038-ae28-ab05c06f5af2 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:28.890156 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-3bf2a527-a121-4815-b1b2-54eb189b107d req-be9c6ea0-51ec-4038-ae28-ab05c06f5af2 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:28.912459 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-3bf2a527-a121-4815-b1b2-54eb189b107d req-be9c6ea0-51ec-4038-ae28-ab05c06f5af2 service nova] Creating event network-vif-plugged:eaa121f9-c4cc-46aa-8ab0-8bccbe96fc5d for instance 19a673aa-44db-47a4-8642-5bc88f96b86b on n-h1-860284-1 Oct 04 22:02:28.919597 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-3bf2a527-a121-4815-b1b2-54eb189b107d req-be9c6ea0-51ec-4038-ae28-ab05c06f5af2 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056693 Oct 04 22:02:28.920746 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2022/4019] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:02:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:02:28.937143 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-e65ef5cd-c23b-48e0-a704-8b0b8390b2c5 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:02:28.937885 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-e65ef5cd-c23b-48e0-a704-8b0b8390b2c5 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] [instance: 19a673aa-44db-47a4-8642-5bc88f96b86b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:02:28.945727 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e65ef5cd-c23b-48e0-a704-8b0b8390b2c5 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:28.946747 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e65ef5cd-c23b-48e0-a704-8b0b8390b2c5 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:28.947733 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e65ef5cd-c23b-48e0-a704-8b0b8390b2c5 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:28.948696 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e65ef5cd-c23b-48e0-a704-8b0b8390b2c5 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:28.949358 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e65ef5cd-c23b-48e0-a704-8b0b8390b2c5 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:28.949987 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e65ef5cd-c23b-48e0-a704-8b0b8390b2c5 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:29.359671 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-e65ef5cd-c23b-48e0-a704-8b0b8390b2c5 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2034fc9060874868bc5d27370a1c351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89499d833a4a00805164f4f79ed522', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:02:29.376773 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-e65ef5cd-c23b-48e0-a704-8b0b8390b2c5 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] 10.222.0.43 "GET /compute/v2.1/servers/19a673aa-44db-47a4-8642-5bc88f96b86b" status: 200 len: 1318 microversion: 2.1 time: 0.454581 Oct 04 22:02:29.377596 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2023/4020] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:02:28 2022] GET /compute/v2.1/servers/19a673aa-44db-47a4-8642-5bc88f96b86b => generated 1318 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:02:29.884602 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-ff32818c-1898-43e5-92ad-fc75604d7702 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:02:29.885509 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-ff32818c-1898-43e5-92ad-fc75604d7702 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: f9376877-b87d-4738-b940-2bf314c83337] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:02:29.899403 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ff32818c-1898-43e5-92ad-fc75604d7702 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:29.902421 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ff32818c-1898-43e5-92ad-fc75604d7702 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:29.903543 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ff32818c-1898-43e5-92ad-fc75604d7702 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:29.906538 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ff32818c-1898-43e5-92ad-fc75604d7702 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:29.908782 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ff32818c-1898-43e5-92ad-fc75604d7702 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:29.909470 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ff32818c-1898-43e5-92ad-fc75604d7702 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:30.472453 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-ff32818c-1898-43e5-92ad-fc75604d7702 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a1c8d841104bc9b6910bcc2c0e2bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe9283584fc4d90b0715216d867ea2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:02:30.485123 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-ff32818c-1898-43e5-92ad-fc75604d7702 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "GET /compute/v2.1/servers/f9376877-b87d-4738-b940-2bf314c83337" status: 200 len: 1555 microversion: 2.1 time: 0.608844 Oct 04 22:02:30.485736 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2024/4021] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:02:29 2022] GET /compute/v2.1/servers/f9376877-b87d-4738-b940-2bf314c83337 => generated 1555 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:02:30.499673 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-eb4d062e-a3f2-4389-8b74-3151e4fa86ed tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:02:30.503534 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-eb4d062e-a3f2-4389-8b74-3151e4fa86ed tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] [instance: 19a673aa-44db-47a4-8642-5bc88f96b86b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:02:30.513595 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-eb4d062e-a3f2-4389-8b74-3151e4fa86ed tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:30.514571 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-eb4d062e-a3f2-4389-8b74-3151e4fa86ed tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:30.515289 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-eb4d062e-a3f2-4389-8b74-3151e4fa86ed tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:30.516245 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-eb4d062e-a3f2-4389-8b74-3151e4fa86ed tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:30.517064 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-eb4d062e-a3f2-4389-8b74-3151e4fa86ed tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:30.517889 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-eb4d062e-a3f2-4389-8b74-3151e4fa86ed tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:31.225465 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-eb4d062e-a3f2-4389-8b74-3151e4fa86ed tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2034fc9060874868bc5d27370a1c351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89499d833a4a00805164f4f79ed522', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:02:31.234382 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-eb4d062e-a3f2-4389-8b74-3151e4fa86ed tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] 10.222.0.43 "GET /compute/v2.1/servers/19a673aa-44db-47a4-8642-5bc88f96b86b" status: 200 len: 1318 microversion: 2.1 time: 0.746757 Oct 04 22:02:31.252137 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2025/4022] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:02:30 2022] GET /compute/v2.1/servers/19a673aa-44db-47a4-8642-5bc88f96b86b => generated 1318 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:02:31.511197 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-01c03eae-2fe4-42e2-befa-40e852baf689 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:02:31.511946 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-01c03eae-2fe4-42e2-befa-40e852baf689 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: f9376877-b87d-4738-b940-2bf314c83337] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:02:31.520849 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-01c03eae-2fe4-42e2-befa-40e852baf689 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:31.527038 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-01c03eae-2fe4-42e2-befa-40e852baf689 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:31.527738 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-01c03eae-2fe4-42e2-befa-40e852baf689 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:31.528648 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-01c03eae-2fe4-42e2-befa-40e852baf689 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:31.529266 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-01c03eae-2fe4-42e2-befa-40e852baf689 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:31.529839 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-01c03eae-2fe4-42e2-befa-40e852baf689 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:31.873084 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-682b9a76-1346-48a7-923a-0572af6a4c54 tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] 10.222.0.43 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 4.674871 Oct 04 22:02:31.882289 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1998/4023] 10.222.0.43 () {60 vars in 1170 bytes} [Tue Oct 4 22:02:27 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 4685 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:02:31.891306 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-d1bcb524-9d91-4af2-9a24-726b14bd703d tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.1.94"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:02:31.893893 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-d1bcb524-9d91-4af2-9a24-726b14bd703d tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] [instance: 49298a04-d3ab-4bb1-b8ed-ca7db4e028f3] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:02:31.902630 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d1bcb524-9d91-4af2-9a24-726b14bd703d tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:31.902630 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d1bcb524-9d91-4af2-9a24-726b14bd703d tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:31.902630 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d1bcb524-9d91-4af2-9a24-726b14bd703d tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:31.903073 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d1bcb524-9d91-4af2-9a24-726b14bd703d tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:31.903577 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d1bcb524-9d91-4af2-9a24-726b14bd703d tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:31.904065 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d1bcb524-9d91-4af2-9a24-726b14bd703d tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:31.935992 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d1bcb524-9d91-4af2-9a24-726b14bd703d tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Acquiring lock "refresh_cache-49298a04-d3ab-4bb1-b8ed-ca7db4e028f3" {{(pid=134101) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 04 22:02:31.936408 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d1bcb524-9d91-4af2-9a24-726b14bd703d tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Acquired lock "refresh_cache-49298a04-d3ab-4bb1-b8ed-ca7db4e028f3" {{(pid=134101) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 04 22:02:31.995333 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-01c03eae-2fe4-42e2-befa-40e852baf689 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a1c8d841104bc9b6910bcc2c0e2bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe9283584fc4d90b0715216d867ea2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:02:32.005888 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-01c03eae-2fe4-42e2-befa-40e852baf689 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "GET /compute/v2.1/servers/f9376877-b87d-4738-b940-2bf314c83337" status: 200 len: 1555 microversion: 2.1 time: 0.498630 Oct 04 22:02:32.006865 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2026/4024] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:02:31 2022] GET /compute/v2.1/servers/f9376877-b87d-4738-b940-2bf314c83337 => generated 1555 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:02:32.262292 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-f7fd6f18-abfa-4702-b426-147a6ca92ce0 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:02:32.262957 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-f7fd6f18-abfa-4702-b426-147a6ca92ce0 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] [instance: 19a673aa-44db-47a4-8642-5bc88f96b86b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:02:32.269388 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f7fd6f18-abfa-4702-b426-147a6ca92ce0 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:32.269879 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f7fd6f18-abfa-4702-b426-147a6ca92ce0 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:32.270959 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f7fd6f18-abfa-4702-b426-147a6ca92ce0 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:32.271500 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f7fd6f18-abfa-4702-b426-147a6ca92ce0 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:32.272177 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f7fd6f18-abfa-4702-b426-147a6ca92ce0 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:32.272677 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f7fd6f18-abfa-4702-b426-147a6ca92ce0 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:33.237794 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-f7fd6f18-abfa-4702-b426-147a6ca92ce0 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2034fc9060874868bc5d27370a1c351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89499d833a4a00805164f4f79ed522', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:02:33.251518 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-f7fd6f18-abfa-4702-b426-147a6ca92ce0 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] 10.222.0.43 "GET /compute/v2.1/servers/19a673aa-44db-47a4-8642-5bc88f96b86b" status: 200 len: 1508 microversion: 2.1 time: 0.995666 Oct 04 22:02:33.252555 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2027/4025] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:02:32 2022] GET /compute/v2.1/servers/19a673aa-44db-47a4-8642-5bc88f96b86b => generated 1508 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:02:33.265711 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-64b79d24-8714-4ca1-9211-f3b7a69ea6b0 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:02:33.266354 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-64b79d24-8714-4ca1-9211-f3b7a69ea6b0 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: f9376877-b87d-4738-b940-2bf314c83337] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:02:33.278186 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-64b79d24-8714-4ca1-9211-f3b7a69ea6b0 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:33.279151 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-64b79d24-8714-4ca1-9211-f3b7a69ea6b0 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:33.279777 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-64b79d24-8714-4ca1-9211-f3b7a69ea6b0 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:33.283329 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-64b79d24-8714-4ca1-9211-f3b7a69ea6b0 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:33.284153 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-64b79d24-8714-4ca1-9211-f3b7a69ea6b0 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:33.284784 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-64b79d24-8714-4ca1-9211-f3b7a69ea6b0 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:33.421112 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-64b79d24-8714-4ca1-9211-f3b7a69ea6b0 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a1c8d841104bc9b6910bcc2c0e2bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe9283584fc4d90b0715216d867ea2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:02:33.436033 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-64b79d24-8714-4ca1-9211-f3b7a69ea6b0 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "GET /compute/v2.1/servers/f9376877-b87d-4738-b940-2bf314c83337" status: 200 len: 1346 microversion: 2.1 time: 0.182245 Oct 04 22:02:33.452419 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2028/4026] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:02:33 2022] GET /compute/v2.1/servers/f9376877-b87d-4738-b940-2bf314c83337 => generated 1346 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:02:33.463808 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-ba3735f2-e477-4230-924e-a07d18761eda req-fd5521e2-4f7c-4f9d-ac07-e8189c4832ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9376877-b87d-4738-b940-2bf314c83337", "name": "network-vif-deleted", "tag": "c1424a9c-7ef8-4143-88f4-7519c96678b1"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:02:33.480432 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-ba3735f2-e477-4230-924e-a07d18761eda req-fd5521e2-4f7c-4f9d-ac07-e8189c4832ee service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:33.483849 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-ba3735f2-e477-4230-924e-a07d18761eda req-fd5521e2-4f7c-4f9d-ac07-e8189c4832ee service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:33.484433 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-ba3735f2-e477-4230-924e-a07d18761eda req-fd5521e2-4f7c-4f9d-ac07-e8189c4832ee service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:33.519623 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-ba3735f2-e477-4230-924e-a07d18761eda req-fd5521e2-4f7c-4f9d-ac07-e8189c4832ee service nova] Creating event network-vif-deleted:c1424a9c-7ef8-4143-88f4-7519c96678b1 for instance f9376877-b87d-4738-b940-2bf314c83337 on n-h1-860284-1 Oct 04 22:02:33.536318 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-ba3735f2-e477-4230-924e-a07d18761eda req-fd5521e2-4f7c-4f9d-ac07-e8189c4832ee service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080400 Oct 04 22:02:33.536934 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2029/4027] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:02:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:02:33.552942 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-05b1edd9-b104-4652-ab5e-5415811cdde0 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:02:33.553675 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-05b1edd9-b104-4652-ab5e-5415811cdde0 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] [instance: 19a673aa-44db-47a4-8642-5bc88f96b86b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:02:33.564178 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-05b1edd9-b104-4652-ab5e-5415811cdde0 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:33.564673 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-05b1edd9-b104-4652-ab5e-5415811cdde0 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:33.565160 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-05b1edd9-b104-4652-ab5e-5415811cdde0 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:33.565876 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-05b1edd9-b104-4652-ab5e-5415811cdde0 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:33.566344 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-05b1edd9-b104-4652-ab5e-5415811cdde0 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:33.566802 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-05b1edd9-b104-4652-ab5e-5415811cdde0 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:33.971939 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-05b1edd9-b104-4652-ab5e-5415811cdde0 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2034fc9060874868bc5d27370a1c351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89499d833a4a00805164f4f79ed522', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:02:33.987362 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-05b1edd9-b104-4652-ab5e-5415811cdde0 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] 10.222.0.43 "GET /compute/v2.1/servers/19a673aa-44db-47a4-8642-5bc88f96b86b" status: 200 len: 1508 microversion: 2.1 time: 0.446895 Oct 04 22:02:33.987973 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2030/4028] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:02:33 2022] GET /compute/v2.1/servers/19a673aa-44db-47a4-8642-5bc88f96b86b => generated 1508 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:02:34.012191 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-2c2b7606-943f-4d64-8768-91152c0d6355 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:02:34.017400 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-2c2b7606-943f-4d64-8768-91152c0d6355 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] [instance: 19a673aa-44db-47a4-8642-5bc88f96b86b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:02:34.025438 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2c2b7606-943f-4d64-8768-91152c0d6355 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:34.026395 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2c2b7606-943f-4d64-8768-91152c0d6355 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:34.027141 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2c2b7606-943f-4d64-8768-91152c0d6355 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:34.028046 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2c2b7606-943f-4d64-8768-91152c0d6355 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:34.028688 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2c2b7606-943f-4d64-8768-91152c0d6355 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:34.029267 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2c2b7606-943f-4d64-8768-91152c0d6355 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:34.159053 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-2c2b7606-943f-4d64-8768-91152c0d6355 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] 10.222.0.43 "PUT /compute/v2.1/servers/19a673aa-44db-47a4-8642-5bc88f96b86b" status: 200 len: 1080 microversion: 2.1 time: 0.148726 Oct 04 22:02:34.178153 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2031/4029] 10.222.0.43 () {60 vars in 1256 bytes} [Tue Oct 4 22:02:34 2022] PUT /compute/v2.1/servers/19a673aa-44db-47a4-8642-5bc88f96b86b => generated 1080 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:02:34.195492 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-5748b3ca-7056-4040-a63e-98cd13e1a735 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:02:34.208770 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-5748b3ca-7056-4040-a63e-98cd13e1a735 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] [instance: 19a673aa-44db-47a4-8642-5bc88f96b86b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:02:34.230288 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5748b3ca-7056-4040-a63e-98cd13e1a735 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:34.232011 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5748b3ca-7056-4040-a63e-98cd13e1a735 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:34.233513 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5748b3ca-7056-4040-a63e-98cd13e1a735 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:34.234285 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5748b3ca-7056-4040-a63e-98cd13e1a735 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:34.234840 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5748b3ca-7056-4040-a63e-98cd13e1a735 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:34.238143 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5748b3ca-7056-4040-a63e-98cd13e1a735 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:34.634893 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-5748b3ca-7056-4040-a63e-98cd13e1a735 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2034fc9060874868bc5d27370a1c351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89499d833a4a00805164f4f79ed522', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:02:34.652015 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-5748b3ca-7056-4040-a63e-98cd13e1a735 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] 10.222.0.43 "GET /compute/v2.1/servers/19a673aa-44db-47a4-8642-5bc88f96b86b" status: 200 len: 1506 microversion: 2.1 time: 0.465228 Oct 04 22:02:34.652953 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2032/4030] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:02:34 2022] GET /compute/v2.1/servers/19a673aa-44db-47a4-8642-5bc88f96b86b => generated 1506 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:02:34.657556 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-05db5ad7-2aa3-46b0-a342-315cd007cac1 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:02:34.658172 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-05db5ad7-2aa3-46b0-a342-315cd007cac1 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: f9376877-b87d-4738-b940-2bf314c83337] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:02:34.669714 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-05db5ad7-2aa3-46b0-a342-315cd007cac1 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:34.670201 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-05db5ad7-2aa3-46b0-a342-315cd007cac1 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:34.670661 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-05db5ad7-2aa3-46b0-a342-315cd007cac1 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:34.676827 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-05db5ad7-2aa3-46b0-a342-315cd007cac1 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:34.680416 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-05db5ad7-2aa3-46b0-a342-315cd007cac1 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:34.681309 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-05db5ad7-2aa3-46b0-a342-315cd007cac1 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:34.876545 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-05db5ad7-2aa3-46b0-a342-315cd007cac1 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a1c8d841104bc9b6910bcc2c0e2bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe9283584fc4d90b0715216d867ea2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:02:34.888416 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-05db5ad7-2aa3-46b0-a342-315cd007cac1 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "GET /compute/v2.1/servers/f9376877-b87d-4738-b940-2bf314c83337" status: 200 len: 1346 microversion: 2.1 time: 0.234405 Oct 04 22:02:34.893300 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2033/4031] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:02:34 2022] GET /compute/v2.1/servers/f9376877-b87d-4738-b940-2bf314c83337 => generated 1346 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:02:34.903584 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-9da58466-0619-4da0-9147-873ad3490a01 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:02:34.910694 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-9da58466-0619-4da0-9147-873ad3490a01 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] [instance: 19a673aa-44db-47a4-8642-5bc88f96b86b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:02:34.927326 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9da58466-0619-4da0-9147-873ad3490a01 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:34.939021 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9da58466-0619-4da0-9147-873ad3490a01 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:34.941188 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9da58466-0619-4da0-9147-873ad3490a01 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:34.942986 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9da58466-0619-4da0-9147-873ad3490a01 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:34.944291 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9da58466-0619-4da0-9147-873ad3490a01 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:34.945073 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9da58466-0619-4da0-9147-873ad3490a01 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:35.196112 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.network.neutron [None req-d1bcb524-9d91-4af2-9a24-726b14bd703d tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] [instance: 49298a04-d3ab-4bb1-b8ed-ca7db4e028f3] Building network info cache for instance {{(pid=134101) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 04 22:02:35.245003 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell0:SELECT=12 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:02:35.566972 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-9da58466-0619-4da0-9147-873ad3490a01 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2034fc9060874868bc5d27370a1c351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89499d833a4a00805164f4f79ed522', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:02:35.578303 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-9da58466-0619-4da0-9147-873ad3490a01 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] 10.222.0.43 "GET /compute/v2.1/servers/19a673aa-44db-47a4-8642-5bc88f96b86b" status: 200 len: 1506 microversion: 2.1 time: 0.681462 Oct 04 22:02:35.580892 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2034/4032] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:02:34 2022] GET /compute/v2.1/servers/19a673aa-44db-47a4-8642-5bc88f96b86b => generated 1506 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:02:35.585213 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=12 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:02:35.599858 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-6210330e-b6ab-4ff6-b9f5-94dc57d01d02 req-994010ae-3e12-4978-9853-c49bfe133784 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49298a04-d3ab-4bb1-b8ed-ca7db4e028f3", "tag": "4db0b86a-68bb-4021-8879-799b566c6728"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:02:35.628404 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-6210330e-b6ab-4ff6-b9f5-94dc57d01d02 req-994010ae-3e12-4978-9853-c49bfe133784 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:35.628916 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-6210330e-b6ab-4ff6-b9f5-94dc57d01d02 req-994010ae-3e12-4978-9853-c49bfe133784 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:35.629355 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-6210330e-b6ab-4ff6-b9f5-94dc57d01d02 req-994010ae-3e12-4978-9853-c49bfe133784 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:35.673706 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-6210330e-b6ab-4ff6-b9f5-94dc57d01d02 req-994010ae-3e12-4978-9853-c49bfe133784 service nova] Creating event network-changed:4db0b86a-68bb-4021-8879-799b566c6728 for instance 49298a04-d3ab-4bb1-b8ed-ca7db4e028f3 on n-h2-860284-1 Oct 04 22:02:35.681096 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-6210330e-b6ab-4ff6-b9f5-94dc57d01d02 req-994010ae-3e12-4978-9853-c49bfe133784 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085642 Oct 04 22:02:35.686788 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2035/4033] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:02:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:02:35.700868 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-de39bd22-9787-46c9-b8e5-88ae98867e8a tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:02:35.713940 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-de39bd22-9787-46c9-b8e5-88ae98867e8a tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] [instance: 19a673aa-44db-47a4-8642-5bc88f96b86b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:02:35.733432 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-de39bd22-9787-46c9-b8e5-88ae98867e8a tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:35.733940 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-de39bd22-9787-46c9-b8e5-88ae98867e8a tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:35.734527 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-de39bd22-9787-46c9-b8e5-88ae98867e8a tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:35.740925 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-de39bd22-9787-46c9-b8e5-88ae98867e8a tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:35.741526 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-de39bd22-9787-46c9-b8e5-88ae98867e8a tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:35.742032 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-de39bd22-9787-46c9-b8e5-88ae98867e8a tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:35.905659 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-de39bd22-9787-46c9-b8e5-88ae98867e8a tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] 10.222.0.43 "PUT /compute/v2.1/servers/19a673aa-44db-47a4-8642-5bc88f96b86b" status: 200 len: 1082 microversion: 2.1 time: 0.217459 Oct 04 22:02:35.908286 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2036/4034] 10.222.0.43 () {60 vars in 1256 bytes} [Tue Oct 4 22:02:35 2022] PUT /compute/v2.1/servers/19a673aa-44db-47a4-8642-5bc88f96b86b => generated 1082 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:02:35.923151 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-48fc5a5e-fb0b-4669-951f-cd92ce60034f tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:02:35.923825 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-48fc5a5e-fb0b-4669-951f-cd92ce60034f tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: f9376877-b87d-4738-b940-2bf314c83337] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:02:35.941796 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-48fc5a5e-fb0b-4669-951f-cd92ce60034f tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:35.944915 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-48fc5a5e-fb0b-4669-951f-cd92ce60034f tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:35.947601 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-48fc5a5e-fb0b-4669-951f-cd92ce60034f tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:35.949582 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-48fc5a5e-fb0b-4669-951f-cd92ce60034f tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:35.952146 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-48fc5a5e-fb0b-4669-951f-cd92ce60034f tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:35.954031 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-48fc5a5e-fb0b-4669-951f-cd92ce60034f tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:36.320564 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-48fc5a5e-fb0b-4669-951f-cd92ce60034f tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a1c8d841104bc9b6910bcc2c0e2bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe9283584fc4d90b0715216d867ea2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:02:36.334440 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-48fc5a5e-fb0b-4669-951f-cd92ce60034f tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "GET /compute/v2.1/servers/f9376877-b87d-4738-b940-2bf314c83337" status: 200 len: 1346 microversion: 2.1 time: 0.421668 Oct 04 22:02:36.355366 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2037/4035] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:02:35 2022] GET /compute/v2.1/servers/f9376877-b87d-4738-b940-2bf314c83337 => generated 1346 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:02:36.368224 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-557bd17f-5e1d-46d1-be89-8daf6790e53a tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:02:36.374672 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-557bd17f-5e1d-46d1-be89-8daf6790e53a tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] [instance: 19a673aa-44db-47a4-8642-5bc88f96b86b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:02:36.391229 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-557bd17f-5e1d-46d1-be89-8daf6790e53a tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:36.392081 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-557bd17f-5e1d-46d1-be89-8daf6790e53a tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:36.394523 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-557bd17f-5e1d-46d1-be89-8daf6790e53a tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:36.395463 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-557bd17f-5e1d-46d1-be89-8daf6790e53a tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:36.396566 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-557bd17f-5e1d-46d1-be89-8daf6790e53a tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:36.400623 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-557bd17f-5e1d-46d1-be89-8daf6790e53a tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:36.843758 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-557bd17f-5e1d-46d1-be89-8daf6790e53a tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2034fc9060874868bc5d27370a1c351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89499d833a4a00805164f4f79ed522', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:02:36.858399 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-557bd17f-5e1d-46d1-be89-8daf6790e53a tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] 10.222.0.43 "GET /compute/v2.1/servers/19a673aa-44db-47a4-8642-5bc88f96b86b" status: 200 len: 1508 microversion: 2.1 time: 0.500839 Oct 04 22:02:36.882542 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2038/4036] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:02:36 2022] GET /compute/v2.1/servers/19a673aa-44db-47a4-8642-5bc88f96b86b => generated 1508 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:02:36.903378 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-9c6f81c9-ef8a-4db1-916c-e6d44f7ff1fa tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:02:36.904249 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-9c6f81c9-ef8a-4db1-916c-e6d44f7ff1fa tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] [instance: 19a673aa-44db-47a4-8642-5bc88f96b86b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:02:36.923571 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:02:36.925764 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9c6f81c9-ef8a-4db1-916c-e6d44f7ff1fa tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:36.926687 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9c6f81c9-ef8a-4db1-916c-e6d44f7ff1fa tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:36.927295 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9c6f81c9-ef8a-4db1-916c-e6d44f7ff1fa tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:36.932262 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9c6f81c9-ef8a-4db1-916c-e6d44f7ff1fa tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:36.933182 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9c6f81c9-ef8a-4db1-916c-e6d44f7ff1fa tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:36.933813 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9c6f81c9-ef8a-4db1-916c-e6d44f7ff1fa tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:36.947608 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:02:37.327446 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.network.neutron [None req-d1bcb524-9d91-4af2-9a24-726b14bd703d tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] [instance: 49298a04-d3ab-4bb1-b8ed-ca7db4e028f3] Updating instance_info_cache with network_info: [{"id": "4db0b86a-68bb-4021-8879-799b566c6728", "address": "fa:16:3e:e9:ca:bd", "network": {"id": "127690ac-f36b-46d5-a87d-a2ce7681c8ef", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-1895018730-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.1.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "bad5849b558042d1a5288e8a4443fb53", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap4db0b86a-68", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=134101) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 04 22:02:37.343619 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d1bcb524-9d91-4af2-9a24-726b14bd703d tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Releasing lock "refresh_cache-49298a04-d3ab-4bb1-b8ed-ca7db4e028f3" {{(pid=134101) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 04 22:02:37.344781 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-d1bcb524-9d91-4af2-9a24-726b14bd703d tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] 10.222.0.43 "POST /compute/v2.1/servers/49298a04-d3ab-4bb1-b8ed-ca7db4e028f3/action" status: 202 len: 0 microversion: 2.1 time: 5.461225 Oct 04 22:02:37.345806 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 1999/4037] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 22:02:31 2022] POST /compute/v2.1/servers/49298a04-d3ab-4bb1-b8ed-ca7db4e028f3/action => generated 0 bytes in 5463 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 04 22:02:37.361315 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-4f685f69-2415-470d-a2e7-8bafd2a848b8 tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Action: 'create', calling method: .version_select at 0x7fbb2ee994c0>, body: {"pool": "24746097-fcdf-4b45-9e46-271eb6b454d7"} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:02:37.379497 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-9c6f81c9-ef8a-4db1-916c-e6d44f7ff1fa tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2034fc9060874868bc5d27370a1c351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89499d833a4a00805164f4f79ed522', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:02:37.390543 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-9c6f81c9-ef8a-4db1-916c-e6d44f7ff1fa tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] 10.222.0.43 "GET /compute/v2.1/servers/19a673aa-44db-47a4-8642-5bc88f96b86b" status: 200 len: 1508 microversion: 2.1 time: 0.502523 Oct 04 22:02:37.404916 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2039/4038] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:02:36 2022] GET /compute/v2.1/servers/19a673aa-44db-47a4-8642-5bc88f96b86b => generated 1508 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:02:37.404916 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-86b6862c-317a-4ff1-aa6f-a9ccf6c76570 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:02:37.404916 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-86b6862c-317a-4ff1-aa6f-a9ccf6c76570 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: f9376877-b87d-4738-b940-2bf314c83337] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:02:37.420192 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-86b6862c-317a-4ff1-aa6f-a9ccf6c76570 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:37.420697 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-86b6862c-317a-4ff1-aa6f-a9ccf6c76570 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:37.421136 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-86b6862c-317a-4ff1-aa6f-a9ccf6c76570 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:37.424448 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-86b6862c-317a-4ff1-aa6f-a9ccf6c76570 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:37.426509 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-86b6862c-317a-4ff1-aa6f-a9ccf6c76570 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:37.427210 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-86b6862c-317a-4ff1-aa6f-a9ccf6c76570 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:37.788047 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-86b6862c-317a-4ff1-aa6f-a9ccf6c76570 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a1c8d841104bc9b6910bcc2c0e2bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe9283584fc4d90b0715216d867ea2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:02:37.798732 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-86b6862c-317a-4ff1-aa6f-a9ccf6c76570 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "GET /compute/v2.1/servers/f9376877-b87d-4738-b940-2bf314c83337" status: 200 len: 1346 microversion: 2.1 time: 0.405380 Oct 04 22:02:37.806520 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2040/4039] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:02:37 2022] GET /compute/v2.1/servers/f9376877-b87d-4738-b940-2bf314c83337 => generated 1346 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:02:37.818335 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-07dcbab5-a62b-432a-916c-3b90b76e4daa tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:02:37.828190 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-07dcbab5-a62b-432a-916c-3b90b76e4daa tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] [instance: 19a673aa-44db-47a4-8642-5bc88f96b86b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:02:37.853893 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-07dcbab5-a62b-432a-916c-3b90b76e4daa tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:37.854818 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-07dcbab5-a62b-432a-916c-3b90b76e4daa tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:37.864041 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-07dcbab5-a62b-432a-916c-3b90b76e4daa tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:37.864935 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-07dcbab5-a62b-432a-916c-3b90b76e4daa tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:37.865435 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-07dcbab5-a62b-432a-916c-3b90b76e4daa tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:37.865869 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-07dcbab5-a62b-432a-916c-3b90b76e4daa tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:37.980979 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-07dcbab5-a62b-432a-916c-3b90b76e4daa tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] [instance: 19a673aa-44db-47a4-8642-5bc88f96b86b] Going to try to terminate instance {{(pid=134102) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 22:02:38.268689 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-07dcbab5-a62b-432a-916c-3b90b76e4daa tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] 10.222.0.43 "DELETE /compute/v2.1/servers/19a673aa-44db-47a4-8642-5bc88f96b86b" status: 204 len: 0 microversion: 2.1 time: 0.457284 Oct 04 22:02:38.269913 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2041/4040] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 22:02:37 2022] DELETE /compute/v2.1/servers/19a673aa-44db-47a4-8642-5bc88f96b86b => generated 0 bytes in 463 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 22:02:38.284855 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-f57522d9-7edd-480a-b313-16959404aa07 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:02:38.287567 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-f57522d9-7edd-480a-b313-16959404aa07 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] [instance: 19a673aa-44db-47a4-8642-5bc88f96b86b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:02:38.305160 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f57522d9-7edd-480a-b313-16959404aa07 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:38.308559 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f57522d9-7edd-480a-b313-16959404aa07 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:38.309262 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f57522d9-7edd-480a-b313-16959404aa07 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:38.314792 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f57522d9-7edd-480a-b313-16959404aa07 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:38.315968 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f57522d9-7edd-480a-b313-16959404aa07 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:38.317025 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f57522d9-7edd-480a-b313-16959404aa07 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:38.417306 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-f57522d9-7edd-480a-b313-16959404aa07 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] [instance: 19a673aa-44db-47a4-8642-5bc88f96b86b] Going to try to terminate instance {{(pid=134102) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 22:02:38.536112 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.compute.api [None req-f57522d9-7edd-480a-b313-16959404aa07 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] [instance: 19a673aa-44db-47a4-8642-5bc88f96b86b] Instance is already in deleting state, ignoring this request Oct 04 22:02:38.541558 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-f57522d9-7edd-480a-b313-16959404aa07 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] 10.222.0.43 "DELETE /compute/v2.1/servers/19a673aa-44db-47a4-8642-5bc88f96b86b" status: 204 len: 0 microversion: 2.1 time: 0.263012 Oct 04 22:02:38.542807 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2042/4041] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 22:02:38 2022] DELETE /compute/v2.1/servers/19a673aa-44db-47a4-8642-5bc88f96b86b => generated 0 bytes in 265 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 22:02:38.559042 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-5d3adf31-4f2c-4e3c-ba58-f922c12498d3 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:02:38.559981 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-5d3adf31-4f2c-4e3c-ba58-f922c12498d3 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] [instance: 19a673aa-44db-47a4-8642-5bc88f96b86b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:02:38.575024 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5d3adf31-4f2c-4e3c-ba58-f922c12498d3 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:38.575588 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5d3adf31-4f2c-4e3c-ba58-f922c12498d3 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:38.576014 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5d3adf31-4f2c-4e3c-ba58-f922c12498d3 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:38.576843 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5d3adf31-4f2c-4e3c-ba58-f922c12498d3 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:38.577321 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5d3adf31-4f2c-4e3c-ba58-f922c12498d3 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:38.577794 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5d3adf31-4f2c-4e3c-ba58-f922c12498d3 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:38.876270 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-5d3adf31-4f2c-4e3c-ba58-f922c12498d3 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2034fc9060874868bc5d27370a1c351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89499d833a4a00805164f4f79ed522', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:02:38.899305 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-5d3adf31-4f2c-4e3c-ba58-f922c12498d3 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] 10.222.0.43 "GET /compute/v2.1/servers/19a673aa-44db-47a4-8642-5bc88f96b86b" status: 200 len: 1514 microversion: 2.1 time: 0.352381 Oct 04 22:02:38.901845 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2043/4042] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:02:38 2022] GET /compute/v2.1/servers/19a673aa-44db-47a4-8642-5bc88f96b86b => generated 1514 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:02:38.917359 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-2f5e6fc0-a888-4e62-a94b-3b9d8f96f678 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:02:38.919322 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-2f5e6fc0-a888-4e62-a94b-3b9d8f96f678 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: f9376877-b87d-4738-b940-2bf314c83337] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:02:38.943545 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2f5e6fc0-a888-4e62-a94b-3b9d8f96f678 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:38.944198 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2f5e6fc0-a888-4e62-a94b-3b9d8f96f678 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:38.947270 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2f5e6fc0-a888-4e62-a94b-3b9d8f96f678 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:38.949926 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2f5e6fc0-a888-4e62-a94b-3b9d8f96f678 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:38.950526 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2f5e6fc0-a888-4e62-a94b-3b9d8f96f678 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:38.951089 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2f5e6fc0-a888-4e62-a94b-3b9d8f96f678 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:39.096258 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-2f5e6fc0-a888-4e62-a94b-3b9d8f96f678 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a1c8d841104bc9b6910bcc2c0e2bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe9283584fc4d90b0715216d867ea2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:02:39.108406 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-2f5e6fc0-a888-4e62-a94b-3b9d8f96f678 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "GET /compute/v2.1/servers/f9376877-b87d-4738-b940-2bf314c83337" status: 200 len: 1346 microversion: 2.1 time: 0.205114 Oct 04 22:02:39.129573 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2044/4043] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:02:38 2022] GET /compute/v2.1/servers/f9376877-b87d-4738-b940-2bf314c83337 => generated 1346 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:02:39.896685 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-09b6d400-2bec-4b05-bb22-f17634bf145e tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Action: 'create', calling method: .version_select at 0x7fbb2e486280>, body: {"keypair": {"name": "tempest-keypair-2000945182", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDZLaVR/NBwHEF46wS2w09P3QR/yZk7fey5fNfbIeK1aXl017sajC/wPl6WX9elZalj0kPNoYGCUlDIwR+bYr4kMdokWuIPjRGE9l95Nos5v+KdxzCrsX18Wp90Sqdmo0Q=="}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:02:39.944438 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-09b6d400-2bec-4b05-bb22-f17634bf145e tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Getting quotas for project 82e1a29234ce40f9b37d0eca196cd1db. Resources: {'key_pairs'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:02:39.954659 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-09b6d400-2bec-4b05-bb22-f17634bf145e tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Getting quotas for user 80fc56886fef422b9b52eb1dede7d10e and project 82e1a29234ce40f9b37d0eca196cd1db. Resources: {'key_pairs'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:02:39.998257 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-09b6d400-2bec-4b05-bb22-f17634bf145e tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.637937 Oct 04 22:02:39.999291 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2045/4044] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Oct 4 22:02:39 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:02:40.004970 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-065cd7ba-20a5-48d4-8e56-86a472e976e1 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:02:40.008869 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-065cd7ba-20a5-48d4-8e56-86a472e976e1 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] [instance: 19a673aa-44db-47a4-8642-5bc88f96b86b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:02:40.020263 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-065cd7ba-20a5-48d4-8e56-86a472e976e1 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:40.020926 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-065cd7ba-20a5-48d4-8e56-86a472e976e1 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:40.021536 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-065cd7ba-20a5-48d4-8e56-86a472e976e1 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:40.022442 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-065cd7ba-20a5-48d4-8e56-86a472e976e1 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:40.023051 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-065cd7ba-20a5-48d4-8e56-86a472e976e1 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:40.023824 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-065cd7ba-20a5-48d4-8e56-86a472e976e1 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:40.831726 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-4f685f69-2415-470d-a2e7-8bafd2a848b8 tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] 10.222.0.43 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.479810 Oct 04 22:02:40.840498 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2000/4045] 10.222.0.43 () {60 vars in 1170 bytes} [Tue Oct 4 22:02:37 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3489 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:02:40.845395 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-53abff28-a928-4849-9b72-ed22edc167a0 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:02:40.846021 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-53abff28-a928-4849-9b72-ed22edc167a0 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: f9376877-b87d-4738-b940-2bf314c83337] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:02:40.858556 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-53abff28-a928-4849-9b72-ed22edc167a0 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:40.859064 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-53abff28-a928-4849-9b72-ed22edc167a0 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:40.859511 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-53abff28-a928-4849-9b72-ed22edc167a0 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:40.860231 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-53abff28-a928-4849-9b72-ed22edc167a0 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:40.872698 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-53abff28-a928-4849-9b72-ed22edc167a0 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:40.873165 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-53abff28-a928-4849-9b72-ed22edc167a0 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:41.057405 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-53abff28-a928-4849-9b72-ed22edc167a0 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a1c8d841104bc9b6910bcc2c0e2bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe9283584fc4d90b0715216d867ea2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:02:41.078559 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-53abff28-a928-4849-9b72-ed22edc167a0 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "GET /compute/v2.1/servers/f9376877-b87d-4738-b940-2bf314c83337" status: 200 len: 1346 microversion: 2.1 time: 0.230416 Oct 04 22:02:41.095845 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2001/4046] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:02:40 2022] GET /compute/v2.1/servers/f9376877-b87d-4738-b940-2bf314c83337 => generated 1346 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:02:41.111698 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-065cd7ba-20a5-48d4-8e56-86a472e976e1 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2034fc9060874868bc5d27370a1c351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89499d833a4a00805164f4f79ed522', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:02:41.112932 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-0987d93c-8531-4e2c-9957-4065e6c94d05 tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.1.118"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:02:41.115530 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-0987d93c-8531-4e2c-9957-4065e6c94d05 tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] [instance: 49298a04-d3ab-4bb1-b8ed-ca7db4e028f3] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:02:41.138742 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-065cd7ba-20a5-48d4-8e56-86a472e976e1 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] 10.222.0.43 "GET /compute/v2.1/servers/19a673aa-44db-47a4-8642-5bc88f96b86b" status: 200 len: 1514 microversion: 2.1 time: 1.137949 Oct 04 22:02:41.140000 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2046/4047] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:02:39 2022] GET /compute/v2.1/servers/19a673aa-44db-47a4-8642-5bc88f96b86b => generated 1514 bytes in 1140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:02:41.145698 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0987d93c-8531-4e2c-9957-4065e6c94d05 tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:41.145698 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0987d93c-8531-4e2c-9957-4065e6c94d05 tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:41.145698 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0987d93c-8531-4e2c-9957-4065e6c94d05 tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:41.145698 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0987d93c-8531-4e2c-9957-4065e6c94d05 tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:41.146046 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0987d93c-8531-4e2c-9957-4065e6c94d05 tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:41.146459 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0987d93c-8531-4e2c-9957-4065e6c94d05 tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:41.235038 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0987d93c-8531-4e2c-9957-4065e6c94d05 tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Acquiring lock "refresh_cache-49298a04-d3ab-4bb1-b8ed-ca7db4e028f3" {{(pid=134101) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 04 22:02:41.235450 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0987d93c-8531-4e2c-9957-4065e6c94d05 tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Acquired lock "refresh_cache-49298a04-d3ab-4bb1-b8ed-ca7db4e028f3" {{(pid=134101) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 04 22:02:41.708309 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-9912fe94-b2e4-4655-a9d5-0b9346032cab req-7b2e23c4-71c8-4c63-8745-6cd754935ccc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19a673aa-44db-47a4-8642-5bc88f96b86b", "name": "network-vif-deleted", "tag": "eaa121f9-c4cc-46aa-8ab0-8bccbe96fc5d"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:02:41.755709 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-9912fe94-b2e4-4655-a9d5-0b9346032cab req-7b2e23c4-71c8-4c63-8745-6cd754935ccc service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:41.758496 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-9912fe94-b2e4-4655-a9d5-0b9346032cab req-7b2e23c4-71c8-4c63-8745-6cd754935ccc service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:41.761687 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-9912fe94-b2e4-4655-a9d5-0b9346032cab req-7b2e23c4-71c8-4c63-8745-6cd754935ccc service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:41.813507 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-9912fe94-b2e4-4655-a9d5-0b9346032cab req-7b2e23c4-71c8-4c63-8745-6cd754935ccc service nova] Creating event network-vif-deleted:eaa121f9-c4cc-46aa-8ab0-8bccbe96fc5d for instance 19a673aa-44db-47a4-8642-5bc88f96b86b on n-h1-860284-1 Oct 04 22:02:41.835281 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-9912fe94-b2e4-4655-a9d5-0b9346032cab req-7b2e23c4-71c8-4c63-8745-6cd754935ccc service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128945 Oct 04 22:02:41.840352 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2047/4048] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:02:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:02:42.115176 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-5852707b-cc74-4246-8880-f03731cf0837 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:02:42.116825 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-5852707b-cc74-4246-8880-f03731cf0837 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: f9376877-b87d-4738-b940-2bf314c83337] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:02:42.144327 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5852707b-cc74-4246-8880-f03731cf0837 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:42.145901 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5852707b-cc74-4246-8880-f03731cf0837 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:42.150070 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5852707b-cc74-4246-8880-f03731cf0837 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:42.151317 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5852707b-cc74-4246-8880-f03731cf0837 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:42.152694 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5852707b-cc74-4246-8880-f03731cf0837 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:42.154686 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5852707b-cc74-4246-8880-f03731cf0837 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:42.238126 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5852707b-cc74-4246-8880-f03731cf0837 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:42.238648 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5852707b-cc74-4246-8880-f03731cf0837 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:42.239382 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5852707b-cc74-4246-8880-f03731cf0837 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:42.240076 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.objects.instance [None req-5852707b-cc74-4246-8880-f03731cf0837 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lazy-loading 'fault' on Instance uuid f9376877-b87d-4738-b940-2bf314c83337 {{(pid=134102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 22:02:42.459550 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-5852707b-cc74-4246-8880-f03731cf0837 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a1c8d841104bc9b6910bcc2c0e2bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe9283584fc4d90b0715216d867ea2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:02:42.472407 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-5852707b-cc74-4246-8880-f03731cf0837 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "GET /compute/v2.1/servers/f9376877-b87d-4738-b940-2bf314c83337" status: 200 len: 1351 microversion: 2.1 time: 0.362978 Oct 04 22:02:42.478258 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2048/4049] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:02:42 2022] GET /compute/v2.1/servers/f9376877-b87d-4738-b940-2bf314c83337 => generated 1351 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:02:42.489641 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-3162e5f9-04e3-4c11-989e-41a3b0ca5c94 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:02:42.491023 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-3162e5f9-04e3-4c11-989e-41a3b0ca5c94 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] [instance: 19a673aa-44db-47a4-8642-5bc88f96b86b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:02:42.505743 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3162e5f9-04e3-4c11-989e-41a3b0ca5c94 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:42.512668 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3162e5f9-04e3-4c11-989e-41a3b0ca5c94 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:42.512668 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3162e5f9-04e3-4c11-989e-41a3b0ca5c94 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:42.512668 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3162e5f9-04e3-4c11-989e-41a3b0ca5c94 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:42.512668 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3162e5f9-04e3-4c11-989e-41a3b0ca5c94 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:42.512668 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3162e5f9-04e3-4c11-989e-41a3b0ca5c94 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:42.520472 n-d-860284-1 devstack@n-api.service[134101]: DEBUG neutronclient.v2_0.client [None req-0987d93c-8531-4e2c-9957-4065e6c94d05 tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.25.1.118 (b63c82fc-41af-4cdb-8f6e-3f1896102add) with port 4db0b86a-68bb-4021-8879-799b566c6728 using fixed IP 172.20.0.3, as that fixed IP already has a floating IP on external network 24746097-fcdf-4b45-9e46-271eb6b454d7.", "detail": ""}} {{(pid=134101) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 22:02:42.521078 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0987d93c-8531-4e2c-9957-4065e6c94d05 tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Releasing lock "refresh_cache-49298a04-d3ab-4bb1-b8ed-ca7db4e028f3" {{(pid=134101) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 04 22:02:42.521633 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-0987d93c-8531-4e2c-9957-4065e6c94d05 tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] HTTP exception thrown: Cannot associate floating IP 172.25.1.118 (b63c82fc-41af-4cdb-8f6e-3f1896102add) with port 4db0b86a-68bb-4021-8879-799b566c6728 using fixed IP 172.20.0.3, as that fixed IP already has a floating IP on external network 24746097-fcdf-4b45-9e46-271eb6b454d7. Oct 04 22:02:42.521633 n-d-860284-1 devstack@n-api.service[134101]: Neutron server returns request_ids: ['req-710d5e36-1330-4437-9405-4b23efa1200b'] Oct 04 22:02:42.523733 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-0987d93c-8531-4e2c-9957-4065e6c94d05 tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Request method failure captured: Oct 04 22:02:42.523733 n-d-860284-1 devstack@n-api.service[134101]: request: POST /compute/v2.1/servers/49298a04-d3ab-4bb1-b8ed-ca7db4e028f3/action HTTP/1.1 Oct 04 22:02:42.523733 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 22:02:42.523733 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 22:02:42.523733 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 22:02:42.523733 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 46 Oct 04 22:02:42.523733 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 22:02:42.523733 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 22:02:42.523733 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 22:02:42.523733 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 22:02:42.523733 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPK1fn4pN4SRD03yYlNRfgQojvW4xOOtDRm4hbQGnNkCBseJuSDBWmCiY80kQRlH0QW_aaGxqmtKoHZTzbu68wwQoxUG1oxsNjeZ3eQqh_3Mjso0ggVp4fT1MxaOeaaW0T9MRExWL6tLg89SP0zzgyW4ymGiY4ahLUviV7WwOEakUGzg Oct 04 22:02:42.523733 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 22:02:42.523733 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 22:02:42.523733 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 22:02:42.523733 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 22:02:42.523733 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 22:02:42.523733 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 22:02:42.523733 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: bad5849b558042d1a5288e8a4443fb53 Oct 04 22:02:42.523733 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-157857634 Oct 04 22:02:42.523733 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 22:02:42.523733 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 22:02:42.523733 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/bad5849b558042d1a5288e8a4443fb53"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_bad5849b558042d1a5288e8a4443fb53", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/bad5849b558042d1a5288e8a4443fb53"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/bad5849b558042d1a5288e8a4443fb53"}]}] Oct 04 22:02:42.523733 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-157857634 Oct 04 22:02:42.523733 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: bad5849b558042d1a5288e8a4443fb53 Oct 04 22:02:42.523733 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-157857634 Oct 04 22:02:42.523733 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project Oct 04 22:02:42.523733 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 22:02:42.523733 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 22:02:42.523733 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 1f50bbed6deb45e1a2d081745777596c Oct 04 22:02:42.523733 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project Oct 04 22:02:42.523733 n-d-860284-1 devstack@n-api.service[134101]: Oct 04 22:02:42.523733 n-d-860284-1 devstack@n-api.service[134101]: {"addFloatingIp": {"address": "172.25.1.118"}} Oct 04 22:02:42.523733 n-d-860284-1 devstack@n-api.service[134101]: method: Oct 04 22:02:42.523733 n-d-860284-1 devstack@n-api.service[134101]: exception: Cannot associate floating IP 172.25.1.118 (b63c82fc-41af-4cdb-8f6e-3f1896102add) with port 4db0b86a-68bb-4021-8879-799b566c6728 using fixed IP 172.20.0.3, as that fixed IP already has a floating IP on external network 24746097-fcdf-4b45-9e46-271eb6b454d7. Oct 04 22:02:42.523733 n-d-860284-1 devstack@n-api.service[134101]: Neutron server returns request_ids: ['req-710d5e36-1330-4437-9405-4b23efa1200b'] Oct 04 22:02:42.523733 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': '49298a04-d3ab-4bb1-b8ed-ca7db4e028f3', 'body': {'addFloatingIp': {'address': '172.25.1.118'}}} Oct 04 22:02:42.523733 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:02:42.523733 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:02:42.523733 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2703, in associate_floating_ip Oct 04 22:02:42.523733 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi client.update_floatingip(fip['id'], {'floatingip': param}) Oct 04 22:02:42.523733 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 22:02:42.523733 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 22:02:42.523733 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1016, in update_floatingip Oct 04 22:02:42.523733 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return self._update_resource(self.floatingip_path % (floatingip), Oct 04 22:02:42.523733 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 22:02:42.523733 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 22:02:42.523733 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 2548, in _update_resource Oct 04 22:02:42.523733 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return self.put(path, **kwargs) Oct 04 22:02:42.523733 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 22:02:42.523733 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 22:02:42.523733 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 365, in put Oct 04 22:02:42.523733 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return self.retry_request("PUT", action, body=body, Oct 04 22:02:42.523733 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 22:02:42.523733 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 22:02:42.523733 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 22:02:42.523733 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 22:02:42.523733 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 22:02:42.523733 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 22:02:42.523733 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 22:02:42.523733 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 22:02:42.527794 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 22:02:42.527794 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 22:02:42.527794 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 22:02:42.527794 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 22:02:42.527794 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 22:02:42.527794 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 22:02:42.527794 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Cannot associate floating IP 172.25.1.118 (b63c82fc-41af-4cdb-8f6e-3f1896102add) with port 4db0b86a-68bb-4021-8879-799b566c6728 using fixed IP 172.20.0.3, as that fixed IP already has a floating IP on external network 24746097-fcdf-4b45-9e46-271eb6b454d7. Oct 04 22:02:42.527794 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-710d5e36-1330-4437-9405-4b23efa1200b'] Oct 04 22:02:42.527794 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:02:42.527794 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:02:42.527794 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:02:42.527794 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:02:42.527794 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Oct 04 22:02:42.527794 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Oct 04 22:02:42.527794 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Oct 04 22:02:42.527794 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Oct 04 22:02:42.527794 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2705, in associate_floating_ip Oct 04 22:02:42.527794 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpAssociateFailed(str(e)) Oct 04 22:02:42.527794 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpAssociateFailed: Cannot associate floating IP 172.25.1.118 (b63c82fc-41af-4cdb-8f6e-3f1896102add) with port 4db0b86a-68bb-4021-8879-799b566c6728 using fixed IP 172.20.0.3, as that fixed IP already has a floating IP on external network 24746097-fcdf-4b45-9e46-271eb6b454d7. Oct 04 22:02:42.527794 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-710d5e36-1330-4437-9405-4b23efa1200b'] Oct 04 22:02:42.527794 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:02:42.527794 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:02:42.527794 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:02:42.527794 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:02:42.527794 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:02:42.527794 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:02:42.527794 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:02:42.527794 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:02:42.527794 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 22:02:42.527794 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 22:02:42.527794 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:02:42.527794 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:02:42.527794 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 22:02:42.527794 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 22:02:42.527794 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 246, in _add_floating_ip Oct 04 22:02:42.527794 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=e.format_message()) Oct 04 22:02:42.527794 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Cannot associate floating IP 172.25.1.118 (b63c82fc-41af-4cdb-8f6e-3f1896102add) with port 4db0b86a-68bb-4021-8879-799b566c6728 using fixed IP 172.20.0.3, as that fixed IP already has a floating IP on external network 24746097-fcdf-4b45-9e46-271eb6b454d7. Oct 04 22:02:42.527794 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-710d5e36-1330-4437-9405-4b23efa1200b'] Oct 04 22:02:42.527794 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:02:42.527794 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:02:42.527794 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:02:42.527794 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:02:42.527794 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:02:42.527794 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:02:42.527794 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:02:42.527794 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:02:42.527794 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot associate floating IP 172.25.1.118 (b63c82fc-41af-4cdb-8f6e-3f1896102add) with port 4db0b86a-68bb-4021-8879-799b566c6728 using fixed IP 172.20.0.3, as that fixed IP already has a floating IP on external network 24746097-fcdf-4b45-9e46-271eb6b454d7. Oct 04 22:02:42.527794 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-710d5e36-1330-4437-9405-4b23efa1200b'] Oct 04 22:02:42.527794 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:02:42.531190 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-0987d93c-8531-4e2c-9957-4065e6c94d05 tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Returning 400 to user: Cannot associate floating IP 172.25.1.118 (b63c82fc-41af-4cdb-8f6e-3f1896102add) with port 4db0b86a-68bb-4021-8879-799b566c6728 using fixed IP 172.20.0.3, as that fixed IP already has a floating IP on external network 24746097-fcdf-4b45-9e46-271eb6b454d7. Oct 04 22:02:42.531190 n-d-860284-1 devstack@n-api.service[134101]: Neutron server returns request_ids: ['req-710d5e36-1330-4437-9405-4b23efa1200b'] {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:02:42.531190 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-0987d93c-8531-4e2c-9957-4065e6c94d05 tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] 10.222.0.43 "POST /compute/v2.1/servers/49298a04-d3ab-4bb1-b8ed-ca7db4e028f3/action" status: 400 len: 381 microversion: 2.1 time: 1.428697 Oct 04 22:02:42.531190 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2002/4050] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 22:02:41 2022] POST /compute/v2.1/servers/49298a04-d3ab-4bb1-b8ed-ca7db4e028f3/action => generated 381 bytes in 1430 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 22:02:42.535663 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-b3eb9609-a308-4649-9991-431a859c0e37 tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Calling method '.version_select at 0x7fbb2e15b4c0>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:02:42.599280 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3162e5f9-04e3-4c11-989e-41a3b0ca5c94 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:42.601481 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3162e5f9-04e3-4c11-989e-41a3b0ca5c94 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:42.602097 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3162e5f9-04e3-4c11-989e-41a3b0ca5c94 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:42.604863 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.objects.instance [None req-3162e5f9-04e3-4c11-989e-41a3b0ca5c94 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lazy-loading 'fault' on Instance uuid 19a673aa-44db-47a4-8642-5bc88f96b86b {{(pid=134102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 22:02:42.808819 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-3162e5f9-04e3-4c11-989e-41a3b0ca5c94 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2034fc9060874868bc5d27370a1c351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89499d833a4a00805164f4f79ed522', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:02:42.841824 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-3162e5f9-04e3-4c11-989e-41a3b0ca5c94 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] 10.222.0.43 "GET /compute/v2.1/servers/19a673aa-44db-47a4-8642-5bc88f96b86b" status: 200 len: 1308 microversion: 2.1 time: 0.355547 Oct 04 22:02:42.854390 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2049/4051] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:02:42 2022] GET /compute/v2.1/servers/19a673aa-44db-47a4-8642-5bc88f96b86b => generated 1308 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:02:43.179323 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-b7c5478c-803f-4d3c-ad69-f339563514bb tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-912150275", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f42d911e-d0db-47f1-8152-1d0e2f63f805"}], "security_groups": [{"name": "tempest-securitygroup--604264825"}], "key_name": "tempest-keypair-2000945182", "user_data": "}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:02:43.392727 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.network.neutron [None req-b7c5478c-803f-4d3c-ad69-f339563514bb tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] validate_networks() for [('f42d911e-d0db-47f1-8152-1d0e2f63f805', None, None, None, None, None)] {{(pid=134102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 22:02:44.272216 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-b3eb9609-a308-4649-9991-431a859c0e37 tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] 10.222.0.43 "DELETE /compute/v2.1/os-floating-ips/b63c82fc-41af-4cdb-8f6e-3f1896102add" status: 202 len: 0 microversion: 2.1 time: 1.740809 Oct 04 22:02:44.273582 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2003/4052] 10.222.0.43 () {58 vars in 1263 bytes} [Tue Oct 4 22:02:42 2022] DELETE /compute/v2.1/os-floating-ips/b63c82fc-41af-4cdb-8f6e-3f1896102add => generated 0 bytes in 1743 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 22:02:44.281441 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-b7957b7f-59c1-417d-8c57-7e828a217f20 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:02:44.283764 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-b7957b7f-59c1-417d-8c57-7e828a217f20 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: f9376877-b87d-4738-b940-2bf314c83337] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:02:44.301259 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b7957b7f-59c1-417d-8c57-7e828a217f20 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:44.301929 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b7957b7f-59c1-417d-8c57-7e828a217f20 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:44.302724 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b7957b7f-59c1-417d-8c57-7e828a217f20 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:44.303831 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b7957b7f-59c1-417d-8c57-7e828a217f20 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:44.304468 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b7957b7f-59c1-417d-8c57-7e828a217f20 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:44.310707 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b7957b7f-59c1-417d-8c57-7e828a217f20 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:44.317015 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-b7c5478c-803f-4d3c-ad69-f339563514bb tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Flavor limits 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 22:02:44.318639 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-b7c5478c-803f-4d3c-ad69-f339563514bb tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Image limits 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 22:02:44.319284 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-b7c5478c-803f-4d3c-ad69-f339563514bb tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Flavor pref 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 22:02:44.320620 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-b7c5478c-803f-4d3c-ad69-f339563514bb tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Image pref 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 22:02:44.321054 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-b7c5478c-803f-4d3c-ad69-f339563514bb tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 22:02:44.333484 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-b7957b7f-59c1-417d-8c57-7e828a217f20 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] HTTP exception thrown: Instance f9376877-b87d-4738-b940-2bf314c83337 could not be found. Oct 04 22:02:44.335755 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-b7957b7f-59c1-417d-8c57-7e828a217f20 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Request method failure captured: Oct 04 22:02:44.335755 n-d-860284-1 devstack@n-api.service[134101]: request: GET /compute/v2.1/servers/f9376877-b87d-4738-b940-2bf314c83337 HTTP/1.1 Oct 04 22:02:44.335755 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 22:02:44.335755 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 22:02:44.335755 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 22:02:44.335755 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 22:02:44.335755 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 22:02:44.335755 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 22:02:44.335755 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 22:02:44.335755 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 22:02:44.335755 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPK0nBLOASIAc_jQKg5RCRqB87oRsJiRc3l4etfmNkfSSv1yHGR8RjgOAS-Q4KEeiZVVxJRa8Focu7VoHdbhzgEqV5pocnY2xPPRPWacaT4koizORav87v6vdxgR4HH-PmsbraTS232Q30lW73kM7RH3tINWZChDkcbwtTWeQlIO6TSk Oct 04 22:02:44.335755 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 22:02:44.335755 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 22:02:44.335755 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 22:02:44.335755 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 22:02:44.335755 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 22:02:44.335755 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 22:02:44.335755 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: dfe9283584fc4d90b0715216d867ea2f Oct 04 22:02:44.335755 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-DeleteServersTestJSON-2136146778 Oct 04 22:02:44.335755 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 22:02:44.335755 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 22:02:44.335755 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/dfe9283584fc4d90b0715216d867ea2f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_dfe9283584fc4d90b0715216d867ea2f", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/dfe9283584fc4d90b0715216d867ea2f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/dfe9283584fc4d90b0715216d867ea2f"}]}] Oct 04 22:02:44.335755 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-DeleteServersTestJSON-2136146778 Oct 04 22:02:44.335755 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: dfe9283584fc4d90b0715216d867ea2f Oct 04 22:02:44.335755 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-DeleteServersTestJSON-2136146778 Oct 04 22:02:44.335755 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-DeleteServersTestJSON-2136146778-project Oct 04 22:02:44.335755 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 22:02:44.335755 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 22:02:44.335755 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 41a1c8d841104bc9b6910bcc2c0e2bb1 Oct 04 22:02:44.335755 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-DeleteServersTestJSON-2136146778-project Oct 04 22:02:44.335755 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 22:02:44.335755 n-d-860284-1 devstack@n-api.service[134101]: exception: Instance f9376877-b87d-4738-b940-2bf314c83337 could not be found. Oct 04 22:02:44.335755 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': 'f9376877-b87d-4738-b940-2bf314c83337'} Oct 04 22:02:44.335755 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:02:44.335755 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:02:44.335755 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:02:44.335755 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:02:44.335755 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:02:44.335755 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:02:44.335755 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:02:44.335755 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:02:44.335755 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:02:44.335755 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:02:44.335755 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9376877-b87d-4738-b940-2bf314c83337 could not be found. Oct 04 22:02:44.335755 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:02:44.335755 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:02:44.335755 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:02:44.335755 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:02:44.335755 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:02:44.335755 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:02:44.335755 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:02:44.335755 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:02:44.335755 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:02:44.335755 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:02:44.335755 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:02:44.335755 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:02:44.335755 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:02:44.335755 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:02:44.335755 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:02:44.335755 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:02:44.335755 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9376877-b87d-4738-b940-2bf314c83337 could not be found. Oct 04 22:02:44.335755 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:02:44.335755 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:02:44.335755 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:02:44.340852 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:02:44.340852 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:02:44.340852 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:02:44.340852 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:02:44.340852 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:02:44.340852 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9376877-b87d-4738-b940-2bf314c83337 could not be found. Oct 04 22:02:44.340852 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:02:44.343500 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-b7957b7f-59c1-417d-8c57-7e828a217f20 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Returning 404 to user: Instance f9376877-b87d-4738-b940-2bf314c83337 could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:02:44.345274 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b7c5478c-803f-4d3c-ad69-f339563514bb tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:44.345856 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-b7957b7f-59c1-417d-8c57-7e828a217f20 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "GET /compute/v2.1/servers/f9376877-b87d-4738-b940-2bf314c83337" status: 404 len: 111 microversion: 2.1 time: 0.068634 Oct 04 22:02:44.346352 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b7c5478c-803f-4d3c-ad69-f339563514bb tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:44.346961 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b7c5478c-803f-4d3c-ad69-f339563514bb tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:44.350433 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b7c5478c-803f-4d3c-ad69-f339563514bb tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:44.350433 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b7c5478c-803f-4d3c-ad69-f339563514bb tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:44.350433 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b7c5478c-803f-4d3c-ad69-f339563514bb tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:44.364653 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2004/4053] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:02:44 2022] GET /compute/v2.1/servers/f9376877-b87d-4738-b940-2bf314c83337 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:02:44.378184 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-295f0f0d-8e65-47ff-8fad-885c06e7bc3d tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:02:44.381449 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-295f0f0d-8e65-47ff-8fad-885c06e7bc3d tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] [instance: 19a673aa-44db-47a4-8642-5bc88f96b86b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:02:44.397099 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-295f0f0d-8e65-47ff-8fad-885c06e7bc3d tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:44.397779 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-295f0f0d-8e65-47ff-8fad-885c06e7bc3d tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:44.400787 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-295f0f0d-8e65-47ff-8fad-885c06e7bc3d tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:44.403320 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-295f0f0d-8e65-47ff-8fad-885c06e7bc3d tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:44.404022 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-295f0f0d-8e65-47ff-8fad-885c06e7bc3d tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:44.404618 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-295f0f0d-8e65-47ff-8fad-885c06e7bc3d tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:44.409894 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-b7c5478c-803f-4d3c-ad69-f339563514bb tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Getting quotas for project 82e1a29234ce40f9b37d0eca196cd1db. Resources: {'instances', 'ram', 'cores'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:02:44.422268 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-b7c5478c-803f-4d3c-ad69-f339563514bb tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Getting quotas for user 80fc56886fef422b9b52eb1dede7d10e and project 82e1a29234ce40f9b37d0eca196cd1db. Resources: {'instances', 'ram', 'cores'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:02:44.441536 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-295f0f0d-8e65-47ff-8fad-885c06e7bc3d tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] HTTP exception thrown: Instance 19a673aa-44db-47a4-8642-5bc88f96b86b could not be found. Oct 04 22:02:44.445486 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-295f0f0d-8e65-47ff-8fad-885c06e7bc3d tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Request method failure captured: Oct 04 22:02:44.445486 n-d-860284-1 devstack@n-api.service[134101]: request: GET /compute/v2.1/servers/19a673aa-44db-47a4-8642-5bc88f96b86b HTTP/1.1 Oct 04 22:02:44.445486 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 22:02:44.445486 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 22:02:44.445486 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 22:02:44.445486 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 22:02:44.445486 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 22:02:44.445486 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 22:02:44.445486 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 22:02:44.445486 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 22:02:44.445486 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPKzWheXfA-r0jMUCvCghTgqnEmmWico8QUomTvFWaOpHkFO0MYasCzDh5tHyxvd1ySLZdxwZqWitt8n5eyLrJ-OTBSTZVvVmEcLl1yZjg-ZBwvbP9EdZOwIK3W8AFbjns6cyuN88a7oOE1cMCeXFngQ9_fhd4lGPPICwpOiKdTKmOvs Oct 04 22:02:44.445486 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 22:02:44.445486 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 22:02:44.445486 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 22:02:44.445486 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 22:02:44.445486 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 22:02:44.445486 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 22:02:44.445486 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: aa89499d833a4a00805164f4f79ed522 Oct 04 22:02:44.445486 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-ServerDiskConfigTestJSON-2134643881 Oct 04 22:02:44.445486 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 22:02:44.445486 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 22:02:44.445486 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/aa89499d833a4a00805164f4f79ed522"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_aa89499d833a4a00805164f4f79ed522", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/aa89499d833a4a00805164f4f79ed522"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/aa89499d833a4a00805164f4f79ed522"}]}] Oct 04 22:02:44.445486 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-ServerDiskConfigTestJSON-2134643881 Oct 04 22:02:44.445486 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: aa89499d833a4a00805164f4f79ed522 Oct 04 22:02:44.445486 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-2134643881 Oct 04 22:02:44.445486 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-ServerDiskConfigTestJSON-2134643881-project Oct 04 22:02:44.445486 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 22:02:44.445486 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 22:02:44.445486 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 2034fc9060874868bc5d27370a1c351c Oct 04 22:02:44.445486 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-ServerDiskConfigTestJSON-2134643881-project Oct 04 22:02:44.445486 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 22:02:44.445486 n-d-860284-1 devstack@n-api.service[134101]: exception: Instance 19a673aa-44db-47a4-8642-5bc88f96b86b could not be found. Oct 04 22:02:44.445486 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': '19a673aa-44db-47a4-8642-5bc88f96b86b'} Oct 04 22:02:44.445486 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:02:44.445486 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:02:44.445486 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:02:44.445486 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:02:44.445486 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:02:44.445486 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:02:44.445486 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:02:44.445486 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:02:44.445486 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:02:44.445486 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:02:44.445486 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19a673aa-44db-47a4-8642-5bc88f96b86b could not be found. Oct 04 22:02:44.445486 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:02:44.445486 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:02:44.445486 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:02:44.445486 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:02:44.445486 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:02:44.445486 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:02:44.445486 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:02:44.445486 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:02:44.445486 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:02:44.445486 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:02:44.445486 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:02:44.445486 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:02:44.445486 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:02:44.445486 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:02:44.445486 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:02:44.445486 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:02:44.445486 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19a673aa-44db-47a4-8642-5bc88f96b86b could not be found. Oct 04 22:02:44.445486 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:02:44.445486 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:02:44.445486 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:02:44.450043 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:02:44.450043 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:02:44.450043 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:02:44.450043 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:02:44.450043 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:02:44.450043 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19a673aa-44db-47a4-8642-5bc88f96b86b could not be found. Oct 04 22:02:44.450043 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:02:44.451776 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-295f0f0d-8e65-47ff-8fad-885c06e7bc3d tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Returning 404 to user: Instance 19a673aa-44db-47a4-8642-5bc88f96b86b could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:02:44.458040 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-295f0f0d-8e65-47ff-8fad-885c06e7bc3d tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] 10.222.0.43 "GET /compute/v2.1/servers/19a673aa-44db-47a4-8642-5bc88f96b86b" status: 404 len: 111 microversion: 2.1 time: 0.092099 Oct 04 22:02:44.478574 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2005/4054] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:02:44 2022] GET /compute/v2.1/servers/19a673aa-44db-47a4-8642-5bc88f96b86b => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:02:44.487327 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-b7c5478c-803f-4d3c-ad69-f339563514bb tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Going to run 1 instances... {{(pid=134102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 22:02:44.495509 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-b7c5478c-803f-4d3c-ad69-f339563514bb tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] [instance: 1475392a-475f-414f-803c-e89c9ae1844a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='58548514-5dac-426c-81f5-19e3fba33e23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 22:02:44.499875 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-bdd3e1db-360d-4b37-b07a-76c84be1551c tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.1.94"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:02:44.607159 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-b7c5478c-803f-4d3c-ad69-f339563514bb tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.433815 Oct 04 22:02:44.608421 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2050/4055] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 22:02:43 2022] POST /compute/v2.1/servers => generated 401 bytes in 1437 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 22:02:44.613428 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-13e7a134-12ab-4fd7-baa8-a6757a72463e tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:02:44.614335 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-13e7a134-12ab-4fd7-baa8-a6757a72463e tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] [instance: 3dbe541d-234a-4049-befd-dcd9a67dbd46] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:02:44.624392 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-13e7a134-12ab-4fd7-baa8-a6757a72463e tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:44.625167 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-13e7a134-12ab-4fd7-baa8-a6757a72463e tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:44.625847 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-13e7a134-12ab-4fd7-baa8-a6757a72463e tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:44.627063 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-13e7a134-12ab-4fd7-baa8-a6757a72463e tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:44.627806 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-13e7a134-12ab-4fd7-baa8-a6757a72463e tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:44.628388 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-13e7a134-12ab-4fd7-baa8-a6757a72463e tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:44.649013 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-13e7a134-12ab-4fd7-baa8-a6757a72463e tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] HTTP exception thrown: Instance 3dbe541d-234a-4049-befd-dcd9a67dbd46 could not be found. Oct 04 22:02:44.652618 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-13e7a134-12ab-4fd7-baa8-a6757a72463e tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Request method failure captured: Oct 04 22:02:44.652618 n-d-860284-1 devstack@n-api.service[134102]: request: DELETE /compute/v2.1/servers/3dbe541d-234a-4049-befd-dcd9a67dbd46 HTTP/1.1 Oct 04 22:02:44.652618 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 22:02:44.652618 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 22:02:44.652618 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 22:02:44.652618 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 22:02:44.652618 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 22:02:44.652618 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 22:02:44.652618 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 22:02:44.652618 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 22:02:44.652618 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPKzWheXfA-r0jMUCvCghTgqnEmmWico8QUomTvFWaOpHkFO0MYasCzDh5tHyxvd1ySLZdxwZqWitt8n5eyLrJ-OTBSTZVvVmEcLl1yZjg-ZBwvbP9EdZOwIK3W8AFbjns6cyuN88a7oOE1cMCeXFngQ9_fhd4lGPPICwpOiKdTKmOvs Oct 04 22:02:44.652618 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 22:02:44.652618 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 22:02:44.652618 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 22:02:44.652618 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 22:02:44.652618 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 22:02:44.652618 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 22:02:44.652618 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: aa89499d833a4a00805164f4f79ed522 Oct 04 22:02:44.652618 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-ServerDiskConfigTestJSON-2134643881 Oct 04 22:02:44.652618 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 22:02:44.652618 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 22:02:44.652618 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/aa89499d833a4a00805164f4f79ed522"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_aa89499d833a4a00805164f4f79ed522", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/aa89499d833a4a00805164f4f79ed522"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/aa89499d833a4a00805164f4f79ed522"}]}] Oct 04 22:02:44.652618 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-ServerDiskConfigTestJSON-2134643881 Oct 04 22:02:44.652618 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: aa89499d833a4a00805164f4f79ed522 Oct 04 22:02:44.652618 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-2134643881 Oct 04 22:02:44.652618 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-ServerDiskConfigTestJSON-2134643881-project Oct 04 22:02:44.652618 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 22:02:44.652618 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 22:02:44.652618 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: 2034fc9060874868bc5d27370a1c351c Oct 04 22:02:44.652618 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-ServerDiskConfigTestJSON-2134643881-project Oct 04 22:02:44.652618 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 22:02:44.652618 n-d-860284-1 devstack@n-api.service[134102]: exception: Instance 3dbe541d-234a-4049-befd-dcd9a67dbd46 could not be found. Oct 04 22:02:44.652618 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': '3dbe541d-234a-4049-befd-dcd9a67dbd46'} Oct 04 22:02:44.652618 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:02:44.652618 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:02:44.652618 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:02:44.652618 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:02:44.652618 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:02:44.652618 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:02:44.652618 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:02:44.652618 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:02:44.652618 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:02:44.652618 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:02:44.652618 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3dbe541d-234a-4049-befd-dcd9a67dbd46 could not be found. Oct 04 22:02:44.652618 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:02:44.652618 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:02:44.652618 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:02:44.652618 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:02:44.652618 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:02:44.652618 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:02:44.652618 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:02:44.652618 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:02:44.652618 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:02:44.652618 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:02:44.652618 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 22:02:44.652618 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 22:02:44.652618 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 22:02:44.652618 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 22:02:44.652618 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:02:44.652618 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:02:44.652618 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:02:44.652618 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:02:44.656741 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3dbe541d-234a-4049-befd-dcd9a67dbd46 could not be found. Oct 04 22:02:44.656741 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:02:44.656741 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:02:44.656741 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:02:44.656741 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:02:44.656741 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:02:44.656741 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:02:44.656741 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:02:44.656741 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:02:44.656741 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3dbe541d-234a-4049-befd-dcd9a67dbd46 could not be found. Oct 04 22:02:44.656741 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:02:44.658260 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-13e7a134-12ab-4fd7-baa8-a6757a72463e tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Returning 404 to user: Instance 3dbe541d-234a-4049-befd-dcd9a67dbd46 could not be found. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:02:44.659508 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-13e7a134-12ab-4fd7-baa8-a6757a72463e tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] 10.222.0.43 "DELETE /compute/v2.1/servers/3dbe541d-234a-4049-befd-dcd9a67dbd46" status: 404 len: 111 microversion: 2.1 time: 0.049952 Oct 04 22:02:44.660685 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2051/4056] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 22:02:44 2022] DELETE /compute/v2.1/servers/3dbe541d-234a-4049-befd-dcd9a67dbd46 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:02:44.667070 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-8845f665-287e-4b4d-9e4c-f6417103f0bd tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:02:44.670015 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-8845f665-287e-4b4d-9e4c-f6417103f0bd tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: f9376877-b87d-4738-b940-2bf314c83337] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:02:44.677026 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8845f665-287e-4b4d-9e4c-f6417103f0bd tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:44.677947 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8845f665-287e-4b4d-9e4c-f6417103f0bd tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:44.678628 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8845f665-287e-4b4d-9e4c-f6417103f0bd tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:44.679494 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8845f665-287e-4b4d-9e4c-f6417103f0bd tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:44.680101 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8845f665-287e-4b4d-9e4c-f6417103f0bd tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:44.681512 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8845f665-287e-4b4d-9e4c-f6417103f0bd tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:44.703069 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-8845f665-287e-4b4d-9e4c-f6417103f0bd tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] HTTP exception thrown: Instance f9376877-b87d-4738-b940-2bf314c83337 could not be found. Oct 04 22:02:44.704684 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-8845f665-287e-4b4d-9e4c-f6417103f0bd tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Request method failure captured: Oct 04 22:02:44.704684 n-d-860284-1 devstack@n-api.service[134102]: request: GET /compute/v2.1/servers/f9376877-b87d-4738-b940-2bf314c83337/os-volume_attachments HTTP/1.1 Oct 04 22:02:44.704684 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 22:02:44.704684 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 22:02:44.704684 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 22:02:44.704684 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 22:02:44.704684 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 22:02:44.704684 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 22:02:44.704684 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 22:02:44.704684 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 22:02:44.704684 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPK0nBLOASIAc_jQKg5RCRqB87oRsJiRc3l4etfmNkfSSv1yHGR8RjgOAS-Q4KEeiZVVxJRa8Focu7VoHdbhzgEqV5pocnY2xPPRPWacaT4koizORav87v6vdxgR4HH-PmsbraTS232Q30lW73kM7RH3tINWZChDkcbwtTWeQlIO6TSk Oct 04 22:02:44.704684 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 22:02:44.704684 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 22:02:44.704684 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 22:02:44.704684 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 22:02:44.704684 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 22:02:44.704684 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 22:02:44.704684 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: dfe9283584fc4d90b0715216d867ea2f Oct 04 22:02:44.704684 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-DeleteServersTestJSON-2136146778 Oct 04 22:02:44.704684 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 22:02:44.704684 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 22:02:44.704684 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/dfe9283584fc4d90b0715216d867ea2f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_dfe9283584fc4d90b0715216d867ea2f", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/dfe9283584fc4d90b0715216d867ea2f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/dfe9283584fc4d90b0715216d867ea2f"}]}] Oct 04 22:02:44.704684 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-DeleteServersTestJSON-2136146778 Oct 04 22:02:44.704684 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: dfe9283584fc4d90b0715216d867ea2f Oct 04 22:02:44.704684 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-DeleteServersTestJSON-2136146778 Oct 04 22:02:44.704684 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-DeleteServersTestJSON-2136146778-project Oct 04 22:02:44.704684 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 22:02:44.704684 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 22:02:44.704684 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: 41a1c8d841104bc9b6910bcc2c0e2bb1 Oct 04 22:02:44.704684 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-DeleteServersTestJSON-2136146778-project Oct 04 22:02:44.704684 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 22:02:44.704684 n-d-860284-1 devstack@n-api.service[134102]: exception: Instance f9376877-b87d-4738-b940-2bf314c83337 could not be found. Oct 04 22:02:44.704684 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'server_id': 'f9376877-b87d-4738-b940-2bf314c83337'} Oct 04 22:02:44.704684 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:02:44.704684 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:02:44.704684 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:02:44.704684 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:02:44.704684 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:02:44.704684 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:02:44.704684 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:02:44.704684 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:02:44.704684 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:02:44.704684 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:02:44.704684 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9376877-b87d-4738-b940-2bf314c83337 could not be found. Oct 04 22:02:44.704684 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:02:44.704684 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:02:44.704684 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:02:44.704684 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:02:44.704684 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:02:44.704684 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:02:44.704684 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:02:44.704684 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:02:44.704684 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:02:44.704684 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:02:44.704684 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 22:02:44.704684 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 22:02:44.704684 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 22:02:44.704684 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 22:02:44.704684 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 04 22:02:44.704684 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 04 22:02:44.704684 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:02:44.704684 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:02:44.712504 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9376877-b87d-4738-b940-2bf314c83337 could not be found. Oct 04 22:02:44.712504 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:02:44.712504 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:02:44.712504 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:02:44.712504 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:02:44.712504 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:02:44.712504 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:02:44.712504 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:02:44.712504 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:02:44.712504 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9376877-b87d-4738-b940-2bf314c83337 could not be found. Oct 04 22:02:44.712504 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:02:44.712504 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-8845f665-287e-4b4d-9e4c-f6417103f0bd tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Returning 404 to user: Instance f9376877-b87d-4738-b940-2bf314c83337 could not be found. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:02:44.712504 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-8845f665-287e-4b4d-9e4c-f6417103f0bd tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "GET /compute/v2.1/servers/f9376877-b87d-4738-b940-2bf314c83337/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.044248 Oct 04 22:02:44.717056 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2052/4057] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 22:02:44 2022] GET /compute/v2.1/servers/f9376877-b87d-4738-b940-2bf314c83337/os-volume_attachments => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:02:44.726214 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-035aeea1-9bcc-45ca-a31a-fa9a934edaf3 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:02:44.729773 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-035aeea1-9bcc-45ca-a31a-fa9a934edaf3 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] [instance: 1475392a-475f-414f-803c-e89c9ae1844a] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:02:44.752592 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-bdd3e1db-360d-4b37-b07a-76c84be1551c tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] [instance: 49298a04-d3ab-4bb1-b8ed-ca7db4e028f3] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:02:44.763618 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bdd3e1db-360d-4b37-b07a-76c84be1551c tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:44.764132 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bdd3e1db-360d-4b37-b07a-76c84be1551c tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:44.764580 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bdd3e1db-360d-4b37-b07a-76c84be1551c tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:44.766236 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bdd3e1db-360d-4b37-b07a-76c84be1551c tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:44.766916 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bdd3e1db-360d-4b37-b07a-76c84be1551c tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:44.767866 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bdd3e1db-360d-4b37-b07a-76c84be1551c tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:44.917776 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-035aeea1-9bcc-45ca-a31a-fa9a934edaf3 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80fc56886fef422b9b52eb1dede7d10e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82e1a29234ce40f9b37d0eca196cd1db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:02:44.934011 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-035aeea1-9bcc-45ca-a31a-fa9a934edaf3 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] 10.222.0.43 "GET /compute/v2.1/servers/1475392a-475f-414f-803c-e89c9ae1844a" status: 200 len: 1241 microversion: 2.1 time: 0.212355 Oct 04 22:02:44.934729 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2053/4058] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:02:44 2022] GET /compute/v2.1/servers/1475392a-475f-414f-803c-e89c9ae1844a => generated 1241 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:02:44.940196 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-ef41ce9a-4608-4976-b4a9-3a412dfa657e tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:02:44.940819 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-ef41ce9a-4608-4976-b4a9-3a412dfa657e tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] [instance: 3dbe541d-234a-4049-befd-dcd9a67dbd46] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:02:44.950205 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ef41ce9a-4608-4976-b4a9-3a412dfa657e tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:44.954792 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ef41ce9a-4608-4976-b4a9-3a412dfa657e tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:44.956512 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ef41ce9a-4608-4976-b4a9-3a412dfa657e tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:44.958256 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ef41ce9a-4608-4976-b4a9-3a412dfa657e tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:44.958771 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ef41ce9a-4608-4976-b4a9-3a412dfa657e tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:44.960131 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ef41ce9a-4608-4976-b4a9-3a412dfa657e tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:45.006895 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-ef41ce9a-4608-4976-b4a9-3a412dfa657e tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] HTTP exception thrown: Instance 3dbe541d-234a-4049-befd-dcd9a67dbd46 could not be found. Oct 04 22:02:45.011135 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-ef41ce9a-4608-4976-b4a9-3a412dfa657e tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Request method failure captured: Oct 04 22:02:45.011135 n-d-860284-1 devstack@n-api.service[134102]: request: GET /compute/v2.1/servers/3dbe541d-234a-4049-befd-dcd9a67dbd46 HTTP/1.1 Oct 04 22:02:45.011135 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 22:02:45.011135 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 22:02:45.011135 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 22:02:45.011135 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 22:02:45.011135 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 22:02:45.011135 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 22:02:45.011135 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 22:02:45.011135 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 22:02:45.011135 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPKzWheXfA-r0jMUCvCghTgqnEmmWico8QUomTvFWaOpHkFO0MYasCzDh5tHyxvd1ySLZdxwZqWitt8n5eyLrJ-OTBSTZVvVmEcLl1yZjg-ZBwvbP9EdZOwIK3W8AFbjns6cyuN88a7oOE1cMCeXFngQ9_fhd4lGPPICwpOiKdTKmOvs Oct 04 22:02:45.011135 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 22:02:45.011135 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 22:02:45.011135 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 22:02:45.011135 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 22:02:45.011135 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 22:02:45.011135 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 22:02:45.011135 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: aa89499d833a4a00805164f4f79ed522 Oct 04 22:02:45.011135 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-ServerDiskConfigTestJSON-2134643881 Oct 04 22:02:45.011135 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 22:02:45.011135 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 22:02:45.011135 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/aa89499d833a4a00805164f4f79ed522"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_aa89499d833a4a00805164f4f79ed522", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/aa89499d833a4a00805164f4f79ed522"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/aa89499d833a4a00805164f4f79ed522"}]}] Oct 04 22:02:45.011135 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-ServerDiskConfigTestJSON-2134643881 Oct 04 22:02:45.011135 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: aa89499d833a4a00805164f4f79ed522 Oct 04 22:02:45.011135 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-2134643881 Oct 04 22:02:45.011135 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-ServerDiskConfigTestJSON-2134643881-project Oct 04 22:02:45.011135 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 22:02:45.011135 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 22:02:45.011135 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: 2034fc9060874868bc5d27370a1c351c Oct 04 22:02:45.011135 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-ServerDiskConfigTestJSON-2134643881-project Oct 04 22:02:45.011135 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 22:02:45.011135 n-d-860284-1 devstack@n-api.service[134102]: exception: Instance 3dbe541d-234a-4049-befd-dcd9a67dbd46 could not be found. Oct 04 22:02:45.011135 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': '3dbe541d-234a-4049-befd-dcd9a67dbd46'} Oct 04 22:02:45.011135 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:02:45.011135 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:02:45.011135 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:02:45.011135 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:02:45.011135 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:02:45.011135 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:02:45.011135 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:02:45.011135 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:02:45.011135 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:02:45.011135 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:02:45.011135 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3dbe541d-234a-4049-befd-dcd9a67dbd46 could not be found. Oct 04 22:02:45.011135 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:02:45.011135 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:02:45.011135 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:02:45.011135 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:02:45.011135 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:02:45.011135 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:02:45.011135 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:02:45.011135 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:02:45.011135 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:02:45.011135 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:02:45.011135 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:02:45.011135 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:02:45.011135 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:02:45.011135 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:02:45.011135 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:02:45.011135 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:02:45.011135 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3dbe541d-234a-4049-befd-dcd9a67dbd46 could not be found. Oct 04 22:02:45.011135 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:02:45.011135 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:02:45.011135 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:02:45.014500 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:02:45.014500 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:02:45.014500 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:02:45.014500 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:02:45.014500 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:02:45.014500 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3dbe541d-234a-4049-befd-dcd9a67dbd46 could not be found. Oct 04 22:02:45.014500 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:02:45.017508 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-ef41ce9a-4608-4976-b4a9-3a412dfa657e tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Returning 404 to user: Instance 3dbe541d-234a-4049-befd-dcd9a67dbd46 could not be found. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:02:45.018747 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-ef41ce9a-4608-4976-b4a9-3a412dfa657e tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] 10.222.0.43 "GET /compute/v2.1/servers/3dbe541d-234a-4049-befd-dcd9a67dbd46" status: 404 len: 111 microversion: 2.1 time: 0.082945 Oct 04 22:02:45.020112 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2054/4059] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:02:44 2022] GET /compute/v2.1/servers/3dbe541d-234a-4049-befd-dcd9a67dbd46 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:02:45.031318 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-cac31c16-2fb6-4e75-a497-6a1b22275e87 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:02:45.040759 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-cac31c16-2fb6-4e75-a497-6a1b22275e87 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] [instance: df147c22-6a7f-4081-83e7-97620b23700c] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:02:45.049313 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cac31c16-2fb6-4e75-a497-6a1b22275e87 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:45.050103 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cac31c16-2fb6-4e75-a497-6a1b22275e87 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:45.050695 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cac31c16-2fb6-4e75-a497-6a1b22275e87 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:45.051534 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cac31c16-2fb6-4e75-a497-6a1b22275e87 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:45.053078 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cac31c16-2fb6-4e75-a497-6a1b22275e87 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:45.053630 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cac31c16-2fb6-4e75-a497-6a1b22275e87 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:45.078967 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-cac31c16-2fb6-4e75-a497-6a1b22275e87 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] HTTP exception thrown: Instance df147c22-6a7f-4081-83e7-97620b23700c could not be found. Oct 04 22:02:45.081794 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-cac31c16-2fb6-4e75-a497-6a1b22275e87 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Request method failure captured: Oct 04 22:02:45.081794 n-d-860284-1 devstack@n-api.service[134102]: request: DELETE /compute/v2.1/servers/df147c22-6a7f-4081-83e7-97620b23700c HTTP/1.1 Oct 04 22:02:45.081794 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 22:02:45.081794 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 22:02:45.081794 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 22:02:45.081794 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 22:02:45.081794 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 22:02:45.081794 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 22:02:45.081794 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 22:02:45.081794 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 22:02:45.081794 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPKzWheXfA-r0jMUCvCghTgqnEmmWico8QUomTvFWaOpHkFO0MYasCzDh5tHyxvd1ySLZdxwZqWitt8n5eyLrJ-OTBSTZVvVmEcLl1yZjg-ZBwvbP9EdZOwIK3W8AFbjns6cyuN88a7oOE1cMCeXFngQ9_fhd4lGPPICwpOiKdTKmOvs Oct 04 22:02:45.081794 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 22:02:45.081794 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 22:02:45.081794 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 22:02:45.081794 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 22:02:45.081794 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 22:02:45.081794 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 22:02:45.081794 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: aa89499d833a4a00805164f4f79ed522 Oct 04 22:02:45.081794 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-ServerDiskConfigTestJSON-2134643881 Oct 04 22:02:45.081794 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 22:02:45.081794 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 22:02:45.081794 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/aa89499d833a4a00805164f4f79ed522"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_aa89499d833a4a00805164f4f79ed522", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/aa89499d833a4a00805164f4f79ed522"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/aa89499d833a4a00805164f4f79ed522"}]}] Oct 04 22:02:45.081794 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-ServerDiskConfigTestJSON-2134643881 Oct 04 22:02:45.081794 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: aa89499d833a4a00805164f4f79ed522 Oct 04 22:02:45.081794 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-2134643881 Oct 04 22:02:45.081794 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-ServerDiskConfigTestJSON-2134643881-project Oct 04 22:02:45.081794 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 22:02:45.081794 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 22:02:45.081794 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: 2034fc9060874868bc5d27370a1c351c Oct 04 22:02:45.081794 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-ServerDiskConfigTestJSON-2134643881-project Oct 04 22:02:45.081794 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 22:02:45.081794 n-d-860284-1 devstack@n-api.service[134102]: exception: Instance df147c22-6a7f-4081-83e7-97620b23700c could not be found. Oct 04 22:02:45.081794 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': 'df147c22-6a7f-4081-83e7-97620b23700c'} Oct 04 22:02:45.081794 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:02:45.081794 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:02:45.081794 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:02:45.081794 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:02:45.081794 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:02:45.081794 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:02:45.081794 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:02:45.081794 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:02:45.081794 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:02:45.081794 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:02:45.081794 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df147c22-6a7f-4081-83e7-97620b23700c could not be found. Oct 04 22:02:45.081794 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:02:45.081794 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:02:45.081794 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:02:45.081794 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:02:45.081794 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:02:45.081794 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:02:45.081794 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:02:45.081794 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:02:45.081794 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:02:45.081794 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:02:45.081794 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 22:02:45.081794 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 22:02:45.081794 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 22:02:45.081794 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 22:02:45.081794 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:02:45.081794 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:02:45.081794 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:02:45.081794 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:02:45.086661 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df147c22-6a7f-4081-83e7-97620b23700c could not be found. Oct 04 22:02:45.086661 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:02:45.086661 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:02:45.086661 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:02:45.086661 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:02:45.086661 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:02:45.086661 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:02:45.086661 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:02:45.086661 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:02:45.086661 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df147c22-6a7f-4081-83e7-97620b23700c could not be found. Oct 04 22:02:45.086661 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:02:45.088972 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-cac31c16-2fb6-4e75-a497-6a1b22275e87 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Returning 404 to user: Instance df147c22-6a7f-4081-83e7-97620b23700c could not be found. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:02:45.094232 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-cac31c16-2fb6-4e75-a497-6a1b22275e87 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] 10.222.0.43 "DELETE /compute/v2.1/servers/df147c22-6a7f-4081-83e7-97620b23700c" status: 404 len: 111 microversion: 2.1 time: 0.066980 Oct 04 22:02:45.097559 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2055/4060] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 22:02:45 2022] DELETE /compute/v2.1/servers/df147c22-6a7f-4081-83e7-97620b23700c => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:02:45.115118 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-01f999a7-79e1-4732-9baa-143a6caafda8 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:02:45.115918 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-01f999a7-79e1-4732-9baa-143a6caafda8 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] [instance: df147c22-6a7f-4081-83e7-97620b23700c] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:02:45.133263 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-01f999a7-79e1-4732-9baa-143a6caafda8 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:45.134420 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-01f999a7-79e1-4732-9baa-143a6caafda8 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:45.135210 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-01f999a7-79e1-4732-9baa-143a6caafda8 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:45.136085 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-01f999a7-79e1-4732-9baa-143a6caafda8 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:45.136857 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-01f999a7-79e1-4732-9baa-143a6caafda8 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:45.139964 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-01f999a7-79e1-4732-9baa-143a6caafda8 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:45.182589 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-01f999a7-79e1-4732-9baa-143a6caafda8 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] HTTP exception thrown: Instance df147c22-6a7f-4081-83e7-97620b23700c could not be found. Oct 04 22:02:45.184057 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bdd3e1db-360d-4b37-b07a-76c84be1551c tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Acquiring lock "refresh_cache-49298a04-d3ab-4bb1-b8ed-ca7db4e028f3" {{(pid=134101) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 04 22:02:45.184488 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bdd3e1db-360d-4b37-b07a-76c84be1551c tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Acquired lock "refresh_cache-49298a04-d3ab-4bb1-b8ed-ca7db4e028f3" {{(pid=134101) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 04 22:02:45.187729 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-01f999a7-79e1-4732-9baa-143a6caafda8 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Request method failure captured: Oct 04 22:02:45.187729 n-d-860284-1 devstack@n-api.service[134102]: request: GET /compute/v2.1/servers/df147c22-6a7f-4081-83e7-97620b23700c HTTP/1.1 Oct 04 22:02:45.187729 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 22:02:45.187729 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 22:02:45.187729 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 22:02:45.187729 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 22:02:45.187729 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 22:02:45.187729 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 22:02:45.187729 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 22:02:45.187729 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 22:02:45.187729 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPKzWheXfA-r0jMUCvCghTgqnEmmWico8QUomTvFWaOpHkFO0MYasCzDh5tHyxvd1ySLZdxwZqWitt8n5eyLrJ-OTBSTZVvVmEcLl1yZjg-ZBwvbP9EdZOwIK3W8AFbjns6cyuN88a7oOE1cMCeXFngQ9_fhd4lGPPICwpOiKdTKmOvs Oct 04 22:02:45.187729 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 22:02:45.187729 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 22:02:45.187729 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 22:02:45.187729 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 22:02:45.187729 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 22:02:45.187729 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 22:02:45.187729 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: aa89499d833a4a00805164f4f79ed522 Oct 04 22:02:45.187729 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-ServerDiskConfigTestJSON-2134643881 Oct 04 22:02:45.187729 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 22:02:45.187729 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 22:02:45.187729 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/aa89499d833a4a00805164f4f79ed522"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_aa89499d833a4a00805164f4f79ed522", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/aa89499d833a4a00805164f4f79ed522"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/aa89499d833a4a00805164f4f79ed522"}]}] Oct 04 22:02:45.187729 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-ServerDiskConfigTestJSON-2134643881 Oct 04 22:02:45.187729 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: aa89499d833a4a00805164f4f79ed522 Oct 04 22:02:45.187729 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-2134643881 Oct 04 22:02:45.187729 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-ServerDiskConfigTestJSON-2134643881-project Oct 04 22:02:45.187729 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 22:02:45.187729 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 22:02:45.187729 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: 2034fc9060874868bc5d27370a1c351c Oct 04 22:02:45.187729 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-ServerDiskConfigTestJSON-2134643881-project Oct 04 22:02:45.187729 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 22:02:45.187729 n-d-860284-1 devstack@n-api.service[134102]: exception: Instance df147c22-6a7f-4081-83e7-97620b23700c could not be found. Oct 04 22:02:45.187729 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': 'df147c22-6a7f-4081-83e7-97620b23700c'} Oct 04 22:02:45.187729 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:02:45.187729 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:02:45.187729 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:02:45.187729 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:02:45.187729 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:02:45.187729 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:02:45.187729 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:02:45.187729 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:02:45.187729 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:02:45.187729 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:02:45.187729 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df147c22-6a7f-4081-83e7-97620b23700c could not be found. Oct 04 22:02:45.187729 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:02:45.187729 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:02:45.187729 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:02:45.187729 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:02:45.187729 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:02:45.187729 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:02:45.187729 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:02:45.187729 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:02:45.187729 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:02:45.187729 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:02:45.187729 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:02:45.187729 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:02:45.187729 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:02:45.187729 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:02:45.187729 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:02:45.187729 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:02:45.187729 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df147c22-6a7f-4081-83e7-97620b23700c could not be found. Oct 04 22:02:45.187729 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:02:45.187729 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:02:45.187729 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:02:45.193038 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:02:45.193038 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:02:45.193038 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:02:45.193038 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:02:45.193038 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:02:45.193038 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df147c22-6a7f-4081-83e7-97620b23700c could not be found. Oct 04 22:02:45.193038 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:02:45.193038 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-01f999a7-79e1-4732-9baa-143a6caafda8 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] Returning 404 to user: Instance df147c22-6a7f-4081-83e7-97620b23700c could not be found. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:02:45.193038 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-01f999a7-79e1-4732-9baa-143a6caafda8 tempest-ServerDiskConfigTestJSON-2134643881 tempest-ServerDiskConfigTestJSON-2134643881-project] 10.222.0.43 "GET /compute/v2.1/servers/df147c22-6a7f-4081-83e7-97620b23700c" status: 404 len: 111 microversion: 2.1 time: 0.088904 Oct 04 22:02:45.193038 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2056/4061] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:02:45 2022] GET /compute/v2.1/servers/df147c22-6a7f-4081-83e7-97620b23700c => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 22:02:45.222234 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-41c51479-908b-48c7-9d87-2d7c4c971205 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-981390395", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452", "networks": [{"uuid": "948c65db-57fc-480e-9ddd-f1d8426ccd4e"}]}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:02:45.346758 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.network.neutron [None req-41c51479-908b-48c7-9d87-2d7c4c971205 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] validate_networks() for [('948c65db-57fc-480e-9ddd-f1d8426ccd4e', None, None, None, None, None)] {{(pid=134102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 22:02:46.699889 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-41c51479-908b-48c7-9d87-2d7c4c971205 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Flavor limits 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 22:02:46.700563 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-41c51479-908b-48c7-9d87-2d7c4c971205 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Image limits 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 22:02:46.700799 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-41c51479-908b-48c7-9d87-2d7c4c971205 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Flavor pref 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 22:02:46.701212 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-41c51479-908b-48c7-9d87-2d7c4c971205 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Image pref 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 22:02:46.701634 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-41c51479-908b-48c7-9d87-2d7c4c971205 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 22:02:46.720038 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-41c51479-908b-48c7-9d87-2d7c4c971205 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:46.720575 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-41c51479-908b-48c7-9d87-2d7c4c971205 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:46.721155 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-41c51479-908b-48c7-9d87-2d7c4c971205 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:46.721906 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-41c51479-908b-48c7-9d87-2d7c4c971205 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:46.722398 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-41c51479-908b-48c7-9d87-2d7c4c971205 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:46.722841 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-41c51479-908b-48c7-9d87-2d7c4c971205 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:46.789152 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-41c51479-908b-48c7-9d87-2d7c4c971205 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Getting quotas for project dfe9283584fc4d90b0715216d867ea2f. Resources: {'instances', 'ram', 'cores'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:02:46.795750 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-41c51479-908b-48c7-9d87-2d7c4c971205 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Getting quotas for user 41a1c8d841104bc9b6910bcc2c0e2bb1 and project dfe9283584fc4d90b0715216d867ea2f. Resources: {'instances', 'ram', 'cores'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:02:46.828817 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-41c51479-908b-48c7-9d87-2d7c4c971205 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Going to run 1 instances... {{(pid=134102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 22:02:46.838970 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-41c51479-908b-48c7-9d87-2d7c4c971205 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: ee95fd91-021f-430b-9fe2-74b715161748] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='58548514-5dac-426c-81f5-19e3fba33e23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 22:02:46.934489 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-41c51479-908b-48c7-9d87-2d7c4c971205 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.740529 Oct 04 22:02:46.945711 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2057/4062] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 22:02:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 1754 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 22:02:46.954183 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-4c412206-f10e-4cc8-8c63-03254cf9cac3 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:02:46.955176 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-4c412206-f10e-4cc8-8c63-03254cf9cac3 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] [instance: 1475392a-475f-414f-803c-e89c9ae1844a] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:02:46.972213 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4c412206-f10e-4cc8-8c63-03254cf9cac3 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:46.972754 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4c412206-f10e-4cc8-8c63-03254cf9cac3 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:46.973204 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4c412206-f10e-4cc8-8c63-03254cf9cac3 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:46.974016 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4c412206-f10e-4cc8-8c63-03254cf9cac3 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:46.974542 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4c412206-f10e-4cc8-8c63-03254cf9cac3 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:46.974982 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4c412206-f10e-4cc8-8c63-03254cf9cac3 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:47.251300 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-4c412206-f10e-4cc8-8c63-03254cf9cac3 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80fc56886fef422b9b52eb1dede7d10e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82e1a29234ce40f9b37d0eca196cd1db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:02:47.260371 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-4c412206-f10e-4cc8-8c63-03254cf9cac3 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] 10.222.0.43 "GET /compute/v2.1/servers/1475392a-475f-414f-803c-e89c9ae1844a" status: 200 len: 1299 microversion: 2.1 time: 0.311975 Oct 04 22:02:47.269040 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2058/4063] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:02:46 2022] GET /compute/v2.1/servers/1475392a-475f-414f-803c-e89c9ae1844a => generated 1299 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:02:47.274474 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-5b82395d-114b-461a-a2a2-5aa2937a5f7e tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:02:47.275216 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-5b82395d-114b-461a-a2a2-5aa2937a5f7e tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: ee95fd91-021f-430b-9fe2-74b715161748] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:02:47.397861 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-5b82395d-114b-461a-a2a2-5aa2937a5f7e tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a1c8d841104bc9b6910bcc2c0e2bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe9283584fc4d90b0715216d867ea2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:02:47.409598 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-5b82395d-114b-461a-a2a2-5aa2937a5f7e tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "GET /compute/v2.1/servers/ee95fd91-021f-430b-9fe2-74b715161748" status: 200 len: 1214 microversion: 2.1 time: 0.136994 Oct 04 22:02:47.411175 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2059/4064] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:02:47 2022] GET /compute/v2.1/servers/ee95fd91-021f-430b-9fe2-74b715161748 => generated 1214 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:02:47.437183 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-ca73f60b-9db8-48b8-b211-cf6d6591b3be tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:02:47.437883 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-ca73f60b-9db8-48b8-b211-cf6d6591b3be tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: ee95fd91-021f-430b-9fe2-74b715161748] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:02:47.455719 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-ca73f60b-9db8-48b8-b211-cf6d6591b3be tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: ee95fd91-021f-430b-9fe2-74b715161748] Going to try to terminate instance {{(pid=134102) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 22:02:47.458825 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:INSERT=7 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:02:47.527756 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.network.neutron [None req-bdd3e1db-360d-4b37-b07a-76c84be1551c tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] [instance: 49298a04-d3ab-4bb1-b8ed-ca7db4e028f3] Building network info cache for instance {{(pid=134101) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 04 22:02:48.334178 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.compute.api [None req-ca73f60b-9db8-48b8-b211-cf6d6591b3be tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: ee95fd91-021f-430b-9fe2-74b715161748] Instance Mapping does not exist while attempting local delete cleanup. Oct 04 22:02:48.337526 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-ca73f60b-9db8-48b8-b211-cf6d6591b3be tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "DELETE /compute/v2.1/servers/ee95fd91-021f-430b-9fe2-74b715161748" status: 204 len: 0 microversion: 2.1 time: 0.908102 Oct 04 22:02:48.341070 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2060/4065] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 22:02:47 2022] DELETE /compute/v2.1/servers/ee95fd91-021f-430b-9fe2-74b715161748 => generated 0 bytes in 913 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 22:02:48.362388 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-7fd7b333-7b98-49bd-a6ad-84ac8cbc8b03 req-000c339d-1c53-4579-b34e-d7571e24335f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49298a04-d3ab-4bb1-b8ed-ca7db4e028f3", "tag": "4db0b86a-68bb-4021-8879-799b566c6728"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:02:48.407436 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-7fd7b333-7b98-49bd-a6ad-84ac8cbc8b03 req-000c339d-1c53-4579-b34e-d7571e24335f service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:48.410280 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-7fd7b333-7b98-49bd-a6ad-84ac8cbc8b03 req-000c339d-1c53-4579-b34e-d7571e24335f service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:48.414295 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-7fd7b333-7b98-49bd-a6ad-84ac8cbc8b03 req-000c339d-1c53-4579-b34e-d7571e24335f service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:48.456515 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-7fd7b333-7b98-49bd-a6ad-84ac8cbc8b03 req-000c339d-1c53-4579-b34e-d7571e24335f service nova] Creating event network-changed:4db0b86a-68bb-4021-8879-799b566c6728 for instance 49298a04-d3ab-4bb1-b8ed-ca7db4e028f3 on n-h2-860284-1 Oct 04 22:02:48.473704 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-7fd7b333-7b98-49bd-a6ad-84ac8cbc8b03 req-000c339d-1c53-4579-b34e-d7571e24335f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128389 Oct 04 22:02:48.479409 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2061/4066] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:02:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:02:48.486643 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-1d1e7b83-82b9-430f-959f-07c0ee571f3c tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:02:48.500097 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-1d1e7b83-82b9-430f-959f-07c0ee571f3c tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8ec630399c5d4231ae3d3975c8370c55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b79bc7a0ba4b3e9415590e7e6b7f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:02:48.505401 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-1d1e7b83-82b9-430f-959f-07c0ee571f3c tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Searching by: {'deleted': False, 'project_id': '49b79bc7a0ba4b3e9415590e7e6b7f02'} {{(pid=134102) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 22:02:48.517678 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1d1e7b83-82b9-430f-959f-07c0ee571f3c tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:48.520671 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1d1e7b83-82b9-430f-959f-07c0ee571f3c tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:48.521606 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1d1e7b83-82b9-430f-959f-07c0ee571f3c tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:48.523961 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1d1e7b83-82b9-430f-959f-07c0ee571f3c tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:48.528473 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1d1e7b83-82b9-430f-959f-07c0ee571f3c tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:48.530603 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1d1e7b83-82b9-430f-959f-07c0ee571f3c tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:48.573094 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:02:48.609727 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.multi_cell_list [None req-1d1e7b83-82b9-430f-959f-07c0ee571f3c tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=134102) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 22:02:48.707075 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-1d1e7b83-82b9-430f-959f-07c0ee571f3c tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] 10.222.0.43 "GET /compute/v2.1/servers" status: 200 len: 339 microversion: 2.1 time: 0.220332 Oct 04 22:02:48.708832 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2062/4067] 10.222.0.43 () {58 vars in 1125 bytes} [Tue Oct 4 22:02:48 2022] GET /compute/v2.1/servers => generated 339 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:02:48.722517 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-eadcf88e-b420-41b0-bb01-4f53affb0d23 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:02:48.724127 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-eadcf88e-b420-41b0-bb01-4f53affb0d23 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] [instance: 1475392a-475f-414f-803c-e89c9ae1844a] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:02:48.749504 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-eadcf88e-b420-41b0-bb01-4f53affb0d23 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:48.750952 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-eadcf88e-b420-41b0-bb01-4f53affb0d23 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:48.752013 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-eadcf88e-b420-41b0-bb01-4f53affb0d23 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:48.756193 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-eadcf88e-b420-41b0-bb01-4f53affb0d23 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:48.756843 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-eadcf88e-b420-41b0-bb01-4f53affb0d23 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:48.757397 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-eadcf88e-b420-41b0-bb01-4f53affb0d23 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:49.111555 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-eadcf88e-b420-41b0-bb01-4f53affb0d23 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80fc56886fef422b9b52eb1dede7d10e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82e1a29234ce40f9b37d0eca196cd1db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:02:49.120802 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-eadcf88e-b420-41b0-bb01-4f53affb0d23 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] 10.222.0.43 "GET /compute/v2.1/servers/1475392a-475f-414f-803c-e89c9ae1844a" status: 200 len: 1299 microversion: 2.1 time: 0.409621 Oct 04 22:02:49.121407 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2063/4068] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:02:48 2022] GET /compute/v2.1/servers/1475392a-475f-414f-803c-e89c9ae1844a => generated 1299 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:02:49.139951 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-aeb63854-8cdb-4db3-9709-4bc47df58f2d tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:02:49.140777 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-aeb63854-8cdb-4db3-9709-4bc47df58f2d tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: ee95fd91-021f-430b-9fe2-74b715161748] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:02:49.149174 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-aeb63854-8cdb-4db3-9709-4bc47df58f2d tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] HTTP exception thrown: Instance ee95fd91-021f-430b-9fe2-74b715161748 could not be found. Oct 04 22:02:49.155428 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-aeb63854-8cdb-4db3-9709-4bc47df58f2d tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Request method failure captured: Oct 04 22:02:49.155428 n-d-860284-1 devstack@n-api.service[134102]: request: GET /compute/v2.1/servers/ee95fd91-021f-430b-9fe2-74b715161748 HTTP/1.1 Oct 04 22:02:49.155428 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 22:02:49.155428 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 22:02:49.155428 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 22:02:49.155428 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 22:02:49.155428 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 22:02:49.155428 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 22:02:49.155428 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 22:02:49.155428 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 22:02:49.155428 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPK0nBLOASIAc_jQKg5RCRqB87oRsJiRc3l4etfmNkfSSv1yHGR8RjgOAS-Q4KEeiZVVxJRa8Focu7VoHdbhzgEqV5pocnY2xPPRPWacaT4koizORav87v6vdxgR4HH-PmsbraTS232Q30lW73kM7RH3tINWZChDkcbwtTWeQlIO6TSk Oct 04 22:02:49.155428 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 22:02:49.155428 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 22:02:49.155428 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 22:02:49.155428 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 22:02:49.155428 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 22:02:49.155428 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 22:02:49.155428 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: dfe9283584fc4d90b0715216d867ea2f Oct 04 22:02:49.155428 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-DeleteServersTestJSON-2136146778 Oct 04 22:02:49.155428 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 22:02:49.155428 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 22:02:49.155428 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/dfe9283584fc4d90b0715216d867ea2f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_dfe9283584fc4d90b0715216d867ea2f", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/dfe9283584fc4d90b0715216d867ea2f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/dfe9283584fc4d90b0715216d867ea2f"}]}] Oct 04 22:02:49.155428 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-DeleteServersTestJSON-2136146778 Oct 04 22:02:49.155428 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: dfe9283584fc4d90b0715216d867ea2f Oct 04 22:02:49.155428 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-DeleteServersTestJSON-2136146778 Oct 04 22:02:49.155428 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-DeleteServersTestJSON-2136146778-project Oct 04 22:02:49.155428 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 22:02:49.155428 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 22:02:49.155428 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: 41a1c8d841104bc9b6910bcc2c0e2bb1 Oct 04 22:02:49.155428 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-DeleteServersTestJSON-2136146778-project Oct 04 22:02:49.155428 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 22:02:49.155428 n-d-860284-1 devstack@n-api.service[134102]: exception: Instance ee95fd91-021f-430b-9fe2-74b715161748 could not be found. Oct 04 22:02:49.155428 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': 'ee95fd91-021f-430b-9fe2-74b715161748'} Oct 04 22:02:49.155428 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:02:49.155428 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:02:49.155428 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:02:49.155428 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:02:49.155428 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:02:49.155428 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:02:49.155428 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 22:02:49.155428 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 22:02:49.155428 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee95fd91-021f-430b-9fe2-74b715161748 could not be found. Oct 04 22:02:49.155428 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:02:49.155428 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:02:49.155428 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:02:49.155428 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:02:49.155428 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:02:49.155428 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:02:49.155428 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:02:49.155428 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:02:49.155428 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:02:49.155428 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:02:49.155428 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:02:49.155428 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:02:49.155428 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:02:49.155428 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:02:49.155428 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:02:49.155428 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:02:49.155428 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee95fd91-021f-430b-9fe2-74b715161748 could not be found. Oct 04 22:02:49.155428 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:02:49.155428 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:02:49.155428 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:02:49.155428 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:02:49.155428 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:02:49.160358 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:02:49.160358 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:02:49.160358 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:02:49.160358 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee95fd91-021f-430b-9fe2-74b715161748 could not be found. Oct 04 22:02:49.160358 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:02:49.163717 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-aeb63854-8cdb-4db3-9709-4bc47df58f2d tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Returning 404 to user: Instance ee95fd91-021f-430b-9fe2-74b715161748 could not be found. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:02:49.168295 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-aeb63854-8cdb-4db3-9709-4bc47df58f2d tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "GET /compute/v2.1/servers/ee95fd91-021f-430b-9fe2-74b715161748" status: 404 len: 111 microversion: 2.1 time: 0.036447 Oct 04 22:02:49.169660 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2064/4069] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:02:49 2022] GET /compute/v2.1/servers/ee95fd91-021f-430b-9fe2-74b715161748 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:02:49.181057 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-40f30219-ee38-4d9b-870d-ad58aeadd506 tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:02:49.197530 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-40f30219-ee38-4d9b-870d-ad58aeadd506 tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8ec630399c5d4231ae3d3975c8370c55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b79bc7a0ba4b3e9415590e7e6b7f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:02:49.201520 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-40f30219-ee38-4d9b-870d-ad58aeadd506 tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Searching by: {'deleted': False, 'project_id': '49b79bc7a0ba4b3e9415590e7e6b7f02'} {{(pid=134102) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 22:02:49.218072 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-40f30219-ee38-4d9b-870d-ad58aeadd506 tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:49.222681 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-40f30219-ee38-4d9b-870d-ad58aeadd506 tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:49.223338 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-40f30219-ee38-4d9b-870d-ad58aeadd506 tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:49.226589 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-40f30219-ee38-4d9b-870d-ad58aeadd506 tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:49.227309 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-40f30219-ee38-4d9b-870d-ad58aeadd506 tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:49.229539 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-40f30219-ee38-4d9b-870d-ad58aeadd506 tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:49.302322 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.multi_cell_list [None req-40f30219-ee38-4d9b-870d-ad58aeadd506 tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=134102) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 22:02:49.441116 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-40f30219-ee38-4d9b-870d-ad58aeadd506 tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ec630399c5d4231ae3d3975c8370c55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b79bc7a0ba4b3e9415590e7e6b7f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:02:49.472894 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-40f30219-ee38-4d9b-870d-ad58aeadd506 tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:49.473774 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-40f30219-ee38-4d9b-870d-ad58aeadd506 tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:49.474438 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-40f30219-ee38-4d9b-870d-ad58aeadd506 tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:49.724027 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.network.neutron [None req-bdd3e1db-360d-4b37-b07a-76c84be1551c tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] [instance: 49298a04-d3ab-4bb1-b8ed-ca7db4e028f3] Updating instance_info_cache with network_info: [{"id": "4db0b86a-68bb-4021-8879-799b566c6728", "address": "fa:16:3e:e9:ca:bd", "network": {"id": "127690ac-f36b-46d5-a87d-a2ce7681c8ef", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-1895018730-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "bad5849b558042d1a5288e8a4443fb53", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap4db0b86a-68", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=134101) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 04 22:02:49.735588 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bdd3e1db-360d-4b37-b07a-76c84be1551c tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Releasing lock "refresh_cache-49298a04-d3ab-4bb1-b8ed-ca7db4e028f3" {{(pid=134101) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 04 22:02:49.736486 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-bdd3e1db-360d-4b37-b07a-76c84be1551c tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] 10.222.0.43 "POST /compute/v2.1/servers/49298a04-d3ab-4bb1-b8ed-ca7db4e028f3/action" status: 202 len: 0 microversion: 2.1 time: 5.256635 Oct 04 22:02:49.742710 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2006/4070] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 22:02:44 2022] POST /compute/v2.1/servers/49298a04-d3ab-4bb1-b8ed-ca7db4e028f3/action => generated 0 bytes in 5260 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 04 22:02:49.751868 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-2f0be1c1-a597-4910-9663-838b97fbfb9a tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1393779718", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452", "networks": [{"uuid": "948c65db-57fc-480e-9ddd-f1d8426ccd4e"}]}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:02:49.857771 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.network.neutron [None req-2f0be1c1-a597-4910-9663-838b97fbfb9a tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] validate_networks() for [('948c65db-57fc-480e-9ddd-f1d8426ccd4e', None, None, None, None, None)] {{(pid=134101) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 22:02:50.017490 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-40f30219-ee38-4d9b-870d-ad58aeadd506 tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] 10.222.0.43 "GET /compute/v2.1/servers/detail" status: 200 len: 1712 microversion: 2.1 time: 0.846432 Oct 04 22:02:50.018080 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2065/4071] 10.222.0.43 () {58 vars in 1146 bytes} [Tue Oct 4 22:02:49 2022] GET /compute/v2.1/servers/detail => generated 1712 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:02:50.022989 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-575d7853-e231-4d14-86c8-87747d28d0d3 tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Calling method '.version_select at 0x7fbb2e61cd30>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:02:51.811101 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-2f0be1c1-a597-4910-9663-838b97fbfb9a tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Flavor limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 22:02:51.812277 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-2f0be1c1-a597-4910-9663-838b97fbfb9a tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Image limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 22:02:51.813578 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-2f0be1c1-a597-4910-9663-838b97fbfb9a tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Flavor pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 22:02:51.814185 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-2f0be1c1-a597-4910-9663-838b97fbfb9a tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Image pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 22:02:51.814786 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-2f0be1c1-a597-4910-9663-838b97fbfb9a tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 22:02:51.826149 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2f0be1c1-a597-4910-9663-838b97fbfb9a tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:51.826701 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2f0be1c1-a597-4910-9663-838b97fbfb9a tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:51.827147 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2f0be1c1-a597-4910-9663-838b97fbfb9a tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:51.828253 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2f0be1c1-a597-4910-9663-838b97fbfb9a tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:51.828896 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2f0be1c1-a597-4910-9663-838b97fbfb9a tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:51.829484 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2f0be1c1-a597-4910-9663-838b97fbfb9a tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:51.851746 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-2f0be1c1-a597-4910-9663-838b97fbfb9a tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Getting quotas for project dfe9283584fc4d90b0715216d867ea2f. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:02:51.858445 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-2f0be1c1-a597-4910-9663-838b97fbfb9a tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Getting quotas for user 41a1c8d841104bc9b6910bcc2c0e2bb1 and project dfe9283584fc4d90b0715216d867ea2f. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:02:51.876135 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-2f0be1c1-a597-4910-9663-838b97fbfb9a tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Going to run 1 instances... {{(pid=134101) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 22:02:51.879817 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-2f0be1c1-a597-4910-9663-838b97fbfb9a tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: 64d56eab-65de-4951-adf0-891f8a39383f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='58548514-5dac-426c-81f5-19e3fba33e23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134101) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 22:02:51.954957 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-2f0be1c1-a597-4910-9663-838b97fbfb9a tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.212763 Oct 04 22:02:51.961620 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2007/4072] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 22:02:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 2215 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 22:02:51.962603 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-02080461-a314-47c4-99ba-8a39fca6c62e tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:02:51.975237 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-02080461-a314-47c4-99ba-8a39fca6c62e tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] 10.222.0.43 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.017236 Oct 04 22:02:51.976120 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2008/4073] 10.222.0.43 () {58 vars in 1137 bytes} [Tue Oct 4 22:02:51 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:02:51.993843 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-f0b762de-f9ee-410f-b353-d3a025e8085a tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:02:51.995559 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-f0b762de-f9ee-410f-b353-d3a025e8085a tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] [instance: 1475392a-475f-414f-803c-e89c9ae1844a] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:02:52.007664 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f0b762de-f9ee-410f-b353-d3a025e8085a tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:52.008478 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f0b762de-f9ee-410f-b353-d3a025e8085a tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:52.011913 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f0b762de-f9ee-410f-b353-d3a025e8085a tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:52.013256 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f0b762de-f9ee-410f-b353-d3a025e8085a tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:52.013892 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f0b762de-f9ee-410f-b353-d3a025e8085a tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:52.014385 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f0b762de-f9ee-410f-b353-d3a025e8085a tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:52.545508 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-f0b762de-f9ee-410f-b353-d3a025e8085a tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80fc56886fef422b9b52eb1dede7d10e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82e1a29234ce40f9b37d0eca196cd1db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:02:52.554288 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-f0b762de-f9ee-410f-b353-d3a025e8085a tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] 10.222.0.43 "GET /compute/v2.1/servers/1475392a-475f-414f-803c-e89c9ae1844a" status: 200 len: 1366 microversion: 2.1 time: 0.564952 Oct 04 22:02:52.563137 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2009/4074] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:02:51 2022] GET /compute/v2.1/servers/1475392a-475f-414f-803c-e89c9ae1844a => generated 1366 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:02:52.567919 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-dfd9ccef-5bae-45f5-86f7-77f0e50a94dc tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:02:52.574773 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-dfd9ccef-5bae-45f5-86f7-77f0e50a94dc tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: 64d56eab-65de-4951-adf0-891f8a39383f] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:02:52.716590 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-dfd9ccef-5bae-45f5-86f7-77f0e50a94dc tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a1c8d841104bc9b6910bcc2c0e2bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe9283584fc4d90b0715216d867ea2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:02:52.741112 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-dfd9ccef-5bae-45f5-86f7-77f0e50a94dc tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "GET /compute/v2.1/servers/64d56eab-65de-4951-adf0-891f8a39383f" status: 200 len: 1215 microversion: 2.1 time: 0.170125 Oct 04 22:02:52.741840 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2010/4075] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:02:52 2022] GET /compute/v2.1/servers/64d56eab-65de-4951-adf0-891f8a39383f => generated 1215 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:02:52.763151 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-3c894dda-3e6e-4b47-898a-46feb31ba6f3 tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:02:52.763911 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-3c894dda-3e6e-4b47-898a-46feb31ba6f3 tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] [instance: 3626ed18-d2aa-4ec2-8a06-4e6c76114cfc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:02:52.772084 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3c894dda-3e6e-4b47-898a-46feb31ba6f3 tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:52.772823 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3c894dda-3e6e-4b47-898a-46feb31ba6f3 tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:52.773514 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3c894dda-3e6e-4b47-898a-46feb31ba6f3 tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:52.774588 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3c894dda-3e6e-4b47-898a-46feb31ba6f3 tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:52.775688 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3c894dda-3e6e-4b47-898a-46feb31ba6f3 tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:52.776309 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3c894dda-3e6e-4b47-898a-46feb31ba6f3 tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:52.813809 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-3c894dda-3e6e-4b47-898a-46feb31ba6f3 tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] [instance: 3626ed18-d2aa-4ec2-8a06-4e6c76114cfc] Going to try to terminate instance {{(pid=134101) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 22:02:52.970857 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-3c894dda-3e6e-4b47-898a-46feb31ba6f3 tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] 10.222.0.43 "DELETE /compute/v2.1/servers/3626ed18-d2aa-4ec2-8a06-4e6c76114cfc" status: 204 len: 0 microversion: 2.1 time: 0.211392 Oct 04 22:02:52.973838 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2011/4076] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 22:02:52 2022] DELETE /compute/v2.1/servers/3626ed18-d2aa-4ec2-8a06-4e6c76114cfc => generated 0 bytes in 231 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 22:02:52.991288 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-4a5a3e23-9ba9-4491-bf59-9982dc338eff tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:02:52.996333 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-4a5a3e23-9ba9-4491-bf59-9982dc338eff tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] [instance: 3626ed18-d2aa-4ec2-8a06-4e6c76114cfc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:02:53.015869 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4a5a3e23-9ba9-4491-bf59-9982dc338eff tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:53.018551 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4a5a3e23-9ba9-4491-bf59-9982dc338eff tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:53.020543 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4a5a3e23-9ba9-4491-bf59-9982dc338eff tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:53.022248 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4a5a3e23-9ba9-4491-bf59-9982dc338eff tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:53.023944 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4a5a3e23-9ba9-4491-bf59-9982dc338eff tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:53.024585 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4a5a3e23-9ba9-4491-bf59-9982dc338eff tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:53.214499 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-575d7853-e231-4d14-86c8-87747d28d0d3 tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] 10.222.0.43 "DELETE /compute/v2.1/os-floating-ips/dd21ad29-8a4e-4243-9428-4f0a4dea46bd" status: 202 len: 0 microversion: 2.1 time: 3.195138 Oct 04 22:02:53.216259 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2066/4077] 10.222.0.43 () {58 vars in 1263 bytes} [Tue Oct 4 22:02:50 2022] DELETE /compute/v2.1/os-floating-ips/dd21ad29-8a4e-4243-9428-4f0a4dea46bd => generated 0 bytes in 3197 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 22:02:53.231249 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-714708e2-b9b5-402c-812b-1361bede86bf tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": ""}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:02:53.257280 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-714708e2-b9b5-402c-812b-1361bede86bf tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Request method failure captured: Oct 04 22:02:53.257280 n-d-860284-1 devstack@n-api.service[134102]: request: POST /compute/v2.1/servers/49298a04-d3ab-4bb1-b8ed-ca7db4e028f3/action HTTP/1.1 Oct 04 22:02:53.257280 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 22:02:53.257280 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 22:02:53.257280 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 22:02:53.257280 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 34 Oct 04 22:02:53.257280 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 22:02:53.257280 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 22:02:53.257280 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 22:02:53.257280 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 22:02:53.257280 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPK1fn4pN4SRD03yYlNRfgQojvW4xOOtDRm4hbQGnNkCBseJuSDBWmCiY80kQRlH0QW_aaGxqmtKoHZTzbu68wwQoxUG1oxsNjeZ3eQqh_3Mjso0ggVp4fT1MxaOeaaW0T9MRExWL6tLg89SP0zzgyW4ymGiY4ahLUviV7WwOEakUGzg Oct 04 22:02:53.257280 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 22:02:53.257280 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 22:02:53.257280 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 22:02:53.257280 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 22:02:53.257280 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 22:02:53.257280 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 22:02:53.257280 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: bad5849b558042d1a5288e8a4443fb53 Oct 04 22:02:53.257280 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-157857634 Oct 04 22:02:53.257280 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 22:02:53.257280 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 22:02:53.257280 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/bad5849b558042d1a5288e8a4443fb53"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_bad5849b558042d1a5288e8a4443fb53", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/bad5849b558042d1a5288e8a4443fb53"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/bad5849b558042d1a5288e8a4443fb53"}]}] Oct 04 22:02:53.257280 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-157857634 Oct 04 22:02:53.257280 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: bad5849b558042d1a5288e8a4443fb53 Oct 04 22:02:53.257280 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-157857634 Oct 04 22:02:53.257280 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project Oct 04 22:02:53.257280 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 22:02:53.257280 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 22:02:53.257280 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: 1f50bbed6deb45e1a2d081745777596c Oct 04 22:02:53.257280 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project Oct 04 22:02:53.257280 n-d-860284-1 devstack@n-api.service[134102]: Oct 04 22:02:53.257280 n-d-860284-1 devstack@n-api.service[134102]: {"addFloatingIp": {"address": ""}} Oct 04 22:02:53.257280 n-d-860284-1 devstack@n-api.service[134102]: method: Oct 04 22:02:53.257280 n-d-860284-1 devstack@n-api.service[134102]: exception: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 04 22:02:53.257280 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': '49298a04-d3ab-4bb1-b8ed-ca7db4e028f3', 'body': {'addFloatingIp': {'address': ''}}} Oct 04 22:02:53.257280 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:02:53.257280 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:02:53.257280 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 22:02:53.257280 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 22:02:53.257280 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 22:02:53.257280 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise error Oct 04 22:02:53.257280 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is not valid under any of the given schemas Oct 04 22:02:53.257280 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:02:53.257280 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['addFloatingIp']['properties']['address']: Oct 04 22:02:53.257280 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'ipv4'}, {'format': 'ipv6'}], 'type': 'string'} Oct 04 22:02:53.257280 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:02:53.257280 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi On instance['addFloatingIp']: Oct 04 22:02:53.257280 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi '' Oct 04 22:02:53.257280 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:02:53.257280 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:02:53.257280 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:02:53.257280 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:02:53.257280 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:02:53.257280 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:02:53.257280 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:02:53.257280 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:02:53.257280 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 22:02:53.257280 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 22:02:53.257280 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:02:53.257280 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:02:53.257280 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 22:02:53.257280 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 22:02:53.257280 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 22:02:53.257280 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 22:02:53.257280 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 22:02:53.261648 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 22:02:53.261648 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 04 22:02:53.261648 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:02:53.261648 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:02:53.261648 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:02:53.261648 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:02:53.261648 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:02:53.261648 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:02:53.261648 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 22:02:53.261648 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 22:02:53.261648 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 04 22:02:53.261648 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:02:53.265962 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-714708e2-b9b5-402c-812b-1361bede86bf tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:02:53.267339 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-714708e2-b9b5-402c-812b-1361bede86bf tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] 10.222.0.43 "POST /compute/v2.1/servers/49298a04-d3ab-4bb1-b8ed-ca7db4e028f3/action" status: 400 len: 142 microversion: 2.1 time: 0.041662 Oct 04 22:02:53.283570 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2067/4078] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 22:02:53 2022] POST /compute/v2.1/servers/49298a04-d3ab-4bb1-b8ed-ca7db4e028f3/action => generated 142 bytes in 60 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 22:02:53.292282 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-b66072da-1af1-4a5d-b409-7585cb88d5bc tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:02:53.325342 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-b66072da-1af1-4a5d-b409-7585cb88d5bc tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] [instance: 49298a04-d3ab-4bb1-b8ed-ca7db4e028f3] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:02:53.343085 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b66072da-1af1-4a5d-b409-7585cb88d5bc tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:53.366999 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b66072da-1af1-4a5d-b409-7585cb88d5bc tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.030s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:53.367659 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b66072da-1af1-4a5d-b409-7585cb88d5bc tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:53.368918 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b66072da-1af1-4a5d-b409-7585cb88d5bc tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:53.369546 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b66072da-1af1-4a5d-b409-7585cb88d5bc tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:53.370146 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b66072da-1af1-4a5d-b409-7585cb88d5bc tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:53.436506 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b66072da-1af1-4a5d-b409-7585cb88d5bc tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Acquiring lock "refresh_cache-49298a04-d3ab-4bb1-b8ed-ca7db4e028f3" {{(pid=134102) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 04 22:02:53.439944 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-4a5a3e23-9ba9-4491-bf59-9982dc338eff tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ec630399c5d4231ae3d3975c8370c55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b79bc7a0ba4b3e9415590e7e6b7f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:02:53.443020 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=67,nova_cell1:SAVEPOINT=2,nova_cell1:UPDATE=2,nova_cell1:RELEASE=2,nova_cell1:INSERT=1 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:02:53.444260 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b66072da-1af1-4a5d-b409-7585cb88d5bc tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Acquired lock "refresh_cache-49298a04-d3ab-4bb1-b8ed-ca7db4e028f3" {{(pid=134102) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 04 22:02:53.456589 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-4a5a3e23-9ba9-4491-bf59-9982dc338eff tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] 10.222.0.43 "GET /compute/v2.1/servers/3626ed18-d2aa-4ec2-8a06-4e6c76114cfc" status: 200 len: 1715 microversion: 2.1 time: 0.474562 Oct 04 22:02:53.470397 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2012/4079] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:02:52 2022] GET /compute/v2.1/servers/3626ed18-d2aa-4ec2-8a06-4e6c76114cfc => generated 1715 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:02:53.591737 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-ed9db672-08f0-4987-a7bd-10f22ffc1110 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:02:53.592269 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-ed9db672-08f0-4987-a7bd-10f22ffc1110 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] [instance: 1475392a-475f-414f-803c-e89c9ae1844a] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:02:53.609807 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ed9db672-08f0-4987-a7bd-10f22ffc1110 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:53.610943 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ed9db672-08f0-4987-a7bd-10f22ffc1110 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:53.611401 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ed9db672-08f0-4987-a7bd-10f22ffc1110 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:53.612133 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ed9db672-08f0-4987-a7bd-10f22ffc1110 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:53.612594 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ed9db672-08f0-4987-a7bd-10f22ffc1110 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:53.613027 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ed9db672-08f0-4987-a7bd-10f22ffc1110 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:53.745131 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b66072da-1af1-4a5d-b409-7585cb88d5bc tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Releasing lock "refresh_cache-49298a04-d3ab-4bb1-b8ed-ca7db4e028f3" {{(pid=134102) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 04 22:02:53.746613 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-b66072da-1af1-4a5d-b409-7585cb88d5bc tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] HTTP exception thrown: floating IP not found Oct 04 22:02:53.748640 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-b66072da-1af1-4a5d-b409-7585cb88d5bc tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Request method failure captured: Oct 04 22:02:53.748640 n-d-860284-1 devstack@n-api.service[134102]: request: POST /compute/v2.1/servers/49298a04-d3ab-4bb1-b8ed-ca7db4e028f3/action HTTP/1.1 Oct 04 22:02:53.748640 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 22:02:53.748640 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 22:02:53.748640 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 22:02:53.748640 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 41 Oct 04 22:02:53.748640 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 22:02:53.748640 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 22:02:53.748640 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 22:02:53.748640 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 22:02:53.748640 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPK1fn4pN4SRD03yYlNRfgQojvW4xOOtDRm4hbQGnNkCBseJuSDBWmCiY80kQRlH0QW_aaGxqmtKoHZTzbu68wwQoxUG1oxsNjeZ3eQqh_3Mjso0ggVp4fT1MxaOeaaW0T9MRExWL6tLg89SP0zzgyW4ymGiY4ahLUviV7WwOEakUGzg Oct 04 22:02:53.748640 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 22:02:53.748640 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 22:02:53.748640 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 22:02:53.748640 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 22:02:53.748640 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 22:02:53.748640 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 22:02:53.748640 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: bad5849b558042d1a5288e8a4443fb53 Oct 04 22:02:53.748640 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-157857634 Oct 04 22:02:53.748640 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 22:02:53.748640 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 22:02:53.748640 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/bad5849b558042d1a5288e8a4443fb53"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_bad5849b558042d1a5288e8a4443fb53", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/bad5849b558042d1a5288e8a4443fb53"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/bad5849b558042d1a5288e8a4443fb53"}]}] Oct 04 22:02:53.748640 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-157857634 Oct 04 22:02:53.748640 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: bad5849b558042d1a5288e8a4443fb53 Oct 04 22:02:53.748640 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-157857634 Oct 04 22:02:53.748640 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project Oct 04 22:02:53.748640 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 22:02:53.748640 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 22:02:53.748640 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: 1f50bbed6deb45e1a2d081745777596c Oct 04 22:02:53.748640 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project Oct 04 22:02:53.748640 n-d-860284-1 devstack@n-api.service[134102]: Oct 04 22:02:53.748640 n-d-860284-1 devstack@n-api.service[134102]: {"addFloatingIp": {"address": "0.0.0.0"}} Oct 04 22:02:53.748640 n-d-860284-1 devstack@n-api.service[134102]: method: Oct 04 22:02:53.748640 n-d-860284-1 devstack@n-api.service[134102]: exception: floating IP not found Oct 04 22:02:53.748640 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': '49298a04-d3ab-4bb1-b8ed-ca7db4e028f3', 'body': {'addFloatingIp': {'address': '0.0.0.0'}}} Oct 04 22:02:53.748640 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:02:53.748640 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:02:53.748640 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Oct 04 22:02:53.748640 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Oct 04 22:02:53.748640 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Oct 04 22:02:53.748640 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Oct 04 22:02:53.748640 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2699, in associate_floating_ip Oct 04 22:02:53.748640 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, floating_address) Oct 04 22:02:53.748640 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Oct 04 22:02:53.748640 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Oct 04 22:02:53.748640 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Oct 04 22:02:53.748640 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:02:53.748640 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:02:53.748640 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:02:53.748640 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:02:53.748640 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:02:53.748640 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:02:53.748640 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:02:53.748640 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:02:53.748640 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 22:02:53.748640 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 22:02:53.748640 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:02:53.748640 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:02:53.748640 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 22:02:53.748640 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 22:02:53.748640 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 252, in _add_floating_ip Oct 04 22:02:53.748640 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 04 22:02:53.748640 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: floating IP not found Oct 04 22:02:53.748640 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:02:53.752754 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:02:53.752754 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:02:53.752754 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:02:53.752754 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:02:53.752754 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:02:53.752754 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:02:53.752754 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:02:53.752754 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: floating IP not found Oct 04 22:02:53.752754 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:02:53.756353 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-b66072da-1af1-4a5d-b409-7585cb88d5bc tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Returning 404 to user: floating IP not found {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:02:53.757427 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-b66072da-1af1-4a5d-b409-7585cb88d5bc tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] 10.222.0.43 "POST /compute/v2.1/servers/49298a04-d3ab-4bb1-b8ed-ca7db4e028f3/action" status: 404 len: 67 microversion: 2.1 time: 0.471859 Oct 04 22:02:53.761195 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2068/4080] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 22:02:53 2022] POST /compute/v2.1/servers/49298a04-d3ab-4bb1-b8ed-ca7db4e028f3/action => generated 67 bytes in 474 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 22:02:53.779853 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-fa95cf9d-08f7-424d-b07a-db3f306172b0 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:02:53.781853 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-fa95cf9d-08f7-424d-b07a-db3f306172b0 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: 64d56eab-65de-4951-adf0-891f8a39383f] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:02:53.822963 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fa95cf9d-08f7-424d-b07a-db3f306172b0 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:53.823554 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fa95cf9d-08f7-424d-b07a-db3f306172b0 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:53.826162 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fa95cf9d-08f7-424d-b07a-db3f306172b0 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:53.827054 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fa95cf9d-08f7-424d-b07a-db3f306172b0 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:53.831205 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fa95cf9d-08f7-424d-b07a-db3f306172b0 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:53.831931 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fa95cf9d-08f7-424d-b07a-db3f306172b0 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:54.046249 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-fa95cf9d-08f7-424d-b07a-db3f306172b0 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a1c8d841104bc9b6910bcc2c0e2bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe9283584fc4d90b0715216d867ea2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:02:54.078232 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-fa95cf9d-08f7-424d-b07a-db3f306172b0 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "GET /compute/v2.1/servers/64d56eab-65de-4951-adf0-891f8a39383f" status: 200 len: 1275 microversion: 2.1 time: 0.315083 Oct 04 22:02:54.079285 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2069/4081] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:02:53 2022] GET /compute/v2.1/servers/64d56eab-65de-4951-adf0-891f8a39383f => generated 1275 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:02:54.091433 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-39281538-fea4-40d4-bc68-757bf1f49bcc tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:02:54.235151 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-39281538-fea4-40d4-bc68-757bf1f49bcc tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Oct 04 22:02:54.236786 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-39281538-fea4-40d4-bc68-757bf1f49bcc tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Request method failure captured: Oct 04 22:02:54.236786 n-d-860284-1 devstack@n-api.service[134102]: request: POST /compute/v2.1/servers/49298a04-d3ab-4bb1-b8ed-ca7db4e028f3/action HTTP/1.1 Oct 04 22:02:54.236786 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 22:02:54.236786 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 22:02:54.236786 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 22:02:54.236786 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 44 Oct 04 22:02:54.236786 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 22:02:54.236786 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 22:02:54.236786 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 22:02:54.236786 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 22:02:54.236786 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPK1fn4pN4SRD03yYlNRfgQojvW4xOOtDRm4hbQGnNkCBseJuSDBWmCiY80kQRlH0QW_aaGxqmtKoHZTzbu68wwQoxUG1oxsNjeZ3eQqh_3Mjso0ggVp4fT1MxaOeaaW0T9MRExWL6tLg89SP0zzgyW4ymGiY4ahLUviV7WwOEakUGzg Oct 04 22:02:54.236786 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 22:02:54.236786 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 22:02:54.236786 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 22:02:54.236786 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 22:02:54.236786 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 22:02:54.236786 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 22:02:54.236786 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: bad5849b558042d1a5288e8a4443fb53 Oct 04 22:02:54.236786 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-157857634 Oct 04 22:02:54.236786 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 22:02:54.236786 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 22:02:54.236786 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/bad5849b558042d1a5288e8a4443fb53"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_bad5849b558042d1a5288e8a4443fb53", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/bad5849b558042d1a5288e8a4443fb53"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/bad5849b558042d1a5288e8a4443fb53"}]}] Oct 04 22:02:54.236786 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-157857634 Oct 04 22:02:54.236786 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: bad5849b558042d1a5288e8a4443fb53 Oct 04 22:02:54.236786 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-157857634 Oct 04 22:02:54.236786 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project Oct 04 22:02:54.236786 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 22:02:54.236786 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 22:02:54.236786 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: 1f50bbed6deb45e1a2d081745777596c Oct 04 22:02:54.236786 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project Oct 04 22:02:54.236786 n-d-860284-1 devstack@n-api.service[134102]: Oct 04 22:02:54.236786 n-d-860284-1 devstack@n-api.service[134102]: {"removeFloatingIp": {"address": "0.0.0.0"}} Oct 04 22:02:54.236786 n-d-860284-1 devstack@n-api.service[134102]: method: Oct 04 22:02:54.236786 n-d-860284-1 devstack@n-api.service[134102]: exception: Floating IP not found for address 0.0.0.0. Oct 04 22:02:54.236786 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': '49298a04-d3ab-4bb1-b8ed-ca7db4e028f3', 'body': {'removeFloatingIp': {'address': '0.0.0.0'}}} Oct 04 22:02:54.236786 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:02:54.236786 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:02:54.236786 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 58, in get_instance_by_floating_ip_addr Oct 04 22:02:54.236786 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi self.network_api.get_instance_id_by_floating_address( Oct 04 22:02:54.236786 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2927, in get_instance_id_by_floating_address Oct 04 22:02:54.236786 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, address) Oct 04 22:02:54.236786 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Oct 04 22:02:54.236786 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Oct 04 22:02:54.236786 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Oct 04 22:02:54.236786 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:02:54.236786 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:02:54.236786 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:02:54.236786 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:02:54.236786 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:02:54.236786 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:02:54.236786 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:02:54.236786 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:02:54.236786 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 22:02:54.236786 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 22:02:54.236786 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:02:54.236786 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:02:54.236786 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 22:02:54.236786 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 22:02:54.236786 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 277, in _remove_floating_ip Oct 04 22:02:54.236786 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = get_instance_by_floating_ip_addr(self, context, address) Oct 04 22:02:54.236786 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 61, in get_instance_by_floating_ip_addr Oct 04 22:02:54.236786 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=ex.format_message()) Oct 04 22:02:54.240786 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for address 0.0.0.0. Oct 04 22:02:54.240786 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:02:54.240786 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:02:54.240786 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:02:54.240786 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:02:54.240786 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:02:54.240786 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:02:54.240786 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:02:54.240786 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:02:54.240786 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for address 0.0.0.0. Oct 04 22:02:54.240786 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:02:54.240786 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-39281538-fea4-40d4-bc68-757bf1f49bcc tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:02:54.240786 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-39281538-fea4-40d4-bc68-757bf1f49bcc tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] 10.222.0.43 "POST /compute/v2.1/servers/49298a04-d3ab-4bb1-b8ed-ca7db4e028f3/action" status: 404 len: 88 microversion: 2.1 time: 0.157844 Oct 04 22:02:54.240786 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2070/4082] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 22:02:54 2022] POST /compute/v2.1/servers/49298a04-d3ab-4bb1-b8ed-ca7db4e028f3/action => generated 88 bytes in 159 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 22:02:54.244855 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-6778140c-c13d-4b29-b5e8-648476625b9a req-b6887ca7-fee5-489d-9d14-e90cac60d9fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1475392a-475f-414f-803c-e89c9ae1844a", "tag": "8df5b52b-3b39-4a5f-94b6-6b948feabebe"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:02:54.271336 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-6778140c-c13d-4b29-b5e8-648476625b9a req-b6887ca7-fee5-489d-9d14-e90cac60d9fc service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:54.271827 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-6778140c-c13d-4b29-b5e8-648476625b9a req-b6887ca7-fee5-489d-9d14-e90cac60d9fc service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:54.273682 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-6778140c-c13d-4b29-b5e8-648476625b9a req-b6887ca7-fee5-489d-9d14-e90cac60d9fc service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:54.291409 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-6778140c-c13d-4b29-b5e8-648476625b9a req-b6887ca7-fee5-489d-9d14-e90cac60d9fc service nova] Creating event network-changed:8df5b52b-3b39-4a5f-94b6-6b948feabebe for instance 1475392a-475f-414f-803c-e89c9ae1844a on n-h1-860284-1 Oct 04 22:02:54.298984 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-6778140c-c13d-4b29-b5e8-648476625b9a req-b6887ca7-fee5-489d-9d14-e90cac60d9fc service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058837 Oct 04 22:02:54.300004 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2071/4083] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:02:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:02:54.308665 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-f391a632-92ad-4987-a1a4-3f95b357b3e0 tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:02:54.309713 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-f391a632-92ad-4987-a1a4-3f95b357b3e0 tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] [instance: 49298a04-d3ab-4bb1-b8ed-ca7db4e028f3] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:02:54.318775 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f391a632-92ad-4987-a1a4-3f95b357b3e0 tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:54.319902 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f391a632-92ad-4987-a1a4-3f95b357b3e0 tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:54.320817 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f391a632-92ad-4987-a1a4-3f95b357b3e0 tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:54.322801 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f391a632-92ad-4987-a1a4-3f95b357b3e0 tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:54.323671 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f391a632-92ad-4987-a1a4-3f95b357b3e0 tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:54.324413 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f391a632-92ad-4987-a1a4-3f95b357b3e0 tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:54.345293 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-ed9db672-08f0-4987-a7bd-10f22ffc1110 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80fc56886fef422b9b52eb1dede7d10e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82e1a29234ce40f9b37d0eca196cd1db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:02:54.357220 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-ed9db672-08f0-4987-a7bd-10f22ffc1110 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] 10.222.0.43 "GET /compute/v2.1/servers/1475392a-475f-414f-803c-e89c9ae1844a" status: 200 len: 1366 microversion: 2.1 time: 0.770812 Oct 04 22:02:54.372415 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2013/4084] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:02:53 2022] GET /compute/v2.1/servers/1475392a-475f-414f-803c-e89c9ae1844a => generated 1366 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:02:54.385799 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-f391a632-92ad-4987-a1a4-3f95b357b3e0 tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] [instance: 49298a04-d3ab-4bb1-b8ed-ca7db4e028f3] Going to try to terminate instance {{(pid=134102) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 22:02:54.482277 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-81731df8-e970-43ea-9092-74a72a221d2c tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:02:54.483035 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-81731df8-e970-43ea-9092-74a72a221d2c tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] [instance: 3626ed18-d2aa-4ec2-8a06-4e6c76114cfc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:02:54.492321 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-81731df8-e970-43ea-9092-74a72a221d2c tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:54.497220 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-81731df8-e970-43ea-9092-74a72a221d2c tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:54.498049 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-81731df8-e970-43ea-9092-74a72a221d2c tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:54.500385 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-81731df8-e970-43ea-9092-74a72a221d2c tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:54.503482 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-81731df8-e970-43ea-9092-74a72a221d2c tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:54.503946 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-81731df8-e970-43ea-9092-74a72a221d2c tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:54.518182 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-f391a632-92ad-4987-a1a4-3f95b357b3e0 tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] 10.222.0.43 "DELETE /compute/v2.1/servers/49298a04-d3ab-4bb1-b8ed-ca7db4e028f3" status: 204 len: 0 microversion: 2.1 time: 0.216315 Oct 04 22:02:54.519553 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2072/4085] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 22:02:54 2022] DELETE /compute/v2.1/servers/49298a04-d3ab-4bb1-b8ed-ca7db4e028f3 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 22:02:54.544061 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-405165cc-536b-4771-96ae-81b38231174d tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:02:54.544970 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-405165cc-536b-4771-96ae-81b38231174d tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] [instance: 49298a04-d3ab-4bb1-b8ed-ca7db4e028f3] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:02:54.553407 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-405165cc-536b-4771-96ae-81b38231174d tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:54.554092 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-405165cc-536b-4771-96ae-81b38231174d tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:54.554966 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-405165cc-536b-4771-96ae-81b38231174d tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:54.556076 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-405165cc-536b-4771-96ae-81b38231174d tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:54.556859 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-405165cc-536b-4771-96ae-81b38231174d tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:54.557512 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-405165cc-536b-4771-96ae-81b38231174d tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:55.024961 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-81731df8-e970-43ea-9092-74a72a221d2c tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ec630399c5d4231ae3d3975c8370c55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b79bc7a0ba4b3e9415590e7e6b7f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:02:55.036588 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-81731df8-e970-43ea-9092-74a72a221d2c tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] 10.222.0.43 "GET /compute/v2.1/servers/3626ed18-d2aa-4ec2-8a06-4e6c76114cfc" status: 200 len: 1715 microversion: 2.1 time: 0.558782 Oct 04 22:02:55.049522 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2014/4086] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:02:54 2022] GET /compute/v2.1/servers/3626ed18-d2aa-4ec2-8a06-4e6c76114cfc => generated 1715 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:02:55.049843 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-405165cc-536b-4771-96ae-81b38231174d tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f50bbed6deb45e1a2d081745777596c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bad5849b558042d1a5288e8a4443fb53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:02:55.061639 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-405165cc-536b-4771-96ae-81b38231174d tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] 10.222.0.43 "GET /compute/v2.1/servers/49298a04-d3ab-4bb1-b8ed-ca7db4e028f3" status: 200 len: 1541 microversion: 2.1 time: 0.537518 Oct 04 22:02:55.062405 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2073/4087] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:02:54 2022] GET /compute/v2.1/servers/49298a04-d3ab-4bb1-b8ed-ca7db4e028f3 => generated 1541 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:02:55.107318 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-1f1f58bc-c134-42d1-a744-4b7af2d87f0f tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:02:55.108156 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-1f1f58bc-c134-42d1-a744-4b7af2d87f0f tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: 64d56eab-65de-4951-adf0-891f8a39383f] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:02:55.115989 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1f1f58bc-c134-42d1-a744-4b7af2d87f0f tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:55.116745 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1f1f58bc-c134-42d1-a744-4b7af2d87f0f tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:55.117328 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1f1f58bc-c134-42d1-a744-4b7af2d87f0f tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:55.118223 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1f1f58bc-c134-42d1-a744-4b7af2d87f0f tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:55.118898 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1f1f58bc-c134-42d1-a744-4b7af2d87f0f tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:55.119960 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1f1f58bc-c134-42d1-a744-4b7af2d87f0f tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:55.234519 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-1f1f58bc-c134-42d1-a744-4b7af2d87f0f tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a1c8d841104bc9b6910bcc2c0e2bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe9283584fc4d90b0715216d867ea2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:02:55.249485 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-1f1f58bc-c134-42d1-a744-4b7af2d87f0f tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "GET /compute/v2.1/servers/64d56eab-65de-4951-adf0-891f8a39383f" status: 200 len: 1273 microversion: 2.1 time: 0.147608 Oct 04 22:02:55.250712 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2015/4088] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:02:55 2022] GET /compute/v2.1/servers/64d56eab-65de-4951-adf0-891f8a39383f => generated 1273 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:02:55.384927 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-7ddf773c-9825-4dea-8c4f-7d85fc425905 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:02:55.385943 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-7ddf773c-9825-4dea-8c4f-7d85fc425905 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] [instance: 1475392a-475f-414f-803c-e89c9ae1844a] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:02:55.397354 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7ddf773c-9825-4dea-8c4f-7d85fc425905 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:55.397864 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7ddf773c-9825-4dea-8c4f-7d85fc425905 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:55.398437 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7ddf773c-9825-4dea-8c4f-7d85fc425905 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:55.399755 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7ddf773c-9825-4dea-8c4f-7d85fc425905 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:55.400426 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7ddf773c-9825-4dea-8c4f-7d85fc425905 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:55.401128 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7ddf773c-9825-4dea-8c4f-7d85fc425905 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:55.629832 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-7ddf773c-9825-4dea-8c4f-7d85fc425905 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80fc56886fef422b9b52eb1dede7d10e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82e1a29234ce40f9b37d0eca196cd1db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:02:55.640627 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-7ddf773c-9825-4dea-8c4f-7d85fc425905 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] 10.222.0.43 "GET /compute/v2.1/servers/1475392a-475f-414f-803c-e89c9ae1844a" status: 200 len: 1366 microversion: 2.1 time: 0.260669 Oct 04 22:02:55.641784 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2074/4089] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:02:55 2022] GET /compute/v2.1/servers/1475392a-475f-414f-803c-e89c9ae1844a => generated 1366 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:02:56.067011 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-9b5e0ebe-f5cc-4502-895e-fe0dabf45a0c tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:02:56.067629 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-9b5e0ebe-f5cc-4502-895e-fe0dabf45a0c tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] [instance: 3626ed18-d2aa-4ec2-8a06-4e6c76114cfc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:02:56.076328 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:02:56.077983 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9b5e0ebe-f5cc-4502-895e-fe0dabf45a0c tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:56.085436 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-60707549-d1a3-49ad-a8bc-6c2ef3f78f73 tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:02:56.086062 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-60707549-d1a3-49ad-a8bc-6c2ef3f78f73 tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] [instance: 49298a04-d3ab-4bb1-b8ed-ca7db4e028f3] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:02:56.095543 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9b5e0ebe-f5cc-4502-895e-fe0dabf45a0c tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:56.096122 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9b5e0ebe-f5cc-4502-895e-fe0dabf45a0c tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:56.096890 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9b5e0ebe-f5cc-4502-895e-fe0dabf45a0c tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:56.099006 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9b5e0ebe-f5cc-4502-895e-fe0dabf45a0c tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:56.100786 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9b5e0ebe-f5cc-4502-895e-fe0dabf45a0c tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:56.107044 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-60707549-d1a3-49ad-a8bc-6c2ef3f78f73 tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:56.107765 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-60707549-d1a3-49ad-a8bc-6c2ef3f78f73 tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:56.108389 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-60707549-d1a3-49ad-a8bc-6c2ef3f78f73 tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:56.109303 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-60707549-d1a3-49ad-a8bc-6c2ef3f78f73 tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:56.109957 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-60707549-d1a3-49ad-a8bc-6c2ef3f78f73 tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:56.110654 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-60707549-d1a3-49ad-a8bc-6c2ef3f78f73 tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:56.837659 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-9b5e0ebe-f5cc-4502-895e-fe0dabf45a0c tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ec630399c5d4231ae3d3975c8370c55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b79bc7a0ba4b3e9415590e7e6b7f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:02:56.842478 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-60707549-d1a3-49ad-a8bc-6c2ef3f78f73 tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f50bbed6deb45e1a2d081745777596c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bad5849b558042d1a5288e8a4443fb53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:02:56.854512 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-60707549-d1a3-49ad-a8bc-6c2ef3f78f73 tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] 10.222.0.43 "GET /compute/v2.1/servers/49298a04-d3ab-4bb1-b8ed-ca7db4e028f3" status: 200 len: 1541 microversion: 2.1 time: 0.772735 Oct 04 22:02:56.855380 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-9b5e0ebe-f5cc-4502-895e-fe0dabf45a0c tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] 10.222.0.43 "GET /compute/v2.1/servers/3626ed18-d2aa-4ec2-8a06-4e6c76114cfc" status: 200 len: 1715 microversion: 2.1 time: 0.793310 Oct 04 22:02:56.856240 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2075/4090] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:02:56 2022] GET /compute/v2.1/servers/49298a04-d3ab-4bb1-b8ed-ca7db4e028f3 => generated 1541 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:02:56.873217 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-23a493b6-3ad8-4759-b3f4-fdaf090eaa5d tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:02:56.873846 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-23a493b6-3ad8-4759-b3f4-fdaf090eaa5d tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: 64d56eab-65de-4951-adf0-891f8a39383f] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:02:56.877045 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2016/4091] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:02:56 2022] GET /compute/v2.1/servers/3626ed18-d2aa-4ec2-8a06-4e6c76114cfc => generated 1715 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:02:56.896353 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-23a493b6-3ad8-4759-b3f4-fdaf090eaa5d tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:56.897595 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-23a493b6-3ad8-4759-b3f4-fdaf090eaa5d tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:56.898160 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-23a493b6-3ad8-4759-b3f4-fdaf090eaa5d tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:56.902409 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-23a493b6-3ad8-4759-b3f4-fdaf090eaa5d tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:56.902938 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-23a493b6-3ad8-4759-b3f4-fdaf090eaa5d tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:56.903997 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-23a493b6-3ad8-4759-b3f4-fdaf090eaa5d tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:56.922871 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-c83bc9cb-3a66-4d8d-b653-3c0790884b12 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:02:56.924047 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-c83bc9cb-3a66-4d8d-b653-3c0790884b12 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] [instance: 1475392a-475f-414f-803c-e89c9ae1844a] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:02:56.937673 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c83bc9cb-3a66-4d8d-b653-3c0790884b12 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:56.938749 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c83bc9cb-3a66-4d8d-b653-3c0790884b12 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:56.939462 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c83bc9cb-3a66-4d8d-b653-3c0790884b12 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:56.940417 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c83bc9cb-3a66-4d8d-b653-3c0790884b12 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:56.941087 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c83bc9cb-3a66-4d8d-b653-3c0790884b12 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:56.941806 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c83bc9cb-3a66-4d8d-b653-3c0790884b12 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:57.504465 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-c83bc9cb-3a66-4d8d-b653-3c0790884b12 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80fc56886fef422b9b52eb1dede7d10e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82e1a29234ce40f9b37d0eca196cd1db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:02:57.513595 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-23a493b6-3ad8-4759-b3f4-fdaf090eaa5d tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a1c8d841104bc9b6910bcc2c0e2bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe9283584fc4d90b0715216d867ea2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:02:57.522812 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-c83bc9cb-3a66-4d8d-b653-3c0790884b12 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] 10.222.0.43 "GET /compute/v2.1/servers/1475392a-475f-414f-803c-e89c9ae1844a" status: 200 len: 1366 microversion: 2.1 time: 0.642195 Oct 04 22:02:57.525213 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-23a493b6-3ad8-4759-b3f4-fdaf090eaa5d tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "GET /compute/v2.1/servers/64d56eab-65de-4951-adf0-891f8a39383f" status: 200 len: 1315 microversion: 2.1 time: 0.665498 Oct 04 22:02:57.526773 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2017/4092] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:02:56 2022] GET /compute/v2.1/servers/1475392a-475f-414f-803c-e89c9ae1844a => generated 1366 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:02:57.527485 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2076/4093] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:02:56 2022] GET /compute/v2.1/servers/64d56eab-65de-4951-adf0-891f8a39383f => generated 1315 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:02:57.543936 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-f1cc5c16-2c68-48cc-baab-94b2c6bc523b req-3629d621-95e6-4d12-b8e6-b1e47d4dffc7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3626ed18-d2aa-4ec2-8a06-4e6c76114cfc", "name": "network-vif-deleted", "tag": "94b1784b-5d0d-44f6-9098-f3342b1032e0"}, {"server_uuid": "49298a04-d3ab-4bb1-b8ed-ca7db4e028f3", "name": "network-vif-deleted", "tag": "4db0b86a-68bb-4021-8879-799b566c6728"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:02:57.580792 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-f1cc5c16-2c68-48cc-baab-94b2c6bc523b req-3629d621-95e6-4d12-b8e6-b1e47d4dffc7 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:57.581304 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-f1cc5c16-2c68-48cc-baab-94b2c6bc523b req-3629d621-95e6-4d12-b8e6-b1e47d4dffc7 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:57.589019 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-f1cc5c16-2c68-48cc-baab-94b2c6bc523b req-3629d621-95e6-4d12-b8e6-b1e47d4dffc7 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:57.611001 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-f1cc5c16-2c68-48cc-baab-94b2c6bc523b req-3629d621-95e6-4d12-b8e6-b1e47d4dffc7 service nova] Creating event network-vif-deleted:94b1784b-5d0d-44f6-9098-f3342b1032e0 for instance 3626ed18-d2aa-4ec2-8a06-4e6c76114cfc on n-h2-860284-1 Oct 04 22:02:57.611451 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-f1cc5c16-2c68-48cc-baab-94b2c6bc523b req-3629d621-95e6-4d12-b8e6-b1e47d4dffc7 service nova] Creating event network-vif-deleted:4db0b86a-68bb-4021-8879-799b566c6728 for instance 49298a04-d3ab-4bb1-b8ed-ca7db4e028f3 on n-h2-860284-1 Oct 04 22:02:57.638870 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-f1cc5c16-2c68-48cc-baab-94b2c6bc523b req-3629d621-95e6-4d12-b8e6-b1e47d4dffc7 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.100948 Oct 04 22:02:57.639731 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2018/4094] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:02:57 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:02:57.881030 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-fa14c13e-2742-461c-834f-529278ca6eb3 tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:02:57.881768 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-fa14c13e-2742-461c-834f-529278ca6eb3 tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] [instance: 3626ed18-d2aa-4ec2-8a06-4e6c76114cfc] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:02:57.883918 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e4479d04-cc9e-4d4f-9213-1c2fa2f20b12 tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:02:57.884789 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-e4479d04-cc9e-4d4f-9213-1c2fa2f20b12 tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] [instance: 49298a04-d3ab-4bb1-b8ed-ca7db4e028f3] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:02:57.895905 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fa14c13e-2742-461c-834f-529278ca6eb3 tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:57.896417 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fa14c13e-2742-461c-834f-529278ca6eb3 tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:57.896863 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fa14c13e-2742-461c-834f-529278ca6eb3 tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:57.897054 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e4479d04-cc9e-4d4f-9213-1c2fa2f20b12 tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:57.897587 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fa14c13e-2742-461c-834f-529278ca6eb3 tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:57.898044 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fa14c13e-2742-461c-834f-529278ca6eb3 tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:57.898420 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e4479d04-cc9e-4d4f-9213-1c2fa2f20b12 tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:57.898549 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fa14c13e-2742-461c-834f-529278ca6eb3 tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:57.900187 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e4479d04-cc9e-4d4f-9213-1c2fa2f20b12 tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:57.901097 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e4479d04-cc9e-4d4f-9213-1c2fa2f20b12 tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:57.905462 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e4479d04-cc9e-4d4f-9213-1c2fa2f20b12 tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:57.906086 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e4479d04-cc9e-4d4f-9213-1c2fa2f20b12 tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:57.985463 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fa14c13e-2742-461c-834f-529278ca6eb3 tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:57.985963 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fa14c13e-2742-461c-834f-529278ca6eb3 tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:57.986423 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fa14c13e-2742-461c-834f-529278ca6eb3 tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:57.986939 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.objects.instance [None req-fa14c13e-2742-461c-834f-529278ca6eb3 tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Lazy-loading 'fault' on Instance uuid 3626ed18-d2aa-4ec2-8a06-4e6c76114cfc {{(pid=134102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 22:02:57.991914 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e4479d04-cc9e-4d4f-9213-1c2fa2f20b12 tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:57.992400 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e4479d04-cc9e-4d4f-9213-1c2fa2f20b12 tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:57.992870 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e4479d04-cc9e-4d4f-9213-1c2fa2f20b12 tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:57.993324 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.objects.instance [None req-e4479d04-cc9e-4d4f-9213-1c2fa2f20b12 tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Lazy-loading 'fault' on Instance uuid 49298a04-d3ab-4bb1-b8ed-ca7db4e028f3 {{(pid=134101) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 22:02:58.319705 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-e4479d04-cc9e-4d4f-9213-1c2fa2f20b12 tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f50bbed6deb45e1a2d081745777596c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bad5849b558042d1a5288e8a4443fb53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:02:58.334899 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-e4479d04-cc9e-4d4f-9213-1c2fa2f20b12 tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] 10.222.0.43 "GET /compute/v2.1/servers/49298a04-d3ab-4bb1-b8ed-ca7db4e028f3" status: 200 len: 1321 microversion: 2.1 time: 0.455415 Oct 04 22:02:58.345462 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2019/4095] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:02:57 2022] GET /compute/v2.1/servers/49298a04-d3ab-4bb1-b8ed-ca7db4e028f3 => generated 1321 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:02:58.381755 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-fa14c13e-2742-461c-834f-529278ca6eb3 tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ec630399c5d4231ae3d3975c8370c55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b79bc7a0ba4b3e9415590e7e6b7f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:02:58.395490 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-fa14c13e-2742-461c-834f-529278ca6eb3 tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] 10.222.0.43 "GET /compute/v2.1/servers/3626ed18-d2aa-4ec2-8a06-4e6c76114cfc" status: 200 len: 1367 microversion: 2.1 time: 0.518469 Oct 04 22:02:58.396125 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2077/4096] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:02:57 2022] GET /compute/v2.1/servers/3626ed18-d2aa-4ec2-8a06-4e6c76114cfc => generated 1367 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:02:58.551603 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-a9e21010-78a8-481b-8c09-d3e16788ba95 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:02:58.553096 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-a9e21010-78a8-481b-8c09-d3e16788ba95 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] [instance: 1475392a-475f-414f-803c-e89c9ae1844a] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:02:58.558721 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-44039ee5-a079-4abd-a456-947f08266be0 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:02:58.559355 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-44039ee5-a079-4abd-a456-947f08266be0 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: 64d56eab-65de-4951-adf0-891f8a39383f] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:02:58.567746 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a9e21010-78a8-481b-8c09-d3e16788ba95 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:58.573553 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a9e21010-78a8-481b-8c09-d3e16788ba95 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:58.575524 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a9e21010-78a8-481b-8c09-d3e16788ba95 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:58.580743 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a9e21010-78a8-481b-8c09-d3e16788ba95 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:58.581402 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-44039ee5-a079-4abd-a456-947f08266be0 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:58.581929 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-44039ee5-a079-4abd-a456-947f08266be0 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:58.582356 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-44039ee5-a079-4abd-a456-947f08266be0 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:58.583115 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-44039ee5-a079-4abd-a456-947f08266be0 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:58.583554 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a9e21010-78a8-481b-8c09-d3e16788ba95 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:58.583664 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-44039ee5-a079-4abd-a456-947f08266be0 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:58.584315 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a9e21010-78a8-481b-8c09-d3e16788ba95 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:58.589348 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-44039ee5-a079-4abd-a456-947f08266be0 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:58.939521 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-44039ee5-a079-4abd-a456-947f08266be0 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a1c8d841104bc9b6910bcc2c0e2bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe9283584fc4d90b0715216d867ea2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:02:58.953371 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-a9e21010-78a8-481b-8c09-d3e16788ba95 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80fc56886fef422b9b52eb1dede7d10e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82e1a29234ce40f9b37d0eca196cd1db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:02:58.957060 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-44039ee5-a079-4abd-a456-947f08266be0 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "GET /compute/v2.1/servers/64d56eab-65de-4951-adf0-891f8a39383f" status: 200 len: 1315 microversion: 2.1 time: 0.403114 Oct 04 22:02:58.957896 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2078/4097] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:02:58 2022] GET /compute/v2.1/servers/64d56eab-65de-4951-adf0-891f8a39383f => generated 1315 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:02:58.980436 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-a9e21010-78a8-481b-8c09-d3e16788ba95 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] 10.222.0.43 "GET /compute/v2.1/servers/1475392a-475f-414f-803c-e89c9ae1844a" status: 200 len: 1366 microversion: 2.1 time: 0.432855 Oct 04 22:02:58.981331 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2020/4098] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:02:58 2022] GET /compute/v2.1/servers/1475392a-475f-414f-803c-e89c9ae1844a => generated 1366 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:02:59.368736 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-16496543-ef2b-41e0-874a-e3d215fe27da tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:02:59.369693 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-16496543-ef2b-41e0-874a-e3d215fe27da tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] [instance: 49298a04-d3ab-4bb1-b8ed-ca7db4e028f3] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:02:59.373057 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell0:SELECT=8 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:02:59.384252 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-16496543-ef2b-41e0-874a-e3d215fe27da tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:59.387573 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-16496543-ef2b-41e0-874a-e3d215fe27da tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:59.388725 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-16496543-ef2b-41e0-874a-e3d215fe27da tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:59.391312 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-16496543-ef2b-41e0-874a-e3d215fe27da tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:59.394248 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-16496543-ef2b-41e0-874a-e3d215fe27da tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:59.394963 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-16496543-ef2b-41e0-874a-e3d215fe27da tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:59.416489 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell0:SELECT=24 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:02:59.423369 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-d2690c02-8900-41cc-9e0e-36f6b8102430 tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:02:59.425522 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-d2690c02-8900-41cc-9e0e-36f6b8102430 tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] [instance: 3626ed18-d2aa-4ec2-8a06-4e6c76114cfc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:02:59.445663 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d2690c02-8900-41cc-9e0e-36f6b8102430 tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:59.446583 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d2690c02-8900-41cc-9e0e-36f6b8102430 tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:59.459082 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d2690c02-8900-41cc-9e0e-36f6b8102430 tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:59.460205 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d2690c02-8900-41cc-9e0e-36f6b8102430 tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:59.460886 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d2690c02-8900-41cc-9e0e-36f6b8102430 tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:59.462058 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d2690c02-8900-41cc-9e0e-36f6b8102430 tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:59.465385 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-16496543-ef2b-41e0-874a-e3d215fe27da tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] HTTP exception thrown: Instance 49298a04-d3ab-4bb1-b8ed-ca7db4e028f3 could not be found. Oct 04 22:02:59.467454 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-16496543-ef2b-41e0-874a-e3d215fe27da tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Request method failure captured: Oct 04 22:02:59.467454 n-d-860284-1 devstack@n-api.service[134102]: request: GET /compute/v2.1/servers/49298a04-d3ab-4bb1-b8ed-ca7db4e028f3 HTTP/1.1 Oct 04 22:02:59.467454 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 22:02:59.467454 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 22:02:59.467454 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 22:02:59.467454 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 22:02:59.467454 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 22:02:59.467454 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 22:02:59.467454 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 22:02:59.467454 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 22:02:59.467454 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPK1fn4pN4SRD03yYlNRfgQojvW4xOOtDRm4hbQGnNkCBseJuSDBWmCiY80kQRlH0QW_aaGxqmtKoHZTzbu68wwQoxUG1oxsNjeZ3eQqh_3Mjso0ggVp4fT1MxaOeaaW0T9MRExWL6tLg89SP0zzgyW4ymGiY4ahLUviV7WwOEakUGzg Oct 04 22:02:59.467454 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 22:02:59.467454 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 22:02:59.467454 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 22:02:59.467454 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 22:02:59.467454 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 22:02:59.467454 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 22:02:59.467454 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: bad5849b558042d1a5288e8a4443fb53 Oct 04 22:02:59.467454 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-157857634 Oct 04 22:02:59.467454 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 22:02:59.467454 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 22:02:59.467454 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/bad5849b558042d1a5288e8a4443fb53"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_bad5849b558042d1a5288e8a4443fb53", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/bad5849b558042d1a5288e8a4443fb53"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/bad5849b558042d1a5288e8a4443fb53"}]}] Oct 04 22:02:59.467454 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-157857634 Oct 04 22:02:59.467454 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: bad5849b558042d1a5288e8a4443fb53 Oct 04 22:02:59.467454 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-157857634 Oct 04 22:02:59.467454 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project Oct 04 22:02:59.467454 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 22:02:59.467454 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 22:02:59.467454 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: 1f50bbed6deb45e1a2d081745777596c Oct 04 22:02:59.467454 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project Oct 04 22:02:59.467454 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 22:02:59.467454 n-d-860284-1 devstack@n-api.service[134102]: exception: Instance 49298a04-d3ab-4bb1-b8ed-ca7db4e028f3 could not be found. Oct 04 22:02:59.467454 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': '49298a04-d3ab-4bb1-b8ed-ca7db4e028f3'} Oct 04 22:02:59.467454 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:02:59.467454 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:02:59.467454 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:02:59.467454 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:02:59.467454 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:02:59.467454 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:02:59.467454 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:02:59.467454 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:02:59.467454 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:02:59.467454 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:02:59.467454 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49298a04-d3ab-4bb1-b8ed-ca7db4e028f3 could not be found. Oct 04 22:02:59.467454 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:02:59.467454 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:02:59.467454 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:02:59.467454 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:02:59.467454 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:02:59.467454 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:02:59.467454 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:02:59.467454 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:02:59.467454 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:02:59.467454 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:02:59.467454 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:02:59.467454 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:02:59.467454 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:02:59.467454 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:02:59.467454 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:02:59.467454 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:02:59.467454 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49298a04-d3ab-4bb1-b8ed-ca7db4e028f3 could not be found. Oct 04 22:02:59.467454 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:02:59.471885 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:02:59.471885 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:02:59.471885 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:02:59.471885 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:02:59.471885 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:02:59.471885 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:02:59.471885 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:02:59.471885 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49298a04-d3ab-4bb1-b8ed-ca7db4e028f3 could not be found. Oct 04 22:02:59.471885 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:02:59.471885 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-16496543-ef2b-41e0-874a-e3d215fe27da tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] Returning 404 to user: Instance 49298a04-d3ab-4bb1-b8ed-ca7db4e028f3 could not be found. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:02:59.471885 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-16496543-ef2b-41e0-874a-e3d215fe27da tempest-FloatingIPsAssociationNegativeTestJSON-157857634 tempest-FloatingIPsAssociationNegativeTestJSON-157857634-project] 10.222.0.43 "GET /compute/v2.1/servers/49298a04-d3ab-4bb1-b8ed-ca7db4e028f3" status: 404 len: 111 microversion: 2.1 time: 0.105304 Oct 04 22:02:59.471885 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2079/4099] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:02:59 2022] GET /compute/v2.1/servers/49298a04-d3ab-4bb1-b8ed-ca7db4e028f3 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 22:02:59.489099 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-d2690c02-8900-41cc-9e0e-36f6b8102430 tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] HTTP exception thrown: Instance 3626ed18-d2aa-4ec2-8a06-4e6c76114cfc could not be found. Oct 04 22:02:59.492808 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-d2690c02-8900-41cc-9e0e-36f6b8102430 tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Request method failure captured: Oct 04 22:02:59.492808 n-d-860284-1 devstack@n-api.service[134101]: request: GET /compute/v2.1/servers/3626ed18-d2aa-4ec2-8a06-4e6c76114cfc HTTP/1.1 Oct 04 22:02:59.492808 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 22:02:59.492808 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 22:02:59.492808 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 22:02:59.492808 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 22:02:59.492808 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 22:02:59.492808 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 22:02:59.492808 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 22:02:59.492808 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 22:02:59.492808 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPK0Zy_2tRaAooIYJgXEwmIymgRqw-TPG7sufIyiDyHZVG_dJRgP_OJEeIoMmz1gNzoO_-Ia74suCtayhifii9N7vB_3Gi9vc6_QLIaJ26ebhkxfe_-Co9miLxp-1H34eXUehrGw2Wulkzty9BgwvobRNL6KrFaDIXZLX6kS8ATGENrk Oct 04 22:02:59.492808 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 22:02:59.492808 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 22:02:59.492808 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 22:02:59.492808 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 22:02:59.492808 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 22:02:59.492808 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 22:02:59.492808 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: 49b79bc7a0ba4b3e9415590e7e6b7f02 Oct 04 22:02:59.492808 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-ServersTestManualDisk-394032521 Oct 04 22:02:59.492808 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 22:02:59.492808 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 22:02:59.492808 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/49b79bc7a0ba4b3e9415590e7e6b7f02"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_49b79bc7a0ba4b3e9415590e7e6b7f02", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/49b79bc7a0ba4b3e9415590e7e6b7f02"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/49b79bc7a0ba4b3e9415590e7e6b7f02"}]}] Oct 04 22:02:59.492808 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-ServersTestManualDisk-394032521 Oct 04 22:02:59.492808 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: 49b79bc7a0ba4b3e9415590e7e6b7f02 Oct 04 22:02:59.492808 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-ServersTestManualDisk-394032521 Oct 04 22:02:59.492808 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-ServersTestManualDisk-394032521-project Oct 04 22:02:59.492808 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 22:02:59.492808 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 22:02:59.492808 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 8ec630399c5d4231ae3d3975c8370c55 Oct 04 22:02:59.492808 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-ServersTestManualDisk-394032521-project Oct 04 22:02:59.492808 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 22:02:59.492808 n-d-860284-1 devstack@n-api.service[134101]: exception: Instance 3626ed18-d2aa-4ec2-8a06-4e6c76114cfc could not be found. Oct 04 22:02:59.492808 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': '3626ed18-d2aa-4ec2-8a06-4e6c76114cfc'} Oct 04 22:02:59.492808 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:02:59.492808 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:02:59.492808 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:02:59.492808 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:02:59.492808 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:02:59.492808 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:02:59.492808 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:02:59.492808 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:02:59.492808 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:02:59.492808 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:02:59.492808 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3626ed18-d2aa-4ec2-8a06-4e6c76114cfc could not be found. Oct 04 22:02:59.492808 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:02:59.492808 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:02:59.492808 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:02:59.492808 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:02:59.492808 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:02:59.492808 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:02:59.492808 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:02:59.492808 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:02:59.492808 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:02:59.492808 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:02:59.492808 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:02:59.492808 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:02:59.492808 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:02:59.492808 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:02:59.492808 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:02:59.492808 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:02:59.492808 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3626ed18-d2aa-4ec2-8a06-4e6c76114cfc could not be found. Oct 04 22:02:59.492808 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:02:59.492808 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:02:59.492808 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:02:59.497350 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:02:59.497350 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:02:59.497350 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:02:59.497350 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:02:59.497350 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:02:59.497350 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3626ed18-d2aa-4ec2-8a06-4e6c76114cfc could not be found. Oct 04 22:02:59.497350 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:02:59.500722 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-d2690c02-8900-41cc-9e0e-36f6b8102430 tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Returning 404 to user: Instance 3626ed18-d2aa-4ec2-8a06-4e6c76114cfc could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:02:59.501840 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-d2690c02-8900-41cc-9e0e-36f6b8102430 tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] 10.222.0.43 "GET /compute/v2.1/servers/3626ed18-d2aa-4ec2-8a06-4e6c76114cfc" status: 404 len: 111 microversion: 2.1 time: 0.082746 Oct 04 22:02:59.503959 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2021/4100] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:02:59 2022] GET /compute/v2.1/servers/3626ed18-d2aa-4ec2-8a06-4e6c76114cfc => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 22:02:59.512547 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-3990ed09-8637-4802-ad87-ad52b4817b38 tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] Calling method '.version_select at 0x7fbb2e6b8700>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:02:59.557643 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-3990ed09-8637-4802-ad87-ad52b4817b38 tempest-ServersTestManualDisk-394032521 tempest-ServersTestManualDisk-394032521-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1713464007" status: 202 len: 0 microversion: 2.1 time: 0.048819 Oct 04 22:02:59.558496 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2080/4101] 10.222.0.43 () {58 vars in 1221 bytes} [Tue Oct 4 22:02:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1713464007 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 22:02:59.980433 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-40f69ee2-9bc7-4bf5-888b-b0c1f4cdfde7 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:02:59.981047 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-40f69ee2-9bc7-4bf5-888b-b0c1f4cdfde7 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: 64d56eab-65de-4951-adf0-891f8a39383f] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:02:59.992190 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-40f69ee2-9bc7-4bf5-888b-b0c1f4cdfde7 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:59.992696 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-40f69ee2-9bc7-4bf5-888b-b0c1f4cdfde7 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:59.993173 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-40f69ee2-9bc7-4bf5-888b-b0c1f4cdfde7 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:59.993880 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-40f69ee2-9bc7-4bf5-888b-b0c1f4cdfde7 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:00.003371 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-40f69ee2-9bc7-4bf5-888b-b0c1f4cdfde7 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:00.003852 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-40f69ee2-9bc7-4bf5-888b-b0c1f4cdfde7 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:00.008064 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-799bfb76-c8eb-4f2f-a6d4-b58f8a8b761d tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:00.008898 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-799bfb76-c8eb-4f2f-a6d4-b58f8a8b761d tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] [instance: 1475392a-475f-414f-803c-e89c9ae1844a] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:03:00.022112 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-799bfb76-c8eb-4f2f-a6d4-b58f8a8b761d tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:00.026593 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-799bfb76-c8eb-4f2f-a6d4-b58f8a8b761d tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:00.027107 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-799bfb76-c8eb-4f2f-a6d4-b58f8a8b761d tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:00.030527 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-799bfb76-c8eb-4f2f-a6d4-b58f8a8b761d tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:00.031318 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-799bfb76-c8eb-4f2f-a6d4-b58f8a8b761d tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:00.035273 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-799bfb76-c8eb-4f2f-a6d4-b58f8a8b761d tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:00.704764 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-40f69ee2-9bc7-4bf5-888b-b0c1f4cdfde7 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a1c8d841104bc9b6910bcc2c0e2bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe9283584fc4d90b0715216d867ea2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:00.718220 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-40f69ee2-9bc7-4bf5-888b-b0c1f4cdfde7 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "GET /compute/v2.1/servers/64d56eab-65de-4951-adf0-891f8a39383f" status: 200 len: 1315 microversion: 2.1 time: 0.742124 Oct 04 22:03:00.719058 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2022/4102] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:02:59 2022] GET /compute/v2.1/servers/64d56eab-65de-4951-adf0-891f8a39383f => generated 1315 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:03:00.728641 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-64da05a2-a924-4310-9983-650dab10d506 req-716a4e7b-5a84-42d1-9697-092e53bcbb7f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64d56eab-65de-4951-adf0-891f8a39383f", "tag": "8b4a4ef4-3ab7-4920-b49c-999ef579490d"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:03:00.756176 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-64da05a2-a924-4310-9983-650dab10d506 req-716a4e7b-5a84-42d1-9697-092e53bcbb7f service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:00.765766 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-64da05a2-a924-4310-9983-650dab10d506 req-716a4e7b-5a84-42d1-9697-092e53bcbb7f service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:00.767038 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-64da05a2-a924-4310-9983-650dab10d506 req-716a4e7b-5a84-42d1-9697-092e53bcbb7f service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:00.799072 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-799bfb76-c8eb-4f2f-a6d4-b58f8a8b761d tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80fc56886fef422b9b52eb1dede7d10e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82e1a29234ce40f9b37d0eca196cd1db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:00.814859 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-799bfb76-c8eb-4f2f-a6d4-b58f8a8b761d tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] 10.222.0.43 "GET /compute/v2.1/servers/1475392a-475f-414f-803c-e89c9ae1844a" status: 200 len: 1366 microversion: 2.1 time: 0.811003 Oct 04 22:03:00.815736 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2081/4103] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:03:00 2022] GET /compute/v2.1/servers/1475392a-475f-414f-803c-e89c9ae1844a => generated 1366 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:03:00.829503 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-64da05a2-a924-4310-9983-650dab10d506 req-716a4e7b-5a84-42d1-9697-092e53bcbb7f service nova] Creating event network-changed:8b4a4ef4-3ab7-4920-b49c-999ef579490d for instance 64d56eab-65de-4951-adf0-891f8a39383f on n-h1-860284-1 Oct 04 22:03:00.857117 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-64da05a2-a924-4310-9983-650dab10d506 req-716a4e7b-5a84-42d1-9697-092e53bcbb7f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.129860 Oct 04 22:03:00.858699 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2023/4104] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:03:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:03:01.226626 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-77d7d85b-ff01-4ed2-8bdf-e696988e866c req-df38eaf8-5330-47a6-810d-8f7ccad19eb6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1475392a-475f-414f-803c-e89c9ae1844a", "name": "network-vif-plugged", "status": "completed", "tag": "8df5b52b-3b39-4a5f-94b6-6b948feabebe"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:03:01.261860 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-531d46b2-d617-4c4e-aea9-83b90cfda8db tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-816538895", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452", "networks": [{"uuid": "a8b347c4-c6ad-4a61-a42c-389e7a6763a0"}]}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:03:01.268727 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-77d7d85b-ff01-4ed2-8bdf-e696988e866c req-df38eaf8-5330-47a6-810d-8f7ccad19eb6 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:01.270685 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-77d7d85b-ff01-4ed2-8bdf-e696988e866c req-df38eaf8-5330-47a6-810d-8f7ccad19eb6 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:01.271145 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-77d7d85b-ff01-4ed2-8bdf-e696988e866c req-df38eaf8-5330-47a6-810d-8f7ccad19eb6 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:01.303283 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-77d7d85b-ff01-4ed2-8bdf-e696988e866c req-df38eaf8-5330-47a6-810d-8f7ccad19eb6 service nova] Creating event network-vif-plugged:8df5b52b-3b39-4a5f-94b6-6b948feabebe for instance 1475392a-475f-414f-803c-e89c9ae1844a on n-h1-860284-1 Oct 04 22:03:01.313388 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-77d7d85b-ff01-4ed2-8bdf-e696988e866c req-df38eaf8-5330-47a6-810d-8f7ccad19eb6 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091719 Oct 04 22:03:01.315378 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2024/4105] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:03:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:03:01.373666 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.network.neutron [None req-531d46b2-d617-4c4e-aea9-83b90cfda8db tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] validate_networks() for [('a8b347c4-c6ad-4a61-a42c-389e7a6763a0', None, None, None, None, None)] {{(pid=134102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 22:03:01.747233 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-7c6e88ce-ce88-4a89-8f32-3213eb9c2f17 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:01.748327 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-7c6e88ce-ce88-4a89-8f32-3213eb9c2f17 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: 64d56eab-65de-4951-adf0-891f8a39383f] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:03:01.775909 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7c6e88ce-ce88-4a89-8f32-3213eb9c2f17 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:01.777032 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7c6e88ce-ce88-4a89-8f32-3213eb9c2f17 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:01.777682 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7c6e88ce-ce88-4a89-8f32-3213eb9c2f17 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:01.778649 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7c6e88ce-ce88-4a89-8f32-3213eb9c2f17 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:01.779504 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7c6e88ce-ce88-4a89-8f32-3213eb9c2f17 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:01.780180 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7c6e88ce-ce88-4a89-8f32-3213eb9c2f17 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:01.851081 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=2 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:03:02.453556 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-531d46b2-d617-4c4e-aea9-83b90cfda8db tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Flavor limits 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 22:03:02.455175 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-531d46b2-d617-4c4e-aea9-83b90cfda8db tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Image limits 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 22:03:02.455919 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-531d46b2-d617-4c4e-aea9-83b90cfda8db tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Flavor pref 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 22:03:02.457072 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-531d46b2-d617-4c4e-aea9-83b90cfda8db tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Image pref 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 22:03:02.457894 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-531d46b2-d617-4c4e-aea9-83b90cfda8db tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 22:03:02.471584 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-531d46b2-d617-4c4e-aea9-83b90cfda8db tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:02.472577 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-531d46b2-d617-4c4e-aea9-83b90cfda8db tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:02.473251 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-531d46b2-d617-4c4e-aea9-83b90cfda8db tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:02.474758 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-531d46b2-d617-4c4e-aea9-83b90cfda8db tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:02.475504 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-531d46b2-d617-4c4e-aea9-83b90cfda8db tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:02.476151 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-531d46b2-d617-4c4e-aea9-83b90cfda8db tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:02.483713 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-7c6e88ce-ce88-4a89-8f32-3213eb9c2f17 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a1c8d841104bc9b6910bcc2c0e2bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe9283584fc4d90b0715216d867ea2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:02.494842 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-7c6e88ce-ce88-4a89-8f32-3213eb9c2f17 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "GET /compute/v2.1/servers/64d56eab-65de-4951-adf0-891f8a39383f" status: 200 len: 1315 microversion: 2.1 time: 0.754249 Oct 04 22:03:02.498660 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2025/4106] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:03:01 2022] GET /compute/v2.1/servers/64d56eab-65de-4951-adf0-891f8a39383f => generated 1315 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:03:02.514429 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-b8b3de9a-1c8d-4211-b594-fa50a14f21de tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:02.523499 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-531d46b2-d617-4c4e-aea9-83b90cfda8db tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Getting quotas for project fba14e6816284d9e89e22913643f4355. Resources: {'instances', 'ram', 'cores'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:03:02.524783 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-b8b3de9a-1c8d-4211-b594-fa50a14f21de tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] [instance: 1475392a-475f-414f-803c-e89c9ae1844a] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:03:02.535998 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-531d46b2-d617-4c4e-aea9-83b90cfda8db tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Getting quotas for user 9f46a71ea0ee4e45afaea7e38e8c0ddd and project fba14e6816284d9e89e22913643f4355. Resources: {'instances', 'ram', 'cores'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:03:02.540016 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b8b3de9a-1c8d-4211-b594-fa50a14f21de tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:02.540728 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b8b3de9a-1c8d-4211-b594-fa50a14f21de tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:02.541350 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b8b3de9a-1c8d-4211-b594-fa50a14f21de tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:02.547763 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b8b3de9a-1c8d-4211-b594-fa50a14f21de tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:02.548480 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b8b3de9a-1c8d-4211-b594-fa50a14f21de tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:02.550594 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b8b3de9a-1c8d-4211-b594-fa50a14f21de tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:02.606101 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-531d46b2-d617-4c4e-aea9-83b90cfda8db tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Going to run 1 instances... {{(pid=134102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 22:03:02.620795 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-531d46b2-d617-4c4e-aea9-83b90cfda8db tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] [instance: 07e11885-b7b0-4ad1-bda6-a677b9aaf48d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='58548514-5dac-426c-81f5-19e3fba33e23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 22:03:02.721487 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=8 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:03:02.756083 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-531d46b2-d617-4c4e-aea9-83b90cfda8db tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.937248 Oct 04 22:03:02.769452 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2082/4107] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 22:03:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 1951 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 22:03:02.855797 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-b837b3bf-d1a9-4f38-ae3a-16e15974bd2a tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-721711420", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452", "networks": [{"uuid": "a8b347c4-c6ad-4a61-a42c-389e7a6763a0"}]}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:03:02.978911 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.network.neutron [None req-b837b3bf-d1a9-4f38-ae3a-16e15974bd2a tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] validate_networks() for [('a8b347c4-c6ad-4a61-a42c-389e7a6763a0', None, None, None, None, None)] {{(pid=134102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 22:03:04.245891 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-b8b3de9a-1c8d-4211-b594-fa50a14f21de tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80fc56886fef422b9b52eb1dede7d10e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82e1a29234ce40f9b37d0eca196cd1db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:04.261519 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-b8b3de9a-1c8d-4211-b594-fa50a14f21de tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] 10.222.0.43 "GET /compute/v2.1/servers/1475392a-475f-414f-803c-e89c9ae1844a" status: 200 len: 1366 microversion: 2.1 time: 1.761105 Oct 04 22:03:04.283665 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2026/4108] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:03:02 2022] GET /compute/v2.1/servers/1475392a-475f-414f-803c-e89c9ae1844a => generated 1366 bytes in 1784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:03:04.321801 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-ea4e901b-a703-4140-a5bc-8f26f12b72f5 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:04.322905 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-ea4e901b-a703-4140-a5bc-8f26f12b72f5 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: 64d56eab-65de-4951-adf0-891f8a39383f] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:03:04.363137 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ea4e901b-a703-4140-a5bc-8f26f12b72f5 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:04.363840 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ea4e901b-a703-4140-a5bc-8f26f12b72f5 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:04.364447 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ea4e901b-a703-4140-a5bc-8f26f12b72f5 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:04.366259 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ea4e901b-a703-4140-a5bc-8f26f12b72f5 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:04.371393 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ea4e901b-a703-4140-a5bc-8f26f12b72f5 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:04.372051 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ea4e901b-a703-4140-a5bc-8f26f12b72f5 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:04.876110 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-ea4e901b-a703-4140-a5bc-8f26f12b72f5 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a1c8d841104bc9b6910bcc2c0e2bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe9283584fc4d90b0715216d867ea2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:04.884598 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-ea4e901b-a703-4140-a5bc-8f26f12b72f5 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "GET /compute/v2.1/servers/64d56eab-65de-4951-adf0-891f8a39383f" status: 200 len: 1315 microversion: 2.1 time: 0.598674 Oct 04 22:03:04.887516 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2027/4109] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:03:04 2022] GET /compute/v2.1/servers/64d56eab-65de-4951-adf0-891f8a39383f => generated 1315 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:03:05.289372 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-3753796b-f524-4e8b-936a-788f6711f6e3 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:05.291291 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-3753796b-f524-4e8b-936a-788f6711f6e3 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] [instance: 1475392a-475f-414f-803c-e89c9ae1844a] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:03:05.305990 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3753796b-f524-4e8b-936a-788f6711f6e3 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:05.306606 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3753796b-f524-4e8b-936a-788f6711f6e3 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:05.307208 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3753796b-f524-4e8b-936a-788f6711f6e3 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:05.314490 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3753796b-f524-4e8b-936a-788f6711f6e3 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:05.315222 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3753796b-f524-4e8b-936a-788f6711f6e3 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:05.315895 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3753796b-f524-4e8b-936a-788f6711f6e3 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:05.478533 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-b837b3bf-d1a9-4f38-ae3a-16e15974bd2a tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Flavor limits 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 22:03:05.479829 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-b837b3bf-d1a9-4f38-ae3a-16e15974bd2a tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Image limits 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 22:03:05.480637 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-b837b3bf-d1a9-4f38-ae3a-16e15974bd2a tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Flavor pref 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 22:03:05.481212 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-b837b3bf-d1a9-4f38-ae3a-16e15974bd2a tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Image pref 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 22:03:05.482281 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-b837b3bf-d1a9-4f38-ae3a-16e15974bd2a tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 22:03:05.510676 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b837b3bf-d1a9-4f38-ae3a-16e15974bd2a tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:05.521897 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b837b3bf-d1a9-4f38-ae3a-16e15974bd2a tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:05.523308 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b837b3bf-d1a9-4f38-ae3a-16e15974bd2a tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:05.527506 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b837b3bf-d1a9-4f38-ae3a-16e15974bd2a tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:05.530144 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b837b3bf-d1a9-4f38-ae3a-16e15974bd2a tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:05.531817 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b837b3bf-d1a9-4f38-ae3a-16e15974bd2a tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:05.572328 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:03:05.628417 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-b837b3bf-d1a9-4f38-ae3a-16e15974bd2a tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Getting quotas for project fba14e6816284d9e89e22913643f4355. Resources: {'instances', 'ram', 'cores'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:03:05.663616 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-b837b3bf-d1a9-4f38-ae3a-16e15974bd2a tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Getting quotas for user 9f46a71ea0ee4e45afaea7e38e8c0ddd and project fba14e6816284d9e89e22913643f4355. Resources: {'instances', 'ram', 'cores'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:03:05.715826 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-b837b3bf-d1a9-4f38-ae3a-16e15974bd2a tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Going to run 1 instances... {{(pid=134102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 22:03:05.718090 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-b837b3bf-d1a9-4f38-ae3a-16e15974bd2a tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] [instance: 27f6babc-9d2c-4ba8-8043-cd2d90f9ba7e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='58548514-5dac-426c-81f5-19e3fba33e23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 22:03:05.749490 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-3753796b-f524-4e8b-936a-788f6711f6e3 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80fc56886fef422b9b52eb1dede7d10e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82e1a29234ce40f9b37d0eca196cd1db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:05.769434 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-3753796b-f524-4e8b-936a-788f6711f6e3 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] 10.222.0.43 "GET /compute/v2.1/servers/1475392a-475f-414f-803c-e89c9ae1844a" status: 200 len: 1557 microversion: 2.1 time: 0.484929 Oct 04 22:03:05.773522 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2028/4110] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:03:05 2022] GET /compute/v2.1/servers/1475392a-475f-414f-803c-e89c9ae1844a => generated 1557 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:03:05.802308 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-8eb2b4a9-3770-4ba0-8417-ef719696156a tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:05.803733 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-8eb2b4a9-3770-4ba0-8417-ef719696156a tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] [instance: 1475392a-475f-414f-803c-e89c9ae1844a] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:03:05.812494 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8eb2b4a9-3770-4ba0-8417-ef719696156a tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:05.813503 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8eb2b4a9-3770-4ba0-8417-ef719696156a tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:05.814181 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8eb2b4a9-3770-4ba0-8417-ef719696156a tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:05.815390 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8eb2b4a9-3770-4ba0-8417-ef719696156a tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:05.816586 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8eb2b4a9-3770-4ba0-8417-ef719696156a tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:05.817478 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8eb2b4a9-3770-4ba0-8417-ef719696156a tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:05.860216 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-b837b3bf-d1a9-4f38-ae3a-16e15974bd2a tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.003020 Oct 04 22:03:05.884689 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2083/4111] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 22:03:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 3034 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 22:03:05.918355 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-f9690955-8fa7-467d-820a-97ed7723514d tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:05.918864 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-f9690955-8fa7-467d-820a-97ed7723514d tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: 64d56eab-65de-4951-adf0-891f8a39383f] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:03:05.941408 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f9690955-8fa7-467d-820a-97ed7723514d tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:05.949583 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f9690955-8fa7-467d-820a-97ed7723514d tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:05.951812 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f9690955-8fa7-467d-820a-97ed7723514d tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:05.952748 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f9690955-8fa7-467d-820a-97ed7723514d tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:05.953378 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f9690955-8fa7-467d-820a-97ed7723514d tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:05.956168 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f9690955-8fa7-467d-820a-97ed7723514d tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:06.254293 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-8eb2b4a9-3770-4ba0-8417-ef719696156a tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] 10.222.0.43 "GET /compute/v2.1/servers/1475392a-475f-414f-803c-e89c9ae1844a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.456849 Oct 04 22:03:06.255875 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2029/4112] 10.222.0.43 () {58 vars in 1275 bytes} [Tue Oct 4 22:03:05 2022] GET /compute/v2.1/servers/1475392a-475f-414f-803c-e89c9ae1844a/os-interface => generated 285 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:03:06.261800 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-c5875193-d02d-4310-a657-46a466267dda tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-239781209", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "451", "networks": [{"uuid": "a8b347c4-c6ad-4a61-a42c-389e7a6763a0"}]}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:03:06.393341 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.network.neutron [None req-c5875193-d02d-4310-a657-46a466267dda tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] validate_networks() for [('a8b347c4-c6ad-4a61-a42c-389e7a6763a0', None, None, None, None, None)] {{(pid=134101) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 22:03:07.297806 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-f9690955-8fa7-467d-820a-97ed7723514d tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a1c8d841104bc9b6910bcc2c0e2bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe9283584fc4d90b0715216d867ea2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:07.307144 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-f9690955-8fa7-467d-820a-97ed7723514d tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "GET /compute/v2.1/servers/64d56eab-65de-4951-adf0-891f8a39383f" status: 200 len: 1315 microversion: 2.1 time: 1.401157 Oct 04 22:03:07.321512 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2084/4113] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:03:05 2022] GET /compute/v2.1/servers/64d56eab-65de-4951-adf0-891f8a39383f => generated 1315 bytes in 1416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:03:07.332415 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-f9b4b078-77c2-4e4b-989e-be55448e6de4 req-00508363-89ab-468b-a893-be1d5cbafa2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64d56eab-65de-4951-adf0-891f8a39383f", "name": "network-vif-plugged", "status": "completed", "tag": "8b4a4ef4-3ab7-4920-b49c-999ef579490d"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:03:07.365369 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-f9b4b078-77c2-4e4b-989e-be55448e6de4 req-00508363-89ab-468b-a893-be1d5cbafa2d service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:07.366009 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-f9b4b078-77c2-4e4b-989e-be55448e6de4 req-00508363-89ab-468b-a893-be1d5cbafa2d service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:07.371400 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-f9b4b078-77c2-4e4b-989e-be55448e6de4 req-00508363-89ab-468b-a893-be1d5cbafa2d service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:07.395690 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-f9b4b078-77c2-4e4b-989e-be55448e6de4 req-00508363-89ab-468b-a893-be1d5cbafa2d service nova] Creating event network-vif-plugged:8b4a4ef4-3ab7-4920-b49c-999ef579490d for instance 64d56eab-65de-4951-adf0-891f8a39383f on n-h1-860284-1 Oct 04 22:03:07.413018 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-f9b4b078-77c2-4e4b-989e-be55448e6de4 req-00508363-89ab-468b-a893-be1d5cbafa2d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089829 Oct 04 22:03:07.416798 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2085/4114] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:03:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:03:08.345588 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-07cb47f9-cd8c-4e85-b497-716f949c5947 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:08.347089 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-07cb47f9-cd8c-4e85-b497-716f949c5947 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: 64d56eab-65de-4951-adf0-891f8a39383f] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:03:08.354789 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-07cb47f9-cd8c-4e85-b497-716f949c5947 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:08.355614 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-07cb47f9-cd8c-4e85-b497-716f949c5947 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:08.356283 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-07cb47f9-cd8c-4e85-b497-716f949c5947 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:08.357218 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-07cb47f9-cd8c-4e85-b497-716f949c5947 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:08.357940 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-07cb47f9-cd8c-4e85-b497-716f949c5947 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:08.358638 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-07cb47f9-cd8c-4e85-b497-716f949c5947 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:08.623706 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-c5875193-d02d-4310-a657-46a466267dda tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Flavor limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 22:03:08.624252 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-c5875193-d02d-4310-a657-46a466267dda tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Image limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 22:03:08.624655 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-c5875193-d02d-4310-a657-46a466267dda tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Flavor pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 22:03:08.625084 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-c5875193-d02d-4310-a657-46a466267dda tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Image pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 22:03:08.625554 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-c5875193-d02d-4310-a657-46a466267dda tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 22:03:08.658862 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c5875193-d02d-4310-a657-46a466267dda tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:08.660338 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c5875193-d02d-4310-a657-46a466267dda tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:08.663382 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c5875193-d02d-4310-a657-46a466267dda tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:08.664585 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c5875193-d02d-4310-a657-46a466267dda tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:08.665233 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c5875193-d02d-4310-a657-46a466267dda tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:08.665680 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c5875193-d02d-4310-a657-46a466267dda tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:08.705256 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-c5875193-d02d-4310-a657-46a466267dda tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Getting quotas for project fba14e6816284d9e89e22913643f4355. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:03:08.716967 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-c5875193-d02d-4310-a657-46a466267dda tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Getting quotas for user 9f46a71ea0ee4e45afaea7e38e8c0ddd and project fba14e6816284d9e89e22913643f4355. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:03:08.752017 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-c5875193-d02d-4310-a657-46a466267dda tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Going to run 1 instances... {{(pid=134101) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 22:03:08.757574 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-c5875193-d02d-4310-a657-46a466267dda tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] [instance: 879c8591-9e1e-42e8-bc3f-a435fd86caaf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='58548514-5dac-426c-81f5-19e3fba33e23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134101) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 22:03:08.902899 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-c5875193-d02d-4310-a657-46a466267dda tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.645776 Oct 04 22:03:08.909808 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2030/4115] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 22:03:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 2652 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 22:03:08.933908 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-7dbc8e29-af25-4c94-a5d1-7c9fbdee74fb tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:08.934722 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-7dbc8e29-af25-4c94-a5d1-7c9fbdee74fb tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] [instance: 879c8591-9e1e-42e8-bc3f-a435fd86caaf] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:03:09.112183 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-07cb47f9-cd8c-4e85-b497-716f949c5947 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a1c8d841104bc9b6910bcc2c0e2bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe9283584fc4d90b0715216d867ea2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:09.127455 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-07cb47f9-cd8c-4e85-b497-716f949c5947 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "GET /compute/v2.1/servers/64d56eab-65de-4951-adf0-891f8a39383f" status: 200 len: 1315 microversion: 2.1 time: 0.786036 Oct 04 22:03:09.146156 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2086/4116] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:03:08 2022] GET /compute/v2.1/servers/64d56eab-65de-4951-adf0-891f8a39383f => generated 1315 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:03:09.224806 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-7dbc8e29-af25-4c94-a5d1-7c9fbdee74fb tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f46a71ea0ee4e45afaea7e38e8c0ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba14e6816284d9e89e22913643f4355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:09.239997 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-7dbc8e29-af25-4c94-a5d1-7c9fbdee74fb tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] 10.222.0.43 "GET /compute/v2.1/servers/879c8591-9e1e-42e8-bc3f-a435fd86caaf" status: 200 len: 1220 microversion: 2.1 time: 0.328593 Oct 04 22:03:09.240921 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2031/4117] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:03:08 2022] GET /compute/v2.1/servers/879c8591-9e1e-42e8-bc3f-a435fd86caaf => generated 1220 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:03:10.127523 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-57446f34-f0c1-4f60-ad82-7c5f781debf3 req-b84d5c8e-0fed-4e44-b505-ca4590150a8b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1475392a-475f-414f-803c-e89c9ae1844a", "tag": "8df5b52b-3b39-4a5f-94b6-6b948feabebe"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:03:10.146249 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-57446f34-f0c1-4f60-ad82-7c5f781debf3 req-b84d5c8e-0fed-4e44-b505-ca4590150a8b service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:10.147113 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-57446f34-f0c1-4f60-ad82-7c5f781debf3 req-b84d5c8e-0fed-4e44-b505-ca4590150a8b service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:10.148061 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-57446f34-f0c1-4f60-ad82-7c5f781debf3 req-b84d5c8e-0fed-4e44-b505-ca4590150a8b service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:10.153917 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-ef21648f-e12f-4598-b7aa-5b4eca4bff85 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:10.155722 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-ef21648f-e12f-4598-b7aa-5b4eca4bff85 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: 64d56eab-65de-4951-adf0-891f8a39383f] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:03:10.168744 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-57446f34-f0c1-4f60-ad82-7c5f781debf3 req-b84d5c8e-0fed-4e44-b505-ca4590150a8b service nova] Creating event network-changed:8df5b52b-3b39-4a5f-94b6-6b948feabebe for instance 1475392a-475f-414f-803c-e89c9ae1844a on n-h1-860284-1 Oct 04 22:03:10.175206 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-57446f34-f0c1-4f60-ad82-7c5f781debf3 req-b84d5c8e-0fed-4e44-b505-ca4590150a8b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060592 Oct 04 22:03:10.176791 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ef21648f-e12f-4598-b7aa-5b4eca4bff85 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:10.177334 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ef21648f-e12f-4598-b7aa-5b4eca4bff85 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:10.178299 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2087/4118] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:03:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:03:10.184463 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ef21648f-e12f-4598-b7aa-5b4eca4bff85 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:10.185948 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ef21648f-e12f-4598-b7aa-5b4eca4bff85 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:10.186717 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ef21648f-e12f-4598-b7aa-5b4eca4bff85 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:10.190543 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ef21648f-e12f-4598-b7aa-5b4eca4bff85 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:10.267002 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-11f91b3e-cd59-41b0-ac74-2115c7315727 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:10.268125 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-11f91b3e-cd59-41b0-ac74-2115c7315727 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] [instance: 879c8591-9e1e-42e8-bc3f-a435fd86caaf] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:03:10.286715 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-11f91b3e-cd59-41b0-ac74-2115c7315727 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:10.287604 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-11f91b3e-cd59-41b0-ac74-2115c7315727 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:10.288488 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-11f91b3e-cd59-41b0-ac74-2115c7315727 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:10.290069 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-11f91b3e-cd59-41b0-ac74-2115c7315727 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:10.293305 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-11f91b3e-cd59-41b0-ac74-2115c7315727 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:10.294022 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-11f91b3e-cd59-41b0-ac74-2115c7315727 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:10.506087 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-11f91b3e-cd59-41b0-ac74-2115c7315727 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f46a71ea0ee4e45afaea7e38e8c0ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba14e6816284d9e89e22913643f4355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:10.516625 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-11f91b3e-cd59-41b0-ac74-2115c7315727 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] 10.222.0.43 "GET /compute/v2.1/servers/879c8591-9e1e-42e8-bc3f-a435fd86caaf" status: 200 len: 1272 microversion: 2.1 time: 0.252729 Oct 04 22:03:10.517332 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2088/4119] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:03:10 2022] GET /compute/v2.1/servers/879c8591-9e1e-42e8-bc3f-a435fd86caaf => generated 1272 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:03:10.988627 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-ef21648f-e12f-4598-b7aa-5b4eca4bff85 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a1c8d841104bc9b6910bcc2c0e2bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe9283584fc4d90b0715216d867ea2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:10.998961 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-ef21648f-e12f-4598-b7aa-5b4eca4bff85 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "GET /compute/v2.1/servers/64d56eab-65de-4951-adf0-891f8a39383f" status: 200 len: 1502 microversion: 2.1 time: 0.849579 Oct 04 22:03:11.003627 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2032/4120] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:03:10 2022] GET /compute/v2.1/servers/64d56eab-65de-4951-adf0-891f8a39383f => generated 1502 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:03:11.034701 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-673e39b4-730e-443e-8042-5b1b9ee0225c tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:03:11.035532 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-673e39b4-730e-443e-8042-5b1b9ee0225c tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: 64d56eab-65de-4951-adf0-891f8a39383f] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:03:11.044328 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-673e39b4-730e-443e-8042-5b1b9ee0225c tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:11.045289 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-673e39b4-730e-443e-8042-5b1b9ee0225c tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:11.045919 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-673e39b4-730e-443e-8042-5b1b9ee0225c tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:11.046985 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-673e39b4-730e-443e-8042-5b1b9ee0225c tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:11.047601 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-673e39b4-730e-443e-8042-5b1b9ee0225c tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:11.048173 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-673e39b4-730e-443e-8042-5b1b9ee0225c tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:11.153402 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-673e39b4-730e-443e-8042-5b1b9ee0225c tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "POST /compute/v2.1/servers/64d56eab-65de-4951-adf0-891f8a39383f/action" status: 202 len: 0 microversion: 2.1 time: 0.123087 Oct 04 22:03:11.158276 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2089/4121] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 22:03:11 2022] POST /compute/v2.1/servers/64d56eab-65de-4951-adf0-891f8a39383f/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 22:03:11.172084 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-580f0d8e-01e6-441f-9fda-260400dbf84d tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:11.172820 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-580f0d8e-01e6-441f-9fda-260400dbf84d tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: 64d56eab-65de-4951-adf0-891f8a39383f] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:03:11.202224 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-580f0d8e-01e6-441f-9fda-260400dbf84d tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:11.202873 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-580f0d8e-01e6-441f-9fda-260400dbf84d tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:11.203776 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-580f0d8e-01e6-441f-9fda-260400dbf84d tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:11.204529 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-580f0d8e-01e6-441f-9fda-260400dbf84d tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:11.204996 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-580f0d8e-01e6-441f-9fda-260400dbf84d tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:11.209688 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-580f0d8e-01e6-441f-9fda-260400dbf84d tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:11.542709 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-0d75c3ee-ed54-40cf-bc7b-747ee243cb07 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:11.543660 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-0d75c3ee-ed54-40cf-bc7b-747ee243cb07 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] [instance: 879c8591-9e1e-42e8-bc3f-a435fd86caaf] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:03:11.561938 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_api:SELECT=91,nova_api:DELETE=2,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:03:11.565515 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0d75c3ee-ed54-40cf-bc7b-747ee243cb07 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:11.569386 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0d75c3ee-ed54-40cf-bc7b-747ee243cb07 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:11.572315 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0d75c3ee-ed54-40cf-bc7b-747ee243cb07 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:11.574209 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0d75c3ee-ed54-40cf-bc7b-747ee243cb07 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:11.579028 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0d75c3ee-ed54-40cf-bc7b-747ee243cb07 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:11.588041 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0d75c3ee-ed54-40cf-bc7b-747ee243cb07 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:11.652948 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-580f0d8e-01e6-441f-9fda-260400dbf84d tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a1c8d841104bc9b6910bcc2c0e2bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe9283584fc4d90b0715216d867ea2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:11.659506 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=100 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:03:11.666664 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-580f0d8e-01e6-441f-9fda-260400dbf84d tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "GET /compute/v2.1/servers/64d56eab-65de-4951-adf0-891f8a39383f" status: 200 len: 1507 microversion: 2.1 time: 0.507135 Oct 04 22:03:11.674061 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2033/4122] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:03:11 2022] GET /compute/v2.1/servers/64d56eab-65de-4951-adf0-891f8a39383f => generated 1507 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:03:11.766385 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-0d75c3ee-ed54-40cf-bc7b-747ee243cb07 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f46a71ea0ee4e45afaea7e38e8c0ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba14e6816284d9e89e22913643f4355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:11.776544 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-0d75c3ee-ed54-40cf-bc7b-747ee243cb07 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] 10.222.0.43 "GET /compute/v2.1/servers/879c8591-9e1e-42e8-bc3f-a435fd86caaf" status: 200 len: 1278 microversion: 2.1 time: 0.240016 Oct 04 22:03:11.780692 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2090/4123] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:03:11 2022] GET /compute/v2.1/servers/879c8591-9e1e-42e8-bc3f-a435fd86caaf => generated 1278 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:03:11.907830 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-8506d9c7-01f0-47da-897c-8568aae43e1c req-930bcd78-f312-45aa-908b-01e04827bc70 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07e11885-b7b0-4ad1-bda6-a677b9aaf48d", "tag": "f61060d0-c909-46d7-9db6-37c2d7289758"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:03:11.927573 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-8506d9c7-01f0-47da-897c-8568aae43e1c req-930bcd78-f312-45aa-908b-01e04827bc70 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:11.928292 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-8506d9c7-01f0-47da-897c-8568aae43e1c req-930bcd78-f312-45aa-908b-01e04827bc70 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:11.934761 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-8506d9c7-01f0-47da-897c-8568aae43e1c req-930bcd78-f312-45aa-908b-01e04827bc70 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:11.963980 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-8506d9c7-01f0-47da-897c-8568aae43e1c req-930bcd78-f312-45aa-908b-01e04827bc70 service nova] Creating event network-changed:f61060d0-c909-46d7-9db6-37c2d7289758 for instance 07e11885-b7b0-4ad1-bda6-a677b9aaf48d on n-h2-860284-1 Oct 04 22:03:11.972796 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-8506d9c7-01f0-47da-897c-8568aae43e1c req-930bcd78-f312-45aa-908b-01e04827bc70 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069602 Oct 04 22:03:11.974068 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2034/4124] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:03:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:03:12.698786 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-4d8ff601-a510-4725-94ac-8f9e3573792e tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:12.699413 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-4d8ff601-a510-4725-94ac-8f9e3573792e tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: 64d56eab-65de-4951-adf0-891f8a39383f] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:03:12.715760 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4d8ff601-a510-4725-94ac-8f9e3573792e tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:12.716355 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4d8ff601-a510-4725-94ac-8f9e3573792e tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:12.716810 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4d8ff601-a510-4725-94ac-8f9e3573792e tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:12.717851 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4d8ff601-a510-4725-94ac-8f9e3573792e tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:12.718321 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4d8ff601-a510-4725-94ac-8f9e3573792e tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:12.718794 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4d8ff601-a510-4725-94ac-8f9e3573792e tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:12.804504 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-d69e6ec7-cf08-4489-a516-53fd12739df9 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:12.806567 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-d69e6ec7-cf08-4489-a516-53fd12739df9 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] [instance: 879c8591-9e1e-42e8-bc3f-a435fd86caaf] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:03:12.833875 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d69e6ec7-cf08-4489-a516-53fd12739df9 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:12.857323 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d69e6ec7-cf08-4489-a516-53fd12739df9 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:12.859736 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d69e6ec7-cf08-4489-a516-53fd12739df9 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:12.866993 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d69e6ec7-cf08-4489-a516-53fd12739df9 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:12.871279 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d69e6ec7-cf08-4489-a516-53fd12739df9 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:12.872395 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d69e6ec7-cf08-4489-a516-53fd12739df9 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:13.015223 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-d69e6ec7-cf08-4489-a516-53fd12739df9 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f46a71ea0ee4e45afaea7e38e8c0ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba14e6816284d9e89e22913643f4355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:13.017023 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-4d8ff601-a510-4725-94ac-8f9e3573792e tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a1c8d841104bc9b6910bcc2c0e2bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe9283584fc4d90b0715216d867ea2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:13.027322 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-4d8ff601-a510-4725-94ac-8f9e3573792e tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "GET /compute/v2.1/servers/64d56eab-65de-4951-adf0-891f8a39383f" status: 200 len: 1487 microversion: 2.1 time: 0.333961 Oct 04 22:03:13.028569 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2091/4125] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:03:12 2022] GET /compute/v2.1/servers/64d56eab-65de-4951-adf0-891f8a39383f => generated 1487 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:03:13.030276 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-d69e6ec7-cf08-4489-a516-53fd12739df9 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] 10.222.0.43 "GET /compute/v2.1/servers/879c8591-9e1e-42e8-bc3f-a435fd86caaf" status: 200 len: 1278 microversion: 2.1 time: 0.233594 Oct 04 22:03:13.031437 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2035/4126] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:03:12 2022] GET /compute/v2.1/servers/879c8591-9e1e-42e8-bc3f-a435fd86caaf => generated 1278 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:03:13.051366 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-49037327-9566-4b96-bdae-2dec31b666e3 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:13.052100 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-49037327-9566-4b96-bdae-2dec31b666e3 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: 64d56eab-65de-4951-adf0-891f8a39383f] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:03:13.059912 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-49037327-9566-4b96-bdae-2dec31b666e3 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:13.060415 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-49037327-9566-4b96-bdae-2dec31b666e3 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:13.060863 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-49037327-9566-4b96-bdae-2dec31b666e3 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:13.061587 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-49037327-9566-4b96-bdae-2dec31b666e3 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:13.062048 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-49037327-9566-4b96-bdae-2dec31b666e3 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:13.063142 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-49037327-9566-4b96-bdae-2dec31b666e3 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:13.115858 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-49037327-9566-4b96-bdae-2dec31b666e3 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: 64d56eab-65de-4951-adf0-891f8a39383f] Going to try to terminate instance {{(pid=134102) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 22:03:13.264708 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-49037327-9566-4b96-bdae-2dec31b666e3 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "DELETE /compute/v2.1/servers/64d56eab-65de-4951-adf0-891f8a39383f" status: 204 len: 0 microversion: 2.1 time: 0.216986 Oct 04 22:03:13.268761 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2092/4127] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 22:03:13 2022] DELETE /compute/v2.1/servers/64d56eab-65de-4951-adf0-891f8a39383f => generated 0 bytes in 219 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 22:03:13.275929 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-7e4e00d6-4f62-46e5-8ac5-0ce083610094 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:13.278294 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-7e4e00d6-4f62-46e5-8ac5-0ce083610094 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: 64d56eab-65de-4951-adf0-891f8a39383f] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:03:13.292911 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7e4e00d6-4f62-46e5-8ac5-0ce083610094 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:13.293427 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7e4e00d6-4f62-46e5-8ac5-0ce083610094 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:13.293871 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7e4e00d6-4f62-46e5-8ac5-0ce083610094 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:13.294617 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7e4e00d6-4f62-46e5-8ac5-0ce083610094 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:13.295112 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7e4e00d6-4f62-46e5-8ac5-0ce083610094 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:13.295521 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7e4e00d6-4f62-46e5-8ac5-0ce083610094 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:13.649443 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-7e4e00d6-4f62-46e5-8ac5-0ce083610094 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a1c8d841104bc9b6910bcc2c0e2bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe9283584fc4d90b0715216d867ea2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:13.667231 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-7e4e00d6-4f62-46e5-8ac5-0ce083610094 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "GET /compute/v2.1/servers/64d56eab-65de-4951-adf0-891f8a39383f" status: 200 len: 1493 microversion: 2.1 time: 0.397060 Oct 04 22:03:13.668768 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2036/4128] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:03:13 2022] GET /compute/v2.1/servers/64d56eab-65de-4951-adf0-891f8a39383f => generated 1493 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:03:14.057936 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-486e3a3f-a24e-4d47-a7ee-e4d4e22dd52e tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:14.058630 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-486e3a3f-a24e-4d47-a7ee-e4d4e22dd52e tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] [instance: 879c8591-9e1e-42e8-bc3f-a435fd86caaf] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:03:14.067543 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-486e3a3f-a24e-4d47-a7ee-e4d4e22dd52e tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:14.068397 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-486e3a3f-a24e-4d47-a7ee-e4d4e22dd52e tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:14.069269 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-486e3a3f-a24e-4d47-a7ee-e4d4e22dd52e tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:14.071699 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-486e3a3f-a24e-4d47-a7ee-e4d4e22dd52e tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:14.072490 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-486e3a3f-a24e-4d47-a7ee-e4d4e22dd52e tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:14.073635 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-486e3a3f-a24e-4d47-a7ee-e4d4e22dd52e tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:14.181940 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-486e3a3f-a24e-4d47-a7ee-e4d4e22dd52e tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f46a71ea0ee4e45afaea7e38e8c0ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba14e6816284d9e89e22913643f4355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:14.193223 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-486e3a3f-a24e-4d47-a7ee-e4d4e22dd52e tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] 10.222.0.43 "GET /compute/v2.1/servers/879c8591-9e1e-42e8-bc3f-a435fd86caaf" status: 200 len: 1278 microversion: 2.1 time: 0.140857 Oct 04 22:03:14.206960 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2093/4129] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:03:14 2022] GET /compute/v2.1/servers/879c8591-9e1e-42e8-bc3f-a435fd86caaf => generated 1278 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:03:14.693978 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-5bff60c8-a0cd-4d7d-93c4-226d5d6d46ee tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:14.694641 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-5bff60c8-a0cd-4d7d-93c4-226d5d6d46ee tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: 64d56eab-65de-4951-adf0-891f8a39383f] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:03:14.708549 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5bff60c8-a0cd-4d7d-93c4-226d5d6d46ee tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:14.709398 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5bff60c8-a0cd-4d7d-93c4-226d5d6d46ee tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:14.710148 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5bff60c8-a0cd-4d7d-93c4-226d5d6d46ee tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:14.711317 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5bff60c8-a0cd-4d7d-93c4-226d5d6d46ee tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:14.712273 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5bff60c8-a0cd-4d7d-93c4-226d5d6d46ee tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:14.713001 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5bff60c8-a0cd-4d7d-93c4-226d5d6d46ee tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:15.172864 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-5bff60c8-a0cd-4d7d-93c4-226d5d6d46ee tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a1c8d841104bc9b6910bcc2c0e2bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe9283584fc4d90b0715216d867ea2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:15.186465 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-5bff60c8-a0cd-4d7d-93c4-226d5d6d46ee tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "GET /compute/v2.1/servers/64d56eab-65de-4951-adf0-891f8a39383f" status: 200 len: 1493 microversion: 2.1 time: 0.496364 Oct 04 22:03:15.187610 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2037/4130] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:03:14 2022] GET /compute/v2.1/servers/64d56eab-65de-4951-adf0-891f8a39383f => generated 1493 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:03:15.223089 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-afa8aaa2-891a-4667-a3c5-cb9a21a2ba6d tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:15.223800 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-afa8aaa2-891a-4667-a3c5-cb9a21a2ba6d tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] [instance: 879c8591-9e1e-42e8-bc3f-a435fd86caaf] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:03:15.251683 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-afa8aaa2-891a-4667-a3c5-cb9a21a2ba6d tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:15.255333 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-afa8aaa2-891a-4667-a3c5-cb9a21a2ba6d tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:15.256446 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-afa8aaa2-891a-4667-a3c5-cb9a21a2ba6d tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:15.260719 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-afa8aaa2-891a-4667-a3c5-cb9a21a2ba6d tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:15.261380 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-afa8aaa2-891a-4667-a3c5-cb9a21a2ba6d tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:15.261843 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-afa8aaa2-891a-4667-a3c5-cb9a21a2ba6d tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:15.573058 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell0:SELECT=4 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:03:15.603064 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-afa8aaa2-891a-4667-a3c5-cb9a21a2ba6d tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f46a71ea0ee4e45afaea7e38e8c0ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba14e6816284d9e89e22913643f4355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:15.613365 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-afa8aaa2-891a-4667-a3c5-cb9a21a2ba6d tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] 10.222.0.43 "GET /compute/v2.1/servers/879c8591-9e1e-42e8-bc3f-a435fd86caaf" status: 200 len: 1320 microversion: 2.1 time: 0.399138 Oct 04 22:03:15.614181 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2094/4131] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:03:15 2022] GET /compute/v2.1/servers/879c8591-9e1e-42e8-bc3f-a435fd86caaf => generated 1320 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:03:15.620726 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-0562604b-506b-4e35-8aab-5ee4967c31e8 req-dc887aad-bc51-44f3-ae86-022f2feba00e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27f6babc-9d2c-4ba8-8043-cd2d90f9ba7e", "tag": "c6715c1a-cde4-4b82-ab5f-4aaead73c545"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:03:15.640806 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-0562604b-506b-4e35-8aab-5ee4967c31e8 req-dc887aad-bc51-44f3-ae86-022f2feba00e service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:15.641333 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-0562604b-506b-4e35-8aab-5ee4967c31e8 req-dc887aad-bc51-44f3-ae86-022f2feba00e service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:15.641780 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-0562604b-506b-4e35-8aab-5ee4967c31e8 req-dc887aad-bc51-44f3-ae86-022f2feba00e service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:15.664097 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-0562604b-506b-4e35-8aab-5ee4967c31e8 req-dc887aad-bc51-44f3-ae86-022f2feba00e service nova] Creating event network-changed:c6715c1a-cde4-4b82-ab5f-4aaead73c545 for instance 27f6babc-9d2c-4ba8-8043-cd2d90f9ba7e on n-h2-860284-1 Oct 04 22:03:15.674921 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-0562604b-506b-4e35-8aab-5ee4967c31e8 req-dc887aad-bc51-44f3-ae86-022f2feba00e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058119 Oct 04 22:03:15.675555 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2095/4132] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:03:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:03:15.770785 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-7f0c3c2f-4ba4-4c28-b8da-5bcea4401bbc tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-267616306", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452", "networks": "none"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:03:15.870135 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-7f0c3c2f-4ba4-4c28-b8da-5bcea4401bbc tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Flavor limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 22:03:15.871191 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-7f0c3c2f-4ba4-4c28-b8da-5bcea4401bbc tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Image limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 22:03:15.871657 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-7f0c3c2f-4ba4-4c28-b8da-5bcea4401bbc tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Flavor pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 22:03:15.872245 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-7f0c3c2f-4ba4-4c28-b8da-5bcea4401bbc tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Image pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 22:03:15.872842 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-7f0c3c2f-4ba4-4c28-b8da-5bcea4401bbc tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 22:03:15.893068 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7f0c3c2f-4ba4-4c28-b8da-5bcea4401bbc tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:15.893417 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7f0c3c2f-4ba4-4c28-b8da-5bcea4401bbc tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:15.893857 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7f0c3c2f-4ba4-4c28-b8da-5bcea4401bbc tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:15.894613 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7f0c3c2f-4ba4-4c28-b8da-5bcea4401bbc tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:15.895068 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7f0c3c2f-4ba4-4c28-b8da-5bcea4401bbc tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:15.895492 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7f0c3c2f-4ba4-4c28-b8da-5bcea4401bbc tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:15.940262 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-a1127d2f-14a2-465b-befa-c77026058bcc req-b4700b9e-ab0e-4c3f-8923-34520bfda30f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64d56eab-65de-4951-adf0-891f8a39383f", "name": "network-vif-deleted", "tag": "8b4a4ef4-3ab7-4920-b49c-999ef579490d"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:03:15.952897 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell0:SELECT=12 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:03:15.960217 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-7f0c3c2f-4ba4-4c28-b8da-5bcea4401bbc tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Getting quotas for project 53f24f86f0fc4a3ba09c2be55876c783. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:03:15.976612 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-a1127d2f-14a2-465b-befa-c77026058bcc req-b4700b9e-ab0e-4c3f-8923-34520bfda30f service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:15.980227 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-a1127d2f-14a2-465b-befa-c77026058bcc req-b4700b9e-ab0e-4c3f-8923-34520bfda30f service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:15.981663 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-a1127d2f-14a2-465b-befa-c77026058bcc req-b4700b9e-ab0e-4c3f-8923-34520bfda30f service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:15.987627 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-7f0c3c2f-4ba4-4c28-b8da-5bcea4401bbc tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Getting quotas for user 92894af6b8f74650ad7696e1f3ac375d and project 53f24f86f0fc4a3ba09c2be55876c783. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:03:16.014953 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-a1127d2f-14a2-465b-befa-c77026058bcc req-b4700b9e-ab0e-4c3f-8923-34520bfda30f service nova] Creating event network-vif-deleted:8b4a4ef4-3ab7-4920-b49c-999ef579490d for instance 64d56eab-65de-4951-adf0-891f8a39383f on n-h1-860284-1 Oct 04 22:03:16.025358 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-7f0c3c2f-4ba4-4c28-b8da-5bcea4401bbc tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Going to run 1 instances... {{(pid=134101) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 22:03:16.029865 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-a1127d2f-14a2-465b-befa-c77026058bcc req-b4700b9e-ab0e-4c3f-8923-34520bfda30f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095619 Oct 04 22:03:16.033984 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2096/4133] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:03:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:03:16.034346 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-7f0c3c2f-4ba4-4c28-b8da-5bcea4401bbc tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] [instance: 39dc4bb1-8465-4576-b490-d066c0fbb18f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='58548514-5dac-426c-81f5-19e3fba33e23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134101) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 22:03:16.104869 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-7f0c3c2f-4ba4-4c28-b8da-5bcea4401bbc tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 0.548234 Oct 04 22:03:16.106355 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2038/4134] 10.222.0.43 () {62 vars in 1188 bytes} [Tue Oct 4 22:03:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 552 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 04 22:03:16.125184 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-0fc2b067-f727-4087-9b34-4b418695c9fd tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:16.126416 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-0fc2b067-f727-4087-9b34-4b418695c9fd tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] [instance: 39dc4bb1-8465-4576-b490-d066c0fbb18f] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:03:16.211930 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-33ac03db-85c5-4c58-afcb-bcec15e0d4eb tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:16.212658 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-33ac03db-85c5-4c58-afcb-bcec15e0d4eb tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: 64d56eab-65de-4951-adf0-891f8a39383f] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:03:16.225570 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-33ac03db-85c5-4c58-afcb-bcec15e0d4eb tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:16.227046 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-33ac03db-85c5-4c58-afcb-bcec15e0d4eb tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:16.228365 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-33ac03db-85c5-4c58-afcb-bcec15e0d4eb tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:16.231363 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-33ac03db-85c5-4c58-afcb-bcec15e0d4eb tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:16.231867 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-33ac03db-85c5-4c58-afcb-bcec15e0d4eb tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:16.232303 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-33ac03db-85c5-4c58-afcb-bcec15e0d4eb tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:16.250601 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-0fc2b067-f727-4087-9b34-4b418695c9fd tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92894af6b8f74650ad7696e1f3ac375d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f24f86f0fc4a3ba09c2be55876c783', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:16.279322 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-33ac03db-85c5-4c58-afcb-bcec15e0d4eb tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:16.279715 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-0fc2b067-f727-4087-9b34-4b418695c9fd tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92894af6b8f74650ad7696e1f3ac375d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f24f86f0fc4a3ba09c2be55876c783', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:16.280255 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-33ac03db-85c5-4c58-afcb-bcec15e0d4eb tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:16.280888 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-33ac03db-85c5-4c58-afcb-bcec15e0d4eb tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:16.281671 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.objects.instance [None req-33ac03db-85c5-4c58-afcb-bcec15e0d4eb tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lazy-loading 'fault' on Instance uuid 64d56eab-65de-4951-adf0-891f8a39383f {{(pid=134101) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 22:03:16.291142 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-0fc2b067-f727-4087-9b34-4b418695c9fd tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92894af6b8f74650ad7696e1f3ac375d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f24f86f0fc4a3ba09c2be55876c783', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:16.293361 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-0fc2b067-f727-4087-9b34-4b418695c9fd tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] 10.222.0.43 "GET /compute/v2.1/servers/39dc4bb1-8465-4576-b490-d066c0fbb18f" status: 200 len: 1277 microversion: 2.54 time: 0.179654 Oct 04 22:03:16.295043 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2097/4135] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:03:16 2022] GET /compute/v2.1/servers/39dc4bb1-8465-4576-b490-d066c0fbb18f => generated 1277 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:03:16.330166 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-33ac03db-85c5-4c58-afcb-bcec15e0d4eb tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a1c8d841104bc9b6910bcc2c0e2bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe9283584fc4d90b0715216d867ea2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:16.340495 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-33ac03db-85c5-4c58-afcb-bcec15e0d4eb tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "GET /compute/v2.1/servers/64d56eab-65de-4951-adf0-891f8a39383f" status: 200 len: 1305 microversion: 2.1 time: 0.133416 Oct 04 22:03:16.341717 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2039/4136] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:03:16 2022] GET /compute/v2.1/servers/64d56eab-65de-4951-adf0-891f8a39383f => generated 1305 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:03:16.639183 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-83953f58-34b8-45cc-9201-541e9058d5df tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:16.640173 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-83953f58-34b8-45cc-9201-541e9058d5df tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] [instance: 879c8591-9e1e-42e8-bc3f-a435fd86caaf] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:03:16.649417 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-83953f58-34b8-45cc-9201-541e9058d5df tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:16.650176 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-83953f58-34b8-45cc-9201-541e9058d5df tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:16.650949 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-83953f58-34b8-45cc-9201-541e9058d5df tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:16.652585 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-83953f58-34b8-45cc-9201-541e9058d5df tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:16.653429 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-83953f58-34b8-45cc-9201-541e9058d5df tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:16.654762 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-83953f58-34b8-45cc-9201-541e9058d5df tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:17.332101 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-bd2f8493-17ae-4da4-aa91-3f807096b197 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:17.336393 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-bd2f8493-17ae-4da4-aa91-3f807096b197 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] [instance: 39dc4bb1-8465-4576-b490-d066c0fbb18f] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:03:17.364541 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bd2f8493-17ae-4da4-aa91-3f807096b197 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:17.372082 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bd2f8493-17ae-4da4-aa91-3f807096b197 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:17.373167 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bd2f8493-17ae-4da4-aa91-3f807096b197 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:17.374210 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bd2f8493-17ae-4da4-aa91-3f807096b197 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:17.377081 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bd2f8493-17ae-4da4-aa91-3f807096b197 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:17.377769 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bd2f8493-17ae-4da4-aa91-3f807096b197 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:17.398202 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-83953f58-34b8-45cc-9201-541e9058d5df tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f46a71ea0ee4e45afaea7e38e8c0ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba14e6816284d9e89e22913643f4355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:17.412599 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-83953f58-34b8-45cc-9201-541e9058d5df tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] 10.222.0.43 "GET /compute/v2.1/servers/879c8591-9e1e-42e8-bc3f-a435fd86caaf" status: 200 len: 1320 microversion: 2.1 time: 0.778601 Oct 04 22:03:17.426878 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2098/4137] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:03:16 2022] GET /compute/v2.1/servers/879c8591-9e1e-42e8-bc3f-a435fd86caaf => generated 1320 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:03:17.459663 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-d9f05090-eb14-4530-bac8-0966b624f59d tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:17.460353 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-d9f05090-eb14-4530-bac8-0966b624f59d tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: 64d56eab-65de-4951-adf0-891f8a39383f] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:03:17.488535 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d9f05090-eb14-4530-bac8-0966b624f59d tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:17.489529 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d9f05090-eb14-4530-bac8-0966b624f59d tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:17.490250 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d9f05090-eb14-4530-bac8-0966b624f59d tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:17.491510 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d9f05090-eb14-4530-bac8-0966b624f59d tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:17.492546 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d9f05090-eb14-4530-bac8-0966b624f59d tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:17.493168 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d9f05090-eb14-4530-bac8-0966b624f59d tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:17.506992 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-bd2f8493-17ae-4da4-aa91-3f807096b197 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92894af6b8f74650ad7696e1f3ac375d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f24f86f0fc4a3ba09c2be55876c783', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:17.534872 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-bd2f8493-17ae-4da4-aa91-3f807096b197 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92894af6b8f74650ad7696e1f3ac375d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f24f86f0fc4a3ba09c2be55876c783', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:17.540675 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-bd2f8493-17ae-4da4-aa91-3f807096b197 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92894af6b8f74650ad7696e1f3ac375d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f24f86f0fc4a3ba09c2be55876c783', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:17.541906 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-bd2f8493-17ae-4da4-aa91-3f807096b197 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] 10.222.0.43 "GET /compute/v2.1/servers/39dc4bb1-8465-4576-b490-d066c0fbb18f" status: 200 len: 1329 microversion: 2.54 time: 0.223732 Oct 04 22:03:17.542525 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2040/4138] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:03:17 2022] GET /compute/v2.1/servers/39dc4bb1-8465-4576-b490-d066c0fbb18f => generated 1329 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 22:03:17.569766 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-d9f05090-eb14-4530-bac8-0966b624f59d tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] HTTP exception thrown: Instance 64d56eab-65de-4951-adf0-891f8a39383f could not be found. Oct 04 22:03:17.574149 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-d9f05090-eb14-4530-bac8-0966b624f59d tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Request method failure captured: Oct 04 22:03:17.574149 n-d-860284-1 devstack@n-api.service[134102]: request: GET /compute/v2.1/servers/64d56eab-65de-4951-adf0-891f8a39383f HTTP/1.1 Oct 04 22:03:17.574149 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 22:03:17.574149 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 22:03:17.574149 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 22:03:17.574149 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 22:03:17.574149 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 22:03:17.574149 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 22:03:17.574149 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 22:03:17.574149 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 22:03:17.574149 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPK0nBLOASIAc_jQKg5RCRqB87oRsJiRc3l4etfmNkfSSv1yHGR8RjgOAS-Q4KEeiZVVxJRa8Focu7VoHdbhzgEqV5pocnY2xPPRPWacaT4koizORav87v6vdxgR4HH-PmsbraTS232Q30lW73kM7RH3tINWZChDkcbwtTWeQlIO6TSk Oct 04 22:03:17.574149 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 22:03:17.574149 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 22:03:17.574149 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 22:03:17.574149 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 22:03:17.574149 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 22:03:17.574149 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 22:03:17.574149 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: dfe9283584fc4d90b0715216d867ea2f Oct 04 22:03:17.574149 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-DeleteServersTestJSON-2136146778 Oct 04 22:03:17.574149 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 22:03:17.574149 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 22:03:17.574149 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/dfe9283584fc4d90b0715216d867ea2f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_dfe9283584fc4d90b0715216d867ea2f", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/dfe9283584fc4d90b0715216d867ea2f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/dfe9283584fc4d90b0715216d867ea2f"}]}] Oct 04 22:03:17.574149 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-DeleteServersTestJSON-2136146778 Oct 04 22:03:17.574149 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: dfe9283584fc4d90b0715216d867ea2f Oct 04 22:03:17.574149 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-DeleteServersTestJSON-2136146778 Oct 04 22:03:17.574149 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-DeleteServersTestJSON-2136146778-project Oct 04 22:03:17.574149 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 22:03:17.574149 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 22:03:17.574149 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: 41a1c8d841104bc9b6910bcc2c0e2bb1 Oct 04 22:03:17.574149 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-DeleteServersTestJSON-2136146778-project Oct 04 22:03:17.574149 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 22:03:17.574149 n-d-860284-1 devstack@n-api.service[134102]: exception: Instance 64d56eab-65de-4951-adf0-891f8a39383f could not be found. Oct 04 22:03:17.574149 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': '64d56eab-65de-4951-adf0-891f8a39383f'} Oct 04 22:03:17.574149 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:03:17.574149 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:03:17.574149 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:03:17.574149 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:03:17.574149 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:03:17.574149 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:03:17.574149 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:03:17.574149 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:03:17.574149 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:03:17.574149 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:03:17.574149 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64d56eab-65de-4951-adf0-891f8a39383f could not be found. Oct 04 22:03:17.574149 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:03:17.574149 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:03:17.574149 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:03:17.574149 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:03:17.574149 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:03:17.574149 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:03:17.574149 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:03:17.574149 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:03:17.574149 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:03:17.574149 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:03:17.574149 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:03:17.574149 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:03:17.574149 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:03:17.574149 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:03:17.574149 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:03:17.574149 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:03:17.574149 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64d56eab-65de-4951-adf0-891f8a39383f could not be found. Oct 04 22:03:17.574149 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:03:17.574149 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:03:17.574149 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:03:17.579207 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:03:17.579207 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:03:17.579207 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:03:17.579207 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:03:17.579207 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:03:17.579207 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64d56eab-65de-4951-adf0-891f8a39383f could not be found. Oct 04 22:03:17.579207 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:03:17.581293 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-d9f05090-eb14-4530-bac8-0966b624f59d tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Returning 404 to user: Instance 64d56eab-65de-4951-adf0-891f8a39383f could not be found. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:03:17.582777 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-d9f05090-eb14-4530-bac8-0966b624f59d tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "GET /compute/v2.1/servers/64d56eab-65de-4951-adf0-891f8a39383f" status: 404 len: 111 microversion: 2.1 time: 0.154244 Oct 04 22:03:17.590909 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2099/4139] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:03:17 2022] GET /compute/v2.1/servers/64d56eab-65de-4951-adf0-891f8a39383f => generated 111 bytes in 156 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:03:17.794004 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-d3541646-6041-4bc6-a2e2-8fe614e220ab tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1566097635", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452", "networks": [{"uuid": "948c65db-57fc-480e-9ddd-f1d8426ccd4e"}]}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:03:17.899354 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.network.neutron [None req-d3541646-6041-4bc6-a2e2-8fe614e220ab tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] validate_networks() for [('948c65db-57fc-480e-9ddd-f1d8426ccd4e', None, None, None, None, None)] {{(pid=134101) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 22:03:18.230510 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-7b6c5775-86f2-464e-8f95-4a452ebbf176 req-1a9d521c-22c1-4203-b91e-9fb7e47e9b9a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "879c8591-9e1e-42e8-bc3f-a435fd86caaf", "tag": "37aaf4df-3249-45b9-9aad-48fecc563a6a"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:03:18.260377 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-7b6c5775-86f2-464e-8f95-4a452ebbf176 req-1a9d521c-22c1-4203-b91e-9fb7e47e9b9a service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:18.264505 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-7b6c5775-86f2-464e-8f95-4a452ebbf176 req-1a9d521c-22c1-4203-b91e-9fb7e47e9b9a service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:18.265095 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-7b6c5775-86f2-464e-8f95-4a452ebbf176 req-1a9d521c-22c1-4203-b91e-9fb7e47e9b9a service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:18.312707 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-7b6c5775-86f2-464e-8f95-4a452ebbf176 req-1a9d521c-22c1-4203-b91e-9fb7e47e9b9a service nova] Creating event network-changed:37aaf4df-3249-45b9-9aad-48fecc563a6a for instance 879c8591-9e1e-42e8-bc3f-a435fd86caaf on n-h1-860284-1 Oct 04 22:03:18.328480 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-7b6c5775-86f2-464e-8f95-4a452ebbf176 req-1a9d521c-22c1-4203-b91e-9fb7e47e9b9a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105820 Oct 04 22:03:18.330127 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2100/4140] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:03:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:03:18.440031 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-24139da6-c89d-452c-aaab-71c365129d5b tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:18.440771 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-24139da6-c89d-452c-aaab-71c365129d5b tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] [instance: 879c8591-9e1e-42e8-bc3f-a435fd86caaf] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:03:18.455166 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-24139da6-c89d-452c-aaab-71c365129d5b tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:18.455675 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-24139da6-c89d-452c-aaab-71c365129d5b tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:18.456302 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-24139da6-c89d-452c-aaab-71c365129d5b tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:18.457210 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-24139da6-c89d-452c-aaab-71c365129d5b tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:18.463322 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-24139da6-c89d-452c-aaab-71c365129d5b tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:18.464036 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-24139da6-c89d-452c-aaab-71c365129d5b tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:19.029898 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-24139da6-c89d-452c-aaab-71c365129d5b tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f46a71ea0ee4e45afaea7e38e8c0ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba14e6816284d9e89e22913643f4355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:19.040183 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-24139da6-c89d-452c-aaab-71c365129d5b tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] 10.222.0.43 "GET /compute/v2.1/servers/879c8591-9e1e-42e8-bc3f-a435fd86caaf" status: 200 len: 1320 microversion: 2.1 time: 0.605956 Oct 04 22:03:19.041355 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2101/4141] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:03:18 2022] GET /compute/v2.1/servers/879c8591-9e1e-42e8-bc3f-a435fd86caaf => generated 1320 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:03:19.047363 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-f38141e3-cb87-4417-bfc6-29c5dab52549 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:19.048200 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-f38141e3-cb87-4417-bfc6-29c5dab52549 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] [instance: 39dc4bb1-8465-4576-b490-d066c0fbb18f] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:03:19.062225 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f38141e3-cb87-4417-bfc6-29c5dab52549 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:19.063213 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f38141e3-cb87-4417-bfc6-29c5dab52549 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:19.064358 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f38141e3-cb87-4417-bfc6-29c5dab52549 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:19.065267 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f38141e3-cb87-4417-bfc6-29c5dab52549 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:19.065731 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f38141e3-cb87-4417-bfc6-29c5dab52549 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:19.066172 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f38141e3-cb87-4417-bfc6-29c5dab52549 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:19.227556 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-f38141e3-cb87-4417-bfc6-29c5dab52549 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92894af6b8f74650ad7696e1f3ac375d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f24f86f0fc4a3ba09c2be55876c783', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:19.227556 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:03:19.231582 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-d3541646-6041-4bc6-a2e2-8fe614e220ab tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Flavor limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 22:03:19.232093 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-d3541646-6041-4bc6-a2e2-8fe614e220ab tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Image limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 22:03:19.232604 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-d3541646-6041-4bc6-a2e2-8fe614e220ab tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Flavor pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 22:03:19.233036 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-d3541646-6041-4bc6-a2e2-8fe614e220ab tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Image pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 22:03:19.233544 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-d3541646-6041-4bc6-a2e2-8fe614e220ab tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 22:03:19.242119 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-f38141e3-cb87-4417-bfc6-29c5dab52549 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92894af6b8f74650ad7696e1f3ac375d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f24f86f0fc4a3ba09c2be55876c783', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:19.244704 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-f38141e3-cb87-4417-bfc6-29c5dab52549 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92894af6b8f74650ad7696e1f3ac375d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f24f86f0fc4a3ba09c2be55876c783', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:19.245954 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-f38141e3-cb87-4417-bfc6-29c5dab52549 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] 10.222.0.43 "GET /compute/v2.1/servers/39dc4bb1-8465-4576-b490-d066c0fbb18f" status: 200 len: 1335 microversion: 2.54 time: 0.203300 Oct 04 22:03:19.246555 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2102/4142] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:03:19 2022] GET /compute/v2.1/servers/39dc4bb1-8465-4576-b490-d066c0fbb18f => generated 1335 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:03:19.255592 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d3541646-6041-4bc6-a2e2-8fe614e220ab tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:19.256231 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d3541646-6041-4bc6-a2e2-8fe614e220ab tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:19.256754 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d3541646-6041-4bc6-a2e2-8fe614e220ab tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:19.257624 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d3541646-6041-4bc6-a2e2-8fe614e220ab tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:19.259412 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d3541646-6041-4bc6-a2e2-8fe614e220ab tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:19.259994 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d3541646-6041-4bc6-a2e2-8fe614e220ab tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:19.282599 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-d3541646-6041-4bc6-a2e2-8fe614e220ab tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Getting quotas for project dfe9283584fc4d90b0715216d867ea2f. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:03:19.295960 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-d3541646-6041-4bc6-a2e2-8fe614e220ab tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Getting quotas for user 41a1c8d841104bc9b6910bcc2c0e2bb1 and project dfe9283584fc4d90b0715216d867ea2f. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:03:19.322416 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-d3541646-6041-4bc6-a2e2-8fe614e220ab tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Going to run 1 instances... {{(pid=134101) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 22:03:19.325205 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-d3541646-6041-4bc6-a2e2-8fe614e220ab tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: e5842070-d5a3-43f9-82f8-ebce4eaf5526] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='58548514-5dac-426c-81f5-19e3fba33e23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134101) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 22:03:19.379700 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-d3541646-6041-4bc6-a2e2-8fe614e220ab tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.591169 Oct 04 22:03:19.380513 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2041/4143] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 22:03:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 1593 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 22:03:19.392125 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-8dd947aa-07a9-41ca-a1d3-cb31eaca3d26 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:19.392739 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-8dd947aa-07a9-41ca-a1d3-cb31eaca3d26 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: e5842070-d5a3-43f9-82f8-ebce4eaf5526] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:03:19.588300 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-8dd947aa-07a9-41ca-a1d3-cb31eaca3d26 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a1c8d841104bc9b6910bcc2c0e2bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe9283584fc4d90b0715216d867ea2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:19.597322 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-8dd947aa-07a9-41ca-a1d3-cb31eaca3d26 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "GET /compute/v2.1/servers/e5842070-d5a3-43f9-82f8-ebce4eaf5526" status: 200 len: 1215 microversion: 2.1 time: 0.209035 Oct 04 22:03:19.598289 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2103/4144] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:03:19 2022] GET /compute/v2.1/servers/e5842070-d5a3-43f9-82f8-ebce4eaf5526 => generated 1215 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:03:20.065939 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-17ff209c-95db-42a3-ac00-327f917c3b39 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:20.066775 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-17ff209c-95db-42a3-ac00-327f917c3b39 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] [instance: 879c8591-9e1e-42e8-bc3f-a435fd86caaf] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:03:20.069565 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:03:20.077063 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-17ff209c-95db-42a3-ac00-327f917c3b39 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:20.077877 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-17ff209c-95db-42a3-ac00-327f917c3b39 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:20.083629 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-17ff209c-95db-42a3-ac00-327f917c3b39 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:20.084667 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-17ff209c-95db-42a3-ac00-327f917c3b39 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:20.085367 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-17ff209c-95db-42a3-ac00-327f917c3b39 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:20.086239 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-17ff209c-95db-42a3-ac00-327f917c3b39 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:20.272592 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-63be9652-c9bd-45c0-a9bb-70ed8d44c1a5 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:20.273488 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-63be9652-c9bd-45c0-a9bb-70ed8d44c1a5 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] [instance: 39dc4bb1-8465-4576-b490-d066c0fbb18f] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:03:20.291353 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-63be9652-c9bd-45c0-a9bb-70ed8d44c1a5 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:20.292121 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-63be9652-c9bd-45c0-a9bb-70ed8d44c1a5 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:20.292745 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-63be9652-c9bd-45c0-a9bb-70ed8d44c1a5 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:20.293633 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-63be9652-c9bd-45c0-a9bb-70ed8d44c1a5 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:20.294255 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-63be9652-c9bd-45c0-a9bb-70ed8d44c1a5 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:20.294864 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-63be9652-c9bd-45c0-a9bb-70ed8d44c1a5 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:20.421442 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-17ff209c-95db-42a3-ac00-327f917c3b39 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f46a71ea0ee4e45afaea7e38e8c0ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba14e6816284d9e89e22913643f4355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:20.430415 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-63be9652-c9bd-45c0-a9bb-70ed8d44c1a5 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92894af6b8f74650ad7696e1f3ac375d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f24f86f0fc4a3ba09c2be55876c783', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:20.433698 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-17ff209c-95db-42a3-ac00-327f917c3b39 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] 10.222.0.43 "GET /compute/v2.1/servers/879c8591-9e1e-42e8-bc3f-a435fd86caaf" status: 200 len: 1320 microversion: 2.1 time: 0.372841 Oct 04 22:03:20.434799 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2042/4145] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:03:20 2022] GET /compute/v2.1/servers/879c8591-9e1e-42e8-bc3f-a435fd86caaf => generated 1320 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:03:20.441201 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-63be9652-c9bd-45c0-a9bb-70ed8d44c1a5 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92894af6b8f74650ad7696e1f3ac375d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f24f86f0fc4a3ba09c2be55876c783', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:20.443608 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-63be9652-c9bd-45c0-a9bb-70ed8d44c1a5 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92894af6b8f74650ad7696e1f3ac375d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f24f86f0fc4a3ba09c2be55876c783', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:20.444781 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-63be9652-c9bd-45c0-a9bb-70ed8d44c1a5 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] 10.222.0.43 "GET /compute/v2.1/servers/39dc4bb1-8465-4576-b490-d066c0fbb18f" status: 200 len: 1335 microversion: 2.54 time: 0.176274 Oct 04 22:03:20.459548 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2104/4146] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:03:20 2022] GET /compute/v2.1/servers/39dc4bb1-8465-4576-b490-d066c0fbb18f => generated 1335 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 22:03:20.622855 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-6fb9d182-206b-447c-9e0d-e35c8d6b65ef tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:20.624533 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-6fb9d182-206b-447c-9e0d-e35c8d6b65ef tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: e5842070-d5a3-43f9-82f8-ebce4eaf5526] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:03:20.631377 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6fb9d182-206b-447c-9e0d-e35c8d6b65ef tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:20.632180 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6fb9d182-206b-447c-9e0d-e35c8d6b65ef tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:20.632662 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6fb9d182-206b-447c-9e0d-e35c8d6b65ef tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:20.633715 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6fb9d182-206b-447c-9e0d-e35c8d6b65ef tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:20.634615 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6fb9d182-206b-447c-9e0d-e35c8d6b65ef tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:20.635205 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6fb9d182-206b-447c-9e0d-e35c8d6b65ef tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:20.745963 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-6fb9d182-206b-447c-9e0d-e35c8d6b65ef tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a1c8d841104bc9b6910bcc2c0e2bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe9283584fc4d90b0715216d867ea2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:20.777365 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-6fb9d182-206b-447c-9e0d-e35c8d6b65ef tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "GET /compute/v2.1/servers/e5842070-d5a3-43f9-82f8-ebce4eaf5526" status: 200 len: 1219 microversion: 2.1 time: 0.159828 Oct 04 22:03:20.778269 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2043/4147] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:03:20 2022] GET /compute/v2.1/servers/e5842070-d5a3-43f9-82f8-ebce4eaf5526 => generated 1219 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:03:21.457431 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-fac1f0fe-4408-4882-831e-6e526145d073 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:21.458069 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-fac1f0fe-4408-4882-831e-6e526145d073 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] [instance: 879c8591-9e1e-42e8-bc3f-a435fd86caaf] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:03:21.472335 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fac1f0fe-4408-4882-831e-6e526145d073 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:21.472535 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-1d3d474b-5d6b-4e67-bb77-708e387b61bf tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:21.473587 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fac1f0fe-4408-4882-831e-6e526145d073 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:21.474264 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-1d3d474b-5d6b-4e67-bb77-708e387b61bf tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] [instance: 39dc4bb1-8465-4576-b490-d066c0fbb18f] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:03:21.475114 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fac1f0fe-4408-4882-831e-6e526145d073 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:21.478062 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fac1f0fe-4408-4882-831e-6e526145d073 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:21.479381 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fac1f0fe-4408-4882-831e-6e526145d073 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:21.479990 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fac1f0fe-4408-4882-831e-6e526145d073 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:21.489698 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1d3d474b-5d6b-4e67-bb77-708e387b61bf tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:21.491991 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1d3d474b-5d6b-4e67-bb77-708e387b61bf tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:21.493570 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1d3d474b-5d6b-4e67-bb77-708e387b61bf tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:21.494615 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1d3d474b-5d6b-4e67-bb77-708e387b61bf tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:21.496384 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1d3d474b-5d6b-4e67-bb77-708e387b61bf tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:21.498705 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1d3d474b-5d6b-4e67-bb77-708e387b61bf tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:21.882048 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-fac1f0fe-4408-4882-831e-6e526145d073 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f46a71ea0ee4e45afaea7e38e8c0ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba14e6816284d9e89e22913643f4355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:21.893052 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-fac1f0fe-4408-4882-831e-6e526145d073 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] 10.222.0.43 "GET /compute/v2.1/servers/879c8591-9e1e-42e8-bc3f-a435fd86caaf" status: 200 len: 1320 microversion: 2.1 time: 0.440205 Oct 04 22:03:21.893648 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2105/4148] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:03:21 2022] GET /compute/v2.1/servers/879c8591-9e1e-42e8-bc3f-a435fd86caaf => generated 1320 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:03:21.902455 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-09662d0a-d4d5-45f6-908b-9149edff8da8 req-39789e86-a3b4-4faf-8687-96af85cf1cee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07e11885-b7b0-4ad1-bda6-a677b9aaf48d", "name": "network-vif-plugged", "status": "completed", "tag": "f61060d0-c909-46d7-9db6-37c2d7289758"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:03:21.926590 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-09662d0a-d4d5-45f6-908b-9149edff8da8 req-39789e86-a3b4-4faf-8687-96af85cf1cee service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:21.927365 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-09662d0a-d4d5-45f6-908b-9149edff8da8 req-39789e86-a3b4-4faf-8687-96af85cf1cee service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:21.927801 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-09662d0a-d4d5-45f6-908b-9149edff8da8 req-39789e86-a3b4-4faf-8687-96af85cf1cee service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:21.941701 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-09662d0a-d4d5-45f6-908b-9149edff8da8 req-39789e86-a3b4-4faf-8687-96af85cf1cee service nova] Creating event network-vif-plugged:f61060d0-c909-46d7-9db6-37c2d7289758 for instance 07e11885-b7b0-4ad1-bda6-a677b9aaf48d on n-h2-860284-1 Oct 04 22:03:21.948298 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-09662d0a-d4d5-45f6-908b-9149edff8da8 req-39789e86-a3b4-4faf-8687-96af85cf1cee service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049863 Oct 04 22:03:21.949525 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2106/4149] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:03:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:03:21.956858 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-2dc49eda-bdb9-4b2b-aa91-4b3d3eb8d2b9 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:21.957815 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-2dc49eda-bdb9-4b2b-aa91-4b3d3eb8d2b9 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: e5842070-d5a3-43f9-82f8-ebce4eaf5526] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:03:21.966162 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2dc49eda-bdb9-4b2b-aa91-4b3d3eb8d2b9 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:21.967234 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2dc49eda-bdb9-4b2b-aa91-4b3d3eb8d2b9 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:21.967969 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2dc49eda-bdb9-4b2b-aa91-4b3d3eb8d2b9 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:21.969377 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2dc49eda-bdb9-4b2b-aa91-4b3d3eb8d2b9 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:21.970127 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2dc49eda-bdb9-4b2b-aa91-4b3d3eb8d2b9 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:21.970967 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2dc49eda-bdb9-4b2b-aa91-4b3d3eb8d2b9 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:22.121533 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-2dc49eda-bdb9-4b2b-aa91-4b3d3eb8d2b9 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a1c8d841104bc9b6910bcc2c0e2bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe9283584fc4d90b0715216d867ea2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:22.146027 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-2dc49eda-bdb9-4b2b-aa91-4b3d3eb8d2b9 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "GET /compute/v2.1/servers/e5842070-d5a3-43f9-82f8-ebce4eaf5526" status: 200 len: 1275 microversion: 2.1 time: 0.188581 Oct 04 22:03:22.163485 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2107/4150] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:03:21 2022] GET /compute/v2.1/servers/e5842070-d5a3-43f9-82f8-ebce4eaf5526 => generated 1275 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:03:22.332613 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-1d3d474b-5d6b-4e67-bb77-708e387b61bf tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92894af6b8f74650ad7696e1f3ac375d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f24f86f0fc4a3ba09c2be55876c783', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:22.347483 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-1d3d474b-5d6b-4e67-bb77-708e387b61bf tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92894af6b8f74650ad7696e1f3ac375d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f24f86f0fc4a3ba09c2be55876c783', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:22.350020 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-1d3d474b-5d6b-4e67-bb77-708e387b61bf tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92894af6b8f74650ad7696e1f3ac375d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f24f86f0fc4a3ba09c2be55876c783', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:22.353714 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-1d3d474b-5d6b-4e67-bb77-708e387b61bf tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] 10.222.0.43 "GET /compute/v2.1/servers/39dc4bb1-8465-4576-b490-d066c0fbb18f" status: 200 len: 1335 microversion: 2.54 time: 0.883473 Oct 04 22:03:22.386857 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2044/4151] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:03:21 2022] GET /compute/v2.1/servers/39dc4bb1-8465-4576-b490-d066c0fbb18f => generated 1335 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 22:03:22.921413 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-1124513d-ac63-48b9-964b-a9cbbfc37281 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:22.922386 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-1124513d-ac63-48b9-964b-a9cbbfc37281 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] [instance: 879c8591-9e1e-42e8-bc3f-a435fd86caaf] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:03:22.958043 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1124513d-ac63-48b9-964b-a9cbbfc37281 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:22.959270 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1124513d-ac63-48b9-964b-a9cbbfc37281 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:22.960678 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1124513d-ac63-48b9-964b-a9cbbfc37281 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:22.962954 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1124513d-ac63-48b9-964b-a9cbbfc37281 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:22.964359 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1124513d-ac63-48b9-964b-a9cbbfc37281 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:22.965157 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1124513d-ac63-48b9-964b-a9cbbfc37281 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:23.176895 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-f1314ef8-7d95-4935-98cc-d916813e9d6c tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:23.178093 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-f1314ef8-7d95-4935-98cc-d916813e9d6c tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: e5842070-d5a3-43f9-82f8-ebce4eaf5526] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:03:23.189563 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f1314ef8-7d95-4935-98cc-d916813e9d6c tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:23.202555 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f1314ef8-7d95-4935-98cc-d916813e9d6c tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:23.203445 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f1314ef8-7d95-4935-98cc-d916813e9d6c tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:23.204424 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f1314ef8-7d95-4935-98cc-d916813e9d6c tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:23.205146 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f1314ef8-7d95-4935-98cc-d916813e9d6c tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:23.205815 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f1314ef8-7d95-4935-98cc-d916813e9d6c tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:24.169137 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-1124513d-ac63-48b9-964b-a9cbbfc37281 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f46a71ea0ee4e45afaea7e38e8c0ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba14e6816284d9e89e22913643f4355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:24.186603 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-1124513d-ac63-48b9-964b-a9cbbfc37281 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] 10.222.0.43 "GET /compute/v2.1/servers/879c8591-9e1e-42e8-bc3f-a435fd86caaf" status: 200 len: 1320 microversion: 2.1 time: 1.273291 Oct 04 22:03:24.189139 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2108/4152] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:03:22 2022] GET /compute/v2.1/servers/879c8591-9e1e-42e8-bc3f-a435fd86caaf => generated 1320 bytes in 1277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:03:24.222049 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-8aa73e63-1c28-4d7a-9fa7-eecf980eb255 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:24.225154 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-8aa73e63-1c28-4d7a-9fa7-eecf980eb255 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] [instance: 39dc4bb1-8465-4576-b490-d066c0fbb18f] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:03:24.252933 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8aa73e63-1c28-4d7a-9fa7-eecf980eb255 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:24.254880 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8aa73e63-1c28-4d7a-9fa7-eecf980eb255 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:24.262467 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8aa73e63-1c28-4d7a-9fa7-eecf980eb255 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:24.266929 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8aa73e63-1c28-4d7a-9fa7-eecf980eb255 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:24.267883 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8aa73e63-1c28-4d7a-9fa7-eecf980eb255 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:24.271382 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8aa73e63-1c28-4d7a-9fa7-eecf980eb255 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:24.426500 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-f1314ef8-7d95-4935-98cc-d916813e9d6c tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a1c8d841104bc9b6910bcc2c0e2bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe9283584fc4d90b0715216d867ea2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:24.450545 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-f1314ef8-7d95-4935-98cc-d916813e9d6c tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "GET /compute/v2.1/servers/e5842070-d5a3-43f9-82f8-ebce4eaf5526" status: 200 len: 1315 microversion: 2.1 time: 1.278150 Oct 04 22:03:24.468669 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2045/4153] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:03:23 2022] GET /compute/v2.1/servers/e5842070-d5a3-43f9-82f8-ebce4eaf5526 => generated 1315 bytes in 1297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:03:24.474142 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-0263b83b-66d2-45bd-aabc-28cdb7511051 req-c2a2538e-4c98-4469-89be-febeaf6f052e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27f6babc-9d2c-4ba8-8043-cd2d90f9ba7e", "name": "network-vif-plugged", "status": "completed", "tag": "c6715c1a-cde4-4b82-ab5f-4aaead73c545"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:03:24.475236 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-8aa73e63-1c28-4d7a-9fa7-eecf980eb255 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92894af6b8f74650ad7696e1f3ac375d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f24f86f0fc4a3ba09c2be55876c783', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:24.488231 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-0263b83b-66d2-45bd-aabc-28cdb7511051 req-c2a2538e-4c98-4469-89be-febeaf6f052e service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:24.489214 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-0263b83b-66d2-45bd-aabc-28cdb7511051 req-c2a2538e-4c98-4469-89be-febeaf6f052e service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:24.489952 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-0263b83b-66d2-45bd-aabc-28cdb7511051 req-c2a2538e-4c98-4469-89be-febeaf6f052e service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:24.499495 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-8aa73e63-1c28-4d7a-9fa7-eecf980eb255 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92894af6b8f74650ad7696e1f3ac375d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f24f86f0fc4a3ba09c2be55876c783', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:24.500953 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-8aa73e63-1c28-4d7a-9fa7-eecf980eb255 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92894af6b8f74650ad7696e1f3ac375d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f24f86f0fc4a3ba09c2be55876c783', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:24.502141 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-8aa73e63-1c28-4d7a-9fa7-eecf980eb255 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] 10.222.0.43 "GET /compute/v2.1/servers/39dc4bb1-8465-4576-b490-d066c0fbb18f" status: 200 len: 1335 microversion: 2.54 time: 0.311756 Oct 04 22:03:24.502754 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2109/4154] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:03:24 2022] GET /compute/v2.1/servers/39dc4bb1-8465-4576-b490-d066c0fbb18f => generated 1335 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:03:24.505693 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-0263b83b-66d2-45bd-aabc-28cdb7511051 req-c2a2538e-4c98-4469-89be-febeaf6f052e service nova] Creating event network-vif-plugged:c6715c1a-cde4-4b82-ab5f-4aaead73c545 for instance 27f6babc-9d2c-4ba8-8043-cd2d90f9ba7e on n-h2-860284-1 Oct 04 22:03:24.521792 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-0263b83b-66d2-45bd-aabc-28cdb7511051 req-c2a2538e-4c98-4469-89be-febeaf6f052e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051548 Oct 04 22:03:24.523007 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2046/4155] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:03:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:03:25.216997 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-f25b6e36-2ee4-4ac3-8300-3f45e2f71144 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:25.217635 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-f25b6e36-2ee4-4ac3-8300-3f45e2f71144 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] [instance: 879c8591-9e1e-42e8-bc3f-a435fd86caaf] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:03:25.231656 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f25b6e36-2ee4-4ac3-8300-3f45e2f71144 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:25.232162 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f25b6e36-2ee4-4ac3-8300-3f45e2f71144 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:25.232610 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f25b6e36-2ee4-4ac3-8300-3f45e2f71144 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:25.233339 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f25b6e36-2ee4-4ac3-8300-3f45e2f71144 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:25.233804 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f25b6e36-2ee4-4ac3-8300-3f45e2f71144 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:25.234238 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f25b6e36-2ee4-4ac3-8300-3f45e2f71144 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:25.480385 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-6282e3ab-3bbf-4797-9f39-418f50516058 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:25.483809 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-6282e3ab-3bbf-4797-9f39-418f50516058 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: e5842070-d5a3-43f9-82f8-ebce4eaf5526] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:03:25.507265 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6282e3ab-3bbf-4797-9f39-418f50516058 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:25.514272 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6282e3ab-3bbf-4797-9f39-418f50516058 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:25.516962 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6282e3ab-3bbf-4797-9f39-418f50516058 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:25.530402 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6282e3ab-3bbf-4797-9f39-418f50516058 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:25.531180 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6282e3ab-3bbf-4797-9f39-418f50516058 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:25.531870 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6282e3ab-3bbf-4797-9f39-418f50516058 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:25.777982 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-f25b6e36-2ee4-4ac3-8300-3f45e2f71144 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f46a71ea0ee4e45afaea7e38e8c0ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba14e6816284d9e89e22913643f4355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:25.791029 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-f25b6e36-2ee4-4ac3-8300-3f45e2f71144 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] 10.222.0.43 "GET /compute/v2.1/servers/879c8591-9e1e-42e8-bc3f-a435fd86caaf" status: 200 len: 1320 microversion: 2.1 time: 0.579687 Oct 04 22:03:25.791657 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2110/4156] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:03:25 2022] GET /compute/v2.1/servers/879c8591-9e1e-42e8-bc3f-a435fd86caaf => generated 1320 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:03:25.802053 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-cda2e7b0-664e-4078-ab60-7a8d3ed071af tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:25.802740 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-cda2e7b0-664e-4078-ab60-7a8d3ed071af tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] [instance: 39dc4bb1-8465-4576-b490-d066c0fbb18f] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:03:25.815177 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cda2e7b0-664e-4078-ab60-7a8d3ed071af tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:25.815912 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cda2e7b0-664e-4078-ab60-7a8d3ed071af tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:25.816510 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cda2e7b0-664e-4078-ab60-7a8d3ed071af tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:25.817412 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cda2e7b0-664e-4078-ab60-7a8d3ed071af tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:25.818211 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cda2e7b0-664e-4078-ab60-7a8d3ed071af tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:25.818840 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cda2e7b0-664e-4078-ab60-7a8d3ed071af tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:25.952661 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-cda2e7b0-664e-4078-ab60-7a8d3ed071af tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92894af6b8f74650ad7696e1f3ac375d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f24f86f0fc4a3ba09c2be55876c783', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:25.979546 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-cda2e7b0-664e-4078-ab60-7a8d3ed071af tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92894af6b8f74650ad7696e1f3ac375d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f24f86f0fc4a3ba09c2be55876c783', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:25.981338 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-cda2e7b0-664e-4078-ab60-7a8d3ed071af tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92894af6b8f74650ad7696e1f3ac375d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f24f86f0fc4a3ba09c2be55876c783', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:25.988794 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-cda2e7b0-664e-4078-ab60-7a8d3ed071af tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] 10.222.0.43 "GET /compute/v2.1/servers/39dc4bb1-8465-4576-b490-d066c0fbb18f" status: 200 len: 1356 microversion: 2.54 time: 0.192781 Oct 04 22:03:25.989594 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2111/4157] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:03:25 2022] GET /compute/v2.1/servers/39dc4bb1-8465-4576-b490-d066c0fbb18f => generated 1356 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:03:26.000782 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-ca224970-7b09-43f1-93f0-c87e12807033 req-0bccd6f7-c9cd-43b0-9498-7d610efe781b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5842070-d5a3-43f9-82f8-ebce4eaf5526", "tag": "cf72dec7-7df1-4b49-8368-50d5e80924eb"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:03:26.028434 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-ca224970-7b09-43f1-93f0-c87e12807033 req-0bccd6f7-c9cd-43b0-9498-7d610efe781b service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:26.028864 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-ca224970-7b09-43f1-93f0-c87e12807033 req-0bccd6f7-c9cd-43b0-9498-7d610efe781b service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:26.029312 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-ca224970-7b09-43f1-93f0-c87e12807033 req-0bccd6f7-c9cd-43b0-9498-7d610efe781b service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:26.053162 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-ca224970-7b09-43f1-93f0-c87e12807033 req-0bccd6f7-c9cd-43b0-9498-7d610efe781b service nova] Creating event network-changed:cf72dec7-7df1-4b49-8368-50d5e80924eb for instance e5842070-d5a3-43f9-82f8-ebce4eaf5526 on n-h2-860284-1 Oct 04 22:03:26.060219 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-ca224970-7b09-43f1-93f0-c87e12807033 req-0bccd6f7-c9cd-43b0-9498-7d610efe781b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068913 Oct 04 22:03:26.066458 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2112/4158] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:03:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:03:26.080042 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-aabd6fdd-6247-457d-a0f3-12e59df82b0b tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Action: 'create', calling method: .version_select at 0x7fbb3724ea60>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-666142146", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPRKDAc2ei2/I9xSxbOHPf1qvkTc+BGRZJ2NSbE1zCz1ro5Q3uVgQzqYboxRAkpfuBnJuCH4QltFfxTplNoPwObl0yjmpXLxIofmwsFiwyUuXzWoBHr0cmYj/c65X7sIxQ=="}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:03:26.093168 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-6282e3ab-3bbf-4797-9f39-418f50516058 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a1c8d841104bc9b6910bcc2c0e2bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe9283584fc4d90b0715216d867ea2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:26.101878 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-aabd6fdd-6247-457d-a0f3-12e59df82b0b tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Getting quotas for project 53f24f86f0fc4a3ba09c2be55876c783. Resources: {'key_pairs'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:03:26.108787 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-aabd6fdd-6247-457d-a0f3-12e59df82b0b tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Getting quotas for user 92894af6b8f74650ad7696e1f3ac375d and project 53f24f86f0fc4a3ba09c2be55876c783. Resources: {'key_pairs'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:03:26.111158 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-6282e3ab-3bbf-4797-9f39-418f50516058 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "GET /compute/v2.1/servers/e5842070-d5a3-43f9-82f8-ebce4eaf5526" status: 200 len: 1315 microversion: 2.1 time: 0.636637 Oct 04 22:03:26.112939 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2047/4159] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:03:25 2022] GET /compute/v2.1/servers/e5842070-d5a3-43f9-82f8-ebce4eaf5526 => generated 1315 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:03:26.172894 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-aabd6fdd-6247-457d-a0f3-12e59df82b0b tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 201 len: 419 microversion: 2.54 time: 0.104874 Oct 04 22:03:26.173721 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2113/4160] 10.222.0.43 () {62 vars in 1200 bytes} [Tue Oct 4 22:03:26 2022] POST /compute/v2.1/os-keypairs => generated 419 bytes in 106 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 04 22:03:26.185824 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-01a19db9-2511-419c-a1f2-9a698194a428 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-666142146", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:03:26.189126 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-01a19db9-2511-419c-a1f2-9a698194a428 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] [instance: 39dc4bb1-8465-4576-b490-d066c0fbb18f] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:03:26.199541 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-01a19db9-2511-419c-a1f2-9a698194a428 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:26.200046 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-01a19db9-2511-419c-a1f2-9a698194a428 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:26.200487 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-01a19db9-2511-419c-a1f2-9a698194a428 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:26.201196 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-01a19db9-2511-419c-a1f2-9a698194a428 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:26.201785 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-01a19db9-2511-419c-a1f2-9a698194a428 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:26.202462 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-01a19db9-2511-419c-a1f2-9a698194a428 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:26.385767 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-01a19db9-2511-419c-a1f2-9a698194a428 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Flavor limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 22:03:26.386381 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-01a19db9-2511-419c-a1f2-9a698194a428 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Image limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 22:03:26.387012 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-01a19db9-2511-419c-a1f2-9a698194a428 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Flavor pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 22:03:26.387442 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-01a19db9-2511-419c-a1f2-9a698194a428 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Image pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 22:03:26.387867 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-01a19db9-2511-419c-a1f2-9a698194a428 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 22:03:26.519606 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-6abcfe62-a3cd-441b-bb1d-cc0acb52a37e tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1801885481", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452", "networks": [{"uuid": "54dc583b-b197-4250-8660-141d8275cae0"}]}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:03:26.566276 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-01a19db9-2511-419c-a1f2-9a698194a428 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] [instance: 39dc4bb1-8465-4576-b490-d066c0fbb18f] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:03:26.581307 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-01a19db9-2511-419c-a1f2-9a698194a428 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:26.582038 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-01a19db9-2511-419c-a1f2-9a698194a428 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:26.582885 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-01a19db9-2511-419c-a1f2-9a698194a428 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:26.583906 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-01a19db9-2511-419c-a1f2-9a698194a428 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:26.584657 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-01a19db9-2511-419c-a1f2-9a698194a428 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:26.585245 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-01a19db9-2511-419c-a1f2-9a698194a428 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:26.631968 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.network.neutron [None req-6abcfe62-a3cd-441b-bb1d-cc0acb52a37e tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] validate_networks() for [('54dc583b-b197-4250-8660-141d8275cae0', None, None, None, None, None)] {{(pid=134102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 22:03:26.639739 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-01a19db9-2511-419c-a1f2-9a698194a428 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] 10.222.0.43 "POST /compute/v2.1/servers/39dc4bb1-8465-4576-b490-d066c0fbb18f/action" status: 202 len: 1138 microversion: 2.54 time: 0.458336 Oct 04 22:03:26.640980 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2048/4161] 10.222.0.43 () {62 vars in 1320 bytes} [Tue Oct 4 22:03:26 2022] POST /compute/v2.1/servers/39dc4bb1-8465-4576-b490-d066c0fbb18f/action => generated 1138 bytes in 461 msecs (HTTP/1.1 202) 10 headers in 454 bytes (2 switches on core 0) Oct 04 22:03:26.665961 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-a15d0b6e-1d7a-45e2-aedf-0a2f1a1363fe tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:26.666889 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-a15d0b6e-1d7a-45e2-aedf-0a2f1a1363fe tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] [instance: 39dc4bb1-8465-4576-b490-d066c0fbb18f] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:03:26.680938 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a15d0b6e-1d7a-45e2-aedf-0a2f1a1363fe tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:26.681738 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a15d0b6e-1d7a-45e2-aedf-0a2f1a1363fe tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:26.685694 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a15d0b6e-1d7a-45e2-aedf-0a2f1a1363fe tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:26.686833 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a15d0b6e-1d7a-45e2-aedf-0a2f1a1363fe tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:26.687629 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a15d0b6e-1d7a-45e2-aedf-0a2f1a1363fe tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:26.688267 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a15d0b6e-1d7a-45e2-aedf-0a2f1a1363fe tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:26.839602 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-a15d0b6e-1d7a-45e2-aedf-0a2f1a1363fe tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92894af6b8f74650ad7696e1f3ac375d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f24f86f0fc4a3ba09c2be55876c783', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:26.855286 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-a15d0b6e-1d7a-45e2-aedf-0a2f1a1363fe tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92894af6b8f74650ad7696e1f3ac375d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f24f86f0fc4a3ba09c2be55876c783', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:26.856875 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-a15d0b6e-1d7a-45e2-aedf-0a2f1a1363fe tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92894af6b8f74650ad7696e1f3ac375d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f24f86f0fc4a3ba09c2be55876c783', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:26.858116 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-a15d0b6e-1d7a-45e2-aedf-0a2f1a1363fe tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] 10.222.0.43 "GET /compute/v2.1/servers/39dc4bb1-8465-4576-b490-d066c0fbb18f" status: 200 len: 1407 microversion: 2.54 time: 0.197471 Oct 04 22:03:26.861646 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2049/4162] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:03:26 2022] GET /compute/v2.1/servers/39dc4bb1-8465-4576-b490-d066c0fbb18f => generated 1407 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 22:03:26.870221 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-d50359b6-230f-406a-80d1-1c472611ea83 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:26.877843 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-d50359b6-230f-406a-80d1-1c472611ea83 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] [instance: 879c8591-9e1e-42e8-bc3f-a435fd86caaf] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:03:26.892203 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d50359b6-230f-406a-80d1-1c472611ea83 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:26.893052 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d50359b6-230f-406a-80d1-1c472611ea83 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:26.898982 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d50359b6-230f-406a-80d1-1c472611ea83 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:26.899888 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d50359b6-230f-406a-80d1-1c472611ea83 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:26.900441 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d50359b6-230f-406a-80d1-1c472611ea83 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:26.900886 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d50359b6-230f-406a-80d1-1c472611ea83 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:26.937262 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:03:27.257597 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-d50359b6-230f-406a-80d1-1c472611ea83 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f46a71ea0ee4e45afaea7e38e8c0ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba14e6816284d9e89e22913643f4355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:27.270749 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-d50359b6-230f-406a-80d1-1c472611ea83 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] 10.222.0.43 "GET /compute/v2.1/servers/879c8591-9e1e-42e8-bc3f-a435fd86caaf" status: 200 len: 1320 microversion: 2.1 time: 0.407687 Oct 04 22:03:27.287191 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2050/4163] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:03:26 2022] GET /compute/v2.1/servers/879c8591-9e1e-42e8-bc3f-a435fd86caaf => generated 1320 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:03:27.293728 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-3ef84368-cfd7-4d6a-8463-1288f95d2707 req-84c60e19-2b43-42b3-a1d6-2cc178fdd17a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "879c8591-9e1e-42e8-bc3f-a435fd86caaf", "name": "network-vif-plugged", "status": "completed", "tag": "37aaf4df-3249-45b9-9aad-48fecc563a6a"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:03:27.304034 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-3ef84368-cfd7-4d6a-8463-1288f95d2707 req-84c60e19-2b43-42b3-a1d6-2cc178fdd17a service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:27.305540 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-3ef84368-cfd7-4d6a-8463-1288f95d2707 req-84c60e19-2b43-42b3-a1d6-2cc178fdd17a service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:27.306298 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-3ef84368-cfd7-4d6a-8463-1288f95d2707 req-84c60e19-2b43-42b3-a1d6-2cc178fdd17a service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:27.319736 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-3ef84368-cfd7-4d6a-8463-1288f95d2707 req-84c60e19-2b43-42b3-a1d6-2cc178fdd17a service nova] Creating event network-vif-plugged:37aaf4df-3249-45b9-9aad-48fecc563a6a for instance 879c8591-9e1e-42e8-bc3f-a435fd86caaf on n-h1-860284-1 Oct 04 22:03:27.325522 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-3ef84368-cfd7-4d6a-8463-1288f95d2707 req-84c60e19-2b43-42b3-a1d6-2cc178fdd17a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036991 Oct 04 22:03:27.326136 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2051/4164] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:03:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:03:27.331594 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-915c042e-5b77-4273-a9a8-8a244f98f8c9 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:27.332789 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-915c042e-5b77-4273-a9a8-8a244f98f8c9 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: e5842070-d5a3-43f9-82f8-ebce4eaf5526] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:03:27.341792 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-915c042e-5b77-4273-a9a8-8a244f98f8c9 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:27.343488 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-915c042e-5b77-4273-a9a8-8a244f98f8c9 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:27.344143 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-915c042e-5b77-4273-a9a8-8a244f98f8c9 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:27.345052 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-915c042e-5b77-4273-a9a8-8a244f98f8c9 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:27.346489 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-915c042e-5b77-4273-a9a8-8a244f98f8c9 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:27.347127 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-915c042e-5b77-4273-a9a8-8a244f98f8c9 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:27.389666 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-6abcfe62-a3cd-441b-bb1d-cc0acb52a37e tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Flavor limits 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 22:03:27.390323 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-6abcfe62-a3cd-441b-bb1d-cc0acb52a37e tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Image limits 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 22:03:27.391020 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-6abcfe62-a3cd-441b-bb1d-cc0acb52a37e tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Flavor pref 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 22:03:27.391452 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-6abcfe62-a3cd-441b-bb1d-cc0acb52a37e tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Image pref 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 22:03:27.391878 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-6abcfe62-a3cd-441b-bb1d-cc0acb52a37e tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 22:03:27.405212 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6abcfe62-a3cd-441b-bb1d-cc0acb52a37e tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:27.406108 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6abcfe62-a3cd-441b-bb1d-cc0acb52a37e tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:27.406819 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6abcfe62-a3cd-441b-bb1d-cc0acb52a37e tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:27.407911 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6abcfe62-a3cd-441b-bb1d-cc0acb52a37e tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:27.408635 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6abcfe62-a3cd-441b-bb1d-cc0acb52a37e tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:27.409307 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6abcfe62-a3cd-441b-bb1d-cc0acb52a37e tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:27.432789 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-6abcfe62-a3cd-441b-bb1d-cc0acb52a37e tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Getting quotas for project a1e037651e3345a8b95ea528cae02c9f. Resources: {'instances', 'ram', 'cores'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:03:27.441072 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-6abcfe62-a3cd-441b-bb1d-cc0acb52a37e tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Getting quotas for user 9973de86311b47e882de18efbcb3f67f and project a1e037651e3345a8b95ea528cae02c9f. Resources: {'instances', 'ram', 'cores'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:03:27.456478 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-6abcfe62-a3cd-441b-bb1d-cc0acb52a37e tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Going to run 1 instances... {{(pid=134102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 22:03:27.459530 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-6abcfe62-a3cd-441b-bb1d-cc0acb52a37e tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] [instance: ad97980f-d9c5-4237-b84a-2a13dfbc7764] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='58548514-5dac-426c-81f5-19e3fba33e23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 22:03:27.564066 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-6abcfe62-a3cd-441b-bb1d-cc0acb52a37e tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.187208 Oct 04 22:03:27.564771 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2114/4165] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 22:03:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 1191 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 22:03:27.577178 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-a87f336b-9055-4821-bfca-1e2626713b57 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:27.578156 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-a87f336b-9055-4821-bfca-1e2626713b57 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] [instance: ad97980f-d9c5-4237-b84a-2a13dfbc7764] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:03:27.625539 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-915c042e-5b77-4273-a9a8-8a244f98f8c9 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a1c8d841104bc9b6910bcc2c0e2bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe9283584fc4d90b0715216d867ea2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:27.637422 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-915c042e-5b77-4273-a9a8-8a244f98f8c9 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "GET /compute/v2.1/servers/e5842070-d5a3-43f9-82f8-ebce4eaf5526" status: 200 len: 1315 microversion: 2.1 time: 0.309705 Oct 04 22:03:27.638163 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2052/4166] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:03:27 2022] GET /compute/v2.1/servers/e5842070-d5a3-43f9-82f8-ebce4eaf5526 => generated 1315 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:03:27.673619 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-a87f336b-9055-4821-bfca-1e2626713b57 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973de86311b47e882de18efbcb3f67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e037651e3345a8b95ea528cae02c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:27.681243 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-a87f336b-9055-4821-bfca-1e2626713b57 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] 10.222.0.43 "GET /compute/v2.1/servers/ad97980f-d9c5-4237-b84a-2a13dfbc7764" status: 200 len: 1225 microversion: 2.1 time: 0.108306 Oct 04 22:03:27.682002 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2115/4167] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:03:27 2022] GET /compute/v2.1/servers/ad97980f-d9c5-4237-b84a-2a13dfbc7764 => generated 1225 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:03:27.892557 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-b5f01a65-a8a5-42f6-8249-0f8b6afb0369 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:27.893270 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-b5f01a65-a8a5-42f6-8249-0f8b6afb0369 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] [instance: 39dc4bb1-8465-4576-b490-d066c0fbb18f] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:03:27.903637 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b5f01a65-a8a5-42f6-8249-0f8b6afb0369 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:27.905128 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b5f01a65-a8a5-42f6-8249-0f8b6afb0369 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:27.906143 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b5f01a65-a8a5-42f6-8249-0f8b6afb0369 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:27.907098 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b5f01a65-a8a5-42f6-8249-0f8b6afb0369 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:27.908232 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b5f01a65-a8a5-42f6-8249-0f8b6afb0369 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:27.908864 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b5f01a65-a8a5-42f6-8249-0f8b6afb0369 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:28.030179 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-b5f01a65-a8a5-42f6-8249-0f8b6afb0369 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92894af6b8f74650ad7696e1f3ac375d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f24f86f0fc4a3ba09c2be55876c783', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:28.040599 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-b5f01a65-a8a5-42f6-8249-0f8b6afb0369 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92894af6b8f74650ad7696e1f3ac375d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f24f86f0fc4a3ba09c2be55876c783', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:28.046041 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-b5f01a65-a8a5-42f6-8249-0f8b6afb0369 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92894af6b8f74650ad7696e1f3ac375d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f24f86f0fc4a3ba09c2be55876c783', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:28.049071 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-b5f01a65-a8a5-42f6-8249-0f8b6afb0369 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] 10.222.0.43 "GET /compute/v2.1/servers/39dc4bb1-8465-4576-b490-d066c0fbb18f" status: 200 len: 1407 microversion: 2.54 time: 0.161239 Oct 04 22:03:28.050627 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2053/4168] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:03:27 2022] GET /compute/v2.1/servers/39dc4bb1-8465-4576-b490-d066c0fbb18f => generated 1407 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:03:28.299836 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-af245620-db14-477a-9dc9-68cbf8fcf598 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:28.300471 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-af245620-db14-477a-9dc9-68cbf8fcf598 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] [instance: 879c8591-9e1e-42e8-bc3f-a435fd86caaf] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:03:28.313385 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-af245620-db14-477a-9dc9-68cbf8fcf598 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:28.313903 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-af245620-db14-477a-9dc9-68cbf8fcf598 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:28.314332 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-af245620-db14-477a-9dc9-68cbf8fcf598 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:28.315091 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-af245620-db14-477a-9dc9-68cbf8fcf598 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:28.315554 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-af245620-db14-477a-9dc9-68cbf8fcf598 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:28.315987 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-af245620-db14-477a-9dc9-68cbf8fcf598 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:28.581854 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-af245620-db14-477a-9dc9-68cbf8fcf598 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f46a71ea0ee4e45afaea7e38e8c0ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba14e6816284d9e89e22913643f4355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:28.595284 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-af245620-db14-477a-9dc9-68cbf8fcf598 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] 10.222.0.43 "GET /compute/v2.1/servers/879c8591-9e1e-42e8-bc3f-a435fd86caaf" status: 200 len: 1320 microversion: 2.1 time: 0.299433 Oct 04 22:03:28.609602 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2116/4169] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:03:28 2022] GET /compute/v2.1/servers/879c8591-9e1e-42e8-bc3f-a435fd86caaf => generated 1320 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:03:28.665659 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-2420d379-c9ad-4144-823c-21099856b4a1 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:28.666323 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-2420d379-c9ad-4144-823c-21099856b4a1 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: e5842070-d5a3-43f9-82f8-ebce4eaf5526] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:03:28.686971 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2420d379-c9ad-4144-823c-21099856b4a1 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:28.690301 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2420d379-c9ad-4144-823c-21099856b4a1 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:28.691434 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2420d379-c9ad-4144-823c-21099856b4a1 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:28.692316 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2420d379-c9ad-4144-823c-21099856b4a1 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:28.693848 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2420d379-c9ad-4144-823c-21099856b4a1 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:28.694565 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2420d379-c9ad-4144-823c-21099856b4a1 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:28.706847 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-a204cb3a-2135-4021-9e3e-02299841c360 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:28.707538 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-a204cb3a-2135-4021-9e3e-02299841c360 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] [instance: ad97980f-d9c5-4237-b84a-2a13dfbc7764] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:03:28.715895 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a204cb3a-2135-4021-9e3e-02299841c360 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:28.716402 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a204cb3a-2135-4021-9e3e-02299841c360 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:28.716840 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a204cb3a-2135-4021-9e3e-02299841c360 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:28.717560 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a204cb3a-2135-4021-9e3e-02299841c360 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:28.718415 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a204cb3a-2135-4021-9e3e-02299841c360 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:28.718875 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a204cb3a-2135-4021-9e3e-02299841c360 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:28.904356 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-a204cb3a-2135-4021-9e3e-02299841c360 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973de86311b47e882de18efbcb3f67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e037651e3345a8b95ea528cae02c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:28.917132 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-a204cb3a-2135-4021-9e3e-02299841c360 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] 10.222.0.43 "GET /compute/v2.1/servers/ad97980f-d9c5-4237-b84a-2a13dfbc7764" status: 200 len: 1221 microversion: 2.1 time: 0.216475 Oct 04 22:03:28.930398 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2117/4170] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:03:28 2022] GET /compute/v2.1/servers/ad97980f-d9c5-4237-b84a-2a13dfbc7764 => generated 1221 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:03:29.076151 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-c94d3542-4506-4d1e-b51c-6f20799ebc58 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:29.076777 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-c94d3542-4506-4d1e-b51c-6f20799ebc58 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] [instance: 39dc4bb1-8465-4576-b490-d066c0fbb18f] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:03:29.079033 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-2420d379-c9ad-4144-823c-21099856b4a1 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a1c8d841104bc9b6910bcc2c0e2bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe9283584fc4d90b0715216d867ea2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:29.108672 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-2420d379-c9ad-4144-823c-21099856b4a1 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "GET /compute/v2.1/servers/e5842070-d5a3-43f9-82f8-ebce4eaf5526" status: 200 len: 1315 microversion: 2.1 time: 0.449569 Oct 04 22:03:29.114533 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c94d3542-4506-4d1e-b51c-6f20799ebc58 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:29.115414 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c94d3542-4506-4d1e-b51c-6f20799ebc58 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:29.116955 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c94d3542-4506-4d1e-b51c-6f20799ebc58 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:29.120809 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2054/4171] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:03:28 2022] GET /compute/v2.1/servers/e5842070-d5a3-43f9-82f8-ebce4eaf5526 => generated 1315 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:03:29.122212 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c94d3542-4506-4d1e-b51c-6f20799ebc58 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:29.122918 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c94d3542-4506-4d1e-b51c-6f20799ebc58 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:29.123564 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c94d3542-4506-4d1e-b51c-6f20799ebc58 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:29.314833 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-c94d3542-4506-4d1e-b51c-6f20799ebc58 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92894af6b8f74650ad7696e1f3ac375d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f24f86f0fc4a3ba09c2be55876c783', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:29.327639 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-c94d3542-4506-4d1e-b51c-6f20799ebc58 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92894af6b8f74650ad7696e1f3ac375d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f24f86f0fc4a3ba09c2be55876c783', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:29.331233 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-c94d3542-4506-4d1e-b51c-6f20799ebc58 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92894af6b8f74650ad7696e1f3ac375d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f24f86f0fc4a3ba09c2be55876c783', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:29.332390 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-c94d3542-4506-4d1e-b51c-6f20799ebc58 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] 10.222.0.43 "GET /compute/v2.1/servers/39dc4bb1-8465-4576-b490-d066c0fbb18f" status: 200 len: 1407 microversion: 2.54 time: 0.260365 Oct 04 22:03:29.335707 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2118/4172] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:03:29 2022] GET /compute/v2.1/servers/39dc4bb1-8465-4576-b490-d066c0fbb18f => generated 1407 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 22:03:29.620069 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-97924b33-4a3f-4046-9790-d14e482686d8 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:29.620627 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-97924b33-4a3f-4046-9790-d14e482686d8 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] [instance: 879c8591-9e1e-42e8-bc3f-a435fd86caaf] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:03:29.622677 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=6 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:03:29.623964 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=20 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:03:29.641552 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-97924b33-4a3f-4046-9790-d14e482686d8 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:29.642081 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-97924b33-4a3f-4046-9790-d14e482686d8 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:29.642560 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-97924b33-4a3f-4046-9790-d14e482686d8 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:29.643927 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-97924b33-4a3f-4046-9790-d14e482686d8 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:29.647485 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-97924b33-4a3f-4046-9790-d14e482686d8 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:29.648152 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-97924b33-4a3f-4046-9790-d14e482686d8 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:29.895015 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-97924b33-4a3f-4046-9790-d14e482686d8 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f46a71ea0ee4e45afaea7e38e8c0ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba14e6816284d9e89e22913643f4355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:29.908176 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-97924b33-4a3f-4046-9790-d14e482686d8 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] 10.222.0.43 "GET /compute/v2.1/servers/879c8591-9e1e-42e8-bc3f-a435fd86caaf" status: 200 len: 1511 microversion: 2.1 time: 0.292567 Oct 04 22:03:29.909314 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2055/4173] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:03:29 2022] GET /compute/v2.1/servers/879c8591-9e1e-42e8-bc3f-a435fd86caaf => generated 1511 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:03:29.946109 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-6349ed47-f897-4abe-8634-22b408d9e5ff tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:29.946778 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-5c91cf39-23d8-42ed-a28a-0639647afff8 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:29.946865 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-6349ed47-f897-4abe-8634-22b408d9e5ff tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] [instance: 07e11885-b7b0-4ad1-bda6-a677b9aaf48d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:03:29.947037 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-5c91cf39-23d8-42ed-a28a-0639647afff8 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] [instance: ad97980f-d9c5-4237-b84a-2a13dfbc7764] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:03:29.963591 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6349ed47-f897-4abe-8634-22b408d9e5ff tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:29.964600 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5c91cf39-23d8-42ed-a28a-0639647afff8 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:29.965102 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5c91cf39-23d8-42ed-a28a-0639647afff8 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:29.965547 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5c91cf39-23d8-42ed-a28a-0639647afff8 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:29.966275 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5c91cf39-23d8-42ed-a28a-0639647afff8 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:29.966757 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5c91cf39-23d8-42ed-a28a-0639647afff8 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:29.967187 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5c91cf39-23d8-42ed-a28a-0639647afff8 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:29.967648 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6349ed47-f897-4abe-8634-22b408d9e5ff tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:29.970782 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6349ed47-f897-4abe-8634-22b408d9e5ff tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:29.972953 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6349ed47-f897-4abe-8634-22b408d9e5ff tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:29.977435 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6349ed47-f897-4abe-8634-22b408d9e5ff tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:29.977902 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6349ed47-f897-4abe-8634-22b408d9e5ff tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:30.105371 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-5c91cf39-23d8-42ed-a28a-0639647afff8 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973de86311b47e882de18efbcb3f67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e037651e3345a8b95ea528cae02c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:30.127501 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-5c91cf39-23d8-42ed-a28a-0639647afff8 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] 10.222.0.43 "GET /compute/v2.1/servers/ad97980f-d9c5-4237-b84a-2a13dfbc7764" status: 200 len: 1285 microversion: 2.1 time: 0.185210 Oct 04 22:03:30.128106 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2056/4174] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:03:29 2022] GET /compute/v2.1/servers/ad97980f-d9c5-4237-b84a-2a13dfbc7764 => generated 1285 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:03:30.152074 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-f921704f-8154-42a7-82cd-e8c3a0b7d219 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:30.156731 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-f921704f-8154-42a7-82cd-e8c3a0b7d219 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: e5842070-d5a3-43f9-82f8-ebce4eaf5526] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:03:30.175226 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f921704f-8154-42a7-82cd-e8c3a0b7d219 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:30.176136 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f921704f-8154-42a7-82cd-e8c3a0b7d219 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:30.176777 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f921704f-8154-42a7-82cd-e8c3a0b7d219 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:30.178346 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f921704f-8154-42a7-82cd-e8c3a0b7d219 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:30.179039 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f921704f-8154-42a7-82cd-e8c3a0b7d219 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:30.180825 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f921704f-8154-42a7-82cd-e8c3a0b7d219 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:30.511532 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-6349ed47-f897-4abe-8634-22b408d9e5ff tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f46a71ea0ee4e45afaea7e38e8c0ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba14e6816284d9e89e22913643f4355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:30.530501 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-6349ed47-f897-4abe-8634-22b408d9e5ff tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] 10.222.0.43 "GET /compute/v2.1/servers/07e11885-b7b0-4ad1-bda6-a677b9aaf48d" status: 200 len: 1510 microversion: 2.1 time: 0.600376 Oct 04 22:03:30.533377 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2119/4175] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:03:29 2022] GET /compute/v2.1/servers/07e11885-b7b0-4ad1-bda6-a677b9aaf48d => generated 1510 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:03:30.543888 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-56050670-962a-4b4f-b8f8-8e19b8f3f382 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:30.547954 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-56050670-962a-4b4f-b8f8-8e19b8f3f382 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] [instance: 39dc4bb1-8465-4576-b490-d066c0fbb18f] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:03:30.565108 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-56050670-962a-4b4f-b8f8-8e19b8f3f382 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:30.565611 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-56050670-962a-4b4f-b8f8-8e19b8f3f382 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:30.571189 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-56050670-962a-4b4f-b8f8-8e19b8f3f382 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:30.572188 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-56050670-962a-4b4f-b8f8-8e19b8f3f382 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:30.575899 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-56050670-962a-4b4f-b8f8-8e19b8f3f382 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:30.577497 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-56050670-962a-4b4f-b8f8-8e19b8f3f382 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:30.705020 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-56050670-962a-4b4f-b8f8-8e19b8f3f382 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92894af6b8f74650ad7696e1f3ac375d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f24f86f0fc4a3ba09c2be55876c783', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:30.720912 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-56050670-962a-4b4f-b8f8-8e19b8f3f382 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92894af6b8f74650ad7696e1f3ac375d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f24f86f0fc4a3ba09c2be55876c783', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:30.727305 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-56050670-962a-4b4f-b8f8-8e19b8f3f382 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92894af6b8f74650ad7696e1f3ac375d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f24f86f0fc4a3ba09c2be55876c783', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:30.729059 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-56050670-962a-4b4f-b8f8-8e19b8f3f382 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] 10.222.0.43 "GET /compute/v2.1/servers/39dc4bb1-8465-4576-b490-d066c0fbb18f" status: 200 len: 1407 microversion: 2.54 time: 0.194408 Oct 04 22:03:30.731898 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2120/4176] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:03:30 2022] GET /compute/v2.1/servers/39dc4bb1-8465-4576-b490-d066c0fbb18f => generated 1407 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:03:30.752252 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-03d6d4e9-54a5-431a-91f0-dfb761b37f98 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:30.764907 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-03d6d4e9-54a5-431a-91f0-dfb761b37f98 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] [instance: 27f6babc-9d2c-4ba8-8043-cd2d90f9ba7e] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:03:30.780061 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-03d6d4e9-54a5-431a-91f0-dfb761b37f98 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:30.780642 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-03d6d4e9-54a5-431a-91f0-dfb761b37f98 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:30.781098 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-03d6d4e9-54a5-431a-91f0-dfb761b37f98 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:30.782720 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-03d6d4e9-54a5-431a-91f0-dfb761b37f98 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:30.783343 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-03d6d4e9-54a5-431a-91f0-dfb761b37f98 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:30.796526 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-03d6d4e9-54a5-431a-91f0-dfb761b37f98 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:30.992241 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-f921704f-8154-42a7-82cd-e8c3a0b7d219 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a1c8d841104bc9b6910bcc2c0e2bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe9283584fc4d90b0715216d867ea2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:31.000784 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-f921704f-8154-42a7-82cd-e8c3a0b7d219 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "GET /compute/v2.1/servers/e5842070-d5a3-43f9-82f8-ebce4eaf5526" status: 200 len: 1315 microversion: 2.1 time: 0.860730 Oct 04 22:03:31.001388 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2057/4177] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:03:30 2022] GET /compute/v2.1/servers/e5842070-d5a3-43f9-82f8-ebce4eaf5526 => generated 1315 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:03:31.073941 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-03d6d4e9-54a5-431a-91f0-dfb761b37f98 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f46a71ea0ee4e45afaea7e38e8c0ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba14e6816284d9e89e22913643f4355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:31.091667 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-03d6d4e9-54a5-431a-91f0-dfb761b37f98 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] 10.222.0.43 "GET /compute/v2.1/servers/27f6babc-9d2c-4ba8-8043-cd2d90f9ba7e" status: 200 len: 1510 microversion: 2.1 time: 0.358257 Oct 04 22:03:31.105866 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2121/4178] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:03:30 2022] GET /compute/v2.1/servers/27f6babc-9d2c-4ba8-8043-cd2d90f9ba7e => generated 1510 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:03:31.116339 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-cdadf356-f06b-42a5-a331-c04d20f5437c tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:31.137840 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-cdadf356-f06b-42a5-a331-c04d20f5437c tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9f46a71ea0ee4e45afaea7e38e8c0ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba14e6816284d9e89e22913643f4355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:31.138758 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-cdadf356-f06b-42a5-a331-c04d20f5437c tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': 'fba14e6816284d9e89e22913643f4355'} {{(pid=134101) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 22:03:31.154104 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cdadf356-f06b-42a5-a331-c04d20f5437c tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:31.155011 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cdadf356-f06b-42a5-a331-c04d20f5437c tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:31.155581 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-31f6b0a8-4e1b-41c2-a579-cb6f208b5a61 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:31.156157 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cdadf356-f06b-42a5-a331-c04d20f5437c tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:31.156833 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cdadf356-f06b-42a5-a331-c04d20f5437c tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:31.157468 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cdadf356-f06b-42a5-a331-c04d20f5437c tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:31.157605 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-31f6b0a8-4e1b-41c2-a579-cb6f208b5a61 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] [instance: ad97980f-d9c5-4237-b84a-2a13dfbc7764] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:03:31.158181 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cdadf356-f06b-42a5-a331-c04d20f5437c tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:31.172947 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:03:31.174597 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-31f6b0a8-4e1b-41c2-a579-cb6f208b5a61 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:31.175132 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-31f6b0a8-4e1b-41c2-a579-cb6f208b5a61 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:31.175590 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-31f6b0a8-4e1b-41c2-a579-cb6f208b5a61 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:31.177400 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-31f6b0a8-4e1b-41c2-a579-cb6f208b5a61 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:31.177906 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-31f6b0a8-4e1b-41c2-a579-cb6f208b5a61 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:31.178728 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-31f6b0a8-4e1b-41c2-a579-cb6f208b5a61 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:31.270789 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.multi_cell_list [None req-cdadf356-f06b-42a5-a331-c04d20f5437c tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=134101) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 22:03:31.279275 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-31f6b0a8-4e1b-41c2-a579-cb6f208b5a61 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973de86311b47e882de18efbcb3f67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e037651e3345a8b95ea528cae02c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:31.292254 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-31f6b0a8-4e1b-41c2-a579-cb6f208b5a61 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] 10.222.0.43 "GET /compute/v2.1/servers/ad97980f-d9c5-4237-b84a-2a13dfbc7764" status: 200 len: 1283 microversion: 2.1 time: 0.141925 Oct 04 22:03:31.293703 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2122/4179] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:03:31 2022] GET /compute/v2.1/servers/ad97980f-d9c5-4237-b84a-2a13dfbc7764 => generated 1283 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:03:31.350340 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-cdadf356-f06b-42a5-a331-c04d20f5437c tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f46a71ea0ee4e45afaea7e38e8c0ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba14e6816284d9e89e22913643f4355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:31.357393 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cdadf356-f06b-42a5-a331-c04d20f5437c tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:31.358120 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cdadf356-f06b-42a5-a331-c04d20f5437c tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:31.358746 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cdadf356-f06b-42a5-a331-c04d20f5437c tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:31.594209 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-cdadf356-f06b-42a5-a331-c04d20f5437c tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] 10.222.0.43 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1514 microversion: 2.1 time: 0.482252 Oct 04 22:03:31.595487 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2058/4180] 10.222.0.43 () {58 vars in 1167 bytes} [Tue Oct 4 22:03:31 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1514 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:03:31.624328 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-0ae8d095-d034-4d46-b31c-aa9761288aaa tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:31.635287 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-0ae8d095-d034-4d46-b31c-aa9761288aaa tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9f46a71ea0ee4e45afaea7e38e8c0ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba14e6816284d9e89e22913643f4355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:31.640492 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-0ae8d095-d034-4d46-b31c-aa9761288aaa tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-816538895', 'deleted': False, 'project_id': 'fba14e6816284d9e89e22913643f4355'} {{(pid=134102) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 22:03:31.650709 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0ae8d095-d034-4d46-b31c-aa9761288aaa tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:31.657319 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0ae8d095-d034-4d46-b31c-aa9761288aaa tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:31.658117 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0ae8d095-d034-4d46-b31c-aa9761288aaa tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:31.660147 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0ae8d095-d034-4d46-b31c-aa9761288aaa tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:31.660839 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0ae8d095-d034-4d46-b31c-aa9761288aaa tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:31.661475 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0ae8d095-d034-4d46-b31c-aa9761288aaa tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:31.751653 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-61c866c2-6d18-4bc4-b908-0cfd1706b726 req-eb348575-2a61-42d9-82eb-2ea411068964 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5842070-d5a3-43f9-82f8-ebce4eaf5526", "name": "network-vif-plugged", "status": "completed", "tag": "cf72dec7-7df1-4b49-8368-50d5e80924eb"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:03:31.779241 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-61c866c2-6d18-4bc4-b908-0cfd1706b726 req-eb348575-2a61-42d9-82eb-2ea411068964 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:31.779736 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-61c866c2-6d18-4bc4-b908-0cfd1706b726 req-eb348575-2a61-42d9-82eb-2ea411068964 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:31.780164 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-61c866c2-6d18-4bc4-b908-0cfd1706b726 req-eb348575-2a61-42d9-82eb-2ea411068964 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:31.818928 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-61c866c2-6d18-4bc4-b908-0cfd1706b726 req-eb348575-2a61-42d9-82eb-2ea411068964 service nova] Creating event network-vif-plugged:cf72dec7-7df1-4b49-8368-50d5e80924eb for instance e5842070-d5a3-43f9-82f8-ebce4eaf5526 on n-h2-860284-1 Oct 04 22:03:31.834045 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-61c866c2-6d18-4bc4-b908-0cfd1706b726 req-eb348575-2a61-42d9-82eb-2ea411068964 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087124 Oct 04 22:03:31.835149 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2059/4181] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:03:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:03:31.850994 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-bcdefb9e-9c1d-46ec-b0d8-c658fd4b4bf4 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:31.860949 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-bcdefb9e-9c1d-46ec-b0d8-c658fd4b4bf4 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] [instance: 39dc4bb1-8465-4576-b490-d066c0fbb18f] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:03:31.868211 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bcdefb9e-9c1d-46ec-b0d8-c658fd4b4bf4 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:31.869074 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bcdefb9e-9c1d-46ec-b0d8-c658fd4b4bf4 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:31.869842 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bcdefb9e-9c1d-46ec-b0d8-c658fd4b4bf4 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:31.870864 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bcdefb9e-9c1d-46ec-b0d8-c658fd4b4bf4 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:31.873748 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bcdefb9e-9c1d-46ec-b0d8-c658fd4b4bf4 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:31.874465 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bcdefb9e-9c1d-46ec-b0d8-c658fd4b4bf4 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:31.887454 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.multi_cell_list [None req-0ae8d095-d034-4d46-b31c-aa9761288aaa tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=134102) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 22:03:32.020363 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-0ae8d095-d034-4d46-b31c-aa9761288aaa tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f46a71ea0ee4e45afaea7e38e8c0ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba14e6816284d9e89e22913643f4355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:32.020976 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-bcdefb9e-9c1d-46ec-b0d8-c658fd4b4bf4 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92894af6b8f74650ad7696e1f3ac375d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f24f86f0fc4a3ba09c2be55876c783', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:32.029963 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0ae8d095-d034-4d46-b31c-aa9761288aaa tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:32.031295 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0ae8d095-d034-4d46-b31c-aa9761288aaa tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:32.031933 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0ae8d095-d034-4d46-b31c-aa9761288aaa tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:32.033732 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-bcdefb9e-9c1d-46ec-b0d8-c658fd4b4bf4 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92894af6b8f74650ad7696e1f3ac375d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f24f86f0fc4a3ba09c2be55876c783', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:32.036640 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=100 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:03:32.037127 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-bcdefb9e-9c1d-46ec-b0d8-c658fd4b4bf4 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92894af6b8f74650ad7696e1f3ac375d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f24f86f0fc4a3ba09c2be55876c783', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:32.039762 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-bcdefb9e-9c1d-46ec-b0d8-c658fd4b4bf4 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] 10.222.0.43 "GET /compute/v2.1/servers/39dc4bb1-8465-4576-b490-d066c0fbb18f" status: 200 len: 1407 microversion: 2.54 time: 0.201946 Oct 04 22:03:32.042481 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2060/4182] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:03:31 2022] GET /compute/v2.1/servers/39dc4bb1-8465-4576-b490-d066c0fbb18f => generated 1407 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:03:32.051114 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-039f9076-4616-4003-99d2-fce8b193fa42 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:32.052110 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-039f9076-4616-4003-99d2-fce8b193fa42 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: e5842070-d5a3-43f9-82f8-ebce4eaf5526] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:03:32.066255 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-039f9076-4616-4003-99d2-fce8b193fa42 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:32.071157 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-039f9076-4616-4003-99d2-fce8b193fa42 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:32.072692 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-039f9076-4616-4003-99d2-fce8b193fa42 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:32.073894 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-039f9076-4616-4003-99d2-fce8b193fa42 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:32.074690 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-039f9076-4616-4003-99d2-fce8b193fa42 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:32.076263 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-039f9076-4616-4003-99d2-fce8b193fa42 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:32.284629 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-0ae8d095-d034-4d46-b31c-aa9761288aaa tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] 10.222.0.43 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-816538895" status: 200 len: 1513 microversion: 2.1 time: 0.664664 Oct 04 22:03:32.298777 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2123/4183] 10.222.0.43 () {58 vars in 1261 bytes} [Tue Oct 4 22:03:31 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-816538895 => generated 1513 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:03:32.315253 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-8018222c-459b-446b-a14c-16f913f9d365 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:32.331175 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-8018222c-459b-446b-a14c-16f913f9d365 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9f46a71ea0ee4e45afaea7e38e8c0ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba14e6816284d9e89e22913643f4355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:32.333493 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-8018222c-459b-446b-a14c-16f913f9d365 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': 'fba14e6816284d9e89e22913643f4355'} {{(pid=134102) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 22:03:32.350353 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8018222c-459b-446b-a14c-16f913f9d365 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:32.351250 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8018222c-459b-446b-a14c-16f913f9d365 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:32.351965 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8018222c-459b-446b-a14c-16f913f9d365 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:32.353010 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8018222c-459b-446b-a14c-16f913f9d365 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:32.353735 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8018222c-459b-446b-a14c-16f913f9d365 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:32.354456 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8018222c-459b-446b-a14c-16f913f9d365 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:32.425209 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-039f9076-4616-4003-99d2-fce8b193fa42 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a1c8d841104bc9b6910bcc2c0e2bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe9283584fc4d90b0715216d867ea2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:32.437456 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-039f9076-4616-4003-99d2-fce8b193fa42 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "GET /compute/v2.1/servers/e5842070-d5a3-43f9-82f8-ebce4eaf5526" status: 200 len: 1315 microversion: 2.1 time: 0.390881 Oct 04 22:03:32.443763 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2061/4184] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:03:32 2022] GET /compute/v2.1/servers/e5842070-d5a3-43f9-82f8-ebce4eaf5526 => generated 1315 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:03:32.449517 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-97016082-3e90-42c2-83ae-8f2318ac6df6 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:32.450617 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-97016082-3e90-42c2-83ae-8f2318ac6df6 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] [instance: ad97980f-d9c5-4237-b84a-2a13dfbc7764] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:03:32.457605 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-97016082-3e90-42c2-83ae-8f2318ac6df6 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:32.458524 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-97016082-3e90-42c2-83ae-8f2318ac6df6 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:32.459219 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-97016082-3e90-42c2-83ae-8f2318ac6df6 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:32.460198 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-97016082-3e90-42c2-83ae-8f2318ac6df6 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:32.461442 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-97016082-3e90-42c2-83ae-8f2318ac6df6 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:32.462117 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-97016082-3e90-42c2-83ae-8f2318ac6df6 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:32.512481 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.multi_cell_list [None req-8018222c-459b-446b-a14c-16f913f9d365 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=134102) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 22:03:32.671820 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-8018222c-459b-446b-a14c-16f913f9d365 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f46a71ea0ee4e45afaea7e38e8c0ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba14e6816284d9e89e22913643f4355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:32.694805 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-97016082-3e90-42c2-83ae-8f2318ac6df6 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973de86311b47e882de18efbcb3f67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e037651e3345a8b95ea528cae02c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:32.695051 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8018222c-459b-446b-a14c-16f913f9d365 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:32.697595 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8018222c-459b-446b-a14c-16f913f9d365 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:32.699642 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8018222c-459b-446b-a14c-16f913f9d365 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:32.705517 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-97016082-3e90-42c2-83ae-8f2318ac6df6 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] 10.222.0.43 "GET /compute/v2.1/servers/ad97980f-d9c5-4237-b84a-2a13dfbc7764" status: 200 len: 1325 microversion: 2.1 time: 0.260131 Oct 04 22:03:32.706282 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2062/4185] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:03:32 2022] GET /compute/v2.1/servers/ad97980f-d9c5-4237-b84a-2a13dfbc7764 => generated 1325 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:03:32.918665 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-8018222c-459b-446b-a14c-16f913f9d365 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] 10.222.0.43 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4514 microversion: 2.1 time: 0.608989 Oct 04 22:03:32.919508 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2124/4186] 10.222.0.43 () {58 vars in 1173 bytes} [Tue Oct 4 22:03:32 2022] GET /compute/v2.1/servers/detail?status=active => generated 4514 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:03:32.945893 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-ba1a03fb-e8b0-4e22-b7a1-4c8b28edc993 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:32.952156 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-ba1a03fb-e8b0-4e22-b7a1-4c8b28edc993 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9f46a71ea0ee4e45afaea7e38e8c0ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba14e6816284d9e89e22913643f4355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:32.952862 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.compute.servers [None req-ba1a03fb-e8b0-4e22-b7a1-4c8b28edc993 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Removing options 'limit' from query {{(pid=134101) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 04 22:03:32.953896 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-ba1a03fb-e8b0-4e22-b7a1-4c8b28edc993 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Searching by: {'deleted': False, 'project_id': 'fba14e6816284d9e89e22913643f4355'} {{(pid=134101) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 22:03:32.961372 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ba1a03fb-e8b0-4e22-b7a1-4c8b28edc993 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:32.961868 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ba1a03fb-e8b0-4e22-b7a1-4c8b28edc993 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:32.962307 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ba1a03fb-e8b0-4e22-b7a1-4c8b28edc993 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:32.963260 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ba1a03fb-e8b0-4e22-b7a1-4c8b28edc993 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:32.964115 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ba1a03fb-e8b0-4e22-b7a1-4c8b28edc993 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:32.964900 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ba1a03fb-e8b0-4e22-b7a1-4c8b28edc993 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:33.000586 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-ba1a03fb-e8b0-4e22-b7a1-4c8b28edc993 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f46a71ea0ee4e45afaea7e38e8c0ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba14e6816284d9e89e22913643f4355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:33.007294 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ba1a03fb-e8b0-4e22-b7a1-4c8b28edc993 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:33.008268 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ba1a03fb-e8b0-4e22-b7a1-4c8b28edc993 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:33.008703 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ba1a03fb-e8b0-4e22-b7a1-4c8b28edc993 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:33.072647 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-daa4cd5e-6776-44d2-9fd8-8e33ef1ae45f tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:33.073562 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-daa4cd5e-6776-44d2-9fd8-8e33ef1ae45f tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] [instance: 39dc4bb1-8465-4576-b490-d066c0fbb18f] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:03:33.083153 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-daa4cd5e-6776-44d2-9fd8-8e33ef1ae45f tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:33.084252 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-daa4cd5e-6776-44d2-9fd8-8e33ef1ae45f tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:33.084856 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-daa4cd5e-6776-44d2-9fd8-8e33ef1ae45f tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:33.086257 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-daa4cd5e-6776-44d2-9fd8-8e33ef1ae45f tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:33.087333 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-daa4cd5e-6776-44d2-9fd8-8e33ef1ae45f tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:33.087943 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-daa4cd5e-6776-44d2-9fd8-8e33ef1ae45f tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:33.214226 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-daa4cd5e-6776-44d2-9fd8-8e33ef1ae45f tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92894af6b8f74650ad7696e1f3ac375d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f24f86f0fc4a3ba09c2be55876c783', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:33.226281 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-daa4cd5e-6776-44d2-9fd8-8e33ef1ae45f tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92894af6b8f74650ad7696e1f3ac375d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f24f86f0fc4a3ba09c2be55876c783', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:33.229262 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-daa4cd5e-6776-44d2-9fd8-8e33ef1ae45f tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92894af6b8f74650ad7696e1f3ac375d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f24f86f0fc4a3ba09c2be55876c783', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:33.231020 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-daa4cd5e-6776-44d2-9fd8-8e33ef1ae45f tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] 10.222.0.43 "GET /compute/v2.1/servers/39dc4bb1-8465-4576-b490-d066c0fbb18f" status: 200 len: 1407 microversion: 2.54 time: 0.164598 Oct 04 22:03:33.247918 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2125/4187] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:03:33 2022] GET /compute/v2.1/servers/39dc4bb1-8465-4576-b490-d066c0fbb18f => generated 1407 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:03:33.251728 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-ba1a03fb-e8b0-4e22-b7a1-4c8b28edc993 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] 10.222.0.43 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1660 microversion: 2.1 time: 0.309955 Oct 04 22:03:33.253268 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2063/4188] 10.222.0.43 () {58 vars in 1161 bytes} [Tue Oct 4 22:03:32 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1660 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:03:33.261612 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-609a13d2-2a2b-489d-8580-db473bb1678c req-3b65d556-e5ba-41e4-b04a-f53e1f3e307f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad97980f-d9c5-4237-b84a-2a13dfbc7764", "tag": "eb2633ea-2747-42ba-9388-e6e2161cfa52"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:03:33.287595 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-609a13d2-2a2b-489d-8580-db473bb1678c req-3b65d556-e5ba-41e4-b04a-f53e1f3e307f service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:33.289685 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-609a13d2-2a2b-489d-8580-db473bb1678c req-3b65d556-e5ba-41e4-b04a-f53e1f3e307f service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:33.290327 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-609a13d2-2a2b-489d-8580-db473bb1678c req-3b65d556-e5ba-41e4-b04a-f53e1f3e307f service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:33.295200 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-41463b1c-3196-4ccf-86ce-f7c9633e4291 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:33.302235 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-41463b1c-3196-4ccf-86ce-f7c9633e4291 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9f46a71ea0ee4e45afaea7e38e8c0ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba14e6816284d9e89e22913643f4355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:33.303603 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-41463b1c-3196-4ccf-86ce-f7c9633e4291 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': 'fba14e6816284d9e89e22913643f4355'} {{(pid=134101) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 22:03:33.311737 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-41463b1c-3196-4ccf-86ce-f7c9633e4291 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:33.312465 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-41463b1c-3196-4ccf-86ce-f7c9633e4291 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:33.313074 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-41463b1c-3196-4ccf-86ce-f7c9633e4291 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:33.314071 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-41463b1c-3196-4ccf-86ce-f7c9633e4291 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:33.314237 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-609a13d2-2a2b-489d-8580-db473bb1678c req-3b65d556-e5ba-41e4-b04a-f53e1f3e307f service nova] Creating event network-changed:eb2633ea-2747-42ba-9388-e6e2161cfa52 for instance ad97980f-d9c5-4237-b84a-2a13dfbc7764 on n-h1-860284-1 Oct 04 22:03:33.314979 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-41463b1c-3196-4ccf-86ce-f7c9633e4291 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:33.315664 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-41463b1c-3196-4ccf-86ce-f7c9633e4291 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:33.324554 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-609a13d2-2a2b-489d-8580-db473bb1678c req-3b65d556-e5ba-41e4-b04a-f53e1f3e307f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073005 Oct 04 22:03:33.324554 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2126/4189] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:03:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:03:33.350715 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.multi_cell_list [None req-41463b1c-3196-4ccf-86ce-f7c9633e4291 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=134101) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 22:03:33.392883 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-41463b1c-3196-4ccf-86ce-f7c9633e4291 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] 10.222.0.43 "GET /compute/v2.1/servers?status=active" status: 200 len: 1009 microversion: 2.1 time: 0.110825 Oct 04 22:03:33.393639 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2064/4190] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Oct 4 22:03:33 2022] GET /compute/v2.1/servers?status=active => generated 1009 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:03:33.408641 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-bef9af90-1f00-41e6-88f3-2601ac4fac8d tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:33.419396 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-bef9af90-1f00-41e6-88f3-2601ac4fac8d tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9f46a71ea0ee4e45afaea7e38e8c0ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba14e6816284d9e89e22913643f4355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:33.420488 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.compute.servers [None req-bef9af90-1f00-41e6-88f3-2601ac4fac8d tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Removing options 'limit' from query {{(pid=134102) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 04 22:03:33.422565 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-bef9af90-1f00-41e6-88f3-2601ac4fac8d tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Searching by: {'deleted': False, 'project_id': 'fba14e6816284d9e89e22913643f4355'} {{(pid=134102) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 22:03:33.433038 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bef9af90-1f00-41e6-88f3-2601ac4fac8d tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:33.433801 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bef9af90-1f00-41e6-88f3-2601ac4fac8d tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:33.434677 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bef9af90-1f00-41e6-88f3-2601ac4fac8d tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:33.436283 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bef9af90-1f00-41e6-88f3-2601ac4fac8d tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:33.437005 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bef9af90-1f00-41e6-88f3-2601ac4fac8d tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:33.438095 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bef9af90-1f00-41e6-88f3-2601ac4fac8d tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:33.477339 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.multi_cell_list [None req-bef9af90-1f00-41e6-88f3-2601ac4fac8d tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=134102) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 22:03:33.519174 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-bef9af90-1f00-41e6-88f3-2601ac4fac8d tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] 10.222.0.43 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1009 microversion: 2.1 time: 0.115502 Oct 04 22:03:33.520451 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2127/4191] 10.222.0.43 () {58 vars in 1150 bytes} [Tue Oct 4 22:03:33 2022] GET /compute/v2.1/servers?limit=100000 => generated 1009 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:03:33.532910 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-8aa0a087-ce94-46bc-994a-e49e5ba823ac tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:33.538817 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-8aa0a087-ce94-46bc-994a-e49e5ba823ac tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9f46a71ea0ee4e45afaea7e38e8c0ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba14e6816284d9e89e22913643f4355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:33.539778 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-8aa0a087-ce94-46bc-994a-e49e5ba823ac tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Searching by: {'deleted': False, 'project_id': 'fba14e6816284d9e89e22913643f4355'} {{(pid=134101) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 22:03:33.548699 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8aa0a087-ce94-46bc-994a-e49e5ba823ac tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:33.549880 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8aa0a087-ce94-46bc-994a-e49e5ba823ac tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:33.550783 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8aa0a087-ce94-46bc-994a-e49e5ba823ac tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:33.551981 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8aa0a087-ce94-46bc-994a-e49e5ba823ac tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:33.552631 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8aa0a087-ce94-46bc-994a-e49e5ba823ac tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:33.553277 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8aa0a087-ce94-46bc-994a-e49e5ba823ac tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:33.576899 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-c8cd3ebc-f1eb-4dc6-80a8-92051099e4b6 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:33.577907 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-c8cd3ebc-f1eb-4dc6-80a8-92051099e4b6 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: e5842070-d5a3-43f9-82f8-ebce4eaf5526] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:03:33.590135 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c8cd3ebc-f1eb-4dc6-80a8-92051099e4b6 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:33.590929 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c8cd3ebc-f1eb-4dc6-80a8-92051099e4b6 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:33.591643 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c8cd3ebc-f1eb-4dc6-80a8-92051099e4b6 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:33.592803 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c8cd3ebc-f1eb-4dc6-80a8-92051099e4b6 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:33.593538 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c8cd3ebc-f1eb-4dc6-80a8-92051099e4b6 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:33.594273 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c8cd3ebc-f1eb-4dc6-80a8-92051099e4b6 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:33.602708 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.multi_cell_list [None req-8aa0a087-ce94-46bc-994a-e49e5ba823ac tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=134101) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 22:03:33.662724 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-8aa0a087-ce94-46bc-994a-e49e5ba823ac tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] 10.222.0.43 "GET /compute/v2.1/servers" status: 200 len: 1009 microversion: 2.1 time: 0.133510 Oct 04 22:03:33.663532 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2065/4192] 10.222.0.43 () {58 vars in 1125 bytes} [Tue Oct 4 22:03:33 2022] GET /compute/v2.1/servers => generated 1009 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:03:33.688013 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-f2c38813-0eb9-4fe5-a864-de40af702fc4 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:33.693271 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-f2c38813-0eb9-4fe5-a864-de40af702fc4 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9f46a71ea0ee4e45afaea7e38e8c0ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba14e6816284d9e89e22913643f4355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:33.694541 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-f2c38813-0eb9-4fe5-a864-de40af702fc4 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': 'fba14e6816284d9e89e22913643f4355'} {{(pid=134101) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 22:03:33.707632 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f2c38813-0eb9-4fe5-a864-de40af702fc4 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:33.708152 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f2c38813-0eb9-4fe5-a864-de40af702fc4 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:33.708531 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f2c38813-0eb9-4fe5-a864-de40af702fc4 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:33.709310 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f2c38813-0eb9-4fe5-a864-de40af702fc4 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:33.709748 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f2c38813-0eb9-4fe5-a864-de40af702fc4 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:33.710155 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f2c38813-0eb9-4fe5-a864-de40af702fc4 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:33.803949 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.multi_cell_list [None req-f2c38813-0eb9-4fe5-a864-de40af702fc4 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=134101) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 22:03:33.834481 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-c8cd3ebc-f1eb-4dc6-80a8-92051099e4b6 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a1c8d841104bc9b6910bcc2c0e2bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe9283584fc4d90b0715216d867ea2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:33.841244 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-c8cd3ebc-f1eb-4dc6-80a8-92051099e4b6 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "GET /compute/v2.1/servers/e5842070-d5a3-43f9-82f8-ebce4eaf5526" status: 200 len: 1315 microversion: 2.1 time: 0.268358 Oct 04 22:03:33.849456 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2128/4193] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:03:33 2022] GET /compute/v2.1/servers/e5842070-d5a3-43f9-82f8-ebce4eaf5526 => generated 1315 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:03:33.854733 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=100 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:03:33.856195 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-98e60004-44ec-4b4b-b569-7cbd0a5242ba tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:33.857116 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-98e60004-44ec-4b4b-b569-7cbd0a5242ba tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] [instance: ad97980f-d9c5-4237-b84a-2a13dfbc7764] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:03:33.864638 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-98e60004-44ec-4b4b-b569-7cbd0a5242ba tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:33.865478 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-98e60004-44ec-4b4b-b569-7cbd0a5242ba tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:33.866603 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-98e60004-44ec-4b4b-b569-7cbd0a5242ba tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:33.868392 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-98e60004-44ec-4b4b-b569-7cbd0a5242ba tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:33.869084 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-98e60004-44ec-4b4b-b569-7cbd0a5242ba tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:33.869615 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-98e60004-44ec-4b4b-b569-7cbd0a5242ba tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:33.873758 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-f2c38813-0eb9-4fe5-a864-de40af702fc4 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] 10.222.0.43 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 345 microversion: 2.1 time: 0.195426 Oct 04 22:03:33.874557 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2066/4194] 10.222.0.43 () {58 vars in 1146 bytes} [Tue Oct 4 22:03:33 2022] GET /compute/v2.1/servers?flavor=451 => generated 345 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:03:33.888825 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-ea42e23a-486b-49a1-8c5a-aaf4dd082ba8 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:33.893628 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-ea42e23a-486b-49a1-8c5a-aaf4dd082ba8 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9f46a71ea0ee4e45afaea7e38e8c0ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba14e6816284d9e89e22913643f4355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:33.894077 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.compute.servers [None req-ea42e23a-486b-49a1-8c5a-aaf4dd082ba8 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Removing options 'limit' from query {{(pid=134101) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 04 22:03:33.894755 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-ea42e23a-486b-49a1-8c5a-aaf4dd082ba8 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Searching by: {'deleted': False, 'project_id': 'fba14e6816284d9e89e22913643f4355'} {{(pid=134101) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 22:03:33.902131 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ea42e23a-486b-49a1-8c5a-aaf4dd082ba8 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:33.902697 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ea42e23a-486b-49a1-8c5a-aaf4dd082ba8 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:33.903177 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ea42e23a-486b-49a1-8c5a-aaf4dd082ba8 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:33.903912 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ea42e23a-486b-49a1-8c5a-aaf4dd082ba8 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:33.904400 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ea42e23a-486b-49a1-8c5a-aaf4dd082ba8 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:33.904849 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ea42e23a-486b-49a1-8c5a-aaf4dd082ba8 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:33.937078 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-ea42e23a-486b-49a1-8c5a-aaf4dd082ba8 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] 10.222.0.43 "GET /compute/v2.1/servers?limit=1" status: 200 len: 484 microversion: 2.1 time: 0.051991 Oct 04 22:03:33.938080 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2067/4195] 10.222.0.43 () {58 vars in 1140 bytes} [Tue Oct 4 22:03:33 2022] GET /compute/v2.1/servers?limit=1 => generated 484 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:03:33.951033 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-eea5e3b9-2a5e-434e-9590-a9dc5d9be725 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:33.957950 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-eea5e3b9-2a5e-434e-9590-a9dc5d9be725 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9f46a71ea0ee4e45afaea7e38e8c0ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba14e6816284d9e89e22913643f4355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:33.959067 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-eea5e3b9-2a5e-434e-9590-a9dc5d9be725 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-816538895', 'deleted': False, 'project_id': 'fba14e6816284d9e89e22913643f4355'} {{(pid=134101) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 22:03:33.968149 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-eea5e3b9-2a5e-434e-9590-a9dc5d9be725 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:33.969011 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-eea5e3b9-2a5e-434e-9590-a9dc5d9be725 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:33.969473 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-eea5e3b9-2a5e-434e-9590-a9dc5d9be725 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:33.970223 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-eea5e3b9-2a5e-434e-9590-a9dc5d9be725 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:33.970717 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-eea5e3b9-2a5e-434e-9590-a9dc5d9be725 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:33.971159 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-eea5e3b9-2a5e-434e-9590-a9dc5d9be725 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:34.047013 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-98e60004-44ec-4b4b-b569-7cbd0a5242ba tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973de86311b47e882de18efbcb3f67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e037651e3345a8b95ea528cae02c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:34.058586 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-98e60004-44ec-4b4b-b569-7cbd0a5242ba tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] 10.222.0.43 "GET /compute/v2.1/servers/ad97980f-d9c5-4237-b84a-2a13dfbc7764" status: 200 len: 1325 microversion: 2.1 time: 0.207769 Oct 04 22:03:34.059477 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2129/4196] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:03:33 2022] GET /compute/v2.1/servers/ad97980f-d9c5-4237-b84a-2a13dfbc7764 => generated 1325 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:03:34.092206 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.multi_cell_list [None req-eea5e3b9-2a5e-434e-9590-a9dc5d9be725 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=134101) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 22:03:34.156334 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-eea5e3b9-2a5e-434e-9590-a9dc5d9be725 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] 10.222.0.43 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-816538895" status: 200 len: 345 microversion: 2.1 time: 0.209763 Oct 04 22:03:34.156941 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2068/4197] 10.222.0.43 () {58 vars in 1240 bytes} [Tue Oct 4 22:03:33 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-816538895 => generated 345 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:03:34.174539 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-46264117-6616-4f10-8019-31089250b913 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:03:34.185707 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-46264117-6616-4f10-8019-31089250b913 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:34.186394 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-46264117-6616-4f10-8019-31089250b913 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:34.187008 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-46264117-6616-4f10-8019-31089250b913 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:34.215361 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-46264117-6616-4f10-8019-31089250b913 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] [instance: 07e11885-b7b0-4ad1-bda6-a677b9aaf48d] Going to try to stop instance {{(pid=134102) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 04 22:03:34.269105 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-46264117-6616-4f10-8019-31089250b913 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] 10.222.0.43 "POST /compute/v2.1/servers/07e11885-b7b0-4ad1-bda6-a677b9aaf48d/action" status: 202 len: 0 microversion: 2.1 time: 0.100868 Oct 04 22:03:34.270274 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2130/4198] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 22:03:34 2022] POST /compute/v2.1/servers/07e11885-b7b0-4ad1-bda6-a677b9aaf48d/action => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 22:03:34.279737 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-cc6e7102-3a5b-4a30-989f-a6aa4104d9e2 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:34.281038 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-cc6e7102-3a5b-4a30-989f-a6aa4104d9e2 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] [instance: 07e11885-b7b0-4ad1-bda6-a677b9aaf48d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:03:34.293563 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cc6e7102-3a5b-4a30-989f-a6aa4104d9e2 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:34.294832 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cc6e7102-3a5b-4a30-989f-a6aa4104d9e2 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:34.295298 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cc6e7102-3a5b-4a30-989f-a6aa4104d9e2 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:34.296081 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cc6e7102-3a5b-4a30-989f-a6aa4104d9e2 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:34.296555 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cc6e7102-3a5b-4a30-989f-a6aa4104d9e2 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:34.296997 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cc6e7102-3a5b-4a30-989f-a6aa4104d9e2 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:34.299118 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-6d582319-04ae-4ebc-bddc-66d48e0311fd tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:34.301510 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-6d582319-04ae-4ebc-bddc-66d48e0311fd tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] [instance: 39dc4bb1-8465-4576-b490-d066c0fbb18f] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:03:34.315490 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6d582319-04ae-4ebc-bddc-66d48e0311fd tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:34.316605 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6d582319-04ae-4ebc-bddc-66d48e0311fd tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:34.317155 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6d582319-04ae-4ebc-bddc-66d48e0311fd tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:34.318003 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6d582319-04ae-4ebc-bddc-66d48e0311fd tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:34.318721 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6d582319-04ae-4ebc-bddc-66d48e0311fd tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:34.319397 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6d582319-04ae-4ebc-bddc-66d48e0311fd tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:34.455855 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-6d582319-04ae-4ebc-bddc-66d48e0311fd tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92894af6b8f74650ad7696e1f3ac375d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f24f86f0fc4a3ba09c2be55876c783', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:34.472460 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-6d582319-04ae-4ebc-bddc-66d48e0311fd tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92894af6b8f74650ad7696e1f3ac375d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f24f86f0fc4a3ba09c2be55876c783', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:34.480747 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-6d582319-04ae-4ebc-bddc-66d48e0311fd tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92894af6b8f74650ad7696e1f3ac375d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f24f86f0fc4a3ba09c2be55876c783', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:34.481975 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-6d582319-04ae-4ebc-bddc-66d48e0311fd tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] 10.222.0.43 "GET /compute/v2.1/servers/39dc4bb1-8465-4576-b490-d066c0fbb18f" status: 200 len: 1407 microversion: 2.54 time: 0.196496 Oct 04 22:03:34.482586 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2131/4199] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:03:34 2022] GET /compute/v2.1/servers/39dc4bb1-8465-4576-b490-d066c0fbb18f => generated 1407 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:03:34.576904 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-cc6e7102-3a5b-4a30-989f-a6aa4104d9e2 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f46a71ea0ee4e45afaea7e38e8c0ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba14e6816284d9e89e22913643f4355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:34.586425 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-cc6e7102-3a5b-4a30-989f-a6aa4104d9e2 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] 10.222.0.43 "GET /compute/v2.1/servers/07e11885-b7b0-4ad1-bda6-a677b9aaf48d" status: 200 len: 1520 microversion: 2.1 time: 0.310333 Oct 04 22:03:34.587287 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2069/4200] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:03:34 2022] GET /compute/v2.1/servers/07e11885-b7b0-4ad1-bda6-a677b9aaf48d => generated 1520 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:03:34.865414 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-649a4c92-d30b-4c3b-9f55-955306879ffd tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:34.866138 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-649a4c92-d30b-4c3b-9f55-955306879ffd tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: e5842070-d5a3-43f9-82f8-ebce4eaf5526] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:03:34.874533 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-649a4c92-d30b-4c3b-9f55-955306879ffd tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:34.875109 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-649a4c92-d30b-4c3b-9f55-955306879ffd tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:34.876590 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-649a4c92-d30b-4c3b-9f55-955306879ffd tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:34.877312 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-649a4c92-d30b-4c3b-9f55-955306879ffd tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:34.877905 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-649a4c92-d30b-4c3b-9f55-955306879ffd tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:34.878327 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-649a4c92-d30b-4c3b-9f55-955306879ffd tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:35.028173 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-649a4c92-d30b-4c3b-9f55-955306879ffd tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a1c8d841104bc9b6910bcc2c0e2bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe9283584fc4d90b0715216d867ea2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:35.044073 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-649a4c92-d30b-4c3b-9f55-955306879ffd tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "GET /compute/v2.1/servers/e5842070-d5a3-43f9-82f8-ebce4eaf5526" status: 200 len: 1503 microversion: 2.1 time: 0.182808 Oct 04 22:03:35.046440 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2132/4201] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:03:34 2022] GET /compute/v2.1/servers/e5842070-d5a3-43f9-82f8-ebce4eaf5526 => generated 1503 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:03:35.068511 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-cad12cf6-1126-4601-9c4a-a2e6e1789a42 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:03:35.069055 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-cad12cf6-1126-4601-9c4a-a2e6e1789a42 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: e5842070-d5a3-43f9-82f8-ebce4eaf5526] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:03:35.077209 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cad12cf6-1126-4601-9c4a-a2e6e1789a42 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:35.078383 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cad12cf6-1126-4601-9c4a-a2e6e1789a42 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:35.079286 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cad12cf6-1126-4601-9c4a-a2e6e1789a42 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:35.080213 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cad12cf6-1126-4601-9c4a-a2e6e1789a42 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:35.081043 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cad12cf6-1126-4601-9c4a-a2e6e1789a42 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:35.081627 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cad12cf6-1126-4601-9c4a-a2e6e1789a42 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:35.083492 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-63ccb9d9-c774-4634-af96-98ce5114b598 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:35.084233 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-63ccb9d9-c774-4634-af96-98ce5114b598 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] [instance: ad97980f-d9c5-4237-b84a-2a13dfbc7764] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:03:35.092996 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-63ccb9d9-c774-4634-af96-98ce5114b598 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:35.093426 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-63ccb9d9-c774-4634-af96-98ce5114b598 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:35.093869 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-63ccb9d9-c774-4634-af96-98ce5114b598 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:35.094881 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-63ccb9d9-c774-4634-af96-98ce5114b598 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:35.095349 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-63ccb9d9-c774-4634-af96-98ce5114b598 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:35.095784 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-63ccb9d9-c774-4634-af96-98ce5114b598 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:35.127386 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.objects.instance [None req-cad12cf6-1126-4601-9c4a-a2e6e1789a42 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lazy-loading 'flavor' on Instance uuid e5842070-d5a3-43f9-82f8-ebce4eaf5526 {{(pid=134101) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 22:03:35.348712 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-cad12cf6-1126-4601-9c4a-a2e6e1789a42 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "POST /compute/v2.1/servers/e5842070-d5a3-43f9-82f8-ebce4eaf5526/action" status: 202 len: 0 microversion: 2.1 time: 0.283704 Oct 04 22:03:35.353132 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2070/4202] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 22:03:35 2022] POST /compute/v2.1/servers/e5842070-d5a3-43f9-82f8-ebce4eaf5526/action => generated 0 bytes in 289 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 22:03:35.353493 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-63ccb9d9-c774-4634-af96-98ce5114b598 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973de86311b47e882de18efbcb3f67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e037651e3345a8b95ea528cae02c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:35.358874 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-9092e8de-3bce-45d1-b552-fc3bdc083b06 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:35.359854 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-9092e8de-3bce-45d1-b552-fc3bdc083b06 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: e5842070-d5a3-43f9-82f8-ebce4eaf5526] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:03:35.366653 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9092e8de-3bce-45d1-b552-fc3bdc083b06 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:35.367684 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9092e8de-3bce-45d1-b552-fc3bdc083b06 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:35.368156 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9092e8de-3bce-45d1-b552-fc3bdc083b06 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:35.369144 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9092e8de-3bce-45d1-b552-fc3bdc083b06 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:35.369822 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9092e8de-3bce-45d1-b552-fc3bdc083b06 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:35.370210 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9092e8de-3bce-45d1-b552-fc3bdc083b06 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:35.374835 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-63ccb9d9-c774-4634-af96-98ce5114b598 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] 10.222.0.43 "GET /compute/v2.1/servers/ad97980f-d9c5-4237-b84a-2a13dfbc7764" status: 200 len: 1325 microversion: 2.1 time: 0.295579 Oct 04 22:03:35.375351 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2133/4203] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:03:35 2022] GET /compute/v2.1/servers/ad97980f-d9c5-4237-b84a-2a13dfbc7764 => generated 1325 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:03:35.512800 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-d5a40934-8b6c-466e-b428-20581b5759c8 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:35.514485 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-d5a40934-8b6c-466e-b428-20581b5759c8 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] [instance: 39dc4bb1-8465-4576-b490-d066c0fbb18f] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:03:35.525066 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d5a40934-8b6c-466e-b428-20581b5759c8 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:35.525882 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d5a40934-8b6c-466e-b428-20581b5759c8 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:35.531775 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d5a40934-8b6c-466e-b428-20581b5759c8 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:35.532912 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d5a40934-8b6c-466e-b428-20581b5759c8 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:35.533845 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d5a40934-8b6c-466e-b428-20581b5759c8 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:35.534425 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-9092e8de-3bce-45d1-b552-fc3bdc083b06 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a1c8d841104bc9b6910bcc2c0e2bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe9283584fc4d90b0715216d867ea2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:35.535098 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d5a40934-8b6c-466e-b428-20581b5759c8 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:35.544324 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-9092e8de-3bce-45d1-b552-fc3bdc083b06 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "GET /compute/v2.1/servers/e5842070-d5a3-43f9-82f8-ebce4eaf5526" status: 200 len: 1509 microversion: 2.1 time: 0.189706 Oct 04 22:03:35.545143 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2071/4204] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:03:35 2022] GET /compute/v2.1/servers/e5842070-d5a3-43f9-82f8-ebce4eaf5526 => generated 1509 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:03:35.611312 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-a4435232-f02b-4408-bdcd-f81e316b231a tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:35.612325 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-a4435232-f02b-4408-bdcd-f81e316b231a tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] [instance: 07e11885-b7b0-4ad1-bda6-a677b9aaf48d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:03:35.624590 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a4435232-f02b-4408-bdcd-f81e316b231a tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:35.625587 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a4435232-f02b-4408-bdcd-f81e316b231a tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:35.626985 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a4435232-f02b-4408-bdcd-f81e316b231a tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:35.628774 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a4435232-f02b-4408-bdcd-f81e316b231a tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:35.632403 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a4435232-f02b-4408-bdcd-f81e316b231a tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:35.633220 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-d5a40934-8b6c-466e-b428-20581b5759c8 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92894af6b8f74650ad7696e1f3ac375d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f24f86f0fc4a3ba09c2be55876c783', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:35.634556 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a4435232-f02b-4408-bdcd-f81e316b231a tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:35.650722 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-d5a40934-8b6c-466e-b428-20581b5759c8 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92894af6b8f74650ad7696e1f3ac375d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f24f86f0fc4a3ba09c2be55876c783', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:35.661345 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-d5a40934-8b6c-466e-b428-20581b5759c8 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92894af6b8f74650ad7696e1f3ac375d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f24f86f0fc4a3ba09c2be55876c783', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:35.666611 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-d5a40934-8b6c-466e-b428-20581b5759c8 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] 10.222.0.43 "GET /compute/v2.1/servers/39dc4bb1-8465-4576-b490-d066c0fbb18f" status: 200 len: 1407 microversion: 2.54 time: 0.158045 Oct 04 22:03:35.667277 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2134/4205] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:03:35 2022] GET /compute/v2.1/servers/39dc4bb1-8465-4576-b490-d066c0fbb18f => generated 1407 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:03:35.848201 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-a4435232-f02b-4408-bdcd-f81e316b231a tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f46a71ea0ee4e45afaea7e38e8c0ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba14e6816284d9e89e22913643f4355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:35.856877 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-a4435232-f02b-4408-bdcd-f81e316b231a tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] 10.222.0.43 "GET /compute/v2.1/servers/07e11885-b7b0-4ad1-bda6-a677b9aaf48d" status: 200 len: 1520 microversion: 2.1 time: 0.250246 Oct 04 22:03:35.857386 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2072/4206] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:03:35 2022] GET /compute/v2.1/servers/07e11885-b7b0-4ad1-bda6-a677b9aaf48d => generated 1520 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:03:36.401325 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-17eca37b-365e-4a75-aad0-f511f7e2661e tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:36.402594 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-17eca37b-365e-4a75-aad0-f511f7e2661e tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] [instance: ad97980f-d9c5-4237-b84a-2a13dfbc7764] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:03:36.413788 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-17eca37b-365e-4a75-aad0-f511f7e2661e tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:36.414980 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-17eca37b-365e-4a75-aad0-f511f7e2661e tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:36.415613 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-17eca37b-365e-4a75-aad0-f511f7e2661e tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:36.416497 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-17eca37b-365e-4a75-aad0-f511f7e2661e tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:36.417107 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-17eca37b-365e-4a75-aad0-f511f7e2661e tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:36.417695 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-17eca37b-365e-4a75-aad0-f511f7e2661e tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:36.568257 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-fe6c6fd3-4d45-4ab6-9f72-bc84dc295faf tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:36.569056 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-fe6c6fd3-4d45-4ab6-9f72-bc84dc295faf tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: e5842070-d5a3-43f9-82f8-ebce4eaf5526] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:03:36.582663 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fe6c6fd3-4d45-4ab6-9f72-bc84dc295faf tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:36.588478 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fe6c6fd3-4d45-4ab6-9f72-bc84dc295faf tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:36.589076 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fe6c6fd3-4d45-4ab6-9f72-bc84dc295faf tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:36.590970 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fe6c6fd3-4d45-4ab6-9f72-bc84dc295faf tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:36.591542 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fe6c6fd3-4d45-4ab6-9f72-bc84dc295faf tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:36.592815 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fe6c6fd3-4d45-4ab6-9f72-bc84dc295faf tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:36.646971 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-17eca37b-365e-4a75-aad0-f511f7e2661e tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973de86311b47e882de18efbcb3f67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e037651e3345a8b95ea528cae02c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:36.660509 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-17eca37b-365e-4a75-aad0-f511f7e2661e tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] 10.222.0.43 "GET /compute/v2.1/servers/ad97980f-d9c5-4237-b84a-2a13dfbc7764" status: 200 len: 1325 microversion: 2.1 time: 0.265558 Oct 04 22:03:36.661129 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2135/4207] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:03:36 2022] GET /compute/v2.1/servers/ad97980f-d9c5-4237-b84a-2a13dfbc7764 => generated 1325 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:03:36.697246 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-1cda3559-d033-4095-b51e-e6c4041dae6b tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:36.699156 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-1cda3559-d033-4095-b51e-e6c4041dae6b tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] [instance: 39dc4bb1-8465-4576-b490-d066c0fbb18f] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:03:36.717497 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1cda3559-d033-4095-b51e-e6c4041dae6b tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:36.726127 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1cda3559-d033-4095-b51e-e6c4041dae6b tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:36.727377 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1cda3559-d033-4095-b51e-e6c4041dae6b tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:36.728578 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1cda3559-d033-4095-b51e-e6c4041dae6b tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:36.729048 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1cda3559-d033-4095-b51e-e6c4041dae6b tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:36.729478 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1cda3559-d033-4095-b51e-e6c4041dae6b tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:36.900734 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-1cda3559-d033-4095-b51e-e6c4041dae6b tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92894af6b8f74650ad7696e1f3ac375d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f24f86f0fc4a3ba09c2be55876c783', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:36.916320 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-fe6c6fd3-4d45-4ab6-9f72-bc84dc295faf tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a1c8d841104bc9b6910bcc2c0e2bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe9283584fc4d90b0715216d867ea2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:36.924214 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-1cda3559-d033-4095-b51e-e6c4041dae6b tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92894af6b8f74650ad7696e1f3ac375d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f24f86f0fc4a3ba09c2be55876c783', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:36.925984 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-1cda3559-d033-4095-b51e-e6c4041dae6b tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92894af6b8f74650ad7696e1f3ac375d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f24f86f0fc4a3ba09c2be55876c783', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:36.927258 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-fe6c6fd3-4d45-4ab6-9f72-bc84dc295faf tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "GET /compute/v2.1/servers/e5842070-d5a3-43f9-82f8-ebce4eaf5526" status: 200 len: 1509 microversion: 2.1 time: 0.362001 Oct 04 22:03:36.927573 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-1cda3559-d033-4095-b51e-e6c4041dae6b tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] 10.222.0.43 "GET /compute/v2.1/servers/39dc4bb1-8465-4576-b490-d066c0fbb18f" status: 200 len: 1407 microversion: 2.54 time: 0.236150 Oct 04 22:03:36.928548 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2073/4209] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:03:36 2022] GET /compute/v2.1/servers/e5842070-d5a3-43f9-82f8-ebce4eaf5526 => generated 1509 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:03:36.928669 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2136/4209] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:03:36 2022] GET /compute/v2.1/servers/39dc4bb1-8465-4576-b490-d066c0fbb18f => generated 1407 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:03:36.949205 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-4da76d77-a642-4355-922c-9376bfa96561 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:36.950072 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-4da76d77-a642-4355-922c-9376bfa96561 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] [instance: 07e11885-b7b0-4ad1-bda6-a677b9aaf48d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:03:36.957133 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4da76d77-a642-4355-922c-9376bfa96561 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:36.957629 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4da76d77-a642-4355-922c-9376bfa96561 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:36.958068 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4da76d77-a642-4355-922c-9376bfa96561 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:36.958839 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4da76d77-a642-4355-922c-9376bfa96561 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:36.959260 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4da76d77-a642-4355-922c-9376bfa96561 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:36.959681 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4da76d77-a642-4355-922c-9376bfa96561 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:37.130640 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-4da76d77-a642-4355-922c-9376bfa96561 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f46a71ea0ee4e45afaea7e38e8c0ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba14e6816284d9e89e22913643f4355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:37.139291 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-4da76d77-a642-4355-922c-9376bfa96561 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] 10.222.0.43 "GET /compute/v2.1/servers/07e11885-b7b0-4ad1-bda6-a677b9aaf48d" status: 200 len: 1520 microversion: 2.1 time: 0.209697 Oct 04 22:03:37.140120 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2137/4210] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:03:36 2022] GET /compute/v2.1/servers/07e11885-b7b0-4ad1-bda6-a677b9aaf48d => generated 1520 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:03:37.686119 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-b7edeb06-ad61-43c5-abdc-2aa0c946a8de tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:37.686119 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-b7edeb06-ad61-43c5-abdc-2aa0c946a8de tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] [instance: ad97980f-d9c5-4237-b84a-2a13dfbc7764] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:03:37.696931 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b7edeb06-ad61-43c5-abdc-2aa0c946a8de tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:37.698431 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b7edeb06-ad61-43c5-abdc-2aa0c946a8de tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:37.699330 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b7edeb06-ad61-43c5-abdc-2aa0c946a8de tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:37.700729 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b7edeb06-ad61-43c5-abdc-2aa0c946a8de tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:37.701671 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b7edeb06-ad61-43c5-abdc-2aa0c946a8de tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:37.702591 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b7edeb06-ad61-43c5-abdc-2aa0c946a8de tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:37.875524 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-b7edeb06-ad61-43c5-abdc-2aa0c946a8de tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973de86311b47e882de18efbcb3f67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e037651e3345a8b95ea528cae02c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:37.886189 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-b7edeb06-ad61-43c5-abdc-2aa0c946a8de tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] 10.222.0.43 "GET /compute/v2.1/servers/ad97980f-d9c5-4237-b84a-2a13dfbc7764" status: 200 len: 1325 microversion: 2.1 time: 0.205785 Oct 04 22:03:37.887176 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2074/4211] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:03:37 2022] GET /compute/v2.1/servers/ad97980f-d9c5-4237-b84a-2a13dfbc7764 => generated 1325 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:03:37.957926 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-fa697400-c23c-4cfe-bc4e-18f34efa4c74 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:37.958643 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-fa697400-c23c-4cfe-bc4e-18f34efa4c74 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] [instance: 39dc4bb1-8465-4576-b490-d066c0fbb18f] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:03:37.965449 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-4f035637-3315-4377-9d29-d2cb3a0156b4 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:37.966067 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-4f035637-3315-4377-9d29-d2cb3a0156b4 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: e5842070-d5a3-43f9-82f8-ebce4eaf5526] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:03:37.975117 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4f035637-3315-4377-9d29-d2cb3a0156b4 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:37.975890 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4f035637-3315-4377-9d29-d2cb3a0156b4 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:37.977040 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4f035637-3315-4377-9d29-d2cb3a0156b4 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:37.977937 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4f035637-3315-4377-9d29-d2cb3a0156b4 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:37.978580 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4f035637-3315-4377-9d29-d2cb3a0156b4 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:37.979157 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4f035637-3315-4377-9d29-d2cb3a0156b4 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:37.980754 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fa697400-c23c-4cfe-bc4e-18f34efa4c74 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:37.981327 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fa697400-c23c-4cfe-bc4e-18f34efa4c74 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:37.982871 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fa697400-c23c-4cfe-bc4e-18f34efa4c74 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:37.985094 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fa697400-c23c-4cfe-bc4e-18f34efa4c74 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:37.985885 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fa697400-c23c-4cfe-bc4e-18f34efa4c74 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:37.986329 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fa697400-c23c-4cfe-bc4e-18f34efa4c74 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:38.097863 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-fa697400-c23c-4cfe-bc4e-18f34efa4c74 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92894af6b8f74650ad7696e1f3ac375d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f24f86f0fc4a3ba09c2be55876c783', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:38.112093 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-fa697400-c23c-4cfe-bc4e-18f34efa4c74 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92894af6b8f74650ad7696e1f3ac375d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f24f86f0fc4a3ba09c2be55876c783', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:38.117669 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-fa697400-c23c-4cfe-bc4e-18f34efa4c74 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92894af6b8f74650ad7696e1f3ac375d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f24f86f0fc4a3ba09c2be55876c783', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:38.123153 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-fa697400-c23c-4cfe-bc4e-18f34efa4c74 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] 10.222.0.43 "GET /compute/v2.1/servers/39dc4bb1-8465-4576-b490-d066c0fbb18f" status: 200 len: 1407 microversion: 2.54 time: 0.168938 Oct 04 22:03:38.128587 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2075/4212] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:03:37 2022] GET /compute/v2.1/servers/39dc4bb1-8465-4576-b490-d066c0fbb18f => generated 1407 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:03:38.165643 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-93fb2bf8-7b36-4590-bbe6-df9f35fafcc0 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:38.167049 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-93fb2bf8-7b36-4590-bbe6-df9f35fafcc0 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] [instance: 07e11885-b7b0-4ad1-bda6-a677b9aaf48d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:03:38.175489 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-4f035637-3315-4377-9d29-d2cb3a0156b4 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a1c8d841104bc9b6910bcc2c0e2bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe9283584fc4d90b0715216d867ea2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:38.175712 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-93fb2bf8-7b36-4590-bbe6-df9f35fafcc0 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:38.176568 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-93fb2bf8-7b36-4590-bbe6-df9f35fafcc0 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:38.177158 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-93fb2bf8-7b36-4590-bbe6-df9f35fafcc0 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:38.178643 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-93fb2bf8-7b36-4590-bbe6-df9f35fafcc0 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:38.180186 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-93fb2bf8-7b36-4590-bbe6-df9f35fafcc0 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:38.180935 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-93fb2bf8-7b36-4590-bbe6-df9f35fafcc0 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:38.187416 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-4f035637-3315-4377-9d29-d2cb3a0156b4 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "GET /compute/v2.1/servers/e5842070-d5a3-43f9-82f8-ebce4eaf5526" status: 200 len: 1509 microversion: 2.1 time: 0.235195 Oct 04 22:03:38.190060 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2138/4213] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:03:37 2022] GET /compute/v2.1/servers/e5842070-d5a3-43f9-82f8-ebce4eaf5526 => generated 1509 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:03:38.343559 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-93fb2bf8-7b36-4590-bbe6-df9f35fafcc0 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f46a71ea0ee4e45afaea7e38e8c0ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba14e6816284d9e89e22913643f4355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:38.352815 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-93fb2bf8-7b36-4590-bbe6-df9f35fafcc0 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] 10.222.0.43 "GET /compute/v2.1/servers/07e11885-b7b0-4ad1-bda6-a677b9aaf48d" status: 200 len: 1520 microversion: 2.1 time: 0.193431 Oct 04 22:03:38.353513 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2076/4214] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:03:38 2022] GET /compute/v2.1/servers/07e11885-b7b0-4ad1-bda6-a677b9aaf48d => generated 1520 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:03:38.711057 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-d7aefa29-6968-4d3e-810d-b625e4961d4e req-0b515f73-b6f8-46d4-97a5-a32c539022be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad97980f-d9c5-4237-b84a-2a13dfbc7764", "name": "network-vif-plugged", "status": "completed", "tag": "eb2633ea-2747-42ba-9388-e6e2161cfa52"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:03:38.731826 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-d7aefa29-6968-4d3e-810d-b625e4961d4e req-0b515f73-b6f8-46d4-97a5-a32c539022be service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:38.732462 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-d7aefa29-6968-4d3e-810d-b625e4961d4e req-0b515f73-b6f8-46d4-97a5-a32c539022be service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:38.733966 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-d7aefa29-6968-4d3e-810d-b625e4961d4e req-0b515f73-b6f8-46d4-97a5-a32c539022be service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:38.748042 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:03:38.765770 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-d7aefa29-6968-4d3e-810d-b625e4961d4e req-0b515f73-b6f8-46d4-97a5-a32c539022be service nova] Creating event network-vif-plugged:eb2633ea-2747-42ba-9388-e6e2161cfa52 for instance ad97980f-d9c5-4237-b84a-2a13dfbc7764 on n-h1-860284-1 Oct 04 22:03:38.774797 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-d7aefa29-6968-4d3e-810d-b625e4961d4e req-0b515f73-b6f8-46d4-97a5-a32c539022be service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072602 Oct 04 22:03:38.775899 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2139/4215] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:03:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:03:38.910449 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-b617512b-54fb-4ad4-a441-cdbd02b5763d tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:38.911022 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-b617512b-54fb-4ad4-a441-cdbd02b5763d tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] [instance: ad97980f-d9c5-4237-b84a-2a13dfbc7764] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:03:38.923484 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b617512b-54fb-4ad4-a441-cdbd02b5763d tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:38.923965 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b617512b-54fb-4ad4-a441-cdbd02b5763d tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:38.924691 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b617512b-54fb-4ad4-a441-cdbd02b5763d tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:38.925787 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b617512b-54fb-4ad4-a441-cdbd02b5763d tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:38.926412 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b617512b-54fb-4ad4-a441-cdbd02b5763d tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:38.927093 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b617512b-54fb-4ad4-a441-cdbd02b5763d tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:39.085280 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-b617512b-54fb-4ad4-a441-cdbd02b5763d tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973de86311b47e882de18efbcb3f67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e037651e3345a8b95ea528cae02c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:39.099001 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-b617512b-54fb-4ad4-a441-cdbd02b5763d tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] 10.222.0.43 "GET /compute/v2.1/servers/ad97980f-d9c5-4237-b84a-2a13dfbc7764" status: 200 len: 1325 microversion: 2.1 time: 0.192117 Oct 04 22:03:39.099962 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2077/4216] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:03:38 2022] GET /compute/v2.1/servers/ad97980f-d9c5-4237-b84a-2a13dfbc7764 => generated 1325 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:03:39.167472 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-3fd4fd4e-7d13-40ee-96b4-109acd7623b5 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:39.169934 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-3fd4fd4e-7d13-40ee-96b4-109acd7623b5 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] [instance: 39dc4bb1-8465-4576-b490-d066c0fbb18f] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:03:39.183839 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3fd4fd4e-7d13-40ee-96b4-109acd7623b5 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:39.185117 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3fd4fd4e-7d13-40ee-96b4-109acd7623b5 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:39.185797 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3fd4fd4e-7d13-40ee-96b4-109acd7623b5 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:39.188141 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3fd4fd4e-7d13-40ee-96b4-109acd7623b5 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:39.188979 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3fd4fd4e-7d13-40ee-96b4-109acd7623b5 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:39.189562 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3fd4fd4e-7d13-40ee-96b4-109acd7623b5 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:39.217370 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-1198214f-49c2-429f-94fd-3129442e6576 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:39.218343 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-1198214f-49c2-429f-94fd-3129442e6576 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: e5842070-d5a3-43f9-82f8-ebce4eaf5526] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:03:39.225752 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1198214f-49c2-429f-94fd-3129442e6576 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:39.231205 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1198214f-49c2-429f-94fd-3129442e6576 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:39.231926 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1198214f-49c2-429f-94fd-3129442e6576 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:39.232914 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1198214f-49c2-429f-94fd-3129442e6576 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:39.233720 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1198214f-49c2-429f-94fd-3129442e6576 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:39.234393 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1198214f-49c2-429f-94fd-3129442e6576 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:39.301080 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-3fd4fd4e-7d13-40ee-96b4-109acd7623b5 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92894af6b8f74650ad7696e1f3ac375d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f24f86f0fc4a3ba09c2be55876c783', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:39.310678 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-3fd4fd4e-7d13-40ee-96b4-109acd7623b5 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92894af6b8f74650ad7696e1f3ac375d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f24f86f0fc4a3ba09c2be55876c783', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:39.312461 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-3fd4fd4e-7d13-40ee-96b4-109acd7623b5 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92894af6b8f74650ad7696e1f3ac375d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f24f86f0fc4a3ba09c2be55876c783', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:39.313827 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-3fd4fd4e-7d13-40ee-96b4-109acd7623b5 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] 10.222.0.43 "GET /compute/v2.1/servers/39dc4bb1-8465-4576-b490-d066c0fbb18f" status: 200 len: 1407 microversion: 2.54 time: 0.157019 Oct 04 22:03:39.314570 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2140/4217] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:03:39 2022] GET /compute/v2.1/servers/39dc4bb1-8465-4576-b490-d066c0fbb18f => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:03:39.375820 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-c5cc41a1-c759-4d19-89ec-8bed8adafd3a tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:39.376547 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-c5cc41a1-c759-4d19-89ec-8bed8adafd3a tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] [instance: 07e11885-b7b0-4ad1-bda6-a677b9aaf48d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:03:39.383987 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c5cc41a1-c759-4d19-89ec-8bed8adafd3a tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:39.384588 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c5cc41a1-c759-4d19-89ec-8bed8adafd3a tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:39.385104 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c5cc41a1-c759-4d19-89ec-8bed8adafd3a tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:39.385906 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c5cc41a1-c759-4d19-89ec-8bed8adafd3a tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:39.386459 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c5cc41a1-c759-4d19-89ec-8bed8adafd3a tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:39.387103 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c5cc41a1-c759-4d19-89ec-8bed8adafd3a tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:39.478196 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-1198214f-49c2-429f-94fd-3129442e6576 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a1c8d841104bc9b6910bcc2c0e2bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe9283584fc4d90b0715216d867ea2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:39.493075 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-1198214f-49c2-429f-94fd-3129442e6576 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "GET /compute/v2.1/servers/e5842070-d5a3-43f9-82f8-ebce4eaf5526" status: 200 len: 1509 microversion: 2.1 time: 0.278965 Oct 04 22:03:39.493750 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2078/4218] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:03:39 2022] GET /compute/v2.1/servers/e5842070-d5a3-43f9-82f8-ebce4eaf5526 => generated 1509 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:03:39.566099 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-c5cc41a1-c759-4d19-89ec-8bed8adafd3a tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f46a71ea0ee4e45afaea7e38e8c0ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba14e6816284d9e89e22913643f4355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:39.576478 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-c5cc41a1-c759-4d19-89ec-8bed8adafd3a tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] 10.222.0.43 "GET /compute/v2.1/servers/07e11885-b7b0-4ad1-bda6-a677b9aaf48d" status: 200 len: 1520 microversion: 2.1 time: 0.204327 Oct 04 22:03:39.577241 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2141/4219] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:03:39 2022] GET /compute/v2.1/servers/07e11885-b7b0-4ad1-bda6-a677b9aaf48d => generated 1520 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:03:40.123024 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-5804fb00-2d47-4a31-a583-27a0b86be541 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:40.123638 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-5804fb00-2d47-4a31-a583-27a0b86be541 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] [instance: ad97980f-d9c5-4237-b84a-2a13dfbc7764] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:03:40.130634 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5804fb00-2d47-4a31-a583-27a0b86be541 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:40.131413 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5804fb00-2d47-4a31-a583-27a0b86be541 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:40.132326 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5804fb00-2d47-4a31-a583-27a0b86be541 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:40.134171 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5804fb00-2d47-4a31-a583-27a0b86be541 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:40.134871 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5804fb00-2d47-4a31-a583-27a0b86be541 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:40.135552 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5804fb00-2d47-4a31-a583-27a0b86be541 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:40.310791 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-5804fb00-2d47-4a31-a583-27a0b86be541 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973de86311b47e882de18efbcb3f67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e037651e3345a8b95ea528cae02c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:40.319525 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-5804fb00-2d47-4a31-a583-27a0b86be541 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] 10.222.0.43 "GET /compute/v2.1/servers/ad97980f-d9c5-4237-b84a-2a13dfbc7764" status: 200 len: 1325 microversion: 2.1 time: 0.200304 Oct 04 22:03:40.321198 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2079/4220] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:03:40 2022] GET /compute/v2.1/servers/ad97980f-d9c5-4237-b84a-2a13dfbc7764 => generated 1325 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:03:40.341117 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-e7a6dd1f-0283-421b-8611-b52cb826dd6c tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:40.341902 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-e7a6dd1f-0283-421b-8611-b52cb826dd6c tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] [instance: 39dc4bb1-8465-4576-b490-d066c0fbb18f] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:03:40.350261 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e7a6dd1f-0283-421b-8611-b52cb826dd6c tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:40.350512 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e7a6dd1f-0283-421b-8611-b52cb826dd6c tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:40.350959 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e7a6dd1f-0283-421b-8611-b52cb826dd6c tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:40.351905 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e7a6dd1f-0283-421b-8611-b52cb826dd6c tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:40.352440 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e7a6dd1f-0283-421b-8611-b52cb826dd6c tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:40.352877 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e7a6dd1f-0283-421b-8611-b52cb826dd6c tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:40.425210 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-e7a6dd1f-0283-421b-8611-b52cb826dd6c tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92894af6b8f74650ad7696e1f3ac375d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f24f86f0fc4a3ba09c2be55876c783', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:40.440613 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-e7a6dd1f-0283-421b-8611-b52cb826dd6c tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92894af6b8f74650ad7696e1f3ac375d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f24f86f0fc4a3ba09c2be55876c783', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:40.442077 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-e7a6dd1f-0283-421b-8611-b52cb826dd6c tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92894af6b8f74650ad7696e1f3ac375d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f24f86f0fc4a3ba09c2be55876c783', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:40.443311 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-e7a6dd1f-0283-421b-8611-b52cb826dd6c tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] 10.222.0.43 "GET /compute/v2.1/servers/39dc4bb1-8465-4576-b490-d066c0fbb18f" status: 200 len: 1407 microversion: 2.54 time: 0.106378 Oct 04 22:03:40.454388 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2142/4221] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:03:40 2022] GET /compute/v2.1/servers/39dc4bb1-8465-4576-b490-d066c0fbb18f => generated 1407 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:03:40.517551 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-651c4097-98b9-4ff9-bbb7-5d0807e878e1 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:40.518180 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-651c4097-98b9-4ff9-bbb7-5d0807e878e1 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: e5842070-d5a3-43f9-82f8-ebce4eaf5526] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:03:40.534266 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-651c4097-98b9-4ff9-bbb7-5d0807e878e1 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:40.537485 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-651c4097-98b9-4ff9-bbb7-5d0807e878e1 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:40.537969 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-651c4097-98b9-4ff9-bbb7-5d0807e878e1 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:40.539094 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-651c4097-98b9-4ff9-bbb7-5d0807e878e1 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:40.543227 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-651c4097-98b9-4ff9-bbb7-5d0807e878e1 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:40.543746 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-651c4097-98b9-4ff9-bbb7-5d0807e878e1 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:40.602235 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-4559097b-defd-4aef-941a-793f71d41231 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:40.602939 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-4559097b-defd-4aef-941a-793f71d41231 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] [instance: 07e11885-b7b0-4ad1-bda6-a677b9aaf48d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:03:40.624900 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4559097b-defd-4aef-941a-793f71d41231 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:40.625549 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4559097b-defd-4aef-941a-793f71d41231 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:40.626207 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4559097b-defd-4aef-941a-793f71d41231 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:40.627429 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4559097b-defd-4aef-941a-793f71d41231 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:40.632147 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4559097b-defd-4aef-941a-793f71d41231 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:40.633589 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4559097b-defd-4aef-941a-793f71d41231 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:40.760489 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-651c4097-98b9-4ff9-bbb7-5d0807e878e1 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a1c8d841104bc9b6910bcc2c0e2bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe9283584fc4d90b0715216d867ea2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:40.769559 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-651c4097-98b9-4ff9-bbb7-5d0807e878e1 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "GET /compute/v2.1/servers/e5842070-d5a3-43f9-82f8-ebce4eaf5526" status: 200 len: 1509 microversion: 2.1 time: 0.256149 Oct 04 22:03:40.770531 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2080/4222] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:03:40 2022] GET /compute/v2.1/servers/e5842070-d5a3-43f9-82f8-ebce4eaf5526 => generated 1509 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:03:40.819802 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-4559097b-defd-4aef-941a-793f71d41231 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f46a71ea0ee4e45afaea7e38e8c0ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba14e6816284d9e89e22913643f4355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:40.828551 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-4559097b-defd-4aef-941a-793f71d41231 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] 10.222.0.43 "GET /compute/v2.1/servers/07e11885-b7b0-4ad1-bda6-a677b9aaf48d" status: 200 len: 1520 microversion: 2.1 time: 0.231578 Oct 04 22:03:40.829347 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2143/4223] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:03:40 2022] GET /compute/v2.1/servers/07e11885-b7b0-4ad1-bda6-a677b9aaf48d => generated 1520 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:03:41.344534 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-018be5ad-e2ac-4617-87a8-82dd4e66c5c8 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:41.345376 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-018be5ad-e2ac-4617-87a8-82dd4e66c5c8 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] [instance: ad97980f-d9c5-4237-b84a-2a13dfbc7764] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:03:41.354312 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-018be5ad-e2ac-4617-87a8-82dd4e66c5c8 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:41.354744 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-018be5ad-e2ac-4617-87a8-82dd4e66c5c8 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:41.355417 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-018be5ad-e2ac-4617-87a8-82dd4e66c5c8 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:41.356414 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-018be5ad-e2ac-4617-87a8-82dd4e66c5c8 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:41.356939 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-018be5ad-e2ac-4617-87a8-82dd4e66c5c8 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:41.357380 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-018be5ad-e2ac-4617-87a8-82dd4e66c5c8 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:41.470861 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-5b7585de-963f-4703-91c7-16661ddd1508 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:41.471519 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-5b7585de-963f-4703-91c7-16661ddd1508 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] [instance: 39dc4bb1-8465-4576-b490-d066c0fbb18f] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:03:41.482264 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5b7585de-963f-4703-91c7-16661ddd1508 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:41.483519 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5b7585de-963f-4703-91c7-16661ddd1508 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:41.484186 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5b7585de-963f-4703-91c7-16661ddd1508 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:41.486421 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5b7585de-963f-4703-91c7-16661ddd1508 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:41.487325 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5b7585de-963f-4703-91c7-16661ddd1508 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:41.487861 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5b7585de-963f-4703-91c7-16661ddd1508 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:41.543250 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-018be5ad-e2ac-4617-87a8-82dd4e66c5c8 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973de86311b47e882de18efbcb3f67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e037651e3345a8b95ea528cae02c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:41.545811 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:03:41.553907 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-018be5ad-e2ac-4617-87a8-82dd4e66c5c8 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] 10.222.0.43 "GET /compute/v2.1/servers/ad97980f-d9c5-4237-b84a-2a13dfbc7764" status: 200 len: 1522 microversion: 2.1 time: 0.213306 Oct 04 22:03:41.555060 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2081/4224] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:03:41 2022] GET /compute/v2.1/servers/ad97980f-d9c5-4237-b84a-2a13dfbc7764 => generated 1522 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:03:41.582892 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-44cfe2d4-2fa4-47c1-a4ae-d5e073797088 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:41.583805 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-44cfe2d4-2fa4-47c1-a4ae-d5e073797088 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] [instance: ad97980f-d9c5-4237-b84a-2a13dfbc7764] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:03:41.584054 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-5b7585de-963f-4703-91c7-16661ddd1508 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92894af6b8f74650ad7696e1f3ac375d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f24f86f0fc4a3ba09c2be55876c783', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:41.593371 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-44cfe2d4-2fa4-47c1-a4ae-d5e073797088 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:41.593850 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-44cfe2d4-2fa4-47c1-a4ae-d5e073797088 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:41.594331 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-44cfe2d4-2fa4-47c1-a4ae-d5e073797088 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:41.595433 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-44cfe2d4-2fa4-47c1-a4ae-d5e073797088 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:41.595766 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-44cfe2d4-2fa4-47c1-a4ae-d5e073797088 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:41.596879 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-44cfe2d4-2fa4-47c1-a4ae-d5e073797088 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:41.606460 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-5b7585de-963f-4703-91c7-16661ddd1508 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92894af6b8f74650ad7696e1f3ac375d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f24f86f0fc4a3ba09c2be55876c783', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:41.608431 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-5b7585de-963f-4703-91c7-16661ddd1508 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92894af6b8f74650ad7696e1f3ac375d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f24f86f0fc4a3ba09c2be55876c783', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:41.610539 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-5b7585de-963f-4703-91c7-16661ddd1508 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] 10.222.0.43 "GET /compute/v2.1/servers/39dc4bb1-8465-4576-b490-d066c0fbb18f" status: 200 len: 1407 microversion: 2.54 time: 0.143871 Oct 04 22:03:41.611953 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2144/4225] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:03:41 2022] GET /compute/v2.1/servers/39dc4bb1-8465-4576-b490-d066c0fbb18f => generated 1407 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 22:03:41.767877 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-44cfe2d4-2fa4-47c1-a4ae-d5e073797088 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973de86311b47e882de18efbcb3f67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e037651e3345a8b95ea528cae02c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:41.776799 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-44cfe2d4-2fa4-47c1-a4ae-d5e073797088 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] 10.222.0.43 "GET /compute/v2.1/servers/ad97980f-d9c5-4237-b84a-2a13dfbc7764" status: 200 len: 1522 microversion: 2.1 time: 0.200384 Oct 04 22:03:41.777508 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2082/4226] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:03:41 2022] GET /compute/v2.1/servers/ad97980f-d9c5-4237-b84a-2a13dfbc7764 => generated 1522 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:03:41.799649 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-4f33a00d-63b2-4209-ad39-7f507f262e1c tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-683034634", "metadata": {"": ""}}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:03:41.799861 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-1124d91e-121f-4e30-9c06-5805d1b5db14 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:41.800605 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-1124d91e-121f-4e30-9c06-5805d1b5db14 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: e5842070-d5a3-43f9-82f8-ebce4eaf5526] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:03:41.805067 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-4f33a00d-63b2-4209-ad39-7f507f262e1c tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Request method failure captured: Oct 04 22:03:41.805067 n-d-860284-1 devstack@n-api.service[134101]: request: POST /compute/v2.1/servers/ad97980f-d9c5-4237-b84a-2a13dfbc7764/action HTTP/1.1 Oct 04 22:03:41.805067 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 22:03:41.805067 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 22:03:41.805067 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 22:03:41.805067 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 106 Oct 04 22:03:41.805067 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 22:03:41.805067 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 22:03:41.805067 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 22:03:41.805067 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 22:03:41.805067 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPK2uaWdbUBgaC4RfPmjtTbjIfwc-i2umyIIBK_cF0D-_RCmikTip9FKSkMA-3LEgg0VpJcoPxMz4oo_myk5qoqg03ZgavcBoIAuumM_46SfpdfsovWLWxw7rAOFQTEcjFL3h_S0RmznoPUhj4-fuUVB2M5gfUS2qQyVeicBq2kx7daY Oct 04 22:03:41.805067 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 22:03:41.805067 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 22:03:41.805067 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 22:03:41.805067 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 22:03:41.805067 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 22:03:41.805067 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 22:03:41.805067 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: a1e037651e3345a8b95ea528cae02c9f Oct 04 22:03:41.805067 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-342298031 Oct 04 22:03:41.805067 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 22:03:41.805067 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 22:03:41.805067 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a1e037651e3345a8b95ea528cae02c9f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_a1e037651e3345a8b95ea528cae02c9f", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a1e037651e3345a8b95ea528cae02c9f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/a1e037651e3345a8b95ea528cae02c9f"}]}] Oct 04 22:03:41.805067 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-342298031 Oct 04 22:03:41.805067 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: a1e037651e3345a8b95ea528cae02c9f Oct 04 22:03:41.805067 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-342298031 Oct 04 22:03:41.805067 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-ImagesOneServerNegativeTestJSON-342298031-project Oct 04 22:03:41.805067 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 22:03:41.805067 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 22:03:41.805067 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 9973de86311b47e882de18efbcb3f67f Oct 04 22:03:41.805067 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-342298031-project Oct 04 22:03:41.805067 n-d-860284-1 devstack@n-api.service[134101]: Oct 04 22:03:41.805067 n-d-860284-1 devstack@n-api.service[134101]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-683034634", "metadata": {"": ""}}} Oct 04 22:03:41.805067 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 22:03:41.805067 n-d-860284-1 devstack@n-api.service[134101]: exception: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 22:03:41.805067 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': 'ad97980f-d9c5-4237-b84a-2a13dfbc7764', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-683034634', 'metadata': {'': ''}}}} Oct 04 22:03:41.805067 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:03:41.805067 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:03:41.805067 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 22:03:41.805067 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 22:03:41.805067 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 22:03:41.805067 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise error Oct 04 22:03:41.805067 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 22:03:41.805067 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:03:41.805067 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Oct 04 22:03:41.805067 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 04 22:03:41.805067 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 04 22:03:41.805067 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 04 22:03:41.805067 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 04 22:03:41.805067 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:03:41.805067 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 04 22:03:41.805067 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi {'': ''} Oct 04 22:03:41.805067 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:03:41.805067 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:03:41.805067 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:03:41.805067 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:03:41.805067 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:03:41.805067 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:03:41.805067 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:03:41.805067 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:03:41.805067 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:03:41.805067 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:03:41.805067 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 22:03:41.805067 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 22:03:41.805067 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 22:03:41.808907 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 22:03:41.808907 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 22:03:41.808907 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 22:03:41.808907 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 22:03:41.808907 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 22:03:41.808907 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 22:03:41.808907 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:03:41.808907 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:03:41.808907 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:03:41.808907 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:03:41.808907 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:03:41.808907 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:03:41.808907 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 22:03:41.808907 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 22:03:41.808907 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 22:03:41.808907 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:03:41.809751 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1124d91e-121f-4e30-9c06-5805d1b5db14 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:41.809751 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1124d91e-121f-4e30-9c06-5805d1b5db14 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:41.809992 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1124d91e-121f-4e30-9c06-5805d1b5db14 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:41.810845 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1124d91e-121f-4e30-9c06-5805d1b5db14 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:41.811366 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1124d91e-121f-4e30-9c06-5805d1b5db14 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:41.811787 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-4f33a00d-63b2-4209-ad39-7f507f262e1c tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:03:41.812029 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1124d91e-121f-4e30-9c06-5805d1b5db14 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:41.813251 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-4f33a00d-63b2-4209-ad39-7f507f262e1c tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] 10.222.0.43 "POST /compute/v2.1/servers/ad97980f-d9c5-4237-b84a-2a13dfbc7764/action" status: 400 len: 170 microversion: 2.1 time: 0.017418 Oct 04 22:03:41.817497 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2083/4227] 10.222.0.43 () {60 vars in 1279 bytes} [Tue Oct 4 22:03:41 2022] POST /compute/v2.1/servers/ad97980f-d9c5-4237-b84a-2a13dfbc7764/action => generated 170 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 04 22:03:41.824614 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-ae46d80f-af1b-4b51-8d51-912f95532069 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:41.825257 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-ae46d80f-af1b-4b51-8d51-912f95532069 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] [instance: ad97980f-d9c5-4237-b84a-2a13dfbc7764] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:03:41.833328 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ae46d80f-af1b-4b51-8d51-912f95532069 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:41.833989 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ae46d80f-af1b-4b51-8d51-912f95532069 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:41.834463 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ae46d80f-af1b-4b51-8d51-912f95532069 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:41.835366 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ae46d80f-af1b-4b51-8d51-912f95532069 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:41.836848 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ae46d80f-af1b-4b51-8d51-912f95532069 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:41.837551 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ae46d80f-af1b-4b51-8d51-912f95532069 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:42.075952 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-ae46d80f-af1b-4b51-8d51-912f95532069 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973de86311b47e882de18efbcb3f67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e037651e3345a8b95ea528cae02c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:42.078193 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-1124d91e-121f-4e30-9c06-5805d1b5db14 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a1c8d841104bc9b6910bcc2c0e2bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe9283584fc4d90b0715216d867ea2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:42.085031 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-ae46d80f-af1b-4b51-8d51-912f95532069 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] 10.222.0.43 "GET /compute/v2.1/servers/ad97980f-d9c5-4237-b84a-2a13dfbc7764" status: 200 len: 1522 microversion: 2.1 time: 0.266515 Oct 04 22:03:42.085666 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2084/4228] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:03:41 2022] GET /compute/v2.1/servers/ad97980f-d9c5-4237-b84a-2a13dfbc7764 => generated 1522 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:03:42.091226 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-bf1f8884-90a5-4c97-aa19-ad7b97f4915a tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:42.092050 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-bf1f8884-90a5-4c97-aa19-ad7b97f4915a tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] [instance: 07e11885-b7b0-4ad1-bda6-a677b9aaf48d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:03:42.095775 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-1124d91e-121f-4e30-9c06-5805d1b5db14 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "GET /compute/v2.1/servers/e5842070-d5a3-43f9-82f8-ebce4eaf5526" status: 200 len: 1509 microversion: 2.1 time: 0.301178 Oct 04 22:03:42.100325 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bf1f8884-90a5-4c97-aa19-ad7b97f4915a tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:42.101856 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bf1f8884-90a5-4c97-aa19-ad7b97f4915a tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:42.102623 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bf1f8884-90a5-4c97-aa19-ad7b97f4915a tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:42.103506 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bf1f8884-90a5-4c97-aa19-ad7b97f4915a tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:42.104108 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bf1f8884-90a5-4c97-aa19-ad7b97f4915a tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:42.104851 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bf1f8884-90a5-4c97-aa19-ad7b97f4915a tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:42.106528 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2145/4229] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:03:41 2022] GET /compute/v2.1/servers/e5842070-d5a3-43f9-82f8-ebce4eaf5526 => generated 1509 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:03:42.118105 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-7d405681-1176-46d4-ad14-5d6f98a3958b tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:42.119295 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-7d405681-1176-46d4-ad14-5d6f98a3958b tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] [instance: ad97980f-d9c5-4237-b84a-2a13dfbc7764] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:03:42.126882 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7d405681-1176-46d4-ad14-5d6f98a3958b tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:42.127646 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7d405681-1176-46d4-ad14-5d6f98a3958b tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:42.128090 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7d405681-1176-46d4-ad14-5d6f98a3958b tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:42.128972 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7d405681-1176-46d4-ad14-5d6f98a3958b tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:42.129966 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7d405681-1176-46d4-ad14-5d6f98a3958b tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:42.130601 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7d405681-1176-46d4-ad14-5d6f98a3958b tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:42.664671 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell0:SELECT=20 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:03:42.683183 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-bf1f8884-90a5-4c97-aa19-ad7b97f4915a tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f46a71ea0ee4e45afaea7e38e8c0ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba14e6816284d9e89e22913643f4355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:42.692661 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-bf1f8884-90a5-4c97-aa19-ad7b97f4915a tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] 10.222.0.43 "GET /compute/v2.1/servers/07e11885-b7b0-4ad1-bda6-a677b9aaf48d" status: 200 len: 1520 microversion: 2.1 time: 0.605785 Oct 04 22:03:42.693236 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2085/4230] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:03:42 2022] GET /compute/v2.1/servers/07e11885-b7b0-4ad1-bda6-a677b9aaf48d => generated 1520 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:03:42.698811 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-81e964b1-fae0-43ed-911f-6a2f79c2269f tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:42.699748 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-81e964b1-fae0-43ed-911f-6a2f79c2269f tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] [instance: 39dc4bb1-8465-4576-b490-d066c0fbb18f] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:03:42.706502 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=100 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:03:42.708428 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-81e964b1-fae0-43ed-911f-6a2f79c2269f tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:42.709206 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-81e964b1-fae0-43ed-911f-6a2f79c2269f tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:42.709843 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-81e964b1-fae0-43ed-911f-6a2f79c2269f tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:42.711449 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-81e964b1-fae0-43ed-911f-6a2f79c2269f tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:42.712393 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-81e964b1-fae0-43ed-911f-6a2f79c2269f tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:42.712730 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-81e964b1-fae0-43ed-911f-6a2f79c2269f tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:42.721194 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-7d405681-1176-46d4-ad14-5d6f98a3958b tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973de86311b47e882de18efbcb3f67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e037651e3345a8b95ea528cae02c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:42.731628 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-7d405681-1176-46d4-ad14-5d6f98a3958b tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] 10.222.0.43 "GET /compute/v2.1/servers/ad97980f-d9c5-4237-b84a-2a13dfbc7764" status: 200 len: 1522 microversion: 2.1 time: 0.623796 Oct 04 22:03:42.732475 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2146/4231] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:03:42 2022] GET /compute/v2.1/servers/ad97980f-d9c5-4237-b84a-2a13dfbc7764 => generated 1522 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:03:42.756817 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-ccb3b48b-1d12-455c-9063-9b485bbf1363 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-439237541", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:03:42.761772 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-ccb3b48b-1d12-455c-9063-9b485bbf1363 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Request method failure captured: Oct 04 22:03:42.761772 n-d-860284-1 devstack@n-api.service[134102]: request: POST /compute/v2.1/servers/ad97980f-d9c5-4237-b84a-2a13dfbc7764/action HTTP/1.1 Oct 04 22:03:42.761772 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 22:03:42.761772 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 22:03:42.761772 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 22:03:42.761772 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 618 Oct 04 22:03:42.761772 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 22:03:42.761772 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 22:03:42.761772 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 22:03:42.761772 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 22:03:42.761772 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPK2uaWdbUBgaC4RfPmjtTbjIfwc-i2umyIIBK_cF0D-_RCmikTip9FKSkMA-3LEgg0VpJcoPxMz4oo_myk5qoqg03ZgavcBoIAuumM_46SfpdfsovWLWxw7rAOFQTEcjFL3h_S0RmznoPUhj4-fuUVB2M5gfUS2qQyVeicBq2kx7daY Oct 04 22:03:42.761772 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 22:03:42.761772 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 22:03:42.761772 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 22:03:42.761772 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 22:03:42.761772 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 22:03:42.761772 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 22:03:42.761772 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: a1e037651e3345a8b95ea528cae02c9f Oct 04 22:03:42.761772 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-342298031 Oct 04 22:03:42.761772 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 22:03:42.761772 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 22:03:42.761772 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a1e037651e3345a8b95ea528cae02c9f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_a1e037651e3345a8b95ea528cae02c9f", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a1e037651e3345a8b95ea528cae02c9f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/a1e037651e3345a8b95ea528cae02c9f"}]}] Oct 04 22:03:42.761772 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-342298031 Oct 04 22:03:42.761772 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: a1e037651e3345a8b95ea528cae02c9f Oct 04 22:03:42.761772 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-342298031 Oct 04 22:03:42.761772 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-ImagesOneServerNegativeTestJSON-342298031-project Oct 04 22:03:42.761772 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 22:03:42.761772 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 22:03:42.761772 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: 9973de86311b47e882de18efbcb3f67f Oct 04 22:03:42.761772 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-342298031-project Oct 04 22:03:42.761772 n-d-860284-1 devstack@n-api.service[134102]: Oct 04 22:03:42.761772 n-d-860284-1 devstack@n-api.service[134102]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-439237541", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} Oct 04 22:03:42.761772 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 22:03:42.761772 n-d-860284-1 devstack@n-api.service[134102]: exception: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 22:03:42.761772 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': 'ad97980f-d9c5-4237-b84a-2a13dfbc7764', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-439237541', 'metadata': {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}}}} Oct 04 22:03:42.761772 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:03:42.761772 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:03:42.761772 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 22:03:42.761772 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 22:03:42.761772 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 22:03:42.761772 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise error Oct 04 22:03:42.764597 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 22:03:42.764597 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:03:42.764597 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Oct 04 22:03:42.764597 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 04 22:03:42.764597 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 04 22:03:42.764597 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 04 22:03:42.764597 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 04 22:03:42.764597 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:03:42.764597 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 04 22:03:42.764597 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'} Oct 04 22:03:42.764597 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:03:42.764597 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:03:42.764597 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:03:42.764597 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:03:42.764597 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:03:42.764597 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:03:42.764597 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:03:42.764597 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:03:42.764597 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:03:42.764597 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:03:42.764597 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 22:03:42.764597 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 22:03:42.764597 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 22:03:42.764597 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 22:03:42.764597 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 22:03:42.764597 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 22:03:42.764597 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 22:03:42.764597 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 22:03:42.764597 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 22:03:42.764597 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:03:42.764597 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:03:42.764597 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:03:42.764597 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:03:42.764597 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:03:42.764597 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:03:42.764597 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 22:03:42.764597 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 22:03:42.764597 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 22:03:42.764597 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:03:42.767770 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-ccb3b48b-1d12-455c-9063-9b485bbf1363 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:03:42.768779 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-ccb3b48b-1d12-455c-9063-9b485bbf1363 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] 10.222.0.43 "POST /compute/v2.1/servers/ad97980f-d9c5-4237-b84a-2a13dfbc7764/action" status: 400 len: 938 microversion: 2.1 time: 0.016604 Oct 04 22:03:42.769618 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2147/4232] 10.222.0.43 () {60 vars in 1279 bytes} [Tue Oct 4 22:03:42 2022] POST /compute/v2.1/servers/ad97980f-d9c5-4237-b84a-2a13dfbc7764/action => generated 938 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 04 22:03:42.778135 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-031d6803-3781-47a7-9b9f-ec1141cc53b3 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:42.778802 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-031d6803-3781-47a7-9b9f-ec1141cc53b3 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] [instance: ad97980f-d9c5-4237-b84a-2a13dfbc7764] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:03:42.788007 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-031d6803-3781-47a7-9b9f-ec1141cc53b3 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:42.788497 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-031d6803-3781-47a7-9b9f-ec1141cc53b3 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:42.789735 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-031d6803-3781-47a7-9b9f-ec1141cc53b3 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:42.790510 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-031d6803-3781-47a7-9b9f-ec1141cc53b3 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:42.791064 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-031d6803-3781-47a7-9b9f-ec1141cc53b3 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:42.791499 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-031d6803-3781-47a7-9b9f-ec1141cc53b3 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:42.795884 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-81e964b1-fae0-43ed-911f-6a2f79c2269f tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92894af6b8f74650ad7696e1f3ac375d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f24f86f0fc4a3ba09c2be55876c783', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:42.806861 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-81e964b1-fae0-43ed-911f-6a2f79c2269f tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92894af6b8f74650ad7696e1f3ac375d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f24f86f0fc4a3ba09c2be55876c783', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:42.808227 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-81e964b1-fae0-43ed-911f-6a2f79c2269f tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92894af6b8f74650ad7696e1f3ac375d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f24f86f0fc4a3ba09c2be55876c783', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:42.809389 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-81e964b1-fae0-43ed-911f-6a2f79c2269f tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] 10.222.0.43 "GET /compute/v2.1/servers/39dc4bb1-8465-4576-b490-d066c0fbb18f" status: 200 len: 1407 microversion: 2.54 time: 0.114926 Oct 04 22:03:42.809956 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2086/4233] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:03:42 2022] GET /compute/v2.1/servers/39dc4bb1-8465-4576-b490-d066c0fbb18f => generated 1407 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:03:42.939535 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-031d6803-3781-47a7-9b9f-ec1141cc53b3 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973de86311b47e882de18efbcb3f67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e037651e3345a8b95ea528cae02c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:42.948150 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-031d6803-3781-47a7-9b9f-ec1141cc53b3 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] 10.222.0.43 "GET /compute/v2.1/servers/ad97980f-d9c5-4237-b84a-2a13dfbc7764" status: 200 len: 1522 microversion: 2.1 time: 0.173669 Oct 04 22:03:42.948638 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2148/4234] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:03:42 2022] GET /compute/v2.1/servers/ad97980f-d9c5-4237-b84a-2a13dfbc7764 => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:03:42.971498 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-2188f592-2f69-4fe4-a3b7-1acd903ee722 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:42.972555 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-2188f592-2f69-4fe4-a3b7-1acd903ee722 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] [instance: ad97980f-d9c5-4237-b84a-2a13dfbc7764] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:03:42.980270 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2188f592-2f69-4fe4-a3b7-1acd903ee722 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:42.980775 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2188f592-2f69-4fe4-a3b7-1acd903ee722 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:42.981230 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2188f592-2f69-4fe4-a3b7-1acd903ee722 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:42.982067 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2188f592-2f69-4fe4-a3b7-1acd903ee722 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:42.982470 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2188f592-2f69-4fe4-a3b7-1acd903ee722 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:42.983269 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2188f592-2f69-4fe4-a3b7-1acd903ee722 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:42.999950 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=4 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:03:43.125962 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-6acb164c-d0d8-49c0-977d-352813159d54 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:43.126652 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-6acb164c-d0d8-49c0-977d-352813159d54 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: e5842070-d5a3-43f9-82f8-ebce4eaf5526] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:03:43.134055 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6acb164c-d0d8-49c0-977d-352813159d54 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:43.134771 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6acb164c-d0d8-49c0-977d-352813159d54 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:43.135211 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6acb164c-d0d8-49c0-977d-352813159d54 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:43.135921 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6acb164c-d0d8-49c0-977d-352813159d54 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:43.136824 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6acb164c-d0d8-49c0-977d-352813159d54 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:43.136824 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6acb164c-d0d8-49c0-977d-352813159d54 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:43.190199 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-2188f592-2f69-4fe4-a3b7-1acd903ee722 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973de86311b47e882de18efbcb3f67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e037651e3345a8b95ea528cae02c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:43.198351 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-2188f592-2f69-4fe4-a3b7-1acd903ee722 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] 10.222.0.43 "GET /compute/v2.1/servers/ad97980f-d9c5-4237-b84a-2a13dfbc7764" status: 200 len: 1522 microversion: 2.1 time: 0.230700 Oct 04 22:03:43.199038 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2087/4235] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:03:42 2022] GET /compute/v2.1/servers/ad97980f-d9c5-4237-b84a-2a13dfbc7764 => generated 1522 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:03:43.222289 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-207d3837-7948-4407-82a9-d0ab1ac65106 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:03:43.226775 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-207d3837-7948-4407-82a9-d0ab1ac65106 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Request method failure captured: Oct 04 22:03:43.226775 n-d-860284-1 devstack@n-api.service[134101]: request: POST /compute/v2.1/servers/ad97980f-d9c5-4237-b84a-2a13dfbc7764/action HTTP/1.1 Oct 04 22:03:43.226775 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 22:03:43.226775 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 22:03:43.226775 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 22:03:43.226775 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 285 Oct 04 22:03:43.226775 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 22:03:43.226775 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 22:03:43.226775 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 22:03:43.226775 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 22:03:43.226775 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPK2uaWdbUBgaC4RfPmjtTbjIfwc-i2umyIIBK_cF0D-_RCmikTip9FKSkMA-3LEgg0VpJcoPxMz4oo_myk5qoqg03ZgavcBoIAuumM_46SfpdfsovWLWxw7rAOFQTEcjFL3h_S0RmznoPUhj4-fuUVB2M5gfUS2qQyVeicBq2kx7daY Oct 04 22:03:43.226775 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 22:03:43.226775 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 22:03:43.226775 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 22:03:43.226775 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 22:03:43.226775 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 22:03:43.226775 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 22:03:43.226775 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: a1e037651e3345a8b95ea528cae02c9f Oct 04 22:03:43.226775 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-342298031 Oct 04 22:03:43.226775 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 22:03:43.226775 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 22:03:43.226775 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a1e037651e3345a8b95ea528cae02c9f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_a1e037651e3345a8b95ea528cae02c9f", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a1e037651e3345a8b95ea528cae02c9f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/a1e037651e3345a8b95ea528cae02c9f"}]}] Oct 04 22:03:43.226775 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-342298031 Oct 04 22:03:43.226775 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: a1e037651e3345a8b95ea528cae02c9f Oct 04 22:03:43.226775 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-342298031 Oct 04 22:03:43.226775 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-ImagesOneServerNegativeTestJSON-342298031-project Oct 04 22:03:43.226775 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 22:03:43.226775 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 22:03:43.226775 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 9973de86311b47e882de18efbcb3f67f Oct 04 22:03:43.226775 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-342298031-project Oct 04 22:03:43.226775 n-d-860284-1 devstack@n-api.service[134101]: Oct 04 22:03:43.226775 n-d-860284-1 devstack@n-api.service[134101]: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 04 22:03:43.226775 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 22:03:43.226775 n-d-860284-1 devstack@n-api.service[134101]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 22:03:43.226775 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': 'ad97980f-d9c5-4237-b84a-2a13dfbc7764', 'body': {'createImage': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 04 22:03:43.226775 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:03:43.226775 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:03:43.226775 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 22:03:43.226775 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 22:03:43.226775 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 22:03:43.226775 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise error Oct 04 22:03:43.226775 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 22:03:43.226775 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:03:43.226775 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['createImage']['properties']['name']: Oct 04 22:03:43.226775 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 04 22:03:43.226775 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:03:43.226775 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 04 22:03:43.226775 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 04 22:03:43.226775 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:03:43.226775 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:03:43.226775 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:03:43.226775 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:03:43.230304 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:03:43.230304 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:03:43.230304 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:03:43.230304 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:03:43.230304 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:03:43.230304 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:03:43.230304 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 22:03:43.230304 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 22:03:43.230304 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 22:03:43.230304 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 22:03:43.230304 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 22:03:43.230304 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 22:03:43.230304 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 22:03:43.230304 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 22:03:43.230304 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 22:03:43.230304 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:03:43.230304 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:03:43.230304 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:03:43.230304 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:03:43.230304 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:03:43.230304 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:03:43.230304 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 22:03:43.230304 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 22:03:43.230304 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 22:03:43.230304 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:03:43.230304 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-207d3837-7948-4407-82a9-d0ab1ac65106 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:03:43.230304 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-207d3837-7948-4407-82a9-d0ab1ac65106 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] 10.222.0.43 "POST /compute/v2.1/servers/ad97980f-d9c5-4237-b84a-2a13dfbc7764/action" status: 400 len: 619 microversion: 2.1 time: 0.010653 Oct 04 22:03:43.232290 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2088/4236] 10.222.0.43 () {60 vars in 1279 bytes} [Tue Oct 4 22:03:43 2022] POST /compute/v2.1/servers/ad97980f-d9c5-4237-b84a-2a13dfbc7764/action => generated 619 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 04 22:03:43.237986 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-3262f745-25e3-425e-994e-3aeea68cd677 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:43.238715 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-3262f745-25e3-425e-994e-3aeea68cd677 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] [instance: ad97980f-d9c5-4237-b84a-2a13dfbc7764] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:03:43.246735 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3262f745-25e3-425e-994e-3aeea68cd677 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:43.247490 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3262f745-25e3-425e-994e-3aeea68cd677 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:43.248044 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3262f745-25e3-425e-994e-3aeea68cd677 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:43.248863 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3262f745-25e3-425e-994e-3aeea68cd677 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:43.249436 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3262f745-25e3-425e-994e-3aeea68cd677 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:43.249979 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3262f745-25e3-425e-994e-3aeea68cd677 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:43.340118 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-6acb164c-d0d8-49c0-977d-352813159d54 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a1c8d841104bc9b6910bcc2c0e2bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe9283584fc4d90b0715216d867ea2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:43.349634 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-6acb164c-d0d8-49c0-977d-352813159d54 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "GET /compute/v2.1/servers/e5842070-d5a3-43f9-82f8-ebce4eaf5526" status: 200 len: 1509 microversion: 2.1 time: 0.228084 Oct 04 22:03:43.350228 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2149/4237] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:03:43 2022] GET /compute/v2.1/servers/e5842070-d5a3-43f9-82f8-ebce4eaf5526 => generated 1509 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:03:43.411922 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-3262f745-25e3-425e-994e-3aeea68cd677 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973de86311b47e882de18efbcb3f67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e037651e3345a8b95ea528cae02c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:43.423055 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-3262f745-25e3-425e-994e-3aeea68cd677 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] 10.222.0.43 "GET /compute/v2.1/servers/ad97980f-d9c5-4237-b84a-2a13dfbc7764" status: 200 len: 1522 microversion: 2.1 time: 0.189553 Oct 04 22:03:43.423759 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2089/4238] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:03:43 2022] GET /compute/v2.1/servers/ad97980f-d9c5-4237-b84a-2a13dfbc7764 => generated 1522 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:03:43.447467 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-1797b367-ab4b-4953-b8d8-98ca306ec4c9 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:43.448012 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-1797b367-ab4b-4953-b8d8-98ca306ec4c9 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] [instance: ad97980f-d9c5-4237-b84a-2a13dfbc7764] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:03:43.452925 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell0:SELECT=8 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:03:43.455345 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1797b367-ab4b-4953-b8d8-98ca306ec4c9 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:43.455838 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1797b367-ab4b-4953-b8d8-98ca306ec4c9 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:43.456272 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1797b367-ab4b-4953-b8d8-98ca306ec4c9 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:43.456979 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1797b367-ab4b-4953-b8d8-98ca306ec4c9 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:43.457434 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1797b367-ab4b-4953-b8d8-98ca306ec4c9 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:43.458014 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1797b367-ab4b-4953-b8d8-98ca306ec4c9 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:43.718805 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-f0c347f4-fb47-44b8-a072-e7771df5daee tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:43.719587 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-f0c347f4-fb47-44b8-a072-e7771df5daee tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] [instance: 07e11885-b7b0-4ad1-bda6-a677b9aaf48d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:03:43.734949 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f0c347f4-fb47-44b8-a072-e7771df5daee tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:43.735510 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f0c347f4-fb47-44b8-a072-e7771df5daee tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:43.735919 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f0c347f4-fb47-44b8-a072-e7771df5daee tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:43.736877 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f0c347f4-fb47-44b8-a072-e7771df5daee tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:43.737446 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f0c347f4-fb47-44b8-a072-e7771df5daee tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:43.737813 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f0c347f4-fb47-44b8-a072-e7771df5daee tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:43.968418 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-1797b367-ab4b-4953-b8d8-98ca306ec4c9 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973de86311b47e882de18efbcb3f67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e037651e3345a8b95ea528cae02c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:43.972480 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-f0c347f4-fb47-44b8-a072-e7771df5daee tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f46a71ea0ee4e45afaea7e38e8c0ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba14e6816284d9e89e22913643f4355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:43.982148 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-f0c347f4-fb47-44b8-a072-e7771df5daee tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] 10.222.0.43 "GET /compute/v2.1/servers/07e11885-b7b0-4ad1-bda6-a677b9aaf48d" status: 200 len: 1520 microversion: 2.1 time: 0.267543 Oct 04 22:03:43.983965 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2090/4239] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:03:43 2022] GET /compute/v2.1/servers/07e11885-b7b0-4ad1-bda6-a677b9aaf48d => generated 1520 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:03:43.985423 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-1797b367-ab4b-4953-b8d8-98ca306ec4c9 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] 10.222.0.43 "GET /compute/v2.1/servers/ad97980f-d9c5-4237-b84a-2a13dfbc7764" status: 200 len: 1522 microversion: 2.1 time: 0.542829 Oct 04 22:03:43.987220 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2150/4240] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:03:43 2022] GET /compute/v2.1/servers/ad97980f-d9c5-4237-b84a-2a13dfbc7764 => generated 1522 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:03:43.988510 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-4b8a1a67-36bb-4696-b9fc-30e51de94024 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:43.989122 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-4b8a1a67-36bb-4696-b9fc-30e51de94024 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] [instance: 39dc4bb1-8465-4576-b490-d066c0fbb18f] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:03:43.995533 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4b8a1a67-36bb-4696-b9fc-30e51de94024 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:43.996005 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4b8a1a67-36bb-4696-b9fc-30e51de94024 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:43.996445 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4b8a1a67-36bb-4696-b9fc-30e51de94024 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:43.997178 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4b8a1a67-36bb-4696-b9fc-30e51de94024 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:43.997658 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4b8a1a67-36bb-4696-b9fc-30e51de94024 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:43.998072 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4b8a1a67-36bb-4696-b9fc-30e51de94024 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:44.026197 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-0571d21d-032b-4a81-a610-d5a1b2ecf952 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1364297803"}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:03:44.029008 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-0571d21d-032b-4a81-a610-d5a1b2ecf952 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] [instance: ad97980f-d9c5-4237-b84a-2a13dfbc7764] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:03:44.036138 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0571d21d-032b-4a81-a610-d5a1b2ecf952 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:44.036836 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0571d21d-032b-4a81-a610-d5a1b2ecf952 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:44.037446 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0571d21d-032b-4a81-a610-d5a1b2ecf952 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:44.038352 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0571d21d-032b-4a81-a610-d5a1b2ecf952 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:44.039914 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0571d21d-032b-4a81-a610-d5a1b2ecf952 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:44.040509 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0571d21d-032b-4a81-a610-d5a1b2ecf952 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:44.047099 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=14 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:03:44.083656 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-4b8a1a67-36bb-4696-b9fc-30e51de94024 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92894af6b8f74650ad7696e1f3ac375d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f24f86f0fc4a3ba09c2be55876c783', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:44.095415 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-4b8a1a67-36bb-4696-b9fc-30e51de94024 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92894af6b8f74650ad7696e1f3ac375d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f24f86f0fc4a3ba09c2be55876c783', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:44.096989 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-4b8a1a67-36bb-4696-b9fc-30e51de94024 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92894af6b8f74650ad7696e1f3ac375d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f24f86f0fc4a3ba09c2be55876c783', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:44.098487 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-4b8a1a67-36bb-4696-b9fc-30e51de94024 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] 10.222.0.43 "GET /compute/v2.1/servers/39dc4bb1-8465-4576-b490-d066c0fbb18f" status: 200 len: 1407 microversion: 2.54 time: 0.113611 Oct 04 22:03:44.099762 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2091/4241] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:03:43 2022] GET /compute/v2.1/servers/39dc4bb1-8465-4576-b490-d066c0fbb18f => generated 1407 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:03:44.283444 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-0571d21d-032b-4a81-a610-d5a1b2ecf952 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] 10.222.0.43 "POST /compute/v2.1/servers/ad97980f-d9c5-4237-b84a-2a13dfbc7764/action" status: 202 len: 0 microversion: 2.1 time: 0.263598 Oct 04 22:03:44.290539 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2151/4242] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 22:03:44 2022] POST /compute/v2.1/servers/ad97980f-d9c5-4237-b84a-2a13dfbc7764/action => generated 0 bytes in 265 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 04 22:03:44.298350 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-847099a8-2002-4a03-9043-1978a76b881e tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1351662257"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:03:44.308796 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-847099a8-2002-4a03-9043-1978a76b881e tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] [instance: ad97980f-d9c5-4237-b84a-2a13dfbc7764] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:03:44.316624 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-847099a8-2002-4a03-9043-1978a76b881e tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:44.317458 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-847099a8-2002-4a03-9043-1978a76b881e tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:44.317946 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-847099a8-2002-4a03-9043-1978a76b881e tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:44.318793 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-847099a8-2002-4a03-9043-1978a76b881e tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:44.319263 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-847099a8-2002-4a03-9043-1978a76b881e tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:44.319703 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-847099a8-2002-4a03-9043-1978a76b881e tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:44.357930 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-847099a8-2002-4a03-9043-1978a76b881e tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] HTTP exception thrown: Cannot 'createImage' instance ad97980f-d9c5-4237-b84a-2a13dfbc7764 while it is in task_state image_snapshot_pending Oct 04 22:03:44.359638 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-847099a8-2002-4a03-9043-1978a76b881e tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Request method failure captured: Oct 04 22:03:44.359638 n-d-860284-1 devstack@n-api.service[134101]: request: POST /compute/v2.1/servers/ad97980f-d9c5-4237-b84a-2a13dfbc7764/action HTTP/1.1 Oct 04 22:03:44.359638 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 22:03:44.359638 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 22:03:44.359638 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 22:03:44.359638 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 85 Oct 04 22:03:44.359638 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 22:03:44.359638 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 22:03:44.359638 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 22:03:44.359638 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 22:03:44.359638 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPK2uaWdbUBgaC4RfPmjtTbjIfwc-i2umyIIBK_cF0D-_RCmikTip9FKSkMA-3LEgg0VpJcoPxMz4oo_myk5qoqg03ZgavcBoIAuumM_46SfpdfsovWLWxw7rAOFQTEcjFL3h_S0RmznoPUhj4-fuUVB2M5gfUS2qQyVeicBq2kx7daY Oct 04 22:03:44.359638 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 22:03:44.359638 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 22:03:44.359638 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 22:03:44.359638 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 22:03:44.359638 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 22:03:44.359638 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 22:03:44.359638 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: a1e037651e3345a8b95ea528cae02c9f Oct 04 22:03:44.359638 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-342298031 Oct 04 22:03:44.359638 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 22:03:44.359638 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 22:03:44.359638 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a1e037651e3345a8b95ea528cae02c9f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_a1e037651e3345a8b95ea528cae02c9f", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a1e037651e3345a8b95ea528cae02c9f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/a1e037651e3345a8b95ea528cae02c9f"}]}] Oct 04 22:03:44.359638 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-342298031 Oct 04 22:03:44.359638 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: a1e037651e3345a8b95ea528cae02c9f Oct 04 22:03:44.359638 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-342298031 Oct 04 22:03:44.359638 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-ImagesOneServerNegativeTestJSON-342298031-project Oct 04 22:03:44.359638 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 22:03:44.359638 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 22:03:44.359638 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 9973de86311b47e882de18efbcb3f67f Oct 04 22:03:44.359638 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-342298031-project Oct 04 22:03:44.359638 n-d-860284-1 devstack@n-api.service[134101]: Oct 04 22:03:44.359638 n-d-860284-1 devstack@n-api.service[134101]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1351662257"}} Oct 04 22:03:44.359638 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 22:03:44.359638 n-d-860284-1 devstack@n-api.service[134101]: exception: Cannot 'createImage' instance ad97980f-d9c5-4237-b84a-2a13dfbc7764 while it is in task_state image_snapshot_pending Oct 04 22:03:44.359638 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': 'ad97980f-d9c5-4237-b84a-2a13dfbc7764', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1351662257'}}} Oct 04 22:03:44.359638 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:03:44.359638 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:03:44.359638 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1349, in _action_create_image Oct 04 22:03:44.359638 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi image = self.compute_api.snapshot(context, Oct 04 22:03:44.359638 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 155, in inner Oct 04 22:03:44.359638 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 04 22:03:44.359638 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ad97980f-d9c5-4237-b84a-2a13dfbc7764 in task_state image_snapshot_pending. Cannot snapshot while the instance is in this state. Oct 04 22:03:44.359638 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:03:44.359638 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:03:44.359638 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:03:44.359638 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:03:44.359638 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:03:44.359638 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:03:44.359638 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:03:44.359638 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:03:44.359638 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:03:44.359638 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:03:44.359638 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 22:03:44.359638 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 22:03:44.359638 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 22:03:44.359638 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 22:03:44.359638 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1354, in _action_create_image Oct 04 22:03:44.359638 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 04 22:03:44.359638 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 04 22:03:44.359638 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 22:03:44.363195 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'createImage' instance ad97980f-d9c5-4237-b84a-2a13dfbc7764 while it is in task_state image_snapshot_pending Oct 04 22:03:44.363195 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:03:44.363195 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:03:44.363195 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:03:44.363195 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:03:44.363195 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:03:44.363195 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:03:44.363195 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:03:44.363195 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:03:44.363195 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'createImage' instance ad97980f-d9c5-4237-b84a-2a13dfbc7764 while it is in task_state image_snapshot_pending Oct 04 22:03:44.363195 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:03:44.363195 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-847099a8-2002-4a03-9043-1978a76b881e tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Returning 409 to user: Cannot 'createImage' instance ad97980f-d9c5-4237-b84a-2a13dfbc7764 while it is in task_state image_snapshot_pending {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:03:44.363195 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-847099a8-2002-4a03-9043-1978a76b881e tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] 10.222.0.43 "POST /compute/v2.1/servers/ad97980f-d9c5-4237-b84a-2a13dfbc7764/action" status: 409 len: 167 microversion: 2.1 time: 0.068926 Oct 04 22:03:44.363195 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2092/4243] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 22:03:44 2022] POST /compute/v2.1/servers/ad97980f-d9c5-4237-b84a-2a13dfbc7764/action => generated 167 bytes in 70 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 22:03:44.375231 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-a60f56fd-e8c4-4b40-81e6-d7a13e7f18f4 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Calling method '.version_select at 0x7fbb2fa94790>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:44.391688 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-090b72ec-e5f2-4907-9200-61376895a0b7 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:44.397302 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-090b72ec-e5f2-4907-9200-61376895a0b7 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: e5842070-d5a3-43f9-82f8-ebce4eaf5526] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:03:44.403235 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-090b72ec-e5f2-4907-9200-61376895a0b7 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:44.403833 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-090b72ec-e5f2-4907-9200-61376895a0b7 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:44.404350 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-090b72ec-e5f2-4907-9200-61376895a0b7 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:44.405145 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-090b72ec-e5f2-4907-9200-61376895a0b7 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:44.405683 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-090b72ec-e5f2-4907-9200-61376895a0b7 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:44.406214 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-090b72ec-e5f2-4907-9200-61376895a0b7 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:44.551019 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-a60f56fd-e8c4-4b40-81e6-d7a13e7f18f4 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] 10.222.0.43 "DELETE /compute/v2.1/images/9a6d6140-ea5c-4b2c-a6b0-66a51dd4e2bd" status: 204 len: 0 microversion: 2.1 time: 0.184345 Oct 04 22:03:44.551609 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2152/4244] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:03:44 2022] DELETE /compute/v2.1/images/9a6d6140-ea5c-4b2c-a6b0-66a51dd4e2bd => generated 0 bytes in 186 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 22:03:44.562019 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-d1d107dd-122d-4b50-86ee-1b55c512d668 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:44.562909 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-d1d107dd-122d-4b50-86ee-1b55c512d668 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] [instance: ad97980f-d9c5-4237-b84a-2a13dfbc7764] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:03:44.572686 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d1d107dd-122d-4b50-86ee-1b55c512d668 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:44.573289 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d1d107dd-122d-4b50-86ee-1b55c512d668 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:44.573806 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d1d107dd-122d-4b50-86ee-1b55c512d668 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:44.577448 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d1d107dd-122d-4b50-86ee-1b55c512d668 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:44.578140 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d1d107dd-122d-4b50-86ee-1b55c512d668 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:44.578816 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d1d107dd-122d-4b50-86ee-1b55c512d668 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:44.584645 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-090b72ec-e5f2-4907-9200-61376895a0b7 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a1c8d841104bc9b6910bcc2c0e2bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe9283584fc4d90b0715216d867ea2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:44.594210 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-090b72ec-e5f2-4907-9200-61376895a0b7 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "GET /compute/v2.1/servers/e5842070-d5a3-43f9-82f8-ebce4eaf5526" status: 200 len: 1509 microversion: 2.1 time: 0.214428 Oct 04 22:03:44.598907 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2093/4245] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:03:44 2022] GET /compute/v2.1/servers/e5842070-d5a3-43f9-82f8-ebce4eaf5526 => generated 1509 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:03:44.750445 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-d1d107dd-122d-4b50-86ee-1b55c512d668 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973de86311b47e882de18efbcb3f67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e037651e3345a8b95ea528cae02c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:44.761181 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-d1d107dd-122d-4b50-86ee-1b55c512d668 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] 10.222.0.43 "GET /compute/v2.1/servers/ad97980f-d9c5-4237-b84a-2a13dfbc7764" status: 200 len: 1534 microversion: 2.1 time: 0.204690 Oct 04 22:03:44.762152 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2153/4246] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:03:44 2022] GET /compute/v2.1/servers/ad97980f-d9c5-4237-b84a-2a13dfbc7764 => generated 1534 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:03:45.015707 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-a89dffaf-a4b4-46ef-befb-f3e03ecbe8f1 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:45.016519 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-a89dffaf-a4b4-46ef-befb-f3e03ecbe8f1 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] [instance: 07e11885-b7b0-4ad1-bda6-a677b9aaf48d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:03:45.024247 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a89dffaf-a4b4-46ef-befb-f3e03ecbe8f1 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:45.024809 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a89dffaf-a4b4-46ef-befb-f3e03ecbe8f1 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:45.025255 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a89dffaf-a4b4-46ef-befb-f3e03ecbe8f1 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:45.026174 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a89dffaf-a4b4-46ef-befb-f3e03ecbe8f1 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:45.026662 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a89dffaf-a4b4-46ef-befb-f3e03ecbe8f1 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:45.027752 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a89dffaf-a4b4-46ef-befb-f3e03ecbe8f1 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:45.136888 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-b587576c-6b5d-43e4-ab30-173677e36673 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:45.138142 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-b587576c-6b5d-43e4-ab30-173677e36673 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] [instance: 39dc4bb1-8465-4576-b490-d066c0fbb18f] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:03:45.145536 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b587576c-6b5d-43e4-ab30-173677e36673 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:45.146273 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b587576c-6b5d-43e4-ab30-173677e36673 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:45.146796 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b587576c-6b5d-43e4-ab30-173677e36673 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:45.147511 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b587576c-6b5d-43e4-ab30-173677e36673 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:45.148913 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b587576c-6b5d-43e4-ab30-173677e36673 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:45.151212 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b587576c-6b5d-43e4-ab30-173677e36673 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:45.186579 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-a89dffaf-a4b4-46ef-befb-f3e03ecbe8f1 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f46a71ea0ee4e45afaea7e38e8c0ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba14e6816284d9e89e22913643f4355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:45.196245 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-a89dffaf-a4b4-46ef-befb-f3e03ecbe8f1 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] 10.222.0.43 "GET /compute/v2.1/servers/07e11885-b7b0-4ad1-bda6-a677b9aaf48d" status: 200 len: 1520 microversion: 2.1 time: 0.184594 Oct 04 22:03:45.197187 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2094/4247] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:03:45 2022] GET /compute/v2.1/servers/07e11885-b7b0-4ad1-bda6-a677b9aaf48d => generated 1520 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:03:45.233356 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-b587576c-6b5d-43e4-ab30-173677e36673 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92894af6b8f74650ad7696e1f3ac375d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f24f86f0fc4a3ba09c2be55876c783', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:45.242875 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-b587576c-6b5d-43e4-ab30-173677e36673 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92894af6b8f74650ad7696e1f3ac375d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f24f86f0fc4a3ba09c2be55876c783', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:45.244718 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-b587576c-6b5d-43e4-ab30-173677e36673 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92894af6b8f74650ad7696e1f3ac375d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f24f86f0fc4a3ba09c2be55876c783', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:45.246190 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-b587576c-6b5d-43e4-ab30-173677e36673 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] 10.222.0.43 "GET /compute/v2.1/servers/39dc4bb1-8465-4576-b490-d066c0fbb18f" status: 200 len: 1407 microversion: 2.54 time: 0.121734 Oct 04 22:03:45.250875 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2154/4248] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:03:45 2022] GET /compute/v2.1/servers/39dc4bb1-8465-4576-b490-d066c0fbb18f => generated 1407 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:03:45.618682 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-5d3d8488-fd02-4d17-abff-316d947f5a64 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:45.619348 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-5d3d8488-fd02-4d17-abff-316d947f5a64 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: e5842070-d5a3-43f9-82f8-ebce4eaf5526] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:03:45.625961 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5d3d8488-fd02-4d17-abff-316d947f5a64 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:45.626568 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5d3d8488-fd02-4d17-abff-316d947f5a64 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:45.627013 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5d3d8488-fd02-4d17-abff-316d947f5a64 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:45.627864 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5d3d8488-fd02-4d17-abff-316d947f5a64 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:45.628179 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5d3d8488-fd02-4d17-abff-316d947f5a64 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:45.628613 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5d3d8488-fd02-4d17-abff-316d947f5a64 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:45.772465 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-5d3d8488-fd02-4d17-abff-316d947f5a64 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a1c8d841104bc9b6910bcc2c0e2bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe9283584fc4d90b0715216d867ea2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:45.781594 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-5d3d8488-fd02-4d17-abff-316d947f5a64 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "GET /compute/v2.1/servers/e5842070-d5a3-43f9-82f8-ebce4eaf5526" status: 200 len: 1509 microversion: 2.1 time: 0.167332 Oct 04 22:03:45.784032 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-08d494ea-45c3-49b3-bf84-b9004caf2ede tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:45.784664 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-08d494ea-45c3-49b3-bf84-b9004caf2ede tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] [instance: ad97980f-d9c5-4237-b84a-2a13dfbc7764] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:03:45.794039 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-08d494ea-45c3-49b3-bf84-b9004caf2ede tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:45.794563 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-08d494ea-45c3-49b3-bf84-b9004caf2ede tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:45.795049 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-08d494ea-45c3-49b3-bf84-b9004caf2ede tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:45.795168 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2095/4249] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:03:45 2022] GET /compute/v2.1/servers/e5842070-d5a3-43f9-82f8-ebce4eaf5526 => generated 1509 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:03:45.795712 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-08d494ea-45c3-49b3-bf84-b9004caf2ede tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:45.796408 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-08d494ea-45c3-49b3-bf84-b9004caf2ede tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:45.796841 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-08d494ea-45c3-49b3-bf84-b9004caf2ede tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:45.940745 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-08d494ea-45c3-49b3-bf84-b9004caf2ede tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973de86311b47e882de18efbcb3f67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e037651e3345a8b95ea528cae02c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:45.949655 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-08d494ea-45c3-49b3-bf84-b9004caf2ede tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] 10.222.0.43 "GET /compute/v2.1/servers/ad97980f-d9c5-4237-b84a-2a13dfbc7764" status: 200 len: 1534 microversion: 2.1 time: 0.169585 Oct 04 22:03:45.950479 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2155/4250] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:03:45 2022] GET /compute/v2.1/servers/ad97980f-d9c5-4237-b84a-2a13dfbc7764 => generated 1534 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:03:46.221292 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-a68c2e68-2931-48ed-9b1c-3618bc8c10bd tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:46.221978 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-a68c2e68-2931-48ed-9b1c-3618bc8c10bd tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] [instance: 07e11885-b7b0-4ad1-bda6-a677b9aaf48d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:03:46.232715 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a68c2e68-2931-48ed-9b1c-3618bc8c10bd tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:46.232715 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a68c2e68-2931-48ed-9b1c-3618bc8c10bd tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:46.240525 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a68c2e68-2931-48ed-9b1c-3618bc8c10bd tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:46.241435 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a68c2e68-2931-48ed-9b1c-3618bc8c10bd tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:46.242487 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a68c2e68-2931-48ed-9b1c-3618bc8c10bd tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:46.243119 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a68c2e68-2931-48ed-9b1c-3618bc8c10bd tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:46.276790 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-850ab21e-a1fb-43a5-8e41-f9f0f80be9fd tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:46.277416 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-850ab21e-a1fb-43a5-8e41-f9f0f80be9fd tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] [instance: 39dc4bb1-8465-4576-b490-d066c0fbb18f] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:03:46.286814 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-850ab21e-a1fb-43a5-8e41-f9f0f80be9fd tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:46.287314 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-850ab21e-a1fb-43a5-8e41-f9f0f80be9fd tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:46.287752 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-850ab21e-a1fb-43a5-8e41-f9f0f80be9fd tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:46.288464 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-850ab21e-a1fb-43a5-8e41-f9f0f80be9fd tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:46.294639 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-850ab21e-a1fb-43a5-8e41-f9f0f80be9fd tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:46.295084 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-850ab21e-a1fb-43a5-8e41-f9f0f80be9fd tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:46.380011 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-850ab21e-a1fb-43a5-8e41-f9f0f80be9fd tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92894af6b8f74650ad7696e1f3ac375d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f24f86f0fc4a3ba09c2be55876c783', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:46.391628 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-850ab21e-a1fb-43a5-8e41-f9f0f80be9fd tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92894af6b8f74650ad7696e1f3ac375d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f24f86f0fc4a3ba09c2be55876c783', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:46.393353 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-850ab21e-a1fb-43a5-8e41-f9f0f80be9fd tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92894af6b8f74650ad7696e1f3ac375d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f24f86f0fc4a3ba09c2be55876c783', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:46.395188 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-850ab21e-a1fb-43a5-8e41-f9f0f80be9fd tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] 10.222.0.43 "GET /compute/v2.1/servers/39dc4bb1-8465-4576-b490-d066c0fbb18f" status: 200 len: 1407 microversion: 2.54 time: 0.122980 Oct 04 22:03:46.397001 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2156/4251] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:03:46 2022] GET /compute/v2.1/servers/39dc4bb1-8465-4576-b490-d066c0fbb18f => generated 1407 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:03:46.463947 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-a68c2e68-2931-48ed-9b1c-3618bc8c10bd tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f46a71ea0ee4e45afaea7e38e8c0ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba14e6816284d9e89e22913643f4355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:46.473078 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-a68c2e68-2931-48ed-9b1c-3618bc8c10bd tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] 10.222.0.43 "GET /compute/v2.1/servers/07e11885-b7b0-4ad1-bda6-a677b9aaf48d" status: 200 len: 1520 microversion: 2.1 time: 0.256356 Oct 04 22:03:46.473886 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2096/4252] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:03:46 2022] GET /compute/v2.1/servers/07e11885-b7b0-4ad1-bda6-a677b9aaf48d => generated 1520 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:03:46.808940 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-6a078b1f-e3d3-4dd0-ae84-935e989a94b6 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:46.809553 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-6a078b1f-e3d3-4dd0-ae84-935e989a94b6 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: e5842070-d5a3-43f9-82f8-ebce4eaf5526] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:03:46.816204 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6a078b1f-e3d3-4dd0-ae84-935e989a94b6 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:46.816695 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6a078b1f-e3d3-4dd0-ae84-935e989a94b6 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:46.817347 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6a078b1f-e3d3-4dd0-ae84-935e989a94b6 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:46.818058 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6a078b1f-e3d3-4dd0-ae84-935e989a94b6 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:46.818536 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6a078b1f-e3d3-4dd0-ae84-935e989a94b6 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:46.819111 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6a078b1f-e3d3-4dd0-ae84-935e989a94b6 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:46.822119 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:03:46.973688 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-5374d391-e76c-4a08-834b-d26ffbe53cc8 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:46.974317 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-5374d391-e76c-4a08-834b-d26ffbe53cc8 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] [instance: ad97980f-d9c5-4237-b84a-2a13dfbc7764] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:03:46.983414 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5374d391-e76c-4a08-834b-d26ffbe53cc8 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:46.983916 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5374d391-e76c-4a08-834b-d26ffbe53cc8 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:46.984381 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5374d391-e76c-4a08-834b-d26ffbe53cc8 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:46.985052 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5374d391-e76c-4a08-834b-d26ffbe53cc8 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:46.985836 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5374d391-e76c-4a08-834b-d26ffbe53cc8 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:46.986253 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5374d391-e76c-4a08-834b-d26ffbe53cc8 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:47.010855 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-6a078b1f-e3d3-4dd0-ae84-935e989a94b6 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a1c8d841104bc9b6910bcc2c0e2bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe9283584fc4d90b0715216d867ea2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:47.023723 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-6a078b1f-e3d3-4dd0-ae84-935e989a94b6 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "GET /compute/v2.1/servers/e5842070-d5a3-43f9-82f8-ebce4eaf5526" status: 200 len: 1509 microversion: 2.1 time: 0.219481 Oct 04 22:03:47.024541 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2157/4253] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:03:46 2022] GET /compute/v2.1/servers/e5842070-d5a3-43f9-82f8-ebce4eaf5526 => generated 1509 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:03:47.213961 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-5374d391-e76c-4a08-834b-d26ffbe53cc8 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973de86311b47e882de18efbcb3f67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e037651e3345a8b95ea528cae02c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:47.223218 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-5374d391-e76c-4a08-834b-d26ffbe53cc8 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] 10.222.0.43 "GET /compute/v2.1/servers/ad97980f-d9c5-4237-b84a-2a13dfbc7764" status: 200 len: 1540 microversion: 2.1 time: 0.253470 Oct 04 22:03:47.233316 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2097/4254] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:03:46 2022] GET /compute/v2.1/servers/ad97980f-d9c5-4237-b84a-2a13dfbc7764 => generated 1540 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:03:47.423671 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-c314b6e6-7a11-4534-ac02-5cf7c67bf3b2 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:47.424223 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-c314b6e6-7a11-4534-ac02-5cf7c67bf3b2 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] [instance: 39dc4bb1-8465-4576-b490-d066c0fbb18f] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:03:47.431677 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c314b6e6-7a11-4534-ac02-5cf7c67bf3b2 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:47.432529 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c314b6e6-7a11-4534-ac02-5cf7c67bf3b2 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:47.433152 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c314b6e6-7a11-4534-ac02-5cf7c67bf3b2 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:47.434070 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c314b6e6-7a11-4534-ac02-5cf7c67bf3b2 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:47.434691 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c314b6e6-7a11-4534-ac02-5cf7c67bf3b2 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:47.435456 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c314b6e6-7a11-4534-ac02-5cf7c67bf3b2 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:47.498899 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-dd602c34-f68a-4334-acb0-ff935f2808bf tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:47.500213 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-dd602c34-f68a-4334-acb0-ff935f2808bf tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] [instance: 07e11885-b7b0-4ad1-bda6-a677b9aaf48d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:03:47.508429 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dd602c34-f68a-4334-acb0-ff935f2808bf tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:47.509139 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dd602c34-f68a-4334-acb0-ff935f2808bf tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:47.509875 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dd602c34-f68a-4334-acb0-ff935f2808bf tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:47.510780 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dd602c34-f68a-4334-acb0-ff935f2808bf tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:47.511398 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dd602c34-f68a-4334-acb0-ff935f2808bf tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:47.511986 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dd602c34-f68a-4334-acb0-ff935f2808bf tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:47.531227 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-c314b6e6-7a11-4534-ac02-5cf7c67bf3b2 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92894af6b8f74650ad7696e1f3ac375d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f24f86f0fc4a3ba09c2be55876c783', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:47.542524 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-c314b6e6-7a11-4534-ac02-5cf7c67bf3b2 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92894af6b8f74650ad7696e1f3ac375d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f24f86f0fc4a3ba09c2be55876c783', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:47.547679 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-c314b6e6-7a11-4534-ac02-5cf7c67bf3b2 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92894af6b8f74650ad7696e1f3ac375d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f24f86f0fc4a3ba09c2be55876c783', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:47.548946 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-c314b6e6-7a11-4534-ac02-5cf7c67bf3b2 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] 10.222.0.43 "GET /compute/v2.1/servers/39dc4bb1-8465-4576-b490-d066c0fbb18f" status: 200 len: 1407 microversion: 2.54 time: 0.129856 Oct 04 22:03:47.549544 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2158/4255] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:03:47 2022] GET /compute/v2.1/servers/39dc4bb1-8465-4576-b490-d066c0fbb18f => generated 1407 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 22:03:47.700986 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-dd602c34-f68a-4334-acb0-ff935f2808bf tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f46a71ea0ee4e45afaea7e38e8c0ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba14e6816284d9e89e22913643f4355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:47.711896 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-dd602c34-f68a-4334-acb0-ff935f2808bf tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] 10.222.0.43 "GET /compute/v2.1/servers/07e11885-b7b0-4ad1-bda6-a677b9aaf48d" status: 200 len: 1520 microversion: 2.1 time: 0.217353 Oct 04 22:03:47.712601 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2098/4256] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:03:47 2022] GET /compute/v2.1/servers/07e11885-b7b0-4ad1-bda6-a677b9aaf48d => generated 1520 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:03:48.047994 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-a13645ff-935e-4bb7-8d82-1eb1d86b111d tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:48.048957 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-a13645ff-935e-4bb7-8d82-1eb1d86b111d tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: e5842070-d5a3-43f9-82f8-ebce4eaf5526] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:03:48.056877 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a13645ff-935e-4bb7-8d82-1eb1d86b111d tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:48.057738 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a13645ff-935e-4bb7-8d82-1eb1d86b111d tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:48.058419 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a13645ff-935e-4bb7-8d82-1eb1d86b111d tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:48.059436 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a13645ff-935e-4bb7-8d82-1eb1d86b111d tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:48.059954 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a13645ff-935e-4bb7-8d82-1eb1d86b111d tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:48.060668 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a13645ff-935e-4bb7-8d82-1eb1d86b111d tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:48.247187 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-5c5b4f29-e96d-451b-a0a0-0a90145cc7a3 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:48.247937 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-5c5b4f29-e96d-451b-a0a0-0a90145cc7a3 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] [instance: ad97980f-d9c5-4237-b84a-2a13dfbc7764] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:03:48.249934 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-a13645ff-935e-4bb7-8d82-1eb1d86b111d tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a1c8d841104bc9b6910bcc2c0e2bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe9283584fc4d90b0715216d867ea2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:48.259600 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-a13645ff-935e-4bb7-8d82-1eb1d86b111d tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "GET /compute/v2.1/servers/e5842070-d5a3-43f9-82f8-ebce4eaf5526" status: 200 len: 1509 microversion: 2.1 time: 0.215325 Oct 04 22:03:48.260249 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2159/4257] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:03:48 2022] GET /compute/v2.1/servers/e5842070-d5a3-43f9-82f8-ebce4eaf5526 => generated 1509 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:03:48.260995 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5c5b4f29-e96d-451b-a0a0-0a90145cc7a3 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:48.261567 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5c5b4f29-e96d-451b-a0a0-0a90145cc7a3 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:48.262089 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5c5b4f29-e96d-451b-a0a0-0a90145cc7a3 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:48.262780 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5c5b4f29-e96d-451b-a0a0-0a90145cc7a3 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:48.263242 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5c5b4f29-e96d-451b-a0a0-0a90145cc7a3 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:48.263675 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5c5b4f29-e96d-451b-a0a0-0a90145cc7a3 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:48.421058 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-5c5b4f29-e96d-451b-a0a0-0a90145cc7a3 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973de86311b47e882de18efbcb3f67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e037651e3345a8b95ea528cae02c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:48.432397 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-5c5b4f29-e96d-451b-a0a0-0a90145cc7a3 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] 10.222.0.43 "GET /compute/v2.1/servers/ad97980f-d9c5-4237-b84a-2a13dfbc7764" status: 200 len: 1540 microversion: 2.1 time: 0.189182 Oct 04 22:03:48.433230 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2099/4258] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:03:48 2022] GET /compute/v2.1/servers/ad97980f-d9c5-4237-b84a-2a13dfbc7764 => generated 1540 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:03:48.576723 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-aa3e65be-3d2e-4213-9fee-e439bf1fec87 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:48.578029 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-aa3e65be-3d2e-4213-9fee-e439bf1fec87 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] [instance: 39dc4bb1-8465-4576-b490-d066c0fbb18f] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:03:48.590130 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-aa3e65be-3d2e-4213-9fee-e439bf1fec87 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:48.592032 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-aa3e65be-3d2e-4213-9fee-e439bf1fec87 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:48.599332 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-aa3e65be-3d2e-4213-9fee-e439bf1fec87 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:48.600436 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-aa3e65be-3d2e-4213-9fee-e439bf1fec87 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:48.601437 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-aa3e65be-3d2e-4213-9fee-e439bf1fec87 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:48.601794 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-aa3e65be-3d2e-4213-9fee-e439bf1fec87 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:48.676613 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-aa3e65be-3d2e-4213-9fee-e439bf1fec87 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92894af6b8f74650ad7696e1f3ac375d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f24f86f0fc4a3ba09c2be55876c783', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:48.688325 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-aa3e65be-3d2e-4213-9fee-e439bf1fec87 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92894af6b8f74650ad7696e1f3ac375d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f24f86f0fc4a3ba09c2be55876c783', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:48.690501 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-aa3e65be-3d2e-4213-9fee-e439bf1fec87 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92894af6b8f74650ad7696e1f3ac375d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f24f86f0fc4a3ba09c2be55876c783', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:48.693106 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-aa3e65be-3d2e-4213-9fee-e439bf1fec87 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] 10.222.0.43 "GET /compute/v2.1/servers/39dc4bb1-8465-4576-b490-d066c0fbb18f" status: 200 len: 1407 microversion: 2.54 time: 0.121162 Oct 04 22:03:48.693822 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2160/4259] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:03:48 2022] GET /compute/v2.1/servers/39dc4bb1-8465-4576-b490-d066c0fbb18f => generated 1407 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:03:48.736140 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-58467ae0-05e7-44e0-828d-56f51ac4e5af tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:48.737049 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-58467ae0-05e7-44e0-828d-56f51ac4e5af tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] [instance: 07e11885-b7b0-4ad1-bda6-a677b9aaf48d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:03:48.743583 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-58467ae0-05e7-44e0-828d-56f51ac4e5af tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:48.744387 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-58467ae0-05e7-44e0-828d-56f51ac4e5af tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:48.745043 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-58467ae0-05e7-44e0-828d-56f51ac4e5af tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:48.745961 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-58467ae0-05e7-44e0-828d-56f51ac4e5af tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:48.746919 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-58467ae0-05e7-44e0-828d-56f51ac4e5af tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:48.747863 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-58467ae0-05e7-44e0-828d-56f51ac4e5af tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:48.784589 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=100 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:03:49.071163 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-58467ae0-05e7-44e0-828d-56f51ac4e5af tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f46a71ea0ee4e45afaea7e38e8c0ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba14e6816284d9e89e22913643f4355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:49.081871 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-58467ae0-05e7-44e0-828d-56f51ac4e5af tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] 10.222.0.43 "GET /compute/v2.1/servers/07e11885-b7b0-4ad1-bda6-a677b9aaf48d" status: 200 len: 1520 microversion: 2.1 time: 0.349663 Oct 04 22:03:49.082483 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2100/4260] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:03:48 2022] GET /compute/v2.1/servers/07e11885-b7b0-4ad1-bda6-a677b9aaf48d => generated 1520 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:03:49.284782 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-8e8ca3c8-fd96-4924-a73a-18e2d638738f tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:49.285432 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-8e8ca3c8-fd96-4924-a73a-18e2d638738f tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: e5842070-d5a3-43f9-82f8-ebce4eaf5526] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:03:49.292720 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8e8ca3c8-fd96-4924-a73a-18e2d638738f tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:49.293219 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8e8ca3c8-fd96-4924-a73a-18e2d638738f tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:49.293665 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8e8ca3c8-fd96-4924-a73a-18e2d638738f tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:49.294445 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8e8ca3c8-fd96-4924-a73a-18e2d638738f tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:49.295193 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8e8ca3c8-fd96-4924-a73a-18e2d638738f tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:49.295639 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8e8ca3c8-fd96-4924-a73a-18e2d638738f tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:49.455491 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-8e8ca3c8-fd96-4924-a73a-18e2d638738f tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a1c8d841104bc9b6910bcc2c0e2bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe9283584fc4d90b0715216d867ea2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:49.455954 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-4cdea539-d6f8-43e8-9f86-fc9cc53e40b0 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:49.456607 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-4cdea539-d6f8-43e8-9f86-fc9cc53e40b0 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] [instance: ad97980f-d9c5-4237-b84a-2a13dfbc7764] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:03:49.465003 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4cdea539-d6f8-43e8-9f86-fc9cc53e40b0 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:49.465495 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4cdea539-d6f8-43e8-9f86-fc9cc53e40b0 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:49.465959 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-8e8ca3c8-fd96-4924-a73a-18e2d638738f tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "GET /compute/v2.1/servers/e5842070-d5a3-43f9-82f8-ebce4eaf5526" status: 200 len: 1509 microversion: 2.1 time: 0.185310 Oct 04 22:03:49.466116 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4cdea539-d6f8-43e8-9f86-fc9cc53e40b0 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:49.466614 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2161/4261] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:03:49 2022] GET /compute/v2.1/servers/e5842070-d5a3-43f9-82f8-ebce4eaf5526 => generated 1509 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:03:49.476488 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4cdea539-d6f8-43e8-9f86-fc9cc53e40b0 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:49.477191 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4cdea539-d6f8-43e8-9f86-fc9cc53e40b0 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:49.478024 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4cdea539-d6f8-43e8-9f86-fc9cc53e40b0 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:49.626406 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-4cdea539-d6f8-43e8-9f86-fc9cc53e40b0 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973de86311b47e882de18efbcb3f67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e037651e3345a8b95ea528cae02c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:49.631611 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-4cdea539-d6f8-43e8-9f86-fc9cc53e40b0 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] 10.222.0.43 "GET /compute/v2.1/servers/ad97980f-d9c5-4237-b84a-2a13dfbc7764" status: 200 len: 1540 microversion: 2.1 time: 0.180028 Oct 04 22:03:49.633356 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2101/4262] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:03:49 2022] GET /compute/v2.1/servers/ad97980f-d9c5-4237-b84a-2a13dfbc7764 => generated 1540 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:03:49.722461 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-b07019a9-462a-452d-b5c1-b412a5ef485d tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:49.723887 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-b07019a9-462a-452d-b5c1-b412a5ef485d tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] [instance: 39dc4bb1-8465-4576-b490-d066c0fbb18f] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:03:49.735582 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b07019a9-462a-452d-b5c1-b412a5ef485d tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:49.736661 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b07019a9-462a-452d-b5c1-b412a5ef485d tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:49.737313 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b07019a9-462a-452d-b5c1-b412a5ef485d tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:49.738252 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b07019a9-462a-452d-b5c1-b412a5ef485d tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:49.739588 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b07019a9-462a-452d-b5c1-b412a5ef485d tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:49.740049 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b07019a9-462a-452d-b5c1-b412a5ef485d tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:49.834709 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-b07019a9-462a-452d-b5c1-b412a5ef485d tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92894af6b8f74650ad7696e1f3ac375d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f24f86f0fc4a3ba09c2be55876c783', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:49.844456 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-b07019a9-462a-452d-b5c1-b412a5ef485d tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92894af6b8f74650ad7696e1f3ac375d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f24f86f0fc4a3ba09c2be55876c783', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:49.845901 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-b07019a9-462a-452d-b5c1-b412a5ef485d tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92894af6b8f74650ad7696e1f3ac375d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f24f86f0fc4a3ba09c2be55876c783', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:49.847148 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-b07019a9-462a-452d-b5c1-b412a5ef485d tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] 10.222.0.43 "GET /compute/v2.1/servers/39dc4bb1-8465-4576-b490-d066c0fbb18f" status: 200 len: 1407 microversion: 2.54 time: 0.128683 Oct 04 22:03:49.847870 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2162/4263] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:03:49 2022] GET /compute/v2.1/servers/39dc4bb1-8465-4576-b490-d066c0fbb18f => generated 1407 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:03:50.106063 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-c81cbf12-e84d-4bb8-8fe4-176dbe46a075 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:50.106837 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-c81cbf12-e84d-4bb8-8fe4-176dbe46a075 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] [instance: 07e11885-b7b0-4ad1-bda6-a677b9aaf48d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:03:50.113557 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c81cbf12-e84d-4bb8-8fe4-176dbe46a075 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:50.114148 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c81cbf12-e84d-4bb8-8fe4-176dbe46a075 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:50.122623 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c81cbf12-e84d-4bb8-8fe4-176dbe46a075 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:50.123987 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c81cbf12-e84d-4bb8-8fe4-176dbe46a075 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:50.124746 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c81cbf12-e84d-4bb8-8fe4-176dbe46a075 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:50.125348 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c81cbf12-e84d-4bb8-8fe4-176dbe46a075 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:50.289518 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-c81cbf12-e84d-4bb8-8fe4-176dbe46a075 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f46a71ea0ee4e45afaea7e38e8c0ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba14e6816284d9e89e22913643f4355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:50.299761 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-c81cbf12-e84d-4bb8-8fe4-176dbe46a075 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] 10.222.0.43 "GET /compute/v2.1/servers/07e11885-b7b0-4ad1-bda6-a677b9aaf48d" status: 200 len: 1520 microversion: 2.1 time: 0.197452 Oct 04 22:03:50.300487 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2102/4264] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:03:50 2022] GET /compute/v2.1/servers/07e11885-b7b0-4ad1-bda6-a677b9aaf48d => generated 1520 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:03:50.491474 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-78519525-2502-4e19-9e16-2ae3a2e2f353 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:50.492569 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-78519525-2502-4e19-9e16-2ae3a2e2f353 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: e5842070-d5a3-43f9-82f8-ebce4eaf5526] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:03:50.501657 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-78519525-2502-4e19-9e16-2ae3a2e2f353 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:50.502415 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-78519525-2502-4e19-9e16-2ae3a2e2f353 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:50.503014 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-78519525-2502-4e19-9e16-2ae3a2e2f353 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:50.503743 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-78519525-2502-4e19-9e16-2ae3a2e2f353 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:50.504350 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-78519525-2502-4e19-9e16-2ae3a2e2f353 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:50.505359 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-78519525-2502-4e19-9e16-2ae3a2e2f353 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:50.655305 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-025c44a0-8496-498d-87e3-4df57f88f779 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:50.656100 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-025c44a0-8496-498d-87e3-4df57f88f779 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] [instance: ad97980f-d9c5-4237-b84a-2a13dfbc7764] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:03:50.670206 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-025c44a0-8496-498d-87e3-4df57f88f779 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:50.671109 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-025c44a0-8496-498d-87e3-4df57f88f779 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:50.671775 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-025c44a0-8496-498d-87e3-4df57f88f779 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:50.672713 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-025c44a0-8496-498d-87e3-4df57f88f779 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:50.673395 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-025c44a0-8496-498d-87e3-4df57f88f779 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:50.674046 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-025c44a0-8496-498d-87e3-4df57f88f779 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:50.795199 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-78519525-2502-4e19-9e16-2ae3a2e2f353 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a1c8d841104bc9b6910bcc2c0e2bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe9283584fc4d90b0715216d867ea2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:50.824254 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-78519525-2502-4e19-9e16-2ae3a2e2f353 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "GET /compute/v2.1/servers/e5842070-d5a3-43f9-82f8-ebce4eaf5526" status: 200 len: 1509 microversion: 2.1 time: 0.336789 Oct 04 22:03:50.825570 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2163/4265] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:03:50 2022] GET /compute/v2.1/servers/e5842070-d5a3-43f9-82f8-ebce4eaf5526 => generated 1509 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:03:50.833107 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-84c8c8ee-30ed-4d0b-b5f9-4b7b523070b5 req-0786fbe0-8f9a-414e-b3ee-2ea0157be54d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad97980f-d9c5-4237-b84a-2a13dfbc7764", "name": "network-vif-plugged", "status": "completed", "tag": "eb2633ea-2747-42ba-9388-e6e2161cfa52"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:03:50.848480 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-84c8c8ee-30ed-4d0b-b5f9-4b7b523070b5 req-0786fbe0-8f9a-414e-b3ee-2ea0157be54d service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:50.849811 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-84c8c8ee-30ed-4d0b-b5f9-4b7b523070b5 req-0786fbe0-8f9a-414e-b3ee-2ea0157be54d service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:50.850885 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-84c8c8ee-30ed-4d0b-b5f9-4b7b523070b5 req-0786fbe0-8f9a-414e-b3ee-2ea0157be54d service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:50.875920 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-84c8c8ee-30ed-4d0b-b5f9-4b7b523070b5 req-0786fbe0-8f9a-414e-b3ee-2ea0157be54d service nova] Creating event network-vif-plugged:eb2633ea-2747-42ba-9388-e6e2161cfa52 for instance ad97980f-d9c5-4237-b84a-2a13dfbc7764 on n-h1-860284-1 Oct 04 22:03:50.884637 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-84c8c8ee-30ed-4d0b-b5f9-4b7b523070b5 req-0786fbe0-8f9a-414e-b3ee-2ea0157be54d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056981 Oct 04 22:03:50.886639 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2164/4266] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:03:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:03:50.894378 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-50da6475-845e-433c-9662-c0567d694544 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:50.895493 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-50da6475-845e-433c-9662-c0567d694544 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] [instance: 39dc4bb1-8465-4576-b490-d066c0fbb18f] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:03:50.900700 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-025c44a0-8496-498d-87e3-4df57f88f779 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973de86311b47e882de18efbcb3f67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e037651e3345a8b95ea528cae02c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:50.903575 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-50da6475-845e-433c-9662-c0567d694544 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:50.904985 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-50da6475-845e-433c-9662-c0567d694544 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:50.905587 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-50da6475-845e-433c-9662-c0567d694544 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:50.906503 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-50da6475-845e-433c-9662-c0567d694544 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:50.907112 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-50da6475-845e-433c-9662-c0567d694544 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:50.907879 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-50da6475-845e-433c-9662-c0567d694544 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:50.910933 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-025c44a0-8496-498d-87e3-4df57f88f779 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] 10.222.0.43 "GET /compute/v2.1/servers/ad97980f-d9c5-4237-b84a-2a13dfbc7764" status: 200 len: 1540 microversion: 2.1 time: 0.259386 Oct 04 22:03:50.912160 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2103/4267] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:03:50 2022] GET /compute/v2.1/servers/ad97980f-d9c5-4237-b84a-2a13dfbc7764 => generated 1540 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:03:51.000710 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-50da6475-845e-433c-9662-c0567d694544 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92894af6b8f74650ad7696e1f3ac375d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f24f86f0fc4a3ba09c2be55876c783', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:51.011289 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-50da6475-845e-433c-9662-c0567d694544 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92894af6b8f74650ad7696e1f3ac375d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f24f86f0fc4a3ba09c2be55876c783', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:51.012740 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-50da6475-845e-433c-9662-c0567d694544 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92894af6b8f74650ad7696e1f3ac375d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f24f86f0fc4a3ba09c2be55876c783', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:51.019318 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-50da6475-845e-433c-9662-c0567d694544 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] 10.222.0.43 "GET /compute/v2.1/servers/39dc4bb1-8465-4576-b490-d066c0fbb18f" status: 200 len: 1407 microversion: 2.54 time: 0.130491 Oct 04 22:03:51.019970 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2165/4268] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:03:50 2022] GET /compute/v2.1/servers/39dc4bb1-8465-4576-b490-d066c0fbb18f => generated 1407 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:03:51.324299 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-aa8f2e05-ccb8-4753-8b9e-34d883d092a0 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:51.325189 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-aa8f2e05-ccb8-4753-8b9e-34d883d092a0 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] [instance: 07e11885-b7b0-4ad1-bda6-a677b9aaf48d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:03:51.332976 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-aa8f2e05-ccb8-4753-8b9e-34d883d092a0 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:51.333752 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-aa8f2e05-ccb8-4753-8b9e-34d883d092a0 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:51.334351 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-aa8f2e05-ccb8-4753-8b9e-34d883d092a0 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:51.335268 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-aa8f2e05-ccb8-4753-8b9e-34d883d092a0 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:51.335977 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-aa8f2e05-ccb8-4753-8b9e-34d883d092a0 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:51.336645 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-aa8f2e05-ccb8-4753-8b9e-34d883d092a0 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:51.422831 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-57feeefc-bf4c-49c6-a90c-8c65032fecee tempest-PortsAdminExtendedAttrsTestJSON-493546525 tempest-PortsAdminExtendedAttrsTestJSON-493546525-project-admin] Calling method '.version_select at 0x7fbb2e6260d0>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:51.424647 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-57feeefc-bf4c-49c6-a90c-8c65032fecee tempest-PortsAdminExtendedAttrsTestJSON-493546525 tempest-PortsAdminExtendedAttrsTestJSON-493546525-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:51.425317 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-57feeefc-bf4c-49c6-a90c-8c65032fecee tempest-PortsAdminExtendedAttrsTestJSON-493546525 tempest-PortsAdminExtendedAttrsTestJSON-493546525-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:51.425955 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-57feeefc-bf4c-49c6-a90c-8c65032fecee tempest-PortsAdminExtendedAttrsTestJSON-493546525 tempest-PortsAdminExtendedAttrsTestJSON-493546525-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:51.441019 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-57feeefc-bf4c-49c6-a90c-8c65032fecee tempest-PortsAdminExtendedAttrsTestJSON-493546525 tempest-PortsAdminExtendedAttrsTestJSON-493546525-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:51.441455 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-57feeefc-bf4c-49c6-a90c-8c65032fecee tempest-PortsAdminExtendedAttrsTestJSON-493546525 tempest-PortsAdminExtendedAttrsTestJSON-493546525-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:51.441926 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-57feeefc-bf4c-49c6-a90c-8c65032fecee tempest-PortsAdminExtendedAttrsTestJSON-493546525 tempest-PortsAdminExtendedAttrsTestJSON-493546525-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:51.454656 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-57feeefc-bf4c-49c6-a90c-8c65032fecee tempest-PortsAdminExtendedAttrsTestJSON-493546525 tempest-PortsAdminExtendedAttrsTestJSON-493546525-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:51.455466 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-57feeefc-bf4c-49c6-a90c-8c65032fecee tempest-PortsAdminExtendedAttrsTestJSON-493546525 tempest-PortsAdminExtendedAttrsTestJSON-493546525-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:51.456089 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-57feeefc-bf4c-49c6-a90c-8c65032fecee tempest-PortsAdminExtendedAttrsTestJSON-493546525 tempest-PortsAdminExtendedAttrsTestJSON-493546525-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:51.463951 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-57feeefc-bf4c-49c6-a90c-8c65032fecee tempest-PortsAdminExtendedAttrsTestJSON-493546525 tempest-PortsAdminExtendedAttrsTestJSON-493546525-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.201555 Oct 04 22:03:51.464768 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2104/4269] 10.222.0.43 () {58 vars in 1146 bytes} [Tue Oct 4 22:03:51 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:03:51.507177 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-aa8f2e05-ccb8-4753-8b9e-34d883d092a0 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f46a71ea0ee4e45afaea7e38e8c0ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba14e6816284d9e89e22913643f4355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:51.517493 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-aa8f2e05-ccb8-4753-8b9e-34d883d092a0 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] 10.222.0.43 "GET /compute/v2.1/servers/07e11885-b7b0-4ad1-bda6-a677b9aaf48d" status: 200 len: 1520 microversion: 2.1 time: 0.197261 Oct 04 22:03:51.518409 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2166/4270] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:03:51 2022] GET /compute/v2.1/servers/07e11885-b7b0-4ad1-bda6-a677b9aaf48d => generated 1520 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:03:51.854258 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-cf599d4b-76dd-4e7f-957d-eb991c368e6a tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:51.854933 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-cf599d4b-76dd-4e7f-957d-eb991c368e6a tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: e5842070-d5a3-43f9-82f8-ebce4eaf5526] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:03:51.863008 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cf599d4b-76dd-4e7f-957d-eb991c368e6a tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:51.863527 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cf599d4b-76dd-4e7f-957d-eb991c368e6a tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:51.863960 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cf599d4b-76dd-4e7f-957d-eb991c368e6a tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:51.865179 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cf599d4b-76dd-4e7f-957d-eb991c368e6a tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:51.865179 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cf599d4b-76dd-4e7f-957d-eb991c368e6a tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:51.866094 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cf599d4b-76dd-4e7f-957d-eb991c368e6a tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:51.936697 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-11f4b610-8a81-48a4-80fe-a7e2ed675e6e tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:51.937311 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-11f4b610-8a81-48a4-80fe-a7e2ed675e6e tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] [instance: ad97980f-d9c5-4237-b84a-2a13dfbc7764] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:03:51.944101 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-11f4b610-8a81-48a4-80fe-a7e2ed675e6e tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:51.944936 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-11f4b610-8a81-48a4-80fe-a7e2ed675e6e tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:51.945543 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-11f4b610-8a81-48a4-80fe-a7e2ed675e6e tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:51.946475 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-11f4b610-8a81-48a4-80fe-a7e2ed675e6e tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:51.947107 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-11f4b610-8a81-48a4-80fe-a7e2ed675e6e tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:51.947535 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-11f4b610-8a81-48a4-80fe-a7e2ed675e6e tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:52.028502 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-cf599d4b-76dd-4e7f-957d-eb991c368e6a tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a1c8d841104bc9b6910bcc2c0e2bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe9283584fc4d90b0715216d867ea2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:52.040181 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-cf599d4b-76dd-4e7f-957d-eb991c368e6a tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "GET /compute/v2.1/servers/e5842070-d5a3-43f9-82f8-ebce4eaf5526" status: 200 len: 1509 microversion: 2.1 time: 0.188036 Oct 04 22:03:52.045290 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2105/4271] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:03:51 2022] GET /compute/v2.1/servers/e5842070-d5a3-43f9-82f8-ebce4eaf5526 => generated 1509 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:03:52.049013 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-307a72b1-38cc-4839-bbb3-ca5ec1456fc9 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:52.049827 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-307a72b1-38cc-4839-bbb3-ca5ec1456fc9 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] [instance: 39dc4bb1-8465-4576-b490-d066c0fbb18f] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:03:52.068076 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-307a72b1-38cc-4839-bbb3-ca5ec1456fc9 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:52.068739 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-307a72b1-38cc-4839-bbb3-ca5ec1456fc9 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:52.069363 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-307a72b1-38cc-4839-bbb3-ca5ec1456fc9 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:52.070260 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-307a72b1-38cc-4839-bbb3-ca5ec1456fc9 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:52.070865 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-307a72b1-38cc-4839-bbb3-ca5ec1456fc9 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:52.071469 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-307a72b1-38cc-4839-bbb3-ca5ec1456fc9 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:52.198956 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-307a72b1-38cc-4839-bbb3-ca5ec1456fc9 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92894af6b8f74650ad7696e1f3ac375d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f24f86f0fc4a3ba09c2be55876c783', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:52.212785 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-307a72b1-38cc-4839-bbb3-ca5ec1456fc9 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92894af6b8f74650ad7696e1f3ac375d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f24f86f0fc4a3ba09c2be55876c783', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:52.214325 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-307a72b1-38cc-4839-bbb3-ca5ec1456fc9 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92894af6b8f74650ad7696e1f3ac375d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f24f86f0fc4a3ba09c2be55876c783', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:52.215731 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-307a72b1-38cc-4839-bbb3-ca5ec1456fc9 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] 10.222.0.43 "GET /compute/v2.1/servers/39dc4bb1-8465-4576-b490-d066c0fbb18f" status: 200 len: 1407 microversion: 2.54 time: 0.170919 Oct 04 22:03:52.216152 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2106/4272] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:03:52 2022] GET /compute/v2.1/servers/39dc4bb1-8465-4576-b490-d066c0fbb18f => generated 1407 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:03:52.225151 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-11f4b610-8a81-48a4-80fe-a7e2ed675e6e tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973de86311b47e882de18efbcb3f67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e037651e3345a8b95ea528cae02c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:52.235508 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-11f4b610-8a81-48a4-80fe-a7e2ed675e6e tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] 10.222.0.43 "GET /compute/v2.1/servers/ad97980f-d9c5-4237-b84a-2a13dfbc7764" status: 200 len: 1535 microversion: 2.1 time: 0.302770 Oct 04 22:03:52.240229 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2167/4273] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:03:51 2022] GET /compute/v2.1/servers/ad97980f-d9c5-4237-b84a-2a13dfbc7764 => generated 1535 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:03:52.542725 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-da1d512b-e9d6-412f-ba44-d66c9306ae9c tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:52.543770 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-da1d512b-e9d6-412f-ba44-d66c9306ae9c tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] [instance: 07e11885-b7b0-4ad1-bda6-a677b9aaf48d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:03:52.550357 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-da1d512b-e9d6-412f-ba44-d66c9306ae9c tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:52.550985 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-da1d512b-e9d6-412f-ba44-d66c9306ae9c tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:52.551502 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-da1d512b-e9d6-412f-ba44-d66c9306ae9c tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:52.552299 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-da1d512b-e9d6-412f-ba44-d66c9306ae9c tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:52.552839 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-da1d512b-e9d6-412f-ba44-d66c9306ae9c tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:52.553363 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-da1d512b-e9d6-412f-ba44-d66c9306ae9c tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:52.701184 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-da1d512b-e9d6-412f-ba44-d66c9306ae9c tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f46a71ea0ee4e45afaea7e38e8c0ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba14e6816284d9e89e22913643f4355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:52.709667 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-da1d512b-e9d6-412f-ba44-d66c9306ae9c tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] 10.222.0.43 "GET /compute/v2.1/servers/07e11885-b7b0-4ad1-bda6-a677b9aaf48d" status: 200 len: 1520 microversion: 2.1 time: 0.171219 Oct 04 22:03:52.710325 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2107/4274] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:03:52 2022] GET /compute/v2.1/servers/07e11885-b7b0-4ad1-bda6-a677b9aaf48d => generated 1520 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:03:53.067124 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-e12b82e4-2b1b-4215-b028-78a9e0e6fdb7 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:53.068911 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-e12b82e4-2b1b-4215-b028-78a9e0e6fdb7 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: e5842070-d5a3-43f9-82f8-ebce4eaf5526] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:03:53.078799 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e12b82e4-2b1b-4215-b028-78a9e0e6fdb7 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:53.079719 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e12b82e4-2b1b-4215-b028-78a9e0e6fdb7 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:53.079719 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e12b82e4-2b1b-4215-b028-78a9e0e6fdb7 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:53.080500 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e12b82e4-2b1b-4215-b028-78a9e0e6fdb7 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:53.080998 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e12b82e4-2b1b-4215-b028-78a9e0e6fdb7 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:53.081439 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e12b82e4-2b1b-4215-b028-78a9e0e6fdb7 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:53.250976 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-26989599-0b55-4a2f-81ba-1c34a79b743b tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:53.252452 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-26989599-0b55-4a2f-81ba-1c34a79b743b tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] [instance: 39dc4bb1-8465-4576-b490-d066c0fbb18f] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:03:53.260652 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-26989599-0b55-4a2f-81ba-1c34a79b743b tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:53.261539 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-26989599-0b55-4a2f-81ba-1c34a79b743b tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:53.262217 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-26989599-0b55-4a2f-81ba-1c34a79b743b tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:53.262957 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-26989599-0b55-4a2f-81ba-1c34a79b743b tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:53.263408 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-26989599-0b55-4a2f-81ba-1c34a79b743b tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:53.264002 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-26989599-0b55-4a2f-81ba-1c34a79b743b tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:53.371703 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-26989599-0b55-4a2f-81ba-1c34a79b743b tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92894af6b8f74650ad7696e1f3ac375d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f24f86f0fc4a3ba09c2be55876c783', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:53.382104 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-26989599-0b55-4a2f-81ba-1c34a79b743b tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92894af6b8f74650ad7696e1f3ac375d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f24f86f0fc4a3ba09c2be55876c783', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:53.384459 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-26989599-0b55-4a2f-81ba-1c34a79b743b tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92894af6b8f74650ad7696e1f3ac375d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f24f86f0fc4a3ba09c2be55876c783', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:53.386311 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-26989599-0b55-4a2f-81ba-1c34a79b743b tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] 10.222.0.43 "GET /compute/v2.1/servers/39dc4bb1-8465-4576-b490-d066c0fbb18f" status: 200 len: 1407 microversion: 2.54 time: 0.143502 Oct 04 22:03:53.398791 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2108/4275] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:03:53 2022] GET /compute/v2.1/servers/39dc4bb1-8465-4576-b490-d066c0fbb18f => generated 1407 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:03:53.398791 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-38c8af1c-9add-4713-a310-dd5365701798 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:53.398791 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-38c8af1c-9add-4713-a310-dd5365701798 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] [instance: ad97980f-d9c5-4237-b84a-2a13dfbc7764] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:03:53.398791 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-38c8af1c-9add-4713-a310-dd5365701798 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:53.399250 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-38c8af1c-9add-4713-a310-dd5365701798 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:53.399409 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-38c8af1c-9add-4713-a310-dd5365701798 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:53.400343 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-38c8af1c-9add-4713-a310-dd5365701798 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:53.400991 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-38c8af1c-9add-4713-a310-dd5365701798 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:53.401590 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-38c8af1c-9add-4713-a310-dd5365701798 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:53.514102 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-e12b82e4-2b1b-4215-b028-78a9e0e6fdb7 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a1c8d841104bc9b6910bcc2c0e2bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe9283584fc4d90b0715216d867ea2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:53.522355 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-e12b82e4-2b1b-4215-b028-78a9e0e6fdb7 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "GET /compute/v2.1/servers/e5842070-d5a3-43f9-82f8-ebce4eaf5526" status: 200 len: 1509 microversion: 2.1 time: 0.460892 Oct 04 22:03:53.523672 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2168/4276] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:03:53 2022] GET /compute/v2.1/servers/e5842070-d5a3-43f9-82f8-ebce4eaf5526 => generated 1509 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:03:53.606143 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-38c8af1c-9add-4713-a310-dd5365701798 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973de86311b47e882de18efbcb3f67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e037651e3345a8b95ea528cae02c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:53.614872 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-38c8af1c-9add-4713-a310-dd5365701798 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] 10.222.0.43 "GET /compute/v2.1/servers/ad97980f-d9c5-4237-b84a-2a13dfbc7764" status: 200 len: 1522 microversion: 2.1 time: 0.227067 Oct 04 22:03:53.615701 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2109/4277] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:03:53 2022] GET /compute/v2.1/servers/ad97980f-d9c5-4237-b84a-2a13dfbc7764 => generated 1522 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:03:53.637843 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-0953889d-3f92-4f50-9b74-9abd82f01f4d tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:53.638343 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-0953889d-3f92-4f50-9b74-9abd82f01f4d tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] [instance: ad97980f-d9c5-4237-b84a-2a13dfbc7764] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:03:53.644377 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0953889d-3f92-4f50-9b74-9abd82f01f4d tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:53.644865 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0953889d-3f92-4f50-9b74-9abd82f01f4d tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:53.645304 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0953889d-3f92-4f50-9b74-9abd82f01f4d tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:53.646008 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0953889d-3f92-4f50-9b74-9abd82f01f4d tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:53.646493 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0953889d-3f92-4f50-9b74-9abd82f01f4d tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:53.646956 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0953889d-3f92-4f50-9b74-9abd82f01f4d tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:53.672993 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-0953889d-3f92-4f50-9b74-9abd82f01f4d tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] [instance: ad97980f-d9c5-4237-b84a-2a13dfbc7764] Going to try to terminate instance {{(pid=134102) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 22:03:53.736732 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-9dfb815d-6ea3-43c8-b82a-803af744a014 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:53.737606 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-9dfb815d-6ea3-43c8-b82a-803af744a014 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] [instance: 07e11885-b7b0-4ad1-bda6-a677b9aaf48d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:03:53.744515 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9dfb815d-6ea3-43c8-b82a-803af744a014 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:53.745017 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9dfb815d-6ea3-43c8-b82a-803af744a014 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:53.745467 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9dfb815d-6ea3-43c8-b82a-803af744a014 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:53.746189 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9dfb815d-6ea3-43c8-b82a-803af744a014 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:53.746701 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9dfb815d-6ea3-43c8-b82a-803af744a014 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:53.747163 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9dfb815d-6ea3-43c8-b82a-803af744a014 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:53.765002 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:03:53.771460 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-0953889d-3f92-4f50-9b74-9abd82f01f4d tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] 10.222.0.43 "DELETE /compute/v2.1/servers/ad97980f-d9c5-4237-b84a-2a13dfbc7764" status: 204 len: 0 microversion: 2.1 time: 0.136988 Oct 04 22:03:53.772682 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2169/4278] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 22:03:53 2022] DELETE /compute/v2.1/servers/ad97980f-d9c5-4237-b84a-2a13dfbc7764 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 22:03:53.781666 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-c4522493-57b5-4777-aa10-13c37c37ef8d tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:53.782767 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-c4522493-57b5-4777-aa10-13c37c37ef8d tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] [instance: ad97980f-d9c5-4237-b84a-2a13dfbc7764] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:03:53.790055 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c4522493-57b5-4777-aa10-13c37c37ef8d tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:53.790748 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c4522493-57b5-4777-aa10-13c37c37ef8d tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:53.791220 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c4522493-57b5-4777-aa10-13c37c37ef8d tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:53.791930 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c4522493-57b5-4777-aa10-13c37c37ef8d tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:53.792409 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c4522493-57b5-4777-aa10-13c37c37ef8d tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:53.792835 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c4522493-57b5-4777-aa10-13c37c37ef8d tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:54.070272 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-9dfb815d-6ea3-43c8-b82a-803af744a014 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f46a71ea0ee4e45afaea7e38e8c0ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba14e6816284d9e89e22913643f4355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:54.078307 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-9dfb815d-6ea3-43c8-b82a-803af744a014 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] 10.222.0.43 "GET /compute/v2.1/servers/07e11885-b7b0-4ad1-bda6-a677b9aaf48d" status: 200 len: 1520 microversion: 2.1 time: 0.348764 Oct 04 22:03:54.078817 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-c4522493-57b5-4777-aa10-13c37c37ef8d tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973de86311b47e882de18efbcb3f67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e037651e3345a8b95ea528cae02c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:54.090806 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2110/4279] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:03:53 2022] GET /compute/v2.1/servers/07e11885-b7b0-4ad1-bda6-a677b9aaf48d => generated 1520 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:03:54.090903 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-c4522493-57b5-4777-aa10-13c37c37ef8d tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] 10.222.0.43 "GET /compute/v2.1/servers/ad97980f-d9c5-4237-b84a-2a13dfbc7764" status: 200 len: 1528 microversion: 2.1 time: 0.311221 Oct 04 22:03:54.090903 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2170/4280] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:03:53 2022] GET /compute/v2.1/servers/ad97980f-d9c5-4237-b84a-2a13dfbc7764 => generated 1528 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:03:54.413223 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-c5f15e29-8fde-4694-afc6-93d0aaa69357 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:54.416354 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-c5f15e29-8fde-4694-afc6-93d0aaa69357 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] [instance: 39dc4bb1-8465-4576-b490-d066c0fbb18f] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:03:54.427288 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c5f15e29-8fde-4694-afc6-93d0aaa69357 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:54.427810 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c5f15e29-8fde-4694-afc6-93d0aaa69357 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:54.428259 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c5f15e29-8fde-4694-afc6-93d0aaa69357 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:54.429015 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c5f15e29-8fde-4694-afc6-93d0aaa69357 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:54.429957 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c5f15e29-8fde-4694-afc6-93d0aaa69357 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:54.430598 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c5f15e29-8fde-4694-afc6-93d0aaa69357 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:54.518778 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-c5f15e29-8fde-4694-afc6-93d0aaa69357 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92894af6b8f74650ad7696e1f3ac375d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f24f86f0fc4a3ba09c2be55876c783', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:54.532887 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-c5f15e29-8fde-4694-afc6-93d0aaa69357 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92894af6b8f74650ad7696e1f3ac375d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f24f86f0fc4a3ba09c2be55876c783', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:54.534482 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-c5f15e29-8fde-4694-afc6-93d0aaa69357 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92894af6b8f74650ad7696e1f3ac375d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f24f86f0fc4a3ba09c2be55876c783', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:54.536809 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-c5f15e29-8fde-4694-afc6-93d0aaa69357 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] 10.222.0.43 "GET /compute/v2.1/servers/39dc4bb1-8465-4576-b490-d066c0fbb18f" status: 200 len: 1407 microversion: 2.54 time: 0.127729 Oct 04 22:03:54.538410 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2111/4281] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:03:54 2022] GET /compute/v2.1/servers/39dc4bb1-8465-4576-b490-d066c0fbb18f => generated 1407 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:03:54.562692 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-320a71b4-6934-4514-a67a-4838312d1165 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:54.563334 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-320a71b4-6934-4514-a67a-4838312d1165 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: e5842070-d5a3-43f9-82f8-ebce4eaf5526] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:03:54.569431 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-320a71b4-6934-4514-a67a-4838312d1165 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:54.570196 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-320a71b4-6934-4514-a67a-4838312d1165 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:54.570791 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-320a71b4-6934-4514-a67a-4838312d1165 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:54.571521 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-320a71b4-6934-4514-a67a-4838312d1165 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:54.571991 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-320a71b4-6934-4514-a67a-4838312d1165 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:54.572427 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-320a71b4-6934-4514-a67a-4838312d1165 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:54.792362 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-0641331b-f157-42c6-80fa-79f7190623b4 req-21032975-36ed-47c8-b9d7-f865f31f65fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad97980f-d9c5-4237-b84a-2a13dfbc7764", "name": "network-vif-unplugged", "status": "completed", "tag": "eb2633ea-2747-42ba-9388-e6e2161cfa52"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:03:54.806340 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-0641331b-f157-42c6-80fa-79f7190623b4 req-21032975-36ed-47c8-b9d7-f865f31f65fc service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:54.806938 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-0641331b-f157-42c6-80fa-79f7190623b4 req-21032975-36ed-47c8-b9d7-f865f31f65fc service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:54.807429 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-0641331b-f157-42c6-80fa-79f7190623b4 req-21032975-36ed-47c8-b9d7-f865f31f65fc service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:54.823976 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-320a71b4-6934-4514-a67a-4838312d1165 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a1c8d841104bc9b6910bcc2c0e2bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe9283584fc4d90b0715216d867ea2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:54.834847 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-320a71b4-6934-4514-a67a-4838312d1165 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "GET /compute/v2.1/servers/e5842070-d5a3-43f9-82f8-ebce4eaf5526" status: 200 len: 1509 microversion: 2.1 time: 0.278689 Oct 04 22:03:54.841108 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2171/4282] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:03:54 2022] GET /compute/v2.1/servers/e5842070-d5a3-43f9-82f8-ebce4eaf5526 => generated 1509 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:03:54.854052 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-0641331b-f157-42c6-80fa-79f7190623b4 req-21032975-36ed-47c8-b9d7-f865f31f65fc service nova] Creating event network-vif-unplugged:eb2633ea-2747-42ba-9388-e6e2161cfa52 for instance ad97980f-d9c5-4237-b84a-2a13dfbc7764 on n-h1-860284-1 Oct 04 22:03:54.861208 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-0641331b-f157-42c6-80fa-79f7190623b4 req-21032975-36ed-47c8-b9d7-f865f31f65fc service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.076432 Oct 04 22:03:54.861901 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2112/4283] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:03:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:03:55.103908 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-fef10c63-1735-49bc-a96a-ef5a912a1b40 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:55.104528 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-fef10c63-1735-49bc-a96a-ef5a912a1b40 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] [instance: 07e11885-b7b0-4ad1-bda6-a677b9aaf48d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:03:55.113723 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-cdf6ef06-5f66-46ea-ac99-0ca0212fb54a tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:55.113917 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fef10c63-1735-49bc-a96a-ef5a912a1b40 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:55.114528 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-cdf6ef06-5f66-46ea-ac99-0ca0212fb54a tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] [instance: ad97980f-d9c5-4237-b84a-2a13dfbc7764] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:03:55.115446 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fef10c63-1735-49bc-a96a-ef5a912a1b40 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:55.116231 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fef10c63-1735-49bc-a96a-ef5a912a1b40 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:55.117968 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fef10c63-1735-49bc-a96a-ef5a912a1b40 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:55.118691 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fef10c63-1735-49bc-a96a-ef5a912a1b40 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:55.119339 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fef10c63-1735-49bc-a96a-ef5a912a1b40 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:55.137563 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cdf6ef06-5f66-46ea-ac99-0ca0212fb54a tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:55.137563 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cdf6ef06-5f66-46ea-ac99-0ca0212fb54a tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:55.137996 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cdf6ef06-5f66-46ea-ac99-0ca0212fb54a tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:55.139006 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cdf6ef06-5f66-46ea-ac99-0ca0212fb54a tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:55.139838 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cdf6ef06-5f66-46ea-ac99-0ca0212fb54a tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:55.140428 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cdf6ef06-5f66-46ea-ac99-0ca0212fb54a tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:55.347852 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-fef10c63-1735-49bc-a96a-ef5a912a1b40 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f46a71ea0ee4e45afaea7e38e8c0ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba14e6816284d9e89e22913643f4355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:55.350042 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:03:55.351212 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-cdf6ef06-5f66-46ea-ac99-0ca0212fb54a tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973de86311b47e882de18efbcb3f67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e037651e3345a8b95ea528cae02c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:55.360066 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-fef10c63-1735-49bc-a96a-ef5a912a1b40 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] 10.222.0.43 "GET /compute/v2.1/servers/07e11885-b7b0-4ad1-bda6-a677b9aaf48d" status: 200 len: 1497 microversion: 2.1 time: 0.260713 Oct 04 22:03:55.360998 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2172/4284] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:03:55 2022] GET /compute/v2.1/servers/07e11885-b7b0-4ad1-bda6-a677b9aaf48d => generated 1497 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:03:55.371329 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-cdf6ef06-5f66-46ea-ac99-0ca0212fb54a tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] 10.222.0.43 "GET /compute/v2.1/servers/ad97980f-d9c5-4237-b84a-2a13dfbc7764" status: 200 len: 1528 microversion: 2.1 time: 0.253525 Oct 04 22:03:55.388854 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2113/4285] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:03:55 2022] GET /compute/v2.1/servers/ad97980f-d9c5-4237-b84a-2a13dfbc7764 => generated 1528 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:03:55.389048 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-21b8cec4-84a8-4bf1-a0e6-920740263791 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:55.393843 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-21b8cec4-84a8-4bf1-a0e6-920740263791 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9f46a71ea0ee4e45afaea7e38e8c0ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba14e6816284d9e89e22913643f4355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:55.395046 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-21b8cec4-84a8-4bf1-a0e6-920740263791 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': 'fba14e6816284d9e89e22913643f4355'} {{(pid=134102) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 22:03:55.404126 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-21b8cec4-84a8-4bf1-a0e6-920740263791 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:55.405008 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-21b8cec4-84a8-4bf1-a0e6-920740263791 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:55.406132 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-21b8cec4-84a8-4bf1-a0e6-920740263791 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:55.407583 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-21b8cec4-84a8-4bf1-a0e6-920740263791 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:55.408410 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-21b8cec4-84a8-4bf1-a0e6-920740263791 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:55.409085 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-21b8cec4-84a8-4bf1-a0e6-920740263791 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:55.526641 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.multi_cell_list [None req-21b8cec4-84a8-4bf1-a0e6-920740263791 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=134102) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 22:03:55.570727 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-7c642f9c-04df-4918-af4f-66a4768533af tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:55.571288 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-7c642f9c-04df-4918-af4f-66a4768533af tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] [instance: 39dc4bb1-8465-4576-b490-d066c0fbb18f] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:03:55.579110 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7c642f9c-04df-4918-af4f-66a4768533af tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:55.579613 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7c642f9c-04df-4918-af4f-66a4768533af tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:55.580057 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7c642f9c-04df-4918-af4f-66a4768533af tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:55.580769 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7c642f9c-04df-4918-af4f-66a4768533af tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:55.581391 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7c642f9c-04df-4918-af4f-66a4768533af tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:55.581890 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7c642f9c-04df-4918-af4f-66a4768533af tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:55.592863 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-21b8cec4-84a8-4bf1-a0e6-920740263791 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] 10.222.0.43 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 345 microversion: 2.1 time: 0.209365 Oct 04 22:03:55.593836 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2173/4286] 10.222.0.43 () {58 vars in 1154 bytes} [Tue Oct 4 22:03:55 2022] GET /compute/v2.1/servers?status=shutoff => generated 345 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:03:55.614729 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-186d8807-40e4-4d10-93ae-904995912161 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:03:55.622762 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-186d8807-40e4-4d10-93ae-904995912161 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:55.623531 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-186d8807-40e4-4d10-93ae-904995912161 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:55.624605 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-186d8807-40e4-4d10-93ae-904995912161 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:55.656024 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-186d8807-40e4-4d10-93ae-904995912161 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] [instance: 07e11885-b7b0-4ad1-bda6-a677b9aaf48d] Going to try to start instance {{(pid=134102) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 04 22:03:55.666126 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-7c642f9c-04df-4918-af4f-66a4768533af tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92894af6b8f74650ad7696e1f3ac375d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f24f86f0fc4a3ba09c2be55876c783', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:55.681124 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-7c642f9c-04df-4918-af4f-66a4768533af tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92894af6b8f74650ad7696e1f3ac375d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f24f86f0fc4a3ba09c2be55876c783', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:55.686418 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-7c642f9c-04df-4918-af4f-66a4768533af tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92894af6b8f74650ad7696e1f3ac375d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f24f86f0fc4a3ba09c2be55876c783', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:55.688120 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-7c642f9c-04df-4918-af4f-66a4768533af tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] 10.222.0.43 "GET /compute/v2.1/servers/39dc4bb1-8465-4576-b490-d066c0fbb18f" status: 200 len: 1407 microversion: 2.54 time: 0.123213 Oct 04 22:03:55.695284 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2114/4287] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:03:55 2022] GET /compute/v2.1/servers/39dc4bb1-8465-4576-b490-d066c0fbb18f => generated 1407 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 22:03:55.728753 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-186d8807-40e4-4d10-93ae-904995912161 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] 10.222.0.43 "POST /compute/v2.1/servers/07e11885-b7b0-4ad1-bda6-a677b9aaf48d/action" status: 202 len: 0 microversion: 2.1 time: 0.118729 Oct 04 22:03:55.729408 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2174/4288] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 22:03:55 2022] POST /compute/v2.1/servers/07e11885-b7b0-4ad1-bda6-a677b9aaf48d/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 22:03:55.738204 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-6014bfef-8ceb-41ea-9b4e-1305a45501c5 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:55.740027 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-6014bfef-8ceb-41ea-9b4e-1305a45501c5 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] [instance: 07e11885-b7b0-4ad1-bda6-a677b9aaf48d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:03:55.751905 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6014bfef-8ceb-41ea-9b4e-1305a45501c5 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:55.752483 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6014bfef-8ceb-41ea-9b4e-1305a45501c5 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:55.752918 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6014bfef-8ceb-41ea-9b4e-1305a45501c5 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:55.753791 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6014bfef-8ceb-41ea-9b4e-1305a45501c5 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:55.754373 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6014bfef-8ceb-41ea-9b4e-1305a45501c5 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:55.754983 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6014bfef-8ceb-41ea-9b4e-1305a45501c5 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:55.863733 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-d24a6498-ff40-476f-8785-ed9b33ac3069 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:55.870770 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-d24a6498-ff40-476f-8785-ed9b33ac3069 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: e5842070-d5a3-43f9-82f8-ebce4eaf5526] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:03:55.891421 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d24a6498-ff40-476f-8785-ed9b33ac3069 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:55.892644 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d24a6498-ff40-476f-8785-ed9b33ac3069 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:55.893252 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d24a6498-ff40-476f-8785-ed9b33ac3069 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:55.894314 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d24a6498-ff40-476f-8785-ed9b33ac3069 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:55.894960 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d24a6498-ff40-476f-8785-ed9b33ac3069 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:55.895807 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d24a6498-ff40-476f-8785-ed9b33ac3069 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:55.973215 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-6014bfef-8ceb-41ea-9b4e-1305a45501c5 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f46a71ea0ee4e45afaea7e38e8c0ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba14e6816284d9e89e22913643f4355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:55.983797 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-6014bfef-8ceb-41ea-9b4e-1305a45501c5 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] 10.222.0.43 "GET /compute/v2.1/servers/07e11885-b7b0-4ad1-bda6-a677b9aaf48d" status: 200 len: 1506 microversion: 2.1 time: 0.249535 Oct 04 22:03:55.989824 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2115/4289] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:03:55 2022] GET /compute/v2.1/servers/07e11885-b7b0-4ad1-bda6-a677b9aaf48d => generated 1506 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:03:56.083731 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-d24a6498-ff40-476f-8785-ed9b33ac3069 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a1c8d841104bc9b6910bcc2c0e2bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe9283584fc4d90b0715216d867ea2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:56.094012 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-d24a6498-ff40-476f-8785-ed9b33ac3069 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "GET /compute/v2.1/servers/e5842070-d5a3-43f9-82f8-ebce4eaf5526" status: 200 len: 1509 microversion: 2.1 time: 0.236482 Oct 04 22:03:56.094650 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2175/4290] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:03:55 2022] GET /compute/v2.1/servers/e5842070-d5a3-43f9-82f8-ebce4eaf5526 => generated 1509 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:03:56.408105 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-79b4aa3f-e6d6-414c-b847-22994895ad8f tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:56.408746 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-79b4aa3f-e6d6-414c-b847-22994895ad8f tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] [instance: ad97980f-d9c5-4237-b84a-2a13dfbc7764] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:03:56.415682 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-79b4aa3f-e6d6-414c-b847-22994895ad8f tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:56.416199 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-79b4aa3f-e6d6-414c-b847-22994895ad8f tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:56.416634 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-79b4aa3f-e6d6-414c-b847-22994895ad8f tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:56.417332 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-79b4aa3f-e6d6-414c-b847-22994895ad8f tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:56.417790 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-79b4aa3f-e6d6-414c-b847-22994895ad8f tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:56.418211 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-79b4aa3f-e6d6-414c-b847-22994895ad8f tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:56.573620 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-79b4aa3f-e6d6-414c-b847-22994895ad8f tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973de86311b47e882de18efbcb3f67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e037651e3345a8b95ea528cae02c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:56.592698 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-79b4aa3f-e6d6-414c-b847-22994895ad8f tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] 10.222.0.43 "GET /compute/v2.1/servers/ad97980f-d9c5-4237-b84a-2a13dfbc7764" status: 200 len: 1528 microversion: 2.1 time: 0.188416 Oct 04 22:03:56.593718 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2116/4291] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:03:56 2022] GET /compute/v2.1/servers/ad97980f-d9c5-4237-b84a-2a13dfbc7764 => generated 1528 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:03:56.718036 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-14e2f1ad-fe4d-424e-a026-62b0f758aad0 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:56.719445 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-14e2f1ad-fe4d-424e-a026-62b0f758aad0 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] [instance: 39dc4bb1-8465-4576-b490-d066c0fbb18f] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:03:56.727367 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-14e2f1ad-fe4d-424e-a026-62b0f758aad0 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:56.727874 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-14e2f1ad-fe4d-424e-a026-62b0f758aad0 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:56.729695 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-14e2f1ad-fe4d-424e-a026-62b0f758aad0 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:56.730485 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-14e2f1ad-fe4d-424e-a026-62b0f758aad0 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:56.730957 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-14e2f1ad-fe4d-424e-a026-62b0f758aad0 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:56.731565 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-14e2f1ad-fe4d-424e-a026-62b0f758aad0 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:56.814416 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-14e2f1ad-fe4d-424e-a026-62b0f758aad0 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92894af6b8f74650ad7696e1f3ac375d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f24f86f0fc4a3ba09c2be55876c783', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:56.829578 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-14e2f1ad-fe4d-424e-a026-62b0f758aad0 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92894af6b8f74650ad7696e1f3ac375d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f24f86f0fc4a3ba09c2be55876c783', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:56.831890 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-14e2f1ad-fe4d-424e-a026-62b0f758aad0 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92894af6b8f74650ad7696e1f3ac375d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f24f86f0fc4a3ba09c2be55876c783', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:56.833481 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-14e2f1ad-fe4d-424e-a026-62b0f758aad0 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] 10.222.0.43 "GET /compute/v2.1/servers/39dc4bb1-8465-4576-b490-d066c0fbb18f" status: 200 len: 1407 microversion: 2.54 time: 0.120365 Oct 04 22:03:56.836632 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2176/4292] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:03:56 2022] GET /compute/v2.1/servers/39dc4bb1-8465-4576-b490-d066c0fbb18f => generated 1407 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:03:57.012800 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-2ecf7811-d024-4ef4-be83-a7faafae3153 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:57.013658 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-2ecf7811-d024-4ef4-be83-a7faafae3153 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] [instance: 07e11885-b7b0-4ad1-bda6-a677b9aaf48d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:03:57.020632 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2ecf7811-d024-4ef4-be83-a7faafae3153 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:57.021551 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2ecf7811-d024-4ef4-be83-a7faafae3153 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:57.022301 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2ecf7811-d024-4ef4-be83-a7faafae3153 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:57.023885 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2ecf7811-d024-4ef4-be83-a7faafae3153 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:57.024496 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2ecf7811-d024-4ef4-be83-a7faafae3153 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:57.025075 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2ecf7811-d024-4ef4-be83-a7faafae3153 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:57.124822 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-6a129fc8-a524-4637-8cec-a8b657f04403 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:57.125455 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-6a129fc8-a524-4637-8cec-a8b657f04403 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: e5842070-d5a3-43f9-82f8-ebce4eaf5526] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:03:57.141104 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6a129fc8-a524-4637-8cec-a8b657f04403 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:57.141609 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6a129fc8-a524-4637-8cec-a8b657f04403 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:57.144978 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6a129fc8-a524-4637-8cec-a8b657f04403 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:57.145817 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6a129fc8-a524-4637-8cec-a8b657f04403 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:57.146307 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6a129fc8-a524-4637-8cec-a8b657f04403 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:57.147990 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6a129fc8-a524-4637-8cec-a8b657f04403 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:57.391235 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-2ecf7811-d024-4ef4-be83-a7faafae3153 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f46a71ea0ee4e45afaea7e38e8c0ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba14e6816284d9e89e22913643f4355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:57.394044 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=100 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:03:57.402963 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-2ecf7811-d024-4ef4-be83-a7faafae3153 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] 10.222.0.43 "GET /compute/v2.1/servers/07e11885-b7b0-4ad1-bda6-a677b9aaf48d" status: 200 len: 1506 microversion: 2.1 time: 0.394195 Oct 04 22:03:57.403669 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2117/4293] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:03:57 2022] GET /compute/v2.1/servers/07e11885-b7b0-4ad1-bda6-a677b9aaf48d => generated 1506 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:03:57.408765 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-6b97c2b5-5269-47e1-ad34-7e99ce5d85a4 req-d5fc3671-18c0-4e95-9028-7c9c8a199da1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad97980f-d9c5-4237-b84a-2a13dfbc7764", "name": "network-vif-deleted", "tag": "eb2633ea-2747-42ba-9388-e6e2161cfa52"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:03:57.419570 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-6b97c2b5-5269-47e1-ad34-7e99ce5d85a4 req-d5fc3671-18c0-4e95-9028-7c9c8a199da1 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:57.420361 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-6b97c2b5-5269-47e1-ad34-7e99ce5d85a4 req-d5fc3671-18c0-4e95-9028-7c9c8a199da1 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:57.420803 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-6b97c2b5-5269-47e1-ad34-7e99ce5d85a4 req-d5fc3671-18c0-4e95-9028-7c9c8a199da1 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:57.433073 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-6b97c2b5-5269-47e1-ad34-7e99ce5d85a4 req-d5fc3671-18c0-4e95-9028-7c9c8a199da1 service nova] Creating event network-vif-deleted:eb2633ea-2747-42ba-9388-e6e2161cfa52 for instance ad97980f-d9c5-4237-b84a-2a13dfbc7764 on n-h1-860284-1 Oct 04 22:03:57.438131 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-6b97c2b5-5269-47e1-ad34-7e99ce5d85a4 req-d5fc3671-18c0-4e95-9028-7c9c8a199da1 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032997 Oct 04 22:03:57.438779 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2118/4294] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:03:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:03:57.464572 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-6a129fc8-a524-4637-8cec-a8b657f04403 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a1c8d841104bc9b6910bcc2c0e2bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe9283584fc4d90b0715216d867ea2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:57.473169 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-6a129fc8-a524-4637-8cec-a8b657f04403 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "GET /compute/v2.1/servers/e5842070-d5a3-43f9-82f8-ebce4eaf5526" status: 200 len: 1509 microversion: 2.1 time: 0.359803 Oct 04 22:03:57.474071 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2177/4295] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:03:57 2022] GET /compute/v2.1/servers/e5842070-d5a3-43f9-82f8-ebce4eaf5526 => generated 1509 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:03:57.619273 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-6fde188b-ad66-4cbd-a97b-97412f3ea8f9 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:57.620755 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-6fde188b-ad66-4cbd-a97b-97412f3ea8f9 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] [instance: ad97980f-d9c5-4237-b84a-2a13dfbc7764] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:03:57.627485 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6fde188b-ad66-4cbd-a97b-97412f3ea8f9 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:57.628309 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6fde188b-ad66-4cbd-a97b-97412f3ea8f9 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:57.628968 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6fde188b-ad66-4cbd-a97b-97412f3ea8f9 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:57.630150 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6fde188b-ad66-4cbd-a97b-97412f3ea8f9 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:57.630855 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6fde188b-ad66-4cbd-a97b-97412f3ea8f9 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:57.631503 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6fde188b-ad66-4cbd-a97b-97412f3ea8f9 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:57.674173 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6fde188b-ad66-4cbd-a97b-97412f3ea8f9 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:57.674989 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6fde188b-ad66-4cbd-a97b-97412f3ea8f9 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:57.675693 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6fde188b-ad66-4cbd-a97b-97412f3ea8f9 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:57.676251 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.objects.instance [None req-6fde188b-ad66-4cbd-a97b-97412f3ea8f9 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lazy-loading 'fault' on Instance uuid ad97980f-d9c5-4237-b84a-2a13dfbc7764 {{(pid=134101) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 22:03:57.740654 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-6fde188b-ad66-4cbd-a97b-97412f3ea8f9 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973de86311b47e882de18efbcb3f67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e037651e3345a8b95ea528cae02c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:57.749756 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-6fde188b-ad66-4cbd-a97b-97412f3ea8f9 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] 10.222.0.43 "GET /compute/v2.1/servers/ad97980f-d9c5-4237-b84a-2a13dfbc7764" status: 200 len: 1315 microversion: 2.1 time: 0.137093 Oct 04 22:03:57.756501 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2119/4296] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:03:57 2022] GET /compute/v2.1/servers/ad97980f-d9c5-4237-b84a-2a13dfbc7764 => generated 1315 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:03:57.861168 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-7c72e605-d5e3-4003-8528-2b564dd356ca tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:57.862289 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-7c72e605-d5e3-4003-8528-2b564dd356ca tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] [instance: 39dc4bb1-8465-4576-b490-d066c0fbb18f] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:03:57.869670 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7c72e605-d5e3-4003-8528-2b564dd356ca tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:57.870570 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7c72e605-d5e3-4003-8528-2b564dd356ca tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:57.871116 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7c72e605-d5e3-4003-8528-2b564dd356ca tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:57.871977 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7c72e605-d5e3-4003-8528-2b564dd356ca tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:57.872670 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7c72e605-d5e3-4003-8528-2b564dd356ca tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:57.873175 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7c72e605-d5e3-4003-8528-2b564dd356ca tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:57.946647 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-7c72e605-d5e3-4003-8528-2b564dd356ca tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92894af6b8f74650ad7696e1f3ac375d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f24f86f0fc4a3ba09c2be55876c783', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:57.955717 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-7c72e605-d5e3-4003-8528-2b564dd356ca tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92894af6b8f74650ad7696e1f3ac375d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f24f86f0fc4a3ba09c2be55876c783', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:57.957175 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-7c72e605-d5e3-4003-8528-2b564dd356ca tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92894af6b8f74650ad7696e1f3ac375d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f24f86f0fc4a3ba09c2be55876c783', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:57.958376 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-7c72e605-d5e3-4003-8528-2b564dd356ca tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] 10.222.0.43 "GET /compute/v2.1/servers/39dc4bb1-8465-4576-b490-d066c0fbb18f" status: 200 len: 1407 microversion: 2.54 time: 0.101367 Oct 04 22:03:57.958960 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2178/4297] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:03:57 2022] GET /compute/v2.1/servers/39dc4bb1-8465-4576-b490-d066c0fbb18f => generated 1407 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:03:58.433284 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-c8685ae1-c24b-49e9-aebc-1ff0a1fd57a9 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:58.434021 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-c8685ae1-c24b-49e9-aebc-1ff0a1fd57a9 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] [instance: 07e11885-b7b0-4ad1-bda6-a677b9aaf48d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:03:58.441620 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c8685ae1-c24b-49e9-aebc-1ff0a1fd57a9 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:58.442268 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c8685ae1-c24b-49e9-aebc-1ff0a1fd57a9 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:58.442851 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c8685ae1-c24b-49e9-aebc-1ff0a1fd57a9 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:58.453093 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c8685ae1-c24b-49e9-aebc-1ff0a1fd57a9 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:58.457296 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c8685ae1-c24b-49e9-aebc-1ff0a1fd57a9 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:58.457892 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c8685ae1-c24b-49e9-aebc-1ff0a1fd57a9 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:58.513381 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-f0972dd2-b5b0-4f63-b55b-f3f58ea6a57f tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:58.514573 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-f0972dd2-b5b0-4f63-b55b-f3f58ea6a57f tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: e5842070-d5a3-43f9-82f8-ebce4eaf5526] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:03:58.525003 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f0972dd2-b5b0-4f63-b55b-f3f58ea6a57f tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:58.525511 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f0972dd2-b5b0-4f63-b55b-f3f58ea6a57f tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:58.525959 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f0972dd2-b5b0-4f63-b55b-f3f58ea6a57f tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:58.533919 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f0972dd2-b5b0-4f63-b55b-f3f58ea6a57f tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:58.534548 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f0972dd2-b5b0-4f63-b55b-f3f58ea6a57f tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:58.535009 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f0972dd2-b5b0-4f63-b55b-f3f58ea6a57f tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:58.812866 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-c8685ae1-c24b-49e9-aebc-1ff0a1fd57a9 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f46a71ea0ee4e45afaea7e38e8c0ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba14e6816284d9e89e22913643f4355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:58.833805 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-c8685ae1-c24b-49e9-aebc-1ff0a1fd57a9 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] 10.222.0.43 "GET /compute/v2.1/servers/07e11885-b7b0-4ad1-bda6-a677b9aaf48d" status: 200 len: 1510 microversion: 2.1 time: 0.406251 Oct 04 22:03:58.834425 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2120/4298] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:03:58 2022] GET /compute/v2.1/servers/07e11885-b7b0-4ad1-bda6-a677b9aaf48d => generated 1510 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:03:58.864948 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-5c7eea35-bc82-44b1-9041-708dd7df8bc3 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:58.868268 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-5c7eea35-bc82-44b1-9041-708dd7df8bc3 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] [instance: ad97980f-d9c5-4237-b84a-2a13dfbc7764] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:03:58.897237 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5c7eea35-bc82-44b1-9041-708dd7df8bc3 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:58.900781 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-f0972dd2-b5b0-4f63-b55b-f3f58ea6a57f tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a1c8d841104bc9b6910bcc2c0e2bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe9283584fc4d90b0715216d867ea2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:58.901346 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5c7eea35-bc82-44b1-9041-708dd7df8bc3 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:58.901952 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5c7eea35-bc82-44b1-9041-708dd7df8bc3 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:58.902741 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5c7eea35-bc82-44b1-9041-708dd7df8bc3 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:58.903263 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5c7eea35-bc82-44b1-9041-708dd7df8bc3 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:58.903706 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5c7eea35-bc82-44b1-9041-708dd7df8bc3 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:58.915490 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-f0972dd2-b5b0-4f63-b55b-f3f58ea6a57f tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "GET /compute/v2.1/servers/e5842070-d5a3-43f9-82f8-ebce4eaf5526" status: 200 len: 1509 microversion: 2.1 time: 0.416350 Oct 04 22:03:58.916116 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2179/4299] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:03:58 2022] GET /compute/v2.1/servers/e5842070-d5a3-43f9-82f8-ebce4eaf5526 => generated 1509 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:03:58.924375 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-e6db612f-6a80-4eac-8efa-ecea8213c732 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:58.934303 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-e6db612f-6a80-4eac-8efa-ecea8213c732 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9f46a71ea0ee4e45afaea7e38e8c0ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba14e6816284d9e89e22913643f4355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:58.947034 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.compute.servers [None req-e6db612f-6a80-4eac-8efa-ecea8213c732 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Removing options 'limit' from query {{(pid=134102) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 04 22:03:58.948036 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-e6db612f-6a80-4eac-8efa-ecea8213c732 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Searching by: {'deleted': False, 'project_id': 'fba14e6816284d9e89e22913643f4355'} {{(pid=134102) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 22:03:58.949444 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e6db612f-6a80-4eac-8efa-ecea8213c732 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:58.950126 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e6db612f-6a80-4eac-8efa-ecea8213c732 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:58.950780 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e6db612f-6a80-4eac-8efa-ecea8213c732 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:58.952533 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e6db612f-6a80-4eac-8efa-ecea8213c732 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:58.953151 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e6db612f-6a80-4eac-8efa-ecea8213c732 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:58.953623 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e6db612f-6a80-4eac-8efa-ecea8213c732 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:58.955276 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-e6db612f-6a80-4eac-8efa-ecea8213c732 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] 10.222.0.43 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.038144 Oct 04 22:03:58.956382 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2180/4300] 10.222.0.43 () {58 vars in 1140 bytes} [Tue Oct 4 22:03:58 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 22:03:58.967763 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5c7eea35-bc82-44b1-9041-708dd7df8bc3 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:58.969611 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5c7eea35-bc82-44b1-9041-708dd7df8bc3 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:58.970149 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5c7eea35-bc82-44b1-9041-708dd7df8bc3 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:58.971144 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.objects.instance [None req-5c7eea35-bc82-44b1-9041-708dd7df8bc3 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lazy-loading 'fault' on Instance uuid ad97980f-d9c5-4237-b84a-2a13dfbc7764 {{(pid=134101) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 22:03:58.980593 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-0699a390-7db8-45a8-a8e3-d7b7b518c03d tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:58.981638 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-0699a390-7db8-45a8-a8e3-d7b7b518c03d tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] [instance: 07e11885-b7b0-4ad1-bda6-a677b9aaf48d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:03:58.997610 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0699a390-7db8-45a8-a8e3-d7b7b518c03d tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:58.998595 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0699a390-7db8-45a8-a8e3-d7b7b518c03d tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:58.999276 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0699a390-7db8-45a8-a8e3-d7b7b518c03d tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:59.000314 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0699a390-7db8-45a8-a8e3-d7b7b518c03d tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:59.000991 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0699a390-7db8-45a8-a8e3-d7b7b518c03d tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:59.001663 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0699a390-7db8-45a8-a8e3-d7b7b518c03d tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:59.044428 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-5c7eea35-bc82-44b1-9041-708dd7df8bc3 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973de86311b47e882de18efbcb3f67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e037651e3345a8b95ea528cae02c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:59.055165 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-5c7eea35-bc82-44b1-9041-708dd7df8bc3 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] 10.222.0.43 "GET /compute/v2.1/servers/ad97980f-d9c5-4237-b84a-2a13dfbc7764" status: 200 len: 1315 microversion: 2.1 time: 0.207035 Oct 04 22:03:59.066908 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2121/4301] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:03:58 2022] GET /compute/v2.1/servers/ad97980f-d9c5-4237-b84a-2a13dfbc7764 => generated 1315 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:03:59.073339 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-eeaef3f3-dec5-4445-b699-be7d53fa7a49 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:59.075790 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-eeaef3f3-dec5-4445-b699-be7d53fa7a49 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] [instance: 39dc4bb1-8465-4576-b490-d066c0fbb18f] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:03:59.083126 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-eeaef3f3-dec5-4445-b699-be7d53fa7a49 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:59.083984 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-eeaef3f3-dec5-4445-b699-be7d53fa7a49 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:59.084657 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-eeaef3f3-dec5-4445-b699-be7d53fa7a49 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:59.086320 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-eeaef3f3-dec5-4445-b699-be7d53fa7a49 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:59.087273 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-eeaef3f3-dec5-4445-b699-be7d53fa7a49 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:59.087920 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-eeaef3f3-dec5-4445-b699-be7d53fa7a49 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:59.515445 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-eeaef3f3-dec5-4445-b699-be7d53fa7a49 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92894af6b8f74650ad7696e1f3ac375d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f24f86f0fc4a3ba09c2be55876c783', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:59.530426 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-eeaef3f3-dec5-4445-b699-be7d53fa7a49 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92894af6b8f74650ad7696e1f3ac375d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f24f86f0fc4a3ba09c2be55876c783', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:59.535127 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-eeaef3f3-dec5-4445-b699-be7d53fa7a49 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92894af6b8f74650ad7696e1f3ac375d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f24f86f0fc4a3ba09c2be55876c783', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:59.537906 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-eeaef3f3-dec5-4445-b699-be7d53fa7a49 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] 10.222.0.43 "GET /compute/v2.1/servers/39dc4bb1-8465-4576-b490-d066c0fbb18f" status: 200 len: 1413 microversion: 2.54 time: 0.469956 Oct 04 22:03:59.539806 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2122/4302] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:03:59 2022] GET /compute/v2.1/servers/39dc4bb1-8465-4576-b490-d066c0fbb18f => generated 1413 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:03:59.588537 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-0699a390-7db8-45a8-a8e3-d7b7b518c03d tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f46a71ea0ee4e45afaea7e38e8c0ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba14e6816284d9e89e22913643f4355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:59.598545 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-0699a390-7db8-45a8-a8e3-d7b7b518c03d tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] 10.222.0.43 "GET /compute/v2.1/servers/07e11885-b7b0-4ad1-bda6-a677b9aaf48d" status: 200 len: 1510 microversion: 2.1 time: 0.632428 Oct 04 22:03:59.599801 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2181/4303] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:03:58 2022] GET /compute/v2.1/servers/07e11885-b7b0-4ad1-bda6-a677b9aaf48d => generated 1510 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:03:59.621645 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-28a316bc-b307-4c6f-8e0f-fd27d1ef3583 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:59.622266 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-28a316bc-b307-4c6f-8e0f-fd27d1ef3583 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] [instance: 27f6babc-9d2c-4ba8-8043-cd2d90f9ba7e] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:03:59.629093 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-28a316bc-b307-4c6f-8e0f-fd27d1ef3583 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:59.629608 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-28a316bc-b307-4c6f-8e0f-fd27d1ef3583 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:59.630037 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-28a316bc-b307-4c6f-8e0f-fd27d1ef3583 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:59.630801 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-28a316bc-b307-4c6f-8e0f-fd27d1ef3583 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:59.631264 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-28a316bc-b307-4c6f-8e0f-fd27d1ef3583 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:59.631704 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-28a316bc-b307-4c6f-8e0f-fd27d1ef3583 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:59.794498 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-28a316bc-b307-4c6f-8e0f-fd27d1ef3583 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f46a71ea0ee4e45afaea7e38e8c0ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba14e6816284d9e89e22913643f4355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:59.802997 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-28a316bc-b307-4c6f-8e0f-fd27d1ef3583 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] 10.222.0.43 "GET /compute/v2.1/servers/27f6babc-9d2c-4ba8-8043-cd2d90f9ba7e" status: 200 len: 1510 microversion: 2.1 time: 0.185300 Oct 04 22:03:59.814879 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2123/4304] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:03:59 2022] GET /compute/v2.1/servers/27f6babc-9d2c-4ba8-8043-cd2d90f9ba7e => generated 1510 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:03:59.828233 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-0a025f79-d9ba-4fcf-81cc-1b573d6e946a tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:59.829041 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-0a025f79-d9ba-4fcf-81cc-1b573d6e946a tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] [instance: 879c8591-9e1e-42e8-bc3f-a435fd86caaf] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:03:59.836644 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0a025f79-d9ba-4fcf-81cc-1b573d6e946a tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:59.837394 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0a025f79-d9ba-4fcf-81cc-1b573d6e946a tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:59.837997 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0a025f79-d9ba-4fcf-81cc-1b573d6e946a tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:59.838947 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0a025f79-d9ba-4fcf-81cc-1b573d6e946a tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:59.839564 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0a025f79-d9ba-4fcf-81cc-1b573d6e946a tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:59.840152 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0a025f79-d9ba-4fcf-81cc-1b573d6e946a tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:59.946934 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-8514cec3-896e-4115-a16b-33c028ea4a08 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:59.947747 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-8514cec3-896e-4115-a16b-33c028ea4a08 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: e5842070-d5a3-43f9-82f8-ebce4eaf5526] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:03:59.959271 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8514cec3-896e-4115-a16b-33c028ea4a08 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:59.959712 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8514cec3-896e-4115-a16b-33c028ea4a08 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:59.961002 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8514cec3-896e-4115-a16b-33c028ea4a08 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:59.971692 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8514cec3-896e-4115-a16b-33c028ea4a08 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:59.972441 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8514cec3-896e-4115-a16b-33c028ea4a08 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:59.973127 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8514cec3-896e-4115-a16b-33c028ea4a08 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:00.082555 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-0a025f79-d9ba-4fcf-81cc-1b573d6e946a tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f46a71ea0ee4e45afaea7e38e8c0ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba14e6816284d9e89e22913643f4355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:04:00.095128 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-0a025f79-d9ba-4fcf-81cc-1b573d6e946a tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] 10.222.0.43 "GET /compute/v2.1/servers/879c8591-9e1e-42e8-bc3f-a435fd86caaf" status: 200 len: 1511 microversion: 2.1 time: 0.270792 Oct 04 22:04:00.098314 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2182/4305] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:03:59 2022] GET /compute/v2.1/servers/879c8591-9e1e-42e8-bc3f-a435fd86caaf => generated 1511 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:04:00.108793 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-492e75bc-d0b6-4b7d-801b-a78a4c44a054 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:04:00.115182 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-492e75bc-d0b6-4b7d-801b-a78a4c44a054 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] [instance: ad97980f-d9c5-4237-b84a-2a13dfbc7764] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:04:00.125341 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-492e75bc-d0b6-4b7d-801b-a78a4c44a054 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:00.128375 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-492e75bc-d0b6-4b7d-801b-a78a4c44a054 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:00.131541 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-492e75bc-d0b6-4b7d-801b-a78a4c44a054 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:00.132924 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-492e75bc-d0b6-4b7d-801b-a78a4c44a054 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:00.133405 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-492e75bc-d0b6-4b7d-801b-a78a4c44a054 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:00.133830 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-492e75bc-d0b6-4b7d-801b-a78a4c44a054 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:00.151736 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-492e75bc-d0b6-4b7d-801b-a78a4c44a054 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] HTTP exception thrown: Instance ad97980f-d9c5-4237-b84a-2a13dfbc7764 could not be found. Oct 04 22:04:00.153402 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-492e75bc-d0b6-4b7d-801b-a78a4c44a054 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Request method failure captured: Oct 04 22:04:00.153402 n-d-860284-1 devstack@n-api.service[134102]: request: GET /compute/v2.1/servers/ad97980f-d9c5-4237-b84a-2a13dfbc7764 HTTP/1.1 Oct 04 22:04:00.153402 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 22:04:00.153402 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 22:04:00.153402 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 22:04:00.153402 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 22:04:00.153402 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 22:04:00.153402 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 22:04:00.153402 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 22:04:00.153402 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 22:04:00.153402 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPK2uaWdbUBgaC4RfPmjtTbjIfwc-i2umyIIBK_cF0D-_RCmikTip9FKSkMA-3LEgg0VpJcoPxMz4oo_myk5qoqg03ZgavcBoIAuumM_46SfpdfsovWLWxw7rAOFQTEcjFL3h_S0RmznoPUhj4-fuUVB2M5gfUS2qQyVeicBq2kx7daY Oct 04 22:04:00.153402 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 22:04:00.153402 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 22:04:00.153402 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 22:04:00.153402 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 22:04:00.153402 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 22:04:00.153402 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 22:04:00.153402 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: a1e037651e3345a8b95ea528cae02c9f Oct 04 22:04:00.153402 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-342298031 Oct 04 22:04:00.153402 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 22:04:00.153402 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 22:04:00.153402 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a1e037651e3345a8b95ea528cae02c9f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_a1e037651e3345a8b95ea528cae02c9f", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a1e037651e3345a8b95ea528cae02c9f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/a1e037651e3345a8b95ea528cae02c9f"}]}] Oct 04 22:04:00.153402 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-342298031 Oct 04 22:04:00.153402 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: a1e037651e3345a8b95ea528cae02c9f Oct 04 22:04:00.153402 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-342298031 Oct 04 22:04:00.153402 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-ImagesOneServerNegativeTestJSON-342298031-project Oct 04 22:04:00.153402 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 22:04:00.153402 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 22:04:00.153402 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: 9973de86311b47e882de18efbcb3f67f Oct 04 22:04:00.153402 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-342298031-project Oct 04 22:04:00.153402 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 22:04:00.153402 n-d-860284-1 devstack@n-api.service[134102]: exception: Instance ad97980f-d9c5-4237-b84a-2a13dfbc7764 could not be found. Oct 04 22:04:00.153402 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': 'ad97980f-d9c5-4237-b84a-2a13dfbc7764'} Oct 04 22:04:00.153402 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:04:00.153402 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:04:00.153402 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:04:00.153402 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:04:00.153402 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:04:00.153402 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:04:00.153402 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:04:00.153402 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:04:00.153402 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:04:00.153402 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:04:00.153402 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad97980f-d9c5-4237-b84a-2a13dfbc7764 could not be found. Oct 04 22:04:00.153402 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:04:00.153402 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:04:00.153402 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:04:00.153402 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:04:00.153402 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:04:00.153402 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:04:00.153402 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:04:00.153402 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:04:00.153402 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:04:00.153402 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:04:00.153402 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:04:00.153402 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:04:00.153402 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:04:00.153402 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:04:00.153402 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:04:00.153402 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:04:00.153402 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad97980f-d9c5-4237-b84a-2a13dfbc7764 could not be found. Oct 04 22:04:00.153402 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:04:00.153402 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:04:00.165299 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:04:00.165299 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:04:00.165299 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:04:00.165299 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:04:00.165299 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:04:00.165299 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:04:00.165299 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad97980f-d9c5-4237-b84a-2a13dfbc7764 could not be found. Oct 04 22:04:00.165299 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:04:00.165299 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-492e75bc-d0b6-4b7d-801b-a78a4c44a054 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Returning 404 to user: Instance ad97980f-d9c5-4237-b84a-2a13dfbc7764 could not be found. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:04:00.165299 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-492e75bc-d0b6-4b7d-801b-a78a4c44a054 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] 10.222.0.43 "GET /compute/v2.1/servers/ad97980f-d9c5-4237-b84a-2a13dfbc7764" status: 404 len: 111 microversion: 2.1 time: 0.055262 Oct 04 22:04:00.165299 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2183/4306] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:04:00 2022] GET /compute/v2.1/servers/ad97980f-d9c5-4237-b84a-2a13dfbc7764 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:04:00.165299 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-a692f9b5-2642-499e-9484-a9699c267129 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:04:00.166203 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-a692f9b5-2642-499e-9484-a9699c267129 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9f46a71ea0ee4e45afaea7e38e8c0ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba14e6816284d9e89e22913643f4355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:04:00.166658 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-a692f9b5-2642-499e-9484-a9699c267129 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Searching by: {'ip': '172.20.0.12', 'deleted': False, 'project_id': 'fba14e6816284d9e89e22913643f4355'} {{(pid=134102) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 22:04:00.184324 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-8514cec3-896e-4115-a16b-33c028ea4a08 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a1c8d841104bc9b6910bcc2c0e2bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe9283584fc4d90b0715216d867ea2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:04:00.200327 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-8514cec3-896e-4115-a16b-33c028ea4a08 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "GET /compute/v2.1/servers/e5842070-d5a3-43f9-82f8-ebce4eaf5526" status: 200 len: 1509 microversion: 2.1 time: 0.258211 Oct 04 22:04:00.209320 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2124/4307] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:03:59 2022] GET /compute/v2.1/servers/e5842070-d5a3-43f9-82f8-ebce4eaf5526 => generated 1509 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:04:00.225890 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-2030d148-f88b-4a91-b971-0b53a62dcde2 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Action: 'create', calling method: .version_select at 0x7fbb2e2354c0>, body: {"keypair": {"name": "tempest-keypair-870543901", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFF9F99S/se4DKYdhyH32U23BSwFGcvbLNnznziQaroSWvyLumjebInVMcWuPJkJbAxQ5UmRmA/AmojCwaMXUnCOxMFCCmpf6tzBqsFODrN31mSCRC5M8TLo4Qkib3kDvg=="}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:04:00.249064 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-2030d148-f88b-4a91-b971-0b53a62dcde2 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Getting quotas for project a1e037651e3345a8b95ea528cae02c9f. Resources: {'key_pairs'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:04:00.255715 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-2030d148-f88b-4a91-b971-0b53a62dcde2 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Getting quotas for user 9973de86311b47e882de18efbcb3f67f and project a1e037651e3345a8b95ea528cae02c9f. Resources: {'key_pairs'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:04:00.304813 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-2030d148-f88b-4a91-b971-0b53a62dcde2 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.089387 Oct 04 22:04:00.306027 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2125/4308] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Oct 4 22:04:00 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:04:00.353423 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a692f9b5-2642-499e-9484-a9699c267129 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:00.353960 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a692f9b5-2642-499e-9484-a9699c267129 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:00.354450 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a692f9b5-2642-499e-9484-a9699c267129 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:00.355180 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a692f9b5-2642-499e-9484-a9699c267129 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:00.355628 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a692f9b5-2642-499e-9484-a9699c267129 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:00.356080 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a692f9b5-2642-499e-9484-a9699c267129 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:00.478079 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.multi_cell_list [None req-a692f9b5-2642-499e-9484-a9699c267129 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=134102) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 22:04:00.543454 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-a692f9b5-2642-499e-9484-a9699c267129 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] 10.222.0.43 "GET /compute/v2.1/servers?ip=172.20.0.12" status: 200 len: 345 microversion: 2.1 time: 0.386935 Oct 04 22:04:00.544263 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2184/4309] 10.222.0.43 () {58 vars in 1154 bytes} [Tue Oct 4 22:04:00 2022] GET /compute/v2.1/servers?ip=172.20.0.12 => generated 345 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:04:00.559002 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e352f5b8-f889-4733-a703-3b08988cfdd4 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:04:00.559439 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-e352f5b8-f889-4733-a703-3b08988cfdd4 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] [instance: 07e11885-b7b0-4ad1-bda6-a677b9aaf48d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:04:00.569475 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-1fdc35ec-50ba-4288-ad3c-07b83f672ed7 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:04:00.570802 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-1fdc35ec-50ba-4288-ad3c-07b83f672ed7 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] [instance: 39dc4bb1-8465-4576-b490-d066c0fbb18f] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:04:00.574032 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e352f5b8-f889-4733-a703-3b08988cfdd4 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:00.574459 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e352f5b8-f889-4733-a703-3b08988cfdd4 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:00.575066 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e352f5b8-f889-4733-a703-3b08988cfdd4 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:00.575925 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e352f5b8-f889-4733-a703-3b08988cfdd4 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:00.576457 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e352f5b8-f889-4733-a703-3b08988cfdd4 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:00.576954 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e352f5b8-f889-4733-a703-3b08988cfdd4 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:00.578939 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1fdc35ec-50ba-4288-ad3c-07b83f672ed7 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:00.579677 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1fdc35ec-50ba-4288-ad3c-07b83f672ed7 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:00.580765 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1fdc35ec-50ba-4288-ad3c-07b83f672ed7 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:00.581772 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1fdc35ec-50ba-4288-ad3c-07b83f672ed7 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:00.582745 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1fdc35ec-50ba-4288-ad3c-07b83f672ed7 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:00.583411 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1fdc35ec-50ba-4288-ad3c-07b83f672ed7 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:00.693449 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-1fdc35ec-50ba-4288-ad3c-07b83f672ed7 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92894af6b8f74650ad7696e1f3ac375d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f24f86f0fc4a3ba09c2be55876c783', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:04:00.708695 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-1fdc35ec-50ba-4288-ad3c-07b83f672ed7 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92894af6b8f74650ad7696e1f3ac375d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f24f86f0fc4a3ba09c2be55876c783', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:04:00.710844 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-1fdc35ec-50ba-4288-ad3c-07b83f672ed7 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92894af6b8f74650ad7696e1f3ac375d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f24f86f0fc4a3ba09c2be55876c783', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:04:00.712297 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-1fdc35ec-50ba-4288-ad3c-07b83f672ed7 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] 10.222.0.43 "GET /compute/v2.1/servers/39dc4bb1-8465-4576-b490-d066c0fbb18f" status: 200 len: 1413 microversion: 2.54 time: 0.147508 Oct 04 22:04:00.713406 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2185/4310] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:04:00 2022] GET /compute/v2.1/servers/39dc4bb1-8465-4576-b490-d066c0fbb18f => generated 1413 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:04:00.838956 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-e352f5b8-f889-4733-a703-3b08988cfdd4 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f46a71ea0ee4e45afaea7e38e8c0ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba14e6816284d9e89e22913643f4355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:04:00.853473 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-e352f5b8-f889-4733-a703-3b08988cfdd4 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] 10.222.0.43 "GET /compute/v2.1/servers/07e11885-b7b0-4ad1-bda6-a677b9aaf48d" status: 200 len: 1510 microversion: 2.1 time: 0.299602 Oct 04 22:04:00.854066 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2126/4311] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:04:00 2022] GET /compute/v2.1/servers/07e11885-b7b0-4ad1-bda6-a677b9aaf48d => generated 1510 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:04:00.878746 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-40a786be-eda0-4509-bf5a-959ac87125cc tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:04:00.879484 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-40a786be-eda0-4509-bf5a-959ac87125cc tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] [instance: 27f6babc-9d2c-4ba8-8043-cd2d90f9ba7e] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:04:00.890162 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-40a786be-eda0-4509-bf5a-959ac87125cc tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:00.890703 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-40a786be-eda0-4509-bf5a-959ac87125cc tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:00.891151 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-40a786be-eda0-4509-bf5a-959ac87125cc tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:00.891870 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-40a786be-eda0-4509-bf5a-959ac87125cc tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:00.892334 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-40a786be-eda0-4509-bf5a-959ac87125cc tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:00.892935 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-40a786be-eda0-4509-bf5a-959ac87125cc tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:01.104112 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-40a786be-eda0-4509-bf5a-959ac87125cc tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f46a71ea0ee4e45afaea7e38e8c0ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba14e6816284d9e89e22913643f4355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:04:01.126936 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-40a786be-eda0-4509-bf5a-959ac87125cc tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] 10.222.0.43 "GET /compute/v2.1/servers/27f6babc-9d2c-4ba8-8043-cd2d90f9ba7e" status: 200 len: 1510 microversion: 2.1 time: 0.253463 Oct 04 22:04:01.135745 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2186/4312] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:04:00 2022] GET /compute/v2.1/servers/27f6babc-9d2c-4ba8-8043-cd2d90f9ba7e => generated 1510 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:04:01.159983 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-7b78998b-f70a-4c6d-94cd-3ee155fd4aca tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:04:01.159983 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-7b78998b-f70a-4c6d-94cd-3ee155fd4aca tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] [instance: 879c8591-9e1e-42e8-bc3f-a435fd86caaf] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:04:01.167815 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7b78998b-f70a-4c6d-94cd-3ee155fd4aca tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:01.168271 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7b78998b-f70a-4c6d-94cd-3ee155fd4aca tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:01.168892 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7b78998b-f70a-4c6d-94cd-3ee155fd4aca tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:01.169788 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7b78998b-f70a-4c6d-94cd-3ee155fd4aca tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:01.170514 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7b78998b-f70a-4c6d-94cd-3ee155fd4aca tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:01.170862 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7b78998b-f70a-4c6d-94cd-3ee155fd4aca tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:01.249025 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-f9581f9d-890d-4147-abd4-c481a9e938d9 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:04:01.249660 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-f9581f9d-890d-4147-abd4-c481a9e938d9 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: e5842070-d5a3-43f9-82f8-ebce4eaf5526] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:04:01.289439 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f9581f9d-890d-4147-abd4-c481a9e938d9 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:01.290809 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f9581f9d-890d-4147-abd4-c481a9e938d9 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:01.292373 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f9581f9d-890d-4147-abd4-c481a9e938d9 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:01.294304 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f9581f9d-890d-4147-abd4-c481a9e938d9 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:01.294826 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f9581f9d-890d-4147-abd4-c481a9e938d9 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:01.296801 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f9581f9d-890d-4147-abd4-c481a9e938d9 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:01.596795 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-7b78998b-f70a-4c6d-94cd-3ee155fd4aca tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f46a71ea0ee4e45afaea7e38e8c0ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba14e6816284d9e89e22913643f4355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:04:01.607808 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-7b78998b-f70a-4c6d-94cd-3ee155fd4aca tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] 10.222.0.43 "GET /compute/v2.1/servers/879c8591-9e1e-42e8-bc3f-a435fd86caaf" status: 200 len: 1511 microversion: 2.1 time: 0.452306 Oct 04 22:04:01.608723 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2127/4313] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:04:01 2022] GET /compute/v2.1/servers/879c8591-9e1e-42e8-bc3f-a435fd86caaf => generated 1511 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:04:01.631115 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-6e157811-077f-43ab-ba3b-4f9b4044cc4c tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:04:01.638483 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-6e157811-077f-43ab-ba3b-4f9b4044cc4c tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9f46a71ea0ee4e45afaea7e38e8c0ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba14e6816284d9e89e22913643f4355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:04:01.639459 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-6e157811-077f-43ab-ba3b-4f9b4044cc4c tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Searching by: {'deleted': False, 'project_id': 'fba14e6816284d9e89e22913643f4355'} {{(pid=134101) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 22:04:01.645904 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6e157811-077f-43ab-ba3b-4f9b4044cc4c tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:01.646936 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6e157811-077f-43ab-ba3b-4f9b4044cc4c tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:01.647625 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6e157811-077f-43ab-ba3b-4f9b4044cc4c tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:01.649368 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6e157811-077f-43ab-ba3b-4f9b4044cc4c tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:01.649904 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6e157811-077f-43ab-ba3b-4f9b4044cc4c tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:01.650342 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6e157811-077f-43ab-ba3b-4f9b4044cc4c tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:01.656753 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-f9581f9d-890d-4147-abd4-c481a9e938d9 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a1c8d841104bc9b6910bcc2c0e2bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe9283584fc4d90b0715216d867ea2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:04:01.671577 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-f9581f9d-890d-4147-abd4-c481a9e938d9 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "GET /compute/v2.1/servers/e5842070-d5a3-43f9-82f8-ebce4eaf5526" status: 200 len: 1509 microversion: 2.1 time: 0.444904 Oct 04 22:04:01.673515 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2187/4314] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:04:01 2022] GET /compute/v2.1/servers/e5842070-d5a3-43f9-82f8-ebce4eaf5526 => generated 1509 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:04:01.697558 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.multi_cell_list [None req-6e157811-077f-43ab-ba3b-4f9b4044cc4c tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=134101) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 22:04:01.739953 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-24fa6af0-a118-4a27-bc87-bdfa54ea7448 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:04:01.740574 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-24fa6af0-a118-4a27-bc87-bdfa54ea7448 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] [instance: 39dc4bb1-8465-4576-b490-d066c0fbb18f] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:04:01.743032 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-6e157811-077f-43ab-ba3b-4f9b4044cc4c tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f46a71ea0ee4e45afaea7e38e8c0ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba14e6816284d9e89e22913643f4355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:04:01.746164 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:04:01.747384 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-24fa6af0-a118-4a27-bc87-bdfa54ea7448 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:01.748079 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-24fa6af0-a118-4a27-bc87-bdfa54ea7448 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:01.748682 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-24fa6af0-a118-4a27-bc87-bdfa54ea7448 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:01.749621 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-24fa6af0-a118-4a27-bc87-bdfa54ea7448 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:01.750297 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-24fa6af0-a118-4a27-bc87-bdfa54ea7448 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:01.750904 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-24fa6af0-a118-4a27-bc87-bdfa54ea7448 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:01.752595 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6e157811-077f-43ab-ba3b-4f9b4044cc4c tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:01.754128 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6e157811-077f-43ab-ba3b-4f9b4044cc4c tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:01.754760 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6e157811-077f-43ab-ba3b-4f9b4044cc4c tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:01.932554 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-24fa6af0-a118-4a27-bc87-bdfa54ea7448 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92894af6b8f74650ad7696e1f3ac375d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f24f86f0fc4a3ba09c2be55876c783', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:04:01.947613 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-24fa6af0-a118-4a27-bc87-bdfa54ea7448 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92894af6b8f74650ad7696e1f3ac375d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f24f86f0fc4a3ba09c2be55876c783', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:04:01.949309 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-24fa6af0-a118-4a27-bc87-bdfa54ea7448 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92894af6b8f74650ad7696e1f3ac375d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f24f86f0fc4a3ba09c2be55876c783', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:04:01.950707 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-24fa6af0-a118-4a27-bc87-bdfa54ea7448 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] 10.222.0.43 "GET /compute/v2.1/servers/39dc4bb1-8465-4576-b490-d066c0fbb18f" status: 200 len: 1413 microversion: 2.54 time: 0.214650 Oct 04 22:04:01.968594 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2188/4315] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:04:01 2022] GET /compute/v2.1/servers/39dc4bb1-8465-4576-b490-d066c0fbb18f => generated 1413 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 22:04:02.114454 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-6e157811-077f-43ab-ba3b-4f9b4044cc4c tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] 10.222.0.43 "GET /compute/v2.1/servers/detail" status: 200 len: 4514 microversion: 2.1 time: 0.487252 Oct 04 22:04:02.131176 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2128/4316] 10.222.0.43 () {58 vars in 1146 bytes} [Tue Oct 4 22:04:01 2022] GET /compute/v2.1/servers/detail => generated 4514 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:04:02.144661 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-e7eca0a2-592e-4a96-ac60-7881921930ec tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:04:02.149846 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-e7eca0a2-592e-4a96-ac60-7881921930ec tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9f46a71ea0ee4e45afaea7e38e8c0ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba14e6816284d9e89e22913643f4355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:04:02.150595 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-e7eca0a2-592e-4a96-ac60-7881921930ec tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Searching by: {'ip': '172.20.0.', 'deleted': False, 'project_id': 'fba14e6816284d9e89e22913643f4355'} {{(pid=134102) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 22:04:02.365838 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e7eca0a2-592e-4a96-ac60-7881921930ec tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:02.368318 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e7eca0a2-592e-4a96-ac60-7881921930ec tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:02.368833 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e7eca0a2-592e-4a96-ac60-7881921930ec tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:02.370349 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e7eca0a2-592e-4a96-ac60-7881921930ec tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:02.370349 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e7eca0a2-592e-4a96-ac60-7881921930ec tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:02.370851 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e7eca0a2-592e-4a96-ac60-7881921930ec tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:02.453761 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:04:02.465070 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.multi_cell_list [None req-e7eca0a2-592e-4a96-ac60-7881921930ec tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=134102) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 22:04:02.540304 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-e7eca0a2-592e-4a96-ac60-7881921930ec tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] 10.222.0.43 "GET /compute/v2.1/servers?ip=172.20.0." status: 200 len: 1009 microversion: 2.1 time: 0.398476 Oct 04 22:04:02.542166 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2189/4317] 10.222.0.43 () {58 vars in 1150 bytes} [Tue Oct 4 22:04:02 2022] GET /compute/v2.1/servers?ip=172.20.0. => generated 1009 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:04:02.559277 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-845ea2dd-2a3a-4cb3-82ff-0b51edacf2c7 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:04:02.565609 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-845ea2dd-2a3a-4cb3-82ff-0b51edacf2c7 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9f46a71ea0ee4e45afaea7e38e8c0ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba14e6816284d9e89e22913643f4355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:04:02.567389 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-845ea2dd-2a3a-4cb3-82ff-0b51edacf2c7 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': 'fba14e6816284d9e89e22913643f4355'} {{(pid=134101) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 22:04:02.577280 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-845ea2dd-2a3a-4cb3-82ff-0b51edacf2c7 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:02.577775 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-845ea2dd-2a3a-4cb3-82ff-0b51edacf2c7 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:02.578210 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-845ea2dd-2a3a-4cb3-82ff-0b51edacf2c7 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:02.579044 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-845ea2dd-2a3a-4cb3-82ff-0b51edacf2c7 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:02.579505 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-845ea2dd-2a3a-4cb3-82ff-0b51edacf2c7 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:02.579933 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-845ea2dd-2a3a-4cb3-82ff-0b51edacf2c7 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:02.697508 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-4e8569e2-f9a0-4e0e-9bed-d57dfe9a91c2 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:04:02.698176 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-4e8569e2-f9a0-4e0e-9bed-d57dfe9a91c2 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: e5842070-d5a3-43f9-82f8-ebce4eaf5526] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:04:02.712770 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4e8569e2-f9a0-4e0e-9bed-d57dfe9a91c2 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:02.713553 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4e8569e2-f9a0-4e0e-9bed-d57dfe9a91c2 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:02.714000 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4e8569e2-f9a0-4e0e-9bed-d57dfe9a91c2 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:02.714756 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4e8569e2-f9a0-4e0e-9bed-d57dfe9a91c2 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:02.715208 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4e8569e2-f9a0-4e0e-9bed-d57dfe9a91c2 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:02.718293 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4e8569e2-f9a0-4e0e-9bed-d57dfe9a91c2 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:02.746691 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.multi_cell_list [None req-845ea2dd-2a3a-4cb3-82ff-0b51edacf2c7 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=134101) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 22:04:02.849982 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-845ea2dd-2a3a-4cb3-82ff-0b51edacf2c7 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] 10.222.0.43 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1009 microversion: 2.1 time: 0.297323 Oct 04 22:04:02.851982 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2129/4318] 10.222.0.43 () {58 vars in 1212 bytes} [Tue Oct 4 22:04:02 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1009 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:04:02.864498 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-3d5f4eeb-d98e-479f-b5e1-e54edfa6131b tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:04:02.880065 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-3d5f4eeb-d98e-479f-b5e1-e54edfa6131b tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9f46a71ea0ee4e45afaea7e38e8c0ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba14e6816284d9e89e22913643f4355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:04:02.881533 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-3d5f4eeb-d98e-479f-b5e1-e54edfa6131b tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': 'fba14e6816284d9e89e22913643f4355'} {{(pid=134101) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 22:04:02.890329 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3d5f4eeb-d98e-479f-b5e1-e54edfa6131b tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:02.893845 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3d5f4eeb-d98e-479f-b5e1-e54edfa6131b tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:02.896057 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3d5f4eeb-d98e-479f-b5e1-e54edfa6131b tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:02.898593 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3d5f4eeb-d98e-479f-b5e1-e54edfa6131b tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:02.899584 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3d5f4eeb-d98e-479f-b5e1-e54edfa6131b tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:02.901796 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3d5f4eeb-d98e-479f-b5e1-e54edfa6131b tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:02.999094 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-4e8569e2-f9a0-4e0e-9bed-d57dfe9a91c2 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a1c8d841104bc9b6910bcc2c0e2bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe9283584fc4d90b0715216d867ea2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:04:03.009566 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-4e8569e2-f9a0-4e0e-9bed-d57dfe9a91c2 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "GET /compute/v2.1/servers/e5842070-d5a3-43f9-82f8-ebce4eaf5526" status: 200 len: 1509 microversion: 2.1 time: 0.316152 Oct 04 22:04:03.010183 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2190/4319] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:04:02 2022] GET /compute/v2.1/servers/e5842070-d5a3-43f9-82f8-ebce4eaf5526 => generated 1509 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:04:03.016909 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-1a99431a-9e80-4a13-8a20-c6ec92cbfeec tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:04:03.017742 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-1a99431a-9e80-4a13-8a20-c6ec92cbfeec tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] [instance: 39dc4bb1-8465-4576-b490-d066c0fbb18f] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:04:03.043502 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1a99431a-9e80-4a13-8a20-c6ec92cbfeec tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:03.044363 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1a99431a-9e80-4a13-8a20-c6ec92cbfeec tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:03.045045 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1a99431a-9e80-4a13-8a20-c6ec92cbfeec tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:03.045908 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1a99431a-9e80-4a13-8a20-c6ec92cbfeec tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:03.046696 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1a99431a-9e80-4a13-8a20-c6ec92cbfeec tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:03.047229 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1a99431a-9e80-4a13-8a20-c6ec92cbfeec tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:03.057141 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.multi_cell_list [None req-3d5f4eeb-d98e-479f-b5e1-e54edfa6131b tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=134101) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 22:04:03.164062 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-3d5f4eeb-d98e-479f-b5e1-e54edfa6131b tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] 10.222.0.43 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1009 microversion: 2.1 time: 0.302556 Oct 04 22:04:03.167750 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2130/4320] 10.222.0.43 () {58 vars in 1196 bytes} [Tue Oct 4 22:04:02 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1009 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:04:03.178821 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-bcbd260c-6e59-44ad-b3df-08e3e5fe4b0b tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:04:03.188689 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-bcbd260c-6e59-44ad-b3df-08e3e5fe4b0b tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9f46a71ea0ee4e45afaea7e38e8c0ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba14e6816284d9e89e22913643f4355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:04:03.189801 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-bcbd260c-6e59-44ad-b3df-08e3e5fe4b0b tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Searching by: {'name': '-816538895', 'deleted': False, 'project_id': 'fba14e6816284d9e89e22913643f4355'} {{(pid=134101) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 22:04:03.197660 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bcbd260c-6e59-44ad-b3df-08e3e5fe4b0b tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:03.198754 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bcbd260c-6e59-44ad-b3df-08e3e5fe4b0b tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:03.199505 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bcbd260c-6e59-44ad-b3df-08e3e5fe4b0b tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:03.201524 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bcbd260c-6e59-44ad-b3df-08e3e5fe4b0b tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:03.202559 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bcbd260c-6e59-44ad-b3df-08e3e5fe4b0b tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:03.203308 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bcbd260c-6e59-44ad-b3df-08e3e5fe4b0b tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:03.206508 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-1a99431a-9e80-4a13-8a20-c6ec92cbfeec tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92894af6b8f74650ad7696e1f3ac375d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f24f86f0fc4a3ba09c2be55876c783', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:04:03.218232 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-1a99431a-9e80-4a13-8a20-c6ec92cbfeec tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92894af6b8f74650ad7696e1f3ac375d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f24f86f0fc4a3ba09c2be55876c783', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:04:03.219892 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-1a99431a-9e80-4a13-8a20-c6ec92cbfeec tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92894af6b8f74650ad7696e1f3ac375d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f24f86f0fc4a3ba09c2be55876c783', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:04:03.221600 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-1a99431a-9e80-4a13-8a20-c6ec92cbfeec tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] 10.222.0.43 "GET /compute/v2.1/servers/39dc4bb1-8465-4576-b490-d066c0fbb18f" status: 200 len: 1413 microversion: 2.54 time: 0.210439 Oct 04 22:04:03.222448 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2191/4321] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:04:03 2022] GET /compute/v2.1/servers/39dc4bb1-8465-4576-b490-d066c0fbb18f => generated 1413 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:04:03.256836 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-95bfb801-eee6-4113-bff1-f2f701700a48 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-2117243942", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:04:03.319502 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.multi_cell_list [None req-bcbd260c-6e59-44ad-b3df-08e3e5fe4b0b tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=134101) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 22:04:03.348863 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.network.neutron [None req-95bfb801-eee6-4113-bff1-f2f701700a48 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] validate_networks() for [('54dc583b-b197-4250-8660-141d8275cae0', None, None, None, None, None)] {{(pid=134102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 22:04:03.421013 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-bcbd260c-6e59-44ad-b3df-08e3e5fe4b0b tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] 10.222.0.43 "GET /compute/v2.1/servers?name=-816538895" status: 200 len: 345 microversion: 2.1 time: 0.247612 Oct 04 22:04:03.422242 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2131/4322] 10.222.0.43 () {58 vars in 1156 bytes} [Tue Oct 4 22:04:03 2022] GET /compute/v2.1/servers?name=-816538895 => generated 345 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:04:03.437001 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-26b08427-3466-4010-bd03-ff72f7f0ea19 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:04:03.443007 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-26b08427-3466-4010-bd03-ff72f7f0ea19 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9f46a71ea0ee4e45afaea7e38e8c0ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba14e6816284d9e89e22913643f4355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:04:03.445449 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-26b08427-3466-4010-bd03-ff72f7f0ea19 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': 'fba14e6816284d9e89e22913643f4355'} {{(pid=134101) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 22:04:03.452333 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-26b08427-3466-4010-bd03-ff72f7f0ea19 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:03.453131 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-26b08427-3466-4010-bd03-ff72f7f0ea19 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:03.454139 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-26b08427-3466-4010-bd03-ff72f7f0ea19 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:03.455138 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-26b08427-3466-4010-bd03-ff72f7f0ea19 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:03.455774 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-26b08427-3466-4010-bd03-ff72f7f0ea19 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:03.456379 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-26b08427-3466-4010-bd03-ff72f7f0ea19 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:03.570225 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.multi_cell_list [None req-26b08427-3466-4010-bd03-ff72f7f0ea19 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=134101) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 22:04:03.653238 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-26b08427-3466-4010-bd03-ff72f7f0ea19 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] 10.222.0.43 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1009 microversion: 2.1 time: 0.221418 Oct 04 22:04:03.653851 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2132/4323] 10.222.0.43 () {58 vars in 1154 bytes} [Tue Oct 4 22:04:03 2022] GET /compute/v2.1/servers?name=-instance => generated 1009 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:04:03.667269 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-47717f58-a256-4819-96c3-f54ef5f23f7a tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:04:03.672652 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-47717f58-a256-4819-96c3-f54ef5f23f7a tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9f46a71ea0ee4e45afaea7e38e8c0ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba14e6816284d9e89e22913643f4355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:04:03.673330 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-47717f58-a256-4819-96c3-f54ef5f23f7a tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-81653889', 'deleted': False, 'project_id': 'fba14e6816284d9e89e22913643f4355'} {{(pid=134101) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 22:04:03.679088 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-47717f58-a256-4819-96c3-f54ef5f23f7a tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:03.679570 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-47717f58-a256-4819-96c3-f54ef5f23f7a tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:03.680254 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-47717f58-a256-4819-96c3-f54ef5f23f7a tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:03.680982 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-47717f58-a256-4819-96c3-f54ef5f23f7a tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:03.681441 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-47717f58-a256-4819-96c3-f54ef5f23f7a tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:03.681861 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-47717f58-a256-4819-96c3-f54ef5f23f7a tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:03.774311 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=100 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:04:03.778124 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.multi_cell_list [None req-47717f58-a256-4819-96c3-f54ef5f23f7a tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=134101) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 22:04:03.846632 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-47717f58-a256-4819-96c3-f54ef5f23f7a tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] 10.222.0.43 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-81653889" status: 200 len: 345 microversion: 2.1 time: 0.184086 Oct 04 22:04:03.848457 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2133/4324] 10.222.0.43 () {58 vars in 1226 bytes} [Tue Oct 4 22:04:03 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-81653889 => generated 345 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:04:03.861984 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-6e9056af-b8c6-4db4-8157-bd2024126776 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:04:03.862523 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-6e9056af-b8c6-4db4-8157-bd2024126776 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] [instance: 879c8591-9e1e-42e8-bc3f-a435fd86caaf] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:04:03.869263 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6e9056af-b8c6-4db4-8157-bd2024126776 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:03.869739 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6e9056af-b8c6-4db4-8157-bd2024126776 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:03.870181 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6e9056af-b8c6-4db4-8157-bd2024126776 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:03.871101 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6e9056af-b8c6-4db4-8157-bd2024126776 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:03.871560 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6e9056af-b8c6-4db4-8157-bd2024126776 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:03.872157 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6e9056af-b8c6-4db4-8157-bd2024126776 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:03.901988 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-6e9056af-b8c6-4db4-8157-bd2024126776 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] [instance: 879c8591-9e1e-42e8-bc3f-a435fd86caaf] Going to try to terminate instance {{(pid=134101) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 22:04:04.025803 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-6e9056af-b8c6-4db4-8157-bd2024126776 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] 10.222.0.43 "DELETE /compute/v2.1/servers/879c8591-9e1e-42e8-bc3f-a435fd86caaf" status: 204 len: 0 microversion: 2.1 time: 0.168225 Oct 04 22:04:04.027830 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2134/4325] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 22:04:03 2022] DELETE /compute/v2.1/servers/879c8591-9e1e-42e8-bc3f-a435fd86caaf => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 22:04:04.039290 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-b2defece-aac5-4dfe-9f50-f6f369474c51 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:04:04.040343 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-b2defece-aac5-4dfe-9f50-f6f369474c51 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: e5842070-d5a3-43f9-82f8-ebce4eaf5526] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:04:04.049768 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b2defece-aac5-4dfe-9f50-f6f369474c51 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:04.050791 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b2defece-aac5-4dfe-9f50-f6f369474c51 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:04.059054 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b2defece-aac5-4dfe-9f50-f6f369474c51 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:04.060056 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b2defece-aac5-4dfe-9f50-f6f369474c51 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:04.060692 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b2defece-aac5-4dfe-9f50-f6f369474c51 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:04.061258 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b2defece-aac5-4dfe-9f50-f6f369474c51 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:04.293859 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-95bfb801-eee6-4113-bff1-f2f701700a48 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Flavor limits 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 22:04:04.294938 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-95bfb801-eee6-4113-bff1-f2f701700a48 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Image limits 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 22:04:04.295688 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-95bfb801-eee6-4113-bff1-f2f701700a48 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Flavor pref 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 22:04:04.296318 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-95bfb801-eee6-4113-bff1-f2f701700a48 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Image pref 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 22:04:04.297596 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-95bfb801-eee6-4113-bff1-f2f701700a48 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 22:04:04.315462 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-95bfb801-eee6-4113-bff1-f2f701700a48 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:04.324317 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-95bfb801-eee6-4113-bff1-f2f701700a48 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:04.325010 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-95bfb801-eee6-4113-bff1-f2f701700a48 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:04.326021 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-b2defece-aac5-4dfe-9f50-f6f369474c51 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a1c8d841104bc9b6910bcc2c0e2bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe9283584fc4d90b0715216d867ea2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:04:04.327270 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-95bfb801-eee6-4113-bff1-f2f701700a48 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:04.327909 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-95bfb801-eee6-4113-bff1-f2f701700a48 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:04.328430 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-95bfb801-eee6-4113-bff1-f2f701700a48 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:04.348907 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-95bfb801-eee6-4113-bff1-f2f701700a48 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Getting quotas for project a1e037651e3345a8b95ea528cae02c9f. Resources: {'instances', 'ram', 'cores'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:04:04.349218 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-b2defece-aac5-4dfe-9f50-f6f369474c51 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "GET /compute/v2.1/servers/e5842070-d5a3-43f9-82f8-ebce4eaf5526" status: 200 len: 1509 microversion: 2.1 time: 0.317385 Oct 04 22:04:04.350026 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2135/4326] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:04:04 2022] GET /compute/v2.1/servers/e5842070-d5a3-43f9-82f8-ebce4eaf5526 => generated 1509 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:04:04.356782 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-95bfb801-eee6-4113-bff1-f2f701700a48 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Getting quotas for user 9973de86311b47e882de18efbcb3f67f and project a1e037651e3345a8b95ea528cae02c9f. Resources: {'instances', 'ram', 'cores'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:04:04.371013 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-95bfb801-eee6-4113-bff1-f2f701700a48 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Going to run 1 instances... {{(pid=134102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 22:04:04.373662 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-95bfb801-eee6-4113-bff1-f2f701700a48 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] [instance: 38ec68cd-0c1c-4f92-bb44-f6f6fb078b42] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='58548514-5dac-426c-81f5-19e3fba33e23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 22:04:04.374634 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-d3c27c84-6ca2-40c1-8fcc-e0a9ac7cba76 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:04:04.375270 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-d3c27c84-6ca2-40c1-8fcc-e0a9ac7cba76 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] [instance: 879c8591-9e1e-42e8-bc3f-a435fd86caaf] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:04:04.395127 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d3c27c84-6ca2-40c1-8fcc-e0a9ac7cba76 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:04.395657 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d3c27c84-6ca2-40c1-8fcc-e0a9ac7cba76 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:04.396111 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d3c27c84-6ca2-40c1-8fcc-e0a9ac7cba76 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:04.397310 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d3c27c84-6ca2-40c1-8fcc-e0a9ac7cba76 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:04.397310 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d3c27c84-6ca2-40c1-8fcc-e0a9ac7cba76 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:04.398565 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d3c27c84-6ca2-40c1-8fcc-e0a9ac7cba76 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:04.433686 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-95bfb801-eee6-4113-bff1-f2f701700a48 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.181073 Oct 04 22:04:04.434726 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2192/4327] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 22:04:03 2022] POST /compute/v2.1/servers => generated 383 bytes in 1210 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 22:04:04.449786 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-7527638a-b133-4f72-b13f-f31492d956ca tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:04:04.450443 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-7527638a-b133-4f72-b13f-f31492d956ca tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] [instance: 39dc4bb1-8465-4576-b490-d066c0fbb18f] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:04:04.459816 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7527638a-b133-4f72-b13f-f31492d956ca tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:04.461008 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7527638a-b133-4f72-b13f-f31492d956ca tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:04.462656 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7527638a-b133-4f72-b13f-f31492d956ca tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:04.463607 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7527638a-b133-4f72-b13f-f31492d956ca tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:04.464268 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7527638a-b133-4f72-b13f-f31492d956ca tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:04.464889 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7527638a-b133-4f72-b13f-f31492d956ca tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:04.555328 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-7527638a-b133-4f72-b13f-f31492d956ca tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92894af6b8f74650ad7696e1f3ac375d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f24f86f0fc4a3ba09c2be55876c783', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:04:04.568202 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-7527638a-b133-4f72-b13f-f31492d956ca tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92894af6b8f74650ad7696e1f3ac375d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f24f86f0fc4a3ba09c2be55876c783', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:04:04.572044 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-7527638a-b133-4f72-b13f-f31492d956ca tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92894af6b8f74650ad7696e1f3ac375d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f24f86f0fc4a3ba09c2be55876c783', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:04:04.578573 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-7527638a-b133-4f72-b13f-f31492d956ca tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] 10.222.0.43 "GET /compute/v2.1/servers/39dc4bb1-8465-4576-b490-d066c0fbb18f" status: 200 len: 1398 microversion: 2.54 time: 0.135637 Oct 04 22:04:04.580769 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2193/4328] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:04:04 2022] GET /compute/v2.1/servers/39dc4bb1-8465-4576-b490-d066c0fbb18f => generated 1398 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:04:04.591094 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-3d116e9c-2119-4233-9e7c-92666503c66b tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:04:04.596936 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-3d116e9c-2119-4233-9e7c-92666503c66b tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] [instance: 38ec68cd-0c1c-4f92-bb44-f6f6fb078b42] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:04:04.699740 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-3d116e9c-2119-4233-9e7c-92666503c66b tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973de86311b47e882de18efbcb3f67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e037651e3345a8b95ea528cae02c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:04:04.705532 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-d3c27c84-6ca2-40c1-8fcc-e0a9ac7cba76 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f46a71ea0ee4e45afaea7e38e8c0ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba14e6816284d9e89e22913643f4355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:04:04.709622 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-3d116e9c-2119-4233-9e7c-92666503c66b tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] 10.222.0.43 "GET /compute/v2.1/servers/38ec68cd-0c1c-4f92-bb44-f6f6fb078b42" status: 200 len: 1225 microversion: 2.1 time: 0.126194 Oct 04 22:04:04.709622 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2194/4329] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:04:04 2022] GET /compute/v2.1/servers/38ec68cd-0c1c-4f92-bb44-f6f6fb078b42 => generated 1225 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:04:04.717400 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-d3c27c84-6ca2-40c1-8fcc-e0a9ac7cba76 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] 10.222.0.43 "GET /compute/v2.1/servers/879c8591-9e1e-42e8-bc3f-a435fd86caaf" status: 200 len: 1517 microversion: 2.1 time: 0.356996 Oct 04 22:04:04.718197 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2136/4330] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:04:04 2022] GET /compute/v2.1/servers/879c8591-9e1e-42e8-bc3f-a435fd86caaf => generated 1517 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:04:04.733684 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-e893d069-59d4-4cb9-8c08-d5a0b2fe5971 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Calling method '.version_select at 0x7fbb2f170ca0>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:04:04.763382 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-e893d069-59d4-4cb9-8c08-d5a0b2fe5971 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-666142146" status: 204 len: 0 microversion: 2.54 time: 0.035865 Oct 04 22:04:04.764687 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2195/4331] 10.222.0.43 () {60 vars in 1316 bytes} [Tue Oct 4 22:04:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-666142146 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 22:04:04.778108 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-fcfe324b-9e26-4efc-aaa1-9d0c7683aaae tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:04:04.778983 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-fcfe324b-9e26-4efc-aaa1-9d0c7683aaae tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] [instance: 39dc4bb1-8465-4576-b490-d066c0fbb18f] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:04:04.790064 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fcfe324b-9e26-4efc-aaa1-9d0c7683aaae tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:04.791522 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fcfe324b-9e26-4efc-aaa1-9d0c7683aaae tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:04.792135 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fcfe324b-9e26-4efc-aaa1-9d0c7683aaae tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:04.793419 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fcfe324b-9e26-4efc-aaa1-9d0c7683aaae tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:04.794048 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fcfe324b-9e26-4efc-aaa1-9d0c7683aaae tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:04.795000 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fcfe324b-9e26-4efc-aaa1-9d0c7683aaae tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:04.829136 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-fcfe324b-9e26-4efc-aaa1-9d0c7683aaae tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] [instance: 39dc4bb1-8465-4576-b490-d066c0fbb18f] Going to try to terminate instance {{(pid=134101) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 22:04:04.957656 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-fcfe324b-9e26-4efc-aaa1-9d0c7683aaae tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] 10.222.0.43 "DELETE /compute/v2.1/servers/39dc4bb1-8465-4576-b490-d066c0fbb18f" status: 204 len: 0 microversion: 2.54 time: 0.183469 Oct 04 22:04:04.958956 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2137/4332] 10.222.0.43 () {60 vars in 1280 bytes} [Tue Oct 4 22:04:04 2022] DELETE /compute/v2.1/servers/39dc4bb1-8465-4576-b490-d066c0fbb18f => generated 0 bytes in 186 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 22:04:04.967674 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-70138d6d-dc31-402c-afdc-6e2027d43873 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:04:04.968221 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-70138d6d-dc31-402c-afdc-6e2027d43873 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] [instance: 39dc4bb1-8465-4576-b490-d066c0fbb18f] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:04:04.983100 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-70138d6d-dc31-402c-afdc-6e2027d43873 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:04.983625 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-70138d6d-dc31-402c-afdc-6e2027d43873 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:04.984079 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-70138d6d-dc31-402c-afdc-6e2027d43873 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:04.984807 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-70138d6d-dc31-402c-afdc-6e2027d43873 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:04.985291 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-70138d6d-dc31-402c-afdc-6e2027d43873 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:04.985702 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-70138d6d-dc31-402c-afdc-6e2027d43873 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:05.075225 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-70138d6d-dc31-402c-afdc-6e2027d43873 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92894af6b8f74650ad7696e1f3ac375d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f24f86f0fc4a3ba09c2be55876c783', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:04:05.086041 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-70138d6d-dc31-402c-afdc-6e2027d43873 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92894af6b8f74650ad7696e1f3ac375d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f24f86f0fc4a3ba09c2be55876c783', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:04:05.091497 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-70138d6d-dc31-402c-afdc-6e2027d43873 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92894af6b8f74650ad7696e1f3ac375d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f24f86f0fc4a3ba09c2be55876c783', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:04:05.093208 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-70138d6d-dc31-402c-afdc-6e2027d43873 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] 10.222.0.43 "GET /compute/v2.1/servers/39dc4bb1-8465-4576-b490-d066c0fbb18f" status: 200 len: 1404 microversion: 2.54 time: 0.129664 Oct 04 22:04:05.093813 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2196/4333] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:04:04 2022] GET /compute/v2.1/servers/39dc4bb1-8465-4576-b490-d066c0fbb18f => generated 1404 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:04:05.377743 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-7db2724e-f138-4c91-8133-f390d2935947 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:04:05.378478 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-7db2724e-f138-4c91-8133-f390d2935947 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: e5842070-d5a3-43f9-82f8-ebce4eaf5526] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:04:05.390357 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7db2724e-f138-4c91-8133-f390d2935947 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:05.390900 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7db2724e-f138-4c91-8133-f390d2935947 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:05.391450 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7db2724e-f138-4c91-8133-f390d2935947 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:05.392176 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7db2724e-f138-4c91-8133-f390d2935947 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:05.392808 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7db2724e-f138-4c91-8133-f390d2935947 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:05.393410 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7db2724e-f138-4c91-8133-f390d2935947 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:05.739849 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-6c55d6bc-4945-4fbd-81db-62002a0c1a29 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:04:05.740986 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-6c55d6bc-4945-4fbd-81db-62002a0c1a29 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] [instance: 38ec68cd-0c1c-4f92-bb44-f6f6fb078b42] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:04:05.748865 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6c55d6bc-4945-4fbd-81db-62002a0c1a29 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:05.749358 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6c55d6bc-4945-4fbd-81db-62002a0c1a29 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:05.749797 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6c55d6bc-4945-4fbd-81db-62002a0c1a29 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:05.750553 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6c55d6bc-4945-4fbd-81db-62002a0c1a29 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:05.750978 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6c55d6bc-4945-4fbd-81db-62002a0c1a29 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:05.751402 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6c55d6bc-4945-4fbd-81db-62002a0c1a29 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:05.781688 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-7db2724e-f138-4c91-8133-f390d2935947 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a1c8d841104bc9b6910bcc2c0e2bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe9283584fc4d90b0715216d867ea2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:04:05.795070 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-7db2724e-f138-4c91-8133-f390d2935947 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "GET /compute/v2.1/servers/e5842070-d5a3-43f9-82f8-ebce4eaf5526" status: 200 len: 1509 microversion: 2.1 time: 0.421509 Oct 04 22:04:05.795668 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2138/4334] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:04:05 2022] GET /compute/v2.1/servers/e5842070-d5a3-43f9-82f8-ebce4eaf5526 => generated 1509 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:04:05.801216 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-7ded6e9b-7ec8-4be9-813f-41a53d2abdb9 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:04:05.802057 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-7ded6e9b-7ec8-4be9-813f-41a53d2abdb9 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] [instance: 879c8591-9e1e-42e8-bc3f-a435fd86caaf] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:04:05.809848 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7ded6e9b-7ec8-4be9-813f-41a53d2abdb9 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:05.810596 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7ded6e9b-7ec8-4be9-813f-41a53d2abdb9 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:05.811429 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7ded6e9b-7ec8-4be9-813f-41a53d2abdb9 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:05.812297 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7ded6e9b-7ec8-4be9-813f-41a53d2abdb9 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:05.812870 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7ded6e9b-7ec8-4be9-813f-41a53d2abdb9 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:05.813470 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7ded6e9b-7ec8-4be9-813f-41a53d2abdb9 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:05.885570 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-6c55d6bc-4945-4fbd-81db-62002a0c1a29 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973de86311b47e882de18efbcb3f67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e037651e3345a8b95ea528cae02c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:04:05.894386 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-6c55d6bc-4945-4fbd-81db-62002a0c1a29 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] 10.222.0.43 "GET /compute/v2.1/servers/38ec68cd-0c1c-4f92-bb44-f6f6fb078b42" status: 200 len: 1277 microversion: 2.1 time: 0.164114 Oct 04 22:04:05.895122 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2197/4335] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:04:05 2022] GET /compute/v2.1/servers/38ec68cd-0c1c-4f92-bb44-f6f6fb078b42 => generated 1277 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:04:06.120687 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-0217b480-ec3d-45e8-8f75-1a7ba2c89838 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:04:06.121573 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-0217b480-ec3d-45e8-8f75-1a7ba2c89838 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] [instance: 39dc4bb1-8465-4576-b490-d066c0fbb18f] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:04:06.129140 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0217b480-ec3d-45e8-8f75-1a7ba2c89838 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:06.130716 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0217b480-ec3d-45e8-8f75-1a7ba2c89838 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:06.131339 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0217b480-ec3d-45e8-8f75-1a7ba2c89838 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:06.133478 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0217b480-ec3d-45e8-8f75-1a7ba2c89838 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:06.134180 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0217b480-ec3d-45e8-8f75-1a7ba2c89838 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:06.134903 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0217b480-ec3d-45e8-8f75-1a7ba2c89838 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:06.478405 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-0217b480-ec3d-45e8-8f75-1a7ba2c89838 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92894af6b8f74650ad7696e1f3ac375d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f24f86f0fc4a3ba09c2be55876c783', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:04:06.492379 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-7ded6e9b-7ec8-4be9-813f-41a53d2abdb9 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f46a71ea0ee4e45afaea7e38e8c0ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba14e6816284d9e89e22913643f4355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:04:06.492992 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-0217b480-ec3d-45e8-8f75-1a7ba2c89838 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92894af6b8f74650ad7696e1f3ac375d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f24f86f0fc4a3ba09c2be55876c783', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:04:06.495108 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-0217b480-ec3d-45e8-8f75-1a7ba2c89838 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92894af6b8f74650ad7696e1f3ac375d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f24f86f0fc4a3ba09c2be55876c783', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:04:06.498253 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-0217b480-ec3d-45e8-8f75-1a7ba2c89838 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] 10.222.0.43 "GET /compute/v2.1/servers/39dc4bb1-8465-4576-b490-d066c0fbb18f" status: 200 len: 1404 microversion: 2.54 time: 0.381138 Oct 04 22:04:06.511991 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2198/4336] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:04:06 2022] GET /compute/v2.1/servers/39dc4bb1-8465-4576-b490-d066c0fbb18f => generated 1404 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 22:04:06.513767 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-7ded6e9b-7ec8-4be9-813f-41a53d2abdb9 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] 10.222.0.43 "GET /compute/v2.1/servers/879c8591-9e1e-42e8-bc3f-a435fd86caaf" status: 200 len: 1517 microversion: 2.1 time: 0.716684 Oct 04 22:04:06.515164 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2139/4337] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:04:05 2022] GET /compute/v2.1/servers/879c8591-9e1e-42e8-bc3f-a435fd86caaf => generated 1517 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:04:06.827814 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-1eb1cedd-db7e-44ed-8259-b5def8d520fd tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:04:06.836469 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-1eb1cedd-db7e-44ed-8259-b5def8d520fd tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: e5842070-d5a3-43f9-82f8-ebce4eaf5526] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:04:06.860900 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1eb1cedd-db7e-44ed-8259-b5def8d520fd tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:06.863097 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1eb1cedd-db7e-44ed-8259-b5def8d520fd tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:06.869047 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1eb1cedd-db7e-44ed-8259-b5def8d520fd tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:06.870061 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1eb1cedd-db7e-44ed-8259-b5def8d520fd tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:06.873268 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1eb1cedd-db7e-44ed-8259-b5def8d520fd tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:06.874524 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1eb1cedd-db7e-44ed-8259-b5def8d520fd tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:06.920715 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-31726d38-c045-4456-b056-1906327b4184 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:04:06.921629 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-31726d38-c045-4456-b056-1906327b4184 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] [instance: 38ec68cd-0c1c-4f92-bb44-f6f6fb078b42] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:04:06.937126 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-31726d38-c045-4456-b056-1906327b4184 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:06.940411 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-31726d38-c045-4456-b056-1906327b4184 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:06.941062 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-31726d38-c045-4456-b056-1906327b4184 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:06.946831 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-31726d38-c045-4456-b056-1906327b4184 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:06.947534 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-31726d38-c045-4456-b056-1906327b4184 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:06.951245 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-31726d38-c045-4456-b056-1906327b4184 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:07.267268 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-31726d38-c045-4456-b056-1906327b4184 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973de86311b47e882de18efbcb3f67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e037651e3345a8b95ea528cae02c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:04:07.283001 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-31726d38-c045-4456-b056-1906327b4184 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] 10.222.0.43 "GET /compute/v2.1/servers/38ec68cd-0c1c-4f92-bb44-f6f6fb078b42" status: 200 len: 1277 microversion: 2.1 time: 0.364891 Oct 04 22:04:07.288313 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2140/4338] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:04:06 2022] GET /compute/v2.1/servers/38ec68cd-0c1c-4f92-bb44-f6f6fb078b42 => generated 1277 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:04:07.526216 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-1eb1cedd-db7e-44ed-8259-b5def8d520fd tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a1c8d841104bc9b6910bcc2c0e2bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe9283584fc4d90b0715216d867ea2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:04:07.529857 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-6f99acba-fab0-46be-8f65-3488466c662a tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:04:07.530520 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-6f99acba-fab0-46be-8f65-3488466c662a tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] [instance: 39dc4bb1-8465-4576-b490-d066c0fbb18f] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:04:07.537480 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-1eb1cedd-db7e-44ed-8259-b5def8d520fd tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "GET /compute/v2.1/servers/e5842070-d5a3-43f9-82f8-ebce4eaf5526" status: 200 len: 1530 microversion: 2.1 time: 0.716605 Oct 04 22:04:07.543450 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6f99acba-fab0-46be-8f65-3488466c662a tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:07.544434 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6f99acba-fab0-46be-8f65-3488466c662a tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:07.545208 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6f99acba-fab0-46be-8f65-3488466c662a tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:07.547871 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6f99acba-fab0-46be-8f65-3488466c662a tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:07.548578 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6f99acba-fab0-46be-8f65-3488466c662a tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:07.550036 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6f99acba-fab0-46be-8f65-3488466c662a tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:07.573304 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2199/4339] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:04:06 2022] GET /compute/v2.1/servers/e5842070-d5a3-43f9-82f8-ebce4eaf5526 => generated 1530 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:04:07.584572 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-5e1d9dcb-dd33-428e-9905-8bbb330f2fc2 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:04:07.590565 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-5e1d9dcb-dd33-428e-9905-8bbb330f2fc2 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] [instance: 879c8591-9e1e-42e8-bc3f-a435fd86caaf] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:04:07.619217 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5e1d9dcb-dd33-428e-9905-8bbb330f2fc2 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:07.621259 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5e1d9dcb-dd33-428e-9905-8bbb330f2fc2 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:07.621949 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5e1d9dcb-dd33-428e-9905-8bbb330f2fc2 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:07.623083 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5e1d9dcb-dd33-428e-9905-8bbb330f2fc2 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:07.642898 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5e1d9dcb-dd33-428e-9905-8bbb330f2fc2 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:07.645816 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5e1d9dcb-dd33-428e-9905-8bbb330f2fc2 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:07.646790 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6f99acba-fab0-46be-8f65-3488466c662a tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:07.651014 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6f99acba-fab0-46be-8f65-3488466c662a tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:07.652042 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6f99acba-fab0-46be-8f65-3488466c662a tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:07.653538 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.objects.instance [None req-6f99acba-fab0-46be-8f65-3488466c662a tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lazy-loading 'fault' on Instance uuid 39dc4bb1-8465-4576-b490-d066c0fbb18f {{(pid=134101) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 22:04:07.797450 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-6f99acba-fab0-46be-8f65-3488466c662a tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92894af6b8f74650ad7696e1f3ac375d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f24f86f0fc4a3ba09c2be55876c783', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:04:07.808706 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-6f99acba-fab0-46be-8f65-3488466c662a tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92894af6b8f74650ad7696e1f3ac375d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f24f86f0fc4a3ba09c2be55876c783', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:04:07.810998 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-6f99acba-fab0-46be-8f65-3488466c662a tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92894af6b8f74650ad7696e1f3ac375d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f24f86f0fc4a3ba09c2be55876c783', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:04:07.813529 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-6f99acba-fab0-46be-8f65-3488466c662a tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] 10.222.0.43 "GET /compute/v2.1/servers/39dc4bb1-8465-4576-b490-d066c0fbb18f" status: 200 len: 1409 microversion: 2.54 time: 0.287645 Oct 04 22:04:07.822252 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-5e1d9dcb-dd33-428e-9905-8bbb330f2fc2 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f46a71ea0ee4e45afaea7e38e8c0ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba14e6816284d9e89e22913643f4355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:04:07.830951 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2141/4340] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:04:07 2022] GET /compute/v2.1/servers/39dc4bb1-8465-4576-b490-d066c0fbb18f => generated 1409 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:04:07.833864 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-5e1d9dcb-dd33-428e-9905-8bbb330f2fc2 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] 10.222.0.43 "GET /compute/v2.1/servers/879c8591-9e1e-42e8-bc3f-a435fd86caaf" status: 200 len: 1475 microversion: 2.1 time: 0.259351 Oct 04 22:04:07.836061 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2200/4341] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:04:07 2022] GET /compute/v2.1/servers/879c8591-9e1e-42e8-bc3f-a435fd86caaf => generated 1475 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:04:08.209690 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-0b06e555-1ab5-46b1-93f5-ebb879a5ee19 req-c2591916-7bb8-4abe-a58c-421daf232f2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "879c8591-9e1e-42e8-bc3f-a435fd86caaf", "name": "network-vif-deleted", "tag": "37aaf4df-3249-45b9-9aad-48fecc563a6a"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:04:08.231395 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-0b06e555-1ab5-46b1-93f5-ebb879a5ee19 req-c2591916-7bb8-4abe-a58c-421daf232f2d service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:08.232295 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-0b06e555-1ab5-46b1-93f5-ebb879a5ee19 req-c2591916-7bb8-4abe-a58c-421daf232f2d service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:08.232295 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-0b06e555-1ab5-46b1-93f5-ebb879a5ee19 req-c2591916-7bb8-4abe-a58c-421daf232f2d service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:08.270193 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-0b06e555-1ab5-46b1-93f5-ebb879a5ee19 req-c2591916-7bb8-4abe-a58c-421daf232f2d service nova] Creating event network-vif-deleted:37aaf4df-3249-45b9-9aad-48fecc563a6a for instance 879c8591-9e1e-42e8-bc3f-a435fd86caaf on n-h1-860284-1 Oct 04 22:04:08.292252 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-0b06e555-1ab5-46b1-93f5-ebb879a5ee19 req-c2591916-7bb8-4abe-a58c-421daf232f2d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085258 Oct 04 22:04:08.296443 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2142/4342] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:04:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:04:08.311400 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-ac2f612e-ac89-453a-8b36-e162ab049916 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:04:08.313979 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-ac2f612e-ac89-453a-8b36-e162ab049916 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] [instance: 38ec68cd-0c1c-4f92-bb44-f6f6fb078b42] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:04:08.331410 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ac2f612e-ac89-453a-8b36-e162ab049916 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:08.332377 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ac2f612e-ac89-453a-8b36-e162ab049916 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:08.346732 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ac2f612e-ac89-453a-8b36-e162ab049916 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:08.346732 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ac2f612e-ac89-453a-8b36-e162ab049916 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:08.346732 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ac2f612e-ac89-453a-8b36-e162ab049916 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:08.346732 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ac2f612e-ac89-453a-8b36-e162ab049916 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:08.546500 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-ac2f612e-ac89-453a-8b36-e162ab049916 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973de86311b47e882de18efbcb3f67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e037651e3345a8b95ea528cae02c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:04:08.555699 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-ac2f612e-ac89-453a-8b36-e162ab049916 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] 10.222.0.43 "GET /compute/v2.1/servers/38ec68cd-0c1c-4f92-bb44-f6f6fb078b42" status: 200 len: 1283 microversion: 2.1 time: 0.250952 Oct 04 22:04:08.560020 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2201/4343] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:04:08 2022] GET /compute/v2.1/servers/38ec68cd-0c1c-4f92-bb44-f6f6fb078b42 => generated 1283 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:04:08.581738 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-d21e2bda-9740-46aa-89a1-3a284aa5aab4 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:04:08.582761 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-d21e2bda-9740-46aa-89a1-3a284aa5aab4 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: e5842070-d5a3-43f9-82f8-ebce4eaf5526] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:04:08.598505 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d21e2bda-9740-46aa-89a1-3a284aa5aab4 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:08.602127 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d21e2bda-9740-46aa-89a1-3a284aa5aab4 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:08.604262 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d21e2bda-9740-46aa-89a1-3a284aa5aab4 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:08.619127 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d21e2bda-9740-46aa-89a1-3a284aa5aab4 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:08.619792 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d21e2bda-9740-46aa-89a1-3a284aa5aab4 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:08.621484 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d21e2bda-9740-46aa-89a1-3a284aa5aab4 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:08.842004 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-70d5a654-ac77-413e-a060-9c70ba25c768 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:04:08.843960 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-70d5a654-ac77-413e-a060-9c70ba25c768 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] [instance: 39dc4bb1-8465-4576-b490-d066c0fbb18f] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:04:08.860185 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-70d5a654-ac77-413e-a060-9c70ba25c768 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:08.861266 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-70d5a654-ac77-413e-a060-9c70ba25c768 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:08.863203 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-70d5a654-ac77-413e-a060-9c70ba25c768 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:08.866855 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-70d5a654-ac77-413e-a060-9c70ba25c768 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:08.867634 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-70d5a654-ac77-413e-a060-9c70ba25c768 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:08.868809 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-70d5a654-ac77-413e-a060-9c70ba25c768 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:08.892306 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-d21e2bda-9740-46aa-89a1-3a284aa5aab4 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a1c8d841104bc9b6910bcc2c0e2bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe9283584fc4d90b0715216d867ea2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:04:08.907698 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-70d5a654-ac77-413e-a060-9c70ba25c768 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] HTTP exception thrown: Instance 39dc4bb1-8465-4576-b490-d066c0fbb18f could not be found. Oct 04 22:04:08.911209 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-70d5a654-ac77-413e-a060-9c70ba25c768 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Request method failure captured: Oct 04 22:04:08.911209 n-d-860284-1 devstack@n-api.service[134102]: request: GET /compute/v2.1/servers/39dc4bb1-8465-4576-b490-d066c0fbb18f HTTP/1.1 Oct 04 22:04:08.911209 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 22:04:08.911209 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 22:04:08.911209 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 22:04:08.911209 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 22:04:08.911209 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 22:04:08.911209 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 22:04:08.911209 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 22:04:08.911209 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 22:04:08.911209 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPK2jeDZA9noCD2ZO8iQR1knpBcf-MdEMAUS00b_LphbgmFbWQOJ0jJvPLW8qRF9vkUyOVg36YJBok2HxOXGtqabBVH7JbXTR_873znlP4sQgciLAgNK31rOuaTw6cVgDNSLfs9tEQvdWatM_PqyH6X-uCqeeimU5HTuwlsJ6Lh4ChPU Oct 04 22:04:08.911209 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 22:04:08.911209 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 22:04:08.911209 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 22:04:08.911209 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 22:04:08.911209 n-d-860284-1 devstack@n-api.service[134102]: X-Openstack-Nova-Api-Version: 2.54 Oct 04 22:04:08.911209 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 22:04:08.911209 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 22:04:08.911209 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: 53f24f86f0fc4a3ba09c2be55876c783 Oct 04 22:04:08.911209 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-ServerShowV254Test-810044425 Oct 04 22:04:08.911209 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 22:04:08.911209 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 22:04:08.911209 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/53f24f86f0fc4a3ba09c2be55876c783"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_53f24f86f0fc4a3ba09c2be55876c783", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/53f24f86f0fc4a3ba09c2be55876c783"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/53f24f86f0fc4a3ba09c2be55876c783"}]}] Oct 04 22:04:08.911209 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-ServerShowV254Test-810044425 Oct 04 22:04:08.911209 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: 53f24f86f0fc4a3ba09c2be55876c783 Oct 04 22:04:08.911209 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-ServerShowV254Test-810044425 Oct 04 22:04:08.911209 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-ServerShowV254Test-810044425-project Oct 04 22:04:08.911209 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 22:04:08.911209 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 22:04:08.911209 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: 92894af6b8f74650ad7696e1f3ac375d Oct 04 22:04:08.911209 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-ServerShowV254Test-810044425-project Oct 04 22:04:08.911209 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 22:04:08.911209 n-d-860284-1 devstack@n-api.service[134102]: exception: Instance 39dc4bb1-8465-4576-b490-d066c0fbb18f could not be found. Oct 04 22:04:08.911209 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': '39dc4bb1-8465-4576-b490-d066c0fbb18f'} Oct 04 22:04:08.911209 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:04:08.911209 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:04:08.911209 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:04:08.911209 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:04:08.911209 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:04:08.911209 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:04:08.911209 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:04:08.911209 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:04:08.911209 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:04:08.911209 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:04:08.911209 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 39dc4bb1-8465-4576-b490-d066c0fbb18f could not be found. Oct 04 22:04:08.911209 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:04:08.911209 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:04:08.911209 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:04:08.911209 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:04:08.911209 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:04:08.911209 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:04:08.911209 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:04:08.911209 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:04:08.911209 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:04:08.911209 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:04:08.911209 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:04:08.911209 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:04:08.911209 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:04:08.911209 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:04:08.911209 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:04:08.911209 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:04:08.911209 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39dc4bb1-8465-4576-b490-d066c0fbb18f could not be found. Oct 04 22:04:08.911209 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:04:08.911209 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:04:08.911209 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:04:08.916053 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:04:08.916053 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:04:08.916053 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:04:08.916053 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:04:08.916053 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:04:08.916053 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39dc4bb1-8465-4576-b490-d066c0fbb18f could not be found. Oct 04 22:04:08.916053 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:04:08.916053 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-70d5a654-ac77-413e-a060-9c70ba25c768 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] Returning 404 to user: Instance 39dc4bb1-8465-4576-b490-d066c0fbb18f could not be found. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:04:08.919257 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-70d5a654-ac77-413e-a060-9c70ba25c768 tempest-ServerShowV254Test-810044425 tempest-ServerShowV254Test-810044425-project] 10.222.0.43 "GET /compute/v2.1/servers/39dc4bb1-8465-4576-b490-d066c0fbb18f" status: 404 len: 111 microversion: 2.54 time: 0.079271 Oct 04 22:04:08.919894 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2202/4344] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:04:08 2022] GET /compute/v2.1/servers/39dc4bb1-8465-4576-b490-d066c0fbb18f => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 04 22:04:08.922282 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-d21e2bda-9740-46aa-89a1-3a284aa5aab4 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "GET /compute/v2.1/servers/e5842070-d5a3-43f9-82f8-ebce4eaf5526" status: 200 len: 1530 microversion: 2.1 time: 0.345622 Oct 04 22:04:08.933031 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-f74a7fa9-537d-4b76-898a-dcf626e0a780 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:04:08.937631 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-f74a7fa9-537d-4b76-898a-dcf626e0a780 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] [instance: 879c8591-9e1e-42e8-bc3f-a435fd86caaf] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:04:08.947182 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2143/4345] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:04:08 2022] GET /compute/v2.1/servers/e5842070-d5a3-43f9-82f8-ebce4eaf5526 => generated 1530 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:04:08.952499 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f74a7fa9-537d-4b76-898a-dcf626e0a780 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:08.953373 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f74a7fa9-537d-4b76-898a-dcf626e0a780 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:08.954038 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f74a7fa9-537d-4b76-898a-dcf626e0a780 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:08.955021 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f74a7fa9-537d-4b76-898a-dcf626e0a780 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:08.955721 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f74a7fa9-537d-4b76-898a-dcf626e0a780 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:08.956371 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f74a7fa9-537d-4b76-898a-dcf626e0a780 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:09.034725 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f74a7fa9-537d-4b76-898a-dcf626e0a780 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:09.035713 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f74a7fa9-537d-4b76-898a-dcf626e0a780 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:09.036373 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f74a7fa9-537d-4b76-898a-dcf626e0a780 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:09.038801 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.objects.instance [None req-f74a7fa9-537d-4b76-898a-dcf626e0a780 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lazy-loading 'fault' on Instance uuid 879c8591-9e1e-42e8-bc3f-a435fd86caaf {{(pid=134102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 22:04:09.212946 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-f74a7fa9-537d-4b76-898a-dcf626e0a780 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f46a71ea0ee4e45afaea7e38e8c0ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba14e6816284d9e89e22913643f4355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:04:09.224149 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-f74a7fa9-537d-4b76-898a-dcf626e0a780 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] 10.222.0.43 "GET /compute/v2.1/servers/879c8591-9e1e-42e8-bc3f-a435fd86caaf" status: 200 len: 1310 microversion: 2.1 time: 0.303140 Oct 04 22:04:09.228838 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2203/4346] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:04:08 2022] GET /compute/v2.1/servers/879c8591-9e1e-42e8-bc3f-a435fd86caaf => generated 1310 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:04:09.585163 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-a4a66b05-dca6-4119-9aef-d0f3cc3e2073 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:04:09.586219 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-a4a66b05-dca6-4119-9aef-d0f3cc3e2073 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] [instance: 38ec68cd-0c1c-4f92-bb44-f6f6fb078b42] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:04:09.596771 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a4a66b05-dca6-4119-9aef-d0f3cc3e2073 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:09.597276 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a4a66b05-dca6-4119-9aef-d0f3cc3e2073 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:09.598026 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a4a66b05-dca6-4119-9aef-d0f3cc3e2073 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:09.598981 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a4a66b05-dca6-4119-9aef-d0f3cc3e2073 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:09.599833 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a4a66b05-dca6-4119-9aef-d0f3cc3e2073 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:09.600554 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a4a66b05-dca6-4119-9aef-d0f3cc3e2073 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:09.950969 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-a4a66b05-dca6-4119-9aef-d0f3cc3e2073 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973de86311b47e882de18efbcb3f67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e037651e3345a8b95ea528cae02c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:04:09.959336 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-a4a66b05-dca6-4119-9aef-d0f3cc3e2073 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] 10.222.0.43 "GET /compute/v2.1/servers/38ec68cd-0c1c-4f92-bb44-f6f6fb078b42" status: 200 len: 1325 microversion: 2.1 time: 0.381684 Oct 04 22:04:09.984407 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-75ceb95b-0963-490c-b0f3-6eb87b0446c5 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:04:09.986642 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-75ceb95b-0963-490c-b0f3-6eb87b0446c5 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: e5842070-d5a3-43f9-82f8-ebce4eaf5526] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:04:09.991084 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2144/4347] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:04:09 2022] GET /compute/v2.1/servers/38ec68cd-0c1c-4f92-bb44-f6f6fb078b42 => generated 1325 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:04:09.997200 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-75ceb95b-0963-490c-b0f3-6eb87b0446c5 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:09.997820 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-75ceb95b-0963-490c-b0f3-6eb87b0446c5 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:09.998412 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-75ceb95b-0963-490c-b0f3-6eb87b0446c5 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:09.999502 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-75ceb95b-0963-490c-b0f3-6eb87b0446c5 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:10.000139 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-75ceb95b-0963-490c-b0f3-6eb87b0446c5 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:10.000664 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-75ceb95b-0963-490c-b0f3-6eb87b0446c5 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:10.258119 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e4f34ed0-8a3b-4c0a-88cf-c41e0077544a tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:04:10.258741 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-e4f34ed0-8a3b-4c0a-88cf-c41e0077544a tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] [instance: 879c8591-9e1e-42e8-bc3f-a435fd86caaf] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:04:10.266291 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e4f34ed0-8a3b-4c0a-88cf-c41e0077544a tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:10.267084 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e4f34ed0-8a3b-4c0a-88cf-c41e0077544a tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:10.267681 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e4f34ed0-8a3b-4c0a-88cf-c41e0077544a tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:10.268552 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e4f34ed0-8a3b-4c0a-88cf-c41e0077544a tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:10.269156 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e4f34ed0-8a3b-4c0a-88cf-c41e0077544a tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:10.269734 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e4f34ed0-8a3b-4c0a-88cf-c41e0077544a tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:10.289511 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-e4f34ed0-8a3b-4c0a-88cf-c41e0077544a tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] HTTP exception thrown: Instance 879c8591-9e1e-42e8-bc3f-a435fd86caaf could not be found. Oct 04 22:04:10.291551 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e4f34ed0-8a3b-4c0a-88cf-c41e0077544a tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Request method failure captured: Oct 04 22:04:10.291551 n-d-860284-1 devstack@n-api.service[134101]: request: GET /compute/v2.1/servers/879c8591-9e1e-42e8-bc3f-a435fd86caaf HTTP/1.1 Oct 04 22:04:10.291551 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 22:04:10.291551 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 22:04:10.291551 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 22:04:10.291551 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 22:04:10.291551 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 22:04:10.291551 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 22:04:10.291551 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 22:04:10.291551 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 22:04:10.291551 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPK2TTv3puhvLYJkkncg7oyfMvF803zm0axPVekf74VKvSSXRscmXC0gLlZAZ5Eeva5io0_Uu0A096p3ZwglukXdTKmIEOHcIj3oG6pczVaA7vmkBkE-XvUS2RL60Fx4CVvFtdtDE3vK2W9Q74LDgspkyDfBj5eKI6J9VNLC_mNcTwA4 Oct 04 22:04:10.291551 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 22:04:10.291551 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 22:04:10.291551 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 22:04:10.291551 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 22:04:10.291551 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 22:04:10.291551 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 22:04:10.291551 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: fba14e6816284d9e89e22913643f4355 Oct 04 22:04:10.291551 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-ListServerFiltersTestJSON-1700739940 Oct 04 22:04:10.291551 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 22:04:10.291551 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 22:04:10.291551 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/fba14e6816284d9e89e22913643f4355"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_fba14e6816284d9e89e22913643f4355", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/fba14e6816284d9e89e22913643f4355"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/fba14e6816284d9e89e22913643f4355"}]}] Oct 04 22:04:10.291551 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-ListServerFiltersTestJSON-1700739940 Oct 04 22:04:10.291551 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: fba14e6816284d9e89e22913643f4355 Oct 04 22:04:10.291551 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1700739940 Oct 04 22:04:10.291551 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-ListServerFiltersTestJSON-1700739940-project Oct 04 22:04:10.291551 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 22:04:10.291551 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 22:04:10.291551 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 9f46a71ea0ee4e45afaea7e38e8c0ddd Oct 04 22:04:10.291551 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-ListServerFiltersTestJSON-1700739940-project Oct 04 22:04:10.291551 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 22:04:10.291551 n-d-860284-1 devstack@n-api.service[134101]: exception: Instance 879c8591-9e1e-42e8-bc3f-a435fd86caaf could not be found. Oct 04 22:04:10.291551 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': '879c8591-9e1e-42e8-bc3f-a435fd86caaf'} Oct 04 22:04:10.291551 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:04:10.291551 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:04:10.291551 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:04:10.291551 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:04:10.291551 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:04:10.291551 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:04:10.291551 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:04:10.291551 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:04:10.291551 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:04:10.291551 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:04:10.291551 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 879c8591-9e1e-42e8-bc3f-a435fd86caaf could not be found. Oct 04 22:04:10.291551 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:04:10.291551 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:04:10.291551 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:04:10.291551 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:04:10.291551 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:04:10.291551 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:04:10.291551 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:04:10.291551 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:04:10.291551 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:04:10.291551 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:04:10.291551 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:04:10.291551 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:04:10.291551 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:04:10.291551 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:04:10.291551 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:04:10.291551 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:04:10.291551 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 879c8591-9e1e-42e8-bc3f-a435fd86caaf could not be found. Oct 04 22:04:10.291551 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:04:10.291551 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:04:10.291551 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:04:10.296235 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:04:10.296235 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:04:10.296235 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:04:10.296235 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:04:10.296235 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:04:10.296235 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 879c8591-9e1e-42e8-bc3f-a435fd86caaf could not be found. Oct 04 22:04:10.296235 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:04:10.296235 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e4f34ed0-8a3b-4c0a-88cf-c41e0077544a tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Returning 404 to user: Instance 879c8591-9e1e-42e8-bc3f-a435fd86caaf could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:04:10.296235 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-e4f34ed0-8a3b-4c0a-88cf-c41e0077544a tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] 10.222.0.43 "GET /compute/v2.1/servers/879c8591-9e1e-42e8-bc3f-a435fd86caaf" status: 404 len: 111 microversion: 2.1 time: 0.041988 Oct 04 22:04:10.299078 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2145/4348] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:04:10 2022] GET /compute/v2.1/servers/879c8591-9e1e-42e8-bc3f-a435fd86caaf => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 22:04:10.307552 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-07985980-6344-41a5-8aed-d0dd26881755 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:04:10.308063 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-07985980-6344-41a5-8aed-d0dd26881755 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] [instance: 27f6babc-9d2c-4ba8-8043-cd2d90f9ba7e] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:04:10.317039 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-07985980-6344-41a5-8aed-d0dd26881755 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:10.317540 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-07985980-6344-41a5-8aed-d0dd26881755 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:10.317986 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-07985980-6344-41a5-8aed-d0dd26881755 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:10.318925 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-07985980-6344-41a5-8aed-d0dd26881755 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:10.319559 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-07985980-6344-41a5-8aed-d0dd26881755 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:10.319997 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-07985980-6344-41a5-8aed-d0dd26881755 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:10.354008 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-07985980-6344-41a5-8aed-d0dd26881755 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] [instance: 27f6babc-9d2c-4ba8-8043-cd2d90f9ba7e] Going to try to terminate instance {{(pid=134101) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 22:04:10.381869 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:04:10.398404 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-75ceb95b-0963-490c-b0f3-6eb87b0446c5 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a1c8d841104bc9b6910bcc2c0e2bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe9283584fc4d90b0715216d867ea2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:04:10.407873 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-75ceb95b-0963-490c-b0f3-6eb87b0446c5 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "GET /compute/v2.1/servers/e5842070-d5a3-43f9-82f8-ebce4eaf5526" status: 200 len: 1530 microversion: 2.1 time: 0.437048 Oct 04 22:04:10.408473 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2204/4349] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:04:09 2022] GET /compute/v2.1/servers/e5842070-d5a3-43f9-82f8-ebce4eaf5526 => generated 1530 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:04:10.466929 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-07985980-6344-41a5-8aed-d0dd26881755 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] 10.222.0.43 "DELETE /compute/v2.1/servers/27f6babc-9d2c-4ba8-8043-cd2d90f9ba7e" status: 204 len: 0 microversion: 2.1 time: 0.165804 Oct 04 22:04:10.467656 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2146/4350] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 22:04:10 2022] DELETE /compute/v2.1/servers/27f6babc-9d2c-4ba8-8043-cd2d90f9ba7e => generated 0 bytes in 168 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 22:04:10.476441 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-7741237a-89e7-461c-91a0-a909acbc1776 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:04:10.477675 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-7741237a-89e7-461c-91a0-a909acbc1776 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] [instance: 27f6babc-9d2c-4ba8-8043-cd2d90f9ba7e] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:04:10.484383 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7741237a-89e7-461c-91a0-a909acbc1776 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:10.485155 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7741237a-89e7-461c-91a0-a909acbc1776 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:10.485935 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7741237a-89e7-461c-91a0-a909acbc1776 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:10.486900 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7741237a-89e7-461c-91a0-a909acbc1776 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:10.487791 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7741237a-89e7-461c-91a0-a909acbc1776 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:10.488243 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7741237a-89e7-461c-91a0-a909acbc1776 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:10.871809 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-7741237a-89e7-461c-91a0-a909acbc1776 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f46a71ea0ee4e45afaea7e38e8c0ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba14e6816284d9e89e22913643f4355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:04:10.882307 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-7741237a-89e7-461c-91a0-a909acbc1776 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] 10.222.0.43 "GET /compute/v2.1/servers/27f6babc-9d2c-4ba8-8043-cd2d90f9ba7e" status: 200 len: 1516 microversion: 2.1 time: 0.410195 Oct 04 22:04:10.883471 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2205/4351] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:04:10 2022] GET /compute/v2.1/servers/27f6babc-9d2c-4ba8-8043-cd2d90f9ba7e => generated 1516 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:04:10.988863 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-5c33921a-1ead-4284-ad98-b87f45459bea tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:04:10.989566 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-5c33921a-1ead-4284-ad98-b87f45459bea tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] [instance: 38ec68cd-0c1c-4f92-bb44-f6f6fb078b42] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:04:11.009315 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5c33921a-1ead-4284-ad98-b87f45459bea tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:11.010075 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5c33921a-1ead-4284-ad98-b87f45459bea tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:11.010720 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5c33921a-1ead-4284-ad98-b87f45459bea tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:11.011600 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5c33921a-1ead-4284-ad98-b87f45459bea tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:11.014024 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5c33921a-1ead-4284-ad98-b87f45459bea tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:11.014831 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5c33921a-1ead-4284-ad98-b87f45459bea tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:11.279377 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-7741237a-89e7-461c-91a0-a909acbc1776 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:04:11.280413 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-7741237a-89e7-461c-91a0-a909acbc1776 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] 10.222.0.43 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001416 Oct 04 22:04:11.280749 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2206/4352] 10.222.0.43 () {56 vars in 886 bytes} [Tue Oct 4 22:04:11 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 04 22:04:11.385416 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-5c33921a-1ead-4284-ad98-b87f45459bea tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973de86311b47e882de18efbcb3f67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e037651e3345a8b95ea528cae02c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:04:11.401990 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-5c33921a-1ead-4284-ad98-b87f45459bea tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] 10.222.0.43 "GET /compute/v2.1/servers/38ec68cd-0c1c-4f92-bb44-f6f6fb078b42" status: 200 len: 1325 microversion: 2.1 time: 0.416935 Oct 04 22:04:11.403917 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2147/4353] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:04:10 2022] GET /compute/v2.1/servers/38ec68cd-0c1c-4f92-bb44-f6f6fb078b42 => generated 1325 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:04:11.434055 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-3e315c80-44b6-4ec3-a45b-ba2f9c65c67f tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:04:11.434702 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-3e315c80-44b6-4ec3-a45b-ba2f9c65c67f tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: e5842070-d5a3-43f9-82f8-ebce4eaf5526] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:04:11.443503 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3e315c80-44b6-4ec3-a45b-ba2f9c65c67f tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:11.444760 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3e315c80-44b6-4ec3-a45b-ba2f9c65c67f tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:11.445446 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3e315c80-44b6-4ec3-a45b-ba2f9c65c67f tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:11.446030 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3e315c80-44b6-4ec3-a45b-ba2f9c65c67f tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:11.446532 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3e315c80-44b6-4ec3-a45b-ba2f9c65c67f tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:11.446971 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3e315c80-44b6-4ec3-a45b-ba2f9c65c67f tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:11.464922 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-a44ff628-7984-474d-93c5-9e0598efcdda req-259739bf-e045-4950-8814-50c902987b8b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38ec68cd-0c1c-4f92-bb44-f6f6fb078b42", "tag": "b891c80c-20f1-4ab6-8dec-a4169bd15c92"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:04:11.529856 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-a44ff628-7984-474d-93c5-9e0598efcdda req-259739bf-e045-4950-8814-50c902987b8b service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:11.531996 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-a44ff628-7984-474d-93c5-9e0598efcdda req-259739bf-e045-4950-8814-50c902987b8b service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:11.532756 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-a44ff628-7984-474d-93c5-9e0598efcdda req-259739bf-e045-4950-8814-50c902987b8b service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:11.564451 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-a44ff628-7984-474d-93c5-9e0598efcdda req-259739bf-e045-4950-8814-50c902987b8b service nova] Creating event network-changed:b891c80c-20f1-4ab6-8dec-a4169bd15c92 for instance 38ec68cd-0c1c-4f92-bb44-f6f6fb078b42 on n-h1-860284-1 Oct 04 22:04:11.581824 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-a44ff628-7984-474d-93c5-9e0598efcdda req-259739bf-e045-4950-8814-50c902987b8b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121535 Oct 04 22:04:11.582900 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2148/4354] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:04:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:04:11.778733 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-b59d4d88-4335-4622-a355-08f53166bbab req-8fe98c25-f1b6-440f-a4b9-3ebd680968e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5842070-d5a3-43f9-82f8-ebce4eaf5526", "name": "network-vif-plugged", "status": "completed", "tag": "cf72dec7-7df1-4b49-8368-50d5e80924eb"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:04:11.788130 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=6 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:04:11.800680 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-b59d4d88-4335-4622-a355-08f53166bbab req-8fe98c25-f1b6-440f-a4b9-3ebd680968e0 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:11.801171 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-b59d4d88-4335-4622-a355-08f53166bbab req-8fe98c25-f1b6-440f-a4b9-3ebd680968e0 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:11.801611 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-b59d4d88-4335-4622-a355-08f53166bbab req-8fe98c25-f1b6-440f-a4b9-3ebd680968e0 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:11.848956 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-b59d4d88-4335-4622-a355-08f53166bbab req-8fe98c25-f1b6-440f-a4b9-3ebd680968e0 service nova] Creating event network-vif-plugged:cf72dec7-7df1-4b49-8368-50d5e80924eb for instance e5842070-d5a3-43f9-82f8-ebce4eaf5526 on n-h2-860284-1 Oct 04 22:04:11.854600 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-3e315c80-44b6-4ec3-a45b-ba2f9c65c67f tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a1c8d841104bc9b6910bcc2c0e2bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe9283584fc4d90b0715216d867ea2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:04:11.872387 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-b59d4d88-4335-4622-a355-08f53166bbab req-8fe98c25-f1b6-440f-a4b9-3ebd680968e0 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097648 Oct 04 22:04:11.873361 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-3e315c80-44b6-4ec3-a45b-ba2f9c65c67f tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "GET /compute/v2.1/servers/e5842070-d5a3-43f9-82f8-ebce4eaf5526" status: 200 len: 1530 microversion: 2.1 time: 0.443386 Oct 04 22:04:11.875092 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2149/4355] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:04:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:04:11.880526 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2207/4356] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:04:11 2022] GET /compute/v2.1/servers/e5842070-d5a3-43f9-82f8-ebce4eaf5526 => generated 1530 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:04:11.908091 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-d718bf3f-15d8-442c-9900-e623f727e32c tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:04:11.908802 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-d718bf3f-15d8-442c-9900-e623f727e32c tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] [instance: 27f6babc-9d2c-4ba8-8043-cd2d90f9ba7e] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:04:11.924498 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d718bf3f-15d8-442c-9900-e623f727e32c tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:11.925007 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d718bf3f-15d8-442c-9900-e623f727e32c tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:11.925491 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d718bf3f-15d8-442c-9900-e623f727e32c tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:11.926208 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d718bf3f-15d8-442c-9900-e623f727e32c tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:11.926705 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d718bf3f-15d8-442c-9900-e623f727e32c tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:11.946590 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d718bf3f-15d8-442c-9900-e623f727e32c tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:12.351179 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-d718bf3f-15d8-442c-9900-e623f727e32c tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f46a71ea0ee4e45afaea7e38e8c0ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba14e6816284d9e89e22913643f4355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:04:12.365040 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-d718bf3f-15d8-442c-9900-e623f727e32c tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] 10.222.0.43 "GET /compute/v2.1/servers/27f6babc-9d2c-4ba8-8043-cd2d90f9ba7e" status: 200 len: 1516 microversion: 2.1 time: 0.462268 Oct 04 22:04:12.370766 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2150/4357] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:04:11 2022] GET /compute/v2.1/servers/27f6babc-9d2c-4ba8-8043-cd2d90f9ba7e => generated 1516 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:04:12.436699 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-3ab24754-bcd4-40ff-b447-64bcf9cc2265 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:04:12.437584 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-3ab24754-bcd4-40ff-b447-64bcf9cc2265 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] [instance: 38ec68cd-0c1c-4f92-bb44-f6f6fb078b42] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:04:12.470966 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3ab24754-bcd4-40ff-b447-64bcf9cc2265 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:12.472484 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3ab24754-bcd4-40ff-b447-64bcf9cc2265 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:12.473289 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3ab24754-bcd4-40ff-b447-64bcf9cc2265 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:12.474569 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3ab24754-bcd4-40ff-b447-64bcf9cc2265 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:12.475577 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3ab24754-bcd4-40ff-b447-64bcf9cc2265 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:12.476803 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3ab24754-bcd4-40ff-b447-64bcf9cc2265 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:12.780478 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-3ab24754-bcd4-40ff-b447-64bcf9cc2265 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973de86311b47e882de18efbcb3f67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e037651e3345a8b95ea528cae02c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:04:12.800089 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-3ab24754-bcd4-40ff-b447-64bcf9cc2265 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] 10.222.0.43 "GET /compute/v2.1/servers/38ec68cd-0c1c-4f92-bb44-f6f6fb078b42" status: 200 len: 1325 microversion: 2.1 time: 0.375394 Oct 04 22:04:12.806550 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2208/4358] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:04:12 2022] GET /compute/v2.1/servers/38ec68cd-0c1c-4f92-bb44-f6f6fb078b42 => generated 1325 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:04:12.903362 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-d4a34b83-f645-4113-8156-2430f8917322 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:04:12.904233 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-d4a34b83-f645-4113-8156-2430f8917322 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: e5842070-d5a3-43f9-82f8-ebce4eaf5526] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:04:12.911362 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d4a34b83-f645-4113-8156-2430f8917322 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:12.912342 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d4a34b83-f645-4113-8156-2430f8917322 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:12.913753 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d4a34b83-f645-4113-8156-2430f8917322 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:12.914781 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d4a34b83-f645-4113-8156-2430f8917322 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:12.915501 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d4a34b83-f645-4113-8156-2430f8917322 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:12.916161 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d4a34b83-f645-4113-8156-2430f8917322 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:13.368449 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-d4a34b83-f645-4113-8156-2430f8917322 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a1c8d841104bc9b6910bcc2c0e2bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe9283584fc4d90b0715216d867ea2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:04:13.389135 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-d4a34b83-f645-4113-8156-2430f8917322 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "GET /compute/v2.1/servers/e5842070-d5a3-43f9-82f8-ebce4eaf5526" status: 200 len: 1525 microversion: 2.1 time: 0.480758 Oct 04 22:04:13.394500 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2151/4359] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:04:12 2022] GET /compute/v2.1/servers/e5842070-d5a3-43f9-82f8-ebce4eaf5526 => generated 1525 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:04:13.397893 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-aecc0247-5295-4e4d-875c-fb6efe6cbc7b tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:04:13.399426 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-aecc0247-5295-4e4d-875c-fb6efe6cbc7b tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] [instance: 27f6babc-9d2c-4ba8-8043-cd2d90f9ba7e] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:04:13.416700 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-aecc0247-5295-4e4d-875c-fb6efe6cbc7b tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:13.420527 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-aecc0247-5295-4e4d-875c-fb6efe6cbc7b tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:13.421193 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-aecc0247-5295-4e4d-875c-fb6efe6cbc7b tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:13.425232 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-aecc0247-5295-4e4d-875c-fb6efe6cbc7b tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:13.428457 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-aecc0247-5295-4e4d-875c-fb6efe6cbc7b tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:13.429743 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-aecc0247-5295-4e4d-875c-fb6efe6cbc7b tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:13.833508 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-11c79d0a-3882-4397-842f-4b9b25fdeef4 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:04:13.834128 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-11c79d0a-3882-4397-842f-4b9b25fdeef4 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] [instance: 38ec68cd-0c1c-4f92-bb44-f6f6fb078b42] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:04:13.837347 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=12 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:04:13.858105 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-11c79d0a-3882-4397-842f-4b9b25fdeef4 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:13.858648 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-11c79d0a-3882-4397-842f-4b9b25fdeef4 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:13.859100 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-11c79d0a-3882-4397-842f-4b9b25fdeef4 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:13.859826 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-11c79d0a-3882-4397-842f-4b9b25fdeef4 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:13.860286 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-11c79d0a-3882-4397-842f-4b9b25fdeef4 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:13.860731 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-11c79d0a-3882-4397-842f-4b9b25fdeef4 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:13.926919 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-aecc0247-5295-4e4d-875c-fb6efe6cbc7b tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f46a71ea0ee4e45afaea7e38e8c0ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba14e6816284d9e89e22913643f4355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:04:13.940854 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=100 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:04:13.977814 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-aecc0247-5295-4e4d-875c-fb6efe6cbc7b tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] 10.222.0.43 "GET /compute/v2.1/servers/27f6babc-9d2c-4ba8-8043-cd2d90f9ba7e" status: 200 len: 1474 microversion: 2.1 time: 0.583451 Oct 04 22:04:13.987505 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2209/4360] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:04:13 2022] GET /compute/v2.1/servers/27f6babc-9d2c-4ba8-8043-cd2d90f9ba7e => generated 1474 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:04:14.341645 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell0:SELECT=8 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:04:14.453051 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-11c79d0a-3882-4397-842f-4b9b25fdeef4 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973de86311b47e882de18efbcb3f67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e037651e3345a8b95ea528cae02c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:04:14.465688 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-11c79d0a-3882-4397-842f-4b9b25fdeef4 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] 10.222.0.43 "GET /compute/v2.1/servers/38ec68cd-0c1c-4f92-bb44-f6f6fb078b42" status: 200 len: 1325 microversion: 2.1 time: 0.636208 Oct 04 22:04:14.468914 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2152/4361] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:04:13 2022] GET /compute/v2.1/servers/38ec68cd-0c1c-4f92-bb44-f6f6fb078b42 => generated 1325 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:04:14.486464 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-cf96a6c4-8193-43df-9d8d-507b95e4010d tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:04:14.487443 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-cf96a6c4-8193-43df-9d8d-507b95e4010d tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: e5842070-d5a3-43f9-82f8-ebce4eaf5526] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:04:14.509371 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cf96a6c4-8193-43df-9d8d-507b95e4010d tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:14.510836 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cf96a6c4-8193-43df-9d8d-507b95e4010d tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:14.511559 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cf96a6c4-8193-43df-9d8d-507b95e4010d tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:14.530342 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cf96a6c4-8193-43df-9d8d-507b95e4010d tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:14.548891 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cf96a6c4-8193-43df-9d8d-507b95e4010d tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:14.548891 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cf96a6c4-8193-43df-9d8d-507b95e4010d tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:14.706642 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell0:SELECT=8 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:04:14.731296 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-363016c8-f500-4d52-a7fe-4f061a81f75f req-3992c8e8-5bcb-49bf-a3f3-1c604fca1825 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27f6babc-9d2c-4ba8-8043-cd2d90f9ba7e", "name": "network-vif-deleted", "tag": "c6715c1a-cde4-4b82-ab5f-4aaead73c545"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:04:14.762614 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-363016c8-f500-4d52-a7fe-4f061a81f75f req-3992c8e8-5bcb-49bf-a3f3-1c604fca1825 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:14.768549 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-363016c8-f500-4d52-a7fe-4f061a81f75f req-3992c8e8-5bcb-49bf-a3f3-1c604fca1825 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:14.769591 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-363016c8-f500-4d52-a7fe-4f061a81f75f req-3992c8e8-5bcb-49bf-a3f3-1c604fca1825 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:14.811095 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-363016c8-f500-4d52-a7fe-4f061a81f75f req-3992c8e8-5bcb-49bf-a3f3-1c604fca1825 service nova] Creating event network-vif-deleted:c6715c1a-cde4-4b82-ab5f-4aaead73c545 for instance 27f6babc-9d2c-4ba8-8043-cd2d90f9ba7e on n-h2-860284-1 Oct 04 22:04:14.830074 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-363016c8-f500-4d52-a7fe-4f061a81f75f req-3992c8e8-5bcb-49bf-a3f3-1c604fca1825 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.840183 Oct 04 22:04:14.832806 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2210/4362] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:04:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:04:15.013512 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-834099ff-3201-4055-8caa-74e3d139054f tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:04:15.015082 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-834099ff-3201-4055-8caa-74e3d139054f tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] [instance: 27f6babc-9d2c-4ba8-8043-cd2d90f9ba7e] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:04:15.031718 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-834099ff-3201-4055-8caa-74e3d139054f tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:15.033862 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-834099ff-3201-4055-8caa-74e3d139054f tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:15.035940 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-834099ff-3201-4055-8caa-74e3d139054f tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:15.039019 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-834099ff-3201-4055-8caa-74e3d139054f tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:15.039637 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-834099ff-3201-4055-8caa-74e3d139054f tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:15.044480 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-834099ff-3201-4055-8caa-74e3d139054f tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:15.069110 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-834099ff-3201-4055-8caa-74e3d139054f tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] HTTP exception thrown: Instance 27f6babc-9d2c-4ba8-8043-cd2d90f9ba7e could not be found. Oct 04 22:04:15.071803 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-834099ff-3201-4055-8caa-74e3d139054f tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Request method failure captured: Oct 04 22:04:15.071803 n-d-860284-1 devstack@n-api.service[134102]: request: GET /compute/v2.1/servers/27f6babc-9d2c-4ba8-8043-cd2d90f9ba7e HTTP/1.1 Oct 04 22:04:15.071803 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 22:04:15.071803 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 22:04:15.071803 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 22:04:15.071803 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 22:04:15.071803 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 22:04:15.071803 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 22:04:15.071803 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 22:04:15.071803 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 22:04:15.071803 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPK2TTv3puhvLYJkkncg7oyfMvF803zm0axPVekf74VKvSSXRscmXC0gLlZAZ5Eeva5io0_Uu0A096p3ZwglukXdTKmIEOHcIj3oG6pczVaA7vmkBkE-XvUS2RL60Fx4CVvFtdtDE3vK2W9Q74LDgspkyDfBj5eKI6J9VNLC_mNcTwA4 Oct 04 22:04:15.071803 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 22:04:15.071803 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 22:04:15.071803 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 22:04:15.071803 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 22:04:15.071803 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 22:04:15.071803 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 22:04:15.071803 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: fba14e6816284d9e89e22913643f4355 Oct 04 22:04:15.071803 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-ListServerFiltersTestJSON-1700739940 Oct 04 22:04:15.071803 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 22:04:15.071803 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 22:04:15.071803 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/fba14e6816284d9e89e22913643f4355"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_fba14e6816284d9e89e22913643f4355", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/fba14e6816284d9e89e22913643f4355"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/fba14e6816284d9e89e22913643f4355"}]}] Oct 04 22:04:15.071803 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-ListServerFiltersTestJSON-1700739940 Oct 04 22:04:15.071803 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: fba14e6816284d9e89e22913643f4355 Oct 04 22:04:15.071803 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1700739940 Oct 04 22:04:15.071803 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-ListServerFiltersTestJSON-1700739940-project Oct 04 22:04:15.071803 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 22:04:15.071803 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 22:04:15.071803 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: 9f46a71ea0ee4e45afaea7e38e8c0ddd Oct 04 22:04:15.071803 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-ListServerFiltersTestJSON-1700739940-project Oct 04 22:04:15.071803 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 22:04:15.071803 n-d-860284-1 devstack@n-api.service[134102]: exception: Instance 27f6babc-9d2c-4ba8-8043-cd2d90f9ba7e could not be found. Oct 04 22:04:15.071803 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': '27f6babc-9d2c-4ba8-8043-cd2d90f9ba7e'} Oct 04 22:04:15.071803 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:04:15.071803 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:04:15.071803 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:04:15.071803 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:04:15.071803 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:04:15.071803 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:04:15.071803 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:04:15.071803 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:04:15.071803 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:04:15.071803 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:04:15.071803 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27f6babc-9d2c-4ba8-8043-cd2d90f9ba7e could not be found. Oct 04 22:04:15.071803 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:04:15.071803 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:04:15.071803 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:04:15.071803 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:04:15.071803 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:04:15.071803 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:04:15.071803 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:04:15.071803 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:04:15.071803 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:04:15.071803 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:04:15.071803 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:04:15.071803 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:04:15.071803 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:04:15.071803 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:04:15.071803 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:04:15.071803 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:04:15.071803 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27f6babc-9d2c-4ba8-8043-cd2d90f9ba7e could not be found. Oct 04 22:04:15.071803 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:04:15.071803 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:04:15.071803 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:04:15.076841 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:04:15.076841 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:04:15.076841 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:04:15.076841 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:04:15.076841 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:04:15.076841 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27f6babc-9d2c-4ba8-8043-cd2d90f9ba7e could not be found. Oct 04 22:04:15.076841 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:04:15.079198 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-834099ff-3201-4055-8caa-74e3d139054f tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Returning 404 to user: Instance 27f6babc-9d2c-4ba8-8043-cd2d90f9ba7e could not be found. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:04:15.080389 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-834099ff-3201-4055-8caa-74e3d139054f tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] 10.222.0.43 "GET /compute/v2.1/servers/27f6babc-9d2c-4ba8-8043-cd2d90f9ba7e" status: 404 len: 111 microversion: 2.1 time: 0.071566 Oct 04 22:04:15.081874 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2211/4363] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:04:15 2022] GET /compute/v2.1/servers/27f6babc-9d2c-4ba8-8043-cd2d90f9ba7e => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 22:04:15.099928 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-5c141b83-9550-4a40-967f-79f595154bf3 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:04:15.101329 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-5c141b83-9550-4a40-967f-79f595154bf3 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] [instance: 07e11885-b7b0-4ad1-bda6-a677b9aaf48d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:04:15.129154 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5c141b83-9550-4a40-967f-79f595154bf3 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:15.130078 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5c141b83-9550-4a40-967f-79f595154bf3 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:15.130999 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5c141b83-9550-4a40-967f-79f595154bf3 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:15.132610 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5c141b83-9550-4a40-967f-79f595154bf3 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:15.133141 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5c141b83-9550-4a40-967f-79f595154bf3 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:15.133720 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5c141b83-9550-4a40-967f-79f595154bf3 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:15.240671 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-5c141b83-9550-4a40-967f-79f595154bf3 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] [instance: 07e11885-b7b0-4ad1-bda6-a677b9aaf48d] Going to try to terminate instance {{(pid=134102) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 22:04:15.326915 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-cf96a6c4-8193-43df-9d8d-507b95e4010d tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a1c8d841104bc9b6910bcc2c0e2bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe9283584fc4d90b0715216d867ea2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:04:15.344252 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-cf96a6c4-8193-43df-9d8d-507b95e4010d tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "GET /compute/v2.1/servers/e5842070-d5a3-43f9-82f8-ebce4eaf5526" status: 200 len: 1525 microversion: 2.1 time: 0.871130 Oct 04 22:04:15.348953 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2153/4364] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:04:14 2022] GET /compute/v2.1/servers/e5842070-d5a3-43f9-82f8-ebce4eaf5526 => generated 1525 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:04:15.407751 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:04:15.449292 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-5c141b83-9550-4a40-967f-79f595154bf3 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] 10.222.0.43 "DELETE /compute/v2.1/servers/07e11885-b7b0-4ad1-bda6-a677b9aaf48d" status: 204 len: 0 microversion: 2.1 time: 0.360696 Oct 04 22:04:15.451332 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2212/4365] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 22:04:15 2022] DELETE /compute/v2.1/servers/07e11885-b7b0-4ad1-bda6-a677b9aaf48d => generated 0 bytes in 365 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 22:04:15.461293 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-cb0db720-3584-4049-bdc3-d0b60025f900 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:04:15.462666 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-cb0db720-3584-4049-bdc3-d0b60025f900 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] [instance: 07e11885-b7b0-4ad1-bda6-a677b9aaf48d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:04:15.476603 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cb0db720-3584-4049-bdc3-d0b60025f900 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:15.481280 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cb0db720-3584-4049-bdc3-d0b60025f900 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:15.482462 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cb0db720-3584-4049-bdc3-d0b60025f900 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:15.483564 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cb0db720-3584-4049-bdc3-d0b60025f900 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:15.484138 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cb0db720-3584-4049-bdc3-d0b60025f900 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:15.484682 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cb0db720-3584-4049-bdc3-d0b60025f900 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:15.497931 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-d797b289-7c86-43e1-956f-7100a829bf22 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:04:15.499107 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-d797b289-7c86-43e1-956f-7100a829bf22 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] [instance: 38ec68cd-0c1c-4f92-bb44-f6f6fb078b42] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:04:15.514386 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d797b289-7c86-43e1-956f-7100a829bf22 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:15.518963 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d797b289-7c86-43e1-956f-7100a829bf22 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:15.519521 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d797b289-7c86-43e1-956f-7100a829bf22 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:15.520756 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d797b289-7c86-43e1-956f-7100a829bf22 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:15.523280 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d797b289-7c86-43e1-956f-7100a829bf22 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:15.525363 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d797b289-7c86-43e1-956f-7100a829bf22 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:16.371123 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-cb0db720-3584-4049-bdc3-d0b60025f900 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f46a71ea0ee4e45afaea7e38e8c0ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba14e6816284d9e89e22913643f4355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:04:16.380839 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-cb0db720-3584-4049-bdc3-d0b60025f900 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] 10.222.0.43 "GET /compute/v2.1/servers/07e11885-b7b0-4ad1-bda6-a677b9aaf48d" status: 200 len: 1516 microversion: 2.1 time: 0.924853 Oct 04 22:04:16.400936 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2154/4366] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:04:15 2022] GET /compute/v2.1/servers/07e11885-b7b0-4ad1-bda6-a677b9aaf48d => generated 1516 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:04:16.406584 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-749e56a0-9e39-44e6-a581-7e899405453a tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:04:16.408726 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-749e56a0-9e39-44e6-a581-7e899405453a tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: e5842070-d5a3-43f9-82f8-ebce4eaf5526] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:04:16.416197 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-749e56a0-9e39-44e6-a581-7e899405453a tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:16.417133 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-749e56a0-9e39-44e6-a581-7e899405453a tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:16.418842 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-749e56a0-9e39-44e6-a581-7e899405453a tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:16.419929 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-749e56a0-9e39-44e6-a581-7e899405453a tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:16.420651 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-749e56a0-9e39-44e6-a581-7e899405453a tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:16.421304 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-749e56a0-9e39-44e6-a581-7e899405453a tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:16.543876 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-d797b289-7c86-43e1-956f-7100a829bf22 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973de86311b47e882de18efbcb3f67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e037651e3345a8b95ea528cae02c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:04:16.558208 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-d797b289-7c86-43e1-956f-7100a829bf22 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] 10.222.0.43 "GET /compute/v2.1/servers/38ec68cd-0c1c-4f92-bb44-f6f6fb078b42" status: 200 len: 1325 microversion: 2.1 time: 1.066707 Oct 04 22:04:16.561355 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2213/4367] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:04:15 2022] GET /compute/v2.1/servers/38ec68cd-0c1c-4f92-bb44-f6f6fb078b42 => generated 1325 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:04:16.861343 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-749e56a0-9e39-44e6-a581-7e899405453a tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a1c8d841104bc9b6910bcc2c0e2bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe9283584fc4d90b0715216d867ea2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:04:16.874079 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-749e56a0-9e39-44e6-a581-7e899405453a tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "GET /compute/v2.1/servers/e5842070-d5a3-43f9-82f8-ebce4eaf5526" status: 200 len: 1525 microversion: 2.1 time: 0.471609 Oct 04 22:04:16.876529 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2155/4368] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:04:16 2022] GET /compute/v2.1/servers/e5842070-d5a3-43f9-82f8-ebce4eaf5526 => generated 1525 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:04:17.407452 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-e9d485e6-53ed-4251-9718-f1c62a9ba506 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:04:17.408359 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-e9d485e6-53ed-4251-9718-f1c62a9ba506 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] [instance: 07e11885-b7b0-4ad1-bda6-a677b9aaf48d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:04:17.416153 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e9d485e6-53ed-4251-9718-f1c62a9ba506 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:17.416920 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e9d485e6-53ed-4251-9718-f1c62a9ba506 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:17.417554 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e9d485e6-53ed-4251-9718-f1c62a9ba506 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:17.418737 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e9d485e6-53ed-4251-9718-f1c62a9ba506 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:17.419388 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e9d485e6-53ed-4251-9718-f1c62a9ba506 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:17.420006 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e9d485e6-53ed-4251-9718-f1c62a9ba506 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:17.582165 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e70a635a-b066-43fc-95e0-116a8d1e60ce tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:04:17.590469 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-e70a635a-b066-43fc-95e0-116a8d1e60ce tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] [instance: 38ec68cd-0c1c-4f92-bb44-f6f6fb078b42] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:04:17.603559 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e70a635a-b066-43fc-95e0-116a8d1e60ce tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:17.605277 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e70a635a-b066-43fc-95e0-116a8d1e60ce tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:17.606039 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e70a635a-b066-43fc-95e0-116a8d1e60ce tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:17.615455 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e70a635a-b066-43fc-95e0-116a8d1e60ce tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:17.617041 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e70a635a-b066-43fc-95e0-116a8d1e60ce tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:17.618318 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e70a635a-b066-43fc-95e0-116a8d1e60ce tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:17.769183 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-e9d485e6-53ed-4251-9718-f1c62a9ba506 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f46a71ea0ee4e45afaea7e38e8c0ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba14e6816284d9e89e22913643f4355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:04:17.794347 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-e9d485e6-53ed-4251-9718-f1c62a9ba506 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] 10.222.0.43 "GET /compute/v2.1/servers/07e11885-b7b0-4ad1-bda6-a677b9aaf48d" status: 200 len: 1516 microversion: 2.1 time: 0.386814 Oct 04 22:04:17.795078 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2214/4369] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:04:17 2022] GET /compute/v2.1/servers/07e11885-b7b0-4ad1-bda6-a677b9aaf48d => generated 1516 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:04:17.904238 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-65fde80d-db0f-4b87-b511-b5ccebd311f8 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:04:17.904867 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-65fde80d-db0f-4b87-b511-b5ccebd311f8 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: e5842070-d5a3-43f9-82f8-ebce4eaf5526] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:04:17.932768 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-65fde80d-db0f-4b87-b511-b5ccebd311f8 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:17.933267 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-65fde80d-db0f-4b87-b511-b5ccebd311f8 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:17.933716 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-65fde80d-db0f-4b87-b511-b5ccebd311f8 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:17.934477 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-65fde80d-db0f-4b87-b511-b5ccebd311f8 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:17.934938 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-65fde80d-db0f-4b87-b511-b5ccebd311f8 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:17.941148 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-65fde80d-db0f-4b87-b511-b5ccebd311f8 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:18.407050 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-e70a635a-b066-43fc-95e0-116a8d1e60ce tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973de86311b47e882de18efbcb3f67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e037651e3345a8b95ea528cae02c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:04:18.423090 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-e70a635a-b066-43fc-95e0-116a8d1e60ce tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] 10.222.0.43 "GET /compute/v2.1/servers/38ec68cd-0c1c-4f92-bb44-f6f6fb078b42" status: 200 len: 1325 microversion: 2.1 time: 0.844846 Oct 04 22:04:18.439105 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2156/4370] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:04:17 2022] GET /compute/v2.1/servers/38ec68cd-0c1c-4f92-bb44-f6f6fb078b42 => generated 1325 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:04:18.443789 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-65fde80d-db0f-4b87-b511-b5ccebd311f8 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a1c8d841104bc9b6910bcc2c0e2bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe9283584fc4d90b0715216d867ea2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:04:18.454877 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-65fde80d-db0f-4b87-b511-b5ccebd311f8 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "GET /compute/v2.1/servers/e5842070-d5a3-43f9-82f8-ebce4eaf5526" status: 200 len: 1525 microversion: 2.1 time: 0.554473 Oct 04 22:04:18.465805 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2215/4371] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:04:17 2022] GET /compute/v2.1/servers/e5842070-d5a3-43f9-82f8-ebce4eaf5526 => generated 1525 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:04:18.755891 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-ef3f67bd-3896-4a23-8cca-265c5bb279bf req-2b5a08e5-89dc-478f-a124-5729867462f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07e11885-b7b0-4ad1-bda6-a677b9aaf48d", "name": "network-vif-deleted", "tag": "f61060d0-c909-46d7-9db6-37c2d7289758"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:04:18.778577 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-ef3f67bd-3896-4a23-8cca-265c5bb279bf req-2b5a08e5-89dc-478f-a124-5729867462f2 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:18.779995 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-ef3f67bd-3896-4a23-8cca-265c5bb279bf req-2b5a08e5-89dc-478f-a124-5729867462f2 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:18.780737 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-ef3f67bd-3896-4a23-8cca-265c5bb279bf req-2b5a08e5-89dc-478f-a124-5729867462f2 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:18.828672 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-7f44ee8e-4c8d-42e2-93a0-fb3489009794 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:04:18.829959 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-7f44ee8e-4c8d-42e2-93a0-fb3489009794 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] [instance: 07e11885-b7b0-4ad1-bda6-a677b9aaf48d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:04:18.844689 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7f44ee8e-4c8d-42e2-93a0-fb3489009794 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:18.847354 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7f44ee8e-4c8d-42e2-93a0-fb3489009794 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:18.851530 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7f44ee8e-4c8d-42e2-93a0-fb3489009794 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:18.854417 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7f44ee8e-4c8d-42e2-93a0-fb3489009794 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:18.855155 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7f44ee8e-4c8d-42e2-93a0-fb3489009794 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:18.869700 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-ef3f67bd-3896-4a23-8cca-265c5bb279bf req-2b5a08e5-89dc-478f-a124-5729867462f2 service nova] Creating event network-vif-deleted:f61060d0-c909-46d7-9db6-37c2d7289758 for instance 07e11885-b7b0-4ad1-bda6-a677b9aaf48d on n-h2-860284-1 Oct 04 22:04:18.872215 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7f44ee8e-4c8d-42e2-93a0-fb3489009794 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:18.900997 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-ef3f67bd-3896-4a23-8cca-265c5bb279bf req-2b5a08e5-89dc-478f-a124-5729867462f2 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.161216 Oct 04 22:04:18.912255 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2157/4372] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:04:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:04:18.979377 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7f44ee8e-4c8d-42e2-93a0-fb3489009794 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:18.980223 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7f44ee8e-4c8d-42e2-93a0-fb3489009794 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:18.980879 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7f44ee8e-4c8d-42e2-93a0-fb3489009794 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:18.984727 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.objects.instance [None req-7f44ee8e-4c8d-42e2-93a0-fb3489009794 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lazy-loading 'fault' on Instance uuid 07e11885-b7b0-4ad1-bda6-a677b9aaf48d {{(pid=134102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 22:04:19.218702 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-7f44ee8e-4c8d-42e2-93a0-fb3489009794 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f46a71ea0ee4e45afaea7e38e8c0ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba14e6816284d9e89e22913643f4355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:04:19.230658 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-a34ad166-f25c-4353-bc07-a350afba1ecf req-5f7bf1a7-d064-4bd4-913f-aa1d4e4b8201 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38ec68cd-0c1c-4f92-bb44-f6f6fb078b42", "name": "network-vif-plugged", "status": "completed", "tag": "b891c80c-20f1-4ab6-8dec-a4169bd15c92"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:04:19.231466 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-7f44ee8e-4c8d-42e2-93a0-fb3489009794 tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] 10.222.0.43 "GET /compute/v2.1/servers/07e11885-b7b0-4ad1-bda6-a677b9aaf48d" status: 200 len: 1310 microversion: 2.1 time: 0.407351 Oct 04 22:04:19.233006 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2216/4373] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:04:18 2022] GET /compute/v2.1/servers/07e11885-b7b0-4ad1-bda6-a677b9aaf48d => generated 1310 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:04:19.262710 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-a34ad166-f25c-4353-bc07-a350afba1ecf req-5f7bf1a7-d064-4bd4-913f-aa1d4e4b8201 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:19.263438 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-a34ad166-f25c-4353-bc07-a350afba1ecf req-5f7bf1a7-d064-4bd4-913f-aa1d4e4b8201 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:19.264039 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-a34ad166-f25c-4353-bc07-a350afba1ecf req-5f7bf1a7-d064-4bd4-913f-aa1d4e4b8201 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:19.277850 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-a34ad166-f25c-4353-bc07-a350afba1ecf req-5f7bf1a7-d064-4bd4-913f-aa1d4e4b8201 service nova] Creating event network-vif-plugged:b891c80c-20f1-4ab6-8dec-a4169bd15c92 for instance 38ec68cd-0c1c-4f92-bb44-f6f6fb078b42 on n-h1-860284-1 Oct 04 22:04:19.286993 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-a34ad166-f25c-4353-bc07-a350afba1ecf req-5f7bf1a7-d064-4bd4-913f-aa1d4e4b8201 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061707 Oct 04 22:04:19.288019 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2158/4374] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:04:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:04:19.451819 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-1731933f-5fd4-4cc7-ba1f-e535ad55d9db tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:04:19.452827 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-1731933f-5fd4-4cc7-ba1f-e535ad55d9db tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] [instance: 38ec68cd-0c1c-4f92-bb44-f6f6fb078b42] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:04:19.468725 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1731933f-5fd4-4cc7-ba1f-e535ad55d9db tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:19.469606 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1731933f-5fd4-4cc7-ba1f-e535ad55d9db tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:19.470395 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1731933f-5fd4-4cc7-ba1f-e535ad55d9db tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:19.471378 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1731933f-5fd4-4cc7-ba1f-e535ad55d9db tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:19.472839 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1731933f-5fd4-4cc7-ba1f-e535ad55d9db tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:19.476250 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1731933f-5fd4-4cc7-ba1f-e535ad55d9db tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:19.492377 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-ac42df04-8ff8-4a79-81a8-d33d64058916 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:04:19.494156 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-ac42df04-8ff8-4a79-81a8-d33d64058916 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: e5842070-d5a3-43f9-82f8-ebce4eaf5526] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:04:19.509288 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ac42df04-8ff8-4a79-81a8-d33d64058916 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:19.519578 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ac42df04-8ff8-4a79-81a8-d33d64058916 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:19.523483 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ac42df04-8ff8-4a79-81a8-d33d64058916 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:19.531392 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ac42df04-8ff8-4a79-81a8-d33d64058916 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:19.532483 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ac42df04-8ff8-4a79-81a8-d33d64058916 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:19.533491 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ac42df04-8ff8-4a79-81a8-d33d64058916 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:20.030426 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-1731933f-5fd4-4cc7-ba1f-e535ad55d9db tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973de86311b47e882de18efbcb3f67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e037651e3345a8b95ea528cae02c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:04:20.031570 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-ac42df04-8ff8-4a79-81a8-d33d64058916 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a1c8d841104bc9b6910bcc2c0e2bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe9283584fc4d90b0715216d867ea2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:04:20.038991 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-1731933f-5fd4-4cc7-ba1f-e535ad55d9db tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] 10.222.0.43 "GET /compute/v2.1/servers/38ec68cd-0c1c-4f92-bb44-f6f6fb078b42" status: 200 len: 1325 microversion: 2.1 time: 0.590639 Oct 04 22:04:20.060527 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2217/4375] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:04:19 2022] GET /compute/v2.1/servers/38ec68cd-0c1c-4f92-bb44-f6f6fb078b42 => generated 1325 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:04:20.068599 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-ac42df04-8ff8-4a79-81a8-d33d64058916 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "GET /compute/v2.1/servers/e5842070-d5a3-43f9-82f8-ebce4eaf5526" status: 200 len: 1525 microversion: 2.1 time: 0.581639 Oct 04 22:04:20.071534 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2159/4376] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:04:19 2022] GET /compute/v2.1/servers/e5842070-d5a3-43f9-82f8-ebce4eaf5526 => generated 1525 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:04:20.256701 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-ba58e5c9-67f4-488a-98c3-d19840b4e69c tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:04:20.257495 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-ba58e5c9-67f4-488a-98c3-d19840b4e69c tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] [instance: 07e11885-b7b0-4ad1-bda6-a677b9aaf48d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:04:20.273431 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ba58e5c9-67f4-488a-98c3-d19840b4e69c tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:20.273431 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ba58e5c9-67f4-488a-98c3-d19840b4e69c tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:20.273431 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ba58e5c9-67f4-488a-98c3-d19840b4e69c tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:20.274543 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ba58e5c9-67f4-488a-98c3-d19840b4e69c tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:20.275001 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ba58e5c9-67f4-488a-98c3-d19840b4e69c tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:20.275434 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ba58e5c9-67f4-488a-98c3-d19840b4e69c tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:20.306942 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-ba58e5c9-67f4-488a-98c3-d19840b4e69c tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] HTTP exception thrown: Instance 07e11885-b7b0-4ad1-bda6-a677b9aaf48d could not be found. Oct 04 22:04:20.309618 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-ba58e5c9-67f4-488a-98c3-d19840b4e69c tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Request method failure captured: Oct 04 22:04:20.309618 n-d-860284-1 devstack@n-api.service[134102]: request: GET /compute/v2.1/servers/07e11885-b7b0-4ad1-bda6-a677b9aaf48d HTTP/1.1 Oct 04 22:04:20.309618 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 22:04:20.309618 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 22:04:20.309618 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 22:04:20.309618 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 22:04:20.309618 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 22:04:20.309618 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 22:04:20.309618 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 22:04:20.309618 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 22:04:20.309618 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPK2TTv3puhvLYJkkncg7oyfMvF803zm0axPVekf74VKvSSXRscmXC0gLlZAZ5Eeva5io0_Uu0A096p3ZwglukXdTKmIEOHcIj3oG6pczVaA7vmkBkE-XvUS2RL60Fx4CVvFtdtDE3vK2W9Q74LDgspkyDfBj5eKI6J9VNLC_mNcTwA4 Oct 04 22:04:20.309618 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 22:04:20.309618 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 22:04:20.309618 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 22:04:20.309618 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 22:04:20.309618 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 22:04:20.309618 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 22:04:20.309618 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: fba14e6816284d9e89e22913643f4355 Oct 04 22:04:20.309618 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-ListServerFiltersTestJSON-1700739940 Oct 04 22:04:20.309618 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 22:04:20.309618 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 22:04:20.309618 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/fba14e6816284d9e89e22913643f4355"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_fba14e6816284d9e89e22913643f4355", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/fba14e6816284d9e89e22913643f4355"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/fba14e6816284d9e89e22913643f4355"}]}] Oct 04 22:04:20.309618 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-ListServerFiltersTestJSON-1700739940 Oct 04 22:04:20.309618 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: fba14e6816284d9e89e22913643f4355 Oct 04 22:04:20.309618 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1700739940 Oct 04 22:04:20.309618 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-ListServerFiltersTestJSON-1700739940-project Oct 04 22:04:20.309618 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 22:04:20.309618 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 22:04:20.309618 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: 9f46a71ea0ee4e45afaea7e38e8c0ddd Oct 04 22:04:20.309618 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-ListServerFiltersTestJSON-1700739940-project Oct 04 22:04:20.309618 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 22:04:20.309618 n-d-860284-1 devstack@n-api.service[134102]: exception: Instance 07e11885-b7b0-4ad1-bda6-a677b9aaf48d could not be found. Oct 04 22:04:20.309618 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': '07e11885-b7b0-4ad1-bda6-a677b9aaf48d'} Oct 04 22:04:20.309618 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:04:20.309618 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:04:20.309618 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:04:20.309618 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:04:20.309618 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:04:20.309618 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:04:20.309618 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:04:20.309618 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:04:20.309618 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:04:20.309618 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:04:20.309618 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 07e11885-b7b0-4ad1-bda6-a677b9aaf48d could not be found. Oct 04 22:04:20.309618 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:04:20.309618 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:04:20.309618 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:04:20.309618 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:04:20.309618 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:04:20.309618 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:04:20.309618 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:04:20.309618 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:04:20.309618 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:04:20.309618 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:04:20.309618 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:04:20.309618 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:04:20.309618 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:04:20.309618 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:04:20.309618 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:04:20.309618 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:04:20.309618 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 07e11885-b7b0-4ad1-bda6-a677b9aaf48d could not be found. Oct 04 22:04:20.309618 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:04:20.309618 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:04:20.309618 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:04:20.313486 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:04:20.313486 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:04:20.313486 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:04:20.313486 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:04:20.313486 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:04:20.313486 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 07e11885-b7b0-4ad1-bda6-a677b9aaf48d could not be found. Oct 04 22:04:20.313486 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:04:20.315382 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-ba58e5c9-67f4-488a-98c3-d19840b4e69c tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] Returning 404 to user: Instance 07e11885-b7b0-4ad1-bda6-a677b9aaf48d could not be found. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:04:20.316525 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-ba58e5c9-67f4-488a-98c3-d19840b4e69c tempest-ListServerFiltersTestJSON-1700739940 tempest-ListServerFiltersTestJSON-1700739940-project] 10.222.0.43 "GET /compute/v2.1/servers/07e11885-b7b0-4ad1-bda6-a677b9aaf48d" status: 404 len: 111 microversion: 2.1 time: 0.063850 Oct 04 22:04:20.317644 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2218/4377] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:04:20 2022] GET /compute/v2.1/servers/07e11885-b7b0-4ad1-bda6-a677b9aaf48d => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:04:21.062571 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-f07ebfcb-2fd4-4fb3-864f-9f9739bc2237 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:04:21.063188 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-f07ebfcb-2fd4-4fb3-864f-9f9739bc2237 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] [instance: 38ec68cd-0c1c-4f92-bb44-f6f6fb078b42] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:04:21.082085 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f07ebfcb-2fd4-4fb3-864f-9f9739bc2237 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:21.083175 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f07ebfcb-2fd4-4fb3-864f-9f9739bc2237 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:21.083848 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f07ebfcb-2fd4-4fb3-864f-9f9739bc2237 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:21.085381 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f07ebfcb-2fd4-4fb3-864f-9f9739bc2237 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:21.086070 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f07ebfcb-2fd4-4fb3-864f-9f9739bc2237 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:21.086751 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f07ebfcb-2fd4-4fb3-864f-9f9739bc2237 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:21.112325 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-39695c62-7cdf-41b3-9f3c-425dd5908817 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:04:21.113684 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-39695c62-7cdf-41b3-9f3c-425dd5908817 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: e5842070-d5a3-43f9-82f8-ebce4eaf5526] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:04:21.126893 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-39695c62-7cdf-41b3-9f3c-425dd5908817 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:21.127695 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-39695c62-7cdf-41b3-9f3c-425dd5908817 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:21.128376 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-39695c62-7cdf-41b3-9f3c-425dd5908817 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:21.145084 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-39695c62-7cdf-41b3-9f3c-425dd5908817 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:21.145827 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-39695c62-7cdf-41b3-9f3c-425dd5908817 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:21.146521 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-39695c62-7cdf-41b3-9f3c-425dd5908817 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:21.652062 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-f07ebfcb-2fd4-4fb3-864f-9f9739bc2237 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973de86311b47e882de18efbcb3f67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e037651e3345a8b95ea528cae02c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:04:21.683998 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-f07ebfcb-2fd4-4fb3-864f-9f9739bc2237 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] 10.222.0.43 "GET /compute/v2.1/servers/38ec68cd-0c1c-4f92-bb44-f6f6fb078b42" status: 200 len: 1325 microversion: 2.1 time: 0.626035 Oct 04 22:04:21.689970 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2160/4378] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:04:21 2022] GET /compute/v2.1/servers/38ec68cd-0c1c-4f92-bb44-f6f6fb078b42 => generated 1325 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:04:21.837985 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-39695c62-7cdf-41b3-9f3c-425dd5908817 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a1c8d841104bc9b6910bcc2c0e2bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe9283584fc4d90b0715216d867ea2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:04:21.846412 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-39695c62-7cdf-41b3-9f3c-425dd5908817 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "GET /compute/v2.1/servers/e5842070-d5a3-43f9-82f8-ebce4eaf5526" status: 200 len: 1525 microversion: 2.1 time: 0.737963 Oct 04 22:04:21.867312 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2219/4379] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:04:21 2022] GET /compute/v2.1/servers/e5842070-d5a3-43f9-82f8-ebce4eaf5526 => generated 1525 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:04:22.720426 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e7388555-4f8b-46fb-a7d1-5c3b6037cb41 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:04:22.721836 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-e7388555-4f8b-46fb-a7d1-5c3b6037cb41 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] [instance: 38ec68cd-0c1c-4f92-bb44-f6f6fb078b42] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:04:22.736823 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e7388555-4f8b-46fb-a7d1-5c3b6037cb41 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:22.740512 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e7388555-4f8b-46fb-a7d1-5c3b6037cb41 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:22.743224 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e7388555-4f8b-46fb-a7d1-5c3b6037cb41 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:22.746525 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e7388555-4f8b-46fb-a7d1-5c3b6037cb41 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:22.747454 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e7388555-4f8b-46fb-a7d1-5c3b6037cb41 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:22.748179 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e7388555-4f8b-46fb-a7d1-5c3b6037cb41 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:22.892530 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-2cd2fb2c-4878-48ad-8a83-a33c9e0e91fc tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:04:22.893677 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-2cd2fb2c-4878-48ad-8a83-a33c9e0e91fc tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: e5842070-d5a3-43f9-82f8-ebce4eaf5526] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:04:22.905515 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2cd2fb2c-4878-48ad-8a83-a33c9e0e91fc tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:22.914723 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2cd2fb2c-4878-48ad-8a83-a33c9e0e91fc tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:22.916462 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2cd2fb2c-4878-48ad-8a83-a33c9e0e91fc tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:22.918493 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2cd2fb2c-4878-48ad-8a83-a33c9e0e91fc tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:22.919404 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2cd2fb2c-4878-48ad-8a83-a33c9e0e91fc tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:22.923448 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2cd2fb2c-4878-48ad-8a83-a33c9e0e91fc tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:23.489629 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-2cd2fb2c-4878-48ad-8a83-a33c9e0e91fc tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a1c8d841104bc9b6910bcc2c0e2bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe9283584fc4d90b0715216d867ea2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:04:23.511946 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-2cd2fb2c-4878-48ad-8a83-a33c9e0e91fc tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "GET /compute/v2.1/servers/e5842070-d5a3-43f9-82f8-ebce4eaf5526" status: 200 len: 1525 microversion: 2.1 time: 0.624230 Oct 04 22:04:23.523303 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2220/4380] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:04:22 2022] GET /compute/v2.1/servers/e5842070-d5a3-43f9-82f8-ebce4eaf5526 => generated 1525 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:04:23.539770 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-e7388555-4f8b-46fb-a7d1-5c3b6037cb41 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973de86311b47e882de18efbcb3f67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e037651e3345a8b95ea528cae02c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:04:23.566286 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-e7388555-4f8b-46fb-a7d1-5c3b6037cb41 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] 10.222.0.43 "GET /compute/v2.1/servers/38ec68cd-0c1c-4f92-bb44-f6f6fb078b42" status: 200 len: 1522 microversion: 2.1 time: 0.857051 Oct 04 22:04:23.578394 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2161/4381] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:04:22 2022] GET /compute/v2.1/servers/38ec68cd-0c1c-4f92-bb44-f6f6fb078b42 => generated 1522 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:04:23.605556 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-187d364e-130a-4b83-b5f8-3a50bf20cd2c tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:04:23.606542 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-187d364e-130a-4b83-b5f8-3a50bf20cd2c tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] [instance: 38ec68cd-0c1c-4f92-bb44-f6f6fb078b42] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:04:23.637906 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-187d364e-130a-4b83-b5f8-3a50bf20cd2c tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:23.638678 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-187d364e-130a-4b83-b5f8-3a50bf20cd2c tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:23.639176 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-187d364e-130a-4b83-b5f8-3a50bf20cd2c tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:23.640034 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-187d364e-130a-4b83-b5f8-3a50bf20cd2c tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:23.640606 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-187d364e-130a-4b83-b5f8-3a50bf20cd2c tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:23.652826 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-187d364e-130a-4b83-b5f8-3a50bf20cd2c tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:24.340478 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-187d364e-130a-4b83-b5f8-3a50bf20cd2c tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973de86311b47e882de18efbcb3f67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e037651e3345a8b95ea528cae02c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:04:24.351270 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-187d364e-130a-4b83-b5f8-3a50bf20cd2c tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] 10.222.0.43 "GET /compute/v2.1/servers/38ec68cd-0c1c-4f92-bb44-f6f6fb078b42" status: 200 len: 1522 microversion: 2.1 time: 0.749189 Oct 04 22:04:24.352033 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2221/4382] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:04:23 2022] GET /compute/v2.1/servers/38ec68cd-0c1c-4f92-bb44-f6f6fb078b42 => generated 1522 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:04:24.376788 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-98122112-b487-4e68-abe5-85fc43ddf307 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-945987849"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:04:24.380702 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-98122112-b487-4e68-abe5-85fc43ddf307 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] [instance: 38ec68cd-0c1c-4f92-bb44-f6f6fb078b42] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:04:24.404211 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-98122112-b487-4e68-abe5-85fc43ddf307 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:24.404738 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-98122112-b487-4e68-abe5-85fc43ddf307 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:24.405168 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-98122112-b487-4e68-abe5-85fc43ddf307 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:24.419384 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-98122112-b487-4e68-abe5-85fc43ddf307 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:24.420196 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-98122112-b487-4e68-abe5-85fc43ddf307 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:24.420955 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-98122112-b487-4e68-abe5-85fc43ddf307 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:24.569216 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-75c8246b-3031-4988-8608-f69132f7baf6 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:04:24.570172 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-75c8246b-3031-4988-8608-f69132f7baf6 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: e5842070-d5a3-43f9-82f8-ebce4eaf5526] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:04:24.576754 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-75c8246b-3031-4988-8608-f69132f7baf6 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:24.577666 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-75c8246b-3031-4988-8608-f69132f7baf6 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:24.578318 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-75c8246b-3031-4988-8608-f69132f7baf6 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:24.579245 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-75c8246b-3031-4988-8608-f69132f7baf6 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:24.579867 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-75c8246b-3031-4988-8608-f69132f7baf6 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:24.580498 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-75c8246b-3031-4988-8608-f69132f7baf6 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:24.970502 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-98122112-b487-4e68-abe5-85fc43ddf307 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] 10.222.0.43 "POST /compute/v2.1/servers/38ec68cd-0c1c-4f92-bb44-f6f6fb078b42/action" status: 202 len: 0 microversion: 2.1 time: 0.596796 Oct 04 22:04:24.978140 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2162/4383] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 22:04:24 2022] POST /compute/v2.1/servers/38ec68cd-0c1c-4f92-bb44-f6f6fb078b42/action => generated 0 bytes in 606 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 04 22:04:24.984808 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-9a04cf6e-99eb-4be2-8115-79cac6a1c7da tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Calling method '.version_select at 0x7fbb2f00b790>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:04:25.063409 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-75c8246b-3031-4988-8608-f69132f7baf6 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a1c8d841104bc9b6910bcc2c0e2bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe9283584fc4d90b0715216d867ea2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:04:25.088295 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-75c8246b-3031-4988-8608-f69132f7baf6 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "GET /compute/v2.1/servers/e5842070-d5a3-43f9-82f8-ebce4eaf5526" status: 200 len: 1525 microversion: 2.1 time: 0.523599 Oct 04 22:04:25.113612 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2222/4384] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:04:24 2022] GET /compute/v2.1/servers/e5842070-d5a3-43f9-82f8-ebce4eaf5526 => generated 1525 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:04:25.324685 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-9a04cf6e-99eb-4be2-8115-79cac6a1c7da tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] 10.222.0.43 "DELETE /compute/v2.1/images/be62032a-0e01-4e9d-9f5a-3eb7f039329e" status: 204 len: 0 microversion: 2.1 time: 0.344725 Oct 04 22:04:25.325419 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2163/4385] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:04:24 2022] DELETE /compute/v2.1/images/be62032a-0e01-4e9d-9f5a-3eb7f039329e => generated 0 bytes in 347 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 22:04:25.337338 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-6b58a79d-0e6b-49ab-9a79-0a172fcfa49b tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Calling method '.version_select at 0x7fbb2f869e50>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:04:25.402978 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-6b58a79d-0e6b-49ab-9a79-0a172fcfa49b tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] HTTP exception thrown: Image not found. Oct 04 22:04:25.405276 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-6b58a79d-0e6b-49ab-9a79-0a172fcfa49b tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Request method failure captured: Oct 04 22:04:25.405276 n-d-860284-1 devstack@n-api.service[134102]: request: GET /compute/v2.1/images/be62032a-0e01-4e9d-9f5a-3eb7f039329e HTTP/1.1 Oct 04 22:04:25.405276 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 22:04:25.405276 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 22:04:25.405276 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 22:04:25.405276 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 22:04:25.405276 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 22:04:25.405276 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 22:04:25.405276 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 22:04:25.405276 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 22:04:25.405276 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPK2uaWdbUBgaC4RfPmjtTbjIfwc-i2umyIIBK_cF0D-_RCmikTip9FKSkMA-3LEgg0VpJcoPxMz4oo_myk5qoqg03ZgavcBoIAuumM_46SfpdfsovWLWxw7rAOFQTEcjFL3h_S0RmznoPUhj4-fuUVB2M5gfUS2qQyVeicBq2kx7daY Oct 04 22:04:25.405276 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 22:04:25.405276 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 22:04:25.405276 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 22:04:25.405276 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 22:04:25.405276 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 22:04:25.405276 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 22:04:25.405276 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: a1e037651e3345a8b95ea528cae02c9f Oct 04 22:04:25.405276 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-342298031 Oct 04 22:04:25.405276 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 22:04:25.405276 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 22:04:25.405276 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a1e037651e3345a8b95ea528cae02c9f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_a1e037651e3345a8b95ea528cae02c9f", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a1e037651e3345a8b95ea528cae02c9f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/a1e037651e3345a8b95ea528cae02c9f"}]}] Oct 04 22:04:25.405276 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-342298031 Oct 04 22:04:25.405276 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: a1e037651e3345a8b95ea528cae02c9f Oct 04 22:04:25.405276 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-342298031 Oct 04 22:04:25.405276 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-ImagesOneServerNegativeTestJSON-342298031-project Oct 04 22:04:25.405276 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 22:04:25.405276 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 22:04:25.405276 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: 9973de86311b47e882de18efbcb3f67f Oct 04 22:04:25.405276 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-342298031-project Oct 04 22:04:25.405276 n-d-860284-1 devstack@n-api.service[134102]: method: Oct 04 22:04:25.405276 n-d-860284-1 devstack@n-api.service[134102]: exception: Image not found. Oct 04 22:04:25.405276 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': 'be62032a-0e01-4e9d-9f5a-3eb7f039329e'} Oct 04 22:04:25.405276 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:04:25.405276 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:04:25.405276 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 22:04:25.405276 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 22:04:25.405276 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 22:04:25.405276 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 22:04:25.405276 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 22:04:25.405276 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 22:04:25.405276 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 22:04:25.405276 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 22:04:25.405276 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 22:04:25.405276 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 22:04:25.405276 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 22:04:25.405276 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 22:04:25.405276 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 22:04:25.405276 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 22:04:25.405276 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 22:04:25.405276 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 22:04:25.405276 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID be62032a-0e01-4e9d-9f5a-3eb7f039329e Oct 04 22:04:25.405276 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:04:25.405276 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:04:25.405276 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:04:25.405276 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:04:25.405276 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 04 22:04:25.405276 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 04 22:04:25.405276 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 04 22:04:25.405276 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 04 22:04:25.405276 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 04 22:04:25.405276 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 04 22:04:25.405276 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 04 22:04:25.415674 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 04 22:04:25.415674 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 22:04:25.415674 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 22:04:25.415674 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 22:04:25.415674 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 22:04:25.415674 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 22:04:25.415674 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 22:04:25.415674 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 22:04:25.415674 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 22:04:25.415674 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 22:04:25.415674 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 22:04:25.415674 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 22:04:25.415674 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 22:04:25.415674 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 22:04:25.415674 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 22:04:25.415674 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 22:04:25.415674 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 22:04:25.415674 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image be62032a-0e01-4e9d-9f5a-3eb7f039329e could not be found. Oct 04 22:04:25.415674 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:04:25.415674 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:04:25.415674 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:04:25.415674 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:04:25.415674 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:04:25.415674 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:04:25.415674 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:04:25.415674 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:04:25.415674 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 22:04:25.415674 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 22:04:25.415674 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:04:25.415674 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:04:25.415674 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 04 22:04:25.415674 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 22:04:25.415674 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 22:04:25.415674 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:04:25.415674 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:04:25.415674 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:04:25.415674 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:04:25.415674 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:04:25.415674 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:04:25.415674 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:04:25.415674 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:04:25.415674 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 22:04:25.415674 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:04:25.415674 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-6b58a79d-0e6b-49ab-9a79-0a172fcfa49b tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Returning 404 to user: Image not found. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:04:25.415674 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-6b58a79d-0e6b-49ab-9a79-0a172fcfa49b tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] 10.222.0.43 "GET /compute/v2.1/images/be62032a-0e01-4e9d-9f5a-3eb7f039329e" status: 404 len: 62 microversion: 2.1 time: 0.075363 Oct 04 22:04:25.415674 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2223/4386] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Oct 4 22:04:25 2022] GET /compute/v2.1/images/be62032a-0e01-4e9d-9f5a-3eb7f039329e => generated 62 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 22:04:25.425747 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-7d2869a5-2e40-43d3-853a-6378654b800c tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:04:25.425747 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-7d2869a5-2e40-43d3-853a-6378654b800c tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] [instance: 38ec68cd-0c1c-4f92-bb44-f6f6fb078b42] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:04:25.462846 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7d2869a5-2e40-43d3-853a-6378654b800c tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:25.464105 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7d2869a5-2e40-43d3-853a-6378654b800c tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:25.465763 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7d2869a5-2e40-43d3-853a-6378654b800c tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:25.468134 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7d2869a5-2e40-43d3-853a-6378654b800c tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:25.469555 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7d2869a5-2e40-43d3-853a-6378654b800c tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:25.471667 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7d2869a5-2e40-43d3-853a-6378654b800c tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:25.964097 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-7d2869a5-2e40-43d3-853a-6378654b800c tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973de86311b47e882de18efbcb3f67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e037651e3345a8b95ea528cae02c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:04:25.966697 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:04:25.981212 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-7d2869a5-2e40-43d3-853a-6378654b800c tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] 10.222.0.43 "GET /compute/v2.1/servers/38ec68cd-0c1c-4f92-bb44-f6f6fb078b42" status: 200 len: 1534 microversion: 2.1 time: 0.568507 Oct 04 22:04:25.982158 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2164/4387] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:04:25 2022] GET /compute/v2.1/servers/38ec68cd-0c1c-4f92-bb44-f6f6fb078b42 => generated 1534 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:04:26.075931 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-6f19e6c7-f64c-4d27-a035-b17ef82f9d7e tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:04:26.076531 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-6f19e6c7-f64c-4d27-a035-b17ef82f9d7e tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] [instance: 1475392a-475f-414f-803c-e89c9ae1844a] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:04:26.107668 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6f19e6c7-f64c-4d27-a035-b17ef82f9d7e tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:26.114099 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6f19e6c7-f64c-4d27-a035-b17ef82f9d7e tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:26.122045 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6f19e6c7-f64c-4d27-a035-b17ef82f9d7e tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:26.139201 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6f19e6c7-f64c-4d27-a035-b17ef82f9d7e tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:26.140428 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6f19e6c7-f64c-4d27-a035-b17ef82f9d7e tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:26.142912 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6f19e6c7-f64c-4d27-a035-b17ef82f9d7e tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:26.144352 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-0bfcd503-1267-4642-8dd9-065a9092f21a tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:04:26.145537 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-0bfcd503-1267-4642-8dd9-065a9092f21a tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: e5842070-d5a3-43f9-82f8-ebce4eaf5526] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:04:26.187124 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0bfcd503-1267-4642-8dd9-065a9092f21a tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:26.190210 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0bfcd503-1267-4642-8dd9-065a9092f21a tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:26.192128 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0bfcd503-1267-4642-8dd9-065a9092f21a tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:26.196857 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0bfcd503-1267-4642-8dd9-065a9092f21a tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:26.198208 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0bfcd503-1267-4642-8dd9-065a9092f21a tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:26.201026 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0bfcd503-1267-4642-8dd9-065a9092f21a tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:26.302630 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-6f19e6c7-f64c-4d27-a035-b17ef82f9d7e tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] 10.222.0.43 "GET /compute/v2.1/servers/1475392a-475f-414f-803c-e89c9ae1844a/ips" status: 200 len: 151 microversion: 2.1 time: 0.228580 Oct 04 22:04:26.303378 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2224/4388] 10.222.0.43 () {58 vars in 1248 bytes} [Tue Oct 4 22:04:26 2022] GET /compute/v2.1/servers/1475392a-475f-414f-803c-e89c9ae1844a/ips => generated 151 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:04:26.552071 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-0bfcd503-1267-4642-8dd9-065a9092f21a tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a1c8d841104bc9b6910bcc2c0e2bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe9283584fc4d90b0715216d867ea2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:04:26.571892 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-0bfcd503-1267-4642-8dd9-065a9092f21a tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "GET /compute/v2.1/servers/e5842070-d5a3-43f9-82f8-ebce4eaf5526" status: 200 len: 1525 microversion: 2.1 time: 0.433242 Oct 04 22:04:26.581258 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2165/4389] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:04:26 2022] GET /compute/v2.1/servers/e5842070-d5a3-43f9-82f8-ebce4eaf5526 => generated 1525 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:04:27.037388 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-0afd1f99-a277-4b68-8e02-823d1b5e6db4 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:04:27.041543 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-0afd1f99-a277-4b68-8e02-823d1b5e6db4 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] [instance: 38ec68cd-0c1c-4f92-bb44-f6f6fb078b42] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:04:27.076257 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0afd1f99-a277-4b68-8e02-823d1b5e6db4 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:27.078297 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0afd1f99-a277-4b68-8e02-823d1b5e6db4 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:27.079137 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0afd1f99-a277-4b68-8e02-823d1b5e6db4 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:27.080312 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0afd1f99-a277-4b68-8e02-823d1b5e6db4 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:27.085848 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0afd1f99-a277-4b68-8e02-823d1b5e6db4 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:27.098996 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0afd1f99-a277-4b68-8e02-823d1b5e6db4 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:27.613073 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-2d7000ab-b2f1-4b6d-b664-d95145360a29 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:04:27.615063 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-2d7000ab-b2f1-4b6d-b664-d95145360a29 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: e5842070-d5a3-43f9-82f8-ebce4eaf5526] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:04:27.628104 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2d7000ab-b2f1-4b6d-b664-d95145360a29 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:27.628984 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2d7000ab-b2f1-4b6d-b664-d95145360a29 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:27.634807 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2d7000ab-b2f1-4b6d-b664-d95145360a29 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:27.636969 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2d7000ab-b2f1-4b6d-b664-d95145360a29 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:27.638448 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2d7000ab-b2f1-4b6d-b664-d95145360a29 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:27.639382 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2d7000ab-b2f1-4b6d-b664-d95145360a29 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:27.733307 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-0afd1f99-a277-4b68-8e02-823d1b5e6db4 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973de86311b47e882de18efbcb3f67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e037651e3345a8b95ea528cae02c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:04:27.747264 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-0afd1f99-a277-4b68-8e02-823d1b5e6db4 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] 10.222.0.43 "GET /compute/v2.1/servers/38ec68cd-0c1c-4f92-bb44-f6f6fb078b42" status: 200 len: 1534 microversion: 2.1 time: 0.725830 Oct 04 22:04:27.750601 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2225/4390] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:04:27 2022] GET /compute/v2.1/servers/38ec68cd-0c1c-4f92-bb44-f6f6fb078b42 => generated 1534 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:04:28.285024 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-2d7000ab-b2f1-4b6d-b664-d95145360a29 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a1c8d841104bc9b6910bcc2c0e2bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe9283584fc4d90b0715216d867ea2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:04:28.329913 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-2d7000ab-b2f1-4b6d-b664-d95145360a29 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "GET /compute/v2.1/servers/e5842070-d5a3-43f9-82f8-ebce4eaf5526" status: 200 len: 1525 microversion: 2.1 time: 0.722626 Oct 04 22:04:28.340025 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2166/4391] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:04:27 2022] GET /compute/v2.1/servers/e5842070-d5a3-43f9-82f8-ebce4eaf5526 => generated 1525 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:04:28.782993 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-43124920-0045-4283-beae-f9168e52498d tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:04:28.783770 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-43124920-0045-4283-beae-f9168e52498d tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] [instance: 38ec68cd-0c1c-4f92-bb44-f6f6fb078b42] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:04:28.801447 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-43124920-0045-4283-beae-f9168e52498d tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:28.805663 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-43124920-0045-4283-beae-f9168e52498d tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:28.806344 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-43124920-0045-4283-beae-f9168e52498d tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:28.807233 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-43124920-0045-4283-beae-f9168e52498d tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:28.807940 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-43124920-0045-4283-beae-f9168e52498d tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:28.809369 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-43124920-0045-4283-beae-f9168e52498d tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:29.405738 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-5f2b1344-18e2-4e31-9cf8-23181192df43 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:04:29.422203 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-5f2b1344-18e2-4e31-9cf8-23181192df43 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: e5842070-d5a3-43f9-82f8-ebce4eaf5526] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:04:29.464089 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5f2b1344-18e2-4e31-9cf8-23181192df43 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:29.464603 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5f2b1344-18e2-4e31-9cf8-23181192df43 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:29.467038 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5f2b1344-18e2-4e31-9cf8-23181192df43 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:29.470643 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5f2b1344-18e2-4e31-9cf8-23181192df43 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:29.471097 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5f2b1344-18e2-4e31-9cf8-23181192df43 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:29.471720 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5f2b1344-18e2-4e31-9cf8-23181192df43 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:29.752728 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-43124920-0045-4283-beae-f9168e52498d tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973de86311b47e882de18efbcb3f67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e037651e3345a8b95ea528cae02c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:04:29.761594 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-43124920-0045-4283-beae-f9168e52498d tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] 10.222.0.43 "GET /compute/v2.1/servers/38ec68cd-0c1c-4f92-bb44-f6f6fb078b42" status: 200 len: 1540 microversion: 2.1 time: 0.986180 Oct 04 22:04:29.770526 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2226/4392] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:04:28 2022] GET /compute/v2.1/servers/38ec68cd-0c1c-4f92-bb44-f6f6fb078b42 => generated 1540 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:04:30.028868 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-5f2b1344-18e2-4e31-9cf8-23181192df43 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a1c8d841104bc9b6910bcc2c0e2bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe9283584fc4d90b0715216d867ea2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:04:30.038519 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-5f2b1344-18e2-4e31-9cf8-23181192df43 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "GET /compute/v2.1/servers/e5842070-d5a3-43f9-82f8-ebce4eaf5526" status: 200 len: 1525 microversion: 2.1 time: 0.665695 Oct 04 22:04:30.042013 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2167/4393] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:04:29 2022] GET /compute/v2.1/servers/e5842070-d5a3-43f9-82f8-ebce4eaf5526 => generated 1525 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:04:30.797271 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-af964192-b50a-421d-b7f4-8bfa1a8df899 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:04:30.801417 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-af964192-b50a-421d-b7f4-8bfa1a8df899 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] [instance: 38ec68cd-0c1c-4f92-bb44-f6f6fb078b42] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:04:30.873032 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-af964192-b50a-421d-b7f4-8bfa1a8df899 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:30.873539 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-af964192-b50a-421d-b7f4-8bfa1a8df899 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:30.873982 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-af964192-b50a-421d-b7f4-8bfa1a8df899 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:30.874728 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-af964192-b50a-421d-b7f4-8bfa1a8df899 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:30.875180 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-af964192-b50a-421d-b7f4-8bfa1a8df899 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:30.889726 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-af964192-b50a-421d-b7f4-8bfa1a8df899 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:30.998066 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-b1dca6b7-b6a3-4eac-ad59-66a065a1b9f6 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d08ec112-2c00-4842-92cc-46ecee83c686"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:04:31.001265 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-b1dca6b7-b6a3-4eac-ad59-66a065a1b9f6 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] [instance: 1475392a-475f-414f-803c-e89c9ae1844a] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:04:31.015537 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b1dca6b7-b6a3-4eac-ad59-66a065a1b9f6 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:31.019214 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b1dca6b7-b6a3-4eac-ad59-66a065a1b9f6 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:31.020370 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b1dca6b7-b6a3-4eac-ad59-66a065a1b9f6 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:31.024019 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b1dca6b7-b6a3-4eac-ad59-66a065a1b9f6 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:31.024704 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b1dca6b7-b6a3-4eac-ad59-66a065a1b9f6 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:31.025319 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b1dca6b7-b6a3-4eac-ad59-66a065a1b9f6 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:31.671707 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-af964192-b50a-421d-b7f4-8bfa1a8df899 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973de86311b47e882de18efbcb3f67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e037651e3345a8b95ea528cae02c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:04:31.674560 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:04:31.701557 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-b1dca6b7-b6a3-4eac-ad59-66a065a1b9f6 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] 10.222.0.43 "POST /compute/v2.1/servers/1475392a-475f-414f-803c-e89c9ae1844a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.701383 Oct 04 22:04:31.707975 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2168/4394] 10.222.0.43 () {60 vars in 1323 bytes} [Tue Oct 4 22:04:30 2022] POST /compute/v2.1/servers/1475392a-475f-414f-803c-e89c9ae1844a/os-volume_attachments => generated 194 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:04:31.709267 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-af964192-b50a-421d-b7f4-8bfa1a8df899 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] 10.222.0.43 "GET /compute/v2.1/servers/38ec68cd-0c1c-4f92-bb44-f6f6fb078b42" status: 200 len: 1540 microversion: 2.1 time: 0.922729 Oct 04 22:04:31.738389 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2227/4395] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:04:30 2022] GET /compute/v2.1/servers/38ec68cd-0c1c-4f92-bb44-f6f6fb078b42 => generated 1540 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:04:31.760051 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-288f1df7-a811-49e3-9dcb-77f00ed06ed3 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:04:31.773876 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-288f1df7-a811-49e3-9dcb-77f00ed06ed3 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: e5842070-d5a3-43f9-82f8-ebce4eaf5526] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:04:31.799462 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:04:31.810094 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-288f1df7-a811-49e3-9dcb-77f00ed06ed3 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:31.811796 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-288f1df7-a811-49e3-9dcb-77f00ed06ed3 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:31.815743 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-288f1df7-a811-49e3-9dcb-77f00ed06ed3 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:31.820774 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-288f1df7-a811-49e3-9dcb-77f00ed06ed3 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:31.822029 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-288f1df7-a811-49e3-9dcb-77f00ed06ed3 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:31.823863 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-288f1df7-a811-49e3-9dcb-77f00ed06ed3 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:32.338958 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-288f1df7-a811-49e3-9dcb-77f00ed06ed3 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a1c8d841104bc9b6910bcc2c0e2bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe9283584fc4d90b0715216d867ea2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:04:32.352493 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-288f1df7-a811-49e3-9dcb-77f00ed06ed3 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "GET /compute/v2.1/servers/e5842070-d5a3-43f9-82f8-ebce4eaf5526" status: 200 len: 1525 microversion: 2.1 time: 0.622671 Oct 04 22:04:32.355079 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2169/4396] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:04:31 2022] GET /compute/v2.1/servers/e5842070-d5a3-43f9-82f8-ebce4eaf5526 => generated 1525 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:04:32.766337 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-2f65d024-5d42-49ba-8338-49dfcd29b754 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:04:32.767178 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-2f65d024-5d42-49ba-8338-49dfcd29b754 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] [instance: 38ec68cd-0c1c-4f92-bb44-f6f6fb078b42] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:04:32.812792 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2f65d024-5d42-49ba-8338-49dfcd29b754 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:32.813225 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2f65d024-5d42-49ba-8338-49dfcd29b754 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:32.813680 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2f65d024-5d42-49ba-8338-49dfcd29b754 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:32.822087 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2f65d024-5d42-49ba-8338-49dfcd29b754 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:32.822681 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2f65d024-5d42-49ba-8338-49dfcd29b754 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:32.823165 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2f65d024-5d42-49ba-8338-49dfcd29b754 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:33.291505 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-2f65d024-5d42-49ba-8338-49dfcd29b754 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973de86311b47e882de18efbcb3f67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e037651e3345a8b95ea528cae02c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:04:33.316437 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-2f65d024-5d42-49ba-8338-49dfcd29b754 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] 10.222.0.43 "GET /compute/v2.1/servers/38ec68cd-0c1c-4f92-bb44-f6f6fb078b42" status: 200 len: 1522 microversion: 2.1 time: 0.557683 Oct 04 22:04:33.326402 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2228/4397] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:04:32 2022] GET /compute/v2.1/servers/38ec68cd-0c1c-4f92-bb44-f6f6fb078b42 => generated 1522 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:04:33.344734 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-af33bb78-b752-4423-a5b1-995a7bb838cd tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:04:33.345904 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-af33bb78-b752-4423-a5b1-995a7bb838cd tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] [instance: 38ec68cd-0c1c-4f92-bb44-f6f6fb078b42] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:04:33.369592 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-af33bb78-b752-4423-a5b1-995a7bb838cd tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:33.370101 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-af33bb78-b752-4423-a5b1-995a7bb838cd tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:33.376242 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-af33bb78-b752-4423-a5b1-995a7bb838cd tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:33.377120 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-af33bb78-b752-4423-a5b1-995a7bb838cd tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:33.377613 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-af33bb78-b752-4423-a5b1-995a7bb838cd tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:33.378058 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-af33bb78-b752-4423-a5b1-995a7bb838cd tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:33.381020 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-96e0453a-6e9d-4d6c-995d-4c9dabbf0dbb tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:04:33.382789 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-96e0453a-6e9d-4d6c-995d-4c9dabbf0dbb tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: e5842070-d5a3-43f9-82f8-ebce4eaf5526] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:04:33.400671 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-96e0453a-6e9d-4d6c-995d-4c9dabbf0dbb tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:33.401175 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-96e0453a-6e9d-4d6c-995d-4c9dabbf0dbb tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:33.401614 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-96e0453a-6e9d-4d6c-995d-4c9dabbf0dbb tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:33.402727 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-96e0453a-6e9d-4d6c-995d-4c9dabbf0dbb tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:33.403219 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-96e0453a-6e9d-4d6c-995d-4c9dabbf0dbb tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:33.403654 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-96e0453a-6e9d-4d6c-995d-4c9dabbf0dbb tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:33.453091 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-af33bb78-b752-4423-a5b1-995a7bb838cd tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] [instance: 38ec68cd-0c1c-4f92-bb44-f6f6fb078b42] Going to try to terminate instance {{(pid=134101) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 22:04:33.728445 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-af33bb78-b752-4423-a5b1-995a7bb838cd tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] 10.222.0.43 "DELETE /compute/v2.1/servers/38ec68cd-0c1c-4f92-bb44-f6f6fb078b42" status: 204 len: 0 microversion: 2.1 time: 0.385702 Oct 04 22:04:33.736499 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2170/4398] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 22:04:33 2022] DELETE /compute/v2.1/servers/38ec68cd-0c1c-4f92-bb44-f6f6fb078b42 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 22:04:33.765992 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-1bfad04c-f840-4ba6-b4d9-d7375b903988 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:04:33.769856 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-1bfad04c-f840-4ba6-b4d9-d7375b903988 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] [instance: 38ec68cd-0c1c-4f92-bb44-f6f6fb078b42] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:04:33.784500 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-96e0453a-6e9d-4d6c-995d-4c9dabbf0dbb tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a1c8d841104bc9b6910bcc2c0e2bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe9283584fc4d90b0715216d867ea2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:04:33.791769 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1bfad04c-f840-4ba6-b4d9-d7375b903988 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:33.794247 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1bfad04c-f840-4ba6-b4d9-d7375b903988 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:33.795013 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-96e0453a-6e9d-4d6c-995d-4c9dabbf0dbb tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "GET /compute/v2.1/servers/e5842070-d5a3-43f9-82f8-ebce4eaf5526" status: 200 len: 1525 microversion: 2.1 time: 0.417786 Oct 04 22:04:33.795329 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1bfad04c-f840-4ba6-b4d9-d7375b903988 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:33.795947 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2229/4399] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:04:33 2022] GET /compute/v2.1/servers/e5842070-d5a3-43f9-82f8-ebce4eaf5526 => generated 1525 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:04:33.796722 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1bfad04c-f840-4ba6-b4d9-d7375b903988 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:33.797597 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1bfad04c-f840-4ba6-b4d9-d7375b903988 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:33.798552 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1bfad04c-f840-4ba6-b4d9-d7375b903988 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:34.152645 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-1bfad04c-f840-4ba6-b4d9-d7375b903988 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973de86311b47e882de18efbcb3f67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e037651e3345a8b95ea528cae02c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:04:34.164892 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-1bfad04c-f840-4ba6-b4d9-d7375b903988 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] 10.222.0.43 "GET /compute/v2.1/servers/38ec68cd-0c1c-4f92-bb44-f6f6fb078b42" status: 200 len: 1528 microversion: 2.1 time: 0.422426 Oct 04 22:04:34.170479 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2171/4400] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:04:33 2022] GET /compute/v2.1/servers/38ec68cd-0c1c-4f92-bb44-f6f6fb078b42 => generated 1528 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:04:34.409259 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-cf675702-2c72-42db-892a-6eb677ab4e73 req-0aaaf11a-f9d1-42d0-b666-3b60e7017fab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38ec68cd-0c1c-4f92-bb44-f6f6fb078b42", "name": "network-vif-plugged", "status": "completed", "tag": "b891c80c-20f1-4ab6-8dec-a4169bd15c92"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:04:34.432371 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-cf675702-2c72-42db-892a-6eb677ab4e73 req-0aaaf11a-f9d1-42d0-b666-3b60e7017fab service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:34.433270 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-cf675702-2c72-42db-892a-6eb677ab4e73 req-0aaaf11a-f9d1-42d0-b666-3b60e7017fab service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:34.434774 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-cf675702-2c72-42db-892a-6eb677ab4e73 req-0aaaf11a-f9d1-42d0-b666-3b60e7017fab service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:34.488772 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-cf675702-2c72-42db-892a-6eb677ab4e73 req-0aaaf11a-f9d1-42d0-b666-3b60e7017fab service nova] Creating event network-vif-plugged:b891c80c-20f1-4ab6-8dec-a4169bd15c92 for instance 38ec68cd-0c1c-4f92-bb44-f6f6fb078b42 on n-h1-860284-1 Oct 04 22:04:34.508889 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-cf675702-2c72-42db-892a-6eb677ab4e73 req-0aaaf11a-f9d1-42d0-b666-3b60e7017fab service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.575973 Oct 04 22:04:34.513363 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2230/4401] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:04:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:04:34.828878 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-c042322f-f7e1-4c70-9238-e5234b94a56e tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:04:34.830235 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-c042322f-f7e1-4c70-9238-e5234b94a56e tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: e5842070-d5a3-43f9-82f8-ebce4eaf5526] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:04:34.847285 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c042322f-f7e1-4c70-9238-e5234b94a56e tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:34.848061 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c042322f-f7e1-4c70-9238-e5234b94a56e tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:34.848774 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c042322f-f7e1-4c70-9238-e5234b94a56e tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:34.851736 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c042322f-f7e1-4c70-9238-e5234b94a56e tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:34.852677 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c042322f-f7e1-4c70-9238-e5234b94a56e tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:34.854475 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c042322f-f7e1-4c70-9238-e5234b94a56e tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:35.199553 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-7a27bb53-60f9-4d4d-a848-4a3140cbe731 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:04:35.200456 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-7a27bb53-60f9-4d4d-a848-4a3140cbe731 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] [instance: 38ec68cd-0c1c-4f92-bb44-f6f6fb078b42] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:04:35.213681 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7a27bb53-60f9-4d4d-a848-4a3140cbe731 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:35.225683 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7a27bb53-60f9-4d4d-a848-4a3140cbe731 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:35.226762 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7a27bb53-60f9-4d4d-a848-4a3140cbe731 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:35.227750 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7a27bb53-60f9-4d4d-a848-4a3140cbe731 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:35.228440 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7a27bb53-60f9-4d4d-a848-4a3140cbe731 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:35.229091 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7a27bb53-60f9-4d4d-a848-4a3140cbe731 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:35.619202 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-c042322f-f7e1-4c70-9238-e5234b94a56e tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a1c8d841104bc9b6910bcc2c0e2bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe9283584fc4d90b0715216d867ea2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:04:35.641147 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-c042322f-f7e1-4c70-9238-e5234b94a56e tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "GET /compute/v2.1/servers/e5842070-d5a3-43f9-82f8-ebce4eaf5526" status: 200 len: 1525 microversion: 2.1 time: 0.817852 Oct 04 22:04:35.642293 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2172/4402] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:04:34 2022] GET /compute/v2.1/servers/e5842070-d5a3-43f9-82f8-ebce4eaf5526 => generated 1525 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:04:36.514728 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-7a27bb53-60f9-4d4d-a848-4a3140cbe731 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973de86311b47e882de18efbcb3f67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e037651e3345a8b95ea528cae02c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:04:36.527053 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-7a27bb53-60f9-4d4d-a848-4a3140cbe731 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] 10.222.0.43 "GET /compute/v2.1/servers/38ec68cd-0c1c-4f92-bb44-f6f6fb078b42" status: 200 len: 1528 microversion: 2.1 time: 1.333306 Oct 04 22:04:36.544444 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2231/4403] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:04:35 2022] GET /compute/v2.1/servers/38ec68cd-0c1c-4f92-bb44-f6f6fb078b42 => generated 1528 bytes in 1350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:04:36.555975 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-5cc1086c-c0a4-4d9d-b649-1bf38abdc92d req-5ceea934-6a52-48c7-8ebb-8fa4d862d74a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38ec68cd-0c1c-4f92-bb44-f6f6fb078b42", "name": "network-vif-unplugged", "status": "completed", "tag": "b891c80c-20f1-4ab6-8dec-a4169bd15c92"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:04:36.586985 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-5cc1086c-c0a4-4d9d-b649-1bf38abdc92d req-5ceea934-6a52-48c7-8ebb-8fa4d862d74a service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:36.592113 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-5cc1086c-c0a4-4d9d-b649-1bf38abdc92d req-5ceea934-6a52-48c7-8ebb-8fa4d862d74a service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:36.594500 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-5cc1086c-c0a4-4d9d-b649-1bf38abdc92d req-5ceea934-6a52-48c7-8ebb-8fa4d862d74a service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:36.633479 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-5cc1086c-c0a4-4d9d-b649-1bf38abdc92d req-5ceea934-6a52-48c7-8ebb-8fa4d862d74a service nova] Creating event network-vif-unplugged:b891c80c-20f1-4ab6-8dec-a4169bd15c92 for instance 38ec68cd-0c1c-4f92-bb44-f6f6fb078b42 on n-h1-860284-1 Oct 04 22:04:36.645511 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-5cc1086c-c0a4-4d9d-b649-1bf38abdc92d req-5ceea934-6a52-48c7-8ebb-8fa4d862d74a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.095666 Oct 04 22:04:36.657476 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2173/4404] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:04:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:04:36.688580 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-01537cc6-d133-4500-8039-e9b7b9fc6f14 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:04:36.689456 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-01537cc6-d133-4500-8039-e9b7b9fc6f14 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: e5842070-d5a3-43f9-82f8-ebce4eaf5526] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:04:36.704970 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-01537cc6-d133-4500-8039-e9b7b9fc6f14 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:36.706028 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-01537cc6-d133-4500-8039-e9b7b9fc6f14 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:36.707031 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-01537cc6-d133-4500-8039-e9b7b9fc6f14 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:36.721475 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-01537cc6-d133-4500-8039-e9b7b9fc6f14 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:36.723316 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-01537cc6-d133-4500-8039-e9b7b9fc6f14 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:36.724018 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-01537cc6-d133-4500-8039-e9b7b9fc6f14 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:37.557262 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-097e727c-fa1c-4762-8ecc-d9a88862ea7e tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:04:37.558804 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-097e727c-fa1c-4762-8ecc-d9a88862ea7e tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] [instance: 38ec68cd-0c1c-4f92-bb44-f6f6fb078b42] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:04:37.570551 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-097e727c-fa1c-4762-8ecc-d9a88862ea7e tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:37.579129 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-097e727c-fa1c-4762-8ecc-d9a88862ea7e tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:37.580023 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-097e727c-fa1c-4762-8ecc-d9a88862ea7e tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:37.581099 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-097e727c-fa1c-4762-8ecc-d9a88862ea7e tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:37.581864 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-097e727c-fa1c-4762-8ecc-d9a88862ea7e tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:37.582605 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-097e727c-fa1c-4762-8ecc-d9a88862ea7e tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:37.761796 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-01537cc6-d133-4500-8039-e9b7b9fc6f14 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a1c8d841104bc9b6910bcc2c0e2bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe9283584fc4d90b0715216d867ea2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:04:37.773497 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-01537cc6-d133-4500-8039-e9b7b9fc6f14 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "GET /compute/v2.1/servers/e5842070-d5a3-43f9-82f8-ebce4eaf5526" status: 200 len: 1525 microversion: 2.1 time: 1.088943 Oct 04 22:04:37.774120 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2232/4405] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:04:36 2022] GET /compute/v2.1/servers/e5842070-d5a3-43f9-82f8-ebce4eaf5526 => generated 1525 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:04:38.083509 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-097e727c-fa1c-4762-8ecc-d9a88862ea7e tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973de86311b47e882de18efbcb3f67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e037651e3345a8b95ea528cae02c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:04:38.098160 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-097e727c-fa1c-4762-8ecc-d9a88862ea7e tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] 10.222.0.43 "GET /compute/v2.1/servers/38ec68cd-0c1c-4f92-bb44-f6f6fb078b42" status: 200 len: 1528 microversion: 2.1 time: 0.540725 Oct 04 22:04:38.113019 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2174/4406] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:04:37 2022] GET /compute/v2.1/servers/38ec68cd-0c1c-4f92-bb44-f6f6fb078b42 => generated 1528 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:04:38.805703 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-6b084140-9526-4b85-9c34-2ba70cf8a6a8 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:04:38.806330 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-6b084140-9526-4b85-9c34-2ba70cf8a6a8 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: e5842070-d5a3-43f9-82f8-ebce4eaf5526] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:04:38.830425 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6b084140-9526-4b85-9c34-2ba70cf8a6a8 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:38.830914 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6b084140-9526-4b85-9c34-2ba70cf8a6a8 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:38.831368 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6b084140-9526-4b85-9c34-2ba70cf8a6a8 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:38.832191 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6b084140-9526-4b85-9c34-2ba70cf8a6a8 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:38.832658 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6b084140-9526-4b85-9c34-2ba70cf8a6a8 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:38.833140 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6b084140-9526-4b85-9c34-2ba70cf8a6a8 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:38.870932 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-e044d5bb-2570-42e6-9908-3c45bb91c45c req-60430383-9ba7-41f1-83ea-6f7ee6b34492 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38ec68cd-0c1c-4f92-bb44-f6f6fb078b42", "name": "network-vif-deleted", "tag": "b891c80c-20f1-4ab6-8dec-a4169bd15c92"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:04:38.931091 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-e044d5bb-2570-42e6-9908-3c45bb91c45c req-60430383-9ba7-41f1-83ea-6f7ee6b34492 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:38.935868 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-e044d5bb-2570-42e6-9908-3c45bb91c45c req-60430383-9ba7-41f1-83ea-6f7ee6b34492 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:38.938473 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-e044d5bb-2570-42e6-9908-3c45bb91c45c req-60430383-9ba7-41f1-83ea-6f7ee6b34492 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:39.023073 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-e044d5bb-2570-42e6-9908-3c45bb91c45c req-60430383-9ba7-41f1-83ea-6f7ee6b34492 service nova] Creating event network-vif-deleted:b891c80c-20f1-4ab6-8dec-a4169bd15c92 for instance 38ec68cd-0c1c-4f92-bb44-f6f6fb078b42 on n-h1-860284-1 Oct 04 22:04:39.037476 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-e044d5bb-2570-42e6-9908-3c45bb91c45c req-60430383-9ba7-41f1-83ea-6f7ee6b34492 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.176198 Oct 04 22:04:39.045252 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2175/4407] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:04:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:04:39.142749 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-4a687937-d2a0-4141-84bc-a08b1ed4e705 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:04:39.143836 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-4a687937-d2a0-4141-84bc-a08b1ed4e705 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] [instance: 38ec68cd-0c1c-4f92-bb44-f6f6fb078b42] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:04:39.153477 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4a687937-d2a0-4141-84bc-a08b1ed4e705 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:39.154347 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4a687937-d2a0-4141-84bc-a08b1ed4e705 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:39.155086 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4a687937-d2a0-4141-84bc-a08b1ed4e705 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:39.156080 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4a687937-d2a0-4141-84bc-a08b1ed4e705 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:39.156981 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4a687937-d2a0-4141-84bc-a08b1ed4e705 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:39.158050 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4a687937-d2a0-4141-84bc-a08b1ed4e705 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:39.295008 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4a687937-d2a0-4141-84bc-a08b1ed4e705 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:39.301088 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4a687937-d2a0-4141-84bc-a08b1ed4e705 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:39.312592 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4a687937-d2a0-4141-84bc-a08b1ed4e705 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:39.314751 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.objects.instance [None req-4a687937-d2a0-4141-84bc-a08b1ed4e705 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lazy-loading 'fault' on Instance uuid 38ec68cd-0c1c-4f92-bb44-f6f6fb078b42 {{(pid=134101) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 22:04:39.374168 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-6b084140-9526-4b85-9c34-2ba70cf8a6a8 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a1c8d841104bc9b6910bcc2c0e2bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe9283584fc4d90b0715216d867ea2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:04:39.392429 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-6b084140-9526-4b85-9c34-2ba70cf8a6a8 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "GET /compute/v2.1/servers/e5842070-d5a3-43f9-82f8-ebce4eaf5526" status: 200 len: 1525 microversion: 2.1 time: 0.591565 Oct 04 22:04:39.393583 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2233/4408] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:04:38 2022] GET /compute/v2.1/servers/e5842070-d5a3-43f9-82f8-ebce4eaf5526 => generated 1525 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:04:39.431432 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-4a687937-d2a0-4141-84bc-a08b1ed4e705 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973de86311b47e882de18efbcb3f67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e037651e3345a8b95ea528cae02c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:04:39.441787 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-4a687937-d2a0-4141-84bc-a08b1ed4e705 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] 10.222.0.43 "GET /compute/v2.1/servers/38ec68cd-0c1c-4f92-bb44-f6f6fb078b42" status: 200 len: 1315 microversion: 2.1 time: 0.316813 Oct 04 22:04:39.446451 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2176/4409] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:04:39 2022] GET /compute/v2.1/servers/38ec68cd-0c1c-4f92-bb44-f6f6fb078b42 => generated 1315 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:04:40.421466 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-130b63af-e7ff-4f20-afb0-d81b9cb30c3d tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:04:40.422920 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-130b63af-e7ff-4f20-afb0-d81b9cb30c3d tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: e5842070-d5a3-43f9-82f8-ebce4eaf5526] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:04:40.445233 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-130b63af-e7ff-4f20-afb0-d81b9cb30c3d tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:40.446146 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-130b63af-e7ff-4f20-afb0-d81b9cb30c3d tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:40.446870 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-130b63af-e7ff-4f20-afb0-d81b9cb30c3d tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:40.447869 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-130b63af-e7ff-4f20-afb0-d81b9cb30c3d tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:40.448620 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-130b63af-e7ff-4f20-afb0-d81b9cb30c3d tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:40.449298 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-130b63af-e7ff-4f20-afb0-d81b9cb30c3d tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:40.468505 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-7e56101f-f4f5-480f-8514-ca76ca9cc128 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:04:40.469147 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-7e56101f-f4f5-480f-8514-ca76ca9cc128 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] [instance: 38ec68cd-0c1c-4f92-bb44-f6f6fb078b42] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:04:40.479809 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7e56101f-f4f5-480f-8514-ca76ca9cc128 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:40.480319 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7e56101f-f4f5-480f-8514-ca76ca9cc128 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:40.480767 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7e56101f-f4f5-480f-8514-ca76ca9cc128 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:40.481504 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7e56101f-f4f5-480f-8514-ca76ca9cc128 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:40.481975 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7e56101f-f4f5-480f-8514-ca76ca9cc128 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:40.504353 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7e56101f-f4f5-480f-8514-ca76ca9cc128 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:40.558081 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-7e56101f-f4f5-480f-8514-ca76ca9cc128 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] HTTP exception thrown: Instance 38ec68cd-0c1c-4f92-bb44-f6f6fb078b42 could not be found. Oct 04 22:04:40.583631 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-7e56101f-f4f5-480f-8514-ca76ca9cc128 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Request method failure captured: Oct 04 22:04:40.583631 n-d-860284-1 devstack@n-api.service[134101]: request: GET /compute/v2.1/servers/38ec68cd-0c1c-4f92-bb44-f6f6fb078b42 HTTP/1.1 Oct 04 22:04:40.583631 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 22:04:40.583631 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 22:04:40.583631 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 22:04:40.583631 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 22:04:40.583631 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 22:04:40.583631 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 22:04:40.583631 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 22:04:40.583631 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 22:04:40.583631 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPK2uaWdbUBgaC4RfPmjtTbjIfwc-i2umyIIBK_cF0D-_RCmikTip9FKSkMA-3LEgg0VpJcoPxMz4oo_myk5qoqg03ZgavcBoIAuumM_46SfpdfsovWLWxw7rAOFQTEcjFL3h_S0RmznoPUhj4-fuUVB2M5gfUS2qQyVeicBq2kx7daY Oct 04 22:04:40.583631 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 22:04:40.583631 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 22:04:40.583631 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 22:04:40.583631 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 22:04:40.583631 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 22:04:40.583631 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 22:04:40.583631 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: a1e037651e3345a8b95ea528cae02c9f Oct 04 22:04:40.583631 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-342298031 Oct 04 22:04:40.583631 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 22:04:40.583631 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 22:04:40.583631 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a1e037651e3345a8b95ea528cae02c9f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_a1e037651e3345a8b95ea528cae02c9f", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a1e037651e3345a8b95ea528cae02c9f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/a1e037651e3345a8b95ea528cae02c9f"}]}] Oct 04 22:04:40.583631 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-342298031 Oct 04 22:04:40.583631 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: a1e037651e3345a8b95ea528cae02c9f Oct 04 22:04:40.583631 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-342298031 Oct 04 22:04:40.583631 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-ImagesOneServerNegativeTestJSON-342298031-project Oct 04 22:04:40.583631 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 22:04:40.583631 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 22:04:40.583631 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 9973de86311b47e882de18efbcb3f67f Oct 04 22:04:40.583631 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-342298031-project Oct 04 22:04:40.583631 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 22:04:40.583631 n-d-860284-1 devstack@n-api.service[134101]: exception: Instance 38ec68cd-0c1c-4f92-bb44-f6f6fb078b42 could not be found. Oct 04 22:04:40.583631 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': '38ec68cd-0c1c-4f92-bb44-f6f6fb078b42'} Oct 04 22:04:40.583631 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:04:40.583631 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:04:40.583631 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:04:40.583631 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:04:40.583631 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:04:40.583631 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:04:40.583631 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:04:40.583631 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:04:40.583631 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:04:40.583631 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:04:40.583631 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38ec68cd-0c1c-4f92-bb44-f6f6fb078b42 could not be found. Oct 04 22:04:40.583631 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:04:40.583631 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:04:40.583631 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:04:40.583631 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:04:40.583631 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:04:40.583631 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:04:40.583631 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:04:40.583631 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:04:40.583631 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:04:40.583631 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:04:40.583631 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:04:40.583631 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:04:40.583631 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:04:40.583631 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:04:40.583631 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:04:40.583631 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:04:40.583631 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38ec68cd-0c1c-4f92-bb44-f6f6fb078b42 could not be found. Oct 04 22:04:40.583631 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:04:40.583631 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:04:40.588962 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:04:40.588962 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:04:40.588962 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:04:40.588962 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:04:40.588962 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:04:40.588962 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:04:40.588962 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38ec68cd-0c1c-4f92-bb44-f6f6fb078b42 could not be found. Oct 04 22:04:40.588962 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:04:40.595564 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-7e56101f-f4f5-480f-8514-ca76ca9cc128 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Returning 404 to user: Instance 38ec68cd-0c1c-4f92-bb44-f6f6fb078b42 could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:04:40.600205 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-7e56101f-f4f5-480f-8514-ca76ca9cc128 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] 10.222.0.43 "GET /compute/v2.1/servers/38ec68cd-0c1c-4f92-bb44-f6f6fb078b42" status: 404 len: 111 microversion: 2.1 time: 0.135781 Oct 04 22:04:40.608582 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2177/4410] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:04:40 2022] GET /compute/v2.1/servers/38ec68cd-0c1c-4f92-bb44-f6f6fb078b42 => generated 111 bytes in 145 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:04:40.906261 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-ebc3594d-7d72-4400-b3a0-bd1ea3e13ce3 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1368244283", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:04:41.051176 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.network.neutron [None req-ebc3594d-7d72-4400-b3a0-bd1ea3e13ce3 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] validate_networks() for [('54dc583b-b197-4250-8660-141d8275cae0', None, None, None, None, None)] {{(pid=134101) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 22:04:41.055951 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-130b63af-e7ff-4f20-afb0-d81b9cb30c3d tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a1c8d841104bc9b6910bcc2c0e2bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe9283584fc4d90b0715216d867ea2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:04:41.072302 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-130b63af-e7ff-4f20-afb0-d81b9cb30c3d tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "GET /compute/v2.1/servers/e5842070-d5a3-43f9-82f8-ebce4eaf5526" status: 200 len: 1525 microversion: 2.1 time: 0.654976 Oct 04 22:04:41.073239 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2234/4411] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:04:40 2022] GET /compute/v2.1/servers/e5842070-d5a3-43f9-82f8-ebce4eaf5526 => generated 1525 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:04:42.099073 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-8b3267d2-b525-41ed-b251-cd0cb88fc59c tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:04:42.100335 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-8b3267d2-b525-41ed-b251-cd0cb88fc59c tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: e5842070-d5a3-43f9-82f8-ebce4eaf5526] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:04:42.126775 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8b3267d2-b525-41ed-b251-cd0cb88fc59c tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:42.155245 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8b3267d2-b525-41ed-b251-cd0cb88fc59c tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:42.158401 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8b3267d2-b525-41ed-b251-cd0cb88fc59c tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:42.159666 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8b3267d2-b525-41ed-b251-cd0cb88fc59c tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:42.160580 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8b3267d2-b525-41ed-b251-cd0cb88fc59c tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:42.163021 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8b3267d2-b525-41ed-b251-cd0cb88fc59c tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:43.003484 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-8b3267d2-b525-41ed-b251-cd0cb88fc59c tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a1c8d841104bc9b6910bcc2c0e2bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe9283584fc4d90b0715216d867ea2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:04:43.013361 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-8b3267d2-b525-41ed-b251-cd0cb88fc59c tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "GET /compute/v2.1/servers/e5842070-d5a3-43f9-82f8-ebce4eaf5526" status: 200 len: 1525 microversion: 2.1 time: 0.918193 Oct 04 22:04:43.044167 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2235/4412] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:04:42 2022] GET /compute/v2.1/servers/e5842070-d5a3-43f9-82f8-ebce4eaf5526 => generated 1525 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:04:43.555535 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-c927d825-f72e-4a91-b680-4cb7f7876010 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Action: 'create', calling method: .version_select at 0x7fbb2e869c10>, body: {"keypair": {"name": "tempest-keypair-1577660225", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI8UTWnMu6n9U5VXkOrQ+B4Zrl/A3G1P7FqOaT64I2FTEjnd645qxPp4us69jyiJHU5dh6Pz7Y7KfsgXppvtqIoWkjsUXNDL74lrrrcuuwVA2KoLenh97AfKRBIeoBK6HA=="}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:04:43.621198 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-c927d825-f72e-4a91-b680-4cb7f7876010 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Getting quotas for project 9da7a77590054a3c911643db69a0beae. Resources: {'key_pairs'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:04:43.637771 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-c927d825-f72e-4a91-b680-4cb7f7876010 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Getting quotas for user 836cb8e2e7be4981bb266cbd4189a775 and project 9da7a77590054a3c911643db69a0beae. Resources: {'key_pairs'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:04:43.658306 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-ebc3594d-7d72-4400-b3a0-bd1ea3e13ce3 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Flavor limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 22:04:43.658953 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-ebc3594d-7d72-4400-b3a0-bd1ea3e13ce3 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Image limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 22:04:43.659550 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-ebc3594d-7d72-4400-b3a0-bd1ea3e13ce3 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Flavor pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 22:04:43.660045 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-ebc3594d-7d72-4400-b3a0-bd1ea3e13ce3 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Image pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 22:04:43.660608 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-ebc3594d-7d72-4400-b3a0-bd1ea3e13ce3 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 22:04:43.703879 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ebc3594d-7d72-4400-b3a0-bd1ea3e13ce3 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:43.704720 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ebc3594d-7d72-4400-b3a0-bd1ea3e13ce3 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:43.705410 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ebc3594d-7d72-4400-b3a0-bd1ea3e13ce3 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:43.706475 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ebc3594d-7d72-4400-b3a0-bd1ea3e13ce3 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:43.707164 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ebc3594d-7d72-4400-b3a0-bd1ea3e13ce3 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:43.708174 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ebc3594d-7d72-4400-b3a0-bd1ea3e13ce3 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:43.733603 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-ebc3594d-7d72-4400-b3a0-bd1ea3e13ce3 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Getting quotas for project a1e037651e3345a8b95ea528cae02c9f. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:04:43.745015 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-c927d825-f72e-4a91-b680-4cb7f7876010 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.560810 Oct 04 22:04:43.746756 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-ebc3594d-7d72-4400-b3a0-bd1ea3e13ce3 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Getting quotas for user 9973de86311b47e882de18efbcb3f67f and project a1e037651e3345a8b95ea528cae02c9f. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:04:43.754301 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2236/4413] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Oct 4 22:04:43 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:04:43.787474 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-ebc3594d-7d72-4400-b3a0-bd1ea3e13ce3 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Going to run 1 instances... {{(pid=134101) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 22:04:43.791065 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-ebc3594d-7d72-4400-b3a0-bd1ea3e13ce3 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] [instance: 6d9cd6fc-504f-49cc-9abc-56d738ef4d8a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='58548514-5dac-426c-81f5-19e3fba33e23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134101) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 22:04:43.866846 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-ebc3594d-7d72-4400-b3a0-bd1ea3e13ce3 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.964486 Oct 04 22:04:43.868315 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2178/4414] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 22:04:40 2022] POST /compute/v2.1/servers => generated 383 bytes in 2968 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 22:04:43.883236 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-85ed26b4-afcb-4316-9285-ef23826e1a4d tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:04:43.884000 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-85ed26b4-afcb-4316-9285-ef23826e1a4d tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] [instance: 6d9cd6fc-504f-49cc-9abc-56d738ef4d8a] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:04:44.018314 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-85ed26b4-afcb-4316-9285-ef23826e1a4d tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973de86311b47e882de18efbcb3f67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e037651e3345a8b95ea528cae02c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:04:44.032121 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-85ed26b4-afcb-4316-9285-ef23826e1a4d tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] 10.222.0.43 "GET /compute/v2.1/servers/6d9cd6fc-504f-49cc-9abc-56d738ef4d8a" status: 200 len: 1225 microversion: 2.1 time: 0.156142 Oct 04 22:04:44.032731 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2237/4415] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:04:43 2022] GET /compute/v2.1/servers/6d9cd6fc-504f-49cc-9abc-56d738ef4d8a => generated 1225 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:04:44.055544 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-aecc25b5-1b3a-4a20-998b-553014fe7282 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:04:44.056656 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-aecc25b5-1b3a-4a20-998b-553014fe7282 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: e5842070-d5a3-43f9-82f8-ebce4eaf5526] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:04:44.071404 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-aecc25b5-1b3a-4a20-998b-553014fe7282 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:44.071934 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-aecc25b5-1b3a-4a20-998b-553014fe7282 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:44.072375 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-aecc25b5-1b3a-4a20-998b-553014fe7282 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:44.076754 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-aecc25b5-1b3a-4a20-998b-553014fe7282 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:44.077381 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-aecc25b5-1b3a-4a20-998b-553014fe7282 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:44.077835 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-aecc25b5-1b3a-4a20-998b-553014fe7282 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:44.746016 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-aecc25b5-1b3a-4a20-998b-553014fe7282 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a1c8d841104bc9b6910bcc2c0e2bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe9283584fc4d90b0715216d867ea2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:04:44.764438 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-aecc25b5-1b3a-4a20-998b-553014fe7282 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "GET /compute/v2.1/servers/e5842070-d5a3-43f9-82f8-ebce4eaf5526" status: 200 len: 1525 microversion: 2.1 time: 0.713661 Oct 04 22:04:44.776310 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2179/4416] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:04:44 2022] GET /compute/v2.1/servers/e5842070-d5a3-43f9-82f8-ebce4eaf5526 => generated 1525 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:04:45.059939 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-b2dac77f-0ee9-4e59-bc6b-f3eaf5fe37c3 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:04:45.061086 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-b2dac77f-0ee9-4e59-bc6b-f3eaf5fe37c3 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] [instance: 6d9cd6fc-504f-49cc-9abc-56d738ef4d8a] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:04:45.075053 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b2dac77f-0ee9-4e59-bc6b-f3eaf5fe37c3 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:45.078695 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b2dac77f-0ee9-4e59-bc6b-f3eaf5fe37c3 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:45.087756 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b2dac77f-0ee9-4e59-bc6b-f3eaf5fe37c3 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:45.088712 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b2dac77f-0ee9-4e59-bc6b-f3eaf5fe37c3 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:45.092941 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b2dac77f-0ee9-4e59-bc6b-f3eaf5fe37c3 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:45.093572 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b2dac77f-0ee9-4e59-bc6b-f3eaf5fe37c3 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:45.799589 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-f1944fbf-4aed-4b3f-8d3d-d7598058b13f tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:04:45.800921 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-f1944fbf-4aed-4b3f-8d3d-d7598058b13f tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: e5842070-d5a3-43f9-82f8-ebce4eaf5526] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:04:45.811920 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f1944fbf-4aed-4b3f-8d3d-d7598058b13f tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:45.815024 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f1944fbf-4aed-4b3f-8d3d-d7598058b13f tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:45.816944 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f1944fbf-4aed-4b3f-8d3d-d7598058b13f tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:45.818181 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f1944fbf-4aed-4b3f-8d3d-d7598058b13f tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:45.821670 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f1944fbf-4aed-4b3f-8d3d-d7598058b13f tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:45.822491 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f1944fbf-4aed-4b3f-8d3d-d7598058b13f tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:46.161721 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-b2dac77f-0ee9-4e59-bc6b-f3eaf5fe37c3 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973de86311b47e882de18efbcb3f67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e037651e3345a8b95ea528cae02c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:04:46.170794 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-b2dac77f-0ee9-4e59-bc6b-f3eaf5fe37c3 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] 10.222.0.43 "GET /compute/v2.1/servers/6d9cd6fc-504f-49cc-9abc-56d738ef4d8a" status: 200 len: 1221 microversion: 2.1 time: 1.116656 Oct 04 22:04:46.174970 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2238/4417] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:04:45 2022] GET /compute/v2.1/servers/6d9cd6fc-504f-49cc-9abc-56d738ef4d8a => generated 1221 bytes in 1122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:04:46.589291 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-f1944fbf-4aed-4b3f-8d3d-d7598058b13f tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a1c8d841104bc9b6910bcc2c0e2bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe9283584fc4d90b0715216d867ea2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:04:46.613985 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:04:46.627666 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-f1944fbf-4aed-4b3f-8d3d-d7598058b13f tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "GET /compute/v2.1/servers/e5842070-d5a3-43f9-82f8-ebce4eaf5526" status: 200 len: 1507 microversion: 2.1 time: 0.827044 Oct 04 22:04:46.629226 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2180/4418] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:04:45 2022] GET /compute/v2.1/servers/e5842070-d5a3-43f9-82f8-ebce4eaf5526 => generated 1507 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:04:47.199358 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-f59c01a2-cd3a-4089-91f4-48c1b58a5ba7 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:04:47.200132 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-f59c01a2-cd3a-4089-91f4-48c1b58a5ba7 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] [instance: 6d9cd6fc-504f-49cc-9abc-56d738ef4d8a] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:04:47.210443 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:04:47.224505 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f59c01a2-cd3a-4089-91f4-48c1b58a5ba7 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:47.225051 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f59c01a2-cd3a-4089-91f4-48c1b58a5ba7 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:47.225505 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f59c01a2-cd3a-4089-91f4-48c1b58a5ba7 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:47.226235 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f59c01a2-cd3a-4089-91f4-48c1b58a5ba7 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:47.226720 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f59c01a2-cd3a-4089-91f4-48c1b58a5ba7 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:47.227154 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f59c01a2-cd3a-4089-91f4-48c1b58a5ba7 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:47.457619 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-f59c01a2-cd3a-4089-91f4-48c1b58a5ba7 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973de86311b47e882de18efbcb3f67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e037651e3345a8b95ea528cae02c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:04:47.470518 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-f59c01a2-cd3a-4089-91f4-48c1b58a5ba7 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] 10.222.0.43 "GET /compute/v2.1/servers/6d9cd6fc-504f-49cc-9abc-56d738ef4d8a" status: 200 len: 1283 microversion: 2.1 time: 0.275132 Oct 04 22:04:47.471437 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2239/4419] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:04:47 2022] GET /compute/v2.1/servers/6d9cd6fc-504f-49cc-9abc-56d738ef4d8a => generated 1283 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:04:47.659223 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-8dbe3ce4-1a80-46d6-b79a-2ac654950ee8 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:04:47.665687 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-8dbe3ce4-1a80-46d6-b79a-2ac654950ee8 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: e5842070-d5a3-43f9-82f8-ebce4eaf5526] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:04:47.675479 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8dbe3ce4-1a80-46d6-b79a-2ac654950ee8 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:47.677033 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8dbe3ce4-1a80-46d6-b79a-2ac654950ee8 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:47.678209 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8dbe3ce4-1a80-46d6-b79a-2ac654950ee8 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:47.679271 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8dbe3ce4-1a80-46d6-b79a-2ac654950ee8 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:47.680014 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8dbe3ce4-1a80-46d6-b79a-2ac654950ee8 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:47.680667 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8dbe3ce4-1a80-46d6-b79a-2ac654950ee8 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:48.222825 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-8dbe3ce4-1a80-46d6-b79a-2ac654950ee8 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a1c8d841104bc9b6910bcc2c0e2bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe9283584fc4d90b0715216d867ea2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:04:48.245374 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-8dbe3ce4-1a80-46d6-b79a-2ac654950ee8 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "GET /compute/v2.1/servers/e5842070-d5a3-43f9-82f8-ebce4eaf5526" status: 200 len: 1507 microversion: 2.1 time: 0.591087 Oct 04 22:04:48.248139 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2181/4420] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:04:47 2022] GET /compute/v2.1/servers/e5842070-d5a3-43f9-82f8-ebce4eaf5526 => generated 1507 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:04:48.500785 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-a1e8117c-9269-47cd-92dd-b7b8db119294 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:04:48.501518 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-a1e8117c-9269-47cd-92dd-b7b8db119294 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] [instance: 6d9cd6fc-504f-49cc-9abc-56d738ef4d8a] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:04:48.512622 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a1e8117c-9269-47cd-92dd-b7b8db119294 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:48.513118 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a1e8117c-9269-47cd-92dd-b7b8db119294 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:48.513558 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a1e8117c-9269-47cd-92dd-b7b8db119294 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:48.514279 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a1e8117c-9269-47cd-92dd-b7b8db119294 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:48.514766 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a1e8117c-9269-47cd-92dd-b7b8db119294 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:48.516389 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a1e8117c-9269-47cd-92dd-b7b8db119294 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:48.767994 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-283c4519-e659-498a-9183-5cf0242e4b8e tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-303103490", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "46f1773f-94f8-4a79-8019-a2303221d351"}], "security_groups": [{"name": "tempest-securitygroup--300469640"}], "key_name": "tempest-keypair-1577660225", "user_data": "}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:04:48.953711 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-a1e8117c-9269-47cd-92dd-b7b8db119294 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973de86311b47e882de18efbcb3f67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e037651e3345a8b95ea528cae02c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:04:48.973140 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-a1e8117c-9269-47cd-92dd-b7b8db119294 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] 10.222.0.43 "GET /compute/v2.1/servers/6d9cd6fc-504f-49cc-9abc-56d738ef4d8a" status: 200 len: 1325 microversion: 2.1 time: 0.476998 Oct 04 22:04:48.978837 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2240/4421] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:04:48 2022] GET /compute/v2.1/servers/6d9cd6fc-504f-49cc-9abc-56d738ef4d8a => generated 1325 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:04:49.028586 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.network.neutron [None req-283c4519-e659-498a-9183-5cf0242e4b8e tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] validate_networks() for [('46f1773f-94f8-4a79-8019-a2303221d351', None, None, None, None, None)] {{(pid=134101) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 22:04:49.271385 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-a13caf07-f3b4-4d9d-a258-b4878b3ab8e7 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:04:49.272266 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-a13caf07-f3b4-4d9d-a258-b4878b3ab8e7 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: e5842070-d5a3-43f9-82f8-ebce4eaf5526] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:04:49.283297 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a13caf07-f3b4-4d9d-a258-b4878b3ab8e7 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:49.284283 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a13caf07-f3b4-4d9d-a258-b4878b3ab8e7 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:49.285919 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a13caf07-f3b4-4d9d-a258-b4878b3ab8e7 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:49.287433 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a13caf07-f3b4-4d9d-a258-b4878b3ab8e7 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:49.288845 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a13caf07-f3b4-4d9d-a258-b4878b3ab8e7 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:49.289987 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a13caf07-f3b4-4d9d-a258-b4878b3ab8e7 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:50.323647 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-283c4519-e659-498a-9183-5cf0242e4b8e tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Flavor limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 22:04:50.324207 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-283c4519-e659-498a-9183-5cf0242e4b8e tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Image limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 22:04:50.324616 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-283c4519-e659-498a-9183-5cf0242e4b8e tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Flavor pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 22:04:50.325219 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-283c4519-e659-498a-9183-5cf0242e4b8e tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Image pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 22:04:50.325794 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-283c4519-e659-498a-9183-5cf0242e4b8e tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 22:04:50.348895 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-283c4519-e659-498a-9183-5cf0242e4b8e tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:50.351390 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-283c4519-e659-498a-9183-5cf0242e4b8e tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:50.353106 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-283c4519-e659-498a-9183-5cf0242e4b8e tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:50.354248 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-283c4519-e659-498a-9183-5cf0242e4b8e tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:50.354701 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-a13caf07-f3b4-4d9d-a258-b4878b3ab8e7 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a1c8d841104bc9b6910bcc2c0e2bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe9283584fc4d90b0715216d867ea2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:04:50.356215 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-283c4519-e659-498a-9183-5cf0242e4b8e tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:50.356823 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-283c4519-e659-498a-9183-5cf0242e4b8e tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:50.394698 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-a13caf07-f3b4-4d9d-a258-b4878b3ab8e7 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "GET /compute/v2.1/servers/e5842070-d5a3-43f9-82f8-ebce4eaf5526" status: 200 len: 1450 microversion: 2.1 time: 1.111561 Oct 04 22:04:50.394698 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2241/4422] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:04:49 2022] GET /compute/v2.1/servers/e5842070-d5a3-43f9-82f8-ebce4eaf5526 => generated 1450 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:04:50.394698 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-b0b915db-4169-40e6-9cfa-5760dd6281b4 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:04:50.394698 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-b0b915db-4169-40e6-9cfa-5760dd6281b4 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] [instance: 6d9cd6fc-504f-49cc-9abc-56d738ef4d8a] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:04:50.425577 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b0b915db-4169-40e6-9cfa-5760dd6281b4 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:50.426961 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b0b915db-4169-40e6-9cfa-5760dd6281b4 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:50.427528 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b0b915db-4169-40e6-9cfa-5760dd6281b4 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:50.430256 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-283c4519-e659-498a-9183-5cf0242e4b8e tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Getting quotas for project 9da7a77590054a3c911643db69a0beae. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:04:50.430863 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b0b915db-4169-40e6-9cfa-5760dd6281b4 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:50.431492 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b0b915db-4169-40e6-9cfa-5760dd6281b4 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:50.432041 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b0b915db-4169-40e6-9cfa-5760dd6281b4 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:50.442748 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-283c4519-e659-498a-9183-5cf0242e4b8e tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Getting quotas for user 836cb8e2e7be4981bb266cbd4189a775 and project 9da7a77590054a3c911643db69a0beae. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:04:50.487119 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-283c4519-e659-498a-9183-5cf0242e4b8e tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Going to run 1 instances... {{(pid=134101) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 22:04:50.495268 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-283c4519-e659-498a-9183-5cf0242e4b8e tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 48243e1b-892b-4c4b-8db1-242b2e40653b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='58548514-5dac-426c-81f5-19e3fba33e23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134101) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 22:04:50.718173 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-283c4519-e659-498a-9183-5cf0242e4b8e tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.960840 Oct 04 22:04:50.720649 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2182/4423] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 22:04:48 2022] POST /compute/v2.1/servers => generated 408 bytes in 1966 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 22:04:50.733005 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-69465f37-59ea-4481-8089-1b0a3de982cf tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:04:50.735456 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-69465f37-59ea-4481-8089-1b0a3de982cf tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: e5842070-d5a3-43f9-82f8-ebce4eaf5526] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:04:50.760362 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-69465f37-59ea-4481-8089-1b0a3de982cf tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:50.761015 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-69465f37-59ea-4481-8089-1b0a3de982cf tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:50.763013 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-69465f37-59ea-4481-8089-1b0a3de982cf tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:50.764993 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-69465f37-59ea-4481-8089-1b0a3de982cf tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:50.767549 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-69465f37-59ea-4481-8089-1b0a3de982cf tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:50.795445 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-69465f37-59ea-4481-8089-1b0a3de982cf tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:50.875998 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-b0b915db-4169-40e6-9cfa-5760dd6281b4 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973de86311b47e882de18efbcb3f67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e037651e3345a8b95ea528cae02c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:04:50.888495 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-b0b915db-4169-40e6-9cfa-5760dd6281b4 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] 10.222.0.43 "GET /compute/v2.1/servers/6d9cd6fc-504f-49cc-9abc-56d738ef4d8a" status: 200 len: 1325 microversion: 2.1 time: 0.502752 Oct 04 22:04:50.914436 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2242/4424] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:04:50 2022] GET /compute/v2.1/servers/6d9cd6fc-504f-49cc-9abc-56d738ef4d8a => generated 1325 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:04:50.932772 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-e5ebc02a-7c21-4b1f-9485-20a58961a91d tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:04:50.933653 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-e5ebc02a-7c21-4b1f-9485-20a58961a91d tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 48243e1b-892b-4c4b-8db1-242b2e40653b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:04:50.942982 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-69465f37-59ea-4481-8089-1b0a3de982cf tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: e5842070-d5a3-43f9-82f8-ebce4eaf5526] Going to try to terminate instance {{(pid=134101) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 22:04:50.976166 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.compute.api [None req-69465f37-59ea-4481-8089-1b0a3de982cf tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: e5842070-d5a3-43f9-82f8-ebce4eaf5526] Working on deleting snapshot 85015ab5-2d18-4fb3-b22b-11ac3efb40f1 from shelved instance... Oct 04 22:04:51.096082 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-e5ebc02a-7c21-4b1f-9485-20a58961a91d tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:04:51.110981 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-e5ebc02a-7c21-4b1f-9485-20a58961a91d tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b" status: 200 len: 1238 microversion: 2.1 time: 0.202528 Oct 04 22:04:51.127214 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2243/4425] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:04:50 2022] GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b => generated 1238 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:04:51.142975 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-e610a643-2208-4fd2-ae4d-4c952beb1983 req-628c0791-1904-4cc5-b883-d147485709b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5842070-d5a3-43f9-82f8-ebce4eaf5526", "name": "network-vif-unplugged", "status": "completed", "tag": "cf72dec7-7df1-4b49-8368-50d5e80924eb"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:04:51.159377 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-e610a643-2208-4fd2-ae4d-4c952beb1983 req-628c0791-1904-4cc5-b883-d147485709b8 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:51.159863 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-e610a643-2208-4fd2-ae4d-4c952beb1983 req-628c0791-1904-4cc5-b883-d147485709b8 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:51.160291 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-e610a643-2208-4fd2-ae4d-4c952beb1983 req-628c0791-1904-4cc5-b883-d147485709b8 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:51.180032 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.compute.server_external_events [req-e610a643-2208-4fd2-ae4d-4c952beb1983 req-628c0791-1904-4cc5-b883-d147485709b8 service nova] Unable to find a host for instance e5842070-d5a3-43f9-82f8-ebce4eaf5526. Dropping event network-vif-unplugged {{(pid=134102) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 04 22:04:51.181355 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-e610a643-2208-4fd2-ae4d-4c952beb1983 req-628c0791-1904-4cc5-b883-d147485709b8 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.067418 Oct 04 22:04:51.182573 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2244/4426] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:04:51 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 69 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 04 22:04:51.929735 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-e3b715c9-cec5-422f-97f4-8455350b9001 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:04:51.930424 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-e3b715c9-cec5-422f-97f4-8455350b9001 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] [instance: 6d9cd6fc-504f-49cc-9abc-56d738ef4d8a] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:04:51.942915 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e3b715c9-cec5-422f-97f4-8455350b9001 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:51.943439 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e3b715c9-cec5-422f-97f4-8455350b9001 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:51.944059 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e3b715c9-cec5-422f-97f4-8455350b9001 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:51.945017 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e3b715c9-cec5-422f-97f4-8455350b9001 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:51.946923 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e3b715c9-cec5-422f-97f4-8455350b9001 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:51.947561 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e3b715c9-cec5-422f-97f4-8455350b9001 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:52.157610 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-69465f37-59ea-4481-8089-1b0a3de982cf tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: e5842070-d5a3-43f9-82f8-ebce4eaf5526] Doing local delete in cell 1297bf18-d456-4d7b-91a9-0a07f1cafd2a(cell1) {{(pid=134101) _delete /opt/stack/nova/nova/compute/api.py:2546}} Oct 04 22:04:52.158504 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-69465f37-59ea-4481-8089-1b0a3de982cf tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:52.159374 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-69465f37-59ea-4481-8089-1b0a3de982cf tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:52.160183 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-69465f37-59ea-4481-8089-1b0a3de982cf tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:52.160975 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.compute.api [None req-69465f37-59ea-4481-8089-1b0a3de982cf tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: e5842070-d5a3-43f9-82f8-ebce4eaf5526] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Oct 04 22:04:52.166595 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.network.neutron [None req-69465f37-59ea-4481-8089-1b0a3de982cf tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: e5842070-d5a3-43f9-82f8-ebce4eaf5526] deallocate_for_instance() {{(pid=134101) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Oct 04 22:04:52.175596 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-e3b715c9-cec5-422f-97f4-8455350b9001 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973de86311b47e882de18efbcb3f67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e037651e3345a8b95ea528cae02c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:04:52.185941 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-e3b715c9-cec5-422f-97f4-8455350b9001 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] 10.222.0.43 "GET /compute/v2.1/servers/6d9cd6fc-504f-49cc-9abc-56d738ef4d8a" status: 200 len: 1325 microversion: 2.1 time: 0.261102 Oct 04 22:04:52.187817 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2245/4427] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:04:51 2022] GET /compute/v2.1/servers/6d9cd6fc-504f-49cc-9abc-56d738ef4d8a => generated 1325 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:04:52.196509 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-d39ba6aa-b92e-4d96-9ae8-f87d4e85ea01 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:04:52.199635 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-d39ba6aa-b92e-4d96-9ae8-f87d4e85ea01 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 48243e1b-892b-4c4b-8db1-242b2e40653b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:04:52.207695 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d39ba6aa-b92e-4d96-9ae8-f87d4e85ea01 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:52.208206 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d39ba6aa-b92e-4d96-9ae8-f87d4e85ea01 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:52.210082 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d39ba6aa-b92e-4d96-9ae8-f87d4e85ea01 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:52.211081 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d39ba6aa-b92e-4d96-9ae8-f87d4e85ea01 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:52.211557 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d39ba6aa-b92e-4d96-9ae8-f87d4e85ea01 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:52.211989 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d39ba6aa-b92e-4d96-9ae8-f87d4e85ea01 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:52.313904 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-d39ba6aa-b92e-4d96-9ae8-f87d4e85ea01 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:04:52.327641 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-d39ba6aa-b92e-4d96-9ae8-f87d4e85ea01 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b" status: 200 len: 1290 microversion: 2.1 time: 0.138349 Oct 04 22:04:52.342398 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2246/4428] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:04:52 2022] GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b => generated 1290 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:04:52.356321 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-a916484b-9868-4963-92e2-4a19d90b1e7d req-84460d92-7f31-487a-91fa-0a0d70bd3757 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d9cd6fc-504f-49cc-9abc-56d738ef4d8a", "tag": "534c2dce-c50a-4f0e-8c09-676f22e4a597"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:04:52.368982 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-a916484b-9868-4963-92e2-4a19d90b1e7d req-84460d92-7f31-487a-91fa-0a0d70bd3757 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:52.370005 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-a916484b-9868-4963-92e2-4a19d90b1e7d req-84460d92-7f31-487a-91fa-0a0d70bd3757 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:52.370460 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-a916484b-9868-4963-92e2-4a19d90b1e7d req-84460d92-7f31-487a-91fa-0a0d70bd3757 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:52.385106 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-a916484b-9868-4963-92e2-4a19d90b1e7d req-84460d92-7f31-487a-91fa-0a0d70bd3757 service nova] Creating event network-changed:534c2dce-c50a-4f0e-8c09-676f22e4a597 for instance 6d9cd6fc-504f-49cc-9abc-56d738ef4d8a on n-h2-860284-1 Oct 04 22:04:52.391271 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-a916484b-9868-4963-92e2-4a19d90b1e7d req-84460d92-7f31-487a-91fa-0a0d70bd3757 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052504 Oct 04 22:04:52.392121 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2247/4429] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:04:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:04:53.160829 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.network.neutron [None req-69465f37-59ea-4481-8089-1b0a3de982cf tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: e5842070-d5a3-43f9-82f8-ebce4eaf5526] Updating instance_info_cache with network_info: [] {{(pid=134101) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 04 22:04:53.493930 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-2e8f422d-6927-4c84-b0f6-75481ea104f1 req-051f6a28-9f15-4f0d-83aa-a2dc6634f70d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5842070-d5a3-43f9-82f8-ebce4eaf5526", "name": "network-vif-deleted", "tag": "cf72dec7-7df1-4b49-8368-50d5e80924eb"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:04:53.515435 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-2e8f422d-6927-4c84-b0f6-75481ea104f1 req-051f6a28-9f15-4f0d-83aa-a2dc6634f70d service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:53.516094 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-2e8f422d-6927-4c84-b0f6-75481ea104f1 req-051f6a28-9f15-4f0d-83aa-a2dc6634f70d service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:53.516964 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-2e8f422d-6927-4c84-b0f6-75481ea104f1 req-051f6a28-9f15-4f0d-83aa-a2dc6634f70d service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:53.546700 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.compute.server_external_events [req-2e8f422d-6927-4c84-b0f6-75481ea104f1 req-051f6a28-9f15-4f0d-83aa-a2dc6634f70d service nova] Unable to find a host for instance e5842070-d5a3-43f9-82f8-ebce4eaf5526. Dropping event network-vif-deleted {{(pid=134102) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 04 22:04:53.547616 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-2e8f422d-6927-4c84-b0f6-75481ea104f1 req-051f6a28-9f15-4f0d-83aa-a2dc6634f70d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.379398 Oct 04 22:04:53.555184 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2248/4430] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:04:53 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 388 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 04 22:04:53.562717 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-ebdee1fa-230c-41b6-b96d-e3491a47861a tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:04:53.563465 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-ebdee1fa-230c-41b6-b96d-e3491a47861a tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] [instance: 6d9cd6fc-504f-49cc-9abc-56d738ef4d8a] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:04:53.579212 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ebdee1fa-230c-41b6-b96d-e3491a47861a tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:53.580084 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ebdee1fa-230c-41b6-b96d-e3491a47861a tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:53.580695 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ebdee1fa-230c-41b6-b96d-e3491a47861a tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:53.582162 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ebdee1fa-230c-41b6-b96d-e3491a47861a tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:53.582810 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ebdee1fa-230c-41b6-b96d-e3491a47861a tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:53.583390 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ebdee1fa-230c-41b6-b96d-e3491a47861a tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:53.826878 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-ebdee1fa-230c-41b6-b96d-e3491a47861a tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973de86311b47e882de18efbcb3f67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e037651e3345a8b95ea528cae02c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:04:53.835790 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-69465f37-59ea-4481-8089-1b0a3de982cf tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "DELETE /compute/v2.1/servers/e5842070-d5a3-43f9-82f8-ebce4eaf5526" status: 204 len: 0 microversion: 2.1 time: 3.112591 Oct 04 22:04:53.836709 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2183/4431] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 22:04:50 2022] DELETE /compute/v2.1/servers/e5842070-d5a3-43f9-82f8-ebce4eaf5526 => generated 0 bytes in 3114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 22:04:53.843348 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-a4f5ade7-fff7-44ea-95b5-ca234cc16bd2 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:04:53.844307 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-a4f5ade7-fff7-44ea-95b5-ca234cc16bd2 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 48243e1b-892b-4c4b-8db1-242b2e40653b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:04:53.852970 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-ebdee1fa-230c-41b6-b96d-e3491a47861a tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] 10.222.0.43 "GET /compute/v2.1/servers/6d9cd6fc-504f-49cc-9abc-56d738ef4d8a" status: 200 len: 1325 microversion: 2.1 time: 0.293347 Oct 04 22:04:53.853983 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a4f5ade7-fff7-44ea-95b5-ca234cc16bd2 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:53.854712 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a4f5ade7-fff7-44ea-95b5-ca234cc16bd2 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:53.855311 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a4f5ade7-fff7-44ea-95b5-ca234cc16bd2 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:53.856260 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a4f5ade7-fff7-44ea-95b5-ca234cc16bd2 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:53.856920 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a4f5ade7-fff7-44ea-95b5-ca234cc16bd2 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:53.857496 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a4f5ade7-fff7-44ea-95b5-ca234cc16bd2 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:53.859935 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2249/4432] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:04:53 2022] GET /compute/v2.1/servers/6d9cd6fc-504f-49cc-9abc-56d738ef4d8a => generated 1325 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:04:53.867230 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-ebcd4830-e070-4da6-a922-0ccfeee3fb67 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:04:53.879261 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-ebcd4830-e070-4da6-a922-0ccfeee3fb67 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: e5842070-d5a3-43f9-82f8-ebce4eaf5526] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:04:53.892421 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ebcd4830-e070-4da6-a922-0ccfeee3fb67 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:53.899536 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ebcd4830-e070-4da6-a922-0ccfeee3fb67 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:53.902395 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ebcd4830-e070-4da6-a922-0ccfeee3fb67 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:53.903159 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ebcd4830-e070-4da6-a922-0ccfeee3fb67 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:53.903631 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ebcd4830-e070-4da6-a922-0ccfeee3fb67 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:53.905104 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ebcd4830-e070-4da6-a922-0ccfeee3fb67 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:53.909966 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=100 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:04:53.926214 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-ebcd4830-e070-4da6-a922-0ccfeee3fb67 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] HTTP exception thrown: Instance e5842070-d5a3-43f9-82f8-ebce4eaf5526 could not be found. Oct 04 22:04:53.928583 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-ebcd4830-e070-4da6-a922-0ccfeee3fb67 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Request method failure captured: Oct 04 22:04:53.928583 n-d-860284-1 devstack@n-api.service[134102]: request: GET /compute/v2.1/servers/e5842070-d5a3-43f9-82f8-ebce4eaf5526 HTTP/1.1 Oct 04 22:04:53.928583 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 22:04:53.928583 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 22:04:53.928583 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 22:04:53.928583 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 22:04:53.928583 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 22:04:53.928583 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 22:04:53.928583 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 22:04:53.928583 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 22:04:53.928583 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPK0nBLOASIAc_jQKg5RCRqB87oRsJiRc3l4etfmNkfSSv1yHGR8RjgOAS-Q4KEeiZVVxJRa8Focu7VoHdbhzgEqV5pocnY2xPPRPWacaT4koizORav87v6vdxgR4HH-PmsbraTS232Q30lW73kM7RH3tINWZChDkcbwtTWeQlIO6TSk Oct 04 22:04:53.928583 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 22:04:53.928583 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 22:04:53.928583 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 22:04:53.928583 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 22:04:53.928583 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 22:04:53.928583 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 22:04:53.928583 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: dfe9283584fc4d90b0715216d867ea2f Oct 04 22:04:53.928583 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-DeleteServersTestJSON-2136146778 Oct 04 22:04:53.928583 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 22:04:53.928583 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 22:04:53.928583 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/dfe9283584fc4d90b0715216d867ea2f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_dfe9283584fc4d90b0715216d867ea2f", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/dfe9283584fc4d90b0715216d867ea2f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/dfe9283584fc4d90b0715216d867ea2f"}]}] Oct 04 22:04:53.928583 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-DeleteServersTestJSON-2136146778 Oct 04 22:04:53.928583 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: dfe9283584fc4d90b0715216d867ea2f Oct 04 22:04:53.928583 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-DeleteServersTestJSON-2136146778 Oct 04 22:04:53.928583 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-DeleteServersTestJSON-2136146778-project Oct 04 22:04:53.928583 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 22:04:53.928583 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 22:04:53.928583 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: 41a1c8d841104bc9b6910bcc2c0e2bb1 Oct 04 22:04:53.928583 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-DeleteServersTestJSON-2136146778-project Oct 04 22:04:53.928583 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 22:04:53.928583 n-d-860284-1 devstack@n-api.service[134102]: exception: Instance e5842070-d5a3-43f9-82f8-ebce4eaf5526 could not be found. Oct 04 22:04:53.928583 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': 'e5842070-d5a3-43f9-82f8-ebce4eaf5526'} Oct 04 22:04:53.928583 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:04:53.928583 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:04:53.928583 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:04:53.928583 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:04:53.928583 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:04:53.928583 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:04:53.928583 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:04:53.928583 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:04:53.928583 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:04:53.928583 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:04:53.928583 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5842070-d5a3-43f9-82f8-ebce4eaf5526 could not be found. Oct 04 22:04:53.928583 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:04:53.928583 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:04:53.928583 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:04:53.928583 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:04:53.928583 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:04:53.928583 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:04:53.928583 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:04:53.928583 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:04:53.928583 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:04:53.928583 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:04:53.928583 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:04:53.928583 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:04:53.928583 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:04:53.928583 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:04:53.928583 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:04:53.928583 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:04:53.928583 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5842070-d5a3-43f9-82f8-ebce4eaf5526 could not be found. Oct 04 22:04:53.928583 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:04:53.928583 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:04:53.928583 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:04:53.933605 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:04:53.933605 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:04:53.933605 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:04:53.933605 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:04:53.933605 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:04:53.933605 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5842070-d5a3-43f9-82f8-ebce4eaf5526 could not be found. Oct 04 22:04:53.933605 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:04:53.935054 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-ebcd4830-e070-4da6-a922-0ccfeee3fb67 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Returning 404 to user: Instance e5842070-d5a3-43f9-82f8-ebce4eaf5526 could not be found. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:04:53.936100 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-ebcd4830-e070-4da6-a922-0ccfeee3fb67 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "GET /compute/v2.1/servers/e5842070-d5a3-43f9-82f8-ebce4eaf5526" status: 404 len: 111 microversion: 2.1 time: 0.074996 Oct 04 22:04:53.937152 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2250/4433] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:04:53 2022] GET /compute/v2.1/servers/e5842070-d5a3-43f9-82f8-ebce4eaf5526 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:04:54.004321 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-a4f5ade7-fff7-44ea-95b5-ca234cc16bd2 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:04:54.013810 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-a4f5ade7-fff7-44ea-95b5-ca234cc16bd2 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b" status: 200 len: 1296 microversion: 2.1 time: 0.175817 Oct 04 22:04:54.018206 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2184/4434] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:04:53 2022] GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b => generated 1296 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:04:54.139044 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-44ef95b7-e010-4851-b108-bb0348d8c4c3 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1322879109", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452", "networks": [{"uuid": "948c65db-57fc-480e-9ddd-f1d8426ccd4e"}]}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:04:54.237802 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.network.neutron [None req-44ef95b7-e010-4851-b108-bb0348d8c4c3 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] validate_networks() for [('948c65db-57fc-480e-9ddd-f1d8426ccd4e', None, None, None, None, None)] {{(pid=134102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 22:04:54.878467 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-594b4043-5ce2-4ef0-9015-586fdefe96a4 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:04:54.879099 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-594b4043-5ce2-4ef0-9015-586fdefe96a4 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] [instance: 6d9cd6fc-504f-49cc-9abc-56d738ef4d8a] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:04:54.896309 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-594b4043-5ce2-4ef0-9015-586fdefe96a4 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:54.898084 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-594b4043-5ce2-4ef0-9015-586fdefe96a4 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:54.898518 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-594b4043-5ce2-4ef0-9015-586fdefe96a4 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:54.899274 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-594b4043-5ce2-4ef0-9015-586fdefe96a4 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:54.899769 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-594b4043-5ce2-4ef0-9015-586fdefe96a4 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:54.900183 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-594b4043-5ce2-4ef0-9015-586fdefe96a4 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:55.404586 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-594b4043-5ce2-4ef0-9015-586fdefe96a4 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973de86311b47e882de18efbcb3f67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e037651e3345a8b95ea528cae02c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:04:55.420679 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-594b4043-5ce2-4ef0-9015-586fdefe96a4 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] 10.222.0.43 "GET /compute/v2.1/servers/6d9cd6fc-504f-49cc-9abc-56d738ef4d8a" status: 200 len: 1325 microversion: 2.1 time: 0.544296 Oct 04 22:04:55.423104 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2185/4435] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:04:54 2022] GET /compute/v2.1/servers/6d9cd6fc-504f-49cc-9abc-56d738ef4d8a => generated 1325 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:04:55.430432 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-44ef95b7-e010-4851-b108-bb0348d8c4c3 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Flavor limits 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 22:04:55.430960 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-44ef95b7-e010-4851-b108-bb0348d8c4c3 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Image limits 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 22:04:55.431330 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-44ef95b7-e010-4851-b108-bb0348d8c4c3 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Flavor pref 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 22:04:55.431743 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-44ef95b7-e010-4851-b108-bb0348d8c4c3 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Image pref 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 22:04:55.432390 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-44ef95b7-e010-4851-b108-bb0348d8c4c3 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 22:04:55.455246 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-0d281db1-45e5-4d85-8eb3-300818d0bfd9 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:04:55.457168 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-0d281db1-45e5-4d85-8eb3-300818d0bfd9 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 48243e1b-892b-4c4b-8db1-242b2e40653b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:04:55.475130 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0d281db1-45e5-4d85-8eb3-300818d0bfd9 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:55.476066 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0d281db1-45e5-4d85-8eb3-300818d0bfd9 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:55.476946 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0d281db1-45e5-4d85-8eb3-300818d0bfd9 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:55.477674 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-44ef95b7-e010-4851-b108-bb0348d8c4c3 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:55.478162 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-44ef95b7-e010-4851-b108-bb0348d8c4c3 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:55.478631 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-44ef95b7-e010-4851-b108-bb0348d8c4c3 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:55.479370 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-44ef95b7-e010-4851-b108-bb0348d8c4c3 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:55.479583 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0d281db1-45e5-4d85-8eb3-300818d0bfd9 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:55.479829 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-44ef95b7-e010-4851-b108-bb0348d8c4c3 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:55.480269 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-44ef95b7-e010-4851-b108-bb0348d8c4c3 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:55.482249 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0d281db1-45e5-4d85-8eb3-300818d0bfd9 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:55.483997 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0d281db1-45e5-4d85-8eb3-300818d0bfd9 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:55.534057 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-44ef95b7-e010-4851-b108-bb0348d8c4c3 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Getting quotas for project dfe9283584fc4d90b0715216d867ea2f. Resources: {'instances', 'ram', 'cores'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:04:55.548095 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-44ef95b7-e010-4851-b108-bb0348d8c4c3 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Getting quotas for user 41a1c8d841104bc9b6910bcc2c0e2bb1 and project dfe9283584fc4d90b0715216d867ea2f. Resources: {'instances', 'ram', 'cores'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:04:55.585402 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-44ef95b7-e010-4851-b108-bb0348d8c4c3 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Going to run 1 instances... {{(pid=134102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 22:04:55.595485 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-44ef95b7-e010-4851-b108-bb0348d8c4c3 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: f45bd103-0f2f-4eb0-83f9-a084adb03d18] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='58548514-5dac-426c-81f5-19e3fba33e23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 22:04:55.690735 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-44ef95b7-e010-4851-b108-bb0348d8c4c3 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.558407 Oct 04 22:04:55.698305 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2251/4436] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 22:04:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 1566 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 22:04:55.726233 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-2a82bcc5-0738-4856-b760-1a6c3fc96f1b tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:04:55.745077 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-2a82bcc5-0738-4856-b760-1a6c3fc96f1b tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: f45bd103-0f2f-4eb0-83f9-a084adb03d18] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:04:55.942996 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-0d281db1-45e5-4d85-8eb3-300818d0bfd9 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:04:55.952724 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-0d281db1-45e5-4d85-8eb3-300818d0bfd9 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b" status: 200 len: 1363 microversion: 2.1 time: 0.525997 Oct 04 22:04:55.958275 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2186/4437] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:04:55 2022] GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b => generated 1363 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:04:55.994027 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-2a82bcc5-0738-4856-b760-1a6c3fc96f1b tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a1c8d841104bc9b6910bcc2c0e2bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe9283584fc4d90b0715216d867ea2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:04:56.014905 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-2a82bcc5-0738-4856-b760-1a6c3fc96f1b tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "GET /compute/v2.1/servers/f45bd103-0f2f-4eb0-83f9-a084adb03d18" status: 200 len: 1215 microversion: 2.1 time: 0.289132 Oct 04 22:04:56.031022 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2252/4438] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:04:55 2022] GET /compute/v2.1/servers/f45bd103-0f2f-4eb0-83f9-a084adb03d18 => generated 1215 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:04:56.448260 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-546ffd86-f6ab-44e5-aa41-cbf6b9959f62 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:04:56.448900 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-546ffd86-f6ab-44e5-aa41-cbf6b9959f62 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] [instance: 6d9cd6fc-504f-49cc-9abc-56d738ef4d8a] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:04:56.456481 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-546ffd86-f6ab-44e5-aa41-cbf6b9959f62 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:56.460542 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-546ffd86-f6ab-44e5-aa41-cbf6b9959f62 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:56.461224 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-546ffd86-f6ab-44e5-aa41-cbf6b9959f62 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:56.462200 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-546ffd86-f6ab-44e5-aa41-cbf6b9959f62 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:56.465673 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-546ffd86-f6ab-44e5-aa41-cbf6b9959f62 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:56.466338 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-546ffd86-f6ab-44e5-aa41-cbf6b9959f62 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:56.916161 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-546ffd86-f6ab-44e5-aa41-cbf6b9959f62 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973de86311b47e882de18efbcb3f67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e037651e3345a8b95ea528cae02c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:04:56.932607 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-546ffd86-f6ab-44e5-aa41-cbf6b9959f62 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] 10.222.0.43 "GET /compute/v2.1/servers/6d9cd6fc-504f-49cc-9abc-56d738ef4d8a" status: 200 len: 1325 microversion: 2.1 time: 0.488202 Oct 04 22:04:56.951759 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2187/4439] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:04:56 2022] GET /compute/v2.1/servers/6d9cd6fc-504f-49cc-9abc-56d738ef4d8a => generated 1325 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:04:56.984464 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-85e32c8f-9f3a-433e-8437-9ead0bf5907b tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:04:56.985099 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-85e32c8f-9f3a-433e-8437-9ead0bf5907b tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 48243e1b-892b-4c4b-8db1-242b2e40653b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:04:57.002019 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-85e32c8f-9f3a-433e-8437-9ead0bf5907b tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:57.002603 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-85e32c8f-9f3a-433e-8437-9ead0bf5907b tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:57.004565 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-85e32c8f-9f3a-433e-8437-9ead0bf5907b tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:57.005387 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-85e32c8f-9f3a-433e-8437-9ead0bf5907b tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:57.006541 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-85e32c8f-9f3a-433e-8437-9ead0bf5907b tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:57.006882 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-85e32c8f-9f3a-433e-8437-9ead0bf5907b tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:57.044553 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-9e564523-8a48-453c-8484-90c3cfbfd4e1 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:04:57.045178 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-9e564523-8a48-453c-8484-90c3cfbfd4e1 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: f45bd103-0f2f-4eb0-83f9-a084adb03d18] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:04:57.057835 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9e564523-8a48-453c-8484-90c3cfbfd4e1 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:57.058726 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9e564523-8a48-453c-8484-90c3cfbfd4e1 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:57.059318 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9e564523-8a48-453c-8484-90c3cfbfd4e1 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:57.060332 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9e564523-8a48-453c-8484-90c3cfbfd4e1 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:57.060940 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9e564523-8a48-453c-8484-90c3cfbfd4e1 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:57.061523 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9e564523-8a48-453c-8484-90c3cfbfd4e1 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:57.232223 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-9e564523-8a48-453c-8484-90c3cfbfd4e1 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a1c8d841104bc9b6910bcc2c0e2bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe9283584fc4d90b0715216d867ea2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:04:57.248180 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-9e564523-8a48-453c-8484-90c3cfbfd4e1 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "GET /compute/v2.1/servers/f45bd103-0f2f-4eb0-83f9-a084adb03d18" status: 200 len: 1267 microversion: 2.1 time: 0.207976 Oct 04 22:04:57.271219 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2188/4440] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:04:57 2022] GET /compute/v2.1/servers/f45bd103-0f2f-4eb0-83f9-a084adb03d18 => generated 1267 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:04:57.286251 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-85e32c8f-9f3a-433e-8437-9ead0bf5907b tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:04:57.298052 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-eb9eedf7-1c2a-4255-a176-69d18f76ad7f req-38c38973-0014-4268-a7e5-a9daf5166ac7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48243e1b-892b-4c4b-8db1-242b2e40653b", "tag": "a795c088-46ba-4a15-a651-33aa842e29b5"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:04:57.314034 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-85e32c8f-9f3a-433e-8437-9ead0bf5907b tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b" status: 200 len: 1363 microversion: 2.1 time: 0.332562 Oct 04 22:04:57.318376 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2253/4441] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:04:56 2022] GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b => generated 1363 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:04:57.327227 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-eb9eedf7-1c2a-4255-a176-69d18f76ad7f req-38c38973-0014-4268-a7e5-a9daf5166ac7 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:57.327923 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-eb9eedf7-1c2a-4255-a176-69d18f76ad7f req-38c38973-0014-4268-a7e5-a9daf5166ac7 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:57.328560 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-eb9eedf7-1c2a-4255-a176-69d18f76ad7f req-38c38973-0014-4268-a7e5-a9daf5166ac7 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:57.355421 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-eb9eedf7-1c2a-4255-a176-69d18f76ad7f req-38c38973-0014-4268-a7e5-a9daf5166ac7 service nova] Creating event network-changed:a795c088-46ba-4a15-a651-33aa842e29b5 for instance 48243e1b-892b-4c4b-8db1-242b2e40653b on n-h1-860284-1 Oct 04 22:04:57.361176 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-eb9eedf7-1c2a-4255-a176-69d18f76ad7f req-38c38973-0014-4268-a7e5-a9daf5166ac7 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069666 Oct 04 22:04:57.362508 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2189/4442] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:04:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:04:57.959162 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-787acc2e-21fc-47c5-afb9-486af4fd4cb2 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:04:57.960046 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-787acc2e-21fc-47c5-afb9-486af4fd4cb2 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] [instance: 6d9cd6fc-504f-49cc-9abc-56d738ef4d8a] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:04:57.968691 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-787acc2e-21fc-47c5-afb9-486af4fd4cb2 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:57.977582 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-787acc2e-21fc-47c5-afb9-486af4fd4cb2 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:57.978469 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-787acc2e-21fc-47c5-afb9-486af4fd4cb2 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:57.981645 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-787acc2e-21fc-47c5-afb9-486af4fd4cb2 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:57.982590 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-787acc2e-21fc-47c5-afb9-486af4fd4cb2 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:57.983904 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-787acc2e-21fc-47c5-afb9-486af4fd4cb2 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:58.292955 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-8b8392ec-a0ad-4cd8-a235-5da65645d30c tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:04:58.296548 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-8b8392ec-a0ad-4cd8-a235-5da65645d30c tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: f45bd103-0f2f-4eb0-83f9-a084adb03d18] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:04:58.327094 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8b8392ec-a0ad-4cd8-a235-5da65645d30c tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:58.333373 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8b8392ec-a0ad-4cd8-a235-5da65645d30c tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:58.333935 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8b8392ec-a0ad-4cd8-a235-5da65645d30c tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:58.337283 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8b8392ec-a0ad-4cd8-a235-5da65645d30c tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:58.338245 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8b8392ec-a0ad-4cd8-a235-5da65645d30c tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:58.356972 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8b8392ec-a0ad-4cd8-a235-5da65645d30c tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:58.548818 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-8b8392ec-a0ad-4cd8-a235-5da65645d30c tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a1c8d841104bc9b6910bcc2c0e2bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe9283584fc4d90b0715216d867ea2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:04:58.566874 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-8b8392ec-a0ad-4cd8-a235-5da65645d30c tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "GET /compute/v2.1/servers/f45bd103-0f2f-4eb0-83f9-a084adb03d18" status: 200 len: 1273 microversion: 2.1 time: 0.287985 Oct 04 22:04:58.579860 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2190/4443] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:04:58 2022] GET /compute/v2.1/servers/f45bd103-0f2f-4eb0-83f9-a084adb03d18 => generated 1273 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:04:58.594527 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-7300c3aa-30df-468a-bfc4-c94317070f25 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:04:58.595916 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-7300c3aa-30df-468a-bfc4-c94317070f25 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 48243e1b-892b-4c4b-8db1-242b2e40653b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:04:58.608162 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7300c3aa-30df-468a-bfc4-c94317070f25 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:58.609157 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7300c3aa-30df-468a-bfc4-c94317070f25 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:58.609995 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7300c3aa-30df-468a-bfc4-c94317070f25 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:58.611497 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7300c3aa-30df-468a-bfc4-c94317070f25 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:58.612290 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7300c3aa-30df-468a-bfc4-c94317070f25 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:58.612999 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7300c3aa-30df-468a-bfc4-c94317070f25 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:58.713669 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-787acc2e-21fc-47c5-afb9-486af4fd4cb2 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973de86311b47e882de18efbcb3f67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e037651e3345a8b95ea528cae02c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:04:58.733111 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-787acc2e-21fc-47c5-afb9-486af4fd4cb2 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] 10.222.0.43 "GET /compute/v2.1/servers/6d9cd6fc-504f-49cc-9abc-56d738ef4d8a" status: 200 len: 1325 microversion: 2.1 time: 0.778116 Oct 04 22:04:58.747509 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2254/4444] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:04:57 2022] GET /compute/v2.1/servers/6d9cd6fc-504f-49cc-9abc-56d738ef4d8a => generated 1325 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:04:58.755468 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-b0e8a102-a384-47b4-87de-5b0290b7169d tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Action: 'create', calling method: .version_select at 0x7fbb2f0b7430>, body: {"keypair": {"name": "tempest-keypair-466635076", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGaZWNEiFNfkTSSWKdCjZatTm2nLRqKsnsf4lPM9jXxOH/pIWAgKHrYBZxABAoN4EFSFARFeH7XujRZMRdPXHmFvvi0BFCaiCfIqz6ITz002zgXTqzHYN0bqW8qBl0mkSQ=="}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:04:58.779154 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-b0e8a102-a384-47b4-87de-5b0290b7169d tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Getting quotas for project 82e1a29234ce40f9b37d0eca196cd1db. Resources: {'key_pairs'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:04:58.785223 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-b0e8a102-a384-47b4-87de-5b0290b7169d tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Getting quotas for user 80fc56886fef422b9b52eb1dede7d10e and project 82e1a29234ce40f9b37d0eca196cd1db. Resources: {'key_pairs'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:04:58.827898 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-b0e8a102-a384-47b4-87de-5b0290b7169d tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.077882 Oct 04 22:04:58.835614 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2255/4445] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Oct 4 22:04:58 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:04:58.842723 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-0eb78a28-7a1f-4471-a165-6407dacec324 req-68b6217c-9669-492b-9cef-28ddcd98d149 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d9cd6fc-504f-49cc-9abc-56d738ef4d8a", "name": "network-vif-plugged", "status": "completed", "tag": "534c2dce-c50a-4f0e-8c09-676f22e4a597"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:04:58.858942 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-0eb78a28-7a1f-4471-a165-6407dacec324 req-68b6217c-9669-492b-9cef-28ddcd98d149 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:58.859783 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-0eb78a28-7a1f-4471-a165-6407dacec324 req-68b6217c-9669-492b-9cef-28ddcd98d149 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:58.860396 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-0eb78a28-7a1f-4471-a165-6407dacec324 req-68b6217c-9669-492b-9cef-28ddcd98d149 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:58.903152 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-0eb78a28-7a1f-4471-a165-6407dacec324 req-68b6217c-9669-492b-9cef-28ddcd98d149 service nova] Creating event network-vif-plugged:534c2dce-c50a-4f0e-8c09-676f22e4a597 for instance 6d9cd6fc-504f-49cc-9abc-56d738ef4d8a on n-h2-860284-1 Oct 04 22:04:58.921160 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-0eb78a28-7a1f-4471-a165-6407dacec324 req-68b6217c-9669-492b-9cef-28ddcd98d149 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087287 Oct 04 22:04:58.926107 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2256/4446] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:04:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:04:58.979087 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-7300c3aa-30df-468a-bfc4-c94317070f25 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:04:59.011584 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-7300c3aa-30df-468a-bfc4-c94317070f25 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b" status: 200 len: 1363 microversion: 2.1 time: 0.429662 Oct 04 22:04:59.012607 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2191/4447] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:04:58 2022] GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b => generated 1363 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:04:59.596341 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-fa695db7-3d2f-4afc-8f2e-194a24d24a74 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:04:59.597456 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-fa695db7-3d2f-4afc-8f2e-194a24d24a74 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: f45bd103-0f2f-4eb0-83f9-a084adb03d18] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:04:59.607841 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fa695db7-3d2f-4afc-8f2e-194a24d24a74 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:59.609066 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fa695db7-3d2f-4afc-8f2e-194a24d24a74 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:59.609938 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fa695db7-3d2f-4afc-8f2e-194a24d24a74 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:59.611061 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fa695db7-3d2f-4afc-8f2e-194a24d24a74 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:59.611802 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fa695db7-3d2f-4afc-8f2e-194a24d24a74 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:59.612842 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fa695db7-3d2f-4afc-8f2e-194a24d24a74 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:59.764751 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-49baef6e-fdef-4312-82ce-27f9c17d4fc5 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:04:59.768164 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-49baef6e-fdef-4312-82ce-27f9c17d4fc5 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] [instance: 6d9cd6fc-504f-49cc-9abc-56d738ef4d8a] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:04:59.785169 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-49baef6e-fdef-4312-82ce-27f9c17d4fc5 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:59.785924 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-49baef6e-fdef-4312-82ce-27f9c17d4fc5 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:59.786708 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-49baef6e-fdef-4312-82ce-27f9c17d4fc5 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:59.789634 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-49baef6e-fdef-4312-82ce-27f9c17d4fc5 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:59.790310 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-49baef6e-fdef-4312-82ce-27f9c17d4fc5 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:59.791248 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-49baef6e-fdef-4312-82ce-27f9c17d4fc5 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:59.818015 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=16,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:05:00.136427 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-fa695db7-3d2f-4afc-8f2e-194a24d24a74 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a1c8d841104bc9b6910bcc2c0e2bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe9283584fc4d90b0715216d867ea2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:05:00.148245 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-fa695db7-3d2f-4afc-8f2e-194a24d24a74 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "GET /compute/v2.1/servers/f45bd103-0f2f-4eb0-83f9-a084adb03d18" status: 200 len: 1315 microversion: 2.1 time: 0.556164 Oct 04 22:05:00.149519 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2257/4448] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:04:59 2022] GET /compute/v2.1/servers/f45bd103-0f2f-4eb0-83f9-a084adb03d18 => generated 1315 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:05:00.157053 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-aa456265-a30e-4a3d-9277-2f57ddbb5c53 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:05:00.157946 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-aa456265-a30e-4a3d-9277-2f57ddbb5c53 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 48243e1b-892b-4c4b-8db1-242b2e40653b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:05:00.166060 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-aa456265-a30e-4a3d-9277-2f57ddbb5c53 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:00.166990 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-aa456265-a30e-4a3d-9277-2f57ddbb5c53 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:00.167631 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-aa456265-a30e-4a3d-9277-2f57ddbb5c53 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:00.168692 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-aa456265-a30e-4a3d-9277-2f57ddbb5c53 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:00.169350 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-aa456265-a30e-4a3d-9277-2f57ddbb5c53 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:00.169975 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-aa456265-a30e-4a3d-9277-2f57ddbb5c53 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:00.272167 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-49baef6e-fdef-4312-82ce-27f9c17d4fc5 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973de86311b47e882de18efbcb3f67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e037651e3345a8b95ea528cae02c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:05:00.281343 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-49baef6e-fdef-4312-82ce-27f9c17d4fc5 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] 10.222.0.43 "GET /compute/v2.1/servers/6d9cd6fc-504f-49cc-9abc-56d738ef4d8a" status: 200 len: 1325 microversion: 2.1 time: 0.527339 Oct 04 22:05:00.286560 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2192/4449] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:04:59 2022] GET /compute/v2.1/servers/6d9cd6fc-504f-49cc-9abc-56d738ef4d8a => generated 1325 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:05:00.535699 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-aa456265-a30e-4a3d-9277-2f57ddbb5c53 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:05:00.548202 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-aa456265-a30e-4a3d-9277-2f57ddbb5c53 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b" status: 200 len: 1363 microversion: 2.1 time: 0.396755 Oct 04 22:05:00.549184 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2258/4450] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:05:00 2022] GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b => generated 1363 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:05:01.176747 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-332b8f47-53cd-4ed0-8eab-2af751b01cf6 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:05:01.177410 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-332b8f47-53cd-4ed0-8eab-2af751b01cf6 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: f45bd103-0f2f-4eb0-83f9-a084adb03d18] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:05:01.180258 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=4 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:05:01.181818 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=12 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:05:01.199825 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-332b8f47-53cd-4ed0-8eab-2af751b01cf6 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:01.200678 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-332b8f47-53cd-4ed0-8eab-2af751b01cf6 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:01.201368 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-332b8f47-53cd-4ed0-8eab-2af751b01cf6 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:01.202902 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-332b8f47-53cd-4ed0-8eab-2af751b01cf6 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:01.203557 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-332b8f47-53cd-4ed0-8eab-2af751b01cf6 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:01.204224 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-332b8f47-53cd-4ed0-8eab-2af751b01cf6 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:01.311471 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-8b0f185e-ee28-4e1a-9cc9-0b44300b5e73 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:05:01.312346 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-8b0f185e-ee28-4e1a-9cc9-0b44300b5e73 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] [instance: 6d9cd6fc-504f-49cc-9abc-56d738ef4d8a] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:05:01.332571 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8b0f185e-ee28-4e1a-9cc9-0b44300b5e73 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:01.336201 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8b0f185e-ee28-4e1a-9cc9-0b44300b5e73 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:01.336966 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8b0f185e-ee28-4e1a-9cc9-0b44300b5e73 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:01.341536 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8b0f185e-ee28-4e1a-9cc9-0b44300b5e73 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:01.343801 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8b0f185e-ee28-4e1a-9cc9-0b44300b5e73 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:01.346939 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8b0f185e-ee28-4e1a-9cc9-0b44300b5e73 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:01.607337 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-332b8f47-53cd-4ed0-8eab-2af751b01cf6 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a1c8d841104bc9b6910bcc2c0e2bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe9283584fc4d90b0715216d867ea2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:05:01.618868 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-332b8f47-53cd-4ed0-8eab-2af751b01cf6 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "GET /compute/v2.1/servers/f45bd103-0f2f-4eb0-83f9-a084adb03d18" status: 200 len: 1315 microversion: 2.1 time: 0.445243 Oct 04 22:05:01.620812 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2193/4451] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:05:01 2022] GET /compute/v2.1/servers/f45bd103-0f2f-4eb0-83f9-a084adb03d18 => generated 1315 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:05:01.641473 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-6342345a-7665-4871-b1ce-78743cffe48f req-eac6856c-2538-49e6-ac35-53f339273298 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f45bd103-0f2f-4eb0-83f9-a084adb03d18", "tag": "fca2bbb6-1283-4e6c-852d-1e4abc9390f9"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:05:01.657383 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-6342345a-7665-4871-b1ce-78743cffe48f req-eac6856c-2538-49e6-ac35-53f339273298 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:01.657913 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-6342345a-7665-4871-b1ce-78743cffe48f req-eac6856c-2538-49e6-ac35-53f339273298 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:01.658358 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-6342345a-7665-4871-b1ce-78743cffe48f req-eac6856c-2538-49e6-ac35-53f339273298 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:01.683190 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-6342345a-7665-4871-b1ce-78743cffe48f req-eac6856c-2538-49e6-ac35-53f339273298 service nova] Creating event network-changed:fca2bbb6-1283-4e6c-852d-1e4abc9390f9 for instance f45bd103-0f2f-4eb0-83f9-a084adb03d18 on n-h2-860284-1 Oct 04 22:05:01.697085 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-6342345a-7665-4871-b1ce-78743cffe48f req-eac6856c-2538-49e6-ac35-53f339273298 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071523 Oct 04 22:05:01.698744 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2194/4452] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:05:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:05:01.712279 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-eb21baae-3218-4e48-ace3-a265b1e8bc84 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:05:01.712935 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-eb21baae-3218-4e48-ace3-a265b1e8bc84 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 48243e1b-892b-4c4b-8db1-242b2e40653b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:05:01.729167 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-eb21baae-3218-4e48-ace3-a265b1e8bc84 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:01.729670 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-eb21baae-3218-4e48-ace3-a265b1e8bc84 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:01.730113 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-eb21baae-3218-4e48-ace3-a265b1e8bc84 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:01.730860 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-eb21baae-3218-4e48-ace3-a265b1e8bc84 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:01.731315 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-eb21baae-3218-4e48-ace3-a265b1e8bc84 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:01.753094 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-eb21baae-3218-4e48-ace3-a265b1e8bc84 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:01.870885 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-8b0f185e-ee28-4e1a-9cc9-0b44300b5e73 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973de86311b47e882de18efbcb3f67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e037651e3345a8b95ea528cae02c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:05:01.882262 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-8b0f185e-ee28-4e1a-9cc9-0b44300b5e73 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] 10.222.0.43 "GET /compute/v2.1/servers/6d9cd6fc-504f-49cc-9abc-56d738ef4d8a" status: 200 len: 1523 microversion: 2.1 time: 0.576770 Oct 04 22:05:01.888066 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2259/4453] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:05:01 2022] GET /compute/v2.1/servers/6d9cd6fc-504f-49cc-9abc-56d738ef4d8a => generated 1523 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:05:01.928492 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-cd61ca19-c3d3-4f46-a7b8-913b54a4dc5d tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:05:01.929295 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-cd61ca19-c3d3-4f46-a7b8-913b54a4dc5d tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] [instance: 6d9cd6fc-504f-49cc-9abc-56d738ef4d8a] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:05:01.941977 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cd61ca19-c3d3-4f46-a7b8-913b54a4dc5d tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:01.942513 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cd61ca19-c3d3-4f46-a7b8-913b54a4dc5d tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:01.942955 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cd61ca19-c3d3-4f46-a7b8-913b54a4dc5d tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:01.943718 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cd61ca19-c3d3-4f46-a7b8-913b54a4dc5d tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:01.944181 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cd61ca19-c3d3-4f46-a7b8-913b54a4dc5d tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:01.944612 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cd61ca19-c3d3-4f46-a7b8-913b54a4dc5d tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:02.004487 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-cd61ca19-c3d3-4f46-a7b8-913b54a4dc5d tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] [instance: 6d9cd6fc-504f-49cc-9abc-56d738ef4d8a] Going to try to terminate instance {{(pid=134102) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 22:05:02.180029 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-cd61ca19-c3d3-4f46-a7b8-913b54a4dc5d tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] 10.222.0.43 "DELETE /compute/v2.1/servers/6d9cd6fc-504f-49cc-9abc-56d738ef4d8a" status: 204 len: 0 microversion: 2.1 time: 0.254870 Oct 04 22:05:02.181320 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2260/4454] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 22:05:01 2022] DELETE /compute/v2.1/servers/6d9cd6fc-504f-49cc-9abc-56d738ef4d8a => generated 0 bytes in 257 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 22:05:02.191637 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-4b79add3-478d-4f43-b3df-ad5bd11c3d4c tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:05:02.195417 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-4b79add3-478d-4f43-b3df-ad5bd11c3d4c tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] [instance: 6d9cd6fc-504f-49cc-9abc-56d738ef4d8a] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:05:02.211242 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4b79add3-478d-4f43-b3df-ad5bd11c3d4c tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:02.211749 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4b79add3-478d-4f43-b3df-ad5bd11c3d4c tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:02.212272 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4b79add3-478d-4f43-b3df-ad5bd11c3d4c tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:02.213068 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4b79add3-478d-4f43-b3df-ad5bd11c3d4c tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:02.213463 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4b79add3-478d-4f43-b3df-ad5bd11c3d4c tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:02.213956 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4b79add3-478d-4f43-b3df-ad5bd11c3d4c tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:02.935254 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-eb21baae-3218-4e48-ace3-a265b1e8bc84 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:05:02.944761 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-eb21baae-3218-4e48-ace3-a265b1e8bc84 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b" status: 200 len: 1363 microversion: 2.1 time: 1.244417 Oct 04 22:05:02.945610 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2195/4455] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:05:01 2022] GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b => generated 1363 bytes in 1246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:05:02.967061 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-2a4c3348-e898-4427-aba7-d39fb9be4ee1 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1326348555", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f42d911e-d0db-47f1-8152-1d0e2f63f805"}], "security_groups": [{"name": "tempest-securitygroup--1068017738"}], "key_name": "tempest-keypair-466635076", "user_data": "}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:05:02.998337 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:INSERT=6 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:05:03.058034 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-4b79add3-478d-4f43-b3df-ad5bd11c3d4c tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973de86311b47e882de18efbcb3f67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e037651e3345a8b95ea528cae02c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:05:03.077164 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-4b79add3-478d-4f43-b3df-ad5bd11c3d4c tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] 10.222.0.43 "GET /compute/v2.1/servers/6d9cd6fc-504f-49cc-9abc-56d738ef4d8a" status: 200 len: 1529 microversion: 2.1 time: 0.891376 Oct 04 22:05:03.077772 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2261/4456] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:05:02 2022] GET /compute/v2.1/servers/6d9cd6fc-504f-49cc-9abc-56d738ef4d8a => generated 1529 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:05:03.090550 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-ee58d8d8-08c5-4dc9-8a22-06b867777f57 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:05:03.090550 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-ee58d8d8-08c5-4dc9-8a22-06b867777f57 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: f45bd103-0f2f-4eb0-83f9-a084adb03d18] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:05:03.092058 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ee58d8d8-08c5-4dc9-8a22-06b867777f57 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:03.098628 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ee58d8d8-08c5-4dc9-8a22-06b867777f57 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:03.099239 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ee58d8d8-08c5-4dc9-8a22-06b867777f57 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:03.101839 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ee58d8d8-08c5-4dc9-8a22-06b867777f57 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:03.102879 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ee58d8d8-08c5-4dc9-8a22-06b867777f57 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:03.103749 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ee58d8d8-08c5-4dc9-8a22-06b867777f57 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:03.488830 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.network.neutron [None req-2a4c3348-e898-4427-aba7-d39fb9be4ee1 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] validate_networks() for [('f42d911e-d0db-47f1-8152-1d0e2f63f805', None, None, None, None, None)] {{(pid=134101) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 22:05:03.716206 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-ee58d8d8-08c5-4dc9-8a22-06b867777f57 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a1c8d841104bc9b6910bcc2c0e2bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe9283584fc4d90b0715216d867ea2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:05:03.727948 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-ee58d8d8-08c5-4dc9-8a22-06b867777f57 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "GET /compute/v2.1/servers/f45bd103-0f2f-4eb0-83f9-a084adb03d18" status: 200 len: 1315 microversion: 2.1 time: 0.649105 Oct 04 22:05:03.734287 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2262/4457] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:05:03 2022] GET /compute/v2.1/servers/f45bd103-0f2f-4eb0-83f9-a084adb03d18 => generated 1315 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:05:03.969068 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-c85cb264-809a-4540-870e-bd316d065fbb tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:05:03.969760 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-c85cb264-809a-4540-870e-bd316d065fbb tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 48243e1b-892b-4c4b-8db1-242b2e40653b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:05:03.985219 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c85cb264-809a-4540-870e-bd316d065fbb tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:03.985746 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c85cb264-809a-4540-870e-bd316d065fbb tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:03.986199 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c85cb264-809a-4540-870e-bd316d065fbb tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:03.992962 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c85cb264-809a-4540-870e-bd316d065fbb tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:03.993490 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c85cb264-809a-4540-870e-bd316d065fbb tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:03.994412 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c85cb264-809a-4540-870e-bd316d065fbb tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:04.531736 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-c85cb264-809a-4540-870e-bd316d065fbb tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:05:04.541778 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-c85cb264-809a-4540-870e-bd316d065fbb tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b" status: 200 len: 1363 microversion: 2.1 time: 0.576929 Oct 04 22:05:04.548715 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2263/4458] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:05:03 2022] GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b => generated 1363 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:05:04.559183 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-02b0bc35-b2d0-4c61-bb61-ffad330160d8 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:05:04.562968 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-02b0bc35-b2d0-4c61-bb61-ffad330160d8 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] [instance: 6d9cd6fc-504f-49cc-9abc-56d738ef4d8a] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:05:04.576572 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-02b0bc35-b2d0-4c61-bb61-ffad330160d8 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:04.577270 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-02b0bc35-b2d0-4c61-bb61-ffad330160d8 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:04.578887 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-02b0bc35-b2d0-4c61-bb61-ffad330160d8 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:04.579795 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-02b0bc35-b2d0-4c61-bb61-ffad330160d8 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:04.583353 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-02b0bc35-b2d0-4c61-bb61-ffad330160d8 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:04.586688 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-02b0bc35-b2d0-4c61-bb61-ffad330160d8 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:05.032507 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-02b0bc35-b2d0-4c61-bb61-ffad330160d8 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973de86311b47e882de18efbcb3f67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e037651e3345a8b95ea528cae02c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:05:05.049122 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-02b0bc35-b2d0-4c61-bb61-ffad330160d8 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] 10.222.0.43 "GET /compute/v2.1/servers/6d9cd6fc-504f-49cc-9abc-56d738ef4d8a" status: 200 len: 1529 microversion: 2.1 time: 0.493927 Oct 04 22:05:05.049833 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2264/4459] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:05:04 2022] GET /compute/v2.1/servers/6d9cd6fc-504f-49cc-9abc-56d738ef4d8a => generated 1529 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:05:05.076036 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-2a4c3348-e898-4427-aba7-d39fb9be4ee1 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Flavor limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 22:05:05.076638 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-2a4c3348-e898-4427-aba7-d39fb9be4ee1 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Image limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 22:05:05.077016 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-2a4c3348-e898-4427-aba7-d39fb9be4ee1 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Flavor pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 22:05:05.077435 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-2a4c3348-e898-4427-aba7-d39fb9be4ee1 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Image pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 22:05:05.077857 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-2a4c3348-e898-4427-aba7-d39fb9be4ee1 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 22:05:05.089559 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-b471dc5b-48a2-4f6a-83a6-675e5a5efffe tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:05:05.090279 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-b471dc5b-48a2-4f6a-83a6-675e5a5efffe tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: f45bd103-0f2f-4eb0-83f9-a084adb03d18] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:05:05.103594 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2a4c3348-e898-4427-aba7-d39fb9be4ee1 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:05.104325 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2a4c3348-e898-4427-aba7-d39fb9be4ee1 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:05.104707 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2a4c3348-e898-4427-aba7-d39fb9be4ee1 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:05.112142 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2a4c3348-e898-4427-aba7-d39fb9be4ee1 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:05.112727 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2a4c3348-e898-4427-aba7-d39fb9be4ee1 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:05.113186 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2a4c3348-e898-4427-aba7-d39fb9be4ee1 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:05.115529 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b471dc5b-48a2-4f6a-83a6-675e5a5efffe tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:05.119716 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b471dc5b-48a2-4f6a-83a6-675e5a5efffe tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:05.120244 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b471dc5b-48a2-4f6a-83a6-675e5a5efffe tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:05.123388 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b471dc5b-48a2-4f6a-83a6-675e5a5efffe tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:05.127573 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b471dc5b-48a2-4f6a-83a6-675e5a5efffe tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:05.133023 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b471dc5b-48a2-4f6a-83a6-675e5a5efffe tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:05.201335 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-2a4c3348-e898-4427-aba7-d39fb9be4ee1 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Getting quotas for project 82e1a29234ce40f9b37d0eca196cd1db. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:05:05.217249 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-2a4c3348-e898-4427-aba7-d39fb9be4ee1 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Getting quotas for user 80fc56886fef422b9b52eb1dede7d10e and project 82e1a29234ce40f9b37d0eca196cd1db. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:05:05.237693 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-2a4c3348-e898-4427-aba7-d39fb9be4ee1 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Going to run 1 instances... {{(pid=134101) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 22:05:05.240299 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-2a4c3348-e898-4427-aba7-d39fb9be4ee1 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] [instance: 9fd64a5e-1e76-4841-bf99-37ab4d2ce55a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='58548514-5dac-426c-81f5-19e3fba33e23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134101) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 22:05:05.337950 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-2a4c3348-e898-4427-aba7-d39fb9be4ee1 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.375426 Oct 04 22:05:05.350291 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2196/4460] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 22:05:02 2022] POST /compute/v2.1/servers => generated 402 bytes in 2388 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 22:05:05.367316 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-43b7d8b7-92ce-401d-bcc5-5b34f749c749 req-53db993d-2c14-4a26-bd4a-855b1b8a587d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48243e1b-892b-4c4b-8db1-242b2e40653b", "name": "network-vif-plugged", "status": "completed", "tag": "a795c088-46ba-4a15-a651-33aa842e29b5"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:05:05.390672 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-43b7d8b7-92ce-401d-bcc5-5b34f749c749 req-53db993d-2c14-4a26-bd4a-855b1b8a587d service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:05.392185 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-43b7d8b7-92ce-401d-bcc5-5b34f749c749 req-53db993d-2c14-4a26-bd4a-855b1b8a587d service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:05.392829 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-43b7d8b7-92ce-401d-bcc5-5b34f749c749 req-53db993d-2c14-4a26-bd4a-855b1b8a587d service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:05.437771 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-43b7d8b7-92ce-401d-bcc5-5b34f749c749 req-53db993d-2c14-4a26-bd4a-855b1b8a587d service nova] Creating event network-vif-plugged:a795c088-46ba-4a15-a651-33aa842e29b5 for instance 48243e1b-892b-4c4b-8db1-242b2e40653b on n-h1-860284-1 Oct 04 22:05:05.448886 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-43b7d8b7-92ce-401d-bcc5-5b34f749c749 req-53db993d-2c14-4a26-bd4a-855b1b8a587d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096071 Oct 04 22:05:05.451748 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2197/4461] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:05:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:05:05.464432 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-61498ee5-a565-4ca2-ab32-de49bc69488f tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:05:05.466647 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-61498ee5-a565-4ca2-ab32-de49bc69488f tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] [instance: 9fd64a5e-1e76-4841-bf99-37ab4d2ce55a] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:05:05.509653 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell0:SELECT=2 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:05:05.605940 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-61498ee5-a565-4ca2-ab32-de49bc69488f tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80fc56886fef422b9b52eb1dede7d10e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82e1a29234ce40f9b37d0eca196cd1db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:05:05.622631 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-61498ee5-a565-4ca2-ab32-de49bc69488f tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] 10.222.0.43 "GET /compute/v2.1/servers/9fd64a5e-1e76-4841-bf99-37ab4d2ce55a" status: 200 len: 1241 microversion: 2.1 time: 0.159797 Oct 04 22:05:05.632440 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2198/4462] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:05:05 2022] GET /compute/v2.1/servers/9fd64a5e-1e76-4841-bf99-37ab4d2ce55a => generated 1241 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:05:05.647164 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-d8943b5a-3b2f-42fc-b328-46a52ee31088 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:05:05.648272 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-d8943b5a-3b2f-42fc-b328-46a52ee31088 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 48243e1b-892b-4c4b-8db1-242b2e40653b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:05:05.659015 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d8943b5a-3b2f-42fc-b328-46a52ee31088 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:05.664009 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d8943b5a-3b2f-42fc-b328-46a52ee31088 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:05.665181 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d8943b5a-3b2f-42fc-b328-46a52ee31088 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:05.666401 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d8943b5a-3b2f-42fc-b328-46a52ee31088 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:05.668376 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d8943b5a-3b2f-42fc-b328-46a52ee31088 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:05.678504 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d8943b5a-3b2f-42fc-b328-46a52ee31088 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:05.946226 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-b471dc5b-48a2-4f6a-83a6-675e5a5efffe tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a1c8d841104bc9b6910bcc2c0e2bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe9283584fc4d90b0715216d867ea2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:05:05.962094 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-b471dc5b-48a2-4f6a-83a6-675e5a5efffe tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "GET /compute/v2.1/servers/f45bd103-0f2f-4eb0-83f9-a084adb03d18" status: 200 len: 1315 microversion: 2.1 time: 0.895816 Oct 04 22:05:05.962964 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2265/4463] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:05:05 2022] GET /compute/v2.1/servers/f45bd103-0f2f-4eb0-83f9-a084adb03d18 => generated 1315 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:05:06.073939 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-b7768397-9de4-4f12-8ad6-02007f168ec3 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:05:06.075031 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-b7768397-9de4-4f12-8ad6-02007f168ec3 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] [instance: 6d9cd6fc-504f-49cc-9abc-56d738ef4d8a] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:05:06.092910 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b7768397-9de4-4f12-8ad6-02007f168ec3 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:06.097032 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b7768397-9de4-4f12-8ad6-02007f168ec3 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:06.098311 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b7768397-9de4-4f12-8ad6-02007f168ec3 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:06.100664 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b7768397-9de4-4f12-8ad6-02007f168ec3 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:06.104844 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b7768397-9de4-4f12-8ad6-02007f168ec3 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:06.105649 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b7768397-9de4-4f12-8ad6-02007f168ec3 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:06.365159 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-d8943b5a-3b2f-42fc-b328-46a52ee31088 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:05:06.374989 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-d8943b5a-3b2f-42fc-b328-46a52ee31088 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b" status: 200 len: 1363 microversion: 2.1 time: 0.741287 Oct 04 22:05:06.380175 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2199/4464] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:05:05 2022] GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b => generated 1363 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:05:06.463443 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-b7768397-9de4-4f12-8ad6-02007f168ec3 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973de86311b47e882de18efbcb3f67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e037651e3345a8b95ea528cae02c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:05:06.481183 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-b7768397-9de4-4f12-8ad6-02007f168ec3 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] 10.222.0.43 "GET /compute/v2.1/servers/6d9cd6fc-504f-49cc-9abc-56d738ef4d8a" status: 200 len: 1529 microversion: 2.1 time: 0.413260 Oct 04 22:05:06.482241 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2266/4465] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:05:06 2022] GET /compute/v2.1/servers/6d9cd6fc-504f-49cc-9abc-56d738ef4d8a => generated 1529 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:05:06.645285 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-0fa3b60d-191c-40b1-95a8-b22e527a24ab tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:05:06.649635 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-0fa3b60d-191c-40b1-95a8-b22e527a24ab tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] [instance: 9fd64a5e-1e76-4841-bf99-37ab4d2ce55a] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:05:06.670162 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0fa3b60d-191c-40b1-95a8-b22e527a24ab tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:06.670709 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0fa3b60d-191c-40b1-95a8-b22e527a24ab tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:06.671154 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0fa3b60d-191c-40b1-95a8-b22e527a24ab tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:06.671880 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0fa3b60d-191c-40b1-95a8-b22e527a24ab tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:06.672341 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0fa3b60d-191c-40b1-95a8-b22e527a24ab tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:06.672772 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0fa3b60d-191c-40b1-95a8-b22e527a24ab tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:06.988847 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-85226957-8bf7-4d75-aed3-7515807d7a60 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:05:06.989468 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-85226957-8bf7-4d75-aed3-7515807d7a60 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: f45bd103-0f2f-4eb0-83f9-a084adb03d18] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:05:06.996469 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-85226957-8bf7-4d75-aed3-7515807d7a60 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:06.996962 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-85226957-8bf7-4d75-aed3-7515807d7a60 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:06.997401 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-85226957-8bf7-4d75-aed3-7515807d7a60 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:06.998101 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-85226957-8bf7-4d75-aed3-7515807d7a60 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:07.003582 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-85226957-8bf7-4d75-aed3-7515807d7a60 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:07.004184 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-85226957-8bf7-4d75-aed3-7515807d7a60 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:07.049403 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-0fa3b60d-191c-40b1-95a8-b22e527a24ab tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80fc56886fef422b9b52eb1dede7d10e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82e1a29234ce40f9b37d0eca196cd1db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:05:07.062405 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-0fa3b60d-191c-40b1-95a8-b22e527a24ab tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] 10.222.0.43 "GET /compute/v2.1/servers/9fd64a5e-1e76-4841-bf99-37ab4d2ce55a" status: 200 len: 1245 microversion: 2.1 time: 0.420933 Oct 04 22:05:07.071905 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2200/4466] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:05:06 2022] GET /compute/v2.1/servers/9fd64a5e-1e76-4841-bf99-37ab4d2ce55a => generated 1245 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:05:07.216730 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-85226957-8bf7-4d75-aed3-7515807d7a60 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a1c8d841104bc9b6910bcc2c0e2bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe9283584fc4d90b0715216d867ea2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:05:07.225363 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-85226957-8bf7-4d75-aed3-7515807d7a60 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "GET /compute/v2.1/servers/f45bd103-0f2f-4eb0-83f9-a084adb03d18" status: 200 len: 1315 microversion: 2.1 time: 0.239800 Oct 04 22:05:07.225964 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2267/4467] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:05:06 2022] GET /compute/v2.1/servers/f45bd103-0f2f-4eb0-83f9-a084adb03d18 => generated 1315 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:05:07.272900 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-058aa715-b6da-4f39-9945-4809eac4a2ad req-5ffcf489-bcd1-4edd-ab40-af50167e0f1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d9cd6fc-504f-49cc-9abc-56d738ef4d8a", "name": "network-vif-deleted", "tag": "534c2dce-c50a-4f0e-8c09-676f22e4a597"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:05:07.326958 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-058aa715-b6da-4f39-9945-4809eac4a2ad req-5ffcf489-bcd1-4edd-ab40-af50167e0f1d service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:07.327212 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-058aa715-b6da-4f39-9945-4809eac4a2ad req-5ffcf489-bcd1-4edd-ab40-af50167e0f1d service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:07.327586 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-058aa715-b6da-4f39-9945-4809eac4a2ad req-5ffcf489-bcd1-4edd-ab40-af50167e0f1d service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:07.366444 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-058aa715-b6da-4f39-9945-4809eac4a2ad req-5ffcf489-bcd1-4edd-ab40-af50167e0f1d service nova] Creating event network-vif-deleted:534c2dce-c50a-4f0e-8c09-676f22e4a597 for instance 6d9cd6fc-504f-49cc-9abc-56d738ef4d8a on n-h2-860284-1 Oct 04 22:05:07.381921 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-058aa715-b6da-4f39-9945-4809eac4a2ad req-5ffcf489-bcd1-4edd-ab40-af50167e0f1d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115570 Oct 04 22:05:07.386395 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2201/4468] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:05:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:05:07.419493 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-aae9ec64-c3b3-4081-a257-dc9d18622c53 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:05:07.420184 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-aae9ec64-c3b3-4081-a257-dc9d18622c53 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 48243e1b-892b-4c4b-8db1-242b2e40653b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:05:07.437976 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-aae9ec64-c3b3-4081-a257-dc9d18622c53 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:07.440030 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-aae9ec64-c3b3-4081-a257-dc9d18622c53 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:07.440678 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-aae9ec64-c3b3-4081-a257-dc9d18622c53 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:07.446156 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-aae9ec64-c3b3-4081-a257-dc9d18622c53 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:07.446866 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-aae9ec64-c3b3-4081-a257-dc9d18622c53 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:07.460203 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-aae9ec64-c3b3-4081-a257-dc9d18622c53 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:07.510494 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-4f68d3f8-e1a1-4f88-8f6b-1f0e3734f3db tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:05:07.514960 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-4f68d3f8-e1a1-4f88-8f6b-1f0e3734f3db tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] [instance: 6d9cd6fc-504f-49cc-9abc-56d738ef4d8a] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:05:07.565538 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4f68d3f8-e1a1-4f88-8f6b-1f0e3734f3db tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:07.586769 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4f68d3f8-e1a1-4f88-8f6b-1f0e3734f3db tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:07.610081 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4f68d3f8-e1a1-4f88-8f6b-1f0e3734f3db tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:07.610897 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4f68d3f8-e1a1-4f88-8f6b-1f0e3734f3db tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:07.611384 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4f68d3f8-e1a1-4f88-8f6b-1f0e3734f3db tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:07.611823 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4f68d3f8-e1a1-4f88-8f6b-1f0e3734f3db tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:07.725362 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4f68d3f8-e1a1-4f88-8f6b-1f0e3734f3db tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:07.727140 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4f68d3f8-e1a1-4f88-8f6b-1f0e3734f3db tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:07.728886 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4f68d3f8-e1a1-4f88-8f6b-1f0e3734f3db tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:07.730987 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.objects.instance [None req-4f68d3f8-e1a1-4f88-8f6b-1f0e3734f3db tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lazy-loading 'fault' on Instance uuid 6d9cd6fc-504f-49cc-9abc-56d738ef4d8a {{(pid=134101) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 22:05:08.196504 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-4f68d3f8-e1a1-4f88-8f6b-1f0e3734f3db tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973de86311b47e882de18efbcb3f67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e037651e3345a8b95ea528cae02c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:05:08.257469 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-4f68d3f8-e1a1-4f88-8f6b-1f0e3734f3db tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] 10.222.0.43 "GET /compute/v2.1/servers/6d9cd6fc-504f-49cc-9abc-56d738ef4d8a" status: 200 len: 1315 microversion: 2.1 time: 0.749402 Oct 04 22:05:08.261914 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2202/4469] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:05:07 2022] GET /compute/v2.1/servers/6d9cd6fc-504f-49cc-9abc-56d738ef4d8a => generated 1315 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:05:08.282946 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-ba4957c8-151b-425c-8391-76de8a928e6b tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:05:08.283971 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-ba4957c8-151b-425c-8391-76de8a928e6b tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] [instance: 9fd64a5e-1e76-4841-bf99-37ab4d2ce55a] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:05:08.302479 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ba4957c8-151b-425c-8391-76de8a928e6b tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:08.303504 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ba4957c8-151b-425c-8391-76de8a928e6b tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:08.307807 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ba4957c8-151b-425c-8391-76de8a928e6b tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:08.309041 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ba4957c8-151b-425c-8391-76de8a928e6b tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:08.309874 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ba4957c8-151b-425c-8391-76de8a928e6b tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:08.312382 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ba4957c8-151b-425c-8391-76de8a928e6b tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:08.549603 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-aae9ec64-c3b3-4081-a257-dc9d18622c53 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:05:08.561555 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-aae9ec64-c3b3-4081-a257-dc9d18622c53 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b" status: 200 len: 1363 microversion: 2.1 time: 1.155217 Oct 04 22:05:08.565194 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2268/4470] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:05:07 2022] GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b => generated 1363 bytes in 1160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:05:08.576028 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-dde8e02a-b000-4aad-8749-24b7e03303cd tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:05:08.577359 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-dde8e02a-b000-4aad-8749-24b7e03303cd tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: f45bd103-0f2f-4eb0-83f9-a084adb03d18] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:05:08.590030 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dde8e02a-b000-4aad-8749-24b7e03303cd tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:08.591002 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dde8e02a-b000-4aad-8749-24b7e03303cd tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:08.591868 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dde8e02a-b000-4aad-8749-24b7e03303cd tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:08.593153 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dde8e02a-b000-4aad-8749-24b7e03303cd tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:08.594398 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dde8e02a-b000-4aad-8749-24b7e03303cd tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:08.595101 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dde8e02a-b000-4aad-8749-24b7e03303cd tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:08.600102 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:05:08.612005 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-ba4957c8-151b-425c-8391-76de8a928e6b tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80fc56886fef422b9b52eb1dede7d10e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82e1a29234ce40f9b37d0eca196cd1db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:05:08.641654 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-ba4957c8-151b-425c-8391-76de8a928e6b tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] 10.222.0.43 "GET /compute/v2.1/servers/9fd64a5e-1e76-4841-bf99-37ab4d2ce55a" status: 200 len: 1301 microversion: 2.1 time: 0.373399 Oct 04 22:05:08.658638 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2203/4471] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:05:08 2022] GET /compute/v2.1/servers/9fd64a5e-1e76-4841-bf99-37ab4d2ce55a => generated 1301 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:05:08.663326 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-0286c4c0-c4c7-46ad-84b5-9c13fbb8d65b req-fbc5f0c2-d274-47f7-bddf-13185fe4d1ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f45bd103-0f2f-4eb0-83f9-a084adb03d18", "name": "network-vif-plugged", "status": "completed", "tag": "fca2bbb6-1283-4e6c-852d-1e4abc9390f9"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:05:08.703106 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-0286c4c0-c4c7-46ad-84b5-9c13fbb8d65b req-fbc5f0c2-d274-47f7-bddf-13185fe4d1ec service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:08.703948 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-0286c4c0-c4c7-46ad-84b5-9c13fbb8d65b req-fbc5f0c2-d274-47f7-bddf-13185fe4d1ec service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:08.710863 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-0286c4c0-c4c7-46ad-84b5-9c13fbb8d65b req-fbc5f0c2-d274-47f7-bddf-13185fe4d1ec service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:08.726965 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-0286c4c0-c4c7-46ad-84b5-9c13fbb8d65b req-fbc5f0c2-d274-47f7-bddf-13185fe4d1ec service nova] Creating event network-vif-plugged:fca2bbb6-1283-4e6c-852d-1e4abc9390f9 for instance f45bd103-0f2f-4eb0-83f9-a084adb03d18 on n-h2-860284-1 Oct 04 22:05:08.736746 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-0286c4c0-c4c7-46ad-84b5-9c13fbb8d65b req-fbc5f0c2-d274-47f7-bddf-13185fe4d1ec service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086467 Oct 04 22:05:08.738219 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2204/4472] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:05:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:05:08.797493 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell0:SELECT=20 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:05:08.947008 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-dde8e02a-b000-4aad-8749-24b7e03303cd tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a1c8d841104bc9b6910bcc2c0e2bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe9283584fc4d90b0715216d867ea2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:05:08.959456 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-dde8e02a-b000-4aad-8749-24b7e03303cd tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "GET /compute/v2.1/servers/f45bd103-0f2f-4eb0-83f9-a084adb03d18" status: 200 len: 1315 microversion: 2.1 time: 0.392451 Oct 04 22:05:08.962610 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2269/4473] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:05:08 2022] GET /compute/v2.1/servers/f45bd103-0f2f-4eb0-83f9-a084adb03d18 => generated 1315 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:05:09.296097 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-170dd6c4-6017-4d2c-88f0-6d33abb6b15c tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:05:09.296973 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-170dd6c4-6017-4d2c-88f0-6d33abb6b15c tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] [instance: 6d9cd6fc-504f-49cc-9abc-56d738ef4d8a] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:05:09.308987 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-170dd6c4-6017-4d2c-88f0-6d33abb6b15c tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:09.309821 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-170dd6c4-6017-4d2c-88f0-6d33abb6b15c tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:09.310843 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-170dd6c4-6017-4d2c-88f0-6d33abb6b15c tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:09.311857 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-170dd6c4-6017-4d2c-88f0-6d33abb6b15c tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:09.313484 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-170dd6c4-6017-4d2c-88f0-6d33abb6b15c tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:09.314010 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-170dd6c4-6017-4d2c-88f0-6d33abb6b15c tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:09.342906 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-170dd6c4-6017-4d2c-88f0-6d33abb6b15c tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] HTTP exception thrown: Instance 6d9cd6fc-504f-49cc-9abc-56d738ef4d8a could not be found. Oct 04 22:05:09.346423 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-170dd6c4-6017-4d2c-88f0-6d33abb6b15c tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Request method failure captured: Oct 04 22:05:09.346423 n-d-860284-1 devstack@n-api.service[134101]: request: GET /compute/v2.1/servers/6d9cd6fc-504f-49cc-9abc-56d738ef4d8a HTTP/1.1 Oct 04 22:05:09.346423 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 22:05:09.346423 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 22:05:09.346423 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 22:05:09.346423 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 22:05:09.346423 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 22:05:09.346423 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 22:05:09.346423 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 22:05:09.346423 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 22:05:09.346423 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPK2uaWdbUBgaC4RfPmjtTbjIfwc-i2umyIIBK_cF0D-_RCmikTip9FKSkMA-3LEgg0VpJcoPxMz4oo_myk5qoqg03ZgavcBoIAuumM_46SfpdfsovWLWxw7rAOFQTEcjFL3h_S0RmznoPUhj4-fuUVB2M5gfUS2qQyVeicBq2kx7daY Oct 04 22:05:09.346423 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 22:05:09.346423 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 22:05:09.346423 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 22:05:09.346423 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 22:05:09.346423 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 22:05:09.346423 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 22:05:09.346423 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: a1e037651e3345a8b95ea528cae02c9f Oct 04 22:05:09.346423 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-342298031 Oct 04 22:05:09.346423 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 22:05:09.346423 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 22:05:09.346423 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a1e037651e3345a8b95ea528cae02c9f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_a1e037651e3345a8b95ea528cae02c9f", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a1e037651e3345a8b95ea528cae02c9f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/a1e037651e3345a8b95ea528cae02c9f"}]}] Oct 04 22:05:09.346423 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-342298031 Oct 04 22:05:09.346423 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: a1e037651e3345a8b95ea528cae02c9f Oct 04 22:05:09.346423 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-342298031 Oct 04 22:05:09.346423 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-ImagesOneServerNegativeTestJSON-342298031-project Oct 04 22:05:09.346423 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 22:05:09.346423 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 22:05:09.346423 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 9973de86311b47e882de18efbcb3f67f Oct 04 22:05:09.346423 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-342298031-project Oct 04 22:05:09.346423 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 22:05:09.346423 n-d-860284-1 devstack@n-api.service[134101]: exception: Instance 6d9cd6fc-504f-49cc-9abc-56d738ef4d8a could not be found. Oct 04 22:05:09.346423 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': '6d9cd6fc-504f-49cc-9abc-56d738ef4d8a'} Oct 04 22:05:09.346423 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:05:09.346423 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:05:09.346423 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:05:09.346423 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:05:09.346423 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:05:09.346423 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:05:09.346423 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:05:09.346423 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:05:09.346423 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:05:09.346423 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:05:09.346423 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d9cd6fc-504f-49cc-9abc-56d738ef4d8a could not be found. Oct 04 22:05:09.346423 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:05:09.346423 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:05:09.346423 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:05:09.346423 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:05:09.346423 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:05:09.346423 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:05:09.346423 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:05:09.346423 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:05:09.346423 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:05:09.346423 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:05:09.346423 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:05:09.346423 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:05:09.346423 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:05:09.346423 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:05:09.346423 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:05:09.346423 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:05:09.346423 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d9cd6fc-504f-49cc-9abc-56d738ef4d8a could not be found. Oct 04 22:05:09.346423 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:05:09.346423 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:05:09.352149 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:05:09.352149 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:05:09.352149 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:05:09.352149 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:05:09.352149 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:05:09.352149 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:05:09.352149 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d9cd6fc-504f-49cc-9abc-56d738ef4d8a could not be found. Oct 04 22:05:09.352149 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:05:09.352149 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-170dd6c4-6017-4d2c-88f0-6d33abb6b15c tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Returning 404 to user: Instance 6d9cd6fc-504f-49cc-9abc-56d738ef4d8a could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:05:09.352149 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-170dd6c4-6017-4d2c-88f0-6d33abb6b15c tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] 10.222.0.43 "GET /compute/v2.1/servers/6d9cd6fc-504f-49cc-9abc-56d738ef4d8a" status: 404 len: 111 microversion: 2.1 time: 0.065011 Oct 04 22:05:09.374943 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2205/4474] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:05:09 2022] GET /compute/v2.1/servers/6d9cd6fc-504f-49cc-9abc-56d738ef4d8a => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:05:09.375554 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-9015d67c-88c8-4829-a0df-e9da35d25c80 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Calling method '.version_select at 0x7fbb2f0b7c10>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:05:09.435236 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-9015d67c-88c8-4829-a0df-e9da35d25c80 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] HTTP exception thrown: Image not found. Oct 04 22:05:09.438543 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-9015d67c-88c8-4829-a0df-e9da35d25c80 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Request method failure captured: Oct 04 22:05:09.438543 n-d-860284-1 devstack@n-api.service[134102]: request: DELETE /compute/v2.1/images/be62032a-0e01-4e9d-9f5a-3eb7f039329e HTTP/1.1 Oct 04 22:05:09.438543 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 22:05:09.438543 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 22:05:09.438543 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 22:05:09.438543 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 22:05:09.438543 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 22:05:09.438543 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 22:05:09.438543 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 22:05:09.438543 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 22:05:09.438543 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPK2uaWdbUBgaC4RfPmjtTbjIfwc-i2umyIIBK_cF0D-_RCmikTip9FKSkMA-3LEgg0VpJcoPxMz4oo_myk5qoqg03ZgavcBoIAuumM_46SfpdfsovWLWxw7rAOFQTEcjFL3h_S0RmznoPUhj4-fuUVB2M5gfUS2qQyVeicBq2kx7daY Oct 04 22:05:09.438543 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 22:05:09.438543 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 22:05:09.438543 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 22:05:09.438543 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 22:05:09.438543 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 22:05:09.438543 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 22:05:09.438543 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: a1e037651e3345a8b95ea528cae02c9f Oct 04 22:05:09.438543 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-342298031 Oct 04 22:05:09.438543 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 22:05:09.438543 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 22:05:09.438543 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a1e037651e3345a8b95ea528cae02c9f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_a1e037651e3345a8b95ea528cae02c9f", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a1e037651e3345a8b95ea528cae02c9f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/a1e037651e3345a8b95ea528cae02c9f"}]}] Oct 04 22:05:09.438543 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-342298031 Oct 04 22:05:09.438543 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: a1e037651e3345a8b95ea528cae02c9f Oct 04 22:05:09.438543 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-342298031 Oct 04 22:05:09.438543 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-ImagesOneServerNegativeTestJSON-342298031-project Oct 04 22:05:09.438543 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 22:05:09.438543 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 22:05:09.438543 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: 9973de86311b47e882de18efbcb3f67f Oct 04 22:05:09.438543 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-342298031-project Oct 04 22:05:09.438543 n-d-860284-1 devstack@n-api.service[134102]: method: Oct 04 22:05:09.438543 n-d-860284-1 devstack@n-api.service[134102]: exception: Image not found. Oct 04 22:05:09.438543 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': 'be62032a-0e01-4e9d-9f5a-3eb7f039329e'} Oct 04 22:05:09.438543 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:05:09.438543 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:05:09.438543 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 04 22:05:09.438543 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 04 22:05:09.438543 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 22:05:09.438543 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 22:05:09.438543 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 22:05:09.438543 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 22:05:09.438543 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 04 22:05:09.438543 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 04 22:05:09.438543 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 04 22:05:09.438543 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 04 22:05:09.438543 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 22:05:09.438543 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 22:05:09.438543 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 22:05:09.438543 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 22:05:09.438543 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image be62032a-0e01-4e9d-9f5a-3eb7f039329e to delete Oct 04 22:05:09.438543 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:05:09.438543 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:05:09.438543 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:05:09.438543 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:05:09.438543 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 04 22:05:09.438543 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 04 22:05:09.438543 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 04 22:05:09.438543 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 04 22:05:09.438543 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 04 22:05:09.438543 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 04 22:05:09.438543 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image be62032a-0e01-4e9d-9f5a-3eb7f039329e could not be found. Oct 04 22:05:09.438543 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:05:09.438543 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:05:09.438543 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:05:09.444689 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:05:09.444689 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:05:09.444689 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:05:09.444689 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:05:09.444689 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:05:09.444689 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 22:05:09.444689 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 22:05:09.444689 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:05:09.444689 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:05:09.444689 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 04 22:05:09.444689 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 22:05:09.444689 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 22:05:09.444689 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:05:09.444689 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:05:09.444689 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:05:09.444689 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:05:09.444689 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:05:09.444689 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:05:09.444689 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:05:09.444689 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:05:09.444689 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 22:05:09.444689 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:05:09.444689 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-9015d67c-88c8-4829-a0df-e9da35d25c80 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Returning 404 to user: Image not found. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:05:09.444689 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-9015d67c-88c8-4829-a0df-e9da35d25c80 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] 10.222.0.43 "DELETE /compute/v2.1/images/be62032a-0e01-4e9d-9f5a-3eb7f039329e" status: 404 len: 62 microversion: 2.1 time: 0.071703 Oct 04 22:05:09.444689 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2270/4475] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:05:09 2022] DELETE /compute/v2.1/images/be62032a-0e01-4e9d-9f5a-3eb7f039329e => generated 62 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 22:05:09.451436 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-693f5580-24f6-404f-a82c-942016c536a8 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:05:09.455157 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-693f5580-24f6-404f-a82c-942016c536a8 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] [instance: 38ec68cd-0c1c-4f92-bb44-f6f6fb078b42] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:05:09.473995 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-693f5580-24f6-404f-a82c-942016c536a8 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:09.475551 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-693f5580-24f6-404f-a82c-942016c536a8 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:09.475994 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-693f5580-24f6-404f-a82c-942016c536a8 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:09.476959 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-693f5580-24f6-404f-a82c-942016c536a8 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:09.477784 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-693f5580-24f6-404f-a82c-942016c536a8 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:09.478414 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-693f5580-24f6-404f-a82c-942016c536a8 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:09.503343 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-693f5580-24f6-404f-a82c-942016c536a8 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] HTTP exception thrown: Instance 38ec68cd-0c1c-4f92-bb44-f6f6fb078b42 could not be found. Oct 04 22:05:09.504909 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-693f5580-24f6-404f-a82c-942016c536a8 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Request method failure captured: Oct 04 22:05:09.504909 n-d-860284-1 devstack@n-api.service[134101]: request: DELETE /compute/v2.1/servers/38ec68cd-0c1c-4f92-bb44-f6f6fb078b42 HTTP/1.1 Oct 04 22:05:09.504909 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 22:05:09.504909 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 22:05:09.504909 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 22:05:09.504909 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 22:05:09.504909 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 22:05:09.504909 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 22:05:09.504909 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 22:05:09.504909 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 22:05:09.504909 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPK2uaWdbUBgaC4RfPmjtTbjIfwc-i2umyIIBK_cF0D-_RCmikTip9FKSkMA-3LEgg0VpJcoPxMz4oo_myk5qoqg03ZgavcBoIAuumM_46SfpdfsovWLWxw7rAOFQTEcjFL3h_S0RmznoPUhj4-fuUVB2M5gfUS2qQyVeicBq2kx7daY Oct 04 22:05:09.504909 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 22:05:09.504909 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 22:05:09.504909 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 22:05:09.504909 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 22:05:09.504909 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 22:05:09.504909 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 22:05:09.504909 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: a1e037651e3345a8b95ea528cae02c9f Oct 04 22:05:09.504909 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-342298031 Oct 04 22:05:09.504909 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 22:05:09.504909 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 22:05:09.504909 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a1e037651e3345a8b95ea528cae02c9f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_a1e037651e3345a8b95ea528cae02c9f", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a1e037651e3345a8b95ea528cae02c9f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/a1e037651e3345a8b95ea528cae02c9f"}]}] Oct 04 22:05:09.504909 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-342298031 Oct 04 22:05:09.504909 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: a1e037651e3345a8b95ea528cae02c9f Oct 04 22:05:09.504909 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-342298031 Oct 04 22:05:09.504909 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-ImagesOneServerNegativeTestJSON-342298031-project Oct 04 22:05:09.504909 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 22:05:09.504909 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 22:05:09.504909 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 9973de86311b47e882de18efbcb3f67f Oct 04 22:05:09.504909 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-342298031-project Oct 04 22:05:09.504909 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 22:05:09.504909 n-d-860284-1 devstack@n-api.service[134101]: exception: Instance 38ec68cd-0c1c-4f92-bb44-f6f6fb078b42 could not be found. Oct 04 22:05:09.504909 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': '38ec68cd-0c1c-4f92-bb44-f6f6fb078b42'} Oct 04 22:05:09.504909 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:05:09.504909 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:05:09.504909 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:05:09.504909 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:05:09.504909 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:05:09.504909 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:05:09.504909 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:05:09.504909 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:05:09.504909 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:05:09.504909 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:05:09.504909 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38ec68cd-0c1c-4f92-bb44-f6f6fb078b42 could not be found. Oct 04 22:05:09.504909 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:05:09.504909 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:05:09.504909 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:05:09.504909 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:05:09.504909 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:05:09.504909 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:05:09.504909 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:05:09.504909 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:05:09.504909 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:05:09.504909 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:05:09.504909 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 22:05:09.504909 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 22:05:09.504909 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 22:05:09.504909 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 22:05:09.504909 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:05:09.504909 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:05:09.504909 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:05:09.504909 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:05:09.510045 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38ec68cd-0c1c-4f92-bb44-f6f6fb078b42 could not be found. Oct 04 22:05:09.510045 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:05:09.510045 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:05:09.510045 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:05:09.510045 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:05:09.510045 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:05:09.510045 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:05:09.510045 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:05:09.510045 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:05:09.510045 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38ec68cd-0c1c-4f92-bb44-f6f6fb078b42 could not be found. Oct 04 22:05:09.510045 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:05:09.510045 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-693f5580-24f6-404f-a82c-942016c536a8 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Returning 404 to user: Instance 38ec68cd-0c1c-4f92-bb44-f6f6fb078b42 could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:05:09.510045 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-693f5580-24f6-404f-a82c-942016c536a8 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] 10.222.0.43 "DELETE /compute/v2.1/servers/38ec68cd-0c1c-4f92-bb44-f6f6fb078b42" status: 404 len: 111 microversion: 2.1 time: 0.058850 Oct 04 22:05:09.526026 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2206/4476] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 22:05:09 2022] DELETE /compute/v2.1/servers/38ec68cd-0c1c-4f92-bb44-f6f6fb078b42 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:05:09.532178 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-96baf690-dfe4-46cc-a86c-33636d02ded9 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:05:09.533355 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-96baf690-dfe4-46cc-a86c-33636d02ded9 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] [instance: 38ec68cd-0c1c-4f92-bb44-f6f6fb078b42] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:05:09.547567 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-96baf690-dfe4-46cc-a86c-33636d02ded9 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:09.548308 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-96baf690-dfe4-46cc-a86c-33636d02ded9 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:09.549142 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-96baf690-dfe4-46cc-a86c-33636d02ded9 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:09.550410 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-96baf690-dfe4-46cc-a86c-33636d02ded9 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:09.551512 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-96baf690-dfe4-46cc-a86c-33636d02ded9 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:09.553396 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-96baf690-dfe4-46cc-a86c-33636d02ded9 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:09.574994 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-96baf690-dfe4-46cc-a86c-33636d02ded9 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] HTTP exception thrown: Instance 38ec68cd-0c1c-4f92-bb44-f6f6fb078b42 could not be found. Oct 04 22:05:09.577238 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-96baf690-dfe4-46cc-a86c-33636d02ded9 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Request method failure captured: Oct 04 22:05:09.577238 n-d-860284-1 devstack@n-api.service[134102]: request: GET /compute/v2.1/servers/38ec68cd-0c1c-4f92-bb44-f6f6fb078b42 HTTP/1.1 Oct 04 22:05:09.577238 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 22:05:09.577238 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 22:05:09.577238 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 22:05:09.577238 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 22:05:09.577238 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 22:05:09.577238 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 22:05:09.577238 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 22:05:09.577238 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 22:05:09.577238 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPK2uaWdbUBgaC4RfPmjtTbjIfwc-i2umyIIBK_cF0D-_RCmikTip9FKSkMA-3LEgg0VpJcoPxMz4oo_myk5qoqg03ZgavcBoIAuumM_46SfpdfsovWLWxw7rAOFQTEcjFL3h_S0RmznoPUhj4-fuUVB2M5gfUS2qQyVeicBq2kx7daY Oct 04 22:05:09.577238 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 22:05:09.577238 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 22:05:09.577238 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 22:05:09.577238 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 22:05:09.577238 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 22:05:09.577238 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 22:05:09.577238 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: a1e037651e3345a8b95ea528cae02c9f Oct 04 22:05:09.577238 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-342298031 Oct 04 22:05:09.577238 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 22:05:09.577238 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 22:05:09.577238 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a1e037651e3345a8b95ea528cae02c9f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_a1e037651e3345a8b95ea528cae02c9f", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a1e037651e3345a8b95ea528cae02c9f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/a1e037651e3345a8b95ea528cae02c9f"}]}] Oct 04 22:05:09.577238 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-342298031 Oct 04 22:05:09.577238 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: a1e037651e3345a8b95ea528cae02c9f Oct 04 22:05:09.577238 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-342298031 Oct 04 22:05:09.577238 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-ImagesOneServerNegativeTestJSON-342298031-project Oct 04 22:05:09.577238 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 22:05:09.577238 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 22:05:09.577238 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: 9973de86311b47e882de18efbcb3f67f Oct 04 22:05:09.577238 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-342298031-project Oct 04 22:05:09.577238 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 22:05:09.577238 n-d-860284-1 devstack@n-api.service[134102]: exception: Instance 38ec68cd-0c1c-4f92-bb44-f6f6fb078b42 could not be found. Oct 04 22:05:09.577238 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': '38ec68cd-0c1c-4f92-bb44-f6f6fb078b42'} Oct 04 22:05:09.577238 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:05:09.577238 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:05:09.577238 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:05:09.577238 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:05:09.577238 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:05:09.577238 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:05:09.577238 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:05:09.577238 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:05:09.577238 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:05:09.577238 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:05:09.577238 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38ec68cd-0c1c-4f92-bb44-f6f6fb078b42 could not be found. Oct 04 22:05:09.577238 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:05:09.577238 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:05:09.577238 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:05:09.577238 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:05:09.577238 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:05:09.577238 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:05:09.577238 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:05:09.577238 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:05:09.577238 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:05:09.577238 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:05:09.577238 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:05:09.577238 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:05:09.577238 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:05:09.577238 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:05:09.577238 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:05:09.577238 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:05:09.577238 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38ec68cd-0c1c-4f92-bb44-f6f6fb078b42 could not be found. Oct 04 22:05:09.577238 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:05:09.577238 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:05:09.582071 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:05:09.582071 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:05:09.582071 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:05:09.582071 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:05:09.582071 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:05:09.582071 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:05:09.582071 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38ec68cd-0c1c-4f92-bb44-f6f6fb078b42 could not be found. Oct 04 22:05:09.582071 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:05:09.584391 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-96baf690-dfe4-46cc-a86c-33636d02ded9 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Returning 404 to user: Instance 38ec68cd-0c1c-4f92-bb44-f6f6fb078b42 could not be found. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:05:09.585529 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-96baf690-dfe4-46cc-a86c-33636d02ded9 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] 10.222.0.43 "GET /compute/v2.1/servers/38ec68cd-0c1c-4f92-bb44-f6f6fb078b42" status: 404 len: 111 microversion: 2.1 time: 0.058197 Oct 04 22:05:09.590714 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2271/4477] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:05:09 2022] GET /compute/v2.1/servers/38ec68cd-0c1c-4f92-bb44-f6f6fb078b42 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:05:09.593916 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-828461fb-8acf-4750-88fa-37a4dd19ef62 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:05:09.594621 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-828461fb-8acf-4750-88fa-37a4dd19ef62 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 48243e1b-892b-4c4b-8db1-242b2e40653b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:05:09.597215 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-7ba2b7e6-e9d1-4320-995d-be59a4e894ea tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Calling method '.version_select at 0x7fbb2e7f8700>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:05:09.601717 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-828461fb-8acf-4750-88fa-37a4dd19ef62 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:09.602213 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-828461fb-8acf-4750-88fa-37a4dd19ef62 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:09.602877 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-828461fb-8acf-4750-88fa-37a4dd19ef62 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:09.604177 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-828461fb-8acf-4750-88fa-37a4dd19ef62 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:09.604956 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-828461fb-8acf-4750-88fa-37a4dd19ef62 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:09.605969 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-828461fb-8acf-4750-88fa-37a4dd19ef62 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:09.617439 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:05:09.629236 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-7ba2b7e6-e9d1-4320-995d-be59a4e894ea tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-870543901" status: 202 len: 0 microversion: 2.1 time: 0.036869 Oct 04 22:05:09.633275 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2272/4478] 10.222.0.43 () {58 vars in 1218 bytes} [Tue Oct 4 22:05:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-870543901 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 22:05:09.667034 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-41bc445a-6180-4066-a496-8ef67a0de92f tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:05:09.668050 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-41bc445a-6180-4066-a496-8ef67a0de92f tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] [instance: 9fd64a5e-1e76-4841-bf99-37ab4d2ce55a] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:05:09.684372 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-41bc445a-6180-4066-a496-8ef67a0de92f tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:09.684989 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-41bc445a-6180-4066-a496-8ef67a0de92f tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:09.685850 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-41bc445a-6180-4066-a496-8ef67a0de92f tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:09.687298 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-41bc445a-6180-4066-a496-8ef67a0de92f tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:09.688554 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-41bc445a-6180-4066-a496-8ef67a0de92f tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:09.689216 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-41bc445a-6180-4066-a496-8ef67a0de92f tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:09.810564 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-41bc445a-6180-4066-a496-8ef67a0de92f tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80fc56886fef422b9b52eb1dede7d10e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82e1a29234ce40f9b37d0eca196cd1db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:05:09.830877 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-41bc445a-6180-4066-a496-8ef67a0de92f tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] 10.222.0.43 "GET /compute/v2.1/servers/9fd64a5e-1e76-4841-bf99-37ab4d2ce55a" status: 200 len: 1299 microversion: 2.1 time: 0.169012 Oct 04 22:05:09.854976 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2273/4479] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:05:09 2022] GET /compute/v2.1/servers/9fd64a5e-1e76-4841-bf99-37ab4d2ce55a => generated 1299 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:05:10.001241 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-1fca767d-42fc-4be4-baeb-b07423e0214b tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:05:10.003331 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-1fca767d-42fc-4be4-baeb-b07423e0214b tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: f45bd103-0f2f-4eb0-83f9-a084adb03d18] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:05:10.008856 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-828461fb-8acf-4750-88fa-37a4dd19ef62 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:05:10.020185 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-828461fb-8acf-4750-88fa-37a4dd19ef62 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b" status: 200 len: 1550 microversion: 2.1 time: 0.432343 Oct 04 22:05:10.021998 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2207/4480] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:05:09 2022] GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b => generated 1550 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:05:10.024844 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1fca767d-42fc-4be4-baeb-b07423e0214b tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:10.026314 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1fca767d-42fc-4be4-baeb-b07423e0214b tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:10.026963 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1fca767d-42fc-4be4-baeb-b07423e0214b tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:10.027781 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1fca767d-42fc-4be4-baeb-b07423e0214b tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:10.028344 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1fca767d-42fc-4be4-baeb-b07423e0214b tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:10.033110 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1fca767d-42fc-4be4-baeb-b07423e0214b tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:10.047938 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-055c5a63-1ce8-45d7-8e50-cfcd8d50843b tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:05:10.049220 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-055c5a63-1ce8-45d7-8e50-cfcd8d50843b tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 48243e1b-892b-4c4b-8db1-242b2e40653b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:05:10.059971 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-055c5a63-1ce8-45d7-8e50-cfcd8d50843b tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:10.061645 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-055c5a63-1ce8-45d7-8e50-cfcd8d50843b tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:10.062126 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-055c5a63-1ce8-45d7-8e50-cfcd8d50843b tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:10.062894 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-055c5a63-1ce8-45d7-8e50-cfcd8d50843b tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:10.063365 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-055c5a63-1ce8-45d7-8e50-cfcd8d50843b tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:10.063826 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-055c5a63-1ce8-45d7-8e50-cfcd8d50843b tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:10.343578 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-055c5a63-1ce8-45d7-8e50-cfcd8d50843b tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.297881 Oct 04 22:05:10.343578 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2208/4481] 10.222.0.43 () {58 vars in 1275 bytes} [Tue Oct 4 22:05:10 2022] GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b/os-interface => generated 284 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:05:10.591812 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-1fca767d-42fc-4be4-baeb-b07423e0214b tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a1c8d841104bc9b6910bcc2c0e2bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe9283584fc4d90b0715216d867ea2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:05:10.612139 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-1fca767d-42fc-4be4-baeb-b07423e0214b tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "GET /compute/v2.1/servers/f45bd103-0f2f-4eb0-83f9-a084adb03d18" status: 200 len: 1315 microversion: 2.1 time: 0.622558 Oct 04 22:05:10.613375 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2274/4482] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:05:09 2022] GET /compute/v2.1/servers/f45bd103-0f2f-4eb0-83f9-a084adb03d18 => generated 1315 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:05:10.864352 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-1a39de7e-853a-441b-8dbb-2566692c1a8d tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:05:10.865063 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-1a39de7e-853a-441b-8dbb-2566692c1a8d tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] [instance: 9fd64a5e-1e76-4841-bf99-37ab4d2ce55a] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:05:10.876698 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1a39de7e-853a-441b-8dbb-2566692c1a8d tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:10.877891 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1a39de7e-853a-441b-8dbb-2566692c1a8d tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:10.878603 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1a39de7e-853a-441b-8dbb-2566692c1a8d tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:10.893684 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1a39de7e-853a-441b-8dbb-2566692c1a8d tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:10.894619 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1a39de7e-853a-441b-8dbb-2566692c1a8d tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:10.895404 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1a39de7e-853a-441b-8dbb-2566692c1a8d tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:11.188390 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-4342d473-aa4c-4c5b-a379-0718ec828658 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Calling method '.version_select at 0x7fbb2e7e41f0>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:05:11.226854 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-4342d473-aa4c-4c5b-a379-0718ec828658 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] HTTP exception thrown: Image not found. Oct 04 22:05:11.230421 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-4342d473-aa4c-4c5b-a379-0718ec828658 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Request method failure captured: Oct 04 22:05:11.230421 n-d-860284-1 devstack@n-api.service[134102]: request: DELETE /compute/v2.1/images/9a6d6140-ea5c-4b2c-a6b0-66a51dd4e2bd HTTP/1.1 Oct 04 22:05:11.230421 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 22:05:11.230421 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 22:05:11.230421 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 22:05:11.230421 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 22:05:11.230421 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 22:05:11.230421 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 22:05:11.230421 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 22:05:11.230421 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 22:05:11.230421 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPK2uaWdbUBgaC4RfPmjtTbjIfwc-i2umyIIBK_cF0D-_RCmikTip9FKSkMA-3LEgg0VpJcoPxMz4oo_myk5qoqg03ZgavcBoIAuumM_46SfpdfsovWLWxw7rAOFQTEcjFL3h_S0RmznoPUhj4-fuUVB2M5gfUS2qQyVeicBq2kx7daY Oct 04 22:05:11.230421 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 22:05:11.230421 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 22:05:11.230421 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 22:05:11.230421 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 22:05:11.230421 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 22:05:11.230421 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 22:05:11.230421 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: a1e037651e3345a8b95ea528cae02c9f Oct 04 22:05:11.230421 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-342298031 Oct 04 22:05:11.230421 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 22:05:11.230421 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 22:05:11.230421 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a1e037651e3345a8b95ea528cae02c9f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_a1e037651e3345a8b95ea528cae02c9f", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a1e037651e3345a8b95ea528cae02c9f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/a1e037651e3345a8b95ea528cae02c9f"}]}] Oct 04 22:05:11.230421 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-342298031 Oct 04 22:05:11.230421 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: a1e037651e3345a8b95ea528cae02c9f Oct 04 22:05:11.230421 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-342298031 Oct 04 22:05:11.230421 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-ImagesOneServerNegativeTestJSON-342298031-project Oct 04 22:05:11.230421 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 22:05:11.230421 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 22:05:11.230421 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: 9973de86311b47e882de18efbcb3f67f Oct 04 22:05:11.230421 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-342298031-project Oct 04 22:05:11.230421 n-d-860284-1 devstack@n-api.service[134102]: method: Oct 04 22:05:11.230421 n-d-860284-1 devstack@n-api.service[134102]: exception: Image not found. Oct 04 22:05:11.230421 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': '9a6d6140-ea5c-4b2c-a6b0-66a51dd4e2bd'} Oct 04 22:05:11.230421 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:05:11.230421 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:05:11.230421 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 04 22:05:11.230421 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 04 22:05:11.230421 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 22:05:11.230421 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 22:05:11.230421 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 22:05:11.230421 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 22:05:11.230421 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 04 22:05:11.230421 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 04 22:05:11.230421 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 04 22:05:11.230421 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 04 22:05:11.230421 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 22:05:11.230421 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 22:05:11.230421 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 22:05:11.230421 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 22:05:11.230421 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 9a6d6140-ea5c-4b2c-a6b0-66a51dd4e2bd to delete Oct 04 22:05:11.230421 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:05:11.230421 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:05:11.230421 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:05:11.230421 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:05:11.230421 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 04 22:05:11.230421 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 04 22:05:11.230421 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 04 22:05:11.230421 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 04 22:05:11.230421 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 04 22:05:11.230421 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 04 22:05:11.230421 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 9a6d6140-ea5c-4b2c-a6b0-66a51dd4e2bd could not be found. Oct 04 22:05:11.230421 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:05:11.230421 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:05:11.230421 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:05:11.235917 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:05:11.235917 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:05:11.235917 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:05:11.235917 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:05:11.235917 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:05:11.235917 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 22:05:11.235917 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 22:05:11.235917 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:05:11.235917 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:05:11.235917 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 04 22:05:11.235917 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 22:05:11.235917 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 22:05:11.235917 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:05:11.235917 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:05:11.235917 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:05:11.235917 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:05:11.235917 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:05:11.235917 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:05:11.235917 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:05:11.235917 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:05:11.235917 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 22:05:11.235917 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:05:11.235917 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-4342d473-aa4c-4c5b-a379-0718ec828658 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Returning 404 to user: Image not found. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:05:11.237566 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-4342d473-aa4c-4c5b-a379-0718ec828658 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] 10.222.0.43 "DELETE /compute/v2.1/images/9a6d6140-ea5c-4b2c-a6b0-66a51dd4e2bd" status: 404 len: 62 microversion: 2.1 time: 0.052300 Oct 04 22:05:11.240606 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2275/4483] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:05:11 2022] DELETE /compute/v2.1/images/9a6d6140-ea5c-4b2c-a6b0-66a51dd4e2bd => generated 62 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 22:05:11.248090 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-51a9ed82-3157-4c07-be48-cdad186b3e24 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:05:11.248940 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-51a9ed82-3157-4c07-be48-cdad186b3e24 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] [instance: ad97980f-d9c5-4237-b84a-2a13dfbc7764] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:05:11.258564 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-51a9ed82-3157-4c07-be48-cdad186b3e24 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:11.259499 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-51a9ed82-3157-4c07-be48-cdad186b3e24 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:11.260194 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-51a9ed82-3157-4c07-be48-cdad186b3e24 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:11.261233 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-51a9ed82-3157-4c07-be48-cdad186b3e24 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:11.261943 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-51a9ed82-3157-4c07-be48-cdad186b3e24 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:11.262742 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-51a9ed82-3157-4c07-be48-cdad186b3e24 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:11.282523 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-51a9ed82-3157-4c07-be48-cdad186b3e24 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] HTTP exception thrown: Instance ad97980f-d9c5-4237-b84a-2a13dfbc7764 could not be found. Oct 04 22:05:11.284583 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-51a9ed82-3157-4c07-be48-cdad186b3e24 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Request method failure captured: Oct 04 22:05:11.284583 n-d-860284-1 devstack@n-api.service[134102]: request: DELETE /compute/v2.1/servers/ad97980f-d9c5-4237-b84a-2a13dfbc7764 HTTP/1.1 Oct 04 22:05:11.284583 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 22:05:11.284583 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 22:05:11.284583 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 22:05:11.284583 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 22:05:11.284583 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 22:05:11.284583 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 22:05:11.284583 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 22:05:11.284583 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 22:05:11.284583 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPK2uaWdbUBgaC4RfPmjtTbjIfwc-i2umyIIBK_cF0D-_RCmikTip9FKSkMA-3LEgg0VpJcoPxMz4oo_myk5qoqg03ZgavcBoIAuumM_46SfpdfsovWLWxw7rAOFQTEcjFL3h_S0RmznoPUhj4-fuUVB2M5gfUS2qQyVeicBq2kx7daY Oct 04 22:05:11.284583 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 22:05:11.284583 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 22:05:11.284583 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 22:05:11.284583 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 22:05:11.284583 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 22:05:11.284583 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 22:05:11.284583 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: a1e037651e3345a8b95ea528cae02c9f Oct 04 22:05:11.284583 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-342298031 Oct 04 22:05:11.284583 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 22:05:11.284583 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 22:05:11.284583 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a1e037651e3345a8b95ea528cae02c9f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_a1e037651e3345a8b95ea528cae02c9f", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a1e037651e3345a8b95ea528cae02c9f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/a1e037651e3345a8b95ea528cae02c9f"}]}] Oct 04 22:05:11.284583 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-342298031 Oct 04 22:05:11.284583 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: a1e037651e3345a8b95ea528cae02c9f Oct 04 22:05:11.284583 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-342298031 Oct 04 22:05:11.284583 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-ImagesOneServerNegativeTestJSON-342298031-project Oct 04 22:05:11.284583 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 22:05:11.284583 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 22:05:11.284583 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: 9973de86311b47e882de18efbcb3f67f Oct 04 22:05:11.284583 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-342298031-project Oct 04 22:05:11.284583 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 22:05:11.284583 n-d-860284-1 devstack@n-api.service[134102]: exception: Instance ad97980f-d9c5-4237-b84a-2a13dfbc7764 could not be found. Oct 04 22:05:11.284583 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': 'ad97980f-d9c5-4237-b84a-2a13dfbc7764'} Oct 04 22:05:11.284583 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:05:11.284583 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:05:11.284583 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:05:11.284583 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:05:11.284583 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:05:11.284583 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:05:11.284583 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:05:11.284583 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:05:11.284583 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:05:11.284583 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:05:11.284583 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad97980f-d9c5-4237-b84a-2a13dfbc7764 could not be found. Oct 04 22:05:11.284583 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:05:11.284583 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:05:11.284583 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:05:11.284583 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:05:11.284583 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:05:11.284583 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:05:11.284583 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:05:11.284583 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:05:11.284583 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:05:11.284583 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:05:11.284583 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 22:05:11.284583 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 22:05:11.284583 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 22:05:11.284583 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 22:05:11.284583 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:05:11.284583 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:05:11.284583 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:05:11.284583 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:05:11.288812 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad97980f-d9c5-4237-b84a-2a13dfbc7764 could not be found. Oct 04 22:05:11.288812 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:05:11.288812 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:05:11.288812 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:05:11.288812 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:05:11.288812 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:05:11.288812 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:05:11.288812 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:05:11.288812 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:05:11.288812 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad97980f-d9c5-4237-b84a-2a13dfbc7764 could not be found. Oct 04 22:05:11.288812 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:05:11.289501 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-51a9ed82-3157-4c07-be48-cdad186b3e24 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Returning 404 to user: Instance ad97980f-d9c5-4237-b84a-2a13dfbc7764 could not be found. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:05:11.293779 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-51a9ed82-3157-4c07-be48-cdad186b3e24 tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] 10.222.0.43 "DELETE /compute/v2.1/servers/ad97980f-d9c5-4237-b84a-2a13dfbc7764" status: 404 len: 111 microversion: 2.1 time: 0.048344 Oct 04 22:05:11.298222 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2276/4484] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 22:05:11 2022] DELETE /compute/v2.1/servers/ad97980f-d9c5-4237-b84a-2a13dfbc7764 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:05:11.304226 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-e4712c64-71b8-4dfb-aed3-d38eb65b412c tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:05:11.304848 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-e4712c64-71b8-4dfb-aed3-d38eb65b412c tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] [instance: ad97980f-d9c5-4237-b84a-2a13dfbc7764] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:05:11.311085 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e4712c64-71b8-4dfb-aed3-d38eb65b412c tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:11.311748 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e4712c64-71b8-4dfb-aed3-d38eb65b412c tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:11.312477 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e4712c64-71b8-4dfb-aed3-d38eb65b412c tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:11.313344 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e4712c64-71b8-4dfb-aed3-d38eb65b412c tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:11.313809 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e4712c64-71b8-4dfb-aed3-d38eb65b412c tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:11.314279 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e4712c64-71b8-4dfb-aed3-d38eb65b412c tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:11.331869 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-e4712c64-71b8-4dfb-aed3-d38eb65b412c tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] HTTP exception thrown: Instance ad97980f-d9c5-4237-b84a-2a13dfbc7764 could not be found. Oct 04 22:05:11.334449 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-e4712c64-71b8-4dfb-aed3-d38eb65b412c tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Request method failure captured: Oct 04 22:05:11.334449 n-d-860284-1 devstack@n-api.service[134102]: request: GET /compute/v2.1/servers/ad97980f-d9c5-4237-b84a-2a13dfbc7764 HTTP/1.1 Oct 04 22:05:11.334449 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 22:05:11.334449 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 22:05:11.334449 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 22:05:11.334449 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 22:05:11.334449 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 22:05:11.334449 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 22:05:11.334449 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 22:05:11.334449 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 22:05:11.334449 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPK2uaWdbUBgaC4RfPmjtTbjIfwc-i2umyIIBK_cF0D-_RCmikTip9FKSkMA-3LEgg0VpJcoPxMz4oo_myk5qoqg03ZgavcBoIAuumM_46SfpdfsovWLWxw7rAOFQTEcjFL3h_S0RmznoPUhj4-fuUVB2M5gfUS2qQyVeicBq2kx7daY Oct 04 22:05:11.334449 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 22:05:11.334449 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 22:05:11.334449 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 22:05:11.334449 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 22:05:11.334449 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 22:05:11.334449 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 22:05:11.334449 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: a1e037651e3345a8b95ea528cae02c9f Oct 04 22:05:11.334449 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-342298031 Oct 04 22:05:11.334449 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 22:05:11.334449 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 22:05:11.334449 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a1e037651e3345a8b95ea528cae02c9f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_a1e037651e3345a8b95ea528cae02c9f", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a1e037651e3345a8b95ea528cae02c9f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/a1e037651e3345a8b95ea528cae02c9f"}]}] Oct 04 22:05:11.334449 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-342298031 Oct 04 22:05:11.334449 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: a1e037651e3345a8b95ea528cae02c9f Oct 04 22:05:11.334449 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-342298031 Oct 04 22:05:11.334449 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-ImagesOneServerNegativeTestJSON-342298031-project Oct 04 22:05:11.334449 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 22:05:11.334449 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 22:05:11.334449 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: 9973de86311b47e882de18efbcb3f67f Oct 04 22:05:11.334449 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-342298031-project Oct 04 22:05:11.334449 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 22:05:11.334449 n-d-860284-1 devstack@n-api.service[134102]: exception: Instance ad97980f-d9c5-4237-b84a-2a13dfbc7764 could not be found. Oct 04 22:05:11.334449 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': 'ad97980f-d9c5-4237-b84a-2a13dfbc7764'} Oct 04 22:05:11.334449 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:05:11.334449 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:05:11.334449 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:05:11.334449 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:05:11.334449 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:05:11.334449 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:05:11.334449 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:05:11.334449 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:05:11.334449 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:05:11.334449 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:05:11.334449 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad97980f-d9c5-4237-b84a-2a13dfbc7764 could not be found. Oct 04 22:05:11.334449 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:05:11.334449 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:05:11.334449 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:05:11.334449 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:05:11.334449 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:05:11.334449 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:05:11.334449 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:05:11.334449 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:05:11.334449 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:05:11.334449 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:05:11.334449 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:05:11.334449 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:05:11.334449 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:05:11.334449 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:05:11.334449 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:05:11.334449 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:05:11.334449 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad97980f-d9c5-4237-b84a-2a13dfbc7764 could not be found. Oct 04 22:05:11.334449 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:05:11.334449 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:05:11.339247 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:05:11.339247 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:05:11.339247 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:05:11.339247 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:05:11.339247 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:05:11.339247 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:05:11.339247 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad97980f-d9c5-4237-b84a-2a13dfbc7764 could not be found. Oct 04 22:05:11.339247 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:05:11.341390 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-e4712c64-71b8-4dfb-aed3-d38eb65b412c tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] Returning 404 to user: Instance ad97980f-d9c5-4237-b84a-2a13dfbc7764 could not be found. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:05:11.342629 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-e4712c64-71b8-4dfb-aed3-d38eb65b412c tempest-ImagesOneServerNegativeTestJSON-342298031 tempest-ImagesOneServerNegativeTestJSON-342298031-project] 10.222.0.43 "GET /compute/v2.1/servers/ad97980f-d9c5-4237-b84a-2a13dfbc7764" status: 404 len: 111 microversion: 2.1 time: 0.042625 Oct 04 22:05:11.343701 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2277/4485] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:05:11 2022] GET /compute/v2.1/servers/ad97980f-d9c5-4237-b84a-2a13dfbc7764 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:05:11.353720 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-1a39de7e-853a-441b-8dbb-2566692c1a8d tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80fc56886fef422b9b52eb1dede7d10e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82e1a29234ce40f9b37d0eca196cd1db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:05:11.364040 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-1a39de7e-853a-441b-8dbb-2566692c1a8d tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] 10.222.0.43 "GET /compute/v2.1/servers/9fd64a5e-1e76-4841-bf99-37ab4d2ce55a" status: 200 len: 1367 microversion: 2.1 time: 0.505326 Oct 04 22:05:11.383116 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2209/4486] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:05:10 2022] GET /compute/v2.1/servers/9fd64a5e-1e76-4841-bf99-37ab4d2ce55a => generated 1367 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:05:11.639548 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-c084886c-cfc1-4f15-b484-e031780130f2 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:05:11.640865 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-c084886c-cfc1-4f15-b484-e031780130f2 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: f45bd103-0f2f-4eb0-83f9-a084adb03d18] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:05:11.652576 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c084886c-cfc1-4f15-b484-e031780130f2 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:11.653166 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c084886c-cfc1-4f15-b484-e031780130f2 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:11.653673 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c084886c-cfc1-4f15-b484-e031780130f2 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:11.654539 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c084886c-cfc1-4f15-b484-e031780130f2 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:11.661160 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c084886c-cfc1-4f15-b484-e031780130f2 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:11.662548 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c084886c-cfc1-4f15-b484-e031780130f2 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:12.390499 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-a103c804-5f87-4584-aa8c-9f2ac1c2552d tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:05:12.391893 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-a103c804-5f87-4584-aa8c-9f2ac1c2552d tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] [instance: 9fd64a5e-1e76-4841-bf99-37ab4d2ce55a] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:05:12.401478 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a103c804-5f87-4584-aa8c-9f2ac1c2552d tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:12.402862 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a103c804-5f87-4584-aa8c-9f2ac1c2552d tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:12.403695 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a103c804-5f87-4584-aa8c-9f2ac1c2552d tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:12.404897 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a103c804-5f87-4584-aa8c-9f2ac1c2552d tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:12.405646 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a103c804-5f87-4584-aa8c-9f2ac1c2552d tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:12.406316 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a103c804-5f87-4584-aa8c-9f2ac1c2552d tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:13.013913 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-c084886c-cfc1-4f15-b484-e031780130f2 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a1c8d841104bc9b6910bcc2c0e2bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe9283584fc4d90b0715216d867ea2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:05:13.025143 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-c084886c-cfc1-4f15-b484-e031780130f2 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "GET /compute/v2.1/servers/f45bd103-0f2f-4eb0-83f9-a084adb03d18" status: 200 len: 1502 microversion: 2.1 time: 1.389570 Oct 04 22:05:13.030681 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2278/4487] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:05:11 2022] GET /compute/v2.1/servers/f45bd103-0f2f-4eb0-83f9-a084adb03d18 => generated 1502 bytes in 1396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:05:13.050278 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-59d49027-188f-481f-b5b5-8a14c90c0e1d tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:05:13.071115 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-59d49027-188f-481f-b5b5-8a14c90c0e1d tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:13.071621 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-59d49027-188f-481f-b5b5-8a14c90c0e1d tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:13.072061 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-59d49027-188f-481f-b5b5-8a14c90c0e1d tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:13.113043 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-59d49027-188f-481f-b5b5-8a14c90c0e1d tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: f45bd103-0f2f-4eb0-83f9-a084adb03d18] Going to try to stop instance {{(pid=134102) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 04 22:05:13.230135 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-59d49027-188f-481f-b5b5-8a14c90c0e1d tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "POST /compute/v2.1/servers/f45bd103-0f2f-4eb0-83f9-a084adb03d18/action" status: 202 len: 0 microversion: 2.1 time: 0.183173 Oct 04 22:05:13.234823 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2279/4488] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 22:05:13 2022] POST /compute/v2.1/servers/f45bd103-0f2f-4eb0-83f9-a084adb03d18/action => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 22:05:13.240783 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-b716ee46-391a-4052-82bb-41c83d274120 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:05:13.241495 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-b716ee46-391a-4052-82bb-41c83d274120 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: f45bd103-0f2f-4eb0-83f9-a084adb03d18] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:05:13.266800 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b716ee46-391a-4052-82bb-41c83d274120 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:13.267561 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b716ee46-391a-4052-82bb-41c83d274120 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:13.268202 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b716ee46-391a-4052-82bb-41c83d274120 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:13.269084 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b716ee46-391a-4052-82bb-41c83d274120 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:13.269703 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b716ee46-391a-4052-82bb-41c83d274120 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:13.270297 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b716ee46-391a-4052-82bb-41c83d274120 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:13.524899 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-a103c804-5f87-4584-aa8c-9f2ac1c2552d tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80fc56886fef422b9b52eb1dede7d10e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82e1a29234ce40f9b37d0eca196cd1db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:05:13.559757 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-a103c804-5f87-4584-aa8c-9f2ac1c2552d tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] 10.222.0.43 "GET /compute/v2.1/servers/9fd64a5e-1e76-4841-bf99-37ab4d2ce55a" status: 200 len: 1367 microversion: 2.1 time: 1.167082 Oct 04 22:05:13.560501 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2210/4489] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:05:12 2022] GET /compute/v2.1/servers/9fd64a5e-1e76-4841-bf99-37ab4d2ce55a => generated 1367 bytes in 1176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:05:13.575679 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-48a01ec6-e71f-49d3-961f-78949fc7b2dc req-437b5d74-fc26-44ff-8c1c-2ab48c200c0d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48243e1b-892b-4c4b-8db1-242b2e40653b", "tag": "a795c088-46ba-4a15-a651-33aa842e29b5"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:05:13.609346 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-48a01ec6-e71f-49d3-961f-78949fc7b2dc req-437b5d74-fc26-44ff-8c1c-2ab48c200c0d service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:13.614266 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-48a01ec6-e71f-49d3-961f-78949fc7b2dc req-437b5d74-fc26-44ff-8c1c-2ab48c200c0d service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:13.614875 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-48a01ec6-e71f-49d3-961f-78949fc7b2dc req-437b5d74-fc26-44ff-8c1c-2ab48c200c0d service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:13.647143 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-48a01ec6-e71f-49d3-961f-78949fc7b2dc req-437b5d74-fc26-44ff-8c1c-2ab48c200c0d service nova] Creating event network-changed:a795c088-46ba-4a15-a651-33aa842e29b5 for instance 48243e1b-892b-4c4b-8db1-242b2e40653b on n-h1-860284-1 Oct 04 22:05:13.674704 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-48a01ec6-e71f-49d3-961f-78949fc7b2dc req-437b5d74-fc26-44ff-8c1c-2ab48c200c0d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098499 Oct 04 22:05:13.675371 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2211/4490] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:05:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:05:13.956833 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-b716ee46-391a-4052-82bb-41c83d274120 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a1c8d841104bc9b6910bcc2c0e2bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe9283584fc4d90b0715216d867ea2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:05:13.980040 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-b716ee46-391a-4052-82bb-41c83d274120 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "GET /compute/v2.1/servers/f45bd103-0f2f-4eb0-83f9-a084adb03d18" status: 200 len: 1512 microversion: 2.1 time: 0.743996 Oct 04 22:05:13.980654 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2280/4491] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:05:13 2022] GET /compute/v2.1/servers/f45bd103-0f2f-4eb0-83f9-a084adb03d18 => generated 1512 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:05:14.249891 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-c4885703-36ab-47d4-97f9-4c598f28755d req-80516fce-0bbd-4add-9c2e-36fc816a49f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9fd64a5e-1e76-4841-bf99-37ab4d2ce55a", "tag": "dbf78af7-5b9d-4366-ac1b-b66ca10a6554"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:05:14.273160 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-c4885703-36ab-47d4-97f9-4c598f28755d req-80516fce-0bbd-4add-9c2e-36fc816a49f9 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:14.274001 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-c4885703-36ab-47d4-97f9-4c598f28755d req-80516fce-0bbd-4add-9c2e-36fc816a49f9 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:14.277233 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-c4885703-36ab-47d4-97f9-4c598f28755d req-80516fce-0bbd-4add-9c2e-36fc816a49f9 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:14.315236 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-c4885703-36ab-47d4-97f9-4c598f28755d req-80516fce-0bbd-4add-9c2e-36fc816a49f9 service nova] Creating event network-changed:dbf78af7-5b9d-4366-ac1b-b66ca10a6554 for instance 9fd64a5e-1e76-4841-bf99-37ab4d2ce55a on n-h1-860284-1 Oct 04 22:05:14.328422 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-c4885703-36ab-47d4-97f9-4c598f28755d req-80516fce-0bbd-4add-9c2e-36fc816a49f9 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089197 Oct 04 22:05:14.331548 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2212/4492] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:05:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:05:14.590134 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-96d4caf3-75b1-4e4a-952c-669d1e4b9af5 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:05:14.590896 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-96d4caf3-75b1-4e4a-952c-669d1e4b9af5 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] [instance: 9fd64a5e-1e76-4841-bf99-37ab4d2ce55a] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:05:14.601770 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-96d4caf3-75b1-4e4a-952c-669d1e4b9af5 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:14.605070 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-96d4caf3-75b1-4e4a-952c-669d1e4b9af5 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:14.605611 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-96d4caf3-75b1-4e4a-952c-669d1e4b9af5 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:14.606481 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-96d4caf3-75b1-4e4a-952c-669d1e4b9af5 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:14.607029 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-96d4caf3-75b1-4e4a-952c-669d1e4b9af5 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:14.608890 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-96d4caf3-75b1-4e4a-952c-669d1e4b9af5 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:15.009536 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-ed9cc759-bfcb-48af-a197-206e3dcea663 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:05:15.010385 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-ed9cc759-bfcb-48af-a197-206e3dcea663 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: f45bd103-0f2f-4eb0-83f9-a084adb03d18] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:05:15.032901 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ed9cc759-bfcb-48af-a197-206e3dcea663 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:15.035440 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ed9cc759-bfcb-48af-a197-206e3dcea663 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:15.036438 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ed9cc759-bfcb-48af-a197-206e3dcea663 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:15.038571 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ed9cc759-bfcb-48af-a197-206e3dcea663 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:15.039550 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ed9cc759-bfcb-48af-a197-206e3dcea663 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:15.041312 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ed9cc759-bfcb-48af-a197-206e3dcea663 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:15.168243 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=2 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:05:15.406816 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-96d4caf3-75b1-4e4a-952c-669d1e4b9af5 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80fc56886fef422b9b52eb1dede7d10e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82e1a29234ce40f9b37d0eca196cd1db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:05:15.423901 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-96d4caf3-75b1-4e4a-952c-669d1e4b9af5 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] 10.222.0.43 "GET /compute/v2.1/servers/9fd64a5e-1e76-4841-bf99-37ab4d2ce55a" status: 200 len: 1367 microversion: 2.1 time: 0.833513 Oct 04 22:05:15.424832 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2281/4493] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:05:14 2022] GET /compute/v2.1/servers/9fd64a5e-1e76-4841-bf99-37ab4d2ce55a => generated 1367 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:05:15.454386 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-ed9cc759-bfcb-48af-a197-206e3dcea663 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a1c8d841104bc9b6910bcc2c0e2bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe9283584fc4d90b0715216d867ea2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:05:15.467245 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-ed9cc759-bfcb-48af-a197-206e3dcea663 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "GET /compute/v2.1/servers/f45bd103-0f2f-4eb0-83f9-a084adb03d18" status: 200 len: 1512 microversion: 2.1 time: 0.462881 Oct 04 22:05:15.467840 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2213/4494] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:05:15 2022] GET /compute/v2.1/servers/f45bd103-0f2f-4eb0-83f9-a084adb03d18 => generated 1512 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:05:16.462236 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-2705dce8-6f92-4dc3-a377-386e250ce472 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:05:16.464729 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-2705dce8-6f92-4dc3-a377-386e250ce472 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] [instance: 9fd64a5e-1e76-4841-bf99-37ab4d2ce55a] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:05:16.474744 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2705dce8-6f92-4dc3-a377-386e250ce472 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:16.475609 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2705dce8-6f92-4dc3-a377-386e250ce472 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:16.476315 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2705dce8-6f92-4dc3-a377-386e250ce472 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:16.486005 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2705dce8-6f92-4dc3-a377-386e250ce472 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:16.487456 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2705dce8-6f92-4dc3-a377-386e250ce472 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:16.488240 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2705dce8-6f92-4dc3-a377-386e250ce472 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:16.504674 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-27aa4525-7163-49a5-94ac-0450ee3569c9 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:05:16.507653 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-27aa4525-7163-49a5-94ac-0450ee3569c9 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: f45bd103-0f2f-4eb0-83f9-a084adb03d18] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:05:16.509882 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=8 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:05:16.532618 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-27aa4525-7163-49a5-94ac-0450ee3569c9 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:16.535426 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-27aa4525-7163-49a5-94ac-0450ee3569c9 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:16.541782 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-27aa4525-7163-49a5-94ac-0450ee3569c9 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:16.542965 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-27aa4525-7163-49a5-94ac-0450ee3569c9 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:16.545674 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-27aa4525-7163-49a5-94ac-0450ee3569c9 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:16.546879 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-27aa4525-7163-49a5-94ac-0450ee3569c9 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:17.035103 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-2705dce8-6f92-4dc3-a377-386e250ce472 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80fc56886fef422b9b52eb1dede7d10e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82e1a29234ce40f9b37d0eca196cd1db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:05:17.055053 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-2705dce8-6f92-4dc3-a377-386e250ce472 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] 10.222.0.43 "GET /compute/v2.1/servers/9fd64a5e-1e76-4841-bf99-37ab4d2ce55a" status: 200 len: 1367 microversion: 2.1 time: 0.598456 Oct 04 22:05:17.061350 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2282/4495] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:05:16 2022] GET /compute/v2.1/servers/9fd64a5e-1e76-4841-bf99-37ab4d2ce55a => generated 1367 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:05:17.197020 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-27aa4525-7163-49a5-94ac-0450ee3569c9 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a1c8d841104bc9b6910bcc2c0e2bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe9283584fc4d90b0715216d867ea2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:05:17.211397 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-27aa4525-7163-49a5-94ac-0450ee3569c9 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "GET /compute/v2.1/servers/f45bd103-0f2f-4eb0-83f9-a084adb03d18" status: 200 len: 1512 microversion: 2.1 time: 0.710639 Oct 04 22:05:17.212012 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2214/4496] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:05:16 2022] GET /compute/v2.1/servers/f45bd103-0f2f-4eb0-83f9-a084adb03d18 => generated 1512 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:05:18.089054 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-6539fe38-fddf-4dde-9993-01664e667226 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:05:18.089888 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-6539fe38-fddf-4dde-9993-01664e667226 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] [instance: 9fd64a5e-1e76-4841-bf99-37ab4d2ce55a] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:05:18.103873 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6539fe38-fddf-4dde-9993-01664e667226 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:18.105523 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6539fe38-fddf-4dde-9993-01664e667226 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:18.109305 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6539fe38-fddf-4dde-9993-01664e667226 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:18.110484 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6539fe38-fddf-4dde-9993-01664e667226 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:18.113354 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6539fe38-fddf-4dde-9993-01664e667226 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:18.113933 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6539fe38-fddf-4dde-9993-01664e667226 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:18.237272 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-5a90d3f8-2ebf-406d-9da1-8ba111f268aa tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:05:18.237895 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-5a90d3f8-2ebf-406d-9da1-8ba111f268aa tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: f45bd103-0f2f-4eb0-83f9-a084adb03d18] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:05:18.263533 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5a90d3f8-2ebf-406d-9da1-8ba111f268aa tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:18.264212 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5a90d3f8-2ebf-406d-9da1-8ba111f268aa tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:18.265578 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5a90d3f8-2ebf-406d-9da1-8ba111f268aa tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:18.266876 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5a90d3f8-2ebf-406d-9da1-8ba111f268aa tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:18.269398 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5a90d3f8-2ebf-406d-9da1-8ba111f268aa tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:18.269966 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5a90d3f8-2ebf-406d-9da1-8ba111f268aa tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:18.575958 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-6539fe38-fddf-4dde-9993-01664e667226 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80fc56886fef422b9b52eb1dede7d10e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82e1a29234ce40f9b37d0eca196cd1db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:05:18.617323 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-6539fe38-fddf-4dde-9993-01664e667226 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] 10.222.0.43 "GET /compute/v2.1/servers/9fd64a5e-1e76-4841-bf99-37ab4d2ce55a" status: 200 len: 1367 microversion: 2.1 time: 0.533500 Oct 04 22:05:18.623819 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2283/4497] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:05:18 2022] GET /compute/v2.1/servers/9fd64a5e-1e76-4841-bf99-37ab4d2ce55a => generated 1367 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:05:18.657181 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-5a90d3f8-2ebf-406d-9da1-8ba111f268aa tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a1c8d841104bc9b6910bcc2c0e2bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe9283584fc4d90b0715216d867ea2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:05:18.666984 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-5a90d3f8-2ebf-406d-9da1-8ba111f268aa tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "GET /compute/v2.1/servers/f45bd103-0f2f-4eb0-83f9-a084adb03d18" status: 200 len: 1512 microversion: 2.1 time: 0.435087 Oct 04 22:05:18.668132 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2215/4498] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:05:18 2022] GET /compute/v2.1/servers/f45bd103-0f2f-4eb0-83f9-a084adb03d18 => generated 1512 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:05:19.642671 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-d05d6131-e19f-4e23-b604-ad61104c6fe3 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:05:19.643303 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-d05d6131-e19f-4e23-b604-ad61104c6fe3 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] [instance: 9fd64a5e-1e76-4841-bf99-37ab4d2ce55a] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:05:19.666191 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d05d6131-e19f-4e23-b604-ad61104c6fe3 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:19.666844 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d05d6131-e19f-4e23-b604-ad61104c6fe3 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:19.667483 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d05d6131-e19f-4e23-b604-ad61104c6fe3 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:19.668952 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d05d6131-e19f-4e23-b604-ad61104c6fe3 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:19.676041 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d05d6131-e19f-4e23-b604-ad61104c6fe3 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:19.676704 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d05d6131-e19f-4e23-b604-ad61104c6fe3 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:19.694322 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-d09493f9-ea5b-4400-a667-53f4201c62f2 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:05:19.695084 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-d09493f9-ea5b-4400-a667-53f4201c62f2 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: f45bd103-0f2f-4eb0-83f9-a084adb03d18] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:05:19.730682 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d09493f9-ea5b-4400-a667-53f4201c62f2 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:19.737142 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d09493f9-ea5b-4400-a667-53f4201c62f2 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:19.737850 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d09493f9-ea5b-4400-a667-53f4201c62f2 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:19.738894 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d09493f9-ea5b-4400-a667-53f4201c62f2 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:19.747908 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d09493f9-ea5b-4400-a667-53f4201c62f2 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:19.752758 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d09493f9-ea5b-4400-a667-53f4201c62f2 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:19.822005 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=100 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:05:20.664733 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-d09493f9-ea5b-4400-a667-53f4201c62f2 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a1c8d841104bc9b6910bcc2c0e2bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe9283584fc4d90b0715216d867ea2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:05:20.679080 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-d09493f9-ea5b-4400-a667-53f4201c62f2 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "GET /compute/v2.1/servers/f45bd103-0f2f-4eb0-83f9-a084adb03d18" status: 200 len: 1512 microversion: 2.1 time: 0.989166 Oct 04 22:05:20.680078 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2216/4499] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:05:19 2022] GET /compute/v2.1/servers/f45bd103-0f2f-4eb0-83f9-a084adb03d18 => generated 1512 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:05:20.756391 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-d05d6131-e19f-4e23-b604-ad61104c6fe3 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80fc56886fef422b9b52eb1dede7d10e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82e1a29234ce40f9b37d0eca196cd1db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:05:20.773457 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-d05d6131-e19f-4e23-b604-ad61104c6fe3 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] 10.222.0.43 "GET /compute/v2.1/servers/9fd64a5e-1e76-4841-bf99-37ab4d2ce55a" status: 200 len: 1367 microversion: 2.1 time: 1.134569 Oct 04 22:05:20.790444 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2284/4500] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:05:19 2022] GET /compute/v2.1/servers/9fd64a5e-1e76-4841-bf99-37ab4d2ce55a => generated 1367 bytes in 1136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:05:21.706183 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-62489d7b-4fb7-40d4-b789-ed8543dfd7d4 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:05:21.706837 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-62489d7b-4fb7-40d4-b789-ed8543dfd7d4 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: f45bd103-0f2f-4eb0-83f9-a084adb03d18] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:05:21.734314 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-62489d7b-4fb7-40d4-b789-ed8543dfd7d4 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:21.734856 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-62489d7b-4fb7-40d4-b789-ed8543dfd7d4 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:21.735305 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-62489d7b-4fb7-40d4-b789-ed8543dfd7d4 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:21.736033 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-62489d7b-4fb7-40d4-b789-ed8543dfd7d4 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:21.740791 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-62489d7b-4fb7-40d4-b789-ed8543dfd7d4 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:21.742083 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-62489d7b-4fb7-40d4-b789-ed8543dfd7d4 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:21.805686 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-d16e42d3-c9a7-4469-9dc8-fbaf509e9a2b tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:05:21.807002 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-d16e42d3-c9a7-4469-9dc8-fbaf509e9a2b tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] [instance: 9fd64a5e-1e76-4841-bf99-37ab4d2ce55a] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:05:21.826828 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d16e42d3-c9a7-4469-9dc8-fbaf509e9a2b tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:21.831101 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d16e42d3-c9a7-4469-9dc8-fbaf509e9a2b tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:21.831809 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d16e42d3-c9a7-4469-9dc8-fbaf509e9a2b tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:21.835578 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d16e42d3-c9a7-4469-9dc8-fbaf509e9a2b tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:21.837035 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d16e42d3-c9a7-4469-9dc8-fbaf509e9a2b tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:21.837676 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d16e42d3-c9a7-4469-9dc8-fbaf509e9a2b tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:22.268378 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-62489d7b-4fb7-40d4-b789-ed8543dfd7d4 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a1c8d841104bc9b6910bcc2c0e2bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe9283584fc4d90b0715216d867ea2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:05:22.277532 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-62489d7b-4fb7-40d4-b789-ed8543dfd7d4 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "GET /compute/v2.1/servers/f45bd103-0f2f-4eb0-83f9-a084adb03d18" status: 200 len: 1512 microversion: 2.1 time: 0.576472 Oct 04 22:05:22.278151 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2217/4501] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:05:21 2022] GET /compute/v2.1/servers/f45bd103-0f2f-4eb0-83f9-a084adb03d18 => generated 1512 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:05:22.401678 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-d16e42d3-c9a7-4469-9dc8-fbaf509e9a2b tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80fc56886fef422b9b52eb1dede7d10e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82e1a29234ce40f9b37d0eca196cd1db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:05:22.412706 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-d16e42d3-c9a7-4469-9dc8-fbaf509e9a2b tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] 10.222.0.43 "GET /compute/v2.1/servers/9fd64a5e-1e76-4841-bf99-37ab4d2ce55a" status: 200 len: 1367 microversion: 2.1 time: 0.611495 Oct 04 22:05:22.426443 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2285/4502] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:05:21 2022] GET /compute/v2.1/servers/9fd64a5e-1e76-4841-bf99-37ab4d2ce55a => generated 1367 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:05:23.305211 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-7b24290b-9da9-4e2a-a3d7-69e69fcf021d tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:05:23.307660 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-7b24290b-9da9-4e2a-a3d7-69e69fcf021d tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: f45bd103-0f2f-4eb0-83f9-a084adb03d18] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:05:23.324867 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7b24290b-9da9-4e2a-a3d7-69e69fcf021d tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:23.326968 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7b24290b-9da9-4e2a-a3d7-69e69fcf021d tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:23.328321 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7b24290b-9da9-4e2a-a3d7-69e69fcf021d tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:23.330406 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7b24290b-9da9-4e2a-a3d7-69e69fcf021d tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:23.332436 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7b24290b-9da9-4e2a-a3d7-69e69fcf021d tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:23.334218 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7b24290b-9da9-4e2a-a3d7-69e69fcf021d tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:23.340212 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-d30bc804-c3d5-4a12-9ef9-b291280291ff req-e5b1bcfd-64df-4026-86e3-996fe3acf797 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fd64a5e-1e76-4841-bf99-37ab4d2ce55a", "name": "network-vif-plugged", "status": "completed", "tag": "dbf78af7-5b9d-4366-ac1b-b66ca10a6554"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:05:23.355602 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-d30bc804-c3d5-4a12-9ef9-b291280291ff req-e5b1bcfd-64df-4026-86e3-996fe3acf797 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:23.356320 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-d30bc804-c3d5-4a12-9ef9-b291280291ff req-e5b1bcfd-64df-4026-86e3-996fe3acf797 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:23.356949 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-d30bc804-c3d5-4a12-9ef9-b291280291ff req-e5b1bcfd-64df-4026-86e3-996fe3acf797 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:23.375404 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-d30bc804-c3d5-4a12-9ef9-b291280291ff req-e5b1bcfd-64df-4026-86e3-996fe3acf797 service nova] Creating event network-vif-plugged:dbf78af7-5b9d-4366-ac1b-b66ca10a6554 for instance 9fd64a5e-1e76-4841-bf99-37ab4d2ce55a on n-h1-860284-1 Oct 04 22:05:23.399484 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-d30bc804-c3d5-4a12-9ef9-b291280291ff req-e5b1bcfd-64df-4026-86e3-996fe3acf797 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064422 Oct 04 22:05:23.401222 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2286/4503] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:05:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:05:23.439012 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-fc99a244-37f1-4b43-ba90-f59414305cee tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:05:23.439882 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-fc99a244-37f1-4b43-ba90-f59414305cee tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] [instance: 9fd64a5e-1e76-4841-bf99-37ab4d2ce55a] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:05:23.452148 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fc99a244-37f1-4b43-ba90-f59414305cee tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:23.454813 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fc99a244-37f1-4b43-ba90-f59414305cee tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:23.455335 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fc99a244-37f1-4b43-ba90-f59414305cee tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:23.461744 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fc99a244-37f1-4b43-ba90-f59414305cee tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:23.478253 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fc99a244-37f1-4b43-ba90-f59414305cee tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:23.479000 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fc99a244-37f1-4b43-ba90-f59414305cee tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:23.832004 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-fc99a244-37f1-4b43-ba90-f59414305cee tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80fc56886fef422b9b52eb1dede7d10e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82e1a29234ce40f9b37d0eca196cd1db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:05:23.844339 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-fc99a244-37f1-4b43-ba90-f59414305cee tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] 10.222.0.43 "GET /compute/v2.1/servers/9fd64a5e-1e76-4841-bf99-37ab4d2ce55a" status: 200 len: 1367 microversion: 2.1 time: 0.408634 Oct 04 22:05:23.847477 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2287/4504] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:05:23 2022] GET /compute/v2.1/servers/9fd64a5e-1e76-4841-bf99-37ab4d2ce55a => generated 1367 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:05:23.885924 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-7b24290b-9da9-4e2a-a3d7-69e69fcf021d tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a1c8d841104bc9b6910bcc2c0e2bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe9283584fc4d90b0715216d867ea2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:05:23.895772 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-7b24290b-9da9-4e2a-a3d7-69e69fcf021d tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "GET /compute/v2.1/servers/f45bd103-0f2f-4eb0-83f9-a084adb03d18" status: 200 len: 1512 microversion: 2.1 time: 0.596608 Oct 04 22:05:23.903244 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2218/4505] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:05:23 2022] GET /compute/v2.1/servers/f45bd103-0f2f-4eb0-83f9-a084adb03d18 => generated 1512 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:05:24.875510 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-0c9de953-3715-43d9-b786-8b5b1ed0f903 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:05:24.877638 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-0c9de953-3715-43d9-b786-8b5b1ed0f903 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] [instance: 9fd64a5e-1e76-4841-bf99-37ab4d2ce55a] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:05:24.893618 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0c9de953-3715-43d9-b786-8b5b1ed0f903 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:24.894724 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0c9de953-3715-43d9-b786-8b5b1ed0f903 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:24.895356 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0c9de953-3715-43d9-b786-8b5b1ed0f903 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:24.897599 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0c9de953-3715-43d9-b786-8b5b1ed0f903 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:24.898426 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0c9de953-3715-43d9-b786-8b5b1ed0f903 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:24.898861 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0c9de953-3715-43d9-b786-8b5b1ed0f903 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:24.921784 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e96472fb-2510-4a59-ba07-a0c9e1ca8c0d tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:05:24.923103 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-e96472fb-2510-4a59-ba07-a0c9e1ca8c0d tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: f45bd103-0f2f-4eb0-83f9-a084adb03d18] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:05:24.937955 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e96472fb-2510-4a59-ba07-a0c9e1ca8c0d tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:24.938781 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e96472fb-2510-4a59-ba07-a0c9e1ca8c0d tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:24.939467 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e96472fb-2510-4a59-ba07-a0c9e1ca8c0d tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:24.940293 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e96472fb-2510-4a59-ba07-a0c9e1ca8c0d tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:24.940851 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e96472fb-2510-4a59-ba07-a0c9e1ca8c0d tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:24.941427 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e96472fb-2510-4a59-ba07-a0c9e1ca8c0d tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:25.438738 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-0c9de953-3715-43d9-b786-8b5b1ed0f903 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80fc56886fef422b9b52eb1dede7d10e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82e1a29234ce40f9b37d0eca196cd1db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:05:25.455621 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-0c9de953-3715-43d9-b786-8b5b1ed0f903 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] 10.222.0.43 "GET /compute/v2.1/servers/9fd64a5e-1e76-4841-bf99-37ab4d2ce55a" status: 200 len: 1367 microversion: 2.1 time: 0.584677 Oct 04 22:05:25.470547 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2288/4506] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:05:24 2022] GET /compute/v2.1/servers/9fd64a5e-1e76-4841-bf99-37ab4d2ce55a => generated 1367 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:05:25.887009 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-e96472fb-2510-4a59-ba07-a0c9e1ca8c0d tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a1c8d841104bc9b6910bcc2c0e2bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe9283584fc4d90b0715216d867ea2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:05:25.903954 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-e96472fb-2510-4a59-ba07-a0c9e1ca8c0d tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "GET /compute/v2.1/servers/f45bd103-0f2f-4eb0-83f9-a084adb03d18" status: 200 len: 1512 microversion: 2.1 time: 0.984559 Oct 04 22:05:25.905178 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2219/4507] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:05:24 2022] GET /compute/v2.1/servers/f45bd103-0f2f-4eb0-83f9-a084adb03d18 => generated 1512 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:05:26.483947 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-f5063e33-ec78-488b-a9ba-0a1a1177a353 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:05:26.484608 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-f5063e33-ec78-488b-a9ba-0a1a1177a353 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] [instance: 9fd64a5e-1e76-4841-bf99-37ab4d2ce55a] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:05:26.497484 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f5063e33-ec78-488b-a9ba-0a1a1177a353 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:26.498631 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f5063e33-ec78-488b-a9ba-0a1a1177a353 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:26.499399 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f5063e33-ec78-488b-a9ba-0a1a1177a353 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:26.500837 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f5063e33-ec78-488b-a9ba-0a1a1177a353 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:26.501718 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f5063e33-ec78-488b-a9ba-0a1a1177a353 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:26.505954 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f5063e33-ec78-488b-a9ba-0a1a1177a353 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:26.893697 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-f5063e33-ec78-488b-a9ba-0a1a1177a353 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80fc56886fef422b9b52eb1dede7d10e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82e1a29234ce40f9b37d0eca196cd1db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:05:26.913272 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-f5063e33-ec78-488b-a9ba-0a1a1177a353 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] 10.222.0.43 "GET /compute/v2.1/servers/9fd64a5e-1e76-4841-bf99-37ab4d2ce55a" status: 200 len: 1558 microversion: 2.1 time: 0.434250 Oct 04 22:05:26.913883 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2289/4508] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:05:26 2022] GET /compute/v2.1/servers/9fd64a5e-1e76-4841-bf99-37ab4d2ce55a => generated 1558 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:05:26.942047 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-62c392c6-ab18-43db-bcf6-f8db06b34ef9 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:05:26.948405 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-a95ccd50-4f75-44bc-be6f-f408ae3c6980 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:05:26.949483 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-62c392c6-ab18-43db-bcf6-f8db06b34ef9 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: f45bd103-0f2f-4eb0-83f9-a084adb03d18] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:05:26.953136 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-a95ccd50-4f75-44bc-be6f-f408ae3c6980 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] [instance: 9fd64a5e-1e76-4841-bf99-37ab4d2ce55a] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:05:26.961249 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-62c392c6-ab18-43db-bcf6-f8db06b34ef9 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:26.962013 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-62c392c6-ab18-43db-bcf6-f8db06b34ef9 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:26.962762 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-62c392c6-ab18-43db-bcf6-f8db06b34ef9 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:26.963715 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-62c392c6-ab18-43db-bcf6-f8db06b34ef9 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:26.964467 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-62c392c6-ab18-43db-bcf6-f8db06b34ef9 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:26.968780 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-62c392c6-ab18-43db-bcf6-f8db06b34ef9 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:26.982981 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a95ccd50-4f75-44bc-be6f-f408ae3c6980 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:26.983508 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a95ccd50-4f75-44bc-be6f-f408ae3c6980 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:26.983959 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a95ccd50-4f75-44bc-be6f-f408ae3c6980 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:26.984696 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a95ccd50-4f75-44bc-be6f-f408ae3c6980 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:26.985160 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a95ccd50-4f75-44bc-be6f-f408ae3c6980 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:26.985587 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a95ccd50-4f75-44bc-be6f-f408ae3c6980 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:27.032718 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:05:27.291880 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-a95ccd50-4f75-44bc-be6f-f408ae3c6980 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] 10.222.0.43 "GET /compute/v2.1/servers/9fd64a5e-1e76-4841-bf99-37ab4d2ce55a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.354322 Oct 04 22:05:27.301451 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2290/4509] 10.222.0.43 () {58 vars in 1275 bytes} [Tue Oct 4 22:05:26 2022] GET /compute/v2.1/servers/9fd64a5e-1e76-4841-bf99-37ab4d2ce55a/os-interface => generated 285 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:05:27.611322 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-62c392c6-ab18-43db-bcf6-f8db06b34ef9 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a1c8d841104bc9b6910bcc2c0e2bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe9283584fc4d90b0715216d867ea2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:05:27.623660 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-62c392c6-ab18-43db-bcf6-f8db06b34ef9 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "GET /compute/v2.1/servers/f45bd103-0f2f-4eb0-83f9-a084adb03d18" status: 200 len: 1512 microversion: 2.1 time: 0.689725 Oct 04 22:05:27.635775 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2220/4510] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:05:26 2022] GET /compute/v2.1/servers/f45bd103-0f2f-4eb0-83f9-a084adb03d18 => generated 1512 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:05:28.652137 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-894b7bc9-bf2f-44d8-ab73-610ac7e02d8d tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:05:28.653559 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-894b7bc9-bf2f-44d8-ab73-610ac7e02d8d tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: f45bd103-0f2f-4eb0-83f9-a084adb03d18] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:05:28.665330 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-894b7bc9-bf2f-44d8-ab73-610ac7e02d8d tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:28.667364 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-894b7bc9-bf2f-44d8-ab73-610ac7e02d8d tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:28.669130 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-894b7bc9-bf2f-44d8-ab73-610ac7e02d8d tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:28.670825 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-894b7bc9-bf2f-44d8-ab73-610ac7e02d8d tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:28.672488 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-894b7bc9-bf2f-44d8-ab73-610ac7e02d8d tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:28.673093 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-894b7bc9-bf2f-44d8-ab73-610ac7e02d8d tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:29.288388 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-894b7bc9-bf2f-44d8-ab73-610ac7e02d8d tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a1c8d841104bc9b6910bcc2c0e2bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe9283584fc4d90b0715216d867ea2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:05:29.298124 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-894b7bc9-bf2f-44d8-ab73-610ac7e02d8d tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "GET /compute/v2.1/servers/f45bd103-0f2f-4eb0-83f9-a084adb03d18" status: 200 len: 1512 microversion: 2.1 time: 0.649975 Oct 04 22:05:29.315036 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2291/4511] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:05:28 2022] GET /compute/v2.1/servers/f45bd103-0f2f-4eb0-83f9-a084adb03d18 => generated 1512 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:05:30.325499 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-a8db720f-a16b-4441-82f5-cb0f571589a7 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:05:30.326123 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-a8db720f-a16b-4441-82f5-cb0f571589a7 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: f45bd103-0f2f-4eb0-83f9-a084adb03d18] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:05:30.343208 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a8db720f-a16b-4441-82f5-cb0f571589a7 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:30.343980 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a8db720f-a16b-4441-82f5-cb0f571589a7 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:30.348679 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a8db720f-a16b-4441-82f5-cb0f571589a7 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:30.350704 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a8db720f-a16b-4441-82f5-cb0f571589a7 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:30.351363 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a8db720f-a16b-4441-82f5-cb0f571589a7 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:30.351971 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a8db720f-a16b-4441-82f5-cb0f571589a7 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:31.424437 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-91c2b9a0-9b0d-4463-a08b-6681d2a6850d req-91681dfd-96b9-4936-b8f4-a01d7cd3a2e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9fd64a5e-1e76-4841-bf99-37ab4d2ce55a", "tag": "dbf78af7-5b9d-4366-ac1b-b66ca10a6554"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:05:31.432285 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-a8db720f-a16b-4441-82f5-cb0f571589a7 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a1c8d841104bc9b6910bcc2c0e2bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe9283584fc4d90b0715216d867ea2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:05:31.442334 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-a8db720f-a16b-4441-82f5-cb0f571589a7 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "GET /compute/v2.1/servers/f45bd103-0f2f-4eb0-83f9-a084adb03d18" status: 200 len: 1512 microversion: 2.1 time: 1.122498 Oct 04 22:05:31.450424 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2221/4512] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:05:30 2022] GET /compute/v2.1/servers/f45bd103-0f2f-4eb0-83f9-a084adb03d18 => generated 1512 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:05:31.452857 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-91c2b9a0-9b0d-4463-a08b-6681d2a6850d req-91681dfd-96b9-4936-b8f4-a01d7cd3a2e8 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:31.454855 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-91c2b9a0-9b0d-4463-a08b-6681d2a6850d req-91681dfd-96b9-4936-b8f4-a01d7cd3a2e8 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:31.456648 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-91c2b9a0-9b0d-4463-a08b-6681d2a6850d req-91681dfd-96b9-4936-b8f4-a01d7cd3a2e8 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:31.481405 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-91c2b9a0-9b0d-4463-a08b-6681d2a6850d req-91681dfd-96b9-4936-b8f4-a01d7cd3a2e8 service nova] Creating event network-changed:dbf78af7-5b9d-4366-ac1b-b66ca10a6554 for instance 9fd64a5e-1e76-4841-bf99-37ab4d2ce55a on n-h1-860284-1 Oct 04 22:05:31.488603 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-91c2b9a0-9b0d-4463-a08b-6681d2a6850d req-91681dfd-96b9-4936-b8f4-a01d7cd3a2e8 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067728 Oct 04 22:05:31.490889 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2292/4513] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:05:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:05:32.472580 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-a048c306-f0d3-4357-8b48-803df2626abd tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:05:32.473328 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-a048c306-f0d3-4357-8b48-803df2626abd tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: f45bd103-0f2f-4eb0-83f9-a084adb03d18] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:05:32.492058 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a048c306-f0d3-4357-8b48-803df2626abd tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:32.492827 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a048c306-f0d3-4357-8b48-803df2626abd tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:32.493430 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a048c306-f0d3-4357-8b48-803df2626abd tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:32.494348 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a048c306-f0d3-4357-8b48-803df2626abd tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:32.494835 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a048c306-f0d3-4357-8b48-803df2626abd tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:32.495263 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a048c306-f0d3-4357-8b48-803df2626abd tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:32.951816 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-a048c306-f0d3-4357-8b48-803df2626abd tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a1c8d841104bc9b6910bcc2c0e2bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe9283584fc4d90b0715216d867ea2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:05:32.968305 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-a048c306-f0d3-4357-8b48-803df2626abd tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "GET /compute/v2.1/servers/f45bd103-0f2f-4eb0-83f9-a084adb03d18" status: 200 len: 1512 microversion: 2.1 time: 0.499594 Oct 04 22:05:32.969596 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2222/4514] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:05:32 2022] GET /compute/v2.1/servers/f45bd103-0f2f-4eb0-83f9-a084adb03d18 => generated 1512 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:05:33.997876 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-22bcc2f8-ca18-44c3-afe6-153e39a363d8 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:05:33.998549 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-22bcc2f8-ca18-44c3-afe6-153e39a363d8 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: f45bd103-0f2f-4eb0-83f9-a084adb03d18] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:05:34.012323 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-22bcc2f8-ca18-44c3-afe6-153e39a363d8 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:34.012839 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-22bcc2f8-ca18-44c3-afe6-153e39a363d8 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:34.013289 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-22bcc2f8-ca18-44c3-afe6-153e39a363d8 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:34.014039 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-22bcc2f8-ca18-44c3-afe6-153e39a363d8 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:34.014719 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-22bcc2f8-ca18-44c3-afe6-153e39a363d8 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:34.015161 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-22bcc2f8-ca18-44c3-afe6-153e39a363d8 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:34.430792 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-22bcc2f8-ca18-44c3-afe6-153e39a363d8 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a1c8d841104bc9b6910bcc2c0e2bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe9283584fc4d90b0715216d867ea2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:05:34.445036 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-22bcc2f8-ca18-44c3-afe6-153e39a363d8 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "GET /compute/v2.1/servers/f45bd103-0f2f-4eb0-83f9-a084adb03d18" status: 200 len: 1512 microversion: 2.1 time: 0.452551 Oct 04 22:05:34.461384 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2293/4515] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:05:33 2022] GET /compute/v2.1/servers/f45bd103-0f2f-4eb0-83f9-a084adb03d18 => generated 1512 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:05:34.751765 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-b74497b1-7d66-411c-86a3-c71c563dc24b tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1064768549", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452", "networks": [{"uuid": "c393a93b-86db-4b77-9ce9-efed0ce936ba"}, {"uuid": "dd6f2a32-3d4a-4d94-9037-94d352aaf54f"}, {"uuid": "c393a93b-86db-4b77-9ce9-efed0ce936ba"}]}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:05:34.800309 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=3 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:05:34.845770 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.network.neutron [None req-b74497b1-7d66-411c-86a3-c71c563dc24b tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] validate_networks() for [('c393a93b-86db-4b77-9ce9-efed0ce936ba', None, None, None, None, None), ('dd6f2a32-3d4a-4d94-9037-94d352aaf54f', None, None, None, None, None), ('c393a93b-86db-4b77-9ce9-efed0ce936ba', None, None, None, None, None)] {{(pid=134101) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 22:05:35.472378 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-14dba39f-bf56-461e-ad46-d976098865fd tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:05:35.473207 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-14dba39f-bf56-461e-ad46-d976098865fd tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: f45bd103-0f2f-4eb0-83f9-a084adb03d18] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:05:35.501332 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-14dba39f-bf56-461e-ad46-d976098865fd tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:35.502216 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-14dba39f-bf56-461e-ad46-d976098865fd tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:35.503114 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-14dba39f-bf56-461e-ad46-d976098865fd tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:35.509885 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-14dba39f-bf56-461e-ad46-d976098865fd tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:35.510581 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-14dba39f-bf56-461e-ad46-d976098865fd tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:35.511349 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-14dba39f-bf56-461e-ad46-d976098865fd tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:37.048996 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-14dba39f-bf56-461e-ad46-d976098865fd tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a1c8d841104bc9b6910bcc2c0e2bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe9283584fc4d90b0715216d867ea2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:05:37.060543 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-14dba39f-bf56-461e-ad46-d976098865fd tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "GET /compute/v2.1/servers/f45bd103-0f2f-4eb0-83f9-a084adb03d18" status: 200 len: 1512 microversion: 2.1 time: 1.592170 Oct 04 22:05:37.067787 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2294/4516] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:05:35 2022] GET /compute/v2.1/servers/f45bd103-0f2f-4eb0-83f9-a084adb03d18 => generated 1512 bytes in 1600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:05:38.090033 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-78648b00-75df-4b0c-8a59-3eade3ef0bba tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:05:38.090762 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-78648b00-75df-4b0c-8a59-3eade3ef0bba tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: f45bd103-0f2f-4eb0-83f9-a084adb03d18] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:05:38.110004 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-78648b00-75df-4b0c-8a59-3eade3ef0bba tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:38.110538 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-78648b00-75df-4b0c-8a59-3eade3ef0bba tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:38.111198 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-78648b00-75df-4b0c-8a59-3eade3ef0bba tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:38.112670 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-78648b00-75df-4b0c-8a59-3eade3ef0bba tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:38.113311 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-78648b00-75df-4b0c-8a59-3eade3ef0bba tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:38.113895 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-78648b00-75df-4b0c-8a59-3eade3ef0bba tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:38.477820 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-78648b00-75df-4b0c-8a59-3eade3ef0bba tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a1c8d841104bc9b6910bcc2c0e2bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe9283584fc4d90b0715216d867ea2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:05:38.483057 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-b74497b1-7d66-411c-86a3-c71c563dc24b tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Flavor limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 22:05:38.483674 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-b74497b1-7d66-411c-86a3-c71c563dc24b tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Image limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 22:05:38.483996 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-b74497b1-7d66-411c-86a3-c71c563dc24b tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Flavor pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 22:05:38.484793 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-b74497b1-7d66-411c-86a3-c71c563dc24b tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Image pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 22:05:38.485395 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-b74497b1-7d66-411c-86a3-c71c563dc24b tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 22:05:38.499959 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-78648b00-75df-4b0c-8a59-3eade3ef0bba tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "GET /compute/v2.1/servers/f45bd103-0f2f-4eb0-83f9-a084adb03d18" status: 200 len: 1512 microversion: 2.1 time: 0.413173 Oct 04 22:05:38.501327 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2295/4517] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:05:38 2022] GET /compute/v2.1/servers/f45bd103-0f2f-4eb0-83f9-a084adb03d18 => generated 1512 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:05:38.512780 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b74497b1-7d66-411c-86a3-c71c563dc24b tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:38.513288 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b74497b1-7d66-411c-86a3-c71c563dc24b tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:38.513735 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b74497b1-7d66-411c-86a3-c71c563dc24b tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:38.514508 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b74497b1-7d66-411c-86a3-c71c563dc24b tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:38.514970 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b74497b1-7d66-411c-86a3-c71c563dc24b tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:38.527251 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b74497b1-7d66-411c-86a3-c71c563dc24b tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:38.641962 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-b74497b1-7d66-411c-86a3-c71c563dc24b tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Getting quotas for project a555982bb6f841d7a72b6eca84a6150f. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:05:38.668073 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-b74497b1-7d66-411c-86a3-c71c563dc24b tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Getting quotas for user 4cd0931292c245578bea8861f9ba7607 and project a555982bb6f841d7a72b6eca84a6150f. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:05:38.708679 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-b74497b1-7d66-411c-86a3-c71c563dc24b tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Going to run 1 instances... {{(pid=134101) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 22:05:38.719280 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-b74497b1-7d66-411c-86a3-c71c563dc24b tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] [instance: 09bf867a-5ad2-42cd-bbd5-66e92dc8fff0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='58548514-5dac-426c-81f5-19e3fba33e23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134101) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 22:05:38.865712 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-b74497b1-7d66-411c-86a3-c71c563dc24b tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.119024 Oct 04 22:05:38.870478 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2223/4518] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 22:05:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 4125 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 22:05:38.883548 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-11e1f772-673f-4353-b87b-fea133026d25 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:05:38.884281 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-11e1f772-673f-4353-b87b-fea133026d25 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] [instance: 09bf867a-5ad2-42cd-bbd5-66e92dc8fff0] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:05:39.009406 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-11e1f772-673f-4353-b87b-fea133026d25 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cd0931292c245578bea8861f9ba7607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a555982bb6f841d7a72b6eca84a6150f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:05:39.036372 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-11e1f772-673f-4353-b87b-fea133026d25 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] 10.222.0.43 "GET /compute/v2.1/servers/09bf867a-5ad2-42cd-bbd5-66e92dc8fff0" status: 200 len: 1213 microversion: 2.1 time: 0.154680 Oct 04 22:05:39.050397 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2296/4519] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:05:38 2022] GET /compute/v2.1/servers/09bf867a-5ad2-42cd-bbd5-66e92dc8fff0 => generated 1213 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:05:39.540642 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-f8cc4529-8bb8-4d8a-ab48-be1ba6b00a3e tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:05:39.541275 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-f8cc4529-8bb8-4d8a-ab48-be1ba6b00a3e tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: f45bd103-0f2f-4eb0-83f9-a084adb03d18] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:05:39.560823 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f8cc4529-8bb8-4d8a-ab48-be1ba6b00a3e tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:39.561332 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f8cc4529-8bb8-4d8a-ab48-be1ba6b00a3e tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:39.561774 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f8cc4529-8bb8-4d8a-ab48-be1ba6b00a3e tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:39.562516 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f8cc4529-8bb8-4d8a-ab48-be1ba6b00a3e tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:39.571966 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f8cc4529-8bb8-4d8a-ab48-be1ba6b00a3e tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:39.572724 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f8cc4529-8bb8-4d8a-ab48-be1ba6b00a3e tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:39.903059 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-f8cc4529-8bb8-4d8a-ab48-be1ba6b00a3e tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a1c8d841104bc9b6910bcc2c0e2bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe9283584fc4d90b0715216d867ea2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:05:39.922964 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-f8cc4529-8bb8-4d8a-ab48-be1ba6b00a3e tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "GET /compute/v2.1/servers/f45bd103-0f2f-4eb0-83f9-a084adb03d18" status: 200 len: 1489 microversion: 2.1 time: 0.397278 Oct 04 22:05:39.938463 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2224/4520] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:05:39 2022] GET /compute/v2.1/servers/f45bd103-0f2f-4eb0-83f9-a084adb03d18 => generated 1489 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:05:39.948337 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-863a4c9d-25e3-4a59-a3dd-a78a82500f7b tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:05:39.948893 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-863a4c9d-25e3-4a59-a3dd-a78a82500f7b tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: f45bd103-0f2f-4eb0-83f9-a084adb03d18] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:05:39.964539 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_api:DELETE=1,nova_api:SELECT=49 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:05:39.966238 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-863a4c9d-25e3-4a59-a3dd-a78a82500f7b tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:39.966956 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-863a4c9d-25e3-4a59-a3dd-a78a82500f7b tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:39.967572 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-863a4c9d-25e3-4a59-a3dd-a78a82500f7b tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:39.968439 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-863a4c9d-25e3-4a59-a3dd-a78a82500f7b tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:39.969056 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-863a4c9d-25e3-4a59-a3dd-a78a82500f7b tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:39.969639 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-863a4c9d-25e3-4a59-a3dd-a78a82500f7b tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:40.019336 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-863a4c9d-25e3-4a59-a3dd-a78a82500f7b tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: f45bd103-0f2f-4eb0-83f9-a084adb03d18] Going to try to terminate instance {{(pid=134102) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 22:05:40.074735 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-228b935a-de4f-4fe8-a72d-ca7513630cdd tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:05:40.075846 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-228b935a-de4f-4fe8-a72d-ca7513630cdd tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] [instance: 09bf867a-5ad2-42cd-bbd5-66e92dc8fff0] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:05:40.090164 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-228b935a-de4f-4fe8-a72d-ca7513630cdd tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:40.091285 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-228b935a-de4f-4fe8-a72d-ca7513630cdd tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:40.093634 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-228b935a-de4f-4fe8-a72d-ca7513630cdd tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:40.097271 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-228b935a-de4f-4fe8-a72d-ca7513630cdd tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:40.097271 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-228b935a-de4f-4fe8-a72d-ca7513630cdd tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:40.097271 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-228b935a-de4f-4fe8-a72d-ca7513630cdd tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:40.228649 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-863a4c9d-25e3-4a59-a3dd-a78a82500f7b tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "DELETE /compute/v2.1/servers/f45bd103-0f2f-4eb0-83f9-a084adb03d18" status: 204 len: 0 microversion: 2.1 time: 0.283839 Oct 04 22:05:40.229614 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2297/4521] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 22:05:39 2022] DELETE /compute/v2.1/servers/f45bd103-0f2f-4eb0-83f9-a084adb03d18 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 22:05:40.242091 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-b1c468ce-6295-4aae-aaa7-0cb73014115d tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:05:40.242926 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-b1c468ce-6295-4aae-aaa7-0cb73014115d tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: f45bd103-0f2f-4eb0-83f9-a084adb03d18] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:05:40.249185 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b1c468ce-6295-4aae-aaa7-0cb73014115d tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:40.249682 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b1c468ce-6295-4aae-aaa7-0cb73014115d tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:40.250285 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b1c468ce-6295-4aae-aaa7-0cb73014115d tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:40.251026 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b1c468ce-6295-4aae-aaa7-0cb73014115d tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:40.251535 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b1c468ce-6295-4aae-aaa7-0cb73014115d tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:40.251968 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b1c468ce-6295-4aae-aaa7-0cb73014115d tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:40.302404 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-228b935a-de4f-4fe8-a72d-ca7513630cdd tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cd0931292c245578bea8861f9ba7607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a555982bb6f841d7a72b6eca84a6150f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:05:40.318052 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-228b935a-de4f-4fe8-a72d-ca7513630cdd tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] 10.222.0.43 "GET /compute/v2.1/servers/09bf867a-5ad2-42cd-bbd5-66e92dc8fff0" status: 200 len: 1265 microversion: 2.1 time: 0.250891 Oct 04 22:05:40.324288 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2225/4522] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:05:40 2022] GET /compute/v2.1/servers/09bf867a-5ad2-42cd-bbd5-66e92dc8fff0 => generated 1265 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:05:40.516322 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-b1c468ce-6295-4aae-aaa7-0cb73014115d tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a1c8d841104bc9b6910bcc2c0e2bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe9283584fc4d90b0715216d867ea2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:05:40.526168 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-b1c468ce-6295-4aae-aaa7-0cb73014115d tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "GET /compute/v2.1/servers/f45bd103-0f2f-4eb0-83f9-a084adb03d18" status: 200 len: 1495 microversion: 2.1 time: 0.292241 Oct 04 22:05:40.542394 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2298/4523] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:05:40 2022] GET /compute/v2.1/servers/f45bd103-0f2f-4eb0-83f9-a084adb03d18 => generated 1495 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:05:41.347692 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-fc6e5694-55e6-4deb-b6b6-49956815b008 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:05:41.350422 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-fc6e5694-55e6-4deb-b6b6-49956815b008 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] [instance: 09bf867a-5ad2-42cd-bbd5-66e92dc8fff0] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:05:41.360050 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fc6e5694-55e6-4deb-b6b6-49956815b008 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:41.361625 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fc6e5694-55e6-4deb-b6b6-49956815b008 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:41.362248 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fc6e5694-55e6-4deb-b6b6-49956815b008 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:41.363156 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fc6e5694-55e6-4deb-b6b6-49956815b008 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:41.363803 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fc6e5694-55e6-4deb-b6b6-49956815b008 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:41.364808 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fc6e5694-55e6-4deb-b6b6-49956815b008 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:41.510823 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-fc6e5694-55e6-4deb-b6b6-49956815b008 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cd0931292c245578bea8861f9ba7607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a555982bb6f841d7a72b6eca84a6150f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:05:41.526295 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-fc6e5694-55e6-4deb-b6b6-49956815b008 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] 10.222.0.43 "GET /compute/v2.1/servers/09bf867a-5ad2-42cd-bbd5-66e92dc8fff0" status: 200 len: 1265 microversion: 2.1 time: 0.182741 Oct 04 22:05:41.526931 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2226/4524] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:05:41 2022] GET /compute/v2.1/servers/09bf867a-5ad2-42cd-bbd5-66e92dc8fff0 => generated 1265 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:05:41.556437 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-1c7ccd67-2907-4c11-8721-db449f7c24f1 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:05:41.557761 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-1c7ccd67-2907-4c11-8721-db449f7c24f1 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: f45bd103-0f2f-4eb0-83f9-a084adb03d18] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:05:41.568908 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1c7ccd67-2907-4c11-8721-db449f7c24f1 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:41.569917 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1c7ccd67-2907-4c11-8721-db449f7c24f1 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:41.570620 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1c7ccd67-2907-4c11-8721-db449f7c24f1 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:41.571541 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1c7ccd67-2907-4c11-8721-db449f7c24f1 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:41.572167 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1c7ccd67-2907-4c11-8721-db449f7c24f1 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:41.573519 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1c7ccd67-2907-4c11-8721-db449f7c24f1 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:41.965522 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-1c7ccd67-2907-4c11-8721-db449f7c24f1 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a1c8d841104bc9b6910bcc2c0e2bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe9283584fc4d90b0715216d867ea2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:05:41.976780 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-1c7ccd67-2907-4c11-8721-db449f7c24f1 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "GET /compute/v2.1/servers/f45bd103-0f2f-4eb0-83f9-a084adb03d18" status: 200 len: 1495 microversion: 2.1 time: 0.426935 Oct 04 22:05:41.987132 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2299/4525] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:05:41 2022] GET /compute/v2.1/servers/f45bd103-0f2f-4eb0-83f9-a084adb03d18 => generated 1495 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:05:42.550978 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-62b03c06-dd56-4fb2-baff-f14c78b76677 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:05:42.553774 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-62b03c06-dd56-4fb2-baff-f14c78b76677 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] [instance: 09bf867a-5ad2-42cd-bbd5-66e92dc8fff0] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:05:42.577964 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-62b03c06-dd56-4fb2-baff-f14c78b76677 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:42.581390 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-62b03c06-dd56-4fb2-baff-f14c78b76677 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:42.582109 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-62b03c06-dd56-4fb2-baff-f14c78b76677 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:42.584475 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-62b03c06-dd56-4fb2-baff-f14c78b76677 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:42.589611 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-62b03c06-dd56-4fb2-baff-f14c78b76677 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:42.590766 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-62b03c06-dd56-4fb2-baff-f14c78b76677 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:42.851700 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-7b8527e1-4ab8-4c99-ac14-eea8e12aeac9 req-14418cd3-41af-466d-851e-b067e955202c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f45bd103-0f2f-4eb0-83f9-a084adb03d18", "name": "network-vif-deleted", "tag": "fca2bbb6-1283-4e6c-852d-1e4abc9390f9"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:05:42.857223 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-62b03c06-dd56-4fb2-baff-f14c78b76677 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cd0931292c245578bea8861f9ba7607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a555982bb6f841d7a72b6eca84a6150f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:05:42.876969 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-7b8527e1-4ab8-4c99-ac14-eea8e12aeac9 req-14418cd3-41af-466d-851e-b067e955202c service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:42.877740 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-7b8527e1-4ab8-4c99-ac14-eea8e12aeac9 req-14418cd3-41af-466d-851e-b067e955202c service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:42.877915 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-62b03c06-dd56-4fb2-baff-f14c78b76677 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] 10.222.0.43 "GET /compute/v2.1/servers/09bf867a-5ad2-42cd-bbd5-66e92dc8fff0" status: 200 len: 1271 microversion: 2.1 time: 0.323688 Oct 04 22:05:42.878552 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-7b8527e1-4ab8-4c99-ac14-eea8e12aeac9 req-14418cd3-41af-466d-851e-b067e955202c service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:42.880990 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2227/4526] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:05:42 2022] GET /compute/v2.1/servers/09bf867a-5ad2-42cd-bbd5-66e92dc8fff0 => generated 1271 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:05:42.901455 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-7b8527e1-4ab8-4c99-ac14-eea8e12aeac9 req-14418cd3-41af-466d-851e-b067e955202c service nova] Creating event network-vif-deleted:fca2bbb6-1283-4e6c-852d-1e4abc9390f9 for instance f45bd103-0f2f-4eb0-83f9-a084adb03d18 on n-h2-860284-1 Oct 04 22:05:42.931922 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-7b8527e1-4ab8-4c99-ac14-eea8e12aeac9 req-14418cd3-41af-466d-851e-b067e955202c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085682 Oct 04 22:05:42.937596 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2300/4527] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:05:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:05:43.012921 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-dbebe16d-6a10-45a6-8b1f-292591935d39 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:05:43.014146 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-dbebe16d-6a10-45a6-8b1f-292591935d39 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: f45bd103-0f2f-4eb0-83f9-a084adb03d18] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:05:43.027276 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dbebe16d-6a10-45a6-8b1f-292591935d39 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:43.028182 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dbebe16d-6a10-45a6-8b1f-292591935d39 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:43.031344 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dbebe16d-6a10-45a6-8b1f-292591935d39 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:43.032420 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dbebe16d-6a10-45a6-8b1f-292591935d39 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:43.035244 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dbebe16d-6a10-45a6-8b1f-292591935d39 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:43.036979 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dbebe16d-6a10-45a6-8b1f-292591935d39 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:43.160198 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dbebe16d-6a10-45a6-8b1f-292591935d39 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:43.160536 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dbebe16d-6a10-45a6-8b1f-292591935d39 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:43.161690 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dbebe16d-6a10-45a6-8b1f-292591935d39 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:43.162384 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.objects.instance [None req-dbebe16d-6a10-45a6-8b1f-292591935d39 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lazy-loading 'fault' on Instance uuid f45bd103-0f2f-4eb0-83f9-a084adb03d18 {{(pid=134101) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 22:05:43.318476 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-dbebe16d-6a10-45a6-8b1f-292591935d39 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a1c8d841104bc9b6910bcc2c0e2bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe9283584fc4d90b0715216d867ea2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:05:43.331391 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-dbebe16d-6a10-45a6-8b1f-292591935d39 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "GET /compute/v2.1/servers/f45bd103-0f2f-4eb0-83f9-a084adb03d18" status: 200 len: 1305 microversion: 2.1 time: 0.323380 Oct 04 22:05:43.338822 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2228/4528] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:05:43 2022] GET /compute/v2.1/servers/f45bd103-0f2f-4eb0-83f9-a084adb03d18 => generated 1305 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:05:43.908382 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-8667dcb0-c497-44a2-8777-2dde5038c890 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:05:43.910156 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-8667dcb0-c497-44a2-8777-2dde5038c890 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] [instance: 09bf867a-5ad2-42cd-bbd5-66e92dc8fff0] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:05:43.931678 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8667dcb0-c497-44a2-8777-2dde5038c890 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:43.931678 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8667dcb0-c497-44a2-8777-2dde5038c890 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:43.931925 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8667dcb0-c497-44a2-8777-2dde5038c890 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:43.933772 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8667dcb0-c497-44a2-8777-2dde5038c890 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:43.934683 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8667dcb0-c497-44a2-8777-2dde5038c890 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:43.935497 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8667dcb0-c497-44a2-8777-2dde5038c890 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:44.306428 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-8667dcb0-c497-44a2-8777-2dde5038c890 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cd0931292c245578bea8861f9ba7607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a555982bb6f841d7a72b6eca84a6150f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:05:44.355216 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-8667dcb0-c497-44a2-8777-2dde5038c890 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] 10.222.0.43 "GET /compute/v2.1/servers/09bf867a-5ad2-42cd-bbd5-66e92dc8fff0" status: 200 len: 1313 microversion: 2.1 time: 0.455343 Oct 04 22:05:44.356620 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2301/4529] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:05:43 2022] GET /compute/v2.1/servers/09bf867a-5ad2-42cd-bbd5-66e92dc8fff0 => generated 1313 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:05:44.365269 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-f656bc77-60d3-4fb4-8a5a-ac638fad5955 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:05:44.366069 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-f656bc77-60d3-4fb4-8a5a-ac638fad5955 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: f45bd103-0f2f-4eb0-83f9-a084adb03d18] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:05:44.381282 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f656bc77-60d3-4fb4-8a5a-ac638fad5955 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:44.381908 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f656bc77-60d3-4fb4-8a5a-ac638fad5955 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:44.383133 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f656bc77-60d3-4fb4-8a5a-ac638fad5955 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:44.386109 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f656bc77-60d3-4fb4-8a5a-ac638fad5955 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:44.387859 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f656bc77-60d3-4fb4-8a5a-ac638fad5955 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:44.390682 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f656bc77-60d3-4fb4-8a5a-ac638fad5955 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:44.436190 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-f656bc77-60d3-4fb4-8a5a-ac638fad5955 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] HTTP exception thrown: Instance f45bd103-0f2f-4eb0-83f9-a084adb03d18 could not be found. Oct 04 22:05:44.463725 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-f656bc77-60d3-4fb4-8a5a-ac638fad5955 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Request method failure captured: Oct 04 22:05:44.463725 n-d-860284-1 devstack@n-api.service[134101]: request: GET /compute/v2.1/servers/f45bd103-0f2f-4eb0-83f9-a084adb03d18 HTTP/1.1 Oct 04 22:05:44.463725 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 22:05:44.463725 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 22:05:44.463725 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 22:05:44.463725 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 22:05:44.463725 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 22:05:44.463725 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 22:05:44.463725 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 22:05:44.463725 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 22:05:44.463725 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPK0nBLOASIAc_jQKg5RCRqB87oRsJiRc3l4etfmNkfSSv1yHGR8RjgOAS-Q4KEeiZVVxJRa8Focu7VoHdbhzgEqV5pocnY2xPPRPWacaT4koizORav87v6vdxgR4HH-PmsbraTS232Q30lW73kM7RH3tINWZChDkcbwtTWeQlIO6TSk Oct 04 22:05:44.463725 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 22:05:44.463725 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 22:05:44.463725 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 22:05:44.463725 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 22:05:44.463725 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 22:05:44.463725 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 22:05:44.463725 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: dfe9283584fc4d90b0715216d867ea2f Oct 04 22:05:44.463725 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-DeleteServersTestJSON-2136146778 Oct 04 22:05:44.463725 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 22:05:44.463725 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 22:05:44.463725 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/dfe9283584fc4d90b0715216d867ea2f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_dfe9283584fc4d90b0715216d867ea2f", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/dfe9283584fc4d90b0715216d867ea2f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/dfe9283584fc4d90b0715216d867ea2f"}]}] Oct 04 22:05:44.463725 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-DeleteServersTestJSON-2136146778 Oct 04 22:05:44.463725 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: dfe9283584fc4d90b0715216d867ea2f Oct 04 22:05:44.463725 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-DeleteServersTestJSON-2136146778 Oct 04 22:05:44.463725 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-DeleteServersTestJSON-2136146778-project Oct 04 22:05:44.463725 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 22:05:44.463725 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 22:05:44.463725 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 41a1c8d841104bc9b6910bcc2c0e2bb1 Oct 04 22:05:44.463725 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-DeleteServersTestJSON-2136146778-project Oct 04 22:05:44.463725 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 22:05:44.463725 n-d-860284-1 devstack@n-api.service[134101]: exception: Instance f45bd103-0f2f-4eb0-83f9-a084adb03d18 could not be found. Oct 04 22:05:44.463725 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': 'f45bd103-0f2f-4eb0-83f9-a084adb03d18'} Oct 04 22:05:44.463725 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:05:44.463725 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:05:44.463725 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:05:44.463725 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:05:44.463725 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:05:44.463725 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:05:44.463725 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:05:44.463725 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:05:44.463725 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:05:44.463725 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:05:44.463725 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f45bd103-0f2f-4eb0-83f9-a084adb03d18 could not be found. Oct 04 22:05:44.463725 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:05:44.463725 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:05:44.463725 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:05:44.463725 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:05:44.463725 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:05:44.463725 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:05:44.463725 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:05:44.463725 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:05:44.463725 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:05:44.463725 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:05:44.463725 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:05:44.463725 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:05:44.463725 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:05:44.463725 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:05:44.463725 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:05:44.463725 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:05:44.463725 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f45bd103-0f2f-4eb0-83f9-a084adb03d18 could not be found. Oct 04 22:05:44.463725 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:05:44.463725 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:05:44.463725 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:05:44.467779 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:05:44.467779 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:05:44.467779 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:05:44.467779 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:05:44.467779 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:05:44.467779 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f45bd103-0f2f-4eb0-83f9-a084adb03d18 could not be found. Oct 04 22:05:44.467779 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:05:44.467779 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-f656bc77-60d3-4fb4-8a5a-ac638fad5955 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Returning 404 to user: Instance f45bd103-0f2f-4eb0-83f9-a084adb03d18 could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:05:44.467779 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-f656bc77-60d3-4fb4-8a5a-ac638fad5955 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "GET /compute/v2.1/servers/f45bd103-0f2f-4eb0-83f9-a084adb03d18" status: 404 len: 111 microversion: 2.1 time: 0.105950 Oct 04 22:05:44.468357 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2229/4530] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:05:44 2022] GET /compute/v2.1/servers/f45bd103-0f2f-4eb0-83f9-a084adb03d18 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:05:44.652769 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-935b0217-cbd7-4428-a24e-40ab345b5a9e tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1796841543", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452", "networks": [{"uuid": "948c65db-57fc-480e-9ddd-f1d8426ccd4e"}]}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:05:44.856756 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.network.neutron [None req-935b0217-cbd7-4428-a24e-40ab345b5a9e tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] validate_networks() for [('948c65db-57fc-480e-9ddd-f1d8426ccd4e', None, None, None, None, None)] {{(pid=134102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 22:05:45.405466 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-739f68d4-4f42-4b13-9053-5cb2619e8a15 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:05:45.406101 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-739f68d4-4f42-4b13-9053-5cb2619e8a15 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] [instance: 09bf867a-5ad2-42cd-bbd5-66e92dc8fff0] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:05:45.426067 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-739f68d4-4f42-4b13-9053-5cb2619e8a15 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:45.427240 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-739f68d4-4f42-4b13-9053-5cb2619e8a15 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:45.427897 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-739f68d4-4f42-4b13-9053-5cb2619e8a15 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:45.431066 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-739f68d4-4f42-4b13-9053-5cb2619e8a15 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:45.432788 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-739f68d4-4f42-4b13-9053-5cb2619e8a15 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:45.434506 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-739f68d4-4f42-4b13-9053-5cb2619e8a15 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:45.667442 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-739f68d4-4f42-4b13-9053-5cb2619e8a15 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cd0931292c245578bea8861f9ba7607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a555982bb6f841d7a72b6eca84a6150f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:05:45.684531 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-739f68d4-4f42-4b13-9053-5cb2619e8a15 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] 10.222.0.43 "GET /compute/v2.1/servers/09bf867a-5ad2-42cd-bbd5-66e92dc8fff0" status: 200 len: 1334 microversion: 2.1 time: 0.282840 Oct 04 22:05:45.686423 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2230/4531] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:05:45 2022] GET /compute/v2.1/servers/09bf867a-5ad2-42cd-bbd5-66e92dc8fff0 => generated 1334 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:05:46.339537 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-935b0217-cbd7-4428-a24e-40ab345b5a9e tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Flavor limits 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 22:05:46.340032 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-935b0217-cbd7-4428-a24e-40ab345b5a9e tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Image limits 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 22:05:46.340793 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-935b0217-cbd7-4428-a24e-40ab345b5a9e tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Flavor pref 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 22:05:46.341307 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-935b0217-cbd7-4428-a24e-40ab345b5a9e tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Image pref 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 22:05:46.342041 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-935b0217-cbd7-4428-a24e-40ab345b5a9e tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 22:05:46.363325 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-935b0217-cbd7-4428-a24e-40ab345b5a9e tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:46.364330 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-935b0217-cbd7-4428-a24e-40ab345b5a9e tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:46.365287 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-935b0217-cbd7-4428-a24e-40ab345b5a9e tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:46.366449 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-935b0217-cbd7-4428-a24e-40ab345b5a9e tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:46.367170 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-935b0217-cbd7-4428-a24e-40ab345b5a9e tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:46.367747 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-935b0217-cbd7-4428-a24e-40ab345b5a9e tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:46.397496 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-935b0217-cbd7-4428-a24e-40ab345b5a9e tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Getting quotas for project dfe9283584fc4d90b0715216d867ea2f. Resources: {'instances', 'ram', 'cores'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:05:46.407594 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-935b0217-cbd7-4428-a24e-40ab345b5a9e tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Getting quotas for user 41a1c8d841104bc9b6910bcc2c0e2bb1 and project dfe9283584fc4d90b0715216d867ea2f. Resources: {'instances', 'ram', 'cores'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:05:46.437684 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-935b0217-cbd7-4428-a24e-40ab345b5a9e tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Going to run 1 instances... {{(pid=134102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 22:05:46.440917 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-935b0217-cbd7-4428-a24e-40ab345b5a9e tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: 07967adf-40e2-41e8-97d0-bc9ccf38fb53] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='58548514-5dac-426c-81f5-19e3fba33e23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 22:05:46.514797 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-935b0217-cbd7-4428-a24e-40ab345b5a9e tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.866902 Oct 04 22:05:46.516017 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2302/4532] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 22:05:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 1870 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 22:05:46.541524 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-458ed7bc-2043-47a1-89a8-e2651ae1bd24 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:05:46.547349 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-458ed7bc-2043-47a1-89a8-e2651ae1bd24 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: 07967adf-40e2-41e8-97d0-bc9ccf38fb53] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:05:46.710941 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-1f6c523b-6509-4034-b909-523b0df5ed6e tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:05:46.711794 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-1f6c523b-6509-4034-b909-523b0df5ed6e tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] [instance: 09bf867a-5ad2-42cd-bbd5-66e92dc8fff0] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:05:46.748263 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1f6c523b-6509-4034-b909-523b0df5ed6e tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:46.749972 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1f6c523b-6509-4034-b909-523b0df5ed6e tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:46.750464 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1f6c523b-6509-4034-b909-523b0df5ed6e tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:46.752410 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1f6c523b-6509-4034-b909-523b0df5ed6e tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:46.765933 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1f6c523b-6509-4034-b909-523b0df5ed6e tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:46.766446 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1f6c523b-6509-4034-b909-523b0df5ed6e tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:46.782883 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-458ed7bc-2043-47a1-89a8-e2651ae1bd24 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a1c8d841104bc9b6910bcc2c0e2bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe9283584fc4d90b0715216d867ea2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:05:46.794298 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-458ed7bc-2043-47a1-89a8-e2651ae1bd24 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "GET /compute/v2.1/servers/07967adf-40e2-41e8-97d0-bc9ccf38fb53" status: 200 len: 1215 microversion: 2.1 time: 0.270215 Oct 04 22:05:46.843123 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2231/4533] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:05:46 2022] GET /compute/v2.1/servers/07967adf-40e2-41e8-97d0-bc9ccf38fb53 => generated 1215 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:05:47.153428 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-1f6c523b-6509-4034-b909-523b0df5ed6e tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cd0931292c245578bea8861f9ba7607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a555982bb6f841d7a72b6eca84a6150f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:05:47.163681 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-1f6c523b-6509-4034-b909-523b0df5ed6e tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] 10.222.0.43 "GET /compute/v2.1/servers/09bf867a-5ad2-42cd-bbd5-66e92dc8fff0" status: 200 len: 1355 microversion: 2.1 time: 0.458314 Oct 04 22:05:47.164288 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2303/4534] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:05:46 2022] GET /compute/v2.1/servers/09bf867a-5ad2-42cd-bbd5-66e92dc8fff0 => generated 1355 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:05:47.839079 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-84287d63-a594-4af9-b493-29970481ffd9 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:05:47.839714 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-84287d63-a594-4af9-b493-29970481ffd9 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: 07967adf-40e2-41e8-97d0-bc9ccf38fb53] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:05:47.853325 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-84287d63-a594-4af9-b493-29970481ffd9 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:47.853930 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-84287d63-a594-4af9-b493-29970481ffd9 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:47.854939 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-84287d63-a594-4af9-b493-29970481ffd9 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:47.856014 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-84287d63-a594-4af9-b493-29970481ffd9 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:47.856724 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-84287d63-a594-4af9-b493-29970481ffd9 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:47.858239 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-84287d63-a594-4af9-b493-29970481ffd9 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:48.002015 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-84287d63-a594-4af9-b493-29970481ffd9 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a1c8d841104bc9b6910bcc2c0e2bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe9283584fc4d90b0715216d867ea2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:05:48.012563 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-84287d63-a594-4af9-b493-29970481ffd9 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "GET /compute/v2.1/servers/07967adf-40e2-41e8-97d0-bc9ccf38fb53" status: 200 len: 1267 microversion: 2.1 time: 0.182393 Oct 04 22:05:48.013646 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2232/4535] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:05:47 2022] GET /compute/v2.1/servers/07967adf-40e2-41e8-97d0-bc9ccf38fb53 => generated 1267 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:05:48.189279 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-2b154a58-351c-4652-a90a-ef368245ea40 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:05:48.190190 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-2b154a58-351c-4652-a90a-ef368245ea40 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] [instance: 09bf867a-5ad2-42cd-bbd5-66e92dc8fff0] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:05:48.215956 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2b154a58-351c-4652-a90a-ef368245ea40 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:48.216758 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2b154a58-351c-4652-a90a-ef368245ea40 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:48.217711 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2b154a58-351c-4652-a90a-ef368245ea40 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:48.219579 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2b154a58-351c-4652-a90a-ef368245ea40 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:48.220962 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2b154a58-351c-4652-a90a-ef368245ea40 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:48.221852 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2b154a58-351c-4652-a90a-ef368245ea40 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:48.460668 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-2b154a58-351c-4652-a90a-ef368245ea40 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cd0931292c245578bea8861f9ba7607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a555982bb6f841d7a72b6eca84a6150f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:05:48.472228 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-2b154a58-351c-4652-a90a-ef368245ea40 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] 10.222.0.43 "GET /compute/v2.1/servers/09bf867a-5ad2-42cd-bbd5-66e92dc8fff0" status: 200 len: 1355 microversion: 2.1 time: 0.288233 Oct 04 22:05:48.473229 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2304/4536] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:05:48 2022] GET /compute/v2.1/servers/09bf867a-5ad2-42cd-bbd5-66e92dc8fff0 => generated 1355 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:05:49.025017 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-119ca15b-6d35-4ff5-a91f-43f63525ab23 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-2088974276", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452", "networks": [{"uuid": "8d03ebd6-c397-421b-b2b9-c0caf6788498"}]}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:05:49.045624 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-9d73c4ac-ee6e-4bb3-a41a-60c4aaa08cb6 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:05:49.047811 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-9d73c4ac-ee6e-4bb3-a41a-60c4aaa08cb6 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: 07967adf-40e2-41e8-97d0-bc9ccf38fb53] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:05:49.048125 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=2 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:05:49.060875 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9d73c4ac-ee6e-4bb3-a41a-60c4aaa08cb6 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:49.065054 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9d73c4ac-ee6e-4bb3-a41a-60c4aaa08cb6 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:49.066123 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9d73c4ac-ee6e-4bb3-a41a-60c4aaa08cb6 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:49.068633 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9d73c4ac-ee6e-4bb3-a41a-60c4aaa08cb6 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:49.069779 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9d73c4ac-ee6e-4bb3-a41a-60c4aaa08cb6 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:49.071623 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9d73c4ac-ee6e-4bb3-a41a-60c4aaa08cb6 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:49.100138 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.network.neutron [None req-119ca15b-6d35-4ff5-a91f-43f63525ab23 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] validate_networks() for [('8d03ebd6-c397-421b-b2b9-c0caf6788498', None, None, None, None, None)] {{(pid=134101) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 22:05:49.273521 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-9d73c4ac-ee6e-4bb3-a41a-60c4aaa08cb6 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a1c8d841104bc9b6910bcc2c0e2bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe9283584fc4d90b0715216d867ea2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:05:49.283549 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-9d73c4ac-ee6e-4bb3-a41a-60c4aaa08cb6 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "GET /compute/v2.1/servers/07967adf-40e2-41e8-97d0-bc9ccf38fb53" status: 200 len: 1273 microversion: 2.1 time: 0.247165 Oct 04 22:05:49.285011 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2305/4537] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:05:49 2022] GET /compute/v2.1/servers/07967adf-40e2-41e8-97d0-bc9ccf38fb53 => generated 1273 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:05:49.296208 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-8564b593-c8ad-4856-8feb-27351f4b8203 req-62fd784b-b043-431c-beb9-7160834c5930 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09bf867a-5ad2-42cd-bbd5-66e92dc8fff0", "tag": "ed0ed48f-26ae-443e-9902-e3c7343a3449"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:05:49.309145 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-8564b593-c8ad-4856-8feb-27351f4b8203 req-62fd784b-b043-431c-beb9-7160834c5930 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:49.309828 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-8564b593-c8ad-4856-8feb-27351f4b8203 req-62fd784b-b043-431c-beb9-7160834c5930 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:49.310511 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-8564b593-c8ad-4856-8feb-27351f4b8203 req-62fd784b-b043-431c-beb9-7160834c5930 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:49.326881 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-8564b593-c8ad-4856-8feb-27351f4b8203 req-62fd784b-b043-431c-beb9-7160834c5930 service nova] Creating event network-changed:ed0ed48f-26ae-443e-9902-e3c7343a3449 for instance 09bf867a-5ad2-42cd-bbd5-66e92dc8fff0 on n-h2-860284-1 Oct 04 22:05:49.333965 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-8564b593-c8ad-4856-8feb-27351f4b8203 req-62fd784b-b043-431c-beb9-7160834c5930 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046765 Oct 04 22:05:49.334898 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2306/4538] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:05:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:05:49.500816 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-756a921e-599b-4709-8e8a-34caffd6a000 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:05:49.502351 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-756a921e-599b-4709-8e8a-34caffd6a000 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] [instance: 09bf867a-5ad2-42cd-bbd5-66e92dc8fff0] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:05:49.512161 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-756a921e-599b-4709-8e8a-34caffd6a000 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:49.512663 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-756a921e-599b-4709-8e8a-34caffd6a000 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:49.513108 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-756a921e-599b-4709-8e8a-34caffd6a000 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:49.513820 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-756a921e-599b-4709-8e8a-34caffd6a000 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:49.514559 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-756a921e-599b-4709-8e8a-34caffd6a000 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:49.515604 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-756a921e-599b-4709-8e8a-34caffd6a000 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:49.963812 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-756a921e-599b-4709-8e8a-34caffd6a000 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cd0931292c245578bea8861f9ba7607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a555982bb6f841d7a72b6eca84a6150f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:05:49.979245 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-756a921e-599b-4709-8e8a-34caffd6a000 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] 10.222.0.43 "GET /compute/v2.1/servers/09bf867a-5ad2-42cd-bbd5-66e92dc8fff0" status: 200 len: 1355 microversion: 2.1 time: 0.483519 Oct 04 22:05:49.981089 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2307/4539] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:05:49 2022] GET /compute/v2.1/servers/09bf867a-5ad2-42cd-bbd5-66e92dc8fff0 => generated 1355 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:05:50.072707 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-119ca15b-6d35-4ff5-a91f-43f63525ab23 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Flavor limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 22:05:50.073974 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-119ca15b-6d35-4ff5-a91f-43f63525ab23 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Image limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 22:05:50.075201 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-119ca15b-6d35-4ff5-a91f-43f63525ab23 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Flavor pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 22:05:50.076225 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-119ca15b-6d35-4ff5-a91f-43f63525ab23 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Image pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 22:05:50.077250 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-119ca15b-6d35-4ff5-a91f-43f63525ab23 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 22:05:50.090041 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-119ca15b-6d35-4ff5-a91f-43f63525ab23 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:50.092012 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-119ca15b-6d35-4ff5-a91f-43f63525ab23 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:50.092776 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-119ca15b-6d35-4ff5-a91f-43f63525ab23 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:50.093834 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-119ca15b-6d35-4ff5-a91f-43f63525ab23 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:50.094619 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-119ca15b-6d35-4ff5-a91f-43f63525ab23 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:50.095223 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-119ca15b-6d35-4ff5-a91f-43f63525ab23 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:50.120084 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=90 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:05:50.143651 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-119ca15b-6d35-4ff5-a91f-43f63525ab23 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Getting quotas for project b556e1ace286450f8493715e8317a107. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:05:50.150529 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-119ca15b-6d35-4ff5-a91f-43f63525ab23 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Getting quotas for user 09e72a1a5d1a4c4b838acb169ab11eb0 and project b556e1ace286450f8493715e8317a107. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:05:50.177454 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-119ca15b-6d35-4ff5-a91f-43f63525ab23 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Going to run 1 instances... {{(pid=134101) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 22:05:50.180275 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-119ca15b-6d35-4ff5-a91f-43f63525ab23 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] [instance: 92d3d7e9-8a75-4e07-812c-8b9f441e0376] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='58548514-5dac-426c-81f5-19e3fba33e23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134101) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 22:05:50.310107 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-119ca15b-6d35-4ff5-a91f-43f63525ab23 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.289694 Oct 04 22:05:50.312950 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2233/4540] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 22:05:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 1294 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 22:05:50.328587 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-641b9b6f-ab35-45a7-9293-f225b0c6bf28 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:05:50.330031 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-641b9b6f-ab35-45a7-9293-f225b0c6bf28 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: 07967adf-40e2-41e8-97d0-bc9ccf38fb53] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:05:50.342643 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-978da637-472e-44c1-b102-2bce35c26f5a tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:05:50.344391 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-978da637-472e-44c1-b102-2bce35c26f5a tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] [instance: 92d3d7e9-8a75-4e07-812c-8b9f441e0376] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:05:50.354378 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-641b9b6f-ab35-45a7-9293-f225b0c6bf28 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:50.355712 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-641b9b6f-ab35-45a7-9293-f225b0c6bf28 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:50.356274 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-641b9b6f-ab35-45a7-9293-f225b0c6bf28 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:50.358856 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-641b9b6f-ab35-45a7-9293-f225b0c6bf28 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:50.360623 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-641b9b6f-ab35-45a7-9293-f225b0c6bf28 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:50.361085 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-641b9b6f-ab35-45a7-9293-f225b0c6bf28 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:50.519832 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-978da637-472e-44c1-b102-2bce35c26f5a tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e72a1a5d1a4c4b838acb169ab11eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b556e1ace286450f8493715e8317a107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:05:50.531682 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-978da637-472e-44c1-b102-2bce35c26f5a tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] 10.222.0.43 "GET /compute/v2.1/servers/92d3d7e9-8a75-4e07-812c-8b9f441e0376" status: 200 len: 1219 microversion: 2.1 time: 0.210167 Oct 04 22:05:50.532926 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2234/4541] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:05:50 2022] GET /compute/v2.1/servers/92d3d7e9-8a75-4e07-812c-8b9f441e0376 => generated 1219 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:05:50.741379 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-641b9b6f-ab35-45a7-9293-f225b0c6bf28 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a1c8d841104bc9b6910bcc2c0e2bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe9283584fc4d90b0715216d867ea2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:05:50.749948 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-641b9b6f-ab35-45a7-9293-f225b0c6bf28 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "GET /compute/v2.1/servers/07967adf-40e2-41e8-97d0-bc9ccf38fb53" status: 200 len: 1315 microversion: 2.1 time: 0.444620 Oct 04 22:05:50.751441 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2308/4542] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:05:50 2022] GET /compute/v2.1/servers/07967adf-40e2-41e8-97d0-bc9ccf38fb53 => generated 1315 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:05:51.009524 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-3d0cd1db-9ee7-4b60-b915-a15df3e5e95d tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:05:51.010193 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-3d0cd1db-9ee7-4b60-b915-a15df3e5e95d tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] [instance: 09bf867a-5ad2-42cd-bbd5-66e92dc8fff0] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:05:51.026795 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3d0cd1db-9ee7-4b60-b915-a15df3e5e95d tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:51.027647 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3d0cd1db-9ee7-4b60-b915-a15df3e5e95d tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:51.028573 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3d0cd1db-9ee7-4b60-b915-a15df3e5e95d tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:51.029371 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3d0cd1db-9ee7-4b60-b915-a15df3e5e95d tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:51.029840 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3d0cd1db-9ee7-4b60-b915-a15df3e5e95d tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:51.031505 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3d0cd1db-9ee7-4b60-b915-a15df3e5e95d tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:51.344955 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-3d0cd1db-9ee7-4b60-b915-a15df3e5e95d tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cd0931292c245578bea8861f9ba7607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a555982bb6f841d7a72b6eca84a6150f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:05:51.359295 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-3d0cd1db-9ee7-4b60-b915-a15df3e5e95d tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] 10.222.0.43 "GET /compute/v2.1/servers/09bf867a-5ad2-42cd-bbd5-66e92dc8fff0" status: 200 len: 1355 microversion: 2.1 time: 0.357482 Oct 04 22:05:51.359944 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2235/4543] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:05:50 2022] GET /compute/v2.1/servers/09bf867a-5ad2-42cd-bbd5-66e92dc8fff0 => generated 1355 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:05:51.399055 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-90fc7130-471f-4395-9b2d-8608937fa33e req-59f8de1e-c993-41b0-8691-139330a3414f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09bf867a-5ad2-42cd-bbd5-66e92dc8fff0", "tag": "d811dbc1-e714-411f-880d-f883a5ee6676"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:05:51.414027 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-90fc7130-471f-4395-9b2d-8608937fa33e req-59f8de1e-c993-41b0-8691-139330a3414f service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:51.414978 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-90fc7130-471f-4395-9b2d-8608937fa33e req-59f8de1e-c993-41b0-8691-139330a3414f service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:51.415637 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-90fc7130-471f-4395-9b2d-8608937fa33e req-59f8de1e-c993-41b0-8691-139330a3414f service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:51.429600 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-90fc7130-471f-4395-9b2d-8608937fa33e req-59f8de1e-c993-41b0-8691-139330a3414f service nova] Creating event network-changed:d811dbc1-e714-411f-880d-f883a5ee6676 for instance 09bf867a-5ad2-42cd-bbd5-66e92dc8fff0 on n-h2-860284-1 Oct 04 22:05:51.435275 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-90fc7130-471f-4395-9b2d-8608937fa33e req-59f8de1e-c993-41b0-8691-139330a3414f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050719 Oct 04 22:05:51.436515 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2309/4544] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:05:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:05:51.557785 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-fbfb8bf1-84a2-47cc-bf4c-0b7b34487e4e tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:05:51.558431 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-fbfb8bf1-84a2-47cc-bf4c-0b7b34487e4e tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] [instance: 92d3d7e9-8a75-4e07-812c-8b9f441e0376] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:05:51.578694 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fbfb8bf1-84a2-47cc-bf4c-0b7b34487e4e tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:51.579469 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fbfb8bf1-84a2-47cc-bf4c-0b7b34487e4e tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:51.581410 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fbfb8bf1-84a2-47cc-bf4c-0b7b34487e4e tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:51.583359 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fbfb8bf1-84a2-47cc-bf4c-0b7b34487e4e tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:51.585693 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fbfb8bf1-84a2-47cc-bf4c-0b7b34487e4e tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:51.586636 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fbfb8bf1-84a2-47cc-bf4c-0b7b34487e4e tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:51.738656 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-fbfb8bf1-84a2-47cc-bf4c-0b7b34487e4e tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e72a1a5d1a4c4b838acb169ab11eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b556e1ace286450f8493715e8317a107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:05:51.752117 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-fbfb8bf1-84a2-47cc-bf4c-0b7b34487e4e tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] 10.222.0.43 "GET /compute/v2.1/servers/92d3d7e9-8a75-4e07-812c-8b9f441e0376" status: 200 len: 1271 microversion: 2.1 time: 0.198088 Oct 04 22:05:51.752744 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2236/4545] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:05:51 2022] GET /compute/v2.1/servers/92d3d7e9-8a75-4e07-812c-8b9f441e0376 => generated 1271 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:05:51.776246 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-1a796fa2-9429-44ca-8526-2f6c5947d36e tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:05:51.777081 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-1a796fa2-9429-44ca-8526-2f6c5947d36e tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: 07967adf-40e2-41e8-97d0-bc9ccf38fb53] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:05:51.798041 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1a796fa2-9429-44ca-8526-2f6c5947d36e tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:51.798599 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1a796fa2-9429-44ca-8526-2f6c5947d36e tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:51.799050 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1a796fa2-9429-44ca-8526-2f6c5947d36e tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:51.799776 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1a796fa2-9429-44ca-8526-2f6c5947d36e tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:51.800430 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1a796fa2-9429-44ca-8526-2f6c5947d36e tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:51.801011 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1a796fa2-9429-44ca-8526-2f6c5947d36e tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:51.806688 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:05:52.068880 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-1a796fa2-9429-44ca-8526-2f6c5947d36e tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a1c8d841104bc9b6910bcc2c0e2bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe9283584fc4d90b0715216d867ea2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:05:52.095027 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-1a796fa2-9429-44ca-8526-2f6c5947d36e tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "GET /compute/v2.1/servers/07967adf-40e2-41e8-97d0-bc9ccf38fb53" status: 200 len: 1315 microversion: 2.1 time: 0.323812 Oct 04 22:05:52.095645 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2310/4546] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:05:51 2022] GET /compute/v2.1/servers/07967adf-40e2-41e8-97d0-bc9ccf38fb53 => generated 1315 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:05:52.389599 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-ee4331e8-fe66-4695-8b21-fef666423b6e tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:05:52.389599 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-ee4331e8-fe66-4695-8b21-fef666423b6e tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] [instance: 09bf867a-5ad2-42cd-bbd5-66e92dc8fff0] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:05:52.397934 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ee4331e8-fe66-4695-8b21-fef666423b6e tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:52.398717 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ee4331e8-fe66-4695-8b21-fef666423b6e tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:52.399252 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ee4331e8-fe66-4695-8b21-fef666423b6e tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:52.400708 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ee4331e8-fe66-4695-8b21-fef666423b6e tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:52.401265 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ee4331e8-fe66-4695-8b21-fef666423b6e tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:52.401767 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ee4331e8-fe66-4695-8b21-fef666423b6e tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:52.575387 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-ee4331e8-fe66-4695-8b21-fef666423b6e tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cd0931292c245578bea8861f9ba7607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a555982bb6f841d7a72b6eca84a6150f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:05:52.584008 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-ee4331e8-fe66-4695-8b21-fef666423b6e tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] 10.222.0.43 "GET /compute/v2.1/servers/09bf867a-5ad2-42cd-bbd5-66e92dc8fff0" status: 200 len: 1355 microversion: 2.1 time: 0.205042 Oct 04 22:05:52.584920 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2237/4547] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:05:52 2022] GET /compute/v2.1/servers/09bf867a-5ad2-42cd-bbd5-66e92dc8fff0 => generated 1355 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:05:52.777293 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-fa192539-da2e-4f3e-a93a-d5f3d20de46f tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:05:52.778042 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-fa192539-da2e-4f3e-a93a-d5f3d20de46f tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] [instance: 92d3d7e9-8a75-4e07-812c-8b9f441e0376] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:05:52.786876 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fa192539-da2e-4f3e-a93a-d5f3d20de46f tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:52.788278 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fa192539-da2e-4f3e-a93a-d5f3d20de46f tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:52.789159 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fa192539-da2e-4f3e-a93a-d5f3d20de46f tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:52.789980 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fa192539-da2e-4f3e-a93a-d5f3d20de46f tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:52.790577 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fa192539-da2e-4f3e-a93a-d5f3d20de46f tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:52.791266 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fa192539-da2e-4f3e-a93a-d5f3d20de46f tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:52.873989 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-fa192539-da2e-4f3e-a93a-d5f3d20de46f tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e72a1a5d1a4c4b838acb169ab11eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b556e1ace286450f8493715e8317a107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:05:52.883090 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-fa192539-da2e-4f3e-a93a-d5f3d20de46f tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] 10.222.0.43 "GET /compute/v2.1/servers/92d3d7e9-8a75-4e07-812c-8b9f441e0376" status: 200 len: 1277 microversion: 2.1 time: 0.110121 Oct 04 22:05:52.890562 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2311/4548] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:05:52 2022] GET /compute/v2.1/servers/92d3d7e9-8a75-4e07-812c-8b9f441e0376 => generated 1277 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:05:53.121013 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-58cee06e-94c1-49a0-ba2e-f39c917161a0 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:05:53.121880 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-58cee06e-94c1-49a0-ba2e-f39c917161a0 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: 07967adf-40e2-41e8-97d0-bc9ccf38fb53] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:05:53.131377 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-58cee06e-94c1-49a0-ba2e-f39c917161a0 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:53.132140 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-58cee06e-94c1-49a0-ba2e-f39c917161a0 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:53.132848 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-58cee06e-94c1-49a0-ba2e-f39c917161a0 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:53.133768 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-58cee06e-94c1-49a0-ba2e-f39c917161a0 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:53.134409 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-58cee06e-94c1-49a0-ba2e-f39c917161a0 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:53.135059 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-58cee06e-94c1-49a0-ba2e-f39c917161a0 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:53.386295 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-58cee06e-94c1-49a0-ba2e-f39c917161a0 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a1c8d841104bc9b6910bcc2c0e2bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe9283584fc4d90b0715216d867ea2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:05:53.396841 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-58cee06e-94c1-49a0-ba2e-f39c917161a0 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "GET /compute/v2.1/servers/07967adf-40e2-41e8-97d0-bc9ccf38fb53" status: 200 len: 1315 microversion: 2.1 time: 0.280238 Oct 04 22:05:53.398472 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2238/4549] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:05:53 2022] GET /compute/v2.1/servers/07967adf-40e2-41e8-97d0-bc9ccf38fb53 => generated 1315 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:05:53.470194 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-664accbc-e714-4062-950d-3ea94b965bc7 req-9e6658a1-e69e-422e-bc3d-d60625c804ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07967adf-40e2-41e8-97d0-bc9ccf38fb53", "tag": "4dfcf579-7ad9-44da-b7d9-bf8e382a42f8"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:05:53.483320 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-664accbc-e714-4062-950d-3ea94b965bc7 req-9e6658a1-e69e-422e-bc3d-d60625c804ff service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:53.483320 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-664accbc-e714-4062-950d-3ea94b965bc7 req-9e6658a1-e69e-422e-bc3d-d60625c804ff service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:53.484316 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-664accbc-e714-4062-950d-3ea94b965bc7 req-9e6658a1-e69e-422e-bc3d-d60625c804ff service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:53.497227 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-664accbc-e714-4062-950d-3ea94b965bc7 req-9e6658a1-e69e-422e-bc3d-d60625c804ff service nova] Creating event network-changed:4dfcf579-7ad9-44da-b7d9-bf8e382a42f8 for instance 07967adf-40e2-41e8-97d0-bc9ccf38fb53 on n-h2-860284-1 Oct 04 22:05:53.502713 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-664accbc-e714-4062-950d-3ea94b965bc7 req-9e6658a1-e69e-422e-bc3d-d60625c804ff service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037193 Oct 04 22:05:53.503335 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2312/4550] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:05:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:05:53.611505 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-1c3ff21a-9c79-47dc-9885-118c5dd55376 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:05:53.612457 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-1c3ff21a-9c79-47dc-9885-118c5dd55376 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] [instance: 09bf867a-5ad2-42cd-bbd5-66e92dc8fff0] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:05:53.622067 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1c3ff21a-9c79-47dc-9885-118c5dd55376 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:53.622967 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1c3ff21a-9c79-47dc-9885-118c5dd55376 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:53.623764 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1c3ff21a-9c79-47dc-9885-118c5dd55376 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:53.624503 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1c3ff21a-9c79-47dc-9885-118c5dd55376 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:53.624974 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1c3ff21a-9c79-47dc-9885-118c5dd55376 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:53.625408 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1c3ff21a-9c79-47dc-9885-118c5dd55376 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:53.883640 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-1c3ff21a-9c79-47dc-9885-118c5dd55376 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cd0931292c245578bea8861f9ba7607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a555982bb6f841d7a72b6eca84a6150f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:05:53.894712 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-1c3ff21a-9c79-47dc-9885-118c5dd55376 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] 10.222.0.43 "GET /compute/v2.1/servers/09bf867a-5ad2-42cd-bbd5-66e92dc8fff0" status: 200 len: 1355 microversion: 2.1 time: 0.288225 Oct 04 22:05:53.914496 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2239/4551] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:05:53 2022] GET /compute/v2.1/servers/09bf867a-5ad2-42cd-bbd5-66e92dc8fff0 => generated 1355 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:05:53.928655 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-7e6141fa-ed81-460f-8935-a7ef65018487 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:05:53.930556 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-7e6141fa-ed81-460f-8935-a7ef65018487 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] [instance: 92d3d7e9-8a75-4e07-812c-8b9f441e0376] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:05:53.945335 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7e6141fa-ed81-460f-8935-a7ef65018487 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:53.946119 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7e6141fa-ed81-460f-8935-a7ef65018487 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:53.946697 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7e6141fa-ed81-460f-8935-a7ef65018487 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:53.950678 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7e6141fa-ed81-460f-8935-a7ef65018487 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:53.951261 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7e6141fa-ed81-460f-8935-a7ef65018487 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:53.951717 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7e6141fa-ed81-460f-8935-a7ef65018487 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:54.036781 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-7e6141fa-ed81-460f-8935-a7ef65018487 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e72a1a5d1a4c4b838acb169ab11eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b556e1ace286450f8493715e8317a107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:05:54.047085 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-7e6141fa-ed81-460f-8935-a7ef65018487 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] 10.222.0.43 "GET /compute/v2.1/servers/92d3d7e9-8a75-4e07-812c-8b9f441e0376" status: 200 len: 1277 microversion: 2.1 time: 0.143160 Oct 04 22:05:54.048483 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2313/4552] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:05:53 2022] GET /compute/v2.1/servers/92d3d7e9-8a75-4e07-812c-8b9f441e0376 => generated 1277 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:05:54.420359 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e0412d4b-e14f-40e7-adae-b6622f636bd5 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:05:54.420977 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-e0412d4b-e14f-40e7-adae-b6622f636bd5 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: 07967adf-40e2-41e8-97d0-bc9ccf38fb53] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:05:54.427731 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e0412d4b-e14f-40e7-adae-b6622f636bd5 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:54.428220 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e0412d4b-e14f-40e7-adae-b6622f636bd5 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:54.428655 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e0412d4b-e14f-40e7-adae-b6622f636bd5 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:54.429351 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e0412d4b-e14f-40e7-adae-b6622f636bd5 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:54.429802 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e0412d4b-e14f-40e7-adae-b6622f636bd5 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:54.430226 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e0412d4b-e14f-40e7-adae-b6622f636bd5 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:54.585338 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-e0412d4b-e14f-40e7-adae-b6622f636bd5 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a1c8d841104bc9b6910bcc2c0e2bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe9283584fc4d90b0715216d867ea2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:05:54.593347 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-e0412d4b-e14f-40e7-adae-b6622f636bd5 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "GET /compute/v2.1/servers/07967adf-40e2-41e8-97d0-bc9ccf38fb53" status: 200 len: 1315 microversion: 2.1 time: 0.176839 Oct 04 22:05:54.594027 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2240/4553] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:05:54 2022] GET /compute/v2.1/servers/07967adf-40e2-41e8-97d0-bc9ccf38fb53 => generated 1315 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:05:54.941307 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-f3d3991c-28fa-479b-bea3-282696736843 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:05:54.942686 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-f3d3991c-28fa-479b-bea3-282696736843 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] [instance: 09bf867a-5ad2-42cd-bbd5-66e92dc8fff0] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:05:54.950635 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f3d3991c-28fa-479b-bea3-282696736843 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:54.951128 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f3d3991c-28fa-479b-bea3-282696736843 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:54.951779 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f3d3991c-28fa-479b-bea3-282696736843 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:54.952499 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f3d3991c-28fa-479b-bea3-282696736843 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:54.953274 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f3d3991c-28fa-479b-bea3-282696736843 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:54.954115 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f3d3991c-28fa-479b-bea3-282696736843 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:55.072396 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-fca2ae8c-d734-4662-9b21-333ef3626566 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:05:55.073589 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-fca2ae8c-d734-4662-9b21-333ef3626566 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] [instance: 92d3d7e9-8a75-4e07-812c-8b9f441e0376] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:05:55.087329 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fca2ae8c-d734-4662-9b21-333ef3626566 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:55.088584 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fca2ae8c-d734-4662-9b21-333ef3626566 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:55.089267 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fca2ae8c-d734-4662-9b21-333ef3626566 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:55.090762 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fca2ae8c-d734-4662-9b21-333ef3626566 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:55.091482 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fca2ae8c-d734-4662-9b21-333ef3626566 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:55.092140 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fca2ae8c-d734-4662-9b21-333ef3626566 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:55.192759 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-f3d3991c-28fa-479b-bea3-282696736843 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cd0931292c245578bea8861f9ba7607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a555982bb6f841d7a72b6eca84a6150f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:05:55.210345 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-f3d3991c-28fa-479b-bea3-282696736843 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] 10.222.0.43 "GET /compute/v2.1/servers/09bf867a-5ad2-42cd-bbd5-66e92dc8fff0" status: 200 len: 1355 microversion: 2.1 time: 0.271940 Oct 04 22:05:55.228173 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2314/4554] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:05:54 2022] GET /compute/v2.1/servers/09bf867a-5ad2-42cd-bbd5-66e92dc8fff0 => generated 1355 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:05:55.269598 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-fca2ae8c-d734-4662-9b21-333ef3626566 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e72a1a5d1a4c4b838acb169ab11eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b556e1ace286450f8493715e8317a107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:05:55.279488 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-fca2ae8c-d734-4662-9b21-333ef3626566 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] 10.222.0.43 "GET /compute/v2.1/servers/92d3d7e9-8a75-4e07-812c-8b9f441e0376" status: 200 len: 1319 microversion: 2.1 time: 0.211971 Oct 04 22:05:55.280271 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2241/4555] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:05:55 2022] GET /compute/v2.1/servers/92d3d7e9-8a75-4e07-812c-8b9f441e0376 => generated 1319 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:05:55.547133 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-1be88adc-85b5-4697-81a9-c50e66a46a6c req-b41efbc5-8247-48cf-bdfd-b44f0b791c42 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09bf867a-5ad2-42cd-bbd5-66e92dc8fff0", "tag": "b2bca8f9-985a-40a5-b364-9714853fc6b3"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:05:55.564440 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-1be88adc-85b5-4697-81a9-c50e66a46a6c req-b41efbc5-8247-48cf-bdfd-b44f0b791c42 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:55.565419 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-1be88adc-85b5-4697-81a9-c50e66a46a6c req-b41efbc5-8247-48cf-bdfd-b44f0b791c42 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:55.566046 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-1be88adc-85b5-4697-81a9-c50e66a46a6c req-b41efbc5-8247-48cf-bdfd-b44f0b791c42 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:55.581524 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-1be88adc-85b5-4697-81a9-c50e66a46a6c req-b41efbc5-8247-48cf-bdfd-b44f0b791c42 service nova] Creating event network-changed:b2bca8f9-985a-40a5-b364-9714853fc6b3 for instance 09bf867a-5ad2-42cd-bbd5-66e92dc8fff0 on n-h2-860284-1 Oct 04 22:05:55.588908 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-1be88adc-85b5-4697-81a9-c50e66a46a6c req-b41efbc5-8247-48cf-bdfd-b44f0b791c42 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048435 Oct 04 22:05:55.590290 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2315/4556] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:05:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:05:55.621218 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-fc7e597a-b42c-4d53-bc28-246f4f49d82a tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:05:55.622628 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-fc7e597a-b42c-4d53-bc28-246f4f49d82a tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: 07967adf-40e2-41e8-97d0-bc9ccf38fb53] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:05:55.633640 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fc7e597a-b42c-4d53-bc28-246f4f49d82a tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:55.634462 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fc7e597a-b42c-4d53-bc28-246f4f49d82a tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:55.635140 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fc7e597a-b42c-4d53-bc28-246f4f49d82a tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:55.636049 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fc7e597a-b42c-4d53-bc28-246f4f49d82a tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:55.636692 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fc7e597a-b42c-4d53-bc28-246f4f49d82a tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:55.637337 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fc7e597a-b42c-4d53-bc28-246f4f49d82a tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:56.224656 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-fc7e597a-b42c-4d53-bc28-246f4f49d82a tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a1c8d841104bc9b6910bcc2c0e2bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe9283584fc4d90b0715216d867ea2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:05:56.235770 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-fc7e597a-b42c-4d53-bc28-246f4f49d82a tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "GET /compute/v2.1/servers/07967adf-40e2-41e8-97d0-bc9ccf38fb53" status: 200 len: 1315 microversion: 2.1 time: 0.622094 Oct 04 22:05:56.241582 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2242/4557] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:05:55 2022] GET /compute/v2.1/servers/07967adf-40e2-41e8-97d0-bc9ccf38fb53 => generated 1315 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:05:56.267481 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-e6f61f15-44c2-406a-84c0-1f920c5389ad tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:05:56.271434 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-e6f61f15-44c2-406a-84c0-1f920c5389ad tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] [instance: 09bf867a-5ad2-42cd-bbd5-66e92dc8fff0] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:05:56.283241 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e6f61f15-44c2-406a-84c0-1f920c5389ad tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:56.284374 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e6f61f15-44c2-406a-84c0-1f920c5389ad tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:56.285526 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e6f61f15-44c2-406a-84c0-1f920c5389ad tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:56.286759 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e6f61f15-44c2-406a-84c0-1f920c5389ad tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:56.287435 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e6f61f15-44c2-406a-84c0-1f920c5389ad tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:56.288295 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e6f61f15-44c2-406a-84c0-1f920c5389ad tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:56.305479 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-9000e067-80d6-4359-bb4b-95df99f5201f tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:05:56.306270 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-9000e067-80d6-4359-bb4b-95df99f5201f tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] [instance: 92d3d7e9-8a75-4e07-812c-8b9f441e0376] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:05:56.322546 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9000e067-80d6-4359-bb4b-95df99f5201f tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:56.323367 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9000e067-80d6-4359-bb4b-95df99f5201f tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:56.324007 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9000e067-80d6-4359-bb4b-95df99f5201f tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:56.324923 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9000e067-80d6-4359-bb4b-95df99f5201f tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:56.325629 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9000e067-80d6-4359-bb4b-95df99f5201f tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:56.326274 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9000e067-80d6-4359-bb4b-95df99f5201f tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:56.385054 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell0:SELECT=2 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:05:56.429832 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell0:SELECT=8 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:05:56.634425 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-e6f61f15-44c2-406a-84c0-1f920c5389ad tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cd0931292c245578bea8861f9ba7607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a555982bb6f841d7a72b6eca84a6150f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:05:56.645472 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-9000e067-80d6-4359-bb4b-95df99f5201f tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e72a1a5d1a4c4b838acb169ab11eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b556e1ace286450f8493715e8317a107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:05:56.652627 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-e6f61f15-44c2-406a-84c0-1f920c5389ad tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] 10.222.0.43 "GET /compute/v2.1/servers/09bf867a-5ad2-42cd-bbd5-66e92dc8fff0" status: 200 len: 1355 microversion: 2.1 time: 0.419108 Oct 04 22:05:56.656436 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2316/4558] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:05:56 2022] GET /compute/v2.1/servers/09bf867a-5ad2-42cd-bbd5-66e92dc8fff0 => generated 1355 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:05:56.660512 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-9000e067-80d6-4359-bb4b-95df99f5201f tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] 10.222.0.43 "GET /compute/v2.1/servers/92d3d7e9-8a75-4e07-812c-8b9f441e0376" status: 200 len: 1319 microversion: 2.1 time: 0.360895 Oct 04 22:05:56.662153 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2243/4559] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:05:56 2022] GET /compute/v2.1/servers/92d3d7e9-8a75-4e07-812c-8b9f441e0376 => generated 1319 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:05:57.266119 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-d42adc50-2ae0-4e7f-bbdf-595675a954ae tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:05:57.266786 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-d42adc50-2ae0-4e7f-bbdf-595675a954ae tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: 07967adf-40e2-41e8-97d0-bc9ccf38fb53] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:05:57.278992 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d42adc50-2ae0-4e7f-bbdf-595675a954ae tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:57.279523 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d42adc50-2ae0-4e7f-bbdf-595675a954ae tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:57.280541 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d42adc50-2ae0-4e7f-bbdf-595675a954ae tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:57.281276 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d42adc50-2ae0-4e7f-bbdf-595675a954ae tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:57.282678 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d42adc50-2ae0-4e7f-bbdf-595675a954ae tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:57.283286 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d42adc50-2ae0-4e7f-bbdf-595675a954ae tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:57.530304 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-d42adc50-2ae0-4e7f-bbdf-595675a954ae tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a1c8d841104bc9b6910bcc2c0e2bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe9283584fc4d90b0715216d867ea2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:05:57.552630 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-d42adc50-2ae0-4e7f-bbdf-595675a954ae tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "GET /compute/v2.1/servers/07967adf-40e2-41e8-97d0-bc9ccf38fb53" status: 200 len: 1315 microversion: 2.1 time: 0.291240 Oct 04 22:05:57.555005 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2317/4560] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:05:57 2022] GET /compute/v2.1/servers/07967adf-40e2-41e8-97d0-bc9ccf38fb53 => generated 1315 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:05:57.632578 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-eb7aa3dc-32a5-419d-bedb-7b62b313e488 req-6102becb-2358-419b-958b-f9304eea38d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92d3d7e9-8a75-4e07-812c-8b9f441e0376", "tag": "50b70cb5-82ab-438c-8d09-f11e74153646"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:05:57.651327 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-eb7aa3dc-32a5-419d-bedb-7b62b313e488 req-6102becb-2358-419b-958b-f9304eea38d5 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:57.652005 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-eb7aa3dc-32a5-419d-bedb-7b62b313e488 req-6102becb-2358-419b-958b-f9304eea38d5 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:57.652420 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-eb7aa3dc-32a5-419d-bedb-7b62b313e488 req-6102becb-2358-419b-958b-f9304eea38d5 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:57.666873 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-eb7aa3dc-32a5-419d-bedb-7b62b313e488 req-6102becb-2358-419b-958b-f9304eea38d5 service nova] Creating event network-changed:50b70cb5-82ab-438c-8d09-f11e74153646 for instance 92d3d7e9-8a75-4e07-812c-8b9f441e0376 on n-h1-860284-1 Oct 04 22:05:57.675345 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-eb7aa3dc-32a5-419d-bedb-7b62b313e488 req-6102becb-2358-419b-958b-f9304eea38d5 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048684 Oct 04 22:05:57.675971 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2244/4561] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:05:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:05:57.691499 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-f48e2ba4-7e1b-4593-91c0-1241d7ac3ada tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:05:57.692686 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-f48e2ba4-7e1b-4593-91c0-1241d7ac3ada tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] [instance: 09bf867a-5ad2-42cd-bbd5-66e92dc8fff0] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:05:57.701947 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-95f71ae7-37a6-4a33-8f40-9b54e830eb1b tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:05:57.703000 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-95f71ae7-37a6-4a33-8f40-9b54e830eb1b tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] [instance: 92d3d7e9-8a75-4e07-812c-8b9f441e0376] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:05:57.708745 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f48e2ba4-7e1b-4593-91c0-1241d7ac3ada tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:57.709408 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f48e2ba4-7e1b-4593-91c0-1241d7ac3ada tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:57.709930 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f48e2ba4-7e1b-4593-91c0-1241d7ac3ada tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:57.710742 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f48e2ba4-7e1b-4593-91c0-1241d7ac3ada tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:57.711206 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f48e2ba4-7e1b-4593-91c0-1241d7ac3ada tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:57.711641 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f48e2ba4-7e1b-4593-91c0-1241d7ac3ada tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:57.712152 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-95f71ae7-37a6-4a33-8f40-9b54e830eb1b tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:57.713406 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-95f71ae7-37a6-4a33-8f40-9b54e830eb1b tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:57.714041 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-95f71ae7-37a6-4a33-8f40-9b54e830eb1b tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:57.714976 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-95f71ae7-37a6-4a33-8f40-9b54e830eb1b tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:57.715603 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-95f71ae7-37a6-4a33-8f40-9b54e830eb1b tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:57.716226 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-95f71ae7-37a6-4a33-8f40-9b54e830eb1b tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:58.290694 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-95f71ae7-37a6-4a33-8f40-9b54e830eb1b tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e72a1a5d1a4c4b838acb169ab11eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b556e1ace286450f8493715e8317a107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:05:58.305157 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-95f71ae7-37a6-4a33-8f40-9b54e830eb1b tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] 10.222.0.43 "GET /compute/v2.1/servers/92d3d7e9-8a75-4e07-812c-8b9f441e0376" status: 200 len: 1319 microversion: 2.1 time: 0.607632 Oct 04 22:05:58.305718 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-f48e2ba4-7e1b-4593-91c0-1241d7ac3ada tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cd0931292c245578bea8861f9ba7607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a555982bb6f841d7a72b6eca84a6150f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:05:58.306253 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2245/4562] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:05:57 2022] GET /compute/v2.1/servers/92d3d7e9-8a75-4e07-812c-8b9f441e0376 => generated 1319 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:05:58.323661 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-f48e2ba4-7e1b-4593-91c0-1241d7ac3ada tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] 10.222.0.43 "GET /compute/v2.1/servers/09bf867a-5ad2-42cd-bbd5-66e92dc8fff0" status: 200 len: 1355 microversion: 2.1 time: 0.636100 Oct 04 22:05:58.324278 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2318/4563] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:05:57 2022] GET /compute/v2.1/servers/09bf867a-5ad2-42cd-bbd5-66e92dc8fff0 => generated 1355 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:05:58.587098 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-5ab18b14-912e-4365-b044-33a221a28ec1 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:05:58.587989 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-5ab18b14-912e-4365-b044-33a221a28ec1 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: 07967adf-40e2-41e8-97d0-bc9ccf38fb53] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:05:58.600586 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5ab18b14-912e-4365-b044-33a221a28ec1 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:58.601493 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5ab18b14-912e-4365-b044-33a221a28ec1 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:58.602271 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5ab18b14-912e-4365-b044-33a221a28ec1 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:58.603240 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5ab18b14-912e-4365-b044-33a221a28ec1 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:58.604067 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5ab18b14-912e-4365-b044-33a221a28ec1 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:58.604853 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5ab18b14-912e-4365-b044-33a221a28ec1 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:58.934339 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-5ab18b14-912e-4365-b044-33a221a28ec1 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a1c8d841104bc9b6910bcc2c0e2bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe9283584fc4d90b0715216d867ea2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:05:58.953202 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-5ab18b14-912e-4365-b044-33a221a28ec1 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "GET /compute/v2.1/servers/07967adf-40e2-41e8-97d0-bc9ccf38fb53" status: 200 len: 1315 microversion: 2.1 time: 0.372666 Oct 04 22:05:58.953973 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2246/4564] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:05:58 2022] GET /compute/v2.1/servers/07967adf-40e2-41e8-97d0-bc9ccf38fb53 => generated 1315 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:05:59.330654 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-f5028dd5-cbfc-4a83-af5d-5c00e6da9fb9 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:05:59.331327 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-f5028dd5-cbfc-4a83-af5d-5c00e6da9fb9 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] [instance: 92d3d7e9-8a75-4e07-812c-8b9f441e0376] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:05:59.339432 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f5028dd5-cbfc-4a83-af5d-5c00e6da9fb9 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:59.340354 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f5028dd5-cbfc-4a83-af5d-5c00e6da9fb9 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:59.341010 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f5028dd5-cbfc-4a83-af5d-5c00e6da9fb9 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:59.342072 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f5028dd5-cbfc-4a83-af5d-5c00e6da9fb9 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:59.342800 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f5028dd5-cbfc-4a83-af5d-5c00e6da9fb9 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:59.343459 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f5028dd5-cbfc-4a83-af5d-5c00e6da9fb9 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:59.351083 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-b34e0217-e00b-4659-9305-5250038ea1f6 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:05:59.352044 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-b34e0217-e00b-4659-9305-5250038ea1f6 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] [instance: 09bf867a-5ad2-42cd-bbd5-66e92dc8fff0] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:05:59.364756 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b34e0217-e00b-4659-9305-5250038ea1f6 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:59.365942 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b34e0217-e00b-4659-9305-5250038ea1f6 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:59.367614 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b34e0217-e00b-4659-9305-5250038ea1f6 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:59.369090 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b34e0217-e00b-4659-9305-5250038ea1f6 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:59.370221 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b34e0217-e00b-4659-9305-5250038ea1f6 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:59.371811 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b34e0217-e00b-4659-9305-5250038ea1f6 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:59.734452 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-f5028dd5-cbfc-4a83-af5d-5c00e6da9fb9 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e72a1a5d1a4c4b838acb169ab11eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b556e1ace286450f8493715e8317a107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:05:59.744049 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-f5028dd5-cbfc-4a83-af5d-5c00e6da9fb9 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] 10.222.0.43 "GET /compute/v2.1/servers/92d3d7e9-8a75-4e07-812c-8b9f441e0376" status: 200 len: 1319 microversion: 2.1 time: 0.418504 Oct 04 22:05:59.746673 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2319/4565] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:05:59 2022] GET /compute/v2.1/servers/92d3d7e9-8a75-4e07-812c-8b9f441e0376 => generated 1319 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:05:59.750057 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-b34e0217-e00b-4659-9305-5250038ea1f6 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cd0931292c245578bea8861f9ba7607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a555982bb6f841d7a72b6eca84a6150f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:05:59.762016 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-b34e0217-e00b-4659-9305-5250038ea1f6 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] 10.222.0.43 "GET /compute/v2.1/servers/09bf867a-5ad2-42cd-bbd5-66e92dc8fff0" status: 200 len: 1355 microversion: 2.1 time: 0.415041 Oct 04 22:05:59.766625 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2247/4566] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:05:59 2022] GET /compute/v2.1/servers/09bf867a-5ad2-42cd-bbd5-66e92dc8fff0 => generated 1355 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:05:59.980434 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-9541b27a-7e36-40e8-baf7-0acf232b9ce0 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:05:59.981181 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-9541b27a-7e36-40e8-baf7-0acf232b9ce0 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: 07967adf-40e2-41e8-97d0-bc9ccf38fb53] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:05:59.988396 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9541b27a-7e36-40e8-baf7-0acf232b9ce0 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:59.989124 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9541b27a-7e36-40e8-baf7-0acf232b9ce0 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:59.989633 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9541b27a-7e36-40e8-baf7-0acf232b9ce0 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:59.990596 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9541b27a-7e36-40e8-baf7-0acf232b9ce0 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:59.991275 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9541b27a-7e36-40e8-baf7-0acf232b9ce0 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:59.991732 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9541b27a-7e36-40e8-baf7-0acf232b9ce0 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:00.285707 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-9541b27a-7e36-40e8-baf7-0acf232b9ce0 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a1c8d841104bc9b6910bcc2c0e2bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe9283584fc4d90b0715216d867ea2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:06:00.297048 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-9541b27a-7e36-40e8-baf7-0acf232b9ce0 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "GET /compute/v2.1/servers/07967adf-40e2-41e8-97d0-bc9ccf38fb53" status: 200 len: 1315 microversion: 2.1 time: 0.322521 Oct 04 22:06:00.302950 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2320/4567] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:05:59 2022] GET /compute/v2.1/servers/07967adf-40e2-41e8-97d0-bc9ccf38fb53 => generated 1315 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:06:00.322275 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-b21a6426-7e50-4a92-85e8-c5d36155cf2a req-ee7414c8-3136-479a-b86c-4d4ecb532b3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07967adf-40e2-41e8-97d0-bc9ccf38fb53", "name": "network-vif-plugged", "status": "completed", "tag": "4dfcf579-7ad9-44da-b7d9-bf8e382a42f8"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:06:00.329616 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=2 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:06:00.335546 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-b21a6426-7e50-4a92-85e8-c5d36155cf2a req-ee7414c8-3136-479a-b86c-4d4ecb532b3c service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:00.336600 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-b21a6426-7e50-4a92-85e8-c5d36155cf2a req-ee7414c8-3136-479a-b86c-4d4ecb532b3c service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:00.337245 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-b21a6426-7e50-4a92-85e8-c5d36155cf2a req-ee7414c8-3136-479a-b86c-4d4ecb532b3c service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:00.350750 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-b21a6426-7e50-4a92-85e8-c5d36155cf2a req-ee7414c8-3136-479a-b86c-4d4ecb532b3c service nova] Creating event network-vif-plugged:4dfcf579-7ad9-44da-b7d9-bf8e382a42f8 for instance 07967adf-40e2-41e8-97d0-bc9ccf38fb53 on n-h2-860284-1 Oct 04 22:06:00.356349 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-b21a6426-7e50-4a92-85e8-c5d36155cf2a req-ee7414c8-3136-479a-b86c-4d4ecb532b3c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037763 Oct 04 22:06:00.357200 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2248/4568] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:06:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:06:00.776826 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-a3ace5bb-02c6-45c5-a1d1-e0449cee5f05 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:06:00.778212 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-a3ace5bb-02c6-45c5-a1d1-e0449cee5f05 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] [instance: 92d3d7e9-8a75-4e07-812c-8b9f441e0376] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:06:00.787557 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=16 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:06:00.792223 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a3ace5bb-02c6-45c5-a1d1-e0449cee5f05 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:00.792752 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a3ace5bb-02c6-45c5-a1d1-e0449cee5f05 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:00.793179 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a3ace5bb-02c6-45c5-a1d1-e0449cee5f05 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:00.793911 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a3ace5bb-02c6-45c5-a1d1-e0449cee5f05 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:00.795778 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-dec2b7a8-4cc1-425b-bb14-f299ea5388a1 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:06:00.796506 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a3ace5bb-02c6-45c5-a1d1-e0449cee5f05 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:00.797025 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a3ace5bb-02c6-45c5-a1d1-e0449cee5f05 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:00.797979 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-dec2b7a8-4cc1-425b-bb14-f299ea5388a1 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] [instance: 09bf867a-5ad2-42cd-bbd5-66e92dc8fff0] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:06:00.806551 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dec2b7a8-4cc1-425b-bb14-f299ea5388a1 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:00.808166 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dec2b7a8-4cc1-425b-bb14-f299ea5388a1 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:00.809466 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dec2b7a8-4cc1-425b-bb14-f299ea5388a1 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:00.810610 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dec2b7a8-4cc1-425b-bb14-f299ea5388a1 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:00.811407 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dec2b7a8-4cc1-425b-bb14-f299ea5388a1 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:00.812492 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dec2b7a8-4cc1-425b-bb14-f299ea5388a1 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:01.115562 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-dec2b7a8-4cc1-425b-bb14-f299ea5388a1 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cd0931292c245578bea8861f9ba7607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a555982bb6f841d7a72b6eca84a6150f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:06:01.133539 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-dec2b7a8-4cc1-425b-bb14-f299ea5388a1 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] 10.222.0.43 "GET /compute/v2.1/servers/09bf867a-5ad2-42cd-bbd5-66e92dc8fff0" status: 200 len: 1355 microversion: 2.1 time: 0.348239 Oct 04 22:06:01.145853 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2249/4569] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:06:00 2022] GET /compute/v2.1/servers/09bf867a-5ad2-42cd-bbd5-66e92dc8fff0 => generated 1355 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:06:01.182030 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-a3ace5bb-02c6-45c5-a1d1-e0449cee5f05 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e72a1a5d1a4c4b838acb169ab11eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b556e1ace286450f8493715e8317a107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:06:01.190305 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-a3ace5bb-02c6-45c5-a1d1-e0449cee5f05 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] 10.222.0.43 "GET /compute/v2.1/servers/92d3d7e9-8a75-4e07-812c-8b9f441e0376" status: 200 len: 1319 microversion: 2.1 time: 0.421221 Oct 04 22:06:01.191206 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2321/4570] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:06:00 2022] GET /compute/v2.1/servers/92d3d7e9-8a75-4e07-812c-8b9f441e0376 => generated 1319 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:06:01.323122 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e492fa46-0e0a-4fdd-95cd-5c5759ad9ebd tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:06:01.325094 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-e492fa46-0e0a-4fdd-95cd-5c5759ad9ebd tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: 07967adf-40e2-41e8-97d0-bc9ccf38fb53] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:06:01.333877 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e492fa46-0e0a-4fdd-95cd-5c5759ad9ebd tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:01.334554 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e492fa46-0e0a-4fdd-95cd-5c5759ad9ebd tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:01.335002 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e492fa46-0e0a-4fdd-95cd-5c5759ad9ebd tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:01.336409 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e492fa46-0e0a-4fdd-95cd-5c5759ad9ebd tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:01.336953 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e492fa46-0e0a-4fdd-95cd-5c5759ad9ebd tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:01.338050 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e492fa46-0e0a-4fdd-95cd-5c5759ad9ebd tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:01.600552 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-e492fa46-0e0a-4fdd-95cd-5c5759ad9ebd tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a1c8d841104bc9b6910bcc2c0e2bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe9283584fc4d90b0715216d867ea2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:06:01.611252 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-e492fa46-0e0a-4fdd-95cd-5c5759ad9ebd tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "GET /compute/v2.1/servers/07967adf-40e2-41e8-97d0-bc9ccf38fb53" status: 200 len: 1315 microversion: 2.1 time: 0.294451 Oct 04 22:06:01.625055 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2250/4571] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:06:01 2022] GET /compute/v2.1/servers/07967adf-40e2-41e8-97d0-bc9ccf38fb53 => generated 1315 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:06:02.157146 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-348509c0-14fc-4d58-955f-fd53b6476893 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:06:02.157760 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-348509c0-14fc-4d58-955f-fd53b6476893 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] [instance: 09bf867a-5ad2-42cd-bbd5-66e92dc8fff0] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:06:02.165732 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-348509c0-14fc-4d58-955f-fd53b6476893 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:02.166228 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-348509c0-14fc-4d58-955f-fd53b6476893 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:02.166990 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-348509c0-14fc-4d58-955f-fd53b6476893 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:02.167775 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-348509c0-14fc-4d58-955f-fd53b6476893 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:02.168450 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-348509c0-14fc-4d58-955f-fd53b6476893 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:02.168950 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-348509c0-14fc-4d58-955f-fd53b6476893 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:02.215978 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-68196d13-c076-4bba-8d39-7814eaf7da9a tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:06:02.217057 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-68196d13-c076-4bba-8d39-7814eaf7da9a tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] [instance: 92d3d7e9-8a75-4e07-812c-8b9f441e0376] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:06:02.223941 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-68196d13-c076-4bba-8d39-7814eaf7da9a tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:02.224657 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-68196d13-c076-4bba-8d39-7814eaf7da9a tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:02.225116 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-68196d13-c076-4bba-8d39-7814eaf7da9a tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:02.226155 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-68196d13-c076-4bba-8d39-7814eaf7da9a tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:02.226710 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-68196d13-c076-4bba-8d39-7814eaf7da9a tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:02.227378 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-68196d13-c076-4bba-8d39-7814eaf7da9a tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:02.716545 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-348509c0-14fc-4d58-955f-fd53b6476893 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cd0931292c245578bea8861f9ba7607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a555982bb6f841d7a72b6eca84a6150f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:06:02.741745 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-348509c0-14fc-4d58-955f-fd53b6476893 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] 10.222.0.43 "GET /compute/v2.1/servers/09bf867a-5ad2-42cd-bbd5-66e92dc8fff0" status: 200 len: 1355 microversion: 2.1 time: 0.587215 Oct 04 22:06:02.743438 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2322/4572] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:06:02 2022] GET /compute/v2.1/servers/09bf867a-5ad2-42cd-bbd5-66e92dc8fff0 => generated 1355 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:06:02.749276 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-2b38c038-e006-493e-b7b7-e6161d1d8150 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:06:02.750055 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-2b38c038-e006-493e-b7b7-e6161d1d8150 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: 07967adf-40e2-41e8-97d0-bc9ccf38fb53] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:06:02.757398 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2b38c038-e006-493e-b7b7-e6161d1d8150 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:02.758505 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2b38c038-e006-493e-b7b7-e6161d1d8150 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:02.759219 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2b38c038-e006-493e-b7b7-e6161d1d8150 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:02.760129 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2b38c038-e006-493e-b7b7-e6161d1d8150 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:02.760906 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2b38c038-e006-493e-b7b7-e6161d1d8150 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:02.761570 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2b38c038-e006-493e-b7b7-e6161d1d8150 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:02.792492 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-68196d13-c076-4bba-8d39-7814eaf7da9a tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e72a1a5d1a4c4b838acb169ab11eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b556e1ace286450f8493715e8317a107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:06:02.817651 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-68196d13-c076-4bba-8d39-7814eaf7da9a tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] 10.222.0.43 "GET /compute/v2.1/servers/92d3d7e9-8a75-4e07-812c-8b9f441e0376" status: 200 len: 1319 microversion: 2.1 time: 0.605742 Oct 04 22:06:02.819606 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2251/4573] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:06:02 2022] GET /compute/v2.1/servers/92d3d7e9-8a75-4e07-812c-8b9f441e0376 => generated 1319 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:06:03.103857 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-2b38c038-e006-493e-b7b7-e6161d1d8150 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a1c8d841104bc9b6910bcc2c0e2bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe9283584fc4d90b0715216d867ea2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:06:03.144236 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-2b38c038-e006-493e-b7b7-e6161d1d8150 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "GET /compute/v2.1/servers/07967adf-40e2-41e8-97d0-bc9ccf38fb53" status: 200 len: 1315 microversion: 2.1 time: 0.399110 Oct 04 22:06:03.160191 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2323/4574] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:06:02 2022] GET /compute/v2.1/servers/07967adf-40e2-41e8-97d0-bc9ccf38fb53 => generated 1315 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:06:03.767289 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-c6c54036-97fd-4fb3-b417-73986e14fa1f tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:06:03.767863 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-c6c54036-97fd-4fb3-b417-73986e14fa1f tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] [instance: 09bf867a-5ad2-42cd-bbd5-66e92dc8fff0] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:06:03.786700 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c6c54036-97fd-4fb3-b417-73986e14fa1f tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:03.787222 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c6c54036-97fd-4fb3-b417-73986e14fa1f tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:03.793905 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c6c54036-97fd-4fb3-b417-73986e14fa1f tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:03.795071 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c6c54036-97fd-4fb3-b417-73986e14fa1f tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:03.795603 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c6c54036-97fd-4fb3-b417-73986e14fa1f tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:03.796061 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c6c54036-97fd-4fb3-b417-73986e14fa1f tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:03.854050 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-6ab1761c-727f-435e-b71b-6788c914b23f tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:06:03.854963 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-6ab1761c-727f-435e-b71b-6788c914b23f tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] [instance: 92d3d7e9-8a75-4e07-812c-8b9f441e0376] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:06:03.867388 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6ab1761c-727f-435e-b71b-6788c914b23f tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:03.875197 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6ab1761c-727f-435e-b71b-6788c914b23f tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:03.875902 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6ab1761c-727f-435e-b71b-6788c914b23f tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:03.877160 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6ab1761c-727f-435e-b71b-6788c914b23f tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:03.877856 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6ab1761c-727f-435e-b71b-6788c914b23f tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:03.878502 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6ab1761c-727f-435e-b71b-6788c914b23f tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:04.194966 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-c6c54036-97fd-4fb3-b417-73986e14fa1f tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cd0931292c245578bea8861f9ba7607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a555982bb6f841d7a72b6eca84a6150f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:06:04.208220 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=100 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:06:04.241498 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-c6c54036-97fd-4fb3-b417-73986e14fa1f tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] 10.222.0.43 "GET /compute/v2.1/servers/09bf867a-5ad2-42cd-bbd5-66e92dc8fff0" status: 200 len: 1355 microversion: 2.1 time: 0.477329 Oct 04 22:06:04.255240 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2252/4575] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:06:03 2022] GET /compute/v2.1/servers/09bf867a-5ad2-42cd-bbd5-66e92dc8fff0 => generated 1355 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:06:04.255240 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-25b54fa5-46db-4242-9e01-f501d8fbe9e2 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:06:04.255240 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-25b54fa5-46db-4242-9e01-f501d8fbe9e2 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: 07967adf-40e2-41e8-97d0-bc9ccf38fb53] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:06:04.261427 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-6ab1761c-727f-435e-b71b-6788c914b23f tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e72a1a5d1a4c4b838acb169ab11eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b556e1ace286450f8493715e8317a107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:06:04.268075 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-25b54fa5-46db-4242-9e01-f501d8fbe9e2 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:04.268507 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-25b54fa5-46db-4242-9e01-f501d8fbe9e2 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:04.272747 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-25b54fa5-46db-4242-9e01-f501d8fbe9e2 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:04.273521 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-25b54fa5-46db-4242-9e01-f501d8fbe9e2 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:04.274668 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-25b54fa5-46db-4242-9e01-f501d8fbe9e2 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:04.276931 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-6ab1761c-727f-435e-b71b-6788c914b23f tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] 10.222.0.43 "GET /compute/v2.1/servers/92d3d7e9-8a75-4e07-812c-8b9f441e0376" status: 200 len: 1319 microversion: 2.1 time: 0.425764 Oct 04 22:06:04.277783 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2324/4576] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:06:03 2022] GET /compute/v2.1/servers/92d3d7e9-8a75-4e07-812c-8b9f441e0376 => generated 1319 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:06:04.293586 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-25b54fa5-46db-4242-9e01-f501d8fbe9e2 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:04.659304 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-25b54fa5-46db-4242-9e01-f501d8fbe9e2 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a1c8d841104bc9b6910bcc2c0e2bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe9283584fc4d90b0715216d867ea2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:06:04.672008 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-25b54fa5-46db-4242-9e01-f501d8fbe9e2 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "GET /compute/v2.1/servers/07967adf-40e2-41e8-97d0-bc9ccf38fb53" status: 200 len: 1502 microversion: 2.1 time: 0.424582 Oct 04 22:06:04.672620 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2253/4577] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:06:04 2022] GET /compute/v2.1/servers/07967adf-40e2-41e8-97d0-bc9ccf38fb53 => generated 1502 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:06:04.696715 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-54355b1d-a65d-4b09-8bd2-a6498031ce37 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:06:04.697775 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-54355b1d-a65d-4b09-8bd2-a6498031ce37 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: 07967adf-40e2-41e8-97d0-bc9ccf38fb53] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:06:04.705033 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-54355b1d-a65d-4b09-8bd2-a6498031ce37 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:04.705844 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-54355b1d-a65d-4b09-8bd2-a6498031ce37 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:04.706593 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-54355b1d-a65d-4b09-8bd2-a6498031ce37 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:04.708361 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-54355b1d-a65d-4b09-8bd2-a6498031ce37 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:04.709532 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-54355b1d-a65d-4b09-8bd2-a6498031ce37 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:04.710875 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-54355b1d-a65d-4b09-8bd2-a6498031ce37 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:04.744657 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.objects.instance [None req-54355b1d-a65d-4b09-8bd2-a6498031ce37 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lazy-loading 'flavor' on Instance uuid 07967adf-40e2-41e8-97d0-bc9ccf38fb53 {{(pid=134102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 22:06:04.848993 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-54355b1d-a65d-4b09-8bd2-a6498031ce37 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "POST /compute/v2.1/servers/07967adf-40e2-41e8-97d0-bc9ccf38fb53/action" status: 202 len: 0 microversion: 2.1 time: 0.156392 Oct 04 22:06:04.850090 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2325/4578] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 22:06:04 2022] POST /compute/v2.1/servers/07967adf-40e2-41e8-97d0-bc9ccf38fb53/action => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 22:06:04.858472 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-d54f27ee-ce63-4488-aade-98d6149350ac tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:06:04.859354 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-d54f27ee-ce63-4488-aade-98d6149350ac tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: 07967adf-40e2-41e8-97d0-bc9ccf38fb53] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:06:04.862040 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=6 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:06:04.872968 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d54f27ee-ce63-4488-aade-98d6149350ac tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:04.873477 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d54f27ee-ce63-4488-aade-98d6149350ac tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:04.873983 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d54f27ee-ce63-4488-aade-98d6149350ac tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:04.874815 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d54f27ee-ce63-4488-aade-98d6149350ac tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:04.875332 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d54f27ee-ce63-4488-aade-98d6149350ac tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:04.880810 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d54f27ee-ce63-4488-aade-98d6149350ac tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:05.142542 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-d54f27ee-ce63-4488-aade-98d6149350ac tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a1c8d841104bc9b6910bcc2c0e2bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe9283584fc4d90b0715216d867ea2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:06:05.156695 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-d54f27ee-ce63-4488-aade-98d6149350ac tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "GET /compute/v2.1/servers/07967adf-40e2-41e8-97d0-bc9ccf38fb53" status: 200 len: 1510 microversion: 2.1 time: 0.302102 Oct 04 22:06:05.157634 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2254/4579] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:06:04 2022] GET /compute/v2.1/servers/07967adf-40e2-41e8-97d0-bc9ccf38fb53 => generated 1510 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:06:05.305162 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-7981bf60-50e2-4105-930a-8b97b1187e63 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:06:05.305897 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-7981bf60-50e2-4105-930a-8b97b1187e63 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] [instance: 92d3d7e9-8a75-4e07-812c-8b9f441e0376] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:06:05.309774 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-90e2740b-53d1-4de0-b66f-3809ff9b7dad tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:06:05.310553 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-90e2740b-53d1-4de0-b66f-3809ff9b7dad tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] [instance: 09bf867a-5ad2-42cd-bbd5-66e92dc8fff0] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:06:05.324661 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7981bf60-50e2-4105-930a-8b97b1187e63 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:05.326562 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7981bf60-50e2-4105-930a-8b97b1187e63 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:05.327025 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7981bf60-50e2-4105-930a-8b97b1187e63 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:05.327344 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-90e2740b-53d1-4de0-b66f-3809ff9b7dad tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:05.328700 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7981bf60-50e2-4105-930a-8b97b1187e63 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:05.329256 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-90e2740b-53d1-4de0-b66f-3809ff9b7dad tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:05.330845 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7981bf60-50e2-4105-930a-8b97b1187e63 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:05.331087 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-90e2740b-53d1-4de0-b66f-3809ff9b7dad tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:05.331848 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-90e2740b-53d1-4de0-b66f-3809ff9b7dad tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:05.332336 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-90e2740b-53d1-4de0-b66f-3809ff9b7dad tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:05.333364 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-90e2740b-53d1-4de0-b66f-3809ff9b7dad tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:05.334021 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7981bf60-50e2-4105-930a-8b97b1187e63 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:05.359262 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:06:05.728182 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-7981bf60-50e2-4105-930a-8b97b1187e63 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e72a1a5d1a4c4b838acb169ab11eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b556e1ace286450f8493715e8317a107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:06:05.741821 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-7981bf60-50e2-4105-930a-8b97b1187e63 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] 10.222.0.43 "GET /compute/v2.1/servers/92d3d7e9-8a75-4e07-812c-8b9f441e0376" status: 200 len: 1319 microversion: 2.1 time: 0.441105 Oct 04 22:06:05.743944 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2255/4580] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:06:05 2022] GET /compute/v2.1/servers/92d3d7e9-8a75-4e07-812c-8b9f441e0376 => generated 1319 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:06:05.767538 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-90e2740b-53d1-4de0-b66f-3809ff9b7dad tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cd0931292c245578bea8861f9ba7607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a555982bb6f841d7a72b6eca84a6150f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:06:05.784918 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-90e2740b-53d1-4de0-b66f-3809ff9b7dad tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] 10.222.0.43 "GET /compute/v2.1/servers/09bf867a-5ad2-42cd-bbd5-66e92dc8fff0" status: 200 len: 1355 microversion: 2.1 time: 0.496361 Oct 04 22:06:05.802801 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2326/4581] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:06:05 2022] GET /compute/v2.1/servers/09bf867a-5ad2-42cd-bbd5-66e92dc8fff0 => generated 1355 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:06:06.182193 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-cd3c580a-0686-424e-b216-4ad8db0da662 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:06:06.182965 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-cd3c580a-0686-424e-b216-4ad8db0da662 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: 07967adf-40e2-41e8-97d0-bc9ccf38fb53] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:06:06.194777 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cd3c580a-0686-424e-b216-4ad8db0da662 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:06.196140 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cd3c580a-0686-424e-b216-4ad8db0da662 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:06.197660 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cd3c580a-0686-424e-b216-4ad8db0da662 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:06.199079 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cd3c580a-0686-424e-b216-4ad8db0da662 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:06.200245 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cd3c580a-0686-424e-b216-4ad8db0da662 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:06.200966 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cd3c580a-0686-424e-b216-4ad8db0da662 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:06.769418 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-714fbf0a-a1a0-423c-aaf3-76f74bfa98a1 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:06:06.771229 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-714fbf0a-a1a0-423c-aaf3-76f74bfa98a1 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] [instance: 92d3d7e9-8a75-4e07-812c-8b9f441e0376] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:06:06.778751 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-714fbf0a-a1a0-423c-aaf3-76f74bfa98a1 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:06.779388 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-714fbf0a-a1a0-423c-aaf3-76f74bfa98a1 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:06.779969 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-714fbf0a-a1a0-423c-aaf3-76f74bfa98a1 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:06.780981 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-714fbf0a-a1a0-423c-aaf3-76f74bfa98a1 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:06.781770 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-714fbf0a-a1a0-423c-aaf3-76f74bfa98a1 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:06.782587 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-714fbf0a-a1a0-423c-aaf3-76f74bfa98a1 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:06.812587 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-cd3c580a-0686-424e-b216-4ad8db0da662 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a1c8d841104bc9b6910bcc2c0e2bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe9283584fc4d90b0715216d867ea2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:06:06.823662 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-cd3c580a-0686-424e-b216-4ad8db0da662 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "GET /compute/v2.1/servers/07967adf-40e2-41e8-97d0-bc9ccf38fb53" status: 200 len: 1493 microversion: 2.1 time: 0.645600 Oct 04 22:06:06.824261 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2256/4582] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:06:06 2022] GET /compute/v2.1/servers/07967adf-40e2-41e8-97d0-bc9ccf38fb53 => generated 1493 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:06:06.846500 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-0fa2c498-497a-44ba-bdaa-45163419adb4 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:06:06.847590 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-0fa2c498-497a-44ba-bdaa-45163419adb4 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] [instance: 09bf867a-5ad2-42cd-bbd5-66e92dc8fff0] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:06:06.854349 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0fa2c498-497a-44ba-bdaa-45163419adb4 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:06.855956 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0fa2c498-497a-44ba-bdaa-45163419adb4 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:06.856523 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0fa2c498-497a-44ba-bdaa-45163419adb4 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:06.857368 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0fa2c498-497a-44ba-bdaa-45163419adb4 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:06.857958 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0fa2c498-497a-44ba-bdaa-45163419adb4 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:06.858490 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0fa2c498-497a-44ba-bdaa-45163419adb4 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:07.081304 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-714fbf0a-a1a0-423c-aaf3-76f74bfa98a1 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e72a1a5d1a4c4b838acb169ab11eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b556e1ace286450f8493715e8317a107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:06:07.104142 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-714fbf0a-a1a0-423c-aaf3-76f74bfa98a1 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] 10.222.0.43 "GET /compute/v2.1/servers/92d3d7e9-8a75-4e07-812c-8b9f441e0376" status: 200 len: 1319 microversion: 2.1 time: 0.339596 Oct 04 22:06:07.128330 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2327/4583] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:06:06 2022] GET /compute/v2.1/servers/92d3d7e9-8a75-4e07-812c-8b9f441e0376 => generated 1319 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:06:07.136815 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-da64566a-59b7-491a-9a17-bdcf80953318 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:06:07.137576 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-da64566a-59b7-491a-9a17-bdcf80953318 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: 07967adf-40e2-41e8-97d0-bc9ccf38fb53] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:06:07.144390 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-da64566a-59b7-491a-9a17-bdcf80953318 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:07.145159 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-da64566a-59b7-491a-9a17-bdcf80953318 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:07.146138 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-da64566a-59b7-491a-9a17-bdcf80953318 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:07.147227 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-da64566a-59b7-491a-9a17-bdcf80953318 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:07.147862 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-da64566a-59b7-491a-9a17-bdcf80953318 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:07.151136 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-da64566a-59b7-491a-9a17-bdcf80953318 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:07.166052 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-0fa2c498-497a-44ba-bdaa-45163419adb4 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cd0931292c245578bea8861f9ba7607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a555982bb6f841d7a72b6eca84a6150f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:06:07.176001 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-0fa2c498-497a-44ba-bdaa-45163419adb4 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] 10.222.0.43 "GET /compute/v2.1/servers/09bf867a-5ad2-42cd-bbd5-66e92dc8fff0" status: 200 len: 1355 microversion: 2.1 time: 0.334380 Oct 04 22:06:07.177263 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2257/4584] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:06:06 2022] GET /compute/v2.1/servers/09bf867a-5ad2-42cd-bbd5-66e92dc8fff0 => generated 1355 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:06:07.199376 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-da64566a-59b7-491a-9a17-bdcf80953318 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: 07967adf-40e2-41e8-97d0-bc9ccf38fb53] Going to try to terminate instance {{(pid=134102) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 22:06:07.319978 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-da64566a-59b7-491a-9a17-bdcf80953318 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "DELETE /compute/v2.1/servers/07967adf-40e2-41e8-97d0-bc9ccf38fb53" status: 204 len: 0 microversion: 2.1 time: 0.190348 Oct 04 22:06:07.321119 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2328/4585] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 22:06:07 2022] DELETE /compute/v2.1/servers/07967adf-40e2-41e8-97d0-bc9ccf38fb53 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 22:06:07.329932 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-7195fd90-8607-4885-8c14-8f54b003e332 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:06:07.331400 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-7195fd90-8607-4885-8c14-8f54b003e332 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: 07967adf-40e2-41e8-97d0-bc9ccf38fb53] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:06:07.349537 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7195fd90-8607-4885-8c14-8f54b003e332 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:07.350237 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7195fd90-8607-4885-8c14-8f54b003e332 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:07.350791 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7195fd90-8607-4885-8c14-8f54b003e332 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:07.351618 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7195fd90-8607-4885-8c14-8f54b003e332 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:07.352199 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7195fd90-8607-4885-8c14-8f54b003e332 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:07.352690 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7195fd90-8607-4885-8c14-8f54b003e332 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:07.425430 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-ce5a261c-00e1-4ee0-9e90-6d16c6d2bb98 req-935b8fcf-e48c-4be9-bf52-a84a751ae9f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92d3d7e9-8a75-4e07-812c-8b9f441e0376", "name": "network-vif-plugged", "status": "completed", "tag": "50b70cb5-82ab-438c-8d09-f11e74153646"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:06:07.449336 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-ce5a261c-00e1-4ee0-9e90-6d16c6d2bb98 req-935b8fcf-e48c-4be9-bf52-a84a751ae9f9 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:07.450492 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-ce5a261c-00e1-4ee0-9e90-6d16c6d2bb98 req-935b8fcf-e48c-4be9-bf52-a84a751ae9f9 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:07.451090 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-ce5a261c-00e1-4ee0-9e90-6d16c6d2bb98 req-935b8fcf-e48c-4be9-bf52-a84a751ae9f9 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:07.474678 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-ce5a261c-00e1-4ee0-9e90-6d16c6d2bb98 req-935b8fcf-e48c-4be9-bf52-a84a751ae9f9 service nova] Creating event network-vif-plugged:50b70cb5-82ab-438c-8d09-f11e74153646 for instance 92d3d7e9-8a75-4e07-812c-8b9f441e0376 on n-h1-860284-1 Oct 04 22:06:07.480798 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-ce5a261c-00e1-4ee0-9e90-6d16c6d2bb98 req-935b8fcf-e48c-4be9-bf52-a84a751ae9f9 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062711 Oct 04 22:06:07.482099 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2329/4586] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:06:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:06:07.608331 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-7195fd90-8607-4885-8c14-8f54b003e332 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a1c8d841104bc9b6910bcc2c0e2bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe9283584fc4d90b0715216d867ea2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:06:07.619721 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-7195fd90-8607-4885-8c14-8f54b003e332 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "GET /compute/v2.1/servers/07967adf-40e2-41e8-97d0-bc9ccf38fb53" status: 200 len: 1499 microversion: 2.1 time: 0.293996 Oct 04 22:06:07.620813 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2258/4587] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:06:07 2022] GET /compute/v2.1/servers/07967adf-40e2-41e8-97d0-bc9ccf38fb53 => generated 1499 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:06:08.131470 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-3520257a-3fe9-4124-9730-d4b28f078714 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:06:08.135403 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-3520257a-3fe9-4124-9730-d4b28f078714 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] [instance: 92d3d7e9-8a75-4e07-812c-8b9f441e0376] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:06:08.154879 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3520257a-3fe9-4124-9730-d4b28f078714 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:08.155981 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3520257a-3fe9-4124-9730-d4b28f078714 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:08.156862 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3520257a-3fe9-4124-9730-d4b28f078714 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:08.163410 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3520257a-3fe9-4124-9730-d4b28f078714 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:08.165569 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3520257a-3fe9-4124-9730-d4b28f078714 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:08.166200 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3520257a-3fe9-4124-9730-d4b28f078714 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:08.205077 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-da794adc-7d78-45ca-bb0b-9e016482dfd0 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:06:08.205819 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-da794adc-7d78-45ca-bb0b-9e016482dfd0 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] [instance: 09bf867a-5ad2-42cd-bbd5-66e92dc8fff0] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:06:08.221314 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-da794adc-7d78-45ca-bb0b-9e016482dfd0 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:08.225993 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-da794adc-7d78-45ca-bb0b-9e016482dfd0 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:08.227898 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-da794adc-7d78-45ca-bb0b-9e016482dfd0 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:08.230210 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-da794adc-7d78-45ca-bb0b-9e016482dfd0 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:08.232698 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-da794adc-7d78-45ca-bb0b-9e016482dfd0 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:08.240486 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-da794adc-7d78-45ca-bb0b-9e016482dfd0 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:08.703847 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-3520257a-3fe9-4124-9730-d4b28f078714 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e72a1a5d1a4c4b838acb169ab11eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b556e1ace286450f8493715e8317a107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:06:08.712847 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-3520257a-3fe9-4124-9730-d4b28f078714 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] 10.222.0.43 "GET /compute/v2.1/servers/92d3d7e9-8a75-4e07-812c-8b9f441e0376" status: 200 len: 1319 microversion: 2.1 time: 0.587168 Oct 04 22:06:08.713759 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2330/4588] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:06:08 2022] GET /compute/v2.1/servers/92d3d7e9-8a75-4e07-812c-8b9f441e0376 => generated 1319 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:06:08.718784 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-f1360d1f-a671-4418-a338-3bfd9b6be974 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:06:08.719739 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-f1360d1f-a671-4418-a338-3bfd9b6be974 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: 07967adf-40e2-41e8-97d0-bc9ccf38fb53] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:06:08.726277 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f1360d1f-a671-4418-a338-3bfd9b6be974 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:08.727141 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f1360d1f-a671-4418-a338-3bfd9b6be974 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:08.727818 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f1360d1f-a671-4418-a338-3bfd9b6be974 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:08.728927 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f1360d1f-a671-4418-a338-3bfd9b6be974 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:08.729608 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f1360d1f-a671-4418-a338-3bfd9b6be974 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:08.730262 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f1360d1f-a671-4418-a338-3bfd9b6be974 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:08.761394 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-da794adc-7d78-45ca-bb0b-9e016482dfd0 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cd0931292c245578bea8861f9ba7607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a555982bb6f841d7a72b6eca84a6150f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:06:08.773257 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-da794adc-7d78-45ca-bb0b-9e016482dfd0 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] 10.222.0.43 "GET /compute/v2.1/servers/09bf867a-5ad2-42cd-bbd5-66e92dc8fff0" status: 200 len: 1355 microversion: 2.1 time: 0.572077 Oct 04 22:06:08.788893 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2259/4589] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:06:08 2022] GET /compute/v2.1/servers/09bf867a-5ad2-42cd-bbd5-66e92dc8fff0 => generated 1355 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:06:08.920572 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-f1360d1f-a671-4418-a338-3bfd9b6be974 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a1c8d841104bc9b6910bcc2c0e2bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe9283584fc4d90b0715216d867ea2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:06:08.932153 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-f1360d1f-a671-4418-a338-3bfd9b6be974 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "GET /compute/v2.1/servers/07967adf-40e2-41e8-97d0-bc9ccf38fb53" status: 200 len: 1499 microversion: 2.1 time: 0.216977 Oct 04 22:06:08.933018 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2331/4590] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:06:08 2022] GET /compute/v2.1/servers/07967adf-40e2-41e8-97d0-bc9ccf38fb53 => generated 1499 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:06:09.519656 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-48b7d755-d1ee-4c05-b205-fcfcd499ca05 req-15d8a36d-3940-4833-ba04-a71384b7de60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09bf867a-5ad2-42cd-bbd5-66e92dc8fff0", "name": "network-vif-plugged", "status": "completed", "tag": "ed0ed48f-26ae-443e-9902-e3c7343a3449"}, {"server_uuid": "09bf867a-5ad2-42cd-bbd5-66e92dc8fff0", "name": "network-vif-plugged", "status": "completed", "tag": "d811dbc1-e714-411f-880d-f883a5ee6676"}, {"server_uuid": "09bf867a-5ad2-42cd-bbd5-66e92dc8fff0", "name": "network-vif-plugged", "status": "completed", "tag": "b2bca8f9-985a-40a5-b364-9714853fc6b3"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:06:09.532990 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-48b7d755-d1ee-4c05-b205-fcfcd499ca05 req-15d8a36d-3940-4833-ba04-a71384b7de60 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:09.533778 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-48b7d755-d1ee-4c05-b205-fcfcd499ca05 req-15d8a36d-3940-4833-ba04-a71384b7de60 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:09.534404 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-48b7d755-d1ee-4c05-b205-fcfcd499ca05 req-15d8a36d-3940-4833-ba04-a71384b7de60 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:09.552402 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-48b7d755-d1ee-4c05-b205-fcfcd499ca05 req-15d8a36d-3940-4833-ba04-a71384b7de60 service nova] Creating event network-vif-plugged:ed0ed48f-26ae-443e-9902-e3c7343a3449 for instance 09bf867a-5ad2-42cd-bbd5-66e92dc8fff0 on n-h2-860284-1 Oct 04 22:06:09.552942 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-48b7d755-d1ee-4c05-b205-fcfcd499ca05 req-15d8a36d-3940-4833-ba04-a71384b7de60 service nova] Creating event network-vif-plugged:d811dbc1-e714-411f-880d-f883a5ee6676 for instance 09bf867a-5ad2-42cd-bbd5-66e92dc8fff0 on n-h2-860284-1 Oct 04 22:06:09.553512 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-48b7d755-d1ee-4c05-b205-fcfcd499ca05 req-15d8a36d-3940-4833-ba04-a71384b7de60 service nova] Creating event network-vif-plugged:b2bca8f9-985a-40a5-b364-9714853fc6b3 for instance 09bf867a-5ad2-42cd-bbd5-66e92dc8fff0 on n-h2-860284-1 Oct 04 22:06:09.559851 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-48b7d755-d1ee-4c05-b205-fcfcd499ca05 req-15d8a36d-3940-4833-ba04-a71384b7de60 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.043775 Oct 04 22:06:09.560486 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2260/4591] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:06:09 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:06:09.745234 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-fcd07e00-c771-4b98-893f-2883d838f13d tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:06:09.746453 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-fcd07e00-c771-4b98-893f-2883d838f13d tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] [instance: 92d3d7e9-8a75-4e07-812c-8b9f441e0376] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:06:09.755500 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fcd07e00-c771-4b98-893f-2883d838f13d tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:09.755988 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fcd07e00-c771-4b98-893f-2883d838f13d tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:09.756432 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fcd07e00-c771-4b98-893f-2883d838f13d tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:09.757135 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fcd07e00-c771-4b98-893f-2883d838f13d tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:09.757615 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fcd07e00-c771-4b98-893f-2883d838f13d tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:09.758015 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fcd07e00-c771-4b98-893f-2883d838f13d tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:09.813131 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e145846c-f950-4219-86f4-a929f2e36a2a tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:06:09.814583 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-e145846c-f950-4219-86f4-a929f2e36a2a tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] [instance: 09bf867a-5ad2-42cd-bbd5-66e92dc8fff0] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:06:09.823359 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e145846c-f950-4219-86f4-a929f2e36a2a tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:09.824276 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e145846c-f950-4219-86f4-a929f2e36a2a tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:09.830783 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e145846c-f950-4219-86f4-a929f2e36a2a tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:09.838131 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e145846c-f950-4219-86f4-a929f2e36a2a tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:09.838718 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e145846c-f950-4219-86f4-a929f2e36a2a tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:09.839199 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e145846c-f950-4219-86f4-a929f2e36a2a tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:10.055879 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-fcd07e00-c771-4b98-893f-2883d838f13d tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e72a1a5d1a4c4b838acb169ab11eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b556e1ace286450f8493715e8317a107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:06:10.069673 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-fcd07e00-c771-4b98-893f-2883d838f13d tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] 10.222.0.43 "GET /compute/v2.1/servers/92d3d7e9-8a75-4e07-812c-8b9f441e0376" status: 200 len: 1508 microversion: 2.1 time: 0.331072 Oct 04 22:06:10.071471 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2332/4592] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:06:09 2022] GET /compute/v2.1/servers/92d3d7e9-8a75-4e07-812c-8b9f441e0376 => generated 1508 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:06:10.077180 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-ba62deca-14e7-4e89-b8f7-867b972f8172 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:06:10.077860 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-ba62deca-14e7-4e89-b8f7-867b972f8172 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: 07967adf-40e2-41e8-97d0-bc9ccf38fb53] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:06:10.081072 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:06:10.089672 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ba62deca-14e7-4e89-b8f7-867b972f8172 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:10.090189 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ba62deca-14e7-4e89-b8f7-867b972f8172 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:10.091070 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ba62deca-14e7-4e89-b8f7-867b972f8172 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:10.091582 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ba62deca-14e7-4e89-b8f7-867b972f8172 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:10.092044 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ba62deca-14e7-4e89-b8f7-867b972f8172 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:10.096531 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ba62deca-14e7-4e89-b8f7-867b972f8172 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:10.245119 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-e145846c-f950-4219-86f4-a929f2e36a2a tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cd0931292c245578bea8861f9ba7607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a555982bb6f841d7a72b6eca84a6150f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:06:10.258833 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-e145846c-f950-4219-86f4-a929f2e36a2a tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] 10.222.0.43 "GET /compute/v2.1/servers/09bf867a-5ad2-42cd-bbd5-66e92dc8fff0" status: 200 len: 1355 microversion: 2.1 time: 0.449010 Oct 04 22:06:10.261184 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2261/4593] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:06:09 2022] GET /compute/v2.1/servers/09bf867a-5ad2-42cd-bbd5-66e92dc8fff0 => generated 1355 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:06:10.269897 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-ba62deca-14e7-4e89-b8f7-867b972f8172 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a1c8d841104bc9b6910bcc2c0e2bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe9283584fc4d90b0715216d867ea2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:06:10.282228 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-a61cbb58-950b-4e20-ad08-7de3e5e14a85 req-c6b6980f-7d5e-44a1-ab98-95fcb8111310 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07967adf-40e2-41e8-97d0-bc9ccf38fb53", "name": "network-vif-deleted", "tag": "4dfcf579-7ad9-44da-b7d9-bf8e382a42f8"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:06:10.288484 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-ba62deca-14e7-4e89-b8f7-867b972f8172 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "GET /compute/v2.1/servers/07967adf-40e2-41e8-97d0-bc9ccf38fb53" status: 200 len: 1457 microversion: 2.1 time: 0.215283 Oct 04 22:06:10.289107 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2333/4594] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:06:10 2022] GET /compute/v2.1/servers/07967adf-40e2-41e8-97d0-bc9ccf38fb53 => generated 1457 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:06:10.303875 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-a61cbb58-950b-4e20-ad08-7de3e5e14a85 req-c6b6980f-7d5e-44a1-ab98-95fcb8111310 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:10.304393 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-a61cbb58-950b-4e20-ad08-7de3e5e14a85 req-c6b6980f-7d5e-44a1-ab98-95fcb8111310 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:10.305424 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-a61cbb58-950b-4e20-ad08-7de3e5e14a85 req-c6b6980f-7d5e-44a1-ab98-95fcb8111310 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:10.321789 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-a61cbb58-950b-4e20-ad08-7de3e5e14a85 req-c6b6980f-7d5e-44a1-ab98-95fcb8111310 service nova] Creating event network-vif-deleted:4dfcf579-7ad9-44da-b7d9-bf8e382a42f8 for instance 07967adf-40e2-41e8-97d0-bc9ccf38fb53 on n-h2-860284-1 Oct 04 22:06:10.328193 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-a61cbb58-950b-4e20-ad08-7de3e5e14a85 req-c6b6980f-7d5e-44a1-ab98-95fcb8111310 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064198 Oct 04 22:06:10.329254 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2262/4595] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:06:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:06:11.288919 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-4811996e-b0e6-4e88-8469-e31bf1cb7339 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:06:11.290178 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-4811996e-b0e6-4e88-8469-e31bf1cb7339 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] [instance: 09bf867a-5ad2-42cd-bbd5-66e92dc8fff0] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:06:11.297574 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4811996e-b0e6-4e88-8469-e31bf1cb7339 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:11.298350 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4811996e-b0e6-4e88-8469-e31bf1cb7339 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:11.299065 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4811996e-b0e6-4e88-8469-e31bf1cb7339 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:11.299986 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4811996e-b0e6-4e88-8469-e31bf1cb7339 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:11.300442 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4811996e-b0e6-4e88-8469-e31bf1cb7339 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:11.301162 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4811996e-b0e6-4e88-8469-e31bf1cb7339 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:11.324124 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-dd4c3852-6e36-4f0e-8e8a-c1af6b3897e9 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:06:11.324855 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-dd4c3852-6e36-4f0e-8e8a-c1af6b3897e9 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: 07967adf-40e2-41e8-97d0-bc9ccf38fb53] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:06:11.342851 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dd4c3852-6e36-4f0e-8e8a-c1af6b3897e9 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:11.343403 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dd4c3852-6e36-4f0e-8e8a-c1af6b3897e9 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:11.344063 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dd4c3852-6e36-4f0e-8e8a-c1af6b3897e9 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:11.345070 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dd4c3852-6e36-4f0e-8e8a-c1af6b3897e9 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:11.345714 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dd4c3852-6e36-4f0e-8e8a-c1af6b3897e9 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:11.346562 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dd4c3852-6e36-4f0e-8e8a-c1af6b3897e9 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:11.392227 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dd4c3852-6e36-4f0e-8e8a-c1af6b3897e9 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:11.392996 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dd4c3852-6e36-4f0e-8e8a-c1af6b3897e9 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:11.393639 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dd4c3852-6e36-4f0e-8e8a-c1af6b3897e9 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:11.394263 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.objects.instance [None req-dd4c3852-6e36-4f0e-8e8a-c1af6b3897e9 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lazy-loading 'fault' on Instance uuid 07967adf-40e2-41e8-97d0-bc9ccf38fb53 {{(pid=134101) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 22:06:11.500015 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-dd4c3852-6e36-4f0e-8e8a-c1af6b3897e9 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a1c8d841104bc9b6910bcc2c0e2bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe9283584fc4d90b0715216d867ea2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:06:11.510670 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-dd4c3852-6e36-4f0e-8e8a-c1af6b3897e9 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "GET /compute/v2.1/servers/07967adf-40e2-41e8-97d0-bc9ccf38fb53" status: 200 len: 1305 microversion: 2.1 time: 0.194401 Oct 04 22:06:11.511371 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2263/4596] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:06:11 2022] GET /compute/v2.1/servers/07967adf-40e2-41e8-97d0-bc9ccf38fb53 => generated 1305 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:06:11.647305 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-4811996e-b0e6-4e88-8469-e31bf1cb7339 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cd0931292c245578bea8861f9ba7607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a555982bb6f841d7a72b6eca84a6150f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:06:11.660153 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-4811996e-b0e6-4e88-8469-e31bf1cb7339 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] 10.222.0.43 "GET /compute/v2.1/servers/09bf867a-5ad2-42cd-bbd5-66e92dc8fff0" status: 200 len: 1355 microversion: 2.1 time: 0.377581 Oct 04 22:06:11.674283 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2334/4597] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:06:11 2022] GET /compute/v2.1/servers/09bf867a-5ad2-42cd-bbd5-66e92dc8fff0 => generated 1355 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:06:12.687548 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-db80586d-dbb5-4fda-90bf-6f40e6ecce16 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:06:12.689198 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-db80586d-dbb5-4fda-90bf-6f40e6ecce16 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] [instance: 09bf867a-5ad2-42cd-bbd5-66e92dc8fff0] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:06:12.711251 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-db80586d-dbb5-4fda-90bf-6f40e6ecce16 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:12.712385 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-db80586d-dbb5-4fda-90bf-6f40e6ecce16 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:12.714984 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-db80586d-dbb5-4fda-90bf-6f40e6ecce16 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:12.716805 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-db80586d-dbb5-4fda-90bf-6f40e6ecce16 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:12.718608 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-db80586d-dbb5-4fda-90bf-6f40e6ecce16 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:12.722314 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-db80586d-dbb5-4fda-90bf-6f40e6ecce16 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:12.965397 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-b770f33e-d2b3-47b8-be7a-563492b5b547 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:06:12.966582 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-b770f33e-d2b3-47b8-be7a-563492b5b547 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: 07967adf-40e2-41e8-97d0-bc9ccf38fb53] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:06:12.978998 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b770f33e-d2b3-47b8-be7a-563492b5b547 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:12.980032 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b770f33e-d2b3-47b8-be7a-563492b5b547 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:12.980791 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b770f33e-d2b3-47b8-be7a-563492b5b547 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:12.982711 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b770f33e-d2b3-47b8-be7a-563492b5b547 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:12.984144 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b770f33e-d2b3-47b8-be7a-563492b5b547 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:12.985294 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b770f33e-d2b3-47b8-be7a-563492b5b547 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:13.015606 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-b770f33e-d2b3-47b8-be7a-563492b5b547 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] HTTP exception thrown: Instance 07967adf-40e2-41e8-97d0-bc9ccf38fb53 could not be found. Oct 04 22:06:13.019833 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-b770f33e-d2b3-47b8-be7a-563492b5b547 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Request method failure captured: Oct 04 22:06:13.019833 n-d-860284-1 devstack@n-api.service[134101]: request: GET /compute/v2.1/servers/07967adf-40e2-41e8-97d0-bc9ccf38fb53 HTTP/1.1 Oct 04 22:06:13.019833 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 22:06:13.019833 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 22:06:13.019833 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 22:06:13.019833 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 22:06:13.019833 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 22:06:13.019833 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 22:06:13.019833 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 22:06:13.019833 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 22:06:13.019833 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPK0nBLOASIAc_jQKg5RCRqB87oRsJiRc3l4etfmNkfSSv1yHGR8RjgOAS-Q4KEeiZVVxJRa8Focu7VoHdbhzgEqV5pocnY2xPPRPWacaT4koizORav87v6vdxgR4HH-PmsbraTS232Q30lW73kM7RH3tINWZChDkcbwtTWeQlIO6TSk Oct 04 22:06:13.019833 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 22:06:13.019833 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 22:06:13.019833 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 22:06:13.019833 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 22:06:13.019833 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 22:06:13.019833 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 22:06:13.019833 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: dfe9283584fc4d90b0715216d867ea2f Oct 04 22:06:13.019833 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-DeleteServersTestJSON-2136146778 Oct 04 22:06:13.019833 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 22:06:13.019833 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 22:06:13.019833 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/dfe9283584fc4d90b0715216d867ea2f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_dfe9283584fc4d90b0715216d867ea2f", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/dfe9283584fc4d90b0715216d867ea2f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/dfe9283584fc4d90b0715216d867ea2f"}]}] Oct 04 22:06:13.019833 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-DeleteServersTestJSON-2136146778 Oct 04 22:06:13.019833 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: dfe9283584fc4d90b0715216d867ea2f Oct 04 22:06:13.019833 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-DeleteServersTestJSON-2136146778 Oct 04 22:06:13.019833 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-DeleteServersTestJSON-2136146778-project Oct 04 22:06:13.019833 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 22:06:13.019833 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 22:06:13.019833 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 41a1c8d841104bc9b6910bcc2c0e2bb1 Oct 04 22:06:13.019833 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-DeleteServersTestJSON-2136146778-project Oct 04 22:06:13.019833 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 22:06:13.019833 n-d-860284-1 devstack@n-api.service[134101]: exception: Instance 07967adf-40e2-41e8-97d0-bc9ccf38fb53 could not be found. Oct 04 22:06:13.019833 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': '07967adf-40e2-41e8-97d0-bc9ccf38fb53'} Oct 04 22:06:13.019833 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:06:13.019833 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:06:13.019833 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:06:13.019833 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:06:13.019833 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:06:13.019833 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:06:13.019833 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:06:13.019833 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:06:13.019833 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:06:13.019833 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:06:13.019833 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 07967adf-40e2-41e8-97d0-bc9ccf38fb53 could not be found. Oct 04 22:06:13.019833 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:06:13.019833 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:06:13.019833 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:06:13.019833 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:06:13.019833 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:06:13.019833 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:06:13.019833 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:06:13.019833 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:06:13.019833 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:06:13.019833 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:06:13.019833 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:06:13.019833 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:06:13.019833 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:06:13.019833 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:06:13.019833 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:06:13.019833 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:06:13.019833 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 07967adf-40e2-41e8-97d0-bc9ccf38fb53 could not be found. Oct 04 22:06:13.019833 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:06:13.019833 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:06:13.019833 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:06:13.029236 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:06:13.029236 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:06:13.029236 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:06:13.029236 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:06:13.029236 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:06:13.029236 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 07967adf-40e2-41e8-97d0-bc9ccf38fb53 could not be found. Oct 04 22:06:13.029236 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:06:13.035462 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-b770f33e-d2b3-47b8-be7a-563492b5b547 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Returning 404 to user: Instance 07967adf-40e2-41e8-97d0-bc9ccf38fb53 could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:06:13.035462 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-b770f33e-d2b3-47b8-be7a-563492b5b547 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "GET /compute/v2.1/servers/07967adf-40e2-41e8-97d0-bc9ccf38fb53" status: 404 len: 111 microversion: 2.1 time: 0.501180 Oct 04 22:06:13.036188 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2264/4598] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:06:12 2022] GET /compute/v2.1/servers/07967adf-40e2-41e8-97d0-bc9ccf38fb53 => generated 111 bytes in 505 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:06:13.056600 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-dcd754fa-2336-4088-a3f4-3c45eb501868 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:06:13.057875 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-dcd754fa-2336-4088-a3f4-3c45eb501868 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: 07967adf-40e2-41e8-97d0-bc9ccf38fb53] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:06:13.074176 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dcd754fa-2336-4088-a3f4-3c45eb501868 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:13.075406 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dcd754fa-2336-4088-a3f4-3c45eb501868 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:13.076380 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dcd754fa-2336-4088-a3f4-3c45eb501868 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:13.077874 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dcd754fa-2336-4088-a3f4-3c45eb501868 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:13.079384 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dcd754fa-2336-4088-a3f4-3c45eb501868 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:13.080382 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dcd754fa-2336-4088-a3f4-3c45eb501868 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:13.144610 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-dcd754fa-2336-4088-a3f4-3c45eb501868 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] HTTP exception thrown: Instance 07967adf-40e2-41e8-97d0-bc9ccf38fb53 could not be found. Oct 04 22:06:13.147427 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-dcd754fa-2336-4088-a3f4-3c45eb501868 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Request method failure captured: Oct 04 22:06:13.147427 n-d-860284-1 devstack@n-api.service[134101]: request: DELETE /compute/v2.1/servers/07967adf-40e2-41e8-97d0-bc9ccf38fb53 HTTP/1.1 Oct 04 22:06:13.147427 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 22:06:13.147427 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 22:06:13.147427 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 22:06:13.147427 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 22:06:13.147427 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 22:06:13.147427 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 22:06:13.147427 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 22:06:13.147427 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 22:06:13.147427 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPK0nBLOASIAc_jQKg5RCRqB87oRsJiRc3l4etfmNkfSSv1yHGR8RjgOAS-Q4KEeiZVVxJRa8Focu7VoHdbhzgEqV5pocnY2xPPRPWacaT4koizORav87v6vdxgR4HH-PmsbraTS232Q30lW73kM7RH3tINWZChDkcbwtTWeQlIO6TSk Oct 04 22:06:13.147427 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 22:06:13.147427 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 22:06:13.147427 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 22:06:13.147427 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 22:06:13.147427 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 22:06:13.147427 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 22:06:13.147427 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: dfe9283584fc4d90b0715216d867ea2f Oct 04 22:06:13.147427 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-DeleteServersTestJSON-2136146778 Oct 04 22:06:13.147427 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 22:06:13.147427 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 22:06:13.147427 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/dfe9283584fc4d90b0715216d867ea2f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_dfe9283584fc4d90b0715216d867ea2f", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/dfe9283584fc4d90b0715216d867ea2f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/dfe9283584fc4d90b0715216d867ea2f"}]}] Oct 04 22:06:13.147427 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-DeleteServersTestJSON-2136146778 Oct 04 22:06:13.147427 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: dfe9283584fc4d90b0715216d867ea2f Oct 04 22:06:13.147427 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-DeleteServersTestJSON-2136146778 Oct 04 22:06:13.147427 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-DeleteServersTestJSON-2136146778-project Oct 04 22:06:13.147427 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 22:06:13.147427 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 22:06:13.147427 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 41a1c8d841104bc9b6910bcc2c0e2bb1 Oct 04 22:06:13.147427 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-DeleteServersTestJSON-2136146778-project Oct 04 22:06:13.147427 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 22:06:13.147427 n-d-860284-1 devstack@n-api.service[134101]: exception: Instance 07967adf-40e2-41e8-97d0-bc9ccf38fb53 could not be found. Oct 04 22:06:13.147427 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': '07967adf-40e2-41e8-97d0-bc9ccf38fb53'} Oct 04 22:06:13.147427 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:06:13.147427 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:06:13.147427 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:06:13.147427 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:06:13.147427 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:06:13.147427 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:06:13.147427 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:06:13.147427 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:06:13.147427 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:06:13.147427 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:06:13.147427 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 07967adf-40e2-41e8-97d0-bc9ccf38fb53 could not be found. Oct 04 22:06:13.147427 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:06:13.147427 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:06:13.147427 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:06:13.147427 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:06:13.147427 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:06:13.147427 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:06:13.147427 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:06:13.147427 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:06:13.147427 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:06:13.147427 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:06:13.147427 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 22:06:13.147427 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 22:06:13.147427 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 22:06:13.147427 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 22:06:13.147427 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:06:13.147427 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:06:13.147427 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:06:13.147427 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:06:13.152029 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 07967adf-40e2-41e8-97d0-bc9ccf38fb53 could not be found. Oct 04 22:06:13.152029 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:06:13.152029 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:06:13.152029 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:06:13.152029 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:06:13.152029 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:06:13.152029 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:06:13.152029 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:06:13.152029 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:06:13.152029 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 07967adf-40e2-41e8-97d0-bc9ccf38fb53 could not be found. Oct 04 22:06:13.152029 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:06:13.152029 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-dcd754fa-2336-4088-a3f4-3c45eb501868 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Returning 404 to user: Instance 07967adf-40e2-41e8-97d0-bc9ccf38fb53 could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:06:13.152899 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-dcd754fa-2336-4088-a3f4-3c45eb501868 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "DELETE /compute/v2.1/servers/07967adf-40e2-41e8-97d0-bc9ccf38fb53" status: 404 len: 111 microversion: 2.1 time: 0.103651 Oct 04 22:06:13.156666 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2265/4599] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 22:06:13 2022] DELETE /compute/v2.1/servers/07967adf-40e2-41e8-97d0-bc9ccf38fb53 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:06:13.163085 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-70c6ffd2-c9d8-4155-b71f-9f3b40fe823f tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:06:13.165230 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-70c6ffd2-c9d8-4155-b71f-9f3b40fe823f tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: 07967adf-40e2-41e8-97d0-bc9ccf38fb53] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:06:13.179637 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-70c6ffd2-c9d8-4155-b71f-9f3b40fe823f tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:13.180549 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-70c6ffd2-c9d8-4155-b71f-9f3b40fe823f tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:13.185114 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-70c6ffd2-c9d8-4155-b71f-9f3b40fe823f tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:13.186348 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-70c6ffd2-c9d8-4155-b71f-9f3b40fe823f tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:13.197354 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-70c6ffd2-c9d8-4155-b71f-9f3b40fe823f tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:13.198146 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-70c6ffd2-c9d8-4155-b71f-9f3b40fe823f tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:13.252249 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-70c6ffd2-c9d8-4155-b71f-9f3b40fe823f tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] HTTP exception thrown: Instance 07967adf-40e2-41e8-97d0-bc9ccf38fb53 could not be found. Oct 04 22:06:13.253871 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-70c6ffd2-c9d8-4155-b71f-9f3b40fe823f tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Request method failure captured: Oct 04 22:06:13.253871 n-d-860284-1 devstack@n-api.service[134101]: request: GET /compute/v2.1/servers/07967adf-40e2-41e8-97d0-bc9ccf38fb53 HTTP/1.1 Oct 04 22:06:13.253871 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 22:06:13.253871 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 22:06:13.253871 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 22:06:13.253871 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 22:06:13.253871 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 22:06:13.253871 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 22:06:13.253871 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 22:06:13.253871 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 22:06:13.253871 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPK0nBLOASIAc_jQKg5RCRqB87oRsJiRc3l4etfmNkfSSv1yHGR8RjgOAS-Q4KEeiZVVxJRa8Focu7VoHdbhzgEqV5pocnY2xPPRPWacaT4koizORav87v6vdxgR4HH-PmsbraTS232Q30lW73kM7RH3tINWZChDkcbwtTWeQlIO6TSk Oct 04 22:06:13.253871 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 22:06:13.253871 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 22:06:13.253871 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 22:06:13.253871 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 22:06:13.253871 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 22:06:13.253871 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 22:06:13.253871 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: dfe9283584fc4d90b0715216d867ea2f Oct 04 22:06:13.253871 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-DeleteServersTestJSON-2136146778 Oct 04 22:06:13.253871 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 22:06:13.253871 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 22:06:13.253871 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/dfe9283584fc4d90b0715216d867ea2f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_dfe9283584fc4d90b0715216d867ea2f", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/dfe9283584fc4d90b0715216d867ea2f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/dfe9283584fc4d90b0715216d867ea2f"}]}] Oct 04 22:06:13.253871 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-DeleteServersTestJSON-2136146778 Oct 04 22:06:13.253871 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: dfe9283584fc4d90b0715216d867ea2f Oct 04 22:06:13.253871 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-DeleteServersTestJSON-2136146778 Oct 04 22:06:13.253871 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-DeleteServersTestJSON-2136146778-project Oct 04 22:06:13.253871 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 22:06:13.253871 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 22:06:13.253871 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 41a1c8d841104bc9b6910bcc2c0e2bb1 Oct 04 22:06:13.253871 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-DeleteServersTestJSON-2136146778-project Oct 04 22:06:13.253871 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 22:06:13.253871 n-d-860284-1 devstack@n-api.service[134101]: exception: Instance 07967adf-40e2-41e8-97d0-bc9ccf38fb53 could not be found. Oct 04 22:06:13.253871 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': '07967adf-40e2-41e8-97d0-bc9ccf38fb53'} Oct 04 22:06:13.253871 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:06:13.253871 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:06:13.253871 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:06:13.253871 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:06:13.253871 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:06:13.253871 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:06:13.253871 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:06:13.253871 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:06:13.253871 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:06:13.253871 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:06:13.253871 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 07967adf-40e2-41e8-97d0-bc9ccf38fb53 could not be found. Oct 04 22:06:13.253871 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:06:13.253871 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:06:13.253871 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:06:13.253871 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:06:13.253871 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:06:13.253871 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:06:13.253871 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:06:13.253871 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:06:13.253871 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:06:13.253871 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:06:13.253871 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:06:13.253871 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:06:13.253871 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:06:13.253871 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:06:13.253871 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:06:13.253871 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:06:13.253871 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 07967adf-40e2-41e8-97d0-bc9ccf38fb53 could not be found. Oct 04 22:06:13.253871 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:06:13.253871 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:06:13.253871 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:06:13.270822 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:06:13.270822 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:06:13.270822 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:06:13.270822 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:06:13.270822 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:06:13.270822 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 07967adf-40e2-41e8-97d0-bc9ccf38fb53 could not be found. Oct 04 22:06:13.270822 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:06:13.270822 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-70c6ffd2-c9d8-4155-b71f-9f3b40fe823f tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Returning 404 to user: Instance 07967adf-40e2-41e8-97d0-bc9ccf38fb53 could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:06:13.270822 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-70c6ffd2-c9d8-4155-b71f-9f3b40fe823f tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "GET /compute/v2.1/servers/07967adf-40e2-41e8-97d0-bc9ccf38fb53" status: 404 len: 111 microversion: 2.1 time: 0.100494 Oct 04 22:06:13.270822 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2266/4600] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:06:13 2022] GET /compute/v2.1/servers/07967adf-40e2-41e8-97d0-bc9ccf38fb53 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 22:06:13.274506 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-01469c9c-3fe7-470f-b776-135e7c379af1 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:06:13.274506 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-01469c9c-3fe7-470f-b776-135e7c379af1 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: f45bd103-0f2f-4eb0-83f9-a084adb03d18] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:06:13.281003 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-01469c9c-3fe7-470f-b776-135e7c379af1 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:13.281511 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-01469c9c-3fe7-470f-b776-135e7c379af1 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:13.281953 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-01469c9c-3fe7-470f-b776-135e7c379af1 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:13.283697 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-01469c9c-3fe7-470f-b776-135e7c379af1 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:13.284178 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-01469c9c-3fe7-470f-b776-135e7c379af1 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:13.284612 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-01469c9c-3fe7-470f-b776-135e7c379af1 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:13.303214 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-01469c9c-3fe7-470f-b776-135e7c379af1 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] HTTP exception thrown: Instance f45bd103-0f2f-4eb0-83f9-a084adb03d18 could not be found. Oct 04 22:06:13.304795 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-01469c9c-3fe7-470f-b776-135e7c379af1 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Request method failure captured: Oct 04 22:06:13.304795 n-d-860284-1 devstack@n-api.service[134101]: request: DELETE /compute/v2.1/servers/f45bd103-0f2f-4eb0-83f9-a084adb03d18 HTTP/1.1 Oct 04 22:06:13.304795 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 22:06:13.304795 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 22:06:13.304795 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 22:06:13.304795 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 22:06:13.304795 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 22:06:13.304795 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 22:06:13.304795 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 22:06:13.304795 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 22:06:13.304795 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPK0nBLOASIAc_jQKg5RCRqB87oRsJiRc3l4etfmNkfSSv1yHGR8RjgOAS-Q4KEeiZVVxJRa8Focu7VoHdbhzgEqV5pocnY2xPPRPWacaT4koizORav87v6vdxgR4HH-PmsbraTS232Q30lW73kM7RH3tINWZChDkcbwtTWeQlIO6TSk Oct 04 22:06:13.304795 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 22:06:13.304795 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 22:06:13.304795 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 22:06:13.304795 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 22:06:13.304795 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 22:06:13.304795 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 22:06:13.304795 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: dfe9283584fc4d90b0715216d867ea2f Oct 04 22:06:13.304795 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-DeleteServersTestJSON-2136146778 Oct 04 22:06:13.304795 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 22:06:13.304795 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 22:06:13.304795 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/dfe9283584fc4d90b0715216d867ea2f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_dfe9283584fc4d90b0715216d867ea2f", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/dfe9283584fc4d90b0715216d867ea2f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/dfe9283584fc4d90b0715216d867ea2f"}]}] Oct 04 22:06:13.304795 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-DeleteServersTestJSON-2136146778 Oct 04 22:06:13.304795 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: dfe9283584fc4d90b0715216d867ea2f Oct 04 22:06:13.304795 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-DeleteServersTestJSON-2136146778 Oct 04 22:06:13.304795 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-DeleteServersTestJSON-2136146778-project Oct 04 22:06:13.304795 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 22:06:13.304795 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 22:06:13.304795 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 41a1c8d841104bc9b6910bcc2c0e2bb1 Oct 04 22:06:13.304795 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-DeleteServersTestJSON-2136146778-project Oct 04 22:06:13.304795 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 22:06:13.304795 n-d-860284-1 devstack@n-api.service[134101]: exception: Instance f45bd103-0f2f-4eb0-83f9-a084adb03d18 could not be found. Oct 04 22:06:13.304795 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': 'f45bd103-0f2f-4eb0-83f9-a084adb03d18'} Oct 04 22:06:13.304795 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:06:13.304795 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:06:13.304795 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:06:13.304795 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:06:13.304795 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:06:13.304795 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:06:13.304795 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:06:13.304795 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:06:13.304795 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:06:13.304795 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:06:13.304795 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f45bd103-0f2f-4eb0-83f9-a084adb03d18 could not be found. Oct 04 22:06:13.304795 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:06:13.304795 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:06:13.304795 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:06:13.304795 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:06:13.304795 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:06:13.304795 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:06:13.304795 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:06:13.304795 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:06:13.304795 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:06:13.304795 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:06:13.304795 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 22:06:13.304795 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 22:06:13.304795 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 22:06:13.304795 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 22:06:13.304795 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:06:13.304795 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:06:13.304795 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:06:13.304795 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:06:13.314632 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f45bd103-0f2f-4eb0-83f9-a084adb03d18 could not be found. Oct 04 22:06:13.314632 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:06:13.314632 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:06:13.314632 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:06:13.314632 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:06:13.314632 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:06:13.314632 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:06:13.314632 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:06:13.314632 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:06:13.314632 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f45bd103-0f2f-4eb0-83f9-a084adb03d18 could not be found. Oct 04 22:06:13.314632 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:06:13.314632 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-01469c9c-3fe7-470f-b776-135e7c379af1 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Returning 404 to user: Instance f45bd103-0f2f-4eb0-83f9-a084adb03d18 could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:06:13.314632 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-01469c9c-3fe7-470f-b776-135e7c379af1 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "DELETE /compute/v2.1/servers/f45bd103-0f2f-4eb0-83f9-a084adb03d18" status: 404 len: 111 microversion: 2.1 time: 0.039797 Oct 04 22:06:13.314632 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2267/4601] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 22:06:13 2022] DELETE /compute/v2.1/servers/f45bd103-0f2f-4eb0-83f9-a084adb03d18 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:06:13.320353 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e6646979-cc32-4d01-9d52-d0acc4a2c72b tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:06:13.320353 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-e6646979-cc32-4d01-9d52-d0acc4a2c72b tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: f45bd103-0f2f-4eb0-83f9-a084adb03d18] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:06:13.325229 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e6646979-cc32-4d01-9d52-d0acc4a2c72b tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:13.325738 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e6646979-cc32-4d01-9d52-d0acc4a2c72b tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:13.326183 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e6646979-cc32-4d01-9d52-d0acc4a2c72b tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:13.326938 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e6646979-cc32-4d01-9d52-d0acc4a2c72b tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:13.327395 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e6646979-cc32-4d01-9d52-d0acc4a2c72b tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:13.327822 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e6646979-cc32-4d01-9d52-d0acc4a2c72b tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:13.364826 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-e6646979-cc32-4d01-9d52-d0acc4a2c72b tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] HTTP exception thrown: Instance f45bd103-0f2f-4eb0-83f9-a084adb03d18 could not be found. Oct 04 22:06:13.368919 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e6646979-cc32-4d01-9d52-d0acc4a2c72b tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Request method failure captured: Oct 04 22:06:13.368919 n-d-860284-1 devstack@n-api.service[134101]: request: GET /compute/v2.1/servers/f45bd103-0f2f-4eb0-83f9-a084adb03d18 HTTP/1.1 Oct 04 22:06:13.368919 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 22:06:13.368919 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 22:06:13.368919 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 22:06:13.368919 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 22:06:13.368919 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 22:06:13.368919 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 22:06:13.368919 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 22:06:13.368919 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 22:06:13.368919 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPK0nBLOASIAc_jQKg5RCRqB87oRsJiRc3l4etfmNkfSSv1yHGR8RjgOAS-Q4KEeiZVVxJRa8Focu7VoHdbhzgEqV5pocnY2xPPRPWacaT4koizORav87v6vdxgR4HH-PmsbraTS232Q30lW73kM7RH3tINWZChDkcbwtTWeQlIO6TSk Oct 04 22:06:13.368919 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 22:06:13.368919 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 22:06:13.368919 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 22:06:13.368919 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 22:06:13.368919 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 22:06:13.368919 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 22:06:13.368919 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: dfe9283584fc4d90b0715216d867ea2f Oct 04 22:06:13.368919 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-DeleteServersTestJSON-2136146778 Oct 04 22:06:13.368919 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 22:06:13.368919 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 22:06:13.368919 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/dfe9283584fc4d90b0715216d867ea2f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_dfe9283584fc4d90b0715216d867ea2f", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/dfe9283584fc4d90b0715216d867ea2f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/dfe9283584fc4d90b0715216d867ea2f"}]}] Oct 04 22:06:13.368919 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-DeleteServersTestJSON-2136146778 Oct 04 22:06:13.368919 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: dfe9283584fc4d90b0715216d867ea2f Oct 04 22:06:13.368919 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-DeleteServersTestJSON-2136146778 Oct 04 22:06:13.368919 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-DeleteServersTestJSON-2136146778-project Oct 04 22:06:13.368919 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 22:06:13.368919 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 22:06:13.368919 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 41a1c8d841104bc9b6910bcc2c0e2bb1 Oct 04 22:06:13.368919 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-DeleteServersTestJSON-2136146778-project Oct 04 22:06:13.368919 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 22:06:13.368919 n-d-860284-1 devstack@n-api.service[134101]: exception: Instance f45bd103-0f2f-4eb0-83f9-a084adb03d18 could not be found. Oct 04 22:06:13.368919 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': 'f45bd103-0f2f-4eb0-83f9-a084adb03d18'} Oct 04 22:06:13.368919 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:06:13.368919 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:06:13.368919 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:06:13.368919 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:06:13.368919 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:06:13.368919 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:06:13.368919 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:06:13.368919 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:06:13.368919 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:06:13.368919 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:06:13.368919 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f45bd103-0f2f-4eb0-83f9-a084adb03d18 could not be found. Oct 04 22:06:13.368919 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:06:13.368919 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:06:13.368919 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:06:13.368919 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:06:13.368919 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:06:13.368919 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:06:13.368919 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:06:13.368919 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:06:13.368919 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:06:13.368919 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:06:13.368919 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:06:13.368919 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:06:13.368919 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:06:13.368919 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:06:13.368919 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:06:13.368919 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:06:13.368919 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f45bd103-0f2f-4eb0-83f9-a084adb03d18 could not be found. Oct 04 22:06:13.368919 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:06:13.368919 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:06:13.368919 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:06:13.379422 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:06:13.379422 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:06:13.379422 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:06:13.379422 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:06:13.379422 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:06:13.379422 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f45bd103-0f2f-4eb0-83f9-a084adb03d18 could not be found. Oct 04 22:06:13.379422 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:06:13.379422 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e6646979-cc32-4d01-9d52-d0acc4a2c72b tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Returning 404 to user: Instance f45bd103-0f2f-4eb0-83f9-a084adb03d18 could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:06:13.379422 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-e6646979-cc32-4d01-9d52-d0acc4a2c72b tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "GET /compute/v2.1/servers/f45bd103-0f2f-4eb0-83f9-a084adb03d18" status: 404 len: 111 microversion: 2.1 time: 0.058723 Oct 04 22:06:13.379422 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2268/4602] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:06:13 2022] GET /compute/v2.1/servers/f45bd103-0f2f-4eb0-83f9-a084adb03d18 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:06:13.400772 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-b0d55d6e-9763-423f-a2c6-7f9aa01c1391 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:06:13.407171 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-b0d55d6e-9763-423f-a2c6-7f9aa01c1391 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: e5842070-d5a3-43f9-82f8-ebce4eaf5526] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:06:13.415535 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b0d55d6e-9763-423f-a2c6-7f9aa01c1391 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:13.416298 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b0d55d6e-9763-423f-a2c6-7f9aa01c1391 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:13.417126 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b0d55d6e-9763-423f-a2c6-7f9aa01c1391 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:13.417922 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b0d55d6e-9763-423f-a2c6-7f9aa01c1391 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:13.418425 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b0d55d6e-9763-423f-a2c6-7f9aa01c1391 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:13.418922 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b0d55d6e-9763-423f-a2c6-7f9aa01c1391 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:13.439413 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-b0d55d6e-9763-423f-a2c6-7f9aa01c1391 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] HTTP exception thrown: Instance e5842070-d5a3-43f9-82f8-ebce4eaf5526 could not be found. Oct 04 22:06:13.441017 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-b0d55d6e-9763-423f-a2c6-7f9aa01c1391 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Request method failure captured: Oct 04 22:06:13.441017 n-d-860284-1 devstack@n-api.service[134101]: request: DELETE /compute/v2.1/servers/e5842070-d5a3-43f9-82f8-ebce4eaf5526 HTTP/1.1 Oct 04 22:06:13.441017 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 22:06:13.441017 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 22:06:13.441017 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 22:06:13.441017 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 22:06:13.441017 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 22:06:13.441017 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 22:06:13.441017 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 22:06:13.441017 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 22:06:13.441017 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPK0nBLOASIAc_jQKg5RCRqB87oRsJiRc3l4etfmNkfSSv1yHGR8RjgOAS-Q4KEeiZVVxJRa8Focu7VoHdbhzgEqV5pocnY2xPPRPWacaT4koizORav87v6vdxgR4HH-PmsbraTS232Q30lW73kM7RH3tINWZChDkcbwtTWeQlIO6TSk Oct 04 22:06:13.441017 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 22:06:13.441017 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 22:06:13.441017 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 22:06:13.441017 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 22:06:13.441017 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 22:06:13.441017 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 22:06:13.441017 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: dfe9283584fc4d90b0715216d867ea2f Oct 04 22:06:13.441017 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-DeleteServersTestJSON-2136146778 Oct 04 22:06:13.441017 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 22:06:13.441017 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 22:06:13.441017 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/dfe9283584fc4d90b0715216d867ea2f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_dfe9283584fc4d90b0715216d867ea2f", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/dfe9283584fc4d90b0715216d867ea2f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/dfe9283584fc4d90b0715216d867ea2f"}]}] Oct 04 22:06:13.441017 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-DeleteServersTestJSON-2136146778 Oct 04 22:06:13.441017 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: dfe9283584fc4d90b0715216d867ea2f Oct 04 22:06:13.441017 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-DeleteServersTestJSON-2136146778 Oct 04 22:06:13.441017 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-DeleteServersTestJSON-2136146778-project Oct 04 22:06:13.441017 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 22:06:13.441017 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 22:06:13.441017 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 41a1c8d841104bc9b6910bcc2c0e2bb1 Oct 04 22:06:13.441017 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-DeleteServersTestJSON-2136146778-project Oct 04 22:06:13.441017 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 22:06:13.441017 n-d-860284-1 devstack@n-api.service[134101]: exception: Instance e5842070-d5a3-43f9-82f8-ebce4eaf5526 could not be found. Oct 04 22:06:13.441017 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': 'e5842070-d5a3-43f9-82f8-ebce4eaf5526'} Oct 04 22:06:13.441017 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:06:13.441017 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:06:13.441017 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:06:13.441017 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:06:13.441017 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:06:13.441017 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:06:13.441017 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:06:13.441017 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:06:13.441017 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:06:13.441017 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:06:13.441017 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5842070-d5a3-43f9-82f8-ebce4eaf5526 could not be found. Oct 04 22:06:13.441017 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:06:13.441017 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:06:13.441017 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:06:13.441017 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:06:13.441017 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:06:13.441017 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:06:13.441017 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:06:13.441017 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:06:13.441017 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:06:13.441017 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:06:13.441017 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 22:06:13.441017 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 22:06:13.441017 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 22:06:13.441017 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 22:06:13.441017 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:06:13.441017 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:06:13.441017 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:06:13.441017 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:06:13.453991 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5842070-d5a3-43f9-82f8-ebce4eaf5526 could not be found. Oct 04 22:06:13.453991 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:06:13.453991 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:06:13.453991 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:06:13.453991 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:06:13.453991 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:06:13.453991 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:06:13.453991 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:06:13.453991 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:06:13.453991 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5842070-d5a3-43f9-82f8-ebce4eaf5526 could not be found. Oct 04 22:06:13.453991 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:06:13.453991 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-b0d55d6e-9763-423f-a2c6-7f9aa01c1391 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Returning 404 to user: Instance e5842070-d5a3-43f9-82f8-ebce4eaf5526 could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:06:13.453991 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-b0d55d6e-9763-423f-a2c6-7f9aa01c1391 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "DELETE /compute/v2.1/servers/e5842070-d5a3-43f9-82f8-ebce4eaf5526" status: 404 len: 111 microversion: 2.1 time: 0.064370 Oct 04 22:06:13.453991 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2269/4603] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 22:06:13 2022] DELETE /compute/v2.1/servers/e5842070-d5a3-43f9-82f8-ebce4eaf5526 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:06:13.457136 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-398164ac-c876-42b3-82c7-bd782c309ae7 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:06:13.457136 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-398164ac-c876-42b3-82c7-bd782c309ae7 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: e5842070-d5a3-43f9-82f8-ebce4eaf5526] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:06:13.465324 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-398164ac-c876-42b3-82c7-bd782c309ae7 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:13.465843 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-398164ac-c876-42b3-82c7-bd782c309ae7 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:13.466298 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-398164ac-c876-42b3-82c7-bd782c309ae7 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:13.467127 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-398164ac-c876-42b3-82c7-bd782c309ae7 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:13.467596 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-398164ac-c876-42b3-82c7-bd782c309ae7 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:13.468659 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-398164ac-c876-42b3-82c7-bd782c309ae7 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:13.492745 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-398164ac-c876-42b3-82c7-bd782c309ae7 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] HTTP exception thrown: Instance e5842070-d5a3-43f9-82f8-ebce4eaf5526 could not be found. Oct 04 22:06:13.494347 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-398164ac-c876-42b3-82c7-bd782c309ae7 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Request method failure captured: Oct 04 22:06:13.494347 n-d-860284-1 devstack@n-api.service[134101]: request: GET /compute/v2.1/servers/e5842070-d5a3-43f9-82f8-ebce4eaf5526 HTTP/1.1 Oct 04 22:06:13.494347 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 22:06:13.494347 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 22:06:13.494347 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 22:06:13.494347 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 22:06:13.494347 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 22:06:13.494347 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 22:06:13.494347 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 22:06:13.494347 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 22:06:13.494347 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPK0nBLOASIAc_jQKg5RCRqB87oRsJiRc3l4etfmNkfSSv1yHGR8RjgOAS-Q4KEeiZVVxJRa8Focu7VoHdbhzgEqV5pocnY2xPPRPWacaT4koizORav87v6vdxgR4HH-PmsbraTS232Q30lW73kM7RH3tINWZChDkcbwtTWeQlIO6TSk Oct 04 22:06:13.494347 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 22:06:13.494347 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 22:06:13.494347 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 22:06:13.494347 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 22:06:13.494347 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 22:06:13.494347 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 22:06:13.494347 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: dfe9283584fc4d90b0715216d867ea2f Oct 04 22:06:13.494347 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-DeleteServersTestJSON-2136146778 Oct 04 22:06:13.494347 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 22:06:13.494347 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 22:06:13.494347 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/dfe9283584fc4d90b0715216d867ea2f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_dfe9283584fc4d90b0715216d867ea2f", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/dfe9283584fc4d90b0715216d867ea2f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/dfe9283584fc4d90b0715216d867ea2f"}]}] Oct 04 22:06:13.494347 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-DeleteServersTestJSON-2136146778 Oct 04 22:06:13.494347 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: dfe9283584fc4d90b0715216d867ea2f Oct 04 22:06:13.494347 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-DeleteServersTestJSON-2136146778 Oct 04 22:06:13.494347 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-DeleteServersTestJSON-2136146778-project Oct 04 22:06:13.494347 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 22:06:13.494347 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 22:06:13.494347 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 41a1c8d841104bc9b6910bcc2c0e2bb1 Oct 04 22:06:13.494347 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-DeleteServersTestJSON-2136146778-project Oct 04 22:06:13.494347 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 22:06:13.494347 n-d-860284-1 devstack@n-api.service[134101]: exception: Instance e5842070-d5a3-43f9-82f8-ebce4eaf5526 could not be found. Oct 04 22:06:13.494347 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': 'e5842070-d5a3-43f9-82f8-ebce4eaf5526'} Oct 04 22:06:13.494347 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:06:13.494347 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:06:13.494347 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:06:13.494347 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:06:13.494347 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:06:13.494347 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:06:13.494347 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:06:13.494347 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:06:13.494347 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:06:13.494347 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:06:13.494347 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5842070-d5a3-43f9-82f8-ebce4eaf5526 could not be found. Oct 04 22:06:13.494347 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:06:13.494347 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:06:13.494347 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:06:13.494347 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:06:13.494347 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:06:13.494347 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:06:13.494347 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:06:13.494347 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:06:13.494347 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:06:13.494347 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:06:13.494347 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:06:13.494347 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:06:13.494347 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:06:13.494347 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:06:13.494347 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:06:13.494347 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:06:13.494347 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5842070-d5a3-43f9-82f8-ebce4eaf5526 could not be found. Oct 04 22:06:13.494347 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:06:13.494347 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:06:13.494347 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:06:13.502612 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:06:13.502612 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:06:13.502612 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:06:13.502612 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:06:13.502612 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:06:13.502612 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5842070-d5a3-43f9-82f8-ebce4eaf5526 could not be found. Oct 04 22:06:13.502612 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:06:13.502612 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-398164ac-c876-42b3-82c7-bd782c309ae7 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Returning 404 to user: Instance e5842070-d5a3-43f9-82f8-ebce4eaf5526 could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:06:13.502612 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-398164ac-c876-42b3-82c7-bd782c309ae7 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "GET /compute/v2.1/servers/e5842070-d5a3-43f9-82f8-ebce4eaf5526" status: 404 len: 111 microversion: 2.1 time: 0.045672 Oct 04 22:06:13.502612 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2270/4604] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:06:13 2022] GET /compute/v2.1/servers/e5842070-d5a3-43f9-82f8-ebce4eaf5526 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:06:13.507559 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-ca717e33-399d-4243-bd5d-2bb39fac9c00 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:06:13.507559 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-ca717e33-399d-4243-bd5d-2bb39fac9c00 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: 64d56eab-65de-4951-adf0-891f8a39383f] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:06:13.515008 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ca717e33-399d-4243-bd5d-2bb39fac9c00 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:13.515462 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ca717e33-399d-4243-bd5d-2bb39fac9c00 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:13.515925 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ca717e33-399d-4243-bd5d-2bb39fac9c00 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:13.516682 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ca717e33-399d-4243-bd5d-2bb39fac9c00 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:13.518409 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ca717e33-399d-4243-bd5d-2bb39fac9c00 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:13.518918 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ca717e33-399d-4243-bd5d-2bb39fac9c00 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:13.542704 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-ca717e33-399d-4243-bd5d-2bb39fac9c00 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] HTTP exception thrown: Instance 64d56eab-65de-4951-adf0-891f8a39383f could not be found. Oct 04 22:06:13.545489 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-ca717e33-399d-4243-bd5d-2bb39fac9c00 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Request method failure captured: Oct 04 22:06:13.545489 n-d-860284-1 devstack@n-api.service[134101]: request: DELETE /compute/v2.1/servers/64d56eab-65de-4951-adf0-891f8a39383f HTTP/1.1 Oct 04 22:06:13.545489 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 22:06:13.545489 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 22:06:13.545489 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 22:06:13.545489 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 22:06:13.545489 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 22:06:13.545489 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 22:06:13.545489 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 22:06:13.545489 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 22:06:13.545489 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPK0nBLOASIAc_jQKg5RCRqB87oRsJiRc3l4etfmNkfSSv1yHGR8RjgOAS-Q4KEeiZVVxJRa8Focu7VoHdbhzgEqV5pocnY2xPPRPWacaT4koizORav87v6vdxgR4HH-PmsbraTS232Q30lW73kM7RH3tINWZChDkcbwtTWeQlIO6TSk Oct 04 22:06:13.545489 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 22:06:13.545489 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 22:06:13.545489 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 22:06:13.545489 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 22:06:13.545489 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 22:06:13.545489 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 22:06:13.545489 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: dfe9283584fc4d90b0715216d867ea2f Oct 04 22:06:13.545489 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-DeleteServersTestJSON-2136146778 Oct 04 22:06:13.545489 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 22:06:13.545489 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 22:06:13.545489 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/dfe9283584fc4d90b0715216d867ea2f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_dfe9283584fc4d90b0715216d867ea2f", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/dfe9283584fc4d90b0715216d867ea2f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/dfe9283584fc4d90b0715216d867ea2f"}]}] Oct 04 22:06:13.545489 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-DeleteServersTestJSON-2136146778 Oct 04 22:06:13.545489 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: dfe9283584fc4d90b0715216d867ea2f Oct 04 22:06:13.545489 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-DeleteServersTestJSON-2136146778 Oct 04 22:06:13.545489 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-DeleteServersTestJSON-2136146778-project Oct 04 22:06:13.545489 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 22:06:13.545489 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 22:06:13.545489 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 41a1c8d841104bc9b6910bcc2c0e2bb1 Oct 04 22:06:13.545489 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-DeleteServersTestJSON-2136146778-project Oct 04 22:06:13.545489 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 22:06:13.545489 n-d-860284-1 devstack@n-api.service[134101]: exception: Instance 64d56eab-65de-4951-adf0-891f8a39383f could not be found. Oct 04 22:06:13.545489 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': '64d56eab-65de-4951-adf0-891f8a39383f'} Oct 04 22:06:13.545489 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:06:13.545489 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:06:13.545489 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:06:13.545489 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:06:13.545489 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:06:13.545489 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:06:13.545489 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:06:13.545489 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:06:13.545489 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:06:13.545489 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:06:13.545489 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64d56eab-65de-4951-adf0-891f8a39383f could not be found. Oct 04 22:06:13.545489 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:06:13.545489 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:06:13.545489 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:06:13.545489 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:06:13.545489 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:06:13.545489 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:06:13.545489 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:06:13.545489 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:06:13.545489 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:06:13.545489 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:06:13.545489 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 22:06:13.545489 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 22:06:13.545489 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 22:06:13.545489 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 22:06:13.545489 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:06:13.545489 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:06:13.545489 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:06:13.545489 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:06:13.552668 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64d56eab-65de-4951-adf0-891f8a39383f could not be found. Oct 04 22:06:13.552668 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:06:13.552668 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:06:13.552668 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:06:13.552668 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:06:13.552668 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:06:13.552668 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:06:13.552668 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:06:13.552668 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:06:13.552668 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64d56eab-65de-4951-adf0-891f8a39383f could not be found. Oct 04 22:06:13.552668 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:06:13.552668 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-ca717e33-399d-4243-bd5d-2bb39fac9c00 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Returning 404 to user: Instance 64d56eab-65de-4951-adf0-891f8a39383f could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:06:13.552668 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-ca717e33-399d-4243-bd5d-2bb39fac9c00 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "DELETE /compute/v2.1/servers/64d56eab-65de-4951-adf0-891f8a39383f" status: 404 len: 111 microversion: 2.1 time: 0.044796 Oct 04 22:06:13.552668 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2271/4605] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 22:06:13 2022] DELETE /compute/v2.1/servers/64d56eab-65de-4951-adf0-891f8a39383f => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:06:13.559306 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-56bb100f-20ec-4aff-b0cf-0e73246077c8 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:06:13.560665 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-56bb100f-20ec-4aff-b0cf-0e73246077c8 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: 64d56eab-65de-4951-adf0-891f8a39383f] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:06:13.570997 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-56bb100f-20ec-4aff-b0cf-0e73246077c8 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:13.572023 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-56bb100f-20ec-4aff-b0cf-0e73246077c8 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:13.572940 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-56bb100f-20ec-4aff-b0cf-0e73246077c8 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:13.573904 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-56bb100f-20ec-4aff-b0cf-0e73246077c8 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:13.574718 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-56bb100f-20ec-4aff-b0cf-0e73246077c8 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:13.575552 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-56bb100f-20ec-4aff-b0cf-0e73246077c8 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:13.599314 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-56bb100f-20ec-4aff-b0cf-0e73246077c8 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] HTTP exception thrown: Instance 64d56eab-65de-4951-adf0-891f8a39383f could not be found. Oct 04 22:06:13.600893 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-56bb100f-20ec-4aff-b0cf-0e73246077c8 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Request method failure captured: Oct 04 22:06:13.600893 n-d-860284-1 devstack@n-api.service[134101]: request: GET /compute/v2.1/servers/64d56eab-65de-4951-adf0-891f8a39383f HTTP/1.1 Oct 04 22:06:13.600893 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 22:06:13.600893 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 22:06:13.600893 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 22:06:13.600893 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 22:06:13.600893 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 22:06:13.600893 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 22:06:13.600893 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 22:06:13.600893 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 22:06:13.600893 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPK0nBLOASIAc_jQKg5RCRqB87oRsJiRc3l4etfmNkfSSv1yHGR8RjgOAS-Q4KEeiZVVxJRa8Focu7VoHdbhzgEqV5pocnY2xPPRPWacaT4koizORav87v6vdxgR4HH-PmsbraTS232Q30lW73kM7RH3tINWZChDkcbwtTWeQlIO6TSk Oct 04 22:06:13.600893 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 22:06:13.600893 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 22:06:13.600893 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 22:06:13.600893 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 22:06:13.600893 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 22:06:13.600893 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 22:06:13.600893 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: dfe9283584fc4d90b0715216d867ea2f Oct 04 22:06:13.600893 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-DeleteServersTestJSON-2136146778 Oct 04 22:06:13.600893 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 22:06:13.600893 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 22:06:13.600893 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/dfe9283584fc4d90b0715216d867ea2f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_dfe9283584fc4d90b0715216d867ea2f", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/dfe9283584fc4d90b0715216d867ea2f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/dfe9283584fc4d90b0715216d867ea2f"}]}] Oct 04 22:06:13.600893 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-DeleteServersTestJSON-2136146778 Oct 04 22:06:13.600893 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: dfe9283584fc4d90b0715216d867ea2f Oct 04 22:06:13.600893 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-DeleteServersTestJSON-2136146778 Oct 04 22:06:13.600893 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-DeleteServersTestJSON-2136146778-project Oct 04 22:06:13.600893 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 22:06:13.600893 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 22:06:13.600893 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 41a1c8d841104bc9b6910bcc2c0e2bb1 Oct 04 22:06:13.600893 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-DeleteServersTestJSON-2136146778-project Oct 04 22:06:13.600893 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 22:06:13.600893 n-d-860284-1 devstack@n-api.service[134101]: exception: Instance 64d56eab-65de-4951-adf0-891f8a39383f could not be found. Oct 04 22:06:13.600893 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': '64d56eab-65de-4951-adf0-891f8a39383f'} Oct 04 22:06:13.600893 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:06:13.600893 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:06:13.600893 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:06:13.600893 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:06:13.600893 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:06:13.600893 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:06:13.600893 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:06:13.600893 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:06:13.600893 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:06:13.600893 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:06:13.600893 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64d56eab-65de-4951-adf0-891f8a39383f could not be found. Oct 04 22:06:13.600893 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:06:13.600893 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:06:13.600893 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:06:13.600893 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:06:13.600893 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:06:13.600893 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:06:13.600893 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:06:13.600893 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:06:13.600893 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:06:13.600893 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:06:13.600893 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:06:13.600893 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:06:13.600893 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:06:13.600893 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:06:13.600893 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:06:13.600893 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:06:13.600893 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64d56eab-65de-4951-adf0-891f8a39383f could not be found. Oct 04 22:06:13.600893 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:06:13.600893 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:06:13.600893 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:06:13.611005 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:06:13.611005 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:06:13.611005 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:06:13.611005 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:06:13.611005 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:06:13.611005 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64d56eab-65de-4951-adf0-891f8a39383f could not be found. Oct 04 22:06:13.611005 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:06:13.611005 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-56bb100f-20ec-4aff-b0cf-0e73246077c8 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Returning 404 to user: Instance 64d56eab-65de-4951-adf0-891f8a39383f could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:06:13.611005 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-56bb100f-20ec-4aff-b0cf-0e73246077c8 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "GET /compute/v2.1/servers/64d56eab-65de-4951-adf0-891f8a39383f" status: 404 len: 111 microversion: 2.1 time: 0.049770 Oct 04 22:06:13.611005 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2272/4606] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:06:13 2022] GET /compute/v2.1/servers/64d56eab-65de-4951-adf0-891f8a39383f => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:06:13.614601 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-94f38541-95dd-4eab-bea9-5ff6deb94350 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:06:13.615536 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-94f38541-95dd-4eab-bea9-5ff6deb94350 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: ee95fd91-021f-430b-9fe2-74b715161748] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:06:13.624265 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-94f38541-95dd-4eab-bea9-5ff6deb94350 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] HTTP exception thrown: Instance ee95fd91-021f-430b-9fe2-74b715161748 could not be found. Oct 04 22:06:13.627102 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-94f38541-95dd-4eab-bea9-5ff6deb94350 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Request method failure captured: Oct 04 22:06:13.627102 n-d-860284-1 devstack@n-api.service[134101]: request: DELETE /compute/v2.1/servers/ee95fd91-021f-430b-9fe2-74b715161748 HTTP/1.1 Oct 04 22:06:13.627102 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 22:06:13.627102 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 22:06:13.627102 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 22:06:13.627102 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 22:06:13.627102 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 22:06:13.627102 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 22:06:13.627102 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 22:06:13.627102 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 22:06:13.627102 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPK0nBLOASIAc_jQKg5RCRqB87oRsJiRc3l4etfmNkfSSv1yHGR8RjgOAS-Q4KEeiZVVxJRa8Focu7VoHdbhzgEqV5pocnY2xPPRPWacaT4koizORav87v6vdxgR4HH-PmsbraTS232Q30lW73kM7RH3tINWZChDkcbwtTWeQlIO6TSk Oct 04 22:06:13.627102 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 22:06:13.627102 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 22:06:13.627102 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 22:06:13.627102 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 22:06:13.627102 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 22:06:13.627102 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 22:06:13.627102 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: dfe9283584fc4d90b0715216d867ea2f Oct 04 22:06:13.627102 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-DeleteServersTestJSON-2136146778 Oct 04 22:06:13.627102 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 22:06:13.627102 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 22:06:13.627102 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/dfe9283584fc4d90b0715216d867ea2f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_dfe9283584fc4d90b0715216d867ea2f", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/dfe9283584fc4d90b0715216d867ea2f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/dfe9283584fc4d90b0715216d867ea2f"}]}] Oct 04 22:06:13.627102 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-DeleteServersTestJSON-2136146778 Oct 04 22:06:13.627102 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: dfe9283584fc4d90b0715216d867ea2f Oct 04 22:06:13.627102 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-DeleteServersTestJSON-2136146778 Oct 04 22:06:13.627102 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-DeleteServersTestJSON-2136146778-project Oct 04 22:06:13.627102 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 22:06:13.627102 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 22:06:13.627102 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 41a1c8d841104bc9b6910bcc2c0e2bb1 Oct 04 22:06:13.627102 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-DeleteServersTestJSON-2136146778-project Oct 04 22:06:13.627102 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 22:06:13.627102 n-d-860284-1 devstack@n-api.service[134101]: exception: Instance ee95fd91-021f-430b-9fe2-74b715161748 could not be found. Oct 04 22:06:13.627102 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': 'ee95fd91-021f-430b-9fe2-74b715161748'} Oct 04 22:06:13.627102 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:06:13.627102 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:06:13.627102 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:06:13.627102 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:06:13.627102 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:06:13.627102 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:06:13.627102 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 22:06:13.627102 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 22:06:13.627102 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee95fd91-021f-430b-9fe2-74b715161748 could not be found. Oct 04 22:06:13.627102 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:06:13.627102 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:06:13.627102 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:06:13.627102 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:06:13.627102 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:06:13.627102 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:06:13.627102 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:06:13.627102 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:06:13.627102 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:06:13.627102 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:06:13.627102 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 22:06:13.627102 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 22:06:13.627102 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 22:06:13.627102 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 22:06:13.627102 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:06:13.627102 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:06:13.627102 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:06:13.627102 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:06:13.627102 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee95fd91-021f-430b-9fe2-74b715161748 could not be found. Oct 04 22:06:13.627102 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:06:13.627102 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:06:13.631264 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:06:13.631264 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:06:13.631264 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:06:13.631264 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:06:13.631264 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:06:13.631264 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:06:13.631264 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee95fd91-021f-430b-9fe2-74b715161748 could not be found. Oct 04 22:06:13.631264 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:06:13.631264 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-94f38541-95dd-4eab-bea9-5ff6deb94350 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Returning 404 to user: Instance ee95fd91-021f-430b-9fe2-74b715161748 could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:06:13.631264 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-94f38541-95dd-4eab-bea9-5ff6deb94350 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "DELETE /compute/v2.1/servers/ee95fd91-021f-430b-9fe2-74b715161748" status: 404 len: 111 microversion: 2.1 time: 0.019180 Oct 04 22:06:13.632787 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2273/4607] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 22:06:13 2022] DELETE /compute/v2.1/servers/ee95fd91-021f-430b-9fe2-74b715161748 => generated 111 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:06:13.638111 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-cdf1ea46-e793-4883-9d44-ad768a9c4e70 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:06:13.639175 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-cdf1ea46-e793-4883-9d44-ad768a9c4e70 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: ee95fd91-021f-430b-9fe2-74b715161748] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:06:13.649274 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-cdf1ea46-e793-4883-9d44-ad768a9c4e70 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] HTTP exception thrown: Instance ee95fd91-021f-430b-9fe2-74b715161748 could not be found. Oct 04 22:06:13.651435 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-cdf1ea46-e793-4883-9d44-ad768a9c4e70 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Request method failure captured: Oct 04 22:06:13.651435 n-d-860284-1 devstack@n-api.service[134101]: request: GET /compute/v2.1/servers/ee95fd91-021f-430b-9fe2-74b715161748 HTTP/1.1 Oct 04 22:06:13.651435 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 22:06:13.651435 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 22:06:13.651435 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 22:06:13.651435 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 22:06:13.651435 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 22:06:13.651435 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 22:06:13.651435 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 22:06:13.651435 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 22:06:13.651435 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPK0nBLOASIAc_jQKg5RCRqB87oRsJiRc3l4etfmNkfSSv1yHGR8RjgOAS-Q4KEeiZVVxJRa8Focu7VoHdbhzgEqV5pocnY2xPPRPWacaT4koizORav87v6vdxgR4HH-PmsbraTS232Q30lW73kM7RH3tINWZChDkcbwtTWeQlIO6TSk Oct 04 22:06:13.651435 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 22:06:13.651435 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 22:06:13.651435 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 22:06:13.651435 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 22:06:13.651435 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 22:06:13.651435 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 22:06:13.651435 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: dfe9283584fc4d90b0715216d867ea2f Oct 04 22:06:13.651435 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-DeleteServersTestJSON-2136146778 Oct 04 22:06:13.651435 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 22:06:13.651435 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 22:06:13.651435 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/dfe9283584fc4d90b0715216d867ea2f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_dfe9283584fc4d90b0715216d867ea2f", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/dfe9283584fc4d90b0715216d867ea2f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/dfe9283584fc4d90b0715216d867ea2f"}]}] Oct 04 22:06:13.651435 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-DeleteServersTestJSON-2136146778 Oct 04 22:06:13.651435 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: dfe9283584fc4d90b0715216d867ea2f Oct 04 22:06:13.651435 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-DeleteServersTestJSON-2136146778 Oct 04 22:06:13.651435 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-DeleteServersTestJSON-2136146778-project Oct 04 22:06:13.651435 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 22:06:13.651435 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 22:06:13.651435 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 41a1c8d841104bc9b6910bcc2c0e2bb1 Oct 04 22:06:13.651435 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-DeleteServersTestJSON-2136146778-project Oct 04 22:06:13.651435 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 22:06:13.651435 n-d-860284-1 devstack@n-api.service[134101]: exception: Instance ee95fd91-021f-430b-9fe2-74b715161748 could not be found. Oct 04 22:06:13.651435 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': 'ee95fd91-021f-430b-9fe2-74b715161748'} Oct 04 22:06:13.651435 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:06:13.651435 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:06:13.651435 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:06:13.651435 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:06:13.651435 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:06:13.651435 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:06:13.651435 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 22:06:13.651435 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 22:06:13.651435 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee95fd91-021f-430b-9fe2-74b715161748 could not be found. Oct 04 22:06:13.651435 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:06:13.651435 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:06:13.651435 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:06:13.651435 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:06:13.651435 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:06:13.651435 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:06:13.651435 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:06:13.651435 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:06:13.651435 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:06:13.651435 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:06:13.651435 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:06:13.651435 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:06:13.651435 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:06:13.651435 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:06:13.651435 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:06:13.651435 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:06:13.651435 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee95fd91-021f-430b-9fe2-74b715161748 could not be found. Oct 04 22:06:13.651435 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:06:13.651435 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:06:13.651435 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:06:13.651435 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:06:13.651435 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:06:13.656196 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:06:13.656196 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:06:13.656196 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:06:13.656196 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee95fd91-021f-430b-9fe2-74b715161748 could not be found. Oct 04 22:06:13.656196 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:06:13.658856 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-cdf1ea46-e793-4883-9d44-ad768a9c4e70 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Returning 404 to user: Instance ee95fd91-021f-430b-9fe2-74b715161748 could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:06:13.661235 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-cdf1ea46-e793-4883-9d44-ad768a9c4e70 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "GET /compute/v2.1/servers/ee95fd91-021f-430b-9fe2-74b715161748" status: 404 len: 111 microversion: 2.1 time: 0.026278 Oct 04 22:06:13.665689 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2274/4608] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:06:13 2022] GET /compute/v2.1/servers/ee95fd91-021f-430b-9fe2-74b715161748 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:06:13.837389 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-db80586d-dbb5-4fda-90bf-6f40e6ecce16 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cd0931292c245578bea8861f9ba7607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a555982bb6f841d7a72b6eca84a6150f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:06:13.845673 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-db80586d-dbb5-4fda-90bf-6f40e6ecce16 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] 10.222.0.43 "GET /compute/v2.1/servers/09bf867a-5ad2-42cd-bbd5-66e92dc8fff0" status: 200 len: 1807 microversion: 2.1 time: 1.165102 Oct 04 22:06:13.862109 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2335/4609] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:06:12 2022] GET /compute/v2.1/servers/09bf867a-5ad2-42cd-bbd5-66e92dc8fff0 => generated 1807 bytes in 1182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:06:13.870553 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-103800d3-c5cf-4904-98d0-15f53bb78d5a tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:06:13.871287 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-103800d3-c5cf-4904-98d0-15f53bb78d5a tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] [instance: 09bf867a-5ad2-42cd-bbd5-66e92dc8fff0] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:06:13.881698 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-103800d3-c5cf-4904-98d0-15f53bb78d5a tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:13.885935 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-103800d3-c5cf-4904-98d0-15f53bb78d5a tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:13.886696 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-103800d3-c5cf-4904-98d0-15f53bb78d5a tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:13.888112 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-103800d3-c5cf-4904-98d0-15f53bb78d5a tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:13.911215 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-103800d3-c5cf-4904-98d0-15f53bb78d5a tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:13.911215 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-103800d3-c5cf-4904-98d0-15f53bb78d5a tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:13.951058 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-103800d3-c5cf-4904-98d0-15f53bb78d5a tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] 10.222.0.43 "GET /compute/v2.1/servers/09bf867a-5ad2-42cd-bbd5-66e92dc8fff0/ips" status: 200 len: 220 microversion: 2.1 time: 0.084805 Oct 04 22:06:13.965518 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-255c4d10-0b1d-42e1-8983-43a840087c2b tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:06:13.966305 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-255c4d10-0b1d-42e1-8983-43a840087c2b tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] [instance: 09bf867a-5ad2-42cd-bbd5-66e92dc8fff0] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:06:13.970060 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2275/4610] 10.222.0.43 () {58 vars in 1248 bytes} [Tue Oct 4 22:06:13 2022] GET /compute/v2.1/servers/09bf867a-5ad2-42cd-bbd5-66e92dc8fff0/ips => generated 220 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:06:13.976352 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-255c4d10-0b1d-42e1-8983-43a840087c2b tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:13.977112 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-255c4d10-0b1d-42e1-8983-43a840087c2b tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:13.977758 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-255c4d10-0b1d-42e1-8983-43a840087c2b tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:13.978711 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-255c4d10-0b1d-42e1-8983-43a840087c2b tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:13.979352 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-255c4d10-0b1d-42e1-8983-43a840087c2b tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:13.979950 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-255c4d10-0b1d-42e1-8983-43a840087c2b tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:14.018304 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-255c4d10-0b1d-42e1-8983-43a840087c2b tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] [instance: 09bf867a-5ad2-42cd-bbd5-66e92dc8fff0] Going to try to terminate instance {{(pid=134102) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 22:06:14.184374 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-255c4d10-0b1d-42e1-8983-43a840087c2b tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] 10.222.0.43 "DELETE /compute/v2.1/servers/09bf867a-5ad2-42cd-bbd5-66e92dc8fff0" status: 204 len: 0 microversion: 2.1 time: 0.222643 Oct 04 22:06:14.195703 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-c733f812-1281-4db4-a33d-518ad468e511 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:06:14.196722 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-c733f812-1281-4db4-a33d-518ad468e511 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] [instance: 09bf867a-5ad2-42cd-bbd5-66e92dc8fff0] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:06:14.200730 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2336/4611] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 22:06:13 2022] DELETE /compute/v2.1/servers/09bf867a-5ad2-42cd-bbd5-66e92dc8fff0 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 22:06:14.205814 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c733f812-1281-4db4-a33d-518ad468e511 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:14.206714 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c733f812-1281-4db4-a33d-518ad468e511 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:14.208133 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c733f812-1281-4db4-a33d-518ad468e511 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:14.209647 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c733f812-1281-4db4-a33d-518ad468e511 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:14.210451 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c733f812-1281-4db4-a33d-518ad468e511 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:14.211149 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c733f812-1281-4db4-a33d-518ad468e511 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:15.019068 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-c733f812-1281-4db4-a33d-518ad468e511 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cd0931292c245578bea8861f9ba7607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a555982bb6f841d7a72b6eca84a6150f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:06:15.081307 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-c733f812-1281-4db4-a33d-518ad468e511 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] 10.222.0.43 "GET /compute/v2.1/servers/09bf867a-5ad2-42cd-bbd5-66e92dc8fff0" status: 200 len: 1813 microversion: 2.1 time: 0.890558 Oct 04 22:06:15.090764 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2276/4612] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:06:14 2022] GET /compute/v2.1/servers/09bf867a-5ad2-42cd-bbd5-66e92dc8fff0 => generated 1813 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:06:16.136910 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-1ab7b80f-b2fd-4a5e-bb96-7da5fd9e52ad tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:06:16.137647 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-1ab7b80f-b2fd-4a5e-bb96-7da5fd9e52ad tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] [instance: 09bf867a-5ad2-42cd-bbd5-66e92dc8fff0] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:06:16.152502 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1ab7b80f-b2fd-4a5e-bb96-7da5fd9e52ad tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:16.153008 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1ab7b80f-b2fd-4a5e-bb96-7da5fd9e52ad tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:16.153453 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1ab7b80f-b2fd-4a5e-bb96-7da5fd9e52ad tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:16.162168 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1ab7b80f-b2fd-4a5e-bb96-7da5fd9e52ad tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:16.163303 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1ab7b80f-b2fd-4a5e-bb96-7da5fd9e52ad tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:16.163772 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1ab7b80f-b2fd-4a5e-bb96-7da5fd9e52ad tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:16.414277 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-1ab7b80f-b2fd-4a5e-bb96-7da5fd9e52ad tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cd0931292c245578bea8861f9ba7607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a555982bb6f841d7a72b6eca84a6150f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:06:16.422956 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-1ab7b80f-b2fd-4a5e-bb96-7da5fd9e52ad tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] 10.222.0.43 "GET /compute/v2.1/servers/09bf867a-5ad2-42cd-bbd5-66e92dc8fff0" status: 200 len: 1813 microversion: 2.1 time: 0.290938 Oct 04 22:06:16.442688 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2337/4613] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:06:16 2022] GET /compute/v2.1/servers/09bf867a-5ad2-42cd-bbd5-66e92dc8fff0 => generated 1813 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:06:17.453849 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-382da09c-8116-4cea-9c16-ae38dc8d4bf5 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:06:17.454628 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-382da09c-8116-4cea-9c16-ae38dc8d4bf5 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] [instance: 09bf867a-5ad2-42cd-bbd5-66e92dc8fff0] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:06:17.471512 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-382da09c-8116-4cea-9c16-ae38dc8d4bf5 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:17.472102 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-382da09c-8116-4cea-9c16-ae38dc8d4bf5 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:17.473339 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-382da09c-8116-4cea-9c16-ae38dc8d4bf5 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:17.474439 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-382da09c-8116-4cea-9c16-ae38dc8d4bf5 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:17.477845 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-382da09c-8116-4cea-9c16-ae38dc8d4bf5 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:17.478676 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-382da09c-8116-4cea-9c16-ae38dc8d4bf5 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:17.852220 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-382da09c-8116-4cea-9c16-ae38dc8d4bf5 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cd0931292c245578bea8861f9ba7607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a555982bb6f841d7a72b6eca84a6150f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:06:17.870645 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-382da09c-8116-4cea-9c16-ae38dc8d4bf5 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] 10.222.0.43 "GET /compute/v2.1/servers/09bf867a-5ad2-42cd-bbd5-66e92dc8fff0" status: 200 len: 1813 microversion: 2.1 time: 0.420775 Oct 04 22:06:17.871245 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2277/4614] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:06:17 2022] GET /compute/v2.1/servers/09bf867a-5ad2-42cd-bbd5-66e92dc8fff0 => generated 1813 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:06:18.081919 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-70436cef-4475-4a17-84d9-b6ee4175cce0 req-30e3104f-b3fa-4c19-9958-a9c7dce506e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09bf867a-5ad2-42cd-bbd5-66e92dc8fff0", "name": "network-vif-deleted", "tag": "d811dbc1-e714-411f-880d-f883a5ee6676"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:06:18.121625 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-70436cef-4475-4a17-84d9-b6ee4175cce0 req-30e3104f-b3fa-4c19-9958-a9c7dce506e8 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:18.128504 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-70436cef-4475-4a17-84d9-b6ee4175cce0 req-30e3104f-b3fa-4c19-9958-a9c7dce506e8 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:18.131008 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-70436cef-4475-4a17-84d9-b6ee4175cce0 req-30e3104f-b3fa-4c19-9958-a9c7dce506e8 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:18.156601 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-70436cef-4475-4a17-84d9-b6ee4175cce0 req-30e3104f-b3fa-4c19-9958-a9c7dce506e8 service nova] Creating event network-vif-deleted:d811dbc1-e714-411f-880d-f883a5ee6676 for instance 09bf867a-5ad2-42cd-bbd5-66e92dc8fff0 on n-h2-860284-1 Oct 04 22:06:18.174292 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-70436cef-4475-4a17-84d9-b6ee4175cce0 req-30e3104f-b3fa-4c19-9958-a9c7dce506e8 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096721 Oct 04 22:06:18.175213 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2338/4615] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:06:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:06:18.898778 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-9c5122e5-36e3-40ee-9dd0-c9765d9a6808 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:06:18.899439 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-9c5122e5-36e3-40ee-9dd0-c9765d9a6808 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] [instance: 09bf867a-5ad2-42cd-bbd5-66e92dc8fff0] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:06:18.917533 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9c5122e5-36e3-40ee-9dd0-c9765d9a6808 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:18.917940 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9c5122e5-36e3-40ee-9dd0-c9765d9a6808 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:18.918422 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9c5122e5-36e3-40ee-9dd0-c9765d9a6808 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:18.919167 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9c5122e5-36e3-40ee-9dd0-c9765d9a6808 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:18.919641 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9c5122e5-36e3-40ee-9dd0-c9765d9a6808 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:18.920082 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9c5122e5-36e3-40ee-9dd0-c9765d9a6808 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:19.229870 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-9c5122e5-36e3-40ee-9dd0-c9765d9a6808 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cd0931292c245578bea8861f9ba7607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a555982bb6f841d7a72b6eca84a6150f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:06:19.237330 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=100 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:06:19.242090 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-9c5122e5-36e3-40ee-9dd0-c9765d9a6808 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] 10.222.0.43 "GET /compute/v2.1/servers/09bf867a-5ad2-42cd-bbd5-66e92dc8fff0" status: 200 len: 1633 microversion: 2.1 time: 0.347533 Oct 04 22:06:19.248920 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2278/4616] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:06:18 2022] GET /compute/v2.1/servers/09bf867a-5ad2-42cd-bbd5-66e92dc8fff0 => generated 1633 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:06:19.428657 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-49f43563-fdf3-4cd3-abbc-58691db723df req-a18eaa9a-d4ac-41d0-81b2-c2fd558c9899 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09bf867a-5ad2-42cd-bbd5-66e92dc8fff0", "name": "network-vif-unplugged", "status": "completed", "tag": "ed0ed48f-26ae-443e-9902-e3c7343a3449"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:06:19.451034 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-49f43563-fdf3-4cd3-abbc-58691db723df req-a18eaa9a-d4ac-41d0-81b2-c2fd558c9899 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:19.451821 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-49f43563-fdf3-4cd3-abbc-58691db723df req-a18eaa9a-d4ac-41d0-81b2-c2fd558c9899 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:19.452465 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-49f43563-fdf3-4cd3-abbc-58691db723df req-a18eaa9a-d4ac-41d0-81b2-c2fd558c9899 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:19.505138 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-49f43563-fdf3-4cd3-abbc-58691db723df req-a18eaa9a-d4ac-41d0-81b2-c2fd558c9899 service nova] Creating event network-vif-unplugged:ed0ed48f-26ae-443e-9902-e3c7343a3449 for instance 09bf867a-5ad2-42cd-bbd5-66e92dc8fff0 on n-h2-860284-1 Oct 04 22:06:19.519041 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-772f53c3-86de-4b6b-a41c-946aec762287 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:06:19.519770 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-772f53c3-86de-4b6b-a41c-946aec762287 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: f9376877-b87d-4738-b940-2bf314c83337] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:06:19.521723 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-49f43563-fdf3-4cd3-abbc-58691db723df req-a18eaa9a-d4ac-41d0-81b2-c2fd558c9899 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.098394 Oct 04 22:06:19.524392 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2339/4617] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:06:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:06:19.532780 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-772f53c3-86de-4b6b-a41c-946aec762287 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:19.544853 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-772f53c3-86de-4b6b-a41c-946aec762287 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:19.545484 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-772f53c3-86de-4b6b-a41c-946aec762287 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:19.547260 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-772f53c3-86de-4b6b-a41c-946aec762287 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:19.553889 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-772f53c3-86de-4b6b-a41c-946aec762287 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:19.554530 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-772f53c3-86de-4b6b-a41c-946aec762287 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:19.622511 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-772f53c3-86de-4b6b-a41c-946aec762287 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] HTTP exception thrown: Instance f9376877-b87d-4738-b940-2bf314c83337 could not be found. Oct 04 22:06:19.626662 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-772f53c3-86de-4b6b-a41c-946aec762287 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Request method failure captured: Oct 04 22:06:19.626662 n-d-860284-1 devstack@n-api.service[134101]: request: DELETE /compute/v2.1/servers/f9376877-b87d-4738-b940-2bf314c83337 HTTP/1.1 Oct 04 22:06:19.626662 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 22:06:19.626662 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 22:06:19.626662 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 22:06:19.626662 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 22:06:19.626662 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 22:06:19.626662 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 22:06:19.626662 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 22:06:19.626662 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 22:06:19.626662 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPK0nBLOASIAc_jQKg5RCRqB87oRsJiRc3l4etfmNkfSSv1yHGR8RjgOAS-Q4KEeiZVVxJRa8Focu7VoHdbhzgEqV5pocnY2xPPRPWacaT4koizORav87v6vdxgR4HH-PmsbraTS232Q30lW73kM7RH3tINWZChDkcbwtTWeQlIO6TSk Oct 04 22:06:19.626662 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 22:06:19.626662 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 22:06:19.626662 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 22:06:19.626662 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 22:06:19.626662 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 22:06:19.626662 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 22:06:19.626662 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: dfe9283584fc4d90b0715216d867ea2f Oct 04 22:06:19.626662 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-DeleteServersTestJSON-2136146778 Oct 04 22:06:19.626662 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 22:06:19.626662 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 22:06:19.626662 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/dfe9283584fc4d90b0715216d867ea2f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_dfe9283584fc4d90b0715216d867ea2f", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/dfe9283584fc4d90b0715216d867ea2f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/dfe9283584fc4d90b0715216d867ea2f"}]}] Oct 04 22:06:19.626662 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-DeleteServersTestJSON-2136146778 Oct 04 22:06:19.626662 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: dfe9283584fc4d90b0715216d867ea2f Oct 04 22:06:19.626662 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-DeleteServersTestJSON-2136146778 Oct 04 22:06:19.626662 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-DeleteServersTestJSON-2136146778-project Oct 04 22:06:19.626662 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 22:06:19.626662 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 22:06:19.626662 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 41a1c8d841104bc9b6910bcc2c0e2bb1 Oct 04 22:06:19.626662 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-DeleteServersTestJSON-2136146778-project Oct 04 22:06:19.626662 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 22:06:19.626662 n-d-860284-1 devstack@n-api.service[134101]: exception: Instance f9376877-b87d-4738-b940-2bf314c83337 could not be found. Oct 04 22:06:19.626662 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': 'f9376877-b87d-4738-b940-2bf314c83337'} Oct 04 22:06:19.626662 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:06:19.626662 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:06:19.626662 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:06:19.626662 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:06:19.626662 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:06:19.626662 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:06:19.626662 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:06:19.626662 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:06:19.626662 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:06:19.626662 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:06:19.626662 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9376877-b87d-4738-b940-2bf314c83337 could not be found. Oct 04 22:06:19.626662 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:06:19.626662 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:06:19.626662 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:06:19.626662 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:06:19.626662 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:06:19.626662 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:06:19.626662 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:06:19.626662 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:06:19.626662 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:06:19.626662 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:06:19.626662 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 22:06:19.626662 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 22:06:19.626662 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 22:06:19.626662 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 22:06:19.626662 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:06:19.626662 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:06:19.626662 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:06:19.626662 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:06:19.632034 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9376877-b87d-4738-b940-2bf314c83337 could not be found. Oct 04 22:06:19.632034 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:06:19.632034 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:06:19.632034 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:06:19.632034 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:06:19.632034 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:06:19.632034 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:06:19.632034 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:06:19.632034 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:06:19.632034 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9376877-b87d-4738-b940-2bf314c83337 could not be found. Oct 04 22:06:19.632034 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:06:19.637480 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-772f53c3-86de-4b6b-a41c-946aec762287 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Returning 404 to user: Instance f9376877-b87d-4738-b940-2bf314c83337 could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:06:19.642447 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-772f53c3-86de-4b6b-a41c-946aec762287 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "DELETE /compute/v2.1/servers/f9376877-b87d-4738-b940-2bf314c83337" status: 404 len: 111 microversion: 2.1 time: 0.127878 Oct 04 22:06:19.662918 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2279/4618] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 22:06:19 2022] DELETE /compute/v2.1/servers/f9376877-b87d-4738-b940-2bf314c83337 => generated 111 bytes in 149 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:06:19.672026 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-3dd6f41e-ca7d-46a8-90cf-504f633a30f5 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:06:19.672768 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-3dd6f41e-ca7d-46a8-90cf-504f633a30f5 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: f9376877-b87d-4738-b940-2bf314c83337] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:06:19.680556 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3dd6f41e-ca7d-46a8-90cf-504f633a30f5 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:19.681060 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3dd6f41e-ca7d-46a8-90cf-504f633a30f5 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:19.681513 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3dd6f41e-ca7d-46a8-90cf-504f633a30f5 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:19.682250 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3dd6f41e-ca7d-46a8-90cf-504f633a30f5 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:19.682755 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3dd6f41e-ca7d-46a8-90cf-504f633a30f5 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:19.683189 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3dd6f41e-ca7d-46a8-90cf-504f633a30f5 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:19.729632 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-3dd6f41e-ca7d-46a8-90cf-504f633a30f5 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] HTTP exception thrown: Instance f9376877-b87d-4738-b940-2bf314c83337 could not be found. Oct 04 22:06:19.731376 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-3dd6f41e-ca7d-46a8-90cf-504f633a30f5 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Request method failure captured: Oct 04 22:06:19.731376 n-d-860284-1 devstack@n-api.service[134102]: request: GET /compute/v2.1/servers/f9376877-b87d-4738-b940-2bf314c83337 HTTP/1.1 Oct 04 22:06:19.731376 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 22:06:19.731376 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 22:06:19.731376 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 22:06:19.731376 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 22:06:19.731376 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 22:06:19.731376 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 22:06:19.731376 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 22:06:19.731376 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 22:06:19.731376 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPK0nBLOASIAc_jQKg5RCRqB87oRsJiRc3l4etfmNkfSSv1yHGR8RjgOAS-Q4KEeiZVVxJRa8Focu7VoHdbhzgEqV5pocnY2xPPRPWacaT4koizORav87v6vdxgR4HH-PmsbraTS232Q30lW73kM7RH3tINWZChDkcbwtTWeQlIO6TSk Oct 04 22:06:19.731376 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 22:06:19.731376 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 22:06:19.731376 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 22:06:19.731376 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 22:06:19.731376 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 22:06:19.731376 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 22:06:19.731376 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: dfe9283584fc4d90b0715216d867ea2f Oct 04 22:06:19.731376 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-DeleteServersTestJSON-2136146778 Oct 04 22:06:19.731376 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 22:06:19.731376 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 22:06:19.731376 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/dfe9283584fc4d90b0715216d867ea2f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_dfe9283584fc4d90b0715216d867ea2f", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/dfe9283584fc4d90b0715216d867ea2f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/dfe9283584fc4d90b0715216d867ea2f"}]}] Oct 04 22:06:19.731376 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-DeleteServersTestJSON-2136146778 Oct 04 22:06:19.731376 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: dfe9283584fc4d90b0715216d867ea2f Oct 04 22:06:19.731376 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-DeleteServersTestJSON-2136146778 Oct 04 22:06:19.731376 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-DeleteServersTestJSON-2136146778-project Oct 04 22:06:19.731376 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 22:06:19.731376 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 22:06:19.731376 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: 41a1c8d841104bc9b6910bcc2c0e2bb1 Oct 04 22:06:19.731376 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-DeleteServersTestJSON-2136146778-project Oct 04 22:06:19.731376 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 22:06:19.731376 n-d-860284-1 devstack@n-api.service[134102]: exception: Instance f9376877-b87d-4738-b940-2bf314c83337 could not be found. Oct 04 22:06:19.731376 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': 'f9376877-b87d-4738-b940-2bf314c83337'} Oct 04 22:06:19.731376 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:06:19.731376 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:06:19.731376 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:06:19.731376 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:06:19.731376 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:06:19.731376 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:06:19.731376 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:06:19.731376 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:06:19.731376 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:06:19.731376 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:06:19.731376 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9376877-b87d-4738-b940-2bf314c83337 could not be found. Oct 04 22:06:19.731376 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:06:19.731376 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:06:19.731376 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:06:19.731376 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:06:19.731376 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:06:19.731376 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:06:19.731376 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:06:19.731376 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:06:19.731376 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:06:19.731376 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:06:19.731376 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:06:19.731376 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:06:19.731376 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:06:19.731376 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:06:19.731376 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:06:19.731376 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:06:19.731376 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9376877-b87d-4738-b940-2bf314c83337 could not be found. Oct 04 22:06:19.731376 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:06:19.731376 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:06:19.731376 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:06:19.736080 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:06:19.736080 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:06:19.736080 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:06:19.736080 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:06:19.736080 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:06:19.736080 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9376877-b87d-4738-b940-2bf314c83337 could not be found. Oct 04 22:06:19.736080 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:06:19.736080 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-3dd6f41e-ca7d-46a8-90cf-504f633a30f5 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Returning 404 to user: Instance f9376877-b87d-4738-b940-2bf314c83337 could not be found. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:06:19.736080 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-3dd6f41e-ca7d-46a8-90cf-504f633a30f5 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "GET /compute/v2.1/servers/f9376877-b87d-4738-b940-2bf314c83337" status: 404 len: 111 microversion: 2.1 time: 0.065393 Oct 04 22:06:19.736080 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2340/4619] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:06:19 2022] GET /compute/v2.1/servers/f9376877-b87d-4738-b940-2bf314c83337 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:06:19.746573 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-9b38e26e-db3f-4548-8bcd-cb7065ad8749 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:06:19.754943 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-9b38e26e-db3f-4548-8bcd-cb7065ad8749 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: aef57343-eb2a-4379-87cd-aab5f82d2a37] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:06:19.774282 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9b38e26e-db3f-4548-8bcd-cb7065ad8749 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:19.776746 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9b38e26e-db3f-4548-8bcd-cb7065ad8749 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:19.779117 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9b38e26e-db3f-4548-8bcd-cb7065ad8749 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:19.785101 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9b38e26e-db3f-4548-8bcd-cb7065ad8749 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:19.786108 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9b38e26e-db3f-4548-8bcd-cb7065ad8749 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:19.786860 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9b38e26e-db3f-4548-8bcd-cb7065ad8749 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:19.807055 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-9b38e26e-db3f-4548-8bcd-cb7065ad8749 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] HTTP exception thrown: Instance aef57343-eb2a-4379-87cd-aab5f82d2a37 could not be found. Oct 04 22:06:19.812301 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-9b38e26e-db3f-4548-8bcd-cb7065ad8749 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Request method failure captured: Oct 04 22:06:19.812301 n-d-860284-1 devstack@n-api.service[134101]: request: DELETE /compute/v2.1/servers/aef57343-eb2a-4379-87cd-aab5f82d2a37 HTTP/1.1 Oct 04 22:06:19.812301 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 22:06:19.812301 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 22:06:19.812301 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 22:06:19.812301 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 22:06:19.812301 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 22:06:19.812301 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 22:06:19.812301 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 22:06:19.812301 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 22:06:19.812301 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPK0nBLOASIAc_jQKg5RCRqB87oRsJiRc3l4etfmNkfSSv1yHGR8RjgOAS-Q4KEeiZVVxJRa8Focu7VoHdbhzgEqV5pocnY2xPPRPWacaT4koizORav87v6vdxgR4HH-PmsbraTS232Q30lW73kM7RH3tINWZChDkcbwtTWeQlIO6TSk Oct 04 22:06:19.812301 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 22:06:19.812301 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 22:06:19.812301 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 22:06:19.812301 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 22:06:19.812301 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 22:06:19.812301 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 22:06:19.812301 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: dfe9283584fc4d90b0715216d867ea2f Oct 04 22:06:19.812301 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-DeleteServersTestJSON-2136146778 Oct 04 22:06:19.812301 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 22:06:19.812301 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 22:06:19.812301 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/dfe9283584fc4d90b0715216d867ea2f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_dfe9283584fc4d90b0715216d867ea2f", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/dfe9283584fc4d90b0715216d867ea2f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/dfe9283584fc4d90b0715216d867ea2f"}]}] Oct 04 22:06:19.812301 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-DeleteServersTestJSON-2136146778 Oct 04 22:06:19.812301 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: dfe9283584fc4d90b0715216d867ea2f Oct 04 22:06:19.812301 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-DeleteServersTestJSON-2136146778 Oct 04 22:06:19.812301 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-DeleteServersTestJSON-2136146778-project Oct 04 22:06:19.812301 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 22:06:19.812301 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 22:06:19.812301 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 41a1c8d841104bc9b6910bcc2c0e2bb1 Oct 04 22:06:19.812301 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-DeleteServersTestJSON-2136146778-project Oct 04 22:06:19.812301 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 22:06:19.812301 n-d-860284-1 devstack@n-api.service[134101]: exception: Instance aef57343-eb2a-4379-87cd-aab5f82d2a37 could not be found. Oct 04 22:06:19.812301 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': 'aef57343-eb2a-4379-87cd-aab5f82d2a37'} Oct 04 22:06:19.812301 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:06:19.812301 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:06:19.812301 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:06:19.812301 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:06:19.812301 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:06:19.812301 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:06:19.812301 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:06:19.812301 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:06:19.812301 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:06:19.812301 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:06:19.812301 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aef57343-eb2a-4379-87cd-aab5f82d2a37 could not be found. Oct 04 22:06:19.812301 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:06:19.812301 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:06:19.812301 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:06:19.812301 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:06:19.812301 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:06:19.812301 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:06:19.812301 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:06:19.812301 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:06:19.812301 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:06:19.812301 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:06:19.812301 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 22:06:19.812301 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 22:06:19.812301 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 22:06:19.812301 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 22:06:19.812301 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:06:19.812301 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:06:19.812301 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:06:19.812301 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:06:19.816069 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aef57343-eb2a-4379-87cd-aab5f82d2a37 could not be found. Oct 04 22:06:19.816069 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:06:19.816069 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:06:19.816069 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:06:19.816069 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:06:19.816069 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:06:19.816069 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:06:19.816069 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:06:19.816069 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:06:19.816069 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aef57343-eb2a-4379-87cd-aab5f82d2a37 could not be found. Oct 04 22:06:19.816069 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:06:19.827591 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-9b38e26e-db3f-4548-8bcd-cb7065ad8749 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Returning 404 to user: Instance aef57343-eb2a-4379-87cd-aab5f82d2a37 could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:06:19.829641 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-9b38e26e-db3f-4548-8bcd-cb7065ad8749 tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "DELETE /compute/v2.1/servers/aef57343-eb2a-4379-87cd-aab5f82d2a37" status: 404 len: 111 microversion: 2.1 time: 0.091593 Oct 04 22:06:19.830842 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2280/4620] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 22:06:19 2022] DELETE /compute/v2.1/servers/aef57343-eb2a-4379-87cd-aab5f82d2a37 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:06:19.839400 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-a38844b4-0a2a-4392-af2a-46aec592f37f tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:06:19.840047 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-a38844b4-0a2a-4392-af2a-46aec592f37f tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] [instance: aef57343-eb2a-4379-87cd-aab5f82d2a37] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:06:19.862803 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a38844b4-0a2a-4392-af2a-46aec592f37f tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:19.863345 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a38844b4-0a2a-4392-af2a-46aec592f37f tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:19.865047 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a38844b4-0a2a-4392-af2a-46aec592f37f tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:19.866834 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a38844b4-0a2a-4392-af2a-46aec592f37f tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:19.868312 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a38844b4-0a2a-4392-af2a-46aec592f37f tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:19.870511 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a38844b4-0a2a-4392-af2a-46aec592f37f tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:19.905466 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-a38844b4-0a2a-4392-af2a-46aec592f37f tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] HTTP exception thrown: Instance aef57343-eb2a-4379-87cd-aab5f82d2a37 could not be found. Oct 04 22:06:19.907075 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-a38844b4-0a2a-4392-af2a-46aec592f37f tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Request method failure captured: Oct 04 22:06:19.907075 n-d-860284-1 devstack@n-api.service[134102]: request: GET /compute/v2.1/servers/aef57343-eb2a-4379-87cd-aab5f82d2a37 HTTP/1.1 Oct 04 22:06:19.907075 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 22:06:19.907075 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 22:06:19.907075 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 22:06:19.907075 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 22:06:19.907075 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 22:06:19.907075 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 22:06:19.907075 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 22:06:19.907075 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 22:06:19.907075 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPK0nBLOASIAc_jQKg5RCRqB87oRsJiRc3l4etfmNkfSSv1yHGR8RjgOAS-Q4KEeiZVVxJRa8Focu7VoHdbhzgEqV5pocnY2xPPRPWacaT4koizORav87v6vdxgR4HH-PmsbraTS232Q30lW73kM7RH3tINWZChDkcbwtTWeQlIO6TSk Oct 04 22:06:19.907075 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 22:06:19.907075 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 22:06:19.907075 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 22:06:19.907075 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 22:06:19.907075 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 22:06:19.907075 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 22:06:19.907075 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: dfe9283584fc4d90b0715216d867ea2f Oct 04 22:06:19.907075 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-DeleteServersTestJSON-2136146778 Oct 04 22:06:19.907075 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 22:06:19.907075 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 22:06:19.907075 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/dfe9283584fc4d90b0715216d867ea2f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_dfe9283584fc4d90b0715216d867ea2f", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/dfe9283584fc4d90b0715216d867ea2f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/dfe9283584fc4d90b0715216d867ea2f"}]}] Oct 04 22:06:19.907075 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-DeleteServersTestJSON-2136146778 Oct 04 22:06:19.907075 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: dfe9283584fc4d90b0715216d867ea2f Oct 04 22:06:19.907075 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-DeleteServersTestJSON-2136146778 Oct 04 22:06:19.907075 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-DeleteServersTestJSON-2136146778-project Oct 04 22:06:19.907075 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 22:06:19.907075 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 22:06:19.907075 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: 41a1c8d841104bc9b6910bcc2c0e2bb1 Oct 04 22:06:19.907075 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-DeleteServersTestJSON-2136146778-project Oct 04 22:06:19.907075 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 22:06:19.907075 n-d-860284-1 devstack@n-api.service[134102]: exception: Instance aef57343-eb2a-4379-87cd-aab5f82d2a37 could not be found. Oct 04 22:06:19.907075 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': 'aef57343-eb2a-4379-87cd-aab5f82d2a37'} Oct 04 22:06:19.907075 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:06:19.907075 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:06:19.907075 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:06:19.907075 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:06:19.907075 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:06:19.907075 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:06:19.907075 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:06:19.907075 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:06:19.907075 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:06:19.907075 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:06:19.907075 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aef57343-eb2a-4379-87cd-aab5f82d2a37 could not be found. Oct 04 22:06:19.907075 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:06:19.907075 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:06:19.907075 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:06:19.907075 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:06:19.907075 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:06:19.907075 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:06:19.907075 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:06:19.907075 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:06:19.907075 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:06:19.907075 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:06:19.907075 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:06:19.907075 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:06:19.907075 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:06:19.907075 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:06:19.907075 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:06:19.907075 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:06:19.907075 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aef57343-eb2a-4379-87cd-aab5f82d2a37 could not be found. Oct 04 22:06:19.907075 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:06:19.907075 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:06:19.907075 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:06:19.914568 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:06:19.914568 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:06:19.914568 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:06:19.914568 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:06:19.914568 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:06:19.914568 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aef57343-eb2a-4379-87cd-aab5f82d2a37 could not be found. Oct 04 22:06:19.914568 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:06:19.914568 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-a38844b4-0a2a-4392-af2a-46aec592f37f tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] Returning 404 to user: Instance aef57343-eb2a-4379-87cd-aab5f82d2a37 could not be found. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:06:19.914568 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-a38844b4-0a2a-4392-af2a-46aec592f37f tempest-DeleteServersTestJSON-2136146778 tempest-DeleteServersTestJSON-2136146778-project] 10.222.0.43 "GET /compute/v2.1/servers/aef57343-eb2a-4379-87cd-aab5f82d2a37" status: 404 len: 111 microversion: 2.1 time: 0.073192 Oct 04 22:06:19.914568 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2341/4621] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:06:19 2022] GET /compute/v2.1/servers/aef57343-eb2a-4379-87cd-aab5f82d2a37 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:06:20.269716 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-56e4e067-dfe9-4c20-9735-2864814f6b09 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:06:20.271420 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-56e4e067-dfe9-4c20-9735-2864814f6b09 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] [instance: 09bf867a-5ad2-42cd-bbd5-66e92dc8fff0] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:06:20.283741 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-56e4e067-dfe9-4c20-9735-2864814f6b09 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:20.288126 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-56e4e067-dfe9-4c20-9735-2864814f6b09 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:20.288825 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-56e4e067-dfe9-4c20-9735-2864814f6b09 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:20.291303 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-56e4e067-dfe9-4c20-9735-2864814f6b09 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:20.291993 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-56e4e067-dfe9-4c20-9735-2864814f6b09 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:20.293283 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-56e4e067-dfe9-4c20-9735-2864814f6b09 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:20.411222 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-b6bbfd66-4488-449a-814f-d98cc6f72171 req-e2c5bcbb-29f8-4073-8a41-a43ec0b00a59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09bf867a-5ad2-42cd-bbd5-66e92dc8fff0", "name": "network-vif-deleted", "tag": "b2bca8f9-985a-40a5-b364-9714853fc6b3"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:06:20.440175 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-b6bbfd66-4488-449a-814f-d98cc6f72171 req-e2c5bcbb-29f8-4073-8a41-a43ec0b00a59 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:20.442474 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-b6bbfd66-4488-449a-814f-d98cc6f72171 req-e2c5bcbb-29f8-4073-8a41-a43ec0b00a59 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:20.443143 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-b6bbfd66-4488-449a-814f-d98cc6f72171 req-e2c5bcbb-29f8-4073-8a41-a43ec0b00a59 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:20.512874 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-b6bbfd66-4488-449a-814f-d98cc6f72171 req-e2c5bcbb-29f8-4073-8a41-a43ec0b00a59 service nova] Creating event network-vif-deleted:b2bca8f9-985a-40a5-b364-9714853fc6b3 for instance 09bf867a-5ad2-42cd-bbd5-66e92dc8fff0 on n-h2-860284-1 Oct 04 22:06:20.524320 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-b6bbfd66-4488-449a-814f-d98cc6f72171 req-e2c5bcbb-29f8-4073-8a41-a43ec0b00a59 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116982 Oct 04 22:06:20.525851 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2342/4622] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:06:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:06:21.015081 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-56e4e067-dfe9-4c20-9735-2864814f6b09 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cd0931292c245578bea8861f9ba7607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a555982bb6f841d7a72b6eca84a6150f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:06:21.028511 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-56e4e067-dfe9-4c20-9735-2864814f6b09 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] 10.222.0.43 "GET /compute/v2.1/servers/09bf867a-5ad2-42cd-bbd5-66e92dc8fff0" status: 200 len: 1612 microversion: 2.1 time: 0.762356 Oct 04 22:06:21.036205 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2281/4623] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:06:20 2022] GET /compute/v2.1/servers/09bf867a-5ad2-42cd-bbd5-66e92dc8fff0 => generated 1612 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:06:22.058732 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-94faa0e1-1d42-4e1c-8c6b-5c711d7ccac5 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:06:22.059493 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-94faa0e1-1d42-4e1c-8c6b-5c711d7ccac5 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] [instance: 09bf867a-5ad2-42cd-bbd5-66e92dc8fff0] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:06:22.083244 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-94faa0e1-1d42-4e1c-8c6b-5c711d7ccac5 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:22.093461 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-94faa0e1-1d42-4e1c-8c6b-5c711d7ccac5 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:22.095025 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-94faa0e1-1d42-4e1c-8c6b-5c711d7ccac5 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:22.096720 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-94faa0e1-1d42-4e1c-8c6b-5c711d7ccac5 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:22.098301 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-94faa0e1-1d42-4e1c-8c6b-5c711d7ccac5 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:22.099420 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-94faa0e1-1d42-4e1c-8c6b-5c711d7ccac5 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:22.302977 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-94faa0e1-1d42-4e1c-8c6b-5c711d7ccac5 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cd0931292c245578bea8861f9ba7607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a555982bb6f841d7a72b6eca84a6150f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:06:22.332039 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:06:22.350469 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-94faa0e1-1d42-4e1c-8c6b-5c711d7ccac5 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] 10.222.0.43 "GET /compute/v2.1/servers/09bf867a-5ad2-42cd-bbd5-66e92dc8fff0" status: 200 len: 1455 microversion: 2.1 time: 0.295849 Oct 04 22:06:22.352639 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2343/4624] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:06:22 2022] GET /compute/v2.1/servers/09bf867a-5ad2-42cd-bbd5-66e92dc8fff0 => generated 1455 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:06:22.606315 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-8821a23a-2fa9-481f-85f7-9931b9b84acc req-1a92fd52-c1ac-4e00-9669-b4b91f3e9edb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09bf867a-5ad2-42cd-bbd5-66e92dc8fff0", "name": "network-vif-deleted", "tag": "ed0ed48f-26ae-443e-9902-e3c7343a3449"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:06:22.631076 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-8821a23a-2fa9-481f-85f7-9931b9b84acc req-1a92fd52-c1ac-4e00-9669-b4b91f3e9edb service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:22.635386 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-8821a23a-2fa9-481f-85f7-9931b9b84acc req-1a92fd52-c1ac-4e00-9669-b4b91f3e9edb service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:22.636137 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-8821a23a-2fa9-481f-85f7-9931b9b84acc req-1a92fd52-c1ac-4e00-9669-b4b91f3e9edb service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:22.711973 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-8821a23a-2fa9-481f-85f7-9931b9b84acc req-1a92fd52-c1ac-4e00-9669-b4b91f3e9edb service nova] Creating event network-vif-deleted:ed0ed48f-26ae-443e-9902-e3c7343a3449 for instance 09bf867a-5ad2-42cd-bbd5-66e92dc8fff0 on n-h2-860284-1 Oct 04 22:06:22.720516 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-8821a23a-2fa9-481f-85f7-9931b9b84acc req-1a92fd52-c1ac-4e00-9669-b4b91f3e9edb service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118659 Oct 04 22:06:22.723217 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2282/4625] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:06:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:06:23.382877 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-60514b87-b680-4a46-98b4-03ace004a7d8 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:06:23.384147 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-60514b87-b680-4a46-98b4-03ace004a7d8 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] [instance: 09bf867a-5ad2-42cd-bbd5-66e92dc8fff0] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:06:23.393966 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-60514b87-b680-4a46-98b4-03ace004a7d8 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:23.395715 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-60514b87-b680-4a46-98b4-03ace004a7d8 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:23.396814 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-60514b87-b680-4a46-98b4-03ace004a7d8 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:23.397840 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-60514b87-b680-4a46-98b4-03ace004a7d8 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:23.398593 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-60514b87-b680-4a46-98b4-03ace004a7d8 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:23.399292 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-60514b87-b680-4a46-98b4-03ace004a7d8 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:23.418762 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-60514b87-b680-4a46-98b4-03ace004a7d8 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] HTTP exception thrown: Instance 09bf867a-5ad2-42cd-bbd5-66e92dc8fff0 could not be found. Oct 04 22:06:23.435186 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-60514b87-b680-4a46-98b4-03ace004a7d8 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Request method failure captured: Oct 04 22:06:23.435186 n-d-860284-1 devstack@n-api.service[134102]: request: GET /compute/v2.1/servers/09bf867a-5ad2-42cd-bbd5-66e92dc8fff0 HTTP/1.1 Oct 04 22:06:23.435186 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 22:06:23.435186 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 22:06:23.435186 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 22:06:23.435186 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 22:06:23.435186 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 22:06:23.435186 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 22:06:23.435186 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 22:06:23.435186 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 22:06:23.435186 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPK4rVHSJ18_h3nmUTvsmLkrcgyz9VziEUYrv1QHLl0wUgMHspzD_35xS7SrUWqlg61UpMYX9ej0QcvySSs-V_aXPECB8PZsHWnLLZbr8gujVcglgZ1-aIET1G1xYZDLJYg-p6aFIZc8xBttPJ9iKmwMFj4IATa36OmQb4o86GYOSO5s Oct 04 22:06:23.435186 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 22:06:23.435186 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 22:06:23.435186 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 22:06:23.435186 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 22:06:23.435186 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 22:06:23.435186 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 22:06:23.435186 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: a555982bb6f841d7a72b6eca84a6150f Oct 04 22:06:23.435186 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-ServersTestMultiNic-1109058152 Oct 04 22:06:23.435186 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 22:06:23.435186 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 22:06:23.435186 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a555982bb6f841d7a72b6eca84a6150f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_a555982bb6f841d7a72b6eca84a6150f", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a555982bb6f841d7a72b6eca84a6150f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/a555982bb6f841d7a72b6eca84a6150f"}]}] Oct 04 22:06:23.435186 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-ServersTestMultiNic-1109058152 Oct 04 22:06:23.435186 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: a555982bb6f841d7a72b6eca84a6150f Oct 04 22:06:23.435186 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-ServersTestMultiNic-1109058152 Oct 04 22:06:23.435186 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-ServersTestMultiNic-1109058152-project Oct 04 22:06:23.435186 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 22:06:23.435186 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 22:06:23.435186 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: 4cd0931292c245578bea8861f9ba7607 Oct 04 22:06:23.435186 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-ServersTestMultiNic-1109058152-project Oct 04 22:06:23.435186 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 22:06:23.435186 n-d-860284-1 devstack@n-api.service[134102]: exception: Instance 09bf867a-5ad2-42cd-bbd5-66e92dc8fff0 could not be found. Oct 04 22:06:23.435186 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': '09bf867a-5ad2-42cd-bbd5-66e92dc8fff0'} Oct 04 22:06:23.435186 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:06:23.435186 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:06:23.435186 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:06:23.435186 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:06:23.435186 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:06:23.435186 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:06:23.435186 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:06:23.435186 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:06:23.435186 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:06:23.435186 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:06:23.435186 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 09bf867a-5ad2-42cd-bbd5-66e92dc8fff0 could not be found. Oct 04 22:06:23.435186 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:06:23.435186 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:06:23.435186 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:06:23.435186 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:06:23.435186 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:06:23.435186 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:06:23.435186 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:06:23.435186 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:06:23.435186 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:06:23.435186 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:06:23.435186 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:06:23.435186 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:06:23.435186 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:06:23.435186 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:06:23.435186 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:06:23.435186 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:06:23.435186 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 09bf867a-5ad2-42cd-bbd5-66e92dc8fff0 could not be found. Oct 04 22:06:23.435186 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:06:23.435186 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:06:23.435186 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:06:23.439559 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:06:23.439559 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:06:23.439559 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:06:23.439559 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:06:23.439559 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:06:23.439559 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 09bf867a-5ad2-42cd-bbd5-66e92dc8fff0 could not be found. Oct 04 22:06:23.439559 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:06:23.450166 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-60514b87-b680-4a46-98b4-03ace004a7d8 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Returning 404 to user: Instance 09bf867a-5ad2-42cd-bbd5-66e92dc8fff0 could not be found. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:06:23.451730 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-60514b87-b680-4a46-98b4-03ace004a7d8 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] 10.222.0.43 "GET /compute/v2.1/servers/09bf867a-5ad2-42cd-bbd5-66e92dc8fff0" status: 404 len: 111 microversion: 2.1 time: 0.074267 Oct 04 22:06:23.456433 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2344/4626] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:06:23 2022] GET /compute/v2.1/servers/09bf867a-5ad2-42cd-bbd5-66e92dc8fff0 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:06:26.898147 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-323f9fc9-377e-437c-a493-bc8fab9e3d29 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:06:26.907844 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-323f9fc9-377e-437c-a493-bc8fab9e3d29 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 48243e1b-892b-4c4b-8db1-242b2e40653b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:06:26.950938 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-323f9fc9-377e-437c-a493-bc8fab9e3d29 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:26.952335 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-323f9fc9-377e-437c-a493-bc8fab9e3d29 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:26.953452 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-323f9fc9-377e-437c-a493-bc8fab9e3d29 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:26.955207 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-323f9fc9-377e-437c-a493-bc8fab9e3d29 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:26.956653 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-323f9fc9-377e-437c-a493-bc8fab9e3d29 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:26.960229 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-323f9fc9-377e-437c-a493-bc8fab9e3d29 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:27.666151 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-323f9fc9-377e-437c-a493-bc8fab9e3d29 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:06:27.735027 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-323f9fc9-377e-437c-a493-bc8fab9e3d29 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b" status: 200 len: 1669 microversion: 2.1 time: 0.846149 Oct 04 22:06:27.738676 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2283/4627] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:06:26 2022] GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b => generated 1669 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:06:27.766011 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-0fb0a34f-7734-461f-b1ae-cc9a680b7afc tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:06:27.766709 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-0fb0a34f-7734-461f-b1ae-cc9a680b7afc tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 48243e1b-892b-4c4b-8db1-242b2e40653b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:06:27.784000 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0fb0a34f-7734-461f-b1ae-cc9a680b7afc tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:27.784318 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0fb0a34f-7734-461f-b1ae-cc9a680b7afc tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:27.784770 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0fb0a34f-7734-461f-b1ae-cc9a680b7afc tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:27.792262 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0fb0a34f-7734-461f-b1ae-cc9a680b7afc tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:27.792883 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0fb0a34f-7734-461f-b1ae-cc9a680b7afc tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:27.793352 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0fb0a34f-7734-461f-b1ae-cc9a680b7afc tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:28.327465 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-0fb0a34f-7734-461f-b1ae-cc9a680b7afc tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:06:28.340057 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-0fb0a34f-7734-461f-b1ae-cc9a680b7afc tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b" status: 200 len: 1669 microversion: 2.1 time: 0.578591 Oct 04 22:06:28.343384 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2345/4628] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:06:27 2022] GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b => generated 1669 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:06:28.369715 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-96607670-1da9-4448-9822-693a99c520a2 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:06:28.371014 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-96607670-1da9-4448-9822-693a99c520a2 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 48243e1b-892b-4c4b-8db1-242b2e40653b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:06:28.385170 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-96607670-1da9-4448-9822-693a99c520a2 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:28.388036 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-96607670-1da9-4448-9822-693a99c520a2 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:28.388869 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-96607670-1da9-4448-9822-693a99c520a2 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:28.389921 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-96607670-1da9-4448-9822-693a99c520a2 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:28.390681 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-96607670-1da9-4448-9822-693a99c520a2 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:28.391345 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-96607670-1da9-4448-9822-693a99c520a2 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:29.260997 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-96607670-1da9-4448-9822-693a99c520a2 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:06:29.281295 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-96607670-1da9-4448-9822-693a99c520a2 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b" status: 200 len: 1669 microversion: 2.1 time: 0.915488 Oct 04 22:06:29.303161 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2284/4629] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:06:28 2022] GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b => generated 1669 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:06:29.311681 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-d5e20244-aec2-43ef-af22-00e0006ee2c4 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-2125192988"}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:06:29.317492 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-d5e20244-aec2-43ef-af22-00e0006ee2c4 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 48243e1b-892b-4c4b-8db1-242b2e40653b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:06:29.337045 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d5e20244-aec2-43ef-af22-00e0006ee2c4 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:29.342186 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d5e20244-aec2-43ef-af22-00e0006ee2c4 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:29.342813 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d5e20244-aec2-43ef-af22-00e0006ee2c4 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:29.343857 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d5e20244-aec2-43ef-af22-00e0006ee2c4 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:29.347182 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d5e20244-aec2-43ef-af22-00e0006ee2c4 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:29.350124 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d5e20244-aec2-43ef-af22-00e0006ee2c4 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:29.897842 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-d5e20244-aec2-43ef-af22-00e0006ee2c4 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "POST /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b/action" status: 202 len: 0 microversion: 2.1 time: 0.590472 Oct 04 22:06:29.898886 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2346/4630] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 22:06:29 2022] POST /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b/action => generated 0 bytes in 596 msecs (HTTP/1.1 202) 10 headers in 456 bytes (2 switches on core 0) Oct 04 22:06:35.971217 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-84c8b165-5705-4a30-9306-9a801796af10 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-893841117", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452", "networks": [{"uuid": "a7bd6e7c-889e-4efd-baa6-25c4a61994e5"}, {"uuid": "0fbe85b8-d472-48e5-bec4-273bb39e8424"}]}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:06:36.005225 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=64 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:06:36.142272 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.network.neutron [None req-84c8b165-5705-4a30-9306-9a801796af10 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] validate_networks() for [('a7bd6e7c-889e-4efd-baa6-25c4a61994e5', None, None, None, None, None), ('0fbe85b8-d472-48e5-bec4-273bb39e8424', None, None, None, None, None)] {{(pid=134101) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 22:06:37.506092 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-528dac5b-2889-4d87-a741-708386b472d8 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:06:37.507250 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-528dac5b-2889-4d87-a741-708386b472d8 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] [instance: 9fd64a5e-1e76-4841-bf99-37ab4d2ce55a] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:06:37.532563 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-528dac5b-2889-4d87-a741-708386b472d8 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:37.533374 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-528dac5b-2889-4d87-a741-708386b472d8 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:37.534194 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-528dac5b-2889-4d87-a741-708386b472d8 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:37.544586 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-528dac5b-2889-4d87-a741-708386b472d8 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:37.545496 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-528dac5b-2889-4d87-a741-708386b472d8 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:37.561457 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-528dac5b-2889-4d87-a741-708386b472d8 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:37.615791 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-528dac5b-2889-4d87-a741-708386b472d8 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] 10.222.0.43 "GET /compute/v2.1/servers/9fd64a5e-1e76-4841-bf99-37ab4d2ce55a/ips" status: 200 len: 151 microversion: 2.1 time: 0.129275 Oct 04 22:06:37.618430 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2347/4631] 10.222.0.43 () {58 vars in 1248 bytes} [Tue Oct 4 22:06:37 2022] GET /compute/v2.1/servers/9fd64a5e-1e76-4841-bf99-37ab4d2ce55a/ips => generated 151 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:06:37.634577 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-5264ae48-8e09-489a-90d3-a755ba18ed7b tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d08ec112-2c00-4842-92cc-46ecee83c686"}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:06:37.655234 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-5264ae48-8e09-489a-90d3-a755ba18ed7b tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] [instance: 9fd64a5e-1e76-4841-bf99-37ab4d2ce55a] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:06:37.669670 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5264ae48-8e09-489a-90d3-a755ba18ed7b tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:37.670601 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5264ae48-8e09-489a-90d3-a755ba18ed7b tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:37.671419 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5264ae48-8e09-489a-90d3-a755ba18ed7b tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:37.672685 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5264ae48-8e09-489a-90d3-a755ba18ed7b tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:37.673449 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5264ae48-8e09-489a-90d3-a755ba18ed7b tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:37.674150 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5264ae48-8e09-489a-90d3-a755ba18ed7b tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:37.918103 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-5264ae48-8e09-489a-90d3-a755ba18ed7b tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] HTTP exception thrown: Invalid volume: volume d08ec112-2c00-4842-92cc-46ecee83c686 is already attached to instances: 1475392a-475f-414f-803c-e89c9ae1844a Oct 04 22:06:37.923032 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-5264ae48-8e09-489a-90d3-a755ba18ed7b tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Request method failure captured: Oct 04 22:06:37.923032 n-d-860284-1 devstack@n-api.service[134102]: request: POST /compute/v2.1/servers/9fd64a5e-1e76-4841-bf99-37ab4d2ce55a/os-volume_attachments HTTP/1.1 Oct 04 22:06:37.923032 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 22:06:37.923032 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 22:06:37.923032 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 22:06:37.923032 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 74 Oct 04 22:06:37.923032 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 22:06:37.923032 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 22:06:37.923032 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 22:06:37.923032 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 22:06:37.923032 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPK1_jKuDmdFTooG3vXwJSp1td0Kvvx-9VX1-OpwmBVV8uNR_MbJNU7EeI7sJdUoH3-0m3mmRBtTc-gLPN-qZ-RuZ8IL2TyG35svVe_hwPH0Z2c1BjkAMrt5beIkYsGbtm00-0XbqMbhJ5wgj-ztyQnhQ8ugDue3oDD_DUqnSWikZCg8 Oct 04 22:06:37.923032 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 22:06:37.923032 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 22:06:37.923032 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 22:06:37.923032 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 22:06:37.923032 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 22:06:37.923032 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 22:06:37.923032 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: 82e1a29234ce40f9b37d0eca196cd1db Oct 04 22:06:37.923032 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-AttachVolumeNegativeTest-2122228341 Oct 04 22:06:37.923032 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 22:06:37.923032 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 22:06:37.923032 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/82e1a29234ce40f9b37d0eca196cd1db"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_82e1a29234ce40f9b37d0eca196cd1db", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/82e1a29234ce40f9b37d0eca196cd1db"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/82e1a29234ce40f9b37d0eca196cd1db"}]}] Oct 04 22:06:37.923032 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-AttachVolumeNegativeTest-2122228341 Oct 04 22:06:37.923032 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: 82e1a29234ce40f9b37d0eca196cd1db Oct 04 22:06:37.923032 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2122228341 Oct 04 22:06:37.923032 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-AttachVolumeNegativeTest-2122228341-project Oct 04 22:06:37.923032 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 22:06:37.923032 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 22:06:37.923032 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: 80fc56886fef422b9b52eb1dede7d10e Oct 04 22:06:37.923032 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-AttachVolumeNegativeTest-2122228341-project Oct 04 22:06:37.923032 n-d-860284-1 devstack@n-api.service[134102]: Oct 04 22:06:37.923032 n-d-860284-1 devstack@n-api.service[134102]: {"volumeAttachment": {"volumeId": "d08ec112-2c00-4842-92cc-46ecee83c686"}} Oct 04 22:06:37.923032 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 22:06:37.923032 n-d-860284-1 devstack@n-api.service[134102]: exception: Invalid volume: volume d08ec112-2c00-4842-92cc-46ecee83c686 is already attached to instances: 1475392a-475f-414f-803c-e89c9ae1844a Oct 04 22:06:37.923032 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'server_id': '9fd64a5e-1e76-4841-bf99-37ab4d2ce55a', 'body': {'volumeAttachment': {'volumeId': 'd08ec112-2c00-4842-92cc-46ecee83c686'}}} Oct 04 22:06:37.923032 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:06:37.923032 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:06:37.923032 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 04 22:06:37.923032 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 04 22:06:37.923032 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 22:06:37.923032 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 22:06:37.923032 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 04 22:06:37.923032 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 22:06:37.923032 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 04 22:06:37.923032 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 04 22:06:37.923032 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 04 22:06:37.923032 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 04 22:06:37.923032 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume d08ec112-2c00-4842-92cc-46ecee83c686 is already attached to instances: 1475392a-475f-414f-803c-e89c9ae1844a Oct 04 22:06:37.923032 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:06:37.923032 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:06:37.923032 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:06:37.923032 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:06:37.923032 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:06:37.923032 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:06:37.923032 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:06:37.923032 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:06:37.923032 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:06:37.923032 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:06:37.923032 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 22:06:37.923032 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 22:06:37.923032 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 22:06:37.923032 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 22:06:37.927938 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 22:06:37.927938 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 22:06:37.927938 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 04 22:06:37.927938 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 04 22:06:37.927938 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume d08ec112-2c00-4842-92cc-46ecee83c686 is already attached to instances: 1475392a-475f-414f-803c-e89c9ae1844a Oct 04 22:06:37.927938 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:06:37.927938 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:06:37.927938 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:06:37.927938 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:06:37.927938 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:06:37.927938 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:06:37.927938 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:06:37.927938 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:06:37.927938 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume d08ec112-2c00-4842-92cc-46ecee83c686 is already attached to instances: 1475392a-475f-414f-803c-e89c9ae1844a Oct 04 22:06:37.927938 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:06:37.930669 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-5264ae48-8e09-489a-90d3-a755ba18ed7b tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Returning 400 to user: Invalid volume: volume d08ec112-2c00-4842-92cc-46ecee83c686 is already attached to instances: 1475392a-475f-414f-803c-e89c9ae1844a {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:06:37.934278 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-5264ae48-8e09-489a-90d3-a755ba18ed7b tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] 10.222.0.43 "POST /compute/v2.1/servers/9fd64a5e-1e76-4841-bf99-37ab4d2ce55a/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.308924 Oct 04 22:06:37.936926 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2348/4632] 10.222.0.43 () {60 vars in 1323 bytes} [Tue Oct 4 22:06:37 2022] POST /compute/v2.1/servers/9fd64a5e-1e76-4841-bf99-37ab4d2ce55a/os-volume_attachments => generated 174 bytes in 313 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 22:06:37.948367 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-231755f3-792d-40b3-a76e-010b34b9095a tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:06:37.949206 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-231755f3-792d-40b3-a76e-010b34b9095a tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] [instance: 9fd64a5e-1e76-4841-bf99-37ab4d2ce55a] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:06:37.965308 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-231755f3-792d-40b3-a76e-010b34b9095a tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:37.966139 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-231755f3-792d-40b3-a76e-010b34b9095a tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:37.966850 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-231755f3-792d-40b3-a76e-010b34b9095a tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:37.968678 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-231755f3-792d-40b3-a76e-010b34b9095a tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:37.979213 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-231755f3-792d-40b3-a76e-010b34b9095a tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:37.980035 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-231755f3-792d-40b3-a76e-010b34b9095a tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:38.030962 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-231755f3-792d-40b3-a76e-010b34b9095a tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] [instance: 9fd64a5e-1e76-4841-bf99-37ab4d2ce55a] Going to try to terminate instance {{(pid=134102) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 22:06:38.212473 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-231755f3-792d-40b3-a76e-010b34b9095a tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] 10.222.0.43 "DELETE /compute/v2.1/servers/9fd64a5e-1e76-4841-bf99-37ab4d2ce55a" status: 204 len: 0 microversion: 2.1 time: 0.268028 Oct 04 22:06:38.213579 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2349/4633] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 22:06:37 2022] DELETE /compute/v2.1/servers/9fd64a5e-1e76-4841-bf99-37ab4d2ce55a => generated 0 bytes in 270 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 22:06:38.229101 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-99926b5c-882f-4c5b-a105-b634a2d04a57 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:06:38.234201 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-99926b5c-882f-4c5b-a105-b634a2d04a57 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] [instance: 9fd64a5e-1e76-4841-bf99-37ab4d2ce55a] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:06:38.249352 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-99926b5c-882f-4c5b-a105-b634a2d04a57 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:38.250390 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-99926b5c-882f-4c5b-a105-b634a2d04a57 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:38.251641 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-99926b5c-882f-4c5b-a105-b634a2d04a57 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:38.254678 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-99926b5c-882f-4c5b-a105-b634a2d04a57 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:38.258075 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-99926b5c-882f-4c5b-a105-b634a2d04a57 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:38.258984 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-99926b5c-882f-4c5b-a105-b634a2d04a57 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:38.444198 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-84c8b165-5705-4a30-9306-9a801796af10 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Flavor limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 22:06:38.445416 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-84c8b165-5705-4a30-9306-9a801796af10 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Image limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 22:06:38.446131 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-84c8b165-5705-4a30-9306-9a801796af10 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Flavor pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 22:06:38.446812 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-84c8b165-5705-4a30-9306-9a801796af10 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Image pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 22:06:38.447466 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-84c8b165-5705-4a30-9306-9a801796af10 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 22:06:38.470593 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-84c8b165-5705-4a30-9306-9a801796af10 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:38.471581 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-84c8b165-5705-4a30-9306-9a801796af10 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:38.472846 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-84c8b165-5705-4a30-9306-9a801796af10 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:38.474249 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-84c8b165-5705-4a30-9306-9a801796af10 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:38.475131 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-84c8b165-5705-4a30-9306-9a801796af10 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:38.475857 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-84c8b165-5705-4a30-9306-9a801796af10 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:38.543388 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-84c8b165-5705-4a30-9306-9a801796af10 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Getting quotas for project a555982bb6f841d7a72b6eca84a6150f. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:06:38.570444 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-84c8b165-5705-4a30-9306-9a801796af10 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Getting quotas for user 4cd0931292c245578bea8861f9ba7607 and project a555982bb6f841d7a72b6eca84a6150f. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:06:38.625105 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-84c8b165-5705-4a30-9306-9a801796af10 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Going to run 1 instances... {{(pid=134101) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 22:06:38.632815 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-84c8b165-5705-4a30-9306-9a801796af10 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] [instance: 9d592615-a510-440d-9f41-8476fee6f370] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='58548514-5dac-426c-81f5-19e3fba33e23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134101) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 22:06:38.795713 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-84c8b165-5705-4a30-9306-9a801796af10 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.830173 Oct 04 22:06:38.797808 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2285/4634] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 22:06:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 2833 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 22:06:38.833803 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-8c7b2231-2496-4860-b7f5-1edc2c72e494 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:06:38.842959 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-8c7b2231-2496-4860-b7f5-1edc2c72e494 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] [instance: 9d592615-a510-440d-9f41-8476fee6f370] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:06:39.118147 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-8c7b2231-2496-4860-b7f5-1edc2c72e494 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cd0931292c245578bea8861f9ba7607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a555982bb6f841d7a72b6eca84a6150f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:06:39.123325 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-99926b5c-882f-4c5b-a105-b634a2d04a57 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80fc56886fef422b9b52eb1dede7d10e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82e1a29234ce40f9b37d0eca196cd1db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:06:39.137949 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-99926b5c-882f-4c5b-a105-b634a2d04a57 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] 10.222.0.43 "GET /compute/v2.1/servers/9fd64a5e-1e76-4841-bf99-37ab4d2ce55a" status: 200 len: 1683 microversion: 2.1 time: 0.916587 Oct 04 22:06:39.150102 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-8c7b2231-2496-4860-b7f5-1edc2c72e494 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] 10.222.0.43 "GET /compute/v2.1/servers/9d592615-a510-440d-9f41-8476fee6f370" status: 200 len: 1212 microversion: 2.1 time: 0.341127 Oct 04 22:06:39.152654 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2286/4635] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:06:38 2022] GET /compute/v2.1/servers/9d592615-a510-440d-9f41-8476fee6f370 => generated 1212 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:06:39.166817 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2350/4636] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:06:38 2022] GET /compute/v2.1/servers/9fd64a5e-1e76-4841-bf99-37ab4d2ce55a => generated 1683 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:06:40.169004 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-7489c8ea-47f6-499d-8667-c8333875311d tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:06:40.170569 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-7489c8ea-47f6-499d-8667-c8333875311d tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] [instance: 9fd64a5e-1e76-4841-bf99-37ab4d2ce55a] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:06:40.179406 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-02dcd097-b017-40cb-b9bb-b023eed8ae7c tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:06:40.180722 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-02dcd097-b017-40cb-b9bb-b023eed8ae7c tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] [instance: 9d592615-a510-440d-9f41-8476fee6f370] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:06:40.196610 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=2 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:06:40.200162 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7489c8ea-47f6-499d-8667-c8333875311d tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:40.204484 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-02dcd097-b017-40cb-b9bb-b023eed8ae7c tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:40.205428 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7489c8ea-47f6-499d-8667-c8333875311d tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:40.206948 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7489c8ea-47f6-499d-8667-c8333875311d tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:40.208069 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-02dcd097-b017-40cb-b9bb-b023eed8ae7c tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:40.211356 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7489c8ea-47f6-499d-8667-c8333875311d tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:40.212159 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-02dcd097-b017-40cb-b9bb-b023eed8ae7c tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:40.215191 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7489c8ea-47f6-499d-8667-c8333875311d tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:40.216314 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-02dcd097-b017-40cb-b9bb-b023eed8ae7c tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:40.216979 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7489c8ea-47f6-499d-8667-c8333875311d tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:40.217658 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-02dcd097-b017-40cb-b9bb-b023eed8ae7c tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:40.222729 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-02dcd097-b017-40cb-b9bb-b023eed8ae7c tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:40.652247 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-02dcd097-b017-40cb-b9bb-b023eed8ae7c tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cd0931292c245578bea8861f9ba7607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a555982bb6f841d7a72b6eca84a6150f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:06:40.675328 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-02dcd097-b017-40cb-b9bb-b023eed8ae7c tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] 10.222.0.43 "GET /compute/v2.1/servers/9d592615-a510-440d-9f41-8476fee6f370" status: 200 len: 1264 microversion: 2.1 time: 0.500540 Oct 04 22:06:40.678982 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2351/4637] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:06:40 2022] GET /compute/v2.1/servers/9d592615-a510-440d-9f41-8476fee6f370 => generated 1264 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:06:40.949759 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-7489c8ea-47f6-499d-8667-c8333875311d tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80fc56886fef422b9b52eb1dede7d10e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82e1a29234ce40f9b37d0eca196cd1db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:06:40.970133 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-7489c8ea-47f6-499d-8667-c8333875311d tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] 10.222.0.43 "GET /compute/v2.1/servers/9fd64a5e-1e76-4841-bf99-37ab4d2ce55a" status: 200 len: 1683 microversion: 2.1 time: 0.805433 Oct 04 22:06:40.976993 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2287/4638] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:06:40 2022] GET /compute/v2.1/servers/9fd64a5e-1e76-4841-bf99-37ab4d2ce55a => generated 1683 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:06:41.710250 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-e6e1bad9-fb8e-40b3-b78d-6e39152dca64 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:06:41.711017 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-e6e1bad9-fb8e-40b3-b78d-6e39152dca64 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] [instance: 9d592615-a510-440d-9f41-8476fee6f370] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:06:41.727447 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e6e1bad9-fb8e-40b3-b78d-6e39152dca64 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:41.728257 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e6e1bad9-fb8e-40b3-b78d-6e39152dca64 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:41.728992 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e6e1bad9-fb8e-40b3-b78d-6e39152dca64 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:41.730995 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e6e1bad9-fb8e-40b3-b78d-6e39152dca64 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:41.731795 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e6e1bad9-fb8e-40b3-b78d-6e39152dca64 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:41.732591 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e6e1bad9-fb8e-40b3-b78d-6e39152dca64 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:41.908418 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-e6e1bad9-fb8e-40b3-b78d-6e39152dca64 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cd0931292c245578bea8861f9ba7607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a555982bb6f841d7a72b6eca84a6150f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:06:41.920875 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-e6e1bad9-fb8e-40b3-b78d-6e39152dca64 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] 10.222.0.43 "GET /compute/v2.1/servers/9d592615-a510-440d-9f41-8476fee6f370" status: 200 len: 1270 microversion: 2.1 time: 0.218204 Oct 04 22:06:41.952057 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2352/4639] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:06:41 2022] GET /compute/v2.1/servers/9d592615-a510-440d-9f41-8476fee6f370 => generated 1270 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:06:42.000670 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-4dc8fcb5-51d5-4244-a162-d86242d7e1ba tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:06:42.001869 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-4dc8fcb5-51d5-4244-a162-d86242d7e1ba tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] [instance: 9fd64a5e-1e76-4841-bf99-37ab4d2ce55a] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:06:42.038426 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4dc8fcb5-51d5-4244-a162-d86242d7e1ba tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:42.043986 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4dc8fcb5-51d5-4244-a162-d86242d7e1ba tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:42.044851 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4dc8fcb5-51d5-4244-a162-d86242d7e1ba tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:42.045861 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4dc8fcb5-51d5-4244-a162-d86242d7e1ba tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:42.046708 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4dc8fcb5-51d5-4244-a162-d86242d7e1ba tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:42.048136 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4dc8fcb5-51d5-4244-a162-d86242d7e1ba tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:42.460546 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-4dc8fcb5-51d5-4244-a162-d86242d7e1ba tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80fc56886fef422b9b52eb1dede7d10e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82e1a29234ce40f9b37d0eca196cd1db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:06:42.469507 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-4dc8fcb5-51d5-4244-a162-d86242d7e1ba tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] 10.222.0.43 "GET /compute/v2.1/servers/9fd64a5e-1e76-4841-bf99-37ab4d2ce55a" status: 200 len: 1683 microversion: 2.1 time: 0.473382 Oct 04 22:06:42.470765 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2288/4640] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:06:41 2022] GET /compute/v2.1/servers/9fd64a5e-1e76-4841-bf99-37ab4d2ce55a => generated 1683 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:06:42.712173 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-0c4b2050-596c-4d54-803e-fdcd414c745b req-72b1f581-af65-4546-86ae-f9b562acfa22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48243e1b-892b-4c4b-8db1-242b2e40653b", "name": "network-vif-plugged", "status": "completed", "tag": "a795c088-46ba-4a15-a651-33aa842e29b5"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:06:42.743581 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-0c4b2050-596c-4d54-803e-fdcd414c745b req-72b1f581-af65-4546-86ae-f9b562acfa22 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:42.744073 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-0c4b2050-596c-4d54-803e-fdcd414c745b req-72b1f581-af65-4546-86ae-f9b562acfa22 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:42.750329 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-0c4b2050-596c-4d54-803e-fdcd414c745b req-72b1f581-af65-4546-86ae-f9b562acfa22 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:42.797238 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-0c4b2050-596c-4d54-803e-fdcd414c745b req-72b1f581-af65-4546-86ae-f9b562acfa22 service nova] Creating event network-vif-plugged:a795c088-46ba-4a15-a651-33aa842e29b5 for instance 48243e1b-892b-4c4b-8db1-242b2e40653b on n-h1-860284-1 Oct 04 22:06:42.826286 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-0c4b2050-596c-4d54-803e-fdcd414c745b req-72b1f581-af65-4546-86ae-f9b562acfa22 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114562 Oct 04 22:06:42.831738 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2353/4641] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:06:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:06:42.963087 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-c2b16505-3f8f-4330-962f-e9515b6e1657 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:06:42.964570 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-c2b16505-3f8f-4330-962f-e9515b6e1657 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] [instance: 9d592615-a510-440d-9f41-8476fee6f370] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:06:42.980074 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c2b16505-3f8f-4330-962f-e9515b6e1657 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:42.980601 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c2b16505-3f8f-4330-962f-e9515b6e1657 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:42.981113 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c2b16505-3f8f-4330-962f-e9515b6e1657 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:42.981888 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c2b16505-3f8f-4330-962f-e9515b6e1657 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:42.982399 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c2b16505-3f8f-4330-962f-e9515b6e1657 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:42.982831 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c2b16505-3f8f-4330-962f-e9515b6e1657 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:43.265616 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-c2b16505-3f8f-4330-962f-e9515b6e1657 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cd0931292c245578bea8861f9ba7607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a555982bb6f841d7a72b6eca84a6150f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:06:43.278861 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-c2b16505-3f8f-4330-962f-e9515b6e1657 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] 10.222.0.43 "GET /compute/v2.1/servers/9d592615-a510-440d-9f41-8476fee6f370" status: 200 len: 1270 microversion: 2.1 time: 0.319879 Oct 04 22:06:43.306665 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2289/4642] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:06:42 2022] GET /compute/v2.1/servers/9d592615-a510-440d-9f41-8476fee6f370 => generated 1270 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:06:43.496839 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-1cae1318-a983-46b1-b7a9-f87ded2529fd tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:06:43.497740 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-1cae1318-a983-46b1-b7a9-f87ded2529fd tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] [instance: 9fd64a5e-1e76-4841-bf99-37ab4d2ce55a] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:06:43.507814 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1cae1318-a983-46b1-b7a9-f87ded2529fd tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:43.513336 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1cae1318-a983-46b1-b7a9-f87ded2529fd tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:43.514053 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1cae1318-a983-46b1-b7a9-f87ded2529fd tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:43.515093 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1cae1318-a983-46b1-b7a9-f87ded2529fd tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:43.515742 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1cae1318-a983-46b1-b7a9-f87ded2529fd tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:43.516380 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1cae1318-a983-46b1-b7a9-f87ded2529fd tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:43.830789 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-1cae1318-a983-46b1-b7a9-f87ded2529fd tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80fc56886fef422b9b52eb1dede7d10e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82e1a29234ce40f9b37d0eca196cd1db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:06:43.839510 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-1cae1318-a983-46b1-b7a9-f87ded2529fd tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] 10.222.0.43 "GET /compute/v2.1/servers/9fd64a5e-1e76-4841-bf99-37ab4d2ce55a" status: 200 len: 1683 microversion: 2.1 time: 0.347628 Oct 04 22:06:43.854638 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2354/4643] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:06:43 2022] GET /compute/v2.1/servers/9fd64a5e-1e76-4841-bf99-37ab4d2ce55a => generated 1683 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:06:44.317021 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-684b5960-eed5-41bb-a928-1c66937f6f8e tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:06:44.319208 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-684b5960-eed5-41bb-a928-1c66937f6f8e tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] [instance: 9d592615-a510-440d-9f41-8476fee6f370] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:06:44.344814 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-684b5960-eed5-41bb-a928-1c66937f6f8e tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:44.351463 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-684b5960-eed5-41bb-a928-1c66937f6f8e tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:44.354683 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-684b5960-eed5-41bb-a928-1c66937f6f8e tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:44.357974 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-684b5960-eed5-41bb-a928-1c66937f6f8e tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:44.362492 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-684b5960-eed5-41bb-a928-1c66937f6f8e tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:44.371180 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-684b5960-eed5-41bb-a928-1c66937f6f8e tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:44.834746 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-92c6a4f6-086c-41b5-9ae6-40a2f55b24d6 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "06c5b346-db5e-4e76-be3f-495fbaea7d71", "device": "/dev/sdb"}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:06:44.839541 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-92c6a4f6-086c-41b5-9ae6-40a2f55b24d6 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] [instance: 92d3d7e9-8a75-4e07-812c-8b9f441e0376] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:06:44.871428 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-92c6a4f6-086c-41b5-9ae6-40a2f55b24d6 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:44.872065 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-92c6a4f6-086c-41b5-9ae6-40a2f55b24d6 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:44.876027 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-92c6a4f6-086c-41b5-9ae6-40a2f55b24d6 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:44.876982 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-92c6a4f6-086c-41b5-9ae6-40a2f55b24d6 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:44.877335 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-92c6a4f6-086c-41b5-9ae6-40a2f55b24d6 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:44.880028 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-92c6a4f6-086c-41b5-9ae6-40a2f55b24d6 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:44.898243 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-684b5960-eed5-41bb-a928-1c66937f6f8e tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cd0931292c245578bea8861f9ba7607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a555982bb6f841d7a72b6eca84a6150f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:06:44.907549 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-684b5960-eed5-41bb-a928-1c66937f6f8e tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] 10.222.0.43 "GET /compute/v2.1/servers/9d592615-a510-440d-9f41-8476fee6f370" status: 200 len: 1270 microversion: 2.1 time: 0.597577 Oct 04 22:06:44.927138 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2290/4644] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:06:44 2022] GET /compute/v2.1/servers/9d592615-a510-440d-9f41-8476fee6f370 => generated 1270 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:06:44.940393 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e5ef7b3c-e93c-47cb-b47d-c7b6ea94b781 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:06:44.949539 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-e5ef7b3c-e93c-47cb-b47d-c7b6ea94b781 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] [instance: 9fd64a5e-1e76-4841-bf99-37ab4d2ce55a] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:06:44.977615 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e5ef7b3c-e93c-47cb-b47d-c7b6ea94b781 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:44.978207 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e5ef7b3c-e93c-47cb-b47d-c7b6ea94b781 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:44.978832 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e5ef7b3c-e93c-47cb-b47d-c7b6ea94b781 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:44.980116 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e5ef7b3c-e93c-47cb-b47d-c7b6ea94b781 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:44.980973 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e5ef7b3c-e93c-47cb-b47d-c7b6ea94b781 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:45.002041 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e5ef7b3c-e93c-47cb-b47d-c7b6ea94b781 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:45.314028 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-e5ef7b3c-e93c-47cb-b47d-c7b6ea94b781 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80fc56886fef422b9b52eb1dede7d10e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82e1a29234ce40f9b37d0eca196cd1db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:06:45.330133 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-e5ef7b3c-e93c-47cb-b47d-c7b6ea94b781 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] 10.222.0.43 "GET /compute/v2.1/servers/9fd64a5e-1e76-4841-bf99-37ab4d2ce55a" status: 200 len: 1615 microversion: 2.1 time: 0.401365 Oct 04 22:06:45.360608 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2291/4645] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:06:44 2022] GET /compute/v2.1/servers/9fd64a5e-1e76-4841-bf99-37ab4d2ce55a => generated 1615 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:06:45.608047 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-92c6a4f6-086c-41b5-9ae6-40a2f55b24d6 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] 10.222.0.43 "POST /compute/v2.1/servers/92d3d7e9-8a75-4e07-812c-8b9f441e0376/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.777954 Oct 04 22:06:45.608879 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2355/4646] 10.222.0.43 () {60 vars in 1323 bytes} [Tue Oct 4 22:06:44 2022] POST /compute/v2.1/servers/92d3d7e9-8a75-4e07-812c-8b9f441e0376/os-volume_attachments => generated 194 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:06:45.946531 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-7327eac8-24d2-4f1b-854a-9be3afc5debc tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:06:45.947164 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-7327eac8-24d2-4f1b-854a-9be3afc5debc tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] [instance: 9d592615-a510-440d-9f41-8476fee6f370] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:06:45.966740 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7327eac8-24d2-4f1b-854a-9be3afc5debc tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:45.967673 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7327eac8-24d2-4f1b-854a-9be3afc5debc tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:45.968338 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7327eac8-24d2-4f1b-854a-9be3afc5debc tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:45.970089 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7327eac8-24d2-4f1b-854a-9be3afc5debc tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:45.970877 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7327eac8-24d2-4f1b-854a-9be3afc5debc tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:45.971534 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7327eac8-24d2-4f1b-854a-9be3afc5debc tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:46.117296 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-7327eac8-24d2-4f1b-854a-9be3afc5debc tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cd0931292c245578bea8861f9ba7607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a555982bb6f841d7a72b6eca84a6150f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:06:46.142823 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-7327eac8-24d2-4f1b-854a-9be3afc5debc tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] 10.222.0.43 "GET /compute/v2.1/servers/9d592615-a510-440d-9f41-8476fee6f370" status: 200 len: 1270 microversion: 2.1 time: 0.197390 Oct 04 22:06:46.144648 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2292/4647] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:06:45 2022] GET /compute/v2.1/servers/9d592615-a510-440d-9f41-8476fee6f370 => generated 1270 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:06:46.385975 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-5046700c-e0e5-4332-b984-26a60d0b621e tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:06:46.386721 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-5046700c-e0e5-4332-b984-26a60d0b621e tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] [instance: 9fd64a5e-1e76-4841-bf99-37ab4d2ce55a] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:06:46.406350 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5046700c-e0e5-4332-b984-26a60d0b621e tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:46.406889 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5046700c-e0e5-4332-b984-26a60d0b621e tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:46.407338 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5046700c-e0e5-4332-b984-26a60d0b621e tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:46.408086 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5046700c-e0e5-4332-b984-26a60d0b621e tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:46.408555 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5046700c-e0e5-4332-b984-26a60d0b621e tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:46.408991 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5046700c-e0e5-4332-b984-26a60d0b621e tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:46.524608 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-5046700c-e0e5-4332-b984-26a60d0b621e tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80fc56886fef422b9b52eb1dede7d10e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82e1a29234ce40f9b37d0eca196cd1db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:06:46.540473 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-5046700c-e0e5-4332-b984-26a60d0b621e tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] 10.222.0.43 "GET /compute/v2.1/servers/9fd64a5e-1e76-4841-bf99-37ab4d2ce55a" status: 200 len: 1615 microversion: 2.1 time: 0.159494 Oct 04 22:06:46.545962 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2356/4648] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:06:46 2022] GET /compute/v2.1/servers/9fd64a5e-1e76-4841-bf99-37ab4d2ce55a => generated 1615 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:06:47.170798 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-7a5c5106-3418-4a34-ba5a-095d81be3c82 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:06:47.171626 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-7a5c5106-3418-4a34-ba5a-095d81be3c82 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] [instance: 9d592615-a510-440d-9f41-8476fee6f370] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:06:47.192196 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7a5c5106-3418-4a34-ba5a-095d81be3c82 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:47.202438 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7a5c5106-3418-4a34-ba5a-095d81be3c82 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:47.206284 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7a5c5106-3418-4a34-ba5a-095d81be3c82 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:47.213104 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7a5c5106-3418-4a34-ba5a-095d81be3c82 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:47.221219 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7a5c5106-3418-4a34-ba5a-095d81be3c82 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:47.223795 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7a5c5106-3418-4a34-ba5a-095d81be3c82 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:47.574147 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-d5279b46-1f62-4a5f-b28c-511edae36c29 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:06:47.574854 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-d5279b46-1f62-4a5f-b28c-511edae36c29 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] [instance: 9fd64a5e-1e76-4841-bf99-37ab4d2ce55a] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:06:47.586922 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d5279b46-1f62-4a5f-b28c-511edae36c29 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:47.596459 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d5279b46-1f62-4a5f-b28c-511edae36c29 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:47.597282 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d5279b46-1f62-4a5f-b28c-511edae36c29 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:47.601513 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d5279b46-1f62-4a5f-b28c-511edae36c29 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:47.603453 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d5279b46-1f62-4a5f-b28c-511edae36c29 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:47.610726 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d5279b46-1f62-4a5f-b28c-511edae36c29 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:48.341378 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-d5279b46-1f62-4a5f-b28c-511edae36c29 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80fc56886fef422b9b52eb1dede7d10e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82e1a29234ce40f9b37d0eca196cd1db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:06:48.349163 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:06:48.357723 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-d5279b46-1f62-4a5f-b28c-511edae36c29 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] 10.222.0.43 "GET /compute/v2.1/servers/9fd64a5e-1e76-4841-bf99-37ab4d2ce55a" status: 200 len: 1615 microversion: 2.1 time: 0.787544 Oct 04 22:06:48.358828 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2357/4649] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:06:47 2022] GET /compute/v2.1/servers/9fd64a5e-1e76-4841-bf99-37ab4d2ce55a => generated 1615 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:06:48.517097 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=2 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:06:48.526060 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-7a5c5106-3418-4a34-ba5a-095d81be3c82 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cd0931292c245578bea8861f9ba7607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a555982bb6f841d7a72b6eca84a6150f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:06:48.582218 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-7a5c5106-3418-4a34-ba5a-095d81be3c82 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] 10.222.0.43 "GET /compute/v2.1/servers/9d592615-a510-440d-9f41-8476fee6f370" status: 200 len: 1312 microversion: 2.1 time: 1.411627 Oct 04 22:06:48.586593 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2293/4650] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:06:47 2022] GET /compute/v2.1/servers/9d592615-a510-440d-9f41-8476fee6f370 => generated 1312 bytes in 1420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:06:49.220243 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-b77ce5c2-9d25-4e86-8cca-c55c0643efde req-ad56c3b4-5a92-454f-8cb6-413b281f3f63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fd64a5e-1e76-4841-bf99-37ab4d2ce55a", "name": "network-vif-deleted", "tag": "dbf78af7-5b9d-4366-ac1b-b66ca10a6554"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:06:49.243422 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-b77ce5c2-9d25-4e86-8cca-c55c0643efde req-ad56c3b4-5a92-454f-8cb6-413b281f3f63 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:49.258227 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-b77ce5c2-9d25-4e86-8cca-c55c0643efde req-ad56c3b4-5a92-454f-8cb6-413b281f3f63 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:49.259302 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-b77ce5c2-9d25-4e86-8cca-c55c0643efde req-ad56c3b4-5a92-454f-8cb6-413b281f3f63 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:49.289496 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-b77ce5c2-9d25-4e86-8cca-c55c0643efde req-ad56c3b4-5a92-454f-8cb6-413b281f3f63 service nova] Creating event network-vif-deleted:dbf78af7-5b9d-4366-ac1b-b66ca10a6554 for instance 9fd64a5e-1e76-4841-bf99-37ab4d2ce55a on n-h1-860284-1 Oct 04 22:06:49.304236 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-b77ce5c2-9d25-4e86-8cca-c55c0643efde req-ad56c3b4-5a92-454f-8cb6-413b281f3f63 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088004 Oct 04 22:06:49.307678 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2358/4651] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:06:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:06:49.403928 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-fc987580-4c09-4dde-8428-224e74b5e17f tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:06:49.404468 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-fc987580-4c09-4dde-8428-224e74b5e17f tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] [instance: 9fd64a5e-1e76-4841-bf99-37ab4d2ce55a] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:06:49.406425 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=8 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:06:49.423972 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fc987580-4c09-4dde-8428-224e74b5e17f tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:49.431024 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fc987580-4c09-4dde-8428-224e74b5e17f tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:49.431858 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fc987580-4c09-4dde-8428-224e74b5e17f tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:49.432850 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fc987580-4c09-4dde-8428-224e74b5e17f tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:49.433875 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fc987580-4c09-4dde-8428-224e74b5e17f tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:49.434526 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fc987580-4c09-4dde-8428-224e74b5e17f tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:49.520739 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fc987580-4c09-4dde-8428-224e74b5e17f tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:49.521940 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fc987580-4c09-4dde-8428-224e74b5e17f tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:49.527308 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fc987580-4c09-4dde-8428-224e74b5e17f tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:49.528029 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.objects.instance [None req-fc987580-4c09-4dde-8428-224e74b5e17f tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lazy-loading 'fault' on Instance uuid 9fd64a5e-1e76-4841-bf99-37ab4d2ce55a {{(pid=134101) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 22:06:49.530352 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=74 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:06:49.619268 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-deeb28ae-8edc-45b5-8a78-4fcc077f9d94 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:06:49.620374 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-deeb28ae-8edc-45b5-8a78-4fcc077f9d94 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] [instance: 9d592615-a510-440d-9f41-8476fee6f370] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:06:49.639692 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-deeb28ae-8edc-45b5-8a78-4fcc077f9d94 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:49.641756 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-deeb28ae-8edc-45b5-8a78-4fcc077f9d94 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:49.644105 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-deeb28ae-8edc-45b5-8a78-4fcc077f9d94 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:49.645592 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-deeb28ae-8edc-45b5-8a78-4fcc077f9d94 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:49.647770 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-deeb28ae-8edc-45b5-8a78-4fcc077f9d94 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:49.649154 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-deeb28ae-8edc-45b5-8a78-4fcc077f9d94 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:50.044679 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-fc987580-4c09-4dde-8428-224e74b5e17f tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80fc56886fef422b9b52eb1dede7d10e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82e1a29234ce40f9b37d0eca196cd1db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:06:50.052718 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-fc987580-4c09-4dde-8428-224e74b5e17f tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] 10.222.0.43 "GET /compute/v2.1/servers/9fd64a5e-1e76-4841-bf99-37ab4d2ce55a" status: 200 len: 1331 microversion: 2.1 time: 0.653157 Oct 04 22:06:50.053926 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2294/4652] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:06:49 2022] GET /compute/v2.1/servers/9fd64a5e-1e76-4841-bf99-37ab4d2ce55a => generated 1331 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:06:50.260709 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-deeb28ae-8edc-45b5-8a78-4fcc077f9d94 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cd0931292c245578bea8861f9ba7607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a555982bb6f841d7a72b6eca84a6150f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:06:50.274704 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-deeb28ae-8edc-45b5-8a78-4fcc077f9d94 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] 10.222.0.43 "GET /compute/v2.1/servers/9d592615-a510-440d-9f41-8476fee6f370" status: 200 len: 1312 microversion: 2.1 time: 0.664184 Oct 04 22:06:50.294799 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2359/4653] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:06:49 2022] GET /compute/v2.1/servers/9d592615-a510-440d-9f41-8476fee6f370 => generated 1312 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:06:51.099368 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-fc88c2ab-0a07-4cc4-bce8-4028f514960a tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:06:51.101478 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-fc88c2ab-0a07-4cc4-bce8-4028f514960a tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] [instance: 9fd64a5e-1e76-4841-bf99-37ab4d2ce55a] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:06:51.117880 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fc88c2ab-0a07-4cc4-bce8-4028f514960a tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:51.118707 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fc88c2ab-0a07-4cc4-bce8-4028f514960a tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:51.119548 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fc88c2ab-0a07-4cc4-bce8-4028f514960a tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:51.120452 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fc88c2ab-0a07-4cc4-bce8-4028f514960a tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:51.123889 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fc88c2ab-0a07-4cc4-bce8-4028f514960a tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:51.127172 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fc88c2ab-0a07-4cc4-bce8-4028f514960a tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:51.178179 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-fc88c2ab-0a07-4cc4-bce8-4028f514960a tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] HTTP exception thrown: Instance 9fd64a5e-1e76-4841-bf99-37ab4d2ce55a could not be found. Oct 04 22:06:51.179946 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-fc88c2ab-0a07-4cc4-bce8-4028f514960a tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Request method failure captured: Oct 04 22:06:51.179946 n-d-860284-1 devstack@n-api.service[134101]: request: GET /compute/v2.1/servers/9fd64a5e-1e76-4841-bf99-37ab4d2ce55a HTTP/1.1 Oct 04 22:06:51.179946 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 22:06:51.179946 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 22:06:51.179946 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 22:06:51.179946 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 22:06:51.179946 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 22:06:51.179946 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 22:06:51.179946 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 22:06:51.179946 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 22:06:51.179946 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPK1_jKuDmdFTooG3vXwJSp1td0Kvvx-9VX1-OpwmBVV8uNR_MbJNU7EeI7sJdUoH3-0m3mmRBtTc-gLPN-qZ-RuZ8IL2TyG35svVe_hwPH0Z2c1BjkAMrt5beIkYsGbtm00-0XbqMbhJ5wgj-ztyQnhQ8ugDue3oDD_DUqnSWikZCg8 Oct 04 22:06:51.179946 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 22:06:51.179946 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 22:06:51.179946 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 22:06:51.179946 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 22:06:51.179946 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 22:06:51.179946 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 22:06:51.179946 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: 82e1a29234ce40f9b37d0eca196cd1db Oct 04 22:06:51.179946 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-AttachVolumeNegativeTest-2122228341 Oct 04 22:06:51.179946 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 22:06:51.179946 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 22:06:51.179946 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/82e1a29234ce40f9b37d0eca196cd1db"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_82e1a29234ce40f9b37d0eca196cd1db", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/82e1a29234ce40f9b37d0eca196cd1db"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/82e1a29234ce40f9b37d0eca196cd1db"}]}] Oct 04 22:06:51.179946 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-AttachVolumeNegativeTest-2122228341 Oct 04 22:06:51.179946 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: 82e1a29234ce40f9b37d0eca196cd1db Oct 04 22:06:51.179946 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2122228341 Oct 04 22:06:51.179946 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-AttachVolumeNegativeTest-2122228341-project Oct 04 22:06:51.179946 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 22:06:51.179946 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 22:06:51.179946 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 80fc56886fef422b9b52eb1dede7d10e Oct 04 22:06:51.179946 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-AttachVolumeNegativeTest-2122228341-project Oct 04 22:06:51.179946 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 22:06:51.179946 n-d-860284-1 devstack@n-api.service[134101]: exception: Instance 9fd64a5e-1e76-4841-bf99-37ab4d2ce55a could not be found. Oct 04 22:06:51.179946 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': '9fd64a5e-1e76-4841-bf99-37ab4d2ce55a'} Oct 04 22:06:51.179946 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:06:51.179946 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:06:51.179946 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:06:51.179946 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:06:51.179946 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:06:51.179946 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:06:51.179946 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:06:51.179946 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:06:51.179946 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:06:51.179946 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:06:51.179946 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9fd64a5e-1e76-4841-bf99-37ab4d2ce55a could not be found. Oct 04 22:06:51.179946 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:06:51.179946 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:06:51.179946 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:06:51.179946 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:06:51.179946 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:06:51.179946 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:06:51.179946 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:06:51.179946 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:06:51.179946 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:06:51.179946 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:06:51.179946 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:06:51.179946 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:06:51.179946 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:06:51.179946 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:06:51.179946 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:06:51.179946 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:06:51.179946 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9fd64a5e-1e76-4841-bf99-37ab4d2ce55a could not be found. Oct 04 22:06:51.179946 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:06:51.179946 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:06:51.179946 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:06:51.185134 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:06:51.185134 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:06:51.185134 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:06:51.185134 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:06:51.185134 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:06:51.185134 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9fd64a5e-1e76-4841-bf99-37ab4d2ce55a could not be found. Oct 04 22:06:51.185134 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:06:51.191886 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-fc88c2ab-0a07-4cc4-bce8-4028f514960a tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Returning 404 to user: Instance 9fd64a5e-1e76-4841-bf99-37ab4d2ce55a could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:06:51.194896 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-fc88c2ab-0a07-4cc4-bce8-4028f514960a tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] 10.222.0.43 "GET /compute/v2.1/servers/9fd64a5e-1e76-4841-bf99-37ab4d2ce55a" status: 404 len: 111 microversion: 2.1 time: 0.117638 Oct 04 22:06:51.202275 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2295/4654] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:06:51 2022] GET /compute/v2.1/servers/9fd64a5e-1e76-4841-bf99-37ab4d2ce55a => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:06:51.205052 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-c271628c-0536-4e68-b30d-46e030b0641a tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Calling method '.version_select at 0x7fbb2e5fddc0>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:06:51.268810 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-c271628c-0536-4e68-b30d-46e030b0641a tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-466635076" status: 202 len: 0 microversion: 2.1 time: 0.067519 Oct 04 22:06:51.270774 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2360/4655] 10.222.0.43 () {58 vars in 1218 bytes} [Tue Oct 4 22:06:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-466635076 => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 22:06:51.302101 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e0d49883-2662-45be-8d68-f5647ee2a00c tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:06:51.302970 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-e0d49883-2662-45be-8d68-f5647ee2a00c tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] [instance: 9d592615-a510-440d-9f41-8476fee6f370] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:06:51.321184 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e0d49883-2662-45be-8d68-f5647ee2a00c tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:51.326636 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e0d49883-2662-45be-8d68-f5647ee2a00c tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:51.328609 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e0d49883-2662-45be-8d68-f5647ee2a00c tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:51.333270 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e0d49883-2662-45be-8d68-f5647ee2a00c tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:51.339010 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e0d49883-2662-45be-8d68-f5647ee2a00c tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:51.341196 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e0d49883-2662-45be-8d68-f5647ee2a00c tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:52.362650 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-e0d49883-2662-45be-8d68-f5647ee2a00c tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cd0931292c245578bea8861f9ba7607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a555982bb6f841d7a72b6eca84a6150f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:06:52.375996 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-e0d49883-2662-45be-8d68-f5647ee2a00c tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] 10.222.0.43 "GET /compute/v2.1/servers/9d592615-a510-440d-9f41-8476fee6f370" status: 200 len: 1312 microversion: 2.1 time: 1.078702 Oct 04 22:06:52.377294 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2296/4656] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:06:51 2022] GET /compute/v2.1/servers/9d592615-a510-440d-9f41-8476fee6f370 => generated 1312 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:06:53.404604 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-426e7ebf-2248-4f02-b7a0-db43970fdcd1 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:06:53.405229 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-426e7ebf-2248-4f02-b7a0-db43970fdcd1 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] [instance: 9d592615-a510-440d-9f41-8476fee6f370] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:06:53.426850 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-426e7ebf-2248-4f02-b7a0-db43970fdcd1 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:53.434690 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-426e7ebf-2248-4f02-b7a0-db43970fdcd1 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:53.436862 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-426e7ebf-2248-4f02-b7a0-db43970fdcd1 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:53.440706 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-426e7ebf-2248-4f02-b7a0-db43970fdcd1 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:53.441710 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-426e7ebf-2248-4f02-b7a0-db43970fdcd1 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:53.442333 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-426e7ebf-2248-4f02-b7a0-db43970fdcd1 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:54.131755 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-426e7ebf-2248-4f02-b7a0-db43970fdcd1 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cd0931292c245578bea8861f9ba7607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a555982bb6f841d7a72b6eca84a6150f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:06:54.160862 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-426e7ebf-2248-4f02-b7a0-db43970fdcd1 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] 10.222.0.43 "GET /compute/v2.1/servers/9d592615-a510-440d-9f41-8476fee6f370" status: 200 len: 1312 microversion: 2.1 time: 0.759745 Oct 04 22:06:54.168319 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2361/4657] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:06:53 2022] GET /compute/v2.1/servers/9d592615-a510-440d-9f41-8476fee6f370 => generated 1312 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:06:55.191910 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-2fcb2207-bd9f-4525-a356-bc5eda870d2f tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:06:55.194478 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-2fcb2207-bd9f-4525-a356-bc5eda870d2f tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] [instance: 9d592615-a510-440d-9f41-8476fee6f370] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:06:55.208790 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2fcb2207-bd9f-4525-a356-bc5eda870d2f tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:55.209682 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2fcb2207-bd9f-4525-a356-bc5eda870d2f tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:55.210300 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2fcb2207-bd9f-4525-a356-bc5eda870d2f tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:55.211265 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2fcb2207-bd9f-4525-a356-bc5eda870d2f tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:55.211898 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2fcb2207-bd9f-4525-a356-bc5eda870d2f tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:55.212494 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2fcb2207-bd9f-4525-a356-bc5eda870d2f tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:56.171437 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-2fcb2207-bd9f-4525-a356-bc5eda870d2f tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cd0931292c245578bea8861f9ba7607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a555982bb6f841d7a72b6eca84a6150f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:06:56.181601 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-2fcb2207-bd9f-4525-a356-bc5eda870d2f tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] 10.222.0.43 "GET /compute/v2.1/servers/9d592615-a510-440d-9f41-8476fee6f370" status: 200 len: 1333 microversion: 2.1 time: 0.996014 Oct 04 22:06:56.204995 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2297/4658] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:06:55 2022] GET /compute/v2.1/servers/9d592615-a510-440d-9f41-8476fee6f370 => generated 1333 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:06:56.361287 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-1cef55f6-f010-4fde-8b14-5518e0ca23d6 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:06:56.362427 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-1cef55f6-f010-4fde-8b14-5518e0ca23d6 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] [instance: 1475392a-475f-414f-803c-e89c9ae1844a] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:06:56.374146 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1cef55f6-f010-4fde-8b14-5518e0ca23d6 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:56.374681 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1cef55f6-f010-4fde-8b14-5518e0ca23d6 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:56.375128 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1cef55f6-f010-4fde-8b14-5518e0ca23d6 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:56.377202 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1cef55f6-f010-4fde-8b14-5518e0ca23d6 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:56.377570 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1cef55f6-f010-4fde-8b14-5518e0ca23d6 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:56.378033 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1cef55f6-f010-4fde-8b14-5518e0ca23d6 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:56.648457 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.objects.instance [None req-1cef55f6-f010-4fde-8b14-5518e0ca23d6 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lazy-loading 'services' on Instance uuid 1475392a-475f-414f-803c-e89c9ae1844a {{(pid=134102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 22:06:56.821381 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-1cef55f6-f010-4fde-8b14-5518e0ca23d6 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] 10.222.0.43 "DELETE /compute/v2.1/servers/1475392a-475f-414f-803c-e89c9ae1844a/os-volume_attachments/d08ec112-2c00-4842-92cc-46ecee83c686" status: 202 len: 0 microversion: 2.1 time: 0.463448 Oct 04 22:06:56.829809 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2362/4659] 10.222.0.43 () {58 vars in 1416 bytes} [Tue Oct 4 22:06:56 2022] DELETE /compute/v2.1/servers/1475392a-475f-414f-803c-e89c9ae1844a/os-volume_attachments/d08ec112-2c00-4842-92cc-46ecee83c686 => generated 0 bytes in 473 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 22:06:56.836501 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-9f3c41a6-d296-430e-a408-15e87e59f345 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:06:56.844290 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-9f3c41a6-d296-430e-a408-15e87e59f345 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] [instance: 1475392a-475f-414f-803c-e89c9ae1844a] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:06:56.867170 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9f3c41a6-d296-430e-a408-15e87e59f345 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:56.873085 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9f3c41a6-d296-430e-a408-15e87e59f345 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:56.873949 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9f3c41a6-d296-430e-a408-15e87e59f345 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:56.874925 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9f3c41a6-d296-430e-a408-15e87e59f345 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:56.875569 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9f3c41a6-d296-430e-a408-15e87e59f345 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:56.876213 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9f3c41a6-d296-430e-a408-15e87e59f345 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:56.960572 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-9f3c41a6-d296-430e-a408-15e87e59f345 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] 10.222.0.43 "GET /compute/v2.1/servers/1475392a-475f-414f-803c-e89c9ae1844a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.133693 Oct 04 22:06:56.968545 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2298/4660] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 22:06:56 2022] GET /compute/v2.1/servers/1475392a-475f-414f-803c-e89c9ae1844a/os-volume_attachments => generated 197 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:06:57.231691 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-da9920c3-8cfd-4d54-87d9-fcf623c51ce8 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:06:57.233046 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-da9920c3-8cfd-4d54-87d9-fcf623c51ce8 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] [instance: 9d592615-a510-440d-9f41-8476fee6f370] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:06:57.248002 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-da9920c3-8cfd-4d54-87d9-fcf623c51ce8 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:57.248556 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-da9920c3-8cfd-4d54-87d9-fcf623c51ce8 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:57.248929 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-da9920c3-8cfd-4d54-87d9-fcf623c51ce8 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:57.249656 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-da9920c3-8cfd-4d54-87d9-fcf623c51ce8 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:57.250120 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-da9920c3-8cfd-4d54-87d9-fcf623c51ce8 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:57.250587 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-da9920c3-8cfd-4d54-87d9-fcf623c51ce8 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:57.981038 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-641af6fa-3998-492f-9f63-03709ec47a50 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:06:57.984213 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-641af6fa-3998-492f-9f63-03709ec47a50 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] [instance: 1475392a-475f-414f-803c-e89c9ae1844a] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:06:58.005362 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-641af6fa-3998-492f-9f63-03709ec47a50 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:58.007056 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-641af6fa-3998-492f-9f63-03709ec47a50 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:58.011224 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-641af6fa-3998-492f-9f63-03709ec47a50 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:58.012462 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-641af6fa-3998-492f-9f63-03709ec47a50 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:58.013174 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-641af6fa-3998-492f-9f63-03709ec47a50 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:58.013844 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-641af6fa-3998-492f-9f63-03709ec47a50 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:58.157601 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-641af6fa-3998-492f-9f63-03709ec47a50 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] 10.222.0.43 "GET /compute/v2.1/servers/1475392a-475f-414f-803c-e89c9ae1844a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.178369 Oct 04 22:06:58.166162 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2299/4661] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 22:06:57 2022] GET /compute/v2.1/servers/1475392a-475f-414f-803c-e89c9ae1844a/os-volume_attachments => generated 197 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:06:58.757910 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-da9920c3-8cfd-4d54-87d9-fcf623c51ce8 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cd0931292c245578bea8861f9ba7607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a555982bb6f841d7a72b6eca84a6150f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:06:58.772200 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-da9920c3-8cfd-4d54-87d9-fcf623c51ce8 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] 10.222.0.43 "GET /compute/v2.1/servers/9d592615-a510-440d-9f41-8476fee6f370" status: 200 len: 1333 microversion: 2.1 time: 1.554349 Oct 04 22:06:58.772928 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2363/4662] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:06:57 2022] GET /compute/v2.1/servers/9d592615-a510-440d-9f41-8476fee6f370 => generated 1333 bytes in 1557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:06:59.181854 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-1f887c4b-4d3b-40e4-a774-4818747de635 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:06:59.195650 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-1f887c4b-4d3b-40e4-a774-4818747de635 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] [instance: 1475392a-475f-414f-803c-e89c9ae1844a] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:06:59.222818 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1f887c4b-4d3b-40e4-a774-4818747de635 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:59.224383 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1f887c4b-4d3b-40e4-a774-4818747de635 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:59.228639 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1f887c4b-4d3b-40e4-a774-4818747de635 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:59.229789 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1f887c4b-4d3b-40e4-a774-4818747de635 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:59.231377 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1f887c4b-4d3b-40e4-a774-4818747de635 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:59.231596 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-902a4680-ad46-4457-a3af-96a70f4b8683 req-1040f030-6682-4312-980a-976ca9d6d26c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d592615-a510-440d-9f41-8476fee6f370", "tag": "406e9f5e-41b6-4909-b819-3005e1869096"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:06:59.234124 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1f887c4b-4d3b-40e4-a774-4818747de635 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:59.257714 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-902a4680-ad46-4457-a3af-96a70f4b8683 req-1040f030-6682-4312-980a-976ca9d6d26c service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:59.264330 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-902a4680-ad46-4457-a3af-96a70f4b8683 req-1040f030-6682-4312-980a-976ca9d6d26c service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:59.265122 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-902a4680-ad46-4457-a3af-96a70f4b8683 req-1040f030-6682-4312-980a-976ca9d6d26c service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:59.311081 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-902a4680-ad46-4457-a3af-96a70f4b8683 req-1040f030-6682-4312-980a-976ca9d6d26c service nova] Creating event network-changed:406e9f5e-41b6-4909-b819-3005e1869096 for instance 9d592615-a510-440d-9f41-8476fee6f370 on n-h2-860284-1 Oct 04 22:06:59.319654 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-902a4680-ad46-4457-a3af-96a70f4b8683 req-1040f030-6682-4312-980a-976ca9d6d26c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091853 Oct 04 22:06:59.321777 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2364/4663] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:06:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:06:59.348018 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-1f887c4b-4d3b-40e4-a774-4818747de635 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] 10.222.0.43 "GET /compute/v2.1/servers/1475392a-475f-414f-803c-e89c9ae1844a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.173762 Oct 04 22:06:59.353155 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2300/4664] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 22:06:59 2022] GET /compute/v2.1/servers/1475392a-475f-414f-803c-e89c9ae1844a/os-volume_attachments => generated 197 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:06:59.797149 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-038f7be5-abfd-4ae4-b2aa-25b51a276c37 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:06:59.800911 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-038f7be5-abfd-4ae4-b2aa-25b51a276c37 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] [instance: 9d592615-a510-440d-9f41-8476fee6f370] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:06:59.826723 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-038f7be5-abfd-4ae4-b2aa-25b51a276c37 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:59.827983 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-038f7be5-abfd-4ae4-b2aa-25b51a276c37 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:59.828829 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-038f7be5-abfd-4ae4-b2aa-25b51a276c37 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:59.833274 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-038f7be5-abfd-4ae4-b2aa-25b51a276c37 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:59.834510 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-038f7be5-abfd-4ae4-b2aa-25b51a276c37 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:59.835175 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-038f7be5-abfd-4ae4-b2aa-25b51a276c37 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:00.367864 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-6211abc6-11bc-40d7-a40f-33f683990339 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:07:00.370210 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-6211abc6-11bc-40d7-a40f-33f683990339 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] [instance: 1475392a-475f-414f-803c-e89c9ae1844a] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:07:00.396602 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6211abc6-11bc-40d7-a40f-33f683990339 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:00.403195 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6211abc6-11bc-40d7-a40f-33f683990339 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:00.403980 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6211abc6-11bc-40d7-a40f-33f683990339 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:00.404960 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6211abc6-11bc-40d7-a40f-33f683990339 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:00.405777 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6211abc6-11bc-40d7-a40f-33f683990339 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:00.406495 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6211abc6-11bc-40d7-a40f-33f683990339 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:00.521290 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-6211abc6-11bc-40d7-a40f-33f683990339 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] 10.222.0.43 "GET /compute/v2.1/servers/1475392a-475f-414f-803c-e89c9ae1844a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.159086 Oct 04 22:07:00.521909 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2301/4665] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 22:07:00 2022] GET /compute/v2.1/servers/1475392a-475f-414f-803c-e89c9ae1844a/os-volume_attachments => generated 197 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:07:00.928200 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-038f7be5-abfd-4ae4-b2aa-25b51a276c37 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cd0931292c245578bea8861f9ba7607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a555982bb6f841d7a72b6eca84a6150f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:07:00.936725 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-038f7be5-abfd-4ae4-b2aa-25b51a276c37 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] 10.222.0.43 "GET /compute/v2.1/servers/9d592615-a510-440d-9f41-8476fee6f370" status: 200 len: 1333 microversion: 2.1 time: 1.143686 Oct 04 22:07:00.948027 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2365/4666] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:06:59 2022] GET /compute/v2.1/servers/9d592615-a510-440d-9f41-8476fee6f370 => generated 1333 bytes in 1156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:07:01.535402 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-287279b2-06cd-45cd-b689-f719b0ea1d16 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:07:01.539417 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-287279b2-06cd-45cd-b689-f719b0ea1d16 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] [instance: 1475392a-475f-414f-803c-e89c9ae1844a] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:07:01.575690 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-287279b2-06cd-45cd-b689-f719b0ea1d16 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:01.576483 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-287279b2-06cd-45cd-b689-f719b0ea1d16 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:01.577145 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-287279b2-06cd-45cd-b689-f719b0ea1d16 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:01.578150 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-287279b2-06cd-45cd-b689-f719b0ea1d16 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:01.583375 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-287279b2-06cd-45cd-b689-f719b0ea1d16 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:01.584178 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-287279b2-06cd-45cd-b689-f719b0ea1d16 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:01.663217 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-287279b2-06cd-45cd-b689-f719b0ea1d16 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] 10.222.0.43 "GET /compute/v2.1/servers/1475392a-475f-414f-803c-e89c9ae1844a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.126913 Oct 04 22:07:01.664360 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2302/4667] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 22:07:01 2022] GET /compute/v2.1/servers/1475392a-475f-414f-803c-e89c9ae1844a/os-volume_attachments => generated 197 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:07:01.995262 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-a15857c4-9934-46a2-920b-04edf3897473 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:07:01.995881 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-a15857c4-9934-46a2-920b-04edf3897473 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] [instance: 9d592615-a510-440d-9f41-8476fee6f370] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:07:02.016530 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a15857c4-9934-46a2-920b-04edf3897473 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:02.034193 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a15857c4-9934-46a2-920b-04edf3897473 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:02.035439 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a15857c4-9934-46a2-920b-04edf3897473 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:02.036224 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a15857c4-9934-46a2-920b-04edf3897473 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:02.036709 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a15857c4-9934-46a2-920b-04edf3897473 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:02.037145 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a15857c4-9934-46a2-920b-04edf3897473 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:02.676070 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-db435989-8812-4477-96f3-a705ee88fd00 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:07:02.678277 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-db435989-8812-4477-96f3-a705ee88fd00 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] [instance: 1475392a-475f-414f-803c-e89c9ae1844a] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:07:02.693827 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-db435989-8812-4477-96f3-a705ee88fd00 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:02.694329 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-db435989-8812-4477-96f3-a705ee88fd00 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:02.694818 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-db435989-8812-4477-96f3-a705ee88fd00 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:02.695544 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-db435989-8812-4477-96f3-a705ee88fd00 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:02.696003 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-db435989-8812-4477-96f3-a705ee88fd00 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:02.696426 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-db435989-8812-4477-96f3-a705ee88fd00 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:02.775650 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-db435989-8812-4477-96f3-a705ee88fd00 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] 10.222.0.43 "GET /compute/v2.1/servers/1475392a-475f-414f-803c-e89c9ae1844a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.103754 Oct 04 22:07:02.776868 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2303/4668] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 22:07:02 2022] GET /compute/v2.1/servers/1475392a-475f-414f-803c-e89c9ae1844a/os-volume_attachments => generated 197 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:07:03.271776 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-a15857c4-9934-46a2-920b-04edf3897473 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cd0931292c245578bea8861f9ba7607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a555982bb6f841d7a72b6eca84a6150f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:07:03.292220 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-a15857c4-9934-46a2-920b-04edf3897473 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] 10.222.0.43 "GET /compute/v2.1/servers/9d592615-a510-440d-9f41-8476fee6f370" status: 200 len: 1333 microversion: 2.1 time: 1.300050 Oct 04 22:07:03.292920 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2366/4669] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:07:01 2022] GET /compute/v2.1/servers/9d592615-a510-440d-9f41-8476fee6f370 => generated 1333 bytes in 1303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:07:03.353084 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-244b95a2-8cd3-4040-a5e4-e6722676bd62 req-6dea5e37-4f6a-47ee-b179-40fab4620982 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d592615-a510-440d-9f41-8476fee6f370", "tag": "325e8b1f-32b2-4124-be4a-18e8fff98adc"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:07:03.368763 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-244b95a2-8cd3-4040-a5e4-e6722676bd62 req-6dea5e37-4f6a-47ee-b179-40fab4620982 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:03.369749 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-244b95a2-8cd3-4040-a5e4-e6722676bd62 req-6dea5e37-4f6a-47ee-b179-40fab4620982 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:03.370353 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-244b95a2-8cd3-4040-a5e4-e6722676bd62 req-6dea5e37-4f6a-47ee-b179-40fab4620982 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:03.409610 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-244b95a2-8cd3-4040-a5e4-e6722676bd62 req-6dea5e37-4f6a-47ee-b179-40fab4620982 service nova] Creating event network-changed:325e8b1f-32b2-4124-be4a-18e8fff98adc for instance 9d592615-a510-440d-9f41-8476fee6f370 on n-h2-860284-1 Oct 04 22:07:03.422893 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-244b95a2-8cd3-4040-a5e4-e6722676bd62 req-6dea5e37-4f6a-47ee-b179-40fab4620982 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075546 Oct 04 22:07:03.424130 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2304/4670] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:07:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:07:03.789273 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-ec3f69f9-2687-4248-b4ec-f21bfa5d4222 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:07:03.792147 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-ec3f69f9-2687-4248-b4ec-f21bfa5d4222 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] [instance: 1475392a-475f-414f-803c-e89c9ae1844a] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:07:03.803690 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ec3f69f9-2687-4248-b4ec-f21bfa5d4222 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:03.806841 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ec3f69f9-2687-4248-b4ec-f21bfa5d4222 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:03.810305 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ec3f69f9-2687-4248-b4ec-f21bfa5d4222 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:03.812204 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ec3f69f9-2687-4248-b4ec-f21bfa5d4222 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:03.821148 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ec3f69f9-2687-4248-b4ec-f21bfa5d4222 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:03.821843 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ec3f69f9-2687-4248-b4ec-f21bfa5d4222 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:04.084167 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-ec3f69f9-2687-4248-b4ec-f21bfa5d4222 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] 10.222.0.43 "GET /compute/v2.1/servers/1475392a-475f-414f-803c-e89c9ae1844a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.293330 Oct 04 22:07:04.091132 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2367/4671] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 22:07:03 2022] GET /compute/v2.1/servers/1475392a-475f-414f-803c-e89c9ae1844a/os-volume_attachments => generated 197 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:07:04.323119 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-d5c73200-37b5-472c-9751-7df157acdbb8 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:07:04.323910 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-d5c73200-37b5-472c-9751-7df157acdbb8 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] [instance: 9d592615-a510-440d-9f41-8476fee6f370] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:07:04.345498 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d5c73200-37b5-472c-9751-7df157acdbb8 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:04.346276 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d5c73200-37b5-472c-9751-7df157acdbb8 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:04.347724 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d5c73200-37b5-472c-9751-7df157acdbb8 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:04.348835 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d5c73200-37b5-472c-9751-7df157acdbb8 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:04.349460 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d5c73200-37b5-472c-9751-7df157acdbb8 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:04.350045 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d5c73200-37b5-472c-9751-7df157acdbb8 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:05.098112 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-19eadde3-d18c-41ac-a97a-5f274604609b tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:07:05.100459 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-19eadde3-d18c-41ac-a97a-5f274604609b tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] [instance: 1475392a-475f-414f-803c-e89c9ae1844a] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:07:05.156924 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-19eadde3-d18c-41ac-a97a-5f274604609b tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:05.158214 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-19eadde3-d18c-41ac-a97a-5f274604609b tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:05.161703 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-19eadde3-d18c-41ac-a97a-5f274604609b tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:05.163547 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-19eadde3-d18c-41ac-a97a-5f274604609b tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:05.165517 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-19eadde3-d18c-41ac-a97a-5f274604609b tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:05.168931 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-19eadde3-d18c-41ac-a97a-5f274604609b tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:05.233772 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-d5c73200-37b5-472c-9751-7df157acdbb8 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cd0931292c245578bea8861f9ba7607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a555982bb6f841d7a72b6eca84a6150f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:07:05.242401 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-d5c73200-37b5-472c-9751-7df157acdbb8 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] 10.222.0.43 "GET /compute/v2.1/servers/9d592615-a510-440d-9f41-8476fee6f370" status: 200 len: 1333 microversion: 2.1 time: 0.929162 Oct 04 22:07:05.247158 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2305/4672] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:07:04 2022] GET /compute/v2.1/servers/9d592615-a510-440d-9f41-8476fee6f370 => generated 1333 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:07:05.261968 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-19eadde3-d18c-41ac-a97a-5f274604609b tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] 10.222.0.43 "GET /compute/v2.1/servers/1475392a-475f-414f-803c-e89c9ae1844a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.169069 Oct 04 22:07:05.263213 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2368/4673] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 22:07:05 2022] GET /compute/v2.1/servers/1475392a-475f-414f-803c-e89c9ae1844a/os-volume_attachments => generated 197 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:07:06.273643 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-7762130f-b479-4e0e-b407-6fe1a6701a6b tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:07:06.274887 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-7762130f-b479-4e0e-b407-6fe1a6701a6b tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] [instance: 9d592615-a510-440d-9f41-8476fee6f370] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:07:06.275284 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-5a0be5c8-acb5-42f7-ac22-e9deb58ad1a5 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:07:06.278061 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-5a0be5c8-acb5-42f7-ac22-e9deb58ad1a5 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] [instance: 1475392a-475f-414f-803c-e89c9ae1844a] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:07:06.285395 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:07:06.286932 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7762130f-b479-4e0e-b407-6fe1a6701a6b tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:06.293897 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7762130f-b479-4e0e-b407-6fe1a6701a6b tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:06.295079 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7762130f-b479-4e0e-b407-6fe1a6701a6b tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:06.296163 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7762130f-b479-4e0e-b407-6fe1a6701a6b tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:06.297936 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5a0be5c8-acb5-42f7-ac22-e9deb58ad1a5 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:06.299578 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5a0be5c8-acb5-42f7-ac22-e9deb58ad1a5 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:06.301363 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5a0be5c8-acb5-42f7-ac22-e9deb58ad1a5 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:06.302384 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5a0be5c8-acb5-42f7-ac22-e9deb58ad1a5 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:06.303133 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5a0be5c8-acb5-42f7-ac22-e9deb58ad1a5 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:06.303805 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5a0be5c8-acb5-42f7-ac22-e9deb58ad1a5 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:06.304670 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7762130f-b479-4e0e-b407-6fe1a6701a6b tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:06.305134 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7762130f-b479-4e0e-b407-6fe1a6701a6b tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:06.406403 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-5a0be5c8-acb5-42f7-ac22-e9deb58ad1a5 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] 10.222.0.43 "GET /compute/v2.1/servers/1475392a-475f-414f-803c-e89c9ae1844a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.135894 Oct 04 22:07:06.416154 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2369/4674] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 22:07:06 2022] GET /compute/v2.1/servers/1475392a-475f-414f-803c-e89c9ae1844a/os-volume_attachments => generated 197 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:07:07.433696 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-64fd9208-ff7c-4d92-8783-7b152f7da5ef tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:07:07.437198 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-64fd9208-ff7c-4d92-8783-7b152f7da5ef tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] [instance: 1475392a-475f-414f-803c-e89c9ae1844a] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:07:07.464099 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-64fd9208-ff7c-4d92-8783-7b152f7da5ef tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:07.466056 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-64fd9208-ff7c-4d92-8783-7b152f7da5ef tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:07.468843 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-64fd9208-ff7c-4d92-8783-7b152f7da5ef tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:07.469820 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-64fd9208-ff7c-4d92-8783-7b152f7da5ef tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:07.470479 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-64fd9208-ff7c-4d92-8783-7b152f7da5ef tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:07.481033 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-64fd9208-ff7c-4d92-8783-7b152f7da5ef tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:07.551054 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-64fd9208-ff7c-4d92-8783-7b152f7da5ef tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] 10.222.0.43 "GET /compute/v2.1/servers/1475392a-475f-414f-803c-e89c9ae1844a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.122856 Oct 04 22:07:07.558907 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2370/4675] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 22:07:07 2022] GET /compute/v2.1/servers/1475392a-475f-414f-803c-e89c9ae1844a/os-volume_attachments => generated 25 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 04 22:07:07.713365 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-aeb4efdc-485c-48fe-94d6-d7ac2d91fd98 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:07:07.714231 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-aeb4efdc-485c-48fe-94d6-d7ac2d91fd98 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] [instance: 1475392a-475f-414f-803c-e89c9ae1844a] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:07:07.723496 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-aeb4efdc-485c-48fe-94d6-d7ac2d91fd98 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:07.724361 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-aeb4efdc-485c-48fe-94d6-d7ac2d91fd98 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:07.725051 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-aeb4efdc-485c-48fe-94d6-d7ac2d91fd98 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:07.726102 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-aeb4efdc-485c-48fe-94d6-d7ac2d91fd98 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:07.728280 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-aeb4efdc-485c-48fe-94d6-d7ac2d91fd98 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:07.728998 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-aeb4efdc-485c-48fe-94d6-d7ac2d91fd98 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:07.768519 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-aeb4efdc-485c-48fe-94d6-d7ac2d91fd98 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] [instance: 1475392a-475f-414f-803c-e89c9ae1844a] Going to try to terminate instance {{(pid=134102) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 22:07:07.834232 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-7762130f-b479-4e0e-b407-6fe1a6701a6b tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cd0931292c245578bea8861f9ba7607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a555982bb6f841d7a72b6eca84a6150f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:07:07.899587 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-7762130f-b479-4e0e-b407-6fe1a6701a6b tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] 10.222.0.43 "GET /compute/v2.1/servers/9d592615-a510-440d-9f41-8476fee6f370" status: 200 len: 1333 microversion: 2.1 time: 1.625587 Oct 04 22:07:07.903139 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-aeb4efdc-485c-48fe-94d6-d7ac2d91fd98 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] 10.222.0.43 "DELETE /compute/v2.1/servers/1475392a-475f-414f-803c-e89c9ae1844a" status: 204 len: 0 microversion: 2.1 time: 0.195342 Oct 04 22:07:07.903768 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2306/4676] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:07:06 2022] GET /compute/v2.1/servers/9d592615-a510-440d-9f41-8476fee6f370 => generated 1333 bytes in 1635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:07:07.913672 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2371/4677] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 22:07:07 2022] DELETE /compute/v2.1/servers/1475392a-475f-414f-803c-e89c9ae1844a => generated 0 bytes in 204 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 22:07:07.923466 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-ca4a2d77-f450-4892-b2af-caa0d4246237 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:07:07.924150 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-ca4a2d77-f450-4892-b2af-caa0d4246237 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] [instance: 1475392a-475f-414f-803c-e89c9ae1844a] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:07:07.932847 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ca4a2d77-f450-4892-b2af-caa0d4246237 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:07.933572 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ca4a2d77-f450-4892-b2af-caa0d4246237 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:07.934191 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ca4a2d77-f450-4892-b2af-caa0d4246237 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:07.935848 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ca4a2d77-f450-4892-b2af-caa0d4246237 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:07.936349 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ca4a2d77-f450-4892-b2af-caa0d4246237 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:07.936791 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ca4a2d77-f450-4892-b2af-caa0d4246237 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:08.930503 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-d247073b-2d82-461b-8fc4-b1264b7e1750 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:07:08.931192 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-d247073b-2d82-461b-8fc4-b1264b7e1750 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] [instance: 9d592615-a510-440d-9f41-8476fee6f370] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:07:08.954886 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d247073b-2d82-461b-8fc4-b1264b7e1750 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:08.955689 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d247073b-2d82-461b-8fc4-b1264b7e1750 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:08.961092 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d247073b-2d82-461b-8fc4-b1264b7e1750 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:08.967161 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d247073b-2d82-461b-8fc4-b1264b7e1750 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:08.968804 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d247073b-2d82-461b-8fc4-b1264b7e1750 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:08.970097 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d247073b-2d82-461b-8fc4-b1264b7e1750 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:09.735234 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-ca4a2d77-f450-4892-b2af-caa0d4246237 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80fc56886fef422b9b52eb1dede7d10e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82e1a29234ce40f9b37d0eca196cd1db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:07:09.753020 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-ca4a2d77-f450-4892-b2af-caa0d4246237 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] 10.222.0.43 "GET /compute/v2.1/servers/1475392a-475f-414f-803c-e89c9ae1844a" status: 200 len: 1682 microversion: 2.1 time: 1.837618 Oct 04 22:07:09.756898 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2307/4678] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:07:07 2022] GET /compute/v2.1/servers/1475392a-475f-414f-803c-e89c9ae1844a => generated 1682 bytes in 1843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:07:09.889578 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-d247073b-2d82-461b-8fc4-b1264b7e1750 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cd0931292c245578bea8861f9ba7607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a555982bb6f841d7a72b6eca84a6150f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:07:09.914117 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-d247073b-2d82-461b-8fc4-b1264b7e1750 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] 10.222.0.43 "GET /compute/v2.1/servers/9d592615-a510-440d-9f41-8476fee6f370" status: 200 len: 1333 microversion: 2.1 time: 0.988765 Oct 04 22:07:09.915957 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2372/4679] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:07:08 2022] GET /compute/v2.1/servers/9d592615-a510-440d-9f41-8476fee6f370 => generated 1333 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:07:10.781860 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-fa44d434-0252-420e-b815-f56e36b96225 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:07:10.782839 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-fa44d434-0252-420e-b815-f56e36b96225 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] [instance: 1475392a-475f-414f-803c-e89c9ae1844a] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:07:10.817718 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fa44d434-0252-420e-b815-f56e36b96225 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:10.825296 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fa44d434-0252-420e-b815-f56e36b96225 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:10.829299 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fa44d434-0252-420e-b815-f56e36b96225 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:10.830349 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fa44d434-0252-420e-b815-f56e36b96225 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:10.833917 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fa44d434-0252-420e-b815-f56e36b96225 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:10.837822 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fa44d434-0252-420e-b815-f56e36b96225 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:10.947089 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-b374a71f-4c18-497d-bf2e-635a44af1496 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:07:10.948759 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-b374a71f-4c18-497d-bf2e-635a44af1496 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] [instance: 9d592615-a510-440d-9f41-8476fee6f370] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:07:10.961766 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_api:SELECT=50,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:07:10.978218 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b374a71f-4c18-497d-bf2e-635a44af1496 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:10.982744 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b374a71f-4c18-497d-bf2e-635a44af1496 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:10.985030 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b374a71f-4c18-497d-bf2e-635a44af1496 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:11.005604 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b374a71f-4c18-497d-bf2e-635a44af1496 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:11.019381 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b374a71f-4c18-497d-bf2e-635a44af1496 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:11.028972 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b374a71f-4c18-497d-bf2e-635a44af1496 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:11.200997 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-fa44d434-0252-420e-b815-f56e36b96225 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80fc56886fef422b9b52eb1dede7d10e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82e1a29234ce40f9b37d0eca196cd1db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:07:11.224850 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-fa44d434-0252-420e-b815-f56e36b96225 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] 10.222.0.43 "GET /compute/v2.1/servers/1475392a-475f-414f-803c-e89c9ae1844a" status: 200 len: 1615 microversion: 2.1 time: 0.438792 Oct 04 22:07:11.244308 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2308/4680] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:07:10 2022] GET /compute/v2.1/servers/1475392a-475f-414f-803c-e89c9ae1844a => generated 1615 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:07:11.859701 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-178e367c-f12e-4490-8724-cc080d88a6b2 req-40f0a4e2-1bfd-44e3-9431-3eda04504667 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1475392a-475f-414f-803c-e89c9ae1844a", "name": "network-vif-deleted", "tag": "8df5b52b-3b39-4a5f-94b6-6b948feabebe"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:07:11.932023 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-178e367c-f12e-4490-8724-cc080d88a6b2 req-40f0a4e2-1bfd-44e3-9431-3eda04504667 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:11.938402 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-178e367c-f12e-4490-8724-cc080d88a6b2 req-40f0a4e2-1bfd-44e3-9431-3eda04504667 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:11.938881 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-178e367c-f12e-4490-8724-cc080d88a6b2 req-40f0a4e2-1bfd-44e3-9431-3eda04504667 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:11.997682 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-178e367c-f12e-4490-8724-cc080d88a6b2 req-40f0a4e2-1bfd-44e3-9431-3eda04504667 service nova] Creating event network-vif-deleted:8df5b52b-3b39-4a5f-94b6-6b948feabebe for instance 1475392a-475f-414f-803c-e89c9ae1844a on n-h1-860284-1 Oct 04 22:07:12.044680 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-178e367c-f12e-4490-8724-cc080d88a6b2 req-40f0a4e2-1bfd-44e3-9431-3eda04504667 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.210243 Oct 04 22:07:12.051808 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2309/4681] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:07:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:07:12.301140 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-da9850f5-2b7a-42ce-8ed7-570153ff7c08 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:07:12.304353 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-da9850f5-2b7a-42ce-8ed7-570153ff7c08 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] [instance: 1475392a-475f-414f-803c-e89c9ae1844a] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:07:12.320670 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-da9850f5-2b7a-42ce-8ed7-570153ff7c08 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:12.321589 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-da9850f5-2b7a-42ce-8ed7-570153ff7c08 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:12.322289 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-da9850f5-2b7a-42ce-8ed7-570153ff7c08 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:12.323316 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-da9850f5-2b7a-42ce-8ed7-570153ff7c08 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:12.326478 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-da9850f5-2b7a-42ce-8ed7-570153ff7c08 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:12.327180 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-da9850f5-2b7a-42ce-8ed7-570153ff7c08 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:12.420647 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-da9850f5-2b7a-42ce-8ed7-570153ff7c08 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:12.427173 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-da9850f5-2b7a-42ce-8ed7-570153ff7c08 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:12.430384 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-da9850f5-2b7a-42ce-8ed7-570153ff7c08 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:12.432558 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.objects.instance [None req-da9850f5-2b7a-42ce-8ed7-570153ff7c08 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lazy-loading 'fault' on Instance uuid 1475392a-475f-414f-803c-e89c9ae1844a {{(pid=134101) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 22:07:12.805863 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-b374a71f-4c18-497d-bf2e-635a44af1496 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cd0931292c245578bea8861f9ba7607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a555982bb6f841d7a72b6eca84a6150f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:07:12.819688 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-b374a71f-4c18-497d-bf2e-635a44af1496 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] 10.222.0.43 "GET /compute/v2.1/servers/9d592615-a510-440d-9f41-8476fee6f370" status: 200 len: 1333 microversion: 2.1 time: 1.875559 Oct 04 22:07:12.820879 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2373/4682] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:07:10 2022] GET /compute/v2.1/servers/9d592615-a510-440d-9f41-8476fee6f370 => generated 1333 bytes in 1879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:07:13.100522 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-da9850f5-2b7a-42ce-8ed7-570153ff7c08 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80fc56886fef422b9b52eb1dede7d10e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82e1a29234ce40f9b37d0eca196cd1db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:07:13.166031 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-da9850f5-2b7a-42ce-8ed7-570153ff7c08 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] 10.222.0.43 "GET /compute/v2.1/servers/1475392a-475f-414f-803c-e89c9ae1844a" status: 200 len: 1331 microversion: 2.1 time: 0.900491 Oct 04 22:07:13.167494 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2310/4683] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:07:12 2022] GET /compute/v2.1/servers/1475392a-475f-414f-803c-e89c9ae1844a => generated 1331 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:07:13.846169 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-0e320681-10f3-4d1f-8e45-310486ad56cc tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:07:13.847132 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-0e320681-10f3-4d1f-8e45-310486ad56cc tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] [instance: 9d592615-a510-440d-9f41-8476fee6f370] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:07:13.881431 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0e320681-10f3-4d1f-8e45-310486ad56cc tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:13.882089 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0e320681-10f3-4d1f-8e45-310486ad56cc tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:13.882703 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0e320681-10f3-4d1f-8e45-310486ad56cc tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:13.883714 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0e320681-10f3-4d1f-8e45-310486ad56cc tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:13.884817 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0e320681-10f3-4d1f-8e45-310486ad56cc tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:13.888262 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0e320681-10f3-4d1f-8e45-310486ad56cc tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:13.936355 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:07:14.198186 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-5ffede1c-5370-4127-abc1-bf861c74996a tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:07:14.199148 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-5ffede1c-5370-4127-abc1-bf861c74996a tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] [instance: 1475392a-475f-414f-803c-e89c9ae1844a] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:07:14.231488 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5ffede1c-5370-4127-abc1-bf861c74996a tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:14.232317 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5ffede1c-5370-4127-abc1-bf861c74996a tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:14.240115 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5ffede1c-5370-4127-abc1-bf861c74996a tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:14.241833 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5ffede1c-5370-4127-abc1-bf861c74996a tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:14.247224 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5ffede1c-5370-4127-abc1-bf861c74996a tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:14.251209 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5ffede1c-5370-4127-abc1-bf861c74996a tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:14.360077 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-5ffede1c-5370-4127-abc1-bf861c74996a tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] HTTP exception thrown: Instance 1475392a-475f-414f-803c-e89c9ae1844a could not be found. Oct 04 22:07:14.364311 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-5ffede1c-5370-4127-abc1-bf861c74996a tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Request method failure captured: Oct 04 22:07:14.364311 n-d-860284-1 devstack@n-api.service[134101]: request: GET /compute/v2.1/servers/1475392a-475f-414f-803c-e89c9ae1844a HTTP/1.1 Oct 04 22:07:14.364311 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 22:07:14.364311 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 22:07:14.364311 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 22:07:14.364311 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 22:07:14.364311 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 22:07:14.364311 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 22:07:14.364311 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 22:07:14.364311 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 22:07:14.364311 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPK1_jKuDmdFTooG3vXwJSp1td0Kvvx-9VX1-OpwmBVV8uNR_MbJNU7EeI7sJdUoH3-0m3mmRBtTc-gLPN-qZ-RuZ8IL2TyG35svVe_hwPH0Z2c1BjkAMrt5beIkYsGbtm00-0XbqMbhJ5wgj-ztyQnhQ8ugDue3oDD_DUqnSWikZCg8 Oct 04 22:07:14.364311 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 22:07:14.364311 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 22:07:14.364311 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 22:07:14.364311 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 22:07:14.364311 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 22:07:14.364311 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 22:07:14.364311 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: 82e1a29234ce40f9b37d0eca196cd1db Oct 04 22:07:14.364311 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-AttachVolumeNegativeTest-2122228341 Oct 04 22:07:14.364311 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 22:07:14.364311 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 22:07:14.364311 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/82e1a29234ce40f9b37d0eca196cd1db"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_82e1a29234ce40f9b37d0eca196cd1db", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/82e1a29234ce40f9b37d0eca196cd1db"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/82e1a29234ce40f9b37d0eca196cd1db"}]}] Oct 04 22:07:14.364311 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-AttachVolumeNegativeTest-2122228341 Oct 04 22:07:14.364311 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: 82e1a29234ce40f9b37d0eca196cd1db Oct 04 22:07:14.364311 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2122228341 Oct 04 22:07:14.364311 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-AttachVolumeNegativeTest-2122228341-project Oct 04 22:07:14.364311 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 22:07:14.364311 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 22:07:14.364311 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 80fc56886fef422b9b52eb1dede7d10e Oct 04 22:07:14.364311 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-AttachVolumeNegativeTest-2122228341-project Oct 04 22:07:14.364311 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 22:07:14.364311 n-d-860284-1 devstack@n-api.service[134101]: exception: Instance 1475392a-475f-414f-803c-e89c9ae1844a could not be found. Oct 04 22:07:14.364311 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': '1475392a-475f-414f-803c-e89c9ae1844a'} Oct 04 22:07:14.364311 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:07:14.364311 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:07:14.364311 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:07:14.364311 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:07:14.364311 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:07:14.364311 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:07:14.364311 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:07:14.364311 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:07:14.364311 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:07:14.364311 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:07:14.364311 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1475392a-475f-414f-803c-e89c9ae1844a could not be found. Oct 04 22:07:14.364311 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:07:14.364311 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:07:14.364311 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:07:14.364311 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:07:14.364311 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:07:14.364311 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:07:14.364311 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:07:14.364311 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:07:14.364311 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:07:14.364311 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:07:14.364311 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:07:14.364311 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:07:14.364311 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:07:14.364311 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:07:14.364311 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:07:14.364311 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:07:14.364311 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1475392a-475f-414f-803c-e89c9ae1844a could not be found. Oct 04 22:07:14.364311 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:07:14.364311 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:07:14.364311 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:07:14.373545 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:07:14.373545 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:07:14.373545 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:07:14.373545 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:07:14.373545 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:07:14.373545 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1475392a-475f-414f-803c-e89c9ae1844a could not be found. Oct 04 22:07:14.373545 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:07:14.381939 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-5ffede1c-5370-4127-abc1-bf861c74996a tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Returning 404 to user: Instance 1475392a-475f-414f-803c-e89c9ae1844a could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:07:14.384027 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-5ffede1c-5370-4127-abc1-bf861c74996a tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] 10.222.0.43 "GET /compute/v2.1/servers/1475392a-475f-414f-803c-e89c9ae1844a" status: 404 len: 111 microversion: 2.1 time: 0.194253 Oct 04 22:07:14.396381 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2311/4684] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:07:14 2022] GET /compute/v2.1/servers/1475392a-475f-414f-803c-e89c9ae1844a => generated 111 bytes in 207 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:07:14.408459 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-4bc7cff8-f1c9-4979-b3ac-fe6e6d1c1f0e tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Calling method '.version_select at 0x7fbb2e330b80>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:07:14.474683 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-4bc7cff8-f1c9-4979-b3ac-fe6e6d1c1f0e tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2000945182" status: 202 len: 0 microversion: 2.1 time: 0.073280 Oct 04 22:07:14.476490 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2312/4685] 10.222.0.43 () {58 vars in 1221 bytes} [Tue Oct 4 22:07:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2000945182 => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 22:07:14.829484 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-48d7a4b2-7ba2-48b2-a37a-b1785c228e50 req-f2b1b687-f7e9-4b72-8346-9577cf54754d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d592615-a510-440d-9f41-8476fee6f370", "name": "network-vif-plugged", "status": "completed", "tag": "406e9f5e-41b6-4909-b819-3005e1869096"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:07:14.905121 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-48d7a4b2-7ba2-48b2-a37a-b1785c228e50 req-f2b1b687-f7e9-4b72-8346-9577cf54754d service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:14.910410 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-48d7a4b2-7ba2-48b2-a37a-b1785c228e50 req-f2b1b687-f7e9-4b72-8346-9577cf54754d service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:14.919908 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-48d7a4b2-7ba2-48b2-a37a-b1785c228e50 req-f2b1b687-f7e9-4b72-8346-9577cf54754d service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:14.992098 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-48d7a4b2-7ba2-48b2-a37a-b1785c228e50 req-f2b1b687-f7e9-4b72-8346-9577cf54754d service nova] Creating event network-vif-plugged:406e9f5e-41b6-4909-b819-3005e1869096 for instance 9d592615-a510-440d-9f41-8476fee6f370 on n-h2-860284-1 Oct 04 22:07:15.039216 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-48d7a4b2-7ba2-48b2-a37a-b1785c228e50 req-f2b1b687-f7e9-4b72-8346-9577cf54754d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.216125 Oct 04 22:07:15.040187 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2313/4686] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:07:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:07:15.048749 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-0e320681-10f3-4d1f-8e45-310486ad56cc tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cd0931292c245578bea8861f9ba7607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a555982bb6f841d7a72b6eca84a6150f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:07:15.091041 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-0e320681-10f3-4d1f-8e45-310486ad56cc tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] 10.222.0.43 "GET /compute/v2.1/servers/9d592615-a510-440d-9f41-8476fee6f370" status: 200 len: 1333 microversion: 2.1 time: 1.229186 Oct 04 22:07:15.093941 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2374/4687] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:07:13 2022] GET /compute/v2.1/servers/9d592615-a510-440d-9f41-8476fee6f370 => generated 1333 bytes in 1253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:07:15.673225 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-faa8a8b1-7cf8-4757-a4c1-e9acbf846df8 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:07:15.676608 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-faa8a8b1-7cf8-4757-a4c1-e9acbf846df8 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 48243e1b-892b-4c4b-8db1-242b2e40653b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:07:15.731237 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-faa8a8b1-7cf8-4757-a4c1-e9acbf846df8 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:15.732540 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-faa8a8b1-7cf8-4757-a4c1-e9acbf846df8 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:15.743464 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-faa8a8b1-7cf8-4757-a4c1-e9acbf846df8 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:15.745167 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-faa8a8b1-7cf8-4757-a4c1-e9acbf846df8 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:15.749076 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-faa8a8b1-7cf8-4757-a4c1-e9acbf846df8 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:15.750219 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-faa8a8b1-7cf8-4757-a4c1-e9acbf846df8 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:16.133097 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-60e75431-19e0-4226-af2e-775843fc3bb3 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:07:16.134549 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-60e75431-19e0-4226-af2e-775843fc3bb3 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] [instance: 9d592615-a510-440d-9f41-8476fee6f370] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:07:16.153148 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-60e75431-19e0-4226-af2e-775843fc3bb3 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:16.154310 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-60e75431-19e0-4226-af2e-775843fc3bb3 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:16.155020 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-60e75431-19e0-4226-af2e-775843fc3bb3 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:16.158080 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-60e75431-19e0-4226-af2e-775843fc3bb3 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:16.158080 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-60e75431-19e0-4226-af2e-775843fc3bb3 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:16.158080 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-60e75431-19e0-4226-af2e-775843fc3bb3 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:16.473474 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-faa8a8b1-7cf8-4757-a4c1-e9acbf846df8 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:07:16.487172 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-faa8a8b1-7cf8-4757-a4c1-e9acbf846df8 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b" status: 200 len: 1682 microversion: 2.1 time: 0.828605 Oct 04 22:07:16.512983 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2314/4688] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:07:15 2022] GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b => generated 1682 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:07:16.944037 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-a9215f74-4124-4d4f-87c4-191063dc6ac8 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Action: 'create', calling method: .version_select at 0x7fbb2ede4ee0>, body: {"keypair": {"name": "tempest-keypair-483355405", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFZ0wG6fjirWeml71oxTDUweCHOfJyMXOJlaAhzxhr/RAJi33rKvJz7jW4W+9QJJalGQcrSeHRhUSoz+C7JhxylSne0wvu/WbOrQnNYxg9qRMQdq1j4tbpVvEdiDhbHv1g=="}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:07:17.016516 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-a9215f74-4124-4d4f-87c4-191063dc6ac8 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Getting quotas for project 82e1a29234ce40f9b37d0eca196cd1db. Resources: {'key_pairs'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:07:17.046036 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-a9215f74-4124-4d4f-87c4-191063dc6ac8 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Getting quotas for user 80fc56886fef422b9b52eb1dede7d10e and project 82e1a29234ce40f9b37d0eca196cd1db. Resources: {'key_pairs'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:07:17.115702 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-a9215f74-4124-4d4f-87c4-191063dc6ac8 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.180206 Oct 04 22:07:17.116544 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2315/4689] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Oct 4 22:07:16 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:07:17.185092 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-a6d5917e-2db8-4d23-95d2-c303935b3f74 req-dd961a58-be8f-4365-98cd-0944de85df95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d592615-a510-440d-9f41-8476fee6f370", "name": "network-vif-plugged", "status": "completed", "tag": "325e8b1f-32b2-4124-be4a-18e8fff98adc"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:07:17.205389 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-a6d5917e-2db8-4d23-95d2-c303935b3f74 req-dd961a58-be8f-4365-98cd-0944de85df95 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:17.205792 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-a6d5917e-2db8-4d23-95d2-c303935b3f74 req-dd961a58-be8f-4365-98cd-0944de85df95 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:17.209776 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-a6d5917e-2db8-4d23-95d2-c303935b3f74 req-dd961a58-be8f-4365-98cd-0944de85df95 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:17.218822 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=100 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:07:17.241349 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-a6d5917e-2db8-4d23-95d2-c303935b3f74 req-dd961a58-be8f-4365-98cd-0944de85df95 service nova] Creating event network-vif-plugged:325e8b1f-32b2-4124-be4a-18e8fff98adc for instance 9d592615-a510-440d-9f41-8476fee6f370 on n-h2-860284-1 Oct 04 22:07:17.247134 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-a6d5917e-2db8-4d23-95d2-c303935b3f74 req-dd961a58-be8f-4365-98cd-0944de85df95 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067384 Oct 04 22:07:17.247870 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2316/4690] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:07:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:07:17.460110 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-60e75431-19e0-4226-af2e-775843fc3bb3 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cd0931292c245578bea8861f9ba7607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a555982bb6f841d7a72b6eca84a6150f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:07:17.482915 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-60e75431-19e0-4226-af2e-775843fc3bb3 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] 10.222.0.43 "GET /compute/v2.1/servers/9d592615-a510-440d-9f41-8476fee6f370" status: 200 len: 1333 microversion: 2.1 time: 1.355745 Oct 04 22:07:17.485325 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2375/4691] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:07:16 2022] GET /compute/v2.1/servers/9d592615-a510-440d-9f41-8476fee6f370 => generated 1333 bytes in 1362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:07:17.524979 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-de461695-bc63-4ab6-b815-6447c34ec6e2 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:07:17.525860 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-de461695-bc63-4ab6-b815-6447c34ec6e2 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 48243e1b-892b-4c4b-8db1-242b2e40653b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:07:17.547061 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-de461695-bc63-4ab6-b815-6447c34ec6e2 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:17.548914 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-de461695-bc63-4ab6-b815-6447c34ec6e2 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:17.549891 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-de461695-bc63-4ab6-b815-6447c34ec6e2 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:17.552150 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-de461695-bc63-4ab6-b815-6447c34ec6e2 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:17.553177 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-de461695-bc63-4ab6-b815-6447c34ec6e2 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:17.553903 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-de461695-bc63-4ab6-b815-6447c34ec6e2 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:18.009546 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-de461695-bc63-4ab6-b815-6447c34ec6e2 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:07:18.027601 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-de461695-bc63-4ab6-b815-6447c34ec6e2 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b" status: 200 len: 1669 microversion: 2.1 time: 0.511678 Oct 04 22:07:18.028236 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2317/4692] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:07:17 2022] GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b => generated 1669 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:07:18.055827 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-7b08025c-52f2-4603-89b9-99cd66da2142 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-285761964"}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:07:18.058300 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-7b08025c-52f2-4603-89b9-99cd66da2142 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 48243e1b-892b-4c4b-8db1-242b2e40653b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:07:18.069955 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7b08025c-52f2-4603-89b9-99cd66da2142 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:18.070946 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7b08025c-52f2-4603-89b9-99cd66da2142 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:18.079320 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7b08025c-52f2-4603-89b9-99cd66da2142 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:18.081761 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7b08025c-52f2-4603-89b9-99cd66da2142 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:18.082550 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7b08025c-52f2-4603-89b9-99cd66da2142 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:18.083381 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7b08025c-52f2-4603-89b9-99cd66da2142 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:18.524763 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-6e58aefb-6452-4420-8f81-d9475676c7a2 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:07:18.525402 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-6e58aefb-6452-4420-8f81-d9475676c7a2 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] [instance: 9d592615-a510-440d-9f41-8476fee6f370] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:07:18.539231 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6e58aefb-6452-4420-8f81-d9475676c7a2 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:18.546479 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6e58aefb-6452-4420-8f81-d9475676c7a2 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:18.547168 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6e58aefb-6452-4420-8f81-d9475676c7a2 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:18.548294 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6e58aefb-6452-4420-8f81-d9475676c7a2 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:18.548911 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6e58aefb-6452-4420-8f81-d9475676c7a2 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:18.555136 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6e58aefb-6452-4420-8f81-d9475676c7a2 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:18.650928 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-7b08025c-52f2-4603-89b9-99cd66da2142 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "POST /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b/action" status: 202 len: 0 microversion: 2.1 time: 0.598862 Oct 04 22:07:18.653326 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2376/4693] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 22:07:18 2022] POST /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b/action => generated 0 bytes in 602 msecs (HTTP/1.1 202) 10 headers in 456 bytes (2 switches on core 0) Oct 04 22:07:19.053881 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-6e58aefb-6452-4420-8f81-d9475676c7a2 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cd0931292c245578bea8861f9ba7607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a555982bb6f841d7a72b6eca84a6150f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:07:19.074970 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-6e58aefb-6452-4420-8f81-d9475676c7a2 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] 10.222.0.43 "GET /compute/v2.1/servers/9d592615-a510-440d-9f41-8476fee6f370" status: 200 len: 1333 microversion: 2.1 time: 0.568591 Oct 04 22:07:19.091198 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2318/4694] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:07:18 2022] GET /compute/v2.1/servers/9d592615-a510-440d-9f41-8476fee6f370 => generated 1333 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:07:19.458085 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-bb09df8b-6529-46f8-9ee9-98b815814b0e req-3a53878b-db85-4dab-a508-74629e80b720 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48243e1b-892b-4c4b-8db1-242b2e40653b", "name": "network-vif-unplugged", "status": "completed", "tag": "a795c088-46ba-4a15-a651-33aa842e29b5"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:07:19.479526 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-bb09df8b-6529-46f8-9ee9-98b815814b0e req-3a53878b-db85-4dab-a508-74629e80b720 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:19.480859 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-bb09df8b-6529-46f8-9ee9-98b815814b0e req-3a53878b-db85-4dab-a508-74629e80b720 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:19.481303 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-bb09df8b-6529-46f8-9ee9-98b815814b0e req-3a53878b-db85-4dab-a508-74629e80b720 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:19.513709 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-bb09df8b-6529-46f8-9ee9-98b815814b0e req-3a53878b-db85-4dab-a508-74629e80b720 service nova] Creating event network-vif-unplugged:a795c088-46ba-4a15-a651-33aa842e29b5 for instance 48243e1b-892b-4c4b-8db1-242b2e40653b on n-h1-860284-1 Oct 04 22:07:19.523218 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-bb09df8b-6529-46f8-9ee9-98b815814b0e req-3a53878b-db85-4dab-a508-74629e80b720 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.073530 Oct 04 22:07:19.529495 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2377/4695] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:07:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:07:20.103818 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-831f48a7-5abb-4c8b-8b35-eca831c44569 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:07:20.104351 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-831f48a7-5abb-4c8b-8b35-eca831c44569 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] [instance: 9d592615-a510-440d-9f41-8476fee6f370] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:07:20.154790 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-831f48a7-5abb-4c8b-8b35-eca831c44569 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:20.155480 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-831f48a7-5abb-4c8b-8b35-eca831c44569 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:20.155937 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-831f48a7-5abb-4c8b-8b35-eca831c44569 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:20.156685 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-831f48a7-5abb-4c8b-8b35-eca831c44569 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:20.163498 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-831f48a7-5abb-4c8b-8b35-eca831c44569 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:20.164768 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-831f48a7-5abb-4c8b-8b35-eca831c44569 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:20.560930 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-831f48a7-5abb-4c8b-8b35-eca831c44569 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cd0931292c245578bea8861f9ba7607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a555982bb6f841d7a72b6eca84a6150f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:07:20.571141 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-831f48a7-5abb-4c8b-8b35-eca831c44569 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] 10.222.0.43 "GET /compute/v2.1/servers/9d592615-a510-440d-9f41-8476fee6f370" status: 200 len: 1669 microversion: 2.1 time: 0.471453 Oct 04 22:07:20.572013 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2319/4696] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:07:20 2022] GET /compute/v2.1/servers/9d592615-a510-440d-9f41-8476fee6f370 => generated 1669 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:07:20.599044 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-3f6ee9c5-fd47-485c-8807-8f17229a31ae tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:07:20.600345 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-3f6ee9c5-fd47-485c-8807-8f17229a31ae tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] [instance: 9d592615-a510-440d-9f41-8476fee6f370] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:07:20.608964 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3f6ee9c5-fd47-485c-8807-8f17229a31ae tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:20.609781 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3f6ee9c5-fd47-485c-8807-8f17229a31ae tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:20.610478 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3f6ee9c5-fd47-485c-8807-8f17229a31ae tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:20.611739 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3f6ee9c5-fd47-485c-8807-8f17229a31ae tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:20.612834 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3f6ee9c5-fd47-485c-8807-8f17229a31ae tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:20.613338 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3f6ee9c5-fd47-485c-8807-8f17229a31ae tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:20.643584 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-3f6ee9c5-fd47-485c-8807-8f17229a31ae tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] 10.222.0.43 "GET /compute/v2.1/servers/9d592615-a510-440d-9f41-8476fee6f370/ips" status: 200 len: 180 microversion: 2.1 time: 0.050059 Oct 04 22:07:20.644824 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2378/4697] 10.222.0.43 () {58 vars in 1248 bytes} [Tue Oct 4 22:07:20 2022] GET /compute/v2.1/servers/9d592615-a510-440d-9f41-8476fee6f370/ips => generated 180 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:07:20.657693 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-69b1dba6-970b-4d1f-a9ed-745ba7cf94bc tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:07:20.658046 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-69b1dba6-970b-4d1f-a9ed-745ba7cf94bc tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] [instance: 9d592615-a510-440d-9f41-8476fee6f370] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:07:20.670103 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-69b1dba6-970b-4d1f-a9ed-745ba7cf94bc tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:20.671012 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-69b1dba6-970b-4d1f-a9ed-745ba7cf94bc tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:20.671710 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-69b1dba6-970b-4d1f-a9ed-745ba7cf94bc tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:20.672796 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-69b1dba6-970b-4d1f-a9ed-745ba7cf94bc tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:20.673588 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-69b1dba6-970b-4d1f-a9ed-745ba7cf94bc tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:20.674287 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-69b1dba6-970b-4d1f-a9ed-745ba7cf94bc tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:20.709614 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-69b1dba6-970b-4d1f-a9ed-745ba7cf94bc tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] [instance: 9d592615-a510-440d-9f41-8476fee6f370] Going to try to terminate instance {{(pid=134101) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 22:07:20.858255 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-69b1dba6-970b-4d1f-a9ed-745ba7cf94bc tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] 10.222.0.43 "DELETE /compute/v2.1/servers/9d592615-a510-440d-9f41-8476fee6f370" status: 204 len: 0 microversion: 2.1 time: 0.204720 Oct 04 22:07:20.865446 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2320/4698] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 22:07:20 2022] DELETE /compute/v2.1/servers/9d592615-a510-440d-9f41-8476fee6f370 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 22:07:20.870322 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-b80e2890-197e-4e52-9032-38ab993aab53 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:07:20.871140 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-b80e2890-197e-4e52-9032-38ab993aab53 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] [instance: 9d592615-a510-440d-9f41-8476fee6f370] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:07:20.883950 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b80e2890-197e-4e52-9032-38ab993aab53 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:20.884878 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b80e2890-197e-4e52-9032-38ab993aab53 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:20.885658 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b80e2890-197e-4e52-9032-38ab993aab53 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:20.886706 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b80e2890-197e-4e52-9032-38ab993aab53 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:20.887499 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b80e2890-197e-4e52-9032-38ab993aab53 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:20.888106 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b80e2890-197e-4e52-9032-38ab993aab53 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:21.697415 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-b80e2890-197e-4e52-9032-38ab993aab53 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cd0931292c245578bea8861f9ba7607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a555982bb6f841d7a72b6eca84a6150f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:07:21.709750 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-b80e2890-197e-4e52-9032-38ab993aab53 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] 10.222.0.43 "GET /compute/v2.1/servers/9d592615-a510-440d-9f41-8476fee6f370" status: 200 len: 1675 microversion: 2.1 time: 0.843649 Oct 04 22:07:21.710300 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2379/4699] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:07:20 2022] GET /compute/v2.1/servers/9d592615-a510-440d-9f41-8476fee6f370 => generated 1675 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:07:21.906642 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-74d430e7-c849-469b-8cf5-1f0c3b1932c8 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-333611679", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f42d911e-d0db-47f1-8152-1d0e2f63f805"}], "security_groups": [{"name": "tempest-securitygroup--1792031634"}], "key_name": "tempest-keypair-483355405", "user_data": "}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:07:22.170121 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.network.neutron [None req-74d430e7-c849-469b-8cf5-1f0c3b1932c8 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] validate_networks() for [('f42d911e-d0db-47f1-8152-1d0e2f63f805', None, None, None, None, None)] {{(pid=134101) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 22:07:22.734780 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-5789ea8c-d960-47d0-8981-eac4c3d90a7a tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:07:22.736124 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-5789ea8c-d960-47d0-8981-eac4c3d90a7a tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] [instance: 9d592615-a510-440d-9f41-8476fee6f370] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:07:22.754270 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5789ea8c-d960-47d0-8981-eac4c3d90a7a tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:22.761953 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5789ea8c-d960-47d0-8981-eac4c3d90a7a tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:22.762690 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5789ea8c-d960-47d0-8981-eac4c3d90a7a tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:22.769155 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5789ea8c-d960-47d0-8981-eac4c3d90a7a tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:22.772495 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5789ea8c-d960-47d0-8981-eac4c3d90a7a tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:22.774918 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5789ea8c-d960-47d0-8981-eac4c3d90a7a tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:23.361716 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-5789ea8c-d960-47d0-8981-eac4c3d90a7a tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cd0931292c245578bea8861f9ba7607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a555982bb6f841d7a72b6eca84a6150f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:07:23.376169 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-5789ea8c-d960-47d0-8981-eac4c3d90a7a tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] 10.222.0.43 "GET /compute/v2.1/servers/9d592615-a510-440d-9f41-8476fee6f370" status: 200 len: 1675 microversion: 2.1 time: 0.645755 Oct 04 22:07:23.399441 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2380/4700] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:07:22 2022] GET /compute/v2.1/servers/9d592615-a510-440d-9f41-8476fee6f370 => generated 1675 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:07:23.601381 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-74d430e7-c849-469b-8cf5-1f0c3b1932c8 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Flavor limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 22:07:23.601853 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-74d430e7-c849-469b-8cf5-1f0c3b1932c8 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Image limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 22:07:23.602331 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-74d430e7-c849-469b-8cf5-1f0c3b1932c8 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Flavor pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 22:07:23.602715 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-74d430e7-c849-469b-8cf5-1f0c3b1932c8 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Image pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 22:07:23.603124 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-74d430e7-c849-469b-8cf5-1f0c3b1932c8 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 22:07:23.614635 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-74d430e7-c849-469b-8cf5-1f0c3b1932c8 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:23.615382 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-74d430e7-c849-469b-8cf5-1f0c3b1932c8 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:23.616130 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-74d430e7-c849-469b-8cf5-1f0c3b1932c8 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:23.617546 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-74d430e7-c849-469b-8cf5-1f0c3b1932c8 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:23.618165 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-74d430e7-c849-469b-8cf5-1f0c3b1932c8 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:23.618955 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-74d430e7-c849-469b-8cf5-1f0c3b1932c8 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:23.644836 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-74d430e7-c849-469b-8cf5-1f0c3b1932c8 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Getting quotas for project 82e1a29234ce40f9b37d0eca196cd1db. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:07:23.652127 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-74d430e7-c849-469b-8cf5-1f0c3b1932c8 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Getting quotas for user 80fc56886fef422b9b52eb1dede7d10e and project 82e1a29234ce40f9b37d0eca196cd1db. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:07:23.668583 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-74d430e7-c849-469b-8cf5-1f0c3b1932c8 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Going to run 1 instances... {{(pid=134101) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 22:07:23.672399 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-74d430e7-c849-469b-8cf5-1f0c3b1932c8 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] [instance: e616bb7a-3fab-411e-ab23-25d093c36691] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='58548514-5dac-426c-81f5-19e3fba33e23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134101) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 22:07:23.751319 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-74d430e7-c849-469b-8cf5-1f0c3b1932c8 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.849048 Oct 04 22:07:23.763014 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2321/4701] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 22:07:21 2022] POST /compute/v2.1/servers => generated 402 bytes in 1863 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 22:07:23.767590 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-c97c5ede-8e9d-4e3f-944e-3cac15fdc898 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:07:23.768113 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-c97c5ede-8e9d-4e3f-944e-3cac15fdc898 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] [instance: e616bb7a-3fab-411e-ab23-25d093c36691] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:07:23.934547 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-c97c5ede-8e9d-4e3f-944e-3cac15fdc898 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80fc56886fef422b9b52eb1dede7d10e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82e1a29234ce40f9b37d0eca196cd1db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:07:23.957827 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-c97c5ede-8e9d-4e3f-944e-3cac15fdc898 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] 10.222.0.43 "GET /compute/v2.1/servers/e616bb7a-3fab-411e-ab23-25d093c36691" status: 200 len: 1240 microversion: 2.1 time: 0.185264 Oct 04 22:07:23.963215 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2381/4702] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:07:23 2022] GET /compute/v2.1/servers/e616bb7a-3fab-411e-ab23-25d093c36691 => generated 1240 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:07:24.413225 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-935ad940-f41d-4379-b455-87b158b25f86 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:07:24.414076 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-935ad940-f41d-4379-b455-87b158b25f86 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] [instance: 9d592615-a510-440d-9f41-8476fee6f370] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:07:24.438835 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-935ad940-f41d-4379-b455-87b158b25f86 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:24.439781 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-935ad940-f41d-4379-b455-87b158b25f86 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:24.441336 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-935ad940-f41d-4379-b455-87b158b25f86 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:24.442670 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-935ad940-f41d-4379-b455-87b158b25f86 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:24.443466 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-935ad940-f41d-4379-b455-87b158b25f86 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:24.444211 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-935ad940-f41d-4379-b455-87b158b25f86 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:24.808519 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-935ad940-f41d-4379-b455-87b158b25f86 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cd0931292c245578bea8861f9ba7607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a555982bb6f841d7a72b6eca84a6150f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:07:24.828734 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-935ad940-f41d-4379-b455-87b158b25f86 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] 10.222.0.43 "GET /compute/v2.1/servers/9d592615-a510-440d-9f41-8476fee6f370" status: 200 len: 1675 microversion: 2.1 time: 0.430982 Oct 04 22:07:24.832943 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2322/4703] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:07:24 2022] GET /compute/v2.1/servers/9d592615-a510-440d-9f41-8476fee6f370 => generated 1675 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:07:24.888420 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-20ae6aa9-2d2a-4763-9b62-3ee2dc7801fb req-cbdd8c85-c9dc-4d0e-b73f-585f3e16e836 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48243e1b-892b-4c4b-8db1-242b2e40653b", "name": "network-vif-plugged", "status": "completed", "tag": "a795c088-46ba-4a15-a651-33aa842e29b5"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:07:24.913728 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-20ae6aa9-2d2a-4763-9b62-3ee2dc7801fb req-cbdd8c85-c9dc-4d0e-b73f-585f3e16e836 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:24.914559 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-20ae6aa9-2d2a-4763-9b62-3ee2dc7801fb req-cbdd8c85-c9dc-4d0e-b73f-585f3e16e836 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:24.915181 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-20ae6aa9-2d2a-4763-9b62-3ee2dc7801fb req-cbdd8c85-c9dc-4d0e-b73f-585f3e16e836 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:24.945196 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-20ae6aa9-2d2a-4763-9b62-3ee2dc7801fb req-cbdd8c85-c9dc-4d0e-b73f-585f3e16e836 service nova] Creating event network-vif-plugged:a795c088-46ba-4a15-a651-33aa842e29b5 for instance 48243e1b-892b-4c4b-8db1-242b2e40653b on n-h1-860284-1 Oct 04 22:07:24.961291 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-20ae6aa9-2d2a-4763-9b62-3ee2dc7801fb req-cbdd8c85-c9dc-4d0e-b73f-585f3e16e836 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076185 Oct 04 22:07:24.964042 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2382/4704] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:07:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:07:24.991348 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-4ce2dd34-cd98-4b02-a297-df4769624e24 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:07:24.992336 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-4ce2dd34-cd98-4b02-a297-df4769624e24 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] [instance: e616bb7a-3fab-411e-ab23-25d093c36691] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:07:25.023656 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4ce2dd34-cd98-4b02-a297-df4769624e24 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:25.026711 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4ce2dd34-cd98-4b02-a297-df4769624e24 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:25.030762 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4ce2dd34-cd98-4b02-a297-df4769624e24 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:25.033991 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4ce2dd34-cd98-4b02-a297-df4769624e24 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:25.038439 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4ce2dd34-cd98-4b02-a297-df4769624e24 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:25.040144 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4ce2dd34-cd98-4b02-a297-df4769624e24 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:25.177208 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-a6f1a496-bcc5-4cd3-a79a-c5ee3682be0b req-d2b0848b-a9ca-4af9-8c88-ca3ac31d3f9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d592615-a510-440d-9f41-8476fee6f370", "name": "network-vif-deleted", "tag": "325e8b1f-32b2-4124-be4a-18e8fff98adc"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:07:25.201783 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-a6f1a496-bcc5-4cd3-a79a-c5ee3682be0b req-d2b0848b-a9ca-4af9-8c88-ca3ac31d3f9a service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:25.202575 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-a6f1a496-bcc5-4cd3-a79a-c5ee3682be0b req-d2b0848b-a9ca-4af9-8c88-ca3ac31d3f9a service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:25.203187 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-a6f1a496-bcc5-4cd3-a79a-c5ee3682be0b req-d2b0848b-a9ca-4af9-8c88-ca3ac31d3f9a service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:25.239783 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-a6f1a496-bcc5-4cd3-a79a-c5ee3682be0b req-d2b0848b-a9ca-4af9-8c88-ca3ac31d3f9a service nova] Creating event network-vif-deleted:325e8b1f-32b2-4124-be4a-18e8fff98adc for instance 9d592615-a510-440d-9f41-8476fee6f370 on n-h2-860284-1 Oct 04 22:07:25.264571 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-a6f1a496-bcc5-4cd3-a79a-c5ee3682be0b req-d2b0848b-a9ca-4af9-8c88-ca3ac31d3f9a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091661 Oct 04 22:07:25.266601 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2383/4705] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:07:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:07:25.451030 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-4ce2dd34-cd98-4b02-a297-df4769624e24 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80fc56886fef422b9b52eb1dede7d10e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82e1a29234ce40f9b37d0eca196cd1db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:07:25.476474 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-4ce2dd34-cd98-4b02-a297-df4769624e24 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] 10.222.0.43 "GET /compute/v2.1/servers/e616bb7a-3fab-411e-ab23-25d093c36691" status: 200 len: 1236 microversion: 2.1 time: 0.489548 Oct 04 22:07:25.499171 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2323/4706] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:07:24 2022] GET /compute/v2.1/servers/e616bb7a-3fab-411e-ab23-25d093c36691 => generated 1236 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:07:25.859752 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-8c6d5e0f-e418-4d4f-8320-368c96834ef6 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:07:25.860775 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-8c6d5e0f-e418-4d4f-8320-368c96834ef6 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] [instance: 9d592615-a510-440d-9f41-8476fee6f370] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:07:25.873031 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8c6d5e0f-e418-4d4f-8320-368c96834ef6 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:25.876656 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8c6d5e0f-e418-4d4f-8320-368c96834ef6 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:25.877400 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8c6d5e0f-e418-4d4f-8320-368c96834ef6 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:25.878464 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8c6d5e0f-e418-4d4f-8320-368c96834ef6 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:25.883196 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8c6d5e0f-e418-4d4f-8320-368c96834ef6 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:25.883945 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8c6d5e0f-e418-4d4f-8320-368c96834ef6 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:26.324646 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-8c6d5e0f-e418-4d4f-8320-368c96834ef6 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cd0931292c245578bea8861f9ba7607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a555982bb6f841d7a72b6eca84a6150f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:07:26.343841 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-8c6d5e0f-e418-4d4f-8320-368c96834ef6 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] 10.222.0.43 "GET /compute/v2.1/servers/9d592615-a510-440d-9f41-8476fee6f370" status: 200 len: 1496 microversion: 2.1 time: 0.490237 Oct 04 22:07:26.345036 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2384/4707] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:07:25 2022] GET /compute/v2.1/servers/9d592615-a510-440d-9f41-8476fee6f370 => generated 1496 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:07:26.505170 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-7f5acef6-f735-4fb1-8026-6b6736be9a95 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:07:26.512761 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-55964994-4893-486e-bd98-31b91595b0ae tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:07:26.516802 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-7f5acef6-f735-4fb1-8026-6b6736be9a95 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] [instance: 92d3d7e9-8a75-4e07-812c-8b9f441e0376] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:07:26.519223 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-55964994-4893-486e-bd98-31b91595b0ae tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] [instance: e616bb7a-3fab-411e-ab23-25d093c36691] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:07:26.537840 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-55964994-4893-486e-bd98-31b91595b0ae tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:26.538332 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-55964994-4893-486e-bd98-31b91595b0ae tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:26.543166 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7f5acef6-f735-4fb1-8026-6b6736be9a95 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:26.543932 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7f5acef6-f735-4fb1-8026-6b6736be9a95 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:26.544729 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-55964994-4893-486e-bd98-31b91595b0ae tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:26.545346 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7f5acef6-f735-4fb1-8026-6b6736be9a95 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:26.547396 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7f5acef6-f735-4fb1-8026-6b6736be9a95 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:26.550161 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-55964994-4893-486e-bd98-31b91595b0ae tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:26.550971 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7f5acef6-f735-4fb1-8026-6b6736be9a95 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:26.552170 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-55964994-4893-486e-bd98-31b91595b0ae tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:26.552618 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-55964994-4893-486e-bd98-31b91595b0ae tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:26.555195 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7f5acef6-f735-4fb1-8026-6b6736be9a95 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:26.712130 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-55964994-4893-486e-bd98-31b91595b0ae tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80fc56886fef422b9b52eb1dede7d10e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82e1a29234ce40f9b37d0eca196cd1db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:07:26.738655 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-55964994-4893-486e-bd98-31b91595b0ae tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] 10.222.0.43 "GET /compute/v2.1/servers/e616bb7a-3fab-411e-ab23-25d093c36691" status: 200 len: 1298 microversion: 2.1 time: 0.230314 Oct 04 22:07:26.741908 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2385/4708] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:07:26 2022] GET /compute/v2.1/servers/e616bb7a-3fab-411e-ab23-25d093c36691 => generated 1298 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:07:26.763840 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.objects.instance [None req-7f5acef6-f735-4fb1-8026-6b6736be9a95 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lazy-loading 'services' on Instance uuid 92d3d7e9-8a75-4e07-812c-8b9f441e0376 {{(pid=134101) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 22:07:27.007687 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-7f5acef6-f735-4fb1-8026-6b6736be9a95 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] 10.222.0.43 "DELETE /compute/v2.1/servers/92d3d7e9-8a75-4e07-812c-8b9f441e0376/os-volume_attachments/06c5b346-db5e-4e76-be3f-495fbaea7d71" status: 202 len: 0 microversion: 2.1 time: 0.504426 Oct 04 22:07:27.011427 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2324/4709] 10.222.0.43 () {58 vars in 1416 bytes} [Tue Oct 4 22:07:26 2022] DELETE /compute/v2.1/servers/92d3d7e9-8a75-4e07-812c-8b9f441e0376/os-volume_attachments/06c5b346-db5e-4e76-be3f-495fbaea7d71 => generated 0 bytes in 510 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 22:07:27.124869 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-881c92a5-46f0-4474-90b1-44008a0d6b13 req-bba6b0ef-1c4b-4867-8af9-93ddddbed1c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d592615-a510-440d-9f41-8476fee6f370", "name": "network-vif-unplugged", "status": "completed", "tag": "406e9f5e-41b6-4909-b819-3005e1869096"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:07:27.173931 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-881c92a5-46f0-4474-90b1-44008a0d6b13 req-bba6b0ef-1c4b-4867-8af9-93ddddbed1c0 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:27.178693 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-881c92a5-46f0-4474-90b1-44008a0d6b13 req-bba6b0ef-1c4b-4867-8af9-93ddddbed1c0 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:27.179463 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-881c92a5-46f0-4474-90b1-44008a0d6b13 req-bba6b0ef-1c4b-4867-8af9-93ddddbed1c0 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:27.211812 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-881c92a5-46f0-4474-90b1-44008a0d6b13 req-bba6b0ef-1c4b-4867-8af9-93ddddbed1c0 service nova] Creating event network-vif-unplugged:406e9f5e-41b6-4909-b819-3005e1869096 for instance 9d592615-a510-440d-9f41-8476fee6f370 on n-h2-860284-1 Oct 04 22:07:27.233189 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-881c92a5-46f0-4474-90b1-44008a0d6b13 req-bba6b0ef-1c4b-4867-8af9-93ddddbed1c0 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.114093 Oct 04 22:07:27.237955 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2386/4710] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:07:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:07:27.376019 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-a3e84eb9-f1f9-439a-84d7-4412881244d2 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:07:27.376939 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-a3e84eb9-f1f9-439a-84d7-4412881244d2 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] [instance: 9d592615-a510-440d-9f41-8476fee6f370] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:07:27.385775 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a3e84eb9-f1f9-439a-84d7-4412881244d2 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:27.386276 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a3e84eb9-f1f9-439a-84d7-4412881244d2 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:27.386769 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a3e84eb9-f1f9-439a-84d7-4412881244d2 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:27.387477 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a3e84eb9-f1f9-439a-84d7-4412881244d2 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:27.392461 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a3e84eb9-f1f9-439a-84d7-4412881244d2 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:27.394143 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a3e84eb9-f1f9-439a-84d7-4412881244d2 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:27.764155 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-9555d5ae-b7c0-45f3-96cd-49082d01339e tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:07:27.765573 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-9555d5ae-b7c0-45f3-96cd-49082d01339e tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] [instance: e616bb7a-3fab-411e-ab23-25d093c36691] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:07:27.765824 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-a3e84eb9-f1f9-439a-84d7-4412881244d2 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cd0931292c245578bea8861f9ba7607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a555982bb6f841d7a72b6eca84a6150f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:07:27.774737 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9555d5ae-b7c0-45f3-96cd-49082d01339e tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:27.775555 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9555d5ae-b7c0-45f3-96cd-49082d01339e tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:27.776242 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9555d5ae-b7c0-45f3-96cd-49082d01339e tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:27.777231 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9555d5ae-b7c0-45f3-96cd-49082d01339e tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:27.777923 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9555d5ae-b7c0-45f3-96cd-49082d01339e tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:27.778795 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9555d5ae-b7c0-45f3-96cd-49082d01339e tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:27.786293 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-a3e84eb9-f1f9-439a-84d7-4412881244d2 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] 10.222.0.43 "GET /compute/v2.1/servers/9d592615-a510-440d-9f41-8476fee6f370" status: 200 len: 1496 microversion: 2.1 time: 0.417999 Oct 04 22:07:27.786940 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2325/4711] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:07:27 2022] GET /compute/v2.1/servers/9d592615-a510-440d-9f41-8476fee6f370 => generated 1496 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:07:27.869247 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-6e9abec3-3f97-4fe6-b8c5-308c25911810 req-ac68f6d0-517a-4e97-8ecd-96658ca4eff1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d592615-a510-440d-9f41-8476fee6f370", "name": "network-vif-deleted", "tag": "406e9f5e-41b6-4909-b819-3005e1869096"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:07:27.927946 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-6e9abec3-3f97-4fe6-b8c5-308c25911810 req-ac68f6d0-517a-4e97-8ecd-96658ca4eff1 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:27.932995 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-6e9abec3-3f97-4fe6-b8c5-308c25911810 req-ac68f6d0-517a-4e97-8ecd-96658ca4eff1 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:27.933498 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-6e9abec3-3f97-4fe6-b8c5-308c25911810 req-ac68f6d0-517a-4e97-8ecd-96658ca4eff1 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:27.970822 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-9555d5ae-b7c0-45f3-96cd-49082d01339e tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80fc56886fef422b9b52eb1dede7d10e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82e1a29234ce40f9b37d0eca196cd1db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:07:27.990435 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-6e9abec3-3f97-4fe6-b8c5-308c25911810 req-ac68f6d0-517a-4e97-8ecd-96658ca4eff1 service nova] Creating event network-vif-deleted:406e9f5e-41b6-4909-b819-3005e1869096 for instance 9d592615-a510-440d-9f41-8476fee6f370 on n-h2-860284-1 Oct 04 22:07:27.991200 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-9555d5ae-b7c0-45f3-96cd-49082d01339e tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] 10.222.0.43 "GET /compute/v2.1/servers/e616bb7a-3fab-411e-ab23-25d093c36691" status: 200 len: 1298 microversion: 2.1 time: 0.226766 Oct 04 22:07:27.991934 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2387/4712] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:07:27 2022] GET /compute/v2.1/servers/e616bb7a-3fab-411e-ab23-25d093c36691 => generated 1298 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:07:28.005252 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-6e9abec3-3f97-4fe6-b8c5-308c25911810 req-ac68f6d0-517a-4e97-8ecd-96658ca4eff1 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.143810 Oct 04 22:07:28.009292 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2326/4713] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:07:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:07:28.816162 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-78cfe2e7-5838-4a2e-ba3f-a40dd864d2e1 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:07:28.816886 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-78cfe2e7-5838-4a2e-ba3f-a40dd864d2e1 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] [instance: 9d592615-a510-440d-9f41-8476fee6f370] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:07:28.830144 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-78cfe2e7-5838-4a2e-ba3f-a40dd864d2e1 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:28.832086 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-78cfe2e7-5838-4a2e-ba3f-a40dd864d2e1 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:28.833979 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-78cfe2e7-5838-4a2e-ba3f-a40dd864d2e1 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:28.837184 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-78cfe2e7-5838-4a2e-ba3f-a40dd864d2e1 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:28.837920 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-78cfe2e7-5838-4a2e-ba3f-a40dd864d2e1 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:28.838603 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-78cfe2e7-5838-4a2e-ba3f-a40dd864d2e1 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:28.929544 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-78cfe2e7-5838-4a2e-ba3f-a40dd864d2e1 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:28.931187 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-78cfe2e7-5838-4a2e-ba3f-a40dd864d2e1 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:28.932846 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-78cfe2e7-5838-4a2e-ba3f-a40dd864d2e1 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:28.935051 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.objects.instance [None req-78cfe2e7-5838-4a2e-ba3f-a40dd864d2e1 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lazy-loading 'fault' on Instance uuid 9d592615-a510-440d-9f41-8476fee6f370 {{(pid=134102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 22:07:29.031334 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-7f96f53b-0eaf-4bf5-9429-6a54daa733eb tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:07:29.033220 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-7f96f53b-0eaf-4bf5-9429-6a54daa733eb tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] [instance: e616bb7a-3fab-411e-ab23-25d093c36691] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:07:29.053939 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7f96f53b-0eaf-4bf5-9429-6a54daa733eb tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:29.055121 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7f96f53b-0eaf-4bf5-9429-6a54daa733eb tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:29.055599 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7f96f53b-0eaf-4bf5-9429-6a54daa733eb tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:29.059430 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7f96f53b-0eaf-4bf5-9429-6a54daa733eb tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:29.059858 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7f96f53b-0eaf-4bf5-9429-6a54daa733eb tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:29.061474 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7f96f53b-0eaf-4bf5-9429-6a54daa733eb tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:29.087222 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-78cfe2e7-5838-4a2e-ba3f-a40dd864d2e1 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cd0931292c245578bea8861f9ba7607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a555982bb6f841d7a72b6eca84a6150f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:07:29.107591 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-78cfe2e7-5838-4a2e-ba3f-a40dd864d2e1 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] 10.222.0.43 "GET /compute/v2.1/servers/9d592615-a510-440d-9f41-8476fee6f370" status: 200 len: 1302 microversion: 2.1 time: 0.296896 Oct 04 22:07:29.112612 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2388/4714] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:07:28 2022] GET /compute/v2.1/servers/9d592615-a510-440d-9f41-8476fee6f370 => generated 1302 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:07:29.208336 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-7f96f53b-0eaf-4bf5-9429-6a54daa733eb tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80fc56886fef422b9b52eb1dede7d10e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82e1a29234ce40f9b37d0eca196cd1db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:07:29.220830 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-7f96f53b-0eaf-4bf5-9429-6a54daa733eb tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] 10.222.0.43 "GET /compute/v2.1/servers/e616bb7a-3fab-411e-ab23-25d093c36691" status: 200 len: 1298 microversion: 2.1 time: 0.199502 Oct 04 22:07:29.222312 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2327/4715] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:07:29 2022] GET /compute/v2.1/servers/e616bb7a-3fab-411e-ab23-25d093c36691 => generated 1298 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:07:30.140324 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-751e2089-00ac-423b-89ab-2750f1163b10 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:07:30.140808 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-751e2089-00ac-423b-89ab-2750f1163b10 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] [instance: 9d592615-a510-440d-9f41-8476fee6f370] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:07:30.166956 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-751e2089-00ac-423b-89ab-2750f1163b10 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:30.167614 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-751e2089-00ac-423b-89ab-2750f1163b10 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:30.168078 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-751e2089-00ac-423b-89ab-2750f1163b10 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:30.168839 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-751e2089-00ac-423b-89ab-2750f1163b10 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:30.169305 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-751e2089-00ac-423b-89ab-2750f1163b10 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:30.169741 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-751e2089-00ac-423b-89ab-2750f1163b10 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:30.241477 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-751e2089-00ac-423b-89ab-2750f1163b10 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] HTTP exception thrown: Instance 9d592615-a510-440d-9f41-8476fee6f370 could not be found. Oct 04 22:07:30.243151 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-751e2089-00ac-423b-89ab-2750f1163b10 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Request method failure captured: Oct 04 22:07:30.243151 n-d-860284-1 devstack@n-api.service[134102]: request: GET /compute/v2.1/servers/9d592615-a510-440d-9f41-8476fee6f370 HTTP/1.1 Oct 04 22:07:30.243151 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 22:07:30.243151 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 22:07:30.243151 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 22:07:30.243151 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 22:07:30.243151 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 22:07:30.243151 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 22:07:30.243151 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 22:07:30.243151 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 22:07:30.243151 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPK4rVHSJ18_h3nmUTvsmLkrcgyz9VziEUYrv1QHLl0wUgMHspzD_35xS7SrUWqlg61UpMYX9ej0QcvySSs-V_aXPECB8PZsHWnLLZbr8gujVcglgZ1-aIET1G1xYZDLJYg-p6aFIZc8xBttPJ9iKmwMFj4IATa36OmQb4o86GYOSO5s Oct 04 22:07:30.243151 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 22:07:30.243151 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 22:07:30.243151 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 22:07:30.243151 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 22:07:30.243151 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 22:07:30.243151 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 22:07:30.243151 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: a555982bb6f841d7a72b6eca84a6150f Oct 04 22:07:30.243151 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-ServersTestMultiNic-1109058152 Oct 04 22:07:30.243151 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 22:07:30.243151 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 22:07:30.243151 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a555982bb6f841d7a72b6eca84a6150f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_a555982bb6f841d7a72b6eca84a6150f", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a555982bb6f841d7a72b6eca84a6150f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/a555982bb6f841d7a72b6eca84a6150f"}]}] Oct 04 22:07:30.243151 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-ServersTestMultiNic-1109058152 Oct 04 22:07:30.243151 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: a555982bb6f841d7a72b6eca84a6150f Oct 04 22:07:30.243151 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-ServersTestMultiNic-1109058152 Oct 04 22:07:30.243151 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-ServersTestMultiNic-1109058152-project Oct 04 22:07:30.243151 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 22:07:30.243151 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 22:07:30.243151 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: 4cd0931292c245578bea8861f9ba7607 Oct 04 22:07:30.243151 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-ServersTestMultiNic-1109058152-project Oct 04 22:07:30.243151 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 22:07:30.243151 n-d-860284-1 devstack@n-api.service[134102]: exception: Instance 9d592615-a510-440d-9f41-8476fee6f370 could not be found. Oct 04 22:07:30.243151 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': '9d592615-a510-440d-9f41-8476fee6f370'} Oct 04 22:07:30.243151 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:07:30.243151 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:07:30.243151 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:07:30.243151 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:07:30.243151 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:07:30.243151 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:07:30.243151 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:07:30.243151 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:07:30.243151 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:07:30.243151 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:07:30.243151 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d592615-a510-440d-9f41-8476fee6f370 could not be found. Oct 04 22:07:30.243151 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:07:30.243151 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:07:30.243151 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:07:30.243151 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:07:30.243151 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:07:30.243151 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:07:30.243151 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:07:30.243151 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:07:30.243151 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:07:30.243151 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:07:30.243151 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:07:30.243151 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:07:30.243151 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:07:30.243151 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:07:30.243151 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:07:30.243151 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:07:30.243151 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d592615-a510-440d-9f41-8476fee6f370 could not be found. Oct 04 22:07:30.243151 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:07:30.243151 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:07:30.243151 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:07:30.247996 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:07:30.247996 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:07:30.247996 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:07:30.247996 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:07:30.247996 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:07:30.247996 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d592615-a510-440d-9f41-8476fee6f370 could not be found. Oct 04 22:07:30.247996 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:07:30.247996 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-751e2089-00ac-423b-89ab-2750f1163b10 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Returning 404 to user: Instance 9d592615-a510-440d-9f41-8476fee6f370 could not be found. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:07:30.247996 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-751e2089-00ac-423b-89ab-2750f1163b10 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] 10.222.0.43 "GET /compute/v2.1/servers/9d592615-a510-440d-9f41-8476fee6f370" status: 404 len: 111 microversion: 2.1 time: 0.108971 Oct 04 22:07:30.248692 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2389/4716] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:07:30 2022] GET /compute/v2.1/servers/9d592615-a510-440d-9f41-8476fee6f370 => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:07:30.260483 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-a2ffe00c-80ee-4960-8035-d3e33800e6b3 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:07:30.261305 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-a2ffe00c-80ee-4960-8035-d3e33800e6b3 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] [instance: e616bb7a-3fab-411e-ab23-25d093c36691] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:07:30.283508 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a2ffe00c-80ee-4960-8035-d3e33800e6b3 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:30.284239 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a2ffe00c-80ee-4960-8035-d3e33800e6b3 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:30.284744 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a2ffe00c-80ee-4960-8035-d3e33800e6b3 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:30.285506 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a2ffe00c-80ee-4960-8035-d3e33800e6b3 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:30.287758 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a2ffe00c-80ee-4960-8035-d3e33800e6b3 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:30.288405 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a2ffe00c-80ee-4960-8035-d3e33800e6b3 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:32.105025 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-a2ffe00c-80ee-4960-8035-d3e33800e6b3 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80fc56886fef422b9b52eb1dede7d10e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82e1a29234ce40f9b37d0eca196cd1db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:07:32.127170 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-a2ffe00c-80ee-4960-8035-d3e33800e6b3 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] 10.222.0.43 "GET /compute/v2.1/servers/e616bb7a-3fab-411e-ab23-25d093c36691" status: 200 len: 1366 microversion: 2.1 time: 1.885926 Oct 04 22:07:32.138491 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2328/4717] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:07:30 2022] GET /compute/v2.1/servers/e616bb7a-3fab-411e-ab23-25d093c36691 => generated 1366 bytes in 1898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:07:33.165631 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-5c5028d0-6f1a-4263-a97b-7a6f96bdce29 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:07:33.167215 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-5c5028d0-6f1a-4263-a97b-7a6f96bdce29 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] [instance: e616bb7a-3fab-411e-ab23-25d093c36691] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:07:33.201569 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5c5028d0-6f1a-4263-a97b-7a6f96bdce29 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:33.204261 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5c5028d0-6f1a-4263-a97b-7a6f96bdce29 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:33.207280 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5c5028d0-6f1a-4263-a97b-7a6f96bdce29 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:33.208497 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5c5028d0-6f1a-4263-a97b-7a6f96bdce29 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:33.212990 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5c5028d0-6f1a-4263-a97b-7a6f96bdce29 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:33.218041 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5c5028d0-6f1a-4263-a97b-7a6f96bdce29 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:33.711278 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-5c5028d0-6f1a-4263-a97b-7a6f96bdce29 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80fc56886fef422b9b52eb1dede7d10e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82e1a29234ce40f9b37d0eca196cd1db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:07:33.723098 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-5c5028d0-6f1a-4263-a97b-7a6f96bdce29 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] 10.222.0.43 "GET /compute/v2.1/servers/e616bb7a-3fab-411e-ab23-25d093c36691" status: 200 len: 1366 microversion: 2.1 time: 0.564782 Oct 04 22:07:33.729075 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2390/4718] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:07:33 2022] GET /compute/v2.1/servers/e616bb7a-3fab-411e-ab23-25d093c36691 => generated 1366 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:07:34.756342 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-49efa00b-79b8-4ad5-94fb-eae63488e294 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:07:34.757000 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-49efa00b-79b8-4ad5-94fb-eae63488e294 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] [instance: e616bb7a-3fab-411e-ab23-25d093c36691] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:07:34.772468 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=2 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:07:34.773283 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=10 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:07:34.784399 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-49efa00b-79b8-4ad5-94fb-eae63488e294 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:34.785234 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-49efa00b-79b8-4ad5-94fb-eae63488e294 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:34.788419 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-49efa00b-79b8-4ad5-94fb-eae63488e294 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:34.790757 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-49efa00b-79b8-4ad5-94fb-eae63488e294 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:34.793227 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-49efa00b-79b8-4ad5-94fb-eae63488e294 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:34.794040 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-49efa00b-79b8-4ad5-94fb-eae63488e294 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:34.896124 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-4609200c-e53f-457e-b501-8e46ff8939f0 req-f1baaf0a-228d-48b2-bf06-ccb43cec5360 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e616bb7a-3fab-411e-ab23-25d093c36691", "tag": "cd8f87a5-9b17-4bf6-9825-06160395f18f"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:07:34.901698 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell0:SELECT=2 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:07:34.934095 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-4609200c-e53f-457e-b501-8e46ff8939f0 req-f1baaf0a-228d-48b2-bf06-ccb43cec5360 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:34.935019 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-4609200c-e53f-457e-b501-8e46ff8939f0 req-f1baaf0a-228d-48b2-bf06-ccb43cec5360 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:34.935477 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-4609200c-e53f-457e-b501-8e46ff8939f0 req-f1baaf0a-228d-48b2-bf06-ccb43cec5360 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:34.984524 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-4609200c-e53f-457e-b501-8e46ff8939f0 req-f1baaf0a-228d-48b2-bf06-ccb43cec5360 service nova] Creating event network-changed:cd8f87a5-9b17-4bf6-9825-06160395f18f for instance e616bb7a-3fab-411e-ab23-25d093c36691 on n-h1-860284-1 Oct 04 22:07:35.006301 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-4609200c-e53f-457e-b501-8e46ff8939f0 req-f1baaf0a-228d-48b2-bf06-ccb43cec5360 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113639 Oct 04 22:07:35.008664 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2391/4719] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:07:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:07:35.397516 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-49efa00b-79b8-4ad5-94fb-eae63488e294 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80fc56886fef422b9b52eb1dede7d10e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82e1a29234ce40f9b37d0eca196cd1db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:07:35.420361 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-49efa00b-79b8-4ad5-94fb-eae63488e294 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] 10.222.0.43 "GET /compute/v2.1/servers/e616bb7a-3fab-411e-ab23-25d093c36691" status: 200 len: 1366 microversion: 2.1 time: 0.669226 Oct 04 22:07:35.420979 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2329/4720] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:07:34 2022] GET /compute/v2.1/servers/e616bb7a-3fab-411e-ab23-25d093c36691 => generated 1366 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:07:36.453855 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-1eeceebf-1102-4e54-bede-2fee72e6088f tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:07:36.455301 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-1eeceebf-1102-4e54-bede-2fee72e6088f tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] [instance: e616bb7a-3fab-411e-ab23-25d093c36691] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:07:36.471726 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1eeceebf-1102-4e54-bede-2fee72e6088f tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:36.473345 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1eeceebf-1102-4e54-bede-2fee72e6088f tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:36.475225 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1eeceebf-1102-4e54-bede-2fee72e6088f tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:36.480767 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1eeceebf-1102-4e54-bede-2fee72e6088f tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:36.484938 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1eeceebf-1102-4e54-bede-2fee72e6088f tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:36.485697 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1eeceebf-1102-4e54-bede-2fee72e6088f tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:36.837264 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-1eeceebf-1102-4e54-bede-2fee72e6088f tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80fc56886fef422b9b52eb1dede7d10e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82e1a29234ce40f9b37d0eca196cd1db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:07:36.848763 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-1eeceebf-1102-4e54-bede-2fee72e6088f tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] 10.222.0.43 "GET /compute/v2.1/servers/e616bb7a-3fab-411e-ab23-25d093c36691" status: 200 len: 1366 microversion: 2.1 time: 0.399924 Oct 04 22:07:36.853741 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2392/4721] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:07:36 2022] GET /compute/v2.1/servers/e616bb7a-3fab-411e-ab23-25d093c36691 => generated 1366 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:07:37.556890 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-2ff138de-a9fb-4144-b668-b6f5c4762176 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:07:37.557495 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-2ff138de-a9fb-4144-b668-b6f5c4762176 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] [instance: 92d3d7e9-8a75-4e07-812c-8b9f441e0376] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:07:37.572464 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=78,nova_api:DELETE=1,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:07:37.573952 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2ff138de-a9fb-4144-b668-b6f5c4762176 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:37.580322 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2ff138de-a9fb-4144-b668-b6f5c4762176 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:37.581273 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2ff138de-a9fb-4144-b668-b6f5c4762176 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:37.582293 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2ff138de-a9fb-4144-b668-b6f5c4762176 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:37.582788 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2ff138de-a9fb-4144-b668-b6f5c4762176 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:37.583222 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2ff138de-a9fb-4144-b668-b6f5c4762176 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:37.686821 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-2ff138de-a9fb-4144-b668-b6f5c4762176 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] [instance: 92d3d7e9-8a75-4e07-812c-8b9f441e0376] Going to try to terminate instance {{(pid=134101) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 22:07:37.883937 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-19f894ad-9ec1-422d-9413-1c718661112e tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:07:37.888891 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-19f894ad-9ec1-422d-9413-1c718661112e tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] [instance: e616bb7a-3fab-411e-ab23-25d093c36691] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:07:37.938186 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-19f894ad-9ec1-422d-9413-1c718661112e tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:37.940608 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-19f894ad-9ec1-422d-9413-1c718661112e tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:37.941355 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-19f894ad-9ec1-422d-9413-1c718661112e tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:37.943971 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-19f894ad-9ec1-422d-9413-1c718661112e tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:37.948131 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-19f894ad-9ec1-422d-9413-1c718661112e tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:37.951279 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-19f894ad-9ec1-422d-9413-1c718661112e tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:38.389963 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-19f894ad-9ec1-422d-9413-1c718661112e tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80fc56886fef422b9b52eb1dede7d10e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82e1a29234ce40f9b37d0eca196cd1db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:07:38.400473 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-19f894ad-9ec1-422d-9413-1c718661112e tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] 10.222.0.43 "GET /compute/v2.1/servers/e616bb7a-3fab-411e-ab23-25d093c36691" status: 200 len: 1366 microversion: 2.1 time: 0.523397 Oct 04 22:07:38.401727 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2393/4722] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:07:37 2022] GET /compute/v2.1/servers/e616bb7a-3fab-411e-ab23-25d093c36691 => generated 1366 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:07:38.510383 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:07:38.615636 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-2ff138de-a9fb-4144-b668-b6f5c4762176 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] 10.222.0.43 "DELETE /compute/v2.1/servers/92d3d7e9-8a75-4e07-812c-8b9f441e0376" status: 204 len: 0 microversion: 2.1 time: 1.062357 Oct 04 22:07:38.624271 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2330/4723] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 22:07:37 2022] DELETE /compute/v2.1/servers/92d3d7e9-8a75-4e07-812c-8b9f441e0376 => generated 0 bytes in 1072 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 22:07:38.636424 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-c4da8ec3-f8cd-4fb3-b662-d20fef6d158b tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:07:38.637192 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-c4da8ec3-f8cd-4fb3-b662-d20fef6d158b tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] [instance: 92d3d7e9-8a75-4e07-812c-8b9f441e0376] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:07:38.648474 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c4da8ec3-f8cd-4fb3-b662-d20fef6d158b tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:38.650953 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c4da8ec3-f8cd-4fb3-b662-d20fef6d158b tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:38.652565 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c4da8ec3-f8cd-4fb3-b662-d20fef6d158b tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:38.653586 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c4da8ec3-f8cd-4fb3-b662-d20fef6d158b tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:38.656654 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c4da8ec3-f8cd-4fb3-b662-d20fef6d158b tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:38.663129 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c4da8ec3-f8cd-4fb3-b662-d20fef6d158b tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:39.044518 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-849d0c07-1714-4513-a923-a3dc261afaa7 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:07:39.044748 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-849d0c07-1714-4513-a923-a3dc261afaa7 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] [instance: 9d592615-a510-440d-9f41-8476fee6f370] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:07:39.054735 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-849d0c07-1714-4513-a923-a3dc261afaa7 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:39.055249 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-849d0c07-1714-4513-a923-a3dc261afaa7 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:39.055699 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-849d0c07-1714-4513-a923-a3dc261afaa7 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:39.056430 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-849d0c07-1714-4513-a923-a3dc261afaa7 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:39.056899 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-849d0c07-1714-4513-a923-a3dc261afaa7 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:39.057349 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-849d0c07-1714-4513-a923-a3dc261afaa7 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:39.159932 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-849d0c07-1714-4513-a923-a3dc261afaa7 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] HTTP exception thrown: Instance 9d592615-a510-440d-9f41-8476fee6f370 could not be found. Oct 04 22:07:39.179591 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-849d0c07-1714-4513-a923-a3dc261afaa7 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Request method failure captured: Oct 04 22:07:39.179591 n-d-860284-1 devstack@n-api.service[134101]: request: DELETE /compute/v2.1/servers/9d592615-a510-440d-9f41-8476fee6f370 HTTP/1.1 Oct 04 22:07:39.179591 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 22:07:39.179591 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 22:07:39.179591 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 22:07:39.179591 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 22:07:39.179591 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 22:07:39.179591 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 22:07:39.179591 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 22:07:39.179591 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 22:07:39.179591 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPK4rVHSJ18_h3nmUTvsmLkrcgyz9VziEUYrv1QHLl0wUgMHspzD_35xS7SrUWqlg61UpMYX9ej0QcvySSs-V_aXPECB8PZsHWnLLZbr8gujVcglgZ1-aIET1G1xYZDLJYg-p6aFIZc8xBttPJ9iKmwMFj4IATa36OmQb4o86GYOSO5s Oct 04 22:07:39.179591 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 22:07:39.179591 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 22:07:39.179591 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 22:07:39.179591 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 22:07:39.179591 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 22:07:39.179591 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 22:07:39.179591 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: a555982bb6f841d7a72b6eca84a6150f Oct 04 22:07:39.179591 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-ServersTestMultiNic-1109058152 Oct 04 22:07:39.179591 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 22:07:39.179591 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 22:07:39.179591 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a555982bb6f841d7a72b6eca84a6150f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_a555982bb6f841d7a72b6eca84a6150f", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a555982bb6f841d7a72b6eca84a6150f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/a555982bb6f841d7a72b6eca84a6150f"}]}] Oct 04 22:07:39.179591 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-ServersTestMultiNic-1109058152 Oct 04 22:07:39.179591 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: a555982bb6f841d7a72b6eca84a6150f Oct 04 22:07:39.179591 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-ServersTestMultiNic-1109058152 Oct 04 22:07:39.179591 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-ServersTestMultiNic-1109058152-project Oct 04 22:07:39.179591 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 22:07:39.179591 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 22:07:39.179591 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 4cd0931292c245578bea8861f9ba7607 Oct 04 22:07:39.179591 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-ServersTestMultiNic-1109058152-project Oct 04 22:07:39.179591 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 22:07:39.179591 n-d-860284-1 devstack@n-api.service[134101]: exception: Instance 9d592615-a510-440d-9f41-8476fee6f370 could not be found. Oct 04 22:07:39.179591 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': '9d592615-a510-440d-9f41-8476fee6f370'} Oct 04 22:07:39.179591 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:07:39.179591 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:07:39.179591 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:07:39.179591 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:07:39.179591 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:07:39.179591 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:07:39.179591 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:07:39.179591 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:07:39.179591 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:07:39.179591 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:07:39.179591 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d592615-a510-440d-9f41-8476fee6f370 could not be found. Oct 04 22:07:39.179591 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:07:39.179591 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:07:39.179591 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:07:39.179591 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:07:39.179591 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:07:39.179591 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:07:39.179591 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:07:39.179591 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:07:39.179591 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:07:39.179591 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:07:39.179591 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 22:07:39.179591 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 22:07:39.179591 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 22:07:39.179591 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 22:07:39.179591 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:07:39.179591 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:07:39.179591 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:07:39.179591 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:07:39.183616 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d592615-a510-440d-9f41-8476fee6f370 could not be found. Oct 04 22:07:39.183616 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:07:39.183616 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:07:39.183616 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:07:39.183616 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:07:39.183616 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:07:39.183616 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:07:39.183616 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:07:39.183616 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:07:39.183616 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d592615-a510-440d-9f41-8476fee6f370 could not be found. Oct 04 22:07:39.183616 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:07:39.183616 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-849d0c07-1714-4513-a923-a3dc261afaa7 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Returning 404 to user: Instance 9d592615-a510-440d-9f41-8476fee6f370 could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:07:39.184773 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-849d0c07-1714-4513-a923-a3dc261afaa7 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] 10.222.0.43 "DELETE /compute/v2.1/servers/9d592615-a510-440d-9f41-8476fee6f370" status: 404 len: 111 microversion: 2.1 time: 0.145026 Oct 04 22:07:39.190772 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2331/4724] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 22:07:39 2022] DELETE /compute/v2.1/servers/9d592615-a510-440d-9f41-8476fee6f370 => generated 111 bytes in 150 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 22:07:39.208826 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-ac6e4018-e73e-47d3-8eeb-1ce996d75c76 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:07:39.209563 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-ac6e4018-e73e-47d3-8eeb-1ce996d75c76 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] [instance: 9d592615-a510-440d-9f41-8476fee6f370] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:07:39.229035 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ac6e4018-e73e-47d3-8eeb-1ce996d75c76 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:39.229542 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ac6e4018-e73e-47d3-8eeb-1ce996d75c76 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:39.236327 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ac6e4018-e73e-47d3-8eeb-1ce996d75c76 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:39.242946 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ac6e4018-e73e-47d3-8eeb-1ce996d75c76 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:39.243646 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ac6e4018-e73e-47d3-8eeb-1ce996d75c76 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:39.252114 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ac6e4018-e73e-47d3-8eeb-1ce996d75c76 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:39.303691 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-ac6e4018-e73e-47d3-8eeb-1ce996d75c76 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] HTTP exception thrown: Instance 9d592615-a510-440d-9f41-8476fee6f370 could not be found. Oct 04 22:07:39.307388 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-ac6e4018-e73e-47d3-8eeb-1ce996d75c76 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Request method failure captured: Oct 04 22:07:39.307388 n-d-860284-1 devstack@n-api.service[134101]: request: GET /compute/v2.1/servers/9d592615-a510-440d-9f41-8476fee6f370 HTTP/1.1 Oct 04 22:07:39.307388 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 22:07:39.307388 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 22:07:39.307388 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 22:07:39.307388 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 22:07:39.307388 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 22:07:39.307388 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 22:07:39.307388 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 22:07:39.307388 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 22:07:39.307388 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPK4rVHSJ18_h3nmUTvsmLkrcgyz9VziEUYrv1QHLl0wUgMHspzD_35xS7SrUWqlg61UpMYX9ej0QcvySSs-V_aXPECB8PZsHWnLLZbr8gujVcglgZ1-aIET1G1xYZDLJYg-p6aFIZc8xBttPJ9iKmwMFj4IATa36OmQb4o86GYOSO5s Oct 04 22:07:39.307388 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 22:07:39.307388 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 22:07:39.307388 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 22:07:39.307388 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 22:07:39.307388 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 22:07:39.307388 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 22:07:39.307388 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: a555982bb6f841d7a72b6eca84a6150f Oct 04 22:07:39.307388 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-ServersTestMultiNic-1109058152 Oct 04 22:07:39.307388 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 22:07:39.307388 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 22:07:39.307388 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a555982bb6f841d7a72b6eca84a6150f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_a555982bb6f841d7a72b6eca84a6150f", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a555982bb6f841d7a72b6eca84a6150f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/a555982bb6f841d7a72b6eca84a6150f"}]}] Oct 04 22:07:39.307388 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-ServersTestMultiNic-1109058152 Oct 04 22:07:39.307388 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: a555982bb6f841d7a72b6eca84a6150f Oct 04 22:07:39.307388 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-ServersTestMultiNic-1109058152 Oct 04 22:07:39.307388 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-ServersTestMultiNic-1109058152-project Oct 04 22:07:39.307388 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 22:07:39.307388 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 22:07:39.307388 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 4cd0931292c245578bea8861f9ba7607 Oct 04 22:07:39.307388 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-ServersTestMultiNic-1109058152-project Oct 04 22:07:39.307388 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 22:07:39.307388 n-d-860284-1 devstack@n-api.service[134101]: exception: Instance 9d592615-a510-440d-9f41-8476fee6f370 could not be found. Oct 04 22:07:39.307388 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': '9d592615-a510-440d-9f41-8476fee6f370'} Oct 04 22:07:39.307388 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:07:39.307388 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:07:39.307388 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:07:39.307388 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:07:39.307388 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:07:39.307388 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:07:39.307388 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:07:39.307388 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:07:39.307388 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:07:39.307388 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:07:39.307388 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d592615-a510-440d-9f41-8476fee6f370 could not be found. Oct 04 22:07:39.307388 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:07:39.307388 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:07:39.307388 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:07:39.307388 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:07:39.307388 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:07:39.307388 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:07:39.307388 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:07:39.307388 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:07:39.307388 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:07:39.307388 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:07:39.307388 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:07:39.307388 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:07:39.307388 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:07:39.307388 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:07:39.307388 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:07:39.307388 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:07:39.307388 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d592615-a510-440d-9f41-8476fee6f370 could not be found. Oct 04 22:07:39.307388 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:07:39.307388 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:07:39.307388 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:07:39.312023 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:07:39.312023 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:07:39.312023 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:07:39.312023 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:07:39.312023 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:07:39.312023 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d592615-a510-440d-9f41-8476fee6f370 could not be found. Oct 04 22:07:39.312023 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:07:39.314643 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-ac6e4018-e73e-47d3-8eeb-1ce996d75c76 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Returning 404 to user: Instance 9d592615-a510-440d-9f41-8476fee6f370 could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:07:39.318263 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-ac6e4018-e73e-47d3-8eeb-1ce996d75c76 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] 10.222.0.43 "GET /compute/v2.1/servers/9d592615-a510-440d-9f41-8476fee6f370" status: 404 len: 111 microversion: 2.1 time: 0.113782 Oct 04 22:07:39.320320 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2332/4725] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:07:39 2022] GET /compute/v2.1/servers/9d592615-a510-440d-9f41-8476fee6f370 => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 22:07:39.339887 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-58da484f-7227-48d1-b9b5-12181c36a4e8 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:07:39.340594 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-58da484f-7227-48d1-b9b5-12181c36a4e8 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] [instance: 09bf867a-5ad2-42cd-bbd5-66e92dc8fff0] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:07:39.358810 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-58da484f-7227-48d1-b9b5-12181c36a4e8 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:39.360862 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-58da484f-7227-48d1-b9b5-12181c36a4e8 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:39.361499 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-58da484f-7227-48d1-b9b5-12181c36a4e8 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:39.365202 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-58da484f-7227-48d1-b9b5-12181c36a4e8 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:39.367392 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-58da484f-7227-48d1-b9b5-12181c36a4e8 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:39.368600 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-58da484f-7227-48d1-b9b5-12181c36a4e8 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:39.412003 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-58da484f-7227-48d1-b9b5-12181c36a4e8 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] HTTP exception thrown: Instance 09bf867a-5ad2-42cd-bbd5-66e92dc8fff0 could not be found. Oct 04 22:07:39.440393 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-58da484f-7227-48d1-b9b5-12181c36a4e8 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Request method failure captured: Oct 04 22:07:39.440393 n-d-860284-1 devstack@n-api.service[134101]: request: DELETE /compute/v2.1/servers/09bf867a-5ad2-42cd-bbd5-66e92dc8fff0 HTTP/1.1 Oct 04 22:07:39.440393 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 22:07:39.440393 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 22:07:39.440393 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 22:07:39.440393 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 22:07:39.440393 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 22:07:39.440393 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 22:07:39.440393 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 22:07:39.440393 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 22:07:39.440393 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPK4rVHSJ18_h3nmUTvsmLkrcgyz9VziEUYrv1QHLl0wUgMHspzD_35xS7SrUWqlg61UpMYX9ej0QcvySSs-V_aXPECB8PZsHWnLLZbr8gujVcglgZ1-aIET1G1xYZDLJYg-p6aFIZc8xBttPJ9iKmwMFj4IATa36OmQb4o86GYOSO5s Oct 04 22:07:39.440393 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 22:07:39.440393 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 22:07:39.440393 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 22:07:39.440393 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 22:07:39.440393 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 22:07:39.440393 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 22:07:39.440393 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: a555982bb6f841d7a72b6eca84a6150f Oct 04 22:07:39.440393 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-ServersTestMultiNic-1109058152 Oct 04 22:07:39.440393 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 22:07:39.440393 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 22:07:39.440393 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a555982bb6f841d7a72b6eca84a6150f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_a555982bb6f841d7a72b6eca84a6150f", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a555982bb6f841d7a72b6eca84a6150f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/a555982bb6f841d7a72b6eca84a6150f"}]}] Oct 04 22:07:39.440393 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-ServersTestMultiNic-1109058152 Oct 04 22:07:39.440393 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: a555982bb6f841d7a72b6eca84a6150f Oct 04 22:07:39.440393 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-ServersTestMultiNic-1109058152 Oct 04 22:07:39.440393 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-ServersTestMultiNic-1109058152-project Oct 04 22:07:39.440393 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 22:07:39.440393 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 22:07:39.440393 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 4cd0931292c245578bea8861f9ba7607 Oct 04 22:07:39.440393 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-ServersTestMultiNic-1109058152-project Oct 04 22:07:39.440393 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 22:07:39.440393 n-d-860284-1 devstack@n-api.service[134101]: exception: Instance 09bf867a-5ad2-42cd-bbd5-66e92dc8fff0 could not be found. Oct 04 22:07:39.440393 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': '09bf867a-5ad2-42cd-bbd5-66e92dc8fff0'} Oct 04 22:07:39.440393 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:07:39.440393 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:07:39.440393 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:07:39.440393 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:07:39.440393 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:07:39.440393 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:07:39.440393 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:07:39.440393 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:07:39.440393 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:07:39.440393 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:07:39.440393 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 09bf867a-5ad2-42cd-bbd5-66e92dc8fff0 could not be found. Oct 04 22:07:39.440393 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:07:39.440393 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:07:39.440393 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:07:39.440393 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:07:39.440393 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:07:39.440393 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:07:39.440393 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:07:39.440393 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:07:39.440393 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:07:39.440393 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:07:39.440393 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 22:07:39.440393 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 22:07:39.440393 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 22:07:39.440393 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 22:07:39.440393 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:07:39.440393 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:07:39.440393 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:07:39.440393 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:07:39.444944 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 09bf867a-5ad2-42cd-bbd5-66e92dc8fff0 could not be found. Oct 04 22:07:39.444944 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:07:39.444944 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:07:39.444944 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:07:39.444944 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:07:39.444944 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:07:39.444944 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:07:39.444944 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:07:39.444944 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:07:39.444944 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 09bf867a-5ad2-42cd-bbd5-66e92dc8fff0 could not be found. Oct 04 22:07:39.444944 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:07:39.450953 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-58da484f-7227-48d1-b9b5-12181c36a4e8 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Returning 404 to user: Instance 09bf867a-5ad2-42cd-bbd5-66e92dc8fff0 could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:07:39.454842 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-58da484f-7227-48d1-b9b5-12181c36a4e8 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] 10.222.0.43 "DELETE /compute/v2.1/servers/09bf867a-5ad2-42cd-bbd5-66e92dc8fff0" status: 404 len: 111 microversion: 2.1 time: 0.128561 Oct 04 22:07:39.459642 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2333/4726] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 22:07:39 2022] DELETE /compute/v2.1/servers/09bf867a-5ad2-42cd-bbd5-66e92dc8fff0 => generated 111 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:07:39.838625 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-c4da8ec3-f8cd-4fb3-b662-d20fef6d158b tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e72a1a5d1a4c4b838acb169ab11eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b556e1ace286450f8493715e8317a107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:07:39.841050 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:07:39.856087 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e935e8cb-2d66-4470-9fc3-22630dd84634 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:07:39.856996 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-e935e8cb-2d66-4470-9fc3-22630dd84634 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] [instance: e616bb7a-3fab-411e-ab23-25d093c36691] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:07:39.858858 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-c4da8ec3-f8cd-4fb3-b662-d20fef6d158b tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] 10.222.0.43 "GET /compute/v2.1/servers/92d3d7e9-8a75-4e07-812c-8b9f441e0376" status: 200 len: 1514 microversion: 2.1 time: 1.227781 Oct 04 22:07:39.860221 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2394/4727] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:07:38 2022] GET /compute/v2.1/servers/92d3d7e9-8a75-4e07-812c-8b9f441e0376 => generated 1514 bytes in 1230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:07:39.866439 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-859b2dff-2056-481b-bfc5-de1a4d3cbea0 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:07:39.867038 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-859b2dff-2056-481b-bfc5-de1a4d3cbea0 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] [instance: 09bf867a-5ad2-42cd-bbd5-66e92dc8fff0] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:07:39.875335 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-859b2dff-2056-481b-bfc5-de1a4d3cbea0 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:39.876115 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-859b2dff-2056-481b-bfc5-de1a4d3cbea0 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:39.876751 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-859b2dff-2056-481b-bfc5-de1a4d3cbea0 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:39.877533 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-859b2dff-2056-481b-bfc5-de1a4d3cbea0 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:39.878072 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-859b2dff-2056-481b-bfc5-de1a4d3cbea0 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:39.878638 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-859b2dff-2056-481b-bfc5-de1a4d3cbea0 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:39.882551 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e935e8cb-2d66-4470-9fc3-22630dd84634 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:39.883393 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e935e8cb-2d66-4470-9fc3-22630dd84634 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:39.884565 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e935e8cb-2d66-4470-9fc3-22630dd84634 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:39.886146 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e935e8cb-2d66-4470-9fc3-22630dd84634 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:39.886998 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e935e8cb-2d66-4470-9fc3-22630dd84634 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:39.887871 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e935e8cb-2d66-4470-9fc3-22630dd84634 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:39.909949 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-859b2dff-2056-481b-bfc5-de1a4d3cbea0 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] HTTP exception thrown: Instance 09bf867a-5ad2-42cd-bbd5-66e92dc8fff0 could not be found. Oct 04 22:07:39.923148 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-859b2dff-2056-481b-bfc5-de1a4d3cbea0 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Request method failure captured: Oct 04 22:07:39.923148 n-d-860284-1 devstack@n-api.service[134102]: request: GET /compute/v2.1/servers/09bf867a-5ad2-42cd-bbd5-66e92dc8fff0 HTTP/1.1 Oct 04 22:07:39.923148 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 22:07:39.923148 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 22:07:39.923148 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 22:07:39.923148 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 22:07:39.923148 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 22:07:39.923148 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 22:07:39.923148 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 22:07:39.923148 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 22:07:39.923148 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPK4rVHSJ18_h3nmUTvsmLkrcgyz9VziEUYrv1QHLl0wUgMHspzD_35xS7SrUWqlg61UpMYX9ej0QcvySSs-V_aXPECB8PZsHWnLLZbr8gujVcglgZ1-aIET1G1xYZDLJYg-p6aFIZc8xBttPJ9iKmwMFj4IATa36OmQb4o86GYOSO5s Oct 04 22:07:39.923148 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 22:07:39.923148 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 22:07:39.923148 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 22:07:39.923148 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 22:07:39.923148 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 22:07:39.923148 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 22:07:39.923148 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: a555982bb6f841d7a72b6eca84a6150f Oct 04 22:07:39.923148 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-ServersTestMultiNic-1109058152 Oct 04 22:07:39.923148 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 22:07:39.923148 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 22:07:39.923148 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a555982bb6f841d7a72b6eca84a6150f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_a555982bb6f841d7a72b6eca84a6150f", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a555982bb6f841d7a72b6eca84a6150f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/a555982bb6f841d7a72b6eca84a6150f"}]}] Oct 04 22:07:39.923148 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-ServersTestMultiNic-1109058152 Oct 04 22:07:39.923148 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: a555982bb6f841d7a72b6eca84a6150f Oct 04 22:07:39.923148 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-ServersTestMultiNic-1109058152 Oct 04 22:07:39.923148 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-ServersTestMultiNic-1109058152-project Oct 04 22:07:39.923148 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 22:07:39.923148 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 22:07:39.923148 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: 4cd0931292c245578bea8861f9ba7607 Oct 04 22:07:39.923148 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-ServersTestMultiNic-1109058152-project Oct 04 22:07:39.923148 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 22:07:39.923148 n-d-860284-1 devstack@n-api.service[134102]: exception: Instance 09bf867a-5ad2-42cd-bbd5-66e92dc8fff0 could not be found. Oct 04 22:07:39.923148 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': '09bf867a-5ad2-42cd-bbd5-66e92dc8fff0'} Oct 04 22:07:39.923148 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:07:39.923148 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:07:39.923148 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:07:39.923148 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:07:39.923148 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:07:39.923148 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:07:39.923148 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:07:39.923148 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:07:39.923148 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:07:39.923148 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:07:39.923148 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 09bf867a-5ad2-42cd-bbd5-66e92dc8fff0 could not be found. Oct 04 22:07:39.923148 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:07:39.923148 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:07:39.923148 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:07:39.923148 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:07:39.923148 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:07:39.923148 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:07:39.923148 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:07:39.923148 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:07:39.923148 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:07:39.923148 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:07:39.923148 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:07:39.923148 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:07:39.923148 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:07:39.923148 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:07:39.923148 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:07:39.923148 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:07:39.923148 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 09bf867a-5ad2-42cd-bbd5-66e92dc8fff0 could not be found. Oct 04 22:07:39.923148 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:07:39.923148 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:07:39.923148 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:07:39.929248 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:07:39.929248 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:07:39.929248 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:07:39.929248 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:07:39.929248 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:07:39.929248 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 09bf867a-5ad2-42cd-bbd5-66e92dc8fff0 could not be found. Oct 04 22:07:39.929248 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:07:39.929248 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-859b2dff-2056-481b-bfc5-de1a4d3cbea0 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] Returning 404 to user: Instance 09bf867a-5ad2-42cd-bbd5-66e92dc8fff0 could not be found. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:07:39.929248 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-859b2dff-2056-481b-bfc5-de1a4d3cbea0 tempest-ServersTestMultiNic-1109058152 tempest-ServersTestMultiNic-1109058152-project] 10.222.0.43 "GET /compute/v2.1/servers/09bf867a-5ad2-42cd-bbd5-66e92dc8fff0" status: 404 len: 111 microversion: 2.1 time: 0.063338 Oct 04 22:07:39.929248 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2395/4728] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:07:39 2022] GET /compute/v2.1/servers/09bf867a-5ad2-42cd-bbd5-66e92dc8fff0 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:07:40.792216 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-e935e8cb-2d66-4470-9fc3-22630dd84634 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80fc56886fef422b9b52eb1dede7d10e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82e1a29234ce40f9b37d0eca196cd1db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:07:40.813399 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-e935e8cb-2d66-4470-9fc3-22630dd84634 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] 10.222.0.43 "GET /compute/v2.1/servers/e616bb7a-3fab-411e-ab23-25d093c36691" status: 200 len: 1366 microversion: 2.1 time: 1.342021 Oct 04 22:07:40.827047 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2334/4729] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:07:39 2022] GET /compute/v2.1/servers/e616bb7a-3fab-411e-ab23-25d093c36691 => generated 1366 bytes in 1366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:07:40.884874 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-7cc5a2f6-c9df-44df-b00d-afb053246948 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:07:40.885493 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-7cc5a2f6-c9df-44df-b00d-afb053246948 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] [instance: 92d3d7e9-8a75-4e07-812c-8b9f441e0376] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:07:40.897971 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7cc5a2f6-c9df-44df-b00d-afb053246948 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:40.898792 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7cc5a2f6-c9df-44df-b00d-afb053246948 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:40.899592 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7cc5a2f6-c9df-44df-b00d-afb053246948 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:40.906415 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7cc5a2f6-c9df-44df-b00d-afb053246948 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:40.907485 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7cc5a2f6-c9df-44df-b00d-afb053246948 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:40.908085 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7cc5a2f6-c9df-44df-b00d-afb053246948 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:41.675989 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-7cc5a2f6-c9df-44df-b00d-afb053246948 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e72a1a5d1a4c4b838acb169ab11eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b556e1ace286450f8493715e8317a107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:07:41.684928 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-7cc5a2f6-c9df-44df-b00d-afb053246948 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] 10.222.0.43 "GET /compute/v2.1/servers/92d3d7e9-8a75-4e07-812c-8b9f441e0376" status: 200 len: 1514 microversion: 2.1 time: 0.804213 Oct 04 22:07:41.696234 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2396/4730] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:07:40 2022] GET /compute/v2.1/servers/92d3d7e9-8a75-4e07-812c-8b9f441e0376 => generated 1514 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:07:41.838171 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-3fd07c4f-4cdc-4959-b144-067f52b97855 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:07:41.839128 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-3fd07c4f-4cdc-4959-b144-067f52b97855 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] [instance: e616bb7a-3fab-411e-ab23-25d093c36691] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:07:41.857067 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3fd07c4f-4cdc-4959-b144-067f52b97855 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:41.857580 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3fd07c4f-4cdc-4959-b144-067f52b97855 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:41.858030 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3fd07c4f-4cdc-4959-b144-067f52b97855 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:41.871359 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3fd07c4f-4cdc-4959-b144-067f52b97855 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:41.874793 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3fd07c4f-4cdc-4959-b144-067f52b97855 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:41.875321 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3fd07c4f-4cdc-4959-b144-067f52b97855 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:42.724727 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-ce9d7907-9faa-4255-b6f4-b603a79af8c1 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:07:42.726326 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-ce9d7907-9faa-4255-b6f4-b603a79af8c1 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] [instance: 92d3d7e9-8a75-4e07-812c-8b9f441e0376] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:07:42.738417 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_api:SELECT=52 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:07:42.769051 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ce9d7907-9faa-4255-b6f4-b603a79af8c1 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:42.781144 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ce9d7907-9faa-4255-b6f4-b603a79af8c1 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:42.782894 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ce9d7907-9faa-4255-b6f4-b603a79af8c1 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:42.787875 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ce9d7907-9faa-4255-b6f4-b603a79af8c1 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:42.792954 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ce9d7907-9faa-4255-b6f4-b603a79af8c1 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:42.795393 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ce9d7907-9faa-4255-b6f4-b603a79af8c1 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:43.252980 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-3fd07c4f-4cdc-4959-b144-067f52b97855 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80fc56886fef422b9b52eb1dede7d10e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82e1a29234ce40f9b37d0eca196cd1db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:07:43.264822 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-3fd07c4f-4cdc-4959-b144-067f52b97855 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] 10.222.0.43 "GET /compute/v2.1/servers/e616bb7a-3fab-411e-ab23-25d093c36691" status: 200 len: 1366 microversion: 2.1 time: 1.430744 Oct 04 22:07:43.268259 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2335/4731] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:07:41 2022] GET /compute/v2.1/servers/e616bb7a-3fab-411e-ab23-25d093c36691 => generated 1366 bytes in 1435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:07:43.670402 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-e4d1e726-5785-437e-becc-5e4bdc5f4d91 req-7e5c4535-aff3-4774-8309-e8daec7d3962 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e616bb7a-3fab-411e-ab23-25d093c36691", "name": "network-vif-plugged", "status": "completed", "tag": "cd8f87a5-9b17-4bf6-9825-06160395f18f"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:07:43.683863 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-e4d1e726-5785-437e-becc-5e4bdc5f4d91 req-7e5c4535-aff3-4774-8309-e8daec7d3962 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:43.684812 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-e4d1e726-5785-437e-becc-5e4bdc5f4d91 req-7e5c4535-aff3-4774-8309-e8daec7d3962 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:43.685421 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-e4d1e726-5785-437e-becc-5e4bdc5f4d91 req-7e5c4535-aff3-4774-8309-e8daec7d3962 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:43.704366 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-e4d1e726-5785-437e-becc-5e4bdc5f4d91 req-7e5c4535-aff3-4774-8309-e8daec7d3962 service nova] Creating event network-vif-plugged:cd8f87a5-9b17-4bf6-9825-06160395f18f for instance e616bb7a-3fab-411e-ab23-25d093c36691 on n-h1-860284-1 Oct 04 22:07:43.713816 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-e4d1e726-5785-437e-becc-5e4bdc5f4d91 req-7e5c4535-aff3-4774-8309-e8daec7d3962 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050066 Oct 04 22:07:43.715122 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2336/4732] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:07:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:07:43.814783 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-ce9d7907-9faa-4255-b6f4-b603a79af8c1 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e72a1a5d1a4c4b838acb169ab11eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b556e1ace286450f8493715e8317a107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:07:43.836421 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-ce9d7907-9faa-4255-b6f4-b603a79af8c1 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] 10.222.0.43 "GET /compute/v2.1/servers/92d3d7e9-8a75-4e07-812c-8b9f441e0376" status: 200 len: 1514 microversion: 2.1 time: 1.111556 Oct 04 22:07:43.841100 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2397/4733] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:07:42 2022] GET /compute/v2.1/servers/92d3d7e9-8a75-4e07-812c-8b9f441e0376 => generated 1514 bytes in 1123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:07:44.329467 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-48c1eb8b-1e5b-4e78-8ba5-84d30e47bfe5 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:07:44.334309 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-48c1eb8b-1e5b-4e78-8ba5-84d30e47bfe5 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] [instance: e616bb7a-3fab-411e-ab23-25d093c36691] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:07:44.352200 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-48c1eb8b-1e5b-4e78-8ba5-84d30e47bfe5 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:44.354549 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-48c1eb8b-1e5b-4e78-8ba5-84d30e47bfe5 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:44.360326 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-48c1eb8b-1e5b-4e78-8ba5-84d30e47bfe5 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:44.362260 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-48c1eb8b-1e5b-4e78-8ba5-84d30e47bfe5 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:44.363774 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-48c1eb8b-1e5b-4e78-8ba5-84d30e47bfe5 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:44.365509 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-48c1eb8b-1e5b-4e78-8ba5-84d30e47bfe5 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:44.863054 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-a0378dad-9882-4fec-8cc1-c84b8d5aff0b tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:07:44.864428 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-a0378dad-9882-4fec-8cc1-c84b8d5aff0b tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] [instance: 92d3d7e9-8a75-4e07-812c-8b9f441e0376] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:07:44.883298 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a0378dad-9882-4fec-8cc1-c84b8d5aff0b tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:44.888296 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a0378dad-9882-4fec-8cc1-c84b8d5aff0b tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:44.890928 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a0378dad-9882-4fec-8cc1-c84b8d5aff0b tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:44.891717 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a0378dad-9882-4fec-8cc1-c84b8d5aff0b tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:44.897158 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a0378dad-9882-4fec-8cc1-c84b8d5aff0b tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:44.900645 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a0378dad-9882-4fec-8cc1-c84b8d5aff0b tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:45.094279 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-a0378dad-9882-4fec-8cc1-c84b8d5aff0b tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e72a1a5d1a4c4b838acb169ab11eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b556e1ace286450f8493715e8317a107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:07:45.134655 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-a0378dad-9882-4fec-8cc1-c84b8d5aff0b tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] 10.222.0.43 "GET /compute/v2.1/servers/92d3d7e9-8a75-4e07-812c-8b9f441e0376" status: 200 len: 1472 microversion: 2.1 time: 0.272951 Oct 04 22:07:45.162948 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2398/4734] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:07:44 2022] GET /compute/v2.1/servers/92d3d7e9-8a75-4e07-812c-8b9f441e0376 => generated 1472 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:07:45.178976 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-48c1eb8b-1e5b-4e78-8ba5-84d30e47bfe5 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80fc56886fef422b9b52eb1dede7d10e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82e1a29234ce40f9b37d0eca196cd1db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:07:45.190680 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-3e75a73a-f39d-4493-91b0-2eeae1a8e053 req-287fdd46-9054-4638-9aa2-c913d9ded6e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92d3d7e9-8a75-4e07-812c-8b9f441e0376", "name": "network-vif-deleted", "tag": "50b70cb5-82ab-438c-8d09-f11e74153646"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:07:45.197535 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-48c1eb8b-1e5b-4e78-8ba5-84d30e47bfe5 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] 10.222.0.43 "GET /compute/v2.1/servers/e616bb7a-3fab-411e-ab23-25d093c36691" status: 200 len: 1366 microversion: 2.1 time: 0.906584 Oct 04 22:07:45.198147 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2337/4735] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:07:44 2022] GET /compute/v2.1/servers/e616bb7a-3fab-411e-ab23-25d093c36691 => generated 1366 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:07:45.239849 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-3e75a73a-f39d-4493-91b0-2eeae1a8e053 req-287fdd46-9054-4638-9aa2-c913d9ded6e0 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:45.240258 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-3e75a73a-f39d-4493-91b0-2eeae1a8e053 req-287fdd46-9054-4638-9aa2-c913d9ded6e0 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:45.240698 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-3e75a73a-f39d-4493-91b0-2eeae1a8e053 req-287fdd46-9054-4638-9aa2-c913d9ded6e0 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:45.324454 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-3e75a73a-f39d-4493-91b0-2eeae1a8e053 req-287fdd46-9054-4638-9aa2-c913d9ded6e0 service nova] Creating event network-vif-deleted:50b70cb5-82ab-438c-8d09-f11e74153646 for instance 92d3d7e9-8a75-4e07-812c-8b9f441e0376 on n-h1-860284-1 Oct 04 22:07:45.345183 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-3e75a73a-f39d-4493-91b0-2eeae1a8e053 req-287fdd46-9054-4638-9aa2-c913d9ded6e0 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.180545 Oct 04 22:07:45.357382 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2399/4736] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:07:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:07:46.168828 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-8cd65e7d-512e-49c2-8182-23c69033d4db tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:07:46.170418 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-8cd65e7d-512e-49c2-8182-23c69033d4db tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] [instance: 92d3d7e9-8a75-4e07-812c-8b9f441e0376] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:07:46.186707 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8cd65e7d-512e-49c2-8182-23c69033d4db tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:46.188084 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8cd65e7d-512e-49c2-8182-23c69033d4db tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:46.188782 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8cd65e7d-512e-49c2-8182-23c69033d4db tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:46.189854 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8cd65e7d-512e-49c2-8182-23c69033d4db tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:46.191393 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8cd65e7d-512e-49c2-8182-23c69033d4db tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:46.192315 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8cd65e7d-512e-49c2-8182-23c69033d4db tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:46.230996 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-9d70a993-214a-48f2-8d13-828295a704bb tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:07:46.234256 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-9d70a993-214a-48f2-8d13-828295a704bb tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] [instance: e616bb7a-3fab-411e-ab23-25d093c36691] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:07:46.264145 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9d70a993-214a-48f2-8d13-828295a704bb tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:46.266048 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9d70a993-214a-48f2-8d13-828295a704bb tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:46.267155 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9d70a993-214a-48f2-8d13-828295a704bb tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:46.268535 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9d70a993-214a-48f2-8d13-828295a704bb tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:46.269423 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9d70a993-214a-48f2-8d13-828295a704bb tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:46.270213 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9d70a993-214a-48f2-8d13-828295a704bb tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:46.307104 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8cd65e7d-512e-49c2-8182-23c69033d4db tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:46.307745 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8cd65e7d-512e-49c2-8182-23c69033d4db tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:46.308273 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8cd65e7d-512e-49c2-8182-23c69033d4db tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:46.308822 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.objects.instance [None req-8cd65e7d-512e-49c2-8182-23c69033d4db tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lazy-loading 'fault' on Instance uuid 92d3d7e9-8a75-4e07-812c-8b9f441e0376 {{(pid=134101) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 22:07:46.814050 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-8cd65e7d-512e-49c2-8182-23c69033d4db tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e72a1a5d1a4c4b838acb169ab11eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b556e1ace286450f8493715e8317a107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:07:46.829060 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-8cd65e7d-512e-49c2-8182-23c69033d4db tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] 10.222.0.43 "GET /compute/v2.1/servers/92d3d7e9-8a75-4e07-812c-8b9f441e0376" status: 200 len: 1309 microversion: 2.1 time: 0.670072 Oct 04 22:07:46.829696 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2338/4737] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:07:46 2022] GET /compute/v2.1/servers/92d3d7e9-8a75-4e07-812c-8b9f441e0376 => generated 1309 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:07:47.312932 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-9d70a993-214a-48f2-8d13-828295a704bb tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80fc56886fef422b9b52eb1dede7d10e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82e1a29234ce40f9b37d0eca196cd1db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:07:47.324061 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-9d70a993-214a-48f2-8d13-828295a704bb tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] 10.222.0.43 "GET /compute/v2.1/servers/e616bb7a-3fab-411e-ab23-25d093c36691" status: 200 len: 1556 microversion: 2.1 time: 1.102745 Oct 04 22:07:47.352095 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2400/4738] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:07:46 2022] GET /compute/v2.1/servers/e616bb7a-3fab-411e-ab23-25d093c36691 => generated 1556 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:07:47.354587 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-26d09683-aea4-4cc0-b53f-c2cd9bc33423 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:07:47.355236 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-26d09683-aea4-4cc0-b53f-c2cd9bc33423 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] [instance: e616bb7a-3fab-411e-ab23-25d093c36691] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:07:47.370288 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-26d09683-aea4-4cc0-b53f-c2cd9bc33423 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:47.378171 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-26d09683-aea4-4cc0-b53f-c2cd9bc33423 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:47.384703 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-26d09683-aea4-4cc0-b53f-c2cd9bc33423 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:47.386292 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-26d09683-aea4-4cc0-b53f-c2cd9bc33423 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:47.388569 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-26d09683-aea4-4cc0-b53f-c2cd9bc33423 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:47.391960 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-26d09683-aea4-4cc0-b53f-c2cd9bc33423 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:47.712853 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-26d09683-aea4-4cc0-b53f-c2cd9bc33423 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] 10.222.0.43 "GET /compute/v2.1/servers/e616bb7a-3fab-411e-ab23-25d093c36691/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.362491 Oct 04 22:07:47.713689 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2339/4739] 10.222.0.43 () {58 vars in 1275 bytes} [Tue Oct 4 22:07:47 2022] GET /compute/v2.1/servers/e616bb7a-3fab-411e-ab23-25d093c36691/os-interface => generated 284 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:07:47.853582 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-48480c4c-a9e6-42ba-ad03-bac5cf3080ba tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:07:47.854294 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-48480c4c-a9e6-42ba-ad03-bac5cf3080ba tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] [instance: 92d3d7e9-8a75-4e07-812c-8b9f441e0376] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:07:47.872785 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-48480c4c-a9e6-42ba-ad03-bac5cf3080ba tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:47.873311 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-48480c4c-a9e6-42ba-ad03-bac5cf3080ba tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:47.873768 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-48480c4c-a9e6-42ba-ad03-bac5cf3080ba tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:47.874537 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-48480c4c-a9e6-42ba-ad03-bac5cf3080ba tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:47.875008 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-48480c4c-a9e6-42ba-ad03-bac5cf3080ba tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:47.884030 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-48480c4c-a9e6-42ba-ad03-bac5cf3080ba tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:47.935218 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-48480c4c-a9e6-42ba-ad03-bac5cf3080ba tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] HTTP exception thrown: Instance 92d3d7e9-8a75-4e07-812c-8b9f441e0376 could not be found. Oct 04 22:07:47.947617 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-48480c4c-a9e6-42ba-ad03-bac5cf3080ba tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Request method failure captured: Oct 04 22:07:47.947617 n-d-860284-1 devstack@n-api.service[134102]: request: GET /compute/v2.1/servers/92d3d7e9-8a75-4e07-812c-8b9f441e0376 HTTP/1.1 Oct 04 22:07:47.947617 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 22:07:47.947617 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 22:07:47.947617 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 22:07:47.947617 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 22:07:47.947617 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 22:07:47.947617 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 22:07:47.947617 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 22:07:47.947617 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 22:07:47.947617 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPK3XGe_9LTr-F_4Y4GbB6F0pBU01uOiJadU_J2G8O_7racYQ8_uSwc7v8esFcLz6ue_rfHMTfhl2KQ9M-XfVnqLTCpNy2uCsSxHxRtuIDMQYscL2d2DZOvObj9x5X0aN0Don0dK6uXVOXET6R9th4WmxqtGXBgmrceaqExHsF6ZLBQA Oct 04 22:07:47.947617 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 22:07:47.947617 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 22:07:47.947617 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 22:07:47.947617 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 22:07:47.947617 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 22:07:47.947617 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 22:07:47.947617 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: b556e1ace286450f8493715e8317a107 Oct 04 22:07:47.947617 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1498882996 Oct 04 22:07:47.947617 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 22:07:47.947617 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 22:07:47.947617 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b556e1ace286450f8493715e8317a107"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_b556e1ace286450f8493715e8317a107", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b556e1ace286450f8493715e8317a107"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/b556e1ace286450f8493715e8317a107"}]}] Oct 04 22:07:47.947617 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-VolumesSnapshotTestJSON-1498882996 Oct 04 22:07:47.947617 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: b556e1ace286450f8493715e8317a107 Oct 04 22:07:47.947617 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1498882996 Oct 04 22:07:47.947617 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-VolumesSnapshotTestJSON-1498882996-project Oct 04 22:07:47.947617 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 22:07:47.947617 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 22:07:47.947617 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: 09e72a1a5d1a4c4b838acb169ab11eb0 Oct 04 22:07:47.947617 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-VolumesSnapshotTestJSON-1498882996-project Oct 04 22:07:47.947617 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 22:07:47.947617 n-d-860284-1 devstack@n-api.service[134102]: exception: Instance 92d3d7e9-8a75-4e07-812c-8b9f441e0376 could not be found. Oct 04 22:07:47.947617 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': '92d3d7e9-8a75-4e07-812c-8b9f441e0376'} Oct 04 22:07:47.947617 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:07:47.947617 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:07:47.947617 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:07:47.947617 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:07:47.947617 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:07:47.947617 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:07:47.947617 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:07:47.947617 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:07:47.947617 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:07:47.947617 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:07:47.947617 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92d3d7e9-8a75-4e07-812c-8b9f441e0376 could not be found. Oct 04 22:07:47.947617 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:07:47.947617 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:07:47.947617 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:07:47.947617 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:07:47.947617 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:07:47.947617 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:07:47.947617 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:07:47.947617 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:07:47.947617 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:07:47.947617 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:07:47.947617 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:07:47.947617 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:07:47.947617 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:07:47.947617 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:07:47.947617 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:07:47.947617 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:07:47.947617 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92d3d7e9-8a75-4e07-812c-8b9f441e0376 could not be found. Oct 04 22:07:47.947617 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:07:47.947617 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:07:47.947617 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:07:47.952290 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:07:47.952290 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:07:47.952290 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:07:47.952290 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:07:47.952290 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:07:47.952290 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92d3d7e9-8a75-4e07-812c-8b9f441e0376 could not be found. Oct 04 22:07:47.952290 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:07:47.958584 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-48480c4c-a9e6-42ba-ad03-bac5cf3080ba tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Returning 404 to user: Instance 92d3d7e9-8a75-4e07-812c-8b9f441e0376 could not be found. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:07:47.962137 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-48480c4c-a9e6-42ba-ad03-bac5cf3080ba tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] 10.222.0.43 "GET /compute/v2.1/servers/92d3d7e9-8a75-4e07-812c-8b9f441e0376" status: 404 len: 111 microversion: 2.1 time: 0.111183 Oct 04 22:07:47.964909 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2401/4740] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:07:47 2022] GET /compute/v2.1/servers/92d3d7e9-8a75-4e07-812c-8b9f441e0376 => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:07:49.989704 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-b8c89069-e1bc-4177-b76e-2d1be87347b5 req-e5e77f87-8569-4e1c-8cfb-241c2de346bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e616bb7a-3fab-411e-ab23-25d093c36691", "tag": "cd8f87a5-9b17-4bf6-9825-06160395f18f"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:07:50.035625 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-b8c89069-e1bc-4177-b76e-2d1be87347b5 req-e5e77f87-8569-4e1c-8cfb-241c2de346bf service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:50.042186 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-b8c89069-e1bc-4177-b76e-2d1be87347b5 req-e5e77f87-8569-4e1c-8cfb-241c2de346bf service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:50.044902 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-b8c89069-e1bc-4177-b76e-2d1be87347b5 req-e5e77f87-8569-4e1c-8cfb-241c2de346bf service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:50.096385 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-b8c89069-e1bc-4177-b76e-2d1be87347b5 req-e5e77f87-8569-4e1c-8cfb-241c2de346bf service nova] Creating event network-changed:cd8f87a5-9b17-4bf6-9825-06160395f18f for instance e616bb7a-3fab-411e-ab23-25d093c36691 on n-h1-860284-1 Oct 04 22:07:50.108244 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-b8c89069-e1bc-4177-b76e-2d1be87347b5 req-e5e77f87-8569-4e1c-8cfb-241c2de346bf service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128942 Oct 04 22:07:50.112860 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2340/4741] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:07:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:07:59.526954 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-7bc55b48-d28d-4233-ad4f-e33e1fb3bd71 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:07:59.528173 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-7bc55b48-d28d-4233-ad4f-e33e1fb3bd71 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 48243e1b-892b-4c4b-8db1-242b2e40653b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:07:59.538782 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_api:SELECT=9 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:07:59.539485 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=31 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:07:59.543773 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7bc55b48-d28d-4233-ad4f-e33e1fb3bd71 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:59.546802 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7bc55b48-d28d-4233-ad4f-e33e1fb3bd71 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:59.547621 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7bc55b48-d28d-4233-ad4f-e33e1fb3bd71 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:59.550218 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7bc55b48-d28d-4233-ad4f-e33e1fb3bd71 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:59.551711 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7bc55b48-d28d-4233-ad4f-e33e1fb3bd71 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:59.554555 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7bc55b48-d28d-4233-ad4f-e33e1fb3bd71 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:59.829177 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-7bc55b48-d28d-4233-ad4f-e33e1fb3bd71 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:07:59.848455 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-7bc55b48-d28d-4233-ad4f-e33e1fb3bd71 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b" status: 200 len: 1682 microversion: 2.1 time: 0.322055 Oct 04 22:07:59.868716 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2402/4742] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:07:59 2022] GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b => generated 1682 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:08:00.890782 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-cc20c55d-78cc-4ee9-a43d-5ca9730ed9b2 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:08:00.891512 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-cc20c55d-78cc-4ee9-a43d-5ca9730ed9b2 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 48243e1b-892b-4c4b-8db1-242b2e40653b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:08:00.897361 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:08:00.904822 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=40 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:08:00.925298 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cc20c55d-78cc-4ee9-a43d-5ca9730ed9b2 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:00.926195 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cc20c55d-78cc-4ee9-a43d-5ca9730ed9b2 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:00.926942 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cc20c55d-78cc-4ee9-a43d-5ca9730ed9b2 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:00.927883 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cc20c55d-78cc-4ee9-a43d-5ca9730ed9b2 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:00.929307 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cc20c55d-78cc-4ee9-a43d-5ca9730ed9b2 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:00.929971 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cc20c55d-78cc-4ee9-a43d-5ca9730ed9b2 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:01.354631 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-cc20c55d-78cc-4ee9-a43d-5ca9730ed9b2 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:08:01.363747 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-cc20c55d-78cc-4ee9-a43d-5ca9730ed9b2 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b" status: 200 len: 1669 microversion: 2.1 time: 0.493876 Oct 04 22:08:01.367515 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-96427d6a-5f47-4708-a8d3-d991e8d3558b tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-441008585", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452", "networks": [{"uuid": "8d03ebd6-c397-421b-b2b9-c0caf6788498"}]}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:08:01.368800 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2341/4743] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:08:00 2022] GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b => generated 1669 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:08:01.398917 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-8d04684b-e2f0-4de4-ab88-30c82983ce95 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-1489351558"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:08:01.403243 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-8d04684b-e2f0-4de4-ab88-30c82983ce95 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 48243e1b-892b-4c4b-8db1-242b2e40653b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:08:01.425922 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8d04684b-e2f0-4de4-ab88-30c82983ce95 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:01.426548 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8d04684b-e2f0-4de4-ab88-30c82983ce95 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:01.426994 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8d04684b-e2f0-4de4-ab88-30c82983ce95 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:01.427961 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8d04684b-e2f0-4de4-ab88-30c82983ce95 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:01.428631 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8d04684b-e2f0-4de4-ab88-30c82983ce95 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:01.429374 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8d04684b-e2f0-4de4-ab88-30c82983ce95 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:01.474233 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.network.neutron [None req-96427d6a-5f47-4708-a8d3-d991e8d3558b tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] validate_networks() for [('8d03ebd6-c397-421b-b2b9-c0caf6788498', None, None, None, None, None)] {{(pid=134102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 22:08:01.775189 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-8d04684b-e2f0-4de4-ab88-30c82983ce95 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "POST /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b/action" status: 202 len: 0 microversion: 2.1 time: 0.380541 Oct 04 22:08:01.775910 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2342/4744] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 22:08:01 2022] POST /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b/action => generated 0 bytes in 382 msecs (HTTP/1.1 202) 10 headers in 456 bytes (2 switches on core 0) Oct 04 22:08:01.791288 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-80c50297-44eb-4188-a810-49f3bdcd6697 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:08:01.798218 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-80c50297-44eb-4188-a810-49f3bdcd6697 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 48243e1b-892b-4c4b-8db1-242b2e40653b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:08:01.810334 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-80c50297-44eb-4188-a810-49f3bdcd6697 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:01.811226 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-80c50297-44eb-4188-a810-49f3bdcd6697 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:01.811874 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-80c50297-44eb-4188-a810-49f3bdcd6697 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:01.812814 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-80c50297-44eb-4188-a810-49f3bdcd6697 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:01.814144 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-80c50297-44eb-4188-a810-49f3bdcd6697 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:01.815454 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-80c50297-44eb-4188-a810-49f3bdcd6697 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:02.407523 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-80c50297-44eb-4188-a810-49f3bdcd6697 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:08:02.424530 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-80c50297-44eb-4188-a810-49f3bdcd6697 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b" status: 200 len: 1679 microversion: 2.1 time: 0.637349 Oct 04 22:08:02.425143 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2343/4745] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:08:01 2022] GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b => generated 1679 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:08:03.168962 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-96427d6a-5f47-4708-a8d3-d991e8d3558b tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Flavor limits 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 22:08:03.169475 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-96427d6a-5f47-4708-a8d3-d991e8d3558b tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Image limits 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 22:08:03.169848 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-96427d6a-5f47-4708-a8d3-d991e8d3558b tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Flavor pref 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 22:08:03.170268 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-96427d6a-5f47-4708-a8d3-d991e8d3558b tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Image pref 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 22:08:03.175008 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-96427d6a-5f47-4708-a8d3-d991e8d3558b tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 22:08:03.201182 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-96427d6a-5f47-4708-a8d3-d991e8d3558b tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:03.201696 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-96427d6a-5f47-4708-a8d3-d991e8d3558b tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:03.202134 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-96427d6a-5f47-4708-a8d3-d991e8d3558b tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:03.212235 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-96427d6a-5f47-4708-a8d3-d991e8d3558b tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:03.212750 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-96427d6a-5f47-4708-a8d3-d991e8d3558b tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:03.213199 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-96427d6a-5f47-4708-a8d3-d991e8d3558b tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:03.243550 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-68b031d0-afb6-4b6a-afd4-44d001235384 req-93859830-38bf-4b42-9787-d5b8cc1df79d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48243e1b-892b-4c4b-8db1-242b2e40653b", "name": "network-vif-unplugged", "status": "completed", "tag": "a795c088-46ba-4a15-a651-33aa842e29b5"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:08:03.261214 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-96427d6a-5f47-4708-a8d3-d991e8d3558b tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Getting quotas for project b556e1ace286450f8493715e8317a107. Resources: {'instances', 'ram', 'cores'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:08:03.266826 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-68b031d0-afb6-4b6a-afd4-44d001235384 req-93859830-38bf-4b42-9787-d5b8cc1df79d service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:03.268164 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-68b031d0-afb6-4b6a-afd4-44d001235384 req-93859830-38bf-4b42-9787-d5b8cc1df79d service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:03.268649 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-68b031d0-afb6-4b6a-afd4-44d001235384 req-93859830-38bf-4b42-9787-d5b8cc1df79d service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:03.277942 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-96427d6a-5f47-4708-a8d3-d991e8d3558b tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Getting quotas for user 09e72a1a5d1a4c4b838acb169ab11eb0 and project b556e1ace286450f8493715e8317a107. Resources: {'instances', 'ram', 'cores'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:08:03.309651 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-96427d6a-5f47-4708-a8d3-d991e8d3558b tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Going to run 1 instances... {{(pid=134102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 22:08:03.309883 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-68b031d0-afb6-4b6a-afd4-44d001235384 req-93859830-38bf-4b42-9787-d5b8cc1df79d service nova] Creating event network-vif-unplugged:a795c088-46ba-4a15-a651-33aa842e29b5 for instance 48243e1b-892b-4c4b-8db1-242b2e40653b on n-h1-860284-1 Oct 04 22:08:03.317689 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-96427d6a-5f47-4708-a8d3-d991e8d3558b tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] [instance: 9f29b298-6acb-468a-b28b-6ce95ba57ea2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='58548514-5dac-426c-81f5-19e3fba33e23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 22:08:03.321216 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-68b031d0-afb6-4b6a-afd4-44d001235384 req-93859830-38bf-4b42-9787-d5b8cc1df79d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.078941 Oct 04 22:08:03.322219 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2344/4746] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:08:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:08:03.432360 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-96427d6a-5f47-4708-a8d3-d991e8d3558b tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.068737 Oct 04 22:08:03.433651 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2403/4747] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 22:08:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 2071 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 22:08:03.449350 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-03fe6f78-abbe-4547-88e8-1e6a302ad11b tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:08:03.453516 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-03fe6f78-abbe-4547-88e8-1e6a302ad11b tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] [instance: 9f29b298-6acb-468a-b28b-6ce95ba57ea2] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:08:03.468070 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-b04a27e9-eef3-4965-8239-45c077127c77 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:08:03.468849 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-b04a27e9-eef3-4965-8239-45c077127c77 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 48243e1b-892b-4c4b-8db1-242b2e40653b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:08:03.491803 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b04a27e9-eef3-4965-8239-45c077127c77 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:03.492339 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b04a27e9-eef3-4965-8239-45c077127c77 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:03.492795 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b04a27e9-eef3-4965-8239-45c077127c77 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:03.495315 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b04a27e9-eef3-4965-8239-45c077127c77 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:03.497290 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b04a27e9-eef3-4965-8239-45c077127c77 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:03.497891 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b04a27e9-eef3-4965-8239-45c077127c77 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:04.146848 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-03fe6f78-abbe-4547-88e8-1e6a302ad11b tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e72a1a5d1a4c4b838acb169ab11eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b556e1ace286450f8493715e8317a107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:08:04.156526 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-03fe6f78-abbe-4547-88e8-1e6a302ad11b tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] 10.222.0.43 "GET /compute/v2.1/servers/9f29b298-6acb-468a-b28b-6ce95ba57ea2" status: 200 len: 1218 microversion: 2.1 time: 0.713909 Oct 04 22:08:04.159820 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2345/4748] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:08:03 2022] GET /compute/v2.1/servers/9f29b298-6acb-468a-b28b-6ce95ba57ea2 => generated 1218 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:08:04.452298 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-b04a27e9-eef3-4965-8239-45c077127c77 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:08:04.464033 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-b04a27e9-eef3-4965-8239-45c077127c77 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b" status: 200 len: 1679 microversion: 2.1 time: 1.011318 Oct 04 22:08:04.494472 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2404/4749] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:08:03 2022] GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b => generated 1679 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:08:05.184155 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-f33f4969-4095-47d3-864b-89a305f414d1 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:08:05.184762 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-f33f4969-4095-47d3-864b-89a305f414d1 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] [instance: 9f29b298-6acb-468a-b28b-6ce95ba57ea2] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:08:05.193606 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f33f4969-4095-47d3-864b-89a305f414d1 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:05.197964 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f33f4969-4095-47d3-864b-89a305f414d1 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:05.198660 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f33f4969-4095-47d3-864b-89a305f414d1 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:05.208229 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f33f4969-4095-47d3-864b-89a305f414d1 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:05.208988 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f33f4969-4095-47d3-864b-89a305f414d1 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:05.209633 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f33f4969-4095-47d3-864b-89a305f414d1 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:05.332063 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-f33f4969-4095-47d3-864b-89a305f414d1 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e72a1a5d1a4c4b838acb169ab11eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b556e1ace286450f8493715e8317a107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:08:05.346262 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-f33f4969-4095-47d3-864b-89a305f414d1 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] 10.222.0.43 "GET /compute/v2.1/servers/9f29b298-6acb-468a-b28b-6ce95ba57ea2" status: 200 len: 1270 microversion: 2.1 time: 0.164356 Oct 04 22:08:05.352753 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2346/4750] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:08:05 2022] GET /compute/v2.1/servers/9f29b298-6acb-468a-b28b-6ce95ba57ea2 => generated 1270 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:08:05.497826 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-02fdf1fb-d81a-48cb-9e4d-694fd0b6e25b tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:08:05.498534 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-02fdf1fb-d81a-48cb-9e4d-694fd0b6e25b tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 48243e1b-892b-4c4b-8db1-242b2e40653b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:08:05.513993 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-02fdf1fb-d81a-48cb-9e4d-694fd0b6e25b tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:05.514568 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-02fdf1fb-d81a-48cb-9e4d-694fd0b6e25b tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:05.518514 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-02fdf1fb-d81a-48cb-9e4d-694fd0b6e25b tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:05.532566 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-02fdf1fb-d81a-48cb-9e4d-694fd0b6e25b tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:05.541221 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-02fdf1fb-d81a-48cb-9e4d-694fd0b6e25b tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:05.544812 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-02fdf1fb-d81a-48cb-9e4d-694fd0b6e25b tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:06.027001 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-02fdf1fb-d81a-48cb-9e4d-694fd0b6e25b tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:08:06.042925 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-02fdf1fb-d81a-48cb-9e4d-694fd0b6e25b tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b" status: 200 len: 1687 microversion: 2.1 time: 0.549264 Oct 04 22:08:06.059680 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2405/4751] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:08:05 2022] GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b => generated 1687 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:08:06.381645 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-a8ca989e-154a-4c37-9c84-fda65808a149 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:08:06.383148 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-a8ca989e-154a-4c37-9c84-fda65808a149 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] [instance: 9f29b298-6acb-468a-b28b-6ce95ba57ea2] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:08:06.395255 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a8ca989e-154a-4c37-9c84-fda65808a149 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:06.396040 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a8ca989e-154a-4c37-9c84-fda65808a149 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:06.396686 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a8ca989e-154a-4c37-9c84-fda65808a149 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:06.399435 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a8ca989e-154a-4c37-9c84-fda65808a149 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:06.400502 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a8ca989e-154a-4c37-9c84-fda65808a149 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:06.401534 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a8ca989e-154a-4c37-9c84-fda65808a149 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:06.507113 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-a8ca989e-154a-4c37-9c84-fda65808a149 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e72a1a5d1a4c4b838acb169ab11eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b556e1ace286450f8493715e8317a107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:08:06.515789 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-a8ca989e-154a-4c37-9c84-fda65808a149 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] 10.222.0.43 "GET /compute/v2.1/servers/9f29b298-6acb-468a-b28b-6ce95ba57ea2" status: 200 len: 1276 microversion: 2.1 time: 0.138762 Oct 04 22:08:06.516667 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2347/4752] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:08:06 2022] GET /compute/v2.1/servers/9f29b298-6acb-468a-b28b-6ce95ba57ea2 => generated 1276 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:08:07.070859 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-554765d0-9704-4c8f-906d-0c6cf9446228 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:08:07.072022 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-554765d0-9704-4c8f-906d-0c6cf9446228 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 48243e1b-892b-4c4b-8db1-242b2e40653b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:08:07.079665 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-554765d0-9704-4c8f-906d-0c6cf9446228 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:07.082162 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-554765d0-9704-4c8f-906d-0c6cf9446228 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:07.082852 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-554765d0-9704-4c8f-906d-0c6cf9446228 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:07.083774 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-554765d0-9704-4c8f-906d-0c6cf9446228 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:07.084407 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-554765d0-9704-4c8f-906d-0c6cf9446228 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:07.085031 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-554765d0-9704-4c8f-906d-0c6cf9446228 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:07.484843 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-554765d0-9704-4c8f-906d-0c6cf9446228 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:08:07.498668 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-554765d0-9704-4c8f-906d-0c6cf9446228 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b" status: 200 len: 1687 microversion: 2.1 time: 0.428804 Oct 04 22:08:07.512766 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2406/4753] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:08:07 2022] GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b => generated 1687 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:08:07.548083 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-961ab6c4-1be8-4083-ba96-e0de84a9bfdf tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:08:07.549343 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-961ab6c4-1be8-4083-ba96-e0de84a9bfdf tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] [instance: 9f29b298-6acb-468a-b28b-6ce95ba57ea2] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:08:07.574405 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-961ab6c4-1be8-4083-ba96-e0de84a9bfdf tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:07.581319 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-961ab6c4-1be8-4083-ba96-e0de84a9bfdf tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:07.582780 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-961ab6c4-1be8-4083-ba96-e0de84a9bfdf tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:07.583799 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-961ab6c4-1be8-4083-ba96-e0de84a9bfdf tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:07.584573 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-961ab6c4-1be8-4083-ba96-e0de84a9bfdf tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:07.585660 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-961ab6c4-1be8-4083-ba96-e0de84a9bfdf tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:08.054549 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-961ab6c4-1be8-4083-ba96-e0de84a9bfdf tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e72a1a5d1a4c4b838acb169ab11eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b556e1ace286450f8493715e8317a107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:08:08.071508 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-961ab6c4-1be8-4083-ba96-e0de84a9bfdf tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] 10.222.0.43 "GET /compute/v2.1/servers/9f29b298-6acb-468a-b28b-6ce95ba57ea2" status: 200 len: 1318 microversion: 2.1 time: 0.532850 Oct 04 22:08:08.089292 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2348/4754] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:08:07 2022] GET /compute/v2.1/servers/9f29b298-6acb-468a-b28b-6ce95ba57ea2 => generated 1318 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:08:08.523395 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-5c9b1422-af8c-4501-9874-c8b48ea4153b tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:08:08.524281 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-5c9b1422-af8c-4501-9874-c8b48ea4153b tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 48243e1b-892b-4c4b-8db1-242b2e40653b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:08:08.541541 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5c9b1422-af8c-4501-9874-c8b48ea4153b tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:08.543984 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5c9b1422-af8c-4501-9874-c8b48ea4153b tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:08.544589 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5c9b1422-af8c-4501-9874-c8b48ea4153b tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:08.545498 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5c9b1422-af8c-4501-9874-c8b48ea4153b tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:08.548248 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5c9b1422-af8c-4501-9874-c8b48ea4153b tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:08.549343 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5c9b1422-af8c-4501-9874-c8b48ea4153b tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:09.002219 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-5c9b1422-af8c-4501-9874-c8b48ea4153b tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:08:09.018661 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-5c9b1422-af8c-4501-9874-c8b48ea4153b tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b" status: 200 len: 1687 microversion: 2.1 time: 0.495657 Oct 04 22:08:09.020391 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2407/4755] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:08:08 2022] GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b => generated 1687 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:08:09.103300 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-93a51f5e-6ca9-4c23-923d-6e58f14ea44f tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:08:09.104559 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-93a51f5e-6ca9-4c23-923d-6e58f14ea44f tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] [instance: 9f29b298-6acb-468a-b28b-6ce95ba57ea2] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:08:09.118777 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-93a51f5e-6ca9-4c23-923d-6e58f14ea44f tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:09.119564 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-93a51f5e-6ca9-4c23-923d-6e58f14ea44f tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:09.122751 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-93a51f5e-6ca9-4c23-923d-6e58f14ea44f tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:09.123757 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-93a51f5e-6ca9-4c23-923d-6e58f14ea44f tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:09.124472 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-93a51f5e-6ca9-4c23-923d-6e58f14ea44f tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:09.128230 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-93a51f5e-6ca9-4c23-923d-6e58f14ea44f tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:09.546536 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-93a51f5e-6ca9-4c23-923d-6e58f14ea44f tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e72a1a5d1a4c4b838acb169ab11eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b556e1ace286450f8493715e8317a107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:08:09.565138 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-93a51f5e-6ca9-4c23-923d-6e58f14ea44f tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] 10.222.0.43 "GET /compute/v2.1/servers/9f29b298-6acb-468a-b28b-6ce95ba57ea2" status: 200 len: 1318 microversion: 2.1 time: 0.464695 Oct 04 22:08:09.567612 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2349/4756] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:08:09 2022] GET /compute/v2.1/servers/9f29b298-6acb-468a-b28b-6ce95ba57ea2 => generated 1318 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:08:10.048685 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-10aa0a11-5903-465c-8b9c-5c7298d91811 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:08:10.050881 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-10aa0a11-5903-465c-8b9c-5c7298d91811 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 48243e1b-892b-4c4b-8db1-242b2e40653b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:08:10.061698 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-10aa0a11-5903-465c-8b9c-5c7298d91811 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:10.062493 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-10aa0a11-5903-465c-8b9c-5c7298d91811 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:10.063115 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-10aa0a11-5903-465c-8b9c-5c7298d91811 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:10.063997 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-10aa0a11-5903-465c-8b9c-5c7298d91811 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:10.065864 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-10aa0a11-5903-465c-8b9c-5c7298d91811 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:10.066599 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-10aa0a11-5903-465c-8b9c-5c7298d91811 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:10.273410 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-16c8764f-1ba8-41fc-a6c8-f2237c785ed5 req-89f4695a-b9f7-4a18-b673-7a296fcc3dfa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f29b298-6acb-468a-b28b-6ce95ba57ea2", "tag": "02dd4837-dd78-48fb-99a2-b89da47f98d8"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:08:10.304575 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-16c8764f-1ba8-41fc-a6c8-f2237c785ed5 req-89f4695a-b9f7-4a18-b673-7a296fcc3dfa service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:10.306477 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-16c8764f-1ba8-41fc-a6c8-f2237c785ed5 req-89f4695a-b9f7-4a18-b673-7a296fcc3dfa service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:10.309111 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-16c8764f-1ba8-41fc-a6c8-f2237c785ed5 req-89f4695a-b9f7-4a18-b673-7a296fcc3dfa service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:10.341134 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-16c8764f-1ba8-41fc-a6c8-f2237c785ed5 req-89f4695a-b9f7-4a18-b673-7a296fcc3dfa service nova] Creating event network-changed:02dd4837-dd78-48fb-99a2-b89da47f98d8 for instance 9f29b298-6acb-468a-b28b-6ce95ba57ea2 on n-h2-860284-1 Oct 04 22:08:10.356871 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-16c8764f-1ba8-41fc-a6c8-f2237c785ed5 req-89f4695a-b9f7-4a18-b673-7a296fcc3dfa service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090569 Oct 04 22:08:10.358858 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2350/4757] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:08:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:08:10.591170 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-c1e4f944-0645-453d-b0ec-22e8745b1c57 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:08:10.592181 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-c1e4f944-0645-453d-b0ec-22e8745b1c57 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] [instance: 9f29b298-6acb-468a-b28b-6ce95ba57ea2] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:08:10.605078 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c1e4f944-0645-453d-b0ec-22e8745b1c57 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:10.605604 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c1e4f944-0645-453d-b0ec-22e8745b1c57 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:10.606042 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c1e4f944-0645-453d-b0ec-22e8745b1c57 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:10.612761 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c1e4f944-0645-453d-b0ec-22e8745b1c57 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:10.613273 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c1e4f944-0645-453d-b0ec-22e8745b1c57 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:10.613717 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c1e4f944-0645-453d-b0ec-22e8745b1c57 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:10.843077 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-10aa0a11-5903-465c-8b9c-5c7298d91811 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:08:10.857255 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-10aa0a11-5903-465c-8b9c-5c7298d91811 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b" status: 200 len: 1687 microversion: 2.1 time: 0.813964 Oct 04 22:08:10.860594 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2408/4758] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:08:10 2022] GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b => generated 1687 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:08:11.417578 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-612ecefe-0663-4960-be67-109445bc72cb req-35ea4992-c0ed-472e-910b-624517308a56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48243e1b-892b-4c4b-8db1-242b2e40653b", "name": "network-vif-plugged", "status": "completed", "tag": "a795c088-46ba-4a15-a651-33aa842e29b5"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:08:11.439008 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-612ecefe-0663-4960-be67-109445bc72cb req-35ea4992-c0ed-472e-910b-624517308a56 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:11.440329 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-612ecefe-0663-4960-be67-109445bc72cb req-35ea4992-c0ed-472e-910b-624517308a56 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:11.440796 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-612ecefe-0663-4960-be67-109445bc72cb req-35ea4992-c0ed-472e-910b-624517308a56 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:11.468383 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-612ecefe-0663-4960-be67-109445bc72cb req-35ea4992-c0ed-472e-910b-624517308a56 service nova] Creating event network-vif-plugged:a795c088-46ba-4a15-a651-33aa842e29b5 for instance 48243e1b-892b-4c4b-8db1-242b2e40653b on n-h1-860284-1 Oct 04 22:08:11.477809 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-612ecefe-0663-4960-be67-109445bc72cb req-35ea4992-c0ed-472e-910b-624517308a56 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065097 Oct 04 22:08:11.482879 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2409/4759] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:08:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:08:11.589294 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-c1e4f944-0645-453d-b0ec-22e8745b1c57 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e72a1a5d1a4c4b838acb169ab11eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b556e1ace286450f8493715e8317a107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:08:11.617858 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-c1e4f944-0645-453d-b0ec-22e8745b1c57 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] 10.222.0.43 "GET /compute/v2.1/servers/9f29b298-6acb-468a-b28b-6ce95ba57ea2" status: 200 len: 1318 microversion: 2.1 time: 1.031314 Oct 04 22:08:11.626750 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2351/4760] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:08:10 2022] GET /compute/v2.1/servers/9f29b298-6acb-468a-b28b-6ce95ba57ea2 => generated 1318 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:08:11.888434 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-de921f0b-1728-406e-b0ad-342514a1030d tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:08:11.889598 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-de921f0b-1728-406e-b0ad-342514a1030d tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 48243e1b-892b-4c4b-8db1-242b2e40653b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:08:11.898261 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-de921f0b-1728-406e-b0ad-342514a1030d tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:11.898933 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-de921f0b-1728-406e-b0ad-342514a1030d tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:11.899671 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-de921f0b-1728-406e-b0ad-342514a1030d tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:11.900818 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-de921f0b-1728-406e-b0ad-342514a1030d tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:11.901597 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-de921f0b-1728-406e-b0ad-342514a1030d tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:11.902261 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-de921f0b-1728-406e-b0ad-342514a1030d tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:12.256552 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-de921f0b-1728-406e-b0ad-342514a1030d tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:08:12.264635 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-de921f0b-1728-406e-b0ad-342514a1030d tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b" status: 200 len: 1687 microversion: 2.1 time: 0.385856 Oct 04 22:08:12.287875 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2410/4761] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:08:11 2022] GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b => generated 1687 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:08:12.647958 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-11583718-2857-46ce-9855-aa04d43dae21 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:08:12.650423 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-11583718-2857-46ce-9855-aa04d43dae21 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] [instance: 9f29b298-6acb-468a-b28b-6ce95ba57ea2] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:08:12.669537 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-11583718-2857-46ce-9855-aa04d43dae21 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:12.669998 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-11583718-2857-46ce-9855-aa04d43dae21 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:12.670931 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-11583718-2857-46ce-9855-aa04d43dae21 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:12.676401 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-11583718-2857-46ce-9855-aa04d43dae21 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:12.679448 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-11583718-2857-46ce-9855-aa04d43dae21 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:12.680243 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-11583718-2857-46ce-9855-aa04d43dae21 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:12.844849 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-99e5e17c-2427-429d-977e-7a1be6ef6974 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-765586575", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452", "networks": [{"uuid": "3e97795f-9423-4034-b566-4a70497d6dcc"}]}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:08:12.977646 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.network.neutron [None req-99e5e17c-2427-429d-977e-7a1be6ef6974 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] validate_networks() for [('3e97795f-9423-4034-b566-4a70497d6dcc', None, None, None, None, None)] {{(pid=134101) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 22:08:13.240492 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell0:SELECT=2 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:08:13.303297 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell0:SELECT=6 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:08:13.592988 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-11583718-2857-46ce-9855-aa04d43dae21 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e72a1a5d1a4c4b838acb169ab11eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b556e1ace286450f8493715e8317a107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:08:13.606467 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-11583718-2857-46ce-9855-aa04d43dae21 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] 10.222.0.43 "GET /compute/v2.1/servers/9f29b298-6acb-468a-b28b-6ce95ba57ea2" status: 200 len: 1318 microversion: 2.1 time: 0.966924 Oct 04 22:08:13.607116 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2411/4762] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:08:12 2022] GET /compute/v2.1/servers/9f29b298-6acb-468a-b28b-6ce95ba57ea2 => generated 1318 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:08:13.622860 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-b36844b7-02b8-483d-a7aa-52a7712eb753 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:08:13.623867 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-b36844b7-02b8-483d-a7aa-52a7712eb753 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 48243e1b-892b-4c4b-8db1-242b2e40653b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:08:13.642187 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b36844b7-02b8-483d-a7aa-52a7712eb753 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:13.644279 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b36844b7-02b8-483d-a7aa-52a7712eb753 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:13.646331 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b36844b7-02b8-483d-a7aa-52a7712eb753 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:13.648676 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b36844b7-02b8-483d-a7aa-52a7712eb753 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:13.649262 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b36844b7-02b8-483d-a7aa-52a7712eb753 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:13.657475 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b36844b7-02b8-483d-a7aa-52a7712eb753 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:14.158731 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=2 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:08:15.142121 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-b36844b7-02b8-483d-a7aa-52a7712eb753 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:08:15.154287 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-99e5e17c-2427-429d-977e-7a1be6ef6974 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Flavor limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 22:08:15.154755 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-99e5e17c-2427-429d-977e-7a1be6ef6974 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Image limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 22:08:15.155241 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-99e5e17c-2427-429d-977e-7a1be6ef6974 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Flavor pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 22:08:15.155670 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-99e5e17c-2427-429d-977e-7a1be6ef6974 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Image pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 22:08:15.156091 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-99e5e17c-2427-429d-977e-7a1be6ef6974 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 22:08:15.161652 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-b36844b7-02b8-483d-a7aa-52a7712eb753 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b" status: 200 len: 1682 microversion: 2.1 time: 1.552718 Oct 04 22:08:15.167471 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2412/4763] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:08:13 2022] GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b => generated 1682 bytes in 1560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:08:15.186210 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-180e5ddc-6582-474e-be04-bb58be09dfa2 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:08:15.188088 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-180e5ddc-6582-474e-be04-bb58be09dfa2 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] [instance: 9f29b298-6acb-468a-b28b-6ce95ba57ea2] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:08:15.189339 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-99e5e17c-2427-429d-977e-7a1be6ef6974 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:15.190891 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-99e5e17c-2427-429d-977e-7a1be6ef6974 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:15.193064 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-99e5e17c-2427-429d-977e-7a1be6ef6974 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:15.194080 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-99e5e17c-2427-429d-977e-7a1be6ef6974 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:15.200649 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-99e5e17c-2427-429d-977e-7a1be6ef6974 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:15.201337 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-99e5e17c-2427-429d-977e-7a1be6ef6974 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:15.203402 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-180e5ddc-6582-474e-be04-bb58be09dfa2 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:15.204126 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-180e5ddc-6582-474e-be04-bb58be09dfa2 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:15.209544 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-180e5ddc-6582-474e-be04-bb58be09dfa2 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:15.210646 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-180e5ddc-6582-474e-be04-bb58be09dfa2 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:15.211304 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-180e5ddc-6582-474e-be04-bb58be09dfa2 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:15.211937 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-180e5ddc-6582-474e-be04-bb58be09dfa2 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:15.241862 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-99e5e17c-2427-429d-977e-7a1be6ef6974 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Getting quotas for project d4b00cd9fa8e40a0919b61fcd60269f5. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:08:15.256661 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-99e5e17c-2427-429d-977e-7a1be6ef6974 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Getting quotas for user 9c1682f1a60045d8a04d4d67393cd13f and project d4b00cd9fa8e40a0919b61fcd60269f5. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:08:15.288192 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-99e5e17c-2427-429d-977e-7a1be6ef6974 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Going to run 1 instances... {{(pid=134101) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 22:08:15.293554 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-99e5e17c-2427-429d-977e-7a1be6ef6974 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: 62b87810-2125-4803-bd20-74c16a76ef81] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='58548514-5dac-426c-81f5-19e3fba33e23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134101) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 22:08:15.449428 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-99e5e17c-2427-429d-977e-7a1be6ef6974 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.861637 Oct 04 22:08:15.458259 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2352/4764] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 22:08:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 2871 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 22:08:15.464099 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-d69fa0c4-f7ea-47c0-a310-e93ff09f616b tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:08:15.465889 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-d69fa0c4-f7ea-47c0-a310-e93ff09f616b tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: 62b87810-2125-4803-bd20-74c16a76ef81] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:08:15.645719 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-d69fa0c4-f7ea-47c0-a310-e93ff09f616b tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1682f1a60045d8a04d4d67393cd13f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b00cd9fa8e40a0919b61fcd60269f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:08:15.664509 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-d69fa0c4-f7ea-47c0-a310-e93ff09f616b tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "GET /compute/v2.1/servers/62b87810-2125-4803-bd20-74c16a76ef81" status: 200 len: 1192 microversion: 2.1 time: 0.204650 Oct 04 22:08:15.667587 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2353/4765] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:08:15 2022] GET /compute/v2.1/servers/62b87810-2125-4803-bd20-74c16a76ef81 => generated 1192 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:08:15.931429 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-180e5ddc-6582-474e-be04-bb58be09dfa2 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e72a1a5d1a4c4b838acb169ab11eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b556e1ace286450f8493715e8317a107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:08:15.944285 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-180e5ddc-6582-474e-be04-bb58be09dfa2 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] 10.222.0.43 "GET /compute/v2.1/servers/9f29b298-6acb-468a-b28b-6ce95ba57ea2" status: 200 len: 1318 microversion: 2.1 time: 0.773443 Oct 04 22:08:15.947820 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2413/4766] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:08:15 2022] GET /compute/v2.1/servers/9f29b298-6acb-468a-b28b-6ce95ba57ea2 => generated 1318 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:08:16.191746 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-fdcb6982-2211-490f-b0ee-34644ec241a3 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:08:16.192366 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-fdcb6982-2211-490f-b0ee-34644ec241a3 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 48243e1b-892b-4c4b-8db1-242b2e40653b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:08:16.209598 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fdcb6982-2211-490f-b0ee-34644ec241a3 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:16.211126 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fdcb6982-2211-490f-b0ee-34644ec241a3 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:16.211828 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fdcb6982-2211-490f-b0ee-34644ec241a3 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:16.212797 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fdcb6982-2211-490f-b0ee-34644ec241a3 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:16.214203 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fdcb6982-2211-490f-b0ee-34644ec241a3 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:16.214937 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fdcb6982-2211-490f-b0ee-34644ec241a3 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:16.665029 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-fdcb6982-2211-490f-b0ee-34644ec241a3 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:08:16.685062 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-fdcb6982-2211-490f-b0ee-34644ec241a3 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b" status: 200 len: 1682 microversion: 2.1 time: 0.499734 Oct 04 22:08:16.688176 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2354/4767] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:08:16 2022] GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b => generated 1682 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:08:16.696338 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-032ac674-81df-455c-a2ee-233c55e4581f tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:08:16.696994 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-032ac674-81df-455c-a2ee-233c55e4581f tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: 62b87810-2125-4803-bd20-74c16a76ef81] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:08:16.707577 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-032ac674-81df-455c-a2ee-233c55e4581f tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:16.712628 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-032ac674-81df-455c-a2ee-233c55e4581f tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:16.721124 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-032ac674-81df-455c-a2ee-233c55e4581f tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:16.726841 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-032ac674-81df-455c-a2ee-233c55e4581f tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:16.729753 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-032ac674-81df-455c-a2ee-233c55e4581f tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:16.731511 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-032ac674-81df-455c-a2ee-233c55e4581f tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:16.976502 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-d53560c3-98c4-4e46-a58c-f513ee6a7a2d tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:08:16.979002 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-d53560c3-98c4-4e46-a58c-f513ee6a7a2d tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] [instance: 9f29b298-6acb-468a-b28b-6ce95ba57ea2] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:08:17.019138 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d53560c3-98c4-4e46-a58c-f513ee6a7a2d tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:17.020199 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d53560c3-98c4-4e46-a58c-f513ee6a7a2d tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:17.023276 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d53560c3-98c4-4e46-a58c-f513ee6a7a2d tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:17.027161 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d53560c3-98c4-4e46-a58c-f513ee6a7a2d tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:17.028914 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d53560c3-98c4-4e46-a58c-f513ee6a7a2d tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:17.032128 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d53560c3-98c4-4e46-a58c-f513ee6a7a2d tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:17.052128 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-032ac674-81df-455c-a2ee-233c55e4581f tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1682f1a60045d8a04d4d67393cd13f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b00cd9fa8e40a0919b61fcd60269f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:08:17.105733 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-032ac674-81df-455c-a2ee-233c55e4581f tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "GET /compute/v2.1/servers/62b87810-2125-4803-bd20-74c16a76ef81" status: 200 len: 1196 microversion: 2.1 time: 0.409903 Oct 04 22:08:17.111698 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2414/4768] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:08:16 2022] GET /compute/v2.1/servers/62b87810-2125-4803-bd20-74c16a76ef81 => generated 1196 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:08:17.228978 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-44abde69-94cd-4752-af25-d8382b5ffc3f tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Action: 'create', calling method: .version_select at 0x7fbb2e7691f0>, body: {"keypair": {"name": "tempest-keypair-631057217", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF7R+O0cGGOpDIS7uPOEh+0YPi49iM1kDT4y+PyPqR9WYqw5McQ4Fh5JFEeodGuB27kO8vrBLqz6T3EEI8s5kaBFoJEIjwc+q5Hmrx27+XBz+idUIYMxyY6KCDgF6cRDng=="}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:08:17.266994 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-44abde69-94cd-4752-af25-d8382b5ffc3f tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Getting quotas for project f877741b2664498e974791b4952bfc92. Resources: {'key_pairs'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:08:17.280782 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-44abde69-94cd-4752-af25-d8382b5ffc3f tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Getting quotas for user ed57db002d7b42ea8533ed32b6904c63 and project f877741b2664498e974791b4952bfc92. Resources: {'key_pairs'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:08:17.319678 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-d53560c3-98c4-4e46-a58c-f513ee6a7a2d tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e72a1a5d1a4c4b838acb169ab11eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b556e1ace286450f8493715e8317a107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:08:17.335483 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-d53560c3-98c4-4e46-a58c-f513ee6a7a2d tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] 10.222.0.43 "GET /compute/v2.1/servers/9f29b298-6acb-468a-b28b-6ce95ba57ea2" status: 200 len: 1318 microversion: 2.1 time: 0.365951 Oct 04 22:08:17.347634 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2355/4769] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:08:16 2022] GET /compute/v2.1/servers/9f29b298-6acb-468a-b28b-6ce95ba57ea2 => generated 1318 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:08:17.361994 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-44abde69-94cd-4752-af25-d8382b5ffc3f tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.32 time: 0.137029 Oct 04 22:08:17.364929 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2415/4770] 10.222.0.43 () {62 vars in 1200 bytes} [Tue Oct 4 22:08:17 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 141 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 04 22:08:17.720828 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-49e1d352-c807-4a4f-a3ef-d3435cf89d15 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:08:17.721878 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-49e1d352-c807-4a4f-a3ef-d3435cf89d15 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 48243e1b-892b-4c4b-8db1-242b2e40653b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:08:17.755011 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-49e1d352-c807-4a4f-a3ef-d3435cf89d15 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:17.755671 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-49e1d352-c807-4a4f-a3ef-d3435cf89d15 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:17.756225 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-49e1d352-c807-4a4f-a3ef-d3435cf89d15 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:17.757237 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-49e1d352-c807-4a4f-a3ef-d3435cf89d15 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:17.757817 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-49e1d352-c807-4a4f-a3ef-d3435cf89d15 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:17.762719 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-49e1d352-c807-4a4f-a3ef-d3435cf89d15 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:18.156512 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-f0d94a26-e1a6-4a7a-b88c-66134367dd7a tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:08:18.182282 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-f0d94a26-e1a6-4a7a-b88c-66134367dd7a tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: 62b87810-2125-4803-bd20-74c16a76ef81] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:08:18.182282 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f0d94a26-e1a6-4a7a-b88c-66134367dd7a tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:18.183067 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f0d94a26-e1a6-4a7a-b88c-66134367dd7a tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:18.183067 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f0d94a26-e1a6-4a7a-b88c-66134367dd7a tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:18.183626 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f0d94a26-e1a6-4a7a-b88c-66134367dd7a tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:18.184100 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f0d94a26-e1a6-4a7a-b88c-66134367dd7a tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:18.184530 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f0d94a26-e1a6-4a7a-b88c-66134367dd7a tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:18.356244 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-49e1d352-c807-4a4f-a3ef-d3435cf89d15 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:08:18.365857 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-49e1d352-c807-4a4f-a3ef-d3435cf89d15 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b" status: 200 len: 1682 microversion: 2.1 time: 0.653179 Oct 04 22:08:18.375729 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2356/4771] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:08:17 2022] GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b => generated 1682 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:08:18.395972 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-5906cb8c-3c2b-497e-bb75-bc3e177f7c3d tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:08:18.396759 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-5906cb8c-3c2b-497e-bb75-bc3e177f7c3d tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] [instance: 9f29b298-6acb-468a-b28b-6ce95ba57ea2] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:08:18.405143 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5906cb8c-3c2b-497e-bb75-bc3e177f7c3d tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:18.405917 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5906cb8c-3c2b-497e-bb75-bc3e177f7c3d tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:18.406659 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5906cb8c-3c2b-497e-bb75-bc3e177f7c3d tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:18.407669 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5906cb8c-3c2b-497e-bb75-bc3e177f7c3d tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:18.409136 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5906cb8c-3c2b-497e-bb75-bc3e177f7c3d tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:18.409996 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5906cb8c-3c2b-497e-bb75-bc3e177f7c3d tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:18.479498 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-f0d94a26-e1a6-4a7a-b88c-66134367dd7a tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1682f1a60045d8a04d4d67393cd13f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b00cd9fa8e40a0919b61fcd60269f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:08:18.495438 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-f0d94a26-e1a6-4a7a-b88c-66134367dd7a tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "GET /compute/v2.1/servers/62b87810-2125-4803-bd20-74c16a76ef81" status: 200 len: 1250 microversion: 2.1 time: 0.343104 Oct 04 22:08:18.496343 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2416/4772] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:08:18 2022] GET /compute/v2.1/servers/62b87810-2125-4803-bd20-74c16a76ef81 => generated 1250 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:08:19.397845 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-b36481cd-60d1-4629-a94a-0f8536e4dcc0 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:08:19.398726 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-b36481cd-60d1-4629-a94a-0f8536e4dcc0 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 48243e1b-892b-4c4b-8db1-242b2e40653b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:08:19.427183 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b36481cd-60d1-4629-a94a-0f8536e4dcc0 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:19.430011 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b36481cd-60d1-4629-a94a-0f8536e4dcc0 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:19.431652 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b36481cd-60d1-4629-a94a-0f8536e4dcc0 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:19.435711 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b36481cd-60d1-4629-a94a-0f8536e4dcc0 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:19.440370 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b36481cd-60d1-4629-a94a-0f8536e4dcc0 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:19.443735 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b36481cd-60d1-4629-a94a-0f8536e4dcc0 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:19.954979 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-5906cb8c-3c2b-497e-bb75-bc3e177f7c3d tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e72a1a5d1a4c4b838acb169ab11eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b556e1ace286450f8493715e8317a107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:08:19.966579 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-5906cb8c-3c2b-497e-bb75-bc3e177f7c3d tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] 10.222.0.43 "GET /compute/v2.1/servers/9f29b298-6acb-468a-b28b-6ce95ba57ea2" status: 200 len: 1318 microversion: 2.1 time: 1.588461 Oct 04 22:08:19.967510 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2357/4773] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:08:18 2022] GET /compute/v2.1/servers/9f29b298-6acb-468a-b28b-6ce95ba57ea2 => generated 1318 bytes in 1591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:08:19.980605 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-48e6593f-8c91-43aa-8cc1-a06a834b32d2 req-842bf76f-6ff8-40c3-973f-6b3854b25984 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f29b298-6acb-468a-b28b-6ce95ba57ea2", "name": "network-vif-plugged", "status": "completed", "tag": "02dd4837-dd78-48fb-99a2-b89da47f98d8"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:08:19.996500 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-48e6593f-8c91-43aa-8cc1-a06a834b32d2 req-842bf76f-6ff8-40c3-973f-6b3854b25984 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:19.997292 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-48e6593f-8c91-43aa-8cc1-a06a834b32d2 req-842bf76f-6ff8-40c3-973f-6b3854b25984 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:19.997896 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-48e6593f-8c91-43aa-8cc1-a06a834b32d2 req-842bf76f-6ff8-40c3-973f-6b3854b25984 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:20.026929 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-48e6593f-8c91-43aa-8cc1-a06a834b32d2 req-842bf76f-6ff8-40c3-973f-6b3854b25984 service nova] Creating event network-vif-plugged:02dd4837-dd78-48fb-99a2-b89da47f98d8 for instance 9f29b298-6acb-468a-b28b-6ce95ba57ea2 on n-h2-860284-1 Oct 04 22:08:20.042063 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-48e6593f-8c91-43aa-8cc1-a06a834b32d2 req-842bf76f-6ff8-40c3-973f-6b3854b25984 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073032 Oct 04 22:08:20.043025 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2358/4774] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:08:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:08:20.057602 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-1ad5678d-9536-4774-b56a-449760ff076b tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:08:20.063541 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-1ad5678d-9536-4774-b56a-449760ff076b tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: 62b87810-2125-4803-bd20-74c16a76ef81] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:08:20.098675 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1ad5678d-9536-4774-b56a-449760ff076b tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:20.099640 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1ad5678d-9536-4774-b56a-449760ff076b tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:20.102067 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1ad5678d-9536-4774-b56a-449760ff076b tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:20.103115 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1ad5678d-9536-4774-b56a-449760ff076b tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:20.103822 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1ad5678d-9536-4774-b56a-449760ff076b tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:20.104437 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1ad5678d-9536-4774-b56a-449760ff076b tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:20.953630 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-b36481cd-60d1-4629-a94a-0f8536e4dcc0 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:08:20.973698 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-b36481cd-60d1-4629-a94a-0f8536e4dcc0 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b" status: 200 len: 1682 microversion: 2.1 time: 1.581277 Oct 04 22:08:20.974334 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2417/4775] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:08:19 2022] GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b => generated 1682 bytes in 1583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:08:21.001916 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-0adede2a-2297-4d5c-ab50-1557a242c068 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:08:21.003588 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-0adede2a-2297-4d5c-ab50-1557a242c068 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] [instance: 9f29b298-6acb-468a-b28b-6ce95ba57ea2] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:08:21.022008 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0adede2a-2297-4d5c-ab50-1557a242c068 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:21.022886 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0adede2a-2297-4d5c-ab50-1557a242c068 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:21.023557 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0adede2a-2297-4d5c-ab50-1557a242c068 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:21.024728 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0adede2a-2297-4d5c-ab50-1557a242c068 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:21.025610 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0adede2a-2297-4d5c-ab50-1557a242c068 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:21.026261 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0adede2a-2297-4d5c-ab50-1557a242c068 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:21.169376 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-1ad5678d-9536-4774-b56a-449760ff076b tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1682f1a60045d8a04d4d67393cd13f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b00cd9fa8e40a0919b61fcd60269f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:08:21.179415 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-1ad5678d-9536-4774-b56a-449760ff076b tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "GET /compute/v2.1/servers/62b87810-2125-4803-bd20-74c16a76ef81" status: 200 len: 1292 microversion: 2.1 time: 1.134953 Oct 04 22:08:21.188186 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2359/4776] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:08:20 2022] GET /compute/v2.1/servers/62b87810-2125-4803-bd20-74c16a76ef81 => generated 1292 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:08:21.563496 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-0adede2a-2297-4d5c-ab50-1557a242c068 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e72a1a5d1a4c4b838acb169ab11eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b556e1ace286450f8493715e8317a107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:08:21.584778 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-0adede2a-2297-4d5c-ab50-1557a242c068 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] 10.222.0.43 "GET /compute/v2.1/servers/9f29b298-6acb-468a-b28b-6ce95ba57ea2" status: 200 len: 1318 microversion: 2.1 time: 0.589828 Oct 04 22:08:21.612980 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2418/4777] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:08:20 2022] GET /compute/v2.1/servers/9f29b298-6acb-468a-b28b-6ce95ba57ea2 => generated 1318 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:08:22.002816 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-8006bea7-c045-40d7-8195-f486951a690a tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:08:22.003777 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-8006bea7-c045-40d7-8195-f486951a690a tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 48243e1b-892b-4c4b-8db1-242b2e40653b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:08:22.063450 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8006bea7-c045-40d7-8195-f486951a690a tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:22.063450 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8006bea7-c045-40d7-8195-f486951a690a tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:22.063450 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8006bea7-c045-40d7-8195-f486951a690a tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:22.063450 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8006bea7-c045-40d7-8195-f486951a690a tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:22.063450 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8006bea7-c045-40d7-8195-f486951a690a tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:22.063450 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8006bea7-c045-40d7-8195-f486951a690a tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:22.210397 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-0c909258-1ed7-4b72-bd15-8bfaee782df1 req-1b7b92e1-9f4b-4d5f-993c-28dcf39d9a00 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62b87810-2125-4803-bd20-74c16a76ef81", "tag": "1d119cd0-6059-4b2c-afea-42a85a4a3b03"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:08:22.229148 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-0c909258-1ed7-4b72-bd15-8bfaee782df1 req-1b7b92e1-9f4b-4d5f-993c-28dcf39d9a00 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:22.229899 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-0c909258-1ed7-4b72-bd15-8bfaee782df1 req-1b7b92e1-9f4b-4d5f-993c-28dcf39d9a00 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:22.241935 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-0c909258-1ed7-4b72-bd15-8bfaee782df1 req-1b7b92e1-9f4b-4d5f-993c-28dcf39d9a00 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:22.271307 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-0c909258-1ed7-4b72-bd15-8bfaee782df1 req-1b7b92e1-9f4b-4d5f-993c-28dcf39d9a00 service nova] Creating event network-changed:1d119cd0-6059-4b2c-afea-42a85a4a3b03 for instance 62b87810-2125-4803-bd20-74c16a76ef81 on n-h2-860284-1 Oct 04 22:08:22.295994 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-0c909258-1ed7-4b72-bd15-8bfaee782df1 req-1b7b92e1-9f4b-4d5f-993c-28dcf39d9a00 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088952 Oct 04 22:08:22.297683 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2419/4778] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:08:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:08:22.306967 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-382c39ec-fcb3-46b8-a317-53047c4ae64e tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:08:22.308048 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-382c39ec-fcb3-46b8-a317-53047c4ae64e tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: 62b87810-2125-4803-bd20-74c16a76ef81] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:08:22.316834 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-382c39ec-fcb3-46b8-a317-53047c4ae64e tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:22.317697 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-382c39ec-fcb3-46b8-a317-53047c4ae64e tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:22.318541 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-382c39ec-fcb3-46b8-a317-53047c4ae64e tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:22.319451 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-382c39ec-fcb3-46b8-a317-53047c4ae64e tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:22.320097 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-382c39ec-fcb3-46b8-a317-53047c4ae64e tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:22.320709 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-382c39ec-fcb3-46b8-a317-53047c4ae64e tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:23.182413 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-382c39ec-fcb3-46b8-a317-53047c4ae64e tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1682f1a60045d8a04d4d67393cd13f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b00cd9fa8e40a0919b61fcd60269f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:08:23.194355 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-382c39ec-fcb3-46b8-a317-53047c4ae64e tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "GET /compute/v2.1/servers/62b87810-2125-4803-bd20-74c16a76ef81" status: 200 len: 1292 microversion: 2.1 time: 0.894431 Oct 04 22:08:23.196544 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2420/4779] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:08:22 2022] GET /compute/v2.1/servers/62b87810-2125-4803-bd20-74c16a76ef81 => generated 1292 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:08:23.209650 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-86ad30f7-74bc-4d92-8193-9079b5aecaec tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:08:23.211908 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-86ad30f7-74bc-4d92-8193-9079b5aecaec tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] [instance: 9f29b298-6acb-468a-b28b-6ce95ba57ea2] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:08:23.226682 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-86ad30f7-74bc-4d92-8193-9079b5aecaec tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:23.229831 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-86ad30f7-74bc-4d92-8193-9079b5aecaec tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:23.230761 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-86ad30f7-74bc-4d92-8193-9079b5aecaec tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:23.231730 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-86ad30f7-74bc-4d92-8193-9079b5aecaec tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:23.233846 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-86ad30f7-74bc-4d92-8193-9079b5aecaec tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:23.234611 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-86ad30f7-74bc-4d92-8193-9079b5aecaec tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:23.289012 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=100 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:08:23.433634 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-8006bea7-c045-40d7-8195-f486951a690a tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:08:23.441111 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:08:23.456551 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-8006bea7-c045-40d7-8195-f486951a690a tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b" status: 200 len: 1682 microversion: 2.1 time: 1.458482 Oct 04 22:08:23.457171 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2360/4780] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:08:21 2022] GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b => generated 1682 bytes in 1461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:08:23.938193 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-86ad30f7-74bc-4d92-8193-9079b5aecaec tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e72a1a5d1a4c4b838acb169ab11eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b556e1ace286450f8493715e8317a107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:08:23.949700 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-86ad30f7-74bc-4d92-8193-9079b5aecaec tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] 10.222.0.43 "GET /compute/v2.1/servers/9f29b298-6acb-468a-b28b-6ce95ba57ea2" status: 200 len: 1507 microversion: 2.1 time: 0.751398 Oct 04 22:08:23.950858 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2421/4781] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:08:23 2022] GET /compute/v2.1/servers/9f29b298-6acb-468a-b28b-6ce95ba57ea2 => generated 1507 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:08:23.975038 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-912e26e7-8b0c-4c25-9759-1113d47e092f tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "320f26dd-78e4-4c74-b556-be2974d9ec5a", "device": "/dev/sdb"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:08:23.978066 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-912e26e7-8b0c-4c25-9759-1113d47e092f tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] [instance: 9f29b298-6acb-468a-b28b-6ce95ba57ea2] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:08:23.988443 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-912e26e7-8b0c-4c25-9759-1113d47e092f tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:23.989438 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-912e26e7-8b0c-4c25-9759-1113d47e092f tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:23.990112 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-912e26e7-8b0c-4c25-9759-1113d47e092f tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:23.991138 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-912e26e7-8b0c-4c25-9759-1113d47e092f tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:23.992594 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-912e26e7-8b0c-4c25-9759-1113d47e092f tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:23.993277 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-912e26e7-8b0c-4c25-9759-1113d47e092f tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:24.225578 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-b0064918-7606-4fc8-b553-88b3c326aced tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:08:24.227354 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-b0064918-7606-4fc8-b553-88b3c326aced tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: 62b87810-2125-4803-bd20-74c16a76ef81] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:08:24.254261 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b0064918-7606-4fc8-b553-88b3c326aced tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:24.257349 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b0064918-7606-4fc8-b553-88b3c326aced tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:24.258672 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b0064918-7606-4fc8-b553-88b3c326aced tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:24.260692 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b0064918-7606-4fc8-b553-88b3c326aced tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:24.261533 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b0064918-7606-4fc8-b553-88b3c326aced tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:24.262159 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b0064918-7606-4fc8-b553-88b3c326aced tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:24.596574 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-b0064918-7606-4fc8-b553-88b3c326aced tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1682f1a60045d8a04d4d67393cd13f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b00cd9fa8e40a0919b61fcd60269f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:08:24.605804 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-b0064918-7606-4fc8-b553-88b3c326aced tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "GET /compute/v2.1/servers/62b87810-2125-4803-bd20-74c16a76ef81" status: 200 len: 1292 microversion: 2.1 time: 0.390466 Oct 04 22:08:24.629482 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2422/4782] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:08:24 2022] GET /compute/v2.1/servers/62b87810-2125-4803-bd20-74c16a76ef81 => generated 1292 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:08:24.641288 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-2fe3116c-34a0-4d27-a3a8-bdfef81a90e7 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:08:24.644688 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-2fe3116c-34a0-4d27-a3a8-bdfef81a90e7 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 48243e1b-892b-4c4b-8db1-242b2e40653b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:08:24.654089 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2fe3116c-34a0-4d27-a3a8-bdfef81a90e7 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:24.654856 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2fe3116c-34a0-4d27-a3a8-bdfef81a90e7 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:24.655513 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2fe3116c-34a0-4d27-a3a8-bdfef81a90e7 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:24.656920 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2fe3116c-34a0-4d27-a3a8-bdfef81a90e7 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:24.657607 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2fe3116c-34a0-4d27-a3a8-bdfef81a90e7 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:24.659099 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2fe3116c-34a0-4d27-a3a8-bdfef81a90e7 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:25.219440 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=2 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:08:25.466229 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-912e26e7-8b0c-4c25-9759-1113d47e092f tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] 10.222.0.43 "POST /compute/v2.1/servers/9f29b298-6acb-468a-b28b-6ce95ba57ea2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.496632 Oct 04 22:08:25.472220 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2361/4783] 10.222.0.43 () {60 vars in 1323 bytes} [Tue Oct 4 22:08:23 2022] POST /compute/v2.1/servers/9f29b298-6acb-468a-b28b-6ce95ba57ea2/os-volume_attachments => generated 194 bytes in 1503 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:08:25.640977 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-b416c322-682a-4f17-9bfa-a1b661ded6b5 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:08:25.641843 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-b416c322-682a-4f17-9bfa-a1b661ded6b5 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: 62b87810-2125-4803-bd20-74c16a76ef81] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:08:25.656093 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=8 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:08:25.664707 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b416c322-682a-4f17-9bfa-a1b661ded6b5 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:25.667532 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b416c322-682a-4f17-9bfa-a1b661ded6b5 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:25.668132 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b416c322-682a-4f17-9bfa-a1b661ded6b5 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:25.672700 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b416c322-682a-4f17-9bfa-a1b661ded6b5 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:25.673206 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b416c322-682a-4f17-9bfa-a1b661ded6b5 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:25.676399 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b416c322-682a-4f17-9bfa-a1b661ded6b5 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:26.499434 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-2fe3116c-34a0-4d27-a3a8-bdfef81a90e7 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:08:26.517094 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-2fe3116c-34a0-4d27-a3a8-bdfef81a90e7 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b" status: 200 len: 1682 microversion: 2.1 time: 1.881573 Oct 04 22:08:26.536210 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2423/4784] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:08:24 2022] GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b => generated 1682 bytes in 1905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:08:26.730623 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-b416c322-682a-4f17-9bfa-a1b661ded6b5 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1682f1a60045d8a04d4d67393cd13f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b00cd9fa8e40a0919b61fcd60269f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:08:26.742229 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-b416c322-682a-4f17-9bfa-a1b661ded6b5 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "GET /compute/v2.1/servers/62b87810-2125-4803-bd20-74c16a76ef81" status: 200 len: 1292 microversion: 2.1 time: 1.108202 Oct 04 22:08:26.754833 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2362/4785] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:08:25 2022] GET /compute/v2.1/servers/62b87810-2125-4803-bd20-74c16a76ef81 => generated 1292 bytes in 1122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:08:27.545273 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-f0c08ab0-f603-4876-98d7-b8a7003fe24b tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:08:27.545991 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-f0c08ab0-f603-4876-98d7-b8a7003fe24b tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 48243e1b-892b-4c4b-8db1-242b2e40653b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:08:27.549774 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell0:SELECT=4 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:08:27.578011 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f0c08ab0-f603-4876-98d7-b8a7003fe24b tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:27.579563 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f0c08ab0-f603-4876-98d7-b8a7003fe24b tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:27.582373 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f0c08ab0-f603-4876-98d7-b8a7003fe24b tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:27.584195 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f0c08ab0-f603-4876-98d7-b8a7003fe24b tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:27.591154 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f0c08ab0-f603-4876-98d7-b8a7003fe24b tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:27.591830 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f0c08ab0-f603-4876-98d7-b8a7003fe24b tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:27.769136 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-b0af4a30-e25f-4948-8b0f-37626d5108d3 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:08:27.769917 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-b0af4a30-e25f-4948-8b0f-37626d5108d3 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: 62b87810-2125-4803-bd20-74c16a76ef81] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:08:27.783963 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b0af4a30-e25f-4948-8b0f-37626d5108d3 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:27.786386 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b0af4a30-e25f-4948-8b0f-37626d5108d3 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:27.787822 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b0af4a30-e25f-4948-8b0f-37626d5108d3 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:27.793076 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b0af4a30-e25f-4948-8b0f-37626d5108d3 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:27.795295 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b0af4a30-e25f-4948-8b0f-37626d5108d3 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:27.795869 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b0af4a30-e25f-4948-8b0f-37626d5108d3 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:28.034619 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-f0c08ab0-f603-4876-98d7-b8a7003fe24b tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:08:28.054133 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-f0c08ab0-f603-4876-98d7-b8a7003fe24b tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b" status: 200 len: 1682 microversion: 2.1 time: 0.513437 Oct 04 22:08:28.055193 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2424/4786] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:08:27 2022] GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b => generated 1682 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:08:28.152382 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-3034c86c-c253-4056-bdcc-69a0de24a74f tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1609139673", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "3ab97d25-8a44-4745-ab46-f1721db50007"}, {"port": "f59ea8c9-f58e-4510-8926-2c0460bdd87d", "tag": "port-1"}, {"port": "68e96019-907e-47ad-a440-3208969682fb", "tag": "port-2"}, {"uuid": "861be64c-37ca-4e0c-8d67-128a66ef062a", "tag": "net-1"}, {"uuid": "861be64c-37ca-4e0c-8d67-128a66ef062a"}, {"uuid": "b51edbbd-e47c-4857-b55c-9dabefa55acb", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "b51edbbd-e47c-4857-b55c-9dabefa55acb", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "eca4a5a0-0b49-4495-89b4-920824148e86", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "a182a42b-96d7-4669-a720-bde4fd7303f7", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "4eee84d0-3346-441a-8326-ea64f54f11ec", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--370308022"}], "key_name": "tempest-keypair-631057217", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:08:28.157375 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-b0af4a30-e25f-4948-8b0f-37626d5108d3 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1682f1a60045d8a04d4d67393cd13f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b00cd9fa8e40a0919b61fcd60269f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:08:28.167848 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-b0af4a30-e25f-4948-8b0f-37626d5108d3 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "GET /compute/v2.1/servers/62b87810-2125-4803-bd20-74c16a76ef81" status: 200 len: 1292 microversion: 2.1 time: 0.403065 Oct 04 22:08:28.169835 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2363/4787] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:08:27 2022] GET /compute/v2.1/servers/62b87810-2125-4803-bd20-74c16a76ef81 => generated 1292 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:08:28.768454 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.network.neutron [None req-3034c86c-c253-4056-bdcc-69a0de24a74f tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] validate_networks() for [('3ab97d25-8a44-4745-ab46-f1721db50007', None, None, None, None, None), (None, None, 'f59ea8c9-f58e-4510-8926-2c0460bdd87d', None, None, None), (None, None, '68e96019-907e-47ad-a440-3208969682fb', None, None, None), ('861be64c-37ca-4e0c-8d67-128a66ef062a', None, None, None, None, None), ('861be64c-37ca-4e0c-8d67-128a66ef062a', None, None, None, None, None), ('b51edbbd-e47c-4857-b55c-9dabefa55acb', '10.2.2.100', None, None, None, None), ('b51edbbd-e47c-4857-b55c-9dabefa55acb', '10.2.2.200', None, None, None, None)] {{(pid=134102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 22:08:29.084624 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-bc833853-8b74-465a-8f93-0b7f906f7060 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:08:29.085256 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-bc833853-8b74-465a-8f93-0b7f906f7060 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 48243e1b-892b-4c4b-8db1-242b2e40653b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:08:29.104366 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bc833853-8b74-465a-8f93-0b7f906f7060 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:29.110492 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bc833853-8b74-465a-8f93-0b7f906f7060 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:29.111756 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bc833853-8b74-465a-8f93-0b7f906f7060 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:29.112718 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bc833853-8b74-465a-8f93-0b7f906f7060 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:29.113626 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bc833853-8b74-465a-8f93-0b7f906f7060 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:29.114697 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bc833853-8b74-465a-8f93-0b7f906f7060 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:30.128190 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-bc833853-8b74-465a-8f93-0b7f906f7060 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:08:30.140992 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-bc833853-8b74-465a-8f93-0b7f906f7060 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b" status: 200 len: 1682 microversion: 2.1 time: 1.061538 Oct 04 22:08:30.161341 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2364/4788] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:08:29 2022] GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b => generated 1682 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:08:30.171432 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-dba17334-33a1-4f20-80be-c479a60f0770 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:08:30.174748 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-dba17334-33a1-4f20-80be-c479a60f0770 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: 62b87810-2125-4803-bd20-74c16a76ef81] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:08:30.186148 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dba17334-33a1-4f20-80be-c479a60f0770 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:30.189604 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dba17334-33a1-4f20-80be-c479a60f0770 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:30.193276 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dba17334-33a1-4f20-80be-c479a60f0770 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:30.194382 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dba17334-33a1-4f20-80be-c479a60f0770 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:30.199498 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dba17334-33a1-4f20-80be-c479a60f0770 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:30.200205 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dba17334-33a1-4f20-80be-c479a60f0770 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:30.904221 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-dba17334-33a1-4f20-80be-c479a60f0770 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1682f1a60045d8a04d4d67393cd13f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b00cd9fa8e40a0919b61fcd60269f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:08:30.934168 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-dba17334-33a1-4f20-80be-c479a60f0770 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "GET /compute/v2.1/servers/62b87810-2125-4803-bd20-74c16a76ef81" status: 200 len: 1292 microversion: 2.1 time: 0.769232 Oct 04 22:08:30.952687 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2365/4789] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:08:30 2022] GET /compute/v2.1/servers/62b87810-2125-4803-bd20-74c16a76ef81 => generated 1292 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:08:31.169558 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-2ac0f923-b723-4058-94b1-a70a666ea462 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:08:31.170193 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-2ac0f923-b723-4058-94b1-a70a666ea462 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 48243e1b-892b-4c4b-8db1-242b2e40653b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:08:31.173354 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=3 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:08:31.189291 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2ac0f923-b723-4058-94b1-a70a666ea462 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:31.190551 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2ac0f923-b723-4058-94b1-a70a666ea462 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:31.192192 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2ac0f923-b723-4058-94b1-a70a666ea462 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:31.192951 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2ac0f923-b723-4058-94b1-a70a666ea462 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:31.193437 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2ac0f923-b723-4058-94b1-a70a666ea462 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:31.199493 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2ac0f923-b723-4058-94b1-a70a666ea462 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:31.721057 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-2ac0f923-b723-4058-94b1-a70a666ea462 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:08:31.732041 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-2ac0f923-b723-4058-94b1-a70a666ea462 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b" status: 200 len: 1682 microversion: 2.1 time: 0.566365 Oct 04 22:08:31.732643 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2366/4790] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:08:31 2022] GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b => generated 1682 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:08:31.963034 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-dd772e25-2b38-44dc-a140-dba6670a6732 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:08:31.963670 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-dd772e25-2b38-44dc-a140-dba6670a6732 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: 62b87810-2125-4803-bd20-74c16a76ef81] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:08:31.976304 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dd772e25-2b38-44dc-a140-dba6670a6732 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:31.976902 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dd772e25-2b38-44dc-a140-dba6670a6732 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:31.977539 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dd772e25-2b38-44dc-a140-dba6670a6732 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:31.978486 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dd772e25-2b38-44dc-a140-dba6670a6732 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:31.979110 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dd772e25-2b38-44dc-a140-dba6670a6732 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:31.979722 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dd772e25-2b38-44dc-a140-dba6670a6732 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:32.672597 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-dd772e25-2b38-44dc-a140-dba6670a6732 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1682f1a60045d8a04d4d67393cd13f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b00cd9fa8e40a0919b61fcd60269f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:08:32.692365 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-dd772e25-2b38-44dc-a140-dba6670a6732 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "GET /compute/v2.1/servers/62b87810-2125-4803-bd20-74c16a76ef81" status: 200 len: 1292 microversion: 2.1 time: 0.733316 Oct 04 22:08:32.693207 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2367/4791] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:08:31 2022] GET /compute/v2.1/servers/62b87810-2125-4803-bd20-74c16a76ef81 => generated 1292 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:08:32.758733 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-79103b46-f507-4e85-a019-1dc0a4226502 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:08:32.759525 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-79103b46-f507-4e85-a019-1dc0a4226502 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 48243e1b-892b-4c4b-8db1-242b2e40653b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:08:32.770223 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-79103b46-f507-4e85-a019-1dc0a4226502 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:32.773104 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-79103b46-f507-4e85-a019-1dc0a4226502 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:32.773587 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-79103b46-f507-4e85-a019-1dc0a4226502 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:32.779204 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-79103b46-f507-4e85-a019-1dc0a4226502 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:32.786954 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-79103b46-f507-4e85-a019-1dc0a4226502 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:32.788393 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-79103b46-f507-4e85-a019-1dc0a4226502 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:33.254503 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-79103b46-f507-4e85-a019-1dc0a4226502 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:08:33.265123 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-79103b46-f507-4e85-a019-1dc0a4226502 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b" status: 200 len: 1682 microversion: 2.1 time: 0.511673 Oct 04 22:08:33.269047 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2368/4792] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:08:32 2022] GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b => generated 1682 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:08:33.721370 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-8b635283-4738-4c3a-b7cf-882a1b9b3aa3 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:08:33.723567 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-8b635283-4738-4c3a-b7cf-882a1b9b3aa3 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: 62b87810-2125-4803-bd20-74c16a76ef81] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:08:33.740671 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8b635283-4738-4c3a-b7cf-882a1b9b3aa3 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:33.750985 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8b635283-4738-4c3a-b7cf-882a1b9b3aa3 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:33.752876 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8b635283-4738-4c3a-b7cf-882a1b9b3aa3 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:33.757045 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8b635283-4738-4c3a-b7cf-882a1b9b3aa3 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:33.759825 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8b635283-4738-4c3a-b7cf-882a1b9b3aa3 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:33.762352 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8b635283-4738-4c3a-b7cf-882a1b9b3aa3 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:34.075961 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-8b635283-4738-4c3a-b7cf-882a1b9b3aa3 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1682f1a60045d8a04d4d67393cd13f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b00cd9fa8e40a0919b61fcd60269f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:08:34.087202 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-8b635283-4738-4c3a-b7cf-882a1b9b3aa3 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "GET /compute/v2.1/servers/62b87810-2125-4803-bd20-74c16a76ef81" status: 200 len: 1292 microversion: 2.1 time: 0.371016 Oct 04 22:08:34.110675 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2369/4793] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:08:33 2022] GET /compute/v2.1/servers/62b87810-2125-4803-bd20-74c16a76ef81 => generated 1292 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:08:34.140172 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-9cd92b28-8017-45cb-91f9-48a6a99b2689 req-82196f07-6004-4fd9-acac-9b68311a51cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62b87810-2125-4803-bd20-74c16a76ef81", "name": "network-vif-plugged", "status": "completed", "tag": "1d119cd0-6059-4b2c-afea-42a85a4a3b03"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:08:34.157140 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-9cd92b28-8017-45cb-91f9-48a6a99b2689 req-82196f07-6004-4fd9-acac-9b68311a51cb service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:34.158287 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-9cd92b28-8017-45cb-91f9-48a6a99b2689 req-82196f07-6004-4fd9-acac-9b68311a51cb service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:34.159001 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-9cd92b28-8017-45cb-91f9-48a6a99b2689 req-82196f07-6004-4fd9-acac-9b68311a51cb service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:34.174212 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-9cd92b28-8017-45cb-91f9-48a6a99b2689 req-82196f07-6004-4fd9-acac-9b68311a51cb service nova] Creating event network-vif-plugged:1d119cd0-6059-4b2c-afea-42a85a4a3b03 for instance 62b87810-2125-4803-bd20-74c16a76ef81 on n-h2-860284-1 Oct 04 22:08:34.182028 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-9cd92b28-8017-45cb-91f9-48a6a99b2689 req-82196f07-6004-4fd9-acac-9b68311a51cb service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069173 Oct 04 22:08:34.184026 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2370/4794] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:08:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:08:34.297309 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-45453184-e72d-4c15-9b56-ea2d4f8bc8c2 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:08:34.299988 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-45453184-e72d-4c15-9b56-ea2d4f8bc8c2 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 48243e1b-892b-4c4b-8db1-242b2e40653b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:08:34.316412 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-45453184-e72d-4c15-9b56-ea2d4f8bc8c2 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:34.317358 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-45453184-e72d-4c15-9b56-ea2d4f8bc8c2 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:34.318080 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-45453184-e72d-4c15-9b56-ea2d4f8bc8c2 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:34.320485 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-45453184-e72d-4c15-9b56-ea2d4f8bc8c2 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:34.324242 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-45453184-e72d-4c15-9b56-ea2d4f8bc8c2 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:34.325483 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-45453184-e72d-4c15-9b56-ea2d4f8bc8c2 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:34.387292 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-3034c86c-c253-4056-bdcc-69a0de24a74f tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Flavor limits 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 22:08:34.388454 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-3034c86c-c253-4056-bdcc-69a0de24a74f tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Image limits 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 22:08:34.389257 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-3034c86c-c253-4056-bdcc-69a0de24a74f tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Flavor pref 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 22:08:34.389908 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-3034c86c-c253-4056-bdcc-69a0de24a74f tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Image pref 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 22:08:34.390578 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-3034c86c-c253-4056-bdcc-69a0de24a74f tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 22:08:34.395037 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=4 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:08:34.416376 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3034c86c-c253-4056-bdcc-69a0de24a74f tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:34.425416 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3034c86c-c253-4056-bdcc-69a0de24a74f tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:34.431119 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3034c86c-c253-4056-bdcc-69a0de24a74f tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:34.432503 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3034c86c-c253-4056-bdcc-69a0de24a74f tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:34.436709 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3034c86c-c253-4056-bdcc-69a0de24a74f tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:34.437574 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3034c86c-c253-4056-bdcc-69a0de24a74f tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:34.496395 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-3034c86c-c253-4056-bdcc-69a0de24a74f tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Getting quotas for project f877741b2664498e974791b4952bfc92. Resources: {'instances', 'ram', 'cores'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:08:34.513691 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-3034c86c-c253-4056-bdcc-69a0de24a74f tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Getting quotas for user ed57db002d7b42ea8533ed32b6904c63 and project f877741b2664498e974791b4952bfc92. Resources: {'instances', 'ram', 'cores'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:08:34.723554 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-45453184-e72d-4c15-9b56-ea2d4f8bc8c2 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:08:34.734320 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-45453184-e72d-4c15-9b56-ea2d4f8bc8c2 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b" status: 200 len: 1682 microversion: 2.1 time: 0.441810 Oct 04 22:08:34.742429 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2371/4795] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:08:34 2022] GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b => generated 1682 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:08:34.961699 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-3034c86c-c253-4056-bdcc-69a0de24a74f tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Going to run 1 instances... {{(pid=134102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 22:08:34.965114 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-3034c86c-c253-4056-bdcc-69a0de24a74f tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] [instance: 367dad85-827d-47b0-a468-418d398b36f9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='eca4a5a0-0b49-4495-89b4-920824148e86',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='a182a42b-96d7-4669-a720-bde4fd7303f7',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4eee84d0-3346-441a-8326-ea64f54f11ec',volume_size=None,volume_type=None)] {{(pid=134102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 22:08:35.112601 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-fc45a168-68a1-4b5e-8a77-68757be3e79b tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:08:35.113228 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-fc45a168-68a1-4b5e-8a77-68757be3e79b tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: 62b87810-2125-4803-bd20-74c16a76ef81] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:08:35.156211 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fc45a168-68a1-4b5e-8a77-68757be3e79b tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:35.166954 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fc45a168-68a1-4b5e-8a77-68757be3e79b tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:35.167576 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fc45a168-68a1-4b5e-8a77-68757be3e79b tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:35.168404 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fc45a168-68a1-4b5e-8a77-68757be3e79b tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:35.168926 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fc45a168-68a1-4b5e-8a77-68757be3e79b tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:35.169383 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fc45a168-68a1-4b5e-8a77-68757be3e79b tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:35.391800 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-fc45a168-68a1-4b5e-8a77-68757be3e79b tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1682f1a60045d8a04d4d67393cd13f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b00cd9fa8e40a0919b61fcd60269f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:08:35.404799 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-fc45a168-68a1-4b5e-8a77-68757be3e79b tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "GET /compute/v2.1/servers/62b87810-2125-4803-bd20-74c16a76ef81" status: 200 len: 1292 microversion: 2.1 time: 0.293305 Oct 04 22:08:35.405444 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2372/4796] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:08:35 2022] GET /compute/v2.1/servers/62b87810-2125-4803-bd20-74c16a76ef81 => generated 1292 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:08:35.667933 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-3034c86c-c253-4056-bdcc-69a0de24a74f tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.32 time: 7.519723 Oct 04 22:08:35.669380 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2425/4797] 10.222.0.43 () {62 vars in 1189 bytes} [Tue Oct 4 22:08:28 2022] POST /compute/v2.1/servers => generated 405 bytes in 7522 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 04 22:08:35.681078 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-c8557fb9-cb14-4d8d-bc04-d6b0637994e7 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:08:35.681710 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-c8557fb9-cb14-4d8d-bc04-d6b0637994e7 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] [instance: 367dad85-827d-47b0-a468-418d398b36f9] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:08:35.769974 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-3906706c-fa88-4b37-ab23-5a71a083f9b9 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:08:35.770991 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-3906706c-fa88-4b37-ab23-5a71a083f9b9 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 48243e1b-892b-4c4b-8db1-242b2e40653b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:08:35.796954 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3906706c-fa88-4b37-ab23-5a71a083f9b9 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:35.798599 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3906706c-fa88-4b37-ab23-5a71a083f9b9 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:35.801261 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3906706c-fa88-4b37-ab23-5a71a083f9b9 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:35.802122 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3906706c-fa88-4b37-ab23-5a71a083f9b9 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:35.803895 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3906706c-fa88-4b37-ab23-5a71a083f9b9 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:35.803895 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3906706c-fa88-4b37-ab23-5a71a083f9b9 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:35.833720 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-c8557fb9-cb14-4d8d-bc04-d6b0637994e7 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:08:35.846107 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-c8557fb9-cb14-4d8d-bc04-d6b0637994e7 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:08:35.851352 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-c8557fb9-cb14-4d8d-bc04-d6b0637994e7 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:08:35.859312 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-c8557fb9-cb14-4d8d-bc04-d6b0637994e7 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] 10.222.0.43 "GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9" status: 200 len: 1285 microversion: 2.32 time: 0.182199 Oct 04 22:08:35.882900 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2373/4798] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:08:35 2022] GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9 => generated 1285 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:08:36.106082 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-3906706c-fa88-4b37-ab23-5a71a083f9b9 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:08:36.116900 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-3906706c-fa88-4b37-ab23-5a71a083f9b9 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b" status: 200 len: 1682 microversion: 2.1 time: 0.350733 Oct 04 22:08:36.143218 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2426/4799] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:08:35 2022] GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b => generated 1682 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:08:36.431605 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-04e1ca35-09b8-4b53-8e3c-0c43d585c6d0 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:08:36.432227 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-04e1ca35-09b8-4b53-8e3c-0c43d585c6d0 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: 62b87810-2125-4803-bd20-74c16a76ef81] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:08:36.445277 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-04e1ca35-09b8-4b53-8e3c-0c43d585c6d0 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:36.455893 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-04e1ca35-09b8-4b53-8e3c-0c43d585c6d0 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:36.460043 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-04e1ca35-09b8-4b53-8e3c-0c43d585c6d0 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:36.464338 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-04e1ca35-09b8-4b53-8e3c-0c43d585c6d0 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:36.467772 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-04e1ca35-09b8-4b53-8e3c-0c43d585c6d0 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:36.468635 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-04e1ca35-09b8-4b53-8e3c-0c43d585c6d0 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:36.729420 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-04e1ca35-09b8-4b53-8e3c-0c43d585c6d0 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1682f1a60045d8a04d4d67393cd13f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b00cd9fa8e40a0919b61fcd60269f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:08:36.741748 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-04e1ca35-09b8-4b53-8e3c-0c43d585c6d0 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "GET /compute/v2.1/servers/62b87810-2125-4803-bd20-74c16a76ef81" status: 200 len: 1292 microversion: 2.1 time: 0.313958 Oct 04 22:08:36.742863 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2374/4800] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:08:36 2022] GET /compute/v2.1/servers/62b87810-2125-4803-bd20-74c16a76ef81 => generated 1292 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:08:36.895398 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-4e0a47dd-648f-4d27-832b-68641cbe48fa tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:08:36.897476 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-4e0a47dd-648f-4d27-832b-68641cbe48fa tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] [instance: 367dad85-827d-47b0-a468-418d398b36f9] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:08:37.129894 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-4e0a47dd-648f-4d27-832b-68641cbe48fa tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:08:37.145578 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-360cda9f-f4d4-47f9-9994-1aa6decb8ab7 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:08:37.146304 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-360cda9f-f4d4-47f9-9994-1aa6decb8ab7 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 48243e1b-892b-4c4b-8db1-242b2e40653b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:08:37.159503 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-4e0a47dd-648f-4d27-832b-68641cbe48fa tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:08:37.170391 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-360cda9f-f4d4-47f9-9994-1aa6decb8ab7 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:37.172489 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-4e0a47dd-648f-4d27-832b-68641cbe48fa tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:08:37.177523 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-360cda9f-f4d4-47f9-9994-1aa6decb8ab7 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:37.181878 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-360cda9f-f4d4-47f9-9994-1aa6decb8ab7 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:37.185032 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-360cda9f-f4d4-47f9-9994-1aa6decb8ab7 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:37.185592 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-4e0a47dd-648f-4d27-832b-68641cbe48fa tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] 10.222.0.43 "GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9" status: 200 len: 1285 microversion: 2.32 time: 0.295983 Oct 04 22:08:37.187648 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-360cda9f-f4d4-47f9-9994-1aa6decb8ab7 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:37.188335 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2427/4801] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:08:36 2022] GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9 => generated 1285 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:08:37.189551 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-360cda9f-f4d4-47f9-9994-1aa6decb8ab7 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:37.504804 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-360cda9f-f4d4-47f9-9994-1aa6decb8ab7 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:08:37.518186 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-360cda9f-f4d4-47f9-9994-1aa6decb8ab7 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b" status: 200 len: 1682 microversion: 2.1 time: 0.376204 Oct 04 22:08:37.519041 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2375/4802] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:08:37 2022] GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b => generated 1682 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:08:37.770710 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-a9fd4f15-621a-4258-b8ef-abb623ec9135 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:08:37.771642 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-a9fd4f15-621a-4258-b8ef-abb623ec9135 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: 62b87810-2125-4803-bd20-74c16a76ef81] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:08:37.785959 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a9fd4f15-621a-4258-b8ef-abb623ec9135 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:37.786859 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a9fd4f15-621a-4258-b8ef-abb623ec9135 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:37.787812 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a9fd4f15-621a-4258-b8ef-abb623ec9135 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:37.790451 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a9fd4f15-621a-4258-b8ef-abb623ec9135 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:37.800007 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a9fd4f15-621a-4258-b8ef-abb623ec9135 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:37.800680 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a9fd4f15-621a-4258-b8ef-abb623ec9135 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:38.222348 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-d478400e-47a1-4893-bc17-37b5b5ed69ef tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:08:38.222932 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-d478400e-47a1-4893-bc17-37b5b5ed69ef tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] [instance: 367dad85-827d-47b0-a468-418d398b36f9] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:08:38.240430 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d478400e-47a1-4893-bc17-37b5b5ed69ef tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:38.240938 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d478400e-47a1-4893-bc17-37b5b5ed69ef tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:38.241398 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d478400e-47a1-4893-bc17-37b5b5ed69ef tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:38.254338 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d478400e-47a1-4893-bc17-37b5b5ed69ef tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:38.258819 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d478400e-47a1-4893-bc17-37b5b5ed69ef tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:38.259409 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d478400e-47a1-4893-bc17-37b5b5ed69ef tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:38.480935 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-d478400e-47a1-4893-bc17-37b5b5ed69ef tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:08:38.492809 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-a9fd4f15-621a-4258-b8ef-abb623ec9135 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1682f1a60045d8a04d4d67393cd13f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b00cd9fa8e40a0919b61fcd60269f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:08:38.505501 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-a9fd4f15-621a-4258-b8ef-abb623ec9135 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "GET /compute/v2.1/servers/62b87810-2125-4803-bd20-74c16a76ef81" status: 200 len: 1473 microversion: 2.1 time: 0.738410 Oct 04 22:08:38.510345 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2428/4803] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:08:37 2022] GET /compute/v2.1/servers/62b87810-2125-4803-bd20-74c16a76ef81 => generated 1473 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:08:38.526639 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-d478400e-47a1-4893-bc17-37b5b5ed69ef tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:08:38.538132 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-d478400e-47a1-4893-bc17-37b5b5ed69ef tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:08:38.542954 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-024f79aa-ea15-460a-984a-8b905879697e tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:08:38.543821 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-024f79aa-ea15-460a-984a-8b905879697e tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 48243e1b-892b-4c4b-8db1-242b2e40653b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:08:38.553063 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-024f79aa-ea15-460a-984a-8b905879697e tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:38.553865 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-024f79aa-ea15-460a-984a-8b905879697e tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:38.554689 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-024f79aa-ea15-460a-984a-8b905879697e tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:38.555634 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-024f79aa-ea15-460a-984a-8b905879697e tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:38.556336 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-024f79aa-ea15-460a-984a-8b905879697e tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:38.557111 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-024f79aa-ea15-460a-984a-8b905879697e tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:38.559589 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-d478400e-47a1-4893-bc17-37b5b5ed69ef tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] 10.222.0.43 "GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9" status: 200 len: 1575 microversion: 2.32 time: 0.343556 Oct 04 22:08:38.574406 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2376/4804] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:08:38 2022] GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9 => generated 1575 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:08:38.685183 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e62d0755-d174-403c-b1a0-a709c96b9611 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1553412834", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:08:38.840692 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.network.neutron [None req-e62d0755-d174-403c-b1a0-a709c96b9611 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] validate_networks() for [('3e97795f-9423-4034-b566-4a70497d6dcc', None, None, None, None, None)] {{(pid=134101) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 22:08:39.760947 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-024f79aa-ea15-460a-984a-8b905879697e tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:08:39.769387 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-024f79aa-ea15-460a-984a-8b905879697e tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b" status: 200 len: 1682 microversion: 2.1 time: 1.231489 Oct 04 22:08:39.769993 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2429/4805] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:08:38 2022] GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b => generated 1682 bytes in 1233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:08:39.792177 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-1a637fa5-1043-466d-b65f-ba92b27426d5 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:08:39.793114 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-1a637fa5-1043-466d-b65f-ba92b27426d5 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] [instance: 367dad85-827d-47b0-a468-418d398b36f9] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:08:39.801856 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1a637fa5-1043-466d-b65f-ba92b27426d5 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:39.802705 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1a637fa5-1043-466d-b65f-ba92b27426d5 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:39.803352 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1a637fa5-1043-466d-b65f-ba92b27426d5 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:39.804260 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1a637fa5-1043-466d-b65f-ba92b27426d5 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:39.804947 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1a637fa5-1043-466d-b65f-ba92b27426d5 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:39.805584 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1a637fa5-1043-466d-b65f-ba92b27426d5 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:39.981776 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-1a637fa5-1043-466d-b65f-ba92b27426d5 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:08:40.004304 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-1a637fa5-1043-466d-b65f-ba92b27426d5 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:08:40.006453 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-1a637fa5-1043-466d-b65f-ba92b27426d5 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:08:40.012573 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-1a637fa5-1043-466d-b65f-ba92b27426d5 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] 10.222.0.43 "GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9" status: 200 len: 1593 microversion: 2.32 time: 0.235079 Oct 04 22:08:40.013989 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2430/4806] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:08:39 2022] GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9 => generated 1593 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:08:40.800586 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-d184901a-c580-4cb5-bd3e-cd969083c6f5 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:08:40.801227 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-d184901a-c580-4cb5-bd3e-cd969083c6f5 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 48243e1b-892b-4c4b-8db1-242b2e40653b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:08:40.817450 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d184901a-c580-4cb5-bd3e-cd969083c6f5 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:40.818507 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d184901a-c580-4cb5-bd3e-cd969083c6f5 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:40.819159 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d184901a-c580-4cb5-bd3e-cd969083c6f5 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:40.821022 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d184901a-c580-4cb5-bd3e-cd969083c6f5 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:40.821518 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d184901a-c580-4cb5-bd3e-cd969083c6f5 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:40.821967 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d184901a-c580-4cb5-bd3e-cd969083c6f5 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:40.840212 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-e62d0755-d174-403c-b1a0-a709c96b9611 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Flavor limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 22:08:40.841379 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-e62d0755-d174-403c-b1a0-a709c96b9611 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Image limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 22:08:40.842126 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-e62d0755-d174-403c-b1a0-a709c96b9611 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Flavor pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 22:08:40.842801 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-e62d0755-d174-403c-b1a0-a709c96b9611 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Image pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 22:08:40.843453 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-e62d0755-d174-403c-b1a0-a709c96b9611 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 22:08:40.865081 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e62d0755-d174-403c-b1a0-a709c96b9611 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:40.865975 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e62d0755-d174-403c-b1a0-a709c96b9611 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:40.866724 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e62d0755-d174-403c-b1a0-a709c96b9611 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:40.867724 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e62d0755-d174-403c-b1a0-a709c96b9611 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:40.871253 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e62d0755-d174-403c-b1a0-a709c96b9611 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:40.872028 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e62d0755-d174-403c-b1a0-a709c96b9611 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:40.921295 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-e62d0755-d174-403c-b1a0-a709c96b9611 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Getting quotas for project d4b00cd9fa8e40a0919b61fcd60269f5. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:08:40.930466 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-e62d0755-d174-403c-b1a0-a709c96b9611 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Getting quotas for user 9c1682f1a60045d8a04d4d67393cd13f and project d4b00cd9fa8e40a0919b61fcd60269f5. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:08:40.960359 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-e62d0755-d174-403c-b1a0-a709c96b9611 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Going to run 1 instances... {{(pid=134101) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 22:08:40.963787 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-e62d0755-d174-403c-b1a0-a709c96b9611 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: 62fc3d46-cf76-43a9-b7ed-ce6b76104d8d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='58548514-5dac-426c-81f5-19e3fba33e23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134101) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 22:08:41.054770 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-e62d0755-d174-403c-b1a0-a709c96b9611 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.387012 Oct 04 22:08:41.065905 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2377/4807] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 22:08:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 2399 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 22:08:41.071462 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-b9fd82eb-caf8-44d4-8062-dc943881e61a tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:08:41.075281 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-b9fd82eb-caf8-44d4-8062-dc943881e61a tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] [instance: 367dad85-827d-47b0-a468-418d398b36f9] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:08:41.102941 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b9fd82eb-caf8-44d4-8062-dc943881e61a tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:41.103702 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b9fd82eb-caf8-44d4-8062-dc943881e61a tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:41.104380 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b9fd82eb-caf8-44d4-8062-dc943881e61a tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:41.105458 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b9fd82eb-caf8-44d4-8062-dc943881e61a tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:41.106279 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b9fd82eb-caf8-44d4-8062-dc943881e61a tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:41.107433 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b9fd82eb-caf8-44d4-8062-dc943881e61a tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:41.154211 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:08:41.289156 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-b9fd82eb-caf8-44d4-8062-dc943881e61a tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:08:41.319197 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-b9fd82eb-caf8-44d4-8062-dc943881e61a tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:08:41.327990 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-b9fd82eb-caf8-44d4-8062-dc943881e61a tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:08:41.329419 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-b9fd82eb-caf8-44d4-8062-dc943881e61a tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] 10.222.0.43 "GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9" status: 200 len: 1593 microversion: 2.32 time: 0.261990 Oct 04 22:08:41.366449 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2378/4808] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:08:41 2022] GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9 => generated 1593 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:08:41.366449 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-08f62f70-7feb-44c3-9469-66be46d00d79 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:08:41.366449 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-08f62f70-7feb-44c3-9469-66be46d00d79 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: 62fc3d46-cf76-43a9-b7ed-ce6b76104d8d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:08:41.410833 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-08f62f70-7feb-44c3-9469-66be46d00d79 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: 62fc3d46-cf76-43a9-b7ed-ce6b76104d8d] Going to try to terminate instance {{(pid=134101) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 22:08:41.658153 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-d184901a-c580-4cb5-bd3e-cd969083c6f5 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:08:41.676156 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-d184901a-c580-4cb5-bd3e-cd969083c6f5 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b" status: 200 len: 1682 microversion: 2.1 time: 0.882544 Oct 04 22:08:41.693743 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2431/4809] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:08:40 2022] GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b => generated 1682 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:08:41.723556 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.scheduler.client.report [None req-08f62f70-7feb-44c3-9469-66be46d00d79 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Deleted allocations for instance 62fc3d46-cf76-43a9-b7ed-ce6b76104d8d Oct 04 22:08:41.730046 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.compute.api [None req-08f62f70-7feb-44c3-9469-66be46d00d79 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: 62fc3d46-cf76-43a9-b7ed-ce6b76104d8d] Instance Mapping does not exist while attempting local delete cleanup. Oct 04 22:08:41.731069 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-08f62f70-7feb-44c3-9469-66be46d00d79 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "DELETE /compute/v2.1/servers/62fc3d46-cf76-43a9-b7ed-ce6b76104d8d" status: 204 len: 0 microversion: 2.1 time: 0.378701 Oct 04 22:08:41.736917 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2379/4810] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 22:08:41 2022] DELETE /compute/v2.1/servers/62fc3d46-cf76-43a9-b7ed-ce6b76104d8d => generated 0 bytes in 384 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 22:08:41.755307 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-ad81321f-b688-4cdb-939f-f5a59731aa18 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:08:41.756574 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-ad81321f-b688-4cdb-939f-f5a59731aa18 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: 62fc3d46-cf76-43a9-b7ed-ce6b76104d8d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:08:41.766048 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-ad81321f-b688-4cdb-939f-f5a59731aa18 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] HTTP exception thrown: Instance 62fc3d46-cf76-43a9-b7ed-ce6b76104d8d could not be found. Oct 04 22:08:41.769778 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-ad81321f-b688-4cdb-939f-f5a59731aa18 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Request method failure captured: Oct 04 22:08:41.769778 n-d-860284-1 devstack@n-api.service[134102]: request: GET /compute/v2.1/servers/62fc3d46-cf76-43a9-b7ed-ce6b76104d8d HTTP/1.1 Oct 04 22:08:41.769778 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 22:08:41.769778 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 22:08:41.769778 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 22:08:41.769778 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 22:08:41.769778 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 22:08:41.769778 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 22:08:41.769778 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 22:08:41.769778 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 22:08:41.769778 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPK7MP0-m-xtUnxXwLoxlIfO4jzoQOT6GMi-_9Rz-dG646c6MuQMOjiOhGtcOohb2ZIUdejR42Va0IkiFMBDtdnbnUEdF8Psxz0uHfYGBQiEZpqo4CpOHPpz5KjUxS1LmPgcFnegJZtGQu1irxi49GMeHkm9nnXbxd63druWj1zFChJ4 Oct 04 22:08:41.769778 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 22:08:41.769778 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 22:08:41.769778 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 22:08:41.769778 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 22:08:41.769778 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 22:08:41.769778 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 22:08:41.769778 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: d4b00cd9fa8e40a0919b61fcd60269f5 Oct 04 22:08:41.769778 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-ServersTestJSON-1600369848 Oct 04 22:08:41.769778 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 22:08:41.769778 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 22:08:41.769778 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d4b00cd9fa8e40a0919b61fcd60269f5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_d4b00cd9fa8e40a0919b61fcd60269f5", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d4b00cd9fa8e40a0919b61fcd60269f5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/d4b00cd9fa8e40a0919b61fcd60269f5"}]}] Oct 04 22:08:41.769778 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-ServersTestJSON-1600369848 Oct 04 22:08:41.769778 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: d4b00cd9fa8e40a0919b61fcd60269f5 Oct 04 22:08:41.769778 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-ServersTestJSON-1600369848 Oct 04 22:08:41.769778 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-ServersTestJSON-1600369848-project Oct 04 22:08:41.769778 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 22:08:41.769778 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 22:08:41.769778 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: 9c1682f1a60045d8a04d4d67393cd13f Oct 04 22:08:41.769778 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-ServersTestJSON-1600369848-project Oct 04 22:08:41.769778 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 22:08:41.769778 n-d-860284-1 devstack@n-api.service[134102]: exception: Instance 62fc3d46-cf76-43a9-b7ed-ce6b76104d8d could not be found. Oct 04 22:08:41.769778 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': '62fc3d46-cf76-43a9-b7ed-ce6b76104d8d'} Oct 04 22:08:41.769778 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:08:41.769778 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:08:41.769778 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:08:41.769778 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:08:41.769778 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:08:41.769778 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:08:41.769778 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 22:08:41.769778 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 22:08:41.769778 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62fc3d46-cf76-43a9-b7ed-ce6b76104d8d could not be found. Oct 04 22:08:41.769778 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:08:41.769778 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:08:41.769778 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:08:41.769778 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:08:41.769778 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:08:41.769778 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:08:41.769778 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:08:41.769778 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:08:41.769778 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:08:41.769778 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:08:41.769778 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:08:41.769778 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:08:41.769778 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:08:41.769778 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:08:41.769778 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:08:41.769778 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:08:41.769778 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62fc3d46-cf76-43a9-b7ed-ce6b76104d8d could not be found. Oct 04 22:08:41.769778 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:08:41.769778 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:08:41.769778 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:08:41.769778 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:08:41.769778 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:08:41.775862 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:08:41.775862 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:08:41.775862 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:08:41.775862 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62fc3d46-cf76-43a9-b7ed-ce6b76104d8d could not be found. Oct 04 22:08:41.775862 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:08:41.775862 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-ad81321f-b688-4cdb-939f-f5a59731aa18 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Returning 404 to user: Instance 62fc3d46-cf76-43a9-b7ed-ce6b76104d8d could not be found. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:08:41.775862 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-ad81321f-b688-4cdb-939f-f5a59731aa18 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "GET /compute/v2.1/servers/62fc3d46-cf76-43a9-b7ed-ce6b76104d8d" status: 404 len: 111 microversion: 2.1 time: 0.031072 Oct 04 22:08:41.775862 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2432/4811] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:08:41 2022] GET /compute/v2.1/servers/62fc3d46-cf76-43a9-b7ed-ce6b76104d8d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:08:41.908114 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-012d0efa-30b2-447f-8a02-9ca23463ee2e tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1468506039", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "3e97795f-9423-4034-b566-4a70497d6dcc"}]}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:08:42.047609 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.network.neutron [None req-012d0efa-30b2-447f-8a02-9ca23463ee2e tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] validate_networks() for [('3e97795f-9423-4034-b566-4a70497d6dcc', None, None, None, None, None)] {{(pid=134101) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 22:08:42.386259 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-afbdeadb-f848-4193-917c-f55d5826b1bc tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:08:42.387026 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-afbdeadb-f848-4193-917c-f55d5826b1bc tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] [instance: 367dad85-827d-47b0-a468-418d398b36f9] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:08:42.411524 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-afbdeadb-f848-4193-917c-f55d5826b1bc tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:42.415118 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-afbdeadb-f848-4193-917c-f55d5826b1bc tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:42.431127 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-afbdeadb-f848-4193-917c-f55d5826b1bc tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:42.433510 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-afbdeadb-f848-4193-917c-f55d5826b1bc tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:42.438386 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-afbdeadb-f848-4193-917c-f55d5826b1bc tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:42.439972 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-afbdeadb-f848-4193-917c-f55d5826b1bc tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:43.233382 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-afbdeadb-f848-4193-917c-f55d5826b1bc tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:08:43.264885 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-afbdeadb-f848-4193-917c-f55d5826b1bc tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:08:43.269766 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-afbdeadb-f848-4193-917c-f55d5826b1bc tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:08:43.275628 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-afbdeadb-f848-4193-917c-f55d5826b1bc tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] 10.222.0.43 "GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9" status: 200 len: 1660 microversion: 2.32 time: 0.895997 Oct 04 22:08:43.276407 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2433/4812] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:08:42 2022] GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9 => generated 1660 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:08:43.288586 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-13284928-732a-4351-a350-f249232425fc tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:08:43.289540 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-13284928-732a-4351-a350-f249232425fc tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 48243e1b-892b-4c4b-8db1-242b2e40653b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:08:43.302544 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-13284928-732a-4351-a350-f249232425fc tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:43.304875 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-13284928-732a-4351-a350-f249232425fc tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:43.305553 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-13284928-732a-4351-a350-f249232425fc tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:43.306410 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-13284928-732a-4351-a350-f249232425fc tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:43.308581 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-13284928-732a-4351-a350-f249232425fc tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:43.311677 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-13284928-732a-4351-a350-f249232425fc tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:43.738582 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-012d0efa-30b2-447f-8a02-9ca23463ee2e tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Flavor limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 22:08:43.739140 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-012d0efa-30b2-447f-8a02-9ca23463ee2e tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Image limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 22:08:43.739644 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-012d0efa-30b2-447f-8a02-9ca23463ee2e tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Flavor pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 22:08:43.740394 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-012d0efa-30b2-447f-8a02-9ca23463ee2e tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Image pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 22:08:43.740908 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-012d0efa-30b2-447f-8a02-9ca23463ee2e tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 22:08:43.763092 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-012d0efa-30b2-447f-8a02-9ca23463ee2e tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:43.763592 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-012d0efa-30b2-447f-8a02-9ca23463ee2e tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:43.764040 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-012d0efa-30b2-447f-8a02-9ca23463ee2e tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:43.764799 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-012d0efa-30b2-447f-8a02-9ca23463ee2e tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:43.765429 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-012d0efa-30b2-447f-8a02-9ca23463ee2e tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:43.765873 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-012d0efa-30b2-447f-8a02-9ca23463ee2e tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:43.804153 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-012d0efa-30b2-447f-8a02-9ca23463ee2e tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Getting quotas for project d4b00cd9fa8e40a0919b61fcd60269f5. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:08:43.816395 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-012d0efa-30b2-447f-8a02-9ca23463ee2e tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Getting quotas for user 9c1682f1a60045d8a04d4d67393cd13f and project d4b00cd9fa8e40a0919b61fcd60269f5. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:08:43.848970 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-012d0efa-30b2-447f-8a02-9ca23463ee2e tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Going to run 1 instances... {{(pid=134101) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 22:08:43.858922 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-012d0efa-30b2-447f-8a02-9ca23463ee2e tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: 3b565a7d-fde0-47e5-99b9-1ed5ba9aab93] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='58548514-5dac-426c-81f5-19e3fba33e23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134101) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 22:08:43.983756 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-012d0efa-30b2-447f-8a02-9ca23463ee2e tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.084916 Oct 04 22:08:43.987389 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2380/4813] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 22:08:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 2090 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 22:08:43.999469 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-2037993f-c689-470e-a3cb-4d92b8221c0d tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:08:44.004188 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-2037993f-c689-470e-a3cb-4d92b8221c0d tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: 3b565a7d-fde0-47e5-99b9-1ed5ba9aab93] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:08:44.111087 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-2037993f-c689-470e-a3cb-4d92b8221c0d tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1682f1a60045d8a04d4d67393cd13f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b00cd9fa8e40a0919b61fcd60269f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:08:44.122279 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-2037993f-c689-470e-a3cb-4d92b8221c0d tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "GET /compute/v2.1/servers/3b565a7d-fde0-47e5-99b9-1ed5ba9aab93" status: 200 len: 1221 microversion: 2.1 time: 0.127826 Oct 04 22:08:44.131122 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2381/4814] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:08:43 2022] GET /compute/v2.1/servers/3b565a7d-fde0-47e5-99b9-1ed5ba9aab93 => generated 1221 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:08:44.307822 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-2d07a3dc-b6fa-4498-8b1b-15f9ed24d718 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:08:44.308815 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-2d07a3dc-b6fa-4498-8b1b-15f9ed24d718 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] [instance: 367dad85-827d-47b0-a468-418d398b36f9] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:08:44.319053 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-13284928-732a-4351-a350-f249232425fc tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:08:44.332147 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-13284928-732a-4351-a350-f249232425fc tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b" status: 200 len: 1669 microversion: 2.1 time: 1.054511 Oct 04 22:08:44.346407 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2434/4815] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:08:43 2022] GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b => generated 1669 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:08:44.348355 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2d07a3dc-b6fa-4498-8b1b-15f9ed24d718 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:44.348938 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2d07a3dc-b6fa-4498-8b1b-15f9ed24d718 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:44.349397 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2d07a3dc-b6fa-4498-8b1b-15f9ed24d718 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:44.350132 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2d07a3dc-b6fa-4498-8b1b-15f9ed24d718 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:44.358039 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2d07a3dc-b6fa-4498-8b1b-15f9ed24d718 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:44.359136 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2d07a3dc-b6fa-4498-8b1b-15f9ed24d718 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:44.625272 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-249c638a-897b-4155-969b-1e038a9134cf tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:08:44.626003 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-249c638a-897b-4155-969b-1e038a9134cf tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 48243e1b-892b-4c4b-8db1-242b2e40653b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:08:44.630657 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell0:SELECT=2 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:08:44.644072 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-249c638a-897b-4155-969b-1e038a9134cf tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:44.644512 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-249c638a-897b-4155-969b-1e038a9134cf tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:44.646186 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-249c638a-897b-4155-969b-1e038a9134cf tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:44.650634 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-249c638a-897b-4155-969b-1e038a9134cf tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:44.651283 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-249c638a-897b-4155-969b-1e038a9134cf tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:44.652656 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-249c638a-897b-4155-969b-1e038a9134cf tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:45.578248 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-2d07a3dc-b6fa-4498-8b1b-15f9ed24d718 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:08:45.592277 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-2d07a3dc-b6fa-4498-8b1b-15f9ed24d718 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:08:45.595299 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-2d07a3dc-b6fa-4498-8b1b-15f9ed24d718 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:08:45.603217 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-2d07a3dc-b6fa-4498-8b1b-15f9ed24d718 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] 10.222.0.43 "GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9" status: 200 len: 1660 microversion: 2.32 time: 1.299941 Oct 04 22:08:45.604181 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2382/4816] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:08:44 2022] GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9 => generated 1660 bytes in 1302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 22:08:45.614006 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-3a51ca12-0376-4c04-9262-99725c8fabe7 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:08:45.615059 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-3a51ca12-0376-4c04-9262-99725c8fabe7 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: 3b565a7d-fde0-47e5-99b9-1ed5ba9aab93] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:08:45.644686 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3a51ca12-0376-4c04-9262-99725c8fabe7 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:45.645550 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3a51ca12-0376-4c04-9262-99725c8fabe7 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:45.646240 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3a51ca12-0376-4c04-9262-99725c8fabe7 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:45.648281 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3a51ca12-0376-4c04-9262-99725c8fabe7 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:45.649118 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3a51ca12-0376-4c04-9262-99725c8fabe7 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:45.649838 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3a51ca12-0376-4c04-9262-99725c8fabe7 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:45.659636 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-249c638a-897b-4155-969b-1e038a9134cf tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:08:45.692041 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-249c638a-897b-4155-969b-1e038a9134cf tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b" status: 200 len: 1669 microversion: 2.1 time: 1.060905 Oct 04 22:08:45.694476 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2435/4817] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:08:44 2022] GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b => generated 1669 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:08:45.711056 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-790f2aee-ddad-42a5-9ca1-4c36c7c82d67 req-ac46004f-da55-43d0-9afd-5651b884d7a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48243e1b-892b-4c4b-8db1-242b2e40653b", "name": "network-vif-unplugged", "status": "completed", "tag": "a795c088-46ba-4a15-a651-33aa842e29b5"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:08:45.738002 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-790f2aee-ddad-42a5-9ca1-4c36c7c82d67 req-ac46004f-da55-43d0-9afd-5651b884d7a2 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:45.753453 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-790f2aee-ddad-42a5-9ca1-4c36c7c82d67 req-ac46004f-da55-43d0-9afd-5651b884d7a2 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:45.755436 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-790f2aee-ddad-42a5-9ca1-4c36c7c82d67 req-ac46004f-da55-43d0-9afd-5651b884d7a2 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:45.789982 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-790f2aee-ddad-42a5-9ca1-4c36c7c82d67 req-ac46004f-da55-43d0-9afd-5651b884d7a2 service nova] Creating event network-vif-unplugged:a795c088-46ba-4a15-a651-33aa842e29b5 for instance 48243e1b-892b-4c4b-8db1-242b2e40653b on n-h1-860284-1 Oct 04 22:08:45.803794 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-790f2aee-ddad-42a5-9ca1-4c36c7c82d67 req-ac46004f-da55-43d0-9afd-5651b884d7a2 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.103502 Oct 04 22:08:45.818567 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2436/4818] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:08:45 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:08:45.843129 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-3a51ca12-0376-4c04-9262-99725c8fabe7 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1682f1a60045d8a04d4d67393cd13f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b00cd9fa8e40a0919b61fcd60269f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:08:45.856097 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-3a51ca12-0376-4c04-9262-99725c8fabe7 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "GET /compute/v2.1/servers/3b565a7d-fde0-47e5-99b9-1ed5ba9aab93" status: 200 len: 1273 microversion: 2.1 time: 0.250384 Oct 04 22:08:45.856941 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2383/4819] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:08:45 2022] GET /compute/v2.1/servers/3b565a7d-fde0-47e5-99b9-1ed5ba9aab93 => generated 1273 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:08:46.645718 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-4ebddd0e-972b-4258-85e4-e1330b78528f tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:08:46.647232 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-4ebddd0e-972b-4258-85e4-e1330b78528f tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] [instance: 367dad85-827d-47b0-a468-418d398b36f9] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:08:46.676016 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4ebddd0e-972b-4258-85e4-e1330b78528f tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:46.677767 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4ebddd0e-972b-4258-85e4-e1330b78528f tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:46.679258 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4ebddd0e-972b-4258-85e4-e1330b78528f tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:46.680438 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4ebddd0e-972b-4258-85e4-e1330b78528f tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:46.681010 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4ebddd0e-972b-4258-85e4-e1330b78528f tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:46.682681 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4ebddd0e-972b-4258-85e4-e1330b78528f tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:46.880921 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e68ef5ec-e44e-4df9-80bf-25b9328344ab tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:08:46.882290 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-e68ef5ec-e44e-4df9-80bf-25b9328344ab tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: 3b565a7d-fde0-47e5-99b9-1ed5ba9aab93] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:08:46.891870 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e68ef5ec-e44e-4df9-80bf-25b9328344ab tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:46.899190 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e68ef5ec-e44e-4df9-80bf-25b9328344ab tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:46.900242 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e68ef5ec-e44e-4df9-80bf-25b9328344ab tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:46.901332 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e68ef5ec-e44e-4df9-80bf-25b9328344ab tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:46.902048 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e68ef5ec-e44e-4df9-80bf-25b9328344ab tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:46.902808 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e68ef5ec-e44e-4df9-80bf-25b9328344ab tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:47.137824 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell0:SELECT=8 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:08:47.255007 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-e68ef5ec-e44e-4df9-80bf-25b9328344ab tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1682f1a60045d8a04d4d67393cd13f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b00cd9fa8e40a0919b61fcd60269f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:08:47.271998 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-e68ef5ec-e44e-4df9-80bf-25b9328344ab tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "GET /compute/v2.1/servers/3b565a7d-fde0-47e5-99b9-1ed5ba9aab93" status: 200 len: 1279 microversion: 2.1 time: 0.395816 Oct 04 22:08:47.272611 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2384/4820] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:08:46 2022] GET /compute/v2.1/servers/3b565a7d-fde0-47e5-99b9-1ed5ba9aab93 => generated 1279 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:08:47.553456 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-4ebddd0e-972b-4258-85e4-e1330b78528f tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:08:47.592367 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-4ebddd0e-972b-4258-85e4-e1330b78528f tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:08:47.596609 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-4ebddd0e-972b-4258-85e4-e1330b78528f tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:08:47.603368 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-3f7068af-c0f9-46c6-8cd6-846771e0f16e tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:08:47.604004 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-3f7068af-c0f9-46c6-8cd6-846771e0f16e tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 48243e1b-892b-4c4b-8db1-242b2e40653b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:08:47.605612 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-4ebddd0e-972b-4258-85e4-e1330b78528f tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] 10.222.0.43 "GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9" status: 200 len: 1706 microversion: 2.32 time: 0.973340 Oct 04 22:08:47.608472 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2437/4821] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:08:46 2022] GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9 => generated 1706 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:08:47.664422 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3f7068af-c0f9-46c6-8cd6-846771e0f16e tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:47.665627 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3f7068af-c0f9-46c6-8cd6-846771e0f16e tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:47.666991 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3f7068af-c0f9-46c6-8cd6-846771e0f16e tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:47.671593 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3f7068af-c0f9-46c6-8cd6-846771e0f16e tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:47.672396 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3f7068af-c0f9-46c6-8cd6-846771e0f16e tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:47.674184 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3f7068af-c0f9-46c6-8cd6-846771e0f16e tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:48.077310 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-3f7068af-c0f9-46c6-8cd6-846771e0f16e tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:08:48.094966 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-3f7068af-c0f9-46c6-8cd6-846771e0f16e tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b" status: 200 len: 1669 microversion: 2.1 time: 0.517359 Oct 04 22:08:48.109235 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2385/4822] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:08:47 2022] GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b => generated 1669 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:08:48.135554 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-ddb091de-5b30-4c9e-9f34-0d00aa945449 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:08:48.137194 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-ddb091de-5b30-4c9e-9f34-0d00aa945449 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 48243e1b-892b-4c4b-8db1-242b2e40653b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:08:48.163522 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ddb091de-5b30-4c9e-9f34-0d00aa945449 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:48.169637 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ddb091de-5b30-4c9e-9f34-0d00aa945449 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:48.170340 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ddb091de-5b30-4c9e-9f34-0d00aa945449 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:48.172307 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ddb091de-5b30-4c9e-9f34-0d00aa945449 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:48.173499 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ddb091de-5b30-4c9e-9f34-0d00aa945449 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:48.174135 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ddb091de-5b30-4c9e-9f34-0d00aa945449 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:48.306080 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-287b3c7b-4324-4ea6-bad5-6d37afdda939 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:08:48.308193 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-287b3c7b-4324-4ea6-bad5-6d37afdda939 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: 3b565a7d-fde0-47e5-99b9-1ed5ba9aab93] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:08:48.318972 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-287b3c7b-4324-4ea6-bad5-6d37afdda939 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:48.320093 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-287b3c7b-4324-4ea6-bad5-6d37afdda939 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:48.320820 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-287b3c7b-4324-4ea6-bad5-6d37afdda939 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:48.321894 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-287b3c7b-4324-4ea6-bad5-6d37afdda939 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:48.322588 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-287b3c7b-4324-4ea6-bad5-6d37afdda939 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:48.323283 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-287b3c7b-4324-4ea6-bad5-6d37afdda939 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:48.541533 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-287b3c7b-4324-4ea6-bad5-6d37afdda939 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1682f1a60045d8a04d4d67393cd13f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b00cd9fa8e40a0919b61fcd60269f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:08:48.565250 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-ddb091de-5b30-4c9e-9f34-0d00aa945449 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:08:48.586017 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-ddb091de-5b30-4c9e-9f34-0d00aa945449 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b" status: 200 len: 1669 microversion: 2.1 time: 0.462825 Oct 04 22:08:48.593476 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2438/4823] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:08:48 2022] GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b => generated 1669 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:08:48.595206 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-287b3c7b-4324-4ea6-bad5-6d37afdda939 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "GET /compute/v2.1/servers/3b565a7d-fde0-47e5-99b9-1ed5ba9aab93" status: 200 len: 1279 microversion: 2.1 time: 0.293863 Oct 04 22:08:48.597168 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2386/4824] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:08:48 2022] GET /compute/v2.1/servers/3b565a7d-fde0-47e5-99b9-1ed5ba9aab93 => generated 1279 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:08:48.625258 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-7f156301-4d7b-48fc-82a9-e8b0d35d8a82 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:08:48.626987 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-7f156301-4d7b-48fc-82a9-e8b0d35d8a82 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 48243e1b-892b-4c4b-8db1-242b2e40653b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:08:48.640999 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7f156301-4d7b-48fc-82a9-e8b0d35d8a82 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:48.652083 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-ff7f772d-616b-4b1b-863f-288849d2ae78 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:08:48.652900 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-ff7f772d-616b-4b1b-863f-288849d2ae78 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] [instance: 367dad85-827d-47b0-a468-418d398b36f9] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:08:48.653718 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7f156301-4d7b-48fc-82a9-e8b0d35d8a82 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:48.655788 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7f156301-4d7b-48fc-82a9-e8b0d35d8a82 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:48.657554 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7f156301-4d7b-48fc-82a9-e8b0d35d8a82 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:48.659750 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7f156301-4d7b-48fc-82a9-e8b0d35d8a82 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:48.661619 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7f156301-4d7b-48fc-82a9-e8b0d35d8a82 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:48.676028 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ff7f772d-616b-4b1b-863f-288849d2ae78 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:48.678263 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ff7f772d-616b-4b1b-863f-288849d2ae78 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:48.684111 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ff7f772d-616b-4b1b-863f-288849d2ae78 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:48.685146 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ff7f772d-616b-4b1b-863f-288849d2ae78 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:48.688086 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ff7f772d-616b-4b1b-863f-288849d2ae78 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:48.691010 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ff7f772d-616b-4b1b-863f-288849d2ae78 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:49.568385 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-7f156301-4d7b-48fc-82a9-e8b0d35d8a82 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:08:49.581728 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-7f156301-4d7b-48fc-82a9-e8b0d35d8a82 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b" status: 200 len: 1669 microversion: 2.1 time: 0.962574 Oct 04 22:08:49.583908 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2387/4825] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:08:48 2022] GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b => generated 1669 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:08:49.614004 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-2b1eba62-0245-4a5a-bb9a-40b7f11532a5 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:08:49.617708 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-2b1eba62-0245-4a5a-bb9a-40b7f11532a5 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 48243e1b-892b-4c4b-8db1-242b2e40653b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:08:49.648903 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2b1eba62-0245-4a5a-bb9a-40b7f11532a5 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:49.650882 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2b1eba62-0245-4a5a-bb9a-40b7f11532a5 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:49.652910 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2b1eba62-0245-4a5a-bb9a-40b7f11532a5 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:49.655353 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2b1eba62-0245-4a5a-bb9a-40b7f11532a5 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:49.658043 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2b1eba62-0245-4a5a-bb9a-40b7f11532a5 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:49.659350 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2b1eba62-0245-4a5a-bb9a-40b7f11532a5 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:49.686839 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-ff7f772d-616b-4b1b-863f-288849d2ae78 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:08:49.710108 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-ff7f772d-616b-4b1b-863f-288849d2ae78 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:08:49.713328 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-ff7f772d-616b-4b1b-863f-288849d2ae78 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:08:49.720611 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-ff7f772d-616b-4b1b-863f-288849d2ae78 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] 10.222.0.43 "GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9" status: 200 len: 1706 microversion: 2.32 time: 1.066596 Oct 04 22:08:49.737915 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2439/4826] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:08:48 2022] GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9 => generated 1706 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:08:49.746085 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-8542ca89-bcfb-41a6-b027-a9448564d107 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:08:49.747047 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-8542ca89-bcfb-41a6-b027-a9448564d107 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: 3b565a7d-fde0-47e5-99b9-1ed5ba9aab93] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:08:49.754506 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8542ca89-bcfb-41a6-b027-a9448564d107 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:49.755369 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8542ca89-bcfb-41a6-b027-a9448564d107 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:49.755973 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8542ca89-bcfb-41a6-b027-a9448564d107 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:49.756883 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8542ca89-bcfb-41a6-b027-a9448564d107 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:49.757989 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8542ca89-bcfb-41a6-b027-a9448564d107 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:49.758748 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8542ca89-bcfb-41a6-b027-a9448564d107 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:49.887581 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-2b1eba62-0245-4a5a-bb9a-40b7f11532a5 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "POST /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b/action" status: 202 len: 0 microversion: 2.1 time: 0.283541 Oct 04 22:08:49.888556 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2388/4827] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 22:08:49 2022] POST /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b/action => generated 0 bytes in 285 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 22:08:49.897725 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e03f7945-d762-4f85-bde4-bcc6840cbcb6 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:08:49.900944 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-e03f7945-d762-4f85-bde4-bcc6840cbcb6 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 48243e1b-892b-4c4b-8db1-242b2e40653b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:08:49.925431 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e03f7945-d762-4f85-bde4-bcc6840cbcb6 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:49.926208 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e03f7945-d762-4f85-bde4-bcc6840cbcb6 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:49.926976 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e03f7945-d762-4f85-bde4-bcc6840cbcb6 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:49.927987 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e03f7945-d762-4f85-bde4-bcc6840cbcb6 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:49.928606 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e03f7945-d762-4f85-bde4-bcc6840cbcb6 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:49.929197 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e03f7945-d762-4f85-bde4-bcc6840cbcb6 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:50.397464 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-8542ca89-bcfb-41a6-b027-a9448564d107 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1682f1a60045d8a04d4d67393cd13f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b00cd9fa8e40a0919b61fcd60269f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:08:50.409108 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-8542ca89-bcfb-41a6-b027-a9448564d107 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "GET /compute/v2.1/servers/3b565a7d-fde0-47e5-99b9-1ed5ba9aab93" status: 200 len: 1321 microversion: 2.1 time: 0.669831 Oct 04 22:08:50.415098 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2440/4828] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:08:49 2022] GET /compute/v2.1/servers/3b565a7d-fde0-47e5-99b9-1ed5ba9aab93 => generated 1321 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:08:50.716834 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-e03f7945-d762-4f85-bde4-bcc6840cbcb6 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:08:50.741134 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-e03f7945-d762-4f85-bde4-bcc6840cbcb6 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b" status: 200 len: 1671 microversion: 2.1 time: 0.848203 Oct 04 22:08:50.741737 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2389/4829] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:08:49 2022] GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b => generated 1671 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:08:50.767151 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-0faadaf5-f936-4602-b7a9-10a6e073d338 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:08:50.767796 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-0faadaf5-f936-4602-b7a9-10a6e073d338 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] [instance: 367dad85-827d-47b0-a468-418d398b36f9] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:08:50.781769 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0faadaf5-f936-4602-b7a9-10a6e073d338 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:50.783961 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0faadaf5-f936-4602-b7a9-10a6e073d338 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:50.785498 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0faadaf5-f936-4602-b7a9-10a6e073d338 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:50.787468 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0faadaf5-f936-4602-b7a9-10a6e073d338 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:50.789599 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0faadaf5-f936-4602-b7a9-10a6e073d338 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:50.791978 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0faadaf5-f936-4602-b7a9-10a6e073d338 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:50.843084 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=100 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:08:51.443181 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-021445ce-b578-49a0-9a09-695fe19d84fa tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:08:51.444102 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-021445ce-b578-49a0-9a09-695fe19d84fa tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: 3b565a7d-fde0-47e5-99b9-1ed5ba9aab93] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:08:51.492084 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-021445ce-b578-49a0-9a09-695fe19d84fa tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:51.515491 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-021445ce-b578-49a0-9a09-695fe19d84fa tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:51.516258 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-021445ce-b578-49a0-9a09-695fe19d84fa tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:51.517664 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-021445ce-b578-49a0-9a09-695fe19d84fa tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:51.518139 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-021445ce-b578-49a0-9a09-695fe19d84fa tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:51.538267 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-021445ce-b578-49a0-9a09-695fe19d84fa tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:51.661335 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-0faadaf5-f936-4602-b7a9-10a6e073d338 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:08:51.681645 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-0faadaf5-f936-4602-b7a9-10a6e073d338 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:08:51.681645 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-0faadaf5-f936-4602-b7a9-10a6e073d338 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:08:51.681645 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-0faadaf5-f936-4602-b7a9-10a6e073d338 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] 10.222.0.43 "GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9" status: 200 len: 1752 microversion: 2.32 time: 0.917788 Oct 04 22:08:51.681645 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2441/4830] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:08:50 2022] GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9 => generated 1752 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:08:51.767838 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-8c2fe365-220a-4e56-9caa-259885df9d36 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:08:51.768516 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-8c2fe365-220a-4e56-9caa-259885df9d36 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 48243e1b-892b-4c4b-8db1-242b2e40653b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:08:51.779116 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8c2fe365-220a-4e56-9caa-259885df9d36 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:51.779627 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8c2fe365-220a-4e56-9caa-259885df9d36 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:51.780077 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8c2fe365-220a-4e56-9caa-259885df9d36 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:51.780811 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8c2fe365-220a-4e56-9caa-259885df9d36 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:51.781278 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8c2fe365-220a-4e56-9caa-259885df9d36 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:51.781719 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8c2fe365-220a-4e56-9caa-259885df9d36 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:52.729252 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-8c2fe365-220a-4e56-9caa-259885df9d36 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:08:52.740145 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-8c2fe365-220a-4e56-9caa-259885df9d36 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b" status: 200 len: 1671 microversion: 2.1 time: 0.976236 Oct 04 22:08:52.741125 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-021445ce-b578-49a0-9a09-695fe19d84fa tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1682f1a60045d8a04d4d67393cd13f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b00cd9fa8e40a0919b61fcd60269f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:08:52.756003 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2442/4831] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:08:51 2022] GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b => generated 1671 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:08:52.760038 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-021445ce-b578-49a0-9a09-695fe19d84fa tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "GET /compute/v2.1/servers/3b565a7d-fde0-47e5-99b9-1ed5ba9aab93" status: 200 len: 1321 microversion: 2.1 time: 1.321240 Oct 04 22:08:52.763405 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-41fa85d1-1c94-4469-8966-94d5afa8576c req-60ae56d4-cd19-4e01-9cab-393cf804600c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b565a7d-fde0-47e5-99b9-1ed5ba9aab93", "tag": "628ec69c-47ae-49e4-a271-03107301cdf9"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:08:52.779311 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2390/4832] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:08:51 2022] GET /compute/v2.1/servers/3b565a7d-fde0-47e5-99b9-1ed5ba9aab93 => generated 1321 bytes in 1341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:08:52.789945 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-41fa85d1-1c94-4469-8966-94d5afa8576c req-60ae56d4-cd19-4e01-9cab-393cf804600c service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:52.790506 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-41fa85d1-1c94-4469-8966-94d5afa8576c req-60ae56d4-cd19-4e01-9cab-393cf804600c service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:52.790629 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-caa1a577-4f28-4ce9-9ef9-3477f09e8f43 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:08:52.790911 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-41fa85d1-1c94-4469-8966-94d5afa8576c req-60ae56d4-cd19-4e01-9cab-393cf804600c service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:52.793560 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-caa1a577-4f28-4ce9-9ef9-3477f09e8f43 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] [instance: 367dad85-827d-47b0-a468-418d398b36f9] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:08:52.808571 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-caa1a577-4f28-4ce9-9ef9-3477f09e8f43 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:52.809077 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-caa1a577-4f28-4ce9-9ef9-3477f09e8f43 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:52.816592 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-caa1a577-4f28-4ce9-9ef9-3477f09e8f43 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:52.817474 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-caa1a577-4f28-4ce9-9ef9-3477f09e8f43 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:52.817982 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-caa1a577-4f28-4ce9-9ef9-3477f09e8f43 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:52.818464 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-caa1a577-4f28-4ce9-9ef9-3477f09e8f43 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:52.819634 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-41fa85d1-1c94-4469-8966-94d5afa8576c req-60ae56d4-cd19-4e01-9cab-393cf804600c service nova] Creating event network-changed:628ec69c-47ae-49e4-a271-03107301cdf9 for instance 3b565a7d-fde0-47e5-99b9-1ed5ba9aab93 on n-h2-860284-1 Oct 04 22:08:52.830977 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-41fa85d1-1c94-4469-8966-94d5afa8576c req-60ae56d4-cd19-4e01-9cab-393cf804600c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073336 Oct 04 22:08:52.834543 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2443/4833] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:08:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:08:53.295316 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-caa1a577-4f28-4ce9-9ef9-3477f09e8f43 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:08:53.318398 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-caa1a577-4f28-4ce9-9ef9-3477f09e8f43 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:08:53.322740 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-caa1a577-4f28-4ce9-9ef9-3477f09e8f43 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:08:53.329532 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-caa1a577-4f28-4ce9-9ef9-3477f09e8f43 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] 10.222.0.43 "GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9" status: 200 len: 1798 microversion: 2.32 time: 0.547851 Oct 04 22:08:53.331408 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2391/4834] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:08:52 2022] GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9 => generated 1798 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:08:53.772447 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-f6a8e2fa-9cb2-4697-bd2e-0b486c7ae68b tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:08:53.773791 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-f6a8e2fa-9cb2-4697-bd2e-0b486c7ae68b tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 48243e1b-892b-4c4b-8db1-242b2e40653b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:08:53.788694 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-0dd2dad5-2a9d-47cf-84e4-b51ff34c68ba tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:08:53.789550 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-0dd2dad5-2a9d-47cf-84e4-b51ff34c68ba tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: 3b565a7d-fde0-47e5-99b9-1ed5ba9aab93] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:08:53.795103 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f6a8e2fa-9cb2-4697-bd2e-0b486c7ae68b tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:53.796355 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f6a8e2fa-9cb2-4697-bd2e-0b486c7ae68b tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:53.797086 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f6a8e2fa-9cb2-4697-bd2e-0b486c7ae68b tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:53.799485 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f6a8e2fa-9cb2-4697-bd2e-0b486c7ae68b tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:53.800451 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f6a8e2fa-9cb2-4697-bd2e-0b486c7ae68b tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:53.801285 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f6a8e2fa-9cb2-4697-bd2e-0b486c7ae68b tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:53.806618 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=4 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:08:53.812445 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0dd2dad5-2a9d-47cf-84e4-b51ff34c68ba tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:53.815091 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0dd2dad5-2a9d-47cf-84e4-b51ff34c68ba tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:53.816788 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0dd2dad5-2a9d-47cf-84e4-b51ff34c68ba tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:53.820581 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0dd2dad5-2a9d-47cf-84e4-b51ff34c68ba tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:53.826868 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0dd2dad5-2a9d-47cf-84e4-b51ff34c68ba tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:53.828396 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0dd2dad5-2a9d-47cf-84e4-b51ff34c68ba tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:54.116919 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=18 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:08:54.289120 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-f6a8e2fa-9cb2-4697-bd2e-0b486c7ae68b tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:08:54.303618 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-f6a8e2fa-9cb2-4697-bd2e-0b486c7ae68b tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b" status: 200 len: 1669 microversion: 2.1 time: 0.542033 Oct 04 22:08:54.314996 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-0dd2dad5-2a9d-47cf-84e4-b51ff34c68ba tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1682f1a60045d8a04d4d67393cd13f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b00cd9fa8e40a0919b61fcd60269f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:08:54.324680 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2444/4835] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:08:53 2022] GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b => generated 1669 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:08:54.331255 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-0dd2dad5-2a9d-47cf-84e4-b51ff34c68ba tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "GET /compute/v2.1/servers/3b565a7d-fde0-47e5-99b9-1ed5ba9aab93" status: 200 len: 1321 microversion: 2.1 time: 0.545099 Oct 04 22:08:54.333420 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2392/4836] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:08:53 2022] GET /compute/v2.1/servers/3b565a7d-fde0-47e5-99b9-1ed5ba9aab93 => generated 1321 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:08:54.351648 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-e7667be5-7d60-4142-86cb-cea7e1f2cdb4 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:08:54.357120 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-e7667be5-7d60-4142-86cb-cea7e1f2cdb4 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 48243e1b-892b-4c4b-8db1-242b2e40653b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:08:54.363065 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-d1105252-d650-453a-b001-2bbe09c67ed2 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:08:54.363732 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-d1105252-d650-453a-b001-2bbe09c67ed2 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] [instance: 367dad85-827d-47b0-a468-418d398b36f9] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:08:54.367023 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e7667be5-7d60-4142-86cb-cea7e1f2cdb4 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:54.370334 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e7667be5-7d60-4142-86cb-cea7e1f2cdb4 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:54.373170 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e7667be5-7d60-4142-86cb-cea7e1f2cdb4 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:54.374200 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e7667be5-7d60-4142-86cb-cea7e1f2cdb4 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:54.374933 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e7667be5-7d60-4142-86cb-cea7e1f2cdb4 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:54.375399 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d1105252-d650-453a-b001-2bbe09c67ed2 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:54.375962 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d1105252-d650-453a-b001-2bbe09c67ed2 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:54.377136 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e7667be5-7d60-4142-86cb-cea7e1f2cdb4 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:54.382071 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d1105252-d650-453a-b001-2bbe09c67ed2 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:54.383176 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d1105252-d650-453a-b001-2bbe09c67ed2 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:54.383682 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d1105252-d650-453a-b001-2bbe09c67ed2 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:54.384145 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d1105252-d650-453a-b001-2bbe09c67ed2 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:54.477534 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-e7667be5-7d60-4142-86cb-cea7e1f2cdb4 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "POST /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b/action" status: 200 len: 324 microversion: 2.1 time: 0.148080 Oct 04 22:08:54.478539 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2445/4837] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 22:08:54 2022] POST /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b/action => generated 324 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:08:54.490086 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-7550c99f-1a15-4f05-b302-0eafe988672e tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:08:54.490846 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-7550c99f-1a15-4f05-b302-0eafe988672e tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 48243e1b-892b-4c4b-8db1-242b2e40653b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:08:54.504411 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7550c99f-1a15-4f05-b302-0eafe988672e tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:54.504907 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7550c99f-1a15-4f05-b302-0eafe988672e tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:54.505350 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7550c99f-1a15-4f05-b302-0eafe988672e tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:54.506066 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7550c99f-1a15-4f05-b302-0eafe988672e tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:54.519201 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7550c99f-1a15-4f05-b302-0eafe988672e tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:54.519776 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7550c99f-1a15-4f05-b302-0eafe988672e tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:55.059857 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-d1105252-d650-453a-b001-2bbe09c67ed2 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:08:55.090032 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-d1105252-d650-453a-b001-2bbe09c67ed2 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:08:55.093628 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-d1105252-d650-453a-b001-2bbe09c67ed2 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:08:55.102950 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-d1105252-d650-453a-b001-2bbe09c67ed2 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] 10.222.0.43 "GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9" status: 200 len: 1844 microversion: 2.32 time: 0.739753 Oct 04 22:08:55.105469 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2393/4838] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:08:54 2022] GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9 => generated 1844 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 22:08:55.219257 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-7550c99f-1a15-4f05-b302-0eafe988672e tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:08:55.236420 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-7550c99f-1a15-4f05-b302-0eafe988672e tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b" status: 200 len: 1669 microversion: 2.1 time: 0.751983 Oct 04 22:08:55.254842 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2446/4839] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:08:54 2022] GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b => generated 1669 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:08:55.267388 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-0a1777cc-287a-4026-b649-f7e06046da30 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:08:55.268466 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-0a1777cc-287a-4026-b649-f7e06046da30 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 48243e1b-892b-4c4b-8db1-242b2e40653b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:08:55.291712 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0a1777cc-287a-4026-b649-f7e06046da30 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:55.293491 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0a1777cc-287a-4026-b649-f7e06046da30 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:55.295756 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0a1777cc-287a-4026-b649-f7e06046da30 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:55.302435 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0a1777cc-287a-4026-b649-f7e06046da30 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:55.309168 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0a1777cc-287a-4026-b649-f7e06046da30 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:55.310706 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0a1777cc-287a-4026-b649-f7e06046da30 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:55.371117 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-86e5b8cf-eb0b-475a-a4a3-a7a75d42f74d tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:08:55.372270 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-86e5b8cf-eb0b-475a-a4a3-a7a75d42f74d tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: 3b565a7d-fde0-47e5-99b9-1ed5ba9aab93] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:08:55.382648 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-86e5b8cf-eb0b-475a-a4a3-a7a75d42f74d tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:55.383326 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-86e5b8cf-eb0b-475a-a4a3-a7a75d42f74d tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:55.384068 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-86e5b8cf-eb0b-475a-a4a3-a7a75d42f74d tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:55.385435 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-86e5b8cf-eb0b-475a-a4a3-a7a75d42f74d tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:55.386202 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-86e5b8cf-eb0b-475a-a4a3-a7a75d42f74d tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:55.386865 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-86e5b8cf-eb0b-475a-a4a3-a7a75d42f74d tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:56.101348 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-0a1777cc-287a-4026-b649-f7e06046da30 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:08:56.114871 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-0a1777cc-287a-4026-b649-f7e06046da30 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b" status: 200 len: 1669 microversion: 2.1 time: 0.856404 Oct 04 22:08:56.115813 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2394/4840] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:08:55 2022] GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b => generated 1669 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:08:56.144041 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-9c470c8b-28e3-4738-8638-d6a40480d592 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:08:56.148110 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-9c470c8b-28e3-4738-8638-d6a40480d592 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] [instance: 367dad85-827d-47b0-a468-418d398b36f9] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:08:56.150653 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:08:56.163735 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9c470c8b-28e3-4738-8638-d6a40480d592 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:56.166336 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9c470c8b-28e3-4738-8638-d6a40480d592 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:56.167044 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9c470c8b-28e3-4738-8638-d6a40480d592 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:56.168952 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9c470c8b-28e3-4738-8638-d6a40480d592 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:56.173618 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9c470c8b-28e3-4738-8638-d6a40480d592 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:56.174616 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9c470c8b-28e3-4738-8638-d6a40480d592 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:56.367425 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-86e5b8cf-eb0b-475a-a4a3-a7a75d42f74d tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1682f1a60045d8a04d4d67393cd13f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b00cd9fa8e40a0919b61fcd60269f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:08:56.383373 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-86e5b8cf-eb0b-475a-a4a3-a7a75d42f74d tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "GET /compute/v2.1/servers/3b565a7d-fde0-47e5-99b9-1ed5ba9aab93" status: 200 len: 1321 microversion: 2.1 time: 1.024582 Oct 04 22:08:56.384005 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2447/4841] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:08:55 2022] GET /compute/v2.1/servers/3b565a7d-fde0-47e5-99b9-1ed5ba9aab93 => generated 1321 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:08:56.388930 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-2181f5d3-c516-4580-a764-6428675db945 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:08:56.389563 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-2181f5d3-c516-4580-a764-6428675db945 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 48243e1b-892b-4c4b-8db1-242b2e40653b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:08:56.410174 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2181f5d3-c516-4580-a764-6428675db945 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:56.411075 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2181f5d3-c516-4580-a764-6428675db945 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:56.411696 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2181f5d3-c516-4580-a764-6428675db945 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:56.412859 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2181f5d3-c516-4580-a764-6428675db945 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:56.419468 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2181f5d3-c516-4580-a764-6428675db945 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:56.439716 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2181f5d3-c516-4580-a764-6428675db945 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:57.302305 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-9c470c8b-28e3-4738-8638-d6a40480d592 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:08:57.321515 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-9c470c8b-28e3-4738-8638-d6a40480d592 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:08:57.324552 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-9c470c8b-28e3-4738-8638-d6a40480d592 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:08:57.328597 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-9c470c8b-28e3-4738-8638-d6a40480d592 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] 10.222.0.43 "GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9" status: 200 len: 1844 microversion: 2.32 time: 1.194254 Oct 04 22:08:57.362536 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2395/4842] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:08:56 2022] GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9 => generated 1844 bytes in 1229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:08:57.408550 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-bba6e6d5-83bd-429d-a31d-6b9e6c31f73e tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:08:57.409620 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-bba6e6d5-83bd-429d-a31d-6b9e6c31f73e tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: 3b565a7d-fde0-47e5-99b9-1ed5ba9aab93] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:08:57.428835 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bba6e6d5-83bd-429d-a31d-6b9e6c31f73e tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:57.430516 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bba6e6d5-83bd-429d-a31d-6b9e6c31f73e tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:57.432259 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bba6e6d5-83bd-429d-a31d-6b9e6c31f73e tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:57.435448 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bba6e6d5-83bd-429d-a31d-6b9e6c31f73e tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:57.441384 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bba6e6d5-83bd-429d-a31d-6b9e6c31f73e tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:57.442145 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bba6e6d5-83bd-429d-a31d-6b9e6c31f73e tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:57.451276 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-2181f5d3-c516-4580-a764-6428675db945 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:08:57.460378 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-2181f5d3-c516-4580-a764-6428675db945 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b" status: 200 len: 1669 microversion: 2.1 time: 1.075281 Oct 04 22:08:57.467585 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2448/4843] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:08:56 2022] GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b => generated 1669 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:08:57.496746 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-9b121a59-5b80-4de8-a167-2c3e74aa53a6 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:08:57.497659 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-9b121a59-5b80-4de8-a167-2c3e74aa53a6 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 48243e1b-892b-4c4b-8db1-242b2e40653b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:08:57.509992 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9b121a59-5b80-4de8-a167-2c3e74aa53a6 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:57.510920 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9b121a59-5b80-4de8-a167-2c3e74aa53a6 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:57.514983 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9b121a59-5b80-4de8-a167-2c3e74aa53a6 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:57.515760 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9b121a59-5b80-4de8-a167-2c3e74aa53a6 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:57.517428 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9b121a59-5b80-4de8-a167-2c3e74aa53a6 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:57.517640 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9b121a59-5b80-4de8-a167-2c3e74aa53a6 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:58.055256 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-9b121a59-5b80-4de8-a167-2c3e74aa53a6 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:08:58.067098 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-9b121a59-5b80-4de8-a167-2c3e74aa53a6 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b" status: 200 len: 1669 microversion: 2.1 time: 0.575058 Oct 04 22:08:58.082894 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2449/4844] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:08:57 2022] GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b => generated 1669 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:08:58.192396 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-bba6e6d5-83bd-429d-a31d-6b9e6c31f73e tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1682f1a60045d8a04d4d67393cd13f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b00cd9fa8e40a0919b61fcd60269f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:08:58.197534 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:08:58.202241 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-bba6e6d5-83bd-429d-a31d-6b9e6c31f73e tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "GET /compute/v2.1/servers/3b565a7d-fde0-47e5-99b9-1ed5ba9aab93" status: 200 len: 1321 microversion: 2.1 time: 0.798203 Oct 04 22:08:58.207266 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2396/4845] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:08:57 2022] GET /compute/v2.1/servers/3b565a7d-fde0-47e5-99b9-1ed5ba9aab93 => generated 1321 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:08:58.260128 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-8f765bc1-a356-4bbe-b161-2375f79a8952 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-590283537", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452", "networks": [{"uuid": "46f1773f-94f8-4a79-8019-a2303221d351"}]}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:08:58.341034 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.network.neutron [None req-8f765bc1-a356-4bbe-b161-2375f79a8952 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] validate_networks() for [('46f1773f-94f8-4a79-8019-a2303221d351', None, None, None, None, None)] {{(pid=134102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 22:08:58.358585 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-d16edbb8-fb20-4e89-b7d2-ab6610c09a16 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:08:58.359786 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-d16edbb8-fb20-4e89-b7d2-ab6610c09a16 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] [instance: 367dad85-827d-47b0-a468-418d398b36f9] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:08:58.378881 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d16edbb8-fb20-4e89-b7d2-ab6610c09a16 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:58.379596 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d16edbb8-fb20-4e89-b7d2-ab6610c09a16 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:58.380121 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d16edbb8-fb20-4e89-b7d2-ab6610c09a16 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:58.381015 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d16edbb8-fb20-4e89-b7d2-ab6610c09a16 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:58.381737 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d16edbb8-fb20-4e89-b7d2-ab6610c09a16 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:58.382311 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d16edbb8-fb20-4e89-b7d2-ab6610c09a16 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:59.860728 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-d16edbb8-fb20-4e89-b7d2-ab6610c09a16 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:08:59.897571 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-d16edbb8-fb20-4e89-b7d2-ab6610c09a16 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:08:59.905640 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-d16edbb8-fb20-4e89-b7d2-ab6610c09a16 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:08:59.910523 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-d16edbb8-fb20-4e89-b7d2-ab6610c09a16 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] 10.222.0.43 "GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9" status: 200 len: 1844 microversion: 2.32 time: 1.556116 Oct 04 22:08:59.913619 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2397/4846] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:08:58 2022] GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9 => generated 1844 bytes in 1560 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 22:08:59.933825 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-43b4e841-c845-454b-a376-5155892c0d7b req-bdcd418e-4101-4247-a532-b0af1bdb6f02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "367dad85-827d-47b0-a468-418d398b36f9", "tag": "1701ea5d-b8bb-4192-8463-7dfa341dc8c3"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:08:59.984662 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-43b4e841-c845-454b-a376-5155892c0d7b req-bdcd418e-4101-4247-a532-b0af1bdb6f02 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:59.989035 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-43b4e841-c845-454b-a376-5155892c0d7b req-bdcd418e-4101-4247-a532-b0af1bdb6f02 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:59.990962 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-43b4e841-c845-454b-a376-5155892c0d7b req-bdcd418e-4101-4247-a532-b0af1bdb6f02 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:00.024220 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-43b4e841-c845-454b-a376-5155892c0d7b req-bdcd418e-4101-4247-a532-b0af1bdb6f02 service nova] Creating event network-changed:1701ea5d-b8bb-4192-8463-7dfa341dc8c3 for instance 367dad85-827d-47b0-a468-418d398b36f9 on n-h1-860284-1 Oct 04 22:09:00.048805 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-43b4e841-c845-454b-a376-5155892c0d7b req-bdcd418e-4101-4247-a532-b0af1bdb6f02 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123484 Oct 04 22:09:00.052658 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2398/4847] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:08:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:09:00.066305 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-f183c121-5cac-445d-a1f3-2ceb38c73d94 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:00.068681 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-f183c121-5cac-445d-a1f3-2ceb38c73d94 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: 3b565a7d-fde0-47e5-99b9-1ed5ba9aab93] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:00.086717 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f183c121-5cac-445d-a1f3-2ceb38c73d94 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:00.089421 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f183c121-5cac-445d-a1f3-2ceb38c73d94 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:00.090981 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f183c121-5cac-445d-a1f3-2ceb38c73d94 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:00.092510 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f183c121-5cac-445d-a1f3-2ceb38c73d94 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:00.093469 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f183c121-5cac-445d-a1f3-2ceb38c73d94 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:00.098922 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f183c121-5cac-445d-a1f3-2ceb38c73d94 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:00.545106 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-f183c121-5cac-445d-a1f3-2ceb38c73d94 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1682f1a60045d8a04d4d67393cd13f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b00cd9fa8e40a0919b61fcd60269f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:00.557963 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-f183c121-5cac-445d-a1f3-2ceb38c73d94 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "GET /compute/v2.1/servers/3b565a7d-fde0-47e5-99b9-1ed5ba9aab93" status: 200 len: 1321 microversion: 2.1 time: 0.503009 Oct 04 22:09:00.563845 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2399/4848] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:09:00 2022] GET /compute/v2.1/servers/3b565a7d-fde0-47e5-99b9-1ed5ba9aab93 => generated 1321 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:09:00.747527 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-8f765bc1-a356-4bbe-b161-2375f79a8952 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Flavor limits 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 22:09:00.748260 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-8f765bc1-a356-4bbe-b161-2375f79a8952 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Image limits 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 22:09:00.749188 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-8f765bc1-a356-4bbe-b161-2375f79a8952 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Flavor pref 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 22:09:00.749728 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-8f765bc1-a356-4bbe-b161-2375f79a8952 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Image pref 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 22:09:00.750255 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-8f765bc1-a356-4bbe-b161-2375f79a8952 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 22:09:00.771632 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8f765bc1-a356-4bbe-b161-2375f79a8952 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:00.774457 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8f765bc1-a356-4bbe-b161-2375f79a8952 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:00.775192 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8f765bc1-a356-4bbe-b161-2375f79a8952 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:00.776223 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8f765bc1-a356-4bbe-b161-2375f79a8952 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:00.778940 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8f765bc1-a356-4bbe-b161-2375f79a8952 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:00.779766 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8f765bc1-a356-4bbe-b161-2375f79a8952 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:00.831148 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-8f765bc1-a356-4bbe-b161-2375f79a8952 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Getting quotas for project 9da7a77590054a3c911643db69a0beae. Resources: {'instances', 'ram', 'cores'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:09:00.846181 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-8f765bc1-a356-4bbe-b161-2375f79a8952 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Getting quotas for user 836cb8e2e7be4981bb266cbd4189a775 and project 9da7a77590054a3c911643db69a0beae. Resources: {'instances', 'ram', 'cores'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:09:00.883803 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-8f765bc1-a356-4bbe-b161-2375f79a8952 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Going to run 1 instances... {{(pid=134102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 22:09:00.893097 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-8f765bc1-a356-4bbe-b161-2375f79a8952 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 3d4d9f68-34fa-48b4-a274-6b389af36686] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='58548514-5dac-426c-81f5-19e3fba33e23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 22:09:00.942680 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-85a66d6d-9889-4b2f-bac7-017b4fc82557 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:00.943972 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-85a66d6d-9889-4b2f-bac7-017b4fc82557 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] [instance: 367dad85-827d-47b0-a468-418d398b36f9] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:00.966295 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-85a66d6d-9889-4b2f-bac7-017b4fc82557 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:00.968786 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-85a66d6d-9889-4b2f-bac7-017b4fc82557 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:00.971624 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-85a66d6d-9889-4b2f-bac7-017b4fc82557 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:00.978926 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-85a66d6d-9889-4b2f-bac7-017b4fc82557 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:00.979481 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-85a66d6d-9889-4b2f-bac7-017b4fc82557 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:00.979942 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-85a66d6d-9889-4b2f-bac7-017b4fc82557 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:01.034386 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-8f765bc1-a356-4bbe-b161-2375f79a8952 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.778004 Oct 04 22:09:01.047226 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2450/4849] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 22:08:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 2791 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 22:09:01.059345 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-6aebc322-314b-44f5-b645-50be9c591515 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:01.061351 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-6aebc322-314b-44f5-b645-50be9c591515 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 3d4d9f68-34fa-48b4-a274-6b389af36686] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:01.201510 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-6aebc322-314b-44f5-b645-50be9c591515 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:01.214854 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-6aebc322-314b-44f5-b645-50be9c591515 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/3d4d9f68-34fa-48b4-a274-6b389af36686" status: 200 len: 1214 microversion: 2.1 time: 0.162357 Oct 04 22:09:01.231170 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2451/4850] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:09:01 2022] GET /compute/v2.1/servers/3d4d9f68-34fa-48b4-a274-6b389af36686 => generated 1214 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:09:01.608373 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-8f4c5e9c-d14c-4fd1-9bcf-925df0d9a1f3 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:01.614048 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-8f4c5e9c-d14c-4fd1-9bcf-925df0d9a1f3 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: 3b565a7d-fde0-47e5-99b9-1ed5ba9aab93] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:01.623600 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8f4c5e9c-d14c-4fd1-9bcf-925df0d9a1f3 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:01.624370 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8f4c5e9c-d14c-4fd1-9bcf-925df0d9a1f3 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:01.625280 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8f4c5e9c-d14c-4fd1-9bcf-925df0d9a1f3 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:01.626466 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8f4c5e9c-d14c-4fd1-9bcf-925df0d9a1f3 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:01.627180 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8f4c5e9c-d14c-4fd1-9bcf-925df0d9a1f3 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:01.627842 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8f4c5e9c-d14c-4fd1-9bcf-925df0d9a1f3 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:01.824848 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-85a66d6d-9889-4b2f-bac7-017b4fc82557 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:01.842829 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-85a66d6d-9889-4b2f-bac7-017b4fc82557 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:01.848249 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-85a66d6d-9889-4b2f-bac7-017b4fc82557 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:01.854656 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-85a66d6d-9889-4b2f-bac7-017b4fc82557 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] 10.222.0.43 "GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9" status: 200 len: 1865 microversion: 2.32 time: 0.916977 Oct 04 22:09:01.856026 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2400/4851] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:09:00 2022] GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9 => generated 1865 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 22:09:01.957811 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-8f4c5e9c-d14c-4fd1-9bcf-925df0d9a1f3 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1682f1a60045d8a04d4d67393cd13f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b00cd9fa8e40a0919b61fcd60269f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:01.974544 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-8f4c5e9c-d14c-4fd1-9bcf-925df0d9a1f3 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "GET /compute/v2.1/servers/3b565a7d-fde0-47e5-99b9-1ed5ba9aab93" status: 200 len: 1321 microversion: 2.1 time: 0.375721 Oct 04 22:09:01.991737 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2452/4852] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:09:01 2022] GET /compute/v2.1/servers/3b565a7d-fde0-47e5-99b9-1ed5ba9aab93 => generated 1321 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:09:02.241838 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-03d21bf4-5baa-4a47-8def-160a96e4e8ab tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:02.242459 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-03d21bf4-5baa-4a47-8def-160a96e4e8ab tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 3d4d9f68-34fa-48b4-a274-6b389af36686] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:02.267996 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-03d21bf4-5baa-4a47-8def-160a96e4e8ab tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:02.270280 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-03d21bf4-5baa-4a47-8def-160a96e4e8ab tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:02.273989 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-03d21bf4-5baa-4a47-8def-160a96e4e8ab tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:02.277331 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-03d21bf4-5baa-4a47-8def-160a96e4e8ab tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:02.279873 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-03d21bf4-5baa-4a47-8def-160a96e4e8ab tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:02.283185 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-03d21bf4-5baa-4a47-8def-160a96e4e8ab tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:02.402646 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-a311a069-e839-4cc0-af9b-9f07ddf9d259 req-bd0e0f84-d624-48bf-9116-18cc8f867f53 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "367dad85-827d-47b0-a468-418d398b36f9", "tag": "f59ea8c9-f58e-4510-8926-2c0460bdd87d"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:09:02.428842 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-a311a069-e839-4cc0-af9b-9f07ddf9d259 req-bd0e0f84-d624-48bf-9116-18cc8f867f53 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:02.437049 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-a311a069-e839-4cc0-af9b-9f07ddf9d259 req-bd0e0f84-d624-48bf-9116-18cc8f867f53 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:02.438937 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-a311a069-e839-4cc0-af9b-9f07ddf9d259 req-bd0e0f84-d624-48bf-9116-18cc8f867f53 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:02.484988 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-a311a069-e839-4cc0-af9b-9f07ddf9d259 req-bd0e0f84-d624-48bf-9116-18cc8f867f53 service nova] Creating event network-changed:f59ea8c9-f58e-4510-8926-2c0460bdd87d for instance 367dad85-827d-47b0-a468-418d398b36f9 on n-h1-860284-1 Oct 04 22:09:02.503144 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-a311a069-e839-4cc0-af9b-9f07ddf9d259 req-bd0e0f84-d624-48bf-9116-18cc8f867f53 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104333 Oct 04 22:09:02.509032 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2453/4853] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:09:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:09:02.720085 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-7e1c096a-6430-4507-a8f7-1c8fe86ca329 req-a1d99613-5129-4181-bfad-e4519222e11d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b565a7d-fde0-47e5-99b9-1ed5ba9aab93", "name": "network-vif-plugged", "status": "completed", "tag": "628ec69c-47ae-49e4-a271-03107301cdf9"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:09:02.735151 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-03d21bf4-5baa-4a47-8def-160a96e4e8ab tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:02.752934 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-03d21bf4-5baa-4a47-8def-160a96e4e8ab tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/3d4d9f68-34fa-48b4-a274-6b389af36686" status: 200 len: 1210 microversion: 2.1 time: 0.513796 Oct 04 22:09:02.753305 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-7e1c096a-6430-4507-a8f7-1c8fe86ca329 req-a1d99613-5129-4181-bfad-e4519222e11d service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:02.753657 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2401/4854] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:09:02 2022] GET /compute/v2.1/servers/3d4d9f68-34fa-48b4-a274-6b389af36686 => generated 1210 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:09:02.754353 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-7e1c096a-6430-4507-a8f7-1c8fe86ca329 req-a1d99613-5129-4181-bfad-e4519222e11d service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:02.756524 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-7e1c096a-6430-4507-a8f7-1c8fe86ca329 req-a1d99613-5129-4181-bfad-e4519222e11d service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:02.878804 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-7e1c096a-6430-4507-a8f7-1c8fe86ca329 req-a1d99613-5129-4181-bfad-e4519222e11d service nova] Creating event network-vif-plugged:628ec69c-47ae-49e4-a271-03107301cdf9 for instance 3b565a7d-fde0-47e5-99b9-1ed5ba9aab93 on n-h2-860284-1 Oct 04 22:09:02.886199 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-7e1c096a-6430-4507-a8f7-1c8fe86ca329 req-a1d99613-5129-4181-bfad-e4519222e11d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.172291 Oct 04 22:09:02.887675 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2454/4855] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:09:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:09:02.903759 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-963493d5-a8c3-4ae2-8b1b-445aedf94f7c tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:02.904415 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-963493d5-a8c3-4ae2-8b1b-445aedf94f7c tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] [instance: 367dad85-827d-47b0-a468-418d398b36f9] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:02.925230 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-963493d5-a8c3-4ae2-8b1b-445aedf94f7c tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:02.938843 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-963493d5-a8c3-4ae2-8b1b-445aedf94f7c tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:02.939986 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-963493d5-a8c3-4ae2-8b1b-445aedf94f7c tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:02.940974 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-963493d5-a8c3-4ae2-8b1b-445aedf94f7c tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:02.941635 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-963493d5-a8c3-4ae2-8b1b-445aedf94f7c tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:02.942261 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-963493d5-a8c3-4ae2-8b1b-445aedf94f7c tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:03.015681 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-ed883a18-e564-4f48-a336-4e753c4d67e3 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:03.019574 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-ed883a18-e564-4f48-a336-4e753c4d67e3 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: 3b565a7d-fde0-47e5-99b9-1ed5ba9aab93] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:03.028904 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ed883a18-e564-4f48-a336-4e753c4d67e3 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:03.030412 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ed883a18-e564-4f48-a336-4e753c4d67e3 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:03.031021 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ed883a18-e564-4f48-a336-4e753c4d67e3 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:03.031975 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ed883a18-e564-4f48-a336-4e753c4d67e3 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:03.032647 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ed883a18-e564-4f48-a336-4e753c4d67e3 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:03.033264 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ed883a18-e564-4f48-a336-4e753c4d67e3 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:04.101805 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-ed883a18-e564-4f48-a336-4e753c4d67e3 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1682f1a60045d8a04d4d67393cd13f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b00cd9fa8e40a0919b61fcd60269f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:04.120921 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-963493d5-a8c3-4ae2-8b1b-445aedf94f7c tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:04.143719 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-963493d5-a8c3-4ae2-8b1b-445aedf94f7c tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:04.148434 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-963493d5-a8c3-4ae2-8b1b-445aedf94f7c tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:04.150137 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-ed883a18-e564-4f48-a336-4e753c4d67e3 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "GET /compute/v2.1/servers/3b565a7d-fde0-47e5-99b9-1ed5ba9aab93" status: 200 len: 1321 microversion: 2.1 time: 1.144260 Oct 04 22:09:04.153083 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-963493d5-a8c3-4ae2-8b1b-445aedf94f7c tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] 10.222.0.43 "GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9" status: 200 len: 1865 microversion: 2.32 time: 1.271416 Oct 04 22:09:04.154908 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2455/4856] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:09:03 2022] GET /compute/v2.1/servers/3b565a7d-fde0-47e5-99b9-1ed5ba9aab93 => generated 1321 bytes in 1150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:09:04.155549 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2402/4857] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:09:02 2022] GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9 => generated 1865 bytes in 1276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:09:04.170645 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-b0e678c3-5f2a-48dd-b76a-de33756db46d tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:04.174103 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-b0e678c3-5f2a-48dd-b76a-de33756db46d tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] [instance: 9f29b298-6acb-468a-b28b-6ce95ba57ea2] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:04.175659 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-6be7caff-6e6a-4eea-b346-389e69940c1c tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:04.181573 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-6be7caff-6e6a-4eea-b346-389e69940c1c tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 3d4d9f68-34fa-48b4-a274-6b389af36686] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:04.200129 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b0e678c3-5f2a-48dd-b76a-de33756db46d tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:04.202855 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6be7caff-6e6a-4eea-b346-389e69940c1c tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:04.203226 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b0e678c3-5f2a-48dd-b76a-de33756db46d tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:04.204726 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b0e678c3-5f2a-48dd-b76a-de33756db46d tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:04.206340 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6be7caff-6e6a-4eea-b346-389e69940c1c tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:04.208363 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6be7caff-6e6a-4eea-b346-389e69940c1c tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:04.209308 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6be7caff-6e6a-4eea-b346-389e69940c1c tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:04.209819 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6be7caff-6e6a-4eea-b346-389e69940c1c tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:04.212991 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6be7caff-6e6a-4eea-b346-389e69940c1c tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:04.213998 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b0e678c3-5f2a-48dd-b76a-de33756db46d tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:04.230018 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b0e678c3-5f2a-48dd-b76a-de33756db46d tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:04.231577 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b0e678c3-5f2a-48dd-b76a-de33756db46d tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:04.488492 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.objects.instance [None req-b0e678c3-5f2a-48dd-b76a-de33756db46d tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lazy-loading 'services' on Instance uuid 9f29b298-6acb-468a-b28b-6ce95ba57ea2 {{(pid=134102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 22:09:04.562466 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-6be7caff-6e6a-4eea-b346-389e69940c1c tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:04.574519 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-6be7caff-6e6a-4eea-b346-389e69940c1c tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/3d4d9f68-34fa-48b4-a274-6b389af36686" status: 200 len: 1272 microversion: 2.1 time: 0.417615 Oct 04 22:09:04.577870 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2403/4858] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:09:04 2022] GET /compute/v2.1/servers/3d4d9f68-34fa-48b4-a274-6b389af36686 => generated 1272 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:09:04.614860 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-33e6eb2e-8bdf-4f95-96b0-97fd5982eeeb tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:04.615612 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-33e6eb2e-8bdf-4f95-96b0-97fd5982eeeb tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] [instance: e616bb7a-3fab-411e-ab23-25d093c36691] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:04.624494 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-33e6eb2e-8bdf-4f95-96b0-97fd5982eeeb tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:04.625491 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-33e6eb2e-8bdf-4f95-96b0-97fd5982eeeb tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:04.626655 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-33e6eb2e-8bdf-4f95-96b0-97fd5982eeeb tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:04.628373 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-33e6eb2e-8bdf-4f95-96b0-97fd5982eeeb tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:04.629227 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-33e6eb2e-8bdf-4f95-96b0-97fd5982eeeb tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:04.629841 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-33e6eb2e-8bdf-4f95-96b0-97fd5982eeeb tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:04.695058 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-33e6eb2e-8bdf-4f95-96b0-97fd5982eeeb tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] 10.222.0.43 "GET /compute/v2.1/servers/e616bb7a-3fab-411e-ab23-25d093c36691/ips" status: 200 len: 150 microversion: 2.1 time: 0.088553 Oct 04 22:09:04.696213 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2404/4859] 10.222.0.43 () {58 vars in 1248 bytes} [Tue Oct 4 22:09:04 2022] GET /compute/v2.1/servers/e616bb7a-3fab-411e-ab23-25d093c36691/ips => generated 150 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:09:04.711496 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-b0e678c3-5f2a-48dd-b76a-de33756db46d tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] 10.222.0.43 "DELETE /compute/v2.1/servers/9f29b298-6acb-468a-b28b-6ce95ba57ea2/os-volume_attachments/320f26dd-78e4-4c74-b556-be2974d9ec5a" status: 202 len: 0 microversion: 2.1 time: 0.555143 Oct 04 22:09:04.720139 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2456/4860] 10.222.0.43 () {58 vars in 1416 bytes} [Tue Oct 4 22:09:04 2022] DELETE /compute/v2.1/servers/9f29b298-6acb-468a-b28b-6ce95ba57ea2/os-volume_attachments/320f26dd-78e4-4c74-b556-be2974d9ec5a => generated 0 bytes in 564 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 22:09:05.202989 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-12e2a4df-c55f-438f-a241-13eb76427609 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:05.209635 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-18a26ad6-1544-41e1-8709-06bb01e4be57 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:05.212725 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-12e2a4df-c55f-438f-a241-13eb76427609 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] [instance: 367dad85-827d-47b0-a468-418d398b36f9] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:05.212941 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-18a26ad6-1544-41e1-8709-06bb01e4be57 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: 3b565a7d-fde0-47e5-99b9-1ed5ba9aab93] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:05.233931 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=6 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:09:05.259768 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-12e2a4df-c55f-438f-a241-13eb76427609 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:05.260281 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-12e2a4df-c55f-438f-a241-13eb76427609 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:05.260737 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-12e2a4df-c55f-438f-a241-13eb76427609 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:05.261110 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-18a26ad6-1544-41e1-8709-06bb01e4be57 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:05.261532 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-12e2a4df-c55f-438f-a241-13eb76427609 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:05.264661 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-18a26ad6-1544-41e1-8709-06bb01e4be57 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:05.268095 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-18a26ad6-1544-41e1-8709-06bb01e4be57 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:05.272045 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-12e2a4df-c55f-438f-a241-13eb76427609 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:05.272239 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-18a26ad6-1544-41e1-8709-06bb01e4be57 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:05.274107 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-18a26ad6-1544-41e1-8709-06bb01e4be57 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:05.276302 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-12e2a4df-c55f-438f-a241-13eb76427609 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:05.276679 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-18a26ad6-1544-41e1-8709-06bb01e4be57 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:06.357616 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-12e2a4df-c55f-438f-a241-13eb76427609 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:06.389062 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-12e2a4df-c55f-438f-a241-13eb76427609 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:06.397881 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-12e2a4df-c55f-438f-a241-13eb76427609 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:06.399996 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-12e2a4df-c55f-438f-a241-13eb76427609 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] 10.222.0.43 "GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9" status: 200 len: 1886 microversion: 2.32 time: 1.202593 Oct 04 22:09:06.403520 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2457/4861] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:09:05 2022] GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9 => generated 1886 bytes in 1207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 22:09:06.417666 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-c6003c62-552a-46a5-a99a-17a15b19a761 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:06.418656 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-c6003c62-552a-46a5-a99a-17a15b19a761 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 3d4d9f68-34fa-48b4-a274-6b389af36686] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:06.433466 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c6003c62-552a-46a5-a99a-17a15b19a761 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:06.436067 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c6003c62-552a-46a5-a99a-17a15b19a761 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:06.436763 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c6003c62-552a-46a5-a99a-17a15b19a761 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:06.437696 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c6003c62-552a-46a5-a99a-17a15b19a761 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:06.440022 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c6003c62-552a-46a5-a99a-17a15b19a761 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:06.440694 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c6003c62-552a-46a5-a99a-17a15b19a761 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:06.574443 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-18a26ad6-1544-41e1-8709-06bb01e4be57 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1682f1a60045d8a04d4d67393cd13f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b00cd9fa8e40a0919b61fcd60269f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:06.585190 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-c6003c62-552a-46a5-a99a-17a15b19a761 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:06.590220 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-18a26ad6-1544-41e1-8709-06bb01e4be57 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "GET /compute/v2.1/servers/3b565a7d-fde0-47e5-99b9-1ed5ba9aab93" status: 200 len: 1321 microversion: 2.1 time: 1.398774 Oct 04 22:09:06.602397 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2405/4862] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:09:05 2022] GET /compute/v2.1/servers/3b565a7d-fde0-47e5-99b9-1ed5ba9aab93 => generated 1321 bytes in 1403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:09:06.603030 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-c6003c62-552a-46a5-a99a-17a15b19a761 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/3d4d9f68-34fa-48b4-a274-6b389af36686" status: 200 len: 1272 microversion: 2.1 time: 0.191475 Oct 04 22:09:06.615011 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2458/4863] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:09:06 2022] GET /compute/v2.1/servers/3d4d9f68-34fa-48b4-a274-6b389af36686 => generated 1272 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:09:07.381862 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-8d6cc12e-3ab7-4005-a369-9bdc23cd4c77 req-2c750bd2-d9da-47da-98db-21275e82d64a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "367dad85-827d-47b0-a468-418d398b36f9", "tag": "68e96019-907e-47ad-a440-3208969682fb"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:09:07.407890 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-8d6cc12e-3ab7-4005-a369-9bdc23cd4c77 req-2c750bd2-d9da-47da-98db-21275e82d64a service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:07.418581 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-8d6cc12e-3ab7-4005-a369-9bdc23cd4c77 req-2c750bd2-d9da-47da-98db-21275e82d64a service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:07.424220 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-8d6cc12e-3ab7-4005-a369-9bdc23cd4c77 req-2c750bd2-d9da-47da-98db-21275e82d64a service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:07.437804 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-ba07d81f-b1d9-4d12-b7fd-cf7c973629ee tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:07.438466 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-ba07d81f-b1d9-4d12-b7fd-cf7c973629ee tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] [instance: 367dad85-827d-47b0-a468-418d398b36f9] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:07.476322 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ba07d81f-b1d9-4d12-b7fd-cf7c973629ee tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:07.477114 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ba07d81f-b1d9-4d12-b7fd-cf7c973629ee tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:07.477775 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ba07d81f-b1d9-4d12-b7fd-cf7c973629ee tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:07.480664 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-8d6cc12e-3ab7-4005-a369-9bdc23cd4c77 req-2c750bd2-d9da-47da-98db-21275e82d64a service nova] Creating event network-changed:68e96019-907e-47ad-a440-3208969682fb for instance 367dad85-827d-47b0-a468-418d398b36f9 on n-h1-860284-1 Oct 04 22:09:07.482913 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ba07d81f-b1d9-4d12-b7fd-cf7c973629ee tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:07.493435 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ba07d81f-b1d9-4d12-b7fd-cf7c973629ee tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:07.494644 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ba07d81f-b1d9-4d12-b7fd-cf7c973629ee tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:07.496467 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-8d6cc12e-3ab7-4005-a369-9bdc23cd4c77 req-2c750bd2-d9da-47da-98db-21275e82d64a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120564 Oct 04 22:09:07.497333 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2406/4864] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:09:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:09:07.626506 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-778d96b3-0470-426f-8a24-4afa3bca35dd tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:07.628672 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-778d96b3-0470-426f-8a24-4afa3bca35dd tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 3d4d9f68-34fa-48b4-a274-6b389af36686] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:07.653011 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-778d96b3-0470-426f-8a24-4afa3bca35dd tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:07.656049 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-778d96b3-0470-426f-8a24-4afa3bca35dd tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:07.657373 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-778d96b3-0470-426f-8a24-4afa3bca35dd tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:07.661570 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-778d96b3-0470-426f-8a24-4afa3bca35dd tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:07.662746 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-778d96b3-0470-426f-8a24-4afa3bca35dd tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:07.665651 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-778d96b3-0470-426f-8a24-4afa3bca35dd tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:08.578854 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-778d96b3-0470-426f-8a24-4afa3bca35dd tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:08.588883 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-778d96b3-0470-426f-8a24-4afa3bca35dd tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/3d4d9f68-34fa-48b4-a274-6b389af36686" status: 200 len: 1314 microversion: 2.1 time: 0.971067 Oct 04 22:09:08.589529 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2407/4865] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:09:07 2022] GET /compute/v2.1/servers/3d4d9f68-34fa-48b4-a274-6b389af36686 => generated 1314 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:09:08.608557 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-04d1eb79-61ff-4c73-bf31-c8515a2cfe03 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:08.609397 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-04d1eb79-61ff-4c73-bf31-c8515a2cfe03 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: 3b565a7d-fde0-47e5-99b9-1ed5ba9aab93] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:08.626763 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-04d1eb79-61ff-4c73-bf31-c8515a2cfe03 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:08.628042 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-04d1eb79-61ff-4c73-bf31-c8515a2cfe03 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:08.628668 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-04d1eb79-61ff-4c73-bf31-c8515a2cfe03 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:08.629584 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-04d1eb79-61ff-4c73-bf31-c8515a2cfe03 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:08.630229 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-04d1eb79-61ff-4c73-bf31-c8515a2cfe03 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:08.630895 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-04d1eb79-61ff-4c73-bf31-c8515a2cfe03 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:08.804801 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-ba07d81f-b1d9-4d12-b7fd-cf7c973629ee tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:08.822051 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-ba07d81f-b1d9-4d12-b7fd-cf7c973629ee tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:08.823603 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-ba07d81f-b1d9-4d12-b7fd-cf7c973629ee tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:08.824850 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-ba07d81f-b1d9-4d12-b7fd-cf7c973629ee tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] 10.222.0.43 "GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9" status: 200 len: 1886 microversion: 2.32 time: 1.395765 Oct 04 22:09:08.830091 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2459/4866] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:09:07 2022] GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9 => generated 1886 bytes in 1402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:09:09.263288 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-b437e2fa-95da-4dbb-bd33-99d258a52ca2 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6e1c92b2-7bf1-4aeb-bfbe-fb530b06318e"}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:09:09.266094 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-b437e2fa-95da-4dbb-bd33-99d258a52ca2 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] [instance: e616bb7a-3fab-411e-ab23-25d093c36691] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:09.279168 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b437e2fa-95da-4dbb-bd33-99d258a52ca2 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:09.281483 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b437e2fa-95da-4dbb-bd33-99d258a52ca2 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:09.288451 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b437e2fa-95da-4dbb-bd33-99d258a52ca2 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:09.289363 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b437e2fa-95da-4dbb-bd33-99d258a52ca2 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:09.289851 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b437e2fa-95da-4dbb-bd33-99d258a52ca2 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:09.290304 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b437e2fa-95da-4dbb-bd33-99d258a52ca2 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:09.635806 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-04d1eb79-61ff-4c73-bf31-c8515a2cfe03 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1682f1a60045d8a04d4d67393cd13f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b00cd9fa8e40a0919b61fcd60269f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:09.648819 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-04d1eb79-61ff-4c73-bf31-c8515a2cfe03 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "GET /compute/v2.1/servers/3b565a7d-fde0-47e5-99b9-1ed5ba9aab93" status: 200 len: 1502 microversion: 2.1 time: 1.045079 Oct 04 22:09:09.663753 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2408/4867] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:09:08 2022] GET /compute/v2.1/servers/3b565a7d-fde0-47e5-99b9-1ed5ba9aab93 => generated 1502 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:09:09.689604 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-23de7d76-d33b-45aa-af93-08c3715d2d7e req-eaf6968d-8f17-4394-8299-613c731e7394 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d4d9f68-34fa-48b4-a274-6b389af36686", "tag": "f13beae5-f748-444a-889a-9f97d7e0da5c"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:09:09.712068 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-23de7d76-d33b-45aa-af93-08c3715d2d7e req-eaf6968d-8f17-4394-8299-613c731e7394 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:09.717163 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-23de7d76-d33b-45aa-af93-08c3715d2d7e req-eaf6968d-8f17-4394-8299-613c731e7394 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:09.717936 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-23de7d76-d33b-45aa-af93-08c3715d2d7e req-eaf6968d-8f17-4394-8299-613c731e7394 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:09.744298 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-23de7d76-d33b-45aa-af93-08c3715d2d7e req-eaf6968d-8f17-4394-8299-613c731e7394 service nova] Creating event network-changed:f13beae5-f748-444a-889a-9f97d7e0da5c for instance 3d4d9f68-34fa-48b4-a274-6b389af36686 on n-h1-860284-1 Oct 04 22:09:09.753008 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-23de7d76-d33b-45aa-af93-08c3715d2d7e req-eaf6968d-8f17-4394-8299-613c731e7394 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087115 Oct 04 22:09:09.754033 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2409/4868] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:09:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:09:09.759908 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-70e7c990-ee58-4a5d-85e6-af4e778684a5 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:09.761147 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-70e7c990-ee58-4a5d-85e6-af4e778684a5 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 3d4d9f68-34fa-48b4-a274-6b389af36686] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:09.771089 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-70e7c990-ee58-4a5d-85e6-af4e778684a5 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:09.772486 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-70e7c990-ee58-4a5d-85e6-af4e778684a5 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:09.773279 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-70e7c990-ee58-4a5d-85e6-af4e778684a5 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:09.774185 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-70e7c990-ee58-4a5d-85e6-af4e778684a5 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:09.774951 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-70e7c990-ee58-4a5d-85e6-af4e778684a5 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:09.775560 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-70e7c990-ee58-4a5d-85e6-af4e778684a5 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:09.803096 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:09:09.852332 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-b437e2fa-95da-4dbb-bd33-99d258a52ca2 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] 10.222.0.43 "POST /compute/v2.1/servers/e616bb7a-3fab-411e-ab23-25d093c36691/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.592259 Oct 04 22:09:09.880704 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2460/4869] 10.222.0.43 () {60 vars in 1323 bytes} [Tue Oct 4 22:09:09 2022] POST /compute/v2.1/servers/e616bb7a-3fab-411e-ab23-25d093c36691/os-volume_attachments => generated 194 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:09:09.903375 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-e6ac83ef-2c5c-4268-9080-bb2687e436b9 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:09.910110 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-e6ac83ef-2c5c-4268-9080-bb2687e436b9 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: 3b565a7d-fde0-47e5-99b9-1ed5ba9aab93] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:09.920650 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e6ac83ef-2c5c-4268-9080-bb2687e436b9 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:09.921596 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e6ac83ef-2c5c-4268-9080-bb2687e436b9 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:09.922298 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e6ac83ef-2c5c-4268-9080-bb2687e436b9 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:09.923341 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e6ac83ef-2c5c-4268-9080-bb2687e436b9 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:09.924233 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e6ac83ef-2c5c-4268-9080-bb2687e436b9 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:09.924952 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e6ac83ef-2c5c-4268-9080-bb2687e436b9 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:10.692196 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-e6ac83ef-2c5c-4268-9080-bb2687e436b9 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1682f1a60045d8a04d4d67393cd13f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b00cd9fa8e40a0919b61fcd60269f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:10.705090 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-e6ac83ef-2c5c-4268-9080-bb2687e436b9 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "GET /compute/v2.1/servers/3b565a7d-fde0-47e5-99b9-1ed5ba9aab93" status: 200 len: 1502 microversion: 2.1 time: 0.818720 Oct 04 22:09:10.706160 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2461/4870] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:09:09 2022] GET /compute/v2.1/servers/3b565a7d-fde0-47e5-99b9-1ed5ba9aab93 => generated 1502 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:09:10.719163 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-db5cf134-0c89-40be-87cb-5bfc8abd6654 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:10.720247 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-db5cf134-0c89-40be-87cb-5bfc8abd6654 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] [instance: 367dad85-827d-47b0-a468-418d398b36f9] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:10.739048 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-db5cf134-0c89-40be-87cb-5bfc8abd6654 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:10.739913 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-db5cf134-0c89-40be-87cb-5bfc8abd6654 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:10.740599 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-db5cf134-0c89-40be-87cb-5bfc8abd6654 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:10.741536 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-db5cf134-0c89-40be-87cb-5bfc8abd6654 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:10.742527 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-db5cf134-0c89-40be-87cb-5bfc8abd6654 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:10.743197 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-db5cf134-0c89-40be-87cb-5bfc8abd6654 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:10.803375 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-70e7c990-ee58-4a5d-85e6-af4e778684a5 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:10.805712 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell0:SELECT=2 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:09:10.823395 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-70e7c990-ee58-4a5d-85e6-af4e778684a5 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/3d4d9f68-34fa-48b4-a274-6b389af36686" status: 200 len: 1314 microversion: 2.1 time: 1.067708 Oct 04 22:09:10.824121 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2410/4871] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:09:09 2022] GET /compute/v2.1/servers/3d4d9f68-34fa-48b4-a274-6b389af36686 => generated 1314 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:09:10.830889 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-faebf63b-7f2e-4f8f-8d20-a2205843b38c tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:10.831396 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-faebf63b-7f2e-4f8f-8d20-a2205843b38c tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: 3b565a7d-fde0-47e5-99b9-1ed5ba9aab93] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:10.851435 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-faebf63b-7f2e-4f8f-8d20-a2205843b38c tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:10.857510 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-faebf63b-7f2e-4f8f-8d20-a2205843b38c tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:10.858133 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-faebf63b-7f2e-4f8f-8d20-a2205843b38c tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:10.858925 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-faebf63b-7f2e-4f8f-8d20-a2205843b38c tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:10.859403 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-faebf63b-7f2e-4f8f-8d20-a2205843b38c tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:10.859867 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-faebf63b-7f2e-4f8f-8d20-a2205843b38c tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:10.921558 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-faebf63b-7f2e-4f8f-8d20-a2205843b38c tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: 3b565a7d-fde0-47e5-99b9-1ed5ba9aab93] Going to try to terminate instance {{(pid=134101) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 22:09:11.071440 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-faebf63b-7f2e-4f8f-8d20-a2205843b38c tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "DELETE /compute/v2.1/servers/3b565a7d-fde0-47e5-99b9-1ed5ba9aab93" status: 204 len: 0 microversion: 2.1 time: 0.245600 Oct 04 22:09:11.073571 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2411/4872] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 22:09:10 2022] DELETE /compute/v2.1/servers/3b565a7d-fde0-47e5-99b9-1ed5ba9aab93 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 22:09:11.086698 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-414db96a-efdb-49e3-94b1-56417bf4647b tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:11.087692 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-414db96a-efdb-49e3-94b1-56417bf4647b tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: 3b565a7d-fde0-47e5-99b9-1ed5ba9aab93] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:11.096616 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-414db96a-efdb-49e3-94b1-56417bf4647b tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:11.097384 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-414db96a-efdb-49e3-94b1-56417bf4647b tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:11.097995 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-414db96a-efdb-49e3-94b1-56417bf4647b tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:11.099009 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-414db96a-efdb-49e3-94b1-56417bf4647b tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:11.099653 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-414db96a-efdb-49e3-94b1-56417bf4647b tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:11.100303 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-414db96a-efdb-49e3-94b1-56417bf4647b tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:11.211518 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell0:SELECT=8 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:09:12.049464 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-414db96a-efdb-49e3-94b1-56417bf4647b tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1682f1a60045d8a04d4d67393cd13f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b00cd9fa8e40a0919b61fcd60269f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:12.058356 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-414db96a-efdb-49e3-94b1-56417bf4647b tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "GET /compute/v2.1/servers/3b565a7d-fde0-47e5-99b9-1ed5ba9aab93" status: 200 len: 1508 microversion: 2.1 time: 0.976691 Oct 04 22:09:12.063114 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2412/4873] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:09:11 2022] GET /compute/v2.1/servers/3b565a7d-fde0-47e5-99b9-1ed5ba9aab93 => generated 1508 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:09:12.076184 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-db5cf134-0c89-40be-87cb-5bfc8abd6654 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:12.083576 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-6a17bde2-e461-4986-afdd-9a1ad687e951 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:12.084769 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-6a17bde2-e461-4986-afdd-9a1ad687e951 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 3d4d9f68-34fa-48b4-a274-6b389af36686] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:12.109426 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-db5cf134-0c89-40be-87cb-5bfc8abd6654 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:12.112625 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-db5cf134-0c89-40be-87cb-5bfc8abd6654 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:12.113168 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6a17bde2-e461-4986-afdd-9a1ad687e951 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:12.113982 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6a17bde2-e461-4986-afdd-9a1ad687e951 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:12.114676 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6a17bde2-e461-4986-afdd-9a1ad687e951 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:12.115618 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6a17bde2-e461-4986-afdd-9a1ad687e951 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:12.117333 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-db5cf134-0c89-40be-87cb-5bfc8abd6654 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] 10.222.0.43 "GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9" status: 200 len: 1874 microversion: 2.32 time: 1.407487 Oct 04 22:09:12.127309 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6a17bde2-e461-4986-afdd-9a1ad687e951 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:12.128356 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2462/4874] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:09:10 2022] GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9 => generated 1874 bytes in 1421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:09:12.129064 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6a17bde2-e461-4986-afdd-9a1ad687e951 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:12.434409 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-b9e9d66f-4310-4116-890e-e618157a66b0 req-f62ec6c1-cc97-45ab-ab0b-ea2b0417cbc3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "367dad85-827d-47b0-a468-418d398b36f9", "tag": "8a1449d2-6f50-4eb8-b168-4134f5622384"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:09:12.463124 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-b9e9d66f-4310-4116-890e-e618157a66b0 req-f62ec6c1-cc97-45ab-ab0b-ea2b0417cbc3 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:12.463953 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-b9e9d66f-4310-4116-890e-e618157a66b0 req-f62ec6c1-cc97-45ab-ab0b-ea2b0417cbc3 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:12.464639 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-b9e9d66f-4310-4116-890e-e618157a66b0 req-f62ec6c1-cc97-45ab-ab0b-ea2b0417cbc3 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:12.488670 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-b9e9d66f-4310-4116-890e-e618157a66b0 req-f62ec6c1-cc97-45ab-ab0b-ea2b0417cbc3 service nova] Creating event network-changed:8a1449d2-6f50-4eb8-b168-4134f5622384 for instance 367dad85-827d-47b0-a468-418d398b36f9 on n-h1-860284-1 Oct 04 22:09:12.496986 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-b9e9d66f-4310-4116-890e-e618157a66b0 req-f62ec6c1-cc97-45ab-ab0b-ea2b0417cbc3 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066512 Oct 04 22:09:12.498282 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2463/4875] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:09:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:09:12.828582 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-6a17bde2-e461-4986-afdd-9a1ad687e951 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:12.855226 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-6a17bde2-e461-4986-afdd-9a1ad687e951 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/3d4d9f68-34fa-48b4-a274-6b389af36686" status: 200 len: 1314 microversion: 2.1 time: 0.790569 Oct 04 22:09:12.857753 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2413/4876] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:09:12 2022] GET /compute/v2.1/servers/3d4d9f68-34fa-48b4-a274-6b389af36686 => generated 1314 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:09:13.091295 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-19d339a0-99c6-4528-976f-25f32f12e47a tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:13.092328 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-19d339a0-99c6-4528-976f-25f32f12e47a tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: 3b565a7d-fde0-47e5-99b9-1ed5ba9aab93] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:13.111507 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-19d339a0-99c6-4528-976f-25f32f12e47a tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:13.113417 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-19d339a0-99c6-4528-976f-25f32f12e47a tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:13.115518 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-19d339a0-99c6-4528-976f-25f32f12e47a tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:13.119218 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-19d339a0-99c6-4528-976f-25f32f12e47a tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:13.120539 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-19d339a0-99c6-4528-976f-25f32f12e47a tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:13.123684 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-19d339a0-99c6-4528-976f-25f32f12e47a tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:13.159110 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-100b68c1-9052-4a29-a3c2-7b647febe88f tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:13.159749 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-100b68c1-9052-4a29-a3c2-7b647febe88f tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] [instance: 367dad85-827d-47b0-a468-418d398b36f9] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:13.178462 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-100b68c1-9052-4a29-a3c2-7b647febe88f tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:13.179330 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-100b68c1-9052-4a29-a3c2-7b647febe88f tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:13.183245 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-100b68c1-9052-4a29-a3c2-7b647febe88f tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:13.187718 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-100b68c1-9052-4a29-a3c2-7b647febe88f tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:13.193600 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-100b68c1-9052-4a29-a3c2-7b647febe88f tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:13.194270 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-100b68c1-9052-4a29-a3c2-7b647febe88f tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:13.230321 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:09:13.873043 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-19d339a0-99c6-4528-976f-25f32f12e47a tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1682f1a60045d8a04d4d67393cd13f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b00cd9fa8e40a0919b61fcd60269f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:13.885462 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-19d339a0-99c6-4528-976f-25f32f12e47a tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "GET /compute/v2.1/servers/3b565a7d-fde0-47e5-99b9-1ed5ba9aab93" status: 200 len: 1508 microversion: 2.1 time: 0.800854 Oct 04 22:09:13.903275 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2464/4877] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:09:13 2022] GET /compute/v2.1/servers/3b565a7d-fde0-47e5-99b9-1ed5ba9aab93 => generated 1508 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:09:13.920258 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-2e69b20d-9285-45b2-b3a8-9d324c8affb4 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:13.923540 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-2e69b20d-9285-45b2-b3a8-9d324c8affb4 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 3d4d9f68-34fa-48b4-a274-6b389af36686] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:13.942013 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2e69b20d-9285-45b2-b3a8-9d324c8affb4 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:13.942971 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2e69b20d-9285-45b2-b3a8-9d324c8affb4 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:13.943834 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2e69b20d-9285-45b2-b3a8-9d324c8affb4 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:13.950107 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2e69b20d-9285-45b2-b3a8-9d324c8affb4 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:13.951065 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2e69b20d-9285-45b2-b3a8-9d324c8affb4 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:13.951648 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2e69b20d-9285-45b2-b3a8-9d324c8affb4 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:14.365108 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-100b68c1-9052-4a29-a3c2-7b647febe88f tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:14.378766 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-100b68c1-9052-4a29-a3c2-7b647febe88f tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:14.384332 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-100b68c1-9052-4a29-a3c2-7b647febe88f tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:14.396031 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-100b68c1-9052-4a29-a3c2-7b647febe88f tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] 10.222.0.43 "GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9" status: 200 len: 1874 microversion: 2.32 time: 1.243298 Oct 04 22:09:14.397463 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2414/4878] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:09:13 2022] GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9 => generated 1874 bytes in 1246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 22:09:14.727368 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-2e69b20d-9285-45b2-b3a8-9d324c8affb4 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:14.740726 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-2e69b20d-9285-45b2-b3a8-9d324c8affb4 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/3d4d9f68-34fa-48b4-a274-6b389af36686" status: 200 len: 1314 microversion: 2.1 time: 0.836050 Oct 04 22:09:14.763220 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2465/4879] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:09:13 2022] GET /compute/v2.1/servers/3d4d9f68-34fa-48b4-a274-6b389af36686 => generated 1314 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:09:14.921239 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-62d74ee5-d325-4626-9bd2-1cb3648b7de3 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:14.922066 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-62d74ee5-d325-4626-9bd2-1cb3648b7de3 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: 3b565a7d-fde0-47e5-99b9-1ed5ba9aab93] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:14.931450 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-62d74ee5-d325-4626-9bd2-1cb3648b7de3 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:14.932362 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-62d74ee5-d325-4626-9bd2-1cb3648b7de3 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:14.933187 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-62d74ee5-d325-4626-9bd2-1cb3648b7de3 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:14.934198 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-62d74ee5-d325-4626-9bd2-1cb3648b7de3 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:14.935958 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-62d74ee5-d325-4626-9bd2-1cb3648b7de3 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:14.936700 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-62d74ee5-d325-4626-9bd2-1cb3648b7de3 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:15.455873 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-4a462a23-9cd1-4207-93e6-b4265f6b1b51 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:15.456524 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-4a462a23-9cd1-4207-93e6-b4265f6b1b51 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] [instance: 367dad85-827d-47b0-a468-418d398b36f9] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:15.476271 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4a462a23-9cd1-4207-93e6-b4265f6b1b51 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:15.477215 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4a462a23-9cd1-4207-93e6-b4265f6b1b51 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:15.478179 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4a462a23-9cd1-4207-93e6-b4265f6b1b51 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:15.479346 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4a462a23-9cd1-4207-93e6-b4265f6b1b51 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:15.481454 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4a462a23-9cd1-4207-93e6-b4265f6b1b51 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:15.482168 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4a462a23-9cd1-4207-93e6-b4265f6b1b51 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:15.557611 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-62d74ee5-d325-4626-9bd2-1cb3648b7de3 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1682f1a60045d8a04d4d67393cd13f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b00cd9fa8e40a0919b61fcd60269f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:15.590547 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-62d74ee5-d325-4626-9bd2-1cb3648b7de3 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "GET /compute/v2.1/servers/3b565a7d-fde0-47e5-99b9-1ed5ba9aab93" status: 200 len: 1508 microversion: 2.1 time: 0.673335 Oct 04 22:09:15.599511 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2415/4880] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:09:14 2022] GET /compute/v2.1/servers/3b565a7d-fde0-47e5-99b9-1ed5ba9aab93 => generated 1508 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:09:15.776573 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-d68ef9f9-6a41-4986-bd41-626535671762 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:15.777681 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-d68ef9f9-6a41-4986-bd41-626535671762 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 3d4d9f68-34fa-48b4-a274-6b389af36686] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:15.809675 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d68ef9f9-6a41-4986-bd41-626535671762 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:15.819076 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d68ef9f9-6a41-4986-bd41-626535671762 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:15.820079 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d68ef9f9-6a41-4986-bd41-626535671762 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:15.823286 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d68ef9f9-6a41-4986-bd41-626535671762 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:15.824258 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d68ef9f9-6a41-4986-bd41-626535671762 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:15.825026 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d68ef9f9-6a41-4986-bd41-626535671762 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:16.103333 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-4a462a23-9cd1-4207-93e6-b4265f6b1b51 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:16.120363 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-4a462a23-9cd1-4207-93e6-b4265f6b1b51 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:16.129684 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-4a462a23-9cd1-4207-93e6-b4265f6b1b51 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:16.133821 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-4a462a23-9cd1-4207-93e6-b4265f6b1b51 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] 10.222.0.43 "GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9" status: 200 len: 1874 microversion: 2.32 time: 0.684064 Oct 04 22:09:16.153824 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2466/4881] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:09:15 2022] GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9 => generated 1874 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 22:09:16.293620 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-d68ef9f9-6a41-4986-bd41-626535671762 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:16.307271 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-d68ef9f9-6a41-4986-bd41-626535671762 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/3d4d9f68-34fa-48b4-a274-6b389af36686" status: 200 len: 1314 microversion: 2.1 time: 0.539017 Oct 04 22:09:16.308504 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2416/4882] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:09:15 2022] GET /compute/v2.1/servers/3d4d9f68-34fa-48b4-a274-6b389af36686 => generated 1314 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:09:16.633197 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-b4127459-a4fd-4b4d-8ed1-023abbf36691 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:16.633769 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-b4127459-a4fd-4b4d-8ed1-023abbf36691 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: 3b565a7d-fde0-47e5-99b9-1ed5ba9aab93] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:16.647228 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b4127459-a4fd-4b4d-8ed1-023abbf36691 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:16.647723 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b4127459-a4fd-4b4d-8ed1-023abbf36691 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:16.648989 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b4127459-a4fd-4b4d-8ed1-023abbf36691 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:16.650003 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b4127459-a4fd-4b4d-8ed1-023abbf36691 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:16.652393 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b4127459-a4fd-4b4d-8ed1-023abbf36691 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:16.653118 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b4127459-a4fd-4b4d-8ed1-023abbf36691 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:16.888104 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-860450c6-1ad7-4a77-b6e5-e713a36f8d33 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:16.888782 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-860450c6-1ad7-4a77-b6e5-e713a36f8d33 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] [instance: 9f29b298-6acb-468a-b28b-6ce95ba57ea2] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:16.899689 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-860450c6-1ad7-4a77-b6e5-e713a36f8d33 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:16.903901 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-860450c6-1ad7-4a77-b6e5-e713a36f8d33 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:16.905928 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-860450c6-1ad7-4a77-b6e5-e713a36f8d33 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:16.908808 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-860450c6-1ad7-4a77-b6e5-e713a36f8d33 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:16.915900 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-860450c6-1ad7-4a77-b6e5-e713a36f8d33 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:16.917896 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-860450c6-1ad7-4a77-b6e5-e713a36f8d33 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:16.991158 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-860450c6-1ad7-4a77-b6e5-e713a36f8d33 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] [instance: 9f29b298-6acb-468a-b28b-6ce95ba57ea2] Going to try to terminate instance {{(pid=134101) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 22:09:17.058544 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-b4127459-a4fd-4b4d-8ed1-023abbf36691 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1682f1a60045d8a04d4d67393cd13f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b00cd9fa8e40a0919b61fcd60269f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:17.072199 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-b4127459-a4fd-4b4d-8ed1-023abbf36691 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "GET /compute/v2.1/servers/3b565a7d-fde0-47e5-99b9-1ed5ba9aab93" status: 200 len: 1508 microversion: 2.1 time: 0.444462 Oct 04 22:09:17.073824 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2467/4883] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:09:16 2022] GET /compute/v2.1/servers/3b565a7d-fde0-47e5-99b9-1ed5ba9aab93 => generated 1508 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:09:17.166612 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-016378a6-12c8-4d44-9535-777a47f38679 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:17.167869 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-016378a6-12c8-4d44-9535-777a47f38679 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] [instance: 367dad85-827d-47b0-a468-418d398b36f9] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:17.182007 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-016378a6-12c8-4d44-9535-777a47f38679 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:17.183118 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-016378a6-12c8-4d44-9535-777a47f38679 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:17.187364 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-860450c6-1ad7-4a77-b6e5-e713a36f8d33 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] 10.222.0.43 "DELETE /compute/v2.1/servers/9f29b298-6acb-468a-b28b-6ce95ba57ea2" status: 204 len: 0 microversion: 2.1 time: 0.304567 Oct 04 22:09:17.189180 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-016378a6-12c8-4d44-9535-777a47f38679 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:17.190086 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2417/4884] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 22:09:16 2022] DELETE /compute/v2.1/servers/9f29b298-6acb-468a-b28b-6ce95ba57ea2 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 22:09:17.195178 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-016378a6-12c8-4d44-9535-777a47f38679 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:17.196234 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-016378a6-12c8-4d44-9535-777a47f38679 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:17.196956 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-016378a6-12c8-4d44-9535-777a47f38679 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:17.201273 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-3de094da-5a6c-40ec-a42d-77c2a95f891a tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:17.202834 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-3de094da-5a6c-40ec-a42d-77c2a95f891a tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] [instance: 9f29b298-6acb-468a-b28b-6ce95ba57ea2] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:17.213548 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3de094da-5a6c-40ec-a42d-77c2a95f891a tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:17.214742 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3de094da-5a6c-40ec-a42d-77c2a95f891a tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:17.215386 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3de094da-5a6c-40ec-a42d-77c2a95f891a tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:17.216614 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3de094da-5a6c-40ec-a42d-77c2a95f891a tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:17.217284 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3de094da-5a6c-40ec-a42d-77c2a95f891a tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:17.218043 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3de094da-5a6c-40ec-a42d-77c2a95f891a tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:17.704974 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-016378a6-12c8-4d44-9535-777a47f38679 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:17.720750 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-016378a6-12c8-4d44-9535-777a47f38679 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:17.721960 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-3de094da-5a6c-40ec-a42d-77c2a95f891a tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e72a1a5d1a4c4b838acb169ab11eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b556e1ace286450f8493715e8317a107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:17.722576 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-016378a6-12c8-4d44-9535-777a47f38679 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:17.724465 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-016378a6-12c8-4d44-9535-777a47f38679 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] 10.222.0.43 "GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9" status: 200 len: 1874 microversion: 2.32 time: 0.562629 Oct 04 22:09:17.726150 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2468/4885] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:09:17 2022] GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9 => generated 1874 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:09:17.733780 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-8077b943-4e51-4ba3-8781-b9a137b842c2 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:17.734530 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-8077b943-4e51-4ba3-8781-b9a137b842c2 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 3d4d9f68-34fa-48b4-a274-6b389af36686] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:17.746543 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8077b943-4e51-4ba3-8781-b9a137b842c2 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:17.747715 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8077b943-4e51-4ba3-8781-b9a137b842c2 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:17.748355 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8077b943-4e51-4ba3-8781-b9a137b842c2 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:17.749339 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8077b943-4e51-4ba3-8781-b9a137b842c2 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:17.749816 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8077b943-4e51-4ba3-8781-b9a137b842c2 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:17.750282 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8077b943-4e51-4ba3-8781-b9a137b842c2 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:17.755387 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-3de094da-5a6c-40ec-a42d-77c2a95f891a tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] 10.222.0.43 "GET /compute/v2.1/servers/9f29b298-6acb-468a-b28b-6ce95ba57ea2" status: 200 len: 1513 microversion: 2.1 time: 0.559088 Oct 04 22:09:17.758089 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2418/4886] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:09:17 2022] GET /compute/v2.1/servers/9f29b298-6acb-468a-b28b-6ce95ba57ea2 => generated 1513 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:09:17.962572 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-b2c18b67-4d88-47b8-bffd-cfb2871b193b req-5ddd9a5d-4dce-49bf-bf8c-101d3204a666 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b565a7d-fde0-47e5-99b9-1ed5ba9aab93", "name": "network-vif-deleted", "tag": "628ec69c-47ae-49e4-a271-03107301cdf9"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:09:17.992314 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-b2c18b67-4d88-47b8-bffd-cfb2871b193b req-5ddd9a5d-4dce-49bf-bf8c-101d3204a666 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:17.993337 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-b2c18b67-4d88-47b8-bffd-cfb2871b193b req-5ddd9a5d-4dce-49bf-bf8c-101d3204a666 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:17.994008 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-b2c18b67-4d88-47b8-bffd-cfb2871b193b req-5ddd9a5d-4dce-49bf-bf8c-101d3204a666 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:18.028956 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-b2c18b67-4d88-47b8-bffd-cfb2871b193b req-5ddd9a5d-4dce-49bf-bf8c-101d3204a666 service nova] Creating event network-vif-deleted:628ec69c-47ae-49e4-a271-03107301cdf9 for instance 3b565a7d-fde0-47e5-99b9-1ed5ba9aab93 on n-h2-860284-1 Oct 04 22:09:18.044230 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-b2c18b67-4d88-47b8-bffd-cfb2871b193b req-5ddd9a5d-4dce-49bf-bf8c-101d3204a666 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.284628 Oct 04 22:09:18.045384 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2419/4887] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:09:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:09:18.117245 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-4fa90ceb-8fe9-4a4f-9a24-99812b17bf05 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:18.118382 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-4fa90ceb-8fe9-4a4f-9a24-99812b17bf05 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: 3b565a7d-fde0-47e5-99b9-1ed5ba9aab93] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:18.132720 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4fa90ceb-8fe9-4a4f-9a24-99812b17bf05 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:18.138442 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4fa90ceb-8fe9-4a4f-9a24-99812b17bf05 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:18.139233 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4fa90ceb-8fe9-4a4f-9a24-99812b17bf05 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:18.140408 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4fa90ceb-8fe9-4a4f-9a24-99812b17bf05 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:18.142527 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4fa90ceb-8fe9-4a4f-9a24-99812b17bf05 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:18.144529 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4fa90ceb-8fe9-4a4f-9a24-99812b17bf05 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:18.373272 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-4fa90ceb-8fe9-4a4f-9a24-99812b17bf05 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1682f1a60045d8a04d4d67393cd13f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b00cd9fa8e40a0919b61fcd60269f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:18.414184 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-4fa90ceb-8fe9-4a4f-9a24-99812b17bf05 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "GET /compute/v2.1/servers/3b565a7d-fde0-47e5-99b9-1ed5ba9aab93" status: 200 len: 1466 microversion: 2.1 time: 0.301943 Oct 04 22:09:18.415127 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2420/4888] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:09:18 2022] GET /compute/v2.1/servers/3b565a7d-fde0-47e5-99b9-1ed5ba9aab93 => generated 1466 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:09:18.764444 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-d1a08c96-ca16-4884-a358-20975f713b95 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:18.766938 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-d1a08c96-ca16-4884-a358-20975f713b95 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] [instance: 367dad85-827d-47b0-a468-418d398b36f9] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:18.793643 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d1a08c96-ca16-4884-a358-20975f713b95 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:18.798827 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d1a08c96-ca16-4884-a358-20975f713b95 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:18.799368 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d1a08c96-ca16-4884-a358-20975f713b95 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:18.800139 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d1a08c96-ca16-4884-a358-20975f713b95 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:18.800612 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d1a08c96-ca16-4884-a358-20975f713b95 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:18.803805 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d1a08c96-ca16-4884-a358-20975f713b95 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:18.850747 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-8077b943-4e51-4ba3-8781-b9a137b842c2 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:18.870478 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-8077b943-4e51-4ba3-8781-b9a137b842c2 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/3d4d9f68-34fa-48b4-a274-6b389af36686" status: 200 len: 1314 microversion: 2.1 time: 1.137769 Oct 04 22:09:18.887530 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2469/4889] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:09:17 2022] GET /compute/v2.1/servers/3d4d9f68-34fa-48b4-a274-6b389af36686 => generated 1314 bytes in 1149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:09:18.894128 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-13d01122-c4ae-451d-a15f-bd7c6e1953dc tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:18.908462 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-13d01122-c4ae-451d-a15f-bd7c6e1953dc tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] [instance: 9f29b298-6acb-468a-b28b-6ce95ba57ea2] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:18.917828 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-13d01122-c4ae-451d-a15f-bd7c6e1953dc tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:18.918427 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-13d01122-c4ae-451d-a15f-bd7c6e1953dc tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:18.919018 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-13d01122-c4ae-451d-a15f-bd7c6e1953dc tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:18.919939 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-13d01122-c4ae-451d-a15f-bd7c6e1953dc tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:18.920523 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-13d01122-c4ae-451d-a15f-bd7c6e1953dc tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:18.922016 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-13d01122-c4ae-451d-a15f-bd7c6e1953dc tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:19.711267 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-13d01122-c4ae-451d-a15f-bd7c6e1953dc tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e72a1a5d1a4c4b838acb169ab11eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b556e1ace286450f8493715e8317a107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:19.720195 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-d1a08c96-ca16-4884-a358-20975f713b95 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:19.725498 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-13d01122-c4ae-451d-a15f-bd7c6e1953dc tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] 10.222.0.43 "GET /compute/v2.1/servers/9f29b298-6acb-468a-b28b-6ce95ba57ea2" status: 200 len: 1513 microversion: 2.1 time: 0.847841 Oct 04 22:09:19.727243 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2470/4890] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:09:18 2022] GET /compute/v2.1/servers/9f29b298-6acb-468a-b28b-6ce95ba57ea2 => generated 1513 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:09:19.733935 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-2492fad6-f31d-4954-838b-68e8c19281b7 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:19.736026 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-2492fad6-f31d-4954-838b-68e8c19281b7 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: 3b565a7d-fde0-47e5-99b9-1ed5ba9aab93] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:19.744540 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2492fad6-f31d-4954-838b-68e8c19281b7 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:19.745451 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2492fad6-f31d-4954-838b-68e8c19281b7 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:19.746162 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2492fad6-f31d-4954-838b-68e8c19281b7 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:19.747745 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2492fad6-f31d-4954-838b-68e8c19281b7 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:19.749421 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2492fad6-f31d-4954-838b-68e8c19281b7 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:19.750164 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2492fad6-f31d-4954-838b-68e8c19281b7 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:19.774387 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-2492fad6-f31d-4954-838b-68e8c19281b7 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] HTTP exception thrown: Instance 3b565a7d-fde0-47e5-99b9-1ed5ba9aab93 could not be found. Oct 04 22:09:19.776933 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-2492fad6-f31d-4954-838b-68e8c19281b7 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Request method failure captured: Oct 04 22:09:19.776933 n-d-860284-1 devstack@n-api.service[134102]: request: GET /compute/v2.1/servers/3b565a7d-fde0-47e5-99b9-1ed5ba9aab93 HTTP/1.1 Oct 04 22:09:19.776933 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 22:09:19.776933 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 22:09:19.776933 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 22:09:19.776933 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 22:09:19.776933 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 22:09:19.776933 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 22:09:19.776933 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 22:09:19.776933 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 22:09:19.776933 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPK7MP0-m-xtUnxXwLoxlIfO4jzoQOT6GMi-_9Rz-dG646c6MuQMOjiOhGtcOohb2ZIUdejR42Va0IkiFMBDtdnbnUEdF8Psxz0uHfYGBQiEZpqo4CpOHPpz5KjUxS1LmPgcFnegJZtGQu1irxi49GMeHkm9nnXbxd63druWj1zFChJ4 Oct 04 22:09:19.776933 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 22:09:19.776933 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 22:09:19.776933 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 22:09:19.776933 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 22:09:19.776933 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 22:09:19.776933 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 22:09:19.776933 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: d4b00cd9fa8e40a0919b61fcd60269f5 Oct 04 22:09:19.776933 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-ServersTestJSON-1600369848 Oct 04 22:09:19.776933 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 22:09:19.776933 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 22:09:19.776933 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d4b00cd9fa8e40a0919b61fcd60269f5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_d4b00cd9fa8e40a0919b61fcd60269f5", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d4b00cd9fa8e40a0919b61fcd60269f5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/d4b00cd9fa8e40a0919b61fcd60269f5"}]}] Oct 04 22:09:19.776933 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-ServersTestJSON-1600369848 Oct 04 22:09:19.776933 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: d4b00cd9fa8e40a0919b61fcd60269f5 Oct 04 22:09:19.776933 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-ServersTestJSON-1600369848 Oct 04 22:09:19.776933 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-ServersTestJSON-1600369848-project Oct 04 22:09:19.776933 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 22:09:19.776933 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 22:09:19.776933 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: 9c1682f1a60045d8a04d4d67393cd13f Oct 04 22:09:19.776933 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-ServersTestJSON-1600369848-project Oct 04 22:09:19.776933 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 22:09:19.776933 n-d-860284-1 devstack@n-api.service[134102]: exception: Instance 3b565a7d-fde0-47e5-99b9-1ed5ba9aab93 could not be found. Oct 04 22:09:19.776933 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': '3b565a7d-fde0-47e5-99b9-1ed5ba9aab93'} Oct 04 22:09:19.776933 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:09:19.776933 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:09:19.776933 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:09:19.776933 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:09:19.776933 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:09:19.776933 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:09:19.776933 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:09:19.776933 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:09:19.776933 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:09:19.776933 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:09:19.776933 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b565a7d-fde0-47e5-99b9-1ed5ba9aab93 could not be found. Oct 04 22:09:19.776933 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:09:19.776933 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:09:19.776933 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:09:19.776933 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:09:19.776933 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:09:19.776933 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:09:19.776933 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:09:19.776933 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:09:19.776933 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:09:19.776933 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:09:19.776933 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:09:19.776933 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:09:19.776933 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:09:19.776933 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:09:19.776933 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:09:19.776933 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:09:19.776933 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b565a7d-fde0-47e5-99b9-1ed5ba9aab93 could not be found. Oct 04 22:09:19.776933 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:09:19.776933 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:09:19.776933 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:09:19.784820 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:09:19.784820 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:09:19.784820 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:09:19.784820 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:09:19.784820 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:09:19.784820 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b565a7d-fde0-47e5-99b9-1ed5ba9aab93 could not be found. Oct 04 22:09:19.784820 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:09:19.785340 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-d1a08c96-ca16-4884-a358-20975f713b95 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:19.785340 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-d1a08c96-ca16-4884-a358-20975f713b95 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:19.788860 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-2492fad6-f31d-4954-838b-68e8c19281b7 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Returning 404 to user: Instance 3b565a7d-fde0-47e5-99b9-1ed5ba9aab93 could not be found. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:09:19.790579 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-2492fad6-f31d-4954-838b-68e8c19281b7 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "GET /compute/v2.1/servers/3b565a7d-fde0-47e5-99b9-1ed5ba9aab93" status: 404 len: 111 microversion: 2.1 time: 0.061033 Oct 04 22:09:19.791629 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2471/4891] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:09:19 2022] GET /compute/v2.1/servers/3b565a7d-fde0-47e5-99b9-1ed5ba9aab93 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:09:19.799984 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-d1a08c96-ca16-4884-a358-20975f713b95 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] 10.222.0.43 "GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9" status: 200 len: 1874 microversion: 2.32 time: 1.040034 Oct 04 22:09:19.816505 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2421/4892] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:09:18 2022] GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9 => generated 1874 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 22:09:19.826422 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-da154b00-342d-44b3-bea5-017e30860c41 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Action: 'create', calling method: .version_select at 0x7fbb2e76b0d0>, body: {"keypair": {"name": "tempest-key-450823448", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIuEFnv141Jd5xW4YI/FpDkFH9xbFITdo8qJswPkg0o7t43/M7l76iUuKrQDf67qcqBf/jiGWmswEHE2W0sVIUXB0X1HiaK4jjUz1kZPe2G82H43Qcypsf7TAvd7j26VmA=="}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:09:19.843447 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-bb1ae353-dc4f-4bc0-8302-249469c5bbd9 req-e025cb34-ee98-4a5c-9b7c-b0761577b28e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d4d9f68-34fa-48b4-a274-6b389af36686", "name": "network-vif-plugged", "status": "completed", "tag": "f13beae5-f748-444a-889a-9f97d7e0da5c"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:09:19.869462 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-bb1ae353-dc4f-4bc0-8302-249469c5bbd9 req-e025cb34-ee98-4a5c-9b7c-b0761577b28e service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:19.870006 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-bb1ae353-dc4f-4bc0-8302-249469c5bbd9 req-e025cb34-ee98-4a5c-9b7c-b0761577b28e service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:19.870487 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-bb1ae353-dc4f-4bc0-8302-249469c5bbd9 req-e025cb34-ee98-4a5c-9b7c-b0761577b28e service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:19.936938 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-bb1ae353-dc4f-4bc0-8302-249469c5bbd9 req-e025cb34-ee98-4a5c-9b7c-b0761577b28e service nova] Creating event network-vif-plugged:f13beae5-f748-444a-889a-9f97d7e0da5c for instance 3d4d9f68-34fa-48b4-a274-6b389af36686 on n-h1-860284-1 Oct 04 22:09:19.937710 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-da154b00-342d-44b3-bea5-017e30860c41 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Getting quotas for project d4b00cd9fa8e40a0919b61fcd60269f5. Resources: {'key_pairs'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:09:19.950751 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-bb1ae353-dc4f-4bc0-8302-249469c5bbd9 req-e025cb34-ee98-4a5c-9b7c-b0761577b28e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112553 Oct 04 22:09:19.955679 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2422/4893] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:09:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Oct 04 22:09:19.956764 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-da154b00-342d-44b3-bea5-017e30860c41 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Getting quotas for user 9c1682f1a60045d8a04d4d67393cd13f and project d4b00cd9fa8e40a0919b61fcd60269f5. Resources: {'key_pairs'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:09:19.992182 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-ee7ed4e1-efde-4c2a-b3c1-3338ccc311b0 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:19.992928 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-ee7ed4e1-efde-4c2a-b3c1-3338ccc311b0 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 3d4d9f68-34fa-48b4-a274-6b389af36686] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:20.014089 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-da154b00-342d-44b3-bea5-017e30860c41 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 381 microversion: 2.1 time: 0.201018 Oct 04 22:09:20.017556 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2472/4894] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Oct 4 22:09:19 2022] POST /compute/v2.1/os-keypairs => generated 381 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:09:20.019760 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ee7ed4e1-efde-4c2a-b3c1-3338ccc311b0 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:20.020273 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ee7ed4e1-efde-4c2a-b3c1-3338ccc311b0 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:20.020729 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ee7ed4e1-efde-4c2a-b3c1-3338ccc311b0 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:20.021627 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ee7ed4e1-efde-4c2a-b3c1-3338ccc311b0 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:20.022106 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ee7ed4e1-efde-4c2a-b3c1-3338ccc311b0 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:20.022575 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ee7ed4e1-efde-4c2a-b3c1-3338ccc311b0 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:20.032484 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-193fa892-79f6-474c-bd0a-8a521cc6ecfc tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Calling method '.version_select at 0x7fbb2f754700>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:20.050068 n-d-860284-1 devstack@n-api.service[134102]: WARNING oslo_db.sqlalchemy.utils [None req-193fa892-79f6-474c-bd0a-8a521cc6ecfc tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 04 22:09:20.056331 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-193fa892-79f6-474c-bd0a-8a521cc6ecfc tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "GET /compute/v2.1/os-keypairs" status: 200 len: 350 microversion: 2.1 time: 0.033582 Oct 04 22:09:20.057618 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2473/4895] 10.222.0.43 () {58 vars in 1137 bytes} [Tue Oct 4 22:09:20 2022] GET /compute/v2.1/os-keypairs => generated 350 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:09:20.150897 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-7837af26-3ccb-4f28-8498-e6dbd2ceabed tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1975535146", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452", "key_name": "tempest-key-450823448", "networks": [{"uuid": "3e97795f-9423-4034-b566-4a70497d6dcc"}]}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:09:20.257296 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.network.neutron [None req-7837af26-3ccb-4f28-8498-e6dbd2ceabed tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] validate_networks() for [('3e97795f-9423-4034-b566-4a70497d6dcc', None, None, None, None, None)] {{(pid=134102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 22:09:20.772568 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-ee7ed4e1-efde-4c2a-b3c1-3338ccc311b0 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:20.783898 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-ee7ed4e1-efde-4c2a-b3c1-3338ccc311b0 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/3d4d9f68-34fa-48b4-a274-6b389af36686" status: 200 len: 1314 microversion: 2.1 time: 0.824844 Oct 04 22:09:20.794836 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2423/4896] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:09:19 2022] GET /compute/v2.1/servers/3d4d9f68-34fa-48b4-a274-6b389af36686 => generated 1314 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:09:20.806250 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-8c391031-e0f4-4ccf-b4cf-94a1c9b9c725 req-081dbe32-c2b3-4414-b09d-967e19d535dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "367dad85-827d-47b0-a468-418d398b36f9", "tag": "2185372b-2bf8-48af-a686-257c42659538"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:09:20.817649 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-8c391031-e0f4-4ccf-b4cf-94a1c9b9c725 req-081dbe32-c2b3-4414-b09d-967e19d535dd service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:20.818451 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-8c391031-e0f4-4ccf-b4cf-94a1c9b9c725 req-081dbe32-c2b3-4414-b09d-967e19d535dd service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:20.819190 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-8c391031-e0f4-4ccf-b4cf-94a1c9b9c725 req-081dbe32-c2b3-4414-b09d-967e19d535dd service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:20.835336 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-8c391031-e0f4-4ccf-b4cf-94a1c9b9c725 req-081dbe32-c2b3-4414-b09d-967e19d535dd service nova] Creating event network-changed:2185372b-2bf8-48af-a686-257c42659538 for instance 367dad85-827d-47b0-a468-418d398b36f9 on n-h1-860284-1 Oct 04 22:09:20.843022 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-8c391031-e0f4-4ccf-b4cf-94a1c9b9c725 req-081dbe32-c2b3-4414-b09d-967e19d535dd service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046466 Oct 04 22:09:20.844315 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2424/4897] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:09:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:09:20.850349 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-6929b5f6-3956-4df5-83fe-902d3026bc12 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:20.851482 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-6929b5f6-3956-4df5-83fe-902d3026bc12 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] [instance: 9f29b298-6acb-468a-b28b-6ce95ba57ea2] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:20.860488 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6929b5f6-3956-4df5-83fe-902d3026bc12 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:20.861280 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6929b5f6-3956-4df5-83fe-902d3026bc12 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:20.862536 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6929b5f6-3956-4df5-83fe-902d3026bc12 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:20.863581 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6929b5f6-3956-4df5-83fe-902d3026bc12 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:20.864350 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6929b5f6-3956-4df5-83fe-902d3026bc12 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:20.865041 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6929b5f6-3956-4df5-83fe-902d3026bc12 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:21.255023 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-6929b5f6-3956-4df5-83fe-902d3026bc12 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e72a1a5d1a4c4b838acb169ab11eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b556e1ace286450f8493715e8317a107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:21.268405 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-6929b5f6-3956-4df5-83fe-902d3026bc12 tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] 10.222.0.43 "GET /compute/v2.1/servers/9f29b298-6acb-468a-b28b-6ce95ba57ea2" status: 200 len: 1513 microversion: 2.1 time: 0.419790 Oct 04 22:09:21.269197 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2425/4898] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:09:20 2022] GET /compute/v2.1/servers/9f29b298-6acb-468a-b28b-6ce95ba57ea2 => generated 1513 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:09:21.277482 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-75c070be-e138-47b0-8679-ddf21b8504af tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:21.278644 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-75c070be-e138-47b0-8679-ddf21b8504af tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] [instance: 367dad85-827d-47b0-a468-418d398b36f9] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:21.294247 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-75c070be-e138-47b0-8679-ddf21b8504af tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:21.300061 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-75c070be-e138-47b0-8679-ddf21b8504af tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:21.300868 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-75c070be-e138-47b0-8679-ddf21b8504af tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:21.303040 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-75c070be-e138-47b0-8679-ddf21b8504af tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:21.306937 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-75c070be-e138-47b0-8679-ddf21b8504af tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:21.309636 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-75c070be-e138-47b0-8679-ddf21b8504af tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:21.578154 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-7837af26-3ccb-4f28-8498-e6dbd2ceabed tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Flavor limits 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 22:09:21.579290 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-7837af26-3ccb-4f28-8498-e6dbd2ceabed tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Image limits 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 22:09:21.579870 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-7837af26-3ccb-4f28-8498-e6dbd2ceabed tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Flavor pref 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 22:09:21.580292 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-7837af26-3ccb-4f28-8498-e6dbd2ceabed tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Image pref 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 22:09:21.580709 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-7837af26-3ccb-4f28-8498-e6dbd2ceabed tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 22:09:21.604340 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7837af26-3ccb-4f28-8498-e6dbd2ceabed tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:21.604850 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7837af26-3ccb-4f28-8498-e6dbd2ceabed tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:21.605457 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7837af26-3ccb-4f28-8498-e6dbd2ceabed tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:21.606218 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7837af26-3ccb-4f28-8498-e6dbd2ceabed tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:21.606740 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7837af26-3ccb-4f28-8498-e6dbd2ceabed tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:21.607181 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7837af26-3ccb-4f28-8498-e6dbd2ceabed tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:21.620074 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-75c070be-e138-47b0-8679-ddf21b8504af tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:21.636521 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-7837af26-3ccb-4f28-8498-e6dbd2ceabed tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Getting quotas for project d4b00cd9fa8e40a0919b61fcd60269f5. Resources: {'instances', 'ram', 'cores'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:09:21.638052 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-75c070be-e138-47b0-8679-ddf21b8504af tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:21.639481 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-75c070be-e138-47b0-8679-ddf21b8504af tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:21.640665 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-75c070be-e138-47b0-8679-ddf21b8504af tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] 10.222.0.43 "GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9" status: 200 len: 1874 microversion: 2.32 time: 0.370507 Oct 04 22:09:21.642689 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2426/4899] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:09:21 2022] GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9 => generated 1874 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:09:21.642867 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-7837af26-3ccb-4f28-8498-e6dbd2ceabed tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Getting quotas for user 9c1682f1a60045d8a04d4d67393cd13f and project d4b00cd9fa8e40a0919b61fcd60269f5. Resources: {'instances', 'ram', 'cores'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:09:21.669643 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-7837af26-3ccb-4f28-8498-e6dbd2ceabed tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Going to run 1 instances... {{(pid=134102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 22:09:21.672841 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-7837af26-3ccb-4f28-8498-e6dbd2ceabed tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: 25c0bc2a-016e-441c-aeda-ad5c48f755fa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='58548514-5dac-426c-81f5-19e3fba33e23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 22:09:21.770201 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-7837af26-3ccb-4f28-8498-e6dbd2ceabed tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.631053 Oct 04 22:09:21.773675 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2474/4900] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 22:09:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 1638 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 22:09:21.785585 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-fdd898d8-9978-423f-a019-54a74c412049 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:21.786286 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-fdd898d8-9978-423f-a019-54a74c412049 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: 25c0bc2a-016e-441c-aeda-ad5c48f755fa] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:21.810841 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-c365ec12-0044-498e-8e8f-a6cf035b94c3 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:21.811514 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-c365ec12-0044-498e-8e8f-a6cf035b94c3 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 3d4d9f68-34fa-48b4-a274-6b389af36686] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:21.827931 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c365ec12-0044-498e-8e8f-a6cf035b94c3 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:21.837549 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c365ec12-0044-498e-8e8f-a6cf035b94c3 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:21.838153 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c365ec12-0044-498e-8e8f-a6cf035b94c3 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:21.838947 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c365ec12-0044-498e-8e8f-a6cf035b94c3 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:21.839744 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c365ec12-0044-498e-8e8f-a6cf035b94c3 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:21.840187 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c365ec12-0044-498e-8e8f-a6cf035b94c3 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:22.171228 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-fdd898d8-9978-423f-a019-54a74c412049 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1682f1a60045d8a04d4d67393cd13f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b00cd9fa8e40a0919b61fcd60269f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:22.181389 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-fdd898d8-9978-423f-a019-54a74c412049 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "GET /compute/v2.1/servers/25c0bc2a-016e-441c-aeda-ad5c48f755fa" status: 200 len: 1228 microversion: 2.1 time: 0.399817 Oct 04 22:09:22.182779 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2427/4901] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:09:21 2022] GET /compute/v2.1/servers/25c0bc2a-016e-441c-aeda-ad5c48f755fa => generated 1228 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:09:22.298450 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-0e32b66c-f660-4458-896d-b662f77f33fa tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:22.299157 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-0e32b66c-f660-4458-896d-b662f77f33fa tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] [instance: 9f29b298-6acb-468a-b28b-6ce95ba57ea2] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:22.313542 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0e32b66c-f660-4458-896d-b662f77f33fa tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:22.314052 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0e32b66c-f660-4458-896d-b662f77f33fa tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:22.314528 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0e32b66c-f660-4458-896d-b662f77f33fa tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:22.315258 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0e32b66c-f660-4458-896d-b662f77f33fa tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:22.315717 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0e32b66c-f660-4458-896d-b662f77f33fa tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:22.316155 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0e32b66c-f660-4458-896d-b662f77f33fa tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:22.495874 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-c365ec12-0044-498e-8e8f-a6cf035b94c3 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:22.513269 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-c365ec12-0044-498e-8e8f-a6cf035b94c3 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/3d4d9f68-34fa-48b4-a274-6b389af36686" status: 200 len: 1314 microversion: 2.1 time: 0.707129 Oct 04 22:09:22.514180 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2475/4902] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:09:21 2022] GET /compute/v2.1/servers/3d4d9f68-34fa-48b4-a274-6b389af36686 => generated 1314 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:09:22.669504 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-6e260581-ed11-41a5-adbf-60ad2f4af6ed tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:22.671773 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-6e260581-ed11-41a5-adbf-60ad2f4af6ed tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] [instance: 367dad85-827d-47b0-a468-418d398b36f9] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:22.684672 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6e260581-ed11-41a5-adbf-60ad2f4af6ed tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:22.685578 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6e260581-ed11-41a5-adbf-60ad2f4af6ed tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:22.686343 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6e260581-ed11-41a5-adbf-60ad2f4af6ed tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:22.687528 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6e260581-ed11-41a5-adbf-60ad2f4af6ed tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:22.689374 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6e260581-ed11-41a5-adbf-60ad2f4af6ed tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:22.690159 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6e260581-ed11-41a5-adbf-60ad2f4af6ed tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:22.957780 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-0e32b66c-f660-4458-896d-b662f77f33fa tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e72a1a5d1a4c4b838acb169ab11eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b556e1ace286450f8493715e8317a107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:22.974138 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-0e32b66c-f660-4458-896d-b662f77f33fa tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] 10.222.0.43 "GET /compute/v2.1/servers/9f29b298-6acb-468a-b28b-6ce95ba57ea2" status: 200 len: 1513 microversion: 2.1 time: 0.681899 Oct 04 22:09:22.977472 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2428/4903] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:09:22 2022] GET /compute/v2.1/servers/9f29b298-6acb-468a-b28b-6ce95ba57ea2 => generated 1513 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:09:23.102680 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-6e260581-ed11-41a5-adbf-60ad2f4af6ed tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:23.118446 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-6e260581-ed11-41a5-adbf-60ad2f4af6ed tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:23.120227 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-6e260581-ed11-41a5-adbf-60ad2f4af6ed tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:23.121522 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-6e260581-ed11-41a5-adbf-60ad2f4af6ed tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] 10.222.0.43 "GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9" status: 200 len: 1874 microversion: 2.32 time: 0.456807 Oct 04 22:09:23.126554 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2476/4904] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:09:22 2022] GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9 => generated 1874 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:09:23.228837 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-c075a446-4544-4984-a5ee-fe7a3ed9a16e tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:23.229582 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-c075a446-4544-4984-a5ee-fe7a3ed9a16e tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: 25c0bc2a-016e-441c-aeda-ad5c48f755fa] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:23.242806 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c075a446-4544-4984-a5ee-fe7a3ed9a16e tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:23.244428 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c075a446-4544-4984-a5ee-fe7a3ed9a16e tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:23.244924 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c075a446-4544-4984-a5ee-fe7a3ed9a16e tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:23.252043 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c075a446-4544-4984-a5ee-fe7a3ed9a16e tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:23.252564 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c075a446-4544-4984-a5ee-fe7a3ed9a16e tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:23.253019 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c075a446-4544-4984-a5ee-fe7a3ed9a16e tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:23.444012 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-c075a446-4544-4984-a5ee-fe7a3ed9a16e tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1682f1a60045d8a04d4d67393cd13f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b00cd9fa8e40a0919b61fcd60269f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:23.452731 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-c075a446-4544-4984-a5ee-fe7a3ed9a16e tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "GET /compute/v2.1/servers/25c0bc2a-016e-441c-aeda-ad5c48f755fa" status: 200 len: 1224 microversion: 2.1 time: 0.227549 Oct 04 22:09:23.458139 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2429/4905] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:09:23 2022] GET /compute/v2.1/servers/25c0bc2a-016e-441c-aeda-ad5c48f755fa => generated 1224 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:09:23.533481 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-f2ab13e3-b1a3-4893-9249-11e03a503e7c req-d51b1f27-981e-472c-8752-630ce0647f02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f29b298-6acb-468a-b28b-6ce95ba57ea2", "name": "network-vif-deleted", "tag": "02dd4837-dd78-48fb-99a2-b89da47f98d8"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:09:23.554525 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e5a1204d-c32e-46d7-ad4c-f1a86055da8b tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:23.555546 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-e5a1204d-c32e-46d7-ad4c-f1a86055da8b tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 3d4d9f68-34fa-48b4-a274-6b389af36686] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:23.565350 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e5a1204d-c32e-46d7-ad4c-f1a86055da8b tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:23.566418 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e5a1204d-c32e-46d7-ad4c-f1a86055da8b tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:23.567087 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e5a1204d-c32e-46d7-ad4c-f1a86055da8b tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:23.568225 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e5a1204d-c32e-46d7-ad4c-f1a86055da8b tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:23.569052 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e5a1204d-c32e-46d7-ad4c-f1a86055da8b tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:23.569728 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e5a1204d-c32e-46d7-ad4c-f1a86055da8b tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:23.586615 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-f2ab13e3-b1a3-4893-9249-11e03a503e7c req-d51b1f27-981e-472c-8752-630ce0647f02 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:23.589913 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-f2ab13e3-b1a3-4893-9249-11e03a503e7c req-d51b1f27-981e-472c-8752-630ce0647f02 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:23.590827 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-f2ab13e3-b1a3-4893-9249-11e03a503e7c req-d51b1f27-981e-472c-8752-630ce0647f02 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:23.654803 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-f2ab13e3-b1a3-4893-9249-11e03a503e7c req-d51b1f27-981e-472c-8752-630ce0647f02 service nova] Creating event network-vif-deleted:02dd4837-dd78-48fb-99a2-b89da47f98d8 for instance 9f29b298-6acb-468a-b28b-6ce95ba57ea2 on n-h2-860284-1 Oct 04 22:09:23.663236 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-f2ab13e3-b1a3-4893-9249-11e03a503e7c req-d51b1f27-981e-472c-8752-630ce0647f02 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133801 Oct 04 22:09:23.668075 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2477/4906] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:09:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:09:23.829189 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-e5a1204d-c32e-46d7-ad4c-f1a86055da8b tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:23.838579 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-e5a1204d-c32e-46d7-ad4c-f1a86055da8b tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/3d4d9f68-34fa-48b4-a274-6b389af36686" status: 200 len: 1501 microversion: 2.1 time: 0.288694 Oct 04 22:09:23.839450 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2430/4907] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:09:23 2022] GET /compute/v2.1/servers/3d4d9f68-34fa-48b4-a274-6b389af36686 => generated 1501 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:09:23.865556 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-9785a820-dfcb-483b-8e31-4760d79b5bd5 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:09:23.875457 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9785a820-dfcb-483b-8e31-4760d79b5bd5 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:23.876140 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9785a820-dfcb-483b-8e31-4760d79b5bd5 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:23.876717 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9785a820-dfcb-483b-8e31-4760d79b5bd5 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:23.913021 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-9785a820-dfcb-483b-8e31-4760d79b5bd5 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 3d4d9f68-34fa-48b4-a274-6b389af36686] Going to try to stop instance {{(pid=134102) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 04 22:09:23.993539 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-9785a820-dfcb-483b-8e31-4760d79b5bd5 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "POST /compute/v2.1/servers/3d4d9f68-34fa-48b4-a274-6b389af36686/action" status: 202 len: 0 microversion: 2.1 time: 0.133443 Oct 04 22:09:23.994299 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2478/4908] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 22:09:23 2022] POST /compute/v2.1/servers/3d4d9f68-34fa-48b4-a274-6b389af36686/action => generated 0 bytes in 136 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 22:09:24.007969 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-ae7a839e-d7dc-487e-866f-114ccd297df9 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:24.009053 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-ae7a839e-d7dc-487e-866f-114ccd297df9 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 3d4d9f68-34fa-48b4-a274-6b389af36686] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:24.019901 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-ca5ca070-40ae-443d-898c-abce14eecb7f tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:24.024804 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-ca5ca070-40ae-443d-898c-abce14eecb7f tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] [instance: 9f29b298-6acb-468a-b28b-6ce95ba57ea2] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:24.024994 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ae7a839e-d7dc-487e-866f-114ccd297df9 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:24.028397 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ae7a839e-d7dc-487e-866f-114ccd297df9 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:24.029176 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ae7a839e-d7dc-487e-866f-114ccd297df9 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:24.031581 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ae7a839e-d7dc-487e-866f-114ccd297df9 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:24.033936 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ae7a839e-d7dc-487e-866f-114ccd297df9 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:24.035735 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ae7a839e-d7dc-487e-866f-114ccd297df9 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:24.045852 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ca5ca070-40ae-443d-898c-abce14eecb7f tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:24.051310 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ca5ca070-40ae-443d-898c-abce14eecb7f tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:24.054853 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ca5ca070-40ae-443d-898c-abce14eecb7f tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:24.058039 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ca5ca070-40ae-443d-898c-abce14eecb7f tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:24.059030 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ca5ca070-40ae-443d-898c-abce14eecb7f tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:24.063664 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ca5ca070-40ae-443d-898c-abce14eecb7f tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:24.192387 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ca5ca070-40ae-443d-898c-abce14eecb7f tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:24.192885 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ca5ca070-40ae-443d-898c-abce14eecb7f tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:24.198033 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ca5ca070-40ae-443d-898c-abce14eecb7f tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:24.198855 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.objects.instance [None req-ca5ca070-40ae-443d-898c-abce14eecb7f tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lazy-loading 'fault' on Instance uuid 9f29b298-6acb-468a-b28b-6ce95ba57ea2 {{(pid=134101) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 22:09:24.277308 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-ae7a839e-d7dc-487e-866f-114ccd297df9 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:24.289975 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-ae7a839e-d7dc-487e-866f-114ccd297df9 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/3d4d9f68-34fa-48b4-a274-6b389af36686" status: 200 len: 1511 microversion: 2.1 time: 0.289134 Oct 04 22:09:24.292683 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2479/4909] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:09:23 2022] GET /compute/v2.1/servers/3d4d9f68-34fa-48b4-a274-6b389af36686 => generated 1511 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:09:24.306893 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-dffaa2d0-e018-45d0-a470-1ce32ae4e713 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:24.307918 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-dffaa2d0-e018-45d0-a470-1ce32ae4e713 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] [instance: 367dad85-827d-47b0-a468-418d398b36f9] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:24.317759 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dffaa2d0-e018-45d0-a470-1ce32ae4e713 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:24.330545 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dffaa2d0-e018-45d0-a470-1ce32ae4e713 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:24.331614 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dffaa2d0-e018-45d0-a470-1ce32ae4e713 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:24.332707 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dffaa2d0-e018-45d0-a470-1ce32ae4e713 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:24.333547 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dffaa2d0-e018-45d0-a470-1ce32ae4e713 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:24.334232 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dffaa2d0-e018-45d0-a470-1ce32ae4e713 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:24.349333 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-ca5ca070-40ae-443d-898c-abce14eecb7f tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e72a1a5d1a4c4b838acb169ab11eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b556e1ace286450f8493715e8317a107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:24.356826 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:09:24.365893 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:09:24.366106 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-ca5ca070-40ae-443d-898c-abce14eecb7f tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] 10.222.0.43 "GET /compute/v2.1/servers/9f29b298-6acb-468a-b28b-6ce95ba57ea2" status: 200 len: 1308 microversion: 2.1 time: 0.365398 Oct 04 22:09:24.366985 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2431/4910] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:09:23 2022] GET /compute/v2.1/servers/9f29b298-6acb-468a-b28b-6ce95ba57ea2 => generated 1308 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:09:24.477984 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-83e24dce-1c3c-47a0-a8f3-091ef567f48b tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:24.478849 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-83e24dce-1c3c-47a0-a8f3-091ef567f48b tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: 25c0bc2a-016e-441c-aeda-ad5c48f755fa] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:24.486627 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-83e24dce-1c3c-47a0-a8f3-091ef567f48b tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:24.487385 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-83e24dce-1c3c-47a0-a8f3-091ef567f48b tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:24.488000 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-83e24dce-1c3c-47a0-a8f3-091ef567f48b tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:24.489539 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-83e24dce-1c3c-47a0-a8f3-091ef567f48b tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:24.490171 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-83e24dce-1c3c-47a0-a8f3-091ef567f48b tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:24.490810 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-83e24dce-1c3c-47a0-a8f3-091ef567f48b tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:24.590278 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-83e24dce-1c3c-47a0-a8f3-091ef567f48b tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1682f1a60045d8a04d4d67393cd13f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b00cd9fa8e40a0919b61fcd60269f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:24.601328 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-dffaa2d0-e018-45d0-a470-1ce32ae4e713 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:24.610940 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-83e24dce-1c3c-47a0-a8f3-091ef567f48b tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "GET /compute/v2.1/servers/25c0bc2a-016e-441c-aeda-ad5c48f755fa" status: 200 len: 1298 microversion: 2.1 time: 0.135538 Oct 04 22:09:24.611652 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2432/4911] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:09:24 2022] GET /compute/v2.1/servers/25c0bc2a-016e-441c-aeda-ad5c48f755fa => generated 1298 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:09:24.627058 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-dffaa2d0-e018-45d0-a470-1ce32ae4e713 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:24.631243 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-dffaa2d0-e018-45d0-a470-1ce32ae4e713 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:24.632655 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-dffaa2d0-e018-45d0-a470-1ce32ae4e713 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] 10.222.0.43 "GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9" status: 200 len: 1874 microversion: 2.32 time: 0.338590 Oct 04 22:09:24.633798 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2480/4912] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:09:24 2022] GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9 => generated 1874 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:09:25.319230 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-c37bfe1e-7d66-46b6-8252-dff82ec15148 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:25.320542 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-c37bfe1e-7d66-46b6-8252-dff82ec15148 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 3d4d9f68-34fa-48b4-a274-6b389af36686] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:25.330071 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c37bfe1e-7d66-46b6-8252-dff82ec15148 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:25.331035 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c37bfe1e-7d66-46b6-8252-dff82ec15148 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:25.331495 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c37bfe1e-7d66-46b6-8252-dff82ec15148 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:25.332243 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c37bfe1e-7d66-46b6-8252-dff82ec15148 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:25.332890 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c37bfe1e-7d66-46b6-8252-dff82ec15148 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:25.333360 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c37bfe1e-7d66-46b6-8252-dff82ec15148 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:25.393173 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-66e932a5-0e97-445c-bcad-de41f89b843b tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:25.394779 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-66e932a5-0e97-445c-bcad-de41f89b843b tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] [instance: 9f29b298-6acb-468a-b28b-6ce95ba57ea2] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:25.405735 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-66e932a5-0e97-445c-bcad-de41f89b843b tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:25.407157 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-66e932a5-0e97-445c-bcad-de41f89b843b tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:25.408203 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-66e932a5-0e97-445c-bcad-de41f89b843b tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:25.409222 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-66e932a5-0e97-445c-bcad-de41f89b843b tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:25.409988 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-66e932a5-0e97-445c-bcad-de41f89b843b tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:25.413491 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-66e932a5-0e97-445c-bcad-de41f89b843b tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:25.432649 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-66e932a5-0e97-445c-bcad-de41f89b843b tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] HTTP exception thrown: Instance 9f29b298-6acb-468a-b28b-6ce95ba57ea2 could not be found. Oct 04 22:09:25.436262 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-66e932a5-0e97-445c-bcad-de41f89b843b tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Request method failure captured: Oct 04 22:09:25.436262 n-d-860284-1 devstack@n-api.service[134102]: request: GET /compute/v2.1/servers/9f29b298-6acb-468a-b28b-6ce95ba57ea2 HTTP/1.1 Oct 04 22:09:25.436262 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 22:09:25.436262 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 22:09:25.436262 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 22:09:25.436262 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 22:09:25.436262 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 22:09:25.436262 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 22:09:25.436262 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 22:09:25.436262 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 22:09:25.436262 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPK3XGe_9LTr-F_4Y4GbB6F0pBU01uOiJadU_J2G8O_7racYQ8_uSwc7v8esFcLz6ue_rfHMTfhl2KQ9M-XfVnqLTCpNy2uCsSxHxRtuIDMQYscL2d2DZOvObj9x5X0aN0Don0dK6uXVOXET6R9th4WmxqtGXBgmrceaqExHsF6ZLBQA Oct 04 22:09:25.436262 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 22:09:25.436262 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 22:09:25.436262 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 22:09:25.436262 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 22:09:25.436262 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 22:09:25.436262 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 22:09:25.436262 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: b556e1ace286450f8493715e8317a107 Oct 04 22:09:25.436262 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1498882996 Oct 04 22:09:25.436262 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 22:09:25.436262 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 22:09:25.436262 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b556e1ace286450f8493715e8317a107"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_b556e1ace286450f8493715e8317a107", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b556e1ace286450f8493715e8317a107"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/b556e1ace286450f8493715e8317a107"}]}] Oct 04 22:09:25.436262 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-VolumesSnapshotTestJSON-1498882996 Oct 04 22:09:25.436262 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: b556e1ace286450f8493715e8317a107 Oct 04 22:09:25.436262 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1498882996 Oct 04 22:09:25.436262 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-VolumesSnapshotTestJSON-1498882996-project Oct 04 22:09:25.436262 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 22:09:25.436262 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 22:09:25.436262 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: 09e72a1a5d1a4c4b838acb169ab11eb0 Oct 04 22:09:25.436262 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-VolumesSnapshotTestJSON-1498882996-project Oct 04 22:09:25.436262 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 22:09:25.436262 n-d-860284-1 devstack@n-api.service[134102]: exception: Instance 9f29b298-6acb-468a-b28b-6ce95ba57ea2 could not be found. Oct 04 22:09:25.436262 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': '9f29b298-6acb-468a-b28b-6ce95ba57ea2'} Oct 04 22:09:25.436262 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:09:25.436262 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:09:25.436262 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:09:25.436262 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:09:25.436262 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:09:25.436262 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:09:25.436262 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:09:25.436262 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:09:25.436262 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:09:25.436262 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:09:25.436262 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f29b298-6acb-468a-b28b-6ce95ba57ea2 could not be found. Oct 04 22:09:25.436262 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:09:25.436262 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:09:25.436262 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:09:25.436262 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:09:25.436262 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:09:25.436262 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:09:25.436262 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:09:25.436262 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:09:25.436262 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:09:25.436262 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:09:25.436262 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:09:25.436262 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:09:25.436262 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:09:25.436262 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:09:25.436262 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:09:25.436262 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:09:25.436262 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f29b298-6acb-468a-b28b-6ce95ba57ea2 could not be found. Oct 04 22:09:25.436262 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:09:25.436262 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:09:25.436262 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:09:25.442660 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:09:25.442660 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:09:25.442660 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:09:25.442660 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:09:25.442660 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:09:25.442660 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f29b298-6acb-468a-b28b-6ce95ba57ea2 could not be found. Oct 04 22:09:25.442660 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:09:25.443651 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-66e932a5-0e97-445c-bcad-de41f89b843b tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] Returning 404 to user: Instance 9f29b298-6acb-468a-b28b-6ce95ba57ea2 could not be found. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:09:25.444478 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-66e932a5-0e97-445c-bcad-de41f89b843b tempest-VolumesSnapshotTestJSON-1498882996 tempest-VolumesSnapshotTestJSON-1498882996-project] 10.222.0.43 "GET /compute/v2.1/servers/9f29b298-6acb-468a-b28b-6ce95ba57ea2" status: 404 len: 111 microversion: 2.1 time: 0.059095 Oct 04 22:09:25.456156 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2481/4913] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:09:25 2022] GET /compute/v2.1/servers/9f29b298-6acb-468a-b28b-6ce95ba57ea2 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 22:09:25.637029 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-73060b5b-d520-4f54-8f58-2c6a158b5533 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:25.638153 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-73060b5b-d520-4f54-8f58-2c6a158b5533 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: 25c0bc2a-016e-441c-aeda-ad5c48f755fa] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:25.649043 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-73060b5b-d520-4f54-8f58-2c6a158b5533 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:25.649560 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-73060b5b-d520-4f54-8f58-2c6a158b5533 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:25.649972 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-73060b5b-d520-4f54-8f58-2c6a158b5533 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:25.650741 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-73060b5b-d520-4f54-8f58-2c6a158b5533 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:25.651394 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-73060b5b-d520-4f54-8f58-2c6a158b5533 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:25.651989 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-73060b5b-d520-4f54-8f58-2c6a158b5533 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:25.704689 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-c37bfe1e-7d66-46b6-8252-dff82ec15148 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:25.714476 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-c37bfe1e-7d66-46b6-8252-dff82ec15148 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/3d4d9f68-34fa-48b4-a274-6b389af36686" status: 200 len: 1511 microversion: 2.1 time: 0.400417 Oct 04 22:09:25.715693 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2433/4914] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:09:25 2022] GET /compute/v2.1/servers/3d4d9f68-34fa-48b4-a274-6b389af36686 => generated 1511 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:09:25.724462 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-76050334-ee7e-4d69-abf5-421d11cbe60d tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:25.725483 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-76050334-ee7e-4d69-abf5-421d11cbe60d tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] [instance: 367dad85-827d-47b0-a468-418d398b36f9] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:25.732873 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-76050334-ee7e-4d69-abf5-421d11cbe60d tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:25.733711 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-76050334-ee7e-4d69-abf5-421d11cbe60d tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:25.734312 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-76050334-ee7e-4d69-abf5-421d11cbe60d tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:25.735792 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-76050334-ee7e-4d69-abf5-421d11cbe60d tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:25.736637 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-76050334-ee7e-4d69-abf5-421d11cbe60d tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:25.737321 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-76050334-ee7e-4d69-abf5-421d11cbe60d tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:25.779384 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-73060b5b-d520-4f54-8f58-2c6a158b5533 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1682f1a60045d8a04d4d67393cd13f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b00cd9fa8e40a0919b61fcd60269f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:25.795154 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-73060b5b-d520-4f54-8f58-2c6a158b5533 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "GET /compute/v2.1/servers/25c0bc2a-016e-441c-aeda-ad5c48f755fa" status: 200 len: 1286 microversion: 2.1 time: 0.161959 Oct 04 22:09:25.796519 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2482/4915] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:09:25 2022] GET /compute/v2.1/servers/25c0bc2a-016e-441c-aeda-ad5c48f755fa => generated 1286 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:09:25.821075 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-0cd63fe4-96f5-404c-bd50-7724d1a2ad5f req-8f4e5f91-c642-43b6-8e23-1faa4a9cbac8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "367dad85-827d-47b0-a468-418d398b36f9", "tag": "7400e0ba-5b25-45e1-a43e-d44f730f5d6c"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:09:25.840875 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-0cd63fe4-96f5-404c-bd50-7724d1a2ad5f req-8f4e5f91-c642-43b6-8e23-1faa4a9cbac8 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:25.841611 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-0cd63fe4-96f5-404c-bd50-7724d1a2ad5f req-8f4e5f91-c642-43b6-8e23-1faa4a9cbac8 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:25.842463 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-0cd63fe4-96f5-404c-bd50-7724d1a2ad5f req-8f4e5f91-c642-43b6-8e23-1faa4a9cbac8 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:25.863222 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-0cd63fe4-96f5-404c-bd50-7724d1a2ad5f req-8f4e5f91-c642-43b6-8e23-1faa4a9cbac8 service nova] Creating event network-changed:7400e0ba-5b25-45e1-a43e-d44f730f5d6c for instance 367dad85-827d-47b0-a468-418d398b36f9 on n-h1-860284-1 Oct 04 22:09:25.877270 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-0cd63fe4-96f5-404c-bd50-7724d1a2ad5f req-8f4e5f91-c642-43b6-8e23-1faa4a9cbac8 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064525 Oct 04 22:09:25.878818 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2483/4916] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:09:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:09:26.680945 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-76050334-ee7e-4d69-abf5-421d11cbe60d tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:26.706225 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-76050334-ee7e-4d69-abf5-421d11cbe60d tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:26.708775 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-76050334-ee7e-4d69-abf5-421d11cbe60d tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:26.711261 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-76050334-ee7e-4d69-abf5-421d11cbe60d tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] 10.222.0.43 "GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9" status: 200 len: 1874 microversion: 2.32 time: 0.993886 Oct 04 22:09:26.712188 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2434/4917] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:09:25 2022] GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9 => generated 1874 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:09:26.781157 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-f73b905d-42f7-49d4-a586-cc568f9ed91f tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:26.782714 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-f73b905d-42f7-49d4-a586-cc568f9ed91f tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 3d4d9f68-34fa-48b4-a274-6b389af36686] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:26.792294 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f73b905d-42f7-49d4-a586-cc568f9ed91f tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:26.793094 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f73b905d-42f7-49d4-a586-cc568f9ed91f tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:26.794309 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f73b905d-42f7-49d4-a586-cc568f9ed91f tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:26.795307 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f73b905d-42f7-49d4-a586-cc568f9ed91f tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:26.795774 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f73b905d-42f7-49d4-a586-cc568f9ed91f tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:26.796234 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f73b905d-42f7-49d4-a586-cc568f9ed91f tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:26.821087 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-c647d652-17ee-436c-b561-c92122a095e8 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:26.821740 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-c647d652-17ee-436c-b561-c92122a095e8 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: 25c0bc2a-016e-441c-aeda-ad5c48f755fa] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:26.831863 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:09:26.839610 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c647d652-17ee-436c-b561-c92122a095e8 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:26.843250 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c647d652-17ee-436c-b561-c92122a095e8 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:26.845957 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c647d652-17ee-436c-b561-c92122a095e8 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:26.851499 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c647d652-17ee-436c-b561-c92122a095e8 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:26.853738 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c647d652-17ee-436c-b561-c92122a095e8 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:26.854535 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c647d652-17ee-436c-b561-c92122a095e8 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:27.521153 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-f73b905d-42f7-49d4-a586-cc568f9ed91f tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:27.550393 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-f73b905d-42f7-49d4-a586-cc568f9ed91f tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/3d4d9f68-34fa-48b4-a274-6b389af36686" status: 200 len: 1511 microversion: 2.1 time: 0.800987 Oct 04 22:09:27.552964 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2484/4918] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:09:26 2022] GET /compute/v2.1/servers/3d4d9f68-34fa-48b4-a274-6b389af36686 => generated 1511 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:09:27.670517 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-c647d652-17ee-436c-b561-c92122a095e8 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1682f1a60045d8a04d4d67393cd13f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b00cd9fa8e40a0919b61fcd60269f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:27.688683 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-c647d652-17ee-436c-b561-c92122a095e8 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "GET /compute/v2.1/servers/25c0bc2a-016e-441c-aeda-ad5c48f755fa" status: 200 len: 1328 microversion: 2.1 time: 0.872298 Oct 04 22:09:27.689932 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2435/4919] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:09:26 2022] GET /compute/v2.1/servers/25c0bc2a-016e-441c-aeda-ad5c48f755fa => generated 1328 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:09:27.739098 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-2a847a4e-b041-4020-859e-c5b1bd5e90a7 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:27.739831 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-2a847a4e-b041-4020-859e-c5b1bd5e90a7 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] [instance: 367dad85-827d-47b0-a468-418d398b36f9] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:27.748137 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2a847a4e-b041-4020-859e-c5b1bd5e90a7 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:27.748682 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2a847a4e-b041-4020-859e-c5b1bd5e90a7 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:27.749278 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2a847a4e-b041-4020-859e-c5b1bd5e90a7 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:27.750287 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2a847a4e-b041-4020-859e-c5b1bd5e90a7 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:27.750842 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2a847a4e-b041-4020-859e-c5b1bd5e90a7 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:27.751619 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2a847a4e-b041-4020-859e-c5b1bd5e90a7 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:27.914455 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-c26a284e-2d67-472d-8ca2-f64cb27c7292 req-88efe425-1c4c-4f79-945e-4ac1c121993e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "367dad85-827d-47b0-a468-418d398b36f9", "tag": "bc487837-1357-4c07-964b-174fe9476f33"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:09:27.929675 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-c26a284e-2d67-472d-8ca2-f64cb27c7292 req-88efe425-1c4c-4f79-945e-4ac1c121993e service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:27.930811 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-c26a284e-2d67-472d-8ca2-f64cb27c7292 req-88efe425-1c4c-4f79-945e-4ac1c121993e service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:27.931700 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-c26a284e-2d67-472d-8ca2-f64cb27c7292 req-88efe425-1c4c-4f79-945e-4ac1c121993e service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:27.948587 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-c26a284e-2d67-472d-8ca2-f64cb27c7292 req-88efe425-1c4c-4f79-945e-4ac1c121993e service nova] Creating event network-changed:bc487837-1357-4c07-964b-174fe9476f33 for instance 367dad85-827d-47b0-a468-418d398b36f9 on n-h1-860284-1 Oct 04 22:09:27.957895 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-c26a284e-2d67-472d-8ca2-f64cb27c7292 req-88efe425-1c4c-4f79-945e-4ac1c121993e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056623 Oct 04 22:09:27.960896 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2436/4920] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:09:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:09:28.043750 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-2a847a4e-b041-4020-859e-c5b1bd5e90a7 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:28.055420 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-2a847a4e-b041-4020-859e-c5b1bd5e90a7 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:28.056980 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-2a847a4e-b041-4020-859e-c5b1bd5e90a7 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:28.058401 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-2a847a4e-b041-4020-859e-c5b1bd5e90a7 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] 10.222.0.43 "GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9" status: 200 len: 1874 microversion: 2.32 time: 0.325042 Oct 04 22:09:28.059029 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2485/4921] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:09:27 2022] GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9 => generated 1874 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:09:28.576959 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-3661ec0f-5902-4106-b198-cfa22f8b3b80 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:28.577928 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-3661ec0f-5902-4106-b198-cfa22f8b3b80 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 3d4d9f68-34fa-48b4-a274-6b389af36686] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:28.588098 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3661ec0f-5902-4106-b198-cfa22f8b3b80 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:28.588619 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3661ec0f-5902-4106-b198-cfa22f8b3b80 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:28.589209 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3661ec0f-5902-4106-b198-cfa22f8b3b80 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:28.589947 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3661ec0f-5902-4106-b198-cfa22f8b3b80 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:28.590435 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3661ec0f-5902-4106-b198-cfa22f8b3b80 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:28.590872 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3661ec0f-5902-4106-b198-cfa22f8b3b80 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:28.723404 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-a5bd52a4-bbed-4c1d-aed7-21f2fa8cbc91 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:28.724275 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-a5bd52a4-bbed-4c1d-aed7-21f2fa8cbc91 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: 25c0bc2a-016e-441c-aeda-ad5c48f755fa] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:28.737127 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a5bd52a4-bbed-4c1d-aed7-21f2fa8cbc91 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:28.742947 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a5bd52a4-bbed-4c1d-aed7-21f2fa8cbc91 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:28.743671 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a5bd52a4-bbed-4c1d-aed7-21f2fa8cbc91 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:28.744638 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a5bd52a4-bbed-4c1d-aed7-21f2fa8cbc91 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:28.748543 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a5bd52a4-bbed-4c1d-aed7-21f2fa8cbc91 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:28.749703 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a5bd52a4-bbed-4c1d-aed7-21f2fa8cbc91 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:28.805738 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-3661ec0f-5902-4106-b198-cfa22f8b3b80 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:28.825185 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-3661ec0f-5902-4106-b198-cfa22f8b3b80 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/3d4d9f68-34fa-48b4-a274-6b389af36686" status: 200 len: 1511 microversion: 2.1 time: 0.252890 Oct 04 22:09:28.841661 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2437/4922] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:09:28 2022] GET /compute/v2.1/servers/3d4d9f68-34fa-48b4-a274-6b389af36686 => generated 1511 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:09:28.973901 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-a5bd52a4-bbed-4c1d-aed7-21f2fa8cbc91 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1682f1a60045d8a04d4d67393cd13f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b00cd9fa8e40a0919b61fcd60269f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:28.982964 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-a5bd52a4-bbed-4c1d-aed7-21f2fa8cbc91 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "GET /compute/v2.1/servers/25c0bc2a-016e-441c-aeda-ad5c48f755fa" status: 200 len: 1328 microversion: 2.1 time: 0.264699 Oct 04 22:09:28.984691 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2486/4923] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:09:28 2022] GET /compute/v2.1/servers/25c0bc2a-016e-441c-aeda-ad5c48f755fa => generated 1328 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:09:29.086408 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-c3ae8f77-2f79-41b8-bfaa-5de0eaf1b4c1 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:29.087510 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-c3ae8f77-2f79-41b8-bfaa-5de0eaf1b4c1 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] [instance: 367dad85-827d-47b0-a468-418d398b36f9] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:29.095403 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c3ae8f77-2f79-41b8-bfaa-5de0eaf1b4c1 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:29.096366 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c3ae8f77-2f79-41b8-bfaa-5de0eaf1b4c1 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:29.097163 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c3ae8f77-2f79-41b8-bfaa-5de0eaf1b4c1 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:29.098333 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c3ae8f77-2f79-41b8-bfaa-5de0eaf1b4c1 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:29.099021 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c3ae8f77-2f79-41b8-bfaa-5de0eaf1b4c1 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:29.099635 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c3ae8f77-2f79-41b8-bfaa-5de0eaf1b4c1 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:29.366130 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-c3ae8f77-2f79-41b8-bfaa-5de0eaf1b4c1 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:29.376913 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-c3ae8f77-2f79-41b8-bfaa-5de0eaf1b4c1 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:29.378576 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-c3ae8f77-2f79-41b8-bfaa-5de0eaf1b4c1 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:29.379902 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-c3ae8f77-2f79-41b8-bfaa-5de0eaf1b4c1 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] 10.222.0.43 "GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9" status: 200 len: 1874 microversion: 2.32 time: 0.297887 Oct 04 22:09:29.380759 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2438/4924] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:09:29 2022] GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9 => generated 1874 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:09:29.851741 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-4873e686-dd83-4a06-bbe5-80ad7db01261 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:29.852369 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-4873e686-dd83-4a06-bbe5-80ad7db01261 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 3d4d9f68-34fa-48b4-a274-6b389af36686] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:29.864869 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4873e686-dd83-4a06-bbe5-80ad7db01261 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:29.865795 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4873e686-dd83-4a06-bbe5-80ad7db01261 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:29.866318 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4873e686-dd83-4a06-bbe5-80ad7db01261 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:29.867678 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4873e686-dd83-4a06-bbe5-80ad7db01261 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:29.868350 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4873e686-dd83-4a06-bbe5-80ad7db01261 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:29.868848 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4873e686-dd83-4a06-bbe5-80ad7db01261 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:30.013040 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-b351e556-54e7-4c93-9811-52d7286d1cff tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:30.014074 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-b351e556-54e7-4c93-9811-52d7286d1cff tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: 25c0bc2a-016e-441c-aeda-ad5c48f755fa] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:30.044503 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b351e556-54e7-4c93-9811-52d7286d1cff tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:30.051174 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b351e556-54e7-4c93-9811-52d7286d1cff tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:30.052360 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b351e556-54e7-4c93-9811-52d7286d1cff tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:30.053711 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b351e556-54e7-4c93-9811-52d7286d1cff tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:30.054621 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b351e556-54e7-4c93-9811-52d7286d1cff tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:30.055416 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b351e556-54e7-4c93-9811-52d7286d1cff tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:30.151441 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-4873e686-dd83-4a06-bbe5-80ad7db01261 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:30.175353 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-4873e686-dd83-4a06-bbe5-80ad7db01261 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/3d4d9f68-34fa-48b4-a274-6b389af36686" status: 200 len: 1511 microversion: 2.1 time: 0.322566 Oct 04 22:09:30.192996 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2487/4925] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:09:29 2022] GET /compute/v2.1/servers/3d4d9f68-34fa-48b4-a274-6b389af36686 => generated 1511 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:09:30.297808 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-b351e556-54e7-4c93-9811-52d7286d1cff tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1682f1a60045d8a04d4d67393cd13f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b00cd9fa8e40a0919b61fcd60269f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:30.317705 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-b351e556-54e7-4c93-9811-52d7286d1cff tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "GET /compute/v2.1/servers/25c0bc2a-016e-441c-aeda-ad5c48f755fa" status: 200 len: 1328 microversion: 2.1 time: 0.313565 Oct 04 22:09:30.331793 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2439/4926] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:09:30 2022] GET /compute/v2.1/servers/25c0bc2a-016e-441c-aeda-ad5c48f755fa => generated 1328 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:09:30.406112 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-33d24fad-7c64-41dd-8109-dff4082bdc5b tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:30.407680 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-33d24fad-7c64-41dd-8109-dff4082bdc5b tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] [instance: 367dad85-827d-47b0-a468-418d398b36f9] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:30.413990 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-33d24fad-7c64-41dd-8109-dff4082bdc5b tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:30.414508 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-33d24fad-7c64-41dd-8109-dff4082bdc5b tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:30.414948 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-33d24fad-7c64-41dd-8109-dff4082bdc5b tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:30.415670 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-33d24fad-7c64-41dd-8109-dff4082bdc5b tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:30.416213 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-33d24fad-7c64-41dd-8109-dff4082bdc5b tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:30.416651 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-33d24fad-7c64-41dd-8109-dff4082bdc5b tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:30.721901 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-33d24fad-7c64-41dd-8109-dff4082bdc5b tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:30.742813 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-33d24fad-7c64-41dd-8109-dff4082bdc5b tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:30.745140 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-33d24fad-7c64-41dd-8109-dff4082bdc5b tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:30.749200 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-33d24fad-7c64-41dd-8109-dff4082bdc5b tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] 10.222.0.43 "GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9" status: 200 len: 1874 microversion: 2.32 time: 0.346999 Oct 04 22:09:30.750045 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2488/4927] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:09:30 2022] GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9 => generated 1874 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:09:30.959280 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-cdbe46e1-7161-4d70-b0f5-6b465fab3bc2 req-6998b093-807a-4128-8b1e-82c8a9f92d3c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25c0bc2a-016e-441c-aeda-ad5c48f755fa", "tag": "fd642047-45c4-4590-bc8b-632c444afb84"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:09:30.980881 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-cdbe46e1-7161-4d70-b0f5-6b465fab3bc2 req-6998b093-807a-4128-8b1e-82c8a9f92d3c service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:30.981585 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-cdbe46e1-7161-4d70-b0f5-6b465fab3bc2 req-6998b093-807a-4128-8b1e-82c8a9f92d3c service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:30.982196 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-cdbe46e1-7161-4d70-b0f5-6b465fab3bc2 req-6998b093-807a-4128-8b1e-82c8a9f92d3c service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:31.007083 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-cdbe46e1-7161-4d70-b0f5-6b465fab3bc2 req-6998b093-807a-4128-8b1e-82c8a9f92d3c service nova] Creating event network-changed:fd642047-45c4-4590-bc8b-632c444afb84 for instance 25c0bc2a-016e-441c-aeda-ad5c48f755fa on n-h2-860284-1 Oct 04 22:09:31.020319 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-cdbe46e1-7161-4d70-b0f5-6b465fab3bc2 req-6998b093-807a-4128-8b1e-82c8a9f92d3c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062252 Oct 04 22:09:31.021965 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2440/4928] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:09:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:09:31.210509 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-78ca2750-588c-490f-a0cd-f1f1eadbeaa9 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:31.212363 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-78ca2750-588c-490f-a0cd-f1f1eadbeaa9 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 3d4d9f68-34fa-48b4-a274-6b389af36686] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:31.238929 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-78ca2750-588c-490f-a0cd-f1f1eadbeaa9 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:31.241936 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-78ca2750-588c-490f-a0cd-f1f1eadbeaa9 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:31.243763 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-78ca2750-588c-490f-a0cd-f1f1eadbeaa9 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:31.244698 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-78ca2750-588c-490f-a0cd-f1f1eadbeaa9 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:31.245979 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-78ca2750-588c-490f-a0cd-f1f1eadbeaa9 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:31.246779 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-78ca2750-588c-490f-a0cd-f1f1eadbeaa9 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:31.360941 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-abfd22e8-a324-43ed-a128-1d72d456ae43 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:31.363327 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-abfd22e8-a324-43ed-a128-1d72d456ae43 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: 25c0bc2a-016e-441c-aeda-ad5c48f755fa] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:31.393325 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-abfd22e8-a324-43ed-a128-1d72d456ae43 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:31.401789 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-abfd22e8-a324-43ed-a128-1d72d456ae43 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:31.404011 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-abfd22e8-a324-43ed-a128-1d72d456ae43 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:31.428249 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-abfd22e8-a324-43ed-a128-1d72d456ae43 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:31.434239 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-abfd22e8-a324-43ed-a128-1d72d456ae43 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:31.435194 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-abfd22e8-a324-43ed-a128-1d72d456ae43 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:31.592419 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-78ca2750-588c-490f-a0cd-f1f1eadbeaa9 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:31.606459 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-78ca2750-588c-490f-a0cd-f1f1eadbeaa9 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/3d4d9f68-34fa-48b4-a274-6b389af36686" status: 200 len: 1511 microversion: 2.1 time: 0.408033 Oct 04 22:09:31.618752 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2489/4929] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:09:31 2022] GET /compute/v2.1/servers/3d4d9f68-34fa-48b4-a274-6b389af36686 => generated 1511 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:09:31.626847 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-bc1efe0e-be5b-48e4-a55b-3d1263081be5 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6e1c92b2-7bf1-4aeb-bfbe-fb530b06318e"}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:09:31.629484 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-bc1efe0e-be5b-48e4-a55b-3d1263081be5 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] [instance: e616bb7a-3fab-411e-ab23-25d093c36691] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:31.643890 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell0:SELECT=2 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:09:31.651723 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bc1efe0e-be5b-48e4-a55b-3d1263081be5 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:31.652233 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bc1efe0e-be5b-48e4-a55b-3d1263081be5 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:31.652681 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bc1efe0e-be5b-48e4-a55b-3d1263081be5 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:31.653848 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bc1efe0e-be5b-48e4-a55b-3d1263081be5 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:31.654517 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bc1efe0e-be5b-48e4-a55b-3d1263081be5 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:31.657642 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bc1efe0e-be5b-48e4-a55b-3d1263081be5 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:31.661800 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell0:SELECT=10 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:09:31.799874 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-bc1efe0e-be5b-48e4-a55b-3d1263081be5 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] HTTP exception thrown: Invalid volume: volume 6e1c92b2-7bf1-4aeb-bfbe-fb530b06318e is already attached to instances: e616bb7a-3fab-411e-ab23-25d093c36691 Oct 04 22:09:31.804658 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-bc1efe0e-be5b-48e4-a55b-3d1263081be5 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Request method failure captured: Oct 04 22:09:31.804658 n-d-860284-1 devstack@n-api.service[134102]: request: POST /compute/v2.1/servers/e616bb7a-3fab-411e-ab23-25d093c36691/os-volume_attachments HTTP/1.1 Oct 04 22:09:31.804658 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 22:09:31.804658 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 22:09:31.804658 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 22:09:31.804658 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 74 Oct 04 22:09:31.804658 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 22:09:31.804658 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 22:09:31.804658 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 22:09:31.804658 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 22:09:31.804658 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPK1_jKuDmdFTooG3vXwJSp1td0Kvvx-9VX1-OpwmBVV8uNR_MbJNU7EeI7sJdUoH3-0m3mmRBtTc-gLPN-qZ-RuZ8IL2TyG35svVe_hwPH0Z2c1BjkAMrt5beIkYsGbtm00-0XbqMbhJ5wgj-ztyQnhQ8ugDue3oDD_DUqnSWikZCg8 Oct 04 22:09:31.804658 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 22:09:31.804658 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 22:09:31.804658 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 22:09:31.804658 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 22:09:31.804658 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 22:09:31.804658 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 22:09:31.804658 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: 82e1a29234ce40f9b37d0eca196cd1db Oct 04 22:09:31.804658 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-AttachVolumeNegativeTest-2122228341 Oct 04 22:09:31.804658 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 22:09:31.804658 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 22:09:31.804658 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/82e1a29234ce40f9b37d0eca196cd1db"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_82e1a29234ce40f9b37d0eca196cd1db", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/82e1a29234ce40f9b37d0eca196cd1db"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/82e1a29234ce40f9b37d0eca196cd1db"}]}] Oct 04 22:09:31.804658 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-AttachVolumeNegativeTest-2122228341 Oct 04 22:09:31.804658 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: 82e1a29234ce40f9b37d0eca196cd1db Oct 04 22:09:31.804658 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2122228341 Oct 04 22:09:31.804658 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-AttachVolumeNegativeTest-2122228341-project Oct 04 22:09:31.804658 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 22:09:31.804658 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 22:09:31.804658 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: 80fc56886fef422b9b52eb1dede7d10e Oct 04 22:09:31.804658 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-AttachVolumeNegativeTest-2122228341-project Oct 04 22:09:31.804658 n-d-860284-1 devstack@n-api.service[134102]: Oct 04 22:09:31.804658 n-d-860284-1 devstack@n-api.service[134102]: {"volumeAttachment": {"volumeId": "6e1c92b2-7bf1-4aeb-bfbe-fb530b06318e"}} Oct 04 22:09:31.804658 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 22:09:31.804658 n-d-860284-1 devstack@n-api.service[134102]: exception: Invalid volume: volume 6e1c92b2-7bf1-4aeb-bfbe-fb530b06318e is already attached to instances: e616bb7a-3fab-411e-ab23-25d093c36691 Oct 04 22:09:31.804658 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'server_id': 'e616bb7a-3fab-411e-ab23-25d093c36691', 'body': {'volumeAttachment': {'volumeId': '6e1c92b2-7bf1-4aeb-bfbe-fb530b06318e'}}} Oct 04 22:09:31.804658 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:09:31.804658 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:09:31.804658 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 04 22:09:31.804658 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 04 22:09:31.804658 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 22:09:31.804658 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 22:09:31.804658 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 04 22:09:31.804658 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 22:09:31.804658 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 04 22:09:31.804658 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 04 22:09:31.804658 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 04 22:09:31.804658 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 04 22:09:31.804658 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 6e1c92b2-7bf1-4aeb-bfbe-fb530b06318e is already attached to instances: e616bb7a-3fab-411e-ab23-25d093c36691 Oct 04 22:09:31.804658 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:09:31.804658 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:09:31.804658 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:09:31.804658 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:09:31.804658 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:09:31.804658 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:09:31.804658 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:09:31.804658 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:09:31.804658 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:09:31.804658 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:09:31.804658 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 22:09:31.804658 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 22:09:31.804658 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 22:09:31.804658 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 22:09:31.817316 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 22:09:31.817316 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 22:09:31.817316 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 04 22:09:31.817316 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 04 22:09:31.817316 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 6e1c92b2-7bf1-4aeb-bfbe-fb530b06318e is already attached to instances: e616bb7a-3fab-411e-ab23-25d093c36691 Oct 04 22:09:31.817316 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:09:31.817316 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:09:31.817316 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:09:31.817316 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:09:31.817316 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:09:31.817316 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:09:31.817316 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:09:31.817316 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:09:31.817316 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 6e1c92b2-7bf1-4aeb-bfbe-fb530b06318e is already attached to instances: e616bb7a-3fab-411e-ab23-25d093c36691 Oct 04 22:09:31.817316 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:09:31.819715 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-bc1efe0e-be5b-48e4-a55b-3d1263081be5 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Returning 400 to user: Invalid volume: volume 6e1c92b2-7bf1-4aeb-bfbe-fb530b06318e is already attached to instances: e616bb7a-3fab-411e-ab23-25d093c36691 {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:09:31.821874 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-bc1efe0e-be5b-48e4-a55b-3d1263081be5 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] 10.222.0.43 "POST /compute/v2.1/servers/e616bb7a-3fab-411e-ab23-25d093c36691/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.199772 Oct 04 22:09:31.828192 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2490/4930] 10.222.0.43 () {60 vars in 1323 bytes} [Tue Oct 4 22:09:31 2022] POST /compute/v2.1/servers/e616bb7a-3fab-411e-ab23-25d093c36691/os-volume_attachments => generated 174 bytes in 203 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 04 22:09:31.836453 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-f8ae2c5f-b8ac-4ab6-9ad3-f15ec448ccd3 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:31.840303 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-f8ae2c5f-b8ac-4ab6-9ad3-f15ec448ccd3 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] [instance: 367dad85-827d-47b0-a468-418d398b36f9] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:31.854707 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f8ae2c5f-b8ac-4ab6-9ad3-f15ec448ccd3 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:31.855370 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f8ae2c5f-b8ac-4ab6-9ad3-f15ec448ccd3 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:31.855929 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f8ae2c5f-b8ac-4ab6-9ad3-f15ec448ccd3 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:31.856799 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f8ae2c5f-b8ac-4ab6-9ad3-f15ec448ccd3 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:31.858786 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f8ae2c5f-b8ac-4ab6-9ad3-f15ec448ccd3 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:31.859350 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f8ae2c5f-b8ac-4ab6-9ad3-f15ec448ccd3 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:32.176120 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=2 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:09:32.248361 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-f8ae2c5f-b8ac-4ab6-9ad3-f15ec448ccd3 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:32.261018 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-f8ae2c5f-b8ac-4ab6-9ad3-f15ec448ccd3 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:32.268943 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-f8ae2c5f-b8ac-4ab6-9ad3-f15ec448ccd3 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:32.283135 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-f8ae2c5f-b8ac-4ab6-9ad3-f15ec448ccd3 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] 10.222.0.43 "GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9" status: 200 len: 1874 microversion: 2.32 time: 0.446014 Oct 04 22:09:32.287158 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2491/4931] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:09:31 2022] GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9 => generated 1874 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:09:32.298627 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-6b7cf72e-d082-4a79-9d33-00cf92021d08 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:32.300104 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-6b7cf72e-d082-4a79-9d33-00cf92021d08 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] [instance: e616bb7a-3fab-411e-ab23-25d093c36691] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:32.317271 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6b7cf72e-d082-4a79-9d33-00cf92021d08 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:32.323223 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6b7cf72e-d082-4a79-9d33-00cf92021d08 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:32.324391 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6b7cf72e-d082-4a79-9d33-00cf92021d08 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:32.325274 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6b7cf72e-d082-4a79-9d33-00cf92021d08 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:32.325970 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6b7cf72e-d082-4a79-9d33-00cf92021d08 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:32.326559 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6b7cf72e-d082-4a79-9d33-00cf92021d08 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:32.467004 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-abfd22e8-a324-43ed-a128-1d72d456ae43 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1682f1a60045d8a04d4d67393cd13f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b00cd9fa8e40a0919b61fcd60269f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:32.503240 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-abfd22e8-a324-43ed-a128-1d72d456ae43 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "GET /compute/v2.1/servers/25c0bc2a-016e-441c-aeda-ad5c48f755fa" status: 200 len: 1328 microversion: 2.1 time: 1.161759 Oct 04 22:09:32.504253 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2441/4932] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:09:31 2022] GET /compute/v2.1/servers/25c0bc2a-016e-441c-aeda-ad5c48f755fa => generated 1328 bytes in 1164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:09:32.623029 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.objects.instance [None req-6b7cf72e-d082-4a79-9d33-00cf92021d08 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lazy-loading 'services' on Instance uuid e616bb7a-3fab-411e-ab23-25d093c36691 {{(pid=134102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 22:09:32.636670 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-1758f52f-5402-4898-aa75-df3e504a6cb0 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:32.637561 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-1758f52f-5402-4898-aa75-df3e504a6cb0 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 3d4d9f68-34fa-48b4-a274-6b389af36686] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:32.644536 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1758f52f-5402-4898-aa75-df3e504a6cb0 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:32.652537 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1758f52f-5402-4898-aa75-df3e504a6cb0 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:32.653273 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1758f52f-5402-4898-aa75-df3e504a6cb0 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:32.654237 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1758f52f-5402-4898-aa75-df3e504a6cb0 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:32.654900 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1758f52f-5402-4898-aa75-df3e504a6cb0 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:32.655508 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1758f52f-5402-4898-aa75-df3e504a6cb0 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:32.822908 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-6b7cf72e-d082-4a79-9d33-00cf92021d08 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] 10.222.0.43 "DELETE /compute/v2.1/servers/e616bb7a-3fab-411e-ab23-25d093c36691/os-volume_attachments/6e1c92b2-7bf1-4aeb-bfbe-fb530b06318e" status: 202 len: 0 microversion: 2.1 time: 0.534085 Oct 04 22:09:32.824281 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2492/4933] 10.222.0.43 () {58 vars in 1416 bytes} [Tue Oct 4 22:09:32 2022] DELETE /compute/v2.1/servers/e616bb7a-3fab-411e-ab23-25d093c36691/os-volume_attachments/6e1c92b2-7bf1-4aeb-bfbe-fb530b06318e => generated 0 bytes in 537 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 22:09:32.834029 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-9b104d66-e624-4630-8c3e-8ec97facb656 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:32.836964 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-9b104d66-e624-4630-8c3e-8ec97facb656 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] [instance: e616bb7a-3fab-411e-ab23-25d093c36691] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:32.849453 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9b104d66-e624-4630-8c3e-8ec97facb656 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:32.852567 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9b104d66-e624-4630-8c3e-8ec97facb656 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:32.861063 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9b104d66-e624-4630-8c3e-8ec97facb656 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:32.865736 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9b104d66-e624-4630-8c3e-8ec97facb656 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:32.866764 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9b104d66-e624-4630-8c3e-8ec97facb656 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:32.867565 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9b104d66-e624-4630-8c3e-8ec97facb656 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:32.935042 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-9b104d66-e624-4630-8c3e-8ec97facb656 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] 10.222.0.43 "GET /compute/v2.1/servers/e616bb7a-3fab-411e-ab23-25d093c36691/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.105489 Oct 04 22:09:32.939443 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2493/4934] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 22:09:32 2022] GET /compute/v2.1/servers/e616bb7a-3fab-411e-ab23-25d093c36691/os-volume_attachments => generated 197 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:09:33.007916 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-1758f52f-5402-4898-aa75-df3e504a6cb0 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:33.025296 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-1758f52f-5402-4898-aa75-df3e504a6cb0 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/3d4d9f68-34fa-48b4-a274-6b389af36686" status: 200 len: 1511 microversion: 2.1 time: 0.385375 Oct 04 22:09:33.025980 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2442/4935] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:09:32 2022] GET /compute/v2.1/servers/3d4d9f68-34fa-48b4-a274-6b389af36686 => generated 1511 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:09:33.345378 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-ead13e80-bbd3-4b37-8a34-a898a16e3194 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:33.346776 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-ead13e80-bbd3-4b37-8a34-a898a16e3194 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] [instance: 367dad85-827d-47b0-a468-418d398b36f9] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:33.362838 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:09:33.366662 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ead13e80-bbd3-4b37-8a34-a898a16e3194 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:33.369954 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ead13e80-bbd3-4b37-8a34-a898a16e3194 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:33.371190 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ead13e80-bbd3-4b37-8a34-a898a16e3194 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:33.372192 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ead13e80-bbd3-4b37-8a34-a898a16e3194 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:33.372894 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ead13e80-bbd3-4b37-8a34-a898a16e3194 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:33.375901 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ead13e80-bbd3-4b37-8a34-a898a16e3194 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:33.548647 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e02520a3-a268-4489-a550-4a559bd1ed64 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:33.549924 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-e02520a3-a268-4489-a550-4a559bd1ed64 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: 25c0bc2a-016e-441c-aeda-ad5c48f755fa] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:33.567633 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e02520a3-a268-4489-a550-4a559bd1ed64 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:33.568515 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e02520a3-a268-4489-a550-4a559bd1ed64 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:33.569144 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e02520a3-a268-4489-a550-4a559bd1ed64 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:33.575198 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e02520a3-a268-4489-a550-4a559bd1ed64 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:33.576232 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e02520a3-a268-4489-a550-4a559bd1ed64 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:33.576857 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e02520a3-a268-4489-a550-4a559bd1ed64 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:33.962356 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-ead13e80-bbd3-4b37-8a34-a898a16e3194 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:33.999932 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-ead13e80-bbd3-4b37-8a34-a898a16e3194 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:34.003344 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-ead13e80-bbd3-4b37-8a34-a898a16e3194 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:34.004961 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-ead13e80-bbd3-4b37-8a34-a898a16e3194 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] 10.222.0.43 "GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9" status: 200 len: 1874 microversion: 2.32 time: 0.669190 Oct 04 22:09:34.006917 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2494/4936] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:09:33 2022] GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9 => generated 1874 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:09:34.016015 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-e02520a3-a268-4489-a550-4a559bd1ed64 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1682f1a60045d8a04d4d67393cd13f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b00cd9fa8e40a0919b61fcd60269f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:34.020818 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-3c689648-2df6-4b16-a313-2471ebdedcbc tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:34.025238 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-3c689648-2df6-4b16-a313-2471ebdedcbc tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] [instance: e616bb7a-3fab-411e-ab23-25d093c36691] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:34.029588 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-e02520a3-a268-4489-a550-4a559bd1ed64 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "GET /compute/v2.1/servers/25c0bc2a-016e-441c-aeda-ad5c48f755fa" status: 200 len: 1328 microversion: 2.1 time: 0.485442 Oct 04 22:09:34.042585 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2443/4937] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:09:33 2022] GET /compute/v2.1/servers/25c0bc2a-016e-441c-aeda-ad5c48f755fa => generated 1328 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:09:34.053003 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3c689648-2df6-4b16-a313-2471ebdedcbc tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:34.053984 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3c689648-2df6-4b16-a313-2471ebdedcbc tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:34.054790 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3c689648-2df6-4b16-a313-2471ebdedcbc tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:34.055529 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-594e9b6b-ec13-4e43-923c-d644c0514350 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:34.055936 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3c689648-2df6-4b16-a313-2471ebdedcbc tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:34.056300 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-594e9b6b-ec13-4e43-923c-d644c0514350 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 3d4d9f68-34fa-48b4-a274-6b389af36686] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:34.067704 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3c689648-2df6-4b16-a313-2471ebdedcbc tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:34.068508 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3c689648-2df6-4b16-a313-2471ebdedcbc tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:34.071521 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-594e9b6b-ec13-4e43-923c-d644c0514350 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:34.074186 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-594e9b6b-ec13-4e43-923c-d644c0514350 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:34.074497 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-594e9b6b-ec13-4e43-923c-d644c0514350 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:34.075349 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-594e9b6b-ec13-4e43-923c-d644c0514350 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:34.081561 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-594e9b6b-ec13-4e43-923c-d644c0514350 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:34.082924 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-594e9b6b-ec13-4e43-923c-d644c0514350 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:34.115728 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-3c689648-2df6-4b16-a313-2471ebdedcbc tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] 10.222.0.43 "GET /compute/v2.1/servers/e616bb7a-3fab-411e-ab23-25d093c36691/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.107375 Oct 04 22:09:34.121269 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2495/4938] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 22:09:34 2022] GET /compute/v2.1/servers/e616bb7a-3fab-411e-ab23-25d093c36691/os-volume_attachments => generated 197 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:09:34.652529 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-594e9b6b-ec13-4e43-923c-d644c0514350 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:34.679536 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-594e9b6b-ec13-4e43-923c-d644c0514350 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/3d4d9f68-34fa-48b4-a274-6b389af36686" status: 200 len: 1511 microversion: 2.1 time: 0.628795 Oct 04 22:09:34.695802 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2444/4939] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:09:34 2022] GET /compute/v2.1/servers/3d4d9f68-34fa-48b4-a274-6b389af36686 => generated 1511 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:09:35.039827 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-3bd4016e-a147-4b39-b855-4e4726d78ce8 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:35.041097 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-3bd4016e-a147-4b39-b855-4e4726d78ce8 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] [instance: 367dad85-827d-47b0-a468-418d398b36f9] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:35.056248 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-15938e79-49e9-4437-8899-b2966a906e45 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:35.056869 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-15938e79-49e9-4437-8899-b2966a906e45 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: 25c0bc2a-016e-441c-aeda-ad5c48f755fa] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:35.057491 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3bd4016e-a147-4b39-b855-4e4726d78ce8 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:35.058254 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3bd4016e-a147-4b39-b855-4e4726d78ce8 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:35.060236 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3bd4016e-a147-4b39-b855-4e4726d78ce8 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:35.061384 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3bd4016e-a147-4b39-b855-4e4726d78ce8 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:35.066484 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3bd4016e-a147-4b39-b855-4e4726d78ce8 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:35.067342 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3bd4016e-a147-4b39-b855-4e4726d78ce8 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:35.070407 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-15938e79-49e9-4437-8899-b2966a906e45 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:35.070919 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-15938e79-49e9-4437-8899-b2966a906e45 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:35.071361 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-15938e79-49e9-4437-8899-b2966a906e45 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:35.072080 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-15938e79-49e9-4437-8899-b2966a906e45 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:35.072537 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-15938e79-49e9-4437-8899-b2966a906e45 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:35.072965 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-15938e79-49e9-4437-8899-b2966a906e45 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:35.413918 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-15938e79-49e9-4437-8899-b2966a906e45 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1682f1a60045d8a04d4d67393cd13f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b00cd9fa8e40a0919b61fcd60269f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:35.428433 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-15938e79-49e9-4437-8899-b2966a906e45 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "GET /compute/v2.1/servers/25c0bc2a-016e-441c-aeda-ad5c48f755fa" status: 200 len: 1328 microversion: 2.1 time: 0.376071 Oct 04 22:09:35.438797 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2445/4940] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:09:35 2022] GET /compute/v2.1/servers/25c0bc2a-016e-441c-aeda-ad5c48f755fa => generated 1328 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:09:35.438797 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-98796d09-edbc-4f27-af59-4d2c44ba8220 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:35.438797 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-98796d09-edbc-4f27-af59-4d2c44ba8220 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] [instance: e616bb7a-3fab-411e-ab23-25d093c36691] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:35.454205 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-98796d09-edbc-4f27-af59-4d2c44ba8220 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:35.454773 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-98796d09-edbc-4f27-af59-4d2c44ba8220 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:35.455193 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-98796d09-edbc-4f27-af59-4d2c44ba8220 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:35.455896 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-98796d09-edbc-4f27-af59-4d2c44ba8220 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:35.456357 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-98796d09-edbc-4f27-af59-4d2c44ba8220 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:35.456792 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-98796d09-edbc-4f27-af59-4d2c44ba8220 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:35.529498 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-98796d09-edbc-4f27-af59-4d2c44ba8220 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] 10.222.0.43 "GET /compute/v2.1/servers/e616bb7a-3fab-411e-ab23-25d093c36691/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.098934 Oct 04 22:09:35.533171 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2446/4941] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 22:09:35 2022] GET /compute/v2.1/servers/e616bb7a-3fab-411e-ab23-25d093c36691/os-volume_attachments => generated 197 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:09:35.690384 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-3bd4016e-a147-4b39-b855-4e4726d78ce8 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:35.708337 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e3ac1cd7-a90a-4885-8fbb-2b2a5106ff09 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:35.709090 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-e3ac1cd7-a90a-4885-8fbb-2b2a5106ff09 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 3d4d9f68-34fa-48b4-a274-6b389af36686] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:35.723916 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e3ac1cd7-a90a-4885-8fbb-2b2a5106ff09 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:35.725650 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e3ac1cd7-a90a-4885-8fbb-2b2a5106ff09 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:35.727677 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e3ac1cd7-a90a-4885-8fbb-2b2a5106ff09 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:35.729912 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e3ac1cd7-a90a-4885-8fbb-2b2a5106ff09 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:35.731183 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e3ac1cd7-a90a-4885-8fbb-2b2a5106ff09 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:35.733535 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e3ac1cd7-a90a-4885-8fbb-2b2a5106ff09 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:35.738594 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-3bd4016e-a147-4b39-b855-4e4726d78ce8 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:35.748499 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-3bd4016e-a147-4b39-b855-4e4726d78ce8 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:35.749914 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-3bd4016e-a147-4b39-b855-4e4726d78ce8 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] 10.222.0.43 "GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9" status: 200 len: 1874 microversion: 2.32 time: 0.719284 Oct 04 22:09:35.773621 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2496/4942] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:09:35 2022] GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9 => generated 1874 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:09:36.050048 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-e3ac1cd7-a90a-4885-8fbb-2b2a5106ff09 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:36.064938 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-e3ac1cd7-a90a-4885-8fbb-2b2a5106ff09 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/3d4d9f68-34fa-48b4-a274-6b389af36686" status: 200 len: 1511 microversion: 2.1 time: 0.364923 Oct 04 22:09:36.065664 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2447/4943] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:09:35 2022] GET /compute/v2.1/servers/3d4d9f68-34fa-48b4-a274-6b389af36686 => generated 1511 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:09:36.454170 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-a7dc4f25-9e11-4c6b-ab40-624cbbe6b573 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:36.455613 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-a7dc4f25-9e11-4c6b-ab40-624cbbe6b573 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: 25c0bc2a-016e-441c-aeda-ad5c48f755fa] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:36.463864 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a7dc4f25-9e11-4c6b-ab40-624cbbe6b573 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:36.468220 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a7dc4f25-9e11-4c6b-ab40-624cbbe6b573 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:36.469842 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a7dc4f25-9e11-4c6b-ab40-624cbbe6b573 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:36.474355 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a7dc4f25-9e11-4c6b-ab40-624cbbe6b573 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:36.475310 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a7dc4f25-9e11-4c6b-ab40-624cbbe6b573 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:36.479613 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a7dc4f25-9e11-4c6b-ab40-624cbbe6b573 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:36.544303 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-abbc1e1e-efa8-427b-b27a-19d766d6ade8 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:36.551788 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-abbc1e1e-efa8-427b-b27a-19d766d6ade8 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] [instance: e616bb7a-3fab-411e-ab23-25d093c36691] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:36.586142 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-abbc1e1e-efa8-427b-b27a-19d766d6ade8 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:36.590338 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-abbc1e1e-efa8-427b-b27a-19d766d6ade8 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:36.591195 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-abbc1e1e-efa8-427b-b27a-19d766d6ade8 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:36.595608 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-abbc1e1e-efa8-427b-b27a-19d766d6ade8 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:36.596453 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-abbc1e1e-efa8-427b-b27a-19d766d6ade8 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:36.603773 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-abbc1e1e-efa8-427b-b27a-19d766d6ade8 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:36.695183 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-abbc1e1e-efa8-427b-b27a-19d766d6ade8 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] 10.222.0.43 "GET /compute/v2.1/servers/e616bb7a-3fab-411e-ab23-25d093c36691/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.156186 Oct 04 22:09:36.698438 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2448/4944] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 22:09:36 2022] GET /compute/v2.1/servers/e616bb7a-3fab-411e-ab23-25d093c36691/os-volume_attachments => generated 197 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:09:36.781487 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-85edaaf4-0d9f-4960-a240-136b4c600f68 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:36.782756 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-85edaaf4-0d9f-4960-a240-136b4c600f68 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] [instance: 367dad85-827d-47b0-a468-418d398b36f9] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:36.823012 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-85edaaf4-0d9f-4960-a240-136b4c600f68 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:36.827993 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-85edaaf4-0d9f-4960-a240-136b4c600f68 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:36.829311 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-85edaaf4-0d9f-4960-a240-136b4c600f68 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:36.830336 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-85edaaf4-0d9f-4960-a240-136b4c600f68 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:36.831022 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-85edaaf4-0d9f-4960-a240-136b4c600f68 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:36.831791 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-85edaaf4-0d9f-4960-a240-136b4c600f68 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:36.908252 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-a7dc4f25-9e11-4c6b-ab40-624cbbe6b573 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1682f1a60045d8a04d4d67393cd13f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b00cd9fa8e40a0919b61fcd60269f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:36.913383 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:09:36.923943 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-a7dc4f25-9e11-4c6b-ab40-624cbbe6b573 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "GET /compute/v2.1/servers/25c0bc2a-016e-441c-aeda-ad5c48f755fa" status: 200 len: 1328 microversion: 2.1 time: 0.473800 Oct 04 22:09:36.944050 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2497/4945] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:09:36 2022] GET /compute/v2.1/servers/25c0bc2a-016e-441c-aeda-ad5c48f755fa => generated 1328 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:09:37.107414 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-5fdded65-65d6-48e7-9c5a-cd9ae3cd893a tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:37.108173 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-5fdded65-65d6-48e7-9c5a-cd9ae3cd893a tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 3d4d9f68-34fa-48b4-a274-6b389af36686] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:37.134602 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5fdded65-65d6-48e7-9c5a-cd9ae3cd893a tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:37.134602 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5fdded65-65d6-48e7-9c5a-cd9ae3cd893a tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:37.134602 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5fdded65-65d6-48e7-9c5a-cd9ae3cd893a tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:37.148716 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5fdded65-65d6-48e7-9c5a-cd9ae3cd893a tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:37.149420 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5fdded65-65d6-48e7-9c5a-cd9ae3cd893a tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:37.149873 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5fdded65-65d6-48e7-9c5a-cd9ae3cd893a tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:37.523333 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-85edaaf4-0d9f-4960-a240-136b4c600f68 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:37.526627 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=100 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:09:37.547587 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-85edaaf4-0d9f-4960-a240-136b4c600f68 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:37.556172 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-85edaaf4-0d9f-4960-a240-136b4c600f68 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:37.557725 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-85edaaf4-0d9f-4960-a240-136b4c600f68 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] 10.222.0.43 "GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9" status: 200 len: 1874 microversion: 2.32 time: 0.780762 Oct 04 22:09:37.579691 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2449/4946] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:09:36 2022] GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9 => generated 1874 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 22:09:37.711424 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-7e2a8792-9c9b-4169-9907-67495334c3c6 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:37.714082 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-7e2a8792-9c9b-4169-9907-67495334c3c6 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] [instance: e616bb7a-3fab-411e-ab23-25d093c36691] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:37.723750 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7e2a8792-9c9b-4169-9907-67495334c3c6 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:37.735956 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7e2a8792-9c9b-4169-9907-67495334c3c6 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:37.736706 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7e2a8792-9c9b-4169-9907-67495334c3c6 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:37.737627 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7e2a8792-9c9b-4169-9907-67495334c3c6 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:37.738253 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7e2a8792-9c9b-4169-9907-67495334c3c6 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:37.738887 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7e2a8792-9c9b-4169-9907-67495334c3c6 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:37.801927 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-7e2a8792-9c9b-4169-9907-67495334c3c6 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] 10.222.0.43 "GET /compute/v2.1/servers/e616bb7a-3fab-411e-ab23-25d093c36691/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.095363 Oct 04 22:09:37.803828 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2450/4947] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 22:09:37 2022] GET /compute/v2.1/servers/e616bb7a-3fab-411e-ab23-25d093c36691/os-volume_attachments => generated 197 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:09:37.893670 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-5fdded65-65d6-48e7-9c5a-cd9ae3cd893a tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:37.926540 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-5fdded65-65d6-48e7-9c5a-cd9ae3cd893a tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/3d4d9f68-34fa-48b4-a274-6b389af36686" status: 200 len: 1511 microversion: 2.1 time: 0.822232 Oct 04 22:09:37.929713 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2498/4948] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:09:37 2022] GET /compute/v2.1/servers/3d4d9f68-34fa-48b4-a274-6b389af36686 => generated 1511 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:09:37.952962 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-44f34a32-50cb-4ca2-9fd9-37023ab1dd0e tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:37.954487 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-44f34a32-50cb-4ca2-9fd9-37023ab1dd0e tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: 25c0bc2a-016e-441c-aeda-ad5c48f755fa] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:37.973804 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-44f34a32-50cb-4ca2-9fd9-37023ab1dd0e tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:37.974999 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-44f34a32-50cb-4ca2-9fd9-37023ab1dd0e tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:37.977635 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-44f34a32-50cb-4ca2-9fd9-37023ab1dd0e tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:37.982403 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-44f34a32-50cb-4ca2-9fd9-37023ab1dd0e tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:37.984595 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-44f34a32-50cb-4ca2-9fd9-37023ab1dd0e tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:37.985329 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-44f34a32-50cb-4ca2-9fd9-37023ab1dd0e tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:38.605094 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-f67e3df8-5e8f-4c28-be06-6138bbb78281 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:38.606531 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-f67e3df8-5e8f-4c28-be06-6138bbb78281 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] [instance: 367dad85-827d-47b0-a468-418d398b36f9] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:38.617018 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f67e3df8-5e8f-4c28-be06-6138bbb78281 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:38.620626 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f67e3df8-5e8f-4c28-be06-6138bbb78281 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:38.621594 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f67e3df8-5e8f-4c28-be06-6138bbb78281 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:38.624353 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f67e3df8-5e8f-4c28-be06-6138bbb78281 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:38.626630 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f67e3df8-5e8f-4c28-be06-6138bbb78281 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:38.627554 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f67e3df8-5e8f-4c28-be06-6138bbb78281 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:38.657930 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-44f34a32-50cb-4ca2-9fd9-37023ab1dd0e tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1682f1a60045d8a04d4d67393cd13f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b00cd9fa8e40a0919b61fcd60269f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:38.666162 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-44f34a32-50cb-4ca2-9fd9-37023ab1dd0e tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "GET /compute/v2.1/servers/25c0bc2a-016e-441c-aeda-ad5c48f755fa" status: 200 len: 1328 microversion: 2.1 time: 0.717739 Oct 04 22:09:38.669121 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2451/4949] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:09:37 2022] GET /compute/v2.1/servers/25c0bc2a-016e-441c-aeda-ad5c48f755fa => generated 1328 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:09:38.815938 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-0fc198d2-904c-4efa-9680-3f6b2c075e96 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:38.818465 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-0fc198d2-904c-4efa-9680-3f6b2c075e96 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] [instance: e616bb7a-3fab-411e-ab23-25d093c36691] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:38.833344 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0fc198d2-904c-4efa-9680-3f6b2c075e96 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:38.838376 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0fc198d2-904c-4efa-9680-3f6b2c075e96 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:38.839083 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0fc198d2-904c-4efa-9680-3f6b2c075e96 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:38.840022 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0fc198d2-904c-4efa-9680-3f6b2c075e96 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:38.840664 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0fc198d2-904c-4efa-9680-3f6b2c075e96 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:38.841270 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0fc198d2-904c-4efa-9680-3f6b2c075e96 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:38.947404 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-0fc198d2-904c-4efa-9680-3f6b2c075e96 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] 10.222.0.43 "GET /compute/v2.1/servers/e616bb7a-3fab-411e-ab23-25d093c36691/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.135838 Oct 04 22:09:38.950890 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2452/4950] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 22:09:38 2022] GET /compute/v2.1/servers/e616bb7a-3fab-411e-ab23-25d093c36691/os-volume_attachments => generated 197 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:09:38.958657 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-8b99f24f-9e0a-4837-8012-0072217ec43f tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:38.959632 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-8b99f24f-9e0a-4837-8012-0072217ec43f tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 3d4d9f68-34fa-48b4-a274-6b389af36686] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:38.970745 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8b99f24f-9e0a-4837-8012-0072217ec43f tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:38.972857 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8b99f24f-9e0a-4837-8012-0072217ec43f tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:38.975679 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8b99f24f-9e0a-4837-8012-0072217ec43f tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:38.980042 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8b99f24f-9e0a-4837-8012-0072217ec43f tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:38.984316 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8b99f24f-9e0a-4837-8012-0072217ec43f tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:38.988095 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8b99f24f-9e0a-4837-8012-0072217ec43f tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:39.262406 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-f67e3df8-5e8f-4c28-be06-6138bbb78281 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:39.282718 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-f67e3df8-5e8f-4c28-be06-6138bbb78281 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:39.284524 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-f67e3df8-5e8f-4c28-be06-6138bbb78281 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:39.285802 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-f67e3df8-5e8f-4c28-be06-6138bbb78281 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] 10.222.0.43 "GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9" status: 200 len: 1874 microversion: 2.32 time: 0.698899 Oct 04 22:09:39.288623 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2499/4951] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:09:38 2022] GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9 => generated 1874 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 22:09:39.439657 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-8b99f24f-9e0a-4837-8012-0072217ec43f tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:39.449034 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-8b99f24f-9e0a-4837-8012-0072217ec43f tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/3d4d9f68-34fa-48b4-a274-6b389af36686" status: 200 len: 1511 microversion: 2.1 time: 0.496678 Oct 04 22:09:39.456223 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2453/4952] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:09:38 2022] GET /compute/v2.1/servers/3d4d9f68-34fa-48b4-a274-6b389af36686 => generated 1511 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:09:39.696498 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-295df76c-a16a-415e-ae9e-99a009c2f831 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:39.697403 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-295df76c-a16a-415e-ae9e-99a009c2f831 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: 25c0bc2a-016e-441c-aeda-ad5c48f755fa] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:39.717049 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-295df76c-a16a-415e-ae9e-99a009c2f831 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:39.723975 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-295df76c-a16a-415e-ae9e-99a009c2f831 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:39.725794 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-295df76c-a16a-415e-ae9e-99a009c2f831 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:39.726844 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-295df76c-a16a-415e-ae9e-99a009c2f831 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:39.727515 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-295df76c-a16a-415e-ae9e-99a009c2f831 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:39.728845 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-295df76c-a16a-415e-ae9e-99a009c2f831 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:39.964060 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-fb938748-6442-45c6-9f9c-50d555e3eb26 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:39.967357 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-fb938748-6442-45c6-9f9c-50d555e3eb26 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] [instance: e616bb7a-3fab-411e-ab23-25d093c36691] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:39.992882 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fb938748-6442-45c6-9f9c-50d555e3eb26 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:39.995592 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fb938748-6442-45c6-9f9c-50d555e3eb26 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:39.998007 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fb938748-6442-45c6-9f9c-50d555e3eb26 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:40.001217 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fb938748-6442-45c6-9f9c-50d555e3eb26 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:40.003991 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fb938748-6442-45c6-9f9c-50d555e3eb26 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:40.004706 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fb938748-6442-45c6-9f9c-50d555e3eb26 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:40.161463 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-fb938748-6442-45c6-9f9c-50d555e3eb26 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] 10.222.0.43 "GET /compute/v2.1/servers/e616bb7a-3fab-411e-ab23-25d093c36691/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.202184 Oct 04 22:09:40.163447 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2454/4953] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 22:09:39 2022] GET /compute/v2.1/servers/e616bb7a-3fab-411e-ab23-25d093c36691/os-volume_attachments => generated 197 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:09:40.317010 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-51c16be7-a09b-49ad-87b5-ecc418b65544 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:40.318731 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-51c16be7-a09b-49ad-87b5-ecc418b65544 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] [instance: 367dad85-827d-47b0-a468-418d398b36f9] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:40.334900 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-51c16be7-a09b-49ad-87b5-ecc418b65544 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:40.339919 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-51c16be7-a09b-49ad-87b5-ecc418b65544 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:40.341228 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-51c16be7-a09b-49ad-87b5-ecc418b65544 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:40.343311 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-51c16be7-a09b-49ad-87b5-ecc418b65544 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:40.344747 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-51c16be7-a09b-49ad-87b5-ecc418b65544 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:40.357544 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-51c16be7-a09b-49ad-87b5-ecc418b65544 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:40.616924 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-295df76c-a16a-415e-ae9e-99a009c2f831 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1682f1a60045d8a04d4d67393cd13f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b00cd9fa8e40a0919b61fcd60269f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:40.639255 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-295df76c-a16a-415e-ae9e-99a009c2f831 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "GET /compute/v2.1/servers/25c0bc2a-016e-441c-aeda-ad5c48f755fa" status: 200 len: 1328 microversion: 2.1 time: 0.948417 Oct 04 22:09:40.642166 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2500/4954] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:09:39 2022] GET /compute/v2.1/servers/25c0bc2a-016e-441c-aeda-ad5c48f755fa => generated 1328 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:09:40.798999 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-3a4c786e-af5c-4244-9eee-45ab395914d0 req-37a3d70a-11c8-4a65-bdf7-6709832200df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25c0bc2a-016e-441c-aeda-ad5c48f755fa", "name": "network-vif-plugged", "status": "completed", "tag": "fd642047-45c4-4590-bc8b-632c444afb84"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:09:40.820840 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-3a4c786e-af5c-4244-9eee-45ab395914d0 req-37a3d70a-11c8-4a65-bdf7-6709832200df service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:40.821332 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-3a4c786e-af5c-4244-9eee-45ab395914d0 req-37a3d70a-11c8-4a65-bdf7-6709832200df service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:40.821773 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-3a4c786e-af5c-4244-9eee-45ab395914d0 req-37a3d70a-11c8-4a65-bdf7-6709832200df service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:40.863366 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-3a4c786e-af5c-4244-9eee-45ab395914d0 req-37a3d70a-11c8-4a65-bdf7-6709832200df service nova] Creating event network-vif-plugged:fd642047-45c4-4590-bc8b-632c444afb84 for instance 25c0bc2a-016e-441c-aeda-ad5c48f755fa on n-h2-860284-1 Oct 04 22:09:40.881162 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-3a4c786e-af5c-4244-9eee-45ab395914d0 req-37a3d70a-11c8-4a65-bdf7-6709832200df service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.232352 Oct 04 22:09:40.883161 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2501/4955] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:09:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:09:40.908572 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-2e341946-7055-4553-9c4e-0905fd0dfbec tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:40.912271 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-2e341946-7055-4553-9c4e-0905fd0dfbec tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 3d4d9f68-34fa-48b4-a274-6b389af36686] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:40.983079 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2e341946-7055-4553-9c4e-0905fd0dfbec tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:40.983674 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2e341946-7055-4553-9c4e-0905fd0dfbec tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:40.984141 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2e341946-7055-4553-9c4e-0905fd0dfbec tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:40.985583 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2e341946-7055-4553-9c4e-0905fd0dfbec tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:40.986057 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2e341946-7055-4553-9c4e-0905fd0dfbec tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:40.986526 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2e341946-7055-4553-9c4e-0905fd0dfbec tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:41.465134 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-2e341946-7055-4553-9c4e-0905fd0dfbec tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:41.474963 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-2e341946-7055-4553-9c4e-0905fd0dfbec tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/3d4d9f68-34fa-48b4-a274-6b389af36686" status: 200 len: 1511 microversion: 2.1 time: 0.588974 Oct 04 22:09:41.479526 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2502/4956] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:09:40 2022] GET /compute/v2.1/servers/3d4d9f68-34fa-48b4-a274-6b389af36686 => generated 1511 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:09:41.488173 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-2e25c5ac-40a2-4ee5-b7ca-1aa4dbf62746 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:41.493840 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-2e25c5ac-40a2-4ee5-b7ca-1aa4dbf62746 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] [instance: e616bb7a-3fab-411e-ab23-25d093c36691] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:41.505854 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2e25c5ac-40a2-4ee5-b7ca-1aa4dbf62746 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:41.506696 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2e25c5ac-40a2-4ee5-b7ca-1aa4dbf62746 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:41.508082 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2e25c5ac-40a2-4ee5-b7ca-1aa4dbf62746 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:41.509081 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2e25c5ac-40a2-4ee5-b7ca-1aa4dbf62746 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:41.509789 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2e25c5ac-40a2-4ee5-b7ca-1aa4dbf62746 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:41.510589 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2e25c5ac-40a2-4ee5-b7ca-1aa4dbf62746 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:41.523642 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-51c16be7-a09b-49ad-87b5-ecc418b65544 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:41.535967 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-51c16be7-a09b-49ad-87b5-ecc418b65544 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:41.537675 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-51c16be7-a09b-49ad-87b5-ecc418b65544 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:41.544249 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-51c16be7-a09b-49ad-87b5-ecc418b65544 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] 10.222.0.43 "GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9" status: 200 len: 1874 microversion: 2.32 time: 1.231900 Oct 04 22:09:41.548757 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2455/4957] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:09:40 2022] GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9 => generated 1874 bytes in 1237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:09:41.568653 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-2e25c5ac-40a2-4ee5-b7ca-1aa4dbf62746 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] 10.222.0.43 "GET /compute/v2.1/servers/e616bb7a-3fab-411e-ab23-25d093c36691/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.087286 Oct 04 22:09:41.578900 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2503/4958] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 22:09:41 2022] GET /compute/v2.1/servers/e616bb7a-3fab-411e-ab23-25d093c36691/os-volume_attachments => generated 25 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 22:09:41.652965 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-60ba6d9d-9a68-4616-84eb-7d5d531acff9 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:41.654038 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-60ba6d9d-9a68-4616-84eb-7d5d531acff9 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] [instance: e616bb7a-3fab-411e-ab23-25d093c36691] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:41.661421 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-60ba6d9d-9a68-4616-84eb-7d5d531acff9 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:41.669657 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-8f86b4ce-ef77-4e1a-97b1-89b18001a175 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:41.673748 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-8f86b4ce-ef77-4e1a-97b1-89b18001a175 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: 25c0bc2a-016e-441c-aeda-ad5c48f755fa] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:41.679544 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-60ba6d9d-9a68-4616-84eb-7d5d531acff9 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:41.681529 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-60ba6d9d-9a68-4616-84eb-7d5d531acff9 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:41.683151 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-60ba6d9d-9a68-4616-84eb-7d5d531acff9 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:41.685092 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-60ba6d9d-9a68-4616-84eb-7d5d531acff9 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:41.685707 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-60ba6d9d-9a68-4616-84eb-7d5d531acff9 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:41.686557 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8f86b4ce-ef77-4e1a-97b1-89b18001a175 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:41.690275 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8f86b4ce-ef77-4e1a-97b1-89b18001a175 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:41.690976 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8f86b4ce-ef77-4e1a-97b1-89b18001a175 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:41.691860 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8f86b4ce-ef77-4e1a-97b1-89b18001a175 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:41.692470 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8f86b4ce-ef77-4e1a-97b1-89b18001a175 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:41.693063 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8f86b4ce-ef77-4e1a-97b1-89b18001a175 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:41.762890 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-60ba6d9d-9a68-4616-84eb-7d5d531acff9 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] [instance: e616bb7a-3fab-411e-ab23-25d093c36691] Going to try to terminate instance {{(pid=134101) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 22:09:41.973089 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-60ba6d9d-9a68-4616-84eb-7d5d531acff9 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] 10.222.0.43 "DELETE /compute/v2.1/servers/e616bb7a-3fab-411e-ab23-25d093c36691" status: 204 len: 0 microversion: 2.1 time: 0.323834 Oct 04 22:09:41.973717 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2456/4959] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 22:09:41 2022] DELETE /compute/v2.1/servers/e616bb7a-3fab-411e-ab23-25d093c36691 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 22:09:41.983297 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-214325cb-69ca-4fd8-a723-79b3bb1debb0 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:41.984012 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-214325cb-69ca-4fd8-a723-79b3bb1debb0 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] [instance: e616bb7a-3fab-411e-ab23-25d093c36691] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:42.013894 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-214325cb-69ca-4fd8-a723-79b3bb1debb0 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:42.014440 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-214325cb-69ca-4fd8-a723-79b3bb1debb0 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:42.014892 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-214325cb-69ca-4fd8-a723-79b3bb1debb0 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:42.020491 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-214325cb-69ca-4fd8-a723-79b3bb1debb0 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:42.021122 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-214325cb-69ca-4fd8-a723-79b3bb1debb0 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:42.022497 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-214325cb-69ca-4fd8-a723-79b3bb1debb0 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:42.063616 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-8f86b4ce-ef77-4e1a-97b1-89b18001a175 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1682f1a60045d8a04d4d67393cd13f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b00cd9fa8e40a0919b61fcd60269f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:42.088720 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-8f86b4ce-ef77-4e1a-97b1-89b18001a175 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "GET /compute/v2.1/servers/25c0bc2a-016e-441c-aeda-ad5c48f755fa" status: 200 len: 1328 microversion: 2.1 time: 0.420893 Oct 04 22:09:42.090294 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2504/4960] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:09:41 2022] GET /compute/v2.1/servers/25c0bc2a-016e-441c-aeda-ad5c48f755fa => generated 1328 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:09:42.413113 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-214325cb-69ca-4fd8-a723-79b3bb1debb0 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80fc56886fef422b9b52eb1dede7d10e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82e1a29234ce40f9b37d0eca196cd1db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:42.421188 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-214325cb-69ca-4fd8-a723-79b3bb1debb0 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] 10.222.0.43 "GET /compute/v2.1/servers/e616bb7a-3fab-411e-ab23-25d093c36691" status: 200 len: 1681 microversion: 2.1 time: 0.442101 Oct 04 22:09:42.435526 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2457/4961] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:09:41 2022] GET /compute/v2.1/servers/e616bb7a-3fab-411e-ab23-25d093c36691 => generated 1681 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:09:42.508726 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-5abafd4d-3cf0-4050-808a-da7774f49315 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:42.509347 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-5abafd4d-3cf0-4050-808a-da7774f49315 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 3d4d9f68-34fa-48b4-a274-6b389af36686] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:42.521879 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5abafd4d-3cf0-4050-808a-da7774f49315 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:42.525315 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5abafd4d-3cf0-4050-808a-da7774f49315 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:42.525945 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5abafd4d-3cf0-4050-808a-da7774f49315 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:42.529680 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5abafd4d-3cf0-4050-808a-da7774f49315 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:42.531305 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5abafd4d-3cf0-4050-808a-da7774f49315 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:42.532411 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5abafd4d-3cf0-4050-808a-da7774f49315 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:42.577385 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-c42695fc-aa8a-41ac-b168-a3de85b5e685 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:42.578040 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-c42695fc-aa8a-41ac-b168-a3de85b5e685 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] [instance: 367dad85-827d-47b0-a468-418d398b36f9] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:42.587331 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c42695fc-aa8a-41ac-b168-a3de85b5e685 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:42.591473 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c42695fc-aa8a-41ac-b168-a3de85b5e685 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:42.595190 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c42695fc-aa8a-41ac-b168-a3de85b5e685 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:42.597322 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c42695fc-aa8a-41ac-b168-a3de85b5e685 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:42.598904 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c42695fc-aa8a-41ac-b168-a3de85b5e685 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:42.599357 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c42695fc-aa8a-41ac-b168-a3de85b5e685 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:43.101395 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-5abafd4d-3cf0-4050-808a-da7774f49315 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:43.154567 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-5abafd4d-3cf0-4050-808a-da7774f49315 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/3d4d9f68-34fa-48b4-a274-6b389af36686" status: 200 len: 1511 microversion: 2.1 time: 0.610644 Oct 04 22:09:43.155467 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2505/4962] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:09:42 2022] GET /compute/v2.1/servers/3d4d9f68-34fa-48b4-a274-6b389af36686 => generated 1511 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:09:43.161114 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-12a082d3-f05c-4e56-a0f8-5b5aa2b1685b tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:43.162213 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-12a082d3-f05c-4e56-a0f8-5b5aa2b1685b tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: 25c0bc2a-016e-441c-aeda-ad5c48f755fa] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:43.168974 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-12a082d3-f05c-4e56-a0f8-5b5aa2b1685b tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:43.169729 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-12a082d3-f05c-4e56-a0f8-5b5aa2b1685b tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:43.170358 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-12a082d3-f05c-4e56-a0f8-5b5aa2b1685b tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:43.171272 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-12a082d3-f05c-4e56-a0f8-5b5aa2b1685b tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:43.171973 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-12a082d3-f05c-4e56-a0f8-5b5aa2b1685b tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:43.173076 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-12a082d3-f05c-4e56-a0f8-5b5aa2b1685b tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:43.226488 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-c42695fc-aa8a-41ac-b168-a3de85b5e685 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:43.246732 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-c42695fc-aa8a-41ac-b168-a3de85b5e685 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:43.253620 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-c42695fc-aa8a-41ac-b168-a3de85b5e685 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:43.254993 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-c42695fc-aa8a-41ac-b168-a3de85b5e685 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] 10.222.0.43 "GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9" status: 200 len: 1874 microversion: 2.32 time: 0.681585 Oct 04 22:09:43.255609 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2458/4963] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:09:42 2022] GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9 => generated 1874 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:09:43.449234 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-80351a25-ad8c-4dab-8f89-d6b7f8329432 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:43.450024 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-80351a25-ad8c-4dab-8f89-d6b7f8329432 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] [instance: e616bb7a-3fab-411e-ab23-25d093c36691] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:43.461862 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-80351a25-ad8c-4dab-8f89-d6b7f8329432 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:43.462387 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-80351a25-ad8c-4dab-8f89-d6b7f8329432 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:43.462847 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-80351a25-ad8c-4dab-8f89-d6b7f8329432 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:43.463568 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-80351a25-ad8c-4dab-8f89-d6b7f8329432 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:43.464041 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-80351a25-ad8c-4dab-8f89-d6b7f8329432 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:43.469443 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-80351a25-ad8c-4dab-8f89-d6b7f8329432 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:43.483044 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-12a082d3-f05c-4e56-a0f8-5b5aa2b1685b tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1682f1a60045d8a04d4d67393cd13f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b00cd9fa8e40a0919b61fcd60269f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:43.492797 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-12a082d3-f05c-4e56-a0f8-5b5aa2b1685b tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "GET /compute/v2.1/servers/25c0bc2a-016e-441c-aeda-ad5c48f755fa" status: 200 len: 1510 microversion: 2.1 time: 0.335472 Oct 04 22:09:43.510404 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2506/4964] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:09:43 2022] GET /compute/v2.1/servers/25c0bc2a-016e-441c-aeda-ad5c48f755fa => generated 1510 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:09:43.524420 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-a12ab155-7251-4d71-98e2-7f5e09f12fe1 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:43.525202 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-a12ab155-7251-4d71-98e2-7f5e09f12fe1 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: 25c0bc2a-016e-441c-aeda-ad5c48f755fa] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:43.534070 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a12ab155-7251-4d71-98e2-7f5e09f12fe1 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:43.534803 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a12ab155-7251-4d71-98e2-7f5e09f12fe1 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:43.535436 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a12ab155-7251-4d71-98e2-7f5e09f12fe1 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:43.536403 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a12ab155-7251-4d71-98e2-7f5e09f12fe1 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:43.537556 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a12ab155-7251-4d71-98e2-7f5e09f12fe1 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:43.538109 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a12ab155-7251-4d71-98e2-7f5e09f12fe1 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:43.840432 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-80351a25-ad8c-4dab-8f89-d6b7f8329432 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80fc56886fef422b9b52eb1dede7d10e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82e1a29234ce40f9b37d0eca196cd1db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:43.851059 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-80351a25-ad8c-4dab-8f89-d6b7f8329432 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] 10.222.0.43 "GET /compute/v2.1/servers/e616bb7a-3fab-411e-ab23-25d093c36691" status: 200 len: 1681 microversion: 2.1 time: 0.405704 Oct 04 22:09:43.863365 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2459/4965] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:09:43 2022] GET /compute/v2.1/servers/e616bb7a-3fab-411e-ab23-25d093c36691 => generated 1681 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:09:43.959876 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-a12ab155-7251-4d71-98e2-7f5e09f12fe1 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1682f1a60045d8a04d4d67393cd13f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b00cd9fa8e40a0919b61fcd60269f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:43.974777 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-a12ab155-7251-4d71-98e2-7f5e09f12fe1 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "GET /compute/v2.1/servers/25c0bc2a-016e-441c-aeda-ad5c48f755fa" status: 200 len: 1510 microversion: 2.1 time: 0.454938 Oct 04 22:09:43.977151 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2507/4966] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:09:43 2022] GET /compute/v2.1/servers/25c0bc2a-016e-441c-aeda-ad5c48f755fa => generated 1510 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:09:44.004231 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-4fa057be-5267-43e6-98a8-cf1a0bae5d7e tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:44.004669 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-4fa057be-5267-43e6-98a8-cf1a0bae5d7e tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: 25c0bc2a-016e-441c-aeda-ad5c48f755fa] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:44.030633 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4fa057be-5267-43e6-98a8-cf1a0bae5d7e tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:44.039712 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4fa057be-5267-43e6-98a8-cf1a0bae5d7e tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:44.041551 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4fa057be-5267-43e6-98a8-cf1a0bae5d7e tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:44.045611 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4fa057be-5267-43e6-98a8-cf1a0bae5d7e tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:44.048849 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4fa057be-5267-43e6-98a8-cf1a0bae5d7e tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:44.049547 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4fa057be-5267-43e6-98a8-cf1a0bae5d7e tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:44.107274 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-4fa057be-5267-43e6-98a8-cf1a0bae5d7e tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: 25c0bc2a-016e-441c-aeda-ad5c48f755fa] Going to try to terminate instance {{(pid=134101) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 22:09:44.181055 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-5bc53228-8cd9-4561-b478-ddbfd3536533 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:44.181683 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-5bc53228-8cd9-4561-b478-ddbfd3536533 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 3d4d9f68-34fa-48b4-a274-6b389af36686] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:44.195129 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5bc53228-8cd9-4561-b478-ddbfd3536533 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:44.195635 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5bc53228-8cd9-4561-b478-ddbfd3536533 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:44.196083 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5bc53228-8cd9-4561-b478-ddbfd3536533 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:44.196809 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5bc53228-8cd9-4561-b478-ddbfd3536533 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:44.197268 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5bc53228-8cd9-4561-b478-ddbfd3536533 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:44.197704 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5bc53228-8cd9-4561-b478-ddbfd3536533 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:44.263100 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-4fa057be-5267-43e6-98a8-cf1a0bae5d7e tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "DELETE /compute/v2.1/servers/25c0bc2a-016e-441c-aeda-ad5c48f755fa" status: 204 len: 0 microversion: 2.1 time: 0.262816 Oct 04 22:09:44.264142 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2460/4967] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 22:09:43 2022] DELETE /compute/v2.1/servers/25c0bc2a-016e-441c-aeda-ad5c48f755fa => generated 0 bytes in 266 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 22:09:44.278401 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-4137990b-fece-4424-a95a-8b7862a9e9a3 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:44.279457 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-4137990b-fece-4424-a95a-8b7862a9e9a3 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: 25c0bc2a-016e-441c-aeda-ad5c48f755fa] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:44.286727 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4137990b-fece-4424-a95a-8b7862a9e9a3 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:44.287487 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4137990b-fece-4424-a95a-8b7862a9e9a3 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:44.288578 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4137990b-fece-4424-a95a-8b7862a9e9a3 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:44.289301 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4137990b-fece-4424-a95a-8b7862a9e9a3 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:44.289900 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4137990b-fece-4424-a95a-8b7862a9e9a3 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:44.290589 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4137990b-fece-4424-a95a-8b7862a9e9a3 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:44.570350 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-5bc53228-8cd9-4561-b478-ddbfd3536533 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:44.581372 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-5bc53228-8cd9-4561-b478-ddbfd3536533 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/3d4d9f68-34fa-48b4-a274-6b389af36686" status: 200 len: 1511 microversion: 2.1 time: 0.402768 Oct 04 22:09:44.581987 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2508/4968] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:09:44 2022] GET /compute/v2.1/servers/3d4d9f68-34fa-48b4-a274-6b389af36686 => generated 1511 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:09:44.599437 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-4137990b-fece-4424-a95a-8b7862a9e9a3 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1682f1a60045d8a04d4d67393cd13f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b00cd9fa8e40a0919b61fcd60269f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:44.604107 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-7a7f4e47-50bf-4225-a507-fdf29e9ba9d1 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:44.605720 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-7a7f4e47-50bf-4225-a507-fdf29e9ba9d1 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] [instance: 367dad85-827d-47b0-a468-418d398b36f9] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:44.612180 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-4137990b-fece-4424-a95a-8b7862a9e9a3 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "GET /compute/v2.1/servers/25c0bc2a-016e-441c-aeda-ad5c48f755fa" status: 200 len: 1516 microversion: 2.1 time: 0.342116 Oct 04 22:09:44.613539 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2461/4969] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:09:44 2022] GET /compute/v2.1/servers/25c0bc2a-016e-441c-aeda-ad5c48f755fa => generated 1516 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:09:44.617435 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7a7f4e47-50bf-4225-a507-fdf29e9ba9d1 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:44.618179 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7a7f4e47-50bf-4225-a507-fdf29e9ba9d1 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:44.618933 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7a7f4e47-50bf-4225-a507-fdf29e9ba9d1 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:44.619887 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7a7f4e47-50bf-4225-a507-fdf29e9ba9d1 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:44.620449 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7a7f4e47-50bf-4225-a507-fdf29e9ba9d1 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:44.620945 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7a7f4e47-50bf-4225-a507-fdf29e9ba9d1 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:44.878082 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-75dee4b0-37aa-4278-aea5-e7f99489326e tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:44.879463 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-75dee4b0-37aa-4278-aea5-e7f99489326e tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] [instance: e616bb7a-3fab-411e-ab23-25d093c36691] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:44.892804 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-75dee4b0-37aa-4278-aea5-e7f99489326e tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:44.893671 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-75dee4b0-37aa-4278-aea5-e7f99489326e tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:44.896942 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-75dee4b0-37aa-4278-aea5-e7f99489326e tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:44.898244 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-75dee4b0-37aa-4278-aea5-e7f99489326e tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:44.901544 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-75dee4b0-37aa-4278-aea5-e7f99489326e tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:44.902387 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-75dee4b0-37aa-4278-aea5-e7f99489326e tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:44.917101 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-7a7f4e47-50bf-4225-a507-fdf29e9ba9d1 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:44.934493 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-7a7f4e47-50bf-4225-a507-fdf29e9ba9d1 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:44.934837 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-7a7f4e47-50bf-4225-a507-fdf29e9ba9d1 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:44.939253 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-7a7f4e47-50bf-4225-a507-fdf29e9ba9d1 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] 10.222.0.43 "GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9" status: 200 len: 1874 microversion: 2.32 time: 0.341069 Oct 04 22:09:44.941626 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2509/4970] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:09:44 2022] GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9 => generated 1874 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:09:45.285988 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-75dee4b0-37aa-4278-aea5-e7f99489326e tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80fc56886fef422b9b52eb1dede7d10e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82e1a29234ce40f9b37d0eca196cd1db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:45.296504 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-75dee4b0-37aa-4278-aea5-e7f99489326e tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] 10.222.0.43 "GET /compute/v2.1/servers/e616bb7a-3fab-411e-ab23-25d093c36691" status: 200 len: 1681 microversion: 2.1 time: 0.423312 Oct 04 22:09:45.315567 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2462/4971] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:09:44 2022] GET /compute/v2.1/servers/e616bb7a-3fab-411e-ab23-25d093c36691 => generated 1681 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:09:45.621359 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-b54cc14b-c863-44c9-8af3-281fdbeccb05 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:45.622159 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-b54cc14b-c863-44c9-8af3-281fdbeccb05 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 3d4d9f68-34fa-48b4-a274-6b389af36686] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:45.636222 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-cea64580-4f90-4ba4-950e-2916618573db tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:45.637136 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-cea64580-4f90-4ba4-950e-2916618573db tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: 25c0bc2a-016e-441c-aeda-ad5c48f755fa] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:45.652795 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b54cc14b-c863-44c9-8af3-281fdbeccb05 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:45.653529 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b54cc14b-c863-44c9-8af3-281fdbeccb05 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:45.654595 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b54cc14b-c863-44c9-8af3-281fdbeccb05 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:45.654773 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cea64580-4f90-4ba4-950e-2916618573db tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:45.655439 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cea64580-4f90-4ba4-950e-2916618573db tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:45.656108 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cea64580-4f90-4ba4-950e-2916618573db tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:45.657059 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cea64580-4f90-4ba4-950e-2916618573db tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:45.657710 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cea64580-4f90-4ba4-950e-2916618573db tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:45.658486 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cea64580-4f90-4ba4-950e-2916618573db tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:45.662839 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b54cc14b-c863-44c9-8af3-281fdbeccb05 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:45.663905 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:09:45.667593 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b54cc14b-c863-44c9-8af3-281fdbeccb05 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:45.669702 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b54cc14b-c863-44c9-8af3-281fdbeccb05 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:46.100045 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-cea64580-4f90-4ba4-950e-2916618573db tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1682f1a60045d8a04d4d67393cd13f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b00cd9fa8e40a0919b61fcd60269f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:46.116813 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-b54cc14b-c863-44c9-8af3-281fdbeccb05 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:46.127936 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-cea64580-4f90-4ba4-950e-2916618573db tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "GET /compute/v2.1/servers/25c0bc2a-016e-441c-aeda-ad5c48f755fa" status: 200 len: 1516 microversion: 2.1 time: 0.495628 Oct 04 22:09:46.129140 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-b54cc14b-c863-44c9-8af3-281fdbeccb05 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/3d4d9f68-34fa-48b4-a274-6b389af36686" status: 200 len: 1511 microversion: 2.1 time: 0.527780 Oct 04 22:09:46.145519 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2463/4972] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:09:45 2022] GET /compute/v2.1/servers/25c0bc2a-016e-441c-aeda-ad5c48f755fa => generated 1516 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:09:46.146122 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2510/4973] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:09:45 2022] GET /compute/v2.1/servers/3d4d9f68-34fa-48b4-a274-6b389af36686 => generated 1511 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:09:46.152601 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e5492c00-d6cb-4b14-a7b3-0ac9d241e641 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:46.153231 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-e5492c00-d6cb-4b14-a7b3-0ac9d241e641 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] [instance: 367dad85-827d-47b0-a468-418d398b36f9] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:46.165918 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e5492c00-d6cb-4b14-a7b3-0ac9d241e641 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:46.168543 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e5492c00-d6cb-4b14-a7b3-0ac9d241e641 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:46.169028 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e5492c00-d6cb-4b14-a7b3-0ac9d241e641 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:46.169780 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e5492c00-d6cb-4b14-a7b3-0ac9d241e641 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:46.170259 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e5492c00-d6cb-4b14-a7b3-0ac9d241e641 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:46.173494 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e5492c00-d6cb-4b14-a7b3-0ac9d241e641 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:46.334806 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-6f52f161-18ce-401d-9e35-d09ee856ba4b tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:46.335447 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-6f52f161-18ce-401d-9e35-d09ee856ba4b tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] [instance: e616bb7a-3fab-411e-ab23-25d093c36691] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:46.354220 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6f52f161-18ce-401d-9e35-d09ee856ba4b tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:46.357551 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6f52f161-18ce-401d-9e35-d09ee856ba4b tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:46.358229 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6f52f161-18ce-401d-9e35-d09ee856ba4b tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:46.370122 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6f52f161-18ce-401d-9e35-d09ee856ba4b tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:46.370680 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6f52f161-18ce-401d-9e35-d09ee856ba4b tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:46.371140 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6f52f161-18ce-401d-9e35-d09ee856ba4b tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:46.492244 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-6f52f161-18ce-401d-9e35-d09ee856ba4b tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80fc56886fef422b9b52eb1dede7d10e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82e1a29234ce40f9b37d0eca196cd1db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:46.505848 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-6f52f161-18ce-401d-9e35-d09ee856ba4b tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] 10.222.0.43 "GET /compute/v2.1/servers/e616bb7a-3fab-411e-ab23-25d093c36691" status: 200 len: 1613 microversion: 2.1 time: 0.183324 Oct 04 22:09:46.519981 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2511/4974] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:09:46 2022] GET /compute/v2.1/servers/e616bb7a-3fab-411e-ab23-25d093c36691 => generated 1613 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:09:46.530822 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-d0a28ca4-5a6f-4a40-8e87-8e97601ca2e5 req-d54f735d-67fe-4dd9-9a7a-97f303485f57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e616bb7a-3fab-411e-ab23-25d093c36691", "name": "network-vif-deleted", "tag": "cd8f87a5-9b17-4bf6-9825-06160395f18f"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:09:46.552421 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-d0a28ca4-5a6f-4a40-8e87-8e97601ca2e5 req-d54f735d-67fe-4dd9-9a7a-97f303485f57 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:46.553541 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-d0a28ca4-5a6f-4a40-8e87-8e97601ca2e5 req-d54f735d-67fe-4dd9-9a7a-97f303485f57 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:46.554354 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-d0a28ca4-5a6f-4a40-8e87-8e97601ca2e5 req-d54f735d-67fe-4dd9-9a7a-97f303485f57 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:46.572814 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-d0a28ca4-5a6f-4a40-8e87-8e97601ca2e5 req-d54f735d-67fe-4dd9-9a7a-97f303485f57 service nova] Creating event network-vif-deleted:cd8f87a5-9b17-4bf6-9825-06160395f18f for instance e616bb7a-3fab-411e-ab23-25d093c36691 on n-h1-860284-1 Oct 04 22:09:46.582964 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-d0a28ca4-5a6f-4a40-8e87-8e97601ca2e5 req-d54f735d-67fe-4dd9-9a7a-97f303485f57 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060160 Oct 04 22:09:46.584294 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2512/4975] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:09:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:09:46.980239 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-e5492c00-d6cb-4b14-a7b3-0ac9d241e641 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:47.003004 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-e5492c00-d6cb-4b14-a7b3-0ac9d241e641 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:47.004745 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-e5492c00-d6cb-4b14-a7b3-0ac9d241e641 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:47.006246 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-e5492c00-d6cb-4b14-a7b3-0ac9d241e641 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] 10.222.0.43 "GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9" status: 200 len: 1874 microversion: 2.32 time: 0.859110 Oct 04 22:09:47.009233 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2464/4976] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:09:46 2022] GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9 => generated 1874 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:09:47.155135 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-b8d02a4c-b518-4cbb-9e52-d33b54f7fe24 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:47.155953 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-b8d02a4c-b518-4cbb-9e52-d33b54f7fe24 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 3d4d9f68-34fa-48b4-a274-6b389af36686] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:47.171102 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-b7c42941-b349-46be-ba5e-691fa857ad99 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:47.172675 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-b7c42941-b349-46be-ba5e-691fa857ad99 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: 25c0bc2a-016e-441c-aeda-ad5c48f755fa] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:47.199247 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b7c42941-b349-46be-ba5e-691fa857ad99 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:47.201052 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b7c42941-b349-46be-ba5e-691fa857ad99 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:47.202592 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b8d02a4c-b518-4cbb-9e52-d33b54f7fe24 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:47.203603 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b8d02a4c-b518-4cbb-9e52-d33b54f7fe24 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:47.203917 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b7c42941-b349-46be-ba5e-691fa857ad99 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:47.206695 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b7c42941-b349-46be-ba5e-691fa857ad99 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:47.208070 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b8d02a4c-b518-4cbb-9e52-d33b54f7fe24 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:47.209745 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b7c42941-b349-46be-ba5e-691fa857ad99 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:47.211987 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b7c42941-b349-46be-ba5e-691fa857ad99 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:47.219521 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b8d02a4c-b518-4cbb-9e52-d33b54f7fe24 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:47.221294 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b8d02a4c-b518-4cbb-9e52-d33b54f7fe24 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:47.228754 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b8d02a4c-b518-4cbb-9e52-d33b54f7fe24 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:48.161654 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-b7c42941-b349-46be-ba5e-691fa857ad99 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1682f1a60045d8a04d4d67393cd13f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b00cd9fa8e40a0919b61fcd60269f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:48.175365 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-b7c42941-b349-46be-ba5e-691fa857ad99 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "GET /compute/v2.1/servers/25c0bc2a-016e-441c-aeda-ad5c48f755fa" status: 200 len: 1474 microversion: 2.1 time: 1.010407 Oct 04 22:09:48.176998 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2465/4977] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:09:47 2022] GET /compute/v2.1/servers/25c0bc2a-016e-441c-aeda-ad5c48f755fa => generated 1474 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:09:48.194233 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-0485670b-9871-472e-bb3e-11b3fff8f6b5 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:48.195404 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-0485670b-9871-472e-bb3e-11b3fff8f6b5 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] [instance: e616bb7a-3fab-411e-ab23-25d093c36691] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:48.213453 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0485670b-9871-472e-bb3e-11b3fff8f6b5 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:48.215131 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0485670b-9871-472e-bb3e-11b3fff8f6b5 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:48.220568 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0485670b-9871-472e-bb3e-11b3fff8f6b5 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:48.221482 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0485670b-9871-472e-bb3e-11b3fff8f6b5 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:48.222263 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0485670b-9871-472e-bb3e-11b3fff8f6b5 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:48.222837 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0485670b-9871-472e-bb3e-11b3fff8f6b5 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:48.271483 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-0485670b-9871-472e-bb3e-11b3fff8f6b5 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] HTTP exception thrown: Instance e616bb7a-3fab-411e-ab23-25d093c36691 could not be found. Oct 04 22:09:48.284700 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-0485670b-9871-472e-bb3e-11b3fff8f6b5 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Request method failure captured: Oct 04 22:09:48.284700 n-d-860284-1 devstack@n-api.service[134101]: request: GET /compute/v2.1/servers/e616bb7a-3fab-411e-ab23-25d093c36691 HTTP/1.1 Oct 04 22:09:48.284700 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 22:09:48.284700 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 22:09:48.284700 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 22:09:48.284700 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 22:09:48.284700 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 22:09:48.284700 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 22:09:48.284700 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 22:09:48.284700 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 22:09:48.284700 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPK1_jKuDmdFTooG3vXwJSp1td0Kvvx-9VX1-OpwmBVV8uNR_MbJNU7EeI7sJdUoH3-0m3mmRBtTc-gLPN-qZ-RuZ8IL2TyG35svVe_hwPH0Z2c1BjkAMrt5beIkYsGbtm00-0XbqMbhJ5wgj-ztyQnhQ8ugDue3oDD_DUqnSWikZCg8 Oct 04 22:09:48.284700 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 22:09:48.284700 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 22:09:48.284700 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 22:09:48.284700 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 22:09:48.284700 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 22:09:48.284700 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 22:09:48.284700 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: 82e1a29234ce40f9b37d0eca196cd1db Oct 04 22:09:48.284700 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-AttachVolumeNegativeTest-2122228341 Oct 04 22:09:48.284700 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 22:09:48.284700 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 22:09:48.284700 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/82e1a29234ce40f9b37d0eca196cd1db"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_82e1a29234ce40f9b37d0eca196cd1db", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/82e1a29234ce40f9b37d0eca196cd1db"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/82e1a29234ce40f9b37d0eca196cd1db"}]}] Oct 04 22:09:48.284700 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-AttachVolumeNegativeTest-2122228341 Oct 04 22:09:48.284700 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: 82e1a29234ce40f9b37d0eca196cd1db Oct 04 22:09:48.284700 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2122228341 Oct 04 22:09:48.284700 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-AttachVolumeNegativeTest-2122228341-project Oct 04 22:09:48.284700 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 22:09:48.284700 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 22:09:48.284700 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 80fc56886fef422b9b52eb1dede7d10e Oct 04 22:09:48.284700 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-AttachVolumeNegativeTest-2122228341-project Oct 04 22:09:48.284700 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 22:09:48.284700 n-d-860284-1 devstack@n-api.service[134101]: exception: Instance e616bb7a-3fab-411e-ab23-25d093c36691 could not be found. Oct 04 22:09:48.284700 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': 'e616bb7a-3fab-411e-ab23-25d093c36691'} Oct 04 22:09:48.284700 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:09:48.284700 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:09:48.284700 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:09:48.284700 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:09:48.284700 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:09:48.284700 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:09:48.284700 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:09:48.284700 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:09:48.284700 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:09:48.284700 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:09:48.284700 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e616bb7a-3fab-411e-ab23-25d093c36691 could not be found. Oct 04 22:09:48.284700 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:09:48.284700 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:09:48.284700 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:09:48.284700 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:09:48.284700 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:09:48.284700 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:09:48.284700 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:09:48.284700 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:09:48.284700 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:09:48.284700 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:09:48.284700 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:09:48.284700 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:09:48.284700 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:09:48.284700 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:09:48.284700 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:09:48.284700 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:09:48.284700 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e616bb7a-3fab-411e-ab23-25d093c36691 could not be found. Oct 04 22:09:48.284700 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:09:48.284700 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:09:48.284700 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:09:48.290498 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:09:48.290498 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:09:48.290498 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:09:48.290498 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:09:48.290498 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:09:48.290498 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e616bb7a-3fab-411e-ab23-25d093c36691 could not be found. Oct 04 22:09:48.290498 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:09:48.290498 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-0485670b-9871-472e-bb3e-11b3fff8f6b5 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Returning 404 to user: Instance e616bb7a-3fab-411e-ab23-25d093c36691 could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:09:48.292358 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-0485670b-9871-472e-bb3e-11b3fff8f6b5 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] 10.222.0.43 "GET /compute/v2.1/servers/e616bb7a-3fab-411e-ab23-25d093c36691" status: 404 len: 111 microversion: 2.1 time: 0.112281 Oct 04 22:09:48.293880 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2466/4978] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:09:48 2022] GET /compute/v2.1/servers/e616bb7a-3fab-411e-ab23-25d093c36691 => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:09:48.305378 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-5d789cb1-38ce-4eef-9c2d-b746fe23a420 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:48.306286 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-5d789cb1-38ce-4eef-9c2d-b746fe23a420 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] [instance: 367dad85-827d-47b0-a468-418d398b36f9] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:48.320249 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5d789cb1-38ce-4eef-9c2d-b746fe23a420 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:48.325244 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5d789cb1-38ce-4eef-9c2d-b746fe23a420 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:48.326217 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5d789cb1-38ce-4eef-9c2d-b746fe23a420 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:48.327571 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5d789cb1-38ce-4eef-9c2d-b746fe23a420 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:48.328953 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5d789cb1-38ce-4eef-9c2d-b746fe23a420 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:48.329946 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5d789cb1-38ce-4eef-9c2d-b746fe23a420 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:49.224958 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-5d789cb1-38ce-4eef-9c2d-b746fe23a420 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:49.244278 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-5d789cb1-38ce-4eef-9c2d-b746fe23a420 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:49.246046 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-5d789cb1-38ce-4eef-9c2d-b746fe23a420 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:49.248239 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-5d789cb1-38ce-4eef-9c2d-b746fe23a420 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] 10.222.0.43 "GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9" status: 200 len: 1874 microversion: 2.32 time: 0.951648 Oct 04 22:09:49.253116 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-b8d02a4c-b518-4cbb-9e52-d33b54f7fe24 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:49.267662 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2467/4979] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:09:48 2022] GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9 => generated 1874 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:09:49.273051 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-b8d02a4c-b518-4cbb-9e52-d33b54f7fe24 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/3d4d9f68-34fa-48b4-a274-6b389af36686" status: 200 len: 1511 microversion: 2.1 time: 2.122013 Oct 04 22:09:49.295519 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-ba500919-5347-47df-9702-bbab597fb7ea tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Calling method '.version_select at 0x7fbb2e224ca0>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:49.299070 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2513/4980] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:09:47 2022] GET /compute/v2.1/servers/3d4d9f68-34fa-48b4-a274-6b389af36686 => generated 1511 bytes in 2150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:09:49.313921 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-e42790da-4b93-4fab-81df-1f451f732c61 req-7fbe8019-8254-4d87-976b-ed229dddc16d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25c0bc2a-016e-441c-aeda-ad5c48f755fa", "name": "network-vif-deleted", "tag": "fd642047-45c4-4590-bc8b-632c444afb84"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:09:49.316785 n-d-860284-1 devstack@n-api.service[134101]: ERROR oslo.messaging._drivers.impl_rabbit [None req-ba500919-5347-47df-9702-bbab597fb7ea tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] [54f0993b-fb22-4e4c-ae00-e3f0e5da4c18] AMQP server on 10.222.0.43:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 22:09:49.350064 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-e42790da-4b93-4fab-81df-1f451f732c61 req-7fbe8019-8254-4d87-976b-ed229dddc16d service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:49.352156 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-e42790da-4b93-4fab-81df-1f451f732c61 req-7fbe8019-8254-4d87-976b-ed229dddc16d service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:49.352643 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-e42790da-4b93-4fab-81df-1f451f732c61 req-7fbe8019-8254-4d87-976b-ed229dddc16d service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:49.374243 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-e42790da-4b93-4fab-81df-1f451f732c61 req-7fbe8019-8254-4d87-976b-ed229dddc16d service nova] Creating event network-vif-deleted:fd642047-45c4-4590-bc8b-632c444afb84 for instance 25c0bc2a-016e-441c-aeda-ad5c48f755fa on n-h2-860284-1 Oct 04 22:09:49.383285 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-e42790da-4b93-4fab-81df-1f451f732c61 req-7fbe8019-8254-4d87-976b-ed229dddc16d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082793 Oct 04 22:09:49.396253 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2514/4981] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:09:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:09:49.402192 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-6d99d672-2729-4923-9104-4a2db91d31c2 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:49.403247 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-6d99d672-2729-4923-9104-4a2db91d31c2 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: 25c0bc2a-016e-441c-aeda-ad5c48f755fa] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:49.417379 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6d99d672-2729-4923-9104-4a2db91d31c2 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:49.418197 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6d99d672-2729-4923-9104-4a2db91d31c2 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:49.418871 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6d99d672-2729-4923-9104-4a2db91d31c2 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:49.419825 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6d99d672-2729-4923-9104-4a2db91d31c2 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:49.420477 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6d99d672-2729-4923-9104-4a2db91d31c2 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:49.421091 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6d99d672-2729-4923-9104-4a2db91d31c2 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:49.443462 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-6d99d672-2729-4923-9104-4a2db91d31c2 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] HTTP exception thrown: Instance 25c0bc2a-016e-441c-aeda-ad5c48f755fa could not be found. Oct 04 22:09:49.445590 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-6d99d672-2729-4923-9104-4a2db91d31c2 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Request method failure captured: Oct 04 22:09:49.445590 n-d-860284-1 devstack@n-api.service[134102]: request: GET /compute/v2.1/servers/25c0bc2a-016e-441c-aeda-ad5c48f755fa HTTP/1.1 Oct 04 22:09:49.445590 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 22:09:49.445590 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 22:09:49.445590 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 22:09:49.445590 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 22:09:49.445590 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 22:09:49.445590 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 22:09:49.445590 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 22:09:49.445590 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 22:09:49.445590 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPK7MP0-m-xtUnxXwLoxlIfO4jzoQOT6GMi-_9Rz-dG646c6MuQMOjiOhGtcOohb2ZIUdejR42Va0IkiFMBDtdnbnUEdF8Psxz0uHfYGBQiEZpqo4CpOHPpz5KjUxS1LmPgcFnegJZtGQu1irxi49GMeHkm9nnXbxd63druWj1zFChJ4 Oct 04 22:09:49.445590 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 22:09:49.445590 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 22:09:49.445590 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 22:09:49.445590 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 22:09:49.445590 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 22:09:49.445590 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 22:09:49.445590 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: d4b00cd9fa8e40a0919b61fcd60269f5 Oct 04 22:09:49.445590 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-ServersTestJSON-1600369848 Oct 04 22:09:49.445590 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 22:09:49.445590 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 22:09:49.445590 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d4b00cd9fa8e40a0919b61fcd60269f5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_d4b00cd9fa8e40a0919b61fcd60269f5", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d4b00cd9fa8e40a0919b61fcd60269f5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/d4b00cd9fa8e40a0919b61fcd60269f5"}]}] Oct 04 22:09:49.445590 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-ServersTestJSON-1600369848 Oct 04 22:09:49.445590 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: d4b00cd9fa8e40a0919b61fcd60269f5 Oct 04 22:09:49.445590 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-ServersTestJSON-1600369848 Oct 04 22:09:49.445590 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-ServersTestJSON-1600369848-project Oct 04 22:09:49.445590 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 22:09:49.445590 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 22:09:49.445590 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: 9c1682f1a60045d8a04d4d67393cd13f Oct 04 22:09:49.445590 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-ServersTestJSON-1600369848-project Oct 04 22:09:49.445590 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 22:09:49.445590 n-d-860284-1 devstack@n-api.service[134102]: exception: Instance 25c0bc2a-016e-441c-aeda-ad5c48f755fa could not be found. Oct 04 22:09:49.445590 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': '25c0bc2a-016e-441c-aeda-ad5c48f755fa'} Oct 04 22:09:49.445590 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:09:49.445590 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:09:49.445590 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:09:49.445590 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:09:49.445590 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:09:49.445590 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:09:49.445590 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:09:49.445590 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:09:49.445590 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:09:49.445590 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:09:49.445590 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 25c0bc2a-016e-441c-aeda-ad5c48f755fa could not be found. Oct 04 22:09:49.445590 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:09:49.445590 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:09:49.445590 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:09:49.445590 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:09:49.445590 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:09:49.445590 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:09:49.445590 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:09:49.445590 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:09:49.445590 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:09:49.445590 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:09:49.445590 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:09:49.445590 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:09:49.445590 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:09:49.445590 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:09:49.445590 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:09:49.445590 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:09:49.445590 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 25c0bc2a-016e-441c-aeda-ad5c48f755fa could not be found. Oct 04 22:09:49.445590 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:09:49.445590 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:09:49.445590 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:09:49.451135 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:09:49.451135 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:09:49.451135 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:09:49.451135 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:09:49.451135 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:09:49.451135 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 25c0bc2a-016e-441c-aeda-ad5c48f755fa could not be found. Oct 04 22:09:49.451135 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:09:49.454848 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-6d99d672-2729-4923-9104-4a2db91d31c2 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Returning 404 to user: Instance 25c0bc2a-016e-441c-aeda-ad5c48f755fa could not be found. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:09:49.455955 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-6d99d672-2729-4923-9104-4a2db91d31c2 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "GET /compute/v2.1/servers/25c0bc2a-016e-441c-aeda-ad5c48f755fa" status: 404 len: 111 microversion: 2.1 time: 0.058149 Oct 04 22:09:49.461203 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2515/4982] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:09:49 2022] GET /compute/v2.1/servers/25c0bc2a-016e-441c-aeda-ad5c48f755fa => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:09:49.466459 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-24ee821a-9e30-4b02-b8e7-15900bb26fde tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Calling method '.version_select at 0x7fbb2e793af0>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:49.535138 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-24ee821a-9e30-4b02-b8e7-15900bb26fde tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-key-450823448" status: 202 len: 0 microversion: 2.1 time: 0.072419 Oct 04 22:09:49.538749 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2516/4983] 10.222.0.43 () {58 vars in 1206 bytes} [Tue Oct 4 22:09:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-450823448 => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 22:09:49.686427 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-4cf163d4-c333-46fe-9c54-cc6cf35d96a3 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1366040188", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452", "networks": [{"uuid": "3e97795f-9423-4034-b566-4a70497d6dcc"}]}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:09:49.816463 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.network.neutron [None req-4cf163d4-c333-46fe-9c54-cc6cf35d96a3 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] validate_networks() for [('3e97795f-9423-4034-b566-4a70497d6dcc', None, None, None, None, None)] {{(pid=134102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 22:09:50.335825 n-d-860284-1 devstack@n-api.service[134101]: INFO oslo.messaging._drivers.impl_rabbit [None req-ba500919-5347-47df-9702-bbab597fb7ea tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] [54f0993b-fb22-4e4c-ae00-e3f0e5da4c18] Reconnected to AMQP server on 10.222.0.43:5672 via [amqp] client with port 60476. Oct 04 22:09:50.373185 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-ba500919-5347-47df-9702-bbab597fb7ea tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-483355405" status: 202 len: 0 microversion: 2.1 time: 1.104071 Oct 04 22:09:50.374118 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2468/4984] 10.222.0.43 () {58 vars in 1218 bytes} [Tue Oct 4 22:09:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-483355405 => generated 0 bytes in 1106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 22:09:50.387693 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-fe1364af-a311-49d1-92c2-dc4b99bcabe6 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:50.389092 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-fe1364af-a311-49d1-92c2-dc4b99bcabe6 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] [instance: 367dad85-827d-47b0-a468-418d398b36f9] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:50.399948 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fe1364af-a311-49d1-92c2-dc4b99bcabe6 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:50.400704 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fe1364af-a311-49d1-92c2-dc4b99bcabe6 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:50.401323 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fe1364af-a311-49d1-92c2-dc4b99bcabe6 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:50.402233 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fe1364af-a311-49d1-92c2-dc4b99bcabe6 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:50.402971 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fe1364af-a311-49d1-92c2-dc4b99bcabe6 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:50.403575 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fe1364af-a311-49d1-92c2-dc4b99bcabe6 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:51.070050 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-fe1364af-a311-49d1-92c2-dc4b99bcabe6 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:51.087688 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-fe1364af-a311-49d1-92c2-dc4b99bcabe6 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:51.089460 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-fe1364af-a311-49d1-92c2-dc4b99bcabe6 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:51.090922 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-fe1364af-a311-49d1-92c2-dc4b99bcabe6 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] 10.222.0.43 "GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9" status: 200 len: 1874 microversion: 2.32 time: 0.715386 Oct 04 22:09:51.093614 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-4cf163d4-c333-46fe-9c54-cc6cf35d96a3 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Flavor limits 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 22:09:51.097412 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-4cf163d4-c333-46fe-9c54-cc6cf35d96a3 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Image limits 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 22:09:51.098421 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-4cf163d4-c333-46fe-9c54-cc6cf35d96a3 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Flavor pref 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 22:09:51.099583 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-4cf163d4-c333-46fe-9c54-cc6cf35d96a3 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Image pref 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 22:09:51.100543 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-4cf163d4-c333-46fe-9c54-cc6cf35d96a3 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 22:09:51.110408 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2469/4985] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:09:50 2022] GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9 => generated 1874 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:09:51.120696 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4cf163d4-c333-46fe-9c54-cc6cf35d96a3 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:51.123047 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4cf163d4-c333-46fe-9c54-cc6cf35d96a3 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:51.124130 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4cf163d4-c333-46fe-9c54-cc6cf35d96a3 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:51.125426 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-1bb079b2-0a35-4234-b11b-f7866d71caa3 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:51.126085 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-1bb079b2-0a35-4234-b11b-f7866d71caa3 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 3d4d9f68-34fa-48b4-a274-6b389af36686] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:51.126680 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4cf163d4-c333-46fe-9c54-cc6cf35d96a3 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:51.127300 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4cf163d4-c333-46fe-9c54-cc6cf35d96a3 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:51.127864 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4cf163d4-c333-46fe-9c54-cc6cf35d96a3 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:51.143652 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1bb079b2-0a35-4234-b11b-f7866d71caa3 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:51.144212 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1bb079b2-0a35-4234-b11b-f7866d71caa3 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:51.145033 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1bb079b2-0a35-4234-b11b-f7866d71caa3 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:51.145872 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1bb079b2-0a35-4234-b11b-f7866d71caa3 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:51.148216 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1bb079b2-0a35-4234-b11b-f7866d71caa3 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:51.148897 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1bb079b2-0a35-4234-b11b-f7866d71caa3 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:51.182710 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-4cf163d4-c333-46fe-9c54-cc6cf35d96a3 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Getting quotas for project d4b00cd9fa8e40a0919b61fcd60269f5. Resources: {'instances', 'ram', 'cores'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:09:51.196023 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-4cf163d4-c333-46fe-9c54-cc6cf35d96a3 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Getting quotas for user 9c1682f1a60045d8a04d4d67393cd13f and project d4b00cd9fa8e40a0919b61fcd60269f5. Resources: {'instances', 'ram', 'cores'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:09:51.238451 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-4cf163d4-c333-46fe-9c54-cc6cf35d96a3 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Going to run 1 instances... {{(pid=134102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 22:09:51.259756 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-4cf163d4-c333-46fe-9c54-cc6cf35d96a3 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: bedf6a44-86ef-4673-8a8f-7541db6eeda7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='58548514-5dac-426c-81f5-19e3fba33e23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 22:09:51.480952 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-1bb079b2-0a35-4234-b11b-f7866d71caa3 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:51.490400 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-1bb079b2-0a35-4234-b11b-f7866d71caa3 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/3d4d9f68-34fa-48b4-a274-6b389af36686" status: 200 len: 1488 microversion: 2.1 time: 0.378694 Oct 04 22:09:51.507388 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2470/4986] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:09:51 2022] GET /compute/v2.1/servers/3d4d9f68-34fa-48b4-a274-6b389af36686 => generated 1488 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:09:51.507657 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-4cf163d4-c333-46fe-9c54-cc6cf35d96a3 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.817379 Oct 04 22:09:51.507657 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2517/4987] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 22:09:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 1821 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 22:09:51.511250 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-28dbcdd4-c269-4af7-99e7-708f4ccb5c5d tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:51.512107 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-28dbcdd4-c269-4af7-99e7-708f4ccb5c5d tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: bedf6a44-86ef-4673-8a8f-7541db6eeda7] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:51.523632 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-711f0258-8468-4f28-b445-dbd34dd2d71c tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:09:51.527228 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-711f0258-8468-4f28-b445-dbd34dd2d71c tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 48243e1b-892b-4c4b-8db1-242b2e40653b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:51.534907 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-711f0258-8468-4f28-b445-dbd34dd2d71c tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:51.535600 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-711f0258-8468-4f28-b445-dbd34dd2d71c tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:51.536237 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-711f0258-8468-4f28-b445-dbd34dd2d71c tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:51.537395 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-711f0258-8468-4f28-b445-dbd34dd2d71c tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:51.538030 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-711f0258-8468-4f28-b445-dbd34dd2d71c tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:51.538772 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-711f0258-8468-4f28-b445-dbd34dd2d71c tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:51.614568 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-711f0258-8468-4f28-b445-dbd34dd2d71c tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "POST /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b/action" status: 200 len: 148 microversion: 2.1 time: 0.094464 Oct 04 22:09:51.616864 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2518/4988] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 22:09:51 2022] POST /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b/action => generated 148 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:09:51.648287 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-dd18265f-61af-4a4f-a573-8a94f3dbf0a6 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:51.652295 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-dd18265f-61af-4a4f-a573-8a94f3dbf0a6 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 48243e1b-892b-4c4b-8db1-242b2e40653b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:51.671577 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dd18265f-61af-4a4f-a573-8a94f3dbf0a6 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:51.675078 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dd18265f-61af-4a4f-a573-8a94f3dbf0a6 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:51.677456 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dd18265f-61af-4a4f-a573-8a94f3dbf0a6 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:51.678819 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dd18265f-61af-4a4f-a573-8a94f3dbf0a6 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:51.679554 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dd18265f-61af-4a4f-a573-8a94f3dbf0a6 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:51.680392 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dd18265f-61af-4a4f-a573-8a94f3dbf0a6 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:51.719793 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-28dbcdd4-c269-4af7-99e7-708f4ccb5c5d tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1682f1a60045d8a04d4d67393cd13f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b00cd9fa8e40a0919b61fcd60269f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:51.725230 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=100 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:09:51.736551 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-28dbcdd4-c269-4af7-99e7-708f4ccb5c5d tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "GET /compute/v2.1/servers/bedf6a44-86ef-4673-8a8f-7541db6eeda7" status: 200 len: 1209 microversion: 2.1 time: 0.229054 Oct 04 22:09:51.737608 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2471/4989] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:09:51 2022] GET /compute/v2.1/servers/bedf6a44-86ef-4673-8a8f-7541db6eeda7 => generated 1209 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:09:52.071029 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-dd18265f-61af-4a4f-a573-8a94f3dbf0a6 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:52.085602 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-dd18265f-61af-4a4f-a573-8a94f3dbf0a6 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b" status: 200 len: 1669 microversion: 2.1 time: 0.462919 Oct 04 22:09:52.087906 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2519/4990] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:09:51 2022] GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b => generated 1669 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:09:52.141072 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-b546fe66-b534-48b1-9459-857ffe54d425 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:52.142627 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-76a40145-8450-4fb7-b10c-496216d205bf tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:52.143788 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-b546fe66-b534-48b1-9459-857ffe54d425 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 48243e1b-892b-4c4b-8db1-242b2e40653b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:52.145191 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-76a40145-8450-4fb7-b10c-496216d205bf tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] [instance: 367dad85-827d-47b0-a468-418d398b36f9] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:52.160802 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b546fe66-b534-48b1-9459-857ffe54d425 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:52.163409 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b546fe66-b534-48b1-9459-857ffe54d425 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:52.163581 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-76a40145-8450-4fb7-b10c-496216d205bf tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:52.164302 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-76a40145-8450-4fb7-b10c-496216d205bf tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:52.166286 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b546fe66-b534-48b1-9459-857ffe54d425 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:52.166598 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-76a40145-8450-4fb7-b10c-496216d205bf tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:52.168665 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b546fe66-b534-48b1-9459-857ffe54d425 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:52.169165 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-76a40145-8450-4fb7-b10c-496216d205bf tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:52.171312 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b546fe66-b534-48b1-9459-857ffe54d425 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:52.171658 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-76a40145-8450-4fb7-b10c-496216d205bf tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:52.172500 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b546fe66-b534-48b1-9459-857ffe54d425 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:52.173181 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-76a40145-8450-4fb7-b10c-496216d205bf tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:52.857574 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-76a40145-8450-4fb7-b10c-496216d205bf tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:52.873052 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-76a40145-8450-4fb7-b10c-496216d205bf tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:52.874538 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-76a40145-8450-4fb7-b10c-496216d205bf tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:52.876308 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-76a40145-8450-4fb7-b10c-496216d205bf tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] 10.222.0.43 "GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9" status: 200 len: 1874 microversion: 2.32 time: 0.751420 Oct 04 22:09:52.893182 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2520/4991] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:09:52 2022] GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9 => generated 1874 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:09:52.912285 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-333bf8e7-a26a-4f68-aa75-010bc5dcbfdc tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Action: 'create', calling method: .version_select at 0x7fbb2e76e790>, body: {"keypair": {"name": "tempest-keypair-938614431", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ3yHUwnKbgYuhSv2L0aGUJySK00mamz78S2n/t3CvuW1YWicuECxplO11GXmQH89NHJe1MtKhGOO0EwWAWOzdjPAfXgoxVPplsBm/9Kz5NC5umdLzsE4lLkD7MaXTXspQ=="}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:09:52.977816 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-b546fe66-b534-48b1-9459-857ffe54d425 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:52.991767 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-333bf8e7-a26a-4f68-aa75-010bc5dcbfdc tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Getting quotas for project 82e1a29234ce40f9b37d0eca196cd1db. Resources: {'key_pairs'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:09:52.992144 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-b546fe66-b534-48b1-9459-857ffe54d425 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b" status: 200 len: 1669 microversion: 2.1 time: 0.868607 Oct 04 22:09:52.995790 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2472/4992] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:09:52 2022] GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b => generated 1669 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:09:53.009125 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-16a2a5ea-c4ae-4e07-aca3-e3adaa48d9be tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:53.009984 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-16a2a5ea-c4ae-4e07-aca3-e3adaa48d9be tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: bedf6a44-86ef-4673-8a8f-7541db6eeda7] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:53.029071 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-16a2a5ea-c4ae-4e07-aca3-e3adaa48d9be tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:53.029342 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-333bf8e7-a26a-4f68-aa75-010bc5dcbfdc tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Getting quotas for user 80fc56886fef422b9b52eb1dede7d10e and project 82e1a29234ce40f9b37d0eca196cd1db. Resources: {'key_pairs'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:09:53.031633 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-16a2a5ea-c4ae-4e07-aca3-e3adaa48d9be tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:53.035731 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-16a2a5ea-c4ae-4e07-aca3-e3adaa48d9be tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:53.037408 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-16a2a5ea-c4ae-4e07-aca3-e3adaa48d9be tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:53.039314 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-16a2a5ea-c4ae-4e07-aca3-e3adaa48d9be tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:53.040114 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-16a2a5ea-c4ae-4e07-aca3-e3adaa48d9be tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:53.104926 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-333bf8e7-a26a-4f68-aa75-010bc5dcbfdc tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.199944 Oct 04 22:09:53.106591 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2521/4993] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Oct 4 22:09:52 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:09:53.144363 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-05a3abe4-aac5-4f46-b22b-d371a79260a9 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:53.145913 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-05a3abe4-aac5-4f46-b22b-d371a79260a9 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 48243e1b-892b-4c4b-8db1-242b2e40653b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:53.175530 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-05a3abe4-aac5-4f46-b22b-d371a79260a9 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:53.176434 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-05a3abe4-aac5-4f46-b22b-d371a79260a9 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:53.177012 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-05a3abe4-aac5-4f46-b22b-d371a79260a9 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:53.177886 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-05a3abe4-aac5-4f46-b22b-d371a79260a9 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:53.179836 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-05a3abe4-aac5-4f46-b22b-d371a79260a9 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:53.184145 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-05a3abe4-aac5-4f46-b22b-d371a79260a9 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:53.305804 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-16a2a5ea-c4ae-4e07-aca3-e3adaa48d9be tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1682f1a60045d8a04d4d67393cd13f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b00cd9fa8e40a0919b61fcd60269f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:53.332852 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-16a2a5ea-c4ae-4e07-aca3-e3adaa48d9be tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "GET /compute/v2.1/servers/bedf6a44-86ef-4673-8a8f-7541db6eeda7" status: 200 len: 1261 microversion: 2.1 time: 0.335660 Oct 04 22:09:53.355705 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2473/4994] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:09:52 2022] GET /compute/v2.1/servers/bedf6a44-86ef-4673-8a8f-7541db6eeda7 => generated 1261 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:09:53.525896 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-05a3abe4-aac5-4f46-b22b-d371a79260a9 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:53.538065 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-05a3abe4-aac5-4f46-b22b-d371a79260a9 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b" status: 200 len: 1669 microversion: 2.1 time: 0.407805 Oct 04 22:09:53.538728 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2522/4995] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:09:53 2022] GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b => generated 1669 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:09:53.565802 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-702f4de4-2ef0-4dae-a641-ab9980edc2f9 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:53.566655 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-702f4de4-2ef0-4dae-a641-ab9980edc2f9 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 48243e1b-892b-4c4b-8db1-242b2e40653b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:53.577339 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-702f4de4-2ef0-4dae-a641-ab9980edc2f9 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:53.582781 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-702f4de4-2ef0-4dae-a641-ab9980edc2f9 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:53.584603 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-702f4de4-2ef0-4dae-a641-ab9980edc2f9 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:53.585818 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-702f4de4-2ef0-4dae-a641-ab9980edc2f9 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:53.587955 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-702f4de4-2ef0-4dae-a641-ab9980edc2f9 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:53.589103 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-702f4de4-2ef0-4dae-a641-ab9980edc2f9 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:53.910772 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-5d9365c2-9ce3-4f67-a99a-21c89fe6a268 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:53.911764 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-5d9365c2-9ce3-4f67-a99a-21c89fe6a268 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] [instance: 367dad85-827d-47b0-a468-418d398b36f9] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:53.935214 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5d9365c2-9ce3-4f67-a99a-21c89fe6a268 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:53.943491 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5d9365c2-9ce3-4f67-a99a-21c89fe6a268 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:53.944337 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5d9365c2-9ce3-4f67-a99a-21c89fe6a268 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:53.946895 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5d9365c2-9ce3-4f67-a99a-21c89fe6a268 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:53.947582 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5d9365c2-9ce3-4f67-a99a-21c89fe6a268 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:53.949651 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5d9365c2-9ce3-4f67-a99a-21c89fe6a268 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:54.096691 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-702f4de4-2ef0-4dae-a641-ab9980edc2f9 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:54.119702 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-702f4de4-2ef0-4dae-a641-ab9980edc2f9 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b" status: 200 len: 1669 microversion: 2.1 time: 0.558913 Oct 04 22:09:54.121121 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2474/4996] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:09:53 2022] GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b => generated 1669 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:09:54.192112 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-2e6dea9c-226e-4ab9-bcbd-01ef890ac026 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1214343367", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452", "networks": [{"uuid": "46f1773f-94f8-4a79-8019-a2303221d351"}]}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:09:54.284552 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.network.neutron [None req-2e6dea9c-226e-4ab9-bcbd-01ef890ac026 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] validate_networks() for [('46f1773f-94f8-4a79-8019-a2303221d351', None, None, None, None, None)] {{(pid=134101) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 22:09:54.746104 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-5d9365c2-9ce3-4f67-a99a-21c89fe6a268 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:54.769979 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-5d9365c2-9ce3-4f67-a99a-21c89fe6a268 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:54.772851 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-5d9365c2-9ce3-4f67-a99a-21c89fe6a268 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:54.777679 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-5d9365c2-9ce3-4f67-a99a-21c89fe6a268 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] 10.222.0.43 "GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9" status: 200 len: 1874 microversion: 2.32 time: 0.872634 Oct 04 22:09:54.778534 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2523/4997] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:09:53 2022] GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9 => generated 1874 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 22:09:54.785600 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-8430d2cd-a2c9-4872-93ac-e41d5cf34ac9 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:54.786691 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-8430d2cd-a2c9-4872-93ac-e41d5cf34ac9 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: bedf6a44-86ef-4673-8a8f-7541db6eeda7] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:54.799310 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8430d2cd-a2c9-4872-93ac-e41d5cf34ac9 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:54.800084 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8430d2cd-a2c9-4872-93ac-e41d5cf34ac9 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:54.800734 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8430d2cd-a2c9-4872-93ac-e41d5cf34ac9 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:54.801705 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8430d2cd-a2c9-4872-93ac-e41d5cf34ac9 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:54.802184 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8430d2cd-a2c9-4872-93ac-e41d5cf34ac9 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:54.802676 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8430d2cd-a2c9-4872-93ac-e41d5cf34ac9 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:54.948819 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-8430d2cd-a2c9-4872-93ac-e41d5cf34ac9 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1682f1a60045d8a04d4d67393cd13f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b00cd9fa8e40a0919b61fcd60269f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:54.962502 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-8430d2cd-a2c9-4872-93ac-e41d5cf34ac9 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "GET /compute/v2.1/servers/bedf6a44-86ef-4673-8a8f-7541db6eeda7" status: 200 len: 1267 microversion: 2.1 time: 0.182279 Oct 04 22:09:54.963761 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2524/4998] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:09:54 2022] GET /compute/v2.1/servers/bedf6a44-86ef-4673-8a8f-7541db6eeda7 => generated 1267 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:09:55.483499 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-2e6dea9c-226e-4ab9-bcbd-01ef890ac026 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Flavor limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 22:09:55.484852 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-2e6dea9c-226e-4ab9-bcbd-01ef890ac026 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Image limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 22:09:55.485311 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-2e6dea9c-226e-4ab9-bcbd-01ef890ac026 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Flavor pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 22:09:55.485801 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-2e6dea9c-226e-4ab9-bcbd-01ef890ac026 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Image pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 22:09:55.486294 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-2e6dea9c-226e-4ab9-bcbd-01ef890ac026 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 22:09:55.501545 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2e6dea9c-226e-4ab9-bcbd-01ef890ac026 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:55.504777 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2e6dea9c-226e-4ab9-bcbd-01ef890ac026 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:55.507653 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2e6dea9c-226e-4ab9-bcbd-01ef890ac026 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:55.508660 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2e6dea9c-226e-4ab9-bcbd-01ef890ac026 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:55.511602 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2e6dea9c-226e-4ab9-bcbd-01ef890ac026 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:55.512242 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2e6dea9c-226e-4ab9-bcbd-01ef890ac026 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:55.548247 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:09:55.564753 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-2e6dea9c-226e-4ab9-bcbd-01ef890ac026 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Getting quotas for project 9da7a77590054a3c911643db69a0beae. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:09:55.576687 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-2e6dea9c-226e-4ab9-bcbd-01ef890ac026 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Getting quotas for user 836cb8e2e7be4981bb266cbd4189a775 and project 9da7a77590054a3c911643db69a0beae. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:09:55.612733 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-2e6dea9c-226e-4ab9-bcbd-01ef890ac026 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Going to run 1 instances... {{(pid=134101) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 22:09:55.615143 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-2e6dea9c-226e-4ab9-bcbd-01ef890ac026 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: a9da8775-8ca8-41b1-8340-e4f3dae6e05b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='58548514-5dac-426c-81f5-19e3fba33e23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134101) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 22:09:55.697137 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-2e6dea9c-226e-4ab9-bcbd-01ef890ac026 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.509906 Oct 04 22:09:55.702820 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2475/4999] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 22:09:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 1515 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 22:09:55.713108 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-30d00531-57a7-4053-905a-e73e4f3366af tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:55.716820 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-30d00531-57a7-4053-905a-e73e4f3366af tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: a9da8775-8ca8-41b1-8340-e4f3dae6e05b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:55.805534 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-906ee944-d98c-479a-9425-698231f8a65f tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:55.806353 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-906ee944-d98c-479a-9425-698231f8a65f tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] [instance: 367dad85-827d-47b0-a468-418d398b36f9] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:55.816457 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-906ee944-d98c-479a-9425-698231f8a65f tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:55.816958 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-906ee944-d98c-479a-9425-698231f8a65f tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:55.817403 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-906ee944-d98c-479a-9425-698231f8a65f tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:55.818119 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-906ee944-d98c-479a-9425-698231f8a65f tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:55.822988 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-906ee944-d98c-479a-9425-698231f8a65f tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:55.823861 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-906ee944-d98c-479a-9425-698231f8a65f tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:55.872230 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-30d00531-57a7-4053-905a-e73e4f3366af tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:55.888701 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-30d00531-57a7-4053-905a-e73e4f3366af tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/a9da8775-8ca8-41b1-8340-e4f3dae6e05b" status: 200 len: 1215 microversion: 2.1 time: 0.179360 Oct 04 22:09:55.890746 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2525/5000] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:09:55 2022] GET /compute/v2.1/servers/a9da8775-8ca8-41b1-8340-e4f3dae6e05b => generated 1215 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:09:55.986497 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-f3bcf075-657f-46c2-af2d-9ff584f52347 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:55.987426 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-f3bcf075-657f-46c2-af2d-9ff584f52347 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: bedf6a44-86ef-4673-8a8f-7541db6eeda7] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:56.023489 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f3bcf075-657f-46c2-af2d-9ff584f52347 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:56.023999 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f3bcf075-657f-46c2-af2d-9ff584f52347 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:56.032174 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f3bcf075-657f-46c2-af2d-9ff584f52347 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:56.033107 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f3bcf075-657f-46c2-af2d-9ff584f52347 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:56.033621 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f3bcf075-657f-46c2-af2d-9ff584f52347 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:56.034083 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f3bcf075-657f-46c2-af2d-9ff584f52347 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:57.113064 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-f3bcf075-657f-46c2-af2d-9ff584f52347 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1682f1a60045d8a04d4d67393cd13f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b00cd9fa8e40a0919b61fcd60269f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:57.131518 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-f3bcf075-657f-46c2-af2d-9ff584f52347 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "GET /compute/v2.1/servers/bedf6a44-86ef-4673-8a8f-7541db6eeda7" status: 200 len: 1309 microversion: 2.1 time: 1.149741 Oct 04 22:09:57.148239 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2526/5001] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:09:55 2022] GET /compute/v2.1/servers/bedf6a44-86ef-4673-8a8f-7541db6eeda7 => generated 1309 bytes in 1167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:09:57.153658 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-e392ca1a-f6ee-4b27-a056-b5c3c21e2d9d tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:57.154530 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-e392ca1a-f6ee-4b27-a056-b5c3c21e2d9d tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: a9da8775-8ca8-41b1-8340-e4f3dae6e05b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:57.163769 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e392ca1a-f6ee-4b27-a056-b5c3c21e2d9d tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:57.165050 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e392ca1a-f6ee-4b27-a056-b5c3c21e2d9d tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:57.165684 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e392ca1a-f6ee-4b27-a056-b5c3c21e2d9d tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:57.166638 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e392ca1a-f6ee-4b27-a056-b5c3c21e2d9d tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:57.167266 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e392ca1a-f6ee-4b27-a056-b5c3c21e2d9d tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:57.167874 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e392ca1a-f6ee-4b27-a056-b5c3c21e2d9d tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:57.251060 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-e392ca1a-f6ee-4b27-a056-b5c3c21e2d9d tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:57.259896 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-906ee944-d98c-479a-9425-698231f8a65f tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:57.262752 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-e392ca1a-f6ee-4b27-a056-b5c3c21e2d9d tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/a9da8775-8ca8-41b1-8340-e4f3dae6e05b" status: 200 len: 1267 microversion: 2.1 time: 0.112823 Oct 04 22:09:57.263355 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2527/5002] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:09:57 2022] GET /compute/v2.1/servers/a9da8775-8ca8-41b1-8340-e4f3dae6e05b => generated 1267 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:09:57.283317 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-906ee944-d98c-479a-9425-698231f8a65f tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:57.289553 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-906ee944-d98c-479a-9425-698231f8a65f tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:57.291066 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-906ee944-d98c-479a-9425-698231f8a65f tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] 10.222.0.43 "GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9" status: 200 len: 1874 microversion: 2.32 time: 1.490614 Oct 04 22:09:57.318286 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2476/5003] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:09:55 2022] GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9 => generated 1874 bytes in 1492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:09:58.155624 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-028ac589-68cc-458e-acaa-c55faec1992c tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:58.156832 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-028ac589-68cc-458e-acaa-c55faec1992c tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: bedf6a44-86ef-4673-8a8f-7541db6eeda7] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:58.175529 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-028ac589-68cc-458e-acaa-c55faec1992c tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:58.176044 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-028ac589-68cc-458e-acaa-c55faec1992c tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:58.176479 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-028ac589-68cc-458e-acaa-c55faec1992c tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:58.177197 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-028ac589-68cc-458e-acaa-c55faec1992c tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:58.177654 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-028ac589-68cc-458e-acaa-c55faec1992c tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:58.178086 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-028ac589-68cc-458e-acaa-c55faec1992c tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:58.289486 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-dbb55ccf-9c5c-44ed-a126-93ef0609b25c tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:58.291015 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-dbb55ccf-9c5c-44ed-a126-93ef0609b25c tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: a9da8775-8ca8-41b1-8340-e4f3dae6e05b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:58.316284 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dbb55ccf-9c5c-44ed-a126-93ef0609b25c tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:58.316872 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dbb55ccf-9c5c-44ed-a126-93ef0609b25c tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:58.319939 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dbb55ccf-9c5c-44ed-a126-93ef0609b25c tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:58.322232 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dbb55ccf-9c5c-44ed-a126-93ef0609b25c tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:58.324438 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dbb55ccf-9c5c-44ed-a126-93ef0609b25c tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:58.325641 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dbb55ccf-9c5c-44ed-a126-93ef0609b25c tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:58.540272 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-dbb55ccf-9c5c-44ed-a126-93ef0609b25c tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:58.551872 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-dbb55ccf-9c5c-44ed-a126-93ef0609b25c tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/a9da8775-8ca8-41b1-8340-e4f3dae6e05b" status: 200 len: 1273 microversion: 2.1 time: 0.267321 Oct 04 22:09:58.555052 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2477/5004] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:09:58 2022] GET /compute/v2.1/servers/a9da8775-8ca8-41b1-8340-e4f3dae6e05b => generated 1273 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:09:58.565938 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-b9444283-cc70-42b7-a12c-b079a0400c03 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:58.567097 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-b9444283-cc70-42b7-a12c-b079a0400c03 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] [instance: 367dad85-827d-47b0-a468-418d398b36f9] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:58.576702 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b9444283-cc70-42b7-a12c-b079a0400c03 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:58.577696 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b9444283-cc70-42b7-a12c-b079a0400c03 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:58.578423 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b9444283-cc70-42b7-a12c-b079a0400c03 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:58.579590 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b9444283-cc70-42b7-a12c-b079a0400c03 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:58.580278 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b9444283-cc70-42b7-a12c-b079a0400c03 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:58.580923 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b9444283-cc70-42b7-a12c-b079a0400c03 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:58.888058 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-028ac589-68cc-458e-acaa-c55faec1992c tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1682f1a60045d8a04d4d67393cd13f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b00cd9fa8e40a0919b61fcd60269f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:58.898881 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-028ac589-68cc-458e-acaa-c55faec1992c tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "GET /compute/v2.1/servers/bedf6a44-86ef-4673-8a8f-7541db6eeda7" status: 200 len: 1309 microversion: 2.1 time: 0.747064 Oct 04 22:09:58.901050 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2528/5005] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:09:58 2022] GET /compute/v2.1/servers/bedf6a44-86ef-4673-8a8f-7541db6eeda7 => generated 1309 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:09:58.914540 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-e64efc1e-0248-4c7e-9578-b556de364a89 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-92988716", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f42d911e-d0db-47f1-8152-1d0e2f63f805"}], "security_groups": [{"name": "tempest-securitygroup--1317808886"}], "key_name": "tempest-keypair-938614431", "user_data": "}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:09:59.191168 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-b9444283-cc70-42b7-a12c-b079a0400c03 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:59.208931 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-b9444283-cc70-42b7-a12c-b079a0400c03 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:59.210546 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-b9444283-cc70-42b7-a12c-b079a0400c03 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:59.214690 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-b9444283-cc70-42b7-a12c-b079a0400c03 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] 10.222.0.43 "GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9" status: 200 len: 1874 microversion: 2.32 time: 0.657981 Oct 04 22:09:59.226786 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2478/5006] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:09:58 2022] GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9 => generated 1874 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:09:59.240309 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-fcb9f3b9-53f9-4bc9-b9c2-e634228ba263 req-2a17e526-fa81-470c-87b7-c7a2eb58d456 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bedf6a44-86ef-4673-8a8f-7541db6eeda7", "tag": "9470361c-e49a-4c6e-b434-6845f951ce31"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:09:59.252014 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-fcb9f3b9-53f9-4bc9-b9c2-e634228ba263 req-2a17e526-fa81-470c-87b7-c7a2eb58d456 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:59.252806 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-fcb9f3b9-53f9-4bc9-b9c2-e634228ba263 req-2a17e526-fa81-470c-87b7-c7a2eb58d456 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:59.253411 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-fcb9f3b9-53f9-4bc9-b9c2-e634228ba263 req-2a17e526-fa81-470c-87b7-c7a2eb58d456 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:59.258477 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.network.neutron [None req-e64efc1e-0248-4c7e-9578-b556de364a89 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] validate_networks() for [('f42d911e-d0db-47f1-8152-1d0e2f63f805', None, None, None, None, None)] {{(pid=134102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 22:09:59.267076 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-fcb9f3b9-53f9-4bc9-b9c2-e634228ba263 req-2a17e526-fa81-470c-87b7-c7a2eb58d456 service nova] Creating event network-changed:9470361c-e49a-4c6e-b434-6845f951ce31 for instance bedf6a44-86ef-4673-8a8f-7541db6eeda7 on n-h2-860284-1 Oct 04 22:09:59.273932 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-fcb9f3b9-53f9-4bc9-b9c2-e634228ba263 req-2a17e526-fa81-470c-87b7-c7a2eb58d456 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045696 Oct 04 22:09:59.276984 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2479/5007] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:09:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:09:59.584944 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-ce509e5d-e30a-4fb0-9593-02d2f1e09b80 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:59.586306 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-ce509e5d-e30a-4fb0-9593-02d2f1e09b80 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: a9da8775-8ca8-41b1-8340-e4f3dae6e05b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:59.611365 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ce509e5d-e30a-4fb0-9593-02d2f1e09b80 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:59.614783 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ce509e5d-e30a-4fb0-9593-02d2f1e09b80 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:59.615586 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ce509e5d-e30a-4fb0-9593-02d2f1e09b80 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:59.620494 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ce509e5d-e30a-4fb0-9593-02d2f1e09b80 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:59.623359 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ce509e5d-e30a-4fb0-9593-02d2f1e09b80 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:59.624012 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ce509e5d-e30a-4fb0-9593-02d2f1e09b80 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:59.978153 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:10:00.226711 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-ce509e5d-e30a-4fb0-9593-02d2f1e09b80 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:10:00.235358 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-ce509e5d-e30a-4fb0-9593-02d2f1e09b80 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/a9da8775-8ca8-41b1-8340-e4f3dae6e05b" status: 200 len: 1315 microversion: 2.1 time: 0.657907 Oct 04 22:10:00.250463 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2480/5008] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:09:59 2022] GET /compute/v2.1/servers/a9da8775-8ca8-41b1-8340-e4f3dae6e05b => generated 1315 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:10:00.255488 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-172e7888-7012-4a7d-b2df-abb82fce2dac tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:10:00.256139 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-172e7888-7012-4a7d-b2df-abb82fce2dac tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: bedf6a44-86ef-4673-8a8f-7541db6eeda7] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:10:00.276308 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-172e7888-7012-4a7d-b2df-abb82fce2dac tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:00.277492 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-172e7888-7012-4a7d-b2df-abb82fce2dac tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:00.280124 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-172e7888-7012-4a7d-b2df-abb82fce2dac tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:00.288864 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-172e7888-7012-4a7d-b2df-abb82fce2dac tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:00.293854 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-172e7888-7012-4a7d-b2df-abb82fce2dac tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:00.299164 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-172e7888-7012-4a7d-b2df-abb82fce2dac tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:00.725200 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-e64efc1e-0248-4c7e-9578-b556de364a89 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Flavor limits 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 22:10:00.725802 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-172e7888-7012-4a7d-b2df-abb82fce2dac tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1682f1a60045d8a04d4d67393cd13f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b00cd9fa8e40a0919b61fcd60269f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:10:00.727020 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-e64efc1e-0248-4c7e-9578-b556de364a89 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Image limits 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 22:10:00.727753 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-e64efc1e-0248-4c7e-9578-b556de364a89 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Flavor pref 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 22:10:00.728670 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-e64efc1e-0248-4c7e-9578-b556de364a89 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Image pref 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 22:10:00.729268 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-e64efc1e-0248-4c7e-9578-b556de364a89 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 22:10:00.743907 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-172e7888-7012-4a7d-b2df-abb82fce2dac tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "GET /compute/v2.1/servers/bedf6a44-86ef-4673-8a8f-7541db6eeda7" status: 200 len: 1309 microversion: 2.1 time: 0.486700 Oct 04 22:10:00.748472 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2481/5009] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:10:00 2022] GET /compute/v2.1/servers/bedf6a44-86ef-4673-8a8f-7541db6eeda7 => generated 1309 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:10:00.761654 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-9b563516-213f-46ec-bafd-db5181d0b045 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:10:00.762236 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-9b563516-213f-46ec-bafd-db5181d0b045 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] [instance: 367dad85-827d-47b0-a468-418d398b36f9] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:10:00.768584 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e64efc1e-0248-4c7e-9578-b556de364a89 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:00.770181 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e64efc1e-0248-4c7e-9578-b556de364a89 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:00.772765 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e64efc1e-0248-4c7e-9578-b556de364a89 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:00.774448 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e64efc1e-0248-4c7e-9578-b556de364a89 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:00.775377 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e64efc1e-0248-4c7e-9578-b556de364a89 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:00.777640 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e64efc1e-0248-4c7e-9578-b556de364a89 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:00.780553 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9b563516-213f-46ec-bafd-db5181d0b045 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:00.781088 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9b563516-213f-46ec-bafd-db5181d0b045 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:00.793749 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9b563516-213f-46ec-bafd-db5181d0b045 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:00.794958 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9b563516-213f-46ec-bafd-db5181d0b045 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:00.801183 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9b563516-213f-46ec-bafd-db5181d0b045 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:00.801902 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9b563516-213f-46ec-bafd-db5181d0b045 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:00.841866 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-e64efc1e-0248-4c7e-9578-b556de364a89 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Getting quotas for project 82e1a29234ce40f9b37d0eca196cd1db. Resources: {'instances', 'ram', 'cores'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:10:00.854834 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-e64efc1e-0248-4c7e-9578-b556de364a89 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Getting quotas for user 80fc56886fef422b9b52eb1dede7d10e and project 82e1a29234ce40f9b37d0eca196cd1db. Resources: {'instances', 'ram', 'cores'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:10:00.889517 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-e64efc1e-0248-4c7e-9578-b556de364a89 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Going to run 1 instances... {{(pid=134102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 22:10:00.893173 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-e64efc1e-0248-4c7e-9578-b556de364a89 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] [instance: 696c547f-7cea-497f-9871-dd26f3fb6cfc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='58548514-5dac-426c-81f5-19e3fba33e23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 22:10:01.030294 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-e64efc1e-0248-4c7e-9578-b556de364a89 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.124854 Oct 04 22:10:01.031888 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2529/5010] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 22:09:58 2022] POST /compute/v2.1/servers => generated 402 bytes in 2130 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 22:10:01.043952 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-31dc80a0-c181-4dce-be0e-ca13734ee153 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:10:01.044949 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-31dc80a0-c181-4dce-be0e-ca13734ee153 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] [instance: 696c547f-7cea-497f-9871-dd26f3fb6cfc] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:10:01.315488 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-31dc80a0-c181-4dce-be0e-ca13734ee153 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80fc56886fef422b9b52eb1dede7d10e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82e1a29234ce40f9b37d0eca196cd1db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:10:01.335720 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-31dc80a0-c181-4dce-be0e-ca13734ee153 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] 10.222.0.43 "GET /compute/v2.1/servers/696c547f-7cea-497f-9871-dd26f3fb6cfc" status: 200 len: 1239 microversion: 2.1 time: 0.291978 Oct 04 22:10:01.336417 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2530/5011] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:10:01 2022] GET /compute/v2.1/servers/696c547f-7cea-497f-9871-dd26f3fb6cfc => generated 1239 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:10:01.345945 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-5db51f3d-6234-4ec1-8241-4318f5eed0ec tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:10:01.346807 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-5db51f3d-6234-4ec1-8241-4318f5eed0ec tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: a9da8775-8ca8-41b1-8340-e4f3dae6e05b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:10:01.375850 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5db51f3d-6234-4ec1-8241-4318f5eed0ec tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:01.385259 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5db51f3d-6234-4ec1-8241-4318f5eed0ec tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:01.386026 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5db51f3d-6234-4ec1-8241-4318f5eed0ec tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:01.387088 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5db51f3d-6234-4ec1-8241-4318f5eed0ec tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:01.389275 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5db51f3d-6234-4ec1-8241-4318f5eed0ec tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:01.391421 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5db51f3d-6234-4ec1-8241-4318f5eed0ec tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:01.440677 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-9b563516-213f-46ec-bafd-db5181d0b045 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:10:01.458971 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-9b563516-213f-46ec-bafd-db5181d0b045 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:10:01.469095 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-9b563516-213f-46ec-bafd-db5181d0b045 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:10:01.475326 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-9b563516-213f-46ec-bafd-db5181d0b045 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] 10.222.0.43 "GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9" status: 200 len: 1874 microversion: 2.32 time: 0.719629 Oct 04 22:10:01.488800 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2482/5012] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:10:00 2022] GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9 => generated 1874 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:10:01.693529 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-5db51f3d-6234-4ec1-8241-4318f5eed0ec tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:10:01.724290 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-5db51f3d-6234-4ec1-8241-4318f5eed0ec tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/a9da8775-8ca8-41b1-8340-e4f3dae6e05b" status: 200 len: 1315 microversion: 2.1 time: 0.384495 Oct 04 22:10:01.732590 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2531/5013] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:10:01 2022] GET /compute/v2.1/servers/a9da8775-8ca8-41b1-8340-e4f3dae6e05b => generated 1315 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:10:01.772739 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-c384ea2b-43c2-4635-8c6b-db320e9e5044 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:10:01.773981 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-c384ea2b-43c2-4635-8c6b-db320e9e5044 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: bedf6a44-86ef-4673-8a8f-7541db6eeda7] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:10:01.782321 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c384ea2b-43c2-4635-8c6b-db320e9e5044 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:01.783252 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c384ea2b-43c2-4635-8c6b-db320e9e5044 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:01.783897 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c384ea2b-43c2-4635-8c6b-db320e9e5044 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:01.784882 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c384ea2b-43c2-4635-8c6b-db320e9e5044 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:01.785509 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c384ea2b-43c2-4635-8c6b-db320e9e5044 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:01.786270 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c384ea2b-43c2-4635-8c6b-db320e9e5044 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:02.224458 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-c384ea2b-43c2-4635-8c6b-db320e9e5044 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1682f1a60045d8a04d4d67393cd13f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b00cd9fa8e40a0919b61fcd60269f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:10:02.231896 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=100 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:10:02.235048 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-c384ea2b-43c2-4635-8c6b-db320e9e5044 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "GET /compute/v2.1/servers/bedf6a44-86ef-4673-8a8f-7541db6eeda7" status: 200 len: 1309 microversion: 2.1 time: 0.465255 Oct 04 22:10:02.247226 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2483/5014] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:10:01 2022] GET /compute/v2.1/servers/bedf6a44-86ef-4673-8a8f-7541db6eeda7 => generated 1309 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:10:02.252282 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-7ee8f56c-e13e-494d-bac1-94c971459a1f req-d15aeaf4-714d-4706-830c-2dfe26278fda service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9da8775-8ca8-41b1-8340-e4f3dae6e05b", "tag": "a2b687e2-c84f-4fe7-aa70-7f2f1ddf6a09"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:10:02.285690 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-7ee8f56c-e13e-494d-bac1-94c971459a1f req-d15aeaf4-714d-4706-830c-2dfe26278fda service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:02.296080 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-7ee8f56c-e13e-494d-bac1-94c971459a1f req-d15aeaf4-714d-4706-830c-2dfe26278fda service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:02.301349 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-7ee8f56c-e13e-494d-bac1-94c971459a1f req-d15aeaf4-714d-4706-830c-2dfe26278fda service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:02.340212 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-7ee8f56c-e13e-494d-bac1-94c971459a1f req-d15aeaf4-714d-4706-830c-2dfe26278fda service nova] Creating event network-changed:a2b687e2-c84f-4fe7-aa70-7f2f1ddf6a09 for instance a9da8775-8ca8-41b1-8340-e4f3dae6e05b on n-h2-860284-1 Oct 04 22:10:02.360166 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-7ee8f56c-e13e-494d-bac1-94c971459a1f req-d15aeaf4-714d-4706-830c-2dfe26278fda service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112389 Oct 04 22:10:02.361452 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2532/5015] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:10:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:10:02.385274 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-996aa158-4604-4c2d-8f23-5ce77217398f tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:10:02.386505 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-996aa158-4604-4c2d-8f23-5ce77217398f tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] [instance: 696c547f-7cea-497f-9871-dd26f3fb6cfc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:10:02.413526 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-996aa158-4604-4c2d-8f23-5ce77217398f tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:02.415220 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-996aa158-4604-4c2d-8f23-5ce77217398f tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:02.417914 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-996aa158-4604-4c2d-8f23-5ce77217398f tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:02.422759 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-996aa158-4604-4c2d-8f23-5ce77217398f tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:02.423265 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-996aa158-4604-4c2d-8f23-5ce77217398f tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:02.423718 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-996aa158-4604-4c2d-8f23-5ce77217398f tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:02.518303 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-633895ee-687e-410f-a50a-637535683d80 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:10:02.519480 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-633895ee-687e-410f-a50a-637535683d80 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] [instance: 367dad85-827d-47b0-a468-418d398b36f9] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:10:02.535302 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-633895ee-687e-410f-a50a-637535683d80 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:02.537514 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-633895ee-687e-410f-a50a-637535683d80 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:02.537514 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-633895ee-687e-410f-a50a-637535683d80 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:02.537514 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-633895ee-687e-410f-a50a-637535683d80 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:02.537809 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-633895ee-687e-410f-a50a-637535683d80 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:02.538025 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-633895ee-687e-410f-a50a-637535683d80 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:02.552562 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-996aa158-4604-4c2d-8f23-5ce77217398f tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80fc56886fef422b9b52eb1dede7d10e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82e1a29234ce40f9b37d0eca196cd1db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:10:02.563590 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-996aa158-4604-4c2d-8f23-5ce77217398f tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] 10.222.0.43 "GET /compute/v2.1/servers/696c547f-7cea-497f-9871-dd26f3fb6cfc" status: 200 len: 1243 microversion: 2.1 time: 0.182166 Oct 04 22:10:02.568993 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2484/5016] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:10:02 2022] GET /compute/v2.1/servers/696c547f-7cea-497f-9871-dd26f3fb6cfc => generated 1243 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:10:02.753903 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-826179eb-80a9-4f12-9529-9e073f3bf895 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:10:02.754799 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-826179eb-80a9-4f12-9529-9e073f3bf895 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: a9da8775-8ca8-41b1-8340-e4f3dae6e05b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:10:02.770548 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-826179eb-80a9-4f12-9529-9e073f3bf895 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:02.771390 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-826179eb-80a9-4f12-9529-9e073f3bf895 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:02.772600 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-826179eb-80a9-4f12-9529-9e073f3bf895 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:02.773572 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-826179eb-80a9-4f12-9529-9e073f3bf895 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:02.774849 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-826179eb-80a9-4f12-9529-9e073f3bf895 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:02.780835 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-826179eb-80a9-4f12-9529-9e073f3bf895 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:03.068395 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-826179eb-80a9-4f12-9529-9e073f3bf895 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:10:03.091744 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-826179eb-80a9-4f12-9529-9e073f3bf895 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/a9da8775-8ca8-41b1-8340-e4f3dae6e05b" status: 200 len: 1315 microversion: 2.1 time: 0.342165 Oct 04 22:10:03.093031 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2485/5017] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:10:02 2022] GET /compute/v2.1/servers/a9da8775-8ca8-41b1-8340-e4f3dae6e05b => generated 1315 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:10:03.160478 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-633895ee-687e-410f-a50a-637535683d80 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:10:03.194174 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-633895ee-687e-410f-a50a-637535683d80 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:10:03.216502 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-633895ee-687e-410f-a50a-637535683d80 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:10:03.220519 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-633895ee-687e-410f-a50a-637535683d80 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] 10.222.0.43 "GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9" status: 200 len: 1874 microversion: 2.32 time: 0.707132 Oct 04 22:10:03.243578 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2533/5018] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:10:02 2022] GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9 => generated 1874 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 22:10:03.274813 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-11923eed-9f3c-45cd-b914-04a8ebcf3b56 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:10:03.275754 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-11923eed-9f3c-45cd-b914-04a8ebcf3b56 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: bedf6a44-86ef-4673-8a8f-7541db6eeda7] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:10:03.295238 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-11923eed-9f3c-45cd-b914-04a8ebcf3b56 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:03.298470 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-11923eed-9f3c-45cd-b914-04a8ebcf3b56 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:03.301082 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-11923eed-9f3c-45cd-b914-04a8ebcf3b56 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:03.305294 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-11923eed-9f3c-45cd-b914-04a8ebcf3b56 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:03.310170 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-11923eed-9f3c-45cd-b914-04a8ebcf3b56 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:03.323651 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-11923eed-9f3c-45cd-b914-04a8ebcf3b56 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:03.623055 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-eafe2566-8889-4570-b2c9-8dd3db57c0d8 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:10:03.623762 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-eafe2566-8889-4570-b2c9-8dd3db57c0d8 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] [instance: 696c547f-7cea-497f-9871-dd26f3fb6cfc] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:10:03.647262 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-eafe2566-8889-4570-b2c9-8dd3db57c0d8 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:03.648058 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-eafe2566-8889-4570-b2c9-8dd3db57c0d8 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:03.648664 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-eafe2566-8889-4570-b2c9-8dd3db57c0d8 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:03.649554 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-eafe2566-8889-4570-b2c9-8dd3db57c0d8 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:03.650173 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-eafe2566-8889-4570-b2c9-8dd3db57c0d8 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:03.650792 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-eafe2566-8889-4570-b2c9-8dd3db57c0d8 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:04.014950 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-eafe2566-8889-4570-b2c9-8dd3db57c0d8 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80fc56886fef422b9b52eb1dede7d10e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82e1a29234ce40f9b37d0eca196cd1db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:10:04.033343 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-eafe2566-8889-4570-b2c9-8dd3db57c0d8 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] 10.222.0.43 "GET /compute/v2.1/servers/696c547f-7cea-497f-9871-dd26f3fb6cfc" status: 200 len: 1291 microversion: 2.1 time: 0.427771 Oct 04 22:10:04.048956 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2534/5019] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:10:03 2022] GET /compute/v2.1/servers/696c547f-7cea-497f-9871-dd26f3fb6cfc => generated 1291 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:10:04.070357 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-11923eed-9f3c-45cd-b914-04a8ebcf3b56 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1682f1a60045d8a04d4d67393cd13f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b00cd9fa8e40a0919b61fcd60269f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:10:04.080765 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-11923eed-9f3c-45cd-b914-04a8ebcf3b56 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "GET /compute/v2.1/servers/bedf6a44-86ef-4673-8a8f-7541db6eeda7" status: 200 len: 1309 microversion: 2.1 time: 0.810386 Oct 04 22:10:04.087956 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2486/5020] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:10:03 2022] GET /compute/v2.1/servers/bedf6a44-86ef-4673-8a8f-7541db6eeda7 => generated 1309 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:10:04.137648 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-c24cc434-157e-4cf4-90bc-2d2449cbaa80 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:10:04.138538 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-c24cc434-157e-4cf4-90bc-2d2449cbaa80 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: a9da8775-8ca8-41b1-8340-e4f3dae6e05b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:10:04.158506 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c24cc434-157e-4cf4-90bc-2d2449cbaa80 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:04.159251 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c24cc434-157e-4cf4-90bc-2d2449cbaa80 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:04.159871 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c24cc434-157e-4cf4-90bc-2d2449cbaa80 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:04.160875 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c24cc434-157e-4cf4-90bc-2d2449cbaa80 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:04.162214 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c24cc434-157e-4cf4-90bc-2d2449cbaa80 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:04.162843 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c24cc434-157e-4cf4-90bc-2d2449cbaa80 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:04.252094 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-62ce1943-1e76-4c6d-b9bd-7fa96c328452 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:10:04.252727 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-62ce1943-1e76-4c6d-b9bd-7fa96c328452 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] [instance: 367dad85-827d-47b0-a468-418d398b36f9] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:10:04.264301 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-62ce1943-1e76-4c6d-b9bd-7fa96c328452 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:04.265871 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-62ce1943-1e76-4c6d-b9bd-7fa96c328452 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:04.271366 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-62ce1943-1e76-4c6d-b9bd-7fa96c328452 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:04.272387 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-62ce1943-1e76-4c6d-b9bd-7fa96c328452 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:04.273025 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-62ce1943-1e76-4c6d-b9bd-7fa96c328452 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:04.273819 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-62ce1943-1e76-4c6d-b9bd-7fa96c328452 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:05.313386 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-62ce1943-1e76-4c6d-b9bd-7fa96c328452 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:10:05.317202 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-c24cc434-157e-4cf4-90bc-2d2449cbaa80 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:10:05.327334 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-c24cc434-157e-4cf4-90bc-2d2449cbaa80 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/a9da8775-8ca8-41b1-8340-e4f3dae6e05b" status: 200 len: 1315 microversion: 2.1 time: 1.201327 Oct 04 22:10:05.330760 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-62ce1943-1e76-4c6d-b9bd-7fa96c328452 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:10:05.344960 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2535/5021] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:10:04 2022] GET /compute/v2.1/servers/a9da8775-8ca8-41b1-8340-e4f3dae6e05b => generated 1315 bytes in 1220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:10:05.348131 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-62ce1943-1e76-4c6d-b9bd-7fa96c328452 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:10:05.353694 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-62ce1943-1e76-4c6d-b9bd-7fa96c328452 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] 10.222.0.43 "GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9" status: 200 len: 1874 microversion: 2.32 time: 1.106717 Oct 04 22:10:05.365132 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2487/5022] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:10:04 2022] GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9 => generated 1874 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 22:10:05.369788 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-372a8526-514a-4651-acce-f01488f1c241 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:10:05.370490 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-372a8526-514a-4651-acce-f01488f1c241 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] [instance: 696c547f-7cea-497f-9871-dd26f3fb6cfc] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:10:05.380515 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-6cad90a2-f432-45af-b0f9-f97b94288260 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:10:05.381702 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-6cad90a2-f432-45af-b0f9-f97b94288260 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: bedf6a44-86ef-4673-8a8f-7541db6eeda7] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:10:05.383749 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-372a8526-514a-4651-acce-f01488f1c241 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:05.384263 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-372a8526-514a-4651-acce-f01488f1c241 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:05.384712 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-372a8526-514a-4651-acce-f01488f1c241 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:05.391805 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-372a8526-514a-4651-acce-f01488f1c241 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:05.392358 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-372a8526-514a-4651-acce-f01488f1c241 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:05.392810 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-372a8526-514a-4651-acce-f01488f1c241 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:05.405258 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6cad90a2-f432-45af-b0f9-f97b94288260 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:05.409147 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6cad90a2-f432-45af-b0f9-f97b94288260 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:05.411545 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6cad90a2-f432-45af-b0f9-f97b94288260 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:05.412863 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6cad90a2-f432-45af-b0f9-f97b94288260 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:05.414421 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6cad90a2-f432-45af-b0f9-f97b94288260 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:05.418349 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6cad90a2-f432-45af-b0f9-f97b94288260 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:05.541864 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=2 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:10:05.592339 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-372a8526-514a-4651-acce-f01488f1c241 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80fc56886fef422b9b52eb1dede7d10e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82e1a29234ce40f9b37d0eca196cd1db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:10:05.601296 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=8 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:10:05.608042 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-372a8526-514a-4651-acce-f01488f1c241 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] 10.222.0.43 "GET /compute/v2.1/servers/696c547f-7cea-497f-9871-dd26f3fb6cfc" status: 200 len: 1297 microversion: 2.1 time: 0.259420 Oct 04 22:10:05.609842 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2536/5023] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:10:05 2022] GET /compute/v2.1/servers/696c547f-7cea-497f-9871-dd26f3fb6cfc => generated 1297 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:10:05.720940 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-6cad90a2-f432-45af-b0f9-f97b94288260 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1682f1a60045d8a04d4d67393cd13f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b00cd9fa8e40a0919b61fcd60269f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:10:05.736627 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-6cad90a2-f432-45af-b0f9-f97b94288260 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "GET /compute/v2.1/servers/bedf6a44-86ef-4673-8a8f-7541db6eeda7" status: 200 len: 1309 microversion: 2.1 time: 0.367766 Oct 04 22:10:05.739394 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2488/5024] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:10:05 2022] GET /compute/v2.1/servers/bedf6a44-86ef-4673-8a8f-7541db6eeda7 => generated 1309 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:10:06.357293 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-ee0972e8-6f30-4c70-a0f2-3e851f25f98f tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:10:06.358623 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-ee0972e8-6f30-4c70-a0f2-3e851f25f98f tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: a9da8775-8ca8-41b1-8340-e4f3dae6e05b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:10:06.378069 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ee0972e8-6f30-4c70-a0f2-3e851f25f98f tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:06.383601 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ee0972e8-6f30-4c70-a0f2-3e851f25f98f tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:06.392030 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ee0972e8-6f30-4c70-a0f2-3e851f25f98f tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:06.398796 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ee0972e8-6f30-4c70-a0f2-3e851f25f98f tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:06.399658 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ee0972e8-6f30-4c70-a0f2-3e851f25f98f tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:06.406470 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ee0972e8-6f30-4c70-a0f2-3e851f25f98f tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:06.413584 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-147212d1-6685-4526-9414-a3c413086517 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:10:06.414215 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-147212d1-6685-4526-9414-a3c413086517 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] [instance: 367dad85-827d-47b0-a468-418d398b36f9] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:10:06.451306 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-147212d1-6685-4526-9414-a3c413086517 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:06.459268 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-147212d1-6685-4526-9414-a3c413086517 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:06.464935 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-147212d1-6685-4526-9414-a3c413086517 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:06.466241 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-147212d1-6685-4526-9414-a3c413086517 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:06.483375 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-147212d1-6685-4526-9414-a3c413086517 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:06.493718 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-147212d1-6685-4526-9414-a3c413086517 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:07.174456 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-ee0972e8-6f30-4c70-a0f2-3e851f25f98f tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:10:07.186385 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-147212d1-6685-4526-9414-a3c413086517 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:10:07.189292 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-ee0972e8-6f30-4c70-a0f2-3e851f25f98f tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/a9da8775-8ca8-41b1-8340-e4f3dae6e05b" status: 200 len: 1315 microversion: 2.1 time: 0.835554 Oct 04 22:10:07.206036 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-147212d1-6685-4526-9414-a3c413086517 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:10:07.210902 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2537/5025] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:10:06 2022] GET /compute/v2.1/servers/a9da8775-8ca8-41b1-8340-e4f3dae6e05b => generated 1315 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:10:07.215859 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-880a5ad2-29a9-40ce-98f2-be151b5015c9 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:10:07.216492 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-880a5ad2-29a9-40ce-98f2-be151b5015c9 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] [instance: 696c547f-7cea-497f-9871-dd26f3fb6cfc] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:10:07.228116 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-147212d1-6685-4526-9414-a3c413086517 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:10:07.229539 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-147212d1-6685-4526-9414-a3c413086517 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] 10.222.0.43 "GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9" status: 200 len: 1874 microversion: 2.32 time: 0.829379 Oct 04 22:10:07.230482 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2489/5026] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:10:06 2022] GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9 => generated 1874 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:10:07.242651 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-4e71c4b9-778a-4c42-a862-99506b0a2c7a tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:10:07.252127 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-880a5ad2-29a9-40ce-98f2-be151b5015c9 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:07.253162 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-4e71c4b9-778a-4c42-a862-99506b0a2c7a tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: bedf6a44-86ef-4673-8a8f-7541db6eeda7] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:10:07.253887 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-880a5ad2-29a9-40ce-98f2-be151b5015c9 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:07.254341 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-880a5ad2-29a9-40ce-98f2-be151b5015c9 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:07.255112 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-880a5ad2-29a9-40ce-98f2-be151b5015c9 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:07.255573 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-880a5ad2-29a9-40ce-98f2-be151b5015c9 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:07.256015 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-880a5ad2-29a9-40ce-98f2-be151b5015c9 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:07.277235 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4e71c4b9-778a-4c42-a862-99506b0a2c7a tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:07.278807 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4e71c4b9-778a-4c42-a862-99506b0a2c7a tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:07.289971 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4e71c4b9-778a-4c42-a862-99506b0a2c7a tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:07.292049 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4e71c4b9-778a-4c42-a862-99506b0a2c7a tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:07.294818 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4e71c4b9-778a-4c42-a862-99506b0a2c7a tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:07.318495 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4e71c4b9-778a-4c42-a862-99506b0a2c7a tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:07.656426 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-4e71c4b9-778a-4c42-a862-99506b0a2c7a tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1682f1a60045d8a04d4d67393cd13f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b00cd9fa8e40a0919b61fcd60269f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:10:07.670523 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-4e71c4b9-778a-4c42-a862-99506b0a2c7a tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "GET /compute/v2.1/servers/bedf6a44-86ef-4673-8a8f-7541db6eeda7" status: 200 len: 1309 microversion: 2.1 time: 0.437634 Oct 04 22:10:07.672590 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2490/5027] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:10:07 2022] GET /compute/v2.1/servers/bedf6a44-86ef-4673-8a8f-7541db6eeda7 => generated 1309 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:10:07.832578 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-880a5ad2-29a9-40ce-98f2-be151b5015c9 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80fc56886fef422b9b52eb1dede7d10e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82e1a29234ce40f9b37d0eca196cd1db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:10:07.850574 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-880a5ad2-29a9-40ce-98f2-be151b5015c9 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] 10.222.0.43 "GET /compute/v2.1/servers/696c547f-7cea-497f-9871-dd26f3fb6cfc" status: 200 len: 1365 microversion: 2.1 time: 0.631418 Oct 04 22:10:07.851438 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2538/5028] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:10:07 2022] GET /compute/v2.1/servers/696c547f-7cea-497f-9871-dd26f3fb6cfc => generated 1365 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:10:08.219157 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-b91551aa-10dc-4027-b2f9-f9e51cb77958 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:10:08.220228 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-b91551aa-10dc-4027-b2f9-f9e51cb77958 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: a9da8775-8ca8-41b1-8340-e4f3dae6e05b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:10:08.231442 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b91551aa-10dc-4027-b2f9-f9e51cb77958 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:08.232806 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b91551aa-10dc-4027-b2f9-f9e51cb77958 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:08.233950 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b91551aa-10dc-4027-b2f9-f9e51cb77958 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:08.236154 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b91551aa-10dc-4027-b2f9-f9e51cb77958 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:08.238453 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b91551aa-10dc-4027-b2f9-f9e51cb77958 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:08.239141 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b91551aa-10dc-4027-b2f9-f9e51cb77958 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:08.262608 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-d5f64844-514c-4298-b48e-a9908ee5349b tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:10:08.263665 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-d5f64844-514c-4298-b48e-a9908ee5349b tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] [instance: 367dad85-827d-47b0-a468-418d398b36f9] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:10:08.276316 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d5f64844-514c-4298-b48e-a9908ee5349b tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:08.280320 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d5f64844-514c-4298-b48e-a9908ee5349b tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:08.281645 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d5f64844-514c-4298-b48e-a9908ee5349b tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:08.282779 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d5f64844-514c-4298-b48e-a9908ee5349b tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:08.284621 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d5f64844-514c-4298-b48e-a9908ee5349b tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:08.286334 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d5f64844-514c-4298-b48e-a9908ee5349b tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:09.033833 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-b91551aa-10dc-4027-b2f9-f9e51cb77958 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:10:09.047634 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-b91551aa-10dc-4027-b2f9-f9e51cb77958 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/a9da8775-8ca8-41b1-8340-e4f3dae6e05b" status: 200 len: 1315 microversion: 2.1 time: 0.834202 Oct 04 22:10:09.052564 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2491/5029] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:10:08 2022] GET /compute/v2.1/servers/a9da8775-8ca8-41b1-8340-e4f3dae6e05b => generated 1315 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:10:09.063156 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-43ff3c90-3783-4797-9036-0885ec26e146 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:10:09.064031 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-43ff3c90-3783-4797-9036-0885ec26e146 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: bedf6a44-86ef-4673-8a8f-7541db6eeda7] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:10:09.079491 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-43ff3c90-3783-4797-9036-0885ec26e146 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:09.079992 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-43ff3c90-3783-4797-9036-0885ec26e146 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:09.080319 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-d5f64844-514c-4298-b48e-a9908ee5349b tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:10:09.080793 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-43ff3c90-3783-4797-9036-0885ec26e146 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:09.081138 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-43ff3c90-3783-4797-9036-0885ec26e146 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:09.081606 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-43ff3c90-3783-4797-9036-0885ec26e146 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:09.082035 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-43ff3c90-3783-4797-9036-0885ec26e146 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:09.093971 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-d5f64844-514c-4298-b48e-a9908ee5349b tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:10:09.101602 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-d5f64844-514c-4298-b48e-a9908ee5349b tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:10:09.105760 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-d5f64844-514c-4298-b48e-a9908ee5349b tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] 10.222.0.43 "GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9" status: 200 len: 1874 microversion: 2.32 time: 0.845909 Oct 04 22:10:09.112107 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2539/5030] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:10:08 2022] GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9 => generated 1874 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 22:10:09.137712 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-f05f8663-deb0-415f-a35b-bfe6a8422cc4 req-700260e8-23bd-4263-afb2-6e3afdc2c0db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "696c547f-7cea-497f-9871-dd26f3fb6cfc", "tag": "b5aaccab-10a5-4329-b536-62d277938793"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:10:09.174220 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-f05f8663-deb0-415f-a35b-bfe6a8422cc4 req-700260e8-23bd-4263-afb2-6e3afdc2c0db service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:09.176937 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-f05f8663-deb0-415f-a35b-bfe6a8422cc4 req-700260e8-23bd-4263-afb2-6e3afdc2c0db service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:09.177998 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-f05f8663-deb0-415f-a35b-bfe6a8422cc4 req-700260e8-23bd-4263-afb2-6e3afdc2c0db service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:09.189995 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=100 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:10:09.216524 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-f05f8663-deb0-415f-a35b-bfe6a8422cc4 req-700260e8-23bd-4263-afb2-6e3afdc2c0db service nova] Creating event network-changed:b5aaccab-10a5-4329-b536-62d277938793 for instance 696c547f-7cea-497f-9871-dd26f3fb6cfc on n-h1-860284-1 Oct 04 22:10:09.228970 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-f05f8663-deb0-415f-a35b-bfe6a8422cc4 req-700260e8-23bd-4263-afb2-6e3afdc2c0db service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113326 Oct 04 22:10:09.229636 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2540/5031] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:10:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:10:09.242688 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-4842fb2c-fce5-4868-a847-65283a158286 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:10:09.243417 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-4842fb2c-fce5-4868-a847-65283a158286 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] [instance: 696c547f-7cea-497f-9871-dd26f3fb6cfc] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:10:09.263055 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4842fb2c-fce5-4868-a847-65283a158286 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:09.263867 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4842fb2c-fce5-4868-a847-65283a158286 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:09.264814 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4842fb2c-fce5-4868-a847-65283a158286 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:09.266816 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4842fb2c-fce5-4868-a847-65283a158286 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:09.267485 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4842fb2c-fce5-4868-a847-65283a158286 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:09.268104 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4842fb2c-fce5-4868-a847-65283a158286 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:09.699790 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-43ff3c90-3783-4797-9036-0885ec26e146 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1682f1a60045d8a04d4d67393cd13f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b00cd9fa8e40a0919b61fcd60269f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:10:09.710728 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-43ff3c90-3783-4797-9036-0885ec26e146 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "GET /compute/v2.1/servers/bedf6a44-86ef-4673-8a8f-7541db6eeda7" status: 200 len: 1309 microversion: 2.1 time: 0.656724 Oct 04 22:10:09.726324 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2492/5032] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:10:09 2022] GET /compute/v2.1/servers/bedf6a44-86ef-4673-8a8f-7541db6eeda7 => generated 1309 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:10:09.745644 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-4842fb2c-fce5-4868-a847-65283a158286 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80fc56886fef422b9b52eb1dede7d10e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82e1a29234ce40f9b37d0eca196cd1db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:10:09.759381 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-4842fb2c-fce5-4868-a847-65283a158286 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] 10.222.0.43 "GET /compute/v2.1/servers/696c547f-7cea-497f-9871-dd26f3fb6cfc" status: 200 len: 1365 microversion: 2.1 time: 0.525934 Oct 04 22:10:09.760285 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2541/5033] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:10:09 2022] GET /compute/v2.1/servers/696c547f-7cea-497f-9871-dd26f3fb6cfc => generated 1365 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:10:10.075232 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-16db47d3-8371-40f9-93b2-772f990481b6 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:10:10.075843 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-16db47d3-8371-40f9-93b2-772f990481b6 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: a9da8775-8ca8-41b1-8340-e4f3dae6e05b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:10:10.092330 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-16db47d3-8371-40f9-93b2-772f990481b6 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:10.093165 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-16db47d3-8371-40f9-93b2-772f990481b6 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:10.093776 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-16db47d3-8371-40f9-93b2-772f990481b6 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:10.094752 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-16db47d3-8371-40f9-93b2-772f990481b6 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:10.095366 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-16db47d3-8371-40f9-93b2-772f990481b6 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:10.095960 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-16db47d3-8371-40f9-93b2-772f990481b6 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:10.142437 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-017d2151-d2e2-449f-aa02-92076b4b9e7a tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:10:10.143604 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-017d2151-d2e2-449f-aa02-92076b4b9e7a tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] [instance: 367dad85-827d-47b0-a468-418d398b36f9] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:10:10.153298 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-017d2151-d2e2-449f-aa02-92076b4b9e7a tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:10.153797 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-017d2151-d2e2-449f-aa02-92076b4b9e7a tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:10.154427 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-017d2151-d2e2-449f-aa02-92076b4b9e7a tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:10.159071 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-017d2151-d2e2-449f-aa02-92076b4b9e7a tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:10.160843 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-017d2151-d2e2-449f-aa02-92076b4b9e7a tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:10.162469 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-017d2151-d2e2-449f-aa02-92076b4b9e7a tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:10.584962 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-16db47d3-8371-40f9-93b2-772f990481b6 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:10:10.600407 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-16db47d3-8371-40f9-93b2-772f990481b6 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/a9da8775-8ca8-41b1-8340-e4f3dae6e05b" status: 200 len: 1315 microversion: 2.1 time: 0.527325 Oct 04 22:10:10.601203 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2493/5034] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:10:10 2022] GET /compute/v2.1/servers/a9da8775-8ca8-41b1-8340-e4f3dae6e05b => generated 1315 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:10:10.610567 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-d640435f-3a17-4a50-81ac-45c15d0607e1 req-e68cdccc-0f88-492e-b278-b7d71388002e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bedf6a44-86ef-4673-8a8f-7541db6eeda7", "name": "network-vif-plugged", "status": "completed", "tag": "9470361c-e49a-4c6e-b434-6845f951ce31"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:10:10.626322 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-d640435f-3a17-4a50-81ac-45c15d0607e1 req-e68cdccc-0f88-492e-b278-b7d71388002e service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:10.627628 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-d640435f-3a17-4a50-81ac-45c15d0607e1 req-e68cdccc-0f88-492e-b278-b7d71388002e service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:10.628261 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-d640435f-3a17-4a50-81ac-45c15d0607e1 req-e68cdccc-0f88-492e-b278-b7d71388002e service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:10.652122 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-017d2151-d2e2-449f-aa02-92076b4b9e7a tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:10:10.662453 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-d640435f-3a17-4a50-81ac-45c15d0607e1 req-e68cdccc-0f88-492e-b278-b7d71388002e service nova] Creating event network-vif-plugged:9470361c-e49a-4c6e-b434-6845f951ce31 for instance bedf6a44-86ef-4673-8a8f-7541db6eeda7 on n-h2-860284-1 Oct 04 22:10:10.667942 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-017d2151-d2e2-449f-aa02-92076b4b9e7a tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:10:10.670036 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-017d2151-d2e2-449f-aa02-92076b4b9e7a tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:10:10.671805 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-017d2151-d2e2-449f-aa02-92076b4b9e7a tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] 10.222.0.43 "GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9" status: 200 len: 1874 microversion: 2.32 time: 0.534235 Oct 04 22:10:10.672862 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2542/5035] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:10:10 2022] GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9 => generated 1874 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:10:10.676921 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-d640435f-3a17-4a50-81ac-45c15d0607e1 req-e68cdccc-0f88-492e-b278-b7d71388002e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072178 Oct 04 22:10:10.677636 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2494/5036] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:10:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:10:10.739082 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-d10fa896-fc6e-4999-a19f-f794a72eb0d0 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:10:10.739940 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-d10fa896-fc6e-4999-a19f-f794a72eb0d0 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: bedf6a44-86ef-4673-8a8f-7541db6eeda7] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:10:10.747556 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d10fa896-fc6e-4999-a19f-f794a72eb0d0 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:10.748420 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d10fa896-fc6e-4999-a19f-f794a72eb0d0 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:10.749035 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d10fa896-fc6e-4999-a19f-f794a72eb0d0 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:10.750930 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d10fa896-fc6e-4999-a19f-f794a72eb0d0 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:10.751819 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d10fa896-fc6e-4999-a19f-f794a72eb0d0 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:10.752452 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d10fa896-fc6e-4999-a19f-f794a72eb0d0 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:10.787276 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-90aaf957-57f1-4baf-9e0e-71b082af64b7 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:10:10.787998 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-90aaf957-57f1-4baf-9e0e-71b082af64b7 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] [instance: 696c547f-7cea-497f-9871-dd26f3fb6cfc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:10:10.806918 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-90aaf957-57f1-4baf-9e0e-71b082af64b7 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:10.807730 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-90aaf957-57f1-4baf-9e0e-71b082af64b7 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:10.808353 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-90aaf957-57f1-4baf-9e0e-71b082af64b7 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:10.809238 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-90aaf957-57f1-4baf-9e0e-71b082af64b7 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:10.809865 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-90aaf957-57f1-4baf-9e0e-71b082af64b7 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:10.810488 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-90aaf957-57f1-4baf-9e0e-71b082af64b7 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:10.822666 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell0:SELECT=4 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:10:11.024164 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-d10fa896-fc6e-4999-a19f-f794a72eb0d0 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1682f1a60045d8a04d4d67393cd13f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b00cd9fa8e40a0919b61fcd60269f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:10:11.039919 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-d10fa896-fc6e-4999-a19f-f794a72eb0d0 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "GET /compute/v2.1/servers/bedf6a44-86ef-4673-8a8f-7541db6eeda7" status: 200 len: 1309 microversion: 2.1 time: 0.306374 Oct 04 22:10:11.043078 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2543/5037] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:10:10 2022] GET /compute/v2.1/servers/bedf6a44-86ef-4673-8a8f-7541db6eeda7 => generated 1309 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:10:11.113964 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-90aaf957-57f1-4baf-9e0e-71b082af64b7 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80fc56886fef422b9b52eb1dede7d10e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82e1a29234ce40f9b37d0eca196cd1db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:10:11.143091 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-90aaf957-57f1-4baf-9e0e-71b082af64b7 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] 10.222.0.43 "GET /compute/v2.1/servers/696c547f-7cea-497f-9871-dd26f3fb6cfc" status: 200 len: 1365 microversion: 2.1 time: 0.359245 Oct 04 22:10:11.143715 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2495/5038] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:10:10 2022] GET /compute/v2.1/servers/696c547f-7cea-497f-9871-dd26f3fb6cfc => generated 1365 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:10:11.623517 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-618e25f5-4746-4789-8df7-e60c40a85321 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:10:11.625080 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-618e25f5-4746-4789-8df7-e60c40a85321 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: a9da8775-8ca8-41b1-8340-e4f3dae6e05b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:10:11.631539 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell0:SELECT=20 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:10:11.635883 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-618e25f5-4746-4789-8df7-e60c40a85321 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:11.637109 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-618e25f5-4746-4789-8df7-e60c40a85321 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:11.637810 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-618e25f5-4746-4789-8df7-e60c40a85321 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:11.639079 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-618e25f5-4746-4789-8df7-e60c40a85321 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:11.640722 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-618e25f5-4746-4789-8df7-e60c40a85321 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:11.641074 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-618e25f5-4746-4789-8df7-e60c40a85321 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:11.704208 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-2db3c4a3-fdf5-47b5-960a-8e68f7ae1be8 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:10:11.705311 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-2db3c4a3-fdf5-47b5-960a-8e68f7ae1be8 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] [instance: 367dad85-827d-47b0-a468-418d398b36f9] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:10:11.717287 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2db3c4a3-fdf5-47b5-960a-8e68f7ae1be8 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:11.719702 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2db3c4a3-fdf5-47b5-960a-8e68f7ae1be8 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:11.720637 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2db3c4a3-fdf5-47b5-960a-8e68f7ae1be8 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:11.722914 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2db3c4a3-fdf5-47b5-960a-8e68f7ae1be8 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:11.724544 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2db3c4a3-fdf5-47b5-960a-8e68f7ae1be8 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:11.726449 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2db3c4a3-fdf5-47b5-960a-8e68f7ae1be8 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:11.855646 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-618e25f5-4746-4789-8df7-e60c40a85321 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:10:11.867233 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-618e25f5-4746-4789-8df7-e60c40a85321 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/a9da8775-8ca8-41b1-8340-e4f3dae6e05b" status: 200 len: 1315 microversion: 2.1 time: 0.247605 Oct 04 22:10:11.887538 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2544/5039] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:10:11 2022] GET /compute/v2.1/servers/a9da8775-8ca8-41b1-8340-e4f3dae6e05b => generated 1315 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:10:12.066636 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-015e62b5-37e4-461a-92a7-f1f1ea799c4d tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:10:12.067400 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-015e62b5-37e4-461a-92a7-f1f1ea799c4d tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: bedf6a44-86ef-4673-8a8f-7541db6eeda7] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:10:12.087810 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-015e62b5-37e4-461a-92a7-f1f1ea799c4d tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:12.089269 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-015e62b5-37e4-461a-92a7-f1f1ea799c4d tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:12.091691 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-015e62b5-37e4-461a-92a7-f1f1ea799c4d tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:12.092864 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-015e62b5-37e4-461a-92a7-f1f1ea799c4d tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:12.095810 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-015e62b5-37e4-461a-92a7-f1f1ea799c4d tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:12.099457 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-015e62b5-37e4-461a-92a7-f1f1ea799c4d tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:12.436152 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-015e62b5-37e4-461a-92a7-f1f1ea799c4d tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1682f1a60045d8a04d4d67393cd13f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b00cd9fa8e40a0919b61fcd60269f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:10:12.452031 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-2db3c4a3-fdf5-47b5-960a-8e68f7ae1be8 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:10:12.453993 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-015e62b5-37e4-461a-92a7-f1f1ea799c4d tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "GET /compute/v2.1/servers/bedf6a44-86ef-4673-8a8f-7541db6eeda7" status: 200 len: 1309 microversion: 2.1 time: 0.392569 Oct 04 22:10:12.469350 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-2db3c4a3-fdf5-47b5-960a-8e68f7ae1be8 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:10:12.488378 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-2db3c4a3-fdf5-47b5-960a-8e68f7ae1be8 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:10:12.490567 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2545/5040] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:10:12 2022] GET /compute/v2.1/servers/bedf6a44-86ef-4673-8a8f-7541db6eeda7 => generated 1309 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:10:12.491867 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-2db3c4a3-fdf5-47b5-960a-8e68f7ae1be8 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] 10.222.0.43 "GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9" status: 200 len: 1874 microversion: 2.32 time: 0.793828 Oct 04 22:10:12.510949 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2496/5041] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:10:11 2022] GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9 => generated 1874 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:10:12.518948 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-8bcaa22a-91cf-4625-a207-93e101e02b2d tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:10:12.519754 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-8bcaa22a-91cf-4625-a207-93e101e02b2d tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] [instance: 696c547f-7cea-497f-9871-dd26f3fb6cfc] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:10:12.528068 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8bcaa22a-91cf-4625-a207-93e101e02b2d tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:12.531950 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8bcaa22a-91cf-4625-a207-93e101e02b2d tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:12.532618 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8bcaa22a-91cf-4625-a207-93e101e02b2d tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:12.533768 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8bcaa22a-91cf-4625-a207-93e101e02b2d tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:12.537556 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8bcaa22a-91cf-4625-a207-93e101e02b2d tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:12.550887 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8bcaa22a-91cf-4625-a207-93e101e02b2d tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:12.872881 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-8bcaa22a-91cf-4625-a207-93e101e02b2d tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80fc56886fef422b9b52eb1dede7d10e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82e1a29234ce40f9b37d0eca196cd1db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:10:12.892423 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-8bcaa22a-91cf-4625-a207-93e101e02b2d tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] 10.222.0.43 "GET /compute/v2.1/servers/696c547f-7cea-497f-9871-dd26f3fb6cfc" status: 200 len: 1365 microversion: 2.1 time: 0.400620 Oct 04 22:10:12.893882 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2546/5042] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:10:12 2022] GET /compute/v2.1/servers/696c547f-7cea-497f-9871-dd26f3fb6cfc => generated 1365 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:10:12.911652 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-cc078fdf-03d1-47e7-bb01-ad4dc9c1e2d5 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:10:12.912696 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-cc078fdf-03d1-47e7-bb01-ad4dc9c1e2d5 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: a9da8775-8ca8-41b1-8340-e4f3dae6e05b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:10:12.923925 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cc078fdf-03d1-47e7-bb01-ad4dc9c1e2d5 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:12.931570 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cc078fdf-03d1-47e7-bb01-ad4dc9c1e2d5 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:12.932140 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cc078fdf-03d1-47e7-bb01-ad4dc9c1e2d5 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:12.932929 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cc078fdf-03d1-47e7-bb01-ad4dc9c1e2d5 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:12.933418 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cc078fdf-03d1-47e7-bb01-ad4dc9c1e2d5 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:12.933861 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cc078fdf-03d1-47e7-bb01-ad4dc9c1e2d5 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:13.203351 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-cc078fdf-03d1-47e7-bb01-ad4dc9c1e2d5 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:10:13.212246 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-cc078fdf-03d1-47e7-bb01-ad4dc9c1e2d5 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/a9da8775-8ca8-41b1-8340-e4f3dae6e05b" status: 200 len: 1315 microversion: 2.1 time: 0.322922 Oct 04 22:10:13.232157 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2497/5043] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:10:12 2022] GET /compute/v2.1/servers/a9da8775-8ca8-41b1-8340-e4f3dae6e05b => generated 1315 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:10:13.489982 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-b39caac8-81cf-47ae-be47-baea967deb45 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:10:13.490674 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-b39caac8-81cf-47ae-be47-baea967deb45 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: bedf6a44-86ef-4673-8a8f-7541db6eeda7] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:10:13.505164 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b39caac8-81cf-47ae-be47-baea967deb45 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:13.505827 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b39caac8-81cf-47ae-be47-baea967deb45 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:13.506519 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b39caac8-81cf-47ae-be47-baea967deb45 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:13.508834 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b39caac8-81cf-47ae-be47-baea967deb45 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:13.509788 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b39caac8-81cf-47ae-be47-baea967deb45 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:13.512186 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b39caac8-81cf-47ae-be47-baea967deb45 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:13.528626 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e6ab2fdf-57bf-44aa-97b5-772b182009c2 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:10:13.529353 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-e6ab2fdf-57bf-44aa-97b5-772b182009c2 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] [instance: 367dad85-827d-47b0-a468-418d398b36f9] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:10:13.541488 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e6ab2fdf-57bf-44aa-97b5-772b182009c2 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:13.542202 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e6ab2fdf-57bf-44aa-97b5-772b182009c2 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:13.544630 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e6ab2fdf-57bf-44aa-97b5-772b182009c2 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:13.548624 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e6ab2fdf-57bf-44aa-97b5-772b182009c2 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:13.549639 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e6ab2fdf-57bf-44aa-97b5-772b182009c2 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:13.550396 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e6ab2fdf-57bf-44aa-97b5-772b182009c2 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:13.859306 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-b39caac8-81cf-47ae-be47-baea967deb45 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1682f1a60045d8a04d4d67393cd13f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b00cd9fa8e40a0919b61fcd60269f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:10:13.867540 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-b39caac8-81cf-47ae-be47-baea967deb45 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "GET /compute/v2.1/servers/bedf6a44-86ef-4673-8a8f-7541db6eeda7" status: 200 len: 1491 microversion: 2.1 time: 0.381540 Oct 04 22:10:13.872355 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2547/5044] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:10:13 2022] GET /compute/v2.1/servers/bedf6a44-86ef-4673-8a8f-7541db6eeda7 => generated 1491 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:10:13.885718 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-e6ab2fdf-57bf-44aa-97b5-772b182009c2 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:10:13.906504 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-e6ab2fdf-57bf-44aa-97b5-772b182009c2 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:10:13.908131 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-e6ab2fdf-57bf-44aa-97b5-772b182009c2 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:10:13.909533 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-e6ab2fdf-57bf-44aa-97b5-772b182009c2 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] 10.222.0.43 "GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9" status: 200 len: 1874 microversion: 2.32 time: 0.386857 Oct 04 22:10:13.913383 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2498/5045] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:10:13 2022] GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9 => generated 1874 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:10:13.918262 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-0ed62331-6c43-4edc-9928-b3c0bd99a3b4 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:10:13.919520 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-0ed62331-6c43-4edc-9928-b3c0bd99a3b4 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] [instance: 696c547f-7cea-497f-9871-dd26f3fb6cfc] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:10:13.928498 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0ed62331-6c43-4edc-9928-b3c0bd99a3b4 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:13.929363 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0ed62331-6c43-4edc-9928-b3c0bd99a3b4 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:13.930056 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0ed62331-6c43-4edc-9928-b3c0bd99a3b4 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:13.932331 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0ed62331-6c43-4edc-9928-b3c0bd99a3b4 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:13.933030 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0ed62331-6c43-4edc-9928-b3c0bd99a3b4 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:13.933670 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0ed62331-6c43-4edc-9928-b3c0bd99a3b4 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:13.978409 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-07635188-ce92-4501-b397-39895970d387 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1366040188", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452", "networks": [{"uuid": "3e97795f-9423-4034-b566-4a70497d6dcc"}]}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:10:14.091269 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.network.neutron [None req-07635188-ce92-4501-b397-39895970d387 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] validate_networks() for [('3e97795f-9423-4034-b566-4a70497d6dcc', None, None, None, None, None)] {{(pid=134101) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 22:10:14.232160 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-0ed62331-6c43-4edc-9928-b3c0bd99a3b4 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80fc56886fef422b9b52eb1dede7d10e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82e1a29234ce40f9b37d0eca196cd1db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:10:14.246224 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-0ed62331-6c43-4edc-9928-b3c0bd99a3b4 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] 10.222.0.43 "GET /compute/v2.1/servers/696c547f-7cea-497f-9871-dd26f3fb6cfc" status: 200 len: 1365 microversion: 2.1 time: 0.330313 Oct 04 22:10:14.247948 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2548/5046] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:10:13 2022] GET /compute/v2.1/servers/696c547f-7cea-497f-9871-dd26f3fb6cfc => generated 1365 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:10:14.253987 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-fe385111-4aab-43c5-a85e-1beda2767a11 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:10:14.254905 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-fe385111-4aab-43c5-a85e-1beda2767a11 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: a9da8775-8ca8-41b1-8340-e4f3dae6e05b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:10:14.261475 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fe385111-4aab-43c5-a85e-1beda2767a11 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:14.262250 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fe385111-4aab-43c5-a85e-1beda2767a11 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:14.263010 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fe385111-4aab-43c5-a85e-1beda2767a11 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:14.263903 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fe385111-4aab-43c5-a85e-1beda2767a11 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:14.268346 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fe385111-4aab-43c5-a85e-1beda2767a11 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:14.275833 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fe385111-4aab-43c5-a85e-1beda2767a11 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:14.624854 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-fe385111-4aab-43c5-a85e-1beda2767a11 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:10:14.636631 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-fe385111-4aab-43c5-a85e-1beda2767a11 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/a9da8775-8ca8-41b1-8340-e4f3dae6e05b" status: 200 len: 1315 microversion: 2.1 time: 0.387478 Oct 04 22:10:14.639879 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2549/5047] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:10:14 2022] GET /compute/v2.1/servers/a9da8775-8ca8-41b1-8340-e4f3dae6e05b => generated 1315 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:10:14.934343 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-07635188-ce92-4501-b397-39895970d387 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Flavor limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 22:10:14.935129 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-07635188-ce92-4501-b397-39895970d387 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Image limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 22:10:14.935751 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-07635188-ce92-4501-b397-39895970d387 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Flavor pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 22:10:14.936395 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-07635188-ce92-4501-b397-39895970d387 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Image pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 22:10:14.937312 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-07635188-ce92-4501-b397-39895970d387 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 22:10:14.942748 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-cfd59751-9402-4743-af1e-ee1a3c587b3c tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:10:14.944137 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-cfd59751-9402-4743-af1e-ee1a3c587b3c tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] [instance: 367dad85-827d-47b0-a468-418d398b36f9] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:10:14.956471 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cfd59751-9402-4743-af1e-ee1a3c587b3c tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:14.956973 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cfd59751-9402-4743-af1e-ee1a3c587b3c tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:14.957419 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cfd59751-9402-4743-af1e-ee1a3c587b3c tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:14.958155 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cfd59751-9402-4743-af1e-ee1a3c587b3c tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:14.958646 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cfd59751-9402-4743-af1e-ee1a3c587b3c tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:14.959111 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cfd59751-9402-4743-af1e-ee1a3c587b3c tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:14.980468 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-07635188-ce92-4501-b397-39895970d387 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:14.982527 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-07635188-ce92-4501-b397-39895970d387 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:14.983286 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-07635188-ce92-4501-b397-39895970d387 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:14.984194 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-07635188-ce92-4501-b397-39895970d387 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:14.986670 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-07635188-ce92-4501-b397-39895970d387 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:14.987241 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-07635188-ce92-4501-b397-39895970d387 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:15.014836 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-07635188-ce92-4501-b397-39895970d387 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Getting quotas for project d4b00cd9fa8e40a0919b61fcd60269f5. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:10:15.026913 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-07635188-ce92-4501-b397-39895970d387 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Getting quotas for user 9c1682f1a60045d8a04d4d67393cd13f and project d4b00cd9fa8e40a0919b61fcd60269f5. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:10:15.051777 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-07635188-ce92-4501-b397-39895970d387 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Going to run 1 instances... {{(pid=134101) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 22:10:15.055165 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-07635188-ce92-4501-b397-39895970d387 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: 395434aa-4b24-4f4f-b83c-bb8870cd38b7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='58548514-5dac-426c-81f5-19e3fba33e23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134101) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 22:10:15.135351 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-07635188-ce92-4501-b397-39895970d387 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.160806 Oct 04 22:10:15.149119 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2499/5048] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 22:10:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 1175 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 22:10:15.166814 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-a9b0c592-6e50-4904-8303-832ccbe702b0 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:10:15.167994 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-a9b0c592-6e50-4904-8303-832ccbe702b0 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: 395434aa-4b24-4f4f-b83c-bb8870cd38b7] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:10:15.353023 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-a9b0c592-6e50-4904-8303-832ccbe702b0 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1682f1a60045d8a04d4d67393cd13f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b00cd9fa8e40a0919b61fcd60269f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:10:15.369658 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-a9b0c592-6e50-4904-8303-832ccbe702b0 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "GET /compute/v2.1/servers/395434aa-4b24-4f4f-b83c-bb8870cd38b7" status: 200 len: 1209 microversion: 2.1 time: 0.212853 Oct 04 22:10:15.382393 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2500/5049] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:10:15 2022] GET /compute/v2.1/servers/395434aa-4b24-4f4f-b83c-bb8870cd38b7 => generated 1209 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:10:15.382393 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-216f6b48-ae86-4829-b03b-8a296a6ccb84 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:10:15.382393 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-216f6b48-ae86-4829-b03b-8a296a6ccb84 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] [instance: 696c547f-7cea-497f-9871-dd26f3fb6cfc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:10:15.392622 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-216f6b48-ae86-4829-b03b-8a296a6ccb84 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:15.395140 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-216f6b48-ae86-4829-b03b-8a296a6ccb84 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:15.396045 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-216f6b48-ae86-4829-b03b-8a296a6ccb84 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:15.397703 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-216f6b48-ae86-4829-b03b-8a296a6ccb84 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:15.398395 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-216f6b48-ae86-4829-b03b-8a296a6ccb84 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:15.399313 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-216f6b48-ae86-4829-b03b-8a296a6ccb84 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:15.466835 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-cfd59751-9402-4743-af1e-ee1a3c587b3c tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:10:15.488805 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-cfd59751-9402-4743-af1e-ee1a3c587b3c tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:10:15.499495 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-cfd59751-9402-4743-af1e-ee1a3c587b3c tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:10:15.501543 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-cfd59751-9402-4743-af1e-ee1a3c587b3c tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] 10.222.0.43 "GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9" status: 200 len: 1874 microversion: 2.32 time: 0.563167 Oct 04 22:10:15.502348 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2550/5050] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:10:14 2022] GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9 => generated 1874 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:10:15.663560 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-b087fd82-5451-4ca8-9334-06037d0f0f69 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:10:15.664648 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-b087fd82-5451-4ca8-9334-06037d0f0f69 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: a9da8775-8ca8-41b1-8340-e4f3dae6e05b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:10:15.689082 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b087fd82-5451-4ca8-9334-06037d0f0f69 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:15.689938 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b087fd82-5451-4ca8-9334-06037d0f0f69 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:15.691702 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b087fd82-5451-4ca8-9334-06037d0f0f69 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:15.692692 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b087fd82-5451-4ca8-9334-06037d0f0f69 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:15.693393 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b087fd82-5451-4ca8-9334-06037d0f0f69 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:15.694077 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b087fd82-5451-4ca8-9334-06037d0f0f69 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:15.703124 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-216f6b48-ae86-4829-b03b-8a296a6ccb84 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80fc56886fef422b9b52eb1dede7d10e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82e1a29234ce40f9b37d0eca196cd1db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:10:15.715499 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-216f6b48-ae86-4829-b03b-8a296a6ccb84 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] 10.222.0.43 "GET /compute/v2.1/servers/696c547f-7cea-497f-9871-dd26f3fb6cfc" status: 200 len: 1365 microversion: 2.1 time: 0.343023 Oct 04 22:10:15.717826 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2501/5051] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:10:15 2022] GET /compute/v2.1/servers/696c547f-7cea-497f-9871-dd26f3fb6cfc => generated 1365 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:10:15.973435 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-b087fd82-5451-4ca8-9334-06037d0f0f69 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:10:15.994065 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-b087fd82-5451-4ca8-9334-06037d0f0f69 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/a9da8775-8ca8-41b1-8340-e4f3dae6e05b" status: 200 len: 1315 microversion: 2.1 time: 0.334399 Oct 04 22:10:16.014519 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2551/5052] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:10:15 2022] GET /compute/v2.1/servers/a9da8775-8ca8-41b1-8340-e4f3dae6e05b => generated 1315 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:10:16.403749 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-89d642dd-e6cd-4733-ae63-6128dfff5a77 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:10:16.404509 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-89d642dd-e6cd-4733-ae63-6128dfff5a77 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: 395434aa-4b24-4f4f-b83c-bb8870cd38b7] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:10:16.461248 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-89d642dd-e6cd-4733-ae63-6128dfff5a77 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:16.461773 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-89d642dd-e6cd-4733-ae63-6128dfff5a77 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:16.462238 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-89d642dd-e6cd-4733-ae63-6128dfff5a77 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:16.463226 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-89d642dd-e6cd-4733-ae63-6128dfff5a77 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:16.463780 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-89d642dd-e6cd-4733-ae63-6128dfff5a77 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:16.464220 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-89d642dd-e6cd-4733-ae63-6128dfff5a77 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:16.535348 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-4bb2dbca-a40e-4ad7-878b-434d7fbdaf1e tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:10:16.536345 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-4bb2dbca-a40e-4ad7-878b-434d7fbdaf1e tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] [instance: 367dad85-827d-47b0-a468-418d398b36f9] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:10:16.568862 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4bb2dbca-a40e-4ad7-878b-434d7fbdaf1e tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:16.569414 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4bb2dbca-a40e-4ad7-878b-434d7fbdaf1e tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:16.569874 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4bb2dbca-a40e-4ad7-878b-434d7fbdaf1e tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:16.571029 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4bb2dbca-a40e-4ad7-878b-434d7fbdaf1e tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:16.571506 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4bb2dbca-a40e-4ad7-878b-434d7fbdaf1e tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:16.571945 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4bb2dbca-a40e-4ad7-878b-434d7fbdaf1e tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:16.612413 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-89d642dd-e6cd-4733-ae63-6128dfff5a77 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1682f1a60045d8a04d4d67393cd13f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b00cd9fa8e40a0919b61fcd60269f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:10:16.616246 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=100 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:10:16.626077 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-89d642dd-e6cd-4733-ae63-6128dfff5a77 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "GET /compute/v2.1/servers/395434aa-4b24-4f4f-b83c-bb8870cd38b7" status: 200 len: 1261 microversion: 2.1 time: 0.234176 Oct 04 22:10:16.631302 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2502/5053] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:10:16 2022] GET /compute/v2.1/servers/395434aa-4b24-4f4f-b83c-bb8870cd38b7 => generated 1261 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:10:16.742486 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-c39eeddf-ec97-42b3-879f-d4662d9890bd tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:10:16.743586 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-c39eeddf-ec97-42b3-879f-d4662d9890bd tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] [instance: 696c547f-7cea-497f-9871-dd26f3fb6cfc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:10:16.752589 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c39eeddf-ec97-42b3-879f-d4662d9890bd tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:16.753571 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c39eeddf-ec97-42b3-879f-d4662d9890bd tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:16.754283 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c39eeddf-ec97-42b3-879f-d4662d9890bd tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:16.755239 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c39eeddf-ec97-42b3-879f-d4662d9890bd tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:16.756208 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c39eeddf-ec97-42b3-879f-d4662d9890bd tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:16.757006 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c39eeddf-ec97-42b3-879f-d4662d9890bd tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:17.976330 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-4bb2dbca-a40e-4ad7-878b-434d7fbdaf1e tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:10:18.010262 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-4bb2dbca-a40e-4ad7-878b-434d7fbdaf1e tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:10:18.013595 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-4bb2dbca-a40e-4ad7-878b-434d7fbdaf1e tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:10:18.016537 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-4bb2dbca-a40e-4ad7-878b-434d7fbdaf1e tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] 10.222.0.43 "GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9" status: 200 len: 1874 microversion: 2.32 time: 1.488084 Oct 04 22:10:18.023984 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2552/5054] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:10:16 2022] GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9 => generated 1874 bytes in 1496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:10:18.035125 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-ac5fd5ee-33fd-4f1f-8ddf-1dc5398e2786 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:10:18.043497 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-ac5fd5ee-33fd-4f1f-8ddf-1dc5398e2786 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: a9da8775-8ca8-41b1-8340-e4f3dae6e05b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:10:18.055071 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ac5fd5ee-33fd-4f1f-8ddf-1dc5398e2786 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:18.055729 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ac5fd5ee-33fd-4f1f-8ddf-1dc5398e2786 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:18.056322 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ac5fd5ee-33fd-4f1f-8ddf-1dc5398e2786 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:18.057300 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ac5fd5ee-33fd-4f1f-8ddf-1dc5398e2786 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:18.064053 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ac5fd5ee-33fd-4f1f-8ddf-1dc5398e2786 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:18.064703 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ac5fd5ee-33fd-4f1f-8ddf-1dc5398e2786 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:18.322442 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-c39eeddf-ec97-42b3-879f-d4662d9890bd tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80fc56886fef422b9b52eb1dede7d10e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82e1a29234ce40f9b37d0eca196cd1db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:10:18.340838 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-c39eeddf-ec97-42b3-879f-d4662d9890bd tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] 10.222.0.43 "GET /compute/v2.1/servers/696c547f-7cea-497f-9871-dd26f3fb6cfc" status: 200 len: 1365 microversion: 2.1 time: 1.603481 Oct 04 22:10:18.344436 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2503/5055] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:10:16 2022] GET /compute/v2.1/servers/696c547f-7cea-497f-9871-dd26f3fb6cfc => generated 1365 bytes in 1608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:10:18.358457 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e238fd75-e07d-407f-90f0-ca33600cc3d9 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:10:18.373509 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-e238fd75-e07d-407f-90f0-ca33600cc3d9 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: 395434aa-4b24-4f4f-b83c-bb8870cd38b7] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:10:18.389043 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e238fd75-e07d-407f-90f0-ca33600cc3d9 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:18.391393 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e238fd75-e07d-407f-90f0-ca33600cc3d9 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:18.392132 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e238fd75-e07d-407f-90f0-ca33600cc3d9 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:18.394885 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e238fd75-e07d-407f-90f0-ca33600cc3d9 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:18.396438 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e238fd75-e07d-407f-90f0-ca33600cc3d9 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:18.397146 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e238fd75-e07d-407f-90f0-ca33600cc3d9 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:18.960370 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-ac5fd5ee-33fd-4f1f-8ddf-1dc5398e2786 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:10:18.971550 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-ac5fd5ee-33fd-4f1f-8ddf-1dc5398e2786 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/a9da8775-8ca8-41b1-8340-e4f3dae6e05b" status: 200 len: 1315 microversion: 2.1 time: 0.946105 Oct 04 22:10:18.972567 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2553/5056] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:10:18 2022] GET /compute/v2.1/servers/a9da8775-8ca8-41b1-8340-e4f3dae6e05b => generated 1315 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:10:18.977480 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-53dde062-db29-4887-bd12-c00484fa4036 req-ba2520e2-c861-4199-9e94-73fd4af9bc1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "367dad85-827d-47b0-a468-418d398b36f9", "name": "network-vif-plugged", "status": "completed", "tag": "1701ea5d-b8bb-4192-8463-7dfa341dc8c3"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:10:19.000909 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-53dde062-db29-4887-bd12-c00484fa4036 req-ba2520e2-c861-4199-9e94-73fd4af9bc1f service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:19.001789 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-53dde062-db29-4887-bd12-c00484fa4036 req-ba2520e2-c861-4199-9e94-73fd4af9bc1f service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:19.002489 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-53dde062-db29-4887-bd12-c00484fa4036 req-ba2520e2-c861-4199-9e94-73fd4af9bc1f service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:19.038068 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-53dde062-db29-4887-bd12-c00484fa4036 req-ba2520e2-c861-4199-9e94-73fd4af9bc1f service nova] Creating event network-vif-plugged:1701ea5d-b8bb-4192-8463-7dfa341dc8c3 for instance 367dad85-827d-47b0-a468-418d398b36f9 on n-h1-860284-1 Oct 04 22:10:19.053415 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-53dde062-db29-4887-bd12-c00484fa4036 req-ba2520e2-c861-4199-9e94-73fd4af9bc1f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079313 Oct 04 22:10:19.056602 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2554/5057] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:10:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:10:19.077479 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-62a49f38-54d6-40ac-828a-994cb895a387 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:10:19.080630 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-62a49f38-54d6-40ac-828a-994cb895a387 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] [instance: 367dad85-827d-47b0-a468-418d398b36f9] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:10:19.103842 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-62a49f38-54d6-40ac-828a-994cb895a387 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:19.104567 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-62a49f38-54d6-40ac-828a-994cb895a387 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:19.105099 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-62a49f38-54d6-40ac-828a-994cb895a387 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:19.105929 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-62a49f38-54d6-40ac-828a-994cb895a387 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:19.111247 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-62a49f38-54d6-40ac-828a-994cb895a387 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:19.111812 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-62a49f38-54d6-40ac-828a-994cb895a387 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:19.245203 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-e238fd75-e07d-407f-90f0-ca33600cc3d9 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1682f1a60045d8a04d4d67393cd13f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b00cd9fa8e40a0919b61fcd60269f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:10:19.257741 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-e238fd75-e07d-407f-90f0-ca33600cc3d9 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "GET /compute/v2.1/servers/395434aa-4b24-4f4f-b83c-bb8870cd38b7" status: 200 len: 1309 microversion: 2.1 time: 0.911607 Oct 04 22:10:19.258152 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2504/5058] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:10:18 2022] GET /compute/v2.1/servers/395434aa-4b24-4f4f-b83c-bb8870cd38b7 => generated 1309 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:10:19.370528 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-8ba937b0-f9fa-4b0c-bd92-59693face8b1 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:10:19.371174 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-8ba937b0-f9fa-4b0c-bd92-59693face8b1 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] [instance: 696c547f-7cea-497f-9871-dd26f3fb6cfc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:10:19.380273 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8ba937b0-f9fa-4b0c-bd92-59693face8b1 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:19.380771 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8ba937b0-f9fa-4b0c-bd92-59693face8b1 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:19.391148 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8ba937b0-f9fa-4b0c-bd92-59693face8b1 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:19.395616 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8ba937b0-f9fa-4b0c-bd92-59693face8b1 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:19.395925 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8ba937b0-f9fa-4b0c-bd92-59693face8b1 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:19.396564 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8ba937b0-f9fa-4b0c-bd92-59693face8b1 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:20.013066 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-62a49f38-54d6-40ac-828a-994cb895a387 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:10:20.029864 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-62a49f38-54d6-40ac-828a-994cb895a387 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:10:20.031554 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-62a49f38-54d6-40ac-828a-994cb895a387 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:10:20.032817 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-62a49f38-54d6-40ac-828a-994cb895a387 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] 10.222.0.43 "GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9" status: 200 len: 1874 microversion: 2.32 time: 0.965950 Oct 04 22:10:20.042339 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-8ba937b0-f9fa-4b0c-bd92-59693face8b1 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80fc56886fef422b9b52eb1dede7d10e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82e1a29234ce40f9b37d0eca196cd1db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:10:20.052982 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-8ba937b0-f9fa-4b0c-bd92-59693face8b1 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] 10.222.0.43 "GET /compute/v2.1/servers/696c547f-7cea-497f-9871-dd26f3fb6cfc" status: 200 len: 1365 microversion: 2.1 time: 0.686355 Oct 04 22:10:20.053535 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2555/5059] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:10:19 2022] GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9 => generated 1874 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:10:20.062746 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2505/5060] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:10:19 2022] GET /compute/v2.1/servers/696c547f-7cea-497f-9871-dd26f3fb6cfc => generated 1365 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:10:20.063618 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-88595bba-fb28-4c73-ab76-01ea9929411d tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:10:20.065193 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-88595bba-fb28-4c73-ab76-01ea9929411d tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: a9da8775-8ca8-41b1-8340-e4f3dae6e05b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:10:20.080616 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-88595bba-fb28-4c73-ab76-01ea9929411d tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:20.086935 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-88595bba-fb28-4c73-ab76-01ea9929411d tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:20.087791 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-88595bba-fb28-4c73-ab76-01ea9929411d tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:20.092840 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-88595bba-fb28-4c73-ab76-01ea9929411d tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:20.094333 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-88595bba-fb28-4c73-ab76-01ea9929411d tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:20.097367 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-88595bba-fb28-4c73-ab76-01ea9929411d tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:20.286086 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-771e5359-7f43-40c9-a44e-bb08d6b25273 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:10:20.286997 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-771e5359-7f43-40c9-a44e-bb08d6b25273 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: 395434aa-4b24-4f4f-b83c-bb8870cd38b7] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:10:20.301091 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-771e5359-7f43-40c9-a44e-bb08d6b25273 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:20.301598 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-771e5359-7f43-40c9-a44e-bb08d6b25273 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:20.310401 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-771e5359-7f43-40c9-a44e-bb08d6b25273 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:20.311327 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-771e5359-7f43-40c9-a44e-bb08d6b25273 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:20.311994 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-771e5359-7f43-40c9-a44e-bb08d6b25273 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:20.312518 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-771e5359-7f43-40c9-a44e-bb08d6b25273 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:20.987465 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-88595bba-fb28-4c73-ab76-01ea9929411d tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:10:21.002892 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-88595bba-fb28-4c73-ab76-01ea9929411d tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/a9da8775-8ca8-41b1-8340-e4f3dae6e05b" status: 200 len: 1315 microversion: 2.1 time: 0.947949 Oct 04 22:10:21.003822 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2556/5061] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:10:20 2022] GET /compute/v2.1/servers/a9da8775-8ca8-41b1-8340-e4f3dae6e05b => generated 1315 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:10:21.022240 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-4408a60c-5018-4cd0-bd6d-6695e16b38ae req-f0ff0fe2-e0f4-4b4f-9f63-40c42a230dd2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "395434aa-4b24-4f4f-b83c-bb8870cd38b7", "tag": "95bc59a7-4753-423d-8cf1-764c9edf2646"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:10:21.054094 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-4408a60c-5018-4cd0-bd6d-6695e16b38ae req-f0ff0fe2-e0f4-4b4f-9f63-40c42a230dd2 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:21.054761 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-4408a60c-5018-4cd0-bd6d-6695e16b38ae req-f0ff0fe2-e0f4-4b4f-9f63-40c42a230dd2 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:21.055360 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-4408a60c-5018-4cd0-bd6d-6695e16b38ae req-f0ff0fe2-e0f4-4b4f-9f63-40c42a230dd2 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:21.101681 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-4408a60c-5018-4cd0-bd6d-6695e16b38ae req-f0ff0fe2-e0f4-4b4f-9f63-40c42a230dd2 service nova] Creating event network-changed:95bc59a7-4753-423d-8cf1-764c9edf2646 for instance 395434aa-4b24-4f4f-b83c-bb8870cd38b7 on n-h2-860284-1 Oct 04 22:10:21.112598 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-4408a60c-5018-4cd0-bd6d-6695e16b38ae req-f0ff0fe2-e0f4-4b4f-9f63-40c42a230dd2 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107313 Oct 04 22:10:21.122968 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2557/5062] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:10:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:10:21.142161 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-b9849bdf-03a8-4aeb-a169-9016ab80e8ea tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:10:21.143238 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-b9849bdf-03a8-4aeb-a169-9016ab80e8ea tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] [instance: 367dad85-827d-47b0-a468-418d398b36f9] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:10:21.151731 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b9849bdf-03a8-4aeb-a169-9016ab80e8ea tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:21.152335 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b9849bdf-03a8-4aeb-a169-9016ab80e8ea tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:21.152919 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b9849bdf-03a8-4aeb-a169-9016ab80e8ea tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:21.153763 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b9849bdf-03a8-4aeb-a169-9016ab80e8ea tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:21.154348 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b9849bdf-03a8-4aeb-a169-9016ab80e8ea tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:21.158873 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b9849bdf-03a8-4aeb-a169-9016ab80e8ea tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:21.216408 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-771e5359-7f43-40c9-a44e-bb08d6b25273 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1682f1a60045d8a04d4d67393cd13f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b00cd9fa8e40a0919b61fcd60269f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:10:21.229560 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-771e5359-7f43-40c9-a44e-bb08d6b25273 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "GET /compute/v2.1/servers/395434aa-4b24-4f4f-b83c-bb8870cd38b7" status: 200 len: 1309 microversion: 2.1 time: 0.947229 Oct 04 22:10:21.236662 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2506/5063] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:10:20 2022] GET /compute/v2.1/servers/395434aa-4b24-4f4f-b83c-bb8870cd38b7 => generated 1309 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:10:21.253768 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e7008c29-a6b7-4aa0-8c6f-aa9ec8b91129 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:10:21.255195 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-e7008c29-a6b7-4aa0-8c6f-aa9ec8b91129 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] [instance: 696c547f-7cea-497f-9871-dd26f3fb6cfc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:10:21.276607 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e7008c29-a6b7-4aa0-8c6f-aa9ec8b91129 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:21.278504 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e7008c29-a6b7-4aa0-8c6f-aa9ec8b91129 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:21.279400 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e7008c29-a6b7-4aa0-8c6f-aa9ec8b91129 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:21.282298 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e7008c29-a6b7-4aa0-8c6f-aa9ec8b91129 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:21.283203 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e7008c29-a6b7-4aa0-8c6f-aa9ec8b91129 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:21.283828 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e7008c29-a6b7-4aa0-8c6f-aa9ec8b91129 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:21.835227 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-e7008c29-a6b7-4aa0-8c6f-aa9ec8b91129 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80fc56886fef422b9b52eb1dede7d10e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82e1a29234ce40f9b37d0eca196cd1db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:10:21.836295 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-b9849bdf-03a8-4aeb-a169-9016ab80e8ea tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:10:21.856624 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=100 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:10:21.863398 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-e7008c29-a6b7-4aa0-8c6f-aa9ec8b91129 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] 10.222.0.43 "GET /compute/v2.1/servers/696c547f-7cea-497f-9871-dd26f3fb6cfc" status: 200 len: 1365 microversion: 2.1 time: 0.620623 Oct 04 22:10:21.866549 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2507/5064] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:10:21 2022] GET /compute/v2.1/servers/696c547f-7cea-497f-9871-dd26f3fb6cfc => generated 1365 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:10:21.873335 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-b9849bdf-03a8-4aeb-a169-9016ab80e8ea tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:10:21.879690 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-b9849bdf-03a8-4aeb-a169-9016ab80e8ea tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:10:21.883520 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-b9849bdf-03a8-4aeb-a169-9016ab80e8ea tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] 10.222.0.43 "GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9" status: 200 len: 1874 microversion: 2.32 time: 0.755158 Oct 04 22:10:21.884136 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2558/5065] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:10:21 2022] GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9 => generated 1874 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:10:21.884486 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-31fc2599-96b3-4f65-982f-ab5c7a402619 req-92812928-d055-45ec-81e6-19879024c1fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "367dad85-827d-47b0-a468-418d398b36f9", "name": "network-vif-plugged", "status": "completed", "tag": "2185372b-2bf8-48af-a686-257c42659538"}, {"server_uuid": "a9da8775-8ca8-41b1-8340-e4f3dae6e05b", "name": "network-vif-plugged", "status": "completed", "tag": "a2b687e2-c84f-4fe7-aa70-7f2f1ddf6a09"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:10:21.898279 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-31fc2599-96b3-4f65-982f-ab5c7a402619 req-92812928-d055-45ec-81e6-19879024c1fd service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:21.898801 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-31fc2599-96b3-4f65-982f-ab5c7a402619 req-92812928-d055-45ec-81e6-19879024c1fd service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:21.899240 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-31fc2599-96b3-4f65-982f-ab5c7a402619 req-92812928-d055-45ec-81e6-19879024c1fd service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:21.919501 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-31fc2599-96b3-4f65-982f-ab5c7a402619 req-92812928-d055-45ec-81e6-19879024c1fd service nova] Creating event network-vif-plugged:2185372b-2bf8-48af-a686-257c42659538 for instance 367dad85-827d-47b0-a468-418d398b36f9 on n-h1-860284-1 Oct 04 22:10:21.921373 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-31fc2599-96b3-4f65-982f-ab5c7a402619 req-92812928-d055-45ec-81e6-19879024c1fd service nova] Creating event network-vif-plugged:a2b687e2-c84f-4fe7-aa70-7f2f1ddf6a09 for instance a9da8775-8ca8-41b1-8340-e4f3dae6e05b on n-h2-860284-1 Oct 04 22:10:21.935854 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-31fc2599-96b3-4f65-982f-ab5c7a402619 req-92812928-d055-45ec-81e6-19879024c1fd service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.064800 Oct 04 22:10:21.937587 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2508/5066] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:10:21 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:10:22.045705 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-ed918652-fbc3-457f-a61b-94c783ff13e2 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:10:22.059556 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-ed918652-fbc3-457f-a61b-94c783ff13e2 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: a9da8775-8ca8-41b1-8340-e4f3dae6e05b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:10:22.114480 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ed918652-fbc3-457f-a61b-94c783ff13e2 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:22.117250 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ed918652-fbc3-457f-a61b-94c783ff13e2 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:22.118062 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ed918652-fbc3-457f-a61b-94c783ff13e2 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:22.119094 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ed918652-fbc3-457f-a61b-94c783ff13e2 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:22.119803 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ed918652-fbc3-457f-a61b-94c783ff13e2 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:22.120507 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ed918652-fbc3-457f-a61b-94c783ff13e2 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:22.275976 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-93bbf5d0-1220-4ee4-a076-aaaba429b414 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:10:22.276634 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-93bbf5d0-1220-4ee4-a076-aaaba429b414 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: 395434aa-4b24-4f4f-b83c-bb8870cd38b7] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:10:22.337641 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-93bbf5d0-1220-4ee4-a076-aaaba429b414 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:22.338152 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-93bbf5d0-1220-4ee4-a076-aaaba429b414 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:22.338647 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-93bbf5d0-1220-4ee4-a076-aaaba429b414 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:22.339633 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-93bbf5d0-1220-4ee4-a076-aaaba429b414 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:22.340317 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-93bbf5d0-1220-4ee4-a076-aaaba429b414 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:22.340965 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-93bbf5d0-1220-4ee4-a076-aaaba429b414 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:22.753448 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-ed918652-fbc3-457f-a61b-94c783ff13e2 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:10:22.779966 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-ed918652-fbc3-457f-a61b-94c783ff13e2 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/a9da8775-8ca8-41b1-8340-e4f3dae6e05b" status: 200 len: 1315 microversion: 2.1 time: 0.755569 Oct 04 22:10:22.781272 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2559/5067] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:10:22 2022] GET /compute/v2.1/servers/a9da8775-8ca8-41b1-8340-e4f3dae6e05b => generated 1315 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:10:22.889194 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-a34bea68-723f-42f7-b565-e90157fc4a99 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:10:22.889884 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-a34bea68-723f-42f7-b565-e90157fc4a99 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] [instance: 696c547f-7cea-497f-9871-dd26f3fb6cfc] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:10:22.897875 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a34bea68-723f-42f7-b565-e90157fc4a99 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:22.903057 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a34bea68-723f-42f7-b565-e90157fc4a99 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:22.905883 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a34bea68-723f-42f7-b565-e90157fc4a99 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:22.909186 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a34bea68-723f-42f7-b565-e90157fc4a99 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:22.909951 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a34bea68-723f-42f7-b565-e90157fc4a99 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:22.910622 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a34bea68-723f-42f7-b565-e90157fc4a99 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:23.305530 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-93bbf5d0-1220-4ee4-a076-aaaba429b414 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1682f1a60045d8a04d4d67393cd13f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b00cd9fa8e40a0919b61fcd60269f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:10:23.394869 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-93bbf5d0-1220-4ee4-a076-aaaba429b414 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "GET /compute/v2.1/servers/395434aa-4b24-4f4f-b83c-bb8870cd38b7" status: 200 len: 1309 microversion: 2.1 time: 1.135468 Oct 04 22:10:23.407887 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2509/5068] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:10:22 2022] GET /compute/v2.1/servers/395434aa-4b24-4f4f-b83c-bb8870cd38b7 => generated 1309 bytes in 1149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:10:23.427416 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-cd62972b-ae7b-4d06-8a70-06b61ceba19d tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:10:23.429233 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-cd62972b-ae7b-4d06-8a70-06b61ceba19d tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] [instance: 367dad85-827d-47b0-a468-418d398b36f9] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:10:23.482451 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cd62972b-ae7b-4d06-8a70-06b61ceba19d tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:23.483424 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cd62972b-ae7b-4d06-8a70-06b61ceba19d tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:23.484207 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cd62972b-ae7b-4d06-8a70-06b61ceba19d tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:23.485750 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cd62972b-ae7b-4d06-8a70-06b61ceba19d tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:23.486517 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cd62972b-ae7b-4d06-8a70-06b61ceba19d tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:23.487246 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cd62972b-ae7b-4d06-8a70-06b61ceba19d tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:23.559702 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-a34bea68-723f-42f7-b565-e90157fc4a99 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80fc56886fef422b9b52eb1dede7d10e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82e1a29234ce40f9b37d0eca196cd1db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:10:23.580730 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-a34bea68-723f-42f7-b565-e90157fc4a99 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] 10.222.0.43 "GET /compute/v2.1/servers/696c547f-7cea-497f-9871-dd26f3fb6cfc" status: 200 len: 1365 microversion: 2.1 time: 0.695444 Oct 04 22:10:23.582263 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2560/5069] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:10:22 2022] GET /compute/v2.1/servers/696c547f-7cea-497f-9871-dd26f3fb6cfc => generated 1365 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:10:23.804185 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-705a2c86-64f6-4334-b213-268dd317440d tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:10:23.805053 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-705a2c86-64f6-4334-b213-268dd317440d tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: a9da8775-8ca8-41b1-8340-e4f3dae6e05b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:10:23.814922 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-705a2c86-64f6-4334-b213-268dd317440d tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:23.819943 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-705a2c86-64f6-4334-b213-268dd317440d tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:23.820541 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-705a2c86-64f6-4334-b213-268dd317440d tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:23.821414 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-705a2c86-64f6-4334-b213-268dd317440d tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:23.822002 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-705a2c86-64f6-4334-b213-268dd317440d tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:23.822583 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-705a2c86-64f6-4334-b213-268dd317440d tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:24.603029 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-cd62972b-ae7b-4d06-8a70-06b61ceba19d tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:10:24.619277 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-cd62972b-ae7b-4d06-8a70-06b61ceba19d tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:10:24.620863 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-cd62972b-ae7b-4d06-8a70-06b61ceba19d tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:10:24.622100 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-cd62972b-ae7b-4d06-8a70-06b61ceba19d tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] 10.222.0.43 "GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9" status: 200 len: 1874 microversion: 2.32 time: 1.212703 Oct 04 22:10:24.642458 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2510/5070] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:10:23 2022] GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9 => generated 1874 bytes in 1219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:10:24.642458 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-2b6780ec-4ea6-43cf-aab6-c90a5d5a470f req-ed889175-e7b4-412b-9d64-b13d2835ff73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "367dad85-827d-47b0-a468-418d398b36f9", "name": "network-vif-plugged", "status": "completed", "tag": "8a1449d2-6f50-4eb8-b168-4134f5622384"}, {"server_uuid": "367dad85-827d-47b0-a468-418d398b36f9", "name": "network-vif-plugged", "status": "completed", "tag": "7400e0ba-5b25-45e1-a43e-d44f730f5d6c"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:10:24.658105 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-2b6780ec-4ea6-43cf-aab6-c90a5d5a470f req-ed889175-e7b4-412b-9d64-b13d2835ff73 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:24.658616 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-2b6780ec-4ea6-43cf-aab6-c90a5d5a470f req-ed889175-e7b4-412b-9d64-b13d2835ff73 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:24.659052 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-2b6780ec-4ea6-43cf-aab6-c90a5d5a470f req-ed889175-e7b4-412b-9d64-b13d2835ff73 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:24.662990 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-705a2c86-64f6-4334-b213-268dd317440d tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:10:24.680429 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-705a2c86-64f6-4334-b213-268dd317440d tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/a9da8775-8ca8-41b1-8340-e4f3dae6e05b" status: 200 len: 1315 microversion: 2.1 time: 0.876798 Oct 04 22:10:24.681507 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2561/5071] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:10:23 2022] GET /compute/v2.1/servers/a9da8775-8ca8-41b1-8340-e4f3dae6e05b => generated 1315 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:10:24.688255 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-2b6780ec-4ea6-43cf-aab6-c90a5d5a470f req-ed889175-e7b4-412b-9d64-b13d2835ff73 service nova] Creating event network-vif-plugged:8a1449d2-6f50-4eb8-b168-4134f5622384 for instance 367dad85-827d-47b0-a468-418d398b36f9 on n-h1-860284-1 Oct 04 22:10:24.688936 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-2b6780ec-4ea6-43cf-aab6-c90a5d5a470f req-ed889175-e7b4-412b-9d64-b13d2835ff73 service nova] Creating event network-vif-plugged:7400e0ba-5b25-45e1-a43e-d44f730f5d6c for instance 367dad85-827d-47b0-a468-418d398b36f9 on n-h1-860284-1 Oct 04 22:10:24.692244 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-3c41d837-713b-4617-8bbf-cc312bf49f46 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:10:24.692882 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-3c41d837-713b-4617-8bbf-cc312bf49f46 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: 395434aa-4b24-4f4f-b83c-bb8870cd38b7] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:10:24.711538 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3c41d837-713b-4617-8bbf-cc312bf49f46 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:24.712047 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3c41d837-713b-4617-8bbf-cc312bf49f46 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:24.716089 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-2b6780ec-4ea6-43cf-aab6-c90a5d5a470f req-ed889175-e7b4-412b-9d64-b13d2835ff73 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.086776 Oct 04 22:10:24.716726 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2511/5072] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:10:24 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:10:24.717526 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3c41d837-713b-4617-8bbf-cc312bf49f46 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:24.718416 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3c41d837-713b-4617-8bbf-cc312bf49f46 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:24.721197 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3c41d837-713b-4617-8bbf-cc312bf49f46 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:24.721654 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3c41d837-713b-4617-8bbf-cc312bf49f46 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:24.734400 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-dbd9c7fb-3e2d-450b-8ee6-49d64c1c1869 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:10:24.741674 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-dbd9c7fb-3e2d-450b-8ee6-49d64c1c1869 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] [instance: 696c547f-7cea-497f-9871-dd26f3fb6cfc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:10:24.746562 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:10:24.759726 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dbd9c7fb-3e2d-450b-8ee6-49d64c1c1869 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:24.763004 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dbd9c7fb-3e2d-450b-8ee6-49d64c1c1869 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:24.764010 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dbd9c7fb-3e2d-450b-8ee6-49d64c1c1869 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:24.768208 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dbd9c7fb-3e2d-450b-8ee6-49d64c1c1869 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:24.768984 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dbd9c7fb-3e2d-450b-8ee6-49d64c1c1869 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:24.771597 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dbd9c7fb-3e2d-450b-8ee6-49d64c1c1869 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:24.997920 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=2 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:10:25.219642 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-3c41d837-713b-4617-8bbf-cc312bf49f46 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1682f1a60045d8a04d4d67393cd13f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b00cd9fa8e40a0919b61fcd60269f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:10:25.239721 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-3c41d837-713b-4617-8bbf-cc312bf49f46 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "GET /compute/v2.1/servers/395434aa-4b24-4f4f-b83c-bb8870cd38b7" status: 200 len: 1309 microversion: 2.1 time: 0.556728 Oct 04 22:10:25.240464 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2562/5073] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:10:24 2022] GET /compute/v2.1/servers/395434aa-4b24-4f4f-b83c-bb8870cd38b7 => generated 1309 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:10:25.369752 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=8 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:10:25.402174 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-dbd9c7fb-3e2d-450b-8ee6-49d64c1c1869 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80fc56886fef422b9b52eb1dede7d10e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82e1a29234ce40f9b37d0eca196cd1db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:10:25.420310 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-dbd9c7fb-3e2d-450b-8ee6-49d64c1c1869 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] 10.222.0.43 "GET /compute/v2.1/servers/696c547f-7cea-497f-9871-dd26f3fb6cfc" status: 200 len: 1365 microversion: 2.1 time: 0.693698 Oct 04 22:10:25.438633 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2512/5074] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:10:24 2022] GET /compute/v2.1/servers/696c547f-7cea-497f-9871-dd26f3fb6cfc => generated 1365 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:10:25.674020 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-4e00c516-5f35-4e8d-a40d-c3dd079a0fec tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:10:25.674852 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-4e00c516-5f35-4e8d-a40d-c3dd079a0fec tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] [instance: 367dad85-827d-47b0-a468-418d398b36f9] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:10:25.683368 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4e00c516-5f35-4e8d-a40d-c3dd079a0fec tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:25.684199 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4e00c516-5f35-4e8d-a40d-c3dd079a0fec tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:25.684889 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4e00c516-5f35-4e8d-a40d-c3dd079a0fec tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:25.686073 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4e00c516-5f35-4e8d-a40d-c3dd079a0fec tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:25.688319 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4e00c516-5f35-4e8d-a40d-c3dd079a0fec tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:25.689223 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4e00c516-5f35-4e8d-a40d-c3dd079a0fec tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:25.714538 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-f034fe96-bfdd-4fc6-887c-2a15b81c9456 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:10:25.715849 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-f034fe96-bfdd-4fc6-887c-2a15b81c9456 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: a9da8775-8ca8-41b1-8340-e4f3dae6e05b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:10:25.724118 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f034fe96-bfdd-4fc6-887c-2a15b81c9456 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:25.725622 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f034fe96-bfdd-4fc6-887c-2a15b81c9456 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:25.726349 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f034fe96-bfdd-4fc6-887c-2a15b81c9456 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:25.727319 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f034fe96-bfdd-4fc6-887c-2a15b81c9456 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:25.727994 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f034fe96-bfdd-4fc6-887c-2a15b81c9456 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:25.728594 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f034fe96-bfdd-4fc6-887c-2a15b81c9456 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:26.291621 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-4e00c516-5f35-4e8d-a40d-c3dd079a0fec tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:10:26.320269 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-4e00c516-5f35-4e8d-a40d-c3dd079a0fec tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:10:26.322467 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-4e00c516-5f35-4e8d-a40d-c3dd079a0fec tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:10:26.324092 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-4e00c516-5f35-4e8d-a40d-c3dd079a0fec tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] 10.222.0.43 "GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9" status: 200 len: 1874 microversion: 2.32 time: 0.668633 Oct 04 22:10:26.339299 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2563/5075] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:10:25 2022] GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9 => generated 1874 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:10:26.339299 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-78e897f0-95f0-4fd9-bff1-b0d719189409 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:10:26.339299 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-78e897f0-95f0-4fd9-bff1-b0d719189409 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: 395434aa-4b24-4f4f-b83c-bb8870cd38b7] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:10:26.373150 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-78e897f0-95f0-4fd9-bff1-b0d719189409 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:26.373935 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-78e897f0-95f0-4fd9-bff1-b0d719189409 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:26.375326 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-78e897f0-95f0-4fd9-bff1-b0d719189409 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:26.377384 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-78e897f0-95f0-4fd9-bff1-b0d719189409 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:26.378048 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-78e897f0-95f0-4fd9-bff1-b0d719189409 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:26.380107 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-78e897f0-95f0-4fd9-bff1-b0d719189409 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:26.641410 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-f034fe96-bfdd-4fc6-887c-2a15b81c9456 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:10:26.653688 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-f034fe96-bfdd-4fc6-887c-2a15b81c9456 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/a9da8775-8ca8-41b1-8340-e4f3dae6e05b" status: 200 len: 1315 microversion: 2.1 time: 0.943987 Oct 04 22:10:26.654304 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2513/5076] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:10:25 2022] GET /compute/v2.1/servers/a9da8775-8ca8-41b1-8340-e4f3dae6e05b => generated 1315 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:10:26.672596 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-8291f52c-3d4c-4ec2-b4b2-2178abbcf0fb tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:10:26.673241 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-8291f52c-3d4c-4ec2-b4b2-2178abbcf0fb tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] [instance: 696c547f-7cea-497f-9871-dd26f3fb6cfc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:10:26.701966 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8291f52c-3d4c-4ec2-b4b2-2178abbcf0fb tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:26.710312 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8291f52c-3d4c-4ec2-b4b2-2178abbcf0fb tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:26.711257 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8291f52c-3d4c-4ec2-b4b2-2178abbcf0fb tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:26.713120 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8291f52c-3d4c-4ec2-b4b2-2178abbcf0fb tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:26.713804 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8291f52c-3d4c-4ec2-b4b2-2178abbcf0fb tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:26.716425 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8291f52c-3d4c-4ec2-b4b2-2178abbcf0fb tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:27.029469 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-78e897f0-95f0-4fd9-bff1-b0d719189409 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1682f1a60045d8a04d4d67393cd13f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b00cd9fa8e40a0919b61fcd60269f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:10:27.044886 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-78e897f0-95f0-4fd9-bff1-b0d719189409 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "GET /compute/v2.1/servers/395434aa-4b24-4f4f-b83c-bb8870cd38b7" status: 200 len: 1309 microversion: 2.1 time: 0.715259 Oct 04 22:10:27.045475 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2564/5077] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:10:26 2022] GET /compute/v2.1/servers/395434aa-4b24-4f4f-b83c-bb8870cd38b7 => generated 1309 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:10:27.056190 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-d12ce47e-e62d-4854-8bc0-b78ac73445bc req-e038de8e-7850-4fc6-97a3-d1999335f486 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "367dad85-827d-47b0-a468-418d398b36f9", "name": "network-vif-plugged", "status": "completed", "tag": "68e96019-907e-47ad-a440-3208969682fb"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:10:27.083251 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-d12ce47e-e62d-4854-8bc0-b78ac73445bc req-e038de8e-7850-4fc6-97a3-d1999335f486 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:27.083741 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-d12ce47e-e62d-4854-8bc0-b78ac73445bc req-e038de8e-7850-4fc6-97a3-d1999335f486 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:27.084180 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-d12ce47e-e62d-4854-8bc0-b78ac73445bc req-e038de8e-7850-4fc6-97a3-d1999335f486 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:27.133569 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-8291f52c-3d4c-4ec2-b4b2-2178abbcf0fb tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80fc56886fef422b9b52eb1dede7d10e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82e1a29234ce40f9b37d0eca196cd1db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:10:27.142988 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-8291f52c-3d4c-4ec2-b4b2-2178abbcf0fb tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] 10.222.0.43 "GET /compute/v2.1/servers/696c547f-7cea-497f-9871-dd26f3fb6cfc" status: 200 len: 1365 microversion: 2.1 time: 0.487520 Oct 04 22:10:27.143598 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2514/5078] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:10:26 2022] GET /compute/v2.1/servers/696c547f-7cea-497f-9871-dd26f3fb6cfc => generated 1365 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:10:27.145003 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-d12ce47e-e62d-4854-8bc0-b78ac73445bc req-e038de8e-7850-4fc6-97a3-d1999335f486 service nova] Creating event network-vif-plugged:68e96019-907e-47ad-a440-3208969682fb for instance 367dad85-827d-47b0-a468-418d398b36f9 on n-h1-860284-1 Oct 04 22:10:27.163005 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-d12ce47e-e62d-4854-8bc0-b78ac73445bc req-e038de8e-7850-4fc6-97a3-d1999335f486 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109258 Oct 04 22:10:27.163994 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2565/5079] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:10:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:10:27.371879 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-f61c7a65-1a65-48fe-b62d-fc264050a20d tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:10:27.378900 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-f61c7a65-1a65-48fe-b62d-fc264050a20d tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] [instance: 367dad85-827d-47b0-a468-418d398b36f9] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:10:27.402234 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f61c7a65-1a65-48fe-b62d-fc264050a20d tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:27.403607 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f61c7a65-1a65-48fe-b62d-fc264050a20d tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:27.404626 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f61c7a65-1a65-48fe-b62d-fc264050a20d tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:27.408104 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f61c7a65-1a65-48fe-b62d-fc264050a20d tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:27.409850 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f61c7a65-1a65-48fe-b62d-fc264050a20d tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:27.412201 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f61c7a65-1a65-48fe-b62d-fc264050a20d tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:27.683733 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-3c44a7b4-19a5-491d-8a32-c2ada0e74fed tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:10:27.684937 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-3c44a7b4-19a5-491d-8a32-c2ada0e74fed tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: a9da8775-8ca8-41b1-8340-e4f3dae6e05b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:10:27.700688 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3c44a7b4-19a5-491d-8a32-c2ada0e74fed tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:27.701520 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3c44a7b4-19a5-491d-8a32-c2ada0e74fed tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:27.701994 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3c44a7b4-19a5-491d-8a32-c2ada0e74fed tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:27.702976 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3c44a7b4-19a5-491d-8a32-c2ada0e74fed tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:27.705412 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3c44a7b4-19a5-491d-8a32-c2ada0e74fed tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:27.708598 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3c44a7b4-19a5-491d-8a32-c2ada0e74fed tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:28.420652 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-f61c7a65-1a65-48fe-b62d-fc264050a20d tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:10:28.439293 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-f61c7a65-1a65-48fe-b62d-fc264050a20d tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:10:28.445273 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-f61c7a65-1a65-48fe-b62d-fc264050a20d tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:10:28.459764 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-f61c7a65-1a65-48fe-b62d-fc264050a20d tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] 10.222.0.43 "GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9" status: 200 len: 1874 microversion: 2.32 time: 1.102400 Oct 04 22:10:28.463578 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-3c44a7b4-19a5-491d-8a32-c2ada0e74fed tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:10:28.477910 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-3c44a7b4-19a5-491d-8a32-c2ada0e74fed tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/a9da8775-8ca8-41b1-8340-e4f3dae6e05b" status: 200 len: 1503 microversion: 2.1 time: 0.799241 Oct 04 22:10:28.486263 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2515/5080] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:10:27 2022] GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9 => generated 1874 bytes in 1129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:10:28.487840 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2566/5081] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:10:27 2022] GET /compute/v2.1/servers/a9da8775-8ca8-41b1-8340-e4f3dae6e05b => generated 1503 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:10:28.492916 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-3bf9dab3-1d7b-4429-96d0-06a120df41cc tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:10:28.497768 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-3bf9dab3-1d7b-4429-96d0-06a120df41cc tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] [instance: 696c547f-7cea-497f-9871-dd26f3fb6cfc] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:10:28.502847 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-3ca4fe33-56fd-4099-b680-6448ac2a8595 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:10:28.507784 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-3ca4fe33-56fd-4099-b680-6448ac2a8595 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: 395434aa-4b24-4f4f-b83c-bb8870cd38b7] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:10:28.527215 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3bf9dab3-1d7b-4429-96d0-06a120df41cc tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:28.527730 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3bf9dab3-1d7b-4429-96d0-06a120df41cc tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:28.528187 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3bf9dab3-1d7b-4429-96d0-06a120df41cc tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:28.528923 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3bf9dab3-1d7b-4429-96d0-06a120df41cc tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:28.529391 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3bf9dab3-1d7b-4429-96d0-06a120df41cc tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:28.538849 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3ca4fe33-56fd-4099-b680-6448ac2a8595 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:28.539847 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3ca4fe33-56fd-4099-b680-6448ac2a8595 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:28.540563 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3ca4fe33-56fd-4099-b680-6448ac2a8595 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:28.541089 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3bf9dab3-1d7b-4429-96d0-06a120df41cc tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:28.542135 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3ca4fe33-56fd-4099-b680-6448ac2a8595 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:28.544521 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3ca4fe33-56fd-4099-b680-6448ac2a8595 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:28.545787 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3ca4fe33-56fd-4099-b680-6448ac2a8595 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:29.046529 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-3bf9dab3-1d7b-4429-96d0-06a120df41cc tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80fc56886fef422b9b52eb1dede7d10e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82e1a29234ce40f9b37d0eca196cd1db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:10:29.053959 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-3ca4fe33-56fd-4099-b680-6448ac2a8595 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1682f1a60045d8a04d4d67393cd13f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b00cd9fa8e40a0919b61fcd60269f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:10:29.056339 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-3bf9dab3-1d7b-4429-96d0-06a120df41cc tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] 10.222.0.43 "GET /compute/v2.1/servers/696c547f-7cea-497f-9871-dd26f3fb6cfc" status: 200 len: 1365 microversion: 2.1 time: 0.567198 Oct 04 22:10:29.060919 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2567/5082] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:10:28 2022] GET /compute/v2.1/servers/696c547f-7cea-497f-9871-dd26f3fb6cfc => generated 1365 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:10:29.072537 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-3ca4fe33-56fd-4099-b680-6448ac2a8595 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "GET /compute/v2.1/servers/395434aa-4b24-4f4f-b83c-bb8870cd38b7" status: 200 len: 1309 microversion: 2.1 time: 0.577249 Oct 04 22:10:29.072537 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2516/5083] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:10:28 2022] GET /compute/v2.1/servers/395434aa-4b24-4f4f-b83c-bb8870cd38b7 => generated 1309 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:10:29.089914 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-95d696cc-065b-42f9-9903-20dc3546293b tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:10:29.093363 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-95d696cc-065b-42f9-9903-20dc3546293b tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: a9da8775-8ca8-41b1-8340-e4f3dae6e05b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:10:29.112616 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-95d696cc-065b-42f9-9903-20dc3546293b tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:29.117949 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-95d696cc-065b-42f9-9903-20dc3546293b tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:29.118760 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-95d696cc-065b-42f9-9903-20dc3546293b tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:29.119786 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-95d696cc-065b-42f9-9903-20dc3546293b tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:29.122638 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-95d696cc-065b-42f9-9903-20dc3546293b tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:29.128595 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-95d696cc-065b-42f9-9903-20dc3546293b tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:29.239950 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-95d696cc-065b-42f9-9903-20dc3546293b tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "POST /compute/v2.1/servers/a9da8775-8ca8-41b1-8340-e4f3dae6e05b/action" status: 200 len: 14 microversion: 2.1 time: 0.175648 Oct 04 22:10:29.241713 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2568/5084] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 22:10:29 2022] POST /compute/v2.1/servers/a9da8775-8ca8-41b1-8340-e4f3dae6e05b/action => generated 14 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 22:10:29.393967 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-b7933056-9276-44f4-be86-152cefcbfbb2 req-56551b12-18a7-49b6-9021-f36f34a6491f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "367dad85-827d-47b0-a468-418d398b36f9", "name": "network-vif-plugged", "status": "completed", "tag": "bc487837-1357-4c07-964b-174fe9476f33"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:10:29.413103 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-b7933056-9276-44f4-be86-152cefcbfbb2 req-56551b12-18a7-49b6-9021-f36f34a6491f service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:29.415867 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-b7933056-9276-44f4-be86-152cefcbfbb2 req-56551b12-18a7-49b6-9021-f36f34a6491f service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:29.416676 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-b7933056-9276-44f4-be86-152cefcbfbb2 req-56551b12-18a7-49b6-9021-f36f34a6491f service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:29.443175 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-b7933056-9276-44f4-be86-152cefcbfbb2 req-56551b12-18a7-49b6-9021-f36f34a6491f service nova] Creating event network-vif-plugged:bc487837-1357-4c07-964b-174fe9476f33 for instance 367dad85-827d-47b0-a468-418d398b36f9 on n-h1-860284-1 Oct 04 22:10:29.462481 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-b7933056-9276-44f4-be86-152cefcbfbb2 req-56551b12-18a7-49b6-9021-f36f34a6491f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074408 Oct 04 22:10:29.463773 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2517/5085] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:10:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:10:29.500729 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-1a2ebd1b-c060-4ba0-8573-e3b522640f9f tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:10:29.502090 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-1a2ebd1b-c060-4ba0-8573-e3b522640f9f tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] [instance: 367dad85-827d-47b0-a468-418d398b36f9] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:10:29.509438 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1a2ebd1b-c060-4ba0-8573-e3b522640f9f tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:29.510205 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1a2ebd1b-c060-4ba0-8573-e3b522640f9f tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:29.513285 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1a2ebd1b-c060-4ba0-8573-e3b522640f9f tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:29.514287 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1a2ebd1b-c060-4ba0-8573-e3b522640f9f tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:29.517823 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1a2ebd1b-c060-4ba0-8573-e3b522640f9f tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:29.518519 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1a2ebd1b-c060-4ba0-8573-e3b522640f9f tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:29.993085 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-1a2ebd1b-c060-4ba0-8573-e3b522640f9f tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:10:30.009767 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-1a2ebd1b-c060-4ba0-8573-e3b522640f9f tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:10:30.012459 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-1a2ebd1b-c060-4ba0-8573-e3b522640f9f tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:10:30.013889 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-1a2ebd1b-c060-4ba0-8573-e3b522640f9f tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] 10.222.0.43 "GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9" status: 200 len: 1874 microversion: 2.32 time: 0.518870 Oct 04 22:10:30.015895 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2569/5086] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:10:29 2022] GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9 => generated 1874 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:10:30.097057 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-638dc5d9-f831-4099-b37d-b787e0f416dc tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:10:30.097959 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-638dc5d9-f831-4099-b37d-b787e0f416dc tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: 395434aa-4b24-4f4f-b83c-bb8870cd38b7] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:10:30.098933 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-94ecdecf-2cba-41a0-82d5-f45365bdb35d tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:10:30.102767 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:10:30.103836 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-94ecdecf-2cba-41a0-82d5-f45365bdb35d tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] [instance: 696c547f-7cea-497f-9871-dd26f3fb6cfc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:10:30.121254 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-638dc5d9-f831-4099-b37d-b787e0f416dc tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:30.122451 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-94ecdecf-2cba-41a0-82d5-f45365bdb35d tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:30.123067 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-94ecdecf-2cba-41a0-82d5-f45365bdb35d tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:30.124954 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-638dc5d9-f831-4099-b37d-b787e0f416dc tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:30.125836 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-638dc5d9-f831-4099-b37d-b787e0f416dc tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:30.126030 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-94ecdecf-2cba-41a0-82d5-f45365bdb35d tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:30.126958 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-94ecdecf-2cba-41a0-82d5-f45365bdb35d tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:30.127225 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-638dc5d9-f831-4099-b37d-b787e0f416dc tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:30.127888 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-94ecdecf-2cba-41a0-82d5-f45365bdb35d tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:30.128050 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-638dc5d9-f831-4099-b37d-b787e0f416dc tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:30.128432 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-638dc5d9-f831-4099-b37d-b787e0f416dc tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:30.142109 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-94ecdecf-2cba-41a0-82d5-f45365bdb35d tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:30.464170 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-638dc5d9-f831-4099-b37d-b787e0f416dc tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1682f1a60045d8a04d4d67393cd13f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b00cd9fa8e40a0919b61fcd60269f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:10:30.474179 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-638dc5d9-f831-4099-b37d-b787e0f416dc tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "GET /compute/v2.1/servers/395434aa-4b24-4f4f-b83c-bb8870cd38b7" status: 200 len: 1309 microversion: 2.1 time: 0.381997 Oct 04 22:10:30.479677 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2570/5087] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:10:30 2022] GET /compute/v2.1/servers/395434aa-4b24-4f4f-b83c-bb8870cd38b7 => generated 1309 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:10:30.487044 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-43b4dc93-6eab-40b2-ac3b-49aad9e354f5 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:10:30.497302 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-43b4dc93-6eab-40b2-ac3b-49aad9e354f5 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: a9da8775-8ca8-41b1-8340-e4f3dae6e05b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:10:30.515653 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-43b4dc93-6eab-40b2-ac3b-49aad9e354f5 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:30.522735 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-43b4dc93-6eab-40b2-ac3b-49aad9e354f5 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:30.525352 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-43b4dc93-6eab-40b2-ac3b-49aad9e354f5 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:30.526526 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-43b4dc93-6eab-40b2-ac3b-49aad9e354f5 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:30.529223 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-43b4dc93-6eab-40b2-ac3b-49aad9e354f5 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:30.529988 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-43b4dc93-6eab-40b2-ac3b-49aad9e354f5 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:30.586117 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-94ecdecf-2cba-41a0-82d5-f45365bdb35d tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80fc56886fef422b9b52eb1dede7d10e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82e1a29234ce40f9b37d0eca196cd1db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:10:30.603814 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-94ecdecf-2cba-41a0-82d5-f45365bdb35d tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] 10.222.0.43 "GET /compute/v2.1/servers/696c547f-7cea-497f-9871-dd26f3fb6cfc" status: 200 len: 1365 microversion: 2.1 time: 0.517553 Oct 04 22:10:30.604408 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2518/5088] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:10:30 2022] GET /compute/v2.1/servers/696c547f-7cea-497f-9871-dd26f3fb6cfc => generated 1365 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:10:30.621070 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-43b4dc93-6eab-40b2-ac3b-49aad9e354f5 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "POST /compute/v2.1/servers/a9da8775-8ca8-41b1-8340-e4f3dae6e05b/action" status: 200 len: 14 microversion: 2.1 time: 0.139416 Oct 04 22:10:30.622260 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2571/5089] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 22:10:30 2022] POST /compute/v2.1/servers/a9da8775-8ca8-41b1-8340-e4f3dae6e05b/action => generated 14 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 22:10:31.043694 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-dd1a4041-ccbf-48c1-85c4-1cc53fc5940f tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:10:31.044335 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-dd1a4041-ccbf-48c1-85c4-1cc53fc5940f tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] [instance: 367dad85-827d-47b0-a468-418d398b36f9] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:10:31.054411 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dd1a4041-ccbf-48c1-85c4-1cc53fc5940f tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:31.054927 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dd1a4041-ccbf-48c1-85c4-1cc53fc5940f tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:31.055368 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dd1a4041-ccbf-48c1-85c4-1cc53fc5940f tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:31.060351 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dd1a4041-ccbf-48c1-85c4-1cc53fc5940f tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:31.062459 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dd1a4041-ccbf-48c1-85c4-1cc53fc5940f tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:31.063366 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dd1a4041-ccbf-48c1-85c4-1cc53fc5940f tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:31.509454 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-5bd3b056-8bae-41fc-b800-38c06f6f0826 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:10:31.510179 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-5bd3b056-8bae-41fc-b800-38c06f6f0826 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: 395434aa-4b24-4f4f-b83c-bb8870cd38b7] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:10:31.527651 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5bd3b056-8bae-41fc-b800-38c06f6f0826 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:31.528318 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5bd3b056-8bae-41fc-b800-38c06f6f0826 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:31.528570 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5bd3b056-8bae-41fc-b800-38c06f6f0826 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:31.529298 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5bd3b056-8bae-41fc-b800-38c06f6f0826 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:31.536189 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5bd3b056-8bae-41fc-b800-38c06f6f0826 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:31.537101 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5bd3b056-8bae-41fc-b800-38c06f6f0826 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:31.795098 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-dd1a4041-ccbf-48c1-85c4-1cc53fc5940f tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:10:31.816670 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-dd1a4041-ccbf-48c1-85c4-1cc53fc5940f tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:10:31.823472 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-dd1a4041-ccbf-48c1-85c4-1cc53fc5940f tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:10:31.828578 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-dd1a4041-ccbf-48c1-85c4-1cc53fc5940f tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] 10.222.0.43 "GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9" status: 200 len: 1874 microversion: 2.32 time: 0.788925 Oct 04 22:10:31.829873 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2519/5090] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:10:31 2022] GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9 => generated 1874 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:10:31.839979 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-9a70120d-77c0-4492-9b49-8974824a0dc8 req-7f5fefeb-1426-4222-923a-3efff3e5ae1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "367dad85-827d-47b0-a468-418d398b36f9", "name": "network-vif-plugged", "status": "completed", "tag": "f59ea8c9-f58e-4510-8926-2c0460bdd87d"}, {"server_uuid": "696c547f-7cea-497f-9871-dd26f3fb6cfc", "name": "network-vif-plugged", "status": "completed", "tag": "b5aaccab-10a5-4329-b536-62d277938793"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:10:31.870651 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-9a70120d-77c0-4492-9b49-8974824a0dc8 req-7f5fefeb-1426-4222-923a-3efff3e5ae1a service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:31.871069 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-5bd3b056-8bae-41fc-b800-38c06f6f0826 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1682f1a60045d8a04d4d67393cd13f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b00cd9fa8e40a0919b61fcd60269f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:10:31.872609 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-9a70120d-77c0-4492-9b49-8974824a0dc8 req-7f5fefeb-1426-4222-923a-3efff3e5ae1a service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:31.873741 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-9a70120d-77c0-4492-9b49-8974824a0dc8 req-7f5fefeb-1426-4222-923a-3efff3e5ae1a service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:31.880827 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-5bd3b056-8bae-41fc-b800-38c06f6f0826 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "GET /compute/v2.1/servers/395434aa-4b24-4f4f-b83c-bb8870cd38b7" status: 200 len: 1309 microversion: 2.1 time: 0.375718 Oct 04 22:10:31.881439 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2572/5091] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:10:31 2022] GET /compute/v2.1/servers/395434aa-4b24-4f4f-b83c-bb8870cd38b7 => generated 1309 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:10:31.894876 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-20d0239f-5692-45ba-9e58-3482714737d3 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:10:31.895495 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-20d0239f-5692-45ba-9e58-3482714737d3 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] [instance: 696c547f-7cea-497f-9871-dd26f3fb6cfc] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:10:31.910223 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-20d0239f-5692-45ba-9e58-3482714737d3 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:31.917403 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-9a70120d-77c0-4492-9b49-8974824a0dc8 req-7f5fefeb-1426-4222-923a-3efff3e5ae1a service nova] Creating event network-vif-plugged:f59ea8c9-f58e-4510-8926-2c0460bdd87d for instance 367dad85-827d-47b0-a468-418d398b36f9 on n-h1-860284-1 Oct 04 22:10:31.917751 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-20d0239f-5692-45ba-9e58-3482714737d3 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:31.918538 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-20d0239f-5692-45ba-9e58-3482714737d3 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:31.919773 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-20d0239f-5692-45ba-9e58-3482714737d3 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:31.920389 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-9a70120d-77c0-4492-9b49-8974824a0dc8 req-7f5fefeb-1426-4222-923a-3efff3e5ae1a service nova] Creating event network-vif-plugged:b5aaccab-10a5-4329-b536-62d277938793 for instance 696c547f-7cea-497f-9871-dd26f3fb6cfc on n-h1-860284-1 Oct 04 22:10:31.923297 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-20d0239f-5692-45ba-9e58-3482714737d3 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:31.923848 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-20d0239f-5692-45ba-9e58-3482714737d3 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:31.941683 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-9a70120d-77c0-4492-9b49-8974824a0dc8 req-7f5fefeb-1426-4222-923a-3efff3e5ae1a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.105911 Oct 04 22:10:31.945556 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2520/5092] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:10:31 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:10:31.982958 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-3ae4b76f-1b61-47d5-9c31-d99b43180471 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:10:31.988015 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-3ae4b76f-1b61-47d5-9c31-d99b43180471 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: a9da8775-8ca8-41b1-8340-e4f3dae6e05b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:10:32.004357 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3ae4b76f-1b61-47d5-9c31-d99b43180471 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:32.005843 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3ae4b76f-1b61-47d5-9c31-d99b43180471 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:32.006553 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3ae4b76f-1b61-47d5-9c31-d99b43180471 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:32.008523 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3ae4b76f-1b61-47d5-9c31-d99b43180471 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:32.009201 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3ae4b76f-1b61-47d5-9c31-d99b43180471 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:32.010707 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3ae4b76f-1b61-47d5-9c31-d99b43180471 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:32.123331 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-3ae4b76f-1b61-47d5-9c31-d99b43180471 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "POST /compute/v2.1/servers/a9da8775-8ca8-41b1-8340-e4f3dae6e05b/action" status: 200 len: 14 microversion: 2.1 time: 0.173946 Oct 04 22:10:32.126109 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2521/5093] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 22:10:31 2022] POST /compute/v2.1/servers/a9da8775-8ca8-41b1-8340-e4f3dae6e05b/action => generated 14 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 22:10:32.442070 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-20d0239f-5692-45ba-9e58-3482714737d3 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80fc56886fef422b9b52eb1dede7d10e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82e1a29234ce40f9b37d0eca196cd1db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:10:32.461153 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-20d0239f-5692-45ba-9e58-3482714737d3 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] 10.222.0.43 "GET /compute/v2.1/servers/696c547f-7cea-497f-9871-dd26f3fb6cfc" status: 200 len: 1365 microversion: 2.1 time: 0.566487 Oct 04 22:10:32.487655 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2573/5094] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:10:31 2022] GET /compute/v2.1/servers/696c547f-7cea-497f-9871-dd26f3fb6cfc => generated 1365 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:10:32.857745 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-d7752e24-6d4d-4bcf-a0f8-08af75f053ee tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:10:32.860363 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-d7752e24-6d4d-4bcf-a0f8-08af75f053ee tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] [instance: 367dad85-827d-47b0-a468-418d398b36f9] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:10:32.879435 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d7752e24-6d4d-4bcf-a0f8-08af75f053ee tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:32.882976 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d7752e24-6d4d-4bcf-a0f8-08af75f053ee tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:32.883641 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d7752e24-6d4d-4bcf-a0f8-08af75f053ee tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:32.884587 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d7752e24-6d4d-4bcf-a0f8-08af75f053ee tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:32.885218 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d7752e24-6d4d-4bcf-a0f8-08af75f053ee tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:32.885809 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d7752e24-6d4d-4bcf-a0f8-08af75f053ee tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:32.903770 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-51a58f87-7723-4dc3-8aee-8c7e587d0d88 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:10:32.904551 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-51a58f87-7723-4dc3-8aee-8c7e587d0d88 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: 395434aa-4b24-4f4f-b83c-bb8870cd38b7] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:10:32.925023 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-51a58f87-7723-4dc3-8aee-8c7e587d0d88 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:32.925527 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-51a58f87-7723-4dc3-8aee-8c7e587d0d88 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:32.925974 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-51a58f87-7723-4dc3-8aee-8c7e587d0d88 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:32.926902 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-51a58f87-7723-4dc3-8aee-8c7e587d0d88 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:32.927188 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-51a58f87-7723-4dc3-8aee-8c7e587d0d88 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:32.927621 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-51a58f87-7723-4dc3-8aee-8c7e587d0d88 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:32.958869 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=100 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:10:33.338656 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-d7752e24-6d4d-4bcf-a0f8-08af75f053ee tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:10:33.350027 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-d7752e24-6d4d-4bcf-a0f8-08af75f053ee tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:10:33.360325 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-d7752e24-6d4d-4bcf-a0f8-08af75f053ee tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:10:33.365036 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-51a58f87-7723-4dc3-8aee-8c7e587d0d88 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1682f1a60045d8a04d4d67393cd13f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b00cd9fa8e40a0919b61fcd60269f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:10:33.375839 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-d7752e24-6d4d-4bcf-a0f8-08af75f053ee tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] 10.222.0.43 "GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9" status: 200 len: 1874 microversion: 2.32 time: 0.520700 Oct 04 22:10:33.379610 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-51a58f87-7723-4dc3-8aee-8c7e587d0d88 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "GET /compute/v2.1/servers/395434aa-4b24-4f4f-b83c-bb8870cd38b7" status: 200 len: 1309 microversion: 2.1 time: 0.480409 Oct 04 22:10:33.380748 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2522/5095] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:10:32 2022] GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9 => generated 1874 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:10:33.409873 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2574/5096] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:10:32 2022] GET /compute/v2.1/servers/395434aa-4b24-4f4f-b83c-bb8870cd38b7 => generated 1309 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:10:33.413802 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e060d449-e4de-49f0-9058-730603c2463a tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:10:33.420550 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-e060d449-e4de-49f0-9058-730603c2463a tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: a9da8775-8ca8-41b1-8340-e4f3dae6e05b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:10:33.434747 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e060d449-e4de-49f0-9058-730603c2463a tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:33.436116 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e060d449-e4de-49f0-9058-730603c2463a tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:33.437356 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e060d449-e4de-49f0-9058-730603c2463a tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:33.438330 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e060d449-e4de-49f0-9058-730603c2463a tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:33.443943 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e060d449-e4de-49f0-9058-730603c2463a tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:33.444514 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e060d449-e4de-49f0-9058-730603c2463a tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:33.495245 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-b537a809-6896-425a-b65f-be88b6ee9080 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:10:33.501125 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-b537a809-6896-425a-b65f-be88b6ee9080 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] [instance: 696c547f-7cea-497f-9871-dd26f3fb6cfc] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:10:33.549659 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-e060d449-e4de-49f0-9058-730603c2463a tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "POST /compute/v2.1/servers/a9da8775-8ca8-41b1-8340-e4f3dae6e05b/action" status: 200 len: 14 microversion: 2.1 time: 0.164704 Oct 04 22:10:33.552277 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2523/5097] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 22:10:33 2022] POST /compute/v2.1/servers/a9da8775-8ca8-41b1-8340-e4f3dae6e05b/action => generated 14 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 22:10:33.552823 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b537a809-6896-425a-b65f-be88b6ee9080 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:33.554211 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b537a809-6896-425a-b65f-be88b6ee9080 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.030s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:33.556194 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b537a809-6896-425a-b65f-be88b6ee9080 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:33.563783 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b537a809-6896-425a-b65f-be88b6ee9080 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:33.564397 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b537a809-6896-425a-b65f-be88b6ee9080 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:33.564862 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b537a809-6896-425a-b65f-be88b6ee9080 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:33.839453 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-b537a809-6896-425a-b65f-be88b6ee9080 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80fc56886fef422b9b52eb1dede7d10e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82e1a29234ce40f9b37d0eca196cd1db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:10:33.853580 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-b537a809-6896-425a-b65f-be88b6ee9080 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] 10.222.0.43 "GET /compute/v2.1/servers/696c547f-7cea-497f-9871-dd26f3fb6cfc" status: 200 len: 1365 microversion: 2.1 time: 0.368785 Oct 04 22:10:33.854243 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2575/5098] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:10:33 2022] GET /compute/v2.1/servers/696c547f-7cea-497f-9871-dd26f3fb6cfc => generated 1365 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:10:34.021141 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-50a2d8ab-f2a2-4a9a-9253-dafaf50a35fc req-222b59c1-419d-493a-8bcc-71629e7ac26d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "395434aa-4b24-4f4f-b83c-bb8870cd38b7", "name": "network-vif-plugged", "status": "completed", "tag": "95bc59a7-4753-423d-8cf1-764c9edf2646"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:10:34.033287 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-50a2d8ab-f2a2-4a9a-9253-dafaf50a35fc req-222b59c1-419d-493a-8bcc-71629e7ac26d service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:34.034152 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-50a2d8ab-f2a2-4a9a-9253-dafaf50a35fc req-222b59c1-419d-493a-8bcc-71629e7ac26d service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:34.034836 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-50a2d8ab-f2a2-4a9a-9253-dafaf50a35fc req-222b59c1-419d-493a-8bcc-71629e7ac26d service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:34.056494 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-50a2d8ab-f2a2-4a9a-9253-dafaf50a35fc req-222b59c1-419d-493a-8bcc-71629e7ac26d service nova] Creating event network-vif-plugged:95bc59a7-4753-423d-8cf1-764c9edf2646 for instance 395434aa-4b24-4f4f-b83c-bb8870cd38b7 on n-h2-860284-1 Oct 04 22:10:34.062119 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-50a2d8ab-f2a2-4a9a-9253-dafaf50a35fc req-222b59c1-419d-493a-8bcc-71629e7ac26d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045165 Oct 04 22:10:34.063777 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2524/5099] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:10:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:10:34.406396 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-1f07898e-27cd-42fc-8ed3-72c1e39efb34 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:10:34.407190 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-1f07898e-27cd-42fc-8ed3-72c1e39efb34 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] [instance: 367dad85-827d-47b0-a468-418d398b36f9] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:10:34.429540 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1f07898e-27cd-42fc-8ed3-72c1e39efb34 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:34.431059 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1f07898e-27cd-42fc-8ed3-72c1e39efb34 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:34.432822 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1f07898e-27cd-42fc-8ed3-72c1e39efb34 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:34.433680 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1f07898e-27cd-42fc-8ed3-72c1e39efb34 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:34.438645 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-7b87d153-48eb-46d9-a8ea-9ad802ef9b59 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:10:34.439727 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1f07898e-27cd-42fc-8ed3-72c1e39efb34 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:34.439890 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-7b87d153-48eb-46d9-a8ea-9ad802ef9b59 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: 395434aa-4b24-4f4f-b83c-bb8870cd38b7] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:10:34.440600 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1f07898e-27cd-42fc-8ed3-72c1e39efb34 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:34.484992 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7b87d153-48eb-46d9-a8ea-9ad802ef9b59 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:34.485499 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7b87d153-48eb-46d9-a8ea-9ad802ef9b59 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:34.485949 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7b87d153-48eb-46d9-a8ea-9ad802ef9b59 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:34.486711 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7b87d153-48eb-46d9-a8ea-9ad802ef9b59 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:34.487183 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7b87d153-48eb-46d9-a8ea-9ad802ef9b59 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:34.487624 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7b87d153-48eb-46d9-a8ea-9ad802ef9b59 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:35.149429 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-7b87d153-48eb-46d9-a8ea-9ad802ef9b59 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1682f1a60045d8a04d4d67393cd13f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b00cd9fa8e40a0919b61fcd60269f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:10:35.163962 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-7b87d153-48eb-46d9-a8ea-9ad802ef9b59 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "GET /compute/v2.1/servers/395434aa-4b24-4f4f-b83c-bb8870cd38b7" status: 200 len: 1309 microversion: 2.1 time: 0.743974 Oct 04 22:10:35.165263 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2525/5100] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:10:34 2022] GET /compute/v2.1/servers/395434aa-4b24-4f4f-b83c-bb8870cd38b7 => generated 1309 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:10:35.180246 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-513f387a-1492-48a4-80d8-0ae6b8038648 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:10:35.183406 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-513f387a-1492-48a4-80d8-0ae6b8038648 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: a9da8775-8ca8-41b1-8340-e4f3dae6e05b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:10:35.192559 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-513f387a-1492-48a4-80d8-0ae6b8038648 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:35.193134 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-513f387a-1492-48a4-80d8-0ae6b8038648 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:35.193641 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-513f387a-1492-48a4-80d8-0ae6b8038648 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:35.194478 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-513f387a-1492-48a4-80d8-0ae6b8038648 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:35.195007 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-513f387a-1492-48a4-80d8-0ae6b8038648 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:35.195505 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-513f387a-1492-48a4-80d8-0ae6b8038648 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:35.202745 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-1f07898e-27cd-42fc-8ed3-72c1e39efb34 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:10:35.210216 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=100 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:10:35.227646 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-1f07898e-27cd-42fc-8ed3-72c1e39efb34 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:10:35.231089 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-1f07898e-27cd-42fc-8ed3-72c1e39efb34 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:10:35.232944 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-1f07898e-27cd-42fc-8ed3-72c1e39efb34 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] 10.222.0.43 "GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9" status: 200 len: 1874 microversion: 2.32 time: 0.831661 Oct 04 22:10:35.235525 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2576/5101] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:10:34 2022] GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9 => generated 1874 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:10:35.242277 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-60b3dc6a-3ebb-4384-a055-4f48a127834c tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:10:35.243279 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-60b3dc6a-3ebb-4384-a055-4f48a127834c tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] [instance: 696c547f-7cea-497f-9871-dd26f3fb6cfc] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:10:35.251618 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-60b3dc6a-3ebb-4384-a055-4f48a127834c tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:35.252478 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-60b3dc6a-3ebb-4384-a055-4f48a127834c tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:35.253144 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-60b3dc6a-3ebb-4384-a055-4f48a127834c tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:35.254072 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-60b3dc6a-3ebb-4384-a055-4f48a127834c tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:35.255158 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-60b3dc6a-3ebb-4384-a055-4f48a127834c tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:35.256046 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-60b3dc6a-3ebb-4384-a055-4f48a127834c tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:35.303303 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-513f387a-1492-48a4-80d8-0ae6b8038648 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "POST /compute/v2.1/servers/a9da8775-8ca8-41b1-8340-e4f3dae6e05b/action" status: 200 len: 14 microversion: 2.1 time: 0.135207 Oct 04 22:10:35.307373 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2526/5102] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 22:10:35 2022] POST /compute/v2.1/servers/a9da8775-8ca8-41b1-8340-e4f3dae6e05b/action => generated 14 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 22:10:35.484186 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-60b3dc6a-3ebb-4384-a055-4f48a127834c tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80fc56886fef422b9b52eb1dede7d10e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82e1a29234ce40f9b37d0eca196cd1db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:10:35.493054 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-60b3dc6a-3ebb-4384-a055-4f48a127834c tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] 10.222.0.43 "GET /compute/v2.1/servers/696c547f-7cea-497f-9871-dd26f3fb6cfc" status: 200 len: 1555 microversion: 2.1 time: 0.256119 Oct 04 22:10:35.493661 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2577/5103] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:10:35 2022] GET /compute/v2.1/servers/696c547f-7cea-497f-9871-dd26f3fb6cfc => generated 1555 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:10:35.525517 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-a9351b95-4eff-40a2-97c7-0e55a43869bb tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:10:35.526225 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-a9351b95-4eff-40a2-97c7-0e55a43869bb tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] [instance: 696c547f-7cea-497f-9871-dd26f3fb6cfc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:10:35.541435 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a9351b95-4eff-40a2-97c7-0e55a43869bb tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:35.543492 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a9351b95-4eff-40a2-97c7-0e55a43869bb tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:35.543637 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a9351b95-4eff-40a2-97c7-0e55a43869bb tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:35.544633 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a9351b95-4eff-40a2-97c7-0e55a43869bb tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:35.546889 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a9351b95-4eff-40a2-97c7-0e55a43869bb tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:35.548321 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a9351b95-4eff-40a2-97c7-0e55a43869bb tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:35.728937 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-a9351b95-4eff-40a2-97c7-0e55a43869bb tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] 10.222.0.43 "GET /compute/v2.1/servers/696c547f-7cea-497f-9871-dd26f3fb6cfc/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.208293 Oct 04 22:10:35.728937 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2527/5104] 10.222.0.43 () {58 vars in 1275 bytes} [Tue Oct 4 22:10:35 2022] GET /compute/v2.1/servers/696c547f-7cea-497f-9871-dd26f3fb6cfc/os-interface => generated 284 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:10:36.188836 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-56d2b5fa-bc33-49e1-a7f8-3dfee2983d63 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:10:36.189854 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-56d2b5fa-bc33-49e1-a7f8-3dfee2983d63 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: 395434aa-4b24-4f4f-b83c-bb8870cd38b7] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:10:36.199547 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-56d2b5fa-bc33-49e1-a7f8-3dfee2983d63 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:36.201450 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-56d2b5fa-bc33-49e1-a7f8-3dfee2983d63 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:36.202014 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-56d2b5fa-bc33-49e1-a7f8-3dfee2983d63 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:36.202991 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-56d2b5fa-bc33-49e1-a7f8-3dfee2983d63 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:36.203469 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-56d2b5fa-bc33-49e1-a7f8-3dfee2983d63 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:36.213256 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-56d2b5fa-bc33-49e1-a7f8-3dfee2983d63 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:36.263117 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-3461ac46-23fb-4a63-a7ee-e1c88c59ec4e tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:10:36.264502 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-3461ac46-23fb-4a63-a7ee-e1c88c59ec4e tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] [instance: 367dad85-827d-47b0-a468-418d398b36f9] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:10:36.278624 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3461ac46-23fb-4a63-a7ee-e1c88c59ec4e tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:36.279555 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3461ac46-23fb-4a63-a7ee-e1c88c59ec4e tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:36.281283 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3461ac46-23fb-4a63-a7ee-e1c88c59ec4e tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:36.282296 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3461ac46-23fb-4a63-a7ee-e1c88c59ec4e tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:36.285552 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3461ac46-23fb-4a63-a7ee-e1c88c59ec4e tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:36.286325 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3461ac46-23fb-4a63-a7ee-e1c88c59ec4e tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:37.469684 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-56d2b5fa-bc33-49e1-a7f8-3dfee2983d63 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1682f1a60045d8a04d4d67393cd13f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b00cd9fa8e40a0919b61fcd60269f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:10:37.493766 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-56d2b5fa-bc33-49e1-a7f8-3dfee2983d63 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "GET /compute/v2.1/servers/395434aa-4b24-4f4f-b83c-bb8870cd38b7" status: 200 len: 1309 microversion: 2.1 time: 1.301099 Oct 04 22:10:37.497505 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2578/5105] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:10:36 2022] GET /compute/v2.1/servers/395434aa-4b24-4f4f-b83c-bb8870cd38b7 => generated 1309 bytes in 1314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:10:37.509788 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-6d2cefab-d42a-4d95-be8e-621b7571def0 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:10:37.529878 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-6d2cefab-d42a-4d95-be8e-621b7571def0 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: a9da8775-8ca8-41b1-8340-e4f3dae6e05b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:10:37.550596 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6d2cefab-d42a-4d95-be8e-621b7571def0 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:37.551570 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6d2cefab-d42a-4d95-be8e-621b7571def0 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:37.552288 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6d2cefab-d42a-4d95-be8e-621b7571def0 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:37.553323 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6d2cefab-d42a-4d95-be8e-621b7571def0 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:37.554973 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6d2cefab-d42a-4d95-be8e-621b7571def0 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:37.559778 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6d2cefab-d42a-4d95-be8e-621b7571def0 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:37.665020 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-6d2cefab-d42a-4d95-be8e-621b7571def0 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "POST /compute/v2.1/servers/a9da8775-8ca8-41b1-8340-e4f3dae6e05b/action" status: 200 len: 14 microversion: 2.1 time: 0.165566 Oct 04 22:10:37.668635 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2579/5106] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 22:10:37 2022] POST /compute/v2.1/servers/a9da8775-8ca8-41b1-8340-e4f3dae6e05b/action => generated 14 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 22:10:37.835841 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-3461ac46-23fb-4a63-a7ee-e1c88c59ec4e tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:10:37.855086 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-3461ac46-23fb-4a63-a7ee-e1c88c59ec4e tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:10:37.860794 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-3461ac46-23fb-4a63-a7ee-e1c88c59ec4e tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:10:37.863512 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-3461ac46-23fb-4a63-a7ee-e1c88c59ec4e tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] 10.222.0.43 "GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9" status: 200 len: 2828 microversion: 2.32 time: 1.605068 Oct 04 22:10:37.889786 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2528/5107] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:10:36 2022] GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9 => generated 2828 bytes in 1632 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:10:37.902129 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-3a5d5889-6b4f-4055-9b5d-7156d963cce5 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:10:37.903086 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-3a5d5889-6b4f-4055-9b5d-7156d963cce5 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] [instance: 367dad85-827d-47b0-a468-418d398b36f9] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:10:37.925325 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3a5d5889-6b4f-4055-9b5d-7156d963cce5 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:37.926055 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3a5d5889-6b4f-4055-9b5d-7156d963cce5 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:37.926753 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3a5d5889-6b4f-4055-9b5d-7156d963cce5 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:37.927707 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3a5d5889-6b4f-4055-9b5d-7156d963cce5 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:37.928368 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3a5d5889-6b4f-4055-9b5d-7156d963cce5 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:37.929025 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3a5d5889-6b4f-4055-9b5d-7156d963cce5 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:38.313065 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-3a5d5889-6b4f-4055-9b5d-7156d963cce5 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] 10.222.0.43 "GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9/os-interface" status: 200 len: 1831 microversion: 2.32 time: 0.416575 Oct 04 22:10:38.313829 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2580/5108] 10.222.0.43 () {60 vars in 1316 bytes} [Tue Oct 4 22:10:37 2022] GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9/os-interface => generated 1831 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:10:38.392499 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-56f18438-cf5e-458a-8411-1475d804b006 req-a4650ff0-278e-4d3d-99fa-97bf77ac55fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "696c547f-7cea-497f-9871-dd26f3fb6cfc", "tag": "b5aaccab-10a5-4329-b536-62d277938793"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:10:38.411209 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-56f18438-cf5e-458a-8411-1475d804b006 req-a4650ff0-278e-4d3d-99fa-97bf77ac55fb service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:38.412073 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-56f18438-cf5e-458a-8411-1475d804b006 req-a4650ff0-278e-4d3d-99fa-97bf77ac55fb service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:38.413170 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-56f18438-cf5e-458a-8411-1475d804b006 req-a4650ff0-278e-4d3d-99fa-97bf77ac55fb service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:38.432170 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-56f18438-cf5e-458a-8411-1475d804b006 req-a4650ff0-278e-4d3d-99fa-97bf77ac55fb service nova] Creating event network-changed:b5aaccab-10a5-4329-b536-62d277938793 for instance 696c547f-7cea-497f-9871-dd26f3fb6cfc on n-h1-860284-1 Oct 04 22:10:38.439147 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-56f18438-cf5e-458a-8411-1475d804b006 req-a4650ff0-278e-4d3d-99fa-97bf77ac55fb service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052713 Oct 04 22:10:38.440739 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2529/5109] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:10:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:10:38.522950 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-dcae63b2-6a38-4052-beb5-15707f3df026 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:10:38.524510 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-dcae63b2-6a38-4052-beb5-15707f3df026 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: 395434aa-4b24-4f4f-b83c-bb8870cd38b7] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:10:38.532844 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dcae63b2-6a38-4052-beb5-15707f3df026 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:38.533604 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dcae63b2-6a38-4052-beb5-15707f3df026 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:38.538675 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dcae63b2-6a38-4052-beb5-15707f3df026 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:38.539843 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dcae63b2-6a38-4052-beb5-15707f3df026 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:38.540658 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dcae63b2-6a38-4052-beb5-15707f3df026 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:38.541474 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dcae63b2-6a38-4052-beb5-15707f3df026 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:38.678256 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-67b76e58-c1ef-4dad-b46f-ca184646f41a tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:10:38.680958 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-67b76e58-c1ef-4dad-b46f-ca184646f41a tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: a9da8775-8ca8-41b1-8340-e4f3dae6e05b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:10:38.698559 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-67b76e58-c1ef-4dad-b46f-ca184646f41a tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:38.700986 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-67b76e58-c1ef-4dad-b46f-ca184646f41a tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:38.701623 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-67b76e58-c1ef-4dad-b46f-ca184646f41a tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:38.702924 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-67b76e58-c1ef-4dad-b46f-ca184646f41a tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:38.703612 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-67b76e58-c1ef-4dad-b46f-ca184646f41a tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:38.704730 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-67b76e58-c1ef-4dad-b46f-ca184646f41a tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:38.813509 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-67b76e58-c1ef-4dad-b46f-ca184646f41a tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "POST /compute/v2.1/servers/a9da8775-8ca8-41b1-8340-e4f3dae6e05b/action" status: 200 len: 14 microversion: 2.1 time: 0.139508 Oct 04 22:10:38.817392 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2530/5110] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 22:10:38 2022] POST /compute/v2.1/servers/a9da8775-8ca8-41b1-8340-e4f3dae6e05b/action => generated 14 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 22:10:39.776666 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-dcae63b2-6a38-4052-beb5-15707f3df026 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1682f1a60045d8a04d4d67393cd13f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b00cd9fa8e40a0919b61fcd60269f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:10:39.803157 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-dcae63b2-6a38-4052-beb5-15707f3df026 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "GET /compute/v2.1/servers/395434aa-4b24-4f4f-b83c-bb8870cd38b7" status: 200 len: 1490 microversion: 2.1 time: 1.285846 Oct 04 22:10:39.821935 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2581/5111] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:10:38 2022] GET /compute/v2.1/servers/395434aa-4b24-4f4f-b83c-bb8870cd38b7 => generated 1490 bytes in 1305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:10:39.830414 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-7bd8bdc6-c13a-490e-8514-79844c27bd84 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:10:39.830664 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-1742e1c7-0fc3-4cf8-9205-e1c791ab505f tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:10:39.832917 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-1742e1c7-0fc3-4cf8-9205-e1c791ab505f tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: a9da8775-8ca8-41b1-8340-e4f3dae6e05b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:10:39.845418 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-7bd8bdc6-c13a-490e-8514-79844c27bd84 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: bedf6a44-86ef-4673-8a8f-7541db6eeda7] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:10:39.855748 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1742e1c7-0fc3-4cf8-9205-e1c791ab505f tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:39.856421 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1742e1c7-0fc3-4cf8-9205-e1c791ab505f tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:39.858949 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1742e1c7-0fc3-4cf8-9205-e1c791ab505f tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:39.862079 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1742e1c7-0fc3-4cf8-9205-e1c791ab505f tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:39.862079 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1742e1c7-0fc3-4cf8-9205-e1c791ab505f tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:39.862288 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7bd8bdc6-c13a-490e-8514-79844c27bd84 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:39.862712 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7bd8bdc6-c13a-490e-8514-79844c27bd84 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:39.863745 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7bd8bdc6-c13a-490e-8514-79844c27bd84 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:39.865104 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1742e1c7-0fc3-4cf8-9205-e1c791ab505f tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:39.865883 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7bd8bdc6-c13a-490e-8514-79844c27bd84 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:39.866700 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7bd8bdc6-c13a-490e-8514-79844c27bd84 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:39.867339 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7bd8bdc6-c13a-490e-8514-79844c27bd84 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:39.973740 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-1742e1c7-0fc3-4cf8-9205-e1c791ab505f tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "POST /compute/v2.1/servers/a9da8775-8ca8-41b1-8340-e4f3dae6e05b/action" status: 200 len: 14 microversion: 2.1 time: 0.149904 Oct 04 22:10:39.975001 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2531/5112] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 22:10:39 2022] POST /compute/v2.1/servers/a9da8775-8ca8-41b1-8340-e4f3dae6e05b/action => generated 14 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 04 22:10:40.545803 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-7bd8bdc6-c13a-490e-8514-79844c27bd84 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1682f1a60045d8a04d4d67393cd13f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b00cd9fa8e40a0919b61fcd60269f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:10:40.558615 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-7bd8bdc6-c13a-490e-8514-79844c27bd84 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "GET /compute/v2.1/servers/bedf6a44-86ef-4673-8a8f-7541db6eeda7" status: 200 len: 1491 microversion: 2.1 time: 0.732549 Oct 04 22:10:40.590449 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2582/5113] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:10:39 2022] GET /compute/v2.1/servers/bedf6a44-86ef-4673-8a8f-7541db6eeda7 => generated 1491 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:10:40.597024 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-ea52bc66-7261-47ea-b455-3f784085650a tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:10:40.597796 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-ea52bc66-7261-47ea-b455-3f784085650a tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: 395434aa-4b24-4f4f-b83c-bb8870cd38b7] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:10:40.620885 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ea52bc66-7261-47ea-b455-3f784085650a tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:40.621678 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ea52bc66-7261-47ea-b455-3f784085650a tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:40.623066 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ea52bc66-7261-47ea-b455-3f784085650a tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:40.626314 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ea52bc66-7261-47ea-b455-3f784085650a tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:40.627157 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ea52bc66-7261-47ea-b455-3f784085650a tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:40.627975 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ea52bc66-7261-47ea-b455-3f784085650a tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:40.986054 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-e67c110d-cd6c-4a45-865c-3e70e3d3ad54 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:10:40.989100 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-e67c110d-cd6c-4a45-865c-3e70e3d3ad54 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: a9da8775-8ca8-41b1-8340-e4f3dae6e05b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:10:41.006083 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e67c110d-cd6c-4a45-865c-3e70e3d3ad54 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:41.006924 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e67c110d-cd6c-4a45-865c-3e70e3d3ad54 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:41.007569 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e67c110d-cd6c-4a45-865c-3e70e3d3ad54 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:41.008485 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e67c110d-cd6c-4a45-865c-3e70e3d3ad54 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:41.009184 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e67c110d-cd6c-4a45-865c-3e70e3d3ad54 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:41.009810 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e67c110d-cd6c-4a45-865c-3e70e3d3ad54 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:41.105421 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-e67c110d-cd6c-4a45-865c-3e70e3d3ad54 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "POST /compute/v2.1/servers/a9da8775-8ca8-41b1-8340-e4f3dae6e05b/action" status: 200 len: 14 microversion: 2.1 time: 0.123742 Oct 04 22:10:41.109258 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2583/5114] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 22:10:40 2022] POST /compute/v2.1/servers/a9da8775-8ca8-41b1-8340-e4f3dae6e05b/action => generated 14 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 04 22:10:41.441348 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-ea52bc66-7261-47ea-b455-3f784085650a tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1682f1a60045d8a04d4d67393cd13f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b00cd9fa8e40a0919b61fcd60269f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:10:41.472869 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-ea52bc66-7261-47ea-b455-3f784085650a tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "GET /compute/v2.1/servers/395434aa-4b24-4f4f-b83c-bb8870cd38b7" status: 200 len: 1490 microversion: 2.1 time: 0.879440 Oct 04 22:10:41.476564 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2532/5115] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:10:40 2022] GET /compute/v2.1/servers/395434aa-4b24-4f4f-b83c-bb8870cd38b7 => generated 1490 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:10:41.510740 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-8bec281d-5117-4620-aec5-020778955ca7 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:10:41.511739 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-8bec281d-5117-4620-aec5-020778955ca7 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: 395434aa-4b24-4f4f-b83c-bb8870cd38b7] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:10:41.528483 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8bec281d-5117-4620-aec5-020778955ca7 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:41.529183 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8bec281d-5117-4620-aec5-020778955ca7 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:41.531067 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8bec281d-5117-4620-aec5-020778955ca7 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:41.532316 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8bec281d-5117-4620-aec5-020778955ca7 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:41.532969 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8bec281d-5117-4620-aec5-020778955ca7 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:41.533567 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8bec281d-5117-4620-aec5-020778955ca7 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:41.580235 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-8bec281d-5117-4620-aec5-020778955ca7 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: 395434aa-4b24-4f4f-b83c-bb8870cd38b7] Going to try to terminate instance {{(pid=134102) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 22:10:41.699158 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-8bec281d-5117-4620-aec5-020778955ca7 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "DELETE /compute/v2.1/servers/395434aa-4b24-4f4f-b83c-bb8870cd38b7" status: 204 len: 0 microversion: 2.1 time: 0.201823 Oct 04 22:10:41.700638 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2584/5116] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 22:10:41 2022] DELETE /compute/v2.1/servers/395434aa-4b24-4f4f-b83c-bb8870cd38b7 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 22:10:41.730633 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-0a7f1176-09a1-4b02-892b-4684acc796a8 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:10:41.737603 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-0a7f1176-09a1-4b02-892b-4684acc796a8 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: 395434aa-4b24-4f4f-b83c-bb8870cd38b7] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:10:41.753637 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0a7f1176-09a1-4b02-892b-4684acc796a8 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:41.759908 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0a7f1176-09a1-4b02-892b-4684acc796a8 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:41.761039 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0a7f1176-09a1-4b02-892b-4684acc796a8 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:41.762040 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0a7f1176-09a1-4b02-892b-4684acc796a8 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:41.764507 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0a7f1176-09a1-4b02-892b-4684acc796a8 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:41.765523 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0a7f1176-09a1-4b02-892b-4684acc796a8 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:42.114557 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-0a7f1176-09a1-4b02-892b-4684acc796a8 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1682f1a60045d8a04d4d67393cd13f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b00cd9fa8e40a0919b61fcd60269f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:10:42.117561 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-1932ea98-c5d7-4fd5-a483-88a2fbb8908f tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:10:42.120102 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-1932ea98-c5d7-4fd5-a483-88a2fbb8908f tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: a9da8775-8ca8-41b1-8340-e4f3dae6e05b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:10:42.124461 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-0a7f1176-09a1-4b02-892b-4684acc796a8 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "GET /compute/v2.1/servers/395434aa-4b24-4f4f-b83c-bb8870cd38b7" status: 200 len: 1496 microversion: 2.1 time: 0.418545 Oct 04 22:10:42.132210 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2533/5117] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:10:41 2022] GET /compute/v2.1/servers/395434aa-4b24-4f4f-b83c-bb8870cd38b7 => generated 1496 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:10:42.143428 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1932ea98-c5d7-4fd5-a483-88a2fbb8908f tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:42.144749 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1932ea98-c5d7-4fd5-a483-88a2fbb8908f tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:42.146320 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1932ea98-c5d7-4fd5-a483-88a2fbb8908f tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:42.147525 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1932ea98-c5d7-4fd5-a483-88a2fbb8908f tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:42.151314 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1932ea98-c5d7-4fd5-a483-88a2fbb8908f tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:42.154750 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1932ea98-c5d7-4fd5-a483-88a2fbb8908f tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:42.509403 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-2521e43a-ecac-45c9-8fbf-2a12bbc41332 req-8de54167-bebf-408f-9817-e3a25db018c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "367dad85-827d-47b0-a468-418d398b36f9", "tag": "1701ea5d-b8bb-4192-8463-7dfa341dc8c3"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:10:42.524323 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-2521e43a-ecac-45c9-8fbf-2a12bbc41332 req-8de54167-bebf-408f-9817-e3a25db018c4 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:42.525078 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-2521e43a-ecac-45c9-8fbf-2a12bbc41332 req-8de54167-bebf-408f-9817-e3a25db018c4 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:42.527873 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-2521e43a-ecac-45c9-8fbf-2a12bbc41332 req-8de54167-bebf-408f-9817-e3a25db018c4 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:42.542807 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-2521e43a-ecac-45c9-8fbf-2a12bbc41332 req-8de54167-bebf-408f-9817-e3a25db018c4 service nova] Creating event network-changed:1701ea5d-b8bb-4192-8463-7dfa341dc8c3 for instance 367dad85-827d-47b0-a468-418d398b36f9 on n-h1-860284-1 Oct 04 22:10:42.549050 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-2521e43a-ecac-45c9-8fbf-2a12bbc41332 req-8de54167-bebf-408f-9817-e3a25db018c4 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117562 Oct 04 22:10:42.549892 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2534/5118] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:10:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:10:43.167557 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-38b47003-b02b-4759-a314-39f636ecd2f4 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:10:43.168669 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-38b47003-b02b-4759-a314-39f636ecd2f4 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: 395434aa-4b24-4f4f-b83c-bb8870cd38b7] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:10:43.190118 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-38b47003-b02b-4759-a314-39f636ecd2f4 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:43.193256 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-1932ea98-c5d7-4fd5-a483-88a2fbb8908f tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "POST /compute/v2.1/servers/a9da8775-8ca8-41b1-8340-e4f3dae6e05b/action" status: 200 len: 8208 microversion: 2.1 time: 1.079801 Oct 04 22:10:43.193787 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-38b47003-b02b-4759-a314-39f636ecd2f4 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:43.194536 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-38b47003-b02b-4759-a314-39f636ecd2f4 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:43.196042 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-38b47003-b02b-4759-a314-39f636ecd2f4 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:43.196643 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2585/5119] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 22:10:42 2022] POST /compute/v2.1/servers/a9da8775-8ca8-41b1-8340-e4f3dae6e05b/action => generated 8208 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:10:43.198191 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-38b47003-b02b-4759-a314-39f636ecd2f4 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:43.201970 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-38b47003-b02b-4759-a314-39f636ecd2f4 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:43.206737 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-233ce98c-a8cb-4eda-8588-30d9f1e9adf0 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:10:43.207859 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-233ce98c-a8cb-4eda-8588-30d9f1e9adf0 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 48243e1b-892b-4c4b-8db1-242b2e40653b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:10:43.226664 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-233ce98c-a8cb-4eda-8588-30d9f1e9adf0 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:43.229275 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-233ce98c-a8cb-4eda-8588-30d9f1e9adf0 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:43.229275 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-233ce98c-a8cb-4eda-8588-30d9f1e9adf0 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:43.235891 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-233ce98c-a8cb-4eda-8588-30d9f1e9adf0 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:43.238392 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-233ce98c-a8cb-4eda-8588-30d9f1e9adf0 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:43.240382 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-233ce98c-a8cb-4eda-8588-30d9f1e9adf0 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:43.745820 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-38b47003-b02b-4759-a314-39f636ecd2f4 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1682f1a60045d8a04d4d67393cd13f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b00cd9fa8e40a0919b61fcd60269f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:10:43.756766 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-38b47003-b02b-4759-a314-39f636ecd2f4 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "GET /compute/v2.1/servers/395434aa-4b24-4f4f-b83c-bb8870cd38b7" status: 200 len: 1496 microversion: 2.1 time: 0.598361 Oct 04 22:10:43.758498 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2535/5120] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:10:43 2022] GET /compute/v2.1/servers/395434aa-4b24-4f4f-b83c-bb8870cd38b7 => generated 1496 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:10:43.978771 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-233ce98c-a8cb-4eda-8588-30d9f1e9adf0 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:10:43.992073 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-233ce98c-a8cb-4eda-8588-30d9f1e9adf0 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b" status: 200 len: 1669 microversion: 2.1 time: 0.791024 Oct 04 22:10:44.009413 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2586/5121] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:10:43 2022] GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b => generated 1669 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:10:44.028569 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-10d2119b-3399-4d54-af25-2a89524135d8 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:10:44.029630 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-10d2119b-3399-4d54-af25-2a89524135d8 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 48243e1b-892b-4c4b-8db1-242b2e40653b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:10:44.043078 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-10d2119b-3399-4d54-af25-2a89524135d8 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:44.044413 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-10d2119b-3399-4d54-af25-2a89524135d8 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:44.045093 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-10d2119b-3399-4d54-af25-2a89524135d8 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:44.046908 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-10d2119b-3399-4d54-af25-2a89524135d8 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:44.047900 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-10d2119b-3399-4d54-af25-2a89524135d8 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:44.048633 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-10d2119b-3399-4d54-af25-2a89524135d8 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:44.478025 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-10d2119b-3399-4d54-af25-2a89524135d8 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:10:44.487612 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-10d2119b-3399-4d54-af25-2a89524135d8 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b" status: 200 len: 1669 microversion: 2.1 time: 0.463216 Oct 04 22:10:44.488909 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2536/5122] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:10:44 2022] GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b => generated 1669 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:10:44.512871 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-301ccc46-61b9-44d2-91d6-d05992a12968 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:10:44.514058 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-301ccc46-61b9-44d2-91d6-d05992a12968 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 48243e1b-892b-4c4b-8db1-242b2e40653b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:10:44.522624 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-301ccc46-61b9-44d2-91d6-d05992a12968 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:44.524266 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-301ccc46-61b9-44d2-91d6-d05992a12968 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:44.524934 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-301ccc46-61b9-44d2-91d6-d05992a12968 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:44.525949 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-301ccc46-61b9-44d2-91d6-d05992a12968 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:44.526607 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-301ccc46-61b9-44d2-91d6-d05992a12968 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:44.527209 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-301ccc46-61b9-44d2-91d6-d05992a12968 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:44.794592 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-c45d4ae2-c0a4-4d93-8f3f-209773ec2d3f tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:10:44.795292 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-c45d4ae2-c0a4-4d93-8f3f-209773ec2d3f tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: 395434aa-4b24-4f4f-b83c-bb8870cd38b7] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:10:44.814702 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c45d4ae2-c0a4-4d93-8f3f-209773ec2d3f tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:44.815215 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c45d4ae2-c0a4-4d93-8f3f-209773ec2d3f tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:44.815666 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c45d4ae2-c0a4-4d93-8f3f-209773ec2d3f tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:44.816395 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c45d4ae2-c0a4-4d93-8f3f-209773ec2d3f tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:44.816859 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c45d4ae2-c0a4-4d93-8f3f-209773ec2d3f tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:44.817294 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c45d4ae2-c0a4-4d93-8f3f-209773ec2d3f tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:45.061455 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-301ccc46-61b9-44d2-91d6-d05992a12968 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:10:45.071660 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-301ccc46-61b9-44d2-91d6-d05992a12968 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b" status: 200 len: 1669 microversion: 2.1 time: 0.562694 Oct 04 22:10:45.086631 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2587/5123] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:10:44 2022] GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b => generated 1669 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:10:45.097502 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-d1a71f47-5cc5-4d7e-8b5d-911c2ddeafad tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:10:45.098490 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-d1a71f47-5cc5-4d7e-8b5d-911c2ddeafad tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 48243e1b-892b-4c4b-8db1-242b2e40653b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:10:45.105735 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d1a71f47-5cc5-4d7e-8b5d-911c2ddeafad tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:45.106783 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d1a71f47-5cc5-4d7e-8b5d-911c2ddeafad tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:45.107414 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d1a71f47-5cc5-4d7e-8b5d-911c2ddeafad tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:45.109117 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d1a71f47-5cc5-4d7e-8b5d-911c2ddeafad tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:45.111921 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d1a71f47-5cc5-4d7e-8b5d-911c2ddeafad tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:45.112626 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d1a71f47-5cc5-4d7e-8b5d-911c2ddeafad tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:45.524565 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-c45d4ae2-c0a4-4d93-8f3f-209773ec2d3f tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1682f1a60045d8a04d4d67393cd13f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b00cd9fa8e40a0919b61fcd60269f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:10:45.535662 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-c45d4ae2-c0a4-4d93-8f3f-209773ec2d3f tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "GET /compute/v2.1/servers/395434aa-4b24-4f4f-b83c-bb8870cd38b7" status: 200 len: 1496 microversion: 2.1 time: 0.754165 Oct 04 22:10:45.536280 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2537/5124] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:10:44 2022] GET /compute/v2.1/servers/395434aa-4b24-4f4f-b83c-bb8870cd38b7 => generated 1496 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:10:45.683044 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-d1a71f47-5cc5-4d7e-8b5d-911c2ddeafad tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:10:45.694285 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-d1a71f47-5cc5-4d7e-8b5d-911c2ddeafad tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b" status: 200 len: 1669 microversion: 2.1 time: 0.602792 Oct 04 22:10:45.700294 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2588/5125] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:10:45 2022] GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b => generated 1669 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:10:45.734212 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-2375c43f-2b5c-4dad-bd79-1362ce5edc05 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:10:45.734806 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-2375c43f-2b5c-4dad-bd79-1362ce5edc05 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 48243e1b-892b-4c4b-8db1-242b2e40653b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:10:45.758642 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2375c43f-2b5c-4dad-bd79-1362ce5edc05 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:45.760730 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2375c43f-2b5c-4dad-bd79-1362ce5edc05 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:45.762408 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2375c43f-2b5c-4dad-bd79-1362ce5edc05 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:45.763372 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2375c43f-2b5c-4dad-bd79-1362ce5edc05 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:45.764864 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2375c43f-2b5c-4dad-bd79-1362ce5edc05 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:45.767591 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2375c43f-2b5c-4dad-bd79-1362ce5edc05 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:45.878988 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-2375c43f-2b5c-4dad-bd79-1362ce5edc05 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 48243e1b-892b-4c4b-8db1-242b2e40653b] Locking {{(pid=134101) lock /opt/stack/nova/nova/compute/api.py:4845}} Oct 04 22:10:46.022047 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-d39626c5-80df-4dba-b63c-2cee1fca63a5 req-8cf58884-8909-4575-86d2-cf5133a3f1a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "395434aa-4b24-4f4f-b83c-bb8870cd38b7", "name": "network-vif-deleted", "tag": "95bc59a7-4753-423d-8cf1-764c9edf2646"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:10:46.052186 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-d39626c5-80df-4dba-b63c-2cee1fca63a5 req-8cf58884-8909-4575-86d2-cf5133a3f1a1 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:46.055390 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-d39626c5-80df-4dba-b63c-2cee1fca63a5 req-8cf58884-8909-4575-86d2-cf5133a3f1a1 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:46.055949 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-d39626c5-80df-4dba-b63c-2cee1fca63a5 req-8cf58884-8909-4575-86d2-cf5133a3f1a1 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:46.069378 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-2375c43f-2b5c-4dad-bd79-1362ce5edc05 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "POST /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b/action" status: 202 len: 0 microversion: 2.1 time: 0.337897 Oct 04 22:10:46.072170 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2538/5126] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 22:10:45 2022] POST /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b/action => generated 0 bytes in 343 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 22:10:46.105454 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-d39626c5-80df-4dba-b63c-2cee1fca63a5 req-8cf58884-8909-4575-86d2-cf5133a3f1a1 service nova] Creating event network-vif-deleted:95bc59a7-4753-423d-8cf1-764c9edf2646 for instance 395434aa-4b24-4f4f-b83c-bb8870cd38b7 on n-h2-860284-1 Oct 04 22:10:46.107713 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-4855872a-b811-459e-adf1-26e35658d9d9 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:10:46.113960 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-4855872a-b811-459e-adf1-26e35658d9d9 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 48243e1b-892b-4c4b-8db1-242b2e40653b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:10:46.133412 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4855872a-b811-459e-adf1-26e35658d9d9 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:46.137926 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4855872a-b811-459e-adf1-26e35658d9d9 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:46.141250 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-d39626c5-80df-4dba-b63c-2cee1fca63a5 req-8cf58884-8909-4575-86d2-cf5133a3f1a1 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124677 Oct 04 22:10:46.142473 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2589/5127] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:10:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:10:46.143671 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4855872a-b811-459e-adf1-26e35658d9d9 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:46.144490 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4855872a-b811-459e-adf1-26e35658d9d9 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:46.145054 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4855872a-b811-459e-adf1-26e35658d9d9 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:46.145529 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4855872a-b811-459e-adf1-26e35658d9d9 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:46.495820 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-4855872a-b811-459e-adf1-26e35658d9d9 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:10:46.504759 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-4855872a-b811-459e-adf1-26e35658d9d9 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b" status: 200 len: 1669 microversion: 2.1 time: 0.429790 Oct 04 22:10:46.515311 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2539/5128] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:10:46 2022] GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b => generated 1669 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:10:46.547526 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-ba15d9b7-639a-44f1-a1ec-64e169d23efe tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:10:46.556746 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ba15d9b7-639a-44f1-a1ec-64e169d23efe tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:46.557879 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ba15d9b7-639a-44f1-a1ec-64e169d23efe tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:46.558579 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ba15d9b7-639a-44f1-a1ec-64e169d23efe tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:46.569660 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-5329a945-c513-4499-a0f1-767fa383abf5 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:10:46.570723 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-5329a945-c513-4499-a0f1-767fa383abf5 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: 395434aa-4b24-4f4f-b83c-bb8870cd38b7] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:10:46.582320 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5329a945-c513-4499-a0f1-767fa383abf5 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:46.583506 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5329a945-c513-4499-a0f1-767fa383abf5 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:46.584152 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5329a945-c513-4499-a0f1-767fa383abf5 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:46.585323 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5329a945-c513-4499-a0f1-767fa383abf5 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:46.586159 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5329a945-c513-4499-a0f1-767fa383abf5 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:46.587963 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5329a945-c513-4499-a0f1-767fa383abf5 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:46.607882 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-ba15d9b7-639a-44f1-a1ec-64e169d23efe tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] HTTP exception thrown: Instance 48243e1b-892b-4c4b-8db1-242b2e40653b is locked Oct 04 22:10:46.611801 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-ba15d9b7-639a-44f1-a1ec-64e169d23efe tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Request method failure captured: Oct 04 22:10:46.611801 n-d-860284-1 devstack@n-api.service[134102]: request: POST /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b/action HTTP/1.1 Oct 04 22:10:46.611801 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 22:10:46.611801 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 22:10:46.611801 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 22:10:46.611801 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 15 Oct 04 22:10:46.611801 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 22:10:46.611801 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 22:10:46.611801 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 22:10:46.611801 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 22:10:46.611801 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPK36LhdKEh-IT_3Gw2xkUDt8vFdE3tJ0L0pEorSp45vpb8HIuo5GhgwZG7etc4I92LwOWEQ_5hLVPfNglgOWzH1UtFXDjgpmOJxq9bsBu31hozTvhN6em_GLmX3idDP8ki8j3hYIhOKY57iHcJLRtUu-QmjxHUfChrL6-4ezukI1Oj4 Oct 04 22:10:46.611801 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 22:10:46.611801 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 22:10:46.611801 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 22:10:46.611801 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 22:10:46.611801 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 22:10:46.611801 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 22:10:46.611801 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: 9da7a77590054a3c911643db69a0beae Oct 04 22:10:46.611801 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-ServerActionsTestJSON-514103999 Oct 04 22:10:46.611801 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 22:10:46.611801 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 22:10:46.611801 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/9da7a77590054a3c911643db69a0beae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_9da7a77590054a3c911643db69a0beae", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/9da7a77590054a3c911643db69a0beae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/9da7a77590054a3c911643db69a0beae"}]}] Oct 04 22:10:46.611801 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-ServerActionsTestJSON-514103999 Oct 04 22:10:46.611801 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: 9da7a77590054a3c911643db69a0beae Oct 04 22:10:46.611801 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-ServerActionsTestJSON-514103999 Oct 04 22:10:46.611801 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-ServerActionsTestJSON-514103999-project Oct 04 22:10:46.611801 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 22:10:46.611801 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 22:10:46.611801 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: 836cb8e2e7be4981bb266cbd4189a775 Oct 04 22:10:46.611801 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-ServerActionsTestJSON-514103999-project Oct 04 22:10:46.611801 n-d-860284-1 devstack@n-api.service[134102]: Oct 04 22:10:46.611801 n-d-860284-1 devstack@n-api.service[134102]: {"os-stop": {}} Oct 04 22:10:46.611801 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 22:10:46.611801 n-d-860284-1 devstack@n-api.service[134102]: exception: Instance 48243e1b-892b-4c4b-8db1-242b2e40653b is locked Oct 04 22:10:46.611801 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': '48243e1b-892b-4c4b-8db1-242b2e40653b', 'body': {'os-stop': {}}} Oct 04 22:10:46.611801 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:10:46.611801 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:10:46.611801 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1449, in _stop_server Oct 04 22:10:46.611801 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi self.compute_api.stop(context, instance) Oct 04 22:10:46.611801 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 240, in inner Oct 04 22:10:46.611801 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.InstanceIsLocked(instance_uuid=instance.uuid) Oct 04 22:10:46.611801 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceIsLocked: Instance 48243e1b-892b-4c4b-8db1-242b2e40653b is locked Oct 04 22:10:46.611801 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:10:46.611801 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:10:46.611801 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:10:46.611801 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:10:46.611801 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:10:46.611801 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:10:46.611801 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:10:46.611801 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:10:46.611801 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:10:46.611801 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:10:46.611801 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1451, in _stop_server Oct 04 22:10:46.611801 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=e.format_message()) Oct 04 22:10:46.611801 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Instance 48243e1b-892b-4c4b-8db1-242b2e40653b is locked Oct 04 22:10:46.611801 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:10:46.611801 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:10:46.611801 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:10:46.611801 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:10:46.611801 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:10:46.611801 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:10:46.611801 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:10:46.611801 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:10:46.611801 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48243e1b-892b-4c4b-8db1-242b2e40653b is locked Oct 04 22:10:46.611801 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:10:46.617383 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-ba15d9b7-639a-44f1-a1ec-64e169d23efe tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Returning 409 to user: Instance 48243e1b-892b-4c4b-8db1-242b2e40653b is locked {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:10:46.617383 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-ba15d9b7-639a-44f1-a1ec-64e169d23efe tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "POST /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b/action" status: 409 len: 107 microversion: 2.1 time: 0.076420 Oct 04 22:10:46.619195 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2590/5129] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 22:10:46 2022] POST /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b/action => generated 107 bytes in 82 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 22:10:46.622880 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:10:46.626141 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-4790eca6-46ae-4325-8951-b37139b31a43 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:10:46.627839 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-4790eca6-46ae-4325-8951-b37139b31a43 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 48243e1b-892b-4c4b-8db1-242b2e40653b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:10:46.647991 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4790eca6-46ae-4325-8951-b37139b31a43 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:46.648495 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4790eca6-46ae-4325-8951-b37139b31a43 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:46.649896 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4790eca6-46ae-4325-8951-b37139b31a43 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:46.651400 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4790eca6-46ae-4325-8951-b37139b31a43 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:46.653243 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4790eca6-46ae-4325-8951-b37139b31a43 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:46.653879 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4790eca6-46ae-4325-8951-b37139b31a43 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:46.679859 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5329a945-c513-4499-a0f1-767fa383abf5 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:46.680369 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5329a945-c513-4499-a0f1-767fa383abf5 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:46.680930 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5329a945-c513-4499-a0f1-767fa383abf5 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:46.684315 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.objects.instance [None req-5329a945-c513-4499-a0f1-767fa383abf5 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lazy-loading 'fault' on Instance uuid 395434aa-4b24-4f4f-b83c-bb8870cd38b7 {{(pid=134101) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 22:10:46.786935 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-4790eca6-46ae-4325-8951-b37139b31a43 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 48243e1b-892b-4c4b-8db1-242b2e40653b] Unlocking {{(pid=134102) unlock /opt/stack/nova/nova/compute/api.py:4874}} Oct 04 22:10:46.803590 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-5329a945-c513-4499-a0f1-767fa383abf5 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1682f1a60045d8a04d4d67393cd13f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b00cd9fa8e40a0919b61fcd60269f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:10:46.818694 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-5329a945-c513-4499-a0f1-767fa383abf5 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "GET /compute/v2.1/servers/395434aa-4b24-4f4f-b83c-bb8870cd38b7" status: 200 len: 1299 microversion: 2.1 time: 0.255052 Oct 04 22:10:46.843279 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2540/5130] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:10:46 2022] GET /compute/v2.1/servers/395434aa-4b24-4f4f-b83c-bb8870cd38b7 => generated 1299 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:10:46.938579 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:10:46.945004 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-4790eca6-46ae-4325-8951-b37139b31a43 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "POST /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b/action" status: 202 len: 0 microversion: 2.1 time: 0.322727 Oct 04 22:10:46.947062 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2591/5131] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 22:10:46 2022] POST /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b/action => generated 0 bytes in 327 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 22:10:46.957114 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-bfe6fd69-3f4b-4c5d-be34-9248798fa238 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:10:46.974515 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bfe6fd69-3f4b-4c5d-be34-9248798fa238 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:46.975778 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bfe6fd69-3f4b-4c5d-be34-9248798fa238 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:46.976425 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bfe6fd69-3f4b-4c5d-be34-9248798fa238 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:47.102601 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-bfe6fd69-3f4b-4c5d-be34-9248798fa238 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 48243e1b-892b-4c4b-8db1-242b2e40653b] Going to try to stop instance {{(pid=134101) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 04 22:10:47.176402 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-bfe6fd69-3f4b-4c5d-be34-9248798fa238 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "POST /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b/action" status: 202 len: 0 microversion: 2.1 time: 0.221208 Oct 04 22:10:47.189757 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-e2f5cb92-e021-415f-9f6e-a72807b27efc tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:10:47.190673 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-e2f5cb92-e021-415f-9f6e-a72807b27efc tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 48243e1b-892b-4c4b-8db1-242b2e40653b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:10:47.193610 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2541/5132] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 22:10:46 2022] POST /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b/action => generated 0 bytes in 239 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 22:10:47.221460 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e2f5cb92-e021-415f-9f6e-a72807b27efc tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:47.222286 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e2f5cb92-e021-415f-9f6e-a72807b27efc tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:47.230489 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e2f5cb92-e021-415f-9f6e-a72807b27efc tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:47.232363 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e2f5cb92-e021-415f-9f6e-a72807b27efc tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:47.233058 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e2f5cb92-e021-415f-9f6e-a72807b27efc tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:47.234912 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e2f5cb92-e021-415f-9f6e-a72807b27efc tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:47.543603 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-e2f5cb92-e021-415f-9f6e-a72807b27efc tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:10:47.557981 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-e2f5cb92-e021-415f-9f6e-a72807b27efc tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b" status: 200 len: 1679 microversion: 2.1 time: 0.375715 Oct 04 22:10:47.559004 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2592/5133] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:10:47 2022] GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b => generated 1679 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:10:47.849371 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e5f16b0d-a6c5-428d-82b4-d4199650b38a tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:10:47.850098 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-e5f16b0d-a6c5-428d-82b4-d4199650b38a tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: 395434aa-4b24-4f4f-b83c-bb8870cd38b7] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:10:47.872675 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e5f16b0d-a6c5-428d-82b4-d4199650b38a tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:47.875409 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e5f16b0d-a6c5-428d-82b4-d4199650b38a tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:47.877690 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e5f16b0d-a6c5-428d-82b4-d4199650b38a tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:47.878669 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e5f16b0d-a6c5-428d-82b4-d4199650b38a tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:47.879661 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e5f16b0d-a6c5-428d-82b4-d4199650b38a tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:47.880443 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e5f16b0d-a6c5-428d-82b4-d4199650b38a tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:47.908107 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-e5f16b0d-a6c5-428d-82b4-d4199650b38a tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] HTTP exception thrown: Instance 395434aa-4b24-4f4f-b83c-bb8870cd38b7 could not be found. Oct 04 22:10:47.914560 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e5f16b0d-a6c5-428d-82b4-d4199650b38a tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Request method failure captured: Oct 04 22:10:47.914560 n-d-860284-1 devstack@n-api.service[134101]: request: GET /compute/v2.1/servers/395434aa-4b24-4f4f-b83c-bb8870cd38b7 HTTP/1.1 Oct 04 22:10:47.914560 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 22:10:47.914560 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 22:10:47.914560 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 22:10:47.914560 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 22:10:47.914560 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 22:10:47.914560 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 22:10:47.914560 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 22:10:47.914560 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 22:10:47.914560 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPK7MP0-m-xtUnxXwLoxlIfO4jzoQOT6GMi-_9Rz-dG646c6MuQMOjiOhGtcOohb2ZIUdejR42Va0IkiFMBDtdnbnUEdF8Psxz0uHfYGBQiEZpqo4CpOHPpz5KjUxS1LmPgcFnegJZtGQu1irxi49GMeHkm9nnXbxd63druWj1zFChJ4 Oct 04 22:10:47.914560 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 22:10:47.914560 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 22:10:47.914560 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 22:10:47.914560 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 22:10:47.914560 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 22:10:47.914560 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 22:10:47.914560 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: d4b00cd9fa8e40a0919b61fcd60269f5 Oct 04 22:10:47.914560 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-ServersTestJSON-1600369848 Oct 04 22:10:47.914560 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 22:10:47.914560 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 22:10:47.914560 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d4b00cd9fa8e40a0919b61fcd60269f5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_d4b00cd9fa8e40a0919b61fcd60269f5", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d4b00cd9fa8e40a0919b61fcd60269f5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/d4b00cd9fa8e40a0919b61fcd60269f5"}]}] Oct 04 22:10:47.914560 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-ServersTestJSON-1600369848 Oct 04 22:10:47.914560 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: d4b00cd9fa8e40a0919b61fcd60269f5 Oct 04 22:10:47.914560 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-ServersTestJSON-1600369848 Oct 04 22:10:47.914560 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-ServersTestJSON-1600369848-project Oct 04 22:10:47.914560 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 22:10:47.914560 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 22:10:47.914560 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 9c1682f1a60045d8a04d4d67393cd13f Oct 04 22:10:47.914560 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-ServersTestJSON-1600369848-project Oct 04 22:10:47.914560 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 22:10:47.914560 n-d-860284-1 devstack@n-api.service[134101]: exception: Instance 395434aa-4b24-4f4f-b83c-bb8870cd38b7 could not be found. Oct 04 22:10:47.914560 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': '395434aa-4b24-4f4f-b83c-bb8870cd38b7'} Oct 04 22:10:47.914560 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:10:47.914560 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:10:47.914560 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:10:47.914560 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:10:47.914560 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:10:47.914560 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:10:47.914560 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:10:47.914560 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:10:47.914560 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:10:47.914560 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:10:47.914560 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 395434aa-4b24-4f4f-b83c-bb8870cd38b7 could not be found. Oct 04 22:10:47.914560 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:10:47.914560 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:10:47.914560 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:10:47.914560 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:10:47.914560 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:10:47.914560 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:10:47.914560 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:10:47.914560 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:10:47.914560 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:10:47.914560 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:10:47.914560 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:10:47.914560 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:10:47.914560 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:10:47.914560 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:10:47.914560 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:10:47.914560 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:10:47.914560 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 395434aa-4b24-4f4f-b83c-bb8870cd38b7 could not be found. Oct 04 22:10:47.914560 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:10:47.914560 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:10:47.914560 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:10:47.922685 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:10:47.922685 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:10:47.922685 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:10:47.922685 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:10:47.922685 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:10:47.922685 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 395434aa-4b24-4f4f-b83c-bb8870cd38b7 could not be found. Oct 04 22:10:47.922685 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:10:47.925894 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e5f16b0d-a6c5-428d-82b4-d4199650b38a tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Returning 404 to user: Instance 395434aa-4b24-4f4f-b83c-bb8870cd38b7 could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:10:47.926921 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-e5f16b0d-a6c5-428d-82b4-d4199650b38a tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "GET /compute/v2.1/servers/395434aa-4b24-4f4f-b83c-bb8870cd38b7" status: 404 len: 111 microversion: 2.1 time: 0.083898 Oct 04 22:10:47.931007 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2542/5134] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:10:47 2022] GET /compute/v2.1/servers/395434aa-4b24-4f4f-b83c-bb8870cd38b7 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:10:47.936548 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-0e681267-9f7c-4097-81f8-c699f8c0b519 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:10:47.937794 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-0e681267-9f7c-4097-81f8-c699f8c0b519 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: bedf6a44-86ef-4673-8a8f-7541db6eeda7] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:10:47.949445 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0e681267-9f7c-4097-81f8-c699f8c0b519 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:47.949952 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0e681267-9f7c-4097-81f8-c699f8c0b519 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:47.953812 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0e681267-9f7c-4097-81f8-c699f8c0b519 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:47.954794 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0e681267-9f7c-4097-81f8-c699f8c0b519 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:47.955286 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0e681267-9f7c-4097-81f8-c699f8c0b519 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:47.955730 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0e681267-9f7c-4097-81f8-c699f8c0b519 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:48.014020 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-0e681267-9f7c-4097-81f8-c699f8c0b519 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: bedf6a44-86ef-4673-8a8f-7541db6eeda7] Going to try to terminate instance {{(pid=134102) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 22:10:48.291211 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-0e681267-9f7c-4097-81f8-c699f8c0b519 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "DELETE /compute/v2.1/servers/bedf6a44-86ef-4673-8a8f-7541db6eeda7" status: 204 len: 0 microversion: 2.1 time: 0.357661 Oct 04 22:10:48.293776 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2593/5135] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 22:10:47 2022] DELETE /compute/v2.1/servers/bedf6a44-86ef-4673-8a8f-7541db6eeda7 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 22:10:48.305402 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-d951abcc-8ae0-490d-bfad-679a49eb09d0 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:10:48.306501 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-d951abcc-8ae0-490d-bfad-679a49eb09d0 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: bedf6a44-86ef-4673-8a8f-7541db6eeda7] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:10:48.319399 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d951abcc-8ae0-490d-bfad-679a49eb09d0 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:48.321026 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d951abcc-8ae0-490d-bfad-679a49eb09d0 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:48.322023 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d951abcc-8ae0-490d-bfad-679a49eb09d0 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:48.323386 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d951abcc-8ae0-490d-bfad-679a49eb09d0 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:48.324037 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d951abcc-8ae0-490d-bfad-679a49eb09d0 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:48.334128 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d951abcc-8ae0-490d-bfad-679a49eb09d0 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:48.593363 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-efae3cba-e441-49ee-a98e-96afab8b7f36 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:10:48.594732 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-efae3cba-e441-49ee-a98e-96afab8b7f36 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 48243e1b-892b-4c4b-8db1-242b2e40653b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:10:48.617252 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-efae3cba-e441-49ee-a98e-96afab8b7f36 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:48.618896 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-efae3cba-e441-49ee-a98e-96afab8b7f36 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:48.620810 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-efae3cba-e441-49ee-a98e-96afab8b7f36 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:48.622724 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-efae3cba-e441-49ee-a98e-96afab8b7f36 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:48.623418 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-efae3cba-e441-49ee-a98e-96afab8b7f36 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:48.625444 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-efae3cba-e441-49ee-a98e-96afab8b7f36 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:48.794701 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-d951abcc-8ae0-490d-bfad-679a49eb09d0 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1682f1a60045d8a04d4d67393cd13f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b00cd9fa8e40a0919b61fcd60269f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:10:48.814547 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-d951abcc-8ae0-490d-bfad-679a49eb09d0 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "GET /compute/v2.1/servers/bedf6a44-86ef-4673-8a8f-7541db6eeda7" status: 200 len: 1497 microversion: 2.1 time: 0.512805 Oct 04 22:10:48.816715 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2543/5136] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:10:48 2022] GET /compute/v2.1/servers/bedf6a44-86ef-4673-8a8f-7541db6eeda7 => generated 1497 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:10:49.096077 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-efae3cba-e441-49ee-a98e-96afab8b7f36 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:10:49.138798 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-efae3cba-e441-49ee-a98e-96afab8b7f36 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b" status: 200 len: 1679 microversion: 2.1 time: 0.547713 Oct 04 22:10:49.140242 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2594/5137] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:10:48 2022] GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b => generated 1679 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:10:49.847429 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-cf48b11b-674a-48c0-b12f-93baaaae6921 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:10:49.848119 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-cf48b11b-674a-48c0-b12f-93baaaae6921 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: bedf6a44-86ef-4673-8a8f-7541db6eeda7] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:10:49.862683 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cf48b11b-674a-48c0-b12f-93baaaae6921 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:49.863262 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cf48b11b-674a-48c0-b12f-93baaaae6921 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:49.864751 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cf48b11b-674a-48c0-b12f-93baaaae6921 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:49.870118 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cf48b11b-674a-48c0-b12f-93baaaae6921 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:49.870373 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cf48b11b-674a-48c0-b12f-93baaaae6921 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:49.876299 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cf48b11b-674a-48c0-b12f-93baaaae6921 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:50.167718 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-da73c29f-281c-465f-9c04-2fb6c06e598c tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:10:50.170127 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-da73c29f-281c-465f-9c04-2fb6c06e598c tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 48243e1b-892b-4c4b-8db1-242b2e40653b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:10:50.180560 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-da73c29f-281c-465f-9c04-2fb6c06e598c tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:50.181238 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-da73c29f-281c-465f-9c04-2fb6c06e598c tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:50.181837 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-da73c29f-281c-465f-9c04-2fb6c06e598c tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:50.183021 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-da73c29f-281c-465f-9c04-2fb6c06e598c tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:50.183659 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-da73c29f-281c-465f-9c04-2fb6c06e598c tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:50.184205 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-da73c29f-281c-465f-9c04-2fb6c06e598c tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:50.206762 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-cf48b11b-674a-48c0-b12f-93baaaae6921 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1682f1a60045d8a04d4d67393cd13f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b00cd9fa8e40a0919b61fcd60269f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:10:50.224872 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-cf48b11b-674a-48c0-b12f-93baaaae6921 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "GET /compute/v2.1/servers/bedf6a44-86ef-4673-8a8f-7541db6eeda7" status: 200 len: 1497 microversion: 2.1 time: 0.384560 Oct 04 22:10:50.225472 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2544/5138] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:10:49 2022] GET /compute/v2.1/servers/bedf6a44-86ef-4673-8a8f-7541db6eeda7 => generated 1497 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:10:50.451464 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-da73c29f-281c-465f-9c04-2fb6c06e598c tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:10:50.461912 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-da73c29f-281c-465f-9c04-2fb6c06e598c tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b" status: 200 len: 1679 microversion: 2.1 time: 0.298746 Oct 04 22:10:50.465617 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2595/5139] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:10:50 2022] GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b => generated 1679 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:10:51.175876 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-e0b8c512-123d-4663-9b70-77bb25ed6a2b req-04a0af64-66dc-4bea-8631-a79aa5bdebd8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bedf6a44-86ef-4673-8a8f-7541db6eeda7", "name": "network-vif-deleted", "tag": "9470361c-e49a-4c6e-b434-6845f951ce31"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:10:51.215429 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-e0b8c512-123d-4663-9b70-77bb25ed6a2b req-04a0af64-66dc-4bea-8631-a79aa5bdebd8 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:51.217155 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-e0b8c512-123d-4663-9b70-77bb25ed6a2b req-04a0af64-66dc-4bea-8631-a79aa5bdebd8 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:51.218811 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-e0b8c512-123d-4663-9b70-77bb25ed6a2b req-04a0af64-66dc-4bea-8631-a79aa5bdebd8 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:51.241200 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-e0b8c512-123d-4663-9b70-77bb25ed6a2b req-04a0af64-66dc-4bea-8631-a79aa5bdebd8 service nova] Creating event network-vif-deleted:9470361c-e49a-4c6e-b434-6845f951ce31 for instance bedf6a44-86ef-4673-8a8f-7541db6eeda7 on n-h2-860284-1 Oct 04 22:10:51.250989 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-e0b8c512-123d-4663-9b70-77bb25ed6a2b req-04a0af64-66dc-4bea-8631-a79aa5bdebd8 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081229 Oct 04 22:10:51.252734 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2545/5140] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:10:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:10:51.254999 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-9465b901-77d9-42db-8fae-5e7abf56a39d tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:10:51.255399 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-9465b901-77d9-42db-8fae-5e7abf56a39d tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: bedf6a44-86ef-4673-8a8f-7541db6eeda7] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:10:51.271488 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9465b901-77d9-42db-8fae-5e7abf56a39d tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:51.272113 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9465b901-77d9-42db-8fae-5e7abf56a39d tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:51.272565 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9465b901-77d9-42db-8fae-5e7abf56a39d tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:51.273662 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9465b901-77d9-42db-8fae-5e7abf56a39d tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:51.274137 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9465b901-77d9-42db-8fae-5e7abf56a39d tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:51.275003 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9465b901-77d9-42db-8fae-5e7abf56a39d tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:51.492072 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-7266c300-13ab-4107-8c04-2c27b4013b08 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:10:51.497162 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-7266c300-13ab-4107-8c04-2c27b4013b08 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 48243e1b-892b-4c4b-8db1-242b2e40653b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:10:51.510566 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-9465b901-77d9-42db-8fae-5e7abf56a39d tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1682f1a60045d8a04d4d67393cd13f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b00cd9fa8e40a0919b61fcd60269f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:10:51.524403 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-9465b901-77d9-42db-8fae-5e7abf56a39d tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "GET /compute/v2.1/servers/bedf6a44-86ef-4673-8a8f-7541db6eeda7" status: 200 len: 1294 microversion: 2.1 time: 0.279207 Oct 04 22:10:51.524889 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7266c300-13ab-4107-8c04-2c27b4013b08 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:51.525434 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7266c300-13ab-4107-8c04-2c27b4013b08 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:51.525892 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7266c300-13ab-4107-8c04-2c27b4013b08 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:51.526651 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7266c300-13ab-4107-8c04-2c27b4013b08 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:51.528242 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7266c300-13ab-4107-8c04-2c27b4013b08 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:51.529418 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7266c300-13ab-4107-8c04-2c27b4013b08 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:51.532356 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2596/5141] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:10:51 2022] GET /compute/v2.1/servers/bedf6a44-86ef-4673-8a8f-7541db6eeda7 => generated 1294 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:10:52.234306 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-7266c300-13ab-4107-8c04-2c27b4013b08 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:10:52.251306 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-7266c300-13ab-4107-8c04-2c27b4013b08 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b" status: 200 len: 1679 microversion: 2.1 time: 0.764985 Oct 04 22:10:52.259995 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2546/5142] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:10:51 2022] GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b => generated 1679 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:10:52.562692 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-b7700054-7d49-4c8c-9112-9cb6aeab25a1 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:10:52.564288 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-b7700054-7d49-4c8c-9112-9cb6aeab25a1 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: bedf6a44-86ef-4673-8a8f-7541db6eeda7] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:10:52.575899 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b7700054-7d49-4c8c-9112-9cb6aeab25a1 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:52.577706 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b7700054-7d49-4c8c-9112-9cb6aeab25a1 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:52.578720 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b7700054-7d49-4c8c-9112-9cb6aeab25a1 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:52.579834 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b7700054-7d49-4c8c-9112-9cb6aeab25a1 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:52.580533 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b7700054-7d49-4c8c-9112-9cb6aeab25a1 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:52.581366 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b7700054-7d49-4c8c-9112-9cb6aeab25a1 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:52.623373 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-b7700054-7d49-4c8c-9112-9cb6aeab25a1 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] HTTP exception thrown: Instance bedf6a44-86ef-4673-8a8f-7541db6eeda7 could not be found. Oct 04 22:10:52.628821 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-b7700054-7d49-4c8c-9112-9cb6aeab25a1 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Request method failure captured: Oct 04 22:10:52.628821 n-d-860284-1 devstack@n-api.service[134102]: request: GET /compute/v2.1/servers/bedf6a44-86ef-4673-8a8f-7541db6eeda7 HTTP/1.1 Oct 04 22:10:52.628821 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 22:10:52.628821 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 22:10:52.628821 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 22:10:52.628821 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 22:10:52.628821 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 22:10:52.628821 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 22:10:52.628821 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 22:10:52.628821 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 22:10:52.628821 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPK7MP0-m-xtUnxXwLoxlIfO4jzoQOT6GMi-_9Rz-dG646c6MuQMOjiOhGtcOohb2ZIUdejR42Va0IkiFMBDtdnbnUEdF8Psxz0uHfYGBQiEZpqo4CpOHPpz5KjUxS1LmPgcFnegJZtGQu1irxi49GMeHkm9nnXbxd63druWj1zFChJ4 Oct 04 22:10:52.628821 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 22:10:52.628821 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 22:10:52.628821 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 22:10:52.628821 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 22:10:52.628821 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 22:10:52.628821 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 22:10:52.628821 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: d4b00cd9fa8e40a0919b61fcd60269f5 Oct 04 22:10:52.628821 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-ServersTestJSON-1600369848 Oct 04 22:10:52.628821 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 22:10:52.628821 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 22:10:52.628821 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d4b00cd9fa8e40a0919b61fcd60269f5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_d4b00cd9fa8e40a0919b61fcd60269f5", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d4b00cd9fa8e40a0919b61fcd60269f5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/d4b00cd9fa8e40a0919b61fcd60269f5"}]}] Oct 04 22:10:52.628821 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-ServersTestJSON-1600369848 Oct 04 22:10:52.628821 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: d4b00cd9fa8e40a0919b61fcd60269f5 Oct 04 22:10:52.628821 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-ServersTestJSON-1600369848 Oct 04 22:10:52.628821 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-ServersTestJSON-1600369848-project Oct 04 22:10:52.628821 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 22:10:52.628821 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 22:10:52.628821 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: 9c1682f1a60045d8a04d4d67393cd13f Oct 04 22:10:52.628821 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-ServersTestJSON-1600369848-project Oct 04 22:10:52.628821 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 22:10:52.628821 n-d-860284-1 devstack@n-api.service[134102]: exception: Instance bedf6a44-86ef-4673-8a8f-7541db6eeda7 could not be found. Oct 04 22:10:52.628821 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': 'bedf6a44-86ef-4673-8a8f-7541db6eeda7'} Oct 04 22:10:52.628821 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:10:52.628821 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:10:52.628821 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:10:52.628821 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:10:52.628821 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:10:52.628821 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:10:52.628821 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:10:52.628821 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:10:52.628821 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:10:52.628821 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:10:52.628821 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bedf6a44-86ef-4673-8a8f-7541db6eeda7 could not be found. Oct 04 22:10:52.628821 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:10:52.628821 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:10:52.628821 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:10:52.628821 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:10:52.628821 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:10:52.628821 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:10:52.628821 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:10:52.628821 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:10:52.628821 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:10:52.628821 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:10:52.628821 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:10:52.628821 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:10:52.628821 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:10:52.628821 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:10:52.628821 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:10:52.628821 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:10:52.628821 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bedf6a44-86ef-4673-8a8f-7541db6eeda7 could not be found. Oct 04 22:10:52.628821 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:10:52.628821 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:10:52.628821 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:10:52.635806 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:10:52.635806 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:10:52.635806 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:10:52.635806 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:10:52.635806 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:10:52.635806 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bedf6a44-86ef-4673-8a8f-7541db6eeda7 could not be found. Oct 04 22:10:52.635806 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:10:52.635806 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-b7700054-7d49-4c8c-9112-9cb6aeab25a1 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Returning 404 to user: Instance bedf6a44-86ef-4673-8a8f-7541db6eeda7 could not be found. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:10:52.637003 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-b7700054-7d49-4c8c-9112-9cb6aeab25a1 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "GET /compute/v2.1/servers/bedf6a44-86ef-4673-8a8f-7541db6eeda7" status: 404 len: 111 microversion: 2.1 time: 0.081281 Oct 04 22:10:52.637512 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2597/5143] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:10:52 2022] GET /compute/v2.1/servers/bedf6a44-86ef-4673-8a8f-7541db6eeda7 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:10:52.800696 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-b4ccf404-b9b0-46f5-a155-c0d8b79fd565 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1899288515", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452", "networks": [{"uuid": "3e97795f-9423-4034-b566-4a70497d6dcc"}]}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:10:52.918652 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.network.neutron [None req-b4ccf404-b9b0-46f5-a155-c0d8b79fd565 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] validate_networks() for [('3e97795f-9423-4034-b566-4a70497d6dcc', None, None, None, None, None)] {{(pid=134101) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 22:10:53.281476 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-000a0ea1-63d8-439e-924d-e96d5e0370c2 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:10:53.282099 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-000a0ea1-63d8-439e-924d-e96d5e0370c2 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 48243e1b-892b-4c4b-8db1-242b2e40653b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:10:53.289798 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-000a0ea1-63d8-439e-924d-e96d5e0370c2 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:53.290289 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-000a0ea1-63d8-439e-924d-e96d5e0370c2 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:53.290757 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-000a0ea1-63d8-439e-924d-e96d5e0370c2 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:53.291462 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-000a0ea1-63d8-439e-924d-e96d5e0370c2 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:53.291913 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-000a0ea1-63d8-439e-924d-e96d5e0370c2 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:53.292343 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-000a0ea1-63d8-439e-924d-e96d5e0370c2 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:53.836814 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-000a0ea1-63d8-439e-924d-e96d5e0370c2 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:10:53.850033 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-000a0ea1-63d8-439e-924d-e96d5e0370c2 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b" status: 200 len: 1679 microversion: 2.1 time: 0.573143 Oct 04 22:10:53.862514 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2598/5144] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:10:53 2022] GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b => generated 1679 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:10:54.141542 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-b4ccf404-b9b0-46f5-a155-c0d8b79fd565 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Flavor limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 22:10:54.142789 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-b4ccf404-b9b0-46f5-a155-c0d8b79fd565 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Image limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 22:10:54.143465 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-b4ccf404-b9b0-46f5-a155-c0d8b79fd565 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Flavor pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 22:10:54.144063 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-b4ccf404-b9b0-46f5-a155-c0d8b79fd565 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Image pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 22:10:54.144735 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-b4ccf404-b9b0-46f5-a155-c0d8b79fd565 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 22:10:54.159316 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b4ccf404-b9b0-46f5-a155-c0d8b79fd565 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:54.160885 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b4ccf404-b9b0-46f5-a155-c0d8b79fd565 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:54.162003 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b4ccf404-b9b0-46f5-a155-c0d8b79fd565 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:54.163046 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b4ccf404-b9b0-46f5-a155-c0d8b79fd565 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:54.163896 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b4ccf404-b9b0-46f5-a155-c0d8b79fd565 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:54.164551 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b4ccf404-b9b0-46f5-a155-c0d8b79fd565 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:54.189726 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-b4ccf404-b9b0-46f5-a155-c0d8b79fd565 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Getting quotas for project d4b00cd9fa8e40a0919b61fcd60269f5. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:10:54.197911 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-b4ccf404-b9b0-46f5-a155-c0d8b79fd565 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Getting quotas for user 9c1682f1a60045d8a04d4d67393cd13f and project d4b00cd9fa8e40a0919b61fcd60269f5. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:10:54.220286 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-b4ccf404-b9b0-46f5-a155-c0d8b79fd565 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Going to run 1 instances... {{(pid=134101) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 22:10:54.224435 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-b4ccf404-b9b0-46f5-a155-c0d8b79fd565 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: da7beaa4-0356-4315-bdcc-af5b9c1730a1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='58548514-5dac-426c-81f5-19e3fba33e23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134101) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 22:10:54.283365 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-b4ccf404-b9b0-46f5-a155-c0d8b79fd565 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.487539 Oct 04 22:10:54.296950 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-69f03340-4a3e-462c-9931-9bd1f24b02e8 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:10:54.297591 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-69f03340-4a3e-462c-9931-9bd1f24b02e8 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: da7beaa4-0356-4315-bdcc-af5b9c1730a1] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:10:54.300636 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2547/5145] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 22:10:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 1506 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 22:10:54.408121 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-69f03340-4a3e-462c-9931-9bd1f24b02e8 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1682f1a60045d8a04d4d67393cd13f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b00cd9fa8e40a0919b61fcd60269f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:10:54.416630 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-69f03340-4a3e-462c-9931-9bd1f24b02e8 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "GET /compute/v2.1/servers/da7beaa4-0356-4315-bdcc-af5b9c1730a1" status: 200 len: 1209 microversion: 2.1 time: 0.124344 Oct 04 22:10:54.430582 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2599/5146] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:10:54 2022] GET /compute/v2.1/servers/da7beaa4-0356-4315-bdcc-af5b9c1730a1 => generated 1209 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:10:54.876719 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-3423cc41-fbaf-473c-88cd-ab756495ecfc tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:10:54.877520 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-3423cc41-fbaf-473c-88cd-ab756495ecfc tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 48243e1b-892b-4c4b-8db1-242b2e40653b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:10:54.879999 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=3 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:10:54.899027 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3423cc41-fbaf-473c-88cd-ab756495ecfc tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:54.903069 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3423cc41-fbaf-473c-88cd-ab756495ecfc tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:54.903765 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3423cc41-fbaf-473c-88cd-ab756495ecfc tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:54.906818 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3423cc41-fbaf-473c-88cd-ab756495ecfc tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:54.907499 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3423cc41-fbaf-473c-88cd-ab756495ecfc tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:54.909593 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3423cc41-fbaf-473c-88cd-ab756495ecfc tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:55.323120 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-3423cc41-fbaf-473c-88cd-ab756495ecfc tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:10:55.334555 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-3423cc41-fbaf-473c-88cd-ab756495ecfc tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b" status: 200 len: 1679 microversion: 2.1 time: 0.462236 Oct 04 22:10:55.335456 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2548/5147] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:10:54 2022] GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b => generated 1679 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:10:55.445372 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-4b367971-f9c3-48bc-bddc-1c5350b13ef7 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:10:55.446760 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-4b367971-f9c3-48bc-bddc-1c5350b13ef7 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: da7beaa4-0356-4315-bdcc-af5b9c1730a1] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:10:55.465038 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4b367971-f9c3-48bc-bddc-1c5350b13ef7 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:55.465574 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4b367971-f9c3-48bc-bddc-1c5350b13ef7 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:55.469209 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4b367971-f9c3-48bc-bddc-1c5350b13ef7 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:55.471814 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4b367971-f9c3-48bc-bddc-1c5350b13ef7 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:55.472510 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4b367971-f9c3-48bc-bddc-1c5350b13ef7 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:55.472954 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4b367971-f9c3-48bc-bddc-1c5350b13ef7 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:55.597992 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-4b367971-f9c3-48bc-bddc-1c5350b13ef7 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1682f1a60045d8a04d4d67393cd13f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b00cd9fa8e40a0919b61fcd60269f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:10:55.618657 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-4b367971-f9c3-48bc-bddc-1c5350b13ef7 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "GET /compute/v2.1/servers/da7beaa4-0356-4315-bdcc-af5b9c1730a1" status: 200 len: 1261 microversion: 2.1 time: 0.181067 Oct 04 22:10:55.619266 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2600/5148] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:10:55 2022] GET /compute/v2.1/servers/da7beaa4-0356-4315-bdcc-af5b9c1730a1 => generated 1261 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:10:56.360706 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-29a3d150-5f15-4b65-9b72-f827344de10a tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:10:56.361435 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-29a3d150-5f15-4b65-9b72-f827344de10a tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 48243e1b-892b-4c4b-8db1-242b2e40653b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:10:56.372738 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-29a3d150-5f15-4b65-9b72-f827344de10a tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:56.373630 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-29a3d150-5f15-4b65-9b72-f827344de10a tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:56.374505 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-29a3d150-5f15-4b65-9b72-f827344de10a tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:56.376082 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-29a3d150-5f15-4b65-9b72-f827344de10a tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:56.376807 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-29a3d150-5f15-4b65-9b72-f827344de10a tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:56.377488 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-29a3d150-5f15-4b65-9b72-f827344de10a tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:56.648340 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-978d0845-b700-4ec8-9339-04ab1e33fd0a tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:10:56.648977 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-978d0845-b700-4ec8-9339-04ab1e33fd0a tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: da7beaa4-0356-4315-bdcc-af5b9c1730a1] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:10:56.662934 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-978d0845-b700-4ec8-9339-04ab1e33fd0a tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:56.664555 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-978d0845-b700-4ec8-9339-04ab1e33fd0a tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:56.665183 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-978d0845-b700-4ec8-9339-04ab1e33fd0a tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:56.666819 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-978d0845-b700-4ec8-9339-04ab1e33fd0a tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:56.667979 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-978d0845-b700-4ec8-9339-04ab1e33fd0a tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:56.668620 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-978d0845-b700-4ec8-9339-04ab1e33fd0a tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:56.785781 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-978d0845-b700-4ec8-9339-04ab1e33fd0a tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1682f1a60045d8a04d4d67393cd13f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b00cd9fa8e40a0919b61fcd60269f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:10:56.796417 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-978d0845-b700-4ec8-9339-04ab1e33fd0a tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "GET /compute/v2.1/servers/da7beaa4-0356-4315-bdcc-af5b9c1730a1" status: 200 len: 1267 microversion: 2.1 time: 0.153964 Oct 04 22:10:56.797818 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2601/5149] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:10:56 2022] GET /compute/v2.1/servers/da7beaa4-0356-4315-bdcc-af5b9c1730a1 => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:10:56.954320 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-29a3d150-5f15-4b65-9b72-f827344de10a tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:10:56.968604 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-29a3d150-5f15-4b65-9b72-f827344de10a tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b" status: 200 len: 1679 microversion: 2.1 time: 0.612228 Oct 04 22:10:56.989889 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2549/5150] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:10:56 2022] GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b => generated 1679 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:10:57.824493 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-ead38d69-6d12-425f-ac05-ea8f364d7926 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:10:57.826037 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-ead38d69-6d12-425f-ac05-ea8f364d7926 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: da7beaa4-0356-4315-bdcc-af5b9c1730a1] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:10:57.837421 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ead38d69-6d12-425f-ac05-ea8f364d7926 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:57.838295 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ead38d69-6d12-425f-ac05-ea8f364d7926 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:57.838977 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ead38d69-6d12-425f-ac05-ea8f364d7926 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:57.840465 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ead38d69-6d12-425f-ac05-ea8f364d7926 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:57.841202 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ead38d69-6d12-425f-ac05-ea8f364d7926 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:57.841821 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ead38d69-6d12-425f-ac05-ea8f364d7926 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:58.006179 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-0280cf2b-f48a-4846-ac25-369a5326ed42 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:10:58.007306 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-0280cf2b-f48a-4846-ac25-369a5326ed42 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 48243e1b-892b-4c4b-8db1-242b2e40653b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:10:58.027290 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0280cf2b-f48a-4846-ac25-369a5326ed42 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:58.027702 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0280cf2b-f48a-4846-ac25-369a5326ed42 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:58.028160 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0280cf2b-f48a-4846-ac25-369a5326ed42 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:58.029524 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0280cf2b-f48a-4846-ac25-369a5326ed42 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:58.030505 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0280cf2b-f48a-4846-ac25-369a5326ed42 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:58.030988 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0280cf2b-f48a-4846-ac25-369a5326ed42 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:58.283164 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-ead38d69-6d12-425f-ac05-ea8f364d7926 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1682f1a60045d8a04d4d67393cd13f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b00cd9fa8e40a0919b61fcd60269f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:10:58.337923 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-ead38d69-6d12-425f-ac05-ea8f364d7926 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "GET /compute/v2.1/servers/da7beaa4-0356-4315-bdcc-af5b9c1730a1" status: 200 len: 1309 microversion: 2.1 time: 0.520992 Oct 04 22:10:58.340686 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2602/5151] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:10:57 2022] GET /compute/v2.1/servers/da7beaa4-0356-4315-bdcc-af5b9c1730a1 => generated 1309 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:10:58.373444 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-0280cf2b-f48a-4846-ac25-369a5326ed42 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:10:58.382926 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-0280cf2b-f48a-4846-ac25-369a5326ed42 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b" status: 200 len: 1656 microversion: 2.1 time: 0.384960 Oct 04 22:10:58.395008 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2550/5152] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:10:57 2022] GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b => generated 1656 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:10:58.408057 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-e50cb433-5ab0-4c5e-b4fd-df806fe0efb6 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:10:58.415313 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e50cb433-5ab0-4c5e-b4fd-df806fe0efb6 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:58.416098 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e50cb433-5ab0-4c5e-b4fd-df806fe0efb6 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:58.416702 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e50cb433-5ab0-4c5e-b4fd-df806fe0efb6 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:58.465774 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-e50cb433-5ab0-4c5e-b4fd-df806fe0efb6 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 48243e1b-892b-4c4b-8db1-242b2e40653b] Going to try to start instance {{(pid=134102) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 04 22:10:58.540976 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-e50cb433-5ab0-4c5e-b4fd-df806fe0efb6 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "POST /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b/action" status: 202 len: 0 microversion: 2.1 time: 0.135051 Oct 04 22:10:58.558109 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2603/5153] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 22:10:58 2022] POST /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b/action => generated 0 bytes in 156 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 22:10:58.570115 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-acceef5b-6128-4541-af47-f9cb97f3e43e tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:10:58.572821 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-acceef5b-6128-4541-af47-f9cb97f3e43e tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 48243e1b-892b-4c4b-8db1-242b2e40653b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:10:58.593123 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-acceef5b-6128-4541-af47-f9cb97f3e43e tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:58.596509 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-acceef5b-6128-4541-af47-f9cb97f3e43e tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:58.598398 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-acceef5b-6128-4541-af47-f9cb97f3e43e tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:58.600061 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-acceef5b-6128-4541-af47-f9cb97f3e43e tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:58.603037 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-acceef5b-6128-4541-af47-f9cb97f3e43e tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:58.603645 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-acceef5b-6128-4541-af47-f9cb97f3e43e tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:58.826387 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-8ccb2f55-ffab-4fec-a176-2d18834e4e30 req-16f084d2-fa73-4e43-9d8e-ada69c37fea2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da7beaa4-0356-4315-bdcc-af5b9c1730a1", "tag": "81ae2823-3716-40c5-a83a-05542f96a870"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:10:58.864526 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-8ccb2f55-ffab-4fec-a176-2d18834e4e30 req-16f084d2-fa73-4e43-9d8e-ada69c37fea2 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:58.865007 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-8ccb2f55-ffab-4fec-a176-2d18834e4e30 req-16f084d2-fa73-4e43-9d8e-ada69c37fea2 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:58.868798 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-8ccb2f55-ffab-4fec-a176-2d18834e4e30 req-16f084d2-fa73-4e43-9d8e-ada69c37fea2 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:58.904509 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-8ccb2f55-ffab-4fec-a176-2d18834e4e30 req-16f084d2-fa73-4e43-9d8e-ada69c37fea2 service nova] Creating event network-changed:81ae2823-3716-40c5-a83a-05542f96a870 for instance da7beaa4-0356-4315-bdcc-af5b9c1730a1 on n-h2-860284-1 Oct 04 22:10:58.910701 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-8ccb2f55-ffab-4fec-a176-2d18834e4e30 req-16f084d2-fa73-4e43-9d8e-ada69c37fea2 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089924 Oct 04 22:10:58.912120 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2604/5154] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:10:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:10:59.023678 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-acceef5b-6128-4541-af47-f9cb97f3e43e tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:10:59.034346 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-acceef5b-6128-4541-af47-f9cb97f3e43e tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b" status: 200 len: 1665 microversion: 2.1 time: 0.477655 Oct 04 22:10:59.035678 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2551/5155] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:10:58 2022] GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b => generated 1665 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:10:59.370034 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-4d46f9da-c742-4ba3-a7c2-c88a196ebb28 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:10:59.370756 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-4d46f9da-c742-4ba3-a7c2-c88a196ebb28 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: da7beaa4-0356-4315-bdcc-af5b9c1730a1] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:10:59.389879 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4d46f9da-c742-4ba3-a7c2-c88a196ebb28 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:59.392043 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4d46f9da-c742-4ba3-a7c2-c88a196ebb28 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:59.392583 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4d46f9da-c742-4ba3-a7c2-c88a196ebb28 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:59.396083 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4d46f9da-c742-4ba3-a7c2-c88a196ebb28 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:59.396083 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4d46f9da-c742-4ba3-a7c2-c88a196ebb28 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:59.396890 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4d46f9da-c742-4ba3-a7c2-c88a196ebb28 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:00.015113 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-4d46f9da-c742-4ba3-a7c2-c88a196ebb28 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1682f1a60045d8a04d4d67393cd13f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b00cd9fa8e40a0919b61fcd60269f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:11:00.033308 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-4d46f9da-c742-4ba3-a7c2-c88a196ebb28 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "GET /compute/v2.1/servers/da7beaa4-0356-4315-bdcc-af5b9c1730a1" status: 200 len: 1309 microversion: 2.1 time: 0.667593 Oct 04 22:11:00.034245 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2605/5156] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:10:59 2022] GET /compute/v2.1/servers/da7beaa4-0356-4315-bdcc-af5b9c1730a1 => generated 1309 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:11:00.067765 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-d5e8e336-fd4c-42a4-b5c3-75ed04514a5b tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:11:00.068387 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-d5e8e336-fd4c-42a4-b5c3-75ed04514a5b tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 48243e1b-892b-4c4b-8db1-242b2e40653b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:11:00.075792 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d5e8e336-fd4c-42a4-b5c3-75ed04514a5b tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:00.076278 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d5e8e336-fd4c-42a4-b5c3-75ed04514a5b tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:00.077631 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d5e8e336-fd4c-42a4-b5c3-75ed04514a5b tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:00.082783 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d5e8e336-fd4c-42a4-b5c3-75ed04514a5b tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:00.083605 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d5e8e336-fd4c-42a4-b5c3-75ed04514a5b tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:00.084276 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d5e8e336-fd4c-42a4-b5c3-75ed04514a5b tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:00.361829 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-d5e8e336-fd4c-42a4-b5c3-75ed04514a5b tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:11:00.370514 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-d5e8e336-fd4c-42a4-b5c3-75ed04514a5b tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b" status: 200 len: 1665 microversion: 2.1 time: 0.308134 Oct 04 22:11:00.372267 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2552/5157] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:11:00 2022] GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b => generated 1665 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:11:01.058263 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-9694c586-f30e-4084-af1f-2b13d08b9e1f tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:11:01.059088 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-9694c586-f30e-4084-af1f-2b13d08b9e1f tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: da7beaa4-0356-4315-bdcc-af5b9c1730a1] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:11:01.062985 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=2 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:11:01.069330 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9694c586-f30e-4084-af1f-2b13d08b9e1f tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:01.070102 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9694c586-f30e-4084-af1f-2b13d08b9e1f tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:01.070741 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9694c586-f30e-4084-af1f-2b13d08b9e1f tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:01.071675 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9694c586-f30e-4084-af1f-2b13d08b9e1f tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:01.072333 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9694c586-f30e-4084-af1f-2b13d08b9e1f tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:01.072761 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9694c586-f30e-4084-af1f-2b13d08b9e1f tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:01.320641 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-9694c586-f30e-4084-af1f-2b13d08b9e1f tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1682f1a60045d8a04d4d67393cd13f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b00cd9fa8e40a0919b61fcd60269f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:11:01.332625 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-9694c586-f30e-4084-af1f-2b13d08b9e1f tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "GET /compute/v2.1/servers/da7beaa4-0356-4315-bdcc-af5b9c1730a1" status: 200 len: 1309 microversion: 2.1 time: 0.278219 Oct 04 22:11:01.337166 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2606/5158] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:11:01 2022] GET /compute/v2.1/servers/da7beaa4-0356-4315-bdcc-af5b9c1730a1 => generated 1309 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:11:01.407328 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-1707f232-01e0-40cb-b017-3385e666e8d8 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:11:01.408354 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-1707f232-01e0-40cb-b017-3385e666e8d8 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 48243e1b-892b-4c4b-8db1-242b2e40653b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:11:01.458077 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1707f232-01e0-40cb-b017-3385e666e8d8 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:01.458860 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1707f232-01e0-40cb-b017-3385e666e8d8 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:01.463953 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1707f232-01e0-40cb-b017-3385e666e8d8 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:01.465495 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1707f232-01e0-40cb-b017-3385e666e8d8 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:01.466419 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1707f232-01e0-40cb-b017-3385e666e8d8 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:01.467829 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1707f232-01e0-40cb-b017-3385e666e8d8 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:02.126009 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-1707f232-01e0-40cb-b017-3385e666e8d8 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:11:02.139908 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-1707f232-01e0-40cb-b017-3385e666e8d8 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b" status: 200 len: 1669 microversion: 2.1 time: 0.745453 Oct 04 22:11:02.140534 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2553/5159] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:11:01 2022] GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b => generated 1669 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:11:02.180615 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-3460d1ef-ac4d-482e-a81d-54ed5c910fa4 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:11:02.181577 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-3460d1ef-ac4d-482e-a81d-54ed5c910fa4 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 48243e1b-892b-4c4b-8db1-242b2e40653b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:11:02.192955 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3460d1ef-ac4d-482e-a81d-54ed5c910fa4 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:02.193899 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3460d1ef-ac4d-482e-a81d-54ed5c910fa4 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:02.197411 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3460d1ef-ac4d-482e-a81d-54ed5c910fa4 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:02.197411 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3460d1ef-ac4d-482e-a81d-54ed5c910fa4 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:02.197411 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3460d1ef-ac4d-482e-a81d-54ed5c910fa4 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:02.197411 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3460d1ef-ac4d-482e-a81d-54ed5c910fa4 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:02.366626 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-891344e9-7687-43bd-9c20-00a626db7c15 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:11:02.367876 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-891344e9-7687-43bd-9c20-00a626db7c15 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: da7beaa4-0356-4315-bdcc-af5b9c1730a1] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:11:02.376105 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-891344e9-7687-43bd-9c20-00a626db7c15 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:02.377037 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-891344e9-7687-43bd-9c20-00a626db7c15 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:02.378157 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-891344e9-7687-43bd-9c20-00a626db7c15 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:02.379778 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-891344e9-7687-43bd-9c20-00a626db7c15 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:02.380728 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-891344e9-7687-43bd-9c20-00a626db7c15 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:02.381286 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-891344e9-7687-43bd-9c20-00a626db7c15 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:02.596773 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-3460d1ef-ac4d-482e-a81d-54ed5c910fa4 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:11:02.610838 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-3460d1ef-ac4d-482e-a81d-54ed5c910fa4 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b" status: 200 len: 1669 microversion: 2.1 time: 0.436975 Oct 04 22:11:02.611460 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2607/5160] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:11:02 2022] GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b => generated 1669 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:11:02.646609 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-356a4ed6-40ca-469a-83f0-44c9f52fc0e9 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:11:02.655574 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-356a4ed6-40ca-469a-83f0-44c9f52fc0e9 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 48243e1b-892b-4c4b-8db1-242b2e40653b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:11:02.672945 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-356a4ed6-40ca-469a-83f0-44c9f52fc0e9 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:02.678322 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-356a4ed6-40ca-469a-83f0-44c9f52fc0e9 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:02.680145 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-356a4ed6-40ca-469a-83f0-44c9f52fc0e9 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:02.681578 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-356a4ed6-40ca-469a-83f0-44c9f52fc0e9 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:02.685450 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-356a4ed6-40ca-469a-83f0-44c9f52fc0e9 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:02.688320 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-356a4ed6-40ca-469a-83f0-44c9f52fc0e9 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:02.697569 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=95,nova_cell1:INSERT=2 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:11:02.825607 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-356a4ed6-40ca-469a-83f0-44c9f52fc0e9 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 48243e1b-892b-4c4b-8db1-242b2e40653b] Unlocking {{(pid=134102) unlock /opt/stack/nova/nova/compute/api.py:4874}} Oct 04 22:11:02.856144 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-891344e9-7687-43bd-9c20-00a626db7c15 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1682f1a60045d8a04d4d67393cd13f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b00cd9fa8e40a0919b61fcd60269f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:11:02.890170 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-891344e9-7687-43bd-9c20-00a626db7c15 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "GET /compute/v2.1/servers/da7beaa4-0356-4315-bdcc-af5b9c1730a1" status: 200 len: 1309 microversion: 2.1 time: 0.526556 Oct 04 22:11:02.930228 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2554/5161] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:11:02 2022] GET /compute/v2.1/servers/da7beaa4-0356-4315-bdcc-af5b9c1730a1 => generated 1309 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:11:02.972980 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-356a4ed6-40ca-469a-83f0-44c9f52fc0e9 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "POST /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b/action" status: 202 len: 0 microversion: 2.1 time: 0.340266 Oct 04 22:11:02.973995 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2608/5162] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 22:11:02 2022] POST /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b/action => generated 0 bytes in 344 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 22:11:02.984626 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-8e0f93ad-579c-4435-a4fb-25e2499db3ce tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:11:02.985394 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-8e0f93ad-579c-4435-a4fb-25e2499db3ce tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 48243e1b-892b-4c4b-8db1-242b2e40653b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:11:03.013750 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8e0f93ad-579c-4435-a4fb-25e2499db3ce tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:03.031848 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8e0f93ad-579c-4435-a4fb-25e2499db3ce tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:03.033519 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8e0f93ad-579c-4435-a4fb-25e2499db3ce tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:03.037086 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8e0f93ad-579c-4435-a4fb-25e2499db3ce tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:03.041202 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8e0f93ad-579c-4435-a4fb-25e2499db3ce tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:03.043452 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8e0f93ad-579c-4435-a4fb-25e2499db3ce tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:03.611939 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-8e0f93ad-579c-4435-a4fb-25e2499db3ce tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:11:03.625383 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-8e0f93ad-579c-4435-a4fb-25e2499db3ce tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b" status: 200 len: 1669 microversion: 2.1 time: 0.645003 Oct 04 22:11:03.626982 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2555/5163] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:11:02 2022] GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b => generated 1669 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:11:03.675585 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-850d11a9-0032-489f-ab76-322cdd8a82c6 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:11:03.676628 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-850d11a9-0032-489f-ab76-322cdd8a82c6 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 48243e1b-892b-4c4b-8db1-242b2e40653b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:11:03.698617 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-850d11a9-0032-489f-ab76-322cdd8a82c6 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:03.700147 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-850d11a9-0032-489f-ab76-322cdd8a82c6 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:03.703075 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-850d11a9-0032-489f-ab76-322cdd8a82c6 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:03.705181 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-850d11a9-0032-489f-ab76-322cdd8a82c6 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:03.709441 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-850d11a9-0032-489f-ab76-322cdd8a82c6 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:03.711926 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-850d11a9-0032-489f-ab76-322cdd8a82c6 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:03.937854 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-97ddf48b-9b49-497f-a9bb-e998a95a0bdc tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:11:03.938743 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-97ddf48b-9b49-497f-a9bb-e998a95a0bdc tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: da7beaa4-0356-4315-bdcc-af5b9c1730a1] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:11:03.946560 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-97ddf48b-9b49-497f-a9bb-e998a95a0bdc tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:03.947376 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-97ddf48b-9b49-497f-a9bb-e998a95a0bdc tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:03.947814 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-97ddf48b-9b49-497f-a9bb-e998a95a0bdc tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:03.948723 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-97ddf48b-9b49-497f-a9bb-e998a95a0bdc tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:03.949348 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-97ddf48b-9b49-497f-a9bb-e998a95a0bdc tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:03.950115 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-97ddf48b-9b49-497f-a9bb-e998a95a0bdc tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:03.959006 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-850d11a9-0032-489f-ab76-322cdd8a82c6 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:11:03.974909 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-850d11a9-0032-489f-ab76-322cdd8a82c6 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b" status: 200 len: 1669 microversion: 2.1 time: 0.309275 Oct 04 22:11:03.976465 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2609/5164] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:11:03 2022] GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b => generated 1669 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:11:04.005380 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-f9846019-904d-4b50-af9a-500abef990c1 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:11:04.006313 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-f9846019-904d-4b50-af9a-500abef990c1 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 48243e1b-892b-4c4b-8db1-242b2e40653b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:11:04.014847 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f9846019-904d-4b50-af9a-500abef990c1 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:04.015744 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f9846019-904d-4b50-af9a-500abef990c1 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:04.016638 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f9846019-904d-4b50-af9a-500abef990c1 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:04.017676 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f9846019-904d-4b50-af9a-500abef990c1 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:04.018320 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f9846019-904d-4b50-af9a-500abef990c1 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:04.019569 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f9846019-904d-4b50-af9a-500abef990c1 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:04.179270 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=2 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:11:04.211020 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=6 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:11:04.257266 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-97ddf48b-9b49-497f-a9bb-e998a95a0bdc tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1682f1a60045d8a04d4d67393cd13f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b00cd9fa8e40a0919b61fcd60269f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:11:04.260572 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-f9846019-904d-4b50-af9a-500abef990c1 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:11:04.270224 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-f9846019-904d-4b50-af9a-500abef990c1 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b" status: 200 len: 1669 microversion: 2.1 time: 0.273116 Oct 04 22:11:04.271552 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2610/5165] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:11:03 2022] GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b => generated 1669 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:11:04.272836 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-97ddf48b-9b49-497f-a9bb-e998a95a0bdc tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "GET /compute/v2.1/servers/da7beaa4-0356-4315-bdcc-af5b9c1730a1" status: 200 len: 1309 microversion: 2.1 time: 0.339163 Oct 04 22:11:04.274136 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2556/5166] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:11:03 2022] GET /compute/v2.1/servers/da7beaa4-0356-4315-bdcc-af5b9c1730a1 => generated 1309 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:11:04.294767 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-a44d1f64-dd5c-435b-a15a-eefd1977def8 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:11:04.296255 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-a44d1f64-dd5c-435b-a15a-eefd1977def8 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 48243e1b-892b-4c4b-8db1-242b2e40653b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:11:04.303319 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a44d1f64-dd5c-435b-a15a-eefd1977def8 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:04.304153 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a44d1f64-dd5c-435b-a15a-eefd1977def8 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:04.304827 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a44d1f64-dd5c-435b-a15a-eefd1977def8 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:04.305879 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a44d1f64-dd5c-435b-a15a-eefd1977def8 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:04.306669 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a44d1f64-dd5c-435b-a15a-eefd1977def8 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:04.307405 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a44d1f64-dd5c-435b-a15a-eefd1977def8 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:04.407329 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-a44d1f64-dd5c-435b-a15a-eefd1977def8 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "POST /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b/action" status: 202 len: 0 microversion: 2.1 time: 0.116158 Oct 04 22:11:04.412915 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2611/5167] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 22:11:04 2022] POST /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b/action => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 22:11:04.424626 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-bcae275f-20cb-4558-86f4-321cccdac7af tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:11:04.425799 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-bcae275f-20cb-4558-86f4-321cccdac7af tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 48243e1b-892b-4c4b-8db1-242b2e40653b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:11:04.436515 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bcae275f-20cb-4558-86f4-321cccdac7af tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:04.437353 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bcae275f-20cb-4558-86f4-321cccdac7af tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:04.437797 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bcae275f-20cb-4558-86f4-321cccdac7af tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:04.438606 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bcae275f-20cb-4558-86f4-321cccdac7af tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:04.439244 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bcae275f-20cb-4558-86f4-321cccdac7af tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:04.440544 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bcae275f-20cb-4558-86f4-321cccdac7af tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:04.644134 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-bcae275f-20cb-4558-86f4-321cccdac7af tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:11:04.649122 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:11:04.666019 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-bcae275f-20cb-4558-86f4-321cccdac7af tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b" status: 200 len: 1674 microversion: 2.1 time: 0.251806 Oct 04 22:11:04.667336 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2557/5168] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:11:04 2022] GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b => generated 1674 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:11:05.299907 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-e77e441c-b5bc-4041-92e7-c144f736db7c tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:11:05.300727 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-e77e441c-b5bc-4041-92e7-c144f736db7c tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: da7beaa4-0356-4315-bdcc-af5b9c1730a1] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:11:05.303877 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell0:SELECT=2 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:11:05.309765 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e77e441c-b5bc-4041-92e7-c144f736db7c tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:05.310940 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e77e441c-b5bc-4041-92e7-c144f736db7c tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:05.310940 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e77e441c-b5bc-4041-92e7-c144f736db7c tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:05.312377 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e77e441c-b5bc-4041-92e7-c144f736db7c tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:05.312377 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e77e441c-b5bc-4041-92e7-c144f736db7c tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:05.312860 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e77e441c-b5bc-4041-92e7-c144f736db7c tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:05.594598 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-e77e441c-b5bc-4041-92e7-c144f736db7c tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1682f1a60045d8a04d4d67393cd13f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b00cd9fa8e40a0919b61fcd60269f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:11:05.610156 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-e77e441c-b5bc-4041-92e7-c144f736db7c tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "GET /compute/v2.1/servers/da7beaa4-0356-4315-bdcc-af5b9c1730a1" status: 200 len: 1309 microversion: 2.1 time: 0.314567 Oct 04 22:11:05.623552 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2612/5169] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:11:05 2022] GET /compute/v2.1/servers/da7beaa4-0356-4315-bdcc-af5b9c1730a1 => generated 1309 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:11:05.698151 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-67c3ece8-1baf-4c86-93b2-2c488410452a tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:11:05.699727 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-67c3ece8-1baf-4c86-93b2-2c488410452a tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 48243e1b-892b-4c4b-8db1-242b2e40653b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:11:05.717360 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-67c3ece8-1baf-4c86-93b2-2c488410452a tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:05.717904 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-67c3ece8-1baf-4c86-93b2-2c488410452a tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:05.719357 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-67c3ece8-1baf-4c86-93b2-2c488410452a tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:05.720323 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-67c3ece8-1baf-4c86-93b2-2c488410452a tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:05.721041 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-67c3ece8-1baf-4c86-93b2-2c488410452a tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:05.722679 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-67c3ece8-1baf-4c86-93b2-2c488410452a tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:06.104617 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-67c3ece8-1baf-4c86-93b2-2c488410452a tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:11:06.121228 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-67c3ece8-1baf-4c86-93b2-2c488410452a tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b" status: 200 len: 1654 microversion: 2.1 time: 0.429549 Oct 04 22:11:06.125789 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2558/5170] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:11:05 2022] GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b => generated 1654 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:11:06.156437 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-b226c89b-5019-44ca-ab3a-6ac5948832d6 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:11:06.157019 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-b226c89b-5019-44ca-ab3a-6ac5948832d6 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 48243e1b-892b-4c4b-8db1-242b2e40653b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:11:06.164725 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b226c89b-5019-44ca-ab3a-6ac5948832d6 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:06.165233 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b226c89b-5019-44ca-ab3a-6ac5948832d6 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:06.165879 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b226c89b-5019-44ca-ab3a-6ac5948832d6 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:06.167111 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b226c89b-5019-44ca-ab3a-6ac5948832d6 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:06.167765 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b226c89b-5019-44ca-ab3a-6ac5948832d6 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:06.168947 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b226c89b-5019-44ca-ab3a-6ac5948832d6 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:06.302905 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-b226c89b-5019-44ca-ab3a-6ac5948832d6 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "POST /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b/action" status: 202 len: 0 microversion: 2.1 time: 0.151983 Oct 04 22:11:06.315703 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-b922270f-c7b2-440a-9396-33cb16a5ab72 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:11:06.317257 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-b922270f-c7b2-440a-9396-33cb16a5ab72 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 48243e1b-892b-4c4b-8db1-242b2e40653b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:11:06.320814 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2613/5171] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 22:11:06 2022] POST /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b/action => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 22:11:06.327791 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b922270f-c7b2-440a-9396-33cb16a5ab72 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:06.328634 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b922270f-c7b2-440a-9396-33cb16a5ab72 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:06.329442 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b922270f-c7b2-440a-9396-33cb16a5ab72 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:06.331048 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b922270f-c7b2-440a-9396-33cb16a5ab72 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:06.331724 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b922270f-c7b2-440a-9396-33cb16a5ab72 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:06.332384 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b922270f-c7b2-440a-9396-33cb16a5ab72 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:06.638272 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-02be643a-d5f8-4d79-b00f-8fdce2811965 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:11:06.640360 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-02be643a-d5f8-4d79-b00f-8fdce2811965 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: da7beaa4-0356-4315-bdcc-af5b9c1730a1] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:11:06.659245 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-02be643a-d5f8-4d79-b00f-8fdce2811965 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:06.660071 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-02be643a-d5f8-4d79-b00f-8fdce2811965 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:06.660693 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-02be643a-d5f8-4d79-b00f-8fdce2811965 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:06.662121 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-02be643a-d5f8-4d79-b00f-8fdce2811965 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:06.662875 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-02be643a-d5f8-4d79-b00f-8fdce2811965 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:06.663624 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-02be643a-d5f8-4d79-b00f-8fdce2811965 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:06.759532 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-b922270f-c7b2-440a-9396-33cb16a5ab72 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:11:06.770169 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-b922270f-c7b2-440a-9396-33cb16a5ab72 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b" status: 200 len: 1661 microversion: 2.1 time: 0.459709 Oct 04 22:11:06.771315 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2559/5172] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:11:06 2022] GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b => generated 1661 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:11:06.947487 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-02be643a-d5f8-4d79-b00f-8fdce2811965 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1682f1a60045d8a04d4d67393cd13f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b00cd9fa8e40a0919b61fcd60269f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:11:06.958570 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-02be643a-d5f8-4d79-b00f-8fdce2811965 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "GET /compute/v2.1/servers/da7beaa4-0356-4315-bdcc-af5b9c1730a1" status: 200 len: 1309 microversion: 2.1 time: 0.326190 Oct 04 22:11:06.959903 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2614/5173] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:11:06 2022] GET /compute/v2.1/servers/da7beaa4-0356-4315-bdcc-af5b9c1730a1 => generated 1309 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:11:07.246739 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-d6019245-d4db-43b5-a652-4fe19e56e68b req-2a62704f-2cf9-4f62-aedd-0e21b234ba19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da7beaa4-0356-4315-bdcc-af5b9c1730a1", "name": "network-vif-plugged", "status": "completed", "tag": "81ae2823-3716-40c5-a83a-05542f96a870"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:11:07.267056 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-d6019245-d4db-43b5-a652-4fe19e56e68b req-2a62704f-2cf9-4f62-aedd-0e21b234ba19 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:07.268736 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-d6019245-d4db-43b5-a652-4fe19e56e68b req-2a62704f-2cf9-4f62-aedd-0e21b234ba19 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:07.270069 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-d6019245-d4db-43b5-a652-4fe19e56e68b req-2a62704f-2cf9-4f62-aedd-0e21b234ba19 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:07.288962 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-d6019245-d4db-43b5-a652-4fe19e56e68b req-2a62704f-2cf9-4f62-aedd-0e21b234ba19 service nova] Creating event network-vif-plugged:81ae2823-3716-40c5-a83a-05542f96a870 for instance da7beaa4-0356-4315-bdcc-af5b9c1730a1 on n-h2-860284-1 Oct 04 22:11:07.297760 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-d6019245-d4db-43b5-a652-4fe19e56e68b req-2a62704f-2cf9-4f62-aedd-0e21b234ba19 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055879 Oct 04 22:11:07.298763 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2560/5174] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:11:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:11:07.803842 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-4a9ef517-b34a-4641-a4f5-c3c30662f2a5 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:11:07.808122 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-4a9ef517-b34a-4641-a4f5-c3c30662f2a5 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 48243e1b-892b-4c4b-8db1-242b2e40653b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:11:07.830961 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4a9ef517-b34a-4641-a4f5-c3c30662f2a5 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:07.831813 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4a9ef517-b34a-4641-a4f5-c3c30662f2a5 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:07.832549 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4a9ef517-b34a-4641-a4f5-c3c30662f2a5 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:07.833756 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4a9ef517-b34a-4641-a4f5-c3c30662f2a5 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:07.834676 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4a9ef517-b34a-4641-a4f5-c3c30662f2a5 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:07.835421 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4a9ef517-b34a-4641-a4f5-c3c30662f2a5 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:07.991379 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-cb5b5ff0-1713-4c53-b4a1-b08ee503527c tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:11:07.993143 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-cb5b5ff0-1713-4c53-b4a1-b08ee503527c tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: da7beaa4-0356-4315-bdcc-af5b9c1730a1] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:11:08.003594 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cb5b5ff0-1713-4c53-b4a1-b08ee503527c tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:08.004349 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cb5b5ff0-1713-4c53-b4a1-b08ee503527c tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:08.005511 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cb5b5ff0-1713-4c53-b4a1-b08ee503527c tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:08.006986 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cb5b5ff0-1713-4c53-b4a1-b08ee503527c tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:08.007929 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cb5b5ff0-1713-4c53-b4a1-b08ee503527c tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:08.008546 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cb5b5ff0-1713-4c53-b4a1-b08ee503527c tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:08.187059 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-4a9ef517-b34a-4641-a4f5-c3c30662f2a5 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:11:08.214671 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-4a9ef517-b34a-4641-a4f5-c3c30662f2a5 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b" status: 200 len: 1669 microversion: 2.1 time: 0.420047 Oct 04 22:11:08.216345 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2615/5175] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:11:07 2022] GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b => generated 1669 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:11:08.239750 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-8bc48bac-6ed5-426e-91b0-4f32d797c469 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:11:08.240733 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-8bc48bac-6ed5-426e-91b0-4f32d797c469 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 48243e1b-892b-4c4b-8db1-242b2e40653b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:11:08.247591 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8bc48bac-6ed5-426e-91b0-4f32d797c469 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:08.248035 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8bc48bac-6ed5-426e-91b0-4f32d797c469 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:08.249134 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8bc48bac-6ed5-426e-91b0-4f32d797c469 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:08.249840 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8bc48bac-6ed5-426e-91b0-4f32d797c469 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:08.250324 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8bc48bac-6ed5-426e-91b0-4f32d797c469 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:08.250793 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8bc48bac-6ed5-426e-91b0-4f32d797c469 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:08.774393 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-cb5b5ff0-1713-4c53-b4a1-b08ee503527c tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1682f1a60045d8a04d4d67393cd13f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b00cd9fa8e40a0919b61fcd60269f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:11:08.793536 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-cb5b5ff0-1713-4c53-b4a1-b08ee503527c tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "GET /compute/v2.1/servers/da7beaa4-0356-4315-bdcc-af5b9c1730a1" status: 200 len: 1309 microversion: 2.1 time: 0.809650 Oct 04 22:11:08.797542 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2561/5176] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:11:07 2022] GET /compute/v2.1/servers/da7beaa4-0356-4315-bdcc-af5b9c1730a1 => generated 1309 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:11:08.937221 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-8bc48bac-6ed5-426e-91b0-4f32d797c469 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:11:08.946995 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-8bc48bac-6ed5-426e-91b0-4f32d797c469 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b" status: 200 len: 1669 microversion: 2.1 time: 0.711490 Oct 04 22:11:08.948042 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2616/5177] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:11:08 2022] GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b => generated 1669 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:11:08.973864 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-8ea41457-adbd-404a-b85e-52e1586d7365 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:11:08.974876 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-8ea41457-adbd-404a-b85e-52e1586d7365 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 48243e1b-892b-4c4b-8db1-242b2e40653b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:11:08.982123 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8ea41457-adbd-404a-b85e-52e1586d7365 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:08.983685 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8ea41457-adbd-404a-b85e-52e1586d7365 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:08.984535 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8ea41457-adbd-404a-b85e-52e1586d7365 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:08.985539 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8ea41457-adbd-404a-b85e-52e1586d7365 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:08.986189 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8ea41457-adbd-404a-b85e-52e1586d7365 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:08.989331 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8ea41457-adbd-404a-b85e-52e1586d7365 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:09.388218 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-8ea41457-adbd-404a-b85e-52e1586d7365 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:11:09.400369 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-8ea41457-adbd-404a-b85e-52e1586d7365 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b" status: 200 len: 1669 microversion: 2.1 time: 0.430994 Oct 04 22:11:09.401967 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2562/5178] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:11:08 2022] GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b => generated 1669 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:11:09.429224 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-7cf10678-21b7-4032-954f-dbe9700092cd tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:11:09.431457 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-7cf10678-21b7-4032-954f-dbe9700092cd tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 48243e1b-892b-4c4b-8db1-242b2e40653b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:11:09.452921 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7cf10678-21b7-4032-954f-dbe9700092cd tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:09.453428 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7cf10678-21b7-4032-954f-dbe9700092cd tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:09.453875 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7cf10678-21b7-4032-954f-dbe9700092cd tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:09.454642 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7cf10678-21b7-4032-954f-dbe9700092cd tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:09.457953 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7cf10678-21b7-4032-954f-dbe9700092cd tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:09.458458 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7cf10678-21b7-4032-954f-dbe9700092cd tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:09.774676 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-7cf10678-21b7-4032-954f-dbe9700092cd tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:11:09.790996 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-7cf10678-21b7-4032-954f-dbe9700092cd tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b" status: 200 len: 1669 microversion: 2.1 time: 0.366793 Oct 04 22:11:09.793489 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2617/5179] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:11:09 2022] GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b => generated 1669 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:11:09.827303 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-5cd3d9e4-6d0e-4c1c-b212-f3d8f83c5bfd tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:11:09.830855 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-5cd3d9e4-6d0e-4c1c-b212-f3d8f83c5bfd tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: da7beaa4-0356-4315-bdcc-af5b9c1730a1] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:11:09.836388 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-fb33b0c4-0054-409d-86e7-2ce0abcd8db1 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:11:09.837341 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-fb33b0c4-0054-409d-86e7-2ce0abcd8db1 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 48243e1b-892b-4c4b-8db1-242b2e40653b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:11:09.838879 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5cd3d9e4-6d0e-4c1c-b212-f3d8f83c5bfd tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:09.839500 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5cd3d9e4-6d0e-4c1c-b212-f3d8f83c5bfd tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:09.840110 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5cd3d9e4-6d0e-4c1c-b212-f3d8f83c5bfd tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:09.841280 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5cd3d9e4-6d0e-4c1c-b212-f3d8f83c5bfd tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:09.841864 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5cd3d9e4-6d0e-4c1c-b212-f3d8f83c5bfd tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:09.843947 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5cd3d9e4-6d0e-4c1c-b212-f3d8f83c5bfd tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:09.863573 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fb33b0c4-0054-409d-86e7-2ce0abcd8db1 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:09.868187 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fb33b0c4-0054-409d-86e7-2ce0abcd8db1 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:09.872857 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fb33b0c4-0054-409d-86e7-2ce0abcd8db1 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:09.876910 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fb33b0c4-0054-409d-86e7-2ce0abcd8db1 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:09.878283 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fb33b0c4-0054-409d-86e7-2ce0abcd8db1 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:09.882689 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fb33b0c4-0054-409d-86e7-2ce0abcd8db1 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:10.294466 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-5cd3d9e4-6d0e-4c1c-b212-f3d8f83c5bfd tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1682f1a60045d8a04d4d67393cd13f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b00cd9fa8e40a0919b61fcd60269f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:11:10.306015 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-5cd3d9e4-6d0e-4c1c-b212-f3d8f83c5bfd tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "GET /compute/v2.1/servers/da7beaa4-0356-4315-bdcc-af5b9c1730a1" status: 200 len: 1491 microversion: 2.1 time: 0.483495 Oct 04 22:11:10.307850 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2563/5180] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:11:09 2022] GET /compute/v2.1/servers/da7beaa4-0356-4315-bdcc-af5b9c1730a1 => generated 1491 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:11:10.331660 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-fb33b0c4-0054-409d-86e7-2ce0abcd8db1 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:11:10.337323 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-30d0705e-5371-412c-a977-01871b6a5eac tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:11:10.348484 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-30d0705e-5371-412c-a977-01871b6a5eac tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: da7beaa4-0356-4315-bdcc-af5b9c1730a1] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:11:10.353500 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-fb33b0c4-0054-409d-86e7-2ce0abcd8db1 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b" status: 200 len: 1669 microversion: 2.1 time: 0.524773 Oct 04 22:11:10.358487 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2618/5181] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:11:09 2022] GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b => generated 1669 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:11:10.360884 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-30d0705e-5371-412c-a977-01871b6a5eac tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:10.361590 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-30d0705e-5371-412c-a977-01871b6a5eac tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:10.362190 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-30d0705e-5371-412c-a977-01871b6a5eac tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:10.365251 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-30d0705e-5371-412c-a977-01871b6a5eac tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:10.366380 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-30d0705e-5371-412c-a977-01871b6a5eac tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:10.367299 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-30d0705e-5371-412c-a977-01871b6a5eac tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:10.401821 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-463aeff2-1476-4f69-8809-6693ea6ddfc9 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:11:10.404053 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-463aeff2-1476-4f69-8809-6693ea6ddfc9 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 48243e1b-892b-4c4b-8db1-242b2e40653b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:11:10.413472 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-463aeff2-1476-4f69-8809-6693ea6ddfc9 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:10.414959 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-463aeff2-1476-4f69-8809-6693ea6ddfc9 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:10.415693 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-463aeff2-1476-4f69-8809-6693ea6ddfc9 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:10.423211 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-463aeff2-1476-4f69-8809-6693ea6ddfc9 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:10.423987 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-463aeff2-1476-4f69-8809-6693ea6ddfc9 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:10.424871 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-463aeff2-1476-4f69-8809-6693ea6ddfc9 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:10.559259 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-30d0705e-5371-412c-a977-01871b6a5eac tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "PUT /compute/v2.1/servers/da7beaa4-0356-4315-bdcc-af5b9c1730a1" status: 200 len: 1086 microversion: 2.1 time: 0.229340 Oct 04 22:11:10.562141 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2564/5182] 10.222.0.43 () {60 vars in 1256 bytes} [Tue Oct 4 22:11:10 2022] PUT /compute/v2.1/servers/da7beaa4-0356-4315-bdcc-af5b9c1730a1 => generated 1086 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:11:10.590809 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-59b48c94-2bf1-42a8-baa1-0a189b384dea tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:11:10.591586 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-59b48c94-2bf1-42a8-baa1-0a189b384dea tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: da7beaa4-0356-4315-bdcc-af5b9c1730a1] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:11:10.599996 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-59b48c94-2bf1-42a8-baa1-0a189b384dea tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:10.600574 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-59b48c94-2bf1-42a8-baa1-0a189b384dea tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:10.601085 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-59b48c94-2bf1-42a8-baa1-0a189b384dea tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:10.601878 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-59b48c94-2bf1-42a8-baa1-0a189b384dea tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:10.602512 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-59b48c94-2bf1-42a8-baa1-0a189b384dea tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:10.603086 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-59b48c94-2bf1-42a8-baa1-0a189b384dea tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:10.803151 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-463aeff2-1476-4f69-8809-6693ea6ddfc9 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:11:10.815702 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-463aeff2-1476-4f69-8809-6693ea6ddfc9 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b" status: 200 len: 1669 microversion: 2.1 time: 0.427419 Oct 04 22:11:10.826108 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2619/5183] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:11:10 2022] GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b => generated 1669 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:11:10.921833 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-59b48c94-2bf1-42a8-baa1-0a189b384dea tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1682f1a60045d8a04d4d67393cd13f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b00cd9fa8e40a0919b61fcd60269f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:11:10.932833 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-59b48c94-2bf1-42a8-baa1-0a189b384dea tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "GET /compute/v2.1/servers/da7beaa4-0356-4315-bdcc-af5b9c1730a1" status: 200 len: 1512 microversion: 2.1 time: 0.346839 Oct 04 22:11:10.934898 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2565/5184] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:11:10 2022] GET /compute/v2.1/servers/da7beaa4-0356-4315-bdcc-af5b9c1730a1 => generated 1512 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:11:10.957424 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-6cbe2601-5da4-4757-b530-385a1aff6f18 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:11:10.958059 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-6cbe2601-5da4-4757-b530-385a1aff6f18 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: da7beaa4-0356-4315-bdcc-af5b9c1730a1] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:11:10.965428 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6cbe2601-5da4-4757-b530-385a1aff6f18 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:10.966202 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6cbe2601-5da4-4757-b530-385a1aff6f18 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:10.967516 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6cbe2601-5da4-4757-b530-385a1aff6f18 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:10.968487 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6cbe2601-5da4-4757-b530-385a1aff6f18 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:10.969218 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6cbe2601-5da4-4757-b530-385a1aff6f18 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:10.969838 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6cbe2601-5da4-4757-b530-385a1aff6f18 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:10.982050 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=4,nova_cell1:UPDATE=6 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:11:11.326024 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-6cbe2601-5da4-4757-b530-385a1aff6f18 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1682f1a60045d8a04d4d67393cd13f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b00cd9fa8e40a0919b61fcd60269f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:11:11.339359 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-6cbe2601-5da4-4757-b530-385a1aff6f18 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "GET /compute/v2.1/servers/da7beaa4-0356-4315-bdcc-af5b9c1730a1" status: 200 len: 1512 microversion: 2.1 time: 0.384133 Oct 04 22:11:11.354397 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2620/5185] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:11:10 2022] GET /compute/v2.1/servers/da7beaa4-0356-4315-bdcc-af5b9c1730a1 => generated 1512 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:11:11.365706 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e7683da2-fec9-4a5c-b58f-1bd99d26a82e tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:11:11.366468 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-e7683da2-fec9-4a5c-b58f-1bd99d26a82e tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: da7beaa4-0356-4315-bdcc-af5b9c1730a1] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:11:11.374699 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e7683da2-fec9-4a5c-b58f-1bd99d26a82e tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:11.375314 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e7683da2-fec9-4a5c-b58f-1bd99d26a82e tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:11.375863 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e7683da2-fec9-4a5c-b58f-1bd99d26a82e tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:11.376698 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e7683da2-fec9-4a5c-b58f-1bd99d26a82e tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:11.377267 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e7683da2-fec9-4a5c-b58f-1bd99d26a82e tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:11.378097 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e7683da2-fec9-4a5c-b58f-1bd99d26a82e tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:11.426426 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-e7683da2-fec9-4a5c-b58f-1bd99d26a82e tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: da7beaa4-0356-4315-bdcc-af5b9c1730a1] Going to try to terminate instance {{(pid=134101) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 22:11:11.535769 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-e7683da2-fec9-4a5c-b58f-1bd99d26a82e tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "DELETE /compute/v2.1/servers/da7beaa4-0356-4315-bdcc-af5b9c1730a1" status: 204 len: 0 microversion: 2.1 time: 0.173190 Oct 04 22:11:11.536482 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2566/5186] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 22:11:11 2022] DELETE /compute/v2.1/servers/da7beaa4-0356-4315-bdcc-af5b9c1730a1 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 22:11:11.547576 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-1517c73a-5921-4679-a505-e08364b76139 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:11:11.548221 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-1517c73a-5921-4679-a505-e08364b76139 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: da7beaa4-0356-4315-bdcc-af5b9c1730a1] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:11:11.571671 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1517c73a-5921-4679-a505-e08364b76139 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:11.572915 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1517c73a-5921-4679-a505-e08364b76139 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:11.578855 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1517c73a-5921-4679-a505-e08364b76139 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:11.580151 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1517c73a-5921-4679-a505-e08364b76139 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:11.580904 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1517c73a-5921-4679-a505-e08364b76139 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:11.581630 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1517c73a-5921-4679-a505-e08364b76139 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:11.840748 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-1517c73a-5921-4679-a505-e08364b76139 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1682f1a60045d8a04d4d67393cd13f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b00cd9fa8e40a0919b61fcd60269f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:11:11.858964 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-1517c73a-5921-4679-a505-e08364b76139 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "GET /compute/v2.1/servers/da7beaa4-0356-4315-bdcc-af5b9c1730a1" status: 200 len: 1518 microversion: 2.1 time: 0.317723 Oct 04 22:11:11.866841 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2621/5187] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:11:11 2022] GET /compute/v2.1/servers/da7beaa4-0356-4315-bdcc-af5b9c1730a1 => generated 1518 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:11:12.899588 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-4e2082f7-d6af-4161-b0c2-51584be94e05 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:11:12.901933 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-4e2082f7-d6af-4161-b0c2-51584be94e05 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: da7beaa4-0356-4315-bdcc-af5b9c1730a1] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:11:12.919481 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4e2082f7-d6af-4161-b0c2-51584be94e05 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:12.922224 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4e2082f7-d6af-4161-b0c2-51584be94e05 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:12.924968 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4e2082f7-d6af-4161-b0c2-51584be94e05 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:12.926788 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4e2082f7-d6af-4161-b0c2-51584be94e05 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:12.928012 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4e2082f7-d6af-4161-b0c2-51584be94e05 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:12.929571 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4e2082f7-d6af-4161-b0c2-51584be94e05 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:13.179879 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-4e2082f7-d6af-4161-b0c2-51584be94e05 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1682f1a60045d8a04d4d67393cd13f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b00cd9fa8e40a0919b61fcd60269f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:11:13.195455 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-4e2082f7-d6af-4161-b0c2-51584be94e05 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "GET /compute/v2.1/servers/da7beaa4-0356-4315-bdcc-af5b9c1730a1" status: 200 len: 1518 microversion: 2.1 time: 0.301493 Oct 04 22:11:13.198403 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2567/5188] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:11:12 2022] GET /compute/v2.1/servers/da7beaa4-0356-4315-bdcc-af5b9c1730a1 => generated 1518 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:11:14.225220 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-53e58de6-90ab-497f-87de-6c09009aea73 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:11:14.226796 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-53e58de6-90ab-497f-87de-6c09009aea73 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: da7beaa4-0356-4315-bdcc-af5b9c1730a1] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:11:14.251589 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-53e58de6-90ab-497f-87de-6c09009aea73 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:14.253704 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-53e58de6-90ab-497f-87de-6c09009aea73 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:14.254447 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-53e58de6-90ab-497f-87de-6c09009aea73 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:14.256255 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-53e58de6-90ab-497f-87de-6c09009aea73 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:14.258645 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-53e58de6-90ab-497f-87de-6c09009aea73 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:14.260882 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-53e58de6-90ab-497f-87de-6c09009aea73 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:14.349235 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-b2eb57c4-c34f-4c43-a046-cdc99a3b7119 req-ca7353ee-b2aa-4b08-953c-846c5073b965 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da7beaa4-0356-4315-bdcc-af5b9c1730a1", "name": "network-vif-deleted", "tag": "81ae2823-3716-40c5-a83a-05542f96a870"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:11:14.383342 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-b2eb57c4-c34f-4c43-a046-cdc99a3b7119 req-ca7353ee-b2aa-4b08-953c-846c5073b965 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:14.384012 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-b2eb57c4-c34f-4c43-a046-cdc99a3b7119 req-ca7353ee-b2aa-4b08-953c-846c5073b965 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:14.398704 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-53e58de6-90ab-497f-87de-6c09009aea73 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1682f1a60045d8a04d4d67393cd13f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b00cd9fa8e40a0919b61fcd60269f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:11:14.416266 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-b2eb57c4-c34f-4c43-a046-cdc99a3b7119 req-ca7353ee-b2aa-4b08-953c-846c5073b965 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:14.433629 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-53e58de6-90ab-497f-87de-6c09009aea73 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "GET /compute/v2.1/servers/da7beaa4-0356-4315-bdcc-af5b9c1730a1" status: 200 len: 1476 microversion: 2.1 time: 0.215547 Oct 04 22:11:14.437962 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2622/5189] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:11:14 2022] GET /compute/v2.1/servers/da7beaa4-0356-4315-bdcc-af5b9c1730a1 => generated 1476 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:11:14.472448 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-b2eb57c4-c34f-4c43-a046-cdc99a3b7119 req-ca7353ee-b2aa-4b08-953c-846c5073b965 service nova] Creating event network-vif-deleted:81ae2823-3716-40c5-a83a-05542f96a870 for instance da7beaa4-0356-4315-bdcc-af5b9c1730a1 on n-h2-860284-1 Oct 04 22:11:14.485057 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-b2eb57c4-c34f-4c43-a046-cdc99a3b7119 req-ca7353ee-b2aa-4b08-953c-846c5073b965 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.158529 Oct 04 22:11:14.488807 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2568/5190] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:11:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:11:15.468979 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-2aac7ead-5cda-4bcf-a4ea-8ac57573ce43 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:11:15.469730 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-2aac7ead-5cda-4bcf-a4ea-8ac57573ce43 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: da7beaa4-0356-4315-bdcc-af5b9c1730a1] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:11:15.486116 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2aac7ead-5cda-4bcf-a4ea-8ac57573ce43 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:15.486980 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2aac7ead-5cda-4bcf-a4ea-8ac57573ce43 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:15.487912 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2aac7ead-5cda-4bcf-a4ea-8ac57573ce43 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:15.488905 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2aac7ead-5cda-4bcf-a4ea-8ac57573ce43 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:15.490405 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2aac7ead-5cda-4bcf-a4ea-8ac57573ce43 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:15.493774 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2aac7ead-5cda-4bcf-a4ea-8ac57573ce43 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:15.527981 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-2aac7ead-5cda-4bcf-a4ea-8ac57573ce43 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] HTTP exception thrown: Instance da7beaa4-0356-4315-bdcc-af5b9c1730a1 could not be found. Oct 04 22:11:15.532346 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-2aac7ead-5cda-4bcf-a4ea-8ac57573ce43 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Request method failure captured: Oct 04 22:11:15.532346 n-d-860284-1 devstack@n-api.service[134102]: request: GET /compute/v2.1/servers/da7beaa4-0356-4315-bdcc-af5b9c1730a1 HTTP/1.1 Oct 04 22:11:15.532346 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 22:11:15.532346 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 22:11:15.532346 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 22:11:15.532346 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 22:11:15.532346 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 22:11:15.532346 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 22:11:15.532346 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 22:11:15.532346 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 22:11:15.532346 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPK7MP0-m-xtUnxXwLoxlIfO4jzoQOT6GMi-_9Rz-dG646c6MuQMOjiOhGtcOohb2ZIUdejR42Va0IkiFMBDtdnbnUEdF8Psxz0uHfYGBQiEZpqo4CpOHPpz5KjUxS1LmPgcFnegJZtGQu1irxi49GMeHkm9nnXbxd63druWj1zFChJ4 Oct 04 22:11:15.532346 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 22:11:15.532346 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 22:11:15.532346 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 22:11:15.532346 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 22:11:15.532346 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 22:11:15.532346 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 22:11:15.532346 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: d4b00cd9fa8e40a0919b61fcd60269f5 Oct 04 22:11:15.532346 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-ServersTestJSON-1600369848 Oct 04 22:11:15.532346 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 22:11:15.532346 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 22:11:15.532346 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d4b00cd9fa8e40a0919b61fcd60269f5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_d4b00cd9fa8e40a0919b61fcd60269f5", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d4b00cd9fa8e40a0919b61fcd60269f5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/d4b00cd9fa8e40a0919b61fcd60269f5"}]}] Oct 04 22:11:15.532346 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-ServersTestJSON-1600369848 Oct 04 22:11:15.532346 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: d4b00cd9fa8e40a0919b61fcd60269f5 Oct 04 22:11:15.532346 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-ServersTestJSON-1600369848 Oct 04 22:11:15.532346 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-ServersTestJSON-1600369848-project Oct 04 22:11:15.532346 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 22:11:15.532346 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 22:11:15.532346 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: 9c1682f1a60045d8a04d4d67393cd13f Oct 04 22:11:15.532346 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-ServersTestJSON-1600369848-project Oct 04 22:11:15.532346 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 22:11:15.532346 n-d-860284-1 devstack@n-api.service[134102]: exception: Instance da7beaa4-0356-4315-bdcc-af5b9c1730a1 could not be found. Oct 04 22:11:15.532346 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': 'da7beaa4-0356-4315-bdcc-af5b9c1730a1'} Oct 04 22:11:15.532346 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:11:15.532346 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:11:15.532346 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:11:15.532346 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:11:15.532346 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:11:15.532346 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:11:15.532346 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:11:15.532346 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:11:15.532346 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:11:15.532346 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:11:15.532346 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da7beaa4-0356-4315-bdcc-af5b9c1730a1 could not be found. Oct 04 22:11:15.532346 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:11:15.532346 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:11:15.532346 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:11:15.532346 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:11:15.532346 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:11:15.532346 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:11:15.532346 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:11:15.532346 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:11:15.532346 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:11:15.532346 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:11:15.532346 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:11:15.532346 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:11:15.532346 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:11:15.532346 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:11:15.532346 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:11:15.532346 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:11:15.532346 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da7beaa4-0356-4315-bdcc-af5b9c1730a1 could not be found. Oct 04 22:11:15.532346 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:11:15.532346 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:11:15.532346 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:11:15.542107 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:11:15.542107 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:11:15.542107 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:11:15.542107 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:11:15.542107 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:11:15.542107 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da7beaa4-0356-4315-bdcc-af5b9c1730a1 could not be found. Oct 04 22:11:15.542107 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:11:15.545280 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-2aac7ead-5cda-4bcf-a4ea-8ac57573ce43 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Returning 404 to user: Instance da7beaa4-0356-4315-bdcc-af5b9c1730a1 could not be found. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:11:15.546903 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-2aac7ead-5cda-4bcf-a4ea-8ac57573ce43 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "GET /compute/v2.1/servers/da7beaa4-0356-4315-bdcc-af5b9c1730a1" status: 404 len: 111 microversion: 2.1 time: 0.086131 Oct 04 22:11:15.565195 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2623/5191] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:11:15 2022] GET /compute/v2.1/servers/da7beaa4-0356-4315-bdcc-af5b9c1730a1 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:11:15.815343 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-99d8464d-bc53-48d5-adb1-123ba13b8277 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-208279354", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452", "networks": [{"uuid": "3e97795f-9423-4034-b566-4a70497d6dcc"}]}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:11:15.883844 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.network.neutron [None req-99d8464d-bc53-48d5-adb1-123ba13b8277 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] validate_networks() for [('3e97795f-9423-4034-b566-4a70497d6dcc', None, None, None, None, None)] {{(pid=134101) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 22:11:16.609737 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-99d8464d-bc53-48d5-adb1-123ba13b8277 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Flavor limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 22:11:16.610721 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-99d8464d-bc53-48d5-adb1-123ba13b8277 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Image limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 22:11:16.611218 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-99d8464d-bc53-48d5-adb1-123ba13b8277 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Flavor pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 22:11:16.611641 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-99d8464d-bc53-48d5-adb1-123ba13b8277 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Image pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 22:11:16.612064 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-99d8464d-bc53-48d5-adb1-123ba13b8277 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 22:11:16.621795 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-99d8464d-bc53-48d5-adb1-123ba13b8277 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:16.633931 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-99d8464d-bc53-48d5-adb1-123ba13b8277 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:16.634563 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-99d8464d-bc53-48d5-adb1-123ba13b8277 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:16.635406 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-99d8464d-bc53-48d5-adb1-123ba13b8277 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:16.636103 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-99d8464d-bc53-48d5-adb1-123ba13b8277 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:16.636359 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-99d8464d-bc53-48d5-adb1-123ba13b8277 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:16.687067 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-99d8464d-bc53-48d5-adb1-123ba13b8277 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Getting quotas for project d4b00cd9fa8e40a0919b61fcd60269f5. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:11:16.693730 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-99d8464d-bc53-48d5-adb1-123ba13b8277 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Getting quotas for user 9c1682f1a60045d8a04d4d67393cd13f and project d4b00cd9fa8e40a0919b61fcd60269f5. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:11:16.709129 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-99d8464d-bc53-48d5-adb1-123ba13b8277 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Going to run 1 instances... {{(pid=134101) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 22:11:16.712205 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-99d8464d-bc53-48d5-adb1-123ba13b8277 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: d9a1b9b5-318a-41a8-ba1c-0ad6a55e9840] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='58548514-5dac-426c-81f5-19e3fba33e23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134101) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 22:11:16.782771 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-99d8464d-bc53-48d5-adb1-123ba13b8277 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.974380 Oct 04 22:11:16.783590 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2569/5192] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 22:11:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 976 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 22:11:16.796892 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-38455e5d-f3ff-4bb3-87fd-76fcdbb84122 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:11:16.797609 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-38455e5d-f3ff-4bb3-87fd-76fcdbb84122 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: d9a1b9b5-318a-41a8-ba1c-0ad6a55e9840] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:11:17.011757 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-38455e5d-f3ff-4bb3-87fd-76fcdbb84122 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1682f1a60045d8a04d4d67393cd13f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b00cd9fa8e40a0919b61fcd60269f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:11:17.026688 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-38455e5d-f3ff-4bb3-87fd-76fcdbb84122 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "GET /compute/v2.1/servers/d9a1b9b5-318a-41a8-ba1c-0ad6a55e9840" status: 200 len: 1208 microversion: 2.1 time: 0.234670 Oct 04 22:11:17.028580 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2624/5193] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:11:16 2022] GET /compute/v2.1/servers/d9a1b9b5-318a-41a8-ba1c-0ad6a55e9840 => generated 1208 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:11:18.061958 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-a061f71d-37ba-492a-85fb-a93185e8c582 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:11:18.066549 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-a061f71d-37ba-492a-85fb-a93185e8c582 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: d9a1b9b5-318a-41a8-ba1c-0ad6a55e9840] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:11:18.087300 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a061f71d-37ba-492a-85fb-a93185e8c582 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:18.088259 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a061f71d-37ba-492a-85fb-a93185e8c582 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:18.089105 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a061f71d-37ba-492a-85fb-a93185e8c582 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:18.090426 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a061f71d-37ba-492a-85fb-a93185e8c582 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:18.091544 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a061f71d-37ba-492a-85fb-a93185e8c582 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:18.093199 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a061f71d-37ba-492a-85fb-a93185e8c582 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:18.278971 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-a061f71d-37ba-492a-85fb-a93185e8c582 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1682f1a60045d8a04d4d67393cd13f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b00cd9fa8e40a0919b61fcd60269f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:11:18.318946 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-a061f71d-37ba-492a-85fb-a93185e8c582 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "GET /compute/v2.1/servers/d9a1b9b5-318a-41a8-ba1c-0ad6a55e9840" status: 200 len: 1260 microversion: 2.1 time: 0.253773 Oct 04 22:11:18.319977 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2570/5194] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:11:18 2022] GET /compute/v2.1/servers/d9a1b9b5-318a-41a8-ba1c-0ad6a55e9840 => generated 1260 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:11:19.349770 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-c0f391e6-274c-4ce0-a180-77777d2c302e tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:11:19.351170 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-c0f391e6-274c-4ce0-a180-77777d2c302e tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: d9a1b9b5-318a-41a8-ba1c-0ad6a55e9840] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:11:19.361157 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c0f391e6-274c-4ce0-a180-77777d2c302e tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:19.361868 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c0f391e6-274c-4ce0-a180-77777d2c302e tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:19.362320 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c0f391e6-274c-4ce0-a180-77777d2c302e tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:19.363841 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c0f391e6-274c-4ce0-a180-77777d2c302e tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:19.364319 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c0f391e6-274c-4ce0-a180-77777d2c302e tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:19.364923 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c0f391e6-274c-4ce0-a180-77777d2c302e tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:19.472215 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-c0f391e6-274c-4ce0-a180-77777d2c302e tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1682f1a60045d8a04d4d67393cd13f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b00cd9fa8e40a0919b61fcd60269f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:11:19.485084 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-c0f391e6-274c-4ce0-a180-77777d2c302e tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "GET /compute/v2.1/servers/d9a1b9b5-318a-41a8-ba1c-0ad6a55e9840" status: 200 len: 1266 microversion: 2.1 time: 0.142860 Oct 04 22:11:19.485813 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2625/5195] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:11:19 2022] GET /compute/v2.1/servers/d9a1b9b5-318a-41a8-ba1c-0ad6a55e9840 => generated 1266 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:11:20.509966 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-4b805d44-16eb-4de8-9966-12f5e1cade8e tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:11:20.510718 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-4b805d44-16eb-4de8-9966-12f5e1cade8e tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: d9a1b9b5-318a-41a8-ba1c-0ad6a55e9840] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:11:20.524833 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4b805d44-16eb-4de8-9966-12f5e1cade8e tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:20.525721 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4b805d44-16eb-4de8-9966-12f5e1cade8e tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:20.526269 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4b805d44-16eb-4de8-9966-12f5e1cade8e tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:20.527580 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4b805d44-16eb-4de8-9966-12f5e1cade8e tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:20.528655 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4b805d44-16eb-4de8-9966-12f5e1cade8e tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:20.530068 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4b805d44-16eb-4de8-9966-12f5e1cade8e tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:20.828673 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-4b805d44-16eb-4de8-9966-12f5e1cade8e tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1682f1a60045d8a04d4d67393cd13f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b00cd9fa8e40a0919b61fcd60269f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:11:20.840197 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-4b805d44-16eb-4de8-9966-12f5e1cade8e tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "GET /compute/v2.1/servers/d9a1b9b5-318a-41a8-ba1c-0ad6a55e9840" status: 200 len: 1308 microversion: 2.1 time: 0.334135 Oct 04 22:11:20.843274 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2571/5196] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:11:20 2022] GET /compute/v2.1/servers/d9a1b9b5-318a-41a8-ba1c-0ad6a55e9840 => generated 1308 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:11:21.454664 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-09eeb236-bbc3-4fca-8dce-983ef70a6692 req-fe5d8a0f-22b5-45de-a1fa-f6001e4a8ea9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9a1b9b5-318a-41a8-ba1c-0ad6a55e9840", "tag": "58f9db74-d595-44ff-87ac-3d6c21f343f1"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:11:21.505280 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-09eeb236-bbc3-4fca-8dce-983ef70a6692 req-fe5d8a0f-22b5-45de-a1fa-f6001e4a8ea9 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:21.506124 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-09eeb236-bbc3-4fca-8dce-983ef70a6692 req-fe5d8a0f-22b5-45de-a1fa-f6001e4a8ea9 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:21.509901 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-09eeb236-bbc3-4fca-8dce-983ef70a6692 req-fe5d8a0f-22b5-45de-a1fa-f6001e4a8ea9 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:21.543813 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-09eeb236-bbc3-4fca-8dce-983ef70a6692 req-fe5d8a0f-22b5-45de-a1fa-f6001e4a8ea9 service nova] Creating event network-changed:58f9db74-d595-44ff-87ac-3d6c21f343f1 for instance d9a1b9b5-318a-41a8-ba1c-0ad6a55e9840 on n-h2-860284-1 Oct 04 22:11:21.561337 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-09eeb236-bbc3-4fca-8dce-983ef70a6692 req-fe5d8a0f-22b5-45de-a1fa-f6001e4a8ea9 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112692 Oct 04 22:11:21.565967 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2626/5197] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:11:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:11:21.870976 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-951fa8bf-b5ef-4ceb-b056-3bdb0d82ce7a tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:11:21.871990 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-951fa8bf-b5ef-4ceb-b056-3bdb0d82ce7a tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: d9a1b9b5-318a-41a8-ba1c-0ad6a55e9840] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:11:21.909788 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-951fa8bf-b5ef-4ceb-b056-3bdb0d82ce7a tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:21.910350 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-951fa8bf-b5ef-4ceb-b056-3bdb0d82ce7a tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:21.911258 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-951fa8bf-b5ef-4ceb-b056-3bdb0d82ce7a tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:21.912255 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-951fa8bf-b5ef-4ceb-b056-3bdb0d82ce7a tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:21.913328 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-951fa8bf-b5ef-4ceb-b056-3bdb0d82ce7a tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:21.913773 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-951fa8bf-b5ef-4ceb-b056-3bdb0d82ce7a tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:22.706147 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-951fa8bf-b5ef-4ceb-b056-3bdb0d82ce7a tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1682f1a60045d8a04d4d67393cd13f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b00cd9fa8e40a0919b61fcd60269f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:11:22.725731 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-951fa8bf-b5ef-4ceb-b056-3bdb0d82ce7a tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "GET /compute/v2.1/servers/d9a1b9b5-318a-41a8-ba1c-0ad6a55e9840" status: 200 len: 1308 microversion: 2.1 time: 0.864763 Oct 04 22:11:22.727253 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2572/5198] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:11:21 2022] GET /compute/v2.1/servers/d9a1b9b5-318a-41a8-ba1c-0ad6a55e9840 => generated 1308 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:11:23.751215 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-5623c8c4-40b3-4035-ab48-e95209190c6a tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:11:23.752897 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-5623c8c4-40b3-4035-ab48-e95209190c6a tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: d9a1b9b5-318a-41a8-ba1c-0ad6a55e9840] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:11:23.766160 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5623c8c4-40b3-4035-ab48-e95209190c6a tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:23.767157 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5623c8c4-40b3-4035-ab48-e95209190c6a tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:23.768215 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5623c8c4-40b3-4035-ab48-e95209190c6a tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:23.769602 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5623c8c4-40b3-4035-ab48-e95209190c6a tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:23.770724 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5623c8c4-40b3-4035-ab48-e95209190c6a tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:23.771522 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5623c8c4-40b3-4035-ab48-e95209190c6a tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:24.157769 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-5623c8c4-40b3-4035-ab48-e95209190c6a tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1682f1a60045d8a04d4d67393cd13f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b00cd9fa8e40a0919b61fcd60269f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:11:24.168971 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-5623c8c4-40b3-4035-ab48-e95209190c6a tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "GET /compute/v2.1/servers/d9a1b9b5-318a-41a8-ba1c-0ad6a55e9840" status: 200 len: 1308 microversion: 2.1 time: 0.423417 Oct 04 22:11:24.171022 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2627/5199] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:11:23 2022] GET /compute/v2.1/servers/d9a1b9b5-318a-41a8-ba1c-0ad6a55e9840 => generated 1308 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:11:25.197863 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-08fe42d3-12e1-4ff1-a9b0-11407bcd4f7a tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:11:25.198743 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-08fe42d3-12e1-4ff1-a9b0-11407bcd4f7a tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: d9a1b9b5-318a-41a8-ba1c-0ad6a55e9840] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:11:25.204769 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:11:25.220155 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-08fe42d3-12e1-4ff1-a9b0-11407bcd4f7a tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:25.221615 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-08fe42d3-12e1-4ff1-a9b0-11407bcd4f7a tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:25.226342 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-08fe42d3-12e1-4ff1-a9b0-11407bcd4f7a tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:25.230786 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-08fe42d3-12e1-4ff1-a9b0-11407bcd4f7a tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:25.233962 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-08fe42d3-12e1-4ff1-a9b0-11407bcd4f7a tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:25.236024 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-08fe42d3-12e1-4ff1-a9b0-11407bcd4f7a tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:25.603845 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-08fe42d3-12e1-4ff1-a9b0-11407bcd4f7a tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1682f1a60045d8a04d4d67393cd13f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b00cd9fa8e40a0919b61fcd60269f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:11:25.641680 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-08fe42d3-12e1-4ff1-a9b0-11407bcd4f7a tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "GET /compute/v2.1/servers/d9a1b9b5-318a-41a8-ba1c-0ad6a55e9840" status: 200 len: 1308 microversion: 2.1 time: 0.448926 Oct 04 22:11:25.643887 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2573/5200] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:11:25 2022] GET /compute/v2.1/servers/d9a1b9b5-318a-41a8-ba1c-0ad6a55e9840 => generated 1308 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:11:26.680511 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-bdf30b1c-8f75-4f95-b87f-e5f1c34fddcb tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:11:26.681893 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-bdf30b1c-8f75-4f95-b87f-e5f1c34fddcb tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: d9a1b9b5-318a-41a8-ba1c-0ad6a55e9840] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:11:26.706067 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bdf30b1c-8f75-4f95-b87f-e5f1c34fddcb tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:26.706729 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bdf30b1c-8f75-4f95-b87f-e5f1c34fddcb tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:26.707391 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bdf30b1c-8f75-4f95-b87f-e5f1c34fddcb tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:26.713998 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bdf30b1c-8f75-4f95-b87f-e5f1c34fddcb tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:26.713998 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bdf30b1c-8f75-4f95-b87f-e5f1c34fddcb tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:26.713998 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bdf30b1c-8f75-4f95-b87f-e5f1c34fddcb tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:26.914244 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=2 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:11:26.915807 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=6 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:11:26.925200 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e5f8ffe3-b607-4fb2-a459-eba7c6a2c52c tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:11:26.926595 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-e5f8ffe3-b607-4fb2-a459-eba7c6a2c52c tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] [instance: 367dad85-827d-47b0-a468-418d398b36f9] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:11:26.934864 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e5f8ffe3-b607-4fb2-a459-eba7c6a2c52c tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:26.936227 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e5f8ffe3-b607-4fb2-a459-eba7c6a2c52c tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:26.937488 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e5f8ffe3-b607-4fb2-a459-eba7c6a2c52c tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:26.939193 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e5f8ffe3-b607-4fb2-a459-eba7c6a2c52c tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:26.940188 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e5f8ffe3-b607-4fb2-a459-eba7c6a2c52c tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:26.940871 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e5f8ffe3-b607-4fb2-a459-eba7c6a2c52c tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:26.948019 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:11:27.025580 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell0:SELECT=2 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:11:27.147822 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-bdf30b1c-8f75-4f95-b87f-e5f1c34fddcb tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1682f1a60045d8a04d4d67393cd13f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b00cd9fa8e40a0919b61fcd60269f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:11:27.163091 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-bdf30b1c-8f75-4f95-b87f-e5f1c34fddcb tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "GET /compute/v2.1/servers/d9a1b9b5-318a-41a8-ba1c-0ad6a55e9840" status: 200 len: 1308 microversion: 2.1 time: 0.491282 Oct 04 22:11:27.167749 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2628/5201] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:11:26 2022] GET /compute/v2.1/servers/d9a1b9b5-318a-41a8-ba1c-0ad6a55e9840 => generated 1308 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:11:27.360582 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-e5f8ffe3-b607-4fb2-a459-eba7c6a2c52c tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:11:27.377770 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-c568f03e-7642-4d25-af9d-b5eabb43663d req-3774f99c-01a7-4776-97a3-50d836e0e121 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9a1b9b5-318a-41a8-ba1c-0ad6a55e9840", "name": "network-vif-plugged", "status": "completed", "tag": "58f9db74-d595-44ff-87ac-3d6c21f343f1"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:11:27.377924 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-e5f8ffe3-b607-4fb2-a459-eba7c6a2c52c tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:11:27.380822 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-e5f8ffe3-b607-4fb2-a459-eba7c6a2c52c tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:11:27.382810 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-e5f8ffe3-b607-4fb2-a459-eba7c6a2c52c tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] 10.222.0.43 "GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9" status: 200 len: 2947 microversion: 2.32 time: 0.471415 Oct 04 22:11:27.385467 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2574/5202] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:11:26 2022] GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9 => generated 2947 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:11:27.393686 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-c568f03e-7642-4d25-af9d-b5eabb43663d req-3774f99c-01a7-4776-97a3-50d836e0e121 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:27.394681 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-c568f03e-7642-4d25-af9d-b5eabb43663d req-3774f99c-01a7-4776-97a3-50d836e0e121 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:27.395465 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-c568f03e-7642-4d25-af9d-b5eabb43663d req-3774f99c-01a7-4776-97a3-50d836e0e121 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:27.416021 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-78a7a466-c530-4d1f-81fd-e85acaa79b30 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:11:27.430672 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-78a7a466-c530-4d1f-81fd-e85acaa79b30 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] [instance: 367dad85-827d-47b0-a468-418d398b36f9] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:11:27.444766 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-78a7a466-c530-4d1f-81fd-e85acaa79b30 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:27.445565 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-78a7a466-c530-4d1f-81fd-e85acaa79b30 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:27.445851 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-c568f03e-7642-4d25-af9d-b5eabb43663d req-3774f99c-01a7-4776-97a3-50d836e0e121 service nova] Creating event network-vif-plugged:58f9db74-d595-44ff-87ac-3d6c21f343f1 for instance d9a1b9b5-318a-41a8-ba1c-0ad6a55e9840 on n-h2-860284-1 Oct 04 22:11:27.446559 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-78a7a466-c530-4d1f-81fd-e85acaa79b30 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:27.447589 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-78a7a466-c530-4d1f-81fd-e85acaa79b30 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:27.448292 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-78a7a466-c530-4d1f-81fd-e85acaa79b30 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:27.449686 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-78a7a466-c530-4d1f-81fd-e85acaa79b30 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:27.453899 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-c568f03e-7642-4d25-af9d-b5eabb43663d req-3774f99c-01a7-4776-97a3-50d836e0e121 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083893 Oct 04 22:11:27.455010 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2629/5203] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:11:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:11:27.674129 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-78a7a466-c530-4d1f-81fd-e85acaa79b30 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] 10.222.0.43 "GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9/os-interface" status: 200 len: 1831 microversion: 2.32 time: 0.263796 Oct 04 22:11:27.686217 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2575/5204] 10.222.0.43 () {60 vars in 1316 bytes} [Tue Oct 4 22:11:27 2022] GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9/os-interface => generated 1831 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:11:28.198862 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-28a03328-a338-46e7-b0e5-509dfbea5bc3 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:11:28.199642 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-28a03328-a338-46e7-b0e5-509dfbea5bc3 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: d9a1b9b5-318a-41a8-ba1c-0ad6a55e9840] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:11:28.207370 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-28a03328-a338-46e7-b0e5-509dfbea5bc3 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:28.208022 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-28a03328-a338-46e7-b0e5-509dfbea5bc3 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:28.208629 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-28a03328-a338-46e7-b0e5-509dfbea5bc3 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:28.209729 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-28a03328-a338-46e7-b0e5-509dfbea5bc3 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:28.210402 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-28a03328-a338-46e7-b0e5-509dfbea5bc3 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:28.211273 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-28a03328-a338-46e7-b0e5-509dfbea5bc3 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:28.455104 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-28a03328-a338-46e7-b0e5-509dfbea5bc3 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1682f1a60045d8a04d4d67393cd13f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b00cd9fa8e40a0919b61fcd60269f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:11:28.465605 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-28a03328-a338-46e7-b0e5-509dfbea5bc3 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "GET /compute/v2.1/servers/d9a1b9b5-318a-41a8-ba1c-0ad6a55e9840" status: 200 len: 1308 microversion: 2.1 time: 0.276417 Oct 04 22:11:28.468636 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2630/5205] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:11:28 2022] GET /compute/v2.1/servers/d9a1b9b5-318a-41a8-ba1c-0ad6a55e9840 => generated 1308 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:11:29.490148 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-4ab1eb4f-9421-4879-a40c-20b1a6e9bc4c tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:11:29.490963 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-4ab1eb4f-9421-4879-a40c-20b1a6e9bc4c tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: d9a1b9b5-318a-41a8-ba1c-0ad6a55e9840] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:11:29.507048 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4ab1eb4f-9421-4879-a40c-20b1a6e9bc4c tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:29.507830 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4ab1eb4f-9421-4879-a40c-20b1a6e9bc4c tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:29.508461 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4ab1eb4f-9421-4879-a40c-20b1a6e9bc4c tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:29.510222 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4ab1eb4f-9421-4879-a40c-20b1a6e9bc4c tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:29.511036 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4ab1eb4f-9421-4879-a40c-20b1a6e9bc4c tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:29.514329 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4ab1eb4f-9421-4879-a40c-20b1a6e9bc4c tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:29.899069 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-4ab1eb4f-9421-4879-a40c-20b1a6e9bc4c tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1682f1a60045d8a04d4d67393cd13f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b00cd9fa8e40a0919b61fcd60269f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:11:29.914834 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-4ab1eb4f-9421-4879-a40c-20b1a6e9bc4c tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "GET /compute/v2.1/servers/d9a1b9b5-318a-41a8-ba1c-0ad6a55e9840" status: 200 len: 1490 microversion: 2.1 time: 0.429076 Oct 04 22:11:29.950338 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2576/5206] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:11:29 2022] GET /compute/v2.1/servers/d9a1b9b5-318a-41a8-ba1c-0ad6a55e9840 => generated 1490 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:11:29.955093 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-89bb7d58-634f-4e32-a577-c334afe1a301 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1844333898"}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:11:29.962945 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-89bb7d58-634f-4e32-a577-c334afe1a301 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: d9a1b9b5-318a-41a8-ba1c-0ad6a55e9840] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:11:30.006880 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-89bb7d58-634f-4e32-a577-c334afe1a301 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:30.006880 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-89bb7d58-634f-4e32-a577-c334afe1a301 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:30.007223 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-89bb7d58-634f-4e32-a577-c334afe1a301 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:30.008642 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-89bb7d58-634f-4e32-a577-c334afe1a301 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:30.009244 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-89bb7d58-634f-4e32-a577-c334afe1a301 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:30.009791 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-89bb7d58-634f-4e32-a577-c334afe1a301 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:30.153319 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-89bb7d58-634f-4e32-a577-c334afe1a301 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "PUT /compute/v2.1/servers/d9a1b9b5-318a-41a8-ba1c-0ad6a55e9840" status: 200 len: 1076 microversion: 2.1 time: 0.211840 Oct 04 22:11:30.175096 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2631/5207] 10.222.0.43 () {60 vars in 1256 bytes} [Tue Oct 4 22:11:29 2022] PUT /compute/v2.1/servers/d9a1b9b5-318a-41a8-ba1c-0ad6a55e9840 => generated 1076 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:11:30.179654 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-724e6e5a-a521-430f-a7a2-e7326e8d502d tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:11:30.180627 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-724e6e5a-a521-430f-a7a2-e7326e8d502d tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: d9a1b9b5-318a-41a8-ba1c-0ad6a55e9840] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:11:30.189722 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-724e6e5a-a521-430f-a7a2-e7326e8d502d tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:30.190289 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-724e6e5a-a521-430f-a7a2-e7326e8d502d tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:30.190766 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-724e6e5a-a521-430f-a7a2-e7326e8d502d tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:30.192809 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-724e6e5a-a521-430f-a7a2-e7326e8d502d tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:30.193296 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-724e6e5a-a521-430f-a7a2-e7326e8d502d tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:30.194491 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-724e6e5a-a521-430f-a7a2-e7326e8d502d tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:30.656197 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-724e6e5a-a521-430f-a7a2-e7326e8d502d tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1682f1a60045d8a04d4d67393cd13f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b00cd9fa8e40a0919b61fcd60269f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:11:30.669149 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-724e6e5a-a521-430f-a7a2-e7326e8d502d tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "GET /compute/v2.1/servers/d9a1b9b5-318a-41a8-ba1c-0ad6a55e9840" status: 200 len: 1502 microversion: 2.1 time: 0.493313 Oct 04 22:11:30.671702 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2577/5208] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:11:30 2022] GET /compute/v2.1/servers/d9a1b9b5-318a-41a8-ba1c-0ad6a55e9840 => generated 1502 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:11:30.695744 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-50375a60-e3d1-45d7-ad14-068a8168748b tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:11:30.696679 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-50375a60-e3d1-45d7-ad14-068a8168748b tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: d9a1b9b5-318a-41a8-ba1c-0ad6a55e9840] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:11:30.720564 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-50375a60-e3d1-45d7-ad14-068a8168748b tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:30.721291 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-50375a60-e3d1-45d7-ad14-068a8168748b tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:30.723317 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-50375a60-e3d1-45d7-ad14-068a8168748b tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:30.724328 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-50375a60-e3d1-45d7-ad14-068a8168748b tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:30.727179 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-50375a60-e3d1-45d7-ad14-068a8168748b tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:30.727908 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-50375a60-e3d1-45d7-ad14-068a8168748b tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:31.061691 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-50375a60-e3d1-45d7-ad14-068a8168748b tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1682f1a60045d8a04d4d67393cd13f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b00cd9fa8e40a0919b61fcd60269f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:11:31.077848 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-50375a60-e3d1-45d7-ad14-068a8168748b tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "GET /compute/v2.1/servers/d9a1b9b5-318a-41a8-ba1c-0ad6a55e9840" status: 200 len: 1502 microversion: 2.1 time: 0.386010 Oct 04 22:11:31.094969 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2632/5209] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:11:30 2022] GET /compute/v2.1/servers/d9a1b9b5-318a-41a8-ba1c-0ad6a55e9840 => generated 1502 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:11:31.103759 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-fbdd199c-67a3-4cb7-8187-1cec41d63f44 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:11:31.111778 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fbdd199c-67a3-4cb7-8187-1cec41d63f44 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:31.113341 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fbdd199c-67a3-4cb7-8187-1cec41d63f44 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:31.114297 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fbdd199c-67a3-4cb7-8187-1cec41d63f44 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:31.145873 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-fbdd199c-67a3-4cb7-8187-1cec41d63f44 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: d9a1b9b5-318a-41a8-ba1c-0ad6a55e9840] Going to try to stop instance {{(pid=134101) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 04 22:11:31.221186 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-fbdd199c-67a3-4cb7-8187-1cec41d63f44 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "POST /compute/v2.1/servers/d9a1b9b5-318a-41a8-ba1c-0ad6a55e9840/action" status: 202 len: 0 microversion: 2.1 time: 0.119244 Oct 04 22:11:31.223092 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2578/5210] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 22:11:31 2022] POST /compute/v2.1/servers/d9a1b9b5-318a-41a8-ba1c-0ad6a55e9840/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 22:11:31.242170 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-e9a62bf8-7594-4872-9d58-730da2e4d0ca tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:11:31.242170 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-e9a62bf8-7594-4872-9d58-730da2e4d0ca tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: d9a1b9b5-318a-41a8-ba1c-0ad6a55e9840] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:11:31.247667 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_api:SELECT=56 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:11:31.258333 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e9a62bf8-7594-4872-9d58-730da2e4d0ca tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:31.258871 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e9a62bf8-7594-4872-9d58-730da2e4d0ca tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:31.259527 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e9a62bf8-7594-4872-9d58-730da2e4d0ca tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:31.260569 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e9a62bf8-7594-4872-9d58-730da2e4d0ca tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:31.261043 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e9a62bf8-7594-4872-9d58-730da2e4d0ca tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:31.261485 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e9a62bf8-7594-4872-9d58-730da2e4d0ca tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:31.500458 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-e9a62bf8-7594-4872-9d58-730da2e4d0ca tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1682f1a60045d8a04d4d67393cd13f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b00cd9fa8e40a0919b61fcd60269f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:11:31.520606 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-e9a62bf8-7594-4872-9d58-730da2e4d0ca tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "GET /compute/v2.1/servers/d9a1b9b5-318a-41a8-ba1c-0ad6a55e9840" status: 200 len: 1512 microversion: 2.1 time: 0.281926 Oct 04 22:11:31.525531 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2633/5211] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:11:31 2022] GET /compute/v2.1/servers/d9a1b9b5-318a-41a8-ba1c-0ad6a55e9840 => generated 1512 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:11:32.553967 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-0e33b8b0-a6d3-4718-ba5d-295e1247321c tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:11:32.557042 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-0e33b8b0-a6d3-4718-ba5d-295e1247321c tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: d9a1b9b5-318a-41a8-ba1c-0ad6a55e9840] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:11:32.565252 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0e33b8b0-a6d3-4718-ba5d-295e1247321c tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:32.565753 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0e33b8b0-a6d3-4718-ba5d-295e1247321c tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:32.566598 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0e33b8b0-a6d3-4718-ba5d-295e1247321c tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:32.566927 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0e33b8b0-a6d3-4718-ba5d-295e1247321c tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:32.567381 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0e33b8b0-a6d3-4718-ba5d-295e1247321c tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:32.567807 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0e33b8b0-a6d3-4718-ba5d-295e1247321c tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:32.746677 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-0e33b8b0-a6d3-4718-ba5d-295e1247321c tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1682f1a60045d8a04d4d67393cd13f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b00cd9fa8e40a0919b61fcd60269f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:11:32.756672 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-0e33b8b0-a6d3-4718-ba5d-295e1247321c tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "GET /compute/v2.1/servers/d9a1b9b5-318a-41a8-ba1c-0ad6a55e9840" status: 200 len: 1512 microversion: 2.1 time: 0.207679 Oct 04 22:11:32.757532 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2579/5212] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:11:32 2022] GET /compute/v2.1/servers/d9a1b9b5-318a-41a8-ba1c-0ad6a55e9840 => generated 1512 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:11:33.785494 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-c6110581-7d07-45cf-96c0-080be6690ef1 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:11:33.787234 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-c6110581-7d07-45cf-96c0-080be6690ef1 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: d9a1b9b5-318a-41a8-ba1c-0ad6a55e9840] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:11:33.795793 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c6110581-7d07-45cf-96c0-080be6690ef1 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:33.796565 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c6110581-7d07-45cf-96c0-080be6690ef1 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:33.797295 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c6110581-7d07-45cf-96c0-080be6690ef1 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:33.798278 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c6110581-7d07-45cf-96c0-080be6690ef1 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:33.798918 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c6110581-7d07-45cf-96c0-080be6690ef1 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:33.799579 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c6110581-7d07-45cf-96c0-080be6690ef1 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:33.970270 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-c6110581-7d07-45cf-96c0-080be6690ef1 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1682f1a60045d8a04d4d67393cd13f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b00cd9fa8e40a0919b61fcd60269f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:11:33.980776 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-c6110581-7d07-45cf-96c0-080be6690ef1 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "GET /compute/v2.1/servers/d9a1b9b5-318a-41a8-ba1c-0ad6a55e9840" status: 200 len: 1512 microversion: 2.1 time: 0.202803 Oct 04 22:11:33.981517 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2634/5213] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:11:33 2022] GET /compute/v2.1/servers/d9a1b9b5-318a-41a8-ba1c-0ad6a55e9840 => generated 1512 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:11:35.005222 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-451cef31-cc2d-49cf-accb-b068c8af9897 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:11:35.006630 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-451cef31-cc2d-49cf-accb-b068c8af9897 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: d9a1b9b5-318a-41a8-ba1c-0ad6a55e9840] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:11:35.014232 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-451cef31-cc2d-49cf-accb-b068c8af9897 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:35.015087 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-451cef31-cc2d-49cf-accb-b068c8af9897 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:35.015542 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-451cef31-cc2d-49cf-accb-b068c8af9897 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:35.016287 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-451cef31-cc2d-49cf-accb-b068c8af9897 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:35.016756 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-451cef31-cc2d-49cf-accb-b068c8af9897 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:35.017191 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-451cef31-cc2d-49cf-accb-b068c8af9897 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:35.176855 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-451cef31-cc2d-49cf-accb-b068c8af9897 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1682f1a60045d8a04d4d67393cd13f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b00cd9fa8e40a0919b61fcd60269f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:11:35.185115 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-451cef31-cc2d-49cf-accb-b068c8af9897 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "GET /compute/v2.1/servers/d9a1b9b5-318a-41a8-ba1c-0ad6a55e9840" status: 200 len: 1512 microversion: 2.1 time: 0.184182 Oct 04 22:11:35.186598 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2580/5214] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:11:34 2022] GET /compute/v2.1/servers/d9a1b9b5-318a-41a8-ba1c-0ad6a55e9840 => generated 1512 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:11:36.208955 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-e81e8c4d-d041-458e-9688-682b5f4cb491 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:11:36.209698 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-e81e8c4d-d041-458e-9688-682b5f4cb491 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: d9a1b9b5-318a-41a8-ba1c-0ad6a55e9840] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:11:36.219577 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e81e8c4d-d041-458e-9688-682b5f4cb491 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:36.227036 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e81e8c4d-d041-458e-9688-682b5f4cb491 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:36.227581 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e81e8c4d-d041-458e-9688-682b5f4cb491 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:36.228410 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e81e8c4d-d041-458e-9688-682b5f4cb491 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:36.229091 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e81e8c4d-d041-458e-9688-682b5f4cb491 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:36.229730 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e81e8c4d-d041-458e-9688-682b5f4cb491 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:36.449609 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-e81e8c4d-d041-458e-9688-682b5f4cb491 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1682f1a60045d8a04d4d67393cd13f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b00cd9fa8e40a0919b61fcd60269f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:11:36.462014 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-e81e8c4d-d041-458e-9688-682b5f4cb491 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "GET /compute/v2.1/servers/d9a1b9b5-318a-41a8-ba1c-0ad6a55e9840" status: 200 len: 1512 microversion: 2.1 time: 0.256428 Oct 04 22:11:36.479985 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2635/5215] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:11:36 2022] GET /compute/v2.1/servers/d9a1b9b5-318a-41a8-ba1c-0ad6a55e9840 => generated 1512 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:11:37.493824 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-d5f81eb5-9fbf-4a1e-b069-8ec7a7e3fc27 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:11:37.494619 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-d5f81eb5-9fbf-4a1e-b069-8ec7a7e3fc27 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: d9a1b9b5-318a-41a8-ba1c-0ad6a55e9840] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:11:37.504446 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d5f81eb5-9fbf-4a1e-b069-8ec7a7e3fc27 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:37.505264 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d5f81eb5-9fbf-4a1e-b069-8ec7a7e3fc27 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:37.506093 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d5f81eb5-9fbf-4a1e-b069-8ec7a7e3fc27 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:37.507025 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d5f81eb5-9fbf-4a1e-b069-8ec7a7e3fc27 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:37.507968 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d5f81eb5-9fbf-4a1e-b069-8ec7a7e3fc27 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:37.508588 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d5f81eb5-9fbf-4a1e-b069-8ec7a7e3fc27 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:37.730915 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-d5f81eb5-9fbf-4a1e-b069-8ec7a7e3fc27 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1682f1a60045d8a04d4d67393cd13f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b00cd9fa8e40a0919b61fcd60269f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:11:37.741598 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-d5f81eb5-9fbf-4a1e-b069-8ec7a7e3fc27 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "GET /compute/v2.1/servers/d9a1b9b5-318a-41a8-ba1c-0ad6a55e9840" status: 200 len: 1512 microversion: 2.1 time: 0.251801 Oct 04 22:11:37.742972 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2581/5216] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:11:37 2022] GET /compute/v2.1/servers/d9a1b9b5-318a-41a8-ba1c-0ad6a55e9840 => generated 1512 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:11:38.767549 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-703ef47a-c389-4929-aa81-217b4c22d513 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:11:38.768183 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-703ef47a-c389-4929-aa81-217b4c22d513 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: d9a1b9b5-318a-41a8-ba1c-0ad6a55e9840] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:11:38.786350 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-703ef47a-c389-4929-aa81-217b4c22d513 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:38.787271 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-703ef47a-c389-4929-aa81-217b4c22d513 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:38.787729 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-703ef47a-c389-4929-aa81-217b4c22d513 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:38.788467 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-703ef47a-c389-4929-aa81-217b4c22d513 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:38.788935 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-703ef47a-c389-4929-aa81-217b4c22d513 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:38.789374 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-703ef47a-c389-4929-aa81-217b4c22d513 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:39.025021 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-703ef47a-c389-4929-aa81-217b4c22d513 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1682f1a60045d8a04d4d67393cd13f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b00cd9fa8e40a0919b61fcd60269f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:11:39.035126 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-703ef47a-c389-4929-aa81-217b4c22d513 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "GET /compute/v2.1/servers/d9a1b9b5-318a-41a8-ba1c-0ad6a55e9840" status: 200 len: 1512 microversion: 2.1 time: 0.271757 Oct 04 22:11:39.036009 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2636/5217] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:11:38 2022] GET /compute/v2.1/servers/d9a1b9b5-318a-41a8-ba1c-0ad6a55e9840 => generated 1512 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:11:40.059888 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-8f3907d7-fabd-4cc0-8229-7949473ffd6a tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:11:40.061479 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-8f3907d7-fabd-4cc0-8229-7949473ffd6a tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: d9a1b9b5-318a-41a8-ba1c-0ad6a55e9840] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:11:40.070955 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8f3907d7-fabd-4cc0-8229-7949473ffd6a tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:40.071783 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8f3907d7-fabd-4cc0-8229-7949473ffd6a tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:40.072229 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8f3907d7-fabd-4cc0-8229-7949473ffd6a tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:40.072971 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8f3907d7-fabd-4cc0-8229-7949473ffd6a tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:40.073613 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8f3907d7-fabd-4cc0-8229-7949473ffd6a tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:40.074051 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8f3907d7-fabd-4cc0-8229-7949473ffd6a tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:40.312986 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-8f3907d7-fabd-4cc0-8229-7949473ffd6a tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1682f1a60045d8a04d4d67393cd13f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b00cd9fa8e40a0919b61fcd60269f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:11:40.334938 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-8f3907d7-fabd-4cc0-8229-7949473ffd6a tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "GET /compute/v2.1/servers/d9a1b9b5-318a-41a8-ba1c-0ad6a55e9840" status: 200 len: 1512 microversion: 2.1 time: 0.279982 Oct 04 22:11:40.335536 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2582/5218] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:11:40 2022] GET /compute/v2.1/servers/d9a1b9b5-318a-41a8-ba1c-0ad6a55e9840 => generated 1512 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:11:41.359389 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-03397dd5-efcb-46c7-8529-1931f9819c30 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:11:41.360600 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-03397dd5-efcb-46c7-8529-1931f9819c30 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: d9a1b9b5-318a-41a8-ba1c-0ad6a55e9840] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:11:41.370043 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-03397dd5-efcb-46c7-8529-1931f9819c30 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:41.374712 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-03397dd5-efcb-46c7-8529-1931f9819c30 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:41.376401 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-03397dd5-efcb-46c7-8529-1931f9819c30 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:41.378122 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-03397dd5-efcb-46c7-8529-1931f9819c30 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:41.380427 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-03397dd5-efcb-46c7-8529-1931f9819c30 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:41.381101 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-03397dd5-efcb-46c7-8529-1931f9819c30 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:41.396994 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=1 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:11:41.576546 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-03397dd5-efcb-46c7-8529-1931f9819c30 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1682f1a60045d8a04d4d67393cd13f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b00cd9fa8e40a0919b61fcd60269f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:11:41.586518 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-03397dd5-efcb-46c7-8529-1931f9819c30 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "GET /compute/v2.1/servers/d9a1b9b5-318a-41a8-ba1c-0ad6a55e9840" status: 200 len: 1512 microversion: 2.1 time: 0.231271 Oct 04 22:11:41.586908 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2637/5219] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:11:41 2022] GET /compute/v2.1/servers/d9a1b9b5-318a-41a8-ba1c-0ad6a55e9840 => generated 1512 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:11:42.613398 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-f00eda43-263d-444c-a9ca-b43996af91c3 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:11:42.614011 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-f00eda43-263d-444c-a9ca-b43996af91c3 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: d9a1b9b5-318a-41a8-ba1c-0ad6a55e9840] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:11:42.622100 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f00eda43-263d-444c-a9ca-b43996af91c3 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:42.623628 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f00eda43-263d-444c-a9ca-b43996af91c3 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:42.624264 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f00eda43-263d-444c-a9ca-b43996af91c3 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:42.625157 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f00eda43-263d-444c-a9ca-b43996af91c3 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:42.625787 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f00eda43-263d-444c-a9ca-b43996af91c3 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:42.626421 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f00eda43-263d-444c-a9ca-b43996af91c3 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:42.883234 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-f00eda43-263d-444c-a9ca-b43996af91c3 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1682f1a60045d8a04d4d67393cd13f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b00cd9fa8e40a0919b61fcd60269f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:11:42.901888 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-f00eda43-263d-444c-a9ca-b43996af91c3 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "GET /compute/v2.1/servers/d9a1b9b5-318a-41a8-ba1c-0ad6a55e9840" status: 200 len: 1512 microversion: 2.1 time: 0.291227 Oct 04 22:11:42.905483 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2583/5220] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:11:42 2022] GET /compute/v2.1/servers/d9a1b9b5-318a-41a8-ba1c-0ad6a55e9840 => generated 1512 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:11:43.934786 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-bed6b764-78ed-459b-a6a2-c475ef3029ed tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:11:43.936632 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-bed6b764-78ed-459b-a6a2-c475ef3029ed tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: d9a1b9b5-318a-41a8-ba1c-0ad6a55e9840] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:11:43.944312 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bed6b764-78ed-459b-a6a2-c475ef3029ed tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:43.944822 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bed6b764-78ed-459b-a6a2-c475ef3029ed tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:43.945214 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bed6b764-78ed-459b-a6a2-c475ef3029ed tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:43.945912 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bed6b764-78ed-459b-a6a2-c475ef3029ed tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:43.946593 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bed6b764-78ed-459b-a6a2-c475ef3029ed tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:43.947024 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bed6b764-78ed-459b-a6a2-c475ef3029ed tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:44.236479 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-bed6b764-78ed-459b-a6a2-c475ef3029ed tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1682f1a60045d8a04d4d67393cd13f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b00cd9fa8e40a0919b61fcd60269f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:11:44.246475 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-bed6b764-78ed-459b-a6a2-c475ef3029ed tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "GET /compute/v2.1/servers/d9a1b9b5-318a-41a8-ba1c-0ad6a55e9840" status: 200 len: 1512 microversion: 2.1 time: 0.316197 Oct 04 22:11:44.247421 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2638/5221] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:11:43 2022] GET /compute/v2.1/servers/d9a1b9b5-318a-41a8-ba1c-0ad6a55e9840 => generated 1512 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:11:45.272401 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e74d003e-3d05-4524-b017-b4f6d117ac2e tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:11:45.274326 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-e74d003e-3d05-4524-b017-b4f6d117ac2e tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: d9a1b9b5-318a-41a8-ba1c-0ad6a55e9840] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:11:45.291311 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e74d003e-3d05-4524-b017-b4f6d117ac2e tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:45.293017 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e74d003e-3d05-4524-b017-b4f6d117ac2e tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:45.293712 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e74d003e-3d05-4524-b017-b4f6d117ac2e tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:45.295362 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e74d003e-3d05-4524-b017-b4f6d117ac2e tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:45.296075 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e74d003e-3d05-4524-b017-b4f6d117ac2e tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:45.296707 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e74d003e-3d05-4524-b017-b4f6d117ac2e tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:45.563148 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-e74d003e-3d05-4524-b017-b4f6d117ac2e tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1682f1a60045d8a04d4d67393cd13f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b00cd9fa8e40a0919b61fcd60269f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:11:45.585283 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-e74d003e-3d05-4524-b017-b4f6d117ac2e tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "GET /compute/v2.1/servers/d9a1b9b5-318a-41a8-ba1c-0ad6a55e9840" status: 200 len: 1512 microversion: 2.1 time: 0.318339 Oct 04 22:11:45.587458 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2584/5222] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:11:45 2022] GET /compute/v2.1/servers/d9a1b9b5-318a-41a8-ba1c-0ad6a55e9840 => generated 1512 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:11:46.610135 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-51115eab-8365-4196-a727-cd3b2e175a37 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:11:46.611398 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-51115eab-8365-4196-a727-cd3b2e175a37 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: d9a1b9b5-318a-41a8-ba1c-0ad6a55e9840] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:11:46.620226 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-51115eab-8365-4196-a727-cd3b2e175a37 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:46.625513 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-51115eab-8365-4196-a727-cd3b2e175a37 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:46.626393 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-51115eab-8365-4196-a727-cd3b2e175a37 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:46.627320 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-51115eab-8365-4196-a727-cd3b2e175a37 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:46.628196 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-51115eab-8365-4196-a727-cd3b2e175a37 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:46.630977 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-51115eab-8365-4196-a727-cd3b2e175a37 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:46.955904 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-51115eab-8365-4196-a727-cd3b2e175a37 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1682f1a60045d8a04d4d67393cd13f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b00cd9fa8e40a0919b61fcd60269f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:11:46.964026 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-51115eab-8365-4196-a727-cd3b2e175a37 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "GET /compute/v2.1/servers/d9a1b9b5-318a-41a8-ba1c-0ad6a55e9840" status: 200 len: 1512 microversion: 2.1 time: 0.358846 Oct 04 22:11:46.978999 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2639/5223] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:11:46 2022] GET /compute/v2.1/servers/d9a1b9b5-318a-41a8-ba1c-0ad6a55e9840 => generated 1512 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:11:47.993719 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-7e06af34-0996-4bf6-b418-3f5edf70c7a8 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:11:47.995268 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-7e06af34-0996-4bf6-b418-3f5edf70c7a8 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: d9a1b9b5-318a-41a8-ba1c-0ad6a55e9840] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:11:48.021730 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7e06af34-0996-4bf6-b418-3f5edf70c7a8 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:48.024014 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7e06af34-0996-4bf6-b418-3f5edf70c7a8 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:48.024545 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7e06af34-0996-4bf6-b418-3f5edf70c7a8 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:48.025469 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7e06af34-0996-4bf6-b418-3f5edf70c7a8 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:48.026084 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7e06af34-0996-4bf6-b418-3f5edf70c7a8 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:48.026710 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7e06af34-0996-4bf6-b418-3f5edf70c7a8 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:48.309434 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-7e06af34-0996-4bf6-b418-3f5edf70c7a8 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1682f1a60045d8a04d4d67393cd13f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b00cd9fa8e40a0919b61fcd60269f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:11:48.325260 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-7e06af34-0996-4bf6-b418-3f5edf70c7a8 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "GET /compute/v2.1/servers/d9a1b9b5-318a-41a8-ba1c-0ad6a55e9840" status: 200 len: 1512 microversion: 2.1 time: 0.338632 Oct 04 22:11:48.326508 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2585/5224] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:11:47 2022] GET /compute/v2.1/servers/d9a1b9b5-318a-41a8-ba1c-0ad6a55e9840 => generated 1512 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:11:48.587413 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-dcf70f54-a537-4587-914a-f3dbee2be989 tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-856395420", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452", "networks": [{"uuid": "d03fea29-7d4b-4264-89ad-dd07a6cded96"}]}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:11:48.647261 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.network.neutron [None req-dcf70f54-a537-4587-914a-f3dbee2be989 tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] validate_networks() for [('d03fea29-7d4b-4264-89ad-dd07a6cded96', None, None, None, None, None)] {{(pid=134102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 22:11:49.033395 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-dcf70f54-a537-4587-914a-f3dbee2be989 tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] Flavor limits 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 22:11:49.033953 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-dcf70f54-a537-4587-914a-f3dbee2be989 tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] Image limits 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 22:11:49.034545 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-dcf70f54-a537-4587-914a-f3dbee2be989 tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] Flavor pref 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 22:11:49.034990 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-dcf70f54-a537-4587-914a-f3dbee2be989 tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] Image pref 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 22:11:49.035410 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-dcf70f54-a537-4587-914a-f3dbee2be989 tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 22:11:49.045032 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dcf70f54-a537-4587-914a-f3dbee2be989 tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:49.045520 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dcf70f54-a537-4587-914a-f3dbee2be989 tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:49.045966 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dcf70f54-a537-4587-914a-f3dbee2be989 tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:49.046740 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dcf70f54-a537-4587-914a-f3dbee2be989 tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:49.047204 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dcf70f54-a537-4587-914a-f3dbee2be989 tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:49.047637 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dcf70f54-a537-4587-914a-f3dbee2be989 tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:49.066801 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-dcf70f54-a537-4587-914a-f3dbee2be989 tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] Getting quotas for project 7339865eaa564b7d9b145fb58acc60f9. Resources: {'instances', 'ram', 'cores'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:11:49.072362 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-dcf70f54-a537-4587-914a-f3dbee2be989 tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] Getting quotas for user e1ec7439438f46caa7a08170089338b7 and project 7339865eaa564b7d9b145fb58acc60f9. Resources: {'instances', 'ram', 'cores'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:11:49.088484 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-dcf70f54-a537-4587-914a-f3dbee2be989 tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] Going to run 1 instances... {{(pid=134102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 22:11:49.090912 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-dcf70f54-a537-4587-914a-f3dbee2be989 tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] [instance: 3086c8a4-4db9-459b-8fdb-1a27c1c42d75] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='58548514-5dac-426c-81f5-19e3fba33e23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 22:11:49.152796 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-dcf70f54-a537-4587-914a-f3dbee2be989 tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.715987 Oct 04 22:11:49.157181 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2640/5225] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 22:11:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 722 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 22:11:49.170908 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-66f6be07-923e-4f86-8014-42695e305799 tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:11:49.171565 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-66f6be07-923e-4f86-8014-42695e305799 tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] [instance: 3086c8a4-4db9-459b-8fdb-1a27c1c42d75] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:11:49.233604 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-66f6be07-923e-4f86-8014-42695e305799 tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ec7439438f46caa7a08170089338b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7339865eaa564b7d9b145fb58acc60f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:11:49.241671 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-66f6be07-923e-4f86-8014-42695e305799 tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] 10.222.0.43 "GET /compute/v2.1/servers/3086c8a4-4db9-459b-8fdb-1a27c1c42d75" status: 200 len: 1213 microversion: 2.1 time: 0.076821 Oct 04 22:11:49.242302 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2586/5226] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:11:49 2022] GET /compute/v2.1/servers/3086c8a4-4db9-459b-8fdb-1a27c1c42d75 => generated 1213 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:11:49.349111 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-2e422651-e35c-4dff-b626-a27b0a18c3ee tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:11:49.349817 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-2e422651-e35c-4dff-b626-a27b0a18c3ee tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: d9a1b9b5-318a-41a8-ba1c-0ad6a55e9840] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:11:49.359401 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2e422651-e35c-4dff-b626-a27b0a18c3ee tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:49.360087 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2e422651-e35c-4dff-b626-a27b0a18c3ee tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:49.361313 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2e422651-e35c-4dff-b626-a27b0a18c3ee tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:49.362056 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2e422651-e35c-4dff-b626-a27b0a18c3ee tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:49.362675 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2e422651-e35c-4dff-b626-a27b0a18c3ee tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:49.363796 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2e422651-e35c-4dff-b626-a27b0a18c3ee tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:49.548920 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-2e422651-e35c-4dff-b626-a27b0a18c3ee tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1682f1a60045d8a04d4d67393cd13f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b00cd9fa8e40a0919b61fcd60269f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:11:49.562803 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-2e422651-e35c-4dff-b626-a27b0a18c3ee tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "GET /compute/v2.1/servers/d9a1b9b5-318a-41a8-ba1c-0ad6a55e9840" status: 200 len: 1512 microversion: 2.1 time: 0.217473 Oct 04 22:11:49.563590 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2641/5227] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:11:49 2022] GET /compute/v2.1/servers/d9a1b9b5-318a-41a8-ba1c-0ad6a55e9840 => generated 1512 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:11:50.264657 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-c40f759b-1ef9-48f6-b844-ecbb90e10a1c tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:11:50.265299 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-c40f759b-1ef9-48f6-b844-ecbb90e10a1c tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] [instance: 3086c8a4-4db9-459b-8fdb-1a27c1c42d75] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:11:50.273001 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c40f759b-1ef9-48f6-b844-ecbb90e10a1c tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:50.273483 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c40f759b-1ef9-48f6-b844-ecbb90e10a1c tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:50.273915 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c40f759b-1ef9-48f6-b844-ecbb90e10a1c tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:50.274646 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c40f759b-1ef9-48f6-b844-ecbb90e10a1c tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:50.275208 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c40f759b-1ef9-48f6-b844-ecbb90e10a1c tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:50.275515 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c40f759b-1ef9-48f6-b844-ecbb90e10a1c tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:50.348375 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-c40f759b-1ef9-48f6-b844-ecbb90e10a1c tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ec7439438f46caa7a08170089338b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7339865eaa564b7d9b145fb58acc60f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:11:50.362990 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-c40f759b-1ef9-48f6-b844-ecbb90e10a1c tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] 10.222.0.43 "GET /compute/v2.1/servers/3086c8a4-4db9-459b-8fdb-1a27c1c42d75" status: 200 len: 1265 microversion: 2.1 time: 0.102300 Oct 04 22:11:50.369530 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2587/5228] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:11:50 2022] GET /compute/v2.1/servers/3086c8a4-4db9-459b-8fdb-1a27c1c42d75 => generated 1265 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:11:50.588221 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-8a86080d-bcaf-460b-bf35-f0113f1458aa tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:11:50.588835 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-8a86080d-bcaf-460b-bf35-f0113f1458aa tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: d9a1b9b5-318a-41a8-ba1c-0ad6a55e9840] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:11:50.600897 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8a86080d-bcaf-460b-bf35-f0113f1458aa tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:50.604991 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8a86080d-bcaf-460b-bf35-f0113f1458aa tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:50.608508 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8a86080d-bcaf-460b-bf35-f0113f1458aa tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:50.609307 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8a86080d-bcaf-460b-bf35-f0113f1458aa tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:50.609824 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8a86080d-bcaf-460b-bf35-f0113f1458aa tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:50.610336 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8a86080d-bcaf-460b-bf35-f0113f1458aa tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:50.769873 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-8a86080d-bcaf-460b-bf35-f0113f1458aa tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1682f1a60045d8a04d4d67393cd13f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b00cd9fa8e40a0919b61fcd60269f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:11:50.777803 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-8a86080d-bcaf-460b-bf35-f0113f1458aa tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "GET /compute/v2.1/servers/d9a1b9b5-318a-41a8-ba1c-0ad6a55e9840" status: 200 len: 1512 microversion: 2.1 time: 0.193664 Oct 04 22:11:50.778426 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2642/5229] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:11:50 2022] GET /compute/v2.1/servers/d9a1b9b5-318a-41a8-ba1c-0ad6a55e9840 => generated 1512 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:11:51.388900 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-f57fa7b0-57be-450d-ba8f-997ef5bedbd8 tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:11:51.390273 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-f57fa7b0-57be-450d-ba8f-997ef5bedbd8 tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] [instance: 3086c8a4-4db9-459b-8fdb-1a27c1c42d75] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:11:51.398160 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f57fa7b0-57be-450d-ba8f-997ef5bedbd8 tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:51.398808 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f57fa7b0-57be-450d-ba8f-997ef5bedbd8 tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:51.399340 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f57fa7b0-57be-450d-ba8f-997ef5bedbd8 tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:51.400132 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f57fa7b0-57be-450d-ba8f-997ef5bedbd8 tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:51.400694 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f57fa7b0-57be-450d-ba8f-997ef5bedbd8 tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:51.401209 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f57fa7b0-57be-450d-ba8f-997ef5bedbd8 tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:51.754043 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-f57fa7b0-57be-450d-ba8f-997ef5bedbd8 tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ec7439438f46caa7a08170089338b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7339865eaa564b7d9b145fb58acc60f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:11:51.764093 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-f57fa7b0-57be-450d-ba8f-997ef5bedbd8 tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] 10.222.0.43 "GET /compute/v2.1/servers/3086c8a4-4db9-459b-8fdb-1a27c1c42d75" status: 200 len: 1313 microversion: 2.1 time: 0.379858 Oct 04 22:11:51.764803 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2588/5230] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:11:51 2022] GET /compute/v2.1/servers/3086c8a4-4db9-459b-8fdb-1a27c1c42d75 => generated 1313 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:11:51.802272 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-00ffe1e0-aeab-483b-a7d8-e9b1f9bc3f09 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:11:51.803114 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-00ffe1e0-aeab-483b-a7d8-e9b1f9bc3f09 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: d9a1b9b5-318a-41a8-ba1c-0ad6a55e9840] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:11:51.811528 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-00ffe1e0-aeab-483b-a7d8-e9b1f9bc3f09 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:51.812183 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-00ffe1e0-aeab-483b-a7d8-e9b1f9bc3f09 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:51.812800 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-00ffe1e0-aeab-483b-a7d8-e9b1f9bc3f09 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:51.813706 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-00ffe1e0-aeab-483b-a7d8-e9b1f9bc3f09 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:51.814165 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-00ffe1e0-aeab-483b-a7d8-e9b1f9bc3f09 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:51.814625 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-00ffe1e0-aeab-483b-a7d8-e9b1f9bc3f09 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:52.111472 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-00ffe1e0-aeab-483b-a7d8-e9b1f9bc3f09 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1682f1a60045d8a04d4d67393cd13f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b00cd9fa8e40a0919b61fcd60269f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:11:52.122109 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-00ffe1e0-aeab-483b-a7d8-e9b1f9bc3f09 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "GET /compute/v2.1/servers/d9a1b9b5-318a-41a8-ba1c-0ad6a55e9840" status: 200 len: 1512 microversion: 2.1 time: 0.323929 Oct 04 22:11:52.122862 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2643/5231] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:11:51 2022] GET /compute/v2.1/servers/d9a1b9b5-318a-41a8-ba1c-0ad6a55e9840 => generated 1512 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:11:52.635181 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-c9422f21-0128-49cb-87c0-bdc652ca5913 req-bb25cabb-ca04-4521-ba32-5c6de501b812 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3086c8a4-4db9-459b-8fdb-1a27c1c42d75", "tag": "deb2dae3-a943-45ba-b9df-48c49e206091"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:11:52.651665 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-c9422f21-0128-49cb-87c0-bdc652ca5913 req-bb25cabb-ca04-4521-ba32-5c6de501b812 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:52.652204 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-c9422f21-0128-49cb-87c0-bdc652ca5913 req-bb25cabb-ca04-4521-ba32-5c6de501b812 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:52.652725 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-c9422f21-0128-49cb-87c0-bdc652ca5913 req-bb25cabb-ca04-4521-ba32-5c6de501b812 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:52.666346 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-c9422f21-0128-49cb-87c0-bdc652ca5913 req-bb25cabb-ca04-4521-ba32-5c6de501b812 service nova] Creating event network-changed:deb2dae3-a943-45ba-b9df-48c49e206091 for instance 3086c8a4-4db9-459b-8fdb-1a27c1c42d75 on n-h2-860284-1 Oct 04 22:11:52.672904 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-c9422f21-0128-49cb-87c0-bdc652ca5913 req-bb25cabb-ca04-4521-ba32-5c6de501b812 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044104 Oct 04 22:11:52.673987 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2589/5232] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:11:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:11:52.788575 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-399b83d9-69b7-4914-96b4-8fbff4ebae90 tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:11:52.789207 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-399b83d9-69b7-4914-96b4-8fbff4ebae90 tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] [instance: 3086c8a4-4db9-459b-8fdb-1a27c1c42d75] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:11:52.796177 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-399b83d9-69b7-4914-96b4-8fbff4ebae90 tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:52.796721 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-399b83d9-69b7-4914-96b4-8fbff4ebae90 tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:52.797202 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-399b83d9-69b7-4914-96b4-8fbff4ebae90 tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:52.797921 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-399b83d9-69b7-4914-96b4-8fbff4ebae90 tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:52.798434 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-399b83d9-69b7-4914-96b4-8fbff4ebae90 tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:52.798869 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-399b83d9-69b7-4914-96b4-8fbff4ebae90 tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:53.016823 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-399b83d9-69b7-4914-96b4-8fbff4ebae90 tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ec7439438f46caa7a08170089338b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7339865eaa564b7d9b145fb58acc60f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:11:53.024910 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-399b83d9-69b7-4914-96b4-8fbff4ebae90 tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] 10.222.0.43 "GET /compute/v2.1/servers/3086c8a4-4db9-459b-8fdb-1a27c1c42d75" status: 200 len: 1313 microversion: 2.1 time: 0.240751 Oct 04 22:11:53.025656 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2644/5233] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:11:52 2022] GET /compute/v2.1/servers/3086c8a4-4db9-459b-8fdb-1a27c1c42d75 => generated 1313 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:11:53.148367 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-d71e5259-d591-4792-a7fa-9144aad08b32 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:11:53.149075 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-d71e5259-d591-4792-a7fa-9144aad08b32 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: d9a1b9b5-318a-41a8-ba1c-0ad6a55e9840] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:11:53.155752 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d71e5259-d591-4792-a7fa-9144aad08b32 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:53.156245 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d71e5259-d591-4792-a7fa-9144aad08b32 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:53.156686 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d71e5259-d591-4792-a7fa-9144aad08b32 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:53.157389 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d71e5259-d591-4792-a7fa-9144aad08b32 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:53.157843 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d71e5259-d591-4792-a7fa-9144aad08b32 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:53.158266 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d71e5259-d591-4792-a7fa-9144aad08b32 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:53.408970 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-d71e5259-d591-4792-a7fa-9144aad08b32 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1682f1a60045d8a04d4d67393cd13f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b00cd9fa8e40a0919b61fcd60269f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:11:53.417254 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-d71e5259-d591-4792-a7fa-9144aad08b32 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "GET /compute/v2.1/servers/d9a1b9b5-318a-41a8-ba1c-0ad6a55e9840" status: 200 len: 1512 microversion: 2.1 time: 0.273123 Oct 04 22:11:53.417839 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2590/5234] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:11:53 2022] GET /compute/v2.1/servers/d9a1b9b5-318a-41a8-ba1c-0ad6a55e9840 => generated 1512 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:11:54.048145 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-44024326-62f4-425b-9f13-c4090f2470d2 tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:11:54.048683 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-44024326-62f4-425b-9f13-c4090f2470d2 tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] [instance: 3086c8a4-4db9-459b-8fdb-1a27c1c42d75] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:11:54.055648 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-44024326-62f4-425b-9f13-c4090f2470d2 tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:54.056128 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-44024326-62f4-425b-9f13-c4090f2470d2 tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:54.056560 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-44024326-62f4-425b-9f13-c4090f2470d2 tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:54.057249 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-44024326-62f4-425b-9f13-c4090f2470d2 tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:54.057697 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-44024326-62f4-425b-9f13-c4090f2470d2 tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:54.058120 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-44024326-62f4-425b-9f13-c4090f2470d2 tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:54.236334 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-44024326-62f4-425b-9f13-c4090f2470d2 tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ec7439438f46caa7a08170089338b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7339865eaa564b7d9b145fb58acc60f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:11:54.244433 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-44024326-62f4-425b-9f13-c4090f2470d2 tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] 10.222.0.43 "GET /compute/v2.1/servers/3086c8a4-4db9-459b-8fdb-1a27c1c42d75" status: 200 len: 1313 microversion: 2.1 time: 0.200317 Oct 04 22:11:54.245030 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2645/5235] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:11:54 2022] GET /compute/v2.1/servers/3086c8a4-4db9-459b-8fdb-1a27c1c42d75 => generated 1313 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:11:54.441338 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-8a3f2446-9bee-4f03-b05e-b1598b354701 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:11:54.441995 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-8a3f2446-9bee-4f03-b05e-b1598b354701 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: d9a1b9b5-318a-41a8-ba1c-0ad6a55e9840] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:11:54.448960 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8a3f2446-9bee-4f03-b05e-b1598b354701 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:54.449453 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8a3f2446-9bee-4f03-b05e-b1598b354701 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:54.449899 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8a3f2446-9bee-4f03-b05e-b1598b354701 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:54.451216 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8a3f2446-9bee-4f03-b05e-b1598b354701 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:54.451682 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8a3f2446-9bee-4f03-b05e-b1598b354701 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:54.452112 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8a3f2446-9bee-4f03-b05e-b1598b354701 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:54.592147 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-8a3f2446-9bee-4f03-b05e-b1598b354701 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1682f1a60045d8a04d4d67393cd13f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b00cd9fa8e40a0919b61fcd60269f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:11:54.595020 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:11:54.602208 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-8a3f2446-9bee-4f03-b05e-b1598b354701 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "GET /compute/v2.1/servers/d9a1b9b5-318a-41a8-ba1c-0ad6a55e9840" status: 200 len: 1512 microversion: 2.1 time: 0.164931 Oct 04 22:11:54.602746 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2591/5236] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:11:54 2022] GET /compute/v2.1/servers/d9a1b9b5-318a-41a8-ba1c-0ad6a55e9840 => generated 1512 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:11:55.272843 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-3b3af4fd-fa04-4502-a04a-3bda669b149a tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:11:55.273463 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-3b3af4fd-fa04-4502-a04a-3bda669b149a tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] [instance: 3086c8a4-4db9-459b-8fdb-1a27c1c42d75] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:11:55.280569 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3b3af4fd-fa04-4502-a04a-3bda669b149a tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:55.281066 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3b3af4fd-fa04-4502-a04a-3bda669b149a tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:55.281510 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3b3af4fd-fa04-4502-a04a-3bda669b149a tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:55.282225 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3b3af4fd-fa04-4502-a04a-3bda669b149a tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:55.282910 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3b3af4fd-fa04-4502-a04a-3bda669b149a tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:55.283344 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3b3af4fd-fa04-4502-a04a-3bda669b149a tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:55.434085 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-3b3af4fd-fa04-4502-a04a-3bda669b149a tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ec7439438f46caa7a08170089338b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7339865eaa564b7d9b145fb58acc60f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:11:55.443615 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-3b3af4fd-fa04-4502-a04a-3bda669b149a tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] 10.222.0.43 "GET /compute/v2.1/servers/3086c8a4-4db9-459b-8fdb-1a27c1c42d75" status: 200 len: 1313 microversion: 2.1 time: 0.174660 Oct 04 22:11:55.444231 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2646/5237] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:11:55 2022] GET /compute/v2.1/servers/3086c8a4-4db9-459b-8fdb-1a27c1c42d75 => generated 1313 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:11:55.626853 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-45074b98-1e3e-4d08-8043-0ad5f5afe24d tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:11:55.627656 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-45074b98-1e3e-4d08-8043-0ad5f5afe24d tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: d9a1b9b5-318a-41a8-ba1c-0ad6a55e9840] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:11:55.630656 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=40 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:11:55.637927 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-45074b98-1e3e-4d08-8043-0ad5f5afe24d tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:55.638771 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-45074b98-1e3e-4d08-8043-0ad5f5afe24d tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:55.639378 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-45074b98-1e3e-4d08-8043-0ad5f5afe24d tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:55.640173 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-45074b98-1e3e-4d08-8043-0ad5f5afe24d tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:55.640798 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-45074b98-1e3e-4d08-8043-0ad5f5afe24d tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:55.641236 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-45074b98-1e3e-4d08-8043-0ad5f5afe24d tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:55.780130 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-45074b98-1e3e-4d08-8043-0ad5f5afe24d tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1682f1a60045d8a04d4d67393cd13f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b00cd9fa8e40a0919b61fcd60269f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:11:55.788571 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-45074b98-1e3e-4d08-8043-0ad5f5afe24d tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "GET /compute/v2.1/servers/d9a1b9b5-318a-41a8-ba1c-0ad6a55e9840" status: 200 len: 1512 microversion: 2.1 time: 0.167168 Oct 04 22:11:55.789162 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2592/5238] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:11:55 2022] GET /compute/v2.1/servers/d9a1b9b5-318a-41a8-ba1c-0ad6a55e9840 => generated 1512 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:11:56.467961 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-622c3dc0-ac20-4952-a381-a109aab8697f tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:11:56.468844 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-622c3dc0-ac20-4952-a381-a109aab8697f tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] [instance: 3086c8a4-4db9-459b-8fdb-1a27c1c42d75] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:11:56.475994 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-622c3dc0-ac20-4952-a381-a109aab8697f tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:56.476682 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-622c3dc0-ac20-4952-a381-a109aab8697f tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:56.477312 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-622c3dc0-ac20-4952-a381-a109aab8697f tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:56.478033 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-622c3dc0-ac20-4952-a381-a109aab8697f tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:56.478533 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-622c3dc0-ac20-4952-a381-a109aab8697f tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:56.478982 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-622c3dc0-ac20-4952-a381-a109aab8697f tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:56.637702 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-622c3dc0-ac20-4952-a381-a109aab8697f tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ec7439438f46caa7a08170089338b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7339865eaa564b7d9b145fb58acc60f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:11:56.647834 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-622c3dc0-ac20-4952-a381-a109aab8697f tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] 10.222.0.43 "GET /compute/v2.1/servers/3086c8a4-4db9-459b-8fdb-1a27c1c42d75" status: 200 len: 1313 microversion: 2.1 time: 0.185122 Oct 04 22:11:56.649031 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2647/5239] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:11:56 2022] GET /compute/v2.1/servers/3086c8a4-4db9-459b-8fdb-1a27c1c42d75 => generated 1313 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:11:56.813350 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-f393c966-00b6-40ba-9010-a594a87c03ae tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:11:56.813956 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-f393c966-00b6-40ba-9010-a594a87c03ae tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: d9a1b9b5-318a-41a8-ba1c-0ad6a55e9840] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:11:56.821126 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f393c966-00b6-40ba-9010-a594a87c03ae tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:56.821606 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f393c966-00b6-40ba-9010-a594a87c03ae tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:56.822086 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f393c966-00b6-40ba-9010-a594a87c03ae tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:56.822755 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f393c966-00b6-40ba-9010-a594a87c03ae tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:56.823204 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f393c966-00b6-40ba-9010-a594a87c03ae tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:56.823625 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f393c966-00b6-40ba-9010-a594a87c03ae tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:57.062320 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-f393c966-00b6-40ba-9010-a594a87c03ae tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1682f1a60045d8a04d4d67393cd13f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b00cd9fa8e40a0919b61fcd60269f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:11:57.071918 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-f393c966-00b6-40ba-9010-a594a87c03ae tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "GET /compute/v2.1/servers/d9a1b9b5-318a-41a8-ba1c-0ad6a55e9840" status: 200 len: 1512 microversion: 2.1 time: 0.263110 Oct 04 22:11:57.072582 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2593/5240] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:11:56 2022] GET /compute/v2.1/servers/d9a1b9b5-318a-41a8-ba1c-0ad6a55e9840 => generated 1512 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:11:57.674673 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-96c12346-947a-40ed-a6e4-46cebafe3c80 tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:11:57.678466 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-96c12346-947a-40ed-a6e4-46cebafe3c80 tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] [instance: 3086c8a4-4db9-459b-8fdb-1a27c1c42d75] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:11:57.685740 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-96c12346-947a-40ed-a6e4-46cebafe3c80 tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:57.686805 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-96c12346-947a-40ed-a6e4-46cebafe3c80 tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:57.687556 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-96c12346-947a-40ed-a6e4-46cebafe3c80 tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:57.688505 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-96c12346-947a-40ed-a6e4-46cebafe3c80 tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:57.689144 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-96c12346-947a-40ed-a6e4-46cebafe3c80 tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:57.689726 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-96c12346-947a-40ed-a6e4-46cebafe3c80 tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:57.956287 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-96c12346-947a-40ed-a6e4-46cebafe3c80 tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ec7439438f46caa7a08170089338b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7339865eaa564b7d9b145fb58acc60f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:11:57.966207 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-96c12346-947a-40ed-a6e4-46cebafe3c80 tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] 10.222.0.43 "GET /compute/v2.1/servers/3086c8a4-4db9-459b-8fdb-1a27c1c42d75" status: 200 len: 1313 microversion: 2.1 time: 0.296691 Oct 04 22:11:57.967588 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2648/5241] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:11:57 2022] GET /compute/v2.1/servers/3086c8a4-4db9-459b-8fdb-1a27c1c42d75 => generated 1313 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:11:58.095041 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-30f64cdb-20d2-4610-b427-3062e8c117ce tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:11:58.096257 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-30f64cdb-20d2-4610-b427-3062e8c117ce tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: d9a1b9b5-318a-41a8-ba1c-0ad6a55e9840] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:11:58.103685 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-30f64cdb-20d2-4610-b427-3062e8c117ce tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:58.104470 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-30f64cdb-20d2-4610-b427-3062e8c117ce tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:58.104914 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-30f64cdb-20d2-4610-b427-3062e8c117ce tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:58.105628 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-30f64cdb-20d2-4610-b427-3062e8c117ce tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:58.106081 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-30f64cdb-20d2-4610-b427-3062e8c117ce tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:58.106986 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-30f64cdb-20d2-4610-b427-3062e8c117ce tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:58.360964 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-30f64cdb-20d2-4610-b427-3062e8c117ce tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1682f1a60045d8a04d4d67393cd13f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b00cd9fa8e40a0919b61fcd60269f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:11:58.370585 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-30f64cdb-20d2-4610-b427-3062e8c117ce tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "GET /compute/v2.1/servers/d9a1b9b5-318a-41a8-ba1c-0ad6a55e9840" status: 200 len: 1512 microversion: 2.1 time: 0.279473 Oct 04 22:11:58.371176 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2594/5242] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:11:58 2022] GET /compute/v2.1/servers/d9a1b9b5-318a-41a8-ba1c-0ad6a55e9840 => generated 1512 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:11:58.990582 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-b8ea392e-d8ca-4cc4-b2da-f956132decd7 tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:11:58.991208 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-b8ea392e-d8ca-4cc4-b2da-f956132decd7 tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] [instance: 3086c8a4-4db9-459b-8fdb-1a27c1c42d75] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:11:58.998765 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b8ea392e-d8ca-4cc4-b2da-f956132decd7 tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:58.999242 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b8ea392e-d8ca-4cc4-b2da-f956132decd7 tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:58.999687 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b8ea392e-d8ca-4cc4-b2da-f956132decd7 tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:59.000392 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b8ea392e-d8ca-4cc4-b2da-f956132decd7 tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:59.000867 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b8ea392e-d8ca-4cc4-b2da-f956132decd7 tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:59.001299 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b8ea392e-d8ca-4cc4-b2da-f956132decd7 tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:59.056229 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell0:SELECT=2 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:11:59.083494 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell0:SELECT=6 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:11:59.163111 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-b8ea392e-d8ca-4cc4-b2da-f956132decd7 tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ec7439438f46caa7a08170089338b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7339865eaa564b7d9b145fb58acc60f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:11:59.172047 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-b8ea392e-d8ca-4cc4-b2da-f956132decd7 tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] 10.222.0.43 "GET /compute/v2.1/servers/3086c8a4-4db9-459b-8fdb-1a27c1c42d75" status: 200 len: 1313 microversion: 2.1 time: 0.185389 Oct 04 22:11:59.172648 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2649/5243] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:11:58 2022] GET /compute/v2.1/servers/3086c8a4-4db9-459b-8fdb-1a27c1c42d75 => generated 1313 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:11:59.397969 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-d11ad737-4f03-4200-8c94-af984d012561 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:11:59.398626 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-d11ad737-4f03-4200-8c94-af984d012561 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: d9a1b9b5-318a-41a8-ba1c-0ad6a55e9840] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:11:59.401522 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=2 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:11:59.408060 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d11ad737-4f03-4200-8c94-af984d012561 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:59.409130 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d11ad737-4f03-4200-8c94-af984d012561 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:59.409750 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d11ad737-4f03-4200-8c94-af984d012561 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:59.410789 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d11ad737-4f03-4200-8c94-af984d012561 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:59.410968 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d11ad737-4f03-4200-8c94-af984d012561 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:59.411403 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d11ad737-4f03-4200-8c94-af984d012561 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:59.463352 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-5f6edbb6-e0e3-4f0e-adef-2d991acbabea req-64815ee6-b170-461c-b10b-972ec9b15216 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3086c8a4-4db9-459b-8fdb-1a27c1c42d75", "name": "network-vif-plugged", "status": "completed", "tag": "deb2dae3-a943-45ba-b9df-48c49e206091"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:11:59.478344 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-5f6edbb6-e0e3-4f0e-adef-2d991acbabea req-64815ee6-b170-461c-b10b-972ec9b15216 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:59.479182 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-5f6edbb6-e0e3-4f0e-adef-2d991acbabea req-64815ee6-b170-461c-b10b-972ec9b15216 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:59.480014 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-5f6edbb6-e0e3-4f0e-adef-2d991acbabea req-64815ee6-b170-461c-b10b-972ec9b15216 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:59.499856 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-5f6edbb6-e0e3-4f0e-adef-2d991acbabea req-64815ee6-b170-461c-b10b-972ec9b15216 service nova] Creating event network-vif-plugged:deb2dae3-a943-45ba-b9df-48c49e206091 for instance 3086c8a4-4db9-459b-8fdb-1a27c1c42d75 on n-h2-860284-1 Oct 04 22:11:59.506271 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-5f6edbb6-e0e3-4f0e-adef-2d991acbabea req-64815ee6-b170-461c-b10b-972ec9b15216 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048605 Oct 04 22:11:59.507592 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2650/5244] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:11:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:11:59.597149 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-d11ad737-4f03-4200-8c94-af984d012561 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1682f1a60045d8a04d4d67393cd13f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b00cd9fa8e40a0919b61fcd60269f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:11:59.607500 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-d11ad737-4f03-4200-8c94-af984d012561 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "GET /compute/v2.1/servers/d9a1b9b5-318a-41a8-ba1c-0ad6a55e9840" status: 200 len: 1512 microversion: 2.1 time: 0.216105 Oct 04 22:11:59.608578 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2595/5245] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:11:59 2022] GET /compute/v2.1/servers/d9a1b9b5-318a-41a8-ba1c-0ad6a55e9840 => generated 1512 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:12:00.198144 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-82fe8298-796d-49aa-967c-37e94337876c tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:12:00.198978 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-82fe8298-796d-49aa-967c-37e94337876c tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] [instance: 3086c8a4-4db9-459b-8fdb-1a27c1c42d75] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:12:00.205948 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-82fe8298-796d-49aa-967c-37e94337876c tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:00.206777 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-82fe8298-796d-49aa-967c-37e94337876c tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:00.207229 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-82fe8298-796d-49aa-967c-37e94337876c tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:00.207938 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-82fe8298-796d-49aa-967c-37e94337876c tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:00.208400 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-82fe8298-796d-49aa-967c-37e94337876c tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:00.208942 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-82fe8298-796d-49aa-967c-37e94337876c tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:00.358759 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-82fe8298-796d-49aa-967c-37e94337876c tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ec7439438f46caa7a08170089338b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7339865eaa564b7d9b145fb58acc60f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:12:00.367073 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-82fe8298-796d-49aa-967c-37e94337876c tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] 10.222.0.43 "GET /compute/v2.1/servers/3086c8a4-4db9-459b-8fdb-1a27c1c42d75" status: 200 len: 1313 microversion: 2.1 time: 0.174119 Oct 04 22:12:00.367670 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2651/5246] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:12:00 2022] GET /compute/v2.1/servers/3086c8a4-4db9-459b-8fdb-1a27c1c42d75 => generated 1313 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:12:00.633318 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e085e510-5436-4c20-aeeb-2bf9a80be10b tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:12:00.634046 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-e085e510-5436-4c20-aeeb-2bf9a80be10b tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: d9a1b9b5-318a-41a8-ba1c-0ad6a55e9840] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:12:00.642459 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e085e510-5436-4c20-aeeb-2bf9a80be10b tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:00.642962 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e085e510-5436-4c20-aeeb-2bf9a80be10b tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:00.643574 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e085e510-5436-4c20-aeeb-2bf9a80be10b tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:00.644285 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e085e510-5436-4c20-aeeb-2bf9a80be10b tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:00.644750 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e085e510-5436-4c20-aeeb-2bf9a80be10b tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:00.645185 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e085e510-5436-4c20-aeeb-2bf9a80be10b tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:00.789216 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-e085e510-5436-4c20-aeeb-2bf9a80be10b tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1682f1a60045d8a04d4d67393cd13f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b00cd9fa8e40a0919b61fcd60269f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:12:00.798267 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-e085e510-5436-4c20-aeeb-2bf9a80be10b tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "GET /compute/v2.1/servers/d9a1b9b5-318a-41a8-ba1c-0ad6a55e9840" status: 200 len: 1512 microversion: 2.1 time: 0.169472 Oct 04 22:12:00.811157 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2596/5247] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:12:00 2022] GET /compute/v2.1/servers/d9a1b9b5-318a-41a8-ba1c-0ad6a55e9840 => generated 1512 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:12:01.391187 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-d8187d8b-9612-4460-937b-b10295dc3617 tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:12:01.391814 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-d8187d8b-9612-4460-937b-b10295dc3617 tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] [instance: 3086c8a4-4db9-459b-8fdb-1a27c1c42d75] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:12:01.395989 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:12:01.401347 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d8187d8b-9612-4460-937b-b10295dc3617 tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:01.402044 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d8187d8b-9612-4460-937b-b10295dc3617 tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:01.402657 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d8187d8b-9612-4460-937b-b10295dc3617 tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:01.403395 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d8187d8b-9612-4460-937b-b10295dc3617 tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:01.403882 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d8187d8b-9612-4460-937b-b10295dc3617 tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:01.404314 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d8187d8b-9612-4460-937b-b10295dc3617 tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:01.596243 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-d8187d8b-9612-4460-937b-b10295dc3617 tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ec7439438f46caa7a08170089338b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7339865eaa564b7d9b145fb58acc60f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:12:01.605409 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-d8187d8b-9612-4460-937b-b10295dc3617 tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] 10.222.0.43 "GET /compute/v2.1/servers/3086c8a4-4db9-459b-8fdb-1a27c1c42d75" status: 200 len: 1313 microversion: 2.1 time: 0.219255 Oct 04 22:12:01.618399 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2652/5248] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:12:01 2022] GET /compute/v2.1/servers/3086c8a4-4db9-459b-8fdb-1a27c1c42d75 => generated 1313 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:12:01.822468 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-0e3af90e-dff4-4918-9e8e-a8ebbcc66053 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:12:01.823113 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-0e3af90e-dff4-4918-9e8e-a8ebbcc66053 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: d9a1b9b5-318a-41a8-ba1c-0ad6a55e9840] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:12:01.830543 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0e3af90e-dff4-4918-9e8e-a8ebbcc66053 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:01.831043 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0e3af90e-dff4-4918-9e8e-a8ebbcc66053 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:01.831480 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0e3af90e-dff4-4918-9e8e-a8ebbcc66053 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:01.832185 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0e3af90e-dff4-4918-9e8e-a8ebbcc66053 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:01.832638 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0e3af90e-dff4-4918-9e8e-a8ebbcc66053 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:01.833063 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0e3af90e-dff4-4918-9e8e-a8ebbcc66053 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:01.969945 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-0e3af90e-dff4-4918-9e8e-a8ebbcc66053 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1682f1a60045d8a04d4d67393cd13f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b00cd9fa8e40a0919b61fcd60269f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:12:01.978147 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-0e3af90e-dff4-4918-9e8e-a8ebbcc66053 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "GET /compute/v2.1/servers/d9a1b9b5-318a-41a8-ba1c-0ad6a55e9840" status: 200 len: 1489 microversion: 2.1 time: 0.159567 Oct 04 22:12:01.978766 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2597/5249] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:12:01 2022] GET /compute/v2.1/servers/d9a1b9b5-318a-41a8-ba1c-0ad6a55e9840 => generated 1489 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:12:02.002123 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-20ce888f-03d0-4e46-83be-b9645eb3a5ae tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1936817481"}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:12:02.003913 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-20ce888f-03d0-4e46-83be-b9645eb3a5ae tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: d9a1b9b5-318a-41a8-ba1c-0ad6a55e9840] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:12:02.010295 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-20ce888f-03d0-4e46-83be-b9645eb3a5ae tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:02.010942 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-20ce888f-03d0-4e46-83be-b9645eb3a5ae tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:02.011451 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-20ce888f-03d0-4e46-83be-b9645eb3a5ae tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:02.012306 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-20ce888f-03d0-4e46-83be-b9645eb3a5ae tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:02.012966 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-20ce888f-03d0-4e46-83be-b9645eb3a5ae tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:02.013514 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-20ce888f-03d0-4e46-83be-b9645eb3a5ae tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:02.078760 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-20ce888f-03d0-4e46-83be-b9645eb3a5ae tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "PUT /compute/v2.1/servers/d9a1b9b5-318a-41a8-ba1c-0ad6a55e9840" status: 200 len: 1062 microversion: 2.1 time: 0.081269 Oct 04 22:12:02.086398 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2653/5250] 10.222.0.43 () {60 vars in 1256 bytes} [Tue Oct 4 22:12:01 2022] PUT /compute/v2.1/servers/d9a1b9b5-318a-41a8-ba1c-0ad6a55e9840 => generated 1062 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:12:02.098483 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-49cc9ca6-9866-4500-9810-7c022f4f976f tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:12:02.099167 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-49cc9ca6-9866-4500-9810-7c022f4f976f tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: d9a1b9b5-318a-41a8-ba1c-0ad6a55e9840] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:12:02.105239 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-49cc9ca6-9866-4500-9810-7c022f4f976f tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:02.105795 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-49cc9ca6-9866-4500-9810-7c022f4f976f tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:02.106235 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-49cc9ca6-9866-4500-9810-7c022f4f976f tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:02.107580 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-49cc9ca6-9866-4500-9810-7c022f4f976f tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:02.108033 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-49cc9ca6-9866-4500-9810-7c022f4f976f tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:02.108474 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-49cc9ca6-9866-4500-9810-7c022f4f976f tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:02.252351 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-49cc9ca6-9866-4500-9810-7c022f4f976f tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1682f1a60045d8a04d4d67393cd13f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b00cd9fa8e40a0919b61fcd60269f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:12:02.260265 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-49cc9ca6-9866-4500-9810-7c022f4f976f tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "GET /compute/v2.1/servers/d9a1b9b5-318a-41a8-ba1c-0ad6a55e9840" status: 200 len: 1489 microversion: 2.1 time: 0.165840 Oct 04 22:12:02.260860 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2598/5251] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:12:02 2022] GET /compute/v2.1/servers/d9a1b9b5-318a-41a8-ba1c-0ad6a55e9840 => generated 1489 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:12:02.281911 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-c45a616a-3fa0-4322-b051-947fe3bada99 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:12:02.282565 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-c45a616a-3fa0-4322-b051-947fe3bada99 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: d9a1b9b5-318a-41a8-ba1c-0ad6a55e9840] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:12:02.288796 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c45a616a-3fa0-4322-b051-947fe3bada99 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:02.289276 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c45a616a-3fa0-4322-b051-947fe3bada99 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:02.289704 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c45a616a-3fa0-4322-b051-947fe3bada99 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:02.290441 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c45a616a-3fa0-4322-b051-947fe3bada99 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:02.291058 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c45a616a-3fa0-4322-b051-947fe3bada99 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:02.291507 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c45a616a-3fa0-4322-b051-947fe3bada99 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:02.307131 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:12:02.437581 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-c45a616a-3fa0-4322-b051-947fe3bada99 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1682f1a60045d8a04d4d67393cd13f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b00cd9fa8e40a0919b61fcd60269f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:12:02.445450 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-c45a616a-3fa0-4322-b051-947fe3bada99 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "GET /compute/v2.1/servers/d9a1b9b5-318a-41a8-ba1c-0ad6a55e9840" status: 200 len: 1489 microversion: 2.1 time: 0.167474 Oct 04 22:12:02.446030 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2654/5252] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:12:02 2022] GET /compute/v2.1/servers/d9a1b9b5-318a-41a8-ba1c-0ad6a55e9840 => generated 1489 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:12:02.473039 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-a0ee1c2e-26f3-4036-9509-2536dd6a3b07 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:12:02.473550 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-a0ee1c2e-26f3-4036-9509-2536dd6a3b07 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: d9a1b9b5-318a-41a8-ba1c-0ad6a55e9840] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:12:02.481616 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a0ee1c2e-26f3-4036-9509-2536dd6a3b07 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:02.482175 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a0ee1c2e-26f3-4036-9509-2536dd6a3b07 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:02.482650 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a0ee1c2e-26f3-4036-9509-2536dd6a3b07 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:02.483364 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a0ee1c2e-26f3-4036-9509-2536dd6a3b07 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:02.483820 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a0ee1c2e-26f3-4036-9509-2536dd6a3b07 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:02.484275 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a0ee1c2e-26f3-4036-9509-2536dd6a3b07 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:02.513845 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-a0ee1c2e-26f3-4036-9509-2536dd6a3b07 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: d9a1b9b5-318a-41a8-ba1c-0ad6a55e9840] Going to try to terminate instance {{(pid=134101) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 22:12:02.597054 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-a0ee1c2e-26f3-4036-9509-2536dd6a3b07 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "DELETE /compute/v2.1/servers/d9a1b9b5-318a-41a8-ba1c-0ad6a55e9840" status: 204 len: 0 microversion: 2.1 time: 0.127751 Oct 04 22:12:02.597676 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2599/5253] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 22:12:02 2022] DELETE /compute/v2.1/servers/d9a1b9b5-318a-41a8-ba1c-0ad6a55e9840 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 22:12:02.608599 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-23a2cfc0-7032-4693-a787-6279948f1fcf tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:12:02.609301 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-23a2cfc0-7032-4693-a787-6279948f1fcf tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: d9a1b9b5-318a-41a8-ba1c-0ad6a55e9840] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:12:02.615481 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-23a2cfc0-7032-4693-a787-6279948f1fcf tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:02.616389 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-23a2cfc0-7032-4693-a787-6279948f1fcf tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:02.616899 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-23a2cfc0-7032-4693-a787-6279948f1fcf tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:02.617981 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-23a2cfc0-7032-4693-a787-6279948f1fcf tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:02.618833 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-23a2cfc0-7032-4693-a787-6279948f1fcf tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:02.619331 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-23a2cfc0-7032-4693-a787-6279948f1fcf tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:02.633461 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-58d9c8b5-5b44-4243-a18d-bc45d25ad84b tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:12:02.634174 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-58d9c8b5-5b44-4243-a18d-bc45d25ad84b tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] [instance: 3086c8a4-4db9-459b-8fdb-1a27c1c42d75] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:12:02.642353 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-58d9c8b5-5b44-4243-a18d-bc45d25ad84b tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:02.643084 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-58d9c8b5-5b44-4243-a18d-bc45d25ad84b tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:02.643664 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-58d9c8b5-5b44-4243-a18d-bc45d25ad84b tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:02.644623 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-58d9c8b5-5b44-4243-a18d-bc45d25ad84b tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:02.645513 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-58d9c8b5-5b44-4243-a18d-bc45d25ad84b tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:02.646247 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-58d9c8b5-5b44-4243-a18d-bc45d25ad84b tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:02.839889 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-23a2cfc0-7032-4693-a787-6279948f1fcf tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1682f1a60045d8a04d4d67393cd13f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b00cd9fa8e40a0919b61fcd60269f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:12:02.851255 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-23a2cfc0-7032-4693-a787-6279948f1fcf tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "GET /compute/v2.1/servers/d9a1b9b5-318a-41a8-ba1c-0ad6a55e9840" status: 200 len: 1495 microversion: 2.1 time: 0.248733 Oct 04 22:12:02.852515 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2655/5254] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:12:02 2022] GET /compute/v2.1/servers/d9a1b9b5-318a-41a8-ba1c-0ad6a55e9840 => generated 1495 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:12:02.862797 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-58d9c8b5-5b44-4243-a18d-bc45d25ad84b tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ec7439438f46caa7a08170089338b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7339865eaa564b7d9b145fb58acc60f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:12:02.872129 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-58d9c8b5-5b44-4243-a18d-bc45d25ad84b tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] 10.222.0.43 "GET /compute/v2.1/servers/3086c8a4-4db9-459b-8fdb-1a27c1c42d75" status: 200 len: 1497 microversion: 2.1 time: 0.244250 Oct 04 22:12:02.880468 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2600/5255] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:12:02 2022] GET /compute/v2.1/servers/3086c8a4-4db9-459b-8fdb-1a27c1c42d75 => generated 1497 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:12:03.876037 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-b203c626-8ae2-44ab-a396-21468ffee7bf tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:12:03.877706 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-b203c626-8ae2-44ab-a396-21468ffee7bf tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: d9a1b9b5-318a-41a8-ba1c-0ad6a55e9840] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:12:03.889593 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b203c626-8ae2-44ab-a396-21468ffee7bf tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:03.890430 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b203c626-8ae2-44ab-a396-21468ffee7bf tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:03.891081 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b203c626-8ae2-44ab-a396-21468ffee7bf tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:03.892051 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b203c626-8ae2-44ab-a396-21468ffee7bf tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:03.892979 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b203c626-8ae2-44ab-a396-21468ffee7bf tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:03.893624 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b203c626-8ae2-44ab-a396-21468ffee7bf tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:04.106462 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-b203c626-8ae2-44ab-a396-21468ffee7bf tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1682f1a60045d8a04d4d67393cd13f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b00cd9fa8e40a0919b61fcd60269f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:12:04.118297 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-b203c626-8ae2-44ab-a396-21468ffee7bf tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "GET /compute/v2.1/servers/d9a1b9b5-318a-41a8-ba1c-0ad6a55e9840" status: 200 len: 1495 microversion: 2.1 time: 0.247189 Oct 04 22:12:04.119751 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2656/5256] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:12:03 2022] GET /compute/v2.1/servers/d9a1b9b5-318a-41a8-ba1c-0ad6a55e9840 => generated 1495 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:12:04.615094 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-c5ae2708-6db0-4d9b-8c3d-6e91861614c9 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:12:04.615603 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-c5ae2708-6db0-4d9b-8c3d-6e91861614c9 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] [instance: 696c547f-7cea-497f-9871-dd26f3fb6cfc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:12:04.623867 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c5ae2708-6db0-4d9b-8c3d-6e91861614c9 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:04.624370 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c5ae2708-6db0-4d9b-8c3d-6e91861614c9 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:04.624810 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c5ae2708-6db0-4d9b-8c3d-6e91861614c9 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:04.630929 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c5ae2708-6db0-4d9b-8c3d-6e91861614c9 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:04.631425 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c5ae2708-6db0-4d9b-8c3d-6e91861614c9 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:04.631890 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c5ae2708-6db0-4d9b-8c3d-6e91861614c9 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:04.670836 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-c5ae2708-6db0-4d9b-8c3d-6e91861614c9 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] 10.222.0.43 "GET /compute/v2.1/servers/696c547f-7cea-497f-9871-dd26f3fb6cfc/ips" status: 200 len: 149 microversion: 2.1 time: 0.059404 Oct 04 22:12:04.672240 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2601/5257] 10.222.0.43 () {58 vars in 1248 bytes} [Tue Oct 4 22:12:04 2022] GET /compute/v2.1/servers/696c547f-7cea-497f-9871-dd26f3fb6cfc/ips => generated 149 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:12:04.918492 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-d62ba03b-2454-4fdb-8e3b-8ee15a2f69e8 req-03c7667f-33a7-4c39-a617-fefb68bef2a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9a1b9b5-318a-41a8-ba1c-0ad6a55e9840", "name": "network-vif-deleted", "tag": "58f9db74-d595-44ff-87ac-3d6c21f343f1"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:12:04.946287 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-d62ba03b-2454-4fdb-8e3b-8ee15a2f69e8 req-03c7667f-33a7-4c39-a617-fefb68bef2a0 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:04.947052 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-d62ba03b-2454-4fdb-8e3b-8ee15a2f69e8 req-03c7667f-33a7-4c39-a617-fefb68bef2a0 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:04.947634 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-d62ba03b-2454-4fdb-8e3b-8ee15a2f69e8 req-03c7667f-33a7-4c39-a617-fefb68bef2a0 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:04.962741 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-d62ba03b-2454-4fdb-8e3b-8ee15a2f69e8 req-03c7667f-33a7-4c39-a617-fefb68bef2a0 service nova] Creating event network-vif-deleted:58f9db74-d595-44ff-87ac-3d6c21f343f1 for instance d9a1b9b5-318a-41a8-ba1c-0ad6a55e9840 on n-h2-860284-1 Oct 04 22:12:04.969649 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-d62ba03b-2454-4fdb-8e3b-8ee15a2f69e8 req-03c7667f-33a7-4c39-a617-fefb68bef2a0 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057581 Oct 04 22:12:04.970891 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2657/5258] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:12:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:12:05.142205 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-57a8a2f3-4ad0-4bef-ab17-25990d42a6d2 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:12:05.151382 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-57a8a2f3-4ad0-4bef-ab17-25990d42a6d2 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: d9a1b9b5-318a-41a8-ba1c-0ad6a55e9840] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:12:05.176559 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-57a8a2f3-4ad0-4bef-ab17-25990d42a6d2 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:05.186889 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-57a8a2f3-4ad0-4bef-ab17-25990d42a6d2 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:05.186889 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-57a8a2f3-4ad0-4bef-ab17-25990d42a6d2 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:05.186889 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-57a8a2f3-4ad0-4bef-ab17-25990d42a6d2 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:05.186889 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-57a8a2f3-4ad0-4bef-ab17-25990d42a6d2 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:05.186889 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-57a8a2f3-4ad0-4bef-ab17-25990d42a6d2 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:05.242248 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-57a8a2f3-4ad0-4bef-ab17-25990d42a6d2 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:05.242776 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-57a8a2f3-4ad0-4bef-ab17-25990d42a6d2 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:05.246850 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-57a8a2f3-4ad0-4bef-ab17-25990d42a6d2 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:05.247611 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.objects.instance [None req-57a8a2f3-4ad0-4bef-ab17-25990d42a6d2 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lazy-loading 'fault' on Instance uuid d9a1b9b5-318a-41a8-ba1c-0ad6a55e9840 {{(pid=134101) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 22:12:05.378340 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-57a8a2f3-4ad0-4bef-ab17-25990d42a6d2 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1682f1a60045d8a04d4d67393cd13f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b00cd9fa8e40a0919b61fcd60269f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:12:05.386625 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-57a8a2f3-4ad0-4bef-ab17-25990d42a6d2 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "GET /compute/v2.1/servers/d9a1b9b5-318a-41a8-ba1c-0ad6a55e9840" status: 200 len: 1310 microversion: 2.1 time: 0.248894 Oct 04 22:12:05.395086 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2602/5259] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:12:05 2022] GET /compute/v2.1/servers/d9a1b9b5-318a-41a8-ba1c-0ad6a55e9840 => generated 1310 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:12:06.435518 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-748316de-353f-4e35-baa6-dde912377596 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:12:06.443808 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-748316de-353f-4e35-baa6-dde912377596 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: d9a1b9b5-318a-41a8-ba1c-0ad6a55e9840] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:12:06.453106 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-748316de-353f-4e35-baa6-dde912377596 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:06.453613 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-748316de-353f-4e35-baa6-dde912377596 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:06.454058 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-748316de-353f-4e35-baa6-dde912377596 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:06.454831 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-748316de-353f-4e35-baa6-dde912377596 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:06.455296 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-748316de-353f-4e35-baa6-dde912377596 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:06.467286 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-748316de-353f-4e35-baa6-dde912377596 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:06.487955 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-748316de-353f-4e35-baa6-dde912377596 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] HTTP exception thrown: Instance d9a1b9b5-318a-41a8-ba1c-0ad6a55e9840 could not be found. Oct 04 22:12:06.491787 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-748316de-353f-4e35-baa6-dde912377596 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Request method failure captured: Oct 04 22:12:06.491787 n-d-860284-1 devstack@n-api.service[134102]: request: GET /compute/v2.1/servers/d9a1b9b5-318a-41a8-ba1c-0ad6a55e9840 HTTP/1.1 Oct 04 22:12:06.491787 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 22:12:06.491787 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 22:12:06.491787 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 22:12:06.491787 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 22:12:06.491787 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 22:12:06.491787 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 22:12:06.491787 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 22:12:06.491787 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 22:12:06.491787 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPK7MP0-m-xtUnxXwLoxlIfO4jzoQOT6GMi-_9Rz-dG646c6MuQMOjiOhGtcOohb2ZIUdejR42Va0IkiFMBDtdnbnUEdF8Psxz0uHfYGBQiEZpqo4CpOHPpz5KjUxS1LmPgcFnegJZtGQu1irxi49GMeHkm9nnXbxd63druWj1zFChJ4 Oct 04 22:12:06.491787 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 22:12:06.491787 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 22:12:06.491787 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 22:12:06.491787 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 22:12:06.491787 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 22:12:06.491787 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 22:12:06.491787 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: d4b00cd9fa8e40a0919b61fcd60269f5 Oct 04 22:12:06.491787 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-ServersTestJSON-1600369848 Oct 04 22:12:06.491787 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 22:12:06.491787 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 22:12:06.491787 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d4b00cd9fa8e40a0919b61fcd60269f5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_d4b00cd9fa8e40a0919b61fcd60269f5", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d4b00cd9fa8e40a0919b61fcd60269f5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/d4b00cd9fa8e40a0919b61fcd60269f5"}]}] Oct 04 22:12:06.491787 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-ServersTestJSON-1600369848 Oct 04 22:12:06.491787 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: d4b00cd9fa8e40a0919b61fcd60269f5 Oct 04 22:12:06.491787 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-ServersTestJSON-1600369848 Oct 04 22:12:06.491787 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-ServersTestJSON-1600369848-project Oct 04 22:12:06.491787 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 22:12:06.491787 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 22:12:06.491787 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: 9c1682f1a60045d8a04d4d67393cd13f Oct 04 22:12:06.491787 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-ServersTestJSON-1600369848-project Oct 04 22:12:06.491787 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 22:12:06.491787 n-d-860284-1 devstack@n-api.service[134102]: exception: Instance d9a1b9b5-318a-41a8-ba1c-0ad6a55e9840 could not be found. Oct 04 22:12:06.491787 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': 'd9a1b9b5-318a-41a8-ba1c-0ad6a55e9840'} Oct 04 22:12:06.491787 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:12:06.491787 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:12:06.491787 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:12:06.491787 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:12:06.491787 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:12:06.491787 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:12:06.491787 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:12:06.491787 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:12:06.491787 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:12:06.491787 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:12:06.491787 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9a1b9b5-318a-41a8-ba1c-0ad6a55e9840 could not be found. Oct 04 22:12:06.491787 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:12:06.491787 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:12:06.491787 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:12:06.491787 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:12:06.491787 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:12:06.491787 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:12:06.491787 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:12:06.491787 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:12:06.491787 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:12:06.491787 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:12:06.491787 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:12:06.491787 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:12:06.491787 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:12:06.491787 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:12:06.491787 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:12:06.491787 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:12:06.491787 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9a1b9b5-318a-41a8-ba1c-0ad6a55e9840 could not be found. Oct 04 22:12:06.491787 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:12:06.491787 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:12:06.491787 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:12:06.495295 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:12:06.495295 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:12:06.495295 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:12:06.495295 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:12:06.495295 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:12:06.495295 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9a1b9b5-318a-41a8-ba1c-0ad6a55e9840 could not be found. Oct 04 22:12:06.495295 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:12:06.497749 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-748316de-353f-4e35-baa6-dde912377596 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Returning 404 to user: Instance d9a1b9b5-318a-41a8-ba1c-0ad6a55e9840 could not be found. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:12:06.499176 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-748316de-353f-4e35-baa6-dde912377596 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "GET /compute/v2.1/servers/d9a1b9b5-318a-41a8-ba1c-0ad6a55e9840" status: 404 len: 111 microversion: 2.1 time: 0.081942 Oct 04 22:12:06.503722 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2658/5260] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:12:06 2022] GET /compute/v2.1/servers/d9a1b9b5-318a-41a8-ba1c-0ad6a55e9840 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:12:06.524294 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-a5b99ac5-a3e8-4e56-bdec-6946c0385443 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:12:06.524797 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-a5b99ac5-a3e8-4e56-bdec-6946c0385443 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: d9a1b9b5-318a-41a8-ba1c-0ad6a55e9840] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:12:06.540435 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a5b99ac5-a3e8-4e56-bdec-6946c0385443 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:06.541179 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a5b99ac5-a3e8-4e56-bdec-6946c0385443 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:06.542482 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a5b99ac5-a3e8-4e56-bdec-6946c0385443 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:06.543651 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a5b99ac5-a3e8-4e56-bdec-6946c0385443 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:06.545664 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a5b99ac5-a3e8-4e56-bdec-6946c0385443 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:06.548843 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a5b99ac5-a3e8-4e56-bdec-6946c0385443 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:06.574151 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-a5b99ac5-a3e8-4e56-bdec-6946c0385443 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] HTTP exception thrown: Instance d9a1b9b5-318a-41a8-ba1c-0ad6a55e9840 could not be found. Oct 04 22:12:06.576613 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-a5b99ac5-a3e8-4e56-bdec-6946c0385443 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Request method failure captured: Oct 04 22:12:06.576613 n-d-860284-1 devstack@n-api.service[134101]: request: DELETE /compute/v2.1/servers/d9a1b9b5-318a-41a8-ba1c-0ad6a55e9840 HTTP/1.1 Oct 04 22:12:06.576613 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 22:12:06.576613 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 22:12:06.576613 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 22:12:06.576613 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 22:12:06.576613 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 22:12:06.576613 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 22:12:06.576613 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 22:12:06.576613 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 22:12:06.576613 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPK7MP0-m-xtUnxXwLoxlIfO4jzoQOT6GMi-_9Rz-dG646c6MuQMOjiOhGtcOohb2ZIUdejR42Va0IkiFMBDtdnbnUEdF8Psxz0uHfYGBQiEZpqo4CpOHPpz5KjUxS1LmPgcFnegJZtGQu1irxi49GMeHkm9nnXbxd63druWj1zFChJ4 Oct 04 22:12:06.576613 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 22:12:06.576613 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 22:12:06.576613 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 22:12:06.576613 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 22:12:06.576613 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 22:12:06.576613 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 22:12:06.576613 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: d4b00cd9fa8e40a0919b61fcd60269f5 Oct 04 22:12:06.576613 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-ServersTestJSON-1600369848 Oct 04 22:12:06.576613 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 22:12:06.576613 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 22:12:06.576613 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d4b00cd9fa8e40a0919b61fcd60269f5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_d4b00cd9fa8e40a0919b61fcd60269f5", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d4b00cd9fa8e40a0919b61fcd60269f5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/d4b00cd9fa8e40a0919b61fcd60269f5"}]}] Oct 04 22:12:06.576613 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-ServersTestJSON-1600369848 Oct 04 22:12:06.576613 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: d4b00cd9fa8e40a0919b61fcd60269f5 Oct 04 22:12:06.576613 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-ServersTestJSON-1600369848 Oct 04 22:12:06.576613 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-ServersTestJSON-1600369848-project Oct 04 22:12:06.576613 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 22:12:06.576613 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 22:12:06.576613 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 9c1682f1a60045d8a04d4d67393cd13f Oct 04 22:12:06.576613 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-ServersTestJSON-1600369848-project Oct 04 22:12:06.576613 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 22:12:06.576613 n-d-860284-1 devstack@n-api.service[134101]: exception: Instance d9a1b9b5-318a-41a8-ba1c-0ad6a55e9840 could not be found. Oct 04 22:12:06.576613 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': 'd9a1b9b5-318a-41a8-ba1c-0ad6a55e9840'} Oct 04 22:12:06.576613 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:12:06.576613 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:12:06.576613 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:12:06.576613 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:12:06.576613 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:12:06.576613 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:12:06.576613 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:12:06.576613 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:12:06.576613 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:12:06.576613 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:12:06.576613 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9a1b9b5-318a-41a8-ba1c-0ad6a55e9840 could not be found. Oct 04 22:12:06.576613 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:12:06.576613 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:12:06.576613 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:12:06.576613 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:12:06.576613 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:12:06.576613 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:12:06.576613 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:12:06.576613 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:12:06.576613 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:12:06.576613 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:12:06.576613 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 22:12:06.576613 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 22:12:06.576613 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 22:12:06.576613 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 22:12:06.576613 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:12:06.576613 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:12:06.576613 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:12:06.576613 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:12:06.576613 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9a1b9b5-318a-41a8-ba1c-0ad6a55e9840 could not be found. Oct 04 22:12:06.579710 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:12:06.579710 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:12:06.579710 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:12:06.579710 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:12:06.579710 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:12:06.579710 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:12:06.579710 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:12:06.579710 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:12:06.579710 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9a1b9b5-318a-41a8-ba1c-0ad6a55e9840 could not be found. Oct 04 22:12:06.579710 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:12:06.579710 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-a5b99ac5-a3e8-4e56-bdec-6946c0385443 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Returning 404 to user: Instance d9a1b9b5-318a-41a8-ba1c-0ad6a55e9840 could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:12:06.579710 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-a5b99ac5-a3e8-4e56-bdec-6946c0385443 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "DELETE /compute/v2.1/servers/d9a1b9b5-318a-41a8-ba1c-0ad6a55e9840" status: 404 len: 111 microversion: 2.1 time: 0.059513 Oct 04 22:12:06.586518 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2603/5261] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 22:12:06 2022] DELETE /compute/v2.1/servers/d9a1b9b5-318a-41a8-ba1c-0ad6a55e9840 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:12:06.592408 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-3711a955-d16c-4c35-8889-7bb2876ca5f4 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:12:06.593037 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-3711a955-d16c-4c35-8889-7bb2876ca5f4 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: d9a1b9b5-318a-41a8-ba1c-0ad6a55e9840] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:12:06.612467 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3711a955-d16c-4c35-8889-7bb2876ca5f4 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:06.612981 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3711a955-d16c-4c35-8889-7bb2876ca5f4 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:06.613425 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3711a955-d16c-4c35-8889-7bb2876ca5f4 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:06.614502 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3711a955-d16c-4c35-8889-7bb2876ca5f4 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:06.615162 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3711a955-d16c-4c35-8889-7bb2876ca5f4 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:06.615772 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3711a955-d16c-4c35-8889-7bb2876ca5f4 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:06.631681 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-3711a955-d16c-4c35-8889-7bb2876ca5f4 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] HTTP exception thrown: Instance d9a1b9b5-318a-41a8-ba1c-0ad6a55e9840 could not be found. Oct 04 22:12:06.641724 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-3711a955-d16c-4c35-8889-7bb2876ca5f4 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Request method failure captured: Oct 04 22:12:06.641724 n-d-860284-1 devstack@n-api.service[134102]: request: GET /compute/v2.1/servers/d9a1b9b5-318a-41a8-ba1c-0ad6a55e9840 HTTP/1.1 Oct 04 22:12:06.641724 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 22:12:06.641724 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 22:12:06.641724 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 22:12:06.641724 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 22:12:06.641724 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 22:12:06.641724 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 22:12:06.641724 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 22:12:06.641724 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 22:12:06.641724 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPK7MP0-m-xtUnxXwLoxlIfO4jzoQOT6GMi-_9Rz-dG646c6MuQMOjiOhGtcOohb2ZIUdejR42Va0IkiFMBDtdnbnUEdF8Psxz0uHfYGBQiEZpqo4CpOHPpz5KjUxS1LmPgcFnegJZtGQu1irxi49GMeHkm9nnXbxd63druWj1zFChJ4 Oct 04 22:12:06.641724 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 22:12:06.641724 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 22:12:06.641724 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 22:12:06.641724 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 22:12:06.641724 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 22:12:06.641724 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 22:12:06.641724 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: d4b00cd9fa8e40a0919b61fcd60269f5 Oct 04 22:12:06.641724 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-ServersTestJSON-1600369848 Oct 04 22:12:06.641724 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 22:12:06.641724 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 22:12:06.641724 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d4b00cd9fa8e40a0919b61fcd60269f5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_d4b00cd9fa8e40a0919b61fcd60269f5", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d4b00cd9fa8e40a0919b61fcd60269f5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/d4b00cd9fa8e40a0919b61fcd60269f5"}]}] Oct 04 22:12:06.641724 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-ServersTestJSON-1600369848 Oct 04 22:12:06.641724 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: d4b00cd9fa8e40a0919b61fcd60269f5 Oct 04 22:12:06.641724 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-ServersTestJSON-1600369848 Oct 04 22:12:06.641724 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-ServersTestJSON-1600369848-project Oct 04 22:12:06.641724 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 22:12:06.641724 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 22:12:06.641724 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: 9c1682f1a60045d8a04d4d67393cd13f Oct 04 22:12:06.641724 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-ServersTestJSON-1600369848-project Oct 04 22:12:06.641724 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 22:12:06.641724 n-d-860284-1 devstack@n-api.service[134102]: exception: Instance d9a1b9b5-318a-41a8-ba1c-0ad6a55e9840 could not be found. Oct 04 22:12:06.641724 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': 'd9a1b9b5-318a-41a8-ba1c-0ad6a55e9840'} Oct 04 22:12:06.641724 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:12:06.641724 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:12:06.641724 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:12:06.641724 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:12:06.641724 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:12:06.641724 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:12:06.641724 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:12:06.641724 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:12:06.641724 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:12:06.641724 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:12:06.641724 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9a1b9b5-318a-41a8-ba1c-0ad6a55e9840 could not be found. Oct 04 22:12:06.641724 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:12:06.641724 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:12:06.641724 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:12:06.641724 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:12:06.641724 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:12:06.641724 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:12:06.641724 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:12:06.641724 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:12:06.641724 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:12:06.641724 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:12:06.641724 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:12:06.641724 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:12:06.641724 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:12:06.641724 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:12:06.641724 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:12:06.641724 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:12:06.641724 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9a1b9b5-318a-41a8-ba1c-0ad6a55e9840 could not be found. Oct 04 22:12:06.641724 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:12:06.641724 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:12:06.641724 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:12:06.645195 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:12:06.645195 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:12:06.645195 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:12:06.645195 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:12:06.645195 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:12:06.645195 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9a1b9b5-318a-41a8-ba1c-0ad6a55e9840 could not be found. Oct 04 22:12:06.645195 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:12:06.645195 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-3711a955-d16c-4c35-8889-7bb2876ca5f4 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Returning 404 to user: Instance d9a1b9b5-318a-41a8-ba1c-0ad6a55e9840 could not be found. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:12:06.654615 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-3711a955-d16c-4c35-8889-7bb2876ca5f4 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "GET /compute/v2.1/servers/d9a1b9b5-318a-41a8-ba1c-0ad6a55e9840" status: 404 len: 111 microversion: 2.1 time: 0.063418 Oct 04 22:12:06.656505 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2659/5262] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:12:06 2022] GET /compute/v2.1/servers/d9a1b9b5-318a-41a8-ba1c-0ad6a55e9840 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:12:06.674280 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-d032f45b-d54d-4238-993f-48096ef8d53a tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:12:06.676158 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-d032f45b-d54d-4238-993f-48096ef8d53a tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: da7beaa4-0356-4315-bdcc-af5b9c1730a1] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:12:06.701213 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d032f45b-d54d-4238-993f-48096ef8d53a tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:06.702164 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d032f45b-d54d-4238-993f-48096ef8d53a tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:06.702945 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d032f45b-d54d-4238-993f-48096ef8d53a tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:06.705879 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d032f45b-d54d-4238-993f-48096ef8d53a tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:06.706589 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d032f45b-d54d-4238-993f-48096ef8d53a tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:06.711357 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d032f45b-d54d-4238-993f-48096ef8d53a tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:06.734061 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-d032f45b-d54d-4238-993f-48096ef8d53a tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] HTTP exception thrown: Instance da7beaa4-0356-4315-bdcc-af5b9c1730a1 could not be found. Oct 04 22:12:06.744759 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-d032f45b-d54d-4238-993f-48096ef8d53a tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Request method failure captured: Oct 04 22:12:06.744759 n-d-860284-1 devstack@n-api.service[134101]: request: DELETE /compute/v2.1/servers/da7beaa4-0356-4315-bdcc-af5b9c1730a1 HTTP/1.1 Oct 04 22:12:06.744759 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 22:12:06.744759 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 22:12:06.744759 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 22:12:06.744759 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 22:12:06.744759 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 22:12:06.744759 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 22:12:06.744759 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 22:12:06.744759 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 22:12:06.744759 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPK7MP0-m-xtUnxXwLoxlIfO4jzoQOT6GMi-_9Rz-dG646c6MuQMOjiOhGtcOohb2ZIUdejR42Va0IkiFMBDtdnbnUEdF8Psxz0uHfYGBQiEZpqo4CpOHPpz5KjUxS1LmPgcFnegJZtGQu1irxi49GMeHkm9nnXbxd63druWj1zFChJ4 Oct 04 22:12:06.744759 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 22:12:06.744759 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 22:12:06.744759 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 22:12:06.744759 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 22:12:06.744759 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 22:12:06.744759 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 22:12:06.744759 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: d4b00cd9fa8e40a0919b61fcd60269f5 Oct 04 22:12:06.744759 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-ServersTestJSON-1600369848 Oct 04 22:12:06.744759 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 22:12:06.744759 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 22:12:06.744759 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d4b00cd9fa8e40a0919b61fcd60269f5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_d4b00cd9fa8e40a0919b61fcd60269f5", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d4b00cd9fa8e40a0919b61fcd60269f5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/d4b00cd9fa8e40a0919b61fcd60269f5"}]}] Oct 04 22:12:06.744759 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-ServersTestJSON-1600369848 Oct 04 22:12:06.744759 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: d4b00cd9fa8e40a0919b61fcd60269f5 Oct 04 22:12:06.744759 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-ServersTestJSON-1600369848 Oct 04 22:12:06.744759 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-ServersTestJSON-1600369848-project Oct 04 22:12:06.744759 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 22:12:06.744759 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 22:12:06.744759 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 9c1682f1a60045d8a04d4d67393cd13f Oct 04 22:12:06.744759 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-ServersTestJSON-1600369848-project Oct 04 22:12:06.744759 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 22:12:06.744759 n-d-860284-1 devstack@n-api.service[134101]: exception: Instance da7beaa4-0356-4315-bdcc-af5b9c1730a1 could not be found. Oct 04 22:12:06.744759 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': 'da7beaa4-0356-4315-bdcc-af5b9c1730a1'} Oct 04 22:12:06.744759 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:12:06.744759 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:12:06.744759 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:12:06.744759 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:12:06.744759 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:12:06.744759 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:12:06.744759 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:12:06.744759 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:12:06.744759 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:12:06.744759 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:12:06.744759 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da7beaa4-0356-4315-bdcc-af5b9c1730a1 could not be found. Oct 04 22:12:06.744759 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:12:06.744759 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:12:06.744759 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:12:06.744759 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:12:06.744759 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:12:06.744759 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:12:06.744759 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:12:06.744759 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:12:06.744759 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:12:06.744759 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:12:06.744759 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 22:12:06.744759 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 22:12:06.744759 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 22:12:06.744759 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 22:12:06.744759 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:12:06.744759 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:12:06.744759 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:12:06.744759 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:12:06.744759 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da7beaa4-0356-4315-bdcc-af5b9c1730a1 could not be found. Oct 04 22:12:06.748770 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:12:06.748770 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:12:06.748770 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:12:06.748770 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:12:06.748770 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:12:06.748770 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:12:06.748770 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:12:06.748770 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:12:06.748770 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da7beaa4-0356-4315-bdcc-af5b9c1730a1 could not be found. Oct 04 22:12:06.748770 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:12:06.754251 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-d032f45b-d54d-4238-993f-48096ef8d53a tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Returning 404 to user: Instance da7beaa4-0356-4315-bdcc-af5b9c1730a1 could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:12:06.756818 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-d032f45b-d54d-4238-993f-48096ef8d53a tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "DELETE /compute/v2.1/servers/da7beaa4-0356-4315-bdcc-af5b9c1730a1" status: 404 len: 111 microversion: 2.1 time: 0.094754 Oct 04 22:12:06.757719 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2604/5263] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 22:12:06 2022] DELETE /compute/v2.1/servers/da7beaa4-0356-4315-bdcc-af5b9c1730a1 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:12:06.783797 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-54e199a4-7923-42e8-a8ad-e8b0a2a7ee96 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:12:06.784448 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-54e199a4-7923-42e8-a8ad-e8b0a2a7ee96 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: da7beaa4-0356-4315-bdcc-af5b9c1730a1] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:12:06.798027 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-54e199a4-7923-42e8-a8ad-e8b0a2a7ee96 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:06.798556 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-54e199a4-7923-42e8-a8ad-e8b0a2a7ee96 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:06.799002 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-54e199a4-7923-42e8-a8ad-e8b0a2a7ee96 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:06.799730 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-54e199a4-7923-42e8-a8ad-e8b0a2a7ee96 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:06.800192 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-54e199a4-7923-42e8-a8ad-e8b0a2a7ee96 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:06.800626 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-54e199a4-7923-42e8-a8ad-e8b0a2a7ee96 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:06.825011 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-54e199a4-7923-42e8-a8ad-e8b0a2a7ee96 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] HTTP exception thrown: Instance da7beaa4-0356-4315-bdcc-af5b9c1730a1 could not be found. Oct 04 22:12:06.827242 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-54e199a4-7923-42e8-a8ad-e8b0a2a7ee96 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Request method failure captured: Oct 04 22:12:06.827242 n-d-860284-1 devstack@n-api.service[134102]: request: GET /compute/v2.1/servers/da7beaa4-0356-4315-bdcc-af5b9c1730a1 HTTP/1.1 Oct 04 22:12:06.827242 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 22:12:06.827242 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 22:12:06.827242 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 22:12:06.827242 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 22:12:06.827242 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 22:12:06.827242 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 22:12:06.827242 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 22:12:06.827242 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 22:12:06.827242 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPK7MP0-m-xtUnxXwLoxlIfO4jzoQOT6GMi-_9Rz-dG646c6MuQMOjiOhGtcOohb2ZIUdejR42Va0IkiFMBDtdnbnUEdF8Psxz0uHfYGBQiEZpqo4CpOHPpz5KjUxS1LmPgcFnegJZtGQu1irxi49GMeHkm9nnXbxd63druWj1zFChJ4 Oct 04 22:12:06.827242 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 22:12:06.827242 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 22:12:06.827242 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 22:12:06.827242 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 22:12:06.827242 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 22:12:06.827242 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 22:12:06.827242 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: d4b00cd9fa8e40a0919b61fcd60269f5 Oct 04 22:12:06.827242 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-ServersTestJSON-1600369848 Oct 04 22:12:06.827242 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 22:12:06.827242 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 22:12:06.827242 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d4b00cd9fa8e40a0919b61fcd60269f5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_d4b00cd9fa8e40a0919b61fcd60269f5", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d4b00cd9fa8e40a0919b61fcd60269f5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/d4b00cd9fa8e40a0919b61fcd60269f5"}]}] Oct 04 22:12:06.827242 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-ServersTestJSON-1600369848 Oct 04 22:12:06.827242 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: d4b00cd9fa8e40a0919b61fcd60269f5 Oct 04 22:12:06.827242 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-ServersTestJSON-1600369848 Oct 04 22:12:06.827242 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-ServersTestJSON-1600369848-project Oct 04 22:12:06.827242 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 22:12:06.827242 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 22:12:06.827242 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: 9c1682f1a60045d8a04d4d67393cd13f Oct 04 22:12:06.827242 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-ServersTestJSON-1600369848-project Oct 04 22:12:06.827242 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 22:12:06.827242 n-d-860284-1 devstack@n-api.service[134102]: exception: Instance da7beaa4-0356-4315-bdcc-af5b9c1730a1 could not be found. Oct 04 22:12:06.827242 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': 'da7beaa4-0356-4315-bdcc-af5b9c1730a1'} Oct 04 22:12:06.827242 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:12:06.827242 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:12:06.827242 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:12:06.827242 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:12:06.827242 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:12:06.827242 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:12:06.827242 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:12:06.827242 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:12:06.827242 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:12:06.827242 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:12:06.827242 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da7beaa4-0356-4315-bdcc-af5b9c1730a1 could not be found. Oct 04 22:12:06.827242 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:12:06.827242 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:12:06.827242 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:12:06.827242 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:12:06.827242 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:12:06.827242 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:12:06.827242 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:12:06.827242 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:12:06.827242 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:12:06.827242 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:12:06.827242 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:12:06.827242 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:12:06.827242 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:12:06.827242 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:12:06.827242 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:12:06.827242 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:12:06.827242 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da7beaa4-0356-4315-bdcc-af5b9c1730a1 could not be found. Oct 04 22:12:06.827242 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:12:06.827242 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:12:06.827242 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:12:06.830697 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:12:06.830697 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:12:06.830697 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:12:06.830697 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:12:06.830697 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:12:06.830697 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da7beaa4-0356-4315-bdcc-af5b9c1730a1 could not be found. Oct 04 22:12:06.830697 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:12:06.832791 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-54e199a4-7923-42e8-a8ad-e8b0a2a7ee96 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Returning 404 to user: Instance da7beaa4-0356-4315-bdcc-af5b9c1730a1 could not be found. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:12:06.833909 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-54e199a4-7923-42e8-a8ad-e8b0a2a7ee96 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "GET /compute/v2.1/servers/da7beaa4-0356-4315-bdcc-af5b9c1730a1" status: 404 len: 111 microversion: 2.1 time: 0.063104 Oct 04 22:12:06.842167 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2660/5264] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:12:06 2022] GET /compute/v2.1/servers/da7beaa4-0356-4315-bdcc-af5b9c1730a1 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:12:06.872011 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-ecb0fd2f-0539-4569-b24b-5885a1077263 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:12:06.873251 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-ecb0fd2f-0539-4569-b24b-5885a1077263 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: 395434aa-4b24-4f4f-b83c-bb8870cd38b7] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:12:06.882569 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ecb0fd2f-0539-4569-b24b-5885a1077263 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:06.885002 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ecb0fd2f-0539-4569-b24b-5885a1077263 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:06.886006 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ecb0fd2f-0539-4569-b24b-5885a1077263 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:06.887105 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ecb0fd2f-0539-4569-b24b-5885a1077263 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:06.888487 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ecb0fd2f-0539-4569-b24b-5885a1077263 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:06.889138 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ecb0fd2f-0539-4569-b24b-5885a1077263 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:06.908406 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-ecb0fd2f-0539-4569-b24b-5885a1077263 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] HTTP exception thrown: Instance 395434aa-4b24-4f4f-b83c-bb8870cd38b7 could not be found. Oct 04 22:12:06.910143 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-ecb0fd2f-0539-4569-b24b-5885a1077263 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Request method failure captured: Oct 04 22:12:06.910143 n-d-860284-1 devstack@n-api.service[134101]: request: DELETE /compute/v2.1/servers/395434aa-4b24-4f4f-b83c-bb8870cd38b7 HTTP/1.1 Oct 04 22:12:06.910143 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 22:12:06.910143 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 22:12:06.910143 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 22:12:06.910143 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 22:12:06.910143 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 22:12:06.910143 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 22:12:06.910143 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 22:12:06.910143 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 22:12:06.910143 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPK7MP0-m-xtUnxXwLoxlIfO4jzoQOT6GMi-_9Rz-dG646c6MuQMOjiOhGtcOohb2ZIUdejR42Va0IkiFMBDtdnbnUEdF8Psxz0uHfYGBQiEZpqo4CpOHPpz5KjUxS1LmPgcFnegJZtGQu1irxi49GMeHkm9nnXbxd63druWj1zFChJ4 Oct 04 22:12:06.910143 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 22:12:06.910143 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 22:12:06.910143 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 22:12:06.910143 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 22:12:06.910143 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 22:12:06.910143 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 22:12:06.910143 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: d4b00cd9fa8e40a0919b61fcd60269f5 Oct 04 22:12:06.910143 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-ServersTestJSON-1600369848 Oct 04 22:12:06.910143 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 22:12:06.910143 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 22:12:06.910143 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d4b00cd9fa8e40a0919b61fcd60269f5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_d4b00cd9fa8e40a0919b61fcd60269f5", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d4b00cd9fa8e40a0919b61fcd60269f5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/d4b00cd9fa8e40a0919b61fcd60269f5"}]}] Oct 04 22:12:06.910143 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-ServersTestJSON-1600369848 Oct 04 22:12:06.910143 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: d4b00cd9fa8e40a0919b61fcd60269f5 Oct 04 22:12:06.910143 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-ServersTestJSON-1600369848 Oct 04 22:12:06.910143 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-ServersTestJSON-1600369848-project Oct 04 22:12:06.910143 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 22:12:06.910143 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 22:12:06.910143 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 9c1682f1a60045d8a04d4d67393cd13f Oct 04 22:12:06.910143 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-ServersTestJSON-1600369848-project Oct 04 22:12:06.910143 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 22:12:06.910143 n-d-860284-1 devstack@n-api.service[134101]: exception: Instance 395434aa-4b24-4f4f-b83c-bb8870cd38b7 could not be found. Oct 04 22:12:06.910143 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': '395434aa-4b24-4f4f-b83c-bb8870cd38b7'} Oct 04 22:12:06.910143 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:12:06.910143 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:12:06.910143 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:12:06.910143 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:12:06.910143 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:12:06.910143 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:12:06.910143 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:12:06.910143 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:12:06.910143 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:12:06.910143 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:12:06.910143 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 395434aa-4b24-4f4f-b83c-bb8870cd38b7 could not be found. Oct 04 22:12:06.910143 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:12:06.910143 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:12:06.910143 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:12:06.910143 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:12:06.910143 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:12:06.910143 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:12:06.910143 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:12:06.910143 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:12:06.910143 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:12:06.910143 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:12:06.910143 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 22:12:06.910143 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 22:12:06.910143 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 22:12:06.910143 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 22:12:06.910143 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:12:06.910143 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:12:06.910143 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:12:06.910143 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:12:06.910143 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 395434aa-4b24-4f4f-b83c-bb8870cd38b7 could not be found. Oct 04 22:12:06.914380 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:12:06.914380 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:12:06.914380 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:12:06.914380 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:12:06.914380 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:12:06.914380 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:12:06.914380 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:12:06.914380 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:12:06.914380 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 395434aa-4b24-4f4f-b83c-bb8870cd38b7 could not be found. Oct 04 22:12:06.914380 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:12:06.916377 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-ecb0fd2f-0539-4569-b24b-5885a1077263 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Returning 404 to user: Instance 395434aa-4b24-4f4f-b83c-bb8870cd38b7 could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:12:06.917417 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-ecb0fd2f-0539-4569-b24b-5885a1077263 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "DELETE /compute/v2.1/servers/395434aa-4b24-4f4f-b83c-bb8870cd38b7" status: 404 len: 111 microversion: 2.1 time: 0.070659 Oct 04 22:12:06.918510 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2605/5265] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 22:12:06 2022] DELETE /compute/v2.1/servers/395434aa-4b24-4f4f-b83c-bb8870cd38b7 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:12:06.928359 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-f5b18032-7792-4a60-8a7c-dcbd5893d4d5 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:12:06.929148 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-f5b18032-7792-4a60-8a7c-dcbd5893d4d5 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: 395434aa-4b24-4f4f-b83c-bb8870cd38b7] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:12:06.940205 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f5b18032-7792-4a60-8a7c-dcbd5893d4d5 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:06.941193 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f5b18032-7792-4a60-8a7c-dcbd5893d4d5 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:06.941816 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f5b18032-7792-4a60-8a7c-dcbd5893d4d5 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:06.942855 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f5b18032-7792-4a60-8a7c-dcbd5893d4d5 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:06.943474 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f5b18032-7792-4a60-8a7c-dcbd5893d4d5 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:06.944077 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f5b18032-7792-4a60-8a7c-dcbd5893d4d5 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:06.968090 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-f5b18032-7792-4a60-8a7c-dcbd5893d4d5 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] HTTP exception thrown: Instance 395434aa-4b24-4f4f-b83c-bb8870cd38b7 could not be found. Oct 04 22:12:06.969875 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-f5b18032-7792-4a60-8a7c-dcbd5893d4d5 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Request method failure captured: Oct 04 22:12:06.969875 n-d-860284-1 devstack@n-api.service[134102]: request: GET /compute/v2.1/servers/395434aa-4b24-4f4f-b83c-bb8870cd38b7 HTTP/1.1 Oct 04 22:12:06.969875 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 22:12:06.969875 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 22:12:06.969875 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 22:12:06.969875 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 22:12:06.969875 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 22:12:06.969875 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 22:12:06.969875 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 22:12:06.969875 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 22:12:06.969875 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPK7MP0-m-xtUnxXwLoxlIfO4jzoQOT6GMi-_9Rz-dG646c6MuQMOjiOhGtcOohb2ZIUdejR42Va0IkiFMBDtdnbnUEdF8Psxz0uHfYGBQiEZpqo4CpOHPpz5KjUxS1LmPgcFnegJZtGQu1irxi49GMeHkm9nnXbxd63druWj1zFChJ4 Oct 04 22:12:06.969875 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 22:12:06.969875 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 22:12:06.969875 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 22:12:06.969875 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 22:12:06.969875 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 22:12:06.969875 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 22:12:06.969875 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: d4b00cd9fa8e40a0919b61fcd60269f5 Oct 04 22:12:06.969875 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-ServersTestJSON-1600369848 Oct 04 22:12:06.969875 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 22:12:06.969875 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 22:12:06.969875 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d4b00cd9fa8e40a0919b61fcd60269f5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_d4b00cd9fa8e40a0919b61fcd60269f5", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d4b00cd9fa8e40a0919b61fcd60269f5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/d4b00cd9fa8e40a0919b61fcd60269f5"}]}] Oct 04 22:12:06.969875 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-ServersTestJSON-1600369848 Oct 04 22:12:06.969875 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: d4b00cd9fa8e40a0919b61fcd60269f5 Oct 04 22:12:06.969875 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-ServersTestJSON-1600369848 Oct 04 22:12:06.969875 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-ServersTestJSON-1600369848-project Oct 04 22:12:06.969875 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 22:12:06.969875 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 22:12:06.969875 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: 9c1682f1a60045d8a04d4d67393cd13f Oct 04 22:12:06.969875 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-ServersTestJSON-1600369848-project Oct 04 22:12:06.969875 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 22:12:06.969875 n-d-860284-1 devstack@n-api.service[134102]: exception: Instance 395434aa-4b24-4f4f-b83c-bb8870cd38b7 could not be found. Oct 04 22:12:06.969875 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': '395434aa-4b24-4f4f-b83c-bb8870cd38b7'} Oct 04 22:12:06.969875 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:12:06.969875 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:12:06.969875 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:12:06.969875 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:12:06.969875 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:12:06.969875 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:12:06.969875 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:12:06.969875 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:12:06.969875 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:12:06.969875 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:12:06.969875 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 395434aa-4b24-4f4f-b83c-bb8870cd38b7 could not be found. Oct 04 22:12:06.969875 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:12:06.969875 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:12:06.969875 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:12:06.969875 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:12:06.969875 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:12:06.969875 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:12:06.969875 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:12:06.969875 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:12:06.969875 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:12:06.969875 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:12:06.969875 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:12:06.969875 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:12:06.969875 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:12:06.969875 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:12:06.969875 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:12:06.969875 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:12:06.969875 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 395434aa-4b24-4f4f-b83c-bb8870cd38b7 could not be found. Oct 04 22:12:06.969875 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:12:06.969875 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:12:06.969875 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:12:06.973379 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:12:06.973379 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:12:06.973379 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:12:06.973379 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:12:06.973379 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:12:06.973379 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 395434aa-4b24-4f4f-b83c-bb8870cd38b7 could not be found. Oct 04 22:12:06.973379 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:12:06.973379 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-f5b18032-7792-4a60-8a7c-dcbd5893d4d5 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Returning 404 to user: Instance 395434aa-4b24-4f4f-b83c-bb8870cd38b7 could not be found. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:12:06.973379 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-f5b18032-7792-4a60-8a7c-dcbd5893d4d5 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "GET /compute/v2.1/servers/395434aa-4b24-4f4f-b83c-bb8870cd38b7" status: 404 len: 111 microversion: 2.1 time: 0.047725 Oct 04 22:12:06.973379 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2661/5266] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:12:06 2022] GET /compute/v2.1/servers/395434aa-4b24-4f4f-b83c-bb8870cd38b7 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:12:06.980003 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-afb67051-a2a7-4d26-9d18-fe87e80fa7d9 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:12:06.980770 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-afb67051-a2a7-4d26-9d18-fe87e80fa7d9 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: bedf6a44-86ef-4673-8a8f-7541db6eeda7] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:12:06.988131 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-afb67051-a2a7-4d26-9d18-fe87e80fa7d9 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:06.988874 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-afb67051-a2a7-4d26-9d18-fe87e80fa7d9 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:06.989531 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-afb67051-a2a7-4d26-9d18-fe87e80fa7d9 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:06.990719 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-afb67051-a2a7-4d26-9d18-fe87e80fa7d9 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:06.991391 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-afb67051-a2a7-4d26-9d18-fe87e80fa7d9 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:06.992023 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-afb67051-a2a7-4d26-9d18-fe87e80fa7d9 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:07.009168 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-afb67051-a2a7-4d26-9d18-fe87e80fa7d9 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] HTTP exception thrown: Instance bedf6a44-86ef-4673-8a8f-7541db6eeda7 could not be found. Oct 04 22:12:07.010814 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-afb67051-a2a7-4d26-9d18-fe87e80fa7d9 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Request method failure captured: Oct 04 22:12:07.010814 n-d-860284-1 devstack@n-api.service[134101]: request: DELETE /compute/v2.1/servers/bedf6a44-86ef-4673-8a8f-7541db6eeda7 HTTP/1.1 Oct 04 22:12:07.010814 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 22:12:07.010814 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 22:12:07.010814 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 22:12:07.010814 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 22:12:07.010814 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 22:12:07.010814 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 22:12:07.010814 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 22:12:07.010814 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 22:12:07.010814 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPK7MP0-m-xtUnxXwLoxlIfO4jzoQOT6GMi-_9Rz-dG646c6MuQMOjiOhGtcOohb2ZIUdejR42Va0IkiFMBDtdnbnUEdF8Psxz0uHfYGBQiEZpqo4CpOHPpz5KjUxS1LmPgcFnegJZtGQu1irxi49GMeHkm9nnXbxd63druWj1zFChJ4 Oct 04 22:12:07.010814 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 22:12:07.010814 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 22:12:07.010814 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 22:12:07.010814 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 22:12:07.010814 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 22:12:07.010814 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 22:12:07.010814 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: d4b00cd9fa8e40a0919b61fcd60269f5 Oct 04 22:12:07.010814 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-ServersTestJSON-1600369848 Oct 04 22:12:07.010814 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 22:12:07.010814 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 22:12:07.010814 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d4b00cd9fa8e40a0919b61fcd60269f5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_d4b00cd9fa8e40a0919b61fcd60269f5", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d4b00cd9fa8e40a0919b61fcd60269f5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/d4b00cd9fa8e40a0919b61fcd60269f5"}]}] Oct 04 22:12:07.010814 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-ServersTestJSON-1600369848 Oct 04 22:12:07.010814 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: d4b00cd9fa8e40a0919b61fcd60269f5 Oct 04 22:12:07.010814 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-ServersTestJSON-1600369848 Oct 04 22:12:07.010814 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-ServersTestJSON-1600369848-project Oct 04 22:12:07.010814 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 22:12:07.010814 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 22:12:07.010814 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 9c1682f1a60045d8a04d4d67393cd13f Oct 04 22:12:07.010814 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-ServersTestJSON-1600369848-project Oct 04 22:12:07.010814 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 22:12:07.010814 n-d-860284-1 devstack@n-api.service[134101]: exception: Instance bedf6a44-86ef-4673-8a8f-7541db6eeda7 could not be found. Oct 04 22:12:07.010814 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': 'bedf6a44-86ef-4673-8a8f-7541db6eeda7'} Oct 04 22:12:07.010814 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:12:07.010814 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:12:07.010814 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:12:07.010814 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:12:07.010814 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:12:07.010814 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:12:07.010814 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:12:07.010814 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:12:07.010814 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:12:07.010814 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:12:07.010814 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bedf6a44-86ef-4673-8a8f-7541db6eeda7 could not be found. Oct 04 22:12:07.010814 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:12:07.010814 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:12:07.010814 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:12:07.010814 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:12:07.010814 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:12:07.010814 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:12:07.010814 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:12:07.010814 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:12:07.010814 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:12:07.010814 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:12:07.010814 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 22:12:07.010814 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 22:12:07.010814 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 22:12:07.010814 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 22:12:07.010814 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:12:07.010814 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:12:07.010814 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:12:07.010814 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:12:07.010814 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bedf6a44-86ef-4673-8a8f-7541db6eeda7 could not be found. Oct 04 22:12:07.014913 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:12:07.014913 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:12:07.014913 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:12:07.014913 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:12:07.014913 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:12:07.014913 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:12:07.014913 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:12:07.014913 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:12:07.014913 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bedf6a44-86ef-4673-8a8f-7541db6eeda7 could not be found. Oct 04 22:12:07.014913 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:12:07.014913 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-afb67051-a2a7-4d26-9d18-fe87e80fa7d9 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Returning 404 to user: Instance bedf6a44-86ef-4673-8a8f-7541db6eeda7 could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:12:07.014913 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-afb67051-a2a7-4d26-9d18-fe87e80fa7d9 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "DELETE /compute/v2.1/servers/bedf6a44-86ef-4673-8a8f-7541db6eeda7" status: 404 len: 111 microversion: 2.1 time: 0.036161 Oct 04 22:12:07.014913 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2606/5267] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 22:12:06 2022] DELETE /compute/v2.1/servers/bedf6a44-86ef-4673-8a8f-7541db6eeda7 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:12:07.021226 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-2d4d41fe-1feb-48c2-bb8d-05827b282618 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:12:07.022179 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-2d4d41fe-1feb-48c2-bb8d-05827b282618 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: bedf6a44-86ef-4673-8a8f-7541db6eeda7] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:12:07.028925 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2d4d41fe-1feb-48c2-bb8d-05827b282618 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:07.029716 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2d4d41fe-1feb-48c2-bb8d-05827b282618 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:07.030110 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2d4d41fe-1feb-48c2-bb8d-05827b282618 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:07.030961 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2d4d41fe-1feb-48c2-bb8d-05827b282618 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:07.031496 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2d4d41fe-1feb-48c2-bb8d-05827b282618 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:07.032072 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2d4d41fe-1feb-48c2-bb8d-05827b282618 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:07.058358 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-b77b02ed-7583-4656-ac31-4656514ff9de tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:12:07.058979 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-b77b02ed-7583-4656-ac31-4656514ff9de tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] [instance: 3086c8a4-4db9-459b-8fdb-1a27c1c42d75] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:12:07.062202 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-2d4d41fe-1feb-48c2-bb8d-05827b282618 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] HTTP exception thrown: Instance bedf6a44-86ef-4673-8a8f-7541db6eeda7 could not be found. Oct 04 22:12:07.064954 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-2d4d41fe-1feb-48c2-bb8d-05827b282618 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Request method failure captured: Oct 04 22:12:07.064954 n-d-860284-1 devstack@n-api.service[134102]: request: GET /compute/v2.1/servers/bedf6a44-86ef-4673-8a8f-7541db6eeda7 HTTP/1.1 Oct 04 22:12:07.064954 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 22:12:07.064954 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 22:12:07.064954 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 22:12:07.064954 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 22:12:07.064954 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 22:12:07.064954 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 22:12:07.064954 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 22:12:07.064954 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 22:12:07.064954 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPK7MP0-m-xtUnxXwLoxlIfO4jzoQOT6GMi-_9Rz-dG646c6MuQMOjiOhGtcOohb2ZIUdejR42Va0IkiFMBDtdnbnUEdF8Psxz0uHfYGBQiEZpqo4CpOHPpz5KjUxS1LmPgcFnegJZtGQu1irxi49GMeHkm9nnXbxd63druWj1zFChJ4 Oct 04 22:12:07.064954 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 22:12:07.064954 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 22:12:07.064954 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 22:12:07.064954 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 22:12:07.064954 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 22:12:07.064954 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 22:12:07.064954 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: d4b00cd9fa8e40a0919b61fcd60269f5 Oct 04 22:12:07.064954 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-ServersTestJSON-1600369848 Oct 04 22:12:07.064954 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 22:12:07.064954 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 22:12:07.064954 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d4b00cd9fa8e40a0919b61fcd60269f5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_d4b00cd9fa8e40a0919b61fcd60269f5", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d4b00cd9fa8e40a0919b61fcd60269f5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/d4b00cd9fa8e40a0919b61fcd60269f5"}]}] Oct 04 22:12:07.064954 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-ServersTestJSON-1600369848 Oct 04 22:12:07.064954 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: d4b00cd9fa8e40a0919b61fcd60269f5 Oct 04 22:12:07.064954 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-ServersTestJSON-1600369848 Oct 04 22:12:07.064954 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-ServersTestJSON-1600369848-project Oct 04 22:12:07.064954 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 22:12:07.064954 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 22:12:07.064954 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: 9c1682f1a60045d8a04d4d67393cd13f Oct 04 22:12:07.064954 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-ServersTestJSON-1600369848-project Oct 04 22:12:07.064954 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 22:12:07.064954 n-d-860284-1 devstack@n-api.service[134102]: exception: Instance bedf6a44-86ef-4673-8a8f-7541db6eeda7 could not be found. Oct 04 22:12:07.064954 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': 'bedf6a44-86ef-4673-8a8f-7541db6eeda7'} Oct 04 22:12:07.064954 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:12:07.064954 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:12:07.064954 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:12:07.064954 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:12:07.064954 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:12:07.064954 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:12:07.064954 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:12:07.064954 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:12:07.064954 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:12:07.064954 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:12:07.064954 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bedf6a44-86ef-4673-8a8f-7541db6eeda7 could not be found. Oct 04 22:12:07.064954 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:12:07.064954 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:12:07.064954 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:12:07.064954 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:12:07.064954 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:12:07.064954 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:12:07.064954 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:12:07.064954 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:12:07.064954 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:12:07.064954 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:12:07.064954 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:12:07.064954 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:12:07.064954 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:12:07.064954 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:12:07.064954 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:12:07.064954 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:12:07.064954 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bedf6a44-86ef-4673-8a8f-7541db6eeda7 could not be found. Oct 04 22:12:07.064954 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:12:07.064954 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:12:07.064954 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:12:07.069806 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:12:07.069806 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:12:07.069806 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:12:07.069806 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:12:07.069806 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:12:07.069806 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bedf6a44-86ef-4673-8a8f-7541db6eeda7 could not be found. Oct 04 22:12:07.069806 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:12:07.071113 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b77b02ed-7583-4656-ac31-4656514ff9de tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:07.071113 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b77b02ed-7583-4656-ac31-4656514ff9de tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:07.071113 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b77b02ed-7583-4656-ac31-4656514ff9de tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:07.071113 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b77b02ed-7583-4656-ac31-4656514ff9de tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:07.071113 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b77b02ed-7583-4656-ac31-4656514ff9de tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:07.071113 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b77b02ed-7583-4656-ac31-4656514ff9de tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:07.073200 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-2d4d41fe-1feb-48c2-bb8d-05827b282618 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Returning 404 to user: Instance bedf6a44-86ef-4673-8a8f-7541db6eeda7 could not be found. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:12:07.074659 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-2d4d41fe-1feb-48c2-bb8d-05827b282618 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "GET /compute/v2.1/servers/bedf6a44-86ef-4673-8a8f-7541db6eeda7" status: 404 len: 111 microversion: 2.1 time: 0.057289 Oct 04 22:12:07.081251 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2662/5268] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:12:07 2022] GET /compute/v2.1/servers/bedf6a44-86ef-4673-8a8f-7541db6eeda7 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:12:07.094714 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-fe89acc5-9dfa-40c8-9117-c1421a80ad33 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:12:07.095213 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-fe89acc5-9dfa-40c8-9117-c1421a80ad33 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: 25c0bc2a-016e-441c-aeda-ad5c48f755fa] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:12:07.101903 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fe89acc5-9dfa-40c8-9117-c1421a80ad33 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:07.102406 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fe89acc5-9dfa-40c8-9117-c1421a80ad33 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:07.103047 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fe89acc5-9dfa-40c8-9117-c1421a80ad33 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:07.103927 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fe89acc5-9dfa-40c8-9117-c1421a80ad33 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:07.104527 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fe89acc5-9dfa-40c8-9117-c1421a80ad33 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:07.105092 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fe89acc5-9dfa-40c8-9117-c1421a80ad33 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:07.108804 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-b77b02ed-7583-4656-ac31-4656514ff9de tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] [instance: 3086c8a4-4db9-459b-8fdb-1a27c1c42d75] Going to try to terminate instance {{(pid=134101) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 22:12:07.127574 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-fe89acc5-9dfa-40c8-9117-c1421a80ad33 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] HTTP exception thrown: Instance 25c0bc2a-016e-441c-aeda-ad5c48f755fa could not be found. Oct 04 22:12:07.130919 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-fe89acc5-9dfa-40c8-9117-c1421a80ad33 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Request method failure captured: Oct 04 22:12:07.130919 n-d-860284-1 devstack@n-api.service[134102]: request: DELETE /compute/v2.1/servers/25c0bc2a-016e-441c-aeda-ad5c48f755fa HTTP/1.1 Oct 04 22:12:07.130919 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 22:12:07.130919 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 22:12:07.130919 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 22:12:07.130919 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 22:12:07.130919 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 22:12:07.130919 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 22:12:07.130919 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 22:12:07.130919 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 22:12:07.130919 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPK7MP0-m-xtUnxXwLoxlIfO4jzoQOT6GMi-_9Rz-dG646c6MuQMOjiOhGtcOohb2ZIUdejR42Va0IkiFMBDtdnbnUEdF8Psxz0uHfYGBQiEZpqo4CpOHPpz5KjUxS1LmPgcFnegJZtGQu1irxi49GMeHkm9nnXbxd63druWj1zFChJ4 Oct 04 22:12:07.130919 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 22:12:07.130919 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 22:12:07.130919 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 22:12:07.130919 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 22:12:07.130919 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 22:12:07.130919 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 22:12:07.130919 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: d4b00cd9fa8e40a0919b61fcd60269f5 Oct 04 22:12:07.130919 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-ServersTestJSON-1600369848 Oct 04 22:12:07.130919 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 22:12:07.130919 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 22:12:07.130919 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d4b00cd9fa8e40a0919b61fcd60269f5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_d4b00cd9fa8e40a0919b61fcd60269f5", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d4b00cd9fa8e40a0919b61fcd60269f5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/d4b00cd9fa8e40a0919b61fcd60269f5"}]}] Oct 04 22:12:07.130919 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-ServersTestJSON-1600369848 Oct 04 22:12:07.130919 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: d4b00cd9fa8e40a0919b61fcd60269f5 Oct 04 22:12:07.130919 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-ServersTestJSON-1600369848 Oct 04 22:12:07.130919 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-ServersTestJSON-1600369848-project Oct 04 22:12:07.130919 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 22:12:07.130919 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 22:12:07.130919 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: 9c1682f1a60045d8a04d4d67393cd13f Oct 04 22:12:07.130919 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-ServersTestJSON-1600369848-project Oct 04 22:12:07.130919 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 22:12:07.130919 n-d-860284-1 devstack@n-api.service[134102]: exception: Instance 25c0bc2a-016e-441c-aeda-ad5c48f755fa could not be found. Oct 04 22:12:07.130919 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': '25c0bc2a-016e-441c-aeda-ad5c48f755fa'} Oct 04 22:12:07.130919 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:12:07.130919 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:12:07.130919 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:12:07.130919 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:12:07.130919 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:12:07.130919 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:12:07.130919 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:12:07.130919 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:12:07.130919 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:12:07.130919 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:12:07.130919 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 25c0bc2a-016e-441c-aeda-ad5c48f755fa could not be found. Oct 04 22:12:07.130919 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:12:07.130919 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:12:07.130919 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:12:07.130919 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:12:07.130919 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:12:07.130919 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:12:07.130919 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:12:07.130919 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:12:07.130919 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:12:07.130919 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:12:07.130919 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 22:12:07.130919 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 22:12:07.130919 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 22:12:07.130919 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 22:12:07.130919 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:12:07.130919 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:12:07.130919 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:12:07.130919 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:12:07.130919 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 25c0bc2a-016e-441c-aeda-ad5c48f755fa could not be found. Oct 04 22:12:07.134724 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:12:07.134724 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:12:07.134724 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:12:07.134724 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:12:07.134724 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:12:07.134724 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:12:07.134724 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:12:07.134724 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:12:07.134724 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 25c0bc2a-016e-441c-aeda-ad5c48f755fa could not be found. Oct 04 22:12:07.134724 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:12:07.137014 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-fe89acc5-9dfa-40c8-9117-c1421a80ad33 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Returning 404 to user: Instance 25c0bc2a-016e-441c-aeda-ad5c48f755fa could not be found. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:12:07.138063 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-fe89acc5-9dfa-40c8-9117-c1421a80ad33 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "DELETE /compute/v2.1/servers/25c0bc2a-016e-441c-aeda-ad5c48f755fa" status: 404 len: 111 microversion: 2.1 time: 0.052294 Oct 04 22:12:07.138847 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2663/5269] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 22:12:07 2022] DELETE /compute/v2.1/servers/25c0bc2a-016e-441c-aeda-ad5c48f755fa => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:12:07.149515 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-584c2115-d516-4c8d-ae90-b241690aae46 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:12:07.150151 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-584c2115-d516-4c8d-ae90-b241690aae46 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: 25c0bc2a-016e-441c-aeda-ad5c48f755fa] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:12:07.164257 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-584c2115-d516-4c8d-ae90-b241690aae46 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:07.165315 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-584c2115-d516-4c8d-ae90-b241690aae46 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:07.165952 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-584c2115-d516-4c8d-ae90-b241690aae46 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:07.167209 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-584c2115-d516-4c8d-ae90-b241690aae46 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:07.171461 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-584c2115-d516-4c8d-ae90-b241690aae46 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:07.174496 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-584c2115-d516-4c8d-ae90-b241690aae46 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:07.196218 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:12:07.205989 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-584c2115-d516-4c8d-ae90-b241690aae46 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] HTTP exception thrown: Instance 25c0bc2a-016e-441c-aeda-ad5c48f755fa could not be found. Oct 04 22:12:07.209751 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-584c2115-d516-4c8d-ae90-b241690aae46 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Request method failure captured: Oct 04 22:12:07.209751 n-d-860284-1 devstack@n-api.service[134102]: request: GET /compute/v2.1/servers/25c0bc2a-016e-441c-aeda-ad5c48f755fa HTTP/1.1 Oct 04 22:12:07.209751 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 22:12:07.209751 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 22:12:07.209751 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 22:12:07.209751 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 22:12:07.209751 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 22:12:07.209751 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 22:12:07.209751 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 22:12:07.209751 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 22:12:07.209751 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPK7MP0-m-xtUnxXwLoxlIfO4jzoQOT6GMi-_9Rz-dG646c6MuQMOjiOhGtcOohb2ZIUdejR42Va0IkiFMBDtdnbnUEdF8Psxz0uHfYGBQiEZpqo4CpOHPpz5KjUxS1LmPgcFnegJZtGQu1irxi49GMeHkm9nnXbxd63druWj1zFChJ4 Oct 04 22:12:07.209751 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 22:12:07.209751 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 22:12:07.209751 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 22:12:07.209751 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 22:12:07.209751 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 22:12:07.209751 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 22:12:07.209751 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: d4b00cd9fa8e40a0919b61fcd60269f5 Oct 04 22:12:07.209751 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-ServersTestJSON-1600369848 Oct 04 22:12:07.209751 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 22:12:07.209751 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 22:12:07.209751 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d4b00cd9fa8e40a0919b61fcd60269f5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_d4b00cd9fa8e40a0919b61fcd60269f5", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d4b00cd9fa8e40a0919b61fcd60269f5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/d4b00cd9fa8e40a0919b61fcd60269f5"}]}] Oct 04 22:12:07.209751 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-ServersTestJSON-1600369848 Oct 04 22:12:07.209751 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: d4b00cd9fa8e40a0919b61fcd60269f5 Oct 04 22:12:07.209751 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-ServersTestJSON-1600369848 Oct 04 22:12:07.209751 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-ServersTestJSON-1600369848-project Oct 04 22:12:07.209751 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 22:12:07.209751 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 22:12:07.209751 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: 9c1682f1a60045d8a04d4d67393cd13f Oct 04 22:12:07.209751 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-ServersTestJSON-1600369848-project Oct 04 22:12:07.209751 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 22:12:07.209751 n-d-860284-1 devstack@n-api.service[134102]: exception: Instance 25c0bc2a-016e-441c-aeda-ad5c48f755fa could not be found. Oct 04 22:12:07.209751 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': '25c0bc2a-016e-441c-aeda-ad5c48f755fa'} Oct 04 22:12:07.209751 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:12:07.209751 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:12:07.209751 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:12:07.209751 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:12:07.209751 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:12:07.209751 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:12:07.209751 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:12:07.209751 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:12:07.209751 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:12:07.209751 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:12:07.209751 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 25c0bc2a-016e-441c-aeda-ad5c48f755fa could not be found. Oct 04 22:12:07.209751 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:12:07.209751 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:12:07.209751 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:12:07.209751 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:12:07.209751 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:12:07.209751 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:12:07.209751 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:12:07.209751 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:12:07.209751 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:12:07.209751 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:12:07.209751 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:12:07.209751 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:12:07.209751 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:12:07.209751 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:12:07.209751 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:12:07.209751 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:12:07.209751 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 25c0bc2a-016e-441c-aeda-ad5c48f755fa could not be found. Oct 04 22:12:07.209751 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:12:07.209751 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:12:07.209751 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:12:07.213080 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:12:07.213080 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:12:07.213080 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:12:07.213080 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:12:07.213080 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:12:07.213080 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 25c0bc2a-016e-441c-aeda-ad5c48f755fa could not be found. Oct 04 22:12:07.213080 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:12:07.213080 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-584c2115-d516-4c8d-ae90-b241690aae46 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Returning 404 to user: Instance 25c0bc2a-016e-441c-aeda-ad5c48f755fa could not be found. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:12:07.213080 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-584c2115-d516-4c8d-ae90-b241690aae46 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "GET /compute/v2.1/servers/25c0bc2a-016e-441c-aeda-ad5c48f755fa" status: 404 len: 111 microversion: 2.1 time: 0.067446 Oct 04 22:12:07.217898 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2664/5270] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:12:07 2022] GET /compute/v2.1/servers/25c0bc2a-016e-441c-aeda-ad5c48f755fa => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:12:07.225854 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-ffe4084d-2083-4ae3-93bd-5177a84cd54d tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:12:07.226801 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-ffe4084d-2083-4ae3-93bd-5177a84cd54d tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: 3b565a7d-fde0-47e5-99b9-1ed5ba9aab93] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:12:07.245186 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ffe4084d-2083-4ae3-93bd-5177a84cd54d tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:07.248078 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ffe4084d-2083-4ae3-93bd-5177a84cd54d tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:07.249179 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ffe4084d-2083-4ae3-93bd-5177a84cd54d tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:07.250653 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ffe4084d-2083-4ae3-93bd-5177a84cd54d tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:07.251640 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ffe4084d-2083-4ae3-93bd-5177a84cd54d tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:07.252031 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ffe4084d-2083-4ae3-93bd-5177a84cd54d tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:07.272950 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-ffe4084d-2083-4ae3-93bd-5177a84cd54d tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] HTTP exception thrown: Instance 3b565a7d-fde0-47e5-99b9-1ed5ba9aab93 could not be found. Oct 04 22:12:07.274931 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-ffe4084d-2083-4ae3-93bd-5177a84cd54d tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Request method failure captured: Oct 04 22:12:07.274931 n-d-860284-1 devstack@n-api.service[134102]: request: DELETE /compute/v2.1/servers/3b565a7d-fde0-47e5-99b9-1ed5ba9aab93 HTTP/1.1 Oct 04 22:12:07.274931 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 22:12:07.274931 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 22:12:07.274931 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 22:12:07.274931 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 22:12:07.274931 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 22:12:07.274931 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 22:12:07.274931 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 22:12:07.274931 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 22:12:07.274931 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPK7MP0-m-xtUnxXwLoxlIfO4jzoQOT6GMi-_9Rz-dG646c6MuQMOjiOhGtcOohb2ZIUdejR42Va0IkiFMBDtdnbnUEdF8Psxz0uHfYGBQiEZpqo4CpOHPpz5KjUxS1LmPgcFnegJZtGQu1irxi49GMeHkm9nnXbxd63druWj1zFChJ4 Oct 04 22:12:07.274931 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 22:12:07.274931 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 22:12:07.274931 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 22:12:07.274931 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 22:12:07.274931 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 22:12:07.274931 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 22:12:07.274931 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: d4b00cd9fa8e40a0919b61fcd60269f5 Oct 04 22:12:07.274931 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-ServersTestJSON-1600369848 Oct 04 22:12:07.274931 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 22:12:07.274931 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 22:12:07.274931 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d4b00cd9fa8e40a0919b61fcd60269f5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_d4b00cd9fa8e40a0919b61fcd60269f5", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d4b00cd9fa8e40a0919b61fcd60269f5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/d4b00cd9fa8e40a0919b61fcd60269f5"}]}] Oct 04 22:12:07.274931 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-ServersTestJSON-1600369848 Oct 04 22:12:07.274931 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: d4b00cd9fa8e40a0919b61fcd60269f5 Oct 04 22:12:07.274931 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-ServersTestJSON-1600369848 Oct 04 22:12:07.274931 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-ServersTestJSON-1600369848-project Oct 04 22:12:07.274931 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 22:12:07.274931 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 22:12:07.274931 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: 9c1682f1a60045d8a04d4d67393cd13f Oct 04 22:12:07.274931 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-ServersTestJSON-1600369848-project Oct 04 22:12:07.274931 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 22:12:07.274931 n-d-860284-1 devstack@n-api.service[134102]: exception: Instance 3b565a7d-fde0-47e5-99b9-1ed5ba9aab93 could not be found. Oct 04 22:12:07.274931 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': '3b565a7d-fde0-47e5-99b9-1ed5ba9aab93'} Oct 04 22:12:07.274931 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:12:07.274931 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:12:07.274931 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:12:07.274931 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:12:07.274931 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:12:07.274931 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:12:07.274931 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:12:07.274931 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:12:07.274931 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:12:07.274931 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:12:07.274931 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b565a7d-fde0-47e5-99b9-1ed5ba9aab93 could not be found. Oct 04 22:12:07.274931 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:12:07.274931 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:12:07.274931 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:12:07.274931 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:12:07.274931 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:12:07.274931 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:12:07.274931 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:12:07.274931 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:12:07.274931 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:12:07.274931 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:12:07.274931 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 22:12:07.274931 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 22:12:07.274931 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 22:12:07.274931 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 22:12:07.274931 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:12:07.274931 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:12:07.274931 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:12:07.274931 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:12:07.274931 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b565a7d-fde0-47e5-99b9-1ed5ba9aab93 could not be found. Oct 04 22:12:07.278063 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:12:07.278063 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:12:07.278063 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:12:07.278063 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:12:07.278063 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:12:07.278063 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:12:07.278063 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:12:07.278063 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:12:07.278063 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b565a7d-fde0-47e5-99b9-1ed5ba9aab93 could not be found. Oct 04 22:12:07.278063 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:12:07.278063 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-ffe4084d-2083-4ae3-93bd-5177a84cd54d tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Returning 404 to user: Instance 3b565a7d-fde0-47e5-99b9-1ed5ba9aab93 could not be found. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:12:07.278063 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-ffe4084d-2083-4ae3-93bd-5177a84cd54d tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "DELETE /compute/v2.1/servers/3b565a7d-fde0-47e5-99b9-1ed5ba9aab93" status: 404 len: 111 microversion: 2.1 time: 0.054887 Oct 04 22:12:07.280780 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2665/5271] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 22:12:07 2022] DELETE /compute/v2.1/servers/3b565a7d-fde0-47e5-99b9-1ed5ba9aab93 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:12:07.288386 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-b77b02ed-7583-4656-ac31-4656514ff9de tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] 10.222.0.43 "DELETE /compute/v2.1/servers/3086c8a4-4db9-459b-8fdb-1a27c1c42d75" status: 204 len: 0 microversion: 2.1 time: 0.233322 Oct 04 22:12:07.292008 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2607/5272] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 22:12:07 2022] DELETE /compute/v2.1/servers/3086c8a4-4db9-459b-8fdb-1a27c1c42d75 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 22:12:07.301477 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-be1a1adb-a193-467f-a0e7-8260ecdfa43b tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:12:07.302559 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-be1a1adb-a193-467f-a0e7-8260ecdfa43b tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: 3b565a7d-fde0-47e5-99b9-1ed5ba9aab93] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:12:07.309398 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-be1a1adb-a193-467f-a0e7-8260ecdfa43b tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:07.309968 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-be1a1adb-a193-467f-a0e7-8260ecdfa43b tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:07.310463 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-be1a1adb-a193-467f-a0e7-8260ecdfa43b tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:07.311189 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-be1a1adb-a193-467f-a0e7-8260ecdfa43b tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:07.311672 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-be1a1adb-a193-467f-a0e7-8260ecdfa43b tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:07.312137 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-be1a1adb-a193-467f-a0e7-8260ecdfa43b tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:07.320707 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-651bf5d7-3ab6-4020-99e1-38da86d0de5f tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:12:07.327057 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-651bf5d7-3ab6-4020-99e1-38da86d0de5f tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] [instance: 3086c8a4-4db9-459b-8fdb-1a27c1c42d75] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:12:07.345623 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-651bf5d7-3ab6-4020-99e1-38da86d0de5f tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:07.346120 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-651bf5d7-3ab6-4020-99e1-38da86d0de5f tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:07.346831 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-651bf5d7-3ab6-4020-99e1-38da86d0de5f tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:07.347903 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-651bf5d7-3ab6-4020-99e1-38da86d0de5f tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:07.350584 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-be1a1adb-a193-467f-a0e7-8260ecdfa43b tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] HTTP exception thrown: Instance 3b565a7d-fde0-47e5-99b9-1ed5ba9aab93 could not be found. Oct 04 22:12:07.351005 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-651bf5d7-3ab6-4020-99e1-38da86d0de5f tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:07.351593 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-651bf5d7-3ab6-4020-99e1-38da86d0de5f tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:07.352882 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-be1a1adb-a193-467f-a0e7-8260ecdfa43b tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Request method failure captured: Oct 04 22:12:07.352882 n-d-860284-1 devstack@n-api.service[134102]: request: GET /compute/v2.1/servers/3b565a7d-fde0-47e5-99b9-1ed5ba9aab93 HTTP/1.1 Oct 04 22:12:07.352882 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 22:12:07.352882 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 22:12:07.352882 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 22:12:07.352882 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 22:12:07.352882 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 22:12:07.352882 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 22:12:07.352882 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 22:12:07.352882 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 22:12:07.352882 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPK7MP0-m-xtUnxXwLoxlIfO4jzoQOT6GMi-_9Rz-dG646c6MuQMOjiOhGtcOohb2ZIUdejR42Va0IkiFMBDtdnbnUEdF8Psxz0uHfYGBQiEZpqo4CpOHPpz5KjUxS1LmPgcFnegJZtGQu1irxi49GMeHkm9nnXbxd63druWj1zFChJ4 Oct 04 22:12:07.352882 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 22:12:07.352882 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 22:12:07.352882 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 22:12:07.352882 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 22:12:07.352882 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 22:12:07.352882 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 22:12:07.352882 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: d4b00cd9fa8e40a0919b61fcd60269f5 Oct 04 22:12:07.352882 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-ServersTestJSON-1600369848 Oct 04 22:12:07.352882 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 22:12:07.352882 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 22:12:07.352882 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d4b00cd9fa8e40a0919b61fcd60269f5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_d4b00cd9fa8e40a0919b61fcd60269f5", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d4b00cd9fa8e40a0919b61fcd60269f5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/d4b00cd9fa8e40a0919b61fcd60269f5"}]}] Oct 04 22:12:07.352882 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-ServersTestJSON-1600369848 Oct 04 22:12:07.352882 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: d4b00cd9fa8e40a0919b61fcd60269f5 Oct 04 22:12:07.352882 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-ServersTestJSON-1600369848 Oct 04 22:12:07.352882 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-ServersTestJSON-1600369848-project Oct 04 22:12:07.352882 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 22:12:07.352882 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 22:12:07.352882 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: 9c1682f1a60045d8a04d4d67393cd13f Oct 04 22:12:07.352882 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-ServersTestJSON-1600369848-project Oct 04 22:12:07.352882 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 22:12:07.352882 n-d-860284-1 devstack@n-api.service[134102]: exception: Instance 3b565a7d-fde0-47e5-99b9-1ed5ba9aab93 could not be found. Oct 04 22:12:07.352882 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': '3b565a7d-fde0-47e5-99b9-1ed5ba9aab93'} Oct 04 22:12:07.352882 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:12:07.352882 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:12:07.352882 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:12:07.352882 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:12:07.352882 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:12:07.352882 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:12:07.352882 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:12:07.352882 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:12:07.352882 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:12:07.352882 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:12:07.352882 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b565a7d-fde0-47e5-99b9-1ed5ba9aab93 could not be found. Oct 04 22:12:07.352882 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:12:07.352882 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:12:07.352882 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:12:07.352882 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:12:07.352882 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:12:07.352882 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:12:07.352882 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:12:07.352882 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:12:07.352882 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:12:07.352882 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:12:07.352882 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:12:07.352882 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:12:07.352882 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:12:07.352882 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:12:07.352882 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:12:07.352882 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:12:07.352882 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b565a7d-fde0-47e5-99b9-1ed5ba9aab93 could not be found. Oct 04 22:12:07.352882 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:12:07.352882 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:12:07.352882 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:12:07.356132 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:12:07.356132 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:12:07.356132 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:12:07.356132 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:12:07.356132 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:12:07.356132 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b565a7d-fde0-47e5-99b9-1ed5ba9aab93 could not be found. Oct 04 22:12:07.356132 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:12:07.356132 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-be1a1adb-a193-467f-a0e7-8260ecdfa43b tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Returning 404 to user: Instance 3b565a7d-fde0-47e5-99b9-1ed5ba9aab93 could not be found. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:12:07.356132 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-be1a1adb-a193-467f-a0e7-8260ecdfa43b tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "GET /compute/v2.1/servers/3b565a7d-fde0-47e5-99b9-1ed5ba9aab93" status: 404 len: 111 microversion: 2.1 time: 0.072694 Oct 04 22:12:07.361032 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2666/5273] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:12:07 2022] GET /compute/v2.1/servers/3b565a7d-fde0-47e5-99b9-1ed5ba9aab93 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:12:07.370665 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-cba11825-c9f5-4857-a235-19b3cf413f28 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:12:07.371678 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-cba11825-c9f5-4857-a235-19b3cf413f28 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: 62fc3d46-cf76-43a9-b7ed-ce6b76104d8d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:12:07.384130 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-cba11825-c9f5-4857-a235-19b3cf413f28 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] HTTP exception thrown: Instance 62fc3d46-cf76-43a9-b7ed-ce6b76104d8d could not be found. Oct 04 22:12:07.388336 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-cba11825-c9f5-4857-a235-19b3cf413f28 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Request method failure captured: Oct 04 22:12:07.388336 n-d-860284-1 devstack@n-api.service[134102]: request: DELETE /compute/v2.1/servers/62fc3d46-cf76-43a9-b7ed-ce6b76104d8d HTTP/1.1 Oct 04 22:12:07.388336 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 22:12:07.388336 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 22:12:07.388336 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 22:12:07.388336 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 22:12:07.388336 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 22:12:07.388336 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 22:12:07.388336 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 22:12:07.388336 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 22:12:07.388336 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPK7MP0-m-xtUnxXwLoxlIfO4jzoQOT6GMi-_9Rz-dG646c6MuQMOjiOhGtcOohb2ZIUdejR42Va0IkiFMBDtdnbnUEdF8Psxz0uHfYGBQiEZpqo4CpOHPpz5KjUxS1LmPgcFnegJZtGQu1irxi49GMeHkm9nnXbxd63druWj1zFChJ4 Oct 04 22:12:07.388336 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 22:12:07.388336 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 22:12:07.388336 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 22:12:07.388336 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 22:12:07.388336 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 22:12:07.388336 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 22:12:07.388336 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: d4b00cd9fa8e40a0919b61fcd60269f5 Oct 04 22:12:07.388336 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-ServersTestJSON-1600369848 Oct 04 22:12:07.388336 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 22:12:07.388336 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 22:12:07.388336 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d4b00cd9fa8e40a0919b61fcd60269f5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_d4b00cd9fa8e40a0919b61fcd60269f5", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d4b00cd9fa8e40a0919b61fcd60269f5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/d4b00cd9fa8e40a0919b61fcd60269f5"}]}] Oct 04 22:12:07.388336 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-ServersTestJSON-1600369848 Oct 04 22:12:07.388336 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: d4b00cd9fa8e40a0919b61fcd60269f5 Oct 04 22:12:07.388336 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-ServersTestJSON-1600369848 Oct 04 22:12:07.388336 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-ServersTestJSON-1600369848-project Oct 04 22:12:07.388336 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 22:12:07.388336 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 22:12:07.388336 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: 9c1682f1a60045d8a04d4d67393cd13f Oct 04 22:12:07.388336 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-ServersTestJSON-1600369848-project Oct 04 22:12:07.388336 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 22:12:07.388336 n-d-860284-1 devstack@n-api.service[134102]: exception: Instance 62fc3d46-cf76-43a9-b7ed-ce6b76104d8d could not be found. Oct 04 22:12:07.388336 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': '62fc3d46-cf76-43a9-b7ed-ce6b76104d8d'} Oct 04 22:12:07.388336 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:12:07.388336 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:12:07.388336 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:12:07.388336 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:12:07.388336 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:12:07.388336 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:12:07.388336 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 22:12:07.388336 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 22:12:07.388336 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62fc3d46-cf76-43a9-b7ed-ce6b76104d8d could not be found. Oct 04 22:12:07.388336 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:12:07.388336 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:12:07.388336 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:12:07.388336 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:12:07.388336 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:12:07.388336 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:12:07.388336 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:12:07.388336 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:12:07.388336 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:12:07.388336 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:12:07.388336 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 22:12:07.388336 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 22:12:07.388336 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 22:12:07.388336 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 22:12:07.388336 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:12:07.388336 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:12:07.388336 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:12:07.388336 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:12:07.388336 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62fc3d46-cf76-43a9-b7ed-ce6b76104d8d could not be found. Oct 04 22:12:07.388336 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:12:07.388336 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:12:07.388336 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:12:07.392446 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:12:07.392446 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:12:07.392446 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:12:07.392446 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:12:07.392446 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:12:07.392446 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62fc3d46-cf76-43a9-b7ed-ce6b76104d8d could not be found. Oct 04 22:12:07.392446 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:12:07.394944 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-cba11825-c9f5-4857-a235-19b3cf413f28 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Returning 404 to user: Instance 62fc3d46-cf76-43a9-b7ed-ce6b76104d8d could not be found. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:12:07.396045 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-cba11825-c9f5-4857-a235-19b3cf413f28 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "DELETE /compute/v2.1/servers/62fc3d46-cf76-43a9-b7ed-ce6b76104d8d" status: 404 len: 111 microversion: 2.1 time: 0.033898 Oct 04 22:12:07.397579 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2667/5274] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 22:12:07 2022] DELETE /compute/v2.1/servers/62fc3d46-cf76-43a9-b7ed-ce6b76104d8d => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:12:07.409311 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-479f34d0-f57e-4cdc-8978-ef5e45d0554b tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:12:07.410325 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-479f34d0-f57e-4cdc-8978-ef5e45d0554b tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: 62fc3d46-cf76-43a9-b7ed-ce6b76104d8d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:12:07.418625 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-479f34d0-f57e-4cdc-8978-ef5e45d0554b tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] HTTP exception thrown: Instance 62fc3d46-cf76-43a9-b7ed-ce6b76104d8d could not be found. Oct 04 22:12:07.420866 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-479f34d0-f57e-4cdc-8978-ef5e45d0554b tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Request method failure captured: Oct 04 22:12:07.420866 n-d-860284-1 devstack@n-api.service[134102]: request: GET /compute/v2.1/servers/62fc3d46-cf76-43a9-b7ed-ce6b76104d8d HTTP/1.1 Oct 04 22:12:07.420866 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 22:12:07.420866 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 22:12:07.420866 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 22:12:07.420866 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 22:12:07.420866 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 22:12:07.420866 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 22:12:07.420866 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 22:12:07.420866 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 22:12:07.420866 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPK7MP0-m-xtUnxXwLoxlIfO4jzoQOT6GMi-_9Rz-dG646c6MuQMOjiOhGtcOohb2ZIUdejR42Va0IkiFMBDtdnbnUEdF8Psxz0uHfYGBQiEZpqo4CpOHPpz5KjUxS1LmPgcFnegJZtGQu1irxi49GMeHkm9nnXbxd63druWj1zFChJ4 Oct 04 22:12:07.420866 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 22:12:07.420866 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 22:12:07.420866 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 22:12:07.420866 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 22:12:07.420866 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 22:12:07.420866 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 22:12:07.420866 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: d4b00cd9fa8e40a0919b61fcd60269f5 Oct 04 22:12:07.420866 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-ServersTestJSON-1600369848 Oct 04 22:12:07.420866 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 22:12:07.420866 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 22:12:07.420866 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d4b00cd9fa8e40a0919b61fcd60269f5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_d4b00cd9fa8e40a0919b61fcd60269f5", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d4b00cd9fa8e40a0919b61fcd60269f5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/d4b00cd9fa8e40a0919b61fcd60269f5"}]}] Oct 04 22:12:07.420866 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-ServersTestJSON-1600369848 Oct 04 22:12:07.420866 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: d4b00cd9fa8e40a0919b61fcd60269f5 Oct 04 22:12:07.420866 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-ServersTestJSON-1600369848 Oct 04 22:12:07.420866 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-ServersTestJSON-1600369848-project Oct 04 22:12:07.420866 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 22:12:07.420866 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 22:12:07.420866 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: 9c1682f1a60045d8a04d4d67393cd13f Oct 04 22:12:07.420866 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-ServersTestJSON-1600369848-project Oct 04 22:12:07.420866 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 22:12:07.420866 n-d-860284-1 devstack@n-api.service[134102]: exception: Instance 62fc3d46-cf76-43a9-b7ed-ce6b76104d8d could not be found. Oct 04 22:12:07.420866 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': '62fc3d46-cf76-43a9-b7ed-ce6b76104d8d'} Oct 04 22:12:07.420866 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:12:07.420866 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:12:07.420866 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:12:07.420866 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:12:07.420866 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:12:07.420866 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:12:07.420866 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 22:12:07.420866 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 22:12:07.420866 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62fc3d46-cf76-43a9-b7ed-ce6b76104d8d could not be found. Oct 04 22:12:07.420866 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:12:07.420866 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:12:07.420866 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:12:07.420866 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:12:07.420866 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:12:07.420866 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:12:07.420866 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:12:07.420866 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:12:07.420866 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:12:07.420866 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:12:07.420866 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:12:07.420866 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:12:07.420866 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:12:07.420866 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:12:07.420866 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:12:07.420866 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:12:07.420866 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62fc3d46-cf76-43a9-b7ed-ce6b76104d8d could not be found. Oct 04 22:12:07.420866 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:12:07.420866 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:12:07.420866 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:12:07.420866 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:12:07.420866 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:12:07.424122 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:12:07.424122 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:12:07.424122 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:12:07.424122 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62fc3d46-cf76-43a9-b7ed-ce6b76104d8d could not be found. Oct 04 22:12:07.424122 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:12:07.424122 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-479f34d0-f57e-4cdc-8978-ef5e45d0554b tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Returning 404 to user: Instance 62fc3d46-cf76-43a9-b7ed-ce6b76104d8d could not be found. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:12:07.424122 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-479f34d0-f57e-4cdc-8978-ef5e45d0554b tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "GET /compute/v2.1/servers/62fc3d46-cf76-43a9-b7ed-ce6b76104d8d" status: 404 len: 111 microversion: 2.1 time: 0.020596 Oct 04 22:12:07.424122 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2668/5275] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:12:07 2022] GET /compute/v2.1/servers/62fc3d46-cf76-43a9-b7ed-ce6b76104d8d => generated 111 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:12:07.440397 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-a37823d1-101f-465d-a614-d1bbde5fcb00 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:12:07.441072 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-a37823d1-101f-465d-a614-d1bbde5fcb00 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: 62b87810-2125-4803-bd20-74c16a76ef81] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:12:07.448329 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a37823d1-101f-465d-a614-d1bbde5fcb00 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:07.448830 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a37823d1-101f-465d-a614-d1bbde5fcb00 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:07.449274 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a37823d1-101f-465d-a614-d1bbde5fcb00 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:07.450002 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a37823d1-101f-465d-a614-d1bbde5fcb00 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:07.451075 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a37823d1-101f-465d-a614-d1bbde5fcb00 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:07.451496 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a37823d1-101f-465d-a614-d1bbde5fcb00 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:07.490687 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-a37823d1-101f-465d-a614-d1bbde5fcb00 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: 62b87810-2125-4803-bd20-74c16a76ef81] Going to try to terminate instance {{(pid=134102) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 22:12:07.680694 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-a37823d1-101f-465d-a614-d1bbde5fcb00 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "DELETE /compute/v2.1/servers/62b87810-2125-4803-bd20-74c16a76ef81" status: 204 len: 0 microversion: 2.1 time: 0.251289 Oct 04 22:12:07.681357 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2669/5276] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 22:12:07 2022] DELETE /compute/v2.1/servers/62b87810-2125-4803-bd20-74c16a76ef81 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 22:12:07.690694 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-3d578f10-b301-46ac-a68e-fabcc7694710 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5b039225-c5ac-4b69-833f-6c36865ddf95"}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:12:07.695218 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-3d578f10-b301-46ac-a68e-fabcc7694710 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] [instance: 696c547f-7cea-497f-9871-dd26f3fb6cfc] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:12:07.696639 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-651bf5d7-3ab6-4020-99e1-38da86d0de5f tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ec7439438f46caa7a08170089338b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7339865eaa564b7d9b145fb58acc60f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:12:07.707612 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3d578f10-b301-46ac-a68e-fabcc7694710 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:07.709295 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3d578f10-b301-46ac-a68e-fabcc7694710 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:07.709758 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3d578f10-b301-46ac-a68e-fabcc7694710 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:07.710508 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3d578f10-b301-46ac-a68e-fabcc7694710 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:07.710965 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3d578f10-b301-46ac-a68e-fabcc7694710 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:07.711680 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3d578f10-b301-46ac-a68e-fabcc7694710 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:07.715503 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-651bf5d7-3ab6-4020-99e1-38da86d0de5f tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] 10.222.0.43 "GET /compute/v2.1/servers/3086c8a4-4db9-459b-8fdb-1a27c1c42d75" status: 200 len: 1503 microversion: 2.1 time: 0.415460 Oct 04 22:12:07.717647 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2608/5277] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:12:07 2022] GET /compute/v2.1/servers/3086c8a4-4db9-459b-8fdb-1a27c1c42d75 => generated 1503 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:12:07.730411 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-556025b3-c2c8-4199-9755-b7bc477b3155 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:12:07.733226 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-556025b3-c2c8-4199-9755-b7bc477b3155 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 48243e1b-892b-4c4b-8db1-242b2e40653b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:12:07.750142 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-556025b3-c2c8-4199-9755-b7bc477b3155 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:07.750958 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-556025b3-c2c8-4199-9755-b7bc477b3155 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:07.751578 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-556025b3-c2c8-4199-9755-b7bc477b3155 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:07.752472 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-556025b3-c2c8-4199-9755-b7bc477b3155 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:07.753135 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-556025b3-c2c8-4199-9755-b7bc477b3155 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:07.753864 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-556025b3-c2c8-4199-9755-b7bc477b3155 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:07.893184 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-556025b3-c2c8-4199-9755-b7bc477b3155 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "POST /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b/action" status: 202 len: 0 microversion: 2.1 time: 0.174002 Oct 04 22:12:07.910858 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2609/5278] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 22:12:07 2022] POST /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b/action => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 22:12:07.926160 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-19559194-b2c6-4344-b259-aef8f0485deb tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:12:07.928117 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-19559194-b2c6-4344-b259-aef8f0485deb tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: 62b87810-2125-4803-bd20-74c16a76ef81] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:12:07.941359 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-19559194-b2c6-4344-b259-aef8f0485deb tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:07.942130 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-19559194-b2c6-4344-b259-aef8f0485deb tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:07.942625 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-19559194-b2c6-4344-b259-aef8f0485deb tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:07.943463 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-19559194-b2c6-4344-b259-aef8f0485deb tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:07.947835 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-19559194-b2c6-4344-b259-aef8f0485deb tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:07.948721 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-19559194-b2c6-4344-b259-aef8f0485deb tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:08.234620 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-3d578f10-b301-46ac-a68e-fabcc7694710 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] 10.222.0.43 "POST /compute/v2.1/servers/696c547f-7cea-497f-9871-dd26f3fb6cfc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.551535 Oct 04 22:12:08.237396 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2670/5279] 10.222.0.43 () {60 vars in 1323 bytes} [Tue Oct 4 22:12:07 2022] POST /compute/v2.1/servers/696c547f-7cea-497f-9871-dd26f3fb6cfc/os-volume_attachments => generated 194 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:12:08.261304 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-19559194-b2c6-4344-b259-aef8f0485deb tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1682f1a60045d8a04d4d67393cd13f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b00cd9fa8e40a0919b61fcd60269f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:12:08.269931 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-803cf72b-db09-4637-832d-01afa100e552 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:12:08.271097 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-803cf72b-db09-4637-832d-01afa100e552 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 48243e1b-892b-4c4b-8db1-242b2e40653b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:12:08.275010 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-19559194-b2c6-4344-b259-aef8f0485deb tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "GET /compute/v2.1/servers/62b87810-2125-4803-bd20-74c16a76ef81" status: 200 len: 1479 microversion: 2.1 time: 0.364352 Oct 04 22:12:08.276054 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2610/5280] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:12:07 2022] GET /compute/v2.1/servers/62b87810-2125-4803-bd20-74c16a76ef81 => generated 1479 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:12:08.308823 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-803cf72b-db09-4637-832d-01afa100e552 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:08.313225 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-803cf72b-db09-4637-832d-01afa100e552 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:08.314868 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-803cf72b-db09-4637-832d-01afa100e552 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:08.318717 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-803cf72b-db09-4637-832d-01afa100e552 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:08.321257 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-803cf72b-db09-4637-832d-01afa100e552 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:08.322584 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-803cf72b-db09-4637-832d-01afa100e552 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:08.710546 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-803cf72b-db09-4637-832d-01afa100e552 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:12:08.723776 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-803cf72b-db09-4637-832d-01afa100e552 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b" status: 200 len: 1671 microversion: 2.1 time: 0.484783 Oct 04 22:12:08.724425 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2671/5281] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:12:08 2022] GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b => generated 1671 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:12:08.743762 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-9de99c4f-dacc-4e25-b38c-07a7142ac049 tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:12:08.744383 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-9de99c4f-dacc-4e25-b38c-07a7142ac049 tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] [instance: 3086c8a4-4db9-459b-8fdb-1a27c1c42d75] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:12:08.755468 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9de99c4f-dacc-4e25-b38c-07a7142ac049 tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:08.759388 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9de99c4f-dacc-4e25-b38c-07a7142ac049 tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:08.760047 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9de99c4f-dacc-4e25-b38c-07a7142ac049 tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:08.762471 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9de99c4f-dacc-4e25-b38c-07a7142ac049 tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:08.763418 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9de99c4f-dacc-4e25-b38c-07a7142ac049 tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:08.764271 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9de99c4f-dacc-4e25-b38c-07a7142ac049 tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:09.262974 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-9de99c4f-dacc-4e25-b38c-07a7142ac049 tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ec7439438f46caa7a08170089338b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7339865eaa564b7d9b145fb58acc60f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:12:09.279835 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-9de99c4f-dacc-4e25-b38c-07a7142ac049 tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] 10.222.0.43 "GET /compute/v2.1/servers/3086c8a4-4db9-459b-8fdb-1a27c1c42d75" status: 200 len: 1503 microversion: 2.1 time: 0.538807 Oct 04 22:12:09.281515 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2611/5282] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:12:08 2022] GET /compute/v2.1/servers/3086c8a4-4db9-459b-8fdb-1a27c1c42d75 => generated 1503 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:12:09.301008 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-c83ed6a8-e740-42b5-ab2b-2b2fcdf26169 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:12:09.301624 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-c83ed6a8-e740-42b5-ab2b-2b2fcdf26169 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: 62b87810-2125-4803-bd20-74c16a76ef81] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:12:09.311961 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c83ed6a8-e740-42b5-ab2b-2b2fcdf26169 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:09.312466 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c83ed6a8-e740-42b5-ab2b-2b2fcdf26169 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:09.312955 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c83ed6a8-e740-42b5-ab2b-2b2fcdf26169 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:09.313633 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c83ed6a8-e740-42b5-ab2b-2b2fcdf26169 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:09.314091 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c83ed6a8-e740-42b5-ab2b-2b2fcdf26169 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:09.331274 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c83ed6a8-e740-42b5-ab2b-2b2fcdf26169 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:09.700881 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-c83ed6a8-e740-42b5-ab2b-2b2fcdf26169 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1682f1a60045d8a04d4d67393cd13f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b00cd9fa8e40a0919b61fcd60269f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:12:09.714713 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-c83ed6a8-e740-42b5-ab2b-2b2fcdf26169 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "GET /compute/v2.1/servers/62b87810-2125-4803-bd20-74c16a76ef81" status: 200 len: 1479 microversion: 2.1 time: 0.417920 Oct 04 22:12:09.717037 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2672/5283] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:12:09 2022] GET /compute/v2.1/servers/62b87810-2125-4803-bd20-74c16a76ef81 => generated 1479 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:12:09.752570 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-67d5f870-f108-471e-b89c-72e3ed284ce0 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:12:09.753194 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-67d5f870-f108-471e-b89c-72e3ed284ce0 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 48243e1b-892b-4c4b-8db1-242b2e40653b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:12:09.762211 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-67d5f870-f108-471e-b89c-72e3ed284ce0 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:09.763436 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-67d5f870-f108-471e-b89c-72e3ed284ce0 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:09.763879 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-67d5f870-f108-471e-b89c-72e3ed284ce0 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:09.765670 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-67d5f870-f108-471e-b89c-72e3ed284ce0 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:09.767528 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-67d5f870-f108-471e-b89c-72e3ed284ce0 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:09.768185 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-67d5f870-f108-471e-b89c-72e3ed284ce0 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:10.016446 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-67d5f870-f108-471e-b89c-72e3ed284ce0 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:12:10.026305 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-67d5f870-f108-471e-b89c-72e3ed284ce0 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b" status: 200 len: 1676 microversion: 2.1 time: 0.279449 Oct 04 22:12:10.042249 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2612/5284] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:12:09 2022] GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b => generated 1676 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:12:10.306248 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-f6b697b1-5d99-49bb-a0c9-a70d6083c77c tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:12:10.306903 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-f6b697b1-5d99-49bb-a0c9-a70d6083c77c tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] [instance: 3086c8a4-4db9-459b-8fdb-1a27c1c42d75] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:12:10.321210 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f6b697b1-5d99-49bb-a0c9-a70d6083c77c tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:10.321717 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f6b697b1-5d99-49bb-a0c9-a70d6083c77c tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:10.328315 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f6b697b1-5d99-49bb-a0c9-a70d6083c77c tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:10.330436 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f6b697b1-5d99-49bb-a0c9-a70d6083c77c tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:10.332402 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f6b697b1-5d99-49bb-a0c9-a70d6083c77c tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:10.333982 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f6b697b1-5d99-49bb-a0c9-a70d6083c77c tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:10.567341 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-f6b697b1-5d99-49bb-a0c9-a70d6083c77c tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ec7439438f46caa7a08170089338b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7339865eaa564b7d9b145fb58acc60f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:12:10.578439 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-f6b697b1-5d99-49bb-a0c9-a70d6083c77c tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] 10.222.0.43 "GET /compute/v2.1/servers/3086c8a4-4db9-459b-8fdb-1a27c1c42d75" status: 200 len: 1503 microversion: 2.1 time: 0.276831 Oct 04 22:12:10.579880 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2673/5285] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:12:10 2022] GET /compute/v2.1/servers/3086c8a4-4db9-459b-8fdb-1a27c1c42d75 => generated 1503 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:12:10.741764 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-6e2d097e-715b-407c-84c7-e0930ce442ad tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:12:10.742808 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-6e2d097e-715b-407c-84c7-e0930ce442ad tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: 62b87810-2125-4803-bd20-74c16a76ef81] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:12:10.751374 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6e2d097e-715b-407c-84c7-e0930ce442ad tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:10.752125 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6e2d097e-715b-407c-84c7-e0930ce442ad tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:10.752672 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6e2d097e-715b-407c-84c7-e0930ce442ad tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:10.753717 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6e2d097e-715b-407c-84c7-e0930ce442ad tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:10.754214 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6e2d097e-715b-407c-84c7-e0930ce442ad tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:10.754723 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6e2d097e-715b-407c-84c7-e0930ce442ad tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:11.053103 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-c65d0189-460a-4166-bd0c-a73a736c2fba tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:12:11.054667 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-c65d0189-460a-4166-bd0c-a73a736c2fba tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 48243e1b-892b-4c4b-8db1-242b2e40653b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:12:11.063285 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c65d0189-460a-4166-bd0c-a73a736c2fba tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:11.068152 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c65d0189-460a-4166-bd0c-a73a736c2fba tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:11.068922 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c65d0189-460a-4166-bd0c-a73a736c2fba tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:11.070146 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c65d0189-460a-4166-bd0c-a73a736c2fba tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:11.070852 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c65d0189-460a-4166-bd0c-a73a736c2fba tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:11.071470 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c65d0189-460a-4166-bd0c-a73a736c2fba tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:11.405764 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-6e2d097e-715b-407c-84c7-e0930ce442ad tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1682f1a60045d8a04d4d67393cd13f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b00cd9fa8e40a0919b61fcd60269f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:12:11.416191 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-6e2d097e-715b-407c-84c7-e0930ce442ad tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "GET /compute/v2.1/servers/62b87810-2125-4803-bd20-74c16a76ef81" status: 200 len: 1479 microversion: 2.1 time: 0.678781 Oct 04 22:12:11.421504 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2613/5286] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:12:10 2022] GET /compute/v2.1/servers/62b87810-2125-4803-bd20-74c16a76ef81 => generated 1479 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:12:11.505126 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-c65d0189-460a-4166-bd0c-a73a736c2fba tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:12:11.516780 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-c65d0189-460a-4166-bd0c-a73a736c2fba tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b" status: 200 len: 1669 microversion: 2.1 time: 0.467996 Oct 04 22:12:11.517656 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2674/5287] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:12:11 2022] GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b => generated 1669 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:12:11.605614 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-7e4ad4e7-f8ac-4113-85a4-65a5feb62e3d tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:12:11.607085 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-7e4ad4e7-f8ac-4113-85a4-65a5feb62e3d tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] [instance: 3086c8a4-4db9-459b-8fdb-1a27c1c42d75] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:12:11.614918 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7e4ad4e7-f8ac-4113-85a4-65a5feb62e3d tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:11.615748 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7e4ad4e7-f8ac-4113-85a4-65a5feb62e3d tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:11.631729 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7e4ad4e7-f8ac-4113-85a4-65a5feb62e3d tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:11.632770 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7e4ad4e7-f8ac-4113-85a4-65a5feb62e3d tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:11.633433 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7e4ad4e7-f8ac-4113-85a4-65a5feb62e3d tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:11.633966 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7e4ad4e7-f8ac-4113-85a4-65a5feb62e3d tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:11.810603 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-7e4ad4e7-f8ac-4113-85a4-65a5feb62e3d tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ec7439438f46caa7a08170089338b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7339865eaa564b7d9b145fb58acc60f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:12:11.821341 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-7e4ad4e7-f8ac-4113-85a4-65a5feb62e3d tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] 10.222.0.43 "GET /compute/v2.1/servers/3086c8a4-4db9-459b-8fdb-1a27c1c42d75" status: 200 len: 1503 microversion: 2.1 time: 0.219489 Oct 04 22:12:11.823204 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2614/5288] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:12:11 2022] GET /compute/v2.1/servers/3086c8a4-4db9-459b-8fdb-1a27c1c42d75 => generated 1503 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:12:12.225763 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-0fd3a5bc-403b-4da0-ae7d-b12025882e54 req-bdbacaeb-8792-4dfa-be7f-8fa703874c6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3086c8a4-4db9-459b-8fdb-1a27c1c42d75", "name": "network-vif-deleted", "tag": "deb2dae3-a943-45ba-b9df-48c49e206091"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:12:12.249306 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-0fd3a5bc-403b-4da0-ae7d-b12025882e54 req-bdbacaeb-8792-4dfa-be7f-8fa703874c6f service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:12.266128 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-0fd3a5bc-403b-4da0-ae7d-b12025882e54 req-bdbacaeb-8792-4dfa-be7f-8fa703874c6f service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:12.267398 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-0fd3a5bc-403b-4da0-ae7d-b12025882e54 req-bdbacaeb-8792-4dfa-be7f-8fa703874c6f service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:12.290100 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-0fd3a5bc-403b-4da0-ae7d-b12025882e54 req-bdbacaeb-8792-4dfa-be7f-8fa703874c6f service nova] Creating event network-vif-deleted:deb2dae3-a943-45ba-b9df-48c49e206091 for instance 3086c8a4-4db9-459b-8fdb-1a27c1c42d75 on n-h2-860284-1 Oct 04 22:12:12.308551 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-0fd3a5bc-403b-4da0-ae7d-b12025882e54 req-bdbacaeb-8792-4dfa-be7f-8fa703874c6f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083691 Oct 04 22:12:12.309650 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2675/5289] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:12:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:12:12.445242 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-4483a155-6aed-4ae0-921b-2324389d8c82 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:12:12.445864 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-4483a155-6aed-4ae0-921b-2324389d8c82 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: 62b87810-2125-4803-bd20-74c16a76ef81] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:12:12.452373 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4483a155-6aed-4ae0-921b-2324389d8c82 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:12.452873 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4483a155-6aed-4ae0-921b-2324389d8c82 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:12.453315 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4483a155-6aed-4ae0-921b-2324389d8c82 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:12.454025 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4483a155-6aed-4ae0-921b-2324389d8c82 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:12.454524 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4483a155-6aed-4ae0-921b-2324389d8c82 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:12.455123 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4483a155-6aed-4ae0-921b-2324389d8c82 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:12.530641 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4483a155-6aed-4ae0-921b-2324389d8c82 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:12.531343 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4483a155-6aed-4ae0-921b-2324389d8c82 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:12.531944 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4483a155-6aed-4ae0-921b-2324389d8c82 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:12.532584 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.objects.instance [None req-4483a155-6aed-4ae0-921b-2324389d8c82 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lazy-loading 'fault' on Instance uuid 62b87810-2125-4803-bd20-74c16a76ef81 {{(pid=134101) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 22:12:12.597555 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-4483a155-6aed-4ae0-921b-2324389d8c82 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1682f1a60045d8a04d4d67393cd13f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b00cd9fa8e40a0919b61fcd60269f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:12:12.613484 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-4483a155-6aed-4ae0-921b-2324389d8c82 tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "GET /compute/v2.1/servers/62b87810-2125-4803-bd20-74c16a76ef81" status: 200 len: 1282 microversion: 2.1 time: 0.172083 Oct 04 22:12:12.626210 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2615/5290] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:12:12 2022] GET /compute/v2.1/servers/62b87810-2125-4803-bd20-74c16a76ef81 => generated 1282 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:12:12.849314 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-078319b5-a73c-4cfa-9f4e-7af59a97be16 tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:12:12.850081 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-078319b5-a73c-4cfa-9f4e-7af59a97be16 tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] [instance: 3086c8a4-4db9-459b-8fdb-1a27c1c42d75] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:12:12.877761 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-078319b5-a73c-4cfa-9f4e-7af59a97be16 tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:12.878661 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-078319b5-a73c-4cfa-9f4e-7af59a97be16 tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:12.879307 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-078319b5-a73c-4cfa-9f4e-7af59a97be16 tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:12.880219 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-078319b5-a73c-4cfa-9f4e-7af59a97be16 tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:12.880830 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-078319b5-a73c-4cfa-9f4e-7af59a97be16 tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:12.881955 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-078319b5-a73c-4cfa-9f4e-7af59a97be16 tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:12.952302 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-078319b5-a73c-4cfa-9f4e-7af59a97be16 tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:12.953015 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-078319b5-a73c-4cfa-9f4e-7af59a97be16 tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:12.953615 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-078319b5-a73c-4cfa-9f4e-7af59a97be16 tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:12.955502 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.objects.instance [None req-078319b5-a73c-4cfa-9f4e-7af59a97be16 tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] Lazy-loading 'fault' on Instance uuid 3086c8a4-4db9-459b-8fdb-1a27c1c42d75 {{(pid=134102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 22:12:13.032009 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-078319b5-a73c-4cfa-9f4e-7af59a97be16 tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ec7439438f46caa7a08170089338b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7339865eaa564b7d9b145fb58acc60f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:12:13.040994 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-078319b5-a73c-4cfa-9f4e-7af59a97be16 tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] 10.222.0.43 "GET /compute/v2.1/servers/3086c8a4-4db9-459b-8fdb-1a27c1c42d75" status: 200 len: 1303 microversion: 2.1 time: 0.197704 Oct 04 22:12:13.041599 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2676/5291] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:12:12 2022] GET /compute/v2.1/servers/3086c8a4-4db9-459b-8fdb-1a27c1c42d75 => generated 1303 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:12:13.640111 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-5382d378-d187-42a3-b0be-5bb419a4187d tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:12:13.640728 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-5382d378-d187-42a3-b0be-5bb419a4187d tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] [instance: 62b87810-2125-4803-bd20-74c16a76ef81] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:12:13.657702 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5382d378-d187-42a3-b0be-5bb419a4187d tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:13.658456 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5382d378-d187-42a3-b0be-5bb419a4187d tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:13.659080 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5382d378-d187-42a3-b0be-5bb419a4187d tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:13.659962 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5382d378-d187-42a3-b0be-5bb419a4187d tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:13.660563 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5382d378-d187-42a3-b0be-5bb419a4187d tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:13.661142 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5382d378-d187-42a3-b0be-5bb419a4187d tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:13.688428 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-5382d378-d187-42a3-b0be-5bb419a4187d tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] HTTP exception thrown: Instance 62b87810-2125-4803-bd20-74c16a76ef81 could not be found. Oct 04 22:12:13.700937 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-5382d378-d187-42a3-b0be-5bb419a4187d tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Request method failure captured: Oct 04 22:12:13.700937 n-d-860284-1 devstack@n-api.service[134101]: request: GET /compute/v2.1/servers/62b87810-2125-4803-bd20-74c16a76ef81 HTTP/1.1 Oct 04 22:12:13.700937 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 22:12:13.700937 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 22:12:13.700937 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 22:12:13.700937 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 22:12:13.700937 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 22:12:13.700937 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 22:12:13.700937 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 22:12:13.700937 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 22:12:13.700937 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPK7MP0-m-xtUnxXwLoxlIfO4jzoQOT6GMi-_9Rz-dG646c6MuQMOjiOhGtcOohb2ZIUdejR42Va0IkiFMBDtdnbnUEdF8Psxz0uHfYGBQiEZpqo4CpOHPpz5KjUxS1LmPgcFnegJZtGQu1irxi49GMeHkm9nnXbxd63druWj1zFChJ4 Oct 04 22:12:13.700937 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 22:12:13.700937 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 22:12:13.700937 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 22:12:13.700937 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 22:12:13.700937 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 22:12:13.700937 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 22:12:13.700937 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: d4b00cd9fa8e40a0919b61fcd60269f5 Oct 04 22:12:13.700937 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-ServersTestJSON-1600369848 Oct 04 22:12:13.700937 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 22:12:13.700937 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 22:12:13.700937 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d4b00cd9fa8e40a0919b61fcd60269f5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_d4b00cd9fa8e40a0919b61fcd60269f5", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d4b00cd9fa8e40a0919b61fcd60269f5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/d4b00cd9fa8e40a0919b61fcd60269f5"}]}] Oct 04 22:12:13.700937 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-ServersTestJSON-1600369848 Oct 04 22:12:13.700937 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: d4b00cd9fa8e40a0919b61fcd60269f5 Oct 04 22:12:13.700937 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-ServersTestJSON-1600369848 Oct 04 22:12:13.700937 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-ServersTestJSON-1600369848-project Oct 04 22:12:13.700937 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 22:12:13.700937 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 22:12:13.700937 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 9c1682f1a60045d8a04d4d67393cd13f Oct 04 22:12:13.700937 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-ServersTestJSON-1600369848-project Oct 04 22:12:13.700937 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 22:12:13.700937 n-d-860284-1 devstack@n-api.service[134101]: exception: Instance 62b87810-2125-4803-bd20-74c16a76ef81 could not be found. Oct 04 22:12:13.700937 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': '62b87810-2125-4803-bd20-74c16a76ef81'} Oct 04 22:12:13.700937 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:12:13.700937 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:12:13.700937 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:12:13.700937 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:12:13.700937 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:12:13.700937 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:12:13.700937 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:12:13.700937 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:12:13.700937 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:12:13.700937 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:12:13.700937 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62b87810-2125-4803-bd20-74c16a76ef81 could not be found. Oct 04 22:12:13.700937 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:12:13.700937 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:12:13.700937 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:12:13.700937 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:12:13.700937 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:12:13.700937 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:12:13.700937 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:12:13.700937 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:12:13.700937 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:12:13.700937 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:12:13.700937 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:12:13.700937 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:12:13.700937 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:12:13.700937 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:12:13.700937 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:12:13.700937 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:12:13.700937 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62b87810-2125-4803-bd20-74c16a76ef81 could not be found. Oct 04 22:12:13.700937 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:12:13.700937 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:12:13.700937 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:12:13.704996 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:12:13.704996 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:12:13.704996 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:12:13.704996 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:12:13.704996 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:12:13.704996 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62b87810-2125-4803-bd20-74c16a76ef81 could not be found. Oct 04 22:12:13.704996 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:12:13.704996 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-5382d378-d187-42a3-b0be-5bb419a4187d tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] Returning 404 to user: Instance 62b87810-2125-4803-bd20-74c16a76ef81 could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:12:13.704996 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-5382d378-d187-42a3-b0be-5bb419a4187d tempest-ServersTestJSON-1600369848 tempest-ServersTestJSON-1600369848-project] 10.222.0.43 "GET /compute/v2.1/servers/62b87810-2125-4803-bd20-74c16a76ef81" status: 404 len: 111 microversion: 2.1 time: 0.066988 Oct 04 22:12:13.706718 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2616/5292] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:12:13 2022] GET /compute/v2.1/servers/62b87810-2125-4803-bd20-74c16a76ef81 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:12:14.066405 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-90d9981e-9051-42a0-b7a3-d6293df76042 tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:12:14.067615 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-90d9981e-9051-42a0-b7a3-d6293df76042 tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] [instance: 3086c8a4-4db9-459b-8fdb-1a27c1c42d75] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:12:14.082522 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-90d9981e-9051-42a0-b7a3-d6293df76042 tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:14.083177 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-90d9981e-9051-42a0-b7a3-d6293df76042 tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:14.083871 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-90d9981e-9051-42a0-b7a3-d6293df76042 tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:14.084749 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-90d9981e-9051-42a0-b7a3-d6293df76042 tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:14.085269 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-90d9981e-9051-42a0-b7a3-d6293df76042 tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:14.085766 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-90d9981e-9051-42a0-b7a3-d6293df76042 tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:14.101138 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:12:14.132021 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-90d9981e-9051-42a0-b7a3-d6293df76042 tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] HTTP exception thrown: Instance 3086c8a4-4db9-459b-8fdb-1a27c1c42d75 could not be found. Oct 04 22:12:14.136321 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-90d9981e-9051-42a0-b7a3-d6293df76042 tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] Request method failure captured: Oct 04 22:12:14.136321 n-d-860284-1 devstack@n-api.service[134102]: request: GET /compute/v2.1/servers/3086c8a4-4db9-459b-8fdb-1a27c1c42d75 HTTP/1.1 Oct 04 22:12:14.136321 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 22:12:14.136321 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 22:12:14.136321 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 22:12:14.136321 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 22:12:14.136321 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 22:12:14.136321 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 22:12:14.136321 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 22:12:14.136321 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 22:12:14.136321 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPK-i5_x_aIizoAD22IGz7BSooulFY62Q2Bjo4gl_hd1VTOaBqRkWtfptEovR-iLEGDMTRi14tj5GJExwfu7rvWYzPoKLaQHb0bUpj9XrmUZBltSYidRzmmJPrNJmwRB84TqBqVKbTv3lt0xS6n3673Qa06cc5K_cBNXni7Q6BvEgxAY Oct 04 22:12:14.136321 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 22:12:14.136321 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 22:12:14.136321 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 22:12:14.136321 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 22:12:14.136321 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 22:12:14.136321 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 22:12:14.136321 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: 7339865eaa564b7d9b145fb58acc60f9 Oct 04 22:12:14.136321 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-VolumesActionsTest-430903653 Oct 04 22:12:14.136321 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 22:12:14.136321 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 22:12:14.136321 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/7339865eaa564b7d9b145fb58acc60f9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_7339865eaa564b7d9b145fb58acc60f9", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/7339865eaa564b7d9b145fb58acc60f9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/7339865eaa564b7d9b145fb58acc60f9"}]}] Oct 04 22:12:14.136321 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-VolumesActionsTest-430903653 Oct 04 22:12:14.136321 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: 7339865eaa564b7d9b145fb58acc60f9 Oct 04 22:12:14.136321 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-VolumesActionsTest-430903653 Oct 04 22:12:14.136321 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-VolumesActionsTest-430903653-project Oct 04 22:12:14.136321 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 22:12:14.136321 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 22:12:14.136321 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: e1ec7439438f46caa7a08170089338b7 Oct 04 22:12:14.136321 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-VolumesActionsTest-430903653-project Oct 04 22:12:14.136321 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 22:12:14.136321 n-d-860284-1 devstack@n-api.service[134102]: exception: Instance 3086c8a4-4db9-459b-8fdb-1a27c1c42d75 could not be found. Oct 04 22:12:14.136321 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': '3086c8a4-4db9-459b-8fdb-1a27c1c42d75'} Oct 04 22:12:14.136321 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:12:14.136321 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:12:14.136321 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:12:14.136321 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:12:14.136321 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:12:14.136321 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:12:14.136321 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:12:14.136321 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:12:14.136321 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:12:14.136321 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:12:14.136321 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3086c8a4-4db9-459b-8fdb-1a27c1c42d75 could not be found. Oct 04 22:12:14.136321 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:12:14.136321 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:12:14.136321 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:12:14.136321 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:12:14.136321 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:12:14.136321 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:12:14.136321 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:12:14.136321 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:12:14.136321 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:12:14.136321 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:12:14.136321 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:12:14.136321 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:12:14.136321 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:12:14.136321 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:12:14.136321 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:12:14.136321 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:12:14.136321 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3086c8a4-4db9-459b-8fdb-1a27c1c42d75 could not be found. Oct 04 22:12:14.136321 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:12:14.136321 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:12:14.136321 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:12:14.140943 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:12:14.140943 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:12:14.140943 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:12:14.140943 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:12:14.140943 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:12:14.140943 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3086c8a4-4db9-459b-8fdb-1a27c1c42d75 could not be found. Oct 04 22:12:14.140943 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:12:14.140943 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-90d9981e-9051-42a0-b7a3-d6293df76042 tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] Returning 404 to user: Instance 3086c8a4-4db9-459b-8fdb-1a27c1c42d75 could not be found. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:12:14.143870 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-90d9981e-9051-42a0-b7a3-d6293df76042 tempest-VolumesActionsTest-430903653 tempest-VolumesActionsTest-430903653-project] 10.222.0.43 "GET /compute/v2.1/servers/3086c8a4-4db9-459b-8fdb-1a27c1c42d75" status: 404 len: 111 microversion: 2.1 time: 0.075654 Oct 04 22:12:14.145271 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2677/5293] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:12:14 2022] GET /compute/v2.1/servers/3086c8a4-4db9-459b-8fdb-1a27c1c42d75 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:12:14.404573 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-1f3ef1c6-e027-4568-a77b-d57e770d6131 req-151d68df-9c95-4daf-8fb2-4f588d172d91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62b87810-2125-4803-bd20-74c16a76ef81", "name": "network-vif-deleted", "tag": "1d119cd0-6059-4b2c-afea-42a85a4a3b03"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:12:14.423864 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-1f3ef1c6-e027-4568-a77b-d57e770d6131 req-151d68df-9c95-4daf-8fb2-4f588d172d91 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:14.428832 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-1f3ef1c6-e027-4568-a77b-d57e770d6131 req-151d68df-9c95-4daf-8fb2-4f588d172d91 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:14.429307 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-1f3ef1c6-e027-4568-a77b-d57e770d6131 req-151d68df-9c95-4daf-8fb2-4f588d172d91 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:14.459746 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-1f3ef1c6-e027-4568-a77b-d57e770d6131 req-151d68df-9c95-4daf-8fb2-4f588d172d91 service nova] Creating event network-vif-deleted:1d119cd0-6059-4b2c-afea-42a85a4a3b03 for instance 62b87810-2125-4803-bd20-74c16a76ef81 on n-h2-860284-1 Oct 04 22:12:14.475356 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-1f3ef1c6-e027-4568-a77b-d57e770d6131 req-151d68df-9c95-4daf-8fb2-4f588d172d91 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074928 Oct 04 22:12:14.476662 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2617/5294] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:12:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:12:22.188198 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-ebabbdf1-b151-48f9-a1bd-29a8064b5562 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:12:22.192557 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-ebabbdf1-b151-48f9-a1bd-29a8064b5562 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] [instance: 696c547f-7cea-497f-9871-dd26f3fb6cfc] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:12:22.216961 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ebabbdf1-b151-48f9-a1bd-29a8064b5562 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:22.217941 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ebabbdf1-b151-48f9-a1bd-29a8064b5562 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:22.218884 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ebabbdf1-b151-48f9-a1bd-29a8064b5562 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:22.226254 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ebabbdf1-b151-48f9-a1bd-29a8064b5562 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:22.227212 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ebabbdf1-b151-48f9-a1bd-29a8064b5562 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:22.230210 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ebabbdf1-b151-48f9-a1bd-29a8064b5562 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:22.382733 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.objects.instance [None req-ebabbdf1-b151-48f9-a1bd-29a8064b5562 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lazy-loading 'services' on Instance uuid 696c547f-7cea-497f-9871-dd26f3fb6cfc {{(pid=134102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 22:12:22.478515 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-ebabbdf1-b151-48f9-a1bd-29a8064b5562 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] 10.222.0.43 "DELETE /compute/v2.1/servers/696c547f-7cea-497f-9871-dd26f3fb6cfc/os-volume_attachments/5b039225-c5ac-4b69-833f-6c36865ddf95" status: 202 len: 0 microversion: 2.1 time: 0.308957 Oct 04 22:12:22.479538 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2678/5295] 10.222.0.43 () {58 vars in 1416 bytes} [Tue Oct 4 22:12:22 2022] DELETE /compute/v2.1/servers/696c547f-7cea-497f-9871-dd26f3fb6cfc/os-volume_attachments/5b039225-c5ac-4b69-833f-6c36865ddf95 => generated 0 bytes in 311 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 22:12:22.500243 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-fa0d2409-9c92-4ae3-b90d-89750d12928b tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:12:22.502958 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-fa0d2409-9c92-4ae3-b90d-89750d12928b tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] [instance: 696c547f-7cea-497f-9871-dd26f3fb6cfc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:12:22.513895 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fa0d2409-9c92-4ae3-b90d-89750d12928b tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:22.516281 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fa0d2409-9c92-4ae3-b90d-89750d12928b tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:22.527270 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fa0d2409-9c92-4ae3-b90d-89750d12928b tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:22.532735 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fa0d2409-9c92-4ae3-b90d-89750d12928b tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:22.533611 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fa0d2409-9c92-4ae3-b90d-89750d12928b tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:22.534136 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fa0d2409-9c92-4ae3-b90d-89750d12928b tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:22.580882 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-fa0d2409-9c92-4ae3-b90d-89750d12928b tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] 10.222.0.43 "GET /compute/v2.1/servers/696c547f-7cea-497f-9871-dd26f3fb6cfc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.096865 Oct 04 22:12:22.582066 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2618/5296] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 22:12:22 2022] GET /compute/v2.1/servers/696c547f-7cea-497f-9871-dd26f3fb6cfc/os-volume_attachments => generated 197 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:12:23.600581 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-43599e13-e265-4d63-9942-d5975e4ed5e7 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:12:23.604808 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-43599e13-e265-4d63-9942-d5975e4ed5e7 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] [instance: 696c547f-7cea-497f-9871-dd26f3fb6cfc] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:12:23.619336 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-43599e13-e265-4d63-9942-d5975e4ed5e7 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:23.620778 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-43599e13-e265-4d63-9942-d5975e4ed5e7 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:23.621482 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-43599e13-e265-4d63-9942-d5975e4ed5e7 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:23.623970 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-43599e13-e265-4d63-9942-d5975e4ed5e7 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:23.625328 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-43599e13-e265-4d63-9942-d5975e4ed5e7 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:23.626195 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-43599e13-e265-4d63-9942-d5975e4ed5e7 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:23.676151 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-43599e13-e265-4d63-9942-d5975e4ed5e7 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] 10.222.0.43 "GET /compute/v2.1/servers/696c547f-7cea-497f-9871-dd26f3fb6cfc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.086281 Oct 04 22:12:23.677222 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2679/5297] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 22:12:23 2022] GET /compute/v2.1/servers/696c547f-7cea-497f-9871-dd26f3fb6cfc/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:12:24.690442 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-75941a4c-f9cf-4e9e-9da0-012ed29478e2 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:12:24.692628 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-75941a4c-f9cf-4e9e-9da0-012ed29478e2 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] [instance: 696c547f-7cea-497f-9871-dd26f3fb6cfc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:12:24.711904 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-75941a4c-f9cf-4e9e-9da0-012ed29478e2 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:24.713388 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-75941a4c-f9cf-4e9e-9da0-012ed29478e2 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:24.713926 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-75941a4c-f9cf-4e9e-9da0-012ed29478e2 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:24.717317 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-75941a4c-f9cf-4e9e-9da0-012ed29478e2 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:24.718228 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-75941a4c-f9cf-4e9e-9da0-012ed29478e2 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:24.719014 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-75941a4c-f9cf-4e9e-9da0-012ed29478e2 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:24.800766 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-75941a4c-f9cf-4e9e-9da0-012ed29478e2 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] 10.222.0.43 "GET /compute/v2.1/servers/696c547f-7cea-497f-9871-dd26f3fb6cfc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.115035 Oct 04 22:12:24.801990 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2619/5298] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 22:12:24 2022] GET /compute/v2.1/servers/696c547f-7cea-497f-9871-dd26f3fb6cfc/os-volume_attachments => generated 197 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:12:25.815213 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-8674e95f-3e8c-490d-9db2-cbb24c284b12 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:12:25.818325 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-8674e95f-3e8c-490d-9db2-cbb24c284b12 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] [instance: 696c547f-7cea-497f-9871-dd26f3fb6cfc] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:12:25.832110 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8674e95f-3e8c-490d-9db2-cbb24c284b12 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:25.833609 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8674e95f-3e8c-490d-9db2-cbb24c284b12 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:25.836486 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8674e95f-3e8c-490d-9db2-cbb24c284b12 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:25.839273 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8674e95f-3e8c-490d-9db2-cbb24c284b12 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:25.840275 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8674e95f-3e8c-490d-9db2-cbb24c284b12 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:25.841976 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8674e95f-3e8c-490d-9db2-cbb24c284b12 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:25.946327 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-8674e95f-3e8c-490d-9db2-cbb24c284b12 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] 10.222.0.43 "GET /compute/v2.1/servers/696c547f-7cea-497f-9871-dd26f3fb6cfc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.136792 Oct 04 22:12:25.949690 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2680/5299] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 22:12:25 2022] GET /compute/v2.1/servers/696c547f-7cea-497f-9871-dd26f3fb6cfc/os-volume_attachments => generated 197 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:12:26.973347 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-eed25ae4-cf53-42ce-927c-daed4e14a18c tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:12:26.980765 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-eed25ae4-cf53-42ce-927c-daed4e14a18c tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] [instance: 696c547f-7cea-497f-9871-dd26f3fb6cfc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:12:26.998089 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=2 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:12:27.002212 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-eed25ae4-cf53-42ce-927c-daed4e14a18c tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:27.003065 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-eed25ae4-cf53-42ce-927c-daed4e14a18c tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:27.006835 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-eed25ae4-cf53-42ce-927c-daed4e14a18c tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:27.007780 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-eed25ae4-cf53-42ce-927c-daed4e14a18c tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:27.008445 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-eed25ae4-cf53-42ce-927c-daed4e14a18c tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:27.009630 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-eed25ae4-cf53-42ce-927c-daed4e14a18c tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:27.108578 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-eed25ae4-cf53-42ce-927c-daed4e14a18c tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] 10.222.0.43 "GET /compute/v2.1/servers/696c547f-7cea-497f-9871-dd26f3fb6cfc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.145848 Oct 04 22:12:27.127076 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2620/5300] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 22:12:26 2022] GET /compute/v2.1/servers/696c547f-7cea-497f-9871-dd26f3fb6cfc/os-volume_attachments => generated 197 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:12:28.142084 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-9504c6bf-6f1f-4e8c-90d5-5c5aed3d6206 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:12:28.144343 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-9504c6bf-6f1f-4e8c-90d5-5c5aed3d6206 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] [instance: 696c547f-7cea-497f-9871-dd26f3fb6cfc] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:12:28.163992 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9504c6bf-6f1f-4e8c-90d5-5c5aed3d6206 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:28.169506 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9504c6bf-6f1f-4e8c-90d5-5c5aed3d6206 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:28.176968 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9504c6bf-6f1f-4e8c-90d5-5c5aed3d6206 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:28.182524 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9504c6bf-6f1f-4e8c-90d5-5c5aed3d6206 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:28.183848 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9504c6bf-6f1f-4e8c-90d5-5c5aed3d6206 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:28.184455 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9504c6bf-6f1f-4e8c-90d5-5c5aed3d6206 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:28.302996 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-9504c6bf-6f1f-4e8c-90d5-5c5aed3d6206 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] 10.222.0.43 "GET /compute/v2.1/servers/696c547f-7cea-497f-9871-dd26f3fb6cfc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.165712 Oct 04 22:12:28.304306 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2681/5301] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 22:12:28 2022] GET /compute/v2.1/servers/696c547f-7cea-497f-9871-dd26f3fb6cfc/os-volume_attachments => generated 197 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:12:29.323071 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-5ed04ba2-b0ea-4a09-b1e6-1faf3d0247ac tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:12:29.326627 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-5ed04ba2-b0ea-4a09-b1e6-1faf3d0247ac tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] [instance: 696c547f-7cea-497f-9871-dd26f3fb6cfc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:12:29.341772 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5ed04ba2-b0ea-4a09-b1e6-1faf3d0247ac tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:29.344969 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5ed04ba2-b0ea-4a09-b1e6-1faf3d0247ac tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:29.345694 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5ed04ba2-b0ea-4a09-b1e6-1faf3d0247ac tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:29.346715 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5ed04ba2-b0ea-4a09-b1e6-1faf3d0247ac tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:29.347348 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5ed04ba2-b0ea-4a09-b1e6-1faf3d0247ac tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:29.347933 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5ed04ba2-b0ea-4a09-b1e6-1faf3d0247ac tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:29.416693 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-5ed04ba2-b0ea-4a09-b1e6-1faf3d0247ac tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] 10.222.0.43 "GET /compute/v2.1/servers/696c547f-7cea-497f-9871-dd26f3fb6cfc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.104064 Oct 04 22:12:29.422450 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2621/5302] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 22:12:29 2022] GET /compute/v2.1/servers/696c547f-7cea-497f-9871-dd26f3fb6cfc/os-volume_attachments => generated 197 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:12:30.429603 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-019bc40a-7179-4b03-854d-d5b7730f92bb tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:12:30.432454 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-019bc40a-7179-4b03-854d-d5b7730f92bb tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] [instance: 696c547f-7cea-497f-9871-dd26f3fb6cfc] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:12:30.442073 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-019bc40a-7179-4b03-854d-d5b7730f92bb tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:30.442851 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-019bc40a-7179-4b03-854d-d5b7730f92bb tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:30.443460 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-019bc40a-7179-4b03-854d-d5b7730f92bb tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:30.444350 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-019bc40a-7179-4b03-854d-d5b7730f92bb tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:30.445131 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-019bc40a-7179-4b03-854d-d5b7730f92bb tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:30.445718 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-019bc40a-7179-4b03-854d-d5b7730f92bb tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:30.483536 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-019bc40a-7179-4b03-854d-d5b7730f92bb tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] 10.222.0.43 "GET /compute/v2.1/servers/696c547f-7cea-497f-9871-dd26f3fb6cfc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058122 Oct 04 22:12:30.484767 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2682/5303] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 22:12:30 2022] GET /compute/v2.1/servers/696c547f-7cea-497f-9871-dd26f3fb6cfc/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:12:31.498650 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-f2cc226a-651e-4ab2-b68c-70d7945eabc9 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:12:31.500975 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-f2cc226a-651e-4ab2-b68c-70d7945eabc9 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] [instance: 696c547f-7cea-497f-9871-dd26f3fb6cfc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:12:31.518324 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f2cc226a-651e-4ab2-b68c-70d7945eabc9 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:31.518851 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f2cc226a-651e-4ab2-b68c-70d7945eabc9 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:31.525550 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f2cc226a-651e-4ab2-b68c-70d7945eabc9 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:31.526426 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f2cc226a-651e-4ab2-b68c-70d7945eabc9 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:31.529955 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f2cc226a-651e-4ab2-b68c-70d7945eabc9 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:31.530488 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f2cc226a-651e-4ab2-b68c-70d7945eabc9 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:31.607850 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-f2cc226a-651e-4ab2-b68c-70d7945eabc9 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] 10.222.0.43 "GET /compute/v2.1/servers/696c547f-7cea-497f-9871-dd26f3fb6cfc/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.112963 Oct 04 22:12:31.608927 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2622/5304] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 22:12:31 2022] GET /compute/v2.1/servers/696c547f-7cea-497f-9871-dd26f3fb6cfc/os-volume_attachments => generated 25 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 22:12:31.749510 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-d1a1af1f-db23-4354-823d-574021921b33 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:12:31.750838 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-d1a1af1f-db23-4354-823d-574021921b33 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] [instance: 696c547f-7cea-497f-9871-dd26f3fb6cfc] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:12:31.752943 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=1 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:12:31.767831 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d1a1af1f-db23-4354-823d-574021921b33 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:31.768190 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d1a1af1f-db23-4354-823d-574021921b33 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:31.769988 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d1a1af1f-db23-4354-823d-574021921b33 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:31.773873 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d1a1af1f-db23-4354-823d-574021921b33 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:31.774407 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d1a1af1f-db23-4354-823d-574021921b33 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:31.774843 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d1a1af1f-db23-4354-823d-574021921b33 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:31.827241 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-d1a1af1f-db23-4354-823d-574021921b33 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] [instance: 696c547f-7cea-497f-9871-dd26f3fb6cfc] Going to try to terminate instance {{(pid=134102) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 22:12:31.968887 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-d1a1af1f-db23-4354-823d-574021921b33 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] 10.222.0.43 "DELETE /compute/v2.1/servers/696c547f-7cea-497f-9871-dd26f3fb6cfc" status: 204 len: 0 microversion: 2.1 time: 0.227163 Oct 04 22:12:31.970856 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2683/5305] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 22:12:31 2022] DELETE /compute/v2.1/servers/696c547f-7cea-497f-9871-dd26f3fb6cfc => generated 0 bytes in 230 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 22:12:31.979627 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-ac30d60d-eb43-461b-8ebe-824ab143ec0c tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:12:31.980467 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-ac30d60d-eb43-461b-8ebe-824ab143ec0c tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] [instance: 696c547f-7cea-497f-9871-dd26f3fb6cfc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:12:31.991124 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ac30d60d-eb43-461b-8ebe-824ab143ec0c tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:31.993668 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ac30d60d-eb43-461b-8ebe-824ab143ec0c tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:31.994305 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ac30d60d-eb43-461b-8ebe-824ab143ec0c tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:31.996128 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ac30d60d-eb43-461b-8ebe-824ab143ec0c tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:31.997933 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ac30d60d-eb43-461b-8ebe-824ab143ec0c tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:31.998707 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ac30d60d-eb43-461b-8ebe-824ab143ec0c tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:32.315540 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-ac30d60d-eb43-461b-8ebe-824ab143ec0c tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80fc56886fef422b9b52eb1dede7d10e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82e1a29234ce40f9b37d0eca196cd1db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:12:32.329193 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-ac30d60d-eb43-461b-8ebe-824ab143ec0c tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] 10.222.0.43 "GET /compute/v2.1/servers/696c547f-7cea-497f-9871-dd26f3fb6cfc" status: 200 len: 1679 microversion: 2.1 time: 0.351806 Oct 04 22:12:32.330185 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2623/5306] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:12:31 2022] GET /compute/v2.1/servers/696c547f-7cea-497f-9871-dd26f3fb6cfc => generated 1679 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:12:33.360191 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-a6d0add7-850d-411e-a24b-c0d127390b9e tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:12:33.361518 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-a6d0add7-850d-411e-a24b-c0d127390b9e tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] [instance: 696c547f-7cea-497f-9871-dd26f3fb6cfc] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:12:33.381141 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a6d0add7-850d-411e-a24b-c0d127390b9e tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:33.381885 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a6d0add7-850d-411e-a24b-c0d127390b9e tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:33.382505 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a6d0add7-850d-411e-a24b-c0d127390b9e tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:33.383395 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a6d0add7-850d-411e-a24b-c0d127390b9e tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:33.384010 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a6d0add7-850d-411e-a24b-c0d127390b9e tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:33.384599 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a6d0add7-850d-411e-a24b-c0d127390b9e tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:33.794963 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-a6d0add7-850d-411e-a24b-c0d127390b9e tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80fc56886fef422b9b52eb1dede7d10e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82e1a29234ce40f9b37d0eca196cd1db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:12:33.804035 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-a6d0add7-850d-411e-a24b-c0d127390b9e tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] 10.222.0.43 "GET /compute/v2.1/servers/696c547f-7cea-497f-9871-dd26f3fb6cfc" status: 200 len: 1679 microversion: 2.1 time: 0.448675 Oct 04 22:12:33.809318 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2684/5307] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:12:33 2022] GET /compute/v2.1/servers/696c547f-7cea-497f-9871-dd26f3fb6cfc => generated 1679 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:12:34.835841 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-617bf0d8-1eb2-43c9-a3f0-9b542492a091 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:12:34.836458 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-617bf0d8-1eb2-43c9-a3f0-9b542492a091 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] [instance: 696c547f-7cea-497f-9871-dd26f3fb6cfc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:12:34.850409 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-617bf0d8-1eb2-43c9-a3f0-9b542492a091 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:34.851194 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-617bf0d8-1eb2-43c9-a3f0-9b542492a091 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:34.851830 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-617bf0d8-1eb2-43c9-a3f0-9b542492a091 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:34.861520 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-617bf0d8-1eb2-43c9-a3f0-9b542492a091 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:34.862245 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-617bf0d8-1eb2-43c9-a3f0-9b542492a091 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:34.862933 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-617bf0d8-1eb2-43c9-a3f0-9b542492a091 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:34.938700 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=97,nova_cell1:UPDATE=1 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:12:35.300060 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-617bf0d8-1eb2-43c9-a3f0-9b542492a091 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80fc56886fef422b9b52eb1dede7d10e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82e1a29234ce40f9b37d0eca196cd1db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:12:35.320933 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-617bf0d8-1eb2-43c9-a3f0-9b542492a091 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] 10.222.0.43 "GET /compute/v2.1/servers/696c547f-7cea-497f-9871-dd26f3fb6cfc" status: 200 len: 1679 microversion: 2.1 time: 0.480793 Oct 04 22:12:35.340268 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2624/5308] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:12:34 2022] GET /compute/v2.1/servers/696c547f-7cea-497f-9871-dd26f3fb6cfc => generated 1679 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:12:36.370578 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-0893d8af-0dc1-45b9-a881-c42521af2a0e tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:12:36.372315 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-0893d8af-0dc1-45b9-a881-c42521af2a0e tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] [instance: 696c547f-7cea-497f-9871-dd26f3fb6cfc] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:12:36.396872 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0893d8af-0dc1-45b9-a881-c42521af2a0e tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:36.397361 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0893d8af-0dc1-45b9-a881-c42521af2a0e tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:36.397800 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0893d8af-0dc1-45b9-a881-c42521af2a0e tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:36.402915 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0893d8af-0dc1-45b9-a881-c42521af2a0e tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:36.403443 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0893d8af-0dc1-45b9-a881-c42521af2a0e tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:36.403907 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0893d8af-0dc1-45b9-a881-c42521af2a0e tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:36.727255 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-0893d8af-0dc1-45b9-a881-c42521af2a0e tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80fc56886fef422b9b52eb1dede7d10e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82e1a29234ce40f9b37d0eca196cd1db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:12:36.745606 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-0893d8af-0dc1-45b9-a881-c42521af2a0e tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] 10.222.0.43 "GET /compute/v2.1/servers/696c547f-7cea-497f-9871-dd26f3fb6cfc" status: 200 len: 1611 microversion: 2.1 time: 0.381227 Oct 04 22:12:36.746247 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2685/5309] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:12:36 2022] GET /compute/v2.1/servers/696c547f-7cea-497f-9871-dd26f3fb6cfc => generated 1611 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:12:37.030390 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-c2e0fa74-3b48-4730-95fa-0ec4b8854531 req-cf8b5d8c-476f-42a2-8583-65b61c094258 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "696c547f-7cea-497f-9871-dd26f3fb6cfc", "name": "network-vif-deleted", "tag": "b5aaccab-10a5-4329-b536-62d277938793"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:12:37.054541 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-c2e0fa74-3b48-4730-95fa-0ec4b8854531 req-cf8b5d8c-476f-42a2-8583-65b61c094258 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:37.055038 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-c2e0fa74-3b48-4730-95fa-0ec4b8854531 req-cf8b5d8c-476f-42a2-8583-65b61c094258 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:37.055483 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-c2e0fa74-3b48-4730-95fa-0ec4b8854531 req-cf8b5d8c-476f-42a2-8583-65b61c094258 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:37.099030 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-c2e0fa74-3b48-4730-95fa-0ec4b8854531 req-cf8b5d8c-476f-42a2-8583-65b61c094258 service nova] Creating event network-vif-deleted:b5aaccab-10a5-4329-b536-62d277938793 for instance 696c547f-7cea-497f-9871-dd26f3fb6cfc on n-h1-860284-1 Oct 04 22:12:37.119114 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-c2e0fa74-3b48-4730-95fa-0ec4b8854531 req-cf8b5d8c-476f-42a2-8583-65b61c094258 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092519 Oct 04 22:12:37.132325 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2625/5310] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:12:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:12:37.776444 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-c7d2dc33-ea7d-43f0-82af-e6a8d8a43e25 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:12:37.777070 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-c7d2dc33-ea7d-43f0-82af-e6a8d8a43e25 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] [instance: 696c547f-7cea-497f-9871-dd26f3fb6cfc] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:12:37.789320 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c7d2dc33-ea7d-43f0-82af-e6a8d8a43e25 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:37.800576 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c7d2dc33-ea7d-43f0-82af-e6a8d8a43e25 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:37.801054 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c7d2dc33-ea7d-43f0-82af-e6a8d8a43e25 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:37.805028 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c7d2dc33-ea7d-43f0-82af-e6a8d8a43e25 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:37.806400 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c7d2dc33-ea7d-43f0-82af-e6a8d8a43e25 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:37.807538 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c7d2dc33-ea7d-43f0-82af-e6a8d8a43e25 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:37.865463 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c7d2dc33-ea7d-43f0-82af-e6a8d8a43e25 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:37.866330 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c7d2dc33-ea7d-43f0-82af-e6a8d8a43e25 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:37.867008 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c7d2dc33-ea7d-43f0-82af-e6a8d8a43e25 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:37.867753 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.objects.instance [None req-c7d2dc33-ea7d-43f0-82af-e6a8d8a43e25 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lazy-loading 'fault' on Instance uuid 696c547f-7cea-497f-9871-dd26f3fb6cfc {{(pid=134102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 22:12:37.949308 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-c7d2dc33-ea7d-43f0-82af-e6a8d8a43e25 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80fc56886fef422b9b52eb1dede7d10e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82e1a29234ce40f9b37d0eca196cd1db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:12:37.967429 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-c7d2dc33-ea7d-43f0-82af-e6a8d8a43e25 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] 10.222.0.43 "GET /compute/v2.1/servers/696c547f-7cea-497f-9871-dd26f3fb6cfc" status: 200 len: 1329 microversion: 2.1 time: 0.195848 Oct 04 22:12:37.970229 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2686/5311] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:12:37 2022] GET /compute/v2.1/servers/696c547f-7cea-497f-9871-dd26f3fb6cfc => generated 1329 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:12:39.001166 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-56bc1c7f-e139-4404-bb59-549f870dcdc9 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:12:39.002540 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-56bc1c7f-e139-4404-bb59-549f870dcdc9 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] [instance: 696c547f-7cea-497f-9871-dd26f3fb6cfc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:12:39.009455 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-56bc1c7f-e139-4404-bb59-549f870dcdc9 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:39.012792 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-56bc1c7f-e139-4404-bb59-549f870dcdc9 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:39.013246 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-56bc1c7f-e139-4404-bb59-549f870dcdc9 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:39.013964 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-56bc1c7f-e139-4404-bb59-549f870dcdc9 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:39.014451 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-56bc1c7f-e139-4404-bb59-549f870dcdc9 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:39.014876 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-56bc1c7f-e139-4404-bb59-549f870dcdc9 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:39.046665 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-56bc1c7f-e139-4404-bb59-549f870dcdc9 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] HTTP exception thrown: Instance 696c547f-7cea-497f-9871-dd26f3fb6cfc could not be found. Oct 04 22:12:39.048638 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-56bc1c7f-e139-4404-bb59-549f870dcdc9 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Request method failure captured: Oct 04 22:12:39.048638 n-d-860284-1 devstack@n-api.service[134101]: request: GET /compute/v2.1/servers/696c547f-7cea-497f-9871-dd26f3fb6cfc HTTP/1.1 Oct 04 22:12:39.048638 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 22:12:39.048638 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 22:12:39.048638 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 22:12:39.048638 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 22:12:39.048638 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 22:12:39.048638 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 22:12:39.048638 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 22:12:39.048638 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 22:12:39.048638 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPK1_jKuDmdFTooG3vXwJSp1td0Kvvx-9VX1-OpwmBVV8uNR_MbJNU7EeI7sJdUoH3-0m3mmRBtTc-gLPN-qZ-RuZ8IL2TyG35svVe_hwPH0Z2c1BjkAMrt5beIkYsGbtm00-0XbqMbhJ5wgj-ztyQnhQ8ugDue3oDD_DUqnSWikZCg8 Oct 04 22:12:39.048638 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 22:12:39.048638 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 22:12:39.048638 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 22:12:39.048638 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 22:12:39.048638 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 22:12:39.048638 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 22:12:39.048638 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: 82e1a29234ce40f9b37d0eca196cd1db Oct 04 22:12:39.048638 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-AttachVolumeNegativeTest-2122228341 Oct 04 22:12:39.048638 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 22:12:39.048638 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 22:12:39.048638 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/82e1a29234ce40f9b37d0eca196cd1db"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_82e1a29234ce40f9b37d0eca196cd1db", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/82e1a29234ce40f9b37d0eca196cd1db"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/82e1a29234ce40f9b37d0eca196cd1db"}]}] Oct 04 22:12:39.048638 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-AttachVolumeNegativeTest-2122228341 Oct 04 22:12:39.048638 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: 82e1a29234ce40f9b37d0eca196cd1db Oct 04 22:12:39.048638 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2122228341 Oct 04 22:12:39.048638 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-AttachVolumeNegativeTest-2122228341-project Oct 04 22:12:39.048638 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 22:12:39.048638 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 22:12:39.048638 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 80fc56886fef422b9b52eb1dede7d10e Oct 04 22:12:39.048638 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-AttachVolumeNegativeTest-2122228341-project Oct 04 22:12:39.048638 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 22:12:39.048638 n-d-860284-1 devstack@n-api.service[134101]: exception: Instance 696c547f-7cea-497f-9871-dd26f3fb6cfc could not be found. Oct 04 22:12:39.048638 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': '696c547f-7cea-497f-9871-dd26f3fb6cfc'} Oct 04 22:12:39.048638 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:12:39.048638 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:12:39.048638 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:12:39.048638 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:12:39.048638 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:12:39.048638 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:12:39.048638 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:12:39.048638 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:12:39.048638 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:12:39.048638 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:12:39.048638 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 696c547f-7cea-497f-9871-dd26f3fb6cfc could not be found. Oct 04 22:12:39.048638 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:12:39.048638 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:12:39.048638 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:12:39.048638 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:12:39.048638 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:12:39.048638 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:12:39.048638 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:12:39.048638 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:12:39.048638 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:12:39.048638 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:12:39.048638 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:12:39.048638 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:12:39.048638 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:12:39.048638 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:12:39.048638 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:12:39.048638 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:12:39.048638 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 696c547f-7cea-497f-9871-dd26f3fb6cfc could not be found. Oct 04 22:12:39.048638 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:12:39.048638 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:12:39.048638 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:12:39.057619 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:12:39.057619 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:12:39.057619 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:12:39.057619 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:12:39.057619 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:12:39.057619 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 696c547f-7cea-497f-9871-dd26f3fb6cfc could not be found. Oct 04 22:12:39.057619 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:12:39.057619 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-56bc1c7f-e139-4404-bb59-549f870dcdc9 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Returning 404 to user: Instance 696c547f-7cea-497f-9871-dd26f3fb6cfc could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:12:39.057619 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-56bc1c7f-e139-4404-bb59-549f870dcdc9 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] 10.222.0.43 "GET /compute/v2.1/servers/696c547f-7cea-497f-9871-dd26f3fb6cfc" status: 404 len: 111 microversion: 2.1 time: 0.055952 Oct 04 22:12:39.057619 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2626/5312] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:12:38 2022] GET /compute/v2.1/servers/696c547f-7cea-497f-9871-dd26f3fb6cfc => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 22:12:39.064274 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-af78c625-185e-4aba-a7de-5aa3942548cf tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Calling method '.version_select at 0x7fbb2e4b69d0>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:12:39.125166 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-af78c625-185e-4aba-a7de-5aa3942548cf tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-938614431" status: 202 len: 0 microversion: 2.1 time: 0.068310 Oct 04 22:12:39.126333 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2687/5313] 10.222.0.43 () {58 vars in 1218 bytes} [Tue Oct 4 22:12:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-938614431 => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 22:12:40.589370 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-2adae74b-6bfd-4dba-aade-d425b1d3fc1c tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-1564454167", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452", "networks": [{"uuid": "46d2d8b1-42fb-4865-a389-fdad702f2264"}]}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:12:40.682200 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.network.neutron [None req-2adae74b-6bfd-4dba-aade-d425b1d3fc1c tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] validate_networks() for [('46d2d8b1-42fb-4865-a389-fdad702f2264', None, None, None, None, None)] {{(pid=134101) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 22:12:41.415188 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-2adae74b-6bfd-4dba-aade-d425b1d3fc1c tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] Flavor limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 22:12:41.415836 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-2adae74b-6bfd-4dba-aade-d425b1d3fc1c tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] Image limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 22:12:41.416461 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-2adae74b-6bfd-4dba-aade-d425b1d3fc1c tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] Flavor pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 22:12:41.417019 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-2adae74b-6bfd-4dba-aade-d425b1d3fc1c tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] Image pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 22:12:41.417579 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-2adae74b-6bfd-4dba-aade-d425b1d3fc1c tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 22:12:41.437884 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2adae74b-6bfd-4dba-aade-d425b1d3fc1c tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:41.438648 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2adae74b-6bfd-4dba-aade-d425b1d3fc1c tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:41.439261 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2adae74b-6bfd-4dba-aade-d425b1d3fc1c tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:41.440233 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2adae74b-6bfd-4dba-aade-d425b1d3fc1c tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:41.440838 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2adae74b-6bfd-4dba-aade-d425b1d3fc1c tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:41.447062 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2adae74b-6bfd-4dba-aade-d425b1d3fc1c tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:41.485648 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-2adae74b-6bfd-4dba-aade-d425b1d3fc1c tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] Getting quotas for project 32b18f49935d4c02bfcc189bdc56f259. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:12:41.502226 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-2adae74b-6bfd-4dba-aade-d425b1d3fc1c tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] Getting quotas for user 558a2667b8994bf4acb2a797ff091f31 and project 32b18f49935d4c02bfcc189bdc56f259. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:12:41.528432 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-2adae74b-6bfd-4dba-aade-d425b1d3fc1c tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] Going to run 1 instances... {{(pid=134101) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 22:12:41.531167 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-2adae74b-6bfd-4dba-aade-d425b1d3fc1c tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] [instance: 50de5c85-3929-42cb-86b5-7ed97706e579] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='58548514-5dac-426c-81f5-19e3fba33e23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134101) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 22:12:41.629943 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-2adae74b-6bfd-4dba-aade-d425b1d3fc1c tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.317549 Oct 04 22:12:41.634591 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2627/5314] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 22:12:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 1323 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 22:12:41.646869 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-e7148421-16be-451a-9762-7a3c23eebfd1 tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:12:41.648747 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-e7148421-16be-451a-9762-7a3c23eebfd1 tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] [instance: 50de5c85-3929-42cb-86b5-7ed97706e579] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:12:41.739511 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-e7148421-16be-451a-9762-7a3c23eebfd1 tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '558a2667b8994bf4acb2a797ff091f31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32b18f49935d4c02bfcc189bdc56f259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:12:41.748384 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-e7148421-16be-451a-9762-7a3c23eebfd1 tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] 10.222.0.43 "GET /compute/v2.1/servers/50de5c85-3929-42cb-86b5-7ed97706e579" status: 200 len: 1228 microversion: 2.1 time: 0.106241 Oct 04 22:12:41.758395 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2688/5315] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:12:41 2022] GET /compute/v2.1/servers/50de5c85-3929-42cb-86b5-7ed97706e579 => generated 1228 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:12:42.775940 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-f3c03eb5-adc6-45b4-9583-6f1fe4a8a384 tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:12:42.779029 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-f3c03eb5-adc6-45b4-9583-6f1fe4a8a384 tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] [instance: 50de5c85-3929-42cb-86b5-7ed97706e579] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:12:42.788628 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f3c03eb5-adc6-45b4-9583-6f1fe4a8a384 tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:42.789282 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f3c03eb5-adc6-45b4-9583-6f1fe4a8a384 tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:42.789822 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f3c03eb5-adc6-45b4-9583-6f1fe4a8a384 tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:42.790811 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f3c03eb5-adc6-45b4-9583-6f1fe4a8a384 tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:42.791510 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f3c03eb5-adc6-45b4-9583-6f1fe4a8a384 tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:42.792150 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f3c03eb5-adc6-45b4-9583-6f1fe4a8a384 tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:42.863764 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-f3c03eb5-adc6-45b4-9583-6f1fe4a8a384 tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '558a2667b8994bf4acb2a797ff091f31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32b18f49935d4c02bfcc189bdc56f259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:12:42.872599 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-f3c03eb5-adc6-45b4-9583-6f1fe4a8a384 tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] 10.222.0.43 "GET /compute/v2.1/servers/50de5c85-3929-42cb-86b5-7ed97706e579" status: 200 len: 1280 microversion: 2.1 time: 0.103902 Oct 04 22:12:42.874352 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2628/5316] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:12:42 2022] GET /compute/v2.1/servers/50de5c85-3929-42cb-86b5-7ed97706e579 => generated 1280 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:12:43.897334 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-b4f6a400-fd87-4960-bfa2-4229d0b33fa0 tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:12:43.897968 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-b4f6a400-fd87-4960-bfa2-4229d0b33fa0 tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] [instance: 50de5c85-3929-42cb-86b5-7ed97706e579] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:12:43.910248 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b4f6a400-fd87-4960-bfa2-4229d0b33fa0 tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:43.911002 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b4f6a400-fd87-4960-bfa2-4229d0b33fa0 tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:43.927123 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b4f6a400-fd87-4960-bfa2-4229d0b33fa0 tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:43.927896 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b4f6a400-fd87-4960-bfa2-4229d0b33fa0 tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:43.928373 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b4f6a400-fd87-4960-bfa2-4229d0b33fa0 tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:43.928818 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b4f6a400-fd87-4960-bfa2-4229d0b33fa0 tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:44.079137 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-b4f6a400-fd87-4960-bfa2-4229d0b33fa0 tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '558a2667b8994bf4acb2a797ff091f31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32b18f49935d4c02bfcc189bdc56f259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:12:44.111543 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-b4f6a400-fd87-4960-bfa2-4229d0b33fa0 tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] 10.222.0.43 "GET /compute/v2.1/servers/50de5c85-3929-42cb-86b5-7ed97706e579" status: 200 len: 1286 microversion: 2.1 time: 0.218018 Oct 04 22:12:44.115034 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2689/5317] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:12:43 2022] GET /compute/v2.1/servers/50de5c85-3929-42cb-86b5-7ed97706e579 => generated 1286 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:12:45.143630 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-737125a7-0121-4d46-8804-1885349a5d2a tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:12:45.144417 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-737125a7-0121-4d46-8804-1885349a5d2a tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] [instance: 50de5c85-3929-42cb-86b5-7ed97706e579] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:12:45.155400 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-737125a7-0121-4d46-8804-1885349a5d2a tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:45.156250 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-737125a7-0121-4d46-8804-1885349a5d2a tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:45.156906 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-737125a7-0121-4d46-8804-1885349a5d2a tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:45.157982 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-737125a7-0121-4d46-8804-1885349a5d2a tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:45.158958 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-737125a7-0121-4d46-8804-1885349a5d2a tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:45.159604 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-737125a7-0121-4d46-8804-1885349a5d2a tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:45.319026 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-9f332e85-9e98-448d-8763-adc465ef1256 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:12:45.320290 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-9f332e85-9e98-448d-8763-adc465ef1256 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] [instance: 696c547f-7cea-497f-9871-dd26f3fb6cfc] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:12:45.345319 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9f332e85-9e98-448d-8763-adc465ef1256 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:45.348546 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9f332e85-9e98-448d-8763-adc465ef1256 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:45.349381 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9f332e85-9e98-448d-8763-adc465ef1256 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:45.354725 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9f332e85-9e98-448d-8763-adc465ef1256 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:45.359022 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9f332e85-9e98-448d-8763-adc465ef1256 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:45.359895 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9f332e85-9e98-448d-8763-adc465ef1256 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:45.398167 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-9f332e85-9e98-448d-8763-adc465ef1256 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] HTTP exception thrown: Instance 696c547f-7cea-497f-9871-dd26f3fb6cfc could not be found. Oct 04 22:12:45.403517 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-9f332e85-9e98-448d-8763-adc465ef1256 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Request method failure captured: Oct 04 22:12:45.403517 n-d-860284-1 devstack@n-api.service[134102]: request: DELETE /compute/v2.1/servers/696c547f-7cea-497f-9871-dd26f3fb6cfc HTTP/1.1 Oct 04 22:12:45.403517 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 22:12:45.403517 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 22:12:45.403517 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 22:12:45.403517 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 22:12:45.403517 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 22:12:45.403517 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 22:12:45.403517 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 22:12:45.403517 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 22:12:45.403517 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPK1_jKuDmdFTooG3vXwJSp1td0Kvvx-9VX1-OpwmBVV8uNR_MbJNU7EeI7sJdUoH3-0m3mmRBtTc-gLPN-qZ-RuZ8IL2TyG35svVe_hwPH0Z2c1BjkAMrt5beIkYsGbtm00-0XbqMbhJ5wgj-ztyQnhQ8ugDue3oDD_DUqnSWikZCg8 Oct 04 22:12:45.403517 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 22:12:45.403517 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 22:12:45.403517 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 22:12:45.403517 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 22:12:45.403517 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 22:12:45.403517 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 22:12:45.403517 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: 82e1a29234ce40f9b37d0eca196cd1db Oct 04 22:12:45.403517 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-AttachVolumeNegativeTest-2122228341 Oct 04 22:12:45.403517 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 22:12:45.403517 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 22:12:45.403517 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/82e1a29234ce40f9b37d0eca196cd1db"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_82e1a29234ce40f9b37d0eca196cd1db", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/82e1a29234ce40f9b37d0eca196cd1db"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/82e1a29234ce40f9b37d0eca196cd1db"}]}] Oct 04 22:12:45.403517 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-AttachVolumeNegativeTest-2122228341 Oct 04 22:12:45.403517 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: 82e1a29234ce40f9b37d0eca196cd1db Oct 04 22:12:45.403517 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2122228341 Oct 04 22:12:45.403517 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-AttachVolumeNegativeTest-2122228341-project Oct 04 22:12:45.403517 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 22:12:45.403517 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 22:12:45.403517 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: 80fc56886fef422b9b52eb1dede7d10e Oct 04 22:12:45.403517 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-AttachVolumeNegativeTest-2122228341-project Oct 04 22:12:45.403517 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 22:12:45.403517 n-d-860284-1 devstack@n-api.service[134102]: exception: Instance 696c547f-7cea-497f-9871-dd26f3fb6cfc could not be found. Oct 04 22:12:45.403517 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': '696c547f-7cea-497f-9871-dd26f3fb6cfc'} Oct 04 22:12:45.403517 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:12:45.403517 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:12:45.403517 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:12:45.403517 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:12:45.403517 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:12:45.403517 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:12:45.403517 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:12:45.403517 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:12:45.403517 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:12:45.403517 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:12:45.403517 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 696c547f-7cea-497f-9871-dd26f3fb6cfc could not be found. Oct 04 22:12:45.403517 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:12:45.403517 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:12:45.403517 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:12:45.403517 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:12:45.403517 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:12:45.403517 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:12:45.403517 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:12:45.403517 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:12:45.403517 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:12:45.403517 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:12:45.403517 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 22:12:45.403517 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 22:12:45.403517 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 22:12:45.403517 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 22:12:45.403517 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:12:45.403517 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:12:45.403517 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:12:45.403517 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:12:45.409129 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 696c547f-7cea-497f-9871-dd26f3fb6cfc could not be found. Oct 04 22:12:45.409129 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:12:45.409129 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:12:45.409129 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:12:45.409129 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:12:45.409129 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:12:45.409129 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:12:45.409129 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:12:45.409129 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:12:45.409129 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 696c547f-7cea-497f-9871-dd26f3fb6cfc could not be found. Oct 04 22:12:45.409129 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:12:45.409129 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-9f332e85-9e98-448d-8763-adc465ef1256 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Returning 404 to user: Instance 696c547f-7cea-497f-9871-dd26f3fb6cfc could not be found. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:12:45.409129 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-9f332e85-9e98-448d-8763-adc465ef1256 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] 10.222.0.43 "DELETE /compute/v2.1/servers/696c547f-7cea-497f-9871-dd26f3fb6cfc" status: 404 len: 111 microversion: 2.1 time: 0.094736 Oct 04 22:12:45.412500 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2690/5318] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 22:12:45 2022] DELETE /compute/v2.1/servers/696c547f-7cea-497f-9871-dd26f3fb6cfc => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 22:12:45.428151 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-24de6c25-cd3d-411d-929a-d3a19c976dd0 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:12:45.429923 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-24de6c25-cd3d-411d-929a-d3a19c976dd0 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] [instance: 696c547f-7cea-497f-9871-dd26f3fb6cfc] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:12:45.442389 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-24de6c25-cd3d-411d-929a-d3a19c976dd0 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:45.443476 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-24de6c25-cd3d-411d-929a-d3a19c976dd0 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:45.444128 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-24de6c25-cd3d-411d-929a-d3a19c976dd0 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:45.445512 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-24de6c25-cd3d-411d-929a-d3a19c976dd0 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:45.446143 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-24de6c25-cd3d-411d-929a-d3a19c976dd0 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:45.446781 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-24de6c25-cd3d-411d-929a-d3a19c976dd0 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:45.462356 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-737125a7-0121-4d46-8804-1885349a5d2a tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '558a2667b8994bf4acb2a797ff091f31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32b18f49935d4c02bfcc189bdc56f259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:12:45.468150 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-24de6c25-cd3d-411d-929a-d3a19c976dd0 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] HTTP exception thrown: Instance 696c547f-7cea-497f-9871-dd26f3fb6cfc could not be found. Oct 04 22:12:45.470526 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-24de6c25-cd3d-411d-929a-d3a19c976dd0 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Request method failure captured: Oct 04 22:12:45.470526 n-d-860284-1 devstack@n-api.service[134102]: request: GET /compute/v2.1/servers/696c547f-7cea-497f-9871-dd26f3fb6cfc HTTP/1.1 Oct 04 22:12:45.470526 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 22:12:45.470526 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 22:12:45.470526 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 22:12:45.470526 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 22:12:45.470526 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 22:12:45.470526 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 22:12:45.470526 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 22:12:45.470526 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 22:12:45.470526 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPK1_jKuDmdFTooG3vXwJSp1td0Kvvx-9VX1-OpwmBVV8uNR_MbJNU7EeI7sJdUoH3-0m3mmRBtTc-gLPN-qZ-RuZ8IL2TyG35svVe_hwPH0Z2c1BjkAMrt5beIkYsGbtm00-0XbqMbhJ5wgj-ztyQnhQ8ugDue3oDD_DUqnSWikZCg8 Oct 04 22:12:45.470526 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 22:12:45.470526 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 22:12:45.470526 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 22:12:45.470526 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 22:12:45.470526 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 22:12:45.470526 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 22:12:45.470526 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: 82e1a29234ce40f9b37d0eca196cd1db Oct 04 22:12:45.470526 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-AttachVolumeNegativeTest-2122228341 Oct 04 22:12:45.470526 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 22:12:45.470526 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 22:12:45.470526 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/82e1a29234ce40f9b37d0eca196cd1db"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_82e1a29234ce40f9b37d0eca196cd1db", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/82e1a29234ce40f9b37d0eca196cd1db"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/82e1a29234ce40f9b37d0eca196cd1db"}]}] Oct 04 22:12:45.470526 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-AttachVolumeNegativeTest-2122228341 Oct 04 22:12:45.470526 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: 82e1a29234ce40f9b37d0eca196cd1db Oct 04 22:12:45.470526 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2122228341 Oct 04 22:12:45.470526 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-AttachVolumeNegativeTest-2122228341-project Oct 04 22:12:45.470526 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 22:12:45.470526 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 22:12:45.470526 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: 80fc56886fef422b9b52eb1dede7d10e Oct 04 22:12:45.470526 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-AttachVolumeNegativeTest-2122228341-project Oct 04 22:12:45.470526 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 22:12:45.470526 n-d-860284-1 devstack@n-api.service[134102]: exception: Instance 696c547f-7cea-497f-9871-dd26f3fb6cfc could not be found. Oct 04 22:12:45.470526 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': '696c547f-7cea-497f-9871-dd26f3fb6cfc'} Oct 04 22:12:45.470526 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:12:45.470526 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:12:45.470526 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:12:45.470526 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:12:45.470526 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:12:45.470526 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:12:45.470526 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:12:45.470526 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:12:45.470526 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:12:45.470526 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:12:45.470526 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 696c547f-7cea-497f-9871-dd26f3fb6cfc could not be found. Oct 04 22:12:45.470526 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:12:45.470526 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:12:45.470526 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:12:45.470526 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:12:45.470526 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:12:45.470526 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:12:45.470526 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:12:45.470526 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:12:45.470526 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:12:45.470526 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:12:45.470526 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:12:45.470526 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:12:45.470526 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:12:45.470526 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:12:45.470526 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:12:45.470526 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:12:45.470526 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 696c547f-7cea-497f-9871-dd26f3fb6cfc could not be found. Oct 04 22:12:45.470526 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:12:45.470526 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:12:45.470526 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:12:45.475096 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:12:45.475096 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:12:45.475096 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:12:45.475096 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:12:45.475096 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:12:45.475096 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 696c547f-7cea-497f-9871-dd26f3fb6cfc could not be found. Oct 04 22:12:45.475096 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:12:45.475578 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-737125a7-0121-4d46-8804-1885349a5d2a tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] 10.222.0.43 "GET /compute/v2.1/servers/50de5c85-3929-42cb-86b5-7ed97706e579" status: 200 len: 1328 microversion: 2.1 time: 0.336992 Oct 04 22:12:45.477541 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-24de6c25-cd3d-411d-929a-d3a19c976dd0 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Returning 404 to user: Instance 696c547f-7cea-497f-9871-dd26f3fb6cfc could not be found. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:12:45.478699 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2629/5319] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:12:45 2022] GET /compute/v2.1/servers/50de5c85-3929-42cb-86b5-7ed97706e579 => generated 1328 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:12:45.480912 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-24de6c25-cd3d-411d-929a-d3a19c976dd0 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] 10.222.0.43 "GET /compute/v2.1/servers/696c547f-7cea-497f-9871-dd26f3fb6cfc" status: 404 len: 111 microversion: 2.1 time: 0.060729 Oct 04 22:12:45.482791 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2691/5320] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:12:45 2022] GET /compute/v2.1/servers/696c547f-7cea-497f-9871-dd26f3fb6cfc => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 22:12:46.330667 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-f4455967-dbc3-424f-9969-1dafc3ed18c6 req-10fa4712-d1c7-40ad-9b17-d1f42b60f64b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50de5c85-3929-42cb-86b5-7ed97706e579", "tag": "f7f6c5f7-dda1-4cf9-bd3d-c6b01c729e41"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:12:46.368059 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-f4455967-dbc3-424f-9969-1dafc3ed18c6 req-10fa4712-d1c7-40ad-9b17-d1f42b60f64b service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:46.386222 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-f4455967-dbc3-424f-9969-1dafc3ed18c6 req-10fa4712-d1c7-40ad-9b17-d1f42b60f64b service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:46.387975 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-f4455967-dbc3-424f-9969-1dafc3ed18c6 req-10fa4712-d1c7-40ad-9b17-d1f42b60f64b service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:46.428697 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-f4455967-dbc3-424f-9969-1dafc3ed18c6 req-10fa4712-d1c7-40ad-9b17-d1f42b60f64b service nova] Creating event network-changed:f7f6c5f7-dda1-4cf9-bd3d-c6b01c729e41 for instance 50de5c85-3929-42cb-86b5-7ed97706e579 on n-h2-860284-1 Oct 04 22:12:46.448157 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-f4455967-dbc3-424f-9969-1dafc3ed18c6 req-10fa4712-d1c7-40ad-9b17-d1f42b60f64b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121487 Oct 04 22:12:46.450437 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2630/5321] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:12:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:12:46.511620 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-05464812-13f4-44e2-a3c0-c1fb12d5108f tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:12:46.513102 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-05464812-13f4-44e2-a3c0-c1fb12d5108f tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] [instance: 50de5c85-3929-42cb-86b5-7ed97706e579] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:12:46.531049 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-05464812-13f4-44e2-a3c0-c1fb12d5108f tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:46.533999 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-05464812-13f4-44e2-a3c0-c1fb12d5108f tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:46.534547 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-05464812-13f4-44e2-a3c0-c1fb12d5108f tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:46.535461 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-05464812-13f4-44e2-a3c0-c1fb12d5108f tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:46.537121 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-05464812-13f4-44e2-a3c0-c1fb12d5108f tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:46.537593 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-05464812-13f4-44e2-a3c0-c1fb12d5108f tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:46.878615 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-05464812-13f4-44e2-a3c0-c1fb12d5108f tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '558a2667b8994bf4acb2a797ff091f31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32b18f49935d4c02bfcc189bdc56f259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:12:46.890785 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-05464812-13f4-44e2-a3c0-c1fb12d5108f tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] 10.222.0.43 "GET /compute/v2.1/servers/50de5c85-3929-42cb-86b5-7ed97706e579" status: 200 len: 1328 microversion: 2.1 time: 0.383844 Oct 04 22:12:46.892318 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2692/5322] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:12:46 2022] GET /compute/v2.1/servers/50de5c85-3929-42cb-86b5-7ed97706e579 => generated 1328 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:12:47.920745 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-6bb5e863-b971-4ede-a2e5-b1c9567fbdd6 tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:12:47.921627 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-6bb5e863-b971-4ede-a2e5-b1c9567fbdd6 tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] [instance: 50de5c85-3929-42cb-86b5-7ed97706e579] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:12:47.954815 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6bb5e863-b971-4ede-a2e5-b1c9567fbdd6 tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:47.955329 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6bb5e863-b971-4ede-a2e5-b1c9567fbdd6 tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:47.956028 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6bb5e863-b971-4ede-a2e5-b1c9567fbdd6 tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:47.956969 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6bb5e863-b971-4ede-a2e5-b1c9567fbdd6 tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:47.957816 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6bb5e863-b971-4ede-a2e5-b1c9567fbdd6 tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:47.958437 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6bb5e863-b971-4ede-a2e5-b1c9567fbdd6 tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:48.274869 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-6bb5e863-b971-4ede-a2e5-b1c9567fbdd6 tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '558a2667b8994bf4acb2a797ff091f31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32b18f49935d4c02bfcc189bdc56f259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:12:48.284251 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-6bb5e863-b971-4ede-a2e5-b1c9567fbdd6 tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] 10.222.0.43 "GET /compute/v2.1/servers/50de5c85-3929-42cb-86b5-7ed97706e579" status: 200 len: 1328 microversion: 2.1 time: 0.373415 Oct 04 22:12:48.288186 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2631/5323] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:12:47 2022] GET /compute/v2.1/servers/50de5c85-3929-42cb-86b5-7ed97706e579 => generated 1328 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:12:49.312346 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-3deee4a1-f2da-45f2-80da-b50492e2df62 tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:12:49.313994 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-3deee4a1-f2da-45f2-80da-b50492e2df62 tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] [instance: 50de5c85-3929-42cb-86b5-7ed97706e579] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:12:49.329215 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3deee4a1-f2da-45f2-80da-b50492e2df62 tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:49.330681 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3deee4a1-f2da-45f2-80da-b50492e2df62 tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:49.331590 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3deee4a1-f2da-45f2-80da-b50492e2df62 tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:49.332821 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3deee4a1-f2da-45f2-80da-b50492e2df62 tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:49.334914 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3deee4a1-f2da-45f2-80da-b50492e2df62 tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:49.335734 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3deee4a1-f2da-45f2-80da-b50492e2df62 tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:49.640822 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-3deee4a1-f2da-45f2-80da-b50492e2df62 tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '558a2667b8994bf4acb2a797ff091f31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32b18f49935d4c02bfcc189bdc56f259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:12:49.648921 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-3deee4a1-f2da-45f2-80da-b50492e2df62 tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] 10.222.0.43 "GET /compute/v2.1/servers/50de5c85-3929-42cb-86b5-7ed97706e579" status: 200 len: 1328 microversion: 2.1 time: 0.343750 Oct 04 22:12:49.668173 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2693/5324] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:12:49 2022] GET /compute/v2.1/servers/50de5c85-3929-42cb-86b5-7ed97706e579 => generated 1328 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:12:50.097103 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-0e928fd5-5d3e-4ecd-b579-cd2fadfc6ab7 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:12:50.097628 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-0e928fd5-5d3e-4ecd-b579-cd2fadfc6ab7 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] [instance: e616bb7a-3fab-411e-ab23-25d093c36691] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:12:50.105092 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0e928fd5-5d3e-4ecd-b579-cd2fadfc6ab7 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:50.105586 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0e928fd5-5d3e-4ecd-b579-cd2fadfc6ab7 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:50.106909 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0e928fd5-5d3e-4ecd-b579-cd2fadfc6ab7 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:50.108029 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0e928fd5-5d3e-4ecd-b579-cd2fadfc6ab7 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:50.108780 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0e928fd5-5d3e-4ecd-b579-cd2fadfc6ab7 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:50.109367 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0e928fd5-5d3e-4ecd-b579-cd2fadfc6ab7 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:50.129615 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-0e928fd5-5d3e-4ecd-b579-cd2fadfc6ab7 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] HTTP exception thrown: Instance e616bb7a-3fab-411e-ab23-25d093c36691 could not be found. Oct 04 22:12:50.131922 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-0e928fd5-5d3e-4ecd-b579-cd2fadfc6ab7 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Request method failure captured: Oct 04 22:12:50.131922 n-d-860284-1 devstack@n-api.service[134101]: request: DELETE /compute/v2.1/servers/e616bb7a-3fab-411e-ab23-25d093c36691 HTTP/1.1 Oct 04 22:12:50.131922 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 22:12:50.131922 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 22:12:50.131922 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 22:12:50.131922 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 22:12:50.131922 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 22:12:50.131922 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 22:12:50.131922 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 22:12:50.131922 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 22:12:50.131922 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPK1_jKuDmdFTooG3vXwJSp1td0Kvvx-9VX1-OpwmBVV8uNR_MbJNU7EeI7sJdUoH3-0m3mmRBtTc-gLPN-qZ-RuZ8IL2TyG35svVe_hwPH0Z2c1BjkAMrt5beIkYsGbtm00-0XbqMbhJ5wgj-ztyQnhQ8ugDue3oDD_DUqnSWikZCg8 Oct 04 22:12:50.131922 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 22:12:50.131922 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 22:12:50.131922 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 22:12:50.131922 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 22:12:50.131922 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 22:12:50.131922 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 22:12:50.131922 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: 82e1a29234ce40f9b37d0eca196cd1db Oct 04 22:12:50.131922 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-AttachVolumeNegativeTest-2122228341 Oct 04 22:12:50.131922 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 22:12:50.131922 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 22:12:50.131922 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/82e1a29234ce40f9b37d0eca196cd1db"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_82e1a29234ce40f9b37d0eca196cd1db", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/82e1a29234ce40f9b37d0eca196cd1db"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/82e1a29234ce40f9b37d0eca196cd1db"}]}] Oct 04 22:12:50.131922 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-AttachVolumeNegativeTest-2122228341 Oct 04 22:12:50.131922 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: 82e1a29234ce40f9b37d0eca196cd1db Oct 04 22:12:50.131922 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2122228341 Oct 04 22:12:50.131922 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-AttachVolumeNegativeTest-2122228341-project Oct 04 22:12:50.131922 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 22:12:50.131922 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 22:12:50.131922 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 80fc56886fef422b9b52eb1dede7d10e Oct 04 22:12:50.131922 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-AttachVolumeNegativeTest-2122228341-project Oct 04 22:12:50.131922 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 22:12:50.131922 n-d-860284-1 devstack@n-api.service[134101]: exception: Instance e616bb7a-3fab-411e-ab23-25d093c36691 could not be found. Oct 04 22:12:50.131922 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': 'e616bb7a-3fab-411e-ab23-25d093c36691'} Oct 04 22:12:50.131922 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:12:50.131922 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:12:50.131922 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:12:50.131922 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:12:50.131922 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:12:50.131922 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:12:50.131922 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:12:50.131922 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:12:50.131922 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:12:50.131922 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:12:50.131922 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e616bb7a-3fab-411e-ab23-25d093c36691 could not be found. Oct 04 22:12:50.131922 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:12:50.131922 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:12:50.131922 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:12:50.131922 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:12:50.131922 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:12:50.131922 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:12:50.131922 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:12:50.131922 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:12:50.131922 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:12:50.131922 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:12:50.131922 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 22:12:50.131922 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 22:12:50.131922 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 22:12:50.131922 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 22:12:50.131922 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:12:50.131922 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:12:50.131922 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:12:50.131922 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:12:50.135311 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e616bb7a-3fab-411e-ab23-25d093c36691 could not be found. Oct 04 22:12:50.135311 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:12:50.135311 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:12:50.135311 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:12:50.135311 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:12:50.135311 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:12:50.135311 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:12:50.135311 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:12:50.135311 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:12:50.135311 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e616bb7a-3fab-411e-ab23-25d093c36691 could not be found. Oct 04 22:12:50.135311 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:12:50.138613 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-0e928fd5-5d3e-4ecd-b579-cd2fadfc6ab7 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Returning 404 to user: Instance e616bb7a-3fab-411e-ab23-25d093c36691 could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:12:50.139874 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-0e928fd5-5d3e-4ecd-b579-cd2fadfc6ab7 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] 10.222.0.43 "DELETE /compute/v2.1/servers/e616bb7a-3fab-411e-ab23-25d093c36691" status: 404 len: 111 microversion: 2.1 time: 0.046884 Oct 04 22:12:50.140461 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2632/5325] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 22:12:50 2022] DELETE /compute/v2.1/servers/e616bb7a-3fab-411e-ab23-25d093c36691 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:12:50.149242 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-15359cb2-e757-410f-9abc-a34e2355efed tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:12:50.150329 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-15359cb2-e757-410f-9abc-a34e2355efed tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] [instance: e616bb7a-3fab-411e-ab23-25d093c36691] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:12:50.162169 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-15359cb2-e757-410f-9abc-a34e2355efed tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:50.163677 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-15359cb2-e757-410f-9abc-a34e2355efed tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:50.165209 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-15359cb2-e757-410f-9abc-a34e2355efed tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:50.166404 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-15359cb2-e757-410f-9abc-a34e2355efed tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:50.167124 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-15359cb2-e757-410f-9abc-a34e2355efed tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:50.170449 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-15359cb2-e757-410f-9abc-a34e2355efed tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:50.192923 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-15359cb2-e757-410f-9abc-a34e2355efed tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] HTTP exception thrown: Instance e616bb7a-3fab-411e-ab23-25d093c36691 could not be found. Oct 04 22:12:50.194824 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-15359cb2-e757-410f-9abc-a34e2355efed tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Request method failure captured: Oct 04 22:12:50.194824 n-d-860284-1 devstack@n-api.service[134102]: request: GET /compute/v2.1/servers/e616bb7a-3fab-411e-ab23-25d093c36691 HTTP/1.1 Oct 04 22:12:50.194824 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 22:12:50.194824 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 22:12:50.194824 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 22:12:50.194824 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 22:12:50.194824 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 22:12:50.194824 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 22:12:50.194824 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 22:12:50.194824 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 22:12:50.194824 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPK1_jKuDmdFTooG3vXwJSp1td0Kvvx-9VX1-OpwmBVV8uNR_MbJNU7EeI7sJdUoH3-0m3mmRBtTc-gLPN-qZ-RuZ8IL2TyG35svVe_hwPH0Z2c1BjkAMrt5beIkYsGbtm00-0XbqMbhJ5wgj-ztyQnhQ8ugDue3oDD_DUqnSWikZCg8 Oct 04 22:12:50.194824 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 22:12:50.194824 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 22:12:50.194824 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 22:12:50.194824 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 22:12:50.194824 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 22:12:50.194824 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 22:12:50.194824 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: 82e1a29234ce40f9b37d0eca196cd1db Oct 04 22:12:50.194824 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-AttachVolumeNegativeTest-2122228341 Oct 04 22:12:50.194824 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 22:12:50.194824 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 22:12:50.194824 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/82e1a29234ce40f9b37d0eca196cd1db"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_82e1a29234ce40f9b37d0eca196cd1db", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/82e1a29234ce40f9b37d0eca196cd1db"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/82e1a29234ce40f9b37d0eca196cd1db"}]}] Oct 04 22:12:50.194824 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-AttachVolumeNegativeTest-2122228341 Oct 04 22:12:50.194824 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: 82e1a29234ce40f9b37d0eca196cd1db Oct 04 22:12:50.194824 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2122228341 Oct 04 22:12:50.194824 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-AttachVolumeNegativeTest-2122228341-project Oct 04 22:12:50.194824 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 22:12:50.194824 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 22:12:50.194824 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: 80fc56886fef422b9b52eb1dede7d10e Oct 04 22:12:50.194824 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-AttachVolumeNegativeTest-2122228341-project Oct 04 22:12:50.194824 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 22:12:50.194824 n-d-860284-1 devstack@n-api.service[134102]: exception: Instance e616bb7a-3fab-411e-ab23-25d093c36691 could not be found. Oct 04 22:12:50.194824 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': 'e616bb7a-3fab-411e-ab23-25d093c36691'} Oct 04 22:12:50.194824 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:12:50.194824 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:12:50.194824 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:12:50.194824 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:12:50.194824 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:12:50.194824 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:12:50.194824 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:12:50.194824 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:12:50.194824 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:12:50.194824 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:12:50.194824 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e616bb7a-3fab-411e-ab23-25d093c36691 could not be found. Oct 04 22:12:50.194824 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:12:50.194824 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:12:50.194824 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:12:50.194824 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:12:50.194824 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:12:50.194824 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:12:50.194824 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:12:50.194824 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:12:50.194824 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:12:50.194824 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:12:50.194824 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:12:50.194824 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:12:50.194824 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:12:50.194824 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:12:50.194824 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:12:50.194824 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:12:50.194824 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e616bb7a-3fab-411e-ab23-25d093c36691 could not be found. Oct 04 22:12:50.194824 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:12:50.194824 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:12:50.194824 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:12:50.201884 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:12:50.201884 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:12:50.201884 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:12:50.201884 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:12:50.201884 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:12:50.201884 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e616bb7a-3fab-411e-ab23-25d093c36691 could not be found. Oct 04 22:12:50.201884 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:12:50.201884 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-15359cb2-e757-410f-9abc-a34e2355efed tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Returning 404 to user: Instance e616bb7a-3fab-411e-ab23-25d093c36691 could not be found. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:12:50.201884 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-15359cb2-e757-410f-9abc-a34e2355efed tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] 10.222.0.43 "GET /compute/v2.1/servers/e616bb7a-3fab-411e-ab23-25d093c36691" status: 404 len: 111 microversion: 2.1 time: 0.052202 Oct 04 22:12:50.201884 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2694/5326] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:12:50 2022] GET /compute/v2.1/servers/e616bb7a-3fab-411e-ab23-25d093c36691 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:12:50.206061 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-650623a9-cfb8-40ce-9656-81f6e93afbd9 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:12:50.206669 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-650623a9-cfb8-40ce-9656-81f6e93afbd9 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] [instance: 9fd64a5e-1e76-4841-bf99-37ab4d2ce55a] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:12:50.218514 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-650623a9-cfb8-40ce-9656-81f6e93afbd9 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:50.219031 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-650623a9-cfb8-40ce-9656-81f6e93afbd9 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:50.219605 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-650623a9-cfb8-40ce-9656-81f6e93afbd9 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:50.220336 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-650623a9-cfb8-40ce-9656-81f6e93afbd9 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:50.220798 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-650623a9-cfb8-40ce-9656-81f6e93afbd9 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:50.222052 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-650623a9-cfb8-40ce-9656-81f6e93afbd9 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:50.250590 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-650623a9-cfb8-40ce-9656-81f6e93afbd9 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] HTTP exception thrown: Instance 9fd64a5e-1e76-4841-bf99-37ab4d2ce55a could not be found. Oct 04 22:12:50.252542 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-650623a9-cfb8-40ce-9656-81f6e93afbd9 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Request method failure captured: Oct 04 22:12:50.252542 n-d-860284-1 devstack@n-api.service[134101]: request: DELETE /compute/v2.1/servers/9fd64a5e-1e76-4841-bf99-37ab4d2ce55a HTTP/1.1 Oct 04 22:12:50.252542 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 22:12:50.252542 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 22:12:50.252542 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 22:12:50.252542 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 22:12:50.252542 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 22:12:50.252542 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 22:12:50.252542 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 22:12:50.252542 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 22:12:50.252542 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPK1_jKuDmdFTooG3vXwJSp1td0Kvvx-9VX1-OpwmBVV8uNR_MbJNU7EeI7sJdUoH3-0m3mmRBtTc-gLPN-qZ-RuZ8IL2TyG35svVe_hwPH0Z2c1BjkAMrt5beIkYsGbtm00-0XbqMbhJ5wgj-ztyQnhQ8ugDue3oDD_DUqnSWikZCg8 Oct 04 22:12:50.252542 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 22:12:50.252542 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 22:12:50.252542 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 22:12:50.252542 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 22:12:50.252542 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 22:12:50.252542 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 22:12:50.252542 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: 82e1a29234ce40f9b37d0eca196cd1db Oct 04 22:12:50.252542 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-AttachVolumeNegativeTest-2122228341 Oct 04 22:12:50.252542 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 22:12:50.252542 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 22:12:50.252542 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/82e1a29234ce40f9b37d0eca196cd1db"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_82e1a29234ce40f9b37d0eca196cd1db", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/82e1a29234ce40f9b37d0eca196cd1db"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/82e1a29234ce40f9b37d0eca196cd1db"}]}] Oct 04 22:12:50.252542 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-AttachVolumeNegativeTest-2122228341 Oct 04 22:12:50.252542 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: 82e1a29234ce40f9b37d0eca196cd1db Oct 04 22:12:50.252542 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2122228341 Oct 04 22:12:50.252542 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-AttachVolumeNegativeTest-2122228341-project Oct 04 22:12:50.252542 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 22:12:50.252542 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 22:12:50.252542 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 80fc56886fef422b9b52eb1dede7d10e Oct 04 22:12:50.252542 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-AttachVolumeNegativeTest-2122228341-project Oct 04 22:12:50.252542 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 22:12:50.252542 n-d-860284-1 devstack@n-api.service[134101]: exception: Instance 9fd64a5e-1e76-4841-bf99-37ab4d2ce55a could not be found. Oct 04 22:12:50.252542 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': '9fd64a5e-1e76-4841-bf99-37ab4d2ce55a'} Oct 04 22:12:50.252542 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:12:50.252542 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:12:50.252542 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:12:50.252542 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:12:50.252542 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:12:50.252542 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:12:50.252542 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:12:50.252542 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:12:50.252542 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:12:50.252542 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:12:50.252542 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9fd64a5e-1e76-4841-bf99-37ab4d2ce55a could not be found. Oct 04 22:12:50.252542 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:12:50.252542 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:12:50.252542 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:12:50.252542 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:12:50.252542 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:12:50.252542 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:12:50.252542 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:12:50.252542 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:12:50.252542 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:12:50.252542 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:12:50.252542 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 22:12:50.252542 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 22:12:50.252542 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 22:12:50.252542 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 22:12:50.252542 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:12:50.252542 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:12:50.252542 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:12:50.252542 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:12:50.256279 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9fd64a5e-1e76-4841-bf99-37ab4d2ce55a could not be found. Oct 04 22:12:50.256279 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:12:50.256279 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:12:50.256279 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:12:50.256279 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:12:50.256279 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:12:50.256279 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:12:50.256279 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:12:50.256279 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:12:50.256279 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9fd64a5e-1e76-4841-bf99-37ab4d2ce55a could not be found. Oct 04 22:12:50.256279 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:12:50.256279 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-650623a9-cfb8-40ce-9656-81f6e93afbd9 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Returning 404 to user: Instance 9fd64a5e-1e76-4841-bf99-37ab4d2ce55a could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:12:50.256279 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-650623a9-cfb8-40ce-9656-81f6e93afbd9 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] 10.222.0.43 "DELETE /compute/v2.1/servers/9fd64a5e-1e76-4841-bf99-37ab4d2ce55a" status: 404 len: 111 microversion: 2.1 time: 0.051825 Oct 04 22:12:50.257845 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2633/5327] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 22:12:50 2022] DELETE /compute/v2.1/servers/9fd64a5e-1e76-4841-bf99-37ab4d2ce55a => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:12:50.262680 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-c1fa224a-5466-4bae-b381-d5bc2b182900 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:12:50.263304 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-c1fa224a-5466-4bae-b381-d5bc2b182900 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] [instance: 9fd64a5e-1e76-4841-bf99-37ab4d2ce55a] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:12:50.277475 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c1fa224a-5466-4bae-b381-d5bc2b182900 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:50.278011 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c1fa224a-5466-4bae-b381-d5bc2b182900 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:50.278474 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c1fa224a-5466-4bae-b381-d5bc2b182900 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:50.279190 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c1fa224a-5466-4bae-b381-d5bc2b182900 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:50.280422 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c1fa224a-5466-4bae-b381-d5bc2b182900 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:50.280859 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c1fa224a-5466-4bae-b381-d5bc2b182900 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:50.301750 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-c1fa224a-5466-4bae-b381-d5bc2b182900 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] HTTP exception thrown: Instance 9fd64a5e-1e76-4841-bf99-37ab4d2ce55a could not be found. Oct 04 22:12:50.304970 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-c1fa224a-5466-4bae-b381-d5bc2b182900 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Request method failure captured: Oct 04 22:12:50.304970 n-d-860284-1 devstack@n-api.service[134102]: request: GET /compute/v2.1/servers/9fd64a5e-1e76-4841-bf99-37ab4d2ce55a HTTP/1.1 Oct 04 22:12:50.304970 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 22:12:50.304970 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 22:12:50.304970 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 22:12:50.304970 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 22:12:50.304970 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 22:12:50.304970 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 22:12:50.304970 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 22:12:50.304970 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 22:12:50.304970 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPK1_jKuDmdFTooG3vXwJSp1td0Kvvx-9VX1-OpwmBVV8uNR_MbJNU7EeI7sJdUoH3-0m3mmRBtTc-gLPN-qZ-RuZ8IL2TyG35svVe_hwPH0Z2c1BjkAMrt5beIkYsGbtm00-0XbqMbhJ5wgj-ztyQnhQ8ugDue3oDD_DUqnSWikZCg8 Oct 04 22:12:50.304970 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 22:12:50.304970 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 22:12:50.304970 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 22:12:50.304970 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 22:12:50.304970 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 22:12:50.304970 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 22:12:50.304970 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: 82e1a29234ce40f9b37d0eca196cd1db Oct 04 22:12:50.304970 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-AttachVolumeNegativeTest-2122228341 Oct 04 22:12:50.304970 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 22:12:50.304970 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 22:12:50.304970 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/82e1a29234ce40f9b37d0eca196cd1db"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_82e1a29234ce40f9b37d0eca196cd1db", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/82e1a29234ce40f9b37d0eca196cd1db"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/82e1a29234ce40f9b37d0eca196cd1db"}]}] Oct 04 22:12:50.304970 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-AttachVolumeNegativeTest-2122228341 Oct 04 22:12:50.304970 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: 82e1a29234ce40f9b37d0eca196cd1db Oct 04 22:12:50.304970 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2122228341 Oct 04 22:12:50.304970 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-AttachVolumeNegativeTest-2122228341-project Oct 04 22:12:50.304970 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 22:12:50.304970 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 22:12:50.304970 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: 80fc56886fef422b9b52eb1dede7d10e Oct 04 22:12:50.304970 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-AttachVolumeNegativeTest-2122228341-project Oct 04 22:12:50.304970 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 22:12:50.304970 n-d-860284-1 devstack@n-api.service[134102]: exception: Instance 9fd64a5e-1e76-4841-bf99-37ab4d2ce55a could not be found. Oct 04 22:12:50.304970 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': '9fd64a5e-1e76-4841-bf99-37ab4d2ce55a'} Oct 04 22:12:50.304970 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:12:50.304970 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:12:50.304970 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:12:50.304970 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:12:50.304970 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:12:50.304970 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:12:50.304970 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:12:50.304970 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:12:50.304970 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:12:50.304970 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:12:50.304970 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9fd64a5e-1e76-4841-bf99-37ab4d2ce55a could not be found. Oct 04 22:12:50.304970 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:12:50.304970 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:12:50.304970 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:12:50.304970 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:12:50.304970 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:12:50.304970 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:12:50.304970 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:12:50.304970 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:12:50.304970 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:12:50.304970 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:12:50.304970 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:12:50.304970 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:12:50.304970 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:12:50.304970 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:12:50.304970 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:12:50.304970 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:12:50.304970 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9fd64a5e-1e76-4841-bf99-37ab4d2ce55a could not be found. Oct 04 22:12:50.304970 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:12:50.304970 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:12:50.304970 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:12:50.310883 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:12:50.310883 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:12:50.310883 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:12:50.310883 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:12:50.310883 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:12:50.310883 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9fd64a5e-1e76-4841-bf99-37ab4d2ce55a could not be found. Oct 04 22:12:50.310883 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:12:50.314874 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-c1fa224a-5466-4bae-b381-d5bc2b182900 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Returning 404 to user: Instance 9fd64a5e-1e76-4841-bf99-37ab4d2ce55a could not be found. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:12:50.314874 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-c1fa224a-5466-4bae-b381-d5bc2b182900 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] 10.222.0.43 "GET /compute/v2.1/servers/9fd64a5e-1e76-4841-bf99-37ab4d2ce55a" status: 404 len: 111 microversion: 2.1 time: 0.055853 Oct 04 22:12:50.318781 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2695/5328] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:12:50 2022] GET /compute/v2.1/servers/9fd64a5e-1e76-4841-bf99-37ab4d2ce55a => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 22:12:50.675650 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-ae4441ee-e34e-4143-a990-91f0004132c4 tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:12:50.676594 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-ae4441ee-e34e-4143-a990-91f0004132c4 tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] [instance: 50de5c85-3929-42cb-86b5-7ed97706e579] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:12:50.695313 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ae4441ee-e34e-4143-a990-91f0004132c4 tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:50.698107 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ae4441ee-e34e-4143-a990-91f0004132c4 tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:50.698911 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ae4441ee-e34e-4143-a990-91f0004132c4 tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:50.702068 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ae4441ee-e34e-4143-a990-91f0004132c4 tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:50.703212 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ae4441ee-e34e-4143-a990-91f0004132c4 tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:50.705121 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ae4441ee-e34e-4143-a990-91f0004132c4 tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:50.973269 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-ae4441ee-e34e-4143-a990-91f0004132c4 tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '558a2667b8994bf4acb2a797ff091f31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32b18f49935d4c02bfcc189bdc56f259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:12:50.988643 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-ae4441ee-e34e-4143-a990-91f0004132c4 tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] 10.222.0.43 "GET /compute/v2.1/servers/50de5c85-3929-42cb-86b5-7ed97706e579" status: 200 len: 1328 microversion: 2.1 time: 0.317086 Oct 04 22:12:50.990602 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2634/5329] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:12:50 2022] GET /compute/v2.1/servers/50de5c85-3929-42cb-86b5-7ed97706e579 => generated 1328 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:12:52.014116 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-20fb2965-409e-4e92-9f9c-9793681e15b9 tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:12:52.014922 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-20fb2965-409e-4e92-9f9c-9793681e15b9 tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] [instance: 50de5c85-3929-42cb-86b5-7ed97706e579] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:12:52.022578 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell0:SELECT=2 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:12:52.024695 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-20fb2965-409e-4e92-9f9c-9793681e15b9 tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:52.025396 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-20fb2965-409e-4e92-9f9c-9793681e15b9 tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:52.025836 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-20fb2965-409e-4e92-9f9c-9793681e15b9 tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:52.026833 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-20fb2965-409e-4e92-9f9c-9793681e15b9 tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:52.027302 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-20fb2965-409e-4e92-9f9c-9793681e15b9 tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:52.027773 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-20fb2965-409e-4e92-9f9c-9793681e15b9 tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:52.057443 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:12:52.213236 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-20fb2965-409e-4e92-9f9c-9793681e15b9 tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '558a2667b8994bf4acb2a797ff091f31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32b18f49935d4c02bfcc189bdc56f259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:12:52.222181 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-20fb2965-409e-4e92-9f9c-9793681e15b9 tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] 10.222.0.43 "GET /compute/v2.1/servers/50de5c85-3929-42cb-86b5-7ed97706e579" status: 200 len: 1328 microversion: 2.1 time: 0.212805 Oct 04 22:12:52.226475 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2696/5330] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:12:52 2022] GET /compute/v2.1/servers/50de5c85-3929-42cb-86b5-7ed97706e579 => generated 1328 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:12:53.246285 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-728d00d7-0c8e-46d7-bfae-cd87952a6528 tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:12:53.247740 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-728d00d7-0c8e-46d7-bfae-cd87952a6528 tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] [instance: 50de5c85-3929-42cb-86b5-7ed97706e579] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:12:53.250767 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=2 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:12:53.251464 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=6 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:12:53.256689 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-728d00d7-0c8e-46d7-bfae-cd87952a6528 tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:53.257201 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-728d00d7-0c8e-46d7-bfae-cd87952a6528 tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:53.257643 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-728d00d7-0c8e-46d7-bfae-cd87952a6528 tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:53.258407 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-728d00d7-0c8e-46d7-bfae-cd87952a6528 tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:53.258879 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-728d00d7-0c8e-46d7-bfae-cd87952a6528 tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:53.259317 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-728d00d7-0c8e-46d7-bfae-cd87952a6528 tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:53.402550 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-728d00d7-0c8e-46d7-bfae-cd87952a6528 tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '558a2667b8994bf4acb2a797ff091f31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32b18f49935d4c02bfcc189bdc56f259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:12:53.412245 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-728d00d7-0c8e-46d7-bfae-cd87952a6528 tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] 10.222.0.43 "GET /compute/v2.1/servers/50de5c85-3929-42cb-86b5-7ed97706e579" status: 200 len: 1328 microversion: 2.1 time: 0.169833 Oct 04 22:12:53.413164 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2635/5331] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:12:53 2022] GET /compute/v2.1/servers/50de5c85-3929-42cb-86b5-7ed97706e579 => generated 1328 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:12:53.996145 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-6fc40001-037d-4be5-8f74-8088d9807e27 req-a6862b89-04d3-420e-bb63-57080c808612 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50de5c85-3929-42cb-86b5-7ed97706e579", "name": "network-vif-plugged", "status": "completed", "tag": "f7f6c5f7-dda1-4cf9-bd3d-c6b01c729e41"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:12:54.019658 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-6fc40001-037d-4be5-8f74-8088d9807e27 req-a6862b89-04d3-420e-bb63-57080c808612 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:54.020381 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-6fc40001-037d-4be5-8f74-8088d9807e27 req-a6862b89-04d3-420e-bb63-57080c808612 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:54.021543 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-6fc40001-037d-4be5-8f74-8088d9807e27 req-a6862b89-04d3-420e-bb63-57080c808612 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:54.054622 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-6fc40001-037d-4be5-8f74-8088d9807e27 req-a6862b89-04d3-420e-bb63-57080c808612 service nova] Creating event network-vif-plugged:f7f6c5f7-dda1-4cf9-bd3d-c6b01c729e41 for instance 50de5c85-3929-42cb-86b5-7ed97706e579 on n-h2-860284-1 Oct 04 22:12:54.059057 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-6fc40001-037d-4be5-8f74-8088d9807e27 req-a6862b89-04d3-420e-bb63-57080c808612 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067467 Oct 04 22:12:54.060323 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2697/5332] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:12:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:12:54.437957 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-21328c35-5991-4565-ac99-529732b2cd4f tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:12:54.438757 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-21328c35-5991-4565-ac99-529732b2cd4f tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] [instance: 50de5c85-3929-42cb-86b5-7ed97706e579] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:12:54.447500 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-21328c35-5991-4565-ac99-529732b2cd4f tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:54.447999 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-21328c35-5991-4565-ac99-529732b2cd4f tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:54.448582 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-21328c35-5991-4565-ac99-529732b2cd4f tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:54.450844 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-21328c35-5991-4565-ac99-529732b2cd4f tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:54.452039 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-21328c35-5991-4565-ac99-529732b2cd4f tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:54.452529 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-21328c35-5991-4565-ac99-529732b2cd4f tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:54.715830 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-21328c35-5991-4565-ac99-529732b2cd4f tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '558a2667b8994bf4acb2a797ff091f31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32b18f49935d4c02bfcc189bdc56f259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:12:54.725980 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-21328c35-5991-4565-ac99-529732b2cd4f tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] 10.222.0.43 "GET /compute/v2.1/servers/50de5c85-3929-42cb-86b5-7ed97706e579" status: 200 len: 1328 microversion: 2.1 time: 0.293710 Oct 04 22:12:54.728368 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2636/5333] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:12:54 2022] GET /compute/v2.1/servers/50de5c85-3929-42cb-86b5-7ed97706e579 => generated 1328 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:12:54.796567 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-2b31bde6-8892-45b4-9b27-6c1088fc4522 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:12:54.797258 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-2b31bde6-8892-45b4-9b27-6c1088fc4522 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] [instance: 1475392a-475f-414f-803c-e89c9ae1844a] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:12:54.804516 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2b31bde6-8892-45b4-9b27-6c1088fc4522 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:54.805454 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2b31bde6-8892-45b4-9b27-6c1088fc4522 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:54.806183 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2b31bde6-8892-45b4-9b27-6c1088fc4522 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:54.807190 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2b31bde6-8892-45b4-9b27-6c1088fc4522 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:54.807888 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2b31bde6-8892-45b4-9b27-6c1088fc4522 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:54.808671 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2b31bde6-8892-45b4-9b27-6c1088fc4522 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:54.829480 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-2b31bde6-8892-45b4-9b27-6c1088fc4522 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] HTTP exception thrown: Instance 1475392a-475f-414f-803c-e89c9ae1844a could not be found. Oct 04 22:12:54.831971 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-2b31bde6-8892-45b4-9b27-6c1088fc4522 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Request method failure captured: Oct 04 22:12:54.831971 n-d-860284-1 devstack@n-api.service[134102]: request: DELETE /compute/v2.1/servers/1475392a-475f-414f-803c-e89c9ae1844a HTTP/1.1 Oct 04 22:12:54.831971 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 22:12:54.831971 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 22:12:54.831971 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 22:12:54.831971 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 22:12:54.831971 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 22:12:54.831971 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 22:12:54.831971 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 22:12:54.831971 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 22:12:54.831971 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPK1_jKuDmdFTooG3vXwJSp1td0Kvvx-9VX1-OpwmBVV8uNR_MbJNU7EeI7sJdUoH3-0m3mmRBtTc-gLPN-qZ-RuZ8IL2TyG35svVe_hwPH0Z2c1BjkAMrt5beIkYsGbtm00-0XbqMbhJ5wgj-ztyQnhQ8ugDue3oDD_DUqnSWikZCg8 Oct 04 22:12:54.831971 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 22:12:54.831971 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 22:12:54.831971 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 22:12:54.831971 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 22:12:54.831971 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 22:12:54.831971 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 22:12:54.831971 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: 82e1a29234ce40f9b37d0eca196cd1db Oct 04 22:12:54.831971 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-AttachVolumeNegativeTest-2122228341 Oct 04 22:12:54.831971 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 22:12:54.831971 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 22:12:54.831971 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/82e1a29234ce40f9b37d0eca196cd1db"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_82e1a29234ce40f9b37d0eca196cd1db", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/82e1a29234ce40f9b37d0eca196cd1db"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/82e1a29234ce40f9b37d0eca196cd1db"}]}] Oct 04 22:12:54.831971 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-AttachVolumeNegativeTest-2122228341 Oct 04 22:12:54.831971 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: 82e1a29234ce40f9b37d0eca196cd1db Oct 04 22:12:54.831971 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2122228341 Oct 04 22:12:54.831971 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-AttachVolumeNegativeTest-2122228341-project Oct 04 22:12:54.831971 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 22:12:54.831971 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 22:12:54.831971 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: 80fc56886fef422b9b52eb1dede7d10e Oct 04 22:12:54.831971 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-AttachVolumeNegativeTest-2122228341-project Oct 04 22:12:54.831971 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 22:12:54.831971 n-d-860284-1 devstack@n-api.service[134102]: exception: Instance 1475392a-475f-414f-803c-e89c9ae1844a could not be found. Oct 04 22:12:54.831971 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': '1475392a-475f-414f-803c-e89c9ae1844a'} Oct 04 22:12:54.831971 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:12:54.831971 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:12:54.831971 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:12:54.831971 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:12:54.831971 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:12:54.831971 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:12:54.831971 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:12:54.831971 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:12:54.831971 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:12:54.831971 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:12:54.831971 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1475392a-475f-414f-803c-e89c9ae1844a could not be found. Oct 04 22:12:54.831971 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:12:54.831971 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:12:54.831971 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:12:54.831971 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:12:54.831971 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:12:54.831971 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:12:54.831971 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:12:54.831971 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:12:54.831971 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:12:54.831971 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:12:54.831971 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 22:12:54.831971 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 22:12:54.831971 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 22:12:54.831971 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 22:12:54.831971 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:12:54.831971 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:12:54.831971 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:12:54.831971 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:12:54.835602 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1475392a-475f-414f-803c-e89c9ae1844a could not be found. Oct 04 22:12:54.835602 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:12:54.835602 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:12:54.835602 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:12:54.835602 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:12:54.835602 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:12:54.835602 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:12:54.835602 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:12:54.835602 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:12:54.835602 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1475392a-475f-414f-803c-e89c9ae1844a could not be found. Oct 04 22:12:54.835602 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:12:54.837940 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-2b31bde6-8892-45b4-9b27-6c1088fc4522 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Returning 404 to user: Instance 1475392a-475f-414f-803c-e89c9ae1844a could not be found. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:12:54.839807 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-2b31bde6-8892-45b4-9b27-6c1088fc4522 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] 10.222.0.43 "DELETE /compute/v2.1/servers/1475392a-475f-414f-803c-e89c9ae1844a" status: 404 len: 111 microversion: 2.1 time: 0.048399 Oct 04 22:12:54.842460 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2698/5334] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 22:12:54 2022] DELETE /compute/v2.1/servers/1475392a-475f-414f-803c-e89c9ae1844a => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:12:54.850709 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-d3e13fd9-d99c-48aa-896d-aa4c4cad3037 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:12:54.851945 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-d3e13fd9-d99c-48aa-896d-aa4c4cad3037 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] [instance: 1475392a-475f-414f-803c-e89c9ae1844a] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:12:54.858513 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d3e13fd9-d99c-48aa-896d-aa4c4cad3037 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:54.859779 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d3e13fd9-d99c-48aa-896d-aa4c4cad3037 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:54.860465 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d3e13fd9-d99c-48aa-896d-aa4c4cad3037 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:54.861791 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d3e13fd9-d99c-48aa-896d-aa4c4cad3037 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:54.862491 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d3e13fd9-d99c-48aa-896d-aa4c4cad3037 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:54.863153 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d3e13fd9-d99c-48aa-896d-aa4c4cad3037 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:54.882966 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-d3e13fd9-d99c-48aa-896d-aa4c4cad3037 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] HTTP exception thrown: Instance 1475392a-475f-414f-803c-e89c9ae1844a could not be found. Oct 04 22:12:54.885018 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-d3e13fd9-d99c-48aa-896d-aa4c4cad3037 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Request method failure captured: Oct 04 22:12:54.885018 n-d-860284-1 devstack@n-api.service[134101]: request: GET /compute/v2.1/servers/1475392a-475f-414f-803c-e89c9ae1844a HTTP/1.1 Oct 04 22:12:54.885018 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 22:12:54.885018 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 22:12:54.885018 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 22:12:54.885018 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 22:12:54.885018 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 22:12:54.885018 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 22:12:54.885018 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 22:12:54.885018 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 22:12:54.885018 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPK1_jKuDmdFTooG3vXwJSp1td0Kvvx-9VX1-OpwmBVV8uNR_MbJNU7EeI7sJdUoH3-0m3mmRBtTc-gLPN-qZ-RuZ8IL2TyG35svVe_hwPH0Z2c1BjkAMrt5beIkYsGbtm00-0XbqMbhJ5wgj-ztyQnhQ8ugDue3oDD_DUqnSWikZCg8 Oct 04 22:12:54.885018 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 22:12:54.885018 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 22:12:54.885018 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 22:12:54.885018 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 22:12:54.885018 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 22:12:54.885018 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 22:12:54.885018 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: 82e1a29234ce40f9b37d0eca196cd1db Oct 04 22:12:54.885018 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-AttachVolumeNegativeTest-2122228341 Oct 04 22:12:54.885018 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 22:12:54.885018 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 22:12:54.885018 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/82e1a29234ce40f9b37d0eca196cd1db"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_82e1a29234ce40f9b37d0eca196cd1db", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/82e1a29234ce40f9b37d0eca196cd1db"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/82e1a29234ce40f9b37d0eca196cd1db"}]}] Oct 04 22:12:54.885018 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-AttachVolumeNegativeTest-2122228341 Oct 04 22:12:54.885018 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: 82e1a29234ce40f9b37d0eca196cd1db Oct 04 22:12:54.885018 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2122228341 Oct 04 22:12:54.885018 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-AttachVolumeNegativeTest-2122228341-project Oct 04 22:12:54.885018 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 22:12:54.885018 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 22:12:54.885018 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 80fc56886fef422b9b52eb1dede7d10e Oct 04 22:12:54.885018 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-AttachVolumeNegativeTest-2122228341-project Oct 04 22:12:54.885018 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 22:12:54.885018 n-d-860284-1 devstack@n-api.service[134101]: exception: Instance 1475392a-475f-414f-803c-e89c9ae1844a could not be found. Oct 04 22:12:54.885018 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': '1475392a-475f-414f-803c-e89c9ae1844a'} Oct 04 22:12:54.885018 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:12:54.885018 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:12:54.885018 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:12:54.885018 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:12:54.885018 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:12:54.885018 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:12:54.885018 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:12:54.885018 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:12:54.885018 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:12:54.885018 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:12:54.885018 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1475392a-475f-414f-803c-e89c9ae1844a could not be found. Oct 04 22:12:54.885018 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:12:54.885018 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:12:54.885018 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:12:54.885018 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:12:54.885018 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:12:54.885018 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:12:54.885018 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:12:54.885018 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:12:54.885018 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:12:54.885018 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:12:54.885018 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:12:54.885018 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:12:54.885018 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:12:54.885018 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:12:54.885018 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:12:54.885018 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:12:54.885018 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1475392a-475f-414f-803c-e89c9ae1844a could not be found. Oct 04 22:12:54.885018 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:12:54.885018 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:12:54.885018 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:12:54.889666 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:12:54.889666 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:12:54.889666 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:12:54.889666 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:12:54.889666 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:12:54.889666 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1475392a-475f-414f-803c-e89c9ae1844a could not be found. Oct 04 22:12:54.889666 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:12:54.893070 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-d3e13fd9-d99c-48aa-896d-aa4c4cad3037 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] Returning 404 to user: Instance 1475392a-475f-414f-803c-e89c9ae1844a could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:12:54.894509 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-d3e13fd9-d99c-48aa-896d-aa4c4cad3037 tempest-AttachVolumeNegativeTest-2122228341 tempest-AttachVolumeNegativeTest-2122228341-project] 10.222.0.43 "GET /compute/v2.1/servers/1475392a-475f-414f-803c-e89c9ae1844a" status: 404 len: 111 microversion: 2.1 time: 0.048262 Oct 04 22:12:54.895831 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2637/5335] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:12:54 2022] GET /compute/v2.1/servers/1475392a-475f-414f-803c-e89c9ae1844a => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:12:55.758301 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-913328bf-29ae-4383-9b7c-8b51e6059dab tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:12:55.762335 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-913328bf-29ae-4383-9b7c-8b51e6059dab tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] [instance: 50de5c85-3929-42cb-86b5-7ed97706e579] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:12:55.777658 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-913328bf-29ae-4383-9b7c-8b51e6059dab tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:55.778330 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-913328bf-29ae-4383-9b7c-8b51e6059dab tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:55.779018 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-913328bf-29ae-4383-9b7c-8b51e6059dab tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:55.779945 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-913328bf-29ae-4383-9b7c-8b51e6059dab tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:55.780549 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-913328bf-29ae-4383-9b7c-8b51e6059dab tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:55.781249 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-913328bf-29ae-4383-9b7c-8b51e6059dab tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:55.970191 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-913328bf-29ae-4383-9b7c-8b51e6059dab tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '558a2667b8994bf4acb2a797ff091f31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32b18f49935d4c02bfcc189bdc56f259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:12:55.978508 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-913328bf-29ae-4383-9b7c-8b51e6059dab tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] 10.222.0.43 "GET /compute/v2.1/servers/50de5c85-3929-42cb-86b5-7ed97706e579" status: 200 len: 1328 microversion: 2.1 time: 0.224091 Oct 04 22:12:55.979064 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2699/5336] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:12:55 2022] GET /compute/v2.1/servers/50de5c85-3929-42cb-86b5-7ed97706e579 => generated 1328 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:12:57.003147 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-14f72cca-a3d7-482e-8c16-0c00e061576d tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:12:57.004391 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-14f72cca-a3d7-482e-8c16-0c00e061576d tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] [instance: 50de5c85-3929-42cb-86b5-7ed97706e579] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:12:57.012107 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-14f72cca-a3d7-482e-8c16-0c00e061576d tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:57.012857 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-14f72cca-a3d7-482e-8c16-0c00e061576d tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:57.013496 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-14f72cca-a3d7-482e-8c16-0c00e061576d tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:57.014397 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-14f72cca-a3d7-482e-8c16-0c00e061576d tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:57.015013 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-14f72cca-a3d7-482e-8c16-0c00e061576d tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:57.015591 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-14f72cca-a3d7-482e-8c16-0c00e061576d tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:57.263346 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-14f72cca-a3d7-482e-8c16-0c00e061576d tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '558a2667b8994bf4acb2a797ff091f31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32b18f49935d4c02bfcc189bdc56f259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:12:57.271402 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-14f72cca-a3d7-482e-8c16-0c00e061576d tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] 10.222.0.43 "GET /compute/v2.1/servers/50de5c85-3929-42cb-86b5-7ed97706e579" status: 200 len: 1528 microversion: 2.1 time: 0.272060 Oct 04 22:12:57.287223 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2638/5337] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:12:56 2022] GET /compute/v2.1/servers/50de5c85-3929-42cb-86b5-7ed97706e579 => generated 1528 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:12:57.297289 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-443fd01e-5e3a-4c11-9c98-628433aa836b tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:12:57.298165 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-443fd01e-5e3a-4c11-9c98-628433aa836b tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] [instance: 50de5c85-3929-42cb-86b5-7ed97706e579] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:12:57.304891 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-443fd01e-5e3a-4c11-9c98-628433aa836b tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:57.305381 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-443fd01e-5e3a-4c11-9c98-628433aa836b tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:57.305874 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-443fd01e-5e3a-4c11-9c98-628433aa836b tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:57.306616 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-443fd01e-5e3a-4c11-9c98-628433aa836b tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:57.307071 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-443fd01e-5e3a-4c11-9c98-628433aa836b tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:57.307496 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-443fd01e-5e3a-4c11-9c98-628433aa836b tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:57.532509 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-443fd01e-5e3a-4c11-9c98-628433aa836b tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '558a2667b8994bf4acb2a797ff091f31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32b18f49935d4c02bfcc189bdc56f259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:12:57.554808 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-443fd01e-5e3a-4c11-9c98-628433aa836b tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] 10.222.0.43 "GET /compute/v2.1/servers/50de5c85-3929-42cb-86b5-7ed97706e579" status: 200 len: 1528 microversion: 2.1 time: 0.262603 Oct 04 22:12:57.563142 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2700/5338] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:12:57 2022] GET /compute/v2.1/servers/50de5c85-3929-42cb-86b5-7ed97706e579 => generated 1528 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:12:57.826840 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-c8cbf260-fdf1-4999-8ecf-71079dddff5d tempest-ServersNegativeTestMultiTenantJSON-135068080 tempest-ServersNegativeTestMultiTenantJSON-135068080-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:12:57.827590 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-c8cbf260-fdf1-4999-8ecf-71079dddff5d tempest-ServersNegativeTestMultiTenantJSON-135068080 tempest-ServersNegativeTestMultiTenantJSON-135068080-project] [instance: 50de5c85-3929-42cb-86b5-7ed97706e579] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:12:57.833759 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c8cbf260-fdf1-4999-8ecf-71079dddff5d tempest-ServersNegativeTestMultiTenantJSON-135068080 tempest-ServersNegativeTestMultiTenantJSON-135068080-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:57.834572 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c8cbf260-fdf1-4999-8ecf-71079dddff5d tempest-ServersNegativeTestMultiTenantJSON-135068080 tempest-ServersNegativeTestMultiTenantJSON-135068080-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:57.835076 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c8cbf260-fdf1-4999-8ecf-71079dddff5d tempest-ServersNegativeTestMultiTenantJSON-135068080 tempest-ServersNegativeTestMultiTenantJSON-135068080-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:57.836000 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c8cbf260-fdf1-4999-8ecf-71079dddff5d tempest-ServersNegativeTestMultiTenantJSON-135068080 tempest-ServersNegativeTestMultiTenantJSON-135068080-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:57.836559 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c8cbf260-fdf1-4999-8ecf-71079dddff5d tempest-ServersNegativeTestMultiTenantJSON-135068080 tempest-ServersNegativeTestMultiTenantJSON-135068080-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:57.837071 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c8cbf260-fdf1-4999-8ecf-71079dddff5d tempest-ServersNegativeTestMultiTenantJSON-135068080 tempest-ServersNegativeTestMultiTenantJSON-135068080-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:57.853493 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-c8cbf260-fdf1-4999-8ecf-71079dddff5d tempest-ServersNegativeTestMultiTenantJSON-135068080 tempest-ServersNegativeTestMultiTenantJSON-135068080-project] HTTP exception thrown: Instance 50de5c85-3929-42cb-86b5-7ed97706e579 could not be found. Oct 04 22:12:57.855436 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-c8cbf260-fdf1-4999-8ecf-71079dddff5d tempest-ServersNegativeTestMultiTenantJSON-135068080 tempest-ServersNegativeTestMultiTenantJSON-135068080-project] Request method failure captured: Oct 04 22:12:57.855436 n-d-860284-1 devstack@n-api.service[134101]: request: DELETE /compute/v2.1/servers/50de5c85-3929-42cb-86b5-7ed97706e579 HTTP/1.1 Oct 04 22:12:57.855436 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 22:12:57.855436 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 22:12:57.855436 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 22:12:57.855436 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 22:12:57.855436 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 22:12:57.855436 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 22:12:57.855436 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 22:12:57.855436 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 22:12:57.855436 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPK_YetnL6i8BaDzIQJy8cxqlPGqpaVXxmFA8s7lZ7rWFXRQa8LIQAqT3Fq6WJkK4spygaCDgAgmZ96lyXee9a7QHxSDhsW0R9exOEbqbQ6xZV_My4axNPpjfrh6v8Vbp5XWeT1jTRRKdXvhG6Hoif3UUxKKfvE1eEZWAw4z6vanpfB4 Oct 04 22:12:57.855436 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 22:12:57.855436 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 22:12:57.855436 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 22:12:57.855436 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 22:12:57.855436 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 22:12:57.855436 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 22:12:57.855436 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: a29fe45b014845a6aa942bb1a4bbf78a Oct 04 22:12:57.855436 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-135068080 Oct 04 22:12:57.855436 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 22:12:57.855436 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 22:12:57.855436 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a29fe45b014845a6aa942bb1a4bbf78a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_a29fe45b014845a6aa942bb1a4bbf78a", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a29fe45b014845a6aa942bb1a4bbf78a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/a29fe45b014845a6aa942bb1a4bbf78a"}]}] Oct 04 22:12:57.855436 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-135068080 Oct 04 22:12:57.855436 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: a29fe45b014845a6aa942bb1a4bbf78a Oct 04 22:12:57.855436 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-135068080 Oct 04 22:12:57.855436 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-ServersNegativeTestMultiTenantJSON-135068080-project Oct 04 22:12:57.855436 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 22:12:57.855436 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 22:12:57.855436 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 1bc909ebc1f34f50b5e8525b2c7c0855 Oct 04 22:12:57.855436 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-135068080-project Oct 04 22:12:57.855436 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 22:12:57.855436 n-d-860284-1 devstack@n-api.service[134101]: exception: Instance 50de5c85-3929-42cb-86b5-7ed97706e579 could not be found. Oct 04 22:12:57.855436 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': '50de5c85-3929-42cb-86b5-7ed97706e579'} Oct 04 22:12:57.855436 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:12:57.855436 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:12:57.855436 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:12:57.855436 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:12:57.855436 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:12:57.855436 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:12:57.855436 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:12:57.855436 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:12:57.855436 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:12:57.855436 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:12:57.855436 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50de5c85-3929-42cb-86b5-7ed97706e579 could not be found. Oct 04 22:12:57.855436 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:12:57.855436 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:12:57.855436 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:12:57.855436 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:12:57.855436 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:12:57.855436 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:12:57.855436 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:12:57.855436 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:12:57.855436 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:12:57.855436 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:12:57.855436 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 22:12:57.855436 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 22:12:57.855436 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 22:12:57.855436 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 22:12:57.855436 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:12:57.855436 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:12:57.855436 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:12:57.855436 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:12:57.858832 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50de5c85-3929-42cb-86b5-7ed97706e579 could not be found. Oct 04 22:12:57.858832 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:12:57.858832 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:12:57.858832 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:12:57.858832 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:12:57.858832 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:12:57.858832 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:12:57.858832 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:12:57.858832 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:12:57.858832 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50de5c85-3929-42cb-86b5-7ed97706e579 could not be found. Oct 04 22:12:57.858832 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:12:57.860497 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-c8cbf260-fdf1-4999-8ecf-71079dddff5d tempest-ServersNegativeTestMultiTenantJSON-135068080 tempest-ServersNegativeTestMultiTenantJSON-135068080-project] Returning 404 to user: Instance 50de5c85-3929-42cb-86b5-7ed97706e579 could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:12:57.861509 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-c8cbf260-fdf1-4999-8ecf-71079dddff5d tempest-ServersNegativeTestMultiTenantJSON-135068080 tempest-ServersNegativeTestMultiTenantJSON-135068080-project] 10.222.0.43 "DELETE /compute/v2.1/servers/50de5c85-3929-42cb-86b5-7ed97706e579" status: 404 len: 111 microversion: 2.1 time: 0.286818 Oct 04 22:12:57.866635 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2639/5339] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 22:12:57 2022] DELETE /compute/v2.1/servers/50de5c85-3929-42cb-86b5-7ed97706e579 => generated 111 bytes in 292 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:12:57.872105 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-3087d3ce-16ae-4cd2-8854-f167aba16fa5 tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:12:57.872740 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-3087d3ce-16ae-4cd2-8854-f167aba16fa5 tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] [instance: 50de5c85-3929-42cb-86b5-7ed97706e579] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:12:57.882177 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3087d3ce-16ae-4cd2-8854-f167aba16fa5 tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:57.882731 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3087d3ce-16ae-4cd2-8854-f167aba16fa5 tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:57.883389 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3087d3ce-16ae-4cd2-8854-f167aba16fa5 tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:57.884258 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3087d3ce-16ae-4cd2-8854-f167aba16fa5 tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:57.884916 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3087d3ce-16ae-4cd2-8854-f167aba16fa5 tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:57.885428 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3087d3ce-16ae-4cd2-8854-f167aba16fa5 tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:58.212677 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-3087d3ce-16ae-4cd2-8854-f167aba16fa5 tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '558a2667b8994bf4acb2a797ff091f31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32b18f49935d4c02bfcc189bdc56f259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:12:58.227118 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-3087d3ce-16ae-4cd2-8854-f167aba16fa5 tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] 10.222.0.43 "GET /compute/v2.1/servers/50de5c85-3929-42cb-86b5-7ed97706e579" status: 200 len: 1528 microversion: 2.1 time: 0.358445 Oct 04 22:12:58.229309 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2701/5340] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:12:57 2022] GET /compute/v2.1/servers/50de5c85-3929-42cb-86b5-7ed97706e579 => generated 1528 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:12:58.253638 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-b06f2801-8042-4db8-88eb-54dbd760ca48 tempest-ServersNegativeTestMultiTenantJSON-135068080 tempest-ServersNegativeTestMultiTenantJSON-135068080-project] Action: 'update', calling method: >, body: {"server": {"name": "50de5c85-3929-42cb-86b5-7ed97706e579_new"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:12:58.256241 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-b06f2801-8042-4db8-88eb-54dbd760ca48 tempest-ServersNegativeTestMultiTenantJSON-135068080 tempest-ServersNegativeTestMultiTenantJSON-135068080-project] [instance: 50de5c85-3929-42cb-86b5-7ed97706e579] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:12:58.266398 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b06f2801-8042-4db8-88eb-54dbd760ca48 tempest-ServersNegativeTestMultiTenantJSON-135068080 tempest-ServersNegativeTestMultiTenantJSON-135068080-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:58.266894 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b06f2801-8042-4db8-88eb-54dbd760ca48 tempest-ServersNegativeTestMultiTenantJSON-135068080 tempest-ServersNegativeTestMultiTenantJSON-135068080-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:58.267335 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b06f2801-8042-4db8-88eb-54dbd760ca48 tempest-ServersNegativeTestMultiTenantJSON-135068080 tempest-ServersNegativeTestMultiTenantJSON-135068080-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:58.268051 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b06f2801-8042-4db8-88eb-54dbd760ca48 tempest-ServersNegativeTestMultiTenantJSON-135068080 tempest-ServersNegativeTestMultiTenantJSON-135068080-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:58.268508 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b06f2801-8042-4db8-88eb-54dbd760ca48 tempest-ServersNegativeTestMultiTenantJSON-135068080 tempest-ServersNegativeTestMultiTenantJSON-135068080-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:58.270635 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b06f2801-8042-4db8-88eb-54dbd760ca48 tempest-ServersNegativeTestMultiTenantJSON-135068080 tempest-ServersNegativeTestMultiTenantJSON-135068080-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:58.290767 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-b06f2801-8042-4db8-88eb-54dbd760ca48 tempest-ServersNegativeTestMultiTenantJSON-135068080 tempest-ServersNegativeTestMultiTenantJSON-135068080-project] HTTP exception thrown: Instance 50de5c85-3929-42cb-86b5-7ed97706e579 could not be found. Oct 04 22:12:58.292514 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-b06f2801-8042-4db8-88eb-54dbd760ca48 tempest-ServersNegativeTestMultiTenantJSON-135068080 tempest-ServersNegativeTestMultiTenantJSON-135068080-project] Request method failure captured: Oct 04 22:12:58.292514 n-d-860284-1 devstack@n-api.service[134101]: request: PUT /compute/v2.1/servers/50de5c85-3929-42cb-86b5-7ed97706e579 HTTP/1.1 Oct 04 22:12:58.292514 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 22:12:58.292514 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 22:12:58.292514 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 22:12:58.292514 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 64 Oct 04 22:12:58.292514 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 22:12:58.292514 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 22:12:58.292514 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 22:12:58.292514 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 22:12:58.292514 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPK_YetnL6i8BaDzIQJy8cxqlPGqpaVXxmFA8s7lZ7rWFXRQa8LIQAqT3Fq6WJkK4spygaCDgAgmZ96lyXee9a7QHxSDhsW0R9exOEbqbQ6xZV_My4axNPpjfrh6v8Vbp5XWeT1jTRRKdXvhG6Hoif3UUxKKfvE1eEZWAw4z6vanpfB4 Oct 04 22:12:58.292514 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 22:12:58.292514 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 22:12:58.292514 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 22:12:58.292514 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 22:12:58.292514 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 22:12:58.292514 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 22:12:58.292514 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: a29fe45b014845a6aa942bb1a4bbf78a Oct 04 22:12:58.292514 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-135068080 Oct 04 22:12:58.292514 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 22:12:58.292514 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 22:12:58.292514 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a29fe45b014845a6aa942bb1a4bbf78a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_a29fe45b014845a6aa942bb1a4bbf78a", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a29fe45b014845a6aa942bb1a4bbf78a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/a29fe45b014845a6aa942bb1a4bbf78a"}]}] Oct 04 22:12:58.292514 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-135068080 Oct 04 22:12:58.292514 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: a29fe45b014845a6aa942bb1a4bbf78a Oct 04 22:12:58.292514 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-135068080 Oct 04 22:12:58.292514 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-ServersNegativeTestMultiTenantJSON-135068080-project Oct 04 22:12:58.292514 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 22:12:58.292514 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 22:12:58.292514 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 1bc909ebc1f34f50b5e8525b2c7c0855 Oct 04 22:12:58.292514 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-135068080-project Oct 04 22:12:58.292514 n-d-860284-1 devstack@n-api.service[134101]: Oct 04 22:12:58.292514 n-d-860284-1 devstack@n-api.service[134101]: {"server": {"name": "50de5c85-3929-42cb-86b5-7ed97706e579_new"}} Oct 04 22:12:58.292514 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 22:12:58.292514 n-d-860284-1 devstack@n-api.service[134101]: exception: Instance 50de5c85-3929-42cb-86b5-7ed97706e579 could not be found. Oct 04 22:12:58.292514 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': '50de5c85-3929-42cb-86b5-7ed97706e579', 'body': {'server': {'name': '50de5c85-3929-42cb-86b5-7ed97706e579_new'}}} Oct 04 22:12:58.292514 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:12:58.292514 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:12:58.292514 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:12:58.292514 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:12:58.292514 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:12:58.292514 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:12:58.292514 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:12:58.292514 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:12:58.292514 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:12:58.292514 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:12:58.292514 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50de5c85-3929-42cb-86b5-7ed97706e579 could not be found. Oct 04 22:12:58.292514 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:12:58.292514 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:12:58.292514 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:12:58.292514 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:12:58.292514 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:12:58.292514 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:12:58.292514 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:12:58.292514 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:12:58.292514 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:12:58.292514 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:12:58.292514 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 22:12:58.292514 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 22:12:58.292514 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 22:12:58.292514 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 22:12:58.292514 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 22:12:58.292514 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 22:12:58.292514 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 04 22:12:58.298610 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Oct 04 22:12:58.298610 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Oct 04 22:12:58.298610 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:12:58.298610 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:12:58.298610 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:12:58.298610 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:12:58.298610 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50de5c85-3929-42cb-86b5-7ed97706e579 could not be found. Oct 04 22:12:58.298610 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:12:58.298610 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:12:58.298610 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:12:58.298610 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:12:58.298610 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:12:58.298610 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:12:58.298610 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:12:58.298610 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:12:58.298610 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50de5c85-3929-42cb-86b5-7ed97706e579 could not be found. Oct 04 22:12:58.298610 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:12:58.298610 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-b06f2801-8042-4db8-88eb-54dbd760ca48 tempest-ServersNegativeTestMultiTenantJSON-135068080 tempest-ServersNegativeTestMultiTenantJSON-135068080-project] Returning 404 to user: Instance 50de5c85-3929-42cb-86b5-7ed97706e579 could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:12:58.298610 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-b06f2801-8042-4db8-88eb-54dbd760ca48 tempest-ServersNegativeTestMultiTenantJSON-135068080 tempest-ServersNegativeTestMultiTenantJSON-135068080-project] 10.222.0.43 "PUT /compute/v2.1/servers/50de5c85-3929-42cb-86b5-7ed97706e579" status: 404 len: 111 microversion: 2.1 time: 0.045486 Oct 04 22:12:58.298610 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2640/5341] 10.222.0.43 () {60 vars in 1256 bytes} [Tue Oct 4 22:12:58 2022] PUT /compute/v2.1/servers/50de5c85-3929-42cb-86b5-7ed97706e579 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:12:58.305799 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-619cafb6-c868-4c52-a456-ea9e33904000 tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:12:58.306956 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-619cafb6-c868-4c52-a456-ea9e33904000 tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] [instance: 50de5c85-3929-42cb-86b5-7ed97706e579] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:12:58.317160 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-619cafb6-c868-4c52-a456-ea9e33904000 tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:58.317902 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-619cafb6-c868-4c52-a456-ea9e33904000 tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:58.318335 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-619cafb6-c868-4c52-a456-ea9e33904000 tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:58.319325 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-619cafb6-c868-4c52-a456-ea9e33904000 tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:58.319937 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-619cafb6-c868-4c52-a456-ea9e33904000 tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:58.320534 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-619cafb6-c868-4c52-a456-ea9e33904000 tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:58.360879 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-619cafb6-c868-4c52-a456-ea9e33904000 tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] [instance: 50de5c85-3929-42cb-86b5-7ed97706e579] Going to try to terminate instance {{(pid=134102) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 22:12:58.532414 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-619cafb6-c868-4c52-a456-ea9e33904000 tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] 10.222.0.43 "DELETE /compute/v2.1/servers/50de5c85-3929-42cb-86b5-7ed97706e579" status: 204 len: 0 microversion: 2.1 time: 0.231182 Oct 04 22:12:58.533207 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2702/5342] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 22:12:58 2022] DELETE /compute/v2.1/servers/50de5c85-3929-42cb-86b5-7ed97706e579 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 22:12:58.543823 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-ea870afb-3705-4922-b591-3f79570adbe0 tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:12:58.544905 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-ea870afb-3705-4922-b591-3f79570adbe0 tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] [instance: 50de5c85-3929-42cb-86b5-7ed97706e579] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:12:58.569912 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ea870afb-3705-4922-b591-3f79570adbe0 tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:58.572019 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ea870afb-3705-4922-b591-3f79570adbe0 tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:58.574151 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ea870afb-3705-4922-b591-3f79570adbe0 tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:58.575000 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ea870afb-3705-4922-b591-3f79570adbe0 tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:58.581357 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ea870afb-3705-4922-b591-3f79570adbe0 tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:58.582290 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ea870afb-3705-4922-b591-3f79570adbe0 tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:58.842307 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-ea870afb-3705-4922-b591-3f79570adbe0 tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '558a2667b8994bf4acb2a797ff091f31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32b18f49935d4c02bfcc189bdc56f259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:12:58.858636 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-ea870afb-3705-4922-b591-3f79570adbe0 tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] 10.222.0.43 "GET /compute/v2.1/servers/50de5c85-3929-42cb-86b5-7ed97706e579" status: 200 len: 1534 microversion: 2.1 time: 0.320575 Oct 04 22:12:58.859652 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2641/5343] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:12:58 2022] GET /compute/v2.1/servers/50de5c85-3929-42cb-86b5-7ed97706e579 => generated 1534 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:12:59.888128 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-d5ccb7af-99c9-459a-976c-60f3523afa63 tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:12:59.888857 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-d5ccb7af-99c9-459a-976c-60f3523afa63 tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] [instance: 50de5c85-3929-42cb-86b5-7ed97706e579] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:12:59.910257 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d5ccb7af-99c9-459a-976c-60f3523afa63 tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:59.910902 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d5ccb7af-99c9-459a-976c-60f3523afa63 tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:59.911607 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d5ccb7af-99c9-459a-976c-60f3523afa63 tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:59.912531 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d5ccb7af-99c9-459a-976c-60f3523afa63 tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:59.913239 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d5ccb7af-99c9-459a-976c-60f3523afa63 tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:59.913771 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d5ccb7af-99c9-459a-976c-60f3523afa63 tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:00.380395 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-d5ccb7af-99c9-459a-976c-60f3523afa63 tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '558a2667b8994bf4acb2a797ff091f31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32b18f49935d4c02bfcc189bdc56f259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:13:00.404505 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-d5ccb7af-99c9-459a-976c-60f3523afa63 tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] 10.222.0.43 "GET /compute/v2.1/servers/50de5c85-3929-42cb-86b5-7ed97706e579" status: 200 len: 1534 microversion: 2.1 time: 0.520881 Oct 04 22:13:00.421625 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2703/5344] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:12:59 2022] GET /compute/v2.1/servers/50de5c85-3929-42cb-86b5-7ed97706e579 => generated 1534 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:13:00.691826 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-766ce0bc-2e3e-47d9-a5f7-dee5223e1b6d req-87162f5b-f96e-4d23-8df9-960716fc7bd1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50de5c85-3929-42cb-86b5-7ed97706e579", "name": "network-vif-deleted", "tag": "f7f6c5f7-dda1-4cf9-bd3d-c6b01c729e41"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:13:00.698153 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:13:00.704891 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-766ce0bc-2e3e-47d9-a5f7-dee5223e1b6d req-87162f5b-f96e-4d23-8df9-960716fc7bd1 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:00.705374 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-766ce0bc-2e3e-47d9-a5f7-dee5223e1b6d req-87162f5b-f96e-4d23-8df9-960716fc7bd1 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:00.705882 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-766ce0bc-2e3e-47d9-a5f7-dee5223e1b6d req-87162f5b-f96e-4d23-8df9-960716fc7bd1 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:00.721275 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-766ce0bc-2e3e-47d9-a5f7-dee5223e1b6d req-87162f5b-f96e-4d23-8df9-960716fc7bd1 service nova] Creating event network-vif-deleted:f7f6c5f7-dda1-4cf9-bd3d-c6b01c729e41 for instance 50de5c85-3929-42cb-86b5-7ed97706e579 on n-h2-860284-1 Oct 04 22:13:00.731874 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-766ce0bc-2e3e-47d9-a5f7-dee5223e1b6d req-87162f5b-f96e-4d23-8df9-960716fc7bd1 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043828 Oct 04 22:13:00.735944 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2642/5345] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:13:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:13:01.428871 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-1e77b5dd-fc00-4df4-8aa1-09914f3f4c66 tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:01.429618 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-1e77b5dd-fc00-4df4-8aa1-09914f3f4c66 tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] [instance: 50de5c85-3929-42cb-86b5-7ed97706e579] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:13:01.437273 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1e77b5dd-fc00-4df4-8aa1-09914f3f4c66 tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:01.438120 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1e77b5dd-fc00-4df4-8aa1-09914f3f4c66 tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:01.438761 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1e77b5dd-fc00-4df4-8aa1-09914f3f4c66 tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:01.439680 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1e77b5dd-fc00-4df4-8aa1-09914f3f4c66 tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:01.440281 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1e77b5dd-fc00-4df4-8aa1-09914f3f4c66 tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:01.440946 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1e77b5dd-fc00-4df4-8aa1-09914f3f4c66 tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:01.447872 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-b2db7984-a7c2-4eeb-a84b-652588d616f0 tempest-VolumesSnapshotsTestJSON-195858052 tempest-VolumesSnapshotsTestJSON-195858052-project] Action: 'create', calling method: .version_select at 0x7fbb2e486940>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-475450852"}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:13:01.457261 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-1e77b5dd-fc00-4df4-8aa1-09914f3f4c66 tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] HTTP exception thrown: Instance 50de5c85-3929-42cb-86b5-7ed97706e579 could not be found. Oct 04 22:13:01.459380 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-1e77b5dd-fc00-4df4-8aa1-09914f3f4c66 tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] Request method failure captured: Oct 04 22:13:01.459380 n-d-860284-1 devstack@n-api.service[134101]: request: GET /compute/v2.1/servers/50de5c85-3929-42cb-86b5-7ed97706e579 HTTP/1.1 Oct 04 22:13:01.459380 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 22:13:01.459380 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 22:13:01.459380 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 22:13:01.459380 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 22:13:01.459380 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 22:13:01.459380 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 22:13:01.459380 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 22:13:01.459380 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 22:13:01.459380 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPK_OtvbIuUEIjQxsMgD27Lhb0Na9boWkEWNFfvSY7yoOJDMKa9IkG1LKYuRYg4smreP1AFxCCCZjOXJsi9laHpbqDSoGb_TkBUs-ElkHWRQ0pAtKvCvMgEYQCf8DSafAer0-LA7qsUgHwCFeywNvnTrndBm0IbAX3sZWzYZ_6-dhxKE Oct 04 22:13:01.459380 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 22:13:01.459380 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 22:13:01.459380 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 22:13:01.459380 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 22:13:01.459380 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 22:13:01.459380 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 22:13:01.459380 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: 32b18f49935d4c02bfcc189bdc56f259 Oct 04 22:13:01.459380 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1686901577 Oct 04 22:13:01.459380 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 22:13:01.459380 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 22:13:01.459380 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/32b18f49935d4c02bfcc189bdc56f259"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_32b18f49935d4c02bfcc189bdc56f259", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/32b18f49935d4c02bfcc189bdc56f259"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/32b18f49935d4c02bfcc189bdc56f259"}]}] Oct 04 22:13:01.459380 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1686901577 Oct 04 22:13:01.459380 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: 32b18f49935d4c02bfcc189bdc56f259 Oct 04 22:13:01.459380 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1686901577 Oct 04 22:13:01.459380 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1686901577-project Oct 04 22:13:01.459380 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 22:13:01.459380 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 22:13:01.459380 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 558a2667b8994bf4acb2a797ff091f31 Oct 04 22:13:01.459380 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1686901577-project Oct 04 22:13:01.459380 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 22:13:01.459380 n-d-860284-1 devstack@n-api.service[134101]: exception: Instance 50de5c85-3929-42cb-86b5-7ed97706e579 could not be found. Oct 04 22:13:01.459380 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': '50de5c85-3929-42cb-86b5-7ed97706e579'} Oct 04 22:13:01.459380 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:13:01.459380 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:13:01.459380 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:13:01.459380 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:13:01.459380 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:13:01.459380 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:13:01.459380 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:13:01.459380 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:13:01.459380 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:13:01.459380 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:13:01.459380 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50de5c85-3929-42cb-86b5-7ed97706e579 could not be found. Oct 04 22:13:01.459380 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:13:01.459380 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:13:01.459380 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:13:01.459380 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:13:01.459380 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:13:01.459380 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:13:01.459380 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:13:01.459380 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:13:01.459380 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:13:01.459380 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:13:01.459380 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:13:01.459380 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:13:01.459380 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:13:01.459380 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:13:01.459380 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:13:01.459380 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:13:01.459380 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50de5c85-3929-42cb-86b5-7ed97706e579 could not be found. Oct 04 22:13:01.459380 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:13:01.462794 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:13:01.462794 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:13:01.462794 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:13:01.462794 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:13:01.462794 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:13:01.462794 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:13:01.462794 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:13:01.462794 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50de5c85-3929-42cb-86b5-7ed97706e579 could not be found. Oct 04 22:13:01.462794 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:13:01.462794 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-1e77b5dd-fc00-4df4-8aa1-09914f3f4c66 tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] Returning 404 to user: Instance 50de5c85-3929-42cb-86b5-7ed97706e579 could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:13:01.462794 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-1e77b5dd-fc00-4df4-8aa1-09914f3f4c66 tempest-ServersNegativeTestMultiTenantJSON-1686901577 tempest-ServersNegativeTestMultiTenantJSON-1686901577-project] 10.222.0.43 "GET /compute/v2.1/servers/50de5c85-3929-42cb-86b5-7ed97706e579" status: 404 len: 111 microversion: 2.1 time: 0.036306 Oct 04 22:13:01.465738 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2643/5346] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:13:01 2022] GET /compute/v2.1/servers/50de5c85-3929-42cb-86b5-7ed97706e579 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 22:13:01.895922 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-b2db7984-a7c2-4eeb-a84b-652588d616f0 tempest-VolumesSnapshotsTestJSON-195858052 tempest-VolumesSnapshotsTestJSON-195858052-project] 10.222.0.43 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.622160 Oct 04 22:13:01.896917 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2704/5347] 10.222.0.43 () {60 vars in 1155 bytes} [Tue Oct 4 22:13:01 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 624 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 04 22:13:01.910043 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-db8b407e-e96d-4895-920c-2af63cb4bd00 tempest-VolumesSnapshotsTestJSON-195858052 tempest-VolumesSnapshotsTestJSON-195858052-project] Calling method '.version_select at 0x7fbb2e19f160>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:01.973376 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-db8b407e-e96d-4895-920c-2af63cb4bd00 tempest-VolumesSnapshotsTestJSON-195858052 tempest-VolumesSnapshotsTestJSON-195858052-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/c67f40c9-7359-4363-b458-12d26e40b87e" status: 200 len: 344 microversion: 2.1 time: 0.067136 Oct 04 22:13:01.974081 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2644/5348] 10.222.0.43 () {58 vars in 1245 bytes} [Tue Oct 4 22:13:01 2022] GET /compute/v2.1/os-volumes/c67f40c9-7359-4363-b458-12d26e40b87e => generated 344 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:13:02.987771 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-6d5b7683-b295-480a-8d46-5e218bce3b94 tempest-VolumesSnapshotsTestJSON-195858052 tempest-VolumesSnapshotsTestJSON-195858052-project] Calling method '.version_select at 0x7fbb2ea5d670>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:03.067535 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-6d5b7683-b295-480a-8d46-5e218bce3b94 tempest-VolumesSnapshotsTestJSON-195858052 tempest-VolumesSnapshotsTestJSON-195858052-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/c67f40c9-7359-4363-b458-12d26e40b87e" status: 200 len: 344 microversion: 2.1 time: 0.081485 Oct 04 22:13:03.074829 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2705/5349] 10.222.0.43 () {58 vars in 1245 bytes} [Tue Oct 4 22:13:02 2022] GET /compute/v2.1/os-volumes/c67f40c9-7359-4363-b458-12d26e40b87e => generated 344 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:13:04.083285 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-d9b12740-65db-4b90-a7a2-22ad0ecf0c0f tempest-VolumesSnapshotsTestJSON-195858052 tempest-VolumesSnapshotsTestJSON-195858052-project] Calling method '.version_select at 0x7fbb2edec0d0>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:04.192257 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-d9b12740-65db-4b90-a7a2-22ad0ecf0c0f tempest-VolumesSnapshotsTestJSON-195858052 tempest-VolumesSnapshotsTestJSON-195858052-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/c67f40c9-7359-4363-b458-12d26e40b87e" status: 200 len: 345 microversion: 2.1 time: 0.113558 Oct 04 22:13:04.192715 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2645/5350] 10.222.0.43 () {58 vars in 1245 bytes} [Tue Oct 4 22:13:04 2022] GET /compute/v2.1/os-volumes/c67f40c9-7359-4363-b458-12d26e40b87e => generated 345 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:13:04.221668 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-0b2fe5a6-c6c5-4184-a6b0-d4b54c5c9822 tempest-VolumesSnapshotsTestJSON-195858052 tempest-VolumesSnapshotsTestJSON-195858052-project] Action: 'create', calling method: .version_select at 0x7fbb2e4b6b80>, body: {"snapshot": {"volume_id": "c67f40c9-7359-4363-b458-12d26e40b87e", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1851025449"}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:13:04.555657 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-0b2fe5a6-c6c5-4184-a6b0-d4b54c5c9822 tempest-VolumesSnapshotsTestJSON-195858052 tempest-VolumesSnapshotsTestJSON-195858052-project] 10.222.0.43 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.339030 Oct 04 22:13:04.556284 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2706/5351] 10.222.0.43 () {60 vars in 1162 bytes} [Tue Oct 4 22:13:04 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:13:04.568196 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-3eba1823-c8b8-420a-a3b9-e9498a258a40 tempest-VolumesSnapshotsTestJSON-195858052 tempest-VolumesSnapshotsTestJSON-195858052-project] Calling method '.version_select at 0x7fbb2db075e0>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:04.680071 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-3eba1823-c8b8-420a-a3b9-e9498a258a40 tempest-VolumesSnapshotsTestJSON-195858052 tempest-VolumesSnapshotsTestJSON-195858052-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/edfec82e-40af-4c24-887e-69ae373d9818" status: 200 len: 287 microversion: 2.1 time: 0.115345 Oct 04 22:13:04.680654 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2646/5352] 10.222.0.43 () {58 vars in 1251 bytes} [Tue Oct 4 22:13:04 2022] GET /compute/v2.1/os-snapshots/edfec82e-40af-4c24-887e-69ae373d9818 => generated 287 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:13:04.703323 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-67d548ac-91a7-4dde-b9e7-ddf8119879ab tempest-VolumesSnapshotsTestJSON-195858052 tempest-VolumesSnapshotsTestJSON-195858052-project] Calling method '.version_select at 0x7fbb2e4def70>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:04.780554 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-67d548ac-91a7-4dde-b9e7-ddf8119879ab tempest-VolumesSnapshotsTestJSON-195858052 tempest-VolumesSnapshotsTestJSON-195858052-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.091243 Oct 04 22:13:04.781267 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2707/5353] 10.222.0.43 () {58 vars in 1140 bytes} [Tue Oct 4 22:13:04 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:13:04.792764 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-fd543b7a-2630-47bb-9dbd-5bacd91f852a tempest-VolumesSnapshotsTestJSON-195858052 tempest-VolumesSnapshotsTestJSON-195858052-project] Calling method '.version_select at 0x7fbb3727a280>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:04.843316 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-fd543b7a-2630-47bb-9dbd-5bacd91f852a tempest-VolumesSnapshotsTestJSON-195858052 tempest-VolumesSnapshotsTestJSON-195858052-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/edfec82e-40af-4c24-887e-69ae373d9818" status: 200 len: 287 microversion: 2.1 time: 0.054347 Oct 04 22:13:04.848452 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2647/5354] 10.222.0.43 () {58 vars in 1251 bytes} [Tue Oct 4 22:13:04 2022] GET /compute/v2.1/os-snapshots/edfec82e-40af-4c24-887e-69ae373d9818 => generated 287 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:13:05.864340 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-99f09b9b-2374-4199-b66d-45a70b50f060 tempest-VolumesSnapshotsTestJSON-195858052 tempest-VolumesSnapshotsTestJSON-195858052-project] Calling method '.version_select at 0x7fbb2e4de040>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:05.929454 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-99f09b9b-2374-4199-b66d-45a70b50f060 tempest-VolumesSnapshotsTestJSON-195858052 tempest-VolumesSnapshotsTestJSON-195858052-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/edfec82e-40af-4c24-887e-69ae373d9818" status: 200 len: 287 microversion: 2.1 time: 0.070019 Oct 04 22:13:05.930560 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2708/5355] 10.222.0.43 () {58 vars in 1251 bytes} [Tue Oct 4 22:13:05 2022] GET /compute/v2.1/os-snapshots/edfec82e-40af-4c24-887e-69ae373d9818 => generated 287 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:13:06.950221 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-b10dce9f-9a26-4a72-a0e6-78dd42edb4ae tempest-VolumesSnapshotsTestJSON-195858052 tempest-VolumesSnapshotsTestJSON-195858052-project] Calling method '.version_select at 0x7fbb2db13ca0>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:07.007806 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-b10dce9f-9a26-4a72-a0e6-78dd42edb4ae tempest-VolumesSnapshotsTestJSON-195858052 tempest-VolumesSnapshotsTestJSON-195858052-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/edfec82e-40af-4c24-887e-69ae373d9818" status: 200 len: 287 microversion: 2.1 time: 0.068312 Oct 04 22:13:07.008673 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2648/5356] 10.222.0.43 () {58 vars in 1251 bytes} [Tue Oct 4 22:13:06 2022] GET /compute/v2.1/os-snapshots/edfec82e-40af-4c24-887e-69ae373d9818 => generated 287 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:13:08.021469 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-060f9f28-431e-44ae-9c6d-e9a3507c1d6c tempest-VolumesSnapshotsTestJSON-195858052 tempest-VolumesSnapshotsTestJSON-195858052-project] Calling method '.version_select at 0x7fbb37282310>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:08.074041 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-060f9f28-431e-44ae-9c6d-e9a3507c1d6c tempest-VolumesSnapshotsTestJSON-195858052 tempest-VolumesSnapshotsTestJSON-195858052-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/edfec82e-40af-4c24-887e-69ae373d9818" status: 200 len: 288 microversion: 2.1 time: 0.056696 Oct 04 22:13:08.075586 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2709/5357] 10.222.0.43 () {58 vars in 1251 bytes} [Tue Oct 4 22:13:08 2022] GET /compute/v2.1/os-snapshots/edfec82e-40af-4c24-887e-69ae373d9818 => generated 288 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:13:08.088891 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-4dca1f32-043a-468b-abf7-c31ca34efef4 tempest-VolumesSnapshotsTestJSON-195858052 tempest-VolumesSnapshotsTestJSON-195858052-project] Calling method '.version_select at 0x7fbb2db074c0>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:08.163710 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-4dca1f32-043a-468b-abf7-c31ca34efef4 tempest-VolumesSnapshotsTestJSON-195858052 tempest-VolumesSnapshotsTestJSON-195858052-project] 10.222.0.43 "DELETE /compute/v2.1/os-snapshots/edfec82e-40af-4c24-887e-69ae373d9818" status: 202 len: 0 microversion: 2.1 time: 0.080096 Oct 04 22:13:08.164575 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2649/5358] 10.222.0.43 () {58 vars in 1254 bytes} [Tue Oct 4 22:13:08 2022] DELETE /compute/v2.1/os-snapshots/edfec82e-40af-4c24-887e-69ae373d9818 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 22:13:08.174137 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-2538d016-ebad-4158-b63f-00ed8160bce3 tempest-VolumesSnapshotsTestJSON-195858052 tempest-VolumesSnapshotsTestJSON-195858052-project] Calling method '.version_select at 0x7fbb2ea5dee0>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:08.277392 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-2538d016-ebad-4158-b63f-00ed8160bce3 tempest-VolumesSnapshotsTestJSON-195858052 tempest-VolumesSnapshotsTestJSON-195858052-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/edfec82e-40af-4c24-887e-69ae373d9818" status: 200 len: 287 microversion: 2.1 time: 0.107362 Oct 04 22:13:08.278094 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2710/5359] 10.222.0.43 () {58 vars in 1251 bytes} [Tue Oct 4 22:13:08 2022] GET /compute/v2.1/os-snapshots/edfec82e-40af-4c24-887e-69ae373d9818 => generated 287 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:13:09.292678 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-ab3ce7d4-befc-43ae-b7d3-7e002f7ff633 tempest-VolumesSnapshotsTestJSON-195858052 tempest-VolumesSnapshotsTestJSON-195858052-project] Calling method '.version_select at 0x7fbb2db1e4c0>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:09.359104 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-ab3ce7d4-befc-43ae-b7d3-7e002f7ff633 tempest-VolumesSnapshotsTestJSON-195858052 tempest-VolumesSnapshotsTestJSON-195858052-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/edfec82e-40af-4c24-887e-69ae373d9818" status: 200 len: 287 microversion: 2.1 time: 0.071902 Oct 04 22:13:09.359810 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2650/5360] 10.222.0.43 () {58 vars in 1251 bytes} [Tue Oct 4 22:13:09 2022] GET /compute/v2.1/os-snapshots/edfec82e-40af-4c24-887e-69ae373d9818 => generated 287 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:13:10.386342 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:13:10.396609 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-4268fb52-3fbc-44cc-89d8-851f40ff972d tempest-VolumesSnapshotsTestJSON-195858052 tempest-VolumesSnapshotsTestJSON-195858052-project] Calling method '.version_select at 0x7fbb2e4dedc0>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:10.405848 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=45,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:13:10.441312 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-4268fb52-3fbc-44cc-89d8-851f40ff972d tempest-VolumesSnapshotsTestJSON-195858052 tempest-VolumesSnapshotsTestJSON-195858052-project] HTTP exception thrown: Snapshot edfec82e-40af-4c24-887e-69ae373d9818 could not be found. Oct 04 22:13:10.453372 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-4268fb52-3fbc-44cc-89d8-851f40ff972d tempest-VolumesSnapshotsTestJSON-195858052 tempest-VolumesSnapshotsTestJSON-195858052-project] Request method failure captured: Oct 04 22:13:10.453372 n-d-860284-1 devstack@n-api.service[134102]: request: GET /compute/v2.1/os-snapshots/edfec82e-40af-4c24-887e-69ae373d9818 HTTP/1.1 Oct 04 22:13:10.453372 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 22:13:10.453372 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 22:13:10.453372 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 22:13:10.453372 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 22:13:10.453372 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 22:13:10.453372 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 22:13:10.453372 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 22:13:10.453372 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 22:13:10.453372 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPK_tp7n93FsAv9Ihg7KjrEgl97S2FmhieQzqHugI60N7QsG2iUET5Hh9kAai_Oi16YhkQemQO6QvlZ77ciR-Vx6jZ8YoO4dx6zKy_F0nVC3H5TSQ3OOkjnp5tu3zK4x8s8cdhjhMyBoVnzrp8nijmH5svpwvR_JNGJNXjTIaeS3A8fk Oct 04 22:13:10.453372 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 22:13:10.453372 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 22:13:10.453372 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 22:13:10.453372 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 22:13:10.453372 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 22:13:10.453372 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 22:13:10.453372 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: 8cf92bf4ccda411eb4fabb012777d6c1 Oct 04 22:13:10.453372 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-195858052 Oct 04 22:13:10.453372 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 22:13:10.453372 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 22:13:10.453372 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8cf92bf4ccda411eb4fabb012777d6c1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_8cf92bf4ccda411eb4fabb012777d6c1", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8cf92bf4ccda411eb4fabb012777d6c1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/8cf92bf4ccda411eb4fabb012777d6c1"}]}] Oct 04 22:13:10.453372 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-VolumesSnapshotsTestJSON-195858052 Oct 04 22:13:10.453372 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: 8cf92bf4ccda411eb4fabb012777d6c1 Oct 04 22:13:10.453372 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-195858052 Oct 04 22:13:10.453372 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-VolumesSnapshotsTestJSON-195858052-project Oct 04 22:13:10.453372 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 22:13:10.453372 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 22:13:10.453372 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: bfef987164074c3586945410a6320edc Oct 04 22:13:10.453372 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-VolumesSnapshotsTestJSON-195858052-project Oct 04 22:13:10.453372 n-d-860284-1 devstack@n-api.service[134102]: method: Oct 04 22:13:10.453372 n-d-860284-1 devstack@n-api.service[134102]: exception: Snapshot edfec82e-40af-4c24-887e-69ae373d9818 could not be found. Oct 04 22:13:10.453372 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': 'edfec82e-40af-4c24-887e-69ae373d9818'} Oct 04 22:13:10.453372 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:13:10.453372 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:13:10.453372 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 04 22:13:10.453372 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 04 22:13:10.453372 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 04 22:13:10.453372 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 04 22:13:10.453372 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 04 22:13:10.453372 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 04 22:13:10.453372 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 22:13:10.453372 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 22:13:10.453372 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 22:13:10.453372 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 22:13:10.453372 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 22:13:10.453372 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 22:13:10.453372 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 22:13:10.453372 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 22:13:10.453372 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot edfec82e-40af-4c24-887e-69ae373d9818 could not be found. (HTTP 404) (Request-ID: req-278ed393-07b5-4052-a525-df2244ea0b58) Oct 04 22:13:10.453372 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:13:10.453372 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:13:10.453372 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:13:10.453372 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:13:10.453372 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Oct 04 22:13:10.453372 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Oct 04 22:13:10.453372 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 04 22:13:10.453372 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 04 22:13:10.453372 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Oct 04 22:13:10.453372 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Oct 04 22:13:10.453372 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 04 22:13:10.453372 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 04 22:13:10.457541 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 04 22:13:10.457541 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 04 22:13:10.457541 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 04 22:13:10.457541 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 04 22:13:10.457541 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 04 22:13:10.457541 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 04 22:13:10.457541 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 22:13:10.457541 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 22:13:10.457541 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 22:13:10.457541 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 22:13:10.457541 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 22:13:10.457541 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 22:13:10.457541 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 22:13:10.457541 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 22:13:10.457541 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot edfec82e-40af-4c24-887e-69ae373d9818 could not be found. Oct 04 22:13:10.457541 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:13:10.457541 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:13:10.457541 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:13:10.457541 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:13:10.457541 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:13:10.457541 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:13:10.457541 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:13:10.457541 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:13:10.457541 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 22:13:10.457541 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 22:13:10.457541 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:13:10.457541 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:13:10.457541 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Oct 04 22:13:10.457541 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:13:10.457541 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot edfec82e-40af-4c24-887e-69ae373d9818 could not be found. Oct 04 22:13:10.457541 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:13:10.457541 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:13:10.457541 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:13:10.457541 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:13:10.457541 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:13:10.457541 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:13:10.457541 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:13:10.457541 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:13:10.457541 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot edfec82e-40af-4c24-887e-69ae373d9818 could not be found. Oct 04 22:13:10.457541 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:13:10.457541 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-4268fb52-3fbc-44cc-89d8-851f40ff972d tempest-VolumesSnapshotsTestJSON-195858052 tempest-VolumesSnapshotsTestJSON-195858052-project] Returning 404 to user: Snapshot edfec82e-40af-4c24-887e-69ae373d9818 could not be found. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:13:10.460155 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-4268fb52-3fbc-44cc-89d8-851f40ff972d tempest-VolumesSnapshotsTestJSON-195858052 tempest-VolumesSnapshotsTestJSON-195858052-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/edfec82e-40af-4c24-887e-69ae373d9818" status: 404 len: 111 microversion: 2.1 time: 0.086779 Oct 04 22:13:10.461441 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2711/5361] 10.222.0.43 () {58 vars in 1251 bytes} [Tue Oct 4 22:13:10 2022] GET /compute/v2.1/os-snapshots/edfec82e-40af-4c24-887e-69ae373d9818 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:13:10.472223 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-81b8373e-e813-48a0-8117-cb17130b6254 tempest-VolumesSnapshotsTestJSON-195858052 tempest-VolumesSnapshotsTestJSON-195858052-project] Calling method '.version_select at 0x7fbb3727ac10>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:10.603066 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-81b8373e-e813-48a0-8117-cb17130b6254 tempest-VolumesSnapshotsTestJSON-195858052 tempest-VolumesSnapshotsTestJSON-195858052-project] 10.222.0.43 "DELETE /compute/v2.1/os-volumes/c67f40c9-7359-4363-b458-12d26e40b87e" status: 202 len: 0 microversion: 2.1 time: 0.137072 Oct 04 22:13:10.603852 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2651/5362] 10.222.0.43 () {58 vars in 1248 bytes} [Tue Oct 4 22:13:10 2022] DELETE /compute/v2.1/os-volumes/c67f40c9-7359-4363-b458-12d26e40b87e => generated 0 bytes in 139 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 22:13:10.613866 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-5db3f67d-0dd0-4e46-8ec1-66e117956203 tempest-VolumesSnapshotsTestJSON-195858052 tempest-VolumesSnapshotsTestJSON-195858052-project] Calling method '.version_select at 0x7fbb2e443e50>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:10.700968 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-5db3f67d-0dd0-4e46-8ec1-66e117956203 tempest-VolumesSnapshotsTestJSON-195858052 tempest-VolumesSnapshotsTestJSON-195858052-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/c67f40c9-7359-4363-b458-12d26e40b87e" status: 200 len: 344 microversion: 2.1 time: 0.091516 Oct 04 22:13:10.708032 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2712/5363] 10.222.0.43 () {58 vars in 1245 bytes} [Tue Oct 4 22:13:10 2022] GET /compute/v2.1/os-volumes/c67f40c9-7359-4363-b458-12d26e40b87e => generated 344 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:13:11.716623 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-99dc9d12-731f-4718-a09b-901e97f62a4f tempest-VolumesSnapshotsTestJSON-195858052 tempest-VolumesSnapshotsTestJSON-195858052-project] Calling method '.version_select at 0x7fbb2db1e5e0>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:11.726987 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=3 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:13:11.728717 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=73 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:13:11.824805 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-99dc9d12-731f-4718-a09b-901e97f62a4f tempest-VolumesSnapshotsTestJSON-195858052 tempest-VolumesSnapshotsTestJSON-195858052-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/c67f40c9-7359-4363-b458-12d26e40b87e" status: 200 len: 344 microversion: 2.1 time: 0.112509 Oct 04 22:13:11.825522 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2652/5364] 10.222.0.43 () {58 vars in 1245 bytes} [Tue Oct 4 22:13:11 2022] GET /compute/v2.1/os-volumes/c67f40c9-7359-4363-b458-12d26e40b87e => generated 344 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:13:12.841637 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-71caeaae-0146-486c-8dec-1b323eef494d tempest-VolumesSnapshotsTestJSON-195858052 tempest-VolumesSnapshotsTestJSON-195858052-project] Calling method '.version_select at 0x7fbb2e4dee50>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:12.936904 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-71caeaae-0146-486c-8dec-1b323eef494d tempest-VolumesSnapshotsTestJSON-195858052 tempest-VolumesSnapshotsTestJSON-195858052-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/c67f40c9-7359-4363-b458-12d26e40b87e" status: 200 len: 344 microversion: 2.1 time: 0.100974 Oct 04 22:13:12.952569 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2713/5365] 10.222.0.43 () {58 vars in 1245 bytes} [Tue Oct 4 22:13:12 2022] GET /compute/v2.1/os-volumes/c67f40c9-7359-4363-b458-12d26e40b87e => generated 344 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:13:13.952108 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-8bf39b2c-8037-4ae2-b161-47f4fa77f005 tempest-VolumesSnapshotsTestJSON-195858052 tempest-VolumesSnapshotsTestJSON-195858052-project] Calling method '.version_select at 0x7fbb373dcee0>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:14.022138 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-8bf39b2c-8037-4ae2-b161-47f4fa77f005 tempest-VolumesSnapshotsTestJSON-195858052 tempest-VolumesSnapshotsTestJSON-195858052-project] HTTP exception thrown: Volume c67f40c9-7359-4363-b458-12d26e40b87e could not be found. Oct 04 22:13:14.024163 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-8bf39b2c-8037-4ae2-b161-47f4fa77f005 tempest-VolumesSnapshotsTestJSON-195858052 tempest-VolumesSnapshotsTestJSON-195858052-project] Request method failure captured: Oct 04 22:13:14.024163 n-d-860284-1 devstack@n-api.service[134102]: request: GET /compute/v2.1/os-volumes/c67f40c9-7359-4363-b458-12d26e40b87e HTTP/1.1 Oct 04 22:13:14.024163 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 22:13:14.024163 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 22:13:14.024163 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 22:13:14.024163 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 22:13:14.024163 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 22:13:14.024163 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 22:13:14.024163 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 22:13:14.024163 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 22:13:14.024163 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPK_tp7n93FsAv9Ihg7KjrEgl97S2FmhieQzqHugI60N7QsG2iUET5Hh9kAai_Oi16YhkQemQO6QvlZ77ciR-Vx6jZ8YoO4dx6zKy_F0nVC3H5TSQ3OOkjnp5tu3zK4x8s8cdhjhMyBoVnzrp8nijmH5svpwvR_JNGJNXjTIaeS3A8fk Oct 04 22:13:14.024163 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 22:13:14.024163 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 22:13:14.024163 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 22:13:14.024163 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 22:13:14.024163 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 22:13:14.024163 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 22:13:14.024163 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: 8cf92bf4ccda411eb4fabb012777d6c1 Oct 04 22:13:14.024163 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-195858052 Oct 04 22:13:14.024163 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 22:13:14.024163 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 22:13:14.024163 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8cf92bf4ccda411eb4fabb012777d6c1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_8cf92bf4ccda411eb4fabb012777d6c1", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8cf92bf4ccda411eb4fabb012777d6c1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/8cf92bf4ccda411eb4fabb012777d6c1"}]}] Oct 04 22:13:14.024163 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-VolumesSnapshotsTestJSON-195858052 Oct 04 22:13:14.024163 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: 8cf92bf4ccda411eb4fabb012777d6c1 Oct 04 22:13:14.024163 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-195858052 Oct 04 22:13:14.024163 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-VolumesSnapshotsTestJSON-195858052-project Oct 04 22:13:14.024163 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 22:13:14.024163 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 22:13:14.024163 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: bfef987164074c3586945410a6320edc Oct 04 22:13:14.024163 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-VolumesSnapshotsTestJSON-195858052-project Oct 04 22:13:14.024163 n-d-860284-1 devstack@n-api.service[134102]: method: Oct 04 22:13:14.024163 n-d-860284-1 devstack@n-api.service[134102]: exception: Volume c67f40c9-7359-4363-b458-12d26e40b87e could not be found. Oct 04 22:13:14.024163 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': 'c67f40c9-7359-4363-b458-12d26e40b87e'} Oct 04 22:13:14.024163 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:13:14.024163 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:13:14.024163 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 22:13:14.024163 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 22:13:14.024163 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 22:13:14.024163 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 22:13:14.024163 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 22:13:14.024163 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 22:13:14.024163 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 22:13:14.024163 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 22:13:14.024163 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 22:13:14.024163 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 22:13:14.024163 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 22:13:14.024163 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 22:13:14.024163 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 22:13:14.024163 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 22:13:14.024163 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c67f40c9-7359-4363-b458-12d26e40b87e could not be found. (HTTP 404) (Request-ID: req-8de7fe02-c66c-407e-843e-f01de9a4fdcf) Oct 04 22:13:14.024163 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:13:14.024163 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:13:14.024163 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:13:14.024163 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:13:14.024163 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 04 22:13:14.024163 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 04 22:13:14.024163 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 04 22:13:14.024163 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 04 22:13:14.024163 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 04 22:13:14.024163 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 04 22:13:14.024163 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 04 22:13:14.024163 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 04 22:13:14.024163 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 22:13:14.028511 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 22:13:14.028511 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 22:13:14.028511 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 22:13:14.028511 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 22:13:14.028511 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 22:13:14.028511 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 22:13:14.028511 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 22:13:14.028511 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 22:13:14.028511 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 22:13:14.028511 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 22:13:14.028511 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 22:13:14.028511 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 22:13:14.028511 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 22:13:14.028511 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c67f40c9-7359-4363-b458-12d26e40b87e could not be found. Oct 04 22:13:14.028511 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:13:14.028511 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:13:14.028511 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:13:14.028511 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:13:14.028511 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:13:14.028511 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:13:14.028511 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:13:14.028511 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:13:14.028511 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 22:13:14.028511 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 22:13:14.028511 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:13:14.028511 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:13:14.028511 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 04 22:13:14.028511 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:13:14.028511 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c67f40c9-7359-4363-b458-12d26e40b87e could not be found. Oct 04 22:13:14.028511 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:13:14.028511 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:13:14.028511 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:13:14.028511 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:13:14.028511 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:13:14.028511 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:13:14.028511 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:13:14.028511 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:13:14.028511 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c67f40c9-7359-4363-b458-12d26e40b87e could not be found. Oct 04 22:13:14.028511 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:13:14.028511 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-8bf39b2c-8037-4ae2-b161-47f4fa77f005 tempest-VolumesSnapshotsTestJSON-195858052 tempest-VolumesSnapshotsTestJSON-195858052-project] Returning 404 to user: Volume c67f40c9-7359-4363-b458-12d26e40b87e could not be found. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:13:14.028511 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-8bf39b2c-8037-4ae2-b161-47f4fa77f005 tempest-VolumesSnapshotsTestJSON-195858052 tempest-VolumesSnapshotsTestJSON-195858052-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/c67f40c9-7359-4363-b458-12d26e40b87e" status: 404 len: 109 microversion: 2.1 time: 0.077903 Oct 04 22:13:14.028511 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2714/5366] 10.222.0.43 () {58 vars in 1245 bytes} [Tue Oct 4 22:13:13 2022] GET /compute/v2.1/os-volumes/c67f40c9-7359-4363-b458-12d26e40b87e => generated 109 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 22:13:14.038600 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-24975425-f9a5-4aa5-b18c-037a5292dcbd tempest-VolumesSnapshotsTestJSON-195858052 tempest-VolumesSnapshotsTestJSON-195858052-project] Calling method '.version_select at 0x7fbb2e4de040>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:14.081021 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-24975425-f9a5-4aa5-b18c-037a5292dcbd tempest-VolumesSnapshotsTestJSON-195858052 tempest-VolumesSnapshotsTestJSON-195858052-project] HTTP exception thrown: Volume c67f40c9-7359-4363-b458-12d26e40b87e could not be found. Oct 04 22:13:14.083574 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-24975425-f9a5-4aa5-b18c-037a5292dcbd tempest-VolumesSnapshotsTestJSON-195858052 tempest-VolumesSnapshotsTestJSON-195858052-project] Request method failure captured: Oct 04 22:13:14.083574 n-d-860284-1 devstack@n-api.service[134102]: request: DELETE /compute/v2.1/os-volumes/c67f40c9-7359-4363-b458-12d26e40b87e HTTP/1.1 Oct 04 22:13:14.083574 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 22:13:14.083574 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 22:13:14.083574 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 22:13:14.083574 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 22:13:14.083574 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 22:13:14.083574 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 22:13:14.083574 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 22:13:14.083574 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 22:13:14.083574 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPK_tp7n93FsAv9Ihg7KjrEgl97S2FmhieQzqHugI60N7QsG2iUET5Hh9kAai_Oi16YhkQemQO6QvlZ77ciR-Vx6jZ8YoO4dx6zKy_F0nVC3H5TSQ3OOkjnp5tu3zK4x8s8cdhjhMyBoVnzrp8nijmH5svpwvR_JNGJNXjTIaeS3A8fk Oct 04 22:13:14.083574 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 22:13:14.083574 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 22:13:14.083574 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 22:13:14.083574 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 22:13:14.083574 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 22:13:14.083574 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 22:13:14.083574 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: 8cf92bf4ccda411eb4fabb012777d6c1 Oct 04 22:13:14.083574 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-195858052 Oct 04 22:13:14.083574 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 22:13:14.083574 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 22:13:14.083574 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8cf92bf4ccda411eb4fabb012777d6c1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_8cf92bf4ccda411eb4fabb012777d6c1", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8cf92bf4ccda411eb4fabb012777d6c1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/8cf92bf4ccda411eb4fabb012777d6c1"}]}] Oct 04 22:13:14.083574 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-VolumesSnapshotsTestJSON-195858052 Oct 04 22:13:14.083574 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: 8cf92bf4ccda411eb4fabb012777d6c1 Oct 04 22:13:14.083574 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-195858052 Oct 04 22:13:14.083574 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-VolumesSnapshotsTestJSON-195858052-project Oct 04 22:13:14.083574 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 22:13:14.083574 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 22:13:14.083574 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: bfef987164074c3586945410a6320edc Oct 04 22:13:14.083574 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-VolumesSnapshotsTestJSON-195858052-project Oct 04 22:13:14.083574 n-d-860284-1 devstack@n-api.service[134102]: method: Oct 04 22:13:14.083574 n-d-860284-1 devstack@n-api.service[134102]: exception: Volume c67f40c9-7359-4363-b458-12d26e40b87e could not be found. Oct 04 22:13:14.083574 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': 'c67f40c9-7359-4363-b458-12d26e40b87e'} Oct 04 22:13:14.083574 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:13:14.083574 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:13:14.083574 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 22:13:14.083574 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 22:13:14.083574 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 04 22:13:14.083574 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 04 22:13:14.083574 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 04 22:13:14.083574 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 04 22:13:14.083574 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 04 22:13:14.083574 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 04 22:13:14.083574 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 04 22:13:14.083574 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 04 22:13:14.083574 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 22:13:14.083574 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 22:13:14.083574 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 22:13:14.083574 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 22:13:14.083574 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c67f40c9-7359-4363-b458-12d26e40b87e could not be found. (HTTP 404) (Request-ID: req-b6300b2f-a805-43a4-a72a-a6548e6984df) Oct 04 22:13:14.083574 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:13:14.083574 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:13:14.083574 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:13:14.083574 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:13:14.083574 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 04 22:13:14.083574 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 04 22:13:14.083574 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 04 22:13:14.083574 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 04 22:13:14.083574 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 04 22:13:14.083574 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 04 22:13:14.083574 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 04 22:13:14.083574 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 04 22:13:14.083574 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 22:13:14.087983 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 22:13:14.087983 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 04 22:13:14.087983 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 04 22:13:14.087983 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 04 22:13:14.087983 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 04 22:13:14.087983 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 04 22:13:14.087983 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 04 22:13:14.087983 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 04 22:13:14.087983 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 04 22:13:14.087983 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 22:13:14.087983 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 22:13:14.087983 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 22:13:14.087983 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 22:13:14.087983 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c67f40c9-7359-4363-b458-12d26e40b87e could not be found. Oct 04 22:13:14.087983 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:13:14.087983 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:13:14.087983 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:13:14.087983 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:13:14.087983 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:13:14.087983 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:13:14.087983 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:13:14.087983 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:13:14.087983 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 22:13:14.087983 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 22:13:14.087983 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:13:14.087983 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:13:14.087983 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 04 22:13:14.087983 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:13:14.087983 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c67f40c9-7359-4363-b458-12d26e40b87e could not be found. Oct 04 22:13:14.087983 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:13:14.087983 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:13:14.087983 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:13:14.087983 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:13:14.087983 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:13:14.087983 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:13:14.087983 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:13:14.087983 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:13:14.087983 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c67f40c9-7359-4363-b458-12d26e40b87e could not be found. Oct 04 22:13:14.087983 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:13:14.093091 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-24975425-f9a5-4aa5-b18c-037a5292dcbd tempest-VolumesSnapshotsTestJSON-195858052 tempest-VolumesSnapshotsTestJSON-195858052-project] Returning 404 to user: Volume c67f40c9-7359-4363-b458-12d26e40b87e could not be found. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:13:14.094150 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-24975425-f9a5-4aa5-b18c-037a5292dcbd tempest-VolumesSnapshotsTestJSON-195858052 tempest-VolumesSnapshotsTestJSON-195858052-project] 10.222.0.43 "DELETE /compute/v2.1/os-volumes/c67f40c9-7359-4363-b458-12d26e40b87e" status: 404 len: 109 microversion: 2.1 time: 0.061046 Oct 04 22:13:14.098454 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2715/5367] 10.222.0.43 () {58 vars in 1248 bytes} [Tue Oct 4 22:13:14 2022] DELETE /compute/v2.1/os-volumes/c67f40c9-7359-4363-b458-12d26e40b87e => generated 109 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 22:13:14.107172 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-82f5e610-afb2-4f8f-90b8-062090a6fc32 tempest-VolumesSnapshotsTestJSON-195858052 tempest-VolumesSnapshotsTestJSON-195858052-project] Calling method '.version_select at 0x7fbb2f95bc10>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:14.159340 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-82f5e610-afb2-4f8f-90b8-062090a6fc32 tempest-VolumesSnapshotsTestJSON-195858052 tempest-VolumesSnapshotsTestJSON-195858052-project] HTTP exception thrown: Volume c67f40c9-7359-4363-b458-12d26e40b87e could not be found. Oct 04 22:13:14.161830 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-82f5e610-afb2-4f8f-90b8-062090a6fc32 tempest-VolumesSnapshotsTestJSON-195858052 tempest-VolumesSnapshotsTestJSON-195858052-project] Request method failure captured: Oct 04 22:13:14.161830 n-d-860284-1 devstack@n-api.service[134102]: request: GET /compute/v2.1/os-volumes/c67f40c9-7359-4363-b458-12d26e40b87e HTTP/1.1 Oct 04 22:13:14.161830 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 22:13:14.161830 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 22:13:14.161830 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 22:13:14.161830 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 22:13:14.161830 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 22:13:14.161830 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 22:13:14.161830 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 22:13:14.161830 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 22:13:14.161830 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPK_tp7n93FsAv9Ihg7KjrEgl97S2FmhieQzqHugI60N7QsG2iUET5Hh9kAai_Oi16YhkQemQO6QvlZ77ciR-Vx6jZ8YoO4dx6zKy_F0nVC3H5TSQ3OOkjnp5tu3zK4x8s8cdhjhMyBoVnzrp8nijmH5svpwvR_JNGJNXjTIaeS3A8fk Oct 04 22:13:14.161830 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 22:13:14.161830 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 22:13:14.161830 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 22:13:14.161830 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 22:13:14.161830 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 22:13:14.161830 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 22:13:14.161830 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: 8cf92bf4ccda411eb4fabb012777d6c1 Oct 04 22:13:14.161830 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-195858052 Oct 04 22:13:14.161830 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 22:13:14.161830 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 22:13:14.161830 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8cf92bf4ccda411eb4fabb012777d6c1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_8cf92bf4ccda411eb4fabb012777d6c1", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8cf92bf4ccda411eb4fabb012777d6c1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/8cf92bf4ccda411eb4fabb012777d6c1"}]}] Oct 04 22:13:14.161830 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-VolumesSnapshotsTestJSON-195858052 Oct 04 22:13:14.161830 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: 8cf92bf4ccda411eb4fabb012777d6c1 Oct 04 22:13:14.161830 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-195858052 Oct 04 22:13:14.161830 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-VolumesSnapshotsTestJSON-195858052-project Oct 04 22:13:14.161830 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 22:13:14.161830 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 22:13:14.161830 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: bfef987164074c3586945410a6320edc Oct 04 22:13:14.161830 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-VolumesSnapshotsTestJSON-195858052-project Oct 04 22:13:14.161830 n-d-860284-1 devstack@n-api.service[134102]: method: Oct 04 22:13:14.161830 n-d-860284-1 devstack@n-api.service[134102]: exception: Volume c67f40c9-7359-4363-b458-12d26e40b87e could not be found. Oct 04 22:13:14.161830 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': 'c67f40c9-7359-4363-b458-12d26e40b87e'} Oct 04 22:13:14.161830 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:13:14.161830 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:13:14.161830 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 22:13:14.161830 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 22:13:14.161830 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 22:13:14.161830 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 22:13:14.161830 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 22:13:14.161830 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 22:13:14.161830 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 22:13:14.161830 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 22:13:14.161830 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 22:13:14.161830 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 22:13:14.161830 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 22:13:14.161830 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 22:13:14.161830 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 22:13:14.161830 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 22:13:14.161830 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c67f40c9-7359-4363-b458-12d26e40b87e could not be found. (HTTP 404) (Request-ID: req-9076c794-0030-40b7-80a2-25f86aff6981) Oct 04 22:13:14.161830 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:13:14.161830 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:13:14.161830 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:13:14.161830 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:13:14.161830 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 04 22:13:14.161830 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 04 22:13:14.161830 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 04 22:13:14.161830 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 04 22:13:14.161830 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 04 22:13:14.161830 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 04 22:13:14.161830 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 04 22:13:14.161830 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 04 22:13:14.161830 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 22:13:14.165803 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 22:13:14.165803 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 22:13:14.165803 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 22:13:14.165803 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 22:13:14.165803 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 22:13:14.165803 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 22:13:14.165803 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 22:13:14.165803 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 22:13:14.165803 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 22:13:14.165803 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 22:13:14.165803 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 22:13:14.165803 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 22:13:14.165803 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 22:13:14.165803 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c67f40c9-7359-4363-b458-12d26e40b87e could not be found. Oct 04 22:13:14.165803 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:13:14.165803 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:13:14.165803 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:13:14.165803 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:13:14.165803 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:13:14.165803 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:13:14.165803 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:13:14.165803 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:13:14.165803 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 22:13:14.165803 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 22:13:14.165803 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:13:14.165803 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:13:14.165803 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 04 22:13:14.165803 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:13:14.165803 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c67f40c9-7359-4363-b458-12d26e40b87e could not be found. Oct 04 22:13:14.165803 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:13:14.165803 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:13:14.165803 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:13:14.165803 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:13:14.165803 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:13:14.165803 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:13:14.165803 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:13:14.165803 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:13:14.165803 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c67f40c9-7359-4363-b458-12d26e40b87e could not be found. Oct 04 22:13:14.165803 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:13:14.165803 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-82f5e610-afb2-4f8f-90b8-062090a6fc32 tempest-VolumesSnapshotsTestJSON-195858052 tempest-VolumesSnapshotsTestJSON-195858052-project] Returning 404 to user: Volume c67f40c9-7359-4363-b458-12d26e40b87e could not be found. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:13:14.165803 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-82f5e610-afb2-4f8f-90b8-062090a6fc32 tempest-VolumesSnapshotsTestJSON-195858052 tempest-VolumesSnapshotsTestJSON-195858052-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/c67f40c9-7359-4363-b458-12d26e40b87e" status: 404 len: 109 microversion: 2.1 time: 0.063560 Oct 04 22:13:14.168678 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2716/5368] 10.222.0.43 () {58 vars in 1245 bytes} [Tue Oct 4 22:13:14 2022] GET /compute/v2.1/os-volumes/c67f40c9-7359-4363-b458-12d26e40b87e => generated 109 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:13:14.260363 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-95b73184-90b0-446b-9aa7-764bbf19b849 tempest-VolumesGetTestJSON-43315534 tempest-VolumesGetTestJSON-43315534-project] Action: 'create', calling method: .version_select at 0x7fbb2e138700>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1177438194", "metadata": {"Type": "work"}}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:13:14.976617 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-61113f7d-8730-499c-a303-a7ce72ac4d34 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:14.978240 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-61113f7d-8730-499c-a303-a7ce72ac4d34 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 48243e1b-892b-4c4b-8db1-242b2e40653b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:13:14.995493 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-61113f7d-8730-499c-a303-a7ce72ac4d34 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:14.997329 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-61113f7d-8730-499c-a303-a7ce72ac4d34 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:14.997879 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-61113f7d-8730-499c-a303-a7ce72ac4d34 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:14.999380 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-61113f7d-8730-499c-a303-a7ce72ac4d34 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:15.001503 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-61113f7d-8730-499c-a303-a7ce72ac4d34 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:15.004523 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-61113f7d-8730-499c-a303-a7ce72ac4d34 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:15.060347 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-95b73184-90b0-446b-9aa7-764bbf19b849 tempest-VolumesGetTestJSON-43315534 tempest-VolumesGetTestJSON-43315534-project] 10.222.0.43 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 1.184411 Oct 04 22:13:15.061143 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2653/5369] 10.222.0.43 () {60 vars in 1156 bytes} [Tue Oct 4 22:13:13 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 1186 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 04 22:13:15.074800 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-ce8d0ab0-634e-41ef-a4bd-2862d4d93791 tempest-VolumesGetTestJSON-43315534 tempest-VolumesGetTestJSON-43315534-project] Calling method '.version_select at 0x7fbb2f2bbe50>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:15.235527 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-ce8d0ab0-634e-41ef-a4bd-2862d4d93791 tempest-VolumesGetTestJSON-43315534 tempest-VolumesGetTestJSON-43315534-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/7d408b0a-af09-44e2-8bed-d62f4eb93536" status: 200 len: 353 microversion: 2.1 time: 0.165305 Oct 04 22:13:15.236297 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2654/5370] 10.222.0.43 () {58 vars in 1245 bytes} [Tue Oct 4 22:13:15 2022] GET /compute/v2.1/os-volumes/7d408b0a-af09-44e2-8bed-d62f4eb93536 => generated 353 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:13:15.283374 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-61113f7d-8730-499c-a303-a7ce72ac4d34 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:13:15.299112 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-61113f7d-8730-499c-a303-a7ce72ac4d34 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b" status: 200 len: 1669 microversion: 2.1 time: 0.330155 Oct 04 22:13:15.301515 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2717/5371] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:13:14 2022] GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b => generated 1669 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:13:15.333365 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-17a9b0f0-9786-4876-b870-ec08823e099f tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:15.334181 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-17a9b0f0-9786-4876-b870-ec08823e099f tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 48243e1b-892b-4c4b-8db1-242b2e40653b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:13:15.342725 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-17a9b0f0-9786-4876-b870-ec08823e099f tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:15.343175 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-17a9b0f0-9786-4876-b870-ec08823e099f tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:15.343843 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-17a9b0f0-9786-4876-b870-ec08823e099f tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:15.344608 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-17a9b0f0-9786-4876-b870-ec08823e099f tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:15.345413 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-17a9b0f0-9786-4876-b870-ec08823e099f tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:15.346120 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-17a9b0f0-9786-4876-b870-ec08823e099f tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:15.573893 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-17a9b0f0-9786-4876-b870-ec08823e099f tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:13:15.584686 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-17a9b0f0-9786-4876-b870-ec08823e099f tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b" status: 200 len: 1669 microversion: 2.1 time: 0.257226 Oct 04 22:13:15.596086 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2655/5372] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:13:15 2022] GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b => generated 1669 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:13:15.609824 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-074168ff-8968-4793-b5d3-e75d4b4128ea tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:15.610811 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-074168ff-8968-4793-b5d3-e75d4b4128ea tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 48243e1b-892b-4c4b-8db1-242b2e40653b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:13:15.620481 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-074168ff-8968-4793-b5d3-e75d4b4128ea tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:15.621015 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-074168ff-8968-4793-b5d3-e75d4b4128ea tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:15.625174 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-074168ff-8968-4793-b5d3-e75d4b4128ea tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:15.627183 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-074168ff-8968-4793-b5d3-e75d4b4128ea tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:15.627662 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-074168ff-8968-4793-b5d3-e75d4b4128ea tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:15.628359 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-074168ff-8968-4793-b5d3-e75d4b4128ea tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:15.876513 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-074168ff-8968-4793-b5d3-e75d4b4128ea tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:13:15.885510 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-074168ff-8968-4793-b5d3-e75d4b4128ea tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b" status: 200 len: 1669 microversion: 2.1 time: 0.280305 Oct 04 22:13:15.886104 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2718/5373] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:13:15 2022] GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b => generated 1669 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:13:15.909232 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-43de8b0c-3811-4d51-b82f-9171ab45ce22 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:15.909857 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-43de8b0c-3811-4d51-b82f-9171ab45ce22 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 48243e1b-892b-4c4b-8db1-242b2e40653b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:13:15.917057 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-43de8b0c-3811-4d51-b82f-9171ab45ce22 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:15.917823 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-43de8b0c-3811-4d51-b82f-9171ab45ce22 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:15.918673 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-43de8b0c-3811-4d51-b82f-9171ab45ce22 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:15.919582 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-43de8b0c-3811-4d51-b82f-9171ab45ce22 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:15.920226 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-43de8b0c-3811-4d51-b82f-9171ab45ce22 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:15.920842 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-43de8b0c-3811-4d51-b82f-9171ab45ce22 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:16.138699 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-43de8b0c-3811-4d51-b82f-9171ab45ce22 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:13:16.151216 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-43de8b0c-3811-4d51-b82f-9171ab45ce22 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b" status: 200 len: 1669 microversion: 2.1 time: 0.245741 Oct 04 22:13:16.158385 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2656/5374] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:13:15 2022] GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b => generated 1669 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:13:16.257939 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-06468c72-6b3e-45c5-83ba-3a555f5b52d6 tempest-VolumesGetTestJSON-43315534 tempest-VolumesGetTestJSON-43315534-project] Calling method '.version_select at 0x7fbb2efd2820>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:16.374954 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-06468c72-6b3e-45c5-83ba-3a555f5b52d6 tempest-VolumesGetTestJSON-43315534 tempest-VolumesGetTestJSON-43315534-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/7d408b0a-af09-44e2-8bed-d62f4eb93536" status: 200 len: 353 microversion: 2.1 time: 0.126714 Oct 04 22:13:16.375645 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2719/5375] 10.222.0.43 () {58 vars in 1245 bytes} [Tue Oct 4 22:13:16 2022] GET /compute/v2.1/os-volumes/7d408b0a-af09-44e2-8bed-d62f4eb93536 => generated 353 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:13:16.378054 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-c29f25b4-754c-467c-810c-67a49ea822a8 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1511317428", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452", "networks": [{"uuid": "46f1773f-94f8-4a79-8019-a2303221d351"}]}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:13:16.449838 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.network.neutron [None req-c29f25b4-754c-467c-810c-67a49ea822a8 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] validate_networks() for [('46f1773f-94f8-4a79-8019-a2303221d351', None, None, None, None, None)] {{(pid=134101) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 22:13:17.005824 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-c29f25b4-754c-467c-810c-67a49ea822a8 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Flavor limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 22:13:17.006248 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-c29f25b4-754c-467c-810c-67a49ea822a8 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Image limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 22:13:17.006851 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-c29f25b4-754c-467c-810c-67a49ea822a8 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Flavor pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 22:13:17.007305 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-c29f25b4-754c-467c-810c-67a49ea822a8 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Image pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 22:13:17.007713 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-c29f25b4-754c-467c-810c-67a49ea822a8 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 22:13:17.020232 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c29f25b4-754c-467c-810c-67a49ea822a8 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:17.021090 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c29f25b4-754c-467c-810c-67a49ea822a8 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:17.021598 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c29f25b4-754c-467c-810c-67a49ea822a8 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:17.022663 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c29f25b4-754c-467c-810c-67a49ea822a8 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:17.023494 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c29f25b4-754c-467c-810c-67a49ea822a8 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:17.024132 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c29f25b4-754c-467c-810c-67a49ea822a8 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:17.046334 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-c29f25b4-754c-467c-810c-67a49ea822a8 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Getting quotas for project 9da7a77590054a3c911643db69a0beae. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:13:17.053456 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-c29f25b4-754c-467c-810c-67a49ea822a8 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Getting quotas for user 836cb8e2e7be4981bb266cbd4189a775 and project 9da7a77590054a3c911643db69a0beae. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:13:17.070242 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-c29f25b4-754c-467c-810c-67a49ea822a8 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Going to run 1 instances... {{(pid=134101) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 22:13:17.072839 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-c29f25b4-754c-467c-810c-67a49ea822a8 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: ed4edd72-c2f2-4823-a8ec-274e9bc6ae98] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='58548514-5dac-426c-81f5-19e3fba33e23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134101) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 22:13:17.163563 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-c29f25b4-754c-467c-810c-67a49ea822a8 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.789376 Oct 04 22:13:17.165814 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2657/5376] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 22:13:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 793 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 22:13:17.185693 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-9d0eb18c-8620-4d8e-b18b-bc012efcf768 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:17.186188 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-9d0eb18c-8620-4d8e-b18b-bc012efcf768 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: ed4edd72-c2f2-4823-a8ec-274e9bc6ae98] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:13:17.331705 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-9d0eb18c-8620-4d8e-b18b-bc012efcf768 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:13:17.341662 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-9d0eb18c-8620-4d8e-b18b-bc012efcf768 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/ed4edd72-c2f2-4823-a8ec-274e9bc6ae98" status: 200 len: 1215 microversion: 2.1 time: 0.166920 Oct 04 22:13:17.342321 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2720/5377] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:13:17 2022] GET /compute/v2.1/servers/ed4edd72-c2f2-4823-a8ec-274e9bc6ae98 => generated 1215 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:13:17.389533 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-3ff329a8-3ce4-4a6c-83ef-32dd07f9999c tempest-VolumesGetTestJSON-43315534 tempest-VolumesGetTestJSON-43315534-project] Calling method '.version_select at 0x7fbb2ee55b80>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:17.499759 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-3ff329a8-3ce4-4a6c-83ef-32dd07f9999c tempest-VolumesGetTestJSON-43315534 tempest-VolumesGetTestJSON-43315534-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/7d408b0a-af09-44e2-8bed-d62f4eb93536" status: 200 len: 354 microversion: 2.1 time: 0.114558 Oct 04 22:13:17.500732 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2658/5378] 10.222.0.43 () {58 vars in 1245 bytes} [Tue Oct 4 22:13:17 2022] GET /compute/v2.1/os-volumes/7d408b0a-af09-44e2-8bed-d62f4eb93536 => generated 354 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:13:17.533000 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-14a2372b-bac9-4d29-8752-1a2bf4a8dd12 tempest-VolumesGetTestJSON-43315534 tempest-VolumesGetTestJSON-43315534-project] Calling method '.version_select at 0x7fbb2e443310>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:17.694519 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-14a2372b-bac9-4d29-8752-1a2bf4a8dd12 tempest-VolumesGetTestJSON-43315534 tempest-VolumesGetTestJSON-43315534-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/7d408b0a-af09-44e2-8bed-d62f4eb93536" status: 200 len: 354 microversion: 2.1 time: 0.184259 Oct 04 22:13:17.696027 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2721/5379] 10.222.0.43 () {58 vars in 1245 bytes} [Tue Oct 4 22:13:17 2022] GET /compute/v2.1/os-volumes/7d408b0a-af09-44e2-8bed-d62f4eb93536 => generated 354 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:13:17.709095 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-b8fe926a-16c5-4d64-b770-a4c831c4c86f tempest-VolumesGetTestJSON-43315534 tempest-VolumesGetTestJSON-43315534-project] Calling method '.version_select at 0x7fbb2edec0d0>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:17.809643 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-b8fe926a-16c5-4d64-b770-a4c831c4c86f tempest-VolumesGetTestJSON-43315534 tempest-VolumesGetTestJSON-43315534-project] 10.222.0.43 "DELETE /compute/v2.1/os-volumes/7d408b0a-af09-44e2-8bed-d62f4eb93536" status: 202 len: 0 microversion: 2.1 time: 0.103966 Oct 04 22:13:17.810784 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2659/5380] 10.222.0.43 () {58 vars in 1248 bytes} [Tue Oct 4 22:13:17 2022] DELETE /compute/v2.1/os-volumes/7d408b0a-af09-44e2-8bed-d62f4eb93536 => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 22:13:17.820129 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-b573c504-cc92-4752-9ee6-79b6490943a0 tempest-VolumesGetTestJSON-43315534 tempest-VolumesGetTestJSON-43315534-project] Calling method '.version_select at 0x7fbb2e594430>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:17.918688 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-b573c504-cc92-4752-9ee6-79b6490943a0 tempest-VolumesGetTestJSON-43315534 tempest-VolumesGetTestJSON-43315534-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/7d408b0a-af09-44e2-8bed-d62f4eb93536" status: 200 len: 353 microversion: 2.1 time: 0.102084 Oct 04 22:13:17.919662 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2722/5381] 10.222.0.43 () {58 vars in 1245 bytes} [Tue Oct 4 22:13:17 2022] GET /compute/v2.1/os-volumes/7d408b0a-af09-44e2-8bed-d62f4eb93536 => generated 353 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:13:18.366746 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-a1ff7ebe-0a0b-4ba6-9268-55dda6d23cb5 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:18.367461 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-a1ff7ebe-0a0b-4ba6-9268-55dda6d23cb5 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: ed4edd72-c2f2-4823-a8ec-274e9bc6ae98] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:13:18.376450 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a1ff7ebe-0a0b-4ba6-9268-55dda6d23cb5 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:18.377367 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a1ff7ebe-0a0b-4ba6-9268-55dda6d23cb5 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:18.378340 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a1ff7ebe-0a0b-4ba6-9268-55dda6d23cb5 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:18.379235 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a1ff7ebe-0a0b-4ba6-9268-55dda6d23cb5 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:18.379848 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a1ff7ebe-0a0b-4ba6-9268-55dda6d23cb5 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:18.380625 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a1ff7ebe-0a0b-4ba6-9268-55dda6d23cb5 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:18.505752 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-a1ff7ebe-0a0b-4ba6-9268-55dda6d23cb5 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:13:18.522197 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-a1ff7ebe-0a0b-4ba6-9268-55dda6d23cb5 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/ed4edd72-c2f2-4823-a8ec-274e9bc6ae98" status: 200 len: 1267 microversion: 2.1 time: 0.161129 Oct 04 22:13:18.523633 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2660/5382] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:13:18 2022] GET /compute/v2.1/servers/ed4edd72-c2f2-4823-a8ec-274e9bc6ae98 => generated 1267 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:13:18.935842 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-089eeb5a-e11d-462c-8c63-f6a8c3e43c89 tempest-VolumesGetTestJSON-43315534 tempest-VolumesGetTestJSON-43315534-project] Calling method '.version_select at 0x7fbb2e594160>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:19.065055 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-089eeb5a-e11d-462c-8c63-f6a8c3e43c89 tempest-VolumesGetTestJSON-43315534 tempest-VolumesGetTestJSON-43315534-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/7d408b0a-af09-44e2-8bed-d62f4eb93536" status: 200 len: 353 microversion: 2.1 time: 0.135607 Oct 04 22:13:19.066640 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2723/5383] 10.222.0.43 () {58 vars in 1245 bytes} [Tue Oct 4 22:13:18 2022] GET /compute/v2.1/os-volumes/7d408b0a-af09-44e2-8bed-d62f4eb93536 => generated 353 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:13:19.548024 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-3a422bb6-b6fe-4bf7-91b8-96289627e4a4 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:19.549221 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-3a422bb6-b6fe-4bf7-91b8-96289627e4a4 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: ed4edd72-c2f2-4823-a8ec-274e9bc6ae98] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:13:19.556895 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3a422bb6-b6fe-4bf7-91b8-96289627e4a4 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:19.557746 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3a422bb6-b6fe-4bf7-91b8-96289627e4a4 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:19.559007 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3a422bb6-b6fe-4bf7-91b8-96289627e4a4 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:19.560352 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3a422bb6-b6fe-4bf7-91b8-96289627e4a4 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:19.561895 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3a422bb6-b6fe-4bf7-91b8-96289627e4a4 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:19.562869 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3a422bb6-b6fe-4bf7-91b8-96289627e4a4 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:19.694470 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-3a422bb6-b6fe-4bf7-91b8-96289627e4a4 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:13:19.713301 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-3a422bb6-b6fe-4bf7-91b8-96289627e4a4 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/ed4edd72-c2f2-4823-a8ec-274e9bc6ae98" status: 200 len: 1273 microversion: 2.1 time: 0.167606 Oct 04 22:13:19.714523 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2661/5384] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:13:19 2022] GET /compute/v2.1/servers/ed4edd72-c2f2-4823-a8ec-274e9bc6ae98 => generated 1273 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:13:20.085737 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-431c51c7-9b85-451b-bbba-432255f81496 tempest-VolumesGetTestJSON-43315534 tempest-VolumesGetTestJSON-43315534-project] Calling method '.version_select at 0x7fbb2efd28b0>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:20.242668 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-3f5169f7-71e7-48ce-921e-6962eeac607e tempest-VolumesTestJSON-644152958 tempest-VolumesTestJSON-644152958-project] Calling method '.version_select at 0x7fbb2ee99ca0>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:20.301503 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-431c51c7-9b85-451b-bbba-432255f81496 tempest-VolumesGetTestJSON-43315534 tempest-VolumesGetTestJSON-43315534-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/7d408b0a-af09-44e2-8bed-d62f4eb93536" status: 200 len: 353 microversion: 2.1 time: 0.220457 Oct 04 22:13:20.308968 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2724/5385] 10.222.0.43 () {58 vars in 1245 bytes} [Tue Oct 4 22:13:20 2022] GET /compute/v2.1/os-volumes/7d408b0a-af09-44e2-8bed-d62f4eb93536 => generated 353 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:13:20.363775 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-3f5169f7-71e7-48ce-921e-6962eeac607e tempest-VolumesTestJSON-644152958 tempest-VolumesTestJSON-644152958-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/f895c6c7-6d40-4456-b7e6-c597b99da2eb" status: 200 len: 351 microversion: 2.1 time: 0.126678 Oct 04 22:13:20.364355 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2662/5386] 10.222.0.43 () {58 vars in 1245 bytes} [Tue Oct 4 22:13:20 2022] GET /compute/v2.1/os-volumes/f895c6c7-6d40-4456-b7e6-c597b99da2eb => generated 351 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:13:20.737765 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-daca0d11-9000-43b1-a05d-0d152a8f6056 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:20.738417 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-daca0d11-9000-43b1-a05d-0d152a8f6056 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: ed4edd72-c2f2-4823-a8ec-274e9bc6ae98] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:13:20.752191 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-daca0d11-9000-43b1-a05d-0d152a8f6056 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:20.752893 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-daca0d11-9000-43b1-a05d-0d152a8f6056 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:20.753470 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-daca0d11-9000-43b1-a05d-0d152a8f6056 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:20.754536 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-daca0d11-9000-43b1-a05d-0d152a8f6056 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:20.755135 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-daca0d11-9000-43b1-a05d-0d152a8f6056 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:20.755694 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-daca0d11-9000-43b1-a05d-0d152a8f6056 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:21.017075 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-daca0d11-9000-43b1-a05d-0d152a8f6056 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:13:21.025061 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-daca0d11-9000-43b1-a05d-0d152a8f6056 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/ed4edd72-c2f2-4823-a8ec-274e9bc6ae98" status: 200 len: 1315 microversion: 2.1 time: 0.291316 Oct 04 22:13:21.027140 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2725/5387] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:13:20 2022] GET /compute/v2.1/servers/ed4edd72-c2f2-4823-a8ec-274e9bc6ae98 => generated 1315 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:13:21.316611 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e788d075-bcb3-46bf-863e-e6b44bdaf5e5 tempest-VolumesGetTestJSON-43315534 tempest-VolumesGetTestJSON-43315534-project] Calling method '.version_select at 0x7fbb2db355e0>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:21.379282 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-e788d075-bcb3-46bf-863e-e6b44bdaf5e5 tempest-VolumesGetTestJSON-43315534 tempest-VolumesGetTestJSON-43315534-project] HTTP exception thrown: Volume 7d408b0a-af09-44e2-8bed-d62f4eb93536 could not be found. Oct 04 22:13:21.384564 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e788d075-bcb3-46bf-863e-e6b44bdaf5e5 tempest-VolumesGetTestJSON-43315534 tempest-VolumesGetTestJSON-43315534-project] Request method failure captured: Oct 04 22:13:21.384564 n-d-860284-1 devstack@n-api.service[134101]: request: GET /compute/v2.1/os-volumes/7d408b0a-af09-44e2-8bed-d62f4eb93536 HTTP/1.1 Oct 04 22:13:21.384564 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 22:13:21.384564 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 22:13:21.384564 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 22:13:21.384564 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 22:13:21.384564 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 22:13:21.384564 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 22:13:21.384564 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 22:13:21.384564 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 22:13:21.384564 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPK_5FV-nrj_BWI-vRlR--jrrKyqk_hfaDjwwl6Dl5HVQkVAoS702nOj_ejtVmD9heS4hPEEY0FQmQreUzuibNiM40IEbc-bTthoyjimvWOhz5G0mMFWzHMGMqZOi3d_vzaZn1AJhnHfDvwaGmbyfMzciiFYdPERZkfVH9IsGSrRBANU Oct 04 22:13:21.384564 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 22:13:21.384564 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 22:13:21.384564 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 22:13:21.384564 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 22:13:21.384564 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 22:13:21.384564 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 22:13:21.384564 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: 2d5d9a646986483a84bb133a40c971e0 Oct 04 22:13:21.384564 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-VolumesGetTestJSON-43315534 Oct 04 22:13:21.384564 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 22:13:21.384564 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 22:13:21.384564 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/2d5d9a646986483a84bb133a40c971e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_2d5d9a646986483a84bb133a40c971e0", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/2d5d9a646986483a84bb133a40c971e0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/2d5d9a646986483a84bb133a40c971e0"}]}] Oct 04 22:13:21.384564 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-VolumesGetTestJSON-43315534 Oct 04 22:13:21.384564 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: 2d5d9a646986483a84bb133a40c971e0 Oct 04 22:13:21.384564 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-VolumesGetTestJSON-43315534 Oct 04 22:13:21.384564 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-VolumesGetTestJSON-43315534-project Oct 04 22:13:21.384564 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 22:13:21.384564 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 22:13:21.384564 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 5f32961bab084e13b402e901b6dbf0cc Oct 04 22:13:21.384564 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-VolumesGetTestJSON-43315534-project Oct 04 22:13:21.384564 n-d-860284-1 devstack@n-api.service[134101]: method: Oct 04 22:13:21.384564 n-d-860284-1 devstack@n-api.service[134101]: exception: Volume 7d408b0a-af09-44e2-8bed-d62f4eb93536 could not be found. Oct 04 22:13:21.384564 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': '7d408b0a-af09-44e2-8bed-d62f4eb93536'} Oct 04 22:13:21.384564 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:13:21.384564 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:13:21.384564 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 22:13:21.384564 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 22:13:21.384564 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 22:13:21.384564 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 22:13:21.384564 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 22:13:21.384564 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 22:13:21.384564 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 22:13:21.384564 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 22:13:21.384564 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 22:13:21.384564 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 22:13:21.384564 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 22:13:21.384564 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 22:13:21.384564 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 22:13:21.384564 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 22:13:21.384564 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7d408b0a-af09-44e2-8bed-d62f4eb93536 could not be found. (HTTP 404) (Request-ID: req-569bd262-0360-41ff-9265-9f596c3ee2b3) Oct 04 22:13:21.384564 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:13:21.384564 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:13:21.384564 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:13:21.384564 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:13:21.384564 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 04 22:13:21.384564 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 04 22:13:21.384564 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 04 22:13:21.384564 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 04 22:13:21.384564 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 04 22:13:21.384564 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 04 22:13:21.384564 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 04 22:13:21.384564 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 04 22:13:21.384564 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 22:13:21.389957 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 22:13:21.389957 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 22:13:21.389957 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 22:13:21.389957 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 22:13:21.389957 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 22:13:21.389957 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 22:13:21.389957 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 22:13:21.389957 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 22:13:21.389957 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 22:13:21.389957 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 22:13:21.389957 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 22:13:21.389957 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 22:13:21.389957 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 22:13:21.389957 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7d408b0a-af09-44e2-8bed-d62f4eb93536 could not be found. Oct 04 22:13:21.389957 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:13:21.389957 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:13:21.389957 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:13:21.389957 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:13:21.389957 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:13:21.389957 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:13:21.389957 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:13:21.389957 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:13:21.389957 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 22:13:21.389957 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 22:13:21.389957 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:13:21.389957 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:13:21.389957 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 04 22:13:21.389957 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:13:21.389957 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7d408b0a-af09-44e2-8bed-d62f4eb93536 could not be found. Oct 04 22:13:21.389957 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:13:21.389957 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:13:21.389957 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:13:21.389957 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:13:21.389957 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:13:21.389957 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:13:21.389957 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:13:21.389957 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:13:21.389957 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7d408b0a-af09-44e2-8bed-d62f4eb93536 could not be found. Oct 04 22:13:21.389957 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:13:21.389957 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e788d075-bcb3-46bf-863e-e6b44bdaf5e5 tempest-VolumesGetTestJSON-43315534 tempest-VolumesGetTestJSON-43315534-project] Returning 404 to user: Volume 7d408b0a-af09-44e2-8bed-d62f4eb93536 could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:13:21.389957 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-e788d075-bcb3-46bf-863e-e6b44bdaf5e5 tempest-VolumesGetTestJSON-43315534 tempest-VolumesGetTestJSON-43315534-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/7d408b0a-af09-44e2-8bed-d62f4eb93536" status: 404 len: 109 microversion: 2.1 time: 0.072625 Oct 04 22:13:21.389957 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2663/5388] 10.222.0.43 () {58 vars in 1245 bytes} [Tue Oct 4 22:13:21 2022] GET /compute/v2.1/os-volumes/7d408b0a-af09-44e2-8bed-d62f4eb93536 => generated 109 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:13:21.789266 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-45d0059e-e26f-4133-9408-fa374c0478ce req-3bc472ba-caa4-42e3-bcb8-227820214384 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed4edd72-c2f2-4823-a8ec-274e9bc6ae98", "tag": "3d80fddc-0eaf-4faf-a7a0-9d49d2c52ae2"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:13:21.818801 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-45d0059e-e26f-4133-9408-fa374c0478ce req-3bc472ba-caa4-42e3-bcb8-227820214384 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:21.819294 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-45d0059e-e26f-4133-9408-fa374c0478ce req-3bc472ba-caa4-42e3-bcb8-227820214384 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:21.819730 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-45d0059e-e26f-4133-9408-fa374c0478ce req-3bc472ba-caa4-42e3-bcb8-227820214384 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:21.881005 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-45d0059e-e26f-4133-9408-fa374c0478ce req-3bc472ba-caa4-42e3-bcb8-227820214384 service nova] Creating event network-changed:3d80fddc-0eaf-4faf-a7a0-9d49d2c52ae2 for instance ed4edd72-c2f2-4823-a8ec-274e9bc6ae98 on n-h2-860284-1 Oct 04 22:13:21.896284 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-45d0059e-e26f-4133-9408-fa374c0478ce req-3bc472ba-caa4-42e3-bcb8-227820214384 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111228 Oct 04 22:13:21.897513 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2726/5389] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:13:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:13:22.055497 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-26c70266-ec69-4670-91c6-4eb3f0a73f7e tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:22.061420 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-26c70266-ec69-4670-91c6-4eb3f0a73f7e tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: ed4edd72-c2f2-4823-a8ec-274e9bc6ae98] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:13:22.091606 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-26c70266-ec69-4670-91c6-4eb3f0a73f7e tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:22.093808 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-26c70266-ec69-4670-91c6-4eb3f0a73f7e tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:22.099017 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-26c70266-ec69-4670-91c6-4eb3f0a73f7e tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:22.100915 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-26c70266-ec69-4670-91c6-4eb3f0a73f7e tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:22.101604 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-26c70266-ec69-4670-91c6-4eb3f0a73f7e tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:22.102275 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-26c70266-ec69-4670-91c6-4eb3f0a73f7e tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:22.700975 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-26c70266-ec69-4670-91c6-4eb3f0a73f7e tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:13:22.709197 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-26c70266-ec69-4670-91c6-4eb3f0a73f7e tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/ed4edd72-c2f2-4823-a8ec-274e9bc6ae98" status: 200 len: 1315 microversion: 2.1 time: 0.657363 Oct 04 22:13:22.715702 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2664/5390] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:13:22 2022] GET /compute/v2.1/servers/ed4edd72-c2f2-4823-a8ec-274e9bc6ae98 => generated 1315 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:13:23.118407 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-26542f89-b271-4d95-b70e-94c356100c5a tempest-VolumesTestJSON-644152958 tempest-VolumesTestJSON-644152958-project] Calling method '.version_select at 0x7fbb2efd2e50>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:23.189571 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-26542f89-b271-4d95-b70e-94c356100c5a tempest-VolumesTestJSON-644152958 tempest-VolumesTestJSON-644152958-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/8fce0185-f698-467e-9fa9-a37ba23e8096" status: 200 len: 350 microversion: 2.1 time: 0.075291 Oct 04 22:13:23.190253 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2727/5391] 10.222.0.43 () {58 vars in 1245 bytes} [Tue Oct 4 22:13:23 2022] GET /compute/v2.1/os-volumes/8fce0185-f698-467e-9fa9-a37ba23e8096 => generated 350 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:13:23.743875 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-c5813d6e-366d-4e16-96ce-02b6145dcfe1 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:23.744575 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-c5813d6e-366d-4e16-96ce-02b6145dcfe1 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: ed4edd72-c2f2-4823-a8ec-274e9bc6ae98] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:13:23.754396 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c5813d6e-366d-4e16-96ce-02b6145dcfe1 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:23.756485 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c5813d6e-366d-4e16-96ce-02b6145dcfe1 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:23.757201 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c5813d6e-366d-4e16-96ce-02b6145dcfe1 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:23.760307 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c5813d6e-366d-4e16-96ce-02b6145dcfe1 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:23.762827 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c5813d6e-366d-4e16-96ce-02b6145dcfe1 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:23.763393 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c5813d6e-366d-4e16-96ce-02b6145dcfe1 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:24.012451 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-c5813d6e-366d-4e16-96ce-02b6145dcfe1 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:13:24.021068 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-c5813d6e-366d-4e16-96ce-02b6145dcfe1 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/ed4edd72-c2f2-4823-a8ec-274e9bc6ae98" status: 200 len: 1315 microversion: 2.1 time: 0.281178 Oct 04 22:13:24.026842 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2665/5392] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:13:23 2022] GET /compute/v2.1/servers/ed4edd72-c2f2-4823-a8ec-274e9bc6ae98 => generated 1315 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:13:25.044738 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-b8e79a37-72bd-459b-bc6d-7645715236e5 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:25.046382 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-b8e79a37-72bd-459b-bc6d-7645715236e5 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: ed4edd72-c2f2-4823-a8ec-274e9bc6ae98] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:13:25.066462 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b8e79a37-72bd-459b-bc6d-7645715236e5 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:25.069844 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b8e79a37-72bd-459b-bc6d-7645715236e5 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:25.070340 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b8e79a37-72bd-459b-bc6d-7645715236e5 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:25.071115 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b8e79a37-72bd-459b-bc6d-7645715236e5 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:25.077391 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b8e79a37-72bd-459b-bc6d-7645715236e5 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:25.079230 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b8e79a37-72bd-459b-bc6d-7645715236e5 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:25.599105 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-b8e79a37-72bd-459b-bc6d-7645715236e5 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:13:25.610077 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-b8e79a37-72bd-459b-bc6d-7645715236e5 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/ed4edd72-c2f2-4823-a8ec-274e9bc6ae98" status: 200 len: 1315 microversion: 2.1 time: 0.569520 Oct 04 22:13:25.618760 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2728/5393] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:13:25 2022] GET /compute/v2.1/servers/ed4edd72-c2f2-4823-a8ec-274e9bc6ae98 => generated 1315 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:13:25.851237 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-0817580d-ad1f-49bf-8d98-766eaf79dc3c tempest-VolumesTestJSON-644152958 tempest-VolumesTestJSON-644152958-project] Calling method '.version_select at 0x7fbb2db13d30>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:26.002808 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-0817580d-ad1f-49bf-8d98-766eaf79dc3c tempest-VolumesTestJSON-644152958 tempest-VolumesTestJSON-644152958-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/e0f69b4f-fe54-4366-8acb-db310a9a0707" status: 200 len: 350 microversion: 2.1 time: 0.155866 Oct 04 22:13:26.004550 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2666/5394] 10.222.0.43 () {58 vars in 1245 bytes} [Tue Oct 4 22:13:25 2022] GET /compute/v2.1/os-volumes/e0f69b4f-fe54-4366-8acb-db310a9a0707 => generated 350 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:13:26.114988 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-ebba95a9-abdb-4ef5-9391-736764170f10 tempest-VolumesTestJSON-644152958 tempest-VolumesTestJSON-644152958-project] Calling method '.version_select at 0x7fbb2e4b6ca0>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:26.281771 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-ebba95a9-abdb-4ef5-9391-736764170f10 tempest-VolumesTestJSON-644152958 tempest-VolumesTestJSON-644152958-project] 10.222.0.43 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.171042 Oct 04 22:13:26.282648 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2729/5395] 10.222.0.43 () {58 vars in 1134 bytes} [Tue Oct 4 22:13:26 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:13:26.298584 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-0bed7225-b63b-4789-9b78-6ecf731848d0 tempest-VolumesTestJSON-644152958 tempest-VolumesTestJSON-644152958-project] Calling method '.version_select at 0x7fbb2db1e670>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:26.447225 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-0bed7225-b63b-4789-9b78-6ecf731848d0 tempest-VolumesTestJSON-644152958 tempest-VolumesTestJSON-644152958-project] 10.222.0.43 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.152704 Oct 04 22:13:26.447803 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2667/5396] 10.222.0.43 () {58 vars in 1149 bytes} [Tue Oct 4 22:13:26 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:13:26.462660 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-9fc26294-5aae-4c6e-bfe1-1d2829e0b375 tempest-VolumesTestJSON-644152958 tempest-VolumesTestJSON-644152958-project] Calling method '.version_select at 0x7fbb2f70d280>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:26.608487 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-9fc26294-5aae-4c6e-bfe1-1d2829e0b375 tempest-VolumesTestJSON-644152958 tempest-VolumesTestJSON-644152958-project] 10.222.0.43 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.150399 Oct 04 22:13:26.609149 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2730/5397] 10.222.0.43 () {58 vars in 1134 bytes} [Tue Oct 4 22:13:26 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:13:26.624833 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-2a2b4dbc-2b78-496f-8641-3bfac013b8ba tempest-VolumesTestJSON-644152958 tempest-VolumesTestJSON-644152958-project] Calling method '.version_select at 0x7fbb2e19f160>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:26.677398 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-4329be94-b6fa-4762-884d-7027cdd756ee tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:26.678462 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-4329be94-b6fa-4762-884d-7027cdd756ee tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: ed4edd72-c2f2-4823-a8ec-274e9bc6ae98] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:13:26.685656 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4329be94-b6fa-4762-884d-7027cdd756ee tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:26.686485 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4329be94-b6fa-4762-884d-7027cdd756ee tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:26.687091 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4329be94-b6fa-4762-884d-7027cdd756ee tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:26.688005 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4329be94-b6fa-4762-884d-7027cdd756ee tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:26.688643 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4329be94-b6fa-4762-884d-7027cdd756ee tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:26.689251 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4329be94-b6fa-4762-884d-7027cdd756ee tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:26.793688 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-2a2b4dbc-2b78-496f-8641-3bfac013b8ba tempest-VolumesTestJSON-644152958 tempest-VolumesTestJSON-644152958-project] 10.222.0.43 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.174167 Oct 04 22:13:26.794986 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2668/5398] 10.222.0.43 () {58 vars in 1167 bytes} [Tue Oct 4 22:13:26 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:13:26.811224 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-34a691b4-d87a-4a94-ae66-5bb867f42fac tempest-VolumesTestJSON-644152958 tempest-VolumesTestJSON-644152958-project] Calling method '.version_select at 0x7fbb2db13430>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:26.949977 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-4329be94-b6fa-4762-884d-7027cdd756ee tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:13:26.958676 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-4329be94-b6fa-4762-884d-7027cdd756ee tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/ed4edd72-c2f2-4823-a8ec-274e9bc6ae98" status: 200 len: 1315 microversion: 2.1 time: 0.302045 Oct 04 22:13:26.961074 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2731/5399] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:13:26 2022] GET /compute/v2.1/servers/ed4edd72-c2f2-4823-a8ec-274e9bc6ae98 => generated 1315 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:13:26.986207 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-34a691b4-d87a-4a94-ae66-5bb867f42fac tempest-VolumesTestJSON-644152958 tempest-VolumesTestJSON-644152958-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.179709 Oct 04 22:13:26.986989 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2669/5400] 10.222.0.43 () {58 vars in 1170 bytes} [Tue Oct 4 22:13:26 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:13:27.001346 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-fb6c4ccc-3128-4f87-a751-5650e58fc952 tempest-VolumesTestJSON-644152958 tempest-VolumesTestJSON-644152958-project] Calling method '.version_select at 0x7fbb2e5940d0>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:27.097324 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-fb6c4ccc-3128-4f87-a751-5650e58fc952 tempest-VolumesTestJSON-644152958 tempest-VolumesTestJSON-644152958-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.100158 Oct 04 22:13:27.098301 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2732/5401] 10.222.0.43 () {58 vars in 1155 bytes} [Tue Oct 4 22:13:26 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:13:27.110767 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=2 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:13:27.113491 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=6 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:13:27.119523 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-0f571379-9d27-49ce-992a-8d1c99a557ad tempest-VolumesTestJSON-644152958 tempest-VolumesTestJSON-644152958-project] Calling method '.version_select at 0x7fbb2e6a3670>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:27.208504 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-0f571379-9d27-49ce-992a-8d1c99a557ad tempest-VolumesTestJSON-644152958 tempest-VolumesTestJSON-644152958-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.098830 Oct 04 22:13:27.209084 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2670/5402] 10.222.0.43 () {58 vars in 1188 bytes} [Tue Oct 4 22:13:27 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:13:27.223755 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-40b7000d-390a-44d5-8d7b-7f713cbd4b98 tempest-VolumesTestJSON-644152958 tempest-VolumesTestJSON-644152958-project] Calling method '.version_select at 0x7fbb2e443940>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:27.316932 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-40b7000d-390a-44d5-8d7b-7f713cbd4b98 tempest-VolumesTestJSON-644152958 tempest-VolumesTestJSON-644152958-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.097738 Oct 04 22:13:27.318727 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2733/5403] 10.222.0.43 () {58 vars in 1155 bytes} [Tue Oct 4 22:13:27 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:13:27.986565 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-13f717e8-917e-45c8-8913-6bde8ad0e473 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:27.987350 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-13f717e8-917e-45c8-8913-6bde8ad0e473 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: ed4edd72-c2f2-4823-a8ec-274e9bc6ae98] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:13:27.997840 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-13f717e8-917e-45c8-8913-6bde8ad0e473 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:27.998476 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-13f717e8-917e-45c8-8913-6bde8ad0e473 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:27.999038 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-13f717e8-917e-45c8-8913-6bde8ad0e473 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:27.999851 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-13f717e8-917e-45c8-8913-6bde8ad0e473 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:28.000409 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-13f717e8-917e-45c8-8913-6bde8ad0e473 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:28.001528 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-13f717e8-917e-45c8-8913-6bde8ad0e473 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:28.093330 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-69d3036d-dc75-47f2-b4b7-b747562631a4 req-3ecee6b8-c954-4256-a75c-384178a354d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed4edd72-c2f2-4823-a8ec-274e9bc6ae98", "name": "network-vif-plugged", "status": "completed", "tag": "3d80fddc-0eaf-4faf-a7a0-9d49d2c52ae2"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:13:28.129380 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell0:SELECT=2 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:13:28.150074 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-69d3036d-dc75-47f2-b4b7-b747562631a4 req-3ecee6b8-c954-4256-a75c-384178a354d6 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:28.153290 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-69d3036d-dc75-47f2-b4b7-b747562631a4 req-3ecee6b8-c954-4256-a75c-384178a354d6 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:28.154270 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-69d3036d-dc75-47f2-b4b7-b747562631a4 req-3ecee6b8-c954-4256-a75c-384178a354d6 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:28.184178 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-69d3036d-dc75-47f2-b4b7-b747562631a4 req-3ecee6b8-c954-4256-a75c-384178a354d6 service nova] Creating event network-vif-plugged:3d80fddc-0eaf-4faf-a7a0-9d49d2c52ae2 for instance ed4edd72-c2f2-4823-a8ec-274e9bc6ae98 on n-h2-860284-1 Oct 04 22:13:28.199678 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-69d3036d-dc75-47f2-b4b7-b747562631a4 req-3ecee6b8-c954-4256-a75c-384178a354d6 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110136 Oct 04 22:13:28.201075 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2734/5404] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:13:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:13:28.274477 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-13f717e8-917e-45c8-8913-6bde8ad0e473 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:13:28.284861 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-13f717e8-917e-45c8-8913-6bde8ad0e473 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/ed4edd72-c2f2-4823-a8ec-274e9bc6ae98" status: 200 len: 1315 microversion: 2.1 time: 0.303255 Oct 04 22:13:28.286101 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2671/5405] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:13:27 2022] GET /compute/v2.1/servers/ed4edd72-c2f2-4823-a8ec-274e9bc6ae98 => generated 1315 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:13:29.315985 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-1997196c-907f-4268-99d1-693cccc4061a tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:29.316969 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-1997196c-907f-4268-99d1-693cccc4061a tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: ed4edd72-c2f2-4823-a8ec-274e9bc6ae98] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:13:29.336095 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1997196c-907f-4268-99d1-693cccc4061a tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:29.337841 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1997196c-907f-4268-99d1-693cccc4061a tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:29.341513 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1997196c-907f-4268-99d1-693cccc4061a tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:29.342782 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1997196c-907f-4268-99d1-693cccc4061a tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:29.343459 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1997196c-907f-4268-99d1-693cccc4061a tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:29.344605 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1997196c-907f-4268-99d1-693cccc4061a tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:29.708026 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-1997196c-907f-4268-99d1-693cccc4061a tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:13:29.732848 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-1997196c-907f-4268-99d1-693cccc4061a tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/ed4edd72-c2f2-4823-a8ec-274e9bc6ae98" status: 200 len: 1315 microversion: 2.1 time: 0.423902 Oct 04 22:13:29.750763 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2735/5406] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:13:29 2022] GET /compute/v2.1/servers/ed4edd72-c2f2-4823-a8ec-274e9bc6ae98 => generated 1315 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:13:30.780794 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-3bb0e279-be84-4259-b490-e9a593b7360c tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:30.782294 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-3bb0e279-be84-4259-b490-e9a593b7360c tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: ed4edd72-c2f2-4823-a8ec-274e9bc6ae98] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:13:30.808368 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3bb0e279-be84-4259-b490-e9a593b7360c tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:30.823347 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3bb0e279-be84-4259-b490-e9a593b7360c tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:30.830948 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3bb0e279-be84-4259-b490-e9a593b7360c tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:30.831920 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3bb0e279-be84-4259-b490-e9a593b7360c tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:30.832414 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3bb0e279-be84-4259-b490-e9a593b7360c tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:30.832860 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3bb0e279-be84-4259-b490-e9a593b7360c tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:31.198071 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-3bb0e279-be84-4259-b490-e9a593b7360c tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:13:31.230035 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-3bb0e279-be84-4259-b490-e9a593b7360c tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/ed4edd72-c2f2-4823-a8ec-274e9bc6ae98" status: 200 len: 1503 microversion: 2.1 time: 0.466174 Oct 04 22:13:31.240990 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2672/5407] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:13:30 2022] GET /compute/v2.1/servers/ed4edd72-c2f2-4823-a8ec-274e9bc6ae98 => generated 1503 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:13:31.264542 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-45b24e2b-1c65-4350-91eb-bc2e7769da31 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:13:31.265750 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-45b24e2b-1c65-4350-91eb-bc2e7769da31 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: ed4edd72-c2f2-4823-a8ec-274e9bc6ae98] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:13:31.274320 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-45b24e2b-1c65-4350-91eb-bc2e7769da31 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:31.275146 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-45b24e2b-1c65-4350-91eb-bc2e7769da31 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:31.275792 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-45b24e2b-1c65-4350-91eb-bc2e7769da31 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:31.276690 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-45b24e2b-1c65-4350-91eb-bc2e7769da31 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:31.278000 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-45b24e2b-1c65-4350-91eb-bc2e7769da31 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:31.278893 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-45b24e2b-1c65-4350-91eb-bc2e7769da31 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:31.588079 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.network.security_group_api [None req-45b24e2b-1c65-4350-91eb-bc2e7769da31 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Removing security group b3f1023f-67d7-4255-b4f5-8be586c196d9 from port 3d80fddc-0eaf-4faf-a7a0-9d49d2c52ae2 Oct 04 22:13:32.322901 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-45b24e2b-1c65-4350-91eb-bc2e7769da31 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "POST /compute/v2.1/servers/ed4edd72-c2f2-4823-a8ec-274e9bc6ae98/action" status: 202 len: 0 microversion: 2.1 time: 1.063246 Oct 04 22:13:32.324733 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2736/5408] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 22:13:31 2022] POST /compute/v2.1/servers/ed4edd72-c2f2-4823-a8ec-274e9bc6ae98/action => generated 0 bytes in 1066 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 22:13:32.333640 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-a63d1115-08c3-4784-b014-a202677ffe14 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:32.334867 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-a63d1115-08c3-4784-b014-a202677ffe14 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: ed4edd72-c2f2-4823-a8ec-274e9bc6ae98] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:13:32.347047 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a63d1115-08c3-4784-b014-a202677ffe14 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:32.348700 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a63d1115-08c3-4784-b014-a202677ffe14 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:32.350101 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a63d1115-08c3-4784-b014-a202677ffe14 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:32.352865 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a63d1115-08c3-4784-b014-a202677ffe14 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:32.353520 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a63d1115-08c3-4784-b014-a202677ffe14 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:32.354143 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a63d1115-08c3-4784-b014-a202677ffe14 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:32.646957 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-a63d1115-08c3-4784-b014-a202677ffe14 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:13:32.656036 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-a63d1115-08c3-4784-b014-a202677ffe14 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/ed4edd72-c2f2-4823-a8ec-274e9bc6ae98" status: 200 len: 1461 microversion: 2.1 time: 0.327263 Oct 04 22:13:32.665356 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2737/5409] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:13:32 2022] GET /compute/v2.1/servers/ed4edd72-c2f2-4823-a8ec-274e9bc6ae98 => generated 1461 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:13:32.670271 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-34e0cb97-0216-42e3-bfd9-dbdb7879681a req-77c4b3dc-a702-4b7a-9039-1aa392c3f1aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed4edd72-c2f2-4823-a8ec-274e9bc6ae98", "tag": "3d80fddc-0eaf-4faf-a7a0-9d49d2c52ae2"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:13:32.706798 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-34e0cb97-0216-42e3-bfd9-dbdb7879681a req-77c4b3dc-a702-4b7a-9039-1aa392c3f1aa service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:32.707457 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-34e0cb97-0216-42e3-bfd9-dbdb7879681a req-77c4b3dc-a702-4b7a-9039-1aa392c3f1aa service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:32.707924 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-34e0cb97-0216-42e3-bfd9-dbdb7879681a req-77c4b3dc-a702-4b7a-9039-1aa392c3f1aa service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:32.732241 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-34e0cb97-0216-42e3-bfd9-dbdb7879681a req-77c4b3dc-a702-4b7a-9039-1aa392c3f1aa service nova] Creating event network-changed:3d80fddc-0eaf-4faf-a7a0-9d49d2c52ae2 for instance ed4edd72-c2f2-4823-a8ec-274e9bc6ae98 on n-h2-860284-1 Oct 04 22:13:32.745125 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-34e0cb97-0216-42e3-bfd9-dbdb7879681a req-77c4b3dc-a702-4b7a-9039-1aa392c3f1aa service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075781 Oct 04 22:13:32.765704 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2738/5410] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:13:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:13:32.774173 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-0786e292-b185-4380-913c-e58ecea595d9 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:32.774945 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-0786e292-b185-4380-913c-e58ecea595d9 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 48243e1b-892b-4c4b-8db1-242b2e40653b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:13:32.799246 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0786e292-b185-4380-913c-e58ecea595d9 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:32.799753 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0786e292-b185-4380-913c-e58ecea595d9 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:32.800204 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0786e292-b185-4380-913c-e58ecea595d9 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:32.800933 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0786e292-b185-4380-913c-e58ecea595d9 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:32.801397 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0786e292-b185-4380-913c-e58ecea595d9 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:32.803194 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0786e292-b185-4380-913c-e58ecea595d9 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:32.820695 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-de7ba974-8316-4635-9089-c659fb1fb0e2 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:32.821711 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-de7ba974-8316-4635-9089-c659fb1fb0e2 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] [instance: 367dad85-827d-47b0-a468-418d398b36f9] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:13:32.829572 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-de7ba974-8316-4635-9089-c659fb1fb0e2 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:32.831086 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-de7ba974-8316-4635-9089-c659fb1fb0e2 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:32.847603 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-de7ba974-8316-4635-9089-c659fb1fb0e2 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:32.848800 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-de7ba974-8316-4635-9089-c659fb1fb0e2 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:32.851147 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-de7ba974-8316-4635-9089-c659fb1fb0e2 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:32.858401 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-de7ba974-8316-4635-9089-c659fb1fb0e2 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:33.036063 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-de7ba974-8316-4635-9089-c659fb1fb0e2 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] [instance: 367dad85-827d-47b0-a468-418d398b36f9] Going to try to terminate instance {{(pid=134101) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 22:13:33.243860 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-0786e292-b185-4380-913c-e58ecea595d9 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:13:33.253336 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-0786e292-b185-4380-913c-e58ecea595d9 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b" status: 200 len: 1669 microversion: 2.1 time: 0.486197 Oct 04 22:13:33.261899 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2739/5411] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:13:32 2022] GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b => generated 1669 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:13:33.289514 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-77979129-a3a7-4798-aa2e-d9f911ed434c tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:33.290350 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-77979129-a3a7-4798-aa2e-d9f911ed434c tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 48243e1b-892b-4c4b-8db1-242b2e40653b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:13:33.304299 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-77979129-a3a7-4798-aa2e-d9f911ed434c tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:33.305741 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-77979129-a3a7-4798-aa2e-d9f911ed434c tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:33.312597 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-77979129-a3a7-4798-aa2e-d9f911ed434c tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:33.314571 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-77979129-a3a7-4798-aa2e-d9f911ed434c tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:33.315322 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-77979129-a3a7-4798-aa2e-d9f911ed434c tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:33.317152 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-de7ba974-8316-4635-9089-c659fb1fb0e2 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] 10.222.0.43 "DELETE /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9" status: 204 len: 0 microversion: 2.32 time: 1.324345 Oct 04 22:13:33.317804 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2673/5412] 10.222.0.43 () {60 vars in 1280 bytes} [Tue Oct 4 22:13:31 2022] DELETE /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9 => generated 0 bytes in 1326 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 04 22:13:33.321653 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-77979129-a3a7-4798-aa2e-d9f911ed434c tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:33.369413 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-78a43c50-8ead-40cd-bfa2-716962f90edf tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:33.370193 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-78a43c50-8ead-40cd-bfa2-716962f90edf tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] [instance: 367dad85-827d-47b0-a468-418d398b36f9] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:13:33.387863 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-78a43c50-8ead-40cd-bfa2-716962f90edf tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:33.390555 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-78a43c50-8ead-40cd-bfa2-716962f90edf tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:33.392887 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-78a43c50-8ead-40cd-bfa2-716962f90edf tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:33.395009 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-78a43c50-8ead-40cd-bfa2-716962f90edf tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:33.396914 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-78a43c50-8ead-40cd-bfa2-716962f90edf tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:33.399042 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-78a43c50-8ead-40cd-bfa2-716962f90edf tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:33.750040 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-77979129-a3a7-4798-aa2e-d9f911ed434c tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:13:33.759946 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-77979129-a3a7-4798-aa2e-d9f911ed434c tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b" status: 200 len: 1669 microversion: 2.1 time: 0.474535 Oct 04 22:13:33.766200 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2740/5413] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:13:33 2022] GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b => generated 1669 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:13:33.792032 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-af46f439-c454-4c10-a188-92f3f0a1f165 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:33.793758 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-af46f439-c454-4c10-a188-92f3f0a1f165 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 48243e1b-892b-4c4b-8db1-242b2e40653b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:13:33.807225 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-af46f439-c454-4c10-a188-92f3f0a1f165 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:33.810279 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-af46f439-c454-4c10-a188-92f3f0a1f165 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:33.811514 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-af46f439-c454-4c10-a188-92f3f0a1f165 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:33.815277 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-af46f439-c454-4c10-a188-92f3f0a1f165 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:33.816053 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-af46f439-c454-4c10-a188-92f3f0a1f165 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:33.816744 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-af46f439-c454-4c10-a188-92f3f0a1f165 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:33.854179 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-78a43c50-8ead-40cd-bfa2-716962f90edf tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:13:33.869708 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-78a43c50-8ead-40cd-bfa2-716962f90edf tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:13:33.876261 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-78a43c50-8ead-40cd-bfa2-716962f90edf tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:13:33.880839 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-78a43c50-8ead-40cd-bfa2-716962f90edf tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] 10.222.0.43 "GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9" status: 200 len: 2953 microversion: 2.32 time: 0.532074 Oct 04 22:13:33.882437 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2674/5414] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:13:33 2022] GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9 => generated 2953 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:13:34.089204 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-af46f439-c454-4c10-a188-92f3f0a1f165 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:13:34.101060 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-af46f439-c454-4c10-a188-92f3f0a1f165 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b" status: 200 len: 1669 microversion: 2.1 time: 0.313419 Oct 04 22:13:34.102300 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2741/5415] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:13:33 2022] GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b => generated 1669 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:13:34.124956 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-18a5acc2-eb07-4971-81ab-529a32d55300 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:34.125586 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-18a5acc2-eb07-4971-81ab-529a32d55300 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 48243e1b-892b-4c4b-8db1-242b2e40653b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:13:34.160290 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-18a5acc2-eb07-4971-81ab-529a32d55300 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:34.160802 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-18a5acc2-eb07-4971-81ab-529a32d55300 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:34.161494 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-18a5acc2-eb07-4971-81ab-529a32d55300 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:34.162233 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-18a5acc2-eb07-4971-81ab-529a32d55300 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:34.162722 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-18a5acc2-eb07-4971-81ab-529a32d55300 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:34.163161 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-18a5acc2-eb07-4971-81ab-529a32d55300 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:34.541320 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-18a5acc2-eb07-4971-81ab-529a32d55300 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:13:34.555016 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-18a5acc2-eb07-4971-81ab-529a32d55300 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b" status: 200 len: 1669 microversion: 2.1 time: 0.432425 Oct 04 22:13:34.555724 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2675/5416] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:13:34 2022] GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b => generated 1669 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:13:34.757414 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-632f1b68-d8d1-4543-9f50-3b82627931dd tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-160482375", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452", "networks": [{"uuid": "46f1773f-94f8-4a79-8019-a2303221d351"}]}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:13:34.850193 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.network.neutron [None req-632f1b68-d8d1-4543-9f50-3b82627931dd tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] validate_networks() for [('46f1773f-94f8-4a79-8019-a2303221d351', None, None, None, None, None)] {{(pid=134102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 22:13:34.915229 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-a91202ba-9515-43f9-b312-b4b06897151c tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:34.915855 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-a91202ba-9515-43f9-b312-b4b06897151c tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] [instance: 367dad85-827d-47b0-a468-418d398b36f9] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:13:34.928126 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a91202ba-9515-43f9-b312-b4b06897151c tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:34.928657 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a91202ba-9515-43f9-b312-b4b06897151c tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:34.929097 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a91202ba-9515-43f9-b312-b4b06897151c tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:34.930043 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a91202ba-9515-43f9-b312-b4b06897151c tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:34.933609 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a91202ba-9515-43f9-b312-b4b06897151c tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:34.934965 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a91202ba-9515-43f9-b312-b4b06897151c tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:36.085698 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-a91202ba-9515-43f9-b312-b4b06897151c tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:13:36.112795 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-a91202ba-9515-43f9-b312-b4b06897151c tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:13:36.137990 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-a91202ba-9515-43f9-b312-b4b06897151c tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:13:36.141988 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-a91202ba-9515-43f9-b312-b4b06897151c tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] 10.222.0.43 "GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9" status: 200 len: 2953 microversion: 2.32 time: 1.230926 Oct 04 22:13:36.147831 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2676/5417] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:13:34 2022] GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9 => generated 2953 bytes in 1237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 22:13:37.008627 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-632f1b68-d8d1-4543-9f50-3b82627931dd tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Flavor limits 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 22:13:37.009175 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-632f1b68-d8d1-4543-9f50-3b82627931dd tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Image limits 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 22:13:37.009532 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-632f1b68-d8d1-4543-9f50-3b82627931dd tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Flavor pref 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 22:13:37.009950 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-632f1b68-d8d1-4543-9f50-3b82627931dd tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Image pref 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 22:13:37.010418 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-632f1b68-d8d1-4543-9f50-3b82627931dd tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 22:13:37.027683 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-632f1b68-d8d1-4543-9f50-3b82627931dd tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:37.028245 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-632f1b68-d8d1-4543-9f50-3b82627931dd tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:37.028750 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-632f1b68-d8d1-4543-9f50-3b82627931dd tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:37.041350 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-632f1b68-d8d1-4543-9f50-3b82627931dd tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:37.041852 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-632f1b68-d8d1-4543-9f50-3b82627931dd tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:37.042296 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-632f1b68-d8d1-4543-9f50-3b82627931dd tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:37.114645 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-632f1b68-d8d1-4543-9f50-3b82627931dd tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Getting quotas for project 9da7a77590054a3c911643db69a0beae. Resources: {'instances', 'ram', 'cores'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:13:37.134501 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-632f1b68-d8d1-4543-9f50-3b82627931dd tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Getting quotas for user 836cb8e2e7be4981bb266cbd4189a775 and project 9da7a77590054a3c911643db69a0beae. Resources: {'instances', 'ram', 'cores'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:13:37.175803 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-bef06822-1f1e-4b10-9655-01983c3f419c tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:37.177836 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-bef06822-1f1e-4b10-9655-01983c3f419c tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] [instance: 367dad85-827d-47b0-a468-418d398b36f9] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:13:37.180338 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-632f1b68-d8d1-4543-9f50-3b82627931dd tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Going to run 1 instances... {{(pid=134102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 22:13:37.184631 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-632f1b68-d8d1-4543-9f50-3b82627931dd tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 20a57394-a798-4356-8b70-3615f9de588e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='58548514-5dac-426c-81f5-19e3fba33e23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 22:13:37.206124 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bef06822-1f1e-4b10-9655-01983c3f419c tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:37.208620 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bef06822-1f1e-4b10-9655-01983c3f419c tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:37.211847 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bef06822-1f1e-4b10-9655-01983c3f419c tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:37.214990 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bef06822-1f1e-4b10-9655-01983c3f419c tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:37.219194 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bef06822-1f1e-4b10-9655-01983c3f419c tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:37.223790 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bef06822-1f1e-4b10-9655-01983c3f419c tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:37.308734 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-632f1b68-d8d1-4543-9f50-3b82627931dd tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.555888 Oct 04 22:13:37.318583 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2742/5418] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 22:13:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 2562 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 22:13:37.326208 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-00dd61a2-b912-47c3-91e1-9c5fc39e8f31 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:37.332529 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-00dd61a2-b912-47c3-91e1-9c5fc39e8f31 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 20a57394-a798-4356-8b70-3615f9de588e] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:13:37.572140 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-00dd61a2-b912-47c3-91e1-9c5fc39e8f31 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:13:37.584983 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-00dd61a2-b912-47c3-91e1-9c5fc39e8f31 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/20a57394-a798-4356-8b70-3615f9de588e" status: 200 len: 1214 microversion: 2.1 time: 0.264378 Oct 04 22:13:37.586462 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2743/5419] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:13:37 2022] GET /compute/v2.1/servers/20a57394-a798-4356-8b70-3615f9de588e => generated 1214 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:13:37.868542 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-bef06822-1f1e-4b10-9655-01983c3f419c tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:13:37.900674 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-bef06822-1f1e-4b10-9655-01983c3f419c tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:13:37.910244 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-bef06822-1f1e-4b10-9655-01983c3f419c tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:13:37.916577 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-bef06822-1f1e-4b10-9655-01983c3f419c tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] 10.222.0.43 "GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9" status: 200 len: 2953 microversion: 2.32 time: 0.747376 Oct 04 22:13:37.923404 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2677/5420] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:13:37 2022] GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9 => generated 2953 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:13:38.621366 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-8e254fb5-11b8-4ecb-a642-d596581533ba tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:38.622976 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-8e254fb5-11b8-4ecb-a642-d596581533ba tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 20a57394-a798-4356-8b70-3615f9de588e] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:13:38.643424 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8e254fb5-11b8-4ecb-a642-d596581533ba tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:38.645279 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8e254fb5-11b8-4ecb-a642-d596581533ba tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:38.646623 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8e254fb5-11b8-4ecb-a642-d596581533ba tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:38.647802 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8e254fb5-11b8-4ecb-a642-d596581533ba tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:38.650468 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8e254fb5-11b8-4ecb-a642-d596581533ba tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:38.651018 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8e254fb5-11b8-4ecb-a642-d596581533ba tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:38.850416 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-8e254fb5-11b8-4ecb-a642-d596581533ba tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:13:38.858892 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-8e254fb5-11b8-4ecb-a642-d596581533ba tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/20a57394-a798-4356-8b70-3615f9de588e" status: 200 len: 1210 microversion: 2.1 time: 0.246071 Oct 04 22:13:38.863641 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2744/5421] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:13:38 2022] GET /compute/v2.1/servers/20a57394-a798-4356-8b70-3615f9de588e => generated 1210 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:13:38.958009 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-12155038-f6de-4b1f-b873-a687c3d68d1c tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:38.958670 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-12155038-f6de-4b1f-b873-a687c3d68d1c tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] [instance: 367dad85-827d-47b0-a468-418d398b36f9] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:13:38.970075 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-12155038-f6de-4b1f-b873-a687c3d68d1c tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:38.970906 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-12155038-f6de-4b1f-b873-a687c3d68d1c tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:38.971677 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-12155038-f6de-4b1f-b873-a687c3d68d1c tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:38.972576 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-12155038-f6de-4b1f-b873-a687c3d68d1c tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:38.973211 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-12155038-f6de-4b1f-b873-a687c3d68d1c tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:38.973975 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-12155038-f6de-4b1f-b873-a687c3d68d1c tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:39.320061 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-12155038-f6de-4b1f-b873-a687c3d68d1c tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:13:39.348421 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-12155038-f6de-4b1f-b873-a687c3d68d1c tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:13:39.350484 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-12155038-f6de-4b1f-b873-a687c3d68d1c tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:13:39.357464 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-12155038-f6de-4b1f-b873-a687c3d68d1c tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] 10.222.0.43 "GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9" status: 200 len: 2932 microversion: 2.32 time: 0.404117 Oct 04 22:13:39.359809 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2678/5422] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:13:38 2022] GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9 => generated 2932 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:13:39.898212 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-17abdccb-5c33-4990-be86-d4e1740d8313 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:39.898859 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-17abdccb-5c33-4990-be86-d4e1740d8313 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 20a57394-a798-4356-8b70-3615f9de588e] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:13:39.920552 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-17abdccb-5c33-4990-be86-d4e1740d8313 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:39.920662 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-17abdccb-5c33-4990-be86-d4e1740d8313 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:39.928035 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-17abdccb-5c33-4990-be86-d4e1740d8313 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:39.929195 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-17abdccb-5c33-4990-be86-d4e1740d8313 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:39.930938 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-17abdccb-5c33-4990-be86-d4e1740d8313 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:39.939086 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-17abdccb-5c33-4990-be86-d4e1740d8313 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:40.046511 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-33117b2c-8c82-4e2b-aff0-53751e453169 req-695e9910-734f-4629-94ac-559a48f80109 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "367dad85-827d-47b0-a468-418d398b36f9", "name": "network-vif-unplugged", "status": "completed", "tag": "8a1449d2-6f50-4eb8-b168-4134f5622384"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:13:40.089955 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-33117b2c-8c82-4e2b-aff0-53751e453169 req-695e9910-734f-4629-94ac-559a48f80109 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:40.090547 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-33117b2c-8c82-4e2b-aff0-53751e453169 req-695e9910-734f-4629-94ac-559a48f80109 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:40.090996 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-33117b2c-8c82-4e2b-aff0-53751e453169 req-695e9910-734f-4629-94ac-559a48f80109 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:40.154065 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-33117b2c-8c82-4e2b-aff0-53751e453169 req-695e9910-734f-4629-94ac-559a48f80109 service nova] Creating event network-vif-unplugged:8a1449d2-6f50-4eb8-b168-4134f5622384 for instance 367dad85-827d-47b0-a468-418d398b36f9 on n-h1-860284-1 Oct 04 22:13:40.169660 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-17abdccb-5c33-4990-be86-d4e1740d8313 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:13:40.180158 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-33117b2c-8c82-4e2b-aff0-53751e453169 req-695e9910-734f-4629-94ac-559a48f80109 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.151447 Oct 04 22:13:40.180781 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2679/5423] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:13:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:13:40.182310 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-17abdccb-5c33-4990-be86-d4e1740d8313 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/20a57394-a798-4356-8b70-3615f9de588e" status: 200 len: 1272 microversion: 2.1 time: 0.296986 Oct 04 22:13:40.203503 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2745/5424] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:13:39 2022] GET /compute/v2.1/servers/20a57394-a798-4356-8b70-3615f9de588e => generated 1272 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:13:40.392463 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-c6cdb437-69da-4500-824f-76d669dbd595 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:40.393265 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-c6cdb437-69da-4500-824f-76d669dbd595 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] [instance: 367dad85-827d-47b0-a468-418d398b36f9] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:13:40.412193 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c6cdb437-69da-4500-824f-76d669dbd595 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:40.418089 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c6cdb437-69da-4500-824f-76d669dbd595 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:40.419408 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c6cdb437-69da-4500-824f-76d669dbd595 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:40.425347 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c6cdb437-69da-4500-824f-76d669dbd595 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:40.428133 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c6cdb437-69da-4500-824f-76d669dbd595 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:40.428839 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c6cdb437-69da-4500-824f-76d669dbd595 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:40.450657 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:13:41.215028 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-6611f0f4-21da-434e-945b-dd6b53e5ca43 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:41.216351 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-6611f0f4-21da-434e-945b-dd6b53e5ca43 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 20a57394-a798-4356-8b70-3615f9de588e] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:13:41.225843 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=3 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:13:41.232844 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6611f0f4-21da-434e-945b-dd6b53e5ca43 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:41.238058 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6611f0f4-21da-434e-945b-dd6b53e5ca43 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:41.238785 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6611f0f4-21da-434e-945b-dd6b53e5ca43 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:41.239722 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6611f0f4-21da-434e-945b-dd6b53e5ca43 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:41.244686 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6611f0f4-21da-434e-945b-dd6b53e5ca43 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:41.245347 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6611f0f4-21da-434e-945b-dd6b53e5ca43 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:41.261781 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=85 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:13:41.529426 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-c6cdb437-69da-4500-824f-76d669dbd595 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:13:41.565340 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-c6cdb437-69da-4500-824f-76d669dbd595 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:13:41.573652 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-c6cdb437-69da-4500-824f-76d669dbd595 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:13:41.580405 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-c6cdb437-69da-4500-824f-76d669dbd595 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] 10.222.0.43 "GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9" status: 200 len: 2911 microversion: 2.32 time: 1.193634 Oct 04 22:13:41.581736 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2680/5425] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:13:40 2022] GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9 => generated 2911 bytes in 1197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:13:41.604922 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-96005657-86c4-42da-a507-75933d40ae8a req-46c2e105-91bc-443f-b7d7-02da59be3411 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "367dad85-827d-47b0-a468-418d398b36f9", "name": "network-vif-deleted", "tag": "2185372b-2bf8-48af-a686-257c42659538"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:13:41.659391 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-96005657-86c4-42da-a507-75933d40ae8a req-46c2e105-91bc-443f-b7d7-02da59be3411 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:41.661964 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-96005657-86c4-42da-a507-75933d40ae8a req-46c2e105-91bc-443f-b7d7-02da59be3411 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:41.662500 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-96005657-86c4-42da-a507-75933d40ae8a req-46c2e105-91bc-443f-b7d7-02da59be3411 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:41.712983 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-96005657-86c4-42da-a507-75933d40ae8a req-46c2e105-91bc-443f-b7d7-02da59be3411 service nova] Creating event network-vif-deleted:2185372b-2bf8-48af-a686-257c42659538 for instance 367dad85-827d-47b0-a468-418d398b36f9 on n-h1-860284-1 Oct 04 22:13:41.728452 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-96005657-86c4-42da-a507-75933d40ae8a req-46c2e105-91bc-443f-b7d7-02da59be3411 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.141861 Oct 04 22:13:41.731873 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2681/5426] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:13:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:13:42.175403 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-6611f0f4-21da-434e-945b-dd6b53e5ca43 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:13:42.200575 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-6611f0f4-21da-434e-945b-dd6b53e5ca43 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/20a57394-a798-4356-8b70-3615f9de588e" status: 200 len: 1314 microversion: 2.1 time: 0.991005 Oct 04 22:13:42.205797 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2746/5427] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:13:41 2022] GET /compute/v2.1/servers/20a57394-a798-4356-8b70-3615f9de588e => generated 1314 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:13:42.257705 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-7372c6ef-2810-4e04-95a5-4243a9f52e12 req-a17fa6a1-2e31-4e71-8160-0011e90acb49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "367dad85-827d-47b0-a468-418d398b36f9", "name": "network-vif-unplugged", "status": "completed", "tag": "7400e0ba-5b25-45e1-a43e-d44f730f5d6c"}, {"server_uuid": "367dad85-827d-47b0-a468-418d398b36f9", "name": "network-vif-unplugged", "status": "completed", "tag": "bc487837-1357-4c07-964b-174fe9476f33"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:13:42.288152 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:13:42.296062 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-7372c6ef-2810-4e04-95a5-4243a9f52e12 req-a17fa6a1-2e31-4e71-8160-0011e90acb49 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:42.298734 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-7372c6ef-2810-4e04-95a5-4243a9f52e12 req-a17fa6a1-2e31-4e71-8160-0011e90acb49 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:42.300962 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-7372c6ef-2810-4e04-95a5-4243a9f52e12 req-a17fa6a1-2e31-4e71-8160-0011e90acb49 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:42.334447 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-7372c6ef-2810-4e04-95a5-4243a9f52e12 req-a17fa6a1-2e31-4e71-8160-0011e90acb49 service nova] Creating event network-vif-unplugged:7400e0ba-5b25-45e1-a43e-d44f730f5d6c for instance 367dad85-827d-47b0-a468-418d398b36f9 on n-h1-860284-1 Oct 04 22:13:42.341974 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-7372c6ef-2810-4e04-95a5-4243a9f52e12 req-a17fa6a1-2e31-4e71-8160-0011e90acb49 service nova] Creating event network-vif-unplugged:bc487837-1357-4c07-964b-174fe9476f33 for instance 367dad85-827d-47b0-a468-418d398b36f9 on n-h1-860284-1 Oct 04 22:13:42.360395 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-7372c6ef-2810-4e04-95a5-4243a9f52e12 req-a17fa6a1-2e31-4e71-8160-0011e90acb49 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.110170 Oct 04 22:13:42.361305 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2682/5428] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:13:42 2022] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:13:42.613275 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-1991ce7c-c3a4-4513-940a-2b0b744b9a23 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:42.613905 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-1991ce7c-c3a4-4513-940a-2b0b744b9a23 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] [instance: 367dad85-827d-47b0-a468-418d398b36f9] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:13:42.627712 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1991ce7c-c3a4-4513-940a-2b0b744b9a23 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:42.631634 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1991ce7c-c3a4-4513-940a-2b0b744b9a23 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:42.632266 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1991ce7c-c3a4-4513-940a-2b0b744b9a23 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:42.635223 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1991ce7c-c3a4-4513-940a-2b0b744b9a23 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:42.640576 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1991ce7c-c3a4-4513-940a-2b0b744b9a23 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:42.642917 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1991ce7c-c3a4-4513-940a-2b0b744b9a23 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:43.054284 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-1991ce7c-c3a4-4513-940a-2b0b744b9a23 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:13:43.067700 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-1991ce7c-c3a4-4513-940a-2b0b744b9a23 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:13:43.070186 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-1991ce7c-c3a4-4513-940a-2b0b744b9a23 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:13:43.072147 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-1991ce7c-c3a4-4513-940a-2b0b744b9a23 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] 10.222.0.43 "GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9" status: 200 len: 2752 microversion: 2.32 time: 0.462474 Oct 04 22:13:43.088227 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2747/5429] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:13:42 2022] GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9 => generated 2752 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:13:43.133927 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-4dd1231a-cd77-466d-a964-9e8390a8a451 req-6cd5e826-04eb-4151-a107-c891c5ff167e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20a57394-a798-4356-8b70-3615f9de588e", "tag": "05ea2c3e-5db0-459a-b0b2-b3d8186a59f0"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:13:43.157508 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-4dd1231a-cd77-466d-a964-9e8390a8a451 req-6cd5e826-04eb-4151-a107-c891c5ff167e service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:43.157825 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-4dd1231a-cd77-466d-a964-9e8390a8a451 req-6cd5e826-04eb-4151-a107-c891c5ff167e service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:43.158438 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-4dd1231a-cd77-466d-a964-9e8390a8a451 req-6cd5e826-04eb-4151-a107-c891c5ff167e service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:43.172812 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-4dd1231a-cd77-466d-a964-9e8390a8a451 req-6cd5e826-04eb-4151-a107-c891c5ff167e service nova] Creating event network-changed:05ea2c3e-5db0-459a-b0b2-b3d8186a59f0 for instance 20a57394-a798-4356-8b70-3615f9de588e on n-h2-860284-1 Oct 04 22:13:43.177953 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-4dd1231a-cd77-466d-a964-9e8390a8a451 req-6cd5e826-04eb-4151-a107-c891c5ff167e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051430 Oct 04 22:13:43.179015 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2683/5430] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:13:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:13:43.253928 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-7841302e-902f-4331-943d-a64ad76b10ee tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:43.255771 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-7841302e-902f-4331-943d-a64ad76b10ee tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 20a57394-a798-4356-8b70-3615f9de588e] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:13:43.277586 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7841302e-902f-4331-943d-a64ad76b10ee tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:43.278287 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7841302e-902f-4331-943d-a64ad76b10ee tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:43.284554 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7841302e-902f-4331-943d-a64ad76b10ee tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:43.285773 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7841302e-902f-4331-943d-a64ad76b10ee tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:43.290314 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7841302e-902f-4331-943d-a64ad76b10ee tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:43.291816 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7841302e-902f-4331-943d-a64ad76b10ee tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:43.697726 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-7841302e-902f-4331-943d-a64ad76b10ee tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:13:43.699399 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-03e392f9-20a0-43f6-9a41-7fd59cc04812 tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-726258379", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:13:43.715486 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-7841302e-902f-4331-943d-a64ad76b10ee tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/20a57394-a798-4356-8b70-3615f9de588e" status: 200 len: 1314 microversion: 2.1 time: 0.473136 Oct 04 22:13:43.738708 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2748/5431] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:13:43 2022] GET /compute/v2.1/servers/20a57394-a798-4356-8b70-3615f9de588e => generated 1314 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:13:43.769761 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-330a5433-a7c6-4ae4-87d2-473d93d7018f req-93d7adfc-5a09-4231-98cb-e96423116d71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "367dad85-827d-47b0-a468-418d398b36f9", "name": "network-vif-deleted", "tag": "7400e0ba-5b25-45e1-a43e-d44f730f5d6c"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:13:43.787201 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-330a5433-a7c6-4ae4-87d2-473d93d7018f req-93d7adfc-5a09-4231-98cb-e96423116d71 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:43.788074 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-330a5433-a7c6-4ae4-87d2-473d93d7018f req-93d7adfc-5a09-4231-98cb-e96423116d71 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:43.788706 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-330a5433-a7c6-4ae4-87d2-473d93d7018f req-93d7adfc-5a09-4231-98cb-e96423116d71 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:43.794752 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.network.neutron [None req-03e392f9-20a0-43f6-9a41-7fd59cc04812 tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] validate_networks() for None {{(pid=134101) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 22:13:43.806028 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-330a5433-a7c6-4ae4-87d2-473d93d7018f req-93d7adfc-5a09-4231-98cb-e96423116d71 service nova] Creating event network-vif-deleted:7400e0ba-5b25-45e1-a43e-d44f730f5d6c for instance 367dad85-827d-47b0-a468-418d398b36f9 on n-h1-860284-1 Oct 04 22:13:43.812937 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-330a5433-a7c6-4ae4-87d2-473d93d7018f req-93d7adfc-5a09-4231-98cb-e96423116d71 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046703 Oct 04 22:13:43.814574 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2749/5432] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:13:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:13:44.110586 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-fe81ff9a-334b-41d6-98f3-d433492345fa tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:44.110586 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-fe81ff9a-334b-41d6-98f3-d433492345fa tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] [instance: 367dad85-827d-47b0-a468-418d398b36f9] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:13:44.113925 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fe81ff9a-334b-41d6-98f3-d433492345fa tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:44.114670 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fe81ff9a-334b-41d6-98f3-d433492345fa tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:44.115288 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fe81ff9a-334b-41d6-98f3-d433492345fa tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:44.116025 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fe81ff9a-334b-41d6-98f3-d433492345fa tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:44.116668 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fe81ff9a-334b-41d6-98f3-d433492345fa tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:44.117140 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fe81ff9a-334b-41d6-98f3-d433492345fa tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:44.395397 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-03e392f9-20a0-43f6-9a41-7fd59cc04812 tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] Flavor limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 22:13:44.397206 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-03e392f9-20a0-43f6-9a41-7fd59cc04812 tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] Image limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 22:13:44.401290 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-03e392f9-20a0-43f6-9a41-7fd59cc04812 tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] Flavor pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 22:13:44.402428 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-03e392f9-20a0-43f6-9a41-7fd59cc04812 tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] Image pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 22:13:44.403890 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-03e392f9-20a0-43f6-9a41-7fd59cc04812 tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 22:13:44.428107 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-03e392f9-20a0-43f6-9a41-7fd59cc04812 tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:44.429206 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-03e392f9-20a0-43f6-9a41-7fd59cc04812 tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:44.429864 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-03e392f9-20a0-43f6-9a41-7fd59cc04812 tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:44.433088 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-03e392f9-20a0-43f6-9a41-7fd59cc04812 tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:44.433188 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-03e392f9-20a0-43f6-9a41-7fd59cc04812 tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:44.433930 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-03e392f9-20a0-43f6-9a41-7fd59cc04812 tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:44.484614 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-03e392f9-20a0-43f6-9a41-7fd59cc04812 tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] Getting quotas for project cc18681ca2974a54a172cbc727158883. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:13:44.499984 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-03e392f9-20a0-43f6-9a41-7fd59cc04812 tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] Getting quotas for user b6ba7c8167fd40e6878f7f2af9fa869c and project cc18681ca2974a54a172cbc727158883. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:13:44.530666 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-03e392f9-20a0-43f6-9a41-7fd59cc04812 tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] Going to run 1 instances... {{(pid=134101) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 22:13:44.537265 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-03e392f9-20a0-43f6-9a41-7fd59cc04812 tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] [instance: 1346709b-155a-4048-86ca-f1b08c9d5710] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='58548514-5dac-426c-81f5-19e3fba33e23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134101) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 22:13:44.616461 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-03e392f9-20a0-43f6-9a41-7fd59cc04812 tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.930013 Oct 04 22:13:44.617655 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2684/5433] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 22:13:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 932 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 22:13:44.634431 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-a388d187-be99-4704-b263-8022a9d071d5 req-ec1a7a2a-61d1-4111-960f-d0c7c96870b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "367dad85-827d-47b0-a468-418d398b36f9", "name": "network-vif-unplugged", "status": "completed", "tag": "1701ea5d-b8bb-4192-8463-7dfa341dc8c3"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:13:44.665467 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-a388d187-be99-4704-b263-8022a9d071d5 req-ec1a7a2a-61d1-4111-960f-d0c7c96870b9 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:44.665972 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-a388d187-be99-4704-b263-8022a9d071d5 req-ec1a7a2a-61d1-4111-960f-d0c7c96870b9 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:44.666442 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-a388d187-be99-4704-b263-8022a9d071d5 req-ec1a7a2a-61d1-4111-960f-d0c7c96870b9 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:44.684147 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-a388d187-be99-4704-b263-8022a9d071d5 req-ec1a7a2a-61d1-4111-960f-d0c7c96870b9 service nova] Creating event network-vif-unplugged:1701ea5d-b8bb-4192-8463-7dfa341dc8c3 for instance 367dad85-827d-47b0-a468-418d398b36f9 on n-h1-860284-1 Oct 04 22:13:44.692511 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-a388d187-be99-4704-b263-8022a9d071d5 req-ec1a7a2a-61d1-4111-960f-d0c7c96870b9 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.072027 Oct 04 22:13:44.693414 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2685/5434] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:13:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:13:44.701370 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-df306466-3829-4c41-9378-09cc3a892292 tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:44.702903 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-df306466-3829-4c41-9378-09cc3a892292 tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] [instance: 1346709b-155a-4048-86ca-f1b08c9d5710] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:13:44.945941 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-df306466-3829-4c41-9378-09cc3a892292 tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ba7c8167fd40e6878f7f2af9fa869c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc18681ca2974a54a172cbc727158883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:13:44.969631 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-df306466-3829-4c41-9378-09cc3a892292 tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] 10.222.0.43 "GET /compute/v2.1/servers/1346709b-155a-4048-86ca-f1b08c9d5710" status: 200 len: 1213 microversion: 2.1 time: 0.266346 Oct 04 22:13:44.977422 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2686/5435] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:13:44 2022] GET /compute/v2.1/servers/1346709b-155a-4048-86ca-f1b08c9d5710 => generated 1213 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:13:44.984041 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-565c259b-b82d-4a75-97e2-0e4961fbec8e tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:44.999914 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-565c259b-b82d-4a75-97e2-0e4961fbec8e tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 20a57394-a798-4356-8b70-3615f9de588e] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:13:45.013162 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-565c259b-b82d-4a75-97e2-0e4961fbec8e tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:45.013822 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-565c259b-b82d-4a75-97e2-0e4961fbec8e tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:45.014472 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-565c259b-b82d-4a75-97e2-0e4961fbec8e tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:45.015376 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-565c259b-b82d-4a75-97e2-0e4961fbec8e tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:45.015954 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-565c259b-b82d-4a75-97e2-0e4961fbec8e tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:45.016514 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-565c259b-b82d-4a75-97e2-0e4961fbec8e tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:45.321404 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-fe81ff9a-334b-41d6-98f3-d433492345fa tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:13:45.342983 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-fe81ff9a-334b-41d6-98f3-d433492345fa tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:13:45.345233 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-fe81ff9a-334b-41d6-98f3-d433492345fa tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:13:45.347810 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-fe81ff9a-334b-41d6-98f3-d433492345fa tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] 10.222.0.43 "GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9" status: 200 len: 2546 microversion: 2.32 time: 1.250386 Oct 04 22:13:45.362698 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2750/5436] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:13:44 2022] GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9 => generated 2546 bytes in 1266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 22:13:45.429627 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-565c259b-b82d-4a75-97e2-0e4961fbec8e tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:13:45.446629 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-565c259b-b82d-4a75-97e2-0e4961fbec8e tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/20a57394-a798-4356-8b70-3615f9de588e" status: 200 len: 1314 microversion: 2.1 time: 0.466533 Oct 04 22:13:45.448085 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2687/5437] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:13:44 2022] GET /compute/v2.1/servers/20a57394-a798-4356-8b70-3615f9de588e => generated 1314 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:13:45.851451 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-794495c3-9e75-42a3-b146-a1edace04b3b req-c0699ba7-1c36-481d-8b33-3fd57b3bce30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "367dad85-827d-47b0-a468-418d398b36f9", "name": "network-vif-deleted", "tag": "bc487837-1357-4c07-964b-174fe9476f33"}, {"server_uuid": "367dad85-827d-47b0-a468-418d398b36f9", "name": "network-vif-deleted", "tag": "8a1449d2-6f50-4eb8-b168-4134f5622384"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:13:45.872242 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-794495c3-9e75-42a3-b146-a1edace04b3b req-c0699ba7-1c36-481d-8b33-3fd57b3bce30 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:45.873378 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-794495c3-9e75-42a3-b146-a1edace04b3b req-c0699ba7-1c36-481d-8b33-3fd57b3bce30 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:45.880362 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-794495c3-9e75-42a3-b146-a1edace04b3b req-c0699ba7-1c36-481d-8b33-3fd57b3bce30 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:45.902841 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-794495c3-9e75-42a3-b146-a1edace04b3b req-c0699ba7-1c36-481d-8b33-3fd57b3bce30 service nova] Creating event network-vif-deleted:bc487837-1357-4c07-964b-174fe9476f33 for instance 367dad85-827d-47b0-a468-418d398b36f9 on n-h1-860284-1 Oct 04 22:13:45.906715 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-794495c3-9e75-42a3-b146-a1edace04b3b req-c0699ba7-1c36-481d-8b33-3fd57b3bce30 service nova] Creating event network-vif-deleted:8a1449d2-6f50-4eb8-b168-4134f5622384 for instance 367dad85-827d-47b0-a468-418d398b36f9 on n-h1-860284-1 Oct 04 22:13:45.920484 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-794495c3-9e75-42a3-b146-a1edace04b3b req-c0699ba7-1c36-481d-8b33-3fd57b3bce30 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.072607 Oct 04 22:13:45.934488 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2751/5438] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:13:45 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:13:46.003499 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-4f096927-4552-49a8-81b0-78b7d4c11f9a tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:46.004115 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-4f096927-4552-49a8-81b0-78b7d4c11f9a tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] [instance: 1346709b-155a-4048-86ca-f1b08c9d5710] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:13:46.020453 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4f096927-4552-49a8-81b0-78b7d4c11f9a tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:46.021216 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4f096927-4552-49a8-81b0-78b7d4c11f9a tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:46.021873 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4f096927-4552-49a8-81b0-78b7d4c11f9a tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:46.023094 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4f096927-4552-49a8-81b0-78b7d4c11f9a tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:46.023766 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4f096927-4552-49a8-81b0-78b7d4c11f9a tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:46.024419 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4f096927-4552-49a8-81b0-78b7d4c11f9a tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:46.378557 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-c130f75e-5ea6-41b1-88fd-a133484b059c tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:46.379250 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-c130f75e-5ea6-41b1-88fd-a133484b059c tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] [instance: 367dad85-827d-47b0-a468-418d398b36f9] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:13:46.406322 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c130f75e-5ea6-41b1-88fd-a133484b059c tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:46.414576 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c130f75e-5ea6-41b1-88fd-a133484b059c tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:46.416337 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c130f75e-5ea6-41b1-88fd-a133484b059c tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:46.420332 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c130f75e-5ea6-41b1-88fd-a133484b059c tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:46.421785 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c130f75e-5ea6-41b1-88fd-a133484b059c tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:46.428152 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c130f75e-5ea6-41b1-88fd-a133484b059c tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:47.038433 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-4f096927-4552-49a8-81b0-78b7d4c11f9a tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ba7c8167fd40e6878f7f2af9fa869c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc18681ca2974a54a172cbc727158883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:13:47.064609 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-4f096927-4552-49a8-81b0-78b7d4c11f9a tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] 10.222.0.43 "GET /compute/v2.1/servers/1346709b-155a-4048-86ca-f1b08c9d5710" status: 200 len: 1265 microversion: 2.1 time: 1.065863 Oct 04 22:13:47.072333 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2688/5439] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:13:45 2022] GET /compute/v2.1/servers/1346709b-155a-4048-86ca-f1b08c9d5710 => generated 1265 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:13:47.078631 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell0:SELECT=2 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:13:47.083390 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-19ffd71d-1f66-4870-85df-4446f614a0f9 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:47.084345 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-19ffd71d-1f66-4870-85df-4446f614a0f9 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 20a57394-a798-4356-8b70-3615f9de588e] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:13:47.095322 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-19ffd71d-1f66-4870-85df-4446f614a0f9 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:47.098083 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-19ffd71d-1f66-4870-85df-4446f614a0f9 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:47.100262 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-19ffd71d-1f66-4870-85df-4446f614a0f9 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:47.103796 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-19ffd71d-1f66-4870-85df-4446f614a0f9 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:47.105935 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-19ffd71d-1f66-4870-85df-4446f614a0f9 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:47.112893 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-19ffd71d-1f66-4870-85df-4446f614a0f9 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:47.223934 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-c130f75e-5ea6-41b1-88fd-a133484b059c tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:13:47.239779 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-c130f75e-5ea6-41b1-88fd-a133484b059c tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:13:47.241230 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-c130f75e-5ea6-41b1-88fd-a133484b059c tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:13:47.242519 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-c130f75e-5ea6-41b1-88fd-a133484b059c tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] 10.222.0.43 "GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9" status: 200 len: 2228 microversion: 2.32 time: 0.868926 Oct 04 22:13:47.254464 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2752/5440] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:13:46 2022] GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9 => generated 2228 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 22:13:47.535438 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-19ffd71d-1f66-4870-85df-4446f614a0f9 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:13:47.553448 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-19ffd71d-1f66-4870-85df-4446f614a0f9 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/20a57394-a798-4356-8b70-3615f9de588e" status: 200 len: 1314 microversion: 2.1 time: 0.479397 Oct 04 22:13:47.555991 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2689/5441] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:13:47 2022] GET /compute/v2.1/servers/20a57394-a798-4356-8b70-3615f9de588e => generated 1314 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:13:48.093751 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-f14a7701-1870-4b3f-af94-74a6c01751e1 tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:48.095295 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-f14a7701-1870-4b3f-af94-74a6c01751e1 tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] [instance: 1346709b-155a-4048-86ca-f1b08c9d5710] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:13:48.098433 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell0:SELECT=8 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:13:48.121633 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f14a7701-1870-4b3f-af94-74a6c01751e1 tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:48.126738 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f14a7701-1870-4b3f-af94-74a6c01751e1 tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:48.128227 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f14a7701-1870-4b3f-af94-74a6c01751e1 tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:48.129636 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f14a7701-1870-4b3f-af94-74a6c01751e1 tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:48.134309 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f14a7701-1870-4b3f-af94-74a6c01751e1 tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:48.135324 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f14a7701-1870-4b3f-af94-74a6c01751e1 tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:48.286520 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-063d8b4c-46fd-4e2f-b47a-28416a446529 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:48.288148 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-063d8b4c-46fd-4e2f-b47a-28416a446529 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] [instance: 367dad85-827d-47b0-a468-418d398b36f9] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:13:48.308543 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-063d8b4c-46fd-4e2f-b47a-28416a446529 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:48.309895 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-063d8b4c-46fd-4e2f-b47a-28416a446529 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:48.312712 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-063d8b4c-46fd-4e2f-b47a-28416a446529 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:48.314170 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-063d8b4c-46fd-4e2f-b47a-28416a446529 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:48.315545 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-063d8b4c-46fd-4e2f-b47a-28416a446529 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:48.316489 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-063d8b4c-46fd-4e2f-b47a-28416a446529 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:48.435896 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-f14a7701-1870-4b3f-af94-74a6c01751e1 tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ba7c8167fd40e6878f7f2af9fa869c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc18681ca2974a54a172cbc727158883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:13:48.454100 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-f14a7701-1870-4b3f-af94-74a6c01751e1 tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] 10.222.0.43 "GET /compute/v2.1/servers/1346709b-155a-4048-86ca-f1b08c9d5710" status: 200 len: 1271 microversion: 2.1 time: 0.364393 Oct 04 22:13:48.457348 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2753/5442] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:13:48 2022] GET /compute/v2.1/servers/1346709b-155a-4048-86ca-f1b08c9d5710 => generated 1271 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:13:48.550326 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-063d8b4c-46fd-4e2f-b47a-28416a446529 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:13:48.570163 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-063d8b4c-46fd-4e2f-b47a-28416a446529 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:13:48.576382 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-063d8b4c-46fd-4e2f-b47a-28416a446529 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:13:48.583756 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-b56ea846-bc58-4f0d-95cd-d1a88c7ded40 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:48.584881 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-b56ea846-bc58-4f0d-95cd-d1a88c7ded40 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 20a57394-a798-4356-8b70-3615f9de588e] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:13:48.585703 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-063d8b4c-46fd-4e2f-b47a-28416a446529 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] 10.222.0.43 "GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9" status: 200 len: 2161 microversion: 2.32 time: 0.303792 Oct 04 22:13:48.589435 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2690/5443] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:13:48 2022] GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9 => generated 2161 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:13:48.604525 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b56ea846-bc58-4f0d-95cd-d1a88c7ded40 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:48.605637 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b56ea846-bc58-4f0d-95cd-d1a88c7ded40 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:48.612612 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b56ea846-bc58-4f0d-95cd-d1a88c7ded40 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:48.618177 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b56ea846-bc58-4f0d-95cd-d1a88c7ded40 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:48.618719 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b56ea846-bc58-4f0d-95cd-d1a88c7ded40 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:48.619169 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b56ea846-bc58-4f0d-95cd-d1a88c7ded40 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:48.860805 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-78eb5932-1d10-4455-86d6-5be935451d68 req-92a2c999-5104-4954-89cf-3f02028daae3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "367dad85-827d-47b0-a468-418d398b36f9", "name": "network-vif-deleted", "tag": "1701ea5d-b8bb-4192-8463-7dfa341dc8c3"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:13:48.885820 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-78eb5932-1d10-4455-86d6-5be935451d68 req-92a2c999-5104-4954-89cf-3f02028daae3 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:48.886584 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-78eb5932-1d10-4455-86d6-5be935451d68 req-92a2c999-5104-4954-89cf-3f02028daae3 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:48.887032 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-78eb5932-1d10-4455-86d6-5be935451d68 req-92a2c999-5104-4954-89cf-3f02028daae3 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:48.927576 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-78eb5932-1d10-4455-86d6-5be935451d68 req-92a2c999-5104-4954-89cf-3f02028daae3 service nova] Creating event network-vif-deleted:1701ea5d-b8bb-4192-8463-7dfa341dc8c3 for instance 367dad85-827d-47b0-a468-418d398b36f9 on n-h1-860284-1 Oct 04 22:13:48.949445 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-78eb5932-1d10-4455-86d6-5be935451d68 req-92a2c999-5104-4954-89cf-3f02028daae3 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092613 Oct 04 22:13:48.959183 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2691/5444] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:13:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:13:49.054995 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-b56ea846-bc58-4f0d-95cd-d1a88c7ded40 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:13:49.064286 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-b56ea846-bc58-4f0d-95cd-d1a88c7ded40 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/20a57394-a798-4356-8b70-3615f9de588e" status: 200 len: 1314 microversion: 2.1 time: 0.485704 Oct 04 22:13:49.078732 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2754/5445] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:13:48 2022] GET /compute/v2.1/servers/20a57394-a798-4356-8b70-3615f9de588e => generated 1314 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:13:49.484986 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-cf017000-a9bb-4982-8614-4221a631e497 tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:49.485776 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-cf017000-a9bb-4982-8614-4221a631e497 tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] [instance: 1346709b-155a-4048-86ca-f1b08c9d5710] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:13:49.499373 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cf017000-a9bb-4982-8614-4221a631e497 tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:49.499877 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cf017000-a9bb-4982-8614-4221a631e497 tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:49.504906 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cf017000-a9bb-4982-8614-4221a631e497 tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:49.506007 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cf017000-a9bb-4982-8614-4221a631e497 tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:49.510478 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cf017000-a9bb-4982-8614-4221a631e497 tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:49.511814 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cf017000-a9bb-4982-8614-4221a631e497 tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:49.619756 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-474a18da-2424-4e32-8b9b-18c3e8ce39fa tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:49.622291 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-474a18da-2424-4e32-8b9b-18c3e8ce39fa tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] [instance: 367dad85-827d-47b0-a468-418d398b36f9] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:13:49.635294 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-474a18da-2424-4e32-8b9b-18c3e8ce39fa tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:49.641215 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-474a18da-2424-4e32-8b9b-18c3e8ce39fa tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:49.644104 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-474a18da-2424-4e32-8b9b-18c3e8ce39fa tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:49.645080 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-474a18da-2424-4e32-8b9b-18c3e8ce39fa tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:49.645728 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-474a18da-2424-4e32-8b9b-18c3e8ce39fa tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:49.647980 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-474a18da-2424-4e32-8b9b-18c3e8ce39fa tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:49.872833 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-474a18da-2424-4e32-8b9b-18c3e8ce39fa tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:13:49.898558 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-474a18da-2424-4e32-8b9b-18c3e8ce39fa tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:13:49.908508 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-474a18da-2424-4e32-8b9b-18c3e8ce39fa tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:13:49.912580 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-474a18da-2424-4e32-8b9b-18c3e8ce39fa tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] 10.222.0.43 "GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9" status: 200 len: 1874 microversion: 2.32 time: 0.298043 Oct 04 22:13:49.936392 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2755/5446] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:13:49 2022] GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9 => generated 1874 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 22:13:50.050034 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-cf017000-a9bb-4982-8614-4221a631e497 tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ba7c8167fd40e6878f7f2af9fa869c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc18681ca2974a54a172cbc727158883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:13:50.060463 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-cf017000-a9bb-4982-8614-4221a631e497 tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] 10.222.0.43 "GET /compute/v2.1/servers/1346709b-155a-4048-86ca-f1b08c9d5710" status: 200 len: 1313 microversion: 2.1 time: 0.580969 Oct 04 22:13:50.063758 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2692/5447] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:13:49 2022] GET /compute/v2.1/servers/1346709b-155a-4048-86ca-f1b08c9d5710 => generated 1313 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:13:50.088930 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-8c9f3241-b1ae-41c8-a4d5-a4b41d76f6c6 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:50.091564 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-8c9f3241-b1ae-41c8-a4d5-a4b41d76f6c6 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 20a57394-a798-4356-8b70-3615f9de588e] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:13:50.098322 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8c9f3241-b1ae-41c8-a4d5-a4b41d76f6c6 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:50.099130 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8c9f3241-b1ae-41c8-a4d5-a4b41d76f6c6 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:50.099820 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8c9f3241-b1ae-41c8-a4d5-a4b41d76f6c6 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:50.100801 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8c9f3241-b1ae-41c8-a4d5-a4b41d76f6c6 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:50.101616 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8c9f3241-b1ae-41c8-a4d5-a4b41d76f6c6 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:50.102234 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8c9f3241-b1ae-41c8-a4d5-a4b41d76f6c6 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:50.422035 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-8c9f3241-b1ae-41c8-a4d5-a4b41d76f6c6 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:13:50.435872 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-8c9f3241-b1ae-41c8-a4d5-a4b41d76f6c6 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/20a57394-a798-4356-8b70-3615f9de588e" status: 200 len: 1314 microversion: 2.1 time: 0.352490 Oct 04 22:13:50.438963 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2756/5448] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:13:50 2022] GET /compute/v2.1/servers/20a57394-a798-4356-8b70-3615f9de588e => generated 1314 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:13:50.954963 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-faa134b7-e459-4c32-ae00-712f0c3c1a40 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:50.955582 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-faa134b7-e459-4c32-ae00-712f0c3c1a40 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] [instance: 367dad85-827d-47b0-a468-418d398b36f9] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:13:50.963747 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-faa134b7-e459-4c32-ae00-712f0c3c1a40 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:50.966251 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-faa134b7-e459-4c32-ae00-712f0c3c1a40 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:50.966887 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-faa134b7-e459-4c32-ae00-712f0c3c1a40 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:50.968014 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-faa134b7-e459-4c32-ae00-712f0c3c1a40 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:50.969099 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-faa134b7-e459-4c32-ae00-712f0c3c1a40 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:50.969797 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-faa134b7-e459-4c32-ae00-712f0c3c1a40 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:51.093358 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-048a1615-7856-4c33-91a2-155bcb71368b req-c9e81064-135c-4545-a130-8ad59d15c5f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20a57394-a798-4356-8b70-3615f9de588e", "name": "network-vif-plugged", "status": "completed", "tag": "05ea2c3e-5db0-459a-b0b2-b3d8186a59f0"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:13:51.116758 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-048a1615-7856-4c33-91a2-155bcb71368b req-c9e81064-135c-4545-a130-8ad59d15c5f2 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:51.125685 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-048a1615-7856-4c33-91a2-155bcb71368b req-c9e81064-135c-4545-a130-8ad59d15c5f2 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:51.126295 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-048a1615-7856-4c33-91a2-155bcb71368b req-c9e81064-135c-4545-a130-8ad59d15c5f2 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:51.162596 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-048a1615-7856-4c33-91a2-155bcb71368b req-c9e81064-135c-4545-a130-8ad59d15c5f2 service nova] Creating event network-vif-plugged:05ea2c3e-5db0-459a-b0b2-b3d8186a59f0 for instance 20a57394-a798-4356-8b70-3615f9de588e on n-h2-860284-1 Oct 04 22:13:51.176751 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-048a1615-7856-4c33-91a2-155bcb71368b req-c9e81064-135c-4545-a130-8ad59d15c5f2 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093448 Oct 04 22:13:51.177649 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2757/5449] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:13:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:13:51.195023 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-2df10a12-0831-48f1-b38a-a1b6e3ef382a tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:51.196047 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-2df10a12-0831-48f1-b38a-a1b6e3ef382a tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] [instance: 1346709b-155a-4048-86ca-f1b08c9d5710] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:13:51.212067 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2df10a12-0831-48f1-b38a-a1b6e3ef382a tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:51.219871 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2df10a12-0831-48f1-b38a-a1b6e3ef382a tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:51.221759 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2df10a12-0831-48f1-b38a-a1b6e3ef382a tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:51.226031 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2df10a12-0831-48f1-b38a-a1b6e3ef382a tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:51.239166 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2df10a12-0831-48f1-b38a-a1b6e3ef382a tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:51.241249 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2df10a12-0831-48f1-b38a-a1b6e3ef382a tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:51.312476 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-faa134b7-e459-4c32-ae00-712f0c3c1a40 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:13:51.335175 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-faa134b7-e459-4c32-ae00-712f0c3c1a40 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:13:51.343146 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-faa134b7-e459-4c32-ae00-712f0c3c1a40 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:13:51.352343 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-faa134b7-e459-4c32-ae00-712f0c3c1a40 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] 10.222.0.43 "GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9" status: 200 len: 1874 microversion: 2.32 time: 0.402752 Oct 04 22:13:51.371473 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2693/5450] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:13:50 2022] GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9 => generated 1874 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:13:51.379795 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-1f23aea9-b107-4212-8151-b8d78d73b0cd req-fbf38e50-e20d-429e-b112-5bd3d43940bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1346709b-155a-4048-86ca-f1b08c9d5710", "tag": "0c3cb1ba-1f96-4f4a-b4cb-7d74a135bffa"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:13:51.404356 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-1f23aea9-b107-4212-8151-b8d78d73b0cd req-fbf38e50-e20d-429e-b112-5bd3d43940bd service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:51.410230 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-1f23aea9-b107-4212-8151-b8d78d73b0cd req-fbf38e50-e20d-429e-b112-5bd3d43940bd service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:51.410870 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-1f23aea9-b107-4212-8151-b8d78d73b0cd req-fbf38e50-e20d-429e-b112-5bd3d43940bd service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:51.442484 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-1f23aea9-b107-4212-8151-b8d78d73b0cd req-fbf38e50-e20d-429e-b112-5bd3d43940bd service nova] Creating event network-changed:0c3cb1ba-1f96-4f4a-b4cb-7d74a135bffa for instance 1346709b-155a-4048-86ca-f1b08c9d5710 on n-h1-860284-1 Oct 04 22:13:51.451920 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-1f23aea9-b107-4212-8151-b8d78d73b0cd req-fbf38e50-e20d-429e-b112-5bd3d43940bd service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087727 Oct 04 22:13:51.453028 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2694/5451] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:13:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:13:51.469771 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-1ad5eddd-9023-4aaf-8868-fa70c62fb41a tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:51.470874 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-1ad5eddd-9023-4aaf-8868-fa70c62fb41a tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 20a57394-a798-4356-8b70-3615f9de588e] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:13:51.479607 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1ad5eddd-9023-4aaf-8868-fa70c62fb41a tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:51.480680 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1ad5eddd-9023-4aaf-8868-fa70c62fb41a tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:51.481329 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1ad5eddd-9023-4aaf-8868-fa70c62fb41a tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:51.482331 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1ad5eddd-9023-4aaf-8868-fa70c62fb41a tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:51.483130 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1ad5eddd-9023-4aaf-8868-fa70c62fb41a tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:51.483746 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1ad5eddd-9023-4aaf-8868-fa70c62fb41a tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:51.867587 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-2df10a12-0831-48f1-b38a-a1b6e3ef382a tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ba7c8167fd40e6878f7f2af9fa869c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc18681ca2974a54a172cbc727158883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:13:51.877243 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-2df10a12-0831-48f1-b38a-a1b6e3ef382a tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] 10.222.0.43 "GET /compute/v2.1/servers/1346709b-155a-4048-86ca-f1b08c9d5710" status: 200 len: 1313 microversion: 2.1 time: 0.696301 Oct 04 22:13:51.883201 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2758/5452] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:13:51 2022] GET /compute/v2.1/servers/1346709b-155a-4048-86ca-f1b08c9d5710 => generated 1313 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:13:51.961720 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-1ad5eddd-9023-4aaf-8868-fa70c62fb41a tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:13:51.978418 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-1ad5eddd-9023-4aaf-8868-fa70c62fb41a tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/20a57394-a798-4356-8b70-3615f9de588e" status: 200 len: 1314 microversion: 2.1 time: 0.514272 Oct 04 22:13:51.979004 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2695/5453] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:13:51 2022] GET /compute/v2.1/servers/20a57394-a798-4356-8b70-3615f9de588e => generated 1314 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:13:52.397985 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-a0bff08e-c80b-415c-913b-db7a4bb425db tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:52.399121 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-a0bff08e-c80b-415c-913b-db7a4bb425db tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] [instance: 367dad85-827d-47b0-a468-418d398b36f9] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:13:52.409453 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a0bff08e-c80b-415c-913b-db7a4bb425db tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:52.410060 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a0bff08e-c80b-415c-913b-db7a4bb425db tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:52.411113 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a0bff08e-c80b-415c-913b-db7a4bb425db tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:52.412924 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a0bff08e-c80b-415c-913b-db7a4bb425db tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:52.413454 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a0bff08e-c80b-415c-913b-db7a4bb425db tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:52.414945 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a0bff08e-c80b-415c-913b-db7a4bb425db tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:52.529525 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-a0bff08e-c80b-415c-913b-db7a4bb425db tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:13:52.571951 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-a0bff08e-c80b-415c-913b-db7a4bb425db tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:13:52.581628 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-a0bff08e-c80b-415c-913b-db7a4bb425db tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:13:52.585636 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-a0bff08e-c80b-415c-913b-db7a4bb425db tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] 10.222.0.43 "GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9" status: 200 len: 1874 microversion: 2.32 time: 0.196764 Oct 04 22:13:52.587460 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2759/5454] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:13:52 2022] GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9 => generated 1874 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:13:52.910748 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-3b208070-1640-4a26-8337-55570540ad55 tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:52.911622 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-3b208070-1640-4a26-8337-55570540ad55 tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] [instance: 1346709b-155a-4048-86ca-f1b08c9d5710] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:13:52.922925 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3b208070-1640-4a26-8337-55570540ad55 tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:52.923886 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3b208070-1640-4a26-8337-55570540ad55 tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:52.924564 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3b208070-1640-4a26-8337-55570540ad55 tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:52.933946 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3b208070-1640-4a26-8337-55570540ad55 tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:52.934782 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3b208070-1640-4a26-8337-55570540ad55 tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:52.935704 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3b208070-1640-4a26-8337-55570540ad55 tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:53.006678 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-ad406c05-0eba-4bd0-a4e4-dc141d2cbb01 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:53.007492 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-ad406c05-0eba-4bd0-a4e4-dc141d2cbb01 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 20a57394-a798-4356-8b70-3615f9de588e] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:13:53.016568 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ad406c05-0eba-4bd0-a4e4-dc141d2cbb01 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:53.017098 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ad406c05-0eba-4bd0-a4e4-dc141d2cbb01 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:53.020211 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ad406c05-0eba-4bd0-a4e4-dc141d2cbb01 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:53.020985 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ad406c05-0eba-4bd0-a4e4-dc141d2cbb01 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:53.024331 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ad406c05-0eba-4bd0-a4e4-dc141d2cbb01 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:53.024869 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ad406c05-0eba-4bd0-a4e4-dc141d2cbb01 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:53.299393 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-3b208070-1640-4a26-8337-55570540ad55 tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ba7c8167fd40e6878f7f2af9fa869c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc18681ca2974a54a172cbc727158883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:13:53.313077 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-3b208070-1640-4a26-8337-55570540ad55 tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] 10.222.0.43 "GET /compute/v2.1/servers/1346709b-155a-4048-86ca-f1b08c9d5710" status: 200 len: 1313 microversion: 2.1 time: 0.405673 Oct 04 22:13:53.322536 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2696/5455] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:13:52 2022] GET /compute/v2.1/servers/1346709b-155a-4048-86ca-f1b08c9d5710 => generated 1313 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:13:53.350678 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-ad406c05-0eba-4bd0-a4e4-dc141d2cbb01 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:13:53.364718 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-ad406c05-0eba-4bd0-a4e4-dc141d2cbb01 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/20a57394-a798-4356-8b70-3615f9de588e" status: 200 len: 1314 microversion: 2.1 time: 0.363042 Oct 04 22:13:53.366045 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2760/5456] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:13:53 2022] GET /compute/v2.1/servers/20a57394-a798-4356-8b70-3615f9de588e => generated 1314 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:13:53.619881 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-1ed7fc2e-f190-4693-8343-c403a894a20e tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:53.621503 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-1ed7fc2e-f190-4693-8343-c403a894a20e tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] [instance: 367dad85-827d-47b0-a468-418d398b36f9] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:13:53.630408 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1ed7fc2e-f190-4693-8343-c403a894a20e tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:53.631146 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1ed7fc2e-f190-4693-8343-c403a894a20e tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:53.632072 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1ed7fc2e-f190-4693-8343-c403a894a20e tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:53.633292 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1ed7fc2e-f190-4693-8343-c403a894a20e tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:53.633974 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1ed7fc2e-f190-4693-8343-c403a894a20e tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:53.634656 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1ed7fc2e-f190-4693-8343-c403a894a20e tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:53.723900 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-1ed7fc2e-f190-4693-8343-c403a894a20e tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:13:53.740685 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-1ed7fc2e-f190-4693-8343-c403a894a20e tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:13:53.743524 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-1ed7fc2e-f190-4693-8343-c403a894a20e tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:13:53.746653 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-1ed7fc2e-f190-4693-8343-c403a894a20e tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] 10.222.0.43 "GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9" status: 200 len: 1874 microversion: 2.32 time: 0.129195 Oct 04 22:13:53.759528 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2697/5457] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:13:53 2022] GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9 => generated 1874 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:13:54.342528 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-64ce2b86-c920-499f-a226-38658e03587a tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:54.343397 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-64ce2b86-c920-499f-a226-38658e03587a tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] [instance: 1346709b-155a-4048-86ca-f1b08c9d5710] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:13:54.351919 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-64ce2b86-c920-499f-a226-38658e03587a tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:54.352764 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-64ce2b86-c920-499f-a226-38658e03587a tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:54.353428 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-64ce2b86-c920-499f-a226-38658e03587a tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:54.354402 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-64ce2b86-c920-499f-a226-38658e03587a tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:54.355462 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-64ce2b86-c920-499f-a226-38658e03587a tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:54.356067 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-64ce2b86-c920-499f-a226-38658e03587a tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:54.391807 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-423dc42e-2332-4b5e-aa46-7e705c6b14ea tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:54.393827 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-423dc42e-2332-4b5e-aa46-7e705c6b14ea tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 20a57394-a798-4356-8b70-3615f9de588e] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:13:54.410253 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-423dc42e-2332-4b5e-aa46-7e705c6b14ea tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:54.410976 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-423dc42e-2332-4b5e-aa46-7e705c6b14ea tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:54.411993 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-423dc42e-2332-4b5e-aa46-7e705c6b14ea tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:54.413281 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-423dc42e-2332-4b5e-aa46-7e705c6b14ea tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:54.414183 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-423dc42e-2332-4b5e-aa46-7e705c6b14ea tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:54.415106 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-423dc42e-2332-4b5e-aa46-7e705c6b14ea tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:54.472336 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=2 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:13:54.709174 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-64ce2b86-c920-499f-a226-38658e03587a tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ba7c8167fd40e6878f7f2af9fa869c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc18681ca2974a54a172cbc727158883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:13:54.727121 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-64ce2b86-c920-499f-a226-38658e03587a tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] 10.222.0.43 "GET /compute/v2.1/servers/1346709b-155a-4048-86ca-f1b08c9d5710" status: 200 len: 1313 microversion: 2.1 time: 0.390991 Oct 04 22:13:54.727978 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2761/5458] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:13:54 2022] GET /compute/v2.1/servers/1346709b-155a-4048-86ca-f1b08c9d5710 => generated 1313 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:13:54.768056 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-423dc42e-2332-4b5e-aa46-7e705c6b14ea tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:13:54.778890 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-401254af-c322-4aa3-b684-4abe6b7d3f33 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:54.780100 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-401254af-c322-4aa3-b684-4abe6b7d3f33 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] [instance: 367dad85-827d-47b0-a468-418d398b36f9] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:13:54.780250 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-423dc42e-2332-4b5e-aa46-7e705c6b14ea tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/20a57394-a798-4356-8b70-3615f9de588e" status: 200 len: 1502 microversion: 2.1 time: 0.394253 Oct 04 22:13:54.794704 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2698/5459] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:13:54 2022] GET /compute/v2.1/servers/20a57394-a798-4356-8b70-3615f9de588e => generated 1502 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:13:54.797863 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-401254af-c322-4aa3-b684-4abe6b7d3f33 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:54.799161 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-401254af-c322-4aa3-b684-4abe6b7d3f33 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:54.799628 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-401254af-c322-4aa3-b684-4abe6b7d3f33 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:54.800384 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-401254af-c322-4aa3-b684-4abe6b7d3f33 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:54.800858 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-401254af-c322-4aa3-b684-4abe6b7d3f33 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:54.801298 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-401254af-c322-4aa3-b684-4abe6b7d3f33 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:54.809392 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-0f5a4893-6cc2-4370-b4be-961609bd2a43 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:13:54.809935 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-0f5a4893-6cc2-4370-b4be-961609bd2a43 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 20a57394-a798-4356-8b70-3615f9de588e] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:13:54.823808 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0f5a4893-6cc2-4370-b4be-961609bd2a43 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:54.825694 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0f5a4893-6cc2-4370-b4be-961609bd2a43 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:54.830901 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0f5a4893-6cc2-4370-b4be-961609bd2a43 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:54.832087 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0f5a4893-6cc2-4370-b4be-961609bd2a43 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:54.832751 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0f5a4893-6cc2-4370-b4be-961609bd2a43 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:54.833189 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0f5a4893-6cc2-4370-b4be-961609bd2a43 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:54.902082 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-401254af-c322-4aa3-b684-4abe6b7d3f33 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:13:54.914035 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-401254af-c322-4aa3-b684-4abe6b7d3f33 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:13:54.916056 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-401254af-c322-4aa3-b684-4abe6b7d3f33 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:13:54.919160 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-401254af-c322-4aa3-b684-4abe6b7d3f33 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] 10.222.0.43 "GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9" status: 200 len: 1874 microversion: 2.32 time: 0.145417 Oct 04 22:13:54.930780 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2762/5460] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:13:54 2022] GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9 => generated 1874 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:13:54.951593 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=8 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:13:54.971467 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-0f5a4893-6cc2-4370-b4be-961609bd2a43 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "POST /compute/v2.1/servers/20a57394-a798-4356-8b70-3615f9de588e/action" status: 202 len: 0 microversion: 2.1 time: 0.166018 Oct 04 22:13:54.983595 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2699/5461] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 22:13:54 2022] POST /compute/v2.1/servers/20a57394-a798-4356-8b70-3615f9de588e/action => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 22:13:54.984174 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-86d0c097-0f8d-498f-8eb1-048abf682f28 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:54.985042 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-86d0c097-0f8d-498f-8eb1-048abf682f28 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 20a57394-a798-4356-8b70-3615f9de588e] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:13:54.994843 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-86d0c097-0f8d-498f-8eb1-048abf682f28 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:54.996563 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-86d0c097-0f8d-498f-8eb1-048abf682f28 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:54.997453 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-86d0c097-0f8d-498f-8eb1-048abf682f28 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:54.998484 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-86d0c097-0f8d-498f-8eb1-048abf682f28 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:54.999192 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-86d0c097-0f8d-498f-8eb1-048abf682f28 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:55.000121 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-86d0c097-0f8d-498f-8eb1-048abf682f28 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:55.203649 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-86d0c097-0f8d-498f-8eb1-048abf682f28 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:13:55.221634 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-86d0c097-0f8d-498f-8eb1-048abf682f28 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/20a57394-a798-4356-8b70-3615f9de588e" status: 200 len: 1507 microversion: 2.1 time: 0.243218 Oct 04 22:13:55.223416 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2763/5462] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:13:54 2022] GET /compute/v2.1/servers/20a57394-a798-4356-8b70-3615f9de588e => generated 1507 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:13:55.756424 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e99a1d18-79d9-4a00-bac2-b247755f62be tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:55.757686 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-e99a1d18-79d9-4a00-bac2-b247755f62be tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] [instance: 1346709b-155a-4048-86ca-f1b08c9d5710] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:13:55.770852 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e99a1d18-79d9-4a00-bac2-b247755f62be tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:55.775199 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e99a1d18-79d9-4a00-bac2-b247755f62be tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:55.775854 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e99a1d18-79d9-4a00-bac2-b247755f62be tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:55.777626 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e99a1d18-79d9-4a00-bac2-b247755f62be tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:55.778977 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e99a1d18-79d9-4a00-bac2-b247755f62be tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:55.783145 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e99a1d18-79d9-4a00-bac2-b247755f62be tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:55.947661 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-be34c905-ba76-4649-b43c-779bf1243a77 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:55.948534 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-be34c905-ba76-4649-b43c-779bf1243a77 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] [instance: 367dad85-827d-47b0-a468-418d398b36f9] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:13:55.959797 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-be34c905-ba76-4649-b43c-779bf1243a77 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:55.971416 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-be34c905-ba76-4649-b43c-779bf1243a77 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:55.972048 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-be34c905-ba76-4649-b43c-779bf1243a77 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:55.972972 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-be34c905-ba76-4649-b43c-779bf1243a77 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:55.973603 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-be34c905-ba76-4649-b43c-779bf1243a77 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:55.974164 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-be34c905-ba76-4649-b43c-779bf1243a77 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:56.023457 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-e99a1d18-79d9-4a00-bac2-b247755f62be tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ba7c8167fd40e6878f7f2af9fa869c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc18681ca2974a54a172cbc727158883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:13:56.035206 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-e99a1d18-79d9-4a00-bac2-b247755f62be tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] 10.222.0.43 "GET /compute/v2.1/servers/1346709b-155a-4048-86ca-f1b08c9d5710" status: 200 len: 1313 microversion: 2.1 time: 0.283666 Oct 04 22:13:56.036786 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2700/5463] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:13:55 2022] GET /compute/v2.1/servers/1346709b-155a-4048-86ca-f1b08c9d5710 => generated 1313 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:13:56.079068 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-be34c905-ba76-4649-b43c-779bf1243a77 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:13:56.081785 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=100 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:13:56.094585 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-be34c905-ba76-4649-b43c-779bf1243a77 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:13:56.096056 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-be34c905-ba76-4649-b43c-779bf1243a77 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:13:56.098343 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-be34c905-ba76-4649-b43c-779bf1243a77 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] 10.222.0.43 "GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9" status: 200 len: 1874 microversion: 2.32 time: 0.154249 Oct 04 22:13:56.099451 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2764/5464] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:13:55 2022] GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9 => generated 1874 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:13:56.245770 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-d9efd433-6b65-44da-bce4-a86424aa94fe tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:56.246921 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-d9efd433-6b65-44da-bce4-a86424aa94fe tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 20a57394-a798-4356-8b70-3615f9de588e] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:13:56.254819 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d9efd433-6b65-44da-bce4-a86424aa94fe tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:56.255708 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d9efd433-6b65-44da-bce4-a86424aa94fe tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:56.256326 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d9efd433-6b65-44da-bce4-a86424aa94fe tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:56.257339 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d9efd433-6b65-44da-bce4-a86424aa94fe tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:56.258092 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d9efd433-6b65-44da-bce4-a86424aa94fe tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:56.262298 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d9efd433-6b65-44da-bce4-a86424aa94fe tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:56.300615 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:13:56.472161 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-d9efd433-6b65-44da-bce4-a86424aa94fe tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:13:56.485414 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-d9efd433-6b65-44da-bce4-a86424aa94fe tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/20a57394-a798-4356-8b70-3615f9de588e" status: 200 len: 1487 microversion: 2.1 time: 0.244232 Oct 04 22:13:56.487114 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2701/5465] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:13:56 2022] GET /compute/v2.1/servers/20a57394-a798-4356-8b70-3615f9de588e => generated 1487 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:13:56.508610 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-b55904fa-076e-4fcf-aa18-9002ce5572d1 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:13:56.509406 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-b55904fa-076e-4fcf-aa18-9002ce5572d1 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 20a57394-a798-4356-8b70-3615f9de588e] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:13:56.517485 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b55904fa-076e-4fcf-aa18-9002ce5572d1 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:56.518254 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b55904fa-076e-4fcf-aa18-9002ce5572d1 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:56.518892 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b55904fa-076e-4fcf-aa18-9002ce5572d1 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:56.519607 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b55904fa-076e-4fcf-aa18-9002ce5572d1 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:56.520239 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b55904fa-076e-4fcf-aa18-9002ce5572d1 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:56.520812 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b55904fa-076e-4fcf-aa18-9002ce5572d1 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:56.547733 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.objects.instance [None req-b55904fa-076e-4fcf-aa18-9002ce5572d1 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lazy-loading 'flavor' on Instance uuid 20a57394-a798-4356-8b70-3615f9de588e {{(pid=134102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 22:13:56.801653 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-b55904fa-076e-4fcf-aa18-9002ce5572d1 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "POST /compute/v2.1/servers/20a57394-a798-4356-8b70-3615f9de588e/action" status: 202 len: 0 microversion: 2.1 time: 0.296698 Oct 04 22:13:56.812959 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-b6bda4b8-e33d-47f0-bd1c-92b3e9fdcb18 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:56.814314 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-b6bda4b8-e33d-47f0-bd1c-92b3e9fdcb18 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 20a57394-a798-4356-8b70-3615f9de588e] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:13:56.819470 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2765/5466] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 22:13:56 2022] POST /compute/v2.1/servers/20a57394-a798-4356-8b70-3615f9de588e/action => generated 0 bytes in 315 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 22:13:56.822668 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b6bda4b8-e33d-47f0-bd1c-92b3e9fdcb18 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:56.824193 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b6bda4b8-e33d-47f0-bd1c-92b3e9fdcb18 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:56.824709 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b6bda4b8-e33d-47f0-bd1c-92b3e9fdcb18 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:56.825446 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b6bda4b8-e33d-47f0-bd1c-92b3e9fdcb18 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:56.826174 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b6bda4b8-e33d-47f0-bd1c-92b3e9fdcb18 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:56.826781 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b6bda4b8-e33d-47f0-bd1c-92b3e9fdcb18 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:57.064185 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-bb9d8126-0359-4738-9b71-bd809683050f tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:57.065075 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-bb9d8126-0359-4738-9b71-bd809683050f tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] [instance: 1346709b-155a-4048-86ca-f1b08c9d5710] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:13:57.074438 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bb9d8126-0359-4738-9b71-bd809683050f tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:57.075375 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bb9d8126-0359-4738-9b71-bd809683050f tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:57.076020 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bb9d8126-0359-4738-9b71-bd809683050f tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:57.076948 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bb9d8126-0359-4738-9b71-bd809683050f tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:57.077640 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bb9d8126-0359-4738-9b71-bd809683050f tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:57.079617 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bb9d8126-0359-4738-9b71-bd809683050f tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:57.117140 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-b6bda4b8-e33d-47f0-bd1c-92b3e9fdcb18 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:13:57.140875 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-b6bda4b8-e33d-47f0-bd1c-92b3e9fdcb18 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/20a57394-a798-4356-8b70-3615f9de588e" status: 200 len: 1493 microversion: 2.1 time: 0.326377 Oct 04 22:13:57.143872 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2702/5467] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:13:56 2022] GET /compute/v2.1/servers/20a57394-a798-4356-8b70-3615f9de588e => generated 1493 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:13:57.150353 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-31fb3af8-99f8-46f4-bcad-bdbde0345ba1 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:57.151907 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-31fb3af8-99f8-46f4-bcad-bdbde0345ba1 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] [instance: 367dad85-827d-47b0-a468-418d398b36f9] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:13:57.159533 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-31fb3af8-99f8-46f4-bcad-bdbde0345ba1 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:57.160334 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-31fb3af8-99f8-46f4-bcad-bdbde0345ba1 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:57.161016 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-31fb3af8-99f8-46f4-bcad-bdbde0345ba1 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:57.162924 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-31fb3af8-99f8-46f4-bcad-bdbde0345ba1 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:57.164045 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-31fb3af8-99f8-46f4-bcad-bdbde0345ba1 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:57.164706 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-31fb3af8-99f8-46f4-bcad-bdbde0345ba1 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:57.277405 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-31fb3af8-99f8-46f4-bcad-bdbde0345ba1 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:13:57.289775 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-31fb3af8-99f8-46f4-bcad-bdbde0345ba1 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:13:57.291811 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-31fb3af8-99f8-46f4-bcad-bdbde0345ba1 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:13:57.293907 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-31fb3af8-99f8-46f4-bcad-bdbde0345ba1 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] 10.222.0.43 "GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9" status: 200 len: 1874 microversion: 2.32 time: 0.148301 Oct 04 22:13:57.295031 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2703/5468] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:13:57 2022] GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9 => generated 1874 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:13:57.397300 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-bb9d8126-0359-4738-9b71-bd809683050f tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ba7c8167fd40e6878f7f2af9fa869c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc18681ca2974a54a172cbc727158883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:13:57.406996 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-bb9d8126-0359-4738-9b71-bd809683050f tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] 10.222.0.43 "GET /compute/v2.1/servers/1346709b-155a-4048-86ca-f1b08c9d5710" status: 200 len: 1313 microversion: 2.1 time: 0.349779 Oct 04 22:13:57.407608 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2766/5469] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:13:57 2022] GET /compute/v2.1/servers/1346709b-155a-4048-86ca-f1b08c9d5710 => generated 1313 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:13:57.939821 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-5a448b8c-32b2-4f8f-8a52-223a8f1a264d req-df4f8d32-741d-4ac8-bfb1-516c766e04d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1346709b-155a-4048-86ca-f1b08c9d5710", "name": "network-vif-plugged", "status": "completed", "tag": "0c3cb1ba-1f96-4f4a-b4cb-7d74a135bffa"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:13:57.967362 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-5a448b8c-32b2-4f8f-8a52-223a8f1a264d req-df4f8d32-741d-4ac8-bfb1-516c766e04d1 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:57.979326 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-5a448b8c-32b2-4f8f-8a52-223a8f1a264d req-df4f8d32-741d-4ac8-bfb1-516c766e04d1 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:57.980418 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-5a448b8c-32b2-4f8f-8a52-223a8f1a264d req-df4f8d32-741d-4ac8-bfb1-516c766e04d1 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:58.008112 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-5a448b8c-32b2-4f8f-8a52-223a8f1a264d req-df4f8d32-741d-4ac8-bfb1-516c766e04d1 service nova] Creating event network-vif-plugged:0c3cb1ba-1f96-4f4a-b4cb-7d74a135bffa for instance 1346709b-155a-4048-86ca-f1b08c9d5710 on n-h1-860284-1 Oct 04 22:13:58.024494 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-5a448b8c-32b2-4f8f-8a52-223a8f1a264d req-df4f8d32-741d-4ac8-bfb1-516c766e04d1 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089410 Oct 04 22:13:58.025438 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2704/5470] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:13:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:13:58.165521 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-817d3195-998c-43c0-9028-0af2fce9c2a1 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:58.166846 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-817d3195-998c-43c0-9028-0af2fce9c2a1 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 20a57394-a798-4356-8b70-3615f9de588e] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:13:58.183651 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-817d3195-998c-43c0-9028-0af2fce9c2a1 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:58.187081 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-817d3195-998c-43c0-9028-0af2fce9c2a1 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:58.187823 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-817d3195-998c-43c0-9028-0af2fce9c2a1 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:58.189090 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-817d3195-998c-43c0-9028-0af2fce9c2a1 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:58.193235 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-817d3195-998c-43c0-9028-0af2fce9c2a1 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:58.194002 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-817d3195-998c-43c0-9028-0af2fce9c2a1 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:58.325658 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-1810f8e9-5bf7-4ca1-8c2e-7f320ad597f2 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:58.326865 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-1810f8e9-5bf7-4ca1-8c2e-7f320ad597f2 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] [instance: 367dad85-827d-47b0-a468-418d398b36f9] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:13:58.337867 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1810f8e9-5bf7-4ca1-8c2e-7f320ad597f2 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:58.358815 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1810f8e9-5bf7-4ca1-8c2e-7f320ad597f2 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:58.359397 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1810f8e9-5bf7-4ca1-8c2e-7f320ad597f2 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:58.360176 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1810f8e9-5bf7-4ca1-8c2e-7f320ad597f2 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:58.360660 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1810f8e9-5bf7-4ca1-8c2e-7f320ad597f2 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:58.361101 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1810f8e9-5bf7-4ca1-8c2e-7f320ad597f2 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:58.471114 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-817d3195-998c-43c0-9028-0af2fce9c2a1 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:13:58.481759 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-817d3195-998c-43c0-9028-0af2fce9c2a1 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/20a57394-a798-4356-8b70-3615f9de588e" status: 200 len: 1493 microversion: 2.1 time: 0.320466 Oct 04 22:13:58.488538 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2767/5471] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:13:58 2022] GET /compute/v2.1/servers/20a57394-a798-4356-8b70-3615f9de588e => generated 1493 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:13:58.493665 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-424a1a9b-bbb9-4074-bf28-5ed31f1588a7 tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:58.504341 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-424a1a9b-bbb9-4074-bf28-5ed31f1588a7 tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] [instance: 1346709b-155a-4048-86ca-f1b08c9d5710] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:13:58.511969 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-424a1a9b-bbb9-4074-bf28-5ed31f1588a7 tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:58.519008 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-424a1a9b-bbb9-4074-bf28-5ed31f1588a7 tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:58.519744 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-424a1a9b-bbb9-4074-bf28-5ed31f1588a7 tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:58.520648 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-1810f8e9-5bf7-4ca1-8c2e-7f320ad597f2 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:13:58.520965 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-424a1a9b-bbb9-4074-bf28-5ed31f1588a7 tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:58.521642 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-424a1a9b-bbb9-4074-bf28-5ed31f1588a7 tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:58.522437 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-424a1a9b-bbb9-4074-bf28-5ed31f1588a7 tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:58.531433 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-1810f8e9-5bf7-4ca1-8c2e-7f320ad597f2 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:13:58.539527 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-1810f8e9-5bf7-4ca1-8c2e-7f320ad597f2 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:13:58.541459 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-1810f8e9-5bf7-4ca1-8c2e-7f320ad597f2 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] 10.222.0.43 "GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9" status: 200 len: 1874 microversion: 2.32 time: 0.222018 Oct 04 22:13:58.542931 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2705/5472] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:13:58 2022] GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9 => generated 1874 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 22:13:58.726025 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-424a1a9b-bbb9-4074-bf28-5ed31f1588a7 tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ba7c8167fd40e6878f7f2af9fa869c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc18681ca2974a54a172cbc727158883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:13:58.738058 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-424a1a9b-bbb9-4074-bf28-5ed31f1588a7 tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] 10.222.0.43 "GET /compute/v2.1/servers/1346709b-155a-4048-86ca-f1b08c9d5710" status: 200 len: 1313 microversion: 2.1 time: 0.248046 Oct 04 22:13:58.739685 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2768/5473] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:13:58 2022] GET /compute/v2.1/servers/1346709b-155a-4048-86ca-f1b08c9d5710 => generated 1313 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:13:59.517172 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-678d9608-f8ee-4303-85d4-2ec6526a638b tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:59.517781 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-678d9608-f8ee-4303-85d4-2ec6526a638b tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 20a57394-a798-4356-8b70-3615f9de588e] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:13:59.531238 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-678d9608-f8ee-4303-85d4-2ec6526a638b tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:59.531742 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-678d9608-f8ee-4303-85d4-2ec6526a638b tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:59.532481 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-678d9608-f8ee-4303-85d4-2ec6526a638b tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:59.533203 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-678d9608-f8ee-4303-85d4-2ec6526a638b tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:59.533830 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-678d9608-f8ee-4303-85d4-2ec6526a638b tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:59.534474 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-678d9608-f8ee-4303-85d4-2ec6526a638b tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:59.575807 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-55a477ec-7651-460d-b749-18c2da4bb360 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:59.577280 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-55a477ec-7651-460d-b749-18c2da4bb360 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] [instance: 367dad85-827d-47b0-a468-418d398b36f9] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:13:59.585449 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-55a477ec-7651-460d-b749-18c2da4bb360 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:59.586216 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-55a477ec-7651-460d-b749-18c2da4bb360 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:59.587111 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-55a477ec-7651-460d-b749-18c2da4bb360 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:59.588436 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-55a477ec-7651-460d-b749-18c2da4bb360 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:59.589149 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-55a477ec-7651-460d-b749-18c2da4bb360 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:59.589752 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-55a477ec-7651-460d-b749-18c2da4bb360 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:59.707701 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-55a477ec-7651-460d-b749-18c2da4bb360 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:13:59.721488 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-55a477ec-7651-460d-b749-18c2da4bb360 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:13:59.731597 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-55a477ec-7651-460d-b749-18c2da4bb360 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:13:59.735268 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-55a477ec-7651-460d-b749-18c2da4bb360 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] 10.222.0.43 "GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9" status: 200 len: 1874 microversion: 2.32 time: 0.163388 Oct 04 22:13:59.737487 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2769/5474] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:13:59 2022] GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9 => generated 1874 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 22:13:59.765533 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-aa096038-be1c-46eb-bb9c-ac5716a01c48 tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:59.767798 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-aa096038-be1c-46eb-bb9c-ac5716a01c48 tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] [instance: 1346709b-155a-4048-86ca-f1b08c9d5710] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:13:59.786057 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-aa096038-be1c-46eb-bb9c-ac5716a01c48 tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:59.787705 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-aa096038-be1c-46eb-bb9c-ac5716a01c48 tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:59.789005 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-aa096038-be1c-46eb-bb9c-ac5716a01c48 tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:59.791726 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-aa096038-be1c-46eb-bb9c-ac5716a01c48 tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:59.793084 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-aa096038-be1c-46eb-bb9c-ac5716a01c48 tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:59.794247 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-aa096038-be1c-46eb-bb9c-ac5716a01c48 tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:59.835202 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-678d9608-f8ee-4303-85d4-2ec6526a638b tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:13:59.856377 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-678d9608-f8ee-4303-85d4-2ec6526a638b tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/20a57394-a798-4356-8b70-3615f9de588e" status: 200 len: 1514 microversion: 2.1 time: 0.342531 Oct 04 22:13:59.875515 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2706/5475] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:13:59 2022] GET /compute/v2.1/servers/20a57394-a798-4356-8b70-3615f9de588e => generated 1514 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:14:00.033226 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-aa096038-be1c-46eb-bb9c-ac5716a01c48 tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ba7c8167fd40e6878f7f2af9fa869c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc18681ca2974a54a172cbc727158883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:14:00.045109 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-aa096038-be1c-46eb-bb9c-ac5716a01c48 tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] 10.222.0.43 "GET /compute/v2.1/servers/1346709b-155a-4048-86ca-f1b08c9d5710" status: 200 len: 1463 microversion: 2.1 time: 0.285442 Oct 04 22:14:00.045724 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2770/5476] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:13:59 2022] GET /compute/v2.1/servers/1346709b-155a-4048-86ca-f1b08c9d5710 => generated 1463 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:14:00.072316 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-b5bea180-48e1-4d9f-ba5c-982a25412ff7 tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a1bedfde-d013-489c-a643-59e9805f0fdd", "device": "/dev/sdb"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:14:00.076728 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-b5bea180-48e1-4d9f-ba5c-982a25412ff7 tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] [instance: 1346709b-155a-4048-86ca-f1b08c9d5710] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:14:00.086587 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b5bea180-48e1-4d9f-ba5c-982a25412ff7 tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:00.087721 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b5bea180-48e1-4d9f-ba5c-982a25412ff7 tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:00.088386 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b5bea180-48e1-4d9f-ba5c-982a25412ff7 tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:00.089796 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b5bea180-48e1-4d9f-ba5c-982a25412ff7 tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:00.090699 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b5bea180-48e1-4d9f-ba5c-982a25412ff7 tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:00.092120 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b5bea180-48e1-4d9f-ba5c-982a25412ff7 tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:00.490482 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-b5bea180-48e1-4d9f-ba5c-982a25412ff7 tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] 10.222.0.43 "POST /compute/v2.1/servers/1346709b-155a-4048-86ca-f1b08c9d5710/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.423763 Oct 04 22:14:00.491981 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2707/5477] 10.222.0.43 () {60 vars in 1323 bytes} [Tue Oct 4 22:14:00 2022] POST /compute/v2.1/servers/1346709b-155a-4048-86ca-f1b08c9d5710/os-volume_attachments => generated 194 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:14:00.771764 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-7cf78e62-7c29-4442-98e8-440c484de035 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:14:00.773043 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-7cf78e62-7c29-4442-98e8-440c484de035 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] [instance: 367dad85-827d-47b0-a468-418d398b36f9] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:14:00.780336 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7cf78e62-7c29-4442-98e8-440c484de035 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:00.782067 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7cf78e62-7c29-4442-98e8-440c484de035 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:00.782801 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7cf78e62-7c29-4442-98e8-440c484de035 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:00.783722 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7cf78e62-7c29-4442-98e8-440c484de035 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:00.785951 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7cf78e62-7c29-4442-98e8-440c484de035 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:00.787344 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7cf78e62-7c29-4442-98e8-440c484de035 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:00.887348 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-73f216fb-a684-4332-b8f7-cd893b7b3125 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:14:00.888266 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-73f216fb-a684-4332-b8f7-cd893b7b3125 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 20a57394-a798-4356-8b70-3615f9de588e] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:14:00.915180 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-73f216fb-a684-4332-b8f7-cd893b7b3125 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:00.916163 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-73f216fb-a684-4332-b8f7-cd893b7b3125 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:00.917285 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-73f216fb-a684-4332-b8f7-cd893b7b3125 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:00.918046 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-73f216fb-a684-4332-b8f7-cd893b7b3125 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:00.918787 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-73f216fb-a684-4332-b8f7-cd893b7b3125 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:00.919466 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-73f216fb-a684-4332-b8f7-cd893b7b3125 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:00.935163 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-7cf78e62-7c29-4442-98e8-440c484de035 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:14:00.953071 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-7cf78e62-7c29-4442-98e8-440c484de035 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:14:00.955857 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-7cf78e62-7c29-4442-98e8-440c484de035 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:14:00.962192 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-7cf78e62-7c29-4442-98e8-440c484de035 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] 10.222.0.43 "GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9" status: 200 len: 1874 microversion: 2.32 time: 0.194115 Oct 04 22:14:00.966509 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2771/5478] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:14:00 2022] GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9 => generated 1874 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:14:01.314969 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-73f216fb-a684-4332-b8f7-cd893b7b3125 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:14:01.325468 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-73f216fb-a684-4332-b8f7-cd893b7b3125 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/20a57394-a798-4356-8b70-3615f9de588e" status: 200 len: 1514 microversion: 2.1 time: 0.445513 Oct 04 22:14:01.327277 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2708/5479] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:14:00 2022] GET /compute/v2.1/servers/20a57394-a798-4356-8b70-3615f9de588e => generated 1514 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:14:01.992857 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-912def5e-c1af-4278-ad37-37d996c6bbf0 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:14:01.993466 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-912def5e-c1af-4278-ad37-37d996c6bbf0 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] [instance: 367dad85-827d-47b0-a468-418d398b36f9] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:14:02.001231 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-912def5e-c1af-4278-ad37-37d996c6bbf0 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:02.001902 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-912def5e-c1af-4278-ad37-37d996c6bbf0 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:02.002557 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-912def5e-c1af-4278-ad37-37d996c6bbf0 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:02.003416 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-912def5e-c1af-4278-ad37-37d996c6bbf0 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:02.004087 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-912def5e-c1af-4278-ad37-37d996c6bbf0 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:02.004884 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-912def5e-c1af-4278-ad37-37d996c6bbf0 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:02.093360 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-912def5e-c1af-4278-ad37-37d996c6bbf0 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:14:02.103196 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-912def5e-c1af-4278-ad37-37d996c6bbf0 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:14:02.105734 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-912def5e-c1af-4278-ad37-37d996c6bbf0 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:14:02.107174 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-912def5e-c1af-4278-ad37-37d996c6bbf0 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] 10.222.0.43 "GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9" status: 200 len: 1874 microversion: 2.32 time: 0.118228 Oct 04 22:14:02.108256 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2772/5480] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:14:01 2022] GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9 => generated 1874 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:14:02.356924 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-17bc4cde-4232-4542-b0f5-f0a91ecb7c5e tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:14:02.358662 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-17bc4cde-4232-4542-b0f5-f0a91ecb7c5e tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 20a57394-a798-4356-8b70-3615f9de588e] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:14:02.368056 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-17bc4cde-4232-4542-b0f5-f0a91ecb7c5e tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:02.370161 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-17bc4cde-4232-4542-b0f5-f0a91ecb7c5e tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:02.371077 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-17bc4cde-4232-4542-b0f5-f0a91ecb7c5e tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:02.372798 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-17bc4cde-4232-4542-b0f5-f0a91ecb7c5e tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:02.374184 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-17bc4cde-4232-4542-b0f5-f0a91ecb7c5e tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:02.375351 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-17bc4cde-4232-4542-b0f5-f0a91ecb7c5e tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:02.738169 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-17bc4cde-4232-4542-b0f5-f0a91ecb7c5e tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:14:02.756505 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-17bc4cde-4232-4542-b0f5-f0a91ecb7c5e tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/20a57394-a798-4356-8b70-3615f9de588e" status: 200 len: 1514 microversion: 2.1 time: 0.399812 Oct 04 22:14:02.757302 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2709/5481] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:14:02 2022] GET /compute/v2.1/servers/20a57394-a798-4356-8b70-3615f9de588e => generated 1514 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:14:02.811901 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-fb1b7ff1-9e9a-482b-a277-873833e73496 req-fed7b1b8-91b5-494d-9352-fa4a6e96f79f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20a57394-a798-4356-8b70-3615f9de588e", "name": "network-vif-plugged", "status": "completed", "tag": "05ea2c3e-5db0-459a-b0b2-b3d8186a59f0"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:14:02.838729 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-fb1b7ff1-9e9a-482b-a277-873833e73496 req-fed7b1b8-91b5-494d-9352-fa4a6e96f79f service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:02.842122 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-fb1b7ff1-9e9a-482b-a277-873833e73496 req-fed7b1b8-91b5-494d-9352-fa4a6e96f79f service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:02.843318 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-fb1b7ff1-9e9a-482b-a277-873833e73496 req-fed7b1b8-91b5-494d-9352-fa4a6e96f79f service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:02.877398 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-fb1b7ff1-9e9a-482b-a277-873833e73496 req-fed7b1b8-91b5-494d-9352-fa4a6e96f79f service nova] Creating event network-vif-plugged:05ea2c3e-5db0-459a-b0b2-b3d8186a59f0 for instance 20a57394-a798-4356-8b70-3615f9de588e on n-h2-860284-1 Oct 04 22:14:02.885310 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-fb1b7ff1-9e9a-482b-a277-873833e73496 req-fed7b1b8-91b5-494d-9352-fa4a6e96f79f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080842 Oct 04 22:14:02.892175 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2773/5482] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:14:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:14:03.139408 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-f48f59ca-acf0-471d-ad34-fe467e266ab1 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:14:03.140218 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-f48f59ca-acf0-471d-ad34-fe467e266ab1 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] [instance: 367dad85-827d-47b0-a468-418d398b36f9] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:14:03.150044 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f48f59ca-acf0-471d-ad34-fe467e266ab1 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:03.151622 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f48f59ca-acf0-471d-ad34-fe467e266ab1 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:03.152771 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f48f59ca-acf0-471d-ad34-fe467e266ab1 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:03.153749 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f48f59ca-acf0-471d-ad34-fe467e266ab1 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:03.154890 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f48f59ca-acf0-471d-ad34-fe467e266ab1 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:03.155409 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f48f59ca-acf0-471d-ad34-fe467e266ab1 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:03.284565 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-f48f59ca-acf0-471d-ad34-fe467e266ab1 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:14:03.297244 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-f48f59ca-acf0-471d-ad34-fe467e266ab1 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:14:03.299335 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-f48f59ca-acf0-471d-ad34-fe467e266ab1 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:14:03.300843 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-f48f59ca-acf0-471d-ad34-fe467e266ab1 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] 10.222.0.43 "GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9" status: 200 len: 1874 microversion: 2.32 time: 0.166773 Oct 04 22:14:03.301986 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2710/5483] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:14:03 2022] GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9 => generated 1874 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 22:14:03.791258 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-62896360-5c81-4888-aa43-3b27eef66391 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:14:03.793829 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-62896360-5c81-4888-aa43-3b27eef66391 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 20a57394-a798-4356-8b70-3615f9de588e] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:14:03.807318 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-62896360-5c81-4888-aa43-3b27eef66391 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:03.810295 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-62896360-5c81-4888-aa43-3b27eef66391 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:03.811370 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-62896360-5c81-4888-aa43-3b27eef66391 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:03.813686 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-62896360-5c81-4888-aa43-3b27eef66391 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:03.814819 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-62896360-5c81-4888-aa43-3b27eef66391 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:03.815827 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-62896360-5c81-4888-aa43-3b27eef66391 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:04.165388 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-62896360-5c81-4888-aa43-3b27eef66391 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:14:04.174726 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-62896360-5c81-4888-aa43-3b27eef66391 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/20a57394-a798-4356-8b70-3615f9de588e" status: 200 len: 1509 microversion: 2.1 time: 0.392658 Oct 04 22:14:04.177179 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2774/5484] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:14:03 2022] GET /compute/v2.1/servers/20a57394-a798-4356-8b70-3615f9de588e => generated 1509 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:14:04.328458 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-242473f6-ca3f-43fb-9b31-75326811a45b tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:14:04.329081 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-242473f6-ca3f-43fb-9b31-75326811a45b tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] [instance: 367dad85-827d-47b0-a468-418d398b36f9] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:14:04.341877 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-242473f6-ca3f-43fb-9b31-75326811a45b tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:04.342730 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-242473f6-ca3f-43fb-9b31-75326811a45b tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:04.344196 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-242473f6-ca3f-43fb-9b31-75326811a45b tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:04.345267 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-242473f6-ca3f-43fb-9b31-75326811a45b tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:04.347014 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-242473f6-ca3f-43fb-9b31-75326811a45b tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:04.347471 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-242473f6-ca3f-43fb-9b31-75326811a45b tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:04.453970 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-242473f6-ca3f-43fb-9b31-75326811a45b tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:14:04.473245 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-242473f6-ca3f-43fb-9b31-75326811a45b tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:14:04.475785 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-242473f6-ca3f-43fb-9b31-75326811a45b tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:14:04.478755 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-242473f6-ca3f-43fb-9b31-75326811a45b tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] 10.222.0.43 "GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9" status: 200 len: 1874 microversion: 2.32 time: 0.154101 Oct 04 22:14:04.481562 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2711/5485] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:14:04 2022] GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9 => generated 1874 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:14:05.204173 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-9f19ff03-cf99-4241-b841-bf585558e56c tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:14:05.205494 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-9f19ff03-cf99-4241-b841-bf585558e56c tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 20a57394-a798-4356-8b70-3615f9de588e] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:14:05.216534 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9f19ff03-cf99-4241-b841-bf585558e56c tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:05.217647 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9f19ff03-cf99-4241-b841-bf585558e56c tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:05.218294 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9f19ff03-cf99-4241-b841-bf585558e56c tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:05.219265 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9f19ff03-cf99-4241-b841-bf585558e56c tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:05.219948 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9f19ff03-cf99-4241-b841-bf585558e56c tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:05.220566 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9f19ff03-cf99-4241-b841-bf585558e56c tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:05.475292 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-9f19ff03-cf99-4241-b841-bf585558e56c tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:14:05.487307 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-9f19ff03-cf99-4241-b841-bf585558e56c tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/20a57394-a798-4356-8b70-3615f9de588e" status: 200 len: 1509 microversion: 2.1 time: 0.287082 Oct 04 22:14:05.489763 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2775/5486] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:14:05 2022] GET /compute/v2.1/servers/20a57394-a798-4356-8b70-3615f9de588e => generated 1509 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:14:05.508451 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e7a5baee-b300-43ab-9bb2-72b9424b89d2 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:14:05.509093 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-e7a5baee-b300-43ab-9bb2-72b9424b89d2 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] [instance: 367dad85-827d-47b0-a468-418d398b36f9] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:14:05.525993 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e7a5baee-b300-43ab-9bb2-72b9424b89d2 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:05.526562 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e7a5baee-b300-43ab-9bb2-72b9424b89d2 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:05.527688 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e7a5baee-b300-43ab-9bb2-72b9424b89d2 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:05.528733 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e7a5baee-b300-43ab-9bb2-72b9424b89d2 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:05.529443 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e7a5baee-b300-43ab-9bb2-72b9424b89d2 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:05.530097 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e7a5baee-b300-43ab-9bb2-72b9424b89d2 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:05.643127 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-e7a5baee-b300-43ab-9bb2-72b9424b89d2 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:14:05.670078 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-e7a5baee-b300-43ab-9bb2-72b9424b89d2 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:14:05.672023 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-e7a5baee-b300-43ab-9bb2-72b9424b89d2 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:14:05.678832 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-e7a5baee-b300-43ab-9bb2-72b9424b89d2 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] 10.222.0.43 "GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9" status: 200 len: 1874 microversion: 2.32 time: 0.175209 Oct 04 22:14:05.695108 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2712/5487] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:14:05 2022] GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9 => generated 1874 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:14:06.516140 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-5c299aad-4264-4ee0-96f4-539b5fd6ebeb tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:14:06.516758 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-5c299aad-4264-4ee0-96f4-539b5fd6ebeb tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 20a57394-a798-4356-8b70-3615f9de588e] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:14:06.533130 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5c299aad-4264-4ee0-96f4-539b5fd6ebeb tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:06.535644 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5c299aad-4264-4ee0-96f4-539b5fd6ebeb tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:06.535980 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5c299aad-4264-4ee0-96f4-539b5fd6ebeb tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:06.536973 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5c299aad-4264-4ee0-96f4-539b5fd6ebeb tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:06.537438 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5c299aad-4264-4ee0-96f4-539b5fd6ebeb tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:06.537870 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5c299aad-4264-4ee0-96f4-539b5fd6ebeb tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:06.712909 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-95b0bffc-a4b8-4b31-87d7-1293a781aac4 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:14:06.714838 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-95b0bffc-a4b8-4b31-87d7-1293a781aac4 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] [instance: 367dad85-827d-47b0-a468-418d398b36f9] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:14:06.741244 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-95b0bffc-a4b8-4b31-87d7-1293a781aac4 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:06.744490 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-95b0bffc-a4b8-4b31-87d7-1293a781aac4 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:06.745183 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-95b0bffc-a4b8-4b31-87d7-1293a781aac4 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:06.749012 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-95b0bffc-a4b8-4b31-87d7-1293a781aac4 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:06.749693 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-95b0bffc-a4b8-4b31-87d7-1293a781aac4 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:06.750312 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-95b0bffc-a4b8-4b31-87d7-1293a781aac4 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:06.896576 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-95b0bffc-a4b8-4b31-87d7-1293a781aac4 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:14:06.915523 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-95b0bffc-a4b8-4b31-87d7-1293a781aac4 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:14:06.920528 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-95b0bffc-a4b8-4b31-87d7-1293a781aac4 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:14:06.931133 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-95b0bffc-a4b8-4b31-87d7-1293a781aac4 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] 10.222.0.43 "GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9" status: 200 len: 1874 microversion: 2.32 time: 0.220906 Oct 04 22:14:06.933365 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2713/5488] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:14:06 2022] GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9 => generated 1874 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 22:14:06.989728 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-5c299aad-4264-4ee0-96f4-539b5fd6ebeb tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:14:07.002390 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-5c299aad-4264-4ee0-96f4-539b5fd6ebeb tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/20a57394-a798-4356-8b70-3615f9de588e" status: 200 len: 1509 microversion: 2.1 time: 0.490685 Oct 04 22:14:07.015426 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2776/5489] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:14:06 2022] GET /compute/v2.1/servers/20a57394-a798-4356-8b70-3615f9de588e => generated 1509 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:14:07.963208 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-1c0010b5-61af-4f6e-8ac0-639adb9c81da tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:14:07.964554 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-1c0010b5-61af-4f6e-8ac0-639adb9c81da tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] [instance: 367dad85-827d-47b0-a468-418d398b36f9] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:14:07.979880 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1c0010b5-61af-4f6e-8ac0-639adb9c81da tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:07.981640 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1c0010b5-61af-4f6e-8ac0-639adb9c81da tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:07.983017 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1c0010b5-61af-4f6e-8ac0-639adb9c81da tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:07.985728 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1c0010b5-61af-4f6e-8ac0-639adb9c81da tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:07.986442 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1c0010b5-61af-4f6e-8ac0-639adb9c81da tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:07.988958 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1c0010b5-61af-4f6e-8ac0-639adb9c81da tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:08.028859 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-dc362410-6912-4e74-a05c-900c11ad17bb tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:14:08.031005 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-dc362410-6912-4e74-a05c-900c11ad17bb tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 20a57394-a798-4356-8b70-3615f9de588e] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:14:08.050277 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dc362410-6912-4e74-a05c-900c11ad17bb tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:08.050816 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dc362410-6912-4e74-a05c-900c11ad17bb tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:08.051426 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dc362410-6912-4e74-a05c-900c11ad17bb tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:08.052194 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dc362410-6912-4e74-a05c-900c11ad17bb tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:08.052648 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dc362410-6912-4e74-a05c-900c11ad17bb tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:08.053144 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dc362410-6912-4e74-a05c-900c11ad17bb tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:08.170472 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-1c0010b5-61af-4f6e-8ac0-639adb9c81da tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:14:08.186592 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-1c0010b5-61af-4f6e-8ac0-639adb9c81da tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:14:08.191691 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-1c0010b5-61af-4f6e-8ac0-639adb9c81da tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:14:08.196608 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-1c0010b5-61af-4f6e-8ac0-639adb9c81da tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] 10.222.0.43 "GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9" status: 200 len: 1874 microversion: 2.32 time: 0.236241 Oct 04 22:14:08.197476 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2714/5490] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:14:07 2022] GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9 => generated 1874 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:14:08.408070 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-dc362410-6912-4e74-a05c-900c11ad17bb tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:14:08.418109 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-dc362410-6912-4e74-a05c-900c11ad17bb tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/20a57394-a798-4356-8b70-3615f9de588e" status: 200 len: 1509 microversion: 2.1 time: 0.393669 Oct 04 22:14:08.419418 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2777/5491] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:14:08 2022] GET /compute/v2.1/servers/20a57394-a798-4356-8b70-3615f9de588e => generated 1509 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:14:09.229209 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-84d79584-7457-4223-ac73-bc117493c3db tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:14:09.230569 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-84d79584-7457-4223-ac73-bc117493c3db tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] [instance: 367dad85-827d-47b0-a468-418d398b36f9] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:14:09.253466 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-84d79584-7457-4223-ac73-bc117493c3db tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:09.253972 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-84d79584-7457-4223-ac73-bc117493c3db tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:09.264765 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-84d79584-7457-4223-ac73-bc117493c3db tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:09.267022 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-84d79584-7457-4223-ac73-bc117493c3db tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:09.267537 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-84d79584-7457-4223-ac73-bc117493c3db tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:09.267989 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-84d79584-7457-4223-ac73-bc117493c3db tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:09.445562 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-941ca00e-27ee-4ef1-ba1a-aba95d448ee3 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:14:09.446700 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-941ca00e-27ee-4ef1-ba1a-aba95d448ee3 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 20a57394-a798-4356-8b70-3615f9de588e] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:14:09.463352 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-941ca00e-27ee-4ef1-ba1a-aba95d448ee3 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:09.464538 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-941ca00e-27ee-4ef1-ba1a-aba95d448ee3 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:09.464971 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-941ca00e-27ee-4ef1-ba1a-aba95d448ee3 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:09.465692 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-941ca00e-27ee-4ef1-ba1a-aba95d448ee3 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:09.481274 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-941ca00e-27ee-4ef1-ba1a-aba95d448ee3 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:09.485033 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-941ca00e-27ee-4ef1-ba1a-aba95d448ee3 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:10.020635 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-84d79584-7457-4223-ac73-bc117493c3db tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:14:10.054190 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-84d79584-7457-4223-ac73-bc117493c3db tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:14:10.060804 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-84d79584-7457-4223-ac73-bc117493c3db tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:14:10.062329 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-84d79584-7457-4223-ac73-bc117493c3db tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] 10.222.0.43 "GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9" status: 200 len: 1874 microversion: 2.32 time: 0.838297 Oct 04 22:14:10.064975 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2715/5492] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:14:09 2022] GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9 => generated 1874 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:14:10.271729 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-941ca00e-27ee-4ef1-ba1a-aba95d448ee3 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:14:10.291665 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-941ca00e-27ee-4ef1-ba1a-aba95d448ee3 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/20a57394-a798-4356-8b70-3615f9de588e" status: 200 len: 1509 microversion: 2.1 time: 0.845052 Oct 04 22:14:10.309309 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2778/5493] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:14:09 2022] GET /compute/v2.1/servers/20a57394-a798-4356-8b70-3615f9de588e => generated 1509 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:14:11.098974 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-f3a19e19-9189-4e83-8f9d-daa7f5f06671 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:14:11.099657 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-f3a19e19-9189-4e83-8f9d-daa7f5f06671 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] [instance: 367dad85-827d-47b0-a468-418d398b36f9] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:14:11.119884 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f3a19e19-9189-4e83-8f9d-daa7f5f06671 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:11.123120 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f3a19e19-9189-4e83-8f9d-daa7f5f06671 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:11.124187 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f3a19e19-9189-4e83-8f9d-daa7f5f06671 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:11.124963 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f3a19e19-9189-4e83-8f9d-daa7f5f06671 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:11.127557 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f3a19e19-9189-4e83-8f9d-daa7f5f06671 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:11.128010 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f3a19e19-9189-4e83-8f9d-daa7f5f06671 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:11.258404 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-f3a19e19-9189-4e83-8f9d-daa7f5f06671 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:14:11.276760 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-f3a19e19-9189-4e83-8f9d-daa7f5f06671 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:14:11.279405 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-f3a19e19-9189-4e83-8f9d-daa7f5f06671 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:14:11.281844 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-f3a19e19-9189-4e83-8f9d-daa7f5f06671 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] 10.222.0.43 "GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9" status: 200 len: 1874 microversion: 2.32 time: 0.188255 Oct 04 22:14:11.283158 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2716/5494] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:14:11 2022] GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9 => generated 1874 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:14:11.321868 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-1ec7bf2b-eab7-4256-9550-b303058c8b12 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:14:11.323268 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-1ec7bf2b-eab7-4256-9550-b303058c8b12 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 20a57394-a798-4356-8b70-3615f9de588e] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:14:11.332542 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1ec7bf2b-eab7-4256-9550-b303058c8b12 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:11.333267 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1ec7bf2b-eab7-4256-9550-b303058c8b12 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:11.333951 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1ec7bf2b-eab7-4256-9550-b303058c8b12 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:11.334974 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1ec7bf2b-eab7-4256-9550-b303058c8b12 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:11.335752 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1ec7bf2b-eab7-4256-9550-b303058c8b12 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:11.336412 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1ec7bf2b-eab7-4256-9550-b303058c8b12 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:11.626911 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-1ec7bf2b-eab7-4256-9550-b303058c8b12 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:14:11.640842 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-1ec7bf2b-eab7-4256-9550-b303058c8b12 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/20a57394-a798-4356-8b70-3615f9de588e" status: 200 len: 1509 microversion: 2.1 time: 0.318097 Oct 04 22:14:11.643961 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2779/5495] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:14:11 2022] GET /compute/v2.1/servers/20a57394-a798-4356-8b70-3615f9de588e => generated 1509 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:14:12.312691 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-73faa159-e7f1-4955-8e2f-7be040132ed2 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:14:12.313314 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-73faa159-e7f1-4955-8e2f-7be040132ed2 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] [instance: 367dad85-827d-47b0-a468-418d398b36f9] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:14:12.326588 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-73faa159-e7f1-4955-8e2f-7be040132ed2 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:12.330886 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-73faa159-e7f1-4955-8e2f-7be040132ed2 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:12.334770 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-73faa159-e7f1-4955-8e2f-7be040132ed2 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:12.335835 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-73faa159-e7f1-4955-8e2f-7be040132ed2 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:12.336669 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-73faa159-e7f1-4955-8e2f-7be040132ed2 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:12.341913 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-73faa159-e7f1-4955-8e2f-7be040132ed2 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:12.383246 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:14:12.529780 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-73faa159-e7f1-4955-8e2f-7be040132ed2 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:14:12.565151 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-73faa159-e7f1-4955-8e2f-7be040132ed2 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:14:12.572289 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-73faa159-e7f1-4955-8e2f-7be040132ed2 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:14:12.583344 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-73faa159-e7f1-4955-8e2f-7be040132ed2 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] 10.222.0.43 "GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9" status: 200 len: 1874 microversion: 2.32 time: 0.274746 Oct 04 22:14:12.616501 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2717/5496] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:14:12 2022] GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9 => generated 1874 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 22:14:12.672891 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-11e9ef70-5023-47e9-9c51-984e84354699 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:14:12.674109 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-11e9ef70-5023-47e9-9c51-984e84354699 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 20a57394-a798-4356-8b70-3615f9de588e] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:14:12.685752 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_api:SELECT=68 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:14:12.687415 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-11e9ef70-5023-47e9-9c51-984e84354699 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:12.690546 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-11e9ef70-5023-47e9-9c51-984e84354699 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:12.691194 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-11e9ef70-5023-47e9-9c51-984e84354699 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:12.692097 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-11e9ef70-5023-47e9-9c51-984e84354699 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:12.699411 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-11e9ef70-5023-47e9-9c51-984e84354699 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:12.700140 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-11e9ef70-5023-47e9-9c51-984e84354699 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:12.704194 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:14:13.024018 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-11e9ef70-5023-47e9-9c51-984e84354699 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:14:13.034200 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-11e9ef70-5023-47e9-9c51-984e84354699 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/20a57394-a798-4356-8b70-3615f9de588e" status: 200 len: 1509 microversion: 2.1 time: 0.364822 Oct 04 22:14:13.040794 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2780/5497] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:14:12 2022] GET /compute/v2.1/servers/20a57394-a798-4356-8b70-3615f9de588e => generated 1509 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:14:13.621177 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-38087056-1c17-486d-b5e3-b03d69f9f435 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:14:13.622626 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-38087056-1c17-486d-b5e3-b03d69f9f435 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] [instance: 367dad85-827d-47b0-a468-418d398b36f9] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:14:13.640212 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=3 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:14:13.644120 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-38087056-1c17-486d-b5e3-b03d69f9f435 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:13.646492 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-38087056-1c17-486d-b5e3-b03d69f9f435 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:13.647879 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-38087056-1c17-486d-b5e3-b03d69f9f435 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:13.652242 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-38087056-1c17-486d-b5e3-b03d69f9f435 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:13.653415 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-38087056-1c17-486d-b5e3-b03d69f9f435 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:13.655490 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-38087056-1c17-486d-b5e3-b03d69f9f435 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:13.811131 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-38087056-1c17-486d-b5e3-b03d69f9f435 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:14:13.838694 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-38087056-1c17-486d-b5e3-b03d69f9f435 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:14:13.844485 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-38087056-1c17-486d-b5e3-b03d69f9f435 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:14:13.846650 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-38087056-1c17-486d-b5e3-b03d69f9f435 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] 10.222.0.43 "GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9" status: 200 len: 1874 microversion: 2.32 time: 0.230491 Oct 04 22:14:13.852592 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2718/5498] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:14:13 2022] GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9 => generated 1874 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:14:14.063702 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-f4b3f047-2bbc-488c-bbf0-64d07e25b62f tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:14:14.064322 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-f4b3f047-2bbc-488c-bbf0-64d07e25b62f tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 20a57394-a798-4356-8b70-3615f9de588e] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:14:14.072263 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f4b3f047-2bbc-488c-bbf0-64d07e25b62f tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:14.072756 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f4b3f047-2bbc-488c-bbf0-64d07e25b62f tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:14.073825 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f4b3f047-2bbc-488c-bbf0-64d07e25b62f tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:14.074841 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f4b3f047-2bbc-488c-bbf0-64d07e25b62f tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:14.083106 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f4b3f047-2bbc-488c-bbf0-64d07e25b62f tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:14.083821 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f4b3f047-2bbc-488c-bbf0-64d07e25b62f tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:14.479362 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-f4b3f047-2bbc-488c-bbf0-64d07e25b62f tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:14:14.488265 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-f4b3f047-2bbc-488c-bbf0-64d07e25b62f tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/20a57394-a798-4356-8b70-3615f9de588e" status: 200 len: 1509 microversion: 2.1 time: 0.428308 Oct 04 22:14:14.489465 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2781/5499] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:14:14 2022] GET /compute/v2.1/servers/20a57394-a798-4356-8b70-3615f9de588e => generated 1509 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:14:14.885099 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-3b66b9e7-850f-41be-a073-d5117f444bf7 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:14:14.886339 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-3b66b9e7-850f-41be-a073-d5117f444bf7 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] [instance: 367dad85-827d-47b0-a468-418d398b36f9] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:14:14.904917 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3b66b9e7-850f-41be-a073-d5117f444bf7 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:14.905429 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3b66b9e7-850f-41be-a073-d5117f444bf7 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:14.905881 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3b66b9e7-850f-41be-a073-d5117f444bf7 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:14.906634 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3b66b9e7-850f-41be-a073-d5117f444bf7 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:14.907102 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3b66b9e7-850f-41be-a073-d5117f444bf7 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:14.907535 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3b66b9e7-850f-41be-a073-d5117f444bf7 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:15.080234 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-3b66b9e7-850f-41be-a073-d5117f444bf7 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:14:15.093868 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-3b66b9e7-850f-41be-a073-d5117f444bf7 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:14:15.106019 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-3b66b9e7-850f-41be-a073-d5117f444bf7 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:14:15.107404 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-3b66b9e7-850f-41be-a073-d5117f444bf7 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] 10.222.0.43 "GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9" status: 200 len: 1874 microversion: 2.32 time: 0.227381 Oct 04 22:14:15.107998 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2719/5500] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:14:14 2022] GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9 => generated 1874 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:14:15.522888 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-39faaaf2-62e1-4e30-8885-047e9ed656cc tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:14:15.523885 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-39faaaf2-62e1-4e30-8885-047e9ed656cc tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 20a57394-a798-4356-8b70-3615f9de588e] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:14:15.536545 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-39faaaf2-62e1-4e30-8885-047e9ed656cc tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:15.537453 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-39faaaf2-62e1-4e30-8885-047e9ed656cc tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:15.537911 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-39faaaf2-62e1-4e30-8885-047e9ed656cc tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:15.541314 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-39faaaf2-62e1-4e30-8885-047e9ed656cc tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:15.542859 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-39faaaf2-62e1-4e30-8885-047e9ed656cc tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:15.543318 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-39faaaf2-62e1-4e30-8885-047e9ed656cc tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:15.877446 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-39faaaf2-62e1-4e30-8885-047e9ed656cc tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:14:15.896027 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-39faaaf2-62e1-4e30-8885-047e9ed656cc tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/20a57394-a798-4356-8b70-3615f9de588e" status: 200 len: 1509 microversion: 2.1 time: 0.377754 Oct 04 22:14:15.898544 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2782/5501] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:14:15 2022] GET /compute/v2.1/servers/20a57394-a798-4356-8b70-3615f9de588e => generated 1509 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:14:16.136252 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-70e5bd41-9ddb-4a90-8b88-39a45b49cbe6 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:14:16.137047 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-70e5bd41-9ddb-4a90-8b88-39a45b49cbe6 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] [instance: 367dad85-827d-47b0-a468-418d398b36f9] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:14:16.157307 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-70e5bd41-9ddb-4a90-8b88-39a45b49cbe6 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:16.159895 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-70e5bd41-9ddb-4a90-8b88-39a45b49cbe6 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:16.160464 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-70e5bd41-9ddb-4a90-8b88-39a45b49cbe6 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:16.163914 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-70e5bd41-9ddb-4a90-8b88-39a45b49cbe6 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:16.165616 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-70e5bd41-9ddb-4a90-8b88-39a45b49cbe6 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:16.168040 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-70e5bd41-9ddb-4a90-8b88-39a45b49cbe6 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:16.294828 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-70e5bd41-9ddb-4a90-8b88-39a45b49cbe6 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:14:16.309444 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-70e5bd41-9ddb-4a90-8b88-39a45b49cbe6 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:14:16.311458 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-70e5bd41-9ddb-4a90-8b88-39a45b49cbe6 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:14:16.313726 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-70e5bd41-9ddb-4a90-8b88-39a45b49cbe6 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] 10.222.0.43 "GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9" status: 200 len: 1874 microversion: 2.32 time: 0.183318 Oct 04 22:14:16.314815 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2720/5502] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:14:16 2022] GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9 => generated 1874 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:14:16.937924 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-6a580525-a4d7-40a9-87dd-0943df67783a tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:14:16.942936 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-6a580525-a4d7-40a9-87dd-0943df67783a tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 20a57394-a798-4356-8b70-3615f9de588e] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:14:16.957820 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6a580525-a4d7-40a9-87dd-0943df67783a tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:16.960402 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6a580525-a4d7-40a9-87dd-0943df67783a tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:16.962621 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6a580525-a4d7-40a9-87dd-0943df67783a tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:16.967219 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6a580525-a4d7-40a9-87dd-0943df67783a tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:16.968026 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6a580525-a4d7-40a9-87dd-0943df67783a tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:16.968725 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6a580525-a4d7-40a9-87dd-0943df67783a tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:17.244001 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-6a580525-a4d7-40a9-87dd-0943df67783a tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:14:17.254616 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-6a580525-a4d7-40a9-87dd-0943df67783a tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/20a57394-a798-4356-8b70-3615f9de588e" status: 200 len: 1509 microversion: 2.1 time: 0.326960 Oct 04 22:14:17.255757 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2783/5503] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:14:16 2022] GET /compute/v2.1/servers/20a57394-a798-4356-8b70-3615f9de588e => generated 1509 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:14:17.348314 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-9ef63fde-ea93-4029-95ed-1d327eb5a041 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:14:17.349841 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-9ef63fde-ea93-4029-95ed-1d327eb5a041 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] [instance: 367dad85-827d-47b0-a468-418d398b36f9] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:14:17.367828 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9ef63fde-ea93-4029-95ed-1d327eb5a041 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:17.369520 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9ef63fde-ea93-4029-95ed-1d327eb5a041 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:17.371988 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9ef63fde-ea93-4029-95ed-1d327eb5a041 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:17.372736 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9ef63fde-ea93-4029-95ed-1d327eb5a041 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:17.374033 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9ef63fde-ea93-4029-95ed-1d327eb5a041 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:17.374541 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9ef63fde-ea93-4029-95ed-1d327eb5a041 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:17.475851 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-9ef63fde-ea93-4029-95ed-1d327eb5a041 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:14:17.490695 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-9ef63fde-ea93-4029-95ed-1d327eb5a041 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:14:17.493160 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-9ef63fde-ea93-4029-95ed-1d327eb5a041 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:14:17.496086 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-9ef63fde-ea93-4029-95ed-1d327eb5a041 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] 10.222.0.43 "GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9" status: 200 len: 1874 microversion: 2.32 time: 0.152159 Oct 04 22:14:17.497571 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2721/5504] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:14:17 2022] GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9 => generated 1874 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:14:18.293233 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-f72d0808-463f-4e75-ab5e-deb906b7c492 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:14:18.295019 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-f72d0808-463f-4e75-ab5e-deb906b7c492 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 20a57394-a798-4356-8b70-3615f9de588e] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:14:18.315893 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f72d0808-463f-4e75-ab5e-deb906b7c492 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:18.316416 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f72d0808-463f-4e75-ab5e-deb906b7c492 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:18.316868 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f72d0808-463f-4e75-ab5e-deb906b7c492 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:18.317600 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f72d0808-463f-4e75-ab5e-deb906b7c492 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:18.325661 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f72d0808-463f-4e75-ab5e-deb906b7c492 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:18.328249 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f72d0808-463f-4e75-ab5e-deb906b7c492 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:18.533206 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-2c61fd10-9028-4b3f-9da9-86c246df4733 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:14:18.533831 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-2c61fd10-9028-4b3f-9da9-86c246df4733 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] [instance: 367dad85-827d-47b0-a468-418d398b36f9] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:14:18.552309 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2c61fd10-9028-4b3f-9da9-86c246df4733 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:18.553101 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2c61fd10-9028-4b3f-9da9-86c246df4733 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:18.553751 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2c61fd10-9028-4b3f-9da9-86c246df4733 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:18.554522 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2c61fd10-9028-4b3f-9da9-86c246df4733 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:18.554990 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2c61fd10-9028-4b3f-9da9-86c246df4733 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:18.555429 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2c61fd10-9028-4b3f-9da9-86c246df4733 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:18.640899 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2c61fd10-9028-4b3f-9da9-86c246df4733 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:18.641409 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2c61fd10-9028-4b3f-9da9-86c246df4733 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:18.641865 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2c61fd10-9028-4b3f-9da9-86c246df4733 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:18.642501 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.objects.instance [None req-2c61fd10-9028-4b3f-9da9-86c246df4733 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lazy-loading 'fault' on Instance uuid 367dad85-827d-47b0-a468-418d398b36f9 {{(pid=134101) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 22:14:18.822003 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-f72d0808-463f-4e75-ab5e-deb906b7c492 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:14:18.832260 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-f72d0808-463f-4e75-ab5e-deb906b7c492 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/20a57394-a798-4356-8b70-3615f9de588e" status: 200 len: 1509 microversion: 2.1 time: 0.551452 Oct 04 22:14:18.832910 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2784/5505] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:14:18 2022] GET /compute/v2.1/servers/20a57394-a798-4356-8b70-3615f9de588e => generated 1509 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:14:18.907982 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-2c61fd10-9028-4b3f-9da9-86c246df4733 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:14:18.935623 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-2c61fd10-9028-4b3f-9da9-86c246df4733 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:14:18.946144 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-2c61fd10-9028-4b3f-9da9-86c246df4733 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed57db002d7b42ea8533ed32b6904c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f877741b2664498e974791b4952bfc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:14:18.949929 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-2c61fd10-9028-4b3f-9da9-86c246df4733 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] 10.222.0.43 "GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9" status: 200 len: 1879 microversion: 2.32 time: 0.420589 Oct 04 22:14:18.952631 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2722/5506] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:14:18 2022] GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9 => generated 1879 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:14:19.858963 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-c16215cd-4c7a-4bb7-afa0-004479ae18a1 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:14:19.859590 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-c16215cd-4c7a-4bb7-afa0-004479ae18a1 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 20a57394-a798-4356-8b70-3615f9de588e] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:14:19.881331 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-25f4cf6b-9282-4ba7-8cc8-61e58bf06e89 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1813116840 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1813116840-project-admin] Calling method '.version_select at 0x7fbb2e6ffdc0>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:14:19.884085 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-25f4cf6b-9282-4ba7-8cc8-61e58bf06e89 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1813116840 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1813116840-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:19.884624 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-25f4cf6b-9282-4ba7-8cc8-61e58bf06e89 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1813116840 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1813116840-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:19.885097 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-25f4cf6b-9282-4ba7-8cc8-61e58bf06e89 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1813116840 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1813116840-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:19.903795 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c16215cd-4c7a-4bb7-afa0-004479ae18a1 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:19.904300 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c16215cd-4c7a-4bb7-afa0-004479ae18a1 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:19.904737 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c16215cd-4c7a-4bb7-afa0-004479ae18a1 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:19.905466 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c16215cd-4c7a-4bb7-afa0-004479ae18a1 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:19.905923 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c16215cd-4c7a-4bb7-afa0-004479ae18a1 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:19.906458 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c16215cd-4c7a-4bb7-afa0-004479ae18a1 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:19.955555 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-25f4cf6b-9282-4ba7-8cc8-61e58bf06e89 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1813116840 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1813116840-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:19.956508 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-25f4cf6b-9282-4ba7-8cc8-61e58bf06e89 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1813116840 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1813116840-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:19.957387 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-25f4cf6b-9282-4ba7-8cc8-61e58bf06e89 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1813116840 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1813116840-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:19.998928 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-25f4cf6b-9282-4ba7-8cc8-61e58bf06e89 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1813116840 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1813116840-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:19.999696 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-25f4cf6b-9282-4ba7-8cc8-61e58bf06e89 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1813116840 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1813116840-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:20.002122 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-25f4cf6b-9282-4ba7-8cc8-61e58bf06e89 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1813116840 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1813116840-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:20.016457 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-25f4cf6b-9282-4ba7-8cc8-61e58bf06e89 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1813116840 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1813116840-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.687739 Oct 04 22:14:20.022307 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2785/5507] 10.222.0.43 () {58 vars in 1146 bytes} [Tue Oct 4 22:14:19 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:14:20.022307 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-05c4747c-20fc-4133-bbb2-870e697f91ee tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:14:20.022307 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-05c4747c-20fc-4133-bbb2-870e697f91ee tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] [instance: 367dad85-827d-47b0-a468-418d398b36f9] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:14:20.047409 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-05c4747c-20fc-4133-bbb2-870e697f91ee tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:20.048061 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-05c4747c-20fc-4133-bbb2-870e697f91ee tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:20.048583 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-05c4747c-20fc-4133-bbb2-870e697f91ee tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:20.049374 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-05c4747c-20fc-4133-bbb2-870e697f91ee tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:20.049978 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-05c4747c-20fc-4133-bbb2-870e697f91ee tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:20.050513 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-05c4747c-20fc-4133-bbb2-870e697f91ee tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:20.084126 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-05c4747c-20fc-4133-bbb2-870e697f91ee tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] HTTP exception thrown: Instance 367dad85-827d-47b0-a468-418d398b36f9 could not be found. Oct 04 22:14:20.094977 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-05c4747c-20fc-4133-bbb2-870e697f91ee tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Request method failure captured: Oct 04 22:14:20.094977 n-d-860284-1 devstack@n-api.service[134102]: request: GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9 HTTP/1.1 Oct 04 22:14:20.094977 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 22:14:20.094977 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 22:14:20.094977 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 22:14:20.094977 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 22:14:20.094977 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 22:14:20.094977 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 22:14:20.094977 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 22:14:20.094977 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 22:14:20.094977 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPK6DyZ68D3YsljtT08gRS1ePp3Hl3Sg5qoyHBGnNBZGl8Hx4_8yp4xdJLqrc1qCQ5yvGsoKj0LqIu2wSPsQsi5n7ToJRC0AHbOMtiPKsL2OxAp0OI_GsIpyJbQu_pQSkEMpdZS7qm_PVxTC-i6vy3sEo7k3TICIgJ30UK2AYlV0krlQ Oct 04 22:14:20.094977 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 22:14:20.094977 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 22:14:20.094977 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 22:14:20.094977 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 22:14:20.094977 n-d-860284-1 devstack@n-api.service[134102]: X-Openstack-Nova-Api-Version: 2.32 Oct 04 22:14:20.094977 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 22:14:20.094977 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 22:14:20.094977 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: f877741b2664498e974791b4952bfc92 Oct 04 22:14:20.094977 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-TaggedBootDevicesTest-1574375746 Oct 04 22:14:20.094977 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 22:14:20.094977 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 22:14:20.094977 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f877741b2664498e974791b4952bfc92"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_f877741b2664498e974791b4952bfc92", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f877741b2664498e974791b4952bfc92"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/f877741b2664498e974791b4952bfc92"}]}] Oct 04 22:14:20.094977 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-TaggedBootDevicesTest-1574375746 Oct 04 22:14:20.094977 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: f877741b2664498e974791b4952bfc92 Oct 04 22:14:20.094977 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1574375746 Oct 04 22:14:20.094977 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-TaggedBootDevicesTest-1574375746-project Oct 04 22:14:20.094977 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 22:14:20.094977 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 22:14:20.094977 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: ed57db002d7b42ea8533ed32b6904c63 Oct 04 22:14:20.094977 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-TaggedBootDevicesTest-1574375746-project Oct 04 22:14:20.094977 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 22:14:20.094977 n-d-860284-1 devstack@n-api.service[134102]: exception: Instance 367dad85-827d-47b0-a468-418d398b36f9 could not be found. Oct 04 22:14:20.094977 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': '367dad85-827d-47b0-a468-418d398b36f9'} Oct 04 22:14:20.094977 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:14:20.094977 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:14:20.094977 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:14:20.094977 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:14:20.094977 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:14:20.094977 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:14:20.094977 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:14:20.094977 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:14:20.094977 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:14:20.094977 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:14:20.094977 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 367dad85-827d-47b0-a468-418d398b36f9 could not be found. Oct 04 22:14:20.094977 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:14:20.094977 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:14:20.094977 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:14:20.094977 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:14:20.094977 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:14:20.094977 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:14:20.094977 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:14:20.094977 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:14:20.094977 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:14:20.094977 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:14:20.094977 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:14:20.094977 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:14:20.094977 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:14:20.094977 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:14:20.094977 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:14:20.094977 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:14:20.094977 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 367dad85-827d-47b0-a468-418d398b36f9 could not be found. Oct 04 22:14:20.094977 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:14:20.094977 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:14:20.099366 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:14:20.099366 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:14:20.099366 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:14:20.099366 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:14:20.099366 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:14:20.099366 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:14:20.099366 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 367dad85-827d-47b0-a468-418d398b36f9 could not be found. Oct 04 22:14:20.099366 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:14:20.099366 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-05c4747c-20fc-4133-bbb2-870e697f91ee tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Returning 404 to user: Instance 367dad85-827d-47b0-a468-418d398b36f9 could not be found. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:14:20.099366 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-05c4747c-20fc-4133-bbb2-870e697f91ee tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] 10.222.0.43 "GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9" status: 404 len: 111 microversion: 2.32 time: 0.074525 Oct 04 22:14:20.103309 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2786/5508] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:14:20 2022] GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 22:14:20.109692 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-43381110-4627-41d9-b228-da4d885a5390 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Calling method '.version_select at 0x7fbb2e49f310>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:14:20.161837 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-43381110-4627-41d9-b228-da4d885a5390 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-631057217" status: 204 len: 0 microversion: 2.32 time: 0.056306 Oct 04 22:14:20.164306 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2787/5509] 10.222.0.43 () {60 vars in 1259 bytes} [Tue Oct 4 22:14:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-631057217 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 22:14:20.654755 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-c16215cd-4c7a-4bb7-afa0-004479ae18a1 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:14:20.669871 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-c16215cd-4c7a-4bb7-afa0-004479ae18a1 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/20a57394-a798-4356-8b70-3615f9de588e" status: 200 len: 1509 microversion: 2.1 time: 0.815458 Oct 04 22:14:20.675357 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2723/5510] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:14:19 2022] GET /compute/v2.1/servers/20a57394-a798-4356-8b70-3615f9de588e => generated 1509 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:14:21.697021 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-c1cd3fc9-e62d-45b9-afd9-d86f32f522e2 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:14:21.701116 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-c1cd3fc9-e62d-45b9-afd9-d86f32f522e2 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 20a57394-a798-4356-8b70-3615f9de588e] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:14:21.712128 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c1cd3fc9-e62d-45b9-afd9-d86f32f522e2 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:21.714643 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c1cd3fc9-e62d-45b9-afd9-d86f32f522e2 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:21.715781 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c1cd3fc9-e62d-45b9-afd9-d86f32f522e2 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:21.716759 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c1cd3fc9-e62d-45b9-afd9-d86f32f522e2 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:21.717961 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c1cd3fc9-e62d-45b9-afd9-d86f32f522e2 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:21.718645 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c1cd3fc9-e62d-45b9-afd9-d86f32f522e2 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:22.057041 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-c1cd3fc9-e62d-45b9-afd9-d86f32f522e2 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:14:22.072392 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-c1cd3fc9-e62d-45b9-afd9-d86f32f522e2 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/20a57394-a798-4356-8b70-3615f9de588e" status: 200 len: 1509 microversion: 2.1 time: 0.380833 Oct 04 22:14:22.074789 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2788/5511] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:14:21 2022] GET /compute/v2.1/servers/20a57394-a798-4356-8b70-3615f9de588e => generated 1509 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:14:23.098545 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e95f18c0-c67b-4dba-96d9-5230574b9a03 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:14:23.099965 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-e95f18c0-c67b-4dba-96d9-5230574b9a03 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 20a57394-a798-4356-8b70-3615f9de588e] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:14:23.112611 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e95f18c0-c67b-4dba-96d9-5230574b9a03 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:23.123507 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e95f18c0-c67b-4dba-96d9-5230574b9a03 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:23.123507 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e95f18c0-c67b-4dba-96d9-5230574b9a03 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:23.123507 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e95f18c0-c67b-4dba-96d9-5230574b9a03 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:23.123507 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e95f18c0-c67b-4dba-96d9-5230574b9a03 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:23.123507 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e95f18c0-c67b-4dba-96d9-5230574b9a03 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:23.455390 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-e95f18c0-c67b-4dba-96d9-5230574b9a03 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:14:23.467231 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-e95f18c0-c67b-4dba-96d9-5230574b9a03 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/20a57394-a798-4356-8b70-3615f9de588e" status: 200 len: 1509 microversion: 2.1 time: 0.372531 Oct 04 22:14:23.467827 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2724/5512] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:14:23 2022] GET /compute/v2.1/servers/20a57394-a798-4356-8b70-3615f9de588e => generated 1509 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:14:24.491495 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-d2f46dde-4068-4ef9-8619-b9557bb90fa0 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:14:24.493418 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-d2f46dde-4068-4ef9-8619-b9557bb90fa0 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 20a57394-a798-4356-8b70-3615f9de588e] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:14:24.548361 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d2f46dde-4068-4ef9-8619-b9557bb90fa0 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:24.550985 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d2f46dde-4068-4ef9-8619-b9557bb90fa0 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:24.559091 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d2f46dde-4068-4ef9-8619-b9557bb90fa0 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:24.560236 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d2f46dde-4068-4ef9-8619-b9557bb90fa0 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:24.567659 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d2f46dde-4068-4ef9-8619-b9557bb90fa0 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:24.568532 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d2f46dde-4068-4ef9-8619-b9557bb90fa0 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:25.027133 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-d2f46dde-4068-4ef9-8619-b9557bb90fa0 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:14:25.040488 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-d2f46dde-4068-4ef9-8619-b9557bb90fa0 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/20a57394-a798-4356-8b70-3615f9de588e" status: 200 len: 1509 microversion: 2.1 time: 0.552793 Oct 04 22:14:25.043579 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2789/5513] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:14:24 2022] GET /compute/v2.1/servers/20a57394-a798-4356-8b70-3615f9de588e => generated 1509 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:14:26.071291 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-0f980799-aaa3-4c41-80d7-7e223c38d586 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:14:26.074202 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-0f980799-aaa3-4c41-80d7-7e223c38d586 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 20a57394-a798-4356-8b70-3615f9de588e] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:14:26.087756 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0f980799-aaa3-4c41-80d7-7e223c38d586 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:26.091763 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0f980799-aaa3-4c41-80d7-7e223c38d586 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:26.093096 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0f980799-aaa3-4c41-80d7-7e223c38d586 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:26.095401 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0f980799-aaa3-4c41-80d7-7e223c38d586 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:26.096277 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0f980799-aaa3-4c41-80d7-7e223c38d586 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:26.096899 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0f980799-aaa3-4c41-80d7-7e223c38d586 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:26.623468 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-0f980799-aaa3-4c41-80d7-7e223c38d586 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:14:26.634495 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-0f980799-aaa3-4c41-80d7-7e223c38d586 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/20a57394-a798-4356-8b70-3615f9de588e" status: 200 len: 1506 microversion: 2.1 time: 0.569212 Oct 04 22:14:26.654535 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2725/5514] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:14:26 2022] GET /compute/v2.1/servers/20a57394-a798-4356-8b70-3615f9de588e => generated 1506 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:14:26.736433 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-b50e41cf-e51b-41f6-877e-96b62b5b96b6 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:14:26.736961 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-b50e41cf-e51b-41f6-877e-96b62b5b96b6 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] [instance: 367dad85-827d-47b0-a468-418d398b36f9] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:14:26.753731 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b50e41cf-e51b-41f6-877e-96b62b5b96b6 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:26.754341 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b50e41cf-e51b-41f6-877e-96b62b5b96b6 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:26.754883 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b50e41cf-e51b-41f6-877e-96b62b5b96b6 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:26.755695 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b50e41cf-e51b-41f6-877e-96b62b5b96b6 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:26.756230 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b50e41cf-e51b-41f6-877e-96b62b5b96b6 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:26.756791 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b50e41cf-e51b-41f6-877e-96b62b5b96b6 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:26.772813 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-b50e41cf-e51b-41f6-877e-96b62b5b96b6 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] HTTP exception thrown: Instance 367dad85-827d-47b0-a468-418d398b36f9 could not be found. Oct 04 22:14:26.774752 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-b50e41cf-e51b-41f6-877e-96b62b5b96b6 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Request method failure captured: Oct 04 22:14:26.774752 n-d-860284-1 devstack@n-api.service[134102]: request: DELETE /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9 HTTP/1.1 Oct 04 22:14:26.774752 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 22:14:26.774752 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 22:14:26.774752 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 22:14:26.774752 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 22:14:26.774752 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 22:14:26.774752 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 22:14:26.774752 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 22:14:26.774752 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 22:14:26.774752 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPK6DyZ68D3YsljtT08gRS1ePp3Hl3Sg5qoyHBGnNBZGl8Hx4_8yp4xdJLqrc1qCQ5yvGsoKj0LqIu2wSPsQsi5n7ToJRC0AHbOMtiPKsL2OxAp0OI_GsIpyJbQu_pQSkEMpdZS7qm_PVxTC-i6vy3sEo7k3TICIgJ30UK2AYlV0krlQ Oct 04 22:14:26.774752 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 22:14:26.774752 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 22:14:26.774752 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 22:14:26.774752 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 22:14:26.774752 n-d-860284-1 devstack@n-api.service[134102]: X-Openstack-Nova-Api-Version: 2.32 Oct 04 22:14:26.774752 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 22:14:26.774752 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 22:14:26.774752 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: f877741b2664498e974791b4952bfc92 Oct 04 22:14:26.774752 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-TaggedBootDevicesTest-1574375746 Oct 04 22:14:26.774752 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 22:14:26.774752 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 22:14:26.774752 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f877741b2664498e974791b4952bfc92"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_f877741b2664498e974791b4952bfc92", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f877741b2664498e974791b4952bfc92"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/f877741b2664498e974791b4952bfc92"}]}] Oct 04 22:14:26.774752 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-TaggedBootDevicesTest-1574375746 Oct 04 22:14:26.774752 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: f877741b2664498e974791b4952bfc92 Oct 04 22:14:26.774752 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1574375746 Oct 04 22:14:26.774752 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-TaggedBootDevicesTest-1574375746-project Oct 04 22:14:26.774752 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 22:14:26.774752 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 22:14:26.774752 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: ed57db002d7b42ea8533ed32b6904c63 Oct 04 22:14:26.774752 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-TaggedBootDevicesTest-1574375746-project Oct 04 22:14:26.774752 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 22:14:26.774752 n-d-860284-1 devstack@n-api.service[134102]: exception: Instance 367dad85-827d-47b0-a468-418d398b36f9 could not be found. Oct 04 22:14:26.774752 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': '367dad85-827d-47b0-a468-418d398b36f9'} Oct 04 22:14:26.774752 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:14:26.774752 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:14:26.774752 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:14:26.774752 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:14:26.774752 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:14:26.774752 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:14:26.774752 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:14:26.774752 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:14:26.774752 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:14:26.774752 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:14:26.774752 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 367dad85-827d-47b0-a468-418d398b36f9 could not be found. Oct 04 22:14:26.774752 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:14:26.774752 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:14:26.774752 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:14:26.774752 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:14:26.774752 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:14:26.774752 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:14:26.774752 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:14:26.774752 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:14:26.774752 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:14:26.774752 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:14:26.774752 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 22:14:26.774752 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 22:14:26.774752 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 22:14:26.774752 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 22:14:26.774752 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:14:26.774752 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:14:26.774752 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:14:26.774752 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:14:26.779273 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 367dad85-827d-47b0-a468-418d398b36f9 could not be found. Oct 04 22:14:26.779273 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:14:26.779273 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:14:26.779273 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:14:26.779273 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:14:26.779273 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:14:26.779273 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:14:26.779273 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:14:26.779273 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:14:26.779273 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 367dad85-827d-47b0-a468-418d398b36f9 could not be found. Oct 04 22:14:26.779273 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:14:26.785435 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-b50e41cf-e51b-41f6-877e-96b62b5b96b6 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Returning 404 to user: Instance 367dad85-827d-47b0-a468-418d398b36f9 could not be found. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:14:26.786631 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-b50e41cf-e51b-41f6-877e-96b62b5b96b6 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] 10.222.0.43 "DELETE /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9" status: 404 len: 111 microversion: 2.32 time: 0.054862 Oct 04 22:14:26.787530 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2790/5515] 10.222.0.43 () {60 vars in 1280 bytes} [Tue Oct 4 22:14:26 2022] DELETE /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 22:14:26.796897 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-939ad578-f678-4fb0-aee3-d39823336308 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:14:26.797870 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-939ad578-f678-4fb0-aee3-d39823336308 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] [instance: 367dad85-827d-47b0-a468-418d398b36f9] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:14:26.810591 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-939ad578-f678-4fb0-aee3-d39823336308 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:26.811704 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-939ad578-f678-4fb0-aee3-d39823336308 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:26.814508 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-939ad578-f678-4fb0-aee3-d39823336308 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:26.815506 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-939ad578-f678-4fb0-aee3-d39823336308 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:26.817443 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-939ad578-f678-4fb0-aee3-d39823336308 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:26.819215 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-939ad578-f678-4fb0-aee3-d39823336308 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:26.835426 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-939ad578-f678-4fb0-aee3-d39823336308 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] HTTP exception thrown: Instance 367dad85-827d-47b0-a468-418d398b36f9 could not be found. Oct 04 22:14:26.837680 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-939ad578-f678-4fb0-aee3-d39823336308 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Request method failure captured: Oct 04 22:14:26.837680 n-d-860284-1 devstack@n-api.service[134101]: request: GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9 HTTP/1.1 Oct 04 22:14:26.837680 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 22:14:26.837680 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 22:14:26.837680 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 22:14:26.837680 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 22:14:26.837680 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 22:14:26.837680 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 22:14:26.837680 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 22:14:26.837680 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 22:14:26.837680 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPK6DyZ68D3YsljtT08gRS1ePp3Hl3Sg5qoyHBGnNBZGl8Hx4_8yp4xdJLqrc1qCQ5yvGsoKj0LqIu2wSPsQsi5n7ToJRC0AHbOMtiPKsL2OxAp0OI_GsIpyJbQu_pQSkEMpdZS7qm_PVxTC-i6vy3sEo7k3TICIgJ30UK2AYlV0krlQ Oct 04 22:14:26.837680 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 22:14:26.837680 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 22:14:26.837680 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 22:14:26.837680 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 22:14:26.837680 n-d-860284-1 devstack@n-api.service[134101]: X-Openstack-Nova-Api-Version: 2.32 Oct 04 22:14:26.837680 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 22:14:26.837680 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 22:14:26.837680 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: f877741b2664498e974791b4952bfc92 Oct 04 22:14:26.837680 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-TaggedBootDevicesTest-1574375746 Oct 04 22:14:26.837680 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 22:14:26.837680 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 22:14:26.837680 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f877741b2664498e974791b4952bfc92"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_f877741b2664498e974791b4952bfc92", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f877741b2664498e974791b4952bfc92"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/f877741b2664498e974791b4952bfc92"}]}] Oct 04 22:14:26.837680 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-TaggedBootDevicesTest-1574375746 Oct 04 22:14:26.837680 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: f877741b2664498e974791b4952bfc92 Oct 04 22:14:26.837680 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1574375746 Oct 04 22:14:26.837680 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-TaggedBootDevicesTest-1574375746-project Oct 04 22:14:26.837680 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 22:14:26.837680 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 22:14:26.837680 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: ed57db002d7b42ea8533ed32b6904c63 Oct 04 22:14:26.837680 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-TaggedBootDevicesTest-1574375746-project Oct 04 22:14:26.837680 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 22:14:26.837680 n-d-860284-1 devstack@n-api.service[134101]: exception: Instance 367dad85-827d-47b0-a468-418d398b36f9 could not be found. Oct 04 22:14:26.837680 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': '367dad85-827d-47b0-a468-418d398b36f9'} Oct 04 22:14:26.837680 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:14:26.837680 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:14:26.837680 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:14:26.837680 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:14:26.837680 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:14:26.837680 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:14:26.837680 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:14:26.837680 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:14:26.837680 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:14:26.837680 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:14:26.837680 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 367dad85-827d-47b0-a468-418d398b36f9 could not be found. Oct 04 22:14:26.837680 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:14:26.837680 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:14:26.837680 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:14:26.837680 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:14:26.837680 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:14:26.837680 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:14:26.837680 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:14:26.837680 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:14:26.837680 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:14:26.837680 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:14:26.837680 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:14:26.837680 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:14:26.837680 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:14:26.837680 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:14:26.837680 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:14:26.837680 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:14:26.837680 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 367dad85-827d-47b0-a468-418d398b36f9 could not be found. Oct 04 22:14:26.837680 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:14:26.837680 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:14:26.842795 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:14:26.842795 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:14:26.842795 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:14:26.842795 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:14:26.842795 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:14:26.842795 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:14:26.842795 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 367dad85-827d-47b0-a468-418d398b36f9 could not be found. Oct 04 22:14:26.842795 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:14:26.844877 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-939ad578-f678-4fb0-aee3-d39823336308 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] Returning 404 to user: Instance 367dad85-827d-47b0-a468-418d398b36f9 could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:14:26.846397 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-939ad578-f678-4fb0-aee3-d39823336308 tempest-TaggedBootDevicesTest-1574375746 tempest-TaggedBootDevicesTest-1574375746-project] 10.222.0.43 "GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9" status: 404 len: 111 microversion: 2.32 time: 0.054886 Oct 04 22:14:26.850426 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2726/5516] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:14:26 2022] GET /compute/v2.1/servers/367dad85-827d-47b0-a468-418d398b36f9 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 22:14:27.660799 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-e2ba8047-b3b2-476a-9bf8-460fa6042396 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:14:27.661672 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-e2ba8047-b3b2-476a-9bf8-460fa6042396 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 20a57394-a798-4356-8b70-3615f9de588e] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:14:27.667940 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e2ba8047-b3b2-476a-9bf8-460fa6042396 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:27.668630 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e2ba8047-b3b2-476a-9bf8-460fa6042396 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:27.675270 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e2ba8047-b3b2-476a-9bf8-460fa6042396 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:27.676216 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e2ba8047-b3b2-476a-9bf8-460fa6042396 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:27.676841 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e2ba8047-b3b2-476a-9bf8-460fa6042396 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:27.677427 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e2ba8047-b3b2-476a-9bf8-460fa6042396 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:27.888894 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-e2ba8047-b3b2-476a-9bf8-460fa6042396 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:14:27.897223 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-e2ba8047-b3b2-476a-9bf8-460fa6042396 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/20a57394-a798-4356-8b70-3615f9de588e" status: 200 len: 1506 microversion: 2.1 time: 0.240631 Oct 04 22:14:27.898857 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2791/5517] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:14:27 2022] GET /compute/v2.1/servers/20a57394-a798-4356-8b70-3615f9de588e => generated 1506 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:14:28.924566 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-c8e45f28-8cf4-48a2-bad9-20ad1d4b30db tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:14:28.925860 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-c8e45f28-8cf4-48a2-bad9-20ad1d4b30db tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 20a57394-a798-4356-8b70-3615f9de588e] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:14:28.940419 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c8e45f28-8cf4-48a2-bad9-20ad1d4b30db tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:28.941316 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c8e45f28-8cf4-48a2-bad9-20ad1d4b30db tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:28.944533 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c8e45f28-8cf4-48a2-bad9-20ad1d4b30db tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:28.946725 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c8e45f28-8cf4-48a2-bad9-20ad1d4b30db tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:28.948929 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c8e45f28-8cf4-48a2-bad9-20ad1d4b30db tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:28.949778 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c8e45f28-8cf4-48a2-bad9-20ad1d4b30db tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:29.297501 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-c8e45f28-8cf4-48a2-bad9-20ad1d4b30db tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:14:29.306626 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-c8e45f28-8cf4-48a2-bad9-20ad1d4b30db tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/20a57394-a798-4356-8b70-3615f9de588e" status: 200 len: 1506 microversion: 2.1 time: 0.388321 Oct 04 22:14:29.313404 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2727/5518] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:14:28 2022] GET /compute/v2.1/servers/20a57394-a798-4356-8b70-3615f9de588e => generated 1506 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:14:30.335343 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-da32f802-73d4-4d52-b70d-e7c2712418cf tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:14:30.336074 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-da32f802-73d4-4d52-b70d-e7c2712418cf tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 20a57394-a798-4356-8b70-3615f9de588e] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:14:30.349431 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-da32f802-73d4-4d52-b70d-e7c2712418cf tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:30.350267 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-da32f802-73d4-4d52-b70d-e7c2712418cf tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:30.351024 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-da32f802-73d4-4d52-b70d-e7c2712418cf tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:30.366385 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-da32f802-73d4-4d52-b70d-e7c2712418cf tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:30.366905 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-da32f802-73d4-4d52-b70d-e7c2712418cf tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:30.367483 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-da32f802-73d4-4d52-b70d-e7c2712418cf tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:30.716865 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-da32f802-73d4-4d52-b70d-e7c2712418cf tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:14:30.730176 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-da32f802-73d4-4d52-b70d-e7c2712418cf tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/20a57394-a798-4356-8b70-3615f9de588e" status: 200 len: 1449 microversion: 2.1 time: 0.399144 Oct 04 22:14:30.754453 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2792/5519] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:14:30 2022] GET /compute/v2.1/servers/20a57394-a798-4356-8b70-3615f9de588e => generated 1449 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:14:30.756064 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-21cdbc1c-960c-4f5a-acca-1fbe9ef2469b tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:14:30.756691 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-21cdbc1c-960c-4f5a-acca-1fbe9ef2469b tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 48243e1b-892b-4c4b-8db1-242b2e40653b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:14:30.768902 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-21cdbc1c-960c-4f5a-acca-1fbe9ef2469b tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:30.769513 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-21cdbc1c-960c-4f5a-acca-1fbe9ef2469b tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:30.769962 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-21cdbc1c-960c-4f5a-acca-1fbe9ef2469b tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:30.779278 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-21cdbc1c-960c-4f5a-acca-1fbe9ef2469b tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:30.780172 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-21cdbc1c-960c-4f5a-acca-1fbe9ef2469b tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:30.780985 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-21cdbc1c-960c-4f5a-acca-1fbe9ef2469b tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:31.082090 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-21cdbc1c-960c-4f5a-acca-1fbe9ef2469b tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:14:31.094985 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-21cdbc1c-960c-4f5a-acca-1fbe9ef2469b tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b" status: 200 len: 1669 microversion: 2.1 time: 0.343637 Oct 04 22:14:31.095770 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2728/5520] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:14:30 2022] GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b => generated 1669 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:14:31.134804 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-7bbc3ee7-4822-48f0-98a2-0a8dff6d65b4 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:14:31.138228 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-7bbc3ee7-4822-48f0-98a2-0a8dff6d65b4 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 48243e1b-892b-4c4b-8db1-242b2e40653b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:14:31.160912 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7bbc3ee7-4822-48f0-98a2-0a8dff6d65b4 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:31.164567 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7bbc3ee7-4822-48f0-98a2-0a8dff6d65b4 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:31.165003 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7bbc3ee7-4822-48f0-98a2-0a8dff6d65b4 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:31.165729 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7bbc3ee7-4822-48f0-98a2-0a8dff6d65b4 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:31.169768 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7bbc3ee7-4822-48f0-98a2-0a8dff6d65b4 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:31.170712 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7bbc3ee7-4822-48f0-98a2-0a8dff6d65b4 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:31.409944 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-58a2666d-4f95-40c2-a430-9a6327479b55 req-57a459d2-2ef3-47ea-90c2-3e72f1ec79e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20a57394-a798-4356-8b70-3615f9de588e", "name": "network-vif-unplugged", "status": "completed", "tag": "05ea2c3e-5db0-459a-b0b2-b3d8186a59f0"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:14:31.437903 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-58a2666d-4f95-40c2-a430-9a6327479b55 req-57a459d2-2ef3-47ea-90c2-3e72f1ec79e3 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:31.438454 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-58a2666d-4f95-40c2-a430-9a6327479b55 req-57a459d2-2ef3-47ea-90c2-3e72f1ec79e3 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:31.439082 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-58a2666d-4f95-40c2-a430-9a6327479b55 req-57a459d2-2ef3-47ea-90c2-3e72f1ec79e3 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:31.455516 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.compute.server_external_events [req-58a2666d-4f95-40c2-a430-9a6327479b55 req-57a459d2-2ef3-47ea-90c2-3e72f1ec79e3 service nova] Unable to find a host for instance 20a57394-a798-4356-8b70-3615f9de588e. Dropping event network-vif-unplugged {{(pid=134101) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 04 22:14:31.464203 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-58a2666d-4f95-40c2-a430-9a6327479b55 req-57a459d2-2ef3-47ea-90c2-3e72f1ec79e3 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.059605 Oct 04 22:14:31.466332 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2729/5521] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:14:31 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 65 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 04 22:14:31.520848 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-7bbc3ee7-4822-48f0-98a2-0a8dff6d65b4 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:14:31.530024 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-7bbc3ee7-4822-48f0-98a2-0a8dff6d65b4 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b" status: 200 len: 1669 microversion: 2.1 time: 0.401513 Oct 04 22:14:31.530651 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2793/5522] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:14:31 2022] GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b => generated 1669 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:14:31.557710 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-c744b449-edeb-490b-8401-b9019c6c1fb2 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:14:31.559347 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-c744b449-edeb-490b-8401-b9019c6c1fb2 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 48243e1b-892b-4c4b-8db1-242b2e40653b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:14:31.573999 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c744b449-edeb-490b-8401-b9019c6c1fb2 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:31.574842 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c744b449-edeb-490b-8401-b9019c6c1fb2 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:31.575512 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c744b449-edeb-490b-8401-b9019c6c1fb2 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:31.576347 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c744b449-edeb-490b-8401-b9019c6c1fb2 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:31.577555 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c744b449-edeb-490b-8401-b9019c6c1fb2 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:31.579636 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c744b449-edeb-490b-8401-b9019c6c1fb2 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:31.864713 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-c744b449-edeb-490b-8401-b9019c6c1fb2 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:14:31.878385 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-c744b449-edeb-490b-8401-b9019c6c1fb2 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b" status: 200 len: 1669 microversion: 2.1 time: 0.323472 Oct 04 22:14:31.879959 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2730/5523] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:14:31 2022] GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b => generated 1669 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:14:31.906357 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-7098d41b-3b93-47bb-bc5d-3d4b5ec1f3a2 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:14:31.907539 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-7098d41b-3b93-47bb-bc5d-3d4b5ec1f3a2 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 48243e1b-892b-4c4b-8db1-242b2e40653b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:14:31.917098 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7098d41b-3b93-47bb-bc5d-3d4b5ec1f3a2 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:31.918741 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7098d41b-3b93-47bb-bc5d-3d4b5ec1f3a2 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:31.919890 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7098d41b-3b93-47bb-bc5d-3d4b5ec1f3a2 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:31.921015 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7098d41b-3b93-47bb-bc5d-3d4b5ec1f3a2 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:31.921799 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7098d41b-3b93-47bb-bc5d-3d4b5ec1f3a2 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:31.922561 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7098d41b-3b93-47bb-bc5d-3d4b5ec1f3a2 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:32.151999 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-7098d41b-3b93-47bb-bc5d-3d4b5ec1f3a2 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:14:32.169933 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-7098d41b-3b93-47bb-bc5d-3d4b5ec1f3a2 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b" status: 200 len: 1669 microversion: 2.1 time: 0.268315 Oct 04 22:14:32.181135 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2794/5524] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:14:31 2022] GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b => generated 1669 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:14:32.199760 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-3d2d87c8-ea00-480c-bf82-cc35f8923afb tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:14:32.208887 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3d2d87c8-ea00-480c-bf82-cc35f8923afb tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:32.209479 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3d2d87c8-ea00-480c-bf82-cc35f8923afb tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:32.209980 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3d2d87c8-ea00-480c-bf82-cc35f8923afb tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:32.239797 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-3d2d87c8-ea00-480c-bf82-cc35f8923afb tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 48243e1b-892b-4c4b-8db1-242b2e40653b] Going to try to stop instance {{(pid=134101) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 04 22:14:32.324545 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-3d2d87c8-ea00-480c-bf82-cc35f8923afb tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "POST /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b/action" status: 202 len: 0 microversion: 2.1 time: 0.130069 Oct 04 22:14:32.325186 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2731/5525] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 22:14:32 2022] POST /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b/action => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 22:14:32.333587 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-d90905c0-c5d7-4930-adcc-9ef75f49e673 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:14:32.334220 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-d90905c0-c5d7-4930-adcc-9ef75f49e673 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 48243e1b-892b-4c4b-8db1-242b2e40653b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:14:32.346169 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d90905c0-c5d7-4930-adcc-9ef75f49e673 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:32.346710 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d90905c0-c5d7-4930-adcc-9ef75f49e673 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:32.347143 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d90905c0-c5d7-4930-adcc-9ef75f49e673 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:32.348445 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d90905c0-c5d7-4930-adcc-9ef75f49e673 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:32.349224 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d90905c0-c5d7-4930-adcc-9ef75f49e673 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:32.349914 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d90905c0-c5d7-4930-adcc-9ef75f49e673 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:32.659342 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-d90905c0-c5d7-4930-adcc-9ef75f49e673 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:14:32.671237 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-d90905c0-c5d7-4930-adcc-9ef75f49e673 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b" status: 200 len: 1679 microversion: 2.1 time: 0.340928 Oct 04 22:14:32.683624 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2795/5526] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:14:32 2022] GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b => generated 1679 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:14:33.698688 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-7c6496dd-0c88-488d-89ac-690b34060596 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:14:33.699428 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-7c6496dd-0c88-488d-89ac-690b34060596 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 48243e1b-892b-4c4b-8db1-242b2e40653b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:14:33.715985 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7c6496dd-0c88-488d-89ac-690b34060596 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:33.721514 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7c6496dd-0c88-488d-89ac-690b34060596 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:33.727085 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7c6496dd-0c88-488d-89ac-690b34060596 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:33.728077 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7c6496dd-0c88-488d-89ac-690b34060596 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:33.728731 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7c6496dd-0c88-488d-89ac-690b34060596 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:33.731674 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7c6496dd-0c88-488d-89ac-690b34060596 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:34.508194 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-7c6496dd-0c88-488d-89ac-690b34060596 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:14:34.525814 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-7c6496dd-0c88-488d-89ac-690b34060596 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b" status: 200 len: 1679 microversion: 2.1 time: 0.832262 Oct 04 22:14:34.527808 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2732/5527] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:14:33 2022] GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b => generated 1679 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:14:35.554732 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-12b01756-1691-424c-ad40-69b84c99bddb tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:14:35.555362 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-12b01756-1691-424c-ad40-69b84c99bddb tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 48243e1b-892b-4c4b-8db1-242b2e40653b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:14:35.566516 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-12b01756-1691-424c-ad40-69b84c99bddb tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:35.567016 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-12b01756-1691-424c-ad40-69b84c99bddb tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:35.567466 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-12b01756-1691-424c-ad40-69b84c99bddb tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:35.574975 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-12b01756-1691-424c-ad40-69b84c99bddb tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:35.575478 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-12b01756-1691-424c-ad40-69b84c99bddb tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:35.575929 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-12b01756-1691-424c-ad40-69b84c99bddb tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:35.906801 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-12b01756-1691-424c-ad40-69b84c99bddb tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:14:35.927275 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-12b01756-1691-424c-ad40-69b84c99bddb tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b" status: 200 len: 1679 microversion: 2.1 time: 0.368259 Oct 04 22:14:35.933606 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2796/5528] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:14:35 2022] GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b => generated 1679 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:14:36.973245 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-aae47c62-9d4e-4032-89cc-1f246c331575 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:14:36.974196 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-aae47c62-9d4e-4032-89cc-1f246c331575 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 48243e1b-892b-4c4b-8db1-242b2e40653b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:14:37.023904 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-aae47c62-9d4e-4032-89cc-1f246c331575 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:37.026669 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-aae47c62-9d4e-4032-89cc-1f246c331575 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:37.035479 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-aae47c62-9d4e-4032-89cc-1f246c331575 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:37.037359 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-aae47c62-9d4e-4032-89cc-1f246c331575 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:37.037994 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-aae47c62-9d4e-4032-89cc-1f246c331575 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:37.044801 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-aae47c62-9d4e-4032-89cc-1f246c331575 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:37.404981 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-aae47c62-9d4e-4032-89cc-1f246c331575 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:14:37.434391 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-aae47c62-9d4e-4032-89cc-1f246c331575 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b" status: 200 len: 1679 microversion: 2.1 time: 0.477103 Oct 04 22:14:37.439957 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2733/5529] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:14:36 2022] GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b => generated 1679 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:14:38.472369 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-3d517abe-08fc-4b82-8bbc-1621124d45ae tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:14:38.473087 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-3d517abe-08fc-4b82-8bbc-1621124d45ae tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 48243e1b-892b-4c4b-8db1-242b2e40653b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:14:38.497985 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3d517abe-08fc-4b82-8bbc-1621124d45ae tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:38.498339 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3d517abe-08fc-4b82-8bbc-1621124d45ae tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:38.501659 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3d517abe-08fc-4b82-8bbc-1621124d45ae tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:38.502557 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3d517abe-08fc-4b82-8bbc-1621124d45ae tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:38.503660 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3d517abe-08fc-4b82-8bbc-1621124d45ae tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:38.506830 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3d517abe-08fc-4b82-8bbc-1621124d45ae tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:38.940103 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-3d517abe-08fc-4b82-8bbc-1621124d45ae tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:14:38.955093 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-3d517abe-08fc-4b82-8bbc-1621124d45ae tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b" status: 200 len: 1679 microversion: 2.1 time: 0.488296 Oct 04 22:14:38.955734 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2797/5530] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:14:38 2022] GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b => generated 1679 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:14:39.982232 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-26d2782e-a968-4ca1-ad74-ef6a86e2dd86 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:14:39.983787 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-26d2782e-a968-4ca1-ad74-ef6a86e2dd86 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 48243e1b-892b-4c4b-8db1-242b2e40653b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:14:39.998324 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-26d2782e-a968-4ca1-ad74-ef6a86e2dd86 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:39.999386 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-26d2782e-a968-4ca1-ad74-ef6a86e2dd86 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:40.001502 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-26d2782e-a968-4ca1-ad74-ef6a86e2dd86 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:40.006848 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-26d2782e-a968-4ca1-ad74-ef6a86e2dd86 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:40.008128 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-26d2782e-a968-4ca1-ad74-ef6a86e2dd86 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:40.012913 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-26d2782e-a968-4ca1-ad74-ef6a86e2dd86 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:40.032740 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:14:40.422000 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-26d2782e-a968-4ca1-ad74-ef6a86e2dd86 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:14:40.454309 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-26d2782e-a968-4ca1-ad74-ef6a86e2dd86 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b" status: 200 len: 1679 microversion: 2.1 time: 0.474781 Oct 04 22:14:40.455129 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2734/5531] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:14:39 2022] GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b => generated 1679 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:14:41.487619 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-cf6fb9fa-e145-4116-bcd5-1781a8e04b2e tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:14:41.488730 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-cf6fb9fa-e145-4116-bcd5-1781a8e04b2e tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 48243e1b-892b-4c4b-8db1-242b2e40653b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:14:41.505356 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cf6fb9fa-e145-4116-bcd5-1781a8e04b2e tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:41.508209 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cf6fb9fa-e145-4116-bcd5-1781a8e04b2e tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:41.509077 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cf6fb9fa-e145-4116-bcd5-1781a8e04b2e tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:41.515287 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cf6fb9fa-e145-4116-bcd5-1781a8e04b2e tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:41.515852 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cf6fb9fa-e145-4116-bcd5-1781a8e04b2e tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:41.516353 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cf6fb9fa-e145-4116-bcd5-1781a8e04b2e tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:41.821760 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-cf6fb9fa-e145-4116-bcd5-1781a8e04b2e tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:14:41.836233 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-cf6fb9fa-e145-4116-bcd5-1781a8e04b2e tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b" status: 200 len: 1679 microversion: 2.1 time: 0.352010 Oct 04 22:14:41.847571 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2798/5532] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:14:41 2022] GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b => generated 1679 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:14:42.872267 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-c8fd169f-40b2-40b5-b75e-067ec93eb9b6 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:14:42.873594 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-c8fd169f-40b2-40b5-b75e-067ec93eb9b6 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 48243e1b-892b-4c4b-8db1-242b2e40653b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:14:42.890949 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c8fd169f-40b2-40b5-b75e-067ec93eb9b6 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:42.895763 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c8fd169f-40b2-40b5-b75e-067ec93eb9b6 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:42.896498 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c8fd169f-40b2-40b5-b75e-067ec93eb9b6 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:42.897474 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c8fd169f-40b2-40b5-b75e-067ec93eb9b6 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:42.898559 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c8fd169f-40b2-40b5-b75e-067ec93eb9b6 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:42.899206 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c8fd169f-40b2-40b5-b75e-067ec93eb9b6 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:43.996505 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-c8fd169f-40b2-40b5-b75e-067ec93eb9b6 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:14:44.014110 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-c8fd169f-40b2-40b5-b75e-067ec93eb9b6 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b" status: 200 len: 1656 microversion: 2.1 time: 1.154382 Oct 04 22:14:44.040294 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2735/5533] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:14:42 2022] GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b => generated 1656 bytes in 1177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:14:44.054178 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-f7a7b49b-987a-42d3-8a3a-486feaee1059 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:14:44.061998 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_api:SELECT=41,nova_api:DELETE=1 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:14:44.082977 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f7a7b49b-987a-42d3-8a3a-486feaee1059 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:44.083534 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f7a7b49b-987a-42d3-8a3a-486feaee1059 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:44.085242 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f7a7b49b-987a-42d3-8a3a-486feaee1059 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:44.090680 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=100 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:14:44.117221 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-f7a7b49b-987a-42d3-8a3a-486feaee1059 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 48243e1b-892b-4c4b-8db1-242b2e40653b] Going to try to start instance {{(pid=134102) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 04 22:14:44.202813 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-f7a7b49b-987a-42d3-8a3a-486feaee1059 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "POST /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b/action" status: 202 len: 0 microversion: 2.1 time: 0.158458 Oct 04 22:14:44.203861 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2799/5534] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 22:14:44 2022] POST /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b/action => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 22:14:44.224800 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-5dfcbe6b-6469-4d0b-8e1f-0e8d82f6823d tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:14:44.227231 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-5dfcbe6b-6469-4d0b-8e1f-0e8d82f6823d tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 48243e1b-892b-4c4b-8db1-242b2e40653b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:14:44.244562 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=38 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:14:44.246693 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5dfcbe6b-6469-4d0b-8e1f-0e8d82f6823d tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:44.250158 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5dfcbe6b-6469-4d0b-8e1f-0e8d82f6823d tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:44.251883 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5dfcbe6b-6469-4d0b-8e1f-0e8d82f6823d tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:44.253491 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5dfcbe6b-6469-4d0b-8e1f-0e8d82f6823d tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:44.254205 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5dfcbe6b-6469-4d0b-8e1f-0e8d82f6823d tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:44.256839 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5dfcbe6b-6469-4d0b-8e1f-0e8d82f6823d tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:44.608071 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-5dfcbe6b-6469-4d0b-8e1f-0e8d82f6823d tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:14:44.629931 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-5dfcbe6b-6469-4d0b-8e1f-0e8d82f6823d tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b" status: 200 len: 1665 microversion: 2.1 time: 0.421316 Oct 04 22:14:44.634914 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2736/5535] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:14:44 2022] GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b => generated 1665 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:14:45.670607 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-4feb6e65-1c15-4ade-8db5-05d398dda744 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:14:45.675362 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-4feb6e65-1c15-4ade-8db5-05d398dda744 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 48243e1b-892b-4c4b-8db1-242b2e40653b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:14:45.720900 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4feb6e65-1c15-4ade-8db5-05d398dda744 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:45.721659 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4feb6e65-1c15-4ade-8db5-05d398dda744 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:45.723971 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4feb6e65-1c15-4ade-8db5-05d398dda744 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:45.724904 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4feb6e65-1c15-4ade-8db5-05d398dda744 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:45.728490 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4feb6e65-1c15-4ade-8db5-05d398dda744 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:45.729729 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4feb6e65-1c15-4ade-8db5-05d398dda744 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:46.677087 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-4feb6e65-1c15-4ade-8db5-05d398dda744 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:14:46.685120 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-4feb6e65-1c15-4ade-8db5-05d398dda744 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b" status: 200 len: 1665 microversion: 2.1 time: 1.022439 Oct 04 22:14:46.685717 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2800/5536] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:14:45 2022] GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b => generated 1665 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:14:47.713172 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-0cb6b79f-a4f8-4a2d-b413-7fbc5e113eb0 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:14:47.713904 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-0cb6b79f-a4f8-4a2d-b413-7fbc5e113eb0 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 48243e1b-892b-4c4b-8db1-242b2e40653b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:14:47.728376 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0cb6b79f-a4f8-4a2d-b413-7fbc5e113eb0 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:47.730858 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0cb6b79f-a4f8-4a2d-b413-7fbc5e113eb0 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:47.736041 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0cb6b79f-a4f8-4a2d-b413-7fbc5e113eb0 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:47.750860 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0cb6b79f-a4f8-4a2d-b413-7fbc5e113eb0 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:47.750974 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0cb6b79f-a4f8-4a2d-b413-7fbc5e113eb0 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:47.751388 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0cb6b79f-a4f8-4a2d-b413-7fbc5e113eb0 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:48.141884 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-0cb6b79f-a4f8-4a2d-b413-7fbc5e113eb0 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:14:48.158465 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-0cb6b79f-a4f8-4a2d-b413-7fbc5e113eb0 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b" status: 200 len: 1665 microversion: 2.1 time: 0.448714 Oct 04 22:14:48.160969 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2737/5537] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:14:47 2022] GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b => generated 1665 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:14:49.189888 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-ce905b21-b94c-4c7d-b145-0da1ba79293e tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:14:49.191672 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-ce905b21-b94c-4c7d-b145-0da1ba79293e tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 48243e1b-892b-4c4b-8db1-242b2e40653b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:14:49.203879 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ce905b21-b94c-4c7d-b145-0da1ba79293e tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:49.208513 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ce905b21-b94c-4c7d-b145-0da1ba79293e tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:49.209258 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ce905b21-b94c-4c7d-b145-0da1ba79293e tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:49.210115 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ce905b21-b94c-4c7d-b145-0da1ba79293e tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:49.210725 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ce905b21-b94c-4c7d-b145-0da1ba79293e tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:49.211412 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ce905b21-b94c-4c7d-b145-0da1ba79293e tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:49.478722 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-ce905b21-b94c-4c7d-b145-0da1ba79293e tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:14:49.490211 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-ce905b21-b94c-4c7d-b145-0da1ba79293e tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b" status: 200 len: 1669 microversion: 2.1 time: 0.304323 Oct 04 22:14:49.506521 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2801/5538] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:14:49 2022] GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b => generated 1669 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:14:49.521250 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-ab525611-0148-444e-9441-2c778f643b3f tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:14:49.522158 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-ab525611-0148-444e-9441-2c778f643b3f tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 48243e1b-892b-4c4b-8db1-242b2e40653b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:14:49.549975 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ab525611-0148-444e-9441-2c778f643b3f tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:49.550987 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ab525611-0148-444e-9441-2c778f643b3f tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:49.552486 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ab525611-0148-444e-9441-2c778f643b3f tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:49.553400 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ab525611-0148-444e-9441-2c778f643b3f tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:49.558497 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ab525611-0148-444e-9441-2c778f643b3f tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:49.559140 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ab525611-0148-444e-9441-2c778f643b3f tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:49.855238 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-ab525611-0148-444e-9441-2c778f643b3f tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:14:49.865763 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-ab525611-0148-444e-9441-2c778f643b3f tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b" status: 200 len: 1669 microversion: 2.1 time: 0.348846 Oct 04 22:14:49.879967 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2738/5539] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:14:49 2022] GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b => generated 1669 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:14:49.895276 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-6d296dc9-0ebb-4ea9-abbf-d90b6c4a49c9 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:14:49.896047 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-6d296dc9-0ebb-4ea9-abbf-d90b6c4a49c9 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 48243e1b-892b-4c4b-8db1-242b2e40653b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:14:49.904007 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6d296dc9-0ebb-4ea9-abbf-d90b6c4a49c9 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:49.905217 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6d296dc9-0ebb-4ea9-abbf-d90b6c4a49c9 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:49.906336 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6d296dc9-0ebb-4ea9-abbf-d90b6c4a49c9 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:49.922914 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6d296dc9-0ebb-4ea9-abbf-d90b6c4a49c9 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:49.925633 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6d296dc9-0ebb-4ea9-abbf-d90b6c4a49c9 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:49.926157 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6d296dc9-0ebb-4ea9-abbf-d90b6c4a49c9 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:50.233857 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-6d296dc9-0ebb-4ea9-abbf-d90b6c4a49c9 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:14:50.244594 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-6d296dc9-0ebb-4ea9-abbf-d90b6c4a49c9 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b" status: 200 len: 1669 microversion: 2.1 time: 0.353499 Oct 04 22:14:50.246265 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2802/5540] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:14:49 2022] GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b => generated 1669 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:14:50.272142 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-cf8b2096-45bf-4931-b45d-112a06be38c0 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:14:50.273018 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-cf8b2096-45bf-4931-b45d-112a06be38c0 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 48243e1b-892b-4c4b-8db1-242b2e40653b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:14:50.282938 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cf8b2096-45bf-4931-b45d-112a06be38c0 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:50.283880 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cf8b2096-45bf-4931-b45d-112a06be38c0 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:50.284604 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cf8b2096-45bf-4931-b45d-112a06be38c0 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:50.285980 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cf8b2096-45bf-4931-b45d-112a06be38c0 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:50.286981 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cf8b2096-45bf-4931-b45d-112a06be38c0 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:50.287734 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cf8b2096-45bf-4931-b45d-112a06be38c0 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:50.559934 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-cf8b2096-45bf-4931-b45d-112a06be38c0 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:14:50.575804 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-cf8b2096-45bf-4931-b45d-112a06be38c0 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b" status: 200 len: 1669 microversion: 2.1 time: 0.307923 Oct 04 22:14:50.607609 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2739/5541] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:14:50 2022] GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b => generated 1669 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:14:50.630712 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-f5661127-1dde-4a3f-a434-9c131463a4ac tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:14:50.631645 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-f5661127-1dde-4a3f-a434-9c131463a4ac tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 48243e1b-892b-4c4b-8db1-242b2e40653b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:14:50.639882 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f5661127-1dde-4a3f-a434-9c131463a4ac tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:50.640457 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f5661127-1dde-4a3f-a434-9c131463a4ac tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:50.640908 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f5661127-1dde-4a3f-a434-9c131463a4ac tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:50.641643 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f5661127-1dde-4a3f-a434-9c131463a4ac tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:50.642934 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f5661127-1dde-4a3f-a434-9c131463a4ac tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:50.643734 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f5661127-1dde-4a3f-a434-9c131463a4ac tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:50.912948 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-f5661127-1dde-4a3f-a434-9c131463a4ac tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:14:50.922476 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-f5661127-1dde-4a3f-a434-9c131463a4ac tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b" status: 200 len: 1669 microversion: 2.1 time: 0.299163 Oct 04 22:14:50.923483 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2803/5542] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:14:50 2022] GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b => generated 1669 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:14:50.951981 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-d245f8f0-6769-452f-b16b-e29ecdae6e52 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:14:50.952604 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-d245f8f0-6769-452f-b16b-e29ecdae6e52 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 48243e1b-892b-4c4b-8db1-242b2e40653b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:14:50.962431 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d245f8f0-6769-452f-b16b-e29ecdae6e52 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:50.965889 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d245f8f0-6769-452f-b16b-e29ecdae6e52 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:50.966796 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d245f8f0-6769-452f-b16b-e29ecdae6e52 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:50.967696 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d245f8f0-6769-452f-b16b-e29ecdae6e52 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:50.968254 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d245f8f0-6769-452f-b16b-e29ecdae6e52 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:50.969356 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d245f8f0-6769-452f-b16b-e29ecdae6e52 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:51.035257 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.objects.instance [None req-d245f8f0-6769-452f-b16b-e29ecdae6e52 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lazy-loading 'flavor' on Instance uuid 48243e1b-892b-4c4b-8db1-242b2e40653b {{(pid=134101) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 22:14:51.212431 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-d245f8f0-6769-452f-b16b-e29ecdae6e52 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "POST /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b/action" status: 202 len: 0 microversion: 2.1 time: 0.266854 Oct 04 22:14:51.213543 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2740/5543] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 22:14:50 2022] POST /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b/action => generated 0 bytes in 269 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 22:14:51.232243 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-433faea0-9682-4028-a120-442cefdb3c4c tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:14:51.236554 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-433faea0-9682-4028-a120-442cefdb3c4c tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 48243e1b-892b-4c4b-8db1-242b2e40653b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:14:51.279303 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-433faea0-9682-4028-a120-442cefdb3c4c tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:51.279803 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-433faea0-9682-4028-a120-442cefdb3c4c tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:51.283060 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-433faea0-9682-4028-a120-442cefdb3c4c tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:51.284005 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-433faea0-9682-4028-a120-442cefdb3c4c tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:51.302027 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-433faea0-9682-4028-a120-442cefdb3c4c tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:51.302741 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-433faea0-9682-4028-a120-442cefdb3c4c tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:51.698128 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-433faea0-9682-4028-a120-442cefdb3c4c tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:14:51.707650 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-433faea0-9682-4028-a120-442cefdb3c4c tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b" status: 200 len: 1677 microversion: 2.1 time: 0.487974 Oct 04 22:14:51.714654 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2804/5544] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:14:51 2022] GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b => generated 1677 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:14:52.743263 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-16ac2130-252b-4f0e-9a29-67fa6d7b9d11 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:14:52.743995 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-16ac2130-252b-4f0e-9a29-67fa6d7b9d11 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 48243e1b-892b-4c4b-8db1-242b2e40653b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:14:52.762306 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-16ac2130-252b-4f0e-9a29-67fa6d7b9d11 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:52.762824 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-16ac2130-252b-4f0e-9a29-67fa6d7b9d11 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:52.763346 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-16ac2130-252b-4f0e-9a29-67fa6d7b9d11 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:52.764019 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-16ac2130-252b-4f0e-9a29-67fa6d7b9d11 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:52.764541 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-16ac2130-252b-4f0e-9a29-67fa6d7b9d11 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:52.764983 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-16ac2130-252b-4f0e-9a29-67fa6d7b9d11 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:53.006925 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-16ac2130-252b-4f0e-9a29-67fa6d7b9d11 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:14:53.016425 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-16ac2130-252b-4f0e-9a29-67fa6d7b9d11 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b" status: 200 len: 1660 microversion: 2.1 time: 0.278973 Oct 04 22:14:53.020806 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2741/5545] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:14:52 2022] GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b => generated 1660 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:14:53.044071 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-f19f331c-640c-4603-8d24-f94dc88c89f7 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:14:53.046228 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-f19f331c-640c-4603-8d24-f94dc88c89f7 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 48243e1b-892b-4c4b-8db1-242b2e40653b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:14:53.055067 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f19f331c-640c-4603-8d24-f94dc88c89f7 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:53.055824 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f19f331c-640c-4603-8d24-f94dc88c89f7 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:53.056568 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f19f331c-640c-4603-8d24-f94dc88c89f7 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:53.058048 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f19f331c-640c-4603-8d24-f94dc88c89f7 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:53.058819 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f19f331c-640c-4603-8d24-f94dc88c89f7 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:53.059839 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f19f331c-640c-4603-8d24-f94dc88c89f7 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:53.193473 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-f19f331c-640c-4603-8d24-f94dc88c89f7 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "POST /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b/action" status: 202 len: 0 microversion: 2.1 time: 0.154104 Oct 04 22:14:53.194940 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2805/5546] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 22:14:53 2022] POST /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b/action => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 22:14:53.204620 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-46d5c225-22b9-46f5-920b-9c09d6213518 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:14:53.206052 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-46d5c225-22b9-46f5-920b-9c09d6213518 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 48243e1b-892b-4c4b-8db1-242b2e40653b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:14:53.215029 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-46d5c225-22b9-46f5-920b-9c09d6213518 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:53.216140 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-46d5c225-22b9-46f5-920b-9c09d6213518 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:53.216773 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-46d5c225-22b9-46f5-920b-9c09d6213518 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:53.218045 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-46d5c225-22b9-46f5-920b-9c09d6213518 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:53.218973 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-46d5c225-22b9-46f5-920b-9c09d6213518 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:53.219636 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-46d5c225-22b9-46f5-920b-9c09d6213518 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:53.434555 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-46d5c225-22b9-46f5-920b-9c09d6213518 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:14:53.444500 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-46d5c225-22b9-46f5-920b-9c09d6213518 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b" status: 200 len: 1666 microversion: 2.1 time: 0.242628 Oct 04 22:14:53.445388 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2742/5547] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:14:53 2022] GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b => generated 1666 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:14:54.476870 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-8417bfc4-caff-4dab-b116-6f84608df071 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:14:54.477665 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-8417bfc4-caff-4dab-b116-6f84608df071 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 48243e1b-892b-4c4b-8db1-242b2e40653b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:14:54.497214 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8417bfc4-caff-4dab-b116-6f84608df071 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:54.500477 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8417bfc4-caff-4dab-b116-6f84608df071 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:54.503265 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8417bfc4-caff-4dab-b116-6f84608df071 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:54.524684 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8417bfc4-caff-4dab-b116-6f84608df071 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:54.535030 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8417bfc4-caff-4dab-b116-6f84608df071 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:54.536006 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8417bfc4-caff-4dab-b116-6f84608df071 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:54.763748 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-8417bfc4-caff-4dab-b116-6f84608df071 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:14:54.778179 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-8417bfc4-caff-4dab-b116-6f84608df071 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b" status: 200 len: 1666 microversion: 2.1 time: 0.309472 Oct 04 22:14:54.781956 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2806/5548] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:14:54 2022] GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b => generated 1666 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:14:55.811838 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-5d740ceb-b6f3-4a6f-a7e0-6addc7d835ea tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:14:55.812459 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-5d740ceb-b6f3-4a6f-a7e0-6addc7d835ea tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 48243e1b-892b-4c4b-8db1-242b2e40653b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:14:55.825802 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5d740ceb-b6f3-4a6f-a7e0-6addc7d835ea tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:55.830090 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5d740ceb-b6f3-4a6f-a7e0-6addc7d835ea tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:55.831047 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5d740ceb-b6f3-4a6f-a7e0-6addc7d835ea tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:55.833564 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5d740ceb-b6f3-4a6f-a7e0-6addc7d835ea tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:55.834046 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5d740ceb-b6f3-4a6f-a7e0-6addc7d835ea tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:55.835935 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5d740ceb-b6f3-4a6f-a7e0-6addc7d835ea tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:56.616166 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-5d740ceb-b6f3-4a6f-a7e0-6addc7d835ea tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:14:56.625022 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-5d740ceb-b6f3-4a6f-a7e0-6addc7d835ea tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b" status: 200 len: 1669 microversion: 2.1 time: 0.818409 Oct 04 22:14:56.638751 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2743/5549] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:14:55 2022] GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b => generated 1669 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:14:56.650248 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-0f056161-e5b5-45cd-867a-1c0394823346 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:14:56.652665 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-0f056161-e5b5-45cd-867a-1c0394823346 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 48243e1b-892b-4c4b-8db1-242b2e40653b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:14:56.663686 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0f056161-e5b5-45cd-867a-1c0394823346 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:56.665519 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0f056161-e5b5-45cd-867a-1c0394823346 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:56.668809 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0f056161-e5b5-45cd-867a-1c0394823346 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:56.669976 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0f056161-e5b5-45cd-867a-1c0394823346 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:56.670724 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0f056161-e5b5-45cd-867a-1c0394823346 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:56.671473 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0f056161-e5b5-45cd-867a-1c0394823346 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:57.176704 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-0f056161-e5b5-45cd-867a-1c0394823346 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:14:57.192389 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-0f056161-e5b5-45cd-867a-1c0394823346 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b" status: 200 len: 1669 microversion: 2.1 time: 0.546423 Oct 04 22:14:57.194900 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2807/5550] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:14:56 2022] GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b => generated 1669 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:14:57.218764 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-3a913ee2-9fff-4b00-8dc6-3a8734e8c37a tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:14:57.220660 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-3a913ee2-9fff-4b00-8dc6-3a8734e8c37a tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 20a57394-a798-4356-8b70-3615f9de588e] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:14:57.238511 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3a913ee2-9fff-4b00-8dc6-3a8734e8c37a tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:57.239521 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3a913ee2-9fff-4b00-8dc6-3a8734e8c37a tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:57.240204 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3a913ee2-9fff-4b00-8dc6-3a8734e8c37a tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:57.241794 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3a913ee2-9fff-4b00-8dc6-3a8734e8c37a tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:57.242846 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3a913ee2-9fff-4b00-8dc6-3a8734e8c37a tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:57.244969 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3a913ee2-9fff-4b00-8dc6-3a8734e8c37a tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:57.326692 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-3a913ee2-9fff-4b00-8dc6-3a8734e8c37a tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 20a57394-a798-4356-8b70-3615f9de588e] Going to try to terminate instance {{(pid=134101) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 22:14:57.342195 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.compute.api [None req-3a913ee2-9fff-4b00-8dc6-3a8734e8c37a tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 20a57394-a798-4356-8b70-3615f9de588e] Working on deleting snapshot 04ebeefb-a3e7-4145-bf18-0f3c3f099b2c from shelved instance... Oct 04 22:14:58.557656 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-3a913ee2-9fff-4b00-8dc6-3a8734e8c37a tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 20a57394-a798-4356-8b70-3615f9de588e] Doing local delete in cell 1297bf18-d456-4d7b-91a9-0a07f1cafd2a(cell1) {{(pid=134101) _delete /opt/stack/nova/nova/compute/api.py:2546}} Oct 04 22:14:58.559896 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3a913ee2-9fff-4b00-8dc6-3a8734e8c37a tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:58.560567 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3a913ee2-9fff-4b00-8dc6-3a8734e8c37a tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:58.561205 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3a913ee2-9fff-4b00-8dc6-3a8734e8c37a tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:58.570007 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.compute.api [None req-3a913ee2-9fff-4b00-8dc6-3a8734e8c37a tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 20a57394-a798-4356-8b70-3615f9de588e] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Oct 04 22:14:58.577757 n-d-860284-1 devstack@n-api.service[134101]: ERROR oslo.messaging._drivers.impl_rabbit [None req-3a913ee2-9fff-4b00-8dc6-3a8734e8c37a tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [54f0993b-fb22-4e4c-ae00-e3f0e5da4c18] AMQP server on 10.222.0.43:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 22:14:59.585624 n-d-860284-1 devstack@n-api.service[134101]: INFO oslo.messaging._drivers.impl_rabbit [None req-3a913ee2-9fff-4b00-8dc6-3a8734e8c37a tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [54f0993b-fb22-4e4c-ae00-e3f0e5da4c18] Reconnected to AMQP server on 10.222.0.43:5672 via [amqp] client with port 39546. Oct 04 22:14:59.591958 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.network.neutron [None req-3a913ee2-9fff-4b00-8dc6-3a8734e8c37a tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 20a57394-a798-4356-8b70-3615f9de588e] deallocate_for_instance() {{(pid=134101) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Oct 04 22:15:01.465881 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.network.neutron [None req-3a913ee2-9fff-4b00-8dc6-3a8734e8c37a tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 20a57394-a798-4356-8b70-3615f9de588e] Updating instance_info_cache with network_info: [] {{(pid=134101) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 04 22:15:01.487647 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-7c561347-4958-4a73-b7c5-1293b95c530b req-936e4bcd-56d0-4538-814d-485242c09dc6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20a57394-a798-4356-8b70-3615f9de588e", "name": "network-vif-deleted", "tag": "05ea2c3e-5db0-459a-b0b2-b3d8186a59f0"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:15:01.531651 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-7c561347-4958-4a73-b7c5-1293b95c530b req-936e4bcd-56d0-4538-814d-485242c09dc6 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:01.532146 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-7c561347-4958-4a73-b7c5-1293b95c530b req-936e4bcd-56d0-4538-814d-485242c09dc6 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:01.532589 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-7c561347-4958-4a73-b7c5-1293b95c530b req-936e4bcd-56d0-4538-814d-485242c09dc6 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:01.580141 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.compute.server_external_events [req-7c561347-4958-4a73-b7c5-1293b95c530b req-936e4bcd-56d0-4538-814d-485242c09dc6 service nova] Unable to find a host for instance 20a57394-a798-4356-8b70-3615f9de588e. Dropping event network-vif-deleted {{(pid=134102) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 04 22:15:01.581091 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-7c561347-4958-4a73-b7c5-1293b95c530b req-936e4bcd-56d0-4538-814d-485242c09dc6 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.109660 Oct 04 22:15:01.581719 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2808/5551] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:15:01 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 111 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 04 22:15:02.242515 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=8,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:15:02.317453 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-3a913ee2-9fff-4b00-8dc6-3a8734e8c37a tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "DELETE /compute/v2.1/servers/20a57394-a798-4356-8b70-3615f9de588e" status: 204 len: 0 microversion: 2.1 time: 5.103733 Oct 04 22:15:02.321294 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2744/5552] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 22:14:57 2022] DELETE /compute/v2.1/servers/20a57394-a798-4356-8b70-3615f9de588e => generated 0 bytes in 5105 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 22:15:02.328139 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-a148db62-8b12-4cb7-ba50-ac6aea5694aa tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:15:02.328871 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-a148db62-8b12-4cb7-ba50-ac6aea5694aa tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 20a57394-a798-4356-8b70-3615f9de588e] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:15:02.335846 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a148db62-8b12-4cb7-ba50-ac6aea5694aa tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:02.336317 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a148db62-8b12-4cb7-ba50-ac6aea5694aa tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:02.336900 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a148db62-8b12-4cb7-ba50-ac6aea5694aa tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:02.337617 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a148db62-8b12-4cb7-ba50-ac6aea5694aa tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:02.339213 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a148db62-8b12-4cb7-ba50-ac6aea5694aa tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:02.339921 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a148db62-8b12-4cb7-ba50-ac6aea5694aa tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:02.359422 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-a148db62-8b12-4cb7-ba50-ac6aea5694aa tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] HTTP exception thrown: Instance 20a57394-a798-4356-8b70-3615f9de588e could not be found. Oct 04 22:15:02.361969 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-a148db62-8b12-4cb7-ba50-ac6aea5694aa tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Request method failure captured: Oct 04 22:15:02.361969 n-d-860284-1 devstack@n-api.service[134102]: request: GET /compute/v2.1/servers/20a57394-a798-4356-8b70-3615f9de588e HTTP/1.1 Oct 04 22:15:02.361969 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 22:15:02.361969 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 22:15:02.361969 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 22:15:02.361969 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 22:15:02.361969 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 22:15:02.361969 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 22:15:02.361969 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 22:15:02.361969 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 22:15:02.361969 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPK36LhdKEh-IT_3Gw2xkUDt8vFdE3tJ0L0pEorSp45vpb8HIuo5GhgwZG7etc4I92LwOWEQ_5hLVPfNglgOWzH1UtFXDjgpmOJxq9bsBu31hozTvhN6em_GLmX3idDP8ki8j3hYIhOKY57iHcJLRtUu-QmjxHUfChrL6-4ezukI1Oj4 Oct 04 22:15:02.361969 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 22:15:02.361969 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 22:15:02.361969 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 22:15:02.361969 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 22:15:02.361969 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 22:15:02.361969 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 22:15:02.361969 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: 9da7a77590054a3c911643db69a0beae Oct 04 22:15:02.361969 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-ServerActionsTestJSON-514103999 Oct 04 22:15:02.361969 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 22:15:02.361969 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 22:15:02.361969 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/9da7a77590054a3c911643db69a0beae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_9da7a77590054a3c911643db69a0beae", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/9da7a77590054a3c911643db69a0beae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/9da7a77590054a3c911643db69a0beae"}]}] Oct 04 22:15:02.361969 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-ServerActionsTestJSON-514103999 Oct 04 22:15:02.361969 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: 9da7a77590054a3c911643db69a0beae Oct 04 22:15:02.361969 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-ServerActionsTestJSON-514103999 Oct 04 22:15:02.361969 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-ServerActionsTestJSON-514103999-project Oct 04 22:15:02.361969 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 22:15:02.361969 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 22:15:02.361969 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: 836cb8e2e7be4981bb266cbd4189a775 Oct 04 22:15:02.361969 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-ServerActionsTestJSON-514103999-project Oct 04 22:15:02.361969 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 22:15:02.361969 n-d-860284-1 devstack@n-api.service[134102]: exception: Instance 20a57394-a798-4356-8b70-3615f9de588e could not be found. Oct 04 22:15:02.361969 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': '20a57394-a798-4356-8b70-3615f9de588e'} Oct 04 22:15:02.361969 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:15:02.361969 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:15:02.361969 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:15:02.361969 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:15:02.361969 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:15:02.361969 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:15:02.361969 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:15:02.361969 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:15:02.361969 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:15:02.361969 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:15:02.361969 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20a57394-a798-4356-8b70-3615f9de588e could not be found. Oct 04 22:15:02.361969 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:15:02.361969 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:15:02.361969 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:15:02.361969 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:15:02.361969 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:15:02.361969 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:15:02.361969 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:15:02.361969 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:15:02.361969 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:15:02.361969 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:15:02.361969 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:15:02.361969 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:15:02.361969 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:15:02.361969 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:15:02.361969 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:15:02.361969 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:15:02.361969 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20a57394-a798-4356-8b70-3615f9de588e could not be found. Oct 04 22:15:02.361969 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:15:02.361969 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:15:02.361969 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:15:02.366256 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:15:02.366256 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:15:02.366256 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:15:02.366256 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:15:02.366256 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:15:02.366256 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20a57394-a798-4356-8b70-3615f9de588e could not be found. Oct 04 22:15:02.366256 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:15:02.369443 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-a148db62-8b12-4cb7-ba50-ac6aea5694aa tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Returning 404 to user: Instance 20a57394-a798-4356-8b70-3615f9de588e could not be found. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:15:02.370757 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-a148db62-8b12-4cb7-ba50-ac6aea5694aa tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/20a57394-a798-4356-8b70-3615f9de588e" status: 404 len: 111 microversion: 2.1 time: 0.048009 Oct 04 22:15:02.385572 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-036199c3-150a-45f3-bb92-579f019de756 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:15:02.386105 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-036199c3-150a-45f3-bb92-579f019de756 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: ed4edd72-c2f2-4823-a8ec-274e9bc6ae98] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:15:02.389789 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2809/5553] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:15:02 2022] GET /compute/v2.1/servers/20a57394-a798-4356-8b70-3615f9de588e => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:15:02.395728 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-036199c3-150a-45f3-bb92-579f019de756 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:02.398697 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-036199c3-150a-45f3-bb92-579f019de756 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:02.399652 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-036199c3-150a-45f3-bb92-579f019de756 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:02.404405 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-036199c3-150a-45f3-bb92-579f019de756 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:02.405454 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-036199c3-150a-45f3-bb92-579f019de756 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:02.406773 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-036199c3-150a-45f3-bb92-579f019de756 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:02.468349 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-036199c3-150a-45f3-bb92-579f019de756 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: ed4edd72-c2f2-4823-a8ec-274e9bc6ae98] Going to try to terminate instance {{(pid=134101) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 22:15:02.649921 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-036199c3-150a-45f3-bb92-579f019de756 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "DELETE /compute/v2.1/servers/ed4edd72-c2f2-4823-a8ec-274e9bc6ae98" status: 204 len: 0 microversion: 2.1 time: 0.273005 Oct 04 22:15:02.651115 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2745/5554] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 22:15:02 2022] DELETE /compute/v2.1/servers/ed4edd72-c2f2-4823-a8ec-274e9bc6ae98 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 22:15:02.659821 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-fb36569f-d54c-41ab-b564-44c750edf36c tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:15:02.660524 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-fb36569f-d54c-41ab-b564-44c750edf36c tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: ed4edd72-c2f2-4823-a8ec-274e9bc6ae98] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:15:02.674037 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fb36569f-d54c-41ab-b564-44c750edf36c tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:02.676898 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fb36569f-d54c-41ab-b564-44c750edf36c tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:02.677373 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fb36569f-d54c-41ab-b564-44c750edf36c tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:02.678267 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fb36569f-d54c-41ab-b564-44c750edf36c tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:02.678766 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fb36569f-d54c-41ab-b564-44c750edf36c tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:02.680131 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fb36569f-d54c-41ab-b564-44c750edf36c tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:03.084260 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-fb36569f-d54c-41ab-b564-44c750edf36c tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:15:03.098055 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-fb36569f-d54c-41ab-b564-44c750edf36c tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/ed4edd72-c2f2-4823-a8ec-274e9bc6ae98" status: 200 len: 1467 microversion: 2.1 time: 0.442778 Oct 04 22:15:03.104106 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2810/5555] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:15:02 2022] GET /compute/v2.1/servers/ed4edd72-c2f2-4823-a8ec-274e9bc6ae98 => generated 1467 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:15:04.137968 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-0d3464ae-a12b-4fc9-b95e-1c70afc5c9bc tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:15:04.138346 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-0d3464ae-a12b-4fc9-b95e-1c70afc5c9bc tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: ed4edd72-c2f2-4823-a8ec-274e9bc6ae98] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:15:04.156475 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0d3464ae-a12b-4fc9-b95e-1c70afc5c9bc tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:04.156984 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0d3464ae-a12b-4fc9-b95e-1c70afc5c9bc tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:04.157431 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0d3464ae-a12b-4fc9-b95e-1c70afc5c9bc tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:04.158179 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0d3464ae-a12b-4fc9-b95e-1c70afc5c9bc tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:04.158665 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0d3464ae-a12b-4fc9-b95e-1c70afc5c9bc tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:04.159098 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0d3464ae-a12b-4fc9-b95e-1c70afc5c9bc tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:04.425867 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-0d3464ae-a12b-4fc9-b95e-1c70afc5c9bc tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:15:04.439635 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-0d3464ae-a12b-4fc9-b95e-1c70afc5c9bc tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/ed4edd72-c2f2-4823-a8ec-274e9bc6ae98" status: 200 len: 1467 microversion: 2.1 time: 0.314101 Oct 04 22:15:04.442936 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2746/5556] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:15:04 2022] GET /compute/v2.1/servers/ed4edd72-c2f2-4823-a8ec-274e9bc6ae98 => generated 1467 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:15:05.470512 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-da77b16e-d77b-439b-ab33-9a49044b4f83 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:15:05.471158 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-da77b16e-d77b-439b-ab33-9a49044b4f83 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: ed4edd72-c2f2-4823-a8ec-274e9bc6ae98] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:15:05.490143 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-da77b16e-d77b-439b-ab33-9a49044b4f83 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:05.492681 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-da77b16e-d77b-439b-ab33-9a49044b4f83 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:05.494974 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-da77b16e-d77b-439b-ab33-9a49044b4f83 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:05.496424 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-da77b16e-d77b-439b-ab33-9a49044b4f83 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:05.497953 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-da77b16e-d77b-439b-ab33-9a49044b4f83 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:05.500338 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-da77b16e-d77b-439b-ab33-9a49044b4f83 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:05.717667 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-da77b16e-d77b-439b-ab33-9a49044b4f83 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:15:05.729758 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-da77b16e-d77b-439b-ab33-9a49044b4f83 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/ed4edd72-c2f2-4823-a8ec-274e9bc6ae98" status: 200 len: 1467 microversion: 2.1 time: 0.266448 Oct 04 22:15:05.730948 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2811/5557] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:15:05 2022] GET /compute/v2.1/servers/ed4edd72-c2f2-4823-a8ec-274e9bc6ae98 => generated 1467 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:15:06.759432 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-3381d06d-3966-4e3c-bc5b-194689b27a05 req-b1b061ff-237f-4b89-a820-ec3434cb7434 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed4edd72-c2f2-4823-a8ec-274e9bc6ae98", "name": "network-vif-deleted", "tag": "3d80fddc-0eaf-4faf-a7a0-9d49d2c52ae2"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:15:06.765270 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-c5465c7e-6e50-4516-8bd4-ab6b3c4f6729 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:15:06.765914 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-c5465c7e-6e50-4516-8bd4-ab6b3c4f6729 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: ed4edd72-c2f2-4823-a8ec-274e9bc6ae98] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:15:06.788047 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c5465c7e-6e50-4516-8bd4-ab6b3c4f6729 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:06.791414 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c5465c7e-6e50-4516-8bd4-ab6b3c4f6729 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:06.791967 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c5465c7e-6e50-4516-8bd4-ab6b3c4f6729 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:06.792928 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c5465c7e-6e50-4516-8bd4-ab6b3c4f6729 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:06.794952 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c5465c7e-6e50-4516-8bd4-ab6b3c4f6729 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:06.797835 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-3381d06d-3966-4e3c-bc5b-194689b27a05 req-b1b061ff-237f-4b89-a820-ec3434cb7434 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:06.799489 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c5465c7e-6e50-4516-8bd4-ab6b3c4f6729 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:06.801707 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-3381d06d-3966-4e3c-bc5b-194689b27a05 req-b1b061ff-237f-4b89-a820-ec3434cb7434 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:06.803224 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-3381d06d-3966-4e3c-bc5b-194689b27a05 req-b1b061ff-237f-4b89-a820-ec3434cb7434 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:06.850073 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-c5465c7e-6e50-4516-8bd4-ab6b3c4f6729 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] HTTP exception thrown: Instance ed4edd72-c2f2-4823-a8ec-274e9bc6ae98 could not be found. Oct 04 22:15:06.858030 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-3381d06d-3966-4e3c-bc5b-194689b27a05 req-b1b061ff-237f-4b89-a820-ec3434cb7434 service nova] Creating event network-vif-deleted:3d80fddc-0eaf-4faf-a7a0-9d49d2c52ae2 for instance ed4edd72-c2f2-4823-a8ec-274e9bc6ae98 on n-h2-860284-1 Oct 04 22:15:06.870356 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-c5465c7e-6e50-4516-8bd4-ab6b3c4f6729 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Request method failure captured: Oct 04 22:15:06.870356 n-d-860284-1 devstack@n-api.service[134102]: request: GET /compute/v2.1/servers/ed4edd72-c2f2-4823-a8ec-274e9bc6ae98 HTTP/1.1 Oct 04 22:15:06.870356 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 22:15:06.870356 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 22:15:06.870356 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 22:15:06.870356 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 22:15:06.870356 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 22:15:06.870356 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 22:15:06.870356 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 22:15:06.870356 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 22:15:06.870356 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPK36LhdKEh-IT_3Gw2xkUDt8vFdE3tJ0L0pEorSp45vpb8HIuo5GhgwZG7etc4I92LwOWEQ_5hLVPfNglgOWzH1UtFXDjgpmOJxq9bsBu31hozTvhN6em_GLmX3idDP8ki8j3hYIhOKY57iHcJLRtUu-QmjxHUfChrL6-4ezukI1Oj4 Oct 04 22:15:06.870356 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 22:15:06.870356 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 22:15:06.870356 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 22:15:06.870356 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 22:15:06.870356 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 22:15:06.870356 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 22:15:06.870356 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: 9da7a77590054a3c911643db69a0beae Oct 04 22:15:06.870356 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-ServerActionsTestJSON-514103999 Oct 04 22:15:06.870356 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 22:15:06.870356 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 22:15:06.870356 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/9da7a77590054a3c911643db69a0beae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_9da7a77590054a3c911643db69a0beae", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/9da7a77590054a3c911643db69a0beae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/9da7a77590054a3c911643db69a0beae"}]}] Oct 04 22:15:06.870356 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-ServerActionsTestJSON-514103999 Oct 04 22:15:06.870356 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: 9da7a77590054a3c911643db69a0beae Oct 04 22:15:06.870356 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-ServerActionsTestJSON-514103999 Oct 04 22:15:06.870356 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-ServerActionsTestJSON-514103999-project Oct 04 22:15:06.870356 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 22:15:06.870356 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 22:15:06.870356 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: 836cb8e2e7be4981bb266cbd4189a775 Oct 04 22:15:06.870356 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-ServerActionsTestJSON-514103999-project Oct 04 22:15:06.870356 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 22:15:06.870356 n-d-860284-1 devstack@n-api.service[134102]: exception: Instance ed4edd72-c2f2-4823-a8ec-274e9bc6ae98 could not be found. Oct 04 22:15:06.870356 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': 'ed4edd72-c2f2-4823-a8ec-274e9bc6ae98'} Oct 04 22:15:06.870356 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:15:06.870356 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:15:06.870356 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:15:06.870356 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:15:06.870356 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:15:06.870356 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:15:06.870356 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:15:06.870356 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:15:06.870356 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:15:06.870356 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:15:06.870356 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed4edd72-c2f2-4823-a8ec-274e9bc6ae98 could not be found. Oct 04 22:15:06.870356 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:15:06.870356 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:15:06.870356 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:15:06.870356 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:15:06.870356 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:15:06.870356 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:15:06.870356 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:15:06.870356 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:15:06.870356 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:15:06.870356 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:15:06.870356 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:15:06.870356 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:15:06.870356 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:15:06.870356 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:15:06.870356 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:15:06.870356 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:15:06.870356 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed4edd72-c2f2-4823-a8ec-274e9bc6ae98 could not be found. Oct 04 22:15:06.870356 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:15:06.870356 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:15:06.870356 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:15:06.875143 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:15:06.875143 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:15:06.875143 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:15:06.875143 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:15:06.875143 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:15:06.875143 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed4edd72-c2f2-4823-a8ec-274e9bc6ae98 could not be found. Oct 04 22:15:06.875143 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:15:06.876804 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-c5465c7e-6e50-4516-8bd4-ab6b3c4f6729 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Returning 404 to user: Instance ed4edd72-c2f2-4823-a8ec-274e9bc6ae98 could not be found. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:15:06.878001 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-3381d06d-3966-4e3c-bc5b-194689b27a05 req-b1b061ff-237f-4b89-a820-ec3434cb7434 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.519065 Oct 04 22:15:06.879015 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-c5465c7e-6e50-4516-8bd4-ab6b3c4f6729 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/ed4edd72-c2f2-4823-a8ec-274e9bc6ae98" status: 404 len: 111 microversion: 2.1 time: 0.126799 Oct 04 22:15:06.882837 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2747/5558] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:15:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:15:06.883103 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2812/5559] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:15:06 2022] GET /compute/v2.1/servers/ed4edd72-c2f2-4823-a8ec-274e9bc6ae98 => generated 111 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:15:06.895655 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-35842abf-2158-4021-9ffd-8aa267199692 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:15:06.898314 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-35842abf-2158-4021-9ffd-8aa267199692 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: a9da8775-8ca8-41b1-8340-e4f3dae6e05b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:15:06.906978 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-35842abf-2158-4021-9ffd-8aa267199692 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:06.908231 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-35842abf-2158-4021-9ffd-8aa267199692 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:06.908231 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-35842abf-2158-4021-9ffd-8aa267199692 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:06.909772 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-35842abf-2158-4021-9ffd-8aa267199692 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:06.909772 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-35842abf-2158-4021-9ffd-8aa267199692 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:06.910289 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-35842abf-2158-4021-9ffd-8aa267199692 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:06.949436 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-35842abf-2158-4021-9ffd-8aa267199692 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: a9da8775-8ca8-41b1-8340-e4f3dae6e05b] Going to try to terminate instance {{(pid=134101) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 22:15:07.217027 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-35842abf-2158-4021-9ffd-8aa267199692 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "DELETE /compute/v2.1/servers/a9da8775-8ca8-41b1-8340-e4f3dae6e05b" status: 204 len: 0 microversion: 2.1 time: 0.319868 Oct 04 22:15:07.221970 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2748/5560] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 22:15:06 2022] DELETE /compute/v2.1/servers/a9da8775-8ca8-41b1-8340-e4f3dae6e05b => generated 0 bytes in 332 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 22:15:07.238794 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-a59c62b3-155f-4b7c-8c53-80bd58dd174d tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:15:07.239688 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-a59c62b3-155f-4b7c-8c53-80bd58dd174d tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: a9da8775-8ca8-41b1-8340-e4f3dae6e05b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:15:07.258672 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a59c62b3-155f-4b7c-8c53-80bd58dd174d tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:07.263935 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a59c62b3-155f-4b7c-8c53-80bd58dd174d tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:07.266665 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a59c62b3-155f-4b7c-8c53-80bd58dd174d tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:07.267950 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a59c62b3-155f-4b7c-8c53-80bd58dd174d tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:07.269563 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a59c62b3-155f-4b7c-8c53-80bd58dd174d tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:07.271257 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a59c62b3-155f-4b7c-8c53-80bd58dd174d tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:08.109391 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-a59c62b3-155f-4b7c-8c53-80bd58dd174d tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:15:08.140999 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-a59c62b3-155f-4b7c-8c53-80bd58dd174d tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/a9da8775-8ca8-41b1-8340-e4f3dae6e05b" status: 200 len: 1509 microversion: 2.1 time: 0.916001 Oct 04 22:15:08.145240 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2813/5561] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:15:07 2022] GET /compute/v2.1/servers/a9da8775-8ca8-41b1-8340-e4f3dae6e05b => generated 1509 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:15:09.172198 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-5f47cc70-6f14-44dc-904b-af92176f5e61 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:15:09.172938 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-5f47cc70-6f14-44dc-904b-af92176f5e61 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: a9da8775-8ca8-41b1-8340-e4f3dae6e05b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:15:09.212583 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5f47cc70-6f14-44dc-904b-af92176f5e61 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:09.214090 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5f47cc70-6f14-44dc-904b-af92176f5e61 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:09.214589 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5f47cc70-6f14-44dc-904b-af92176f5e61 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:09.220272 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5f47cc70-6f14-44dc-904b-af92176f5e61 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:09.222035 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5f47cc70-6f14-44dc-904b-af92176f5e61 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:09.222537 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5f47cc70-6f14-44dc-904b-af92176f5e61 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:09.642448 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-5f47cc70-6f14-44dc-904b-af92176f5e61 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:15:09.650837 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-5f47cc70-6f14-44dc-904b-af92176f5e61 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/a9da8775-8ca8-41b1-8340-e4f3dae6e05b" status: 200 len: 1509 microversion: 2.1 time: 0.487301 Oct 04 22:15:09.655391 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2749/5562] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:15:09 2022] GET /compute/v2.1/servers/a9da8775-8ca8-41b1-8340-e4f3dae6e05b => generated 1509 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:15:10.680548 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-f6afe141-e2d0-4a7f-a64f-74a96f8c1b7e tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:15:10.681592 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-f6afe141-e2d0-4a7f-a64f-74a96f8c1b7e tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: a9da8775-8ca8-41b1-8340-e4f3dae6e05b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:15:10.695269 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f6afe141-e2d0-4a7f-a64f-74a96f8c1b7e tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:10.695765 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f6afe141-e2d0-4a7f-a64f-74a96f8c1b7e tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:10.698804 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f6afe141-e2d0-4a7f-a64f-74a96f8c1b7e tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:10.722150 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f6afe141-e2d0-4a7f-a64f-74a96f8c1b7e tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:10.722845 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f6afe141-e2d0-4a7f-a64f-74a96f8c1b7e tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:10.725429 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f6afe141-e2d0-4a7f-a64f-74a96f8c1b7e tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:10.789879 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-12fb4b77-a437-422f-83cc-4d6c0aa73084 req-336ac4d3-8bfd-4441-bc09-6d80600e3018 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9da8775-8ca8-41b1-8340-e4f3dae6e05b", "name": "network-vif-deleted", "tag": "a2b687e2-c84f-4fe7-aa70-7f2f1ddf6a09"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:15:10.821336 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-12fb4b77-a437-422f-83cc-4d6c0aa73084 req-336ac4d3-8bfd-4441-bc09-6d80600e3018 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:10.822628 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-12fb4b77-a437-422f-83cc-4d6c0aa73084 req-336ac4d3-8bfd-4441-bc09-6d80600e3018 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:10.823224 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-12fb4b77-a437-422f-83cc-4d6c0aa73084 req-336ac4d3-8bfd-4441-bc09-6d80600e3018 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:10.855616 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-12fb4b77-a437-422f-83cc-4d6c0aa73084 req-336ac4d3-8bfd-4441-bc09-6d80600e3018 service nova] Creating event network-vif-deleted:a2b687e2-c84f-4fe7-aa70-7f2f1ddf6a09 for instance a9da8775-8ca8-41b1-8340-e4f3dae6e05b on n-h2-860284-1 Oct 04 22:15:10.902434 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-12fb4b77-a437-422f-83cc-4d6c0aa73084 req-336ac4d3-8bfd-4441-bc09-6d80600e3018 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126934 Oct 04 22:15:10.903079 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2750/5563] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:15:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:15:11.535532 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-f6afe141-e2d0-4a7f-a64f-74a96f8c1b7e tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:15:11.544242 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-f6afe141-e2d0-4a7f-a64f-74a96f8c1b7e tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/a9da8775-8ca8-41b1-8340-e4f3dae6e05b" status: 200 len: 1467 microversion: 2.1 time: 0.867684 Oct 04 22:15:11.567040 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2814/5564] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:15:10 2022] GET /compute/v2.1/servers/a9da8775-8ca8-41b1-8340-e4f3dae6e05b => generated 1467 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:15:12.582787 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-b317d28d-4b1a-4aab-b080-aca31e7d9cda tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:15:12.586086 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-b317d28d-4b1a-4aab-b080-aca31e7d9cda tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: a9da8775-8ca8-41b1-8340-e4f3dae6e05b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:15:12.609961 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b317d28d-4b1a-4aab-b080-aca31e7d9cda tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:12.610805 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b317d28d-4b1a-4aab-b080-aca31e7d9cda tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:12.612594 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b317d28d-4b1a-4aab-b080-aca31e7d9cda tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:12.624625 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b317d28d-4b1a-4aab-b080-aca31e7d9cda tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:12.625181 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b317d28d-4b1a-4aab-b080-aca31e7d9cda tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:12.627187 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b317d28d-4b1a-4aab-b080-aca31e7d9cda tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:12.694419 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-b317d28d-4b1a-4aab-b080-aca31e7d9cda tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] HTTP exception thrown: Instance a9da8775-8ca8-41b1-8340-e4f3dae6e05b could not be found. Oct 04 22:15:12.698492 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-b317d28d-4b1a-4aab-b080-aca31e7d9cda tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Request method failure captured: Oct 04 22:15:12.698492 n-d-860284-1 devstack@n-api.service[134101]: request: GET /compute/v2.1/servers/a9da8775-8ca8-41b1-8340-e4f3dae6e05b HTTP/1.1 Oct 04 22:15:12.698492 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 22:15:12.698492 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 22:15:12.698492 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 22:15:12.698492 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 22:15:12.698492 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 22:15:12.698492 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 22:15:12.698492 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 22:15:12.698492 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 22:15:12.698492 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPK36LhdKEh-IT_3Gw2xkUDt8vFdE3tJ0L0pEorSp45vpb8HIuo5GhgwZG7etc4I92LwOWEQ_5hLVPfNglgOWzH1UtFXDjgpmOJxq9bsBu31hozTvhN6em_GLmX3idDP8ki8j3hYIhOKY57iHcJLRtUu-QmjxHUfChrL6-4ezukI1Oj4 Oct 04 22:15:12.698492 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 22:15:12.698492 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 22:15:12.698492 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 22:15:12.698492 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 22:15:12.698492 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 22:15:12.698492 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 22:15:12.698492 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: 9da7a77590054a3c911643db69a0beae Oct 04 22:15:12.698492 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-ServerActionsTestJSON-514103999 Oct 04 22:15:12.698492 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 22:15:12.698492 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 22:15:12.698492 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/9da7a77590054a3c911643db69a0beae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_9da7a77590054a3c911643db69a0beae", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/9da7a77590054a3c911643db69a0beae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/9da7a77590054a3c911643db69a0beae"}]}] Oct 04 22:15:12.698492 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-ServerActionsTestJSON-514103999 Oct 04 22:15:12.698492 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: 9da7a77590054a3c911643db69a0beae Oct 04 22:15:12.698492 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-ServerActionsTestJSON-514103999 Oct 04 22:15:12.698492 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-ServerActionsTestJSON-514103999-project Oct 04 22:15:12.698492 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 22:15:12.698492 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 22:15:12.698492 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 836cb8e2e7be4981bb266cbd4189a775 Oct 04 22:15:12.698492 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-ServerActionsTestJSON-514103999-project Oct 04 22:15:12.698492 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 22:15:12.698492 n-d-860284-1 devstack@n-api.service[134101]: exception: Instance a9da8775-8ca8-41b1-8340-e4f3dae6e05b could not be found. Oct 04 22:15:12.698492 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': 'a9da8775-8ca8-41b1-8340-e4f3dae6e05b'} Oct 04 22:15:12.698492 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:15:12.698492 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:15:12.698492 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:15:12.698492 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:15:12.698492 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:15:12.698492 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:15:12.698492 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:15:12.698492 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:15:12.698492 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:15:12.698492 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:15:12.698492 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9da8775-8ca8-41b1-8340-e4f3dae6e05b could not be found. Oct 04 22:15:12.698492 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:15:12.698492 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:15:12.698492 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:15:12.698492 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:15:12.698492 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:15:12.698492 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:15:12.698492 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:15:12.698492 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:15:12.698492 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:15:12.698492 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:15:12.698492 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:15:12.698492 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:15:12.698492 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:15:12.698492 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:15:12.698492 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:15:12.698492 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:15:12.698492 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9da8775-8ca8-41b1-8340-e4f3dae6e05b could not be found. Oct 04 22:15:12.698492 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:15:12.698492 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:15:12.698492 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:15:12.703181 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:15:12.703181 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:15:12.703181 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:15:12.703181 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:15:12.703181 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:15:12.703181 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9da8775-8ca8-41b1-8340-e4f3dae6e05b could not be found. Oct 04 22:15:12.703181 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:15:12.704411 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-b317d28d-4b1a-4aab-b080-aca31e7d9cda tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Returning 404 to user: Instance a9da8775-8ca8-41b1-8340-e4f3dae6e05b could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:15:12.705503 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-b317d28d-4b1a-4aab-b080-aca31e7d9cda tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/a9da8775-8ca8-41b1-8340-e4f3dae6e05b" status: 404 len: 111 microversion: 2.1 time: 0.136820 Oct 04 22:15:12.706242 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2751/5565] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:15:12 2022] GET /compute/v2.1/servers/a9da8775-8ca8-41b1-8340-e4f3dae6e05b => generated 111 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:15:12.717113 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-47d6ddaf-e888-4bb3-8fc3-ccd8aca67dfc tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:15:12.717663 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-47d6ddaf-e888-4bb3-8fc3-ccd8aca67dfc tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 3d4d9f68-34fa-48b4-a274-6b389af36686] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:15:12.733813 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-47d6ddaf-e888-4bb3-8fc3-ccd8aca67dfc tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:12.739404 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-47d6ddaf-e888-4bb3-8fc3-ccd8aca67dfc tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:12.740443 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-47d6ddaf-e888-4bb3-8fc3-ccd8aca67dfc tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:12.745342 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-47d6ddaf-e888-4bb3-8fc3-ccd8aca67dfc tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:12.748106 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-47d6ddaf-e888-4bb3-8fc3-ccd8aca67dfc tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:12.748932 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-47d6ddaf-e888-4bb3-8fc3-ccd8aca67dfc tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:12.890473 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-47d6ddaf-e888-4bb3-8fc3-ccd8aca67dfc tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 3d4d9f68-34fa-48b4-a274-6b389af36686] Going to try to terminate instance {{(pid=134102) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 22:15:12.896934 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:15:13.145677 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-47d6ddaf-e888-4bb3-8fc3-ccd8aca67dfc tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "DELETE /compute/v2.1/servers/3d4d9f68-34fa-48b4-a274-6b389af36686" status: 204 len: 0 microversion: 2.1 time: 0.434183 Oct 04 22:15:13.149382 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2815/5566] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 22:15:12 2022] DELETE /compute/v2.1/servers/3d4d9f68-34fa-48b4-a274-6b389af36686 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 22:15:13.158798 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-7ec958b6-ea40-4287-a6a8-99d66aa88d54 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:15:13.159697 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-7ec958b6-ea40-4287-a6a8-99d66aa88d54 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 3d4d9f68-34fa-48b4-a274-6b389af36686] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:15:13.176006 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7ec958b6-ea40-4287-a6a8-99d66aa88d54 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:13.186666 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7ec958b6-ea40-4287-a6a8-99d66aa88d54 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:13.187380 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7ec958b6-ea40-4287-a6a8-99d66aa88d54 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:13.188292 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7ec958b6-ea40-4287-a6a8-99d66aa88d54 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:13.193567 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7ec958b6-ea40-4287-a6a8-99d66aa88d54 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:13.194276 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7ec958b6-ea40-4287-a6a8-99d66aa88d54 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:13.586683 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-7ec958b6-ea40-4287-a6a8-99d66aa88d54 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:15:13.597119 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-7ec958b6-ea40-4287-a6a8-99d66aa88d54 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/3d4d9f68-34fa-48b4-a274-6b389af36686" status: 200 len: 1494 microversion: 2.1 time: 0.442699 Oct 04 22:15:13.601193 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2752/5567] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:15:13 2022] GET /compute/v2.1/servers/3d4d9f68-34fa-48b4-a274-6b389af36686 => generated 1494 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:15:14.730529 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-91baaff1-6227-4af9-87b6-f8c6cf65a075 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:15:14.731250 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-91baaff1-6227-4af9-87b6-f8c6cf65a075 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 3d4d9f68-34fa-48b4-a274-6b389af36686] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:15:14.746406 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:15:14.751090 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-91baaff1-6227-4af9-87b6-f8c6cf65a075 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:14.751880 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-91baaff1-6227-4af9-87b6-f8c6cf65a075 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:14.753761 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-91baaff1-6227-4af9-87b6-f8c6cf65a075 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:14.756416 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-91baaff1-6227-4af9-87b6-f8c6cf65a075 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:14.758489 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-91baaff1-6227-4af9-87b6-f8c6cf65a075 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:14.759294 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-91baaff1-6227-4af9-87b6-f8c6cf65a075 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:15.357307 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-91baaff1-6227-4af9-87b6-f8c6cf65a075 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:15:15.405201 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-91baaff1-6227-4af9-87b6-f8c6cf65a075 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/3d4d9f68-34fa-48b4-a274-6b389af36686" status: 200 len: 1494 microversion: 2.1 time: 0.679214 Oct 04 22:15:15.405974 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2816/5568] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:15:14 2022] GET /compute/v2.1/servers/3d4d9f68-34fa-48b4-a274-6b389af36686 => generated 1494 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:15:16.235938 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-28668f15-a165-4606-b4b3-37b93c32a0f2 req-6f7b2596-585f-4af4-a13b-10c84566ad3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d4d9f68-34fa-48b4-a274-6b389af36686", "name": "network-vif-deleted", "tag": "f13beae5-f748-444a-889a-9f97d7e0da5c"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:15:16.252822 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=3 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:15:16.275999 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-28668f15-a165-4606-b4b3-37b93c32a0f2 req-6f7b2596-585f-4af4-a13b-10c84566ad3e service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:16.277907 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-28668f15-a165-4606-b4b3-37b93c32a0f2 req-6f7b2596-585f-4af4-a13b-10c84566ad3e service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:16.279236 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-28668f15-a165-4606-b4b3-37b93c32a0f2 req-6f7b2596-585f-4af4-a13b-10c84566ad3e service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:16.332561 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-28668f15-a165-4606-b4b3-37b93c32a0f2 req-6f7b2596-585f-4af4-a13b-10c84566ad3e service nova] Creating event network-vif-deleted:f13beae5-f748-444a-889a-9f97d7e0da5c for instance 3d4d9f68-34fa-48b4-a274-6b389af36686 on n-h1-860284-1 Oct 04 22:15:16.364817 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-28668f15-a165-4606-b4b3-37b93c32a0f2 req-6f7b2596-585f-4af4-a13b-10c84566ad3e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131599 Oct 04 22:15:16.382095 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2753/5569] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:15:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:15:16.434909 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-f2f74739-04c7-425b-8063-01e564a5c1e0 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:15:16.435555 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-f2f74739-04c7-425b-8063-01e564a5c1e0 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 3d4d9f68-34fa-48b4-a274-6b389af36686] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:15:16.457526 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f2f74739-04c7-425b-8063-01e564a5c1e0 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:16.457839 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f2f74739-04c7-425b-8063-01e564a5c1e0 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:16.458286 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f2f74739-04c7-425b-8063-01e564a5c1e0 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:16.465162 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f2f74739-04c7-425b-8063-01e564a5c1e0 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:16.469298 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f2f74739-04c7-425b-8063-01e564a5c1e0 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:16.471219 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f2f74739-04c7-425b-8063-01e564a5c1e0 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:16.610869 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f2f74739-04c7-425b-8063-01e564a5c1e0 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:16.614251 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f2f74739-04c7-425b-8063-01e564a5c1e0 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:16.615010 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f2f74739-04c7-425b-8063-01e564a5c1e0 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:16.615801 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.objects.instance [None req-f2f74739-04c7-425b-8063-01e564a5c1e0 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lazy-loading 'fault' on Instance uuid 3d4d9f68-34fa-48b4-a274-6b389af36686 {{(pid=134102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 22:15:16.873421 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-f2f74739-04c7-425b-8063-01e564a5c1e0 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:15:16.889754 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-f2f74739-04c7-425b-8063-01e564a5c1e0 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/3d4d9f68-34fa-48b4-a274-6b389af36686" status: 200 len: 1304 microversion: 2.1 time: 0.460381 Oct 04 22:15:16.894078 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2817/5570] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:15:16 2022] GET /compute/v2.1/servers/3d4d9f68-34fa-48b4-a274-6b389af36686 => generated 1304 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:15:17.923951 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-5d1613e8-cd29-47c6-bace-9a24cf5e3e42 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:15:17.924826 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-5d1613e8-cd29-47c6-bace-9a24cf5e3e42 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 3d4d9f68-34fa-48b4-a274-6b389af36686] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:15:17.937656 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5d1613e8-cd29-47c6-bace-9a24cf5e3e42 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:17.946648 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5d1613e8-cd29-47c6-bace-9a24cf5e3e42 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:17.947174 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5d1613e8-cd29-47c6-bace-9a24cf5e3e42 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:17.948796 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5d1613e8-cd29-47c6-bace-9a24cf5e3e42 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:17.960446 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5d1613e8-cd29-47c6-bace-9a24cf5e3e42 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:17.960979 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5d1613e8-cd29-47c6-bace-9a24cf5e3e42 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:18.012887 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-5d1613e8-cd29-47c6-bace-9a24cf5e3e42 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] HTTP exception thrown: Instance 3d4d9f68-34fa-48b4-a274-6b389af36686 could not be found. Oct 04 22:15:18.020120 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-5d1613e8-cd29-47c6-bace-9a24cf5e3e42 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Request method failure captured: Oct 04 22:15:18.020120 n-d-860284-1 devstack@n-api.service[134101]: request: GET /compute/v2.1/servers/3d4d9f68-34fa-48b4-a274-6b389af36686 HTTP/1.1 Oct 04 22:15:18.020120 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 22:15:18.020120 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 22:15:18.020120 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 22:15:18.020120 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 22:15:18.020120 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 22:15:18.020120 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 22:15:18.020120 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 22:15:18.020120 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 22:15:18.020120 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPK36LhdKEh-IT_3Gw2xkUDt8vFdE3tJ0L0pEorSp45vpb8HIuo5GhgwZG7etc4I92LwOWEQ_5hLVPfNglgOWzH1UtFXDjgpmOJxq9bsBu31hozTvhN6em_GLmX3idDP8ki8j3hYIhOKY57iHcJLRtUu-QmjxHUfChrL6-4ezukI1Oj4 Oct 04 22:15:18.020120 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 22:15:18.020120 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 22:15:18.020120 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 22:15:18.020120 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 22:15:18.020120 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 22:15:18.020120 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 22:15:18.020120 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: 9da7a77590054a3c911643db69a0beae Oct 04 22:15:18.020120 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-ServerActionsTestJSON-514103999 Oct 04 22:15:18.020120 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 22:15:18.020120 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 22:15:18.020120 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/9da7a77590054a3c911643db69a0beae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_9da7a77590054a3c911643db69a0beae", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/9da7a77590054a3c911643db69a0beae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/9da7a77590054a3c911643db69a0beae"}]}] Oct 04 22:15:18.020120 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-ServerActionsTestJSON-514103999 Oct 04 22:15:18.020120 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: 9da7a77590054a3c911643db69a0beae Oct 04 22:15:18.020120 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-ServerActionsTestJSON-514103999 Oct 04 22:15:18.020120 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-ServerActionsTestJSON-514103999-project Oct 04 22:15:18.020120 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 22:15:18.020120 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 22:15:18.020120 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 836cb8e2e7be4981bb266cbd4189a775 Oct 04 22:15:18.020120 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-ServerActionsTestJSON-514103999-project Oct 04 22:15:18.020120 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 22:15:18.020120 n-d-860284-1 devstack@n-api.service[134101]: exception: Instance 3d4d9f68-34fa-48b4-a274-6b389af36686 could not be found. Oct 04 22:15:18.020120 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': '3d4d9f68-34fa-48b4-a274-6b389af36686'} Oct 04 22:15:18.020120 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:15:18.020120 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:15:18.020120 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:15:18.020120 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:15:18.020120 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:15:18.020120 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:15:18.020120 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:15:18.020120 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:15:18.020120 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:15:18.020120 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:15:18.020120 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d4d9f68-34fa-48b4-a274-6b389af36686 could not be found. Oct 04 22:15:18.020120 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:15:18.020120 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:15:18.020120 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:15:18.020120 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:15:18.020120 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:15:18.020120 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:15:18.020120 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:15:18.020120 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:15:18.020120 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:15:18.020120 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:15:18.020120 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:15:18.020120 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:15:18.020120 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:15:18.020120 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:15:18.020120 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:15:18.020120 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:15:18.020120 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d4d9f68-34fa-48b4-a274-6b389af36686 could not be found. Oct 04 22:15:18.020120 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:15:18.020120 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:15:18.020120 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:15:18.027918 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:15:18.027918 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:15:18.027918 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:15:18.027918 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:15:18.027918 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:15:18.027918 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d4d9f68-34fa-48b4-a274-6b389af36686 could not be found. Oct 04 22:15:18.027918 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:15:18.027918 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-5d1613e8-cd29-47c6-bace-9a24cf5e3e42 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Returning 404 to user: Instance 3d4d9f68-34fa-48b4-a274-6b389af36686 could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:15:18.027918 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-5d1613e8-cd29-47c6-bace-9a24cf5e3e42 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/3d4d9f68-34fa-48b4-a274-6b389af36686" status: 404 len: 111 microversion: 2.1 time: 0.104565 Oct 04 22:15:18.027918 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2754/5571] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:15:17 2022] GET /compute/v2.1/servers/3d4d9f68-34fa-48b4-a274-6b389af36686 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:15:18.034967 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-f1b629f9-ade9-41c9-b37e-410863f901ee tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:15:18.035478 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-f1b629f9-ade9-41c9-b37e-410863f901ee tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 48243e1b-892b-4c4b-8db1-242b2e40653b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:15:18.062019 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f1b629f9-ade9-41c9-b37e-410863f901ee tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:18.062625 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f1b629f9-ade9-41c9-b37e-410863f901ee tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:18.063098 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f1b629f9-ade9-41c9-b37e-410863f901ee tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:18.066399 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f1b629f9-ade9-41c9-b37e-410863f901ee tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:18.070687 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f1b629f9-ade9-41c9-b37e-410863f901ee tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:18.071378 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f1b629f9-ade9-41c9-b37e-410863f901ee tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:18.106310 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-f1b629f9-ade9-41c9-b37e-410863f901ee tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 48243e1b-892b-4c4b-8db1-242b2e40653b] Going to try to terminate instance {{(pid=134102) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 22:15:18.247695 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-f1b629f9-ade9-41c9-b37e-410863f901ee tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "DELETE /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b" status: 204 len: 0 microversion: 2.1 time: 0.216324 Oct 04 22:15:18.252793 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2818/5572] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 22:15:18 2022] DELETE /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b => generated 0 bytes in 224 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 22:15:18.264545 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-bad14eed-a986-4899-8b55-af0343de56a7 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:15:18.265516 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-bad14eed-a986-4899-8b55-af0343de56a7 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 48243e1b-892b-4c4b-8db1-242b2e40653b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:15:18.279188 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bad14eed-a986-4899-8b55-af0343de56a7 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:18.279683 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bad14eed-a986-4899-8b55-af0343de56a7 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:18.280123 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bad14eed-a986-4899-8b55-af0343de56a7 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:18.280830 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bad14eed-a986-4899-8b55-af0343de56a7 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:18.281289 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bad14eed-a986-4899-8b55-af0343de56a7 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:18.283749 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bad14eed-a986-4899-8b55-af0343de56a7 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:18.717207 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-bad14eed-a986-4899-8b55-af0343de56a7 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:15:18.751795 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-bad14eed-a986-4899-8b55-af0343de56a7 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b" status: 200 len: 1675 microversion: 2.1 time: 0.491481 Oct 04 22:15:18.755773 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2755/5573] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:15:18 2022] GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b => generated 1675 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:15:19.037017 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-2598dc94-1368-4f05-a73a-8e688583e734 tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-1045205223", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452", "networks": [{"uuid": "94d02da0-463d-4392-80b5-a8f3475d5a72"}]}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:15:19.177591 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.network.neutron [None req-2598dc94-1368-4f05-a73a-8e688583e734 tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] validate_networks() for [('94d02da0-463d-4392-80b5-a8f3475d5a72', None, None, None, None, None)] {{(pid=134102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 22:15:19.785276 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-df37a6be-2a40-4444-817c-cd1b673c4d0a tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:15:19.786877 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-df37a6be-2a40-4444-817c-cd1b673c4d0a tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 48243e1b-892b-4c4b-8db1-242b2e40653b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:15:19.805362 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-df37a6be-2a40-4444-817c-cd1b673c4d0a tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:19.806886 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-df37a6be-2a40-4444-817c-cd1b673c4d0a tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:19.807619 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-df37a6be-2a40-4444-817c-cd1b673c4d0a tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:19.808579 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-df37a6be-2a40-4444-817c-cd1b673c4d0a tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:19.809448 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-df37a6be-2a40-4444-817c-cd1b673c4d0a tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:19.810127 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-df37a6be-2a40-4444-817c-cd1b673c4d0a tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:20.144659 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-2598dc94-1368-4f05-a73a-8e688583e734 tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Flavor limits 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 22:15:20.145208 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-2598dc94-1368-4f05-a73a-8e688583e734 tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Image limits 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 22:15:20.146235 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-2598dc94-1368-4f05-a73a-8e688583e734 tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Flavor pref 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 22:15:20.146805 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-2598dc94-1368-4f05-a73a-8e688583e734 tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Image pref 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 22:15:20.148002 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-2598dc94-1368-4f05-a73a-8e688583e734 tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 22:15:20.166242 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2598dc94-1368-4f05-a73a-8e688583e734 tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:20.167169 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2598dc94-1368-4f05-a73a-8e688583e734 tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:20.171874 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2598dc94-1368-4f05-a73a-8e688583e734 tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:20.173846 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2598dc94-1368-4f05-a73a-8e688583e734 tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:20.174619 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2598dc94-1368-4f05-a73a-8e688583e734 tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:20.175292 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2598dc94-1368-4f05-a73a-8e688583e734 tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:20.213619 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-df37a6be-2a40-4444-817c-cd1b673c4d0a tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:15:20.223327 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-2598dc94-1368-4f05-a73a-8e688583e734 tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Getting quotas for project 5e4459c8264f4becb89cc035c9269e7f. Resources: {'instances', 'ram', 'cores'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:15:20.223465 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-df37a6be-2a40-4444-817c-cd1b673c4d0a tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b" status: 200 len: 1675 microversion: 2.1 time: 0.448130 Oct 04 22:15:20.235325 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2756/5574] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:15:19 2022] GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b => generated 1675 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:15:20.242566 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-2598dc94-1368-4f05-a73a-8e688583e734 tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Getting quotas for user cb8470580ebd429e8408b75ac845bf2a and project 5e4459c8264f4becb89cc035c9269e7f. Resources: {'instances', 'ram', 'cores'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:15:20.284860 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-2598dc94-1368-4f05-a73a-8e688583e734 tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Going to run 1 instances... {{(pid=134102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 22:15:20.287881 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-2598dc94-1368-4f05-a73a-8e688583e734 tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] [instance: 04f92b56-d51e-40fe-8641-b32e64cf3801] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='58548514-5dac-426c-81f5-19e3fba33e23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 22:15:20.391222 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-2598dc94-1368-4f05-a73a-8e688583e734 tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.899032 Oct 04 22:15:20.407828 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-7de7ab7e-1cf2-4bac-953e-a54f5629a9e8 tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:15:20.408694 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-7de7ab7e-1cf2-4bac-953e-a54f5629a9e8 tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] [instance: 04f92b56-d51e-40fe-8641-b32e64cf3801] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:15:20.414604 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2819/5575] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 22:15:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 1923 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 22:15:20.534848 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-7de7ab7e-1cf2-4bac-953e-a54f5629a9e8 tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb8470580ebd429e8408b75ac845bf2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e4459c8264f4becb89cc035c9269e7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:15:20.574163 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-7de7ab7e-1cf2-4bac-953e-a54f5629a9e8 tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] 10.222.0.43 "GET /compute/v2.1/servers/04f92b56-d51e-40fe-8641-b32e64cf3801" status: 200 len: 1217 microversion: 2.1 time: 0.168961 Oct 04 22:15:20.578882 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2757/5576] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:15:20 2022] GET /compute/v2.1/servers/04f92b56-d51e-40fe-8641-b32e64cf3801 => generated 1217 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:15:21.257517 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-502e1123-d261-4206-9305-e1f28b1fc21e tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:15:21.258301 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-502e1123-d261-4206-9305-e1f28b1fc21e tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 48243e1b-892b-4c4b-8db1-242b2e40653b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:15:21.283548 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-502e1123-d261-4206-9305-e1f28b1fc21e tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:21.291190 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-502e1123-d261-4206-9305-e1f28b1fc21e tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:21.292042 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-502e1123-d261-4206-9305-e1f28b1fc21e tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:21.292948 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-502e1123-d261-4206-9305-e1f28b1fc21e tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:21.293571 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-502e1123-d261-4206-9305-e1f28b1fc21e tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:21.294195 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-502e1123-d261-4206-9305-e1f28b1fc21e tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:21.490969 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-502e1123-d261-4206-9305-e1f28b1fc21e tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:15:21.503745 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-502e1123-d261-4206-9305-e1f28b1fc21e tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b" status: 200 len: 1675 microversion: 2.1 time: 0.251127 Oct 04 22:15:21.514407 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2820/5577] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:15:21 2022] GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b => generated 1675 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:15:21.602522 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-9e139093-be42-43cb-af06-a41529d38cc2 tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:15:21.604044 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-9e139093-be42-43cb-af06-a41529d38cc2 tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] [instance: 04f92b56-d51e-40fe-8641-b32e64cf3801] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:15:21.618509 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9e139093-be42-43cb-af06-a41529d38cc2 tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:21.621174 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9e139093-be42-43cb-af06-a41529d38cc2 tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:21.622772 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9e139093-be42-43cb-af06-a41529d38cc2 tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:21.623724 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9e139093-be42-43cb-af06-a41529d38cc2 tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:21.626098 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9e139093-be42-43cb-af06-a41529d38cc2 tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:21.626811 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9e139093-be42-43cb-af06-a41529d38cc2 tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:21.766108 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-9e139093-be42-43cb-af06-a41529d38cc2 tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb8470580ebd429e8408b75ac845bf2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e4459c8264f4becb89cc035c9269e7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:15:21.778591 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-9e139093-be42-43cb-af06-a41529d38cc2 tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] 10.222.0.43 "GET /compute/v2.1/servers/04f92b56-d51e-40fe-8641-b32e64cf3801" status: 200 len: 1221 microversion: 2.1 time: 0.180608 Oct 04 22:15:21.791960 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2758/5578] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:15:21 2022] GET /compute/v2.1/servers/04f92b56-d51e-40fe-8641-b32e64cf3801 => generated 1221 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:15:22.532823 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-0f56c916-e539-4cba-a9e6-7c27e76e8c40 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:15:22.534250 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-0f56c916-e539-4cba-a9e6-7c27e76e8c40 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 48243e1b-892b-4c4b-8db1-242b2e40653b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:15:22.569501 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0f56c916-e539-4cba-a9e6-7c27e76e8c40 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:22.572724 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0f56c916-e539-4cba-a9e6-7c27e76e8c40 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:22.576018 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0f56c916-e539-4cba-a9e6-7c27e76e8c40 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:22.581602 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0f56c916-e539-4cba-a9e6-7c27e76e8c40 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:22.582098 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0f56c916-e539-4cba-a9e6-7c27e76e8c40 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:22.592658 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0f56c916-e539-4cba-a9e6-7c27e76e8c40 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:22.809499 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-d912e75d-0111-4086-873d-319ed96043b6 tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:15:22.810827 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-d912e75d-0111-4086-873d-319ed96043b6 tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] [instance: 04f92b56-d51e-40fe-8641-b32e64cf3801] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:15:22.826897 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d912e75d-0111-4086-873d-319ed96043b6 tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:22.828869 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d912e75d-0111-4086-873d-319ed96043b6 tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:22.830672 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d912e75d-0111-4086-873d-319ed96043b6 tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:22.832522 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d912e75d-0111-4086-873d-319ed96043b6 tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:22.834527 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d912e75d-0111-4086-873d-319ed96043b6 tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:22.835965 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d912e75d-0111-4086-873d-319ed96043b6 tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:22.855565 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-0f56c916-e539-4cba-a9e6-7c27e76e8c40 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:15:22.890167 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-0f56c916-e539-4cba-a9e6-7c27e76e8c40 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b" status: 200 len: 1608 microversion: 2.1 time: 0.364832 Oct 04 22:15:22.891013 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2821/5579] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:15:22 2022] GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b => generated 1608 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:15:22.939948 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-a5e58cbe-1e3b-4874-be5c-ee0e04614da5 req-2e47125c-bc7a-4de3-adad-e74a50617cf2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48243e1b-892b-4c4b-8db1-242b2e40653b", "name": "network-vif-deleted", "tag": "a795c088-46ba-4a15-a651-33aa842e29b5"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:15:22.983429 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-a5e58cbe-1e3b-4874-be5c-ee0e04614da5 req-2e47125c-bc7a-4de3-adad-e74a50617cf2 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:22.986868 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-a5e58cbe-1e3b-4874-be5c-ee0e04614da5 req-2e47125c-bc7a-4de3-adad-e74a50617cf2 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:22.990484 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-a5e58cbe-1e3b-4874-be5c-ee0e04614da5 req-2e47125c-bc7a-4de3-adad-e74a50617cf2 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:23.046589 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-a5e58cbe-1e3b-4874-be5c-ee0e04614da5 req-2e47125c-bc7a-4de3-adad-e74a50617cf2 service nova] Creating event network-vif-deleted:a795c088-46ba-4a15-a651-33aa842e29b5 for instance 48243e1b-892b-4c4b-8db1-242b2e40653b on n-h1-860284-1 Oct 04 22:15:23.059261 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-a5e58cbe-1e3b-4874-be5c-ee0e04614da5 req-2e47125c-bc7a-4de3-adad-e74a50617cf2 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135558 Oct 04 22:15:23.066899 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2822/5580] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:15:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:15:23.111153 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-d912e75d-0111-4086-873d-319ed96043b6 tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb8470580ebd429e8408b75ac845bf2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e4459c8264f4becb89cc035c9269e7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:15:23.133718 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-d912e75d-0111-4086-873d-319ed96043b6 tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] 10.222.0.43 "GET /compute/v2.1/servers/04f92b56-d51e-40fe-8641-b32e64cf3801" status: 200 len: 1277 microversion: 2.1 time: 0.333119 Oct 04 22:15:23.139308 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2759/5581] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:15:22 2022] GET /compute/v2.1/servers/04f92b56-d51e-40fe-8641-b32e64cf3801 => generated 1277 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:15:23.921707 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-9225ba3f-7a83-46cb-a05d-760fb402c77b tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:15:23.922456 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-9225ba3f-7a83-46cb-a05d-760fb402c77b tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 48243e1b-892b-4c4b-8db1-242b2e40653b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:15:23.945676 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9225ba3f-7a83-46cb-a05d-760fb402c77b tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:23.946224 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9225ba3f-7a83-46cb-a05d-760fb402c77b tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:23.954753 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9225ba3f-7a83-46cb-a05d-760fb402c77b tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:23.956254 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9225ba3f-7a83-46cb-a05d-760fb402c77b tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:23.960130 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9225ba3f-7a83-46cb-a05d-760fb402c77b tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:23.960804 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9225ba3f-7a83-46cb-a05d-760fb402c77b tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:24.079879 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9225ba3f-7a83-46cb-a05d-760fb402c77b tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:24.080886 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9225ba3f-7a83-46cb-a05d-760fb402c77b tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:24.082934 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9225ba3f-7a83-46cb-a05d-760fb402c77b tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:24.083806 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.objects.instance [None req-9225ba3f-7a83-46cb-a05d-760fb402c77b tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lazy-loading 'fault' on Instance uuid 48243e1b-892b-4c4b-8db1-242b2e40653b {{(pid=134102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 22:15:24.165011 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e257951b-47c1-4e80-8549-52992e4af18b tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:15:24.166655 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-e257951b-47c1-4e80-8549-52992e4af18b tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] [instance: 04f92b56-d51e-40fe-8641-b32e64cf3801] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:15:24.175383 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e257951b-47c1-4e80-8549-52992e4af18b tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:24.175932 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e257951b-47c1-4e80-8549-52992e4af18b tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:24.176313 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e257951b-47c1-4e80-8549-52992e4af18b tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:24.180069 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e257951b-47c1-4e80-8549-52992e4af18b tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:24.182542 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e257951b-47c1-4e80-8549-52992e4af18b tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:24.187439 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e257951b-47c1-4e80-8549-52992e4af18b tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:24.285998 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:UPDATE=12,nova_cell1:DELETE=2,nova_cell1:SELECT=84,nova_cell1:INSERT=2 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:15:24.382852 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-9225ba3f-7a83-46cb-a05d-760fb402c77b tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836cb8e2e7be4981bb266cbd4189a775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7a77590054a3c911643db69a0beae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:15:24.404209 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-9225ba3f-7a83-46cb-a05d-760fb402c77b tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b" status: 200 len: 1328 microversion: 2.1 time: 0.482821 Oct 04 22:15:24.404913 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2823/5582] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:15:23 2022] GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b => generated 1328 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:15:24.571602 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-e257951b-47c1-4e80-8549-52992e4af18b tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb8470580ebd429e8408b75ac845bf2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e4459c8264f4becb89cc035c9269e7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:15:24.592360 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-e257951b-47c1-4e80-8549-52992e4af18b tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] 10.222.0.43 "GET /compute/v2.1/servers/04f92b56-d51e-40fe-8641-b32e64cf3801" status: 200 len: 1275 microversion: 2.1 time: 0.431327 Oct 04 22:15:24.596669 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2760/5583] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:15:24 2022] GET /compute/v2.1/servers/04f92b56-d51e-40fe-8641-b32e64cf3801 => generated 1275 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:15:25.432210 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-b4051d1c-e38b-493d-9382-c004e1f169f9 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:15:25.432843 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-b4051d1c-e38b-493d-9382-c004e1f169f9 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] [instance: 48243e1b-892b-4c4b-8db1-242b2e40653b] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:15:25.444308 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b4051d1c-e38b-493d-9382-c004e1f169f9 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:25.444888 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b4051d1c-e38b-493d-9382-c004e1f169f9 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:25.445289 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b4051d1c-e38b-493d-9382-c004e1f169f9 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:25.450225 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b4051d1c-e38b-493d-9382-c004e1f169f9 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:25.451015 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b4051d1c-e38b-493d-9382-c004e1f169f9 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:25.454232 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b4051d1c-e38b-493d-9382-c004e1f169f9 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:25.489181 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-b4051d1c-e38b-493d-9382-c004e1f169f9 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] HTTP exception thrown: Instance 48243e1b-892b-4c4b-8db1-242b2e40653b could not be found. Oct 04 22:15:25.492405 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-b4051d1c-e38b-493d-9382-c004e1f169f9 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Request method failure captured: Oct 04 22:15:25.492405 n-d-860284-1 devstack@n-api.service[134102]: request: GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b HTTP/1.1 Oct 04 22:15:25.492405 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 22:15:25.492405 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 22:15:25.492405 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 22:15:25.492405 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 22:15:25.492405 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 22:15:25.492405 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 22:15:25.492405 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 22:15:25.492405 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 22:15:25.492405 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPK36LhdKEh-IT_3Gw2xkUDt8vFdE3tJ0L0pEorSp45vpb8HIuo5GhgwZG7etc4I92LwOWEQ_5hLVPfNglgOWzH1UtFXDjgpmOJxq9bsBu31hozTvhN6em_GLmX3idDP8ki8j3hYIhOKY57iHcJLRtUu-QmjxHUfChrL6-4ezukI1Oj4 Oct 04 22:15:25.492405 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 22:15:25.492405 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 22:15:25.492405 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 22:15:25.492405 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 22:15:25.492405 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 22:15:25.492405 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 22:15:25.492405 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: 9da7a77590054a3c911643db69a0beae Oct 04 22:15:25.492405 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-ServerActionsTestJSON-514103999 Oct 04 22:15:25.492405 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 22:15:25.492405 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 22:15:25.492405 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/9da7a77590054a3c911643db69a0beae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_9da7a77590054a3c911643db69a0beae", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/9da7a77590054a3c911643db69a0beae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/9da7a77590054a3c911643db69a0beae"}]}] Oct 04 22:15:25.492405 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-ServerActionsTestJSON-514103999 Oct 04 22:15:25.492405 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: 9da7a77590054a3c911643db69a0beae Oct 04 22:15:25.492405 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-ServerActionsTestJSON-514103999 Oct 04 22:15:25.492405 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-ServerActionsTestJSON-514103999-project Oct 04 22:15:25.492405 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 22:15:25.492405 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 22:15:25.492405 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: 836cb8e2e7be4981bb266cbd4189a775 Oct 04 22:15:25.492405 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-ServerActionsTestJSON-514103999-project Oct 04 22:15:25.492405 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 22:15:25.492405 n-d-860284-1 devstack@n-api.service[134102]: exception: Instance 48243e1b-892b-4c4b-8db1-242b2e40653b could not be found. Oct 04 22:15:25.492405 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': '48243e1b-892b-4c4b-8db1-242b2e40653b'} Oct 04 22:15:25.492405 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:15:25.492405 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:15:25.492405 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:15:25.492405 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:15:25.492405 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:15:25.492405 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:15:25.492405 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:15:25.492405 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:15:25.492405 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:15:25.492405 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:15:25.492405 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48243e1b-892b-4c4b-8db1-242b2e40653b could not be found. Oct 04 22:15:25.492405 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:15:25.492405 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:15:25.492405 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:15:25.492405 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:15:25.492405 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:15:25.492405 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:15:25.492405 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:15:25.492405 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:15:25.492405 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:15:25.492405 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:15:25.492405 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:15:25.492405 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:15:25.492405 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:15:25.492405 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:15:25.492405 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:15:25.492405 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:15:25.492405 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48243e1b-892b-4c4b-8db1-242b2e40653b could not be found. Oct 04 22:15:25.492405 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:15:25.492405 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:15:25.492405 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:15:25.497460 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:15:25.497460 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:15:25.497460 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:15:25.497460 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:15:25.497460 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:15:25.497460 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48243e1b-892b-4c4b-8db1-242b2e40653b could not be found. Oct 04 22:15:25.497460 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:15:25.500516 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-b4051d1c-e38b-493d-9382-c004e1f169f9 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Returning 404 to user: Instance 48243e1b-892b-4c4b-8db1-242b2e40653b could not be found. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:15:25.501518 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-b4051d1c-e38b-493d-9382-c004e1f169f9 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b" status: 404 len: 111 microversion: 2.1 time: 0.074817 Oct 04 22:15:25.502701 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2824/5584] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:15:25 2022] GET /compute/v2.1/servers/48243e1b-892b-4c4b-8db1-242b2e40653b => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:15:25.511358 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-1564676c-9bc9-47fe-a836-7f3d6f2a98e0 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] Calling method '.version_select at 0x7fbb2da78a60>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:15:25.547092 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-1564676c-9bc9-47fe-a836-7f3d6f2a98e0 tempest-ServerActionsTestJSON-514103999 tempest-ServerActionsTestJSON-514103999-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1577660225" status: 202 len: 0 microversion: 2.1 time: 0.038456 Oct 04 22:15:25.548158 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2761/5585] 10.222.0.43 () {58 vars in 1221 bytes} [Tue Oct 4 22:15:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1577660225 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 22:15:25.618155 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-ad414927-cff7-4ba4-a577-68889204736e tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:15:25.622428 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-ad414927-cff7-4ba4-a577-68889204736e tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] [instance: 04f92b56-d51e-40fe-8641-b32e64cf3801] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:15:25.641730 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ad414927-cff7-4ba4-a577-68889204736e tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:25.642248 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ad414927-cff7-4ba4-a577-68889204736e tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:25.650694 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ad414927-cff7-4ba4-a577-68889204736e tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:25.653846 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ad414927-cff7-4ba4-a577-68889204736e tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:25.670663 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ad414927-cff7-4ba4-a577-68889204736e tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:25.673632 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ad414927-cff7-4ba4-a577-68889204736e tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:25.953051 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-ad414927-cff7-4ba4-a577-68889204736e tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb8470580ebd429e8408b75ac845bf2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e4459c8264f4becb89cc035c9269e7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:15:25.962107 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-ad414927-cff7-4ba4-a577-68889204736e tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] 10.222.0.43 "GET /compute/v2.1/servers/04f92b56-d51e-40fe-8641-b32e64cf3801" status: 200 len: 1317 microversion: 2.1 time: 0.348675 Oct 04 22:15:25.971578 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2825/5586] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:15:25 2022] GET /compute/v2.1/servers/04f92b56-d51e-40fe-8641-b32e64cf3801 => generated 1317 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:15:27.001366 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e821ac9c-e643-4cea-86f1-cd09693b9774 tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:15:27.002011 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-e821ac9c-e643-4cea-86f1-cd09693b9774 tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] [instance: 04f92b56-d51e-40fe-8641-b32e64cf3801] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:15:27.028389 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e821ac9c-e643-4cea-86f1-cd09693b9774 tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:27.028942 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e821ac9c-e643-4cea-86f1-cd09693b9774 tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:27.030749 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e821ac9c-e643-4cea-86f1-cd09693b9774 tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:27.033238 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e821ac9c-e643-4cea-86f1-cd09693b9774 tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:27.034904 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e821ac9c-e643-4cea-86f1-cd09693b9774 tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:27.036321 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e821ac9c-e643-4cea-86f1-cd09693b9774 tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:27.222402 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-7a7847f8-cc56-4985-b19b-a98a073a7a73 req-1ee42cab-428f-4ead-98d6-c20e72f4f94a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04f92b56-d51e-40fe-8641-b32e64cf3801", "tag": "b7412dee-c31a-4df6-9e89-fa8bbd74f637"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:15:27.251409 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-7a7847f8-cc56-4985-b19b-a98a073a7a73 req-1ee42cab-428f-4ead-98d6-c20e72f4f94a service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:27.253100 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-7a7847f8-cc56-4985-b19b-a98a073a7a73 req-1ee42cab-428f-4ead-98d6-c20e72f4f94a service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:27.253903 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-7a7847f8-cc56-4985-b19b-a98a073a7a73 req-1ee42cab-428f-4ead-98d6-c20e72f4f94a service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:27.294818 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-7a7847f8-cc56-4985-b19b-a98a073a7a73 req-1ee42cab-428f-4ead-98d6-c20e72f4f94a service nova] Creating event network-changed:b7412dee-c31a-4df6-9e89-fa8bbd74f637 for instance 04f92b56-d51e-40fe-8641-b32e64cf3801 on n-h2-860284-1 Oct 04 22:15:27.301246 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-7a7847f8-cc56-4985-b19b-a98a073a7a73 req-1ee42cab-428f-4ead-98d6-c20e72f4f94a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087418 Oct 04 22:15:27.308371 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2826/5587] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:15:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:15:27.748834 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-e821ac9c-e643-4cea-86f1-cd09693b9774 tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb8470580ebd429e8408b75ac845bf2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e4459c8264f4becb89cc035c9269e7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:15:27.760565 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-e821ac9c-e643-4cea-86f1-cd09693b9774 tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] 10.222.0.43 "GET /compute/v2.1/servers/04f92b56-d51e-40fe-8641-b32e64cf3801" status: 200 len: 1317 microversion: 2.1 time: 0.764173 Oct 04 22:15:27.762560 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2762/5588] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:15:26 2022] GET /compute/v2.1/servers/04f92b56-d51e-40fe-8641-b32e64cf3801 => generated 1317 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:15:28.787143 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-45dba2d6-7275-40af-bb96-6a5a782ac728 tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:15:28.788079 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-45dba2d6-7275-40af-bb96-6a5a782ac728 tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] [instance: 04f92b56-d51e-40fe-8641-b32e64cf3801] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:15:28.797790 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-45dba2d6-7275-40af-bb96-6a5a782ac728 tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:28.798713 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-45dba2d6-7275-40af-bb96-6a5a782ac728 tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:28.799402 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-45dba2d6-7275-40af-bb96-6a5a782ac728 tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:28.800387 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-45dba2d6-7275-40af-bb96-6a5a782ac728 tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:28.801197 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-45dba2d6-7275-40af-bb96-6a5a782ac728 tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:28.801875 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-45dba2d6-7275-40af-bb96-6a5a782ac728 tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:29.156119 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-45dba2d6-7275-40af-bb96-6a5a782ac728 tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb8470580ebd429e8408b75ac845bf2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e4459c8264f4becb89cc035c9269e7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:15:29.174299 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-45dba2d6-7275-40af-bb96-6a5a782ac728 tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] 10.222.0.43 "GET /compute/v2.1/servers/04f92b56-d51e-40fe-8641-b32e64cf3801" status: 200 len: 1317 microversion: 2.1 time: 0.392932 Oct 04 22:15:29.176007 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2827/5589] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:15:28 2022] GET /compute/v2.1/servers/04f92b56-d51e-40fe-8641-b32e64cf3801 => generated 1317 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:15:30.204362 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-0531cd36-092f-44ed-bfdf-ec7b56b6b3d8 tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:15:30.205167 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-0531cd36-092f-44ed-bfdf-ec7b56b6b3d8 tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] [instance: 04f92b56-d51e-40fe-8641-b32e64cf3801] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:15:30.222667 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0531cd36-092f-44ed-bfdf-ec7b56b6b3d8 tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:30.225728 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0531cd36-092f-44ed-bfdf-ec7b56b6b3d8 tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:30.226196 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0531cd36-092f-44ed-bfdf-ec7b56b6b3d8 tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:30.226978 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0531cd36-092f-44ed-bfdf-ec7b56b6b3d8 tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:30.227776 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0531cd36-092f-44ed-bfdf-ec7b56b6b3d8 tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:30.227960 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0531cd36-092f-44ed-bfdf-ec7b56b6b3d8 tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:30.546676 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=2 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:15:30.640336 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-0531cd36-092f-44ed-bfdf-ec7b56b6b3d8 tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb8470580ebd429e8408b75ac845bf2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e4459c8264f4becb89cc035c9269e7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:15:30.655226 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-0531cd36-092f-44ed-bfdf-ec7b56b6b3d8 tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] 10.222.0.43 "GET /compute/v2.1/servers/04f92b56-d51e-40fe-8641-b32e64cf3801" status: 200 len: 1317 microversion: 2.1 time: 0.454464 Oct 04 22:15:30.656142 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2763/5590] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:15:30 2022] GET /compute/v2.1/servers/04f92b56-d51e-40fe-8641-b32e64cf3801 => generated 1317 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:15:31.683965 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-a1dbb378-901d-45ae-aa45-175e89e22e8a tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:15:31.685724 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-a1dbb378-901d-45ae-aa45-175e89e22e8a tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] [instance: 04f92b56-d51e-40fe-8641-b32e64cf3801] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:15:31.690317 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell0:SELECT=2 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:15:31.692296 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell0:SELECT=6 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:15:31.702981 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a1dbb378-901d-45ae-aa45-175e89e22e8a tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:31.704269 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a1dbb378-901d-45ae-aa45-175e89e22e8a tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:31.706588 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a1dbb378-901d-45ae-aa45-175e89e22e8a tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:31.708069 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a1dbb378-901d-45ae-aa45-175e89e22e8a tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:31.708784 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a1dbb378-901d-45ae-aa45-175e89e22e8a tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:31.709431 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a1dbb378-901d-45ae-aa45-175e89e22e8a tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:32.179411 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-a1dbb378-901d-45ae-aa45-175e89e22e8a tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb8470580ebd429e8408b75ac845bf2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e4459c8264f4becb89cc035c9269e7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:15:32.192756 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-a1dbb378-901d-45ae-aa45-175e89e22e8a tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] 10.222.0.43 "GET /compute/v2.1/servers/04f92b56-d51e-40fe-8641-b32e64cf3801" status: 200 len: 1317 microversion: 2.1 time: 0.513859 Oct 04 22:15:32.195341 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2828/5591] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:15:31 2022] GET /compute/v2.1/servers/04f92b56-d51e-40fe-8641-b32e64cf3801 => generated 1317 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:15:33.226888 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-b735a8a3-f12a-4fff-a88f-3d8d68429c32 tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:15:33.230585 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-b735a8a3-f12a-4fff-a88f-3d8d68429c32 tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] [instance: 04f92b56-d51e-40fe-8641-b32e64cf3801] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:15:33.252325 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b735a8a3-f12a-4fff-a88f-3d8d68429c32 tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:33.252990 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b735a8a3-f12a-4fff-a88f-3d8d68429c32 tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:33.253536 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b735a8a3-f12a-4fff-a88f-3d8d68429c32 tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:33.254529 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b735a8a3-f12a-4fff-a88f-3d8d68429c32 tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:33.257090 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b735a8a3-f12a-4fff-a88f-3d8d68429c32 tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:33.257428 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b735a8a3-f12a-4fff-a88f-3d8d68429c32 tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:33.984278 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-f22f4ebf-35a6-4e7f-aa8c-c8d189d92bf0 req-a03a7e1c-6efb-466a-bbe4-005c6e137762 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04f92b56-d51e-40fe-8641-b32e64cf3801", "name": "network-vif-plugged", "status": "completed", "tag": "b7412dee-c31a-4df6-9e89-fa8bbd74f637"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:15:34.007641 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-f22f4ebf-35a6-4e7f-aa8c-c8d189d92bf0 req-a03a7e1c-6efb-466a-bbe4-005c6e137762 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:34.008511 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-f22f4ebf-35a6-4e7f-aa8c-c8d189d92bf0 req-a03a7e1c-6efb-466a-bbe4-005c6e137762 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:34.012488 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-f22f4ebf-35a6-4e7f-aa8c-c8d189d92bf0 req-a03a7e1c-6efb-466a-bbe4-005c6e137762 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:34.035226 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-f22f4ebf-35a6-4e7f-aa8c-c8d189d92bf0 req-a03a7e1c-6efb-466a-bbe4-005c6e137762 service nova] Creating event network-vif-plugged:b7412dee-c31a-4df6-9e89-fa8bbd74f637 for instance 04f92b56-d51e-40fe-8641-b32e64cf3801 on n-h2-860284-1 Oct 04 22:15:34.046271 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-f22f4ebf-35a6-4e7f-aa8c-c8d189d92bf0 req-a03a7e1c-6efb-466a-bbe4-005c6e137762 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.403894 Oct 04 22:15:34.047822 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2829/5592] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:15:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:15:34.133064 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-b735a8a3-f12a-4fff-a88f-3d8d68429c32 tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb8470580ebd429e8408b75ac845bf2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e4459c8264f4becb89cc035c9269e7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:15:34.154741 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-b735a8a3-f12a-4fff-a88f-3d8d68429c32 tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] 10.222.0.43 "GET /compute/v2.1/servers/04f92b56-d51e-40fe-8641-b32e64cf3801" status: 200 len: 1317 microversion: 2.1 time: 0.938516 Oct 04 22:15:34.167911 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2764/5593] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:15:33 2022] GET /compute/v2.1/servers/04f92b56-d51e-40fe-8641-b32e64cf3801 => generated 1317 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:15:35.182953 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-bb2de0c0-81db-4f81-bd77-af44c907a78c tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:15:35.183784 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-bb2de0c0-81db-4f81-bd77-af44c907a78c tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] [instance: 04f92b56-d51e-40fe-8641-b32e64cf3801] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:15:35.206589 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bb2de0c0-81db-4f81-bd77-af44c907a78c tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:35.210354 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bb2de0c0-81db-4f81-bd77-af44c907a78c tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:35.211238 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bb2de0c0-81db-4f81-bd77-af44c907a78c tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:35.212265 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bb2de0c0-81db-4f81-bd77-af44c907a78c tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:35.213843 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bb2de0c0-81db-4f81-bd77-af44c907a78c tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:35.216026 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bb2de0c0-81db-4f81-bd77-af44c907a78c tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:35.584017 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-bb2de0c0-81db-4f81-bd77-af44c907a78c tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb8470580ebd429e8408b75ac845bf2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e4459c8264f4becb89cc035c9269e7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:15:35.592626 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-bb2de0c0-81db-4f81-bd77-af44c907a78c tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] 10.222.0.43 "GET /compute/v2.1/servers/04f92b56-d51e-40fe-8641-b32e64cf3801" status: 200 len: 1317 microversion: 2.1 time: 0.415005 Oct 04 22:15:35.612585 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2830/5594] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:15:35 2022] GET /compute/v2.1/servers/04f92b56-d51e-40fe-8641-b32e64cf3801 => generated 1317 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:15:36.629120 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-cf252659-7fb6-4c03-a3ef-00d005cb3b51 tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:15:36.631475 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-cf252659-7fb6-4c03-a3ef-00d005cb3b51 tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] [instance: 04f92b56-d51e-40fe-8641-b32e64cf3801] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:15:36.641374 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cf252659-7fb6-4c03-a3ef-00d005cb3b51 tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:36.642110 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cf252659-7fb6-4c03-a3ef-00d005cb3b51 tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:36.642864 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cf252659-7fb6-4c03-a3ef-00d005cb3b51 tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:36.643953 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cf252659-7fb6-4c03-a3ef-00d005cb3b51 tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:36.644857 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cf252659-7fb6-4c03-a3ef-00d005cb3b51 tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:36.645447 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cf252659-7fb6-4c03-a3ef-00d005cb3b51 tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:36.935691 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-cf252659-7fb6-4c03-a3ef-00d005cb3b51 tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb8470580ebd429e8408b75ac845bf2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e4459c8264f4becb89cc035c9269e7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:15:36.948624 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-cf252659-7fb6-4c03-a3ef-00d005cb3b51 tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] 10.222.0.43 "GET /compute/v2.1/servers/04f92b56-d51e-40fe-8641-b32e64cf3801" status: 200 len: 1506 microversion: 2.1 time: 0.329739 Oct 04 22:15:36.952295 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2765/5595] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:15:36 2022] GET /compute/v2.1/servers/04f92b56-d51e-40fe-8641-b32e64cf3801 => generated 1506 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:15:36.982250 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-47021e96-e06e-4d4d-86a6-5d17a879ed5b tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:15:36.983645 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-47021e96-e06e-4d4d-86a6-5d17a879ed5b tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] [instance: 04f92b56-d51e-40fe-8641-b32e64cf3801] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:15:36.992660 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-47021e96-e06e-4d4d-86a6-5d17a879ed5b tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:36.994073 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-47021e96-e06e-4d4d-86a6-5d17a879ed5b tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:36.994846 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-47021e96-e06e-4d4d-86a6-5d17a879ed5b tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:36.995782 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-47021e96-e06e-4d4d-86a6-5d17a879ed5b tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:36.996463 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-47021e96-e06e-4d4d-86a6-5d17a879ed5b tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:36.997047 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-47021e96-e06e-4d4d-86a6-5d17a879ed5b tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:37.047102 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:15:37.054644 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-47021e96-e06e-4d4d-86a6-5d17a879ed5b tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': 'cb8470580ebd429e8408b75ac845bf2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e4459c8264f4becb89cc035c9269e7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:15:37.056643 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-47021e96-e06e-4d4d-86a6-5d17a879ed5b tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] 10.222.0.43 "GET /compute/v2.1/servers/04f92b56-d51e-40fe-8641-b32e64cf3801/os-instance-actions/req-2598dc94-1368-4f05-a73a-8e688583e734" status: 200 len: 313 microversion: 2.1 time: 0.083955 Oct 04 22:15:37.073771 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2831/5596] 10.222.0.43 () {58 vars in 1419 bytes} [Tue Oct 4 22:15:36 2022] GET /compute/v2.1/servers/04f92b56-d51e-40fe-8641-b32e64cf3801/os-instance-actions/req-2598dc94-1368-4f05-a73a-8e688583e734 => generated 313 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:15:37.078675 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-caa117dd-d0b1-4408-8009-bd0eab1265e7 tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:15:37.080908 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-caa117dd-d0b1-4408-8009-bd0eab1265e7 tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] [instance: 04f92b56-d51e-40fe-8641-b32e64cf3801] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:15:37.098098 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-caa117dd-d0b1-4408-8009-bd0eab1265e7 tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:37.099046 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-caa117dd-d0b1-4408-8009-bd0eab1265e7 tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:37.099671 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-caa117dd-d0b1-4408-8009-bd0eab1265e7 tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:37.100562 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-caa117dd-d0b1-4408-8009-bd0eab1265e7 tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:37.101232 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-caa117dd-d0b1-4408-8009-bd0eab1265e7 tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:37.101826 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-caa117dd-d0b1-4408-8009-bd0eab1265e7 tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:37.246093 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-caa117dd-d0b1-4408-8009-bd0eab1265e7 tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] 10.222.0.43 "POST /compute/v2.1/servers/04f92b56-d51e-40fe-8641-b32e64cf3801/action" status: 202 len: 0 microversion: 2.1 time: 0.170911 Oct 04 22:15:37.247517 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2766/5597] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 22:15:37 2022] POST /compute/v2.1/servers/04f92b56-d51e-40fe-8641-b32e64cf3801/action => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 22:15:37.259809 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-4218850e-8e5d-4a84-aab1-f56b0cda0d7b tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:15:37.260674 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-4218850e-8e5d-4a84-aab1-f56b0cda0d7b tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] [instance: 04f92b56-d51e-40fe-8641-b32e64cf3801] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:15:37.269918 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4218850e-8e5d-4a84-aab1-f56b0cda0d7b tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:37.271683 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4218850e-8e5d-4a84-aab1-f56b0cda0d7b tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:37.272432 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4218850e-8e5d-4a84-aab1-f56b0cda0d7b tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:37.273422 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4218850e-8e5d-4a84-aab1-f56b0cda0d7b tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:37.274203 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4218850e-8e5d-4a84-aab1-f56b0cda0d7b tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:37.274961 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4218850e-8e5d-4a84-aab1-f56b0cda0d7b tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:37.605960 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-4218850e-8e5d-4a84-aab1-f56b0cda0d7b tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb8470580ebd429e8408b75ac845bf2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e4459c8264f4becb89cc035c9269e7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:15:37.620435 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-4218850e-8e5d-4a84-aab1-f56b0cda0d7b tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] 10.222.0.43 "GET /compute/v2.1/servers/04f92b56-d51e-40fe-8641-b32e64cf3801" status: 200 len: 1508 microversion: 2.1 time: 0.366613 Oct 04 22:15:37.621705 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2832/5598] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:15:37 2022] GET /compute/v2.1/servers/04f92b56-d51e-40fe-8641-b32e64cf3801 => generated 1508 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:15:38.659696 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-59e54779-f116-457c-99dc-5b933b99b3ec tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:15:38.661356 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-59e54779-f116-457c-99dc-5b933b99b3ec tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] [instance: 04f92b56-d51e-40fe-8641-b32e64cf3801] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:15:38.692901 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-59e54779-f116-457c-99dc-5b933b99b3ec tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:38.695900 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-59e54779-f116-457c-99dc-5b933b99b3ec tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:38.698880 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-59e54779-f116-457c-99dc-5b933b99b3ec tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:38.707406 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-59e54779-f116-457c-99dc-5b933b99b3ec tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:38.731213 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-59e54779-f116-457c-99dc-5b933b99b3ec tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:38.732113 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-59e54779-f116-457c-99dc-5b933b99b3ec tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:39.064188 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-59e54779-f116-457c-99dc-5b933b99b3ec tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb8470580ebd429e8408b75ac845bf2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e4459c8264f4becb89cc035c9269e7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:15:39.109374 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-59e54779-f116-457c-99dc-5b933b99b3ec tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] 10.222.0.43 "GET /compute/v2.1/servers/04f92b56-d51e-40fe-8641-b32e64cf3801" status: 200 len: 1508 microversion: 2.1 time: 0.463982 Oct 04 22:15:39.116342 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2767/5599] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:15:38 2022] GET /compute/v2.1/servers/04f92b56-d51e-40fe-8641-b32e64cf3801 => generated 1508 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:15:40.136995 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-cfd5206c-626a-4386-b1a8-fa4c12987edf tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:15:40.137674 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-cfd5206c-626a-4386-b1a8-fa4c12987edf tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] [instance: 04f92b56-d51e-40fe-8641-b32e64cf3801] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:15:40.149303 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cfd5206c-626a-4386-b1a8-fa4c12987edf tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:40.150151 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cfd5206c-626a-4386-b1a8-fa4c12987edf tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:40.150784 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cfd5206c-626a-4386-b1a8-fa4c12987edf tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:40.152581 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cfd5206c-626a-4386-b1a8-fa4c12987edf tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:40.153594 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cfd5206c-626a-4386-b1a8-fa4c12987edf tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:40.154663 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cfd5206c-626a-4386-b1a8-fa4c12987edf tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:40.479601 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-cfd5206c-626a-4386-b1a8-fa4c12987edf tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb8470580ebd429e8408b75ac845bf2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e4459c8264f4becb89cc035c9269e7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:15:40.500282 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-cfd5206c-626a-4386-b1a8-fa4c12987edf tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] 10.222.0.43 "GET /compute/v2.1/servers/04f92b56-d51e-40fe-8641-b32e64cf3801" status: 200 len: 1513 microversion: 2.1 time: 0.365621 Oct 04 22:15:40.500936 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2833/5600] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:15:40 2022] GET /compute/v2.1/servers/04f92b56-d51e-40fe-8641-b32e64cf3801 => generated 1513 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:15:41.527200 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-3491dda7-6ef0-470e-88bd-ab02adec85a9 tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:15:41.528570 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-3491dda7-6ef0-470e-88bd-ab02adec85a9 tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] [instance: 04f92b56-d51e-40fe-8641-b32e64cf3801] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:15:41.537801 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3491dda7-6ef0-470e-88bd-ab02adec85a9 tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:41.538602 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3491dda7-6ef0-470e-88bd-ab02adec85a9 tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:41.539283 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3491dda7-6ef0-470e-88bd-ab02adec85a9 tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:41.540252 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3491dda7-6ef0-470e-88bd-ab02adec85a9 tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:41.541638 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3491dda7-6ef0-470e-88bd-ab02adec85a9 tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:41.542296 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3491dda7-6ef0-470e-88bd-ab02adec85a9 tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:42.070194 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-3491dda7-6ef0-470e-88bd-ab02adec85a9 tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb8470580ebd429e8408b75ac845bf2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e4459c8264f4becb89cc035c9269e7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:15:42.098272 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-3491dda7-6ef0-470e-88bd-ab02adec85a9 tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] 10.222.0.43 "GET /compute/v2.1/servers/04f92b56-d51e-40fe-8641-b32e64cf3801" status: 200 len: 1506 microversion: 2.1 time: 0.576498 Oct 04 22:15:42.104616 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2768/5601] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:15:41 2022] GET /compute/v2.1/servers/04f92b56-d51e-40fe-8641-b32e64cf3801 => generated 1506 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:15:42.137761 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-c7de78da-5c3b-44fb-9077-7416933e44e0 tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Calling method '.version_select at 0x7fbb2e173ca0>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:15:42.139861 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-c7de78da-5c3b-44fb-9077-7416933e44e0 tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] [instance: 04f92b56-d51e-40fe-8641-b32e64cf3801] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:15:42.148496 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c7de78da-5c3b-44fb-9077-7416933e44e0 tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:42.149518 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c7de78da-5c3b-44fb-9077-7416933e44e0 tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:42.150682 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c7de78da-5c3b-44fb-9077-7416933e44e0 tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:42.151617 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c7de78da-5c3b-44fb-9077-7416933e44e0 tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:42.152296 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c7de78da-5c3b-44fb-9077-7416933e44e0 tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:42.152914 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c7de78da-5c3b-44fb-9077-7416933e44e0 tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:42.215056 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-c7de78da-5c3b-44fb-9077-7416933e44e0 tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] 10.222.0.43 "GET /compute/v2.1/servers/04f92b56-d51e-40fe-8641-b32e64cf3801/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.092413 Oct 04 22:15:42.216196 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2834/5602] 10.222.0.43 () {58 vars in 1296 bytes} [Tue Oct 4 22:15:42 2022] GET /compute/v2.1/servers/04f92b56-d51e-40fe-8641-b32e64cf3801/os-instance-actions => generated 611 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:15:42.231575 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e9bc8d7d-5352-42f4-91bc-5080a7d2a169 tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:15:42.232100 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-e9bc8d7d-5352-42f4-91bc-5080a7d2a169 tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] [instance: 04f92b56-d51e-40fe-8641-b32e64cf3801] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:15:42.242161 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e9bc8d7d-5352-42f4-91bc-5080a7d2a169 tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:42.242707 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e9bc8d7d-5352-42f4-91bc-5080a7d2a169 tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:42.248332 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e9bc8d7d-5352-42f4-91bc-5080a7d2a169 tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:42.249314 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e9bc8d7d-5352-42f4-91bc-5080a7d2a169 tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:42.249810 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e9bc8d7d-5352-42f4-91bc-5080a7d2a169 tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:42.253232 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e9bc8d7d-5352-42f4-91bc-5080a7d2a169 tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:42.340105 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-e9bc8d7d-5352-42f4-91bc-5080a7d2a169 tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] [instance: 04f92b56-d51e-40fe-8641-b32e64cf3801] Going to try to terminate instance {{(pid=134101) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 22:15:42.588806 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-e9bc8d7d-5352-42f4-91bc-5080a7d2a169 tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] 10.222.0.43 "DELETE /compute/v2.1/servers/04f92b56-d51e-40fe-8641-b32e64cf3801" status: 204 len: 0 microversion: 2.1 time: 0.362914 Oct 04 22:15:42.590633 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2769/5603] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 22:15:42 2022] DELETE /compute/v2.1/servers/04f92b56-d51e-40fe-8641-b32e64cf3801 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 22:15:42.598821 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-00ca76ed-7641-4d6a-96c5-d2733f244172 tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:15:42.599707 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-00ca76ed-7641-4d6a-96c5-d2733f244172 tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] [instance: 04f92b56-d51e-40fe-8641-b32e64cf3801] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:15:42.613106 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-00ca76ed-7641-4d6a-96c5-d2733f244172 tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:42.613522 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-00ca76ed-7641-4d6a-96c5-d2733f244172 tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:42.613969 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-00ca76ed-7641-4d6a-96c5-d2733f244172 tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:42.614751 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-00ca76ed-7641-4d6a-96c5-d2733f244172 tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:42.615238 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-00ca76ed-7641-4d6a-96c5-d2733f244172 tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:42.615830 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-00ca76ed-7641-4d6a-96c5-d2733f244172 tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:43.055060 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-00ca76ed-7641-4d6a-96c5-d2733f244172 tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb8470580ebd429e8408b75ac845bf2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e4459c8264f4becb89cc035c9269e7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:15:43.077400 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-00ca76ed-7641-4d6a-96c5-d2733f244172 tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] 10.222.0.43 "GET /compute/v2.1/servers/04f92b56-d51e-40fe-8641-b32e64cf3801" status: 200 len: 1512 microversion: 2.1 time: 0.476520 Oct 04 22:15:43.082129 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2835/5604] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:15:42 2022] GET /compute/v2.1/servers/04f92b56-d51e-40fe-8641-b32e64cf3801 => generated 1512 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:15:44.103322 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-8161d649-071a-4414-93e1-86f3df163639 tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:15:44.104041 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-8161d649-071a-4414-93e1-86f3df163639 tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] [instance: 04f92b56-d51e-40fe-8641-b32e64cf3801] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:15:44.139779 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8161d649-071a-4414-93e1-86f3df163639 tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:44.140434 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8161d649-071a-4414-93e1-86f3df163639 tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:44.140899 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8161d649-071a-4414-93e1-86f3df163639 tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:44.141645 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8161d649-071a-4414-93e1-86f3df163639 tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:44.142109 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8161d649-071a-4414-93e1-86f3df163639 tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:44.142578 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8161d649-071a-4414-93e1-86f3df163639 tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:44.806603 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-8161d649-071a-4414-93e1-86f3df163639 tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb8470580ebd429e8408b75ac845bf2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e4459c8264f4becb89cc035c9269e7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:15:44.819387 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-8161d649-071a-4414-93e1-86f3df163639 tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] 10.222.0.43 "GET /compute/v2.1/servers/04f92b56-d51e-40fe-8641-b32e64cf3801" status: 200 len: 1512 microversion: 2.1 time: 0.721473 Oct 04 22:15:44.820011 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2770/5605] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:15:44 2022] GET /compute/v2.1/servers/04f92b56-d51e-40fe-8641-b32e64cf3801 => generated 1512 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:15:45.847853 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-4eb9f5a9-908c-406c-a3d3-a9d4712c58cf tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:15:45.848602 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-4eb9f5a9-908c-406c-a3d3-a9d4712c58cf tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] [instance: 04f92b56-d51e-40fe-8641-b32e64cf3801] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:15:45.857480 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:15:45.877966 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4eb9f5a9-908c-406c-a3d3-a9d4712c58cf tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:45.878742 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4eb9f5a9-908c-406c-a3d3-a9d4712c58cf tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:45.879212 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4eb9f5a9-908c-406c-a3d3-a9d4712c58cf tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:45.882972 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4eb9f5a9-908c-406c-a3d3-a9d4712c58cf tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:45.883555 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4eb9f5a9-908c-406c-a3d3-a9d4712c58cf tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:45.884051 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4eb9f5a9-908c-406c-a3d3-a9d4712c58cf tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:46.316393 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-4eb9f5a9-908c-406c-a3d3-a9d4712c58cf tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb8470580ebd429e8408b75ac845bf2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e4459c8264f4becb89cc035c9269e7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:15:46.328318 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-4eb9f5a9-908c-406c-a3d3-a9d4712c58cf tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] 10.222.0.43 "GET /compute/v2.1/servers/04f92b56-d51e-40fe-8641-b32e64cf3801" status: 200 len: 1512 microversion: 2.1 time: 0.484627 Oct 04 22:15:46.329544 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2836/5606] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:15:45 2022] GET /compute/v2.1/servers/04f92b56-d51e-40fe-8641-b32e64cf3801 => generated 1512 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:15:46.741701 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-7d4c2bb0-beaf-42ce-8687-0e67e0d4790c req-f05b8898-4905-4d83-b1e9-1f682a08ba9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04f92b56-d51e-40fe-8641-b32e64cf3801", "name": "network-vif-deleted", "tag": "b7412dee-c31a-4df6-9e89-fa8bbd74f637"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:15:46.784473 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-7d4c2bb0-beaf-42ce-8687-0e67e0d4790c req-f05b8898-4905-4d83-b1e9-1f682a08ba9f service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:46.785287 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-7d4c2bb0-beaf-42ce-8687-0e67e0d4790c req-f05b8898-4905-4d83-b1e9-1f682a08ba9f service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:46.787056 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-7d4c2bb0-beaf-42ce-8687-0e67e0d4790c req-f05b8898-4905-4d83-b1e9-1f682a08ba9f service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:46.845227 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-7d4c2bb0-beaf-42ce-8687-0e67e0d4790c req-f05b8898-4905-4d83-b1e9-1f682a08ba9f service nova] Creating event network-vif-deleted:b7412dee-c31a-4df6-9e89-fa8bbd74f637 for instance 04f92b56-d51e-40fe-8641-b32e64cf3801 on n-h2-860284-1 Oct 04 22:15:46.864468 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-7d4c2bb0-beaf-42ce-8687-0e67e0d4790c req-f05b8898-4905-4d83-b1e9-1f682a08ba9f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128515 Oct 04 22:15:46.866108 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2771/5607] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:15:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:15:47.358790 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-dde265ed-7d51-43ec-93c4-ce5419c34709 tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:15:47.360048 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-dde265ed-7d51-43ec-93c4-ce5419c34709 tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] [instance: 04f92b56-d51e-40fe-8641-b32e64cf3801] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:15:47.377746 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dde265ed-7d51-43ec-93c4-ce5419c34709 tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:47.382684 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dde265ed-7d51-43ec-93c4-ce5419c34709 tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:47.386928 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dde265ed-7d51-43ec-93c4-ce5419c34709 tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:47.390199 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dde265ed-7d51-43ec-93c4-ce5419c34709 tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:47.390869 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dde265ed-7d51-43ec-93c4-ce5419c34709 tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:47.397242 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dde265ed-7d51-43ec-93c4-ce5419c34709 tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:47.491155 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dde265ed-7d51-43ec-93c4-ce5419c34709 tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:47.492176 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dde265ed-7d51-43ec-93c4-ce5419c34709 tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:47.492779 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dde265ed-7d51-43ec-93c4-ce5419c34709 tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:47.494224 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.objects.instance [None req-dde265ed-7d51-43ec-93c4-ce5419c34709 tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Lazy-loading 'fault' on Instance uuid 04f92b56-d51e-40fe-8641-b32e64cf3801 {{(pid=134102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 22:15:47.799948 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-dde265ed-7d51-43ec-93c4-ce5419c34709 tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb8470580ebd429e8408b75ac845bf2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e4459c8264f4becb89cc035c9269e7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:15:47.818556 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-dde265ed-7d51-43ec-93c4-ce5419c34709 tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] 10.222.0.43 "GET /compute/v2.1/servers/04f92b56-d51e-40fe-8641-b32e64cf3801" status: 200 len: 1307 microversion: 2.1 time: 0.465688 Oct 04 22:15:47.819385 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2837/5608] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:15:47 2022] GET /compute/v2.1/servers/04f92b56-d51e-40fe-8641-b32e64cf3801 => generated 1307 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:15:48.843822 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-43b39689-7ae4-4d4e-90fd-ec3419576f99 tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:15:48.848780 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-43b39689-7ae4-4d4e-90fd-ec3419576f99 tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] [instance: 04f92b56-d51e-40fe-8641-b32e64cf3801] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:15:48.864115 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=46,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:15:48.869725 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-43b39689-7ae4-4d4e-90fd-ec3419576f99 tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:48.870552 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-43b39689-7ae4-4d4e-90fd-ec3419576f99 tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:48.874320 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-43b39689-7ae4-4d4e-90fd-ec3419576f99 tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:48.875838 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-43b39689-7ae4-4d4e-90fd-ec3419576f99 tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:48.876487 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-43b39689-7ae4-4d4e-90fd-ec3419576f99 tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:48.877114 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-43b39689-7ae4-4d4e-90fd-ec3419576f99 tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:48.926353 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-43b39689-7ae4-4d4e-90fd-ec3419576f99 tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] HTTP exception thrown: Instance 04f92b56-d51e-40fe-8641-b32e64cf3801 could not be found. Oct 04 22:15:48.928572 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-43b39689-7ae4-4d4e-90fd-ec3419576f99 tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Request method failure captured: Oct 04 22:15:48.928572 n-d-860284-1 devstack@n-api.service[134101]: request: GET /compute/v2.1/servers/04f92b56-d51e-40fe-8641-b32e64cf3801 HTTP/1.1 Oct 04 22:15:48.928572 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 22:15:48.928572 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 22:15:48.928572 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 22:15:48.928572 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 22:15:48.928572 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 22:15:48.928572 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 22:15:48.928572 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 22:15:48.928572 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 22:15:48.928572 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPLB2QqsT7SW5wEiA8SbQX576rlsMw1lWcrCrfp7beKeE8xZZgvuz_y0r6cqwkGtwaaAGtC1B6ddiwXO4SbrRaF56np8FdWP7hTSJV1apWcy18IFwAusVlmP5aqVE0kU4MpiqFECurE_CtL3lHCwNBKanWM8Qhvai7G11unOCPFSEawk Oct 04 22:15:48.928572 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 22:15:48.928572 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 22:15:48.928572 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 22:15:48.928572 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 22:15:48.928572 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 22:15:48.928572 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 22:15:48.928572 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: 5e4459c8264f4becb89cc035c9269e7f Oct 04 22:15:48.928572 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-InstanceActionsTestJSON-815490502 Oct 04 22:15:48.928572 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 22:15:48.928572 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 22:15:48.928572 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5e4459c8264f4becb89cc035c9269e7f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_5e4459c8264f4becb89cc035c9269e7f", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5e4459c8264f4becb89cc035c9269e7f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/5e4459c8264f4becb89cc035c9269e7f"}]}] Oct 04 22:15:48.928572 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-InstanceActionsTestJSON-815490502 Oct 04 22:15:48.928572 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: 5e4459c8264f4becb89cc035c9269e7f Oct 04 22:15:48.928572 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-InstanceActionsTestJSON-815490502 Oct 04 22:15:48.928572 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-InstanceActionsTestJSON-815490502-project Oct 04 22:15:48.928572 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 22:15:48.928572 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 22:15:48.928572 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: cb8470580ebd429e8408b75ac845bf2a Oct 04 22:15:48.928572 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-InstanceActionsTestJSON-815490502-project Oct 04 22:15:48.928572 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 22:15:48.928572 n-d-860284-1 devstack@n-api.service[134101]: exception: Instance 04f92b56-d51e-40fe-8641-b32e64cf3801 could not be found. Oct 04 22:15:48.928572 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': '04f92b56-d51e-40fe-8641-b32e64cf3801'} Oct 04 22:15:48.928572 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:15:48.928572 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:15:48.928572 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:15:48.928572 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:15:48.928572 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:15:48.928572 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:15:48.928572 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:15:48.928572 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:15:48.928572 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:15:48.928572 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:15:48.928572 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04f92b56-d51e-40fe-8641-b32e64cf3801 could not be found. Oct 04 22:15:48.928572 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:15:48.928572 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:15:48.928572 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:15:48.928572 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:15:48.928572 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:15:48.928572 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:15:48.928572 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:15:48.928572 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:15:48.928572 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:15:48.928572 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:15:48.928572 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:15:48.928572 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:15:48.928572 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:15:48.928572 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:15:48.928572 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:15:48.928572 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:15:48.928572 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04f92b56-d51e-40fe-8641-b32e64cf3801 could not be found. Oct 04 22:15:48.928572 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:15:48.928572 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:15:48.928572 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:15:48.933655 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:15:48.933655 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:15:48.933655 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:15:48.933655 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:15:48.933655 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:15:48.933655 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04f92b56-d51e-40fe-8641-b32e64cf3801 could not be found. Oct 04 22:15:48.933655 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:15:48.935589 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-43b39689-7ae4-4d4e-90fd-ec3419576f99 tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] Returning 404 to user: Instance 04f92b56-d51e-40fe-8641-b32e64cf3801 could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:15:48.936648 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-43b39689-7ae4-4d4e-90fd-ec3419576f99 tempest-InstanceActionsTestJSON-815490502 tempest-InstanceActionsTestJSON-815490502-project] 10.222.0.43 "GET /compute/v2.1/servers/04f92b56-d51e-40fe-8641-b32e64cf3801" status: 404 len: 111 microversion: 2.1 time: 0.097416 Oct 04 22:15:48.937409 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2772/5609] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:15:48 2022] GET /compute/v2.1/servers/04f92b56-d51e-40fe-8641-b32e64cf3801 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:15:55.211148 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-4ba84e5b-c03e-43bb-b9d7-2d1cf428bad8 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-815646915", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:15:55.368825 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.network.neutron [None req-4ba84e5b-c03e-43bb-b9d7-2d1cf428bad8 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] validate_networks() for [('27e021c6-6679-48e6-a567-0998c0d4ad3a', None, None, None, None, None)] {{(pid=134102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 22:15:57.797905 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-4ba84e5b-c03e-43bb-b9d7-2d1cf428bad8 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Flavor limits 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 22:15:57.799649 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-4ba84e5b-c03e-43bb-b9d7-2d1cf428bad8 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Image limits 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 22:15:57.800360 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-4ba84e5b-c03e-43bb-b9d7-2d1cf428bad8 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Flavor pref 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 22:15:57.807282 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-4ba84e5b-c03e-43bb-b9d7-2d1cf428bad8 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Image pref 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 22:15:57.808752 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-4ba84e5b-c03e-43bb-b9d7-2d1cf428bad8 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 22:15:57.814762 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=39 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:15:57.833993 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4ba84e5b-c03e-43bb-b9d7-2d1cf428bad8 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:57.835195 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4ba84e5b-c03e-43bb-b9d7-2d1cf428bad8 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:57.836175 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4ba84e5b-c03e-43bb-b9d7-2d1cf428bad8 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:57.838146 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4ba84e5b-c03e-43bb-b9d7-2d1cf428bad8 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:57.844181 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4ba84e5b-c03e-43bb-b9d7-2d1cf428bad8 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:57.848511 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4ba84e5b-c03e-43bb-b9d7-2d1cf428bad8 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:57.913931 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-4ba84e5b-c03e-43bb-b9d7-2d1cf428bad8 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Getting quotas for project 6b2140f8775f4a7495c0f026b4b810b3. Resources: {'instances', 'ram', 'cores'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:15:57.927736 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-4ba84e5b-c03e-43bb-b9d7-2d1cf428bad8 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Getting quotas for user c99b5f2cd0a343bc81ca0005f2a74591 and project 6b2140f8775f4a7495c0f026b4b810b3. Resources: {'instances', 'ram', 'cores'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:15:57.964947 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-4ba84e5b-c03e-43bb-b9d7-2d1cf428bad8 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Going to run 1 instances... {{(pid=134102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 22:15:57.969476 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-4ba84e5b-c03e-43bb-b9d7-2d1cf428bad8 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] [instance: ee3587af-87cb-4a36-98ed-5a5c81eb6f69] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='58548514-5dac-426c-81f5-19e3fba33e23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 22:15:58.112303 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-4ba84e5b-c03e-43bb-b9d7-2d1cf428bad8 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.271055 Oct 04 22:15:58.115528 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2838/5610] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 22:15:54 2022] POST /compute/v2.1/servers => generated 383 bytes in 3276 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 22:15:58.128516 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-8cbaa79d-ad98-4d88-b139-0e6490377ceb tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:15:58.129295 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-8cbaa79d-ad98-4d88-b139-0e6490377ceb tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] [instance: ee3587af-87cb-4a36-98ed-5a5c81eb6f69] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:15:58.500400 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-8cbaa79d-ad98-4d88-b139-0e6490377ceb tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99b5f2cd0a343bc81ca0005f2a74591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2140f8775f4a7495c0f026b4b810b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:15:58.508487 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-8cbaa79d-ad98-4d88-b139-0e6490377ceb tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] 10.222.0.43 "GET /compute/v2.1/servers/ee3587af-87cb-4a36-98ed-5a5c81eb6f69" status: 200 len: 1222 microversion: 2.1 time: 0.385370 Oct 04 22:15:58.527077 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2773/5611] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:15:58 2022] GET /compute/v2.1/servers/ee3587af-87cb-4a36-98ed-5a5c81eb6f69 => generated 1222 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:15:59.535797 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-4b3f6819-1b8c-4be4-a473-a16ede7ab334 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:15:59.538563 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-4b3f6819-1b8c-4be4-a473-a16ede7ab334 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] [instance: ee3587af-87cb-4a36-98ed-5a5c81eb6f69] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:15:59.550522 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4b3f6819-1b8c-4be4-a473-a16ede7ab334 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:59.552173 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4b3f6819-1b8c-4be4-a473-a16ede7ab334 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:59.552935 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4b3f6819-1b8c-4be4-a473-a16ede7ab334 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:59.554238 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4b3f6819-1b8c-4be4-a473-a16ede7ab334 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:59.555189 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4b3f6819-1b8c-4be4-a473-a16ede7ab334 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:59.557369 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4b3f6819-1b8c-4be4-a473-a16ede7ab334 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:59.709700 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-4b3f6819-1b8c-4be4-a473-a16ede7ab334 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99b5f2cd0a343bc81ca0005f2a74591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2140f8775f4a7495c0f026b4b810b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:15:59.720918 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-4b3f6819-1b8c-4be4-a473-a16ede7ab334 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] 10.222.0.43 "GET /compute/v2.1/servers/ee3587af-87cb-4a36-98ed-5a5c81eb6f69" status: 200 len: 1226 microversion: 2.1 time: 0.189290 Oct 04 22:15:59.739712 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2839/5612] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:15:59 2022] GET /compute/v2.1/servers/ee3587af-87cb-4a36-98ed-5a5c81eb6f69 => generated 1226 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:16:00.756253 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-5b739755-4767-462e-af5a-4f835d82dd46 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:16:00.757533 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-5b739755-4767-462e-af5a-4f835d82dd46 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] [instance: ee3587af-87cb-4a36-98ed-5a5c81eb6f69] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:16:00.796882 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:16:00.815901 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5b739755-4767-462e-af5a-4f835d82dd46 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:00.820729 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5b739755-4767-462e-af5a-4f835d82dd46 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:00.822141 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5b739755-4767-462e-af5a-4f835d82dd46 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:00.825979 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5b739755-4767-462e-af5a-4f835d82dd46 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:00.826509 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5b739755-4767-462e-af5a-4f835d82dd46 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:00.826957 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5b739755-4767-462e-af5a-4f835d82dd46 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:00.972742 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-5b739755-4767-462e-af5a-4f835d82dd46 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99b5f2cd0a343bc81ca0005f2a74591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2140f8775f4a7495c0f026b4b810b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:16:00.985330 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-5b739755-4767-462e-af5a-4f835d82dd46 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] 10.222.0.43 "GET /compute/v2.1/servers/ee3587af-87cb-4a36-98ed-5a5c81eb6f69" status: 200 len: 1292 microversion: 2.1 time: 0.236921 Oct 04 22:16:00.986062 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2774/5613] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:16:00 2022] GET /compute/v2.1/servers/ee3587af-87cb-4a36-98ed-5a5c81eb6f69 => generated 1292 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:16:02.013188 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-cb8f69f5-4d6a-4c0e-9ee3-1d7699e653d8 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:16:02.013658 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-cb8f69f5-4d6a-4c0e-9ee3-1d7699e653d8 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] [instance: ee3587af-87cb-4a36-98ed-5a5c81eb6f69] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:16:02.022684 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cb8f69f5-4d6a-4c0e-9ee3-1d7699e653d8 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:02.023487 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cb8f69f5-4d6a-4c0e-9ee3-1d7699e653d8 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:02.028281 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cb8f69f5-4d6a-4c0e-9ee3-1d7699e653d8 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:02.031853 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cb8f69f5-4d6a-4c0e-9ee3-1d7699e653d8 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:02.032475 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cb8f69f5-4d6a-4c0e-9ee3-1d7699e653d8 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:02.033015 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cb8f69f5-4d6a-4c0e-9ee3-1d7699e653d8 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:02.168975 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-cb8f69f5-4d6a-4c0e-9ee3-1d7699e653d8 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99b5f2cd0a343bc81ca0005f2a74591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2140f8775f4a7495c0f026b4b810b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:16:02.179384 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-cb8f69f5-4d6a-4c0e-9ee3-1d7699e653d8 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] 10.222.0.43 "GET /compute/v2.1/servers/ee3587af-87cb-4a36-98ed-5a5c81eb6f69" status: 200 len: 1280 microversion: 2.1 time: 0.169829 Oct 04 22:16:02.188592 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2840/5614] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:16:02 2022] GET /compute/v2.1/servers/ee3587af-87cb-4a36-98ed-5a5c81eb6f69 => generated 1280 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:16:03.205830 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-5cdec00e-083a-4645-940b-f973eae59559 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:16:03.207237 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-5cdec00e-083a-4645-940b-f973eae59559 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] [instance: ee3587af-87cb-4a36-98ed-5a5c81eb6f69] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:16:03.230845 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5cdec00e-083a-4645-940b-f973eae59559 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:03.231200 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5cdec00e-083a-4645-940b-f973eae59559 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:03.231647 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5cdec00e-083a-4645-940b-f973eae59559 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:03.232542 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5cdec00e-083a-4645-940b-f973eae59559 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:03.232801 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5cdec00e-083a-4645-940b-f973eae59559 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:03.233226 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5cdec00e-083a-4645-940b-f973eae59559 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:03.469386 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-5cdec00e-083a-4645-940b-f973eae59559 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99b5f2cd0a343bc81ca0005f2a74591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2140f8775f4a7495c0f026b4b810b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:16:03.483012 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-5cdec00e-083a-4645-940b-f973eae59559 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] 10.222.0.43 "GET /compute/v2.1/servers/ee3587af-87cb-4a36-98ed-5a5c81eb6f69" status: 200 len: 1280 microversion: 2.1 time: 0.281830 Oct 04 22:16:03.484216 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2775/5615] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:16:03 2022] GET /compute/v2.1/servers/ee3587af-87cb-4a36-98ed-5a5c81eb6f69 => generated 1280 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:16:04.509424 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-ca093377-4f84-49ed-9014-847ba0420be8 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:16:04.510032 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-ca093377-4f84-49ed-9014-847ba0420be8 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] [instance: ee3587af-87cb-4a36-98ed-5a5c81eb6f69] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:16:04.529868 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ca093377-4f84-49ed-9014-847ba0420be8 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:04.530381 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ca093377-4f84-49ed-9014-847ba0420be8 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:04.530824 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ca093377-4f84-49ed-9014-847ba0420be8 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:04.531545 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ca093377-4f84-49ed-9014-847ba0420be8 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:04.531991 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ca093377-4f84-49ed-9014-847ba0420be8 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:04.532414 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ca093377-4f84-49ed-9014-847ba0420be8 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:04.845565 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-7e980157-128d-4b6d-993d-440aa333c414 tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:16:04.846718 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-7e980157-128d-4b6d-993d-440aa333c414 tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] [instance: 1346709b-155a-4048-86ca-f1b08c9d5710] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:16:04.860710 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7e980157-128d-4b6d-993d-440aa333c414 tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:04.861181 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7e980157-128d-4b6d-993d-440aa333c414 tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:04.861624 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7e980157-128d-4b6d-993d-440aa333c414 tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:04.862356 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7e980157-128d-4b6d-993d-440aa333c414 tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:04.862817 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7e980157-128d-4b6d-993d-440aa333c414 tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:04.863430 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7e980157-128d-4b6d-993d-440aa333c414 tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:05.020679 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.objects.instance [None req-7e980157-128d-4b6d-993d-440aa333c414 tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] Lazy-loading 'services' on Instance uuid 1346709b-155a-4048-86ca-f1b08c9d5710 {{(pid=134101) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 22:16:05.139459 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-7e980157-128d-4b6d-993d-440aa333c414 tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] 10.222.0.43 "DELETE /compute/v2.1/servers/1346709b-155a-4048-86ca-f1b08c9d5710/os-volume_attachments/a1bedfde-d013-489c-a643-59e9805f0fdd" status: 202 len: 0 microversion: 2.1 time: 0.297776 Oct 04 22:16:05.140805 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2776/5616] 10.222.0.43 () {58 vars in 1416 bytes} [Tue Oct 4 22:16:04 2022] DELETE /compute/v2.1/servers/1346709b-155a-4048-86ca-f1b08c9d5710/os-volume_attachments/a1bedfde-d013-489c-a643-59e9805f0fdd => generated 0 bytes in 300 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 22:16:05.155944 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-ca093377-4f84-49ed-9014-847ba0420be8 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99b5f2cd0a343bc81ca0005f2a74591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2140f8775f4a7495c0f026b4b810b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:16:05.166074 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-ca093377-4f84-49ed-9014-847ba0420be8 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] 10.222.0.43 "GET /compute/v2.1/servers/ee3587af-87cb-4a36-98ed-5a5c81eb6f69" status: 200 len: 1322 microversion: 2.1 time: 0.660364 Oct 04 22:16:05.173600 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2841/5617] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:16:04 2022] GET /compute/v2.1/servers/ee3587af-87cb-4a36-98ed-5a5c81eb6f69 => generated 1322 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:16:06.198552 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-81ed52a0-a591-4a02-a44d-cd25976205ae tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:16:06.199176 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-81ed52a0-a591-4a02-a44d-cd25976205ae tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] [instance: ee3587af-87cb-4a36-98ed-5a5c81eb6f69] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:16:06.219263 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-81ed52a0-a591-4a02-a44d-cd25976205ae tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:06.219792 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-81ed52a0-a591-4a02-a44d-cd25976205ae tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:06.220240 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-81ed52a0-a591-4a02-a44d-cd25976205ae tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:06.225696 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-81ed52a0-a591-4a02-a44d-cd25976205ae tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:06.227719 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-81ed52a0-a591-4a02-a44d-cd25976205ae tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:06.228419 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-81ed52a0-a591-4a02-a44d-cd25976205ae tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:06.851662 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-81ed52a0-a591-4a02-a44d-cd25976205ae tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99b5f2cd0a343bc81ca0005f2a74591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2140f8775f4a7495c0f026b4b810b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:16:06.892178 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-81ed52a0-a591-4a02-a44d-cd25976205ae tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] 10.222.0.43 "GET /compute/v2.1/servers/ee3587af-87cb-4a36-98ed-5a5c81eb6f69" status: 200 len: 1322 microversion: 2.1 time: 0.680392 Oct 04 22:16:06.906393 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2777/5618] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:16:06 2022] GET /compute/v2.1/servers/ee3587af-87cb-4a36-98ed-5a5c81eb6f69 => generated 1322 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:16:06.953516 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-9dba0fa0-53fb-48c1-aafe-27ba0c73cacd req-1c33cfb9-1ccb-4c8e-81f2-401601f5d0a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee3587af-87cb-4a36-98ed-5a5c81eb6f69", "tag": "22225028-5a17-4dd6-9593-448f6f20fd77"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:16:06.973548 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-9dba0fa0-53fb-48c1-aafe-27ba0c73cacd req-1c33cfb9-1ccb-4c8e-81f2-401601f5d0a8 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:06.974400 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-9dba0fa0-53fb-48c1-aafe-27ba0c73cacd req-1c33cfb9-1ccb-4c8e-81f2-401601f5d0a8 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:06.975132 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-9dba0fa0-53fb-48c1-aafe-27ba0c73cacd req-1c33cfb9-1ccb-4c8e-81f2-401601f5d0a8 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:06.990153 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-9dba0fa0-53fb-48c1-aafe-27ba0c73cacd req-1c33cfb9-1ccb-4c8e-81f2-401601f5d0a8 service nova] Creating event network-changed:22225028-5a17-4dd6-9593-448f6f20fd77 for instance ee3587af-87cb-4a36-98ed-5a5c81eb6f69 on n-h2-860284-1 Oct 04 22:16:06.996692 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-9dba0fa0-53fb-48c1-aafe-27ba0c73cacd req-1c33cfb9-1ccb-4c8e-81f2-401601f5d0a8 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047218 Oct 04 22:16:06.997980 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2842/5619] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:16:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:16:07.931007 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-ed28ede4-71bd-497e-98cf-d59e94526841 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:16:07.934390 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-ed28ede4-71bd-497e-98cf-d59e94526841 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] [instance: ee3587af-87cb-4a36-98ed-5a5c81eb6f69] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:16:07.960728 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ed28ede4-71bd-497e-98cf-d59e94526841 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:07.961271 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ed28ede4-71bd-497e-98cf-d59e94526841 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:07.965200 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ed28ede4-71bd-497e-98cf-d59e94526841 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:07.966057 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ed28ede4-71bd-497e-98cf-d59e94526841 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:07.966589 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ed28ede4-71bd-497e-98cf-d59e94526841 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:07.967036 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ed28ede4-71bd-497e-98cf-d59e94526841 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:08.509566 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=2 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:16:08.829931 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-ed28ede4-71bd-497e-98cf-d59e94526841 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99b5f2cd0a343bc81ca0005f2a74591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2140f8775f4a7495c0f026b4b810b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:16:08.839161 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-ed28ede4-71bd-497e-98cf-d59e94526841 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] 10.222.0.43 "GET /compute/v2.1/servers/ee3587af-87cb-4a36-98ed-5a5c81eb6f69" status: 200 len: 1322 microversion: 2.1 time: 0.924863 Oct 04 22:16:08.844994 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2778/5620] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:16:07 2022] GET /compute/v2.1/servers/ee3587af-87cb-4a36-98ed-5a5c81eb6f69 => generated 1322 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:16:09.869127 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-ffd2133f-c0a8-42b9-91f1-6f71f2a0f954 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:16:09.870301 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-ffd2133f-c0a8-42b9-91f1-6f71f2a0f954 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] [instance: ee3587af-87cb-4a36-98ed-5a5c81eb6f69] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:16:09.881429 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell0:SELECT=2 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:16:09.883258 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell0:SELECT=6 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:16:09.888485 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ffd2133f-c0a8-42b9-91f1-6f71f2a0f954 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:09.889500 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ffd2133f-c0a8-42b9-91f1-6f71f2a0f954 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:09.890146 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ffd2133f-c0a8-42b9-91f1-6f71f2a0f954 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:09.891206 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ffd2133f-c0a8-42b9-91f1-6f71f2a0f954 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:09.891971 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ffd2133f-c0a8-42b9-91f1-6f71f2a0f954 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:09.892662 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ffd2133f-c0a8-42b9-91f1-6f71f2a0f954 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:10.579530 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-ffd2133f-c0a8-42b9-91f1-6f71f2a0f954 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99b5f2cd0a343bc81ca0005f2a74591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2140f8775f4a7495c0f026b4b810b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:16:10.618122 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-ffd2133f-c0a8-42b9-91f1-6f71f2a0f954 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] 10.222.0.43 "GET /compute/v2.1/servers/ee3587af-87cb-4a36-98ed-5a5c81eb6f69" status: 200 len: 1322 microversion: 2.1 time: 0.755142 Oct 04 22:16:10.623471 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2843/5621] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:16:09 2022] GET /compute/v2.1/servers/ee3587af-87cb-4a36-98ed-5a5c81eb6f69 => generated 1322 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:16:11.651548 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-c13c635a-a281-4db3-9e49-871de5afdf4f tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:16:11.652105 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-c13c635a-a281-4db3-9e49-871de5afdf4f tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] [instance: ee3587af-87cb-4a36-98ed-5a5c81eb6f69] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:16:11.670428 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c13c635a-a281-4db3-9e49-871de5afdf4f tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:11.671258 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c13c635a-a281-4db3-9e49-871de5afdf4f tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:11.683303 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c13c635a-a281-4db3-9e49-871de5afdf4f tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:11.684222 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c13c635a-a281-4db3-9e49-871de5afdf4f tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:11.684770 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c13c635a-a281-4db3-9e49-871de5afdf4f tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:11.685542 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c13c635a-a281-4db3-9e49-871de5afdf4f tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:12.256532 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-c13c635a-a281-4db3-9e49-871de5afdf4f tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99b5f2cd0a343bc81ca0005f2a74591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2140f8775f4a7495c0f026b4b810b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:16:12.271092 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-c13c635a-a281-4db3-9e49-871de5afdf4f tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] 10.222.0.43 "GET /compute/v2.1/servers/ee3587af-87cb-4a36-98ed-5a5c81eb6f69" status: 200 len: 1322 microversion: 2.1 time: 0.624832 Oct 04 22:16:12.272401 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2779/5622] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:16:11 2022] GET /compute/v2.1/servers/ee3587af-87cb-4a36-98ed-5a5c81eb6f69 => generated 1322 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:16:13.306737 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-ccff514c-4366-4aa8-913a-cc63782f025a tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:16:13.308073 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-ccff514c-4366-4aa8-913a-cc63782f025a tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] [instance: ee3587af-87cb-4a36-98ed-5a5c81eb6f69] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:16:13.325731 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ccff514c-4366-4aa8-913a-cc63782f025a tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:13.326533 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ccff514c-4366-4aa8-913a-cc63782f025a tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:13.328868 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ccff514c-4366-4aa8-913a-cc63782f025a tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:13.330436 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ccff514c-4366-4aa8-913a-cc63782f025a tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:13.332910 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ccff514c-4366-4aa8-913a-cc63782f025a tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:13.334647 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ccff514c-4366-4aa8-913a-cc63782f025a tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:14.152330 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-ff42bb87-1618-4fd0-987d-8428de2512da tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:16:14.152885 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-ff42bb87-1618-4fd0-987d-8428de2512da tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] [instance: 1346709b-155a-4048-86ca-f1b08c9d5710] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:16:14.168685 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ff42bb87-1618-4fd0-987d-8428de2512da tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:14.169114 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ff42bb87-1618-4fd0-987d-8428de2512da tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:14.172217 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ff42bb87-1618-4fd0-987d-8428de2512da tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:14.177154 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ff42bb87-1618-4fd0-987d-8428de2512da tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:14.177743 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ff42bb87-1618-4fd0-987d-8428de2512da tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:14.178201 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ff42bb87-1618-4fd0-987d-8428de2512da tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:14.264604 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-ff42bb87-1618-4fd0-987d-8428de2512da tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] [instance: 1346709b-155a-4048-86ca-f1b08c9d5710] Going to try to terminate instance {{(pid=134101) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 22:16:14.394773 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-ccff514c-4366-4aa8-913a-cc63782f025a tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99b5f2cd0a343bc81ca0005f2a74591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2140f8775f4a7495c0f026b4b810b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:16:14.421021 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-ff42bb87-1618-4fd0-987d-8428de2512da tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] 10.222.0.43 "DELETE /compute/v2.1/servers/1346709b-155a-4048-86ca-f1b08c9d5710" status: 204 len: 0 microversion: 2.1 time: 0.272666 Oct 04 22:16:14.422263 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2780/5623] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 22:16:14 2022] DELETE /compute/v2.1/servers/1346709b-155a-4048-86ca-f1b08c9d5710 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 22:16:14.425674 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-ccff514c-4366-4aa8-913a-cc63782f025a tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] 10.222.0.43 "GET /compute/v2.1/servers/ee3587af-87cb-4a36-98ed-5a5c81eb6f69" status: 200 len: 1322 microversion: 2.1 time: 1.105141 Oct 04 22:16:14.432634 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2844/5624] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:16:13 2022] GET /compute/v2.1/servers/ee3587af-87cb-4a36-98ed-5a5c81eb6f69 => generated 1322 bytes in 1133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:16:14.442132 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-c931cbba-2f43-4436-9296-902526f3598a tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:16:14.443136 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-c931cbba-2f43-4436-9296-902526f3598a tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] [instance: 1346709b-155a-4048-86ca-f1b08c9d5710] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:16:14.452539 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c931cbba-2f43-4436-9296-902526f3598a tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:14.453304 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c931cbba-2f43-4436-9296-902526f3598a tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:14.454071 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c931cbba-2f43-4436-9296-902526f3598a tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:14.454975 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c931cbba-2f43-4436-9296-902526f3598a tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:14.455693 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c931cbba-2f43-4436-9296-902526f3598a tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:14.456316 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c931cbba-2f43-4436-9296-902526f3598a tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:14.784421 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-c931cbba-2f43-4436-9296-902526f3598a tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ba7c8167fd40e6878f7f2af9fa869c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc18681ca2974a54a172cbc727158883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:16:14.796396 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-c931cbba-2f43-4436-9296-902526f3598a tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] 10.222.0.43 "GET /compute/v2.1/servers/1346709b-155a-4048-86ca-f1b08c9d5710" status: 200 len: 1469 microversion: 2.1 time: 0.368411 Oct 04 22:16:14.811263 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2781/5625] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:16:14 2022] GET /compute/v2.1/servers/1346709b-155a-4048-86ca-f1b08c9d5710 => generated 1469 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:16:15.471128 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-d19d249c-61bd-4bf6-96fd-7ee2461017ee tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:16:15.472662 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-d19d249c-61bd-4bf6-96fd-7ee2461017ee tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] [instance: ee3587af-87cb-4a36-98ed-5a5c81eb6f69] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:16:15.483785 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d19d249c-61bd-4bf6-96fd-7ee2461017ee tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:15.485235 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d19d249c-61bd-4bf6-96fd-7ee2461017ee tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:15.486415 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d19d249c-61bd-4bf6-96fd-7ee2461017ee tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:15.487811 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d19d249c-61bd-4bf6-96fd-7ee2461017ee tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:15.489133 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d19d249c-61bd-4bf6-96fd-7ee2461017ee tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:15.489882 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d19d249c-61bd-4bf6-96fd-7ee2461017ee tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:15.827142 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-9b4584fc-b72b-4a93-a770-6ea98332edac tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:16:15.828325 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-9b4584fc-b72b-4a93-a770-6ea98332edac tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] [instance: 1346709b-155a-4048-86ca-f1b08c9d5710] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:16:15.866298 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9b4584fc-b72b-4a93-a770-6ea98332edac tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:15.867201 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9b4584fc-b72b-4a93-a770-6ea98332edac tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:15.868517 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9b4584fc-b72b-4a93-a770-6ea98332edac tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:15.869786 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9b4584fc-b72b-4a93-a770-6ea98332edac tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:15.897567 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9b4584fc-b72b-4a93-a770-6ea98332edac tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:15.898442 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9b4584fc-b72b-4a93-a770-6ea98332edac tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:15.986191 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-d19d249c-61bd-4bf6-96fd-7ee2461017ee tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99b5f2cd0a343bc81ca0005f2a74591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2140f8775f4a7495c0f026b4b810b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:16:15.998075 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-d19d249c-61bd-4bf6-96fd-7ee2461017ee tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] 10.222.0.43 "GET /compute/v2.1/servers/ee3587af-87cb-4a36-98ed-5a5c81eb6f69" status: 200 len: 1322 microversion: 2.1 time: 0.541402 Oct 04 22:16:16.014393 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2845/5626] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:16:15 2022] GET /compute/v2.1/servers/ee3587af-87cb-4a36-98ed-5a5c81eb6f69 => generated 1322 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:16:16.753886 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-9b4584fc-b72b-4a93-a770-6ea98332edac tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ba7c8167fd40e6878f7f2af9fa869c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc18681ca2974a54a172cbc727158883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:16:16.765463 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-9b4584fc-b72b-4a93-a770-6ea98332edac tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] 10.222.0.43 "GET /compute/v2.1/servers/1346709b-155a-4048-86ca-f1b08c9d5710" status: 200 len: 1469 microversion: 2.1 time: 0.947321 Oct 04 22:16:16.768817 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2782/5627] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:16:15 2022] GET /compute/v2.1/servers/1346709b-155a-4048-86ca-f1b08c9d5710 => generated 1469 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:16:17.034318 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-a2974c01-7a10-42d5-8db4-a1c812bdf3b4 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:16:17.035609 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-a2974c01-7a10-42d5-8db4-a1c812bdf3b4 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] [instance: ee3587af-87cb-4a36-98ed-5a5c81eb6f69] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:16:17.085483 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-282bbf8d-0024-4047-9028-10f561c735fa req-f10b88e3-1fa5-492d-9cfe-6b72ba72e9ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee3587af-87cb-4a36-98ed-5a5c81eb6f69", "name": "network-vif-plugged", "status": "completed", "tag": "22225028-5a17-4dd6-9593-448f6f20fd77"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:16:17.088212 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:16:17.091272 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a2974c01-7a10-42d5-8db4-a1c812bdf3b4 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:17.093870 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a2974c01-7a10-42d5-8db4-a1c812bdf3b4 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:17.097050 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a2974c01-7a10-42d5-8db4-a1c812bdf3b4 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:17.098781 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a2974c01-7a10-42d5-8db4-a1c812bdf3b4 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:17.099974 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a2974c01-7a10-42d5-8db4-a1c812bdf3b4 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:17.101224 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a2974c01-7a10-42d5-8db4-a1c812bdf3b4 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:17.112344 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-282bbf8d-0024-4047-9028-10f561c735fa req-f10b88e3-1fa5-492d-9cfe-6b72ba72e9ef service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:17.112837 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-282bbf8d-0024-4047-9028-10f561c735fa req-f10b88e3-1fa5-492d-9cfe-6b72ba72e9ef service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:17.113372 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-282bbf8d-0024-4047-9028-10f561c735fa req-f10b88e3-1fa5-492d-9cfe-6b72ba72e9ef service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:17.172812 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-282bbf8d-0024-4047-9028-10f561c735fa req-f10b88e3-1fa5-492d-9cfe-6b72ba72e9ef service nova] Creating event network-vif-plugged:22225028-5a17-4dd6-9593-448f6f20fd77 for instance ee3587af-87cb-4a36-98ed-5a5c81eb6f69 on n-h2-860284-1 Oct 04 22:16:17.180703 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-282bbf8d-0024-4047-9028-10f561c735fa req-f10b88e3-1fa5-492d-9cfe-6b72ba72e9ef service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098243 Oct 04 22:16:17.188228 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2783/5628] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:16:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:16:17.520496 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-a2974c01-7a10-42d5-8db4-a1c812bdf3b4 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99b5f2cd0a343bc81ca0005f2a74591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2140f8775f4a7495c0f026b4b810b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:16:17.535244 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-a2974c01-7a10-42d5-8db4-a1c812bdf3b4 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] 10.222.0.43 "GET /compute/v2.1/servers/ee3587af-87cb-4a36-98ed-5a5c81eb6f69" status: 200 len: 1322 microversion: 2.1 time: 0.511035 Oct 04 22:16:17.535933 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2846/5629] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:16:17 2022] GET /compute/v2.1/servers/ee3587af-87cb-4a36-98ed-5a5c81eb6f69 => generated 1322 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:16:17.797309 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-44bdb1df-def6-494a-9293-170aa8fbb069 tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:16:17.798227 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-44bdb1df-def6-494a-9293-170aa8fbb069 tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] [instance: 1346709b-155a-4048-86ca-f1b08c9d5710] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:16:17.812492 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-44bdb1df-def6-494a-9293-170aa8fbb069 tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:17.813221 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-44bdb1df-def6-494a-9293-170aa8fbb069 tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:17.813822 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-44bdb1df-def6-494a-9293-170aa8fbb069 tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:17.814760 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-44bdb1df-def6-494a-9293-170aa8fbb069 tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:17.815366 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-44bdb1df-def6-494a-9293-170aa8fbb069 tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:17.815976 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-44bdb1df-def6-494a-9293-170aa8fbb069 tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:18.463611 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-44bdb1df-def6-494a-9293-170aa8fbb069 tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ba7c8167fd40e6878f7f2af9fa869c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc18681ca2974a54a172cbc727158883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:16:18.482764 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-44bdb1df-def6-494a-9293-170aa8fbb069 tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] 10.222.0.43 "GET /compute/v2.1/servers/1346709b-155a-4048-86ca-f1b08c9d5710" status: 200 len: 1469 microversion: 2.1 time: 0.689569 Oct 04 22:16:18.484730 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2784/5630] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:16:17 2022] GET /compute/v2.1/servers/1346709b-155a-4048-86ca-f1b08c9d5710 => generated 1469 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:16:18.563425 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-8bb4fe14-34bf-41a3-afce-5693d45a9708 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:16:18.564044 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-8bb4fe14-34bf-41a3-afce-5693d45a9708 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] [instance: ee3587af-87cb-4a36-98ed-5a5c81eb6f69] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:16:18.577625 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8bb4fe14-34bf-41a3-afce-5693d45a9708 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:18.578524 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8bb4fe14-34bf-41a3-afce-5693d45a9708 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:18.580810 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8bb4fe14-34bf-41a3-afce-5693d45a9708 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:18.582214 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8bb4fe14-34bf-41a3-afce-5693d45a9708 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:18.584332 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8bb4fe14-34bf-41a3-afce-5693d45a9708 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:18.584775 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8bb4fe14-34bf-41a3-afce-5693d45a9708 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:18.865490 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-8bb4fe14-34bf-41a3-afce-5693d45a9708 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99b5f2cd0a343bc81ca0005f2a74591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2140f8775f4a7495c0f026b4b810b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:16:18.873679 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-8bb4fe14-34bf-41a3-afce-5693d45a9708 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] 10.222.0.43 "GET /compute/v2.1/servers/ee3587af-87cb-4a36-98ed-5a5c81eb6f69" status: 200 len: 1322 microversion: 2.1 time: 0.316164 Oct 04 22:16:18.874294 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2847/5631] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:16:18 2022] GET /compute/v2.1/servers/ee3587af-87cb-4a36-98ed-5a5c81eb6f69 => generated 1322 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:16:18.981897 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-f650bec9-953f-4619-a719-b492f418e8c5 tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-1797107541", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452", "networks": [{"uuid": "c455c673-ec77-45f8-b67a-cb62cd4e3bad"}]}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:16:18.990928 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:16:19.100438 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.network.neutron [None req-f650bec9-953f-4619-a719-b492f418e8c5 tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] validate_networks() for [('c455c673-ec77-45f8-b67a-cb62cd4e3bad', None, None, None, None, None)] {{(pid=134101) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 22:16:19.509732 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-a06719f7-76a6-4156-933c-c7755ed5f99a req-5c453a16-1fcb-428d-b865-529127d4a543 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1346709b-155a-4048-86ca-f1b08c9d5710", "name": "network-vif-deleted", "tag": "0c3cb1ba-1f96-4f4a-b4cb-7d74a135bffa"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:16:19.537617 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-a06719f7-76a6-4156-933c-c7755ed5f99a req-5c453a16-1fcb-428d-b865-529127d4a543 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:19.540199 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-a06719f7-76a6-4156-933c-c7755ed5f99a req-5c453a16-1fcb-428d-b865-529127d4a543 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:19.541005 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-a06719f7-76a6-4156-933c-c7755ed5f99a req-5c453a16-1fcb-428d-b865-529127d4a543 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:19.573257 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-a06719f7-76a6-4156-933c-c7755ed5f99a req-5c453a16-1fcb-428d-b865-529127d4a543 service nova] Creating event network-vif-deleted:0c3cb1ba-1f96-4f4a-b4cb-7d74a135bffa for instance 1346709b-155a-4048-86ca-f1b08c9d5710 on n-h1-860284-1 Oct 04 22:16:19.581043 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-a06719f7-76a6-4156-933c-c7755ed5f99a req-5c453a16-1fcb-428d-b865-529127d4a543 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078117 Oct 04 22:16:19.582639 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2848/5632] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:16:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:16:19.589386 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-b8ee2d68-daab-45fb-82a8-55e78d4ebd14 tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:16:19.590758 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-b8ee2d68-daab-45fb-82a8-55e78d4ebd14 tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] [instance: 1346709b-155a-4048-86ca-f1b08c9d5710] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:16:19.598581 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b8ee2d68-daab-45fb-82a8-55e78d4ebd14 tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:19.599598 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b8ee2d68-daab-45fb-82a8-55e78d4ebd14 tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:19.600260 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b8ee2d68-daab-45fb-82a8-55e78d4ebd14 tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:19.601398 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b8ee2d68-daab-45fb-82a8-55e78d4ebd14 tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:19.602495 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b8ee2d68-daab-45fb-82a8-55e78d4ebd14 tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:19.603062 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b8ee2d68-daab-45fb-82a8-55e78d4ebd14 tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:19.752144 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-b8ee2d68-daab-45fb-82a8-55e78d4ebd14 tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ba7c8167fd40e6878f7f2af9fa869c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc18681ca2974a54a172cbc727158883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:16:19.762506 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-b8ee2d68-daab-45fb-82a8-55e78d4ebd14 tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] 10.222.0.43 "GET /compute/v2.1/servers/1346709b-155a-4048-86ca-f1b08c9d5710" status: 200 len: 1298 microversion: 2.1 time: 0.178287 Oct 04 22:16:19.773706 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2849/5633] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:16:19 2022] GET /compute/v2.1/servers/1346709b-155a-4048-86ca-f1b08c9d5710 => generated 1298 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:16:19.897056 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-527a9a45-74f2-4a3c-bee0-4bdf34b50f61 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:16:19.898210 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-527a9a45-74f2-4a3c-bee0-4bdf34b50f61 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] [instance: ee3587af-87cb-4a36-98ed-5a5c81eb6f69] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:16:19.910182 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-527a9a45-74f2-4a3c-bee0-4bdf34b50f61 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:19.914099 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-527a9a45-74f2-4a3c-bee0-4bdf34b50f61 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:19.915727 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-527a9a45-74f2-4a3c-bee0-4bdf34b50f61 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:19.916778 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-527a9a45-74f2-4a3c-bee0-4bdf34b50f61 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:19.918952 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-527a9a45-74f2-4a3c-bee0-4bdf34b50f61 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:19.919668 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-527a9a45-74f2-4a3c-bee0-4bdf34b50f61 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:20.841498 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-527a9a45-74f2-4a3c-bee0-4bdf34b50f61 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99b5f2cd0a343bc81ca0005f2a74591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2140f8775f4a7495c0f026b4b810b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:16:20.853976 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-527a9a45-74f2-4a3c-bee0-4bdf34b50f61 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] 10.222.0.43 "GET /compute/v2.1/servers/ee3587af-87cb-4a36-98ed-5a5c81eb6f69" status: 200 len: 1517 microversion: 2.1 time: 0.960741 Oct 04 22:16:20.854945 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2850/5634] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:16:19 2022] GET /compute/v2.1/servers/ee3587af-87cb-4a36-98ed-5a5c81eb6f69 => generated 1517 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:16:20.859729 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-508af2c4-9c87-4c49-bb08-4807e8f6066f tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:16:20.860345 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-508af2c4-9c87-4c49-bb08-4807e8f6066f tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] [instance: 1346709b-155a-4048-86ca-f1b08c9d5710] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:16:20.872368 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-508af2c4-9c87-4c49-bb08-4807e8f6066f tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:20.878836 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-508af2c4-9c87-4c49-bb08-4807e8f6066f tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:20.879598 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-508af2c4-9c87-4c49-bb08-4807e8f6066f tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:20.885720 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-508af2c4-9c87-4c49-bb08-4807e8f6066f tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:20.888492 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-508af2c4-9c87-4c49-bb08-4807e8f6066f tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:20.889053 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-508af2c4-9c87-4c49-bb08-4807e8f6066f tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:20.905514 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-508af2c4-9c87-4c49-bb08-4807e8f6066f tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] HTTP exception thrown: Instance 1346709b-155a-4048-86ca-f1b08c9d5710 could not be found. Oct 04 22:16:20.907696 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-508af2c4-9c87-4c49-bb08-4807e8f6066f tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] Request method failure captured: Oct 04 22:16:20.907696 n-d-860284-1 devstack@n-api.service[134102]: request: GET /compute/v2.1/servers/1346709b-155a-4048-86ca-f1b08c9d5710 HTTP/1.1 Oct 04 22:16:20.907696 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 22:16:20.907696 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 22:16:20.907696 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 22:16:20.907696 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 22:16:20.907696 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 22:16:20.907696 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 22:16:20.907696 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 22:16:20.907696 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 22:16:20.907696 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPLAT9xfCE_0_n_sJUd5GJWKyTNsBDQJEIU5EfqEtwOpaoxd7UcbXy3YPbfjC-BenoTFTASQC5gP05IACO36QQmhBUqMrVJW9C8oXEL3X3h1WLKSZ7ypSwbhKD6V6owU-SFLMloH6tk9Dd9_-xCVjtKkGO02bAPOrENasVVQN247tg5Y Oct 04 22:16:20.907696 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 22:16:20.907696 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 22:16:20.907696 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 22:16:20.907696 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 22:16:20.907696 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 22:16:20.907696 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 22:16:20.907696 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: cc18681ca2974a54a172cbc727158883 Oct 04 22:16:20.907696 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-VolumesBackupsTest-515156405 Oct 04 22:16:20.907696 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 22:16:20.907696 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 22:16:20.907696 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/cc18681ca2974a54a172cbc727158883"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_cc18681ca2974a54a172cbc727158883", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/cc18681ca2974a54a172cbc727158883"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/cc18681ca2974a54a172cbc727158883"}]}] Oct 04 22:16:20.907696 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-VolumesBackupsTest-515156405 Oct 04 22:16:20.907696 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: cc18681ca2974a54a172cbc727158883 Oct 04 22:16:20.907696 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-VolumesBackupsTest-515156405 Oct 04 22:16:20.907696 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-VolumesBackupsTest-515156405-project Oct 04 22:16:20.907696 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 22:16:20.907696 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 22:16:20.907696 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: b6ba7c8167fd40e6878f7f2af9fa869c Oct 04 22:16:20.907696 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-VolumesBackupsTest-515156405-project Oct 04 22:16:20.907696 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 22:16:20.907696 n-d-860284-1 devstack@n-api.service[134102]: exception: Instance 1346709b-155a-4048-86ca-f1b08c9d5710 could not be found. Oct 04 22:16:20.907696 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': '1346709b-155a-4048-86ca-f1b08c9d5710'} Oct 04 22:16:20.907696 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:16:20.907696 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:16:20.907696 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:16:20.907696 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:16:20.907696 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:16:20.907696 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:16:20.907696 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:16:20.907696 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:16:20.907696 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:16:20.907696 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:16:20.907696 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1346709b-155a-4048-86ca-f1b08c9d5710 could not be found. Oct 04 22:16:20.907696 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:16:20.907696 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:16:20.907696 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:16:20.907696 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:16:20.907696 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:16:20.907696 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:16:20.907696 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:16:20.907696 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:16:20.907696 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:16:20.907696 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:16:20.907696 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:16:20.907696 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:16:20.907696 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:16:20.907696 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:16:20.907696 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:16:20.907696 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:16:20.907696 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1346709b-155a-4048-86ca-f1b08c9d5710 could not be found. Oct 04 22:16:20.907696 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:16:20.907696 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:16:20.907696 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:16:20.912129 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:16:20.912129 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:16:20.912129 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:16:20.912129 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:16:20.912129 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:16:20.912129 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1346709b-155a-4048-86ca-f1b08c9d5710 could not be found. Oct 04 22:16:20.912129 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:16:20.916407 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-508af2c4-9c87-4c49-bb08-4807e8f6066f tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] Returning 404 to user: Instance 1346709b-155a-4048-86ca-f1b08c9d5710 could not be found. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:16:20.917312 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-508af2c4-9c87-4c49-bb08-4807e8f6066f tempest-VolumesBackupsTest-515156405 tempest-VolumesBackupsTest-515156405-project] 10.222.0.43 "GET /compute/v2.1/servers/1346709b-155a-4048-86ca-f1b08c9d5710" status: 404 len: 111 microversion: 2.1 time: 0.061409 Oct 04 22:16:20.918802 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2851/5635] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:16:20 2022] GET /compute/v2.1/servers/1346709b-155a-4048-86ca-f1b08c9d5710 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:16:20.933496 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-5462b8b2-6b09-4893-8474-61c0975d1127 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:16:20.935781 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-5462b8b2-6b09-4893-8474-61c0975d1127 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] [instance: ee3587af-87cb-4a36-98ed-5a5c81eb6f69] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:16:20.954570 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5462b8b2-6b09-4893-8474-61c0975d1127 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:20.956600 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5462b8b2-6b09-4893-8474-61c0975d1127 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:20.957203 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5462b8b2-6b09-4893-8474-61c0975d1127 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:20.970598 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5462b8b2-6b09-4893-8474-61c0975d1127 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:20.971346 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5462b8b2-6b09-4893-8474-61c0975d1127 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:20.974167 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5462b8b2-6b09-4893-8474-61c0975d1127 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:21.045819 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.objects.instance [None req-5462b8b2-6b09-4893-8474-61c0975d1127 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Lazy-loading 'flavor' on Instance uuid ee3587af-87cb-4a36-98ed-5a5c81eb6f69 {{(pid=134102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 22:16:21.269577 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-5462b8b2-6b09-4893-8474-61c0975d1127 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] 10.222.0.43 "POST /compute/v2.1/servers/ee3587af-87cb-4a36-98ed-5a5c81eb6f69/action" status: 200 len: 32 microversion: 2.1 time: 0.350377 Oct 04 22:16:21.276675 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2852/5636] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 22:16:20 2022] POST /compute/v2.1/servers/ee3587af-87cb-4a36-98ed-5a5c81eb6f69/action => generated 32 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 22:16:21.282746 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-e464a765-d2f6-4a63-acf1-9855885c50c4 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:16:21.283466 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-e464a765-d2f6-4a63-acf1-9855885c50c4 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] [instance: ee3587af-87cb-4a36-98ed-5a5c81eb6f69] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:16:21.306240 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e464a765-d2f6-4a63-acf1-9855885c50c4 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:21.306713 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e464a765-d2f6-4a63-acf1-9855885c50c4 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:21.307145 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e464a765-d2f6-4a63-acf1-9855885c50c4 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:21.308098 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e464a765-d2f6-4a63-acf1-9855885c50c4 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:21.308656 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e464a765-d2f6-4a63-acf1-9855885c50c4 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:21.308985 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e464a765-d2f6-4a63-acf1-9855885c50c4 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:21.341396 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-f650bec9-953f-4619-a719-b492f418e8c5 tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] Flavor limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 22:16:21.341915 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-f650bec9-953f-4619-a719-b492f418e8c5 tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] Image limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 22:16:21.342302 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-f650bec9-953f-4619-a719-b492f418e8c5 tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] Flavor pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 22:16:21.342766 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-f650bec9-953f-4619-a719-b492f418e8c5 tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] Image pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 22:16:21.343260 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-f650bec9-953f-4619-a719-b492f418e8c5 tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 22:16:21.364467 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f650bec9-953f-4619-a719-b492f418e8c5 tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:21.364953 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f650bec9-953f-4619-a719-b492f418e8c5 tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:21.371522 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f650bec9-953f-4619-a719-b492f418e8c5 tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:21.372436 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f650bec9-953f-4619-a719-b492f418e8c5 tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:21.372926 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f650bec9-953f-4619-a719-b492f418e8c5 tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:21.373373 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f650bec9-953f-4619-a719-b492f418e8c5 tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:21.421479 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-f650bec9-953f-4619-a719-b492f418e8c5 tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] Getting quotas for project 04f707cdc9464d6f8f5c6cb58d0fbb18. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:16:21.435249 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-f650bec9-953f-4619-a719-b492f418e8c5 tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] Getting quotas for user a8e7ce1712f146a085427e10710c5171 and project 04f707cdc9464d6f8f5c6cb58d0fbb18. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:16:21.469549 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-f650bec9-953f-4619-a719-b492f418e8c5 tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] Going to run 1 instances... {{(pid=134101) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 22:16:21.482980 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-f650bec9-953f-4619-a719-b492f418e8c5 tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] [instance: dfcd2b12-d268-459c-b712-0163a3163384] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='58548514-5dac-426c-81f5-19e3fba33e23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134101) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 22:16:21.577727 n-d-860284-1 devstack@n-api.service[134101]: ERROR oslo.messaging._drivers.impl_rabbit [None req-f650bec9-953f-4619-a719-b492f418e8c5 tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] [a0705614-f64e-4f2c-9d91-c9cad833fc6d] AMQP server on 10.222.0.43:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 22:16:21.681027 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-e464a765-d2f6-4a63-acf1-9855885c50c4 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99b5f2cd0a343bc81ca0005f2a74591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2140f8775f4a7495c0f026b4b810b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:16:21.689080 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-e464a765-d2f6-4a63-acf1-9855885c50c4 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] 10.222.0.43 "GET /compute/v2.1/servers/ee3587af-87cb-4a36-98ed-5a5c81eb6f69" status: 200 len: 1523 microversion: 2.1 time: 0.410935 Oct 04 22:16:21.689593 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2853/5637] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:16:21 2022] GET /compute/v2.1/servers/ee3587af-87cb-4a36-98ed-5a5c81eb6f69 => generated 1523 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:16:22.588373 n-d-860284-1 devstack@n-api.service[134101]: INFO oslo.messaging._drivers.impl_rabbit [None req-f650bec9-953f-4619-a719-b492f418e8c5 tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] [a0705614-f64e-4f2c-9d91-c9cad833fc6d] Reconnected to AMQP server on 10.222.0.43:5672 via [amqp] client with port 42548. Oct 04 22:16:22.593864 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-f650bec9-953f-4619-a719-b492f418e8c5 tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.825228 Oct 04 22:16:22.595257 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2785/5638] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 22:16:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 3827 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 22:16:22.607625 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-fe69652c-8a6e-472a-b3fb-3191aee7d57d tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:16:22.609021 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-fe69652c-8a6e-472a-b3fb-3191aee7d57d tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] [instance: dfcd2b12-d268-459c-b712-0163a3163384] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:16:22.715585 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-8a1a7c08-6ba4-4b28-9683-651ede195edb tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:16:22.716676 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-8a1a7c08-6ba4-4b28-9683-651ede195edb tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] [instance: ee3587af-87cb-4a36-98ed-5a5c81eb6f69] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:16:22.732345 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8a1a7c08-6ba4-4b28-9683-651ede195edb tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:22.734165 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8a1a7c08-6ba4-4b28-9683-651ede195edb tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:22.736420 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8a1a7c08-6ba4-4b28-9683-651ede195edb tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:22.749702 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8a1a7c08-6ba4-4b28-9683-651ede195edb tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:22.755654 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8a1a7c08-6ba4-4b28-9683-651ede195edb tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:22.760727 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8a1a7c08-6ba4-4b28-9683-651ede195edb tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:22.910151 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-fe69652c-8a6e-472a-b3fb-3191aee7d57d tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8e7ce1712f146a085427e10710c5171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04f707cdc9464d6f8f5c6cb58d0fbb18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:16:22.920560 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-fe69652c-8a6e-472a-b3fb-3191aee7d57d tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] 10.222.0.43 "GET /compute/v2.1/servers/dfcd2b12-d268-459c-b712-0163a3163384" status: 200 len: 1225 microversion: 2.1 time: 0.317198 Oct 04 22:16:22.950759 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2854/5639] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:16:22 2022] GET /compute/v2.1/servers/dfcd2b12-d268-459c-b712-0163a3163384 => generated 1225 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:16:23.334162 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-8a1a7c08-6ba4-4b28-9683-651ede195edb tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99b5f2cd0a343bc81ca0005f2a74591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2140f8775f4a7495c0f026b4b810b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:16:23.343241 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-8a1a7c08-6ba4-4b28-9683-651ede195edb tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] 10.222.0.43 "GET /compute/v2.1/servers/ee3587af-87cb-4a36-98ed-5a5c81eb6f69" status: 200 len: 1523 microversion: 2.1 time: 0.634481 Oct 04 22:16:23.350576 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2786/5640] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:16:22 2022] GET /compute/v2.1/servers/ee3587af-87cb-4a36-98ed-5a5c81eb6f69 => generated 1523 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:16:23.959393 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-edbd58d3-f74e-4102-a214-c3006bec497b tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:16:23.960018 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-edbd58d3-f74e-4102-a214-c3006bec497b tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] [instance: dfcd2b12-d268-459c-b712-0163a3163384] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:16:23.981016 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-edbd58d3-f74e-4102-a214-c3006bec497b tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:23.982043 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-edbd58d3-f74e-4102-a214-c3006bec497b tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:23.984069 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-edbd58d3-f74e-4102-a214-c3006bec497b tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:23.987489 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-edbd58d3-f74e-4102-a214-c3006bec497b tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:23.988189 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-edbd58d3-f74e-4102-a214-c3006bec497b tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:23.988639 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-edbd58d3-f74e-4102-a214-c3006bec497b tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:24.203580 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-edbd58d3-f74e-4102-a214-c3006bec497b tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8e7ce1712f146a085427e10710c5171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04f707cdc9464d6f8f5c6cb58d0fbb18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:16:24.216595 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-edbd58d3-f74e-4102-a214-c3006bec497b tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] 10.222.0.43 "GET /compute/v2.1/servers/dfcd2b12-d268-459c-b712-0163a3163384" status: 200 len: 1277 microversion: 2.1 time: 0.263415 Oct 04 22:16:24.217434 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2855/5641] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:16:23 2022] GET /compute/v2.1/servers/dfcd2b12-d268-459c-b712-0163a3163384 => generated 1277 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:16:24.375231 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-7243977c-d290-4c08-b56e-ee0d76fb5c8a tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:16:24.375774 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-7243977c-d290-4c08-b56e-ee0d76fb5c8a tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] [instance: ee3587af-87cb-4a36-98ed-5a5c81eb6f69] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:16:24.388966 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7243977c-d290-4c08-b56e-ee0d76fb5c8a tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:24.390071 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7243977c-d290-4c08-b56e-ee0d76fb5c8a tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:24.390937 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7243977c-d290-4c08-b56e-ee0d76fb5c8a tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:24.393650 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7243977c-d290-4c08-b56e-ee0d76fb5c8a tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:24.395277 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7243977c-d290-4c08-b56e-ee0d76fb5c8a tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:24.396150 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7243977c-d290-4c08-b56e-ee0d76fb5c8a tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:24.971616 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-7243977c-d290-4c08-b56e-ee0d76fb5c8a tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99b5f2cd0a343bc81ca0005f2a74591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2140f8775f4a7495c0f026b4b810b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:16:25.006357 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-7243977c-d290-4c08-b56e-ee0d76fb5c8a tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] 10.222.0.43 "GET /compute/v2.1/servers/ee3587af-87cb-4a36-98ed-5a5c81eb6f69" status: 200 len: 1523 microversion: 2.1 time: 0.636544 Oct 04 22:16:25.006721 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2787/5642] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:16:24 2022] GET /compute/v2.1/servers/ee3587af-87cb-4a36-98ed-5a5c81eb6f69 => generated 1523 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:16:25.241881 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-8a3cdac2-3199-43a1-96f5-f85d31d66465 tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:16:25.243855 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-8a3cdac2-3199-43a1-96f5-f85d31d66465 tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] [instance: dfcd2b12-d268-459c-b712-0163a3163384] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:16:25.257017 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8a3cdac2-3199-43a1-96f5-f85d31d66465 tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:25.257587 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8a3cdac2-3199-43a1-96f5-f85d31d66465 tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:25.270459 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8a3cdac2-3199-43a1-96f5-f85d31d66465 tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:25.273411 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8a3cdac2-3199-43a1-96f5-f85d31d66465 tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:25.276128 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8a3cdac2-3199-43a1-96f5-f85d31d66465 tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:25.276596 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8a3cdac2-3199-43a1-96f5-f85d31d66465 tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:25.369811 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:16:25.496638 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-8a3cdac2-3199-43a1-96f5-f85d31d66465 tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8e7ce1712f146a085427e10710c5171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04f707cdc9464d6f8f5c6cb58d0fbb18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:16:25.526484 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-8a3cdac2-3199-43a1-96f5-f85d31d66465 tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] 10.222.0.43 "GET /compute/v2.1/servers/dfcd2b12-d268-459c-b712-0163a3163384" status: 200 len: 1283 microversion: 2.1 time: 0.289139 Oct 04 22:16:25.527835 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2856/5643] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:16:25 2022] GET /compute/v2.1/servers/dfcd2b12-d268-459c-b712-0163a3163384 => generated 1283 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:16:26.038352 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-23843f8f-6c8d-4205-b68a-96e011c6ed72 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:16:26.041418 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-23843f8f-6c8d-4205-b68a-96e011c6ed72 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] [instance: ee3587af-87cb-4a36-98ed-5a5c81eb6f69] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:16:26.060802 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-23843f8f-6c8d-4205-b68a-96e011c6ed72 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:26.061706 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-23843f8f-6c8d-4205-b68a-96e011c6ed72 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:26.062989 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-23843f8f-6c8d-4205-b68a-96e011c6ed72 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:26.065076 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-23843f8f-6c8d-4205-b68a-96e011c6ed72 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:26.066018 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-23843f8f-6c8d-4205-b68a-96e011c6ed72 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:26.066916 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-23843f8f-6c8d-4205-b68a-96e011c6ed72 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:26.367609 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-23843f8f-6c8d-4205-b68a-96e011c6ed72 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99b5f2cd0a343bc81ca0005f2a74591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2140f8775f4a7495c0f026b4b810b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:16:26.386051 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-23843f8f-6c8d-4205-b68a-96e011c6ed72 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] 10.222.0.43 "GET /compute/v2.1/servers/ee3587af-87cb-4a36-98ed-5a5c81eb6f69" status: 200 len: 1523 microversion: 2.1 time: 0.355687 Oct 04 22:16:26.387160 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2788/5644] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:16:26 2022] GET /compute/v2.1/servers/ee3587af-87cb-4a36-98ed-5a5c81eb6f69 => generated 1523 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:16:26.553095 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-dc841469-021d-4c30-8d01-4ca8bceca671 tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:16:26.554098 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-dc841469-021d-4c30-8d01-4ca8bceca671 tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] [instance: dfcd2b12-d268-459c-b712-0163a3163384] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:16:26.568843 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dc841469-021d-4c30-8d01-4ca8bceca671 tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:26.569691 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dc841469-021d-4c30-8d01-4ca8bceca671 tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:26.579661 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dc841469-021d-4c30-8d01-4ca8bceca671 tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:26.581521 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dc841469-021d-4c30-8d01-4ca8bceca671 tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:26.583189 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dc841469-021d-4c30-8d01-4ca8bceca671 tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:26.584191 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dc841469-021d-4c30-8d01-4ca8bceca671 tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:26.943592 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-dc841469-021d-4c30-8d01-4ca8bceca671 tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8e7ce1712f146a085427e10710c5171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04f707cdc9464d6f8f5c6cb58d0fbb18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:16:26.955749 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-dc841469-021d-4c30-8d01-4ca8bceca671 tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] 10.222.0.43 "GET /compute/v2.1/servers/dfcd2b12-d268-459c-b712-0163a3163384" status: 200 len: 1325 microversion: 2.1 time: 0.407880 Oct 04 22:16:26.956559 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2857/5645] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:16:26 2022] GET /compute/v2.1/servers/dfcd2b12-d268-459c-b712-0163a3163384 => generated 1325 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:16:27.410883 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-6bf55c89-e74b-4f99-92ae-4bd4e59c2f93 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:16:27.416754 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-6bf55c89-e74b-4f99-92ae-4bd4e59c2f93 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] [instance: ee3587af-87cb-4a36-98ed-5a5c81eb6f69] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:16:27.433629 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6bf55c89-e74b-4f99-92ae-4bd4e59c2f93 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:27.434314 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6bf55c89-e74b-4f99-92ae-4bd4e59c2f93 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:27.435953 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6bf55c89-e74b-4f99-92ae-4bd4e59c2f93 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:27.436871 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6bf55c89-e74b-4f99-92ae-4bd4e59c2f93 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:27.439121 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6bf55c89-e74b-4f99-92ae-4bd4e59c2f93 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:27.439775 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6bf55c89-e74b-4f99-92ae-4bd4e59c2f93 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:27.499836 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:16:27.980250 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-d7abf43f-111a-4019-9287-4caab017c888 tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:16:27.981131 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-d7abf43f-111a-4019-9287-4caab017c888 tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] [instance: dfcd2b12-d268-459c-b712-0163a3163384] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:16:27.999483 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d7abf43f-111a-4019-9287-4caab017c888 tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:27.999990 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d7abf43f-111a-4019-9287-4caab017c888 tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:28.000576 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d7abf43f-111a-4019-9287-4caab017c888 tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:28.001179 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d7abf43f-111a-4019-9287-4caab017c888 tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:28.001647 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d7abf43f-111a-4019-9287-4caab017c888 tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:28.002082 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d7abf43f-111a-4019-9287-4caab017c888 tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:28.477154 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-6bf55c89-e74b-4f99-92ae-4bd4e59c2f93 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99b5f2cd0a343bc81ca0005f2a74591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2140f8775f4a7495c0f026b4b810b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:16:28.489843 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-6bf55c89-e74b-4f99-92ae-4bd4e59c2f93 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] 10.222.0.43 "GET /compute/v2.1/servers/ee3587af-87cb-4a36-98ed-5a5c81eb6f69" status: 200 len: 1523 microversion: 2.1 time: 1.083084 Oct 04 22:16:28.495746 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2789/5646] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:16:27 2022] GET /compute/v2.1/servers/ee3587af-87cb-4a36-98ed-5a5c81eb6f69 => generated 1523 bytes in 1089 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:16:28.525924 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-d7abf43f-111a-4019-9287-4caab017c888 tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8e7ce1712f146a085427e10710c5171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04f707cdc9464d6f8f5c6cb58d0fbb18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:16:28.537155 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-d7abf43f-111a-4019-9287-4caab017c888 tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] 10.222.0.43 "GET /compute/v2.1/servers/dfcd2b12-d268-459c-b712-0163a3163384" status: 200 len: 1325 microversion: 2.1 time: 0.560635 Oct 04 22:16:28.541489 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2858/5647] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:16:27 2022] GET /compute/v2.1/servers/dfcd2b12-d268-459c-b712-0163a3163384 => generated 1325 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:16:29.519115 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-97cabeb4-f565-4ced-b491-a04587bc3129 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:16:29.520550 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-97cabeb4-f565-4ced-b491-a04587bc3129 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] [instance: ee3587af-87cb-4a36-98ed-5a5c81eb6f69] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:16:29.531037 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-97cabeb4-f565-4ced-b491-a04587bc3129 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:29.532150 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-97cabeb4-f565-4ced-b491-a04587bc3129 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:29.532845 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-97cabeb4-f565-4ced-b491-a04587bc3129 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:29.533779 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-97cabeb4-f565-4ced-b491-a04587bc3129 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:29.534621 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-97cabeb4-f565-4ced-b491-a04587bc3129 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:29.535399 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-97cabeb4-f565-4ced-b491-a04587bc3129 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:29.573453 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-23ccc95f-e2a3-4e24-a6df-28d4985057ac tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:16:29.576502 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-23ccc95f-e2a3-4e24-a6df-28d4985057ac tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] [instance: dfcd2b12-d268-459c-b712-0163a3163384] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:16:29.603854 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-23ccc95f-e2a3-4e24-a6df-28d4985057ac tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:29.604515 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-23ccc95f-e2a3-4e24-a6df-28d4985057ac tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:29.606872 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-23ccc95f-e2a3-4e24-a6df-28d4985057ac tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:29.608756 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-23ccc95f-e2a3-4e24-a6df-28d4985057ac tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:29.609367 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-23ccc95f-e2a3-4e24-a6df-28d4985057ac tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:29.610731 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-23ccc95f-e2a3-4e24-a6df-28d4985057ac tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:30.363500 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-97cabeb4-f565-4ced-b491-a04587bc3129 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99b5f2cd0a343bc81ca0005f2a74591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2140f8775f4a7495c0f026b4b810b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:16:30.374866 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-97cabeb4-f565-4ced-b491-a04587bc3129 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] 10.222.0.43 "GET /compute/v2.1/servers/ee3587af-87cb-4a36-98ed-5a5c81eb6f69" status: 200 len: 1523 microversion: 2.1 time: 0.860836 Oct 04 22:16:30.380701 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2790/5648] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:16:29 2022] GET /compute/v2.1/servers/ee3587af-87cb-4a36-98ed-5a5c81eb6f69 => generated 1523 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:16:30.400794 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-587ddd88-cef5-485d-b6b3-5677cac05fdf req-02870a4d-1c9b-4bec-aa8a-e41cf7a2849b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dfcd2b12-d268-459c-b712-0163a3163384", "tag": "3c2df425-a52d-4e1d-aac8-fac3ce841bac"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:16:30.406696 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-23ccc95f-e2a3-4e24-a6df-28d4985057ac tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8e7ce1712f146a085427e10710c5171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04f707cdc9464d6f8f5c6cb58d0fbb18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:16:30.429045 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-587ddd88-cef5-485d-b6b3-5677cac05fdf req-02870a4d-1c9b-4bec-aa8a-e41cf7a2849b service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:30.432413 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-587ddd88-cef5-485d-b6b3-5677cac05fdf req-02870a4d-1c9b-4bec-aa8a-e41cf7a2849b service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:30.433302 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-587ddd88-cef5-485d-b6b3-5677cac05fdf req-02870a4d-1c9b-4bec-aa8a-e41cf7a2849b service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:30.451432 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-23ccc95f-e2a3-4e24-a6df-28d4985057ac tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] 10.222.0.43 "GET /compute/v2.1/servers/dfcd2b12-d268-459c-b712-0163a3163384" status: 200 len: 1325 microversion: 2.1 time: 0.886741 Oct 04 22:16:30.470046 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2859/5649] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:16:29 2022] GET /compute/v2.1/servers/dfcd2b12-d268-459c-b712-0163a3163384 => generated 1325 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:16:30.501473 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-587ddd88-cef5-485d-b6b3-5677cac05fdf req-02870a4d-1c9b-4bec-aa8a-e41cf7a2849b service nova] Creating event network-changed:3c2df425-a52d-4e1d-aac8-fac3ce841bac for instance dfcd2b12-d268-459c-b712-0163a3163384 on n-h1-860284-1 Oct 04 22:16:30.509421 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-587ddd88-cef5-485d-b6b3-5677cac05fdf req-02870a4d-1c9b-4bec-aa8a-e41cf7a2849b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127040 Oct 04 22:16:30.518764 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2791/5650] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:16:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:16:31.404874 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-b49b06d9-7911-4320-8ba0-21c0230cc800 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:16:31.406621 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-b49b06d9-7911-4320-8ba0-21c0230cc800 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] [instance: ee3587af-87cb-4a36-98ed-5a5c81eb6f69] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:16:31.422490 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b49b06d9-7911-4320-8ba0-21c0230cc800 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:31.423000 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b49b06d9-7911-4320-8ba0-21c0230cc800 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:31.423445 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b49b06d9-7911-4320-8ba0-21c0230cc800 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:31.424170 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b49b06d9-7911-4320-8ba0-21c0230cc800 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:31.433002 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b49b06d9-7911-4320-8ba0-21c0230cc800 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:31.433537 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b49b06d9-7911-4320-8ba0-21c0230cc800 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:31.479571 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=2 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:16:31.481766 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=6 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:16:31.489927 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-719b88e0-c2ce-4b21-9ff8-54777d1120a8 tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:16:31.493930 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-719b88e0-c2ce-4b21-9ff8-54777d1120a8 tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] [instance: dfcd2b12-d268-459c-b712-0163a3163384] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:16:31.519718 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-719b88e0-c2ce-4b21-9ff8-54777d1120a8 tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:31.520034 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-719b88e0-c2ce-4b21-9ff8-54777d1120a8 tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:31.523344 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-719b88e0-c2ce-4b21-9ff8-54777d1120a8 tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:31.528723 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-719b88e0-c2ce-4b21-9ff8-54777d1120a8 tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:31.530019 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-719b88e0-c2ce-4b21-9ff8-54777d1120a8 tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:31.533669 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-719b88e0-c2ce-4b21-9ff8-54777d1120a8 tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:32.087793 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-719b88e0-c2ce-4b21-9ff8-54777d1120a8 tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8e7ce1712f146a085427e10710c5171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04f707cdc9464d6f8f5c6cb58d0fbb18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:16:32.106559 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-719b88e0-c2ce-4b21-9ff8-54777d1120a8 tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] 10.222.0.43 "GET /compute/v2.1/servers/dfcd2b12-d268-459c-b712-0163a3163384" status: 200 len: 1325 microversion: 2.1 time: 0.632455 Oct 04 22:16:32.110732 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2792/5651] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:16:31 2022] GET /compute/v2.1/servers/dfcd2b12-d268-459c-b712-0163a3163384 => generated 1325 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:16:32.121337 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-b49b06d9-7911-4320-8ba0-21c0230cc800 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99b5f2cd0a343bc81ca0005f2a74591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2140f8775f4a7495c0f026b4b810b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:16:32.134268 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-b49b06d9-7911-4320-8ba0-21c0230cc800 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] 10.222.0.43 "GET /compute/v2.1/servers/ee3587af-87cb-4a36-98ed-5a5c81eb6f69" status: 200 len: 1523 microversion: 2.1 time: 0.733393 Oct 04 22:16:32.143084 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2860/5652] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:16:31 2022] GET /compute/v2.1/servers/ee3587af-87cb-4a36-98ed-5a5c81eb6f69 => generated 1523 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:16:33.143507 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-9657330f-ebdc-4882-9eef-8b4ea84c9629 tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:16:33.144124 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-9657330f-ebdc-4882-9eef-8b4ea84c9629 tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] [instance: dfcd2b12-d268-459c-b712-0163a3163384] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:16:33.161950 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9657330f-ebdc-4882-9eef-8b4ea84c9629 tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:33.165244 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9657330f-ebdc-4882-9eef-8b4ea84c9629 tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:33.165714 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-cf34dbe0-b72f-4121-a999-d6ef18bce4e7 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:16:33.166898 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-cf34dbe0-b72f-4121-a999-d6ef18bce4e7 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] [instance: ee3587af-87cb-4a36-98ed-5a5c81eb6f69] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:16:33.181532 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9657330f-ebdc-4882-9eef-8b4ea84c9629 tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:33.182642 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9657330f-ebdc-4882-9eef-8b4ea84c9629 tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:33.184219 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell0:SELECT=2 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:16:33.185492 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9657330f-ebdc-4882-9eef-8b4ea84c9629 tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:33.187400 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9657330f-ebdc-4882-9eef-8b4ea84c9629 tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:33.191540 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cf34dbe0-b72f-4121-a999-d6ef18bce4e7 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:33.196718 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cf34dbe0-b72f-4121-a999-d6ef18bce4e7 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:33.200234 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cf34dbe0-b72f-4121-a999-d6ef18bce4e7 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:33.201271 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cf34dbe0-b72f-4121-a999-d6ef18bce4e7 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:33.202203 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cf34dbe0-b72f-4121-a999-d6ef18bce4e7 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:33.203895 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cf34dbe0-b72f-4121-a999-d6ef18bce4e7 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:33.676112 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-cf34dbe0-b72f-4121-a999-d6ef18bce4e7 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99b5f2cd0a343bc81ca0005f2a74591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2140f8775f4a7495c0f026b4b810b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:16:33.688393 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-cf34dbe0-b72f-4121-a999-d6ef18bce4e7 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] 10.222.0.43 "GET /compute/v2.1/servers/ee3587af-87cb-4a36-98ed-5a5c81eb6f69" status: 200 len: 1523 microversion: 2.1 time: 0.526882 Oct 04 22:16:33.688949 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2861/5653] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:16:33 2022] GET /compute/v2.1/servers/ee3587af-87cb-4a36-98ed-5a5c81eb6f69 => generated 1523 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:16:33.727611 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-9657330f-ebdc-4882-9eef-8b4ea84c9629 tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8e7ce1712f146a085427e10710c5171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04f707cdc9464d6f8f5c6cb58d0fbb18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:16:33.740429 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-9657330f-ebdc-4882-9eef-8b4ea84c9629 tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] 10.222.0.43 "GET /compute/v2.1/servers/dfcd2b12-d268-459c-b712-0163a3163384" status: 200 len: 1325 microversion: 2.1 time: 0.602307 Oct 04 22:16:33.748873 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2793/5654] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:16:33 2022] GET /compute/v2.1/servers/dfcd2b12-d268-459c-b712-0163a3163384 => generated 1325 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:16:34.717225 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-d337275e-d270-4f63-af64-6504338872e1 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:16:34.719032 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-d337275e-d270-4f63-af64-6504338872e1 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] [instance: ee3587af-87cb-4a36-98ed-5a5c81eb6f69] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:16:34.729678 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d337275e-d270-4f63-af64-6504338872e1 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:34.730744 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d337275e-d270-4f63-af64-6504338872e1 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:34.731397 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d337275e-d270-4f63-af64-6504338872e1 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:34.732343 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d337275e-d270-4f63-af64-6504338872e1 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:34.732928 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d337275e-d270-4f63-af64-6504338872e1 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:34.733456 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d337275e-d270-4f63-af64-6504338872e1 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:34.764162 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-89297839-f3e7-4e4f-b105-57df57218470 tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:16:34.764777 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-89297839-f3e7-4e4f-b105-57df57218470 tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] [instance: dfcd2b12-d268-459c-b712-0163a3163384] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:16:34.771619 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-89297839-f3e7-4e4f-b105-57df57218470 tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:34.779185 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-89297839-f3e7-4e4f-b105-57df57218470 tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:34.779747 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-89297839-f3e7-4e4f-b105-57df57218470 tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:34.781953 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-89297839-f3e7-4e4f-b105-57df57218470 tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:34.784179 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-89297839-f3e7-4e4f-b105-57df57218470 tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:34.784746 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-89297839-f3e7-4e4f-b105-57df57218470 tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:35.085355 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-d337275e-d270-4f63-af64-6504338872e1 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99b5f2cd0a343bc81ca0005f2a74591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2140f8775f4a7495c0f026b4b810b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:16:35.101514 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-d337275e-d270-4f63-af64-6504338872e1 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] 10.222.0.43 "GET /compute/v2.1/servers/ee3587af-87cb-4a36-98ed-5a5c81eb6f69" status: 200 len: 1523 microversion: 2.1 time: 0.388609 Oct 04 22:16:35.105029 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2862/5655] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:16:34 2022] GET /compute/v2.1/servers/ee3587af-87cb-4a36-98ed-5a5c81eb6f69 => generated 1523 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:16:35.171406 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-89297839-f3e7-4e4f-b105-57df57218470 tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8e7ce1712f146a085427e10710c5171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04f707cdc9464d6f8f5c6cb58d0fbb18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:16:35.185435 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-89297839-f3e7-4e4f-b105-57df57218470 tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] 10.222.0.43 "GET /compute/v2.1/servers/dfcd2b12-d268-459c-b712-0163a3163384" status: 200 len: 1325 microversion: 2.1 time: 0.424862 Oct 04 22:16:35.202408 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2794/5656] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:16:34 2022] GET /compute/v2.1/servers/dfcd2b12-d268-459c-b712-0163a3163384 => generated 1325 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:16:36.132061 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-a611bdaa-e5c9-4371-ba55-654ad0c6dea4 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:16:36.135503 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-a611bdaa-e5c9-4371-ba55-654ad0c6dea4 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] [instance: ee3587af-87cb-4a36-98ed-5a5c81eb6f69] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:16:36.160326 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a611bdaa-e5c9-4371-ba55-654ad0c6dea4 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:36.162331 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a611bdaa-e5c9-4371-ba55-654ad0c6dea4 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:36.166035 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a611bdaa-e5c9-4371-ba55-654ad0c6dea4 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:36.171441 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a611bdaa-e5c9-4371-ba55-654ad0c6dea4 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:36.173811 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a611bdaa-e5c9-4371-ba55-654ad0c6dea4 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:36.175201 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a611bdaa-e5c9-4371-ba55-654ad0c6dea4 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:36.215286 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-72f18196-1a67-41ab-86be-2518f0ad4222 tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:16:36.216592 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-72f18196-1a67-41ab-86be-2518f0ad4222 tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] [instance: dfcd2b12-d268-459c-b712-0163a3163384] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:16:36.232597 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-72f18196-1a67-41ab-86be-2518f0ad4222 tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:36.235658 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-72f18196-1a67-41ab-86be-2518f0ad4222 tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:36.237000 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-72f18196-1a67-41ab-86be-2518f0ad4222 tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:36.242001 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-72f18196-1a67-41ab-86be-2518f0ad4222 tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:36.245159 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-72f18196-1a67-41ab-86be-2518f0ad4222 tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:36.246042 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-72f18196-1a67-41ab-86be-2518f0ad4222 tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:36.775946 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-a611bdaa-e5c9-4371-ba55-654ad0c6dea4 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99b5f2cd0a343bc81ca0005f2a74591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2140f8775f4a7495c0f026b4b810b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:16:36.790832 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-a611bdaa-e5c9-4371-ba55-654ad0c6dea4 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] 10.222.0.43 "GET /compute/v2.1/servers/ee3587af-87cb-4a36-98ed-5a5c81eb6f69" status: 200 len: 1523 microversion: 2.1 time: 0.665183 Oct 04 22:16:36.795009 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2863/5657] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:16:36 2022] GET /compute/v2.1/servers/ee3587af-87cb-4a36-98ed-5a5c81eb6f69 => generated 1523 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:16:36.909822 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-76ada247-a06c-4481-800e-f78edd6524fe req-3b8151ec-a725-4508-9ea2-359a16426ddc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfcd2b12-d268-459c-b712-0163a3163384", "name": "network-vif-plugged", "status": "completed", "tag": "3c2df425-a52d-4e1d-aac8-fac3ce841bac"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:16:36.939471 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-76ada247-a06c-4481-800e-f78edd6524fe req-3b8151ec-a725-4508-9ea2-359a16426ddc service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:36.940418 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-76ada247-a06c-4481-800e-f78edd6524fe req-3b8151ec-a725-4508-9ea2-359a16426ddc service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:36.941017 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-76ada247-a06c-4481-800e-f78edd6524fe req-3b8151ec-a725-4508-9ea2-359a16426ddc service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:36.957089 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-76ada247-a06c-4481-800e-f78edd6524fe req-3b8151ec-a725-4508-9ea2-359a16426ddc service nova] Creating event network-vif-plugged:3c2df425-a52d-4e1d-aac8-fac3ce841bac for instance dfcd2b12-d268-459c-b712-0163a3163384 on n-h1-860284-1 Oct 04 22:16:36.966886 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-76ada247-a06c-4481-800e-f78edd6524fe req-3b8151ec-a725-4508-9ea2-359a16426ddc service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062089 Oct 04 22:16:36.968311 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2864/5658] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:16:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:16:37.060058 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-72f18196-1a67-41ab-86be-2518f0ad4222 tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8e7ce1712f146a085427e10710c5171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04f707cdc9464d6f8f5c6cb58d0fbb18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:16:37.080218 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-72f18196-1a67-41ab-86be-2518f0ad4222 tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] 10.222.0.43 "GET /compute/v2.1/servers/dfcd2b12-d268-459c-b712-0163a3163384" status: 200 len: 1325 microversion: 2.1 time: 0.871245 Oct 04 22:16:37.082005 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2795/5659] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:16:36 2022] GET /compute/v2.1/servers/dfcd2b12-d268-459c-b712-0163a3163384 => generated 1325 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:16:37.820869 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-8bf09f5a-b246-4ce9-947b-0dd2a0fd56f0 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:16:37.822527 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-8bf09f5a-b246-4ce9-947b-0dd2a0fd56f0 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] [instance: ee3587af-87cb-4a36-98ed-5a5c81eb6f69] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:16:37.840536 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8bf09f5a-b246-4ce9-947b-0dd2a0fd56f0 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:37.841355 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8bf09f5a-b246-4ce9-947b-0dd2a0fd56f0 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:37.841994 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8bf09f5a-b246-4ce9-947b-0dd2a0fd56f0 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:37.843337 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8bf09f5a-b246-4ce9-947b-0dd2a0fd56f0 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:37.843948 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8bf09f5a-b246-4ce9-947b-0dd2a0fd56f0 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:37.844829 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8bf09f5a-b246-4ce9-947b-0dd2a0fd56f0 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:38.107919 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-5fbe38f9-3aed-484e-95b1-37857ce11d66 tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:16:38.108609 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-5fbe38f9-3aed-484e-95b1-37857ce11d66 tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] [instance: dfcd2b12-d268-459c-b712-0163a3163384] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:16:38.124782 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5fbe38f9-3aed-484e-95b1-37857ce11d66 tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:38.126869 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5fbe38f9-3aed-484e-95b1-37857ce11d66 tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:38.129377 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5fbe38f9-3aed-484e-95b1-37857ce11d66 tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:38.130428 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5fbe38f9-3aed-484e-95b1-37857ce11d66 tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:38.131056 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5fbe38f9-3aed-484e-95b1-37857ce11d66 tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:38.131488 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5fbe38f9-3aed-484e-95b1-37857ce11d66 tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:38.176054 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-8bf09f5a-b246-4ce9-947b-0dd2a0fd56f0 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99b5f2cd0a343bc81ca0005f2a74591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2140f8775f4a7495c0f026b4b810b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:16:38.189949 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-8bf09f5a-b246-4ce9-947b-0dd2a0fd56f0 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] 10.222.0.43 "GET /compute/v2.1/servers/ee3587af-87cb-4a36-98ed-5a5c81eb6f69" status: 200 len: 1523 microversion: 2.1 time: 0.373735 Oct 04 22:16:38.190595 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2865/5660] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:16:37 2022] GET /compute/v2.1/servers/ee3587af-87cb-4a36-98ed-5a5c81eb6f69 => generated 1523 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:16:38.381450 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-5fbe38f9-3aed-484e-95b1-37857ce11d66 tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8e7ce1712f146a085427e10710c5171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04f707cdc9464d6f8f5c6cb58d0fbb18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:16:38.400595 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-5fbe38f9-3aed-484e-95b1-37857ce11d66 tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] 10.222.0.43 "GET /compute/v2.1/servers/dfcd2b12-d268-459c-b712-0163a3163384" status: 200 len: 1325 microversion: 2.1 time: 0.299975 Oct 04 22:16:38.401648 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2796/5661] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:16:38 2022] GET /compute/v2.1/servers/dfcd2b12-d268-459c-b712-0163a3163384 => generated 1325 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:16:39.214883 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-8017fb42-709e-4cde-bd58-84504211b6c7 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:16:39.216304 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-8017fb42-709e-4cde-bd58-84504211b6c7 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] [instance: ee3587af-87cb-4a36-98ed-5a5c81eb6f69] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:16:39.224989 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8017fb42-709e-4cde-bd58-84504211b6c7 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:39.225840 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8017fb42-709e-4cde-bd58-84504211b6c7 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:39.226663 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8017fb42-709e-4cde-bd58-84504211b6c7 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:39.229478 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8017fb42-709e-4cde-bd58-84504211b6c7 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:39.230875 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8017fb42-709e-4cde-bd58-84504211b6c7 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:39.231552 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8017fb42-709e-4cde-bd58-84504211b6c7 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:39.425484 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-693e406f-9e55-42ea-855d-8ca17858c03e tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:16:39.427051 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-693e406f-9e55-42ea-855d-8ca17858c03e tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] [instance: dfcd2b12-d268-459c-b712-0163a3163384] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:16:39.438651 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-693e406f-9e55-42ea-855d-8ca17858c03e tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:39.439158 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-693e406f-9e55-42ea-855d-8ca17858c03e tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:39.439604 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-693e406f-9e55-42ea-855d-8ca17858c03e tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:39.446064 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-693e406f-9e55-42ea-855d-8ca17858c03e tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:39.446880 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-693e406f-9e55-42ea-855d-8ca17858c03e tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:39.447533 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-693e406f-9e55-42ea-855d-8ca17858c03e tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:39.668382 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-8017fb42-709e-4cde-bd58-84504211b6c7 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99b5f2cd0a343bc81ca0005f2a74591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2140f8775f4a7495c0f026b4b810b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:16:39.681265 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-8017fb42-709e-4cde-bd58-84504211b6c7 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] 10.222.0.43 "GET /compute/v2.1/servers/ee3587af-87cb-4a36-98ed-5a5c81eb6f69" status: 200 len: 1523 microversion: 2.1 time: 0.471924 Oct 04 22:16:39.682297 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2866/5662] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:16:39 2022] GET /compute/v2.1/servers/ee3587af-87cb-4a36-98ed-5a5c81eb6f69 => generated 1523 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:16:39.810656 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-693e406f-9e55-42ea-855d-8ca17858c03e tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8e7ce1712f146a085427e10710c5171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04f707cdc9464d6f8f5c6cb58d0fbb18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:16:39.827280 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-693e406f-9e55-42ea-855d-8ca17858c03e tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] 10.222.0.43 "GET /compute/v2.1/servers/dfcd2b12-d268-459c-b712-0163a3163384" status: 200 len: 1521 microversion: 2.1 time: 0.405921 Oct 04 22:16:39.830872 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2797/5663] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:16:39 2022] GET /compute/v2.1/servers/dfcd2b12-d268-459c-b712-0163a3163384 => generated 1521 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:16:39.861922 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-634b3621-30b8-465e-9c1f-5929bf65fce2 tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:16:39.863076 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-634b3621-30b8-465e-9c1f-5929bf65fce2 tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] [instance: dfcd2b12-d268-459c-b712-0163a3163384] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:16:39.872931 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-634b3621-30b8-465e-9c1f-5929bf65fce2 tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:39.877321 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-634b3621-30b8-465e-9c1f-5929bf65fce2 tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:39.878094 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-634b3621-30b8-465e-9c1f-5929bf65fce2 tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:39.879395 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-634b3621-30b8-465e-9c1f-5929bf65fce2 tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:39.879869 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-634b3621-30b8-465e-9c1f-5929bf65fce2 tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:39.880291 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-634b3621-30b8-465e-9c1f-5929bf65fce2 tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:39.928127 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-634b3621-30b8-465e-9c1f-5929bf65fce2 tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] HTTP exception thrown: Instance is not a member of specified network Oct 04 22:16:39.935035 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-634b3621-30b8-465e-9c1f-5929bf65fce2 tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] Request method failure captured: Oct 04 22:16:39.935035 n-d-860284-1 devstack@n-api.service[134102]: request: GET /compute/v2.1/servers/dfcd2b12-d268-459c-b712-0163a3163384/ips/invalid HTTP/1.1 Oct 04 22:16:39.935035 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 22:16:39.935035 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 22:16:39.935035 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 22:16:39.935035 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 22:16:39.935035 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 22:16:39.935035 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 22:16:39.935035 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 22:16:39.935035 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 22:16:39.935035 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPLCyNH-IC_fW0qaSc4jgnS9nGsd3UbT-7PLiZG0UTBGj-7fK8g4IMkGWokO87RYd0Fx9nzagz_MRI46LkAePGwyS9Yj8X2xeoTdXKJDp6frWpRkmDQ40HEoyls7dTmVSz-sC5morH9mnidJVVAsTP2015ChVuqca8bm-wAD0IxyW7dk Oct 04 22:16:39.935035 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 22:16:39.935035 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 22:16:39.935035 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 22:16:39.935035 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 22:16:39.935035 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 22:16:39.935035 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 22:16:39.935035 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: 04f707cdc9464d6f8f5c6cb58d0fbb18 Oct 04 22:16:39.935035 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1695488757 Oct 04 22:16:39.935035 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 22:16:39.935035 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 22:16:39.935035 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/04f707cdc9464d6f8f5c6cb58d0fbb18"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_04f707cdc9464d6f8f5c6cb58d0fbb18", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/04f707cdc9464d6f8f5c6cb58d0fbb18"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/04f707cdc9464d6f8f5c6cb58d0fbb18"}]}] Oct 04 22:16:39.935035 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1695488757 Oct 04 22:16:39.935035 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: 04f707cdc9464d6f8f5c6cb58d0fbb18 Oct 04 22:16:39.935035 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1695488757 Oct 04 22:16:39.935035 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-ServerAddressesNegativeTestJSON-1695488757-project Oct 04 22:16:39.935035 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 22:16:39.935035 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 22:16:39.935035 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: a8e7ce1712f146a085427e10710c5171 Oct 04 22:16:39.935035 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1695488757-project Oct 04 22:16:39.935035 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 22:16:39.935035 n-d-860284-1 devstack@n-api.service[134102]: exception: Instance is not a member of specified network Oct 04 22:16:39.935035 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'server_id': 'dfcd2b12-d268-459c-b712-0163a3163384', 'id': 'invalid'} Oct 04 22:16:39.935035 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:16:39.935035 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:16:39.935035 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:16:39.935035 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:16:39.935035 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:16:39.935035 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:16:39.935035 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:16:39.935035 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:16:39.935035 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 52, in show Oct 04 22:16:39.935035 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 04 22:16:39.935035 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance is not a member of specified network Oct 04 22:16:39.935035 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:16:39.935035 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:16:39.935035 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:16:39.935035 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:16:39.935035 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:16:39.935035 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:16:39.935035 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:16:39.935035 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:16:39.935035 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance is not a member of specified network Oct 04 22:16:39.935035 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:16:39.939747 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-634b3621-30b8-465e-9c1f-5929bf65fce2 tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] Returning 404 to user: Instance is not a member of specified network {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:16:39.940652 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-634b3621-30b8-465e-9c1f-5929bf65fce2 tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] 10.222.0.43 "GET /compute/v2.1/servers/dfcd2b12-d268-459c-b712-0163a3163384/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.083208 Oct 04 22:16:39.947981 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2867/5664] 10.222.0.43 () {58 vars in 1272 bytes} [Tue Oct 4 22:16:39 2022] GET /compute/v2.1/servers/dfcd2b12-d268-459c-b712-0163a3163384/ips/invalid => generated 91 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 22:16:39.953562 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-276d994a-cb43-420f-b7dc-4b9efd63cadd tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:16:39.954045 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-276d994a-cb43-420f-b7dc-4b9efd63cadd tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] Failed to fetch instance by id 999 {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 04 22:16:39.954618 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-276d994a-cb43-420f-b7dc-4b9efd63cadd tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] HTTP exception thrown: Instance 999 could not be found. Oct 04 22:16:39.956368 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-276d994a-cb43-420f-b7dc-4b9efd63cadd tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] Request method failure captured: Oct 04 22:16:39.956368 n-d-860284-1 devstack@n-api.service[134101]: request: GET /compute/v2.1/servers/999/ips HTTP/1.1 Oct 04 22:16:39.956368 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 22:16:39.956368 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 22:16:39.956368 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 22:16:39.956368 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 22:16:39.956368 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 22:16:39.956368 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 22:16:39.956368 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 22:16:39.956368 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 22:16:39.956368 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPLCyNH-IC_fW0qaSc4jgnS9nGsd3UbT-7PLiZG0UTBGj-7fK8g4IMkGWokO87RYd0Fx9nzagz_MRI46LkAePGwyS9Yj8X2xeoTdXKJDp6frWpRkmDQ40HEoyls7dTmVSz-sC5morH9mnidJVVAsTP2015ChVuqca8bm-wAD0IxyW7dk Oct 04 22:16:39.956368 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 22:16:39.956368 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 22:16:39.956368 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 22:16:39.956368 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 22:16:39.956368 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 22:16:39.956368 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 22:16:39.956368 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: 04f707cdc9464d6f8f5c6cb58d0fbb18 Oct 04 22:16:39.956368 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1695488757 Oct 04 22:16:39.956368 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 22:16:39.956368 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 22:16:39.956368 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/04f707cdc9464d6f8f5c6cb58d0fbb18"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_04f707cdc9464d6f8f5c6cb58d0fbb18", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/04f707cdc9464d6f8f5c6cb58d0fbb18"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/04f707cdc9464d6f8f5c6cb58d0fbb18"}]}] Oct 04 22:16:39.956368 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1695488757 Oct 04 22:16:39.956368 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: 04f707cdc9464d6f8f5c6cb58d0fbb18 Oct 04 22:16:39.956368 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1695488757 Oct 04 22:16:39.956368 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-ServerAddressesNegativeTestJSON-1695488757-project Oct 04 22:16:39.956368 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 22:16:39.956368 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 22:16:39.956368 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: a8e7ce1712f146a085427e10710c5171 Oct 04 22:16:39.956368 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1695488757-project Oct 04 22:16:39.956368 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 22:16:39.956368 n-d-860284-1 devstack@n-api.service[134101]: exception: Instance 999 could not be found. Oct 04 22:16:39.956368 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'server_id': '999'} Oct 04 22:16:39.956368 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:16:39.956368 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:16:39.956368 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:16:39.956368 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:16:39.956368 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 04 22:16:39.956368 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 04 22:16:39.956368 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Oct 04 22:16:39.956368 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:16:39.956368 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:16:39.956368 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:16:39.956368 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:16:39.956368 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:16:39.956368 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:16:39.956368 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:16:39.956368 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:16:39.956368 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:16:39.956368 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:16:39.956368 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 37, in index Oct 04 22:16:39.956368 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self._compute_api, context, server_id) Oct 04 22:16:39.956368 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:16:39.956368 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:16:39.956368 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Oct 04 22:16:39.956368 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:16:39.956368 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:16:39.956368 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:16:39.956368 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:16:39.956368 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:16:39.956368 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:16:39.956368 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:16:39.956368 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:16:39.956368 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Oct 04 22:16:39.956368 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:16:39.960582 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-276d994a-cb43-420f-b7dc-4b9efd63cadd tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] Returning 404 to user: Instance 999 could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:16:39.960582 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-276d994a-cb43-420f-b7dc-4b9efd63cadd tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] 10.222.0.43 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.008706 Oct 04 22:16:39.965611 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2798/5665] 10.222.0.43 () {58 vars in 1149 bytes} [Tue Oct 4 22:16:39 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 22:16:39.969633 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-7c9528e1-29fe-4e13-9822-3c856decfc7b tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:16:39.970936 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-7c9528e1-29fe-4e13-9822-3c856decfc7b tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] [instance: dfcd2b12-d268-459c-b712-0163a3163384] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:16:39.980251 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7c9528e1-29fe-4e13-9822-3c856decfc7b tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:39.981315 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7c9528e1-29fe-4e13-9822-3c856decfc7b tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:39.982004 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7c9528e1-29fe-4e13-9822-3c856decfc7b tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:39.984079 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7c9528e1-29fe-4e13-9822-3c856decfc7b tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:39.985002 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7c9528e1-29fe-4e13-9822-3c856decfc7b tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:39.985670 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7c9528e1-29fe-4e13-9822-3c856decfc7b tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:40.033512 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-7c9528e1-29fe-4e13-9822-3c856decfc7b tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] [instance: dfcd2b12-d268-459c-b712-0163a3163384] Going to try to terminate instance {{(pid=134102) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 22:16:40.163553 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-7c9528e1-29fe-4e13-9822-3c856decfc7b tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] 10.222.0.43 "DELETE /compute/v2.1/servers/dfcd2b12-d268-459c-b712-0163a3163384" status: 204 len: 0 microversion: 2.1 time: 0.198655 Oct 04 22:16:40.164689 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2868/5666] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 22:16:39 2022] DELETE /compute/v2.1/servers/dfcd2b12-d268-459c-b712-0163a3163384 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 22:16:40.173539 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-30d0f8f9-8890-4f56-925d-ebf69ed90843 tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:16:40.174532 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-30d0f8f9-8890-4f56-925d-ebf69ed90843 tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] [instance: dfcd2b12-d268-459c-b712-0163a3163384] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:16:40.184549 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-30d0f8f9-8890-4f56-925d-ebf69ed90843 tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:40.185321 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-30d0f8f9-8890-4f56-925d-ebf69ed90843 tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:40.185948 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-30d0f8f9-8890-4f56-925d-ebf69ed90843 tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:40.186872 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-30d0f8f9-8890-4f56-925d-ebf69ed90843 tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:40.187493 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-30d0f8f9-8890-4f56-925d-ebf69ed90843 tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:40.190954 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-30d0f8f9-8890-4f56-925d-ebf69ed90843 tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:40.371790 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-30d0f8f9-8890-4f56-925d-ebf69ed90843 tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8e7ce1712f146a085427e10710c5171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04f707cdc9464d6f8f5c6cb58d0fbb18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:16:40.381691 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-30d0f8f9-8890-4f56-925d-ebf69ed90843 tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] 10.222.0.43 "GET /compute/v2.1/servers/dfcd2b12-d268-459c-b712-0163a3163384" status: 200 len: 1527 microversion: 2.1 time: 0.212302 Oct 04 22:16:40.382640 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2799/5667] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:16:40 2022] GET /compute/v2.1/servers/dfcd2b12-d268-459c-b712-0163a3163384 => generated 1527 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:16:40.708027 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-03bd9434-56ff-47c6-a044-d6ab785707ba tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:16:40.709358 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-03bd9434-56ff-47c6-a044-d6ab785707ba tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] [instance: ee3587af-87cb-4a36-98ed-5a5c81eb6f69] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:16:40.718003 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-03bd9434-56ff-47c6-a044-d6ab785707ba tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:40.718951 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-03bd9434-56ff-47c6-a044-d6ab785707ba tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:40.719579 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-03bd9434-56ff-47c6-a044-d6ab785707ba tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:40.720532 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-03bd9434-56ff-47c6-a044-d6ab785707ba tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:40.721212 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-03bd9434-56ff-47c6-a044-d6ab785707ba tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:40.721827 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-03bd9434-56ff-47c6-a044-d6ab785707ba tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:40.909546 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-03bd9434-56ff-47c6-a044-d6ab785707ba tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99b5f2cd0a343bc81ca0005f2a74591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2140f8775f4a7495c0f026b4b810b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:16:40.924772 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-03bd9434-56ff-47c6-a044-d6ab785707ba tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] 10.222.0.43 "GET /compute/v2.1/servers/ee3587af-87cb-4a36-98ed-5a5c81eb6f69" status: 200 len: 1523 microversion: 2.1 time: 0.220875 Oct 04 22:16:40.934632 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2869/5668] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:16:40 2022] GET /compute/v2.1/servers/ee3587af-87cb-4a36-98ed-5a5c81eb6f69 => generated 1523 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:16:41.408134 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-d3608e16-5c2e-46ad-8547-57baf871f95b tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:16:41.408775 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-d3608e16-5c2e-46ad-8547-57baf871f95b tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] [instance: dfcd2b12-d268-459c-b712-0163a3163384] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:16:41.424455 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d3608e16-5c2e-46ad-8547-57baf871f95b tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:41.430658 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d3608e16-5c2e-46ad-8547-57baf871f95b tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:41.432790 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d3608e16-5c2e-46ad-8547-57baf871f95b tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:41.434799 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d3608e16-5c2e-46ad-8547-57baf871f95b tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:41.436583 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d3608e16-5c2e-46ad-8547-57baf871f95b tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:41.437266 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d3608e16-5c2e-46ad-8547-57baf871f95b tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:41.740439 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-d3608e16-5c2e-46ad-8547-57baf871f95b tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8e7ce1712f146a085427e10710c5171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04f707cdc9464d6f8f5c6cb58d0fbb18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:16:41.752249 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-d3608e16-5c2e-46ad-8547-57baf871f95b tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] 10.222.0.43 "GET /compute/v2.1/servers/dfcd2b12-d268-459c-b712-0163a3163384" status: 200 len: 1527 microversion: 2.1 time: 0.349833 Oct 04 22:16:41.766391 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2800/5669] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:16:41 2022] GET /compute/v2.1/servers/dfcd2b12-d268-459c-b712-0163a3163384 => generated 1527 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:16:41.957850 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-1e74cbaa-5a27-4ad5-801e-cf2805503a2b tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:16:41.958847 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-1e74cbaa-5a27-4ad5-801e-cf2805503a2b tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] [instance: ee3587af-87cb-4a36-98ed-5a5c81eb6f69] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:16:41.971642 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1e74cbaa-5a27-4ad5-801e-cf2805503a2b tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:41.972682 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1e74cbaa-5a27-4ad5-801e-cf2805503a2b tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:41.973444 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1e74cbaa-5a27-4ad5-801e-cf2805503a2b tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:41.974552 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1e74cbaa-5a27-4ad5-801e-cf2805503a2b tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:41.975448 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1e74cbaa-5a27-4ad5-801e-cf2805503a2b tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:41.976105 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1e74cbaa-5a27-4ad5-801e-cf2805503a2b tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:42.250633 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-1e74cbaa-5a27-4ad5-801e-cf2805503a2b tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99b5f2cd0a343bc81ca0005f2a74591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2140f8775f4a7495c0f026b4b810b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:16:42.262169 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-1e74cbaa-5a27-4ad5-801e-cf2805503a2b tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] 10.222.0.43 "GET /compute/v2.1/servers/ee3587af-87cb-4a36-98ed-5a5c81eb6f69" status: 200 len: 1523 microversion: 2.1 time: 0.307586 Oct 04 22:16:42.263152 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2870/5670] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:16:41 2022] GET /compute/v2.1/servers/ee3587af-87cb-4a36-98ed-5a5c81eb6f69 => generated 1523 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:16:42.778183 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-2b8d42c8-e03c-4758-8e2a-71e6956b7bf3 tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:16:42.778962 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-2b8d42c8-e03c-4758-8e2a-71e6956b7bf3 tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] [instance: dfcd2b12-d268-459c-b712-0163a3163384] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:16:42.792783 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2b8d42c8-e03c-4758-8e2a-71e6956b7bf3 tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:42.794006 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2b8d42c8-e03c-4758-8e2a-71e6956b7bf3 tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:42.794795 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2b8d42c8-e03c-4758-8e2a-71e6956b7bf3 tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:42.795759 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2b8d42c8-e03c-4758-8e2a-71e6956b7bf3 tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:42.796870 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2b8d42c8-e03c-4758-8e2a-71e6956b7bf3 tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:42.797704 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2b8d42c8-e03c-4758-8e2a-71e6956b7bf3 tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:42.931166 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-2b8d42c8-e03c-4758-8e2a-71e6956b7bf3 tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8e7ce1712f146a085427e10710c5171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04f707cdc9464d6f8f5c6cb58d0fbb18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:16:42.940188 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-2b8d42c8-e03c-4758-8e2a-71e6956b7bf3 tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] 10.222.0.43 "GET /compute/v2.1/servers/dfcd2b12-d268-459c-b712-0163a3163384" status: 200 len: 1485 microversion: 2.1 time: 0.167628 Oct 04 22:16:42.940789 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2801/5671] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:16:42 2022] GET /compute/v2.1/servers/dfcd2b12-d268-459c-b712-0163a3163384 => generated 1485 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:16:43.064111 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-b20ea5e7-7980-4025-add4-3808c5f58255 req-3340ffec-d9cc-4ef7-bfc7-42fc74084740 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfcd2b12-d268-459c-b712-0163a3163384", "name": "network-vif-deleted", "tag": "3c2df425-a52d-4e1d-aac8-fac3ce841bac"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:16:43.081331 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-b20ea5e7-7980-4025-add4-3808c5f58255 req-3340ffec-d9cc-4ef7-bfc7-42fc74084740 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:43.082249 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-b20ea5e7-7980-4025-add4-3808c5f58255 req-3340ffec-d9cc-4ef7-bfc7-42fc74084740 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:43.084380 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-b20ea5e7-7980-4025-add4-3808c5f58255 req-3340ffec-d9cc-4ef7-bfc7-42fc74084740 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:43.134987 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-b20ea5e7-7980-4025-add4-3808c5f58255 req-3340ffec-d9cc-4ef7-bfc7-42fc74084740 service nova] Creating event network-vif-deleted:3c2df425-a52d-4e1d-aac8-fac3ce841bac for instance dfcd2b12-d268-459c-b712-0163a3163384 on n-h1-860284-1 Oct 04 22:16:43.151099 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-b20ea5e7-7980-4025-add4-3808c5f58255 req-3340ffec-d9cc-4ef7-bfc7-42fc74084740 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091816 Oct 04 22:16:43.155813 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2871/5672] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:16:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:16:43.288419 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-570d24b6-44cb-40b7-879d-ea87e346484e tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:16:43.289071 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-570d24b6-44cb-40b7-879d-ea87e346484e tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] [instance: ee3587af-87cb-4a36-98ed-5a5c81eb6f69] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:16:43.307689 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-570d24b6-44cb-40b7-879d-ea87e346484e tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:43.309058 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-570d24b6-44cb-40b7-879d-ea87e346484e tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:43.309692 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-570d24b6-44cb-40b7-879d-ea87e346484e tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:43.313731 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-570d24b6-44cb-40b7-879d-ea87e346484e tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:43.314845 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-570d24b6-44cb-40b7-879d-ea87e346484e tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:43.315572 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-570d24b6-44cb-40b7-879d-ea87e346484e tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:43.609343 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-570d24b6-44cb-40b7-879d-ea87e346484e tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99b5f2cd0a343bc81ca0005f2a74591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2140f8775f4a7495c0f026b4b810b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:16:43.647358 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-570d24b6-44cb-40b7-879d-ea87e346484e tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] 10.222.0.43 "GET /compute/v2.1/servers/ee3587af-87cb-4a36-98ed-5a5c81eb6f69" status: 200 len: 1523 microversion: 2.1 time: 0.362990 Oct 04 22:16:43.666996 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2802/5673] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:16:43 2022] GET /compute/v2.1/servers/ee3587af-87cb-4a36-98ed-5a5c81eb6f69 => generated 1523 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:16:43.968744 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-9e6453ea-32a3-4bb2-bbff-73bedd8ac965 tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:16:43.971977 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-9e6453ea-32a3-4bb2-bbff-73bedd8ac965 tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] [instance: dfcd2b12-d268-459c-b712-0163a3163384] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:16:43.991032 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9e6453ea-32a3-4bb2-bbff-73bedd8ac965 tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:43.991854 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9e6453ea-32a3-4bb2-bbff-73bedd8ac965 tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:43.993860 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9e6453ea-32a3-4bb2-bbff-73bedd8ac965 tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:43.995175 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9e6453ea-32a3-4bb2-bbff-73bedd8ac965 tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:43.995714 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9e6453ea-32a3-4bb2-bbff-73bedd8ac965 tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:43.996473 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9e6453ea-32a3-4bb2-bbff-73bedd8ac965 tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:44.019506 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-9e6453ea-32a3-4bb2-bbff-73bedd8ac965 tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] HTTP exception thrown: Instance dfcd2b12-d268-459c-b712-0163a3163384 could not be found. Oct 04 22:16:44.021730 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-9e6453ea-32a3-4bb2-bbff-73bedd8ac965 tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] Request method failure captured: Oct 04 22:16:44.021730 n-d-860284-1 devstack@n-api.service[134102]: request: GET /compute/v2.1/servers/dfcd2b12-d268-459c-b712-0163a3163384 HTTP/1.1 Oct 04 22:16:44.021730 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 22:16:44.021730 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 22:16:44.021730 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 22:16:44.021730 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 22:16:44.021730 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 22:16:44.021730 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 22:16:44.021730 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 22:16:44.021730 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 22:16:44.021730 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPLCyNH-IC_fW0qaSc4jgnS9nGsd3UbT-7PLiZG0UTBGj-7fK8g4IMkGWokO87RYd0Fx9nzagz_MRI46LkAePGwyS9Yj8X2xeoTdXKJDp6frWpRkmDQ40HEoyls7dTmVSz-sC5morH9mnidJVVAsTP2015ChVuqca8bm-wAD0IxyW7dk Oct 04 22:16:44.021730 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 22:16:44.021730 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 22:16:44.021730 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 22:16:44.021730 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 22:16:44.021730 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 22:16:44.021730 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 22:16:44.021730 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: 04f707cdc9464d6f8f5c6cb58d0fbb18 Oct 04 22:16:44.021730 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1695488757 Oct 04 22:16:44.021730 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 22:16:44.021730 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 22:16:44.021730 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/04f707cdc9464d6f8f5c6cb58d0fbb18"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_04f707cdc9464d6f8f5c6cb58d0fbb18", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/04f707cdc9464d6f8f5c6cb58d0fbb18"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/04f707cdc9464d6f8f5c6cb58d0fbb18"}]}] Oct 04 22:16:44.021730 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1695488757 Oct 04 22:16:44.021730 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: 04f707cdc9464d6f8f5c6cb58d0fbb18 Oct 04 22:16:44.021730 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1695488757 Oct 04 22:16:44.021730 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-ServerAddressesNegativeTestJSON-1695488757-project Oct 04 22:16:44.021730 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 22:16:44.021730 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 22:16:44.021730 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: a8e7ce1712f146a085427e10710c5171 Oct 04 22:16:44.021730 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1695488757-project Oct 04 22:16:44.021730 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 22:16:44.021730 n-d-860284-1 devstack@n-api.service[134102]: exception: Instance dfcd2b12-d268-459c-b712-0163a3163384 could not be found. Oct 04 22:16:44.021730 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': 'dfcd2b12-d268-459c-b712-0163a3163384'} Oct 04 22:16:44.021730 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:16:44.021730 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:16:44.021730 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:16:44.021730 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:16:44.021730 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:16:44.021730 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:16:44.021730 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:16:44.021730 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:16:44.021730 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:16:44.021730 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:16:44.021730 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dfcd2b12-d268-459c-b712-0163a3163384 could not be found. Oct 04 22:16:44.021730 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:16:44.021730 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:16:44.021730 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:16:44.021730 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:16:44.021730 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:16:44.021730 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:16:44.021730 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:16:44.021730 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:16:44.021730 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:16:44.021730 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:16:44.021730 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:16:44.021730 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:16:44.021730 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:16:44.021730 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:16:44.021730 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:16:44.021730 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:16:44.021730 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dfcd2b12-d268-459c-b712-0163a3163384 could not be found. Oct 04 22:16:44.021730 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:16:44.021730 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:16:44.026903 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:16:44.026903 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:16:44.026903 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:16:44.026903 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:16:44.026903 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:16:44.026903 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:16:44.026903 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dfcd2b12-d268-459c-b712-0163a3163384 could not be found. Oct 04 22:16:44.026903 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:16:44.026903 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-9e6453ea-32a3-4bb2-bbff-73bedd8ac965 tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] Returning 404 to user: Instance dfcd2b12-d268-459c-b712-0163a3163384 could not be found. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:16:44.026903 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-9e6453ea-32a3-4bb2-bbff-73bedd8ac965 tempest-ServerAddressesNegativeTestJSON-1695488757 tempest-ServerAddressesNegativeTestJSON-1695488757-project] 10.222.0.43 "GET /compute/v2.1/servers/dfcd2b12-d268-459c-b712-0163a3163384" status: 404 len: 111 microversion: 2.1 time: 0.064336 Oct 04 22:16:44.030598 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2872/5674] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:16:43 2022] GET /compute/v2.1/servers/dfcd2b12-d268-459c-b712-0163a3163384 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:16:44.677838 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-5f5f8c2f-d273-4704-ac01-98557629eee4 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:16:44.678771 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-5f5f8c2f-d273-4704-ac01-98557629eee4 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] [instance: ee3587af-87cb-4a36-98ed-5a5c81eb6f69] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:16:44.693911 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5f5f8c2f-d273-4704-ac01-98557629eee4 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:44.696050 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5f5f8c2f-d273-4704-ac01-98557629eee4 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:44.697439 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5f5f8c2f-d273-4704-ac01-98557629eee4 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:44.706959 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5f5f8c2f-d273-4704-ac01-98557629eee4 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:44.707459 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5f5f8c2f-d273-4704-ac01-98557629eee4 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:44.707909 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5f5f8c2f-d273-4704-ac01-98557629eee4 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:45.341167 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-5f5f8c2f-d273-4704-ac01-98557629eee4 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99b5f2cd0a343bc81ca0005f2a74591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2140f8775f4a7495c0f026b4b810b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:16:45.356702 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-5f5f8c2f-d273-4704-ac01-98557629eee4 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] 10.222.0.43 "GET /compute/v2.1/servers/ee3587af-87cb-4a36-98ed-5a5c81eb6f69" status: 200 len: 1523 microversion: 2.1 time: 0.681136 Oct 04 22:16:45.359610 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2803/5675] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:16:44 2022] GET /compute/v2.1/servers/ee3587af-87cb-4a36-98ed-5a5c81eb6f69 => generated 1523 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:16:46.385363 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-f79dc448-d03f-47b0-b48f-f3aab5bda5d6 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:16:46.386896 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-f79dc448-d03f-47b0-b48f-f3aab5bda5d6 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] [instance: ee3587af-87cb-4a36-98ed-5a5c81eb6f69] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:16:46.406294 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f79dc448-d03f-47b0-b48f-f3aab5bda5d6 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:46.407077 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f79dc448-d03f-47b0-b48f-f3aab5bda5d6 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:46.407536 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f79dc448-d03f-47b0-b48f-f3aab5bda5d6 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:46.408379 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f79dc448-d03f-47b0-b48f-f3aab5bda5d6 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:46.408848 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f79dc448-d03f-47b0-b48f-f3aab5bda5d6 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:46.409431 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f79dc448-d03f-47b0-b48f-f3aab5bda5d6 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:46.452943 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:16:46.981457 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-f79dc448-d03f-47b0-b48f-f3aab5bda5d6 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99b5f2cd0a343bc81ca0005f2a74591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2140f8775f4a7495c0f026b4b810b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:16:46.996385 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-f79dc448-d03f-47b0-b48f-f3aab5bda5d6 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] 10.222.0.43 "GET /compute/v2.1/servers/ee3587af-87cb-4a36-98ed-5a5c81eb6f69" status: 200 len: 1523 microversion: 2.1 time: 0.616599 Oct 04 22:16:46.998220 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2873/5676] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:16:46 2022] GET /compute/v2.1/servers/ee3587af-87cb-4a36-98ed-5a5c81eb6f69 => generated 1523 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:16:48.020949 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-b6dee91d-71ea-448e-a8da-628c0c21dbcd tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:16:48.021573 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-b6dee91d-71ea-448e-a8da-628c0c21dbcd tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] [instance: ee3587af-87cb-4a36-98ed-5a5c81eb6f69] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:16:48.030122 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b6dee91d-71ea-448e-a8da-628c0c21dbcd tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:48.031063 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b6dee91d-71ea-448e-a8da-628c0c21dbcd tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:48.031763 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b6dee91d-71ea-448e-a8da-628c0c21dbcd tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:48.032882 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b6dee91d-71ea-448e-a8da-628c0c21dbcd tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:48.033512 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b6dee91d-71ea-448e-a8da-628c0c21dbcd tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:48.034110 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b6dee91d-71ea-448e-a8da-628c0c21dbcd tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:48.912633 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-b6dee91d-71ea-448e-a8da-628c0c21dbcd tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99b5f2cd0a343bc81ca0005f2a74591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2140f8775f4a7495c0f026b4b810b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:16:48.925309 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-b6dee91d-71ea-448e-a8da-628c0c21dbcd tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] 10.222.0.43 "GET /compute/v2.1/servers/ee3587af-87cb-4a36-98ed-5a5c81eb6f69" status: 200 len: 1523 microversion: 2.1 time: 0.905566 Oct 04 22:16:48.926003 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2804/5677] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:16:48 2022] GET /compute/v2.1/servers/ee3587af-87cb-4a36-98ed-5a5c81eb6f69 => generated 1523 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:16:49.953294 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-35e138c6-97ce-46e9-b2ef-44a69c78adaf tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:16:49.954181 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-35e138c6-97ce-46e9-b2ef-44a69c78adaf tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] [instance: ee3587af-87cb-4a36-98ed-5a5c81eb6f69] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:16:49.968617 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:16:49.979389 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-35e138c6-97ce-46e9-b2ef-44a69c78adaf tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:49.979904 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-35e138c6-97ce-46e9-b2ef-44a69c78adaf tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:49.981889 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-35e138c6-97ce-46e9-b2ef-44a69c78adaf tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:49.984069 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-35e138c6-97ce-46e9-b2ef-44a69c78adaf tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:49.984684 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-35e138c6-97ce-46e9-b2ef-44a69c78adaf tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:49.985132 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-35e138c6-97ce-46e9-b2ef-44a69c78adaf tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:50.632587 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-35e138c6-97ce-46e9-b2ef-44a69c78adaf tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99b5f2cd0a343bc81ca0005f2a74591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2140f8775f4a7495c0f026b4b810b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:16:50.649580 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-35e138c6-97ce-46e9-b2ef-44a69c78adaf tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] 10.222.0.43 "GET /compute/v2.1/servers/ee3587af-87cb-4a36-98ed-5a5c81eb6f69" status: 200 len: 1523 microversion: 2.1 time: 0.698236 Oct 04 22:16:50.650323 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2874/5678] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:16:49 2022] GET /compute/v2.1/servers/ee3587af-87cb-4a36-98ed-5a5c81eb6f69 => generated 1523 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:16:51.675494 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-0e88f536-dcd1-4267-a30d-947cb3edf464 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:16:51.676119 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-0e88f536-dcd1-4267-a30d-947cb3edf464 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] [instance: ee3587af-87cb-4a36-98ed-5a5c81eb6f69] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:16:51.684807 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:16:51.695627 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0e88f536-dcd1-4267-a30d-947cb3edf464 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:51.702706 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0e88f536-dcd1-4267-a30d-947cb3edf464 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:51.708287 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0e88f536-dcd1-4267-a30d-947cb3edf464 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:51.709299 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0e88f536-dcd1-4267-a30d-947cb3edf464 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:51.716660 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0e88f536-dcd1-4267-a30d-947cb3edf464 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:51.717426 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0e88f536-dcd1-4267-a30d-947cb3edf464 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:52.266334 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-0e88f536-dcd1-4267-a30d-947cb3edf464 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99b5f2cd0a343bc81ca0005f2a74591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2140f8775f4a7495c0f026b4b810b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:16:52.279766 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-0e88f536-dcd1-4267-a30d-947cb3edf464 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] 10.222.0.43 "GET /compute/v2.1/servers/ee3587af-87cb-4a36-98ed-5a5c81eb6f69" status: 200 len: 1503 microversion: 2.1 time: 0.606259 Oct 04 22:16:52.287675 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2805/5679] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:16:51 2022] GET /compute/v2.1/servers/ee3587af-87cb-4a36-98ed-5a5c81eb6f69 => generated 1503 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:16:52.308469 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-1548e96c-7c15-4a0e-91e8-2031ed1891bd tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Action: 'create', calling method: .version_select at 0x7fbb2e17eb80>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-77649646", "description": "tempest-description-367464481"}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:16:52.747831 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-1548e96c-7c15-4a0e-91e8-2031ed1891bd tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] 10.222.0.43 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.444387 Oct 04 22:16:52.748929 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2875/5680] 10.222.0.43 () {60 vars in 1180 bytes} [Tue Oct 4 22:16:52 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:16:52.763908 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-b2f66c46-9cd3-4a0a-a186-cef511d20b9b tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-77649646"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:16:52.765041 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-b2f66c46-9cd3-4a0a-a186-cef511d20b9b tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] [instance: ee3587af-87cb-4a36-98ed-5a5c81eb6f69] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:16:52.783205 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b2f66c46-9cd3-4a0a-a186-cef511d20b9b tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:52.784305 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b2f66c46-9cd3-4a0a-a186-cef511d20b9b tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:52.785707 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b2f66c46-9cd3-4a0a-a186-cef511d20b9b tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:52.787035 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b2f66c46-9cd3-4a0a-a186-cef511d20b9b tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:52.787736 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b2f66c46-9cd3-4a0a-a186-cef511d20b9b tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:52.788511 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b2f66c46-9cd3-4a0a-a186-cef511d20b9b tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:53.236586 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.network.security_group_api [None req-b2f66c46-9cd3-4a0a-a186-cef511d20b9b tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Adding security group a0189f35-6c73-4bce-a1b3-99750ff46fb3 to port 22225028-5a17-4dd6-9593-448f6f20fd77 Oct 04 22:16:54.671582 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-b2f66c46-9cd3-4a0a-a186-cef511d20b9b tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] 10.222.0.43 "POST /compute/v2.1/servers/ee3587af-87cb-4a36-98ed-5a5c81eb6f69/action" status: 202 len: 0 microversion: 2.1 time: 1.912349 Oct 04 22:16:54.682186 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-16c814b4-9bd1-4ef8-af5c-482aa1912b24 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-77649646"}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:16:54.683509 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2806/5681] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 22:16:52 2022] POST /compute/v2.1/servers/ee3587af-87cb-4a36-98ed-5a5c81eb6f69/action => generated 0 bytes in 1925 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 22:16:54.684173 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-16c814b4-9bd1-4ef8-af5c-482aa1912b24 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] [instance: ee3587af-87cb-4a36-98ed-5a5c81eb6f69] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:16:54.703198 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-16c814b4-9bd1-4ef8-af5c-482aa1912b24 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:54.703944 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-16c814b4-9bd1-4ef8-af5c-482aa1912b24 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:54.704550 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-16c814b4-9bd1-4ef8-af5c-482aa1912b24 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:54.705580 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-16c814b4-9bd1-4ef8-af5c-482aa1912b24 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:54.706241 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-16c814b4-9bd1-4ef8-af5c-482aa1912b24 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:54.706607 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-16c814b4-9bd1-4ef8-af5c-482aa1912b24 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:55.045910 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-810e7172-98f9-424c-a161-dcbab9169442 req-04d76dd9-f8ad-4d37-850b-18b8556e6844 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee3587af-87cb-4a36-98ed-5a5c81eb6f69", "tag": "22225028-5a17-4dd6-9593-448f6f20fd77"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:16:55.065700 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-810e7172-98f9-424c-a161-dcbab9169442 req-04d76dd9-f8ad-4d37-850b-18b8556e6844 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:55.069085 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-810e7172-98f9-424c-a161-dcbab9169442 req-04d76dd9-f8ad-4d37-850b-18b8556e6844 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:55.072416 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-810e7172-98f9-424c-a161-dcbab9169442 req-04d76dd9-f8ad-4d37-850b-18b8556e6844 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:55.112716 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-810e7172-98f9-424c-a161-dcbab9169442 req-04d76dd9-f8ad-4d37-850b-18b8556e6844 service nova] Creating event network-changed:22225028-5a17-4dd6-9593-448f6f20fd77 for instance ee3587af-87cb-4a36-98ed-5a5c81eb6f69 on n-h2-860284-1 Oct 04 22:16:55.131735 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-810e7172-98f9-424c-a161-dcbab9169442 req-04d76dd9-f8ad-4d37-850b-18b8556e6844 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.358238 Oct 04 22:16:55.135780 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2807/5682] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:16:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:16:55.345017 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.network.security_group_api [None req-16c814b4-9bd1-4ef8-af5c-482aa1912b24 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Removing security group a0189f35-6c73-4bce-a1b3-99750ff46fb3 from port 22225028-5a17-4dd6-9593-448f6f20fd77 Oct 04 22:16:56.535121 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-16c814b4-9bd1-4ef8-af5c-482aa1912b24 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] 10.222.0.43 "POST /compute/v2.1/servers/ee3587af-87cb-4a36-98ed-5a5c81eb6f69/action" status: 202 len: 0 microversion: 2.1 time: 1.857975 Oct 04 22:16:56.540074 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2876/5683] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 22:16:54 2022] POST /compute/v2.1/servers/ee3587af-87cb-4a36-98ed-5a5c81eb6f69/action => generated 0 bytes in 1864 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 22:16:56.564106 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-a68dbabf-87f8-4ae1-b63e-f178c63387d2 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Action: 'create', calling method: .version_select at 0x7fbb2d9dd310>, body: {"pool": null} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:16:57.268134 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-20f2e098-2795-40a8-b00e-6fd75bbc3f84 req-05368658-bd23-4291-8622-f82bae44f35d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee3587af-87cb-4a36-98ed-5a5c81eb6f69", "tag": "22225028-5a17-4dd6-9593-448f6f20fd77"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:16:57.285586 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-20f2e098-2795-40a8-b00e-6fd75bbc3f84 req-05368658-bd23-4291-8622-f82bae44f35d service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:57.287524 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-20f2e098-2795-40a8-b00e-6fd75bbc3f84 req-05368658-bd23-4291-8622-f82bae44f35d service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:57.288569 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-20f2e098-2795-40a8-b00e-6fd75bbc3f84 req-05368658-bd23-4291-8622-f82bae44f35d service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:57.314292 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-20f2e098-2795-40a8-b00e-6fd75bbc3f84 req-05368658-bd23-4291-8622-f82bae44f35d service nova] Creating event network-changed:22225028-5a17-4dd6-9593-448f6f20fd77 for instance ee3587af-87cb-4a36-98ed-5a5c81eb6f69 on n-h2-860284-1 Oct 04 22:16:57.320857 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-20f2e098-2795-40a8-b00e-6fd75bbc3f84 req-05368658-bd23-4291-8622-f82bae44f35d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061359 Oct 04 22:16:57.322912 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2877/5684] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:16:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:17:02.317444 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-a68dbabf-87f8-4ae1-b63e-f178c63387d2 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] 10.222.0.43 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 5.772006 Oct 04 22:17:02.318049 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2808/5685] 10.222.0.43 () {60 vars in 1170 bytes} [Tue Oct 4 22:16:56 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 5774 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:17:02.333369 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-51366a8b-bcfb-47a1-80f4-0eb343d05185 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.1.94"}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:17:02.340962 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-51366a8b-bcfb-47a1-80f4-0eb343d05185 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] [instance: ee3587af-87cb-4a36-98ed-5a5c81eb6f69] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:17:02.350992 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-51366a8b-bcfb-47a1-80f4-0eb343d05185 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:17:02.355245 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-51366a8b-bcfb-47a1-80f4-0eb343d05185 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:17:02.355776 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-51366a8b-bcfb-47a1-80f4-0eb343d05185 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:17:02.356541 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-51366a8b-bcfb-47a1-80f4-0eb343d05185 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:17:02.361709 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-51366a8b-bcfb-47a1-80f4-0eb343d05185 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:17:02.362993 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-51366a8b-bcfb-47a1-80f4-0eb343d05185 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:17:02.419401 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-51366a8b-bcfb-47a1-80f4-0eb343d05185 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Acquiring lock "refresh_cache-ee3587af-87cb-4a36-98ed-5a5c81eb6f69" {{(pid=134102) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 04 22:17:02.423372 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-51366a8b-bcfb-47a1-80f4-0eb343d05185 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Acquired lock "refresh_cache-ee3587af-87cb-4a36-98ed-5a5c81eb6f69" {{(pid=134102) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 04 22:17:06.995524 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.network.neutron [None req-51366a8b-bcfb-47a1-80f4-0eb343d05185 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] [instance: ee3587af-87cb-4a36-98ed-5a5c81eb6f69] Building network info cache for instance {{(pid=134102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 04 22:17:07.005024 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=5 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:17:07.005792 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=94 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:17:07.011716 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-b0705567-637d-470c-ba3a-85c17f1b9b46 req-3ee73b55-bf25-46eb-989a-e3ecb358621a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee3587af-87cb-4a36-98ed-5a5c81eb6f69", "tag": "22225028-5a17-4dd6-9593-448f6f20fd77"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:17:07.049329 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-b0705567-637d-470c-ba3a-85c17f1b9b46 req-3ee73b55-bf25-46eb-989a-e3ecb358621a service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:17:07.049845 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-b0705567-637d-470c-ba3a-85c17f1b9b46 req-3ee73b55-bf25-46eb-989a-e3ecb358621a service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:17:07.050320 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-b0705567-637d-470c-ba3a-85c17f1b9b46 req-3ee73b55-bf25-46eb-989a-e3ecb358621a service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:17:07.094337 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-b0705567-637d-470c-ba3a-85c17f1b9b46 req-3ee73b55-bf25-46eb-989a-e3ecb358621a service nova] Creating event network-changed:22225028-5a17-4dd6-9593-448f6f20fd77 for instance ee3587af-87cb-4a36-98ed-5a5c81eb6f69 on n-h2-860284-1 Oct 04 22:17:07.111715 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-b0705567-637d-470c-ba3a-85c17f1b9b46 req-3ee73b55-bf25-46eb-989a-e3ecb358621a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108186 Oct 04 22:17:07.112397 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2809/5686] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:17:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:17:07.389070 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-4776a1bf-27be-4d2b-b432-fac646cc44d3 tempest-ServerGroup264TestJSON-2127882029 tempest-ServerGroup264TestJSON-2127882029-project] Action: 'create', calling method: .version_select at 0x7fbb2d9908b0>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:17:07.433899 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-4776a1bf-27be-4d2b-b432-fac646cc44d3 tempest-ServerGroup264TestJSON-2127882029 tempest-ServerGroup264TestJSON-2127882029-project] Getting quotas for project b0caa45913ef4f42a8374cd6e8a702c7. Resources: {'server_groups'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:17:07.445712 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-4776a1bf-27be-4d2b-b432-fac646cc44d3 tempest-ServerGroup264TestJSON-2127882029 tempest-ServerGroup264TestJSON-2127882029-project] Getting quotas for user 5e1c1f79c80a4c1db8d5e07efe486c57 and project b0caa45913ef4f42a8374cd6e8a702c7. Resources: {'server_groups'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:17:07.520902 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-4776a1bf-27be-4d2b-b432-fac646cc44d3 tempest-ServerGroup264TestJSON-2127882029 tempest-ServerGroup264TestJSON-2127882029-project] Getting quotas for project b0caa45913ef4f42a8374cd6e8a702c7. Resources: {'server_groups'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:17:07.529281 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-4776a1bf-27be-4d2b-b432-fac646cc44d3 tempest-ServerGroup264TestJSON-2127882029 tempest-ServerGroup264TestJSON-2127882029-project] Getting quotas for user 5e1c1f79c80a4c1db8d5e07efe486c57 and project b0caa45913ef4f42a8374cd6e8a702c7. Resources: {'server_groups'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:17:07.560079 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-4776a1bf-27be-4d2b-b432-fac646cc44d3 tempest-ServerGroup264TestJSON-2127882029 tempest-ServerGroup264TestJSON-2127882029-project] 10.222.0.43 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 0.446129 Oct 04 22:17:07.561551 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2810/5687] 10.222.0.43 () {62 vars in 1214 bytes} [Tue Oct 4 22:17:07 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 22:17:07.574678 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-47cc8f1f-a56c-4362-8e6b-8fee19757837 tempest-ServerGroup264TestJSON-2127882029 tempest-ServerGroup264TestJSON-2127882029-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:17:07.620241 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-47cc8f1f-a56c-4362-8e6b-8fee19757837 tempest-ServerGroup264TestJSON-2127882029 tempest-ServerGroup264TestJSON-2127882029-project] 10.222.0.43 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.051585 Oct 04 22:17:07.621372 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2811/5688] 10.222.0.43 () {60 vars in 1193 bytes} [Tue Oct 4 22:17:07 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 22:17:07.635106 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-d6a697b4-eb16-407c-9cda-8b30cf50b8a9 tempest-ServerGroup264TestJSON-2127882029 tempest-ServerGroup264TestJSON-2127882029-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:17:07.645421 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-d6a697b4-eb16-407c-9cda-8b30cf50b8a9 tempest-ServerGroup264TestJSON-2127882029 tempest-ServerGroup264TestJSON-2127882029-project] 10.222.0.43 "GET /compute/v2.1/os-server-groups/a6679548-4253-4c20-9d58-f162d18f0f58" status: 200 len: 235 microversion: 2.64 time: 0.017340 Oct 04 22:17:07.646597 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2812/5689] 10.222.0.43 () {60 vars in 1304 bytes} [Tue Oct 4 22:17:07 2022] GET /compute/v2.1/os-server-groups/a6679548-4253-4c20-9d58-f162d18f0f58 => generated 235 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 22:17:07.658705 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-27b99a8d-7148-4edc-acb5-1d887eeb3924 tempest-ServerGroup264TestJSON-2127882029 tempest-ServerGroup264TestJSON-2127882029-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:17:07.734297 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-27b99a8d-7148-4edc-acb5-1d887eeb3924 tempest-ServerGroup264TestJSON-2127882029 tempest-ServerGroup264TestJSON-2127882029-project] 10.222.0.43 "DELETE /compute/v2.1/os-server-groups/a6679548-4253-4c20-9d58-f162d18f0f58" status: 204 len: 0 microversion: 2.64 time: 0.080430 Oct 04 22:17:07.741698 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2813/5690] 10.222.0.43 () {60 vars in 1307 bytes} [Tue Oct 4 22:17:07 2022] DELETE /compute/v2.1/os-server-groups/a6679548-4253-4c20-9d58-f162d18f0f58 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 22:17:07.761497 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-1cbcda42-031e-412c-9d7e-049a911ed38b tempest-ServerGroup264TestJSON-2127882029 tempest-ServerGroup264TestJSON-2127882029-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:17:07.777767 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-1cbcda42-031e-412c-9d7e-049a911ed38b tempest-ServerGroup264TestJSON-2127882029 tempest-ServerGroup264TestJSON-2127882029-project] HTTP exception thrown: Instance group a6679548-4253-4c20-9d58-f162d18f0f58 could not be found. Oct 04 22:17:07.794342 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-1cbcda42-031e-412c-9d7e-049a911ed38b tempest-ServerGroup264TestJSON-2127882029 tempest-ServerGroup264TestJSON-2127882029-project] Request method failure captured: Oct 04 22:17:07.794342 n-d-860284-1 devstack@n-api.service[134101]: request: DELETE /compute/v2.1/os-server-groups/a6679548-4253-4c20-9d58-f162d18f0f58 HTTP/1.1 Oct 04 22:17:07.794342 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 22:17:07.794342 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 22:17:07.794342 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 22:17:07.794342 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 22:17:07.794342 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 22:17:07.794342 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 22:17:07.794342 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 22:17:07.794342 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 22:17:07.794342 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPLDiqWR82YcUbKIM4TDZ76nBk8a_pg8ztJDStRmAm5Mrkz1RjfPOrvCA70QipnoaODvRQTfmFAQkVHxfYShByx-DGgvhjsWs7lf4eMvKTvqBoKbGXXEy_PxU1-QxQK_9HdMJJ_W1Eua8YWzxuY_0fqenONrjNYfYz9roJQw-YlJTcKs Oct 04 22:17:07.794342 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 22:17:07.794342 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 22:17:07.794342 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 22:17:07.794342 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 22:17:07.794342 n-d-860284-1 devstack@n-api.service[134101]: X-Openstack-Nova-Api-Version: 2.64 Oct 04 22:17:07.794342 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 22:17:07.794342 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 22:17:07.794342 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: b0caa45913ef4f42a8374cd6e8a702c7 Oct 04 22:17:07.794342 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-ServerGroup264TestJSON-2127882029 Oct 04 22:17:07.794342 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 22:17:07.794342 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 22:17:07.794342 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b0caa45913ef4f42a8374cd6e8a702c7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_b0caa45913ef4f42a8374cd6e8a702c7", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b0caa45913ef4f42a8374cd6e8a702c7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/b0caa45913ef4f42a8374cd6e8a702c7"}]}] Oct 04 22:17:07.794342 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-ServerGroup264TestJSON-2127882029 Oct 04 22:17:07.794342 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: b0caa45913ef4f42a8374cd6e8a702c7 Oct 04 22:17:07.794342 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-ServerGroup264TestJSON-2127882029 Oct 04 22:17:07.794342 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-ServerGroup264TestJSON-2127882029-project Oct 04 22:17:07.794342 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 22:17:07.794342 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 22:17:07.794342 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 5e1c1f79c80a4c1db8d5e07efe486c57 Oct 04 22:17:07.794342 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-ServerGroup264TestJSON-2127882029-project Oct 04 22:17:07.794342 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 22:17:07.794342 n-d-860284-1 devstack@n-api.service[134101]: exception: Instance group a6679548-4253-4c20-9d58-f162d18f0f58 could not be found. Oct 04 22:17:07.794342 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': 'a6679548-4253-4c20-9d58-f162d18f0f58'} Oct 04 22:17:07.794342 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:17:07.794342 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:17:07.794342 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 04 22:17:07.794342 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 04 22:17:07.794342 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 22:17:07.794342 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 22:17:07.794342 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 04 22:17:07.794342 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 04 22:17:07.794342 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 22:17:07.794342 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 22:17:07.794342 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 04 22:17:07.794342 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 04 22:17:07.794342 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group a6679548-4253-4c20-9d58-f162d18f0f58 could not be found. Oct 04 22:17:07.794342 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:17:07.794342 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:17:07.794342 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:17:07.794342 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:17:07.794342 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:17:07.794342 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:17:07.794342 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:17:07.794342 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:17:07.794342 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:17:07.794342 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:17:07.794342 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 04 22:17:07.794342 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:17:07.794342 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group a6679548-4253-4c20-9d58-f162d18f0f58 could not be found. Oct 04 22:17:07.794342 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:17:07.794342 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:17:07.794342 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:17:07.794342 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:17:07.802334 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:17:07.802334 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:17:07.802334 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:17:07.802334 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:17:07.802334 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group a6679548-4253-4c20-9d58-f162d18f0f58 could not be found. Oct 04 22:17:07.802334 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:17:07.816566 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-1cbcda42-031e-412c-9d7e-049a911ed38b tempest-ServerGroup264TestJSON-2127882029 tempest-ServerGroup264TestJSON-2127882029-project] Returning 404 to user: Instance group a6679548-4253-4c20-9d58-f162d18f0f58 could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:17:07.818843 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-1cbcda42-031e-412c-9d7e-049a911ed38b tempest-ServerGroup264TestJSON-2127882029 tempest-ServerGroup264TestJSON-2127882029-project] 10.222.0.43 "DELETE /compute/v2.1/os-server-groups/a6679548-4253-4c20-9d58-f162d18f0f58" status: 404 len: 117 microversion: 2.64 time: 0.066185 Oct 04 22:17:07.820766 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2814/5691] 10.222.0.43 () {60 vars in 1307 bytes} [Tue Oct 4 22:17:07 2022] DELETE /compute/v2.1/os-server-groups/a6679548-4253-4c20-9d58-f162d18f0f58 => generated 117 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 22:17:09.465967 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.network.neutron [None req-51366a8b-bcfb-47a1-80f4-0eb343d05185 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] [instance: ee3587af-87cb-4a36-98ed-5a5c81eb6f69] Updating instance_info_cache with network_info: [{"id": "22225028-5a17-4dd6-9593-448f6f20fd77", "address": "fa:16:3e:28:14:8d", "network": {"id": "27e021c6-6679-48e6-a567-0998c0d4ad3a", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-1303305510-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.1.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "6b2140f8775f4a7495c0f026b4b810b3", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap22225028-5a", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=134102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 04 22:17:09.478053 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-51366a8b-bcfb-47a1-80f4-0eb343d05185 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Releasing lock "refresh_cache-ee3587af-87cb-4a36-98ed-5a5c81eb6f69" {{(pid=134102) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 04 22:17:09.482607 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-51366a8b-bcfb-47a1-80f4-0eb343d05185 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] 10.222.0.43 "POST /compute/v2.1/servers/ee3587af-87cb-4a36-98ed-5a5c81eb6f69/action" status: 202 len: 0 microversion: 2.1 time: 7.150652 Oct 04 22:17:09.483974 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2878/5692] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 22:17:02 2022] POST /compute/v2.1/servers/ee3587af-87cb-4a36-98ed-5a5c81eb6f69/action => generated 0 bytes in 7156 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 04 22:17:09.494147 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-ebaa7b34-2979-4101-8c07-9fd2965ec7b0 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.1.94"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:17:10.237767 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-ebaa7b34-2979-4101-8c07-9fd2965ec7b0 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] [instance: ee3587af-87cb-4a36-98ed-5a5c81eb6f69] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:17:10.247480 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ebaa7b34-2979-4101-8c07-9fd2965ec7b0 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:17:10.249346 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ebaa7b34-2979-4101-8c07-9fd2965ec7b0 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:17:10.250709 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ebaa7b34-2979-4101-8c07-9fd2965ec7b0 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:17:10.252760 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ebaa7b34-2979-4101-8c07-9fd2965ec7b0 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:17:10.253257 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ebaa7b34-2979-4101-8c07-9fd2965ec7b0 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:17:10.255188 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ebaa7b34-2979-4101-8c07-9fd2965ec7b0 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:17:10.656720 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ebaa7b34-2979-4101-8c07-9fd2965ec7b0 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Acquiring lock "refresh_cache-ee3587af-87cb-4a36-98ed-5a5c81eb6f69" {{(pid=134101) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 04 22:17:10.657311 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ebaa7b34-2979-4101-8c07-9fd2965ec7b0 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Acquired lock "refresh_cache-ee3587af-87cb-4a36-98ed-5a5c81eb6f69" {{(pid=134101) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 04 22:17:11.370167 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-00194541-8afc-4412-817e-ac6b1941166a tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Action: 'create', calling method: .version_select at 0x7fbb2e10fdc0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1719242022", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFRflZDle5hnob/YO920MgoQRpVRMuc8O3k2ENNReeB9c9i+YpOGE+i+TzwRbp49D9pICoxn3u4/9RlqLJlmIDsBzfBM637gibOV+hxR/upQNN23GcQLtDP8KVvAJ6q5ow=="}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:17:11.417231 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-00194541-8afc-4412-817e-ac6b1941166a tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Getting quotas for project 286d184163154f2e846d521d368e3ead. Resources: {'key_pairs'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:17:11.448521 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-00194541-8afc-4412-817e-ac6b1941166a tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Getting quotas for user 94ac78e2767c49168f0464acea155be1 and project 286d184163154f2e846d521d368e3ead. Resources: {'key_pairs'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:17:11.524762 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-00194541-8afc-4412-817e-ac6b1941166a tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.160149 Oct 04 22:17:11.525856 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2879/5693] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Oct 4 22:17:11 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:17:12.253284 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.network.neutron [None req-ebaa7b34-2979-4101-8c07-9fd2965ec7b0 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] [instance: ee3587af-87cb-4a36-98ed-5a5c81eb6f69] Building network info cache for instance {{(pid=134101) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 04 22:17:12.268267 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-8b3885d8-268a-49ce-bb97-51654c9eb00a req-858cc150-c7b3-4eea-9624-2b6c5cc57bca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee3587af-87cb-4a36-98ed-5a5c81eb6f69", "tag": "22225028-5a17-4dd6-9593-448f6f20fd77"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:17:12.300117 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-8b3885d8-268a-49ce-bb97-51654c9eb00a req-858cc150-c7b3-4eea-9624-2b6c5cc57bca service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:17:12.300791 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-8b3885d8-268a-49ce-bb97-51654c9eb00a req-858cc150-c7b3-4eea-9624-2b6c5cc57bca service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:17:12.301347 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-8b3885d8-268a-49ce-bb97-51654c9eb00a req-858cc150-c7b3-4eea-9624-2b6c5cc57bca service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:17:12.324573 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-8b3885d8-268a-49ce-bb97-51654c9eb00a req-858cc150-c7b3-4eea-9624-2b6c5cc57bca service nova] Creating event network-changed:22225028-5a17-4dd6-9593-448f6f20fd77 for instance ee3587af-87cb-4a36-98ed-5a5c81eb6f69 on n-h2-860284-1 Oct 04 22:17:12.343824 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-8b3885d8-268a-49ce-bb97-51654c9eb00a req-858cc150-c7b3-4eea-9624-2b6c5cc57bca service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082394 Oct 04 22:17:12.344894 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2880/5694] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:17:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:17:13.326289 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.network.neutron [None req-ebaa7b34-2979-4101-8c07-9fd2965ec7b0 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] [instance: ee3587af-87cb-4a36-98ed-5a5c81eb6f69] Updating instance_info_cache with network_info: [{"id": "22225028-5a17-4dd6-9593-448f6f20fd77", "address": "fa:16:3e:28:14:8d", "network": {"id": "27e021c6-6679-48e6-a567-0998c0d4ad3a", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-1303305510-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "6b2140f8775f4a7495c0f026b4b810b3", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap22225028-5a", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=134101) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 04 22:17:13.346650 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ebaa7b34-2979-4101-8c07-9fd2965ec7b0 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Releasing lock "refresh_cache-ee3587af-87cb-4a36-98ed-5a5c81eb6f69" {{(pid=134101) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 04 22:17:13.347897 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-ebaa7b34-2979-4101-8c07-9fd2965ec7b0 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] 10.222.0.43 "POST /compute/v2.1/servers/ee3587af-87cb-4a36-98ed-5a5c81eb6f69/action" status: 202 len: 0 microversion: 2.1 time: 3.859654 Oct 04 22:17:13.350467 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2815/5695] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 22:17:09 2022] POST /compute/v2.1/servers/ee3587af-87cb-4a36-98ed-5a5c81eb6f69/action => generated 0 bytes in 3862 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 04 22:17:13.360506 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-91521f72-08ce-4301-96da-8162873b44ac tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Calling method '.version_select at 0x7fbb2e106550>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:17:15.037526 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-91521f72-08ce-4301-96da-8162873b44ac tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] 10.222.0.43 "DELETE /compute/v2.1/os-floating-ips/4d850755-d7ca-49ab-82ba-0537fe04bebc" status: 202 len: 0 microversion: 2.1 time: 1.682379 Oct 04 22:17:15.038263 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2881/5696] 10.222.0.43 () {58 vars in 1263 bytes} [Tue Oct 4 22:17:13 2022] DELETE /compute/v2.1/os-floating-ips/4d850755-d7ca-49ab-82ba-0537fe04bebc => generated 0 bytes in 1684 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 22:17:15.048798 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-121ebae1-03ab-49e8-9e1c-2686a71347fd tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Calling method '.version_select at 0x7fbb2d9a44c0>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:17:15.480311 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-121ebae1-03ab-49e8-9e1c-2686a71347fd tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/a0189f35-6c73-4bce-a1b3-99750ff46fb3" status: 202 len: 0 microversion: 2.1 time: 0.436268 Oct 04 22:17:15.481302 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2816/5697] 10.222.0.43 () {58 vars in 1272 bytes} [Tue Oct 4 22:17:15 2022] DELETE /compute/v2.1/os-security-groups/a0189f35-6c73-4bce-a1b3-99750ff46fb3 => generated 0 bytes in 438 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 22:17:15.498286 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-9a4bafdf-1b36-4ee7-9401-637eb3ed57d2 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:17:15.499498 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-9a4bafdf-1b36-4ee7-9401-637eb3ed57d2 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] [instance: ee3587af-87cb-4a36-98ed-5a5c81eb6f69] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:17:15.527189 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9a4bafdf-1b36-4ee7-9401-637eb3ed57d2 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:17:15.527903 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9a4bafdf-1b36-4ee7-9401-637eb3ed57d2 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:17:15.530110 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9a4bafdf-1b36-4ee7-9401-637eb3ed57d2 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:17:15.531411 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9a4bafdf-1b36-4ee7-9401-637eb3ed57d2 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:17:15.537336 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9a4bafdf-1b36-4ee7-9401-637eb3ed57d2 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:17:15.538201 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9a4bafdf-1b36-4ee7-9401-637eb3ed57d2 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:17:15.595299 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-9a4bafdf-1b36-4ee7-9401-637eb3ed57d2 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] [instance: ee3587af-87cb-4a36-98ed-5a5c81eb6f69] Going to try to terminate instance {{(pid=134102) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 22:17:15.761699 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-9a4bafdf-1b36-4ee7-9401-637eb3ed57d2 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] 10.222.0.43 "DELETE /compute/v2.1/servers/ee3587af-87cb-4a36-98ed-5a5c81eb6f69" status: 204 len: 0 microversion: 2.1 time: 0.272453 Oct 04 22:17:15.762443 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2882/5698] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 22:17:15 2022] DELETE /compute/v2.1/servers/ee3587af-87cb-4a36-98ed-5a5c81eb6f69 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 22:17:15.774206 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-fbccefd2-ac82-4d2e-b427-4371e6cf42b0 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:17:15.776062 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-fbccefd2-ac82-4d2e-b427-4371e6cf42b0 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] [instance: ee3587af-87cb-4a36-98ed-5a5c81eb6f69] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:17:15.796382 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fbccefd2-ac82-4d2e-b427-4371e6cf42b0 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:17:15.796906 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fbccefd2-ac82-4d2e-b427-4371e6cf42b0 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:17:15.797369 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fbccefd2-ac82-4d2e-b427-4371e6cf42b0 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:17:15.798106 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fbccefd2-ac82-4d2e-b427-4371e6cf42b0 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:17:15.798762 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fbccefd2-ac82-4d2e-b427-4371e6cf42b0 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:17:15.799204 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fbccefd2-ac82-4d2e-b427-4371e6cf42b0 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:17:16.075508 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-fbccefd2-ac82-4d2e-b427-4371e6cf42b0 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99b5f2cd0a343bc81ca0005f2a74591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2140f8775f4a7495c0f026b4b810b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:17:16.089468 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-fbccefd2-ac82-4d2e-b427-4371e6cf42b0 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] 10.222.0.43 "GET /compute/v2.1/servers/ee3587af-87cb-4a36-98ed-5a5c81eb6f69" status: 200 len: 1509 microversion: 2.1 time: 0.321436 Oct 04 22:17:16.092354 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2817/5699] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:17:15 2022] GET /compute/v2.1/servers/ee3587af-87cb-4a36-98ed-5a5c81eb6f69 => generated 1509 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:17:17.114943 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-f0e960a6-4a3e-4de1-b3fb-1373fb20523a tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:17:17.115424 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-f0e960a6-4a3e-4de1-b3fb-1373fb20523a tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] [instance: ee3587af-87cb-4a36-98ed-5a5c81eb6f69] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:17:17.134915 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f0e960a6-4a3e-4de1-b3fb-1373fb20523a tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:17:17.144252 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f0e960a6-4a3e-4de1-b3fb-1373fb20523a tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:17:17.145837 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f0e960a6-4a3e-4de1-b3fb-1373fb20523a tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:17:17.147827 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f0e960a6-4a3e-4de1-b3fb-1373fb20523a tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:17:17.150403 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f0e960a6-4a3e-4de1-b3fb-1373fb20523a tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:17:17.155656 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f0e960a6-4a3e-4de1-b3fb-1373fb20523a tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:17:17.166460 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=39,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:17:17.578177 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-f0e960a6-4a3e-4de1-b3fb-1373fb20523a tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99b5f2cd0a343bc81ca0005f2a74591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2140f8775f4a7495c0f026b4b810b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:17:17.635862 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-f0e960a6-4a3e-4de1-b3fb-1373fb20523a tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] 10.222.0.43 "GET /compute/v2.1/servers/ee3587af-87cb-4a36-98ed-5a5c81eb6f69" status: 200 len: 1509 microversion: 2.1 time: 0.524430 Oct 04 22:17:17.637651 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2883/5700] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:17:17 2022] GET /compute/v2.1/servers/ee3587af-87cb-4a36-98ed-5a5c81eb6f69 => generated 1509 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:17:18.038013 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-5f3d07b9-c83b-4d33-875f-49e4ca59f33a tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1283894665", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452", "networks": [{"uuid": "13baa9a0-f3d7-41b1-91cd-ff8e877df2a8"}], "key_name": "tempest-TestNetworkBasicOps-1719242022", "security_groups": [{"name": "tempest-secgroup-smoke-571906634"}]}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:17:18.049340 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=8 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:17:18.180691 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.network.neutron [None req-5f3d07b9-c83b-4d33-875f-49e4ca59f33a tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] validate_networks() for [('13baa9a0-f3d7-41b1-91cd-ff8e877df2a8', None, None, None, None, None)] {{(pid=134101) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 22:17:18.662689 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-bc78b41d-136b-4051-a559-066f4e180d75 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:17:18.665403 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-bc78b41d-136b-4051-a559-066f4e180d75 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] [instance: ee3587af-87cb-4a36-98ed-5a5c81eb6f69] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:17:18.686887 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bc78b41d-136b-4051-a559-066f4e180d75 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:17:18.687602 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bc78b41d-136b-4051-a559-066f4e180d75 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:17:18.688213 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bc78b41d-136b-4051-a559-066f4e180d75 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:17:18.689118 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bc78b41d-136b-4051-a559-066f4e180d75 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:17:18.689762 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bc78b41d-136b-4051-a559-066f4e180d75 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:17:18.690358 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bc78b41d-136b-4051-a559-066f4e180d75 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:17:18.928624 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-5f3d07b9-c83b-4d33-875f-49e4ca59f33a tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Flavor limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 22:17:18.930395 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-5f3d07b9-c83b-4d33-875f-49e4ca59f33a tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Image limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 22:17:18.931094 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-5f3d07b9-c83b-4d33-875f-49e4ca59f33a tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Flavor pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 22:17:18.931746 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-5f3d07b9-c83b-4d33-875f-49e4ca59f33a tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Image pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 22:17:18.932315 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-5f3d07b9-c83b-4d33-875f-49e4ca59f33a tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 22:17:18.949672 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5f3d07b9-c83b-4d33-875f-49e4ca59f33a tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:17:18.950798 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5f3d07b9-c83b-4d33-875f-49e4ca59f33a tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:17:18.951321 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5f3d07b9-c83b-4d33-875f-49e4ca59f33a tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:17:18.952142 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5f3d07b9-c83b-4d33-875f-49e4ca59f33a tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:17:18.952735 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5f3d07b9-c83b-4d33-875f-49e4ca59f33a tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:17:18.953248 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5f3d07b9-c83b-4d33-875f-49e4ca59f33a tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:17:18.960181 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-bc78b41d-136b-4051-a559-066f4e180d75 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99b5f2cd0a343bc81ca0005f2a74591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2140f8775f4a7495c0f026b4b810b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:17:18.976837 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-bc78b41d-136b-4051-a559-066f4e180d75 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] 10.222.0.43 "GET /compute/v2.1/servers/ee3587af-87cb-4a36-98ed-5a5c81eb6f69" status: 200 len: 1509 microversion: 2.1 time: 0.316252 Oct 04 22:17:18.981218 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2884/5701] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:17:18 2022] GET /compute/v2.1/servers/ee3587af-87cb-4a36-98ed-5a5c81eb6f69 => generated 1509 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:17:19.000372 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-5f3d07b9-c83b-4d33-875f-49e4ca59f33a tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Getting quotas for project 286d184163154f2e846d521d368e3ead. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:17:19.008579 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-5f3d07b9-c83b-4d33-875f-49e4ca59f33a tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Getting quotas for user 94ac78e2767c49168f0464acea155be1 and project 286d184163154f2e846d521d368e3ead. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:17:19.027797 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-5f3d07b9-c83b-4d33-875f-49e4ca59f33a tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Going to run 1 instances... {{(pid=134101) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 22:17:19.030799 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-5f3d07b9-c83b-4d33-875f-49e4ca59f33a tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] [instance: c05ce571-4683-4210-af70-67c2d871f6f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='58548514-5dac-426c-81f5-19e3fba33e23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134101) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 22:17:19.095834 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-5f3d07b9-c83b-4d33-875f-49e4ca59f33a tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.062227 Oct 04 22:17:19.097710 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2818/5702] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 22:17:18 2022] POST /compute/v2.1/servers => generated 405 bytes in 1065 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 22:17:19.110305 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-f2e68b7a-7330-46f7-9777-3b7eef3e52ec tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:17:19.110875 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-f2e68b7a-7330-46f7-9777-3b7eef3e52ec tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] [instance: c05ce571-4683-4210-af70-67c2d871f6f3] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:17:19.243008 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-f2e68b7a-7330-46f7-9777-3b7eef3e52ec tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ac78e2767c49168f0464acea155be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286d184163154f2e846d521d368e3ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:17:19.255311 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-f2e68b7a-7330-46f7-9777-3b7eef3e52ec tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] 10.222.0.43 "GET /compute/v2.1/servers/c05ce571-4683-4210-af70-67c2d871f6f3" status: 200 len: 1249 microversion: 2.1 time: 0.149797 Oct 04 22:17:19.256328 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2885/5703] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:17:19 2022] GET /compute/v2.1/servers/c05ce571-4683-4210-af70-67c2d871f6f3 => generated 1249 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:17:20.005108 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-ca08f560-6963-4750-9a62-3c962b0ed417 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:17:20.005944 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-ca08f560-6963-4750-9a62-3c962b0ed417 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] [instance: ee3587af-87cb-4a36-98ed-5a5c81eb6f69] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:17:20.035699 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ca08f560-6963-4750-9a62-3c962b0ed417 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:17:20.036489 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ca08f560-6963-4750-9a62-3c962b0ed417 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:17:20.036943 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ca08f560-6963-4750-9a62-3c962b0ed417 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:17:20.041915 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ca08f560-6963-4750-9a62-3c962b0ed417 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:17:20.042724 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ca08f560-6963-4750-9a62-3c962b0ed417 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:17:20.044980 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ca08f560-6963-4750-9a62-3c962b0ed417 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:17:20.261965 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-30a636c1-80c9-4473-a53b-526d291c1d5c req-a2e12990-e9ae-4624-b7ea-750ca7f02db7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee3587af-87cb-4a36-98ed-5a5c81eb6f69", "name": "network-vif-deleted", "tag": "22225028-5a17-4dd6-9593-448f6f20fd77"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:17:20.284981 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:17:20.287741 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-30a636c1-80c9-4473-a53b-526d291c1d5c req-a2e12990-e9ae-4624-b7ea-750ca7f02db7 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:17:20.303553 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-30a636c1-80c9-4473-a53b-526d291c1d5c req-a2e12990-e9ae-4624-b7ea-750ca7f02db7 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:17:20.305747 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-30a636c1-80c9-4473-a53b-526d291c1d5c req-a2e12990-e9ae-4624-b7ea-750ca7f02db7 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:17:20.351794 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-30a636c1-80c9-4473-a53b-526d291c1d5c req-a2e12990-e9ae-4624-b7ea-750ca7f02db7 service nova] Creating event network-vif-deleted:22225028-5a17-4dd6-9593-448f6f20fd77 for instance ee3587af-87cb-4a36-98ed-5a5c81eb6f69 on n-h2-860284-1 Oct 04 22:17:20.362903 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-30a636c1-80c9-4473-a53b-526d291c1d5c req-a2e12990-e9ae-4624-b7ea-750ca7f02db7 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105204 Oct 04 22:17:20.364731 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2886/5704] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:17:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:17:20.373540 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-32c29387-07dd-49a9-b48f-be41ed0985b7 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:17:20.374716 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-32c29387-07dd-49a9-b48f-be41ed0985b7 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] [instance: c05ce571-4683-4210-af70-67c2d871f6f3] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:17:20.384975 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-32c29387-07dd-49a9-b48f-be41ed0985b7 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:17:20.385755 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-32c29387-07dd-49a9-b48f-be41ed0985b7 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:17:20.386600 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-32c29387-07dd-49a9-b48f-be41ed0985b7 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:17:20.388183 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-32c29387-07dd-49a9-b48f-be41ed0985b7 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:17:20.389619 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-32c29387-07dd-49a9-b48f-be41ed0985b7 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:17:20.390807 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-32c29387-07dd-49a9-b48f-be41ed0985b7 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:17:20.626926 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-ca08f560-6963-4750-9a62-3c962b0ed417 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99b5f2cd0a343bc81ca0005f2a74591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2140f8775f4a7495c0f026b4b810b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:17:20.647505 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-ca08f560-6963-4750-9a62-3c962b0ed417 tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] 10.222.0.43 "GET /compute/v2.1/servers/ee3587af-87cb-4a36-98ed-5a5c81eb6f69" status: 200 len: 1467 microversion: 2.1 time: 0.646691 Oct 04 22:17:20.656100 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2819/5705] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:17:19 2022] GET /compute/v2.1/servers/ee3587af-87cb-4a36-98ed-5a5c81eb6f69 => generated 1467 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:17:20.673479 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-32c29387-07dd-49a9-b48f-be41ed0985b7 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ac78e2767c49168f0464acea155be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286d184163154f2e846d521d368e3ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:17:20.690296 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-32c29387-07dd-49a9-b48f-be41ed0985b7 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] 10.222.0.43 "GET /compute/v2.1/servers/c05ce571-4683-4210-af70-67c2d871f6f3" status: 200 len: 1301 microversion: 2.1 time: 0.322199 Oct 04 22:17:20.693894 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2887/5706] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:17:20 2022] GET /compute/v2.1/servers/c05ce571-4683-4210-af70-67c2d871f6f3 => generated 1301 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:17:21.684022 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-657a6467-cdbe-4120-bd0b-b2773f84facc tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:17:21.685364 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-657a6467-cdbe-4120-bd0b-b2773f84facc tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] [instance: ee3587af-87cb-4a36-98ed-5a5c81eb6f69] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:17:21.703578 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-657a6467-cdbe-4120-bd0b-b2773f84facc tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:17:21.711411 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-657a6467-cdbe-4120-bd0b-b2773f84facc tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:17:21.713057 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-657a6467-cdbe-4120-bd0b-b2773f84facc tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:17:21.722026 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-0d1cb648-32c6-42c6-9598-7e002ca0bdb6 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:17:21.725121 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-0d1cb648-32c6-42c6-9598-7e002ca0bdb6 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] [instance: c05ce571-4683-4210-af70-67c2d871f6f3] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:17:21.731042 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-657a6467-cdbe-4120-bd0b-b2773f84facc tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:17:21.732850 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-657a6467-cdbe-4120-bd0b-b2773f84facc tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:17:21.733769 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-657a6467-cdbe-4120-bd0b-b2773f84facc tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:17:21.745249 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0d1cb648-32c6-42c6-9598-7e002ca0bdb6 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:17:21.750903 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0d1cb648-32c6-42c6-9598-7e002ca0bdb6 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:17:21.753842 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0d1cb648-32c6-42c6-9598-7e002ca0bdb6 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:17:21.756146 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0d1cb648-32c6-42c6-9598-7e002ca0bdb6 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:17:21.760390 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0d1cb648-32c6-42c6-9598-7e002ca0bdb6 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:17:21.763275 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0d1cb648-32c6-42c6-9598-7e002ca0bdb6 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:17:21.770500 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-657a6467-cdbe-4120-bd0b-b2773f84facc tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] HTTP exception thrown: Instance ee3587af-87cb-4a36-98ed-5a5c81eb6f69 could not be found. Oct 04 22:17:21.780485 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-657a6467-cdbe-4120-bd0b-b2773f84facc tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Request method failure captured: Oct 04 22:17:21.780485 n-d-860284-1 devstack@n-api.service[134101]: request: GET /compute/v2.1/servers/ee3587af-87cb-4a36-98ed-5a5c81eb6f69 HTTP/1.1 Oct 04 22:17:21.780485 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 22:17:21.780485 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 22:17:21.780485 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 22:17:21.780485 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 22:17:21.780485 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 22:17:21.780485 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 22:17:21.780485 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 22:17:21.780485 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 22:17:21.780485 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPLCaB77ObSNcL9x0XMH3WwsY3szms1UeMvEsuXItZ4f88Fm5XtjShZMrutuqY1KGrxIpu_4UgbS3hiDeOnhYI3Ww-5yewleCgHfjIJYtkuz2p-MtRo2NaD4XvSY0huOqSgez5TDn5aV_dZFoaglx-Ymyi7Mb_YYAbDipk2K_VmqxUrQ Oct 04 22:17:21.780485 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 22:17:21.780485 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 22:17:21.780485 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 22:17:21.780485 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 22:17:21.780485 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 22:17:21.780485 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 22:17:21.780485 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: 6b2140f8775f4a7495c0f026b4b810b3 Oct 04 22:17:21.780485 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-ServerRescueTestJSONUnderV235-785726886 Oct 04 22:17:21.780485 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 22:17:21.780485 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 22:17:21.780485 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/6b2140f8775f4a7495c0f026b4b810b3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_6b2140f8775f4a7495c0f026b4b810b3", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/6b2140f8775f4a7495c0f026b4b810b3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/6b2140f8775f4a7495c0f026b4b810b3"}]}] Oct 04 22:17:21.780485 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-ServerRescueTestJSONUnderV235-785726886 Oct 04 22:17:21.780485 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: 6b2140f8775f4a7495c0f026b4b810b3 Oct 04 22:17:21.780485 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-ServerRescueTestJSONUnderV235-785726886 Oct 04 22:17:21.780485 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-ServerRescueTestJSONUnderV235-785726886-project Oct 04 22:17:21.780485 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 22:17:21.780485 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 22:17:21.780485 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: c99b5f2cd0a343bc81ca0005f2a74591 Oct 04 22:17:21.780485 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-ServerRescueTestJSONUnderV235-785726886-project Oct 04 22:17:21.780485 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 22:17:21.780485 n-d-860284-1 devstack@n-api.service[134101]: exception: Instance ee3587af-87cb-4a36-98ed-5a5c81eb6f69 could not be found. Oct 04 22:17:21.780485 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': 'ee3587af-87cb-4a36-98ed-5a5c81eb6f69'} Oct 04 22:17:21.780485 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:17:21.780485 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:17:21.780485 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:17:21.780485 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:17:21.780485 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:17:21.780485 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:17:21.780485 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:17:21.780485 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:17:21.780485 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:17:21.780485 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:17:21.780485 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee3587af-87cb-4a36-98ed-5a5c81eb6f69 could not be found. Oct 04 22:17:21.780485 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:17:21.780485 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:17:21.780485 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:17:21.780485 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:17:21.780485 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:17:21.780485 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:17:21.780485 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:17:21.780485 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:17:21.780485 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:17:21.780485 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:17:21.780485 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:17:21.780485 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:17:21.780485 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:17:21.780485 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:17:21.780485 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:17:21.780485 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:17:21.780485 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee3587af-87cb-4a36-98ed-5a5c81eb6f69 could not be found. Oct 04 22:17:21.780485 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:17:21.780485 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:17:21.785479 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:17:21.785479 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:17:21.785479 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:17:21.785479 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:17:21.785479 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:17:21.785479 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:17:21.785479 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee3587af-87cb-4a36-98ed-5a5c81eb6f69 could not be found. Oct 04 22:17:21.785479 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:17:21.790750 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-657a6467-cdbe-4120-bd0b-b2773f84facc tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] Returning 404 to user: Instance ee3587af-87cb-4a36-98ed-5a5c81eb6f69 could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:17:21.792979 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-657a6467-cdbe-4120-bd0b-b2773f84facc tempest-ServerRescueTestJSONUnderV235-785726886 tempest-ServerRescueTestJSONUnderV235-785726886-project] 10.222.0.43 "GET /compute/v2.1/servers/ee3587af-87cb-4a36-98ed-5a5c81eb6f69" status: 404 len: 111 microversion: 2.1 time: 0.115739 Oct 04 22:17:21.795359 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2820/5707] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:17:21 2022] GET /compute/v2.1/servers/ee3587af-87cb-4a36-98ed-5a5c81eb6f69 => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:17:21.944521 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-0d1cb648-32c6-42c6-9598-7e002ca0bdb6 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ac78e2767c49168f0464acea155be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286d184163154f2e846d521d368e3ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:17:21.959568 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-0d1cb648-32c6-42c6-9598-7e002ca0bdb6 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] 10.222.0.43 "GET /compute/v2.1/servers/c05ce571-4683-4210-af70-67c2d871f6f3" status: 200 len: 1307 microversion: 2.1 time: 0.242346 Oct 04 22:17:21.963823 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2888/5708] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:17:21 2022] GET /compute/v2.1/servers/c05ce571-4683-4210-af70-67c2d871f6f3 => generated 1307 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:17:22.992761 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-ece11cac-9017-4865-9031-524057ceef81 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:17:22.993390 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-ece11cac-9017-4865-9031-524057ceef81 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] [instance: c05ce571-4683-4210-af70-67c2d871f6f3] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:17:23.019991 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ece11cac-9017-4865-9031-524057ceef81 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:17:23.021913 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ece11cac-9017-4865-9031-524057ceef81 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:17:23.023825 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ece11cac-9017-4865-9031-524057ceef81 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:17:23.029530 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ece11cac-9017-4865-9031-524057ceef81 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:17:23.030405 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ece11cac-9017-4865-9031-524057ceef81 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:17:23.033312 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ece11cac-9017-4865-9031-524057ceef81 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:17:23.444147 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-ece11cac-9017-4865-9031-524057ceef81 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ac78e2767c49168f0464acea155be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286d184163154f2e846d521d368e3ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:17:23.462667 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-ece11cac-9017-4865-9031-524057ceef81 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] 10.222.0.43 "GET /compute/v2.1/servers/c05ce571-4683-4210-af70-67c2d871f6f3" status: 200 len: 1307 microversion: 2.1 time: 0.471743 Oct 04 22:17:23.464333 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2821/5709] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:17:22 2022] GET /compute/v2.1/servers/c05ce571-4683-4210-af70-67c2d871f6f3 => generated 1307 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:17:24.485926 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-04015319-798e-4987-88fa-c93ee3c98381 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:17:24.487226 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-04015319-798e-4987-88fa-c93ee3c98381 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] [instance: c05ce571-4683-4210-af70-67c2d871f6f3] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:17:24.505316 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-04015319-798e-4987-88fa-c93ee3c98381 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:17:24.506352 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-04015319-798e-4987-88fa-c93ee3c98381 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:17:24.507125 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-04015319-798e-4987-88fa-c93ee3c98381 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:17:24.509228 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-04015319-798e-4987-88fa-c93ee3c98381 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:17:24.512074 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-04015319-798e-4987-88fa-c93ee3c98381 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:17:24.512634 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-04015319-798e-4987-88fa-c93ee3c98381 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:17:24.862934 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-04015319-798e-4987-88fa-c93ee3c98381 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ac78e2767c49168f0464acea155be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286d184163154f2e846d521d368e3ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:17:24.896618 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-04015319-798e-4987-88fa-c93ee3c98381 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] 10.222.0.43 "GET /compute/v2.1/servers/c05ce571-4683-4210-af70-67c2d871f6f3" status: 200 len: 1374 microversion: 2.1 time: 0.407539 Oct 04 22:17:24.910794 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2889/5710] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:17:24 2022] GET /compute/v2.1/servers/c05ce571-4683-4210-af70-67c2d871f6f3 => generated 1374 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:17:25.925909 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-3c2566d6-54cb-45f3-a4d8-950989a5e857 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:17:25.926688 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-3c2566d6-54cb-45f3-a4d8-950989a5e857 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] [instance: c05ce571-4683-4210-af70-67c2d871f6f3] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:17:25.942224 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3c2566d6-54cb-45f3-a4d8-950989a5e857 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:17:25.942945 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3c2566d6-54cb-45f3-a4d8-950989a5e857 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:17:25.946317 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3c2566d6-54cb-45f3-a4d8-950989a5e857 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:17:25.950380 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3c2566d6-54cb-45f3-a4d8-950989a5e857 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:17:25.951038 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3c2566d6-54cb-45f3-a4d8-950989a5e857 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:17:25.951576 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3c2566d6-54cb-45f3-a4d8-950989a5e857 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:17:26.392868 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-3c2566d6-54cb-45f3-a4d8-950989a5e857 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ac78e2767c49168f0464acea155be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286d184163154f2e846d521d368e3ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:17:26.411623 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-3c2566d6-54cb-45f3-a4d8-950989a5e857 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] 10.222.0.43 "GET /compute/v2.1/servers/c05ce571-4683-4210-af70-67c2d871f6f3" status: 200 len: 1374 microversion: 2.1 time: 0.489952 Oct 04 22:17:26.414876 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2822/5711] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:17:25 2022] GET /compute/v2.1/servers/c05ce571-4683-4210-af70-67c2d871f6f3 => generated 1374 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:17:27.438963 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-1bafc4bd-22b2-4b5c-a607-d5a545d4290a tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:17:27.439708 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-1bafc4bd-22b2-4b5c-a607-d5a545d4290a tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] [instance: c05ce571-4683-4210-af70-67c2d871f6f3] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:17:27.463645 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1bafc4bd-22b2-4b5c-a607-d5a545d4290a tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:17:27.464417 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1bafc4bd-22b2-4b5c-a607-d5a545d4290a tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:17:27.464971 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1bafc4bd-22b2-4b5c-a607-d5a545d4290a tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:17:27.468217 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1bafc4bd-22b2-4b5c-a607-d5a545d4290a tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:17:27.468812 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1bafc4bd-22b2-4b5c-a607-d5a545d4290a tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:17:27.471724 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1bafc4bd-22b2-4b5c-a607-d5a545d4290a tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:17:27.893419 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-1bafc4bd-22b2-4b5c-a607-d5a545d4290a tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ac78e2767c49168f0464acea155be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286d184163154f2e846d521d368e3ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:17:27.910804 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-1bafc4bd-22b2-4b5c-a607-d5a545d4290a tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] 10.222.0.43 "GET /compute/v2.1/servers/c05ce571-4683-4210-af70-67c2d871f6f3" status: 200 len: 1374 microversion: 2.1 time: 0.476299 Oct 04 22:17:27.911664 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2890/5712] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:17:27 2022] GET /compute/v2.1/servers/c05ce571-4683-4210-af70-67c2d871f6f3 => generated 1374 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:17:28.237537 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-13152e5f-b977-4de4-aa0e-16ca82c0f0e6 req-130913e6-ed5b-4c6c-9602-59fa9df16fca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c05ce571-4683-4210-af70-67c2d871f6f3", "tag": "7e71d229-6e38-4aba-8027-f54cd448b83b"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:17:28.257841 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-13152e5f-b977-4de4-aa0e-16ca82c0f0e6 req-130913e6-ed5b-4c6c-9602-59fa9df16fca service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:17:28.258970 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-13152e5f-b977-4de4-aa0e-16ca82c0f0e6 req-130913e6-ed5b-4c6c-9602-59fa9df16fca service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:17:28.263621 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-13152e5f-b977-4de4-aa0e-16ca82c0f0e6 req-130913e6-ed5b-4c6c-9602-59fa9df16fca service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:17:28.296054 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-13152e5f-b977-4de4-aa0e-16ca82c0f0e6 req-130913e6-ed5b-4c6c-9602-59fa9df16fca service nova] Creating event network-changed:7e71d229-6e38-4aba-8027-f54cd448b83b for instance c05ce571-4683-4210-af70-67c2d871f6f3 on n-h1-860284-1 Oct 04 22:17:28.308237 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-13152e5f-b977-4de4-aa0e-16ca82c0f0e6 req-130913e6-ed5b-4c6c-9602-59fa9df16fca service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075139 Oct 04 22:17:28.309114 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2823/5713] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:17:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:17:28.935423 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-3bce8265-655e-42d7-ae8a-a5e5d38f7f3d tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:17:28.937216 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-3bce8265-655e-42d7-ae8a-a5e5d38f7f3d tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] [instance: c05ce571-4683-4210-af70-67c2d871f6f3] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:17:28.945457 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3bce8265-655e-42d7-ae8a-a5e5d38f7f3d tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:17:28.946341 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3bce8265-655e-42d7-ae8a-a5e5d38f7f3d tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:17:28.947022 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3bce8265-655e-42d7-ae8a-a5e5d38f7f3d tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:17:28.947929 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3bce8265-655e-42d7-ae8a-a5e5d38f7f3d tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:17:28.948578 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3bce8265-655e-42d7-ae8a-a5e5d38f7f3d tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:17:28.949191 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3bce8265-655e-42d7-ae8a-a5e5d38f7f3d tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:17:29.248584 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell0:SELECT=6 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:17:29.460848 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-3bce8265-655e-42d7-ae8a-a5e5d38f7f3d tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ac78e2767c49168f0464acea155be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286d184163154f2e846d521d368e3ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:17:29.474707 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-3bce8265-655e-42d7-ae8a-a5e5d38f7f3d tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] 10.222.0.43 "GET /compute/v2.1/servers/c05ce571-4683-4210-af70-67c2d871f6f3" status: 200 len: 1374 microversion: 2.1 time: 0.544078 Oct 04 22:17:29.476836 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2891/5714] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:17:28 2022] GET /compute/v2.1/servers/c05ce571-4683-4210-af70-67c2d871f6f3 => generated 1374 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:17:30.509127 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-cdc7d41f-b9ea-48ba-8e9f-ea35f637d3fa tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:17:30.510018 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-cdc7d41f-b9ea-48ba-8e9f-ea35f637d3fa tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] [instance: c05ce571-4683-4210-af70-67c2d871f6f3] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:17:30.521863 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=2 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:17:30.523001 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=6 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:17:30.530504 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cdc7d41f-b9ea-48ba-8e9f-ea35f637d3fa tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:17:30.534232 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cdc7d41f-b9ea-48ba-8e9f-ea35f637d3fa tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:17:30.534920 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cdc7d41f-b9ea-48ba-8e9f-ea35f637d3fa tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:17:30.535796 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cdc7d41f-b9ea-48ba-8e9f-ea35f637d3fa tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:17:30.536764 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cdc7d41f-b9ea-48ba-8e9f-ea35f637d3fa tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:17:30.539971 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cdc7d41f-b9ea-48ba-8e9f-ea35f637d3fa tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:17:30.828772 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-cdc7d41f-b9ea-48ba-8e9f-ea35f637d3fa tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ac78e2767c49168f0464acea155be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286d184163154f2e846d521d368e3ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:17:30.861237 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-cdc7d41f-b9ea-48ba-8e9f-ea35f637d3fa tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] 10.222.0.43 "GET /compute/v2.1/servers/c05ce571-4683-4210-af70-67c2d871f6f3" status: 200 len: 1374 microversion: 2.1 time: 0.357148 Oct 04 22:17:30.867917 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2824/5715] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:17:30 2022] GET /compute/v2.1/servers/c05ce571-4683-4210-af70-67c2d871f6f3 => generated 1374 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:17:31.890010 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-64a18341-0805-43e9-abcd-4940cec7ed1c tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:17:31.890739 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-64a18341-0805-43e9-abcd-4940cec7ed1c tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] [instance: c05ce571-4683-4210-af70-67c2d871f6f3] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:17:31.905697 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-64a18341-0805-43e9-abcd-4940cec7ed1c tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:17:31.906217 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-64a18341-0805-43e9-abcd-4940cec7ed1c tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:17:31.906689 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-64a18341-0805-43e9-abcd-4940cec7ed1c tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:17:31.907411 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-64a18341-0805-43e9-abcd-4940cec7ed1c tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:17:31.908906 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-64a18341-0805-43e9-abcd-4940cec7ed1c tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:17:31.908906 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-64a18341-0805-43e9-abcd-4940cec7ed1c tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:17:32.874001 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-64a18341-0805-43e9-abcd-4940cec7ed1c tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ac78e2767c49168f0464acea155be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286d184163154f2e846d521d368e3ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:17:32.900449 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-64a18341-0805-43e9-abcd-4940cec7ed1c tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] 10.222.0.43 "GET /compute/v2.1/servers/c05ce571-4683-4210-af70-67c2d871f6f3" status: 200 len: 1374 microversion: 2.1 time: 1.015129 Oct 04 22:17:32.905723 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2892/5716] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:17:31 2022] GET /compute/v2.1/servers/c05ce571-4683-4210-af70-67c2d871f6f3 => generated 1374 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:17:33.932671 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-d462e145-58fa-4fde-9bc7-08ca412b889c tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:17:33.941492 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-d462e145-58fa-4fde-9bc7-08ca412b889c tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] [instance: c05ce571-4683-4210-af70-67c2d871f6f3] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:17:33.968560 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d462e145-58fa-4fde-9bc7-08ca412b889c tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:17:33.969069 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d462e145-58fa-4fde-9bc7-08ca412b889c tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:17:33.974085 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d462e145-58fa-4fde-9bc7-08ca412b889c tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:17:33.975487 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d462e145-58fa-4fde-9bc7-08ca412b889c tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:17:33.976109 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d462e145-58fa-4fde-9bc7-08ca412b889c tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:17:33.987359 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d462e145-58fa-4fde-9bc7-08ca412b889c tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:17:34.324527 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-d462e145-58fa-4fde-9bc7-08ca412b889c tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ac78e2767c49168f0464acea155be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286d184163154f2e846d521d368e3ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:17:34.332467 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-d462e145-58fa-4fde-9bc7-08ca412b889c tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] 10.222.0.43 "GET /compute/v2.1/servers/c05ce571-4683-4210-af70-67c2d871f6f3" status: 200 len: 1374 microversion: 2.1 time: 0.404663 Oct 04 22:17:34.353222 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2825/5717] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:17:33 2022] GET /compute/v2.1/servers/c05ce571-4683-4210-af70-67c2d871f6f3 => generated 1374 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:17:35.364969 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-c259a32e-29cd-420e-a9ea-9bbbe6c22105 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:17:35.365754 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-c259a32e-29cd-420e-a9ea-9bbbe6c22105 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] [instance: c05ce571-4683-4210-af70-67c2d871f6f3] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:17:35.376585 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c259a32e-29cd-420e-a9ea-9bbbe6c22105 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:17:35.377557 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c259a32e-29cd-420e-a9ea-9bbbe6c22105 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:17:35.378352 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c259a32e-29cd-420e-a9ea-9bbbe6c22105 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:17:35.381081 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c259a32e-29cd-420e-a9ea-9bbbe6c22105 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:17:35.382102 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c259a32e-29cd-420e-a9ea-9bbbe6c22105 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:17:35.382767 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c259a32e-29cd-420e-a9ea-9bbbe6c22105 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:17:35.782112 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-c259a32e-29cd-420e-a9ea-9bbbe6c22105 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ac78e2767c49168f0464acea155be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286d184163154f2e846d521d368e3ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:17:35.794971 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-c259a32e-29cd-420e-a9ea-9bbbe6c22105 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] 10.222.0.43 "GET /compute/v2.1/servers/c05ce571-4683-4210-af70-67c2d871f6f3" status: 200 len: 1374 microversion: 2.1 time: 0.434672 Oct 04 22:17:35.797823 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2893/5718] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:17:35 2022] GET /compute/v2.1/servers/c05ce571-4683-4210-af70-67c2d871f6f3 => generated 1374 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:17:36.824500 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-c93b01bc-9bce-4722-84aa-c7e9eb352928 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:17:36.825122 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-c93b01bc-9bce-4722-84aa-c7e9eb352928 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] [instance: c05ce571-4683-4210-af70-67c2d871f6f3] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:17:36.832057 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c93b01bc-9bce-4722-84aa-c7e9eb352928 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:17:36.846269 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c93b01bc-9bce-4722-84aa-c7e9eb352928 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:17:36.849282 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c93b01bc-9bce-4722-84aa-c7e9eb352928 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:17:36.852207 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c93b01bc-9bce-4722-84aa-c7e9eb352928 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:17:36.852879 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c93b01bc-9bce-4722-84aa-c7e9eb352928 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:17:36.860714 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c93b01bc-9bce-4722-84aa-c7e9eb352928 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:17:37.682612 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-c93b01bc-9bce-4722-84aa-c7e9eb352928 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ac78e2767c49168f0464acea155be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286d184163154f2e846d521d368e3ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:17:37.687086 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=57,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:17:37.706562 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-c93b01bc-9bce-4722-84aa-c7e9eb352928 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] 10.222.0.43 "GET /compute/v2.1/servers/c05ce571-4683-4210-af70-67c2d871f6f3" status: 200 len: 1374 microversion: 2.1 time: 0.884995 Oct 04 22:17:37.708867 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2826/5719] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:17:36 2022] GET /compute/v2.1/servers/c05ce571-4683-4210-af70-67c2d871f6f3 => generated 1374 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:17:38.734722 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-f3a9b6fc-a4c4-4c25-be9d-0c7715ee84aa tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:17:38.735369 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-f3a9b6fc-a4c4-4c25-be9d-0c7715ee84aa tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] [instance: c05ce571-4683-4210-af70-67c2d871f6f3] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:17:38.754672 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f3a9b6fc-a4c4-4c25-be9d-0c7715ee84aa tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:17:38.757494 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f3a9b6fc-a4c4-4c25-be9d-0c7715ee84aa tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:17:38.758282 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f3a9b6fc-a4c4-4c25-be9d-0c7715ee84aa tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:17:38.761678 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f3a9b6fc-a4c4-4c25-be9d-0c7715ee84aa tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:17:38.762204 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f3a9b6fc-a4c4-4c25-be9d-0c7715ee84aa tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:17:38.765177 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f3a9b6fc-a4c4-4c25-be9d-0c7715ee84aa tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:17:39.427027 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-f3a9b6fc-a4c4-4c25-be9d-0c7715ee84aa tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ac78e2767c49168f0464acea155be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286d184163154f2e846d521d368e3ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:17:39.435987 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-f3a9b6fc-a4c4-4c25-be9d-0c7715ee84aa tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] 10.222.0.43 "GET /compute/v2.1/servers/c05ce571-4683-4210-af70-67c2d871f6f3" status: 200 len: 1374 microversion: 2.1 time: 0.706290 Oct 04 22:17:39.451010 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2894/5720] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:17:38 2022] GET /compute/v2.1/servers/c05ce571-4683-4210-af70-67c2d871f6f3 => generated 1374 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:17:40.464567 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-a88e12e4-0512-42be-9215-1d30bd6c4348 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:17:40.465213 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-a88e12e4-0512-42be-9215-1d30bd6c4348 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] [instance: c05ce571-4683-4210-af70-67c2d871f6f3] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:17:40.485565 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a88e12e4-0512-42be-9215-1d30bd6c4348 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:17:40.486085 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a88e12e4-0512-42be-9215-1d30bd6c4348 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:17:40.492603 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a88e12e4-0512-42be-9215-1d30bd6c4348 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:17:40.493637 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a88e12e4-0512-42be-9215-1d30bd6c4348 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:17:40.494330 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a88e12e4-0512-42be-9215-1d30bd6c4348 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:17:40.495508 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a88e12e4-0512-42be-9215-1d30bd6c4348 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:17:40.532137 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-48a3864e-3609-4e91-8919-502a4bc09ff2 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1195470173", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:17:40.551842 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=5,nova_api:DELETE=3 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:17:40.642572 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.network.neutron [None req-48a3864e-3609-4e91-8919-502a4bc09ff2 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] validate_networks() for [('7a9fd63d-da82-432b-98f7-d282671f9ebe', None, None, None, None, None)] {{(pid=134101) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 22:17:41.796566 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-a88e12e4-0512-42be-9215-1d30bd6c4348 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ac78e2767c49168f0464acea155be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286d184163154f2e846d521d368e3ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:17:41.811692 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-a88e12e4-0512-42be-9215-1d30bd6c4348 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] 10.222.0.43 "GET /compute/v2.1/servers/c05ce571-4683-4210-af70-67c2d871f6f3" status: 200 len: 1374 microversion: 2.1 time: 1.354129 Oct 04 22:17:41.827852 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2895/5721] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:17:40 2022] GET /compute/v2.1/servers/c05ce571-4683-4210-af70-67c2d871f6f3 => generated 1374 bytes in 1371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:17:41.843818 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-aff5c45d-4ce3-4f24-be45-a6beaaebe869 req-ac283493-0f5b-4e32-937d-f95f2a8d9eeb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c05ce571-4683-4210-af70-67c2d871f6f3", "name": "network-vif-plugged", "status": "completed", "tag": "7e71d229-6e38-4aba-8027-f54cd448b83b"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:17:41.870141 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-aff5c45d-4ce3-4f24-be45-a6beaaebe869 req-ac283493-0f5b-4e32-937d-f95f2a8d9eeb service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:17:41.870953 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-aff5c45d-4ce3-4f24-be45-a6beaaebe869 req-ac283493-0f5b-4e32-937d-f95f2a8d9eeb service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:17:41.871897 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-aff5c45d-4ce3-4f24-be45-a6beaaebe869 req-ac283493-0f5b-4e32-937d-f95f2a8d9eeb service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:17:41.909084 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-aff5c45d-4ce3-4f24-be45-a6beaaebe869 req-ac283493-0f5b-4e32-937d-f95f2a8d9eeb service nova] Creating event network-vif-plugged:7e71d229-6e38-4aba-8027-f54cd448b83b for instance c05ce571-4683-4210-af70-67c2d871f6f3 on n-h1-860284-1 Oct 04 22:17:41.920434 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-aff5c45d-4ce3-4f24-be45-a6beaaebe869 req-ac283493-0f5b-4e32-937d-f95f2a8d9eeb service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090144 Oct 04 22:17:41.922259 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2896/5722] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:17:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:17:42.862264 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-9bc3500e-fd81-4156-9884-fe39d3b8d927 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:17:42.863474 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-9bc3500e-fd81-4156-9884-fe39d3b8d927 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] [instance: c05ce571-4683-4210-af70-67c2d871f6f3] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:17:42.876711 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9bc3500e-fd81-4156-9884-fe39d3b8d927 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:17:42.880764 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9bc3500e-fd81-4156-9884-fe39d3b8d927 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:17:42.881419 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9bc3500e-fd81-4156-9884-fe39d3b8d927 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:17:42.883279 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9bc3500e-fd81-4156-9884-fe39d3b8d927 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:17:42.885153 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9bc3500e-fd81-4156-9884-fe39d3b8d927 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:17:42.887727 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9bc3500e-fd81-4156-9884-fe39d3b8d927 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:17:42.947872 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-48a3864e-3609-4e91-8919-502a4bc09ff2 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Flavor limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 22:17:42.948369 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-48a3864e-3609-4e91-8919-502a4bc09ff2 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Image limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 22:17:42.948763 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-48a3864e-3609-4e91-8919-502a4bc09ff2 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Flavor pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 22:17:42.949178 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-48a3864e-3609-4e91-8919-502a4bc09ff2 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Image pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 22:17:42.949786 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-48a3864e-3609-4e91-8919-502a4bc09ff2 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 22:17:42.974426 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-48a3864e-3609-4e91-8919-502a4bc09ff2 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:17:42.975184 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-48a3864e-3609-4e91-8919-502a4bc09ff2 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:17:42.981446 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-48a3864e-3609-4e91-8919-502a4bc09ff2 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:17:42.986912 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-48a3864e-3609-4e91-8919-502a4bc09ff2 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:17:42.987843 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-48a3864e-3609-4e91-8919-502a4bc09ff2 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:17:42.989112 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-48a3864e-3609-4e91-8919-502a4bc09ff2 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:17:43.046558 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-48a3864e-3609-4e91-8919-502a4bc09ff2 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Getting quotas for project be71413506154420869fdff5939fb940. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:17:43.081334 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-48a3864e-3609-4e91-8919-502a4bc09ff2 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Getting quotas for user ca6cfeabf8d84b2893200c3c54c1c19f and project be71413506154420869fdff5939fb940. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:17:43.132921 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-48a3864e-3609-4e91-8919-502a4bc09ff2 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Going to run 1 instances... {{(pid=134101) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 22:17:43.151537 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-48a3864e-3609-4e91-8919-502a4bc09ff2 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] [instance: 39984acf-f630-4ba0-b4e5-384ef8c3d9fc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='58548514-5dac-426c-81f5-19e3fba33e23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134101) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 22:17:43.266014 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-48a3864e-3609-4e91-8919-502a4bc09ff2 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.076109 Oct 04 22:17:43.267035 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2827/5723] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 22:17:40 2022] POST /compute/v2.1/servers => generated 383 bytes in 3078 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 22:17:43.282105 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-3c3ab6eb-446c-4925-bb13-d5858e7ba1d2 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:17:43.282846 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-3c3ab6eb-446c-4925-bb13-d5858e7ba1d2 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] [instance: 39984acf-f630-4ba0-b4e5-384ef8c3d9fc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:17:43.755767 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-3c3ab6eb-446c-4925-bb13-d5858e7ba1d2 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6cfeabf8d84b2893200c3c54c1c19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be71413506154420869fdff5939fb940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:17:43.771618 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-3c3ab6eb-446c-4925-bb13-d5858e7ba1d2 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] 10.222.0.43 "GET /compute/v2.1/servers/39984acf-f630-4ba0-b4e5-384ef8c3d9fc" status: 200 len: 1222 microversion: 2.1 time: 0.493325 Oct 04 22:17:43.773342 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2828/5724] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:17:43 2022] GET /compute/v2.1/servers/39984acf-f630-4ba0-b4e5-384ef8c3d9fc => generated 1222 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:17:43.798047 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-9bc3500e-fd81-4156-9884-fe39d3b8d927 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ac78e2767c49168f0464acea155be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286d184163154f2e846d521d368e3ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:17:43.827814 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-9bc3500e-fd81-4156-9884-fe39d3b8d927 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] 10.222.0.43 "GET /compute/v2.1/servers/c05ce571-4683-4210-af70-67c2d871f6f3" status: 200 len: 1374 microversion: 2.1 time: 0.975166 Oct 04 22:17:43.838024 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2897/5725] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:17:42 2022] GET /compute/v2.1/servers/c05ce571-4683-4210-af70-67c2d871f6f3 => generated 1374 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:17:43.909279 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-dda7ad78-53cc-48bb-944c-76629e4e3b7f tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-592946499", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:17:44.019508 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.network.neutron [None req-dda7ad78-53cc-48bb-944c-76629e4e3b7f tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] validate_networks() for [('7a9fd63d-da82-432b-98f7-d282671f9ebe', None, None, None, None, None)] {{(pid=134101) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 22:17:44.664583 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-2b5160ac-0971-41bd-9551-513e1a32f976 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Action: 'create', calling method: .version_select at 0x7fbb2e0e0670>, body: {"keypair": {"name": "tempest-keypair-1996980556", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFgx8gachXaofOHaeGooVJgPoC0n9IfAU9ToFr9JvQulESGy2NY9IWV5RM6GYUPt8lTPV9vhlWNkbFnamXBc8MtzqT1HNdHF5JzclkNdjqNSM3zuDopfUDiovVxoFf3cww=="}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:17:44.737678 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-2b5160ac-0971-41bd-9551-513e1a32f976 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Getting quotas for project 33b191bd428a4906b6c2781ae3efdaae. Resources: {'key_pairs'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:17:44.758735 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-2b5160ac-0971-41bd-9551-513e1a32f976 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Getting quotas for user 524ac46437134cd5a5000574631ea59a and project 33b191bd428a4906b6c2781ae3efdaae. Resources: {'key_pairs'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:17:44.819052 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-2b5160ac-0971-41bd-9551-513e1a32f976 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.301860 Oct 04 22:17:44.823258 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2898/5726] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Oct 4 22:17:44 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:17:44.854047 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-580c751a-6987-49fb-96ba-c724748b6e1c tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:17:44.855919 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-580c751a-6987-49fb-96ba-c724748b6e1c tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] [instance: c05ce571-4683-4210-af70-67c2d871f6f3] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:17:44.871811 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-580c751a-6987-49fb-96ba-c724748b6e1c tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:17:44.876450 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-580c751a-6987-49fb-96ba-c724748b6e1c tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:17:44.880263 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-580c751a-6987-49fb-96ba-c724748b6e1c tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:17:44.884553 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-580c751a-6987-49fb-96ba-c724748b6e1c tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:17:44.886308 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-580c751a-6987-49fb-96ba-c724748b6e1c tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:17:44.886797 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-580c751a-6987-49fb-96ba-c724748b6e1c tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:17:45.510876 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-dda7ad78-53cc-48bb-944c-76629e4e3b7f tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Flavor limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 22:17:45.511391 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-dda7ad78-53cc-48bb-944c-76629e4e3b7f tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Image limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 22:17:45.511777 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-dda7ad78-53cc-48bb-944c-76629e4e3b7f tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Flavor pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 22:17:45.512192 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-dda7ad78-53cc-48bb-944c-76629e4e3b7f tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Image pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 22:17:45.512615 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-dda7ad78-53cc-48bb-944c-76629e4e3b7f tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 22:17:45.557176 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dda7ad78-53cc-48bb-944c-76629e4e3b7f tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:17:45.557989 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dda7ad78-53cc-48bb-944c-76629e4e3b7f tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:17:45.561527 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dda7ad78-53cc-48bb-944c-76629e4e3b7f tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:17:45.566718 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dda7ad78-53cc-48bb-944c-76629e4e3b7f tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:17:45.568035 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-580c751a-6987-49fb-96ba-c724748b6e1c tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ac78e2767c49168f0464acea155be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286d184163154f2e846d521d368e3ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:17:45.569023 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dda7ad78-53cc-48bb-944c-76629e4e3b7f tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:17:45.573633 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dda7ad78-53cc-48bb-944c-76629e4e3b7f tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:17:45.586020 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-580c751a-6987-49fb-96ba-c724748b6e1c tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] 10.222.0.43 "GET /compute/v2.1/servers/c05ce571-4683-4210-af70-67c2d871f6f3" status: 200 len: 1546 microversion: 2.1 time: 0.728649 Oct 04 22:17:45.607740 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2899/5727] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:17:44 2022] GET /compute/v2.1/servers/c05ce571-4683-4210-af70-67c2d871f6f3 => generated 1546 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:17:45.627310 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-7d3b75f0-21ac-4cac-ae93-6283f88bf0af tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:17:45.628900 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-7d3b75f0-21ac-4cac-ae93-6283f88bf0af tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] [instance: c05ce571-4683-4210-af70-67c2d871f6f3] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:17:45.640254 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7d3b75f0-21ac-4cac-ae93-6283f88bf0af tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:17:45.644524 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7d3b75f0-21ac-4cac-ae93-6283f88bf0af tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:17:45.645349 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7d3b75f0-21ac-4cac-ae93-6283f88bf0af tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:17:45.647393 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7d3b75f0-21ac-4cac-ae93-6283f88bf0af tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:17:45.650789 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7d3b75f0-21ac-4cac-ae93-6283f88bf0af tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:17:45.651759 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7d3b75f0-21ac-4cac-ae93-6283f88bf0af tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:17:45.666745 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-dda7ad78-53cc-48bb-944c-76629e4e3b7f tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Getting quotas for project be71413506154420869fdff5939fb940. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:17:45.696515 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-dda7ad78-53cc-48bb-944c-76629e4e3b7f tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Getting quotas for user ca6cfeabf8d84b2893200c3c54c1c19f and project be71413506154420869fdff5939fb940. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:17:45.747899 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-dda7ad78-53cc-48bb-944c-76629e4e3b7f tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Going to run 1 instances... {{(pid=134101) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 22:17:45.750123 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-dda7ad78-53cc-48bb-944c-76629e4e3b7f tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] [instance: 95a3ffcc-fc4e-4351-9d57-b8c065aa179c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='58548514-5dac-426c-81f5-19e3fba33e23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134101) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 22:17:45.914164 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-dda7ad78-53cc-48bb-944c-76629e4e3b7f tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.010154 Oct 04 22:17:45.914928 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2829/5728] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 22:17:43 2022] POST /compute/v2.1/servers => generated 383 bytes in 2012 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 22:17:45.926124 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-40e6d921-0ffb-42e0-b830-8ee895f766e1 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:17:45.932596 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-40e6d921-0ffb-42e0-b830-8ee895f766e1 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] [instance: 95a3ffcc-fc4e-4351-9d57-b8c065aa179c] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:17:46.284138 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-40e6d921-0ffb-42e0-b830-8ee895f766e1 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6cfeabf8d84b2893200c3c54c1c19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be71413506154420869fdff5939fb940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:17:46.320319 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-40e6d921-0ffb-42e0-b830-8ee895f766e1 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] 10.222.0.43 "GET /compute/v2.1/servers/95a3ffcc-fc4e-4351-9d57-b8c065aa179c" status: 200 len: 1221 microversion: 2.1 time: 0.397495 Oct 04 22:17:46.321607 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2830/5729] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:17:45 2022] GET /compute/v2.1/servers/95a3ffcc-fc4e-4351-9d57-b8c065aa179c => generated 1221 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:17:46.380772 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-7d3b75f0-21ac-4cac-ae93-6283f88bf0af tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ac78e2767c49168f0464acea155be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286d184163154f2e846d521d368e3ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:17:46.403587 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-7d3b75f0-21ac-4cac-ae93-6283f88bf0af tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] 10.222.0.43 "GET /compute/v2.1/servers/c05ce571-4683-4210-af70-67c2d871f6f3" status: 200 len: 1546 microversion: 2.1 time: 0.781438 Oct 04 22:17:46.418890 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2900/5730] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:17:45 2022] GET /compute/v2.1/servers/c05ce571-4683-4210-af70-67c2d871f6f3 => generated 1546 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:17:47.344954 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-02396007-0fdd-4b19-b32d-1017c9884a25 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:17:47.346266 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-02396007-0fdd-4b19-b32d-1017c9884a25 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] [instance: 95a3ffcc-fc4e-4351-9d57-b8c065aa179c] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:17:47.379941 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-02396007-0fdd-4b19-b32d-1017c9884a25 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:17:47.387168 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-02396007-0fdd-4b19-b32d-1017c9884a25 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:17:47.389106 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-02396007-0fdd-4b19-b32d-1017c9884a25 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:17:47.393836 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-02396007-0fdd-4b19-b32d-1017c9884a25 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:17:47.407136 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-02396007-0fdd-4b19-b32d-1017c9884a25 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:17:47.410182 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-02396007-0fdd-4b19-b32d-1017c9884a25 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:17:47.675529 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-02396007-0fdd-4b19-b32d-1017c9884a25 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6cfeabf8d84b2893200c3c54c1c19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be71413506154420869fdff5939fb940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:17:47.720017 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-02396007-0fdd-4b19-b32d-1017c9884a25 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] 10.222.0.43 "GET /compute/v2.1/servers/95a3ffcc-fc4e-4351-9d57-b8c065aa179c" status: 200 len: 1225 microversion: 2.1 time: 0.379922 Oct 04 22:17:47.739107 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2831/5731] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:17:47 2022] GET /compute/v2.1/servers/95a3ffcc-fc4e-4351-9d57-b8c065aa179c => generated 1225 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:17:48.767092 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-9fba0d40-bc91-4557-926b-1503f7ebb2e4 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:17:48.768165 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-9fba0d40-bc91-4557-926b-1503f7ebb2e4 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] [instance: 95a3ffcc-fc4e-4351-9d57-b8c065aa179c] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:17:48.785215 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9fba0d40-bc91-4557-926b-1503f7ebb2e4 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:17:48.812174 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9fba0d40-bc91-4557-926b-1503f7ebb2e4 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:17:48.822195 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9fba0d40-bc91-4557-926b-1503f7ebb2e4 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:17:48.824109 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9fba0d40-bc91-4557-926b-1503f7ebb2e4 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:17:48.827779 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9fba0d40-bc91-4557-926b-1503f7ebb2e4 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:17:48.830917 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9fba0d40-bc91-4557-926b-1503f7ebb2e4 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:17:48.845883 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=88 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:17:49.078692 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-9fba0d40-bc91-4557-926b-1503f7ebb2e4 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6cfeabf8d84b2893200c3c54c1c19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be71413506154420869fdff5939fb940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:17:49.089091 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-9fba0d40-bc91-4557-926b-1503f7ebb2e4 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] 10.222.0.43 "GET /compute/v2.1/servers/95a3ffcc-fc4e-4351-9d57-b8c065aa179c" status: 200 len: 1291 microversion: 2.1 time: 0.325914 Oct 04 22:17:49.107780 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2901/5732] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:17:48 2022] GET /compute/v2.1/servers/95a3ffcc-fc4e-4351-9d57-b8c065aa179c => generated 1291 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:17:49.496114 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-4d50f962-e794-47d1-b426-d4b4feeacede tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-517664415", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f902d1c0-a388-48db-ac68-ba1329707022"}], "security_groups": [{"name": "tempest-securitygroup--232113212"}], "key_name": "tempest-keypair-1996980556", "user_data": "}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:17:49.809945 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.network.neutron [None req-4d50f962-e794-47d1-b426-d4b4feeacede tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] validate_networks() for [('f902d1c0-a388-48db-ac68-ba1329707022', None, None, None, None, None)] {{(pid=134101) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 22:17:50.115414 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-18ce307d-2528-4a53-8a09-ca92b6a38079 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:17:50.116050 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-18ce307d-2528-4a53-8a09-ca92b6a38079 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] [instance: 95a3ffcc-fc4e-4351-9d57-b8c065aa179c] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:17:50.151956 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-18ce307d-2528-4a53-8a09-ca92b6a38079 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:17:50.152473 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-18ce307d-2528-4a53-8a09-ca92b6a38079 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:17:50.152918 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-18ce307d-2528-4a53-8a09-ca92b6a38079 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:17:50.153651 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-18ce307d-2528-4a53-8a09-ca92b6a38079 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:17:50.162636 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-18ce307d-2528-4a53-8a09-ca92b6a38079 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:17:50.163630 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-18ce307d-2528-4a53-8a09-ca92b6a38079 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:17:50.298110 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-18ce307d-2528-4a53-8a09-ca92b6a38079 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6cfeabf8d84b2893200c3c54c1c19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be71413506154420869fdff5939fb940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:17:50.315643 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-18ce307d-2528-4a53-8a09-ca92b6a38079 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] 10.222.0.43 "GET /compute/v2.1/servers/95a3ffcc-fc4e-4351-9d57-b8c065aa179c" status: 200 len: 1279 microversion: 2.1 time: 0.204125 Oct 04 22:17:50.318721 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2902/5733] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:17:50 2022] GET /compute/v2.1/servers/95a3ffcc-fc4e-4351-9d57-b8c065aa179c => generated 1279 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:17:50.695153 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-4d50f962-e794-47d1-b426-d4b4feeacede tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Flavor limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 22:17:50.695749 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-4d50f962-e794-47d1-b426-d4b4feeacede tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Image limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 22:17:50.696486 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-4d50f962-e794-47d1-b426-d4b4feeacede tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Flavor pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 22:17:50.696900 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-4d50f962-e794-47d1-b426-d4b4feeacede tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Image pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 22:17:50.697315 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-4d50f962-e794-47d1-b426-d4b4feeacede tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 22:17:50.708332 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4d50f962-e794-47d1-b426-d4b4feeacede tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:17:50.709319 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4d50f962-e794-47d1-b426-d4b4feeacede tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:17:50.715571 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4d50f962-e794-47d1-b426-d4b4feeacede tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:17:50.716882 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4d50f962-e794-47d1-b426-d4b4feeacede tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:17:50.717616 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4d50f962-e794-47d1-b426-d4b4feeacede tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:17:50.718576 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4d50f962-e794-47d1-b426-d4b4feeacede tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:17:50.768811 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-4d50f962-e794-47d1-b426-d4b4feeacede tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Getting quotas for project 33b191bd428a4906b6c2781ae3efdaae. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:17:50.798832 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-4d50f962-e794-47d1-b426-d4b4feeacede tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Getting quotas for user 524ac46437134cd5a5000574631ea59a and project 33b191bd428a4906b6c2781ae3efdaae. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:17:50.847338 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-4d50f962-e794-47d1-b426-d4b4feeacede tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Going to run 1 instances... {{(pid=134101) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 22:17:50.849875 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-4d50f962-e794-47d1-b426-d4b4feeacede tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] [instance: 01f84e19-7e4a-460a-bb60-5da518f3d8b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='58548514-5dac-426c-81f5-19e3fba33e23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134101) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 22:17:50.966107 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-4d50f962-e794-47d1-b426-d4b4feeacede tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.478854 Oct 04 22:17:50.976872 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2832/5734] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 22:17:49 2022] POST /compute/v2.1/servers => generated 401 bytes in 1490 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 22:17:50.980055 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-d5cd54ab-58d3-4f4f-a61c-d2b12c2d282c tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:17:50.980909 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-d5cd54ab-58d3-4f4f-a61c-d2b12c2d282c tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] [instance: 01f84e19-7e4a-460a-bb60-5da518f3d8b1] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:17:50.997244 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=1 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:17:51.197592 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-d5cd54ab-58d3-4f4f-a61c-d2b12c2d282c tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '524ac46437134cd5a5000574631ea59a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b191bd428a4906b6c2781ae3efdaae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:17:51.216070 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-d5cd54ab-58d3-4f4f-a61c-d2b12c2d282c tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] 10.222.0.43 "GET /compute/v2.1/servers/01f84e19-7e4a-460a-bb60-5da518f3d8b1" status: 200 len: 1237 microversion: 2.1 time: 0.240324 Oct 04 22:17:51.219303 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2903/5735] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:17:50 2022] GET /compute/v2.1/servers/01f84e19-7e4a-460a-bb60-5da518f3d8b1 => generated 1237 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:17:51.345545 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-d3b6f198-f9ce-4dba-abc2-be0402343667 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:17:51.346471 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-d3b6f198-f9ce-4dba-abc2-be0402343667 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] [instance: 95a3ffcc-fc4e-4351-9d57-b8c065aa179c] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:17:51.357111 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d3b6f198-f9ce-4dba-abc2-be0402343667 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:17:51.357614 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d3b6f198-f9ce-4dba-abc2-be0402343667 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:17:51.360971 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d3b6f198-f9ce-4dba-abc2-be0402343667 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:17:51.364679 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d3b6f198-f9ce-4dba-abc2-be0402343667 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:17:51.365188 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d3b6f198-f9ce-4dba-abc2-be0402343667 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:17:51.367329 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d3b6f198-f9ce-4dba-abc2-be0402343667 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:17:51.510757 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-d3b6f198-f9ce-4dba-abc2-be0402343667 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6cfeabf8d84b2893200c3c54c1c19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be71413506154420869fdff5939fb940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:17:51.534173 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-d3b6f198-f9ce-4dba-abc2-be0402343667 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] 10.222.0.43 "GET /compute/v2.1/servers/95a3ffcc-fc4e-4351-9d57-b8c065aa179c" status: 200 len: 1279 microversion: 2.1 time: 0.185332 Oct 04 22:17:51.542125 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2833/5736] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:17:51 2022] GET /compute/v2.1/servers/95a3ffcc-fc4e-4351-9d57-b8c065aa179c => generated 1279 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:17:52.243113 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-4192dab1-a3ed-4255-910a-9d6995f74e09 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:17:52.244351 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-4192dab1-a3ed-4255-910a-9d6995f74e09 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] [instance: 01f84e19-7e4a-460a-bb60-5da518f3d8b1] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:17:52.262112 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4192dab1-a3ed-4255-910a-9d6995f74e09 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:17:52.262932 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4192dab1-a3ed-4255-910a-9d6995f74e09 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:17:52.263534 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4192dab1-a3ed-4255-910a-9d6995f74e09 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:17:52.264513 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4192dab1-a3ed-4255-910a-9d6995f74e09 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:17:52.265133 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4192dab1-a3ed-4255-910a-9d6995f74e09 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:17:52.265755 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4192dab1-a3ed-4255-910a-9d6995f74e09 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:17:52.344970 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-4192dab1-a3ed-4255-910a-9d6995f74e09 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '524ac46437134cd5a5000574631ea59a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b191bd428a4906b6c2781ae3efdaae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:17:52.356540 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-4192dab1-a3ed-4255-910a-9d6995f74e09 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] 10.222.0.43 "GET /compute/v2.1/servers/01f84e19-7e4a-460a-bb60-5da518f3d8b1" status: 200 len: 1233 microversion: 2.1 time: 0.118162 Oct 04 22:17:52.357806 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2904/5737] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:17:52 2022] GET /compute/v2.1/servers/01f84e19-7e4a-460a-bb60-5da518f3d8b1 => generated 1233 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:17:52.570232 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-ff26e642-26a5-4aa6-b02b-08a20302aa37 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:17:52.570926 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-ff26e642-26a5-4aa6-b02b-08a20302aa37 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] [instance: 95a3ffcc-fc4e-4351-9d57-b8c065aa179c] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:17:52.591316 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ff26e642-26a5-4aa6-b02b-08a20302aa37 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:17:52.594650 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ff26e642-26a5-4aa6-b02b-08a20302aa37 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:17:52.597356 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ff26e642-26a5-4aa6-b02b-08a20302aa37 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:17:52.598544 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ff26e642-26a5-4aa6-b02b-08a20302aa37 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:17:52.601034 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ff26e642-26a5-4aa6-b02b-08a20302aa37 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:17:52.605909 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ff26e642-26a5-4aa6-b02b-08a20302aa37 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:17:52.764896 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-ff26e642-26a5-4aa6-b02b-08a20302aa37 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6cfeabf8d84b2893200c3c54c1c19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be71413506154420869fdff5939fb940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:17:52.775139 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-ff26e642-26a5-4aa6-b02b-08a20302aa37 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] 10.222.0.43 "GET /compute/v2.1/servers/95a3ffcc-fc4e-4351-9d57-b8c065aa179c" status: 200 len: 1279 microversion: 2.1 time: 0.208754 Oct 04 22:17:52.787392 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2834/5738] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:17:52 2022] GET /compute/v2.1/servers/95a3ffcc-fc4e-4351-9d57-b8c065aa179c => generated 1279 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:17:53.384668 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-349ae7f5-cd3b-4527-ade6-561724dd1291 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:17:53.386155 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-349ae7f5-cd3b-4527-ade6-561724dd1291 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] [instance: 01f84e19-7e4a-460a-bb60-5da518f3d8b1] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:17:53.402779 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-349ae7f5-cd3b-4527-ade6-561724dd1291 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:17:53.405241 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-349ae7f5-cd3b-4527-ade6-561724dd1291 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:17:53.408983 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-349ae7f5-cd3b-4527-ade6-561724dd1291 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:17:53.410042 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-349ae7f5-cd3b-4527-ade6-561724dd1291 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:17:53.410742 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-349ae7f5-cd3b-4527-ade6-561724dd1291 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:17:53.413870 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-349ae7f5-cd3b-4527-ade6-561724dd1291 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:17:53.547670 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-349ae7f5-cd3b-4527-ade6-561724dd1291 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '524ac46437134cd5a5000574631ea59a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b191bd428a4906b6c2781ae3efdaae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:17:53.560642 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-349ae7f5-cd3b-4527-ade6-561724dd1291 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] 10.222.0.43 "GET /compute/v2.1/servers/01f84e19-7e4a-460a-bb60-5da518f3d8b1" status: 200 len: 1295 microversion: 2.1 time: 0.181032 Oct 04 22:17:53.561310 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2905/5739] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:17:53 2022] GET /compute/v2.1/servers/01f84e19-7e4a-460a-bb60-5da518f3d8b1 => generated 1295 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:17:53.813016 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-8f7f4d88-ec1a-4d20-9381-9819a56f7b94 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:17:53.814261 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-8f7f4d88-ec1a-4d20-9381-9819a56f7b94 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] [instance: 95a3ffcc-fc4e-4351-9d57-b8c065aa179c] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:17:53.827076 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8f7f4d88-ec1a-4d20-9381-9819a56f7b94 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:17:53.827843 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8f7f4d88-ec1a-4d20-9381-9819a56f7b94 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:17:53.828467 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8f7f4d88-ec1a-4d20-9381-9819a56f7b94 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:17:53.831212 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8f7f4d88-ec1a-4d20-9381-9819a56f7b94 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:17:53.831867 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8f7f4d88-ec1a-4d20-9381-9819a56f7b94 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:17:53.832479 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8f7f4d88-ec1a-4d20-9381-9819a56f7b94 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:17:53.952683 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-8f7f4d88-ec1a-4d20-9381-9819a56f7b94 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6cfeabf8d84b2893200c3c54c1c19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be71413506154420869fdff5939fb940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:17:53.963318 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-8f7f4d88-ec1a-4d20-9381-9819a56f7b94 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] 10.222.0.43 "GET /compute/v2.1/servers/95a3ffcc-fc4e-4351-9d57-b8c065aa179c" status: 200 len: 1279 microversion: 2.1 time: 0.154011 Oct 04 22:17:53.964132 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2835/5740] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:17:53 2022] GET /compute/v2.1/servers/95a3ffcc-fc4e-4351-9d57-b8c065aa179c => generated 1279 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:17:54.597181 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-aa8ea554-d4e0-4245-b0ac-0a06fdc234d9 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:17:54.597816 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-aa8ea554-d4e0-4245-b0ac-0a06fdc234d9 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] [instance: 01f84e19-7e4a-460a-bb60-5da518f3d8b1] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:17:54.618324 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-aa8ea554-d4e0-4245-b0ac-0a06fdc234d9 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:17:54.619197 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-aa8ea554-d4e0-4245-b0ac-0a06fdc234d9 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:17:54.620053 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-aa8ea554-d4e0-4245-b0ac-0a06fdc234d9 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:17:54.621108 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-aa8ea554-d4e0-4245-b0ac-0a06fdc234d9 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:17:54.621921 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-aa8ea554-d4e0-4245-b0ac-0a06fdc234d9 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:17:54.624007 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-aa8ea554-d4e0-4245-b0ac-0a06fdc234d9 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:17:54.732364 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-aa8ea554-d4e0-4245-b0ac-0a06fdc234d9 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '524ac46437134cd5a5000574631ea59a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b191bd428a4906b6c2781ae3efdaae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:17:54.748591 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-aa8ea554-d4e0-4245-b0ac-0a06fdc234d9 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] 10.222.0.43 "GET /compute/v2.1/servers/01f84e19-7e4a-460a-bb60-5da518f3d8b1" status: 200 len: 1295 microversion: 2.1 time: 0.155894 Oct 04 22:17:54.762398 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2906/5741] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:17:54 2022] GET /compute/v2.1/servers/01f84e19-7e4a-460a-bb60-5da518f3d8b1 => generated 1295 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:17:54.986658 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-a1e981c6-6406-4411-b0b9-8b4826519a32 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:17:54.987972 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-a1e981c6-6406-4411-b0b9-8b4826519a32 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] [instance: 95a3ffcc-fc4e-4351-9d57-b8c065aa179c] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:17:55.001597 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a1e981c6-6406-4411-b0b9-8b4826519a32 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:17:55.008897 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a1e981c6-6406-4411-b0b9-8b4826519a32 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:17:55.009623 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a1e981c6-6406-4411-b0b9-8b4826519a32 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:17:55.011258 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a1e981c6-6406-4411-b0b9-8b4826519a32 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:17:55.011989 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a1e981c6-6406-4411-b0b9-8b4826519a32 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:17:55.012666 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a1e981c6-6406-4411-b0b9-8b4826519a32 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:17:55.370225 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-a1e981c6-6406-4411-b0b9-8b4826519a32 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6cfeabf8d84b2893200c3c54c1c19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be71413506154420869fdff5939fb940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:17:55.386497 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-a1e981c6-6406-4411-b0b9-8b4826519a32 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] 10.222.0.43 "GET /compute/v2.1/servers/95a3ffcc-fc4e-4351-9d57-b8c065aa179c" status: 200 len: 1321 microversion: 2.1 time: 0.403789 Oct 04 22:17:55.412292 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2836/5742] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:17:54 2022] GET /compute/v2.1/servers/95a3ffcc-fc4e-4351-9d57-b8c065aa179c => generated 1321 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:17:55.777149 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-a5c34a91-89b1-433f-b517-80011a9efb51 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:17:55.777756 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-a5c34a91-89b1-433f-b517-80011a9efb51 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] [instance: 01f84e19-7e4a-460a-bb60-5da518f3d8b1] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:17:55.795626 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a5c34a91-89b1-433f-b517-80011a9efb51 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:17:55.796128 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a5c34a91-89b1-433f-b517-80011a9efb51 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:17:55.796625 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a5c34a91-89b1-433f-b517-80011a9efb51 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:17:55.797283 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a5c34a91-89b1-433f-b517-80011a9efb51 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:17:55.797744 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a5c34a91-89b1-433f-b517-80011a9efb51 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:17:55.798173 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a5c34a91-89b1-433f-b517-80011a9efb51 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:17:55.901305 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-a5c34a91-89b1-433f-b517-80011a9efb51 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '524ac46437134cd5a5000574631ea59a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b191bd428a4906b6c2781ae3efdaae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:17:55.910300 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-a5c34a91-89b1-433f-b517-80011a9efb51 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] 10.222.0.43 "GET /compute/v2.1/servers/01f84e19-7e4a-460a-bb60-5da518f3d8b1" status: 200 len: 1295 microversion: 2.1 time: 0.136979 Oct 04 22:17:55.911753 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2907/5743] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:17:55 2022] GET /compute/v2.1/servers/01f84e19-7e4a-460a-bb60-5da518f3d8b1 => generated 1295 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:17:56.413831 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-6bd495e1-97ba-4b70-b1eb-67cb2e1fb353 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:17:56.414777 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-6bd495e1-97ba-4b70-b1eb-67cb2e1fb353 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] [instance: 95a3ffcc-fc4e-4351-9d57-b8c065aa179c] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:17:56.431638 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6bd495e1-97ba-4b70-b1eb-67cb2e1fb353 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:17:56.432180 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6bd495e1-97ba-4b70-b1eb-67cb2e1fb353 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:17:56.432810 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6bd495e1-97ba-4b70-b1eb-67cb2e1fb353 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:17:56.433757 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6bd495e1-97ba-4b70-b1eb-67cb2e1fb353 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:17:56.435232 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6bd495e1-97ba-4b70-b1eb-67cb2e1fb353 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:17:56.436255 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6bd495e1-97ba-4b70-b1eb-67cb2e1fb353 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:17:56.937514 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-65d0b8c3-cd7f-4e88-bef8-1d4ca4ccf9b9 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:17:56.938282 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-65d0b8c3-cd7f-4e88-bef8-1d4ca4ccf9b9 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] [instance: 01f84e19-7e4a-460a-bb60-5da518f3d8b1] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:17:56.952323 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-65d0b8c3-cd7f-4e88-bef8-1d4ca4ccf9b9 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:17:56.963169 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-65d0b8c3-cd7f-4e88-bef8-1d4ca4ccf9b9 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:17:56.963974 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-65d0b8c3-cd7f-4e88-bef8-1d4ca4ccf9b9 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:17:56.964905 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-65d0b8c3-cd7f-4e88-bef8-1d4ca4ccf9b9 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:17:56.965582 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-65d0b8c3-cd7f-4e88-bef8-1d4ca4ccf9b9 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:17:56.966220 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-65d0b8c3-cd7f-4e88-bef8-1d4ca4ccf9b9 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:17:58.338821 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-65d0b8c3-cd7f-4e88-bef8-1d4ca4ccf9b9 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '524ac46437134cd5a5000574631ea59a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b191bd428a4906b6c2781ae3efdaae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:17:58.352649 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-65d0b8c3-cd7f-4e88-bef8-1d4ca4ccf9b9 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] 10.222.0.43 "GET /compute/v2.1/servers/01f84e19-7e4a-460a-bb60-5da518f3d8b1" status: 200 len: 1362 microversion: 2.1 time: 1.416726 Oct 04 22:17:58.355255 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-6bd495e1-97ba-4b70-b1eb-67cb2e1fb353 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6cfeabf8d84b2893200c3c54c1c19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be71413506154420869fdff5939fb940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:17:58.367524 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-6bd495e1-97ba-4b70-b1eb-67cb2e1fb353 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] 10.222.0.43 "GET /compute/v2.1/servers/95a3ffcc-fc4e-4351-9d57-b8c065aa179c" status: 200 len: 1321 microversion: 2.1 time: 1.958248 Oct 04 22:17:58.369334 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2908/5744] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:17:56 2022] GET /compute/v2.1/servers/01f84e19-7e4a-460a-bb60-5da518f3d8b1 => generated 1362 bytes in 1436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:17:58.370436 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2837/5745] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:17:56 2022] GET /compute/v2.1/servers/95a3ffcc-fc4e-4351-9d57-b8c065aa179c => generated 1321 bytes in 1962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:17:58.399593 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-192a97c2-72ab-4a4f-9be2-94acfc7f125c req-a2130186-3c42-4c13-a3b7-58e20381aad8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39984acf-f630-4ba0-b4e5-384ef8c3d9fc", "tag": "f5b43b12-ad10-49ab-918e-3f79c162348b"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:17:58.424482 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-192a97c2-72ab-4a4f-9be2-94acfc7f125c req-a2130186-3c42-4c13-a3b7-58e20381aad8 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:17:58.429909 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-192a97c2-72ab-4a4f-9be2-94acfc7f125c req-a2130186-3c42-4c13-a3b7-58e20381aad8 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:17:58.430828 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-192a97c2-72ab-4a4f-9be2-94acfc7f125c req-a2130186-3c42-4c13-a3b7-58e20381aad8 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:17:58.460544 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-192a97c2-72ab-4a4f-9be2-94acfc7f125c req-a2130186-3c42-4c13-a3b7-58e20381aad8 service nova] Creating event network-changed:f5b43b12-ad10-49ab-918e-3f79c162348b for instance 39984acf-f630-4ba0-b4e5-384ef8c3d9fc on n-h2-860284-1 Oct 04 22:17:58.477284 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-192a97c2-72ab-4a4f-9be2-94acfc7f125c req-a2130186-3c42-4c13-a3b7-58e20381aad8 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088953 Oct 04 22:17:58.478542 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2909/5746] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:17:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:17:59.373174 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-07bfd29f-f7da-4c51-b979-3287fdce2d82 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:17:59.373792 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-07bfd29f-f7da-4c51-b979-3287fdce2d82 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] [instance: 01f84e19-7e4a-460a-bb60-5da518f3d8b1] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:17:59.385017 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-07bfd29f-f7da-4c51-b979-3287fdce2d82 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:17:59.385517 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-07bfd29f-f7da-4c51-b979-3287fdce2d82 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:17:59.392504 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-07bfd29f-f7da-4c51-b979-3287fdce2d82 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:17:59.393590 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-07bfd29f-f7da-4c51-b979-3287fdce2d82 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:17:59.394195 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-07bfd29f-f7da-4c51-b979-3287fdce2d82 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:17:59.394758 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-07bfd29f-f7da-4c51-b979-3287fdce2d82 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:17:59.402549 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-8dd6807f-04dc-45c3-9f96-637266f6cb4a tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:17:59.403261 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-8dd6807f-04dc-45c3-9f96-637266f6cb4a tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] [instance: 95a3ffcc-fc4e-4351-9d57-b8c065aa179c] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:17:59.421820 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8dd6807f-04dc-45c3-9f96-637266f6cb4a tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:17:59.431282 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8dd6807f-04dc-45c3-9f96-637266f6cb4a tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:17:59.432019 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8dd6807f-04dc-45c3-9f96-637266f6cb4a tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:17:59.433554 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8dd6807f-04dc-45c3-9f96-637266f6cb4a tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:17:59.434450 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8dd6807f-04dc-45c3-9f96-637266f6cb4a tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:17:59.435088 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8dd6807f-04dc-45c3-9f96-637266f6cb4a tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:00.171719 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-07bfd29f-f7da-4c51-b979-3287fdce2d82 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '524ac46437134cd5a5000574631ea59a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b191bd428a4906b6c2781ae3efdaae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:18:00.182891 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-8dd6807f-04dc-45c3-9f96-637266f6cb4a tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6cfeabf8d84b2893200c3c54c1c19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be71413506154420869fdff5939fb940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:18:00.217512 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-8dd6807f-04dc-45c3-9f96-637266f6cb4a tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] 10.222.0.43 "GET /compute/v2.1/servers/95a3ffcc-fc4e-4351-9d57-b8c065aa179c" status: 200 len: 1321 microversion: 2.1 time: 0.820739 Oct 04 22:18:00.238394 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-07bfd29f-f7da-4c51-b979-3287fdce2d82 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] 10.222.0.43 "GET /compute/v2.1/servers/01f84e19-7e4a-460a-bb60-5da518f3d8b1" status: 200 len: 1362 microversion: 2.1 time: 0.850714 Oct 04 22:18:00.238626 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2910/5747] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:17:59 2022] GET /compute/v2.1/servers/95a3ffcc-fc4e-4351-9d57-b8c065aa179c => generated 1321 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:18:00.238720 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2838/5748] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:17:59 2022] GET /compute/v2.1/servers/01f84e19-7e4a-460a-bb60-5da518f3d8b1 => generated 1362 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:18:00.506997 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-085913cf-9938-4102-80ca-c4a2722def37 req-190a7683-ea6e-48de-9ae7-18bc0edb5d9e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c05ce571-4683-4210-af70-67c2d871f6f3", "tag": "7e71d229-6e38-4aba-8027-f54cd448b83b"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:18:00.532915 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-085913cf-9938-4102-80ca-c4a2722def37 req-190a7683-ea6e-48de-9ae7-18bc0edb5d9e service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:00.533430 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-085913cf-9938-4102-80ca-c4a2722def37 req-190a7683-ea6e-48de-9ae7-18bc0edb5d9e service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:00.534037 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-085913cf-9938-4102-80ca-c4a2722def37 req-190a7683-ea6e-48de-9ae7-18bc0edb5d9e service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:00.568225 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-085913cf-9938-4102-80ca-c4a2722def37 req-190a7683-ea6e-48de-9ae7-18bc0edb5d9e service nova] Creating event network-changed:7e71d229-6e38-4aba-8027-f54cd448b83b for instance c05ce571-4683-4210-af70-67c2d871f6f3 on n-h1-860284-1 Oct 04 22:18:00.574254 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-085913cf-9938-4102-80ca-c4a2722def37 req-190a7683-ea6e-48de-9ae7-18bc0edb5d9e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078672 Oct 04 22:18:00.577351 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2911/5749] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:18:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:18:01.267933 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell0:SELECT=6 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:18:01.278473 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-14c067bc-6bf9-4147-a8ed-b9bb071fb9ed tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:18:01.279096 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-14c067bc-6bf9-4147-a8ed-b9bb071fb9ed tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] [instance: 01f84e19-7e4a-460a-bb60-5da518f3d8b1] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:18:01.279714 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-1d037201-7724-4da5-8d6b-ca191c51dae8 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:18:01.281536 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-1d037201-7724-4da5-8d6b-ca191c51dae8 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] [instance: 95a3ffcc-fc4e-4351-9d57-b8c065aa179c] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:18:01.288977 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=6 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:18:01.297847 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=22 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:18:01.305687 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1d037201-7724-4da5-8d6b-ca191c51dae8 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:01.310772 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-14c067bc-6bf9-4147-a8ed-b9bb071fb9ed tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:01.313392 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1d037201-7724-4da5-8d6b-ca191c51dae8 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:01.315656 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1d037201-7724-4da5-8d6b-ca191c51dae8 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:01.318638 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1d037201-7724-4da5-8d6b-ca191c51dae8 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:01.322129 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-14c067bc-6bf9-4147-a8ed-b9bb071fb9ed tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:01.322784 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1d037201-7724-4da5-8d6b-ca191c51dae8 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:01.325966 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1d037201-7724-4da5-8d6b-ca191c51dae8 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:01.331621 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-14c067bc-6bf9-4147-a8ed-b9bb071fb9ed tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:01.332586 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-14c067bc-6bf9-4147-a8ed-b9bb071fb9ed tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:01.333089 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-14c067bc-6bf9-4147-a8ed-b9bb071fb9ed tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:01.338435 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-14c067bc-6bf9-4147-a8ed-b9bb071fb9ed tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:02.572476 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-1d037201-7724-4da5-8d6b-ca191c51dae8 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6cfeabf8d84b2893200c3c54c1c19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be71413506154420869fdff5939fb940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:18:02.576384 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-14c067bc-6bf9-4147-a8ed-b9bb071fb9ed tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '524ac46437134cd5a5000574631ea59a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b191bd428a4906b6c2781ae3efdaae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:18:02.592517 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-14c067bc-6bf9-4147-a8ed-b9bb071fb9ed tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] 10.222.0.43 "GET /compute/v2.1/servers/01f84e19-7e4a-460a-bb60-5da518f3d8b1" status: 200 len: 1362 microversion: 2.1 time: 1.329152 Oct 04 22:18:02.593790 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2839/5750] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:18:01 2022] GET /compute/v2.1/servers/01f84e19-7e4a-460a-bb60-5da518f3d8b1 => generated 1362 bytes in 1331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:18:02.603757 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-1d037201-7724-4da5-8d6b-ca191c51dae8 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] 10.222.0.43 "GET /compute/v2.1/servers/95a3ffcc-fc4e-4351-9d57-b8c065aa179c" status: 200 len: 1321 microversion: 2.1 time: 1.335656 Oct 04 22:18:02.606136 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2912/5751] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:18:01 2022] GET /compute/v2.1/servers/95a3ffcc-fc4e-4351-9d57-b8c065aa179c => generated 1321 bytes in 1340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:18:02.629812 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-850f4621-56cf-4bf1-8ef0-f47b1755832c req-f1c9a98b-cc94-460d-b175-5e4df8ef0321 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95a3ffcc-fc4e-4351-9d57-b8c065aa179c", "tag": "c5f7322f-32c1-4023-8ab9-49d925d5f631"}, {"name": "network-changed", "server_uuid": "01f84e19-7e4a-460a-bb60-5da518f3d8b1", "tag": "c14485cd-34c9-4858-a37e-19a888659784"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:18:02.654697 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-850f4621-56cf-4bf1-8ef0-f47b1755832c req-f1c9a98b-cc94-460d-b175-5e4df8ef0321 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:02.655738 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-850f4621-56cf-4bf1-8ef0-f47b1755832c req-f1c9a98b-cc94-460d-b175-5e4df8ef0321 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:02.657077 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-850f4621-56cf-4bf1-8ef0-f47b1755832c req-f1c9a98b-cc94-460d-b175-5e4df8ef0321 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:02.676580 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-850f4621-56cf-4bf1-8ef0-f47b1755832c req-f1c9a98b-cc94-460d-b175-5e4df8ef0321 service nova] Creating event network-changed:c5f7322f-32c1-4023-8ab9-49d925d5f631 for instance 95a3ffcc-fc4e-4351-9d57-b8c065aa179c on n-h1-860284-1 Oct 04 22:18:02.677726 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-850f4621-56cf-4bf1-8ef0-f47b1755832c req-f1c9a98b-cc94-460d-b175-5e4df8ef0321 service nova] Creating event network-changed:c14485cd-34c9-4858-a37e-19a888659784 for instance 01f84e19-7e4a-460a-bb60-5da518f3d8b1 on n-h2-860284-1 Oct 04 22:18:02.688864 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-850f4621-56cf-4bf1-8ef0-f47b1755832c req-f1c9a98b-cc94-460d-b175-5e4df8ef0321 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.065336 Oct 04 22:18:02.690056 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2840/5752] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:18:02 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:18:03.618698 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-3ac2767b-b57d-4e4b-818e-19bd9a3f9c5d tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:18:03.620768 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-3ac2767b-b57d-4e4b-818e-19bd9a3f9c5d tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] [instance: 01f84e19-7e4a-460a-bb60-5da518f3d8b1] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:18:03.634077 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3ac2767b-b57d-4e4b-818e-19bd9a3f9c5d tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:03.634284 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3ac2767b-b57d-4e4b-818e-19bd9a3f9c5d tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:03.637199 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-90b0c77a-c916-488a-bfd6-247d022ed060 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:18:03.637935 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-90b0c77a-c916-488a-bfd6-247d022ed060 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] [instance: 95a3ffcc-fc4e-4351-9d57-b8c065aa179c] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:18:03.642230 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3ac2767b-b57d-4e4b-818e-19bd9a3f9c5d tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:03.643248 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3ac2767b-b57d-4e4b-818e-19bd9a3f9c5d tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:03.643739 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3ac2767b-b57d-4e4b-818e-19bd9a3f9c5d tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:03.644183 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3ac2767b-b57d-4e4b-818e-19bd9a3f9c5d tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:03.653374 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-90b0c77a-c916-488a-bfd6-247d022ed060 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:03.653881 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-90b0c77a-c916-488a-bfd6-247d022ed060 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:03.654332 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-90b0c77a-c916-488a-bfd6-247d022ed060 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:03.664204 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-90b0c77a-c916-488a-bfd6-247d022ed060 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:03.665249 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-90b0c77a-c916-488a-bfd6-247d022ed060 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:03.670013 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-90b0c77a-c916-488a-bfd6-247d022ed060 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:03.980457 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-3ac2767b-b57d-4e4b-818e-19bd9a3f9c5d tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '524ac46437134cd5a5000574631ea59a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b191bd428a4906b6c2781ae3efdaae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:18:03.990053 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-3ac2767b-b57d-4e4b-818e-19bd9a3f9c5d tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] 10.222.0.43 "GET /compute/v2.1/servers/01f84e19-7e4a-460a-bb60-5da518f3d8b1" status: 200 len: 1362 microversion: 2.1 time: 0.376274 Oct 04 22:18:03.994981 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2913/5753] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:18:03 2022] GET /compute/v2.1/servers/01f84e19-7e4a-460a-bb60-5da518f3d8b1 => generated 1362 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:18:04.146114 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-90b0c77a-c916-488a-bfd6-247d022ed060 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6cfeabf8d84b2893200c3c54c1c19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be71413506154420869fdff5939fb940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:18:04.161400 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-90b0c77a-c916-488a-bfd6-247d022ed060 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] 10.222.0.43 "GET /compute/v2.1/servers/95a3ffcc-fc4e-4351-9d57-b8c065aa179c" status: 200 len: 1321 microversion: 2.1 time: 0.528318 Oct 04 22:18:04.181378 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2841/5754] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:18:03 2022] GET /compute/v2.1/servers/95a3ffcc-fc4e-4351-9d57-b8c065aa179c => generated 1321 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:18:05.018429 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-71c6f9c6-1bf4-407a-a5eb-92d5d5807c2d tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:18:05.021014 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-71c6f9c6-1bf4-407a-a5eb-92d5d5807c2d tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] [instance: 01f84e19-7e4a-460a-bb60-5da518f3d8b1] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:18:05.039487 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-71c6f9c6-1bf4-407a-a5eb-92d5d5807c2d tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:05.041870 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-71c6f9c6-1bf4-407a-a5eb-92d5d5807c2d tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:05.043012 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-71c6f9c6-1bf4-407a-a5eb-92d5d5807c2d tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:05.044719 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-71c6f9c6-1bf4-407a-a5eb-92d5d5807c2d tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:05.047332 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-71c6f9c6-1bf4-407a-a5eb-92d5d5807c2d tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:05.048823 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-71c6f9c6-1bf4-407a-a5eb-92d5d5807c2d tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:05.187981 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-365d7391-19cc-4bc1-9b70-7fae461f9954 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:18:05.188605 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-365d7391-19cc-4bc1-9b70-7fae461f9954 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] [instance: 95a3ffcc-fc4e-4351-9d57-b8c065aa179c] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:18:05.202697 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-365d7391-19cc-4bc1-9b70-7fae461f9954 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:05.203206 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-365d7391-19cc-4bc1-9b70-7fae461f9954 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:05.203866 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-365d7391-19cc-4bc1-9b70-7fae461f9954 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:05.204828 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-365d7391-19cc-4bc1-9b70-7fae461f9954 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:05.205477 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-365d7391-19cc-4bc1-9b70-7fae461f9954 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:05.208847 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-365d7391-19cc-4bc1-9b70-7fae461f9954 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:05.607415 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-71c6f9c6-1bf4-407a-a5eb-92d5d5807c2d tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '524ac46437134cd5a5000574631ea59a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b191bd428a4906b6c2781ae3efdaae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:18:05.620154 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-365d7391-19cc-4bc1-9b70-7fae461f9954 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6cfeabf8d84b2893200c3c54c1c19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be71413506154420869fdff5939fb940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:18:05.639130 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-71c6f9c6-1bf4-407a-a5eb-92d5d5807c2d tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] 10.222.0.43 "GET /compute/v2.1/servers/01f84e19-7e4a-460a-bb60-5da518f3d8b1" status: 200 len: 1362 microversion: 2.1 time: 0.620281 Oct 04 22:18:05.640766 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-365d7391-19cc-4bc1-9b70-7fae461f9954 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] 10.222.0.43 "GET /compute/v2.1/servers/95a3ffcc-fc4e-4351-9d57-b8c065aa179c" status: 200 len: 1321 microversion: 2.1 time: 0.457012 Oct 04 22:18:05.641576 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2914/5755] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:18:05 2022] GET /compute/v2.1/servers/01f84e19-7e4a-460a-bb60-5da518f3d8b1 => generated 1362 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:18:05.643196 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2842/5756] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:18:05 2022] GET /compute/v2.1/servers/95a3ffcc-fc4e-4351-9d57-b8c065aa179c => generated 1321 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:18:06.686192 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-fc9b1ca2-814a-4f82-85cd-b246191f5acf tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:18:06.692059 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-a671174c-b191-48d5-956f-135a2d1d87ba tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:18:06.695644 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-a671174c-b191-48d5-956f-135a2d1d87ba tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] [instance: 95a3ffcc-fc4e-4351-9d57-b8c065aa179c] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:18:06.696079 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-fc9b1ca2-814a-4f82-85cd-b246191f5acf tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] [instance: 01f84e19-7e4a-460a-bb60-5da518f3d8b1] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:18:06.714722 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a671174c-b191-48d5-956f-135a2d1d87ba tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:06.715254 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a671174c-b191-48d5-956f-135a2d1d87ba tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:06.715807 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fc9b1ca2-814a-4f82-85cd-b246191f5acf tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:06.716593 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fc9b1ca2-814a-4f82-85cd-b246191f5acf tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:06.717580 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fc9b1ca2-814a-4f82-85cd-b246191f5acf tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:06.719219 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a671174c-b191-48d5-956f-135a2d1d87ba tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:06.721178 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fc9b1ca2-814a-4f82-85cd-b246191f5acf tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:06.722320 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fc9b1ca2-814a-4f82-85cd-b246191f5acf tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:06.723633 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fc9b1ca2-814a-4f82-85cd-b246191f5acf tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:06.723791 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a671174c-b191-48d5-956f-135a2d1d87ba tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:06.727502 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a671174c-b191-48d5-956f-135a2d1d87ba tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:06.728960 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a671174c-b191-48d5-956f-135a2d1d87ba tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:07.174133 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-fc9b1ca2-814a-4f82-85cd-b246191f5acf tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '524ac46437134cd5a5000574631ea59a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b191bd428a4906b6c2781ae3efdaae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:18:07.182981 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-fc9b1ca2-814a-4f82-85cd-b246191f5acf tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] 10.222.0.43 "GET /compute/v2.1/servers/01f84e19-7e4a-460a-bb60-5da518f3d8b1" status: 200 len: 1362 microversion: 2.1 time: 0.520679 Oct 04 22:18:07.202789 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2915/5757] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:18:06 2022] GET /compute/v2.1/servers/01f84e19-7e4a-460a-bb60-5da518f3d8b1 => generated 1362 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:18:07.203347 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-a671174c-b191-48d5-956f-135a2d1d87ba tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6cfeabf8d84b2893200c3c54c1c19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be71413506154420869fdff5939fb940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:18:07.215146 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-a671174c-b191-48d5-956f-135a2d1d87ba tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] 10.222.0.43 "GET /compute/v2.1/servers/95a3ffcc-fc4e-4351-9d57-b8c065aa179c" status: 200 len: 1321 microversion: 2.1 time: 0.554038 Oct 04 22:18:07.215739 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2843/5758] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:18:06 2022] GET /compute/v2.1/servers/95a3ffcc-fc4e-4351-9d57-b8c065aa179c => generated 1321 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:18:07.371369 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-11dcdaed-27b7-4820-9b43-8b12de136969 req-310883cb-d362-4aec-9d53-15e8fa97411f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39984acf-f630-4ba0-b4e5-384ef8c3d9fc", "name": "network-vif-plugged", "status": "completed", "tag": "f5b43b12-ad10-49ab-918e-3f79c162348b"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:18:07.386854 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-11dcdaed-27b7-4820-9b43-8b12de136969 req-310883cb-d362-4aec-9d53-15e8fa97411f service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:07.387948 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-11dcdaed-27b7-4820-9b43-8b12de136969 req-310883cb-d362-4aec-9d53-15e8fa97411f service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:07.389190 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-11dcdaed-27b7-4820-9b43-8b12de136969 req-310883cb-d362-4aec-9d53-15e8fa97411f service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:07.405796 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-11dcdaed-27b7-4820-9b43-8b12de136969 req-310883cb-d362-4aec-9d53-15e8fa97411f service nova] Creating event network-vif-plugged:f5b43b12-ad10-49ab-918e-3f79c162348b for instance 39984acf-f630-4ba0-b4e5-384ef8c3d9fc on n-h2-860284-1 Oct 04 22:18:07.415700 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-11dcdaed-27b7-4820-9b43-8b12de136969 req-310883cb-d362-4aec-9d53-15e8fa97411f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048249 Oct 04 22:18:07.418119 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2916/5759] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:18:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:18:08.210427 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-4271cbab-a84b-4b65-b829-a7cea8c6bcab tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:18:08.211186 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-4271cbab-a84b-4b65-b829-a7cea8c6bcab tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] [instance: 01f84e19-7e4a-460a-bb60-5da518f3d8b1] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:18:08.222814 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4271cbab-a84b-4b65-b829-a7cea8c6bcab tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:08.224753 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4271cbab-a84b-4b65-b829-a7cea8c6bcab tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:08.226693 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4271cbab-a84b-4b65-b829-a7cea8c6bcab tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:08.227696 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4271cbab-a84b-4b65-b829-a7cea8c6bcab tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:08.228328 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4271cbab-a84b-4b65-b829-a7cea8c6bcab tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:08.233414 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4271cbab-a84b-4b65-b829-a7cea8c6bcab tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:08.239803 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-eddf3531-cdf8-4e8b-b505-419c228b3cb6 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:18:08.242396 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-eddf3531-cdf8-4e8b-b505-419c228b3cb6 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] [instance: 95a3ffcc-fc4e-4351-9d57-b8c065aa179c] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:18:08.257889 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-eddf3531-cdf8-4e8b-b505-419c228b3cb6 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:08.258611 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-eddf3531-cdf8-4e8b-b505-419c228b3cb6 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:08.260447 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-eddf3531-cdf8-4e8b-b505-419c228b3cb6 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:08.265627 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-eddf3531-cdf8-4e8b-b505-419c228b3cb6 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:08.266618 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-eddf3531-cdf8-4e8b-b505-419c228b3cb6 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:08.267950 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-eddf3531-cdf8-4e8b-b505-419c228b3cb6 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:08.626265 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-4271cbab-a84b-4b65-b829-a7cea8c6bcab tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '524ac46437134cd5a5000574631ea59a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b191bd428a4906b6c2781ae3efdaae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:18:08.635355 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-4271cbab-a84b-4b65-b829-a7cea8c6bcab tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] 10.222.0.43 "GET /compute/v2.1/servers/01f84e19-7e4a-460a-bb60-5da518f3d8b1" status: 200 len: 1362 microversion: 2.1 time: 0.429148 Oct 04 22:18:08.642205 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2844/5760] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:18:08 2022] GET /compute/v2.1/servers/01f84e19-7e4a-460a-bb60-5da518f3d8b1 => generated 1362 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:18:08.729580 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-eddf3531-cdf8-4e8b-b505-419c228b3cb6 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6cfeabf8d84b2893200c3c54c1c19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be71413506154420869fdff5939fb940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:18:08.746138 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-eddf3531-cdf8-4e8b-b505-419c228b3cb6 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] 10.222.0.43 "GET /compute/v2.1/servers/95a3ffcc-fc4e-4351-9d57-b8c065aa179c" status: 200 len: 1321 microversion: 2.1 time: 0.512426 Oct 04 22:18:08.759862 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2917/5761] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:18:08 2022] GET /compute/v2.1/servers/95a3ffcc-fc4e-4351-9d57-b8c065aa179c => generated 1321 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:18:09.565359 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-34ff3a3a-4868-4255-8c27-82366001738e req-c18446a6-0e09-4bc5-9fcb-a9a7ea988176 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95a3ffcc-fc4e-4351-9d57-b8c065aa179c", "name": "network-vif-plugged", "status": "completed", "tag": "c5f7322f-32c1-4023-8ab9-49d925d5f631"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:18:09.594225 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-34ff3a3a-4868-4255-8c27-82366001738e req-c18446a6-0e09-4bc5-9fcb-a9a7ea988176 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:09.594643 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-34ff3a3a-4868-4255-8c27-82366001738e req-c18446a6-0e09-4bc5-9fcb-a9a7ea988176 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:09.595104 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-34ff3a3a-4868-4255-8c27-82366001738e req-c18446a6-0e09-4bc5-9fcb-a9a7ea988176 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:09.631879 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-34ff3a3a-4868-4255-8c27-82366001738e req-c18446a6-0e09-4bc5-9fcb-a9a7ea988176 service nova] Creating event network-vif-plugged:c5f7322f-32c1-4023-8ab9-49d925d5f631 for instance 95a3ffcc-fc4e-4351-9d57-b8c065aa179c on n-h1-860284-1 Oct 04 22:18:09.645394 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-34ff3a3a-4868-4255-8c27-82366001738e req-c18446a6-0e09-4bc5-9fcb-a9a7ea988176 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084568 Oct 04 22:18:09.649490 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2845/5762] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:18:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:18:09.661647 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-92bd878b-0a9e-44f5-ba9f-bdd3e9549dd5 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:18:09.664260 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-92bd878b-0a9e-44f5-ba9f-bdd3e9549dd5 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] [instance: 01f84e19-7e4a-460a-bb60-5da518f3d8b1] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:18:09.674980 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-92bd878b-0a9e-44f5-ba9f-bdd3e9549dd5 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:09.677590 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-92bd878b-0a9e-44f5-ba9f-bdd3e9549dd5 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:09.680072 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-92bd878b-0a9e-44f5-ba9f-bdd3e9549dd5 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:09.681072 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-92bd878b-0a9e-44f5-ba9f-bdd3e9549dd5 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:09.683058 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-92bd878b-0a9e-44f5-ba9f-bdd3e9549dd5 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:09.683679 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-92bd878b-0a9e-44f5-ba9f-bdd3e9549dd5 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:09.773625 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-5ff60b98-04ef-48c7-802c-d410e0dcf096 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:18:09.774599 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-5ff60b98-04ef-48c7-802c-d410e0dcf096 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] [instance: 95a3ffcc-fc4e-4351-9d57-b8c065aa179c] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:18:09.805316 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5ff60b98-04ef-48c7-802c-d410e0dcf096 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:09.805996 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5ff60b98-04ef-48c7-802c-d410e0dcf096 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:09.814534 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5ff60b98-04ef-48c7-802c-d410e0dcf096 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:09.815638 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5ff60b98-04ef-48c7-802c-d410e0dcf096 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:09.816225 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5ff60b98-04ef-48c7-802c-d410e0dcf096 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:09.816793 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5ff60b98-04ef-48c7-802c-d410e0dcf096 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:09.955931 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-92bd878b-0a9e-44f5-ba9f-bdd3e9549dd5 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '524ac46437134cd5a5000574631ea59a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b191bd428a4906b6c2781ae3efdaae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:18:09.966255 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-92bd878b-0a9e-44f5-ba9f-bdd3e9549dd5 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] 10.222.0.43 "GET /compute/v2.1/servers/01f84e19-7e4a-460a-bb60-5da518f3d8b1" status: 200 len: 1362 microversion: 2.1 time: 0.309669 Oct 04 22:18:09.966944 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2918/5763] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:18:09 2022] GET /compute/v2.1/servers/01f84e19-7e4a-460a-bb60-5da518f3d8b1 => generated 1362 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:18:10.151399 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-5ff60b98-04ef-48c7-802c-d410e0dcf096 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6cfeabf8d84b2893200c3c54c1c19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be71413506154420869fdff5939fb940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:18:10.187039 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-5ff60b98-04ef-48c7-802c-d410e0dcf096 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] 10.222.0.43 "GET /compute/v2.1/servers/95a3ffcc-fc4e-4351-9d57-b8c065aa179c" status: 200 len: 1321 microversion: 2.1 time: 0.417963 Oct 04 22:18:10.196079 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2846/5764] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:18:09 2022] GET /compute/v2.1/servers/95a3ffcc-fc4e-4351-9d57-b8c065aa179c => generated 1321 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:18:10.990087 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-ab5278c9-d580-43af-af72-c065d873b38c tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:18:10.990920 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-ab5278c9-d580-43af-af72-c065d873b38c tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] [instance: 01f84e19-7e4a-460a-bb60-5da518f3d8b1] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:18:11.001140 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ab5278c9-d580-43af-af72-c065d873b38c tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:11.001866 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ab5278c9-d580-43af-af72-c065d873b38c tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:11.002534 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ab5278c9-d580-43af-af72-c065d873b38c tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:11.003444 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ab5278c9-d580-43af-af72-c065d873b38c tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:11.004182 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ab5278c9-d580-43af-af72-c065d873b38c tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:11.004851 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ab5278c9-d580-43af-af72-c065d873b38c tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:11.219077 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-1c0ed0d0-849e-4163-aebe-8d9b9f94791e tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:18:11.220451 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-1c0ed0d0-849e-4163-aebe-8d9b9f94791e tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] [instance: 95a3ffcc-fc4e-4351-9d57-b8c065aa179c] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:18:11.226852 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=9 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:18:11.229079 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1c0ed0d0-849e-4163-aebe-8d9b9f94791e tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:11.230521 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1c0ed0d0-849e-4163-aebe-8d9b9f94791e tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:11.230521 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1c0ed0d0-849e-4163-aebe-8d9b9f94791e tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:11.231384 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1c0ed0d0-849e-4163-aebe-8d9b9f94791e tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:11.232250 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1c0ed0d0-849e-4163-aebe-8d9b9f94791e tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:11.232919 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1c0ed0d0-849e-4163-aebe-8d9b9f94791e tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:11.237648 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=90 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:18:11.363402 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-ab5278c9-d580-43af-af72-c065d873b38c tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '524ac46437134cd5a5000574631ea59a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b191bd428a4906b6c2781ae3efdaae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:18:11.374787 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-ab5278c9-d580-43af-af72-c065d873b38c tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] 10.222.0.43 "GET /compute/v2.1/servers/01f84e19-7e4a-460a-bb60-5da518f3d8b1" status: 200 len: 1362 microversion: 2.1 time: 0.388492 Oct 04 22:18:11.376193 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2919/5765] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:18:10 2022] GET /compute/v2.1/servers/01f84e19-7e4a-460a-bb60-5da518f3d8b1 => generated 1362 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:18:11.498871 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-1c0ed0d0-849e-4163-aebe-8d9b9f94791e tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6cfeabf8d84b2893200c3c54c1c19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be71413506154420869fdff5939fb940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:18:11.509487 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-1c0ed0d0-849e-4163-aebe-8d9b9f94791e tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] 10.222.0.43 "GET /compute/v2.1/servers/95a3ffcc-fc4e-4351-9d57-b8c065aa179c" status: 200 len: 1321 microversion: 2.1 time: 0.301735 Oct 04 22:18:11.511883 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2847/5766] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:18:11 2022] GET /compute/v2.1/servers/95a3ffcc-fc4e-4351-9d57-b8c065aa179c => generated 1321 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:18:11.700566 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-75c49b4a-66f4-4e37-858f-cb704e2d6b32 req-aaa792d4-cef4-4d2d-8751-95f6b65721ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01f84e19-7e4a-460a-bb60-5da518f3d8b1", "name": "network-vif-plugged", "status": "completed", "tag": "c14485cd-34c9-4858-a37e-19a888659784"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:18:11.711397 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-75c49b4a-66f4-4e37-858f-cb704e2d6b32 req-aaa792d4-cef4-4d2d-8751-95f6b65721ad service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:11.712243 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-75c49b4a-66f4-4e37-858f-cb704e2d6b32 req-aaa792d4-cef4-4d2d-8751-95f6b65721ad service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:11.713011 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-75c49b4a-66f4-4e37-858f-cb704e2d6b32 req-aaa792d4-cef4-4d2d-8751-95f6b65721ad service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:11.727985 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-75c49b4a-66f4-4e37-858f-cb704e2d6b32 req-aaa792d4-cef4-4d2d-8751-95f6b65721ad service nova] Creating event network-vif-plugged:c14485cd-34c9-4858-a37e-19a888659784 for instance 01f84e19-7e4a-460a-bb60-5da518f3d8b1 on n-h2-860284-1 Oct 04 22:18:11.734683 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-75c49b4a-66f4-4e37-858f-cb704e2d6b32 req-aaa792d4-cef4-4d2d-8751-95f6b65721ad service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037473 Oct 04 22:18:11.735682 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2920/5767] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:18:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:18:12.403309 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-648c125a-0059-43f5-98c9-20b06cd09f19 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:18:12.405024 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-648c125a-0059-43f5-98c9-20b06cd09f19 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] [instance: 01f84e19-7e4a-460a-bb60-5da518f3d8b1] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:18:12.414967 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-648c125a-0059-43f5-98c9-20b06cd09f19 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:12.415747 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-648c125a-0059-43f5-98c9-20b06cd09f19 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:12.416425 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-648c125a-0059-43f5-98c9-20b06cd09f19 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:12.417402 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-648c125a-0059-43f5-98c9-20b06cd09f19 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:12.418093 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-648c125a-0059-43f5-98c9-20b06cd09f19 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:12.419245 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-648c125a-0059-43f5-98c9-20b06cd09f19 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:12.534654 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-ddf86365-5b1a-4e61-8926-864a074ce88d tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:18:12.536819 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-ddf86365-5b1a-4e61-8926-864a074ce88d tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] [instance: 95a3ffcc-fc4e-4351-9d57-b8c065aa179c] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:18:12.544436 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ddf86365-5b1a-4e61-8926-864a074ce88d tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:12.545279 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ddf86365-5b1a-4e61-8926-864a074ce88d tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:12.546103 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ddf86365-5b1a-4e61-8926-864a074ce88d tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:12.547348 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ddf86365-5b1a-4e61-8926-864a074ce88d tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:12.548068 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ddf86365-5b1a-4e61-8926-864a074ce88d tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:12.548754 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ddf86365-5b1a-4e61-8926-864a074ce88d tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:12.583649 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=100 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:18:13.266584 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-648c125a-0059-43f5-98c9-20b06cd09f19 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '524ac46437134cd5a5000574631ea59a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b191bd428a4906b6c2781ae3efdaae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:18:13.276894 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-648c125a-0059-43f5-98c9-20b06cd09f19 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] 10.222.0.43 "GET /compute/v2.1/servers/01f84e19-7e4a-460a-bb60-5da518f3d8b1" status: 200 len: 1362 microversion: 2.1 time: 0.881679 Oct 04 22:18:13.278235 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2848/5768] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:18:12 2022] GET /compute/v2.1/servers/01f84e19-7e4a-460a-bb60-5da518f3d8b1 => generated 1362 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:18:13.306570 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-ddf86365-5b1a-4e61-8926-864a074ce88d tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6cfeabf8d84b2893200c3c54c1c19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be71413506154420869fdff5939fb940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:18:13.319919 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-ddf86365-5b1a-4e61-8926-864a074ce88d tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] 10.222.0.43 "GET /compute/v2.1/servers/95a3ffcc-fc4e-4351-9d57-b8c065aa179c" status: 200 len: 1516 microversion: 2.1 time: 0.787556 Oct 04 22:18:13.322694 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2921/5769] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:18:12 2022] GET /compute/v2.1/servers/95a3ffcc-fc4e-4351-9d57-b8c065aa179c => generated 1516 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:18:13.354539 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-d3269d34-1efd-4408-9cce-73385c969f05 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:18:13.358037 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-d3269d34-1efd-4408-9cce-73385c969f05 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] [instance: 95a3ffcc-fc4e-4351-9d57-b8c065aa179c] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:18:13.380127 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d3269d34-1efd-4408-9cce-73385c969f05 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:13.384914 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d3269d34-1efd-4408-9cce-73385c969f05 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:13.390598 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d3269d34-1efd-4408-9cce-73385c969f05 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:13.392915 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d3269d34-1efd-4408-9cce-73385c969f05 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:13.394015 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d3269d34-1efd-4408-9cce-73385c969f05 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:13.394853 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d3269d34-1efd-4408-9cce-73385c969f05 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:13.469681 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.objects.instance [None req-d3269d34-1efd-4408-9cce-73385c969f05 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lazy-loading 'flavor' on Instance uuid 95a3ffcc-fc4e-4351-9d57-b8c065aa179c {{(pid=134101) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 22:18:13.632243 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-d3269d34-1efd-4408-9cce-73385c969f05 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] 10.222.0.43 "POST /compute/v2.1/servers/95a3ffcc-fc4e-4351-9d57-b8c065aa179c/action" status: 200 len: 32 microversion: 2.1 time: 0.283900 Oct 04 22:18:13.632995 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2849/5770] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 22:18:13 2022] POST /compute/v2.1/servers/95a3ffcc-fc4e-4351-9d57-b8c065aa179c/action => generated 32 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 22:18:13.652595 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-45e1af6e-f012-44d8-bdd2-04ed86e4c6ef tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:18:13.655995 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-45e1af6e-f012-44d8-bdd2-04ed86e4c6ef tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] [instance: 95a3ffcc-fc4e-4351-9d57-b8c065aa179c] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:18:13.692351 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-45e1af6e-f012-44d8-bdd2-04ed86e4c6ef tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:13.693295 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-45e1af6e-f012-44d8-bdd2-04ed86e4c6ef tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:13.696852 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-45e1af6e-f012-44d8-bdd2-04ed86e4c6ef tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:13.697916 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-45e1af6e-f012-44d8-bdd2-04ed86e4c6ef tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:13.715221 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-45e1af6e-f012-44d8-bdd2-04ed86e4c6ef tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:13.718304 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-45e1af6e-f012-44d8-bdd2-04ed86e4c6ef tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:14.004304 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-45e1af6e-f012-44d8-bdd2-04ed86e4c6ef tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6cfeabf8d84b2893200c3c54c1c19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be71413506154420869fdff5939fb940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:18:14.014713 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-45e1af6e-f012-44d8-bdd2-04ed86e4c6ef tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] 10.222.0.43 "GET /compute/v2.1/servers/95a3ffcc-fc4e-4351-9d57-b8c065aa179c" status: 200 len: 1522 microversion: 2.1 time: 0.375787 Oct 04 22:18:14.018033 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2922/5771] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:18:13 2022] GET /compute/v2.1/servers/95a3ffcc-fc4e-4351-9d57-b8c065aa179c => generated 1522 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:18:14.309022 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-7eb9b85f-ed10-4933-baa3-d3d0278aac00 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:18:14.309859 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-7eb9b85f-ed10-4933-baa3-d3d0278aac00 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] [instance: 01f84e19-7e4a-460a-bb60-5da518f3d8b1] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:18:14.317519 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7eb9b85f-ed10-4933-baa3-d3d0278aac00 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:14.318469 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7eb9b85f-ed10-4933-baa3-d3d0278aac00 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:14.319032 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7eb9b85f-ed10-4933-baa3-d3d0278aac00 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:14.320760 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7eb9b85f-ed10-4933-baa3-d3d0278aac00 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:14.322567 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7eb9b85f-ed10-4933-baa3-d3d0278aac00 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:14.324780 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7eb9b85f-ed10-4933-baa3-d3d0278aac00 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:14.701691 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-7eb9b85f-ed10-4933-baa3-d3d0278aac00 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '524ac46437134cd5a5000574631ea59a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b191bd428a4906b6c2781ae3efdaae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:18:14.712203 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-7eb9b85f-ed10-4933-baa3-d3d0278aac00 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] 10.222.0.43 "GET /compute/v2.1/servers/01f84e19-7e4a-460a-bb60-5da518f3d8b1" status: 200 len: 1549 microversion: 2.1 time: 0.410050 Oct 04 22:18:14.731245 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2850/5772] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:18:14 2022] GET /compute/v2.1/servers/01f84e19-7e4a-460a-bb60-5da518f3d8b1 => generated 1549 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:18:14.744247 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-2eccd39f-ee83-47ef-8b27-0bd3b89d4037 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:18:14.745387 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-2eccd39f-ee83-47ef-8b27-0bd3b89d4037 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] [instance: 01f84e19-7e4a-460a-bb60-5da518f3d8b1] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:18:14.756776 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2eccd39f-ee83-47ef-8b27-0bd3b89d4037 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:14.767532 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2eccd39f-ee83-47ef-8b27-0bd3b89d4037 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:14.768366 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2eccd39f-ee83-47ef-8b27-0bd3b89d4037 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:14.771207 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2eccd39f-ee83-47ef-8b27-0bd3b89d4037 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:14.773246 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2eccd39f-ee83-47ef-8b27-0bd3b89d4037 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:14.777242 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2eccd39f-ee83-47ef-8b27-0bd3b89d4037 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:14.957198 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-2eccd39f-ee83-47ef-8b27-0bd3b89d4037 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] 10.222.0.43 "GET /compute/v2.1/servers/01f84e19-7e4a-460a-bb60-5da518f3d8b1/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.218009 Oct 04 22:18:14.958189 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2923/5773] 10.222.0.43 () {58 vars in 1275 bytes} [Tue Oct 4 22:18:14 2022] GET /compute/v2.1/servers/01f84e19-7e4a-460a-bb60-5da518f3d8b1/os-interface => generated 285 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:18:15.047645 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-9b3f8d22-167f-40c3-a12e-db72ee73817b tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:18:15.048789 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-9b3f8d22-167f-40c3-a12e-db72ee73817b tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] [instance: 95a3ffcc-fc4e-4351-9d57-b8c065aa179c] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:18:15.061984 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9b3f8d22-167f-40c3-a12e-db72ee73817b tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:15.066754 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9b3f8d22-167f-40c3-a12e-db72ee73817b tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:15.068031 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9b3f8d22-167f-40c3-a12e-db72ee73817b tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:15.073412 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9b3f8d22-167f-40c3-a12e-db72ee73817b tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:15.074249 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9b3f8d22-167f-40c3-a12e-db72ee73817b tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:15.083042 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9b3f8d22-167f-40c3-a12e-db72ee73817b tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:15.479847 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-9b3f8d22-167f-40c3-a12e-db72ee73817b tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6cfeabf8d84b2893200c3c54c1c19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be71413506154420869fdff5939fb940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:18:15.492075 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-9b3f8d22-167f-40c3-a12e-db72ee73817b tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] 10.222.0.43 "GET /compute/v2.1/servers/95a3ffcc-fc4e-4351-9d57-b8c065aa179c" status: 200 len: 1522 microversion: 2.1 time: 0.448466 Oct 04 22:18:15.502529 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2851/5774] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:18:15 2022] GET /compute/v2.1/servers/95a3ffcc-fc4e-4351-9d57-b8c065aa179c => generated 1522 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:18:16.520862 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-82f0acfb-7fa9-4cf9-bf2f-47159926ae3c tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:18:16.521411 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-82f0acfb-7fa9-4cf9-bf2f-47159926ae3c tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] [instance: 95a3ffcc-fc4e-4351-9d57-b8c065aa179c] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:18:16.542339 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-82f0acfb-7fa9-4cf9-bf2f-47159926ae3c tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:16.542863 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-82f0acfb-7fa9-4cf9-bf2f-47159926ae3c tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:16.543307 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-82f0acfb-7fa9-4cf9-bf2f-47159926ae3c tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:16.544018 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-82f0acfb-7fa9-4cf9-bf2f-47159926ae3c tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:16.544664 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-82f0acfb-7fa9-4cf9-bf2f-47159926ae3c tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:16.545269 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-82f0acfb-7fa9-4cf9-bf2f-47159926ae3c tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:16.902633 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-c6ff350b-3b53-4880-a11b-d3326de54aa0 req-ffbf6e1c-4e53-4a23-ac63-52fcf6658b0a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01f84e19-7e4a-460a-bb60-5da518f3d8b1", "tag": "c14485cd-34c9-4858-a37e-19a888659784"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:18:16.912152 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-82f0acfb-7fa9-4cf9-bf2f-47159926ae3c tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6cfeabf8d84b2893200c3c54c1c19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be71413506154420869fdff5939fb940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:18:16.921101 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-82f0acfb-7fa9-4cf9-bf2f-47159926ae3c tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] 10.222.0.43 "GET /compute/v2.1/servers/95a3ffcc-fc4e-4351-9d57-b8c065aa179c" status: 200 len: 1522 microversion: 2.1 time: 0.404100 Oct 04 22:18:16.930985 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2924/5775] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:18:16 2022] GET /compute/v2.1/servers/95a3ffcc-fc4e-4351-9d57-b8c065aa179c => generated 1522 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:18:16.933462 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-c6ff350b-3b53-4880-a11b-d3326de54aa0 req-ffbf6e1c-4e53-4a23-ac63-52fcf6658b0a service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:16.933974 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-c6ff350b-3b53-4880-a11b-d3326de54aa0 req-ffbf6e1c-4e53-4a23-ac63-52fcf6658b0a service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:16.934442 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-c6ff350b-3b53-4880-a11b-d3326de54aa0 req-ffbf6e1c-4e53-4a23-ac63-52fcf6658b0a service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:16.958216 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-c6ff350b-3b53-4880-a11b-d3326de54aa0 req-ffbf6e1c-4e53-4a23-ac63-52fcf6658b0a service nova] Creating event network-changed:c14485cd-34c9-4858-a37e-19a888659784 for instance 01f84e19-7e4a-460a-bb60-5da518f3d8b1 on n-h2-860284-1 Oct 04 22:18:16.965895 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-c6ff350b-3b53-4880-a11b-d3326de54aa0 req-ffbf6e1c-4e53-4a23-ac63-52fcf6658b0a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067313 Oct 04 22:18:16.966735 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2852/5776] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:18:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:18:17.946132 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-abc47d98-a7ae-4dd5-92e0-81704ec2608c tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:18:17.947907 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-abc47d98-a7ae-4dd5-92e0-81704ec2608c tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] [instance: 95a3ffcc-fc4e-4351-9d57-b8c065aa179c] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:18:17.968184 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-abc47d98-a7ae-4dd5-92e0-81704ec2608c tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:17.969853 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-abc47d98-a7ae-4dd5-92e0-81704ec2608c tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:17.972475 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-abc47d98-a7ae-4dd5-92e0-81704ec2608c tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:17.973420 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-abc47d98-a7ae-4dd5-92e0-81704ec2608c tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:17.974215 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-abc47d98-a7ae-4dd5-92e0-81704ec2608c tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:17.975851 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-abc47d98-a7ae-4dd5-92e0-81704ec2608c tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:18.220789 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-abc47d98-a7ae-4dd5-92e0-81704ec2608c tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6cfeabf8d84b2893200c3c54c1c19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be71413506154420869fdff5939fb940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:18:18.233513 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-abc47d98-a7ae-4dd5-92e0-81704ec2608c tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] 10.222.0.43 "GET /compute/v2.1/servers/95a3ffcc-fc4e-4351-9d57-b8c065aa179c" status: 200 len: 1522 microversion: 2.1 time: 0.289091 Oct 04 22:18:18.233513 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2925/5777] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:18:17 2022] GET /compute/v2.1/servers/95a3ffcc-fc4e-4351-9d57-b8c065aa179c => generated 1522 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:18:19.259778 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-ca9f183c-ba72-4645-acfc-5a24fbe360b4 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:18:19.260636 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-ca9f183c-ba72-4645-acfc-5a24fbe360b4 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] [instance: 95a3ffcc-fc4e-4351-9d57-b8c065aa179c] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:18:19.275583 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ca9f183c-ba72-4645-acfc-5a24fbe360b4 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:19.280670 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ca9f183c-ba72-4645-acfc-5a24fbe360b4 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:19.281429 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ca9f183c-ba72-4645-acfc-5a24fbe360b4 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:19.283551 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ca9f183c-ba72-4645-acfc-5a24fbe360b4 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:19.284550 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ca9f183c-ba72-4645-acfc-5a24fbe360b4 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:19.285239 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ca9f183c-ba72-4645-acfc-5a24fbe360b4 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:19.515231 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-ca9f183c-ba72-4645-acfc-5a24fbe360b4 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6cfeabf8d84b2893200c3c54c1c19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be71413506154420869fdff5939fb940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:18:19.526759 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-ca9f183c-ba72-4645-acfc-5a24fbe360b4 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] 10.222.0.43 "GET /compute/v2.1/servers/95a3ffcc-fc4e-4351-9d57-b8c065aa179c" status: 200 len: 1522 microversion: 2.1 time: 0.273296 Oct 04 22:18:19.534419 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2853/5778] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:18:19 2022] GET /compute/v2.1/servers/95a3ffcc-fc4e-4351-9d57-b8c065aa179c => generated 1522 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:18:20.549636 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-a710a1c9-897b-40a4-ae11-67164e3f74b3 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:18:20.550902 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-a710a1c9-897b-40a4-ae11-67164e3f74b3 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] [instance: 95a3ffcc-fc4e-4351-9d57-b8c065aa179c] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:18:20.560263 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a710a1c9-897b-40a4-ae11-67164e3f74b3 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:20.561031 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a710a1c9-897b-40a4-ae11-67164e3f74b3 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:20.561673 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a710a1c9-897b-40a4-ae11-67164e3f74b3 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:20.562616 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a710a1c9-897b-40a4-ae11-67164e3f74b3 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:20.563459 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a710a1c9-897b-40a4-ae11-67164e3f74b3 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:20.564066 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a710a1c9-897b-40a4-ae11-67164e3f74b3 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:20.813743 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-a710a1c9-897b-40a4-ae11-67164e3f74b3 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6cfeabf8d84b2893200c3c54c1c19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be71413506154420869fdff5939fb940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:18:20.826759 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-a710a1c9-897b-40a4-ae11-67164e3f74b3 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] 10.222.0.43 "GET /compute/v2.1/servers/95a3ffcc-fc4e-4351-9d57-b8c065aa179c" status: 200 len: 1522 microversion: 2.1 time: 0.277834 Oct 04 22:18:20.843442 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2926/5779] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:18:20 2022] GET /compute/v2.1/servers/95a3ffcc-fc4e-4351-9d57-b8c065aa179c => generated 1522 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:18:21.855313 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-91ae2f72-dd44-4ad1-8755-c36e515b6409 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:18:21.856365 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-91ae2f72-dd44-4ad1-8755-c36e515b6409 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] [instance: 95a3ffcc-fc4e-4351-9d57-b8c065aa179c] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:18:21.864917 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-91ae2f72-dd44-4ad1-8755-c36e515b6409 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:21.866312 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-91ae2f72-dd44-4ad1-8755-c36e515b6409 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:21.867235 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-91ae2f72-dd44-4ad1-8755-c36e515b6409 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:21.868257 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-91ae2f72-dd44-4ad1-8755-c36e515b6409 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:21.868978 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-91ae2f72-dd44-4ad1-8755-c36e515b6409 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:21.869656 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-91ae2f72-dd44-4ad1-8755-c36e515b6409 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:22.402049 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-91ae2f72-dd44-4ad1-8755-c36e515b6409 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6cfeabf8d84b2893200c3c54c1c19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be71413506154420869fdff5939fb940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:18:22.414094 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-91ae2f72-dd44-4ad1-8755-c36e515b6409 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] 10.222.0.43 "GET /compute/v2.1/servers/95a3ffcc-fc4e-4351-9d57-b8c065aa179c" status: 200 len: 1522 microversion: 2.1 time: 0.564192 Oct 04 22:18:22.419554 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2854/5780] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:18:21 2022] GET /compute/v2.1/servers/95a3ffcc-fc4e-4351-9d57-b8c065aa179c => generated 1522 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:18:22.950166 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-13c5b75d-fca0-4be5-85de-29255e7d2aeb tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:18:22.957613 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-13c5b75d-fca0-4be5-85de-29255e7d2aeb tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] [instance: c05ce571-4683-4210-af70-67c2d871f6f3] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:18:22.968330 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_api:SELECT=50 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:18:22.981869 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-13c5b75d-fca0-4be5-85de-29255e7d2aeb tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:22.983377 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-13c5b75d-fca0-4be5-85de-29255e7d2aeb tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:22.983882 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-13c5b75d-fca0-4be5-85de-29255e7d2aeb tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:22.984802 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-13c5b75d-fca0-4be5-85de-29255e7d2aeb tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:22.985436 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-13c5b75d-fca0-4be5-85de-29255e7d2aeb tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:22.986088 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-13c5b75d-fca0-4be5-85de-29255e7d2aeb tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:23.097352 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-13c5b75d-fca0-4be5-85de-29255e7d2aeb tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] 10.222.0.43 "POST /compute/v2.1/servers/c05ce571-4683-4210-af70-67c2d871f6f3/action" status: 200 len: 24574 microversion: 2.1 time: 0.152100 Oct 04 22:18:23.098039 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2927/5781] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 22:18:22 2022] POST /compute/v2.1/servers/c05ce571-4683-4210-af70-67c2d871f6f3/action => generated 24574 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 22:18:23.441522 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e14def2a-0057-48c6-8621-b67b635f99db tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:18:23.443530 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-e14def2a-0057-48c6-8621-b67b635f99db tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] [instance: 95a3ffcc-fc4e-4351-9d57-b8c065aa179c] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:18:23.451914 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e14def2a-0057-48c6-8621-b67b635f99db tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:23.452709 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e14def2a-0057-48c6-8621-b67b635f99db tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:23.453346 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e14def2a-0057-48c6-8621-b67b635f99db tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:23.454064 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e14def2a-0057-48c6-8621-b67b635f99db tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:23.454778 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e14def2a-0057-48c6-8621-b67b635f99db tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:23.455218 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e14def2a-0057-48c6-8621-b67b635f99db tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:23.724105 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-e14def2a-0057-48c6-8621-b67b635f99db tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6cfeabf8d84b2893200c3c54c1c19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be71413506154420869fdff5939fb940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:18:23.733703 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-e14def2a-0057-48c6-8621-b67b635f99db tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] 10.222.0.43 "GET /compute/v2.1/servers/95a3ffcc-fc4e-4351-9d57-b8c065aa179c" status: 200 len: 1522 microversion: 2.1 time: 0.297938 Oct 04 22:18:23.735040 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2855/5782] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:18:23 2022] GET /compute/v2.1/servers/95a3ffcc-fc4e-4351-9d57-b8c065aa179c => generated 1522 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:18:24.759064 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-8051e549-1a51-455e-8f03-0b44565ba40c tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:18:24.760421 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-8051e549-1a51-455e-8f03-0b44565ba40c tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] [instance: 95a3ffcc-fc4e-4351-9d57-b8c065aa179c] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:18:24.768540 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8051e549-1a51-455e-8f03-0b44565ba40c tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:24.769038 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8051e549-1a51-455e-8f03-0b44565ba40c tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:24.769486 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8051e549-1a51-455e-8f03-0b44565ba40c tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:24.770207 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8051e549-1a51-455e-8f03-0b44565ba40c tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:24.770708 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8051e549-1a51-455e-8f03-0b44565ba40c tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:24.771145 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8051e549-1a51-455e-8f03-0b44565ba40c tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:25.274709 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-8051e549-1a51-455e-8f03-0b44565ba40c tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6cfeabf8d84b2893200c3c54c1c19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be71413506154420869fdff5939fb940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:18:25.287160 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-8051e549-1a51-455e-8f03-0b44565ba40c tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] 10.222.0.43 "GET /compute/v2.1/servers/95a3ffcc-fc4e-4351-9d57-b8c065aa179c" status: 200 len: 1522 microversion: 2.1 time: 0.532746 Oct 04 22:18:25.289867 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2928/5783] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:18:24 2022] GET /compute/v2.1/servers/95a3ffcc-fc4e-4351-9d57-b8c065aa179c => generated 1522 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:18:26.312844 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e68d0d91-0377-4da6-9b1e-7b174ea748cc tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:18:26.313604 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-e68d0d91-0377-4da6-9b1e-7b174ea748cc tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] [instance: 95a3ffcc-fc4e-4351-9d57-b8c065aa179c] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:18:26.320959 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e68d0d91-0377-4da6-9b1e-7b174ea748cc tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:26.321607 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e68d0d91-0377-4da6-9b1e-7b174ea748cc tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:26.322224 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e68d0d91-0377-4da6-9b1e-7b174ea748cc tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:26.323044 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e68d0d91-0377-4da6-9b1e-7b174ea748cc tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:26.323666 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e68d0d91-0377-4da6-9b1e-7b174ea748cc tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:26.324201 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e68d0d91-0377-4da6-9b1e-7b174ea748cc tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:26.538687 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-e68d0d91-0377-4da6-9b1e-7b174ea748cc tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6cfeabf8d84b2893200c3c54c1c19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be71413506154420869fdff5939fb940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:18:26.549209 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-e68d0d91-0377-4da6-9b1e-7b174ea748cc tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] 10.222.0.43 "GET /compute/v2.1/servers/95a3ffcc-fc4e-4351-9d57-b8c065aa179c" status: 200 len: 1522 microversion: 2.1 time: 0.240537 Oct 04 22:18:26.550135 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2856/5784] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:18:26 2022] GET /compute/v2.1/servers/95a3ffcc-fc4e-4351-9d57-b8c065aa179c => generated 1522 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:18:27.574526 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-0a85d800-a738-428b-9ec2-a837ad9ed585 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:18:27.575882 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-0a85d800-a738-428b-9ec2-a837ad9ed585 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] [instance: 95a3ffcc-fc4e-4351-9d57-b8c065aa179c] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:18:27.588603 n-d-860284-1 devstack@n-api.service[134102]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 22:18:27.589218 n-d-860284-1 devstack@n-api.service[134102]: Tue Oct 4 22:18:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/95a3ffcc-fc4e-4351-9d57-b8c065aa179c (ip 10.222.0.43) !!! Oct 04 22:18:27.594237 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0a85d800-a738-428b-9ec2-a837ad9ed585 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:27.595067 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0a85d800-a738-428b-9ec2-a837ad9ed585 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:27.595823 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0a85d800-a738-428b-9ec2-a837ad9ed585 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:27.596712 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0a85d800-a738-428b-9ec2-a837ad9ed585 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:27.597221 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0a85d800-a738-428b-9ec2-a837ad9ed585 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:27.597733 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0a85d800-a738-428b-9ec2-a837ad9ed585 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:27.824565 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-0a85d800-a738-428b-9ec2-a837ad9ed585 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6cfeabf8d84b2893200c3c54c1c19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be71413506154420869fdff5939fb940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:18:27.835993 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-0a85d800-a738-428b-9ec2-a837ad9ed585 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] 10.222.0.43 "GET /compute/v2.1/servers/95a3ffcc-fc4e-4351-9d57-b8c065aa179c" status: 200 len: 1522 microversion: 2.1 time: 0.264813 Oct 04 22:18:27.853766 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2929/5785] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:18:27 2022] GET /compute/v2.1/servers/95a3ffcc-fc4e-4351-9d57-b8c065aa179c => generated 1522 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:18:28.860164 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-03fdcb6a-cf34-46ef-9dd8-4150619e7b4d tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:18:28.862392 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-03fdcb6a-cf34-46ef-9dd8-4150619e7b4d tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] [instance: 95a3ffcc-fc4e-4351-9d57-b8c065aa179c] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:18:28.871493 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-03fdcb6a-cf34-46ef-9dd8-4150619e7b4d tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:28.872369 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-03fdcb6a-cf34-46ef-9dd8-4150619e7b4d tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:28.873023 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-03fdcb6a-cf34-46ef-9dd8-4150619e7b4d tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:28.873935 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-03fdcb6a-cf34-46ef-9dd8-4150619e7b4d tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:28.874864 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-03fdcb6a-cf34-46ef-9dd8-4150619e7b4d tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:28.875582 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-03fdcb6a-cf34-46ef-9dd8-4150619e7b4d tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:29.099427 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-03fdcb6a-cf34-46ef-9dd8-4150619e7b4d tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6cfeabf8d84b2893200c3c54c1c19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be71413506154420869fdff5939fb940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:18:29.108481 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-03fdcb6a-cf34-46ef-9dd8-4150619e7b4d tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] 10.222.0.43 "GET /compute/v2.1/servers/95a3ffcc-fc4e-4351-9d57-b8c065aa179c" status: 200 len: 1522 microversion: 2.1 time: 0.252299 Oct 04 22:18:29.109678 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2857/5786] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:18:28 2022] GET /compute/v2.1/servers/95a3ffcc-fc4e-4351-9d57-b8c065aa179c => generated 1522 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:18:30.136489 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-2c65947b-d0a7-4be2-bfbe-b77eb5797c11 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:18:30.138014 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-2c65947b-d0a7-4be2-bfbe-b77eb5797c11 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] [instance: 95a3ffcc-fc4e-4351-9d57-b8c065aa179c] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:18:30.147913 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2c65947b-d0a7-4be2-bfbe-b77eb5797c11 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:30.149487 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2c65947b-d0a7-4be2-bfbe-b77eb5797c11 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:30.150298 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2c65947b-d0a7-4be2-bfbe-b77eb5797c11 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:30.151064 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2c65947b-d0a7-4be2-bfbe-b77eb5797c11 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:30.155059 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2c65947b-d0a7-4be2-bfbe-b77eb5797c11 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:30.156248 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2c65947b-d0a7-4be2-bfbe-b77eb5797c11 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:30.352980 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-2c65947b-d0a7-4be2-bfbe-b77eb5797c11 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6cfeabf8d84b2893200c3c54c1c19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be71413506154420869fdff5939fb940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:18:30.363474 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-2c65947b-d0a7-4be2-bfbe-b77eb5797c11 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] 10.222.0.43 "GET /compute/v2.1/servers/95a3ffcc-fc4e-4351-9d57-b8c065aa179c" status: 200 len: 1522 microversion: 2.1 time: 0.229861 Oct 04 22:18:30.383567 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2930/5787] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:18:30 2022] GET /compute/v2.1/servers/95a3ffcc-fc4e-4351-9d57-b8c065aa179c => generated 1522 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:18:31.393919 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-f9a69ce8-8ea3-4c33-b5e9-d782dcfd4363 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:18:31.394748 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-f9a69ce8-8ea3-4c33-b5e9-d782dcfd4363 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] [instance: 95a3ffcc-fc4e-4351-9d57-b8c065aa179c] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:18:31.404762 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f9a69ce8-8ea3-4c33-b5e9-d782dcfd4363 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:31.405270 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f9a69ce8-8ea3-4c33-b5e9-d782dcfd4363 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:31.406143 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f9a69ce8-8ea3-4c33-b5e9-d782dcfd4363 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:31.407247 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f9a69ce8-8ea3-4c33-b5e9-d782dcfd4363 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:31.421169 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f9a69ce8-8ea3-4c33-b5e9-d782dcfd4363 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:31.423631 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f9a69ce8-8ea3-4c33-b5e9-d782dcfd4363 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:31.604064 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-f9a69ce8-8ea3-4c33-b5e9-d782dcfd4363 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6cfeabf8d84b2893200c3c54c1c19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be71413506154420869fdff5939fb940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:18:31.619763 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-f9a69ce8-8ea3-4c33-b5e9-d782dcfd4363 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] 10.222.0.43 "GET /compute/v2.1/servers/95a3ffcc-fc4e-4351-9d57-b8c065aa179c" status: 200 len: 1522 microversion: 2.1 time: 0.232061 Oct 04 22:18:31.621126 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2858/5788] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:18:31 2022] GET /compute/v2.1/servers/95a3ffcc-fc4e-4351-9d57-b8c065aa179c => generated 1522 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:18:32.649093 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-764f34f9-6132-46a7-9b19-0268b2d2281a tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:18:32.649754 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-764f34f9-6132-46a7-9b19-0268b2d2281a tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] [instance: 95a3ffcc-fc4e-4351-9d57-b8c065aa179c] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:18:32.657469 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-764f34f9-6132-46a7-9b19-0268b2d2281a tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:32.657966 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-764f34f9-6132-46a7-9b19-0268b2d2281a tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:32.658423 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-764f34f9-6132-46a7-9b19-0268b2d2281a tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:32.659390 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-764f34f9-6132-46a7-9b19-0268b2d2281a tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:32.659865 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-764f34f9-6132-46a7-9b19-0268b2d2281a tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:32.660292 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-764f34f9-6132-46a7-9b19-0268b2d2281a tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:32.851067 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-764f34f9-6132-46a7-9b19-0268b2d2281a tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6cfeabf8d84b2893200c3c54c1c19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be71413506154420869fdff5939fb940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:18:32.859701 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-764f34f9-6132-46a7-9b19-0268b2d2281a tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] 10.222.0.43 "GET /compute/v2.1/servers/95a3ffcc-fc4e-4351-9d57-b8c065aa179c" status: 200 len: 1522 microversion: 2.1 time: 0.216581 Oct 04 22:18:32.870396 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2931/5789] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:18:32 2022] GET /compute/v2.1/servers/95a3ffcc-fc4e-4351-9d57-b8c065aa179c => generated 1522 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:18:33.886028 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-10f2cbf6-817a-41cd-97ae-ac8f2f1459ce tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:18:33.886636 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-10f2cbf6-817a-41cd-97ae-ac8f2f1459ce tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] [instance: 95a3ffcc-fc4e-4351-9d57-b8c065aa179c] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:18:33.899105 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-10f2cbf6-817a-41cd-97ae-ac8f2f1459ce tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:33.900051 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-10f2cbf6-817a-41cd-97ae-ac8f2f1459ce tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:33.901429 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-10f2cbf6-817a-41cd-97ae-ac8f2f1459ce tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:33.902604 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-10f2cbf6-817a-41cd-97ae-ac8f2f1459ce tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:33.904535 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-10f2cbf6-817a-41cd-97ae-ac8f2f1459ce tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:33.906322 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-10f2cbf6-817a-41cd-97ae-ac8f2f1459ce tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:34.118686 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-10f2cbf6-817a-41cd-97ae-ac8f2f1459ce tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6cfeabf8d84b2893200c3c54c1c19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be71413506154420869fdff5939fb940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:18:34.130624 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-10f2cbf6-817a-41cd-97ae-ac8f2f1459ce tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] 10.222.0.43 "GET /compute/v2.1/servers/95a3ffcc-fc4e-4351-9d57-b8c065aa179c" status: 200 len: 1522 microversion: 2.1 time: 0.248317 Oct 04 22:18:34.134556 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2859/5790] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:18:33 2022] GET /compute/v2.1/servers/95a3ffcc-fc4e-4351-9d57-b8c065aa179c => generated 1522 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:18:35.154343 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-d0cf1377-4c1f-4d39-965a-ea8bc09de90f tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:18:35.155780 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-d0cf1377-4c1f-4d39-965a-ea8bc09de90f tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] [instance: 95a3ffcc-fc4e-4351-9d57-b8c065aa179c] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:18:35.165261 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d0cf1377-4c1f-4d39-965a-ea8bc09de90f tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:35.166024 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d0cf1377-4c1f-4d39-965a-ea8bc09de90f tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:35.166666 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d0cf1377-4c1f-4d39-965a-ea8bc09de90f tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:35.167626 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d0cf1377-4c1f-4d39-965a-ea8bc09de90f tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:35.168430 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d0cf1377-4c1f-4d39-965a-ea8bc09de90f tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:35.170174 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d0cf1377-4c1f-4d39-965a-ea8bc09de90f tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:35.366571 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-d0cf1377-4c1f-4d39-965a-ea8bc09de90f tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6cfeabf8d84b2893200c3c54c1c19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be71413506154420869fdff5939fb940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:18:35.377661 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-d0cf1377-4c1f-4d39-965a-ea8bc09de90f tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] 10.222.0.43 "GET /compute/v2.1/servers/95a3ffcc-fc4e-4351-9d57-b8c065aa179c" status: 200 len: 1522 microversion: 2.1 time: 0.226416 Oct 04 22:18:35.381738 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2932/5791] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:18:35 2022] GET /compute/v2.1/servers/95a3ffcc-fc4e-4351-9d57-b8c065aa179c => generated 1522 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:18:36.409310 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-d15a257e-013a-4232-8e4b-8c47469bef5c tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:18:36.410733 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-d15a257e-013a-4232-8e4b-8c47469bef5c tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] [instance: 95a3ffcc-fc4e-4351-9d57-b8c065aa179c] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:18:36.421277 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d15a257e-013a-4232-8e4b-8c47469bef5c tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:36.422012 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d15a257e-013a-4232-8e4b-8c47469bef5c tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:36.422494 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d15a257e-013a-4232-8e4b-8c47469bef5c tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:36.423426 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d15a257e-013a-4232-8e4b-8c47469bef5c tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:36.423897 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d15a257e-013a-4232-8e4b-8c47469bef5c tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:36.424337 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d15a257e-013a-4232-8e4b-8c47469bef5c tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:36.639090 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-d15a257e-013a-4232-8e4b-8c47469bef5c tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6cfeabf8d84b2893200c3c54c1c19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be71413506154420869fdff5939fb940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:18:36.650228 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-d15a257e-013a-4232-8e4b-8c47469bef5c tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] 10.222.0.43 "GET /compute/v2.1/servers/95a3ffcc-fc4e-4351-9d57-b8c065aa179c" status: 200 len: 1522 microversion: 2.1 time: 0.244461 Oct 04 22:18:36.651895 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2860/5792] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:18:36 2022] GET /compute/v2.1/servers/95a3ffcc-fc4e-4351-9d57-b8c065aa179c => generated 1522 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:18:37.673257 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-d04dcda6-841e-4eda-91cc-cc01f664b4fe tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:18:37.673979 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-d04dcda6-841e-4eda-91cc-cc01f664b4fe tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] [instance: 95a3ffcc-fc4e-4351-9d57-b8c065aa179c] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:18:37.684190 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d04dcda6-841e-4eda-91cc-cc01f664b4fe tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:37.684951 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d04dcda6-841e-4eda-91cc-cc01f664b4fe tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:37.685495 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d04dcda6-841e-4eda-91cc-cc01f664b4fe tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:37.686355 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d04dcda6-841e-4eda-91cc-cc01f664b4fe tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:37.687072 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d04dcda6-841e-4eda-91cc-cc01f664b4fe tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:37.687564 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d04dcda6-841e-4eda-91cc-cc01f664b4fe tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:37.867639 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-d04dcda6-841e-4eda-91cc-cc01f664b4fe tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6cfeabf8d84b2893200c3c54c1c19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be71413506154420869fdff5939fb940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:18:37.878673 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-d04dcda6-841e-4eda-91cc-cc01f664b4fe tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] 10.222.0.43 "GET /compute/v2.1/servers/95a3ffcc-fc4e-4351-9d57-b8c065aa179c" status: 200 len: 1522 microversion: 2.1 time: 0.208073 Oct 04 22:18:37.878958 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2933/5793] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:18:37 2022] GET /compute/v2.1/servers/95a3ffcc-fc4e-4351-9d57-b8c065aa179c => generated 1522 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:18:38.907049 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-d6efdd65-8f5a-4b0c-bae5-8c3c4a48db72 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:18:38.909118 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-d6efdd65-8f5a-4b0c-bae5-8c3c4a48db72 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] [instance: 95a3ffcc-fc4e-4351-9d57-b8c065aa179c] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:18:38.926706 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d6efdd65-8f5a-4b0c-bae5-8c3c4a48db72 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:38.927229 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d6efdd65-8f5a-4b0c-bae5-8c3c4a48db72 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:38.928369 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d6efdd65-8f5a-4b0c-bae5-8c3c4a48db72 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:38.932028 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d6efdd65-8f5a-4b0c-bae5-8c3c4a48db72 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:38.932574 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d6efdd65-8f5a-4b0c-bae5-8c3c4a48db72 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:38.933030 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d6efdd65-8f5a-4b0c-bae5-8c3c4a48db72 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:39.205580 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-d6efdd65-8f5a-4b0c-bae5-8c3c4a48db72 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6cfeabf8d84b2893200c3c54c1c19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be71413506154420869fdff5939fb940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:18:39.217295 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-d6efdd65-8f5a-4b0c-bae5-8c3c4a48db72 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] 10.222.0.43 "GET /compute/v2.1/servers/95a3ffcc-fc4e-4351-9d57-b8c065aa179c" status: 200 len: 1522 microversion: 2.1 time: 0.314793 Oct 04 22:18:39.219232 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2861/5794] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:18:38 2022] GET /compute/v2.1/servers/95a3ffcc-fc4e-4351-9d57-b8c065aa179c => generated 1522 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:18:40.254763 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-bf2c5c52-1f93-4e83-99e0-a855d74e0330 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:18:40.256215 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-bf2c5c52-1f93-4e83-99e0-a855d74e0330 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] [instance: 95a3ffcc-fc4e-4351-9d57-b8c065aa179c] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:18:40.277820 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bf2c5c52-1f93-4e83-99e0-a855d74e0330 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:40.283831 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bf2c5c52-1f93-4e83-99e0-a855d74e0330 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:40.284606 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bf2c5c52-1f93-4e83-99e0-a855d74e0330 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:40.286510 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bf2c5c52-1f93-4e83-99e0-a855d74e0330 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:40.289029 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bf2c5c52-1f93-4e83-99e0-a855d74e0330 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:40.289656 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bf2c5c52-1f93-4e83-99e0-a855d74e0330 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:40.570838 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-bf2c5c52-1f93-4e83-99e0-a855d74e0330 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6cfeabf8d84b2893200c3c54c1c19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be71413506154420869fdff5939fb940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:18:40.586716 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-bf2c5c52-1f93-4e83-99e0-a855d74e0330 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] 10.222.0.43 "GET /compute/v2.1/servers/95a3ffcc-fc4e-4351-9d57-b8c065aa179c" status: 200 len: 1522 microversion: 2.1 time: 0.344749 Oct 04 22:18:40.600697 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2934/5795] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:18:40 2022] GET /compute/v2.1/servers/95a3ffcc-fc4e-4351-9d57-b8c065aa179c => generated 1522 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:18:41.613516 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-493bbc4d-0ead-4909-b7ea-0af45f513733 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:18:41.616505 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-493bbc4d-0ead-4909-b7ea-0af45f513733 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] [instance: 95a3ffcc-fc4e-4351-9d57-b8c065aa179c] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:18:41.628799 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=30 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:18:41.636750 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-493bbc4d-0ead-4909-b7ea-0af45f513733 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:41.638596 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-493bbc4d-0ead-4909-b7ea-0af45f513733 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:41.641688 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-493bbc4d-0ead-4909-b7ea-0af45f513733 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:41.645248 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-493bbc4d-0ead-4909-b7ea-0af45f513733 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:41.646064 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-493bbc4d-0ead-4909-b7ea-0af45f513733 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:41.647589 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-493bbc4d-0ead-4909-b7ea-0af45f513733 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:41.696892 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:18:41.892571 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-493bbc4d-0ead-4909-b7ea-0af45f513733 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6cfeabf8d84b2893200c3c54c1c19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be71413506154420869fdff5939fb940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:18:41.902147 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-493bbc4d-0ead-4909-b7ea-0af45f513733 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] 10.222.0.43 "GET /compute/v2.1/servers/95a3ffcc-fc4e-4351-9d57-b8c065aa179c" status: 200 len: 1522 microversion: 2.1 time: 0.293943 Oct 04 22:18:41.914394 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2862/5796] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:18:41 2022] GET /compute/v2.1/servers/95a3ffcc-fc4e-4351-9d57-b8c065aa179c => generated 1522 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:18:42.931998 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-a44eebd5-0d84-414d-b08c-5801459b95d0 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:18:42.932581 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-a44eebd5-0d84-414d-b08c-5801459b95d0 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] [instance: 95a3ffcc-fc4e-4351-9d57-b8c065aa179c] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:18:42.951472 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a44eebd5-0d84-414d-b08c-5801459b95d0 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:42.952238 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a44eebd5-0d84-414d-b08c-5801459b95d0 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:42.952881 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a44eebd5-0d84-414d-b08c-5801459b95d0 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:42.953775 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a44eebd5-0d84-414d-b08c-5801459b95d0 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:42.954430 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a44eebd5-0d84-414d-b08c-5801459b95d0 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:42.955035 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a44eebd5-0d84-414d-b08c-5801459b95d0 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:42.959557 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=78 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:18:43.121700 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-a44eebd5-0d84-414d-b08c-5801459b95d0 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6cfeabf8d84b2893200c3c54c1c19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be71413506154420869fdff5939fb940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:18:43.138720 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-a44eebd5-0d84-414d-b08c-5801459b95d0 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] 10.222.0.43 "GET /compute/v2.1/servers/95a3ffcc-fc4e-4351-9d57-b8c065aa179c" status: 200 len: 1522 microversion: 2.1 time: 0.214475 Oct 04 22:18:43.139337 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2935/5797] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:18:42 2022] GET /compute/v2.1/servers/95a3ffcc-fc4e-4351-9d57-b8c065aa179c => generated 1522 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:18:44.162398 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-7fd7c93b-f837-4eb4-bc76-58beb8bca78e tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:18:44.163021 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-7fd7c93b-f837-4eb4-bc76-58beb8bca78e tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] [instance: 95a3ffcc-fc4e-4351-9d57-b8c065aa179c] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:18:44.170296 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7fd7c93b-f837-4eb4-bc76-58beb8bca78e tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:44.170931 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7fd7c93b-f837-4eb4-bc76-58beb8bca78e tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:44.171406 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7fd7c93b-f837-4eb4-bc76-58beb8bca78e tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:44.172129 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7fd7c93b-f837-4eb4-bc76-58beb8bca78e tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:44.172588 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7fd7c93b-f837-4eb4-bc76-58beb8bca78e tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:44.173020 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7fd7c93b-f837-4eb4-bc76-58beb8bca78e tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:44.327576 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-7fd7c93b-f837-4eb4-bc76-58beb8bca78e tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6cfeabf8d84b2893200c3c54c1c19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be71413506154420869fdff5939fb940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:18:44.336376 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-7fd7c93b-f837-4eb4-bc76-58beb8bca78e tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] 10.222.0.43 "GET /compute/v2.1/servers/95a3ffcc-fc4e-4351-9d57-b8c065aa179c" status: 200 len: 1502 microversion: 2.1 time: 0.178537 Oct 04 22:18:44.337070 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2863/5798] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:18:44 2022] GET /compute/v2.1/servers/95a3ffcc-fc4e-4351-9d57-b8c065aa179c => generated 1502 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:18:44.359086 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-cfdc7c6a-aea9-4f3e-87e1-049ffcb74116 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:18:44.359847 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-cfdc7c6a-aea9-4f3e-87e1-049ffcb74116 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] [instance: 39984acf-f630-4ba0-b4e5-384ef8c3d9fc] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:18:44.367449 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cfdc7c6a-aea9-4f3e-87e1-049ffcb74116 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:44.368022 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cfdc7c6a-aea9-4f3e-87e1-049ffcb74116 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:44.368544 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cfdc7c6a-aea9-4f3e-87e1-049ffcb74116 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:44.369355 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cfdc7c6a-aea9-4f3e-87e1-049ffcb74116 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:44.369906 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cfdc7c6a-aea9-4f3e-87e1-049ffcb74116 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:44.370448 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cfdc7c6a-aea9-4f3e-87e1-049ffcb74116 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:44.697643 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-cfdc7c6a-aea9-4f3e-87e1-049ffcb74116 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6cfeabf8d84b2893200c3c54c1c19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be71413506154420869fdff5939fb940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:18:44.705712 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-cfdc7c6a-aea9-4f3e-87e1-049ffcb74116 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] 10.222.0.43 "GET /compute/v2.1/servers/39984acf-f630-4ba0-b4e5-384ef8c3d9fc" status: 200 len: 1517 microversion: 2.1 time: 0.350506 Oct 04 22:18:44.706303 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2936/5799] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:18:44 2022] GET /compute/v2.1/servers/39984acf-f630-4ba0-b4e5-384ef8c3d9fc => generated 1517 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:18:44.729068 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-1573228a-8c11-44b0-9357-d53cc7c9c226 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:18:44.731802 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-1573228a-8c11-44b0-9357-d53cc7c9c226 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] [instance: 4e597d23-b6ed-4efb-b70e-73881686c53a] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:18:44.737472 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-1573228a-8c11-44b0-9357-d53cc7c9c226 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] HTTP exception thrown: Instance 4e597d23-b6ed-4efb-b70e-73881686c53a could not be found. Oct 04 22:18:44.741655 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-1573228a-8c11-44b0-9357-d53cc7c9c226 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Request method failure captured: Oct 04 22:18:44.741655 n-d-860284-1 devstack@n-api.service[134101]: request: POST /compute/v2.1/servers/4e597d23-b6ed-4efb-b70e-73881686c53a/action HTTP/1.1 Oct 04 22:18:44.741655 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 22:18:44.741655 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 22:18:44.741655 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 22:18:44.741655 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 14 Oct 04 22:18:44.741655 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 22:18:44.741655 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 22:18:44.741655 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 22:18:44.741655 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 22:18:44.741655 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPLEDiePHKmNYQ70bvTRH9P6iiaqhUoAB8_ZBMNVcHJpqPxkBgo3U3nk5n38-Pj3vdk8AJHCO9JALC7jh3PuAbKmfUvXx7h6K9sXqnrzemrKzzJUfKCyLDC31QQuFp0uS2eKZE1D_dbjuEfh4aQXcfm19u6d5SXGgRB-GYLIygAnJeb8 Oct 04 22:18:44.741655 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 22:18:44.741655 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 22:18:44.741655 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 22:18:44.741655 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 22:18:44.741655 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 22:18:44.741655 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 22:18:44.741655 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: be71413506154420869fdff5939fb940 Oct 04 22:18:44.741655 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1499910012 Oct 04 22:18:44.741655 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 22:18:44.741655 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 22:18:44.741655 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/be71413506154420869fdff5939fb940"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_be71413506154420869fdff5939fb940", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/be71413506154420869fdff5939fb940"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/be71413506154420869fdff5939fb940"}]}] Oct 04 22:18:44.741655 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1499910012 Oct 04 22:18:44.741655 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: be71413506154420869fdff5939fb940 Oct 04 22:18:44.741655 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1499910012 Oct 04 22:18:44.741655 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-ServerRescueNegativeTestJSON-1499910012-project Oct 04 22:18:44.741655 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 22:18:44.741655 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 22:18:44.741655 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: ca6cfeabf8d84b2893200c3c54c1c19f Oct 04 22:18:44.741655 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1499910012-project Oct 04 22:18:44.741655 n-d-860284-1 devstack@n-api.service[134101]: Oct 04 22:18:44.741655 n-d-860284-1 devstack@n-api.service[134101]: {"rescue": {}} Oct 04 22:18:44.741655 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 22:18:44.741655 n-d-860284-1 devstack@n-api.service[134101]: exception: Instance 4e597d23-b6ed-4efb-b70e-73881686c53a could not be found. Oct 04 22:18:44.741655 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': '4e597d23-b6ed-4efb-b70e-73881686c53a', 'body': {'rescue': {}}} Oct 04 22:18:44.741655 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:18:44.741655 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:18:44.741655 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:18:44.741655 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:18:44.741655 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:18:44.741655 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:18:44.741655 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 22:18:44.741655 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 22:18:44.741655 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e597d23-b6ed-4efb-b70e-73881686c53a could not be found. Oct 04 22:18:44.741655 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:18:44.741655 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:18:44.741655 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:18:44.741655 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:18:44.741655 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:18:44.741655 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:18:44.741655 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:18:44.741655 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:18:44.741655 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:18:44.741655 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:18:44.741655 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 22:18:44.741655 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 22:18:44.741655 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 53, in _rescue Oct 04 22:18:44.741655 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 04 22:18:44.741655 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:18:44.741655 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:18:44.741655 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e597d23-b6ed-4efb-b70e-73881686c53a could not be found. Oct 04 22:18:44.741655 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:18:44.741655 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:18:44.741655 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:18:44.741655 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:18:44.746970 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:18:44.746970 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:18:44.746970 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:18:44.746970 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:18:44.746970 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e597d23-b6ed-4efb-b70e-73881686c53a could not be found. Oct 04 22:18:44.746970 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:18:44.746970 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-1573228a-8c11-44b0-9357-d53cc7c9c226 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Returning 404 to user: Instance 4e597d23-b6ed-4efb-b70e-73881686c53a could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:18:44.746970 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-1573228a-8c11-44b0-9357-d53cc7c9c226 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] 10.222.0.43 "POST /compute/v2.1/servers/4e597d23-b6ed-4efb-b70e-73881686c53a/action" status: 404 len: 111 microversion: 2.1 time: 0.018693 Oct 04 22:18:44.746970 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2864/5800] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 22:18:44 2022] POST /compute/v2.1/servers/4e597d23-b6ed-4efb-b70e-73881686c53a/action => generated 111 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 22:18:44.753990 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-e8516bdb-ff03-41d8-8260-b21358750e92 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:18:44.754568 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-e8516bdb-ff03-41d8-8260-b21358750e92 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] [instance: 39984acf-f630-4ba0-b4e5-384ef8c3d9fc] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:18:44.760963 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e8516bdb-ff03-41d8-8260-b21358750e92 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:44.761653 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e8516bdb-ff03-41d8-8260-b21358750e92 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:44.762252 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e8516bdb-ff03-41d8-8260-b21358750e92 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:44.763010 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e8516bdb-ff03-41d8-8260-b21358750e92 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:44.763494 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e8516bdb-ff03-41d8-8260-b21358750e92 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:44.763931 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e8516bdb-ff03-41d8-8260-b21358750e92 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:44.833118 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-e8516bdb-ff03-41d8-8260-b21358750e92 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] 10.222.0.43 "POST /compute/v2.1/servers/39984acf-f630-4ba0-b4e5-384ef8c3d9fc/action" status: 202 len: 0 microversion: 2.1 time: 0.083346 Oct 04 22:18:44.834289 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2937/5801] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 22:18:44 2022] POST /compute/v2.1/servers/39984acf-f630-4ba0-b4e5-384ef8c3d9fc/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 22:18:44.842891 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-df6f70b6-f05f-4aa8-a9f9-afd3840834f9 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:18:44.843647 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-df6f70b6-f05f-4aa8-a9f9-afd3840834f9 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] [instance: 39984acf-f630-4ba0-b4e5-384ef8c3d9fc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:18:44.852069 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-df6f70b6-f05f-4aa8-a9f9-afd3840834f9 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:44.852672 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-df6f70b6-f05f-4aa8-a9f9-afd3840834f9 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:44.853182 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-df6f70b6-f05f-4aa8-a9f9-afd3840834f9 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:44.853962 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-df6f70b6-f05f-4aa8-a9f9-afd3840834f9 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:44.854615 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-df6f70b6-f05f-4aa8-a9f9-afd3840834f9 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:44.855006 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-df6f70b6-f05f-4aa8-a9f9-afd3840834f9 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:45.095146 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-df6f70b6-f05f-4aa8-a9f9-afd3840834f9 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6cfeabf8d84b2893200c3c54c1c19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be71413506154420869fdff5939fb940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:18:45.106867 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-df6f70b6-f05f-4aa8-a9f9-afd3840834f9 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] 10.222.0.43 "GET /compute/v2.1/servers/39984acf-f630-4ba0-b4e5-384ef8c3d9fc" status: 200 len: 1522 microversion: 2.1 time: 0.267955 Oct 04 22:18:45.108281 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2865/5802] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:18:44 2022] GET /compute/v2.1/servers/39984acf-f630-4ba0-b4e5-384ef8c3d9fc => generated 1522 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:18:46.137975 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-788d65ab-96e3-4b3b-b7cd-7ee958f284e0 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:18:46.138842 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-788d65ab-96e3-4b3b-b7cd-7ee958f284e0 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] [instance: 39984acf-f630-4ba0-b4e5-384ef8c3d9fc] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:18:46.153347 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-788d65ab-96e3-4b3b-b7cd-7ee958f284e0 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:46.154791 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-788d65ab-96e3-4b3b-b7cd-7ee958f284e0 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:46.156875 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-788d65ab-96e3-4b3b-b7cd-7ee958f284e0 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:46.157866 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-788d65ab-96e3-4b3b-b7cd-7ee958f284e0 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:46.159132 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-788d65ab-96e3-4b3b-b7cd-7ee958f284e0 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:46.159776 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-788d65ab-96e3-4b3b-b7cd-7ee958f284e0 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:46.336169 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-788d65ab-96e3-4b3b-b7cd-7ee958f284e0 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6cfeabf8d84b2893200c3c54c1c19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be71413506154420869fdff5939fb940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:18:46.346071 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-788d65ab-96e3-4b3b-b7cd-7ee958f284e0 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] 10.222.0.43 "GET /compute/v2.1/servers/39984acf-f630-4ba0-b4e5-384ef8c3d9fc" status: 200 len: 1502 microversion: 2.1 time: 0.213331 Oct 04 22:18:46.362400 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2938/5803] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:18:46 2022] GET /compute/v2.1/servers/39984acf-f630-4ba0-b4e5-384ef8c3d9fc => generated 1502 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:18:46.370590 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-8e3b2cc4-8b13-4c00-8fc0-f8e1be7ea227 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:18:46.374161 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-8e3b2cc4-8b13-4c00-8fc0-f8e1be7ea227 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] [instance: 39984acf-f630-4ba0-b4e5-384ef8c3d9fc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:18:46.382681 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8e3b2cc4-8b13-4c00-8fc0-f8e1be7ea227 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:46.384356 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8e3b2cc4-8b13-4c00-8fc0-f8e1be7ea227 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:46.385003 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8e3b2cc4-8b13-4c00-8fc0-f8e1be7ea227 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:46.385919 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8e3b2cc4-8b13-4c00-8fc0-f8e1be7ea227 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:46.386587 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8e3b2cc4-8b13-4c00-8fc0-f8e1be7ea227 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:46.387197 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8e3b2cc4-8b13-4c00-8fc0-f8e1be7ea227 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:46.415683 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.objects.instance [None req-8e3b2cc4-8b13-4c00-8fc0-f8e1be7ea227 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lazy-loading 'flavor' on Instance uuid 39984acf-f630-4ba0-b4e5-384ef8c3d9fc {{(pid=134101) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 22:18:46.447352 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-8e3b2cc4-8b13-4c00-8fc0-f8e1be7ea227 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] HTTP exception thrown: Cannot 'rescue' instance 39984acf-f630-4ba0-b4e5-384ef8c3d9fc while it is in vm_state paused Oct 04 22:18:46.450418 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-8e3b2cc4-8b13-4c00-8fc0-f8e1be7ea227 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Request method failure captured: Oct 04 22:18:46.450418 n-d-860284-1 devstack@n-api.service[134101]: request: POST /compute/v2.1/servers/39984acf-f630-4ba0-b4e5-384ef8c3d9fc/action HTTP/1.1 Oct 04 22:18:46.450418 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 22:18:46.450418 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 22:18:46.450418 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 22:18:46.450418 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 14 Oct 04 22:18:46.450418 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 22:18:46.450418 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 22:18:46.450418 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 22:18:46.450418 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 22:18:46.450418 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPLEDiePHKmNYQ70bvTRH9P6iiaqhUoAB8_ZBMNVcHJpqPxkBgo3U3nk5n38-Pj3vdk8AJHCO9JALC7jh3PuAbKmfUvXx7h6K9sXqnrzemrKzzJUfKCyLDC31QQuFp0uS2eKZE1D_dbjuEfh4aQXcfm19u6d5SXGgRB-GYLIygAnJeb8 Oct 04 22:18:46.450418 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 22:18:46.450418 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 22:18:46.450418 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 22:18:46.450418 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 22:18:46.450418 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 22:18:46.450418 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 22:18:46.450418 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: be71413506154420869fdff5939fb940 Oct 04 22:18:46.450418 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1499910012 Oct 04 22:18:46.450418 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 22:18:46.450418 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 22:18:46.450418 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/be71413506154420869fdff5939fb940"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_be71413506154420869fdff5939fb940", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/be71413506154420869fdff5939fb940"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/be71413506154420869fdff5939fb940"}]}] Oct 04 22:18:46.450418 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1499910012 Oct 04 22:18:46.450418 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: be71413506154420869fdff5939fb940 Oct 04 22:18:46.450418 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1499910012 Oct 04 22:18:46.450418 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-ServerRescueNegativeTestJSON-1499910012-project Oct 04 22:18:46.450418 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 22:18:46.450418 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 22:18:46.450418 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: ca6cfeabf8d84b2893200c3c54c1c19f Oct 04 22:18:46.450418 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1499910012-project Oct 04 22:18:46.450418 n-d-860284-1 devstack@n-api.service[134101]: Oct 04 22:18:46.450418 n-d-860284-1 devstack@n-api.service[134101]: {"rescue": {}} Oct 04 22:18:46.450418 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 22:18:46.450418 n-d-860284-1 devstack@n-api.service[134101]: exception: Cannot 'rescue' instance 39984acf-f630-4ba0-b4e5-384ef8c3d9fc while it is in vm_state paused Oct 04 22:18:46.450418 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': '39984acf-f630-4ba0-b4e5-384ef8c3d9fc', 'body': {'rescue': {}}} Oct 04 22:18:46.450418 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:18:46.450418 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:18:46.450418 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 62, in _rescue Oct 04 22:18:46.450418 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi self.compute_api.rescue(context, instance, Oct 04 22:18:46.450418 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 04 22:18:46.450418 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 22:18:46.450418 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 22:18:46.450418 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 22:18:46.450418 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 04 22:18:46.450418 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 04 22:18:46.450418 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 39984acf-f630-4ba0-b4e5-384ef8c3d9fc in vm_state paused. Cannot rescue while the instance is in this state. Oct 04 22:18:46.450418 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:18:46.450418 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:18:46.450418 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:18:46.450418 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:18:46.450418 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:18:46.450418 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:18:46.450418 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:18:46.450418 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:18:46.450418 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:18:46.450418 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:18:46.450418 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 22:18:46.450418 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 22:18:46.450418 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 72, in _rescue Oct 04 22:18:46.450418 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Oct 04 22:18:46.450418 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 04 22:18:46.450418 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 22:18:46.450418 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rescue' instance 39984acf-f630-4ba0-b4e5-384ef8c3d9fc while it is in vm_state paused Oct 04 22:18:46.450418 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:18:46.455893 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:18:46.455893 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:18:46.455893 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:18:46.455893 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:18:46.455893 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:18:46.455893 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:18:46.455893 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:18:46.455893 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rescue' instance 39984acf-f630-4ba0-b4e5-384ef8c3d9fc while it is in vm_state paused Oct 04 22:18:46.455893 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:18:46.458757 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-8e3b2cc4-8b13-4c00-8fc0-f8e1be7ea227 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Returning 409 to user: Cannot 'rescue' instance 39984acf-f630-4ba0-b4e5-384ef8c3d9fc while it is in vm_state paused {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:18:46.460805 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-8e3b2cc4-8b13-4c00-8fc0-f8e1be7ea227 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] 10.222.0.43 "POST /compute/v2.1/servers/39984acf-f630-4ba0-b4e5-384ef8c3d9fc/action" status: 409 len: 144 microversion: 2.1 time: 0.094615 Oct 04 22:18:46.462998 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2866/5804] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 22:18:46 2022] POST /compute/v2.1/servers/39984acf-f630-4ba0-b4e5-384ef8c3d9fc/action => generated 144 bytes in 98 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 22:18:46.472578 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-6ee0ec8f-f6bd-464a-b313-3591733cabb1 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:18:46.473553 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-6ee0ec8f-f6bd-464a-b313-3591733cabb1 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] [instance: 39984acf-f630-4ba0-b4e5-384ef8c3d9fc] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:18:46.481471 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6ee0ec8f-f6bd-464a-b313-3591733cabb1 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:46.482480 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6ee0ec8f-f6bd-464a-b313-3591733cabb1 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:46.483143 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6ee0ec8f-f6bd-464a-b313-3591733cabb1 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:46.484208 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6ee0ec8f-f6bd-464a-b313-3591733cabb1 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:46.485046 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6ee0ec8f-f6bd-464a-b313-3591733cabb1 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:46.485914 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6ee0ec8f-f6bd-464a-b313-3591733cabb1 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:46.636099 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-6ee0ec8f-f6bd-464a-b313-3591733cabb1 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] 10.222.0.43 "POST /compute/v2.1/servers/39984acf-f630-4ba0-b4e5-384ef8c3d9fc/action" status: 202 len: 0 microversion: 2.1 time: 0.167955 Oct 04 22:18:46.637645 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2939/5805] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 22:18:46 2022] POST /compute/v2.1/servers/39984acf-f630-4ba0-b4e5-384ef8c3d9fc/action => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 22:18:46.668604 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-f771d992-5be6-4634-afa0-3ab51f3fd06c tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:18:46.669947 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-f771d992-5be6-4634-afa0-3ab51f3fd06c tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] [instance: 39984acf-f630-4ba0-b4e5-384ef8c3d9fc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:18:46.677688 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f771d992-5be6-4634-afa0-3ab51f3fd06c tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:46.679128 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f771d992-5be6-4634-afa0-3ab51f3fd06c tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:46.679807 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f771d992-5be6-4634-afa0-3ab51f3fd06c tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:46.680756 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f771d992-5be6-4634-afa0-3ab51f3fd06c tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:46.681234 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f771d992-5be6-4634-afa0-3ab51f3fd06c tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:46.681677 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f771d992-5be6-4634-afa0-3ab51f3fd06c tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:46.998807 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-f771d992-5be6-4634-afa0-3ab51f3fd06c tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6cfeabf8d84b2893200c3c54c1c19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be71413506154420869fdff5939fb940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:18:47.010553 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-f771d992-5be6-4634-afa0-3ab51f3fd06c tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] 10.222.0.43 "GET /compute/v2.1/servers/39984acf-f630-4ba0-b4e5-384ef8c3d9fc" status: 200 len: 1509 microversion: 2.1 time: 0.367830 Oct 04 22:18:47.012112 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2867/5806] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:18:46 2022] GET /compute/v2.1/servers/39984acf-f630-4ba0-b4e5-384ef8c3d9fc => generated 1509 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:18:48.039812 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-9b1b952d-1931-409c-b44f-e764bfab21da tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:18:48.041373 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-9b1b952d-1931-409c-b44f-e764bfab21da tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] [instance: 39984acf-f630-4ba0-b4e5-384ef8c3d9fc] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:18:48.048948 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9b1b952d-1931-409c-b44f-e764bfab21da tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:48.049727 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9b1b952d-1931-409c-b44f-e764bfab21da tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:48.050250 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9b1b952d-1931-409c-b44f-e764bfab21da tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:48.051078 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9b1b952d-1931-409c-b44f-e764bfab21da tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:48.051611 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9b1b952d-1931-409c-b44f-e764bfab21da tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:48.052495 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9b1b952d-1931-409c-b44f-e764bfab21da tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:48.279101 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-9b1b952d-1931-409c-b44f-e764bfab21da tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6cfeabf8d84b2893200c3c54c1c19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be71413506154420869fdff5939fb940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:18:48.296716 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-9b1b952d-1931-409c-b44f-e764bfab21da tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] 10.222.0.43 "GET /compute/v2.1/servers/39984acf-f630-4ba0-b4e5-384ef8c3d9fc" status: 200 len: 1517 microversion: 2.1 time: 0.263349 Oct 04 22:18:48.315390 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2940/5807] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:18:48 2022] GET /compute/v2.1/servers/39984acf-f630-4ba0-b4e5-384ef8c3d9fc => generated 1517 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:18:51.075256 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-9a6de9e9-8cf2-4691-9687-9abc92e4b27a tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:18:51.078054 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-9a6de9e9-8cf2-4691-9687-9abc92e4b27a tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] [instance: 39984acf-f630-4ba0-b4e5-384ef8c3d9fc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:18:51.090000 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9a6de9e9-8cf2-4691-9687-9abc92e4b27a tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:51.090532 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9a6de9e9-8cf2-4691-9687-9abc92e4b27a tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:51.090980 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9a6de9e9-8cf2-4691-9687-9abc92e4b27a tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:51.091927 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9a6de9e9-8cf2-4691-9687-9abc92e4b27a tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:51.092392 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9a6de9e9-8cf2-4691-9687-9abc92e4b27a tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:51.093056 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9a6de9e9-8cf2-4691-9687-9abc92e4b27a tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:51.151421 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.objects.instance [None req-9a6de9e9-8cf2-4691-9687-9abc92e4b27a tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lazy-loading 'flavor' on Instance uuid 39984acf-f630-4ba0-b4e5-384ef8c3d9fc {{(pid=134101) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 22:18:51.266556 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-9a6de9e9-8cf2-4691-9687-9abc92e4b27a tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] 10.222.0.43 "POST /compute/v2.1/servers/39984acf-f630-4ba0-b4e5-384ef8c3d9fc/action" status: 200 len: 32 microversion: 2.1 time: 0.196948 Oct 04 22:18:51.267176 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2868/5808] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 22:18:51 2022] POST /compute/v2.1/servers/39984acf-f630-4ba0-b4e5-384ef8c3d9fc/action => generated 32 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 22:18:51.279863 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-4d669b6b-b797-4b9f-95bd-7b0750f57745 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:18:51.281761 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-4d669b6b-b797-4b9f-95bd-7b0750f57745 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] [instance: 39984acf-f630-4ba0-b4e5-384ef8c3d9fc] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:18:51.291277 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4d669b6b-b797-4b9f-95bd-7b0750f57745 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:51.292315 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4d669b6b-b797-4b9f-95bd-7b0750f57745 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:51.293168 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4d669b6b-b797-4b9f-95bd-7b0750f57745 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:51.294531 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4d669b6b-b797-4b9f-95bd-7b0750f57745 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:51.295773 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4d669b6b-b797-4b9f-95bd-7b0750f57745 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:51.305472 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4d669b6b-b797-4b9f-95bd-7b0750f57745 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:51.471707 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-4d669b6b-b797-4b9f-95bd-7b0750f57745 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6cfeabf8d84b2893200c3c54c1c19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be71413506154420869fdff5939fb940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:18:51.480505 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-4d669b6b-b797-4b9f-95bd-7b0750f57745 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] 10.222.0.43 "GET /compute/v2.1/servers/39984acf-f630-4ba0-b4e5-384ef8c3d9fc" status: 200 len: 1523 microversion: 2.1 time: 0.204713 Oct 04 22:18:51.481097 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2941/5809] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:18:51 2022] GET /compute/v2.1/servers/39984acf-f630-4ba0-b4e5-384ef8c3d9fc => generated 1523 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:18:52.518351 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-c540f39d-896d-47bc-a891-0e709b2af65b tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:18:52.519089 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-c540f39d-896d-47bc-a891-0e709b2af65b tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] [instance: 39984acf-f630-4ba0-b4e5-384ef8c3d9fc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:18:52.540042 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c540f39d-896d-47bc-a891-0e709b2af65b tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:52.541547 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c540f39d-896d-47bc-a891-0e709b2af65b tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:52.542165 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c540f39d-896d-47bc-a891-0e709b2af65b tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:52.543106 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c540f39d-896d-47bc-a891-0e709b2af65b tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:52.543730 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c540f39d-896d-47bc-a891-0e709b2af65b tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:52.544341 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c540f39d-896d-47bc-a891-0e709b2af65b tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:52.937772 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-c540f39d-896d-47bc-a891-0e709b2af65b tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6cfeabf8d84b2893200c3c54c1c19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be71413506154420869fdff5939fb940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:18:52.937772 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-c540f39d-896d-47bc-a891-0e709b2af65b tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] 10.222.0.43 "GET /compute/v2.1/servers/39984acf-f630-4ba0-b4e5-384ef8c3d9fc" status: 200 len: 1523 microversion: 2.1 time: 0.218017 Oct 04 22:18:52.937772 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2869/5810] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:18:52 2022] GET /compute/v2.1/servers/39984acf-f630-4ba0-b4e5-384ef8c3d9fc => generated 1523 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:18:53.762353 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-c479cb7f-fbdd-4f48-816c-baf6f35be139 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:18:53.764947 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-c479cb7f-fbdd-4f48-816c-baf6f35be139 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] [instance: 39984acf-f630-4ba0-b4e5-384ef8c3d9fc] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:18:53.778568 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_api:SELECT=30 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:18:53.792289 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c479cb7f-fbdd-4f48-816c-baf6f35be139 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:53.793471 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c479cb7f-fbdd-4f48-816c-baf6f35be139 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:53.794131 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c479cb7f-fbdd-4f48-816c-baf6f35be139 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:53.796882 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c479cb7f-fbdd-4f48-816c-baf6f35be139 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:53.798700 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c479cb7f-fbdd-4f48-816c-baf6f35be139 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:53.799368 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c479cb7f-fbdd-4f48-816c-baf6f35be139 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:54.043634 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-c479cb7f-fbdd-4f48-816c-baf6f35be139 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6cfeabf8d84b2893200c3c54c1c19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be71413506154420869fdff5939fb940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:18:54.055967 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-c479cb7f-fbdd-4f48-816c-baf6f35be139 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] 10.222.0.43 "GET /compute/v2.1/servers/39984acf-f630-4ba0-b4e5-384ef8c3d9fc" status: 200 len: 1523 microversion: 2.1 time: 0.302127 Oct 04 22:18:54.057440 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2942/5811] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:18:53 2022] GET /compute/v2.1/servers/39984acf-f630-4ba0-b4e5-384ef8c3d9fc => generated 1523 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:18:55.080735 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-99140869-1e4c-46a4-bea3-d563365e93a1 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:18:55.081468 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-99140869-1e4c-46a4-bea3-d563365e93a1 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] [instance: 39984acf-f630-4ba0-b4e5-384ef8c3d9fc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:18:55.090102 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-99140869-1e4c-46a4-bea3-d563365e93a1 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:55.090902 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-99140869-1e4c-46a4-bea3-d563365e93a1 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:55.091520 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-99140869-1e4c-46a4-bea3-d563365e93a1 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:55.092433 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-99140869-1e4c-46a4-bea3-d563365e93a1 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:55.093148 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-99140869-1e4c-46a4-bea3-d563365e93a1 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:55.093785 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-99140869-1e4c-46a4-bea3-d563365e93a1 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:55.321182 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-99140869-1e4c-46a4-bea3-d563365e93a1 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6cfeabf8d84b2893200c3c54c1c19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be71413506154420869fdff5939fb940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:18:55.329804 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-99140869-1e4c-46a4-bea3-d563365e93a1 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] 10.222.0.43 "GET /compute/v2.1/servers/39984acf-f630-4ba0-b4e5-384ef8c3d9fc" status: 200 len: 1523 microversion: 2.1 time: 0.253383 Oct 04 22:18:55.346865 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2870/5812] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:18:55 2022] GET /compute/v2.1/servers/39984acf-f630-4ba0-b4e5-384ef8c3d9fc => generated 1523 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:18:56.357388 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-cb6927a6-b127-4c01-bad1-a52cecdb30e7 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:18:56.358582 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-cb6927a6-b127-4c01-bad1-a52cecdb30e7 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] [instance: 39984acf-f630-4ba0-b4e5-384ef8c3d9fc] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:18:56.372550 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cb6927a6-b127-4c01-bad1-a52cecdb30e7 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:56.373265 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cb6927a6-b127-4c01-bad1-a52cecdb30e7 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:56.374800 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cb6927a6-b127-4c01-bad1-a52cecdb30e7 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:56.377517 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cb6927a6-b127-4c01-bad1-a52cecdb30e7 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:56.378252 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cb6927a6-b127-4c01-bad1-a52cecdb30e7 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:56.379300 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cb6927a6-b127-4c01-bad1-a52cecdb30e7 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:56.981361 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-cb6927a6-b127-4c01-bad1-a52cecdb30e7 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6cfeabf8d84b2893200c3c54c1c19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be71413506154420869fdff5939fb940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:18:56.991336 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-cb6927a6-b127-4c01-bad1-a52cecdb30e7 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] 10.222.0.43 "GET /compute/v2.1/servers/39984acf-f630-4ba0-b4e5-384ef8c3d9fc" status: 200 len: 1523 microversion: 2.1 time: 0.637913 Oct 04 22:18:56.991945 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2943/5813] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:18:56 2022] GET /compute/v2.1/servers/39984acf-f630-4ba0-b4e5-384ef8c3d9fc => generated 1523 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:18:58.016106 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-301d792e-b0f3-489f-9f87-a2f8c71f2301 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:18:58.016741 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-301d792e-b0f3-489f-9f87-a2f8c71f2301 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] [instance: 39984acf-f630-4ba0-b4e5-384ef8c3d9fc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:18:58.029308 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-301d792e-b0f3-489f-9f87-a2f8c71f2301 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:58.029818 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-301d792e-b0f3-489f-9f87-a2f8c71f2301 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:58.030276 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-301d792e-b0f3-489f-9f87-a2f8c71f2301 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:58.043647 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-301d792e-b0f3-489f-9f87-a2f8c71f2301 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:58.044152 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-301d792e-b0f3-489f-9f87-a2f8c71f2301 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:58.044870 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-301d792e-b0f3-489f-9f87-a2f8c71f2301 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:58.394201 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-301d792e-b0f3-489f-9f87-a2f8c71f2301 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6cfeabf8d84b2893200c3c54c1c19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be71413506154420869fdff5939fb940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:18:58.415741 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-301d792e-b0f3-489f-9f87-a2f8c71f2301 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] 10.222.0.43 "GET /compute/v2.1/servers/39984acf-f630-4ba0-b4e5-384ef8c3d9fc" status: 200 len: 1523 microversion: 2.1 time: 0.399286 Oct 04 22:18:58.416696 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2871/5814] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:18:58 2022] GET /compute/v2.1/servers/39984acf-f630-4ba0-b4e5-384ef8c3d9fc => generated 1523 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:18:59.444766 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-eea4ce4e-6d17-4566-84c2-6b403853b5c8 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:18:59.445408 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-eea4ce4e-6d17-4566-84c2-6b403853b5c8 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] [instance: 39984acf-f630-4ba0-b4e5-384ef8c3d9fc] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:18:59.454721 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-eea4ce4e-6d17-4566-84c2-6b403853b5c8 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:59.455980 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-eea4ce4e-6d17-4566-84c2-6b403853b5c8 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:59.456513 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-eea4ce4e-6d17-4566-84c2-6b403853b5c8 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:59.457402 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-eea4ce4e-6d17-4566-84c2-6b403853b5c8 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:59.458105 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-eea4ce4e-6d17-4566-84c2-6b403853b5c8 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:59.458662 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-eea4ce4e-6d17-4566-84c2-6b403853b5c8 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:59.746540 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-eea4ce4e-6d17-4566-84c2-6b403853b5c8 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6cfeabf8d84b2893200c3c54c1c19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be71413506154420869fdff5939fb940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:18:59.759529 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-eea4ce4e-6d17-4566-84c2-6b403853b5c8 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] 10.222.0.43 "GET /compute/v2.1/servers/39984acf-f630-4ba0-b4e5-384ef8c3d9fc" status: 200 len: 1523 microversion: 2.1 time: 0.321435 Oct 04 22:18:59.760307 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2944/5815] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:18:59 2022] GET /compute/v2.1/servers/39984acf-f630-4ba0-b4e5-384ef8c3d9fc => generated 1523 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:19:00.788036 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-ecd4306a-20ad-4fe3-901d-f16c8e861c73 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:19:00.788703 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-ecd4306a-20ad-4fe3-901d-f16c8e861c73 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] [instance: 39984acf-f630-4ba0-b4e5-384ef8c3d9fc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:19:00.795983 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ecd4306a-20ad-4fe3-901d-f16c8e861c73 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:00.796489 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ecd4306a-20ad-4fe3-901d-f16c8e861c73 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:00.796936 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ecd4306a-20ad-4fe3-901d-f16c8e861c73 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:00.797680 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ecd4306a-20ad-4fe3-901d-f16c8e861c73 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:00.798122 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ecd4306a-20ad-4fe3-901d-f16c8e861c73 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:00.798595 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ecd4306a-20ad-4fe3-901d-f16c8e861c73 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:01.254205 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-ecd4306a-20ad-4fe3-901d-f16c8e861c73 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6cfeabf8d84b2893200c3c54c1c19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be71413506154420869fdff5939fb940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:19:01.278052 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-ecd4306a-20ad-4fe3-901d-f16c8e861c73 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] 10.222.0.43 "GET /compute/v2.1/servers/39984acf-f630-4ba0-b4e5-384ef8c3d9fc" status: 200 len: 1523 microversion: 2.1 time: 0.488818 Oct 04 22:19:01.283843 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2872/5816] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:19:00 2022] GET /compute/v2.1/servers/39984acf-f630-4ba0-b4e5-384ef8c3d9fc => generated 1523 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:19:02.306640 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-b001b991-52ad-4a0c-a079-6d7adbc65ff1 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:19:02.307900 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-b001b991-52ad-4a0c-a079-6d7adbc65ff1 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] [instance: 39984acf-f630-4ba0-b4e5-384ef8c3d9fc] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:19:02.321027 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b001b991-52ad-4a0c-a079-6d7adbc65ff1 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:02.322947 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b001b991-52ad-4a0c-a079-6d7adbc65ff1 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:02.323902 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b001b991-52ad-4a0c-a079-6d7adbc65ff1 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:02.327453 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b001b991-52ad-4a0c-a079-6d7adbc65ff1 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:02.328366 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b001b991-52ad-4a0c-a079-6d7adbc65ff1 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:02.329659 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b001b991-52ad-4a0c-a079-6d7adbc65ff1 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:02.920353 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-b001b991-52ad-4a0c-a079-6d7adbc65ff1 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6cfeabf8d84b2893200c3c54c1c19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be71413506154420869fdff5939fb940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:19:02.929250 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-b001b991-52ad-4a0c-a079-6d7adbc65ff1 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] 10.222.0.43 "GET /compute/v2.1/servers/39984acf-f630-4ba0-b4e5-384ef8c3d9fc" status: 200 len: 1523 microversion: 2.1 time: 0.627789 Oct 04 22:19:02.936802 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2945/5817] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:19:02 2022] GET /compute/v2.1/servers/39984acf-f630-4ba0-b4e5-384ef8c3d9fc => generated 1523 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:19:03.979146 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-6a1c8f2e-7038-4eda-a20f-c754b3eb1537 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:19:03.979898 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-6a1c8f2e-7038-4eda-a20f-c754b3eb1537 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] [instance: 39984acf-f630-4ba0-b4e5-384ef8c3d9fc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:19:03.996779 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6a1c8f2e-7038-4eda-a20f-c754b3eb1537 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:03.998248 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6a1c8f2e-7038-4eda-a20f-c754b3eb1537 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:03.998908 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6a1c8f2e-7038-4eda-a20f-c754b3eb1537 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:03.999840 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6a1c8f2e-7038-4eda-a20f-c754b3eb1537 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:04.000467 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6a1c8f2e-7038-4eda-a20f-c754b3eb1537 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:04.001272 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6a1c8f2e-7038-4eda-a20f-c754b3eb1537 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:04.543746 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-6a1c8f2e-7038-4eda-a20f-c754b3eb1537 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6cfeabf8d84b2893200c3c54c1c19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be71413506154420869fdff5939fb940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:19:04.559413 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-6a1c8f2e-7038-4eda-a20f-c754b3eb1537 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] 10.222.0.43 "GET /compute/v2.1/servers/39984acf-f630-4ba0-b4e5-384ef8c3d9fc" status: 200 len: 1523 microversion: 2.1 time: 0.602096 Oct 04 22:19:04.566599 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2873/5818] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:19:03 2022] GET /compute/v2.1/servers/39984acf-f630-4ba0-b4e5-384ef8c3d9fc => generated 1523 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:19:05.590213 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-db5c42d3-1b79-4b95-9d5b-44fd781cb602 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:19:05.595115 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-db5c42d3-1b79-4b95-9d5b-44fd781cb602 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] [instance: 39984acf-f630-4ba0-b4e5-384ef8c3d9fc] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:19:05.610763 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-db5c42d3-1b79-4b95-9d5b-44fd781cb602 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:05.613683 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-db5c42d3-1b79-4b95-9d5b-44fd781cb602 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:05.616115 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-db5c42d3-1b79-4b95-9d5b-44fd781cb602 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:05.617071 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-db5c42d3-1b79-4b95-9d5b-44fd781cb602 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:05.617754 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-db5c42d3-1b79-4b95-9d5b-44fd781cb602 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:05.623114 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-db5c42d3-1b79-4b95-9d5b-44fd781cb602 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:06.233145 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-db5c42d3-1b79-4b95-9d5b-44fd781cb602 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6cfeabf8d84b2893200c3c54c1c19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be71413506154420869fdff5939fb940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:19:06.248106 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-db5c42d3-1b79-4b95-9d5b-44fd781cb602 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] 10.222.0.43 "GET /compute/v2.1/servers/39984acf-f630-4ba0-b4e5-384ef8c3d9fc" status: 200 len: 1523 microversion: 2.1 time: 0.664396 Oct 04 22:19:06.251592 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2946/5819] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:19:05 2022] GET /compute/v2.1/servers/39984acf-f630-4ba0-b4e5-384ef8c3d9fc => generated 1523 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:19:07.276275 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-06975b21-8f74-42d0-9e84-652771455901 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:19:07.277521 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-06975b21-8f74-42d0-9e84-652771455901 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] [instance: 39984acf-f630-4ba0-b4e5-384ef8c3d9fc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:19:07.291036 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-06975b21-8f74-42d0-9e84-652771455901 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:07.291920 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-06975b21-8f74-42d0-9e84-652771455901 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:07.293464 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-06975b21-8f74-42d0-9e84-652771455901 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:07.296451 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-06975b21-8f74-42d0-9e84-652771455901 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:07.297207 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-06975b21-8f74-42d0-9e84-652771455901 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:07.297875 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-06975b21-8f74-42d0-9e84-652771455901 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:07.476999 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-4fbe311e-c23f-4f94-983f-5ddca27faccd tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Action: 'create', calling method: .version_select at 0x7fbb2e0e70d0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1235115313", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF7IYxBLF195lZYMuCNHjmS4p8NJAx1VJiInr7YN1MraN7pvVeXlmiLJBnoVc5n68DZ5Bf0FJ67CVFtaS5b46d4DcV0WmBvLYvdBMApqIkTXID//0vtm2vmPMPZdN6ZJnw=="}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:19:07.517411 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-06975b21-8f74-42d0-9e84-652771455901 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6cfeabf8d84b2893200c3c54c1c19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be71413506154420869fdff5939fb940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:19:07.525201 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-4fbe311e-c23f-4f94-983f-5ddca27faccd tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Getting quotas for project 286d184163154f2e846d521d368e3ead. Resources: {'key_pairs'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:19:07.526839 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-06975b21-8f74-42d0-9e84-652771455901 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] 10.222.0.43 "GET /compute/v2.1/servers/39984acf-f630-4ba0-b4e5-384ef8c3d9fc" status: 200 len: 1503 microversion: 2.1 time: 0.255566 Oct 04 22:19:07.530137 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2874/5820] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:19:07 2022] GET /compute/v2.1/servers/39984acf-f630-4ba0-b4e5-384ef8c3d9fc => generated 1503 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:19:07.545475 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-4fbe311e-c23f-4f94-983f-5ddca27faccd tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Getting quotas for user 94ac78e2767c49168f0464acea155be1 and project 286d184163154f2e846d521d368e3ead. Resources: {'key_pairs'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:19:07.585593 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-219834d3-2a69-4562-97b2-f27d1e66712c tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bcd8ef8f-27aa-45a5-b17f-66ac89118e93"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:19:07.588087 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-219834d3-2a69-4562-97b2-f27d1e66712c tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] [instance: 39984acf-f630-4ba0-b4e5-384ef8c3d9fc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:19:07.596919 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-4fbe311e-c23f-4f94-983f-5ddca27faccd tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.124833 Oct 04 22:19:07.604216 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2947/5821] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Oct 4 22:19:07 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:19:07.606816 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-219834d3-2a69-4562-97b2-f27d1e66712c tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:07.607822 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-219834d3-2a69-4562-97b2-f27d1e66712c tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:07.608677 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-219834d3-2a69-4562-97b2-f27d1e66712c tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:07.609504 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-219834d3-2a69-4562-97b2-f27d1e66712c tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:07.610024 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-219834d3-2a69-4562-97b2-f27d1e66712c tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:07.611322 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-219834d3-2a69-4562-97b2-f27d1e66712c tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:07.656902 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-219834d3-2a69-4562-97b2-f27d1e66712c tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] HTTP exception thrown: Cannot 'attach_volume' instance 39984acf-f630-4ba0-b4e5-384ef8c3d9fc while it is in vm_state rescued Oct 04 22:19:07.659663 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-219834d3-2a69-4562-97b2-f27d1e66712c tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Request method failure captured: Oct 04 22:19:07.659663 n-d-860284-1 devstack@n-api.service[134101]: request: POST /compute/v2.1/servers/39984acf-f630-4ba0-b4e5-384ef8c3d9fc/os-volume_attachments HTTP/1.1 Oct 04 22:19:07.659663 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 22:19:07.659663 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 22:19:07.659663 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 22:19:07.659663 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 74 Oct 04 22:19:07.659663 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 22:19:07.659663 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 22:19:07.659663 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 22:19:07.659663 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 22:19:07.659663 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPLEDiePHKmNYQ70bvTRH9P6iiaqhUoAB8_ZBMNVcHJpqPxkBgo3U3nk5n38-Pj3vdk8AJHCO9JALC7jh3PuAbKmfUvXx7h6K9sXqnrzemrKzzJUfKCyLDC31QQuFp0uS2eKZE1D_dbjuEfh4aQXcfm19u6d5SXGgRB-GYLIygAnJeb8 Oct 04 22:19:07.659663 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 22:19:07.659663 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 22:19:07.659663 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 22:19:07.659663 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 22:19:07.659663 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 22:19:07.659663 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 22:19:07.659663 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: be71413506154420869fdff5939fb940 Oct 04 22:19:07.659663 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1499910012 Oct 04 22:19:07.659663 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 22:19:07.659663 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 22:19:07.659663 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/be71413506154420869fdff5939fb940"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_be71413506154420869fdff5939fb940", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/be71413506154420869fdff5939fb940"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/be71413506154420869fdff5939fb940"}]}] Oct 04 22:19:07.659663 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1499910012 Oct 04 22:19:07.659663 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: be71413506154420869fdff5939fb940 Oct 04 22:19:07.659663 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1499910012 Oct 04 22:19:07.659663 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-ServerRescueNegativeTestJSON-1499910012-project Oct 04 22:19:07.659663 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 22:19:07.659663 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 22:19:07.659663 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: ca6cfeabf8d84b2893200c3c54c1c19f Oct 04 22:19:07.659663 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1499910012-project Oct 04 22:19:07.659663 n-d-860284-1 devstack@n-api.service[134101]: Oct 04 22:19:07.659663 n-d-860284-1 devstack@n-api.service[134101]: {"volumeAttachment": {"volumeId": "bcd8ef8f-27aa-45a5-b17f-66ac89118e93"}} Oct 04 22:19:07.659663 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 22:19:07.659663 n-d-860284-1 devstack@n-api.service[134101]: exception: Cannot 'attach_volume' instance 39984acf-f630-4ba0-b4e5-384ef8c3d9fc while it is in vm_state rescued Oct 04 22:19:07.659663 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'server_id': '39984acf-f630-4ba0-b4e5-384ef8c3d9fc', 'body': {'volumeAttachment': {'volumeId': 'bcd8ef8f-27aa-45a5-b17f-66ac89118e93'}}} Oct 04 22:19:07.659663 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:19:07.659663 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:19:07.659663 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 04 22:19:07.659663 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 04 22:19:07.659663 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 22:19:07.659663 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 22:19:07.659663 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 04 22:19:07.659663 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 04 22:19:07.659663 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 39984acf-f630-4ba0-b4e5-384ef8c3d9fc in vm_state rescued. Cannot attach_volume while the instance is in this state. Oct 04 22:19:07.659663 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:19:07.659663 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:19:07.659663 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:19:07.659663 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:19:07.659663 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:19:07.659663 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:19:07.659663 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:19:07.659663 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:19:07.659663 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:19:07.659663 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:19:07.659663 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 22:19:07.659663 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 22:19:07.659663 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 22:19:07.659663 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 22:19:07.659663 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 22:19:07.659663 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 22:19:07.659663 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Oct 04 22:19:07.659663 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 04 22:19:07.666311 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 04 22:19:07.666311 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 22:19:07.666311 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 39984acf-f630-4ba0-b4e5-384ef8c3d9fc while it is in vm_state rescued Oct 04 22:19:07.666311 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:19:07.666311 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:19:07.666311 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:19:07.666311 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:19:07.666311 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:19:07.666311 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:19:07.666311 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:19:07.666311 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:19:07.666311 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 39984acf-f630-4ba0-b4e5-384ef8c3d9fc while it is in vm_state rescued Oct 04 22:19:07.666311 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:19:07.666311 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-219834d3-2a69-4562-97b2-f27d1e66712c tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Returning 409 to user: Cannot 'attach_volume' instance 39984acf-f630-4ba0-b4e5-384ef8c3d9fc while it is in vm_state rescued {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:19:07.666311 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-219834d3-2a69-4562-97b2-f27d1e66712c tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] 10.222.0.43 "POST /compute/v2.1/servers/39984acf-f630-4ba0-b4e5-384ef8c3d9fc/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.081791 Oct 04 22:19:07.668418 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2875/5822] 10.222.0.43 () {60 vars in 1323 bytes} [Tue Oct 4 22:19:07 2022] POST /compute/v2.1/servers/39984acf-f630-4ba0-b4e5-384ef8c3d9fc/os-volume_attachments => generated 152 bytes in 87 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 04 22:19:07.673129 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-97a50219-655c-48b1-9310-ac548bbba6b4 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:19:07.673818 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-97a50219-655c-48b1-9310-ac548bbba6b4 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] [instance: 39984acf-f630-4ba0-b4e5-384ef8c3d9fc] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:19:07.681848 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-97a50219-655c-48b1-9310-ac548bbba6b4 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:07.682419 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-97a50219-655c-48b1-9310-ac548bbba6b4 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:07.688995 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-97a50219-655c-48b1-9310-ac548bbba6b4 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:07.691847 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-97a50219-655c-48b1-9310-ac548bbba6b4 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:07.692574 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-97a50219-655c-48b1-9310-ac548bbba6b4 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:07.693802 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-97a50219-655c-48b1-9310-ac548bbba6b4 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:07.898592 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-97a50219-655c-48b1-9310-ac548bbba6b4 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] 10.222.0.43 "POST /compute/v2.1/servers/39984acf-f630-4ba0-b4e5-384ef8c3d9fc/action" status: 202 len: 0 microversion: 2.1 time: 0.229415 Oct 04 22:19:07.926091 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-32a5c466-ef59-4b40-8e8c-4909e2041b97 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:19:07.927510 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-32a5c466-ef59-4b40-8e8c-4909e2041b97 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] [instance: 39984acf-f630-4ba0-b4e5-384ef8c3d9fc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:19:07.935428 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2948/5823] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 22:19:07 2022] POST /compute/v2.1/servers/39984acf-f630-4ba0-b4e5-384ef8c3d9fc/action => generated 0 bytes in 268 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 22:19:07.943671 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-32a5c466-ef59-4b40-8e8c-4909e2041b97 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:07.944194 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-32a5c466-ef59-4b40-8e8c-4909e2041b97 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:07.946919 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-32a5c466-ef59-4b40-8e8c-4909e2041b97 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:07.947732 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-32a5c466-ef59-4b40-8e8c-4909e2041b97 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:07.948268 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-32a5c466-ef59-4b40-8e8c-4909e2041b97 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:07.948713 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-32a5c466-ef59-4b40-8e8c-4909e2041b97 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:08.287318 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-32a5c466-ef59-4b40-8e8c-4909e2041b97 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6cfeabf8d84b2893200c3c54c1c19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be71413506154420869fdff5939fb940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:19:08.314206 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-32a5c466-ef59-4b40-8e8c-4909e2041b97 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] 10.222.0.43 "GET /compute/v2.1/servers/39984acf-f630-4ba0-b4e5-384ef8c3d9fc" status: 200 len: 1511 microversion: 2.1 time: 0.406357 Oct 04 22:19:08.316183 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2876/5824] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:19:07 2022] GET /compute/v2.1/servers/39984acf-f630-4ba0-b4e5-384ef8c3d9fc => generated 1511 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:19:09.346085 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-ea00409b-0444-4ac0-90fb-49b29eb73914 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:19:09.347447 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-ea00409b-0444-4ac0-90fb-49b29eb73914 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] [instance: 39984acf-f630-4ba0-b4e5-384ef8c3d9fc] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:19:09.373177 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ea00409b-0444-4ac0-90fb-49b29eb73914 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:09.379167 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ea00409b-0444-4ac0-90fb-49b29eb73914 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:09.379641 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ea00409b-0444-4ac0-90fb-49b29eb73914 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:09.381021 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ea00409b-0444-4ac0-90fb-49b29eb73914 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:09.381501 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ea00409b-0444-4ac0-90fb-49b29eb73914 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:09.381947 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ea00409b-0444-4ac0-90fb-49b29eb73914 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:09.754785 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-ea00409b-0444-4ac0-90fb-49b29eb73914 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6cfeabf8d84b2893200c3c54c1c19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be71413506154420869fdff5939fb940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:19:09.762929 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:19:09.784289 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-ea00409b-0444-4ac0-90fb-49b29eb73914 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] 10.222.0.43 "GET /compute/v2.1/servers/39984acf-f630-4ba0-b4e5-384ef8c3d9fc" status: 200 len: 1511 microversion: 2.1 time: 0.443253 Oct 04 22:19:09.789264 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2949/5825] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:19:09 2022] GET /compute/v2.1/servers/39984acf-f630-4ba0-b4e5-384ef8c3d9fc => generated 1511 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:19:10.701696 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-6a83a14e-d786-4cc7-bac9-de2260485a97 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1437550130", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452", "networks": [{"uuid": "13116e04-76a0-4e9e-945d-fbec39071caf"}], "key_name": "tempest-TestNetworkBasicOps-1235115313", "security_groups": [{"name": "tempest-secgroup-smoke-1602238485"}]}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:19:10.815450 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-4604f88a-61ee-450a-86c0-dd78bb20db0c tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:19:10.817220 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-4604f88a-61ee-450a-86c0-dd78bb20db0c tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] [instance: 39984acf-f630-4ba0-b4e5-384ef8c3d9fc] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:19:10.827835 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4604f88a-61ee-450a-86c0-dd78bb20db0c tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:10.829377 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4604f88a-61ee-450a-86c0-dd78bb20db0c tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:10.830237 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4604f88a-61ee-450a-86c0-dd78bb20db0c tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:10.831447 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4604f88a-61ee-450a-86c0-dd78bb20db0c tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:10.856205 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4604f88a-61ee-450a-86c0-dd78bb20db0c tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:10.858153 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4604f88a-61ee-450a-86c0-dd78bb20db0c tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:11.093318 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.network.neutron [None req-6a83a14e-d786-4cc7-bac9-de2260485a97 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] validate_networks() for [('13116e04-76a0-4e9e-945d-fbec39071caf', None, None, None, None, None)] {{(pid=134101) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 22:19:11.301351 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-4604f88a-61ee-450a-86c0-dd78bb20db0c tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6cfeabf8d84b2893200c3c54c1c19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be71413506154420869fdff5939fb940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:19:11.329080 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-4604f88a-61ee-450a-86c0-dd78bb20db0c tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] 10.222.0.43 "GET /compute/v2.1/servers/39984acf-f630-4ba0-b4e5-384ef8c3d9fc" status: 200 len: 1511 microversion: 2.1 time: 0.516854 Oct 04 22:19:11.331990 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2950/5826] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:19:10 2022] GET /compute/v2.1/servers/39984acf-f630-4ba0-b4e5-384ef8c3d9fc => generated 1511 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:19:11.340377 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-73bb0edf-08ed-43bd-bf35-0c731b87d71d tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1760263666", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "a6bfe8c7-9df5-4814-a1ba-f9f9709c0645", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f55a0794-d215-4510-84cc-a7b063c083a4"}]}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:19:11.675068 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.network.neutron [None req-73bb0edf-08ed-43bd-bf35-0c731b87d71d tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] validate_networks() for [('f55a0794-d215-4510-84cc-a7b063c083a4', None, None, None, None, None)] {{(pid=134102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 22:19:11.926962 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-6a83a14e-d786-4cc7-bac9-de2260485a97 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Flavor limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 22:19:11.927487 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-6a83a14e-d786-4cc7-bac9-de2260485a97 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Image limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 22:19:11.927811 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-6a83a14e-d786-4cc7-bac9-de2260485a97 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Flavor pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 22:19:11.928264 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-6a83a14e-d786-4cc7-bac9-de2260485a97 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Image pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 22:19:11.928753 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-6a83a14e-d786-4cc7-bac9-de2260485a97 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 22:19:11.931037 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=34 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:19:11.947795 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6a83a14e-d786-4cc7-bac9-de2260485a97 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:11.948293 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6a83a14e-d786-4cc7-bac9-de2260485a97 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:11.948741 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6a83a14e-d786-4cc7-bac9-de2260485a97 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:11.949489 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6a83a14e-d786-4cc7-bac9-de2260485a97 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:11.949959 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6a83a14e-d786-4cc7-bac9-de2260485a97 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:11.950652 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6a83a14e-d786-4cc7-bac9-de2260485a97 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:11.968641 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:19:11.997319 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-6a83a14e-d786-4cc7-bac9-de2260485a97 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Getting quotas for project 286d184163154f2e846d521d368e3ead. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:19:12.007535 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-6a83a14e-d786-4cc7-bac9-de2260485a97 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Getting quotas for user 94ac78e2767c49168f0464acea155be1 and project 286d184163154f2e846d521d368e3ead. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:19:12.039352 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-6a83a14e-d786-4cc7-bac9-de2260485a97 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Going to run 1 instances... {{(pid=134101) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 22:19:12.043115 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-6a83a14e-d786-4cc7-bac9-de2260485a97 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] [instance: 8d50022d-6b2c-4959-a038-e4a4c0ee9639] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='58548514-5dac-426c-81f5-19e3fba33e23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134101) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 22:19:12.166645 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-6a83a14e-d786-4cc7-bac9-de2260485a97 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.468585 Oct 04 22:19:12.186342 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2877/5827] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 22:19:10 2022] POST /compute/v2.1/servers => generated 406 bytes in 1491 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 22:19:12.193673 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-a64884a8-43e3-4f29-a4aa-587c5b48d8b9 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:19:12.195031 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-a64884a8-43e3-4f29-a4aa-587c5b48d8b9 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] [instance: 8d50022d-6b2c-4959-a038-e4a4c0ee9639] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:19:12.253325 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-a64884a8-43e3-4f29-a4aa-587c5b48d8b9 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ac78e2767c49168f0464acea155be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286d184163154f2e846d521d368e3ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:19:12.262532 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-a64884a8-43e3-4f29-a4aa-587c5b48d8b9 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] 10.222.0.43 "GET /compute/v2.1/servers/8d50022d-6b2c-4959-a038-e4a4c0ee9639" status: 200 len: 1249 microversion: 2.1 time: 0.074647 Oct 04 22:19:12.263525 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2878/5828] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:19:12 2022] GET /compute/v2.1/servers/8d50022d-6b2c-4959-a038-e4a4c0ee9639 => generated 1249 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:19:12.358882 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-109dab39-3d46-4fea-bf30-4f05d64e2b58 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:19:12.359511 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-109dab39-3d46-4fea-bf30-4f05d64e2b58 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] [instance: 39984acf-f630-4ba0-b4e5-384ef8c3d9fc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:19:12.371822 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-109dab39-3d46-4fea-bf30-4f05d64e2b58 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:12.372372 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-109dab39-3d46-4fea-bf30-4f05d64e2b58 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:12.372835 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-109dab39-3d46-4fea-bf30-4f05d64e2b58 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:12.375292 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-109dab39-3d46-4fea-bf30-4f05d64e2b58 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:12.375798 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-109dab39-3d46-4fea-bf30-4f05d64e2b58 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:12.376249 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-109dab39-3d46-4fea-bf30-4f05d64e2b58 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:12.716606 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-109dab39-3d46-4fea-bf30-4f05d64e2b58 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6cfeabf8d84b2893200c3c54c1c19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be71413506154420869fdff5939fb940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:19:12.753362 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-109dab39-3d46-4fea-bf30-4f05d64e2b58 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] 10.222.0.43 "GET /compute/v2.1/servers/39984acf-f630-4ba0-b4e5-384ef8c3d9fc" status: 200 len: 1517 microversion: 2.1 time: 0.397908 Oct 04 22:19:12.754516 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2879/5829] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:19:12 2022] GET /compute/v2.1/servers/39984acf-f630-4ba0-b4e5-384ef8c3d9fc => generated 1517 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:19:13.290610 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-f0b5d70c-836d-447e-98c8-d3480a43e449 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:19:13.291611 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-f0b5d70c-836d-447e-98c8-d3480a43e449 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] [instance: 8d50022d-6b2c-4959-a038-e4a4c0ee9639] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:19:13.305426 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f0b5d70c-836d-447e-98c8-d3480a43e449 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:13.308475 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f0b5d70c-836d-447e-98c8-d3480a43e449 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:13.309903 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f0b5d70c-836d-447e-98c8-d3480a43e449 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:13.310615 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f0b5d70c-836d-447e-98c8-d3480a43e449 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:13.311855 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f0b5d70c-836d-447e-98c8-d3480a43e449 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:13.312522 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f0b5d70c-836d-447e-98c8-d3480a43e449 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:13.506728 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-f0b5d70c-836d-447e-98c8-d3480a43e449 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ac78e2767c49168f0464acea155be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286d184163154f2e846d521d368e3ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:19:13.532414 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-f0b5d70c-836d-447e-98c8-d3480a43e449 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] 10.222.0.43 "GET /compute/v2.1/servers/8d50022d-6b2c-4959-a038-e4a4c0ee9639" status: 200 len: 1245 microversion: 2.1 time: 0.241889 Oct 04 22:19:13.537653 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2880/5830] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:19:13 2022] GET /compute/v2.1/servers/8d50022d-6b2c-4959-a038-e4a4c0ee9639 => generated 1245 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:19:14.557860 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-7f44a0a1-bfee-4fb5-9919-dfb4acd0360b tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:19:14.559743 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-7f44a0a1-bfee-4fb5-9919-dfb4acd0360b tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] [instance: 8d50022d-6b2c-4959-a038-e4a4c0ee9639] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:19:14.572211 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7f44a0a1-bfee-4fb5-9919-dfb4acd0360b tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:14.576093 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7f44a0a1-bfee-4fb5-9919-dfb4acd0360b tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:14.577432 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7f44a0a1-bfee-4fb5-9919-dfb4acd0360b tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:14.578731 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7f44a0a1-bfee-4fb5-9919-dfb4acd0360b tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:14.590762 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7f44a0a1-bfee-4fb5-9919-dfb4acd0360b tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:14.592775 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7f44a0a1-bfee-4fb5-9919-dfb4acd0360b tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:14.746476 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-7f44a0a1-bfee-4fb5-9919-dfb4acd0360b tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ac78e2767c49168f0464acea155be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286d184163154f2e846d521d368e3ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:19:14.757160 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-7f44a0a1-bfee-4fb5-9919-dfb4acd0360b tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] 10.222.0.43 "GET /compute/v2.1/servers/8d50022d-6b2c-4959-a038-e4a4c0ee9639" status: 200 len: 1307 microversion: 2.1 time: 0.201080 Oct 04 22:19:14.761019 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2881/5831] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:19:14 2022] GET /compute/v2.1/servers/8d50022d-6b2c-4959-a038-e4a4c0ee9639 => generated 1307 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:19:15.744941 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-73f9a070-1768-49ea-a848-c2bca0ee7287 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Action: 'create', calling method: .version_select at 0x7fbb34963e50>, body: {"keypair": {"name": "tempest-keypair-438545507", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH0/C/07LWYh8LLRgLYlAKEp1vgceMcF6hHrrwrmZ3gjhT7c/eLbpo74hlbnEti/H4IIS45r1RvXVXyhAjQk2UpR5NAiJwNMP/NgiFYhDrV0IAmmYQ2yVUHF3aT/ms7RTg=="}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:19:15.764852 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-73f9a070-1768-49ea-a848-c2bca0ee7287 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Getting quotas for project be71413506154420869fdff5939fb940. Resources: {'key_pairs'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:19:15.777004 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-73f9a070-1768-49ea-a848-c2bca0ee7287 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Getting quotas for user ca6cfeabf8d84b2893200c3c54c1c19f and project be71413506154420869fdff5939fb940. Resources: {'key_pairs'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:19:15.855038 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-73f9a070-1768-49ea-a848-c2bca0ee7287 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.113739 Oct 04 22:19:15.856305 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2882/5832] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Oct 4 22:19:15 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:19:15.862259 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-710077bb-16a0-4407-b6cd-0edda302d7ce tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:19:15.864571 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-710077bb-16a0-4407-b6cd-0edda302d7ce tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] [instance: 8d50022d-6b2c-4959-a038-e4a4c0ee9639] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:19:15.872858 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-710077bb-16a0-4407-b6cd-0edda302d7ce tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:15.873637 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-710077bb-16a0-4407-b6cd-0edda302d7ce tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:15.874302 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-710077bb-16a0-4407-b6cd-0edda302d7ce tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:15.875253 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-710077bb-16a0-4407-b6cd-0edda302d7ce tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:15.876041 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-710077bb-16a0-4407-b6cd-0edda302d7ce tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:15.876661 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-710077bb-16a0-4407-b6cd-0edda302d7ce tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:16.013141 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-710077bb-16a0-4407-b6cd-0edda302d7ce tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ac78e2767c49168f0464acea155be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286d184163154f2e846d521d368e3ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:19:16.022760 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-710077bb-16a0-4407-b6cd-0edda302d7ce tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] 10.222.0.43 "GET /compute/v2.1/servers/8d50022d-6b2c-4959-a038-e4a4c0ee9639" status: 200 len: 1307 microversion: 2.1 time: 0.165148 Oct 04 22:19:16.029183 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2883/5833] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:19:15 2022] GET /compute/v2.1/servers/8d50022d-6b2c-4959-a038-e4a4c0ee9639 => generated 1307 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:19:17.058909 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-d9ef9b22-bfa1-4681-9a1d-0702be456f4b tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:19:17.060338 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-d9ef9b22-bfa1-4681-9a1d-0702be456f4b tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] [instance: 8d50022d-6b2c-4959-a038-e4a4c0ee9639] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:19:17.092529 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d9ef9b22-bfa1-4681-9a1d-0702be456f4b tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:17.100187 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d9ef9b22-bfa1-4681-9a1d-0702be456f4b tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:17.101073 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d9ef9b22-bfa1-4681-9a1d-0702be456f4b tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:17.115424 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d9ef9b22-bfa1-4681-9a1d-0702be456f4b tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:17.117779 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d9ef9b22-bfa1-4681-9a1d-0702be456f4b tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:17.121568 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d9ef9b22-bfa1-4681-9a1d-0702be456f4b tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:17.558507 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell0:SELECT=4 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:19:17.912419 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-d9ef9b22-bfa1-4681-9a1d-0702be456f4b tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ac78e2767c49168f0464acea155be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286d184163154f2e846d521d368e3ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:19:17.929421 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-d9ef9b22-bfa1-4681-9a1d-0702be456f4b tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] 10.222.0.43 "GET /compute/v2.1/servers/8d50022d-6b2c-4959-a038-e4a4c0ee9639" status: 200 len: 1375 microversion: 2.1 time: 0.875821 Oct 04 22:19:17.948441 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2884/5834] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:19:17 2022] GET /compute/v2.1/servers/8d50022d-6b2c-4959-a038-e4a4c0ee9639 => generated 1375 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:19:18.569191 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-9b414e5c-d67a-4d51-8db2-56d7de068080 req-886ab32e-c93a-4cec-96e6-540a55a4df15 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d50022d-6b2c-4959-a038-e4a4c0ee9639", "tag": "c21b6fdd-96b3-490d-a621-cced5b85c7d6"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:19:18.596928 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-9b414e5c-d67a-4d51-8db2-56d7de068080 req-886ab32e-c93a-4cec-96e6-540a55a4df15 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:18.598607 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-9b414e5c-d67a-4d51-8db2-56d7de068080 req-886ab32e-c93a-4cec-96e6-540a55a4df15 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:18.599269 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-9b414e5c-d67a-4d51-8db2-56d7de068080 req-886ab32e-c93a-4cec-96e6-540a55a4df15 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:18.627419 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-9b414e5c-d67a-4d51-8db2-56d7de068080 req-886ab32e-c93a-4cec-96e6-540a55a4df15 service nova] Creating event network-changed:c21b6fdd-96b3-490d-a621-cced5b85c7d6 for instance 8d50022d-6b2c-4959-a038-e4a4c0ee9639 on n-h2-860284-1 Oct 04 22:19:18.643144 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-9b414e5c-d67a-4d51-8db2-56d7de068080 req-886ab32e-c93a-4cec-96e6-540a55a4df15 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080212 Oct 04 22:19:18.644926 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2885/5835] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:19:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:19:18.967110 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-6c457f66-f854-4e2a-bd6b-f7b85294e6da tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:19:18.972245 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-6c457f66-f854-4e2a-bd6b-f7b85294e6da tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] [instance: 8d50022d-6b2c-4959-a038-e4a4c0ee9639] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:19:19.011461 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6c457f66-f854-4e2a-bd6b-f7b85294e6da tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:19.013360 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6c457f66-f854-4e2a-bd6b-f7b85294e6da tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:19.016547 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6c457f66-f854-4e2a-bd6b-f7b85294e6da tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:19.018922 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6c457f66-f854-4e2a-bd6b-f7b85294e6da tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:19.020995 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6c457f66-f854-4e2a-bd6b-f7b85294e6da tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:19.022813 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6c457f66-f854-4e2a-bd6b-f7b85294e6da tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:19.387841 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-6c457f66-f854-4e2a-bd6b-f7b85294e6da tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ac78e2767c49168f0464acea155be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286d184163154f2e846d521d368e3ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:19:19.397245 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-6c457f66-f854-4e2a-bd6b-f7b85294e6da tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] 10.222.0.43 "GET /compute/v2.1/servers/8d50022d-6b2c-4959-a038-e4a4c0ee9639" status: 200 len: 1375 microversion: 2.1 time: 0.440761 Oct 04 22:19:19.400740 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2886/5836] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:19:18 2022] GET /compute/v2.1/servers/8d50022d-6b2c-4959-a038-e4a4c0ee9639 => generated 1375 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:19:19.435462 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-fe7d5134-8968-4eaf-b6a2-9085253abd34 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1388194619", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7a9fd63d-da82-432b-98f7-d282671f9ebe"}], "security_groups": [{"name": "tempest-securitygroup--1271351081"}], "key_name": "tempest-keypair-438545507", "user_data": "}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:19:19.617900 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.network.neutron [None req-fe7d5134-8968-4eaf-b6a2-9085253abd34 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] validate_networks() for [('7a9fd63d-da82-432b-98f7-d282671f9ebe', None, None, None, None, None)] {{(pid=134101) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 22:19:20.170848 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-fe7d5134-8968-4eaf-b6a2-9085253abd34 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Flavor limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 22:19:20.171295 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-fe7d5134-8968-4eaf-b6a2-9085253abd34 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Image limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 22:19:20.171800 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-fe7d5134-8968-4eaf-b6a2-9085253abd34 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Flavor pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 22:19:20.172228 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-fe7d5134-8968-4eaf-b6a2-9085253abd34 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Image pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 22:19:20.172819 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-fe7d5134-8968-4eaf-b6a2-9085253abd34 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 22:19:20.188209 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fe7d5134-8968-4eaf-b6a2-9085253abd34 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:20.188714 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fe7d5134-8968-4eaf-b6a2-9085253abd34 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:20.189167 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fe7d5134-8968-4eaf-b6a2-9085253abd34 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:20.190947 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fe7d5134-8968-4eaf-b6a2-9085253abd34 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:20.191452 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fe7d5134-8968-4eaf-b6a2-9085253abd34 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:20.192010 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fe7d5134-8968-4eaf-b6a2-9085253abd34 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:20.219039 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-fe7d5134-8968-4eaf-b6a2-9085253abd34 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Getting quotas for project be71413506154420869fdff5939fb940. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:19:20.230226 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-fe7d5134-8968-4eaf-b6a2-9085253abd34 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Getting quotas for user ca6cfeabf8d84b2893200c3c54c1c19f and project be71413506154420869fdff5939fb940. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:19:20.253736 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-fe7d5134-8968-4eaf-b6a2-9085253abd34 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Going to run 1 instances... {{(pid=134101) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 22:19:20.257275 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-fe7d5134-8968-4eaf-b6a2-9085253abd34 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] [instance: 317528e8-218a-462c-93a1-0e56caf0ea3b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='58548514-5dac-426c-81f5-19e3fba33e23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134101) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 22:19:20.348868 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-fe7d5134-8968-4eaf-b6a2-9085253abd34 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.917694 Oct 04 22:19:20.350285 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2887/5837] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 22:19:19 2022] POST /compute/v2.1/servers => generated 409 bytes in 920 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 22:19:20.362712 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-cefe2990-a2df-4f23-87e8-c90f8ced92e0 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:19:20.363506 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-cefe2990-a2df-4f23-87e8-c90f8ced92e0 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] [instance: 317528e8-218a-462c-93a1-0e56caf0ea3b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:19:20.439205 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-cefe2990-a2df-4f23-87e8-c90f8ced92e0 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6cfeabf8d84b2893200c3c54c1c19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be71413506154420869fdff5939fb940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:19:20.447819 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-cefe2990-a2df-4f23-87e8-c90f8ced92e0 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] 10.222.0.43 "GET /compute/v2.1/servers/317528e8-218a-462c-93a1-0e56caf0ea3b" status: 200 len: 1245 microversion: 2.1 time: 0.089481 Oct 04 22:19:20.448488 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2888/5838] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:19:20 2022] GET /compute/v2.1/servers/317528e8-218a-462c-93a1-0e56caf0ea3b => generated 1245 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:19:20.453111 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-3cb7254d-4cff-459b-8c76-cfb0560fac15 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:19:20.453728 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-3cb7254d-4cff-459b-8c76-cfb0560fac15 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] [instance: 8d50022d-6b2c-4959-a038-e4a4c0ee9639] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:19:20.460019 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3cb7254d-4cff-459b-8c76-cfb0560fac15 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:20.460510 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3cb7254d-4cff-459b-8c76-cfb0560fac15 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:20.461328 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3cb7254d-4cff-459b-8c76-cfb0560fac15 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:20.461645 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3cb7254d-4cff-459b-8c76-cfb0560fac15 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:20.462095 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3cb7254d-4cff-459b-8c76-cfb0560fac15 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:20.462565 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3cb7254d-4cff-459b-8c76-cfb0560fac15 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:20.632284 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-3cb7254d-4cff-459b-8c76-cfb0560fac15 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ac78e2767c49168f0464acea155be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286d184163154f2e846d521d368e3ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:19:20.644313 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-3cb7254d-4cff-459b-8c76-cfb0560fac15 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] 10.222.0.43 "GET /compute/v2.1/servers/8d50022d-6b2c-4959-a038-e4a4c0ee9639" status: 200 len: 1375 microversion: 2.1 time: 0.194566 Oct 04 22:19:20.645083 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2889/5839] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:19:20 2022] GET /compute/v2.1/servers/8d50022d-6b2c-4959-a038-e4a4c0ee9639 => generated 1375 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:19:21.314082 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=7 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:19:21.396618 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=1 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:19:21.474517 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-0eb751bb-9e32-419c-bdb3-c97be22291ff tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:19:21.475162 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-0eb751bb-9e32-419c-bdb3-c97be22291ff tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] [instance: 317528e8-218a-462c-93a1-0e56caf0ea3b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:19:21.482158 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0eb751bb-9e32-419c-bdb3-c97be22291ff tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:21.483138 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0eb751bb-9e32-419c-bdb3-c97be22291ff tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:21.483597 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0eb751bb-9e32-419c-bdb3-c97be22291ff tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:21.484336 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0eb751bb-9e32-419c-bdb3-c97be22291ff tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:21.484808 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0eb751bb-9e32-419c-bdb3-c97be22291ff tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:21.485248 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0eb751bb-9e32-419c-bdb3-c97be22291ff tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:21.565846 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-0eb751bb-9e32-419c-bdb3-c97be22291ff tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6cfeabf8d84b2893200c3c54c1c19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be71413506154420869fdff5939fb940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:19:21.577579 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-0eb751bb-9e32-419c-bdb3-c97be22291ff tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] 10.222.0.43 "GET /compute/v2.1/servers/317528e8-218a-462c-93a1-0e56caf0ea3b" status: 200 len: 1297 microversion: 2.1 time: 0.108119 Oct 04 22:19:21.583938 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2890/5840] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:19:21 2022] GET /compute/v2.1/servers/317528e8-218a-462c-93a1-0e56caf0ea3b => generated 1297 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:19:21.669648 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-916b8ace-abc2-4ab6-908e-c86bb3404b39 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:19:21.673393 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-916b8ace-abc2-4ab6-908e-c86bb3404b39 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] [instance: 8d50022d-6b2c-4959-a038-e4a4c0ee9639] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:19:21.685412 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-916b8ace-abc2-4ab6-908e-c86bb3404b39 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:21.687273 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-916b8ace-abc2-4ab6-908e-c86bb3404b39 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:21.688308 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-916b8ace-abc2-4ab6-908e-c86bb3404b39 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:21.689313 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-916b8ace-abc2-4ab6-908e-c86bb3404b39 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:21.690055 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-916b8ace-abc2-4ab6-908e-c86bb3404b39 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:21.690747 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-916b8ace-abc2-4ab6-908e-c86bb3404b39 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:21.879324 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-916b8ace-abc2-4ab6-908e-c86bb3404b39 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ac78e2767c49168f0464acea155be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286d184163154f2e846d521d368e3ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:19:21.891247 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-916b8ace-abc2-4ab6-908e-c86bb3404b39 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] 10.222.0.43 "GET /compute/v2.1/servers/8d50022d-6b2c-4959-a038-e4a4c0ee9639" status: 200 len: 1375 microversion: 2.1 time: 0.225912 Oct 04 22:19:21.907457 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2891/5841] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:19:21 2022] GET /compute/v2.1/servers/8d50022d-6b2c-4959-a038-e4a4c0ee9639 => generated 1375 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:19:22.603689 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-1cbc15b4-3501-4332-ac88-3a9f7d35348f tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:19:22.605307 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-1cbc15b4-3501-4332-ac88-3a9f7d35348f tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] [instance: 317528e8-218a-462c-93a1-0e56caf0ea3b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:19:22.612804 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1cbc15b4-3501-4332-ac88-3a9f7d35348f tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:22.613689 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1cbc15b4-3501-4332-ac88-3a9f7d35348f tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:22.615007 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1cbc15b4-3501-4332-ac88-3a9f7d35348f tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:22.616153 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1cbc15b4-3501-4332-ac88-3a9f7d35348f tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:22.616963 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1cbc15b4-3501-4332-ac88-3a9f7d35348f tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:22.617636 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1cbc15b4-3501-4332-ac88-3a9f7d35348f tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:22.699618 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-1cbc15b4-3501-4332-ac88-3a9f7d35348f tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6cfeabf8d84b2893200c3c54c1c19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be71413506154420869fdff5939fb940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:19:22.713415 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-1cbc15b4-3501-4332-ac88-3a9f7d35348f tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] 10.222.0.43 "GET /compute/v2.1/servers/317528e8-218a-462c-93a1-0e56caf0ea3b" status: 200 len: 1303 microversion: 2.1 time: 0.114542 Oct 04 22:19:22.727572 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2892/5842] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:19:22 2022] GET /compute/v2.1/servers/317528e8-218a-462c-93a1-0e56caf0ea3b => generated 1303 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:19:22.918127 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-51961fde-4a5c-4058-8e25-7af4262687ed tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:19:22.919062 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-51961fde-4a5c-4058-8e25-7af4262687ed tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] [instance: 8d50022d-6b2c-4959-a038-e4a4c0ee9639] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:19:22.932010 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-51961fde-4a5c-4058-8e25-7af4262687ed tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:22.933584 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-51961fde-4a5c-4058-8e25-7af4262687ed tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:22.936280 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-51961fde-4a5c-4058-8e25-7af4262687ed tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:22.938132 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-51961fde-4a5c-4058-8e25-7af4262687ed tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:22.939087 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-51961fde-4a5c-4058-8e25-7af4262687ed tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:22.940524 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-51961fde-4a5c-4058-8e25-7af4262687ed tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:23.234216 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-51961fde-4a5c-4058-8e25-7af4262687ed tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ac78e2767c49168f0464acea155be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286d184163154f2e846d521d368e3ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:19:23.247533 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-51961fde-4a5c-4058-8e25-7af4262687ed tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] 10.222.0.43 "GET /compute/v2.1/servers/8d50022d-6b2c-4959-a038-e4a4c0ee9639" status: 200 len: 1375 microversion: 2.1 time: 0.334097 Oct 04 22:19:23.249154 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2893/5843] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:19:22 2022] GET /compute/v2.1/servers/8d50022d-6b2c-4959-a038-e4a4c0ee9639 => generated 1375 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:19:23.741108 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-60c96c0c-d665-46e3-99ae-500ef9e5cd2d tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:19:23.741875 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-60c96c0c-d665-46e3-99ae-500ef9e5cd2d tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] [instance: 317528e8-218a-462c-93a1-0e56caf0ea3b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:19:23.756617 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-60c96c0c-d665-46e3-99ae-500ef9e5cd2d tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:23.766551 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-60c96c0c-d665-46e3-99ae-500ef9e5cd2d tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:23.767023 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-60c96c0c-d665-46e3-99ae-500ef9e5cd2d tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:23.767802 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-60c96c0c-d665-46e3-99ae-500ef9e5cd2d tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:23.768290 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-60c96c0c-d665-46e3-99ae-500ef9e5cd2d tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:23.768711 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-60c96c0c-d665-46e3-99ae-500ef9e5cd2d tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:24.014993 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-60c96c0c-d665-46e3-99ae-500ef9e5cd2d tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6cfeabf8d84b2893200c3c54c1c19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be71413506154420869fdff5939fb940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:19:24.024832 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-60c96c0c-d665-46e3-99ae-500ef9e5cd2d tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] 10.222.0.43 "GET /compute/v2.1/servers/317528e8-218a-462c-93a1-0e56caf0ea3b" status: 200 len: 1371 microversion: 2.1 time: 0.289615 Oct 04 22:19:24.026139 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2894/5844] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:19:23 2022] GET /compute/v2.1/servers/317528e8-218a-462c-93a1-0e56caf0ea3b => generated 1371 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:19:24.273011 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-61f25531-6562-47d3-aeae-25cf24111054 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:19:24.274031 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-61f25531-6562-47d3-aeae-25cf24111054 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] [instance: 8d50022d-6b2c-4959-a038-e4a4c0ee9639] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:19:24.280907 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-61f25531-6562-47d3-aeae-25cf24111054 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:24.281766 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-61f25531-6562-47d3-aeae-25cf24111054 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:24.282520 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-61f25531-6562-47d3-aeae-25cf24111054 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:24.283512 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-61f25531-6562-47d3-aeae-25cf24111054 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:24.284230 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-61f25531-6562-47d3-aeae-25cf24111054 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:24.284893 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-61f25531-6562-47d3-aeae-25cf24111054 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:24.438495 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-61f25531-6562-47d3-aeae-25cf24111054 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ac78e2767c49168f0464acea155be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286d184163154f2e846d521d368e3ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:19:24.447454 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-61f25531-6562-47d3-aeae-25cf24111054 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] 10.222.0.43 "GET /compute/v2.1/servers/8d50022d-6b2c-4959-a038-e4a4c0ee9639" status: 200 len: 1375 microversion: 2.1 time: 0.178762 Oct 04 22:19:24.450047 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2895/5845] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:19:24 2022] GET /compute/v2.1/servers/8d50022d-6b2c-4959-a038-e4a4c0ee9639 => generated 1375 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:19:24.503114 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-1a6e8c11-7be1-4a89-95e4-ed85c71e4a65 req-7b385d2d-2e5a-4ebe-b07f-4bd719f99d48 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "317528e8-218a-462c-93a1-0e56caf0ea3b", "tag": "812694ba-e03a-4b71-918e-d542d921b653"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:19:24.519763 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-1a6e8c11-7be1-4a89-95e4-ed85c71e4a65 req-7b385d2d-2e5a-4ebe-b07f-4bd719f99d48 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:24.520734 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-1a6e8c11-7be1-4a89-95e4-ed85c71e4a65 req-7b385d2d-2e5a-4ebe-b07f-4bd719f99d48 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:24.522552 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-1a6e8c11-7be1-4a89-95e4-ed85c71e4a65 req-7b385d2d-2e5a-4ebe-b07f-4bd719f99d48 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:24.555750 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-1a6e8c11-7be1-4a89-95e4-ed85c71e4a65 req-7b385d2d-2e5a-4ebe-b07f-4bd719f99d48 service nova] Creating event network-changed:812694ba-e03a-4b71-918e-d542d921b653 for instance 317528e8-218a-462c-93a1-0e56caf0ea3b on n-h1-860284-1 Oct 04 22:19:24.569413 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-1a6e8c11-7be1-4a89-95e4-ed85c71e4a65 req-7b385d2d-2e5a-4ebe-b07f-4bd719f99d48 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070681 Oct 04 22:19:24.570445 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2896/5846] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:19:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:19:25.050169 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-588e5bf3-1533-4af1-b683-0a7876fe87f2 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:19:25.051178 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-588e5bf3-1533-4af1-b683-0a7876fe87f2 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] [instance: 317528e8-218a-462c-93a1-0e56caf0ea3b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:19:25.058423 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-588e5bf3-1533-4af1-b683-0a7876fe87f2 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:25.059258 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-588e5bf3-1533-4af1-b683-0a7876fe87f2 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:25.060063 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-588e5bf3-1533-4af1-b683-0a7876fe87f2 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:25.061045 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-588e5bf3-1533-4af1-b683-0a7876fe87f2 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:25.061745 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-588e5bf3-1533-4af1-b683-0a7876fe87f2 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:25.062454 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-588e5bf3-1533-4af1-b683-0a7876fe87f2 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:25.242578 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-588e5bf3-1533-4af1-b683-0a7876fe87f2 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6cfeabf8d84b2893200c3c54c1c19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be71413506154420869fdff5939fb940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:19:25.252528 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-588e5bf3-1533-4af1-b683-0a7876fe87f2 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] 10.222.0.43 "GET /compute/v2.1/servers/317528e8-218a-462c-93a1-0e56caf0ea3b" status: 200 len: 1371 microversion: 2.1 time: 0.207471 Oct 04 22:19:25.262472 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2897/5847] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:19:25 2022] GET /compute/v2.1/servers/317528e8-218a-462c-93a1-0e56caf0ea3b => generated 1371 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:19:25.262472 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-9c794b4a-5ee4-4f23-82ba-7e88a43d718a req-edbe8e46-5a8b-4d29-9623-43dc4b5462fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d50022d-6b2c-4959-a038-e4a4c0ee9639", "name": "network-vif-plugged", "status": "completed", "tag": "c21b6fdd-96b3-490d-a621-cced5b85c7d6"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:19:25.268714 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-9c794b4a-5ee4-4f23-82ba-7e88a43d718a req-edbe8e46-5a8b-4d29-9623-43dc4b5462fc service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:25.269350 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-9c794b4a-5ee4-4f23-82ba-7e88a43d718a req-edbe8e46-5a8b-4d29-9623-43dc4b5462fc service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:25.269896 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-9c794b4a-5ee4-4f23-82ba-7e88a43d718a req-edbe8e46-5a8b-4d29-9623-43dc4b5462fc service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:25.283035 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-9c794b4a-5ee4-4f23-82ba-7e88a43d718a req-edbe8e46-5a8b-4d29-9623-43dc4b5462fc service nova] Creating event network-vif-plugged:c21b6fdd-96b3-490d-a621-cced5b85c7d6 for instance 8d50022d-6b2c-4959-a038-e4a4c0ee9639 on n-h2-860284-1 Oct 04 22:19:25.288995 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-9c794b4a-5ee4-4f23-82ba-7e88a43d718a req-edbe8e46-5a8b-4d29-9623-43dc4b5462fc service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034078 Oct 04 22:19:25.289719 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2898/5848] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:19:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:19:25.475543 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-8c5d9ef4-2935-4795-9bf0-5e9fbcc96e7d tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:19:25.476781 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-8c5d9ef4-2935-4795-9bf0-5e9fbcc96e7d tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] [instance: 8d50022d-6b2c-4959-a038-e4a4c0ee9639] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:19:25.484529 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8c5d9ef4-2935-4795-9bf0-5e9fbcc96e7d tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:25.485406 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8c5d9ef4-2935-4795-9bf0-5e9fbcc96e7d tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:25.486194 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8c5d9ef4-2935-4795-9bf0-5e9fbcc96e7d tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:25.487174 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8c5d9ef4-2935-4795-9bf0-5e9fbcc96e7d tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:25.487880 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8c5d9ef4-2935-4795-9bf0-5e9fbcc96e7d tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:25.488724 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8c5d9ef4-2935-4795-9bf0-5e9fbcc96e7d tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:25.653190 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-8c5d9ef4-2935-4795-9bf0-5e9fbcc96e7d tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ac78e2767c49168f0464acea155be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286d184163154f2e846d521d368e3ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:19:25.663668 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-8c5d9ef4-2935-4795-9bf0-5e9fbcc96e7d tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] 10.222.0.43 "GET /compute/v2.1/servers/8d50022d-6b2c-4959-a038-e4a4c0ee9639" status: 200 len: 1375 microversion: 2.1 time: 0.193947 Oct 04 22:19:25.664448 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2899/5849] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:19:25 2022] GET /compute/v2.1/servers/8d50022d-6b2c-4959-a038-e4a4c0ee9639 => generated 1375 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:19:26.275473 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-5bfa1a1a-6bb4-4267-b774-f41127ed6371 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:19:26.276930 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-5bfa1a1a-6bb4-4267-b774-f41127ed6371 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] [instance: 317528e8-218a-462c-93a1-0e56caf0ea3b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:19:26.285456 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5bfa1a1a-6bb4-4267-b774-f41127ed6371 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:26.286802 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5bfa1a1a-6bb4-4267-b774-f41127ed6371 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:26.287576 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5bfa1a1a-6bb4-4267-b774-f41127ed6371 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:26.288599 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5bfa1a1a-6bb4-4267-b774-f41127ed6371 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:26.289312 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5bfa1a1a-6bb4-4267-b774-f41127ed6371 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:26.289979 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5bfa1a1a-6bb4-4267-b774-f41127ed6371 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:26.295062 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=100 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:19:26.464018 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-5bfa1a1a-6bb4-4267-b774-f41127ed6371 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6cfeabf8d84b2893200c3c54c1c19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be71413506154420869fdff5939fb940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:19:26.472393 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-5bfa1a1a-6bb4-4267-b774-f41127ed6371 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] 10.222.0.43 "GET /compute/v2.1/servers/317528e8-218a-462c-93a1-0e56caf0ea3b" status: 200 len: 1371 microversion: 2.1 time: 0.200362 Oct 04 22:19:26.479886 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2900/5850] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:19:26 2022] GET /compute/v2.1/servers/317528e8-218a-462c-93a1-0e56caf0ea3b => generated 1371 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:19:26.687459 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-b65bbf80-6992-4564-bf10-1f92eadaba45 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:19:26.688348 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-b65bbf80-6992-4564-bf10-1f92eadaba45 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] [instance: 8d50022d-6b2c-4959-a038-e4a4c0ee9639] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:19:26.695862 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b65bbf80-6992-4564-bf10-1f92eadaba45 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:26.696599 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b65bbf80-6992-4564-bf10-1f92eadaba45 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:26.697551 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b65bbf80-6992-4564-bf10-1f92eadaba45 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:26.698490 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b65bbf80-6992-4564-bf10-1f92eadaba45 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:26.699241 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b65bbf80-6992-4564-bf10-1f92eadaba45 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:26.700065 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b65bbf80-6992-4564-bf10-1f92eadaba45 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:26.929771 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-b65bbf80-6992-4564-bf10-1f92eadaba45 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ac78e2767c49168f0464acea155be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286d184163154f2e846d521d368e3ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:19:26.944020 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-b65bbf80-6992-4564-bf10-1f92eadaba45 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] 10.222.0.43 "GET /compute/v2.1/servers/8d50022d-6b2c-4959-a038-e4a4c0ee9639" status: 200 len: 1375 microversion: 2.1 time: 0.260527 Oct 04 22:19:26.962953 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2901/5851] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:19:26 2022] GET /compute/v2.1/servers/8d50022d-6b2c-4959-a038-e4a4c0ee9639 => generated 1375 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:19:27.496989 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-9865e7f8-ef9b-48d0-a074-3c64d1635d7c tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:19:27.497623 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-9865e7f8-ef9b-48d0-a074-3c64d1635d7c tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] [instance: 317528e8-218a-462c-93a1-0e56caf0ea3b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:19:27.517124 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9865e7f8-ef9b-48d0-a074-3c64d1635d7c tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:27.518291 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9865e7f8-ef9b-48d0-a074-3c64d1635d7c tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:27.518991 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9865e7f8-ef9b-48d0-a074-3c64d1635d7c tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:27.522029 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9865e7f8-ef9b-48d0-a074-3c64d1635d7c tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:27.523110 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9865e7f8-ef9b-48d0-a074-3c64d1635d7c tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:27.524205 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9865e7f8-ef9b-48d0-a074-3c64d1635d7c tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:27.709417 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-9865e7f8-ef9b-48d0-a074-3c64d1635d7c tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6cfeabf8d84b2893200c3c54c1c19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be71413506154420869fdff5939fb940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:19:27.719506 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-9865e7f8-ef9b-48d0-a074-3c64d1635d7c tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] 10.222.0.43 "GET /compute/v2.1/servers/317528e8-218a-462c-93a1-0e56caf0ea3b" status: 200 len: 1371 microversion: 2.1 time: 0.226748 Oct 04 22:19:27.731140 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2902/5852] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:19:27 2022] GET /compute/v2.1/servers/317528e8-218a-462c-93a1-0e56caf0ea3b => generated 1371 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:19:27.971375 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-ebf81c80-036e-4503-8400-d9fedac1bd30 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:19:27.971994 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-ebf81c80-036e-4503-8400-d9fedac1bd30 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] [instance: 8d50022d-6b2c-4959-a038-e4a4c0ee9639] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:19:27.978649 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ebf81c80-036e-4503-8400-d9fedac1bd30 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:27.979388 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ebf81c80-036e-4503-8400-d9fedac1bd30 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:27.980008 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ebf81c80-036e-4503-8400-d9fedac1bd30 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:27.980896 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ebf81c80-036e-4503-8400-d9fedac1bd30 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:27.981514 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ebf81c80-036e-4503-8400-d9fedac1bd30 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:27.982104 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ebf81c80-036e-4503-8400-d9fedac1bd30 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:28.139981 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-ebf81c80-036e-4503-8400-d9fedac1bd30 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ac78e2767c49168f0464acea155be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286d184163154f2e846d521d368e3ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:19:28.150623 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-ebf81c80-036e-4503-8400-d9fedac1bd30 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] 10.222.0.43 "GET /compute/v2.1/servers/8d50022d-6b2c-4959-a038-e4a4c0ee9639" status: 200 len: 1547 microversion: 2.1 time: 0.182969 Oct 04 22:19:28.151470 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2903/5853] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:19:27 2022] GET /compute/v2.1/servers/8d50022d-6b2c-4959-a038-e4a4c0ee9639 => generated 1547 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:19:28.178149 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-dfe72914-6136-44fd-9eda-72ab1ce397f4 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:19:28.178968 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-dfe72914-6136-44fd-9eda-72ab1ce397f4 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] [instance: 8d50022d-6b2c-4959-a038-e4a4c0ee9639] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:19:28.188764 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dfe72914-6136-44fd-9eda-72ab1ce397f4 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:28.189263 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dfe72914-6136-44fd-9eda-72ab1ce397f4 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:28.189701 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dfe72914-6136-44fd-9eda-72ab1ce397f4 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:28.190441 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dfe72914-6136-44fd-9eda-72ab1ce397f4 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:28.191104 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dfe72914-6136-44fd-9eda-72ab1ce397f4 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:28.192347 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dfe72914-6136-44fd-9eda-72ab1ce397f4 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:28.347400 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-dfe72914-6136-44fd-9eda-72ab1ce397f4 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ac78e2767c49168f0464acea155be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286d184163154f2e846d521d368e3ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:19:28.357882 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-dfe72914-6136-44fd-9eda-72ab1ce397f4 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] 10.222.0.43 "GET /compute/v2.1/servers/8d50022d-6b2c-4959-a038-e4a4c0ee9639" status: 200 len: 1547 microversion: 2.1 time: 0.184222 Oct 04 22:19:28.358805 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2904/5854] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:19:28 2022] GET /compute/v2.1/servers/8d50022d-6b2c-4959-a038-e4a4c0ee9639 => generated 1547 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:19:28.752499 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-1d9dce35-3e29-44cd-8bc6-81724064bbc5 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:19:28.753605 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-1d9dce35-3e29-44cd-8bc6-81724064bbc5 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] [instance: 317528e8-218a-462c-93a1-0e56caf0ea3b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:19:28.765828 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1d9dce35-3e29-44cd-8bc6-81724064bbc5 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:28.766193 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1d9dce35-3e29-44cd-8bc6-81724064bbc5 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:28.766842 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1d9dce35-3e29-44cd-8bc6-81724064bbc5 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:28.767666 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1d9dce35-3e29-44cd-8bc6-81724064bbc5 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:28.768016 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1d9dce35-3e29-44cd-8bc6-81724064bbc5 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:28.768648 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1d9dce35-3e29-44cd-8bc6-81724064bbc5 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:28.977041 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-1d9dce35-3e29-44cd-8bc6-81724064bbc5 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6cfeabf8d84b2893200c3c54c1c19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be71413506154420869fdff5939fb940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:19:28.985996 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-1d9dce35-3e29-44cd-8bc6-81724064bbc5 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] 10.222.0.43 "GET /compute/v2.1/servers/317528e8-218a-462c-93a1-0e56caf0ea3b" status: 200 len: 1371 microversion: 2.1 time: 0.244228 Oct 04 22:19:28.986982 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2905/5855] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:19:28 2022] GET /compute/v2.1/servers/317528e8-218a-462c-93a1-0e56caf0ea3b => generated 1371 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:19:30.011854 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-18d9af7b-0ffa-410c-bb34-4296274603f8 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:19:30.012654 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-18d9af7b-0ffa-410c-bb34-4296274603f8 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] [instance: 317528e8-218a-462c-93a1-0e56caf0ea3b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:19:30.018748 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:19:30.021946 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-18d9af7b-0ffa-410c-bb34-4296274603f8 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:30.022582 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-18d9af7b-0ffa-410c-bb34-4296274603f8 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:30.023510 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-18d9af7b-0ffa-410c-bb34-4296274603f8 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:30.024452 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-18d9af7b-0ffa-410c-bb34-4296274603f8 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:30.025130 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-18d9af7b-0ffa-410c-bb34-4296274603f8 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:30.025577 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-18d9af7b-0ffa-410c-bb34-4296274603f8 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:30.210981 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=4 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:19:30.229607 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-18d9af7b-0ffa-410c-bb34-4296274603f8 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6cfeabf8d84b2893200c3c54c1c19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be71413506154420869fdff5939fb940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:19:30.238815 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-18d9af7b-0ffa-410c-bb34-4296274603f8 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] 10.222.0.43 "GET /compute/v2.1/servers/317528e8-218a-462c-93a1-0e56caf0ea3b" status: 200 len: 1371 microversion: 2.1 time: 0.232556 Oct 04 22:19:30.239563 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2906/5856] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:19:30 2022] GET /compute/v2.1/servers/317528e8-218a-462c-93a1-0e56caf0ea3b => generated 1371 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:19:31.265870 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-fbc77f0c-ab8a-450c-acab-cb1ee006c01b tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:19:31.269653 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-fbc77f0c-ab8a-450c-acab-cb1ee006c01b tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] [instance: 317528e8-218a-462c-93a1-0e56caf0ea3b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:19:31.288699 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=20 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:19:31.293825 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fbc77f0c-ab8a-450c-acab-cb1ee006c01b tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:31.295413 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fbc77f0c-ab8a-450c-acab-cb1ee006c01b tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:31.295885 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fbc77f0c-ab8a-450c-acab-cb1ee006c01b tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:31.296632 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fbc77f0c-ab8a-450c-acab-cb1ee006c01b tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:31.297161 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fbc77f0c-ab8a-450c-acab-cb1ee006c01b tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:31.298037 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fbc77f0c-ab8a-450c-acab-cb1ee006c01b tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:31.499876 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-fbc77f0c-ab8a-450c-acab-cb1ee006c01b tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6cfeabf8d84b2893200c3c54c1c19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be71413506154420869fdff5939fb940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:19:31.512035 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-fbc77f0c-ab8a-450c-acab-cb1ee006c01b tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] 10.222.0.43 "GET /compute/v2.1/servers/317528e8-218a-462c-93a1-0e56caf0ea3b" status: 200 len: 1371 microversion: 2.1 time: 0.251627 Oct 04 22:19:31.514964 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2907/5857] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:19:31 2022] GET /compute/v2.1/servers/317528e8-218a-462c-93a1-0e56caf0ea3b => generated 1371 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:19:31.713169 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-db485ac9-8cc4-44b9-ae0a-2fdcd2f48a43 req-36b7d17a-86cf-4ff5-b937-f44ba80d6549 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "317528e8-218a-462c-93a1-0e56caf0ea3b", "name": "network-vif-plugged", "status": "completed", "tag": "812694ba-e03a-4b71-918e-d542d921b653"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:19:31.734897 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-db485ac9-8cc4-44b9-ae0a-2fdcd2f48a43 req-36b7d17a-86cf-4ff5-b937-f44ba80d6549 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:31.736179 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-db485ac9-8cc4-44b9-ae0a-2fdcd2f48a43 req-36b7d17a-86cf-4ff5-b937-f44ba80d6549 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:31.739189 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-db485ac9-8cc4-44b9-ae0a-2fdcd2f48a43 req-36b7d17a-86cf-4ff5-b937-f44ba80d6549 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:31.771363 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-db485ac9-8cc4-44b9-ae0a-2fdcd2f48a43 req-36b7d17a-86cf-4ff5-b937-f44ba80d6549 service nova] Creating event network-vif-plugged:812694ba-e03a-4b71-918e-d542d921b653 for instance 317528e8-218a-462c-93a1-0e56caf0ea3b on n-h1-860284-1 Oct 04 22:19:31.792156 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-db485ac9-8cc4-44b9-ae0a-2fdcd2f48a43 req-36b7d17a-86cf-4ff5-b937-f44ba80d6549 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083827 Oct 04 22:19:31.793046 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2908/5858] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:19:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:19:32.445736 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-f841762a-ab97-4b38-bf14-e4fd6ec9b187 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:19:32.449846 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-f841762a-ab97-4b38-bf14-e4fd6ec9b187 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] [instance: 01f84e19-7e4a-460a-bb60-5da518f3d8b1] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:19:32.480359 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f841762a-ab97-4b38-bf14-e4fd6ec9b187 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:32.482279 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f841762a-ab97-4b38-bf14-e4fd6ec9b187 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:32.483190 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f841762a-ab97-4b38-bf14-e4fd6ec9b187 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:32.484630 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f841762a-ab97-4b38-bf14-e4fd6ec9b187 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:32.486331 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f841762a-ab97-4b38-bf14-e4fd6ec9b187 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:32.489017 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f841762a-ab97-4b38-bf14-e4fd6ec9b187 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:32.529417 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-f841762a-ab97-4b38-bf14-e4fd6ec9b187 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] 10.222.0.43 "GET /compute/v2.1/servers/01f84e19-7e4a-460a-bb60-5da518f3d8b1/ips" status: 200 len: 147 microversion: 2.1 time: 0.092511 Oct 04 22:19:32.537021 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2909/5859] 10.222.0.43 () {58 vars in 1248 bytes} [Tue Oct 4 22:19:32 2022] GET /compute/v2.1/servers/01f84e19-7e4a-460a-bb60-5da518f3d8b1/ips => generated 147 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:19:32.547622 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-f60ff366-d5f4-4beb-81c0-ac885e76cc6c tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:19:32.553055 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-f60ff366-d5f4-4beb-81c0-ac885e76cc6c tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] [instance: 317528e8-218a-462c-93a1-0e56caf0ea3b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:19:32.572131 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f60ff366-d5f4-4beb-81c0-ac885e76cc6c tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:32.576120 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f60ff366-d5f4-4beb-81c0-ac885e76cc6c tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:32.577555 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f60ff366-d5f4-4beb-81c0-ac885e76cc6c tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:32.579272 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f60ff366-d5f4-4beb-81c0-ac885e76cc6c tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:32.581477 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f60ff366-d5f4-4beb-81c0-ac885e76cc6c tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:32.582841 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f60ff366-d5f4-4beb-81c0-ac885e76cc6c tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:32.788777 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-f60ff366-d5f4-4beb-81c0-ac885e76cc6c tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6cfeabf8d84b2893200c3c54c1c19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be71413506154420869fdff5939fb940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:19:32.797587 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-f60ff366-d5f4-4beb-81c0-ac885e76cc6c tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] 10.222.0.43 "GET /compute/v2.1/servers/317528e8-218a-462c-93a1-0e56caf0ea3b" status: 200 len: 1371 microversion: 2.1 time: 0.258917 Oct 04 22:19:32.799010 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2910/5860] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:19:32 2022] GET /compute/v2.1/servers/317528e8-218a-462c-93a1-0e56caf0ea3b => generated 1371 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:19:33.821681 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-6be8ce97-d0bd-487b-b9da-2d3150da504f tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:19:33.822382 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-6be8ce97-d0bd-487b-b9da-2d3150da504f tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] [instance: 317528e8-218a-462c-93a1-0e56caf0ea3b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:19:33.834234 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6be8ce97-d0bd-487b-b9da-2d3150da504f tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:33.834595 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6be8ce97-d0bd-487b-b9da-2d3150da504f tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:33.835126 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6be8ce97-d0bd-487b-b9da-2d3150da504f tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:33.835891 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6be8ce97-d0bd-487b-b9da-2d3150da504f tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:33.836418 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6be8ce97-d0bd-487b-b9da-2d3150da504f tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:33.837099 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6be8ce97-d0bd-487b-b9da-2d3150da504f tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:34.022463 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-6be8ce97-d0bd-487b-b9da-2d3150da504f tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6cfeabf8d84b2893200c3c54c1c19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be71413506154420869fdff5939fb940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:19:34.033177 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-6be8ce97-d0bd-487b-b9da-2d3150da504f tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] 10.222.0.43 "GET /compute/v2.1/servers/317528e8-218a-462c-93a1-0e56caf0ea3b" status: 200 len: 1566 microversion: 2.1 time: 0.215977 Oct 04 22:19:34.034320 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2911/5861] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:19:33 2022] GET /compute/v2.1/servers/317528e8-218a-462c-93a1-0e56caf0ea3b => generated 1566 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:19:34.058762 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-b62aac83-ab1c-49da-ad93-4730cb1455e9 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:19:34.059644 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-b62aac83-ab1c-49da-ad93-4730cb1455e9 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] [instance: 317528e8-218a-462c-93a1-0e56caf0ea3b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:19:34.071259 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b62aac83-ab1c-49da-ad93-4730cb1455e9 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:34.074584 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b62aac83-ab1c-49da-ad93-4730cb1455e9 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:34.076031 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b62aac83-ab1c-49da-ad93-4730cb1455e9 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:34.077799 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b62aac83-ab1c-49da-ad93-4730cb1455e9 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:34.079985 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b62aac83-ab1c-49da-ad93-4730cb1455e9 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:34.081287 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b62aac83-ab1c-49da-ad93-4730cb1455e9 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:34.259638 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-b62aac83-ab1c-49da-ad93-4730cb1455e9 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] 10.222.0.43 "GET /compute/v2.1/servers/317528e8-218a-462c-93a1-0e56caf0ea3b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.205163 Oct 04 22:19:34.264797 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2912/5862] 10.222.0.43 () {58 vars in 1275 bytes} [Tue Oct 4 22:19:34 2022] GET /compute/v2.1/servers/317528e8-218a-462c-93a1-0e56caf0ea3b/os-interface => generated 285 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:19:35.759090 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-51d34d26-e79b-4cd8-a883-7ae79cd0ce04 req-81bcac5a-8435-4572-9a36-23b786aa1cb7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "317528e8-218a-462c-93a1-0e56caf0ea3b", "tag": "812694ba-e03a-4b71-918e-d542d921b653"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:19:35.778151 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-51d34d26-e79b-4cd8-a883-7ae79cd0ce04 req-81bcac5a-8435-4572-9a36-23b786aa1cb7 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:35.779661 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-51d34d26-e79b-4cd8-a883-7ae79cd0ce04 req-81bcac5a-8435-4572-9a36-23b786aa1cb7 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:35.782015 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-51d34d26-e79b-4cd8-a883-7ae79cd0ce04 req-81bcac5a-8435-4572-9a36-23b786aa1cb7 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:35.807079 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-51d34d26-e79b-4cd8-a883-7ae79cd0ce04 req-81bcac5a-8435-4572-9a36-23b786aa1cb7 service nova] Creating event network-changed:812694ba-e03a-4b71-918e-d542d921b653 for instance 317528e8-218a-462c-93a1-0e56caf0ea3b on n-h1-860284-1 Oct 04 22:19:35.816458 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-51d34d26-e79b-4cd8-a883-7ae79cd0ce04 req-81bcac5a-8435-4572-9a36-23b786aa1cb7 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061169 Oct 04 22:19:35.818121 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2913/5863] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:19:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:19:35.994523 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-9844dcc3-0553-48d0-9161-88f55971ab2d tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ed5f450e-aeb8-432e-ae1e-3a9c19e22930"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:19:35.997391 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-9844dcc3-0553-48d0-9161-88f55971ab2d tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] [instance: 01f84e19-7e4a-460a-bb60-5da518f3d8b1] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:19:36.015484 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9844dcc3-0553-48d0-9161-88f55971ab2d tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:36.015989 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9844dcc3-0553-48d0-9161-88f55971ab2d tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:36.016429 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9844dcc3-0553-48d0-9161-88f55971ab2d tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:36.017364 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9844dcc3-0553-48d0-9161-88f55971ab2d tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:36.022572 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9844dcc3-0553-48d0-9161-88f55971ab2d tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:36.023061 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9844dcc3-0553-48d0-9161-88f55971ab2d tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:36.428954 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-9844dcc3-0553-48d0-9161-88f55971ab2d tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] 10.222.0.43 "POST /compute/v2.1/servers/01f84e19-7e4a-460a-bb60-5da518f3d8b1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.439859 Oct 04 22:19:36.429889 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2914/5864] 10.222.0.43 () {60 vars in 1323 bytes} [Tue Oct 4 22:19:35 2022] POST /compute/v2.1/servers/01f84e19-7e4a-460a-bb60-5da518f3d8b1/os-volume_attachments => generated 194 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:19:50.620439 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=17 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:19:50.621642 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:19:50.626971 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-1fb71d00-718f-4004-a130-167b9fc509e9 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:19:50.636029 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1fb71d00-718f-4004-a130-167b9fc509e9 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:50.636537 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1fb71d00-718f-4004-a130-167b9fc509e9 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:50.636985 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1fb71d00-718f-4004-a130-167b9fc509e9 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:50.663208 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-1fb71d00-718f-4004-a130-167b9fc509e9 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] [instance: 01f84e19-7e4a-460a-bb60-5da518f3d8b1] Going to try to stop instance {{(pid=134101) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 04 22:19:50.721086 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-1fb71d00-718f-4004-a130-167b9fc509e9 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] 10.222.0.43 "POST /compute/v2.1/servers/01f84e19-7e4a-460a-bb60-5da518f3d8b1/action" status: 202 len: 0 microversion: 2.1 time: 0.102428 Oct 04 22:19:50.722024 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2915/5865] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 22:19:50 2022] POST /compute/v2.1/servers/01f84e19-7e4a-460a-bb60-5da518f3d8b1/action => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 22:19:50.731888 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-0d0a9ab3-5251-450b-8fec-a399b5b90cc7 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:19:50.733206 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-0d0a9ab3-5251-450b-8fec-a399b5b90cc7 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] [instance: 01f84e19-7e4a-460a-bb60-5da518f3d8b1] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:19:50.741509 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0d0a9ab3-5251-450b-8fec-a399b5b90cc7 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:50.741911 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0d0a9ab3-5251-450b-8fec-a399b5b90cc7 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:50.742325 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0d0a9ab3-5251-450b-8fec-a399b5b90cc7 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:50.743067 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0d0a9ab3-5251-450b-8fec-a399b5b90cc7 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:50.743527 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0d0a9ab3-5251-450b-8fec-a399b5b90cc7 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:50.743958 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0d0a9ab3-5251-450b-8fec-a399b5b90cc7 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:50.907526 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-0d0a9ab3-5251-450b-8fec-a399b5b90cc7 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '524ac46437134cd5a5000574631ea59a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b191bd428a4906b6c2781ae3efdaae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:19:50.917759 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-0d0a9ab3-5251-450b-8fec-a399b5b90cc7 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] 10.222.0.43 "GET /compute/v2.1/servers/01f84e19-7e4a-460a-bb60-5da518f3d8b1" status: 200 len: 1724 microversion: 2.1 time: 0.190549 Oct 04 22:19:50.926313 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2916/5866] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:19:50 2022] GET /compute/v2.1/servers/01f84e19-7e4a-460a-bb60-5da518f3d8b1 => generated 1724 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:19:51.941628 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-ce6d649b-d3cd-4386-a577-4710d8a966f4 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:19:51.942854 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-ce6d649b-d3cd-4386-a577-4710d8a966f4 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] [instance: 01f84e19-7e4a-460a-bb60-5da518f3d8b1] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:19:51.949974 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ce6d649b-d3cd-4386-a577-4710d8a966f4 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:51.950731 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ce6d649b-d3cd-4386-a577-4710d8a966f4 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:51.951366 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ce6d649b-d3cd-4386-a577-4710d8a966f4 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:51.952050 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ce6d649b-d3cd-4386-a577-4710d8a966f4 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:51.952684 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ce6d649b-d3cd-4386-a577-4710d8a966f4 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:51.953114 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ce6d649b-d3cd-4386-a577-4710d8a966f4 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:52.118833 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-ce6d649b-d3cd-4386-a577-4710d8a966f4 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '524ac46437134cd5a5000574631ea59a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b191bd428a4906b6c2781ae3efdaae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:19:52.128623 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-ce6d649b-d3cd-4386-a577-4710d8a966f4 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] 10.222.0.43 "GET /compute/v2.1/servers/01f84e19-7e4a-460a-bb60-5da518f3d8b1" status: 200 len: 1724 microversion: 2.1 time: 0.190977 Oct 04 22:19:52.130125 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2917/5867] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:19:51 2022] GET /compute/v2.1/servers/01f84e19-7e4a-460a-bb60-5da518f3d8b1 => generated 1724 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:19:53.153001 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-c8fea04e-6c4d-470e-89eb-26dacbd125bd tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:19:53.154463 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-c8fea04e-6c4d-470e-89eb-26dacbd125bd tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] [instance: 01f84e19-7e4a-460a-bb60-5da518f3d8b1] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:19:53.165170 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c8fea04e-6c4d-470e-89eb-26dacbd125bd tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:53.165874 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c8fea04e-6c4d-470e-89eb-26dacbd125bd tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:53.166688 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c8fea04e-6c4d-470e-89eb-26dacbd125bd tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:53.167635 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c8fea04e-6c4d-470e-89eb-26dacbd125bd tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:53.168486 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c8fea04e-6c4d-470e-89eb-26dacbd125bd tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:53.169129 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c8fea04e-6c4d-470e-89eb-26dacbd125bd tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:53.349354 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-c8fea04e-6c4d-470e-89eb-26dacbd125bd tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '524ac46437134cd5a5000574631ea59a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b191bd428a4906b6c2781ae3efdaae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:19:53.359520 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-c8fea04e-6c4d-470e-89eb-26dacbd125bd tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] 10.222.0.43 "GET /compute/v2.1/servers/01f84e19-7e4a-460a-bb60-5da518f3d8b1" status: 200 len: 1724 microversion: 2.1 time: 0.210758 Oct 04 22:19:53.360137 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2918/5868] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:19:53 2022] GET /compute/v2.1/servers/01f84e19-7e4a-460a-bb60-5da518f3d8b1 => generated 1724 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:19:54.383911 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-8416b441-3ecc-40f8-ad14-f00364b9f5c2 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:19:54.384603 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-8416b441-3ecc-40f8-ad14-f00364b9f5c2 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] [instance: 01f84e19-7e4a-460a-bb60-5da518f3d8b1] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:19:54.398250 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8416b441-3ecc-40f8-ad14-f00364b9f5c2 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:54.398825 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8416b441-3ecc-40f8-ad14-f00364b9f5c2 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:54.399272 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8416b441-3ecc-40f8-ad14-f00364b9f5c2 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:54.399973 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8416b441-3ecc-40f8-ad14-f00364b9f5c2 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:54.400624 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8416b441-3ecc-40f8-ad14-f00364b9f5c2 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:54.401064 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8416b441-3ecc-40f8-ad14-f00364b9f5c2 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:54.547679 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-8416b441-3ecc-40f8-ad14-f00364b9f5c2 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '524ac46437134cd5a5000574631ea59a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b191bd428a4906b6c2781ae3efdaae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:19:54.564631 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-8416b441-3ecc-40f8-ad14-f00364b9f5c2 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] 10.222.0.43 "GET /compute/v2.1/servers/01f84e19-7e4a-460a-bb60-5da518f3d8b1" status: 200 len: 1724 microversion: 2.1 time: 0.185362 Oct 04 22:19:54.565202 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2919/5869] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:19:54 2022] GET /compute/v2.1/servers/01f84e19-7e4a-460a-bb60-5da518f3d8b1 => generated 1724 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:19:55.590029 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-2938558e-6aff-412f-a2d8-97ea9cf68460 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:19:55.590681 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-2938558e-6aff-412f-a2d8-97ea9cf68460 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] [instance: 01f84e19-7e4a-460a-bb60-5da518f3d8b1] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:19:55.602176 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2938558e-6aff-412f-a2d8-97ea9cf68460 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:55.602779 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2938558e-6aff-412f-a2d8-97ea9cf68460 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:55.603664 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2938558e-6aff-412f-a2d8-97ea9cf68460 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:55.604609 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2938558e-6aff-412f-a2d8-97ea9cf68460 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:55.605367 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2938558e-6aff-412f-a2d8-97ea9cf68460 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:55.606033 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2938558e-6aff-412f-a2d8-97ea9cf68460 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:55.752474 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-2938558e-6aff-412f-a2d8-97ea9cf68460 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '524ac46437134cd5a5000574631ea59a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b191bd428a4906b6c2781ae3efdaae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:19:55.765890 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-2938558e-6aff-412f-a2d8-97ea9cf68460 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] 10.222.0.43 "GET /compute/v2.1/servers/01f84e19-7e4a-460a-bb60-5da518f3d8b1" status: 200 len: 1724 microversion: 2.1 time: 0.179600 Oct 04 22:19:55.766706 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2920/5870] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:19:55 2022] GET /compute/v2.1/servers/01f84e19-7e4a-460a-bb60-5da518f3d8b1 => generated 1724 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:19:56.790896 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-ba6a928a-9729-49c8-912f-dee5efa6b93d tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:19:56.791897 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-ba6a928a-9729-49c8-912f-dee5efa6b93d tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] [instance: 01f84e19-7e4a-460a-bb60-5da518f3d8b1] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:19:56.799002 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ba6a928a-9729-49c8-912f-dee5efa6b93d tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:56.799484 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ba6a928a-9729-49c8-912f-dee5efa6b93d tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:56.799995 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ba6a928a-9729-49c8-912f-dee5efa6b93d tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:56.800611 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ba6a928a-9729-49c8-912f-dee5efa6b93d tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:56.801070 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ba6a928a-9729-49c8-912f-dee5efa6b93d tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:56.802236 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ba6a928a-9729-49c8-912f-dee5efa6b93d tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:56.952387 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-ba6a928a-9729-49c8-912f-dee5efa6b93d tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '524ac46437134cd5a5000574631ea59a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b191bd428a4906b6c2781ae3efdaae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:19:56.963500 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-ba6a928a-9729-49c8-912f-dee5efa6b93d tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] 10.222.0.43 "GET /compute/v2.1/servers/01f84e19-7e4a-460a-bb60-5da518f3d8b1" status: 200 len: 1724 microversion: 2.1 time: 0.176601 Oct 04 22:19:56.973222 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2921/5871] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:19:56 2022] GET /compute/v2.1/servers/01f84e19-7e4a-460a-bb60-5da518f3d8b1 => generated 1724 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:19:57.987756 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-6f358db3-8255-4fd7-8d34-0eb7d5f2bb93 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:19:57.989621 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-6f358db3-8255-4fd7-8d34-0eb7d5f2bb93 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] [instance: 01f84e19-7e4a-460a-bb60-5da518f3d8b1] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:19:57.997979 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6f358db3-8255-4fd7-8d34-0eb7d5f2bb93 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:57.998510 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6f358db3-8255-4fd7-8d34-0eb7d5f2bb93 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:57.998960 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6f358db3-8255-4fd7-8d34-0eb7d5f2bb93 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:57.999678 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6f358db3-8255-4fd7-8d34-0eb7d5f2bb93 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:58.000327 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6f358db3-8255-4fd7-8d34-0eb7d5f2bb93 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:58.000938 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6f358db3-8255-4fd7-8d34-0eb7d5f2bb93 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:58.200538 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-6f358db3-8255-4fd7-8d34-0eb7d5f2bb93 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '524ac46437134cd5a5000574631ea59a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b191bd428a4906b6c2781ae3efdaae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:19:58.214131 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-6f358db3-8255-4fd7-8d34-0eb7d5f2bb93 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] 10.222.0.43 "GET /compute/v2.1/servers/01f84e19-7e4a-460a-bb60-5da518f3d8b1" status: 200 len: 1724 microversion: 2.1 time: 0.230541 Oct 04 22:19:58.230394 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2922/5872] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:19:57 2022] GET /compute/v2.1/servers/01f84e19-7e4a-460a-bb60-5da518f3d8b1 => generated 1724 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:19:59.245045 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-82661198-d67d-482a-b7dc-66ec6fb2e20a tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:19:59.249091 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-82661198-d67d-482a-b7dc-66ec6fb2e20a tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] [instance: 01f84e19-7e4a-460a-bb60-5da518f3d8b1] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:19:59.260546 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-82661198-d67d-482a-b7dc-66ec6fb2e20a tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:59.261053 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-82661198-d67d-482a-b7dc-66ec6fb2e20a tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:59.261510 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-82661198-d67d-482a-b7dc-66ec6fb2e20a tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:59.262241 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-82661198-d67d-482a-b7dc-66ec6fb2e20a tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:59.262742 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-82661198-d67d-482a-b7dc-66ec6fb2e20a tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:59.263179 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-82661198-d67d-482a-b7dc-66ec6fb2e20a tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:59.460152 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-82661198-d67d-482a-b7dc-66ec6fb2e20a tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '524ac46437134cd5a5000574631ea59a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b191bd428a4906b6c2781ae3efdaae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:19:59.470858 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-82661198-d67d-482a-b7dc-66ec6fb2e20a tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] 10.222.0.43 "GET /compute/v2.1/servers/01f84e19-7e4a-460a-bb60-5da518f3d8b1" status: 200 len: 1724 microversion: 2.1 time: 0.231936 Oct 04 22:19:59.478841 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2923/5873] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:19:59 2022] GET /compute/v2.1/servers/01f84e19-7e4a-460a-bb60-5da518f3d8b1 => generated 1724 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:20:00.494635 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-19ad2a18-b9c0-44cc-97d3-54904a22b6fc tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:20:00.495279 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-19ad2a18-b9c0-44cc-97d3-54904a22b6fc tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] [instance: 01f84e19-7e4a-460a-bb60-5da518f3d8b1] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:20:00.502289 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-19ad2a18-b9c0-44cc-97d3-54904a22b6fc tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:00.502895 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-19ad2a18-b9c0-44cc-97d3-54904a22b6fc tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:00.503755 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-19ad2a18-b9c0-44cc-97d3-54904a22b6fc tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:00.505258 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-19ad2a18-b9c0-44cc-97d3-54904a22b6fc tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:00.505948 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-19ad2a18-b9c0-44cc-97d3-54904a22b6fc tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:00.506508 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-19ad2a18-b9c0-44cc-97d3-54904a22b6fc tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:01.101439 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-19ad2a18-b9c0-44cc-97d3-54904a22b6fc tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '524ac46437134cd5a5000574631ea59a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b191bd428a4906b6c2781ae3efdaae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:20:01.111955 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-19ad2a18-b9c0-44cc-97d3-54904a22b6fc tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] 10.222.0.43 "GET /compute/v2.1/servers/01f84e19-7e4a-460a-bb60-5da518f3d8b1" status: 200 len: 1724 microversion: 2.1 time: 0.620972 Oct 04 22:20:01.112647 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2924/5874] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:20:00 2022] GET /compute/v2.1/servers/01f84e19-7e4a-460a-bb60-5da518f3d8b1 => generated 1724 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:20:02.139242 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-47fd2d30-8326-47b7-ba1b-2e91feec13fb tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:20:02.139877 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-47fd2d30-8326-47b7-ba1b-2e91feec13fb tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] [instance: 01f84e19-7e4a-460a-bb60-5da518f3d8b1] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:20:02.148740 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-47fd2d30-8326-47b7-ba1b-2e91feec13fb tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:02.149367 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-47fd2d30-8326-47b7-ba1b-2e91feec13fb tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:02.149830 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-47fd2d30-8326-47b7-ba1b-2e91feec13fb tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:02.150582 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-47fd2d30-8326-47b7-ba1b-2e91feec13fb tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:02.151057 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-47fd2d30-8326-47b7-ba1b-2e91feec13fb tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:02.151494 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-47fd2d30-8326-47b7-ba1b-2e91feec13fb tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:02.305303 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-47fd2d30-8326-47b7-ba1b-2e91feec13fb tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '524ac46437134cd5a5000574631ea59a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b191bd428a4906b6c2781ae3efdaae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:20:02.314093 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-47fd2d30-8326-47b7-ba1b-2e91feec13fb tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] 10.222.0.43 "GET /compute/v2.1/servers/01f84e19-7e4a-460a-bb60-5da518f3d8b1" status: 200 len: 1701 microversion: 2.1 time: 0.180858 Oct 04 22:20:02.315271 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2925/5875] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:20:02 2022] GET /compute/v2.1/servers/01f84e19-7e4a-460a-bb60-5da518f3d8b1 => generated 1701 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:20:02.339047 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-b9c62a29-0ebc-42c8-8d66-d7821481446b tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:20:02.345762 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b9c62a29-0ebc-42c8-8d66-d7821481446b tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:02.346578 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b9c62a29-0ebc-42c8-8d66-d7821481446b tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:02.347195 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b9c62a29-0ebc-42c8-8d66-d7821481446b tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:02.373454 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-b9c62a29-0ebc-42c8-8d66-d7821481446b tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] [instance: 01f84e19-7e4a-460a-bb60-5da518f3d8b1] Going to try to start instance {{(pid=134101) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 04 22:20:02.428291 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-b9c62a29-0ebc-42c8-8d66-d7821481446b tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] 10.222.0.43 "POST /compute/v2.1/servers/01f84e19-7e4a-460a-bb60-5da518f3d8b1/action" status: 202 len: 0 microversion: 2.1 time: 0.093694 Oct 04 22:20:02.432565 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2926/5876] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 22:20:02 2022] POST /compute/v2.1/servers/01f84e19-7e4a-460a-bb60-5da518f3d8b1/action => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 22:20:02.438986 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-8daf4781-6f84-4357-b671-1e87cc56f88d tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:20:02.440009 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-8daf4781-6f84-4357-b671-1e87cc56f88d tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] [instance: 01f84e19-7e4a-460a-bb60-5da518f3d8b1] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:20:02.451209 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8daf4781-6f84-4357-b671-1e87cc56f88d tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:02.452070 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8daf4781-6f84-4357-b671-1e87cc56f88d tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:02.452765 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8daf4781-6f84-4357-b671-1e87cc56f88d tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:02.453710 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8daf4781-6f84-4357-b671-1e87cc56f88d tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:02.454384 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8daf4781-6f84-4357-b671-1e87cc56f88d tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:02.455042 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8daf4781-6f84-4357-b671-1e87cc56f88d tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:02.622614 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-8daf4781-6f84-4357-b671-1e87cc56f88d tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '524ac46437134cd5a5000574631ea59a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b191bd428a4906b6c2781ae3efdaae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:20:02.633785 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-8daf4781-6f84-4357-b671-1e87cc56f88d tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] 10.222.0.43 "GET /compute/v2.1/servers/01f84e19-7e4a-460a-bb60-5da518f3d8b1" status: 200 len: 1710 microversion: 2.1 time: 0.198953 Oct 04 22:20:02.634810 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2927/5877] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:20:02 2022] GET /compute/v2.1/servers/01f84e19-7e4a-460a-bb60-5da518f3d8b1 => generated 1710 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:20:03.657872 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-072d7e1b-9128-4050-a173-0307dc8750ae tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:20:03.658577 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-072d7e1b-9128-4050-a173-0307dc8750ae tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] [instance: 01f84e19-7e4a-460a-bb60-5da518f3d8b1] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:20:03.666980 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-072d7e1b-9128-4050-a173-0307dc8750ae tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:03.667479 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-072d7e1b-9128-4050-a173-0307dc8750ae tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:03.667926 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-072d7e1b-9128-4050-a173-0307dc8750ae tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:03.668713 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-072d7e1b-9128-4050-a173-0307dc8750ae tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:03.669092 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-072d7e1b-9128-4050-a173-0307dc8750ae tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:03.669526 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-072d7e1b-9128-4050-a173-0307dc8750ae tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:03.834966 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-072d7e1b-9128-4050-a173-0307dc8750ae tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '524ac46437134cd5a5000574631ea59a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b191bd428a4906b6c2781ae3efdaae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:20:03.843744 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-072d7e1b-9128-4050-a173-0307dc8750ae tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] 10.222.0.43 "GET /compute/v2.1/servers/01f84e19-7e4a-460a-bb60-5da518f3d8b1" status: 200 len: 1710 microversion: 2.1 time: 0.189836 Oct 04 22:20:03.844339 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2928/5878] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:20:03 2022] GET /compute/v2.1/servers/01f84e19-7e4a-460a-bb60-5da518f3d8b1 => generated 1710 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:20:04.871686 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-8b28f69b-df8c-4d50-961b-6b7a23dac6dc tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:20:04.872459 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-8b28f69b-df8c-4d50-961b-6b7a23dac6dc tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] [instance: 01f84e19-7e4a-460a-bb60-5da518f3d8b1] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:20:04.879981 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8b28f69b-df8c-4d50-961b-6b7a23dac6dc tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:04.880798 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8b28f69b-df8c-4d50-961b-6b7a23dac6dc tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:04.881215 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8b28f69b-df8c-4d50-961b-6b7a23dac6dc tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:04.881936 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8b28f69b-df8c-4d50-961b-6b7a23dac6dc tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:04.882815 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8b28f69b-df8c-4d50-961b-6b7a23dac6dc tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:04.883267 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8b28f69b-df8c-4d50-961b-6b7a23dac6dc tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:04.905667 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:20:05.048588 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-8b28f69b-df8c-4d50-961b-6b7a23dac6dc tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '524ac46437134cd5a5000574631ea59a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b191bd428a4906b6c2781ae3efdaae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:20:05.063143 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-8b28f69b-df8c-4d50-961b-6b7a23dac6dc tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] 10.222.0.43 "GET /compute/v2.1/servers/01f84e19-7e4a-460a-bb60-5da518f3d8b1" status: 200 len: 1714 microversion: 2.1 time: 0.195437 Oct 04 22:20:05.063756 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2929/5879] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:20:04 2022] GET /compute/v2.1/servers/01f84e19-7e4a-460a-bb60-5da518f3d8b1 => generated 1714 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:20:10.481099 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-fd9e7d6e-7cb7-4a86-b85b-2aa9d77860bb tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:20:10.481709 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-fd9e7d6e-7cb7-4a86-b85b-2aa9d77860bb tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] [instance: 8d50022d-6b2c-4959-a038-e4a4c0ee9639] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:20:10.489243 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fd9e7d6e-7cb7-4a86-b85b-2aa9d77860bb tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:10.490013 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fd9e7d6e-7cb7-4a86-b85b-2aa9d77860bb tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:10.490668 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fd9e7d6e-7cb7-4a86-b85b-2aa9d77860bb tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:10.491596 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fd9e7d6e-7cb7-4a86-b85b-2aa9d77860bb tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:10.492237 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fd9e7d6e-7cb7-4a86-b85b-2aa9d77860bb tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:10.492844 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fd9e7d6e-7cb7-4a86-b85b-2aa9d77860bb tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:10.530926 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-fd9e7d6e-7cb7-4a86-b85b-2aa9d77860bb tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] [instance: 8d50022d-6b2c-4959-a038-e4a4c0ee9639] Going to try to terminate instance {{(pid=134101) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 22:20:10.664327 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-fd9e7d6e-7cb7-4a86-b85b-2aa9d77860bb tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] 10.222.0.43 "DELETE /compute/v2.1/servers/8d50022d-6b2c-4959-a038-e4a4c0ee9639" status: 204 len: 0 microversion: 2.1 time: 0.182659 Oct 04 22:20:10.665965 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2930/5880] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 22:20:10 2022] DELETE /compute/v2.1/servers/8d50022d-6b2c-4959-a038-e4a4c0ee9639 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 22:20:10.675234 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-91d8b471-08c3-47d8-bccc-7a13ef6b0f9d tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:20:10.676296 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-91d8b471-08c3-47d8-bccc-7a13ef6b0f9d tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] [instance: 8d50022d-6b2c-4959-a038-e4a4c0ee9639] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:20:10.683100 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-91d8b471-08c3-47d8-bccc-7a13ef6b0f9d tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:10.683930 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-91d8b471-08c3-47d8-bccc-7a13ef6b0f9d tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:10.684547 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-91d8b471-08c3-47d8-bccc-7a13ef6b0f9d tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:10.685684 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-91d8b471-08c3-47d8-bccc-7a13ef6b0f9d tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:10.694629 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-91d8b471-08c3-47d8-bccc-7a13ef6b0f9d tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:10.695397 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-91d8b471-08c3-47d8-bccc-7a13ef6b0f9d tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:10.878393 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-91d8b471-08c3-47d8-bccc-7a13ef6b0f9d tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ac78e2767c49168f0464acea155be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286d184163154f2e846d521d368e3ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:20:10.888055 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-91d8b471-08c3-47d8-bccc-7a13ef6b0f9d tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] 10.222.0.43 "GET /compute/v2.1/servers/8d50022d-6b2c-4959-a038-e4a4c0ee9639" status: 200 len: 1553 microversion: 2.1 time: 0.217405 Oct 04 22:20:10.904445 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2931/5881] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:20:10 2022] GET /compute/v2.1/servers/8d50022d-6b2c-4959-a038-e4a4c0ee9639 => generated 1553 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:20:11.913544 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-5a90e8cf-235b-4d7f-9e66-40de25e15782 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:20:11.914226 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-5a90e8cf-235b-4d7f-9e66-40de25e15782 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] [instance: 8d50022d-6b2c-4959-a038-e4a4c0ee9639] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:20:11.942394 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5a90e8cf-235b-4d7f-9e66-40de25e15782 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:11.942394 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5a90e8cf-235b-4d7f-9e66-40de25e15782 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:11.942394 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5a90e8cf-235b-4d7f-9e66-40de25e15782 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:11.951932 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5a90e8cf-235b-4d7f-9e66-40de25e15782 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:11.954498 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5a90e8cf-235b-4d7f-9e66-40de25e15782 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:11.956070 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5a90e8cf-235b-4d7f-9e66-40de25e15782 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:12.172091 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-5a90e8cf-235b-4d7f-9e66-40de25e15782 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ac78e2767c49168f0464acea155be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286d184163154f2e846d521d368e3ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:20:12.182575 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-5a90e8cf-235b-4d7f-9e66-40de25e15782 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] 10.222.0.43 "GET /compute/v2.1/servers/8d50022d-6b2c-4959-a038-e4a4c0ee9639" status: 200 len: 1553 microversion: 2.1 time: 0.274325 Oct 04 22:20:12.183189 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2932/5882] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:20:11 2022] GET /compute/v2.1/servers/8d50022d-6b2c-4959-a038-e4a4c0ee9639 => generated 1553 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:20:13.215191 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-45f2e604-3c6b-423d-950f-54165ee9937f tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:20:13.218953 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-45f2e604-3c6b-423d-950f-54165ee9937f tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] [instance: 8d50022d-6b2c-4959-a038-e4a4c0ee9639] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:20:13.227005 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-45f2e604-3c6b-423d-950f-54165ee9937f tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:13.227564 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-45f2e604-3c6b-423d-950f-54165ee9937f tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:13.227929 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-45f2e604-3c6b-423d-950f-54165ee9937f tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:13.228669 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-45f2e604-3c6b-423d-950f-54165ee9937f tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:13.229132 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-45f2e604-3c6b-423d-950f-54165ee9937f tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:13.229565 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-45f2e604-3c6b-423d-950f-54165ee9937f tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:13.299466 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-45f2e604-3c6b-423d-950f-54165ee9937f tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ac78e2767c49168f0464acea155be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286d184163154f2e846d521d368e3ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:20:13.310238 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-45f2e604-3c6b-423d-950f-54165ee9937f tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] 10.222.0.43 "GET /compute/v2.1/servers/8d50022d-6b2c-4959-a038-e4a4c0ee9639" status: 200 len: 1485 microversion: 2.1 time: 0.102329 Oct 04 22:20:13.311378 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2933/5883] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:20:13 2022] GET /compute/v2.1/servers/8d50022d-6b2c-4959-a038-e4a4c0ee9639 => generated 1485 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:20:13.585466 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-c8690425-fd0f-4dc3-9eef-4ccbac974e15 req-c29b1307-878a-4270-b2ca-9b6d3138e9f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d50022d-6b2c-4959-a038-e4a4c0ee9639", "name": "network-vif-deleted", "tag": "c21b6fdd-96b3-490d-a621-cced5b85c7d6"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:20:13.643735 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-c8690425-fd0f-4dc3-9eef-4ccbac974e15 req-c29b1307-878a-4270-b2ca-9b6d3138e9f5 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:13.644356 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-c8690425-fd0f-4dc3-9eef-4ccbac974e15 req-c29b1307-878a-4270-b2ca-9b6d3138e9f5 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:13.646903 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-c8690425-fd0f-4dc3-9eef-4ccbac974e15 req-c29b1307-878a-4270-b2ca-9b6d3138e9f5 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:13.672234 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-c8690425-fd0f-4dc3-9eef-4ccbac974e15 req-c29b1307-878a-4270-b2ca-9b6d3138e9f5 service nova] Creating event network-vif-deleted:c21b6fdd-96b3-490d-a621-cced5b85c7d6 for instance 8d50022d-6b2c-4959-a038-e4a4c0ee9639 on n-h2-860284-1 Oct 04 22:20:13.695533 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-c8690425-fd0f-4dc3-9eef-4ccbac974e15 req-c29b1307-878a-4270-b2ca-9b6d3138e9f5 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.382631 Oct 04 22:20:13.696148 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2934/5884] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:20:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:20:14.344597 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-20e8bcfb-4ba4-4f43-9a8a-146734731cc4 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:20:14.345652 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-20e8bcfb-4ba4-4f43-9a8a-146734731cc4 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] [instance: 8d50022d-6b2c-4959-a038-e4a4c0ee9639] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:20:14.357420 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-20e8bcfb-4ba4-4f43-9a8a-146734731cc4 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:14.360583 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-20e8bcfb-4ba4-4f43-9a8a-146734731cc4 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:14.361157 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-20e8bcfb-4ba4-4f43-9a8a-146734731cc4 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:14.363365 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-20e8bcfb-4ba4-4f43-9a8a-146734731cc4 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:14.371488 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-20e8bcfb-4ba4-4f43-9a8a-146734731cc4 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:14.371488 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-20e8bcfb-4ba4-4f43-9a8a-146734731cc4 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:14.386295 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-20e8bcfb-4ba4-4f43-9a8a-146734731cc4 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] HTTP exception thrown: Instance 8d50022d-6b2c-4959-a038-e4a4c0ee9639 could not be found. Oct 04 22:20:14.388381 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-20e8bcfb-4ba4-4f43-9a8a-146734731cc4 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Request method failure captured: Oct 04 22:20:14.388381 n-d-860284-1 devstack@n-api.service[134101]: request: GET /compute/v2.1/servers/8d50022d-6b2c-4959-a038-e4a4c0ee9639 HTTP/1.1 Oct 04 22:20:14.388381 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 22:20:14.388381 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 22:20:14.388381 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 22:20:14.388381 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 22:20:14.388381 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 22:20:14.388381 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 22:20:14.388381 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 22:20:14.388381 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 22:20:14.388381 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPLDRjP83hF08fCh8H596OgX3y9N4FGiLSfN8nowIXPmQuqW-EaGgYh04b0TMC967vhiDXrOlxDvb9sOAkDu9NdllggOfXYIwNiskWnh4z5z3gdz3Fjc1gTo1WgLApzt_qxWPTDnDntLv6haJRB4RbFrp9grR6FOxMrXvyjag9koHkLc Oct 04 22:20:14.388381 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 22:20:14.388381 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 22:20:14.388381 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 22:20:14.388381 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 22:20:14.388381 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 22:20:14.388381 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 22:20:14.388381 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: 286d184163154f2e846d521d368e3ead Oct 04 22:20:14.388381 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-TestNetworkBasicOps-869731627 Oct 04 22:20:14.388381 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 22:20:14.388381 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 22:20:14.388381 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/286d184163154f2e846d521d368e3ead"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_286d184163154f2e846d521d368e3ead", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/286d184163154f2e846d521d368e3ead"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/286d184163154f2e846d521d368e3ead"}]}] Oct 04 22:20:14.388381 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-TestNetworkBasicOps-869731627 Oct 04 22:20:14.388381 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: 286d184163154f2e846d521d368e3ead Oct 04 22:20:14.388381 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-TestNetworkBasicOps-869731627 Oct 04 22:20:14.388381 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-TestNetworkBasicOps-869731627-project Oct 04 22:20:14.388381 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 22:20:14.388381 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 22:20:14.388381 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 94ac78e2767c49168f0464acea155be1 Oct 04 22:20:14.388381 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-TestNetworkBasicOps-869731627-project Oct 04 22:20:14.388381 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 22:20:14.388381 n-d-860284-1 devstack@n-api.service[134101]: exception: Instance 8d50022d-6b2c-4959-a038-e4a4c0ee9639 could not be found. Oct 04 22:20:14.388381 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': '8d50022d-6b2c-4959-a038-e4a4c0ee9639'} Oct 04 22:20:14.388381 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:20:14.388381 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:20:14.388381 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:20:14.388381 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:20:14.388381 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:20:14.388381 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:20:14.388381 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:20:14.388381 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:20:14.388381 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:20:14.388381 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:20:14.388381 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d50022d-6b2c-4959-a038-e4a4c0ee9639 could not be found. Oct 04 22:20:14.388381 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:20:14.388381 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:20:14.388381 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:20:14.388381 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:20:14.388381 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:20:14.388381 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:20:14.388381 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:20:14.388381 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:20:14.388381 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:20:14.388381 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:20:14.388381 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:20:14.388381 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:20:14.388381 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:20:14.388381 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:20:14.388381 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:20:14.388381 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:20:14.388381 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d50022d-6b2c-4959-a038-e4a4c0ee9639 could not be found. Oct 04 22:20:14.388381 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:20:14.388381 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:20:14.388381 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:20:14.395516 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:20:14.395516 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:20:14.395516 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:20:14.395516 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:20:14.395516 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:20:14.395516 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d50022d-6b2c-4959-a038-e4a4c0ee9639 could not be found. Oct 04 22:20:14.395516 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:20:14.395516 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-20e8bcfb-4ba4-4f43-9a8a-146734731cc4 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Returning 404 to user: Instance 8d50022d-6b2c-4959-a038-e4a4c0ee9639 could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:20:14.395516 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-20e8bcfb-4ba4-4f43-9a8a-146734731cc4 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] 10.222.0.43 "GET /compute/v2.1/servers/8d50022d-6b2c-4959-a038-e4a4c0ee9639" status: 404 len: 111 microversion: 2.1 time: 0.054490 Oct 04 22:20:14.395516 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2935/5885] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:20:14 2022] GET /compute/v2.1/servers/8d50022d-6b2c-4959-a038-e4a4c0ee9639 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 22:20:14.626310 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-eda76d5a-05e7-4dd1-a28e-d717ebfd51c8 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Calling method '.version_select at 0x7fbb2d948940>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:20:14.672599 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-eda76d5a-05e7-4dd1-a28e-d717ebfd51c8 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1235115313" status: 202 len: 0 microversion: 2.1 time: 0.050822 Oct 04 22:20:14.681150 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2936/5886] 10.222.0.43 () {58 vars in 1257 bytes} [Tue Oct 4 22:20:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1235115313 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 22:20:18.051393 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-5a464945-3d76-4cc6-a88b-e0b55336c0ba tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:20:18.052193 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-5a464945-3d76-4cc6-a88b-e0b55336c0ba tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] [instance: c05ce571-4683-4210-af70-67c2d871f6f3] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:20:18.060285 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5a464945-3d76-4cc6-a88b-e0b55336c0ba tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:18.060771 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5a464945-3d76-4cc6-a88b-e0b55336c0ba tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:18.061555 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5a464945-3d76-4cc6-a88b-e0b55336c0ba tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:18.062352 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5a464945-3d76-4cc6-a88b-e0b55336c0ba tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:18.062841 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5a464945-3d76-4cc6-a88b-e0b55336c0ba tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:18.063276 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5a464945-3d76-4cc6-a88b-e0b55336c0ba tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:18.103069 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-5a464945-3d76-4cc6-a88b-e0b55336c0ba tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] [instance: c05ce571-4683-4210-af70-67c2d871f6f3] Going to try to terminate instance {{(pid=134101) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 22:20:18.271885 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-5a464945-3d76-4cc6-a88b-e0b55336c0ba tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] 10.222.0.43 "DELETE /compute/v2.1/servers/c05ce571-4683-4210-af70-67c2d871f6f3" status: 204 len: 0 microversion: 2.1 time: 0.223770 Oct 04 22:20:18.276196 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2937/5887] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 22:20:18 2022] DELETE /compute/v2.1/servers/c05ce571-4683-4210-af70-67c2d871f6f3 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 22:20:18.282911 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-67ce91e7-bc89-427a-aa30-88c6c21b90c9 req-52713e71-5dfe-4dda-88df-2fee94e1ee40 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c05ce571-4683-4210-af70-67c2d871f6f3", "tag": "7e71d229-6e38-4aba-8027-f54cd448b83b"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:20:18.297013 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-67ce91e7-bc89-427a-aa30-88c6c21b90c9 req-52713e71-5dfe-4dda-88df-2fee94e1ee40 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:18.297771 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-67ce91e7-bc89-427a-aa30-88c6c21b90c9 req-52713e71-5dfe-4dda-88df-2fee94e1ee40 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:18.298390 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-67ce91e7-bc89-427a-aa30-88c6c21b90c9 req-52713e71-5dfe-4dda-88df-2fee94e1ee40 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:18.313826 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-67ce91e7-bc89-427a-aa30-88c6c21b90c9 req-52713e71-5dfe-4dda-88df-2fee94e1ee40 service nova] Creating event network-changed:7e71d229-6e38-4aba-8027-f54cd448b83b for instance c05ce571-4683-4210-af70-67c2d871f6f3 on n-h1-860284-1 Oct 04 22:20:18.324549 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-67ce91e7-bc89-427a-aa30-88c6c21b90c9 req-52713e71-5dfe-4dda-88df-2fee94e1ee40 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046760 Oct 04 22:20:18.325763 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2938/5888] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:20:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:20:18.333187 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-b229515a-cc2f-4f15-8c98-6a3966c40b89 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-986696381", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "e8b73598-a7e4-4e48-89ad-da5bca5aa731", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f55a0794-d215-4510-84cc-a7b063c083a4"}]}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:20:18.448597 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.network.neutron [None req-b229515a-cc2f-4f15-8c98-6a3966c40b89 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] validate_networks() for [('f55a0794-d215-4510-84cc-a7b063c083a4', None, None, None, None, None)] {{(pid=134101) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 22:20:18.963117 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-b229515a-cc2f-4f15-8c98-6a3966c40b89 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Flavor limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 22:20:18.963550 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-b229515a-cc2f-4f15-8c98-6a3966c40b89 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Image limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 22:20:18.965698 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-b229515a-cc2f-4f15-8c98-6a3966c40b89 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Flavor pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 22:20:18.965698 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-b229515a-cc2f-4f15-8c98-6a3966c40b89 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Image pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 22:20:18.965698 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-b229515a-cc2f-4f15-8c98-6a3966c40b89 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 22:20:18.980327 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b229515a-cc2f-4f15-8c98-6a3966c40b89 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:18.980838 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b229515a-cc2f-4f15-8c98-6a3966c40b89 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:18.981292 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b229515a-cc2f-4f15-8c98-6a3966c40b89 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:18.982046 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b229515a-cc2f-4f15-8c98-6a3966c40b89 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:18.982619 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b229515a-cc2f-4f15-8c98-6a3966c40b89 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:18.983075 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b229515a-cc2f-4f15-8c98-6a3966c40b89 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:19.007074 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-b229515a-cc2f-4f15-8c98-6a3966c40b89 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Getting quotas for project 5c98a72bacce47c3947f9b0f0b4e85b6. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:20:19.019061 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-b229515a-cc2f-4f15-8c98-6a3966c40b89 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Getting quotas for user 99acad09db70445b93ae1d64a1b49ca3 and project 5c98a72bacce47c3947f9b0f0b4e85b6. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:20:19.088626 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-b229515a-cc2f-4f15-8c98-6a3966c40b89 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Going to run 1 instances... {{(pid=134101) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 22:20:19.094024 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-b229515a-cc2f-4f15-8c98-6a3966c40b89 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: 7c6bc6d2-31de-4cff-a3f4-f9c685f11bdc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e8b73598-a7e4-4e48-89ad-da5bca5aa731',volume_size=None,volume_type=None)] {{(pid=134101) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 22:20:19.273518 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-b229515a-cc2f-4f15-8c98-6a3966c40b89 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.946141 Oct 04 22:20:19.274736 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2939/5889] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 22:20:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 948 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 22:20:19.279359 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-4a644181-a308-4f03-94f3-fe0c278be76e tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:20:19.279974 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-4a644181-a308-4f03-94f3-fe0c278be76e tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] [instance: c05ce571-4683-4210-af70-67c2d871f6f3] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:20:19.288022 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4a644181-a308-4f03-94f3-fe0c278be76e tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:19.288521 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4a644181-a308-4f03-94f3-fe0c278be76e tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:19.288966 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4a644181-a308-4f03-94f3-fe0c278be76e tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:19.289687 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4a644181-a308-4f03-94f3-fe0c278be76e tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:19.290146 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4a644181-a308-4f03-94f3-fe0c278be76e tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:19.290663 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4a644181-a308-4f03-94f3-fe0c278be76e tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:19.553870 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-4a644181-a308-4f03-94f3-fe0c278be76e tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ac78e2767c49168f0464acea155be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286d184163154f2e846d521d368e3ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:20:19.566499 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-4a644181-a308-4f03-94f3-fe0c278be76e tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] 10.222.0.43 "GET /compute/v2.1/servers/c05ce571-4683-4210-af70-67c2d871f6f3" status: 200 len: 1670 microversion: 2.1 time: 0.290627 Oct 04 22:20:19.567570 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2940/5890] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:20:19 2022] GET /compute/v2.1/servers/c05ce571-4683-4210-af70-67c2d871f6f3 => generated 1670 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:20:19.619511 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-dde65988-ba63-4e29-8295-a8e589a1d1a0 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:20:19.623218 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-dde65988-ba63-4e29-8295-a8e589a1d1a0 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: 7c6bc6d2-31de-4cff-a3f4-f9c685f11bdc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:20:19.745321 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-dde65988-ba63-4e29-8295-a8e589a1d1a0 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:20:19.756505 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-dde65988-ba63-4e29-8295-a8e589a1d1a0 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/7c6bc6d2-31de-4cff-a3f4-f9c685f11bdc" status: 200 len: 1056 microversion: 2.1 time: 0.174727 Oct 04 22:20:19.758061 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2941/5891] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:20:19 2022] GET /compute/v2.1/servers/7c6bc6d2-31de-4cff-a3f4-f9c685f11bdc => generated 1056 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:20:20.596943 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-38ce7816-3d2a-4783-858d-d47954812fc8 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:20:20.599314 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-38ce7816-3d2a-4783-858d-d47954812fc8 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] [instance: c05ce571-4683-4210-af70-67c2d871f6f3] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:20:20.610437 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-38ce7816-3d2a-4783-858d-d47954812fc8 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:20.622247 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-38ce7816-3d2a-4783-858d-d47954812fc8 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:20.622835 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-38ce7816-3d2a-4783-858d-d47954812fc8 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:20.623930 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-38ce7816-3d2a-4783-858d-d47954812fc8 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:20.624698 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-38ce7816-3d2a-4783-858d-d47954812fc8 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:20.625426 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-38ce7816-3d2a-4783-858d-d47954812fc8 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:20.966770 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-38ce7816-3d2a-4783-858d-d47954812fc8 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ac78e2767c49168f0464acea155be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286d184163154f2e846d521d368e3ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:20:20.978269 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-38ce7816-3d2a-4783-858d-d47954812fc8 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] 10.222.0.43 "GET /compute/v2.1/servers/c05ce571-4683-4210-af70-67c2d871f6f3" status: 200 len: 1552 microversion: 2.1 time: 0.386528 Oct 04 22:20:20.979259 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2942/5892] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:20:20 2022] GET /compute/v2.1/servers/c05ce571-4683-4210-af70-67c2d871f6f3 => generated 1552 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:20:20.984170 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-be328f19-c741-4ec8-b9e2-d607b0980d26 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:20:20.985056 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-be328f19-c741-4ec8-b9e2-d607b0980d26 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: 7c6bc6d2-31de-4cff-a3f4-f9c685f11bdc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:20:20.988628 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:20:20.996278 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-be328f19-c741-4ec8-b9e2-d607b0980d26 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:20.997268 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-be328f19-c741-4ec8-b9e2-d607b0980d26 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:20.997986 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-be328f19-c741-4ec8-b9e2-d607b0980d26 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:21.000363 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-be328f19-c741-4ec8-b9e2-d607b0980d26 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:21.002024 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-be328f19-c741-4ec8-b9e2-d607b0980d26 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:21.002424 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-be328f19-c741-4ec8-b9e2-d607b0980d26 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:21.094817 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-be328f19-c741-4ec8-b9e2-d607b0980d26 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:20:21.108618 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-be328f19-c741-4ec8-b9e2-d607b0980d26 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/7c6bc6d2-31de-4cff-a3f4-f9c685f11bdc" status: 200 len: 1154 microversion: 2.1 time: 0.128005 Oct 04 22:20:21.109406 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2943/5893] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:20:20 2022] GET /compute/v2.1/servers/7c6bc6d2-31de-4cff-a3f4-f9c685f11bdc => generated 1154 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:20:21.115259 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-804f4636-ddc0-46b0-975d-1a5e0363990f req-b9ccc840-2fa6-47bb-b2e6-296810151ef0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c05ce571-4683-4210-af70-67c2d871f6f3", "name": "network-vif-deleted", "tag": "7e71d229-6e38-4aba-8027-f54cd448b83b"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:20:21.126138 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-804f4636-ddc0-46b0-975d-1a5e0363990f req-b9ccc840-2fa6-47bb-b2e6-296810151ef0 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:21.127635 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-804f4636-ddc0-46b0-975d-1a5e0363990f req-b9ccc840-2fa6-47bb-b2e6-296810151ef0 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:21.128455 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-804f4636-ddc0-46b0-975d-1a5e0363990f req-b9ccc840-2fa6-47bb-b2e6-296810151ef0 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:21.153097 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-804f4636-ddc0-46b0-975d-1a5e0363990f req-b9ccc840-2fa6-47bb-b2e6-296810151ef0 service nova] Creating event network-vif-deleted:7e71d229-6e38-4aba-8027-f54cd448b83b for instance c05ce571-4683-4210-af70-67c2d871f6f3 on n-h1-860284-1 Oct 04 22:20:21.158216 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-804f4636-ddc0-46b0-975d-1a5e0363990f req-b9ccc840-2fa6-47bb-b2e6-296810151ef0 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047499 Oct 04 22:20:21.159156 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2944/5894] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:20:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:20:22.009860 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-585e5b34-537d-4962-a987-1f9c33cbe4da tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:20:22.010828 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-585e5b34-537d-4962-a987-1f9c33cbe4da tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] [instance: c05ce571-4683-4210-af70-67c2d871f6f3] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:20:22.026534 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-585e5b34-537d-4962-a987-1f9c33cbe4da tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:22.027041 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-585e5b34-537d-4962-a987-1f9c33cbe4da tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:22.027492 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-585e5b34-537d-4962-a987-1f9c33cbe4da tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:22.028243 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-585e5b34-537d-4962-a987-1f9c33cbe4da tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:22.028900 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-585e5b34-537d-4962-a987-1f9c33cbe4da tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:22.029527 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-585e5b34-537d-4962-a987-1f9c33cbe4da tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:22.054269 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-585e5b34-537d-4962-a987-1f9c33cbe4da tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] HTTP exception thrown: Instance c05ce571-4683-4210-af70-67c2d871f6f3 could not be found. Oct 04 22:20:22.069356 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-585e5b34-537d-4962-a987-1f9c33cbe4da tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Request method failure captured: Oct 04 22:20:22.069356 n-d-860284-1 devstack@n-api.service[134101]: request: GET /compute/v2.1/servers/c05ce571-4683-4210-af70-67c2d871f6f3 HTTP/1.1 Oct 04 22:20:22.069356 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 22:20:22.069356 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 22:20:22.069356 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 22:20:22.069356 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 22:20:22.069356 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 22:20:22.069356 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 22:20:22.069356 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 22:20:22.069356 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 22:20:22.069356 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPLDRjP83hF08fCh8H596OgX3y9N4FGiLSfN8nowIXPmQuqW-EaGgYh04b0TMC967vhiDXrOlxDvb9sOAkDu9NdllggOfXYIwNiskWnh4z5z3gdz3Fjc1gTo1WgLApzt_qxWPTDnDntLv6haJRB4RbFrp9grR6FOxMrXvyjag9koHkLc Oct 04 22:20:22.069356 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 22:20:22.069356 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 22:20:22.069356 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 22:20:22.069356 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 22:20:22.069356 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 22:20:22.069356 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 22:20:22.069356 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: 286d184163154f2e846d521d368e3ead Oct 04 22:20:22.069356 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-TestNetworkBasicOps-869731627 Oct 04 22:20:22.069356 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 22:20:22.069356 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 22:20:22.069356 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/286d184163154f2e846d521d368e3ead"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_286d184163154f2e846d521d368e3ead", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/286d184163154f2e846d521d368e3ead"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/286d184163154f2e846d521d368e3ead"}]}] Oct 04 22:20:22.069356 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-TestNetworkBasicOps-869731627 Oct 04 22:20:22.069356 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: 286d184163154f2e846d521d368e3ead Oct 04 22:20:22.069356 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-TestNetworkBasicOps-869731627 Oct 04 22:20:22.069356 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-TestNetworkBasicOps-869731627-project Oct 04 22:20:22.069356 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 22:20:22.069356 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 22:20:22.069356 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 94ac78e2767c49168f0464acea155be1 Oct 04 22:20:22.069356 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-TestNetworkBasicOps-869731627-project Oct 04 22:20:22.069356 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 22:20:22.069356 n-d-860284-1 devstack@n-api.service[134101]: exception: Instance c05ce571-4683-4210-af70-67c2d871f6f3 could not be found. Oct 04 22:20:22.069356 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': 'c05ce571-4683-4210-af70-67c2d871f6f3'} Oct 04 22:20:22.069356 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:20:22.069356 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:20:22.069356 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:20:22.069356 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:20:22.069356 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:20:22.069356 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:20:22.069356 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:20:22.069356 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:20:22.069356 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:20:22.069356 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:20:22.069356 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c05ce571-4683-4210-af70-67c2d871f6f3 could not be found. Oct 04 22:20:22.069356 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:20:22.069356 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:20:22.069356 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:20:22.069356 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:20:22.069356 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:20:22.069356 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:20:22.069356 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:20:22.069356 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:20:22.069356 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:20:22.069356 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:20:22.069356 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:20:22.069356 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:20:22.069356 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:20:22.069356 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:20:22.069356 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:20:22.069356 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:20:22.069356 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c05ce571-4683-4210-af70-67c2d871f6f3 could not be found. Oct 04 22:20:22.069356 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:20:22.069356 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:20:22.069356 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:20:22.074624 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:20:22.074624 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:20:22.074624 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:20:22.074624 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:20:22.074624 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:20:22.074624 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c05ce571-4683-4210-af70-67c2d871f6f3 could not be found. Oct 04 22:20:22.074624 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:20:22.074624 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-585e5b34-537d-4962-a987-1f9c33cbe4da tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Returning 404 to user: Instance c05ce571-4683-4210-af70-67c2d871f6f3 could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:20:22.074624 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-585e5b34-537d-4962-a987-1f9c33cbe4da tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] 10.222.0.43 "GET /compute/v2.1/servers/c05ce571-4683-4210-af70-67c2d871f6f3" status: 404 len: 111 microversion: 2.1 time: 0.068707 Oct 04 22:20:22.074624 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2945/5895] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:20:22 2022] GET /compute/v2.1/servers/c05ce571-4683-4210-af70-67c2d871f6f3 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 22:20:22.144272 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-ff36f143-f24d-425f-8869-ebb54c4cca67 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:20:22.145562 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-ff36f143-f24d-425f-8869-ebb54c4cca67 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: 7c6bc6d2-31de-4cff-a3f4-f9c685f11bdc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:20:22.153265 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ff36f143-f24d-425f-8869-ebb54c4cca67 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:22.154046 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ff36f143-f24d-425f-8869-ebb54c4cca67 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:22.154948 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ff36f143-f24d-425f-8869-ebb54c4cca67 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:22.155860 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ff36f143-f24d-425f-8869-ebb54c4cca67 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:22.156686 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ff36f143-f24d-425f-8869-ebb54c4cca67 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:22.157720 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ff36f143-f24d-425f-8869-ebb54c4cca67 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:22.461509 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-ff36f143-f24d-425f-8869-ebb54c4cca67 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:20:22.471442 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-ff36f143-f24d-425f-8869-ebb54c4cca67 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/7c6bc6d2-31de-4cff-a3f4-f9c685f11bdc" status: 200 len: 1214 microversion: 2.1 time: 0.333175 Oct 04 22:20:22.489968 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2946/5896] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:20:22 2022] GET /compute/v2.1/servers/7c6bc6d2-31de-4cff-a3f4-f9c685f11bdc => generated 1214 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:20:22.496470 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-184ff93f-547f-4279-965a-e651b97be303 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Calling method '.version_select at 0x7fbb2e2430d0>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:20:22.530016 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-184ff93f-547f-4279-965a-e651b97be303 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1719242022" status: 202 len: 0 microversion: 2.1 time: 0.037955 Oct 04 22:20:22.530977 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2947/5897] 10.222.0.43 () {58 vars in 1257 bytes} [Tue Oct 4 22:20:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1719242022 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 22:20:23.504750 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-6515b919-a8c0-4eaf-8a58-e5abde8f18cc tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:20:23.505802 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-6515b919-a8c0-4eaf-8a58-e5abde8f18cc tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: 7c6bc6d2-31de-4cff-a3f4-f9c685f11bdc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:20:23.533830 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6515b919-a8c0-4eaf-8a58-e5abde8f18cc tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:23.540115 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6515b919-a8c0-4eaf-8a58-e5abde8f18cc tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:23.540957 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6515b919-a8c0-4eaf-8a58-e5abde8f18cc tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:23.542251 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6515b919-a8c0-4eaf-8a58-e5abde8f18cc tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:23.549184 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6515b919-a8c0-4eaf-8a58-e5abde8f18cc tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:23.551440 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6515b919-a8c0-4eaf-8a58-e5abde8f18cc tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:23.940836 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-6515b919-a8c0-4eaf-8a58-e5abde8f18cc tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:20:23.960906 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-6515b919-a8c0-4eaf-8a58-e5abde8f18cc tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/7c6bc6d2-31de-4cff-a3f4-f9c685f11bdc" status: 200 len: 1214 microversion: 2.1 time: 0.465340 Oct 04 22:20:23.962217 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2948/5898] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:20:23 2022] GET /compute/v2.1/servers/7c6bc6d2-31de-4cff-a3f4-f9c685f11bdc => generated 1214 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:20:23.968463 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-302e1912-044c-404e-96c5-7d097c6acc34 req-3e832b5e-a0d9-4743-a72c-93af4621b4ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c6bc6d2-31de-4cff-a3f4-f9c685f11bdc", "tag": "bf5f968c-8199-4de6-a241-0d2f47fba437"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:20:23.981639 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-302e1912-044c-404e-96c5-7d097c6acc34 req-3e832b5e-a0d9-4743-a72c-93af4621b4ed service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:23.982316 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-302e1912-044c-404e-96c5-7d097c6acc34 req-3e832b5e-a0d9-4743-a72c-93af4621b4ed service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:23.983488 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-302e1912-044c-404e-96c5-7d097c6acc34 req-3e832b5e-a0d9-4743-a72c-93af4621b4ed service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:24.033117 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-302e1912-044c-404e-96c5-7d097c6acc34 req-3e832b5e-a0d9-4743-a72c-93af4621b4ed service nova] Creating event network-changed:bf5f968c-8199-4de6-a241-0d2f47fba437 for instance 7c6bc6d2-31de-4cff-a3f4-f9c685f11bdc on n-h2-860284-1 Oct 04 22:20:24.060996 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-302e1912-044c-404e-96c5-7d097c6acc34 req-3e832b5e-a0d9-4743-a72c-93af4621b4ed service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094538 Oct 04 22:20:24.062509 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2949/5899] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:20:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:20:25.004948 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-ad365ac8-952f-40fa-8834-d5f823a25b06 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:20:25.005669 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-ad365ac8-952f-40fa-8834-d5f823a25b06 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: 7c6bc6d2-31de-4cff-a3f4-f9c685f11bdc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:20:25.020373 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ad365ac8-952f-40fa-8834-d5f823a25b06 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:25.021334 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ad365ac8-952f-40fa-8834-d5f823a25b06 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:25.022114 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ad365ac8-952f-40fa-8834-d5f823a25b06 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:25.023102 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ad365ac8-952f-40fa-8834-d5f823a25b06 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:25.023765 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ad365ac8-952f-40fa-8834-d5f823a25b06 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:25.024374 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ad365ac8-952f-40fa-8834-d5f823a25b06 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:25.085702 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:20:25.415357 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-ad365ac8-952f-40fa-8834-d5f823a25b06 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:20:25.430273 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-ad365ac8-952f-40fa-8834-d5f823a25b06 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/7c6bc6d2-31de-4cff-a3f4-f9c685f11bdc" status: 200 len: 1214 microversion: 2.1 time: 0.429831 Oct 04 22:20:25.443308 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2950/5900] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:20:24 2022] GET /compute/v2.1/servers/7c6bc6d2-31de-4cff-a3f4-f9c685f11bdc => generated 1214 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:20:26.457996 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-1dee3898-92b1-4c29-a098-a53b59fd7f57 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:20:26.459469 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-1dee3898-92b1-4c29-a098-a53b59fd7f57 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: 7c6bc6d2-31de-4cff-a3f4-f9c685f11bdc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:20:26.469077 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1dee3898-92b1-4c29-a098-a53b59fd7f57 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:26.479557 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1dee3898-92b1-4c29-a098-a53b59fd7f57 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:26.480162 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1dee3898-92b1-4c29-a098-a53b59fd7f57 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:26.480934 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1dee3898-92b1-4c29-a098-a53b59fd7f57 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:26.481412 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1dee3898-92b1-4c29-a098-a53b59fd7f57 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:26.481840 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1dee3898-92b1-4c29-a098-a53b59fd7f57 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:26.753104 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-1dee3898-92b1-4c29-a098-a53b59fd7f57 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:20:26.763149 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-1dee3898-92b1-4c29-a098-a53b59fd7f57 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/7c6bc6d2-31de-4cff-a3f4-f9c685f11bdc" status: 200 len: 1214 microversion: 2.1 time: 0.309708 Oct 04 22:20:26.763985 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2951/5901] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:20:26 2022] GET /compute/v2.1/servers/7c6bc6d2-31de-4cff-a3f4-f9c685f11bdc => generated 1214 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:20:27.793313 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-69ad81f8-de4d-4f25-8dcc-30a4c926f3ae tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:20:27.793917 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-69ad81f8-de4d-4f25-8dcc-30a4c926f3ae tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: 7c6bc6d2-31de-4cff-a3f4-f9c685f11bdc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:20:27.804200 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-69ad81f8-de4d-4f25-8dcc-30a4c926f3ae tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:27.805053 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-69ad81f8-de4d-4f25-8dcc-30a4c926f3ae tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:27.805714 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-69ad81f8-de4d-4f25-8dcc-30a4c926f3ae tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:27.806680 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-69ad81f8-de4d-4f25-8dcc-30a4c926f3ae tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:27.807579 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-69ad81f8-de4d-4f25-8dcc-30a4c926f3ae tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:27.808207 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-69ad81f8-de4d-4f25-8dcc-30a4c926f3ae tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:28.082274 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-69ad81f8-de4d-4f25-8dcc-30a4c926f3ae tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:20:28.095361 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-69ad81f8-de4d-4f25-8dcc-30a4c926f3ae tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/7c6bc6d2-31de-4cff-a3f4-f9c685f11bdc" status: 200 len: 1214 microversion: 2.1 time: 0.306682 Oct 04 22:20:28.096720 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2952/5902] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:20:27 2022] GET /compute/v2.1/servers/7c6bc6d2-31de-4cff-a3f4-f9c685f11bdc => generated 1214 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:20:29.132109 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-b2290d10-8c86-4170-9481-d955f55f1546 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:20:29.139100 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-b2290d10-8c86-4170-9481-d955f55f1546 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: 7c6bc6d2-31de-4cff-a3f4-f9c685f11bdc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:20:29.154192 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=2 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:20:29.156839 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b2290d10-8c86-4170-9481-d955f55f1546 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:29.157592 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b2290d10-8c86-4170-9481-d955f55f1546 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:29.158427 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b2290d10-8c86-4170-9481-d955f55f1546 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:29.159439 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b2290d10-8c86-4170-9481-d955f55f1546 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:29.162241 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b2290d10-8c86-4170-9481-d955f55f1546 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:29.163240 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b2290d10-8c86-4170-9481-d955f55f1546 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:29.522426 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-b2290d10-8c86-4170-9481-d955f55f1546 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:20:29.530624 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-b2290d10-8c86-4170-9481-d955f55f1546 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/7c6bc6d2-31de-4cff-a3f4-f9c685f11bdc" status: 200 len: 1214 microversion: 2.1 time: 0.409716 Oct 04 22:20:29.547734 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2953/5903] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:20:29 2022] GET /compute/v2.1/servers/7c6bc6d2-31de-4cff-a3f4-f9c685f11bdc => generated 1214 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:20:30.561993 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-a8a86ec9-1de8-4073-b9c0-37559af3a8cd tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:20:30.562638 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-a8a86ec9-1de8-4073-b9c0-37559af3a8cd tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: 7c6bc6d2-31de-4cff-a3f4-f9c685f11bdc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:20:30.567098 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=8 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:20:30.606157 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a8a86ec9-1de8-4073-b9c0-37559af3a8cd tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:30.606699 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a8a86ec9-1de8-4073-b9c0-37559af3a8cd tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:30.607145 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a8a86ec9-1de8-4073-b9c0-37559af3a8cd tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:30.608170 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a8a86ec9-1de8-4073-b9c0-37559af3a8cd tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:30.618742 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a8a86ec9-1de8-4073-b9c0-37559af3a8cd tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:30.621851 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a8a86ec9-1de8-4073-b9c0-37559af3a8cd tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:30.928049 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-a8a86ec9-1de8-4073-b9c0-37559af3a8cd tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:20:30.943239 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-a8a86ec9-1de8-4073-b9c0-37559af3a8cd tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/7c6bc6d2-31de-4cff-a3f4-f9c685f11bdc" status: 200 len: 1202 microversion: 2.1 time: 0.391795 Oct 04 22:20:30.959303 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2954/5904] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:20:30 2022] GET /compute/v2.1/servers/7c6bc6d2-31de-4cff-a3f4-f9c685f11bdc => generated 1202 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:20:31.974004 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-dace5c28-00a4-4627-a26e-fe0c24d48174 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:20:31.975478 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-dace5c28-00a4-4627-a26e-fe0c24d48174 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: 7c6bc6d2-31de-4cff-a3f4-f9c685f11bdc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:20:31.993562 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dace5c28-00a4-4627-a26e-fe0c24d48174 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:31.994563 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dace5c28-00a4-4627-a26e-fe0c24d48174 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:31.995243 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dace5c28-00a4-4627-a26e-fe0c24d48174 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:31.996184 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dace5c28-00a4-4627-a26e-fe0c24d48174 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:31.996867 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dace5c28-00a4-4627-a26e-fe0c24d48174 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:31.997498 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dace5c28-00a4-4627-a26e-fe0c24d48174 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:32.384514 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-dace5c28-00a4-4627-a26e-fe0c24d48174 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:20:32.411083 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-dace5c28-00a4-4627-a26e-fe0c24d48174 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/7c6bc6d2-31de-4cff-a3f4-f9c685f11bdc" status: 200 len: 1202 microversion: 2.1 time: 0.438059 Oct 04 22:20:32.436447 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2955/5905] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:20:31 2022] GET /compute/v2.1/servers/7c6bc6d2-31de-4cff-a3f4-f9c685f11bdc => generated 1202 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:20:33.493495 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-f7242ca2-c0d1-49d0-bd0f-64c2051cdbbc tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:20:33.495544 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-f7242ca2-c0d1-49d0-bd0f-64c2051cdbbc tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: 7c6bc6d2-31de-4cff-a3f4-f9c685f11bdc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:20:33.539830 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f7242ca2-c0d1-49d0-bd0f-64c2051cdbbc tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:33.540677 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f7242ca2-c0d1-49d0-bd0f-64c2051cdbbc tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:33.542393 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f7242ca2-c0d1-49d0-bd0f-64c2051cdbbc tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:33.544853 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f7242ca2-c0d1-49d0-bd0f-64c2051cdbbc tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:33.545579 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f7242ca2-c0d1-49d0-bd0f-64c2051cdbbc tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:33.546235 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f7242ca2-c0d1-49d0-bd0f-64c2051cdbbc tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:34.103944 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-f7242ca2-c0d1-49d0-bd0f-64c2051cdbbc tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:20:34.116133 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-f7242ca2-c0d1-49d0-bd0f-64c2051cdbbc tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/7c6bc6d2-31de-4cff-a3f4-f9c685f11bdc" status: 200 len: 1202 microversion: 2.1 time: 0.654201 Oct 04 22:20:34.132566 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2956/5906] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:20:33 2022] GET /compute/v2.1/servers/7c6bc6d2-31de-4cff-a3f4-f9c685f11bdc => generated 1202 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:20:35.156146 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e672ac18-3a04-426b-8112-365bc889aed3 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:20:35.157843 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-e672ac18-3a04-426b-8112-365bc889aed3 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: 7c6bc6d2-31de-4cff-a3f4-f9c685f11bdc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:20:35.181644 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e672ac18-3a04-426b-8112-365bc889aed3 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:35.186571 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e672ac18-3a04-426b-8112-365bc889aed3 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:35.187583 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e672ac18-3a04-426b-8112-365bc889aed3 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:35.192619 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e672ac18-3a04-426b-8112-365bc889aed3 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:35.196429 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e672ac18-3a04-426b-8112-365bc889aed3 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:35.197053 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e672ac18-3a04-426b-8112-365bc889aed3 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:35.668667 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-e672ac18-3a04-426b-8112-365bc889aed3 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:20:35.692619 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-e672ac18-3a04-426b-8112-365bc889aed3 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/7c6bc6d2-31de-4cff-a3f4-f9c685f11bdc" status: 200 len: 1202 microversion: 2.1 time: 0.540155 Oct 04 22:20:35.693566 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2957/5907] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:20:35 2022] GET /compute/v2.1/servers/7c6bc6d2-31de-4cff-a3f4-f9c685f11bdc => generated 1202 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:20:36.721005 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-86778f18-a3e6-4174-8132-62b1a4835c3b tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:20:36.723262 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-86778f18-a3e6-4174-8132-62b1a4835c3b tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: 7c6bc6d2-31de-4cff-a3f4-f9c685f11bdc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:20:36.734403 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-86778f18-a3e6-4174-8132-62b1a4835c3b tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:36.735108 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-86778f18-a3e6-4174-8132-62b1a4835c3b tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:36.735556 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-86778f18-a3e6-4174-8132-62b1a4835c3b tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:36.736441 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-86778f18-a3e6-4174-8132-62b1a4835c3b tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:36.737158 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-86778f18-a3e6-4174-8132-62b1a4835c3b tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:36.737535 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-86778f18-a3e6-4174-8132-62b1a4835c3b tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:36.928077 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-86778f18-a3e6-4174-8132-62b1a4835c3b tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:20:36.943653 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-86778f18-a3e6-4174-8132-62b1a4835c3b tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/7c6bc6d2-31de-4cff-a3f4-f9c685f11bdc" status: 200 len: 1202 microversion: 2.1 time: 0.228608 Oct 04 22:20:36.962984 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2958/5908] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:20:36 2022] GET /compute/v2.1/servers/7c6bc6d2-31de-4cff-a3f4-f9c685f11bdc => generated 1202 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:20:38.026711 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-19ff36b1-ccfd-4b78-b1d3-c485fe771191 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:20:38.026711 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-19ff36b1-ccfd-4b78-b1d3-c485fe771191 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: 7c6bc6d2-31de-4cff-a3f4-f9c685f11bdc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:20:38.026711 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-19ff36b1-ccfd-4b78-b1d3-c485fe771191 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:38.026711 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-19ff36b1-ccfd-4b78-b1d3-c485fe771191 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:38.026711 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-19ff36b1-ccfd-4b78-b1d3-c485fe771191 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:38.026711 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-19ff36b1-ccfd-4b78-b1d3-c485fe771191 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:38.028715 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-19ff36b1-ccfd-4b78-b1d3-c485fe771191 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:38.028715 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-19ff36b1-ccfd-4b78-b1d3-c485fe771191 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:38.345246 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-19ff36b1-ccfd-4b78-b1d3-c485fe771191 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:20:38.368898 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-19ff36b1-ccfd-4b78-b1d3-c485fe771191 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/7c6bc6d2-31de-4cff-a3f4-f9c685f11bdc" status: 200 len: 1202 microversion: 2.1 time: 0.398608 Oct 04 22:20:38.369747 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2959/5909] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:20:37 2022] GET /compute/v2.1/servers/7c6bc6d2-31de-4cff-a3f4-f9c685f11bdc => generated 1202 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:20:38.382328 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-301ec2c8-ac13-4904-9260-ead2295542f3 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Action: 'create', calling method: .version_select at 0x7fbb2e2244c0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1588319888", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIWre7ImD0TWcseGpJRt3DGtDWAnnoASmSh0NxsXQJxQ4wI2rQoRZ8s4mgE6u/0qIc5NWvMuO4hH2O3qM8emBmGrNybO9Q7fqfjgVwaeKKlw2ybVtXeCjQuZmM54naff4Q=="}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:20:38.418723 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-301ec2c8-ac13-4904-9260-ead2295542f3 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Getting quotas for project 286d184163154f2e846d521d368e3ead. Resources: {'key_pairs'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:20:38.426489 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-301ec2c8-ac13-4904-9260-ead2295542f3 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Getting quotas for user 94ac78e2767c49168f0464acea155be1 and project 286d184163154f2e846d521d368e3ead. Resources: {'key_pairs'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:20:38.466838 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-301ec2c8-ac13-4904-9260-ead2295542f3 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.089111 Oct 04 22:20:38.467682 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2960/5910] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Oct 4 22:20:38 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:20:39.407812 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-2a40491b-69dc-48ba-b399-2aeef47c62b7 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:20:39.409371 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-2a40491b-69dc-48ba-b399-2aeef47c62b7 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: 7c6bc6d2-31de-4cff-a3f4-f9c685f11bdc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:20:39.433806 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2a40491b-69dc-48ba-b399-2aeef47c62b7 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:39.438857 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2a40491b-69dc-48ba-b399-2aeef47c62b7 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:39.439560 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2a40491b-69dc-48ba-b399-2aeef47c62b7 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:39.442808 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2a40491b-69dc-48ba-b399-2aeef47c62b7 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:39.448268 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2a40491b-69dc-48ba-b399-2aeef47c62b7 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:39.452242 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2a40491b-69dc-48ba-b399-2aeef47c62b7 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:39.806345 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-2a40491b-69dc-48ba-b399-2aeef47c62b7 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:20:39.815567 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-2a40491b-69dc-48ba-b399-2aeef47c62b7 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/7c6bc6d2-31de-4cff-a3f4-f9c685f11bdc" status: 200 len: 1202 microversion: 2.1 time: 0.413131 Oct 04 22:20:39.817422 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2961/5911] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:20:39 2022] GET /compute/v2.1/servers/7c6bc6d2-31de-4cff-a3f4-f9c685f11bdc => generated 1202 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:20:40.307893 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-4916b783-0b8b-476c-9774-c0064eda776b tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-327925731", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452", "networks": [{"uuid": "9c319202-ff1b-45a7-98b1-1dbbc1eb3839"}], "key_name": "tempest-TestNetworkBasicOps-1588319888", "security_groups": [{"name": "tempest-secgroup-smoke-2002633707"}]}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:20:40.461852 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.network.neutron [None req-4916b783-0b8b-476c-9774-c0064eda776b tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] validate_networks() for [('9c319202-ff1b-45a7-98b1-1dbbc1eb3839', None, None, None, None, None)] {{(pid=134101) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 22:20:41.099302 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-4916b783-0b8b-476c-9774-c0064eda776b tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Flavor limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 22:20:41.101111 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-4916b783-0b8b-476c-9774-c0064eda776b tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Image limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 22:20:41.102590 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-4916b783-0b8b-476c-9774-c0064eda776b tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Flavor pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 22:20:41.103241 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-4916b783-0b8b-476c-9774-c0064eda776b tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Image pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 22:20:41.103999 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-4916b783-0b8b-476c-9774-c0064eda776b tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 22:20:41.137037 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4916b783-0b8b-476c-9774-c0064eda776b tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:41.137502 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4916b783-0b8b-476c-9774-c0064eda776b tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:41.138014 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4916b783-0b8b-476c-9774-c0064eda776b tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:41.153283 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4916b783-0b8b-476c-9774-c0064eda776b tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:41.154385 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4916b783-0b8b-476c-9774-c0064eda776b tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:41.155006 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4916b783-0b8b-476c-9774-c0064eda776b tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:41.204155 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-4916b783-0b8b-476c-9774-c0064eda776b tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Getting quotas for project 286d184163154f2e846d521d368e3ead. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:20:41.212067 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-4916b783-0b8b-476c-9774-c0064eda776b tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Getting quotas for user 94ac78e2767c49168f0464acea155be1 and project 286d184163154f2e846d521d368e3ead. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:20:41.226983 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-4916b783-0b8b-476c-9774-c0064eda776b tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Going to run 1 instances... {{(pid=134101) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 22:20:41.229744 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-4916b783-0b8b-476c-9774-c0064eda776b tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] [instance: 17fb2ff0-7ff4-4acf-a984-ef23ba8ec3dc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='58548514-5dac-426c-81f5-19e3fba33e23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134101) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 22:20:41.288706 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-4916b783-0b8b-476c-9774-c0064eda776b tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.984574 Oct 04 22:20:41.289936 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2962/5912] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 22:20:40 2022] POST /compute/v2.1/servers => generated 406 bytes in 987 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 22:20:41.300347 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-9ce343ec-14fb-4aef-85e7-06e61c8d5dd3 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:20:41.302252 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-9ce343ec-14fb-4aef-85e7-06e61c8d5dd3 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: 7c6bc6d2-31de-4cff-a3f4-f9c685f11bdc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:20:41.313491 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9ce343ec-14fb-4aef-85e7-06e61c8d5dd3 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:41.314294 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9ce343ec-14fb-4aef-85e7-06e61c8d5dd3 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:41.314943 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9ce343ec-14fb-4aef-85e7-06e61c8d5dd3 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:41.316236 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9ce343ec-14fb-4aef-85e7-06e61c8d5dd3 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:41.317631 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9ce343ec-14fb-4aef-85e7-06e61c8d5dd3 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:41.337877 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9ce343ec-14fb-4aef-85e7-06e61c8d5dd3 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:41.648589 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-9ce343ec-14fb-4aef-85e7-06e61c8d5dd3 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:20:41.681213 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-9ce343ec-14fb-4aef-85e7-06e61c8d5dd3 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/7c6bc6d2-31de-4cff-a3f4-f9c685f11bdc" status: 200 len: 1202 microversion: 2.1 time: 0.374071 Oct 04 22:20:41.682855 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2963/5913] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:20:41 2022] GET /compute/v2.1/servers/7c6bc6d2-31de-4cff-a3f4-f9c685f11bdc => generated 1202 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:20:41.692450 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-3846fbd0-970d-4793-87e8-8031ea8e3deb tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:20:41.703764 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-3846fbd0-970d-4793-87e8-8031ea8e3deb tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] [instance: 17fb2ff0-7ff4-4acf-a984-ef23ba8ec3dc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:20:41.805576 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-3846fbd0-970d-4793-87e8-8031ea8e3deb tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ac78e2767c49168f0464acea155be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286d184163154f2e846d521d368e3ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:20:41.817933 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-3846fbd0-970d-4793-87e8-8031ea8e3deb tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] 10.222.0.43 "GET /compute/v2.1/servers/17fb2ff0-7ff4-4acf-a984-ef23ba8ec3dc" status: 200 len: 1248 microversion: 2.1 time: 0.130242 Oct 04 22:20:41.856058 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2964/5914] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:20:41 2022] GET /compute/v2.1/servers/17fb2ff0-7ff4-4acf-a984-ef23ba8ec3dc => generated 1248 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:20:42.119931 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-a73ca1b1-47e9-41e3-b3f8-1b445c0fc284 req-b7b95229-14f6-4d0c-809a-727ef3fce79d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c6bc6d2-31de-4cff-a3f4-f9c685f11bdc", "name": "network-vif-plugged", "status": "completed", "tag": "bf5f968c-8199-4de6-a241-0d2f47fba437"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:20:42.168258 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-a73ca1b1-47e9-41e3-b3f8-1b445c0fc284 req-b7b95229-14f6-4d0c-809a-727ef3fce79d service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:42.168258 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-a73ca1b1-47e9-41e3-b3f8-1b445c0fc284 req-b7b95229-14f6-4d0c-809a-727ef3fce79d service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:42.168431 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-a73ca1b1-47e9-41e3-b3f8-1b445c0fc284 req-b7b95229-14f6-4d0c-809a-727ef3fce79d service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:42.185658 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-a73ca1b1-47e9-41e3-b3f8-1b445c0fc284 req-b7b95229-14f6-4d0c-809a-727ef3fce79d service nova] Creating event network-vif-plugged:bf5f968c-8199-4de6-a241-0d2f47fba437 for instance 7c6bc6d2-31de-4cff-a3f4-f9c685f11bdc on n-h2-860284-1 Oct 04 22:20:42.192042 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-a73ca1b1-47e9-41e3-b3f8-1b445c0fc284 req-b7b95229-14f6-4d0c-809a-727ef3fce79d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.208120 Oct 04 22:20:42.194098 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2965/5915] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:20:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:20:42.708627 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-a999ae35-48f7-4608-9a16-6b56373cc7c8 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:20:42.710145 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-a999ae35-48f7-4608-9a16-6b56373cc7c8 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: 7c6bc6d2-31de-4cff-a3f4-f9c685f11bdc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:20:42.717114 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a999ae35-48f7-4608-9a16-6b56373cc7c8 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:42.717630 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a999ae35-48f7-4608-9a16-6b56373cc7c8 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:42.718077 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a999ae35-48f7-4608-9a16-6b56373cc7c8 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:42.718884 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a999ae35-48f7-4608-9a16-6b56373cc7c8 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:42.719350 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a999ae35-48f7-4608-9a16-6b56373cc7c8 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:42.719817 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a999ae35-48f7-4608-9a16-6b56373cc7c8 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:42.869347 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-a999ae35-48f7-4608-9a16-6b56373cc7c8 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:20:42.877643 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-a999ae35-48f7-4608-9a16-6b56373cc7c8 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/7c6bc6d2-31de-4cff-a3f4-f9c685f11bdc" status: 200 len: 1202 microversion: 2.1 time: 0.175075 Oct 04 22:20:42.890447 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2966/5916] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:20:42 2022] GET /compute/v2.1/servers/7c6bc6d2-31de-4cff-a3f4-f9c685f11bdc => generated 1202 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:20:42.890447 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-7928055c-7377-4ed7-9422-513755fbe3b9 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:20:42.890447 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-7928055c-7377-4ed7-9422-513755fbe3b9 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] [instance: 17fb2ff0-7ff4-4acf-a984-ef23ba8ec3dc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:20:42.898065 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7928055c-7377-4ed7-9422-513755fbe3b9 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:42.898601 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7928055c-7377-4ed7-9422-513755fbe3b9 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:42.899045 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7928055c-7377-4ed7-9422-513755fbe3b9 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:42.899766 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7928055c-7377-4ed7-9422-513755fbe3b9 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:42.900267 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7928055c-7377-4ed7-9422-513755fbe3b9 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:42.900683 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7928055c-7377-4ed7-9422-513755fbe3b9 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:42.978629 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-7928055c-7377-4ed7-9422-513755fbe3b9 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ac78e2767c49168f0464acea155be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286d184163154f2e846d521d368e3ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:20:42.986802 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-7928055c-7377-4ed7-9422-513755fbe3b9 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] 10.222.0.43 "GET /compute/v2.1/servers/17fb2ff0-7ff4-4acf-a984-ef23ba8ec3dc" status: 200 len: 1300 microversion: 2.1 time: 0.104792 Oct 04 22:20:42.987765 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2967/5917] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:20:42 2022] GET /compute/v2.1/servers/17fb2ff0-7ff4-4acf-a984-ef23ba8ec3dc => generated 1300 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:20:43.903909 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-96db706c-7087-4111-9a97-8d50df419ff1 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:20:43.904581 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-96db706c-7087-4111-9a97-8d50df419ff1 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: 7c6bc6d2-31de-4cff-a3f4-f9c685f11bdc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:20:43.919807 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-96db706c-7087-4111-9a97-8d50df419ff1 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:43.920348 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-96db706c-7087-4111-9a97-8d50df419ff1 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:43.920846 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-96db706c-7087-4111-9a97-8d50df419ff1 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:43.921507 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-96db706c-7087-4111-9a97-8d50df419ff1 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:43.921966 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-96db706c-7087-4111-9a97-8d50df419ff1 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:43.928328 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-96db706c-7087-4111-9a97-8d50df419ff1 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:44.287526 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-96db706c-7087-4111-9a97-8d50df419ff1 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:20:44.296730 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-96db706c-7087-4111-9a97-8d50df419ff1 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/7c6bc6d2-31de-4cff-a3f4-f9c685f11bdc" status: 200 len: 1202 microversion: 2.1 time: 0.397309 Oct 04 22:20:44.312883 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2968/5918] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:20:43 2022] GET /compute/v2.1/servers/7c6bc6d2-31de-4cff-a3f4-f9c685f11bdc => generated 1202 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:20:44.313228 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-32e5f374-1830-49a4-9b97-856ea321d74b tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:20:44.321698 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-32e5f374-1830-49a4-9b97-856ea321d74b tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] [instance: 17fb2ff0-7ff4-4acf-a984-ef23ba8ec3dc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:20:44.329850 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-32e5f374-1830-49a4-9b97-856ea321d74b tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:44.330599 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-32e5f374-1830-49a4-9b97-856ea321d74b tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:44.331195 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-32e5f374-1830-49a4-9b97-856ea321d74b tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:44.332119 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-32e5f374-1830-49a4-9b97-856ea321d74b tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:44.333009 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-32e5f374-1830-49a4-9b97-856ea321d74b tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:44.333687 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-32e5f374-1830-49a4-9b97-856ea321d74b tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:44.656214 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-32e5f374-1830-49a4-9b97-856ea321d74b tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ac78e2767c49168f0464acea155be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286d184163154f2e846d521d368e3ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:20:44.665197 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-32e5f374-1830-49a4-9b97-856ea321d74b tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] 10.222.0.43 "GET /compute/v2.1/servers/17fb2ff0-7ff4-4acf-a984-ef23ba8ec3dc" status: 200 len: 1374 microversion: 2.1 time: 0.356310 Oct 04 22:20:44.666093 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2969/5919] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:20:44 2022] GET /compute/v2.1/servers/17fb2ff0-7ff4-4acf-a984-ef23ba8ec3dc => generated 1374 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:20:45.125614 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-8da81472-fe97-4fb0-b47d-5bd74e74f80b req-a19667ba-99f5-45f5-bc0c-56c05695306a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17fb2ff0-7ff4-4acf-a984-ef23ba8ec3dc", "tag": "2a05598a-68c7-4079-85a9-3466be4f8f63"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:20:45.151054 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-8da81472-fe97-4fb0-b47d-5bd74e74f80b req-a19667ba-99f5-45f5-bc0c-56c05695306a service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:45.162530 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-8da81472-fe97-4fb0-b47d-5bd74e74f80b req-a19667ba-99f5-45f5-bc0c-56c05695306a service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:45.163919 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-8da81472-fe97-4fb0-b47d-5bd74e74f80b req-a19667ba-99f5-45f5-bc0c-56c05695306a service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:45.180320 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-8da81472-fe97-4fb0-b47d-5bd74e74f80b req-a19667ba-99f5-45f5-bc0c-56c05695306a service nova] Creating event network-changed:2a05598a-68c7-4079-85a9-3466be4f8f63 for instance 17fb2ff0-7ff4-4acf-a984-ef23ba8ec3dc on n-h1-860284-1 Oct 04 22:20:45.186610 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-8da81472-fe97-4fb0-b47d-5bd74e74f80b req-a19667ba-99f5-45f5-bc0c-56c05695306a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074821 Oct 04 22:20:45.187847 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2970/5920] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:20:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:20:45.325746 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-2ce7f6a1-d8be-403f-9c9e-7bdab21a233e tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:20:45.326572 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-2ce7f6a1-d8be-403f-9c9e-7bdab21a233e tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: 7c6bc6d2-31de-4cff-a3f4-f9c685f11bdc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:20:45.339546 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2ce7f6a1-d8be-403f-9c9e-7bdab21a233e tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:45.340643 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2ce7f6a1-d8be-403f-9c9e-7bdab21a233e tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:45.341327 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2ce7f6a1-d8be-403f-9c9e-7bdab21a233e tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:45.342409 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2ce7f6a1-d8be-403f-9c9e-7bdab21a233e tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:45.343059 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2ce7f6a1-d8be-403f-9c9e-7bdab21a233e tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:45.344033 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2ce7f6a1-d8be-403f-9c9e-7bdab21a233e tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:45.350842 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=100 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:20:45.697141 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-2ce7f6a1-d8be-403f-9c9e-7bdab21a233e tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:20:45.708600 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-2ce7f6a1-d8be-403f-9c9e-7bdab21a233e tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/7c6bc6d2-31de-4cff-a3f4-f9c685f11bdc" status: 200 len: 1390 microversion: 2.1 time: 0.388692 Oct 04 22:20:45.709194 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2971/5921] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:20:45 2022] GET /compute/v2.1/servers/7c6bc6d2-31de-4cff-a3f4-f9c685f11bdc => generated 1390 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:20:45.718188 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-09837ea4-9957-4030-8b5b-fd0a63be07b5 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:20:45.719936 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-09837ea4-9957-4030-8b5b-fd0a63be07b5 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] [instance: 17fb2ff0-7ff4-4acf-a984-ef23ba8ec3dc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:20:45.734057 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-09837ea4-9957-4030-8b5b-fd0a63be07b5 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:45.734596 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-09837ea4-9957-4030-8b5b-fd0a63be07b5 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:45.735041 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-09837ea4-9957-4030-8b5b-fd0a63be07b5 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:45.735760 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-09837ea4-9957-4030-8b5b-fd0a63be07b5 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:45.736224 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-09837ea4-9957-4030-8b5b-fd0a63be07b5 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:45.739360 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-09837ea4-9957-4030-8b5b-fd0a63be07b5 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:46.086072 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-09837ea4-9957-4030-8b5b-fd0a63be07b5 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ac78e2767c49168f0464acea155be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286d184163154f2e846d521d368e3ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:20:46.095361 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-09837ea4-9957-4030-8b5b-fd0a63be07b5 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] 10.222.0.43 "GET /compute/v2.1/servers/17fb2ff0-7ff4-4acf-a984-ef23ba8ec3dc" status: 200 len: 1374 microversion: 2.1 time: 0.384907 Oct 04 22:20:46.112701 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2972/5922] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:20:45 2022] GET /compute/v2.1/servers/17fb2ff0-7ff4-4acf-a984-ef23ba8ec3dc => generated 1374 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:20:46.118706 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-c560e42b-4688-415c-95b4-e31686bcd0d0 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:20:46.119338 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-c560e42b-4688-415c-95b4-e31686bcd0d0 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: 7c6bc6d2-31de-4cff-a3f4-f9c685f11bdc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:20:46.128853 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c560e42b-4688-415c-95b4-e31686bcd0d0 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:46.130632 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c560e42b-4688-415c-95b4-e31686bcd0d0 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:46.131255 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c560e42b-4688-415c-95b4-e31686bcd0d0 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:46.132162 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c560e42b-4688-415c-95b4-e31686bcd0d0 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:46.132774 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c560e42b-4688-415c-95b4-e31686bcd0d0 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:46.133568 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c560e42b-4688-415c-95b4-e31686bcd0d0 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:46.332905 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-c560e42b-4688-415c-95b4-e31686bcd0d0 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:20:46.342680 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-c560e42b-4688-415c-95b4-e31686bcd0d0 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/7c6bc6d2-31de-4cff-a3f4-f9c685f11bdc" status: 200 len: 1390 microversion: 2.1 time: 0.227856 Oct 04 22:20:46.343404 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2973/5923] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:20:46 2022] GET /compute/v2.1/servers/7c6bc6d2-31de-4cff-a3f4-f9c685f11bdc => generated 1390 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:20:46.366649 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-a6f05f09-f33a-4d45-811f-78972f13a682 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:20:46.367297 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-a6f05f09-f33a-4d45-811f-78972f13a682 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: 7c6bc6d2-31de-4cff-a3f4-f9c685f11bdc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:20:46.375244 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a6f05f09-f33a-4d45-811f-78972f13a682 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:46.376017 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a6f05f09-f33a-4d45-811f-78972f13a682 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:46.376623 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a6f05f09-f33a-4d45-811f-78972f13a682 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:46.377539 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a6f05f09-f33a-4d45-811f-78972f13a682 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:46.378165 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a6f05f09-f33a-4d45-811f-78972f13a682 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:46.379450 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a6f05f09-f33a-4d45-811f-78972f13a682 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:46.589589 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-a6f05f09-f33a-4d45-811f-78972f13a682 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:20:46.599841 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-a6f05f09-f33a-4d45-811f-78972f13a682 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/7c6bc6d2-31de-4cff-a3f4-f9c685f11bdc" status: 200 len: 1390 microversion: 2.1 time: 0.237723 Oct 04 22:20:46.600590 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2974/5924] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:20:46 2022] GET /compute/v2.1/servers/7c6bc6d2-31de-4cff-a3f4-f9c685f11bdc => generated 1390 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:20:46.623001 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-7681bb32-73bd-4142-86dc-2057101b4999 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:20:46.623906 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-7681bb32-73bd-4142-86dc-2057101b4999 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: 7c6bc6d2-31de-4cff-a3f4-f9c685f11bdc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:20:46.631454 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7681bb32-73bd-4142-86dc-2057101b4999 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:46.632126 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7681bb32-73bd-4142-86dc-2057101b4999 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:46.632686 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7681bb32-73bd-4142-86dc-2057101b4999 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:46.633515 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7681bb32-73bd-4142-86dc-2057101b4999 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:46.634109 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7681bb32-73bd-4142-86dc-2057101b4999 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:46.634756 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7681bb32-73bd-4142-86dc-2057101b4999 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:46.675075 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-7681bb32-73bd-4142-86dc-2057101b4999 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: 7c6bc6d2-31de-4cff-a3f4-f9c685f11bdc] Going to try to terminate instance {{(pid=134101) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 22:20:46.766219 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=1,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:20:46.783229 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-7681bb32-73bd-4142-86dc-2057101b4999 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "DELETE /compute/v2.1/servers/7c6bc6d2-31de-4cff-a3f4-f9c685f11bdc" status: 204 len: 0 microversion: 2.1 time: 0.164791 Oct 04 22:20:46.788760 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2975/5925] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 22:20:46 2022] DELETE /compute/v2.1/servers/7c6bc6d2-31de-4cff-a3f4-f9c685f11bdc => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 22:20:46.795030 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-f198e97d-e4cf-489a-8aab-07064492094c tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:20:46.795757 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-f198e97d-e4cf-489a-8aab-07064492094c tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: 7c6bc6d2-31de-4cff-a3f4-f9c685f11bdc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:20:46.808769 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f198e97d-e4cf-489a-8aab-07064492094c tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:46.809284 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f198e97d-e4cf-489a-8aab-07064492094c tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:46.809805 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f198e97d-e4cf-489a-8aab-07064492094c tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:46.812501 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f198e97d-e4cf-489a-8aab-07064492094c tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:46.812501 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f198e97d-e4cf-489a-8aab-07064492094c tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:46.812501 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f198e97d-e4cf-489a-8aab-07064492094c tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:46.984265 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-f198e97d-e4cf-489a-8aab-07064492094c tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:20:46.994765 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-f198e97d-e4cf-489a-8aab-07064492094c tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/7c6bc6d2-31de-4cff-a3f4-f9c685f11bdc" status: 200 len: 1396 microversion: 2.1 time: 0.204487 Oct 04 22:20:47.005999 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2976/5926] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:20:46 2022] GET /compute/v2.1/servers/7c6bc6d2-31de-4cff-a3f4-f9c685f11bdc => generated 1396 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:20:47.123970 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-3395645a-d90c-4276-a12f-410847c8402c tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:20:47.125002 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-3395645a-d90c-4276-a12f-410847c8402c tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] [instance: 17fb2ff0-7ff4-4acf-a984-ef23ba8ec3dc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:20:47.135519 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3395645a-d90c-4276-a12f-410847c8402c tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:47.136756 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3395645a-d90c-4276-a12f-410847c8402c tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:47.137515 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3395645a-d90c-4276-a12f-410847c8402c tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:47.138597 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3395645a-d90c-4276-a12f-410847c8402c tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:47.139139 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3395645a-d90c-4276-a12f-410847c8402c tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:47.139650 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3395645a-d90c-4276-a12f-410847c8402c tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:47.302646 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-3395645a-d90c-4276-a12f-410847c8402c tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ac78e2767c49168f0464acea155be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286d184163154f2e846d521d368e3ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:20:47.311706 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-3395645a-d90c-4276-a12f-410847c8402c tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] 10.222.0.43 "GET /compute/v2.1/servers/17fb2ff0-7ff4-4acf-a984-ef23ba8ec3dc" status: 200 len: 1374 microversion: 2.1 time: 0.193682 Oct 04 22:20:47.312584 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2977/5927] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:20:47 2022] GET /compute/v2.1/servers/17fb2ff0-7ff4-4acf-a984-ef23ba8ec3dc => generated 1374 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:20:48.020809 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-27b22ef8-e216-4af6-bffc-7c1e60701f5c tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:20:48.021618 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-27b22ef8-e216-4af6-bffc-7c1e60701f5c tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: 7c6bc6d2-31de-4cff-a3f4-f9c685f11bdc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:20:48.045229 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-27b22ef8-e216-4af6-bffc-7c1e60701f5c tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:48.047214 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-27b22ef8-e216-4af6-bffc-7c1e60701f5c tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:48.047676 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-27b22ef8-e216-4af6-bffc-7c1e60701f5c tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:48.051880 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-27b22ef8-e216-4af6-bffc-7c1e60701f5c tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:48.053610 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-27b22ef8-e216-4af6-bffc-7c1e60701f5c tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:48.055362 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-27b22ef8-e216-4af6-bffc-7c1e60701f5c tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:48.236411 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-27b22ef8-e216-4af6-bffc-7c1e60701f5c tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:20:48.245612 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-27b22ef8-e216-4af6-bffc-7c1e60701f5c tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/7c6bc6d2-31de-4cff-a3f4-f9c685f11bdc" status: 200 len: 1396 microversion: 2.1 time: 0.230252 Oct 04 22:20:48.246219 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2978/5928] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:20:48 2022] GET /compute/v2.1/servers/7c6bc6d2-31de-4cff-a3f4-f9c685f11bdc => generated 1396 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:20:48.337875 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-aa315687-6fc9-4c8c-b501-d96035b27731 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:20:48.338454 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-aa315687-6fc9-4c8c-b501-d96035b27731 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] [instance: 17fb2ff0-7ff4-4acf-a984-ef23ba8ec3dc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:20:48.345444 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-aa315687-6fc9-4c8c-b501-d96035b27731 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:48.345966 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-aa315687-6fc9-4c8c-b501-d96035b27731 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:48.346435 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-aa315687-6fc9-4c8c-b501-d96035b27731 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:48.348294 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-aa315687-6fc9-4c8c-b501-d96035b27731 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:48.349003 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-aa315687-6fc9-4c8c-b501-d96035b27731 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:48.349444 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-aa315687-6fc9-4c8c-b501-d96035b27731 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:48.603898 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-aa315687-6fc9-4c8c-b501-d96035b27731 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ac78e2767c49168f0464acea155be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286d184163154f2e846d521d368e3ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:20:48.630632 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-aa315687-6fc9-4c8c-b501-d96035b27731 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] 10.222.0.43 "GET /compute/v2.1/servers/17fb2ff0-7ff4-4acf-a984-ef23ba8ec3dc" status: 200 len: 1374 microversion: 2.1 time: 0.295170 Oct 04 22:20:48.635998 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2979/5929] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:20:48 2022] GET /compute/v2.1/servers/17fb2ff0-7ff4-4acf-a984-ef23ba8ec3dc => generated 1374 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:20:49.270066 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-783b1518-de64-4280-8f09-1a179702d136 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:20:49.270893 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-783b1518-de64-4280-8f09-1a179702d136 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: 7c6bc6d2-31de-4cff-a3f4-f9c685f11bdc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:20:49.278741 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-783b1518-de64-4280-8f09-1a179702d136 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:49.280056 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-783b1518-de64-4280-8f09-1a179702d136 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:49.280737 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-783b1518-de64-4280-8f09-1a179702d136 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:49.282853 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-783b1518-de64-4280-8f09-1a179702d136 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:49.284251 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-783b1518-de64-4280-8f09-1a179702d136 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:49.284828 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-783b1518-de64-4280-8f09-1a179702d136 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:49.418453 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-783b1518-de64-4280-8f09-1a179702d136 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:20:49.440495 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-783b1518-de64-4280-8f09-1a179702d136 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/7c6bc6d2-31de-4cff-a3f4-f9c685f11bdc" status: 200 len: 1354 microversion: 2.1 time: 0.174930 Oct 04 22:20:49.442599 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2980/5930] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:20:49 2022] GET /compute/v2.1/servers/7c6bc6d2-31de-4cff-a3f4-f9c685f11bdc => generated 1354 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:20:49.572043 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-be21a0a2-04c1-4774-aee9-4b0c6bb46f52 req-952649af-f62b-4a3f-ae1d-29c1b0b72e84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c6bc6d2-31de-4cff-a3f4-f9c685f11bdc", "name": "network-vif-deleted", "tag": "bf5f968c-8199-4de6-a241-0d2f47fba437"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:20:49.594903 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-be21a0a2-04c1-4774-aee9-4b0c6bb46f52 req-952649af-f62b-4a3f-ae1d-29c1b0b72e84 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:49.597996 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-be21a0a2-04c1-4774-aee9-4b0c6bb46f52 req-952649af-f62b-4a3f-ae1d-29c1b0b72e84 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:49.598725 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-be21a0a2-04c1-4774-aee9-4b0c6bb46f52 req-952649af-f62b-4a3f-ae1d-29c1b0b72e84 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:49.633446 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-be21a0a2-04c1-4774-aee9-4b0c6bb46f52 req-952649af-f62b-4a3f-ae1d-29c1b0b72e84 service nova] Creating event network-vif-deleted:bf5f968c-8199-4de6-a241-0d2f47fba437 for instance 7c6bc6d2-31de-4cff-a3f4-f9c685f11bdc on n-h2-860284-1 Oct 04 22:20:49.653374 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-be21a0a2-04c1-4774-aee9-4b0c6bb46f52 req-952649af-f62b-4a3f-ae1d-29c1b0b72e84 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078876 Oct 04 22:20:49.653374 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2981/5931] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:20:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:20:49.667887 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-7fa275ff-5ed7-4763-9f34-2b5a9f178bd6 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:20:49.668727 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-7fa275ff-5ed7-4763-9f34-2b5a9f178bd6 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] [instance: 17fb2ff0-7ff4-4acf-a984-ef23ba8ec3dc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:20:49.676048 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7fa275ff-5ed7-4763-9f34-2b5a9f178bd6 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:49.676550 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7fa275ff-5ed7-4763-9f34-2b5a9f178bd6 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:49.677745 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7fa275ff-5ed7-4763-9f34-2b5a9f178bd6 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:49.678454 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7fa275ff-5ed7-4763-9f34-2b5a9f178bd6 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:49.678928 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7fa275ff-5ed7-4763-9f34-2b5a9f178bd6 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:49.679364 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7fa275ff-5ed7-4763-9f34-2b5a9f178bd6 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:49.986730 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-7fa275ff-5ed7-4763-9f34-2b5a9f178bd6 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ac78e2767c49168f0464acea155be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286d184163154f2e846d521d368e3ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:20:50.000263 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-7fa275ff-5ed7-4763-9f34-2b5a9f178bd6 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] 10.222.0.43 "GET /compute/v2.1/servers/17fb2ff0-7ff4-4acf-a984-ef23ba8ec3dc" status: 200 len: 1374 microversion: 2.1 time: 0.340812 Oct 04 22:20:50.001505 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2982/5932] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:20:49 2022] GET /compute/v2.1/servers/17fb2ff0-7ff4-4acf-a984-ef23ba8ec3dc => generated 1374 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:20:50.010296 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-1ff39c1c-abd2-4ee3-b7ef-a00fa6d8f46a tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ed51c8b8-4d49-4ca2-b479-5c8ecfb288ca"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:20:50.013037 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-1ff39c1c-abd2-4ee3-b7ef-a00fa6d8f46a tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] [instance: 317528e8-218a-462c-93a1-0e56caf0ea3b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:20:50.030222 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1ff39c1c-abd2-4ee3-b7ef-a00fa6d8f46a tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:50.030952 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1ff39c1c-abd2-4ee3-b7ef-a00fa6d8f46a tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:50.031776 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1ff39c1c-abd2-4ee3-b7ef-a00fa6d8f46a tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:50.032766 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1ff39c1c-abd2-4ee3-b7ef-a00fa6d8f46a tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:50.033443 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1ff39c1c-abd2-4ee3-b7ef-a00fa6d8f46a tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:50.034131 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1ff39c1c-abd2-4ee3-b7ef-a00fa6d8f46a tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:50.595214 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-1ff39c1c-abd2-4ee3-b7ef-a00fa6d8f46a tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] 10.222.0.43 "POST /compute/v2.1/servers/317528e8-218a-462c-93a1-0e56caf0ea3b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.591145 Oct 04 22:20:50.595944 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2983/5933] 10.222.0.43 () {60 vars in 1323 bytes} [Tue Oct 4 22:20:50 2022] POST /compute/v2.1/servers/317528e8-218a-462c-93a1-0e56caf0ea3b/os-volume_attachments => generated 194 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:20:50.625408 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-67d8e034-d1e8-4f83-b7aa-a9e7db027720 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:20:50.629835 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-67d8e034-d1e8-4f83-b7aa-a9e7db027720 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: 7c6bc6d2-31de-4cff-a3f4-f9c685f11bdc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:20:50.638964 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-67d8e034-d1e8-4f83-b7aa-a9e7db027720 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:50.639536 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-67d8e034-d1e8-4f83-b7aa-a9e7db027720 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:50.639984 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-67d8e034-d1e8-4f83-b7aa-a9e7db027720 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:50.640710 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-67d8e034-d1e8-4f83-b7aa-a9e7db027720 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:50.641213 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-67d8e034-d1e8-4f83-b7aa-a9e7db027720 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:50.641657 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-67d8e034-d1e8-4f83-b7aa-a9e7db027720 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:50.807492 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-67d8e034-d1e8-4f83-b7aa-a9e7db027720 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:20:50.818340 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-67d8e034-d1e8-4f83-b7aa-a9e7db027720 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/7c6bc6d2-31de-4cff-a3f4-f9c685f11bdc" status: 200 len: 1187 microversion: 2.1 time: 0.202853 Oct 04 22:20:50.819615 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2984/5934] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:20:50 2022] GET /compute/v2.1/servers/7c6bc6d2-31de-4cff-a3f4-f9c685f11bdc => generated 1187 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:20:51.028433 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-1e98bb03-3cfc-4937-af22-1ac88f3912dd tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:20:51.029057 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-1e98bb03-3cfc-4937-af22-1ac88f3912dd tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] [instance: 17fb2ff0-7ff4-4acf-a984-ef23ba8ec3dc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:20:51.040364 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1e98bb03-3cfc-4937-af22-1ac88f3912dd tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:51.045465 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1e98bb03-3cfc-4937-af22-1ac88f3912dd tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:51.046230 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1e98bb03-3cfc-4937-af22-1ac88f3912dd tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:51.047172 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1e98bb03-3cfc-4937-af22-1ac88f3912dd tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:51.047812 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1e98bb03-3cfc-4937-af22-1ac88f3912dd tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:51.050575 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1e98bb03-3cfc-4937-af22-1ac88f3912dd tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:51.087936 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:20:51.194159 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=2 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:20:51.312415 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-1e98bb03-3cfc-4937-af22-1ac88f3912dd tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ac78e2767c49168f0464acea155be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286d184163154f2e846d521d368e3ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:20:51.337627 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-1e98bb03-3cfc-4937-af22-1ac88f3912dd tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] 10.222.0.43 "GET /compute/v2.1/servers/17fb2ff0-7ff4-4acf-a984-ef23ba8ec3dc" status: 200 len: 1374 microversion: 2.1 time: 0.313086 Oct 04 22:20:51.340567 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2985/5935] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:20:51 2022] GET /compute/v2.1/servers/17fb2ff0-7ff4-4acf-a984-ef23ba8ec3dc => generated 1374 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:20:51.844813 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-82853bfb-5beb-49bf-9a97-ad6be487facb tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:20:51.845553 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-82853bfb-5beb-49bf-9a97-ad6be487facb tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: 7c6bc6d2-31de-4cff-a3f4-f9c685f11bdc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:20:51.848431 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=12 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:20:51.859509 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-82853bfb-5beb-49bf-9a97-ad6be487facb tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:51.860101 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-82853bfb-5beb-49bf-9a97-ad6be487facb tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:51.860759 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-82853bfb-5beb-49bf-9a97-ad6be487facb tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:51.861690 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-82853bfb-5beb-49bf-9a97-ad6be487facb tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:51.862398 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-82853bfb-5beb-49bf-9a97-ad6be487facb tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:51.863101 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-82853bfb-5beb-49bf-9a97-ad6be487facb tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:51.969264 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-82853bfb-5beb-49bf-9a97-ad6be487facb tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:20:51.982147 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-82853bfb-5beb-49bf-9a97-ad6be487facb tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/7c6bc6d2-31de-4cff-a3f4-f9c685f11bdc" status: 200 len: 1187 microversion: 2.1 time: 0.141843 Oct 04 22:20:51.984647 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2986/5936] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:20:51 2022] GET /compute/v2.1/servers/7c6bc6d2-31de-4cff-a3f4-f9c685f11bdc => generated 1187 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:20:52.369694 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e1ef3b29-0de6-44e5-bbe5-8d83c16b49b0 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:20:52.370240 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-e1ef3b29-0de6-44e5-bbe5-8d83c16b49b0 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] [instance: 17fb2ff0-7ff4-4acf-a984-ef23ba8ec3dc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:20:52.384040 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e1ef3b29-0de6-44e5-bbe5-8d83c16b49b0 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:52.384548 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e1ef3b29-0de6-44e5-bbe5-8d83c16b49b0 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:52.384989 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e1ef3b29-0de6-44e5-bbe5-8d83c16b49b0 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:52.385709 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e1ef3b29-0de6-44e5-bbe5-8d83c16b49b0 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:52.386164 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e1ef3b29-0de6-44e5-bbe5-8d83c16b49b0 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:52.389847 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e1ef3b29-0de6-44e5-bbe5-8d83c16b49b0 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:52.700371 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-e1ef3b29-0de6-44e5-bbe5-8d83c16b49b0 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ac78e2767c49168f0464acea155be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286d184163154f2e846d521d368e3ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:20:52.710603 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-e1ef3b29-0de6-44e5-bbe5-8d83c16b49b0 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] 10.222.0.43 "GET /compute/v2.1/servers/17fb2ff0-7ff4-4acf-a984-ef23ba8ec3dc" status: 200 len: 1374 microversion: 2.1 time: 0.344959 Oct 04 22:20:52.723514 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2987/5937] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:20:52 2022] GET /compute/v2.1/servers/17fb2ff0-7ff4-4acf-a984-ef23ba8ec3dc => generated 1374 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:20:52.733909 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-e9ab4f94-ea18-4e4c-b8a5-1c731bf1041e req-8204e467-b09e-416f-9855-040a8c575d38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17fb2ff0-7ff4-4acf-a984-ef23ba8ec3dc", "name": "network-vif-plugged", "status": "completed", "tag": "2a05598a-68c7-4079-85a9-3466be4f8f63"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:20:52.745300 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-e9ab4f94-ea18-4e4c-b8a5-1c731bf1041e req-8204e467-b09e-416f-9855-040a8c575d38 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:52.746201 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-e9ab4f94-ea18-4e4c-b8a5-1c731bf1041e req-8204e467-b09e-416f-9855-040a8c575d38 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:52.746832 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-e9ab4f94-ea18-4e4c-b8a5-1c731bf1041e req-8204e467-b09e-416f-9855-040a8c575d38 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:52.764529 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-e9ab4f94-ea18-4e4c-b8a5-1c731bf1041e req-8204e467-b09e-416f-9855-040a8c575d38 service nova] Creating event network-vif-plugged:2a05598a-68c7-4079-85a9-3466be4f8f63 for instance 17fb2ff0-7ff4-4acf-a984-ef23ba8ec3dc on n-h1-860284-1 Oct 04 22:20:52.780645 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-e9ab4f94-ea18-4e4c-b8a5-1c731bf1041e req-8204e467-b09e-416f-9855-040a8c575d38 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052332 Oct 04 22:20:52.781286 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2988/5938] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:20:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:20:53.011100 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-56079672-c4ef-4add-a138-49c4ac1bc52b tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:20:53.012457 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-56079672-c4ef-4add-a138-49c4ac1bc52b tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: 7c6bc6d2-31de-4cff-a3f4-f9c685f11bdc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:20:53.026352 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-56079672-c4ef-4add-a138-49c4ac1bc52b tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:53.026985 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-56079672-c4ef-4add-a138-49c4ac1bc52b tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:53.027578 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-56079672-c4ef-4add-a138-49c4ac1bc52b tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:53.031358 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-56079672-c4ef-4add-a138-49c4ac1bc52b tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:53.032503 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-56079672-c4ef-4add-a138-49c4ac1bc52b tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:53.033573 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-56079672-c4ef-4add-a138-49c4ac1bc52b tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:53.149186 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-56079672-c4ef-4add-a138-49c4ac1bc52b tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:20:53.158035 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-56079672-c4ef-4add-a138-49c4ac1bc52b tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/7c6bc6d2-31de-4cff-a3f4-f9c685f11bdc" status: 200 len: 1187 microversion: 2.1 time: 0.151665 Oct 04 22:20:53.161354 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2989/5939] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:20:53 2022] GET /compute/v2.1/servers/7c6bc6d2-31de-4cff-a3f4-f9c685f11bdc => generated 1187 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:20:53.740155 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-efff0723-97ea-41c9-b9ad-48d164550dc0 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:20:53.741131 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-efff0723-97ea-41c9-b9ad-48d164550dc0 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] [instance: 17fb2ff0-7ff4-4acf-a984-ef23ba8ec3dc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:20:53.748569 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-efff0723-97ea-41c9-b9ad-48d164550dc0 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:53.749090 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-efff0723-97ea-41c9-b9ad-48d164550dc0 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:53.749657 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-efff0723-97ea-41c9-b9ad-48d164550dc0 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:53.750555 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-efff0723-97ea-41c9-b9ad-48d164550dc0 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:53.751134 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-efff0723-97ea-41c9-b9ad-48d164550dc0 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:53.751698 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-efff0723-97ea-41c9-b9ad-48d164550dc0 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:53.926478 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-efff0723-97ea-41c9-b9ad-48d164550dc0 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ac78e2767c49168f0464acea155be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286d184163154f2e846d521d368e3ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:20:53.936698 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-efff0723-97ea-41c9-b9ad-48d164550dc0 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] 10.222.0.43 "GET /compute/v2.1/servers/17fb2ff0-7ff4-4acf-a984-ef23ba8ec3dc" status: 200 len: 1374 microversion: 2.1 time: 0.201810 Oct 04 22:20:53.949400 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2990/5940] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:20:53 2022] GET /compute/v2.1/servers/17fb2ff0-7ff4-4acf-a984-ef23ba8ec3dc => generated 1374 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:20:54.185353 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-8a51b4ca-7731-43b9-a08e-362a31946a8e tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:20:54.186783 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-8a51b4ca-7731-43b9-a08e-362a31946a8e tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: 7c6bc6d2-31de-4cff-a3f4-f9c685f11bdc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:20:54.194779 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8a51b4ca-7731-43b9-a08e-362a31946a8e tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:54.195467 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8a51b4ca-7731-43b9-a08e-362a31946a8e tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:54.196060 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8a51b4ca-7731-43b9-a08e-362a31946a8e tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:54.196942 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8a51b4ca-7731-43b9-a08e-362a31946a8e tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:54.197539 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8a51b4ca-7731-43b9-a08e-362a31946a8e tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:54.198488 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8a51b4ca-7731-43b9-a08e-362a31946a8e tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:54.270521 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-8a51b4ca-7731-43b9-a08e-362a31946a8e tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:20:54.281724 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-8a51b4ca-7731-43b9-a08e-362a31946a8e tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/7c6bc6d2-31de-4cff-a3f4-f9c685f11bdc" status: 200 len: 1187 microversion: 2.1 time: 0.100573 Oct 04 22:20:54.289253 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2991/5941] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:20:54 2022] GET /compute/v2.1/servers/7c6bc6d2-31de-4cff-a3f4-f9c685f11bdc => generated 1187 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:20:54.964368 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-d50054c7-8fc4-4fde-adda-b4e1207e77bb tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:20:54.965013 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-d50054c7-8fc4-4fde-adda-b4e1207e77bb tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] [instance: 17fb2ff0-7ff4-4acf-a984-ef23ba8ec3dc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:20:54.975624 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d50054c7-8fc4-4fde-adda-b4e1207e77bb tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:54.976151 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d50054c7-8fc4-4fde-adda-b4e1207e77bb tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:54.976780 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d50054c7-8fc4-4fde-adda-b4e1207e77bb tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:54.977730 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d50054c7-8fc4-4fde-adda-b4e1207e77bb tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:54.978207 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d50054c7-8fc4-4fde-adda-b4e1207e77bb tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:54.981185 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d50054c7-8fc4-4fde-adda-b4e1207e77bb tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:55.205812 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-d50054c7-8fc4-4fde-adda-b4e1207e77bb tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ac78e2767c49168f0464acea155be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286d184163154f2e846d521d368e3ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:20:55.220101 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-d50054c7-8fc4-4fde-adda-b4e1207e77bb tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] 10.222.0.43 "GET /compute/v2.1/servers/17fb2ff0-7ff4-4acf-a984-ef23ba8ec3dc" status: 200 len: 1546 microversion: 2.1 time: 0.259275 Oct 04 22:20:55.220750 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2992/5942] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:20:54 2022] GET /compute/v2.1/servers/17fb2ff0-7ff4-4acf-a984-ef23ba8ec3dc => generated 1546 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:20:55.248534 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-6679a1ac-7feb-4f2d-a164-945f2b90d2c9 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:20:55.249166 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-6679a1ac-7feb-4f2d-a164-945f2b90d2c9 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] [instance: 17fb2ff0-7ff4-4acf-a984-ef23ba8ec3dc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:20:55.257765 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6679a1ac-7feb-4f2d-a164-945f2b90d2c9 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:55.258450 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6679a1ac-7feb-4f2d-a164-945f2b90d2c9 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:55.258970 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6679a1ac-7feb-4f2d-a164-945f2b90d2c9 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:55.259718 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6679a1ac-7feb-4f2d-a164-945f2b90d2c9 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:55.260299 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6679a1ac-7feb-4f2d-a164-945f2b90d2c9 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:55.260749 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6679a1ac-7feb-4f2d-a164-945f2b90d2c9 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:55.459440 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-6679a1ac-7feb-4f2d-a164-945f2b90d2c9 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ac78e2767c49168f0464acea155be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286d184163154f2e846d521d368e3ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:20:55.468888 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-6679a1ac-7feb-4f2d-a164-945f2b90d2c9 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] 10.222.0.43 "GET /compute/v2.1/servers/17fb2ff0-7ff4-4acf-a984-ef23ba8ec3dc" status: 200 len: 1546 microversion: 2.1 time: 0.225012 Oct 04 22:20:55.469418 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2993/5943] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:20:55 2022] GET /compute/v2.1/servers/17fb2ff0-7ff4-4acf-a984-ef23ba8ec3dc => generated 1546 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:20:55.478702 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-149ac494-fb14-4413-889b-ab632a8f8184 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:20:55.478702 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-149ac494-fb14-4413-889b-ab632a8f8184 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: 7c6bc6d2-31de-4cff-a3f4-f9c685f11bdc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:20:55.488119 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-149ac494-fb14-4413-889b-ab632a8f8184 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:55.488119 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-149ac494-fb14-4413-889b-ab632a8f8184 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:55.488119 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-149ac494-fb14-4413-889b-ab632a8f8184 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:55.488119 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-149ac494-fb14-4413-889b-ab632a8f8184 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:55.488119 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-149ac494-fb14-4413-889b-ab632a8f8184 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:55.488119 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-149ac494-fb14-4413-889b-ab632a8f8184 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:55.545416 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-149ac494-fb14-4413-889b-ab632a8f8184 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:55.546050 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-149ac494-fb14-4413-889b-ab632a8f8184 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:55.546630 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-149ac494-fb14-4413-889b-ab632a8f8184 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:55.547198 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.objects.instance [None req-149ac494-fb14-4413-889b-ab632a8f8184 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lazy-loading 'fault' on Instance uuid 7c6bc6d2-31de-4cff-a3f4-f9c685f11bdc {{(pid=134101) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 22:20:55.600822 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-149ac494-fb14-4413-889b-ab632a8f8184 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:20:55.611297 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-149ac494-fb14-4413-889b-ab632a8f8184 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/7c6bc6d2-31de-4cff-a3f4-f9c685f11bdc" status: 200 len: 1192 microversion: 2.1 time: 0.140634 Oct 04 22:20:55.612319 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2994/5944] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:20:55 2022] GET /compute/v2.1/servers/7c6bc6d2-31de-4cff-a3f4-f9c685f11bdc => generated 1192 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:20:56.636077 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-ddad9420-fdee-47dd-b424-f112b5cd4cee tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:20:56.636701 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-ddad9420-fdee-47dd-b424-f112b5cd4cee tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: 7c6bc6d2-31de-4cff-a3f4-f9c685f11bdc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:20:56.650560 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ddad9420-fdee-47dd-b424-f112b5cd4cee tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:56.651066 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ddad9420-fdee-47dd-b424-f112b5cd4cee tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:56.651527 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ddad9420-fdee-47dd-b424-f112b5cd4cee tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:56.652225 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ddad9420-fdee-47dd-b424-f112b5cd4cee tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:56.652684 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ddad9420-fdee-47dd-b424-f112b5cd4cee tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:56.653113 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ddad9420-fdee-47dd-b424-f112b5cd4cee tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:56.683118 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-ddad9420-fdee-47dd-b424-f112b5cd4cee tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] HTTP exception thrown: Instance 7c6bc6d2-31de-4cff-a3f4-f9c685f11bdc could not be found. Oct 04 22:20:56.685034 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-ddad9420-fdee-47dd-b424-f112b5cd4cee tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Request method failure captured: Oct 04 22:20:56.685034 n-d-860284-1 devstack@n-api.service[134101]: request: GET /compute/v2.1/servers/7c6bc6d2-31de-4cff-a3f4-f9c685f11bdc HTTP/1.1 Oct 04 22:20:56.685034 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 22:20:56.685034 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 22:20:56.685034 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 22:20:56.685034 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 22:20:56.685034 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 22:20:56.685034 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 22:20:56.685034 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 22:20:56.685034 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 22:20:56.685034 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPLFSMo9Eg9y9Lu454XN1MXkt5BE7HeG-NZdibz9nP5ZbzTcA5eo2fVm4gnqUdOUNPfyWilTQor2E780fAI_U9XTD5akzJ8-jVP8Fthos4syj8Pc9nJeMuZjrdlu2EkiFF5ef-9mxCQWUxHOpcRBLI1i5aPH69baR_Z4N2zYKYuhPE2w Oct 04 22:20:56.685034 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 22:20:56.685034 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 22:20:56.685034 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 22:20:56.685034 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 22:20:56.685034 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 22:20:56.685034 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 22:20:56.685034 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: 5c98a72bacce47c3947f9b0f0b4e85b6 Oct 04 22:20:56.685034 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-TestVolumeBootPattern-1701442207 Oct 04 22:20:56.685034 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 22:20:56.685034 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 22:20:56.685034 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5c98a72bacce47c3947f9b0f0b4e85b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_5c98a72bacce47c3947f9b0f0b4e85b6", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5c98a72bacce47c3947f9b0f0b4e85b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/5c98a72bacce47c3947f9b0f0b4e85b6"}]}] Oct 04 22:20:56.685034 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-TestVolumeBootPattern-1701442207 Oct 04 22:20:56.685034 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: 5c98a72bacce47c3947f9b0f0b4e85b6 Oct 04 22:20:56.685034 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-TestVolumeBootPattern-1701442207 Oct 04 22:20:56.685034 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-TestVolumeBootPattern-1701442207-project Oct 04 22:20:56.685034 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 22:20:56.685034 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 22:20:56.685034 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 99acad09db70445b93ae1d64a1b49ca3 Oct 04 22:20:56.685034 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-TestVolumeBootPattern-1701442207-project Oct 04 22:20:56.685034 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 22:20:56.685034 n-d-860284-1 devstack@n-api.service[134101]: exception: Instance 7c6bc6d2-31de-4cff-a3f4-f9c685f11bdc could not be found. Oct 04 22:20:56.685034 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': '7c6bc6d2-31de-4cff-a3f4-f9c685f11bdc'} Oct 04 22:20:56.685034 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:20:56.685034 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:20:56.685034 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:20:56.685034 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:20:56.685034 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:20:56.685034 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:20:56.685034 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:20:56.685034 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:20:56.685034 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:20:56.685034 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:20:56.685034 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c6bc6d2-31de-4cff-a3f4-f9c685f11bdc could not be found. Oct 04 22:20:56.685034 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:20:56.685034 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:20:56.685034 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:20:56.685034 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:20:56.685034 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:20:56.685034 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:20:56.685034 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:20:56.685034 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:20:56.685034 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:20:56.685034 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:20:56.685034 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:20:56.685034 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:20:56.685034 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:20:56.685034 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:20:56.685034 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:20:56.685034 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:20:56.685034 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c6bc6d2-31de-4cff-a3f4-f9c685f11bdc could not be found. Oct 04 22:20:56.685034 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:20:56.685034 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:20:56.685034 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:20:56.689074 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:20:56.689074 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:20:56.689074 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:20:56.689074 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:20:56.689074 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:20:56.689074 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c6bc6d2-31de-4cff-a3f4-f9c685f11bdc could not be found. Oct 04 22:20:56.689074 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:20:56.690548 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-ddad9420-fdee-47dd-b424-f112b5cd4cee tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Returning 404 to user: Instance 7c6bc6d2-31de-4cff-a3f4-f9c685f11bdc could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:20:56.693178 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-ddad9420-fdee-47dd-b424-f112b5cd4cee tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/7c6bc6d2-31de-4cff-a3f4-f9c685f11bdc" status: 404 len: 111 microversion: 2.1 time: 0.060930 Oct 04 22:20:56.693853 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2995/5945] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:20:56 2022] GET /compute/v2.1/servers/7c6bc6d2-31de-4cff-a3f4-f9c685f11bdc => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 22:20:57.481720 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-aed58dd2-8063-4c95-8dd4-53305047b499 req-26d323d1-3f81-40bf-8a07-5d0ee5ea98b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17fb2ff0-7ff4-4acf-a984-ef23ba8ec3dc", "tag": "2a05598a-68c7-4079-85a9-3466be4f8f63"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:20:57.493614 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-aed58dd2-8063-4c95-8dd4-53305047b499 req-26d323d1-3f81-40bf-8a07-5d0ee5ea98b6 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:57.494381 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-aed58dd2-8063-4c95-8dd4-53305047b499 req-26d323d1-3f81-40bf-8a07-5d0ee5ea98b6 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:57.494970 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-aed58dd2-8063-4c95-8dd4-53305047b499 req-26d323d1-3f81-40bf-8a07-5d0ee5ea98b6 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:57.512129 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-aed58dd2-8063-4c95-8dd4-53305047b499 req-26d323d1-3f81-40bf-8a07-5d0ee5ea98b6 service nova] Creating event network-changed:2a05598a-68c7-4079-85a9-3466be4f8f63 for instance 17fb2ff0-7ff4-4acf-a984-ef23ba8ec3dc on n-h1-860284-1 Oct 04 22:20:57.518711 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-aed58dd2-8063-4c95-8dd4-53305047b499 req-26d323d1-3f81-40bf-8a07-5d0ee5ea98b6 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040891 Oct 04 22:20:57.525160 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2996/5946] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:20:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:21:12.071430 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-18124855-d64e-4163-a13e-4026ceb958d6 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:21:12.072135 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-18124855-d64e-4163-a13e-4026ceb958d6 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] [instance: 01f84e19-7e4a-460a-bb60-5da518f3d8b1] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:21:12.082727 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=45 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:21:12.083780 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=58 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:21:12.085759 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-18124855-d64e-4163-a13e-4026ceb958d6 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:12.086541 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-18124855-d64e-4163-a13e-4026ceb958d6 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:12.087315 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-18124855-d64e-4163-a13e-4026ceb958d6 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:12.088447 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-18124855-d64e-4163-a13e-4026ceb958d6 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:12.089805 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-18124855-d64e-4163-a13e-4026ceb958d6 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:12.090769 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-18124855-d64e-4163-a13e-4026ceb958d6 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:12.266244 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.objects.instance [None req-18124855-d64e-4163-a13e-4026ceb958d6 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lazy-loading 'services' on Instance uuid 01f84e19-7e4a-460a-bb60-5da518f3d8b1 {{(pid=134101) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 22:21:12.371700 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-18124855-d64e-4163-a13e-4026ceb958d6 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] 10.222.0.43 "DELETE /compute/v2.1/servers/01f84e19-7e4a-460a-bb60-5da518f3d8b1/os-volume_attachments/ed5f450e-aeb8-432e-ae1e-3a9c19e22930" status: 202 len: 0 microversion: 2.1 time: 0.310411 Oct 04 22:21:12.373029 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2997/5947] 10.222.0.43 () {58 vars in 1416 bytes} [Tue Oct 4 22:21:12 2022] DELETE /compute/v2.1/servers/01f84e19-7e4a-460a-bb60-5da518f3d8b1/os-volume_attachments/ed5f450e-aeb8-432e-ae1e-3a9c19e22930 => generated 0 bytes in 313 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 22:21:12.384344 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-01462493-6742-40bd-a35e-4f9da337d8ce tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:21:12.391583 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-01462493-6742-40bd-a35e-4f9da337d8ce tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] [instance: 317528e8-218a-462c-93a1-0e56caf0ea3b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:21:12.399663 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-01462493-6742-40bd-a35e-4f9da337d8ce tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:12.400094 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-01462493-6742-40bd-a35e-4f9da337d8ce tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:12.400833 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-01462493-6742-40bd-a35e-4f9da337d8ce tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:12.404362 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-01462493-6742-40bd-a35e-4f9da337d8ce tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:12.405018 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-01462493-6742-40bd-a35e-4f9da337d8ce tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:12.406002 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-01462493-6742-40bd-a35e-4f9da337d8ce tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:12.465643 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.objects.instance [None req-01462493-6742-40bd-a35e-4f9da337d8ce tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lazy-loading 'flavor' on Instance uuid 317528e8-218a-462c-93a1-0e56caf0ea3b {{(pid=134101) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 22:21:12.708549 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-01462493-6742-40bd-a35e-4f9da337d8ce tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] 10.222.0.43 "POST /compute/v2.1/servers/317528e8-218a-462c-93a1-0e56caf0ea3b/action" status: 200 len: 32 microversion: 2.1 time: 0.333953 Oct 04 22:21:12.709269 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2998/5948] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 22:21:12 2022] POST /compute/v2.1/servers/317528e8-218a-462c-93a1-0e56caf0ea3b/action => generated 32 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 22:21:12.720110 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-1a0df8c6-ba7c-402d-8dfa-86eaa14e371b tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:21:12.720822 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-1a0df8c6-ba7c-402d-8dfa-86eaa14e371b tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] [instance: 317528e8-218a-462c-93a1-0e56caf0ea3b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:21:12.746711 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1a0df8c6-ba7c-402d-8dfa-86eaa14e371b tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:12.751139 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1a0df8c6-ba7c-402d-8dfa-86eaa14e371b tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:12.752384 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1a0df8c6-ba7c-402d-8dfa-86eaa14e371b tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:12.759000 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1a0df8c6-ba7c-402d-8dfa-86eaa14e371b tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:12.760450 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1a0df8c6-ba7c-402d-8dfa-86eaa14e371b tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:12.761381 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1a0df8c6-ba7c-402d-8dfa-86eaa14e371b tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:13.233506 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-1a0df8c6-ba7c-402d-8dfa-86eaa14e371b tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6cfeabf8d84b2893200c3c54c1c19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be71413506154420869fdff5939fb940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:21:13.244833 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-1a0df8c6-ba7c-402d-8dfa-86eaa14e371b tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] 10.222.0.43 "GET /compute/v2.1/servers/317528e8-218a-462c-93a1-0e56caf0ea3b" status: 200 len: 1737 microversion: 2.1 time: 0.529242 Oct 04 22:21:13.246149 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 2999/5949] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:21:12 2022] GET /compute/v2.1/servers/317528e8-218a-462c-93a1-0e56caf0ea3b => generated 1737 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:21:14.273889 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-d6e64958-3714-432f-8073-582f730ebf6c tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:21:14.274907 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-d6e64958-3714-432f-8073-582f730ebf6c tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] [instance: 317528e8-218a-462c-93a1-0e56caf0ea3b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:21:14.282475 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d6e64958-3714-432f-8073-582f730ebf6c tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:14.283242 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d6e64958-3714-432f-8073-582f730ebf6c tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:14.283985 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d6e64958-3714-432f-8073-582f730ebf6c tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:14.285273 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d6e64958-3714-432f-8073-582f730ebf6c tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:14.286772 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d6e64958-3714-432f-8073-582f730ebf6c tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:14.287455 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d6e64958-3714-432f-8073-582f730ebf6c tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:14.523252 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-d6e64958-3714-432f-8073-582f730ebf6c tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6cfeabf8d84b2893200c3c54c1c19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be71413506154420869fdff5939fb940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:21:14.525670 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-d6e64958-3714-432f-8073-582f730ebf6c tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] 10.222.0.43 "GET /compute/v2.1/servers/317528e8-218a-462c-93a1-0e56caf0ea3b" status: 200 len: 1737 microversion: 2.1 time: 0.260682 Oct 04 22:21:14.526676 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3000/5950] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:21:14 2022] GET /compute/v2.1/servers/317528e8-218a-462c-93a1-0e56caf0ea3b => generated 1737 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:21:15.552549 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-0635cb34-c0b7-4dc6-a6f8-4397cb30c854 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:21:15.553572 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-0635cb34-c0b7-4dc6-a6f8-4397cb30c854 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] [instance: 317528e8-218a-462c-93a1-0e56caf0ea3b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:21:15.575155 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0635cb34-c0b7-4dc6-a6f8-4397cb30c854 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:15.576941 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0635cb34-c0b7-4dc6-a6f8-4397cb30c854 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:15.578176 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0635cb34-c0b7-4dc6-a6f8-4397cb30c854 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:15.580552 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0635cb34-c0b7-4dc6-a6f8-4397cb30c854 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:15.582283 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0635cb34-c0b7-4dc6-a6f8-4397cb30c854 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:15.583527 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0635cb34-c0b7-4dc6-a6f8-4397cb30c854 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:15.947603 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-0635cb34-c0b7-4dc6-a6f8-4397cb30c854 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6cfeabf8d84b2893200c3c54c1c19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be71413506154420869fdff5939fb940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:21:15.966054 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-0635cb34-c0b7-4dc6-a6f8-4397cb30c854 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] 10.222.0.43 "GET /compute/v2.1/servers/317528e8-218a-462c-93a1-0e56caf0ea3b" status: 200 len: 1737 microversion: 2.1 time: 0.418837 Oct 04 22:21:15.981496 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3001/5951] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:21:15 2022] GET /compute/v2.1/servers/317528e8-218a-462c-93a1-0e56caf0ea3b => generated 1737 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:21:17.006259 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-7385da22-2f8a-4c06-bf9a-95d4b756a227 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:21:17.007198 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-7385da22-2f8a-4c06-bf9a-95d4b756a227 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] [instance: 317528e8-218a-462c-93a1-0e56caf0ea3b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:21:17.024473 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7385da22-2f8a-4c06-bf9a-95d4b756a227 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:17.025851 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7385da22-2f8a-4c06-bf9a-95d4b756a227 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:17.026343 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7385da22-2f8a-4c06-bf9a-95d4b756a227 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:17.027104 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7385da22-2f8a-4c06-bf9a-95d4b756a227 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:17.027576 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7385da22-2f8a-4c06-bf9a-95d4b756a227 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:17.028171 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7385da22-2f8a-4c06-bf9a-95d4b756a227 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:17.248808 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-7385da22-2f8a-4c06-bf9a-95d4b756a227 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6cfeabf8d84b2893200c3c54c1c19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be71413506154420869fdff5939fb940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:21:17.249351 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-7385da22-2f8a-4c06-bf9a-95d4b756a227 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] 10.222.0.43 "GET /compute/v2.1/servers/317528e8-218a-462c-93a1-0e56caf0ea3b" status: 200 len: 1737 microversion: 2.1 time: 0.247796 Oct 04 22:21:17.250185 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3002/5952] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:21:17 2022] GET /compute/v2.1/servers/317528e8-218a-462c-93a1-0e56caf0ea3b => generated 1737 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:21:18.132729 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-33fc8955-2873-46a5-a2a7-2ff4c9c5c574 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:21:18.141467 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-33fc8955-2873-46a5-a2a7-2ff4c9c5c574 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:18.142314 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-33fc8955-2873-46a5-a2a7-2ff4c9c5c574 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:18.142796 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-33fc8955-2873-46a5-a2a7-2ff4c9c5c574 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:18.169766 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-33fc8955-2873-46a5-a2a7-2ff4c9c5c574 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] [instance: 01f84e19-7e4a-460a-bb60-5da518f3d8b1] Going to try to stop instance {{(pid=134101) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 04 22:21:18.247562 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-33fc8955-2873-46a5-a2a7-2ff4c9c5c574 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] 10.222.0.43 "POST /compute/v2.1/servers/01f84e19-7e4a-460a-bb60-5da518f3d8b1/action" status: 202 len: 0 microversion: 2.1 time: 0.119726 Oct 04 22:21:18.254948 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3003/5953] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 22:21:18 2022] POST /compute/v2.1/servers/01f84e19-7e4a-460a-bb60-5da518f3d8b1/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 22:21:18.266713 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-52a6ca09-ab1a-4964-8179-65c4ee7fc1b4 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:21:18.269862 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-52a6ca09-ab1a-4964-8179-65c4ee7fc1b4 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] [instance: 01f84e19-7e4a-460a-bb60-5da518f3d8b1] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:21:18.277884 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-52a6ca09-ab1a-4964-8179-65c4ee7fc1b4 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:18.279001 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-52a6ca09-ab1a-4964-8179-65c4ee7fc1b4 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:18.279519 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-52a6ca09-ab1a-4964-8179-65c4ee7fc1b4 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:18.280159 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-52a6ca09-ab1a-4964-8179-65c4ee7fc1b4 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:18.280620 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-52a6ca09-ab1a-4964-8179-65c4ee7fc1b4 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:18.281276 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-52a6ca09-ab1a-4964-8179-65c4ee7fc1b4 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:18.480206 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-52a6ca09-ab1a-4964-8179-65c4ee7fc1b4 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '524ac46437134cd5a5000574631ea59a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b191bd428a4906b6c2781ae3efdaae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:21:18.490974 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-52a6ca09-ab1a-4964-8179-65c4ee7fc1b4 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] 10.222.0.43 "GET /compute/v2.1/servers/01f84e19-7e4a-460a-bb60-5da518f3d8b1" status: 200 len: 1678 microversion: 2.1 time: 0.230345 Oct 04 22:21:18.505943 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3004/5954] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:21:18 2022] GET /compute/v2.1/servers/01f84e19-7e4a-460a-bb60-5da518f3d8b1 => generated 1678 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:21:18.505943 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-adf7b2f1-7113-4258-86bd-1fb0b1495f5c tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:21:18.505943 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-adf7b2f1-7113-4258-86bd-1fb0b1495f5c tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] [instance: 317528e8-218a-462c-93a1-0e56caf0ea3b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:21:18.505943 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-adf7b2f1-7113-4258-86bd-1fb0b1495f5c tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:18.505943 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-adf7b2f1-7113-4258-86bd-1fb0b1495f5c tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:18.505943 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-adf7b2f1-7113-4258-86bd-1fb0b1495f5c tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:18.506767 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-adf7b2f1-7113-4258-86bd-1fb0b1495f5c tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:18.507067 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-adf7b2f1-7113-4258-86bd-1fb0b1495f5c tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:18.507498 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-adf7b2f1-7113-4258-86bd-1fb0b1495f5c tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:18.654186 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-adf7b2f1-7113-4258-86bd-1fb0b1495f5c tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6cfeabf8d84b2893200c3c54c1c19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be71413506154420869fdff5939fb940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:21:18.665293 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-adf7b2f1-7113-4258-86bd-1fb0b1495f5c tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] 10.222.0.43 "GET /compute/v2.1/servers/317528e8-218a-462c-93a1-0e56caf0ea3b" status: 200 len: 1737 microversion: 2.1 time: 0.172402 Oct 04 22:21:18.666031 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3005/5955] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:21:18 2022] GET /compute/v2.1/servers/317528e8-218a-462c-93a1-0e56caf0ea3b => generated 1737 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:21:19.515852 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-70d63d28-2a9c-4281-9091-22f2b1ee8f00 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:21:19.516479 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-70d63d28-2a9c-4281-9091-22f2b1ee8f00 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] [instance: 01f84e19-7e4a-460a-bb60-5da518f3d8b1] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:21:19.525596 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-70d63d28-2a9c-4281-9091-22f2b1ee8f00 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:19.526325 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-70d63d28-2a9c-4281-9091-22f2b1ee8f00 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:19.527055 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-70d63d28-2a9c-4281-9091-22f2b1ee8f00 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:19.527927 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-70d63d28-2a9c-4281-9091-22f2b1ee8f00 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:19.528538 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-70d63d28-2a9c-4281-9091-22f2b1ee8f00 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:19.529187 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-70d63d28-2a9c-4281-9091-22f2b1ee8f00 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:19.682018 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-70d63d28-2a9c-4281-9091-22f2b1ee8f00 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '524ac46437134cd5a5000574631ea59a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b191bd428a4906b6c2781ae3efdaae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:21:19.694313 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-70d63d28-2a9c-4281-9091-22f2b1ee8f00 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] 10.222.0.43 "GET /compute/v2.1/servers/01f84e19-7e4a-460a-bb60-5da518f3d8b1" status: 200 len: 1678 microversion: 2.1 time: 0.182486 Oct 04 22:21:19.696037 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3006/5956] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:21:19 2022] GET /compute/v2.1/servers/01f84e19-7e4a-460a-bb60-5da518f3d8b1 => generated 1678 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:21:19.701112 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-912e8dae-7cee-4dd5-a631-8755220ec8f8 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:21:19.701907 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-912e8dae-7cee-4dd5-a631-8755220ec8f8 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] [instance: 317528e8-218a-462c-93a1-0e56caf0ea3b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:21:19.710882 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-912e8dae-7cee-4dd5-a631-8755220ec8f8 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:19.711866 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-912e8dae-7cee-4dd5-a631-8755220ec8f8 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:19.712492 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-912e8dae-7cee-4dd5-a631-8755220ec8f8 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:19.713925 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-912e8dae-7cee-4dd5-a631-8755220ec8f8 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:19.714865 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-912e8dae-7cee-4dd5-a631-8755220ec8f8 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:19.715464 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-912e8dae-7cee-4dd5-a631-8755220ec8f8 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:19.931184 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-912e8dae-7cee-4dd5-a631-8755220ec8f8 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6cfeabf8d84b2893200c3c54c1c19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be71413506154420869fdff5939fb940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:21:19.948271 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-912e8dae-7cee-4dd5-a631-8755220ec8f8 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] 10.222.0.43 "GET /compute/v2.1/servers/317528e8-218a-462c-93a1-0e56caf0ea3b" status: 200 len: 1737 microversion: 2.1 time: 0.245621 Oct 04 22:21:19.949246 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3007/5957] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:21:19 2022] GET /compute/v2.1/servers/317528e8-218a-462c-93a1-0e56caf0ea3b => generated 1737 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:21:20.725654 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-26b804eb-edac-415b-b293-bd3b5c1f37e0 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:21:20.727163 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-26b804eb-edac-415b-b293-bd3b5c1f37e0 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] [instance: 01f84e19-7e4a-460a-bb60-5da518f3d8b1] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:21:20.735550 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-26b804eb-edac-415b-b293-bd3b5c1f37e0 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:20.736390 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-26b804eb-edac-415b-b293-bd3b5c1f37e0 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:20.739797 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-26b804eb-edac-415b-b293-bd3b5c1f37e0 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:20.740459 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-26b804eb-edac-415b-b293-bd3b5c1f37e0 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:20.741286 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-26b804eb-edac-415b-b293-bd3b5c1f37e0 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:20.741815 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-26b804eb-edac-415b-b293-bd3b5c1f37e0 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:20.946502 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-26b804eb-edac-415b-b293-bd3b5c1f37e0 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '524ac46437134cd5a5000574631ea59a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b191bd428a4906b6c2781ae3efdaae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:21:20.975021 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-26b804eb-edac-415b-b293-bd3b5c1f37e0 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] 10.222.0.43 "GET /compute/v2.1/servers/01f84e19-7e4a-460a-bb60-5da518f3d8b1" status: 200 len: 1678 microversion: 2.1 time: 0.235276 Oct 04 22:21:20.994141 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3008/5958] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:21:20 2022] GET /compute/v2.1/servers/01f84e19-7e4a-460a-bb60-5da518f3d8b1 => generated 1678 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:21:21.000907 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-8ef23e64-bb6c-4095-a279-15c092e2b86b tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:21:21.001908 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-8ef23e64-bb6c-4095-a279-15c092e2b86b tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] [instance: 317528e8-218a-462c-93a1-0e56caf0ea3b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:21:21.010787 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8ef23e64-bb6c-4095-a279-15c092e2b86b tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:21.011571 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8ef23e64-bb6c-4095-a279-15c092e2b86b tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:21.012168 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8ef23e64-bb6c-4095-a279-15c092e2b86b tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:21.013034 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8ef23e64-bb6c-4095-a279-15c092e2b86b tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:21.013704 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8ef23e64-bb6c-4095-a279-15c092e2b86b tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:21.014284 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8ef23e64-bb6c-4095-a279-15c092e2b86b tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:21.254857 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-8ef23e64-bb6c-4095-a279-15c092e2b86b tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6cfeabf8d84b2893200c3c54c1c19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be71413506154420869fdff5939fb940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:21:21.258855 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:21:21.278816 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-8ef23e64-bb6c-4095-a279-15c092e2b86b tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] 10.222.0.43 "GET /compute/v2.1/servers/317528e8-218a-462c-93a1-0e56caf0ea3b" status: 200 len: 1737 microversion: 2.1 time: 0.283035 Oct 04 22:21:21.279678 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3009/5959] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:21:20 2022] GET /compute/v2.1/servers/317528e8-218a-462c-93a1-0e56caf0ea3b => generated 1737 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:21:22.000901 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-369e6dc0-3875-42d6-9848-59248e13fb0a tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:21:22.002596 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-369e6dc0-3875-42d6-9848-59248e13fb0a tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] [instance: 01f84e19-7e4a-460a-bb60-5da518f3d8b1] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:21:22.014024 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-369e6dc0-3875-42d6-9848-59248e13fb0a tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:22.021450 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-369e6dc0-3875-42d6-9848-59248e13fb0a tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:22.022162 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-369e6dc0-3875-42d6-9848-59248e13fb0a tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:22.022982 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-369e6dc0-3875-42d6-9848-59248e13fb0a tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:22.023455 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-369e6dc0-3875-42d6-9848-59248e13fb0a tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:22.023901 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-369e6dc0-3875-42d6-9848-59248e13fb0a tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:22.418247 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-369e6dc0-3875-42d6-9848-59248e13fb0a tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '524ac46437134cd5a5000574631ea59a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b191bd428a4906b6c2781ae3efdaae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:21:22.442642 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-369e6dc0-3875-42d6-9848-59248e13fb0a tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] 10.222.0.43 "GET /compute/v2.1/servers/01f84e19-7e4a-460a-bb60-5da518f3d8b1" status: 200 len: 1678 microversion: 2.1 time: 0.444832 Oct 04 22:21:22.447596 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3010/5960] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:21:21 2022] GET /compute/v2.1/servers/01f84e19-7e4a-460a-bb60-5da518f3d8b1 => generated 1678 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:21:22.463545 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-b9aaf2d8-3cdb-4c62-9e27-1103a1be1311 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:21:22.468552 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-b9aaf2d8-3cdb-4c62-9e27-1103a1be1311 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] [instance: 317528e8-218a-462c-93a1-0e56caf0ea3b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:21:22.497148 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b9aaf2d8-3cdb-4c62-9e27-1103a1be1311 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:22.501016 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b9aaf2d8-3cdb-4c62-9e27-1103a1be1311 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:22.503380 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b9aaf2d8-3cdb-4c62-9e27-1103a1be1311 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:22.504406 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b9aaf2d8-3cdb-4c62-9e27-1103a1be1311 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:22.509398 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b9aaf2d8-3cdb-4c62-9e27-1103a1be1311 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:22.511497 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b9aaf2d8-3cdb-4c62-9e27-1103a1be1311 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:22.865440 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-b9aaf2d8-3cdb-4c62-9e27-1103a1be1311 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6cfeabf8d84b2893200c3c54c1c19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be71413506154420869fdff5939fb940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:21:22.885931 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-b9aaf2d8-3cdb-4c62-9e27-1103a1be1311 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] 10.222.0.43 "GET /compute/v2.1/servers/317528e8-218a-462c-93a1-0e56caf0ea3b" status: 200 len: 1737 microversion: 2.1 time: 0.427647 Oct 04 22:21:22.896234 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3011/5961] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:21:22 2022] GET /compute/v2.1/servers/317528e8-218a-462c-93a1-0e56caf0ea3b => generated 1737 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:21:23.474672 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-5ae5c409-df64-4c33-90d2-679b92f33c32 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:21:23.475281 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-5ae5c409-df64-4c33-90d2-679b92f33c32 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] [instance: 01f84e19-7e4a-460a-bb60-5da518f3d8b1] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:21:23.485301 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5ae5c409-df64-4c33-90d2-679b92f33c32 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:23.485796 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5ae5c409-df64-4c33-90d2-679b92f33c32 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:23.486239 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5ae5c409-df64-4c33-90d2-679b92f33c32 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:23.486985 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5ae5c409-df64-4c33-90d2-679b92f33c32 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:23.488198 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5ae5c409-df64-4c33-90d2-679b92f33c32 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:23.488636 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5ae5c409-df64-4c33-90d2-679b92f33c32 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:23.695558 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-5ae5c409-df64-4c33-90d2-679b92f33c32 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '524ac46437134cd5a5000574631ea59a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b191bd428a4906b6c2781ae3efdaae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:21:23.725507 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-5ae5c409-df64-4c33-90d2-679b92f33c32 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] 10.222.0.43 "GET /compute/v2.1/servers/01f84e19-7e4a-460a-bb60-5da518f3d8b1" status: 200 len: 1678 microversion: 2.1 time: 0.255069 Oct 04 22:21:23.736555 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3012/5962] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:21:23 2022] GET /compute/v2.1/servers/01f84e19-7e4a-460a-bb60-5da518f3d8b1 => generated 1678 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:21:23.909517 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-48df38f7-d38e-4779-a6e9-f0769eb2d4fa tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:21:23.911143 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-48df38f7-d38e-4779-a6e9-f0769eb2d4fa tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] [instance: 317528e8-218a-462c-93a1-0e56caf0ea3b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:21:23.930616 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-48df38f7-d38e-4779-a6e9-f0769eb2d4fa tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:23.931516 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-48df38f7-d38e-4779-a6e9-f0769eb2d4fa tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:23.932666 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-48df38f7-d38e-4779-a6e9-f0769eb2d4fa tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:23.935234 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-48df38f7-d38e-4779-a6e9-f0769eb2d4fa tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:23.936118 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-48df38f7-d38e-4779-a6e9-f0769eb2d4fa tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:23.936773 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-48df38f7-d38e-4779-a6e9-f0769eb2d4fa tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:24.124127 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-48df38f7-d38e-4779-a6e9-f0769eb2d4fa tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6cfeabf8d84b2893200c3c54c1c19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be71413506154420869fdff5939fb940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:21:24.133178 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-48df38f7-d38e-4779-a6e9-f0769eb2d4fa tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] 10.222.0.43 "GET /compute/v2.1/servers/317528e8-218a-462c-93a1-0e56caf0ea3b" status: 200 len: 1737 microversion: 2.1 time: 0.227761 Oct 04 22:21:24.133781 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3013/5963] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:21:23 2022] GET /compute/v2.1/servers/317528e8-218a-462c-93a1-0e56caf0ea3b => generated 1737 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:21:24.949998 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-3ccfe38a-a924-4e3e-9a8a-a481f58932ef tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Action: 'create', calling method: .version_select at 0x7fbb2e693790>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-1266046448", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPshZm8HBq7CtweTEJHC2BYWAkG0Aju1OMrmaLg+xWMO/Kqd5mIQiBaDL9c7daq+y2NTDEeRqhCSwp2uohDrYNphWO2QaCpXxUqfZPCjGHmZzaz2vCS4uN+ZoE6K0qSHvQ=="}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:21:24.966747 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-3ccfe38a-a924-4e3e-9a8a-a481f58932ef tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Getting quotas for project 35747ba0bc69465e971ba85c88fff0cd. Resources: {'key_pairs'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:21:24.974251 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-3ccfe38a-a924-4e3e-9a8a-a481f58932ef tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Getting quotas for user 92bb4deacc2a45df834a675629a56e1b and project 35747ba0bc69465e971ba85c88fff0cd. Resources: {'key_pairs'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:21:25.003627 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-3ccfe38a-a924-4e3e-9a8a-a481f58932ef tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.272846 Oct 04 22:21:25.010410 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3014/5964] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Oct 4 22:21:24 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:21:25.010410 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-aaa8e7cd-fafc-478f-8bf9-290fb3813205 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:21:25.010410 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-aaa8e7cd-fafc-478f-8bf9-290fb3813205 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] [instance: 01f84e19-7e4a-460a-bb60-5da518f3d8b1] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:21:25.017378 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-aaa8e7cd-fafc-478f-8bf9-290fb3813205 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:25.017877 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-aaa8e7cd-fafc-478f-8bf9-290fb3813205 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:25.018318 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-aaa8e7cd-fafc-478f-8bf9-290fb3813205 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:25.019590 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-aaa8e7cd-fafc-478f-8bf9-290fb3813205 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:25.020263 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-aaa8e7cd-fafc-478f-8bf9-290fb3813205 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:25.020756 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-aaa8e7cd-fafc-478f-8bf9-290fb3813205 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:25.266422 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-aaa8e7cd-fafc-478f-8bf9-290fb3813205 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '524ac46437134cd5a5000574631ea59a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b191bd428a4906b6c2781ae3efdaae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:21:25.279165 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-aaa8e7cd-fafc-478f-8bf9-290fb3813205 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] 10.222.0.43 "GET /compute/v2.1/servers/01f84e19-7e4a-460a-bb60-5da518f3d8b1" status: 200 len: 1678 microversion: 2.1 time: 0.273293 Oct 04 22:21:25.280516 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3015/5965] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:21:25 2022] GET /compute/v2.1/servers/01f84e19-7e4a-460a-bb60-5da518f3d8b1 => generated 1678 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:21:25.286519 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-f428a023-d444-42d6-88f5-8839d9251bba tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:21:25.287908 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-f428a023-d444-42d6-88f5-8839d9251bba tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] [instance: 317528e8-218a-462c-93a1-0e56caf0ea3b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:21:25.294386 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f428a023-d444-42d6-88f5-8839d9251bba tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:25.294989 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f428a023-d444-42d6-88f5-8839d9251bba tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:25.295521 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f428a023-d444-42d6-88f5-8839d9251bba tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:25.296290 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f428a023-d444-42d6-88f5-8839d9251bba tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:25.297234 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f428a023-d444-42d6-88f5-8839d9251bba tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:25.297472 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f428a023-d444-42d6-88f5-8839d9251bba tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:25.620174 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-f428a023-d444-42d6-88f5-8839d9251bba tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6cfeabf8d84b2893200c3c54c1c19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be71413506154420869fdff5939fb940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:21:25.635980 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-f428a023-d444-42d6-88f5-8839d9251bba tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] 10.222.0.43 "GET /compute/v2.1/servers/317528e8-218a-462c-93a1-0e56caf0ea3b" status: 200 len: 1737 microversion: 2.1 time: 0.354137 Oct 04 22:21:25.637159 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3016/5966] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:21:25 2022] GET /compute/v2.1/servers/317528e8-218a-462c-93a1-0e56caf0ea3b => generated 1737 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:21:26.307443 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e15c18cb-a2bf-467c-a4da-600f4f816730 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:21:26.308153 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-e15c18cb-a2bf-467c-a4da-600f4f816730 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] [instance: 01f84e19-7e4a-460a-bb60-5da518f3d8b1] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:21:26.320917 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e15c18cb-a2bf-467c-a4da-600f4f816730 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:26.321487 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e15c18cb-a2bf-467c-a4da-600f4f816730 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:26.321880 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e15c18cb-a2bf-467c-a4da-600f4f816730 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:26.322627 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e15c18cb-a2bf-467c-a4da-600f4f816730 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:26.323096 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e15c18cb-a2bf-467c-a4da-600f4f816730 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:26.323533 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e15c18cb-a2bf-467c-a4da-600f4f816730 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:26.597099 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-e15c18cb-a2bf-467c-a4da-600f4f816730 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '524ac46437134cd5a5000574631ea59a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b191bd428a4906b6c2781ae3efdaae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:21:26.610103 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-e15c18cb-a2bf-467c-a4da-600f4f816730 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] 10.222.0.43 "GET /compute/v2.1/servers/01f84e19-7e4a-460a-bb60-5da518f3d8b1" status: 200 len: 1678 microversion: 2.1 time: 0.306931 Oct 04 22:21:26.611810 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3017/5967] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:21:26 2022] GET /compute/v2.1/servers/01f84e19-7e4a-460a-bb60-5da518f3d8b1 => generated 1678 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:21:26.661344 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-1c8b65bc-cd01-4b5c-a66f-7c4890e7c090 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:21:26.667744 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-1c8b65bc-cd01-4b5c-a66f-7c4890e7c090 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] [instance: 317528e8-218a-462c-93a1-0e56caf0ea3b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:21:26.688005 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1c8b65bc-cd01-4b5c-a66f-7c4890e7c090 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:26.689118 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1c8b65bc-cd01-4b5c-a66f-7c4890e7c090 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:26.689118 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1c8b65bc-cd01-4b5c-a66f-7c4890e7c090 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:26.691366 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1c8b65bc-cd01-4b5c-a66f-7c4890e7c090 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:26.692130 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1c8b65bc-cd01-4b5c-a66f-7c4890e7c090 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:26.692587 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1c8b65bc-cd01-4b5c-a66f-7c4890e7c090 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:26.885350 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-1c8b65bc-cd01-4b5c-a66f-7c4890e7c090 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6cfeabf8d84b2893200c3c54c1c19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be71413506154420869fdff5939fb940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:21:26.896214 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-1c8b65bc-cd01-4b5c-a66f-7c4890e7c090 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] 10.222.0.43 "GET /compute/v2.1/servers/317528e8-218a-462c-93a1-0e56caf0ea3b" status: 200 len: 1737 microversion: 2.1 time: 0.239916 Oct 04 22:21:26.897171 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3018/5968] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:21:26 2022] GET /compute/v2.1/servers/317528e8-218a-462c-93a1-0e56caf0ea3b => generated 1737 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:21:27.637124 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-701170f7-cbc3-44a1-bb36-35426d841cf6 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:21:27.638765 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-701170f7-cbc3-44a1-bb36-35426d841cf6 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] [instance: 01f84e19-7e4a-460a-bb60-5da518f3d8b1] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:21:27.646506 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-701170f7-cbc3-44a1-bb36-35426d841cf6 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:27.647599 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-701170f7-cbc3-44a1-bb36-35426d841cf6 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:27.648403 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-701170f7-cbc3-44a1-bb36-35426d841cf6 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:27.649352 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-701170f7-cbc3-44a1-bb36-35426d841cf6 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:27.650019 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-701170f7-cbc3-44a1-bb36-35426d841cf6 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:27.650679 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-701170f7-cbc3-44a1-bb36-35426d841cf6 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:27.830874 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-701170f7-cbc3-44a1-bb36-35426d841cf6 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '524ac46437134cd5a5000574631ea59a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b191bd428a4906b6c2781ae3efdaae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:21:27.844113 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-701170f7-cbc3-44a1-bb36-35426d841cf6 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] 10.222.0.43 "GET /compute/v2.1/servers/01f84e19-7e4a-460a-bb60-5da518f3d8b1" status: 200 len: 1678 microversion: 2.1 time: 0.209515 Oct 04 22:21:27.844782 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3019/5969] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:21:27 2022] GET /compute/v2.1/servers/01f84e19-7e4a-460a-bb60-5da518f3d8b1 => generated 1678 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:21:27.922415 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-10127d98-699f-49aa-968a-a483a83ca663 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:21:27.923050 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-10127d98-699f-49aa-968a-a483a83ca663 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] [instance: 317528e8-218a-462c-93a1-0e56caf0ea3b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:21:27.937382 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-10127d98-699f-49aa-968a-a483a83ca663 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:27.937915 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-10127d98-699f-49aa-968a-a483a83ca663 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:27.938333 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-10127d98-699f-49aa-968a-a483a83ca663 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:27.939308 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-10127d98-699f-49aa-968a-a483a83ca663 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:27.939781 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-10127d98-699f-49aa-968a-a483a83ca663 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:27.940220 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-10127d98-699f-49aa-968a-a483a83ca663 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:28.205428 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-10127d98-699f-49aa-968a-a483a83ca663 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6cfeabf8d84b2893200c3c54c1c19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be71413506154420869fdff5939fb940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:21:28.215235 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-10127d98-699f-49aa-968a-a483a83ca663 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] 10.222.0.43 "GET /compute/v2.1/servers/317528e8-218a-462c-93a1-0e56caf0ea3b" status: 200 len: 1737 microversion: 2.1 time: 0.297226 Oct 04 22:21:28.217090 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3020/5970] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:21:27 2022] GET /compute/v2.1/servers/317528e8-218a-462c-93a1-0e56caf0ea3b => generated 1737 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:21:28.868637 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-d73ad874-8827-4e26-bbb3-acd52f2e38ac tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:21:28.869275 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-d73ad874-8827-4e26-bbb3-acd52f2e38ac tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] [instance: 01f84e19-7e4a-460a-bb60-5da518f3d8b1] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:21:28.877466 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d73ad874-8827-4e26-bbb3-acd52f2e38ac tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:28.878134 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d73ad874-8827-4e26-bbb3-acd52f2e38ac tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:28.878644 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d73ad874-8827-4e26-bbb3-acd52f2e38ac tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:28.879431 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d73ad874-8827-4e26-bbb3-acd52f2e38ac tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:28.879923 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d73ad874-8827-4e26-bbb3-acd52f2e38ac tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:28.880374 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d73ad874-8827-4e26-bbb3-acd52f2e38ac tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:29.227933 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-d73ad874-8827-4e26-bbb3-acd52f2e38ac tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '524ac46437134cd5a5000574631ea59a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b191bd428a4906b6c2781ae3efdaae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:21:29.242940 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-d73ad874-8827-4e26-bbb3-acd52f2e38ac tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] 10.222.0.43 "GET /compute/v2.1/servers/01f84e19-7e4a-460a-bb60-5da518f3d8b1" status: 200 len: 1655 microversion: 2.1 time: 0.378845 Oct 04 22:21:29.252639 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3021/5971] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:21:28 2022] GET /compute/v2.1/servers/01f84e19-7e4a-460a-bb60-5da518f3d8b1 => generated 1655 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:21:29.259531 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-62cba19b-5ad9-4b8f-864f-766b813a9675 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:21:29.271938 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-62cba19b-5ad9-4b8f-864f-766b813a9675 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] [instance: 317528e8-218a-462c-93a1-0e56caf0ea3b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:21:29.281522 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-62cba19b-5ad9-4b8f-864f-766b813a9675 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:29.286715 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-62cba19b-5ad9-4b8f-864f-766b813a9675 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:29.287518 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-62cba19b-5ad9-4b8f-864f-766b813a9675 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:29.288844 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-62cba19b-5ad9-4b8f-864f-766b813a9675 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:29.289480 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-62cba19b-5ad9-4b8f-864f-766b813a9675 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:29.290120 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-62cba19b-5ad9-4b8f-864f-766b813a9675 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:29.558898 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-62cba19b-5ad9-4b8f-864f-766b813a9675 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6cfeabf8d84b2893200c3c54c1c19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be71413506154420869fdff5939fb940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:21:29.572100 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-62cba19b-5ad9-4b8f-864f-766b813a9675 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] 10.222.0.43 "GET /compute/v2.1/servers/317528e8-218a-462c-93a1-0e56caf0ea3b" status: 200 len: 1737 microversion: 2.1 time: 0.316350 Oct 04 22:21:29.572705 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3022/5972] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:21:29 2022] GET /compute/v2.1/servers/317528e8-218a-462c-93a1-0e56caf0ea3b => generated 1737 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:21:29.579967 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-8bf39276-a61a-4a17-9df8-a681c3eec271 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:21:29.587837 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8bf39276-a61a-4a17-9df8-a681c3eec271 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:29.588317 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8bf39276-a61a-4a17-9df8-a681c3eec271 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:29.588794 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8bf39276-a61a-4a17-9df8-a681c3eec271 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:29.615788 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-8bf39276-a61a-4a17-9df8-a681c3eec271 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] [instance: 01f84e19-7e4a-460a-bb60-5da518f3d8b1] Going to try to start instance {{(pid=134101) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 04 22:21:29.684143 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-8bf39276-a61a-4a17-9df8-a681c3eec271 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] 10.222.0.43 "POST /compute/v2.1/servers/01f84e19-7e4a-460a-bb60-5da518f3d8b1/action" status: 202 len: 0 microversion: 2.1 time: 0.110019 Oct 04 22:21:29.689696 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3023/5973] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 22:21:29 2022] POST /compute/v2.1/servers/01f84e19-7e4a-460a-bb60-5da518f3d8b1/action => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 22:21:29.697833 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-fda79741-3cd9-460c-afbe-00e526ee0a57 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:21:29.698791 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-fda79741-3cd9-460c-afbe-00e526ee0a57 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] [instance: 01f84e19-7e4a-460a-bb60-5da518f3d8b1] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:21:29.708583 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fda79741-3cd9-460c-afbe-00e526ee0a57 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:29.709383 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fda79741-3cd9-460c-afbe-00e526ee0a57 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:29.709989 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fda79741-3cd9-460c-afbe-00e526ee0a57 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:29.710908 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fda79741-3cd9-460c-afbe-00e526ee0a57 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:29.711530 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fda79741-3cd9-460c-afbe-00e526ee0a57 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:29.712118 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fda79741-3cd9-460c-afbe-00e526ee0a57 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:29.966862 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-fda79741-3cd9-460c-afbe-00e526ee0a57 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '524ac46437134cd5a5000574631ea59a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b191bd428a4906b6c2781ae3efdaae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:21:29.983673 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-fda79741-3cd9-460c-afbe-00e526ee0a57 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] 10.222.0.43 "GET /compute/v2.1/servers/01f84e19-7e4a-460a-bb60-5da518f3d8b1" status: 200 len: 1664 microversion: 2.1 time: 0.292110 Oct 04 22:21:29.986517 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3024/5974] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:21:29 2022] GET /compute/v2.1/servers/01f84e19-7e4a-460a-bb60-5da518f3d8b1 => generated 1664 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:21:30.597988 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-b2745379-8186-4f83-a6ea-f4d91d7eaf38 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:21:30.598893 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-b2745379-8186-4f83-a6ea-f4d91d7eaf38 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] [instance: 317528e8-218a-462c-93a1-0e56caf0ea3b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:21:30.615236 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b2745379-8186-4f83-a6ea-f4d91d7eaf38 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:30.616045 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b2745379-8186-4f83-a6ea-f4d91d7eaf38 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:30.616689 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b2745379-8186-4f83-a6ea-f4d91d7eaf38 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:30.617738 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b2745379-8186-4f83-a6ea-f4d91d7eaf38 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:30.618396 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b2745379-8186-4f83-a6ea-f4d91d7eaf38 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:30.619863 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b2745379-8186-4f83-a6ea-f4d91d7eaf38 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:31.067189 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-b2745379-8186-4f83-a6ea-f4d91d7eaf38 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6cfeabf8d84b2893200c3c54c1c19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be71413506154420869fdff5939fb940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:21:31.078995 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-b2745379-8186-4f83-a6ea-f4d91d7eaf38 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] 10.222.0.43 "GET /compute/v2.1/servers/317528e8-218a-462c-93a1-0e56caf0ea3b" status: 200 len: 1737 microversion: 2.1 time: 0.486262 Oct 04 22:21:31.080031 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3025/5975] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:21:30 2022] GET /compute/v2.1/servers/317528e8-218a-462c-93a1-0e56caf0ea3b => generated 1737 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:21:31.086621 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-ca57010c-6864-45ed-bf85-6b868ebe0ed9 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-27808487", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "b115b61f-6d71-4c54-946d-edae766011f7", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "f55a0794-d215-4510-84cc-a7b063c083a4"}]}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:21:31.290162 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.network.neutron [None req-ca57010c-6864-45ed-bf85-6b868ebe0ed9 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] validate_networks() for [('f55a0794-d215-4510-84cc-a7b063c083a4', None, None, None, None, None)] {{(pid=134101) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 22:21:32.473462 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-ca57010c-6864-45ed-bf85-6b868ebe0ed9 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Flavor limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 22:21:32.474500 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-ca57010c-6864-45ed-bf85-6b868ebe0ed9 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Image limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 22:21:32.474660 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-ca57010c-6864-45ed-bf85-6b868ebe0ed9 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Flavor pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 22:21:32.475737 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-ca57010c-6864-45ed-bf85-6b868ebe0ed9 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Image pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 22:21:32.476295 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-ca57010c-6864-45ed-bf85-6b868ebe0ed9 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 22:21:32.494782 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ca57010c-6864-45ed-bf85-6b868ebe0ed9 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:32.495281 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ca57010c-6864-45ed-bf85-6b868ebe0ed9 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:32.495725 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ca57010c-6864-45ed-bf85-6b868ebe0ed9 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:32.496470 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ca57010c-6864-45ed-bf85-6b868ebe0ed9 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:32.496930 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ca57010c-6864-45ed-bf85-6b868ebe0ed9 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:32.497364 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ca57010c-6864-45ed-bf85-6b868ebe0ed9 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:32.552892 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-ca57010c-6864-45ed-bf85-6b868ebe0ed9 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Getting quotas for project 5c98a72bacce47c3947f9b0f0b4e85b6. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:21:32.559439 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-ca57010c-6864-45ed-bf85-6b868ebe0ed9 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Getting quotas for user 99acad09db70445b93ae1d64a1b49ca3 and project 5c98a72bacce47c3947f9b0f0b4e85b6. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:21:32.587219 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-ca57010c-6864-45ed-bf85-6b868ebe0ed9 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Going to run 1 instances... {{(pid=134101) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 22:21:32.590480 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-ca57010c-6864-45ed-bf85-6b868ebe0ed9 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: cbfe78f0-109c-43f8-81d4-2faf07d9ca31] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='b115b61f-6d71-4c54-946d-edae766011f7',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134101) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 22:21:32.714580 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-ca57010c-6864-45ed-bf85-6b868ebe0ed9 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.633274 Oct 04 22:21:32.719792 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3026/5976] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 22:21:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 1639 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 22:21:32.732146 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-2e78a826-84ba-47d3-9e8c-049e8e031cf7 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:21:32.733042 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-2e78a826-84ba-47d3-9e8c-049e8e031cf7 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] [instance: 01f84e19-7e4a-460a-bb60-5da518f3d8b1] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:21:32.748408 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2e78a826-84ba-47d3-9e8c-049e8e031cf7 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:32.749363 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2e78a826-84ba-47d3-9e8c-049e8e031cf7 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:32.750086 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2e78a826-84ba-47d3-9e8c-049e8e031cf7 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:32.751090 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2e78a826-84ba-47d3-9e8c-049e8e031cf7 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:32.753382 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2e78a826-84ba-47d3-9e8c-049e8e031cf7 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:32.754579 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2e78a826-84ba-47d3-9e8c-049e8e031cf7 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:32.759863 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:21:33.222560 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-2e78a826-84ba-47d3-9e8c-049e8e031cf7 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '524ac46437134cd5a5000574631ea59a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b191bd428a4906b6c2781ae3efdaae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:21:33.234893 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-2e78a826-84ba-47d3-9e8c-049e8e031cf7 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] 10.222.0.43 "GET /compute/v2.1/servers/01f84e19-7e4a-460a-bb60-5da518f3d8b1" status: 200 len: 1668 microversion: 2.1 time: 0.513561 Oct 04 22:21:33.244700 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3027/5977] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:21:32 2022] GET /compute/v2.1/servers/01f84e19-7e4a-460a-bb60-5da518f3d8b1 => generated 1668 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:21:33.253617 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-a8083ff6-32e3-4665-8d92-16fe1c663383 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:21:33.254897 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-a8083ff6-32e3-4665-8d92-16fe1c663383 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] [instance: 317528e8-218a-462c-93a1-0e56caf0ea3b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:21:33.274197 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a8083ff6-32e3-4665-8d92-16fe1c663383 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:33.274889 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a8083ff6-32e3-4665-8d92-16fe1c663383 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:33.275469 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a8083ff6-32e3-4665-8d92-16fe1c663383 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:33.276412 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a8083ff6-32e3-4665-8d92-16fe1c663383 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:33.277074 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a8083ff6-32e3-4665-8d92-16fe1c663383 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:33.277794 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a8083ff6-32e3-4665-8d92-16fe1c663383 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:33.685724 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-a8083ff6-32e3-4665-8d92-16fe1c663383 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6cfeabf8d84b2893200c3c54c1c19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be71413506154420869fdff5939fb940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:21:33.695503 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-a8083ff6-32e3-4665-8d92-16fe1c663383 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] 10.222.0.43 "GET /compute/v2.1/servers/317528e8-218a-462c-93a1-0e56caf0ea3b" status: 200 len: 1717 microversion: 2.1 time: 0.449391 Oct 04 22:21:33.696118 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3028/5978] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:21:33 2022] GET /compute/v2.1/servers/317528e8-218a-462c-93a1-0e56caf0ea3b => generated 1717 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:21:33.701776 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-3e5a32a1-23b8-4ee4-a236-9564729ad2bb tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:21:33.702659 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-3e5a32a1-23b8-4ee4-a236-9564729ad2bb tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: cbfe78f0-109c-43f8-81d4-2faf07d9ca31] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:21:33.709696 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3e5a32a1-23b8-4ee4-a236-9564729ad2bb tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:33.710793 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3e5a32a1-23b8-4ee4-a236-9564729ad2bb tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:33.711429 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3e5a32a1-23b8-4ee4-a236-9564729ad2bb tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:33.712443 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3e5a32a1-23b8-4ee4-a236-9564729ad2bb tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:33.713701 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3e5a32a1-23b8-4ee4-a236-9564729ad2bb tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:33.714335 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3e5a32a1-23b8-4ee4-a236-9564729ad2bb tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:33.897781 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-3e5a32a1-23b8-4ee4-a236-9564729ad2bb tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:21:33.916339 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-3e5a32a1-23b8-4ee4-a236-9564729ad2bb tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/cbfe78f0-109c-43f8-81d4-2faf07d9ca31" status: 200 len: 1107 microversion: 2.1 time: 0.218597 Oct 04 22:21:33.917006 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3029/5979] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:21:33 2022] GET /compute/v2.1/servers/cbfe78f0-109c-43f8-81d4-2faf07d9ca31 => generated 1107 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:21:33.937409 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-cd85fcd4-50bb-45aa-85fe-043ff2d3547c tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:21:33.937932 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-cd85fcd4-50bb-45aa-85fe-043ff2d3547c tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] [instance: 317528e8-218a-462c-93a1-0e56caf0ea3b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:21:33.955619 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cd85fcd4-50bb-45aa-85fe-043ff2d3547c tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:33.956722 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cd85fcd4-50bb-45aa-85fe-043ff2d3547c tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:33.957449 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cd85fcd4-50bb-45aa-85fe-043ff2d3547c tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:33.958400 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cd85fcd4-50bb-45aa-85fe-043ff2d3547c tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:33.959036 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cd85fcd4-50bb-45aa-85fe-043ff2d3547c tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:33.959630 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cd85fcd4-50bb-45aa-85fe-043ff2d3547c tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:34.113877 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-cd85fcd4-50bb-45aa-85fe-043ff2d3547c tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] HTTP exception thrown: Cannot 'detach_volume' instance 317528e8-218a-462c-93a1-0e56caf0ea3b while it is in vm_state rescued Oct 04 22:21:34.115830 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-cd85fcd4-50bb-45aa-85fe-043ff2d3547c tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Request method failure captured: Oct 04 22:21:34.115830 n-d-860284-1 devstack@n-api.service[134101]: request: DELETE /compute/v2.1/servers/317528e8-218a-462c-93a1-0e56caf0ea3b/os-volume_attachments/ed51c8b8-4d49-4ca2-b479-5c8ecfb288ca HTTP/1.1 Oct 04 22:21:34.115830 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 22:21:34.115830 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 22:21:34.115830 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 22:21:34.115830 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 22:21:34.115830 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 22:21:34.115830 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 22:21:34.115830 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 22:21:34.115830 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 22:21:34.115830 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPLEDiePHKmNYQ70bvTRH9P6iiaqhUoAB8_ZBMNVcHJpqPxkBgo3U3nk5n38-Pj3vdk8AJHCO9JALC7jh3PuAbKmfUvXx7h6K9sXqnrzemrKzzJUfKCyLDC31QQuFp0uS2eKZE1D_dbjuEfh4aQXcfm19u6d5SXGgRB-GYLIygAnJeb8 Oct 04 22:21:34.115830 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 22:21:34.115830 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 22:21:34.115830 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 22:21:34.115830 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 22:21:34.115830 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 22:21:34.115830 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 22:21:34.115830 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: be71413506154420869fdff5939fb940 Oct 04 22:21:34.115830 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1499910012 Oct 04 22:21:34.115830 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 22:21:34.115830 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 22:21:34.115830 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/be71413506154420869fdff5939fb940"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_be71413506154420869fdff5939fb940", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/be71413506154420869fdff5939fb940"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/be71413506154420869fdff5939fb940"}]}] Oct 04 22:21:34.115830 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1499910012 Oct 04 22:21:34.115830 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: be71413506154420869fdff5939fb940 Oct 04 22:21:34.115830 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1499910012 Oct 04 22:21:34.115830 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-ServerRescueNegativeTestJSON-1499910012-project Oct 04 22:21:34.115830 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 22:21:34.115830 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 22:21:34.115830 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: ca6cfeabf8d84b2893200c3c54c1c19f Oct 04 22:21:34.115830 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1499910012-project Oct 04 22:21:34.115830 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 22:21:34.115830 n-d-860284-1 devstack@n-api.service[134101]: exception: Cannot 'detach_volume' instance 317528e8-218a-462c-93a1-0e56caf0ea3b while it is in vm_state rescued Oct 04 22:21:34.115830 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'server_id': '317528e8-218a-462c-93a1-0e56caf0ea3b', 'id': 'ed51c8b8-4d49-4ca2-b479-5c8ecfb288ca'} Oct 04 22:21:34.115830 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:21:34.115830 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:21:34.115830 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Oct 04 22:21:34.115830 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Oct 04 22:21:34.115830 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 22:21:34.115830 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 22:21:34.115830 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 04 22:21:34.115830 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 04 22:21:34.115830 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 317528e8-218a-462c-93a1-0e56caf0ea3b in vm_state rescued. Cannot detach_volume while the instance is in this state. Oct 04 22:21:34.115830 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:21:34.115830 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:21:34.115830 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:21:34.115830 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:21:34.115830 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:21:34.115830 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:21:34.115830 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:21:34.115830 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:21:34.115830 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:21:34.115830 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:21:34.115830 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Oct 04 22:21:34.115830 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 04 22:21:34.115830 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 04 22:21:34.115830 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 22:21:34.115830 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 317528e8-218a-462c-93a1-0e56caf0ea3b while it is in vm_state rescued Oct 04 22:21:34.115830 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:21:34.115830 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:21:34.115830 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:21:34.115830 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:21:34.119814 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:21:34.119814 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:21:34.119814 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:21:34.119814 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:21:34.119814 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 317528e8-218a-462c-93a1-0e56caf0ea3b while it is in vm_state rescued Oct 04 22:21:34.119814 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:21:34.129665 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-cd85fcd4-50bb-45aa-85fe-043ff2d3547c tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Returning 409 to user: Cannot 'detach_volume' instance 317528e8-218a-462c-93a1-0e56caf0ea3b while it is in vm_state rescued {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:21:34.130849 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-cd85fcd4-50bb-45aa-85fe-043ff2d3547c tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] 10.222.0.43 "DELETE /compute/v2.1/servers/317528e8-218a-462c-93a1-0e56caf0ea3b/os-volume_attachments/ed51c8b8-4d49-4ca2-b479-5c8ecfb288ca" status: 409 len: 152 microversion: 2.1 time: 0.199311 Oct 04 22:21:34.131809 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3030/5980] 10.222.0.43 () {58 vars in 1416 bytes} [Tue Oct 4 22:21:33 2022] DELETE /compute/v2.1/servers/317528e8-218a-462c-93a1-0e56caf0ea3b/os-volume_attachments/ed51c8b8-4d49-4ca2-b479-5c8ecfb288ca => generated 152 bytes in 214 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 22:21:34.147070 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-32d4525e-4f4a-4cd3-b3fb-0ee7c9f80f5c tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:21:34.147886 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-32d4525e-4f4a-4cd3-b3fb-0ee7c9f80f5c tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] [instance: 317528e8-218a-462c-93a1-0e56caf0ea3b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:21:34.162628 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-32d4525e-4f4a-4cd3-b3fb-0ee7c9f80f5c tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:34.163408 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-32d4525e-4f4a-4cd3-b3fb-0ee7c9f80f5c tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:34.166974 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-32d4525e-4f4a-4cd3-b3fb-0ee7c9f80f5c tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:34.167920 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-32d4525e-4f4a-4cd3-b3fb-0ee7c9f80f5c tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:34.170979 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-32d4525e-4f4a-4cd3-b3fb-0ee7c9f80f5c tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:34.171618 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-32d4525e-4f4a-4cd3-b3fb-0ee7c9f80f5c tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:34.297298 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-32d4525e-4f4a-4cd3-b3fb-0ee7c9f80f5c tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] 10.222.0.43 "POST /compute/v2.1/servers/317528e8-218a-462c-93a1-0e56caf0ea3b/action" status: 202 len: 0 microversion: 2.1 time: 0.159874 Oct 04 22:21:34.304685 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3031/5981] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 22:21:34 2022] POST /compute/v2.1/servers/317528e8-218a-462c-93a1-0e56caf0ea3b/action => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 22:21:34.313010 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-06449ea3-5a01-4592-8468-4a39daba158e tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:21:34.313810 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-06449ea3-5a01-4592-8468-4a39daba158e tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] [instance: 317528e8-218a-462c-93a1-0e56caf0ea3b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:21:34.323739 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-06449ea3-5a01-4592-8468-4a39daba158e tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:34.325169 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-06449ea3-5a01-4592-8468-4a39daba158e tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:34.325893 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-06449ea3-5a01-4592-8468-4a39daba158e tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:34.327048 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-06449ea3-5a01-4592-8468-4a39daba158e tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:34.327751 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-06449ea3-5a01-4592-8468-4a39daba158e tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:34.329280 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-06449ea3-5a01-4592-8468-4a39daba158e tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:34.844026 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-06449ea3-5a01-4592-8468-4a39daba158e tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6cfeabf8d84b2893200c3c54c1c19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be71413506154420869fdff5939fb940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:21:34.858337 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-06449ea3-5a01-4592-8468-4a39daba158e tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] 10.222.0.43 "GET /compute/v2.1/servers/317528e8-218a-462c-93a1-0e56caf0ea3b" status: 200 len: 1725 microversion: 2.1 time: 0.551959 Oct 04 22:21:34.863587 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3032/5982] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:21:34 2022] GET /compute/v2.1/servers/317528e8-218a-462c-93a1-0e56caf0ea3b => generated 1725 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:21:34.947606 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-4a16e36e-abf3-41ee-b4fc-49a1b046f905 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:21:34.948169 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-4a16e36e-abf3-41ee-b4fc-49a1b046f905 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: cbfe78f0-109c-43f8-81d4-2faf07d9ca31] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:21:34.955641 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4a16e36e-abf3-41ee-b4fc-49a1b046f905 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:34.956348 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4a16e36e-abf3-41ee-b4fc-49a1b046f905 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:34.956937 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4a16e36e-abf3-41ee-b4fc-49a1b046f905 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:34.957418 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4a16e36e-abf3-41ee-b4fc-49a1b046f905 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:34.957878 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4a16e36e-abf3-41ee-b4fc-49a1b046f905 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:34.958313 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4a16e36e-abf3-41ee-b4fc-49a1b046f905 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:35.165289 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-4a16e36e-abf3-41ee-b4fc-49a1b046f905 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:21:35.179068 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-4a16e36e-abf3-41ee-b4fc-49a1b046f905 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/cbfe78f0-109c-43f8-81d4-2faf07d9ca31" status: 200 len: 1125 microversion: 2.1 time: 0.236140 Oct 04 22:21:35.180351 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3033/5983] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:21:34 2022] GET /compute/v2.1/servers/cbfe78f0-109c-43f8-81d4-2faf07d9ca31 => generated 1125 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:21:35.187098 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-d5da4361-e666-4a72-8599-e6c4e1ed4b80 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-1566186934-access_point-961147360", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452", "networks": [{"uuid": "45962d45-315d-4212-b9b5-86cfd0041009"}], "key_name": "tempest-TestSecurityGroupsBasicOps-1266046448", "security_groups": [{"name": "tempest-secgroup_access--627753090"}, {"name": "tempest-secgroup_general--1186748798"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:21:35.218543 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:21:35.482061 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.network.neutron [None req-d5da4361-e666-4a72-8599-e6c4e1ed4b80 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] validate_networks() for [('45962d45-315d-4212-b9b5-86cfd0041009', None, None, None, None, None)] {{(pid=134101) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 22:21:36.262618 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-d5da4361-e666-4a72-8599-e6c4e1ed4b80 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Flavor limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 22:21:36.263675 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-d5da4361-e666-4a72-8599-e6c4e1ed4b80 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Image limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 22:21:36.264351 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-d5da4361-e666-4a72-8599-e6c4e1ed4b80 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Flavor pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 22:21:36.264959 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-d5da4361-e666-4a72-8599-e6c4e1ed4b80 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Image pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 22:21:36.265582 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-d5da4361-e666-4a72-8599-e6c4e1ed4b80 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 22:21:36.292361 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d5da4361-e666-4a72-8599-e6c4e1ed4b80 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:36.293208 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d5da4361-e666-4a72-8599-e6c4e1ed4b80 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:36.293850 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d5da4361-e666-4a72-8599-e6c4e1ed4b80 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:36.294817 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d5da4361-e666-4a72-8599-e6c4e1ed4b80 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:36.295502 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d5da4361-e666-4a72-8599-e6c4e1ed4b80 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:36.296136 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d5da4361-e666-4a72-8599-e6c4e1ed4b80 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:36.322306 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-d5da4361-e666-4a72-8599-e6c4e1ed4b80 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Getting quotas for project 35747ba0bc69465e971ba85c88fff0cd. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:21:36.335886 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-d5da4361-e666-4a72-8599-e6c4e1ed4b80 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Getting quotas for user 92bb4deacc2a45df834a675629a56e1b and project 35747ba0bc69465e971ba85c88fff0cd. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:21:36.353339 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-d5da4361-e666-4a72-8599-e6c4e1ed4b80 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Going to run 1 instances... {{(pid=134101) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 22:21:36.355802 n-d-860284-1 devstack@n-api.service[134101]: WARNING nova.utils [None req-d5da4361-e666-4a72-8599-e6c4e1ed4b80 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-1566186934-access_point-961147360 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-1566186934-ac Oct 04 22:21:36.356839 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-d5da4361-e666-4a72-8599-e6c4e1ed4b80 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] [instance: ef43593b-be9b-4e5f-89c4-17a7e6030e29] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='58548514-5dac-426c-81f5-19e3fba33e23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134101) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 22:21:36.552703 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-d5da4361-e666-4a72-8599-e6c4e1ed4b80 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 457 microversion: 2.1 time: 1.370901 Oct 04 22:21:36.553305 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3034/5984] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 22:21:35 2022] POST /compute/v2.1/servers => generated 457 bytes in 1372 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 22:21:36.558748 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-ca11e149-8276-405d-af28-099adc14defe tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:21:36.559537 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-ca11e149-8276-405d-af28-099adc14defe tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] [instance: 317528e8-218a-462c-93a1-0e56caf0ea3b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:21:36.567883 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ca11e149-8276-405d-af28-099adc14defe tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:36.568391 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ca11e149-8276-405d-af28-099adc14defe tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:36.568840 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ca11e149-8276-405d-af28-099adc14defe tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:36.569943 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ca11e149-8276-405d-af28-099adc14defe tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:36.570772 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ca11e149-8276-405d-af28-099adc14defe tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:36.571479 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ca11e149-8276-405d-af28-099adc14defe tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:36.872960 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-ca11e149-8276-405d-af28-099adc14defe tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6cfeabf8d84b2893200c3c54c1c19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be71413506154420869fdff5939fb940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:21:36.886226 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-ca11e149-8276-405d-af28-099adc14defe tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] 10.222.0.43 "GET /compute/v2.1/servers/317528e8-218a-462c-93a1-0e56caf0ea3b" status: 200 len: 1725 microversion: 2.1 time: 0.331817 Oct 04 22:21:36.887202 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3035/5985] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:21:36 2022] GET /compute/v2.1/servers/317528e8-218a-462c-93a1-0e56caf0ea3b => generated 1725 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:21:36.911645 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-ddfb3108-5134-4171-993c-cf8c8f97699d tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:21:36.916569 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-ddfb3108-5134-4171-993c-cf8c8f97699d tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] [instance: 17fb2ff0-7ff4-4acf-a984-ef23ba8ec3dc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:21:36.927012 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ddfb3108-5134-4171-993c-cf8c8f97699d tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:36.927899 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ddfb3108-5134-4171-993c-cf8c8f97699d tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:36.928561 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ddfb3108-5134-4171-993c-cf8c8f97699d tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:36.929554 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ddfb3108-5134-4171-993c-cf8c8f97699d tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:36.930233 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ddfb3108-5134-4171-993c-cf8c8f97699d tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:36.930928 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ddfb3108-5134-4171-993c-cf8c8f97699d tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:37.745143 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-ddfb3108-5134-4171-993c-cf8c8f97699d tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] 10.222.0.43 "POST /compute/v2.1/servers/17fb2ff0-7ff4-4acf-a984-ef23ba8ec3dc/action" status: 200 len: 24524 microversion: 2.1 time: 0.840128 Oct 04 22:21:37.762628 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3036/5986] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 22:21:36 2022] POST /compute/v2.1/servers/17fb2ff0-7ff4-4acf-a984-ef23ba8ec3dc/action => generated 24524 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 22:21:37.775188 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-cd651b8c-eb2e-4f38-894d-075e3dff1647 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:21:37.778821 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-cd651b8c-eb2e-4f38-894d-075e3dff1647 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: cbfe78f0-109c-43f8-81d4-2faf07d9ca31] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:21:37.791814 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cd651b8c-eb2e-4f38-894d-075e3dff1647 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:37.792597 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cd651b8c-eb2e-4f38-894d-075e3dff1647 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:37.793351 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cd651b8c-eb2e-4f38-894d-075e3dff1647 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:37.794249 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cd651b8c-eb2e-4f38-894d-075e3dff1647 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:37.794894 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cd651b8c-eb2e-4f38-894d-075e3dff1647 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:37.796226 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cd651b8c-eb2e-4f38-894d-075e3dff1647 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:38.101701 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-cd651b8c-eb2e-4f38-894d-075e3dff1647 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:21:38.114898 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-cd651b8c-eb2e-4f38-894d-075e3dff1647 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/cbfe78f0-109c-43f8-81d4-2faf07d9ca31" status: 200 len: 1167 microversion: 2.1 time: 0.347627 Oct 04 22:21:38.116021 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3037/5987] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:21:37 2022] GET /compute/v2.1/servers/cbfe78f0-109c-43f8-81d4-2faf07d9ca31 => generated 1167 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:21:38.134605 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-acd26af5-ec2e-40d8-9f62-d89adaeda4e3 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:21:38.135240 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-acd26af5-ec2e-40d8-9f62-d89adaeda4e3 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] [instance: ef43593b-be9b-4e5f-89c4-17a7e6030e29] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:21:38.146324 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-acd26af5-ec2e-40d8-9f62-d89adaeda4e3 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:38.151234 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-acd26af5-ec2e-40d8-9f62-d89adaeda4e3 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:38.151707 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-acd26af5-ec2e-40d8-9f62-d89adaeda4e3 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:38.152475 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-acd26af5-ec2e-40d8-9f62-d89adaeda4e3 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:38.153002 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-acd26af5-ec2e-40d8-9f62-d89adaeda4e3 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:38.153443 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-acd26af5-ec2e-40d8-9f62-d89adaeda4e3 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:38.288600 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-acd26af5-ec2e-40d8-9f62-d89adaeda4e3 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92bb4deacc2a45df834a675629a56e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35747ba0bc69465e971ba85c88fff0cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:21:38.297377 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-acd26af5-ec2e-40d8-9f62-d89adaeda4e3 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] 10.222.0.43 "GET /compute/v2.1/servers/ef43593b-be9b-4e5f-89c4-17a7e6030e29" status: 200 len: 1290 microversion: 2.1 time: 0.179961 Oct 04 22:21:38.298005 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3038/5988] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:21:38 2022] GET /compute/v2.1/servers/ef43593b-be9b-4e5f-89c4-17a7e6030e29 => generated 1290 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:21:38.309145 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-4ef6f4ab-8ea2-4666-8541-80b84100f262 req-c526f1b3-d418-4b6c-97a0-5d9113aacbfe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cbfe78f0-109c-43f8-81d4-2faf07d9ca31", "tag": "942def51-4e4f-4372-a83b-267375942029"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:21:38.324932 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-4ef6f4ab-8ea2-4666-8541-80b84100f262 req-c526f1b3-d418-4b6c-97a0-5d9113aacbfe service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:38.325619 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-4ef6f4ab-8ea2-4666-8541-80b84100f262 req-c526f1b3-d418-4b6c-97a0-5d9113aacbfe service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:38.326123 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-4ef6f4ab-8ea2-4666-8541-80b84100f262 req-c526f1b3-d418-4b6c-97a0-5d9113aacbfe service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:38.343444 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-4ef6f4ab-8ea2-4666-8541-80b84100f262 req-c526f1b3-d418-4b6c-97a0-5d9113aacbfe service nova] Creating event network-changed:942def51-4e4f-4372-a83b-267375942029 for instance cbfe78f0-109c-43f8-81d4-2faf07d9ca31 on n-h2-860284-1 Oct 04 22:21:38.353349 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-4ef6f4ab-8ea2-4666-8541-80b84100f262 req-c526f1b3-d418-4b6c-97a0-5d9113aacbfe service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053642 Oct 04 22:21:38.355011 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3039/5989] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:21:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:21:38.363396 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-0d622333-d55d-4ff9-b1d7-52f5ba463f68 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:21:38.364230 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-0d622333-d55d-4ff9-b1d7-52f5ba463f68 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] [instance: 317528e8-218a-462c-93a1-0e56caf0ea3b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:21:38.374855 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0d622333-d55d-4ff9-b1d7-52f5ba463f68 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:38.375366 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0d622333-d55d-4ff9-b1d7-52f5ba463f68 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:38.375814 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0d622333-d55d-4ff9-b1d7-52f5ba463f68 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:38.376545 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0d622333-d55d-4ff9-b1d7-52f5ba463f68 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:38.377005 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0d622333-d55d-4ff9-b1d7-52f5ba463f68 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:38.379525 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0d622333-d55d-4ff9-b1d7-52f5ba463f68 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:38.689662 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-0d622333-d55d-4ff9-b1d7-52f5ba463f68 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6cfeabf8d84b2893200c3c54c1c19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be71413506154420869fdff5939fb940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:21:38.700206 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-0d622333-d55d-4ff9-b1d7-52f5ba463f68 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] 10.222.0.43 "GET /compute/v2.1/servers/317528e8-218a-462c-93a1-0e56caf0ea3b" status: 200 len: 1731 microversion: 2.1 time: 0.342534 Oct 04 22:21:38.706613 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3040/5990] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:21:38 2022] GET /compute/v2.1/servers/317528e8-218a-462c-93a1-0e56caf0ea3b => generated 1731 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:21:38.724248 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-ad0ca6d7-b827-4719-9d19-a91b1c6c1c94 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:21:38.725063 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-ad0ca6d7-b827-4719-9d19-a91b1c6c1c94 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] [instance: 317528e8-218a-462c-93a1-0e56caf0ea3b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:21:38.733545 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ad0ca6d7-b827-4719-9d19-a91b1c6c1c94 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:38.734459 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ad0ca6d7-b827-4719-9d19-a91b1c6c1c94 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:38.735696 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ad0ca6d7-b827-4719-9d19-a91b1c6c1c94 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:38.738016 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ad0ca6d7-b827-4719-9d19-a91b1c6c1c94 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:38.738779 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ad0ca6d7-b827-4719-9d19-a91b1c6c1c94 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:38.739608 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ad0ca6d7-b827-4719-9d19-a91b1c6c1c94 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:38.900668 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-ad0ca6d7-b827-4719-9d19-a91b1c6c1c94 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] 10.222.0.43 "GET /compute/v2.1/servers/317528e8-218a-462c-93a1-0e56caf0ea3b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.181264 Oct 04 22:21:38.910892 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3041/5991] 10.222.0.43 () {58 vars in 1275 bytes} [Tue Oct 4 22:21:38 2022] GET /compute/v2.1/servers/317528e8-218a-462c-93a1-0e56caf0ea3b/os-interface => generated 285 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:21:39.141591 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-2d4ced4c-4f3b-4981-8eed-9d73ecafde33 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:21:39.142208 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-2d4ced4c-4f3b-4981-8eed-9d73ecafde33 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: cbfe78f0-109c-43f8-81d4-2faf07d9ca31] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:21:39.149439 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2d4ced4c-4f3b-4981-8eed-9d73ecafde33 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:39.150251 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2d4ced4c-4f3b-4981-8eed-9d73ecafde33 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:39.151000 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2d4ced4c-4f3b-4981-8eed-9d73ecafde33 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:39.152070 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2d4ced4c-4f3b-4981-8eed-9d73ecafde33 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:39.152720 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2d4ced4c-4f3b-4981-8eed-9d73ecafde33 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:39.153527 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2d4ced4c-4f3b-4981-8eed-9d73ecafde33 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:39.473930 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-2d4ced4c-4f3b-4981-8eed-9d73ecafde33 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:21:39.490073 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-2d4ced4c-4f3b-4981-8eed-9d73ecafde33 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/cbfe78f0-109c-43f8-81d4-2faf07d9ca31" status: 200 len: 1167 microversion: 2.1 time: 0.352697 Oct 04 22:21:39.505927 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3042/5992] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:21:39 2022] GET /compute/v2.1/servers/cbfe78f0-109c-43f8-81d4-2faf07d9ca31 => generated 1167 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:21:39.520210 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-d3e5ff35-2639-4447-9b13-77fbd5db8e2a tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:21:39.521520 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-d3e5ff35-2639-4447-9b13-77fbd5db8e2a tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] [instance: ef43593b-be9b-4e5f-89c4-17a7e6030e29] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:21:39.532690 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d3e5ff35-2639-4447-9b13-77fbd5db8e2a tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:39.533442 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d3e5ff35-2639-4447-9b13-77fbd5db8e2a tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:39.534118 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d3e5ff35-2639-4447-9b13-77fbd5db8e2a tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:39.535391 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d3e5ff35-2639-4447-9b13-77fbd5db8e2a tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:39.536303 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d3e5ff35-2639-4447-9b13-77fbd5db8e2a tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:39.537030 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d3e5ff35-2639-4447-9b13-77fbd5db8e2a tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:39.707140 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-d3e5ff35-2639-4447-9b13-77fbd5db8e2a tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92bb4deacc2a45df834a675629a56e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35747ba0bc69465e971ba85c88fff0cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:21:39.726889 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-d3e5ff35-2639-4447-9b13-77fbd5db8e2a tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] 10.222.0.43 "GET /compute/v2.1/servers/ef43593b-be9b-4e5f-89c4-17a7e6030e29" status: 200 len: 1364 microversion: 2.1 time: 0.211828 Oct 04 22:21:39.744157 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3043/5993] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:21:39 2022] GET /compute/v2.1/servers/ef43593b-be9b-4e5f-89c4-17a7e6030e29 => generated 1364 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:21:40.517937 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-2d136249-9e90-4140-b270-76a9b49ae074 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:21:40.520751 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-2d136249-9e90-4140-b270-76a9b49ae074 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: cbfe78f0-109c-43f8-81d4-2faf07d9ca31] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:21:40.533551 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2d136249-9e90-4140-b270-76a9b49ae074 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:40.536908 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2d136249-9e90-4140-b270-76a9b49ae074 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:40.537628 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2d136249-9e90-4140-b270-76a9b49ae074 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:40.538766 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2d136249-9e90-4140-b270-76a9b49ae074 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:40.542412 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2d136249-9e90-4140-b270-76a9b49ae074 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:40.543194 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2d136249-9e90-4140-b270-76a9b49ae074 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:40.927782 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-2d136249-9e90-4140-b270-76a9b49ae074 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:21:40.935572 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:21:40.957304 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-2d136249-9e90-4140-b270-76a9b49ae074 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/cbfe78f0-109c-43f8-81d4-2faf07d9ca31" status: 200 len: 1167 microversion: 2.1 time: 0.440758 Oct 04 22:21:40.973742 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3044/5994] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:21:40 2022] GET /compute/v2.1/servers/cbfe78f0-109c-43f8-81d4-2faf07d9ca31 => generated 1167 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:21:40.991523 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-060defd3-8a18-4973-932c-2fb329742d15 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:21:40.992965 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-060defd3-8a18-4973-932c-2fb329742d15 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] [instance: ef43593b-be9b-4e5f-89c4-17a7e6030e29] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:21:41.030739 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-060defd3-8a18-4973-932c-2fb329742d15 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:41.031684 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-060defd3-8a18-4973-932c-2fb329742d15 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:41.032138 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-060defd3-8a18-4973-932c-2fb329742d15 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:41.037951 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-060defd3-8a18-4973-932c-2fb329742d15 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:41.038453 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-060defd3-8a18-4973-932c-2fb329742d15 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:41.038890 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-060defd3-8a18-4973-932c-2fb329742d15 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:41.461435 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-060defd3-8a18-4973-932c-2fb329742d15 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92bb4deacc2a45df834a675629a56e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35747ba0bc69465e971ba85c88fff0cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:21:41.472552 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-060defd3-8a18-4973-932c-2fb329742d15 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] 10.222.0.43 "GET /compute/v2.1/servers/ef43593b-be9b-4e5f-89c4-17a7e6030e29" status: 200 len: 1471 microversion: 2.1 time: 0.497165 Oct 04 22:21:41.475019 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3045/5995] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:21:40 2022] GET /compute/v2.1/servers/ef43593b-be9b-4e5f-89c4-17a7e6030e29 => generated 1471 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:21:41.516156 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-f8e2e8f2-ef96-4a35-ae6d-0a201f09eaa8 req-c999c7f7-d2f1-4c86-9ccc-e2d4cb31be5b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "317528e8-218a-462c-93a1-0e56caf0ea3b", "tag": "812694ba-e03a-4b71-918e-d542d921b653"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:21:41.530154 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-f8e2e8f2-ef96-4a35-ae6d-0a201f09eaa8 req-c999c7f7-d2f1-4c86-9ccc-e2d4cb31be5b service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:41.531910 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-f8e2e8f2-ef96-4a35-ae6d-0a201f09eaa8 req-c999c7f7-d2f1-4c86-9ccc-e2d4cb31be5b service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:41.532546 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-f8e2e8f2-ef96-4a35-ae6d-0a201f09eaa8 req-c999c7f7-d2f1-4c86-9ccc-e2d4cb31be5b service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:41.548586 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-f8e2e8f2-ef96-4a35-ae6d-0a201f09eaa8 req-c999c7f7-d2f1-4c86-9ccc-e2d4cb31be5b service nova] Creating event network-changed:812694ba-e03a-4b71-918e-d542d921b653 for instance 317528e8-218a-462c-93a1-0e56caf0ea3b on n-h1-860284-1 Oct 04 22:21:41.560316 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-f8e2e8f2-ef96-4a35-ae6d-0a201f09eaa8 req-c999c7f7-d2f1-4c86-9ccc-e2d4cb31be5b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081445 Oct 04 22:21:41.564232 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3046/5996] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:21:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:21:41.999733 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-08e894a9-ec97-4e5c-b4cd-b1f410eee8b4 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:21:42.001114 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-08e894a9-ec97-4e5c-b4cd-b1f410eee8b4 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: cbfe78f0-109c-43f8-81d4-2faf07d9ca31] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:21:42.021708 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-08e894a9-ec97-4e5c-b4cd-b1f410eee8b4 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:42.022595 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-08e894a9-ec97-4e5c-b4cd-b1f410eee8b4 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:42.023720 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-08e894a9-ec97-4e5c-b4cd-b1f410eee8b4 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:42.025175 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-08e894a9-ec97-4e5c-b4cd-b1f410eee8b4 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:42.025665 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-08e894a9-ec97-4e5c-b4cd-b1f410eee8b4 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:42.026189 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-08e894a9-ec97-4e5c-b4cd-b1f410eee8b4 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:42.635670 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-08e894a9-ec97-4e5c-b4cd-b1f410eee8b4 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:21:42.650111 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-08e894a9-ec97-4e5c-b4cd-b1f410eee8b4 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/cbfe78f0-109c-43f8-81d4-2faf07d9ca31" status: 200 len: 1167 microversion: 2.1 time: 0.657336 Oct 04 22:21:42.661672 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3047/5997] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:21:41 2022] GET /compute/v2.1/servers/cbfe78f0-109c-43f8-81d4-2faf07d9ca31 => generated 1167 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:21:42.661672 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-0fd83481-cf4e-4122-af2a-50bc6c824a89 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:21:42.665956 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-0fd83481-cf4e-4122-af2a-50bc6c824a89 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] [instance: ef43593b-be9b-4e5f-89c4-17a7e6030e29] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:21:42.678026 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0fd83481-cf4e-4122-af2a-50bc6c824a89 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:42.682540 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0fd83481-cf4e-4122-af2a-50bc6c824a89 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:42.683182 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0fd83481-cf4e-4122-af2a-50bc6c824a89 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:42.684016 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0fd83481-cf4e-4122-af2a-50bc6c824a89 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:42.684748 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0fd83481-cf4e-4122-af2a-50bc6c824a89 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:42.685316 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0fd83481-cf4e-4122-af2a-50bc6c824a89 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:43.078671 n-d-860284-1 devstack@n-api.service[134102]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 22:21:43.079265 n-d-860284-1 devstack@n-api.service[134102]: Tue Oct 4 22:21:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.43) !!! Oct 04 22:21:43.100744 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-0fd83481-cf4e-4122-af2a-50bc6c824a89 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92bb4deacc2a45df834a675629a56e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35747ba0bc69465e971ba85c88fff0cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:21:43.114675 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-0fd83481-cf4e-4122-af2a-50bc6c824a89 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] 10.222.0.43 "GET /compute/v2.1/servers/ef43593b-be9b-4e5f-89c4-17a7e6030e29" status: 200 len: 1471 microversion: 2.1 time: 0.461965 Oct 04 22:21:43.115506 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3048/5998] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:21:42 2022] GET /compute/v2.1/servers/ef43593b-be9b-4e5f-89c4-17a7e6030e29 => generated 1471 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:21:43.133570 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-f80dbc87-610d-48c7-a258-965fba0e39e3 req-9c849fed-cf20-4438-8dfe-a0bc5446dec4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef43593b-be9b-4e5f-89c4-17a7e6030e29", "tag": "d4ad42be-39ad-404b-9392-f2b7142e73bc"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:21:43.153194 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-f80dbc87-610d-48c7-a258-965fba0e39e3 req-9c849fed-cf20-4438-8dfe-a0bc5446dec4 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:43.153689 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-f80dbc87-610d-48c7-a258-965fba0e39e3 req-9c849fed-cf20-4438-8dfe-a0bc5446dec4 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:43.154091 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-f80dbc87-610d-48c7-a258-965fba0e39e3 req-9c849fed-cf20-4438-8dfe-a0bc5446dec4 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:43.185187 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-f80dbc87-610d-48c7-a258-965fba0e39e3 req-9c849fed-cf20-4438-8dfe-a0bc5446dec4 service nova] Creating event network-changed:d4ad42be-39ad-404b-9392-f2b7142e73bc for instance ef43593b-be9b-4e5f-89c4-17a7e6030e29 on n-h1-860284-1 Oct 04 22:21:43.201812 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-f80dbc87-610d-48c7-a258-965fba0e39e3 req-9c849fed-cf20-4438-8dfe-a0bc5446dec4 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071625 Oct 04 22:21:43.209859 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3049/5999] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:21:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:21:43.592087 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-41e661cc-4530-4cd6-bf8f-54b8dd20f38b req-111d61cd-36a5-49fa-8c34-da3f0156f1f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "317528e8-218a-462c-93a1-0e56caf0ea3b", "tag": "812694ba-e03a-4b71-918e-d542d921b653"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:21:43.605997 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-41e661cc-4530-4cd6-bf8f-54b8dd20f38b req-111d61cd-36a5-49fa-8c34-da3f0156f1f7 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:43.607116 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-41e661cc-4530-4cd6-bf8f-54b8dd20f38b req-111d61cd-36a5-49fa-8c34-da3f0156f1f7 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:43.607938 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-41e661cc-4530-4cd6-bf8f-54b8dd20f38b req-111d61cd-36a5-49fa-8c34-da3f0156f1f7 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:43.631892 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-41e661cc-4530-4cd6-bf8f-54b8dd20f38b req-111d61cd-36a5-49fa-8c34-da3f0156f1f7 service nova] Creating event network-changed:812694ba-e03a-4b71-918e-d542d921b653 for instance 317528e8-218a-462c-93a1-0e56caf0ea3b on n-h1-860284-1 Oct 04 22:21:43.637409 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-41e661cc-4530-4cd6-bf8f-54b8dd20f38b req-111d61cd-36a5-49fa-8c34-da3f0156f1f7 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051213 Oct 04 22:21:43.639060 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3050/6000] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:21:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:21:43.689442 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-6a822ecd-883f-46b0-b6e2-bb02ad9812eb tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:21:43.692961 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-6a822ecd-883f-46b0-b6e2-bb02ad9812eb tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: cbfe78f0-109c-43f8-81d4-2faf07d9ca31] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:21:43.714529 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6a822ecd-883f-46b0-b6e2-bb02ad9812eb tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:43.717288 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6a822ecd-883f-46b0-b6e2-bb02ad9812eb tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:43.717949 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6a822ecd-883f-46b0-b6e2-bb02ad9812eb tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:43.723455 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6a822ecd-883f-46b0-b6e2-bb02ad9812eb tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:43.726120 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6a822ecd-883f-46b0-b6e2-bb02ad9812eb tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:43.727030 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6a822ecd-883f-46b0-b6e2-bb02ad9812eb tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:44.053114 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-6a822ecd-883f-46b0-b6e2-bb02ad9812eb tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:21:44.091630 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-6a822ecd-883f-46b0-b6e2-bb02ad9812eb tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/cbfe78f0-109c-43f8-81d4-2faf07d9ca31" status: 200 len: 1167 microversion: 2.1 time: 0.407364 Oct 04 22:21:44.094033 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3051/6001] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:21:43 2022] GET /compute/v2.1/servers/cbfe78f0-109c-43f8-81d4-2faf07d9ca31 => generated 1167 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:21:44.151408 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-7bc5a57f-64d6-4670-a5a2-b8eb5abd501a tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:21:44.152871 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-7bc5a57f-64d6-4670-a5a2-b8eb5abd501a tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] [instance: ef43593b-be9b-4e5f-89c4-17a7e6030e29] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:21:44.164451 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7bc5a57f-64d6-4670-a5a2-b8eb5abd501a tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:44.165317 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7bc5a57f-64d6-4670-a5a2-b8eb5abd501a tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:44.166865 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7bc5a57f-64d6-4670-a5a2-b8eb5abd501a tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:44.168237 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7bc5a57f-64d6-4670-a5a2-b8eb5abd501a tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:44.169167 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7bc5a57f-64d6-4670-a5a2-b8eb5abd501a tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:44.169831 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7bc5a57f-64d6-4670-a5a2-b8eb5abd501a tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:44.384645 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-7bc5a57f-64d6-4670-a5a2-b8eb5abd501a tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92bb4deacc2a45df834a675629a56e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35747ba0bc69465e971ba85c88fff0cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:21:44.395721 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-7bc5a57f-64d6-4670-a5a2-b8eb5abd501a tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] 10.222.0.43 "GET /compute/v2.1/servers/ef43593b-be9b-4e5f-89c4-17a7e6030e29" status: 200 len: 1471 microversion: 2.1 time: 0.254987 Oct 04 22:21:44.396508 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3052/6002] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:21:44 2022] GET /compute/v2.1/servers/ef43593b-be9b-4e5f-89c4-17a7e6030e29 => generated 1471 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:21:45.118292 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-11fc6561-eb35-4ce3-8cb1-54180ef49609 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:21:45.120119 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-11fc6561-eb35-4ce3-8cb1-54180ef49609 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: cbfe78f0-109c-43f8-81d4-2faf07d9ca31] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:21:45.130530 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-11fc6561-eb35-4ce3-8cb1-54180ef49609 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:45.131245 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-11fc6561-eb35-4ce3-8cb1-54180ef49609 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:45.131849 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-11fc6561-eb35-4ce3-8cb1-54180ef49609 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:45.132839 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-11fc6561-eb35-4ce3-8cb1-54180ef49609 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:45.133295 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-11fc6561-eb35-4ce3-8cb1-54180ef49609 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:45.133887 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-11fc6561-eb35-4ce3-8cb1-54180ef49609 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:45.362531 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-11fc6561-eb35-4ce3-8cb1-54180ef49609 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:21:45.374087 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-11fc6561-eb35-4ce3-8cb1-54180ef49609 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/cbfe78f0-109c-43f8-81d4-2faf07d9ca31" status: 200 len: 1167 microversion: 2.1 time: 0.261091 Oct 04 22:21:45.375145 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3053/6003] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:21:45 2022] GET /compute/v2.1/servers/cbfe78f0-109c-43f8-81d4-2faf07d9ca31 => generated 1167 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:21:45.443811 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-9836029a-07a9-4fd1-a7b9-1940592b37e4 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:21:45.445379 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-9836029a-07a9-4fd1-a7b9-1940592b37e4 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] [instance: ef43593b-be9b-4e5f-89c4-17a7e6030e29] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:21:45.461635 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9836029a-07a9-4fd1-a7b9-1940592b37e4 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:45.462729 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9836029a-07a9-4fd1-a7b9-1940592b37e4 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:45.463773 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9836029a-07a9-4fd1-a7b9-1940592b37e4 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:45.464778 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9836029a-07a9-4fd1-a7b9-1940592b37e4 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:45.466387 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9836029a-07a9-4fd1-a7b9-1940592b37e4 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:45.466387 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9836029a-07a9-4fd1-a7b9-1940592b37e4 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:45.680961 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-9836029a-07a9-4fd1-a7b9-1940592b37e4 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92bb4deacc2a45df834a675629a56e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35747ba0bc69465e971ba85c88fff0cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:21:45.696282 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-9836029a-07a9-4fd1-a7b9-1940592b37e4 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] 10.222.0.43 "GET /compute/v2.1/servers/ef43593b-be9b-4e5f-89c4-17a7e6030e29" status: 200 len: 1471 microversion: 2.1 time: 0.259605 Oct 04 22:21:45.702749 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3054/6004] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:21:45 2022] GET /compute/v2.1/servers/ef43593b-be9b-4e5f-89c4-17a7e6030e29 => generated 1471 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:21:46.404448 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e11cea84-5b49-439d-a75c-bcf53f5992a2 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:21:46.405803 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-e11cea84-5b49-439d-a75c-bcf53f5992a2 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: cbfe78f0-109c-43f8-81d4-2faf07d9ca31] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:21:46.409244 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=4 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:21:46.410876 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=16 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:21:46.462542 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e11cea84-5b49-439d-a75c-bcf53f5992a2 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:46.463233 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e11cea84-5b49-439d-a75c-bcf53f5992a2 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:46.463690 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e11cea84-5b49-439d-a75c-bcf53f5992a2 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:46.464667 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e11cea84-5b49-439d-a75c-bcf53f5992a2 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:46.465422 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e11cea84-5b49-439d-a75c-bcf53f5992a2 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:46.466028 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e11cea84-5b49-439d-a75c-bcf53f5992a2 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:46.741981 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-e11cea84-5b49-439d-a75c-bcf53f5992a2 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:21:46.750896 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-e11cea84-5b49-439d-a75c-bcf53f5992a2 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/cbfe78f0-109c-43f8-81d4-2faf07d9ca31" status: 200 len: 1167 microversion: 2.1 time: 0.350613 Oct 04 22:21:46.768772 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3055/6005] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:21:46 2022] GET /compute/v2.1/servers/cbfe78f0-109c-43f8-81d4-2faf07d9ca31 => generated 1167 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:21:46.786283 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-d09a5aed-9f1f-4881-b44a-f1d4442b0797 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:21:46.787350 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-d09a5aed-9f1f-4881-b44a-f1d4442b0797 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] [instance: ef43593b-be9b-4e5f-89c4-17a7e6030e29] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:21:46.798212 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d09a5aed-9f1f-4881-b44a-f1d4442b0797 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:46.807181 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d09a5aed-9f1f-4881-b44a-f1d4442b0797 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:46.807634 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d09a5aed-9f1f-4881-b44a-f1d4442b0797 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:46.808598 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d09a5aed-9f1f-4881-b44a-f1d4442b0797 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:46.809263 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d09a5aed-9f1f-4881-b44a-f1d4442b0797 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:46.809728 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d09a5aed-9f1f-4881-b44a-f1d4442b0797 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:47.162348 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-d09a5aed-9f1f-4881-b44a-f1d4442b0797 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92bb4deacc2a45df834a675629a56e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35747ba0bc69465e971ba85c88fff0cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:21:47.174506 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-d09a5aed-9f1f-4881-b44a-f1d4442b0797 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] 10.222.0.43 "GET /compute/v2.1/servers/ef43593b-be9b-4e5f-89c4-17a7e6030e29" status: 200 len: 1471 microversion: 2.1 time: 0.404274 Oct 04 22:21:47.176125 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3056/6006] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:21:46 2022] GET /compute/v2.1/servers/ef43593b-be9b-4e5f-89c4-17a7e6030e29 => generated 1471 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:21:47.661178 n-d-860284-1 devstack@n-api.service[134102]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 22:21:47.661728 n-d-860284-1 devstack@n-api.service[134102]: Tue Oct 4 22:21:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.43) !!! Oct 04 22:21:47.775588 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-d4611b7a-0d58-4c01-acb7-02d285d736cc tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:21:47.776931 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-d4611b7a-0d58-4c01-acb7-02d285d736cc tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: cbfe78f0-109c-43f8-81d4-2faf07d9ca31] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:21:47.786501 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d4611b7a-0d58-4c01-acb7-02d285d736cc tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:47.787024 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d4611b7a-0d58-4c01-acb7-02d285d736cc tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:47.787503 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d4611b7a-0d58-4c01-acb7-02d285d736cc tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:47.788202 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d4611b7a-0d58-4c01-acb7-02d285d736cc tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:47.788668 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d4611b7a-0d58-4c01-acb7-02d285d736cc tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:47.789106 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d4611b7a-0d58-4c01-acb7-02d285d736cc tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:47.940349 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-d4611b7a-0d58-4c01-acb7-02d285d736cc tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:21:47.947587 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-d4611b7a-0d58-4c01-acb7-02d285d736cc tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/cbfe78f0-109c-43f8-81d4-2faf07d9ca31" status: 200 len: 1167 microversion: 2.1 time: 0.175799 Oct 04 22:21:47.948580 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3057/6007] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:21:47 2022] GET /compute/v2.1/servers/cbfe78f0-109c-43f8-81d4-2faf07d9ca31 => generated 1167 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:21:48.199302 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-b9ba4af4-755e-4ac6-bb0e-2d0a5141f502 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:21:48.200213 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-b9ba4af4-755e-4ac6-bb0e-2d0a5141f502 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] [instance: ef43593b-be9b-4e5f-89c4-17a7e6030e29] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:21:48.207838 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b9ba4af4-755e-4ac6-bb0e-2d0a5141f502 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:48.208219 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b9ba4af4-755e-4ac6-bb0e-2d0a5141f502 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:48.208668 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b9ba4af4-755e-4ac6-bb0e-2d0a5141f502 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:48.209510 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b9ba4af4-755e-4ac6-bb0e-2d0a5141f502 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:48.209983 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b9ba4af4-755e-4ac6-bb0e-2d0a5141f502 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:48.210658 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b9ba4af4-755e-4ac6-bb0e-2d0a5141f502 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:48.379736 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-b9ba4af4-755e-4ac6-bb0e-2d0a5141f502 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92bb4deacc2a45df834a675629a56e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35747ba0bc69465e971ba85c88fff0cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:21:48.404124 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-b9ba4af4-755e-4ac6-bb0e-2d0a5141f502 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] 10.222.0.43 "GET /compute/v2.1/servers/ef43593b-be9b-4e5f-89c4-17a7e6030e29" status: 200 len: 1471 microversion: 2.1 time: 0.197889 Oct 04 22:21:48.405548 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3058/6008] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:21:48 2022] GET /compute/v2.1/servers/ef43593b-be9b-4e5f-89c4-17a7e6030e29 => generated 1471 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:21:48.970043 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-9a400b5c-e7ee-41e8-9aca-7d6b4e79e30c tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:21:48.972528 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-9a400b5c-e7ee-41e8-9aca-7d6b4e79e30c tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: cbfe78f0-109c-43f8-81d4-2faf07d9ca31] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:21:48.980641 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9a400b5c-e7ee-41e8-9aca-7d6b4e79e30c tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:48.982638 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9a400b5c-e7ee-41e8-9aca-7d6b4e79e30c tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:48.983408 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9a400b5c-e7ee-41e8-9aca-7d6b4e79e30c tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:48.985016 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9a400b5c-e7ee-41e8-9aca-7d6b4e79e30c tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:48.985653 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9a400b5c-e7ee-41e8-9aca-7d6b4e79e30c tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:48.986241 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9a400b5c-e7ee-41e8-9aca-7d6b4e79e30c tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:49.185382 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-9a400b5c-e7ee-41e8-9aca-7d6b4e79e30c tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:21:49.195048 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-9a400b5c-e7ee-41e8-9aca-7d6b4e79e30c tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/cbfe78f0-109c-43f8-81d4-2faf07d9ca31" status: 200 len: 1167 microversion: 2.1 time: 0.229032 Oct 04 22:21:49.196348 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3059/6009] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:21:48 2022] GET /compute/v2.1/servers/cbfe78f0-109c-43f8-81d4-2faf07d9ca31 => generated 1167 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:21:49.431610 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-62668262-49c8-4e42-ae20-1b4694bdc2b5 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:21:49.432972 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-62668262-49c8-4e42-ae20-1b4694bdc2b5 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] [instance: ef43593b-be9b-4e5f-89c4-17a7e6030e29] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:21:49.446262 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-62668262-49c8-4e42-ae20-1b4694bdc2b5 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:49.446799 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-62668262-49c8-4e42-ae20-1b4694bdc2b5 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:49.447245 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-62668262-49c8-4e42-ae20-1b4694bdc2b5 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:49.447984 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-62668262-49c8-4e42-ae20-1b4694bdc2b5 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:49.451110 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-62668262-49c8-4e42-ae20-1b4694bdc2b5 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:49.451898 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-62668262-49c8-4e42-ae20-1b4694bdc2b5 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:49.682864 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-62668262-49c8-4e42-ae20-1b4694bdc2b5 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92bb4deacc2a45df834a675629a56e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35747ba0bc69465e971ba85c88fff0cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:21:49.691107 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-62668262-49c8-4e42-ae20-1b4694bdc2b5 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] 10.222.0.43 "GET /compute/v2.1/servers/ef43593b-be9b-4e5f-89c4-17a7e6030e29" status: 200 len: 1471 microversion: 2.1 time: 0.265898 Oct 04 22:21:49.691920 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3060/6010] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:21:49 2022] GET /compute/v2.1/servers/ef43593b-be9b-4e5f-89c4-17a7e6030e29 => generated 1471 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:21:50.219702 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-47606254-e996-4aad-bfcf-a82fbb92d428 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:21:50.220487 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-47606254-e996-4aad-bfcf-a82fbb92d428 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: cbfe78f0-109c-43f8-81d4-2faf07d9ca31] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:21:50.245763 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-47606254-e996-4aad-bfcf-a82fbb92d428 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:50.246301 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-47606254-e996-4aad-bfcf-a82fbb92d428 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:50.246768 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-47606254-e996-4aad-bfcf-a82fbb92d428 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:50.247496 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-47606254-e996-4aad-bfcf-a82fbb92d428 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:50.247964 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-47606254-e996-4aad-bfcf-a82fbb92d428 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:50.248397 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-47606254-e996-4aad-bfcf-a82fbb92d428 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:50.411858 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-47606254-e996-4aad-bfcf-a82fbb92d428 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:21:50.422836 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-47606254-e996-4aad-bfcf-a82fbb92d428 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/cbfe78f0-109c-43f8-81d4-2faf07d9ca31" status: 200 len: 1167 microversion: 2.1 time: 0.206017 Oct 04 22:21:50.448984 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3061/6011] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:21:50 2022] GET /compute/v2.1/servers/cbfe78f0-109c-43f8-81d4-2faf07d9ca31 => generated 1167 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:21:50.576465 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-9b6e5090-d6e4-490e-84db-e97c3edba562 req-87d49f57-5894-43b5-82f0-659fbac82bec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef43593b-be9b-4e5f-89c4-17a7e6030e29", "name": "network-vif-plugged", "status": "completed", "tag": "d4ad42be-39ad-404b-9392-f2b7142e73bc"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:21:50.590408 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-9b6e5090-d6e4-490e-84db-e97c3edba562 req-87d49f57-5894-43b5-82f0-659fbac82bec service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:50.590408 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-9b6e5090-d6e4-490e-84db-e97c3edba562 req-87d49f57-5894-43b5-82f0-659fbac82bec service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:50.591086 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-9b6e5090-d6e4-490e-84db-e97c3edba562 req-87d49f57-5894-43b5-82f0-659fbac82bec service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:50.622232 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-9b6e5090-d6e4-490e-84db-e97c3edba562 req-87d49f57-5894-43b5-82f0-659fbac82bec service nova] Creating event network-vif-plugged:d4ad42be-39ad-404b-9392-f2b7142e73bc for instance ef43593b-be9b-4e5f-89c4-17a7e6030e29 on n-h1-860284-1 Oct 04 22:21:50.628845 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-9b6e5090-d6e4-490e-84db-e97c3edba562 req-87d49f57-5894-43b5-82f0-659fbac82bec service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056215 Oct 04 22:21:50.629795 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3062/6012] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:21:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:21:50.716873 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-2404b823-28fd-4132-895c-1ca182ba7b2a tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:21:50.717938 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-2404b823-28fd-4132-895c-1ca182ba7b2a tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] [instance: ef43593b-be9b-4e5f-89c4-17a7e6030e29] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:21:50.725939 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2404b823-28fd-4132-895c-1ca182ba7b2a tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:50.726839 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2404b823-28fd-4132-895c-1ca182ba7b2a tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:50.727521 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2404b823-28fd-4132-895c-1ca182ba7b2a tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:50.728465 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2404b823-28fd-4132-895c-1ca182ba7b2a tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:50.729137 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2404b823-28fd-4132-895c-1ca182ba7b2a tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:50.729781 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2404b823-28fd-4132-895c-1ca182ba7b2a tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:50.932426 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-2404b823-28fd-4132-895c-1ca182ba7b2a tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92bb4deacc2a45df834a675629a56e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35747ba0bc69465e971ba85c88fff0cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:21:50.943096 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-2404b823-28fd-4132-895c-1ca182ba7b2a tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] 10.222.0.43 "GET /compute/v2.1/servers/ef43593b-be9b-4e5f-89c4-17a7e6030e29" status: 200 len: 1471 microversion: 2.1 time: 0.230486 Oct 04 22:21:50.943858 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3063/6013] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:21:50 2022] GET /compute/v2.1/servers/ef43593b-be9b-4e5f-89c4-17a7e6030e29 => generated 1471 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:21:51.451377 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-ee2879f4-ce30-451d-87b4-38a511fdd6b5 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:21:51.452929 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-ee2879f4-ce30-451d-87b4-38a511fdd6b5 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: cbfe78f0-109c-43f8-81d4-2faf07d9ca31] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:21:51.460756 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ee2879f4-ce30-451d-87b4-38a511fdd6b5 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:51.461248 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ee2879f4-ce30-451d-87b4-38a511fdd6b5 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:51.461683 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ee2879f4-ce30-451d-87b4-38a511fdd6b5 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:51.462514 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ee2879f4-ce30-451d-87b4-38a511fdd6b5 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:51.462969 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ee2879f4-ce30-451d-87b4-38a511fdd6b5 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:51.463393 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ee2879f4-ce30-451d-87b4-38a511fdd6b5 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:51.467803 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=100 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:21:51.605776 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-ee2879f4-ce30-451d-87b4-38a511fdd6b5 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:21:51.616583 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-ee2879f4-ce30-451d-87b4-38a511fdd6b5 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/cbfe78f0-109c-43f8-81d4-2faf07d9ca31" status: 200 len: 1167 microversion: 2.1 time: 0.169071 Oct 04 22:21:51.617174 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3064/6014] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:21:51 2022] GET /compute/v2.1/servers/cbfe78f0-109c-43f8-81d4-2faf07d9ca31 => generated 1167 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:21:51.967240 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-51f59eaa-f918-46f8-a19d-2a0ed2e93305 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:21:51.968180 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-51f59eaa-f918-46f8-a19d-2a0ed2e93305 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] [instance: ef43593b-be9b-4e5f-89c4-17a7e6030e29] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:21:51.977554 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-51f59eaa-f918-46f8-a19d-2a0ed2e93305 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:51.978034 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-51f59eaa-f918-46f8-a19d-2a0ed2e93305 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:51.978572 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-51f59eaa-f918-46f8-a19d-2a0ed2e93305 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:51.979304 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-51f59eaa-f918-46f8-a19d-2a0ed2e93305 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:51.979768 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-51f59eaa-f918-46f8-a19d-2a0ed2e93305 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:51.980206 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-51f59eaa-f918-46f8-a19d-2a0ed2e93305 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:52.149227 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-51f59eaa-f918-46f8-a19d-2a0ed2e93305 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92bb4deacc2a45df834a675629a56e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35747ba0bc69465e971ba85c88fff0cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:21:52.161570 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-51f59eaa-f918-46f8-a19d-2a0ed2e93305 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] 10.222.0.43 "GET /compute/v2.1/servers/ef43593b-be9b-4e5f-89c4-17a7e6030e29" status: 200 len: 1471 microversion: 2.1 time: 0.198974 Oct 04 22:21:52.162466 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3065/6015] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:21:51 2022] GET /compute/v2.1/servers/ef43593b-be9b-4e5f-89c4-17a7e6030e29 => generated 1471 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:21:52.640721 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-53ef0d1e-f136-4d9c-9e8a-193c771cbe67 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:21:52.641410 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-53ef0d1e-f136-4d9c-9e8a-193c771cbe67 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: cbfe78f0-109c-43f8-81d4-2faf07d9ca31] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:21:52.652083 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-53ef0d1e-f136-4d9c-9e8a-193c771cbe67 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:52.652497 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-53ef0d1e-f136-4d9c-9e8a-193c771cbe67 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:52.652966 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-53ef0d1e-f136-4d9c-9e8a-193c771cbe67 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:52.653673 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-53ef0d1e-f136-4d9c-9e8a-193c771cbe67 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:52.654153 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-53ef0d1e-f136-4d9c-9e8a-193c771cbe67 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:52.657865 n-d-860284-1 devstack@n-api.service[134102]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 22:21:52.659506 n-d-860284-1 devstack@n-api.service[134102]: Tue Oct 4 22:21:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.43) !!! Oct 04 22:21:52.659624 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-53ef0d1e-f136-4d9c-9e8a-193c771cbe67 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:52.817156 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-53ef0d1e-f136-4d9c-9e8a-193c771cbe67 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:21:52.826025 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-53ef0d1e-f136-4d9c-9e8a-193c771cbe67 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/cbfe78f0-109c-43f8-81d4-2faf07d9ca31" status: 200 len: 1167 microversion: 2.1 time: 0.189314 Oct 04 22:21:52.826996 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3066/6016] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:21:52 2022] GET /compute/v2.1/servers/cbfe78f0-109c-43f8-81d4-2faf07d9ca31 => generated 1167 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:21:53.184409 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-ce48397b-4ccc-4c61-86eb-1b2407ab265a tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:21:53.185062 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-ce48397b-4ccc-4c61-86eb-1b2407ab265a tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] [instance: ef43593b-be9b-4e5f-89c4-17a7e6030e29] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:21:53.191885 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ce48397b-4ccc-4c61-86eb-1b2407ab265a tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:53.192558 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ce48397b-4ccc-4c61-86eb-1b2407ab265a tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:53.193005 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ce48397b-4ccc-4c61-86eb-1b2407ab265a tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:53.193853 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ce48397b-4ccc-4c61-86eb-1b2407ab265a tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:53.194449 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ce48397b-4ccc-4c61-86eb-1b2407ab265a tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:53.195064 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ce48397b-4ccc-4c61-86eb-1b2407ab265a tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:53.353072 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-ce48397b-4ccc-4c61-86eb-1b2407ab265a tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92bb4deacc2a45df834a675629a56e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35747ba0bc69465e971ba85c88fff0cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:21:53.361211 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-ce48397b-4ccc-4c61-86eb-1b2407ab265a tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] 10.222.0.43 "GET /compute/v2.1/servers/ef43593b-be9b-4e5f-89c4-17a7e6030e29" status: 200 len: 1643 microversion: 2.1 time: 0.180949 Oct 04 22:21:53.362665 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3067/6017] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:21:53 2022] GET /compute/v2.1/servers/ef43593b-be9b-4e5f-89c4-17a7e6030e29 => generated 1643 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:21:53.384400 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-1f4d10a8-b504-483c-a408-42f3ed07ca5f tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:21:53.385009 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-1f4d10a8-b504-483c-a408-42f3ed07ca5f tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] [instance: ef43593b-be9b-4e5f-89c4-17a7e6030e29] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:21:53.391120 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1f4d10a8-b504-483c-a408-42f3ed07ca5f tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:53.391602 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1f4d10a8-b504-483c-a408-42f3ed07ca5f tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:53.392039 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1f4d10a8-b504-483c-a408-42f3ed07ca5f tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:53.392727 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1f4d10a8-b504-483c-a408-42f3ed07ca5f tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:53.393835 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1f4d10a8-b504-483c-a408-42f3ed07ca5f tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:53.394428 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1f4d10a8-b504-483c-a408-42f3ed07ca5f tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:53.545228 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-1f4d10a8-b504-483c-a408-42f3ed07ca5f tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92bb4deacc2a45df834a675629a56e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35747ba0bc69465e971ba85c88fff0cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:21:53.553248 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-1f4d10a8-b504-483c-a408-42f3ed07ca5f tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] 10.222.0.43 "GET /compute/v2.1/servers/ef43593b-be9b-4e5f-89c4-17a7e6030e29" status: 200 len: 1643 microversion: 2.1 time: 0.172627 Oct 04 22:21:53.553833 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3068/6018] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:21:53 2022] GET /compute/v2.1/servers/ef43593b-be9b-4e5f-89c4-17a7e6030e29 => generated 1643 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:21:53.575178 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-fda6ae30-3fe7-41a3-ba36-ad594481b4eb tempest-TestSecurityGroupsBasicOps-1565614030 tempest-TestSecurityGroupsBasicOps-1565614030-project-admin] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:21:53.576005 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-fda6ae30-3fe7-41a3-ba36-ad594481b4eb tempest-TestSecurityGroupsBasicOps-1565614030 tempest-TestSecurityGroupsBasicOps-1565614030-project-admin] [instance: ef43593b-be9b-4e5f-89c4-17a7e6030e29] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:21:53.586273 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fda6ae30-3fe7-41a3-ba36-ad594481b4eb tempest-TestSecurityGroupsBasicOps-1565614030 tempest-TestSecurityGroupsBasicOps-1565614030-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:53.586822 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fda6ae30-3fe7-41a3-ba36-ad594481b4eb tempest-TestSecurityGroupsBasicOps-1565614030 tempest-TestSecurityGroupsBasicOps-1565614030-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:53.587268 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fda6ae30-3fe7-41a3-ba36-ad594481b4eb tempest-TestSecurityGroupsBasicOps-1565614030 tempest-TestSecurityGroupsBasicOps-1565614030-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:53.587992 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fda6ae30-3fe7-41a3-ba36-ad594481b4eb tempest-TestSecurityGroupsBasicOps-1565614030 tempest-TestSecurityGroupsBasicOps-1565614030-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:53.588452 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fda6ae30-3fe7-41a3-ba36-ad594481b4eb tempest-TestSecurityGroupsBasicOps-1565614030 tempest-TestSecurityGroupsBasicOps-1565614030-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:53.588885 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fda6ae30-3fe7-41a3-ba36-ad594481b4eb tempest-TestSecurityGroupsBasicOps-1565614030 tempest-TestSecurityGroupsBasicOps-1565614030-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:53.856371 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-fda6ae30-3fe7-41a3-ba36-ad594481b4eb tempest-TestSecurityGroupsBasicOps-1565614030 tempest-TestSecurityGroupsBasicOps-1565614030-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/ef43593b-be9b-4e5f-89c4-17a7e6030e29" status: 200 len: 1794 microversion: 2.1 time: 0.285029 Oct 04 22:21:53.857847 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3069/6019] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:21:53 2022] GET /compute/v2.1/servers/ef43593b-be9b-4e5f-89c4-17a7e6030e29 => generated 1794 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:21:53.863180 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-afec27e2-06da-4b8f-ba56-942fca568426 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:21:53.863805 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-afec27e2-06da-4b8f-ba56-942fca568426 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: cbfe78f0-109c-43f8-81d4-2faf07d9ca31] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:21:53.869870 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-afec27e2-06da-4b8f-ba56-942fca568426 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:53.870389 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-afec27e2-06da-4b8f-ba56-942fca568426 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:53.870846 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-afec27e2-06da-4b8f-ba56-942fca568426 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:53.871545 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-afec27e2-06da-4b8f-ba56-942fca568426 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:53.872010 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-afec27e2-06da-4b8f-ba56-942fca568426 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:53.872441 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-afec27e2-06da-4b8f-ba56-942fca568426 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:54.094493 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-afec27e2-06da-4b8f-ba56-942fca568426 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:21:54.103761 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-afec27e2-06da-4b8f-ba56-942fca568426 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/cbfe78f0-109c-43f8-81d4-2faf07d9ca31" status: 200 len: 1201 microversion: 2.1 time: 0.244554 Oct 04 22:21:54.104507 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3070/6020] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:21:53 2022] GET /compute/v2.1/servers/cbfe78f0-109c-43f8-81d4-2faf07d9ca31 => generated 1201 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:21:55.141887 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-0054661b-0d65-4237-9096-251f8a1cf859 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:21:55.142590 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-0054661b-0d65-4237-9096-251f8a1cf859 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: cbfe78f0-109c-43f8-81d4-2faf07d9ca31] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:21:55.150631 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0054661b-0d65-4237-9096-251f8a1cf859 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:55.151166 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0054661b-0d65-4237-9096-251f8a1cf859 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:55.151929 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0054661b-0d65-4237-9096-251f8a1cf859 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:55.152657 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0054661b-0d65-4237-9096-251f8a1cf859 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:55.153151 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0054661b-0d65-4237-9096-251f8a1cf859 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:55.153590 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0054661b-0d65-4237-9096-251f8a1cf859 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:55.402766 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-0054661b-0d65-4237-9096-251f8a1cf859 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:21:55.411726 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-0054661b-0d65-4237-9096-251f8a1cf859 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/cbfe78f0-109c-43f8-81d4-2faf07d9ca31" status: 200 len: 1201 microversion: 2.1 time: 0.287730 Oct 04 22:21:55.412791 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3071/6021] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:21:55 2022] GET /compute/v2.1/servers/cbfe78f0-109c-43f8-81d4-2faf07d9ca31 => generated 1201 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:21:56.262598 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-9883f77c-56b5-489a-82ef-28afb4b3a64d req-60eddf1f-d23a-4312-938f-e3746438b90c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef43593b-be9b-4e5f-89c4-17a7e6030e29", "tag": "d4ad42be-39ad-404b-9392-f2b7142e73bc"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:21:56.272530 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-9883f77c-56b5-489a-82ef-28afb4b3a64d req-60eddf1f-d23a-4312-938f-e3746438b90c service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:56.273267 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-9883f77c-56b5-489a-82ef-28afb4b3a64d req-60eddf1f-d23a-4312-938f-e3746438b90c service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:56.273863 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-9883f77c-56b5-489a-82ef-28afb4b3a64d req-60eddf1f-d23a-4312-938f-e3746438b90c service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:56.287484 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-9883f77c-56b5-489a-82ef-28afb4b3a64d req-60eddf1f-d23a-4312-938f-e3746438b90c service nova] Creating event network-changed:d4ad42be-39ad-404b-9392-f2b7142e73bc for instance ef43593b-be9b-4e5f-89c4-17a7e6030e29 on n-h1-860284-1 Oct 04 22:21:56.294513 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-9883f77c-56b5-489a-82ef-28afb4b3a64d req-60eddf1f-d23a-4312-938f-e3746438b90c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.209198 Oct 04 22:21:56.295685 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3072/6022] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:21:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:21:56.450447 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-b7d3448d-cc9a-4978-a3c4-6033a3f607cb tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:21:56.452167 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-b7d3448d-cc9a-4978-a3c4-6033a3f607cb tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: cbfe78f0-109c-43f8-81d4-2faf07d9ca31] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:21:56.468619 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b7d3448d-cc9a-4978-a3c4-6033a3f607cb tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:56.469132 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b7d3448d-cc9a-4978-a3c4-6033a3f607cb tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:56.469581 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b7d3448d-cc9a-4978-a3c4-6033a3f607cb tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:56.473191 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b7d3448d-cc9a-4978-a3c4-6033a3f607cb tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:56.473191 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b7d3448d-cc9a-4978-a3c4-6033a3f607cb tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:56.473191 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b7d3448d-cc9a-4978-a3c4-6033a3f607cb tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:56.895752 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-b7d3448d-cc9a-4978-a3c4-6033a3f607cb tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:21:56.914301 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-b7d3448d-cc9a-4978-a3c4-6033a3f607cb tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/cbfe78f0-109c-43f8-81d4-2faf07d9ca31" status: 200 len: 1201 microversion: 2.1 time: 0.481760 Oct 04 22:21:56.915304 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3073/6023] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:21:56 2022] GET /compute/v2.1/servers/cbfe78f0-109c-43f8-81d4-2faf07d9ca31 => generated 1201 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:21:57.939541 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-0e7e571e-108b-4860-bafb-2e2b2a712586 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:21:57.940316 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-0e7e571e-108b-4860-bafb-2e2b2a712586 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: cbfe78f0-109c-43f8-81d4-2faf07d9ca31] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:21:57.948360 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0e7e571e-108b-4860-bafb-2e2b2a712586 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:57.948857 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0e7e571e-108b-4860-bafb-2e2b2a712586 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:57.949304 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0e7e571e-108b-4860-bafb-2e2b2a712586 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:57.950013 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0e7e571e-108b-4860-bafb-2e2b2a712586 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:57.950529 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0e7e571e-108b-4860-bafb-2e2b2a712586 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:57.950968 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0e7e571e-108b-4860-bafb-2e2b2a712586 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:58.100231 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-0e7e571e-108b-4860-bafb-2e2b2a712586 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:21:58.108388 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-0e7e571e-108b-4860-bafb-2e2b2a712586 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/cbfe78f0-109c-43f8-81d4-2faf07d9ca31" status: 200 len: 1201 microversion: 2.1 time: 0.172802 Oct 04 22:21:58.109258 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3074/6024] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:21:57 2022] GET /compute/v2.1/servers/cbfe78f0-109c-43f8-81d4-2faf07d9ca31 => generated 1201 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:21:59.132601 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-bafe992d-4bb7-4aea-a4d0-454a3fa8e65b tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:21:59.133523 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-bafe992d-4bb7-4aea-a4d0-454a3fa8e65b tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: cbfe78f0-109c-43f8-81d4-2faf07d9ca31] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:21:59.141027 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bafe992d-4bb7-4aea-a4d0-454a3fa8e65b tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:59.141621 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bafe992d-4bb7-4aea-a4d0-454a3fa8e65b tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:59.142136 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bafe992d-4bb7-4aea-a4d0-454a3fa8e65b tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:59.142949 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bafe992d-4bb7-4aea-a4d0-454a3fa8e65b tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:59.143533 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bafe992d-4bb7-4aea-a4d0-454a3fa8e65b tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:59.144040 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bafe992d-4bb7-4aea-a4d0-454a3fa8e65b tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:59.281534 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-bafe992d-4bb7-4aea-a4d0-454a3fa8e65b tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:21:59.291570 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-bafe992d-4bb7-4aea-a4d0-454a3fa8e65b tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/cbfe78f0-109c-43f8-81d4-2faf07d9ca31" status: 200 len: 1201 microversion: 2.1 time: 0.162555 Oct 04 22:21:59.292175 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3075/6025] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:21:59 2022] GET /compute/v2.1/servers/cbfe78f0-109c-43f8-81d4-2faf07d9ca31 => generated 1201 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:22:00.316598 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-bdc8c69e-1972-4c0e-921b-5de828820c59 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:22:00.317412 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-bdc8c69e-1972-4c0e-921b-5de828820c59 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: cbfe78f0-109c-43f8-81d4-2faf07d9ca31] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:22:00.321199 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:22:00.325656 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bdc8c69e-1972-4c0e-921b-5de828820c59 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:22:00.326151 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bdc8c69e-1972-4c0e-921b-5de828820c59 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:22:00.326629 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bdc8c69e-1972-4c0e-921b-5de828820c59 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:22:00.327338 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bdc8c69e-1972-4c0e-921b-5de828820c59 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:22:00.327796 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bdc8c69e-1972-4c0e-921b-5de828820c59 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:22:00.328226 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bdc8c69e-1972-4c0e-921b-5de828820c59 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:22:00.466089 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-bdc8c69e-1972-4c0e-921b-5de828820c59 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:22:00.474086 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-bdc8c69e-1972-4c0e-921b-5de828820c59 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/cbfe78f0-109c-43f8-81d4-2faf07d9ca31" status: 200 len: 1201 microversion: 2.1 time: 0.162014 Oct 04 22:22:00.474905 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3076/6026] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:22:00 2022] GET /compute/v2.1/servers/cbfe78f0-109c-43f8-81d4-2faf07d9ca31 => generated 1201 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:22:01.500204 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-46c3393b-1380-443f-8c4b-d7d5fe9c0c2c tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:22:01.501077 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-46c3393b-1380-443f-8c4b-d7d5fe9c0c2c tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: cbfe78f0-109c-43f8-81d4-2faf07d9ca31] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:22:01.512065 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-46c3393b-1380-443f-8c4b-d7d5fe9c0c2c tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:22:01.512757 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-46c3393b-1380-443f-8c4b-d7d5fe9c0c2c tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:22:01.513364 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-46c3393b-1380-443f-8c4b-d7d5fe9c0c2c tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:22:01.514483 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-46c3393b-1380-443f-8c4b-d7d5fe9c0c2c tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:22:01.515137 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-46c3393b-1380-443f-8c4b-d7d5fe9c0c2c tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:22:01.515750 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-46c3393b-1380-443f-8c4b-d7d5fe9c0c2c tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:22:01.657866 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-46c3393b-1380-443f-8c4b-d7d5fe9c0c2c tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:22:01.671511 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-46c3393b-1380-443f-8c4b-d7d5fe9c0c2c tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/cbfe78f0-109c-43f8-81d4-2faf07d9ca31" status: 200 len: 1201 microversion: 2.1 time: 0.177523 Oct 04 22:22:01.672295 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3077/6027] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:22:01 2022] GET /compute/v2.1/servers/cbfe78f0-109c-43f8-81d4-2faf07d9ca31 => generated 1201 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:22:02.696013 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-1ce594a4-a899-49c0-9288-4237dfdba7e2 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:22:02.696668 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-1ce594a4-a899-49c0-9288-4237dfdba7e2 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: cbfe78f0-109c-43f8-81d4-2faf07d9ca31] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:22:02.704029 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1ce594a4-a899-49c0-9288-4237dfdba7e2 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:22:02.704536 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1ce594a4-a899-49c0-9288-4237dfdba7e2 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:22:02.704989 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1ce594a4-a899-49c0-9288-4237dfdba7e2 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:22:02.706250 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1ce594a4-a899-49c0-9288-4237dfdba7e2 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:22:02.707186 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1ce594a4-a899-49c0-9288-4237dfdba7e2 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:22:02.707634 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1ce594a4-a899-49c0-9288-4237dfdba7e2 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:22:02.847942 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-1ce594a4-a899-49c0-9288-4237dfdba7e2 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:22:02.856241 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-1ce594a4-a899-49c0-9288-4237dfdba7e2 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/cbfe78f0-109c-43f8-81d4-2faf07d9ca31" status: 200 len: 1201 microversion: 2.1 time: 0.164271 Oct 04 22:22:02.856832 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3078/6028] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:22:02 2022] GET /compute/v2.1/servers/cbfe78f0-109c-43f8-81d4-2faf07d9ca31 => generated 1201 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:22:03.881700 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-985dfe8a-0b93-464a-9ad7-283b1e389610 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:22:03.882353 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-985dfe8a-0b93-464a-9ad7-283b1e389610 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: cbfe78f0-109c-43f8-81d4-2faf07d9ca31] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:22:03.889577 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-985dfe8a-0b93-464a-9ad7-283b1e389610 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:22:03.890093 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-985dfe8a-0b93-464a-9ad7-283b1e389610 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:22:03.890823 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-985dfe8a-0b93-464a-9ad7-283b1e389610 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:22:03.891426 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-985dfe8a-0b93-464a-9ad7-283b1e389610 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:22:03.891922 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-985dfe8a-0b93-464a-9ad7-283b1e389610 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:22:03.892401 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-985dfe8a-0b93-464a-9ad7-283b1e389610 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:22:04.062323 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-985dfe8a-0b93-464a-9ad7-283b1e389610 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:22:04.078479 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-985dfe8a-0b93-464a-9ad7-283b1e389610 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/cbfe78f0-109c-43f8-81d4-2faf07d9ca31" status: 200 len: 1201 microversion: 2.1 time: 0.200819 Oct 04 22:22:04.079367 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3079/6029] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:22:03 2022] GET /compute/v2.1/servers/cbfe78f0-109c-43f8-81d4-2faf07d9ca31 => generated 1201 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:22:04.085753 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-30ae1a83-f9b7-44ce-ba19-6a1996dfa6a3 req-41e9d0ac-50cc-4087-83dc-1c2124149aa2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbfe78f0-109c-43f8-81d4-2faf07d9ca31", "name": "network-vif-plugged", "status": "completed", "tag": "942def51-4e4f-4372-a83b-267375942029"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:22:04.099191 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-30ae1a83-f9b7-44ce-ba19-6a1996dfa6a3 req-41e9d0ac-50cc-4087-83dc-1c2124149aa2 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:22:04.099682 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-30ae1a83-f9b7-44ce-ba19-6a1996dfa6a3 req-41e9d0ac-50cc-4087-83dc-1c2124149aa2 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:22:04.100126 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-30ae1a83-f9b7-44ce-ba19-6a1996dfa6a3 req-41e9d0ac-50cc-4087-83dc-1c2124149aa2 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:22:04.111356 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-30ae1a83-f9b7-44ce-ba19-6a1996dfa6a3 req-41e9d0ac-50cc-4087-83dc-1c2124149aa2 service nova] Creating event network-vif-plugged:942def51-4e4f-4372-a83b-267375942029 for instance cbfe78f0-109c-43f8-81d4-2faf07d9ca31 on n-h2-860284-1 Oct 04 22:22:04.117282 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-30ae1a83-f9b7-44ce-ba19-6a1996dfa6a3 req-41e9d0ac-50cc-4087-83dc-1c2124149aa2 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036556 Oct 04 22:22:04.117898 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3080/6030] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:22:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:22:05.103115 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-47eb6e49-71b5-4655-bfaf-b17b62cbb6d6 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:22:05.103948 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-47eb6e49-71b5-4655-bfaf-b17b62cbb6d6 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: cbfe78f0-109c-43f8-81d4-2faf07d9ca31] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:22:05.110350 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-47eb6e49-71b5-4655-bfaf-b17b62cbb6d6 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:22:05.110879 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-47eb6e49-71b5-4655-bfaf-b17b62cbb6d6 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:22:05.111323 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-47eb6e49-71b5-4655-bfaf-b17b62cbb6d6 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:22:05.112722 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-47eb6e49-71b5-4655-bfaf-b17b62cbb6d6 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:22:05.113196 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-47eb6e49-71b5-4655-bfaf-b17b62cbb6d6 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:22:05.114076 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-47eb6e49-71b5-4655-bfaf-b17b62cbb6d6 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:22:05.252602 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-47eb6e49-71b5-4655-bfaf-b17b62cbb6d6 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:22:05.261351 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-47eb6e49-71b5-4655-bfaf-b17b62cbb6d6 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/cbfe78f0-109c-43f8-81d4-2faf07d9ca31" status: 200 len: 1201 microversion: 2.1 time: 0.163201 Oct 04 22:22:05.262299 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3081/6031] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:22:05 2022] GET /compute/v2.1/servers/cbfe78f0-109c-43f8-81d4-2faf07d9ca31 => generated 1201 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:22:06.286109 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-3db01bc0-e45a-46e5-bda2-7ea197ba73b3 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:22:06.286824 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-3db01bc0-e45a-46e5-bda2-7ea197ba73b3 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: cbfe78f0-109c-43f8-81d4-2faf07d9ca31] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:22:06.293403 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3db01bc0-e45a-46e5-bda2-7ea197ba73b3 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:22:06.293905 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3db01bc0-e45a-46e5-bda2-7ea197ba73b3 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:22:06.294634 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3db01bc0-e45a-46e5-bda2-7ea197ba73b3 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:22:06.295366 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3db01bc0-e45a-46e5-bda2-7ea197ba73b3 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:22:06.296074 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3db01bc0-e45a-46e5-bda2-7ea197ba73b3 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:22:06.296513 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3db01bc0-e45a-46e5-bda2-7ea197ba73b3 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:22:06.302040 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=100 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:22:06.442829 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-3db01bc0-e45a-46e5-bda2-7ea197ba73b3 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:22:06.450944 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-3db01bc0-e45a-46e5-bda2-7ea197ba73b3 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/cbfe78f0-109c-43f8-81d4-2faf07d9ca31" status: 200 len: 1388 microversion: 2.1 time: 0.170181 Oct 04 22:22:06.451541 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3082/6032] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:22:06 2022] GET /compute/v2.1/servers/cbfe78f0-109c-43f8-81d4-2faf07d9ca31 => generated 1388 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:22:06.474549 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-49702e95-6b6a-4d75-a6f5-e14843b19361 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:22:06.475183 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-49702e95-6b6a-4d75-a6f5-e14843b19361 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: cbfe78f0-109c-43f8-81d4-2faf07d9ca31] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:22:06.481169 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-49702e95-6b6a-4d75-a6f5-e14843b19361 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:22:06.481664 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-49702e95-6b6a-4d75-a6f5-e14843b19361 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:22:06.482111 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-49702e95-6b6a-4d75-a6f5-e14843b19361 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:22:06.488729 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-49702e95-6b6a-4d75-a6f5-e14843b19361 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:22:06.489228 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-49702e95-6b6a-4d75-a6f5-e14843b19361 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:22:06.489680 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-49702e95-6b6a-4d75-a6f5-e14843b19361 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:22:06.633113 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-49702e95-6b6a-4d75-a6f5-e14843b19361 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:22:06.642711 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-49702e95-6b6a-4d75-a6f5-e14843b19361 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/cbfe78f0-109c-43f8-81d4-2faf07d9ca31" status: 200 len: 1388 microversion: 2.1 time: 0.173193 Oct 04 22:22:06.644208 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3083/6033] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:22:06 2022] GET /compute/v2.1/servers/cbfe78f0-109c-43f8-81d4-2faf07d9ca31 => generated 1388 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:22:06.667313 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-96e3ed35-339b-4e1a-85a7-a65be2279a3b tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:22:06.667969 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-96e3ed35-339b-4e1a-85a7-a65be2279a3b tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: cbfe78f0-109c-43f8-81d4-2faf07d9ca31] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:22:06.673986 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-96e3ed35-339b-4e1a-85a7-a65be2279a3b tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:22:06.675184 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-96e3ed35-339b-4e1a-85a7-a65be2279a3b tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:22:06.675657 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-96e3ed35-339b-4e1a-85a7-a65be2279a3b tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:22:06.676347 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-96e3ed35-339b-4e1a-85a7-a65be2279a3b tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:22:06.676869 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-96e3ed35-339b-4e1a-85a7-a65be2279a3b tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:22:06.677331 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-96e3ed35-339b-4e1a-85a7-a65be2279a3b tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:22:06.818982 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-96e3ed35-339b-4e1a-85a7-a65be2279a3b tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:22:06.832356 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-96e3ed35-339b-4e1a-85a7-a65be2279a3b tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/cbfe78f0-109c-43f8-81d4-2faf07d9ca31" status: 200 len: 1388 microversion: 2.1 time: 0.168859 Oct 04 22:22:06.833075 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3084/6034] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:22:06 2022] GET /compute/v2.1/servers/cbfe78f0-109c-43f8-81d4-2faf07d9ca31 => generated 1388 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:22:06.918506 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-beecc028-ad7c-44ce-b244-3b7cccab0ee5 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:22:06.919023 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-beecc028-ad7c-44ce-b244-3b7cccab0ee5 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: cbfe78f0-109c-43f8-81d4-2faf07d9ca31] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:22:06.925771 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-beecc028-ad7c-44ce-b244-3b7cccab0ee5 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:22:06.926265 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-beecc028-ad7c-44ce-b244-3b7cccab0ee5 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:22:06.926734 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-beecc028-ad7c-44ce-b244-3b7cccab0ee5 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:22:06.927442 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-beecc028-ad7c-44ce-b244-3b7cccab0ee5 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:22:06.927899 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-beecc028-ad7c-44ce-b244-3b7cccab0ee5 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:22:06.928331 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-beecc028-ad7c-44ce-b244-3b7cccab0ee5 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:22:06.954807 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-beecc028-ad7c-44ce-b244-3b7cccab0ee5 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: cbfe78f0-109c-43f8-81d4-2faf07d9ca31] Going to try to terminate instance {{(pid=134101) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 22:22:07.037983 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-beecc028-ad7c-44ce-b244-3b7cccab0ee5 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "DELETE /compute/v2.1/servers/cbfe78f0-109c-43f8-81d4-2faf07d9ca31" status: 204 len: 0 microversion: 2.1 time: 0.123101 Oct 04 22:22:07.039053 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3085/6035] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 22:22:06 2022] DELETE /compute/v2.1/servers/cbfe78f0-109c-43f8-81d4-2faf07d9ca31 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 22:22:07.047996 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-4008386c-4796-4cb8-a086-919ec40446e4 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:22:07.048805 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-4008386c-4796-4cb8-a086-919ec40446e4 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: cbfe78f0-109c-43f8-81d4-2faf07d9ca31] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:22:07.055334 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4008386c-4796-4cb8-a086-919ec40446e4 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:22:07.055819 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4008386c-4796-4cb8-a086-919ec40446e4 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:22:07.056260 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4008386c-4796-4cb8-a086-919ec40446e4 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:22:07.056958 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4008386c-4796-4cb8-a086-919ec40446e4 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:22:07.057413 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4008386c-4796-4cb8-a086-919ec40446e4 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:22:07.057839 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4008386c-4796-4cb8-a086-919ec40446e4 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:22:07.207030 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-4008386c-4796-4cb8-a086-919ec40446e4 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:22:07.215361 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-4008386c-4796-4cb8-a086-919ec40446e4 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/cbfe78f0-109c-43f8-81d4-2faf07d9ca31" status: 200 len: 1394 microversion: 2.1 time: 0.171621 Oct 04 22:22:07.216050 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3086/6036] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:22:07 2022] GET /compute/v2.1/servers/cbfe78f0-109c-43f8-81d4-2faf07d9ca31 => generated 1394 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:22:08.239595 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-134ed4e3-1845-4699-be6f-364c5a7a1280 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:22:08.240289 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-134ed4e3-1845-4699-be6f-364c5a7a1280 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: cbfe78f0-109c-43f8-81d4-2faf07d9ca31] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:22:08.247619 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-134ed4e3-1845-4699-be6f-364c5a7a1280 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:22:08.248152 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-134ed4e3-1845-4699-be6f-364c5a7a1280 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:22:08.248620 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-134ed4e3-1845-4699-be6f-364c5a7a1280 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:22:08.249365 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-134ed4e3-1845-4699-be6f-364c5a7a1280 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:22:08.249883 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-134ed4e3-1845-4699-be6f-364c5a7a1280 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:22:08.250324 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-134ed4e3-1845-4699-be6f-364c5a7a1280 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:22:08.386201 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-134ed4e3-1845-4699-be6f-364c5a7a1280 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:22:08.396872 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-134ed4e3-1845-4699-be6f-364c5a7a1280 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/cbfe78f0-109c-43f8-81d4-2faf07d9ca31" status: 200 len: 1394 microversion: 2.1 time: 0.162065 Oct 04 22:22:08.397668 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3087/6037] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:22:08 2022] GET /compute/v2.1/servers/cbfe78f0-109c-43f8-81d4-2faf07d9ca31 => generated 1394 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:22:09.421554 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-03dc59c9-2811-4fa0-9b09-569b44c6e22e req-868bd8dc-c1bd-4e40-9345-3d494f2afe20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbfe78f0-109c-43f8-81d4-2faf07d9ca31", "name": "network-vif-deleted", "tag": "942def51-4e4f-4372-a83b-267375942029"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:22:09.438261 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-03dc59c9-2811-4fa0-9b09-569b44c6e22e req-868bd8dc-c1bd-4e40-9345-3d494f2afe20 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:22:09.439027 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-03dc59c9-2811-4fa0-9b09-569b44c6e22e req-868bd8dc-c1bd-4e40-9345-3d494f2afe20 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:22:09.439657 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-03dc59c9-2811-4fa0-9b09-569b44c6e22e req-868bd8dc-c1bd-4e40-9345-3d494f2afe20 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:22:09.457502 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-03dc59c9-2811-4fa0-9b09-569b44c6e22e req-868bd8dc-c1bd-4e40-9345-3d494f2afe20 service nova] Creating event network-vif-deleted:942def51-4e4f-4372-a83b-267375942029 for instance cbfe78f0-109c-43f8-81d4-2faf07d9ca31 on n-h2-860284-1 Oct 04 22:22:09.463204 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-03dc59c9-2811-4fa0-9b09-569b44c6e22e req-868bd8dc-c1bd-4e40-9345-3d494f2afe20 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045948 Oct 04 22:22:09.464210 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3088/6038] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:22:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:22:09.470748 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-ea6ca4a5-191b-49bd-87c8-174f4b00d5db tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:22:09.472421 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-ea6ca4a5-191b-49bd-87c8-174f4b00d5db tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: cbfe78f0-109c-43f8-81d4-2faf07d9ca31] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:22:09.479080 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ea6ca4a5-191b-49bd-87c8-174f4b00d5db tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:22:09.479580 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ea6ca4a5-191b-49bd-87c8-174f4b00d5db tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:22:09.480041 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ea6ca4a5-191b-49bd-87c8-174f4b00d5db tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:22:09.480749 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ea6ca4a5-191b-49bd-87c8-174f4b00d5db tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:22:09.481498 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ea6ca4a5-191b-49bd-87c8-174f4b00d5db tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:22:09.482902 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ea6ca4a5-191b-49bd-87c8-174f4b00d5db tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:22:09.595314 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-ea6ca4a5-191b-49bd-87c8-174f4b00d5db tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:22:09.604166 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-ea6ca4a5-191b-49bd-87c8-174f4b00d5db tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/cbfe78f0-109c-43f8-81d4-2faf07d9ca31" status: 200 len: 1186 microversion: 2.1 time: 0.138480 Oct 04 22:22:09.604759 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3089/6039] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:22:09 2022] GET /compute/v2.1/servers/cbfe78f0-109c-43f8-81d4-2faf07d9ca31 => generated 1186 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:22:10.629412 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-630820b5-c1f7-4165-8eef-c950b505217f tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:22:10.630185 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-630820b5-c1f7-4165-8eef-c950b505217f tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: cbfe78f0-109c-43f8-81d4-2faf07d9ca31] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:22:10.637588 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-630820b5-c1f7-4165-8eef-c950b505217f tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:22:10.638072 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-630820b5-c1f7-4165-8eef-c950b505217f tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:22:10.638729 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-630820b5-c1f7-4165-8eef-c950b505217f tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:22:10.639450 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-630820b5-c1f7-4165-8eef-c950b505217f tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:22:10.640045 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-630820b5-c1f7-4165-8eef-c950b505217f tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:22:10.640493 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-630820b5-c1f7-4165-8eef-c950b505217f tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:22:10.711552 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-630820b5-c1f7-4165-8eef-c950b505217f tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:22:10.720503 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-630820b5-c1f7-4165-8eef-c950b505217f tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/cbfe78f0-109c-43f8-81d4-2faf07d9ca31" status: 200 len: 1186 microversion: 2.1 time: 0.095386 Oct 04 22:22:10.727372 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3090/6040] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:22:10 2022] GET /compute/v2.1/servers/cbfe78f0-109c-43f8-81d4-2faf07d9ca31 => generated 1186 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:22:11.744229 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-4e0eae3e-9f78-48cd-832e-8b7352fe2208 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:22:11.744823 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-4e0eae3e-9f78-48cd-832e-8b7352fe2208 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: cbfe78f0-109c-43f8-81d4-2faf07d9ca31] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:22:11.751751 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4e0eae3e-9f78-48cd-832e-8b7352fe2208 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:22:11.752248 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4e0eae3e-9f78-48cd-832e-8b7352fe2208 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:22:11.752692 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4e0eae3e-9f78-48cd-832e-8b7352fe2208 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:22:11.753400 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4e0eae3e-9f78-48cd-832e-8b7352fe2208 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:22:11.753867 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4e0eae3e-9f78-48cd-832e-8b7352fe2208 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:22:11.754301 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4e0eae3e-9f78-48cd-832e-8b7352fe2208 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:22:11.818449 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-4e0eae3e-9f78-48cd-832e-8b7352fe2208 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:22:11.826640 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-4e0eae3e-9f78-48cd-832e-8b7352fe2208 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/cbfe78f0-109c-43f8-81d4-2faf07d9ca31" status: 200 len: 1186 microversion: 2.1 time: 0.086398 Oct 04 22:22:11.827251 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3091/6041] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:22:11 2022] GET /compute/v2.1/servers/cbfe78f0-109c-43f8-81d4-2faf07d9ca31 => generated 1186 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:22:12.853998 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e996f153-d03a-4ac4-95f8-49bc84ee843f tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:22:12.854787 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-e996f153-d03a-4ac4-95f8-49bc84ee843f tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: cbfe78f0-109c-43f8-81d4-2faf07d9ca31] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:22:12.862758 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e996f153-d03a-4ac4-95f8-49bc84ee843f tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:22:12.863261 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e996f153-d03a-4ac4-95f8-49bc84ee843f tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:22:12.863707 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e996f153-d03a-4ac4-95f8-49bc84ee843f tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:22:12.864432 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e996f153-d03a-4ac4-95f8-49bc84ee843f tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:22:12.864886 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e996f153-d03a-4ac4-95f8-49bc84ee843f tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:22:12.865500 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e996f153-d03a-4ac4-95f8-49bc84ee843f tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:22:12.942004 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-e996f153-d03a-4ac4-95f8-49bc84ee843f tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:22:12.950358 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-e996f153-d03a-4ac4-95f8-49bc84ee843f tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/cbfe78f0-109c-43f8-81d4-2faf07d9ca31" status: 200 len: 1186 microversion: 2.1 time: 0.103369 Oct 04 22:22:12.950959 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3092/6042] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:22:12 2022] GET /compute/v2.1/servers/cbfe78f0-109c-43f8-81d4-2faf07d9ca31 => generated 1186 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:22:13.974205 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-f8721768-aef0-4c8d-86a8-9e43ac824862 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:22:13.974907 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-f8721768-aef0-4c8d-86a8-9e43ac824862 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: cbfe78f0-109c-43f8-81d4-2faf07d9ca31] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:22:13.981952 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f8721768-aef0-4c8d-86a8-9e43ac824862 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:22:13.982586 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f8721768-aef0-4c8d-86a8-9e43ac824862 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:22:13.983130 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f8721768-aef0-4c8d-86a8-9e43ac824862 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:22:13.983963 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f8721768-aef0-4c8d-86a8-9e43ac824862 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:22:13.984315 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f8721768-aef0-4c8d-86a8-9e43ac824862 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:22:13.984748 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f8721768-aef0-4c8d-86a8-9e43ac824862 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:22:14.020076 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f8721768-aef0-4c8d-86a8-9e43ac824862 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:22:14.020637 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f8721768-aef0-4c8d-86a8-9e43ac824862 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:22:14.021088 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f8721768-aef0-4c8d-86a8-9e43ac824862 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:22:14.021546 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.objects.instance [None req-f8721768-aef0-4c8d-86a8-9e43ac824862 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lazy-loading 'fault' on Instance uuid cbfe78f0-109c-43f8-81d4-2faf07d9ca31 {{(pid=134101) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 22:22:14.063979 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-f8721768-aef0-4c8d-86a8-9e43ac824862 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:22:14.072542 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-f8721768-aef0-4c8d-86a8-9e43ac824862 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/cbfe78f0-109c-43f8-81d4-2faf07d9ca31" status: 200 len: 1191 microversion: 2.1 time: 0.103092 Oct 04 22:22:14.073162 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3093/6043] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:22:13 2022] GET /compute/v2.1/servers/cbfe78f0-109c-43f8-81d4-2faf07d9ca31 => generated 1191 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:22:15.097381 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-821517cb-221b-40ed-bacb-2a36e3eec456 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:22:15.098156 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-821517cb-221b-40ed-bacb-2a36e3eec456 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: cbfe78f0-109c-43f8-81d4-2faf07d9ca31] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:22:15.104995 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-821517cb-221b-40ed-bacb-2a36e3eec456 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:22:15.105485 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-821517cb-221b-40ed-bacb-2a36e3eec456 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:22:15.105937 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-821517cb-221b-40ed-bacb-2a36e3eec456 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:22:15.106741 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-821517cb-221b-40ed-bacb-2a36e3eec456 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:22:15.107209 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-821517cb-221b-40ed-bacb-2a36e3eec456 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:22:15.107646 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-821517cb-221b-40ed-bacb-2a36e3eec456 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:22:15.122454 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-821517cb-221b-40ed-bacb-2a36e3eec456 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] HTTP exception thrown: Instance cbfe78f0-109c-43f8-81d4-2faf07d9ca31 could not be found. Oct 04 22:22:15.124140 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-821517cb-221b-40ed-bacb-2a36e3eec456 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Request method failure captured: Oct 04 22:22:15.124140 n-d-860284-1 devstack@n-api.service[134101]: request: GET /compute/v2.1/servers/cbfe78f0-109c-43f8-81d4-2faf07d9ca31 HTTP/1.1 Oct 04 22:22:15.124140 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 22:22:15.124140 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 22:22:15.124140 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 22:22:15.124140 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 22:22:15.124140 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 22:22:15.124140 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 22:22:15.124140 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 22:22:15.124140 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 22:22:15.124140 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPLFSMo9Eg9y9Lu454XN1MXkt5BE7HeG-NZdibz9nP5ZbzTcA5eo2fVm4gnqUdOUNPfyWilTQor2E780fAI_U9XTD5akzJ8-jVP8Fthos4syj8Pc9nJeMuZjrdlu2EkiFF5ef-9mxCQWUxHOpcRBLI1i5aPH69baR_Z4N2zYKYuhPE2w Oct 04 22:22:15.124140 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 22:22:15.124140 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 22:22:15.124140 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 22:22:15.124140 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 22:22:15.124140 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 22:22:15.124140 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 22:22:15.124140 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: 5c98a72bacce47c3947f9b0f0b4e85b6 Oct 04 22:22:15.124140 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-TestVolumeBootPattern-1701442207 Oct 04 22:22:15.124140 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 22:22:15.124140 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 22:22:15.124140 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5c98a72bacce47c3947f9b0f0b4e85b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_5c98a72bacce47c3947f9b0f0b4e85b6", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5c98a72bacce47c3947f9b0f0b4e85b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/5c98a72bacce47c3947f9b0f0b4e85b6"}]}] Oct 04 22:22:15.124140 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-TestVolumeBootPattern-1701442207 Oct 04 22:22:15.124140 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: 5c98a72bacce47c3947f9b0f0b4e85b6 Oct 04 22:22:15.124140 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-TestVolumeBootPattern-1701442207 Oct 04 22:22:15.124140 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-TestVolumeBootPattern-1701442207-project Oct 04 22:22:15.124140 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 22:22:15.124140 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 22:22:15.124140 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 99acad09db70445b93ae1d64a1b49ca3 Oct 04 22:22:15.124140 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-TestVolumeBootPattern-1701442207-project Oct 04 22:22:15.124140 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 22:22:15.124140 n-d-860284-1 devstack@n-api.service[134101]: exception: Instance cbfe78f0-109c-43f8-81d4-2faf07d9ca31 could not be found. Oct 04 22:22:15.124140 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': 'cbfe78f0-109c-43f8-81d4-2faf07d9ca31'} Oct 04 22:22:15.124140 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:22:15.124140 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:22:15.124140 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:22:15.124140 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:22:15.124140 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:22:15.124140 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:22:15.124140 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:22:15.124140 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:22:15.124140 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:22:15.124140 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:22:15.124140 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cbfe78f0-109c-43f8-81d4-2faf07d9ca31 could not be found. Oct 04 22:22:15.124140 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:22:15.124140 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:22:15.124140 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:22:15.124140 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:22:15.124140 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:22:15.124140 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:22:15.124140 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:22:15.124140 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:22:15.124140 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:22:15.124140 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:22:15.124140 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:22:15.124140 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:22:15.124140 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:22:15.124140 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:22:15.124140 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:22:15.124140 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:22:15.124140 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cbfe78f0-109c-43f8-81d4-2faf07d9ca31 could not be found. Oct 04 22:22:15.124140 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:22:15.124140 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:22:15.124140 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:22:15.128255 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:22:15.128255 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:22:15.128255 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:22:15.128255 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:22:15.128255 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:22:15.128255 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cbfe78f0-109c-43f8-81d4-2faf07d9ca31 could not be found. Oct 04 22:22:15.128255 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:22:15.128255 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-821517cb-221b-40ed-bacb-2a36e3eec456 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Returning 404 to user: Instance cbfe78f0-109c-43f8-81d4-2faf07d9ca31 could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:22:15.128255 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-821517cb-221b-40ed-bacb-2a36e3eec456 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/cbfe78f0-109c-43f8-81d4-2faf07d9ca31" status: 404 len: 111 microversion: 2.1 time: 0.032872 Oct 04 22:22:15.128255 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3094/6044] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:22:15 2022] GET /compute/v2.1/servers/cbfe78f0-109c-43f8-81d4-2faf07d9ca31 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 22:22:16.867731 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-30ac867f-92c3-47b8-9410-5704a04f8bff tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:22:16.870630 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-30ac867f-92c3-47b8-9410-5704a04f8bff tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] [instance: 17fb2ff0-7ff4-4acf-a984-ef23ba8ec3dc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:22:16.884117 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-30ac867f-92c3-47b8-9410-5704a04f8bff tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:22:16.885203 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-30ac867f-92c3-47b8-9410-5704a04f8bff tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:22:16.885875 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-30ac867f-92c3-47b8-9410-5704a04f8bff tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:22:16.886880 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-30ac867f-92c3-47b8-9410-5704a04f8bff tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:22:16.887554 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-30ac867f-92c3-47b8-9410-5704a04f8bff tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:22:16.888190 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-30ac867f-92c3-47b8-9410-5704a04f8bff tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:22:16.979801 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-30ac867f-92c3-47b8-9410-5704a04f8bff tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] 10.222.0.43 "POST /compute/v2.1/servers/17fb2ff0-7ff4-4acf-a984-ef23ba8ec3dc/action" status: 200 len: 32596 microversion: 2.1 time: 0.115151 Oct 04 22:22:16.981299 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3095/6045] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 22:22:16 2022] POST /compute/v2.1/servers/17fb2ff0-7ff4-4acf-a984-ef23ba8ec3dc/action => generated 32596 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 22:22:18.197407 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-553c45ff-7eae-490d-9b35-da85930a56e8 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:22:18.198024 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-553c45ff-7eae-490d-9b35-da85930a56e8 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] [instance: 17fb2ff0-7ff4-4acf-a984-ef23ba8ec3dc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:22:18.214802 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-553c45ff-7eae-490d-9b35-da85930a56e8 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:22:18.215303 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-553c45ff-7eae-490d-9b35-da85930a56e8 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:22:18.215747 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-553c45ff-7eae-490d-9b35-da85930a56e8 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:22:18.216649 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-553c45ff-7eae-490d-9b35-da85930a56e8 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:22:18.217275 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-553c45ff-7eae-490d-9b35-da85930a56e8 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:22:18.217926 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-553c45ff-7eae-490d-9b35-da85930a56e8 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:22:18.251036 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-553c45ff-7eae-490d-9b35-da85930a56e8 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] [instance: 17fb2ff0-7ff4-4acf-a984-ef23ba8ec3dc] Going to try to terminate instance {{(pid=134101) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 22:22:18.312324 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:22:18.350326 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-553c45ff-7eae-490d-9b35-da85930a56e8 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] 10.222.0.43 "DELETE /compute/v2.1/servers/17fb2ff0-7ff4-4acf-a984-ef23ba8ec3dc" status: 204 len: 0 microversion: 2.1 time: 0.156701 Oct 04 22:22:18.354185 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3096/6046] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 22:22:18 2022] DELETE /compute/v2.1/servers/17fb2ff0-7ff4-4acf-a984-ef23ba8ec3dc => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 22:22:18.358681 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-ca01857d-f8c3-497b-a8a3-282f9708ef61 req-ad9af845-2221-4130-b2d7-1df58b237759 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17fb2ff0-7ff4-4acf-a984-ef23ba8ec3dc", "tag": "2a05598a-68c7-4079-85a9-3466be4f8f63"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:22:18.371458 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-ca01857d-f8c3-497b-a8a3-282f9708ef61 req-ad9af845-2221-4130-b2d7-1df58b237759 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:22:18.372059 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-ca01857d-f8c3-497b-a8a3-282f9708ef61 req-ad9af845-2221-4130-b2d7-1df58b237759 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:22:18.372574 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-ca01857d-f8c3-497b-a8a3-282f9708ef61 req-ad9af845-2221-4130-b2d7-1df58b237759 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:22:18.387515 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-ca01857d-f8c3-497b-a8a3-282f9708ef61 req-ad9af845-2221-4130-b2d7-1df58b237759 service nova] Creating event network-changed:2a05598a-68c7-4079-85a9-3466be4f8f63 for instance 17fb2ff0-7ff4-4acf-a984-ef23ba8ec3dc on n-h1-860284-1 Oct 04 22:22:18.393665 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-ca01857d-f8c3-497b-a8a3-282f9708ef61 req-ad9af845-2221-4130-b2d7-1df58b237759 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040177 Oct 04 22:22:18.394617 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3097/6047] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:22:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:22:18.403534 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-b2953355-2205-4407-a511-d231a780b63c tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:22:18.404217 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-b2953355-2205-4407-a511-d231a780b63c tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: cbfe78f0-109c-43f8-81d4-2faf07d9ca31] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:22:18.413181 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b2953355-2205-4407-a511-d231a780b63c tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:22:18.413713 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b2953355-2205-4407-a511-d231a780b63c tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:22:18.414234 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b2953355-2205-4407-a511-d231a780b63c tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:22:18.415258 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b2953355-2205-4407-a511-d231a780b63c tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:22:18.415802 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b2953355-2205-4407-a511-d231a780b63c tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:22:18.416306 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b2953355-2205-4407-a511-d231a780b63c tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:22:18.436558 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-b2953355-2205-4407-a511-d231a780b63c tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] HTTP exception thrown: Instance cbfe78f0-109c-43f8-81d4-2faf07d9ca31 could not be found. Oct 04 22:22:18.438698 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-b2953355-2205-4407-a511-d231a780b63c tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Request method failure captured: Oct 04 22:22:18.438698 n-d-860284-1 devstack@n-api.service[134101]: request: DELETE /compute/v2.1/servers/cbfe78f0-109c-43f8-81d4-2faf07d9ca31 HTTP/1.1 Oct 04 22:22:18.438698 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 22:22:18.438698 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 22:22:18.438698 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 22:22:18.438698 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 22:22:18.438698 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 22:22:18.438698 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 22:22:18.438698 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 22:22:18.438698 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 22:22:18.438698 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPLFSMo9Eg9y9Lu454XN1MXkt5BE7HeG-NZdibz9nP5ZbzTcA5eo2fVm4gnqUdOUNPfyWilTQor2E780fAI_U9XTD5akzJ8-jVP8Fthos4syj8Pc9nJeMuZjrdlu2EkiFF5ef-9mxCQWUxHOpcRBLI1i5aPH69baR_Z4N2zYKYuhPE2w Oct 04 22:22:18.438698 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 22:22:18.438698 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 22:22:18.438698 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 22:22:18.438698 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 22:22:18.438698 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 22:22:18.438698 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 22:22:18.438698 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: 5c98a72bacce47c3947f9b0f0b4e85b6 Oct 04 22:22:18.438698 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-TestVolumeBootPattern-1701442207 Oct 04 22:22:18.438698 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 22:22:18.438698 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 22:22:18.438698 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5c98a72bacce47c3947f9b0f0b4e85b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_5c98a72bacce47c3947f9b0f0b4e85b6", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5c98a72bacce47c3947f9b0f0b4e85b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/5c98a72bacce47c3947f9b0f0b4e85b6"}]}] Oct 04 22:22:18.438698 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-TestVolumeBootPattern-1701442207 Oct 04 22:22:18.438698 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: 5c98a72bacce47c3947f9b0f0b4e85b6 Oct 04 22:22:18.438698 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-TestVolumeBootPattern-1701442207 Oct 04 22:22:18.438698 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-TestVolumeBootPattern-1701442207-project Oct 04 22:22:18.438698 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 22:22:18.438698 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 22:22:18.438698 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 99acad09db70445b93ae1d64a1b49ca3 Oct 04 22:22:18.438698 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-TestVolumeBootPattern-1701442207-project Oct 04 22:22:18.438698 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 22:22:18.438698 n-d-860284-1 devstack@n-api.service[134101]: exception: Instance cbfe78f0-109c-43f8-81d4-2faf07d9ca31 could not be found. Oct 04 22:22:18.438698 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': 'cbfe78f0-109c-43f8-81d4-2faf07d9ca31'} Oct 04 22:22:18.438698 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:22:18.438698 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:22:18.438698 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:22:18.438698 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:22:18.438698 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:22:18.438698 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:22:18.438698 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:22:18.438698 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:22:18.438698 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:22:18.438698 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:22:18.438698 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cbfe78f0-109c-43f8-81d4-2faf07d9ca31 could not be found. Oct 04 22:22:18.438698 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:22:18.438698 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:22:18.438698 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:22:18.438698 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:22:18.438698 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:22:18.438698 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:22:18.438698 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:22:18.438698 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:22:18.438698 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:22:18.438698 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:22:18.438698 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 22:22:18.438698 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 22:22:18.438698 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 22:22:18.438698 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 22:22:18.438698 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:22:18.438698 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:22:18.438698 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:22:18.438698 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:22:18.443283 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cbfe78f0-109c-43f8-81d4-2faf07d9ca31 could not be found. Oct 04 22:22:18.443283 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:22:18.443283 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:22:18.443283 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:22:18.443283 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:22:18.443283 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:22:18.443283 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:22:18.443283 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:22:18.443283 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:22:18.443283 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cbfe78f0-109c-43f8-81d4-2faf07d9ca31 could not be found. Oct 04 22:22:18.443283 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:22:18.443283 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-b2953355-2205-4407-a511-d231a780b63c tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Returning 404 to user: Instance cbfe78f0-109c-43f8-81d4-2faf07d9ca31 could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:22:18.443283 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-b2953355-2205-4407-a511-d231a780b63c tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "DELETE /compute/v2.1/servers/cbfe78f0-109c-43f8-81d4-2faf07d9ca31" status: 404 len: 111 microversion: 2.1 time: 0.041317 Oct 04 22:22:18.443283 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3098/6048] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 22:22:18 2022] DELETE /compute/v2.1/servers/cbfe78f0-109c-43f8-81d4-2faf07d9ca31 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:22:18.448183 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-9671f385-8aca-409d-aaae-5abbea0633a9 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:22:18.448987 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-9671f385-8aca-409d-aaae-5abbea0633a9 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] [instance: 17fb2ff0-7ff4-4acf-a984-ef23ba8ec3dc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:22:18.459067 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9671f385-8aca-409d-aaae-5abbea0633a9 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:22:18.459822 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9671f385-8aca-409d-aaae-5abbea0633a9 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:22:18.460434 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9671f385-8aca-409d-aaae-5abbea0633a9 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:22:18.461522 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9671f385-8aca-409d-aaae-5abbea0633a9 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:22:18.462137 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9671f385-8aca-409d-aaae-5abbea0633a9 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:22:18.462749 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9671f385-8aca-409d-aaae-5abbea0633a9 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:22:18.655305 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-9671f385-8aca-409d-aaae-5abbea0633a9 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ac78e2767c49168f0464acea155be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286d184163154f2e846d521d368e3ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:22:18.664872 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-9671f385-8aca-409d-aaae-5abbea0633a9 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] 10.222.0.43 "GET /compute/v2.1/servers/17fb2ff0-7ff4-4acf-a984-ef23ba8ec3dc" status: 200 len: 1670 microversion: 2.1 time: 0.222400 Oct 04 22:22:18.678907 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3099/6049] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:22:18 2022] GET /compute/v2.1/servers/17fb2ff0-7ff4-4acf-a984-ef23ba8ec3dc => generated 1670 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:22:18.687081 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-d00d4831-9c32-473e-b195-06ead22702af tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:22:18.687714 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-d00d4831-9c32-473e-b195-06ead22702af tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: cbfe78f0-109c-43f8-81d4-2faf07d9ca31] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:22:18.696417 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d00d4831-9c32-473e-b195-06ead22702af tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:22:18.696927 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d00d4831-9c32-473e-b195-06ead22702af tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:22:18.697374 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d00d4831-9c32-473e-b195-06ead22702af tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:22:18.698102 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d00d4831-9c32-473e-b195-06ead22702af tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:22:18.698600 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d00d4831-9c32-473e-b195-06ead22702af tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:22:18.699222 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d00d4831-9c32-473e-b195-06ead22702af tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:22:18.718724 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-d00d4831-9c32-473e-b195-06ead22702af tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] HTTP exception thrown: Instance cbfe78f0-109c-43f8-81d4-2faf07d9ca31 could not be found. Oct 04 22:22:18.721800 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-d00d4831-9c32-473e-b195-06ead22702af tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Request method failure captured: Oct 04 22:22:18.721800 n-d-860284-1 devstack@n-api.service[134101]: request: GET /compute/v2.1/servers/cbfe78f0-109c-43f8-81d4-2faf07d9ca31 HTTP/1.1 Oct 04 22:22:18.721800 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 22:22:18.721800 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 22:22:18.721800 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 22:22:18.721800 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 22:22:18.721800 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 22:22:18.721800 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 22:22:18.721800 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 22:22:18.721800 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 22:22:18.721800 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPLFSMo9Eg9y9Lu454XN1MXkt5BE7HeG-NZdibz9nP5ZbzTcA5eo2fVm4gnqUdOUNPfyWilTQor2E780fAI_U9XTD5akzJ8-jVP8Fthos4syj8Pc9nJeMuZjrdlu2EkiFF5ef-9mxCQWUxHOpcRBLI1i5aPH69baR_Z4N2zYKYuhPE2w Oct 04 22:22:18.721800 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 22:22:18.721800 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 22:22:18.721800 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 22:22:18.721800 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 22:22:18.721800 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 22:22:18.721800 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 22:22:18.721800 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: 5c98a72bacce47c3947f9b0f0b4e85b6 Oct 04 22:22:18.721800 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-TestVolumeBootPattern-1701442207 Oct 04 22:22:18.721800 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 22:22:18.721800 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 22:22:18.721800 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5c98a72bacce47c3947f9b0f0b4e85b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_5c98a72bacce47c3947f9b0f0b4e85b6", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5c98a72bacce47c3947f9b0f0b4e85b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/5c98a72bacce47c3947f9b0f0b4e85b6"}]}] Oct 04 22:22:18.721800 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-TestVolumeBootPattern-1701442207 Oct 04 22:22:18.721800 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: 5c98a72bacce47c3947f9b0f0b4e85b6 Oct 04 22:22:18.721800 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-TestVolumeBootPattern-1701442207 Oct 04 22:22:18.721800 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-TestVolumeBootPattern-1701442207-project Oct 04 22:22:18.721800 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 22:22:18.721800 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 22:22:18.721800 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 99acad09db70445b93ae1d64a1b49ca3 Oct 04 22:22:18.721800 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-TestVolumeBootPattern-1701442207-project Oct 04 22:22:18.721800 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 22:22:18.721800 n-d-860284-1 devstack@n-api.service[134101]: exception: Instance cbfe78f0-109c-43f8-81d4-2faf07d9ca31 could not be found. Oct 04 22:22:18.721800 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': 'cbfe78f0-109c-43f8-81d4-2faf07d9ca31'} Oct 04 22:22:18.721800 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:22:18.721800 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:22:18.721800 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:22:18.721800 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:22:18.721800 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:22:18.721800 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:22:18.721800 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:22:18.721800 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:22:18.721800 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:22:18.721800 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:22:18.721800 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cbfe78f0-109c-43f8-81d4-2faf07d9ca31 could not be found. Oct 04 22:22:18.721800 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:22:18.721800 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:22:18.721800 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:22:18.721800 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:22:18.721800 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:22:18.721800 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:22:18.721800 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:22:18.721800 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:22:18.721800 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:22:18.721800 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:22:18.721800 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:22:18.721800 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:22:18.721800 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:22:18.721800 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:22:18.721800 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:22:18.721800 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:22:18.721800 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cbfe78f0-109c-43f8-81d4-2faf07d9ca31 could not be found. Oct 04 22:22:18.721800 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:22:18.721800 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:22:18.721800 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:22:18.725398 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:22:18.725398 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:22:18.725398 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:22:18.725398 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:22:18.725398 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:22:18.725398 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cbfe78f0-109c-43f8-81d4-2faf07d9ca31 could not be found. Oct 04 22:22:18.725398 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:22:18.725398 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-d00d4831-9c32-473e-b195-06ead22702af tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Returning 404 to user: Instance cbfe78f0-109c-43f8-81d4-2faf07d9ca31 could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:22:18.725398 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-d00d4831-9c32-473e-b195-06ead22702af tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/cbfe78f0-109c-43f8-81d4-2faf07d9ca31" status: 404 len: 111 microversion: 2.1 time: 0.043285 Oct 04 22:22:18.725398 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3100/6050] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:22:18 2022] GET /compute/v2.1/servers/cbfe78f0-109c-43f8-81d4-2faf07d9ca31 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:22:19.691110 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-c7ddad5b-7b3e-40be-8306-93d52b29f7a6 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:22:19.691818 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-c7ddad5b-7b3e-40be-8306-93d52b29f7a6 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] [instance: 17fb2ff0-7ff4-4acf-a984-ef23ba8ec3dc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:22:19.708444 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c7ddad5b-7b3e-40be-8306-93d52b29f7a6 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:22:19.711351 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c7ddad5b-7b3e-40be-8306-93d52b29f7a6 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:22:19.712122 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c7ddad5b-7b3e-40be-8306-93d52b29f7a6 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:22:19.734220 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c7ddad5b-7b3e-40be-8306-93d52b29f7a6 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:22:19.738905 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c7ddad5b-7b3e-40be-8306-93d52b29f7a6 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:22:19.740896 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c7ddad5b-7b3e-40be-8306-93d52b29f7a6 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:22:20.006691 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-c7ddad5b-7b3e-40be-8306-93d52b29f7a6 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ac78e2767c49168f0464acea155be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286d184163154f2e846d521d368e3ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:22:20.016454 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-c7ddad5b-7b3e-40be-8306-93d52b29f7a6 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] 10.222.0.43 "GET /compute/v2.1/servers/17fb2ff0-7ff4-4acf-a984-ef23ba8ec3dc" status: 200 len: 1670 microversion: 2.1 time: 0.329169 Oct 04 22:22:20.030882 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3101/6051] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:22:19 2022] GET /compute/v2.1/servers/17fb2ff0-7ff4-4acf-a984-ef23ba8ec3dc => generated 1670 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:22:20.675303 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-ef76dfdd-1bdb-4148-a16e-906d202b436e req-6c8aa754-8845-4520-a323-912e8604fb74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17fb2ff0-7ff4-4acf-a984-ef23ba8ec3dc", "name": "network-vif-deleted", "tag": "2a05598a-68c7-4079-85a9-3466be4f8f63"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:22:20.686960 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-ef76dfdd-1bdb-4148-a16e-906d202b436e req-6c8aa754-8845-4520-a323-912e8604fb74 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:22:20.687447 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-ef76dfdd-1bdb-4148-a16e-906d202b436e req-6c8aa754-8845-4520-a323-912e8604fb74 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:22:20.687880 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-ef76dfdd-1bdb-4148-a16e-906d202b436e req-6c8aa754-8845-4520-a323-912e8604fb74 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:22:20.701715 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-ef76dfdd-1bdb-4148-a16e-906d202b436e req-6c8aa754-8845-4520-a323-912e8604fb74 service nova] Creating event network-vif-deleted:2a05598a-68c7-4079-85a9-3466be4f8f63 for instance 17fb2ff0-7ff4-4acf-a984-ef23ba8ec3dc on n-h1-860284-1 Oct 04 22:22:20.707724 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-ef76dfdd-1bdb-4148-a16e-906d202b436e req-6c8aa754-8845-4520-a323-912e8604fb74 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037651 Oct 04 22:22:20.708342 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3102/6052] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:22:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:22:21.042344 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-6896b900-ef5e-47c1-a92a-81e586702c72 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:22:21.053710 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-6896b900-ef5e-47c1-a92a-81e586702c72 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] [instance: 17fb2ff0-7ff4-4acf-a984-ef23ba8ec3dc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:22:21.067140 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6896b900-ef5e-47c1-a92a-81e586702c72 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:22:21.067641 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6896b900-ef5e-47c1-a92a-81e586702c72 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:22:21.068086 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6896b900-ef5e-47c1-a92a-81e586702c72 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:22:21.068814 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6896b900-ef5e-47c1-a92a-81e586702c72 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:22:21.069283 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6896b900-ef5e-47c1-a92a-81e586702c72 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:22:21.069714 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6896b900-ef5e-47c1-a92a-81e586702c72 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:22:21.120559 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6896b900-ef5e-47c1-a92a-81e586702c72 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:22:21.121288 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6896b900-ef5e-47c1-a92a-81e586702c72 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:22:21.122102 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6896b900-ef5e-47c1-a92a-81e586702c72 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:22:21.124198 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.objects.instance [None req-6896b900-ef5e-47c1-a92a-81e586702c72 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lazy-loading 'fault' on Instance uuid 17fb2ff0-7ff4-4acf-a984-ef23ba8ec3dc {{(pid=134101) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 22:22:21.178709 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-6896b900-ef5e-47c1-a92a-81e586702c72 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ac78e2767c49168f0464acea155be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286d184163154f2e846d521d368e3ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:22:21.192075 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-6896b900-ef5e-47c1-a92a-81e586702c72 tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] 10.222.0.43 "GET /compute/v2.1/servers/17fb2ff0-7ff4-4acf-a984-ef23ba8ec3dc" status: 200 len: 1338 microversion: 2.1 time: 0.154189 Oct 04 22:22:21.192900 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3103/6053] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:22:21 2022] GET /compute/v2.1/servers/17fb2ff0-7ff4-4acf-a984-ef23ba8ec3dc => generated 1338 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:22:22.217960 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-81f0bdc4-9d6d-4874-9486-a40cef6d564f tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:22:22.218652 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-81f0bdc4-9d6d-4874-9486-a40cef6d564f tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] [instance: 17fb2ff0-7ff4-4acf-a984-ef23ba8ec3dc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:22:22.227245 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-81f0bdc4-9d6d-4874-9486-a40cef6d564f tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:22:22.227753 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-81f0bdc4-9d6d-4874-9486-a40cef6d564f tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:22:22.228214 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-81f0bdc4-9d6d-4874-9486-a40cef6d564f tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:22:22.228909 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-81f0bdc4-9d6d-4874-9486-a40cef6d564f tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:22:22.229369 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-81f0bdc4-9d6d-4874-9486-a40cef6d564f tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:22:22.229798 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-81f0bdc4-9d6d-4874-9486-a40cef6d564f tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:22:22.244510 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-81f0bdc4-9d6d-4874-9486-a40cef6d564f tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] HTTP exception thrown: Instance 17fb2ff0-7ff4-4acf-a984-ef23ba8ec3dc could not be found. Oct 04 22:22:22.246178 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-81f0bdc4-9d6d-4874-9486-a40cef6d564f tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Request method failure captured: Oct 04 22:22:22.246178 n-d-860284-1 devstack@n-api.service[134101]: request: GET /compute/v2.1/servers/17fb2ff0-7ff4-4acf-a984-ef23ba8ec3dc HTTP/1.1 Oct 04 22:22:22.246178 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 22:22:22.246178 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 22:22:22.246178 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 22:22:22.246178 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 22:22:22.246178 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 22:22:22.246178 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 22:22:22.246178 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 22:22:22.246178 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 22:22:22.246178 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPLDRjP83hF08fCh8H596OgX3y9N4FGiLSfN8nowIXPmQuqW-EaGgYh04b0TMC967vhiDXrOlxDvb9sOAkDu9NdllggOfXYIwNiskWnh4z5z3gdz3Fjc1gTo1WgLApzt_qxWPTDnDntLv6haJRB4RbFrp9grR6FOxMrXvyjag9koHkLc Oct 04 22:22:22.246178 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 22:22:22.246178 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 22:22:22.246178 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 22:22:22.246178 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 22:22:22.246178 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 22:22:22.246178 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 22:22:22.246178 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: 286d184163154f2e846d521d368e3ead Oct 04 22:22:22.246178 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-TestNetworkBasicOps-869731627 Oct 04 22:22:22.246178 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 22:22:22.246178 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 22:22:22.246178 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/286d184163154f2e846d521d368e3ead"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_286d184163154f2e846d521d368e3ead", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/286d184163154f2e846d521d368e3ead"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/286d184163154f2e846d521d368e3ead"}]}] Oct 04 22:22:22.246178 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-TestNetworkBasicOps-869731627 Oct 04 22:22:22.246178 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: 286d184163154f2e846d521d368e3ead Oct 04 22:22:22.246178 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-TestNetworkBasicOps-869731627 Oct 04 22:22:22.246178 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-TestNetworkBasicOps-869731627-project Oct 04 22:22:22.246178 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 22:22:22.246178 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 22:22:22.246178 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 94ac78e2767c49168f0464acea155be1 Oct 04 22:22:22.246178 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-TestNetworkBasicOps-869731627-project Oct 04 22:22:22.246178 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 22:22:22.246178 n-d-860284-1 devstack@n-api.service[134101]: exception: Instance 17fb2ff0-7ff4-4acf-a984-ef23ba8ec3dc could not be found. Oct 04 22:22:22.246178 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': '17fb2ff0-7ff4-4acf-a984-ef23ba8ec3dc'} Oct 04 22:22:22.246178 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:22:22.246178 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:22:22.246178 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:22:22.246178 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:22:22.246178 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:22:22.246178 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:22:22.246178 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:22:22.246178 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:22:22.246178 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:22:22.246178 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:22:22.246178 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17fb2ff0-7ff4-4acf-a984-ef23ba8ec3dc could not be found. Oct 04 22:22:22.246178 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:22:22.246178 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:22:22.246178 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:22:22.246178 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:22:22.246178 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:22:22.246178 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:22:22.246178 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:22:22.246178 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:22:22.246178 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:22:22.246178 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:22:22.246178 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:22:22.246178 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:22:22.246178 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:22:22.246178 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:22:22.246178 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:22:22.246178 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:22:22.246178 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17fb2ff0-7ff4-4acf-a984-ef23ba8ec3dc could not be found. Oct 04 22:22:22.246178 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:22:22.246178 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:22:22.246178 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:22:22.250049 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:22:22.250049 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:22:22.250049 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:22:22.250049 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:22:22.250049 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:22:22.250049 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17fb2ff0-7ff4-4acf-a984-ef23ba8ec3dc could not be found. Oct 04 22:22:22.250049 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:22:22.250049 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-81f0bdc4-9d6d-4874-9486-a40cef6d564f tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Returning 404 to user: Instance 17fb2ff0-7ff4-4acf-a984-ef23ba8ec3dc could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:22:22.250049 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-81f0bdc4-9d6d-4874-9486-a40cef6d564f tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] 10.222.0.43 "GET /compute/v2.1/servers/17fb2ff0-7ff4-4acf-a984-ef23ba8ec3dc" status: 404 len: 111 microversion: 2.1 time: 0.034673 Oct 04 22:22:22.250049 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3104/6054] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:22:22 2022] GET /compute/v2.1/servers/17fb2ff0-7ff4-4acf-a984-ef23ba8ec3dc => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 22:22:22.447029 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-201dd926-bfdd-4409-b129-4e1d2849e6af tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] Calling method '.version_select at 0x7fbb2e6418b0>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:22:22.475527 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-201dd926-bfdd-4409-b129-4e1d2849e6af tempest-TestNetworkBasicOps-869731627 tempest-TestNetworkBasicOps-869731627-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1588319888" status: 202 len: 0 microversion: 2.1 time: 0.032239 Oct 04 22:22:22.477188 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3105/6055] 10.222.0.43 () {58 vars in 1257 bytes} [Tue Oct 4 22:22:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1588319888 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 22:22:36.467792 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-47ea2239-4ae7-492f-8c13-d4c8db52e8a4 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:22:36.470198 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-47ea2239-4ae7-492f-8c13-d4c8db52e8a4 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] [instance: 01f84e19-7e4a-460a-bb60-5da518f3d8b1] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:22:36.480926 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=30 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:22:36.481719 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:22:36.498987 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-47ea2239-4ae7-492f-8c13-d4c8db52e8a4 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:22:36.499650 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-47ea2239-4ae7-492f-8c13-d4c8db52e8a4 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:22:36.500218 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-47ea2239-4ae7-492f-8c13-d4c8db52e8a4 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:22:36.501105 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-47ea2239-4ae7-492f-8c13-d4c8db52e8a4 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:22:36.501576 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-47ea2239-4ae7-492f-8c13-d4c8db52e8a4 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:22:36.504284 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-47ea2239-4ae7-492f-8c13-d4c8db52e8a4 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:22:36.586223 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-47ea2239-4ae7-492f-8c13-d4c8db52e8a4 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] 10.222.0.43 "GET /compute/v2.1/servers/01f84e19-7e4a-460a-bb60-5da518f3d8b1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.120176 Oct 04 22:22:36.590298 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3106/6056] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 22:22:36 2022] GET /compute/v2.1/servers/01f84e19-7e4a-460a-bb60-5da518f3d8b1/os-volume_attachments => generated 25 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 22:22:36.621392 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-b3711e5c-f494-4387-a34b-5fa8af72181d tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:22:36.622166 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-b3711e5c-f494-4387-a34b-5fa8af72181d tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] [instance: 317528e8-218a-462c-93a1-0e56caf0ea3b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:22:36.631483 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b3711e5c-f494-4387-a34b-5fa8af72181d tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:22:36.632382 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b3711e5c-f494-4387-a34b-5fa8af72181d tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:22:36.633092 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b3711e5c-f494-4387-a34b-5fa8af72181d tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:22:36.634791 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b3711e5c-f494-4387-a34b-5fa8af72181d tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:22:36.635550 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b3711e5c-f494-4387-a34b-5fa8af72181d tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:22:36.636293 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b3711e5c-f494-4387-a34b-5fa8af72181d tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:22:36.839893 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.objects.instance [None req-b3711e5c-f494-4387-a34b-5fa8af72181d tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lazy-loading 'services' on Instance uuid 317528e8-218a-462c-93a1-0e56caf0ea3b {{(pid=134101) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 22:22:37.048339 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-b3711e5c-f494-4387-a34b-5fa8af72181d tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] 10.222.0.43 "DELETE /compute/v2.1/servers/317528e8-218a-462c-93a1-0e56caf0ea3b/os-volume_attachments/ed51c8b8-4d49-4ca2-b479-5c8ecfb288ca" status: 202 len: 0 microversion: 2.1 time: 0.431614 Oct 04 22:22:37.051003 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3107/6057] 10.222.0.43 () {58 vars in 1416 bytes} [Tue Oct 4 22:22:36 2022] DELETE /compute/v2.1/servers/317528e8-218a-462c-93a1-0e56caf0ea3b/os-volume_attachments/ed51c8b8-4d49-4ca2-b479-5c8ecfb288ca => generated 0 bytes in 435 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 22:22:37.082508 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-2f4716c7-0d31-45d1-b5d3-0333deecf3b6 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:22:37.083838 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-2f4716c7-0d31-45d1-b5d3-0333deecf3b6 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] [instance: 01f84e19-7e4a-460a-bb60-5da518f3d8b1] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:22:37.152868 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2f4716c7-0d31-45d1-b5d3-0333deecf3b6 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:22:37.153405 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2f4716c7-0d31-45d1-b5d3-0333deecf3b6 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:22:37.153854 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2f4716c7-0d31-45d1-b5d3-0333deecf3b6 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:22:37.154633 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2f4716c7-0d31-45d1-b5d3-0333deecf3b6 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:22:37.155230 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2f4716c7-0d31-45d1-b5d3-0333deecf3b6 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:22:37.156603 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2f4716c7-0d31-45d1-b5d3-0333deecf3b6 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:22:37.239720 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-2f4716c7-0d31-45d1-b5d3-0333deecf3b6 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] [instance: 01f84e19-7e4a-460a-bb60-5da518f3d8b1] Going to try to terminate instance {{(pid=134101) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 22:22:37.391613 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-2f4716c7-0d31-45d1-b5d3-0333deecf3b6 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] 10.222.0.43 "DELETE /compute/v2.1/servers/01f84e19-7e4a-460a-bb60-5da518f3d8b1" status: 204 len: 0 microversion: 2.1 time: 0.338284 Oct 04 22:22:37.395597 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3108/6058] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 22:22:37 2022] DELETE /compute/v2.1/servers/01f84e19-7e4a-460a-bb60-5da518f3d8b1 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 22:22:37.413476 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-5b264116-f1c2-412e-895d-3d9e81281e61 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:22:37.416727 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-5b264116-f1c2-412e-895d-3d9e81281e61 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] [instance: 317528e8-218a-462c-93a1-0e56caf0ea3b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:22:37.434669 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5b264116-f1c2-412e-895d-3d9e81281e61 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:22:37.442890 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5b264116-f1c2-412e-895d-3d9e81281e61 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:22:37.445318 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5b264116-f1c2-412e-895d-3d9e81281e61 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:22:37.447891 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5b264116-f1c2-412e-895d-3d9e81281e61 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:22:37.449381 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5b264116-f1c2-412e-895d-3d9e81281e61 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:22:37.451358 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5b264116-f1c2-412e-895d-3d9e81281e61 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:22:37.514159 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-5b264116-f1c2-412e-895d-3d9e81281e61 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] 10.222.0.43 "GET /compute/v2.1/servers/317528e8-218a-462c-93a1-0e56caf0ea3b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.112365 Oct 04 22:22:37.515365 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3109/6059] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 22:22:37 2022] GET /compute/v2.1/servers/317528e8-218a-462c-93a1-0e56caf0ea3b/os-volume_attachments => generated 197 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:22:37.522844 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-199e6714-71f2-4261-88c8-4569191518e2 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:22:37.523075 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-199e6714-71f2-4261-88c8-4569191518e2 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] [instance: 01f84e19-7e4a-460a-bb60-5da518f3d8b1] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:22:37.530542 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-199e6714-71f2-4261-88c8-4569191518e2 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:22:37.531245 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-199e6714-71f2-4261-88c8-4569191518e2 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:22:37.531768 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-199e6714-71f2-4261-88c8-4569191518e2 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:22:37.532720 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-199e6714-71f2-4261-88c8-4569191518e2 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:22:37.533716 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-199e6714-71f2-4261-88c8-4569191518e2 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:22:37.534415 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-199e6714-71f2-4261-88c8-4569191518e2 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:22:37.855883 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-199e6714-71f2-4261-88c8-4569191518e2 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '524ac46437134cd5a5000574631ea59a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b191bd428a4906b6c2781ae3efdaae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:22:37.868180 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-199e6714-71f2-4261-88c8-4569191518e2 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] 10.222.0.43 "GET /compute/v2.1/servers/01f84e19-7e4a-460a-bb60-5da518f3d8b1" status: 200 len: 1674 microversion: 2.1 time: 0.351614 Oct 04 22:22:37.868804 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3110/6060] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:22:37 2022] GET /compute/v2.1/servers/01f84e19-7e4a-460a-bb60-5da518f3d8b1 => generated 1674 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:22:38.529159 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-95522a8a-288b-44d1-b524-a89e49e750d5 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:22:38.531758 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-95522a8a-288b-44d1-b524-a89e49e750d5 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] [instance: 317528e8-218a-462c-93a1-0e56caf0ea3b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:22:38.544826 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-95522a8a-288b-44d1-b524-a89e49e750d5 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:22:38.545794 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-95522a8a-288b-44d1-b524-a89e49e750d5 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:22:38.547357 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-95522a8a-288b-44d1-b524-a89e49e750d5 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:22:38.548464 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-95522a8a-288b-44d1-b524-a89e49e750d5 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:22:38.555214 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-95522a8a-288b-44d1-b524-a89e49e750d5 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:22:38.555868 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-95522a8a-288b-44d1-b524-a89e49e750d5 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:22:38.600052 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-95522a8a-288b-44d1-b524-a89e49e750d5 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] 10.222.0.43 "GET /compute/v2.1/servers/317528e8-218a-462c-93a1-0e56caf0ea3b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.075139 Oct 04 22:22:38.601147 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3111/6061] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 22:22:38 2022] GET /compute/v2.1/servers/317528e8-218a-462c-93a1-0e56caf0ea3b/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:22:38.895489 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-03b2ef64-17eb-4088-a6b7-720e8ccd8059 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:22:38.896453 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-03b2ef64-17eb-4088-a6b7-720e8ccd8059 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] [instance: 01f84e19-7e4a-460a-bb60-5da518f3d8b1] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:22:38.908582 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-03b2ef64-17eb-4088-a6b7-720e8ccd8059 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:22:38.911022 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-03b2ef64-17eb-4088-a6b7-720e8ccd8059 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:22:38.914994 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-03b2ef64-17eb-4088-a6b7-720e8ccd8059 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:22:38.915954 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-03b2ef64-17eb-4088-a6b7-720e8ccd8059 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:22:38.916983 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-03b2ef64-17eb-4088-a6b7-720e8ccd8059 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:22:38.917440 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-03b2ef64-17eb-4088-a6b7-720e8ccd8059 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:22:39.999475 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-03b2ef64-17eb-4088-a6b7-720e8ccd8059 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '524ac46437134cd5a5000574631ea59a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b191bd428a4906b6c2781ae3efdaae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:22:40.025316 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-03b2ef64-17eb-4088-a6b7-720e8ccd8059 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] 10.222.0.43 "GET /compute/v2.1/servers/01f84e19-7e4a-460a-bb60-5da518f3d8b1" status: 200 len: 1674 microversion: 2.1 time: 1.134037 Oct 04 22:22:40.026431 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3112/6062] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:22:38 2022] GET /compute/v2.1/servers/01f84e19-7e4a-460a-bb60-5da518f3d8b1 => generated 1674 bytes in 1136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:22:40.944220 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-9916bffc-5ae4-47dc-b6eb-844858ce89ca tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:22:40.949376 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-9916bffc-5ae4-47dc-b6eb-844858ce89ca tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] [instance: 317528e8-218a-462c-93a1-0e56caf0ea3b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:22:40.977255 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9916bffc-5ae4-47dc-b6eb-844858ce89ca tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:22:40.981685 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9916bffc-5ae4-47dc-b6eb-844858ce89ca tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:22:40.983992 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9916bffc-5ae4-47dc-b6eb-844858ce89ca tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:22:40.987431 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9916bffc-5ae4-47dc-b6eb-844858ce89ca tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:22:40.989352 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9916bffc-5ae4-47dc-b6eb-844858ce89ca tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:22:40.992691 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9916bffc-5ae4-47dc-b6eb-844858ce89ca tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:22:41.100811 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-9916bffc-5ae4-47dc-b6eb-844858ce89ca tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] 10.222.0.43 "GET /compute/v2.1/servers/317528e8-218a-462c-93a1-0e56caf0ea3b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 1.044621 Oct 04 22:22:41.103867 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3113/6063] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 22:22:40 2022] GET /compute/v2.1/servers/317528e8-218a-462c-93a1-0e56caf0ea3b/os-volume_attachments => generated 197 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:22:41.116047 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-c00b2b38-fe03-4931-802b-459920ff495b tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:22:41.121430 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-c00b2b38-fe03-4931-802b-459920ff495b tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] [instance: 01f84e19-7e4a-460a-bb60-5da518f3d8b1] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:22:41.144709 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c00b2b38-fe03-4931-802b-459920ff495b tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:22:41.146611 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c00b2b38-fe03-4931-802b-459920ff495b tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:22:41.148951 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c00b2b38-fe03-4931-802b-459920ff495b tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:22:41.152289 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c00b2b38-fe03-4931-802b-459920ff495b tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:22:41.155338 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c00b2b38-fe03-4931-802b-459920ff495b tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:22:41.157305 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c00b2b38-fe03-4931-802b-459920ff495b tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:22:42.176642 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-c00b2b38-fe03-4931-802b-459920ff495b tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '524ac46437134cd5a5000574631ea59a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b191bd428a4906b6c2781ae3efdaae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:22:42.194691 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-c00b2b38-fe03-4931-802b-459920ff495b tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] 10.222.0.43 "GET /compute/v2.1/servers/01f84e19-7e4a-460a-bb60-5da518f3d8b1" status: 200 len: 1674 microversion: 2.1 time: 1.089217 Oct 04 22:22:42.197514 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3114/6064] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:22:41 2022] GET /compute/v2.1/servers/01f84e19-7e4a-460a-bb60-5da518f3d8b1 => generated 1674 bytes in 1093 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:22:42.216836 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-10a71922-d982-4191-a080-65987559615e tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:22:42.244920 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-10a71922-d982-4191-a080-65987559615e tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] [instance: 317528e8-218a-462c-93a1-0e56caf0ea3b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:22:42.293526 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-10a71922-d982-4191-a080-65987559615e tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:22:42.301051 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-10a71922-d982-4191-a080-65987559615e tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:22:42.301531 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-10a71922-d982-4191-a080-65987559615e tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:22:42.302299 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-10a71922-d982-4191-a080-65987559615e tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:22:42.302800 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-10a71922-d982-4191-a080-65987559615e tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:22:42.303237 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-10a71922-d982-4191-a080-65987559615e tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:22:42.493866 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-10a71922-d982-4191-a080-65987559615e tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] 10.222.0.43 "GET /compute/v2.1/servers/317528e8-218a-462c-93a1-0e56caf0ea3b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.288325 Oct 04 22:22:42.496743 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3115/6065] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 22:22:42 2022] GET /compute/v2.1/servers/317528e8-218a-462c-93a1-0e56caf0ea3b/os-volume_attachments => generated 197 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:22:42.888708 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-613a7f0f-78b0-4f3f-b26c-4d5e90bf0d1f req-a221c1d2-1d66-4d0b-ae1a-2320ae2a26db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01f84e19-7e4a-460a-bb60-5da518f3d8b1", "name": "network-vif-deleted", "tag": "c14485cd-34c9-4858-a37e-19a888659784"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:22:42.934051 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-613a7f0f-78b0-4f3f-b26c-4d5e90bf0d1f req-a221c1d2-1d66-4d0b-ae1a-2320ae2a26db service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:22:42.936007 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-613a7f0f-78b0-4f3f-b26c-4d5e90bf0d1f req-a221c1d2-1d66-4d0b-ae1a-2320ae2a26db service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:22:42.937475 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-613a7f0f-78b0-4f3f-b26c-4d5e90bf0d1f req-a221c1d2-1d66-4d0b-ae1a-2320ae2a26db service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:22:43.010741 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-613a7f0f-78b0-4f3f-b26c-4d5e90bf0d1f req-a221c1d2-1d66-4d0b-ae1a-2320ae2a26db service nova] Creating event network-vif-deleted:c14485cd-34c9-4858-a37e-19a888659784 for instance 01f84e19-7e4a-460a-bb60-5da518f3d8b1 on n-h2-860284-1 Oct 04 22:22:43.027377 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-613a7f0f-78b0-4f3f-b26c-4d5e90bf0d1f req-a221c1d2-1d66-4d0b-ae1a-2320ae2a26db service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142118 Oct 04 22:22:43.031792 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3116/6066] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:22:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:22:43.226968 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-874fb0df-e861-4a7b-a52e-ab9e7ee92d9b tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:22:43.227993 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-874fb0df-e861-4a7b-a52e-ab9e7ee92d9b tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] [instance: 01f84e19-7e4a-460a-bb60-5da518f3d8b1] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:22:43.239772 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-874fb0df-e861-4a7b-a52e-ab9e7ee92d9b tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:22:43.240279 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-874fb0df-e861-4a7b-a52e-ab9e7ee92d9b tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:22:43.240732 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-874fb0df-e861-4a7b-a52e-ab9e7ee92d9b tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:22:43.241472 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-874fb0df-e861-4a7b-a52e-ab9e7ee92d9b tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:22:43.241941 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-874fb0df-e861-4a7b-a52e-ab9e7ee92d9b tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:22:43.242401 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-874fb0df-e861-4a7b-a52e-ab9e7ee92d9b tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:22:43.347157 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-874fb0df-e861-4a7b-a52e-ab9e7ee92d9b tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:22:43.348967 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-874fb0df-e861-4a7b-a52e-ab9e7ee92d9b tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:22:43.350172 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-874fb0df-e861-4a7b-a52e-ab9e7ee92d9b tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:22:43.351539 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.objects.instance [None req-874fb0df-e861-4a7b-a52e-ab9e7ee92d9b tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lazy-loading 'fault' on Instance uuid 01f84e19-7e4a-460a-bb60-5da518f3d8b1 {{(pid=134101) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 22:22:43.491438 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-874fb0df-e861-4a7b-a52e-ab9e7ee92d9b tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '524ac46437134cd5a5000574631ea59a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b191bd428a4906b6c2781ae3efdaae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:22:43.508208 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-874fb0df-e861-4a7b-a52e-ab9e7ee92d9b tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] 10.222.0.43 "GET /compute/v2.1/servers/01f84e19-7e4a-460a-bb60-5da518f3d8b1" status: 200 len: 1327 microversion: 2.1 time: 0.282735 Oct 04 22:22:43.516960 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3117/6067] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:22:43 2022] GET /compute/v2.1/servers/01f84e19-7e4a-460a-bb60-5da518f3d8b1 => generated 1327 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:22:43.546073 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-9e234f09-b709-4318-8d50-f1d3bc83043a tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:22:43.555476 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-9e234f09-b709-4318-8d50-f1d3bc83043a tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] [instance: 317528e8-218a-462c-93a1-0e56caf0ea3b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:22:43.618767 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9e234f09-b709-4318-8d50-f1d3bc83043a tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:22:43.622215 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9e234f09-b709-4318-8d50-f1d3bc83043a tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:22:43.624240 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9e234f09-b709-4318-8d50-f1d3bc83043a tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:22:43.625799 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9e234f09-b709-4318-8d50-f1d3bc83043a tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:22:43.637011 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9e234f09-b709-4318-8d50-f1d3bc83043a tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:22:43.639970 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9e234f09-b709-4318-8d50-f1d3bc83043a tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:22:43.752861 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-9e234f09-b709-4318-8d50-f1d3bc83043a tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] 10.222.0.43 "GET /compute/v2.1/servers/317528e8-218a-462c-93a1-0e56caf0ea3b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.232759 Oct 04 22:22:43.760067 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3118/6068] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 22:22:43 2022] GET /compute/v2.1/servers/317528e8-218a-462c-93a1-0e56caf0ea3b/os-volume_attachments => generated 197 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:22:44.934673 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-3e8288bf-49b5-4c89-88cb-09847e178508 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:22:44.937118 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-3e8288bf-49b5-4c89-88cb-09847e178508 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] [instance: 01f84e19-7e4a-460a-bb60-5da518f3d8b1] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:22:44.948380 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3e8288bf-49b5-4c89-88cb-09847e178508 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:22:44.949221 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3e8288bf-49b5-4c89-88cb-09847e178508 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:22:44.949827 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3e8288bf-49b5-4c89-88cb-09847e178508 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:22:44.952023 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3e8288bf-49b5-4c89-88cb-09847e178508 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:22:44.952708 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3e8288bf-49b5-4c89-88cb-09847e178508 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:22:44.953727 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3e8288bf-49b5-4c89-88cb-09847e178508 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:22:45.052189 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-3e8288bf-49b5-4c89-88cb-09847e178508 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] HTTP exception thrown: Instance 01f84e19-7e4a-460a-bb60-5da518f3d8b1 could not be found. Oct 04 22:22:45.058291 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-3e8288bf-49b5-4c89-88cb-09847e178508 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Request method failure captured: Oct 04 22:22:45.058291 n-d-860284-1 devstack@n-api.service[134101]: request: GET /compute/v2.1/servers/01f84e19-7e4a-460a-bb60-5da518f3d8b1 HTTP/1.1 Oct 04 22:22:45.058291 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 22:22:45.058291 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 22:22:45.058291 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 22:22:45.058291 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 22:22:45.058291 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 22:22:45.058291 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 22:22:45.058291 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 22:22:45.058291 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 22:22:45.058291 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPLEI0e33x1BAHVtdEk1fR_AGHhDj7ypAhStNQ0mk6pmZL8klfatbl9edLPPP1alHHlG1IeVtfP_eKUB_-17p4B4SbQ_djJq4XNUJDFz5GaFf32_GIKk-hb1_UBq69b9JNXVq26HhOX2XS0ZvlfeTf8CicS0jdg7FuxdpVTI2bWjbGrQ Oct 04 22:22:45.058291 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 22:22:45.058291 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 22:22:45.058291 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 22:22:45.058291 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 22:22:45.058291 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 22:22:45.058291 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 22:22:45.058291 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: 33b191bd428a4906b6c2781ae3efdaae Oct 04 22:22:45.058291 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-AttachVolumeTestJSON-2095604563 Oct 04 22:22:45.058291 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 22:22:45.058291 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 22:22:45.058291 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/33b191bd428a4906b6c2781ae3efdaae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_33b191bd428a4906b6c2781ae3efdaae", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/33b191bd428a4906b6c2781ae3efdaae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/33b191bd428a4906b6c2781ae3efdaae"}]}] Oct 04 22:22:45.058291 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-AttachVolumeTestJSON-2095604563 Oct 04 22:22:45.058291 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: 33b191bd428a4906b6c2781ae3efdaae Oct 04 22:22:45.058291 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2095604563 Oct 04 22:22:45.058291 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-AttachVolumeTestJSON-2095604563-project Oct 04 22:22:45.058291 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 22:22:45.058291 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 22:22:45.058291 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 524ac46437134cd5a5000574631ea59a Oct 04 22:22:45.058291 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-AttachVolumeTestJSON-2095604563-project Oct 04 22:22:45.058291 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 22:22:45.058291 n-d-860284-1 devstack@n-api.service[134101]: exception: Instance 01f84e19-7e4a-460a-bb60-5da518f3d8b1 could not be found. Oct 04 22:22:45.058291 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': '01f84e19-7e4a-460a-bb60-5da518f3d8b1'} Oct 04 22:22:45.058291 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:22:45.058291 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:22:45.058291 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:22:45.058291 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:22:45.058291 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:22:45.058291 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:22:45.058291 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:22:45.058291 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:22:45.058291 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:22:45.058291 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:22:45.058291 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01f84e19-7e4a-460a-bb60-5da518f3d8b1 could not be found. Oct 04 22:22:45.058291 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:22:45.058291 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:22:45.058291 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:22:45.058291 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:22:45.058291 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:22:45.058291 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:22:45.058291 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:22:45.058291 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:22:45.058291 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:22:45.058291 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:22:45.058291 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:22:45.058291 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:22:45.058291 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:22:45.058291 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:22:45.058291 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:22:45.058291 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:22:45.058291 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01f84e19-7e4a-460a-bb60-5da518f3d8b1 could not be found. Oct 04 22:22:45.058291 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:22:45.058291 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:22:45.058291 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:22:45.062592 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:22:45.062592 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:22:45.062592 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:22:45.062592 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:22:45.062592 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:22:45.062592 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01f84e19-7e4a-460a-bb60-5da518f3d8b1 could not be found. Oct 04 22:22:45.062592 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:22:45.062592 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-3e8288bf-49b5-4c89-88cb-09847e178508 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Returning 404 to user: Instance 01f84e19-7e4a-460a-bb60-5da518f3d8b1 could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:22:45.062592 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-3e8288bf-49b5-4c89-88cb-09847e178508 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] 10.222.0.43 "GET /compute/v2.1/servers/01f84e19-7e4a-460a-bb60-5da518f3d8b1" status: 404 len: 111 microversion: 2.1 time: 0.530388 Oct 04 22:22:45.065327 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3119/6069] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:22:44 2022] GET /compute/v2.1/servers/01f84e19-7e4a-460a-bb60-5da518f3d8b1 => generated 111 bytes in 536 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:22:45.083292 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-1ab33dc7-84b2-467f-b775-d2c97e3f3e4d tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:22:45.087734 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-1ab33dc7-84b2-467f-b775-d2c97e3f3e4d tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] [instance: 317528e8-218a-462c-93a1-0e56caf0ea3b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:22:45.104712 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1ab33dc7-84b2-467f-b775-d2c97e3f3e4d tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:22:45.105653 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1ab33dc7-84b2-467f-b775-d2c97e3f3e4d tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:22:45.109497 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1ab33dc7-84b2-467f-b775-d2c97e3f3e4d tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:22:45.111929 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1ab33dc7-84b2-467f-b775-d2c97e3f3e4d tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:22:45.118030 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1ab33dc7-84b2-467f-b775-d2c97e3f3e4d tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:22:45.119572 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1ab33dc7-84b2-467f-b775-d2c97e3f3e4d tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:22:45.207445 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-1ab33dc7-84b2-467f-b775-d2c97e3f3e4d tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] 10.222.0.43 "GET /compute/v2.1/servers/317528e8-218a-462c-93a1-0e56caf0ea3b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.137502 Oct 04 22:22:45.209283 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3120/6070] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 22:22:45 2022] GET /compute/v2.1/servers/317528e8-218a-462c-93a1-0e56caf0ea3b/os-volume_attachments => generated 197 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:22:45.223712 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-f255fd4d-9bac-4ce7-9178-c6daa96c01a4 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Calling method '.version_select at 0x7fbb2ef0c820>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:22:45.309395 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-f255fd4d-9bac-4ce7-9178-c6daa96c01a4 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1996980556" status: 202 len: 0 microversion: 2.1 time: 0.088867 Oct 04 22:22:45.313166 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3121/6071] 10.222.0.43 () {58 vars in 1221 bytes} [Tue Oct 4 22:22:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1996980556 => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 22:22:46.220933 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-9e420945-684c-4f2e-a250-463fdc882f32 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:22:46.223311 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-9e420945-684c-4f2e-a250-463fdc882f32 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] [instance: 317528e8-218a-462c-93a1-0e56caf0ea3b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:22:46.243704 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9e420945-684c-4f2e-a250-463fdc882f32 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:22:46.244213 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9e420945-684c-4f2e-a250-463fdc882f32 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:22:46.244667 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9e420945-684c-4f2e-a250-463fdc882f32 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:22:46.245399 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9e420945-684c-4f2e-a250-463fdc882f32 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:22:46.245865 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9e420945-684c-4f2e-a250-463fdc882f32 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:22:46.246300 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9e420945-684c-4f2e-a250-463fdc882f32 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:22:46.272688 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:22:46.375306 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-9e420945-684c-4f2e-a250-463fdc882f32 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] 10.222.0.43 "GET /compute/v2.1/servers/317528e8-218a-462c-93a1-0e56caf0ea3b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.158975 Oct 04 22:22:46.375908 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3122/6072] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 22:22:46 2022] GET /compute/v2.1/servers/317528e8-218a-462c-93a1-0e56caf0ea3b/os-volume_attachments => generated 197 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:22:46.647377 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-f231b239-4dfb-490f-ba3f-808b37a04a27 tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] Action: 'create', calling method: .version_select at 0x7fbb2e626f70>, body: {"keypair": {"name": "tempest-TestServerBasicOps-750669432", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOzxTSuji0tGpof1wxK3LXowG8kCrsasiwDqcJeHdLY1QMmJQ1FMimxXdpILTerQ6uiUP57GLt7wEzjdZYhE0wYtRY4IheF95zXaXosV8SdOhGtLn2B1WWiEf4QC5Ep3TQ=="}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:22:46.691179 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-f231b239-4dfb-490f-ba3f-808b37a04a27 tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] Getting quotas for project b0c2c7b1d34e4b31bca19ab9ea59b80e. Resources: {'key_pairs'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:22:46.698282 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-f231b239-4dfb-490f-ba3f-808b37a04a27 tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] Getting quotas for user f99b3239728640108aad384d11d251e6 and project b0c2c7b1d34e4b31bca19ab9ea59b80e. Resources: {'key_pairs'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:22:46.733178 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-f231b239-4dfb-490f-ba3f-808b37a04a27 tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.354536 Oct 04 22:22:46.734608 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3123/6073] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Oct 4 22:22:46 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:22:46.747800 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-7706fd8e-085d-402a-bf2c-f830efcd20e8 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Action: 'create', calling method: .version_select at 0x7fbb2e330af0>, body: {"keypair": {"name": "tempest-keypair-328661257", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLbuuJ99oDDLZNEMhowjVpFjGwm7o1Tp/ueTdsTMdY30x5e8wKkgbPUFEVcw6Mx2Hnikn1/VEGjFaN1E5/WQbROrmaoBhezcRSMBRFLpm9w+vlp2CpiCXJ4pteJF96Z1hw=="}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:22:46.770475 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-7706fd8e-085d-402a-bf2c-f830efcd20e8 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Getting quotas for project 33b191bd428a4906b6c2781ae3efdaae. Resources: {'key_pairs'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:22:46.778999 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-7706fd8e-085d-402a-bf2c-f830efcd20e8 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Getting quotas for user 524ac46437134cd5a5000574631ea59a and project 33b191bd428a4906b6c2781ae3efdaae. Resources: {'key_pairs'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:22:46.835644 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-7706fd8e-085d-402a-bf2c-f830efcd20e8 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.098959 Oct 04 22:22:46.836869 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3124/6074] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Oct 4 22:22:46 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:22:47.388693 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-df11a0ff-251e-4d34-ab7d-9caafd931557 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:22:47.390957 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-df11a0ff-251e-4d34-ab7d-9caafd931557 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] [instance: 317528e8-218a-462c-93a1-0e56caf0ea3b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:22:47.410906 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-df11a0ff-251e-4d34-ab7d-9caafd931557 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:22:47.411916 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-df11a0ff-251e-4d34-ab7d-9caafd931557 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:22:47.413468 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-df11a0ff-251e-4d34-ab7d-9caafd931557 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:22:47.414469 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-df11a0ff-251e-4d34-ab7d-9caafd931557 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:22:47.415100 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-df11a0ff-251e-4d34-ab7d-9caafd931557 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:22:47.415895 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-df11a0ff-251e-4d34-ab7d-9caafd931557 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:22:47.526062 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-df11a0ff-251e-4d34-ab7d-9caafd931557 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] 10.222.0.43 "GET /compute/v2.1/servers/317528e8-218a-462c-93a1-0e56caf0ea3b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.120682 Oct 04 22:22:47.528309 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3125/6075] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 22:22:47 2022] GET /compute/v2.1/servers/317528e8-218a-462c-93a1-0e56caf0ea3b/os-volume_attachments => generated 197 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:22:48.540103 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-f15ba627-1343-4e2e-9852-50de0b0218a9 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:22:48.542912 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-f15ba627-1343-4e2e-9852-50de0b0218a9 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] [instance: 317528e8-218a-462c-93a1-0e56caf0ea3b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:22:48.578871 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f15ba627-1343-4e2e-9852-50de0b0218a9 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:22:48.579461 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f15ba627-1343-4e2e-9852-50de0b0218a9 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:22:48.579995 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f15ba627-1343-4e2e-9852-50de0b0218a9 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:22:48.587894 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f15ba627-1343-4e2e-9852-50de0b0218a9 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:22:48.589871 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f15ba627-1343-4e2e-9852-50de0b0218a9 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:22:48.590845 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f15ba627-1343-4e2e-9852-50de0b0218a9 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:22:48.701979 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-f15ba627-1343-4e2e-9852-50de0b0218a9 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] 10.222.0.43 "GET /compute/v2.1/servers/317528e8-218a-462c-93a1-0e56caf0ea3b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.165878 Oct 04 22:22:48.702726 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3126/6076] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 22:22:48 2022] GET /compute/v2.1/servers/317528e8-218a-462c-93a1-0e56caf0ea3b/os-volume_attachments => generated 25 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 22:22:48.848768 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-85522a57-b526-4715-9ab3-dabeffe6e23e tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:22:48.851280 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-85522a57-b526-4715-9ab3-dabeffe6e23e tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] [instance: 95a3ffcc-fc4e-4351-9d57-b8c065aa179c] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:22:48.877790 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-85522a57-b526-4715-9ab3-dabeffe6e23e tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:22:48.878491 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-85522a57-b526-4715-9ab3-dabeffe6e23e tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:22:48.879050 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-85522a57-b526-4715-9ab3-dabeffe6e23e tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:22:48.883590 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-85522a57-b526-4715-9ab3-dabeffe6e23e tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:22:48.884215 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-85522a57-b526-4715-9ab3-dabeffe6e23e tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:22:48.885253 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-85522a57-b526-4715-9ab3-dabeffe6e23e tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:22:48.983615 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-85522a57-b526-4715-9ab3-dabeffe6e23e tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] HTTP exception thrown: Cannot 'reboot' instance 95a3ffcc-fc4e-4351-9d57-b8c065aa179c while it is in vm_state rescued Oct 04 22:22:49.000666 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-85522a57-b526-4715-9ab3-dabeffe6e23e tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Request method failure captured: Oct 04 22:22:49.000666 n-d-860284-1 devstack@n-api.service[134101]: request: POST /compute/v2.1/servers/95a3ffcc-fc4e-4351-9d57-b8c065aa179c/action HTTP/1.1 Oct 04 22:22:49.000666 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 22:22:49.000666 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 22:22:49.000666 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 22:22:49.000666 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 28 Oct 04 22:22:49.000666 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 22:22:49.000666 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 22:22:49.000666 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 22:22:49.000666 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 22:22:49.000666 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPLEDiePHKmNYQ70bvTRH9P6iiaqhUoAB8_ZBMNVcHJpqPxkBgo3U3nk5n38-Pj3vdk8AJHCO9JALC7jh3PuAbKmfUvXx7h6K9sXqnrzemrKzzJUfKCyLDC31QQuFp0uS2eKZE1D_dbjuEfh4aQXcfm19u6d5SXGgRB-GYLIygAnJeb8 Oct 04 22:22:49.000666 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 22:22:49.000666 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 22:22:49.000666 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 22:22:49.000666 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 22:22:49.000666 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 22:22:49.000666 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 22:22:49.000666 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: be71413506154420869fdff5939fb940 Oct 04 22:22:49.000666 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1499910012 Oct 04 22:22:49.000666 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 22:22:49.000666 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 22:22:49.000666 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/be71413506154420869fdff5939fb940"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_be71413506154420869fdff5939fb940", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/be71413506154420869fdff5939fb940"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/be71413506154420869fdff5939fb940"}]}] Oct 04 22:22:49.000666 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1499910012 Oct 04 22:22:49.000666 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: be71413506154420869fdff5939fb940 Oct 04 22:22:49.000666 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1499910012 Oct 04 22:22:49.000666 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-ServerRescueNegativeTestJSON-1499910012-project Oct 04 22:22:49.000666 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 22:22:49.000666 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 22:22:49.000666 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: ca6cfeabf8d84b2893200c3c54c1c19f Oct 04 22:22:49.000666 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1499910012-project Oct 04 22:22:49.000666 n-d-860284-1 devstack@n-api.service[134101]: Oct 04 22:22:49.000666 n-d-860284-1 devstack@n-api.service[134101]: {"reboot": {"type": "HARD"}} Oct 04 22:22:49.000666 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 22:22:49.000666 n-d-860284-1 devstack@n-api.service[134101]: exception: Cannot 'reboot' instance 95a3ffcc-fc4e-4351-9d57-b8c065aa179c while it is in vm_state rescued Oct 04 22:22:49.000666 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': '95a3ffcc-fc4e-4351-9d57-b8c065aa179c', 'body': {'reboot': {'type': 'HARD'}}} Oct 04 22:22:49.000666 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:22:49.000666 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:22:49.000666 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1036, in _action_reboot Oct 04 22:22:49.000666 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi self.compute_api.reboot(context, instance, reboot_type) Oct 04 22:22:49.000666 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 22:22:49.000666 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 22:22:49.000666 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3552, in reboot Oct 04 22:22:49.000666 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi self._hard_reboot(context, instance) Oct 04 22:22:49.000666 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 04 22:22:49.000666 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 04 22:22:49.000666 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 95a3ffcc-fc4e-4351-9d57-b8c065aa179c in vm_state rescued. Cannot _hard_reboot while the instance is in this state. Oct 04 22:22:49.000666 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:22:49.000666 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:22:49.000666 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:22:49.000666 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:22:49.000666 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:22:49.000666 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:22:49.000666 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:22:49.000666 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:22:49.000666 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:22:49.000666 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:22:49.000666 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 22:22:49.000666 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 22:22:49.000666 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1040, in _action_reboot Oct 04 22:22:49.000666 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 04 22:22:49.000666 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 04 22:22:49.000666 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 22:22:49.004819 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'reboot' instance 95a3ffcc-fc4e-4351-9d57-b8c065aa179c while it is in vm_state rescued Oct 04 22:22:49.004819 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:22:49.004819 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:22:49.004819 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:22:49.004819 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:22:49.004819 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:22:49.004819 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:22:49.004819 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:22:49.004819 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:22:49.004819 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'reboot' instance 95a3ffcc-fc4e-4351-9d57-b8c065aa179c while it is in vm_state rescued Oct 04 22:22:49.004819 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:22:49.004819 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-85522a57-b526-4715-9ab3-dabeffe6e23e tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Returning 409 to user: Cannot 'reboot' instance 95a3ffcc-fc4e-4351-9d57-b8c065aa179c while it is in vm_state rescued {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:22:49.012692 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-85522a57-b526-4715-9ab3-dabeffe6e23e tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] 10.222.0.43 "POST /compute/v2.1/servers/95a3ffcc-fc4e-4351-9d57-b8c065aa179c/action" status: 409 len: 145 microversion: 2.1 time: 0.169685 Oct 04 22:22:49.026661 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3127/6077] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 22:22:48 2022] POST /compute/v2.1/servers/95a3ffcc-fc4e-4351-9d57-b8c065aa179c/action => generated 145 bytes in 185 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 04 22:22:49.034187 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-4b42f6e2-603b-4b9f-9684-a052cf9f56a7 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "58548514-5dac-426c-81f5-19e3fba33e23"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:22:49.043245 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-4b42f6e2-603b-4b9f-9684-a052cf9f56a7 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] [instance: 95a3ffcc-fc4e-4351-9d57-b8c065aa179c] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:22:49.055474 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4b42f6e2-603b-4b9f-9684-a052cf9f56a7 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:22:49.055977 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4b42f6e2-603b-4b9f-9684-a052cf9f56a7 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:22:49.056426 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4b42f6e2-603b-4b9f-9684-a052cf9f56a7 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:22:49.063271 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4b42f6e2-603b-4b9f-9684-a052cf9f56a7 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:22:49.063767 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4b42f6e2-603b-4b9f-9684-a052cf9f56a7 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:22:49.064864 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4b42f6e2-603b-4b9f-9684-a052cf9f56a7 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:22:49.122518 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-4b42f6e2-603b-4b9f-9684-a052cf9f56a7 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] HTTP exception thrown: Cannot 'rebuild' instance 95a3ffcc-fc4e-4351-9d57-b8c065aa179c while it is in vm_state rescued Oct 04 22:22:49.124262 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-4b42f6e2-603b-4b9f-9684-a052cf9f56a7 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Request method failure captured: Oct 04 22:22:49.124262 n-d-860284-1 devstack@n-api.service[134101]: request: POST /compute/v2.1/servers/95a3ffcc-fc4e-4351-9d57-b8c065aa179c/action HTTP/1.1 Oct 04 22:22:49.124262 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 22:22:49.124262 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 22:22:49.124262 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 22:22:49.124262 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 65 Oct 04 22:22:49.124262 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 22:22:49.124262 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 22:22:49.124262 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 22:22:49.124262 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 22:22:49.124262 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPLEDiePHKmNYQ70bvTRH9P6iiaqhUoAB8_ZBMNVcHJpqPxkBgo3U3nk5n38-Pj3vdk8AJHCO9JALC7jh3PuAbKmfUvXx7h6K9sXqnrzemrKzzJUfKCyLDC31QQuFp0uS2eKZE1D_dbjuEfh4aQXcfm19u6d5SXGgRB-GYLIygAnJeb8 Oct 04 22:22:49.124262 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 22:22:49.124262 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 22:22:49.124262 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 22:22:49.124262 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 22:22:49.124262 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 22:22:49.124262 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 22:22:49.124262 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: be71413506154420869fdff5939fb940 Oct 04 22:22:49.124262 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1499910012 Oct 04 22:22:49.124262 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 22:22:49.124262 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 22:22:49.124262 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/be71413506154420869fdff5939fb940"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_be71413506154420869fdff5939fb940", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/be71413506154420869fdff5939fb940"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/be71413506154420869fdff5939fb940"}]}] Oct 04 22:22:49.124262 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1499910012 Oct 04 22:22:49.124262 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: be71413506154420869fdff5939fb940 Oct 04 22:22:49.124262 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1499910012 Oct 04 22:22:49.124262 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-ServerRescueNegativeTestJSON-1499910012-project Oct 04 22:22:49.124262 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 22:22:49.124262 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 22:22:49.124262 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: ca6cfeabf8d84b2893200c3c54c1c19f Oct 04 22:22:49.124262 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1499910012-project Oct 04 22:22:49.124262 n-d-860284-1 devstack@n-api.service[134101]: Oct 04 22:22:49.124262 n-d-860284-1 devstack@n-api.service[134101]: {"rebuild": {"imageRef": "58548514-5dac-426c-81f5-19e3fba33e23"}} Oct 04 22:22:49.124262 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 22:22:49.124262 n-d-860284-1 devstack@n-api.service[134101]: exception: Cannot 'rebuild' instance 95a3ffcc-fc4e-4351-9d57-b8c065aa179c while it is in vm_state rescued Oct 04 22:22:49.124262 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': '95a3ffcc-fc4e-4351-9d57-b8c065aa179c', 'body': {'rebuild': {'imageRef': '58548514-5dac-426c-81f5-19e3fba33e23'}}} Oct 04 22:22:49.124262 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:22:49.124262 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:22:49.124262 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1223, in _action_rebuild Oct 04 22:22:49.124262 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi self.compute_api.rebuild(context, Oct 04 22:22:49.124262 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 04 22:22:49.124262 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 22:22:49.124262 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 04 22:22:49.124262 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 22:22:49.124262 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 22:22:49.124262 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 22:22:49.124262 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 04 22:22:49.124262 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 04 22:22:49.124262 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 95a3ffcc-fc4e-4351-9d57-b8c065aa179c in vm_state rescued. Cannot rebuild while the instance is in this state. Oct 04 22:22:49.124262 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:22:49.124262 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:22:49.124262 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:22:49.124262 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:22:49.124262 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:22:49.124262 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:22:49.124262 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:22:49.124262 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:22:49.124262 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:22:49.124262 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:22:49.124262 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 22:22:49.124262 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 22:22:49.124262 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 22:22:49.124262 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 22:22:49.124262 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 22:22:49.128943 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 22:22:49.128943 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 04 22:22:49.128943 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1231, in _action_rebuild Oct 04 22:22:49.128943 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 04 22:22:49.128943 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 04 22:22:49.128943 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 22:22:49.128943 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rebuild' instance 95a3ffcc-fc4e-4351-9d57-b8c065aa179c while it is in vm_state rescued Oct 04 22:22:49.128943 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:22:49.128943 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:22:49.128943 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:22:49.128943 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:22:49.128943 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:22:49.128943 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:22:49.128943 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:22:49.128943 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:22:49.128943 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rebuild' instance 95a3ffcc-fc4e-4351-9d57-b8c065aa179c while it is in vm_state rescued Oct 04 22:22:49.128943 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:22:49.128943 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-4b42f6e2-603b-4b9f-9684-a052cf9f56a7 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Returning 409 to user: Cannot 'rebuild' instance 95a3ffcc-fc4e-4351-9d57-b8c065aa179c while it is in vm_state rescued {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:22:49.128943 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-4b42f6e2-603b-4b9f-9684-a052cf9f56a7 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] 10.222.0.43 "POST /compute/v2.1/servers/95a3ffcc-fc4e-4351-9d57-b8c065aa179c/action" status: 409 len: 146 microversion: 2.1 time: 0.097990 Oct 04 22:22:49.134195 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3128/6078] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 22:22:49 2022] POST /compute/v2.1/servers/95a3ffcc-fc4e-4351-9d57-b8c065aa179c/action => generated 146 bytes in 107 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 22:22:49.149309 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-a217b8bc-688f-4a33-a2e7-3b5033d8db1a tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-1304601885", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-750669432", "security_groups": [{"name": "tempest-secgroup-smoke-2064942626"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "f6a38384-152f-4ebf-8e64-a870d7d9e23e"}]}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:22:49.379743 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.network.neutron [None req-a217b8bc-688f-4a33-a2e7-3b5033d8db1a tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] validate_networks() for [('f6a38384-152f-4ebf-8e64-a870d7d9e23e', None, None, None, None, None)] {{(pid=134101) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 22:22:50.199813 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-a217b8bc-688f-4a33-a2e7-3b5033d8db1a tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] Getting quotas for project b0c2c7b1d34e4b31bca19ab9ea59b80e. Resources: dict_keys(['metadata_items']) {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:22:50.205889 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-a217b8bc-688f-4a33-a2e7-3b5033d8db1a tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] Getting quotas for user f99b3239728640108aad384d11d251e6 and project b0c2c7b1d34e4b31bca19ab9ea59b80e. Resources: dict_keys(['metadata_items']) {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:22:50.221068 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-a217b8bc-688f-4a33-a2e7-3b5033d8db1a tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] Flavor limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 22:22:50.221860 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-a217b8bc-688f-4a33-a2e7-3b5033d8db1a tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] Image limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 22:22:50.222353 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-a217b8bc-688f-4a33-a2e7-3b5033d8db1a tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] Flavor pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 22:22:50.222813 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-a217b8bc-688f-4a33-a2e7-3b5033d8db1a tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] Image pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 22:22:50.223233 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-a217b8bc-688f-4a33-a2e7-3b5033d8db1a tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 22:22:50.233039 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a217b8bc-688f-4a33-a2e7-3b5033d8db1a tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:22:50.233525 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a217b8bc-688f-4a33-a2e7-3b5033d8db1a tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:22:50.233969 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a217b8bc-688f-4a33-a2e7-3b5033d8db1a tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:22:50.234732 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a217b8bc-688f-4a33-a2e7-3b5033d8db1a tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:22:50.235203 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a217b8bc-688f-4a33-a2e7-3b5033d8db1a tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:22:50.235631 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a217b8bc-688f-4a33-a2e7-3b5033d8db1a tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:22:50.261394 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-a217b8bc-688f-4a33-a2e7-3b5033d8db1a tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] Getting quotas for project b0c2c7b1d34e4b31bca19ab9ea59b80e. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:22:50.268690 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-a217b8bc-688f-4a33-a2e7-3b5033d8db1a tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] Getting quotas for user f99b3239728640108aad384d11d251e6 and project b0c2c7b1d34e4b31bca19ab9ea59b80e. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:22:50.284470 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-a217b8bc-688f-4a33-a2e7-3b5033d8db1a tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] Going to run 1 instances... {{(pid=134101) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 22:22:50.289162 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-a217b8bc-688f-4a33-a2e7-3b5033d8db1a tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] [instance: 3b0c98dd-e4fa-410c-9dd2-01a61db2ddd9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='58548514-5dac-426c-81f5-19e3fba33e23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134101) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 22:22:50.302350 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:22:50.343633 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-a217b8bc-688f-4a33-a2e7-3b5033d8db1a tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.202900 Oct 04 22:22:50.351069 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3129/6079] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 22:22:49 2022] POST /compute/v2.1/servers => generated 406 bytes in 1216 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 22:22:50.357682 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-5e8e5c17-7537-48b0-800d-42fd6e66359b tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:22:50.358258 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-5e8e5c17-7537-48b0-800d-42fd6e66359b tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] [instance: 317528e8-218a-462c-93a1-0e56caf0ea3b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:22:50.366872 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5e8e5c17-7537-48b0-800d-42fd6e66359b tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:22:50.367545 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5e8e5c17-7537-48b0-800d-42fd6e66359b tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:22:50.368178 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5e8e5c17-7537-48b0-800d-42fd6e66359b tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:22:50.368887 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5e8e5c17-7537-48b0-800d-42fd6e66359b tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:22:50.369335 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5e8e5c17-7537-48b0-800d-42fd6e66359b tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:22:50.369918 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5e8e5c17-7537-48b0-800d-42fd6e66359b tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:22:50.402487 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-5e8e5c17-7537-48b0-800d-42fd6e66359b tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] [instance: 317528e8-218a-462c-93a1-0e56caf0ea3b] Going to try to terminate instance {{(pid=134101) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 22:22:50.512729 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-5e8e5c17-7537-48b0-800d-42fd6e66359b tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] 10.222.0.43 "DELETE /compute/v2.1/servers/317528e8-218a-462c-93a1-0e56caf0ea3b" status: 204 len: 0 microversion: 2.1 time: 0.159176 Oct 04 22:22:50.513827 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3130/6080] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 22:22:50 2022] DELETE /compute/v2.1/servers/317528e8-218a-462c-93a1-0e56caf0ea3b => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 22:22:50.525463 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-b0ba45cf-c98f-4949-b554-3463039ea67b tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1766800828", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f902d1c0-a388-48db-ac68-ba1329707022"}], "security_groups": [{"name": "tempest-securitygroup--2088696663"}], "key_name": "tempest-keypair-328661257", "user_data": "}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:22:50.665561 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.network.neutron [None req-b0ba45cf-c98f-4949-b554-3463039ea67b tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] validate_networks() for [('f902d1c0-a388-48db-ac68-ba1329707022', None, None, None, None, None)] {{(pid=134101) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 22:22:51.270837 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-b0ba45cf-c98f-4949-b554-3463039ea67b tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Flavor limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 22:22:51.272243 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-b0ba45cf-c98f-4949-b554-3463039ea67b tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Image limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 22:22:51.272878 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-b0ba45cf-c98f-4949-b554-3463039ea67b tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Flavor pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 22:22:51.273484 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-b0ba45cf-c98f-4949-b554-3463039ea67b tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Image pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 22:22:51.275310 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-b0ba45cf-c98f-4949-b554-3463039ea67b tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 22:22:51.292514 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b0ba45cf-c98f-4949-b554-3463039ea67b tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:22:51.293714 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b0ba45cf-c98f-4949-b554-3463039ea67b tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:22:51.296846 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b0ba45cf-c98f-4949-b554-3463039ea67b tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:22:51.302512 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b0ba45cf-c98f-4949-b554-3463039ea67b tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:22:51.303371 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b0ba45cf-c98f-4949-b554-3463039ea67b tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:22:51.304233 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b0ba45cf-c98f-4949-b554-3463039ea67b tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:22:51.345255 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-b0ba45cf-c98f-4949-b554-3463039ea67b tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Getting quotas for project 33b191bd428a4906b6c2781ae3efdaae. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:22:51.356283 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-b0ba45cf-c98f-4949-b554-3463039ea67b tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Getting quotas for user 524ac46437134cd5a5000574631ea59a and project 33b191bd428a4906b6c2781ae3efdaae. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:22:51.380450 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-b0ba45cf-c98f-4949-b554-3463039ea67b tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Going to run 1 instances... {{(pid=134101) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 22:22:51.384218 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-b0ba45cf-c98f-4949-b554-3463039ea67b tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] [instance: c598f920-d90a-424a-ae96-8ef237f5d234] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='58548514-5dac-426c-81f5-19e3fba33e23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134101) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 22:22:51.473274 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-b0ba45cf-c98f-4949-b554-3463039ea67b tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.957593 Oct 04 22:22:51.474151 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3131/6081] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 22:22:50 2022] POST /compute/v2.1/servers => generated 402 bytes in 960 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 22:22:51.480785 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-fbf6a2bc-2083-4e82-a378-3f7773298d7d tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:22:51.481676 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-fbf6a2bc-2083-4e82-a378-3f7773298d7d tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] [instance: 3b0c98dd-e4fa-410c-9dd2-01a61db2ddd9] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:22:51.491361 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fbf6a2bc-2083-4e82-a378-3f7773298d7d tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:22:51.492310 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fbf6a2bc-2083-4e82-a378-3f7773298d7d tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:22:51.492915 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fbf6a2bc-2083-4e82-a378-3f7773298d7d tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:22:51.494075 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fbf6a2bc-2083-4e82-a378-3f7773298d7d tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:22:51.495024 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fbf6a2bc-2083-4e82-a378-3f7773298d7d tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:22:51.495703 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fbf6a2bc-2083-4e82-a378-3f7773298d7d tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:22:51.609421 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-fbf6a2bc-2083-4e82-a378-3f7773298d7d tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b3239728640108aad384d11d251e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c2c7b1d34e4b31bca19ab9ea59b80e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:22:51.633770 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-fbf6a2bc-2083-4e82-a378-3f7773298d7d tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] 10.222.0.43 "GET /compute/v2.1/servers/3b0c98dd-e4fa-410c-9dd2-01a61db2ddd9" status: 200 len: 1354 microversion: 2.1 time: 0.156790 Oct 04 22:22:51.634770 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3132/6082] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:22:51 2022] GET /compute/v2.1/servers/3b0c98dd-e4fa-410c-9dd2-01a61db2ddd9 => generated 1354 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:22:51.644004 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-4a2a512e-97df-4afe-b3c7-15eb689016c4 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:22:51.644740 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-4a2a512e-97df-4afe-b3c7-15eb689016c4 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] [instance: 317528e8-218a-462c-93a1-0e56caf0ea3b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:22:51.656850 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4a2a512e-97df-4afe-b3c7-15eb689016c4 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:22:51.657453 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4a2a512e-97df-4afe-b3c7-15eb689016c4 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:22:51.658548 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4a2a512e-97df-4afe-b3c7-15eb689016c4 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:22:51.659843 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4a2a512e-97df-4afe-b3c7-15eb689016c4 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:22:51.660952 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4a2a512e-97df-4afe-b3c7-15eb689016c4 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:22:51.663516 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4a2a512e-97df-4afe-b3c7-15eb689016c4 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:22:51.957534 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-4a2a512e-97df-4afe-b3c7-15eb689016c4 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6cfeabf8d84b2893200c3c54c1c19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be71413506154420869fdff5939fb940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:22:51.974516 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-4a2a512e-97df-4afe-b3c7-15eb689016c4 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] 10.222.0.43 "GET /compute/v2.1/servers/317528e8-218a-462c-93a1-0e56caf0ea3b" status: 200 len: 1691 microversion: 2.1 time: 0.337158 Oct 04 22:22:51.975801 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3133/6083] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:22:51 2022] GET /compute/v2.1/servers/317528e8-218a-462c-93a1-0e56caf0ea3b => generated 1691 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:22:51.982020 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-b2e39650-1617-4f54-911b-aa606127b152 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:22:51.983333 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-b2e39650-1617-4f54-911b-aa606127b152 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] [instance: c598f920-d90a-424a-ae96-8ef237f5d234] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:22:52.108580 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-b2e39650-1617-4f54-911b-aa606127b152 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '524ac46437134cd5a5000574631ea59a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b191bd428a4906b6c2781ae3efdaae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:22:52.118450 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-b2e39650-1617-4f54-911b-aa606127b152 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] 10.222.0.43 "GET /compute/v2.1/servers/c598f920-d90a-424a-ae96-8ef237f5d234" status: 200 len: 1237 microversion: 2.1 time: 0.141193 Oct 04 22:22:52.121371 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3134/6084] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:22:51 2022] GET /compute/v2.1/servers/c598f920-d90a-424a-ae96-8ef237f5d234 => generated 1237 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:22:52.659260 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-1a7f4c47-2c60-46a6-bdd9-c3273cec4506 tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:22:52.660094 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-1a7f4c47-2c60-46a6-bdd9-c3273cec4506 tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] [instance: 3b0c98dd-e4fa-410c-9dd2-01a61db2ddd9] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:22:52.668663 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1a7f4c47-2c60-46a6-bdd9-c3273cec4506 tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:22:52.669491 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1a7f4c47-2c60-46a6-bdd9-c3273cec4506 tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:22:52.670303 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1a7f4c47-2c60-46a6-bdd9-c3273cec4506 tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:22:52.671531 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1a7f4c47-2c60-46a6-bdd9-c3273cec4506 tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:22:52.672234 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1a7f4c47-2c60-46a6-bdd9-c3273cec4506 tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:22:52.672862 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1a7f4c47-2c60-46a6-bdd9-c3273cec4506 tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:22:52.776546 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-1a7f4c47-2c60-46a6-bdd9-c3273cec4506 tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b3239728640108aad384d11d251e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c2c7b1d34e4b31bca19ab9ea59b80e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:22:52.787270 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-1a7f4c47-2c60-46a6-bdd9-c3273cec4506 tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] 10.222.0.43 "GET /compute/v2.1/servers/3b0c98dd-e4fa-410c-9dd2-01a61db2ddd9" status: 200 len: 1360 microversion: 2.1 time: 0.133930 Oct 04 22:22:52.806249 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3135/6085] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:22:52 2022] GET /compute/v2.1/servers/3b0c98dd-e4fa-410c-9dd2-01a61db2ddd9 => generated 1360 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:22:52.999092 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-ce00839d-7788-4971-a899-b1ffccb6408b tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:22:53.000069 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-ce00839d-7788-4971-a899-b1ffccb6408b tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] [instance: 317528e8-218a-462c-93a1-0e56caf0ea3b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:22:53.016979 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ce00839d-7788-4971-a899-b1ffccb6408b tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:22:53.017854 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ce00839d-7788-4971-a899-b1ffccb6408b tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:22:53.018608 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ce00839d-7788-4971-a899-b1ffccb6408b tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:22:53.019556 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ce00839d-7788-4971-a899-b1ffccb6408b tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:22:53.020231 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ce00839d-7788-4971-a899-b1ffccb6408b tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:22:53.020876 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ce00839d-7788-4971-a899-b1ffccb6408b tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:22:53.219641 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-ce00839d-7788-4971-a899-b1ffccb6408b tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6cfeabf8d84b2893200c3c54c1c19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be71413506154420869fdff5939fb940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:22:53.232278 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-ce00839d-7788-4971-a899-b1ffccb6408b tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] 10.222.0.43 "GET /compute/v2.1/servers/317528e8-218a-462c-93a1-0e56caf0ea3b" status: 200 len: 1691 microversion: 2.1 time: 0.236909 Oct 04 22:22:53.247807 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3136/6086] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:22:52 2022] GET /compute/v2.1/servers/317528e8-218a-462c-93a1-0e56caf0ea3b => generated 1691 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:22:53.260454 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-c15f892b-0948-4d37-86e3-675cfe86e8e3 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:22:53.261533 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-c15f892b-0948-4d37-86e3-675cfe86e8e3 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] [instance: c598f920-d90a-424a-ae96-8ef237f5d234] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:22:53.271353 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c15f892b-0948-4d37-86e3-675cfe86e8e3 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:22:53.272942 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c15f892b-0948-4d37-86e3-675cfe86e8e3 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:22:53.273629 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c15f892b-0948-4d37-86e3-675cfe86e8e3 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:22:53.274784 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c15f892b-0948-4d37-86e3-675cfe86e8e3 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:22:53.276051 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c15f892b-0948-4d37-86e3-675cfe86e8e3 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:22:53.277434 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c15f892b-0948-4d37-86e3-675cfe86e8e3 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:22:53.367277 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-c15f892b-0948-4d37-86e3-675cfe86e8e3 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '524ac46437134cd5a5000574631ea59a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b191bd428a4906b6c2781ae3efdaae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:22:53.377791 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-c15f892b-0948-4d37-86e3-675cfe86e8e3 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] 10.222.0.43 "GET /compute/v2.1/servers/c598f920-d90a-424a-ae96-8ef237f5d234" status: 200 len: 1241 microversion: 2.1 time: 0.127072 Oct 04 22:22:53.379622 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3137/6087] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:22:53 2022] GET /compute/v2.1/servers/c598f920-d90a-424a-ae96-8ef237f5d234 => generated 1241 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:22:53.810087 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-969b3eed-4173-4160-8ed6-566666b364ba tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:22:53.810822 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-969b3eed-4173-4160-8ed6-566666b364ba tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] [instance: 3b0c98dd-e4fa-410c-9dd2-01a61db2ddd9] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:22:53.818356 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-969b3eed-4173-4160-8ed6-566666b364ba tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:22:53.819198 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-969b3eed-4173-4160-8ed6-566666b364ba tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:22:53.819800 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-969b3eed-4173-4160-8ed6-566666b364ba tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:22:53.820713 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-969b3eed-4173-4160-8ed6-566666b364ba tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:22:53.821337 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-969b3eed-4173-4160-8ed6-566666b364ba tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:22:53.821925 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-969b3eed-4173-4160-8ed6-566666b364ba tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:22:54.038282 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-969b3eed-4173-4160-8ed6-566666b364ba tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b3239728640108aad384d11d251e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c2c7b1d34e4b31bca19ab9ea59b80e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:22:54.051543 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-969b3eed-4173-4160-8ed6-566666b364ba tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] 10.222.0.43 "GET /compute/v2.1/servers/3b0c98dd-e4fa-410c-9dd2-01a61db2ddd9" status: 200 len: 1428 microversion: 2.1 time: 0.244887 Oct 04 22:22:54.054762 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3138/6088] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:22:53 2022] GET /compute/v2.1/servers/3b0c98dd-e4fa-410c-9dd2-01a61db2ddd9 => generated 1428 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:22:54.268947 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-7a92156a-9dc9-4a59-882f-00554f51d544 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:22:54.269657 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-7a92156a-9dc9-4a59-882f-00554f51d544 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] [instance: 317528e8-218a-462c-93a1-0e56caf0ea3b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:22:54.278197 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7a92156a-9dc9-4a59-882f-00554f51d544 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:22:54.278740 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7a92156a-9dc9-4a59-882f-00554f51d544 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:22:54.279220 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7a92156a-9dc9-4a59-882f-00554f51d544 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:22:54.280111 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7a92156a-9dc9-4a59-882f-00554f51d544 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:22:54.281890 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7a92156a-9dc9-4a59-882f-00554f51d544 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:22:54.282888 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7a92156a-9dc9-4a59-882f-00554f51d544 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:22:54.460666 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-7a92156a-9dc9-4a59-882f-00554f51d544 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6cfeabf8d84b2893200c3c54c1c19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be71413506154420869fdff5939fb940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:22:54.474911 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-7a92156a-9dc9-4a59-882f-00554f51d544 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] 10.222.0.43 "GET /compute/v2.1/servers/317528e8-218a-462c-93a1-0e56caf0ea3b" status: 200 len: 1691 microversion: 2.1 time: 0.211135 Oct 04 22:22:54.492316 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3139/6089] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:22:54 2022] GET /compute/v2.1/servers/317528e8-218a-462c-93a1-0e56caf0ea3b => generated 1691 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:22:54.512694 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-81c49292-066a-4213-96be-a59bbe68c578 req-95d849b4-3407-4819-8906-7e0e7a07cb11 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b0c98dd-e4fa-410c-9dd2-01a61db2ddd9", "tag": "c8748d3d-2efd-4332-a388-3d6d1fbf3ef1"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:22:54.527440 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-81c49292-066a-4213-96be-a59bbe68c578 req-95d849b4-3407-4819-8906-7e0e7a07cb11 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:22:54.528193 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-81c49292-066a-4213-96be-a59bbe68c578 req-95d849b4-3407-4819-8906-7e0e7a07cb11 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:22:54.528789 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-81c49292-066a-4213-96be-a59bbe68c578 req-95d849b4-3407-4819-8906-7e0e7a07cb11 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:22:54.555604 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-81c49292-066a-4213-96be-a59bbe68c578 req-95d849b4-3407-4819-8906-7e0e7a07cb11 service nova] Creating event network-changed:c8748d3d-2efd-4332-a388-3d6d1fbf3ef1 for instance 3b0c98dd-e4fa-410c-9dd2-01a61db2ddd9 on n-h2-860284-1 Oct 04 22:22:54.562627 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-81c49292-066a-4213-96be-a59bbe68c578 req-95d849b4-3407-4819-8906-7e0e7a07cb11 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067986 Oct 04 22:22:54.565562 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3140/6090] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:22:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:22:54.571943 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-66461ec0-a5cc-40fa-9e8b-5d954dd54e85 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:22:54.572969 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-66461ec0-a5cc-40fa-9e8b-5d954dd54e85 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] [instance: c598f920-d90a-424a-ae96-8ef237f5d234] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:22:54.580983 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-66461ec0-a5cc-40fa-9e8b-5d954dd54e85 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:22:54.581786 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-66461ec0-a5cc-40fa-9e8b-5d954dd54e85 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:22:54.582528 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-66461ec0-a5cc-40fa-9e8b-5d954dd54e85 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:22:54.583449 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-66461ec0-a5cc-40fa-9e8b-5d954dd54e85 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:22:54.584134 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-66461ec0-a5cc-40fa-9e8b-5d954dd54e85 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:22:54.584769 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-66461ec0-a5cc-40fa-9e8b-5d954dd54e85 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:22:54.754916 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-66461ec0-a5cc-40fa-9e8b-5d954dd54e85 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '524ac46437134cd5a5000574631ea59a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b191bd428a4906b6c2781ae3efdaae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:22:54.764412 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-66461ec0-a5cc-40fa-9e8b-5d954dd54e85 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] 10.222.0.43 "GET /compute/v2.1/servers/c598f920-d90a-424a-ae96-8ef237f5d234" status: 200 len: 1297 microversion: 2.1 time: 0.197221 Oct 04 22:22:54.780207 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3141/6091] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:22:54 2022] GET /compute/v2.1/servers/c598f920-d90a-424a-ae96-8ef237f5d234 => generated 1297 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:22:54.789641 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-7f8e2fa0-16b7-418c-a44c-1bae15dbd50f tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-531006767", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "75c295f9-15df-4b09-89f1-c8056f4674f7", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "f55a0794-d215-4510-84cc-a7b063c083a4"}]}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:22:54.876301 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.network.neutron [None req-7f8e2fa0-16b7-418c-a44c-1bae15dbd50f tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] validate_networks() for [('f55a0794-d215-4510-84cc-a7b063c083a4', None, None, None, None, None)] {{(pid=134101) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 22:22:55.628810 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-7f8e2fa0-16b7-418c-a44c-1bae15dbd50f tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Flavor limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 22:22:55.632099 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-7f8e2fa0-16b7-418c-a44c-1bae15dbd50f tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Image limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 22:22:55.633945 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-7f8e2fa0-16b7-418c-a44c-1bae15dbd50f tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Flavor pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 22:22:55.636719 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-7f8e2fa0-16b7-418c-a44c-1bae15dbd50f tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Image pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 22:22:55.637602 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-7f8e2fa0-16b7-418c-a44c-1bae15dbd50f tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 22:22:55.656369 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7f8e2fa0-16b7-418c-a44c-1bae15dbd50f tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:22:55.657308 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7f8e2fa0-16b7-418c-a44c-1bae15dbd50f tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:22:55.659011 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7f8e2fa0-16b7-418c-a44c-1bae15dbd50f tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:22:55.660118 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7f8e2fa0-16b7-418c-a44c-1bae15dbd50f tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:22:55.661896 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7f8e2fa0-16b7-418c-a44c-1bae15dbd50f tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:22:55.662594 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7f8e2fa0-16b7-418c-a44c-1bae15dbd50f tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:22:55.742294 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-7f8e2fa0-16b7-418c-a44c-1bae15dbd50f tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Getting quotas for project 5c98a72bacce47c3947f9b0f0b4e85b6. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:22:55.749455 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-7f8e2fa0-16b7-418c-a44c-1bae15dbd50f tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Getting quotas for user 99acad09db70445b93ae1d64a1b49ca3 and project 5c98a72bacce47c3947f9b0f0b4e85b6. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:22:55.858792 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-7f8e2fa0-16b7-418c-a44c-1bae15dbd50f tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Going to run 1 instances... {{(pid=134101) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 22:22:55.866707 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-7f8e2fa0-16b7-418c-a44c-1bae15dbd50f tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: f4acd3e4-bb81-43c5-8636-5259a9331844] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='75c295f9-15df-4b09-89f1-c8056f4674f7',volume_size=None,volume_type=None)] {{(pid=134101) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 22:22:56.085519 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-7f8e2fa0-16b7-418c-a44c-1bae15dbd50f tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.303990 Oct 04 22:22:56.088287 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3142/6092] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 22:22:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 1307 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 22:22:56.104307 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-68959265-4913-4288-b556-e4b1b16a31cd tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:22:56.107662 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-68959265-4913-4288-b556-e4b1b16a31cd tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] [instance: 3b0c98dd-e4fa-410c-9dd2-01a61db2ddd9] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:22:56.123004 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-68959265-4913-4288-b556-e4b1b16a31cd tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:22:56.131273 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-68959265-4913-4288-b556-e4b1b16a31cd tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:22:56.131986 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-68959265-4913-4288-b556-e4b1b16a31cd tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:22:56.142006 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-68959265-4913-4288-b556-e4b1b16a31cd tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:22:56.143480 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-68959265-4913-4288-b556-e4b1b16a31cd tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:22:56.144179 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-68959265-4913-4288-b556-e4b1b16a31cd tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:22:56.204436 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:22:57.044211 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-68959265-4913-4288-b556-e4b1b16a31cd tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b3239728640108aad384d11d251e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c2c7b1d34e4b31bca19ab9ea59b80e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:22:57.053565 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-68959265-4913-4288-b556-e4b1b16a31cd tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] 10.222.0.43 "GET /compute/v2.1/servers/3b0c98dd-e4fa-410c-9dd2-01a61db2ddd9" status: 200 len: 1428 microversion: 2.1 time: 0.964042 Oct 04 22:22:57.054427 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3143/6093] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:22:56 2022] GET /compute/v2.1/servers/3b0c98dd-e4fa-410c-9dd2-01a61db2ddd9 => generated 1428 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:22:57.059540 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-bc81a62a-d0bb-4f72-9941-7f3f6b18b0bc tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:22:57.060406 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-bc81a62a-d0bb-4f72-9941-7f3f6b18b0bc tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] [instance: 317528e8-218a-462c-93a1-0e56caf0ea3b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:22:57.067651 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bc81a62a-d0bb-4f72-9941-7f3f6b18b0bc tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:22:57.068376 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bc81a62a-d0bb-4f72-9941-7f3f6b18b0bc tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:22:57.069013 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bc81a62a-d0bb-4f72-9941-7f3f6b18b0bc tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:22:57.069946 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bc81a62a-d0bb-4f72-9941-7f3f6b18b0bc tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:22:57.070706 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bc81a62a-d0bb-4f72-9941-7f3f6b18b0bc tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:22:57.071328 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bc81a62a-d0bb-4f72-9941-7f3f6b18b0bc tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:22:57.108144 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bc81a62a-d0bb-4f72-9941-7f3f6b18b0bc tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:22:57.109540 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bc81a62a-d0bb-4f72-9941-7f3f6b18b0bc tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:22:57.110176 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bc81a62a-d0bb-4f72-9941-7f3f6b18b0bc tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:22:57.110927 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.objects.instance [None req-bc81a62a-d0bb-4f72-9941-7f3f6b18b0bc tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lazy-loading 'fault' on Instance uuid 317528e8-218a-462c-93a1-0e56caf0ea3b {{(pid=134101) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 22:22:57.234040 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-bc81a62a-d0bb-4f72-9941-7f3f6b18b0bc tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6cfeabf8d84b2893200c3c54c1c19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be71413506154420869fdff5939fb940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:22:57.244773 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-bc81a62a-d0bb-4f72-9941-7f3f6b18b0bc tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] 10.222.0.43 "GET /compute/v2.1/servers/317528e8-218a-462c-93a1-0e56caf0ea3b" status: 200 len: 1335 microversion: 2.1 time: 0.188854 Oct 04 22:22:57.247869 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3144/6094] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:22:57 2022] GET /compute/v2.1/servers/317528e8-218a-462c-93a1-0e56caf0ea3b => generated 1335 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:22:57.255403 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-3f06bfa8-35cc-4236-9d84-7b14df920d72 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:22:57.256412 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-3f06bfa8-35cc-4236-9d84-7b14df920d72 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] [instance: c598f920-d90a-424a-ae96-8ef237f5d234] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:22:57.272358 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3f06bfa8-35cc-4236-9d84-7b14df920d72 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:22:57.273124 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3f06bfa8-35cc-4236-9d84-7b14df920d72 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:22:57.273789 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3f06bfa8-35cc-4236-9d84-7b14df920d72 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:22:57.275029 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3f06bfa8-35cc-4236-9d84-7b14df920d72 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:22:57.275601 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3f06bfa8-35cc-4236-9d84-7b14df920d72 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:22:57.276541 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3f06bfa8-35cc-4236-9d84-7b14df920d72 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:22:57.520655 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-3f06bfa8-35cc-4236-9d84-7b14df920d72 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '524ac46437134cd5a5000574631ea59a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b191bd428a4906b6c2781ae3efdaae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:22:57.530679 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-3f06bfa8-35cc-4236-9d84-7b14df920d72 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] 10.222.0.43 "GET /compute/v2.1/servers/c598f920-d90a-424a-ae96-8ef237f5d234" status: 200 len: 1363 microversion: 2.1 time: 0.281073 Oct 04 22:22:57.531666 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3145/6095] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:22:57 2022] GET /compute/v2.1/servers/c598f920-d90a-424a-ae96-8ef237f5d234 => generated 1363 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:22:57.539748 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-655d45d0-8996-4778-956a-c29969f10041 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:22:57.540612 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-655d45d0-8996-4778-956a-c29969f10041 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: f4acd3e4-bb81-43c5-8636-5259a9331844] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:22:57.547767 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-655d45d0-8996-4778-956a-c29969f10041 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:22:57.548999 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-655d45d0-8996-4778-956a-c29969f10041 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:22:57.549560 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-655d45d0-8996-4778-956a-c29969f10041 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:22:57.550410 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-655d45d0-8996-4778-956a-c29969f10041 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:22:57.550974 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-655d45d0-8996-4778-956a-c29969f10041 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:22:57.551531 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-655d45d0-8996-4778-956a-c29969f10041 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:22:57.645165 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-655d45d0-8996-4778-956a-c29969f10041 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:22:57.653906 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-655d45d0-8996-4778-956a-c29969f10041 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/f4acd3e4-bb81-43c5-8636-5259a9331844" status: 200 len: 1120 microversion: 2.1 time: 0.118385 Oct 04 22:22:57.655737 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3146/6096] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:22:57 2022] GET /compute/v2.1/servers/f4acd3e4-bb81-43c5-8636-5259a9331844 => generated 1120 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:22:57.661267 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-46175cd3-35e2-4bc2-8274-b86616500a69 req-3f33f296-8ea0-41cd-8815-2064fe1589f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "317528e8-218a-462c-93a1-0e56caf0ea3b", "name": "network-vif-deleted", "tag": "812694ba-e03a-4b71-918e-d542d921b653"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:22:57.680855 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-46175cd3-35e2-4bc2-8274-b86616500a69 req-3f33f296-8ea0-41cd-8815-2064fe1589f2 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:22:57.680855 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-46175cd3-35e2-4bc2-8274-b86616500a69 req-3f33f296-8ea0-41cd-8815-2064fe1589f2 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:22:57.681078 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-46175cd3-35e2-4bc2-8274-b86616500a69 req-3f33f296-8ea0-41cd-8815-2064fe1589f2 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:22:57.694322 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-46175cd3-35e2-4bc2-8274-b86616500a69 req-3f33f296-8ea0-41cd-8815-2064fe1589f2 service nova] Creating event network-vif-deleted:812694ba-e03a-4b71-918e-d542d921b653 for instance 317528e8-218a-462c-93a1-0e56caf0ea3b on n-h1-860284-1 Oct 04 22:22:57.699614 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-46175cd3-35e2-4bc2-8274-b86616500a69 req-3f33f296-8ea0-41cd-8815-2064fe1589f2 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042730 Oct 04 22:22:57.700235 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3147/6097] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:22:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:22:57.801153 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-1a46b889-7829-4b9a-898e-441fefe38f59 req-335004c6-5c6b-4880-81ec-672913c78dd7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c598f920-d90a-424a-ae96-8ef237f5d234", "tag": "4a08fa07-1572-4ed8-a3d4-c446e944cc4c"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:22:57.837059 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-1a46b889-7829-4b9a-898e-441fefe38f59 req-335004c6-5c6b-4880-81ec-672913c78dd7 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:22:57.837694 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-1a46b889-7829-4b9a-898e-441fefe38f59 req-335004c6-5c6b-4880-81ec-672913c78dd7 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:22:57.837995 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-1a46b889-7829-4b9a-898e-441fefe38f59 req-335004c6-5c6b-4880-81ec-672913c78dd7 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:22:57.855783 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-1a46b889-7829-4b9a-898e-441fefe38f59 req-335004c6-5c6b-4880-81ec-672913c78dd7 service nova] Creating event network-changed:4a08fa07-1572-4ed8-a3d4-c446e944cc4c for instance c598f920-d90a-424a-ae96-8ef237f5d234 on n-h1-860284-1 Oct 04 22:22:57.860772 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-1a46b889-7829-4b9a-898e-441fefe38f59 req-335004c6-5c6b-4880-81ec-672913c78dd7 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086669 Oct 04 22:22:57.862479 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3148/6098] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:22:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:22:58.098597 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-3532af51-290f-4893-8d0c-71b2f56b9b12 tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:22:58.104422 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-3532af51-290f-4893-8d0c-71b2f56b9b12 tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] [instance: 3b0c98dd-e4fa-410c-9dd2-01a61db2ddd9] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:22:58.123846 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3532af51-290f-4893-8d0c-71b2f56b9b12 tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:22:58.125781 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3532af51-290f-4893-8d0c-71b2f56b9b12 tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:22:58.126262 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3532af51-290f-4893-8d0c-71b2f56b9b12 tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:22:58.136886 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3532af51-290f-4893-8d0c-71b2f56b9b12 tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:22:58.161510 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3532af51-290f-4893-8d0c-71b2f56b9b12 tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:22:58.163228 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3532af51-290f-4893-8d0c-71b2f56b9b12 tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:22:58.451915 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-3532af51-290f-4893-8d0c-71b2f56b9b12 tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b3239728640108aad384d11d251e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c2c7b1d34e4b31bca19ab9ea59b80e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:22:58.463581 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-3532af51-290f-4893-8d0c-71b2f56b9b12 tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] 10.222.0.43 "GET /compute/v2.1/servers/3b0c98dd-e4fa-410c-9dd2-01a61db2ddd9" status: 200 len: 1428 microversion: 2.1 time: 0.371046 Oct 04 22:22:58.464644 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3149/6099] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:22:58 2022] GET /compute/v2.1/servers/3b0c98dd-e4fa-410c-9dd2-01a61db2ddd9 => generated 1428 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:22:58.469657 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e1552d55-9b25-4d5f-a7ca-5bf6752b08d9 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:22:58.471400 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-e1552d55-9b25-4d5f-a7ca-5bf6752b08d9 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] [instance: 317528e8-218a-462c-93a1-0e56caf0ea3b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:22:58.478426 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e1552d55-9b25-4d5f-a7ca-5bf6752b08d9 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:22:58.479045 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e1552d55-9b25-4d5f-a7ca-5bf6752b08d9 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:22:58.479590 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e1552d55-9b25-4d5f-a7ca-5bf6752b08d9 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:22:58.480601 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e1552d55-9b25-4d5f-a7ca-5bf6752b08d9 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:22:58.481331 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e1552d55-9b25-4d5f-a7ca-5bf6752b08d9 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:22:58.481855 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e1552d55-9b25-4d5f-a7ca-5bf6752b08d9 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:22:58.498977 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-e1552d55-9b25-4d5f-a7ca-5bf6752b08d9 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] HTTP exception thrown: Instance 317528e8-218a-462c-93a1-0e56caf0ea3b could not be found. Oct 04 22:22:58.500938 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e1552d55-9b25-4d5f-a7ca-5bf6752b08d9 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Request method failure captured: Oct 04 22:22:58.500938 n-d-860284-1 devstack@n-api.service[134101]: request: GET /compute/v2.1/servers/317528e8-218a-462c-93a1-0e56caf0ea3b HTTP/1.1 Oct 04 22:22:58.500938 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 22:22:58.500938 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 22:22:58.500938 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 22:22:58.500938 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 22:22:58.500938 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 22:22:58.500938 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 22:22:58.500938 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 22:22:58.500938 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 22:22:58.500938 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPLEDiePHKmNYQ70bvTRH9P6iiaqhUoAB8_ZBMNVcHJpqPxkBgo3U3nk5n38-Pj3vdk8AJHCO9JALC7jh3PuAbKmfUvXx7h6K9sXqnrzemrKzzJUfKCyLDC31QQuFp0uS2eKZE1D_dbjuEfh4aQXcfm19u6d5SXGgRB-GYLIygAnJeb8 Oct 04 22:22:58.500938 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 22:22:58.500938 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 22:22:58.500938 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 22:22:58.500938 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 22:22:58.500938 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 22:22:58.500938 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 22:22:58.500938 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: be71413506154420869fdff5939fb940 Oct 04 22:22:58.500938 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1499910012 Oct 04 22:22:58.500938 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 22:22:58.500938 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 22:22:58.500938 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/be71413506154420869fdff5939fb940"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_be71413506154420869fdff5939fb940", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/be71413506154420869fdff5939fb940"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/be71413506154420869fdff5939fb940"}]}] Oct 04 22:22:58.500938 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1499910012 Oct 04 22:22:58.500938 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: be71413506154420869fdff5939fb940 Oct 04 22:22:58.500938 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1499910012 Oct 04 22:22:58.500938 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-ServerRescueNegativeTestJSON-1499910012-project Oct 04 22:22:58.500938 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 22:22:58.500938 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 22:22:58.500938 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: ca6cfeabf8d84b2893200c3c54c1c19f Oct 04 22:22:58.500938 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1499910012-project Oct 04 22:22:58.500938 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 22:22:58.500938 n-d-860284-1 devstack@n-api.service[134101]: exception: Instance 317528e8-218a-462c-93a1-0e56caf0ea3b could not be found. Oct 04 22:22:58.500938 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': '317528e8-218a-462c-93a1-0e56caf0ea3b'} Oct 04 22:22:58.500938 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:22:58.500938 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:22:58.500938 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:22:58.500938 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:22:58.500938 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:22:58.500938 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:22:58.500938 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:22:58.500938 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:22:58.500938 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:22:58.500938 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:22:58.500938 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 317528e8-218a-462c-93a1-0e56caf0ea3b could not be found. Oct 04 22:22:58.500938 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:22:58.500938 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:22:58.500938 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:22:58.500938 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:22:58.500938 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:22:58.500938 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:22:58.500938 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:22:58.500938 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:22:58.500938 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:22:58.500938 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:22:58.500938 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:22:58.500938 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:22:58.500938 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:22:58.500938 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:22:58.500938 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:22:58.500938 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:22:58.500938 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 317528e8-218a-462c-93a1-0e56caf0ea3b could not be found. Oct 04 22:22:58.500938 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:22:58.500938 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:22:58.507545 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:22:58.507545 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:22:58.507545 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:22:58.507545 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:22:58.507545 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:22:58.507545 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:22:58.507545 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 317528e8-218a-462c-93a1-0e56caf0ea3b could not be found. Oct 04 22:22:58.507545 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:22:58.507545 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e1552d55-9b25-4d5f-a7ca-5bf6752b08d9 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Returning 404 to user: Instance 317528e8-218a-462c-93a1-0e56caf0ea3b could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:22:58.507545 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-e1552d55-9b25-4d5f-a7ca-5bf6752b08d9 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] 10.222.0.43 "GET /compute/v2.1/servers/317528e8-218a-462c-93a1-0e56caf0ea3b" status: 404 len: 111 microversion: 2.1 time: 0.037655 Oct 04 22:22:58.507545 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3150/6100] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:22:58 2022] GET /compute/v2.1/servers/317528e8-218a-462c-93a1-0e56caf0ea3b => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:22:58.514410 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e803bef7-5547-42ea-9580-4c9e4799aae6 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Calling method '.version_select at 0x7fbb2e243ca0>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:22:58.550251 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-e803bef7-5547-42ea-9580-4c9e4799aae6 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-438545507" status: 202 len: 0 microversion: 2.1 time: 0.039020 Oct 04 22:22:58.550751 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3151/6101] 10.222.0.43 () {58 vars in 1218 bytes} [Tue Oct 4 22:22:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-438545507 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 22:22:58.556840 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-3783b86a-a7ba-404c-b0cc-b4d5d9519892 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:22:58.557585 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-3783b86a-a7ba-404c-b0cc-b4d5d9519892 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] [instance: c598f920-d90a-424a-ae96-8ef237f5d234] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:22:58.570257 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3783b86a-a7ba-404c-b0cc-b4d5d9519892 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:22:58.570257 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3783b86a-a7ba-404c-b0cc-b4d5d9519892 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:22:58.571114 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3783b86a-a7ba-404c-b0cc-b4d5d9519892 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:22:58.572163 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3783b86a-a7ba-404c-b0cc-b4d5d9519892 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:22:58.573792 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3783b86a-a7ba-404c-b0cc-b4d5d9519892 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:22:58.586798 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3783b86a-a7ba-404c-b0cc-b4d5d9519892 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:22:58.890692 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-3783b86a-a7ba-404c-b0cc-b4d5d9519892 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '524ac46437134cd5a5000574631ea59a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b191bd428a4906b6c2781ae3efdaae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:22:58.900289 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-3783b86a-a7ba-404c-b0cc-b4d5d9519892 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] 10.222.0.43 "GET /compute/v2.1/servers/c598f920-d90a-424a-ae96-8ef237f5d234" status: 200 len: 1363 microversion: 2.1 time: 0.348274 Oct 04 22:22:58.901096 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3152/6102] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:22:58 2022] GET /compute/v2.1/servers/c598f920-d90a-424a-ae96-8ef237f5d234 => generated 1363 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:22:58.905798 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-77d19770-d72b-447b-9b45-3f0bc03ca6a0 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:22:58.906466 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-77d19770-d72b-447b-9b45-3f0bc03ca6a0 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: f4acd3e4-bb81-43c5-8636-5259a9331844] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:22:58.914221 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-77d19770-d72b-447b-9b45-3f0bc03ca6a0 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:22:58.914747 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-77d19770-d72b-447b-9b45-3f0bc03ca6a0 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:22:58.915184 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-77d19770-d72b-447b-9b45-3f0bc03ca6a0 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:22:58.915886 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-77d19770-d72b-447b-9b45-3f0bc03ca6a0 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:22:58.916340 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-77d19770-d72b-447b-9b45-3f0bc03ca6a0 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:22:58.916770 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-77d19770-d72b-447b-9b45-3f0bc03ca6a0 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:22:59.058420 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-77d19770-d72b-447b-9b45-3f0bc03ca6a0 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:22:59.068179 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-77d19770-d72b-447b-9b45-3f0bc03ca6a0 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/f4acd3e4-bb81-43c5-8636-5259a9331844" status: 200 len: 1186 microversion: 2.1 time: 0.166113 Oct 04 22:22:59.069140 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3153/6103] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:22:58 2022] GET /compute/v2.1/servers/f4acd3e4-bb81-43c5-8636-5259a9331844 => generated 1186 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:22:59.491364 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-58d42195-dbf4-49ac-872f-0bdb0a6c0854 tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:22:59.492825 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-58d42195-dbf4-49ac-872f-0bdb0a6c0854 tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] [instance: 3b0c98dd-e4fa-410c-9dd2-01a61db2ddd9] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:22:59.499897 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-58d42195-dbf4-49ac-872f-0bdb0a6c0854 tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:22:59.500725 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-58d42195-dbf4-49ac-872f-0bdb0a6c0854 tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:22:59.501416 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-58d42195-dbf4-49ac-872f-0bdb0a6c0854 tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:22:59.502656 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-58d42195-dbf4-49ac-872f-0bdb0a6c0854 tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:22:59.503327 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-58d42195-dbf4-49ac-872f-0bdb0a6c0854 tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:22:59.504124 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-58d42195-dbf4-49ac-872f-0bdb0a6c0854 tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:22:59.750832 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-58d42195-dbf4-49ac-872f-0bdb0a6c0854 tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b3239728640108aad384d11d251e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c2c7b1d34e4b31bca19ab9ea59b80e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:22:59.764313 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-58d42195-dbf4-49ac-872f-0bdb0a6c0854 tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] 10.222.0.43 "GET /compute/v2.1/servers/3b0c98dd-e4fa-410c-9dd2-01a61db2ddd9" status: 200 len: 1428 microversion: 2.1 time: 0.274610 Oct 04 22:22:59.764667 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3154/6104] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:22:59 2022] GET /compute/v2.1/servers/3b0c98dd-e4fa-410c-9dd2-01a61db2ddd9 => generated 1428 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:22:59.927405 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-9bdfd2e5-9cc6-4314-b0dd-b05d738e231e tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:22:59.927968 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-9bdfd2e5-9cc6-4314-b0dd-b05d738e231e tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] [instance: c598f920-d90a-424a-ae96-8ef237f5d234] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:22:59.945056 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9bdfd2e5-9cc6-4314-b0dd-b05d738e231e tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:22:59.945568 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9bdfd2e5-9cc6-4314-b0dd-b05d738e231e tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:22:59.946009 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9bdfd2e5-9cc6-4314-b0dd-b05d738e231e tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:22:59.946763 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9bdfd2e5-9cc6-4314-b0dd-b05d738e231e tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:22:59.947226 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9bdfd2e5-9cc6-4314-b0dd-b05d738e231e tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:22:59.947670 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9bdfd2e5-9cc6-4314-b0dd-b05d738e231e tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:00.269006 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-9bdfd2e5-9cc6-4314-b0dd-b05d738e231e tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '524ac46437134cd5a5000574631ea59a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b191bd428a4906b6c2781ae3efdaae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:00.279517 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-9bdfd2e5-9cc6-4314-b0dd-b05d738e231e tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] 10.222.0.43 "GET /compute/v2.1/servers/c598f920-d90a-424a-ae96-8ef237f5d234" status: 200 len: 1363 microversion: 2.1 time: 0.356147 Oct 04 22:23:00.280449 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3155/6105] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:22:59 2022] GET /compute/v2.1/servers/c598f920-d90a-424a-ae96-8ef237f5d234 => generated 1363 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:23:00.286724 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-dc60afb6-0aae-4335-9cd5-2b93eb4db96d tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:23:00.287603 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-dc60afb6-0aae-4335-9cd5-2b93eb4db96d tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: f4acd3e4-bb81-43c5-8636-5259a9331844] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:23:00.298021 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dc60afb6-0aae-4335-9cd5-2b93eb4db96d tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:00.298881 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dc60afb6-0aae-4335-9cd5-2b93eb4db96d tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:00.299558 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dc60afb6-0aae-4335-9cd5-2b93eb4db96d tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:00.300344 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dc60afb6-0aae-4335-9cd5-2b93eb4db96d tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:00.300825 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dc60afb6-0aae-4335-9cd5-2b93eb4db96d tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:00.301269 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dc60afb6-0aae-4335-9cd5-2b93eb4db96d tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:00.686208 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-dc60afb6-0aae-4335-9cd5-2b93eb4db96d tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:00.696516 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-dc60afb6-0aae-4335-9cd5-2b93eb4db96d tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/f4acd3e4-bb81-43c5-8636-5259a9331844" status: 200 len: 1228 microversion: 2.1 time: 0.414844 Oct 04 22:23:00.723251 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3156/6106] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:23:00 2022] GET /compute/v2.1/servers/f4acd3e4-bb81-43c5-8636-5259a9331844 => generated 1228 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:23:00.739903 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-3072babf-8664-4f32-824f-e5e577bd03b2 req-2ab4d59b-052b-4265-902b-55e2f2144764 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b0c98dd-e4fa-410c-9dd2-01a61db2ddd9", "name": "network-vif-plugged", "status": "completed", "tag": "c8748d3d-2efd-4332-a388-3d6d1fbf3ef1"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:23:00.746275 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:INSERT=8,nova_api:SELECT=90,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:23:00.750278 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-3072babf-8664-4f32-824f-e5e577bd03b2 req-2ab4d59b-052b-4265-902b-55e2f2144764 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:00.759058 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-3072babf-8664-4f32-824f-e5e577bd03b2 req-2ab4d59b-052b-4265-902b-55e2f2144764 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:00.759502 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-3072babf-8664-4f32-824f-e5e577bd03b2 req-2ab4d59b-052b-4265-902b-55e2f2144764 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:00.788702 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-3072babf-8664-4f32-824f-e5e577bd03b2 req-2ab4d59b-052b-4265-902b-55e2f2144764 service nova] Creating event network-vif-plugged:c8748d3d-2efd-4332-a388-3d6d1fbf3ef1 for instance 3b0c98dd-e4fa-410c-9dd2-01a61db2ddd9 on n-h2-860284-1 Oct 04 22:23:00.802333 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-3072babf-8664-4f32-824f-e5e577bd03b2 req-2ab4d59b-052b-4265-902b-55e2f2144764 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081554 Oct 04 22:23:00.803346 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3157/6107] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:23:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:23:00.817201 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-7aaee449-edbb-4e12-8b34-dec2f24f3f8a tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:23:00.818085 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-7aaee449-edbb-4e12-8b34-dec2f24f3f8a tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] [instance: 3b0c98dd-e4fa-410c-9dd2-01a61db2ddd9] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:23:00.833978 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7aaee449-edbb-4e12-8b34-dec2f24f3f8a tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:00.834585 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7aaee449-edbb-4e12-8b34-dec2f24f3f8a tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:00.835503 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7aaee449-edbb-4e12-8b34-dec2f24f3f8a tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:00.836037 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7aaee449-edbb-4e12-8b34-dec2f24f3f8a tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:00.836037 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7aaee449-edbb-4e12-8b34-dec2f24f3f8a tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:00.836764 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7aaee449-edbb-4e12-8b34-dec2f24f3f8a tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:01.039691 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-7aaee449-edbb-4e12-8b34-dec2f24f3f8a tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b3239728640108aad384d11d251e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c2c7b1d34e4b31bca19ab9ea59b80e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:01.050386 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-7aaee449-edbb-4e12-8b34-dec2f24f3f8a tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] 10.222.0.43 "GET /compute/v2.1/servers/3b0c98dd-e4fa-410c-9dd2-01a61db2ddd9" status: 200 len: 1428 microversion: 2.1 time: 0.246163 Oct 04 22:23:01.051332 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3158/6108] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:23:00 2022] GET /compute/v2.1/servers/3b0c98dd-e4fa-410c-9dd2-01a61db2ddd9 => generated 1428 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:23:01.306089 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-03f70f85-a30c-4a3e-bf35-b289359cd2fe tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:23:01.307042 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-03f70f85-a30c-4a3e-bf35-b289359cd2fe tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] [instance: c598f920-d90a-424a-ae96-8ef237f5d234] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:23:01.313462 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-03f70f85-a30c-4a3e-bf35-b289359cd2fe tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:01.319057 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-03f70f85-a30c-4a3e-bf35-b289359cd2fe tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:01.320007 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-03f70f85-a30c-4a3e-bf35-b289359cd2fe tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:01.320978 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-03f70f85-a30c-4a3e-bf35-b289359cd2fe tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:01.321657 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-03f70f85-a30c-4a3e-bf35-b289359cd2fe tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:01.322301 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-03f70f85-a30c-4a3e-bf35-b289359cd2fe tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:01.641926 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-03f70f85-a30c-4a3e-bf35-b289359cd2fe tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '524ac46437134cd5a5000574631ea59a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b191bd428a4906b6c2781ae3efdaae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:01.657325 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-03f70f85-a30c-4a3e-bf35-b289359cd2fe tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] 10.222.0.43 "GET /compute/v2.1/servers/c598f920-d90a-424a-ae96-8ef237f5d234" status: 200 len: 1363 microversion: 2.1 time: 0.355040 Oct 04 22:23:01.668033 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3159/6109] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:23:01 2022] GET /compute/v2.1/servers/c598f920-d90a-424a-ae96-8ef237f5d234 => generated 1363 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:23:01.680108 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-6ef2d6bf-6a9c-45ff-94fa-14a164c88ffe req-eb91fcd8-568b-4ee0-ac93-78e18d953a5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4acd3e4-bb81-43c5-8636-5259a9331844", "tag": "bc5dd01e-0eb1-49d8-b209-65c021fa084a"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:23:01.705869 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-6ef2d6bf-6a9c-45ff-94fa-14a164c88ffe req-eb91fcd8-568b-4ee0-ac93-78e18d953a5e service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:01.709214 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-6ef2d6bf-6a9c-45ff-94fa-14a164c88ffe req-eb91fcd8-568b-4ee0-ac93-78e18d953a5e service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:01.709805 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-6ef2d6bf-6a9c-45ff-94fa-14a164c88ffe req-eb91fcd8-568b-4ee0-ac93-78e18d953a5e service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:01.748051 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-6ef2d6bf-6a9c-45ff-94fa-14a164c88ffe req-eb91fcd8-568b-4ee0-ac93-78e18d953a5e service nova] Creating event network-changed:bc5dd01e-0eb1-49d8-b209-65c021fa084a for instance f4acd3e4-bb81-43c5-8636-5259a9331844 on n-h2-860284-1 Oct 04 22:23:01.758618 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-6ef2d6bf-6a9c-45ff-94fa-14a164c88ffe req-eb91fcd8-568b-4ee0-ac93-78e18d953a5e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087612 Oct 04 22:23:01.759766 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3160/6110] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:23:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:23:01.774403 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-0c8435eb-d362-4e66-8ac3-cebc9bbf7b55 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:23:01.775444 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-0c8435eb-d362-4e66-8ac3-cebc9bbf7b55 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: f4acd3e4-bb81-43c5-8636-5259a9331844] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:23:01.782520 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0c8435eb-d362-4e66-8ac3-cebc9bbf7b55 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:01.784038 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0c8435eb-d362-4e66-8ac3-cebc9bbf7b55 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:01.784725 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0c8435eb-d362-4e66-8ac3-cebc9bbf7b55 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:01.786115 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0c8435eb-d362-4e66-8ac3-cebc9bbf7b55 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:01.786834 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0c8435eb-d362-4e66-8ac3-cebc9bbf7b55 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:01.787786 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0c8435eb-d362-4e66-8ac3-cebc9bbf7b55 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:02.044250 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-0c8435eb-d362-4e66-8ac3-cebc9bbf7b55 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:02.055069 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-0c8435eb-d362-4e66-8ac3-cebc9bbf7b55 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/f4acd3e4-bb81-43c5-8636-5259a9331844" status: 200 len: 1228 microversion: 2.1 time: 0.286149 Oct 04 22:23:02.057018 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3161/6111] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:23:01 2022] GET /compute/v2.1/servers/f4acd3e4-bb81-43c5-8636-5259a9331844 => generated 1228 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:23:02.077672 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-1dfece6c-c03f-486e-9eeb-1eed66f6931b tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:23:02.078103 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-1dfece6c-c03f-486e-9eeb-1eed66f6931b tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] [instance: 3b0c98dd-e4fa-410c-9dd2-01a61db2ddd9] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:23:02.086232 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1dfece6c-c03f-486e-9eeb-1eed66f6931b tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:02.086770 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1dfece6c-c03f-486e-9eeb-1eed66f6931b tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:02.087290 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1dfece6c-c03f-486e-9eeb-1eed66f6931b tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:02.088261 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1dfece6c-c03f-486e-9eeb-1eed66f6931b tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:02.088894 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1dfece6c-c03f-486e-9eeb-1eed66f6931b tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:02.089486 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1dfece6c-c03f-486e-9eeb-1eed66f6931b tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:02.365446 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-1dfece6c-c03f-486e-9eeb-1eed66f6931b tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b3239728640108aad384d11d251e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c2c7b1d34e4b31bca19ab9ea59b80e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:02.374459 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-1dfece6c-c03f-486e-9eeb-1eed66f6931b tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] 10.222.0.43 "GET /compute/v2.1/servers/3b0c98dd-e4fa-410c-9dd2-01a61db2ddd9" status: 200 len: 1428 microversion: 2.1 time: 0.300882 Oct 04 22:23:02.375410 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3162/6112] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:23:02 2022] GET /compute/v2.1/servers/3b0c98dd-e4fa-410c-9dd2-01a61db2ddd9 => generated 1428 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:23:02.695095 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-1b49649a-d0d9-4cd3-aa59-b45393a90258 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:23:02.695986 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-1b49649a-d0d9-4cd3-aa59-b45393a90258 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] [instance: c598f920-d90a-424a-ae96-8ef237f5d234] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:23:02.712572 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1b49649a-d0d9-4cd3-aa59-b45393a90258 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:02.713800 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1b49649a-d0d9-4cd3-aa59-b45393a90258 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:02.714670 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1b49649a-d0d9-4cd3-aa59-b45393a90258 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:02.719099 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1b49649a-d0d9-4cd3-aa59-b45393a90258 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:02.720009 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1b49649a-d0d9-4cd3-aa59-b45393a90258 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:02.722903 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1b49649a-d0d9-4cd3-aa59-b45393a90258 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:03.026686 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-1b49649a-d0d9-4cd3-aa59-b45393a90258 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '524ac46437134cd5a5000574631ea59a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b191bd428a4906b6c2781ae3efdaae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:03.040246 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-1b49649a-d0d9-4cd3-aa59-b45393a90258 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] 10.222.0.43 "GET /compute/v2.1/servers/c598f920-d90a-424a-ae96-8ef237f5d234" status: 200 len: 1363 microversion: 2.1 time: 0.349032 Oct 04 22:23:03.051216 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3163/6113] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:23:02 2022] GET /compute/v2.1/servers/c598f920-d90a-424a-ae96-8ef237f5d234 => generated 1363 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:23:03.088573 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-da1cddca-5eae-4dad-a7a4-ce1e4e8d0ea8 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:23:03.089505 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-da1cddca-5eae-4dad-a7a4-ce1e4e8d0ea8 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: f4acd3e4-bb81-43c5-8636-5259a9331844] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:23:03.096357 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-da1cddca-5eae-4dad-a7a4-ce1e4e8d0ea8 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:03.097101 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-da1cddca-5eae-4dad-a7a4-ce1e4e8d0ea8 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:03.097641 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-da1cddca-5eae-4dad-a7a4-ce1e4e8d0ea8 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:03.098479 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-da1cddca-5eae-4dad-a7a4-ce1e4e8d0ea8 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:03.099116 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-da1cddca-5eae-4dad-a7a4-ce1e4e8d0ea8 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:03.099868 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-da1cddca-5eae-4dad-a7a4-ce1e4e8d0ea8 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:03.125885 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=100 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:23:03.348789 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-da1cddca-5eae-4dad-a7a4-ce1e4e8d0ea8 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:03.363728 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-da1cddca-5eae-4dad-a7a4-ce1e4e8d0ea8 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/f4acd3e4-bb81-43c5-8636-5259a9331844" status: 200 len: 1228 microversion: 2.1 time: 0.287075 Oct 04 22:23:03.371731 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3164/6114] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:23:03 2022] GET /compute/v2.1/servers/f4acd3e4-bb81-43c5-8636-5259a9331844 => generated 1228 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:23:03.399149 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-a9739587-d64f-4fd2-ad70-375640f0b3b7 tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:23:03.399700 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-a9739587-d64f-4fd2-ad70-375640f0b3b7 tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] [instance: 3b0c98dd-e4fa-410c-9dd2-01a61db2ddd9] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:23:03.410502 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a9739587-d64f-4fd2-ad70-375640f0b3b7 tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:03.411313 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a9739587-d64f-4fd2-ad70-375640f0b3b7 tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:03.411908 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a9739587-d64f-4fd2-ad70-375640f0b3b7 tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:03.412431 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a9739587-d64f-4fd2-ad70-375640f0b3b7 tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:03.413987 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a9739587-d64f-4fd2-ad70-375640f0b3b7 tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:03.414782 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a9739587-d64f-4fd2-ad70-375640f0b3b7 tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:03.619609 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-a9739587-d64f-4fd2-ad70-375640f0b3b7 tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b3239728640108aad384d11d251e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c2c7b1d34e4b31bca19ab9ea59b80e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:03.633981 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-a9739587-d64f-4fd2-ad70-375640f0b3b7 tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] 10.222.0.43 "GET /compute/v2.1/servers/3b0c98dd-e4fa-410c-9dd2-01a61db2ddd9" status: 200 len: 1608 microversion: 2.1 time: 0.239551 Oct 04 22:23:03.634662 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3165/6115] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:23:03 2022] GET /compute/v2.1/servers/3b0c98dd-e4fa-410c-9dd2-01a61db2ddd9 => generated 1608 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:23:03.678642 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-d0a2cbb6-c2d0-4c5a-8b5e-2ecd90ab1775 tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:23:03.679271 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-d0a2cbb6-c2d0-4c5a-8b5e-2ecd90ab1775 tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] [instance: 3b0c98dd-e4fa-410c-9dd2-01a61db2ddd9] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:23:03.698844 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d0a2cbb6-c2d0-4c5a-8b5e-2ecd90ab1775 tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:03.699654 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d0a2cbb6-c2d0-4c5a-8b5e-2ecd90ab1775 tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:03.699770 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d0a2cbb6-c2d0-4c5a-8b5e-2ecd90ab1775 tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:03.700496 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d0a2cbb6-c2d0-4c5a-8b5e-2ecd90ab1775 tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:03.706869 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d0a2cbb6-c2d0-4c5a-8b5e-2ecd90ab1775 tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:03.708237 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d0a2cbb6-c2d0-4c5a-8b5e-2ecd90ab1775 tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:03.922767 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-d0a2cbb6-c2d0-4c5a-8b5e-2ecd90ab1775 tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b3239728640108aad384d11d251e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c2c7b1d34e4b31bca19ab9ea59b80e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:03.932757 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-d0a2cbb6-c2d0-4c5a-8b5e-2ecd90ab1775 tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] 10.222.0.43 "GET /compute/v2.1/servers/3b0c98dd-e4fa-410c-9dd2-01a61db2ddd9" status: 200 len: 1608 microversion: 2.1 time: 0.261235 Oct 04 22:23:03.933408 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3166/6116] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:23:03 2022] GET /compute/v2.1/servers/3b0c98dd-e4fa-410c-9dd2-01a61db2ddd9 => generated 1608 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:23:03.956684 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-95d192d5-043a-40f7-ad8b-9e6e63524266 tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:23:03.957690 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-95d192d5-043a-40f7-ad8b-9e6e63524266 tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] [instance: 3b0c98dd-e4fa-410c-9dd2-01a61db2ddd9] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:23:03.965077 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-95d192d5-043a-40f7-ad8b-9e6e63524266 tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:03.970567 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-95d192d5-043a-40f7-ad8b-9e6e63524266 tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:03.971628 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-95d192d5-043a-40f7-ad8b-9e6e63524266 tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:03.973864 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-95d192d5-043a-40f7-ad8b-9e6e63524266 tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:03.976310 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-95d192d5-043a-40f7-ad8b-9e6e63524266 tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:03.977039 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-95d192d5-043a-40f7-ad8b-9e6e63524266 tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:04.175095 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-95d192d5-043a-40f7-ad8b-9e6e63524266 tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b3239728640108aad384d11d251e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c2c7b1d34e4b31bca19ab9ea59b80e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:04.184398 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-95d192d5-043a-40f7-ad8b-9e6e63524266 tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] 10.222.0.43 "GET /compute/v2.1/servers/3b0c98dd-e4fa-410c-9dd2-01a61db2ddd9" status: 200 len: 1608 microversion: 2.1 time: 0.232332 Oct 04 22:23:04.199739 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3167/6117] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:23:03 2022] GET /compute/v2.1/servers/3b0c98dd-e4fa-410c-9dd2-01a61db2ddd9 => generated 1608 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:23:04.217352 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-bb65a6cb-971d-43c8-85dd-13867b71ddaa tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:23:04.218175 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-bb65a6cb-971d-43c8-85dd-13867b71ddaa tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] [instance: c598f920-d90a-424a-ae96-8ef237f5d234] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:23:04.225923 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bb65a6cb-971d-43c8-85dd-13867b71ddaa tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:04.226744 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bb65a6cb-971d-43c8-85dd-13867b71ddaa tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:04.227360 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bb65a6cb-971d-43c8-85dd-13867b71ddaa tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:04.228266 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bb65a6cb-971d-43c8-85dd-13867b71ddaa tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:04.228935 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bb65a6cb-971d-43c8-85dd-13867b71ddaa tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:04.229571 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bb65a6cb-971d-43c8-85dd-13867b71ddaa tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:04.480770 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-bb65a6cb-971d-43c8-85dd-13867b71ddaa tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '524ac46437134cd5a5000574631ea59a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b191bd428a4906b6c2781ae3efdaae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:04.491648 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-bb65a6cb-971d-43c8-85dd-13867b71ddaa tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] 10.222.0.43 "GET /compute/v2.1/servers/c598f920-d90a-424a-ae96-8ef237f5d234" status: 200 len: 1363 microversion: 2.1 time: 0.290716 Oct 04 22:23:04.492257 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3168/6118] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:23:04 2022] GET /compute/v2.1/servers/c598f920-d90a-424a-ae96-8ef237f5d234 => generated 1363 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:23:04.504113 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-9c725c6e-878d-442a-9971-b2a64e1a1dee tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:23:04.504736 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-9c725c6e-878d-442a-9971-b2a64e1a1dee tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: f4acd3e4-bb81-43c5-8636-5259a9331844] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:23:04.516123 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9c725c6e-878d-442a-9971-b2a64e1a1dee tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:04.520611 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9c725c6e-878d-442a-9971-b2a64e1a1dee tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:04.521077 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9c725c6e-878d-442a-9971-b2a64e1a1dee tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:04.521870 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9c725c6e-878d-442a-9971-b2a64e1a1dee tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:04.522333 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9c725c6e-878d-442a-9971-b2a64e1a1dee tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:04.522839 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9c725c6e-878d-442a-9971-b2a64e1a1dee tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:04.740883 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-9c725c6e-878d-442a-9971-b2a64e1a1dee tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:04.751315 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-9c725c6e-878d-442a-9971-b2a64e1a1dee tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/f4acd3e4-bb81-43c5-8636-5259a9331844" status: 200 len: 1228 microversion: 2.1 time: 0.254550 Oct 04 22:23:04.752482 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3169/6119] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:23:04 2022] GET /compute/v2.1/servers/f4acd3e4-bb81-43c5-8636-5259a9331844 => generated 1228 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:23:04.963968 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-4697475d-4d03-4f07-ab82-31a2206e1592 req-a7897f52-1d61-46f5-898b-06c9921b3bba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c598f920-d90a-424a-ae96-8ef237f5d234", "name": "network-vif-plugged", "status": "completed", "tag": "4a08fa07-1572-4ed8-a3d4-c446e944cc4c"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:23:04.974102 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-4697475d-4d03-4f07-ab82-31a2206e1592 req-a7897f52-1d61-46f5-898b-06c9921b3bba service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:04.999620 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-4697475d-4d03-4f07-ab82-31a2206e1592 req-a7897f52-1d61-46f5-898b-06c9921b3bba service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:05.000196 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-4697475d-4d03-4f07-ab82-31a2206e1592 req-a7897f52-1d61-46f5-898b-06c9921b3bba service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:05.058348 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-4697475d-4d03-4f07-ab82-31a2206e1592 req-a7897f52-1d61-46f5-898b-06c9921b3bba service nova] Creating event network-vif-plugged:4a08fa07-1572-4ed8-a3d4-c446e944cc4c for instance c598f920-d90a-424a-ae96-8ef237f5d234 on n-h1-860284-1 Oct 04 22:23:05.075974 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-4697475d-4d03-4f07-ab82-31a2206e1592 req-a7897f52-1d61-46f5-898b-06c9921b3bba service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116146 Oct 04 22:23:05.096048 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3170/6120] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:23:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:23:05.520001 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-8104ed50-7c00-4044-b026-b397e4bdfd4a tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:23:05.521020 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-8104ed50-7c00-4044-b026-b397e4bdfd4a tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] [instance: c598f920-d90a-424a-ae96-8ef237f5d234] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:23:05.538483 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8104ed50-7c00-4044-b026-b397e4bdfd4a tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:05.539250 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8104ed50-7c00-4044-b026-b397e4bdfd4a tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:05.539875 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8104ed50-7c00-4044-b026-b397e4bdfd4a tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:05.540775 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8104ed50-7c00-4044-b026-b397e4bdfd4a tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:05.541434 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8104ed50-7c00-4044-b026-b397e4bdfd4a tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:05.542045 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8104ed50-7c00-4044-b026-b397e4bdfd4a tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:05.708814 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=6 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:23:05.760755 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=32 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:23:05.869168 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-8104ed50-7c00-4044-b026-b397e4bdfd4a tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '524ac46437134cd5a5000574631ea59a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b191bd428a4906b6c2781ae3efdaae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:05.893431 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-8104ed50-7c00-4044-b026-b397e4bdfd4a tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] 10.222.0.43 "GET /compute/v2.1/servers/c598f920-d90a-424a-ae96-8ef237f5d234" status: 200 len: 1363 microversion: 2.1 time: 0.377011 Oct 04 22:23:05.897251 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3171/6121] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:23:05 2022] GET /compute/v2.1/servers/c598f920-d90a-424a-ae96-8ef237f5d234 => generated 1363 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:23:05.910305 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-3d9e8359-eb6d-49cf-8000-49e2fbb22db4 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:23:05.911526 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-3d9e8359-eb6d-49cf-8000-49e2fbb22db4 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: f4acd3e4-bb81-43c5-8636-5259a9331844] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:23:05.920030 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3d9e8359-eb6d-49cf-8000-49e2fbb22db4 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:05.920713 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3d9e8359-eb6d-49cf-8000-49e2fbb22db4 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:05.921476 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3d9e8359-eb6d-49cf-8000-49e2fbb22db4 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:05.922349 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3d9e8359-eb6d-49cf-8000-49e2fbb22db4 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:05.925326 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3d9e8359-eb6d-49cf-8000-49e2fbb22db4 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:05.925326 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3d9e8359-eb6d-49cf-8000-49e2fbb22db4 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:06.209936 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-3d9e8359-eb6d-49cf-8000-49e2fbb22db4 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:06.219783 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-3d9e8359-eb6d-49cf-8000-49e2fbb22db4 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/f4acd3e4-bb81-43c5-8636-5259a9331844" status: 200 len: 1228 microversion: 2.1 time: 0.316401 Oct 04 22:23:06.221640 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3172/6122] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:23:05 2022] GET /compute/v2.1/servers/f4acd3e4-bb81-43c5-8636-5259a9331844 => generated 1228 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:23:06.923025 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-4191f33e-fd36-4df1-b626-f9d7493b731c tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:23:06.924955 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-4191f33e-fd36-4df1-b626-f9d7493b731c tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] [instance: c598f920-d90a-424a-ae96-8ef237f5d234] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:23:06.931382 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4191f33e-fd36-4df1-b626-f9d7493b731c tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:06.931973 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4191f33e-fd36-4df1-b626-f9d7493b731c tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:06.932493 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4191f33e-fd36-4df1-b626-f9d7493b731c tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:06.933433 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4191f33e-fd36-4df1-b626-f9d7493b731c tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:06.933971 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4191f33e-fd36-4df1-b626-f9d7493b731c tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:06.934566 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4191f33e-fd36-4df1-b626-f9d7493b731c tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:07.172117 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-4191f33e-fd36-4df1-b626-f9d7493b731c tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '524ac46437134cd5a5000574631ea59a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b191bd428a4906b6c2781ae3efdaae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:07.195797 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-4191f33e-fd36-4df1-b626-f9d7493b731c tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] 10.222.0.43 "GET /compute/v2.1/servers/c598f920-d90a-424a-ae96-8ef237f5d234" status: 200 len: 1363 microversion: 2.1 time: 0.276509 Oct 04 22:23:07.197489 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3173/6123] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:23:06 2022] GET /compute/v2.1/servers/c598f920-d90a-424a-ae96-8ef237f5d234 => generated 1363 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:23:07.244943 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-f03cd075-16c7-4b22-a3eb-7d30ec0309d6 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:23:07.245775 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-f03cd075-16c7-4b22-a3eb-7d30ec0309d6 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: f4acd3e4-bb81-43c5-8636-5259a9331844] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:23:07.259099 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f03cd075-16c7-4b22-a3eb-7d30ec0309d6 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:07.259099 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f03cd075-16c7-4b22-a3eb-7d30ec0309d6 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:07.259099 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f03cd075-16c7-4b22-a3eb-7d30ec0309d6 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:07.259099 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f03cd075-16c7-4b22-a3eb-7d30ec0309d6 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:07.259099 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f03cd075-16c7-4b22-a3eb-7d30ec0309d6 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:07.259099 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f03cd075-16c7-4b22-a3eb-7d30ec0309d6 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:07.445516 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-f03cd075-16c7-4b22-a3eb-7d30ec0309d6 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:07.458301 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-f03cd075-16c7-4b22-a3eb-7d30ec0309d6 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/f4acd3e4-bb81-43c5-8636-5259a9331844" status: 200 len: 1216 microversion: 2.1 time: 0.217979 Oct 04 22:23:07.459572 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3174/6124] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:23:07 2022] GET /compute/v2.1/servers/f4acd3e4-bb81-43c5-8636-5259a9331844 => generated 1216 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:23:07.467141 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-58314bc7-0f9d-4121-b41f-66e3a8230512 req-e74a43eb-778f-4436-a3ef-bec2bc4bc653 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b0c98dd-e4fa-410c-9dd2-01a61db2ddd9", "tag": "c8748d3d-2efd-4332-a388-3d6d1fbf3ef1"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:23:07.478194 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-58314bc7-0f9d-4121-b41f-66e3a8230512 req-e74a43eb-778f-4436-a3ef-bec2bc4bc653 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:07.478713 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-58314bc7-0f9d-4121-b41f-66e3a8230512 req-e74a43eb-778f-4436-a3ef-bec2bc4bc653 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:07.479293 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-58314bc7-0f9d-4121-b41f-66e3a8230512 req-e74a43eb-778f-4436-a3ef-bec2bc4bc653 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:07.504449 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-58314bc7-0f9d-4121-b41f-66e3a8230512 req-e74a43eb-778f-4436-a3ef-bec2bc4bc653 service nova] Creating event network-changed:c8748d3d-2efd-4332-a388-3d6d1fbf3ef1 for instance 3b0c98dd-e4fa-410c-9dd2-01a61db2ddd9 on n-h2-860284-1 Oct 04 22:23:07.523648 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-58314bc7-0f9d-4121-b41f-66e3a8230512 req-e74a43eb-778f-4436-a3ef-bec2bc4bc653 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059577 Oct 04 22:23:07.527517 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3175/6125] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:23:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:23:08.222002 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-26eccde1-8776-4a4a-8cb0-a6d30108cff0 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:23:08.222955 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-26eccde1-8776-4a4a-8cb0-a6d30108cff0 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] [instance: c598f920-d90a-424a-ae96-8ef237f5d234] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:23:08.232943 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-26eccde1-8776-4a4a-8cb0-a6d30108cff0 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:08.238590 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-26eccde1-8776-4a4a-8cb0-a6d30108cff0 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:08.244056 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-26eccde1-8776-4a4a-8cb0-a6d30108cff0 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:08.244947 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-26eccde1-8776-4a4a-8cb0-a6d30108cff0 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:08.245482 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-26eccde1-8776-4a4a-8cb0-a6d30108cff0 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:08.246915 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-26eccde1-8776-4a4a-8cb0-a6d30108cff0 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:08.468850 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-26eccde1-8776-4a4a-8cb0-a6d30108cff0 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '524ac46437134cd5a5000574631ea59a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b191bd428a4906b6c2781ae3efdaae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:08.485282 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-26eccde1-8776-4a4a-8cb0-a6d30108cff0 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] 10.222.0.43 "GET /compute/v2.1/servers/c598f920-d90a-424a-ae96-8ef237f5d234" status: 200 len: 1550 microversion: 2.1 time: 0.269104 Oct 04 22:23:08.487964 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3176/6126] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:23:08 2022] GET /compute/v2.1/servers/c598f920-d90a-424a-ae96-8ef237f5d234 => generated 1550 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:23:08.493204 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-317a5d52-249d-4101-bd3e-df71ff2d1c03 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:23:08.494091 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-317a5d52-249d-4101-bd3e-df71ff2d1c03 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: f4acd3e4-bb81-43c5-8636-5259a9331844] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:23:08.502249 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-317a5d52-249d-4101-bd3e-df71ff2d1c03 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:08.503308 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-317a5d52-249d-4101-bd3e-df71ff2d1c03 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:08.503974 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-317a5d52-249d-4101-bd3e-df71ff2d1c03 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:08.505473 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-317a5d52-249d-4101-bd3e-df71ff2d1c03 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:08.506875 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-317a5d52-249d-4101-bd3e-df71ff2d1c03 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:08.507486 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-317a5d52-249d-4101-bd3e-df71ff2d1c03 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:08.710934 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-317a5d52-249d-4101-bd3e-df71ff2d1c03 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:08.719451 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-317a5d52-249d-4101-bd3e-df71ff2d1c03 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/f4acd3e4-bb81-43c5-8636-5259a9331844" status: 200 len: 1216 microversion: 2.1 time: 0.230030 Oct 04 22:23:08.730945 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3177/6127] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:23:08 2022] GET /compute/v2.1/servers/f4acd3e4-bb81-43c5-8636-5259a9331844 => generated 1216 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:23:08.743039 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-b09dfc97-7694-4c0e-8956-7c1cff902061 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:23:08.743767 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-b09dfc97-7694-4c0e-8956-7c1cff902061 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] [instance: c598f920-d90a-424a-ae96-8ef237f5d234] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:23:08.749977 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b09dfc97-7694-4c0e-8956-7c1cff902061 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:08.750697 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b09dfc97-7694-4c0e-8956-7c1cff902061 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:08.763822 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b09dfc97-7694-4c0e-8956-7c1cff902061 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:08.765181 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b09dfc97-7694-4c0e-8956-7c1cff902061 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:08.765835 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b09dfc97-7694-4c0e-8956-7c1cff902061 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:08.766512 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b09dfc97-7694-4c0e-8956-7c1cff902061 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:08.868988 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-b09dfc97-7694-4c0e-8956-7c1cff902061 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] 10.222.0.43 "GET /compute/v2.1/servers/c598f920-d90a-424a-ae96-8ef237f5d234/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.136642 Oct 04 22:23:08.869597 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3178/6128] 10.222.0.43 () {58 vars in 1275 bytes} [Tue Oct 4 22:23:08 2022] GET /compute/v2.1/servers/c598f920-d90a-424a-ae96-8ef237f5d234/os-interface => generated 285 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:23:09.746388 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-11aa08b8-f755-4dc4-aebd-b1f47e280f8d tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:23:09.748875 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-11aa08b8-f755-4dc4-aebd-b1f47e280f8d tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: f4acd3e4-bb81-43c5-8636-5259a9331844] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:23:09.755454 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-11aa08b8-f755-4dc4-aebd-b1f47e280f8d tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:09.755948 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-11aa08b8-f755-4dc4-aebd-b1f47e280f8d tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:09.756380 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-11aa08b8-f755-4dc4-aebd-b1f47e280f8d tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:09.757485 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-11aa08b8-f755-4dc4-aebd-b1f47e280f8d tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:09.758865 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-11aa08b8-f755-4dc4-aebd-b1f47e280f8d tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:09.759459 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-11aa08b8-f755-4dc4-aebd-b1f47e280f8d tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:09.975500 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-11aa08b8-f755-4dc4-aebd-b1f47e280f8d tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:09.983572 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-11aa08b8-f755-4dc4-aebd-b1f47e280f8d tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/f4acd3e4-bb81-43c5-8636-5259a9331844" status: 200 len: 1216 microversion: 2.1 time: 0.241966 Oct 04 22:23:09.997821 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3179/6129] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:23:09 2022] GET /compute/v2.1/servers/f4acd3e4-bb81-43c5-8636-5259a9331844 => generated 1216 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:23:10.003845 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-a0685da8-3888-4ae5-956f-5f0c2f07619f req-f3e0a713-66cd-4235-bb84-ed04bcf903a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c598f920-d90a-424a-ae96-8ef237f5d234", "tag": "4a08fa07-1572-4ed8-a3d4-c446e944cc4c"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:23:10.013561 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-a0685da8-3888-4ae5-956f-5f0c2f07619f req-f3e0a713-66cd-4235-bb84-ed04bcf903a0 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:10.014049 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-a0685da8-3888-4ae5-956f-5f0c2f07619f req-f3e0a713-66cd-4235-bb84-ed04bcf903a0 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:10.014531 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-a0685da8-3888-4ae5-956f-5f0c2f07619f req-f3e0a713-66cd-4235-bb84-ed04bcf903a0 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:10.029763 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-a0685da8-3888-4ae5-956f-5f0c2f07619f req-f3e0a713-66cd-4235-bb84-ed04bcf903a0 service nova] Creating event network-changed:4a08fa07-1572-4ed8-a3d4-c446e944cc4c for instance c598f920-d90a-424a-ae96-8ef237f5d234 on n-h1-860284-1 Oct 04 22:23:10.036846 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-a0685da8-3888-4ae5-956f-5f0c2f07619f req-f3e0a713-66cd-4235-bb84-ed04bcf903a0 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035798 Oct 04 22:23:10.037839 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3180/6130] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:23:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:23:10.711406 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-65c7840f-7771-427c-8c20-230ae0f94356 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:23:10.712056 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-65c7840f-7771-427c-8c20-230ae0f94356 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] [instance: 95a3ffcc-fc4e-4351-9d57-b8c065aa179c] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:23:10.719456 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-65c7840f-7771-427c-8c20-230ae0f94356 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:10.721011 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-65c7840f-7771-427c-8c20-230ae0f94356 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:10.721674 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-65c7840f-7771-427c-8c20-230ae0f94356 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:10.722550 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-65c7840f-7771-427c-8c20-230ae0f94356 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:10.723089 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-65c7840f-7771-427c-8c20-230ae0f94356 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:10.723671 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-65c7840f-7771-427c-8c20-230ae0f94356 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:10.756778 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-65c7840f-7771-427c-8c20-230ae0f94356 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] [instance: 95a3ffcc-fc4e-4351-9d57-b8c065aa179c] Going to try to terminate instance {{(pid=134101) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 22:23:10.825707 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:23:10.871940 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-65c7840f-7771-427c-8c20-230ae0f94356 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] 10.222.0.43 "DELETE /compute/v2.1/servers/95a3ffcc-fc4e-4351-9d57-b8c065aa179c" status: 204 len: 0 microversion: 2.1 time: 0.168268 Oct 04 22:23:10.874030 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3181/6131] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 22:23:10 2022] DELETE /compute/v2.1/servers/95a3ffcc-fc4e-4351-9d57-b8c065aa179c => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 22:23:10.883999 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-74c475af-5601-4772-8d26-59ba9414379c tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:23:10.884733 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-74c475af-5601-4772-8d26-59ba9414379c tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] [instance: 95a3ffcc-fc4e-4351-9d57-b8c065aa179c] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:23:10.891353 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-74c475af-5601-4772-8d26-59ba9414379c tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:10.892569 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-74c475af-5601-4772-8d26-59ba9414379c tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:10.893038 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-74c475af-5601-4772-8d26-59ba9414379c tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:10.893895 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-74c475af-5601-4772-8d26-59ba9414379c tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:10.894651 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-74c475af-5601-4772-8d26-59ba9414379c tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:10.895247 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-74c475af-5601-4772-8d26-59ba9414379c tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:11.043537 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-74c475af-5601-4772-8d26-59ba9414379c tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6cfeabf8d84b2893200c3c54c1c19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be71413506154420869fdff5939fb940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:11.053237 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-74c475af-5601-4772-8d26-59ba9414379c tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] 10.222.0.43 "GET /compute/v2.1/servers/95a3ffcc-fc4e-4351-9d57-b8c065aa179c" status: 200 len: 1508 microversion: 2.1 time: 0.173953 Oct 04 22:23:11.054236 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3182/6132] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:23:10 2022] GET /compute/v2.1/servers/95a3ffcc-fc4e-4351-9d57-b8c065aa179c => generated 1508 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:23:11.058712 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-6bfa8db3-b2ea-4ad0-b1bb-8ab110ee7546 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:23:11.059330 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-6bfa8db3-b2ea-4ad0-b1bb-8ab110ee7546 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: f4acd3e4-bb81-43c5-8636-5259a9331844] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:23:11.066627 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6bfa8db3-b2ea-4ad0-b1bb-8ab110ee7546 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:11.067126 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6bfa8db3-b2ea-4ad0-b1bb-8ab110ee7546 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:11.067575 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6bfa8db3-b2ea-4ad0-b1bb-8ab110ee7546 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:11.068292 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6bfa8db3-b2ea-4ad0-b1bb-8ab110ee7546 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:11.068755 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6bfa8db3-b2ea-4ad0-b1bb-8ab110ee7546 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:11.069189 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6bfa8db3-b2ea-4ad0-b1bb-8ab110ee7546 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:11.254991 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-6bfa8db3-b2ea-4ad0-b1bb-8ab110ee7546 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:11.264121 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-6bfa8db3-b2ea-4ad0-b1bb-8ab110ee7546 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/f4acd3e4-bb81-43c5-8636-5259a9331844" status: 200 len: 1216 microversion: 2.1 time: 0.209327 Oct 04 22:23:11.265369 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3183/6133] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:23:11 2022] GET /compute/v2.1/servers/f4acd3e4-bb81-43c5-8636-5259a9331844 => generated 1216 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:23:12.078285 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-7857ec2a-62de-4730-a351-98d913ff5cfc tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:23:12.078954 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-7857ec2a-62de-4730-a351-98d913ff5cfc tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] [instance: 95a3ffcc-fc4e-4351-9d57-b8c065aa179c] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:23:12.086330 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7857ec2a-62de-4730-a351-98d913ff5cfc tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:12.086857 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7857ec2a-62de-4730-a351-98d913ff5cfc tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:12.087282 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7857ec2a-62de-4730-a351-98d913ff5cfc tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:12.087978 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7857ec2a-62de-4730-a351-98d913ff5cfc tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:12.088433 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7857ec2a-62de-4730-a351-98d913ff5cfc tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:12.088857 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7857ec2a-62de-4730-a351-98d913ff5cfc tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:12.234690 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-7857ec2a-62de-4730-a351-98d913ff5cfc tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6cfeabf8d84b2893200c3c54c1c19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be71413506154420869fdff5939fb940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:12.244009 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-7857ec2a-62de-4730-a351-98d913ff5cfc tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] 10.222.0.43 "GET /compute/v2.1/servers/95a3ffcc-fc4e-4351-9d57-b8c065aa179c" status: 200 len: 1508 microversion: 2.1 time: 0.169485 Oct 04 22:23:12.244606 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3184/6134] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:23:12 2022] GET /compute/v2.1/servers/95a3ffcc-fc4e-4351-9d57-b8c065aa179c => generated 1508 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:23:12.289197 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-df709651-683d-411a-917c-95857857075a tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:23:12.289820 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-df709651-683d-411a-917c-95857857075a tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: f4acd3e4-bb81-43c5-8636-5259a9331844] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:23:12.296031 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-df709651-683d-411a-917c-95857857075a tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:12.296527 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-df709651-683d-411a-917c-95857857075a tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:12.297004 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-df709651-683d-411a-917c-95857857075a tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:12.297717 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-df709651-683d-411a-917c-95857857075a tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:12.298903 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-df709651-683d-411a-917c-95857857075a tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:12.299387 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-df709651-683d-411a-917c-95857857075a tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:12.442534 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-df709651-683d-411a-917c-95857857075a tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:12.451033 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-df709651-683d-411a-917c-95857857075a tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/f4acd3e4-bb81-43c5-8636-5259a9331844" status: 200 len: 1216 microversion: 2.1 time: 0.166067 Oct 04 22:23:12.466862 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3185/6135] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:23:12 2022] GET /compute/v2.1/servers/f4acd3e4-bb81-43c5-8636-5259a9331844 => generated 1216 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:23:13.267395 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-1134dac0-10ec-44d0-b41e-e7355655a5b7 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:23:13.268422 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-1134dac0-10ec-44d0-b41e-e7355655a5b7 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] [instance: 95a3ffcc-fc4e-4351-9d57-b8c065aa179c] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:23:13.295273 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1134dac0-10ec-44d0-b41e-e7355655a5b7 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:13.295895 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1134dac0-10ec-44d0-b41e-e7355655a5b7 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:13.296557 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1134dac0-10ec-44d0-b41e-e7355655a5b7 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:13.297413 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1134dac0-10ec-44d0-b41e-e7355655a5b7 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:13.297887 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1134dac0-10ec-44d0-b41e-e7355655a5b7 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:13.299087 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1134dac0-10ec-44d0-b41e-e7355655a5b7 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:13.505717 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-1134dac0-10ec-44d0-b41e-e7355655a5b7 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6cfeabf8d84b2893200c3c54c1c19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be71413506154420869fdff5939fb940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:13.514067 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-1134dac0-10ec-44d0-b41e-e7355655a5b7 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] 10.222.0.43 "GET /compute/v2.1/servers/95a3ffcc-fc4e-4351-9d57-b8c065aa179c" status: 200 len: 1466 microversion: 2.1 time: 0.251318 Oct 04 22:23:13.520868 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3186/6136] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:23:13 2022] GET /compute/v2.1/servers/95a3ffcc-fc4e-4351-9d57-b8c065aa179c => generated 1466 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:23:13.526086 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e4db295f-179d-4b03-bad8-297cd238f0a5 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:23:13.530139 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-e4db295f-179d-4b03-bad8-297cd238f0a5 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: f4acd3e4-bb81-43c5-8636-5259a9331844] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:23:13.543522 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e4db295f-179d-4b03-bad8-297cd238f0a5 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:13.551697 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e4db295f-179d-4b03-bad8-297cd238f0a5 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:13.552542 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e4db295f-179d-4b03-bad8-297cd238f0a5 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:13.553490 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e4db295f-179d-4b03-bad8-297cd238f0a5 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:13.554112 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e4db295f-179d-4b03-bad8-297cd238f0a5 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:13.554749 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e4db295f-179d-4b03-bad8-297cd238f0a5 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:14.456150 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-e4db295f-179d-4b03-bad8-297cd238f0a5 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:14.465423 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-e4db295f-179d-4b03-bad8-297cd238f0a5 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/f4acd3e4-bb81-43c5-8636-5259a9331844" status: 200 len: 1216 microversion: 2.1 time: 0.943306 Oct 04 22:23:14.466548 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3187/6137] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:23:13 2022] GET /compute/v2.1/servers/f4acd3e4-bb81-43c5-8636-5259a9331844 => generated 1216 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:23:14.471723 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-7fe8b6ad-dc5c-4981-8ddc-1ec2d9a27696 req-40ee75dd-ce7d-4d1f-9b22-31a242bf9b83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95a3ffcc-fc4e-4351-9d57-b8c065aa179c", "name": "network-vif-deleted", "tag": "c5f7322f-32c1-4023-8ab9-49d925d5f631"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:23:14.482612 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-7fe8b6ad-dc5c-4981-8ddc-1ec2d9a27696 req-40ee75dd-ce7d-4d1f-9b22-31a242bf9b83 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:14.483180 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-7fe8b6ad-dc5c-4981-8ddc-1ec2d9a27696 req-40ee75dd-ce7d-4d1f-9b22-31a242bf9b83 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:14.484195 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-7fe8b6ad-dc5c-4981-8ddc-1ec2d9a27696 req-40ee75dd-ce7d-4d1f-9b22-31a242bf9b83 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:14.496706 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-7fe8b6ad-dc5c-4981-8ddc-1ec2d9a27696 req-40ee75dd-ce7d-4d1f-9b22-31a242bf9b83 service nova] Creating event network-vif-deleted:c5f7322f-32c1-4023-8ab9-49d925d5f631 for instance 95a3ffcc-fc4e-4351-9d57-b8c065aa179c on n-h1-860284-1 Oct 04 22:23:14.503239 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-7fe8b6ad-dc5c-4981-8ddc-1ec2d9a27696 req-40ee75dd-ce7d-4d1f-9b22-31a242bf9b83 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035065 Oct 04 22:23:14.503865 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3188/6138] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:23:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:23:14.548687 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-d459f6ba-dcb6-449d-bc56-f6960e086991 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:23:14.549409 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-d459f6ba-dcb6-449d-bc56-f6960e086991 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] [instance: 95a3ffcc-fc4e-4351-9d57-b8c065aa179c] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:23:14.555923 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d459f6ba-dcb6-449d-bc56-f6960e086991 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:14.556421 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d459f6ba-dcb6-449d-bc56-f6960e086991 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:14.556899 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d459f6ba-dcb6-449d-bc56-f6960e086991 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:14.557610 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d459f6ba-dcb6-449d-bc56-f6960e086991 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:14.558074 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d459f6ba-dcb6-449d-bc56-f6960e086991 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:14.558563 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d459f6ba-dcb6-449d-bc56-f6960e086991 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:14.574388 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-d459f6ba-dcb6-449d-bc56-f6960e086991 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] HTTP exception thrown: Instance 95a3ffcc-fc4e-4351-9d57-b8c065aa179c could not be found. Oct 04 22:23:14.576053 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-d459f6ba-dcb6-449d-bc56-f6960e086991 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Request method failure captured: Oct 04 22:23:14.576053 n-d-860284-1 devstack@n-api.service[134101]: request: GET /compute/v2.1/servers/95a3ffcc-fc4e-4351-9d57-b8c065aa179c HTTP/1.1 Oct 04 22:23:14.576053 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 22:23:14.576053 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 22:23:14.576053 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 22:23:14.576053 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 22:23:14.576053 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 22:23:14.576053 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 22:23:14.576053 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 22:23:14.576053 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 22:23:14.576053 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPLEDiePHKmNYQ70bvTRH9P6iiaqhUoAB8_ZBMNVcHJpqPxkBgo3U3nk5n38-Pj3vdk8AJHCO9JALC7jh3PuAbKmfUvXx7h6K9sXqnrzemrKzzJUfKCyLDC31QQuFp0uS2eKZE1D_dbjuEfh4aQXcfm19u6d5SXGgRB-GYLIygAnJeb8 Oct 04 22:23:14.576053 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 22:23:14.576053 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 22:23:14.576053 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 22:23:14.576053 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 22:23:14.576053 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 22:23:14.576053 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 22:23:14.576053 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: be71413506154420869fdff5939fb940 Oct 04 22:23:14.576053 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1499910012 Oct 04 22:23:14.576053 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 22:23:14.576053 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 22:23:14.576053 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/be71413506154420869fdff5939fb940"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_be71413506154420869fdff5939fb940", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/be71413506154420869fdff5939fb940"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/be71413506154420869fdff5939fb940"}]}] Oct 04 22:23:14.576053 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1499910012 Oct 04 22:23:14.576053 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: be71413506154420869fdff5939fb940 Oct 04 22:23:14.576053 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1499910012 Oct 04 22:23:14.576053 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-ServerRescueNegativeTestJSON-1499910012-project Oct 04 22:23:14.576053 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 22:23:14.576053 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 22:23:14.576053 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: ca6cfeabf8d84b2893200c3c54c1c19f Oct 04 22:23:14.576053 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1499910012-project Oct 04 22:23:14.576053 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 22:23:14.576053 n-d-860284-1 devstack@n-api.service[134101]: exception: Instance 95a3ffcc-fc4e-4351-9d57-b8c065aa179c could not be found. Oct 04 22:23:14.576053 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': '95a3ffcc-fc4e-4351-9d57-b8c065aa179c'} Oct 04 22:23:14.576053 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:23:14.576053 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:23:14.576053 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:23:14.576053 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:23:14.576053 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:23:14.576053 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:23:14.576053 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:23:14.576053 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:23:14.576053 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:23:14.576053 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:23:14.576053 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95a3ffcc-fc4e-4351-9d57-b8c065aa179c could not be found. Oct 04 22:23:14.576053 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:23:14.576053 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:23:14.576053 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:23:14.576053 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:23:14.576053 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:23:14.576053 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:23:14.576053 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:23:14.576053 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:23:14.576053 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:23:14.576053 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:23:14.576053 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:23:14.576053 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:23:14.576053 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:23:14.576053 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:23:14.576053 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:23:14.576053 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:23:14.576053 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95a3ffcc-fc4e-4351-9d57-b8c065aa179c could not be found. Oct 04 22:23:14.576053 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:23:14.576053 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:23:14.584879 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:23:14.584879 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:23:14.584879 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:23:14.584879 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:23:14.584879 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:23:14.584879 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:23:14.584879 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95a3ffcc-fc4e-4351-9d57-b8c065aa179c could not be found. Oct 04 22:23:14.584879 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:23:14.584879 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-d459f6ba-dcb6-449d-bc56-f6960e086991 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Returning 404 to user: Instance 95a3ffcc-fc4e-4351-9d57-b8c065aa179c could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:23:14.584879 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-d459f6ba-dcb6-449d-bc56-f6960e086991 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] 10.222.0.43 "GET /compute/v2.1/servers/95a3ffcc-fc4e-4351-9d57-b8c065aa179c" status: 404 len: 111 microversion: 2.1 time: 0.033734 Oct 04 22:23:14.584879 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3189/6139] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:23:14 2022] GET /compute/v2.1/servers/95a3ffcc-fc4e-4351-9d57-b8c065aa179c => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:23:14.586473 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-19077055-4ffb-4d91-9c7e-9fe9c24bde6e tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:23:14.586958 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-19077055-4ffb-4d91-9c7e-9fe9c24bde6e tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] [instance: 39984acf-f630-4ba0-b4e5-384ef8c3d9fc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:23:14.593591 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-19077055-4ffb-4d91-9c7e-9fe9c24bde6e tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:14.594311 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-19077055-4ffb-4d91-9c7e-9fe9c24bde6e tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:14.594536 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-19077055-4ffb-4d91-9c7e-9fe9c24bde6e tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:14.596055 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-19077055-4ffb-4d91-9c7e-9fe9c24bde6e tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:14.596329 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-19077055-4ffb-4d91-9c7e-9fe9c24bde6e tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:14.596787 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-19077055-4ffb-4d91-9c7e-9fe9c24bde6e tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:14.623108 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-19077055-4ffb-4d91-9c7e-9fe9c24bde6e tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] [instance: 39984acf-f630-4ba0-b4e5-384ef8c3d9fc] Going to try to terminate instance {{(pid=134101) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 22:23:14.729256 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-19077055-4ffb-4d91-9c7e-9fe9c24bde6e tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] 10.222.0.43 "DELETE /compute/v2.1/servers/39984acf-f630-4ba0-b4e5-384ef8c3d9fc" status: 204 len: 0 microversion: 2.1 time: 0.146091 Oct 04 22:23:14.730085 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3190/6140] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 22:23:14 2022] DELETE /compute/v2.1/servers/39984acf-f630-4ba0-b4e5-384ef8c3d9fc => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 22:23:14.747732 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-53ffd764-2708-427d-af67-1efcdb2980c3 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:23:14.748736 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-53ffd764-2708-427d-af67-1efcdb2980c3 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] [instance: 39984acf-f630-4ba0-b4e5-384ef8c3d9fc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:23:14.756544 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-53ffd764-2708-427d-af67-1efcdb2980c3 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:14.757040 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-53ffd764-2708-427d-af67-1efcdb2980c3 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:14.757486 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-53ffd764-2708-427d-af67-1efcdb2980c3 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:14.758192 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-53ffd764-2708-427d-af67-1efcdb2980c3 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:14.758685 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-53ffd764-2708-427d-af67-1efcdb2980c3 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:14.759118 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-53ffd764-2708-427d-af67-1efcdb2980c3 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:14.977130 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-53ffd764-2708-427d-af67-1efcdb2980c3 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6cfeabf8d84b2893200c3c54c1c19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be71413506154420869fdff5939fb940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:14.986111 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-53ffd764-2708-427d-af67-1efcdb2980c3 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] 10.222.0.43 "GET /compute/v2.1/servers/39984acf-f630-4ba0-b4e5-384ef8c3d9fc" status: 200 len: 1523 microversion: 2.1 time: 0.243491 Oct 04 22:23:14.987133 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3191/6141] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:23:14 2022] GET /compute/v2.1/servers/39984acf-f630-4ba0-b4e5-384ef8c3d9fc => generated 1523 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:23:15.492848 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-54353287-e3bf-4b52-ace8-aad028db39c0 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:23:15.493770 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-54353287-e3bf-4b52-ace8-aad028db39c0 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: f4acd3e4-bb81-43c5-8636-5259a9331844] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:23:15.500314 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-54353287-e3bf-4b52-ace8-aad028db39c0 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:15.500814 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-54353287-e3bf-4b52-ace8-aad028db39c0 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:15.501303 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-54353287-e3bf-4b52-ace8-aad028db39c0 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:15.502686 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-54353287-e3bf-4b52-ace8-aad028db39c0 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:15.503181 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-54353287-e3bf-4b52-ace8-aad028db39c0 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:15.503680 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-54353287-e3bf-4b52-ace8-aad028db39c0 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:15.729796 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-54353287-e3bf-4b52-ace8-aad028db39c0 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:15.740478 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-54353287-e3bf-4b52-ace8-aad028db39c0 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/f4acd3e4-bb81-43c5-8636-5259a9331844" status: 200 len: 1216 microversion: 2.1 time: 0.254584 Oct 04 22:23:15.749248 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3192/6142] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:23:15 2022] GET /compute/v2.1/servers/f4acd3e4-bb81-43c5-8636-5259a9331844 => generated 1216 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:23:16.009924 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-465a8b92-be9a-4133-bd24-e9000ffea63a tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:23:16.010399 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-465a8b92-be9a-4133-bd24-e9000ffea63a tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] [instance: 39984acf-f630-4ba0-b4e5-384ef8c3d9fc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:23:16.021561 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-465a8b92-be9a-4133-bd24-e9000ffea63a tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:16.022194 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-465a8b92-be9a-4133-bd24-e9000ffea63a tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:16.024286 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-465a8b92-be9a-4133-bd24-e9000ffea63a tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:16.025084 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-465a8b92-be9a-4133-bd24-e9000ffea63a tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:16.027755 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-465a8b92-be9a-4133-bd24-e9000ffea63a tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:16.029680 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-465a8b92-be9a-4133-bd24-e9000ffea63a tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:16.246757 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-465a8b92-be9a-4133-bd24-e9000ffea63a tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6cfeabf8d84b2893200c3c54c1c19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be71413506154420869fdff5939fb940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:16.257241 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-465a8b92-be9a-4133-bd24-e9000ffea63a tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] 10.222.0.43 "GET /compute/v2.1/servers/39984acf-f630-4ba0-b4e5-384ef8c3d9fc" status: 200 len: 1523 microversion: 2.1 time: 0.251409 Oct 04 22:23:16.259152 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3193/6143] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:23:16 2022] GET /compute/v2.1/servers/39984acf-f630-4ba0-b4e5-384ef8c3d9fc => generated 1523 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:23:16.765884 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-c084fcb7-1284-4824-925e-1539c97fa763 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:23:16.769338 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-c084fcb7-1284-4824-925e-1539c97fa763 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: f4acd3e4-bb81-43c5-8636-5259a9331844] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:23:16.779489 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c084fcb7-1284-4824-925e-1539c97fa763 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:16.780940 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c084fcb7-1284-4824-925e-1539c97fa763 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:16.782121 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c084fcb7-1284-4824-925e-1539c97fa763 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:16.783936 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c084fcb7-1284-4824-925e-1539c97fa763 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:16.785183 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c084fcb7-1284-4824-925e-1539c97fa763 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:16.786247 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c084fcb7-1284-4824-925e-1539c97fa763 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:17.086059 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-c084fcb7-1284-4824-925e-1539c97fa763 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:17.100936 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-c084fcb7-1284-4824-925e-1539c97fa763 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/f4acd3e4-bb81-43c5-8636-5259a9331844" status: 200 len: 1216 microversion: 2.1 time: 0.339715 Oct 04 22:23:17.102982 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3194/6144] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:23:16 2022] GET /compute/v2.1/servers/f4acd3e4-bb81-43c5-8636-5259a9331844 => generated 1216 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:23:17.281755 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-b7976729-3498-4849-b174-b91e8b73fec0 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:23:17.283205 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-b7976729-3498-4849-b174-b91e8b73fec0 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] [instance: 39984acf-f630-4ba0-b4e5-384ef8c3d9fc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:23:17.300806 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b7976729-3498-4849-b174-b91e8b73fec0 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:17.301485 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b7976729-3498-4849-b174-b91e8b73fec0 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:17.302007 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b7976729-3498-4849-b174-b91e8b73fec0 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:17.303156 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b7976729-3498-4849-b174-b91e8b73fec0 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:17.303710 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b7976729-3498-4849-b174-b91e8b73fec0 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:17.304130 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b7976729-3498-4849-b174-b91e8b73fec0 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:17.635876 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-b7976729-3498-4849-b174-b91e8b73fec0 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6cfeabf8d84b2893200c3c54c1c19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be71413506154420869fdff5939fb940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:17.647576 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-b7976729-3498-4849-b174-b91e8b73fec0 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] 10.222.0.43 "GET /compute/v2.1/servers/39984acf-f630-4ba0-b4e5-384ef8c3d9fc" status: 200 len: 1523 microversion: 2.1 time: 0.370356 Oct 04 22:23:17.648766 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3195/6145] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:23:17 2022] GET /compute/v2.1/servers/39984acf-f630-4ba0-b4e5-384ef8c3d9fc => generated 1523 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:23:18.125187 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-209cbd5d-b86a-4201-81d4-589dcd656181 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:23:18.126697 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-209cbd5d-b86a-4201-81d4-589dcd656181 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: f4acd3e4-bb81-43c5-8636-5259a9331844] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:23:18.142768 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-209cbd5d-b86a-4201-81d4-589dcd656181 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:18.143383 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-209cbd5d-b86a-4201-81d4-589dcd656181 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:18.143919 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-209cbd5d-b86a-4201-81d4-589dcd656181 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:18.144632 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-209cbd5d-b86a-4201-81d4-589dcd656181 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:18.145105 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-209cbd5d-b86a-4201-81d4-589dcd656181 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:18.145623 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-209cbd5d-b86a-4201-81d4-589dcd656181 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:18.752117 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-209cbd5d-b86a-4201-81d4-589dcd656181 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:18.791945 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-209cbd5d-b86a-4201-81d4-589dcd656181 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/f4acd3e4-bb81-43c5-8636-5259a9331844" status: 200 len: 1216 microversion: 2.1 time: 0.670534 Oct 04 22:23:18.792565 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3196/6146] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:23:18 2022] GET /compute/v2.1/servers/f4acd3e4-bb81-43c5-8636-5259a9331844 => generated 1216 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:23:18.804360 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-f584d49b-719e-4b86-a96a-1894e8d129dc tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:23:18.804988 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-f584d49b-719e-4b86-a96a-1894e8d129dc tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] [instance: 39984acf-f630-4ba0-b4e5-384ef8c3d9fc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:23:18.839405 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f584d49b-719e-4b86-a96a-1894e8d129dc tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:18.839907 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f584d49b-719e-4b86-a96a-1894e8d129dc tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:18.840340 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f584d49b-719e-4b86-a96a-1894e8d129dc tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:18.852624 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f584d49b-719e-4b86-a96a-1894e8d129dc tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:18.859421 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f584d49b-719e-4b86-a96a-1894e8d129dc tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:18.860122 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f584d49b-719e-4b86-a96a-1894e8d129dc tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:19.014675 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-f584d49b-719e-4b86-a96a-1894e8d129dc tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6cfeabf8d84b2893200c3c54c1c19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be71413506154420869fdff5939fb940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:19.020646 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:23:19.029939 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-f584d49b-719e-4b86-a96a-1894e8d129dc tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] 10.222.0.43 "GET /compute/v2.1/servers/39984acf-f630-4ba0-b4e5-384ef8c3d9fc" status: 200 len: 1481 microversion: 2.1 time: 0.236321 Oct 04 22:23:19.031135 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3197/6147] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:23:18 2022] GET /compute/v2.1/servers/39984acf-f630-4ba0-b4e5-384ef8c3d9fc => generated 1481 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:23:19.046830 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-c1b9f6ec-af1a-4ca0-bd62-aa780fb39b42 req-1077df60-5cf8-4089-8432-20133d039c87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4acd3e4-bb81-43c5-8636-5259a9331844", "name": "network-vif-plugged", "status": "completed", "tag": "bc5dd01e-0eb1-49d8-b209-65c021fa084a"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:23:19.067786 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-c1b9f6ec-af1a-4ca0-bd62-aa780fb39b42 req-1077df60-5cf8-4089-8432-20133d039c87 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:19.069524 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-c1b9f6ec-af1a-4ca0-bd62-aa780fb39b42 req-1077df60-5cf8-4089-8432-20133d039c87 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:19.070323 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-c1b9f6ec-af1a-4ca0-bd62-aa780fb39b42 req-1077df60-5cf8-4089-8432-20133d039c87 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:19.091864 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-c1b9f6ec-af1a-4ca0-bd62-aa780fb39b42 req-1077df60-5cf8-4089-8432-20133d039c87 service nova] Creating event network-vif-plugged:bc5dd01e-0eb1-49d8-b209-65c021fa084a for instance f4acd3e4-bb81-43c5-8636-5259a9331844 on n-h2-860284-1 Oct 04 22:23:19.099885 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-c1b9f6ec-af1a-4ca0-bd62-aa780fb39b42 req-1077df60-5cf8-4089-8432-20133d039c87 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065929 Oct 04 22:23:19.100519 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3198/6148] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:23:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:23:19.111606 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-e00ab11f-bde9-4cd2-b186-240568f55b59 req-d479c98e-e241-40a0-a1bc-fce5bf233bd9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39984acf-f630-4ba0-b4e5-384ef8c3d9fc", "name": "network-vif-deleted", "tag": "f5b43b12-ad10-49ab-918e-3f79c162348b"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:23:19.146039 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-e00ab11f-bde9-4cd2-b186-240568f55b59 req-d479c98e-e241-40a0-a1bc-fce5bf233bd9 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:19.147452 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-e00ab11f-bde9-4cd2-b186-240568f55b59 req-d479c98e-e241-40a0-a1bc-fce5bf233bd9 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:19.148094 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-e00ab11f-bde9-4cd2-b186-240568f55b59 req-d479c98e-e241-40a0-a1bc-fce5bf233bd9 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:19.165529 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-e00ab11f-bde9-4cd2-b186-240568f55b59 req-d479c98e-e241-40a0-a1bc-fce5bf233bd9 service nova] Creating event network-vif-deleted:f5b43b12-ad10-49ab-918e-3f79c162348b for instance 39984acf-f630-4ba0-b4e5-384ef8c3d9fc on n-h2-860284-1 Oct 04 22:23:19.171092 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-e00ab11f-bde9-4cd2-b186-240568f55b59 req-d479c98e-e241-40a0-a1bc-fce5bf233bd9 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065773 Oct 04 22:23:19.171742 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3199/6149] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:23:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:23:19.819016 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-ffbcf451-d18f-4d1a-a65e-95805635e3c8 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:23:19.821931 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-ffbcf451-d18f-4d1a-a65e-95805635e3c8 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: f4acd3e4-bb81-43c5-8636-5259a9331844] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:23:19.844206 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ffbcf451-d18f-4d1a-a65e-95805635e3c8 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:19.845752 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ffbcf451-d18f-4d1a-a65e-95805635e3c8 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:19.846412 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ffbcf451-d18f-4d1a-a65e-95805635e3c8 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:19.847325 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ffbcf451-d18f-4d1a-a65e-95805635e3c8 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:19.847949 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ffbcf451-d18f-4d1a-a65e-95805635e3c8 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:19.849991 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ffbcf451-d18f-4d1a-a65e-95805635e3c8 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:20.144510 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-ffbcf451-d18f-4d1a-a65e-95805635e3c8 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:20.156656 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-ffbcf451-d18f-4d1a-a65e-95805635e3c8 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/f4acd3e4-bb81-43c5-8636-5259a9331844" status: 200 len: 1216 microversion: 2.1 time: 0.343054 Oct 04 22:23:20.158503 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3200/6150] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:23:19 2022] GET /compute/v2.1/servers/f4acd3e4-bb81-43c5-8636-5259a9331844 => generated 1216 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:23:20.164597 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-6342c8b1-02b9-4203-831f-808c50a970b3 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:23:20.167951 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-6342c8b1-02b9-4203-831f-808c50a970b3 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] [instance: 39984acf-f630-4ba0-b4e5-384ef8c3d9fc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:23:20.185483 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:23:20.188359 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6342c8b1-02b9-4203-831f-808c50a970b3 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:20.189181 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6342c8b1-02b9-4203-831f-808c50a970b3 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:20.189715 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6342c8b1-02b9-4203-831f-808c50a970b3 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:20.190579 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6342c8b1-02b9-4203-831f-808c50a970b3 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:20.191260 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6342c8b1-02b9-4203-831f-808c50a970b3 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:20.191909 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6342c8b1-02b9-4203-831f-808c50a970b3 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:20.248664 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6342c8b1-02b9-4203-831f-808c50a970b3 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:20.249182 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6342c8b1-02b9-4203-831f-808c50a970b3 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:20.249635 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6342c8b1-02b9-4203-831f-808c50a970b3 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:20.250101 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.objects.instance [None req-6342c8b1-02b9-4203-831f-808c50a970b3 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lazy-loading 'fault' on Instance uuid 39984acf-f630-4ba0-b4e5-384ef8c3d9fc {{(pid=134101) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 22:23:20.687498 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-6342c8b1-02b9-4203-831f-808c50a970b3 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6cfeabf8d84b2893200c3c54c1c19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be71413506154420869fdff5939fb940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:20.712313 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-6342c8b1-02b9-4203-831f-808c50a970b3 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] 10.222.0.43 "GET /compute/v2.1/servers/39984acf-f630-4ba0-b4e5-384ef8c3d9fc" status: 200 len: 1312 microversion: 2.1 time: 0.550431 Oct 04 22:23:20.714821 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3201/6151] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:23:20 2022] GET /compute/v2.1/servers/39984acf-f630-4ba0-b4e5-384ef8c3d9fc => generated 1312 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:23:20.971206 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-2ccd3480-5905-4913-b708-ff06d49bb5a0 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-749334192", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452", "networks": [{"uuid": "cd0a6c5e-e3f7-423d-bf5b-3d41095ee0af"}], "key_name": "tempest-TestSecurityGroupsBasicOps-1266046448", "security_groups": []}, "os:scheduler_hints": {"different_host": ["ef43593b-be9b-4e5f-89c4-17a7e6030e29"]}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:23:21.056225 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.network.neutron [None req-2ccd3480-5905-4913-b708-ff06d49bb5a0 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] validate_networks() for [('cd0a6c5e-e3f7-423d-bf5b-3d41095ee0af', None, None, None, None, None)] {{(pid=134101) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 22:23:21.578613 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-2ccd3480-5905-4913-b708-ff06d49bb5a0 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Flavor limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 22:23:21.579331 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-2ccd3480-5905-4913-b708-ff06d49bb5a0 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Image limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 22:23:21.580222 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-2ccd3480-5905-4913-b708-ff06d49bb5a0 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Flavor pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 22:23:21.580641 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-2ccd3480-5905-4913-b708-ff06d49bb5a0 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Image pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 22:23:21.581456 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-2ccd3480-5905-4913-b708-ff06d49bb5a0 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 22:23:21.591152 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2ccd3480-5905-4913-b708-ff06d49bb5a0 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:21.591646 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2ccd3480-5905-4913-b708-ff06d49bb5a0 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:21.592090 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2ccd3480-5905-4913-b708-ff06d49bb5a0 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:21.593023 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2ccd3480-5905-4913-b708-ff06d49bb5a0 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:21.593484 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2ccd3480-5905-4913-b708-ff06d49bb5a0 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:21.594455 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2ccd3480-5905-4913-b708-ff06d49bb5a0 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:21.615237 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-2ccd3480-5905-4913-b708-ff06d49bb5a0 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Getting quotas for project 35747ba0bc69465e971ba85c88fff0cd. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:23:21.622502 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-2ccd3480-5905-4913-b708-ff06d49bb5a0 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Getting quotas for user 92bb4deacc2a45df834a675629a56e1b and project 35747ba0bc69465e971ba85c88fff0cd. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:23:21.639223 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-2ccd3480-5905-4913-b708-ff06d49bb5a0 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Going to run 1 instances... {{(pid=134101) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 22:23:21.641753 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-2ccd3480-5905-4913-b708-ff06d49bb5a0 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] [instance: 333a570b-57ac-40e3-bf33-ebc309bfcd1f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='58548514-5dac-426c-81f5-19e3fba33e23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134101) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 22:23:21.713707 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-2ccd3480-5905-4913-b708-ff06d49bb5a0 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 0.747115 Oct 04 22:23:21.714714 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3202/6152] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 22:23:20 2022] POST /compute/v2.1/servers => generated 361 bytes in 749 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 22:23:21.719639 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-d112749d-ccde-4c73-8afd-299875d2b46c tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:23:21.721457 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-d112749d-ccde-4c73-8afd-299875d2b46c tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: f4acd3e4-bb81-43c5-8636-5259a9331844] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:23:21.729296 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d112749d-ccde-4c73-8afd-299875d2b46c tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:21.730191 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d112749d-ccde-4c73-8afd-299875d2b46c tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:21.730864 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d112749d-ccde-4c73-8afd-299875d2b46c tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:21.743784 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d112749d-ccde-4c73-8afd-299875d2b46c tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:21.744483 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d112749d-ccde-4c73-8afd-299875d2b46c tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:21.744831 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d112749d-ccde-4c73-8afd-299875d2b46c tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:21.971159 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-d112749d-ccde-4c73-8afd-299875d2b46c tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:21.982167 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-d112749d-ccde-4c73-8afd-299875d2b46c tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/f4acd3e4-bb81-43c5-8636-5259a9331844" status: 200 len: 1404 microversion: 2.1 time: 0.266089 Oct 04 22:23:21.990139 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3203/6153] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:23:21 2022] GET /compute/v2.1/servers/f4acd3e4-bb81-43c5-8636-5259a9331844 => generated 1404 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:23:21.995059 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-aa4c7080-b270-48c5-a27d-ae34eeda9887 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:23:21.995628 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-aa4c7080-b270-48c5-a27d-ae34eeda9887 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] [instance: 333a570b-57ac-40e3-bf33-ebc309bfcd1f] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:23:22.062033 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-aa4c7080-b270-48c5-a27d-ae34eeda9887 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92bb4deacc2a45df834a675629a56e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35747ba0bc69465e971ba85c88fff0cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:22.073920 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-aa4c7080-b270-48c5-a27d-ae34eeda9887 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] 10.222.0.43 "GET /compute/v2.1/servers/333a570b-57ac-40e3-bf33-ebc309bfcd1f" status: 200 len: 1241 microversion: 2.1 time: 0.082614 Oct 04 22:23:22.074880 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3204/6154] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:23:21 2022] GET /compute/v2.1/servers/333a570b-57ac-40e3-bf33-ebc309bfcd1f => generated 1241 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:23:22.079948 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-30653299-a9ff-4d8d-8d0f-0d6c92833662 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:23:22.080579 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-30653299-a9ff-4d8d-8d0f-0d6c92833662 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] [instance: 39984acf-f630-4ba0-b4e5-384ef8c3d9fc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:23:22.093678 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-30653299-a9ff-4d8d-8d0f-0d6c92833662 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:22.094351 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-30653299-a9ff-4d8d-8d0f-0d6c92833662 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:22.095191 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-30653299-a9ff-4d8d-8d0f-0d6c92833662 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:22.096130 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-30653299-a9ff-4d8d-8d0f-0d6c92833662 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:22.096830 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-30653299-a9ff-4d8d-8d0f-0d6c92833662 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:22.097374 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-30653299-a9ff-4d8d-8d0f-0d6c92833662 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:22.115555 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-30653299-a9ff-4d8d-8d0f-0d6c92833662 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] HTTP exception thrown: Instance 39984acf-f630-4ba0-b4e5-384ef8c3d9fc could not be found. Oct 04 22:23:22.118181 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-30653299-a9ff-4d8d-8d0f-0d6c92833662 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Request method failure captured: Oct 04 22:23:22.118181 n-d-860284-1 devstack@n-api.service[134101]: request: GET /compute/v2.1/servers/39984acf-f630-4ba0-b4e5-384ef8c3d9fc HTTP/1.1 Oct 04 22:23:22.118181 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 22:23:22.118181 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 22:23:22.118181 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 22:23:22.118181 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 22:23:22.118181 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 22:23:22.118181 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 22:23:22.118181 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 22:23:22.118181 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 22:23:22.118181 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPLEDiePHKmNYQ70bvTRH9P6iiaqhUoAB8_ZBMNVcHJpqPxkBgo3U3nk5n38-Pj3vdk8AJHCO9JALC7jh3PuAbKmfUvXx7h6K9sXqnrzemrKzzJUfKCyLDC31QQuFp0uS2eKZE1D_dbjuEfh4aQXcfm19u6d5SXGgRB-GYLIygAnJeb8 Oct 04 22:23:22.118181 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 22:23:22.118181 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 22:23:22.118181 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 22:23:22.118181 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 22:23:22.118181 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 22:23:22.118181 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 22:23:22.118181 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: be71413506154420869fdff5939fb940 Oct 04 22:23:22.118181 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1499910012 Oct 04 22:23:22.118181 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 22:23:22.118181 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 22:23:22.118181 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/be71413506154420869fdff5939fb940"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_be71413506154420869fdff5939fb940", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/be71413506154420869fdff5939fb940"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/be71413506154420869fdff5939fb940"}]}] Oct 04 22:23:22.118181 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1499910012 Oct 04 22:23:22.118181 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: be71413506154420869fdff5939fb940 Oct 04 22:23:22.118181 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1499910012 Oct 04 22:23:22.118181 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-ServerRescueNegativeTestJSON-1499910012-project Oct 04 22:23:22.118181 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 22:23:22.118181 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 22:23:22.118181 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: ca6cfeabf8d84b2893200c3c54c1c19f Oct 04 22:23:22.118181 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1499910012-project Oct 04 22:23:22.118181 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 22:23:22.118181 n-d-860284-1 devstack@n-api.service[134101]: exception: Instance 39984acf-f630-4ba0-b4e5-384ef8c3d9fc could not be found. Oct 04 22:23:22.118181 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': '39984acf-f630-4ba0-b4e5-384ef8c3d9fc'} Oct 04 22:23:22.118181 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:23:22.118181 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:23:22.118181 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:23:22.118181 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:23:22.118181 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:23:22.118181 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:23:22.118181 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:23:22.118181 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:23:22.118181 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:23:22.118181 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:23:22.118181 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 39984acf-f630-4ba0-b4e5-384ef8c3d9fc could not be found. Oct 04 22:23:22.118181 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:23:22.118181 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:23:22.118181 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:23:22.118181 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:23:22.118181 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:23:22.118181 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:23:22.118181 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:23:22.118181 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:23:22.118181 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:23:22.118181 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:23:22.118181 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:23:22.118181 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:23:22.118181 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:23:22.118181 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:23:22.118181 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:23:22.118181 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:23:22.118181 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39984acf-f630-4ba0-b4e5-384ef8c3d9fc could not be found. Oct 04 22:23:22.118181 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:23:22.118181 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:23:22.123339 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:23:22.123339 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:23:22.123339 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:23:22.123339 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:23:22.123339 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:23:22.123339 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:23:22.123339 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39984acf-f630-4ba0-b4e5-384ef8c3d9fc could not be found. Oct 04 22:23:22.123339 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:23:22.125078 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-30653299-a9ff-4d8d-8d0f-0d6c92833662 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] Returning 404 to user: Instance 39984acf-f630-4ba0-b4e5-384ef8c3d9fc could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:23:22.126795 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-30653299-a9ff-4d8d-8d0f-0d6c92833662 tempest-ServerRescueNegativeTestJSON-1499910012 tempest-ServerRescueNegativeTestJSON-1499910012-project] 10.222.0.43 "GET /compute/v2.1/servers/39984acf-f630-4ba0-b4e5-384ef8c3d9fc" status: 404 len: 111 microversion: 2.1 time: 0.050072 Oct 04 22:23:22.149778 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3205/6155] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:23:22 2022] GET /compute/v2.1/servers/39984acf-f630-4ba0-b4e5-384ef8c3d9fc => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:23:22.157853 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-bb59aeac-cfd0-43df-a127-3d86abd7b2d2 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:23:22.158890 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-bb59aeac-cfd0-43df-a127-3d86abd7b2d2 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: f4acd3e4-bb81-43c5-8636-5259a9331844] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:23:22.167043 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bb59aeac-cfd0-43df-a127-3d86abd7b2d2 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:22.167780 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bb59aeac-cfd0-43df-a127-3d86abd7b2d2 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:22.168427 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bb59aeac-cfd0-43df-a127-3d86abd7b2d2 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:22.169357 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bb59aeac-cfd0-43df-a127-3d86abd7b2d2 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:22.170243 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bb59aeac-cfd0-43df-a127-3d86abd7b2d2 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:22.170998 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bb59aeac-cfd0-43df-a127-3d86abd7b2d2 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:22.590273 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-bb59aeac-cfd0-43df-a127-3d86abd7b2d2 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:22.607692 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-bb59aeac-cfd0-43df-a127-3d86abd7b2d2 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/f4acd3e4-bb81-43c5-8636-5259a9331844" status: 200 len: 1404 microversion: 2.1 time: 0.456327 Oct 04 22:23:22.608286 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3206/6156] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:23:22 2022] GET /compute/v2.1/servers/f4acd3e4-bb81-43c5-8636-5259a9331844 => generated 1404 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:23:22.633325 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-ee520054-fe32-4de5-bc9c-c47825a5c097 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-1451493325"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:23:22.636058 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-ee520054-fe32-4de5-bc9c-c47825a5c097 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: f4acd3e4-bb81-43c5-8636-5259a9331844] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:23:22.642450 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ee520054-fe32-4de5-bc9c-c47825a5c097 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:22.643172 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ee520054-fe32-4de5-bc9c-c47825a5c097 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:22.643778 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ee520054-fe32-4de5-bc9c-c47825a5c097 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:22.644640 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ee520054-fe32-4de5-bc9c-c47825a5c097 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:22.645248 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ee520054-fe32-4de5-bc9c-c47825a5c097 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:22.645841 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ee520054-fe32-4de5-bc9c-c47825a5c097 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:22.840963 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.compute.api [None req-ee520054-fe32-4de5-bc9c-c47825a5c097 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: f4acd3e4-bb81-43c5-8636-5259a9331844] Attempting to quiesce instance before volume snapshot. Oct 04 22:23:22.895638 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.compute.api [None req-ee520054-fe32-4de5-bc9c-c47825a5c097 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: f4acd3e4-bb81-43c5-8636-5259a9331844] Skipping quiescing instance because the operation is not supported by the underlying compute driver. Oct 04 22:23:23.046919 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-ee520054-fe32-4de5-bc9c-c47825a5c097 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: f4acd3e4-bb81-43c5-8636-5259a9331844] Creating snapshot from volume 75c295f9-15df-4b09-89f1-c8056f4674f7. {{(pid=134101) snapshot_instance /opt/stack/nova/nova/compute/api.py:3509}} Oct 04 22:23:24.819394 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-ee520054-fe32-4de5-bc9c-c47825a5c097 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "POST /compute/v2.1/servers/f4acd3e4-bb81-43c5-8636-5259a9331844/action" status: 202 len: 0 microversion: 2.1 time: 2.190197 Oct 04 22:23:24.825687 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3207/6157] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 22:23:22 2022] POST /compute/v2.1/servers/f4acd3e4-bb81-43c5-8636-5259a9331844/action => generated 0 bytes in 2197 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Oct 04 22:23:24.838670 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-c0db851b-8e88-4527-b6bd-30522f3f0bf9 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:23:24.839666 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-c0db851b-8e88-4527-b6bd-30522f3f0bf9 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] [instance: 333a570b-57ac-40e3-bf33-ebc309bfcd1f] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:23:24.862620 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c0db851b-8e88-4527-b6bd-30522f3f0bf9 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:24.863750 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c0db851b-8e88-4527-b6bd-30522f3f0bf9 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:24.864367 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c0db851b-8e88-4527-b6bd-30522f3f0bf9 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:24.865305 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c0db851b-8e88-4527-b6bd-30522f3f0bf9 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:24.865945 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c0db851b-8e88-4527-b6bd-30522f3f0bf9 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:24.866710 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c0db851b-8e88-4527-b6bd-30522f3f0bf9 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:25.139691 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-c0db851b-8e88-4527-b6bd-30522f3f0bf9 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92bb4deacc2a45df834a675629a56e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35747ba0bc69465e971ba85c88fff0cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:25.151076 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-c0db851b-8e88-4527-b6bd-30522f3f0bf9 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] 10.222.0.43 "GET /compute/v2.1/servers/333a570b-57ac-40e3-bf33-ebc309bfcd1f" status: 200 len: 1299 microversion: 2.1 time: 0.323906 Oct 04 22:23:25.151681 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3208/6158] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:23:24 2022] GET /compute/v2.1/servers/333a570b-57ac-40e3-bf33-ebc309bfcd1f => generated 1299 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:23:26.180405 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-d93e4769-fa46-46ff-ad54-ca135e379554 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:23:26.182869 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-d93e4769-fa46-46ff-ad54-ca135e379554 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] [instance: 333a570b-57ac-40e3-bf33-ebc309bfcd1f] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:23:26.215418 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d93e4769-fa46-46ff-ad54-ca135e379554 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:26.216319 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d93e4769-fa46-46ff-ad54-ca135e379554 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:26.217515 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d93e4769-fa46-46ff-ad54-ca135e379554 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:26.218646 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d93e4769-fa46-46ff-ad54-ca135e379554 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:26.225163 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d93e4769-fa46-46ff-ad54-ca135e379554 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:26.226881 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d93e4769-fa46-46ff-ad54-ca135e379554 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:26.534566 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-d93e4769-fa46-46ff-ad54-ca135e379554 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92bb4deacc2a45df834a675629a56e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35747ba0bc69465e971ba85c88fff0cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:26.544453 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-d93e4769-fa46-46ff-ad54-ca135e379554 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] 10.222.0.43 "GET /compute/v2.1/servers/333a570b-57ac-40e3-bf33-ebc309bfcd1f" status: 200 len: 1299 microversion: 2.1 time: 0.371359 Oct 04 22:23:26.558780 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3209/6159] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:23:26 2022] GET /compute/v2.1/servers/333a570b-57ac-40e3-bf33-ebc309bfcd1f => generated 1299 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:23:27.148388 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-391c4f45-a3d5-4d24-b09d-4f3fc4b16a68 req-4bfaec3c-4846-4d0e-a176-4e24a53d0c66 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "333a570b-57ac-40e3-bf33-ebc309bfcd1f", "tag": "b7cea7e2-96bd-47fb-86e0-42e3c7a01c96"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:23:27.176191 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-391c4f45-a3d5-4d24-b09d-4f3fc4b16a68 req-4bfaec3c-4846-4d0e-a176-4e24a53d0c66 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:27.176700 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-391c4f45-a3d5-4d24-b09d-4f3fc4b16a68 req-4bfaec3c-4846-4d0e-a176-4e24a53d0c66 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:27.179755 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-391c4f45-a3d5-4d24-b09d-4f3fc4b16a68 req-4bfaec3c-4846-4d0e-a176-4e24a53d0c66 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:27.214313 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-391c4f45-a3d5-4d24-b09d-4f3fc4b16a68 req-4bfaec3c-4846-4d0e-a176-4e24a53d0c66 service nova] Creating event network-changed:b7cea7e2-96bd-47fb-86e0-42e3c7a01c96 for instance 333a570b-57ac-40e3-bf33-ebc309bfcd1f on n-h2-860284-1 Oct 04 22:23:27.228215 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-391c4f45-a3d5-4d24-b09d-4f3fc4b16a68 req-4bfaec3c-4846-4d0e-a176-4e24a53d0c66 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101213 Oct 04 22:23:27.229149 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3210/6160] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:23:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:23:27.246649 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-c99e2707-3a89-4eb9-9b00-1243fb396a9c tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-1670317820", "imageRef": "bfb75ad3-2ab9-4613-b808-a2349edff56e", "flavorRef": "452", "networks": [{"uuid": "f55a0794-d215-4510-84cc-a7b063c083a4"}]}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:23:27.365564 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.network.neutron [None req-c99e2707-3a89-4eb9-9b00-1243fb396a9c tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] validate_networks() for [('f55a0794-d215-4510-84cc-a7b063c083a4', None, None, None, None, None)] {{(pid=134101) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 22:23:28.424265 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-c99e2707-3a89-4eb9-9b00-1243fb396a9c tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Flavor limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 22:23:28.425894 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-c99e2707-3a89-4eb9-9b00-1243fb396a9c tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Image limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 22:23:28.426614 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-c99e2707-3a89-4eb9-9b00-1243fb396a9c tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Flavor pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 22:23:28.427334 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-c99e2707-3a89-4eb9-9b00-1243fb396a9c tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Image pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 22:23:28.427638 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-c99e2707-3a89-4eb9-9b00-1243fb396a9c tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 22:23:28.438049 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c99e2707-3a89-4eb9-9b00-1243fb396a9c tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:28.438942 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c99e2707-3a89-4eb9-9b00-1243fb396a9c tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:28.440128 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c99e2707-3a89-4eb9-9b00-1243fb396a9c tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:28.441359 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c99e2707-3a89-4eb9-9b00-1243fb396a9c tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:28.442238 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c99e2707-3a89-4eb9-9b00-1243fb396a9c tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:28.447528 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c99e2707-3a89-4eb9-9b00-1243fb396a9c tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:28.470949 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-c99e2707-3a89-4eb9-9b00-1243fb396a9c tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Getting quotas for project 5c98a72bacce47c3947f9b0f0b4e85b6. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:23:28.477999 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-c99e2707-3a89-4eb9-9b00-1243fb396a9c tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Getting quotas for user 99acad09db70445b93ae1d64a1b49ca3 and project 5c98a72bacce47c3947f9b0f0b4e85b6. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:23:28.492797 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-c99e2707-3a89-4eb9-9b00-1243fb396a9c tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Going to run 1 instances... {{(pid=134101) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 22:23:28.495521 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-c99e2707-3a89-4eb9-9b00-1243fb396a9c tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: 4d83b3ae-04db-4148-9d64-99458438ec9b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='d03c5832-bd25-401c-9696-79e61735e539',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=134101) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 22:23:28.598278 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-c99e2707-3a89-4eb9-9b00-1243fb396a9c tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.356209 Oct 04 22:23:28.605145 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3211/6161] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 22:23:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 1358 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 22:23:28.605145 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-398b9b28-3105-4968-b501-40a74f3230bc tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:23:28.605504 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-398b9b28-3105-4968-b501-40a74f3230bc tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] [instance: 333a570b-57ac-40e3-bf33-ebc309bfcd1f] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:23:28.612555 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-398b9b28-3105-4968-b501-40a74f3230bc tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:28.613064 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-398b9b28-3105-4968-b501-40a74f3230bc tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:28.613520 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-398b9b28-3105-4968-b501-40a74f3230bc tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:28.614279 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-398b9b28-3105-4968-b501-40a74f3230bc tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:28.614721 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-398b9b28-3105-4968-b501-40a74f3230bc tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:28.615194 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-398b9b28-3105-4968-b501-40a74f3230bc tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:28.726391 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-398b9b28-3105-4968-b501-40a74f3230bc tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92bb4deacc2a45df834a675629a56e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35747ba0bc69465e971ba85c88fff0cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:28.741060 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-398b9b28-3105-4968-b501-40a74f3230bc tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] 10.222.0.43 "GET /compute/v2.1/servers/333a570b-57ac-40e3-bf33-ebc309bfcd1f" status: 200 len: 1299 microversion: 2.1 time: 0.140298 Oct 04 22:23:28.742525 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3212/6162] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:23:28 2022] GET /compute/v2.1/servers/333a570b-57ac-40e3-bf33-ebc309bfcd1f => generated 1299 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:23:28.748236 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-0528d71d-e295-4475-86aa-29300c0ba82e tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:23:28.749477 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-0528d71d-e295-4475-86aa-29300c0ba82e tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: 4d83b3ae-04db-4148-9d64-99458438ec9b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:23:28.821482 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-0528d71d-e295-4475-86aa-29300c0ba82e tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:28.828715 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-0528d71d-e295-4475-86aa-29300c0ba82e tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/4d83b3ae-04db-4148-9d64-99458438ec9b" status: 200 len: 1230 microversion: 2.1 time: 0.085031 Oct 04 22:23:28.830239 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3213/6163] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:23:28 2022] GET /compute/v2.1/servers/4d83b3ae-04db-4148-9d64-99458438ec9b => generated 1230 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:23:29.764903 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-568c1c1b-d540-44f4-8e32-c67e4fe82f77 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:23:29.765539 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-568c1c1b-d540-44f4-8e32-c67e4fe82f77 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] [instance: 333a570b-57ac-40e3-bf33-ebc309bfcd1f] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:23:29.777406 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-568c1c1b-d540-44f4-8e32-c67e4fe82f77 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:29.777921 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-568c1c1b-d540-44f4-8e32-c67e4fe82f77 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:29.778429 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-568c1c1b-d540-44f4-8e32-c67e4fe82f77 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:29.779152 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-568c1c1b-d540-44f4-8e32-c67e4fe82f77 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:29.779622 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-568c1c1b-d540-44f4-8e32-c67e4fe82f77 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:29.780067 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-568c1c1b-d540-44f4-8e32-c67e4fe82f77 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:29.887625 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-568c1c1b-d540-44f4-8e32-c67e4fe82f77 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92bb4deacc2a45df834a675629a56e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35747ba0bc69465e971ba85c88fff0cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:29.896984 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-568c1c1b-d540-44f4-8e32-c67e4fe82f77 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] 10.222.0.43 "GET /compute/v2.1/servers/333a570b-57ac-40e3-bf33-ebc309bfcd1f" status: 200 len: 1299 microversion: 2.1 time: 0.136044 Oct 04 22:23:29.897782 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3214/6164] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:23:29 2022] GET /compute/v2.1/servers/333a570b-57ac-40e3-bf33-ebc309bfcd1f => generated 1299 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:23:30.076185 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-23cfd7c5-d90e-458c-9072-ad4022b801c6 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-1355273678", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452", "networks": "none"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:23:30.136471 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-23cfd7c5-d90e-458c-9072-ad4022b801c6 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Flavor limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 22:23:30.136590 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-23cfd7c5-d90e-458c-9072-ad4022b801c6 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Image limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 22:23:30.137354 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-23cfd7c5-d90e-458c-9072-ad4022b801c6 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Flavor pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 22:23:30.137460 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-23cfd7c5-d90e-458c-9072-ad4022b801c6 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Image pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 22:23:30.137843 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-23cfd7c5-d90e-458c-9072-ad4022b801c6 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 22:23:30.149639 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-23cfd7c5-d90e-458c-9072-ad4022b801c6 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:30.150141 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-23cfd7c5-d90e-458c-9072-ad4022b801c6 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:30.152293 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-23cfd7c5-d90e-458c-9072-ad4022b801c6 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:30.153071 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-23cfd7c5-d90e-458c-9072-ad4022b801c6 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:30.153554 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-23cfd7c5-d90e-458c-9072-ad4022b801c6 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:30.154028 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-23cfd7c5-d90e-458c-9072-ad4022b801c6 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:30.195400 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-23cfd7c5-d90e-458c-9072-ad4022b801c6 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Getting quotas for project c2ffabfbee11487b93dc6c9c4509935e. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:23:30.207802 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-23cfd7c5-d90e-458c-9072-ad4022b801c6 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Getting quotas for user 680b9f424ac24ef0b93ff30c9a9d9831 and project c2ffabfbee11487b93dc6c9c4509935e. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:23:30.236287 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-23cfd7c5-d90e-458c-9072-ad4022b801c6 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Going to run 1 instances... {{(pid=134101) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 22:23:30.239439 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-23cfd7c5-d90e-458c-9072-ad4022b801c6 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] [instance: ecae70db-7b81-49c7-b4ab-16ec6f7ab31a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='58548514-5dac-426c-81f5-19e3fba33e23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134101) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 22:23:30.315950 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-23cfd7c5-d90e-458c-9072-ad4022b801c6 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.416842 Oct 04 22:23:30.316733 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3215/6165] 10.222.0.43 () {62 vars in 1188 bytes} [Tue Oct 4 22:23:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 418 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 04 22:23:30.326033 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-fafe17ca-75aa-4b79-b5cb-d3a208caee2b tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:23:30.332602 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-fafe17ca-75aa-4b79-b5cb-d3a208caee2b tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: 4d83b3ae-04db-4148-9d64-99458438ec9b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:23:30.365213 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fafe17ca-75aa-4b79-b5cb-d3a208caee2b tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:30.366104 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fafe17ca-75aa-4b79-b5cb-d3a208caee2b tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:30.369301 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fafe17ca-75aa-4b79-b5cb-d3a208caee2b tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:30.371921 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fafe17ca-75aa-4b79-b5cb-d3a208caee2b tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:30.374099 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fafe17ca-75aa-4b79-b5cb-d3a208caee2b tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:30.376610 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fafe17ca-75aa-4b79-b5cb-d3a208caee2b tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:30.511455 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-fafe17ca-75aa-4b79-b5cb-d3a208caee2b tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:30.523315 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-fafe17ca-75aa-4b79-b5cb-d3a208caee2b tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/4d83b3ae-04db-4148-9d64-99458438ec9b" status: 200 len: 1300 microversion: 2.1 time: 0.202781 Oct 04 22:23:30.524122 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3216/6166] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:23:30 2022] GET /compute/v2.1/servers/4d83b3ae-04db-4148-9d64-99458438ec9b => generated 1300 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:23:30.552416 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-4df85ee7-613e-46f5-9c36-0fbe5dca541f tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:23:30.554178 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-4df85ee7-613e-46f5-9c36-0fbe5dca541f tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] [instance: ecae70db-7b81-49c7-b4ab-16ec6f7ab31a] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:23:30.712975 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-4df85ee7-613e-46f5-9c36-0fbe5dca541f tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '680b9f424ac24ef0b93ff30c9a9d9831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ffabfbee11487b93dc6c9c4509935e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:30.731852 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-4df85ee7-613e-46f5-9c36-0fbe5dca541f tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '680b9f424ac24ef0b93ff30c9a9d9831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ffabfbee11487b93dc6c9c4509935e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:30.736290 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-4df85ee7-613e-46f5-9c36-0fbe5dca541f tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '680b9f424ac24ef0b93ff30c9a9d9831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ffabfbee11487b93dc6c9c4509935e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:30.737499 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-4df85ee7-613e-46f5-9c36-0fbe5dca541f tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] 10.222.0.43 "GET /compute/v2.1/servers/ecae70db-7b81-49c7-b4ab-16ec6f7ab31a" status: 200 len: 1278 microversion: 2.47 time: 0.195311 Oct 04 22:23:30.738264 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3217/6167] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:23:30 2022] GET /compute/v2.1/servers/ecae70db-7b81-49c7-b4ab-16ec6f7ab31a => generated 1278 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:23:30.837895 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-46655ef6-1360-482b-9bad-e1ab32ca0912 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-1558692178", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452", "networks": "none"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:23:30.976546 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-46655ef6-1360-482b-9bad-e1ab32ca0912 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Flavor limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 22:23:30.977604 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-46655ef6-1360-482b-9bad-e1ab32ca0912 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Image limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 22:23:30.978304 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-46655ef6-1360-482b-9bad-e1ab32ca0912 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Flavor pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 22:23:30.978966 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-46655ef6-1360-482b-9bad-e1ab32ca0912 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Image pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 22:23:30.980470 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-46655ef6-1360-482b-9bad-e1ab32ca0912 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 22:23:31.004971 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-46655ef6-1360-482b-9bad-e1ab32ca0912 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:31.016422 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-46655ef6-1360-482b-9bad-e1ab32ca0912 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:31.019479 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-46655ef6-1360-482b-9bad-e1ab32ca0912 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:31.021571 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-46655ef6-1360-482b-9bad-e1ab32ca0912 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:31.022076 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-46655ef6-1360-482b-9bad-e1ab32ca0912 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:31.022562 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-46655ef6-1360-482b-9bad-e1ab32ca0912 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:31.069183 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-46655ef6-1360-482b-9bad-e1ab32ca0912 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Getting quotas for project c2ffabfbee11487b93dc6c9c4509935e. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:23:31.080874 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-46655ef6-1360-482b-9bad-e1ab32ca0912 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Getting quotas for user 680b9f424ac24ef0b93ff30c9a9d9831 and project c2ffabfbee11487b93dc6c9c4509935e. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:23:31.143892 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-46655ef6-1360-482b-9bad-e1ab32ca0912 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Going to run 1 instances... {{(pid=134101) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 22:23:31.158254 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-46655ef6-1360-482b-9bad-e1ab32ca0912 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] [instance: 3d1e7581-b5c1-4998-a964-8ca90bf36626] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='58548514-5dac-426c-81f5-19e3fba33e23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134101) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 22:23:31.202845 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=12 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:23:31.227060 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-46655ef6-1360-482b-9bad-e1ab32ca0912 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.393382 Oct 04 22:23:31.228309 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3218/6168] 10.222.0.43 () {62 vars in 1188 bytes} [Tue Oct 4 22:23:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 396 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Oct 04 22:23:31.233613 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-fed47cda-d9fb-4392-9a6b-2eef4a246d85 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:23:31.234656 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-fed47cda-d9fb-4392-9a6b-2eef4a246d85 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] [instance: 333a570b-57ac-40e3-bf33-ebc309bfcd1f] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:23:31.242246 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fed47cda-d9fb-4392-9a6b-2eef4a246d85 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:31.243199 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fed47cda-d9fb-4392-9a6b-2eef4a246d85 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:31.243945 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fed47cda-d9fb-4392-9a6b-2eef4a246d85 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:31.245131 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fed47cda-d9fb-4392-9a6b-2eef4a246d85 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:31.245906 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fed47cda-d9fb-4392-9a6b-2eef4a246d85 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:31.246608 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fed47cda-d9fb-4392-9a6b-2eef4a246d85 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:31.419915 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-fed47cda-d9fb-4392-9a6b-2eef4a246d85 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92bb4deacc2a45df834a675629a56e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35747ba0bc69465e971ba85c88fff0cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:31.438339 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-fed47cda-d9fb-4392-9a6b-2eef4a246d85 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] 10.222.0.43 "GET /compute/v2.1/servers/333a570b-57ac-40e3-bf33-ebc309bfcd1f" status: 200 len: 1299 microversion: 2.1 time: 0.208357 Oct 04 22:23:31.441881 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3219/6169] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:23:31 2022] GET /compute/v2.1/servers/333a570b-57ac-40e3-bf33-ebc309bfcd1f => generated 1299 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:23:31.477344 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-a5aeddff-7aa7-4af6-bca4-dc15e9e4d10a tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:23:31.486092 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-a5aeddff-7aa7-4af6-bca4-dc15e9e4d10a tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] [instance: 3d1e7581-b5c1-4998-a964-8ca90bf36626] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:23:31.582764 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-a5aeddff-7aa7-4af6-bca4-dc15e9e4d10a tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] 10.222.0.43 "PUT /compute/v2.1/servers/3d1e7581-b5c1-4998-a964-8ca90bf36626" status: 200 len: 992 microversion: 2.47 time: 0.118598 Oct 04 22:23:31.594389 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3220/6170] 10.222.0.43 () {62 vars in 1297 bytes} [Tue Oct 4 22:23:31 2022] PUT /compute/v2.1/servers/3d1e7581-b5c1-4998-a964-8ca90bf36626 => generated 992 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 22:23:31.594389 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-c358e770-ab33-4d48-87f3-5dc1e901e56c tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:23:31.594389 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-c358e770-ab33-4d48-87f3-5dc1e901e56c tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: 4d83b3ae-04db-4148-9d64-99458438ec9b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:23:31.610563 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c358e770-ab33-4d48-87f3-5dc1e901e56c tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:31.614642 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c358e770-ab33-4d48-87f3-5dc1e901e56c tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:31.615243 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c358e770-ab33-4d48-87f3-5dc1e901e56c tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:31.616260 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c358e770-ab33-4d48-87f3-5dc1e901e56c tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:31.616759 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c358e770-ab33-4d48-87f3-5dc1e901e56c tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:31.617214 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c358e770-ab33-4d48-87f3-5dc1e901e56c tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:31.723336 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:23:32.195438 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-c358e770-ab33-4d48-87f3-5dc1e901e56c tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:32.209305 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-c358e770-ab33-4d48-87f3-5dc1e901e56c tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/4d83b3ae-04db-4148-9d64-99458438ec9b" status: 200 len: 1342 microversion: 2.1 time: 0.623848 Oct 04 22:23:32.210823 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3221/6171] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:23:31 2022] GET /compute/v2.1/servers/4d83b3ae-04db-4148-9d64-99458438ec9b => generated 1342 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:23:32.216646 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-069f055f-58ea-42c4-aacb-c6fd0ed47bd6 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:23:32.217396 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-069f055f-58ea-42c4-aacb-c6fd0ed47bd6 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] [instance: 3d1e7581-b5c1-4998-a964-8ca90bf36626] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:23:32.226600 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-069f055f-58ea-42c4-aacb-c6fd0ed47bd6 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:32.227723 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-069f055f-58ea-42c4-aacb-c6fd0ed47bd6 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:32.228708 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-069f055f-58ea-42c4-aacb-c6fd0ed47bd6 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:32.229775 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-069f055f-58ea-42c4-aacb-c6fd0ed47bd6 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:32.230502 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-069f055f-58ea-42c4-aacb-c6fd0ed47bd6 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:32.231364 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-069f055f-58ea-42c4-aacb-c6fd0ed47bd6 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:32.379061 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-069f055f-58ea-42c4-aacb-c6fd0ed47bd6 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '680b9f424ac24ef0b93ff30c9a9d9831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ffabfbee11487b93dc6c9c4509935e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:32.392675 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-069f055f-58ea-42c4-aacb-c6fd0ed47bd6 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '680b9f424ac24ef0b93ff30c9a9d9831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ffabfbee11487b93dc6c9c4509935e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:32.396376 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-069f055f-58ea-42c4-aacb-c6fd0ed47bd6 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '680b9f424ac24ef0b93ff30c9a9d9831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ffabfbee11487b93dc6c9c4509935e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:32.403272 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-069f055f-58ea-42c4-aacb-c6fd0ed47bd6 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] 10.222.0.43 "GET /compute/v2.1/servers/3d1e7581-b5c1-4998-a964-8ca90bf36626" status: 200 len: 1282 microversion: 2.47 time: 0.191090 Oct 04 22:23:32.420032 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3222/6172] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:23:32 2022] GET /compute/v2.1/servers/3d1e7581-b5c1-4998-a964-8ca90bf36626 => generated 1282 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:23:32.474605 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-b4c54794-fbf5-48f2-b36c-6fefec10e61f tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:23:32.475608 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-b4c54794-fbf5-48f2-b36c-6fefec10e61f tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] [instance: 333a570b-57ac-40e3-bf33-ebc309bfcd1f] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:23:32.484466 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b4c54794-fbf5-48f2-b36c-6fefec10e61f tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:32.490906 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b4c54794-fbf5-48f2-b36c-6fefec10e61f tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:32.491627 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b4c54794-fbf5-48f2-b36c-6fefec10e61f tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:32.492601 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b4c54794-fbf5-48f2-b36c-6fefec10e61f tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:32.494440 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b4c54794-fbf5-48f2-b36c-6fefec10e61f tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:32.495159 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b4c54794-fbf5-48f2-b36c-6fefec10e61f tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:32.702078 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-b4c54794-fbf5-48f2-b36c-6fefec10e61f tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92bb4deacc2a45df834a675629a56e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35747ba0bc69465e971ba85c88fff0cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:32.716226 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-b4c54794-fbf5-48f2-b36c-6fefec10e61f tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] 10.222.0.43 "GET /compute/v2.1/servers/333a570b-57ac-40e3-bf33-ebc309bfcd1f" status: 200 len: 1299 microversion: 2.1 time: 0.249437 Oct 04 22:23:32.726523 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3223/6173] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:23:32 2022] GET /compute/v2.1/servers/333a570b-57ac-40e3-bf33-ebc309bfcd1f => generated 1299 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:23:32.823049 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-eb922d36-b664-4d04-b802-5c9b4e7f6413 req-39dfad74-8563-47fd-b7ed-76551cd32884 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d83b3ae-04db-4148-9d64-99458438ec9b", "tag": "e2b07028-bc0d-41be-ab5f-9e9c2749c0bf"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:23:32.852798 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-eb922d36-b664-4d04-b802-5c9b4e7f6413 req-39dfad74-8563-47fd-b7ed-76551cd32884 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:32.853375 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-eb922d36-b664-4d04-b802-5c9b4e7f6413 req-39dfad74-8563-47fd-b7ed-76551cd32884 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:32.854040 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-eb922d36-b664-4d04-b802-5c9b4e7f6413 req-39dfad74-8563-47fd-b7ed-76551cd32884 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:32.884042 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-eb922d36-b664-4d04-b802-5c9b4e7f6413 req-39dfad74-8563-47fd-b7ed-76551cd32884 service nova] Creating event network-changed:e2b07028-bc0d-41be-ab5f-9e9c2749c0bf for instance 4d83b3ae-04db-4148-9d64-99458438ec9b on n-h1-860284-1 Oct 04 22:23:32.901041 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-eb922d36-b664-4d04-b802-5c9b4e7f6413 req-39dfad74-8563-47fd-b7ed-76551cd32884 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081821 Oct 04 22:23:32.902091 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3224/6174] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:23:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:23:32.908240 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-fc2620e6-52e7-417a-a7c4-eda02e831e5a req-60bcef79-8f3e-461b-aad4-a1ed8a822d88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "333a570b-57ac-40e3-bf33-ebc309bfcd1f", "name": "network-vif-plugged", "status": "completed", "tag": "b7cea7e2-96bd-47fb-86e0-42e3c7a01c96"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:23:32.935098 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-fc2620e6-52e7-417a-a7c4-eda02e831e5a req-60bcef79-8f3e-461b-aad4-a1ed8a822d88 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:32.936742 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-fc2620e6-52e7-417a-a7c4-eda02e831e5a req-60bcef79-8f3e-461b-aad4-a1ed8a822d88 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:32.937451 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-fc2620e6-52e7-417a-a7c4-eda02e831e5a req-60bcef79-8f3e-461b-aad4-a1ed8a822d88 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:32.962292 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-fc2620e6-52e7-417a-a7c4-eda02e831e5a req-60bcef79-8f3e-461b-aad4-a1ed8a822d88 service nova] Creating event network-vif-plugged:b7cea7e2-96bd-47fb-86e0-42e3c7a01c96 for instance 333a570b-57ac-40e3-bf33-ebc309bfcd1f on n-h2-860284-1 Oct 04 22:23:32.969133 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-fc2620e6-52e7-417a-a7c4-eda02e831e5a req-60bcef79-8f3e-461b-aad4-a1ed8a822d88 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065380 Oct 04 22:23:32.970521 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3225/6175] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:23:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:23:33.234174 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-7b5a5456-7b4f-4963-bdd3-342173d2f2f7 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:23:33.234928 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-7b5a5456-7b4f-4963-bdd3-342173d2f2f7 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: 4d83b3ae-04db-4148-9d64-99458438ec9b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:23:33.242651 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7b5a5456-7b4f-4963-bdd3-342173d2f2f7 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:33.243111 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7b5a5456-7b4f-4963-bdd3-342173d2f2f7 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:33.243569 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7b5a5456-7b4f-4963-bdd3-342173d2f2f7 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:33.244300 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7b5a5456-7b4f-4963-bdd3-342173d2f2f7 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:33.244778 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7b5a5456-7b4f-4963-bdd3-342173d2f2f7 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:33.245525 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7b5a5456-7b4f-4963-bdd3-342173d2f2f7 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:33.406131 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-7b5a5456-7b4f-4963-bdd3-342173d2f2f7 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:33.415660 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-7b5a5456-7b4f-4963-bdd3-342173d2f2f7 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/4d83b3ae-04db-4148-9d64-99458438ec9b" status: 200 len: 1342 microversion: 2.1 time: 0.186156 Oct 04 22:23:33.431013 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3226/6176] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:23:33 2022] GET /compute/v2.1/servers/4d83b3ae-04db-4148-9d64-99458438ec9b => generated 1342 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:23:33.440585 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-08b6e980-f458-4f65-8b6b-8a2b8723e902 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:23:33.441345 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-08b6e980-f458-4f65-8b6b-8a2b8723e902 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] [instance: 3d1e7581-b5c1-4998-a964-8ca90bf36626] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:23:33.449167 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-08b6e980-f458-4f65-8b6b-8a2b8723e902 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:33.449696 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-08b6e980-f458-4f65-8b6b-8a2b8723e902 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:33.450139 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-08b6e980-f458-4f65-8b6b-8a2b8723e902 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:33.450894 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-08b6e980-f458-4f65-8b6b-8a2b8723e902 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:33.451368 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-08b6e980-f458-4f65-8b6b-8a2b8723e902 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:33.451818 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-08b6e980-f458-4f65-8b6b-8a2b8723e902 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:33.521433 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-08b6e980-f458-4f65-8b6b-8a2b8723e902 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '680b9f424ac24ef0b93ff30c9a9d9831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ffabfbee11487b93dc6c9c4509935e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:33.530753 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-08b6e980-f458-4f65-8b6b-8a2b8723e902 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '680b9f424ac24ef0b93ff30c9a9d9831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ffabfbee11487b93dc6c9c4509935e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:33.532285 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-08b6e980-f458-4f65-8b6b-8a2b8723e902 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '680b9f424ac24ef0b93ff30c9a9d9831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ffabfbee11487b93dc6c9c4509935e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:33.533454 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-08b6e980-f458-4f65-8b6b-8a2b8723e902 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] 10.222.0.43 "GET /compute/v2.1/servers/3d1e7581-b5c1-4998-a964-8ca90bf36626" status: 200 len: 1330 microversion: 2.47 time: 0.101813 Oct 04 22:23:33.546751 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3227/6177] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:23:33 2022] GET /compute/v2.1/servers/3d1e7581-b5c1-4998-a964-8ca90bf36626 => generated 1330 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:23:33.749986 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-95818bba-a262-4d39-ac37-c7c22b2826cd tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:23:33.751096 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-95818bba-a262-4d39-ac37-c7c22b2826cd tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] [instance: 333a570b-57ac-40e3-bf33-ebc309bfcd1f] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:23:33.757945 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-95818bba-a262-4d39-ac37-c7c22b2826cd tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:33.758764 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-95818bba-a262-4d39-ac37-c7c22b2826cd tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:33.759396 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-95818bba-a262-4d39-ac37-c7c22b2826cd tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:33.760354 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-95818bba-a262-4d39-ac37-c7c22b2826cd tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:33.760971 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-95818bba-a262-4d39-ac37-c7c22b2826cd tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:33.761643 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-95818bba-a262-4d39-ac37-c7c22b2826cd tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:33.857779 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-95818bba-a262-4d39-ac37-c7c22b2826cd tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92bb4deacc2a45df834a675629a56e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35747ba0bc69465e971ba85c88fff0cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:33.867867 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-95818bba-a262-4d39-ac37-c7c22b2826cd tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] 10.222.0.43 "GET /compute/v2.1/servers/333a570b-57ac-40e3-bf33-ebc309bfcd1f" status: 200 len: 1299 microversion: 2.1 time: 0.122306 Oct 04 22:23:33.868638 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3228/6178] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:23:33 2022] GET /compute/v2.1/servers/333a570b-57ac-40e3-bf33-ebc309bfcd1f => generated 1299 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:23:34.448466 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-80f6d776-5f5d-44c0-be8b-6e9179a260aa tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:23:34.449198 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-80f6d776-5f5d-44c0-be8b-6e9179a260aa tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: 4d83b3ae-04db-4148-9d64-99458438ec9b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:23:34.460771 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-80f6d776-5f5d-44c0-be8b-6e9179a260aa tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:34.461407 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-80f6d776-5f5d-44c0-be8b-6e9179a260aa tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:34.461984 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-80f6d776-5f5d-44c0-be8b-6e9179a260aa tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:34.462777 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-80f6d776-5f5d-44c0-be8b-6e9179a260aa tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:34.463433 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-80f6d776-5f5d-44c0-be8b-6e9179a260aa tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:34.463950 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-80f6d776-5f5d-44c0-be8b-6e9179a260aa tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:34.652208 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-80f6d776-5f5d-44c0-be8b-6e9179a260aa tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:34.662596 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-80f6d776-5f5d-44c0-be8b-6e9179a260aa tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/4d83b3ae-04db-4148-9d64-99458438ec9b" status: 200 len: 1342 microversion: 2.1 time: 0.219400 Oct 04 22:23:34.663716 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3229/6179] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:23:34 2022] GET /compute/v2.1/servers/4d83b3ae-04db-4148-9d64-99458438ec9b => generated 1342 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:23:34.668338 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-10db8091-3993-4c0e-b75a-b9bee5f9470e tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:23:34.669063 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-10db8091-3993-4c0e-b75a-b9bee5f9470e tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] [instance: 3d1e7581-b5c1-4998-a964-8ca90bf36626] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:23:34.675725 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-10db8091-3993-4c0e-b75a-b9bee5f9470e tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:34.676351 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-10db8091-3993-4c0e-b75a-b9bee5f9470e tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:34.676899 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-10db8091-3993-4c0e-b75a-b9bee5f9470e tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:34.677764 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-10db8091-3993-4c0e-b75a-b9bee5f9470e tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:34.678405 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-10db8091-3993-4c0e-b75a-b9bee5f9470e tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:34.678990 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-10db8091-3993-4c0e-b75a-b9bee5f9470e tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:34.749273 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-10db8091-3993-4c0e-b75a-b9bee5f9470e tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '680b9f424ac24ef0b93ff30c9a9d9831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ffabfbee11487b93dc6c9c4509935e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:34.759392 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-10db8091-3993-4c0e-b75a-b9bee5f9470e tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '680b9f424ac24ef0b93ff30c9a9d9831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ffabfbee11487b93dc6c9c4509935e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:34.761012 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-10db8091-3993-4c0e-b75a-b9bee5f9470e tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '680b9f424ac24ef0b93ff30c9a9d9831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ffabfbee11487b93dc6c9c4509935e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:34.762295 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-10db8091-3993-4c0e-b75a-b9bee5f9470e tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] 10.222.0.43 "GET /compute/v2.1/servers/3d1e7581-b5c1-4998-a964-8ca90bf36626" status: 200 len: 1330 microversion: 2.47 time: 0.097571 Oct 04 22:23:34.774390 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3230/6180] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:23:34 2022] GET /compute/v2.1/servers/3d1e7581-b5c1-4998-a964-8ca90bf36626 => generated 1330 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:23:34.892255 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-96bba1a4-c314-44a7-804d-ce435fbf92b7 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:23:34.893126 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-96bba1a4-c314-44a7-804d-ce435fbf92b7 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] [instance: 333a570b-57ac-40e3-bf33-ebc309bfcd1f] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:23:34.899889 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-96bba1a4-c314-44a7-804d-ce435fbf92b7 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:34.900398 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-96bba1a4-c314-44a7-804d-ce435fbf92b7 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:34.900851 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-96bba1a4-c314-44a7-804d-ce435fbf92b7 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:34.901568 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-96bba1a4-c314-44a7-804d-ce435fbf92b7 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:34.902035 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-96bba1a4-c314-44a7-804d-ce435fbf92b7 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:34.902700 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-96bba1a4-c314-44a7-804d-ce435fbf92b7 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:34.995941 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-96bba1a4-c314-44a7-804d-ce435fbf92b7 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92bb4deacc2a45df834a675629a56e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35747ba0bc69465e971ba85c88fff0cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:35.006516 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-96bba1a4-c314-44a7-804d-ce435fbf92b7 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] 10.222.0.43 "GET /compute/v2.1/servers/333a570b-57ac-40e3-bf33-ebc309bfcd1f" status: 200 len: 1472 microversion: 2.1 time: 0.118912 Oct 04 22:23:35.026241 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3231/6181] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:23:34 2022] GET /compute/v2.1/servers/333a570b-57ac-40e3-bf33-ebc309bfcd1f => generated 1472 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:23:35.033067 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-b9c8b619-c0e7-4563-bf7e-274bdbb2cff6 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:23:35.034047 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-b9c8b619-c0e7-4563-bf7e-274bdbb2cff6 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] [instance: 333a570b-57ac-40e3-bf33-ebc309bfcd1f] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:23:35.040864 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b9c8b619-c0e7-4563-bf7e-274bdbb2cff6 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:35.041603 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b9c8b619-c0e7-4563-bf7e-274bdbb2cff6 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:35.042231 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b9c8b619-c0e7-4563-bf7e-274bdbb2cff6 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:35.043359 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b9c8b619-c0e7-4563-bf7e-274bdbb2cff6 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:35.043996 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b9c8b619-c0e7-4563-bf7e-274bdbb2cff6 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:35.044596 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b9c8b619-c0e7-4563-bf7e-274bdbb2cff6 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:35.133632 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-b9c8b619-c0e7-4563-bf7e-274bdbb2cff6 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92bb4deacc2a45df834a675629a56e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35747ba0bc69465e971ba85c88fff0cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:35.142971 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-b9c8b619-c0e7-4563-bf7e-274bdbb2cff6 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] 10.222.0.43 "GET /compute/v2.1/servers/333a570b-57ac-40e3-bf33-ebc309bfcd1f" status: 200 len: 1472 microversion: 2.1 time: 0.114733 Oct 04 22:23:35.159807 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3232/6182] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:23:35 2022] GET /compute/v2.1/servers/333a570b-57ac-40e3-bf33-ebc309bfcd1f => generated 1472 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:23:35.168722 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-fc9cb013-a77b-49f5-8075-8ba3b74ff1fc tempest-TestSecurityGroupsBasicOps-1565614030 tempest-TestSecurityGroupsBasicOps-1565614030-project-admin] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:23:35.170138 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-fc9cb013-a77b-49f5-8075-8ba3b74ff1fc tempest-TestSecurityGroupsBasicOps-1565614030 tempest-TestSecurityGroupsBasicOps-1565614030-project-admin] [instance: 333a570b-57ac-40e3-bf33-ebc309bfcd1f] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:23:35.177037 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fc9cb013-a77b-49f5-8075-8ba3b74ff1fc tempest-TestSecurityGroupsBasicOps-1565614030 tempest-TestSecurityGroupsBasicOps-1565614030-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:35.177630 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fc9cb013-a77b-49f5-8075-8ba3b74ff1fc tempest-TestSecurityGroupsBasicOps-1565614030 tempest-TestSecurityGroupsBasicOps-1565614030-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:35.178268 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fc9cb013-a77b-49f5-8075-8ba3b74ff1fc tempest-TestSecurityGroupsBasicOps-1565614030 tempest-TestSecurityGroupsBasicOps-1565614030-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:35.179167 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fc9cb013-a77b-49f5-8075-8ba3b74ff1fc tempest-TestSecurityGroupsBasicOps-1565614030 tempest-TestSecurityGroupsBasicOps-1565614030-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:35.179824 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fc9cb013-a77b-49f5-8075-8ba3b74ff1fc tempest-TestSecurityGroupsBasicOps-1565614030 tempest-TestSecurityGroupsBasicOps-1565614030-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:35.180792 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fc9cb013-a77b-49f5-8075-8ba3b74ff1fc tempest-TestSecurityGroupsBasicOps-1565614030 tempest-TestSecurityGroupsBasicOps-1565614030-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:35.454010 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-fc9cb013-a77b-49f5-8075-8ba3b74ff1fc tempest-TestSecurityGroupsBasicOps-1565614030 tempest-TestSecurityGroupsBasicOps-1565614030-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/333a570b-57ac-40e3-bf33-ebc309bfcd1f" status: 200 len: 1623 microversion: 2.1 time: 0.289863 Oct 04 22:23:35.458725 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3233/6183] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:23:35 2022] GET /compute/v2.1/servers/333a570b-57ac-40e3-bf33-ebc309bfcd1f => generated 1623 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:23:35.512531 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-c3b69071-b3a7-44ba-b94b-a343d9d87f2d tempest-TestSecurityGroupsBasicOps-1565614030 tempest-TestSecurityGroupsBasicOps-1565614030-project-admin] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:23:35.513391 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-c3b69071-b3a7-44ba-b94b-a343d9d87f2d tempest-TestSecurityGroupsBasicOps-1565614030 tempest-TestSecurityGroupsBasicOps-1565614030-project-admin] [instance: ef43593b-be9b-4e5f-89c4-17a7e6030e29] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:23:35.522818 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c3b69071-b3a7-44ba-b94b-a343d9d87f2d tempest-TestSecurityGroupsBasicOps-1565614030 tempest-TestSecurityGroupsBasicOps-1565614030-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:35.523632 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c3b69071-b3a7-44ba-b94b-a343d9d87f2d tempest-TestSecurityGroupsBasicOps-1565614030 tempest-TestSecurityGroupsBasicOps-1565614030-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:35.524267 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c3b69071-b3a7-44ba-b94b-a343d9d87f2d tempest-TestSecurityGroupsBasicOps-1565614030 tempest-TestSecurityGroupsBasicOps-1565614030-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:35.525172 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c3b69071-b3a7-44ba-b94b-a343d9d87f2d tempest-TestSecurityGroupsBasicOps-1565614030 tempest-TestSecurityGroupsBasicOps-1565614030-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:35.525813 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c3b69071-b3a7-44ba-b94b-a343d9d87f2d tempest-TestSecurityGroupsBasicOps-1565614030 tempest-TestSecurityGroupsBasicOps-1565614030-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:35.526513 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c3b69071-b3a7-44ba-b94b-a343d9d87f2d tempest-TestSecurityGroupsBasicOps-1565614030 tempest-TestSecurityGroupsBasicOps-1565614030-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:35.747305 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-c3b69071-b3a7-44ba-b94b-a343d9d87f2d tempest-TestSecurityGroupsBasicOps-1565614030 tempest-TestSecurityGroupsBasicOps-1565614030-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/ef43593b-be9b-4e5f-89c4-17a7e6030e29" status: 200 len: 1913 microversion: 2.1 time: 0.251689 Oct 04 22:23:35.755179 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3234/6184] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:23:35 2022] GET /compute/v2.1/servers/ef43593b-be9b-4e5f-89c4-17a7e6030e29 => generated 1913 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:23:35.764142 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-17e776e7-d90e-4f33-b822-ce50c1b7d5a0 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:23:35.764704 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-17e776e7-d90e-4f33-b822-ce50c1b7d5a0 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: 4d83b3ae-04db-4148-9d64-99458438ec9b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:23:35.784126 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-17e776e7-d90e-4f33-b822-ce50c1b7d5a0 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:35.785128 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-17e776e7-d90e-4f33-b822-ce50c1b7d5a0 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:35.786039 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-17e776e7-d90e-4f33-b822-ce50c1b7d5a0 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:35.786814 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-17e776e7-d90e-4f33-b822-ce50c1b7d5a0 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:35.787299 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-17e776e7-d90e-4f33-b822-ce50c1b7d5a0 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:35.787751 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-17e776e7-d90e-4f33-b822-ce50c1b7d5a0 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:36.017896 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-17e776e7-d90e-4f33-b822-ce50c1b7d5a0 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:36.032476 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-17e776e7-d90e-4f33-b822-ce50c1b7d5a0 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/4d83b3ae-04db-4148-9d64-99458438ec9b" status: 200 len: 1342 microversion: 2.1 time: 0.283529 Oct 04 22:23:36.033734 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3235/6185] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:23:35 2022] GET /compute/v2.1/servers/4d83b3ae-04db-4148-9d64-99458438ec9b => generated 1342 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:23:36.038797 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-4901a9ed-2357-41de-b79a-497995fc65a2 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:23:36.039437 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-4901a9ed-2357-41de-b79a-497995fc65a2 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] [instance: 3d1e7581-b5c1-4998-a964-8ca90bf36626] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:23:36.047118 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4901a9ed-2357-41de-b79a-497995fc65a2 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:36.051394 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4901a9ed-2357-41de-b79a-497995fc65a2 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:36.052117 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4901a9ed-2357-41de-b79a-497995fc65a2 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:36.053201 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4901a9ed-2357-41de-b79a-497995fc65a2 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:36.057180 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4901a9ed-2357-41de-b79a-497995fc65a2 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:36.057635 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4901a9ed-2357-41de-b79a-497995fc65a2 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:36.144200 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-4901a9ed-2357-41de-b79a-497995fc65a2 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '680b9f424ac24ef0b93ff30c9a9d9831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ffabfbee11487b93dc6c9c4509935e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:36.163351 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-4901a9ed-2357-41de-b79a-497995fc65a2 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '680b9f424ac24ef0b93ff30c9a9d9831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ffabfbee11487b93dc6c9c4509935e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:36.164971 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-4901a9ed-2357-41de-b79a-497995fc65a2 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '680b9f424ac24ef0b93ff30c9a9d9831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ffabfbee11487b93dc6c9c4509935e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:36.166287 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-4901a9ed-2357-41de-b79a-497995fc65a2 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] 10.222.0.43 "GET /compute/v2.1/servers/3d1e7581-b5c1-4998-a964-8ca90bf36626" status: 200 len: 1348 microversion: 2.47 time: 0.131361 Oct 04 22:23:36.167306 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3236/6186] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:23:36 2022] GET /compute/v2.1/servers/3d1e7581-b5c1-4998-a964-8ca90bf36626 => generated 1348 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:23:36.171953 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-db464e5a-ebaa-4e9f-a629-27891ef37f47 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:23:36.172749 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-db464e5a-ebaa-4e9f-a629-27891ef37f47 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] [instance: 333a570b-57ac-40e3-bf33-ebc309bfcd1f] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:23:36.179415 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-db464e5a-ebaa-4e9f-a629-27891ef37f47 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:36.180278 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-db464e5a-ebaa-4e9f-a629-27891ef37f47 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:36.180953 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-db464e5a-ebaa-4e9f-a629-27891ef37f47 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:36.181880 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-db464e5a-ebaa-4e9f-a629-27891ef37f47 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:36.182865 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-db464e5a-ebaa-4e9f-a629-27891ef37f47 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:36.183233 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-db464e5a-ebaa-4e9f-a629-27891ef37f47 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:36.216638 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-db464e5a-ebaa-4e9f-a629-27891ef37f47 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] [instance: 333a570b-57ac-40e3-bf33-ebc309bfcd1f] Going to try to terminate instance {{(pid=134101) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 22:23:36.278122 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:23:36.321587 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-db464e5a-ebaa-4e9f-a629-27891ef37f47 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] 10.222.0.43 "DELETE /compute/v2.1/servers/333a570b-57ac-40e3-bf33-ebc309bfcd1f" status: 204 len: 0 microversion: 2.1 time: 0.152737 Oct 04 22:23:36.327693 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3237/6187] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 22:23:36 2022] DELETE /compute/v2.1/servers/333a570b-57ac-40e3-bf33-ebc309bfcd1f => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 22:23:36.346554 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-9bc8a390-0883-4eb9-bdf4-5786fbf019e7 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:23:36.346554 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-9bc8a390-0883-4eb9-bdf4-5786fbf019e7 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] [instance: 333a570b-57ac-40e3-bf33-ebc309bfcd1f] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:23:36.365355 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9bc8a390-0883-4eb9-bdf4-5786fbf019e7 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:36.365940 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9bc8a390-0883-4eb9-bdf4-5786fbf019e7 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:36.366577 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9bc8a390-0883-4eb9-bdf4-5786fbf019e7 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:36.367305 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9bc8a390-0883-4eb9-bdf4-5786fbf019e7 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:36.367788 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9bc8a390-0883-4eb9-bdf4-5786fbf019e7 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:36.372876 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9bc8a390-0883-4eb9-bdf4-5786fbf019e7 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:36.561980 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-9bc8a390-0883-4eb9-bdf4-5786fbf019e7 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92bb4deacc2a45df834a675629a56e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35747ba0bc69465e971ba85c88fff0cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:36.576374 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-9bc8a390-0883-4eb9-bdf4-5786fbf019e7 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] 10.222.0.43 "GET /compute/v2.1/servers/333a570b-57ac-40e3-bf33-ebc309bfcd1f" status: 200 len: 1478 microversion: 2.1 time: 0.244570 Oct 04 22:23:36.577646 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3238/6188] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:23:36 2022] GET /compute/v2.1/servers/333a570b-57ac-40e3-bf33-ebc309bfcd1f => generated 1478 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:23:37.077930 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-921f6298-4087-443d-946c-332a8c9321b3 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:23:37.079651 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-921f6298-4087-443d-946c-332a8c9321b3 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: 4d83b3ae-04db-4148-9d64-99458438ec9b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:23:37.098407 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-921f6298-4087-443d-946c-332a8c9321b3 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:37.100317 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-921f6298-4087-443d-946c-332a8c9321b3 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:37.100946 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-921f6298-4087-443d-946c-332a8c9321b3 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:37.101814 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-921f6298-4087-443d-946c-332a8c9321b3 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:37.102582 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-921f6298-4087-443d-946c-332a8c9321b3 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:37.105530 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-921f6298-4087-443d-946c-332a8c9321b3 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:37.311138 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-921f6298-4087-443d-946c-332a8c9321b3 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:37.323348 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-921f6298-4087-443d-946c-332a8c9321b3 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/4d83b3ae-04db-4148-9d64-99458438ec9b" status: 200 len: 1342 microversion: 2.1 time: 0.258181 Oct 04 22:23:37.326519 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3239/6189] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:23:37 2022] GET /compute/v2.1/servers/4d83b3ae-04db-4148-9d64-99458438ec9b => generated 1342 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:23:37.332095 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-b11fe0a3-96b2-49d3-a069-28cc715dda54 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:23:37.332730 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-b11fe0a3-96b2-49d3-a069-28cc715dda54 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] [instance: 3d1e7581-b5c1-4998-a964-8ca90bf36626] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:23:37.339181 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b11fe0a3-96b2-49d3-a069-28cc715dda54 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:37.339574 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b11fe0a3-96b2-49d3-a069-28cc715dda54 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:37.339942 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b11fe0a3-96b2-49d3-a069-28cc715dda54 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:37.340771 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b11fe0a3-96b2-49d3-a069-28cc715dda54 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:37.341488 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b11fe0a3-96b2-49d3-a069-28cc715dda54 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:37.342060 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b11fe0a3-96b2-49d3-a069-28cc715dda54 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:37.422227 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-b11fe0a3-96b2-49d3-a069-28cc715dda54 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '680b9f424ac24ef0b93ff30c9a9d9831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ffabfbee11487b93dc6c9c4509935e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:37.433996 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-b11fe0a3-96b2-49d3-a069-28cc715dda54 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '680b9f424ac24ef0b93ff30c9a9d9831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ffabfbee11487b93dc6c9c4509935e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:37.435502 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-b11fe0a3-96b2-49d3-a069-28cc715dda54 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '680b9f424ac24ef0b93ff30c9a9d9831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ffabfbee11487b93dc6c9c4509935e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:37.436834 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-b11fe0a3-96b2-49d3-a069-28cc715dda54 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] 10.222.0.43 "GET /compute/v2.1/servers/3d1e7581-b5c1-4998-a964-8ca90bf36626" status: 200 len: 1336 microversion: 2.47 time: 0.109112 Oct 04 22:23:37.437546 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3240/6190] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:23:37 2022] GET /compute/v2.1/servers/3d1e7581-b5c1-4998-a964-8ca90bf36626 => generated 1336 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:23:37.617743 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-94a0a300-10ce-4ce3-8ddf-397ddfbc13c9 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:23:37.621148 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-94a0a300-10ce-4ce3-8ddf-397ddfbc13c9 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] [instance: 333a570b-57ac-40e3-bf33-ebc309bfcd1f] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:23:37.633190 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-94a0a300-10ce-4ce3-8ddf-397ddfbc13c9 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:37.634071 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-94a0a300-10ce-4ce3-8ddf-397ddfbc13c9 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:37.635501 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-94a0a300-10ce-4ce3-8ddf-397ddfbc13c9 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:37.637461 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-94a0a300-10ce-4ce3-8ddf-397ddfbc13c9 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:37.637461 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-94a0a300-10ce-4ce3-8ddf-397ddfbc13c9 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:37.638763 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-94a0a300-10ce-4ce3-8ddf-397ddfbc13c9 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:37.758038 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-94a0a300-10ce-4ce3-8ddf-397ddfbc13c9 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92bb4deacc2a45df834a675629a56e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35747ba0bc69465e971ba85c88fff0cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:37.769040 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-94a0a300-10ce-4ce3-8ddf-397ddfbc13c9 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] 10.222.0.43 "GET /compute/v2.1/servers/333a570b-57ac-40e3-bf33-ebc309bfcd1f" status: 200 len: 1478 microversion: 2.1 time: 0.168525 Oct 04 22:23:37.771347 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3241/6191] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:23:37 2022] GET /compute/v2.1/servers/333a570b-57ac-40e3-bf33-ebc309bfcd1f => generated 1478 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:23:38.362574 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e1a73cb9-126f-4731-be13-90b16e41e3fb tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:23:38.363473 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-e1a73cb9-126f-4731-be13-90b16e41e3fb tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: 4d83b3ae-04db-4148-9d64-99458438ec9b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:23:38.372634 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e1a73cb9-126f-4731-be13-90b16e41e3fb tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:38.373168 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e1a73cb9-126f-4731-be13-90b16e41e3fb tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:38.373625 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e1a73cb9-126f-4731-be13-90b16e41e3fb tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:38.374412 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e1a73cb9-126f-4731-be13-90b16e41e3fb tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:38.375108 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e1a73cb9-126f-4731-be13-90b16e41e3fb tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:38.375713 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e1a73cb9-126f-4731-be13-90b16e41e3fb tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:38.573437 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-e1a73cb9-126f-4731-be13-90b16e41e3fb tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:38.590889 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-e1a73cb9-126f-4731-be13-90b16e41e3fb tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/4d83b3ae-04db-4148-9d64-99458438ec9b" status: 200 len: 1342 microversion: 2.1 time: 0.233031 Oct 04 22:23:38.591812 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3242/6192] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:23:38 2022] GET /compute/v2.1/servers/4d83b3ae-04db-4148-9d64-99458438ec9b => generated 1342 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:23:38.598597 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-748cb49c-cf8f-48dd-9db7-0afe8ae080ca tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:23:38.599296 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-748cb49c-cf8f-48dd-9db7-0afe8ae080ca tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] [instance: 3d1e7581-b5c1-4998-a964-8ca90bf36626] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:23:38.609269 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-748cb49c-cf8f-48dd-9db7-0afe8ae080ca tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:38.609891 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-748cb49c-cf8f-48dd-9db7-0afe8ae080ca tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:38.611335 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-748cb49c-cf8f-48dd-9db7-0afe8ae080ca tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:38.612546 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-748cb49c-cf8f-48dd-9db7-0afe8ae080ca tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:38.614611 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-748cb49c-cf8f-48dd-9db7-0afe8ae080ca tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:38.615603 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-748cb49c-cf8f-48dd-9db7-0afe8ae080ca tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:38.698888 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-748cb49c-cf8f-48dd-9db7-0afe8ae080ca tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '680b9f424ac24ef0b93ff30c9a9d9831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ffabfbee11487b93dc6c9c4509935e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:38.711566 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-748cb49c-cf8f-48dd-9db7-0afe8ae080ca tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '680b9f424ac24ef0b93ff30c9a9d9831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ffabfbee11487b93dc6c9c4509935e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:38.713778 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-748cb49c-cf8f-48dd-9db7-0afe8ae080ca tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '680b9f424ac24ef0b93ff30c9a9d9831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ffabfbee11487b93dc6c9c4509935e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:38.714337 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-748cb49c-cf8f-48dd-9db7-0afe8ae080ca tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] 10.222.0.43 "GET /compute/v2.1/servers/3d1e7581-b5c1-4998-a964-8ca90bf36626" status: 200 len: 1336 microversion: 2.47 time: 0.121173 Oct 04 22:23:38.715011 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3243/6193] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:23:38 2022] GET /compute/v2.1/servers/3d1e7581-b5c1-4998-a964-8ca90bf36626 => generated 1336 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:23:38.798426 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-d23edfa1-1887-4fc4-9c6b-49fff92e65ed tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:23:38.799282 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-d23edfa1-1887-4fc4-9c6b-49fff92e65ed tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] [instance: 333a570b-57ac-40e3-bf33-ebc309bfcd1f] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:23:38.808539 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d23edfa1-1887-4fc4-9c6b-49fff92e65ed tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:38.809122 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d23edfa1-1887-4fc4-9c6b-49fff92e65ed tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:38.809652 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d23edfa1-1887-4fc4-9c6b-49fff92e65ed tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:38.810524 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d23edfa1-1887-4fc4-9c6b-49fff92e65ed tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:38.811084 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d23edfa1-1887-4fc4-9c6b-49fff92e65ed tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:38.811641 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d23edfa1-1887-4fc4-9c6b-49fff92e65ed tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:38.915841 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-d23edfa1-1887-4fc4-9c6b-49fff92e65ed tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92bb4deacc2a45df834a675629a56e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35747ba0bc69465e971ba85c88fff0cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:38.927173 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-d23edfa1-1887-4fc4-9c6b-49fff92e65ed tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] 10.222.0.43 "GET /compute/v2.1/servers/333a570b-57ac-40e3-bf33-ebc309bfcd1f" status: 200 len: 1478 microversion: 2.1 time: 0.133174 Oct 04 22:23:38.928750 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3244/6194] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:23:38 2022] GET /compute/v2.1/servers/333a570b-57ac-40e3-bf33-ebc309bfcd1f => generated 1478 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:23:39.096635 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-40b5a4b2-a6ce-461e-a7d0-0181dbafe683 req-cdceb9f3-906e-49b9-9494-7c9d48bd0bfe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "333a570b-57ac-40e3-bf33-ebc309bfcd1f", "name": "network-vif-deleted", "tag": "b7cea7e2-96bd-47fb-86e0-42e3c7a01c96"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:23:39.110131 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-40b5a4b2-a6ce-461e-a7d0-0181dbafe683 req-cdceb9f3-906e-49b9-9494-7c9d48bd0bfe service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:39.111563 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-40b5a4b2-a6ce-461e-a7d0-0181dbafe683 req-cdceb9f3-906e-49b9-9494-7c9d48bd0bfe service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:39.112134 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-40b5a4b2-a6ce-461e-a7d0-0181dbafe683 req-cdceb9f3-906e-49b9-9494-7c9d48bd0bfe service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:39.175060 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-40b5a4b2-a6ce-461e-a7d0-0181dbafe683 req-cdceb9f3-906e-49b9-9494-7c9d48bd0bfe service nova] Creating event network-vif-deleted:b7cea7e2-96bd-47fb-86e0-42e3c7a01c96 for instance 333a570b-57ac-40e3-bf33-ebc309bfcd1f on n-h2-860284-1 Oct 04 22:23:39.193092 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-40b5a4b2-a6ce-461e-a7d0-0181dbafe683 req-cdceb9f3-906e-49b9-9494-7c9d48bd0bfe service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100644 Oct 04 22:23:39.197714 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3245/6195] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:23:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:23:39.626873 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-82f80edb-644f-4dfa-bb74-b14c5137ac4d tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:23:39.628613 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-82f80edb-644f-4dfa-bb74-b14c5137ac4d tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: 4d83b3ae-04db-4148-9d64-99458438ec9b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:23:39.637550 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-82f80edb-644f-4dfa-bb74-b14c5137ac4d tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:39.638128 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-82f80edb-644f-4dfa-bb74-b14c5137ac4d tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:39.638619 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-82f80edb-644f-4dfa-bb74-b14c5137ac4d tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:39.639373 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-82f80edb-644f-4dfa-bb74-b14c5137ac4d tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:39.639908 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-82f80edb-644f-4dfa-bb74-b14c5137ac4d tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:39.640370 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-82f80edb-644f-4dfa-bb74-b14c5137ac4d tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:39.872657 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-82f80edb-644f-4dfa-bb74-b14c5137ac4d tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:39.886239 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-82f80edb-644f-4dfa-bb74-b14c5137ac4d tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/4d83b3ae-04db-4148-9d64-99458438ec9b" status: 200 len: 1342 microversion: 2.1 time: 0.270927 Oct 04 22:23:39.889114 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3246/6196] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:23:39 2022] GET /compute/v2.1/servers/4d83b3ae-04db-4148-9d64-99458438ec9b => generated 1342 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:23:39.911343 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-fca31c3b-63de-4cb4-8a8f-ac1bbfa3fa30 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:23:39.912362 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-fca31c3b-63de-4cb4-8a8f-ac1bbfa3fa30 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] [instance: 3d1e7581-b5c1-4998-a964-8ca90bf36626] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:23:39.919788 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fca31c3b-63de-4cb4-8a8f-ac1bbfa3fa30 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:39.920614 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fca31c3b-63de-4cb4-8a8f-ac1bbfa3fa30 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:39.921308 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fca31c3b-63de-4cb4-8a8f-ac1bbfa3fa30 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:39.922096 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fca31c3b-63de-4cb4-8a8f-ac1bbfa3fa30 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:39.923063 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fca31c3b-63de-4cb4-8a8f-ac1bbfa3fa30 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:39.923806 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fca31c3b-63de-4cb4-8a8f-ac1bbfa3fa30 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:40.023409 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-fca31c3b-63de-4cb4-8a8f-ac1bbfa3fa30 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '680b9f424ac24ef0b93ff30c9a9d9831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ffabfbee11487b93dc6c9c4509935e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:40.036150 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-fca31c3b-63de-4cb4-8a8f-ac1bbfa3fa30 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '680b9f424ac24ef0b93ff30c9a9d9831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ffabfbee11487b93dc6c9c4509935e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:40.041099 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-fca31c3b-63de-4cb4-8a8f-ac1bbfa3fa30 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '680b9f424ac24ef0b93ff30c9a9d9831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ffabfbee11487b93dc6c9c4509935e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:40.043286 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-fca31c3b-63de-4cb4-8a8f-ac1bbfa3fa30 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] 10.222.0.43 "GET /compute/v2.1/servers/3d1e7581-b5c1-4998-a964-8ca90bf36626" status: 200 len: 1336 microversion: 2.47 time: 0.139467 Oct 04 22:23:40.047136 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3247/6197] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:23:39 2022] GET /compute/v2.1/servers/3d1e7581-b5c1-4998-a964-8ca90bf36626 => generated 1336 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:23:40.052787 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e6c73647-190d-4706-86a9-cc25a7650810 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:23:40.053674 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-e6c73647-190d-4706-86a9-cc25a7650810 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] [instance: 333a570b-57ac-40e3-bf33-ebc309bfcd1f] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:23:40.062095 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e6c73647-190d-4706-86a9-cc25a7650810 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:40.067710 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e6c73647-190d-4706-86a9-cc25a7650810 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:40.067710 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e6c73647-190d-4706-86a9-cc25a7650810 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:40.067710 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e6c73647-190d-4706-86a9-cc25a7650810 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:40.067710 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e6c73647-190d-4706-86a9-cc25a7650810 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:40.067710 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e6c73647-190d-4706-86a9-cc25a7650810 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:40.086298 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-e6c73647-190d-4706-86a9-cc25a7650810 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] HTTP exception thrown: Instance 333a570b-57ac-40e3-bf33-ebc309bfcd1f could not be found. Oct 04 22:23:40.088781 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e6c73647-190d-4706-86a9-cc25a7650810 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Request method failure captured: Oct 04 22:23:40.088781 n-d-860284-1 devstack@n-api.service[134101]: request: GET /compute/v2.1/servers/333a570b-57ac-40e3-bf33-ebc309bfcd1f HTTP/1.1 Oct 04 22:23:40.088781 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 22:23:40.088781 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 22:23:40.088781 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 22:23:40.088781 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 22:23:40.088781 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 22:23:40.088781 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 22:23:40.088781 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 22:23:40.088781 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 22:23:40.088781 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPLHjc3pYvVYUhfhW5nYXY9YtYBne_9W1L9fgjmEcSGCKF0jBvjSKo8Exg5OKckwWdehsjkfm-Q5gPA3sl2Xn0u44tT4famiOl0zOI7Z0tGj7k658ZKhFePaKUkkK2003_TNrGWVEjeZrMme6ZMevU8_zoVQYR36QnEhRKwkc4ZTlQQE Oct 04 22:23:40.088781 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 22:23:40.088781 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 22:23:40.088781 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 22:23:40.088781 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 22:23:40.088781 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 22:23:40.088781 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 22:23:40.088781 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: 35747ba0bc69465e971ba85c88fff0cd Oct 04 22:23:40.088781 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-1566186934 Oct 04 22:23:40.088781 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 22:23:40.088781 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 22:23:40.088781 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/35747ba0bc69465e971ba85c88fff0cd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_35747ba0bc69465e971ba85c88fff0cd", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/35747ba0bc69465e971ba85c88fff0cd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/35747ba0bc69465e971ba85c88fff0cd"}]}] Oct 04 22:23:40.088781 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-TestSecurityGroupsBasicOps-1566186934 Oct 04 22:23:40.088781 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: 35747ba0bc69465e971ba85c88fff0cd Oct 04 22:23:40.088781 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-1566186934 Oct 04 22:23:40.088781 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-TestSecurityGroupsBasicOps-1566186934-project Oct 04 22:23:40.088781 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 22:23:40.088781 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 22:23:40.088781 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 92bb4deacc2a45df834a675629a56e1b Oct 04 22:23:40.088781 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-TestSecurityGroupsBasicOps-1566186934-project Oct 04 22:23:40.088781 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 22:23:40.088781 n-d-860284-1 devstack@n-api.service[134101]: exception: Instance 333a570b-57ac-40e3-bf33-ebc309bfcd1f could not be found. Oct 04 22:23:40.088781 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': '333a570b-57ac-40e3-bf33-ebc309bfcd1f'} Oct 04 22:23:40.088781 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:23:40.088781 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:23:40.088781 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:23:40.088781 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:23:40.088781 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:23:40.088781 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:23:40.088781 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:23:40.088781 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:23:40.088781 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:23:40.088781 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:23:40.088781 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 333a570b-57ac-40e3-bf33-ebc309bfcd1f could not be found. Oct 04 22:23:40.088781 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:23:40.088781 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:23:40.088781 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:23:40.088781 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:23:40.088781 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:23:40.088781 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:23:40.088781 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:23:40.088781 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:23:40.088781 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:23:40.088781 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:23:40.088781 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:23:40.088781 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:23:40.088781 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:23:40.088781 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:23:40.088781 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:23:40.088781 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:23:40.088781 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 333a570b-57ac-40e3-bf33-ebc309bfcd1f could not be found. Oct 04 22:23:40.088781 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:23:40.088781 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:23:40.096119 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:23:40.096119 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:23:40.096119 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:23:40.096119 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:23:40.096119 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:23:40.096119 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:23:40.096119 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 333a570b-57ac-40e3-bf33-ebc309bfcd1f could not be found. Oct 04 22:23:40.096119 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:23:40.096119 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e6c73647-190d-4706-86a9-cc25a7650810 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Returning 404 to user: Instance 333a570b-57ac-40e3-bf33-ebc309bfcd1f could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:23:40.096119 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-e6c73647-190d-4706-86a9-cc25a7650810 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] 10.222.0.43 "GET /compute/v2.1/servers/333a570b-57ac-40e3-bf33-ebc309bfcd1f" status: 404 len: 111 microversion: 2.1 time: 0.041455 Oct 04 22:23:40.096119 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3248/6198] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:23:40 2022] GET /compute/v2.1/servers/333a570b-57ac-40e3-bf33-ebc309bfcd1f => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:23:40.917862 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-ffdf54fe-6ca0-42da-82d7-d116f58f4f59 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:23:40.919487 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-ffdf54fe-6ca0-42da-82d7-d116f58f4f59 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: 4d83b3ae-04db-4148-9d64-99458438ec9b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:23:40.930837 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ffdf54fe-6ca0-42da-82d7-d116f58f4f59 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:40.932080 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ffdf54fe-6ca0-42da-82d7-d116f58f4f59 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:40.932790 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ffdf54fe-6ca0-42da-82d7-d116f58f4f59 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:40.933876 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ffdf54fe-6ca0-42da-82d7-d116f58f4f59 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:40.934617 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ffdf54fe-6ca0-42da-82d7-d116f58f4f59 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:40.935310 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ffdf54fe-6ca0-42da-82d7-d116f58f4f59 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:41.040755 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=8 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:23:41.125337 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=30 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:23:41.194282 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-ffdf54fe-6ca0-42da-82d7-d116f58f4f59 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:41.204921 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-ffdf54fe-6ca0-42da-82d7-d116f58f4f59 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/4d83b3ae-04db-4148-9d64-99458438ec9b" status: 200 len: 1342 microversion: 2.1 time: 0.290612 Oct 04 22:23:41.220201 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3249/6199] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:23:40 2022] GET /compute/v2.1/servers/4d83b3ae-04db-4148-9d64-99458438ec9b => generated 1342 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:23:41.227551 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-a598c5d0-b0c1-4b81-b5d2-1c9522309627 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:23:41.228455 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-a598c5d0-b0c1-4b81-b5d2-1c9522309627 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] [instance: 3d1e7581-b5c1-4998-a964-8ca90bf36626] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:23:41.235264 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a598c5d0-b0c1-4b81-b5d2-1c9522309627 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:41.236049 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a598c5d0-b0c1-4b81-b5d2-1c9522309627 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:41.236646 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a598c5d0-b0c1-4b81-b5d2-1c9522309627 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:41.238233 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a598c5d0-b0c1-4b81-b5d2-1c9522309627 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:41.238743 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a598c5d0-b0c1-4b81-b5d2-1c9522309627 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:41.239323 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a598c5d0-b0c1-4b81-b5d2-1c9522309627 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:41.349171 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-a598c5d0-b0c1-4b81-b5d2-1c9522309627 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '680b9f424ac24ef0b93ff30c9a9d9831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ffabfbee11487b93dc6c9c4509935e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:41.359850 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-a598c5d0-b0c1-4b81-b5d2-1c9522309627 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '680b9f424ac24ef0b93ff30c9a9d9831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ffabfbee11487b93dc6c9c4509935e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:41.361859 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-a598c5d0-b0c1-4b81-b5d2-1c9522309627 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '680b9f424ac24ef0b93ff30c9a9d9831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ffabfbee11487b93dc6c9c4509935e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:41.363214 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-a598c5d0-b0c1-4b81-b5d2-1c9522309627 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] 10.222.0.43 "GET /compute/v2.1/servers/3d1e7581-b5c1-4998-a964-8ca90bf36626" status: 200 len: 1357 microversion: 2.47 time: 0.142697 Oct 04 22:23:41.364011 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3250/6200] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:23:41 2022] GET /compute/v2.1/servers/3d1e7581-b5c1-4998-a964-8ca90bf36626 => generated 1357 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:23:41.400890 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-465e5af3-b4d4-46d0-994d-a23ddf97fbdb tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "58548514-5dac-426c-81f5-19e3fba33e23"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:23:41.405039 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-465e5af3-b4d4-46d0-994d-a23ddf97fbdb tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] [instance: 3d1e7581-b5c1-4998-a964-8ca90bf36626] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:23:41.418061 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-465e5af3-b4d4-46d0-994d-a23ddf97fbdb tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:41.418061 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-465e5af3-b4d4-46d0-994d-a23ddf97fbdb tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:41.420448 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-465e5af3-b4d4-46d0-994d-a23ddf97fbdb tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:41.420448 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-465e5af3-b4d4-46d0-994d-a23ddf97fbdb tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:41.420448 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-465e5af3-b4d4-46d0-994d-a23ddf97fbdb tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:41.420448 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-465e5af3-b4d4-46d0-994d-a23ddf97fbdb tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:41.523255 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-465e5af3-b4d4-46d0-994d-a23ddf97fbdb tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Flavor limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 22:23:41.523255 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-465e5af3-b4d4-46d0-994d-a23ddf97fbdb tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Image limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 22:23:41.523255 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-465e5af3-b4d4-46d0-994d-a23ddf97fbdb tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Flavor pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 22:23:41.523991 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-465e5af3-b4d4-46d0-994d-a23ddf97fbdb tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Image pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 22:23:41.523991 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-465e5af3-b4d4-46d0-994d-a23ddf97fbdb tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 22:23:41.620593 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-465e5af3-b4d4-46d0-994d-a23ddf97fbdb tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] [instance: 3d1e7581-b5c1-4998-a964-8ca90bf36626] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:23:41.636335 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-465e5af3-b4d4-46d0-994d-a23ddf97fbdb tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:41.639627 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-465e5af3-b4d4-46d0-994d-a23ddf97fbdb tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:41.640202 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-465e5af3-b4d4-46d0-994d-a23ddf97fbdb tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:41.644856 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-465e5af3-b4d4-46d0-994d-a23ddf97fbdb tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:41.645486 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-465e5af3-b4d4-46d0-994d-a23ddf97fbdb tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:41.646227 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-465e5af3-b4d4-46d0-994d-a23ddf97fbdb tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:41.716834 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-465e5af3-b4d4-46d0-994d-a23ddf97fbdb tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] 10.222.0.43 "POST /compute/v2.1/servers/3d1e7581-b5c1-4998-a964-8ca90bf36626/action" status: 202 len: 1079 microversion: 2.47 time: 0.321727 Oct 04 22:23:41.717915 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3251/6201] 10.222.0.43 () {62 vars in 1319 bytes} [Tue Oct 4 22:23:41 2022] POST /compute/v2.1/servers/3d1e7581-b5c1-4998-a964-8ca90bf36626/action => generated 1079 bytes in 324 msecs (HTTP/1.1 202) 10 headers in 454 bytes (2 switches on core 0) Oct 04 22:23:41.753546 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-798d8f94-2e1f-42c1-89ec-338f7ab503f0 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:23:41.754800 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-798d8f94-2e1f-42c1-89ec-338f7ab503f0 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] [instance: 3d1e7581-b5c1-4998-a964-8ca90bf36626] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:23:41.764517 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-798d8f94-2e1f-42c1-89ec-338f7ab503f0 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:41.765029 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-798d8f94-2e1f-42c1-89ec-338f7ab503f0 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:41.765483 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-798d8f94-2e1f-42c1-89ec-338f7ab503f0 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:41.766260 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-798d8f94-2e1f-42c1-89ec-338f7ab503f0 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:41.767681 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-798d8f94-2e1f-42c1-89ec-338f7ab503f0 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:41.768256 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-798d8f94-2e1f-42c1-89ec-338f7ab503f0 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:41.883358 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-798d8f94-2e1f-42c1-89ec-338f7ab503f0 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '680b9f424ac24ef0b93ff30c9a9d9831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ffabfbee11487b93dc6c9c4509935e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:41.911160 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-798d8f94-2e1f-42c1-89ec-338f7ab503f0 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '680b9f424ac24ef0b93ff30c9a9d9831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ffabfbee11487b93dc6c9c4509935e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:41.912932 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-798d8f94-2e1f-42c1-89ec-338f7ab503f0 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '680b9f424ac24ef0b93ff30c9a9d9831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ffabfbee11487b93dc6c9c4509935e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:41.914182 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-798d8f94-2e1f-42c1-89ec-338f7ab503f0 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] 10.222.0.43 "GET /compute/v2.1/servers/3d1e7581-b5c1-4998-a964-8ca90bf36626" status: 200 len: 1366 microversion: 2.47 time: 0.174316 Oct 04 22:23:41.919464 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3252/6202] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:23:41 2022] GET /compute/v2.1/servers/3d1e7581-b5c1-4998-a964-8ca90bf36626 => generated 1366 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 22:23:42.234033 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-9813589e-45ba-4823-9af1-0f89f3a70526 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:23:42.235116 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-9813589e-45ba-4823-9af1-0f89f3a70526 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: 4d83b3ae-04db-4148-9d64-99458438ec9b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:23:42.245781 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9813589e-45ba-4823-9af1-0f89f3a70526 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:42.247471 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9813589e-45ba-4823-9af1-0f89f3a70526 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:42.248455 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9813589e-45ba-4823-9af1-0f89f3a70526 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:42.249817 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9813589e-45ba-4823-9af1-0f89f3a70526 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:42.250603 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9813589e-45ba-4823-9af1-0f89f3a70526 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:42.251853 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9813589e-45ba-4823-9af1-0f89f3a70526 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:42.543824 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-9813589e-45ba-4823-9af1-0f89f3a70526 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:42.546062 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=97,nova_cell1:UPDATE=1 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:23:42.555009 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-9813589e-45ba-4823-9af1-0f89f3a70526 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/4d83b3ae-04db-4148-9d64-99458438ec9b" status: 200 len: 1342 microversion: 2.1 time: 0.325670 Oct 04 22:23:42.571284 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3253/6203] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:23:42 2022] GET /compute/v2.1/servers/4d83b3ae-04db-4148-9d64-99458438ec9b => generated 1342 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:23:42.949542 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-84bb4400-508d-471e-89c3-4d2b59f682a6 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:23:42.950186 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-84bb4400-508d-471e-89c3-4d2b59f682a6 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] [instance: 3d1e7581-b5c1-4998-a964-8ca90bf36626] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:23:42.961839 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-84bb4400-508d-471e-89c3-4d2b59f682a6 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:42.964500 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-84bb4400-508d-471e-89c3-4d2b59f682a6 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:42.966627 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-84bb4400-508d-471e-89c3-4d2b59f682a6 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:42.967835 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-84bb4400-508d-471e-89c3-4d2b59f682a6 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:42.969526 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-84bb4400-508d-471e-89c3-4d2b59f682a6 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:42.970066 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-84bb4400-508d-471e-89c3-4d2b59f682a6 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:43.152734 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-84bb4400-508d-471e-89c3-4d2b59f682a6 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '680b9f424ac24ef0b93ff30c9a9d9831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ffabfbee11487b93dc6c9c4509935e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:43.166297 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-84bb4400-508d-471e-89c3-4d2b59f682a6 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '680b9f424ac24ef0b93ff30c9a9d9831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ffabfbee11487b93dc6c9c4509935e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:43.168693 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-84bb4400-508d-471e-89c3-4d2b59f682a6 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '680b9f424ac24ef0b93ff30c9a9d9831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ffabfbee11487b93dc6c9c4509935e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:43.170864 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-84bb4400-508d-471e-89c3-4d2b59f682a6 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] 10.222.0.43 "GET /compute/v2.1/servers/3d1e7581-b5c1-4998-a964-8ca90bf36626" status: 200 len: 1366 microversion: 2.47 time: 0.225984 Oct 04 22:23:43.172171 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3254/6204] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:23:42 2022] GET /compute/v2.1/servers/3d1e7581-b5c1-4998-a964-8ca90bf36626 => generated 1366 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:23:43.579870 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-08d48e75-ef4c-43ad-9e09-f71877ab2170 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:23:43.580739 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-08d48e75-ef4c-43ad-9e09-f71877ab2170 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: 4d83b3ae-04db-4148-9d64-99458438ec9b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:23:43.593894 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-08d48e75-ef4c-43ad-9e09-f71877ab2170 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:43.594455 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-08d48e75-ef4c-43ad-9e09-f71877ab2170 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:43.595128 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-08d48e75-ef4c-43ad-9e09-f71877ab2170 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:43.605205 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-08d48e75-ef4c-43ad-9e09-f71877ab2170 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:43.605720 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-08d48e75-ef4c-43ad-9e09-f71877ab2170 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:43.606181 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-08d48e75-ef4c-43ad-9e09-f71877ab2170 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:43.887736 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-08d48e75-ef4c-43ad-9e09-f71877ab2170 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:43.903848 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-08d48e75-ef4c-43ad-9e09-f71877ab2170 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/4d83b3ae-04db-4148-9d64-99458438ec9b" status: 200 len: 1342 microversion: 2.1 time: 0.328971 Oct 04 22:23:43.921299 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3255/6205] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:23:43 2022] GET /compute/v2.1/servers/4d83b3ae-04db-4148-9d64-99458438ec9b => generated 1342 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:23:44.198618 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-35612b3f-c15c-4e34-bd50-f341d1ceb8a6 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:23:44.201729 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-35612b3f-c15c-4e34-bd50-f341d1ceb8a6 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] [instance: 3d1e7581-b5c1-4998-a964-8ca90bf36626] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:23:44.212550 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-35612b3f-c15c-4e34-bd50-f341d1ceb8a6 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:44.217839 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-35612b3f-c15c-4e34-bd50-f341d1ceb8a6 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:44.218558 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-35612b3f-c15c-4e34-bd50-f341d1ceb8a6 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:44.220101 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-35612b3f-c15c-4e34-bd50-f341d1ceb8a6 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:44.220774 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-35612b3f-c15c-4e34-bd50-f341d1ceb8a6 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:44.222003 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-35612b3f-c15c-4e34-bd50-f341d1ceb8a6 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:44.338655 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-35612b3f-c15c-4e34-bd50-f341d1ceb8a6 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '680b9f424ac24ef0b93ff30c9a9d9831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ffabfbee11487b93dc6c9c4509935e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:44.347967 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-35612b3f-c15c-4e34-bd50-f341d1ceb8a6 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '680b9f424ac24ef0b93ff30c9a9d9831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ffabfbee11487b93dc6c9c4509935e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:44.349733 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-35612b3f-c15c-4e34-bd50-f341d1ceb8a6 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '680b9f424ac24ef0b93ff30c9a9d9831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ffabfbee11487b93dc6c9c4509935e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:44.351112 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-35612b3f-c15c-4e34-bd50-f341d1ceb8a6 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] 10.222.0.43 "GET /compute/v2.1/servers/3d1e7581-b5c1-4998-a964-8ca90bf36626" status: 200 len: 1366 microversion: 2.47 time: 0.157399 Oct 04 22:23:44.367132 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3256/6206] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:23:44 2022] GET /compute/v2.1/servers/3d1e7581-b5c1-4998-a964-8ca90bf36626 => generated 1366 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:23:44.942861 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-56f78cd3-eecf-4d0b-b84a-e98376a5df0f tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:23:44.943805 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-56f78cd3-eecf-4d0b-b84a-e98376a5df0f tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: 4d83b3ae-04db-4148-9d64-99458438ec9b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:23:44.957931 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-56f78cd3-eecf-4d0b-b84a-e98376a5df0f tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:44.958471 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-56f78cd3-eecf-4d0b-b84a-e98376a5df0f tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:44.958927 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-56f78cd3-eecf-4d0b-b84a-e98376a5df0f tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:44.959654 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-56f78cd3-eecf-4d0b-b84a-e98376a5df0f tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:44.960120 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-56f78cd3-eecf-4d0b-b84a-e98376a5df0f tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:44.960659 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-56f78cd3-eecf-4d0b-b84a-e98376a5df0f tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:45.154808 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-56f78cd3-eecf-4d0b-b84a-e98376a5df0f tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:45.165407 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-56f78cd3-eecf-4d0b-b84a-e98376a5df0f tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/4d83b3ae-04db-4148-9d64-99458438ec9b" status: 200 len: 1342 microversion: 2.1 time: 0.240557 Oct 04 22:23:45.166610 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3257/6207] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:23:44 2022] GET /compute/v2.1/servers/4d83b3ae-04db-4148-9d64-99458438ec9b => generated 1342 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:23:45.381502 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-d41919c7-a4ec-428c-8ece-42b01c7d758b tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:23:45.382157 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-d41919c7-a4ec-428c-8ece-42b01c7d758b tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] [instance: 3d1e7581-b5c1-4998-a964-8ca90bf36626] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:23:45.397739 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d41919c7-a4ec-428c-8ece-42b01c7d758b tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:45.398270 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d41919c7-a4ec-428c-8ece-42b01c7d758b tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:45.408766 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d41919c7-a4ec-428c-8ece-42b01c7d758b tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:45.409935 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d41919c7-a4ec-428c-8ece-42b01c7d758b tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:45.411024 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d41919c7-a4ec-428c-8ece-42b01c7d758b tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:45.411667 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d41919c7-a4ec-428c-8ece-42b01c7d758b tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:45.516795 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-d41919c7-a4ec-428c-8ece-42b01c7d758b tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '680b9f424ac24ef0b93ff30c9a9d9831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ffabfbee11487b93dc6c9c4509935e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:45.529717 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-d41919c7-a4ec-428c-8ece-42b01c7d758b tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '680b9f424ac24ef0b93ff30c9a9d9831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ffabfbee11487b93dc6c9c4509935e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:45.533039 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-d41919c7-a4ec-428c-8ece-42b01c7d758b tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '680b9f424ac24ef0b93ff30c9a9d9831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ffabfbee11487b93dc6c9c4509935e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:45.535347 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-d41919c7-a4ec-428c-8ece-42b01c7d758b tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] 10.222.0.43 "GET /compute/v2.1/servers/3d1e7581-b5c1-4998-a964-8ca90bf36626" status: 200 len: 1366 microversion: 2.47 time: 0.157690 Oct 04 22:23:45.536756 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3258/6208] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:23:45 2022] GET /compute/v2.1/servers/3d1e7581-b5c1-4998-a964-8ca90bf36626 => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:23:46.067424 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-d8a7bad4-1211-4af6-a63c-897ff1833764 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:23:46.068159 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-d8a7bad4-1211-4af6-a63c-897ff1833764 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] [instance: ef43593b-be9b-4e5f-89c4-17a7e6030e29] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:23:46.082936 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d8a7bad4-1211-4af6-a63c-897ff1833764 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:46.083620 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d8a7bad4-1211-4af6-a63c-897ff1833764 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:46.084228 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d8a7bad4-1211-4af6-a63c-897ff1833764 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:46.085100 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d8a7bad4-1211-4af6-a63c-897ff1833764 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:46.085710 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d8a7bad4-1211-4af6-a63c-897ff1833764 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:46.086399 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d8a7bad4-1211-4af6-a63c-897ff1833764 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:46.144055 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-d8a7bad4-1211-4af6-a63c-897ff1833764 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] [instance: ef43593b-be9b-4e5f-89c4-17a7e6030e29] Going to try to terminate instance {{(pid=134101) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 22:23:46.234512 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:23:46.255716 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-d8a7bad4-1211-4af6-a63c-897ff1833764 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] 10.222.0.43 "DELETE /compute/v2.1/servers/ef43593b-be9b-4e5f-89c4-17a7e6030e29" status: 204 len: 0 microversion: 2.1 time: 0.192492 Oct 04 22:23:46.257504 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3259/6209] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 22:23:46 2022] DELETE /compute/v2.1/servers/ef43593b-be9b-4e5f-89c4-17a7e6030e29 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 22:23:46.267119 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-4df36f48-474f-48d9-bc75-88f4fddda7df req-77564b34-e447-43c3-b9ef-dcc236757af8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef43593b-be9b-4e5f-89c4-17a7e6030e29", "tag": "d4ad42be-39ad-404b-9392-f2b7142e73bc"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:23:46.280443 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-4df36f48-474f-48d9-bc75-88f4fddda7df req-77564b34-e447-43c3-b9ef-dcc236757af8 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:46.281304 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-4df36f48-474f-48d9-bc75-88f4fddda7df req-77564b34-e447-43c3-b9ef-dcc236757af8 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:46.283127 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-4df36f48-474f-48d9-bc75-88f4fddda7df req-77564b34-e447-43c3-b9ef-dcc236757af8 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:46.307980 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-4df36f48-474f-48d9-bc75-88f4fddda7df req-77564b34-e447-43c3-b9ef-dcc236757af8 service nova] Creating event network-changed:d4ad42be-39ad-404b-9392-f2b7142e73bc for instance ef43593b-be9b-4e5f-89c4-17a7e6030e29 on n-h1-860284-1 Oct 04 22:23:46.316331 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-4df36f48-474f-48d9-bc75-88f4fddda7df req-77564b34-e447-43c3-b9ef-dcc236757af8 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056324 Oct 04 22:23:46.320345 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3260/6210] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:23:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:23:46.326502 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-b1a63ecf-ffcf-4a2b-b7a5-35ff9c8be006 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:23:46.327514 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-b1a63ecf-ffcf-4a2b-b7a5-35ff9c8be006 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: 4d83b3ae-04db-4148-9d64-99458438ec9b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:23:46.336975 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b1a63ecf-ffcf-4a2b-b7a5-35ff9c8be006 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:46.337508 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b1a63ecf-ffcf-4a2b-b7a5-35ff9c8be006 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:46.338093 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b1a63ecf-ffcf-4a2b-b7a5-35ff9c8be006 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:46.339129 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b1a63ecf-ffcf-4a2b-b7a5-35ff9c8be006 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:46.339683 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b1a63ecf-ffcf-4a2b-b7a5-35ff9c8be006 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:46.340202 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b1a63ecf-ffcf-4a2b-b7a5-35ff9c8be006 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:46.523539 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-b1a63ecf-ffcf-4a2b-b7a5-35ff9c8be006 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:46.533545 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-b1a63ecf-ffcf-4a2b-b7a5-35ff9c8be006 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/4d83b3ae-04db-4148-9d64-99458438ec9b" status: 200 len: 1342 microversion: 2.1 time: 0.211794 Oct 04 22:23:46.552728 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3261/6211] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:23:46 2022] GET /compute/v2.1/servers/4d83b3ae-04db-4148-9d64-99458438ec9b => generated 1342 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:23:46.558437 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-cdb1fa08-8b8e-4a6f-b6f4-cf6e1a7e9caa tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:23:46.559182 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-cdb1fa08-8b8e-4a6f-b6f4-cf6e1a7e9caa tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] [instance: ef43593b-be9b-4e5f-89c4-17a7e6030e29] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:23:46.567282 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cdb1fa08-8b8e-4a6f-b6f4-cf6e1a7e9caa tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:46.567918 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cdb1fa08-8b8e-4a6f-b6f4-cf6e1a7e9caa tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:46.568451 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cdb1fa08-8b8e-4a6f-b6f4-cf6e1a7e9caa tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:46.569267 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cdb1fa08-8b8e-4a6f-b6f4-cf6e1a7e9caa tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:46.569815 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cdb1fa08-8b8e-4a6f-b6f4-cf6e1a7e9caa tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:46.570938 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cdb1fa08-8b8e-4a6f-b6f4-cf6e1a7e9caa tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:46.756286 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-cdb1fa08-8b8e-4a6f-b6f4-cf6e1a7e9caa tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92bb4deacc2a45df834a675629a56e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35747ba0bc69465e971ba85c88fff0cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:46.764406 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-cdb1fa08-8b8e-4a6f-b6f4-cf6e1a7e9caa tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] 10.222.0.43 "GET /compute/v2.1/servers/ef43593b-be9b-4e5f-89c4-17a7e6030e29" status: 200 len: 1768 microversion: 2.1 time: 0.210305 Oct 04 22:23:46.765453 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3262/6212] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:23:46 2022] GET /compute/v2.1/servers/ef43593b-be9b-4e5f-89c4-17a7e6030e29 => generated 1768 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:23:46.772228 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-ba8373a1-6072-47e8-8bee-6a8b4e4e2c35 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:23:46.773065 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-ba8373a1-6072-47e8-8bee-6a8b4e4e2c35 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] [instance: 3d1e7581-b5c1-4998-a964-8ca90bf36626] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:23:46.780003 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ba8373a1-6072-47e8-8bee-6a8b4e4e2c35 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:46.780680 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ba8373a1-6072-47e8-8bee-6a8b4e4e2c35 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:46.781290 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ba8373a1-6072-47e8-8bee-6a8b4e4e2c35 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:46.783128 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ba8373a1-6072-47e8-8bee-6a8b4e4e2c35 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:46.783739 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ba8373a1-6072-47e8-8bee-6a8b4e4e2c35 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:46.784330 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ba8373a1-6072-47e8-8bee-6a8b4e4e2c35 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:46.873966 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-ba8373a1-6072-47e8-8bee-6a8b4e4e2c35 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '680b9f424ac24ef0b93ff30c9a9d9831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ffabfbee11487b93dc6c9c4509935e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:46.886868 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-ba8373a1-6072-47e8-8bee-6a8b4e4e2c35 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '680b9f424ac24ef0b93ff30c9a9d9831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ffabfbee11487b93dc6c9c4509935e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:46.888336 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-ba8373a1-6072-47e8-8bee-6a8b4e4e2c35 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '680b9f424ac24ef0b93ff30c9a9d9831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ffabfbee11487b93dc6c9c4509935e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:46.889721 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-ba8373a1-6072-47e8-8bee-6a8b4e4e2c35 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] 10.222.0.43 "GET /compute/v2.1/servers/3d1e7581-b5c1-4998-a964-8ca90bf36626" status: 200 len: 1366 microversion: 2.47 time: 0.122496 Oct 04 22:23:46.890865 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3263/6213] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:23:46 2022] GET /compute/v2.1/servers/3d1e7581-b5c1-4998-a964-8ca90bf36626 => generated 1366 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:23:47.562702 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-35394f7b-30a1-47ab-b37c-9af6643e2282 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:23:47.567993 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-35394f7b-30a1-47ab-b37c-9af6643e2282 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: 4d83b3ae-04db-4148-9d64-99458438ec9b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:23:47.575573 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-35394f7b-30a1-47ab-b37c-9af6643e2282 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:47.576209 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-35394f7b-30a1-47ab-b37c-9af6643e2282 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:47.576897 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-35394f7b-30a1-47ab-b37c-9af6643e2282 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:47.577873 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-35394f7b-30a1-47ab-b37c-9af6643e2282 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:47.578468 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-35394f7b-30a1-47ab-b37c-9af6643e2282 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:47.589967 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-35394f7b-30a1-47ab-b37c-9af6643e2282 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:47.809526 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-35394f7b-30a1-47ab-b37c-9af6643e2282 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:47.820231 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-35394f7b-30a1-47ab-b37c-9af6643e2282 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/4d83b3ae-04db-4148-9d64-99458438ec9b" status: 200 len: 1342 microversion: 2.1 time: 0.266566 Oct 04 22:23:47.821312 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3264/6214] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:23:47 2022] GET /compute/v2.1/servers/4d83b3ae-04db-4148-9d64-99458438ec9b => generated 1342 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:23:47.827165 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-05391d02-28c4-453b-a063-0e5257cfd1b7 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:23:47.828079 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-05391d02-28c4-453b-a063-0e5257cfd1b7 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] [instance: ef43593b-be9b-4e5f-89c4-17a7e6030e29] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:23:47.853951 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-05391d02-28c4-453b-a063-0e5257cfd1b7 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:47.854629 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-05391d02-28c4-453b-a063-0e5257cfd1b7 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:47.855816 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-05391d02-28c4-453b-a063-0e5257cfd1b7 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:47.857251 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-05391d02-28c4-453b-a063-0e5257cfd1b7 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:47.858014 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-05391d02-28c4-453b-a063-0e5257cfd1b7 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:47.858721 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-05391d02-28c4-453b-a063-0e5257cfd1b7 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:48.054600 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-05391d02-28c4-453b-a063-0e5257cfd1b7 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92bb4deacc2a45df834a675629a56e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35747ba0bc69465e971ba85c88fff0cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:48.064865 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-05391d02-28c4-453b-a063-0e5257cfd1b7 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] 10.222.0.43 "GET /compute/v2.1/servers/ef43593b-be9b-4e5f-89c4-17a7e6030e29" status: 200 len: 1768 microversion: 2.1 time: 0.242000 Oct 04 22:23:48.078626 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3265/6215] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:23:47 2022] GET /compute/v2.1/servers/ef43593b-be9b-4e5f-89c4-17a7e6030e29 => generated 1768 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:23:48.078626 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-ae162a8f-aa45-4e54-a04d-8ba69ee1bd8f tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:23:48.078626 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-ae162a8f-aa45-4e54-a04d-8ba69ee1bd8f tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] [instance: 3d1e7581-b5c1-4998-a964-8ca90bf36626] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:23:48.081874 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ae162a8f-aa45-4e54-a04d-8ba69ee1bd8f tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:48.084917 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ae162a8f-aa45-4e54-a04d-8ba69ee1bd8f tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:48.084917 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ae162a8f-aa45-4e54-a04d-8ba69ee1bd8f tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:48.084917 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ae162a8f-aa45-4e54-a04d-8ba69ee1bd8f tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:48.084917 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ae162a8f-aa45-4e54-a04d-8ba69ee1bd8f tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:48.085312 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ae162a8f-aa45-4e54-a04d-8ba69ee1bd8f tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:48.184961 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-ae162a8f-aa45-4e54-a04d-8ba69ee1bd8f tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '680b9f424ac24ef0b93ff30c9a9d9831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ffabfbee11487b93dc6c9c4509935e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:48.194241 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-ae162a8f-aa45-4e54-a04d-8ba69ee1bd8f tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '680b9f424ac24ef0b93ff30c9a9d9831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ffabfbee11487b93dc6c9c4509935e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:48.196086 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-ae162a8f-aa45-4e54-a04d-8ba69ee1bd8f tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '680b9f424ac24ef0b93ff30c9a9d9831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ffabfbee11487b93dc6c9c4509935e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:48.197460 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-ae162a8f-aa45-4e54-a04d-8ba69ee1bd8f tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] 10.222.0.43 "GET /compute/v2.1/servers/3d1e7581-b5c1-4998-a964-8ca90bf36626" status: 200 len: 1366 microversion: 2.47 time: 0.130839 Oct 04 22:23:48.198536 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3266/6216] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:23:48 2022] GET /compute/v2.1/servers/3d1e7581-b5c1-4998-a964-8ca90bf36626 => generated 1366 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:23:48.844928 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-f25483d4-0efd-4a20-b4be-d8eafa2e28b9 req-0014929c-e995-4628-88ff-bdee45c3a41b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef43593b-be9b-4e5f-89c4-17a7e6030e29", "name": "network-vif-deleted", "tag": "d4ad42be-39ad-404b-9392-f2b7142e73bc"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:23:48.868556 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-f25483d4-0efd-4a20-b4be-d8eafa2e28b9 req-0014929c-e995-4628-88ff-bdee45c3a41b service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:48.869164 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-f25483d4-0efd-4a20-b4be-d8eafa2e28b9 req-0014929c-e995-4628-88ff-bdee45c3a41b service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:48.877118 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-f25483d4-0efd-4a20-b4be-d8eafa2e28b9 req-0014929c-e995-4628-88ff-bdee45c3a41b service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:48.896264 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-f25483d4-0efd-4a20-b4be-d8eafa2e28b9 req-0014929c-e995-4628-88ff-bdee45c3a41b service nova] Creating event network-vif-deleted:d4ad42be-39ad-404b-9392-f2b7142e73bc for instance ef43593b-be9b-4e5f-89c4-17a7e6030e29 on n-h1-860284-1 Oct 04 22:23:48.908876 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-f25483d4-0efd-4a20-b4be-d8eafa2e28b9 req-0014929c-e995-4628-88ff-bdee45c3a41b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067470 Oct 04 22:23:48.915969 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3267/6217] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:23:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:23:48.924221 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-deeec1fb-1de7-4f60-bb34-e517e577a6ed tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:23:48.925465 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-deeec1fb-1de7-4f60-bb34-e517e577a6ed tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: 4d83b3ae-04db-4148-9d64-99458438ec9b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:23:48.932655 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-deeec1fb-1de7-4f60-bb34-e517e577a6ed tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:48.933650 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-deeec1fb-1de7-4f60-bb34-e517e577a6ed tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:48.934445 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-deeec1fb-1de7-4f60-bb34-e517e577a6ed tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:48.935646 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-deeec1fb-1de7-4f60-bb34-e517e577a6ed tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:48.936355 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-deeec1fb-1de7-4f60-bb34-e517e577a6ed tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:48.936974 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-deeec1fb-1de7-4f60-bb34-e517e577a6ed tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:49.106837 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-deeec1fb-1de7-4f60-bb34-e517e577a6ed tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:49.120981 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-deeec1fb-1de7-4f60-bb34-e517e577a6ed tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/4d83b3ae-04db-4148-9d64-99458438ec9b" status: 200 len: 1388 microversion: 2.1 time: 0.203421 Oct 04 22:23:49.124035 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3268/6218] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:23:48 2022] GET /compute/v2.1/servers/4d83b3ae-04db-4148-9d64-99458438ec9b => generated 1388 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:23:49.131704 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-19a08f20-8058-469d-a3d2-3dc13a42f1e4 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:23:49.132970 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-19a08f20-8058-469d-a3d2-3dc13a42f1e4 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] [instance: ef43593b-be9b-4e5f-89c4-17a7e6030e29] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:23:49.146408 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-19a08f20-8058-469d-a3d2-3dc13a42f1e4 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:49.147494 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-19a08f20-8058-469d-a3d2-3dc13a42f1e4 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:49.148154 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-19a08f20-8058-469d-a3d2-3dc13a42f1e4 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:49.149444 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-19a08f20-8058-469d-a3d2-3dc13a42f1e4 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:49.149988 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-19a08f20-8058-469d-a3d2-3dc13a42f1e4 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:49.150731 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-19a08f20-8058-469d-a3d2-3dc13a42f1e4 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:49.192426 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-19a08f20-8058-469d-a3d2-3dc13a42f1e4 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:49.193006 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-19a08f20-8058-469d-a3d2-3dc13a42f1e4 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:49.193584 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-19a08f20-8058-469d-a3d2-3dc13a42f1e4 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:49.194104 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.objects.instance [None req-19a08f20-8058-469d-a3d2-3dc13a42f1e4 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Lazy-loading 'fault' on Instance uuid ef43593b-be9b-4e5f-89c4-17a7e6030e29 {{(pid=134101) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 22:23:49.249425 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-19a08f20-8058-469d-a3d2-3dc13a42f1e4 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92bb4deacc2a45df834a675629a56e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35747ba0bc69465e971ba85c88fff0cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:49.251838 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:23:49.259911 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-19a08f20-8058-469d-a3d2-3dc13a42f1e4 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] 10.222.0.43 "GET /compute/v2.1/servers/ef43593b-be9b-4e5f-89c4-17a7e6030e29" status: 200 len: 1384 microversion: 2.1 time: 0.134951 Oct 04 22:23:49.260576 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3269/6219] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:23:49 2022] GET /compute/v2.1/servers/ef43593b-be9b-4e5f-89c4-17a7e6030e29 => generated 1384 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:23:49.265837 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-5c7c0708-004d-4a6e-8bbf-0596b3a2aac1 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:23:49.267015 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-5c7c0708-004d-4a6e-8bbf-0596b3a2aac1 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] [instance: 3d1e7581-b5c1-4998-a964-8ca90bf36626] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:23:49.273526 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5c7c0708-004d-4a6e-8bbf-0596b3a2aac1 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:49.274040 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5c7c0708-004d-4a6e-8bbf-0596b3a2aac1 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:49.277140 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5c7c0708-004d-4a6e-8bbf-0596b3a2aac1 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:49.277140 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5c7c0708-004d-4a6e-8bbf-0596b3a2aac1 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:49.277140 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5c7c0708-004d-4a6e-8bbf-0596b3a2aac1 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:49.277140 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5c7c0708-004d-4a6e-8bbf-0596b3a2aac1 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:49.347407 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-5c7c0708-004d-4a6e-8bbf-0596b3a2aac1 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '680b9f424ac24ef0b93ff30c9a9d9831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ffabfbee11487b93dc6c9c4509935e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:49.357553 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-5c7c0708-004d-4a6e-8bbf-0596b3a2aac1 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '680b9f424ac24ef0b93ff30c9a9d9831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ffabfbee11487b93dc6c9c4509935e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:49.359236 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-5c7c0708-004d-4a6e-8bbf-0596b3a2aac1 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '680b9f424ac24ef0b93ff30c9a9d9831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ffabfbee11487b93dc6c9c4509935e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:49.360603 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-5c7c0708-004d-4a6e-8bbf-0596b3a2aac1 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] 10.222.0.43 "GET /compute/v2.1/servers/3d1e7581-b5c1-4998-a964-8ca90bf36626" status: 200 len: 1366 microversion: 2.47 time: 0.099024 Oct 04 22:23:49.361324 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3270/6220] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:23:49 2022] GET /compute/v2.1/servers/3d1e7581-b5c1-4998-a964-8ca90bf36626 => generated 1366 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:23:50.151063 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-fc177adc-06be-4e27-94a2-a3724bbb8839 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:23:50.152621 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-fc177adc-06be-4e27-94a2-a3724bbb8839 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: 4d83b3ae-04db-4148-9d64-99458438ec9b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:23:50.165366 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fc177adc-06be-4e27-94a2-a3724bbb8839 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:50.166738 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fc177adc-06be-4e27-94a2-a3724bbb8839 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:50.169189 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fc177adc-06be-4e27-94a2-a3724bbb8839 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:50.170198 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fc177adc-06be-4e27-94a2-a3724bbb8839 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:50.170857 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fc177adc-06be-4e27-94a2-a3724bbb8839 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:50.171471 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fc177adc-06be-4e27-94a2-a3724bbb8839 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:50.335707 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-fc177adc-06be-4e27-94a2-a3724bbb8839 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:50.347899 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-fc177adc-06be-4e27-94a2-a3724bbb8839 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/4d83b3ae-04db-4148-9d64-99458438ec9b" status: 200 len: 1376 microversion: 2.1 time: 0.204384 Oct 04 22:23:50.362548 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3271/6221] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:23:50 2022] GET /compute/v2.1/servers/4d83b3ae-04db-4148-9d64-99458438ec9b => generated 1376 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:23:50.362548 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-1a45edc9-1161-462c-be1a-77c190406b88 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:23:50.362548 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-1a45edc9-1161-462c-be1a-77c190406b88 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] [instance: ef43593b-be9b-4e5f-89c4-17a7e6030e29] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:23:50.366496 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1a45edc9-1161-462c-be1a-77c190406b88 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:50.366496 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1a45edc9-1161-462c-be1a-77c190406b88 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:50.366496 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1a45edc9-1161-462c-be1a-77c190406b88 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:50.366496 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1a45edc9-1161-462c-be1a-77c190406b88 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:50.366496 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1a45edc9-1161-462c-be1a-77c190406b88 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:50.367035 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1a45edc9-1161-462c-be1a-77c190406b88 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:50.402928 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1a45edc9-1161-462c-be1a-77c190406b88 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:50.403430 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1a45edc9-1161-462c-be1a-77c190406b88 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:50.403886 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1a45edc9-1161-462c-be1a-77c190406b88 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:50.404351 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.objects.instance [None req-1a45edc9-1161-462c-be1a-77c190406b88 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Lazy-loading 'fault' on Instance uuid ef43593b-be9b-4e5f-89c4-17a7e6030e29 {{(pid=134101) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 22:23:50.463076 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-1a45edc9-1161-462c-be1a-77c190406b88 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92bb4deacc2a45df834a675629a56e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35747ba0bc69465e971ba85c88fff0cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:50.472042 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-1a45edc9-1161-462c-be1a-77c190406b88 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] 10.222.0.43 "GET /compute/v2.1/servers/ef43593b-be9b-4e5f-89c4-17a7e6030e29" status: 200 len: 1384 microversion: 2.1 time: 0.121771 Oct 04 22:23:50.481750 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3272/6222] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:23:50 2022] GET /compute/v2.1/servers/ef43593b-be9b-4e5f-89c4-17a7e6030e29 => generated 1384 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:23:50.481750 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-164a8646-0ca4-42dd-a2ea-fa342bfb010b tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:23:50.481750 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-164a8646-0ca4-42dd-a2ea-fa342bfb010b tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] [instance: 3d1e7581-b5c1-4998-a964-8ca90bf36626] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:23:50.490676 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-164a8646-0ca4-42dd-a2ea-fa342bfb010b tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:50.490676 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-164a8646-0ca4-42dd-a2ea-fa342bfb010b tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:50.490676 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-164a8646-0ca4-42dd-a2ea-fa342bfb010b tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:50.490676 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-164a8646-0ca4-42dd-a2ea-fa342bfb010b tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:50.490676 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-164a8646-0ca4-42dd-a2ea-fa342bfb010b tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:50.490676 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-164a8646-0ca4-42dd-a2ea-fa342bfb010b tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:50.578246 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-164a8646-0ca4-42dd-a2ea-fa342bfb010b tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '680b9f424ac24ef0b93ff30c9a9d9831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ffabfbee11487b93dc6c9c4509935e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:50.591545 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-164a8646-0ca4-42dd-a2ea-fa342bfb010b tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '680b9f424ac24ef0b93ff30c9a9d9831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ffabfbee11487b93dc6c9c4509935e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:50.593501 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-164a8646-0ca4-42dd-a2ea-fa342bfb010b tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '680b9f424ac24ef0b93ff30c9a9d9831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ffabfbee11487b93dc6c9c4509935e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:50.596783 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-164a8646-0ca4-42dd-a2ea-fa342bfb010b tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] 10.222.0.43 "GET /compute/v2.1/servers/3d1e7581-b5c1-4998-a964-8ca90bf36626" status: 200 len: 1366 microversion: 2.47 time: 0.122880 Oct 04 22:23:50.597336 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3273/6223] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:23:50 2022] GET /compute/v2.1/servers/3d1e7581-b5c1-4998-a964-8ca90bf36626 => generated 1366 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:23:51.374230 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-376e3faf-d9be-428f-8a07-496980045f85 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:23:51.374898 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-376e3faf-d9be-428f-8a07-496980045f85 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: 4d83b3ae-04db-4148-9d64-99458438ec9b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:23:51.382718 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-376e3faf-d9be-428f-8a07-496980045f85 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:51.383233 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-376e3faf-d9be-428f-8a07-496980045f85 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:51.383697 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-376e3faf-d9be-428f-8a07-496980045f85 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:51.384451 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-376e3faf-d9be-428f-8a07-496980045f85 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:51.384928 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-376e3faf-d9be-428f-8a07-496980045f85 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:51.385404 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-376e3faf-d9be-428f-8a07-496980045f85 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:51.528829 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-376e3faf-d9be-428f-8a07-496980045f85 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:51.537235 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-376e3faf-d9be-428f-8a07-496980045f85 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/4d83b3ae-04db-4148-9d64-99458438ec9b" status: 200 len: 1376 microversion: 2.1 time: 0.166886 Oct 04 22:23:51.537822 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3274/6224] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:23:51 2022] GET /compute/v2.1/servers/4d83b3ae-04db-4148-9d64-99458438ec9b => generated 1376 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:23:51.542292 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-58efed52-cb55-48de-9477-23e9a459cfb6 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:23:51.542941 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-58efed52-cb55-48de-9477-23e9a459cfb6 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] [instance: ef43593b-be9b-4e5f-89c4-17a7e6030e29] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:23:51.550134 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-58efed52-cb55-48de-9477-23e9a459cfb6 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:51.550799 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-58efed52-cb55-48de-9477-23e9a459cfb6 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:51.551468 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-58efed52-cb55-48de-9477-23e9a459cfb6 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:51.552329 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-58efed52-cb55-48de-9477-23e9a459cfb6 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:51.552921 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-58efed52-cb55-48de-9477-23e9a459cfb6 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:51.553377 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-58efed52-cb55-48de-9477-23e9a459cfb6 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:51.569037 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-58efed52-cb55-48de-9477-23e9a459cfb6 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] HTTP exception thrown: Instance ef43593b-be9b-4e5f-89c4-17a7e6030e29 could not be found. Oct 04 22:23:51.570675 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-58efed52-cb55-48de-9477-23e9a459cfb6 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Request method failure captured: Oct 04 22:23:51.570675 n-d-860284-1 devstack@n-api.service[134101]: request: GET /compute/v2.1/servers/ef43593b-be9b-4e5f-89c4-17a7e6030e29 HTTP/1.1 Oct 04 22:23:51.570675 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 22:23:51.570675 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 22:23:51.570675 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 22:23:51.570675 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 22:23:51.570675 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 22:23:51.570675 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 22:23:51.570675 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 22:23:51.570675 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 22:23:51.570675 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPLHjc3pYvVYUhfhW5nYXY9YtYBne_9W1L9fgjmEcSGCKF0jBvjSKo8Exg5OKckwWdehsjkfm-Q5gPA3sl2Xn0u44tT4famiOl0zOI7Z0tGj7k658ZKhFePaKUkkK2003_TNrGWVEjeZrMme6ZMevU8_zoVQYR36QnEhRKwkc4ZTlQQE Oct 04 22:23:51.570675 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 22:23:51.570675 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 22:23:51.570675 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 22:23:51.570675 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 22:23:51.570675 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 22:23:51.570675 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 22:23:51.570675 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: 35747ba0bc69465e971ba85c88fff0cd Oct 04 22:23:51.570675 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-1566186934 Oct 04 22:23:51.570675 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 22:23:51.570675 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 22:23:51.570675 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/35747ba0bc69465e971ba85c88fff0cd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_35747ba0bc69465e971ba85c88fff0cd", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/35747ba0bc69465e971ba85c88fff0cd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/35747ba0bc69465e971ba85c88fff0cd"}]}] Oct 04 22:23:51.570675 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-TestSecurityGroupsBasicOps-1566186934 Oct 04 22:23:51.570675 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: 35747ba0bc69465e971ba85c88fff0cd Oct 04 22:23:51.570675 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-1566186934 Oct 04 22:23:51.570675 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-TestSecurityGroupsBasicOps-1566186934-project Oct 04 22:23:51.570675 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 22:23:51.570675 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 22:23:51.570675 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 92bb4deacc2a45df834a675629a56e1b Oct 04 22:23:51.570675 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-TestSecurityGroupsBasicOps-1566186934-project Oct 04 22:23:51.570675 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 22:23:51.570675 n-d-860284-1 devstack@n-api.service[134101]: exception: Instance ef43593b-be9b-4e5f-89c4-17a7e6030e29 could not be found. Oct 04 22:23:51.570675 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': 'ef43593b-be9b-4e5f-89c4-17a7e6030e29'} Oct 04 22:23:51.570675 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:23:51.570675 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:23:51.570675 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:23:51.570675 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:23:51.570675 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:23:51.570675 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:23:51.570675 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:23:51.570675 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:23:51.570675 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:23:51.570675 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:23:51.570675 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef43593b-be9b-4e5f-89c4-17a7e6030e29 could not be found. Oct 04 22:23:51.570675 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:23:51.570675 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:23:51.570675 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:23:51.570675 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:23:51.570675 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:23:51.570675 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:23:51.570675 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:23:51.570675 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:23:51.570675 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:23:51.570675 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:23:51.570675 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:23:51.570675 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:23:51.570675 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:23:51.570675 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:23:51.570675 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:23:51.570675 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:23:51.570675 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef43593b-be9b-4e5f-89c4-17a7e6030e29 could not be found. Oct 04 22:23:51.570675 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:23:51.570675 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:23:51.575192 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:23:51.575192 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:23:51.575192 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:23:51.575192 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:23:51.575192 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:23:51.575192 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:23:51.575192 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef43593b-be9b-4e5f-89c4-17a7e6030e29 could not be found. Oct 04 22:23:51.575192 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:23:51.575192 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-58efed52-cb55-48de-9477-23e9a459cfb6 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Returning 404 to user: Instance ef43593b-be9b-4e5f-89c4-17a7e6030e29 could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:23:51.575192 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-58efed52-cb55-48de-9477-23e9a459cfb6 tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] 10.222.0.43 "GET /compute/v2.1/servers/ef43593b-be9b-4e5f-89c4-17a7e6030e29" status: 404 len: 111 microversion: 2.1 time: 0.033419 Oct 04 22:23:51.575192 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3275/6225] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:23:51 2022] GET /compute/v2.1/servers/ef43593b-be9b-4e5f-89c4-17a7e6030e29 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:23:51.622985 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-b8dbc92e-3d5a-4c93-812c-2f3954756084 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:23:51.623621 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-b8dbc92e-3d5a-4c93-812c-2f3954756084 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] [instance: 3d1e7581-b5c1-4998-a964-8ca90bf36626] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:23:51.633592 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b8dbc92e-3d5a-4c93-812c-2f3954756084 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:51.634112 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b8dbc92e-3d5a-4c93-812c-2f3954756084 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:51.642327 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b8dbc92e-3d5a-4c93-812c-2f3954756084 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:51.645191 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b8dbc92e-3d5a-4c93-812c-2f3954756084 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:51.646122 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b8dbc92e-3d5a-4c93-812c-2f3954756084 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:51.647398 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b8dbc92e-3d5a-4c93-812c-2f3954756084 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:51.739132 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-b8dbc92e-3d5a-4c93-812c-2f3954756084 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '680b9f424ac24ef0b93ff30c9a9d9831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ffabfbee11487b93dc6c9c4509935e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:51.752993 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-b8dbc92e-3d5a-4c93-812c-2f3954756084 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '680b9f424ac24ef0b93ff30c9a9d9831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ffabfbee11487b93dc6c9c4509935e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:51.754333 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-b8dbc92e-3d5a-4c93-812c-2f3954756084 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '680b9f424ac24ef0b93ff30c9a9d9831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ffabfbee11487b93dc6c9c4509935e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:51.755708 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-b8dbc92e-3d5a-4c93-812c-2f3954756084 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] 10.222.0.43 "GET /compute/v2.1/servers/3d1e7581-b5c1-4998-a964-8ca90bf36626" status: 200 len: 1366 microversion: 2.47 time: 0.136676 Oct 04 22:23:51.766424 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3276/6226] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:23:51 2022] GET /compute/v2.1/servers/3d1e7581-b5c1-4998-a964-8ca90bf36626 => generated 1366 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 22:23:52.559759 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-d6cc7ba0-5575-44e8-85f5-5eccd8395c00 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:23:52.560498 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-d6cc7ba0-5575-44e8-85f5-5eccd8395c00 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: 4d83b3ae-04db-4148-9d64-99458438ec9b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:23:52.570536 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d6cc7ba0-5575-44e8-85f5-5eccd8395c00 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:52.571987 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d6cc7ba0-5575-44e8-85f5-5eccd8395c00 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:52.572501 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d6cc7ba0-5575-44e8-85f5-5eccd8395c00 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:52.573251 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d6cc7ba0-5575-44e8-85f5-5eccd8395c00 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:52.573724 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d6cc7ba0-5575-44e8-85f5-5eccd8395c00 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:52.574170 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d6cc7ba0-5575-44e8-85f5-5eccd8395c00 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:52.834087 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-d6cc7ba0-5575-44e8-85f5-5eccd8395c00 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:52.844273 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-d6cc7ba0-5575-44e8-85f5-5eccd8395c00 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/4d83b3ae-04db-4148-9d64-99458438ec9b" status: 200 len: 1376 microversion: 2.1 time: 0.288380 Oct 04 22:23:52.846097 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3277/6227] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:23:52 2022] GET /compute/v2.1/servers/4d83b3ae-04db-4148-9d64-99458438ec9b => generated 1376 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:23:52.858000 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-ffa5e5fe-a400-4cb5-af5c-9318951efdf2 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:23:52.858856 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-ffa5e5fe-a400-4cb5-af5c-9318951efdf2 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] [instance: 3d1e7581-b5c1-4998-a964-8ca90bf36626] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:23:52.866319 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ffa5e5fe-a400-4cb5-af5c-9318951efdf2 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:52.867062 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ffa5e5fe-a400-4cb5-af5c-9318951efdf2 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:52.867692 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ffa5e5fe-a400-4cb5-af5c-9318951efdf2 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:52.868563 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ffa5e5fe-a400-4cb5-af5c-9318951efdf2 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:52.869192 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ffa5e5fe-a400-4cb5-af5c-9318951efdf2 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:52.869687 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ffa5e5fe-a400-4cb5-af5c-9318951efdf2 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:52.986602 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-ffa5e5fe-a400-4cb5-af5c-9318951efdf2 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '680b9f424ac24ef0b93ff30c9a9d9831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ffabfbee11487b93dc6c9c4509935e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:52.997612 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-ffa5e5fe-a400-4cb5-af5c-9318951efdf2 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '680b9f424ac24ef0b93ff30c9a9d9831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ffabfbee11487b93dc6c9c4509935e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:52.999682 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-ffa5e5fe-a400-4cb5-af5c-9318951efdf2 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '680b9f424ac24ef0b93ff30c9a9d9831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ffabfbee11487b93dc6c9c4509935e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:53.001760 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-ffa5e5fe-a400-4cb5-af5c-9318951efdf2 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] 10.222.0.43 "GET /compute/v2.1/servers/3d1e7581-b5c1-4998-a964-8ca90bf36626" status: 200 len: 1366 microversion: 2.47 time: 0.148202 Oct 04 22:23:53.002877 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3278/6228] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:23:52 2022] GET /compute/v2.1/servers/3d1e7581-b5c1-4998-a964-8ca90bf36626 => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:23:53.868838 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-9fa4f2d4-b509-45da-865a-e635b0745cfa tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:23:53.870182 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-9fa4f2d4-b509-45da-865a-e635b0745cfa tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: 4d83b3ae-04db-4148-9d64-99458438ec9b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:23:53.878461 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9fa4f2d4-b509-45da-865a-e635b0745cfa tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:53.878989 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9fa4f2d4-b509-45da-865a-e635b0745cfa tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:53.879407 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9fa4f2d4-b509-45da-865a-e635b0745cfa tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:53.880309 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9fa4f2d4-b509-45da-865a-e635b0745cfa tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:53.880783 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9fa4f2d4-b509-45da-865a-e635b0745cfa tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:53.881224 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9fa4f2d4-b509-45da-865a-e635b0745cfa tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:54.190646 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-9fa4f2d4-b509-45da-865a-e635b0745cfa tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:54.199343 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-9fa4f2d4-b509-45da-865a-e635b0745cfa tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/4d83b3ae-04db-4148-9d64-99458438ec9b" status: 200 len: 1376 microversion: 2.1 time: 0.334288 Oct 04 22:23:54.200016 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3279/6229] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:23:53 2022] GET /compute/v2.1/servers/4d83b3ae-04db-4148-9d64-99458438ec9b => generated 1376 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:23:54.205933 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-10dd1587-2f3c-408c-986b-328ed3ebd309 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:23:54.206662 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-10dd1587-2f3c-408c-986b-328ed3ebd309 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] [instance: 3d1e7581-b5c1-4998-a964-8ca90bf36626] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:23:54.213021 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-10dd1587-2f3c-408c-986b-328ed3ebd309 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:54.213602 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-10dd1587-2f3c-408c-986b-328ed3ebd309 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:54.214142 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-10dd1587-2f3c-408c-986b-328ed3ebd309 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:54.215077 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-10dd1587-2f3c-408c-986b-328ed3ebd309 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:54.215662 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-10dd1587-2f3c-408c-986b-328ed3ebd309 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:54.216340 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-10dd1587-2f3c-408c-986b-328ed3ebd309 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:54.330728 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-10dd1587-2f3c-408c-986b-328ed3ebd309 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '680b9f424ac24ef0b93ff30c9a9d9831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ffabfbee11487b93dc6c9c4509935e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:54.339912 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-10dd1587-2f3c-408c-986b-328ed3ebd309 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '680b9f424ac24ef0b93ff30c9a9d9831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ffabfbee11487b93dc6c9c4509935e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:54.341490 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-10dd1587-2f3c-408c-986b-328ed3ebd309 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '680b9f424ac24ef0b93ff30c9a9d9831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ffabfbee11487b93dc6c9c4509935e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:54.342768 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-10dd1587-2f3c-408c-986b-328ed3ebd309 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] 10.222.0.43 "GET /compute/v2.1/servers/3d1e7581-b5c1-4998-a964-8ca90bf36626" status: 200 len: 1366 microversion: 2.47 time: 0.141571 Oct 04 22:23:54.343419 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3280/6230] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:23:54 2022] GET /compute/v2.1/servers/3d1e7581-b5c1-4998-a964-8ca90bf36626 => generated 1366 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:23:55.226610 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-61436fc7-530c-476f-b4e0-f29b0b3084b5 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:23:55.227395 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-61436fc7-530c-476f-b4e0-f29b0b3084b5 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: 4d83b3ae-04db-4148-9d64-99458438ec9b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:23:55.241335 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-61436fc7-530c-476f-b4e0-f29b0b3084b5 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:55.242014 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-61436fc7-530c-476f-b4e0-f29b0b3084b5 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:55.243290 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-61436fc7-530c-476f-b4e0-f29b0b3084b5 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:55.245129 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-61436fc7-530c-476f-b4e0-f29b0b3084b5 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:55.246916 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-61436fc7-530c-476f-b4e0-f29b0b3084b5 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:55.247719 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-61436fc7-530c-476f-b4e0-f29b0b3084b5 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:55.515957 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-61436fc7-530c-476f-b4e0-f29b0b3084b5 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:55.531004 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-61436fc7-530c-476f-b4e0-f29b0b3084b5 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/4d83b3ae-04db-4148-9d64-99458438ec9b" status: 200 len: 1376 microversion: 2.1 time: 0.308923 Oct 04 22:23:55.542544 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3281/6231] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:23:55 2022] GET /compute/v2.1/servers/4d83b3ae-04db-4148-9d64-99458438ec9b => generated 1376 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:23:55.542544 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-f3371110-d2f5-4c49-b09f-a0ca12b51b63 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:23:55.542544 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-f3371110-d2f5-4c49-b09f-a0ca12b51b63 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] [instance: 3d1e7581-b5c1-4998-a964-8ca90bf36626] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:23:55.549166 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f3371110-d2f5-4c49-b09f-a0ca12b51b63 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:55.549761 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f3371110-d2f5-4c49-b09f-a0ca12b51b63 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:55.550556 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f3371110-d2f5-4c49-b09f-a0ca12b51b63 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:55.551566 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f3371110-d2f5-4c49-b09f-a0ca12b51b63 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:55.552649 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f3371110-d2f5-4c49-b09f-a0ca12b51b63 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:55.553441 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f3371110-d2f5-4c49-b09f-a0ca12b51b63 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:55.651977 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-f3371110-d2f5-4c49-b09f-a0ca12b51b63 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '680b9f424ac24ef0b93ff30c9a9d9831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ffabfbee11487b93dc6c9c4509935e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:55.665779 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-f3371110-d2f5-4c49-b09f-a0ca12b51b63 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '680b9f424ac24ef0b93ff30c9a9d9831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ffabfbee11487b93dc6c9c4509935e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:55.669427 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-f3371110-d2f5-4c49-b09f-a0ca12b51b63 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '680b9f424ac24ef0b93ff30c9a9d9831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ffabfbee11487b93dc6c9c4509935e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:55.671137 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-f3371110-d2f5-4c49-b09f-a0ca12b51b63 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] 10.222.0.43 "GET /compute/v2.1/servers/3d1e7581-b5c1-4998-a964-8ca90bf36626" status: 200 len: 1366 microversion: 2.47 time: 0.136844 Oct 04 22:23:55.672225 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3282/6232] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:23:55 2022] GET /compute/v2.1/servers/3d1e7581-b5c1-4998-a964-8ca90bf36626 => generated 1366 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:23:56.356500 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-0285eeb6-fff9-4d1d-b7f3-4ef0e5d5c24c tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] Calling method '.version_select at 0x7fbb2db0f160>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:23:56.387172 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-0285eeb6-fff9-4d1d-b7f3-4ef0e5d5c24c tempest-TestSecurityGroupsBasicOps-1566186934 tempest-TestSecurityGroupsBasicOps-1566186934-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-1266046448" status: 202 len: 0 microversion: 2.1 time: 0.035405 Oct 04 22:23:56.388572 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3283/6233] 10.222.0.43 () {58 vars in 1278 bytes} [Tue Oct 4 22:23:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-1266046448 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 22:23:56.560788 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-6f96d5ef-de52-4b63-b44c-dfd07fdb3055 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:23:56.561494 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-6f96d5ef-de52-4b63-b44c-dfd07fdb3055 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: 4d83b3ae-04db-4148-9d64-99458438ec9b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:23:56.570327 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6f96d5ef-de52-4b63-b44c-dfd07fdb3055 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:56.571052 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6f96d5ef-de52-4b63-b44c-dfd07fdb3055 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:56.571979 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6f96d5ef-de52-4b63-b44c-dfd07fdb3055 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:56.572969 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6f96d5ef-de52-4b63-b44c-dfd07fdb3055 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:56.573598 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6f96d5ef-de52-4b63-b44c-dfd07fdb3055 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:56.574306 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6f96d5ef-de52-4b63-b44c-dfd07fdb3055 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:56.762162 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-6f96d5ef-de52-4b63-b44c-dfd07fdb3055 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:56.774254 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-6f96d5ef-de52-4b63-b44c-dfd07fdb3055 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/4d83b3ae-04db-4148-9d64-99458438ec9b" status: 200 len: 1376 microversion: 2.1 time: 0.218081 Oct 04 22:23:56.775005 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3284/6234] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:23:56 2022] GET /compute/v2.1/servers/4d83b3ae-04db-4148-9d64-99458438ec9b => generated 1376 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:23:56.783510 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-7c0704ab-a326-4f2f-89e1-4f661d152b72 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:23:56.784637 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-7c0704ab-a326-4f2f-89e1-4f661d152b72 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] [instance: 3d1e7581-b5c1-4998-a964-8ca90bf36626] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:23:56.794072 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7c0704ab-a326-4f2f-89e1-4f661d152b72 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:56.794744 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7c0704ab-a326-4f2f-89e1-4f661d152b72 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:56.795387 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7c0704ab-a326-4f2f-89e1-4f661d152b72 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:56.796426 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7c0704ab-a326-4f2f-89e1-4f661d152b72 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:56.796998 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7c0704ab-a326-4f2f-89e1-4f661d152b72 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:56.797627 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7c0704ab-a326-4f2f-89e1-4f661d152b72 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:56.871997 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-7c0704ab-a326-4f2f-89e1-4f661d152b72 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '680b9f424ac24ef0b93ff30c9a9d9831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ffabfbee11487b93dc6c9c4509935e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:56.885272 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-7c0704ab-a326-4f2f-89e1-4f661d152b72 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '680b9f424ac24ef0b93ff30c9a9d9831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ffabfbee11487b93dc6c9c4509935e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:56.888582 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-7c0704ab-a326-4f2f-89e1-4f661d152b72 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '680b9f424ac24ef0b93ff30c9a9d9831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ffabfbee11487b93dc6c9c4509935e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:56.891221 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-7c0704ab-a326-4f2f-89e1-4f661d152b72 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] 10.222.0.43 "GET /compute/v2.1/servers/3d1e7581-b5c1-4998-a964-8ca90bf36626" status: 200 len: 1366 microversion: 2.47 time: 0.114434 Oct 04 22:23:56.894044 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3285/6235] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:23:56 2022] GET /compute/v2.1/servers/3d1e7581-b5c1-4998-a964-8ca90bf36626 => generated 1366 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:23:57.798890 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-2ab484ed-bde4-4905-9310-c77a63cb96d0 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:23:57.799745 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-2ab484ed-bde4-4905-9310-c77a63cb96d0 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: 4d83b3ae-04db-4148-9d64-99458438ec9b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:23:57.815260 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2ab484ed-bde4-4905-9310-c77a63cb96d0 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:57.815782 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2ab484ed-bde4-4905-9310-c77a63cb96d0 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:57.816476 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2ab484ed-bde4-4905-9310-c77a63cb96d0 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:57.817709 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2ab484ed-bde4-4905-9310-c77a63cb96d0 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:57.818406 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2ab484ed-bde4-4905-9310-c77a63cb96d0 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:57.819651 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2ab484ed-bde4-4905-9310-c77a63cb96d0 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:58.028464 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-2ab484ed-bde4-4905-9310-c77a63cb96d0 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:58.038565 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-2ab484ed-bde4-4905-9310-c77a63cb96d0 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/4d83b3ae-04db-4148-9d64-99458438ec9b" status: 200 len: 1376 microversion: 2.1 time: 0.244915 Oct 04 22:23:58.050394 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3286/6236] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:23:57 2022] GET /compute/v2.1/servers/4d83b3ae-04db-4148-9d64-99458438ec9b => generated 1376 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:23:58.050394 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e4ffb84b-b989-40b7-abf7-e7199f21e5bc tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:23:58.050394 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-e4ffb84b-b989-40b7-abf7-e7199f21e5bc tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] [instance: 3d1e7581-b5c1-4998-a964-8ca90bf36626] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:23:58.051939 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e4ffb84b-b989-40b7-abf7-e7199f21e5bc tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:58.052672 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e4ffb84b-b989-40b7-abf7-e7199f21e5bc tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:58.053287 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e4ffb84b-b989-40b7-abf7-e7199f21e5bc tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:58.054472 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e4ffb84b-b989-40b7-abf7-e7199f21e5bc tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:58.055161 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e4ffb84b-b989-40b7-abf7-e7199f21e5bc tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:58.055775 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e4ffb84b-b989-40b7-abf7-e7199f21e5bc tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:58.129926 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-e4ffb84b-b989-40b7-abf7-e7199f21e5bc tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '680b9f424ac24ef0b93ff30c9a9d9831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ffabfbee11487b93dc6c9c4509935e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:58.132284 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=100 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:23:58.139806 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-e4ffb84b-b989-40b7-abf7-e7199f21e5bc tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '680b9f424ac24ef0b93ff30c9a9d9831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ffabfbee11487b93dc6c9c4509935e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:58.141842 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-e4ffb84b-b989-40b7-abf7-e7199f21e5bc tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '680b9f424ac24ef0b93ff30c9a9d9831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ffabfbee11487b93dc6c9c4509935e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:58.143178 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-e4ffb84b-b989-40b7-abf7-e7199f21e5bc tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] 10.222.0.43 "GET /compute/v2.1/servers/3d1e7581-b5c1-4998-a964-8ca90bf36626" status: 200 len: 1366 microversion: 2.47 time: 0.102682 Oct 04 22:23:58.143859 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3287/6237] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:23:58 2022] GET /compute/v2.1/servers/3d1e7581-b5c1-4998-a964-8ca90bf36626 => generated 1366 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:23:59.067250 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-b23b2795-6871-4e58-9417-774358e31380 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:23:59.068175 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-b23b2795-6871-4e58-9417-774358e31380 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: 4d83b3ae-04db-4148-9d64-99458438ec9b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:23:59.088628 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b23b2795-6871-4e58-9417-774358e31380 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:59.090157 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b23b2795-6871-4e58-9417-774358e31380 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:59.091186 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b23b2795-6871-4e58-9417-774358e31380 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:59.092369 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b23b2795-6871-4e58-9417-774358e31380 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:59.093288 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b23b2795-6871-4e58-9417-774358e31380 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:59.093778 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b23b2795-6871-4e58-9417-774358e31380 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:59.290774 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-b23b2795-6871-4e58-9417-774358e31380 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:59.301075 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-b23b2795-6871-4e58-9417-774358e31380 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/4d83b3ae-04db-4148-9d64-99458438ec9b" status: 200 len: 1376 microversion: 2.1 time: 0.238422 Oct 04 22:23:59.302343 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3288/6238] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:23:59 2022] GET /compute/v2.1/servers/4d83b3ae-04db-4148-9d64-99458438ec9b => generated 1376 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:23:59.307409 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-0c91c085-e0a4-4546-8470-e3aa7070b70b req-2bc86005-f686-4243-b3b2-4daf967969f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d83b3ae-04db-4148-9d64-99458438ec9b", "name": "network-vif-plugged", "status": "completed", "tag": "e2b07028-bc0d-41be-ab5f-9e9c2749c0bf"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:23:59.318684 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-0c91c085-e0a4-4546-8470-e3aa7070b70b req-2bc86005-f686-4243-b3b2-4daf967969f0 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:59.319181 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-0c91c085-e0a4-4546-8470-e3aa7070b70b req-2bc86005-f686-4243-b3b2-4daf967969f0 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:59.319634 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-0c91c085-e0a4-4546-8470-e3aa7070b70b req-2bc86005-f686-4243-b3b2-4daf967969f0 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:59.332700 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-0c91c085-e0a4-4546-8470-e3aa7070b70b req-2bc86005-f686-4243-b3b2-4daf967969f0 service nova] Creating event network-vif-plugged:e2b07028-bc0d-41be-ab5f-9e9c2749c0bf for instance 4d83b3ae-04db-4148-9d64-99458438ec9b on n-h1-860284-1 Oct 04 22:23:59.338328 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-0c91c085-e0a4-4546-8470-e3aa7070b70b req-2bc86005-f686-4243-b3b2-4daf967969f0 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034566 Oct 04 22:23:59.339111 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3289/6239] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:23:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:23:59.345796 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-c472c5a2-f00b-483e-8ad0-a1ceba5ba586 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:23:59.346659 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-c472c5a2-f00b-483e-8ad0-a1ceba5ba586 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] [instance: 3d1e7581-b5c1-4998-a964-8ca90bf36626] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:23:59.353936 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c472c5a2-f00b-483e-8ad0-a1ceba5ba586 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:59.354596 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c472c5a2-f00b-483e-8ad0-a1ceba5ba586 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:59.355169 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c472c5a2-f00b-483e-8ad0-a1ceba5ba586 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:59.356043 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c472c5a2-f00b-483e-8ad0-a1ceba5ba586 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:59.356633 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c472c5a2-f00b-483e-8ad0-a1ceba5ba586 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:59.357081 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c472c5a2-f00b-483e-8ad0-a1ceba5ba586 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:59.440358 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-c472c5a2-f00b-483e-8ad0-a1ceba5ba586 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '680b9f424ac24ef0b93ff30c9a9d9831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ffabfbee11487b93dc6c9c4509935e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:59.450924 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-c472c5a2-f00b-483e-8ad0-a1ceba5ba586 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '680b9f424ac24ef0b93ff30c9a9d9831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ffabfbee11487b93dc6c9c4509935e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:59.452603 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-c472c5a2-f00b-483e-8ad0-a1ceba5ba586 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '680b9f424ac24ef0b93ff30c9a9d9831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ffabfbee11487b93dc6c9c4509935e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:59.454755 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-c472c5a2-f00b-483e-8ad0-a1ceba5ba586 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] 10.222.0.43 "GET /compute/v2.1/servers/3d1e7581-b5c1-4998-a964-8ca90bf36626" status: 200 len: 1366 microversion: 2.47 time: 0.114310 Oct 04 22:23:59.455406 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3290/6240] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:23:59 2022] GET /compute/v2.1/servers/3d1e7581-b5c1-4998-a964-8ca90bf36626 => generated 1366 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:24:00.324316 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-52918f76-6539-4251-97dc-117b4a97f082 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:24:00.325815 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-52918f76-6539-4251-97dc-117b4a97f082 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: 4d83b3ae-04db-4148-9d64-99458438ec9b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:24:00.333492 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-52918f76-6539-4251-97dc-117b4a97f082 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:00.334180 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-52918f76-6539-4251-97dc-117b4a97f082 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:00.334516 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-52918f76-6539-4251-97dc-117b4a97f082 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:00.335270 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-52918f76-6539-4251-97dc-117b4a97f082 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:00.335738 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-52918f76-6539-4251-97dc-117b4a97f082 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:00.336209 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-52918f76-6539-4251-97dc-117b4a97f082 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:00.486649 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-52918f76-6539-4251-97dc-117b4a97f082 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:00.495344 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-52918f76-6539-4251-97dc-117b4a97f082 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/4d83b3ae-04db-4148-9d64-99458438ec9b" status: 200 len: 1376 microversion: 2.1 time: 0.175080 Oct 04 22:24:00.496082 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3291/6241] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:24:00 2022] GET /compute/v2.1/servers/4d83b3ae-04db-4148-9d64-99458438ec9b => generated 1376 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:24:00.502706 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-2de80174-16d1-43ea-a580-919c283e2ed7 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:24:00.504102 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-2de80174-16d1-43ea-a580-919c283e2ed7 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] [instance: 3d1e7581-b5c1-4998-a964-8ca90bf36626] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:24:00.511867 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2de80174-16d1-43ea-a580-919c283e2ed7 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:00.512682 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2de80174-16d1-43ea-a580-919c283e2ed7 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:00.513297 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2de80174-16d1-43ea-a580-919c283e2ed7 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:00.514241 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2de80174-16d1-43ea-a580-919c283e2ed7 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:00.514776 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2de80174-16d1-43ea-a580-919c283e2ed7 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:00.515229 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2de80174-16d1-43ea-a580-919c283e2ed7 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:00.589077 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-2de80174-16d1-43ea-a580-919c283e2ed7 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '680b9f424ac24ef0b93ff30c9a9d9831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ffabfbee11487b93dc6c9c4509935e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:00.598127 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-2de80174-16d1-43ea-a580-919c283e2ed7 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '680b9f424ac24ef0b93ff30c9a9d9831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ffabfbee11487b93dc6c9c4509935e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:00.599645 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-2de80174-16d1-43ea-a580-919c283e2ed7 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '680b9f424ac24ef0b93ff30c9a9d9831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ffabfbee11487b93dc6c9c4509935e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:00.600861 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-2de80174-16d1-43ea-a580-919c283e2ed7 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] 10.222.0.43 "GET /compute/v2.1/servers/3d1e7581-b5c1-4998-a964-8ca90bf36626" status: 200 len: 1366 microversion: 2.47 time: 0.103578 Oct 04 22:24:00.601784 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3292/6242] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:24:00 2022] GET /compute/v2.1/servers/3d1e7581-b5c1-4998-a964-8ca90bf36626 => generated 1366 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:24:01.521182 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e04aee21-22ce-4dfa-9f7e-22bc3875e2f5 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:24:01.521827 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-e04aee21-22ce-4dfa-9f7e-22bc3875e2f5 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: 4d83b3ae-04db-4148-9d64-99458438ec9b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:24:01.529012 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e04aee21-22ce-4dfa-9f7e-22bc3875e2f5 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:01.529578 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e04aee21-22ce-4dfa-9f7e-22bc3875e2f5 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:01.530093 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e04aee21-22ce-4dfa-9f7e-22bc3875e2f5 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:01.530887 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e04aee21-22ce-4dfa-9f7e-22bc3875e2f5 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:01.532190 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e04aee21-22ce-4dfa-9f7e-22bc3875e2f5 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:01.532640 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e04aee21-22ce-4dfa-9f7e-22bc3875e2f5 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:01.665945 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-e04aee21-22ce-4dfa-9f7e-22bc3875e2f5 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:01.674742 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-e04aee21-22ce-4dfa-9f7e-22bc3875e2f5 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/4d83b3ae-04db-4148-9d64-99458438ec9b" status: 200 len: 1564 microversion: 2.1 time: 0.157501 Oct 04 22:24:01.675327 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3293/6243] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:24:01 2022] GET /compute/v2.1/servers/4d83b3ae-04db-4148-9d64-99458438ec9b => generated 1564 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:24:01.679766 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-64a73302-5574-41c2-966d-bc123ee802dc tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:24:01.680381 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-64a73302-5574-41c2-966d-bc123ee802dc tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] [instance: 3d1e7581-b5c1-4998-a964-8ca90bf36626] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:24:01.686016 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-64a73302-5574-41c2-966d-bc123ee802dc tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:01.686532 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-64a73302-5574-41c2-966d-bc123ee802dc tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:01.686982 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-64a73302-5574-41c2-966d-bc123ee802dc tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:01.687710 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-64a73302-5574-41c2-966d-bc123ee802dc tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:01.688408 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-64a73302-5574-41c2-966d-bc123ee802dc tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:01.688848 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-64a73302-5574-41c2-966d-bc123ee802dc tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:01.759112 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-64a73302-5574-41c2-966d-bc123ee802dc tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '680b9f424ac24ef0b93ff30c9a9d9831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ffabfbee11487b93dc6c9c4509935e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:01.768209 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-64a73302-5574-41c2-966d-bc123ee802dc tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '680b9f424ac24ef0b93ff30c9a9d9831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ffabfbee11487b93dc6c9c4509935e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:01.769744 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-64a73302-5574-41c2-966d-bc123ee802dc tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '680b9f424ac24ef0b93ff30c9a9d9831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ffabfbee11487b93dc6c9c4509935e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:01.771030 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-64a73302-5574-41c2-966d-bc123ee802dc tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] 10.222.0.43 "GET /compute/v2.1/servers/3d1e7581-b5c1-4998-a964-8ca90bf36626" status: 200 len: 1366 microversion: 2.47 time: 0.094774 Oct 04 22:24:01.771659 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3294/6244] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:24:01 2022] GET /compute/v2.1/servers/3d1e7581-b5c1-4998-a964-8ca90bf36626 => generated 1366 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:24:01.776202 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-5132cb7f-67e7-49c1-ae6e-3e2d51345279 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:24:01.776818 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-5132cb7f-67e7-49c1-ae6e-3e2d51345279 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: 4d83b3ae-04db-4148-9d64-99458438ec9b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:24:01.783365 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5132cb7f-67e7-49c1-ae6e-3e2d51345279 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:01.783865 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5132cb7f-67e7-49c1-ae6e-3e2d51345279 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:01.784380 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5132cb7f-67e7-49c1-ae6e-3e2d51345279 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:01.785195 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5132cb7f-67e7-49c1-ae6e-3e2d51345279 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:01.785746 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5132cb7f-67e7-49c1-ae6e-3e2d51345279 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:01.786187 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5132cb7f-67e7-49c1-ae6e-3e2d51345279 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:01.922186 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-5132cb7f-67e7-49c1-ae6e-3e2d51345279 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:01.931512 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-5132cb7f-67e7-49c1-ae6e-3e2d51345279 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/4d83b3ae-04db-4148-9d64-99458438ec9b" status: 200 len: 1564 microversion: 2.1 time: 0.158632 Oct 04 22:24:01.932180 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3295/6245] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:24:01 2022] GET /compute/v2.1/servers/4d83b3ae-04db-4148-9d64-99458438ec9b => generated 1564 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:24:02.012780 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-8f91959c-b227-4374-bb55-b6c2687d6497 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:24:02.013295 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-8f91959c-b227-4374-bb55-b6c2687d6497 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: 4d83b3ae-04db-4148-9d64-99458438ec9b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:24:02.019977 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8f91959c-b227-4374-bb55-b6c2687d6497 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:02.020474 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8f91959c-b227-4374-bb55-b6c2687d6497 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:02.020927 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8f91959c-b227-4374-bb55-b6c2687d6497 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:02.021635 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8f91959c-b227-4374-bb55-b6c2687d6497 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:02.022154 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8f91959c-b227-4374-bb55-b6c2687d6497 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:02.022588 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8f91959c-b227-4374-bb55-b6c2687d6497 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:02.049571 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-8f91959c-b227-4374-bb55-b6c2687d6497 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: 4d83b3ae-04db-4148-9d64-99458438ec9b] Going to try to terminate instance {{(pid=134101) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 22:24:02.131131 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-8f91959c-b227-4374-bb55-b6c2687d6497 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "DELETE /compute/v2.1/servers/4d83b3ae-04db-4148-9d64-99458438ec9b" status: 204 len: 0 microversion: 2.1 time: 0.121837 Oct 04 22:24:02.132045 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3296/6246] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 22:24:02 2022] DELETE /compute/v2.1/servers/4d83b3ae-04db-4148-9d64-99458438ec9b => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 22:24:02.142058 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-f676b02d-3543-409c-b7fd-2eb7e01fbccc tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:24:02.142813 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-f676b02d-3543-409c-b7fd-2eb7e01fbccc tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: 4d83b3ae-04db-4148-9d64-99458438ec9b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:24:02.150425 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f676b02d-3543-409c-b7fd-2eb7e01fbccc tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:02.151042 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f676b02d-3543-409c-b7fd-2eb7e01fbccc tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:02.151514 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f676b02d-3543-409c-b7fd-2eb7e01fbccc tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:02.152258 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f676b02d-3543-409c-b7fd-2eb7e01fbccc tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:02.152869 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f676b02d-3543-409c-b7fd-2eb7e01fbccc tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:02.153325 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f676b02d-3543-409c-b7fd-2eb7e01fbccc tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:02.291720 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-f676b02d-3543-409c-b7fd-2eb7e01fbccc tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:02.299672 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-f676b02d-3543-409c-b7fd-2eb7e01fbccc tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/4d83b3ae-04db-4148-9d64-99458438ec9b" status: 200 len: 1570 microversion: 2.1 time: 0.163382 Oct 04 22:24:02.300253 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3297/6247] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:24:02 2022] GET /compute/v2.1/servers/4d83b3ae-04db-4148-9d64-99458438ec9b => generated 1570 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:24:02.798850 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-5336f338-e6e9-4052-b0a8-b38b2007df33 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:24:02.799727 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-5336f338-e6e9-4052-b0a8-b38b2007df33 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] [instance: 3d1e7581-b5c1-4998-a964-8ca90bf36626] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:24:02.806498 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5336f338-e6e9-4052-b0a8-b38b2007df33 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:02.807005 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5336f338-e6e9-4052-b0a8-b38b2007df33 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:02.807457 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5336f338-e6e9-4052-b0a8-b38b2007df33 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:02.808173 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5336f338-e6e9-4052-b0a8-b38b2007df33 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:02.808640 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5336f338-e6e9-4052-b0a8-b38b2007df33 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:02.809081 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5336f338-e6e9-4052-b0a8-b38b2007df33 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:02.878139 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-5336f338-e6e9-4052-b0a8-b38b2007df33 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '680b9f424ac24ef0b93ff30c9a9d9831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ffabfbee11487b93dc6c9c4509935e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:02.886563 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-5336f338-e6e9-4052-b0a8-b38b2007df33 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '680b9f424ac24ef0b93ff30c9a9d9831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ffabfbee11487b93dc6c9c4509935e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:02.888022 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-5336f338-e6e9-4052-b0a8-b38b2007df33 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '680b9f424ac24ef0b93ff30c9a9d9831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ffabfbee11487b93dc6c9c4509935e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:02.889205 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-5336f338-e6e9-4052-b0a8-b38b2007df33 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] 10.222.0.43 "GET /compute/v2.1/servers/3d1e7581-b5c1-4998-a964-8ca90bf36626" status: 200 len: 1366 microversion: 2.47 time: 0.094430 Oct 04 22:24:02.889775 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3298/6248] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:24:02 2022] GET /compute/v2.1/servers/3d1e7581-b5c1-4998-a964-8ca90bf36626 => generated 1366 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 22:24:03.323249 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-89634d41-b8e8-4c64-82b7-4b8409bc97e1 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:24:03.323893 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-89634d41-b8e8-4c64-82b7-4b8409bc97e1 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: 4d83b3ae-04db-4148-9d64-99458438ec9b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:24:03.330452 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-89634d41-b8e8-4c64-82b7-4b8409bc97e1 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:03.330959 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-89634d41-b8e8-4c64-82b7-4b8409bc97e1 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:03.331411 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-89634d41-b8e8-4c64-82b7-4b8409bc97e1 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:03.332131 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-89634d41-b8e8-4c64-82b7-4b8409bc97e1 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:03.332605 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-89634d41-b8e8-4c64-82b7-4b8409bc97e1 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:03.333046 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-89634d41-b8e8-4c64-82b7-4b8409bc97e1 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:03.472939 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-89634d41-b8e8-4c64-82b7-4b8409bc97e1 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:03.481121 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-89634d41-b8e8-4c64-82b7-4b8409bc97e1 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/4d83b3ae-04db-4148-9d64-99458438ec9b" status: 200 len: 1570 microversion: 2.1 time: 0.161837 Oct 04 22:24:03.481907 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3299/6249] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:24:03 2022] GET /compute/v2.1/servers/4d83b3ae-04db-4148-9d64-99458438ec9b => generated 1570 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:24:03.916266 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-df1b07d5-cd67-4354-a329-f36b15cc6bfe tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:24:03.916922 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-df1b07d5-cd67-4354-a329-f36b15cc6bfe tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] [instance: 3d1e7581-b5c1-4998-a964-8ca90bf36626] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:24:03.924986 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-df1b07d5-cd67-4354-a329-f36b15cc6bfe tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:03.926145 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-df1b07d5-cd67-4354-a329-f36b15cc6bfe tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:03.926778 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-df1b07d5-cd67-4354-a329-f36b15cc6bfe tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:03.927504 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-df1b07d5-cd67-4354-a329-f36b15cc6bfe tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:03.927980 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-df1b07d5-cd67-4354-a329-f36b15cc6bfe tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:03.928539 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-df1b07d5-cd67-4354-a329-f36b15cc6bfe tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:03.998208 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-df1b07d5-cd67-4354-a329-f36b15cc6bfe tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '680b9f424ac24ef0b93ff30c9a9d9831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ffabfbee11487b93dc6c9c4509935e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:04.008873 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-df1b07d5-cd67-4354-a329-f36b15cc6bfe tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '680b9f424ac24ef0b93ff30c9a9d9831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ffabfbee11487b93dc6c9c4509935e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:04.008873 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-df1b07d5-cd67-4354-a329-f36b15cc6bfe tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '680b9f424ac24ef0b93ff30c9a9d9831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ffabfbee11487b93dc6c9c4509935e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:04.009612 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-df1b07d5-cd67-4354-a329-f36b15cc6bfe tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] 10.222.0.43 "GET /compute/v2.1/servers/3d1e7581-b5c1-4998-a964-8ca90bf36626" status: 200 len: 1366 microversion: 2.47 time: 0.097525 Oct 04 22:24:04.010393 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3300/6250] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:24:03 2022] GET /compute/v2.1/servers/3d1e7581-b5c1-4998-a964-8ca90bf36626 => generated 1366 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 22:24:04.510079 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-0f1e7d8d-e4c2-4b68-89b7-eb1515b42a8f tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:24:04.511230 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-0f1e7d8d-e4c2-4b68-89b7-eb1515b42a8f tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: 4d83b3ae-04db-4148-9d64-99458438ec9b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:24:04.519288 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:24:04.528238 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0f1e7d8d-e4c2-4b68-89b7-eb1515b42a8f tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:04.530129 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0f1e7d8d-e4c2-4b68-89b7-eb1515b42a8f tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:04.531154 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0f1e7d8d-e4c2-4b68-89b7-eb1515b42a8f tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:04.532095 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0f1e7d8d-e4c2-4b68-89b7-eb1515b42a8f tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:04.532869 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0f1e7d8d-e4c2-4b68-89b7-eb1515b42a8f tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:04.533491 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0f1e7d8d-e4c2-4b68-89b7-eb1515b42a8f tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:04.923875 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-0f1e7d8d-e4c2-4b68-89b7-eb1515b42a8f tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:04.951548 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-0f1e7d8d-e4c2-4b68-89b7-eb1515b42a8f tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/4d83b3ae-04db-4148-9d64-99458438ec9b" status: 200 len: 1528 microversion: 2.1 time: 0.448995 Oct 04 22:24:04.952244 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3301/6251] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:24:04 2022] GET /compute/v2.1/servers/4d83b3ae-04db-4148-9d64-99458438ec9b => generated 1528 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:24:04.957829 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-ed5a41a2-0a08-4117-aeba-8b3b6af97c2e req-0bbacfaf-d845-4675-b705-28dbb0d97e23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d83b3ae-04db-4148-9d64-99458438ec9b", "name": "network-vif-deleted", "tag": "e2b07028-bc0d-41be-ab5f-9e9c2749c0bf"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:24:04.979027 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-ed5a41a2-0a08-4117-aeba-8b3b6af97c2e req-0bbacfaf-d845-4675-b705-28dbb0d97e23 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:04.979526 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-ed5a41a2-0a08-4117-aeba-8b3b6af97c2e req-0bbacfaf-d845-4675-b705-28dbb0d97e23 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:04.979975 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-ed5a41a2-0a08-4117-aeba-8b3b6af97c2e req-0bbacfaf-d845-4675-b705-28dbb0d97e23 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:04.992144 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-ed5a41a2-0a08-4117-aeba-8b3b6af97c2e req-0bbacfaf-d845-4675-b705-28dbb0d97e23 service nova] Creating event network-vif-deleted:e2b07028-bc0d-41be-ab5f-9e9c2749c0bf for instance 4d83b3ae-04db-4148-9d64-99458438ec9b on n-h1-860284-1 Oct 04 22:24:04.997010 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-ed5a41a2-0a08-4117-aeba-8b3b6af97c2e req-0bbacfaf-d845-4675-b705-28dbb0d97e23 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042805 Oct 04 22:24:04.997611 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3302/6252] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:24:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:24:05.038113 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-2add4006-eead-45b1-8e30-cb6da0399ea8 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:24:05.039172 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-2add4006-eead-45b1-8e30-cb6da0399ea8 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] [instance: 3d1e7581-b5c1-4998-a964-8ca90bf36626] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:24:05.049583 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2add4006-eead-45b1-8e30-cb6da0399ea8 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:05.050190 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2add4006-eead-45b1-8e30-cb6da0399ea8 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:05.050699 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2add4006-eead-45b1-8e30-cb6da0399ea8 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:05.051435 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2add4006-eead-45b1-8e30-cb6da0399ea8 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:05.051949 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2add4006-eead-45b1-8e30-cb6da0399ea8 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:05.052752 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2add4006-eead-45b1-8e30-cb6da0399ea8 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:05.151862 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-2add4006-eead-45b1-8e30-cb6da0399ea8 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '680b9f424ac24ef0b93ff30c9a9d9831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ffabfbee11487b93dc6c9c4509935e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:05.164215 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-2add4006-eead-45b1-8e30-cb6da0399ea8 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '680b9f424ac24ef0b93ff30c9a9d9831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ffabfbee11487b93dc6c9c4509935e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:05.166285 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-2add4006-eead-45b1-8e30-cb6da0399ea8 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '680b9f424ac24ef0b93ff30c9a9d9831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ffabfbee11487b93dc6c9c4509935e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:05.167757 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-2add4006-eead-45b1-8e30-cb6da0399ea8 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] 10.222.0.43 "GET /compute/v2.1/servers/3d1e7581-b5c1-4998-a964-8ca90bf36626" status: 200 len: 1366 microversion: 2.47 time: 0.135068 Oct 04 22:24:05.168862 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3303/6253] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:24:05 2022] GET /compute/v2.1/servers/3d1e7581-b5c1-4998-a964-8ca90bf36626 => generated 1366 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 22:24:05.976244 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-4c7d29b0-cab3-492d-8e21-f77f32d9e1cf tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:24:05.976921 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-4c7d29b0-cab3-492d-8e21-f77f32d9e1cf tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: 4d83b3ae-04db-4148-9d64-99458438ec9b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:24:05.985620 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4c7d29b0-cab3-492d-8e21-f77f32d9e1cf tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:05.986694 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4c7d29b0-cab3-492d-8e21-f77f32d9e1cf tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:05.987177 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4c7d29b0-cab3-492d-8e21-f77f32d9e1cf tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:05.987933 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4c7d29b0-cab3-492d-8e21-f77f32d9e1cf tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:05.988413 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4c7d29b0-cab3-492d-8e21-f77f32d9e1cf tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:05.988892 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4c7d29b0-cab3-492d-8e21-f77f32d9e1cf tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:05.992165 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:24:06.064845 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-4c7d29b0-cab3-492d-8e21-f77f32d9e1cf tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:06.075986 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-4c7d29b0-cab3-492d-8e21-f77f32d9e1cf tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/4d83b3ae-04db-4148-9d64-99458438ec9b" status: 200 len: 1361 microversion: 2.1 time: 0.103923 Oct 04 22:24:06.076768 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3304/6254] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:24:05 2022] GET /compute/v2.1/servers/4d83b3ae-04db-4148-9d64-99458438ec9b => generated 1361 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:24:06.195456 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-c66f16c7-6e51-4a6c-b5e8-f28783b31de6 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:24:06.196242 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-c66f16c7-6e51-4a6c-b5e8-f28783b31de6 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] [instance: 3d1e7581-b5c1-4998-a964-8ca90bf36626] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:24:06.204568 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c66f16c7-6e51-4a6c-b5e8-f28783b31de6 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:06.205232 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c66f16c7-6e51-4a6c-b5e8-f28783b31de6 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:06.205791 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c66f16c7-6e51-4a6c-b5e8-f28783b31de6 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:06.206642 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c66f16c7-6e51-4a6c-b5e8-f28783b31de6 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:06.207218 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c66f16c7-6e51-4a6c-b5e8-f28783b31de6 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:06.207763 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c66f16c7-6e51-4a6c-b5e8-f28783b31de6 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:06.277473 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-c66f16c7-6e51-4a6c-b5e8-f28783b31de6 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '680b9f424ac24ef0b93ff30c9a9d9831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ffabfbee11487b93dc6c9c4509935e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:06.287113 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-c66f16c7-6e51-4a6c-b5e8-f28783b31de6 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '680b9f424ac24ef0b93ff30c9a9d9831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ffabfbee11487b93dc6c9c4509935e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:06.288699 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-c66f16c7-6e51-4a6c-b5e8-f28783b31de6 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '680b9f424ac24ef0b93ff30c9a9d9831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ffabfbee11487b93dc6c9c4509935e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:06.290102 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-c66f16c7-6e51-4a6c-b5e8-f28783b31de6 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] 10.222.0.43 "GET /compute/v2.1/servers/3d1e7581-b5c1-4998-a964-8ca90bf36626" status: 200 len: 1366 microversion: 2.47 time: 0.099101 Oct 04 22:24:06.290990 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3305/6255] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:24:06 2022] GET /compute/v2.1/servers/3d1e7581-b5c1-4998-a964-8ca90bf36626 => generated 1366 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 22:24:07.383940 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-3598acb5-93a0-4f25-8335-e9cc61c16a86 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:24:07.384791 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-3598acb5-93a0-4f25-8335-e9cc61c16a86 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: 4d83b3ae-04db-4148-9d64-99458438ec9b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:24:07.394160 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3598acb5-93a0-4f25-8335-e9cc61c16a86 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:07.395047 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3598acb5-93a0-4f25-8335-e9cc61c16a86 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:07.396740 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3598acb5-93a0-4f25-8335-e9cc61c16a86 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:07.397993 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3598acb5-93a0-4f25-8335-e9cc61c16a86 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:07.398889 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3598acb5-93a0-4f25-8335-e9cc61c16a86 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:07.399567 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3598acb5-93a0-4f25-8335-e9cc61c16a86 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:07.483399 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-3598acb5-93a0-4f25-8335-e9cc61c16a86 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:07.494681 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-3598acb5-93a0-4f25-8335-e9cc61c16a86 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/4d83b3ae-04db-4148-9d64-99458438ec9b" status: 200 len: 1361 microversion: 2.1 time: 0.397912 Oct 04 22:24:07.495534 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3306/6256] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:24:07 2022] GET /compute/v2.1/servers/4d83b3ae-04db-4148-9d64-99458438ec9b => generated 1361 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:24:07.501301 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-ee72a47e-7ae2-4842-bb1d-e4868cc1447a tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:24:07.502521 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-ee72a47e-7ae2-4842-bb1d-e4868cc1447a tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] [instance: 3d1e7581-b5c1-4998-a964-8ca90bf36626] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:24:07.510187 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ee72a47e-7ae2-4842-bb1d-e4868cc1447a tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:07.512125 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ee72a47e-7ae2-4842-bb1d-e4868cc1447a tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:07.513662 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ee72a47e-7ae2-4842-bb1d-e4868cc1447a tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:07.516628 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ee72a47e-7ae2-4842-bb1d-e4868cc1447a tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:07.517473 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ee72a47e-7ae2-4842-bb1d-e4868cc1447a tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:07.518086 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ee72a47e-7ae2-4842-bb1d-e4868cc1447a tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:07.598134 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-ee72a47e-7ae2-4842-bb1d-e4868cc1447a tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '680b9f424ac24ef0b93ff30c9a9d9831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ffabfbee11487b93dc6c9c4509935e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:07.608267 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-ee72a47e-7ae2-4842-bb1d-e4868cc1447a tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '680b9f424ac24ef0b93ff30c9a9d9831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ffabfbee11487b93dc6c9c4509935e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:07.610818 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-ee72a47e-7ae2-4842-bb1d-e4868cc1447a tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '680b9f424ac24ef0b93ff30c9a9d9831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ffabfbee11487b93dc6c9c4509935e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:07.612201 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-ee72a47e-7ae2-4842-bb1d-e4868cc1447a tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] 10.222.0.43 "GET /compute/v2.1/servers/3d1e7581-b5c1-4998-a964-8ca90bf36626" status: 200 len: 1366 microversion: 2.47 time: 0.115408 Oct 04 22:24:07.613566 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3307/6257] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:24:07 2022] GET /compute/v2.1/servers/3d1e7581-b5c1-4998-a964-8ca90bf36626 => generated 1366 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:24:08.521279 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-c207688d-b944-476d-9832-dfa79ddce677 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:24:08.522875 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-c207688d-b944-476d-9832-dfa79ddce677 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: 4d83b3ae-04db-4148-9d64-99458438ec9b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:24:08.529933 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c207688d-b944-476d-9832-dfa79ddce677 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:08.530501 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c207688d-b944-476d-9832-dfa79ddce677 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:08.531564 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c207688d-b944-476d-9832-dfa79ddce677 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:08.532449 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c207688d-b944-476d-9832-dfa79ddce677 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:08.532921 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c207688d-b944-476d-9832-dfa79ddce677 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:08.533357 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c207688d-b944-476d-9832-dfa79ddce677 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:08.616615 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-c207688d-b944-476d-9832-dfa79ddce677 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:08.626752 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-c207688d-b944-476d-9832-dfa79ddce677 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/4d83b3ae-04db-4148-9d64-99458438ec9b" status: 200 len: 1361 microversion: 2.1 time: 0.110087 Oct 04 22:24:08.627366 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3308/6258] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:24:08 2022] GET /compute/v2.1/servers/4d83b3ae-04db-4148-9d64-99458438ec9b => generated 1361 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:24:08.640321 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-d5e338e1-e285-400f-974b-31af54e854e4 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:24:08.642548 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-d5e338e1-e285-400f-974b-31af54e854e4 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] [instance: 3d1e7581-b5c1-4998-a964-8ca90bf36626] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:24:08.649493 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d5e338e1-e285-400f-974b-31af54e854e4 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:08.650067 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d5e338e1-e285-400f-974b-31af54e854e4 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:08.650898 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d5e338e1-e285-400f-974b-31af54e854e4 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:08.651675 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d5e338e1-e285-400f-974b-31af54e854e4 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:08.652386 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d5e338e1-e285-400f-974b-31af54e854e4 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:08.652900 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d5e338e1-e285-400f-974b-31af54e854e4 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:08.753503 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-d5e338e1-e285-400f-974b-31af54e854e4 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '680b9f424ac24ef0b93ff30c9a9d9831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ffabfbee11487b93dc6c9c4509935e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:08.778098 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-d5e338e1-e285-400f-974b-31af54e854e4 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '680b9f424ac24ef0b93ff30c9a9d9831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ffabfbee11487b93dc6c9c4509935e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:08.780340 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-d5e338e1-e285-400f-974b-31af54e854e4 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '680b9f424ac24ef0b93ff30c9a9d9831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ffabfbee11487b93dc6c9c4509935e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:08.788421 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-d5e338e1-e285-400f-974b-31af54e854e4 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] 10.222.0.43 "GET /compute/v2.1/servers/3d1e7581-b5c1-4998-a964-8ca90bf36626" status: 200 len: 1366 microversion: 2.47 time: 0.151853 Oct 04 22:24:08.800265 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3309/6259] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:24:08 2022] GET /compute/v2.1/servers/3d1e7581-b5c1-4998-a964-8ca90bf36626 => generated 1366 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 22:24:09.649782 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-d5ff68d2-9891-4d29-8023-40ebe2f83e81 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:24:09.650724 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-d5ff68d2-9891-4d29-8023-40ebe2f83e81 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: 4d83b3ae-04db-4148-9d64-99458438ec9b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:24:09.662594 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d5ff68d2-9891-4d29-8023-40ebe2f83e81 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:09.663477 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d5ff68d2-9891-4d29-8023-40ebe2f83e81 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:09.664364 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d5ff68d2-9891-4d29-8023-40ebe2f83e81 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:09.665281 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d5ff68d2-9891-4d29-8023-40ebe2f83e81 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:09.666070 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d5ff68d2-9891-4d29-8023-40ebe2f83e81 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:09.666777 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d5ff68d2-9891-4d29-8023-40ebe2f83e81 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:09.711994 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d5ff68d2-9891-4d29-8023-40ebe2f83e81 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:09.712745 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d5ff68d2-9891-4d29-8023-40ebe2f83e81 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:09.713458 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d5ff68d2-9891-4d29-8023-40ebe2f83e81 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:09.714084 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.objects.instance [None req-d5ff68d2-9891-4d29-8023-40ebe2f83e81 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lazy-loading 'fault' on Instance uuid 4d83b3ae-04db-4148-9d64-99458438ec9b {{(pid=134101) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 22:24:09.767190 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-d5ff68d2-9891-4d29-8023-40ebe2f83e81 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:09.775897 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-d5ff68d2-9891-4d29-8023-40ebe2f83e81 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/4d83b3ae-04db-4148-9d64-99458438ec9b" status: 200 len: 1366 microversion: 2.1 time: 0.130180 Oct 04 22:24:09.776444 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3310/6260] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:24:09 2022] GET /compute/v2.1/servers/4d83b3ae-04db-4148-9d64-99458438ec9b => generated 1366 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:24:09.821162 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-565a4b2a-4a49-450a-b55a-a8dc5a807616 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:24:09.821943 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-565a4b2a-4a49-450a-b55a-a8dc5a807616 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] [instance: 3d1e7581-b5c1-4998-a964-8ca90bf36626] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:24:09.830676 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-565a4b2a-4a49-450a-b55a-a8dc5a807616 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:09.831392 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-565a4b2a-4a49-450a-b55a-a8dc5a807616 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:09.832058 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-565a4b2a-4a49-450a-b55a-a8dc5a807616 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:09.833290 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-565a4b2a-4a49-450a-b55a-a8dc5a807616 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:09.833906 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-565a4b2a-4a49-450a-b55a-a8dc5a807616 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:09.834642 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-565a4b2a-4a49-450a-b55a-a8dc5a807616 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:09.927859 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-565a4b2a-4a49-450a-b55a-a8dc5a807616 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '680b9f424ac24ef0b93ff30c9a9d9831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ffabfbee11487b93dc6c9c4509935e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:09.937049 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-565a4b2a-4a49-450a-b55a-a8dc5a807616 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '680b9f424ac24ef0b93ff30c9a9d9831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ffabfbee11487b93dc6c9c4509935e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:09.938886 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-565a4b2a-4a49-450a-b55a-a8dc5a807616 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '680b9f424ac24ef0b93ff30c9a9d9831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ffabfbee11487b93dc6c9c4509935e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:09.940314 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-565a4b2a-4a49-450a-b55a-a8dc5a807616 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] 10.222.0.43 "GET /compute/v2.1/servers/3d1e7581-b5c1-4998-a964-8ca90bf36626" status: 200 len: 1366 microversion: 2.47 time: 0.123297 Oct 04 22:24:09.940990 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3311/6261] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:24:09 2022] GET /compute/v2.1/servers/3d1e7581-b5c1-4998-a964-8ca90bf36626 => generated 1366 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 22:24:10.802255 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-7b6e3924-379b-400e-8b41-5c8dbb70f819 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:24:10.804193 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-7b6e3924-379b-400e-8b41-5c8dbb70f819 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: 4d83b3ae-04db-4148-9d64-99458438ec9b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:24:10.813707 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7b6e3924-379b-400e-8b41-5c8dbb70f819 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:10.814226 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7b6e3924-379b-400e-8b41-5c8dbb70f819 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:10.814708 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7b6e3924-379b-400e-8b41-5c8dbb70f819 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:10.815620 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7b6e3924-379b-400e-8b41-5c8dbb70f819 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:10.816154 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7b6e3924-379b-400e-8b41-5c8dbb70f819 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:10.816606 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7b6e3924-379b-400e-8b41-5c8dbb70f819 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:10.831710 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-7b6e3924-379b-400e-8b41-5c8dbb70f819 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] HTTP exception thrown: Instance 4d83b3ae-04db-4148-9d64-99458438ec9b could not be found. Oct 04 22:24:10.833673 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-7b6e3924-379b-400e-8b41-5c8dbb70f819 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Request method failure captured: Oct 04 22:24:10.833673 n-d-860284-1 devstack@n-api.service[134101]: request: GET /compute/v2.1/servers/4d83b3ae-04db-4148-9d64-99458438ec9b HTTP/1.1 Oct 04 22:24:10.833673 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 22:24:10.833673 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 22:24:10.833673 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 22:24:10.833673 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 22:24:10.833673 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 22:24:10.833673 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 22:24:10.833673 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 22:24:10.833673 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 22:24:10.833673 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPLFSMo9Eg9y9Lu454XN1MXkt5BE7HeG-NZdibz9nP5ZbzTcA5eo2fVm4gnqUdOUNPfyWilTQor2E780fAI_U9XTD5akzJ8-jVP8Fthos4syj8Pc9nJeMuZjrdlu2EkiFF5ef-9mxCQWUxHOpcRBLI1i5aPH69baR_Z4N2zYKYuhPE2w Oct 04 22:24:10.833673 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 22:24:10.833673 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 22:24:10.833673 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 22:24:10.833673 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 22:24:10.833673 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 22:24:10.833673 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 22:24:10.833673 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: 5c98a72bacce47c3947f9b0f0b4e85b6 Oct 04 22:24:10.833673 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-TestVolumeBootPattern-1701442207 Oct 04 22:24:10.833673 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 22:24:10.833673 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 22:24:10.833673 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5c98a72bacce47c3947f9b0f0b4e85b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_5c98a72bacce47c3947f9b0f0b4e85b6", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5c98a72bacce47c3947f9b0f0b4e85b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/5c98a72bacce47c3947f9b0f0b4e85b6"}]}] Oct 04 22:24:10.833673 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-TestVolumeBootPattern-1701442207 Oct 04 22:24:10.833673 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: 5c98a72bacce47c3947f9b0f0b4e85b6 Oct 04 22:24:10.833673 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-TestVolumeBootPattern-1701442207 Oct 04 22:24:10.833673 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-TestVolumeBootPattern-1701442207-project Oct 04 22:24:10.833673 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 22:24:10.833673 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 22:24:10.833673 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 99acad09db70445b93ae1d64a1b49ca3 Oct 04 22:24:10.833673 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-TestVolumeBootPattern-1701442207-project Oct 04 22:24:10.833673 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 22:24:10.833673 n-d-860284-1 devstack@n-api.service[134101]: exception: Instance 4d83b3ae-04db-4148-9d64-99458438ec9b could not be found. Oct 04 22:24:10.833673 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': '4d83b3ae-04db-4148-9d64-99458438ec9b'} Oct 04 22:24:10.833673 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:24:10.833673 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:24:10.833673 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:24:10.833673 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:24:10.833673 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:24:10.833673 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:24:10.833673 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:24:10.833673 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:24:10.833673 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:24:10.833673 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:24:10.833673 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d83b3ae-04db-4148-9d64-99458438ec9b could not be found. Oct 04 22:24:10.833673 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:24:10.833673 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:24:10.833673 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:24:10.833673 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:24:10.833673 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:24:10.833673 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:24:10.833673 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:24:10.833673 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:24:10.833673 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:24:10.833673 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:24:10.833673 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:24:10.833673 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:24:10.833673 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:24:10.833673 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:24:10.833673 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:24:10.833673 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:24:10.833673 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d83b3ae-04db-4148-9d64-99458438ec9b could not be found. Oct 04 22:24:10.833673 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:24:10.833673 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:24:10.833673 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:24:10.838109 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:24:10.838109 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:24:10.838109 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:24:10.838109 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:24:10.838109 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:24:10.838109 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d83b3ae-04db-4148-9d64-99458438ec9b could not be found. Oct 04 22:24:10.838109 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:24:10.838109 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-7b6e3924-379b-400e-8b41-5c8dbb70f819 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Returning 404 to user: Instance 4d83b3ae-04db-4148-9d64-99458438ec9b could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:24:10.838109 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-7b6e3924-379b-400e-8b41-5c8dbb70f819 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/4d83b3ae-04db-4148-9d64-99458438ec9b" status: 404 len: 111 microversion: 2.1 time: 0.038744 Oct 04 22:24:10.838109 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3312/6262] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:24:10 2022] GET /compute/v2.1/servers/4d83b3ae-04db-4148-9d64-99458438ec9b => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 22:24:10.970301 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-2a5b5aec-71c1-4b2f-9391-1c35f0a2fbf9 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:24:10.970301 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-2a5b5aec-71c1-4b2f-9391-1c35f0a2fbf9 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] [instance: 3d1e7581-b5c1-4998-a964-8ca90bf36626] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:24:10.979477 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2a5b5aec-71c1-4b2f-9391-1c35f0a2fbf9 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:10.979991 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2a5b5aec-71c1-4b2f-9391-1c35f0a2fbf9 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:10.980449 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2a5b5aec-71c1-4b2f-9391-1c35f0a2fbf9 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:10.981234 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2a5b5aec-71c1-4b2f-9391-1c35f0a2fbf9 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:10.981718 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2a5b5aec-71c1-4b2f-9391-1c35f0a2fbf9 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:10.982335 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2a5b5aec-71c1-4b2f-9391-1c35f0a2fbf9 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:11.058379 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-2a5b5aec-71c1-4b2f-9391-1c35f0a2fbf9 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '680b9f424ac24ef0b93ff30c9a9d9831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ffabfbee11487b93dc6c9c4509935e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:11.067638 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-2a5b5aec-71c1-4b2f-9391-1c35f0a2fbf9 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '680b9f424ac24ef0b93ff30c9a9d9831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ffabfbee11487b93dc6c9c4509935e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:11.069174 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-2a5b5aec-71c1-4b2f-9391-1c35f0a2fbf9 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '680b9f424ac24ef0b93ff30c9a9d9831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ffabfbee11487b93dc6c9c4509935e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:11.070391 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-2a5b5aec-71c1-4b2f-9391-1c35f0a2fbf9 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] 10.222.0.43 "GET /compute/v2.1/servers/3d1e7581-b5c1-4998-a964-8ca90bf36626" status: 200 len: 1366 microversion: 2.47 time: 0.105808 Oct 04 22:24:11.070974 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3313/6263] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:24:10 2022] GET /compute/v2.1/servers/3d1e7581-b5c1-4998-a964-8ca90bf36626 => generated 1366 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 22:24:12.110217 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-04acd08f-f30e-4b04-83f3-9c38ab7321d2 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:24:12.113087 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-04acd08f-f30e-4b04-83f3-9c38ab7321d2 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] [instance: 3d1e7581-b5c1-4998-a964-8ca90bf36626] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:24:12.120273 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-04acd08f-f30e-4b04-83f3-9c38ab7321d2 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:12.120790 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-04acd08f-f30e-4b04-83f3-9c38ab7321d2 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:12.121248 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-04acd08f-f30e-4b04-83f3-9c38ab7321d2 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:12.121979 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-04acd08f-f30e-4b04-83f3-9c38ab7321d2 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:12.122477 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-04acd08f-f30e-4b04-83f3-9c38ab7321d2 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:12.122930 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-04acd08f-f30e-4b04-83f3-9c38ab7321d2 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:12.195809 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-04acd08f-f30e-4b04-83f3-9c38ab7321d2 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '680b9f424ac24ef0b93ff30c9a9d9831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ffabfbee11487b93dc6c9c4509935e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:12.206330 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-04acd08f-f30e-4b04-83f3-9c38ab7321d2 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '680b9f424ac24ef0b93ff30c9a9d9831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ffabfbee11487b93dc6c9c4509935e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:12.207840 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-04acd08f-f30e-4b04-83f3-9c38ab7321d2 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '680b9f424ac24ef0b93ff30c9a9d9831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ffabfbee11487b93dc6c9c4509935e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:12.209049 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-04acd08f-f30e-4b04-83f3-9c38ab7321d2 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] 10.222.0.43 "GET /compute/v2.1/servers/3d1e7581-b5c1-4998-a964-8ca90bf36626" status: 200 len: 1366 microversion: 2.47 time: 0.116136 Oct 04 22:24:12.209605 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3314/6264] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:24:12 2022] GET /compute/v2.1/servers/3d1e7581-b5c1-4998-a964-8ca90bf36626 => generated 1366 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:24:13.257391 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-b977ea4b-c76d-4fb5-a113-c17d3af84a55 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:24:13.261766 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-b977ea4b-c76d-4fb5-a113-c17d3af84a55 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] [instance: 3d1e7581-b5c1-4998-a964-8ca90bf36626] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:24:13.277290 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b977ea4b-c76d-4fb5-a113-c17d3af84a55 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:13.278230 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b977ea4b-c76d-4fb5-a113-c17d3af84a55 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:13.279064 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b977ea4b-c76d-4fb5-a113-c17d3af84a55 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:13.280221 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b977ea4b-c76d-4fb5-a113-c17d3af84a55 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:13.281832 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b977ea4b-c76d-4fb5-a113-c17d3af84a55 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:13.282619 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b977ea4b-c76d-4fb5-a113-c17d3af84a55 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:13.382471 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-b977ea4b-c76d-4fb5-a113-c17d3af84a55 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '680b9f424ac24ef0b93ff30c9a9d9831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ffabfbee11487b93dc6c9c4509935e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:13.398600 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-b977ea4b-c76d-4fb5-a113-c17d3af84a55 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '680b9f424ac24ef0b93ff30c9a9d9831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ffabfbee11487b93dc6c9c4509935e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:13.401625 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-b977ea4b-c76d-4fb5-a113-c17d3af84a55 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '680b9f424ac24ef0b93ff30c9a9d9831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ffabfbee11487b93dc6c9c4509935e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:13.403553 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-b977ea4b-c76d-4fb5-a113-c17d3af84a55 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] 10.222.0.43 "GET /compute/v2.1/servers/3d1e7581-b5c1-4998-a964-8ca90bf36626" status: 200 len: 1366 microversion: 2.47 time: 0.172606 Oct 04 22:24:13.425036 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3315/6265] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:24:13 2022] GET /compute/v2.1/servers/3d1e7581-b5c1-4998-a964-8ca90bf36626 => generated 1366 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 22:24:14.439648 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-62d6d525-d5de-4d20-b89c-008ff0badbe7 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:24:14.440257 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-62d6d525-d5de-4d20-b89c-008ff0badbe7 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] [instance: 3d1e7581-b5c1-4998-a964-8ca90bf36626] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:24:14.454149 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-62d6d525-d5de-4d20-b89c-008ff0badbe7 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:14.454803 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-62d6d525-d5de-4d20-b89c-008ff0badbe7 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:14.455354 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-62d6d525-d5de-4d20-b89c-008ff0badbe7 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:14.456166 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-62d6d525-d5de-4d20-b89c-008ff0badbe7 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:14.456728 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-62d6d525-d5de-4d20-b89c-008ff0badbe7 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:14.457272 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-62d6d525-d5de-4d20-b89c-008ff0badbe7 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:14.542330 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-62d6d525-d5de-4d20-b89c-008ff0badbe7 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '680b9f424ac24ef0b93ff30c9a9d9831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ffabfbee11487b93dc6c9c4509935e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:14.553154 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-62d6d525-d5de-4d20-b89c-008ff0badbe7 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '680b9f424ac24ef0b93ff30c9a9d9831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ffabfbee11487b93dc6c9c4509935e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:14.554982 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-62d6d525-d5de-4d20-b89c-008ff0badbe7 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '680b9f424ac24ef0b93ff30c9a9d9831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ffabfbee11487b93dc6c9c4509935e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:14.556452 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-62d6d525-d5de-4d20-b89c-008ff0badbe7 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] 10.222.0.43 "GET /compute/v2.1/servers/3d1e7581-b5c1-4998-a964-8ca90bf36626" status: 200 len: 1366 microversion: 2.47 time: 0.123070 Oct 04 22:24:14.557095 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3316/6266] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:24:14 2022] GET /compute/v2.1/servers/3d1e7581-b5c1-4998-a964-8ca90bf36626 => generated 1366 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:24:15.150862 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-21890d4c-f1f8-4eb8-b508-470b721f0486 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:24:15.151384 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-21890d4c-f1f8-4eb8-b508-470b721f0486 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: f4acd3e4-bb81-43c5-8636-5259a9331844] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:24:15.158114 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-21890d4c-f1f8-4eb8-b508-470b721f0486 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:15.158636 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-21890d4c-f1f8-4eb8-b508-470b721f0486 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:15.159094 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-21890d4c-f1f8-4eb8-b508-470b721f0486 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:15.160080 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-21890d4c-f1f8-4eb8-b508-470b721f0486 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:15.160555 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-21890d4c-f1f8-4eb8-b508-470b721f0486 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:15.161019 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-21890d4c-f1f8-4eb8-b508-470b721f0486 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:15.186416 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-21890d4c-f1f8-4eb8-b508-470b721f0486 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: f4acd3e4-bb81-43c5-8636-5259a9331844] Going to try to terminate instance {{(pid=134101) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 22:24:15.260753 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-21890d4c-f1f8-4eb8-b508-470b721f0486 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "DELETE /compute/v2.1/servers/f4acd3e4-bb81-43c5-8636-5259a9331844" status: 204 len: 0 microversion: 2.1 time: 0.113689 Oct 04 22:24:15.261524 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3317/6267] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 22:24:15 2022] DELETE /compute/v2.1/servers/f4acd3e4-bb81-43c5-8636-5259a9331844 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 22:24:15.270560 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-2870102f-64a6-4377-86c9-bc8224e0fb39 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:24:15.271267 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-2870102f-64a6-4377-86c9-bc8224e0fb39 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: f4acd3e4-bb81-43c5-8636-5259a9331844] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:24:15.277069 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2870102f-64a6-4377-86c9-bc8224e0fb39 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:15.277564 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2870102f-64a6-4377-86c9-bc8224e0fb39 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:15.278012 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2870102f-64a6-4377-86c9-bc8224e0fb39 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:15.278745 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2870102f-64a6-4377-86c9-bc8224e0fb39 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:15.279216 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2870102f-64a6-4377-86c9-bc8224e0fb39 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:15.279653 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2870102f-64a6-4377-86c9-bc8224e0fb39 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:15.412659 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-2870102f-64a6-4377-86c9-bc8224e0fb39 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:15.420330 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-2870102f-64a6-4377-86c9-bc8224e0fb39 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/f4acd3e4-bb81-43c5-8636-5259a9331844" status: 200 len: 1410 microversion: 2.1 time: 0.153843 Oct 04 22:24:15.420908 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3318/6268] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:24:15 2022] GET /compute/v2.1/servers/f4acd3e4-bb81-43c5-8636-5259a9331844 => generated 1410 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:24:15.582747 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-47abd4db-cd30-449f-9126-d060a8bea88d tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:24:15.583389 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-47abd4db-cd30-449f-9126-d060a8bea88d tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] [instance: 3d1e7581-b5c1-4998-a964-8ca90bf36626] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:24:15.590337 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-47abd4db-cd30-449f-9126-d060a8bea88d tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:15.590863 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-47abd4db-cd30-449f-9126-d060a8bea88d tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:15.591310 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-47abd4db-cd30-449f-9126-d060a8bea88d tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:15.592038 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-47abd4db-cd30-449f-9126-d060a8bea88d tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:15.592503 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-47abd4db-cd30-449f-9126-d060a8bea88d tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:15.592939 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-47abd4db-cd30-449f-9126-d060a8bea88d tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:15.611037 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:24:15.667722 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-47abd4db-cd30-449f-9126-d060a8bea88d tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '680b9f424ac24ef0b93ff30c9a9d9831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ffabfbee11487b93dc6c9c4509935e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:15.678115 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-47abd4db-cd30-449f-9126-d060a8bea88d tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '680b9f424ac24ef0b93ff30c9a9d9831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ffabfbee11487b93dc6c9c4509935e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:15.679853 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-47abd4db-cd30-449f-9126-d060a8bea88d tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '680b9f424ac24ef0b93ff30c9a9d9831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ffabfbee11487b93dc6c9c4509935e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:15.681405 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-47abd4db-cd30-449f-9126-d060a8bea88d tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] 10.222.0.43 "GET /compute/v2.1/servers/3d1e7581-b5c1-4998-a964-8ca90bf36626" status: 200 len: 1372 microversion: 2.47 time: 0.102528 Oct 04 22:24:15.682144 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3319/6269] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:24:15 2022] GET /compute/v2.1/servers/3d1e7581-b5c1-4998-a964-8ca90bf36626 => generated 1372 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 22:24:16.444403 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-c038952b-81d1-4584-a31d-af0b22ce3dba tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:24:16.445185 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-c038952b-81d1-4584-a31d-af0b22ce3dba tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: f4acd3e4-bb81-43c5-8636-5259a9331844] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:24:16.452050 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c038952b-81d1-4584-a31d-af0b22ce3dba tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:16.453274 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c038952b-81d1-4584-a31d-af0b22ce3dba tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:16.453729 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c038952b-81d1-4584-a31d-af0b22ce3dba tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:16.454487 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c038952b-81d1-4584-a31d-af0b22ce3dba tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:16.454960 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c038952b-81d1-4584-a31d-af0b22ce3dba tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:16.455409 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c038952b-81d1-4584-a31d-af0b22ce3dba tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:16.590101 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-c038952b-81d1-4584-a31d-af0b22ce3dba tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:16.600936 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-c038952b-81d1-4584-a31d-af0b22ce3dba tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/f4acd3e4-bb81-43c5-8636-5259a9331844" status: 200 len: 1410 microversion: 2.1 time: 0.159960 Oct 04 22:24:16.601589 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3320/6270] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:24:16 2022] GET /compute/v2.1/servers/f4acd3e4-bb81-43c5-8636-5259a9331844 => generated 1410 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:24:16.709671 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-605b40bf-5869-45aa-a831-5e4bbc2cc431 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:24:16.710217 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-605b40bf-5869-45aa-a831-5e4bbc2cc431 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] [instance: 3d1e7581-b5c1-4998-a964-8ca90bf36626] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:24:16.716262 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-605b40bf-5869-45aa-a831-5e4bbc2cc431 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:16.716768 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-605b40bf-5869-45aa-a831-5e4bbc2cc431 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:16.717221 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-605b40bf-5869-45aa-a831-5e4bbc2cc431 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:16.718017 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-605b40bf-5869-45aa-a831-5e4bbc2cc431 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:16.718636 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-605b40bf-5869-45aa-a831-5e4bbc2cc431 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:16.719089 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-605b40bf-5869-45aa-a831-5e4bbc2cc431 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:16.785478 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-605b40bf-5869-45aa-a831-5e4bbc2cc431 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '680b9f424ac24ef0b93ff30c9a9d9831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ffabfbee11487b93dc6c9c4509935e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:16.793911 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-605b40bf-5869-45aa-a831-5e4bbc2cc431 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '680b9f424ac24ef0b93ff30c9a9d9831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ffabfbee11487b93dc6c9c4509935e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:16.795402 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-605b40bf-5869-45aa-a831-5e4bbc2cc431 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '680b9f424ac24ef0b93ff30c9a9d9831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ffabfbee11487b93dc6c9c4509935e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:16.797346 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-605b40bf-5869-45aa-a831-5e4bbc2cc431 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] 10.222.0.43 "GET /compute/v2.1/servers/3d1e7581-b5c1-4998-a964-8ca90bf36626" status: 200 len: 1372 microversion: 2.47 time: 0.091577 Oct 04 22:24:16.797950 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3321/6271] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:24:16 2022] GET /compute/v2.1/servers/3d1e7581-b5c1-4998-a964-8ca90bf36626 => generated 1372 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 22:24:17.587782 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-3336881d-0de5-4d90-a766-09fff8a40013 req-f81ea56a-3219-4344-a18b-e33c87ba9072 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4acd3e4-bb81-43c5-8636-5259a9331844", "name": "network-vif-deleted", "tag": "bc5dd01e-0eb1-49d8-b209-65c021fa084a"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:24:17.599161 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-3336881d-0de5-4d90-a766-09fff8a40013 req-f81ea56a-3219-4344-a18b-e33c87ba9072 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:17.599856 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-3336881d-0de5-4d90-a766-09fff8a40013 req-f81ea56a-3219-4344-a18b-e33c87ba9072 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:17.600089 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-3336881d-0de5-4d90-a766-09fff8a40013 req-f81ea56a-3219-4344-a18b-e33c87ba9072 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:17.614480 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-3336881d-0de5-4d90-a766-09fff8a40013 req-f81ea56a-3219-4344-a18b-e33c87ba9072 service nova] Creating event network-vif-deleted:bc5dd01e-0eb1-49d8-b209-65c021fa084a for instance f4acd3e4-bb81-43c5-8636-5259a9331844 on n-h2-860284-1 Oct 04 22:24:17.629895 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-3336881d-0de5-4d90-a766-09fff8a40013 req-f81ea56a-3219-4344-a18b-e33c87ba9072 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044132 Oct 04 22:24:17.631558 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3322/6272] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:24:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:24:17.638226 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-3913f9b7-60f9-45ce-a5d2-3ca1d474d87d tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:24:17.639371 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-3913f9b7-60f9-45ce-a5d2-3ca1d474d87d tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: f4acd3e4-bb81-43c5-8636-5259a9331844] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:24:17.646896 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3913f9b7-60f9-45ce-a5d2-3ca1d474d87d tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:17.647702 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3913f9b7-60f9-45ce-a5d2-3ca1d474d87d tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:17.648455 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3913f9b7-60f9-45ce-a5d2-3ca1d474d87d tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:17.648925 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3913f9b7-60f9-45ce-a5d2-3ca1d474d87d tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:17.649404 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3913f9b7-60f9-45ce-a5d2-3ca1d474d87d tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:17.649858 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3913f9b7-60f9-45ce-a5d2-3ca1d474d87d tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:17.729204 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-3913f9b7-60f9-45ce-a5d2-3ca1d474d87d tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:17.746009 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-3913f9b7-60f9-45ce-a5d2-3ca1d474d87d tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/f4acd3e4-bb81-43c5-8636-5259a9331844" status: 200 len: 1201 microversion: 2.1 time: 0.112958 Oct 04 22:24:17.747016 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3323/6273] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:24:17 2022] GET /compute/v2.1/servers/f4acd3e4-bb81-43c5-8636-5259a9331844 => generated 1201 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:24:17.824788 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e6481860-b778-4bfc-820a-42c4738f3a58 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:24:17.825428 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-e6481860-b778-4bfc-820a-42c4738f3a58 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] [instance: 3d1e7581-b5c1-4998-a964-8ca90bf36626] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:24:17.832496 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e6481860-b778-4bfc-820a-42c4738f3a58 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:17.833010 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e6481860-b778-4bfc-820a-42c4738f3a58 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:17.833457 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e6481860-b778-4bfc-820a-42c4738f3a58 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:17.834214 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e6481860-b778-4bfc-820a-42c4738f3a58 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:17.834764 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e6481860-b778-4bfc-820a-42c4738f3a58 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:17.835215 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e6481860-b778-4bfc-820a-42c4738f3a58 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:17.956617 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-e6481860-b778-4bfc-820a-42c4738f3a58 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '680b9f424ac24ef0b93ff30c9a9d9831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ffabfbee11487b93dc6c9c4509935e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:17.965840 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-e6481860-b778-4bfc-820a-42c4738f3a58 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '680b9f424ac24ef0b93ff30c9a9d9831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ffabfbee11487b93dc6c9c4509935e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:17.967023 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-e6481860-b778-4bfc-820a-42c4738f3a58 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '680b9f424ac24ef0b93ff30c9a9d9831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ffabfbee11487b93dc6c9c4509935e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:17.968973 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-e6481860-b778-4bfc-820a-42c4738f3a58 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] 10.222.0.43 "GET /compute/v2.1/servers/3d1e7581-b5c1-4998-a964-8ca90bf36626" status: 200 len: 1372 microversion: 2.47 time: 0.148271 Oct 04 22:24:17.971852 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3324/6274] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:24:17 2022] GET /compute/v2.1/servers/3d1e7581-b5c1-4998-a964-8ca90bf36626 => generated 1372 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:24:18.769154 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-c2e28b87-5855-4ad7-8b60-6aa9ffc25c97 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:24:18.769797 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-c2e28b87-5855-4ad7-8b60-6aa9ffc25c97 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: f4acd3e4-bb81-43c5-8636-5259a9331844] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:24:18.776940 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c2e28b87-5855-4ad7-8b60-6aa9ffc25c97 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:18.777700 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c2e28b87-5855-4ad7-8b60-6aa9ffc25c97 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:18.778408 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c2e28b87-5855-4ad7-8b60-6aa9ffc25c97 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:18.779350 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c2e28b87-5855-4ad7-8b60-6aa9ffc25c97 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:18.780017 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c2e28b87-5855-4ad7-8b60-6aa9ffc25c97 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:18.781181 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c2e28b87-5855-4ad7-8b60-6aa9ffc25c97 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:18.849015 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-c2e28b87-5855-4ad7-8b60-6aa9ffc25c97 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:18.858258 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-c2e28b87-5855-4ad7-8b60-6aa9ffc25c97 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/f4acd3e4-bb81-43c5-8636-5259a9331844" status: 200 len: 1201 microversion: 2.1 time: 0.092952 Oct 04 22:24:18.859245 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3325/6275] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:24:18 2022] GET /compute/v2.1/servers/f4acd3e4-bb81-43c5-8636-5259a9331844 => generated 1201 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:24:18.997696 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-ba321a76-4eaa-408e-8f9d-e90107dd2d3a tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:24:18.998316 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-ba321a76-4eaa-408e-8f9d-e90107dd2d3a tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] [instance: 3d1e7581-b5c1-4998-a964-8ca90bf36626] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:24:19.005648 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ba321a76-4eaa-408e-8f9d-e90107dd2d3a tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:19.006142 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ba321a76-4eaa-408e-8f9d-e90107dd2d3a tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:19.006793 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ba321a76-4eaa-408e-8f9d-e90107dd2d3a tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:19.007534 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ba321a76-4eaa-408e-8f9d-e90107dd2d3a tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:19.007999 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ba321a76-4eaa-408e-8f9d-e90107dd2d3a tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:19.008432 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ba321a76-4eaa-408e-8f9d-e90107dd2d3a tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:19.083565 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-ba321a76-4eaa-408e-8f9d-e90107dd2d3a tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '680b9f424ac24ef0b93ff30c9a9d9831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ffabfbee11487b93dc6c9c4509935e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:19.093398 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-ba321a76-4eaa-408e-8f9d-e90107dd2d3a tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '680b9f424ac24ef0b93ff30c9a9d9831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ffabfbee11487b93dc6c9c4509935e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:19.094890 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-ba321a76-4eaa-408e-8f9d-e90107dd2d3a tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '680b9f424ac24ef0b93ff30c9a9d9831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ffabfbee11487b93dc6c9c4509935e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:19.096089 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-ba321a76-4eaa-408e-8f9d-e90107dd2d3a tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] 10.222.0.43 "GET /compute/v2.1/servers/3d1e7581-b5c1-4998-a964-8ca90bf36626" status: 200 len: 1372 microversion: 2.47 time: 0.102549 Oct 04 22:24:19.096658 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3326/6276] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:24:18 2022] GET /compute/v2.1/servers/3d1e7581-b5c1-4998-a964-8ca90bf36626 => generated 1372 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 22:24:19.884156 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-818a95d5-dd55-493f-9460-c8ea9c85255f tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:24:19.884768 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-818a95d5-dd55-493f-9460-c8ea9c85255f tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: f4acd3e4-bb81-43c5-8636-5259a9331844] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:24:19.891854 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-818a95d5-dd55-493f-9460-c8ea9c85255f tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:19.892354 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-818a95d5-dd55-493f-9460-c8ea9c85255f tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:19.892816 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-818a95d5-dd55-493f-9460-c8ea9c85255f tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:19.893528 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-818a95d5-dd55-493f-9460-c8ea9c85255f tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:19.894004 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-818a95d5-dd55-493f-9460-c8ea9c85255f tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:19.894477 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-818a95d5-dd55-493f-9460-c8ea9c85255f tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:19.957761 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-818a95d5-dd55-493f-9460-c8ea9c85255f tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:19.965833 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-818a95d5-dd55-493f-9460-c8ea9c85255f tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/f4acd3e4-bb81-43c5-8636-5259a9331844" status: 200 len: 1201 microversion: 2.1 time: 0.085676 Oct 04 22:24:19.966438 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3327/6277] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:24:19 2022] GET /compute/v2.1/servers/f4acd3e4-bb81-43c5-8636-5259a9331844 => generated 1201 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:24:20.126434 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-2e225fbd-87e6-4984-bc1b-72a00a195f38 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:24:20.127205 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-2e225fbd-87e6-4984-bc1b-72a00a195f38 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] [instance: 3d1e7581-b5c1-4998-a964-8ca90bf36626] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:24:20.137470 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2e225fbd-87e6-4984-bc1b-72a00a195f38 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:20.138154 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2e225fbd-87e6-4984-bc1b-72a00a195f38 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:20.138820 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2e225fbd-87e6-4984-bc1b-72a00a195f38 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:20.139751 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2e225fbd-87e6-4984-bc1b-72a00a195f38 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:20.140222 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2e225fbd-87e6-4984-bc1b-72a00a195f38 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:20.140668 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2e225fbd-87e6-4984-bc1b-72a00a195f38 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:20.219788 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-2e225fbd-87e6-4984-bc1b-72a00a195f38 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '680b9f424ac24ef0b93ff30c9a9d9831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ffabfbee11487b93dc6c9c4509935e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:20.229050 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-2e225fbd-87e6-4984-bc1b-72a00a195f38 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '680b9f424ac24ef0b93ff30c9a9d9831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ffabfbee11487b93dc6c9c4509935e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:20.230570 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-2e225fbd-87e6-4984-bc1b-72a00a195f38 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '680b9f424ac24ef0b93ff30c9a9d9831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ffabfbee11487b93dc6c9c4509935e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:20.231775 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-2e225fbd-87e6-4984-bc1b-72a00a195f38 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] 10.222.0.43 "GET /compute/v2.1/servers/3d1e7581-b5c1-4998-a964-8ca90bf36626" status: 200 len: 1357 microversion: 2.47 time: 0.112406 Oct 04 22:24:20.232343 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3328/6278] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:24:20 2022] GET /compute/v2.1/servers/3d1e7581-b5c1-4998-a964-8ca90bf36626 => generated 1357 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:24:20.261282 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-deb262bf-4cf1-48dc-bd3f-626bf0983d2f tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:24:20.266966 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-deb262bf-4cf1-48dc-bd3f-626bf0983d2f tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '680b9f424ac24ef0b93ff30c9a9d9831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ffabfbee11487b93dc6c9c4509935e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:20.268118 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-deb262bf-4cf1-48dc-bd3f-626bf0983d2f tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Searching by: {'deleted': False, 'project_id': 'c2ffabfbee11487b93dc6c9c4509935e'} {{(pid=134101) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 22:24:20.274519 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-deb262bf-4cf1-48dc-bd3f-626bf0983d2f tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:20.275155 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-deb262bf-4cf1-48dc-bd3f-626bf0983d2f tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:20.275756 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-deb262bf-4cf1-48dc-bd3f-626bf0983d2f tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:20.276945 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-deb262bf-4cf1-48dc-bd3f-626bf0983d2f tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:20.277554 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-deb262bf-4cf1-48dc-bd3f-626bf0983d2f tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:20.278128 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-deb262bf-4cf1-48dc-bd3f-626bf0983d2f tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:20.396857 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.multi_cell_list [None req-deb262bf-4cf1-48dc-bd3f-626bf0983d2f tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=134101) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 22:24:20.482649 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-deb262bf-4cf1-48dc-bd3f-626bf0983d2f tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '680b9f424ac24ef0b93ff30c9a9d9831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ffabfbee11487b93dc6c9c4509935e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:20.490133 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-deb262bf-4cf1-48dc-bd3f-626bf0983d2f tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:20.490743 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-deb262bf-4cf1-48dc-bd3f-626bf0983d2f tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:20.491207 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-deb262bf-4cf1-48dc-bd3f-626bf0983d2f tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:20.503041 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-deb262bf-4cf1-48dc-bd3f-626bf0983d2f tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '680b9f424ac24ef0b93ff30c9a9d9831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ffabfbee11487b93dc6c9c4509935e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:20.504589 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-deb262bf-4cf1-48dc-bd3f-626bf0983d2f tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '680b9f424ac24ef0b93ff30c9a9d9831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ffabfbee11487b93dc6c9c4509935e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:20.541896 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-deb262bf-4cf1-48dc-bd3f-626bf0983d2f tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] 10.222.0.43 "GET /compute/v2.1/servers/detail" status: 200 len: 2707 microversion: 2.47 time: 0.284837 Oct 04 22:24:20.542740 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3329/6279] 10.222.0.43 () {60 vars in 1187 bytes} [Tue Oct 4 22:24:20 2022] GET /compute/v2.1/servers/detail => generated 2707 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 22:24:20.577746 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-6a5a517e-3090-42a8-9ec6-51334a65b8e7 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:24:20.578229 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-6a5a517e-3090-42a8-9ec6-51334a65b8e7 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] [instance: 3d1e7581-b5c1-4998-a964-8ca90bf36626] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:24:20.584413 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6a5a517e-3090-42a8-9ec6-51334a65b8e7 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:20.584861 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6a5a517e-3090-42a8-9ec6-51334a65b8e7 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:20.585346 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6a5a517e-3090-42a8-9ec6-51334a65b8e7 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:20.586077 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6a5a517e-3090-42a8-9ec6-51334a65b8e7 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:20.586571 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6a5a517e-3090-42a8-9ec6-51334a65b8e7 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:20.587020 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6a5a517e-3090-42a8-9ec6-51334a65b8e7 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:20.614715 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-6a5a517e-3090-42a8-9ec6-51334a65b8e7 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] [instance: 3d1e7581-b5c1-4998-a964-8ca90bf36626] Going to try to terminate instance {{(pid=134101) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 22:24:20.697505 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-6a5a517e-3090-42a8-9ec6-51334a65b8e7 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] 10.222.0.43 "DELETE /compute/v2.1/servers/3d1e7581-b5c1-4998-a964-8ca90bf36626" status: 204 len: 0 microversion: 2.47 time: 0.122789 Oct 04 22:24:20.698387 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3330/6280] 10.222.0.43 () {60 vars in 1280 bytes} [Tue Oct 4 22:24:20 2022] DELETE /compute/v2.1/servers/3d1e7581-b5c1-4998-a964-8ca90bf36626 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 22:24:20.709157 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-1aaee94c-24aa-4cb4-a011-23c30755c35c tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:24:20.710124 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-1aaee94c-24aa-4cb4-a011-23c30755c35c tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] [instance: 3d1e7581-b5c1-4998-a964-8ca90bf36626] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:24:20.716211 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1aaee94c-24aa-4cb4-a011-23c30755c35c tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:20.716699 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1aaee94c-24aa-4cb4-a011-23c30755c35c tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:20.717323 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1aaee94c-24aa-4cb4-a011-23c30755c35c tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:20.718081 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1aaee94c-24aa-4cb4-a011-23c30755c35c tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:20.718661 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1aaee94c-24aa-4cb4-a011-23c30755c35c tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:20.719423 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1aaee94c-24aa-4cb4-a011-23c30755c35c tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:20.830246 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-1aaee94c-24aa-4cb4-a011-23c30755c35c tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '680b9f424ac24ef0b93ff30c9a9d9831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ffabfbee11487b93dc6c9c4509935e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:20.841654 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-1aaee94c-24aa-4cb4-a011-23c30755c35c tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '680b9f424ac24ef0b93ff30c9a9d9831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ffabfbee11487b93dc6c9c4509935e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:20.843580 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-1aaee94c-24aa-4cb4-a011-23c30755c35c tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '680b9f424ac24ef0b93ff30c9a9d9831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ffabfbee11487b93dc6c9c4509935e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:20.845814 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-1aaee94c-24aa-4cb4-a011-23c30755c35c tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] 10.222.0.43 "GET /compute/v2.1/servers/3d1e7581-b5c1-4998-a964-8ca90bf36626" status: 200 len: 1363 microversion: 2.47 time: 0.141036 Oct 04 22:24:20.849067 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3331/6281] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:24:20 2022] GET /compute/v2.1/servers/3d1e7581-b5c1-4998-a964-8ca90bf36626 => generated 1363 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 22:24:20.991499 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-c84ce636-b7eb-4c5d-9dd9-e09fbc38982a tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:24:20.992148 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-c84ce636-b7eb-4c5d-9dd9-e09fbc38982a tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: f4acd3e4-bb81-43c5-8636-5259a9331844] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:24:21.000488 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c84ce636-b7eb-4c5d-9dd9-e09fbc38982a tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:21.001509 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c84ce636-b7eb-4c5d-9dd9-e09fbc38982a tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:21.001970 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c84ce636-b7eb-4c5d-9dd9-e09fbc38982a tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:21.002733 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c84ce636-b7eb-4c5d-9dd9-e09fbc38982a tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:21.003210 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c84ce636-b7eb-4c5d-9dd9-e09fbc38982a tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:21.003655 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c84ce636-b7eb-4c5d-9dd9-e09fbc38982a tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:21.095372 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-c84ce636-b7eb-4c5d-9dd9-e09fbc38982a tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:21.104421 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-c84ce636-b7eb-4c5d-9dd9-e09fbc38982a tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/f4acd3e4-bb81-43c5-8636-5259a9331844" status: 200 len: 1201 microversion: 2.1 time: 0.118917 Oct 04 22:24:21.105018 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3332/6282] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:24:20 2022] GET /compute/v2.1/servers/f4acd3e4-bb81-43c5-8636-5259a9331844 => generated 1201 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:24:21.875857 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-77eead9e-bd3d-4516-b80e-2772b7143b2b tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:24:21.876775 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-77eead9e-bd3d-4516-b80e-2772b7143b2b tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] [instance: 3d1e7581-b5c1-4998-a964-8ca90bf36626] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:24:21.883353 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-77eead9e-bd3d-4516-b80e-2772b7143b2b tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:21.884012 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-77eead9e-bd3d-4516-b80e-2772b7143b2b tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:21.884565 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-77eead9e-bd3d-4516-b80e-2772b7143b2b tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:21.885412 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-77eead9e-bd3d-4516-b80e-2772b7143b2b tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:21.886000 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-77eead9e-bd3d-4516-b80e-2772b7143b2b tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:21.886741 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-77eead9e-bd3d-4516-b80e-2772b7143b2b tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:21.970335 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-77eead9e-bd3d-4516-b80e-2772b7143b2b tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '680b9f424ac24ef0b93ff30c9a9d9831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ffabfbee11487b93dc6c9c4509935e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:21.986056 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-77eead9e-bd3d-4516-b80e-2772b7143b2b tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '680b9f424ac24ef0b93ff30c9a9d9831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ffabfbee11487b93dc6c9c4509935e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:21.987719 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-77eead9e-bd3d-4516-b80e-2772b7143b2b tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '680b9f424ac24ef0b93ff30c9a9d9831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ffabfbee11487b93dc6c9c4509935e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:21.992838 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-77eead9e-bd3d-4516-b80e-2772b7143b2b tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] 10.222.0.43 "GET /compute/v2.1/servers/3d1e7581-b5c1-4998-a964-8ca90bf36626" status: 200 len: 1363 microversion: 2.47 time: 0.121540 Oct 04 22:24:21.993825 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3333/6283] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:24:21 2022] GET /compute/v2.1/servers/3d1e7581-b5c1-4998-a964-8ca90bf36626 => generated 1363 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 22:24:22.131650 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-d7269244-9693-49ba-8174-2ed5a3dc391c tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:24:22.131650 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-d7269244-9693-49ba-8174-2ed5a3dc391c tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: f4acd3e4-bb81-43c5-8636-5259a9331844] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:24:22.147481 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d7269244-9693-49ba-8174-2ed5a3dc391c tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:22.148227 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d7269244-9693-49ba-8174-2ed5a3dc391c tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:22.148828 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d7269244-9693-49ba-8174-2ed5a3dc391c tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:22.149717 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d7269244-9693-49ba-8174-2ed5a3dc391c tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:22.150224 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d7269244-9693-49ba-8174-2ed5a3dc391c tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:22.150845 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d7269244-9693-49ba-8174-2ed5a3dc391c tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:22.168114 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:24:22.247615 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-d7269244-9693-49ba-8174-2ed5a3dc391c tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:22.257838 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-d7269244-9693-49ba-8174-2ed5a3dc391c tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/f4acd3e4-bb81-43c5-8636-5259a9331844" status: 200 len: 1201 microversion: 2.1 time: 0.132194 Oct 04 22:24:22.259138 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3334/6284] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:24:22 2022] GET /compute/v2.1/servers/f4acd3e4-bb81-43c5-8636-5259a9331844 => generated 1201 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:24:23.021268 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-46e51796-9d7b-4e5b-a2d0-d39e14a21ade tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:24:23.022094 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-46e51796-9d7b-4e5b-a2d0-d39e14a21ade tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] [instance: 3d1e7581-b5c1-4998-a964-8ca90bf36626] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:24:23.028427 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-46e51796-9d7b-4e5b-a2d0-d39e14a21ade tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:23.029477 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-46e51796-9d7b-4e5b-a2d0-d39e14a21ade tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:23.030612 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-46e51796-9d7b-4e5b-a2d0-d39e14a21ade tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:23.031927 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-46e51796-9d7b-4e5b-a2d0-d39e14a21ade tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:23.032652 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-46e51796-9d7b-4e5b-a2d0-d39e14a21ade tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:23.033315 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-46e51796-9d7b-4e5b-a2d0-d39e14a21ade tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:23.360633 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-46e51796-9d7b-4e5b-a2d0-d39e14a21ade tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:23.361372 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-46e51796-9d7b-4e5b-a2d0-d39e14a21ade tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:23.361992 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-46e51796-9d7b-4e5b-a2d0-d39e14a21ade tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:23.362674 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.objects.instance [None req-46e51796-9d7b-4e5b-a2d0-d39e14a21ade tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lazy-loading 'fault' on Instance uuid 3d1e7581-b5c1-4998-a964-8ca90bf36626 {{(pid=134101) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 22:24:23.435319 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-46e51796-9d7b-4e5b-a2d0-d39e14a21ade tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '680b9f424ac24ef0b93ff30c9a9d9831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ffabfbee11487b93dc6c9c4509935e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:23.447721 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-46e51796-9d7b-4e5b-a2d0-d39e14a21ade tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '680b9f424ac24ef0b93ff30c9a9d9831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ffabfbee11487b93dc6c9c4509935e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:23.450020 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-46e51796-9d7b-4e5b-a2d0-d39e14a21ade tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '680b9f424ac24ef0b93ff30c9a9d9831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ffabfbee11487b93dc6c9c4509935e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:23.452283 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-46e51796-9d7b-4e5b-a2d0-d39e14a21ade tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] 10.222.0.43 "GET /compute/v2.1/servers/3d1e7581-b5c1-4998-a964-8ca90bf36626" status: 200 len: 1368 microversion: 2.47 time: 0.435198 Oct 04 22:24:23.462393 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3335/6285] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:24:23 2022] GET /compute/v2.1/servers/3d1e7581-b5c1-4998-a964-8ca90bf36626 => generated 1368 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 22:24:23.462393 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-7b4b241b-64c1-475a-9acb-f9261a23b35f tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:24:23.462393 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-7b4b241b-64c1-475a-9acb-f9261a23b35f tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: f4acd3e4-bb81-43c5-8636-5259a9331844] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:24:23.465416 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7b4b241b-64c1-475a-9acb-f9261a23b35f tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:23.466119 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7b4b241b-64c1-475a-9acb-f9261a23b35f tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:23.466756 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7b4b241b-64c1-475a-9acb-f9261a23b35f tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:23.468631 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7b4b241b-64c1-475a-9acb-f9261a23b35f tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:23.469427 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7b4b241b-64c1-475a-9acb-f9261a23b35f tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:23.470041 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7b4b241b-64c1-475a-9acb-f9261a23b35f tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:23.486682 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-7b4b241b-64c1-475a-9acb-f9261a23b35f tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] HTTP exception thrown: Instance f4acd3e4-bb81-43c5-8636-5259a9331844 could not be found. Oct 04 22:24:23.488519 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-7b4b241b-64c1-475a-9acb-f9261a23b35f tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Request method failure captured: Oct 04 22:24:23.488519 n-d-860284-1 devstack@n-api.service[134101]: request: GET /compute/v2.1/servers/f4acd3e4-bb81-43c5-8636-5259a9331844 HTTP/1.1 Oct 04 22:24:23.488519 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 22:24:23.488519 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 22:24:23.488519 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 22:24:23.488519 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 22:24:23.488519 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 22:24:23.488519 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 22:24:23.488519 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 22:24:23.488519 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 22:24:23.488519 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPLFSMo9Eg9y9Lu454XN1MXkt5BE7HeG-NZdibz9nP5ZbzTcA5eo2fVm4gnqUdOUNPfyWilTQor2E780fAI_U9XTD5akzJ8-jVP8Fthos4syj8Pc9nJeMuZjrdlu2EkiFF5ef-9mxCQWUxHOpcRBLI1i5aPH69baR_Z4N2zYKYuhPE2w Oct 04 22:24:23.488519 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 22:24:23.488519 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 22:24:23.488519 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 22:24:23.488519 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 22:24:23.488519 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 22:24:23.488519 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 22:24:23.488519 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: 5c98a72bacce47c3947f9b0f0b4e85b6 Oct 04 22:24:23.488519 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-TestVolumeBootPattern-1701442207 Oct 04 22:24:23.488519 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 22:24:23.488519 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 22:24:23.488519 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5c98a72bacce47c3947f9b0f0b4e85b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_5c98a72bacce47c3947f9b0f0b4e85b6", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5c98a72bacce47c3947f9b0f0b4e85b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/5c98a72bacce47c3947f9b0f0b4e85b6"}]}] Oct 04 22:24:23.488519 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-TestVolumeBootPattern-1701442207 Oct 04 22:24:23.488519 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: 5c98a72bacce47c3947f9b0f0b4e85b6 Oct 04 22:24:23.488519 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-TestVolumeBootPattern-1701442207 Oct 04 22:24:23.488519 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-TestVolumeBootPattern-1701442207-project Oct 04 22:24:23.488519 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 22:24:23.488519 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 22:24:23.488519 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 99acad09db70445b93ae1d64a1b49ca3 Oct 04 22:24:23.488519 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-TestVolumeBootPattern-1701442207-project Oct 04 22:24:23.488519 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 22:24:23.488519 n-d-860284-1 devstack@n-api.service[134101]: exception: Instance f4acd3e4-bb81-43c5-8636-5259a9331844 could not be found. Oct 04 22:24:23.488519 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': 'f4acd3e4-bb81-43c5-8636-5259a9331844'} Oct 04 22:24:23.488519 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:24:23.488519 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:24:23.488519 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:24:23.488519 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:24:23.488519 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:24:23.488519 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:24:23.488519 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:24:23.488519 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:24:23.488519 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:24:23.488519 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:24:23.488519 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4acd3e4-bb81-43c5-8636-5259a9331844 could not be found. Oct 04 22:24:23.488519 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:24:23.488519 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:24:23.488519 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:24:23.488519 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:24:23.488519 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:24:23.488519 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:24:23.488519 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:24:23.488519 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:24:23.488519 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:24:23.488519 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:24:23.488519 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:24:23.488519 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:24:23.488519 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:24:23.488519 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:24:23.488519 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:24:23.488519 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:24:23.488519 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4acd3e4-bb81-43c5-8636-5259a9331844 could not be found. Oct 04 22:24:23.488519 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:24:23.488519 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:24:23.488519 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:24:23.492870 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:24:23.492870 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:24:23.492870 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:24:23.492870 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:24:23.492870 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:24:23.492870 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4acd3e4-bb81-43c5-8636-5259a9331844 could not be found. Oct 04 22:24:23.492870 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:24:23.492870 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-7b4b241b-64c1-475a-9acb-f9261a23b35f tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Returning 404 to user: Instance f4acd3e4-bb81-43c5-8636-5259a9331844 could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:24:23.492870 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-7b4b241b-64c1-475a-9acb-f9261a23b35f tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/f4acd3e4-bb81-43c5-8636-5259a9331844" status: 404 len: 111 microversion: 2.1 time: 0.035519 Oct 04 22:24:23.492870 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3336/6286] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:24:23 2022] GET /compute/v2.1/servers/f4acd3e4-bb81-43c5-8636-5259a9331844 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:24:24.482236 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-09d6d9d7-afeb-447f-993e-fd552f89cd13 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:24:24.483842 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-09d6d9d7-afeb-447f-993e-fd552f89cd13 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] [instance: 3d1e7581-b5c1-4998-a964-8ca90bf36626] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:24:24.491416 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-09d6d9d7-afeb-447f-993e-fd552f89cd13 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:24.492181 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-09d6d9d7-afeb-447f-993e-fd552f89cd13 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:24.492748 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-09d6d9d7-afeb-447f-993e-fd552f89cd13 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:24.493548 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-09d6d9d7-afeb-447f-993e-fd552f89cd13 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:24.494134 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-09d6d9d7-afeb-447f-993e-fd552f89cd13 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:24.494678 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-09d6d9d7-afeb-447f-993e-fd552f89cd13 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:24.511724 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-09d6d9d7-afeb-447f-993e-fd552f89cd13 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] HTTP exception thrown: Instance 3d1e7581-b5c1-4998-a964-8ca90bf36626 could not be found. Oct 04 22:24:24.513508 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-09d6d9d7-afeb-447f-993e-fd552f89cd13 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Request method failure captured: Oct 04 22:24:24.513508 n-d-860284-1 devstack@n-api.service[134101]: request: GET /compute/v2.1/servers/3d1e7581-b5c1-4998-a964-8ca90bf36626 HTTP/1.1 Oct 04 22:24:24.513508 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 22:24:24.513508 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 22:24:24.513508 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 22:24:24.513508 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 22:24:24.513508 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 22:24:24.513508 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 22:24:24.513508 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 22:24:24.513508 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 22:24:24.513508 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPLJh1qIxRRLQR5BqlrVDWH_RTYveWDad6f1gNn6o2BAhx8yhbmv4PZTVCnw7dQucRcN2oWJyvQeseE1r1xmg4mwshg0Ia93CwQ0b9eNijp9TIPZjE7NufSbdxbrdvoKoaEGz678jYaaojOUHH52QIofHYy3ODmpjTLsLZ-zbF5aLe2g Oct 04 22:24:24.513508 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 22:24:24.513508 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 22:24:24.513508 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 22:24:24.513508 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 22:24:24.513508 n-d-860284-1 devstack@n-api.service[134101]: X-Openstack-Nova-Api-Version: 2.47 Oct 04 22:24:24.513508 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 22:24:24.513508 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 22:24:24.513508 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: c2ffabfbee11487b93dc6c9c4509935e Oct 04 22:24:24.513508 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-ServerShowV247Test-1024443248 Oct 04 22:24:24.513508 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 22:24:24.513508 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 22:24:24.513508 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c2ffabfbee11487b93dc6c9c4509935e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_c2ffabfbee11487b93dc6c9c4509935e", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c2ffabfbee11487b93dc6c9c4509935e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/c2ffabfbee11487b93dc6c9c4509935e"}]}] Oct 04 22:24:24.513508 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-ServerShowV247Test-1024443248 Oct 04 22:24:24.513508 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: c2ffabfbee11487b93dc6c9c4509935e Oct 04 22:24:24.513508 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-ServerShowV247Test-1024443248 Oct 04 22:24:24.513508 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-ServerShowV247Test-1024443248-project Oct 04 22:24:24.513508 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 22:24:24.513508 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 22:24:24.513508 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 680b9f424ac24ef0b93ff30c9a9d9831 Oct 04 22:24:24.513508 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-ServerShowV247Test-1024443248-project Oct 04 22:24:24.513508 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 22:24:24.513508 n-d-860284-1 devstack@n-api.service[134101]: exception: Instance 3d1e7581-b5c1-4998-a964-8ca90bf36626 could not be found. Oct 04 22:24:24.513508 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': '3d1e7581-b5c1-4998-a964-8ca90bf36626'} Oct 04 22:24:24.513508 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:24:24.513508 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:24:24.513508 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:24:24.513508 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:24:24.513508 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:24:24.513508 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:24:24.513508 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:24:24.513508 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:24:24.513508 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:24:24.513508 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:24:24.513508 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d1e7581-b5c1-4998-a964-8ca90bf36626 could not be found. Oct 04 22:24:24.513508 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:24:24.513508 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:24:24.513508 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:24:24.513508 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:24:24.513508 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:24:24.513508 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:24:24.513508 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:24:24.513508 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:24:24.513508 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:24:24.513508 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:24:24.513508 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:24:24.513508 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:24:24.513508 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:24:24.513508 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:24:24.513508 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:24:24.513508 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:24:24.513508 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d1e7581-b5c1-4998-a964-8ca90bf36626 could not be found. Oct 04 22:24:24.513508 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:24:24.513508 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:24:24.513508 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:24:24.521347 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:24:24.521347 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:24:24.521347 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:24:24.521347 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:24:24.521347 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:24:24.521347 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d1e7581-b5c1-4998-a964-8ca90bf36626 could not be found. Oct 04 22:24:24.521347 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:24:24.521347 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-09d6d9d7-afeb-447f-993e-fd552f89cd13 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Returning 404 to user: Instance 3d1e7581-b5c1-4998-a964-8ca90bf36626 could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:24:24.521347 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-09d6d9d7-afeb-447f-993e-fd552f89cd13 tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] 10.222.0.43 "GET /compute/v2.1/servers/3d1e7581-b5c1-4998-a964-8ca90bf36626" status: 404 len: 111 microversion: 2.47 time: 0.037936 Oct 04 22:24:24.521347 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3337/6287] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:24:24 2022] GET /compute/v2.1/servers/3d1e7581-b5c1-4998-a964-8ca90bf36626 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 22:24:24.526414 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-5807216a-f89e-4d2f-94be-9810aa4b413b tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:24:24.526946 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-5807216a-f89e-4d2f-94be-9810aa4b413b tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] [instance: ecae70db-7b81-49c7-b4ab-16ec6f7ab31a] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:24:24.535139 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5807216a-f89e-4d2f-94be-9810aa4b413b tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:24.535658 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5807216a-f89e-4d2f-94be-9810aa4b413b tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:24.537406 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5807216a-f89e-4d2f-94be-9810aa4b413b tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:24.537406 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5807216a-f89e-4d2f-94be-9810aa4b413b tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:24.537916 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5807216a-f89e-4d2f-94be-9810aa4b413b tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:24.537916 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5807216a-f89e-4d2f-94be-9810aa4b413b tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:24.571348 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-5807216a-f89e-4d2f-94be-9810aa4b413b tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] [instance: ecae70db-7b81-49c7-b4ab-16ec6f7ab31a] Going to try to terminate instance {{(pid=134101) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 22:24:24.666146 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-5807216a-f89e-4d2f-94be-9810aa4b413b tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] 10.222.0.43 "DELETE /compute/v2.1/servers/ecae70db-7b81-49c7-b4ab-16ec6f7ab31a" status: 204 len: 0 microversion: 2.47 time: 0.144073 Oct 04 22:24:24.670107 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3338/6288] 10.222.0.43 () {60 vars in 1280 bytes} [Tue Oct 4 22:24:24 2022] DELETE /compute/v2.1/servers/ecae70db-7b81-49c7-b4ab-16ec6f7ab31a => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 22:24:24.677568 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-5afe810a-48ff-4fd8-b51a-151e6ba6648d tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:24:24.678466 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-5afe810a-48ff-4fd8-b51a-151e6ba6648d tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] [instance: ecae70db-7b81-49c7-b4ab-16ec6f7ab31a] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:24:24.681753 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:24:24.685427 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5afe810a-48ff-4fd8-b51a-151e6ba6648d tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:24.686344 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5afe810a-48ff-4fd8-b51a-151e6ba6648d tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:24.686827 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5afe810a-48ff-4fd8-b51a-151e6ba6648d tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:24.687578 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5afe810a-48ff-4fd8-b51a-151e6ba6648d tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:24.688024 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5afe810a-48ff-4fd8-b51a-151e6ba6648d tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:24.688697 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5afe810a-48ff-4fd8-b51a-151e6ba6648d tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:24.774704 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-5afe810a-48ff-4fd8-b51a-151e6ba6648d tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '680b9f424ac24ef0b93ff30c9a9d9831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ffabfbee11487b93dc6c9c4509935e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:24.784396 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-5afe810a-48ff-4fd8-b51a-151e6ba6648d tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '680b9f424ac24ef0b93ff30c9a9d9831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ffabfbee11487b93dc6c9c4509935e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:24.785875 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-5afe810a-48ff-4fd8-b51a-151e6ba6648d tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '680b9f424ac24ef0b93ff30c9a9d9831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ffabfbee11487b93dc6c9c4509935e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:24.787136 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-5afe810a-48ff-4fd8-b51a-151e6ba6648d tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] 10.222.0.43 "GET /compute/v2.1/servers/ecae70db-7b81-49c7-b4ab-16ec6f7ab31a" status: 200 len: 1363 microversion: 2.47 time: 0.115120 Oct 04 22:24:24.787777 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3339/6289] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:24:24 2022] GET /compute/v2.1/servers/ecae70db-7b81-49c7-b4ab-16ec6f7ab31a => generated 1363 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 22:24:25.289930 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-a64c2095-5f7b-4fae-bef5-4f2b9eb33a55 tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:24:25.290488 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-a64c2095-5f7b-4fae-bef5-4f2b9eb33a55 tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] [instance: 3b0c98dd-e4fa-410c-9dd2-01a61db2ddd9] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:24:25.297446 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a64c2095-5f7b-4fae-bef5-4f2b9eb33a55 tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:25.298169 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a64c2095-5f7b-4fae-bef5-4f2b9eb33a55 tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:25.298815 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a64c2095-5f7b-4fae-bef5-4f2b9eb33a55 tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:25.299706 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a64c2095-5f7b-4fae-bef5-4f2b9eb33a55 tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:25.300191 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a64c2095-5f7b-4fae-bef5-4f2b9eb33a55 tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:25.300638 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a64c2095-5f7b-4fae-bef5-4f2b9eb33a55 tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:25.326777 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-a64c2095-5f7b-4fae-bef5-4f2b9eb33a55 tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] 10.222.0.43 "GET /compute/v2.1/servers/3b0c98dd-e4fa-410c-9dd2-01a61db2ddd9/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.040417 Oct 04 22:24:25.327199 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3340/6290] 10.222.0.43 () {58 vars in 1293 bytes} [Tue Oct 4 22:24:25 2022] GET /compute/v2.1/servers/3b0c98dd-e4fa-410c-9dd2-01a61db2ddd9/os-server-password => generated 116 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:24:25.331920 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-125ef812-a43f-4de5-812c-fd97e01153bc tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:24:25.332922 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-125ef812-a43f-4de5-812c-fd97e01153bc tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] [instance: c598f920-d90a-424a-ae96-8ef237f5d234] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:24:25.339695 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-125ef812-a43f-4de5-812c-fd97e01153bc tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:25.340206 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-125ef812-a43f-4de5-812c-fd97e01153bc tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:25.340710 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-125ef812-a43f-4de5-812c-fd97e01153bc tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:25.343561 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-125ef812-a43f-4de5-812c-fd97e01153bc tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:25.344057 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-125ef812-a43f-4de5-812c-fd97e01153bc tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:25.344541 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-125ef812-a43f-4de5-812c-fd97e01153bc tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:25.370357 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-125ef812-a43f-4de5-812c-fd97e01153bc tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] 10.222.0.43 "GET /compute/v2.1/servers/c598f920-d90a-424a-ae96-8ef237f5d234/ips" status: 200 len: 146 microversion: 2.1 time: 0.041905 Oct 04 22:24:25.371353 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3341/6291] 10.222.0.43 () {58 vars in 1248 bytes} [Tue Oct 4 22:24:25 2022] GET /compute/v2.1/servers/c598f920-d90a-424a-ae96-8ef237f5d234/ips => generated 146 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:24:25.684177 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-77edf909-46c7-42b8-88b1-dac0ac992c5b tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:24:25.684818 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-77edf909-46c7-42b8-88b1-dac0ac992c5b tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: 4d83b3ae-04db-4148-9d64-99458438ec9b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:24:25.697114 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-77edf909-46c7-42b8-88b1-dac0ac992c5b tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:25.698718 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-77edf909-46c7-42b8-88b1-dac0ac992c5b tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:25.699429 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-77edf909-46c7-42b8-88b1-dac0ac992c5b tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:25.700658 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-77edf909-46c7-42b8-88b1-dac0ac992c5b tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:25.701386 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-77edf909-46c7-42b8-88b1-dac0ac992c5b tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:25.702858 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-77edf909-46c7-42b8-88b1-dac0ac992c5b tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:25.721330 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-77edf909-46c7-42b8-88b1-dac0ac992c5b tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] HTTP exception thrown: Instance 4d83b3ae-04db-4148-9d64-99458438ec9b could not be found. Oct 04 22:24:25.724344 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-77edf909-46c7-42b8-88b1-dac0ac992c5b tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Request method failure captured: Oct 04 22:24:25.724344 n-d-860284-1 devstack@n-api.service[134101]: request: DELETE /compute/v2.1/servers/4d83b3ae-04db-4148-9d64-99458438ec9b HTTP/1.1 Oct 04 22:24:25.724344 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 22:24:25.724344 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 22:24:25.724344 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 22:24:25.724344 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 22:24:25.724344 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 22:24:25.724344 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 22:24:25.724344 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 22:24:25.724344 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 22:24:25.724344 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPLFSMo9Eg9y9Lu454XN1MXkt5BE7HeG-NZdibz9nP5ZbzTcA5eo2fVm4gnqUdOUNPfyWilTQor2E780fAI_U9XTD5akzJ8-jVP8Fthos4syj8Pc9nJeMuZjrdlu2EkiFF5ef-9mxCQWUxHOpcRBLI1i5aPH69baR_Z4N2zYKYuhPE2w Oct 04 22:24:25.724344 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 22:24:25.724344 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 22:24:25.724344 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 22:24:25.724344 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 22:24:25.724344 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 22:24:25.724344 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 22:24:25.724344 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: 5c98a72bacce47c3947f9b0f0b4e85b6 Oct 04 22:24:25.724344 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-TestVolumeBootPattern-1701442207 Oct 04 22:24:25.724344 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 22:24:25.724344 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 22:24:25.724344 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5c98a72bacce47c3947f9b0f0b4e85b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_5c98a72bacce47c3947f9b0f0b4e85b6", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5c98a72bacce47c3947f9b0f0b4e85b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/5c98a72bacce47c3947f9b0f0b4e85b6"}]}] Oct 04 22:24:25.724344 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-TestVolumeBootPattern-1701442207 Oct 04 22:24:25.724344 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: 5c98a72bacce47c3947f9b0f0b4e85b6 Oct 04 22:24:25.724344 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-TestVolumeBootPattern-1701442207 Oct 04 22:24:25.724344 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-TestVolumeBootPattern-1701442207-project Oct 04 22:24:25.724344 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 22:24:25.724344 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 22:24:25.724344 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 99acad09db70445b93ae1d64a1b49ca3 Oct 04 22:24:25.724344 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-TestVolumeBootPattern-1701442207-project Oct 04 22:24:25.724344 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 22:24:25.724344 n-d-860284-1 devstack@n-api.service[134101]: exception: Instance 4d83b3ae-04db-4148-9d64-99458438ec9b could not be found. Oct 04 22:24:25.724344 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': '4d83b3ae-04db-4148-9d64-99458438ec9b'} Oct 04 22:24:25.724344 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:24:25.724344 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:24:25.724344 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:24:25.724344 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:24:25.724344 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:24:25.724344 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:24:25.724344 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:24:25.724344 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:24:25.724344 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:24:25.724344 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:24:25.724344 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d83b3ae-04db-4148-9d64-99458438ec9b could not be found. Oct 04 22:24:25.724344 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:24:25.724344 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:24:25.724344 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:24:25.724344 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:24:25.724344 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:24:25.724344 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:24:25.724344 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:24:25.724344 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:24:25.724344 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:24:25.724344 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:24:25.724344 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 22:24:25.724344 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 22:24:25.724344 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 22:24:25.724344 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 22:24:25.724344 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:24:25.724344 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:24:25.724344 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:24:25.724344 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:24:25.729320 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d83b3ae-04db-4148-9d64-99458438ec9b could not be found. Oct 04 22:24:25.729320 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:24:25.729320 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:24:25.729320 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:24:25.729320 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:24:25.729320 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:24:25.729320 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:24:25.729320 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:24:25.729320 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:24:25.729320 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d83b3ae-04db-4148-9d64-99458438ec9b could not be found. Oct 04 22:24:25.729320 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:24:25.738957 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-77edf909-46c7-42b8-88b1-dac0ac992c5b tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Returning 404 to user: Instance 4d83b3ae-04db-4148-9d64-99458438ec9b could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:24:25.740406 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-77edf909-46c7-42b8-88b1-dac0ac992c5b tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "DELETE /compute/v2.1/servers/4d83b3ae-04db-4148-9d64-99458438ec9b" status: 404 len: 111 microversion: 2.1 time: 0.060183 Oct 04 22:24:25.745691 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3342/6292] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 22:24:25 2022] DELETE /compute/v2.1/servers/4d83b3ae-04db-4148-9d64-99458438ec9b => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:24:25.753959 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-40788743-8d5d-4355-91f9-c1debe8468b5 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:24:25.755028 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-40788743-8d5d-4355-91f9-c1debe8468b5 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: 4d83b3ae-04db-4148-9d64-99458438ec9b] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:24:25.765879 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-40788743-8d5d-4355-91f9-c1debe8468b5 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:25.766466 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-40788743-8d5d-4355-91f9-c1debe8468b5 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:25.766939 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-40788743-8d5d-4355-91f9-c1debe8468b5 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:25.767823 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-40788743-8d5d-4355-91f9-c1debe8468b5 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:25.768735 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-40788743-8d5d-4355-91f9-c1debe8468b5 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:25.769000 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-40788743-8d5d-4355-91f9-c1debe8468b5 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:25.786753 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-40788743-8d5d-4355-91f9-c1debe8468b5 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] HTTP exception thrown: Instance 4d83b3ae-04db-4148-9d64-99458438ec9b could not be found. Oct 04 22:24:25.789047 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-40788743-8d5d-4355-91f9-c1debe8468b5 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Request method failure captured: Oct 04 22:24:25.789047 n-d-860284-1 devstack@n-api.service[134101]: request: GET /compute/v2.1/servers/4d83b3ae-04db-4148-9d64-99458438ec9b HTTP/1.1 Oct 04 22:24:25.789047 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 22:24:25.789047 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 22:24:25.789047 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 22:24:25.789047 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 22:24:25.789047 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 22:24:25.789047 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 22:24:25.789047 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 22:24:25.789047 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 22:24:25.789047 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPLFSMo9Eg9y9Lu454XN1MXkt5BE7HeG-NZdibz9nP5ZbzTcA5eo2fVm4gnqUdOUNPfyWilTQor2E780fAI_U9XTD5akzJ8-jVP8Fthos4syj8Pc9nJeMuZjrdlu2EkiFF5ef-9mxCQWUxHOpcRBLI1i5aPH69baR_Z4N2zYKYuhPE2w Oct 04 22:24:25.789047 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 22:24:25.789047 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 22:24:25.789047 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 22:24:25.789047 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 22:24:25.789047 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 22:24:25.789047 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 22:24:25.789047 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: 5c98a72bacce47c3947f9b0f0b4e85b6 Oct 04 22:24:25.789047 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-TestVolumeBootPattern-1701442207 Oct 04 22:24:25.789047 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 22:24:25.789047 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 22:24:25.789047 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5c98a72bacce47c3947f9b0f0b4e85b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_5c98a72bacce47c3947f9b0f0b4e85b6", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5c98a72bacce47c3947f9b0f0b4e85b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/5c98a72bacce47c3947f9b0f0b4e85b6"}]}] Oct 04 22:24:25.789047 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-TestVolumeBootPattern-1701442207 Oct 04 22:24:25.789047 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: 5c98a72bacce47c3947f9b0f0b4e85b6 Oct 04 22:24:25.789047 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-TestVolumeBootPattern-1701442207 Oct 04 22:24:25.789047 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-TestVolumeBootPattern-1701442207-project Oct 04 22:24:25.789047 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 22:24:25.789047 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 22:24:25.789047 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 99acad09db70445b93ae1d64a1b49ca3 Oct 04 22:24:25.789047 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-TestVolumeBootPattern-1701442207-project Oct 04 22:24:25.789047 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 22:24:25.789047 n-d-860284-1 devstack@n-api.service[134101]: exception: Instance 4d83b3ae-04db-4148-9d64-99458438ec9b could not be found. Oct 04 22:24:25.789047 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': '4d83b3ae-04db-4148-9d64-99458438ec9b'} Oct 04 22:24:25.789047 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:24:25.789047 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:24:25.789047 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:24:25.789047 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:24:25.789047 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:24:25.789047 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:24:25.789047 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:24:25.789047 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:24:25.789047 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:24:25.789047 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:24:25.789047 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d83b3ae-04db-4148-9d64-99458438ec9b could not be found. Oct 04 22:24:25.789047 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:24:25.789047 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:24:25.789047 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:24:25.789047 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:24:25.789047 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:24:25.789047 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:24:25.789047 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:24:25.789047 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:24:25.789047 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:24:25.789047 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:24:25.789047 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:24:25.789047 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:24:25.789047 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:24:25.789047 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:24:25.789047 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:24:25.789047 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:24:25.789047 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d83b3ae-04db-4148-9d64-99458438ec9b could not be found. Oct 04 22:24:25.789047 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:24:25.789047 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:24:25.789047 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:24:25.793652 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:24:25.793652 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:24:25.793652 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:24:25.793652 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:24:25.793652 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:24:25.793652 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d83b3ae-04db-4148-9d64-99458438ec9b could not be found. Oct 04 22:24:25.793652 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:24:25.793652 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-40788743-8d5d-4355-91f9-c1debe8468b5 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Returning 404 to user: Instance 4d83b3ae-04db-4148-9d64-99458438ec9b could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:24:25.793652 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-40788743-8d5d-4355-91f9-c1debe8468b5 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/4d83b3ae-04db-4148-9d64-99458438ec9b" status: 404 len: 111 microversion: 2.1 time: 0.042049 Oct 04 22:24:25.793652 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3343/6293] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:24:25 2022] GET /compute/v2.1/servers/4d83b3ae-04db-4148-9d64-99458438ec9b => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:24:25.817648 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-ca91a43c-5c4f-4e7b-9246-8d4d9638943f tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:24:25.817648 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-ca91a43c-5c4f-4e7b-9246-8d4d9638943f tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] [instance: ecae70db-7b81-49c7-b4ab-16ec6f7ab31a] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:24:25.825588 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ca91a43c-5c4f-4e7b-9246-8d4d9638943f tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:25.826095 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ca91a43c-5c4f-4e7b-9246-8d4d9638943f tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:25.826693 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ca91a43c-5c4f-4e7b-9246-8d4d9638943f tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:25.827600 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ca91a43c-5c4f-4e7b-9246-8d4d9638943f tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:25.829529 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ca91a43c-5c4f-4e7b-9246-8d4d9638943f tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:25.829983 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ca91a43c-5c4f-4e7b-9246-8d4d9638943f tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:25.927731 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-ca91a43c-5c4f-4e7b-9246-8d4d9638943f tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '680b9f424ac24ef0b93ff30c9a9d9831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ffabfbee11487b93dc6c9c4509935e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:25.942172 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-ca91a43c-5c4f-4e7b-9246-8d4d9638943f tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '680b9f424ac24ef0b93ff30c9a9d9831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ffabfbee11487b93dc6c9c4509935e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:25.944514 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-ca91a43c-5c4f-4e7b-9246-8d4d9638943f tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '680b9f424ac24ef0b93ff30c9a9d9831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ffabfbee11487b93dc6c9c4509935e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:25.946205 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-ca91a43c-5c4f-4e7b-9246-8d4d9638943f tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] 10.222.0.43 "GET /compute/v2.1/servers/ecae70db-7b81-49c7-b4ab-16ec6f7ab31a" status: 200 len: 1363 microversion: 2.47 time: 0.137038 Oct 04 22:24:25.947300 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3344/6294] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:24:25 2022] GET /compute/v2.1/servers/ecae70db-7b81-49c7-b4ab-16ec6f7ab31a => generated 1363 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 22:24:26.635330 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-a5476156-8d63-472f-862a-72f0a5391f89 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:24:26.637384 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-a5476156-8d63-472f-862a-72f0a5391f89 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: f4acd3e4-bb81-43c5-8636-5259a9331844] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:24:26.650628 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a5476156-8d63-472f-862a-72f0a5391f89 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:26.651657 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a5476156-8d63-472f-862a-72f0a5391f89 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:26.656017 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a5476156-8d63-472f-862a-72f0a5391f89 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:26.662838 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a5476156-8d63-472f-862a-72f0a5391f89 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:26.667408 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a5476156-8d63-472f-862a-72f0a5391f89 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:26.668525 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a5476156-8d63-472f-862a-72f0a5391f89 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:26.689248 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-a5476156-8d63-472f-862a-72f0a5391f89 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] HTTP exception thrown: Instance f4acd3e4-bb81-43c5-8636-5259a9331844 could not be found. Oct 04 22:24:26.691857 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-a5476156-8d63-472f-862a-72f0a5391f89 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Request method failure captured: Oct 04 22:24:26.691857 n-d-860284-1 devstack@n-api.service[134101]: request: DELETE /compute/v2.1/servers/f4acd3e4-bb81-43c5-8636-5259a9331844 HTTP/1.1 Oct 04 22:24:26.691857 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 22:24:26.691857 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 22:24:26.691857 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 22:24:26.691857 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 22:24:26.691857 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 22:24:26.691857 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 22:24:26.691857 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 22:24:26.691857 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 22:24:26.691857 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPLFSMo9Eg9y9Lu454XN1MXkt5BE7HeG-NZdibz9nP5ZbzTcA5eo2fVm4gnqUdOUNPfyWilTQor2E780fAI_U9XTD5akzJ8-jVP8Fthos4syj8Pc9nJeMuZjrdlu2EkiFF5ef-9mxCQWUxHOpcRBLI1i5aPH69baR_Z4N2zYKYuhPE2w Oct 04 22:24:26.691857 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 22:24:26.691857 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 22:24:26.691857 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 22:24:26.691857 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 22:24:26.691857 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 22:24:26.691857 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 22:24:26.691857 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: 5c98a72bacce47c3947f9b0f0b4e85b6 Oct 04 22:24:26.691857 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-TestVolumeBootPattern-1701442207 Oct 04 22:24:26.691857 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 22:24:26.691857 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 22:24:26.691857 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5c98a72bacce47c3947f9b0f0b4e85b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_5c98a72bacce47c3947f9b0f0b4e85b6", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5c98a72bacce47c3947f9b0f0b4e85b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/5c98a72bacce47c3947f9b0f0b4e85b6"}]}] Oct 04 22:24:26.691857 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-TestVolumeBootPattern-1701442207 Oct 04 22:24:26.691857 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: 5c98a72bacce47c3947f9b0f0b4e85b6 Oct 04 22:24:26.691857 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-TestVolumeBootPattern-1701442207 Oct 04 22:24:26.691857 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-TestVolumeBootPattern-1701442207-project Oct 04 22:24:26.691857 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 22:24:26.691857 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 22:24:26.691857 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 99acad09db70445b93ae1d64a1b49ca3 Oct 04 22:24:26.691857 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-TestVolumeBootPattern-1701442207-project Oct 04 22:24:26.691857 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 22:24:26.691857 n-d-860284-1 devstack@n-api.service[134101]: exception: Instance f4acd3e4-bb81-43c5-8636-5259a9331844 could not be found. Oct 04 22:24:26.691857 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': 'f4acd3e4-bb81-43c5-8636-5259a9331844'} Oct 04 22:24:26.691857 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:24:26.691857 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:24:26.691857 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:24:26.691857 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:24:26.691857 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:24:26.691857 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:24:26.691857 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:24:26.691857 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:24:26.691857 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:24:26.691857 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:24:26.691857 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4acd3e4-bb81-43c5-8636-5259a9331844 could not be found. Oct 04 22:24:26.691857 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:24:26.691857 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:24:26.691857 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:24:26.691857 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:24:26.691857 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:24:26.691857 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:24:26.691857 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:24:26.691857 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:24:26.691857 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:24:26.691857 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:24:26.691857 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 22:24:26.691857 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 22:24:26.691857 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 22:24:26.691857 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 22:24:26.691857 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:24:26.691857 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:24:26.691857 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:24:26.691857 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:24:26.696106 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4acd3e4-bb81-43c5-8636-5259a9331844 could not be found. Oct 04 22:24:26.696106 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:24:26.696106 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:24:26.696106 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:24:26.696106 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:24:26.696106 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:24:26.696106 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:24:26.696106 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:24:26.696106 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:24:26.696106 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4acd3e4-bb81-43c5-8636-5259a9331844 could not be found. Oct 04 22:24:26.696106 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:24:26.699075 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-a5476156-8d63-472f-862a-72f0a5391f89 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Returning 404 to user: Instance f4acd3e4-bb81-43c5-8636-5259a9331844 could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:24:26.700359 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-a5476156-8d63-472f-862a-72f0a5391f89 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "DELETE /compute/v2.1/servers/f4acd3e4-bb81-43c5-8636-5259a9331844" status: 404 len: 111 microversion: 2.1 time: 0.069208 Oct 04 22:24:26.705537 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3345/6295] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 22:24:26 2022] DELETE /compute/v2.1/servers/f4acd3e4-bb81-43c5-8636-5259a9331844 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:24:26.711175 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-1b954da9-f947-4964-b292-551a70cead08 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:24:26.712052 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-1b954da9-f947-4964-b292-551a70cead08 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: f4acd3e4-bb81-43c5-8636-5259a9331844] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:24:26.736527 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1b954da9-f947-4964-b292-551a70cead08 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:26.737202 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1b954da9-f947-4964-b292-551a70cead08 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:26.737856 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1b954da9-f947-4964-b292-551a70cead08 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:26.739166 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1b954da9-f947-4964-b292-551a70cead08 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:26.739768 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1b954da9-f947-4964-b292-551a70cead08 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:26.740320 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1b954da9-f947-4964-b292-551a70cead08 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:26.765514 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-1b954da9-f947-4964-b292-551a70cead08 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] HTTP exception thrown: Instance f4acd3e4-bb81-43c5-8636-5259a9331844 could not be found. Oct 04 22:24:26.767102 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-1b954da9-f947-4964-b292-551a70cead08 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Request method failure captured: Oct 04 22:24:26.767102 n-d-860284-1 devstack@n-api.service[134101]: request: GET /compute/v2.1/servers/f4acd3e4-bb81-43c5-8636-5259a9331844 HTTP/1.1 Oct 04 22:24:26.767102 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 22:24:26.767102 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 22:24:26.767102 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 22:24:26.767102 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 22:24:26.767102 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 22:24:26.767102 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 22:24:26.767102 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 22:24:26.767102 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 22:24:26.767102 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPLFSMo9Eg9y9Lu454XN1MXkt5BE7HeG-NZdibz9nP5ZbzTcA5eo2fVm4gnqUdOUNPfyWilTQor2E780fAI_U9XTD5akzJ8-jVP8Fthos4syj8Pc9nJeMuZjrdlu2EkiFF5ef-9mxCQWUxHOpcRBLI1i5aPH69baR_Z4N2zYKYuhPE2w Oct 04 22:24:26.767102 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 22:24:26.767102 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 22:24:26.767102 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 22:24:26.767102 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 22:24:26.767102 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 22:24:26.767102 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 22:24:26.767102 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: 5c98a72bacce47c3947f9b0f0b4e85b6 Oct 04 22:24:26.767102 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-TestVolumeBootPattern-1701442207 Oct 04 22:24:26.767102 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 22:24:26.767102 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 22:24:26.767102 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5c98a72bacce47c3947f9b0f0b4e85b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_5c98a72bacce47c3947f9b0f0b4e85b6", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5c98a72bacce47c3947f9b0f0b4e85b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/5c98a72bacce47c3947f9b0f0b4e85b6"}]}] Oct 04 22:24:26.767102 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-TestVolumeBootPattern-1701442207 Oct 04 22:24:26.767102 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: 5c98a72bacce47c3947f9b0f0b4e85b6 Oct 04 22:24:26.767102 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-TestVolumeBootPattern-1701442207 Oct 04 22:24:26.767102 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-TestVolumeBootPattern-1701442207-project Oct 04 22:24:26.767102 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 22:24:26.767102 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 22:24:26.767102 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 99acad09db70445b93ae1d64a1b49ca3 Oct 04 22:24:26.767102 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-TestVolumeBootPattern-1701442207-project Oct 04 22:24:26.767102 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 22:24:26.767102 n-d-860284-1 devstack@n-api.service[134101]: exception: Instance f4acd3e4-bb81-43c5-8636-5259a9331844 could not be found. Oct 04 22:24:26.767102 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': 'f4acd3e4-bb81-43c5-8636-5259a9331844'} Oct 04 22:24:26.767102 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:24:26.767102 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:24:26.767102 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:24:26.767102 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:24:26.767102 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:24:26.767102 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:24:26.767102 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:24:26.767102 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:24:26.767102 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:24:26.767102 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:24:26.767102 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4acd3e4-bb81-43c5-8636-5259a9331844 could not be found. Oct 04 22:24:26.767102 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:24:26.767102 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:24:26.767102 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:24:26.767102 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:24:26.767102 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:24:26.767102 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:24:26.767102 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:24:26.767102 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:24:26.767102 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:24:26.767102 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:24:26.767102 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:24:26.767102 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:24:26.767102 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:24:26.767102 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:24:26.767102 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:24:26.767102 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:24:26.767102 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4acd3e4-bb81-43c5-8636-5259a9331844 could not be found. Oct 04 22:24:26.767102 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:24:26.767102 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:24:26.767102 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:24:26.772435 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:24:26.772435 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:24:26.772435 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:24:26.772435 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:24:26.772435 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:24:26.772435 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4acd3e4-bb81-43c5-8636-5259a9331844 could not be found. Oct 04 22:24:26.772435 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:24:26.772435 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-1b954da9-f947-4964-b292-551a70cead08 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Returning 404 to user: Instance f4acd3e4-bb81-43c5-8636-5259a9331844 could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:24:26.772435 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-1b954da9-f947-4964-b292-551a70cead08 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/f4acd3e4-bb81-43c5-8636-5259a9331844" status: 404 len: 111 microversion: 2.1 time: 0.061527 Oct 04 22:24:26.772435 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3346/6296] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:24:26 2022] GET /compute/v2.1/servers/f4acd3e4-bb81-43c5-8636-5259a9331844 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:24:26.865910 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-7acd7a0c-24f6-4511-a800-1e8cb5c82385 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Action: 'create', calling method: .version_select at 0x7fbb2db50040>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1068515310", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNT5mTHLb6xZKmbTx01pbo7wThTMH8YDsycuf36FYRnQHKZVSJLo8F4Egl4QvMlr/16rgcdeiFH3le+vMDhkWumQPXn6F82S3jZE7GN6H2NZSPGuRaq3NvLp6pZRBCa/ww=="}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:24:26.882539 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-7acd7a0c-24f6-4511-a800-1e8cb5c82385 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Getting quotas for project 5c98a72bacce47c3947f9b0f0b4e85b6. Resources: {'key_pairs'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:24:26.887968 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-7acd7a0c-24f6-4511-a800-1e8cb5c82385 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Getting quotas for user 99acad09db70445b93ae1d64a1b49ca3 and project 5c98a72bacce47c3947f9b0f0b4e85b6. Resources: {'key_pairs'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:24:26.912763 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-7acd7a0c-24f6-4511-a800-1e8cb5c82385 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.052156 Oct 04 22:24:26.913362 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3347/6297] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Oct 4 22:24:26 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:24:26.973294 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-50e8076d-f5f7-4e10-9604-51e6099f3e7b tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:24:26.973971 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-50e8076d-f5f7-4e10-9604-51e6099f3e7b tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] [instance: ecae70db-7b81-49c7-b4ab-16ec6f7ab31a] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:24:26.980822 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-50e8076d-f5f7-4e10-9604-51e6099f3e7b tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:26.981335 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-50e8076d-f5f7-4e10-9604-51e6099f3e7b tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:26.981796 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-50e8076d-f5f7-4e10-9604-51e6099f3e7b tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:26.982617 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-50e8076d-f5f7-4e10-9604-51e6099f3e7b tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:26.983083 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-50e8076d-f5f7-4e10-9604-51e6099f3e7b tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:26.983535 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-50e8076d-f5f7-4e10-9604-51e6099f3e7b tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:27.023038 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-50e8076d-f5f7-4e10-9604-51e6099f3e7b tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:27.023650 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-50e8076d-f5f7-4e10-9604-51e6099f3e7b tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:27.024166 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-50e8076d-f5f7-4e10-9604-51e6099f3e7b tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:27.024752 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.objects.instance [None req-50e8076d-f5f7-4e10-9604-51e6099f3e7b tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lazy-loading 'fault' on Instance uuid ecae70db-7b81-49c7-b4ab-16ec6f7ab31a {{(pid=134101) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 22:24:27.097862 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-50e8076d-f5f7-4e10-9604-51e6099f3e7b tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '680b9f424ac24ef0b93ff30c9a9d9831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ffabfbee11487b93dc6c9c4509935e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:27.108718 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-50e8076d-f5f7-4e10-9604-51e6099f3e7b tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '680b9f424ac24ef0b93ff30c9a9d9831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ffabfbee11487b93dc6c9c4509935e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:27.110198 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-50e8076d-f5f7-4e10-9604-51e6099f3e7b tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '680b9f424ac24ef0b93ff30c9a9d9831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ffabfbee11487b93dc6c9c4509935e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:27.111716 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-50e8076d-f5f7-4e10-9604-51e6099f3e7b tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] 10.222.0.43 "GET /compute/v2.1/servers/ecae70db-7b81-49c7-b4ab-16ec6f7ab31a" status: 200 len: 1368 microversion: 2.47 time: 0.142928 Oct 04 22:24:27.112592 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3348/6298] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:24:26 2022] GET /compute/v2.1/servers/ecae70db-7b81-49c7-b4ab-16ec6f7ab31a => generated 1368 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:24:27.895486 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-5db2a010-64ee-4aa5-a0c7-a8d3b594caef tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3cabe7e5-4819-4acd-8b7b-88ce13197037"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:24:27.897752 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-5db2a010-64ee-4aa5-a0c7-a8d3b594caef tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] [instance: c598f920-d90a-424a-ae96-8ef237f5d234] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:24:27.905149 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5db2a010-64ee-4aa5-a0c7-a8d3b594caef tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:27.905664 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5db2a010-64ee-4aa5-a0c7-a8d3b594caef tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:27.906159 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5db2a010-64ee-4aa5-a0c7-a8d3b594caef tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:27.906899 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5db2a010-64ee-4aa5-a0c7-a8d3b594caef tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:27.907368 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5db2a010-64ee-4aa5-a0c7-a8d3b594caef tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:27.907813 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5db2a010-64ee-4aa5-a0c7-a8d3b594caef tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:28.210208 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-5db2a010-64ee-4aa5-a0c7-a8d3b594caef tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] 10.222.0.43 "POST /compute/v2.1/servers/c598f920-d90a-424a-ae96-8ef237f5d234/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.319032 Oct 04 22:24:28.211041 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3349/6299] 10.222.0.43 () {60 vars in 1323 bytes} [Tue Oct 4 22:24:27 2022] POST /compute/v2.1/servers/c598f920-d90a-424a-ae96-8ef237f5d234/os-volume_attachments => generated 194 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:24:28.216276 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-6c8478b3-ae1d-4330-92ac-6fefc51082bd tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:24:28.217288 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-6c8478b3-ae1d-4330-92ac-6fefc51082bd tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] [instance: ecae70db-7b81-49c7-b4ab-16ec6f7ab31a] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:24:28.223937 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6c8478b3-ae1d-4330-92ac-6fefc51082bd tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:28.225001 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6c8478b3-ae1d-4330-92ac-6fefc51082bd tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:28.225104 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6c8478b3-ae1d-4330-92ac-6fefc51082bd tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:28.225961 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6c8478b3-ae1d-4330-92ac-6fefc51082bd tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:28.226541 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6c8478b3-ae1d-4330-92ac-6fefc51082bd tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:28.227096 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6c8478b3-ae1d-4330-92ac-6fefc51082bd tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:28.243510 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-6c8478b3-ae1d-4330-92ac-6fefc51082bd tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] HTTP exception thrown: Instance ecae70db-7b81-49c7-b4ab-16ec6f7ab31a could not be found. Oct 04 22:24:28.245600 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-6c8478b3-ae1d-4330-92ac-6fefc51082bd tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Request method failure captured: Oct 04 22:24:28.245600 n-d-860284-1 devstack@n-api.service[134101]: request: GET /compute/v2.1/servers/ecae70db-7b81-49c7-b4ab-16ec6f7ab31a HTTP/1.1 Oct 04 22:24:28.245600 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 22:24:28.245600 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 22:24:28.245600 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 22:24:28.245600 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 22:24:28.245600 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 22:24:28.245600 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 22:24:28.245600 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 22:24:28.245600 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 22:24:28.245600 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPLJh1qIxRRLQR5BqlrVDWH_RTYveWDad6f1gNn6o2BAhx8yhbmv4PZTVCnw7dQucRcN2oWJyvQeseE1r1xmg4mwshg0Ia93CwQ0b9eNijp9TIPZjE7NufSbdxbrdvoKoaEGz678jYaaojOUHH52QIofHYy3ODmpjTLsLZ-zbF5aLe2g Oct 04 22:24:28.245600 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 22:24:28.245600 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 22:24:28.245600 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 22:24:28.245600 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 22:24:28.245600 n-d-860284-1 devstack@n-api.service[134101]: X-Openstack-Nova-Api-Version: 2.47 Oct 04 22:24:28.245600 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 22:24:28.245600 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 22:24:28.245600 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: c2ffabfbee11487b93dc6c9c4509935e Oct 04 22:24:28.245600 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-ServerShowV247Test-1024443248 Oct 04 22:24:28.245600 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 22:24:28.245600 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 22:24:28.245600 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c2ffabfbee11487b93dc6c9c4509935e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_c2ffabfbee11487b93dc6c9c4509935e", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c2ffabfbee11487b93dc6c9c4509935e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/c2ffabfbee11487b93dc6c9c4509935e"}]}] Oct 04 22:24:28.245600 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-ServerShowV247Test-1024443248 Oct 04 22:24:28.245600 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: c2ffabfbee11487b93dc6c9c4509935e Oct 04 22:24:28.245600 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-ServerShowV247Test-1024443248 Oct 04 22:24:28.245600 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-ServerShowV247Test-1024443248-project Oct 04 22:24:28.245600 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 22:24:28.245600 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 22:24:28.245600 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 680b9f424ac24ef0b93ff30c9a9d9831 Oct 04 22:24:28.245600 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-ServerShowV247Test-1024443248-project Oct 04 22:24:28.245600 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 22:24:28.245600 n-d-860284-1 devstack@n-api.service[134101]: exception: Instance ecae70db-7b81-49c7-b4ab-16ec6f7ab31a could not be found. Oct 04 22:24:28.245600 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': 'ecae70db-7b81-49c7-b4ab-16ec6f7ab31a'} Oct 04 22:24:28.245600 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:24:28.245600 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:24:28.245600 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:24:28.245600 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:24:28.245600 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:24:28.245600 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:24:28.245600 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:24:28.245600 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:24:28.245600 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:24:28.245600 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:24:28.245600 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ecae70db-7b81-49c7-b4ab-16ec6f7ab31a could not be found. Oct 04 22:24:28.245600 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:24:28.245600 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:24:28.245600 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:24:28.245600 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:24:28.245600 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:24:28.245600 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:24:28.245600 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:24:28.245600 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:24:28.245600 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:24:28.245600 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:24:28.245600 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:24:28.245600 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:24:28.245600 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:24:28.245600 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:24:28.245600 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:24:28.245600 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:24:28.245600 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ecae70db-7b81-49c7-b4ab-16ec6f7ab31a could not be found. Oct 04 22:24:28.245600 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:24:28.245600 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:24:28.245600 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:24:28.251706 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:24:28.251706 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:24:28.251706 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:24:28.251706 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:24:28.251706 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:24:28.251706 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ecae70db-7b81-49c7-b4ab-16ec6f7ab31a could not be found. Oct 04 22:24:28.251706 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:24:28.253505 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-6c8478b3-ae1d-4330-92ac-6fefc51082bd tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] Returning 404 to user: Instance ecae70db-7b81-49c7-b4ab-16ec6f7ab31a could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:24:28.254646 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-6c8478b3-ae1d-4330-92ac-6fefc51082bd tempest-ServerShowV247Test-1024443248 tempest-ServerShowV247Test-1024443248-project] 10.222.0.43 "GET /compute/v2.1/servers/ecae70db-7b81-49c7-b4ab-16ec6f7ab31a" status: 404 len: 111 microversion: 2.47 time: 0.042421 Oct 04 22:24:28.255461 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3350/6300] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:24:28 2022] GET /compute/v2.1/servers/ecae70db-7b81-49c7-b4ab-16ec6f7ab31a => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 22:24:30.335475 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=2 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:24:30.361806 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-054cc15f-8372-4fbd-a284-3dc75b87b51f tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-1196449922", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452", "networks": "none"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:24:30.428781 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-054cc15f-8372-4fbd-a284-3dc75b87b51f tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Flavor limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 22:24:30.429224 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-054cc15f-8372-4fbd-a284-3dc75b87b51f tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Image limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 22:24:30.429711 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-054cc15f-8372-4fbd-a284-3dc75b87b51f tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Flavor pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 22:24:30.430130 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-054cc15f-8372-4fbd-a284-3dc75b87b51f tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Image pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 22:24:30.431571 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-054cc15f-8372-4fbd-a284-3dc75b87b51f tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 22:24:30.447813 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-054cc15f-8372-4fbd-a284-3dc75b87b51f tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:30.448321 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-054cc15f-8372-4fbd-a284-3dc75b87b51f tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:30.453186 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-054cc15f-8372-4fbd-a284-3dc75b87b51f tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:30.456730 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-054cc15f-8372-4fbd-a284-3dc75b87b51f tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:30.457230 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-054cc15f-8372-4fbd-a284-3dc75b87b51f tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:30.457678 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-054cc15f-8372-4fbd-a284-3dc75b87b51f tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:30.491123 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-054cc15f-8372-4fbd-a284-3dc75b87b51f tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Getting quotas for project 5a7035d5d2f74f649c6184b972b09826. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:24:30.498106 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-054cc15f-8372-4fbd-a284-3dc75b87b51f tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Getting quotas for user 76be0b9e8d2946e3a9b159ef8abbd62e and project 5a7035d5d2f74f649c6184b972b09826. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:24:30.516065 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-054cc15f-8372-4fbd-a284-3dc75b87b51f tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Going to run 1 instances... {{(pid=134101) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 22:24:30.518730 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-054cc15f-8372-4fbd-a284-3dc75b87b51f tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] [instance: 90eda454-aef8-4d18-ad76-010e1fecad39] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='58548514-5dac-426c-81f5-19e3fba33e23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134101) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 22:24:30.587909 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-054cc15f-8372-4fbd-a284-3dc75b87b51f tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 0.378711 Oct 04 22:24:30.591012 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3351/6301] 10.222.0.43 () {62 vars in 1188 bytes} [Tue Oct 4 22:24:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 383 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Oct 04 22:24:30.608255 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-d6671743-179f-4772-b24d-a7e0e543f7a2 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:24:30.609775 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-d6671743-179f-4772-b24d-a7e0e543f7a2 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] [instance: 90eda454-aef8-4d18-ad76-010e1fecad39] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:24:30.713353 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-d6671743-179f-4772-b24d-a7e0e543f7a2 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76be0b9e8d2946e3a9b159ef8abbd62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7035d5d2f74f649c6184b972b09826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:30.724993 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-d6671743-179f-4772-b24d-a7e0e543f7a2 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76be0b9e8d2946e3a9b159ef8abbd62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7035d5d2f74f649c6184b972b09826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:30.728537 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-d6671743-179f-4772-b24d-a7e0e543f7a2 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76be0b9e8d2946e3a9b159ef8abbd62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7035d5d2f74f649c6184b972b09826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:30.734441 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-d6671743-179f-4772-b24d-a7e0e543f7a2 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] 10.222.0.43 "GET /compute/v2.1/servers/90eda454-aef8-4d18-ad76-010e1fecad39" status: 200 len: 1278 microversion: 2.57 time: 0.134912 Oct 04 22:24:30.736616 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3352/6302] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:24:30 2022] GET /compute/v2.1/servers/90eda454-aef8-4d18-ad76-010e1fecad39 => generated 1278 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 22:24:31.762808 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-28e1c322-708e-4d82-8e10-7a17d80316e0 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:24:31.763547 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-28e1c322-708e-4d82-8e10-7a17d80316e0 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] [instance: 90eda454-aef8-4d18-ad76-010e1fecad39] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:24:31.777798 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-28e1c322-708e-4d82-8e10-7a17d80316e0 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:31.778312 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-28e1c322-708e-4d82-8e10-7a17d80316e0 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:31.778795 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-28e1c322-708e-4d82-8e10-7a17d80316e0 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:31.779633 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-28e1c322-708e-4d82-8e10-7a17d80316e0 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:31.780466 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-28e1c322-708e-4d82-8e10-7a17d80316e0 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:31.780923 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-28e1c322-708e-4d82-8e10-7a17d80316e0 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:31.867381 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-28e1c322-708e-4d82-8e10-7a17d80316e0 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76be0b9e8d2946e3a9b159ef8abbd62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7035d5d2f74f649c6184b972b09826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:31.885649 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-28e1c322-708e-4d82-8e10-7a17d80316e0 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76be0b9e8d2946e3a9b159ef8abbd62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7035d5d2f74f649c6184b972b09826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:31.891094 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-28e1c322-708e-4d82-8e10-7a17d80316e0 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76be0b9e8d2946e3a9b159ef8abbd62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7035d5d2f74f649c6184b972b09826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:31.893276 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-28e1c322-708e-4d82-8e10-7a17d80316e0 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] 10.222.0.43 "GET /compute/v2.1/servers/90eda454-aef8-4d18-ad76-010e1fecad39" status: 200 len: 1330 microversion: 2.57 time: 0.134111 Oct 04 22:24:31.894349 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3353/6303] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:24:31 2022] GET /compute/v2.1/servers/90eda454-aef8-4d18-ad76-010e1fecad39 => generated 1330 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 22:24:32.924138 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-c66dd824-310e-4c92-8982-9aa134da32df tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:24:32.924784 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-c66dd824-310e-4c92-8982-9aa134da32df tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] [instance: 90eda454-aef8-4d18-ad76-010e1fecad39] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:24:32.933602 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c66dd824-310e-4c92-8982-9aa134da32df tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:32.934296 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c66dd824-310e-4c92-8982-9aa134da32df tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:32.935049 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c66dd824-310e-4c92-8982-9aa134da32df tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:32.936752 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c66dd824-310e-4c92-8982-9aa134da32df tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:32.937419 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c66dd824-310e-4c92-8982-9aa134da32df tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:32.938066 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c66dd824-310e-4c92-8982-9aa134da32df tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:33.071821 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-c66dd824-310e-4c92-8982-9aa134da32df tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76be0b9e8d2946e3a9b159ef8abbd62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7035d5d2f74f649c6184b972b09826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:33.091146 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-c66dd824-310e-4c92-8982-9aa134da32df tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76be0b9e8d2946e3a9b159ef8abbd62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7035d5d2f74f649c6184b972b09826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:33.115098 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-c66dd824-310e-4c92-8982-9aa134da32df tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76be0b9e8d2946e3a9b159ef8abbd62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7035d5d2f74f649c6184b972b09826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:33.121576 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-c66dd824-310e-4c92-8982-9aa134da32df tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] 10.222.0.43 "GET /compute/v2.1/servers/90eda454-aef8-4d18-ad76-010e1fecad39" status: 200 len: 1336 microversion: 2.57 time: 0.202446 Oct 04 22:24:33.127619 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3354/6304] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:24:32 2022] GET /compute/v2.1/servers/90eda454-aef8-4d18-ad76-010e1fecad39 => generated 1336 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 22:24:34.153150 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-11f0c97a-2a86-48a4-b5e6-343a223a97c9 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:24:34.156089 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-11f0c97a-2a86-48a4-b5e6-343a223a97c9 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] [instance: 90eda454-aef8-4d18-ad76-010e1fecad39] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:24:34.165285 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-11f0c97a-2a86-48a4-b5e6-343a223a97c9 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:34.167118 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-11f0c97a-2a86-48a4-b5e6-343a223a97c9 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:34.168061 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-11f0c97a-2a86-48a4-b5e6-343a223a97c9 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:34.170079 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-11f0c97a-2a86-48a4-b5e6-343a223a97c9 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:34.170905 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-11f0c97a-2a86-48a4-b5e6-343a223a97c9 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:34.171778 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-11f0c97a-2a86-48a4-b5e6-343a223a97c9 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:34.193198 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:24:34.266097 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-11f0c97a-2a86-48a4-b5e6-343a223a97c9 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76be0b9e8d2946e3a9b159ef8abbd62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7035d5d2f74f649c6184b972b09826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:34.284839 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-11f0c97a-2a86-48a4-b5e6-343a223a97c9 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76be0b9e8d2946e3a9b159ef8abbd62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7035d5d2f74f649c6184b972b09826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:34.287143 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-11f0c97a-2a86-48a4-b5e6-343a223a97c9 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76be0b9e8d2946e3a9b159ef8abbd62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7035d5d2f74f649c6184b972b09826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:34.288990 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-11f0c97a-2a86-48a4-b5e6-343a223a97c9 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] 10.222.0.43 "GET /compute/v2.1/servers/90eda454-aef8-4d18-ad76-010e1fecad39" status: 200 len: 1336 microversion: 2.57 time: 0.140172 Oct 04 22:24:34.290327 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3355/6305] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:24:34 2022] GET /compute/v2.1/servers/90eda454-aef8-4d18-ad76-010e1fecad39 => generated 1336 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 22:24:35.316806 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-4016ce14-6865-4b18-8d05-6d3f07ebcd39 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:24:35.318150 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-4016ce14-6865-4b18-8d05-6d3f07ebcd39 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] [instance: 90eda454-aef8-4d18-ad76-010e1fecad39] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:24:35.331252 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4016ce14-6865-4b18-8d05-6d3f07ebcd39 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:35.334575 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4016ce14-6865-4b18-8d05-6d3f07ebcd39 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:35.335291 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4016ce14-6865-4b18-8d05-6d3f07ebcd39 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:35.336218 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4016ce14-6865-4b18-8d05-6d3f07ebcd39 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:35.337332 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4016ce14-6865-4b18-8d05-6d3f07ebcd39 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:35.338913 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4016ce14-6865-4b18-8d05-6d3f07ebcd39 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:35.425741 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-4016ce14-6865-4b18-8d05-6d3f07ebcd39 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76be0b9e8d2946e3a9b159ef8abbd62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7035d5d2f74f649c6184b972b09826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:35.435815 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-4016ce14-6865-4b18-8d05-6d3f07ebcd39 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76be0b9e8d2946e3a9b159ef8abbd62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7035d5d2f74f649c6184b972b09826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:35.437836 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-4016ce14-6865-4b18-8d05-6d3f07ebcd39 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76be0b9e8d2946e3a9b159ef8abbd62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7035d5d2f74f649c6184b972b09826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:35.439520 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-4016ce14-6865-4b18-8d05-6d3f07ebcd39 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] 10.222.0.43 "GET /compute/v2.1/servers/90eda454-aef8-4d18-ad76-010e1fecad39" status: 200 len: 1336 microversion: 2.57 time: 0.127129 Oct 04 22:24:35.440672 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3356/6306] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:24:35 2022] GET /compute/v2.1/servers/90eda454-aef8-4d18-ad76-010e1fecad39 => generated 1336 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:24:36.469679 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-6e715533-500e-48db-a30c-572d0d777e5f tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:24:36.470756 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-6e715533-500e-48db-a30c-572d0d777e5f tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] [instance: 90eda454-aef8-4d18-ad76-010e1fecad39] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:24:36.478959 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6e715533-500e-48db-a30c-572d0d777e5f tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:36.479472 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6e715533-500e-48db-a30c-572d0d777e5f tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:36.479938 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6e715533-500e-48db-a30c-572d0d777e5f tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:36.480669 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6e715533-500e-48db-a30c-572d0d777e5f tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:36.484273 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6e715533-500e-48db-a30c-572d0d777e5f tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:36.486325 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6e715533-500e-48db-a30c-572d0d777e5f tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:36.588531 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-6e715533-500e-48db-a30c-572d0d777e5f tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76be0b9e8d2946e3a9b159ef8abbd62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7035d5d2f74f649c6184b972b09826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:36.606166 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-6e715533-500e-48db-a30c-572d0d777e5f tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76be0b9e8d2946e3a9b159ef8abbd62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7035d5d2f74f649c6184b972b09826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:36.609940 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-6e715533-500e-48db-a30c-572d0d777e5f tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76be0b9e8d2946e3a9b159ef8abbd62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7035d5d2f74f649c6184b972b09826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:36.611514 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-6e715533-500e-48db-a30c-572d0d777e5f tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] 10.222.0.43 "GET /compute/v2.1/servers/90eda454-aef8-4d18-ad76-010e1fecad39" status: 200 len: 1357 microversion: 2.57 time: 0.146079 Oct 04 22:24:36.612336 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3357/6307] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:24:36 2022] GET /compute/v2.1/servers/90eda454-aef8-4d18-ad76-010e1fecad39 => generated 1357 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:24:36.645490 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-4e119777-f46b-4e29-b971-8f07e2ff7f63 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:24:36.649778 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-4e119777-f46b-4e29-b971-8f07e2ff7f63 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] [instance: 90eda454-aef8-4d18-ad76-010e1fecad39] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:24:36.667236 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4e119777-f46b-4e29-b971-8f07e2ff7f63 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:36.668121 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4e119777-f46b-4e29-b971-8f07e2ff7f63 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:36.670234 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4e119777-f46b-4e29-b971-8f07e2ff7f63 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:36.671795 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4e119777-f46b-4e29-b971-8f07e2ff7f63 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:36.673231 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4e119777-f46b-4e29-b971-8f07e2ff7f63 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:36.674881 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4e119777-f46b-4e29-b971-8f07e2ff7f63 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:36.802860 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-4e119777-f46b-4e29-b971-8f07e2ff7f63 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Flavor limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 22:24:36.803221 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-4e119777-f46b-4e29-b971-8f07e2ff7f63 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Image limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 22:24:36.804034 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-4e119777-f46b-4e29-b971-8f07e2ff7f63 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Flavor pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 22:24:36.804662 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-4e119777-f46b-4e29-b971-8f07e2ff7f63 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Image pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 22:24:36.805266 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-4e119777-f46b-4e29-b971-8f07e2ff7f63 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 22:24:36.924865 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-4e119777-f46b-4e29-b971-8f07e2ff7f63 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] [instance: 90eda454-aef8-4d18-ad76-010e1fecad39] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:24:36.936590 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4e119777-f46b-4e29-b971-8f07e2ff7f63 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:36.942830 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4e119777-f46b-4e29-b971-8f07e2ff7f63 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:36.943517 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4e119777-f46b-4e29-b971-8f07e2ff7f63 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:36.945316 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4e119777-f46b-4e29-b971-8f07e2ff7f63 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:36.946496 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4e119777-f46b-4e29-b971-8f07e2ff7f63 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:36.947469 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4e119777-f46b-4e29-b971-8f07e2ff7f63 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:36.991734 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-4e119777-f46b-4e29-b971-8f07e2ff7f63 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] 10.222.0.43 "POST /compute/v2.1/servers/90eda454-aef8-4d18-ad76-010e1fecad39/action" status: 202 len: 1138 microversion: 2.57 time: 0.352984 Oct 04 22:24:37.007320 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3358/6308] 10.222.0.43 () {62 vars in 1320 bytes} [Tue Oct 4 22:24:36 2022] POST /compute/v2.1/servers/90eda454-aef8-4d18-ad76-010e1fecad39/action => generated 1138 bytes in 370 msecs (HTTP/1.1 202) 10 headers in 454 bytes (2 switches on core 0) Oct 04 22:24:37.016898 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-48e3f0f9-3e29-4941-bd8c-ab9ca6e4c6c2 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:24:37.017733 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-48e3f0f9-3e29-4941-bd8c-ab9ca6e4c6c2 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] [instance: 90eda454-aef8-4d18-ad76-010e1fecad39] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:24:37.025243 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-48e3f0f9-3e29-4941-bd8c-ab9ca6e4c6c2 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:37.025770 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-48e3f0f9-3e29-4941-bd8c-ab9ca6e4c6c2 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:37.026556 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-48e3f0f9-3e29-4941-bd8c-ab9ca6e4c6c2 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:37.027422 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-48e3f0f9-3e29-4941-bd8c-ab9ca6e4c6c2 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:37.027914 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-48e3f0f9-3e29-4941-bd8c-ab9ca6e4c6c2 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:37.028369 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-48e3f0f9-3e29-4941-bd8c-ab9ca6e4c6c2 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:37.163618 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-48e3f0f9-3e29-4941-bd8c-ab9ca6e4c6c2 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76be0b9e8d2946e3a9b159ef8abbd62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7035d5d2f74f649c6184b972b09826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:37.177312 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-48e3f0f9-3e29-4941-bd8c-ab9ca6e4c6c2 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76be0b9e8d2946e3a9b159ef8abbd62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7035d5d2f74f649c6184b972b09826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:37.179758 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-48e3f0f9-3e29-4941-bd8c-ab9ca6e4c6c2 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76be0b9e8d2946e3a9b159ef8abbd62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7035d5d2f74f649c6184b972b09826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:37.181050 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-48e3f0f9-3e29-4941-bd8c-ab9ca6e4c6c2 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] 10.222.0.43 "GET /compute/v2.1/servers/90eda454-aef8-4d18-ad76-010e1fecad39" status: 200 len: 1366 microversion: 2.57 time: 0.169265 Oct 04 22:24:37.181769 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3359/6309] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:24:37 2022] GET /compute/v2.1/servers/90eda454-aef8-4d18-ad76-010e1fecad39 => generated 1366 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 22:24:38.211012 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-ad6aeea8-2d96-402a-bc83-505f16c6c18d tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:24:38.212559 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-ad6aeea8-2d96-402a-bc83-505f16c6c18d tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] [instance: 90eda454-aef8-4d18-ad76-010e1fecad39] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:24:38.220473 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ad6aeea8-2d96-402a-bc83-505f16c6c18d tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:38.222106 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ad6aeea8-2d96-402a-bc83-505f16c6c18d tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:38.222810 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ad6aeea8-2d96-402a-bc83-505f16c6c18d tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:38.223927 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ad6aeea8-2d96-402a-bc83-505f16c6c18d tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:38.224977 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ad6aeea8-2d96-402a-bc83-505f16c6c18d tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:38.225864 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ad6aeea8-2d96-402a-bc83-505f16c6c18d tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:38.328317 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-ad6aeea8-2d96-402a-bc83-505f16c6c18d tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76be0b9e8d2946e3a9b159ef8abbd62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7035d5d2f74f649c6184b972b09826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:38.339873 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-ad6aeea8-2d96-402a-bc83-505f16c6c18d tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76be0b9e8d2946e3a9b159ef8abbd62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7035d5d2f74f649c6184b972b09826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:38.342947 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-ad6aeea8-2d96-402a-bc83-505f16c6c18d tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76be0b9e8d2946e3a9b159ef8abbd62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7035d5d2f74f649c6184b972b09826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:38.344987 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-ad6aeea8-2d96-402a-bc83-505f16c6c18d tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] 10.222.0.43 "GET /compute/v2.1/servers/90eda454-aef8-4d18-ad76-010e1fecad39" status: 200 len: 1366 microversion: 2.57 time: 0.139800 Oct 04 22:24:38.346826 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3360/6310] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:24:38 2022] GET /compute/v2.1/servers/90eda454-aef8-4d18-ad76-010e1fecad39 => generated 1366 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:24:39.375616 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-5f591a5d-fb9e-4d09-a901-59b0478398b4 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:24:39.376864 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-5f591a5d-fb9e-4d09-a901-59b0478398b4 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] [instance: 90eda454-aef8-4d18-ad76-010e1fecad39] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:24:39.385834 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5f591a5d-fb9e-4d09-a901-59b0478398b4 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:39.386352 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5f591a5d-fb9e-4d09-a901-59b0478398b4 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:39.386836 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5f591a5d-fb9e-4d09-a901-59b0478398b4 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:39.387560 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5f591a5d-fb9e-4d09-a901-59b0478398b4 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:39.388648 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5f591a5d-fb9e-4d09-a901-59b0478398b4 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:39.391093 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5f591a5d-fb9e-4d09-a901-59b0478398b4 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:39.488823 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-5f591a5d-fb9e-4d09-a901-59b0478398b4 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76be0b9e8d2946e3a9b159ef8abbd62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7035d5d2f74f649c6184b972b09826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:39.504486 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-5f591a5d-fb9e-4d09-a901-59b0478398b4 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76be0b9e8d2946e3a9b159ef8abbd62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7035d5d2f74f649c6184b972b09826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:39.507787 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-5f591a5d-fb9e-4d09-a901-59b0478398b4 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76be0b9e8d2946e3a9b159ef8abbd62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7035d5d2f74f649c6184b972b09826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:39.509239 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-5f591a5d-fb9e-4d09-a901-59b0478398b4 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] 10.222.0.43 "GET /compute/v2.1/servers/90eda454-aef8-4d18-ad76-010e1fecad39" status: 200 len: 1366 microversion: 2.57 time: 0.139077 Oct 04 22:24:39.510648 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3361/6311] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:24:39 2022] GET /compute/v2.1/servers/90eda454-aef8-4d18-ad76-010e1fecad39 => generated 1366 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 22:24:40.414385 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-525a8a85-4a13-4f3f-9a63-aea77b1501f6 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:24:40.417346 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-525a8a85-4a13-4f3f-9a63-aea77b1501f6 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] [instance: c598f920-d90a-424a-ae96-8ef237f5d234] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:24:40.425174 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-525a8a85-4a13-4f3f-9a63-aea77b1501f6 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:40.426007 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-525a8a85-4a13-4f3f-9a63-aea77b1501f6 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:40.426728 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-525a8a85-4a13-4f3f-9a63-aea77b1501f6 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:40.427695 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-525a8a85-4a13-4f3f-9a63-aea77b1501f6 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:40.428376 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-525a8a85-4a13-4f3f-9a63-aea77b1501f6 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:40.429030 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-525a8a85-4a13-4f3f-9a63-aea77b1501f6 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:40.476497 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-525a8a85-4a13-4f3f-9a63-aea77b1501f6 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] 10.222.0.43 "GET /compute/v2.1/servers/c598f920-d90a-424a-ae96-8ef237f5d234/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066857 Oct 04 22:24:40.483482 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3362/6312] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 22:24:40 2022] GET /compute/v2.1/servers/c598f920-d90a-424a-ae96-8ef237f5d234/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:24:40.490819 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-22537aa1-7041-4cae-b129-3a599059f1ef tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:24:40.491343 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-22537aa1-7041-4cae-b129-3a599059f1ef tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] [instance: c598f920-d90a-424a-ae96-8ef237f5d234] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:24:40.497717 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=2 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:24:40.500198 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-22537aa1-7041-4cae-b129-3a599059f1ef tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:40.500715 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-22537aa1-7041-4cae-b129-3a599059f1ef tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:40.501274 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-22537aa1-7041-4cae-b129-3a599059f1ef tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:40.502728 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-22537aa1-7041-4cae-b129-3a599059f1ef tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:40.503843 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-22537aa1-7041-4cae-b129-3a599059f1ef tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:40.504487 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-22537aa1-7041-4cae-b129-3a599059f1ef tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:40.547235 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-22537aa1-7041-4cae-b129-3a599059f1ef tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] 10.222.0.43 "GET /compute/v2.1/servers/c598f920-d90a-424a-ae96-8ef237f5d234/os-volume_attachments/3cabe7e5-4819-4acd-8b7b-88ce13197037" status: 200 len: 194 microversion: 2.1 time: 0.061990 Oct 04 22:24:40.548142 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3363/6313] 10.222.0.43 () {58 vars in 1413 bytes} [Tue Oct 4 22:24:40 2022] GET /compute/v2.1/servers/c598f920-d90a-424a-ae96-8ef237f5d234/os-volume_attachments/3cabe7e5-4819-4acd-8b7b-88ce13197037 => generated 194 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:24:40.557249 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-2e9c6f75-9094-47ea-bba5-0d6a3e63d557 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:24:40.558864 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-2e9c6f75-9094-47ea-bba5-0d6a3e63d557 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] [instance: 90eda454-aef8-4d18-ad76-010e1fecad39] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:24:40.565263 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2e9c6f75-9094-47ea-bba5-0d6a3e63d557 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:40.565801 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2e9c6f75-9094-47ea-bba5-0d6a3e63d557 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:40.566235 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2e9c6f75-9094-47ea-bba5-0d6a3e63d557 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:40.566983 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2e9c6f75-9094-47ea-bba5-0d6a3e63d557 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:40.567926 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2e9c6f75-9094-47ea-bba5-0d6a3e63d557 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:40.568384 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2e9c6f75-9094-47ea-bba5-0d6a3e63d557 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:40.680357 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-2e9c6f75-9094-47ea-bba5-0d6a3e63d557 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76be0b9e8d2946e3a9b159ef8abbd62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7035d5d2f74f649c6184b972b09826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:40.689893 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-2e9c6f75-9094-47ea-bba5-0d6a3e63d557 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76be0b9e8d2946e3a9b159ef8abbd62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7035d5d2f74f649c6184b972b09826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:40.691310 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-2e9c6f75-9094-47ea-bba5-0d6a3e63d557 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76be0b9e8d2946e3a9b159ef8abbd62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7035d5d2f74f649c6184b972b09826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:40.692790 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-2e9c6f75-9094-47ea-bba5-0d6a3e63d557 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] 10.222.0.43 "GET /compute/v2.1/servers/90eda454-aef8-4d18-ad76-010e1fecad39" status: 200 len: 1366 microversion: 2.57 time: 0.143335 Oct 04 22:24:40.693361 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3364/6314] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:24:40 2022] GET /compute/v2.1/servers/90eda454-aef8-4d18-ad76-010e1fecad39 => generated 1366 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:24:41.724909 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-854e0e5e-be68-4131-b462-c93d594a5aa4 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:24:41.726401 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-854e0e5e-be68-4131-b462-c93d594a5aa4 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] [instance: 90eda454-aef8-4d18-ad76-010e1fecad39] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:24:41.734103 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=14 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:24:41.739129 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-854e0e5e-be68-4131-b462-c93d594a5aa4 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:41.742889 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-854e0e5e-be68-4131-b462-c93d594a5aa4 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:41.743613 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-854e0e5e-be68-4131-b462-c93d594a5aa4 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:41.746497 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-854e0e5e-be68-4131-b462-c93d594a5aa4 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:41.747342 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-854e0e5e-be68-4131-b462-c93d594a5aa4 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:41.757793 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-854e0e5e-be68-4131-b462-c93d594a5aa4 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:41.901219 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-854e0e5e-be68-4131-b462-c93d594a5aa4 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76be0b9e8d2946e3a9b159ef8abbd62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7035d5d2f74f649c6184b972b09826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:41.915716 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-854e0e5e-be68-4131-b462-c93d594a5aa4 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76be0b9e8d2946e3a9b159ef8abbd62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7035d5d2f74f649c6184b972b09826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:41.920050 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-854e0e5e-be68-4131-b462-c93d594a5aa4 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76be0b9e8d2946e3a9b159ef8abbd62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7035d5d2f74f649c6184b972b09826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:41.921630 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-854e0e5e-be68-4131-b462-c93d594a5aa4 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] 10.222.0.43 "GET /compute/v2.1/servers/90eda454-aef8-4d18-ad76-010e1fecad39" status: 200 len: 1366 microversion: 2.57 time: 0.202410 Oct 04 22:24:41.922818 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3365/6315] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:24:41 2022] GET /compute/v2.1/servers/90eda454-aef8-4d18-ad76-010e1fecad39 => generated 1366 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 22:24:42.205884 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-1e1184b7-dca4-4551-9b20-4916a59b8f1e tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0610d928-6a7d-484c-9557-3654c2d1d9d6"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:24:42.209340 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-1e1184b7-dca4-4551-9b20-4916a59b8f1e tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] [instance: c598f920-d90a-424a-ae96-8ef237f5d234] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:24:42.217556 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1e1184b7-dca4-4551-9b20-4916a59b8f1e tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:42.219764 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1e1184b7-dca4-4551-9b20-4916a59b8f1e tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:42.220381 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1e1184b7-dca4-4551-9b20-4916a59b8f1e tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:42.221527 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1e1184b7-dca4-4551-9b20-4916a59b8f1e tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:42.222352 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1e1184b7-dca4-4551-9b20-4916a59b8f1e tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:42.222910 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1e1184b7-dca4-4551-9b20-4916a59b8f1e tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:42.574023 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-1e1184b7-dca4-4551-9b20-4916a59b8f1e tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] 10.222.0.43 "POST /compute/v2.1/servers/c598f920-d90a-424a-ae96-8ef237f5d234/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.374027 Oct 04 22:24:42.575327 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3366/6316] 10.222.0.43 () {60 vars in 1323 bytes} [Tue Oct 4 22:24:42 2022] POST /compute/v2.1/servers/c598f920-d90a-424a-ae96-8ef237f5d234/os-volume_attachments => generated 194 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:24:42.957789 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-84136225-28df-462a-bb95-9fc21835f612 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:24:42.959077 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-84136225-28df-462a-bb95-9fc21835f612 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] [instance: 90eda454-aef8-4d18-ad76-010e1fecad39] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:24:42.976451 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-84136225-28df-462a-bb95-9fc21835f612 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:42.976850 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-84136225-28df-462a-bb95-9fc21835f612 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:42.978069 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-84136225-28df-462a-bb95-9fc21835f612 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:42.979703 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-84136225-28df-462a-bb95-9fc21835f612 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:42.980197 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-84136225-28df-462a-bb95-9fc21835f612 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:42.980649 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-84136225-28df-462a-bb95-9fc21835f612 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:43.117131 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-84136225-28df-462a-bb95-9fc21835f612 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76be0b9e8d2946e3a9b159ef8abbd62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7035d5d2f74f649c6184b972b09826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:43.145216 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-84136225-28df-462a-bb95-9fc21835f612 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76be0b9e8d2946e3a9b159ef8abbd62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7035d5d2f74f649c6184b972b09826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:43.152530 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-84136225-28df-462a-bb95-9fc21835f612 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76be0b9e8d2946e3a9b159ef8abbd62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7035d5d2f74f649c6184b972b09826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:43.155777 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-84136225-28df-462a-bb95-9fc21835f612 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] 10.222.0.43 "GET /compute/v2.1/servers/90eda454-aef8-4d18-ad76-010e1fecad39" status: 200 len: 1366 microversion: 2.57 time: 0.209798 Oct 04 22:24:43.157679 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3367/6317] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:24:42 2022] GET /compute/v2.1/servers/90eda454-aef8-4d18-ad76-010e1fecad39 => generated 1366 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:24:44.190184 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-0a3be174-f2a6-4f31-be8e-b6f28658acd2 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:24:44.191832 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-0a3be174-f2a6-4f31-be8e-b6f28658acd2 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] [instance: 90eda454-aef8-4d18-ad76-010e1fecad39] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:24:44.199411 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0a3be174-f2a6-4f31-be8e-b6f28658acd2 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:44.200053 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0a3be174-f2a6-4f31-be8e-b6f28658acd2 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:44.200807 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0a3be174-f2a6-4f31-be8e-b6f28658acd2 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:44.201971 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0a3be174-f2a6-4f31-be8e-b6f28658acd2 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:44.202602 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0a3be174-f2a6-4f31-be8e-b6f28658acd2 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:44.203120 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0a3be174-f2a6-4f31-be8e-b6f28658acd2 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:44.292292 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-0a3be174-f2a6-4f31-be8e-b6f28658acd2 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76be0b9e8d2946e3a9b159ef8abbd62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7035d5d2f74f649c6184b972b09826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:44.295505 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:24:44.304174 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-0a3be174-f2a6-4f31-be8e-b6f28658acd2 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76be0b9e8d2946e3a9b159ef8abbd62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7035d5d2f74f649c6184b972b09826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:44.306022 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-0a3be174-f2a6-4f31-be8e-b6f28658acd2 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76be0b9e8d2946e3a9b159ef8abbd62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7035d5d2f74f649c6184b972b09826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:44.307519 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-0a3be174-f2a6-4f31-be8e-b6f28658acd2 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] 10.222.0.43 "GET /compute/v2.1/servers/90eda454-aef8-4d18-ad76-010e1fecad39" status: 200 len: 1366 microversion: 2.57 time: 0.122209 Oct 04 22:24:44.324117 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3368/6318] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:24:44 2022] GET /compute/v2.1/servers/90eda454-aef8-4d18-ad76-010e1fecad39 => generated 1366 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:24:45.338538 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-419d51bf-9207-4691-99e8-cbc1f1763e0b tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:24:45.339208 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-419d51bf-9207-4691-99e8-cbc1f1763e0b tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] [instance: 90eda454-aef8-4d18-ad76-010e1fecad39] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:24:45.350979 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-419d51bf-9207-4691-99e8-cbc1f1763e0b tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:45.351573 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-419d51bf-9207-4691-99e8-cbc1f1763e0b tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:45.352225 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-419d51bf-9207-4691-99e8-cbc1f1763e0b tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:45.353015 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-419d51bf-9207-4691-99e8-cbc1f1763e0b tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:45.353559 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-419d51bf-9207-4691-99e8-cbc1f1763e0b tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:45.354073 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-419d51bf-9207-4691-99e8-cbc1f1763e0b tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:45.425060 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-419d51bf-9207-4691-99e8-cbc1f1763e0b tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76be0b9e8d2946e3a9b159ef8abbd62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7035d5d2f74f649c6184b972b09826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:45.434729 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-419d51bf-9207-4691-99e8-cbc1f1763e0b tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76be0b9e8d2946e3a9b159ef8abbd62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7035d5d2f74f649c6184b972b09826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:45.436293 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-419d51bf-9207-4691-99e8-cbc1f1763e0b tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76be0b9e8d2946e3a9b159ef8abbd62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7035d5d2f74f649c6184b972b09826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:45.437705 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-419d51bf-9207-4691-99e8-cbc1f1763e0b tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] 10.222.0.43 "GET /compute/v2.1/servers/90eda454-aef8-4d18-ad76-010e1fecad39" status: 200 len: 1366 microversion: 2.57 time: 0.103692 Oct 04 22:24:45.438921 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3369/6319] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:24:45 2022] GET /compute/v2.1/servers/90eda454-aef8-4d18-ad76-010e1fecad39 => generated 1366 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 22:24:46.466846 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-0aa81f1a-980c-47e3-b876-de683dec1a6e tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:24:46.467703 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-0aa81f1a-980c-47e3-b876-de683dec1a6e tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] [instance: 90eda454-aef8-4d18-ad76-010e1fecad39] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:24:46.475816 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0aa81f1a-980c-47e3-b876-de683dec1a6e tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:46.476564 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0aa81f1a-980c-47e3-b876-de683dec1a6e tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:46.477122 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0aa81f1a-980c-47e3-b876-de683dec1a6e tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:46.478019 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0aa81f1a-980c-47e3-b876-de683dec1a6e tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:46.478635 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0aa81f1a-980c-47e3-b876-de683dec1a6e tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:46.479187 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0aa81f1a-980c-47e3-b876-de683dec1a6e tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:46.550662 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-0aa81f1a-980c-47e3-b876-de683dec1a6e tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76be0b9e8d2946e3a9b159ef8abbd62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7035d5d2f74f649c6184b972b09826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:46.560563 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-0aa81f1a-980c-47e3-b876-de683dec1a6e tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76be0b9e8d2946e3a9b159ef8abbd62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7035d5d2f74f649c6184b972b09826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:46.562200 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-0aa81f1a-980c-47e3-b876-de683dec1a6e tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76be0b9e8d2946e3a9b159ef8abbd62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7035d5d2f74f649c6184b972b09826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:46.563532 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-0aa81f1a-980c-47e3-b876-de683dec1a6e tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] 10.222.0.43 "GET /compute/v2.1/servers/90eda454-aef8-4d18-ad76-010e1fecad39" status: 200 len: 1366 microversion: 2.57 time: 0.101355 Oct 04 22:24:46.564188 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3370/6320] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:24:46 2022] GET /compute/v2.1/servers/90eda454-aef8-4d18-ad76-010e1fecad39 => generated 1366 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:24:47.589222 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-9394efd1-600c-4176-8144-307157c63d51 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:24:47.590258 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-9394efd1-600c-4176-8144-307157c63d51 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] [instance: 90eda454-aef8-4d18-ad76-010e1fecad39] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:24:47.597573 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9394efd1-600c-4176-8144-307157c63d51 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:47.598198 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9394efd1-600c-4176-8144-307157c63d51 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:47.598783 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9394efd1-600c-4176-8144-307157c63d51 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:47.599652 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9394efd1-600c-4176-8144-307157c63d51 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:47.600247 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9394efd1-600c-4176-8144-307157c63d51 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:47.600793 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9394efd1-600c-4176-8144-307157c63d51 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:47.666885 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-9394efd1-600c-4176-8144-307157c63d51 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76be0b9e8d2946e3a9b159ef8abbd62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7035d5d2f74f649c6184b972b09826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:47.677969 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-9394efd1-600c-4176-8144-307157c63d51 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76be0b9e8d2946e3a9b159ef8abbd62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7035d5d2f74f649c6184b972b09826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:47.679642 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-9394efd1-600c-4176-8144-307157c63d51 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76be0b9e8d2946e3a9b159ef8abbd62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7035d5d2f74f649c6184b972b09826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:47.680968 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-9394efd1-600c-4176-8144-307157c63d51 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] 10.222.0.43 "GET /compute/v2.1/servers/90eda454-aef8-4d18-ad76-010e1fecad39" status: 200 len: 1366 microversion: 2.57 time: 0.095758 Oct 04 22:24:47.681643 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3371/6321] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:24:47 2022] GET /compute/v2.1/servers/90eda454-aef8-4d18-ad76-010e1fecad39 => generated 1366 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 22:24:48.707442 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-05432b5f-f2db-45f7-b6b8-7834c2423c41 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:24:48.708902 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-05432b5f-f2db-45f7-b6b8-7834c2423c41 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] [instance: 90eda454-aef8-4d18-ad76-010e1fecad39] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:24:48.716078 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-05432b5f-f2db-45f7-b6b8-7834c2423c41 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:48.716593 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-05432b5f-f2db-45f7-b6b8-7834c2423c41 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:48.717283 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-05432b5f-f2db-45f7-b6b8-7834c2423c41 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:48.718392 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-05432b5f-f2db-45f7-b6b8-7834c2423c41 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:48.719194 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-05432b5f-f2db-45f7-b6b8-7834c2423c41 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:48.719845 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-05432b5f-f2db-45f7-b6b8-7834c2423c41 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:48.812057 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-05432b5f-f2db-45f7-b6b8-7834c2423c41 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76be0b9e8d2946e3a9b159ef8abbd62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7035d5d2f74f649c6184b972b09826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:48.824892 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-05432b5f-f2db-45f7-b6b8-7834c2423c41 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76be0b9e8d2946e3a9b159ef8abbd62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7035d5d2f74f649c6184b972b09826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:48.827114 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-05432b5f-f2db-45f7-b6b8-7834c2423c41 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76be0b9e8d2946e3a9b159ef8abbd62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7035d5d2f74f649c6184b972b09826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:48.829028 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-05432b5f-f2db-45f7-b6b8-7834c2423c41 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] 10.222.0.43 "GET /compute/v2.1/servers/90eda454-aef8-4d18-ad76-010e1fecad39" status: 200 len: 1366 microversion: 2.57 time: 0.125273 Oct 04 22:24:48.830244 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3372/6322] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:24:48 2022] GET /compute/v2.1/servers/90eda454-aef8-4d18-ad76-010e1fecad39 => generated 1366 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:24:49.856711 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-914d1e08-5392-486b-9bab-a0b13842728a tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:24:49.857399 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-914d1e08-5392-486b-9bab-a0b13842728a tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] [instance: 90eda454-aef8-4d18-ad76-010e1fecad39] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:24:49.861335 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:24:49.865231 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-914d1e08-5392-486b-9bab-a0b13842728a tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:49.865736 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-914d1e08-5392-486b-9bab-a0b13842728a tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:49.866189 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-914d1e08-5392-486b-9bab-a0b13842728a tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:49.866942 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-914d1e08-5392-486b-9bab-a0b13842728a tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:49.867413 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-914d1e08-5392-486b-9bab-a0b13842728a tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:49.867857 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-914d1e08-5392-486b-9bab-a0b13842728a tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:49.935483 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-914d1e08-5392-486b-9bab-a0b13842728a tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76be0b9e8d2946e3a9b159ef8abbd62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7035d5d2f74f649c6184b972b09826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:49.943796 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-914d1e08-5392-486b-9bab-a0b13842728a tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76be0b9e8d2946e3a9b159ef8abbd62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7035d5d2f74f649c6184b972b09826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:49.945259 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-914d1e08-5392-486b-9bab-a0b13842728a tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76be0b9e8d2946e3a9b159ef8abbd62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7035d5d2f74f649c6184b972b09826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:49.946469 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-914d1e08-5392-486b-9bab-a0b13842728a tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] 10.222.0.43 "GET /compute/v2.1/servers/90eda454-aef8-4d18-ad76-010e1fecad39" status: 200 len: 1366 microversion: 2.57 time: 0.094444 Oct 04 22:24:49.947039 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3373/6323] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:24:49 2022] GET /compute/v2.1/servers/90eda454-aef8-4d18-ad76-010e1fecad39 => generated 1366 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 22:24:50.377093 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-6f772b90-6155-4665-a3f9-58f49f1ab41d tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1701013973", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1068515310", "security_groups": [{"name": "tempest-secgroup-smoke-1414317642"}], "block_device_mapping_v2": [{"uuid": "f601803f-c4f0-4557-a383-3eaaf7b30006", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f55a0794-d215-4510-84cc-a7b063c083a4"}]}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:24:50.491580 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.network.neutron [None req-6f772b90-6155-4665-a3f9-58f49f1ab41d tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] validate_networks() for [('f55a0794-d215-4510-84cc-a7b063c083a4', None, None, None, None, None)] {{(pid=134101) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 22:24:50.864680 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-6f772b90-6155-4665-a3f9-58f49f1ab41d tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Flavor limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 22:24:50.865785 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-6f772b90-6155-4665-a3f9-58f49f1ab41d tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Image limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 22:24:50.866352 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-6f772b90-6155-4665-a3f9-58f49f1ab41d tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Flavor pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 22:24:50.866806 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-6f772b90-6155-4665-a3f9-58f49f1ab41d tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Image pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 22:24:50.867238 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-6f772b90-6155-4665-a3f9-58f49f1ab41d tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 22:24:50.877560 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6f772b90-6155-4665-a3f9-58f49f1ab41d tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:50.878454 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6f772b90-6155-4665-a3f9-58f49f1ab41d tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:50.878913 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6f772b90-6155-4665-a3f9-58f49f1ab41d tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:50.879661 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6f772b90-6155-4665-a3f9-58f49f1ab41d tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:50.880390 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6f772b90-6155-4665-a3f9-58f49f1ab41d tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:50.880841 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6f772b90-6155-4665-a3f9-58f49f1ab41d tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:50.899272 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-6f772b90-6155-4665-a3f9-58f49f1ab41d tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Getting quotas for project 5c98a72bacce47c3947f9b0f0b4e85b6. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:24:50.905125 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-6f772b90-6155-4665-a3f9-58f49f1ab41d tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Getting quotas for user 99acad09db70445b93ae1d64a1b49ca3 and project 5c98a72bacce47c3947f9b0f0b4e85b6. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:24:50.963918 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-6f772b90-6155-4665-a3f9-58f49f1ab41d tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Going to run 1 instances... {{(pid=134101) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 22:24:50.966100 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-6f772b90-6155-4665-a3f9-58f49f1ab41d tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: 47aa758b-a866-4254-b7ff-47ed2bd1c87f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f601803f-c4f0-4557-a383-3eaaf7b30006',volume_size=None,volume_type=None)] {{(pid=134101) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 22:24:51.092798 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-6f772b90-6155-4665-a3f9-58f49f1ab41d tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.719815 Oct 04 22:24:51.093449 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3374/6324] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 22:24:50 2022] POST /compute/v2.1/servers => generated 406 bytes in 722 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 22:24:51.101807 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e474ef0d-c955-4695-b184-9986f3c23561 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:24:51.102484 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-e474ef0d-c955-4695-b184-9986f3c23561 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] [instance: 90eda454-aef8-4d18-ad76-010e1fecad39] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:24:51.114277 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e474ef0d-c955-4695-b184-9986f3c23561 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:51.114844 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e474ef0d-c955-4695-b184-9986f3c23561 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:51.115313 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e474ef0d-c955-4695-b184-9986f3c23561 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:51.116084 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e474ef0d-c955-4695-b184-9986f3c23561 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:51.116569 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e474ef0d-c955-4695-b184-9986f3c23561 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:51.117025 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e474ef0d-c955-4695-b184-9986f3c23561 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:51.185060 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-e474ef0d-c955-4695-b184-9986f3c23561 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76be0b9e8d2946e3a9b159ef8abbd62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7035d5d2f74f649c6184b972b09826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:51.193725 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-e474ef0d-c955-4695-b184-9986f3c23561 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76be0b9e8d2946e3a9b159ef8abbd62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7035d5d2f74f649c6184b972b09826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:51.195199 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-e474ef0d-c955-4695-b184-9986f3c23561 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76be0b9e8d2946e3a9b159ef8abbd62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7035d5d2f74f649c6184b972b09826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:51.196399 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-e474ef0d-c955-4695-b184-9986f3c23561 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] 10.222.0.43 "GET /compute/v2.1/servers/90eda454-aef8-4d18-ad76-010e1fecad39" status: 200 len: 1366 microversion: 2.57 time: 0.098629 Oct 04 22:24:51.196970 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3375/6325] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:24:51 2022] GET /compute/v2.1/servers/90eda454-aef8-4d18-ad76-010e1fecad39 => generated 1366 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:24:51.202151 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-ef14ab20-680a-4a3d-a022-2a5f9fc6196c tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:24:51.202919 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-ef14ab20-680a-4a3d-a022-2a5f9fc6196c tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: 47aa758b-a866-4254-b7ff-47ed2bd1c87f] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:24:51.259704 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-ef14ab20-680a-4a3d-a022-2a5f9fc6196c tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:51.267295 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-ef14ab20-680a-4a3d-a022-2a5f9fc6196c tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/47aa758b-a866-4254-b7ff-47ed2bd1c87f" status: 200 len: 1095 microversion: 2.1 time: 0.069335 Oct 04 22:24:51.268072 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3376/6326] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:24:51 2022] GET /compute/v2.1/servers/47aa758b-a866-4254-b7ff-47ed2bd1c87f => generated 1095 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:24:52.222729 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-c51ab128-1df9-48c6-a393-712f2b47f075 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:24:52.223373 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-c51ab128-1df9-48c6-a393-712f2b47f075 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] [instance: 90eda454-aef8-4d18-ad76-010e1fecad39] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:24:52.231423 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c51ab128-1df9-48c6-a393-712f2b47f075 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:52.232046 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c51ab128-1df9-48c6-a393-712f2b47f075 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:52.232508 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c51ab128-1df9-48c6-a393-712f2b47f075 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:52.233241 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c51ab128-1df9-48c6-a393-712f2b47f075 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:52.233719 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c51ab128-1df9-48c6-a393-712f2b47f075 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:52.234171 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c51ab128-1df9-48c6-a393-712f2b47f075 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:52.348388 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-c51ab128-1df9-48c6-a393-712f2b47f075 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76be0b9e8d2946e3a9b159ef8abbd62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7035d5d2f74f649c6184b972b09826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:52.358754 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-c51ab128-1df9-48c6-a393-712f2b47f075 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76be0b9e8d2946e3a9b159ef8abbd62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7035d5d2f74f649c6184b972b09826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:52.360421 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-c51ab128-1df9-48c6-a393-712f2b47f075 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76be0b9e8d2946e3a9b159ef8abbd62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7035d5d2f74f649c6184b972b09826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:52.361877 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-c51ab128-1df9-48c6-a393-712f2b47f075 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] 10.222.0.43 "GET /compute/v2.1/servers/90eda454-aef8-4d18-ad76-010e1fecad39" status: 200 len: 1366 microversion: 2.57 time: 0.143190 Oct 04 22:24:52.362660 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3377/6327] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:24:52 2022] GET /compute/v2.1/servers/90eda454-aef8-4d18-ad76-010e1fecad39 => generated 1366 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 22:24:52.367877 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-bfe28a59-417c-4f0e-9a40-71b667c4c794 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:24:52.368775 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-bfe28a59-417c-4f0e-9a40-71b667c4c794 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: 47aa758b-a866-4254-b7ff-47ed2bd1c87f] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:24:52.376646 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bfe28a59-417c-4f0e-9a40-71b667c4c794 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:52.377777 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bfe28a59-417c-4f0e-9a40-71b667c4c794 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:52.378509 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bfe28a59-417c-4f0e-9a40-71b667c4c794 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:52.379476 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bfe28a59-417c-4f0e-9a40-71b667c4c794 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:52.380226 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bfe28a59-417c-4f0e-9a40-71b667c4c794 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:52.380925 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bfe28a59-417c-4f0e-9a40-71b667c4c794 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:52.465965 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-bfe28a59-417c-4f0e-9a40-71b667c4c794 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:52.474943 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-bfe28a59-417c-4f0e-9a40-71b667c4c794 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/47aa758b-a866-4254-b7ff-47ed2bd1c87f" status: 200 len: 1211 microversion: 2.1 time: 0.110725 Oct 04 22:24:52.490791 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3378/6328] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:24:52 2022] GET /compute/v2.1/servers/47aa758b-a866-4254-b7ff-47ed2bd1c87f => generated 1211 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:24:53.390894 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-c242ebb6-6808-4374-958d-a63922990a25 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:24:53.391759 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-c242ebb6-6808-4374-958d-a63922990a25 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] [instance: 90eda454-aef8-4d18-ad76-010e1fecad39] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:24:53.399671 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c242ebb6-6808-4374-958d-a63922990a25 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:53.400195 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c242ebb6-6808-4374-958d-a63922990a25 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:53.400659 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c242ebb6-6808-4374-958d-a63922990a25 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:53.401394 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c242ebb6-6808-4374-958d-a63922990a25 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:53.402061 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c242ebb6-6808-4374-958d-a63922990a25 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:53.402554 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c242ebb6-6808-4374-958d-a63922990a25 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:53.482005 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-c242ebb6-6808-4374-958d-a63922990a25 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76be0b9e8d2946e3a9b159ef8abbd62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7035d5d2f74f649c6184b972b09826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:53.491115 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-c242ebb6-6808-4374-958d-a63922990a25 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76be0b9e8d2946e3a9b159ef8abbd62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7035d5d2f74f649c6184b972b09826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:53.493072 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-c242ebb6-6808-4374-958d-a63922990a25 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76be0b9e8d2946e3a9b159ef8abbd62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7035d5d2f74f649c6184b972b09826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:53.494278 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-c242ebb6-6808-4374-958d-a63922990a25 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] 10.222.0.43 "GET /compute/v2.1/servers/90eda454-aef8-4d18-ad76-010e1fecad39" status: 200 len: 1366 microversion: 2.57 time: 0.109263 Oct 04 22:24:53.495083 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3379/6329] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:24:53 2022] GET /compute/v2.1/servers/90eda454-aef8-4d18-ad76-010e1fecad39 => generated 1366 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:24:53.516551 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-8c82b972-2f1f-4d9b-9600-0b33af079776 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:24:53.517197 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-8c82b972-2f1f-4d9b-9600-0b33af079776 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: 47aa758b-a866-4254-b7ff-47ed2bd1c87f] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:24:53.523619 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8c82b972-2f1f-4d9b-9600-0b33af079776 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:53.524212 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8c82b972-2f1f-4d9b-9600-0b33af079776 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:53.524863 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8c82b972-2f1f-4d9b-9600-0b33af079776 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:53.525758 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8c82b972-2f1f-4d9b-9600-0b33af079776 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:53.526426 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8c82b972-2f1f-4d9b-9600-0b33af079776 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:53.527041 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8c82b972-2f1f-4d9b-9600-0b33af079776 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:53.784736 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-8c82b972-2f1f-4d9b-9600-0b33af079776 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:53.796554 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-8c82b972-2f1f-4d9b-9600-0b33af079776 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/47aa758b-a866-4254-b7ff-47ed2bd1c87f" status: 200 len: 1279 microversion: 2.1 time: 0.292039 Oct 04 22:24:53.797592 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3380/6330] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:24:53 2022] GET /compute/v2.1/servers/47aa758b-a866-4254-b7ff-47ed2bd1c87f => generated 1279 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:24:54.016143 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-595c6567-e409-47df-ad53-33b830871d2f req-f94483dc-2e35-4bd9-a2a8-d2b3895ecdba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47aa758b-a866-4254-b7ff-47ed2bd1c87f", "tag": "8957a848-6a5f-4266-81c3-301fb772023a"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:24:54.035615 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-595c6567-e409-47df-ad53-33b830871d2f req-f94483dc-2e35-4bd9-a2a8-d2b3895ecdba service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:54.039950 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-595c6567-e409-47df-ad53-33b830871d2f req-f94483dc-2e35-4bd9-a2a8-d2b3895ecdba service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:54.040892 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-595c6567-e409-47df-ad53-33b830871d2f req-f94483dc-2e35-4bd9-a2a8-d2b3895ecdba service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:54.054620 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-595c6567-e409-47df-ad53-33b830871d2f req-f94483dc-2e35-4bd9-a2a8-d2b3895ecdba service nova] Creating event network-changed:8957a848-6a5f-4266-81c3-301fb772023a for instance 47aa758b-a866-4254-b7ff-47ed2bd1c87f on n-h1-860284-1 Oct 04 22:24:54.062098 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-595c6567-e409-47df-ad53-33b830871d2f req-f94483dc-2e35-4bd9-a2a8-d2b3895ecdba service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052514 Oct 04 22:24:54.063418 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3381/6331] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:24:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:24:54.524736 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-c6758eed-1af9-4bfb-ae30-156e5264e2a3 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:24:54.525488 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-c6758eed-1af9-4bfb-ae30-156e5264e2a3 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] [instance: 90eda454-aef8-4d18-ad76-010e1fecad39] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:24:54.533859 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c6758eed-1af9-4bfb-ae30-156e5264e2a3 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:54.534400 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c6758eed-1af9-4bfb-ae30-156e5264e2a3 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:54.534886 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c6758eed-1af9-4bfb-ae30-156e5264e2a3 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:54.535634 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c6758eed-1af9-4bfb-ae30-156e5264e2a3 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:54.536136 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c6758eed-1af9-4bfb-ae30-156e5264e2a3 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:54.536570 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c6758eed-1af9-4bfb-ae30-156e5264e2a3 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:54.622406 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-c6758eed-1af9-4bfb-ae30-156e5264e2a3 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76be0b9e8d2946e3a9b159ef8abbd62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7035d5d2f74f649c6184b972b09826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:54.634158 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-c6758eed-1af9-4bfb-ae30-156e5264e2a3 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76be0b9e8d2946e3a9b159ef8abbd62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7035d5d2f74f649c6184b972b09826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:54.635945 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-c6758eed-1af9-4bfb-ae30-156e5264e2a3 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76be0b9e8d2946e3a9b159ef8abbd62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7035d5d2f74f649c6184b972b09826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:54.638618 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-c6758eed-1af9-4bfb-ae30-156e5264e2a3 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] 10.222.0.43 "GET /compute/v2.1/servers/90eda454-aef8-4d18-ad76-010e1fecad39" status: 200 len: 1366 microversion: 2.57 time: 0.120376 Oct 04 22:24:54.654358 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3382/6332] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:24:54 2022] GET /compute/v2.1/servers/90eda454-aef8-4d18-ad76-010e1fecad39 => generated 1366 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 22:24:54.728065 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-637e502b-6b9f-47c5-8337-f8613aa2f425 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:24:54.730509 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-637e502b-6b9f-47c5-8337-f8613aa2f425 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] [instance: c598f920-d90a-424a-ae96-8ef237f5d234] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:24:54.737548 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-637e502b-6b9f-47c5-8337-f8613aa2f425 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:54.738229 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-637e502b-6b9f-47c5-8337-f8613aa2f425 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:54.738986 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-637e502b-6b9f-47c5-8337-f8613aa2f425 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:54.739838 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-637e502b-6b9f-47c5-8337-f8613aa2f425 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:54.740422 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-637e502b-6b9f-47c5-8337-f8613aa2f425 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:54.740976 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-637e502b-6b9f-47c5-8337-f8613aa2f425 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:54.776093 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-637e502b-6b9f-47c5-8337-f8613aa2f425 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] 10.222.0.43 "GET /compute/v2.1/servers/c598f920-d90a-424a-ae96-8ef237f5d234/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.052196 Oct 04 22:24:54.782842 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3383/6333] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 22:24:54 2022] GET /compute/v2.1/servers/c598f920-d90a-424a-ae96-8ef237f5d234/os-volume_attachments => generated 371 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:24:54.820504 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-c477c6db-3af8-402c-ab92-43ec71e327fe tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:24:54.821121 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-c477c6db-3af8-402c-ab92-43ec71e327fe tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: 47aa758b-a866-4254-b7ff-47ed2bd1c87f] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:24:54.827967 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c477c6db-3af8-402c-ab92-43ec71e327fe tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:54.828664 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c477c6db-3af8-402c-ab92-43ec71e327fe tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:54.829299 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c477c6db-3af8-402c-ab92-43ec71e327fe tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:54.830193 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c477c6db-3af8-402c-ab92-43ec71e327fe tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:54.830693 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c477c6db-3af8-402c-ab92-43ec71e327fe tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:54.831141 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c477c6db-3af8-402c-ab92-43ec71e327fe tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:55.056244 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-c477c6db-3af8-402c-ab92-43ec71e327fe tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:55.064887 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-c477c6db-3af8-402c-ab92-43ec71e327fe tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/47aa758b-a866-4254-b7ff-47ed2bd1c87f" status: 200 len: 1279 microversion: 2.1 time: 0.248358 Oct 04 22:24:55.065561 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3384/6334] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:24:54 2022] GET /compute/v2.1/servers/47aa758b-a866-4254-b7ff-47ed2bd1c87f => generated 1279 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:24:55.070503 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-5db7c07f-235a-487a-a848-c56d83acc5a1 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:24:55.071093 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-5db7c07f-235a-487a-a848-c56d83acc5a1 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] [instance: c598f920-d90a-424a-ae96-8ef237f5d234] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:24:55.076954 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5db7c07f-235a-487a-a848-c56d83acc5a1 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:55.077700 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5db7c07f-235a-487a-a848-c56d83acc5a1 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:55.078390 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5db7c07f-235a-487a-a848-c56d83acc5a1 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:55.079316 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5db7c07f-235a-487a-a848-c56d83acc5a1 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:55.080022 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5db7c07f-235a-487a-a848-c56d83acc5a1 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:55.080533 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5db7c07f-235a-487a-a848-c56d83acc5a1 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:55.111542 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-5db7c07f-235a-487a-a848-c56d83acc5a1 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] 10.222.0.43 "GET /compute/v2.1/servers/c598f920-d90a-424a-ae96-8ef237f5d234/os-volume_attachments/3cabe7e5-4819-4acd-8b7b-88ce13197037" status: 200 len: 194 microversion: 2.1 time: 0.044679 Oct 04 22:24:55.112444 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3385/6335] 10.222.0.43 () {58 vars in 1413 bytes} [Tue Oct 4 22:24:55 2022] GET /compute/v2.1/servers/c598f920-d90a-424a-ae96-8ef237f5d234/os-volume_attachments/3cabe7e5-4819-4acd-8b7b-88ce13197037 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:24:55.124168 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-99d93c0e-3537-4220-b13d-254401108f94 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:24:55.124683 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-99d93c0e-3537-4220-b13d-254401108f94 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] [instance: c598f920-d90a-424a-ae96-8ef237f5d234] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:24:55.130897 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-99d93c0e-3537-4220-b13d-254401108f94 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:55.131397 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-99d93c0e-3537-4220-b13d-254401108f94 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:55.131849 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-99d93c0e-3537-4220-b13d-254401108f94 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:55.132564 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-99d93c0e-3537-4220-b13d-254401108f94 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:55.133030 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-99d93c0e-3537-4220-b13d-254401108f94 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:55.133470 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-99d93c0e-3537-4220-b13d-254401108f94 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:55.219035 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.objects.instance [None req-99d93c0e-3537-4220-b13d-254401108f94 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lazy-loading 'services' on Instance uuid c598f920-d90a-424a-ae96-8ef237f5d234 {{(pid=134101) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 22:24:55.292927 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-99d93c0e-3537-4220-b13d-254401108f94 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] 10.222.0.43 "DELETE /compute/v2.1/servers/c598f920-d90a-424a-ae96-8ef237f5d234/os-volume_attachments/3cabe7e5-4819-4acd-8b7b-88ce13197037" status: 202 len: 0 microversion: 2.1 time: 0.173759 Oct 04 22:24:55.294115 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3386/6336] 10.222.0.43 () {58 vars in 1416 bytes} [Tue Oct 4 22:24:55 2022] DELETE /compute/v2.1/servers/c598f920-d90a-424a-ae96-8ef237f5d234/os-volume_attachments/3cabe7e5-4819-4acd-8b7b-88ce13197037 => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 22:24:55.666778 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-50fed7ff-b318-4f00-9b25-584f4285d5dc tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:24:55.667497 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-50fed7ff-b318-4f00-9b25-584f4285d5dc tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] [instance: 90eda454-aef8-4d18-ad76-010e1fecad39] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:24:55.674911 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-50fed7ff-b318-4f00-9b25-584f4285d5dc tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:55.675472 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-50fed7ff-b318-4f00-9b25-584f4285d5dc tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:55.676060 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-50fed7ff-b318-4f00-9b25-584f4285d5dc tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:55.676769 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-50fed7ff-b318-4f00-9b25-584f4285d5dc tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:55.677235 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-50fed7ff-b318-4f00-9b25-584f4285d5dc tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:55.677674 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-50fed7ff-b318-4f00-9b25-584f4285d5dc tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:55.680500 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:24:55.747636 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-50fed7ff-b318-4f00-9b25-584f4285d5dc tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76be0b9e8d2946e3a9b159ef8abbd62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7035d5d2f74f649c6184b972b09826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:55.756216 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-50fed7ff-b318-4f00-9b25-584f4285d5dc tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76be0b9e8d2946e3a9b159ef8abbd62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7035d5d2f74f649c6184b972b09826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:55.757596 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-50fed7ff-b318-4f00-9b25-584f4285d5dc tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76be0b9e8d2946e3a9b159ef8abbd62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7035d5d2f74f649c6184b972b09826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:55.758809 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-50fed7ff-b318-4f00-9b25-584f4285d5dc tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] 10.222.0.43 "GET /compute/v2.1/servers/90eda454-aef8-4d18-ad76-010e1fecad39" status: 200 len: 1366 microversion: 2.57 time: 0.097363 Oct 04 22:24:55.768132 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3387/6337] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:24:55 2022] GET /compute/v2.1/servers/90eda454-aef8-4d18-ad76-010e1fecad39 => generated 1366 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 22:24:56.088976 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-8aba2b94-4ae0-44fe-afa4-3a2d25206d81 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:24:56.089607 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-8aba2b94-4ae0-44fe-afa4-3a2d25206d81 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: 47aa758b-a866-4254-b7ff-47ed2bd1c87f] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:24:56.096219 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8aba2b94-4ae0-44fe-afa4-3a2d25206d81 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:56.096725 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8aba2b94-4ae0-44fe-afa4-3a2d25206d81 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:56.097210 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8aba2b94-4ae0-44fe-afa4-3a2d25206d81 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:56.097919 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8aba2b94-4ae0-44fe-afa4-3a2d25206d81 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:56.098417 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8aba2b94-4ae0-44fe-afa4-3a2d25206d81 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:56.098864 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8aba2b94-4ae0-44fe-afa4-3a2d25206d81 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:56.237935 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-8aba2b94-4ae0-44fe-afa4-3a2d25206d81 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:56.246985 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-8aba2b94-4ae0-44fe-afa4-3a2d25206d81 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/47aa758b-a866-4254-b7ff-47ed2bd1c87f" status: 200 len: 1279 microversion: 2.1 time: 0.161283 Oct 04 22:24:56.247749 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3388/6338] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:24:56 2022] GET /compute/v2.1/servers/47aa758b-a866-4254-b7ff-47ed2bd1c87f => generated 1279 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:24:56.785281 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-b8fd202b-9823-4946-86be-fa2c1d640844 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:24:56.785954 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-b8fd202b-9823-4946-86be-fa2c1d640844 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] [instance: 90eda454-aef8-4d18-ad76-010e1fecad39] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:24:56.793064 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b8fd202b-9823-4946-86be-fa2c1d640844 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:56.793510 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b8fd202b-9823-4946-86be-fa2c1d640844 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:56.793968 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b8fd202b-9823-4946-86be-fa2c1d640844 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:56.794718 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b8fd202b-9823-4946-86be-fa2c1d640844 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:56.795194 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b8fd202b-9823-4946-86be-fa2c1d640844 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:56.795642 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b8fd202b-9823-4946-86be-fa2c1d640844 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:56.865343 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-b8fd202b-9823-4946-86be-fa2c1d640844 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76be0b9e8d2946e3a9b159ef8abbd62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7035d5d2f74f649c6184b972b09826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:56.874764 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-b8fd202b-9823-4946-86be-fa2c1d640844 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76be0b9e8d2946e3a9b159ef8abbd62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7035d5d2f74f649c6184b972b09826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:56.876301 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-b8fd202b-9823-4946-86be-fa2c1d640844 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76be0b9e8d2946e3a9b159ef8abbd62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7035d5d2f74f649c6184b972b09826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:56.877500 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-b8fd202b-9823-4946-86be-fa2c1d640844 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] 10.222.0.43 "GET /compute/v2.1/servers/90eda454-aef8-4d18-ad76-010e1fecad39" status: 200 len: 1366 microversion: 2.57 time: 0.096571 Oct 04 22:24:56.878070 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3389/6339] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:24:56 2022] GET /compute/v2.1/servers/90eda454-aef8-4d18-ad76-010e1fecad39 => generated 1366 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 22:24:57.271934 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-4a106935-98cf-4dce-8b86-5b3712ccc142 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:24:57.272574 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-4a106935-98cf-4dce-8b86-5b3712ccc142 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: 47aa758b-a866-4254-b7ff-47ed2bd1c87f] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:24:57.279231 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4a106935-98cf-4dce-8b86-5b3712ccc142 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:57.279834 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4a106935-98cf-4dce-8b86-5b3712ccc142 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:57.280469 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4a106935-98cf-4dce-8b86-5b3712ccc142 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:57.281483 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4a106935-98cf-4dce-8b86-5b3712ccc142 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:57.282408 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4a106935-98cf-4dce-8b86-5b3712ccc142 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:57.283023 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4a106935-98cf-4dce-8b86-5b3712ccc142 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:57.421650 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-4a106935-98cf-4dce-8b86-5b3712ccc142 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:57.429987 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-4a106935-98cf-4dce-8b86-5b3712ccc142 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/47aa758b-a866-4254-b7ff-47ed2bd1c87f" status: 200 len: 1279 microversion: 2.1 time: 0.161840 Oct 04 22:24:57.430623 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3390/6340] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:24:57 2022] GET /compute/v2.1/servers/47aa758b-a866-4254-b7ff-47ed2bd1c87f => generated 1279 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:24:57.904059 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-01725e1d-9752-4e5f-a66b-f9ebd9b05b80 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:24:57.904698 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-01725e1d-9752-4e5f-a66b-f9ebd9b05b80 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] [instance: 90eda454-aef8-4d18-ad76-010e1fecad39] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:24:57.911904 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-01725e1d-9752-4e5f-a66b-f9ebd9b05b80 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:57.912411 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-01725e1d-9752-4e5f-a66b-f9ebd9b05b80 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:57.912872 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-01725e1d-9752-4e5f-a66b-f9ebd9b05b80 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:57.913593 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-01725e1d-9752-4e5f-a66b-f9ebd9b05b80 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:57.914077 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-01725e1d-9752-4e5f-a66b-f9ebd9b05b80 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:57.914557 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-01725e1d-9752-4e5f-a66b-f9ebd9b05b80 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:57.979869 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-01725e1d-9752-4e5f-a66b-f9ebd9b05b80 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76be0b9e8d2946e3a9b159ef8abbd62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7035d5d2f74f649c6184b972b09826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:57.988343 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-01725e1d-9752-4e5f-a66b-f9ebd9b05b80 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76be0b9e8d2946e3a9b159ef8abbd62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7035d5d2f74f649c6184b972b09826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:57.989800 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-01725e1d-9752-4e5f-a66b-f9ebd9b05b80 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76be0b9e8d2946e3a9b159ef8abbd62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7035d5d2f74f649c6184b972b09826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:57.991022 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-01725e1d-9752-4e5f-a66b-f9ebd9b05b80 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] 10.222.0.43 "GET /compute/v2.1/servers/90eda454-aef8-4d18-ad76-010e1fecad39" status: 200 len: 1366 microversion: 2.57 time: 0.091593 Oct 04 22:24:57.991587 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3391/6341] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:24:57 2022] GET /compute/v2.1/servers/90eda454-aef8-4d18-ad76-010e1fecad39 => generated 1366 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 22:24:58.455430 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-63e59ce1-2d48-42a4-a773-46a86473a060 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:24:58.455975 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-63e59ce1-2d48-42a4-a773-46a86473a060 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: 47aa758b-a866-4254-b7ff-47ed2bd1c87f] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:24:58.462065 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-63e59ce1-2d48-42a4-a773-46a86473a060 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:58.462615 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-63e59ce1-2d48-42a4-a773-46a86473a060 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:58.463068 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-63e59ce1-2d48-42a4-a773-46a86473a060 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:58.463774 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-63e59ce1-2d48-42a4-a773-46a86473a060 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:58.464243 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-63e59ce1-2d48-42a4-a773-46a86473a060 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:58.464686 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-63e59ce1-2d48-42a4-a773-46a86473a060 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:58.611442 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-63e59ce1-2d48-42a4-a773-46a86473a060 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:58.619820 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-63e59ce1-2d48-42a4-a773-46a86473a060 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/47aa758b-a866-4254-b7ff-47ed2bd1c87f" status: 200 len: 1267 microversion: 2.1 time: 0.168307 Oct 04 22:24:58.620417 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3392/6342] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:24:58 2022] GET /compute/v2.1/servers/47aa758b-a866-4254-b7ff-47ed2bd1c87f => generated 1267 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:24:59.017037 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-c0997855-8ddd-4799-8c51-d4df4f7730f7 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:24:59.017697 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-c0997855-8ddd-4799-8c51-d4df4f7730f7 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] [instance: 90eda454-aef8-4d18-ad76-010e1fecad39] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:24:59.024594 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c0997855-8ddd-4799-8c51-d4df4f7730f7 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:59.025101 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c0997855-8ddd-4799-8c51-d4df4f7730f7 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:59.025563 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c0997855-8ddd-4799-8c51-d4df4f7730f7 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:59.026284 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c0997855-8ddd-4799-8c51-d4df4f7730f7 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:59.026787 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c0997855-8ddd-4799-8c51-d4df4f7730f7 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:59.027278 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c0997855-8ddd-4799-8c51-d4df4f7730f7 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:59.094814 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-c0997855-8ddd-4799-8c51-d4df4f7730f7 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76be0b9e8d2946e3a9b159ef8abbd62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7035d5d2f74f649c6184b972b09826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:59.103146 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-c0997855-8ddd-4799-8c51-d4df4f7730f7 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76be0b9e8d2946e3a9b159ef8abbd62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7035d5d2f74f649c6184b972b09826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:59.104704 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-c0997855-8ddd-4799-8c51-d4df4f7730f7 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76be0b9e8d2946e3a9b159ef8abbd62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7035d5d2f74f649c6184b972b09826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:59.106664 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-c0997855-8ddd-4799-8c51-d4df4f7730f7 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] 10.222.0.43 "GET /compute/v2.1/servers/90eda454-aef8-4d18-ad76-010e1fecad39" status: 200 len: 1366 microversion: 2.57 time: 0.093679 Oct 04 22:24:59.107324 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3393/6343] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:24:59 2022] GET /compute/v2.1/servers/90eda454-aef8-4d18-ad76-010e1fecad39 => generated 1366 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 22:24:59.643282 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-4f9c16a1-f3d4-4a99-8ac2-b6a448571176 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:24:59.643871 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-4f9c16a1-f3d4-4a99-8ac2-b6a448571176 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: 47aa758b-a866-4254-b7ff-47ed2bd1c87f] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:24:59.649913 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4f9c16a1-f3d4-4a99-8ac2-b6a448571176 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:59.650513 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4f9c16a1-f3d4-4a99-8ac2-b6a448571176 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:59.650980 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4f9c16a1-f3d4-4a99-8ac2-b6a448571176 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:59.651705 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4f9c16a1-f3d4-4a99-8ac2-b6a448571176 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:59.652248 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4f9c16a1-f3d4-4a99-8ac2-b6a448571176 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:59.652702 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4f9c16a1-f3d4-4a99-8ac2-b6a448571176 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:59.786742 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-4f9c16a1-f3d4-4a99-8ac2-b6a448571176 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:59.794723 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-4f9c16a1-f3d4-4a99-8ac2-b6a448571176 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/47aa758b-a866-4254-b7ff-47ed2bd1c87f" status: 200 len: 1267 microversion: 2.1 time: 0.155526 Oct 04 22:24:59.795311 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3394/6344] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:24:59 2022] GET /compute/v2.1/servers/47aa758b-a866-4254-b7ff-47ed2bd1c87f => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:25:00.132672 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-d19e7692-ee4b-4c87-bcce-83ddbc9e7ff4 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:25:00.133413 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-d19e7692-ee4b-4c87-bcce-83ddbc9e7ff4 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] [instance: 90eda454-aef8-4d18-ad76-010e1fecad39] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:25:00.140583 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d19e7692-ee4b-4c87-bcce-83ddbc9e7ff4 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:00.141094 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d19e7692-ee4b-4c87-bcce-83ddbc9e7ff4 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:00.141551 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d19e7692-ee4b-4c87-bcce-83ddbc9e7ff4 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:00.142275 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d19e7692-ee4b-4c87-bcce-83ddbc9e7ff4 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:00.142791 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d19e7692-ee4b-4c87-bcce-83ddbc9e7ff4 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:00.143238 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d19e7692-ee4b-4c87-bcce-83ddbc9e7ff4 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:00.218382 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-d19e7692-ee4b-4c87-bcce-83ddbc9e7ff4 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76be0b9e8d2946e3a9b159ef8abbd62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7035d5d2f74f649c6184b972b09826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:25:00.227172 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-d19e7692-ee4b-4c87-bcce-83ddbc9e7ff4 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76be0b9e8d2946e3a9b159ef8abbd62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7035d5d2f74f649c6184b972b09826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:25:00.228658 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-d19e7692-ee4b-4c87-bcce-83ddbc9e7ff4 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76be0b9e8d2946e3a9b159ef8abbd62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7035d5d2f74f649c6184b972b09826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:25:00.229868 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-d19e7692-ee4b-4c87-bcce-83ddbc9e7ff4 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] 10.222.0.43 "GET /compute/v2.1/servers/90eda454-aef8-4d18-ad76-010e1fecad39" status: 200 len: 1366 microversion: 2.57 time: 0.101346 Oct 04 22:25:00.230500 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3395/6345] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:25:00 2022] GET /compute/v2.1/servers/90eda454-aef8-4d18-ad76-010e1fecad39 => generated 1366 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 22:25:00.817237 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-70c3218f-bb8c-4617-9a23-37963f477c08 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:25:00.817857 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-70c3218f-bb8c-4617-9a23-37963f477c08 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: 47aa758b-a866-4254-b7ff-47ed2bd1c87f] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:25:00.824008 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-70c3218f-bb8c-4617-9a23-37963f477c08 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:00.825194 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-70c3218f-bb8c-4617-9a23-37963f477c08 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:00.825649 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-70c3218f-bb8c-4617-9a23-37963f477c08 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:00.826355 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-70c3218f-bb8c-4617-9a23-37963f477c08 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:00.826846 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-70c3218f-bb8c-4617-9a23-37963f477c08 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:00.827285 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-70c3218f-bb8c-4617-9a23-37963f477c08 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:00.890004 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=2 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:25:00.962671 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-70c3218f-bb8c-4617-9a23-37963f477c08 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:25:00.970771 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-70c3218f-bb8c-4617-9a23-37963f477c08 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/47aa758b-a866-4254-b7ff-47ed2bd1c87f" status: 200 len: 1267 microversion: 2.1 time: 0.157434 Oct 04 22:25:00.971358 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3396/6346] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:25:00 2022] GET /compute/v2.1/servers/47aa758b-a866-4254-b7ff-47ed2bd1c87f => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:25:01.257135 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-8f1477d3-687d-4847-9b06-31ace7b5c044 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:25:01.257800 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-8f1477d3-687d-4847-9b06-31ace7b5c044 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] [instance: 90eda454-aef8-4d18-ad76-010e1fecad39] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:25:01.263784 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=8 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:25:01.265907 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8f1477d3-687d-4847-9b06-31ace7b5c044 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:01.266439 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8f1477d3-687d-4847-9b06-31ace7b5c044 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:01.266906 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8f1477d3-687d-4847-9b06-31ace7b5c044 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:01.267624 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8f1477d3-687d-4847-9b06-31ace7b5c044 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:01.268105 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8f1477d3-687d-4847-9b06-31ace7b5c044 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:01.268558 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8f1477d3-687d-4847-9b06-31ace7b5c044 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:01.333597 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-8f1477d3-687d-4847-9b06-31ace7b5c044 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76be0b9e8d2946e3a9b159ef8abbd62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7035d5d2f74f649c6184b972b09826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:25:01.342485 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-8f1477d3-687d-4847-9b06-31ace7b5c044 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76be0b9e8d2946e3a9b159ef8abbd62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7035d5d2f74f649c6184b972b09826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:25:01.344004 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-8f1477d3-687d-4847-9b06-31ace7b5c044 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76be0b9e8d2946e3a9b159ef8abbd62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7035d5d2f74f649c6184b972b09826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:25:01.345203 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-8f1477d3-687d-4847-9b06-31ace7b5c044 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] 10.222.0.43 "GET /compute/v2.1/servers/90eda454-aef8-4d18-ad76-010e1fecad39" status: 200 len: 1366 microversion: 2.57 time: 0.092098 Oct 04 22:25:01.345774 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3397/6347] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:25:01 2022] GET /compute/v2.1/servers/90eda454-aef8-4d18-ad76-010e1fecad39 => generated 1366 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 22:25:01.499982 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-935307f1-18da-43d1-85f0-a78027ebbde1 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:25:01.500494 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-935307f1-18da-43d1-85f0-a78027ebbde1 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] [instance: c598f920-d90a-424a-ae96-8ef237f5d234] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:25:01.506531 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-935307f1-18da-43d1-85f0-a78027ebbde1 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:01.507069 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-935307f1-18da-43d1-85f0-a78027ebbde1 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:01.507522 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-935307f1-18da-43d1-85f0-a78027ebbde1 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:01.508225 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-935307f1-18da-43d1-85f0-a78027ebbde1 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:01.508697 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-935307f1-18da-43d1-85f0-a78027ebbde1 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:01.509137 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-935307f1-18da-43d1-85f0-a78027ebbde1 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:01.538845 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-935307f1-18da-43d1-85f0-a78027ebbde1 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] 10.222.0.43 "GET /compute/v2.1/servers/c598f920-d90a-424a-ae96-8ef237f5d234/os-volume_attachments/0610d928-6a7d-484c-9557-3654c2d1d9d6" status: 200 len: 194 microversion: 2.1 time: 0.042945 Oct 04 22:25:01.539418 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3398/6348] 10.222.0.43 () {58 vars in 1413 bytes} [Tue Oct 4 22:25:01 2022] GET /compute/v2.1/servers/c598f920-d90a-424a-ae96-8ef237f5d234/os-volume_attachments/0610d928-6a7d-484c-9557-3654c2d1d9d6 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:25:01.550158 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-f2280bb1-464f-4257-b31c-332001b61938 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:25:01.550696 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-f2280bb1-464f-4257-b31c-332001b61938 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] [instance: c598f920-d90a-424a-ae96-8ef237f5d234] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:25:01.556265 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f2280bb1-464f-4257-b31c-332001b61938 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:01.556767 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f2280bb1-464f-4257-b31c-332001b61938 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:01.557222 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f2280bb1-464f-4257-b31c-332001b61938 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:01.557922 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f2280bb1-464f-4257-b31c-332001b61938 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:01.558946 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f2280bb1-464f-4257-b31c-332001b61938 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:01.559392 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f2280bb1-464f-4257-b31c-332001b61938 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:01.638801 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.objects.instance [None req-f2280bb1-464f-4257-b31c-332001b61938 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lazy-loading 'services' on Instance uuid c598f920-d90a-424a-ae96-8ef237f5d234 {{(pid=134101) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 22:25:01.709953 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-f2280bb1-464f-4257-b31c-332001b61938 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] 10.222.0.43 "DELETE /compute/v2.1/servers/c598f920-d90a-424a-ae96-8ef237f5d234/os-volume_attachments/0610d928-6a7d-484c-9557-3654c2d1d9d6" status: 202 len: 0 microversion: 2.1 time: 0.163175 Oct 04 22:25:01.710958 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3399/6349] 10.222.0.43 () {58 vars in 1416 bytes} [Tue Oct 4 22:25:01 2022] DELETE /compute/v2.1/servers/c598f920-d90a-424a-ae96-8ef237f5d234/os-volume_attachments/0610d928-6a7d-484c-9557-3654c2d1d9d6 => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 22:25:01.995398 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-0a7bf210-8bef-4f46-85ae-a14df683ec33 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:25:01.996039 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-0a7bf210-8bef-4f46-85ae-a14df683ec33 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: 47aa758b-a866-4254-b7ff-47ed2bd1c87f] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:25:02.002672 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0a7bf210-8bef-4f46-85ae-a14df683ec33 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:02.003172 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0a7bf210-8bef-4f46-85ae-a14df683ec33 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:02.003629 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0a7bf210-8bef-4f46-85ae-a14df683ec33 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:02.004335 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0a7bf210-8bef-4f46-85ae-a14df683ec33 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:02.004817 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0a7bf210-8bef-4f46-85ae-a14df683ec33 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:02.005262 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0a7bf210-8bef-4f46-85ae-a14df683ec33 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:02.143676 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-0a7bf210-8bef-4f46-85ae-a14df683ec33 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:25:02.152490 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-0a7bf210-8bef-4f46-85ae-a14df683ec33 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/47aa758b-a866-4254-b7ff-47ed2bd1c87f" status: 200 len: 1267 microversion: 2.1 time: 0.161015 Oct 04 22:25:02.153094 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3400/6350] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:25:01 2022] GET /compute/v2.1/servers/47aa758b-a866-4254-b7ff-47ed2bd1c87f => generated 1267 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:25:02.372146 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-3f7ea232-f889-4de8-a75a-36a5f1435a57 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:25:02.372790 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-3f7ea232-f889-4de8-a75a-36a5f1435a57 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] [instance: 90eda454-aef8-4d18-ad76-010e1fecad39] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:25:02.380261 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3f7ea232-f889-4de8-a75a-36a5f1435a57 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:02.380769 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3f7ea232-f889-4de8-a75a-36a5f1435a57 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:02.381228 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3f7ea232-f889-4de8-a75a-36a5f1435a57 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:02.381955 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3f7ea232-f889-4de8-a75a-36a5f1435a57 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:02.382493 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3f7ea232-f889-4de8-a75a-36a5f1435a57 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:02.382948 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3f7ea232-f889-4de8-a75a-36a5f1435a57 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:02.451727 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-3f7ea232-f889-4de8-a75a-36a5f1435a57 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76be0b9e8d2946e3a9b159ef8abbd62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7035d5d2f74f649c6184b972b09826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:25:02.460334 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-3f7ea232-f889-4de8-a75a-36a5f1435a57 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76be0b9e8d2946e3a9b159ef8abbd62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7035d5d2f74f649c6184b972b09826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:25:02.461825 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-3f7ea232-f889-4de8-a75a-36a5f1435a57 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76be0b9e8d2946e3a9b159ef8abbd62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7035d5d2f74f649c6184b972b09826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:25:02.463073 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-3f7ea232-f889-4de8-a75a-36a5f1435a57 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] 10.222.0.43 "GET /compute/v2.1/servers/90eda454-aef8-4d18-ad76-010e1fecad39" status: 200 len: 1366 microversion: 2.57 time: 0.096166 Oct 04 22:25:02.463641 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3401/6351] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:25:02 2022] GET /compute/v2.1/servers/90eda454-aef8-4d18-ad76-010e1fecad39 => generated 1366 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 22:25:03.091816 n-d-860284-1 devstack@n-api.service[134102]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 22:25:03.092364 n-d-860284-1 devstack@n-api.service[134102]: Tue Oct 4 22:25:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.43) !!! Oct 04 22:25:03.176797 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-1b346974-36b1-47a2-a506-92944dd529c9 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:25:03.177434 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-1b346974-36b1-47a2-a506-92944dd529c9 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: 47aa758b-a866-4254-b7ff-47ed2bd1c87f] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:25:03.184255 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1b346974-36b1-47a2-a506-92944dd529c9 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:03.184755 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1b346974-36b1-47a2-a506-92944dd529c9 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:03.185205 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1b346974-36b1-47a2-a506-92944dd529c9 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:03.185916 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1b346974-36b1-47a2-a506-92944dd529c9 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:03.186538 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1b346974-36b1-47a2-a506-92944dd529c9 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:03.186980 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1b346974-36b1-47a2-a506-92944dd529c9 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:03.322551 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-1b346974-36b1-47a2-a506-92944dd529c9 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:25:03.330795 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-1b346974-36b1-47a2-a506-92944dd529c9 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/47aa758b-a866-4254-b7ff-47ed2bd1c87f" status: 200 len: 1267 microversion: 2.1 time: 0.157876 Oct 04 22:25:03.331384 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3402/6352] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:25:03 2022] GET /compute/v2.1/servers/47aa758b-a866-4254-b7ff-47ed2bd1c87f => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:25:03.489260 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-450b5e07-da26-4d37-80dc-411ea0b88fd0 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:25:03.489907 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-450b5e07-da26-4d37-80dc-411ea0b88fd0 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] [instance: 90eda454-aef8-4d18-ad76-010e1fecad39] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:25:03.497353 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-450b5e07-da26-4d37-80dc-411ea0b88fd0 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:03.497866 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-450b5e07-da26-4d37-80dc-411ea0b88fd0 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:03.498324 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-450b5e07-da26-4d37-80dc-411ea0b88fd0 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:03.499071 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-450b5e07-da26-4d37-80dc-411ea0b88fd0 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:03.499547 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-450b5e07-da26-4d37-80dc-411ea0b88fd0 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:03.500000 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-450b5e07-da26-4d37-80dc-411ea0b88fd0 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:03.502843 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:25:03.571485 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-450b5e07-da26-4d37-80dc-411ea0b88fd0 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76be0b9e8d2946e3a9b159ef8abbd62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7035d5d2f74f649c6184b972b09826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:25:03.580534 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-450b5e07-da26-4d37-80dc-411ea0b88fd0 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76be0b9e8d2946e3a9b159ef8abbd62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7035d5d2f74f649c6184b972b09826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:25:03.582007 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-450b5e07-da26-4d37-80dc-411ea0b88fd0 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76be0b9e8d2946e3a9b159ef8abbd62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7035d5d2f74f649c6184b972b09826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:25:03.583227 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-450b5e07-da26-4d37-80dc-411ea0b88fd0 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] 10.222.0.43 "GET /compute/v2.1/servers/90eda454-aef8-4d18-ad76-010e1fecad39" status: 200 len: 1366 microversion: 2.57 time: 0.098166 Oct 04 22:25:03.583791 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3403/6353] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:25:03 2022] GET /compute/v2.1/servers/90eda454-aef8-4d18-ad76-010e1fecad39 => generated 1366 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 22:25:04.355629 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-edc8b542-c1c3-4eb2-b181-7c61d26195a8 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:25:04.356273 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-edc8b542-c1c3-4eb2-b181-7c61d26195a8 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: 47aa758b-a866-4254-b7ff-47ed2bd1c87f] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:25:04.363068 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-edc8b542-c1c3-4eb2-b181-7c61d26195a8 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:04.363574 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-edc8b542-c1c3-4eb2-b181-7c61d26195a8 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:04.364034 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-edc8b542-c1c3-4eb2-b181-7c61d26195a8 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:04.364750 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-edc8b542-c1c3-4eb2-b181-7c61d26195a8 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:04.365230 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-edc8b542-c1c3-4eb2-b181-7c61d26195a8 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:04.365675 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-edc8b542-c1c3-4eb2-b181-7c61d26195a8 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:04.508585 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-edc8b542-c1c3-4eb2-b181-7c61d26195a8 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:25:04.517919 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-edc8b542-c1c3-4eb2-b181-7c61d26195a8 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/47aa758b-a866-4254-b7ff-47ed2bd1c87f" status: 200 len: 1267 microversion: 2.1 time: 0.166781 Oct 04 22:25:04.518621 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3404/6354] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:25:04 2022] GET /compute/v2.1/servers/47aa758b-a866-4254-b7ff-47ed2bd1c87f => generated 1267 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:25:04.609429 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-cacc12a8-56dd-4fe6-afa6-3b01f4a15c1a tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:25:04.610098 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-cacc12a8-56dd-4fe6-afa6-3b01f4a15c1a tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] [instance: 90eda454-aef8-4d18-ad76-010e1fecad39] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:25:04.616390 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cacc12a8-56dd-4fe6-afa6-3b01f4a15c1a tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:04.616899 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cacc12a8-56dd-4fe6-afa6-3b01f4a15c1a tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:04.617358 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cacc12a8-56dd-4fe6-afa6-3b01f4a15c1a tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:04.618105 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cacc12a8-56dd-4fe6-afa6-3b01f4a15c1a tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:04.618641 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cacc12a8-56dd-4fe6-afa6-3b01f4a15c1a tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:04.619090 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cacc12a8-56dd-4fe6-afa6-3b01f4a15c1a tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:04.685760 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-cacc12a8-56dd-4fe6-afa6-3b01f4a15c1a tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76be0b9e8d2946e3a9b159ef8abbd62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7035d5d2f74f649c6184b972b09826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:25:04.694275 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-cacc12a8-56dd-4fe6-afa6-3b01f4a15c1a tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76be0b9e8d2946e3a9b159ef8abbd62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7035d5d2f74f649c6184b972b09826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:25:04.695779 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-cacc12a8-56dd-4fe6-afa6-3b01f4a15c1a tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76be0b9e8d2946e3a9b159ef8abbd62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7035d5d2f74f649c6184b972b09826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:25:04.696983 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-cacc12a8-56dd-4fe6-afa6-3b01f4a15c1a tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] 10.222.0.43 "GET /compute/v2.1/servers/90eda454-aef8-4d18-ad76-010e1fecad39" status: 200 len: 1366 microversion: 2.57 time: 0.091722 Oct 04 22:25:04.697556 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3405/6355] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:25:04 2022] GET /compute/v2.1/servers/90eda454-aef8-4d18-ad76-010e1fecad39 => generated 1366 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 22:25:05.541321 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-1b2249d5-56d1-4e9b-a0dd-be738afe22e1 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:25:05.541979 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-1b2249d5-56d1-4e9b-a0dd-be738afe22e1 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: 47aa758b-a866-4254-b7ff-47ed2bd1c87f] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:25:05.549620 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1b2249d5-56d1-4e9b-a0dd-be738afe22e1 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:05.550132 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1b2249d5-56d1-4e9b-a0dd-be738afe22e1 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:05.550624 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1b2249d5-56d1-4e9b-a0dd-be738afe22e1 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:05.551354 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1b2249d5-56d1-4e9b-a0dd-be738afe22e1 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:05.551833 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1b2249d5-56d1-4e9b-a0dd-be738afe22e1 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:05.552286 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1b2249d5-56d1-4e9b-a0dd-be738afe22e1 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:05.710653 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-1b2249d5-56d1-4e9b-a0dd-be738afe22e1 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:25:05.721168 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-1b2249d5-56d1-4e9b-a0dd-be738afe22e1 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/47aa758b-a866-4254-b7ff-47ed2bd1c87f" status: 200 len: 1267 microversion: 2.1 time: 0.183794 Oct 04 22:25:05.730414 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3406/6356] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:25:05 2022] GET /compute/v2.1/servers/47aa758b-a866-4254-b7ff-47ed2bd1c87f => generated 1267 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:25:05.730414 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-a67f2f73-ab77-405e-ba78-5d2553c2097a tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:25:05.730414 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-a67f2f73-ab77-405e-ba78-5d2553c2097a tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] [instance: 90eda454-aef8-4d18-ad76-010e1fecad39] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:25:05.743309 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a67f2f73-ab77-405e-ba78-5d2553c2097a tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:05.745365 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a67f2f73-ab77-405e-ba78-5d2553c2097a tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:05.746982 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a67f2f73-ab77-405e-ba78-5d2553c2097a tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:05.748144 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a67f2f73-ab77-405e-ba78-5d2553c2097a tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:05.748685 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a67f2f73-ab77-405e-ba78-5d2553c2097a tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:05.749198 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a67f2f73-ab77-405e-ba78-5d2553c2097a tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:05.834114 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-a67f2f73-ab77-405e-ba78-5d2553c2097a tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76be0b9e8d2946e3a9b159ef8abbd62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7035d5d2f74f649c6184b972b09826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:25:05.845123 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-a67f2f73-ab77-405e-ba78-5d2553c2097a tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76be0b9e8d2946e3a9b159ef8abbd62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7035d5d2f74f649c6184b972b09826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:25:05.847136 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-a67f2f73-ab77-405e-ba78-5d2553c2097a tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76be0b9e8d2946e3a9b159ef8abbd62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7035d5d2f74f649c6184b972b09826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:25:05.848389 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-a67f2f73-ab77-405e-ba78-5d2553c2097a tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] 10.222.0.43 "GET /compute/v2.1/servers/90eda454-aef8-4d18-ad76-010e1fecad39" status: 200 len: 1366 microversion: 2.57 time: 0.125256 Oct 04 22:25:05.856960 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3407/6357] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:25:05 2022] GET /compute/v2.1/servers/90eda454-aef8-4d18-ad76-010e1fecad39 => generated 1366 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:25:06.745750 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-24b11d50-a9b5-411b-9d7b-32dfb868762b tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:25:06.746560 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-24b11d50-a9b5-411b-9d7b-32dfb868762b tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: 47aa758b-a866-4254-b7ff-47ed2bd1c87f] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:25:06.753260 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-24b11d50-a9b5-411b-9d7b-32dfb868762b tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:06.753768 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-24b11d50-a9b5-411b-9d7b-32dfb868762b tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:06.754225 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-24b11d50-a9b5-411b-9d7b-32dfb868762b tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:06.755039 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-24b11d50-a9b5-411b-9d7b-32dfb868762b tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:06.755519 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-24b11d50-a9b5-411b-9d7b-32dfb868762b tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:06.755966 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-24b11d50-a9b5-411b-9d7b-32dfb868762b tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:06.888680 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-24b11d50-a9b5-411b-9d7b-32dfb868762b tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:25:06.896504 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-24b11d50-a9b5-411b-9d7b-32dfb868762b tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/47aa758b-a866-4254-b7ff-47ed2bd1c87f" status: 200 len: 1267 microversion: 2.1 time: 0.154732 Oct 04 22:25:06.897086 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3408/6358] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:25:06 2022] GET /compute/v2.1/servers/47aa758b-a866-4254-b7ff-47ed2bd1c87f => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:25:06.901530 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-faa64f38-47e2-4bc9-889a-0a586c1318f6 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:25:06.902323 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-faa64f38-47e2-4bc9-889a-0a586c1318f6 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] [instance: 90eda454-aef8-4d18-ad76-010e1fecad39] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:25:06.908147 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-faa64f38-47e2-4bc9-889a-0a586c1318f6 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:06.908658 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-faa64f38-47e2-4bc9-889a-0a586c1318f6 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:06.909117 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-faa64f38-47e2-4bc9-889a-0a586c1318f6 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:06.909831 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-faa64f38-47e2-4bc9-889a-0a586c1318f6 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:06.910306 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-faa64f38-47e2-4bc9-889a-0a586c1318f6 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:06.910778 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-faa64f38-47e2-4bc9-889a-0a586c1318f6 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:06.979403 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-faa64f38-47e2-4bc9-889a-0a586c1318f6 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76be0b9e8d2946e3a9b159ef8abbd62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7035d5d2f74f649c6184b972b09826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:25:06.988225 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-faa64f38-47e2-4bc9-889a-0a586c1318f6 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76be0b9e8d2946e3a9b159ef8abbd62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7035d5d2f74f649c6184b972b09826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:25:06.989699 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-faa64f38-47e2-4bc9-889a-0a586c1318f6 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76be0b9e8d2946e3a9b159ef8abbd62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7035d5d2f74f649c6184b972b09826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:25:06.990934 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-faa64f38-47e2-4bc9-889a-0a586c1318f6 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] 10.222.0.43 "GET /compute/v2.1/servers/90eda454-aef8-4d18-ad76-010e1fecad39" status: 200 len: 1366 microversion: 2.57 time: 0.092906 Oct 04 22:25:06.991508 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3409/6359] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:25:06 2022] GET /compute/v2.1/servers/90eda454-aef8-4d18-ad76-010e1fecad39 => generated 1366 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:25:07.127280 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-d5b21ae6-6fa2-434a-bd3d-9432b11bcf82 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:25:07.129619 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-d5b21ae6-6fa2-434a-bd3d-9432b11bcf82 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] [instance: c598f920-d90a-424a-ae96-8ef237f5d234] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:25:07.136209 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d5b21ae6-6fa2-434a-bd3d-9432b11bcf82 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:07.136606 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d5b21ae6-6fa2-434a-bd3d-9432b11bcf82 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:07.137154 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d5b21ae6-6fa2-434a-bd3d-9432b11bcf82 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:07.137873 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d5b21ae6-6fa2-434a-bd3d-9432b11bcf82 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:07.138344 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d5b21ae6-6fa2-434a-bd3d-9432b11bcf82 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:07.138812 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d5b21ae6-6fa2-434a-bd3d-9432b11bcf82 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:07.171991 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-d5b21ae6-6fa2-434a-bd3d-9432b11bcf82 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] 10.222.0.43 "GET /compute/v2.1/servers/c598f920-d90a-424a-ae96-8ef237f5d234/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048588 Oct 04 22:25:07.172596 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3410/6360] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 22:25:07 2022] GET /compute/v2.1/servers/c598f920-d90a-424a-ae96-8ef237f5d234/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 04 22:25:07.299106 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-fefdf833-36e1-471b-843c-e92380ae0118 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:25:07.301442 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-fefdf833-36e1-471b-843c-e92380ae0118 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] [instance: c598f920-d90a-424a-ae96-8ef237f5d234] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:25:07.307713 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fefdf833-36e1-471b-843c-e92380ae0118 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:07.308913 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fefdf833-36e1-471b-843c-e92380ae0118 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:07.309530 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fefdf833-36e1-471b-843c-e92380ae0118 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:07.310261 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fefdf833-36e1-471b-843c-e92380ae0118 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:07.310768 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fefdf833-36e1-471b-843c-e92380ae0118 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:07.311218 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fefdf833-36e1-471b-843c-e92380ae0118 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:07.342954 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-fefdf833-36e1-471b-843c-e92380ae0118 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] 10.222.0.43 "GET /compute/v2.1/servers/c598f920-d90a-424a-ae96-8ef237f5d234/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047928 Oct 04 22:25:07.343575 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3411/6361] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 22:25:07 2022] GET /compute/v2.1/servers/c598f920-d90a-424a-ae96-8ef237f5d234/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 04 22:25:07.409110 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-8c1342e5-8ba7-4218-bb7c-003972a22226 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:25:07.409628 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-8c1342e5-8ba7-4218-bb7c-003972a22226 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] [instance: c598f920-d90a-424a-ae96-8ef237f5d234] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:25:07.415856 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8c1342e5-8ba7-4218-bb7c-003972a22226 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:07.416351 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8c1342e5-8ba7-4218-bb7c-003972a22226 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:07.416807 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8c1342e5-8ba7-4218-bb7c-003972a22226 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:07.417644 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8c1342e5-8ba7-4218-bb7c-003972a22226 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:07.418018 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8c1342e5-8ba7-4218-bb7c-003972a22226 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:07.418492 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8c1342e5-8ba7-4218-bb7c-003972a22226 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:07.444512 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-8c1342e5-8ba7-4218-bb7c-003972a22226 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] [instance: c598f920-d90a-424a-ae96-8ef237f5d234] Going to try to terminate instance {{(pid=134101) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 22:25:07.516498 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:25:07.531056 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-8c1342e5-8ba7-4218-bb7c-003972a22226 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] 10.222.0.43 "DELETE /compute/v2.1/servers/c598f920-d90a-424a-ae96-8ef237f5d234" status: 204 len: 0 microversion: 2.1 time: 0.125717 Oct 04 22:25:07.532192 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3412/6362] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 22:25:07 2022] DELETE /compute/v2.1/servers/c598f920-d90a-424a-ae96-8ef237f5d234 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 22:25:07.537241 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-192aea66-3612-4780-bbb1-a1ce8b56efe0 req-8b0b8a59-9a5a-4ad3-97de-24236f1ed18c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47aa758b-a866-4254-b7ff-47ed2bd1c87f", "name": "network-vif-plugged", "status": "completed", "tag": "8957a848-6a5f-4266-81c3-301fb772023a"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:25:07.548072 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-192aea66-3612-4780-bbb1-a1ce8b56efe0 req-8b0b8a59-9a5a-4ad3-97de-24236f1ed18c service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:07.548579 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-192aea66-3612-4780-bbb1-a1ce8b56efe0 req-8b0b8a59-9a5a-4ad3-97de-24236f1ed18c service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:07.549029 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-192aea66-3612-4780-bbb1-a1ce8b56efe0 req-8b0b8a59-9a5a-4ad3-97de-24236f1ed18c service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:07.560311 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-192aea66-3612-4780-bbb1-a1ce8b56efe0 req-8b0b8a59-9a5a-4ad3-97de-24236f1ed18c service nova] Creating event network-vif-plugged:8957a848-6a5f-4266-81c3-301fb772023a for instance 47aa758b-a866-4254-b7ff-47ed2bd1c87f on n-h1-860284-1 Oct 04 22:25:07.565091 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-192aea66-3612-4780-bbb1-a1ce8b56efe0 req-8b0b8a59-9a5a-4ad3-97de-24236f1ed18c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031775 Oct 04 22:25:07.565692 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3413/6363] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:25:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:25:07.570680 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e20f25dd-ced0-4cb9-ba0d-2881724e4bda tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:25:07.571393 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-e20f25dd-ced0-4cb9-ba0d-2881724e4bda tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] [instance: c598f920-d90a-424a-ae96-8ef237f5d234] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:25:07.577672 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e20f25dd-ced0-4cb9-ba0d-2881724e4bda tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:07.578171 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e20f25dd-ced0-4cb9-ba0d-2881724e4bda tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:07.578658 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e20f25dd-ced0-4cb9-ba0d-2881724e4bda tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:07.579370 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e20f25dd-ced0-4cb9-ba0d-2881724e4bda tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:07.579844 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e20f25dd-ced0-4cb9-ba0d-2881724e4bda tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:07.580291 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e20f25dd-ced0-4cb9-ba0d-2881724e4bda tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:07.673197 n-d-860284-1 devstack@n-api.service[134102]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 22:25:07.673703 n-d-860284-1 devstack@n-api.service[134102]: Tue Oct 4 22:25:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.43) !!! Oct 04 22:25:07.711221 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-e20f25dd-ced0-4cb9-ba0d-2881724e4bda tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '524ac46437134cd5a5000574631ea59a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b191bd428a4906b6c2781ae3efdaae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:25:07.719868 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-e20f25dd-ced0-4cb9-ba0d-2881724e4bda tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] 10.222.0.43 "GET /compute/v2.1/servers/c598f920-d90a-424a-ae96-8ef237f5d234" status: 200 len: 1674 microversion: 2.1 time: 0.153081 Oct 04 22:25:07.720439 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3414/6364] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:25:07 2022] GET /compute/v2.1/servers/c598f920-d90a-424a-ae96-8ef237f5d234 => generated 1674 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:25:07.920123 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-7ed3b2c1-31ac-4f3f-8117-1d6579b6b5d9 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:25:07.920713 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-7ed3b2c1-31ac-4f3f-8117-1d6579b6b5d9 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: 47aa758b-a866-4254-b7ff-47ed2bd1c87f] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:25:07.927503 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7ed3b2c1-31ac-4f3f-8117-1d6579b6b5d9 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:07.928076 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7ed3b2c1-31ac-4f3f-8117-1d6579b6b5d9 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:07.928534 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7ed3b2c1-31ac-4f3f-8117-1d6579b6b5d9 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:07.929239 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7ed3b2c1-31ac-4f3f-8117-1d6579b6b5d9 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:07.929709 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7ed3b2c1-31ac-4f3f-8117-1d6579b6b5d9 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:07.930150 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7ed3b2c1-31ac-4f3f-8117-1d6579b6b5d9 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:08.067043 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-7ed3b2c1-31ac-4f3f-8117-1d6579b6b5d9 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:25:08.075229 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-7ed3b2c1-31ac-4f3f-8117-1d6579b6b5d9 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/47aa758b-a866-4254-b7ff-47ed2bd1c87f" status: 200 len: 1267 microversion: 2.1 time: 0.159713 Oct 04 22:25:08.075805 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3415/6365] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:25:07 2022] GET /compute/v2.1/servers/47aa758b-a866-4254-b7ff-47ed2bd1c87f => generated 1267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:25:08.080278 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-9f9a0d38-44ed-48f1-a40c-5a2851d4387e tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:25:08.080891 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-9f9a0d38-44ed-48f1-a40c-5a2851d4387e tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] [instance: 90eda454-aef8-4d18-ad76-010e1fecad39] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:25:08.086448 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9f9a0d38-44ed-48f1-a40c-5a2851d4387e tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:08.086948 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9f9a0d38-44ed-48f1-a40c-5a2851d4387e tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:08.087401 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9f9a0d38-44ed-48f1-a40c-5a2851d4387e tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:08.088106 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9f9a0d38-44ed-48f1-a40c-5a2851d4387e tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:08.088778 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9f9a0d38-44ed-48f1-a40c-5a2851d4387e tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:08.089013 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9f9a0d38-44ed-48f1-a40c-5a2851d4387e tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:08.155984 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-9f9a0d38-44ed-48f1-a40c-5a2851d4387e tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76be0b9e8d2946e3a9b159ef8abbd62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7035d5d2f74f649c6184b972b09826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:25:08.164546 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-9f9a0d38-44ed-48f1-a40c-5a2851d4387e tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76be0b9e8d2946e3a9b159ef8abbd62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7035d5d2f74f649c6184b972b09826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:25:08.166001 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-9f9a0d38-44ed-48f1-a40c-5a2851d4387e tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76be0b9e8d2946e3a9b159ef8abbd62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7035d5d2f74f649c6184b972b09826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:25:08.167814 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-9f9a0d38-44ed-48f1-a40c-5a2851d4387e tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] 10.222.0.43 "GET /compute/v2.1/servers/90eda454-aef8-4d18-ad76-010e1fecad39" status: 200 len: 1366 microversion: 2.57 time: 0.090478 Oct 04 22:25:08.168395 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3416/6366] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:25:08 2022] GET /compute/v2.1/servers/90eda454-aef8-4d18-ad76-010e1fecad39 => generated 1366 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:25:08.743848 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-74949f30-1082-4073-9bd3-3ed596eb5b92 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:25:08.744479 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-74949f30-1082-4073-9bd3-3ed596eb5b92 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] [instance: c598f920-d90a-424a-ae96-8ef237f5d234] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:25:08.750571 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-74949f30-1082-4073-9bd3-3ed596eb5b92 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:08.751071 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-74949f30-1082-4073-9bd3-3ed596eb5b92 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:08.751527 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-74949f30-1082-4073-9bd3-3ed596eb5b92 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:08.752237 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-74949f30-1082-4073-9bd3-3ed596eb5b92 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:08.752717 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-74949f30-1082-4073-9bd3-3ed596eb5b92 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:08.753158 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-74949f30-1082-4073-9bd3-3ed596eb5b92 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:08.892881 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-74949f30-1082-4073-9bd3-3ed596eb5b92 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '524ac46437134cd5a5000574631ea59a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b191bd428a4906b6c2781ae3efdaae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:25:08.900831 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-74949f30-1082-4073-9bd3-3ed596eb5b92 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] 10.222.0.43 "GET /compute/v2.1/servers/c598f920-d90a-424a-ae96-8ef237f5d234" status: 200 len: 1674 microversion: 2.1 time: 0.160976 Oct 04 22:25:08.901419 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3417/6367] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:25:08 2022] GET /compute/v2.1/servers/c598f920-d90a-424a-ae96-8ef237f5d234 => generated 1674 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:25:09.099219 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-f64cc246-bd6c-4066-b427-3c31385c6682 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:25:09.099841 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-f64cc246-bd6c-4066-b427-3c31385c6682 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: 47aa758b-a866-4254-b7ff-47ed2bd1c87f] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:25:09.106753 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f64cc246-bd6c-4066-b427-3c31385c6682 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:09.107251 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f64cc246-bd6c-4066-b427-3c31385c6682 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:09.107704 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f64cc246-bd6c-4066-b427-3c31385c6682 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:09.108414 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f64cc246-bd6c-4066-b427-3c31385c6682 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:09.108885 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f64cc246-bd6c-4066-b427-3c31385c6682 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:09.109327 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f64cc246-bd6c-4066-b427-3c31385c6682 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:09.241984 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-f64cc246-bd6c-4066-b427-3c31385c6682 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:25:09.244516 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:25:09.253009 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-f64cc246-bd6c-4066-b427-3c31385c6682 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/47aa758b-a866-4254-b7ff-47ed2bd1c87f" status: 200 len: 1267 microversion: 2.1 time: 0.157758 Oct 04 22:25:09.253737 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3418/6368] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:25:09 2022] GET /compute/v2.1/servers/47aa758b-a866-4254-b7ff-47ed2bd1c87f => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:25:09.258326 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-715ade30-c5e2-4df3-8333-527a6c11ddb4 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:25:09.258972 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-715ade30-c5e2-4df3-8333-527a6c11ddb4 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] [instance: 90eda454-aef8-4d18-ad76-010e1fecad39] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:25:09.266299 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-715ade30-c5e2-4df3-8333-527a6c11ddb4 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:09.266822 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-715ade30-c5e2-4df3-8333-527a6c11ddb4 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:09.267281 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-715ade30-c5e2-4df3-8333-527a6c11ddb4 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:09.267995 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-715ade30-c5e2-4df3-8333-527a6c11ddb4 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:09.268463 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-715ade30-c5e2-4df3-8333-527a6c11ddb4 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:09.268906 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-715ade30-c5e2-4df3-8333-527a6c11ddb4 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:09.333537 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-715ade30-c5e2-4df3-8333-527a6c11ddb4 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76be0b9e8d2946e3a9b159ef8abbd62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7035d5d2f74f649c6184b972b09826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:25:09.341959 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-715ade30-c5e2-4df3-8333-527a6c11ddb4 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76be0b9e8d2946e3a9b159ef8abbd62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7035d5d2f74f649c6184b972b09826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:25:09.343473 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-715ade30-c5e2-4df3-8333-527a6c11ddb4 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76be0b9e8d2946e3a9b159ef8abbd62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7035d5d2f74f649c6184b972b09826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:25:09.344672 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-715ade30-c5e2-4df3-8333-527a6c11ddb4 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] 10.222.0.43 "GET /compute/v2.1/servers/90eda454-aef8-4d18-ad76-010e1fecad39" status: 200 len: 1372 microversion: 2.57 time: 0.089983 Oct 04 22:25:09.345247 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3419/6369] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:25:09 2022] GET /compute/v2.1/servers/90eda454-aef8-4d18-ad76-010e1fecad39 => generated 1372 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:25:09.924371 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-708ab469-1015-4ac6-8427-41c37e1b833f tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:25:09.925033 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-708ab469-1015-4ac6-8427-41c37e1b833f tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] [instance: c598f920-d90a-424a-ae96-8ef237f5d234] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:25:09.931118 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-708ab469-1015-4ac6-8427-41c37e1b833f tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:09.931624 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-708ab469-1015-4ac6-8427-41c37e1b833f tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:09.932079 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-708ab469-1015-4ac6-8427-41c37e1b833f tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:09.932812 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-708ab469-1015-4ac6-8427-41c37e1b833f tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:09.933392 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-708ab469-1015-4ac6-8427-41c37e1b833f tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:09.933843 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-708ab469-1015-4ac6-8427-41c37e1b833f tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:10.166885 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-708ab469-1015-4ac6-8427-41c37e1b833f tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '524ac46437134cd5a5000574631ea59a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b191bd428a4906b6c2781ae3efdaae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:25:10.174864 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-708ab469-1015-4ac6-8427-41c37e1b833f tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] 10.222.0.43 "GET /compute/v2.1/servers/c598f920-d90a-424a-ae96-8ef237f5d234" status: 200 len: 1674 microversion: 2.1 time: 0.254353 Oct 04 22:25:10.175632 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3420/6370] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:25:09 2022] GET /compute/v2.1/servers/c598f920-d90a-424a-ae96-8ef237f5d234 => generated 1674 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:25:10.276037 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-d6f6fdfe-2be9-4ed7-9dac-c87271882a1c tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:25:10.276773 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-d6f6fdfe-2be9-4ed7-9dac-c87271882a1c tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: 47aa758b-a866-4254-b7ff-47ed2bd1c87f] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:25:10.283170 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d6f6fdfe-2be9-4ed7-9dac-c87271882a1c tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:10.283676 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d6f6fdfe-2be9-4ed7-9dac-c87271882a1c tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:10.284129 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d6f6fdfe-2be9-4ed7-9dac-c87271882a1c tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:10.284839 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d6f6fdfe-2be9-4ed7-9dac-c87271882a1c tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:10.285305 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d6f6fdfe-2be9-4ed7-9dac-c87271882a1c tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:10.285746 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d6f6fdfe-2be9-4ed7-9dac-c87271882a1c tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:10.563839 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-d6f6fdfe-2be9-4ed7-9dac-c87271882a1c tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:25:10.572076 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-d6f6fdfe-2be9-4ed7-9dac-c87271882a1c tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/47aa758b-a866-4254-b7ff-47ed2bd1c87f" status: 200 len: 1267 microversion: 2.1 time: 0.299936 Oct 04 22:25:10.578871 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3421/6371] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:25:10 2022] GET /compute/v2.1/servers/47aa758b-a866-4254-b7ff-47ed2bd1c87f => generated 1267 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:25:10.578871 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-fd381e59-c18b-4e0e-adfe-b57314d20ab1 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:25:10.578871 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-fd381e59-c18b-4e0e-adfe-b57314d20ab1 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] [instance: 90eda454-aef8-4d18-ad76-010e1fecad39] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:25:10.584492 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fd381e59-c18b-4e0e-adfe-b57314d20ab1 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:10.585136 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fd381e59-c18b-4e0e-adfe-b57314d20ab1 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:10.585608 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fd381e59-c18b-4e0e-adfe-b57314d20ab1 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:10.586327 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fd381e59-c18b-4e0e-adfe-b57314d20ab1 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:10.586832 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fd381e59-c18b-4e0e-adfe-b57314d20ab1 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:10.587280 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fd381e59-c18b-4e0e-adfe-b57314d20ab1 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:10.663819 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-fd381e59-c18b-4e0e-adfe-b57314d20ab1 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76be0b9e8d2946e3a9b159ef8abbd62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7035d5d2f74f649c6184b972b09826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:25:10.672346 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-fd381e59-c18b-4e0e-adfe-b57314d20ab1 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76be0b9e8d2946e3a9b159ef8abbd62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7035d5d2f74f649c6184b972b09826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:25:10.673824 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-fd381e59-c18b-4e0e-adfe-b57314d20ab1 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76be0b9e8d2946e3a9b159ef8abbd62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7035d5d2f74f649c6184b972b09826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:25:10.675056 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-fd381e59-c18b-4e0e-adfe-b57314d20ab1 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] 10.222.0.43 "GET /compute/v2.1/servers/90eda454-aef8-4d18-ad76-010e1fecad39" status: 200 len: 1372 microversion: 2.57 time: 0.101433 Oct 04 22:25:10.675634 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3422/6372] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:25:10 2022] GET /compute/v2.1/servers/90eda454-aef8-4d18-ad76-010e1fecad39 => generated 1372 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:25:11.033461 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-fa007049-5706-46d6-9453-d21fdb3eea6c req-306ab419-35f1-4b3d-9362-d5db8d45851d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c598f920-d90a-424a-ae96-8ef237f5d234", "name": "network-vif-deleted", "tag": "4a08fa07-1572-4ed8-a3d4-c446e944cc4c"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:25:11.056340 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-fa007049-5706-46d6-9453-d21fdb3eea6c req-306ab419-35f1-4b3d-9362-d5db8d45851d service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:11.056917 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-fa007049-5706-46d6-9453-d21fdb3eea6c req-306ab419-35f1-4b3d-9362-d5db8d45851d service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:11.057377 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-fa007049-5706-46d6-9453-d21fdb3eea6c req-306ab419-35f1-4b3d-9362-d5db8d45851d service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:11.071540 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-fa007049-5706-46d6-9453-d21fdb3eea6c req-306ab419-35f1-4b3d-9362-d5db8d45851d service nova] Creating event network-vif-deleted:4a08fa07-1572-4ed8-a3d4-c446e944cc4c for instance c598f920-d90a-424a-ae96-8ef237f5d234 on n-h1-860284-1 Oct 04 22:25:11.076634 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-fa007049-5706-46d6-9453-d21fdb3eea6c req-306ab419-35f1-4b3d-9362-d5db8d45851d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047440 Oct 04 22:25:11.077471 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3423/6373] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:25:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:25:11.201271 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-d1785b73-915a-4e98-8374-631b925bcfa0 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:25:11.202745 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-d1785b73-915a-4e98-8374-631b925bcfa0 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] [instance: c598f920-d90a-424a-ae96-8ef237f5d234] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:25:11.210413 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d1785b73-915a-4e98-8374-631b925bcfa0 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:11.211208 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d1785b73-915a-4e98-8374-631b925bcfa0 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:11.211833 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d1785b73-915a-4e98-8374-631b925bcfa0 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:11.212564 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d1785b73-915a-4e98-8374-631b925bcfa0 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:11.213038 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d1785b73-915a-4e98-8374-631b925bcfa0 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:11.213482 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d1785b73-915a-4e98-8374-631b925bcfa0 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:11.257152 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d1785b73-915a-4e98-8374-631b925bcfa0 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:11.257676 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d1785b73-915a-4e98-8374-631b925bcfa0 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:11.258131 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d1785b73-915a-4e98-8374-631b925bcfa0 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:11.258632 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.objects.instance [None req-d1785b73-915a-4e98-8374-631b925bcfa0 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lazy-loading 'fault' on Instance uuid c598f920-d90a-424a-ae96-8ef237f5d234 {{(pid=134101) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 22:25:11.313539 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-d1785b73-915a-4e98-8374-631b925bcfa0 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '524ac46437134cd5a5000574631ea59a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b191bd428a4906b6c2781ae3efdaae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:25:11.322207 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-d1785b73-915a-4e98-8374-631b925bcfa0 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] 10.222.0.43 "GET /compute/v2.1/servers/c598f920-d90a-424a-ae96-8ef237f5d234" status: 200 len: 1327 microversion: 2.1 time: 0.126028 Oct 04 22:25:11.323211 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3424/6374] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:25:11 2022] GET /compute/v2.1/servers/c598f920-d90a-424a-ae96-8ef237f5d234 => generated 1327 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:25:11.596769 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-93e13e20-1c46-4466-ba2a-7281059fbe94 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:25:11.597739 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-93e13e20-1c46-4466-ba2a-7281059fbe94 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: 47aa758b-a866-4254-b7ff-47ed2bd1c87f] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:25:11.604661 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-93e13e20-1c46-4466-ba2a-7281059fbe94 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:11.605164 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-93e13e20-1c46-4466-ba2a-7281059fbe94 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:11.605822 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-93e13e20-1c46-4466-ba2a-7281059fbe94 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:11.606589 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-93e13e20-1c46-4466-ba2a-7281059fbe94 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:11.607071 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-93e13e20-1c46-4466-ba2a-7281059fbe94 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:11.607524 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-93e13e20-1c46-4466-ba2a-7281059fbe94 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:11.747064 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-93e13e20-1c46-4466-ba2a-7281059fbe94 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:25:11.755196 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-93e13e20-1c46-4466-ba2a-7281059fbe94 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/47aa758b-a866-4254-b7ff-47ed2bd1c87f" status: 200 len: 1455 microversion: 2.1 time: 0.162973 Oct 04 22:25:11.755897 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3425/6375] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:25:11 2022] GET /compute/v2.1/servers/47aa758b-a866-4254-b7ff-47ed2bd1c87f => generated 1455 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:25:11.760219 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e1d1e22c-842b-470e-b4e4-9ca8baa9521e tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:25:11.761515 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-e1d1e22c-842b-470e-b4e4-9ca8baa9521e tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] [instance: 90eda454-aef8-4d18-ad76-010e1fecad39] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:25:11.767463 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e1d1e22c-842b-470e-b4e4-9ca8baa9521e tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:11.768148 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e1d1e22c-842b-470e-b4e4-9ca8baa9521e tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:11.768978 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e1d1e22c-842b-470e-b4e4-9ca8baa9521e tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:11.769882 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e1d1e22c-842b-470e-b4e4-9ca8baa9521e tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:11.770385 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e1d1e22c-842b-470e-b4e4-9ca8baa9521e tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:11.770837 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e1d1e22c-842b-470e-b4e4-9ca8baa9521e tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:11.841882 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-e1d1e22c-842b-470e-b4e4-9ca8baa9521e tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76be0b9e8d2946e3a9b159ef8abbd62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7035d5d2f74f649c6184b972b09826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:25:11.850956 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-e1d1e22c-842b-470e-b4e4-9ca8baa9521e tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76be0b9e8d2946e3a9b159ef8abbd62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7035d5d2f74f649c6184b972b09826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:25:11.852436 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-e1d1e22c-842b-470e-b4e4-9ca8baa9521e tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76be0b9e8d2946e3a9b159ef8abbd62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7035d5d2f74f649c6184b972b09826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:25:11.853647 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-e1d1e22c-842b-470e-b4e4-9ca8baa9521e tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] 10.222.0.43 "GET /compute/v2.1/servers/90eda454-aef8-4d18-ad76-010e1fecad39" status: 200 len: 1372 microversion: 2.57 time: 0.096999 Oct 04 22:25:11.854227 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3426/6376] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:25:11 2022] GET /compute/v2.1/servers/90eda454-aef8-4d18-ad76-010e1fecad39 => generated 1372 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:25:11.859290 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-6e29fc68-86e2-4ce4-9e63-493e7ac30318 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:25:11.859919 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-6e29fc68-86e2-4ce4-9e63-493e7ac30318 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: 47aa758b-a866-4254-b7ff-47ed2bd1c87f] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:25:11.866033 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6e29fc68-86e2-4ce4-9e63-493e7ac30318 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:11.866638 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6e29fc68-86e2-4ce4-9e63-493e7ac30318 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:11.867244 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6e29fc68-86e2-4ce4-9e63-493e7ac30318 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:11.867979 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6e29fc68-86e2-4ce4-9e63-493e7ac30318 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:11.868461 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6e29fc68-86e2-4ce4-9e63-493e7ac30318 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:11.868915 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6e29fc68-86e2-4ce4-9e63-493e7ac30318 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:12.010545 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-6e29fc68-86e2-4ce4-9e63-493e7ac30318 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:25:12.019090 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-6e29fc68-86e2-4ce4-9e63-493e7ac30318 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/47aa758b-a866-4254-b7ff-47ed2bd1c87f" status: 200 len: 1455 microversion: 2.1 time: 0.163678 Oct 04 22:25:12.019772 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3427/6377] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:25:11 2022] GET /compute/v2.1/servers/47aa758b-a866-4254-b7ff-47ed2bd1c87f => generated 1455 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:25:12.346124 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-f2172ff2-c054-41f2-9e85-c3554655a82a tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:25:12.346858 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-f2172ff2-c054-41f2-9e85-c3554655a82a tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] [instance: c598f920-d90a-424a-ae96-8ef237f5d234] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:25:12.353342 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f2172ff2-c054-41f2-9e85-c3554655a82a tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:12.353849 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f2172ff2-c054-41f2-9e85-c3554655a82a tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:12.354303 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f2172ff2-c054-41f2-9e85-c3554655a82a tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:12.355652 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f2172ff2-c054-41f2-9e85-c3554655a82a tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:12.356215 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f2172ff2-c054-41f2-9e85-c3554655a82a tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:12.356665 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f2172ff2-c054-41f2-9e85-c3554655a82a tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:12.379482 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-f2172ff2-c054-41f2-9e85-c3554655a82a tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] HTTP exception thrown: Instance c598f920-d90a-424a-ae96-8ef237f5d234 could not be found. Oct 04 22:25:12.381279 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-f2172ff2-c054-41f2-9e85-c3554655a82a tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Request method failure captured: Oct 04 22:25:12.381279 n-d-860284-1 devstack@n-api.service[134101]: request: GET /compute/v2.1/servers/c598f920-d90a-424a-ae96-8ef237f5d234 HTTP/1.1 Oct 04 22:25:12.381279 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 22:25:12.381279 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 22:25:12.381279 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 22:25:12.381279 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 22:25:12.381279 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 22:25:12.381279 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 22:25:12.381279 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 22:25:12.381279 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 22:25:12.381279 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPLEI0e33x1BAHVtdEk1fR_AGHhDj7ypAhStNQ0mk6pmZL8klfatbl9edLPPP1alHHlG1IeVtfP_eKUB_-17p4B4SbQ_djJq4XNUJDFz5GaFf32_GIKk-hb1_UBq69b9JNXVq26HhOX2XS0ZvlfeTf8CicS0jdg7FuxdpVTI2bWjbGrQ Oct 04 22:25:12.381279 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 22:25:12.381279 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 22:25:12.381279 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 22:25:12.381279 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 22:25:12.381279 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 22:25:12.381279 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 22:25:12.381279 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: 33b191bd428a4906b6c2781ae3efdaae Oct 04 22:25:12.381279 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-AttachVolumeTestJSON-2095604563 Oct 04 22:25:12.381279 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 22:25:12.381279 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 22:25:12.381279 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/33b191bd428a4906b6c2781ae3efdaae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_33b191bd428a4906b6c2781ae3efdaae", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/33b191bd428a4906b6c2781ae3efdaae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/33b191bd428a4906b6c2781ae3efdaae"}]}] Oct 04 22:25:12.381279 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-AttachVolumeTestJSON-2095604563 Oct 04 22:25:12.381279 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: 33b191bd428a4906b6c2781ae3efdaae Oct 04 22:25:12.381279 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2095604563 Oct 04 22:25:12.381279 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-AttachVolumeTestJSON-2095604563-project Oct 04 22:25:12.381279 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 22:25:12.381279 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 22:25:12.381279 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 524ac46437134cd5a5000574631ea59a Oct 04 22:25:12.381279 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-AttachVolumeTestJSON-2095604563-project Oct 04 22:25:12.381279 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 22:25:12.381279 n-d-860284-1 devstack@n-api.service[134101]: exception: Instance c598f920-d90a-424a-ae96-8ef237f5d234 could not be found. Oct 04 22:25:12.381279 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': 'c598f920-d90a-424a-ae96-8ef237f5d234'} Oct 04 22:25:12.381279 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:25:12.381279 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:25:12.381279 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:25:12.381279 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:25:12.381279 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:25:12.381279 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:25:12.381279 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:25:12.381279 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:25:12.381279 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:25:12.381279 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:25:12.381279 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c598f920-d90a-424a-ae96-8ef237f5d234 could not be found. Oct 04 22:25:12.381279 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:25:12.381279 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:25:12.381279 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:25:12.381279 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:25:12.381279 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:25:12.381279 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:25:12.381279 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:25:12.381279 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:25:12.381279 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:25:12.381279 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:25:12.381279 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:25:12.381279 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:25:12.381279 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:25:12.381279 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:25:12.381279 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:25:12.381279 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:25:12.381279 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c598f920-d90a-424a-ae96-8ef237f5d234 could not be found. Oct 04 22:25:12.381279 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:25:12.381279 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:25:12.381279 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:25:12.386136 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:25:12.386136 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:25:12.386136 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:25:12.386136 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:25:12.386136 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:25:12.386136 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c598f920-d90a-424a-ae96-8ef237f5d234 could not be found. Oct 04 22:25:12.386136 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:25:12.386136 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-f2172ff2-c054-41f2-9e85-c3554655a82a tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Returning 404 to user: Instance c598f920-d90a-424a-ae96-8ef237f5d234 could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:25:12.386136 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-f2172ff2-c054-41f2-9e85-c3554655a82a tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] 10.222.0.43 "GET /compute/v2.1/servers/c598f920-d90a-424a-ae96-8ef237f5d234" status: 404 len: 111 microversion: 2.1 time: 0.040553 Oct 04 22:25:12.386136 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3428/6378] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:25:12 2022] GET /compute/v2.1/servers/c598f920-d90a-424a-ae96-8ef237f5d234 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 22:25:12.395118 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-2fcf089c-4ce8-4923-9192-71917980ad69 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Calling method '.version_select at 0x7fbb372161f0>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:25:12.415337 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-2fcf089c-4ce8-4923-9192-71917980ad69 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-328661257" status: 202 len: 0 microversion: 2.1 time: 0.023866 Oct 04 22:25:12.415922 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3429/6379] 10.222.0.43 () {58 vars in 1218 bytes} [Tue Oct 4 22:25:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-328661257 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 22:25:12.700399 n-d-860284-1 devstack@n-api.service[134102]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 22:25:12.700399 n-d-860284-1 devstack@n-api.service[134102]: Tue Oct 4 22:25:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.43) !!! Oct 04 22:25:12.880600 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e3fb7433-b867-4723-9ac0-6946cae9de63 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:25:12.881475 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-e3fb7433-b867-4723-9ac0-6946cae9de63 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] [instance: 90eda454-aef8-4d18-ad76-010e1fecad39] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:25:12.890116 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e3fb7433-b867-4723-9ac0-6946cae9de63 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:12.890808 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e3fb7433-b867-4723-9ac0-6946cae9de63 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:12.891606 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e3fb7433-b867-4723-9ac0-6946cae9de63 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:12.892188 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e3fb7433-b867-4723-9ac0-6946cae9de63 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:12.892780 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e3fb7433-b867-4723-9ac0-6946cae9de63 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:12.893318 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e3fb7433-b867-4723-9ac0-6946cae9de63 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:13.019855 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-e3fb7433-b867-4723-9ac0-6946cae9de63 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76be0b9e8d2946e3a9b159ef8abbd62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7035d5d2f74f649c6184b972b09826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:25:13.029868 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-e3fb7433-b867-4723-9ac0-6946cae9de63 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76be0b9e8d2946e3a9b159ef8abbd62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7035d5d2f74f649c6184b972b09826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:25:13.031694 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-e3fb7433-b867-4723-9ac0-6946cae9de63 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76be0b9e8d2946e3a9b159ef8abbd62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7035d5d2f74f649c6184b972b09826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:25:13.032903 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-e3fb7433-b867-4723-9ac0-6946cae9de63 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] 10.222.0.43 "GET /compute/v2.1/servers/90eda454-aef8-4d18-ad76-010e1fecad39" status: 200 len: 1357 microversion: 2.57 time: 0.156400 Oct 04 22:25:13.033478 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3430/6380] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:25:12 2022] GET /compute/v2.1/servers/90eda454-aef8-4d18-ad76-010e1fecad39 => generated 1357 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 22:25:13.065391 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-fe6d1462-84d8-4692-9631-30efe2107d96 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:25:13.065836 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-fe6d1462-84d8-4692-9631-30efe2107d96 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] [instance: 90eda454-aef8-4d18-ad76-010e1fecad39] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:25:13.073827 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fe6d1462-84d8-4692-9631-30efe2107d96 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:13.074355 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fe6d1462-84d8-4692-9631-30efe2107d96 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:13.075628 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fe6d1462-84d8-4692-9631-30efe2107d96 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:13.076401 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fe6d1462-84d8-4692-9631-30efe2107d96 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:13.077721 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fe6d1462-84d8-4692-9631-30efe2107d96 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:13.077721 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fe6d1462-84d8-4692-9631-30efe2107d96 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:13.110023 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-fe6d1462-84d8-4692-9631-30efe2107d96 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] [instance: 90eda454-aef8-4d18-ad76-010e1fecad39] Going to try to terminate instance {{(pid=134101) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 22:25:13.218124 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-fe6d1462-84d8-4692-9631-30efe2107d96 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] 10.222.0.43 "DELETE /compute/v2.1/servers/90eda454-aef8-4d18-ad76-010e1fecad39" status: 204 len: 0 microversion: 2.57 time: 0.156732 Oct 04 22:25:13.222645 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3431/6381] 10.222.0.43 () {60 vars in 1280 bytes} [Tue Oct 4 22:25:13 2022] DELETE /compute/v2.1/servers/90eda454-aef8-4d18-ad76-010e1fecad39 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 04 22:25:13.229722 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-cfbd674a-ced4-4177-8ce9-878df423f6c7 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:25:13.230689 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-cfbd674a-ced4-4177-8ce9-878df423f6c7 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] [instance: 90eda454-aef8-4d18-ad76-010e1fecad39] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:25:13.238733 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cfbd674a-ced4-4177-8ce9-878df423f6c7 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:13.239376 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cfbd674a-ced4-4177-8ce9-878df423f6c7 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:13.240266 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cfbd674a-ced4-4177-8ce9-878df423f6c7 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:13.240852 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cfbd674a-ced4-4177-8ce9-878df423f6c7 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:13.241435 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cfbd674a-ced4-4177-8ce9-878df423f6c7 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:13.242191 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cfbd674a-ced4-4177-8ce9-878df423f6c7 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:13.674743 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-cfbd674a-ced4-4177-8ce9-878df423f6c7 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76be0b9e8d2946e3a9b159ef8abbd62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7035d5d2f74f649c6184b972b09826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:25:13.684315 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-cfbd674a-ced4-4177-8ce9-878df423f6c7 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76be0b9e8d2946e3a9b159ef8abbd62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7035d5d2f74f649c6184b972b09826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:25:13.685792 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-cfbd674a-ced4-4177-8ce9-878df423f6c7 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76be0b9e8d2946e3a9b159ef8abbd62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7035d5d2f74f649c6184b972b09826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:25:13.687227 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-cfbd674a-ced4-4177-8ce9-878df423f6c7 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] 10.222.0.43 "GET /compute/v2.1/servers/90eda454-aef8-4d18-ad76-010e1fecad39" status: 200 len: 1363 microversion: 2.57 time: 0.463583 Oct 04 22:25:13.687787 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3432/6382] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:25:13 2022] GET /compute/v2.1/servers/90eda454-aef8-4d18-ad76-010e1fecad39 => generated 1363 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:25:14.713596 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-d65cd6ad-ecdd-493f-adb9-bc519d80578a tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:25:14.715414 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-d65cd6ad-ecdd-493f-adb9-bc519d80578a tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] [instance: 90eda454-aef8-4d18-ad76-010e1fecad39] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:25:14.722975 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d65cd6ad-ecdd-493f-adb9-bc519d80578a tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:14.723488 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d65cd6ad-ecdd-493f-adb9-bc519d80578a tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:14.723945 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d65cd6ad-ecdd-493f-adb9-bc519d80578a tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:14.724717 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d65cd6ad-ecdd-493f-adb9-bc519d80578a tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:14.725128 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d65cd6ad-ecdd-493f-adb9-bc519d80578a tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:14.725569 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d65cd6ad-ecdd-493f-adb9-bc519d80578a tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:14.806192 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-d65cd6ad-ecdd-493f-adb9-bc519d80578a tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76be0b9e8d2946e3a9b159ef8abbd62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7035d5d2f74f649c6184b972b09826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:25:14.818856 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-d65cd6ad-ecdd-493f-adb9-bc519d80578a tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76be0b9e8d2946e3a9b159ef8abbd62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7035d5d2f74f649c6184b972b09826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:25:14.820708 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-d65cd6ad-ecdd-493f-adb9-bc519d80578a tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76be0b9e8d2946e3a9b159ef8abbd62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7035d5d2f74f649c6184b972b09826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:25:14.822027 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-d65cd6ad-ecdd-493f-adb9-bc519d80578a tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] 10.222.0.43 "GET /compute/v2.1/servers/90eda454-aef8-4d18-ad76-010e1fecad39" status: 200 len: 1363 microversion: 2.57 time: 0.112455 Oct 04 22:25:14.822873 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3433/6383] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:25:14 2022] GET /compute/v2.1/servers/90eda454-aef8-4d18-ad76-010e1fecad39 => generated 1363 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 22:25:14.828746 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-60d8b727-425d-4002-872b-b573e57fbdb2 req-af1f4b08-c2ba-4fc2-b1b9-2de614cc0c72 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47aa758b-a866-4254-b7ff-47ed2bd1c87f", "tag": "8957a848-6a5f-4266-81c3-301fb772023a"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:25:14.841419 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-60d8b727-425d-4002-872b-b573e57fbdb2 req-af1f4b08-c2ba-4fc2-b1b9-2de614cc0c72 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:14.842321 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-60d8b727-425d-4002-872b-b573e57fbdb2 req-af1f4b08-c2ba-4fc2-b1b9-2de614cc0c72 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:14.842994 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-60d8b727-425d-4002-872b-b573e57fbdb2 req-af1f4b08-c2ba-4fc2-b1b9-2de614cc0c72 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:14.855685 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-60d8b727-425d-4002-872b-b573e57fbdb2 req-af1f4b08-c2ba-4fc2-b1b9-2de614cc0c72 service nova] Creating event network-changed:8957a848-6a5f-4266-81c3-301fb772023a for instance 47aa758b-a866-4254-b7ff-47ed2bd1c87f on n-h1-860284-1 Oct 04 22:25:14.861313 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-60d8b727-425d-4002-872b-b573e57fbdb2 req-af1f4b08-c2ba-4fc2-b1b9-2de614cc0c72 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036034 Oct 04 22:25:14.862199 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3434/6384] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:25:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:25:15.849609 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-695518b6-28e0-43d4-90f7-ffffd39b27f8 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:25:15.851090 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-695518b6-28e0-43d4-90f7-ffffd39b27f8 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] [instance: 90eda454-aef8-4d18-ad76-010e1fecad39] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:25:15.858887 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-695518b6-28e0-43d4-90f7-ffffd39b27f8 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:15.859640 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-695518b6-28e0-43d4-90f7-ffffd39b27f8 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:15.860270 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-695518b6-28e0-43d4-90f7-ffffd39b27f8 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:15.861156 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-695518b6-28e0-43d4-90f7-ffffd39b27f8 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:15.861795 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-695518b6-28e0-43d4-90f7-ffffd39b27f8 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:15.862421 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-695518b6-28e0-43d4-90f7-ffffd39b27f8 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:15.877242 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-695518b6-28e0-43d4-90f7-ffffd39b27f8 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] HTTP exception thrown: Instance 90eda454-aef8-4d18-ad76-010e1fecad39 could not be found. Oct 04 22:25:15.879246 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-695518b6-28e0-43d4-90f7-ffffd39b27f8 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Request method failure captured: Oct 04 22:25:15.879246 n-d-860284-1 devstack@n-api.service[134101]: request: GET /compute/v2.1/servers/90eda454-aef8-4d18-ad76-010e1fecad39 HTTP/1.1 Oct 04 22:25:15.879246 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 22:25:15.879246 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 22:25:15.879246 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 22:25:15.879246 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 22:25:15.879246 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 22:25:15.879246 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 22:25:15.879246 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 22:25:15.879246 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 22:25:15.879246 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPLKeeovCHWGqGAqXgSg7p9S5GSL0_AT6RXOiCFKMGGWDEDwiWT6k98qUEq8kLdEkzZNSx1Xxn_n8kDczJtRngO7o70s6gKdRtQz3vQnmw5qx3KxaTweZJgar-k_GBdpEzaAgh3FOKI-U69u99FTpZLcsRE9LRC3OtXSLqhoikdkhnZU Oct 04 22:25:15.879246 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 22:25:15.879246 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 22:25:15.879246 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 22:25:15.879246 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 22:25:15.879246 n-d-860284-1 devstack@n-api.service[134101]: X-Openstack-Nova-Api-Version: 2.57 Oct 04 22:25:15.879246 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 22:25:15.879246 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 22:25:15.879246 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: 5a7035d5d2f74f649c6184b972b09826 Oct 04 22:25:15.879246 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-ServerShowV257Test-826927847 Oct 04 22:25:15.879246 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 22:25:15.879246 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 22:25:15.879246 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5a7035d5d2f74f649c6184b972b09826"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_5a7035d5d2f74f649c6184b972b09826", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5a7035d5d2f74f649c6184b972b09826"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/5a7035d5d2f74f649c6184b972b09826"}]}] Oct 04 22:25:15.879246 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-ServerShowV257Test-826927847 Oct 04 22:25:15.879246 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: 5a7035d5d2f74f649c6184b972b09826 Oct 04 22:25:15.879246 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-ServerShowV257Test-826927847 Oct 04 22:25:15.879246 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-ServerShowV257Test-826927847-project Oct 04 22:25:15.879246 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 22:25:15.879246 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 22:25:15.879246 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 76be0b9e8d2946e3a9b159ef8abbd62e Oct 04 22:25:15.879246 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-ServerShowV257Test-826927847-project Oct 04 22:25:15.879246 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 22:25:15.879246 n-d-860284-1 devstack@n-api.service[134101]: exception: Instance 90eda454-aef8-4d18-ad76-010e1fecad39 could not be found. Oct 04 22:25:15.879246 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': '90eda454-aef8-4d18-ad76-010e1fecad39'} Oct 04 22:25:15.879246 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:25:15.879246 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:25:15.879246 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:25:15.879246 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:25:15.879246 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:25:15.879246 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:25:15.879246 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:25:15.879246 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:25:15.879246 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:25:15.879246 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:25:15.879246 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90eda454-aef8-4d18-ad76-010e1fecad39 could not be found. Oct 04 22:25:15.879246 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:25:15.879246 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:25:15.879246 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:25:15.879246 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:25:15.879246 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:25:15.879246 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:25:15.879246 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:25:15.879246 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:25:15.879246 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:25:15.879246 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:25:15.879246 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:25:15.879246 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:25:15.879246 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:25:15.879246 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:25:15.879246 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:25:15.879246 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:25:15.879246 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90eda454-aef8-4d18-ad76-010e1fecad39 could not be found. Oct 04 22:25:15.879246 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:25:15.879246 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:25:15.879246 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:25:15.883992 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:25:15.883992 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:25:15.883992 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:25:15.883992 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:25:15.883992 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:25:15.883992 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90eda454-aef8-4d18-ad76-010e1fecad39 could not be found. Oct 04 22:25:15.883992 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:25:15.885218 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-695518b6-28e0-43d4-90f7-ffffd39b27f8 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] Returning 404 to user: Instance 90eda454-aef8-4d18-ad76-010e1fecad39 could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:25:15.886688 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-695518b6-28e0-43d4-90f7-ffffd39b27f8 tempest-ServerShowV257Test-826927847 tempest-ServerShowV257Test-826927847-project] 10.222.0.43 "GET /compute/v2.1/servers/90eda454-aef8-4d18-ad76-010e1fecad39" status: 404 len: 111 microversion: 2.57 time: 0.041340 Oct 04 22:25:15.890670 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3435/6385] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:25:15 2022] GET /compute/v2.1/servers/90eda454-aef8-4d18-ad76-010e1fecad39 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 04 22:25:20.617920 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-86b0f178-5a8e-4d90-9e33-c29f4d2bcf3e tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:25:20.619250 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-86b0f178-5a8e-4d90-9e33-c29f4d2bcf3e tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] [instance: c598f920-d90a-424a-ae96-8ef237f5d234] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:25:20.629626 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-86b0f178-5a8e-4d90-9e33-c29f4d2bcf3e tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:20.630560 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-86b0f178-5a8e-4d90-9e33-c29f4d2bcf3e tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:20.631251 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-86b0f178-5a8e-4d90-9e33-c29f4d2bcf3e tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:20.632300 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-86b0f178-5a8e-4d90-9e33-c29f4d2bcf3e tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:20.633008 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-86b0f178-5a8e-4d90-9e33-c29f4d2bcf3e tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:20.633671 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-86b0f178-5a8e-4d90-9e33-c29f4d2bcf3e tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:20.667879 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-86b0f178-5a8e-4d90-9e33-c29f4d2bcf3e tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] HTTP exception thrown: Instance c598f920-d90a-424a-ae96-8ef237f5d234 could not be found. Oct 04 22:25:20.670448 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-86b0f178-5a8e-4d90-9e33-c29f4d2bcf3e tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Request method failure captured: Oct 04 22:25:20.670448 n-d-860284-1 devstack@n-api.service[134101]: request: DELETE /compute/v2.1/servers/c598f920-d90a-424a-ae96-8ef237f5d234 HTTP/1.1 Oct 04 22:25:20.670448 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 22:25:20.670448 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 22:25:20.670448 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 22:25:20.670448 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 22:25:20.670448 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 22:25:20.670448 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 22:25:20.670448 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 22:25:20.670448 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 22:25:20.670448 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPLEI0e33x1BAHVtdEk1fR_AGHhDj7ypAhStNQ0mk6pmZL8klfatbl9edLPPP1alHHlG1IeVtfP_eKUB_-17p4B4SbQ_djJq4XNUJDFz5GaFf32_GIKk-hb1_UBq69b9JNXVq26HhOX2XS0ZvlfeTf8CicS0jdg7FuxdpVTI2bWjbGrQ Oct 04 22:25:20.670448 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 22:25:20.670448 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 22:25:20.670448 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 22:25:20.670448 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 22:25:20.670448 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 22:25:20.670448 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 22:25:20.670448 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: 33b191bd428a4906b6c2781ae3efdaae Oct 04 22:25:20.670448 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-AttachVolumeTestJSON-2095604563 Oct 04 22:25:20.670448 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 22:25:20.670448 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 22:25:20.670448 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/33b191bd428a4906b6c2781ae3efdaae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_33b191bd428a4906b6c2781ae3efdaae", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/33b191bd428a4906b6c2781ae3efdaae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/33b191bd428a4906b6c2781ae3efdaae"}]}] Oct 04 22:25:20.670448 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-AttachVolumeTestJSON-2095604563 Oct 04 22:25:20.670448 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: 33b191bd428a4906b6c2781ae3efdaae Oct 04 22:25:20.670448 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2095604563 Oct 04 22:25:20.670448 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-AttachVolumeTestJSON-2095604563-project Oct 04 22:25:20.670448 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 22:25:20.670448 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 22:25:20.670448 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 524ac46437134cd5a5000574631ea59a Oct 04 22:25:20.670448 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-AttachVolumeTestJSON-2095604563-project Oct 04 22:25:20.670448 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 22:25:20.670448 n-d-860284-1 devstack@n-api.service[134101]: exception: Instance c598f920-d90a-424a-ae96-8ef237f5d234 could not be found. Oct 04 22:25:20.670448 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': 'c598f920-d90a-424a-ae96-8ef237f5d234'} Oct 04 22:25:20.670448 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:25:20.670448 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:25:20.670448 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:25:20.670448 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:25:20.670448 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:25:20.670448 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:25:20.670448 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:25:20.670448 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:25:20.670448 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:25:20.670448 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:25:20.670448 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c598f920-d90a-424a-ae96-8ef237f5d234 could not be found. Oct 04 22:25:20.670448 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:25:20.670448 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:25:20.670448 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:25:20.670448 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:25:20.670448 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:25:20.670448 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:25:20.670448 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:25:20.670448 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:25:20.670448 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:25:20.670448 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:25:20.670448 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 22:25:20.670448 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 22:25:20.670448 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 22:25:20.670448 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 22:25:20.670448 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:25:20.670448 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:25:20.670448 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:25:20.670448 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:25:20.674214 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c598f920-d90a-424a-ae96-8ef237f5d234 could not be found. Oct 04 22:25:20.674214 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:25:20.674214 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:25:20.674214 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:25:20.674214 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:25:20.674214 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:25:20.674214 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:25:20.674214 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:25:20.674214 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:25:20.674214 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c598f920-d90a-424a-ae96-8ef237f5d234 could not be found. Oct 04 22:25:20.674214 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:25:20.677984 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-86b0f178-5a8e-4d90-9e33-c29f4d2bcf3e tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Returning 404 to user: Instance c598f920-d90a-424a-ae96-8ef237f5d234 could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:25:20.679736 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-86b0f178-5a8e-4d90-9e33-c29f4d2bcf3e tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] 10.222.0.43 "DELETE /compute/v2.1/servers/c598f920-d90a-424a-ae96-8ef237f5d234" status: 404 len: 111 microversion: 2.1 time: 0.066038 Oct 04 22:25:20.684127 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3436/6386] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 22:25:20 2022] DELETE /compute/v2.1/servers/c598f920-d90a-424a-ae96-8ef237f5d234 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:25:20.689988 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-be5ba0f8-1556-4c21-bfbc-4437d37527d7 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:25:20.690970 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-be5ba0f8-1556-4c21-bfbc-4437d37527d7 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] [instance: c598f920-d90a-424a-ae96-8ef237f5d234] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:25:20.698443 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-be5ba0f8-1556-4c21-bfbc-4437d37527d7 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:20.699265 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-be5ba0f8-1556-4c21-bfbc-4437d37527d7 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:20.700609 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-be5ba0f8-1556-4c21-bfbc-4437d37527d7 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:20.701561 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-be5ba0f8-1556-4c21-bfbc-4437d37527d7 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:20.702250 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-be5ba0f8-1556-4c21-bfbc-4437d37527d7 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:20.702939 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-be5ba0f8-1556-4c21-bfbc-4437d37527d7 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:20.724802 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-be5ba0f8-1556-4c21-bfbc-4437d37527d7 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] HTTP exception thrown: Instance c598f920-d90a-424a-ae96-8ef237f5d234 could not be found. Oct 04 22:25:20.727580 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-be5ba0f8-1556-4c21-bfbc-4437d37527d7 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Request method failure captured: Oct 04 22:25:20.727580 n-d-860284-1 devstack@n-api.service[134101]: request: GET /compute/v2.1/servers/c598f920-d90a-424a-ae96-8ef237f5d234 HTTP/1.1 Oct 04 22:25:20.727580 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 22:25:20.727580 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 22:25:20.727580 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 22:25:20.727580 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 22:25:20.727580 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 22:25:20.727580 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 22:25:20.727580 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 22:25:20.727580 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 22:25:20.727580 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPLEI0e33x1BAHVtdEk1fR_AGHhDj7ypAhStNQ0mk6pmZL8klfatbl9edLPPP1alHHlG1IeVtfP_eKUB_-17p4B4SbQ_djJq4XNUJDFz5GaFf32_GIKk-hb1_UBq69b9JNXVq26HhOX2XS0ZvlfeTf8CicS0jdg7FuxdpVTI2bWjbGrQ Oct 04 22:25:20.727580 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 22:25:20.727580 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 22:25:20.727580 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 22:25:20.727580 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 22:25:20.727580 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 22:25:20.727580 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 22:25:20.727580 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: 33b191bd428a4906b6c2781ae3efdaae Oct 04 22:25:20.727580 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-AttachVolumeTestJSON-2095604563 Oct 04 22:25:20.727580 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 22:25:20.727580 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 22:25:20.727580 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/33b191bd428a4906b6c2781ae3efdaae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_33b191bd428a4906b6c2781ae3efdaae", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/33b191bd428a4906b6c2781ae3efdaae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/33b191bd428a4906b6c2781ae3efdaae"}]}] Oct 04 22:25:20.727580 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-AttachVolumeTestJSON-2095604563 Oct 04 22:25:20.727580 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: 33b191bd428a4906b6c2781ae3efdaae Oct 04 22:25:20.727580 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2095604563 Oct 04 22:25:20.727580 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-AttachVolumeTestJSON-2095604563-project Oct 04 22:25:20.727580 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 22:25:20.727580 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 22:25:20.727580 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 524ac46437134cd5a5000574631ea59a Oct 04 22:25:20.727580 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-AttachVolumeTestJSON-2095604563-project Oct 04 22:25:20.727580 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 22:25:20.727580 n-d-860284-1 devstack@n-api.service[134101]: exception: Instance c598f920-d90a-424a-ae96-8ef237f5d234 could not be found. Oct 04 22:25:20.727580 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': 'c598f920-d90a-424a-ae96-8ef237f5d234'} Oct 04 22:25:20.727580 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:25:20.727580 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:25:20.727580 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:25:20.727580 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:25:20.727580 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:25:20.727580 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:25:20.727580 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:25:20.727580 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:25:20.727580 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:25:20.727580 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:25:20.727580 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c598f920-d90a-424a-ae96-8ef237f5d234 could not be found. Oct 04 22:25:20.727580 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:25:20.727580 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:25:20.727580 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:25:20.727580 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:25:20.727580 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:25:20.727580 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:25:20.727580 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:25:20.727580 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:25:20.727580 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:25:20.727580 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:25:20.727580 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:25:20.727580 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:25:20.727580 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:25:20.727580 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:25:20.727580 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:25:20.727580 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:25:20.727580 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c598f920-d90a-424a-ae96-8ef237f5d234 could not be found. Oct 04 22:25:20.727580 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:25:20.727580 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:25:20.727580 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:25:20.732487 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:25:20.732487 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:25:20.732487 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:25:20.732487 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:25:20.732487 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:25:20.732487 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c598f920-d90a-424a-ae96-8ef237f5d234 could not be found. Oct 04 22:25:20.732487 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:25:20.732487 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-be5ba0f8-1556-4c21-bfbc-4437d37527d7 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Returning 404 to user: Instance c598f920-d90a-424a-ae96-8ef237f5d234 could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:25:20.732487 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-be5ba0f8-1556-4c21-bfbc-4437d37527d7 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] 10.222.0.43 "GET /compute/v2.1/servers/c598f920-d90a-424a-ae96-8ef237f5d234" status: 404 len: 111 microversion: 2.1 time: 0.044697 Oct 04 22:25:20.732487 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3437/6387] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:25:20 2022] GET /compute/v2.1/servers/c598f920-d90a-424a-ae96-8ef237f5d234 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:25:22.879991 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-14dc0da9-8b72-47b3-996a-b06a21ef6b2a tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Action: 'create', calling method: .version_select at 0x7fbb2e303b80>, body: {"keypair": {"name": "tempest-keypair-966837515", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOjBiVEoMBjqH4E/wheNmgGjLLqshdY69czQ34EKt+g8qne1t4eKIftjnipyC3jFw1oj/KJIdMsf2DSCGRNmn2l95bNsXOIy3qXX0pmCPRMRxaWJtigMJCDQ5/f4gJSYCQ=="}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:25:22.897404 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-14dc0da9-8b72-47b3-996a-b06a21ef6b2a tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Getting quotas for project 5031651f5e9a433e859e0038af1cb16d. Resources: {'key_pairs'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:25:22.904637 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-14dc0da9-8b72-47b3-996a-b06a21ef6b2a tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Getting quotas for user 97dec2a1a8bc435c9480f89802614cb2 and project 5031651f5e9a433e859e0038af1cb16d. Resources: {'key_pairs'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:25:22.931420 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-14dc0da9-8b72-47b3-996a-b06a21ef6b2a tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.189765 Oct 04 22:25:22.938432 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3438/6388] 10.222.0.43 () {62 vars in 1200 bytes} [Tue Oct 4 22:25:22 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 191 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Oct 04 22:25:24.368895 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-6f72d748-4889-4b53-8cb1-65b6e8c66408 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-464470378", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "67ed6136-9d47-4215-af7c-870ef1839c45"}], "security_groups": [{"name": "tempest-securitygroup--398426979"}], "key_name": "tempest-keypair-966837515", "user_data": "}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:25:24.492534 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.network.neutron [None req-6f72d748-4889-4b53-8cb1-65b6e8c66408 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] validate_networks() for [('67ed6136-9d47-4215-af7c-870ef1839c45', None, None, None, None, None)] {{(pid=134101) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 22:25:24.913537 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-6f72d748-4889-4b53-8cb1-65b6e8c66408 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Flavor limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 22:25:24.913985 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-6f72d748-4889-4b53-8cb1-65b6e8c66408 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Image limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 22:25:24.914513 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-6f72d748-4889-4b53-8cb1-65b6e8c66408 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Flavor pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 22:25:24.914944 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-6f72d748-4889-4b53-8cb1-65b6e8c66408 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Image pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 22:25:24.915553 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-6f72d748-4889-4b53-8cb1-65b6e8c66408 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 22:25:24.924656 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6f72d748-4889-4b53-8cb1-65b6e8c66408 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:24.925165 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6f72d748-4889-4b53-8cb1-65b6e8c66408 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:24.925622 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6f72d748-4889-4b53-8cb1-65b6e8c66408 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:24.926613 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6f72d748-4889-4b53-8cb1-65b6e8c66408 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:24.927200 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6f72d748-4889-4b53-8cb1-65b6e8c66408 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:24.927657 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6f72d748-4889-4b53-8cb1-65b6e8c66408 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:24.945671 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-6f72d748-4889-4b53-8cb1-65b6e8c66408 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Getting quotas for project 5031651f5e9a433e859e0038af1cb16d. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:25:24.951976 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-6f72d748-4889-4b53-8cb1-65b6e8c66408 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Getting quotas for user 97dec2a1a8bc435c9480f89802614cb2 and project 5031651f5e9a433e859e0038af1cb16d. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:25:24.965445 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-6f72d748-4889-4b53-8cb1-65b6e8c66408 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Going to run 1 instances... {{(pid=134101) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 22:25:24.968012 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-6f72d748-4889-4b53-8cb1-65b6e8c66408 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] [instance: 0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='58548514-5dac-426c-81f5-19e3fba33e23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134101) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 22:25:25.020906 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-6f72d748-4889-4b53-8cb1-65b6e8c66408 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.656451 Oct 04 22:25:25.022182 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3439/6389] 10.222.0.43 () {62 vars in 1188 bytes} [Tue Oct 4 22:25:24 2022] POST /compute/v2.1/servers => generated 401 bytes in 658 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 04 22:25:25.035547 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-49c860d9-ec95-45a9-9dd7-ae9f0563ffbc tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:25:25.036821 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-49c860d9-ec95-45a9-9dd7-ae9f0563ffbc tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] [instance: 0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:25:25.129562 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-49c860d9-ec95-45a9-9dd7-ae9f0563ffbc tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:25:25.147282 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-49c860d9-ec95-45a9-9dd7-ae9f0563ffbc tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:25:25.148773 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-49c860d9-ec95-45a9-9dd7-ae9f0563ffbc tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:25:25.149931 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-49c860d9-ec95-45a9-9dd7-ae9f0563ffbc tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] 10.222.0.43 "GET /compute/v2.1/servers/0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc" status: 200 len: 1280 microversion: 2.20 time: 0.119595 Oct 04 22:25:25.157462 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3440/6390] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:25:25 2022] GET /compute/v2.1/servers/0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc => generated 1280 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:25:25.175793 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-55df2955-8e8f-4870-b8ca-c95ffa1fb015 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:25:25.176313 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-55df2955-8e8f-4870-b8ca-c95ffa1fb015 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] [instance: 01f84e19-7e4a-460a-bb60-5da518f3d8b1] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:25:25.184173 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-55df2955-8e8f-4870-b8ca-c95ffa1fb015 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:25.184728 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-55df2955-8e8f-4870-b8ca-c95ffa1fb015 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:25.185182 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-55df2955-8e8f-4870-b8ca-c95ffa1fb015 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:25.185923 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-55df2955-8e8f-4870-b8ca-c95ffa1fb015 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:25.186413 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-55df2955-8e8f-4870-b8ca-c95ffa1fb015 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:25.186859 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-55df2955-8e8f-4870-b8ca-c95ffa1fb015 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:25.204449 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:25:25.206189 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-55df2955-8e8f-4870-b8ca-c95ffa1fb015 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] HTTP exception thrown: Instance 01f84e19-7e4a-460a-bb60-5da518f3d8b1 could not be found. Oct 04 22:25:25.208011 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-55df2955-8e8f-4870-b8ca-c95ffa1fb015 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Request method failure captured: Oct 04 22:25:25.208011 n-d-860284-1 devstack@n-api.service[134101]: request: DELETE /compute/v2.1/servers/01f84e19-7e4a-460a-bb60-5da518f3d8b1 HTTP/1.1 Oct 04 22:25:25.208011 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 22:25:25.208011 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 22:25:25.208011 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 22:25:25.208011 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 22:25:25.208011 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 22:25:25.208011 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 22:25:25.208011 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 22:25:25.208011 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 22:25:25.208011 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPLEI0e33x1BAHVtdEk1fR_AGHhDj7ypAhStNQ0mk6pmZL8klfatbl9edLPPP1alHHlG1IeVtfP_eKUB_-17p4B4SbQ_djJq4XNUJDFz5GaFf32_GIKk-hb1_UBq69b9JNXVq26HhOX2XS0ZvlfeTf8CicS0jdg7FuxdpVTI2bWjbGrQ Oct 04 22:25:25.208011 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 22:25:25.208011 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 22:25:25.208011 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 22:25:25.208011 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 22:25:25.208011 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 22:25:25.208011 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 22:25:25.208011 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: 33b191bd428a4906b6c2781ae3efdaae Oct 04 22:25:25.208011 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-AttachVolumeTestJSON-2095604563 Oct 04 22:25:25.208011 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 22:25:25.208011 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 22:25:25.208011 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/33b191bd428a4906b6c2781ae3efdaae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_33b191bd428a4906b6c2781ae3efdaae", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/33b191bd428a4906b6c2781ae3efdaae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/33b191bd428a4906b6c2781ae3efdaae"}]}] Oct 04 22:25:25.208011 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-AttachVolumeTestJSON-2095604563 Oct 04 22:25:25.208011 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: 33b191bd428a4906b6c2781ae3efdaae Oct 04 22:25:25.208011 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2095604563 Oct 04 22:25:25.208011 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-AttachVolumeTestJSON-2095604563-project Oct 04 22:25:25.208011 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 22:25:25.208011 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 22:25:25.208011 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 524ac46437134cd5a5000574631ea59a Oct 04 22:25:25.208011 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-AttachVolumeTestJSON-2095604563-project Oct 04 22:25:25.208011 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 22:25:25.208011 n-d-860284-1 devstack@n-api.service[134101]: exception: Instance 01f84e19-7e4a-460a-bb60-5da518f3d8b1 could not be found. Oct 04 22:25:25.208011 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': '01f84e19-7e4a-460a-bb60-5da518f3d8b1'} Oct 04 22:25:25.208011 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:25:25.208011 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:25:25.208011 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:25:25.208011 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:25:25.208011 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:25:25.208011 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:25:25.208011 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:25:25.208011 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:25:25.208011 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:25:25.208011 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:25:25.208011 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01f84e19-7e4a-460a-bb60-5da518f3d8b1 could not be found. Oct 04 22:25:25.208011 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:25:25.208011 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:25:25.208011 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:25:25.208011 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:25:25.208011 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:25:25.208011 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:25:25.208011 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:25:25.208011 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:25:25.208011 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:25:25.208011 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:25:25.208011 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 22:25:25.208011 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 22:25:25.208011 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 22:25:25.208011 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 22:25:25.208011 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:25:25.208011 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:25:25.208011 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:25:25.208011 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:25:25.214684 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01f84e19-7e4a-460a-bb60-5da518f3d8b1 could not be found. Oct 04 22:25:25.214684 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:25:25.214684 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:25:25.214684 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:25:25.214684 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:25:25.214684 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:25:25.214684 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:25:25.214684 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:25:25.214684 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:25:25.214684 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01f84e19-7e4a-460a-bb60-5da518f3d8b1 could not be found. Oct 04 22:25:25.214684 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:25:25.214684 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-55df2955-8e8f-4870-b8ca-c95ffa1fb015 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Returning 404 to user: Instance 01f84e19-7e4a-460a-bb60-5da518f3d8b1 could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:25:25.214684 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-55df2955-8e8f-4870-b8ca-c95ffa1fb015 tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] 10.222.0.43 "DELETE /compute/v2.1/servers/01f84e19-7e4a-460a-bb60-5da518f3d8b1" status: 404 len: 111 microversion: 2.1 time: 0.038617 Oct 04 22:25:25.214684 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3441/6391] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 22:25:25 2022] DELETE /compute/v2.1/servers/01f84e19-7e4a-460a-bb60-5da518f3d8b1 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 22:25:25.221037 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-6a17a782-5d84-4bac-b152-5080f17d57fc tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:25:25.221673 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-6a17a782-5d84-4bac-b152-5080f17d57fc tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] [instance: 01f84e19-7e4a-460a-bb60-5da518f3d8b1] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:25:25.228111 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:UPDATE=2,nova_api:SELECT=93,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:25:25.234616 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6a17a782-5d84-4bac-b152-5080f17d57fc tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:25.235395 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6a17a782-5d84-4bac-b152-5080f17d57fc tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:25.236014 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6a17a782-5d84-4bac-b152-5080f17d57fc tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:25.236922 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6a17a782-5d84-4bac-b152-5080f17d57fc tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:25.237553 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6a17a782-5d84-4bac-b152-5080f17d57fc tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:25.238142 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6a17a782-5d84-4bac-b152-5080f17d57fc tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:25.258090 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-6a17a782-5d84-4bac-b152-5080f17d57fc tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] HTTP exception thrown: Instance 01f84e19-7e4a-460a-bb60-5da518f3d8b1 could not be found. Oct 04 22:25:25.260634 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-6a17a782-5d84-4bac-b152-5080f17d57fc tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Request method failure captured: Oct 04 22:25:25.260634 n-d-860284-1 devstack@n-api.service[134101]: request: GET /compute/v2.1/servers/01f84e19-7e4a-460a-bb60-5da518f3d8b1 HTTP/1.1 Oct 04 22:25:25.260634 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 22:25:25.260634 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 22:25:25.260634 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 22:25:25.260634 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 22:25:25.260634 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 22:25:25.260634 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 22:25:25.260634 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 22:25:25.260634 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 22:25:25.260634 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPLEI0e33x1BAHVtdEk1fR_AGHhDj7ypAhStNQ0mk6pmZL8klfatbl9edLPPP1alHHlG1IeVtfP_eKUB_-17p4B4SbQ_djJq4XNUJDFz5GaFf32_GIKk-hb1_UBq69b9JNXVq26HhOX2XS0ZvlfeTf8CicS0jdg7FuxdpVTI2bWjbGrQ Oct 04 22:25:25.260634 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 22:25:25.260634 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 22:25:25.260634 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 22:25:25.260634 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 22:25:25.260634 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 22:25:25.260634 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 22:25:25.260634 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: 33b191bd428a4906b6c2781ae3efdaae Oct 04 22:25:25.260634 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-AttachVolumeTestJSON-2095604563 Oct 04 22:25:25.260634 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 22:25:25.260634 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 22:25:25.260634 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/33b191bd428a4906b6c2781ae3efdaae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_33b191bd428a4906b6c2781ae3efdaae", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/33b191bd428a4906b6c2781ae3efdaae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/33b191bd428a4906b6c2781ae3efdaae"}]}] Oct 04 22:25:25.260634 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-AttachVolumeTestJSON-2095604563 Oct 04 22:25:25.260634 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: 33b191bd428a4906b6c2781ae3efdaae Oct 04 22:25:25.260634 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2095604563 Oct 04 22:25:25.260634 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-AttachVolumeTestJSON-2095604563-project Oct 04 22:25:25.260634 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 22:25:25.260634 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 22:25:25.260634 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 524ac46437134cd5a5000574631ea59a Oct 04 22:25:25.260634 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-AttachVolumeTestJSON-2095604563-project Oct 04 22:25:25.260634 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 22:25:25.260634 n-d-860284-1 devstack@n-api.service[134101]: exception: Instance 01f84e19-7e4a-460a-bb60-5da518f3d8b1 could not be found. Oct 04 22:25:25.260634 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': '01f84e19-7e4a-460a-bb60-5da518f3d8b1'} Oct 04 22:25:25.260634 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:25:25.260634 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:25:25.260634 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:25:25.260634 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:25:25.260634 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:25:25.260634 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:25:25.260634 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:25:25.260634 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:25:25.260634 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:25:25.260634 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:25:25.260634 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01f84e19-7e4a-460a-bb60-5da518f3d8b1 could not be found. Oct 04 22:25:25.260634 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:25:25.260634 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:25:25.260634 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:25:25.260634 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:25:25.260634 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:25:25.260634 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:25:25.260634 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:25:25.260634 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:25:25.260634 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:25:25.260634 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:25:25.260634 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:25:25.260634 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:25:25.260634 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:25:25.260634 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:25:25.260634 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:25:25.260634 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:25:25.260634 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01f84e19-7e4a-460a-bb60-5da518f3d8b1 could not be found. Oct 04 22:25:25.260634 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:25:25.260634 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:25:25.260634 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:25:25.264861 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:25:25.264861 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:25:25.264861 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:25:25.264861 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:25:25.264861 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:25:25.264861 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01f84e19-7e4a-460a-bb60-5da518f3d8b1 could not be found. Oct 04 22:25:25.264861 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:25:25.266523 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-6a17a782-5d84-4bac-b152-5080f17d57fc tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] Returning 404 to user: Instance 01f84e19-7e4a-460a-bb60-5da518f3d8b1 could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:25:25.267587 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-6a17a782-5d84-4bac-b152-5080f17d57fc tempest-AttachVolumeTestJSON-2095604563 tempest-AttachVolumeTestJSON-2095604563-project] 10.222.0.43 "GET /compute/v2.1/servers/01f84e19-7e4a-460a-bb60-5da518f3d8b1" status: 404 len: 111 microversion: 2.1 time: 0.051996 Oct 04 22:25:25.268319 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3442/6392] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:25:25 2022] GET /compute/v2.1/servers/01f84e19-7e4a-460a-bb60-5da518f3d8b1 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:25:26.187221 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-4e39f290-0c14-4406-966c-2bc9a1035c01 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:25:26.187863 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-4e39f290-0c14-4406-966c-2bc9a1035c01 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] [instance: 0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:25:26.195520 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4e39f290-0c14-4406-966c-2bc9a1035c01 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:26.196214 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4e39f290-0c14-4406-966c-2bc9a1035c01 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:26.197148 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4e39f290-0c14-4406-966c-2bc9a1035c01 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:26.198441 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4e39f290-0c14-4406-966c-2bc9a1035c01 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:26.199146 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4e39f290-0c14-4406-966c-2bc9a1035c01 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:26.199747 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4e39f290-0c14-4406-966c-2bc9a1035c01 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:26.297441 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-4e39f290-0c14-4406-966c-2bc9a1035c01 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:25:26.306755 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-4e39f290-0c14-4406-966c-2bc9a1035c01 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:25:26.308375 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-4e39f290-0c14-4406-966c-2bc9a1035c01 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:25:26.309854 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-4e39f290-0c14-4406-966c-2bc9a1035c01 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] 10.222.0.43 "GET /compute/v2.1/servers/0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc" status: 200 len: 1332 microversion: 2.20 time: 0.127347 Oct 04 22:25:26.310857 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3443/6393] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:25:26 2022] GET /compute/v2.1/servers/0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc => generated 1332 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 22:25:27.340869 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-c2d7c949-27fb-4079-bd62-ac87f98f3797 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:25:27.341630 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-c2d7c949-27fb-4079-bd62-ac87f98f3797 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] [instance: 0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:25:27.352683 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c2d7c949-27fb-4079-bd62-ac87f98f3797 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:27.354425 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c2d7c949-27fb-4079-bd62-ac87f98f3797 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:27.355258 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c2d7c949-27fb-4079-bd62-ac87f98f3797 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:27.359854 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c2d7c949-27fb-4079-bd62-ac87f98f3797 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:27.360404 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c2d7c949-27fb-4079-bd62-ac87f98f3797 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:27.360889 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c2d7c949-27fb-4079-bd62-ac87f98f3797 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:27.680392 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-c2d7c949-27fb-4079-bd62-ac87f98f3797 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:25:27.695059 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-c2d7c949-27fb-4079-bd62-ac87f98f3797 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:25:27.698585 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-c2d7c949-27fb-4079-bd62-ac87f98f3797 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:25:27.701774 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-c2d7c949-27fb-4079-bd62-ac87f98f3797 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] 10.222.0.43 "GET /compute/v2.1/servers/0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc" status: 200 len: 1405 microversion: 2.20 time: 0.365105 Oct 04 22:25:27.703024 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3444/6394] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:25:27 2022] GET /compute/v2.1/servers/0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc => generated 1405 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:25:28.864265 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-262dcfb2-b6e6-4c1e-a5a5-6839cff3d6b1 req-875cc27e-a4b9-443f-945a-88547a5a47c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc", "tag": "92737fc4-3618-4a96-a0a0-09038568173c"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:25:28.886114 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-262dcfb2-b6e6-4c1e-a5a5-6839cff3d6b1 req-875cc27e-a4b9-443f-945a-88547a5a47c3 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:28.887012 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-262dcfb2-b6e6-4c1e-a5a5-6839cff3d6b1 req-875cc27e-a4b9-443f-945a-88547a5a47c3 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:28.887618 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-262dcfb2-b6e6-4c1e-a5a5-6839cff3d6b1 req-875cc27e-a4b9-443f-945a-88547a5a47c3 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:28.908827 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-262dcfb2-b6e6-4c1e-a5a5-6839cff3d6b1 req-875cc27e-a4b9-443f-945a-88547a5a47c3 service nova] Creating event network-changed:92737fc4-3618-4a96-a0a0-09038568173c for instance 0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc on n-h2-860284-1 Oct 04 22:25:28.917219 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-262dcfb2-b6e6-4c1e-a5a5-6839cff3d6b1 req-875cc27e-a4b9-443f-945a-88547a5a47c3 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.238925 Oct 04 22:25:28.918732 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3445/6395] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:25:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:25:28.927096 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-91724c00-a4ff-4c20-bebf-cf1773be924f tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:25:28.928942 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-91724c00-a4ff-4c20-bebf-cf1773be924f tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] [instance: 0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:25:28.940887 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-91724c00-a4ff-4c20-bebf-cf1773be924f tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:28.941394 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-91724c00-a4ff-4c20-bebf-cf1773be924f tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:28.942311 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-91724c00-a4ff-4c20-bebf-cf1773be924f tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:28.943351 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-91724c00-a4ff-4c20-bebf-cf1773be924f tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:28.944847 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-91724c00-a4ff-4c20-bebf-cf1773be924f tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:28.945993 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-91724c00-a4ff-4c20-bebf-cf1773be924f tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:29.236457 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-91724c00-a4ff-4c20-bebf-cf1773be924f tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:25:29.250283 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-91724c00-a4ff-4c20-bebf-cf1773be924f tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:25:29.252543 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-91724c00-a4ff-4c20-bebf-cf1773be924f tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:25:29.253889 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-91724c00-a4ff-4c20-bebf-cf1773be924f tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] 10.222.0.43 "GET /compute/v2.1/servers/0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc" status: 200 len: 1405 microversion: 2.20 time: 0.333557 Oct 04 22:25:29.266398 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3446/6396] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:25:28 2022] GET /compute/v2.1/servers/0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc => generated 1405 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:25:30.280761 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-39cf6f8b-ba13-45ea-a747-594d17a69f2c tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:25:30.281422 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-39cf6f8b-ba13-45ea-a747-594d17a69f2c tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] [instance: 0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:25:30.288100 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-39cf6f8b-ba13-45ea-a747-594d17a69f2c tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:30.288612 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-39cf6f8b-ba13-45ea-a747-594d17a69f2c tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:30.289044 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-39cf6f8b-ba13-45ea-a747-594d17a69f2c tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:30.289749 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-39cf6f8b-ba13-45ea-a747-594d17a69f2c tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:30.290213 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-39cf6f8b-ba13-45ea-a747-594d17a69f2c tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:30.291183 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-39cf6f8b-ba13-45ea-a747-594d17a69f2c tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:30.432518 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-39cf6f8b-ba13-45ea-a747-594d17a69f2c tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:25:30.440971 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-39cf6f8b-ba13-45ea-a747-594d17a69f2c tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:25:30.442587 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-39cf6f8b-ba13-45ea-a747-594d17a69f2c tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:25:30.443737 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-39cf6f8b-ba13-45ea-a747-594d17a69f2c tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] 10.222.0.43 "GET /compute/v2.1/servers/0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc" status: 200 len: 1405 microversion: 2.20 time: 0.167343 Oct 04 22:25:30.444311 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3447/6397] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:25:30 2022] GET /compute/v2.1/servers/0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc => generated 1405 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 22:25:31.470600 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-4420caee-8491-4258-8c67-42783a59c5a4 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:25:31.471337 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-4420caee-8491-4258-8c67-42783a59c5a4 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] [instance: 0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:25:31.479032 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4420caee-8491-4258-8c67-42783a59c5a4 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:31.479542 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4420caee-8491-4258-8c67-42783a59c5a4 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:31.479999 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4420caee-8491-4258-8c67-42783a59c5a4 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:31.480711 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4420caee-8491-4258-8c67-42783a59c5a4 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:31.481181 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4420caee-8491-4258-8c67-42783a59c5a4 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:31.481623 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4420caee-8491-4258-8c67-42783a59c5a4 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:31.624567 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-4420caee-8491-4258-8c67-42783a59c5a4 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:25:31.633107 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-4420caee-8491-4258-8c67-42783a59c5a4 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:25:31.635351 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-4420caee-8491-4258-8c67-42783a59c5a4 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:25:31.637129 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-4420caee-8491-4258-8c67-42783a59c5a4 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] 10.222.0.43 "GET /compute/v2.1/servers/0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc" status: 200 len: 1405 microversion: 2.20 time: 0.170292 Oct 04 22:25:31.637862 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3448/6398] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:25:31 2022] GET /compute/v2.1/servers/0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc => generated 1405 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 22:25:32.662901 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-f10f260f-0ed1-4a06-93dc-35e0edebe1fb tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:25:32.663587 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-f10f260f-0ed1-4a06-93dc-35e0edebe1fb tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] [instance: 0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:25:32.672267 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f10f260f-0ed1-4a06-93dc-35e0edebe1fb tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:32.672935 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f10f260f-0ed1-4a06-93dc-35e0edebe1fb tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:32.673468 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f10f260f-0ed1-4a06-93dc-35e0edebe1fb tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:32.674317 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f10f260f-0ed1-4a06-93dc-35e0edebe1fb tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:32.674952 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f10f260f-0ed1-4a06-93dc-35e0edebe1fb tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:32.675404 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f10f260f-0ed1-4a06-93dc-35e0edebe1fb tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:32.818916 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-f10f260f-0ed1-4a06-93dc-35e0edebe1fb tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:25:32.827842 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-f10f260f-0ed1-4a06-93dc-35e0edebe1fb tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:25:32.829665 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-f10f260f-0ed1-4a06-93dc-35e0edebe1fb tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:25:32.831251 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-f10f260f-0ed1-4a06-93dc-35e0edebe1fb tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] 10.222.0.43 "GET /compute/v2.1/servers/0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc" status: 200 len: 1405 microversion: 2.20 time: 0.172497 Oct 04 22:25:32.832228 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3449/6399] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:25:32 2022] GET /compute/v2.1/servers/0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc => generated 1405 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 22:25:33.857695 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-5b987d27-b0ff-4c65-9f0d-cbfcbd7b1eb8 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:25:33.858467 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-5b987d27-b0ff-4c65-9f0d-cbfcbd7b1eb8 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] [instance: 0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:25:33.866278 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5b987d27-b0ff-4c65-9f0d-cbfcbd7b1eb8 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:33.866812 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5b987d27-b0ff-4c65-9f0d-cbfcbd7b1eb8 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:33.867528 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5b987d27-b0ff-4c65-9f0d-cbfcbd7b1eb8 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:33.868492 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5b987d27-b0ff-4c65-9f0d-cbfcbd7b1eb8 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:33.869523 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5b987d27-b0ff-4c65-9f0d-cbfcbd7b1eb8 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:33.870025 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5b987d27-b0ff-4c65-9f0d-cbfcbd7b1eb8 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:34.010062 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-5b987d27-b0ff-4c65-9f0d-cbfcbd7b1eb8 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:25:34.019626 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-5b987d27-b0ff-4c65-9f0d-cbfcbd7b1eb8 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:25:34.021353 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-5b987d27-b0ff-4c65-9f0d-cbfcbd7b1eb8 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:25:34.022556 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-5b987d27-b0ff-4c65-9f0d-cbfcbd7b1eb8 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] 10.222.0.43 "GET /compute/v2.1/servers/0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc" status: 200 len: 1405 microversion: 2.20 time: 0.169121 Oct 04 22:25:34.023127 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3450/6400] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:25:33 2022] GET /compute/v2.1/servers/0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc => generated 1405 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 22:25:35.049310 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-7c56ed16-c56d-4a9c-8a89-406783ac74d1 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:25:35.049949 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-7c56ed16-c56d-4a9c-8a89-406783ac74d1 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] [instance: 0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:25:35.052737 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=2 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:25:35.059184 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7c56ed16-c56d-4a9c-8a89-406783ac74d1 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:35.059819 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7c56ed16-c56d-4a9c-8a89-406783ac74d1 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:35.060336 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7c56ed16-c56d-4a9c-8a89-406783ac74d1 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:35.061056 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7c56ed16-c56d-4a9c-8a89-406783ac74d1 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:35.061581 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7c56ed16-c56d-4a9c-8a89-406783ac74d1 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:35.062106 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7c56ed16-c56d-4a9c-8a89-406783ac74d1 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:35.148465 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=12 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:25:35.241109 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-7c56ed16-c56d-4a9c-8a89-406783ac74d1 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:25:35.252793 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-7c56ed16-c56d-4a9c-8a89-406783ac74d1 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:25:35.254321 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-7c56ed16-c56d-4a9c-8a89-406783ac74d1 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:25:35.255545 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-7c56ed16-c56d-4a9c-8a89-406783ac74d1 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] 10.222.0.43 "GET /compute/v2.1/servers/0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc" status: 200 len: 1405 microversion: 2.20 time: 0.210425 Oct 04 22:25:35.256109 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3451/6401] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:25:35 2022] GET /compute/v2.1/servers/0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc => generated 1405 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 22:25:35.314671 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-25856de1-f52a-4b30-b3f1-73120969bd3f req-c68a81ad-d42c-4c84-bf5c-4fa0800ba907 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc", "name": "network-vif-plugged", "status": "completed", "tag": "92737fc4-3618-4a96-a0a0-09038568173c"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:25:35.333904 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-25856de1-f52a-4b30-b3f1-73120969bd3f req-c68a81ad-d42c-4c84-bf5c-4fa0800ba907 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:35.334819 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-25856de1-f52a-4b30-b3f1-73120969bd3f req-c68a81ad-d42c-4c84-bf5c-4fa0800ba907 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:35.335289 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-25856de1-f52a-4b30-b3f1-73120969bd3f req-c68a81ad-d42c-4c84-bf5c-4fa0800ba907 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:35.350162 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-25856de1-f52a-4b30-b3f1-73120969bd3f req-c68a81ad-d42c-4c84-bf5c-4fa0800ba907 service nova] Creating event network-vif-plugged:92737fc4-3618-4a96-a0a0-09038568173c for instance 0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc on n-h2-860284-1 Oct 04 22:25:35.360878 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-25856de1-f52a-4b30-b3f1-73120969bd3f req-c68a81ad-d42c-4c84-bf5c-4fa0800ba907 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050086 Oct 04 22:25:35.361741 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3452/6402] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:25:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:25:36.282144 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-76d3b649-8eae-48e8-ab51-40287d0bee6f tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:25:36.283523 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-76d3b649-8eae-48e8-ab51-40287d0bee6f tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] [instance: 0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:25:36.292463 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-76d3b649-8eae-48e8-ab51-40287d0bee6f tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:36.292967 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-76d3b649-8eae-48e8-ab51-40287d0bee6f tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:36.293416 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-76d3b649-8eae-48e8-ab51-40287d0bee6f tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:36.294132 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-76d3b649-8eae-48e8-ab51-40287d0bee6f tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:36.294651 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-76d3b649-8eae-48e8-ab51-40287d0bee6f tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:36.295094 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-76d3b649-8eae-48e8-ab51-40287d0bee6f tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:36.431043 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-76d3b649-8eae-48e8-ab51-40287d0bee6f tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:25:36.440106 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-76d3b649-8eae-48e8-ab51-40287d0bee6f tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:25:36.441698 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-76d3b649-8eae-48e8-ab51-40287d0bee6f tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:25:36.442972 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-76d3b649-8eae-48e8-ab51-40287d0bee6f tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] 10.222.0.43 "GET /compute/v2.1/servers/0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc" status: 200 len: 1405 microversion: 2.20 time: 0.165524 Oct 04 22:25:36.443763 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3453/6403] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:25:36 2022] GET /compute/v2.1/servers/0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc => generated 1405 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 22:25:37.468970 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-06788c72-27d1-4075-a69b-59fbe7024fa0 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:25:37.469524 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-06788c72-27d1-4075-a69b-59fbe7024fa0 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] [instance: 0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:25:37.476913 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-06788c72-27d1-4075-a69b-59fbe7024fa0 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:37.477526 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-06788c72-27d1-4075-a69b-59fbe7024fa0 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:37.477904 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-06788c72-27d1-4075-a69b-59fbe7024fa0 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:37.478666 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-06788c72-27d1-4075-a69b-59fbe7024fa0 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:37.479139 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-06788c72-27d1-4075-a69b-59fbe7024fa0 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:37.479617 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-06788c72-27d1-4075-a69b-59fbe7024fa0 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:37.631808 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-06788c72-27d1-4075-a69b-59fbe7024fa0 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:25:37.642312 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-06788c72-27d1-4075-a69b-59fbe7024fa0 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:25:37.643905 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-06788c72-27d1-4075-a69b-59fbe7024fa0 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:25:37.645115 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-06788c72-27d1-4075-a69b-59fbe7024fa0 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] 10.222.0.43 "GET /compute/v2.1/servers/0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc" status: 200 len: 1597 microversion: 2.20 time: 0.180112 Oct 04 22:25:37.645854 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3454/6404] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:25:37 2022] GET /compute/v2.1/servers/0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc => generated 1597 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:25:37.671223 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-93ce12c1-b94c-4202-8091-0bf1bd148fa6 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:25:37.671804 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-93ce12c1-b94c-4202-8091-0bf1bd148fa6 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] [instance: 0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:25:37.677867 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-93ce12c1-b94c-4202-8091-0bf1bd148fa6 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:37.678387 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-93ce12c1-b94c-4202-8091-0bf1bd148fa6 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:37.678846 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-93ce12c1-b94c-4202-8091-0bf1bd148fa6 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:37.679554 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-93ce12c1-b94c-4202-8091-0bf1bd148fa6 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:37.680043 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-93ce12c1-b94c-4202-8091-0bf1bd148fa6 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:37.680484 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-93ce12c1-b94c-4202-8091-0bf1bd148fa6 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:37.777691 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-93ce12c1-b94c-4202-8091-0bf1bd148fa6 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] 10.222.0.43 "GET /compute/v2.1/servers/0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.110296 Oct 04 22:25:37.778394 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3455/6405] 10.222.0.43 () {60 vars in 1316 bytes} [Tue Oct 4 22:25:37 2022] GET /compute/v2.1/servers/0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc/os-interface => generated 284 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 22:25:38.889317 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-f1d974dd-d5ed-48ef-8a10-010a42d5ae53 req-addad07b-d8c9-4f3f-9896-3441594d5f94 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc", "tag": "92737fc4-3618-4a96-a0a0-09038568173c"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:25:38.902213 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-f1d974dd-d5ed-48ef-8a10-010a42d5ae53 req-addad07b-d8c9-4f3f-9896-3441594d5f94 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:38.902904 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-f1d974dd-d5ed-48ef-8a10-010a42d5ae53 req-addad07b-d8c9-4f3f-9896-3441594d5f94 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:38.903585 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-f1d974dd-d5ed-48ef-8a10-010a42d5ae53 req-addad07b-d8c9-4f3f-9896-3441594d5f94 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:38.918022 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-f1d974dd-d5ed-48ef-8a10-010a42d5ae53 req-addad07b-d8c9-4f3f-9896-3441594d5f94 service nova] Creating event network-changed:92737fc4-3618-4a96-a0a0-09038568173c for instance 0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc on n-h2-860284-1 Oct 04 22:25:38.924848 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-f1d974dd-d5ed-48ef-8a10-010a42d5ae53 req-addad07b-d8c9-4f3f-9896-3441594d5f94 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041042 Oct 04 22:25:38.926039 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3456/6406] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:25:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:26:54.272728 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=28 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:26:54.273489 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=73 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:26:54.279223 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-3961f4f4-8b13-4cc8-89d5-12c8779ccf0d tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:26:54.279837 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-3961f4f4-8b13-4cc8-89d5-12c8779ccf0d tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] [instance: 0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:26:54.287521 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3961f4f4-8b13-4cc8-89d5-12c8779ccf0d tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:26:54.288560 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3961f4f4-8b13-4cc8-89d5-12c8779ccf0d tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:26:54.289026 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3961f4f4-8b13-4cc8-89d5-12c8779ccf0d tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:26:54.289746 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3961f4f4-8b13-4cc8-89d5-12c8779ccf0d tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:26:54.290246 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3961f4f4-8b13-4cc8-89d5-12c8779ccf0d tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:26:54.290750 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3961f4f4-8b13-4cc8-89d5-12c8779ccf0d tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:26:54.317013 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-3961f4f4-8b13-4cc8-89d5-12c8779ccf0d tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] 10.222.0.43 "GET /compute/v2.1/servers/0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc/ips" status: 200 len: 150 microversion: 2.20 time: 0.047381 Oct 04 22:26:54.317612 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3457/6407] 10.222.0.43 () {60 vars in 1289 bytes} [Tue Oct 4 22:26:54 2022] GET /compute/v2.1/servers/0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc/ips => generated 150 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 22:26:56.172064 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-beeccf12-853d-41dc-90da-6713fda4d70c tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:26:56.172837 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-beeccf12-853d-41dc-90da-6713fda4d70c tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] [instance: 0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:26:56.180831 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-beeccf12-853d-41dc-90da-6713fda4d70c tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:26:56.181406 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-beeccf12-853d-41dc-90da-6713fda4d70c tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:26:56.181929 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-beeccf12-853d-41dc-90da-6713fda4d70c tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:26:56.182927 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-beeccf12-853d-41dc-90da-6713fda4d70c tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:26:56.183461 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-beeccf12-853d-41dc-90da-6713fda4d70c tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:26:56.183976 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-beeccf12-853d-41dc-90da-6713fda4d70c tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:26:56.212983 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.objects.instance [None req-beeccf12-853d-41dc-90da-6713fda4d70c tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lazy-loading 'flavor' on Instance uuid 0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc {{(pid=134101) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 22:26:56.448258 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-beeccf12-853d-41dc-90da-6713fda4d70c tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] 10.222.0.43 "POST /compute/v2.1/servers/0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc/action" status: 202 len: 0 microversion: 2.20 time: 0.279904 Oct 04 22:26:56.449905 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3458/6408] 10.222.0.43 () {62 vars in 1319 bytes} [Tue Oct 4 22:26:56 2022] POST /compute/v2.1/servers/0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc/action => generated 0 bytes in 282 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 04 22:26:56.461534 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-7d9f2f03-bb45-494d-b59f-b1d67bc8223b tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:26:56.463307 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-7d9f2f03-bb45-494d-b59f-b1d67bc8223b tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] [instance: 0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:26:56.471836 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7d9f2f03-bb45-494d-b59f-b1d67bc8223b tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:26:56.472638 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7d9f2f03-bb45-494d-b59f-b1d67bc8223b tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:26:56.473325 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7d9f2f03-bb45-494d-b59f-b1d67bc8223b tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:26:56.474311 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7d9f2f03-bb45-494d-b59f-b1d67bc8223b tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:26:56.475068 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7d9f2f03-bb45-494d-b59f-b1d67bc8223b tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:26:56.476506 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7d9f2f03-bb45-494d-b59f-b1d67bc8223b tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:26:56.631410 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-7d9f2f03-bb45-494d-b59f-b1d67bc8223b tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:26:56.640426 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-7d9f2f03-bb45-494d-b59f-b1d67bc8223b tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:26:56.642158 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-7d9f2f03-bb45-494d-b59f-b1d67bc8223b tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:26:56.643588 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-7d9f2f03-bb45-494d-b59f-b1d67bc8223b tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] 10.222.0.43 "GET /compute/v2.1/servers/0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc" status: 200 len: 1720 microversion: 2.20 time: 0.190229 Oct 04 22:26:56.644149 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3459/6409] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:26:56 2022] GET /compute/v2.1/servers/0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc => generated 1720 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 22:26:57.671486 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-b9e7f6dd-9360-47c7-b23d-3a2a33d84940 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:26:57.672258 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-b9e7f6dd-9360-47c7-b23d-3a2a33d84940 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] [instance: 0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:26:57.679741 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b9e7f6dd-9360-47c7-b23d-3a2a33d84940 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:26:57.680245 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b9e7f6dd-9360-47c7-b23d-3a2a33d84940 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:26:57.680703 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b9e7f6dd-9360-47c7-b23d-3a2a33d84940 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:26:57.681424 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b9e7f6dd-9360-47c7-b23d-3a2a33d84940 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:26:57.681926 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b9e7f6dd-9360-47c7-b23d-3a2a33d84940 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:26:57.682395 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b9e7f6dd-9360-47c7-b23d-3a2a33d84940 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:26:57.924570 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-b9e7f6dd-9360-47c7-b23d-3a2a33d84940 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:26:57.934427 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-b9e7f6dd-9360-47c7-b23d-3a2a33d84940 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:26:57.936047 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-b9e7f6dd-9360-47c7-b23d-3a2a33d84940 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:26:57.937272 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-b9e7f6dd-9360-47c7-b23d-3a2a33d84940 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] 10.222.0.43 "GET /compute/v2.1/servers/0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc" status: 200 len: 1720 microversion: 2.20 time: 0.270362 Oct 04 22:26:57.950921 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3460/6410] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:26:57 2022] GET /compute/v2.1/servers/0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc => generated 1720 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 22:26:58.964967 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-f305bb22-a260-482d-bc32-b6f61c1192e4 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:26:58.965625 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-f305bb22-a260-482d-bc32-b6f61c1192e4 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] [instance: 0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:26:58.973341 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f305bb22-a260-482d-bc32-b6f61c1192e4 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:26:58.973858 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f305bb22-a260-482d-bc32-b6f61c1192e4 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:26:58.974346 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f305bb22-a260-482d-bc32-b6f61c1192e4 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:26:58.975126 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f305bb22-a260-482d-bc32-b6f61c1192e4 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:26:58.975824 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f305bb22-a260-482d-bc32-b6f61c1192e4 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:26:58.976421 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f305bb22-a260-482d-bc32-b6f61c1192e4 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:26:59.395591 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-f305bb22-a260-482d-bc32-b6f61c1192e4 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:26:59.404063 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-f305bb22-a260-482d-bc32-b6f61c1192e4 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:26:59.405535 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-f305bb22-a260-482d-bc32-b6f61c1192e4 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:26:59.406758 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-f305bb22-a260-482d-bc32-b6f61c1192e4 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] 10.222.0.43 "GET /compute/v2.1/servers/0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc" status: 200 len: 1720 microversion: 2.20 time: 0.446830 Oct 04 22:26:59.407325 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3461/6411] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:26:58 2022] GET /compute/v2.1/servers/0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc => generated 1720 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 22:27:00.433512 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-84f8fb2c-03b6-4be7-ad51-6eeaa444139d tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:27:00.434290 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-84f8fb2c-03b6-4be7-ad51-6eeaa444139d tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] [instance: 0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:27:00.442156 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-84f8fb2c-03b6-4be7-ad51-6eeaa444139d tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:00.442811 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-84f8fb2c-03b6-4be7-ad51-6eeaa444139d tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:00.443368 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-84f8fb2c-03b6-4be7-ad51-6eeaa444139d tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:00.444816 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-84f8fb2c-03b6-4be7-ad51-6eeaa444139d tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:00.445298 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-84f8fb2c-03b6-4be7-ad51-6eeaa444139d tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:00.445993 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-84f8fb2c-03b6-4be7-ad51-6eeaa444139d tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:00.587075 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-84f8fb2c-03b6-4be7-ad51-6eeaa444139d tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:00.595877 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-84f8fb2c-03b6-4be7-ad51-6eeaa444139d tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:00.597375 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-84f8fb2c-03b6-4be7-ad51-6eeaa444139d tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:00.598618 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-84f8fb2c-03b6-4be7-ad51-6eeaa444139d tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] 10.222.0.43 "GET /compute/v2.1/servers/0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc" status: 200 len: 1720 microversion: 2.20 time: 0.169423 Oct 04 22:27:00.599197 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3462/6412] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:27:00 2022] GET /compute/v2.1/servers/0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc => generated 1720 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 22:27:01.627186 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-32cb67c0-e4c0-404c-b5de-7e616f283db3 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:27:01.627908 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-32cb67c0-e4c0-404c-b5de-7e616f283db3 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] [instance: 0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:27:01.635832 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-32cb67c0-e4c0-404c-b5de-7e616f283db3 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:01.636338 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-32cb67c0-e4c0-404c-b5de-7e616f283db3 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:01.636794 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-32cb67c0-e4c0-404c-b5de-7e616f283db3 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:01.637519 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-32cb67c0-e4c0-404c-b5de-7e616f283db3 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:01.637990 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-32cb67c0-e4c0-404c-b5de-7e616f283db3 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:01.638467 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-32cb67c0-e4c0-404c-b5de-7e616f283db3 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:01.855989 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-32cb67c0-e4c0-404c-b5de-7e616f283db3 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:01.865334 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-32cb67c0-e4c0-404c-b5de-7e616f283db3 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:01.867781 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-32cb67c0-e4c0-404c-b5de-7e616f283db3 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:01.869162 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-32cb67c0-e4c0-404c-b5de-7e616f283db3 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] 10.222.0.43 "GET /compute/v2.1/servers/0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc" status: 200 len: 1720 microversion: 2.20 time: 0.245935 Oct 04 22:27:01.870303 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3463/6413] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:27:01 2022] GET /compute/v2.1/servers/0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc => generated 1720 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 22:27:02.895697 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-a9f901dc-1a63-4bfe-8d7b-74ab12c6a6f1 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:27:02.896317 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-a9f901dc-1a63-4bfe-8d7b-74ab12c6a6f1 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] [instance: 0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:27:02.903482 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a9f901dc-1a63-4bfe-8d7b-74ab12c6a6f1 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:02.903936 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a9f901dc-1a63-4bfe-8d7b-74ab12c6a6f1 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:02.904382 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a9f901dc-1a63-4bfe-8d7b-74ab12c6a6f1 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:02.905094 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a9f901dc-1a63-4bfe-8d7b-74ab12c6a6f1 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:02.905558 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a9f901dc-1a63-4bfe-8d7b-74ab12c6a6f1 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:02.905997 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a9f901dc-1a63-4bfe-8d7b-74ab12c6a6f1 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:03.128372 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-a9f901dc-1a63-4bfe-8d7b-74ab12c6a6f1 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:03.138397 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-a9f901dc-1a63-4bfe-8d7b-74ab12c6a6f1 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:03.140065 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-a9f901dc-1a63-4bfe-8d7b-74ab12c6a6f1 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:03.141427 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-a9f901dc-1a63-4bfe-8d7b-74ab12c6a6f1 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] 10.222.0.43 "GET /compute/v2.1/servers/0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc" status: 200 len: 1720 microversion: 2.20 time: 0.249711 Oct 04 22:27:03.142109 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3464/6414] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:27:02 2022] GET /compute/v2.1/servers/0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc => generated 1720 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:27:04.168391 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e642a4d0-c66d-4407-8bb0-b051d54ef8f8 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:27:04.169026 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-e642a4d0-c66d-4407-8bb0-b051d54ef8f8 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] [instance: 0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:27:04.177201 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e642a4d0-c66d-4407-8bb0-b051d54ef8f8 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:04.177710 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e642a4d0-c66d-4407-8bb0-b051d54ef8f8 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:04.178216 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e642a4d0-c66d-4407-8bb0-b051d54ef8f8 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:04.178996 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e642a4d0-c66d-4407-8bb0-b051d54ef8f8 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:04.179449 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e642a4d0-c66d-4407-8bb0-b051d54ef8f8 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:04.179899 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e642a4d0-c66d-4407-8bb0-b051d54ef8f8 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:04.364181 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-e642a4d0-c66d-4407-8bb0-b051d54ef8f8 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:04.374156 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-e642a4d0-c66d-4407-8bb0-b051d54ef8f8 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:04.375660 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-e642a4d0-c66d-4407-8bb0-b051d54ef8f8 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:04.379137 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-e642a4d0-c66d-4407-8bb0-b051d54ef8f8 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] 10.222.0.43 "GET /compute/v2.1/servers/0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc" status: 200 len: 1720 microversion: 2.20 time: 0.213160 Oct 04 22:27:04.379137 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3465/6415] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:27:04 2022] GET /compute/v2.1/servers/0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc => generated 1720 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 22:27:05.402824 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-d964913e-d20e-4349-83ae-4e4db5b53781 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:27:05.403445 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-d964913e-d20e-4349-83ae-4e4db5b53781 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] [instance: 0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:27:05.410408 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d964913e-d20e-4349-83ae-4e4db5b53781 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:05.411030 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d964913e-d20e-4349-83ae-4e4db5b53781 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:05.411489 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d964913e-d20e-4349-83ae-4e4db5b53781 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:05.412234 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d964913e-d20e-4349-83ae-4e4db5b53781 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:05.413446 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d964913e-d20e-4349-83ae-4e4db5b53781 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:05.414166 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d964913e-d20e-4349-83ae-4e4db5b53781 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:05.548307 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-d964913e-d20e-4349-83ae-4e4db5b53781 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:05.558234 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-d964913e-d20e-4349-83ae-4e4db5b53781 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:05.559883 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-d964913e-d20e-4349-83ae-4e4db5b53781 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:05.561188 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-d964913e-d20e-4349-83ae-4e4db5b53781 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] 10.222.0.43 "GET /compute/v2.1/servers/0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc" status: 200 len: 1720 microversion: 2.20 time: 0.162791 Oct 04 22:27:05.561753 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3466/6416] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:27:05 2022] GET /compute/v2.1/servers/0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc => generated 1720 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 22:27:06.587439 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-224a9b5f-5275-400b-9e94-4440d840ae19 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:27:06.588984 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-224a9b5f-5275-400b-9e94-4440d840ae19 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] [instance: 0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:27:06.596570 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-224a9b5f-5275-400b-9e94-4440d840ae19 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:06.597080 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-224a9b5f-5275-400b-9e94-4440d840ae19 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:06.597538 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-224a9b5f-5275-400b-9e94-4440d840ae19 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:06.598260 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-224a9b5f-5275-400b-9e94-4440d840ae19 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:06.598958 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-224a9b5f-5275-400b-9e94-4440d840ae19 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:06.599414 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-224a9b5f-5275-400b-9e94-4440d840ae19 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:06.805118 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-224a9b5f-5275-400b-9e94-4440d840ae19 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:06.814671 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-224a9b5f-5275-400b-9e94-4440d840ae19 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:06.816131 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-224a9b5f-5275-400b-9e94-4440d840ae19 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:06.817314 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-224a9b5f-5275-400b-9e94-4440d840ae19 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] 10.222.0.43 "GET /compute/v2.1/servers/0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc" status: 200 len: 1720 microversion: 2.20 time: 0.234809 Oct 04 22:27:06.817889 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3467/6417] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:27:06 2022] GET /compute/v2.1/servers/0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc => generated 1720 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 22:27:07.843751 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-86485968-03a0-4752-a17f-75fb7a1c4735 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:27:07.844380 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-86485968-03a0-4752-a17f-75fb7a1c4735 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] [instance: 0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:27:07.852031 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-86485968-03a0-4752-a17f-75fb7a1c4735 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:07.852529 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-86485968-03a0-4752-a17f-75fb7a1c4735 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:07.853123 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-86485968-03a0-4752-a17f-75fb7a1c4735 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:07.853838 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-86485968-03a0-4752-a17f-75fb7a1c4735 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:07.854303 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-86485968-03a0-4752-a17f-75fb7a1c4735 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:07.854771 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-86485968-03a0-4752-a17f-75fb7a1c4735 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:07.998056 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-86485968-03a0-4752-a17f-75fb7a1c4735 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:08.006090 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-86485968-03a0-4752-a17f-75fb7a1c4735 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:08.007590 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-86485968-03a0-4752-a17f-75fb7a1c4735 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:08.008986 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-86485968-03a0-4752-a17f-75fb7a1c4735 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] 10.222.0.43 "GET /compute/v2.1/servers/0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc" status: 200 len: 1741 microversion: 2.20 time: 0.169395 Oct 04 22:27:08.009642 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3468/6418] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:27:07 2022] GET /compute/v2.1/servers/0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc => generated 1741 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 22:27:09.035929 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-1f30df0d-debb-43b7-a1c8-39ebeb9e61a2 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:27:09.036770 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-1f30df0d-debb-43b7-a1c8-39ebeb9e61a2 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] [instance: 0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:27:09.044433 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1f30df0d-debb-43b7-a1c8-39ebeb9e61a2 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:09.044951 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1f30df0d-debb-43b7-a1c8-39ebeb9e61a2 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:09.045412 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1f30df0d-debb-43b7-a1c8-39ebeb9e61a2 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:09.046168 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1f30df0d-debb-43b7-a1c8-39ebeb9e61a2 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:09.046676 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1f30df0d-debb-43b7-a1c8-39ebeb9e61a2 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:09.047133 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1f30df0d-debb-43b7-a1c8-39ebeb9e61a2 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:09.194620 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-1f30df0d-debb-43b7-a1c8-39ebeb9e61a2 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:09.203133 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-1f30df0d-debb-43b7-a1c8-39ebeb9e61a2 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:09.205132 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-1f30df0d-debb-43b7-a1c8-39ebeb9e61a2 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:09.206343 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-1f30df0d-debb-43b7-a1c8-39ebeb9e61a2 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] 10.222.0.43 "GET /compute/v2.1/servers/0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc" status: 200 len: 1741 microversion: 2.20 time: 0.174635 Oct 04 22:27:09.206937 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3469/6419] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:27:09 2022] GET /compute/v2.1/servers/0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc => generated 1741 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 22:27:10.234807 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-df4674b1-c455-41b6-ad6d-fe05fdd7987c tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:27:10.235998 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-df4674b1-c455-41b6-ad6d-fe05fdd7987c tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] [instance: 0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:27:10.246187 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-df4674b1-c455-41b6-ad6d-fe05fdd7987c tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:10.246727 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-df4674b1-c455-41b6-ad6d-fe05fdd7987c tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:10.247463 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-df4674b1-c455-41b6-ad6d-fe05fdd7987c tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:10.248286 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-df4674b1-c455-41b6-ad6d-fe05fdd7987c tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:10.248765 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-df4674b1-c455-41b6-ad6d-fe05fdd7987c tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:10.249214 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-df4674b1-c455-41b6-ad6d-fe05fdd7987c tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:10.409315 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-df4674b1-c455-41b6-ad6d-fe05fdd7987c tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:10.418745 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-df4674b1-c455-41b6-ad6d-fe05fdd7987c tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:10.420230 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-df4674b1-c455-41b6-ad6d-fe05fdd7987c tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:10.421431 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-df4674b1-c455-41b6-ad6d-fe05fdd7987c tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] 10.222.0.43 "GET /compute/v2.1/servers/0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc" status: 200 len: 1741 microversion: 2.20 time: 0.191635 Oct 04 22:27:10.422013 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3470/6420] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:27:10 2022] GET /compute/v2.1/servers/0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc => generated 1741 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:27:11.447517 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-6cb60953-ff62-493e-8763-af26d7062dc5 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:27:11.448199 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-6cb60953-ff62-493e-8763-af26d7062dc5 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] [instance: 0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:27:11.455206 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6cb60953-ff62-493e-8763-af26d7062dc5 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:11.455723 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6cb60953-ff62-493e-8763-af26d7062dc5 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:11.456181 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6cb60953-ff62-493e-8763-af26d7062dc5 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:11.457041 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6cb60953-ff62-493e-8763-af26d7062dc5 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:11.457593 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6cb60953-ff62-493e-8763-af26d7062dc5 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:11.458132 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6cb60953-ff62-493e-8763-af26d7062dc5 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:11.614804 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-6cb60953-ff62-493e-8763-af26d7062dc5 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:11.620405 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:27:11.626452 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-6cb60953-ff62-493e-8763-af26d7062dc5 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:11.627930 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-6cb60953-ff62-493e-8763-af26d7062dc5 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:11.629320 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-6cb60953-ff62-493e-8763-af26d7062dc5 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] 10.222.0.43 "GET /compute/v2.1/servers/0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc" status: 200 len: 1741 microversion: 2.20 time: 0.186549 Oct 04 22:27:11.630080 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3471/6421] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:27:11 2022] GET /compute/v2.1/servers/0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc => generated 1741 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 22:27:11.872217 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-3c9a7b2e-aac8-48e2-9ff9-53b07b27e1bf req-0f710ae0-9d35-4faa-963b-3a9211487afd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc", "name": "network-vif-plugged", "status": "completed", "tag": "92737fc4-3618-4a96-a0a0-09038568173c"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:27:11.883263 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-3c9a7b2e-aac8-48e2-9ff9-53b07b27e1bf req-0f710ae0-9d35-4faa-963b-3a9211487afd service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:11.884165 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-3c9a7b2e-aac8-48e2-9ff9-53b07b27e1bf req-0f710ae0-9d35-4faa-963b-3a9211487afd service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:11.884896 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-3c9a7b2e-aac8-48e2-9ff9-53b07b27e1bf req-0f710ae0-9d35-4faa-963b-3a9211487afd service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:11.897174 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-3c9a7b2e-aac8-48e2-9ff9-53b07b27e1bf req-0f710ae0-9d35-4faa-963b-3a9211487afd service nova] Creating event network-vif-plugged:92737fc4-3618-4a96-a0a0-09038568173c for instance 0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc on n-h2-860284-1 Oct 04 22:27:11.903953 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-3c9a7b2e-aac8-48e2-9ff9-53b07b27e1bf req-0f710ae0-9d35-4faa-963b-3a9211487afd service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.200603 Oct 04 22:27:11.904660 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3472/6422] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:27:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:27:12.481347 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-5e5081b5-14da-4991-a4bc-0517d4d13a07 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:27:12.482024 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-5e5081b5-14da-4991-a4bc-0517d4d13a07 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: 47aa758b-a866-4254-b7ff-47ed2bd1c87f] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:27:12.488389 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5e5081b5-14da-4991-a4bc-0517d4d13a07 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:12.488969 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5e5081b5-14da-4991-a4bc-0517d4d13a07 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:12.489424 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5e5081b5-14da-4991-a4bc-0517d4d13a07 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:12.490815 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5e5081b5-14da-4991-a4bc-0517d4d13a07 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:12.491353 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5e5081b5-14da-4991-a4bc-0517d4d13a07 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:12.491792 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5e5081b5-14da-4991-a4bc-0517d4d13a07 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:12.519516 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-5e5081b5-14da-4991-a4bc-0517d4d13a07 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: 47aa758b-a866-4254-b7ff-47ed2bd1c87f] Going to try to terminate instance {{(pid=134101) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 22:27:12.615210 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-5e5081b5-14da-4991-a4bc-0517d4d13a07 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "DELETE /compute/v2.1/servers/47aa758b-a866-4254-b7ff-47ed2bd1c87f" status: 204 len: 0 microversion: 2.1 time: 0.138769 Oct 04 22:27:12.615814 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3473/6423] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 22:27:12 2022] DELETE /compute/v2.1/servers/47aa758b-a866-4254-b7ff-47ed2bd1c87f => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 22:27:12.625443 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-188d007f-66b0-4efc-86b8-234488b102fb tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:27:12.626211 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-188d007f-66b0-4efc-86b8-234488b102fb tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: 47aa758b-a866-4254-b7ff-47ed2bd1c87f] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:27:12.633608 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-188d007f-66b0-4efc-86b8-234488b102fb tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:12.634127 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-188d007f-66b0-4efc-86b8-234488b102fb tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:12.634615 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-188d007f-66b0-4efc-86b8-234488b102fb tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:12.635334 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-188d007f-66b0-4efc-86b8-234488b102fb tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:12.635800 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-188d007f-66b0-4efc-86b8-234488b102fb tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:12.636233 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-188d007f-66b0-4efc-86b8-234488b102fb tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:12.812010 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-188d007f-66b0-4efc-86b8-234488b102fb tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:12.825973 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-188d007f-66b0-4efc-86b8-234488b102fb tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/47aa758b-a866-4254-b7ff-47ed2bd1c87f" status: 200 len: 1580 microversion: 2.1 time: 0.205423 Oct 04 22:27:12.826628 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3474/6424] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:27:12 2022] GET /compute/v2.1/servers/47aa758b-a866-4254-b7ff-47ed2bd1c87f => generated 1580 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:27:12.850412 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-387bde3f-d6de-4429-9447-b17e88358086 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:27:12.851187 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-387bde3f-d6de-4429-9447-b17e88358086 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] [instance: 0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:27:12.862097 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-387bde3f-d6de-4429-9447-b17e88358086 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:12.862688 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-387bde3f-d6de-4429-9447-b17e88358086 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:12.863145 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-387bde3f-d6de-4429-9447-b17e88358086 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:12.863917 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-387bde3f-d6de-4429-9447-b17e88358086 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:12.864389 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-387bde3f-d6de-4429-9447-b17e88358086 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:12.864830 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-387bde3f-d6de-4429-9447-b17e88358086 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:13.132553 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-387bde3f-d6de-4429-9447-b17e88358086 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:13.142691 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-387bde3f-d6de-4429-9447-b17e88358086 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:13.144192 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-387bde3f-d6de-4429-9447-b17e88358086 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:13.145534 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-387bde3f-d6de-4429-9447-b17e88358086 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] 10.222.0.43 "GET /compute/v2.1/servers/0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc" status: 200 len: 1741 microversion: 2.20 time: 0.307870 Oct 04 22:27:13.146288 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3475/6425] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:27:12 2022] GET /compute/v2.1/servers/0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc => generated 1741 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:27:13.850135 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-f82d7ab3-1f48-40ff-833f-62113791c2fb tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:27:13.852095 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-f82d7ab3-1f48-40ff-833f-62113791c2fb tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: 47aa758b-a866-4254-b7ff-47ed2bd1c87f] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:27:13.864897 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f82d7ab3-1f48-40ff-833f-62113791c2fb tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:13.866681 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f82d7ab3-1f48-40ff-833f-62113791c2fb tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:13.868678 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f82d7ab3-1f48-40ff-833f-62113791c2fb tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:13.869668 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f82d7ab3-1f48-40ff-833f-62113791c2fb tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:13.871128 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f82d7ab3-1f48-40ff-833f-62113791c2fb tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:13.873133 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f82d7ab3-1f48-40ff-833f-62113791c2fb tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:14.090866 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-f82d7ab3-1f48-40ff-833f-62113791c2fb tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:14.103588 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-f82d7ab3-1f48-40ff-833f-62113791c2fb tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/47aa758b-a866-4254-b7ff-47ed2bd1c87f" status: 200 len: 1580 microversion: 2.1 time: 0.257923 Oct 04 22:27:14.121120 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3476/6426] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:27:13 2022] GET /compute/v2.1/servers/47aa758b-a866-4254-b7ff-47ed2bd1c87f => generated 1580 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:27:14.175181 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-fbcb9cb9-d308-4f49-8d1e-905b3dd7b635 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:27:14.176137 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-fbcb9cb9-d308-4f49-8d1e-905b3dd7b635 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] [instance: 0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:27:14.190321 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fbcb9cb9-d308-4f49-8d1e-905b3dd7b635 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:14.191350 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fbcb9cb9-d308-4f49-8d1e-905b3dd7b635 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:14.192008 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fbcb9cb9-d308-4f49-8d1e-905b3dd7b635 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:14.192966 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fbcb9cb9-d308-4f49-8d1e-905b3dd7b635 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:14.194531 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fbcb9cb9-d308-4f49-8d1e-905b3dd7b635 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:14.195222 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fbcb9cb9-d308-4f49-8d1e-905b3dd7b635 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:14.822414 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-fbcb9cb9-d308-4f49-8d1e-905b3dd7b635 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:14.835140 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-fbcb9cb9-d308-4f49-8d1e-905b3dd7b635 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:14.837787 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-fbcb9cb9-d308-4f49-8d1e-905b3dd7b635 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:14.841248 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-fbcb9cb9-d308-4f49-8d1e-905b3dd7b635 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] 10.222.0.43 "GET /compute/v2.1/servers/0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc" status: 200 len: 1736 microversion: 2.20 time: 0.673455 Oct 04 22:27:14.861972 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3477/6427] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:27:14 2022] GET /compute/v2.1/servers/0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc => generated 1736 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:27:15.135195 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-c25a6ed4-eb1c-4870-a2d5-ac787350a9e8 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:27:15.136101 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-c25a6ed4-eb1c-4870-a2d5-ac787350a9e8 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: 47aa758b-a866-4254-b7ff-47ed2bd1c87f] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:27:15.145233 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c25a6ed4-eb1c-4870-a2d5-ac787350a9e8 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:15.146046 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c25a6ed4-eb1c-4870-a2d5-ac787350a9e8 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:15.146943 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c25a6ed4-eb1c-4870-a2d5-ac787350a9e8 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:15.147916 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c25a6ed4-eb1c-4870-a2d5-ac787350a9e8 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:15.148635 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c25a6ed4-eb1c-4870-a2d5-ac787350a9e8 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:15.149306 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c25a6ed4-eb1c-4870-a2d5-ac787350a9e8 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:15.429940 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-c25a6ed4-eb1c-4870-a2d5-ac787350a9e8 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:15.441104 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-c25a6ed4-eb1c-4870-a2d5-ac787350a9e8 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/47aa758b-a866-4254-b7ff-47ed2bd1c87f" status: 200 len: 1580 microversion: 2.1 time: 0.311407 Oct 04 22:27:15.453684 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3478/6428] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:27:15 2022] GET /compute/v2.1/servers/47aa758b-a866-4254-b7ff-47ed2bd1c87f => generated 1580 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:27:15.870736 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-1f72ddc2-d6cd-417c-998e-2fed5f724cf9 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:27:15.872273 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-1f72ddc2-d6cd-417c-998e-2fed5f724cf9 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] [instance: 0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:27:15.881934 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1f72ddc2-d6cd-417c-998e-2fed5f724cf9 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:15.899217 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1f72ddc2-d6cd-417c-998e-2fed5f724cf9 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:15.899732 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1f72ddc2-d6cd-417c-998e-2fed5f724cf9 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:15.900790 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1f72ddc2-d6cd-417c-998e-2fed5f724cf9 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:15.901315 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1f72ddc2-d6cd-417c-998e-2fed5f724cf9 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:15.901850 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1f72ddc2-d6cd-417c-998e-2fed5f724cf9 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:16.212238 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-1f72ddc2-d6cd-417c-998e-2fed5f724cf9 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:16.228122 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-1f72ddc2-d6cd-417c-998e-2fed5f724cf9 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:16.229939 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-1f72ddc2-d6cd-417c-998e-2fed5f724cf9 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:16.231764 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-1f72ddc2-d6cd-417c-998e-2fed5f724cf9 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] 10.222.0.43 "GET /compute/v2.1/servers/0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc" status: 200 len: 1736 microversion: 2.20 time: 0.365133 Oct 04 22:27:16.239635 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3479/6429] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:27:15 2022] GET /compute/v2.1/servers/0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc => generated 1736 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 22:27:16.481922 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-a7e663c1-558e-4065-898f-d247a1385d7a req-3a44c86d-e1d9-4206-90e5-b6023ff9679a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47aa758b-a866-4254-b7ff-47ed2bd1c87f", "name": "network-vif-deleted", "tag": "8957a848-6a5f-4266-81c3-301fb772023a"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:27:16.496736 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-a7e663c1-558e-4065-898f-d247a1385d7a req-3a44c86d-e1d9-4206-90e5-b6023ff9679a service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:16.497533 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-a7e663c1-558e-4065-898f-d247a1385d7a req-3a44c86d-e1d9-4206-90e5-b6023ff9679a service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:16.498164 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-a7e663c1-558e-4065-898f-d247a1385d7a req-3a44c86d-e1d9-4206-90e5-b6023ff9679a service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:16.524009 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-a7e663c1-558e-4065-898f-d247a1385d7a req-3a44c86d-e1d9-4206-90e5-b6023ff9679a service nova] Creating event network-vif-deleted:8957a848-6a5f-4266-81c3-301fb772023a for instance 47aa758b-a866-4254-b7ff-47ed2bd1c87f on n-h1-860284-1 Oct 04 22:27:16.531925 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-a7e663c1-558e-4065-898f-d247a1385d7a req-3a44c86d-e1d9-4206-90e5-b6023ff9679a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.200302 Oct 04 22:27:16.532865 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3480/6430] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:27:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:27:16.539098 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-1b9da442-96d1-4ddf-a0d8-ae2f842214a1 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:27:16.540241 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-1b9da442-96d1-4ddf-a0d8-ae2f842214a1 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: 47aa758b-a866-4254-b7ff-47ed2bd1c87f] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:27:16.548407 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1b9da442-96d1-4ddf-a0d8-ae2f842214a1 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:16.549174 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1b9da442-96d1-4ddf-a0d8-ae2f842214a1 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:16.549792 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1b9da442-96d1-4ddf-a0d8-ae2f842214a1 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:16.550718 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1b9da442-96d1-4ddf-a0d8-ae2f842214a1 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:16.551369 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1b9da442-96d1-4ddf-a0d8-ae2f842214a1 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:16.551975 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1b9da442-96d1-4ddf-a0d8-ae2f842214a1 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:16.718214 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-1b9da442-96d1-4ddf-a0d8-ae2f842214a1 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:16.748899 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-1b9da442-96d1-4ddf-a0d8-ae2f842214a1 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/47aa758b-a866-4254-b7ff-47ed2bd1c87f" status: 200 len: 1226 microversion: 2.1 time: 0.211365 Oct 04 22:27:16.752778 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3481/6431] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:27:16 2022] GET /compute/v2.1/servers/47aa758b-a866-4254-b7ff-47ed2bd1c87f => generated 1226 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:27:17.268116 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-a1d35002-fba7-4d7e-88b2-ffed4461143f tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:27:17.268797 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-a1d35002-fba7-4d7e-88b2-ffed4461143f tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] [instance: 0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:27:17.277817 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a1d35002-fba7-4d7e-88b2-ffed4461143f tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:17.278321 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a1d35002-fba7-4d7e-88b2-ffed4461143f tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:17.278797 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a1d35002-fba7-4d7e-88b2-ffed4461143f tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:17.279511 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a1d35002-fba7-4d7e-88b2-ffed4461143f tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:17.279976 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a1d35002-fba7-4d7e-88b2-ffed4461143f tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:17.280414 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a1d35002-fba7-4d7e-88b2-ffed4461143f tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:17.525994 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-a1d35002-fba7-4d7e-88b2-ffed4461143f tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:17.541519 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-a1d35002-fba7-4d7e-88b2-ffed4461143f tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:17.545538 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-a1d35002-fba7-4d7e-88b2-ffed4461143f tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:17.548332 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-a1d35002-fba7-4d7e-88b2-ffed4461143f tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] 10.222.0.43 "GET /compute/v2.1/servers/0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc" status: 200 len: 1736 microversion: 2.20 time: 0.283487 Oct 04 22:27:17.549333 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3482/6432] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:27:17 2022] GET /compute/v2.1/servers/0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc => generated 1736 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 22:27:17.776390 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-9c905229-1554-4ee3-8470-7fb49ff8a72f tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:27:17.777355 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-9c905229-1554-4ee3-8470-7fb49ff8a72f tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: 47aa758b-a866-4254-b7ff-47ed2bd1c87f] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:27:17.793113 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9c905229-1554-4ee3-8470-7fb49ff8a72f tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:17.793911 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9c905229-1554-4ee3-8470-7fb49ff8a72f tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:17.794631 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9c905229-1554-4ee3-8470-7fb49ff8a72f tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:17.795532 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9c905229-1554-4ee3-8470-7fb49ff8a72f tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:17.796176 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9c905229-1554-4ee3-8470-7fb49ff8a72f tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:17.796773 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9c905229-1554-4ee3-8470-7fb49ff8a72f tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:17.958070 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-9c905229-1554-4ee3-8470-7fb49ff8a72f tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:17.976517 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-9c905229-1554-4ee3-8470-7fb49ff8a72f tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/47aa758b-a866-4254-b7ff-47ed2bd1c87f" status: 200 len: 1226 microversion: 2.1 time: 0.204827 Oct 04 22:27:17.993174 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3483/6433] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:27:17 2022] GET /compute/v2.1/servers/47aa758b-a866-4254-b7ff-47ed2bd1c87f => generated 1226 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:27:18.578511 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-fd6823c6-8633-4d7e-a4b7-275a50a15f1a tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:27:18.579372 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-fd6823c6-8633-4d7e-a4b7-275a50a15f1a tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] [instance: 0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:27:18.595835 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fd6823c6-8633-4d7e-a4b7-275a50a15f1a tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:18.596359 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fd6823c6-8633-4d7e-a4b7-275a50a15f1a tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:18.597601 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fd6823c6-8633-4d7e-a4b7-275a50a15f1a tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:18.616080 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fd6823c6-8633-4d7e-a4b7-275a50a15f1a tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:18.619898 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fd6823c6-8633-4d7e-a4b7-275a50a15f1a tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:18.620827 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fd6823c6-8633-4d7e-a4b7-275a50a15f1a tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:18.999353 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-fd6823c6-8633-4d7e-a4b7-275a50a15f1a tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:19.012654 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-fd6823c6-8633-4d7e-a4b7-275a50a15f1a tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:19.016556 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-fd6823c6-8633-4d7e-a4b7-275a50a15f1a tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:19.019025 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-fd6823c6-8633-4d7e-a4b7-275a50a15f1a tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] 10.222.0.43 "GET /compute/v2.1/servers/0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc" status: 200 len: 1736 microversion: 2.20 time: 0.447184 Oct 04 22:27:19.021197 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3484/6434] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:27:18 2022] GET /compute/v2.1/servers/0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc => generated 1736 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:27:19.037587 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-ff55577f-fedc-4ed9-a323-5061b890c46b tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:27:19.038238 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-ff55577f-fedc-4ed9-a323-5061b890c46b tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: 47aa758b-a866-4254-b7ff-47ed2bd1c87f] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:27:19.054696 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ff55577f-fedc-4ed9-a323-5061b890c46b tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:19.055475 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ff55577f-fedc-4ed9-a323-5061b890c46b tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:19.061242 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ff55577f-fedc-4ed9-a323-5061b890c46b tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:19.062294 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ff55577f-fedc-4ed9-a323-5061b890c46b tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:19.062964 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ff55577f-fedc-4ed9-a323-5061b890c46b tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:19.063593 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ff55577f-fedc-4ed9-a323-5061b890c46b tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:19.223662 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-ff55577f-fedc-4ed9-a323-5061b890c46b tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:19.243653 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-ff55577f-fedc-4ed9-a323-5061b890c46b tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/47aa758b-a866-4254-b7ff-47ed2bd1c87f" status: 200 len: 1226 microversion: 2.1 time: 0.217678 Oct 04 22:27:19.259772 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3485/6435] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:27:19 2022] GET /compute/v2.1/servers/47aa758b-a866-4254-b7ff-47ed2bd1c87f => generated 1226 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:27:20.050646 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-d8cc1828-681d-44a5-8c28-513e8507c073 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:27:20.051947 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-d8cc1828-681d-44a5-8c28-513e8507c073 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] [instance: 0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:27:20.075446 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d8cc1828-681d-44a5-8c28-513e8507c073 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:20.075571 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d8cc1828-681d-44a5-8c28-513e8507c073 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:20.075961 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d8cc1828-681d-44a5-8c28-513e8507c073 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:20.076702 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d8cc1828-681d-44a5-8c28-513e8507c073 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:20.077185 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d8cc1828-681d-44a5-8c28-513e8507c073 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:20.077638 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d8cc1828-681d-44a5-8c28-513e8507c073 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:20.463565 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-d8cc1828-681d-44a5-8c28-513e8507c073 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:20.476086 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-d8cc1828-681d-44a5-8c28-513e8507c073 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:20.477586 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-d8cc1828-681d-44a5-8c28-513e8507c073 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:20.478850 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-d8cc1828-681d-44a5-8c28-513e8507c073 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] 10.222.0.43 "GET /compute/v2.1/servers/0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc" status: 200 len: 1736 microversion: 2.20 time: 0.434974 Oct 04 22:27:20.494058 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3486/6436] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:27:20 2022] GET /compute/v2.1/servers/0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc => generated 1736 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 22:27:20.520906 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-b2aff38c-b7d7-4d20-bf5c-bdbcaf041be8 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:27:20.522104 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-b2aff38c-b7d7-4d20-bf5c-bdbcaf041be8 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: 47aa758b-a866-4254-b7ff-47ed2bd1c87f] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:27:20.529854 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b2aff38c-b7d7-4d20-bf5c-bdbcaf041be8 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:20.530663 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b2aff38c-b7d7-4d20-bf5c-bdbcaf041be8 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:20.531360 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b2aff38c-b7d7-4d20-bf5c-bdbcaf041be8 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:20.532344 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b2aff38c-b7d7-4d20-bf5c-bdbcaf041be8 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:20.533058 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b2aff38c-b7d7-4d20-bf5c-bdbcaf041be8 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:20.533733 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b2aff38c-b7d7-4d20-bf5c-bdbcaf041be8 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:20.664720 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-b2aff38c-b7d7-4d20-bf5c-bdbcaf041be8 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:20.701907 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-b2aff38c-b7d7-4d20-bf5c-bdbcaf041be8 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/47aa758b-a866-4254-b7ff-47ed2bd1c87f" status: 200 len: 1226 microversion: 2.1 time: 0.189928 Oct 04 22:27:20.703716 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3487/6437] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:27:20 2022] GET /compute/v2.1/servers/47aa758b-a866-4254-b7ff-47ed2bd1c87f => generated 1226 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:27:21.530863 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-2ef3d3a3-e527-4e35-ab71-76bf3db11320 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:27:21.532218 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-2ef3d3a3-e527-4e35-ab71-76bf3db11320 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] [instance: 0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:27:21.545849 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2ef3d3a3-e527-4e35-ab71-76bf3db11320 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:21.546665 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2ef3d3a3-e527-4e35-ab71-76bf3db11320 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:21.549680 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2ef3d3a3-e527-4e35-ab71-76bf3db11320 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:21.550641 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2ef3d3a3-e527-4e35-ab71-76bf3db11320 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:21.551391 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2ef3d3a3-e527-4e35-ab71-76bf3db11320 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:21.553686 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2ef3d3a3-e527-4e35-ab71-76bf3db11320 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:21.564392 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:27:21.871925 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-2ef3d3a3-e527-4e35-ab71-76bf3db11320 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:21.885928 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-2ef3d3a3-e527-4e35-ab71-76bf3db11320 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:21.889475 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-2ef3d3a3-e527-4e35-ab71-76bf3db11320 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:21.891101 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-2ef3d3a3-e527-4e35-ab71-76bf3db11320 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] 10.222.0.43 "GET /compute/v2.1/servers/0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc" status: 200 len: 1736 microversion: 2.20 time: 0.371350 Oct 04 22:27:21.893339 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3488/6438] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:27:21 2022] GET /compute/v2.1/servers/0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc => generated 1736 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 22:27:21.898252 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-a2999977-6414-47b3-9695-79851b774e2e tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:27:21.899399 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-a2999977-6414-47b3-9695-79851b774e2e tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: 47aa758b-a866-4254-b7ff-47ed2bd1c87f] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:27:21.906272 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a2999977-6414-47b3-9695-79851b774e2e tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:21.907185 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a2999977-6414-47b3-9695-79851b774e2e tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:21.908000 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a2999977-6414-47b3-9695-79851b774e2e tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:21.908966 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a2999977-6414-47b3-9695-79851b774e2e tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:21.909674 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a2999977-6414-47b3-9695-79851b774e2e tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:21.910390 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a2999977-6414-47b3-9695-79851b774e2e tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:22.061401 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-a2999977-6414-47b3-9695-79851b774e2e tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:22.069618 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-a2999977-6414-47b3-9695-79851b774e2e tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/47aa758b-a866-4254-b7ff-47ed2bd1c87f" status: 200 len: 1226 microversion: 2.1 time: 0.174931 Oct 04 22:27:22.070212 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3489/6439] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:27:21 2022] GET /compute/v2.1/servers/47aa758b-a866-4254-b7ff-47ed2bd1c87f => generated 1226 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:27:22.931800 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-a5df99ac-24ba-4afe-82b3-b6c4595d5fb8 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:27:22.934955 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-a5df99ac-24ba-4afe-82b3-b6c4595d5fb8 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] [instance: 0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:27:22.944373 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a5df99ac-24ba-4afe-82b3-b6c4595d5fb8 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:22.945279 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a5df99ac-24ba-4afe-82b3-b6c4595d5fb8 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:22.946004 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a5df99ac-24ba-4afe-82b3-b6c4595d5fb8 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:22.947125 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a5df99ac-24ba-4afe-82b3-b6c4595d5fb8 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:22.948533 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a5df99ac-24ba-4afe-82b3-b6c4595d5fb8 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:22.950517 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a5df99ac-24ba-4afe-82b3-b6c4595d5fb8 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:23.306667 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-a5df99ac-24ba-4afe-82b3-b6c4595d5fb8 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:23.316862 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-a5df99ac-24ba-4afe-82b3-b6c4595d5fb8 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:23.317488 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-a5df99ac-24ba-4afe-82b3-b6c4595d5fb8 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:23.321102 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-a5df99ac-24ba-4afe-82b3-b6c4595d5fb8 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] 10.222.0.43 "GET /compute/v2.1/servers/0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc" status: 200 len: 1736 microversion: 2.20 time: 0.398674 Oct 04 22:27:23.321699 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3490/6440] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:27:22 2022] GET /compute/v2.1/servers/0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc => generated 1736 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 22:27:23.329674 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-c219c905-757f-4d92-919a-358ed2dcbe6e tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:27:23.330598 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-c219c905-757f-4d92-919a-358ed2dcbe6e tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: 47aa758b-a866-4254-b7ff-47ed2bd1c87f] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:27:23.341760 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c219c905-757f-4d92-919a-358ed2dcbe6e tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:23.342545 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c219c905-757f-4d92-919a-358ed2dcbe6e tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:23.344632 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c219c905-757f-4d92-919a-358ed2dcbe6e tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:23.345695 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c219c905-757f-4d92-919a-358ed2dcbe6e tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:23.346764 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c219c905-757f-4d92-919a-358ed2dcbe6e tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:23.347755 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c219c905-757f-4d92-919a-358ed2dcbe6e tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:23.392403 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-c219c905-757f-4d92-919a-358ed2dcbe6e tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] HTTP exception thrown: Instance 47aa758b-a866-4254-b7ff-47ed2bd1c87f could not be found. Oct 04 22:27:23.397163 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-c219c905-757f-4d92-919a-358ed2dcbe6e tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Request method failure captured: Oct 04 22:27:23.397163 n-d-860284-1 devstack@n-api.service[134101]: request: GET /compute/v2.1/servers/47aa758b-a866-4254-b7ff-47ed2bd1c87f HTTP/1.1 Oct 04 22:27:23.397163 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 22:27:23.397163 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 22:27:23.397163 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 22:27:23.397163 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 22:27:23.397163 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 22:27:23.397163 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 22:27:23.397163 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 22:27:23.397163 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 22:27:23.397163 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPLFSMo9Eg9y9Lu454XN1MXkt5BE7HeG-NZdibz9nP5ZbzTcA5eo2fVm4gnqUdOUNPfyWilTQor2E780fAI_U9XTD5akzJ8-jVP8Fthos4syj8Pc9nJeMuZjrdlu2EkiFF5ef-9mxCQWUxHOpcRBLI1i5aPH69baR_Z4N2zYKYuhPE2w Oct 04 22:27:23.397163 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 22:27:23.397163 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 22:27:23.397163 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 22:27:23.397163 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 22:27:23.397163 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 22:27:23.397163 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 22:27:23.397163 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: 5c98a72bacce47c3947f9b0f0b4e85b6 Oct 04 22:27:23.397163 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-TestVolumeBootPattern-1701442207 Oct 04 22:27:23.397163 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 22:27:23.397163 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 22:27:23.397163 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5c98a72bacce47c3947f9b0f0b4e85b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_5c98a72bacce47c3947f9b0f0b4e85b6", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5c98a72bacce47c3947f9b0f0b4e85b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/5c98a72bacce47c3947f9b0f0b4e85b6"}]}] Oct 04 22:27:23.397163 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-TestVolumeBootPattern-1701442207 Oct 04 22:27:23.397163 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: 5c98a72bacce47c3947f9b0f0b4e85b6 Oct 04 22:27:23.397163 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-TestVolumeBootPattern-1701442207 Oct 04 22:27:23.397163 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-TestVolumeBootPattern-1701442207-project Oct 04 22:27:23.397163 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 22:27:23.397163 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 22:27:23.397163 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 99acad09db70445b93ae1d64a1b49ca3 Oct 04 22:27:23.397163 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-TestVolumeBootPattern-1701442207-project Oct 04 22:27:23.397163 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 22:27:23.397163 n-d-860284-1 devstack@n-api.service[134101]: exception: Instance 47aa758b-a866-4254-b7ff-47ed2bd1c87f could not be found. Oct 04 22:27:23.397163 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': '47aa758b-a866-4254-b7ff-47ed2bd1c87f'} Oct 04 22:27:23.397163 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:27:23.397163 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:27:23.397163 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:27:23.397163 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:27:23.397163 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:27:23.397163 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:27:23.397163 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:27:23.397163 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:27:23.397163 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:27:23.397163 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:27:23.397163 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47aa758b-a866-4254-b7ff-47ed2bd1c87f could not be found. Oct 04 22:27:23.397163 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:27:23.397163 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:27:23.397163 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:27:23.397163 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:27:23.397163 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:27:23.397163 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:27:23.397163 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:27:23.397163 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:27:23.397163 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:27:23.397163 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:27:23.397163 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:27:23.397163 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:27:23.397163 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:27:23.397163 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:27:23.397163 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:27:23.397163 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:27:23.397163 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47aa758b-a866-4254-b7ff-47ed2bd1c87f could not be found. Oct 04 22:27:23.397163 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:27:23.397163 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:27:23.397163 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:27:23.401569 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:27:23.401569 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:27:23.401569 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:27:23.401569 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:27:23.401569 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:27:23.401569 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47aa758b-a866-4254-b7ff-47ed2bd1c87f could not be found. Oct 04 22:27:23.401569 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:27:23.406622 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-c219c905-757f-4d92-919a-358ed2dcbe6e tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Returning 404 to user: Instance 47aa758b-a866-4254-b7ff-47ed2bd1c87f could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:27:23.407894 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-c219c905-757f-4d92-919a-358ed2dcbe6e tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/47aa758b-a866-4254-b7ff-47ed2bd1c87f" status: 404 len: 111 microversion: 2.1 time: 0.081996 Oct 04 22:27:23.410257 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3491/6441] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:27:23 2022] GET /compute/v2.1/servers/47aa758b-a866-4254-b7ff-47ed2bd1c87f => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:27:23.546149 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e3a06ee7-e1b0-42c9-97d7-5acac706d1ef tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1619932936", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1068515310", "security_groups": [{"name": "tempest-secgroup-smoke-1414317642"}], "block_device_mapping_v2": [{"uuid": "f601803f-c4f0-4557-a383-3eaaf7b30006", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f55a0794-d215-4510-84cc-a7b063c083a4"}]}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:27:23.834566 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.network.neutron [None req-e3a06ee7-e1b0-42c9-97d7-5acac706d1ef tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] validate_networks() for [('f55a0794-d215-4510-84cc-a7b063c083a4', None, None, None, None, None)] {{(pid=134101) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 22:27:24.644542 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=1 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:27:25.063913 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-e3a06ee7-e1b0-42c9-97d7-5acac706d1ef tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Flavor limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 22:27:25.064392 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-e3a06ee7-e1b0-42c9-97d7-5acac706d1ef tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Image limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 22:27:25.065158 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-e3a06ee7-e1b0-42c9-97d7-5acac706d1ef tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Flavor pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 22:27:25.065728 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-e3a06ee7-e1b0-42c9-97d7-5acac706d1ef tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Image pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 22:27:25.066170 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-e3a06ee7-e1b0-42c9-97d7-5acac706d1ef tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 22:27:25.093147 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e3a06ee7-e1b0-42c9-97d7-5acac706d1ef tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:25.093685 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e3a06ee7-e1b0-42c9-97d7-5acac706d1ef tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:25.094136 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e3a06ee7-e1b0-42c9-97d7-5acac706d1ef tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:25.094921 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e3a06ee7-e1b0-42c9-97d7-5acac706d1ef tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:25.095385 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e3a06ee7-e1b0-42c9-97d7-5acac706d1ef tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:25.096035 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e3a06ee7-e1b0-42c9-97d7-5acac706d1ef tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:25.151889 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-e3a06ee7-e1b0-42c9-97d7-5acac706d1ef tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Getting quotas for project 5c98a72bacce47c3947f9b0f0b4e85b6. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:27:25.160288 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-e3a06ee7-e1b0-42c9-97d7-5acac706d1ef tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Getting quotas for user 99acad09db70445b93ae1d64a1b49ca3 and project 5c98a72bacce47c3947f9b0f0b4e85b6. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:27:25.248869 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-e3a06ee7-e1b0-42c9-97d7-5acac706d1ef tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Going to run 1 instances... {{(pid=134101) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 22:27:25.251671 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-e3a06ee7-e1b0-42c9-97d7-5acac706d1ef tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: f1dea61d-0ca6-457d-9d1b-3aff96427d52] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f601803f-c4f0-4557-a383-3eaaf7b30006',volume_size=None,volume_type=None)] {{(pid=134101) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 22:27:25.540672 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-e3a06ee7-e1b0-42c9-97d7-5acac706d1ef tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.998389 Oct 04 22:27:25.542039 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3492/6442] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 22:27:23 2022] POST /compute/v2.1/servers => generated 406 bytes in 2000 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 22:27:25.547003 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-d7257b15-a19f-4139-9ec7-77faba037918 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:27:25.549045 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-d7257b15-a19f-4139-9ec7-77faba037918 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] [instance: 0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:27:25.558260 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d7257b15-a19f-4139-9ec7-77faba037918 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:25.559121 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d7257b15-a19f-4139-9ec7-77faba037918 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:25.559742 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d7257b15-a19f-4139-9ec7-77faba037918 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:25.560795 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d7257b15-a19f-4139-9ec7-77faba037918 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:25.561970 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d7257b15-a19f-4139-9ec7-77faba037918 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:25.562616 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d7257b15-a19f-4139-9ec7-77faba037918 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:25.800944 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-d7257b15-a19f-4139-9ec7-77faba037918 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:25.812807 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-d7257b15-a19f-4139-9ec7-77faba037918 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:25.814232 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-d7257b15-a19f-4139-9ec7-77faba037918 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:25.820138 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-d7257b15-a19f-4139-9ec7-77faba037918 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] 10.222.0.43 "GET /compute/v2.1/servers/0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc" status: 200 len: 1736 microversion: 2.20 time: 0.272206 Oct 04 22:27:25.821076 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3493/6443] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:27:25 2022] GET /compute/v2.1/servers/0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc => generated 1736 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:27:25.831761 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-785fcc63-a358-4d32-8d9a-78ce1ae40b56 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:27:25.833686 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-785fcc63-a358-4d32-8d9a-78ce1ae40b56 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: f1dea61d-0ca6-457d-9d1b-3aff96427d52] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:27:26.023544 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-785fcc63-a358-4d32-8d9a-78ce1ae40b56 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:26.036517 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-785fcc63-a358-4d32-8d9a-78ce1ae40b56 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/f1dea61d-0ca6-457d-9d1b-3aff96427d52" status: 200 len: 1095 microversion: 2.1 time: 0.212350 Oct 04 22:27:26.038703 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3494/6444] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:27:25 2022] GET /compute/v2.1/servers/f1dea61d-0ca6-457d-9d1b-3aff96427d52 => generated 1095 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:27:26.848201 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-3a70b57f-c823-4b97-b55d-a57e61826a65 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:27:26.850445 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-3a70b57f-c823-4b97-b55d-a57e61826a65 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] [instance: 0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:27:26.868259 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3a70b57f-c823-4b97-b55d-a57e61826a65 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:26.869030 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3a70b57f-c823-4b97-b55d-a57e61826a65 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:26.870118 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3a70b57f-c823-4b97-b55d-a57e61826a65 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:26.875547 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3a70b57f-c823-4b97-b55d-a57e61826a65 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:26.876245 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3a70b57f-c823-4b97-b55d-a57e61826a65 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:26.877923 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3a70b57f-c823-4b97-b55d-a57e61826a65 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:27.141955 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-3a70b57f-c823-4b97-b55d-a57e61826a65 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:27.162786 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-3a70b57f-c823-4b97-b55d-a57e61826a65 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:27.166190 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-3a70b57f-c823-4b97-b55d-a57e61826a65 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:27.167782 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-3a70b57f-c823-4b97-b55d-a57e61826a65 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] 10.222.0.43 "GET /compute/v2.1/servers/0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc" status: 200 len: 1736 microversion: 2.20 time: 0.323696 Oct 04 22:27:27.171410 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3495/6445] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:27:26 2022] GET /compute/v2.1/servers/0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc => generated 1736 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 22:27:27.186928 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-810c4d7b-cb94-485b-855c-3ea35ddcd16a tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:27:27.190151 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-810c4d7b-cb94-485b-855c-3ea35ddcd16a tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: f1dea61d-0ca6-457d-9d1b-3aff96427d52] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:27:27.211391 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-810c4d7b-cb94-485b-855c-3ea35ddcd16a tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:27.221625 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-810c4d7b-cb94-485b-855c-3ea35ddcd16a tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:27.222545 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-810c4d7b-cb94-485b-855c-3ea35ddcd16a tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:27.228866 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-810c4d7b-cb94-485b-855c-3ea35ddcd16a tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:27.229483 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-810c4d7b-cb94-485b-855c-3ea35ddcd16a tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:27.229952 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-810c4d7b-cb94-485b-855c-3ea35ddcd16a tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:27.383298 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-810c4d7b-cb94-485b-855c-3ea35ddcd16a tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:27.391896 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-810c4d7b-cb94-485b-855c-3ea35ddcd16a tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/f1dea61d-0ca6-457d-9d1b-3aff96427d52" status: 200 len: 1211 microversion: 2.1 time: 0.218704 Oct 04 22:27:27.392488 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3496/6446] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:27:27 2022] GET /compute/v2.1/servers/f1dea61d-0ca6-457d-9d1b-3aff96427d52 => generated 1211 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:27:28.198391 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-4b4e720e-4c97-4517-b569-a9455ceafa51 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:27:28.199004 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-4b4e720e-4c97-4517-b569-a9455ceafa51 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] [instance: 0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:27:28.212044 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4b4e720e-4c97-4517-b569-a9455ceafa51 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:28.213103 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4b4e720e-4c97-4517-b569-a9455ceafa51 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:28.213763 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4b4e720e-4c97-4517-b569-a9455ceafa51 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:28.215058 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4b4e720e-4c97-4517-b569-a9455ceafa51 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:28.218225 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4b4e720e-4c97-4517-b569-a9455ceafa51 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:28.218991 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4b4e720e-4c97-4517-b569-a9455ceafa51 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:28.584832 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-4b4e720e-4c97-4517-b569-a9455ceafa51 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:28.598242 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-4b4e720e-4c97-4517-b569-a9455ceafa51 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:28.605094 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-4b4e720e-4c97-4517-b569-a9455ceafa51 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:28.606887 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-4b4e720e-4c97-4517-b569-a9455ceafa51 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] 10.222.0.43 "GET /compute/v2.1/servers/0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc" status: 200 len: 1736 microversion: 2.20 time: 0.413481 Oct 04 22:27:28.608053 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3497/6447] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:27:28 2022] GET /compute/v2.1/servers/0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc => generated 1736 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 22:27:28.614931 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-15f3da1c-d1c6-47ff-ae92-e4c7a411b0b3 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:27:28.615893 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-15f3da1c-d1c6-47ff-ae92-e4c7a411b0b3 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: f1dea61d-0ca6-457d-9d1b-3aff96427d52] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:27:28.622684 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-15f3da1c-d1c6-47ff-ae92-e4c7a411b0b3 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:28.623492 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-15f3da1c-d1c6-47ff-ae92-e4c7a411b0b3 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:28.624180 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-15f3da1c-d1c6-47ff-ae92-e4c7a411b0b3 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:28.625280 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-15f3da1c-d1c6-47ff-ae92-e4c7a411b0b3 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:28.626833 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-15f3da1c-d1c6-47ff-ae92-e4c7a411b0b3 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:28.627749 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-15f3da1c-d1c6-47ff-ae92-e4c7a411b0b3 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:28.869210 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-15f3da1c-d1c6-47ff-ae92-e4c7a411b0b3 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:28.881778 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-15f3da1c-d1c6-47ff-ae92-e4c7a411b0b3 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/f1dea61d-0ca6-457d-9d1b-3aff96427d52" status: 200 len: 1279 microversion: 2.1 time: 0.272189 Oct 04 22:27:28.890723 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3498/6448] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:27:28 2022] GET /compute/v2.1/servers/f1dea61d-0ca6-457d-9d1b-3aff96427d52 => generated 1279 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:27:29.354526 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-8efc9bf7-a61d-4f28-868a-589e4789a56e req-469d3734-1f71-43d9-8428-fc185122805c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1dea61d-0ca6-457d-9d1b-3aff96427d52", "tag": "4a95490d-6ee2-4e08-a931-9210ae4b290c"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:27:29.376562 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-8efc9bf7-a61d-4f28-868a-589e4789a56e req-469d3734-1f71-43d9-8428-fc185122805c service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:29.377065 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-8efc9bf7-a61d-4f28-868a-589e4789a56e req-469d3734-1f71-43d9-8428-fc185122805c service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:29.377595 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-8efc9bf7-a61d-4f28-868a-589e4789a56e req-469d3734-1f71-43d9-8428-fc185122805c service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:29.405706 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-8efc9bf7-a61d-4f28-868a-589e4789a56e req-469d3734-1f71-43d9-8428-fc185122805c service nova] Creating event network-changed:4a95490d-6ee2-4e08-a931-9210ae4b290c for instance f1dea61d-0ca6-457d-9d1b-3aff96427d52 on n-h1-860284-1 Oct 04 22:27:29.417638 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-8efc9bf7-a61d-4f28-868a-589e4789a56e req-469d3734-1f71-43d9-8428-fc185122805c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066958 Oct 04 22:27:29.419395 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3499/6449] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:27:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:27:29.642648 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-2d8c8282-a331-4023-ac2e-4c552ad8e648 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:27:29.643938 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-2d8c8282-a331-4023-ac2e-4c552ad8e648 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] [instance: 0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:27:29.655084 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2d8c8282-a331-4023-ac2e-4c552ad8e648 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:29.655890 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2d8c8282-a331-4023-ac2e-4c552ad8e648 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:29.656762 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2d8c8282-a331-4023-ac2e-4c552ad8e648 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:29.657843 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2d8c8282-a331-4023-ac2e-4c552ad8e648 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:29.658526 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2d8c8282-a331-4023-ac2e-4c552ad8e648 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:29.660191 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2d8c8282-a331-4023-ac2e-4c552ad8e648 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:30.037246 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-2d8c8282-a331-4023-ac2e-4c552ad8e648 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:30.046791 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-2d8c8282-a331-4023-ac2e-4c552ad8e648 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:30.048300 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-2d8c8282-a331-4023-ac2e-4c552ad8e648 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:30.049802 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-2d8c8282-a331-4023-ac2e-4c552ad8e648 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] 10.222.0.43 "GET /compute/v2.1/servers/0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc" status: 200 len: 1736 microversion: 2.20 time: 0.414036 Oct 04 22:27:30.063224 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3500/6450] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:27:29 2022] GET /compute/v2.1/servers/0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc => generated 1736 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 22:27:30.076239 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e8b91631-f1e0-4faa-b15b-d527007a7482 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:27:30.076894 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-e8b91631-f1e0-4faa-b15b-d527007a7482 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: f1dea61d-0ca6-457d-9d1b-3aff96427d52] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:27:30.084609 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e8b91631-f1e0-4faa-b15b-d527007a7482 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:30.085140 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e8b91631-f1e0-4faa-b15b-d527007a7482 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:30.085611 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e8b91631-f1e0-4faa-b15b-d527007a7482 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:30.086593 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e8b91631-f1e0-4faa-b15b-d527007a7482 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:30.086889 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e8b91631-f1e0-4faa-b15b-d527007a7482 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:30.087342 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e8b91631-f1e0-4faa-b15b-d527007a7482 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:30.433822 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-e8b91631-f1e0-4faa-b15b-d527007a7482 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:30.463177 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-e8b91631-f1e0-4faa-b15b-d527007a7482 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/f1dea61d-0ca6-457d-9d1b-3aff96427d52" status: 200 len: 1279 microversion: 2.1 time: 0.387238 Oct 04 22:27:30.465084 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3501/6451] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:27:30 2022] GET /compute/v2.1/servers/f1dea61d-0ca6-457d-9d1b-3aff96427d52 => generated 1279 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:27:31.078915 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-c6d85f91-61c9-4c93-8b3e-522be757f1d2 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:27:31.079624 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-c6d85f91-61c9-4c93-8b3e-522be757f1d2 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] [instance: 0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:27:31.089862 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c6d85f91-61c9-4c93-8b3e-522be757f1d2 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:31.090464 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c6d85f91-61c9-4c93-8b3e-522be757f1d2 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:31.103075 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c6d85f91-61c9-4c93-8b3e-522be757f1d2 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:31.103871 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c6d85f91-61c9-4c93-8b3e-522be757f1d2 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:31.104363 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c6d85f91-61c9-4c93-8b3e-522be757f1d2 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:31.104850 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c6d85f91-61c9-4c93-8b3e-522be757f1d2 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:31.347776 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-c6d85f91-61c9-4c93-8b3e-522be757f1d2 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:31.360632 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-c6d85f91-61c9-4c93-8b3e-522be757f1d2 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:31.362648 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-c6d85f91-61c9-4c93-8b3e-522be757f1d2 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:31.365101 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-c6d85f91-61c9-4c93-8b3e-522be757f1d2 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] 10.222.0.43 "GET /compute/v2.1/servers/0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc" status: 200 len: 1718 microversion: 2.20 time: 0.289418 Oct 04 22:27:31.366023 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3502/6452] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:27:31 2022] GET /compute/v2.1/servers/0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc => generated 1718 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 22:27:31.490070 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-3d56e166-86f8-4356-809b-c9e109b62bed tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:27:31.491654 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-3d56e166-86f8-4356-809b-c9e109b62bed tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: f1dea61d-0ca6-457d-9d1b-3aff96427d52] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:27:31.498987 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3d56e166-86f8-4356-809b-c9e109b62bed tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:31.499783 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3d56e166-86f8-4356-809b-c9e109b62bed tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:31.500521 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3d56e166-86f8-4356-809b-c9e109b62bed tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:31.501474 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3d56e166-86f8-4356-809b-c9e109b62bed tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:31.502198 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3d56e166-86f8-4356-809b-c9e109b62bed tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:31.503406 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3d56e166-86f8-4356-809b-c9e109b62bed tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:32.147136 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-3d56e166-86f8-4356-809b-c9e109b62bed tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:32.157454 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-3d56e166-86f8-4356-809b-c9e109b62bed tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/f1dea61d-0ca6-457d-9d1b-3aff96427d52" status: 200 len: 1279 microversion: 2.1 time: 0.673008 Oct 04 22:27:32.162062 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3503/6453] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:27:31 2022] GET /compute/v2.1/servers/f1dea61d-0ca6-457d-9d1b-3aff96427d52 => generated 1279 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:27:32.392548 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-9ed7418d-3a12-48d9-9ee4-33065fbb0aac tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:27:32.393322 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-9ed7418d-3a12-48d9-9ee4-33065fbb0aac tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] [instance: 0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:27:32.400309 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9ed7418d-3a12-48d9-9ee4-33065fbb0aac tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:32.401039 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9ed7418d-3a12-48d9-9ee4-33065fbb0aac tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:32.401675 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9ed7418d-3a12-48d9-9ee4-33065fbb0aac tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:32.402417 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9ed7418d-3a12-48d9-9ee4-33065fbb0aac tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:32.403093 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9ed7418d-3a12-48d9-9ee4-33065fbb0aac tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:32.403694 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9ed7418d-3a12-48d9-9ee4-33065fbb0aac tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:32.566697 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-9ed7418d-3a12-48d9-9ee4-33065fbb0aac tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:32.577014 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-9ed7418d-3a12-48d9-9ee4-33065fbb0aac tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:32.578585 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-9ed7418d-3a12-48d9-9ee4-33065fbb0aac tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:32.579991 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-9ed7418d-3a12-48d9-9ee4-33065fbb0aac tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] 10.222.0.43 "GET /compute/v2.1/servers/0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc" status: 200 len: 1721 microversion: 2.20 time: 0.191854 Oct 04 22:27:32.596056 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3504/6454] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:27:32 2022] GET /compute/v2.1/servers/0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc => generated 1721 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 22:27:32.607840 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-354fb2ed-a5a6-4ddc-9571-f520e1bf2d7c tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0481f447-5070-497d-8b17-a4e5503dd70c"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:27:32.611318 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-354fb2ed-a5a6-4ddc-9571-f520e1bf2d7c tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] [instance: 0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:27:32.618233 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-354fb2ed-a5a6-4ddc-9571-f520e1bf2d7c tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:32.619042 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-354fb2ed-a5a6-4ddc-9571-f520e1bf2d7c tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:32.619655 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-354fb2ed-a5a6-4ddc-9571-f520e1bf2d7c tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:32.620753 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-354fb2ed-a5a6-4ddc-9571-f520e1bf2d7c tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:32.621381 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-354fb2ed-a5a6-4ddc-9571-f520e1bf2d7c tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:32.621981 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-354fb2ed-a5a6-4ddc-9571-f520e1bf2d7c tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:33.093902 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:27:33.127742 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-354fb2ed-a5a6-4ddc-9571-f520e1bf2d7c tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] 10.222.0.43 "POST /compute/v2.1/servers/0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.524221 Oct 04 22:27:33.136128 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3505/6455] 10.222.0.43 () {62 vars in 1364 bytes} [Tue Oct 4 22:27:32 2022] POST /compute/v2.1/servers/0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc/os-volume_attachments => generated 188 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 22:27:33.184848 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-c9321e73-2780-40af-9e04-c8ccfb8fb1c6 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:27:33.185629 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-c9321e73-2780-40af-9e04-c8ccfb8fb1c6 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: f1dea61d-0ca6-457d-9d1b-3aff96427d52] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:27:33.196143 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c9321e73-2780-40af-9e04-c8ccfb8fb1c6 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:33.202245 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c9321e73-2780-40af-9e04-c8ccfb8fb1c6 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:33.202245 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c9321e73-2780-40af-9e04-c8ccfb8fb1c6 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:33.203582 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c9321e73-2780-40af-9e04-c8ccfb8fb1c6 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:33.204147 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c9321e73-2780-40af-9e04-c8ccfb8fb1c6 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:33.204648 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c9321e73-2780-40af-9e04-c8ccfb8fb1c6 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:33.403230 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-c9321e73-2780-40af-9e04-c8ccfb8fb1c6 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:33.411112 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-c9321e73-2780-40af-9e04-c8ccfb8fb1c6 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/f1dea61d-0ca6-457d-9d1b-3aff96427d52" status: 200 len: 1279 microversion: 2.1 time: 0.230745 Oct 04 22:27:33.411918 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3506/6456] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:27:33 2022] GET /compute/v2.1/servers/f1dea61d-0ca6-457d-9d1b-3aff96427d52 => generated 1279 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:27:33.416463 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-09459709-1c75-4ccf-a1cc-d3d6d82f80b7 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:27:33.417074 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-09459709-1c75-4ccf-a1cc-d3d6d82f80b7 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] [instance: 0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:27:33.423053 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-09459709-1c75-4ccf-a1cc-d3d6d82f80b7 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:33.423581 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-09459709-1c75-4ccf-a1cc-d3d6d82f80b7 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:33.424119 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-09459709-1c75-4ccf-a1cc-d3d6d82f80b7 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:33.424885 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-09459709-1c75-4ccf-a1cc-d3d6d82f80b7 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:33.425383 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-09459709-1c75-4ccf-a1cc-d3d6d82f80b7 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:33.425820 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-09459709-1c75-4ccf-a1cc-d3d6d82f80b7 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:33.475103 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-09459709-1c75-4ccf-a1cc-d3d6d82f80b7 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] [instance: 0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=134101) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 04 22:27:33.556682 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-09459709-1c75-4ccf-a1cc-d3d6d82f80b7 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] 10.222.0.43 "POST /compute/v2.1/servers/0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc/action" status: 202 len: 0 microversion: 2.20 time: 0.143804 Oct 04 22:27:33.557313 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3507/6457] 10.222.0.43 () {62 vars in 1319 bytes} [Tue Oct 4 22:27:33 2022] POST /compute/v2.1/servers/0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc/action => generated 0 bytes in 145 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 22:27:33.567163 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-69dff834-0ebd-4766-979a-8e172b1746d4 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:27:33.568062 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-69dff834-0ebd-4766-979a-8e172b1746d4 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] [instance: 0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:27:33.574833 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-69dff834-0ebd-4766-979a-8e172b1746d4 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:33.575406 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-69dff834-0ebd-4766-979a-8e172b1746d4 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:33.575875 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-69dff834-0ebd-4766-979a-8e172b1746d4 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:33.576611 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-69dff834-0ebd-4766-979a-8e172b1746d4 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:33.577091 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-69dff834-0ebd-4766-979a-8e172b1746d4 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:33.577541 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-69dff834-0ebd-4766-979a-8e172b1746d4 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:33.769324 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-69dff834-0ebd-4766-979a-8e172b1746d4 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:33.786329 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-69dff834-0ebd-4766-979a-8e172b1746d4 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:33.787911 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-69dff834-0ebd-4766-979a-8e172b1746d4 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:33.789576 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-69dff834-0ebd-4766-979a-8e172b1746d4 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] 10.222.0.43 "GET /compute/v2.1/servers/0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc" status: 200 len: 1747 microversion: 2.20 time: 0.227102 Oct 04 22:27:33.805299 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3508/6458] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:27:33 2022] GET /compute/v2.1/servers/0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc => generated 1747 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 22:27:33.901974 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-c0d4b92e-1263-46a4-a261-fe5cd2dccb6e req-5410c144-8c9e-45c0-ae07-edbd5ff12ad0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc", "name": "network-vif-unplugged", "status": "completed", "tag": "92737fc4-3618-4a96-a0a0-09038568173c"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:27:33.920591 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-c0d4b92e-1263-46a4-a261-fe5cd2dccb6e req-5410c144-8c9e-45c0-ae07-edbd5ff12ad0 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:33.923340 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-c0d4b92e-1263-46a4-a261-fe5cd2dccb6e req-5410c144-8c9e-45c0-ae07-edbd5ff12ad0 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:33.925637 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-c0d4b92e-1263-46a4-a261-fe5cd2dccb6e req-5410c144-8c9e-45c0-ae07-edbd5ff12ad0 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:33.944949 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.compute.server_external_events [req-c0d4b92e-1263-46a4-a261-fe5cd2dccb6e req-5410c144-8c9e-45c0-ae07-edbd5ff12ad0 service nova] Unable to find a host for instance 0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc. Dropping event network-vif-unplugged {{(pid=134101) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 04 22:27:33.946239 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-c0d4b92e-1263-46a4-a261-fe5cd2dccb6e req-5410c144-8c9e-45c0-ae07-edbd5ff12ad0 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.048541 Oct 04 22:27:33.947067 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3509/6459] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:27:33 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 50 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 04 22:27:34.436551 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-71a288b8-385d-4686-9304-d1aea9689f1e tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:27:34.443944 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-71a288b8-385d-4686-9304-d1aea9689f1e tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: f1dea61d-0ca6-457d-9d1b-3aff96427d52] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:27:34.458908 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-71a288b8-385d-4686-9304-d1aea9689f1e tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:34.459415 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-71a288b8-385d-4686-9304-d1aea9689f1e tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:34.459870 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-71a288b8-385d-4686-9304-d1aea9689f1e tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:34.460641 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-71a288b8-385d-4686-9304-d1aea9689f1e tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:34.461110 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-71a288b8-385d-4686-9304-d1aea9689f1e tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:34.461591 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-71a288b8-385d-4686-9304-d1aea9689f1e tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:34.616896 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-71a288b8-385d-4686-9304-d1aea9689f1e tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:34.626552 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-71a288b8-385d-4686-9304-d1aea9689f1e tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/f1dea61d-0ca6-457d-9d1b-3aff96427d52" status: 200 len: 1267 microversion: 2.1 time: 0.194655 Oct 04 22:27:34.627386 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3510/6460] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:27:34 2022] GET /compute/v2.1/servers/f1dea61d-0ca6-457d-9d1b-3aff96427d52 => generated 1267 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:27:34.815900 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-10a50722-6f28-4fe7-aece-e9fe9e7cae73 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:27:34.816542 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-10a50722-6f28-4fe7-aece-e9fe9e7cae73 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] [instance: 0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:27:34.822932 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-10a50722-6f28-4fe7-aece-e9fe9e7cae73 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:34.823447 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-10a50722-6f28-4fe7-aece-e9fe9e7cae73 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:34.823905 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-10a50722-6f28-4fe7-aece-e9fe9e7cae73 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:34.824632 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-10a50722-6f28-4fe7-aece-e9fe9e7cae73 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:34.825105 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-10a50722-6f28-4fe7-aece-e9fe9e7cae73 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:34.825551 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-10a50722-6f28-4fe7-aece-e9fe9e7cae73 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:34.981637 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-10a50722-6f28-4fe7-aece-e9fe9e7cae73 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:34.991512 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-10a50722-6f28-4fe7-aece-e9fe9e7cae73 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:34.993319 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-10a50722-6f28-4fe7-aece-e9fe9e7cae73 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:34.994865 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-10a50722-6f28-4fe7-aece-e9fe9e7cae73 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] 10.222.0.43 "GET /compute/v2.1/servers/0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc" status: 200 len: 1747 microversion: 2.20 time: 0.183123 Oct 04 22:27:34.995686 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3511/6461] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:27:34 2022] GET /compute/v2.1/servers/0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc => generated 1747 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 22:27:35.651525 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-5d0f8a1d-3fa9-4073-a9b3-2160a69a6f80 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:27:35.652176 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-5d0f8a1d-3fa9-4073-a9b3-2160a69a6f80 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: f1dea61d-0ca6-457d-9d1b-3aff96427d52] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:27:35.655470 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=2 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:27:35.662238 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5d0f8a1d-3fa9-4073-a9b3-2160a69a6f80 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:35.662921 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5d0f8a1d-3fa9-4073-a9b3-2160a69a6f80 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:35.663452 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5d0f8a1d-3fa9-4073-a9b3-2160a69a6f80 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:35.664425 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5d0f8a1d-3fa9-4073-a9b3-2160a69a6f80 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:35.664975 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5d0f8a1d-3fa9-4073-a9b3-2160a69a6f80 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:35.665434 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5d0f8a1d-3fa9-4073-a9b3-2160a69a6f80 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:35.829502 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-5d0f8a1d-3fa9-4073-a9b3-2160a69a6f80 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:35.837547 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-5d0f8a1d-3fa9-4073-a9b3-2160a69a6f80 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/f1dea61d-0ca6-457d-9d1b-3aff96427d52" status: 200 len: 1267 microversion: 2.1 time: 0.190776 Oct 04 22:27:35.838128 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3512/6462] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:27:35 2022] GET /compute/v2.1/servers/f1dea61d-0ca6-457d-9d1b-3aff96427d52 => generated 1267 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:27:36.026484 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-c9cf4266-1b46-48e9-8d73-074d229d8b53 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:27:36.027498 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-c9cf4266-1b46-48e9-8d73-074d229d8b53 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] [instance: 0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:27:36.033168 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=8 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:27:36.034788 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c9cf4266-1b46-48e9-8d73-074d229d8b53 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:36.035462 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c9cf4266-1b46-48e9-8d73-074d229d8b53 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:36.036492 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c9cf4266-1b46-48e9-8d73-074d229d8b53 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:36.037670 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c9cf4266-1b46-48e9-8d73-074d229d8b53 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:36.038152 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c9cf4266-1b46-48e9-8d73-074d229d8b53 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:36.038658 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c9cf4266-1b46-48e9-8d73-074d229d8b53 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:36.191842 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-c9cf4266-1b46-48e9-8d73-074d229d8b53 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:36.201715 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-c9cf4266-1b46-48e9-8d73-074d229d8b53 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:36.203141 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-c9cf4266-1b46-48e9-8d73-074d229d8b53 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:36.204344 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-c9cf4266-1b46-48e9-8d73-074d229d8b53 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] 10.222.0.43 "GET /compute/v2.1/servers/0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc" status: 200 len: 1747 microversion: 2.20 time: 0.185582 Oct 04 22:27:36.205062 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3513/6463] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:27:36 2022] GET /compute/v2.1/servers/0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc => generated 1747 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 22:27:36.861120 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-86cb0ec9-099b-4747-9ea8-337e6a3fd863 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:27:36.861771 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-86cb0ec9-099b-4747-9ea8-337e6a3fd863 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: f1dea61d-0ca6-457d-9d1b-3aff96427d52] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:27:36.871293 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-86cb0ec9-099b-4747-9ea8-337e6a3fd863 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:36.871810 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-86cb0ec9-099b-4747-9ea8-337e6a3fd863 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:36.872276 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-86cb0ec9-099b-4747-9ea8-337e6a3fd863 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:36.873092 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-86cb0ec9-099b-4747-9ea8-337e6a3fd863 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:36.873702 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-86cb0ec9-099b-4747-9ea8-337e6a3fd863 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:36.874164 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-86cb0ec9-099b-4747-9ea8-337e6a3fd863 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:37.037695 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-86cb0ec9-099b-4747-9ea8-337e6a3fd863 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:37.047273 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-86cb0ec9-099b-4747-9ea8-337e6a3fd863 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/f1dea61d-0ca6-457d-9d1b-3aff96427d52" status: 200 len: 1267 microversion: 2.1 time: 0.190030 Oct 04 22:27:37.048183 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3514/6464] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:27:36 2022] GET /compute/v2.1/servers/f1dea61d-0ca6-457d-9d1b-3aff96427d52 => generated 1267 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:27:37.233856 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-59a2c677-4168-4a04-950a-68372a53743e tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:27:37.234606 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-59a2c677-4168-4a04-950a-68372a53743e tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] [instance: 0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:27:37.242431 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-59a2c677-4168-4a04-950a-68372a53743e tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:37.243028 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-59a2c677-4168-4a04-950a-68372a53743e tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:37.243552 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-59a2c677-4168-4a04-950a-68372a53743e tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:37.245001 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-59a2c677-4168-4a04-950a-68372a53743e tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:37.245554 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-59a2c677-4168-4a04-950a-68372a53743e tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:37.246068 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-59a2c677-4168-4a04-950a-68372a53743e tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:37.480423 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-59a2c677-4168-4a04-950a-68372a53743e tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:37.491446 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-59a2c677-4168-4a04-950a-68372a53743e tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:37.493132 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-59a2c677-4168-4a04-950a-68372a53743e tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:37.494567 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-59a2c677-4168-4a04-950a-68372a53743e tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] 10.222.0.43 "GET /compute/v2.1/servers/0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc" status: 200 len: 1749 microversion: 2.20 time: 0.266048 Oct 04 22:27:37.495254 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3515/6465] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:27:37 2022] GET /compute/v2.1/servers/0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc => generated 1749 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:27:38.074137 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-2475c2bb-1b10-4aca-9076-d32b1c4efb57 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:27:38.075187 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-2475c2bb-1b10-4aca-9076-d32b1c4efb57 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: f1dea61d-0ca6-457d-9d1b-3aff96427d52] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:27:38.082212 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2475c2bb-1b10-4aca-9076-d32b1c4efb57 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:38.083727 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2475c2bb-1b10-4aca-9076-d32b1c4efb57 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:38.084522 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2475c2bb-1b10-4aca-9076-d32b1c4efb57 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:38.085410 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2475c2bb-1b10-4aca-9076-d32b1c4efb57 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:38.085883 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2475c2bb-1b10-4aca-9076-d32b1c4efb57 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:38.086323 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2475c2bb-1b10-4aca-9076-d32b1c4efb57 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:38.302156 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-2475c2bb-1b10-4aca-9076-d32b1c4efb57 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:38.311665 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-2475c2bb-1b10-4aca-9076-d32b1c4efb57 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/f1dea61d-0ca6-457d-9d1b-3aff96427d52" status: 200 len: 1267 microversion: 2.1 time: 0.241344 Oct 04 22:27:38.312657 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3516/6466] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:27:38 2022] GET /compute/v2.1/servers/f1dea61d-0ca6-457d-9d1b-3aff96427d52 => generated 1267 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:27:38.523357 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-15bfb9ea-603d-4c84-b556-35c8981cb163 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:27:38.525135 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-15bfb9ea-603d-4c84-b556-35c8981cb163 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] [instance: 0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:27:38.532699 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-15bfb9ea-603d-4c84-b556-35c8981cb163 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:38.534463 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-15bfb9ea-603d-4c84-b556-35c8981cb163 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:38.535155 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-15bfb9ea-603d-4c84-b556-35c8981cb163 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:38.537099 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-15bfb9ea-603d-4c84-b556-35c8981cb163 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:38.538237 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-15bfb9ea-603d-4c84-b556-35c8981cb163 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:38.539805 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-15bfb9ea-603d-4c84-b556-35c8981cb163 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:38.822081 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-15bfb9ea-603d-4c84-b556-35c8981cb163 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:38.838139 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-15bfb9ea-603d-4c84-b556-35c8981cb163 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:38.841115 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-15bfb9ea-603d-4c84-b556-35c8981cb163 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:38.843811 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-15bfb9ea-603d-4c84-b556-35c8981cb163 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] 10.222.0.43 "GET /compute/v2.1/servers/0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc" status: 200 len: 1749 microversion: 2.20 time: 0.325409 Oct 04 22:27:38.845908 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3517/6467] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:27:38 2022] GET /compute/v2.1/servers/0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc => generated 1749 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:27:39.335991 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-9d47f980-b04e-45ad-9cab-de13b1be6362 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:27:39.337381 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-9d47f980-b04e-45ad-9cab-de13b1be6362 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: f1dea61d-0ca6-457d-9d1b-3aff96427d52] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:27:39.344592 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9d47f980-b04e-45ad-9cab-de13b1be6362 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:39.345215 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9d47f980-b04e-45ad-9cab-de13b1be6362 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:39.345776 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9d47f980-b04e-45ad-9cab-de13b1be6362 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:39.346635 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9d47f980-b04e-45ad-9cab-de13b1be6362 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:39.347360 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9d47f980-b04e-45ad-9cab-de13b1be6362 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:39.348432 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9d47f980-b04e-45ad-9cab-de13b1be6362 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:39.545336 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-9d47f980-b04e-45ad-9cab-de13b1be6362 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:39.553844 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-9d47f980-b04e-45ad-9cab-de13b1be6362 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/f1dea61d-0ca6-457d-9d1b-3aff96427d52" status: 200 len: 1267 microversion: 2.1 time: 0.221964 Oct 04 22:27:39.554639 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3518/6468] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:27:39 2022] GET /compute/v2.1/servers/f1dea61d-0ca6-457d-9d1b-3aff96427d52 => generated 1267 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:27:39.873439 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-4c79c37b-c145-4686-befe-1456c7160a79 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:27:39.874175 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-4c79c37b-c145-4686-befe-1456c7160a79 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] [instance: 0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:27:39.886091 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4c79c37b-c145-4686-befe-1456c7160a79 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:39.886637 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4c79c37b-c145-4686-befe-1456c7160a79 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:39.887095 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4c79c37b-c145-4686-befe-1456c7160a79 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:39.887821 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4c79c37b-c145-4686-befe-1456c7160a79 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:39.888482 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4c79c37b-c145-4686-befe-1456c7160a79 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:39.889004 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4c79c37b-c145-4686-befe-1456c7160a79 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:40.161332 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-4c79c37b-c145-4686-befe-1456c7160a79 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:40.174106 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-4c79c37b-c145-4686-befe-1456c7160a79 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:40.177345 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-4c79c37b-c145-4686-befe-1456c7160a79 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:40.179575 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-4c79c37b-c145-4686-befe-1456c7160a79 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] 10.222.0.43 "GET /compute/v2.1/servers/0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc" status: 200 len: 1749 microversion: 2.20 time: 0.310209 Oct 04 22:27:40.181076 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3519/6469] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:27:39 2022] GET /compute/v2.1/servers/0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc => generated 1749 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 22:27:40.579665 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-db5e5719-74e4-4b44-9bcd-f643ddc08630 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:27:40.580384 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-db5e5719-74e4-4b44-9bcd-f643ddc08630 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: f1dea61d-0ca6-457d-9d1b-3aff96427d52] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:27:40.596394 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-db5e5719-74e4-4b44-9bcd-f643ddc08630 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:40.596929 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-db5e5719-74e4-4b44-9bcd-f643ddc08630 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:40.597401 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-db5e5719-74e4-4b44-9bcd-f643ddc08630 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:40.602069 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-db5e5719-74e4-4b44-9bcd-f643ddc08630 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:40.604019 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-db5e5719-74e4-4b44-9bcd-f643ddc08630 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:40.607696 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-db5e5719-74e4-4b44-9bcd-f643ddc08630 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:40.837352 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-db5e5719-74e4-4b44-9bcd-f643ddc08630 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:40.859288 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-db5e5719-74e4-4b44-9bcd-f643ddc08630 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/f1dea61d-0ca6-457d-9d1b-3aff96427d52" status: 200 len: 1267 microversion: 2.1 time: 0.286094 Oct 04 22:27:40.860521 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3520/6470] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:27:40 2022] GET /compute/v2.1/servers/f1dea61d-0ca6-457d-9d1b-3aff96427d52 => generated 1267 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:27:41.205567 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-6483453b-b5e1-45b0-bb11-4cc9408ad557 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:27:41.206000 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-6483453b-b5e1-45b0-bb11-4cc9408ad557 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] [instance: 0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:27:41.218154 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6483453b-b5e1-45b0-bb11-4cc9408ad557 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:41.219294 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6483453b-b5e1-45b0-bb11-4cc9408ad557 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:41.220092 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6483453b-b5e1-45b0-bb11-4cc9408ad557 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:41.221208 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6483453b-b5e1-45b0-bb11-4cc9408ad557 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:41.221694 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6483453b-b5e1-45b0-bb11-4cc9408ad557 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:41.222310 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6483453b-b5e1-45b0-bb11-4cc9408ad557 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:41.243694 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:27:41.374965 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-6483453b-b5e1-45b0-bb11-4cc9408ad557 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:41.384453 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-6483453b-b5e1-45b0-bb11-4cc9408ad557 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:41.386337 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-6483453b-b5e1-45b0-bb11-4cc9408ad557 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:41.387419 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-6483453b-b5e1-45b0-bb11-4cc9408ad557 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] 10.222.0.43 "GET /compute/v2.1/servers/0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc" status: 200 len: 1749 microversion: 2.20 time: 0.186038 Oct 04 22:27:41.388159 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3521/6471] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:27:41 2022] GET /compute/v2.1/servers/0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc => generated 1749 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:27:41.884682 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-f3f1674c-d9d0-43bd-9499-d8c198c76771 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:27:41.885438 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-f3f1674c-d9d0-43bd-9499-d8c198c76771 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: f1dea61d-0ca6-457d-9d1b-3aff96427d52] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:27:41.893769 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f3f1674c-d9d0-43bd-9499-d8c198c76771 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:41.894286 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f3f1674c-d9d0-43bd-9499-d8c198c76771 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:41.895491 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f3f1674c-d9d0-43bd-9499-d8c198c76771 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:41.895628 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f3f1674c-d9d0-43bd-9499-d8c198c76771 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:41.896038 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f3f1674c-d9d0-43bd-9499-d8c198c76771 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:41.896489 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f3f1674c-d9d0-43bd-9499-d8c198c76771 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:42.069009 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-f3f1674c-d9d0-43bd-9499-d8c198c76771 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:42.078180 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-f3f1674c-d9d0-43bd-9499-d8c198c76771 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/f1dea61d-0ca6-457d-9d1b-3aff96427d52" status: 200 len: 1267 microversion: 2.1 time: 0.197400 Oct 04 22:27:42.078810 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3522/6472] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:27:41 2022] GET /compute/v2.1/servers/f1dea61d-0ca6-457d-9d1b-3aff96427d52 => generated 1267 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:27:42.415492 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-0d7d7c05-9797-4d57-be62-8135b1a348af tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:27:42.416488 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-0d7d7c05-9797-4d57-be62-8135b1a348af tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] [instance: 0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:27:42.427130 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0d7d7c05-9797-4d57-be62-8135b1a348af tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:42.427654 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0d7d7c05-9797-4d57-be62-8135b1a348af tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:42.428107 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0d7d7c05-9797-4d57-be62-8135b1a348af tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:42.428873 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0d7d7c05-9797-4d57-be62-8135b1a348af tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:42.429365 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0d7d7c05-9797-4d57-be62-8135b1a348af tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:42.429855 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0d7d7c05-9797-4d57-be62-8135b1a348af tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:42.675525 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-0d7d7c05-9797-4d57-be62-8135b1a348af tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:42.685819 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-0d7d7c05-9797-4d57-be62-8135b1a348af tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:42.687623 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-0d7d7c05-9797-4d57-be62-8135b1a348af tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:42.688982 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-0d7d7c05-9797-4d57-be62-8135b1a348af tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] 10.222.0.43 "GET /compute/v2.1/servers/0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc" status: 200 len: 1805 microversion: 2.20 time: 0.277359 Oct 04 22:27:42.703319 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3523/6473] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:27:42 2022] GET /compute/v2.1/servers/0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc => generated 1805 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:27:43.102299 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-b07a8e95-16b9-4f63-91b1-e6b1c2217027 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:27:43.102975 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-b07a8e95-16b9-4f63-91b1-e6b1c2217027 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: f1dea61d-0ca6-457d-9d1b-3aff96427d52] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:27:43.111072 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b07a8e95-16b9-4f63-91b1-e6b1c2217027 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:43.111584 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b07a8e95-16b9-4f63-91b1-e6b1c2217027 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:43.112048 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b07a8e95-16b9-4f63-91b1-e6b1c2217027 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:43.112770 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b07a8e95-16b9-4f63-91b1-e6b1c2217027 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:43.113245 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b07a8e95-16b9-4f63-91b1-e6b1c2217027 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:43.114537 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b07a8e95-16b9-4f63-91b1-e6b1c2217027 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:43.298936 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-b07a8e95-16b9-4f63-91b1-e6b1c2217027 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:43.307986 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-b07a8e95-16b9-4f63-91b1-e6b1c2217027 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/f1dea61d-0ca6-457d-9d1b-3aff96427d52" status: 200 len: 1267 microversion: 2.1 time: 0.210697 Oct 04 22:27:43.308586 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3524/6474] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:27:43 2022] GET /compute/v2.1/servers/f1dea61d-0ca6-457d-9d1b-3aff96427d52 => generated 1267 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:27:43.715192 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-17661124-d29f-4701-92be-86bb611baad1 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:27:43.716238 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-17661124-d29f-4701-92be-86bb611baad1 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] [instance: 0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:27:43.731485 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-17661124-d29f-4701-92be-86bb611baad1 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:43.732182 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-17661124-d29f-4701-92be-86bb611baad1 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:43.732517 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-17661124-d29f-4701-92be-86bb611baad1 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:43.733261 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-17661124-d29f-4701-92be-86bb611baad1 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:43.733735 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-17661124-d29f-4701-92be-86bb611baad1 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:43.734178 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-17661124-d29f-4701-92be-86bb611baad1 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:43.914176 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-17661124-d29f-4701-92be-86bb611baad1 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:43.926674 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-17661124-d29f-4701-92be-86bb611baad1 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:43.931474 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-17661124-d29f-4701-92be-86bb611baad1 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:43.938158 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-17661124-d29f-4701-92be-86bb611baad1 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] 10.222.0.43 "GET /compute/v2.1/servers/0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc" status: 200 len: 1805 microversion: 2.20 time: 0.226604 Oct 04 22:27:43.939428 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3525/6475] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:27:43 2022] GET /compute/v2.1/servers/0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc => generated 1805 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:27:44.334073 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-d1d43df7-f3bb-4592-83e0-1bd573bb40b9 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:27:44.334820 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-d1d43df7-f3bb-4592-83e0-1bd573bb40b9 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: f1dea61d-0ca6-457d-9d1b-3aff96427d52] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:27:44.345144 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d1d43df7-f3bb-4592-83e0-1bd573bb40b9 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:44.345743 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d1d43df7-f3bb-4592-83e0-1bd573bb40b9 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:44.346971 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d1d43df7-f3bb-4592-83e0-1bd573bb40b9 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:44.348525 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d1d43df7-f3bb-4592-83e0-1bd573bb40b9 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:44.349217 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d1d43df7-f3bb-4592-83e0-1bd573bb40b9 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:44.349692 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d1d43df7-f3bb-4592-83e0-1bd573bb40b9 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:44.516339 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-d1d43df7-f3bb-4592-83e0-1bd573bb40b9 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:44.528087 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-d1d43df7-f3bb-4592-83e0-1bd573bb40b9 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/f1dea61d-0ca6-457d-9d1b-3aff96427d52" status: 200 len: 1267 microversion: 2.1 time: 0.199342 Oct 04 22:27:44.529259 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3526/6476] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:27:44 2022] GET /compute/v2.1/servers/f1dea61d-0ca6-457d-9d1b-3aff96427d52 => generated 1267 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:27:44.969205 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-c7f2c253-b612-4c7d-a635-ba8e07bf96b6 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:27:44.970135 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-c7f2c253-b612-4c7d-a635-ba8e07bf96b6 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] [instance: 0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:27:44.977235 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c7f2c253-b612-4c7d-a635-ba8e07bf96b6 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:44.977775 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c7f2c253-b612-4c7d-a635-ba8e07bf96b6 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:44.978234 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c7f2c253-b612-4c7d-a635-ba8e07bf96b6 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:44.979004 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c7f2c253-b612-4c7d-a635-ba8e07bf96b6 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:44.979484 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c7f2c253-b612-4c7d-a635-ba8e07bf96b6 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:44.980277 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c7f2c253-b612-4c7d-a635-ba8e07bf96b6 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:45.611974 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-c7f2c253-b612-4c7d-a635-ba8e07bf96b6 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:45.639803 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-c7f2c253-b612-4c7d-a635-ba8e07bf96b6 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:45.646099 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-c7f2c253-b612-4c7d-a635-ba8e07bf96b6 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:45.650689 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-c7f2c253-b612-4c7d-a635-ba8e07bf96b6 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] 10.222.0.43 "GET /compute/v2.1/servers/0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc" status: 200 len: 1805 microversion: 2.20 time: 0.685797 Oct 04 22:27:45.653106 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3527/6477] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:27:44 2022] GET /compute/v2.1/servers/0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc => generated 1805 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 22:27:45.658862 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-dad6fe45-1e2c-41dd-b3e6-349b2d0f3fc6 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:27:45.659662 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-dad6fe45-1e2c-41dd-b3e6-349b2d0f3fc6 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: f1dea61d-0ca6-457d-9d1b-3aff96427d52] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:27:45.667065 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dad6fe45-1e2c-41dd-b3e6-349b2d0f3fc6 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:45.679487 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dad6fe45-1e2c-41dd-b3e6-349b2d0f3fc6 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:45.684023 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dad6fe45-1e2c-41dd-b3e6-349b2d0f3fc6 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:45.687980 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dad6fe45-1e2c-41dd-b3e6-349b2d0f3fc6 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:45.688890 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dad6fe45-1e2c-41dd-b3e6-349b2d0f3fc6 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:45.691566 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dad6fe45-1e2c-41dd-b3e6-349b2d0f3fc6 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:45.930060 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-dad6fe45-1e2c-41dd-b3e6-349b2d0f3fc6 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:45.941351 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-dad6fe45-1e2c-41dd-b3e6-349b2d0f3fc6 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/f1dea61d-0ca6-457d-9d1b-3aff96427d52" status: 200 len: 1267 microversion: 2.1 time: 0.286091 Oct 04 22:27:45.954476 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3528/6478] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:27:45 2022] GET /compute/v2.1/servers/f1dea61d-0ca6-457d-9d1b-3aff96427d52 => generated 1267 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:27:46.384363 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-5e78fbf0-74da-4088-b75f-dcf572e3f85b req-9a53518f-7905-4880-a493-6f990f925ea0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1dea61d-0ca6-457d-9d1b-3aff96427d52", "name": "network-vif-plugged", "status": "completed", "tag": "4a95490d-6ee2-4e08-a931-9210ae4b290c"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:27:46.400084 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-5e78fbf0-74da-4088-b75f-dcf572e3f85b req-9a53518f-7905-4880-a493-6f990f925ea0 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:46.401214 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-5e78fbf0-74da-4088-b75f-dcf572e3f85b req-9a53518f-7905-4880-a493-6f990f925ea0 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:46.401900 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-5e78fbf0-74da-4088-b75f-dcf572e3f85b req-9a53518f-7905-4880-a493-6f990f925ea0 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:46.419248 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-5e78fbf0-74da-4088-b75f-dcf572e3f85b req-9a53518f-7905-4880-a493-6f990f925ea0 service nova] Creating event network-vif-plugged:4a95490d-6ee2-4e08-a931-9210ae4b290c for instance f1dea61d-0ca6-457d-9d1b-3aff96427d52 on n-h1-860284-1 Oct 04 22:27:46.463306 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-5e78fbf0-74da-4088-b75f-dcf572e3f85b req-9a53518f-7905-4880-a493-6f990f925ea0 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070591 Oct 04 22:27:46.465706 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3529/6479] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:27:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:27:46.690084 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-05a9a5bb-e3a2-4b4a-9d18-0bf30c14b9ab tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:27:46.692432 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-05a9a5bb-e3a2-4b4a-9d18-0bf30c14b9ab tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] [instance: 0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:27:46.713445 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-05a9a5bb-e3a2-4b4a-9d18-0bf30c14b9ab tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:46.713990 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-05a9a5bb-e3a2-4b4a-9d18-0bf30c14b9ab tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:46.714561 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-05a9a5bb-e3a2-4b4a-9d18-0bf30c14b9ab tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:46.715651 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-05a9a5bb-e3a2-4b4a-9d18-0bf30c14b9ab tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:46.716141 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-05a9a5bb-e3a2-4b4a-9d18-0bf30c14b9ab tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:46.716596 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-05a9a5bb-e3a2-4b4a-9d18-0bf30c14b9ab tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:46.937165 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-05a9a5bb-e3a2-4b4a-9d18-0bf30c14b9ab tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:46.950598 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-05a9a5bb-e3a2-4b4a-9d18-0bf30c14b9ab tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:46.952781 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-05a9a5bb-e3a2-4b4a-9d18-0bf30c14b9ab tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:46.954452 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-05a9a5bb-e3a2-4b4a-9d18-0bf30c14b9ab tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] 10.222.0.43 "GET /compute/v2.1/servers/0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc" status: 200 len: 1805 microversion: 2.20 time: 0.273609 Oct 04 22:27:46.976998 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3530/6480] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:27:46 2022] GET /compute/v2.1/servers/0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc => generated 1805 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:27:46.982938 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-9d2199e0-a282-481c-b969-1718f5a072e3 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:27:46.983835 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-9d2199e0-a282-481c-b969-1718f5a072e3 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: f1dea61d-0ca6-457d-9d1b-3aff96427d52] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:27:46.990536 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:27:46.992240 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9d2199e0-a282-481c-b969-1718f5a072e3 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:46.992925 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9d2199e0-a282-481c-b969-1718f5a072e3 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:46.993778 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9d2199e0-a282-481c-b969-1718f5a072e3 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:46.995416 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9d2199e0-a282-481c-b969-1718f5a072e3 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:46.996070 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9d2199e0-a282-481c-b969-1718f5a072e3 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:46.996946 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9d2199e0-a282-481c-b969-1718f5a072e3 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:47.253143 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-9d2199e0-a282-481c-b969-1718f5a072e3 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:47.263771 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-9d2199e0-a282-481c-b969-1718f5a072e3 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/f1dea61d-0ca6-457d-9d1b-3aff96427d52" status: 200 len: 1267 microversion: 2.1 time: 0.285117 Oct 04 22:27:47.264567 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3531/6481] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:27:46 2022] GET /compute/v2.1/servers/f1dea61d-0ca6-457d-9d1b-3aff96427d52 => generated 1267 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:27:47.983238 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-5d442b09-bb7a-4599-a059-171b0b5d0936 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:27:47.985198 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-5d442b09-bb7a-4599-a059-171b0b5d0936 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] [instance: 0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:27:48.001527 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5d442b09-bb7a-4599-a059-171b0b5d0936 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:48.007204 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5d442b09-bb7a-4599-a059-171b0b5d0936 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:48.008297 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5d442b09-bb7a-4599-a059-171b0b5d0936 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:48.015643 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5d442b09-bb7a-4599-a059-171b0b5d0936 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:48.017497 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5d442b09-bb7a-4599-a059-171b0b5d0936 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:48.020871 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5d442b09-bb7a-4599-a059-171b0b5d0936 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:48.359303 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-5d442b09-bb7a-4599-a059-171b0b5d0936 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:48.371212 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-5d442b09-bb7a-4599-a059-171b0b5d0936 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:48.372594 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-5d442b09-bb7a-4599-a059-171b0b5d0936 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:48.373829 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-5d442b09-bb7a-4599-a059-171b0b5d0936 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] 10.222.0.43 "GET /compute/v2.1/servers/0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc" status: 200 len: 1805 microversion: 2.20 time: 0.396491 Oct 04 22:27:48.405476 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3532/6482] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:27:47 2022] GET /compute/v2.1/servers/0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc => generated 1805 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:27:48.412938 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-c65c1510-5538-4692-b7eb-362a4a3573ff tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:27:48.413598 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-c65c1510-5538-4692-b7eb-362a4a3573ff tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: f1dea61d-0ca6-457d-9d1b-3aff96427d52] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:27:48.428213 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c65c1510-5538-4692-b7eb-362a4a3573ff tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:48.428847 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c65c1510-5538-4692-b7eb-362a4a3573ff tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:48.429354 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c65c1510-5538-4692-b7eb-362a4a3573ff tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:48.430211 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c65c1510-5538-4692-b7eb-362a4a3573ff tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:48.430759 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c65c1510-5538-4692-b7eb-362a4a3573ff tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:48.439617 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c65c1510-5538-4692-b7eb-362a4a3573ff tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:48.970822 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-c65c1510-5538-4692-b7eb-362a4a3573ff tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:48.987939 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-c65c1510-5538-4692-b7eb-362a4a3573ff tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/f1dea61d-0ca6-457d-9d1b-3aff96427d52" status: 200 len: 1454 microversion: 2.1 time: 0.581062 Oct 04 22:27:48.989696 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3533/6483] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:27:48 2022] GET /compute/v2.1/servers/f1dea61d-0ca6-457d-9d1b-3aff96427d52 => generated 1454 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:27:49.018720 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-7e4796bb-41ca-4fba-97fc-dcba074f098a tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:27:49.019554 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-7e4796bb-41ca-4fba-97fc-dcba074f098a tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: f1dea61d-0ca6-457d-9d1b-3aff96427d52] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:27:49.043753 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7e4796bb-41ca-4fba-97fc-dcba074f098a tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:49.044272 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7e4796bb-41ca-4fba-97fc-dcba074f098a tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:49.049014 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7e4796bb-41ca-4fba-97fc-dcba074f098a tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:49.050683 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7e4796bb-41ca-4fba-97fc-dcba074f098a tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:49.051698 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7e4796bb-41ca-4fba-97fc-dcba074f098a tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:49.052243 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7e4796bb-41ca-4fba-97fc-dcba074f098a tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:49.377424 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-7e4796bb-41ca-4fba-97fc-dcba074f098a tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:49.387047 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-7e4796bb-41ca-4fba-97fc-dcba074f098a tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/f1dea61d-0ca6-457d-9d1b-3aff96427d52" status: 200 len: 1454 microversion: 2.1 time: 0.374932 Oct 04 22:27:49.399723 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3534/6484] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:27:49 2022] GET /compute/v2.1/servers/f1dea61d-0ca6-457d-9d1b-3aff96427d52 => generated 1454 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:27:49.411501 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-4be63e18-2c3d-49b1-91a8-a4907ac3dc0b tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:27:49.415323 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-4be63e18-2c3d-49b1-91a8-a4907ac3dc0b tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] [instance: 0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:27:49.427933 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4be63e18-2c3d-49b1-91a8-a4907ac3dc0b tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:49.428608 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4be63e18-2c3d-49b1-91a8-a4907ac3dc0b tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:49.429456 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4be63e18-2c3d-49b1-91a8-a4907ac3dc0b tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:49.433326 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4be63e18-2c3d-49b1-91a8-a4907ac3dc0b tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:49.435143 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4be63e18-2c3d-49b1-91a8-a4907ac3dc0b tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:49.435644 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4be63e18-2c3d-49b1-91a8-a4907ac3dc0b tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:49.944570 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-4be63e18-2c3d-49b1-91a8-a4907ac3dc0b tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:49.963020 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-4be63e18-2c3d-49b1-91a8-a4907ac3dc0b tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:49.970136 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-4be63e18-2c3d-49b1-91a8-a4907ac3dc0b tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:49.973016 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-4be63e18-2c3d-49b1-91a8-a4907ac3dc0b tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] 10.222.0.43 "GET /compute/v2.1/servers/0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc" status: 200 len: 1805 microversion: 2.20 time: 0.568539 Oct 04 22:27:49.974683 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3535/6485] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:27:49 2022] GET /compute/v2.1/servers/0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc => generated 1805 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 22:27:51.006229 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-3061ca42-1cf9-4df3-ae87-5a0c40ee35c2 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:27:51.007119 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-3061ca42-1cf9-4df3-ae87-5a0c40ee35c2 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] [instance: 0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:27:51.032481 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3061ca42-1cf9-4df3-ae87-5a0c40ee35c2 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:51.034178 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3061ca42-1cf9-4df3-ae87-5a0c40ee35c2 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:51.035446 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3061ca42-1cf9-4df3-ae87-5a0c40ee35c2 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:51.036737 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3061ca42-1cf9-4df3-ae87-5a0c40ee35c2 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:51.043297 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3061ca42-1cf9-4df3-ae87-5a0c40ee35c2 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:51.044358 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3061ca42-1cf9-4df3-ae87-5a0c40ee35c2 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:51.404808 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-3061ca42-1cf9-4df3-ae87-5a0c40ee35c2 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:51.427998 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-3061ca42-1cf9-4df3-ae87-5a0c40ee35c2 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:51.435653 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-3061ca42-1cf9-4df3-ae87-5a0c40ee35c2 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:51.437097 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-3061ca42-1cf9-4df3-ae87-5a0c40ee35c2 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] 10.222.0.43 "GET /compute/v2.1/servers/0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc" status: 200 len: 1805 microversion: 2.20 time: 0.436985 Oct 04 22:27:51.438177 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3536/6486] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:27:50 2022] GET /compute/v2.1/servers/0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc => generated 1805 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:27:52.468216 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-5b08e62a-3554-49ea-9316-bb151e484fa2 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:27:52.469607 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-5b08e62a-3554-49ea-9316-bb151e484fa2 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] [instance: 0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:27:52.490950 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5b08e62a-3554-49ea-9316-bb151e484fa2 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:52.491802 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5b08e62a-3554-49ea-9316-bb151e484fa2 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:52.493075 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5b08e62a-3554-49ea-9316-bb151e484fa2 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:52.498988 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5b08e62a-3554-49ea-9316-bb151e484fa2 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:52.499538 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5b08e62a-3554-49ea-9316-bb151e484fa2 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:52.500010 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5b08e62a-3554-49ea-9316-bb151e484fa2 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:52.828393 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-5b08e62a-3554-49ea-9316-bb151e484fa2 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:52.846555 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-5b08e62a-3554-49ea-9316-bb151e484fa2 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:52.848069 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-5b08e62a-3554-49ea-9316-bb151e484fa2 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:52.855590 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-5b08e62a-3554-49ea-9316-bb151e484fa2 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] 10.222.0.43 "GET /compute/v2.1/servers/0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc" status: 200 len: 1805 microversion: 2.20 time: 0.385950 Oct 04 22:27:52.876778 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3537/6487] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:27:52 2022] GET /compute/v2.1/servers/0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc => generated 1805 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 22:27:53.061209 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-450ecf9e-3a90-4e84-b071-0b9e7a16d5dc req-e9ea6231-488c-405d-b5b1-45b83a189841 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1dea61d-0ca6-457d-9d1b-3aff96427d52", "tag": "4a95490d-6ee2-4e08-a931-9210ae4b290c"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:27:53.076166 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-450ecf9e-3a90-4e84-b071-0b9e7a16d5dc req-e9ea6231-488c-405d-b5b1-45b83a189841 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:53.076668 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-450ecf9e-3a90-4e84-b071-0b9e7a16d5dc req-e9ea6231-488c-405d-b5b1-45b83a189841 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:53.077117 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-450ecf9e-3a90-4e84-b071-0b9e7a16d5dc req-e9ea6231-488c-405d-b5b1-45b83a189841 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:53.090264 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-450ecf9e-3a90-4e84-b071-0b9e7a16d5dc req-e9ea6231-488c-405d-b5b1-45b83a189841 service nova] Creating event network-changed:4a95490d-6ee2-4e08-a931-9210ae4b290c for instance f1dea61d-0ca6-457d-9d1b-3aff96427d52 on n-h1-860284-1 Oct 04 22:27:53.096328 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-450ecf9e-3a90-4e84-b071-0b9e7a16d5dc req-e9ea6231-488c-405d-b5b1-45b83a189841 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038031 Oct 04 22:27:53.096573 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3538/6488] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:27:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:27:53.883776 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-734fa1df-2f1e-4757-addf-61d8138344e2 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:27:53.885656 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-734fa1df-2f1e-4757-addf-61d8138344e2 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] [instance: 0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:27:53.894044 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-734fa1df-2f1e-4757-addf-61d8138344e2 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:53.895211 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-734fa1df-2f1e-4757-addf-61d8138344e2 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:53.895922 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-734fa1df-2f1e-4757-addf-61d8138344e2 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:53.897190 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-734fa1df-2f1e-4757-addf-61d8138344e2 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:53.898474 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-734fa1df-2f1e-4757-addf-61d8138344e2 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:53.899805 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-734fa1df-2f1e-4757-addf-61d8138344e2 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:53.922957 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=100 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:27:54.062249 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-734fa1df-2f1e-4757-addf-61d8138344e2 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:54.072572 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-734fa1df-2f1e-4757-addf-61d8138344e2 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:54.074064 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-734fa1df-2f1e-4757-addf-61d8138344e2 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:54.075328 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-734fa1df-2f1e-4757-addf-61d8138344e2 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] 10.222.0.43 "GET /compute/v2.1/servers/0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc" status: 200 len: 1805 microversion: 2.20 time: 0.197950 Oct 04 22:27:54.076104 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3539/6489] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:27:53 2022] GET /compute/v2.1/servers/0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc => generated 1805 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:27:55.101455 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-d7a3909f-567e-4e4d-9993-dbb84099e846 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:27:55.102112 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-d7a3909f-567e-4e4d-9993-dbb84099e846 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] [instance: 0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:27:55.109222 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d7a3909f-567e-4e4d-9993-dbb84099e846 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:55.109719 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d7a3909f-567e-4e4d-9993-dbb84099e846 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:55.110168 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d7a3909f-567e-4e4d-9993-dbb84099e846 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:55.110902 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d7a3909f-567e-4e4d-9993-dbb84099e846 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:55.111370 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d7a3909f-567e-4e4d-9993-dbb84099e846 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:55.111809 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d7a3909f-567e-4e4d-9993-dbb84099e846 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:55.254136 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-d7a3909f-567e-4e4d-9993-dbb84099e846 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:55.263135 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-d7a3909f-567e-4e4d-9993-dbb84099e846 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:55.264627 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-d7a3909f-567e-4e4d-9993-dbb84099e846 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:55.265833 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-d7a3909f-567e-4e4d-9993-dbb84099e846 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] 10.222.0.43 "GET /compute/v2.1/servers/0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc" status: 200 len: 1805 microversion: 2.20 time: 0.169006 Oct 04 22:27:55.266461 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3540/6490] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:27:55 2022] GET /compute/v2.1/servers/0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc => generated 1805 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 22:27:56.293187 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-5d73b717-5c6e-42ce-9e09-0b6bdb825423 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:27:56.293859 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-5d73b717-5c6e-42ce-9e09-0b6bdb825423 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] [instance: 0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:27:56.302445 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5d73b717-5c6e-42ce-9e09-0b6bdb825423 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:56.302960 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5d73b717-5c6e-42ce-9e09-0b6bdb825423 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:56.303416 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5d73b717-5c6e-42ce-9e09-0b6bdb825423 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:56.304144 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5d73b717-5c6e-42ce-9e09-0b6bdb825423 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:56.304618 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5d73b717-5c6e-42ce-9e09-0b6bdb825423 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:56.305064 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5d73b717-5c6e-42ce-9e09-0b6bdb825423 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:56.572462 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-5d73b717-5c6e-42ce-9e09-0b6bdb825423 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:56.581285 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-5d73b717-5c6e-42ce-9e09-0b6bdb825423 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:56.583163 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-5d73b717-5c6e-42ce-9e09-0b6bdb825423 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:56.584383 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-5d73b717-5c6e-42ce-9e09-0b6bdb825423 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] 10.222.0.43 "GET /compute/v2.1/servers/0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc" status: 200 len: 1805 microversion: 2.20 time: 0.295180 Oct 04 22:27:56.584969 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3541/6491] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:27:56 2022] GET /compute/v2.1/servers/0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc => generated 1805 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 22:27:57.611300 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-97175ad6-f5e5-480d-b352-27deecfcb54d tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:27:57.611940 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-97175ad6-f5e5-480d-b352-27deecfcb54d tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] [instance: 0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:27:57.619498 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-97175ad6-f5e5-480d-b352-27deecfcb54d tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:57.619498 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-97175ad6-f5e5-480d-b352-27deecfcb54d tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:57.619852 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-97175ad6-f5e5-480d-b352-27deecfcb54d tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:57.620571 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-97175ad6-f5e5-480d-b352-27deecfcb54d tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:57.621040 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-97175ad6-f5e5-480d-b352-27deecfcb54d tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:57.621482 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-97175ad6-f5e5-480d-b352-27deecfcb54d tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:57.760873 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-97175ad6-f5e5-480d-b352-27deecfcb54d tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:57.770608 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-97175ad6-f5e5-480d-b352-27deecfcb54d tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:57.772208 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-97175ad6-f5e5-480d-b352-27deecfcb54d tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:57.773498 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-97175ad6-f5e5-480d-b352-27deecfcb54d tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] 10.222.0.43 "GET /compute/v2.1/servers/0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc" status: 200 len: 1805 microversion: 2.20 time: 0.166221 Oct 04 22:27:57.774428 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3542/6492] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:27:57 2022] GET /compute/v2.1/servers/0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc => generated 1805 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 22:27:58.800695 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-4dc07cac-98e8-4778-a094-1e35a7642985 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:27:58.801450 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-4dc07cac-98e8-4778-a094-1e35a7642985 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] [instance: 0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:27:58.818680 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4dc07cac-98e8-4778-a094-1e35a7642985 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:58.819259 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4dc07cac-98e8-4778-a094-1e35a7642985 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:58.819724 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4dc07cac-98e8-4778-a094-1e35a7642985 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:58.820575 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4dc07cac-98e8-4778-a094-1e35a7642985 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:58.821059 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4dc07cac-98e8-4778-a094-1e35a7642985 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:58.821553 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4dc07cac-98e8-4778-a094-1e35a7642985 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:59.177798 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-4dc07cac-98e8-4778-a094-1e35a7642985 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:59.187351 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-4dc07cac-98e8-4778-a094-1e35a7642985 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:59.189005 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-4dc07cac-98e8-4778-a094-1e35a7642985 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:59.190722 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-4dc07cac-98e8-4778-a094-1e35a7642985 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] 10.222.0.43 "GET /compute/v2.1/servers/0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc" status: 200 len: 1805 microversion: 2.20 time: 0.394546 Oct 04 22:27:59.192131 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3543/6493] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:27:58 2022] GET /compute/v2.1/servers/0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc => generated 1805 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 22:28:00.220366 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-4b9b319e-e2af-453c-9692-cbb310cafec3 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:28:00.222378 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-4b9b319e-e2af-453c-9692-cbb310cafec3 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] [instance: 0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:28:00.229411 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4b9b319e-e2af-453c-9692-cbb310cafec3 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:28:00.230064 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4b9b319e-e2af-453c-9692-cbb310cafec3 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:28:00.230771 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4b9b319e-e2af-453c-9692-cbb310cafec3 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:28:00.231505 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4b9b319e-e2af-453c-9692-cbb310cafec3 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:28:00.232169 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4b9b319e-e2af-453c-9692-cbb310cafec3 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:28:00.232621 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4b9b319e-e2af-453c-9692-cbb310cafec3 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:28:00.479734 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-4b9b319e-e2af-453c-9692-cbb310cafec3 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:28:00.490637 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-4b9b319e-e2af-453c-9692-cbb310cafec3 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:28:00.492493 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-4b9b319e-e2af-453c-9692-cbb310cafec3 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:28:00.493928 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-4b9b319e-e2af-453c-9692-cbb310cafec3 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] 10.222.0.43 "GET /compute/v2.1/servers/0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc" status: 200 len: 1805 microversion: 2.20 time: 0.277706 Oct 04 22:28:00.494665 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3544/6494] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:28:00 2022] GET /compute/v2.1/servers/0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc => generated 1805 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 22:28:01.520261 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-a36eec54-5dc9-4a7c-979b-7fb9287fb2a6 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:28:01.520952 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-a36eec54-5dc9-4a7c-979b-7fb9287fb2a6 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] [instance: 0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:28:01.528636 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a36eec54-5dc9-4a7c-979b-7fb9287fb2a6 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:28:01.529148 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a36eec54-5dc9-4a7c-979b-7fb9287fb2a6 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:28:01.529603 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a36eec54-5dc9-4a7c-979b-7fb9287fb2a6 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:28:01.530325 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a36eec54-5dc9-4a7c-979b-7fb9287fb2a6 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:28:01.530824 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a36eec54-5dc9-4a7c-979b-7fb9287fb2a6 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:28:01.531275 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a36eec54-5dc9-4a7c-979b-7fb9287fb2a6 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:28:01.786591 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-a36eec54-5dc9-4a7c-979b-7fb9287fb2a6 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:28:01.795826 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-a36eec54-5dc9-4a7c-979b-7fb9287fb2a6 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:28:01.797342 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-a36eec54-5dc9-4a7c-979b-7fb9287fb2a6 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:28:01.798769 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-a36eec54-5dc9-4a7c-979b-7fb9287fb2a6 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] 10.222.0.43 "GET /compute/v2.1/servers/0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc" status: 200 len: 1805 microversion: 2.20 time: 0.283262 Oct 04 22:28:01.810074 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3545/6495] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:28:01 2022] GET /compute/v2.1/servers/0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc => generated 1805 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 22:28:02.824701 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-6bc3e2e6-213c-4a7f-bf63-895dbdcdfa9e tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:28:02.825400 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-6bc3e2e6-213c-4a7f-bf63-895dbdcdfa9e tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] [instance: 0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:28:02.832942 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6bc3e2e6-213c-4a7f-bf63-895dbdcdfa9e tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:28:02.833705 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6bc3e2e6-213c-4a7f-bf63-895dbdcdfa9e tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:28:02.834457 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6bc3e2e6-213c-4a7f-bf63-895dbdcdfa9e tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:28:02.835560 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6bc3e2e6-213c-4a7f-bf63-895dbdcdfa9e tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:28:02.836206 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6bc3e2e6-213c-4a7f-bf63-895dbdcdfa9e tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:28:02.836851 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6bc3e2e6-213c-4a7f-bf63-895dbdcdfa9e tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:28:03.076126 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-6bc3e2e6-213c-4a7f-bf63-895dbdcdfa9e tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:28:03.087009 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-6bc3e2e6-213c-4a7f-bf63-895dbdcdfa9e tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:28:03.088580 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-6bc3e2e6-213c-4a7f-bf63-895dbdcdfa9e tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:28:03.090500 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-6bc3e2e6-213c-4a7f-bf63-895dbdcdfa9e tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] 10.222.0.43 "GET /compute/v2.1/servers/0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc" status: 200 len: 1805 microversion: 2.20 time: 0.269974 Oct 04 22:28:03.091212 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3546/6496] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:28:02 2022] GET /compute/v2.1/servers/0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc => generated 1805 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 22:28:04.124638 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-51be6b82-d408-417b-b2d0-1afeb4cffd4e tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:28:04.125995 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-51be6b82-d408-417b-b2d0-1afeb4cffd4e tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] [instance: 0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:28:04.142123 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-51be6b82-d408-417b-b2d0-1afeb4cffd4e tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:28:04.143455 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-51be6b82-d408-417b-b2d0-1afeb4cffd4e tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:28:04.144537 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-51be6b82-d408-417b-b2d0-1afeb4cffd4e tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:28:04.145832 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-51be6b82-d408-417b-b2d0-1afeb4cffd4e tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:28:04.146180 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-51be6b82-d408-417b-b2d0-1afeb4cffd4e tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:28:04.146672 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-51be6b82-d408-417b-b2d0-1afeb4cffd4e tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:28:04.296412 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-51be6b82-d408-417b-b2d0-1afeb4cffd4e tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:28:04.309066 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-51be6b82-d408-417b-b2d0-1afeb4cffd4e tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:28:04.310658 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-51be6b82-d408-417b-b2d0-1afeb4cffd4e tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:28:04.312254 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-51be6b82-d408-417b-b2d0-1afeb4cffd4e tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] 10.222.0.43 "GET /compute/v2.1/servers/0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc" status: 200 len: 1805 microversion: 2.20 time: 0.198385 Oct 04 22:28:04.312954 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3547/6497] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:28:04 2022] GET /compute/v2.1/servers/0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc => generated 1805 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:28:05.339647 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-3eabe068-8164-4adc-b48a-762e85ffcd41 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:28:05.341143 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-3eabe068-8164-4adc-b48a-762e85ffcd41 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] [instance: 0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:28:05.350055 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3eabe068-8164-4adc-b48a-762e85ffcd41 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:28:05.350947 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3eabe068-8164-4adc-b48a-762e85ffcd41 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:28:05.351488 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3eabe068-8164-4adc-b48a-762e85ffcd41 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:28:05.352305 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3eabe068-8164-4adc-b48a-762e85ffcd41 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:28:05.352918 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3eabe068-8164-4adc-b48a-762e85ffcd41 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:28:05.353475 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3eabe068-8164-4adc-b48a-762e85ffcd41 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:28:05.647484 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-3eabe068-8164-4adc-b48a-762e85ffcd41 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:28:05.659248 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-3eabe068-8164-4adc-b48a-762e85ffcd41 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:28:05.661442 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-3eabe068-8164-4adc-b48a-762e85ffcd41 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:28:05.663423 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-3eabe068-8164-4adc-b48a-762e85ffcd41 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] 10.222.0.43 "GET /compute/v2.1/servers/0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc" status: 200 len: 1805 microversion: 2.20 time: 0.329048 Oct 04 22:28:05.679778 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3548/6498] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:28:05 2022] GET /compute/v2.1/servers/0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc => generated 1805 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:28:06.697568 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-95c46545-4eae-43aa-b88b-487c8c98b4cf tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:28:06.698316 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-95c46545-4eae-43aa-b88b-487c8c98b4cf tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] [instance: 0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:28:06.706646 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-95c46545-4eae-43aa-b88b-487c8c98b4cf tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:28:06.707572 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-95c46545-4eae-43aa-b88b-487c8c98b4cf tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:28:06.708041 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-95c46545-4eae-43aa-b88b-487c8c98b4cf tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:28:06.708776 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-95c46545-4eae-43aa-b88b-487c8c98b4cf tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:28:06.709343 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-95c46545-4eae-43aa-b88b-487c8c98b4cf tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:28:06.710072 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-95c46545-4eae-43aa-b88b-487c8c98b4cf tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:28:06.958974 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-95c46545-4eae-43aa-b88b-487c8c98b4cf tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:28:06.969651 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-95c46545-4eae-43aa-b88b-487c8c98b4cf tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:28:06.971315 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-95c46545-4eae-43aa-b88b-487c8c98b4cf tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:28:06.973222 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-95c46545-4eae-43aa-b88b-487c8c98b4cf tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] 10.222.0.43 "GET /compute/v2.1/servers/0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc" status: 200 len: 1805 microversion: 2.20 time: 0.279983 Oct 04 22:28:06.973977 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3549/6499] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:28:06 2022] GET /compute/v2.1/servers/0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc => generated 1805 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 22:28:08.001673 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-10b2a54d-cc2d-480b-9841-708375c5f96f tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:28:08.002418 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-10b2a54d-cc2d-480b-9841-708375c5f96f tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] [instance: 0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:28:08.011165 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-10b2a54d-cc2d-480b-9841-708375c5f96f tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:28:08.012489 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-10b2a54d-cc2d-480b-9841-708375c5f96f tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:28:08.013142 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-10b2a54d-cc2d-480b-9841-708375c5f96f tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:28:08.013957 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-10b2a54d-cc2d-480b-9841-708375c5f96f tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:28:08.014558 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-10b2a54d-cc2d-480b-9841-708375c5f96f tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:28:08.015132 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-10b2a54d-cc2d-480b-9841-708375c5f96f tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:28:08.597781 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-10b2a54d-cc2d-480b-9841-708375c5f96f tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:28:08.606688 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-10b2a54d-cc2d-480b-9841-708375c5f96f tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:28:08.608205 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-10b2a54d-cc2d-480b-9841-708375c5f96f tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:28:08.609395 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-10b2a54d-cc2d-480b-9841-708375c5f96f tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] 10.222.0.43 "GET /compute/v2.1/servers/0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc" status: 200 len: 1805 microversion: 2.20 time: 0.612080 Oct 04 22:28:08.609970 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3550/6500] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:28:07 2022] GET /compute/v2.1/servers/0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc => generated 1805 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 22:28:08.621268 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-e8980b42-ab71-4156-8c52-64434ba4ff77 req-ed9b08e1-d20f-4f15-9fa8-64d182eb77f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc", "name": "network-vif-plugged", "status": "completed", "tag": "92737fc4-3618-4a96-a0a0-09038568173c"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:28:08.631746 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-e8980b42-ab71-4156-8c52-64434ba4ff77 req-ed9b08e1-d20f-4f15-9fa8-64d182eb77f9 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:28:08.632393 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-e8980b42-ab71-4156-8c52-64434ba4ff77 req-ed9b08e1-d20f-4f15-9fa8-64d182eb77f9 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:28:08.633094 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-e8980b42-ab71-4156-8c52-64434ba4ff77 req-ed9b08e1-d20f-4f15-9fa8-64d182eb77f9 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:28:08.644876 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-e8980b42-ab71-4156-8c52-64434ba4ff77 req-ed9b08e1-d20f-4f15-9fa8-64d182eb77f9 service nova] Creating event network-vif-plugged:92737fc4-3618-4a96-a0a0-09038568173c for instance 0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc on n-h2-860284-1 Oct 04 22:28:08.650452 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-e8980b42-ab71-4156-8c52-64434ba4ff77 req-ed9b08e1-d20f-4f15-9fa8-64d182eb77f9 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032870 Oct 04 22:28:08.651069 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3551/6501] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:28:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:28:09.638670 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-4b82d20c-74fc-4815-bb96-26a7e01fb2e4 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:28:09.639494 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-4b82d20c-74fc-4815-bb96-26a7e01fb2e4 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] [instance: 0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:28:09.646702 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4b82d20c-74fc-4815-bb96-26a7e01fb2e4 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:28:09.647213 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4b82d20c-74fc-4815-bb96-26a7e01fb2e4 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:28:09.647674 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4b82d20c-74fc-4815-bb96-26a7e01fb2e4 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:28:09.648703 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4b82d20c-74fc-4815-bb96-26a7e01fb2e4 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:28:09.649159 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4b82d20c-74fc-4815-bb96-26a7e01fb2e4 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:28:09.649606 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4b82d20c-74fc-4815-bb96-26a7e01fb2e4 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:28:09.807648 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-4b82d20c-74fc-4815-bb96-26a7e01fb2e4 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:28:09.817877 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-4b82d20c-74fc-4815-bb96-26a7e01fb2e4 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:28:09.819361 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-4b82d20c-74fc-4815-bb96-26a7e01fb2e4 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:28:09.820552 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-4b82d20c-74fc-4815-bb96-26a7e01fb2e4 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] 10.222.0.43 "GET /compute/v2.1/servers/0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc" status: 200 len: 1805 microversion: 2.20 time: 0.188300 Oct 04 22:28:09.821116 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3552/6502] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:28:09 2022] GET /compute/v2.1/servers/0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc => generated 1805 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 22:28:10.847757 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-ee025b8b-da46-43af-ab7b-46585cfbd5cc tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:28:10.849171 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-ee025b8b-da46-43af-ab7b-46585cfbd5cc tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] [instance: 0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:28:10.856689 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ee025b8b-da46-43af-ab7b-46585cfbd5cc tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:28:10.857682 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ee025b8b-da46-43af-ab7b-46585cfbd5cc tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:28:10.858496 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ee025b8b-da46-43af-ab7b-46585cfbd5cc tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:28:10.859496 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ee025b8b-da46-43af-ab7b-46585cfbd5cc tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:28:10.860148 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ee025b8b-da46-43af-ab7b-46585cfbd5cc tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:28:10.860763 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ee025b8b-da46-43af-ab7b-46585cfbd5cc tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:28:11.100261 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-ee025b8b-da46-43af-ab7b-46585cfbd5cc tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:28:11.109731 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-ee025b8b-da46-43af-ab7b-46585cfbd5cc tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:28:11.111249 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-ee025b8b-da46-43af-ab7b-46585cfbd5cc tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:28:11.113421 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-ee025b8b-da46-43af-ab7b-46585cfbd5cc tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] 10.222.0.43 "GET /compute/v2.1/servers/0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc" status: 200 len: 1805 microversion: 2.20 time: 0.270106 Oct 04 22:28:11.114414 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3553/6503] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:28:10 2022] GET /compute/v2.1/servers/0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc => generated 1805 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:28:12.143322 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-88fa55e8-63ce-4052-a64c-13cd3ef89fc3 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:28:12.144996 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-88fa55e8-63ce-4052-a64c-13cd3ef89fc3 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] [instance: 0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:28:12.152546 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-88fa55e8-63ce-4052-a64c-13cd3ef89fc3 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:28:12.153088 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-88fa55e8-63ce-4052-a64c-13cd3ef89fc3 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:28:12.153794 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-88fa55e8-63ce-4052-a64c-13cd3ef89fc3 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:28:12.154732 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-88fa55e8-63ce-4052-a64c-13cd3ef89fc3 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:28:12.155383 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-88fa55e8-63ce-4052-a64c-13cd3ef89fc3 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:28:12.155830 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-88fa55e8-63ce-4052-a64c-13cd3ef89fc3 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:28:12.321260 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-88fa55e8-63ce-4052-a64c-13cd3ef89fc3 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:28:12.335839 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-88fa55e8-63ce-4052-a64c-13cd3ef89fc3 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:28:12.338015 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-88fa55e8-63ce-4052-a64c-13cd3ef89fc3 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:28:12.339804 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-88fa55e8-63ce-4052-a64c-13cd3ef89fc3 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] 10.222.0.43 "GET /compute/v2.1/servers/0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc" status: 200 len: 1792 microversion: 2.20 time: 0.200587 Oct 04 22:28:12.364918 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3554/6504] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:28:12 2022] GET /compute/v2.1/servers/0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc => generated 1792 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 22:28:23.103712 n-d-860284-1 devstack@n-api.service[134102]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 22:28:23.103712 n-d-860284-1 devstack@n-api.service[134102]: Tue Oct 4 22:28:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.43) !!! Oct 04 22:28:27.683140 n-d-860284-1 devstack@n-api.service[134102]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 22:28:27.683830 n-d-860284-1 devstack@n-api.service[134102]: Tue Oct 4 22:28:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.43) !!! Oct 04 22:28:28.849229 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=46 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:28:28.850499 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=88 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:28:29.098033 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-18cd1e6b-e955-424e-ac03-43596efd738c tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:28:29.098597 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-18cd1e6b-e955-424e-ac03-43596efd738c tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] [instance: 3b0c98dd-e4fa-410c-9dd2-01a61db2ddd9] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:28:29.104725 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-18cd1e6b-e955-424e-ac03-43596efd738c tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:28:29.105230 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-18cd1e6b-e955-424e-ac03-43596efd738c tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:28:29.105814 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-18cd1e6b-e955-424e-ac03-43596efd738c tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:28:29.106474 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-18cd1e6b-e955-424e-ac03-43596efd738c tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:28:29.106947 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-18cd1e6b-e955-424e-ac03-43596efd738c tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:28:29.107320 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-18cd1e6b-e955-424e-ac03-43596efd738c tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:28:29.145811 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-18cd1e6b-e955-424e-ac03-43596efd738c tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] [instance: 3b0c98dd-e4fa-410c-9dd2-01a61db2ddd9] Going to try to terminate instance {{(pid=134101) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 22:28:29.229598 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-18cd1e6b-e955-424e-ac03-43596efd738c tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] 10.222.0.43 "DELETE /compute/v2.1/servers/3b0c98dd-e4fa-410c-9dd2-01a61db2ddd9" status: 204 len: 0 microversion: 2.1 time: 0.386354 Oct 04 22:28:29.230418 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3555/6505] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 22:28:28 2022] DELETE /compute/v2.1/servers/3b0c98dd-e4fa-410c-9dd2-01a61db2ddd9 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 22:28:29.240002 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-710d14f0-9e45-4da0-8001-98da28e73272 tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:28:29.240786 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-710d14f0-9e45-4da0-8001-98da28e73272 tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] [instance: 3b0c98dd-e4fa-410c-9dd2-01a61db2ddd9] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:28:29.247111 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-710d14f0-9e45-4da0-8001-98da28e73272 tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:28:29.247559 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-710d14f0-9e45-4da0-8001-98da28e73272 tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:28:29.247993 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-710d14f0-9e45-4da0-8001-98da28e73272 tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:28:29.248905 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-710d14f0-9e45-4da0-8001-98da28e73272 tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:28:29.249484 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-710d14f0-9e45-4da0-8001-98da28e73272 tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:28:29.249905 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-710d14f0-9e45-4da0-8001-98da28e73272 tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:28:29.615081 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-710d14f0-9e45-4da0-8001-98da28e73272 tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b3239728640108aad384d11d251e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c2c7b1d34e4b31bca19ab9ea59b80e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:28:29.623734 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-710d14f0-9e45-4da0-8001-98da28e73272 tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] 10.222.0.43 "GET /compute/v2.1/servers/3b0c98dd-e4fa-410c-9dd2-01a61db2ddd9" status: 200 len: 1731 microversion: 2.1 time: 0.388856 Oct 04 22:28:29.637868 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3556/6506] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:28:29 2022] GET /compute/v2.1/servers/3b0c98dd-e4fa-410c-9dd2-01a61db2ddd9 => generated 1731 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:28:30.649284 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-00b36fc0-fefa-4fad-9ca2-870a38b02dd6 tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:28:30.649926 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-00b36fc0-fefa-4fad-9ca2-870a38b02dd6 tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] [instance: 3b0c98dd-e4fa-410c-9dd2-01a61db2ddd9] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:28:30.666199 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-00b36fc0-fefa-4fad-9ca2-870a38b02dd6 tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:28:30.666973 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-00b36fc0-fefa-4fad-9ca2-870a38b02dd6 tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:28:30.667434 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-00b36fc0-fefa-4fad-9ca2-870a38b02dd6 tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:28:30.668179 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-00b36fc0-fefa-4fad-9ca2-870a38b02dd6 tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:28:30.668654 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-00b36fc0-fefa-4fad-9ca2-870a38b02dd6 tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:28:30.669100 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-00b36fc0-fefa-4fad-9ca2-870a38b02dd6 tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:28:30.768932 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-00b36fc0-fefa-4fad-9ca2-870a38b02dd6 tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b3239728640108aad384d11d251e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c2c7b1d34e4b31bca19ab9ea59b80e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:28:30.784570 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-00b36fc0-fefa-4fad-9ca2-870a38b02dd6 tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] 10.222.0.43 "GET /compute/v2.1/servers/3b0c98dd-e4fa-410c-9dd2-01a61db2ddd9" status: 200 len: 1663 microversion: 2.1 time: 0.139251 Oct 04 22:28:30.786775 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3557/6507] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:28:30 2022] GET /compute/v2.1/servers/3b0c98dd-e4fa-410c-9dd2-01a61db2ddd9 => generated 1663 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:28:30.929128 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-baf6cd91-359f-4330-91a5-39be61bd7801 req-6a485fe5-d308-4887-835f-773937d9f9b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b0c98dd-e4fa-410c-9dd2-01a61db2ddd9", "name": "network-vif-deleted", "tag": "c8748d3d-2efd-4332-a388-3d6d1fbf3ef1"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:28:30.950534 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-baf6cd91-359f-4330-91a5-39be61bd7801 req-6a485fe5-d308-4887-835f-773937d9f9b7 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:28:30.951447 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-baf6cd91-359f-4330-91a5-39be61bd7801 req-6a485fe5-d308-4887-835f-773937d9f9b7 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:28:30.952165 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-baf6cd91-359f-4330-91a5-39be61bd7801 req-6a485fe5-d308-4887-835f-773937d9f9b7 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:28:30.980874 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-baf6cd91-359f-4330-91a5-39be61bd7801 req-6a485fe5-d308-4887-835f-773937d9f9b7 service nova] Creating event network-vif-deleted:c8748d3d-2efd-4332-a388-3d6d1fbf3ef1 for instance 3b0c98dd-e4fa-410c-9dd2-01a61db2ddd9 on n-h2-860284-1 Oct 04 22:28:30.997730 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-baf6cd91-359f-4330-91a5-39be61bd7801 req-6a485fe5-d308-4887-835f-773937d9f9b7 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072101 Oct 04 22:28:31.004196 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3558/6508] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:28:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:28:31.811853 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-a6c5251f-97e9-48a7-990e-6a923fb544ef tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:28:31.813216 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-a6c5251f-97e9-48a7-990e-6a923fb544ef tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] [instance: 3b0c98dd-e4fa-410c-9dd2-01a61db2ddd9] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:28:31.821675 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a6c5251f-97e9-48a7-990e-6a923fb544ef tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:28:31.822287 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a6c5251f-97e9-48a7-990e-6a923fb544ef tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:28:31.823023 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a6c5251f-97e9-48a7-990e-6a923fb544ef tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:28:31.823977 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a6c5251f-97e9-48a7-990e-6a923fb544ef tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:28:31.824754 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a6c5251f-97e9-48a7-990e-6a923fb544ef tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:28:31.825315 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a6c5251f-97e9-48a7-990e-6a923fb544ef tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:28:31.843673 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-a6c5251f-97e9-48a7-990e-6a923fb544ef tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] HTTP exception thrown: Instance 3b0c98dd-e4fa-410c-9dd2-01a61db2ddd9 could not be found. Oct 04 22:28:31.845891 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-a6c5251f-97e9-48a7-990e-6a923fb544ef tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] Request method failure captured: Oct 04 22:28:31.845891 n-d-860284-1 devstack@n-api.service[134101]: request: GET /compute/v2.1/servers/3b0c98dd-e4fa-410c-9dd2-01a61db2ddd9 HTTP/1.1 Oct 04 22:28:31.845891 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 22:28:31.845891 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 22:28:31.845891 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 22:28:31.845891 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 22:28:31.845891 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 22:28:31.845891 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 22:28:31.845891 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 22:28:31.845891 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 22:28:31.845891 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPLIqX1y7SyxyMYwdZXQk67a1BOJGwf1_TVCxrIPB-BUSaWFlZw36W4EUiPuHCptrj_osMgGcVbj7-9teEjwovuW6PQ1MErl_Lv-Tl5aWENfBSkOaOkNUxyiMN6FxrbP_F0ymXu_sSDUYhs9F7DqaztlhBz16XExWnZFWH26VKkzVo_4 Oct 04 22:28:31.845891 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 22:28:31.845891 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 22:28:31.845891 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 22:28:31.845891 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 22:28:31.845891 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 22:28:31.845891 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 22:28:31.845891 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: b0c2c7b1d34e4b31bca19ab9ea59b80e Oct 04 22:28:31.845891 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-TestServerBasicOps-1092200025 Oct 04 22:28:31.845891 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 22:28:31.845891 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 22:28:31.845891 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b0c2c7b1d34e4b31bca19ab9ea59b80e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_b0c2c7b1d34e4b31bca19ab9ea59b80e", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b0c2c7b1d34e4b31bca19ab9ea59b80e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/b0c2c7b1d34e4b31bca19ab9ea59b80e"}]}] Oct 04 22:28:31.845891 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-TestServerBasicOps-1092200025 Oct 04 22:28:31.845891 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: b0c2c7b1d34e4b31bca19ab9ea59b80e Oct 04 22:28:31.845891 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-TestServerBasicOps-1092200025 Oct 04 22:28:31.845891 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-TestServerBasicOps-1092200025-project Oct 04 22:28:31.845891 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 22:28:31.845891 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 22:28:31.845891 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: f99b3239728640108aad384d11d251e6 Oct 04 22:28:31.845891 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-TestServerBasicOps-1092200025-project Oct 04 22:28:31.845891 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 22:28:31.845891 n-d-860284-1 devstack@n-api.service[134101]: exception: Instance 3b0c98dd-e4fa-410c-9dd2-01a61db2ddd9 could not be found. Oct 04 22:28:31.845891 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': '3b0c98dd-e4fa-410c-9dd2-01a61db2ddd9'} Oct 04 22:28:31.845891 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:28:31.845891 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:28:31.845891 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:28:31.845891 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:28:31.845891 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:28:31.845891 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:28:31.845891 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:28:31.845891 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:28:31.845891 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:28:31.845891 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:28:31.845891 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b0c98dd-e4fa-410c-9dd2-01a61db2ddd9 could not be found. Oct 04 22:28:31.845891 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:28:31.845891 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:28:31.845891 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:28:31.845891 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:28:31.845891 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:28:31.845891 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:28:31.845891 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:28:31.845891 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:28:31.845891 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:28:31.845891 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:28:31.845891 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:28:31.845891 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:28:31.845891 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:28:31.845891 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:28:31.845891 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:28:31.845891 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:28:31.845891 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b0c98dd-e4fa-410c-9dd2-01a61db2ddd9 could not be found. Oct 04 22:28:31.845891 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:28:31.845891 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:28:31.845891 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:28:31.850450 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:28:31.850450 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:28:31.850450 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:28:31.850450 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:28:31.850450 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:28:31.850450 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b0c98dd-e4fa-410c-9dd2-01a61db2ddd9 could not be found. Oct 04 22:28:31.850450 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:28:31.850450 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-a6c5251f-97e9-48a7-990e-6a923fb544ef tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] Returning 404 to user: Instance 3b0c98dd-e4fa-410c-9dd2-01a61db2ddd9 could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:28:31.850450 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-a6c5251f-97e9-48a7-990e-6a923fb544ef tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] 10.222.0.43 "GET /compute/v2.1/servers/3b0c98dd-e4fa-410c-9dd2-01a61db2ddd9" status: 404 len: 111 microversion: 2.1 time: 0.042249 Oct 04 22:28:31.850450 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3559/6509] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:28:31 2022] GET /compute/v2.1/servers/3b0c98dd-e4fa-410c-9dd2-01a61db2ddd9 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:28:32.401372 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-7eb052cb-5ca7-4dfe-afab-67f381db770c tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:28:32.401886 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-7eb052cb-5ca7-4dfe-afab-67f381db770c tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] [instance: 3b0c98dd-e4fa-410c-9dd2-01a61db2ddd9] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:28:32.408806 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7eb052cb-5ca7-4dfe-afab-67f381db770c tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:28:32.409335 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7eb052cb-5ca7-4dfe-afab-67f381db770c tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:28:32.409818 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7eb052cb-5ca7-4dfe-afab-67f381db770c tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:28:32.410563 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7eb052cb-5ca7-4dfe-afab-67f381db770c tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:28:32.411076 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7eb052cb-5ca7-4dfe-afab-67f381db770c tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:28:32.411475 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7eb052cb-5ca7-4dfe-afab-67f381db770c tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:28:32.426286 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-7eb052cb-5ca7-4dfe-afab-67f381db770c tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] HTTP exception thrown: Instance 3b0c98dd-e4fa-410c-9dd2-01a61db2ddd9 could not be found. Oct 04 22:28:32.427874 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-7eb052cb-5ca7-4dfe-afab-67f381db770c tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] Request method failure captured: Oct 04 22:28:32.427874 n-d-860284-1 devstack@n-api.service[134101]: request: DELETE /compute/v2.1/servers/3b0c98dd-e4fa-410c-9dd2-01a61db2ddd9 HTTP/1.1 Oct 04 22:28:32.427874 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 22:28:32.427874 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 22:28:32.427874 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 22:28:32.427874 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 22:28:32.427874 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 22:28:32.427874 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 22:28:32.427874 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 22:28:32.427874 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 22:28:32.427874 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPLIqX1y7SyxyMYwdZXQk67a1BOJGwf1_TVCxrIPB-BUSaWFlZw36W4EUiPuHCptrj_osMgGcVbj7-9teEjwovuW6PQ1MErl_Lv-Tl5aWENfBSkOaOkNUxyiMN6FxrbP_F0ymXu_sSDUYhs9F7DqaztlhBz16XExWnZFWH26VKkzVo_4 Oct 04 22:28:32.427874 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 22:28:32.427874 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 22:28:32.427874 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 22:28:32.427874 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 22:28:32.427874 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 22:28:32.427874 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 22:28:32.427874 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: b0c2c7b1d34e4b31bca19ab9ea59b80e Oct 04 22:28:32.427874 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-TestServerBasicOps-1092200025 Oct 04 22:28:32.427874 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 22:28:32.427874 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 22:28:32.427874 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b0c2c7b1d34e4b31bca19ab9ea59b80e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_b0c2c7b1d34e4b31bca19ab9ea59b80e", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b0c2c7b1d34e4b31bca19ab9ea59b80e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/b0c2c7b1d34e4b31bca19ab9ea59b80e"}]}] Oct 04 22:28:32.427874 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-TestServerBasicOps-1092200025 Oct 04 22:28:32.427874 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: b0c2c7b1d34e4b31bca19ab9ea59b80e Oct 04 22:28:32.427874 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-TestServerBasicOps-1092200025 Oct 04 22:28:32.427874 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-TestServerBasicOps-1092200025-project Oct 04 22:28:32.427874 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 22:28:32.427874 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 22:28:32.427874 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: f99b3239728640108aad384d11d251e6 Oct 04 22:28:32.427874 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-TestServerBasicOps-1092200025-project Oct 04 22:28:32.427874 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 22:28:32.427874 n-d-860284-1 devstack@n-api.service[134101]: exception: Instance 3b0c98dd-e4fa-410c-9dd2-01a61db2ddd9 could not be found. Oct 04 22:28:32.427874 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': '3b0c98dd-e4fa-410c-9dd2-01a61db2ddd9'} Oct 04 22:28:32.427874 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:28:32.427874 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:28:32.427874 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:28:32.427874 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:28:32.427874 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:28:32.427874 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:28:32.427874 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:28:32.427874 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:28:32.427874 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:28:32.427874 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:28:32.427874 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b0c98dd-e4fa-410c-9dd2-01a61db2ddd9 could not be found. Oct 04 22:28:32.427874 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:28:32.427874 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:28:32.427874 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:28:32.427874 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:28:32.427874 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:28:32.427874 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:28:32.427874 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:28:32.427874 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:28:32.427874 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:28:32.427874 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:28:32.427874 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 22:28:32.427874 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 22:28:32.427874 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 22:28:32.427874 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 22:28:32.427874 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:28:32.427874 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:28:32.427874 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:28:32.427874 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:28:32.433781 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b0c98dd-e4fa-410c-9dd2-01a61db2ddd9 could not be found. Oct 04 22:28:32.433781 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:28:32.433781 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:28:32.433781 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:28:32.433781 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:28:32.433781 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:28:32.433781 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:28:32.433781 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:28:32.433781 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:28:32.433781 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b0c98dd-e4fa-410c-9dd2-01a61db2ddd9 could not be found. Oct 04 22:28:32.433781 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:28:32.433781 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-7eb052cb-5ca7-4dfe-afab-67f381db770c tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] Returning 404 to user: Instance 3b0c98dd-e4fa-410c-9dd2-01a61db2ddd9 could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:28:32.433781 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-7eb052cb-5ca7-4dfe-afab-67f381db770c tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] 10.222.0.43 "DELETE /compute/v2.1/servers/3b0c98dd-e4fa-410c-9dd2-01a61db2ddd9" status: 404 len: 111 microversion: 2.1 time: 0.032166 Oct 04 22:28:32.433781 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3560/6510] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 22:28:32 2022] DELETE /compute/v2.1/servers/3b0c98dd-e4fa-410c-9dd2-01a61db2ddd9 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:28:32.437773 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-5dde82e8-aed8-4822-9ce3-4df5b69f446f tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:28:32.438425 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-5dde82e8-aed8-4822-9ce3-4df5b69f446f tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] [instance: 3b0c98dd-e4fa-410c-9dd2-01a61db2ddd9] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:28:32.444598 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5dde82e8-aed8-4822-9ce3-4df5b69f446f tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:28:32.445097 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5dde82e8-aed8-4822-9ce3-4df5b69f446f tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:28:32.445633 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5dde82e8-aed8-4822-9ce3-4df5b69f446f tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:28:32.446265 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5dde82e8-aed8-4822-9ce3-4df5b69f446f tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:28:32.446761 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5dde82e8-aed8-4822-9ce3-4df5b69f446f tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:28:32.447205 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5dde82e8-aed8-4822-9ce3-4df5b69f446f tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:28:32.461258 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-5dde82e8-aed8-4822-9ce3-4df5b69f446f tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] HTTP exception thrown: Instance 3b0c98dd-e4fa-410c-9dd2-01a61db2ddd9 could not be found. Oct 04 22:28:32.462969 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-5dde82e8-aed8-4822-9ce3-4df5b69f446f tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] Request method failure captured: Oct 04 22:28:32.462969 n-d-860284-1 devstack@n-api.service[134101]: request: GET /compute/v2.1/servers/3b0c98dd-e4fa-410c-9dd2-01a61db2ddd9 HTTP/1.1 Oct 04 22:28:32.462969 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 22:28:32.462969 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 22:28:32.462969 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 22:28:32.462969 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 22:28:32.462969 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 22:28:32.462969 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 22:28:32.462969 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 22:28:32.462969 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 22:28:32.462969 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPLIqX1y7SyxyMYwdZXQk67a1BOJGwf1_TVCxrIPB-BUSaWFlZw36W4EUiPuHCptrj_osMgGcVbj7-9teEjwovuW6PQ1MErl_Lv-Tl5aWENfBSkOaOkNUxyiMN6FxrbP_F0ymXu_sSDUYhs9F7DqaztlhBz16XExWnZFWH26VKkzVo_4 Oct 04 22:28:32.462969 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 22:28:32.462969 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 22:28:32.462969 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 22:28:32.462969 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 22:28:32.462969 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 22:28:32.462969 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 22:28:32.462969 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: b0c2c7b1d34e4b31bca19ab9ea59b80e Oct 04 22:28:32.462969 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-TestServerBasicOps-1092200025 Oct 04 22:28:32.462969 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 22:28:32.462969 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 22:28:32.462969 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b0c2c7b1d34e4b31bca19ab9ea59b80e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_b0c2c7b1d34e4b31bca19ab9ea59b80e", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b0c2c7b1d34e4b31bca19ab9ea59b80e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/b0c2c7b1d34e4b31bca19ab9ea59b80e"}]}] Oct 04 22:28:32.462969 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-TestServerBasicOps-1092200025 Oct 04 22:28:32.462969 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: b0c2c7b1d34e4b31bca19ab9ea59b80e Oct 04 22:28:32.462969 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-TestServerBasicOps-1092200025 Oct 04 22:28:32.462969 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-TestServerBasicOps-1092200025-project Oct 04 22:28:32.462969 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 22:28:32.462969 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 22:28:32.462969 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: f99b3239728640108aad384d11d251e6 Oct 04 22:28:32.462969 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-TestServerBasicOps-1092200025-project Oct 04 22:28:32.462969 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 22:28:32.462969 n-d-860284-1 devstack@n-api.service[134101]: exception: Instance 3b0c98dd-e4fa-410c-9dd2-01a61db2ddd9 could not be found. Oct 04 22:28:32.462969 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': '3b0c98dd-e4fa-410c-9dd2-01a61db2ddd9'} Oct 04 22:28:32.462969 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:28:32.462969 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:28:32.462969 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:28:32.462969 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:28:32.462969 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:28:32.462969 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:28:32.462969 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:28:32.462969 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:28:32.462969 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:28:32.462969 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:28:32.462969 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b0c98dd-e4fa-410c-9dd2-01a61db2ddd9 could not be found. Oct 04 22:28:32.462969 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:28:32.462969 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:28:32.462969 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:28:32.462969 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:28:32.462969 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:28:32.462969 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:28:32.462969 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:28:32.462969 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:28:32.462969 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:28:32.462969 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:28:32.462969 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:28:32.462969 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:28:32.462969 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:28:32.462969 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:28:32.462969 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:28:32.462969 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:28:32.462969 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b0c98dd-e4fa-410c-9dd2-01a61db2ddd9 could not be found. Oct 04 22:28:32.462969 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:28:32.462969 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:28:32.462969 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:28:32.472871 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:28:32.472871 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:28:32.472871 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:28:32.472871 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:28:32.472871 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:28:32.472871 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b0c98dd-e4fa-410c-9dd2-01a61db2ddd9 could not be found. Oct 04 22:28:32.472871 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:28:32.472871 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-5dde82e8-aed8-4822-9ce3-4df5b69f446f tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] Returning 404 to user: Instance 3b0c98dd-e4fa-410c-9dd2-01a61db2ddd9 could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:28:32.472871 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-5dde82e8-aed8-4822-9ce3-4df5b69f446f tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] 10.222.0.43 "GET /compute/v2.1/servers/3b0c98dd-e4fa-410c-9dd2-01a61db2ddd9" status: 404 len: 111 microversion: 2.1 time: 0.030305 Oct 04 22:28:32.472871 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3561/6511] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:28:32 2022] GET /compute/v2.1/servers/3b0c98dd-e4fa-410c-9dd2-01a61db2ddd9 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 22:28:32.632468 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e2949731-c16a-4a67-90cf-d0f2b9efa733 tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] Calling method '.version_select at 0x7fbb2e1189d0>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:28:32.638019 n-d-860284-1 devstack@n-api.service[134101]: ERROR oslo.messaging._drivers.impl_rabbit [None req-e2949731-c16a-4a67-90cf-d0f2b9efa733 tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] [54f0993b-fb22-4e4c-ae00-e3f0e5da4c18] AMQP server on 10.222.0.43:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 22:28:32.711061 n-d-860284-1 devstack@n-api.service[134102]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 22:28:32.711689 n-d-860284-1 devstack@n-api.service[134102]: Tue Oct 4 22:28:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.43) !!! Oct 04 22:28:33.646217 n-d-860284-1 devstack@n-api.service[134101]: INFO oslo.messaging._drivers.impl_rabbit [None req-e2949731-c16a-4a67-90cf-d0f2b9efa733 tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] [54f0993b-fb22-4e4c-ae00-e3f0e5da4c18] Reconnected to AMQP server on 10.222.0.43:5672 via [amqp] client with port 56912. Oct 04 22:28:33.672045 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-e2949731-c16a-4a67-90cf-d0f2b9efa733 tempest-TestServerBasicOps-1092200025 tempest-TestServerBasicOps-1092200025-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-750669432" status: 202 len: 0 microversion: 2.1 time: 1.043540 Oct 04 22:28:33.672805 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3562/6512] 10.222.0.43 () {58 vars in 1251 bytes} [Tue Oct 4 22:28:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-750669432 => generated 0 bytes in 1045 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 22:29:12.226911 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:29:12.227924 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:29:12.344026 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-d82d99c5-9c90-4651-84b9-c35e88cb7cf5 tempest-TestAggregatesBasicOps-1704045288 tempest-TestAggregatesBasicOps-1704045288-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-890341383", "availability_zone": "foo_zone"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:29:12.370545 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.objects.aggregate [None req-d82d99c5-9c90-4651-84b9-c35e88cb7cf5 tempest-TestAggregatesBasicOps-1704045288 tempest-TestAggregatesBasicOps-1704045288-project-admin] Generated uuid cde19aad-2763-4bce-a625-908ea3572fbd for aggregate {{(pid=134101) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 22:29:12.399839 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-d82d99c5-9c90-4651-84b9-c35e88cb7cf5 tempest-TestAggregatesBasicOps-1704045288 tempest-TestAggregatesBasicOps-1704045288-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates" status: 200 len: 208 microversion: 2.1 time: 0.178997 Oct 04 22:29:12.401258 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3563/6513] 10.222.0.43 () {60 vars in 1164 bytes} [Tue Oct 4 22:29:12 2022] POST /compute/v2.1/os-aggregates => generated 208 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:29:12.414341 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-1070d1a7-1c8d-4d8d-b3a3-278655bd3f4b tempest-TestAggregatesBasicOps-1704045288 tempest-TestAggregatesBasicOps-1704045288-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:29:12.441902 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-1070d1a7-1c8d-4d8d-b3a3-278655bd3f4b tempest-TestAggregatesBasicOps-1704045288 tempest-TestAggregatesBasicOps-1704045288-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 318 microversion: 2.1 time: 0.032334 Oct 04 22:29:12.449570 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3564/6514] 10.222.0.43 () {60 vars in 1194 bytes} [Tue Oct 4 22:29:12 2022] POST /compute/v2.1/os-aggregates/19/action => generated 318 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:29:12.456721 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-31b03e9e-4982-4495-ac1a-8e933469d0a5 tempest-TestAggregatesBasicOps-1704045288 tempest-TestAggregatesBasicOps-1704045288-project-admin] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:29:12.461266 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-31b03e9e-4982-4495-ac1a-8e933469d0a5 tempest-TestAggregatesBasicOps-1704045288 tempest-TestAggregatesBasicOps-1704045288-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:29:12.461808 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-31b03e9e-4982-4495-ac1a-8e933469d0a5 tempest-TestAggregatesBasicOps-1704045288 tempest-TestAggregatesBasicOps-1704045288-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:29:12.462275 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-31b03e9e-4982-4495-ac1a-8e933469d0a5 tempest-TestAggregatesBasicOps-1704045288 tempest-TestAggregatesBasicOps-1704045288-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:29:12.463064 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-31b03e9e-4982-4495-ac1a-8e933469d0a5 tempest-TestAggregatesBasicOps-1704045288 tempest-TestAggregatesBasicOps-1704045288-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:29:12.463544 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-31b03e9e-4982-4495-ac1a-8e933469d0a5 tempest-TestAggregatesBasicOps-1704045288 tempest-TestAggregatesBasicOps-1704045288-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:29:12.463994 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-31b03e9e-4982-4495-ac1a-8e933469d0a5 tempest-TestAggregatesBasicOps-1704045288 tempest-TestAggregatesBasicOps-1704045288-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:29:12.491711 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-31b03e9e-4982-4495-ac1a-8e933469d0a5 tempest-TestAggregatesBasicOps-1704045288 tempest-TestAggregatesBasicOps-1704045288-project-admin] 10.222.0.43 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.041005 Oct 04 22:29:12.492335 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3565/6515] 10.222.0.43 () {58 vars in 1176 bytes} [Tue Oct 4 22:29:12 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:29:12.504007 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-b94ec1c6-5caa-4d51-b3c0-bb0f84a72f24 tempest-TestAggregatesBasicOps-1704045288 tempest-TestAggregatesBasicOps-1704045288-project-admin] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:29:12.511733 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-b94ec1c6-5caa-4d51-b3c0-bb0f84a72f24 tempest-TestAggregatesBasicOps-1704045288 tempest-TestAggregatesBasicOps-1704045288-project-admin] 10.222.0.43 "GET /compute/v2.1/os-aggregates" status: 200 len: 297 microversion: 2.1 time: 0.011895 Oct 04 22:29:12.512636 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3566/6516] 10.222.0.43 () {58 vars in 1143 bytes} [Tue Oct 4 22:29:12 2022] GET /compute/v2.1/os-aggregates => generated 297 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:29:12.525570 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-c01aac48-abd3-4e7f-8cf8-0c7acd2540cf tempest-TestAggregatesBasicOps-1704045288 tempest-TestAggregatesBasicOps-1704045288-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-860284-1"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:29:12.540691 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c01aac48-abd3-4e7f-8cf8-0c7acd2540cf tempest-TestAggregatesBasicOps-1704045288 tempest-TestAggregatesBasicOps-1704045288-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:29:12.541213 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c01aac48-abd3-4e7f-8cf8-0c7acd2540cf tempest-TestAggregatesBasicOps-1704045288 tempest-TestAggregatesBasicOps-1704045288-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:29:12.541678 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c01aac48-abd3-4e7f-8cf8-0c7acd2540cf tempest-TestAggregatesBasicOps-1704045288 tempest-TestAggregatesBasicOps-1704045288-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:29:12.887883 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-c01aac48-abd3-4e7f-8cf8-0c7acd2540cf tempest-TestAggregatesBasicOps-1704045288 tempest-TestAggregatesBasicOps-1704045288-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 309 microversion: 2.1 time: 0.366660 Oct 04 22:29:12.888665 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3567/6517] 10.222.0.43 () {60 vars in 1194 bytes} [Tue Oct 4 22:29:12 2022] POST /compute/v2.1/os-aggregates/19/action => generated 309 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:29:12.900206 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-0ff930c4-2472-482b-b059-84d27c7caf33 tempest-TestAggregatesBasicOps-1704045288 tempest-TestAggregatesBasicOps-1704045288-project-admin] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:29:12.910345 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-0ff930c4-2472-482b-b059-84d27c7caf33 tempest-TestAggregatesBasicOps-1704045288 tempest-TestAggregatesBasicOps-1704045288-project-admin] 10.222.0.43 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 309 microversion: 2.1 time: 0.014058 Oct 04 22:29:12.918161 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3568/6518] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Oct 4 22:29:12 2022] GET /compute/v2.1/os-aggregates/19 => generated 309 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:29:12.924373 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-a3ed0417-410d-4876-9336-8fce904f7d35 tempest-TestAggregatesBasicOps-1704045288 tempest-TestAggregatesBasicOps-1704045288-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-1209024758", "availability_zone": "foo_zone"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:29:13.047231 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-a3ed0417-410d-4876-9336-8fce904f7d35 tempest-TestAggregatesBasicOps-1704045288 tempest-TestAggregatesBasicOps-1704045288-project-admin] 10.222.0.43 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 342 microversion: 2.1 time: 0.127662 Oct 04 22:29:13.049070 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3569/6519] 10.222.0.43 () {60 vars in 1173 bytes} [Tue Oct 4 22:29:12 2022] PUT /compute/v2.1/os-aggregates/19 => generated 342 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:29:13.063556 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-d37d7489-fd5c-4b49-ae9e-15f66484def4 tempest-TestAggregatesBasicOps-1704045288 tempest-TestAggregatesBasicOps-1704045288-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:29:13.091170 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-d37d7489-fd5c-4b49-ae9e-15f66484def4 tempest-TestAggregatesBasicOps-1704045288 tempest-TestAggregatesBasicOps-1704045288-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 356 microversion: 2.1 time: 0.031501 Oct 04 22:29:13.091965 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3570/6520] 10.222.0.43 () {60 vars in 1194 bytes} [Tue Oct 4 22:29:13 2022] POST /compute/v2.1/os-aggregates/19/action => generated 356 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:29:13.103494 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-7bfc9f5e-ea13-4290-91d1-9e50aff6bb1b tempest-TestAggregatesBasicOps-1704045288 tempest-TestAggregatesBasicOps-1704045288-project-admin] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:29:13.112414 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-7bfc9f5e-ea13-4290-91d1-9e50aff6bb1b tempest-TestAggregatesBasicOps-1704045288 tempest-TestAggregatesBasicOps-1704045288-project-admin] 10.222.0.43 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 356 microversion: 2.1 time: 0.012500 Oct 04 22:29:13.113016 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3571/6521] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Oct 4 22:29:13 2022] GET /compute/v2.1/os-aggregates/19 => generated 356 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:29:13.123778 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-ccb87883-7bb6-44bd-831e-6540b16fa9c0 tempest-TestAggregatesBasicOps-1704045288 tempest-TestAggregatesBasicOps-1704045288-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-860284-1"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:29:13.140145 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ccb87883-7bb6-44bd-831e-6540b16fa9c0 tempest-TestAggregatesBasicOps-1704045288 tempest-TestAggregatesBasicOps-1704045288-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:29:13.140665 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ccb87883-7bb6-44bd-831e-6540b16fa9c0 tempest-TestAggregatesBasicOps-1704045288 tempest-TestAggregatesBasicOps-1704045288-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:29:13.141201 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ccb87883-7bb6-44bd-831e-6540b16fa9c0 tempest-TestAggregatesBasicOps-1704045288 tempest-TestAggregatesBasicOps-1704045288-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:29:13.272073 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-ccb87883-7bb6-44bd-831e-6540b16fa9c0 tempest-TestAggregatesBasicOps-1704045288 tempest-TestAggregatesBasicOps-1704045288-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 341 microversion: 2.1 time: 0.151780 Oct 04 22:29:13.274539 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3572/6522] 10.222.0.43 () {60 vars in 1194 bytes} [Tue Oct 4 22:29:13 2022] POST /compute/v2.1/os-aggregates/19/action => generated 341 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:29:13.284298 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-d709c543-6162-46e4-8c3e-fab643c87b89 tempest-TestAggregatesBasicOps-1704045288 tempest-TestAggregatesBasicOps-1704045288-project-admin] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:29:13.305796 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-d709c543-6162-46e4-8c3e-fab643c87b89 tempest-TestAggregatesBasicOps-1704045288 tempest-TestAggregatesBasicOps-1704045288-project-admin] 10.222.0.43 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.025459 Oct 04 22:29:13.306419 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3573/6523] 10.222.0.43 () {58 vars in 1155 bytes} [Tue Oct 4 22:29:13 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Oct 04 22:29:17.337078 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-c7caddfa-1505-4a2e-a665-09532fbf198d tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:29:17.338266 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-c7caddfa-1505-4a2e-a665-09532fbf198d tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] [instance: 0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:29:17.346490 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c7caddfa-1505-4a2e-a665-09532fbf198d tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:29:17.347155 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c7caddfa-1505-4a2e-a665-09532fbf198d tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:29:17.347618 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c7caddfa-1505-4a2e-a665-09532fbf198d tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:29:17.348344 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c7caddfa-1505-4a2e-a665-09532fbf198d tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:29:17.348999 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c7caddfa-1505-4a2e-a665-09532fbf198d tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:29:17.349608 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c7caddfa-1505-4a2e-a665-09532fbf198d tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:29:17.383096 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-c7caddfa-1505-4a2e-a665-09532fbf198d tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] 10.222.0.43 "GET /compute/v2.1/servers/0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc/os-volume_attachments/0481f447-5070-497d-8b17-a4e5503dd70c" status: 200 len: 194 microversion: 2.20 time: 0.053509 Oct 04 22:29:17.383731 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3574/6524] 10.222.0.43 () {60 vars in 1454 bytes} [Tue Oct 4 22:29:17 2022] GET /compute/v2.1/servers/0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc/os-volume_attachments/0481f447-5070-497d-8b17-a4e5503dd70c => generated 194 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 22:29:17.462592 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-68afc0d3-4adb-4f4f-9e16-ce229af40aa6 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:29:17.463116 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-68afc0d3-4adb-4f4f-9e16-ce229af40aa6 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] [instance: 0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:29:17.469926 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-68afc0d3-4adb-4f4f-9e16-ce229af40aa6 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:29:17.470423 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-68afc0d3-4adb-4f4f-9e16-ce229af40aa6 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:29:17.470859 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-68afc0d3-4adb-4f4f-9e16-ce229af40aa6 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:29:17.471591 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-68afc0d3-4adb-4f4f-9e16-ce229af40aa6 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:29:17.472281 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-68afc0d3-4adb-4f4f-9e16-ce229af40aa6 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:29:17.472659 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-68afc0d3-4adb-4f4f-9e16-ce229af40aa6 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:29:17.560355 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.objects.instance [None req-68afc0d3-4adb-4f4f-9e16-ce229af40aa6 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lazy-loading 'services' on Instance uuid 0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc {{(pid=134101) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 22:29:17.650527 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-68afc0d3-4adb-4f4f-9e16-ce229af40aa6 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] 10.222.0.43 "DELETE /compute/v2.1/servers/0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc/os-volume_attachments/0481f447-5070-497d-8b17-a4e5503dd70c" status: 202 len: 0 microversion: 2.20 time: 0.192025 Oct 04 22:29:17.651166 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3575/6525] 10.222.0.43 () {60 vars in 1457 bytes} [Tue Oct 4 22:29:17 2022] DELETE /compute/v2.1/servers/0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc/os-volume_attachments/0481f447-5070-497d-8b17-a4e5503dd70c => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 04 22:29:17.661325 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-76c40824-f09f-4de2-a41d-f159cccd85e1 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:29:17.663809 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-76c40824-f09f-4de2-a41d-f159cccd85e1 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] [instance: 0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:29:17.671208 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-76c40824-f09f-4de2-a41d-f159cccd85e1 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:29:17.671974 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-76c40824-f09f-4de2-a41d-f159cccd85e1 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:29:17.673366 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-76c40824-f09f-4de2-a41d-f159cccd85e1 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:29:17.674277 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-76c40824-f09f-4de2-a41d-f159cccd85e1 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:29:17.675095 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-76c40824-f09f-4de2-a41d-f159cccd85e1 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:29:17.675552 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-76c40824-f09f-4de2-a41d-f159cccd85e1 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:29:17.710227 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-76c40824-f09f-4de2-a41d-f159cccd85e1 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] 10.222.0.43 "GET /compute/v2.1/servers/0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054032 Oct 04 22:29:17.711145 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3576/6526] 10.222.0.43 () {60 vars in 1343 bytes} [Tue Oct 4 22:29:17 2022] GET /compute/v2.1/servers/0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 22:29:18.724907 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-84cb48f4-1c26-4b2d-8422-3c1795431e92 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:29:18.727759 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-84cb48f4-1c26-4b2d-8422-3c1795431e92 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] [instance: 0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:29:18.735226 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-84cb48f4-1c26-4b2d-8422-3c1795431e92 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:29:18.736080 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-84cb48f4-1c26-4b2d-8422-3c1795431e92 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:29:18.736764 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-84cb48f4-1c26-4b2d-8422-3c1795431e92 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:29:18.737701 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-84cb48f4-1c26-4b2d-8422-3c1795431e92 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:29:18.738783 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-84cb48f4-1c26-4b2d-8422-3c1795431e92 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:29:18.739464 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-84cb48f4-1c26-4b2d-8422-3c1795431e92 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:29:18.773168 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-84cb48f4-1c26-4b2d-8422-3c1795431e92 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] 10.222.0.43 "GET /compute/v2.1/servers/0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052426 Oct 04 22:29:18.774667 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3577/6527] 10.222.0.43 () {60 vars in 1343 bytes} [Tue Oct 4 22:29:18 2022] GET /compute/v2.1/servers/0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 22:29:19.788004 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-65992cea-233e-4b0e-ab2c-70b4746a7a59 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:29:19.790828 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-65992cea-233e-4b0e-ab2c-70b4746a7a59 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] [instance: 0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:29:19.814574 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-65992cea-233e-4b0e-ab2c-70b4746a7a59 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:29:19.815370 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-65992cea-233e-4b0e-ab2c-70b4746a7a59 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:29:19.816067 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-65992cea-233e-4b0e-ab2c-70b4746a7a59 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:29:19.820106 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-65992cea-233e-4b0e-ab2c-70b4746a7a59 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:29:19.821167 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-65992cea-233e-4b0e-ab2c-70b4746a7a59 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:29:19.821824 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-65992cea-233e-4b0e-ab2c-70b4746a7a59 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:29:19.889430 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-65992cea-233e-4b0e-ab2c-70b4746a7a59 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] 10.222.0.43 "GET /compute/v2.1/servers/0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.105726 Oct 04 22:29:19.890448 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3578/6528] 10.222.0.43 () {60 vars in 1343 bytes} [Tue Oct 4 22:29:19 2022] GET /compute/v2.1/servers/0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc/os-volume_attachments => generated 197 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 22:29:20.905176 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-d9921d6d-c918-4824-a137-967ad74b193b tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:29:20.908518 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-d9921d6d-c918-4824-a137-967ad74b193b tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] [instance: 0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:29:20.925063 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d9921d6d-c918-4824-a137-967ad74b193b tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:29:20.925584 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d9921d6d-c918-4824-a137-967ad74b193b tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:29:20.926046 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d9921d6d-c918-4824-a137-967ad74b193b tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:29:20.933988 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d9921d6d-c918-4824-a137-967ad74b193b tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:29:20.934331 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d9921d6d-c918-4824-a137-967ad74b193b tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:29:20.934845 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d9921d6d-c918-4824-a137-967ad74b193b tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:29:20.974864 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-d9921d6d-c918-4824-a137-967ad74b193b tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] 10.222.0.43 "GET /compute/v2.1/servers/0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.074288 Oct 04 22:29:20.975605 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3579/6529] 10.222.0.43 () {60 vars in 1343 bytes} [Tue Oct 4 22:29:20 2022] GET /compute/v2.1/servers/0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 22:29:21.988570 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-1dba71c2-f955-4938-9db0-c29cb118b4d3 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:29:21.991468 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-1dba71c2-f955-4938-9db0-c29cb118b4d3 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] [instance: 0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:29:21.998651 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1dba71c2-f955-4938-9db0-c29cb118b4d3 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:29:21.999168 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1dba71c2-f955-4938-9db0-c29cb118b4d3 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:29:21.999629 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1dba71c2-f955-4938-9db0-c29cb118b4d3 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:29:22.000407 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1dba71c2-f955-4938-9db0-c29cb118b4d3 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:29:22.000883 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1dba71c2-f955-4938-9db0-c29cb118b4d3 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:29:22.001323 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1dba71c2-f955-4938-9db0-c29cb118b4d3 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:29:22.035550 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-1dba71c2-f955-4938-9db0-c29cb118b4d3 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] 10.222.0.43 "GET /compute/v2.1/servers/0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051838 Oct 04 22:29:22.036149 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3580/6530] 10.222.0.43 () {60 vars in 1343 bytes} [Tue Oct 4 22:29:21 2022] GET /compute/v2.1/servers/0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 22:29:23.049435 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-c6f93827-879d-4e81-924f-ddbf399bc998 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:29:23.055127 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-c6f93827-879d-4e81-924f-ddbf399bc998 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] [instance: 0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:29:23.060555 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=2 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:29:23.072808 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c6f93827-879d-4e81-924f-ddbf399bc998 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:29:23.073660 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c6f93827-879d-4e81-924f-ddbf399bc998 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:29:23.074389 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c6f93827-879d-4e81-924f-ddbf399bc998 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:29:23.076190 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c6f93827-879d-4e81-924f-ddbf399bc998 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:29:23.077108 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c6f93827-879d-4e81-924f-ddbf399bc998 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:29:23.077790 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c6f93827-879d-4e81-924f-ddbf399bc998 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:29:23.115966 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-c6f93827-879d-4e81-924f-ddbf399bc998 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] 10.222.0.43 "GET /compute/v2.1/servers/0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.072188 Oct 04 22:29:23.123108 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3581/6531] 10.222.0.43 () {60 vars in 1343 bytes} [Tue Oct 4 22:29:23 2022] GET /compute/v2.1/servers/0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc/os-volume_attachments => generated 25 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:29:23.197397 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-b67ea324-9929-49d1-b483-e849659f1e72 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:29:23.198306 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-b67ea324-9929-49d1-b483-e849659f1e72 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] [instance: 0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:29:23.207963 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b67ea324-9929-49d1-b483-e849659f1e72 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:29:23.208544 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b67ea324-9929-49d1-b483-e849659f1e72 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:29:23.209255 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b67ea324-9929-49d1-b483-e849659f1e72 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:29:23.210087 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b67ea324-9929-49d1-b483-e849659f1e72 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:29:23.210646 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b67ea324-9929-49d1-b483-e849659f1e72 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:29:23.211697 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b67ea324-9929-49d1-b483-e849659f1e72 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:29:23.242030 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-b67ea324-9929-49d1-b483-e849659f1e72 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] [instance: 0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc] Going to try to terminate instance {{(pid=134101) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 22:29:23.363575 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-b67ea324-9929-49d1-b483-e849659f1e72 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] 10.222.0.43 "DELETE /compute/v2.1/servers/0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc" status: 204 len: 0 microversion: 2.20 time: 0.169715 Oct 04 22:29:23.364592 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3582/6532] 10.222.0.43 () {60 vars in 1280 bytes} [Tue Oct 4 22:29:23 2022] DELETE /compute/v2.1/servers/0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 04 22:29:23.377190 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-0ff3b181-ab25-4516-a2d0-18e6bfa734b7 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:29:23.378602 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-0ff3b181-ab25-4516-a2d0-18e6bfa734b7 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] [instance: 0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:29:23.385847 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0ff3b181-ab25-4516-a2d0-18e6bfa734b7 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:29:23.386729 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0ff3b181-ab25-4516-a2d0-18e6bfa734b7 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:29:23.387569 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0ff3b181-ab25-4516-a2d0-18e6bfa734b7 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:29:23.388786 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0ff3b181-ab25-4516-a2d0-18e6bfa734b7 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:29:23.389432 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0ff3b181-ab25-4516-a2d0-18e6bfa734b7 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:29:23.390224 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0ff3b181-ab25-4516-a2d0-18e6bfa734b7 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:29:23.609438 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-0ff3b181-ab25-4516-a2d0-18e6bfa734b7 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:29:23.622627 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-0ff3b181-ab25-4516-a2d0-18e6bfa734b7 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:29:23.624513 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-0ff3b181-ab25-4516-a2d0-18e6bfa734b7 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:29:23.626031 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-0ff3b181-ab25-4516-a2d0-18e6bfa734b7 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] 10.222.0.43 "GET /compute/v2.1/servers/0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc" status: 200 len: 1720 microversion: 2.20 time: 0.254166 Oct 04 22:29:23.627192 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3583/6533] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:29:23 2022] GET /compute/v2.1/servers/0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc => generated 1720 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:29:24.657051 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-1b6c3815-25d6-4bee-b137-1eb8768384fe tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:29:24.658575 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-1b6c3815-25d6-4bee-b137-1eb8768384fe tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] [instance: 0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:29:24.667176 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1b6c3815-25d6-4bee-b137-1eb8768384fe tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:29:24.669270 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1b6c3815-25d6-4bee-b137-1eb8768384fe tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:29:24.669740 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1b6c3815-25d6-4bee-b137-1eb8768384fe tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:29:24.670535 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1b6c3815-25d6-4bee-b137-1eb8768384fe tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:29:24.671378 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1b6c3815-25d6-4bee-b137-1eb8768384fe tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:29:24.672030 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1b6c3815-25d6-4bee-b137-1eb8768384fe tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:29:24.855254 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-1b6c3815-25d6-4bee-b137-1eb8768384fe tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:29:24.866964 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-1b6c3815-25d6-4bee-b137-1eb8768384fe tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:29:24.868462 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-1b6c3815-25d6-4bee-b137-1eb8768384fe tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:29:24.869685 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-1b6c3815-25d6-4bee-b137-1eb8768384fe tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] 10.222.0.43 "GET /compute/v2.1/servers/0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc" status: 200 len: 1720 microversion: 2.20 time: 0.217698 Oct 04 22:29:24.882438 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3584/6534] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:29:24 2022] GET /compute/v2.1/servers/0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc => generated 1720 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 22:29:25.897832 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-9f7771d1-b4e8-40fe-9d48-921ac2477b36 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:29:25.899397 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-9f7771d1-b4e8-40fe-9d48-921ac2477b36 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] [instance: 0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:29:25.908291 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9f7771d1-b4e8-40fe-9d48-921ac2477b36 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:29:25.909236 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9f7771d1-b4e8-40fe-9d48-921ac2477b36 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:29:25.910014 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9f7771d1-b4e8-40fe-9d48-921ac2477b36 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:29:25.911044 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9f7771d1-b4e8-40fe-9d48-921ac2477b36 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:29:25.911757 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9f7771d1-b4e8-40fe-9d48-921ac2477b36 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:29:25.912480 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9f7771d1-b4e8-40fe-9d48-921ac2477b36 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:29:26.653496 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-9f7771d1-b4e8-40fe-9d48-921ac2477b36 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:29:26.662087 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-9f7771d1-b4e8-40fe-9d48-921ac2477b36 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:29:26.664025 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-9f7771d1-b4e8-40fe-9d48-921ac2477b36 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:29:26.665435 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-9f7771d1-b4e8-40fe-9d48-921ac2477b36 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] 10.222.0.43 "GET /compute/v2.1/servers/0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc" status: 200 len: 1720 microversion: 2.20 time: 0.772097 Oct 04 22:29:26.666200 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3585/6535] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:29:25 2022] GET /compute/v2.1/servers/0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc => generated 1720 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:29:27.528848 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-b8ac6d3d-dd62-4b69-9a35-87623e3fa621 req-a715bf3b-008e-4866-a978-6d56d8c918a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc", "name": "network-vif-deleted", "tag": "92737fc4-3618-4a96-a0a0-09038568173c"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:29:27.548055 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-b8ac6d3d-dd62-4b69-9a35-87623e3fa621 req-a715bf3b-008e-4866-a978-6d56d8c918a8 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:29:27.555665 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-b8ac6d3d-dd62-4b69-9a35-87623e3fa621 req-a715bf3b-008e-4866-a978-6d56d8c918a8 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:29:27.563707 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-b8ac6d3d-dd62-4b69-9a35-87623e3fa621 req-a715bf3b-008e-4866-a978-6d56d8c918a8 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:29:27.585424 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-b8ac6d3d-dd62-4b69-9a35-87623e3fa621 req-a715bf3b-008e-4866-a978-6d56d8c918a8 service nova] Creating event network-vif-deleted:92737fc4-3618-4a96-a0a0-09038568173c for instance 0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc on n-h2-860284-1 Oct 04 22:29:27.590925 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-b8ac6d3d-dd62-4b69-9a35-87623e3fa621 req-a715bf3b-008e-4866-a978-6d56d8c918a8 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066630 Oct 04 22:29:27.592105 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3586/6536] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:29:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:29:27.691128 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-1951bcfd-3f6c-4268-8fd0-a7b723f01f2a tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:29:27.692181 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-1951bcfd-3f6c-4268-8fd0-a7b723f01f2a tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] [instance: 0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:29:27.700831 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1951bcfd-3f6c-4268-8fd0-a7b723f01f2a tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:29:27.701692 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1951bcfd-3f6c-4268-8fd0-a7b723f01f2a tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:29:27.702354 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1951bcfd-3f6c-4268-8fd0-a7b723f01f2a tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:29:27.704168 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1951bcfd-3f6c-4268-8fd0-a7b723f01f2a tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:29:27.710407 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1951bcfd-3f6c-4268-8fd0-a7b723f01f2a tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:29:27.711220 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1951bcfd-3f6c-4268-8fd0-a7b723f01f2a tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:29:27.716419 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:29:27.774211 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1951bcfd-3f6c-4268-8fd0-a7b723f01f2a tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:29:27.775820 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1951bcfd-3f6c-4268-8fd0-a7b723f01f2a tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:29:27.776931 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1951bcfd-3f6c-4268-8fd0-a7b723f01f2a tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:29:27.777765 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.objects.instance [None req-1951bcfd-3f6c-4268-8fd0-a7b723f01f2a tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lazy-loading 'fault' on Instance uuid 0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc {{(pid=134101) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 22:29:27.857933 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-1951bcfd-3f6c-4268-8fd0-a7b723f01f2a tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:29:27.875675 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-1951bcfd-3f6c-4268-8fd0-a7b723f01f2a tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:29:27.877801 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-1951bcfd-3f6c-4268-8fd0-a7b723f01f2a tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:29:27.879876 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-1951bcfd-3f6c-4268-8fd0-a7b723f01f2a tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] 10.222.0.43 "GET /compute/v2.1/servers/0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc" status: 200 len: 1370 microversion: 2.20 time: 0.193095 Oct 04 22:29:27.894178 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3587/6537] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:29:27 2022] GET /compute/v2.1/servers/0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc => generated 1370 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 22:29:28.909805 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-9b3fb778-c29f-41f7-9247-ca676932267b tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:29:28.913978 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-9b3fb778-c29f-41f7-9247-ca676932267b tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] [instance: 0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:29:28.918013 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=5,nova_api:UPDATE=2,nova_api:DELETE=3 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:29:28.927502 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9b3fb778-c29f-41f7-9247-ca676932267b tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:29:28.927502 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9b3fb778-c29f-41f7-9247-ca676932267b tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:29:28.927973 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9b3fb778-c29f-41f7-9247-ca676932267b tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:29:28.928846 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9b3fb778-c29f-41f7-9247-ca676932267b tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:29:28.929353 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9b3fb778-c29f-41f7-9247-ca676932267b tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:29:28.929857 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9b3fb778-c29f-41f7-9247-ca676932267b tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:29:28.978047 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-9b3fb778-c29f-41f7-9247-ca676932267b tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] HTTP exception thrown: Instance 0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc could not be found. Oct 04 22:29:28.980101 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-9b3fb778-c29f-41f7-9247-ca676932267b tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Request method failure captured: Oct 04 22:29:28.980101 n-d-860284-1 devstack@n-api.service[134101]: request: GET /compute/v2.1/servers/0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc HTTP/1.1 Oct 04 22:29:28.980101 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 22:29:28.980101 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 22:29:28.980101 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 22:29:28.980101 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 22:29:28.980101 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 22:29:28.980101 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 22:29:28.980101 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 22:29:28.980101 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 22:29:28.980101 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPLLS5H9qxnEqloh4s_Fb9sQ6v6LdePhqiIpQDnLeVJr4JmljPmqpyGa-uJ13u3bEOsSAZ1TFW03S-_x_PvbUw2pbG17jm8YFHXtgKD-MkrN05c5AsrMbB2tSIMeCYW80aUJrzlT1cVLz2CGYx3NFkEdXtBWY6BOtUYpSisAtWQWbEiI Oct 04 22:29:28.980101 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 22:29:28.980101 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 22:29:28.980101 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 22:29:28.980101 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 22:29:28.980101 n-d-860284-1 devstack@n-api.service[134101]: X-Openstack-Nova-Api-Version: 2.20 Oct 04 22:29:28.980101 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 22:29:28.980101 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 22:29:28.980101 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: 5031651f5e9a433e859e0038af1cb16d Oct 04 22:29:28.980101 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-863108842 Oct 04 22:29:28.980101 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 22:29:28.980101 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 22:29:28.980101 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5031651f5e9a433e859e0038af1cb16d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_5031651f5e9a433e859e0038af1cb16d", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5031651f5e9a433e859e0038af1cb16d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/5031651f5e9a433e859e0038af1cb16d"}]}] Oct 04 22:29:28.980101 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-AttachVolumeShelveTestJSON-863108842 Oct 04 22:29:28.980101 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: 5031651f5e9a433e859e0038af1cb16d Oct 04 22:29:28.980101 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-863108842 Oct 04 22:29:28.980101 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-AttachVolumeShelveTestJSON-863108842-project Oct 04 22:29:28.980101 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 22:29:28.980101 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 22:29:28.980101 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 97dec2a1a8bc435c9480f89802614cb2 Oct 04 22:29:28.980101 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-AttachVolumeShelveTestJSON-863108842-project Oct 04 22:29:28.980101 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 22:29:28.980101 n-d-860284-1 devstack@n-api.service[134101]: exception: Instance 0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc could not be found. Oct 04 22:29:28.980101 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': '0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc'} Oct 04 22:29:28.980101 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:29:28.980101 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:29:28.980101 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:29:28.980101 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:29:28.980101 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:29:28.980101 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:29:28.980101 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:29:28.980101 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:29:28.980101 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:29:28.980101 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:29:28.980101 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc could not be found. Oct 04 22:29:28.980101 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:29:28.980101 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:29:28.980101 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:29:28.980101 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:29:28.980101 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:29:28.980101 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:29:28.980101 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:29:28.980101 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:29:28.980101 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:29:28.980101 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:29:28.980101 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:29:28.980101 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:29:28.980101 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:29:28.980101 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:29:28.980101 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:29:28.980101 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:29:28.980101 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc could not be found. Oct 04 22:29:28.980101 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:29:28.980101 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:29:28.990109 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:29:28.990109 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:29:28.990109 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:29:28.990109 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:29:28.990109 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:29:28.990109 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:29:28.990109 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc could not be found. Oct 04 22:29:28.990109 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:29:28.990109 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-9b3fb778-c29f-41f7-9247-ca676932267b tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Returning 404 to user: Instance 0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:29:28.990109 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-9b3fb778-c29f-41f7-9247-ca676932267b tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] 10.222.0.43 "GET /compute/v2.1/servers/0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc" status: 404 len: 111 microversion: 2.20 time: 0.077936 Oct 04 22:29:28.990109 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3588/6538] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:29:28 2022] GET /compute/v2.1/servers/0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 22:29:29.004675 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-bbacb724-042c-4fb5-a786-d2874bb73764 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Calling method '.version_select at 0x7fbb2e6c0f70>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:29:29.068596 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-bbacb724-042c-4fb5-a786-d2874bb73764 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-966837515" status: 204 len: 0 microversion: 2.20 time: 0.072034 Oct 04 22:29:29.069756 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3589/6539] 10.222.0.43 () {60 vars in 1259 bytes} [Tue Oct 4 22:29:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-966837515 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 22:29:30.269183 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-6451376d-13ae-45ad-9ef5-89fcf120f7bc tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Action: 'create', calling method: .version_select at 0x7fbb2e35a670>, body: {"keypair": {"name": "tempest-keypair-1583439296", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFjliNFJ182PHJDoTLddXvrvQndQKT2oe9MYoaxTbukNPJQG9i2tPJVBsNp+KfcDWth42jJ9fr2a7mZA+sG/OTmg0GR05VNEIk6kRauu0krX4HQNuRhiTEqglB7bviDuFg=="}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:29:30.302089 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-6451376d-13ae-45ad-9ef5-89fcf120f7bc tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Getting quotas for project 5031651f5e9a433e859e0038af1cb16d. Resources: {'key_pairs'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:29:30.310088 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-6451376d-13ae-45ad-9ef5-89fcf120f7bc tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Getting quotas for user 97dec2a1a8bc435c9480f89802614cb2 and project 5031651f5e9a433e859e0038af1cb16d. Resources: {'key_pairs'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:29:30.355317 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-6451376d-13ae-45ad-9ef5-89fcf120f7bc tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.091723 Oct 04 22:29:30.356470 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3590/6540] 10.222.0.43 () {62 vars in 1200 bytes} [Tue Oct 4 22:29:30 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 94 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 04 22:29:33.112230 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-83957115-53b2-4f3c-ad76-0638cbfde731 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-84142259", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "67ed6136-9d47-4215-af7c-870ef1839c45"}], "security_groups": [{"name": "tempest-securitygroup--762750487"}], "key_name": "tempest-keypair-1583439296", "user_data": "}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:29:33.435999 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.network.neutron [None req-83957115-53b2-4f3c-ad76-0638cbfde731 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] validate_networks() for [('67ed6136-9d47-4215-af7c-870ef1839c45', None, None, None, None, None)] {{(pid=134101) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 22:29:34.346280 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-83957115-53b2-4f3c-ad76-0638cbfde731 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Flavor limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 22:29:34.348597 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-83957115-53b2-4f3c-ad76-0638cbfde731 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Image limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 22:29:34.349310 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-83957115-53b2-4f3c-ad76-0638cbfde731 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Flavor pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 22:29:34.349931 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-83957115-53b2-4f3c-ad76-0638cbfde731 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Image pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 22:29:34.351459 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-83957115-53b2-4f3c-ad76-0638cbfde731 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 22:29:34.373713 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-83957115-53b2-4f3c-ad76-0638cbfde731 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:29:34.374223 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-83957115-53b2-4f3c-ad76-0638cbfde731 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:29:34.375507 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-83957115-53b2-4f3c-ad76-0638cbfde731 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:29:34.376298 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-83957115-53b2-4f3c-ad76-0638cbfde731 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:29:34.376786 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-83957115-53b2-4f3c-ad76-0638cbfde731 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:29:34.377229 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-83957115-53b2-4f3c-ad76-0638cbfde731 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:29:34.440370 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-83957115-53b2-4f3c-ad76-0638cbfde731 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Getting quotas for project 5031651f5e9a433e859e0038af1cb16d. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:29:34.452610 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-83957115-53b2-4f3c-ad76-0638cbfde731 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Getting quotas for user 97dec2a1a8bc435c9480f89802614cb2 and project 5031651f5e9a433e859e0038af1cb16d. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:29:34.494721 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-83957115-53b2-4f3c-ad76-0638cbfde731 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Going to run 1 instances... {{(pid=134101) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 22:29:34.505728 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-83957115-53b2-4f3c-ad76-0638cbfde731 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] [instance: a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='58548514-5dac-426c-81f5-19e3fba33e23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134101) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 22:29:34.635452 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-83957115-53b2-4f3c-ad76-0638cbfde731 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.531345 Oct 04 22:29:34.637364 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3591/6541] 10.222.0.43 () {62 vars in 1188 bytes} [Tue Oct 4 22:29:33 2022] POST /compute/v2.1/servers => generated 401 bytes in 1534 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 04 22:29:34.658180 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-cb93468e-9a5b-48d8-83d7-f0d4a6c003d6 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:29:34.659105 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-cb93468e-9a5b-48d8-83d7-f0d4a6c003d6 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] [instance: a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:29:34.809332 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-cb93468e-9a5b-48d8-83d7-f0d4a6c003d6 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:29:34.825779 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-cb93468e-9a5b-48d8-83d7-f0d4a6c003d6 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:29:34.827326 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-cb93468e-9a5b-48d8-83d7-f0d4a6c003d6 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:29:34.828638 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-cb93468e-9a5b-48d8-83d7-f0d4a6c003d6 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] 10.222.0.43 "GET /compute/v2.1/servers/a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4" status: 200 len: 1280 microversion: 2.20 time: 0.182427 Oct 04 22:29:34.829216 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3592/6542] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:29:34 2022] GET /compute/v2.1/servers/a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4 => generated 1280 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:29:35.871538 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-c9e33a93-df5b-485b-8605-a34a3117443c tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:29:35.872885 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-c9e33a93-df5b-485b-8605-a34a3117443c tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] [instance: a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:29:35.979582 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-c9e33a93-df5b-485b-8605-a34a3117443c tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:29:36.029195 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-c9e33a93-df5b-485b-8605-a34a3117443c tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:29:36.035373 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-c9e33a93-df5b-485b-8605-a34a3117443c tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:29:36.037641 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-c9e33a93-df5b-485b-8605-a34a3117443c tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] 10.222.0.43 "GET /compute/v2.1/servers/a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4" status: 200 len: 1280 microversion: 2.20 time: 0.172100 Oct 04 22:29:36.040316 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3593/6543] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:29:35 2022] GET /compute/v2.1/servers/a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4 => generated 1280 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 22:29:37.072984 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-b0ddd354-f6b5-429a-8b8e-f1709a15ffe7 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:29:37.074098 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-b0ddd354-f6b5-429a-8b8e-f1709a15ffe7 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] [instance: a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:29:37.149381 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-b0ddd354-f6b5-429a-8b8e-f1709a15ffe7 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:29:37.157958 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-b0ddd354-f6b5-429a-8b8e-f1709a15ffe7 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:29:37.159678 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-b0ddd354-f6b5-429a-8b8e-f1709a15ffe7 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:29:37.161250 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-b0ddd354-f6b5-429a-8b8e-f1709a15ffe7 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] 10.222.0.43 "GET /compute/v2.1/servers/a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4" status: 200 len: 1280 microversion: 2.20 time: 0.099474 Oct 04 22:29:37.162498 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3594/6544] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:29:37 2022] GET /compute/v2.1/servers/a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4 => generated 1280 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 22:29:38.190315 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-cfc3026d-a4bf-43c8-8c0c-e4fb9a679eac tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:29:38.191050 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-cfc3026d-a4bf-43c8-8c0c-e4fb9a679eac tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] [instance: a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:29:38.204401 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cfc3026d-a4bf-43c8-8c0c-e4fb9a679eac tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:29:38.205303 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cfc3026d-a4bf-43c8-8c0c-e4fb9a679eac tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:29:38.205842 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cfc3026d-a4bf-43c8-8c0c-e4fb9a679eac tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:29:38.206829 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cfc3026d-a4bf-43c8-8c0c-e4fb9a679eac tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:29:38.207304 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cfc3026d-a4bf-43c8-8c0c-e4fb9a679eac tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:29:38.207769 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cfc3026d-a4bf-43c8-8c0c-e4fb9a679eac tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:29:38.298402 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-cfc3026d-a4bf-43c8-8c0c-e4fb9a679eac tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:29:38.312437 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-cfc3026d-a4bf-43c8-8c0c-e4fb9a679eac tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:29:38.316063 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-cfc3026d-a4bf-43c8-8c0c-e4fb9a679eac tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:29:38.317326 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-cfc3026d-a4bf-43c8-8c0c-e4fb9a679eac tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] 10.222.0.43 "GET /compute/v2.1/servers/a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4" status: 200 len: 1340 microversion: 2.20 time: 0.132001 Oct 04 22:29:38.322132 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3595/6545] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:29:38 2022] GET /compute/v2.1/servers/a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4 => generated 1340 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 22:29:38.777316 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-6b734fb8-e518-4516-8d68-4a5f600bd424 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-375669876", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1068515310", "security_groups": [{"name": "tempest-secgroup-smoke-1414317642"}], "block_device_mapping_v2": [{"uuid": "2d1fec4c-2531-420f-a4a8-8da90ab1a054", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f55a0794-d215-4510-84cc-a7b063c083a4"}]}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:29:38.948958 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.network.neutron [None req-6b734fb8-e518-4516-8d68-4a5f600bd424 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] validate_networks() for [('f55a0794-d215-4510-84cc-a7b063c083a4', None, None, None, None, None)] {{(pid=134101) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 22:29:39.530277 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-6b734fb8-e518-4516-8d68-4a5f600bd424 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Flavor limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 22:29:39.531637 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-6b734fb8-e518-4516-8d68-4a5f600bd424 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Image limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 22:29:39.532143 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-6b734fb8-e518-4516-8d68-4a5f600bd424 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Flavor pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 22:29:39.532588 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-6b734fb8-e518-4516-8d68-4a5f600bd424 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Image pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 22:29:39.533023 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-6b734fb8-e518-4516-8d68-4a5f600bd424 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 22:29:39.543092 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6b734fb8-e518-4516-8d68-4a5f600bd424 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:29:39.543600 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6b734fb8-e518-4516-8d68-4a5f600bd424 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:29:39.544337 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6b734fb8-e518-4516-8d68-4a5f600bd424 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:29:39.545108 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6b734fb8-e518-4516-8d68-4a5f600bd424 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:29:39.545780 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6b734fb8-e518-4516-8d68-4a5f600bd424 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:29:39.546748 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6b734fb8-e518-4516-8d68-4a5f600bd424 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:29:39.576118 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-6b734fb8-e518-4516-8d68-4a5f600bd424 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Getting quotas for project 5c98a72bacce47c3947f9b0f0b4e85b6. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:29:39.583379 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-6b734fb8-e518-4516-8d68-4a5f600bd424 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Getting quotas for user 99acad09db70445b93ae1d64a1b49ca3 and project 5c98a72bacce47c3947f9b0f0b4e85b6. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:29:39.657250 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-6b734fb8-e518-4516-8d68-4a5f600bd424 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Going to run 1 instances... {{(pid=134101) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 22:29:39.659732 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-6b734fb8-e518-4516-8d68-4a5f600bd424 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: 58f32b46-f1a9-4860-a54b-b2f1a012fc18] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2d1fec4c-2531-420f-a4a8-8da90ab1a054',volume_size=None,volume_type=None)] {{(pid=134101) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 22:29:39.855494 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-6b734fb8-e518-4516-8d68-4a5f600bd424 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.082349 Oct 04 22:29:39.856720 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3596/6546] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 22:29:38 2022] POST /compute/v2.1/servers => generated 406 bytes in 1084 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 22:29:39.862920 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-f63d7692-1c00-49ed-b64e-f45bf2ea6523 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:29:39.863978 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-f63d7692-1c00-49ed-b64e-f45bf2ea6523 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] [instance: a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:29:39.870217 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f63d7692-1c00-49ed-b64e-f45bf2ea6523 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:29:39.870874 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f63d7692-1c00-49ed-b64e-f45bf2ea6523 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:29:39.871403 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f63d7692-1c00-49ed-b64e-f45bf2ea6523 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:29:39.872187 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f63d7692-1c00-49ed-b64e-f45bf2ea6523 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:29:39.872910 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f63d7692-1c00-49ed-b64e-f45bf2ea6523 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:29:39.873418 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f63d7692-1c00-49ed-b64e-f45bf2ea6523 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:29:40.154832 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-f63d7692-1c00-49ed-b64e-f45bf2ea6523 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:29:40.165857 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-f63d7692-1c00-49ed-b64e-f45bf2ea6523 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:29:40.167443 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-f63d7692-1c00-49ed-b64e-f45bf2ea6523 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:29:40.168610 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-f63d7692-1c00-49ed-b64e-f45bf2ea6523 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] 10.222.0.43 "GET /compute/v2.1/servers/a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4" status: 200 len: 1405 microversion: 2.20 time: 0.310760 Oct 04 22:29:40.169184 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3597/6547] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:29:39 2022] GET /compute/v2.1/servers/a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4 => generated 1405 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:29:40.174608 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-a31933b8-094f-4513-a47b-12c021384b1b tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:29:40.175565 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-a31933b8-094f-4513-a47b-12c021384b1b tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: 58f32b46-f1a9-4860-a54b-b2f1a012fc18] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:29:40.282842 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-a31933b8-094f-4513-a47b-12c021384b1b tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:29:40.292592 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-a31933b8-094f-4513-a47b-12c021384b1b tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/58f32b46-f1a9-4860-a54b-b2f1a012fc18" status: 200 len: 1094 microversion: 2.1 time: 0.122123 Oct 04 22:29:40.308617 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3598/6548] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:29:40 2022] GET /compute/v2.1/servers/58f32b46-f1a9-4860-a54b-b2f1a012fc18 => generated 1094 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:29:40.568754 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-9bb8e262-babc-4ac3-8560-f9a3e849120e req-74d4d339-6404-45a4-942d-5f2e786d8075 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4", "tag": "c125f571-485f-4f51-9daa-780c14a6c4c9"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:29:40.594600 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-9bb8e262-babc-4ac3-8560-f9a3e849120e req-74d4d339-6404-45a4-942d-5f2e786d8075 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:29:40.610543 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-9bb8e262-babc-4ac3-8560-f9a3e849120e req-74d4d339-6404-45a4-942d-5f2e786d8075 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:29:40.611387 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-9bb8e262-babc-4ac3-8560-f9a3e849120e req-74d4d339-6404-45a4-942d-5f2e786d8075 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:29:40.635073 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-9bb8e262-babc-4ac3-8560-f9a3e849120e req-74d4d339-6404-45a4-942d-5f2e786d8075 service nova] Creating event network-changed:c125f571-485f-4f51-9daa-780c14a6c4c9 for instance a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4 on n-h2-860284-1 Oct 04 22:29:40.645823 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-9bb8e262-babc-4ac3-8560-f9a3e849120e req-74d4d339-6404-45a4-942d-5f2e786d8075 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080619 Oct 04 22:29:40.646485 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3599/6549] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:29:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:29:41.193874 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-4652f290-e11c-4204-9e03-e661c55ddee1 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:29:41.194616 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-4652f290-e11c-4204-9e03-e661c55ddee1 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] [instance: a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:29:41.201869 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4652f290-e11c-4204-9e03-e661c55ddee1 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:29:41.201869 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4652f290-e11c-4204-9e03-e661c55ddee1 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:29:41.202809 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4652f290-e11c-4204-9e03-e661c55ddee1 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:29:41.203626 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4652f290-e11c-4204-9e03-e661c55ddee1 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:29:41.204292 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4652f290-e11c-4204-9e03-e661c55ddee1 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:29:41.205194 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4652f290-e11c-4204-9e03-e661c55ddee1 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:29:41.357641 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-4652f290-e11c-4204-9e03-e661c55ddee1 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:29:41.375103 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-4652f290-e11c-4204-9e03-e661c55ddee1 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:29:41.376609 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-4652f290-e11c-4204-9e03-e661c55ddee1 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:29:41.378354 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-4652f290-e11c-4204-9e03-e661c55ddee1 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] 10.222.0.43 "GET /compute/v2.1/servers/a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4" status: 200 len: 1405 microversion: 2.20 time: 0.188662 Oct 04 22:29:41.394738 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3600/6550] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:29:41 2022] GET /compute/v2.1/servers/a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4 => generated 1405 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 22:29:41.406941 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-d28de350-4811-4e2f-8b09-67ce435c485e tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:29:41.408076 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-d28de350-4811-4e2f-8b09-67ce435c485e tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: 58f32b46-f1a9-4860-a54b-b2f1a012fc18] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:29:41.415919 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d28de350-4811-4e2f-8b09-67ce435c485e tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:29:41.417430 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d28de350-4811-4e2f-8b09-67ce435c485e tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:29:41.418149 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d28de350-4811-4e2f-8b09-67ce435c485e tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:29:41.419274 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d28de350-4811-4e2f-8b09-67ce435c485e tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:29:41.419917 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d28de350-4811-4e2f-8b09-67ce435c485e tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:29:41.420353 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d28de350-4811-4e2f-8b09-67ce435c485e tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:29:41.514536 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-d28de350-4811-4e2f-8b09-67ce435c485e tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:29:41.534814 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-d28de350-4811-4e2f-8b09-67ce435c485e tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/58f32b46-f1a9-4860-a54b-b2f1a012fc18" status: 200 len: 1200 microversion: 2.1 time: 0.137172 Oct 04 22:29:41.535612 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3601/6551] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:29:41 2022] GET /compute/v2.1/servers/58f32b46-f1a9-4860-a54b-b2f1a012fc18 => generated 1200 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:29:42.413048 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-c570dd28-452d-4c8b-8308-97293d7975b0 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:29:42.414355 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-c570dd28-452d-4c8b-8308-97293d7975b0 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] [instance: a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:29:42.428539 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c570dd28-452d-4c8b-8308-97293d7975b0 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:29:42.434290 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c570dd28-452d-4c8b-8308-97293d7975b0 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:29:42.434785 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c570dd28-452d-4c8b-8308-97293d7975b0 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:29:42.435572 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c570dd28-452d-4c8b-8308-97293d7975b0 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:29:42.436045 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c570dd28-452d-4c8b-8308-97293d7975b0 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:29:42.437106 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c570dd28-452d-4c8b-8308-97293d7975b0 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:29:42.689549 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-c570dd28-452d-4c8b-8308-97293d7975b0 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:29:42.710098 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-c570dd28-452d-4c8b-8308-97293d7975b0 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:29:42.712793 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-c570dd28-452d-4c8b-8308-97293d7975b0 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:29:42.715687 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-c570dd28-452d-4c8b-8308-97293d7975b0 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] 10.222.0.43 "GET /compute/v2.1/servers/a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4" status: 200 len: 1405 microversion: 2.20 time: 0.311508 Oct 04 22:29:42.723913 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3602/6552] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:29:42 2022] GET /compute/v2.1/servers/a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4 => generated 1405 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:29:42.735712 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-76cab84b-e3e6-4193-82f1-98416140d369 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:29:42.738003 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-76cab84b-e3e6-4193-82f1-98416140d369 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: 58f32b46-f1a9-4860-a54b-b2f1a012fc18] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:29:42.755086 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-76cab84b-e3e6-4193-82f1-98416140d369 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:29:42.755897 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-76cab84b-e3e6-4193-82f1-98416140d369 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:29:42.757604 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-76cab84b-e3e6-4193-82f1-98416140d369 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:29:42.760942 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-76cab84b-e3e6-4193-82f1-98416140d369 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:29:42.761728 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-76cab84b-e3e6-4193-82f1-98416140d369 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:29:42.762455 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-76cab84b-e3e6-4193-82f1-98416140d369 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:29:43.040774 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-76cab84b-e3e6-4193-82f1-98416140d369 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:29:43.056822 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-76cab84b-e3e6-4193-82f1-98416140d369 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/58f32b46-f1a9-4860-a54b-b2f1a012fc18" status: 200 len: 1278 microversion: 2.1 time: 0.331187 Oct 04 22:29:43.058194 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3603/6553] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:29:42 2022] GET /compute/v2.1/servers/58f32b46-f1a9-4860-a54b-b2f1a012fc18 => generated 1278 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:29:43.492333 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-2b4f01ce-93e0-43a3-90af-c7d5ce45cc3d req-2cb54467-2d98-4451-89e8-1009a7e473b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58f32b46-f1a9-4860-a54b-b2f1a012fc18", "tag": "20b3571c-10c9-40e0-a655-fbd88de173dd"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:29:43.507754 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-2b4f01ce-93e0-43a3-90af-c7d5ce45cc3d req-2cb54467-2d98-4451-89e8-1009a7e473b8 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:29:43.508530 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-2b4f01ce-93e0-43a3-90af-c7d5ce45cc3d req-2cb54467-2d98-4451-89e8-1009a7e473b8 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:29:43.509185 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-2b4f01ce-93e0-43a3-90af-c7d5ce45cc3d req-2cb54467-2d98-4451-89e8-1009a7e473b8 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:29:43.544280 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-2b4f01ce-93e0-43a3-90af-c7d5ce45cc3d req-2cb54467-2d98-4451-89e8-1009a7e473b8 service nova] Creating event network-changed:20b3571c-10c9-40e0-a655-fbd88de173dd for instance 58f32b46-f1a9-4860-a54b-b2f1a012fc18 on n-h1-860284-1 Oct 04 22:29:43.551056 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-2b4f01ce-93e0-43a3-90af-c7d5ce45cc3d req-2cb54467-2d98-4451-89e8-1009a7e473b8 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063556 Oct 04 22:29:43.552035 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3604/6554] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:29:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:29:43.751990 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-b80a836d-124a-40ce-8794-0e16fc6282ab tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:29:43.753229 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-b80a836d-124a-40ce-8794-0e16fc6282ab tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] [instance: a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:29:43.769039 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b80a836d-124a-40ce-8794-0e16fc6282ab tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:29:43.776613 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b80a836d-124a-40ce-8794-0e16fc6282ab tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:29:43.777284 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b80a836d-124a-40ce-8794-0e16fc6282ab tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:29:43.778164 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b80a836d-124a-40ce-8794-0e16fc6282ab tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:29:43.778890 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b80a836d-124a-40ce-8794-0e16fc6282ab tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:29:43.779408 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b80a836d-124a-40ce-8794-0e16fc6282ab tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:29:44.034026 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-b80a836d-124a-40ce-8794-0e16fc6282ab tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:29:44.049754 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-b80a836d-124a-40ce-8794-0e16fc6282ab tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:29:44.053059 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-b80a836d-124a-40ce-8794-0e16fc6282ab tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:29:44.056251 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-b80a836d-124a-40ce-8794-0e16fc6282ab tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] 10.222.0.43 "GET /compute/v2.1/servers/a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4" status: 200 len: 1405 microversion: 2.20 time: 0.308737 Oct 04 22:29:44.057347 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3605/6555] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:29:43 2022] GET /compute/v2.1/servers/a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4 => generated 1405 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 22:29:44.089911 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-9621f10b-aee2-4ff1-9f64-1af03277a13a tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:29:44.091131 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-9621f10b-aee2-4ff1-9f64-1af03277a13a tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: 58f32b46-f1a9-4860-a54b-b2f1a012fc18] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:29:44.102657 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9621f10b-aee2-4ff1-9f64-1af03277a13a tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:29:44.103443 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9621f10b-aee2-4ff1-9f64-1af03277a13a tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:29:44.103980 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9621f10b-aee2-4ff1-9f64-1af03277a13a tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:29:44.104731 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9621f10b-aee2-4ff1-9f64-1af03277a13a tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:29:44.105372 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9621f10b-aee2-4ff1-9f64-1af03277a13a tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:29:44.105773 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9621f10b-aee2-4ff1-9f64-1af03277a13a tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:29:44.334205 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-9621f10b-aee2-4ff1-9f64-1af03277a13a tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:29:44.347709 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-9621f10b-aee2-4ff1-9f64-1af03277a13a tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/58f32b46-f1a9-4860-a54b-b2f1a012fc18" status: 200 len: 1278 microversion: 2.1 time: 0.263074 Oct 04 22:29:44.349733 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3606/6556] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:29:44 2022] GET /compute/v2.1/servers/58f32b46-f1a9-4860-a54b-b2f1a012fc18 => generated 1278 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:29:45.082213 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-9c740767-da88-4a07-902f-11f15b45fd85 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:29:45.083227 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-9c740767-da88-4a07-902f-11f15b45fd85 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] [instance: a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:29:45.091563 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9c740767-da88-4a07-902f-11f15b45fd85 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:29:45.092069 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9c740767-da88-4a07-902f-11f15b45fd85 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:29:45.092670 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9c740767-da88-4a07-902f-11f15b45fd85 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:29:45.093910 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9c740767-da88-4a07-902f-11f15b45fd85 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:29:45.094801 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9c740767-da88-4a07-902f-11f15b45fd85 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:29:45.095727 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9c740767-da88-4a07-902f-11f15b45fd85 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:29:45.259758 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-9c740767-da88-4a07-902f-11f15b45fd85 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:29:45.274218 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-9c740767-da88-4a07-902f-11f15b45fd85 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:29:45.276157 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-9c740767-da88-4a07-902f-11f15b45fd85 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:29:45.277568 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-9c740767-da88-4a07-902f-11f15b45fd85 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] 10.222.0.43 "GET /compute/v2.1/servers/a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4" status: 200 len: 1405 microversion: 2.20 time: 0.199528 Oct 04 22:29:45.278539 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3607/6557] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:29:45 2022] GET /compute/v2.1/servers/a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4 => generated 1405 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 22:29:45.375535 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-7e50b466-6445-492e-92e5-ed085e344eb2 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:29:45.376296 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-7e50b466-6445-492e-92e5-ed085e344eb2 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: 58f32b46-f1a9-4860-a54b-b2f1a012fc18] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:29:45.384495 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7e50b466-6445-492e-92e5-ed085e344eb2 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:29:45.385123 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7e50b466-6445-492e-92e5-ed085e344eb2 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:29:45.385690 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7e50b466-6445-492e-92e5-ed085e344eb2 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:29:45.386511 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7e50b466-6445-492e-92e5-ed085e344eb2 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:29:45.387053 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7e50b466-6445-492e-92e5-ed085e344eb2 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:29:45.388384 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7e50b466-6445-492e-92e5-ed085e344eb2 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:29:45.551598 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-7e50b466-6445-492e-92e5-ed085e344eb2 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:29:45.560334 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-7e50b466-6445-492e-92e5-ed085e344eb2 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/58f32b46-f1a9-4860-a54b-b2f1a012fc18" status: 200 len: 1278 microversion: 2.1 time: 0.190435 Oct 04 22:29:45.560927 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3608/6558] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:29:45 2022] GET /compute/v2.1/servers/58f32b46-f1a9-4860-a54b-b2f1a012fc18 => generated 1278 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:29:46.307846 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-9dcea9f3-6680-45e3-a0e7-aa0b86a5e44c tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:29:46.309933 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-9dcea9f3-6680-45e3-a0e7-aa0b86a5e44c tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] [instance: a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:29:46.320396 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9dcea9f3-6680-45e3-a0e7-aa0b86a5e44c tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:29:46.321316 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9dcea9f3-6680-45e3-a0e7-aa0b86a5e44c tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:29:46.322548 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9dcea9f3-6680-45e3-a0e7-aa0b86a5e44c tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:29:46.323941 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9dcea9f3-6680-45e3-a0e7-aa0b86a5e44c tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:29:46.324991 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9dcea9f3-6680-45e3-a0e7-aa0b86a5e44c tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:29:46.330937 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9dcea9f3-6680-45e3-a0e7-aa0b86a5e44c tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:29:46.496001 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-9dcea9f3-6680-45e3-a0e7-aa0b86a5e44c tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:29:46.516917 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-9dcea9f3-6680-45e3-a0e7-aa0b86a5e44c tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:29:46.519291 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-9dcea9f3-6680-45e3-a0e7-aa0b86a5e44c tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:29:46.521015 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-9dcea9f3-6680-45e3-a0e7-aa0b86a5e44c tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] 10.222.0.43 "GET /compute/v2.1/servers/a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4" status: 200 len: 1405 microversion: 2.20 time: 0.219694 Oct 04 22:29:46.522299 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3609/6559] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:29:46 2022] GET /compute/v2.1/servers/a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4 => generated 1405 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:29:46.585161 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-0ed98ca4-9a9e-414f-9b68-d9cb96f1fa1b tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:29:46.586276 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-0ed98ca4-9a9e-414f-9b68-d9cb96f1fa1b tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: 58f32b46-f1a9-4860-a54b-b2f1a012fc18] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:29:46.599026 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0ed98ca4-9a9e-414f-9b68-d9cb96f1fa1b tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:29:46.599679 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0ed98ca4-9a9e-414f-9b68-d9cb96f1fa1b tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:29:46.600291 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0ed98ca4-9a9e-414f-9b68-d9cb96f1fa1b tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:29:46.601430 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0ed98ca4-9a9e-414f-9b68-d9cb96f1fa1b tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:29:46.601932 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0ed98ca4-9a9e-414f-9b68-d9cb96f1fa1b tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:29:46.602481 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0ed98ca4-9a9e-414f-9b68-d9cb96f1fa1b tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:29:46.780746 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-0ed98ca4-9a9e-414f-9b68-d9cb96f1fa1b tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:29:46.788765 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-0ed98ca4-9a9e-414f-9b68-d9cb96f1fa1b tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/58f32b46-f1a9-4860-a54b-b2f1a012fc18" status: 200 len: 1278 microversion: 2.1 time: 0.208178 Oct 04 22:29:46.794408 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3610/6560] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:29:46 2022] GET /compute/v2.1/servers/58f32b46-f1a9-4860-a54b-b2f1a012fc18 => generated 1278 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:29:47.548806 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-10c1ff5e-505a-4c34-b079-55db0a320ba7 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:29:47.550154 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-10c1ff5e-505a-4c34-b079-55db0a320ba7 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] [instance: a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:29:47.557985 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-10c1ff5e-505a-4c34-b079-55db0a320ba7 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:29:47.558544 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-10c1ff5e-505a-4c34-b079-55db0a320ba7 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:29:47.559225 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-10c1ff5e-505a-4c34-b079-55db0a320ba7 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:29:47.559980 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-10c1ff5e-505a-4c34-b079-55db0a320ba7 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:29:47.560507 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-10c1ff5e-505a-4c34-b079-55db0a320ba7 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:29:47.561150 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-10c1ff5e-505a-4c34-b079-55db0a320ba7 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:29:47.709772 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-10c1ff5e-505a-4c34-b079-55db0a320ba7 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:29:47.719116 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-10c1ff5e-505a-4c34-b079-55db0a320ba7 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:29:47.720764 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-10c1ff5e-505a-4c34-b079-55db0a320ba7 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:29:47.722002 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-10c1ff5e-505a-4c34-b079-55db0a320ba7 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] 10.222.0.43 "GET /compute/v2.1/servers/a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4" status: 200 len: 1405 microversion: 2.20 time: 0.177670 Oct 04 22:29:47.722621 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3611/6561] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:29:47 2022] GET /compute/v2.1/servers/a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4 => generated 1405 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 22:29:47.812916 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e7c7ca23-e79a-44e6-b269-cf534bf686a6 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:29:47.813571 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-e7c7ca23-e79a-44e6-b269-cf534bf686a6 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: 58f32b46-f1a9-4860-a54b-b2f1a012fc18] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:29:47.815580 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=1,nova_api:INSERT=7 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:29:47.820987 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e7c7ca23-e79a-44e6-b269-cf534bf686a6 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:29:47.821486 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e7c7ca23-e79a-44e6-b269-cf534bf686a6 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:29:47.821936 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e7c7ca23-e79a-44e6-b269-cf534bf686a6 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:29:47.822670 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e7c7ca23-e79a-44e6-b269-cf534bf686a6 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:29:47.823135 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e7c7ca23-e79a-44e6-b269-cf534bf686a6 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:29:47.823605 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e7c7ca23-e79a-44e6-b269-cf534bf686a6 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:29:47.976528 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-e7c7ca23-e79a-44e6-b269-cf534bf686a6 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:29:47.980303 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=100 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:29:47.986982 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-e7c7ca23-e79a-44e6-b269-cf534bf686a6 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/58f32b46-f1a9-4860-a54b-b2f1a012fc18" status: 200 len: 1266 microversion: 2.1 time: 0.178895 Oct 04 22:29:47.987573 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3612/6562] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:29:47 2022] GET /compute/v2.1/servers/58f32b46-f1a9-4860-a54b-b2f1a012fc18 => generated 1266 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:29:48.454470 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-18455477-9c06-4e13-ab43-5f95ca14b772 req-19f40ae3-8177-403f-8d4d-3f16b3b94a49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4", "name": "network-vif-plugged", "status": "completed", "tag": "c125f571-485f-4f51-9daa-780c14a6c4c9"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:29:48.465530 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-18455477-9c06-4e13-ab43-5f95ca14b772 req-19f40ae3-8177-403f-8d4d-3f16b3b94a49 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:29:48.466059 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-18455477-9c06-4e13-ab43-5f95ca14b772 req-19f40ae3-8177-403f-8d4d-3f16b3b94a49 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:29:48.471329 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-18455477-9c06-4e13-ab43-5f95ca14b772 req-19f40ae3-8177-403f-8d4d-3f16b3b94a49 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:29:48.489136 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-18455477-9c06-4e13-ab43-5f95ca14b772 req-19f40ae3-8177-403f-8d4d-3f16b3b94a49 service nova] Creating event network-vif-plugged:c125f571-485f-4f51-9daa-780c14a6c4c9 for instance a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4 on n-h2-860284-1 Oct 04 22:29:48.494933 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-18455477-9c06-4e13-ab43-5f95ca14b772 req-19f40ae3-8177-403f-8d4d-3f16b3b94a49 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046532 Oct 04 22:29:48.495854 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3613/6563] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:29:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:29:48.767365 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-b703518f-a30a-463e-8655-8b53c7c6e366 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:29:48.768092 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-b703518f-a30a-463e-8655-8b53c7c6e366 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] [instance: a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:29:48.774745 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b703518f-a30a-463e-8655-8b53c7c6e366 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:29:48.775257 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b703518f-a30a-463e-8655-8b53c7c6e366 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:29:48.775721 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b703518f-a30a-463e-8655-8b53c7c6e366 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:29:48.776437 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b703518f-a30a-463e-8655-8b53c7c6e366 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:29:48.776912 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b703518f-a30a-463e-8655-8b53c7c6e366 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:29:48.777363 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b703518f-a30a-463e-8655-8b53c7c6e366 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:29:48.971433 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-b703518f-a30a-463e-8655-8b53c7c6e366 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:29:48.982938 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-b703518f-a30a-463e-8655-8b53c7c6e366 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:29:48.986488 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-b703518f-a30a-463e-8655-8b53c7c6e366 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:29:48.987785 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-b703518f-a30a-463e-8655-8b53c7c6e366 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] 10.222.0.43 "GET /compute/v2.1/servers/a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4" status: 200 len: 1405 microversion: 2.20 time: 0.226427 Oct 04 22:29:48.988372 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3614/6564] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:29:48 2022] GET /compute/v2.1/servers/a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4 => generated 1405 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 22:29:49.012858 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-87b52c3d-4875-430f-9b9d-85c2e339b8d9 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:29:49.013801 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-87b52c3d-4875-430f-9b9d-85c2e339b8d9 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: 58f32b46-f1a9-4860-a54b-b2f1a012fc18] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:29:49.020932 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-87b52c3d-4875-430f-9b9d-85c2e339b8d9 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:29:49.021445 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-87b52c3d-4875-430f-9b9d-85c2e339b8d9 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:29:49.021904 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-87b52c3d-4875-430f-9b9d-85c2e339b8d9 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:29:49.022644 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-87b52c3d-4875-430f-9b9d-85c2e339b8d9 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:29:49.023118 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-87b52c3d-4875-430f-9b9d-85c2e339b8d9 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:29:49.023563 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-87b52c3d-4875-430f-9b9d-85c2e339b8d9 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:29:49.162473 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-87b52c3d-4875-430f-9b9d-85c2e339b8d9 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:29:49.170503 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-87b52c3d-4875-430f-9b9d-85c2e339b8d9 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/58f32b46-f1a9-4860-a54b-b2f1a012fc18" status: 200 len: 1266 microversion: 2.1 time: 0.162799 Oct 04 22:29:49.171896 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3615/6565] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:29:49 2022] GET /compute/v2.1/servers/58f32b46-f1a9-4860-a54b-b2f1a012fc18 => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:29:50.013017 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-b5cbacfe-5df0-41a2-8043-ef2c257da254 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:29:50.015110 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-b5cbacfe-5df0-41a2-8043-ef2c257da254 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] [instance: a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:29:50.022550 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=4 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:29:50.025350 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b5cbacfe-5df0-41a2-8043-ef2c257da254 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:29:50.025860 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b5cbacfe-5df0-41a2-8043-ef2c257da254 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:29:50.026316 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b5cbacfe-5df0-41a2-8043-ef2c257da254 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:29:50.027066 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b5cbacfe-5df0-41a2-8043-ef2c257da254 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:29:50.027758 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b5cbacfe-5df0-41a2-8043-ef2c257da254 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:29:50.028382 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b5cbacfe-5df0-41a2-8043-ef2c257da254 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:29:50.184112 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-b5cbacfe-5df0-41a2-8043-ef2c257da254 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:29:50.195261 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-b5cbacfe-5df0-41a2-8043-ef2c257da254 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:29:50.196875 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-b5cbacfe-5df0-41a2-8043-ef2c257da254 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:29:50.198188 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-b5cbacfe-5df0-41a2-8043-ef2c257da254 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] 10.222.0.43 "GET /compute/v2.1/servers/a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4" status: 200 len: 1405 microversion: 2.20 time: 0.189236 Oct 04 22:29:50.198854 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3616/6566] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:29:50 2022] GET /compute/v2.1/servers/a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4 => generated 1405 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 22:29:50.203817 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-1d146eff-2509-4156-aa42-15f0bb99a96f tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:29:50.204676 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-1d146eff-2509-4156-aa42-15f0bb99a96f tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: 58f32b46-f1a9-4860-a54b-b2f1a012fc18] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:29:50.211221 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1d146eff-2509-4156-aa42-15f0bb99a96f tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:29:50.212959 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1d146eff-2509-4156-aa42-15f0bb99a96f tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:29:50.212959 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1d146eff-2509-4156-aa42-15f0bb99a96f tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:29:50.212959 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1d146eff-2509-4156-aa42-15f0bb99a96f tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:29:50.213605 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1d146eff-2509-4156-aa42-15f0bb99a96f tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:29:50.213887 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1d146eff-2509-4156-aa42-15f0bb99a96f tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:29:50.288568 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=24 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:29:50.393008 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-1d146eff-2509-4156-aa42-15f0bb99a96f tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:29:50.401374 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-1d146eff-2509-4156-aa42-15f0bb99a96f tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/58f32b46-f1a9-4860-a54b-b2f1a012fc18" status: 200 len: 1266 microversion: 2.1 time: 0.201516 Oct 04 22:29:50.401952 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3617/6567] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:29:50 2022] GET /compute/v2.1/servers/58f32b46-f1a9-4860-a54b-b2f1a012fc18 => generated 1266 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:29:51.239944 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-3e27491c-b0e5-46d5-a099-a21b6fa063df tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:29:51.240601 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-3e27491c-b0e5-46d5-a099-a21b6fa063df tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] [instance: a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:29:51.247422 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3e27491c-b0e5-46d5-a099-a21b6fa063df tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:29:51.247917 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3e27491c-b0e5-46d5-a099-a21b6fa063df tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:29:51.248367 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3e27491c-b0e5-46d5-a099-a21b6fa063df tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:29:51.249722 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3e27491c-b0e5-46d5-a099-a21b6fa063df tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:29:51.250186 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3e27491c-b0e5-46d5-a099-a21b6fa063df tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:29:51.250702 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3e27491c-b0e5-46d5-a099-a21b6fa063df tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:29:51.394210 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-3e27491c-b0e5-46d5-a099-a21b6fa063df tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:29:51.403054 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-3e27491c-b0e5-46d5-a099-a21b6fa063df tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:29:51.404669 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-3e27491c-b0e5-46d5-a099-a21b6fa063df tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:29:51.406479 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-3e27491c-b0e5-46d5-a099-a21b6fa063df tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] 10.222.0.43 "GET /compute/v2.1/servers/a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4" status: 200 len: 1597 microversion: 2.20 time: 0.170565 Oct 04 22:29:51.407211 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3618/6568] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:29:51 2022] GET /compute/v2.1/servers/a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4 => generated 1597 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 22:29:51.423699 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-39b8a18e-dd6f-4f8d-b015-c0fb873adbfd tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:29:51.424455 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-39b8a18e-dd6f-4f8d-b015-c0fb873adbfd tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: 58f32b46-f1a9-4860-a54b-b2f1a012fc18] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:29:51.430825 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-39b8a18e-dd6f-4f8d-b015-c0fb873adbfd tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:29:51.431370 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-39b8a18e-dd6f-4f8d-b015-c0fb873adbfd tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:29:51.431838 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-39b8a18e-dd6f-4f8d-b015-c0fb873adbfd tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:29:51.432565 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-39b8a18e-dd6f-4f8d-b015-c0fb873adbfd tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:29:51.433033 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-39b8a18e-dd6f-4f8d-b015-c0fb873adbfd tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:29:51.433469 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-39b8a18e-dd6f-4f8d-b015-c0fb873adbfd tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:29:51.577866 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-39b8a18e-dd6f-4f8d-b015-c0fb873adbfd tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:29:51.585920 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-39b8a18e-dd6f-4f8d-b015-c0fb873adbfd tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/58f32b46-f1a9-4860-a54b-b2f1a012fc18" status: 200 len: 1266 microversion: 2.1 time: 0.166436 Oct 04 22:29:51.586646 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3619/6569] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:29:51 2022] GET /compute/v2.1/servers/58f32b46-f1a9-4860-a54b-b2f1a012fc18 => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:29:51.591483 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-84460a93-db11-4dcf-b182-419e415d5071 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:29:51.591998 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-84460a93-db11-4dcf-b182-419e415d5071 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] [instance: a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:29:51.598945 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-84460a93-db11-4dcf-b182-419e415d5071 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:29:51.599568 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-84460a93-db11-4dcf-b182-419e415d5071 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:29:51.600134 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-84460a93-db11-4dcf-b182-419e415d5071 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:29:51.600958 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-84460a93-db11-4dcf-b182-419e415d5071 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:29:51.601538 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-84460a93-db11-4dcf-b182-419e415d5071 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:29:51.602024 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-84460a93-db11-4dcf-b182-419e415d5071 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:29:51.681207 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-84460a93-db11-4dcf-b182-419e415d5071 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] 10.222.0.43 "GET /compute/v2.1/servers/a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.093416 Oct 04 22:29:51.681855 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3620/6570] 10.222.0.43 () {60 vars in 1316 bytes} [Tue Oct 4 22:29:51 2022] GET /compute/v2.1/servers/a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 22:29:52.610942 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-b2f6ec63-a7ac-4a59-806c-bbbe3626dd1e tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:29:52.611727 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-b2f6ec63-a7ac-4a59-806c-bbbe3626dd1e tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: 58f32b46-f1a9-4860-a54b-b2f1a012fc18] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:29:52.618449 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b2f6ec63-a7ac-4a59-806c-bbbe3626dd1e tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:29:52.618962 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b2f6ec63-a7ac-4a59-806c-bbbe3626dd1e tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:29:52.619416 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b2f6ec63-a7ac-4a59-806c-bbbe3626dd1e tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:29:52.620143 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b2f6ec63-a7ac-4a59-806c-bbbe3626dd1e tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:29:52.620639 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b2f6ec63-a7ac-4a59-806c-bbbe3626dd1e tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:29:52.621275 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b2f6ec63-a7ac-4a59-806c-bbbe3626dd1e tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:29:52.910158 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-b2f6ec63-a7ac-4a59-806c-bbbe3626dd1e tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:29:52.918326 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-b2f6ec63-a7ac-4a59-806c-bbbe3626dd1e tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/58f32b46-f1a9-4860-a54b-b2f1a012fc18" status: 200 len: 1266 microversion: 2.1 time: 0.312966 Oct 04 22:29:52.919084 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3621/6571] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:29:52 2022] GET /compute/v2.1/servers/58f32b46-f1a9-4860-a54b-b2f1a012fc18 => generated 1266 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:29:53.090254 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-7116a1d6-de88-4482-9f1c-0af17aa7ef4c req-71eac7e9-0cbe-4734-a7a5-d99217da56f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4", "tag": "c125f571-485f-4f51-9daa-780c14a6c4c9"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:29:53.101082 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-7116a1d6-de88-4482-9f1c-0af17aa7ef4c req-71eac7e9-0cbe-4734-a7a5-d99217da56f9 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:29:53.101717 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-7116a1d6-de88-4482-9f1c-0af17aa7ef4c req-71eac7e9-0cbe-4734-a7a5-d99217da56f9 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:29:53.102412 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-7116a1d6-de88-4482-9f1c-0af17aa7ef4c req-71eac7e9-0cbe-4734-a7a5-d99217da56f9 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:29:53.115820 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-7116a1d6-de88-4482-9f1c-0af17aa7ef4c req-71eac7e9-0cbe-4734-a7a5-d99217da56f9 service nova] Creating event network-changed:c125f571-485f-4f51-9daa-780c14a6c4c9 for instance a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4 on n-h2-860284-1 Oct 04 22:29:53.121932 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-7116a1d6-de88-4482-9f1c-0af17aa7ef4c req-71eac7e9-0cbe-4734-a7a5-d99217da56f9 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035385 Oct 04 22:29:53.122962 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3622/6572] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:29:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:29:53.943513 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-067b2c3e-eddb-42a0-846b-a99e7867e231 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:29:53.945015 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-067b2c3e-eddb-42a0-846b-a99e7867e231 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: 58f32b46-f1a9-4860-a54b-b2f1a012fc18] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:29:53.961812 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-067b2c3e-eddb-42a0-846b-a99e7867e231 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:29:53.962332 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-067b2c3e-eddb-42a0-846b-a99e7867e231 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:29:53.962844 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-067b2c3e-eddb-42a0-846b-a99e7867e231 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:29:53.963571 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-067b2c3e-eddb-42a0-846b-a99e7867e231 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:29:53.964047 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-067b2c3e-eddb-42a0-846b-a99e7867e231 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:29:53.964491 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-067b2c3e-eddb-42a0-846b-a99e7867e231 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:29:54.139765 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-067b2c3e-eddb-42a0-846b-a99e7867e231 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:29:54.148429 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-067b2c3e-eddb-42a0-846b-a99e7867e231 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/58f32b46-f1a9-4860-a54b-b2f1a012fc18" status: 200 len: 1266 microversion: 2.1 time: 0.210300 Oct 04 22:29:54.150873 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3623/6573] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:29:53 2022] GET /compute/v2.1/servers/58f32b46-f1a9-4860-a54b-b2f1a012fc18 => generated 1266 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:29:55.172092 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-690704c3-36d2-4e67-b7b7-c7f55ee1d623 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:29:55.172743 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-690704c3-36d2-4e67-b7b7-c7f55ee1d623 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: 58f32b46-f1a9-4860-a54b-b2f1a012fc18] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:29:55.179648 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-690704c3-36d2-4e67-b7b7-c7f55ee1d623 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:29:55.180140 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-690704c3-36d2-4e67-b7b7-c7f55ee1d623 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:29:55.180612 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-690704c3-36d2-4e67-b7b7-c7f55ee1d623 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:29:55.181321 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-690704c3-36d2-4e67-b7b7-c7f55ee1d623 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:29:55.181783 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-690704c3-36d2-4e67-b7b7-c7f55ee1d623 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:29:55.182220 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-690704c3-36d2-4e67-b7b7-c7f55ee1d623 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:29:55.317175 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-690704c3-36d2-4e67-b7b7-c7f55ee1d623 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:29:55.325215 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-690704c3-36d2-4e67-b7b7-c7f55ee1d623 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/58f32b46-f1a9-4860-a54b-b2f1a012fc18" status: 200 len: 1266 microversion: 2.1 time: 0.157496 Oct 04 22:29:55.325797 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3624/6574] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:29:55 2022] GET /compute/v2.1/servers/58f32b46-f1a9-4860-a54b-b2f1a012fc18 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:29:56.348723 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-82e3780b-9c04-4b57-9be4-f52c27244ac0 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:29:56.349377 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-82e3780b-9c04-4b57-9be4-f52c27244ac0 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: 58f32b46-f1a9-4860-a54b-b2f1a012fc18] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:29:56.356179 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-82e3780b-9c04-4b57-9be4-f52c27244ac0 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:29:56.356676 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-82e3780b-9c04-4b57-9be4-f52c27244ac0 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:29:56.357128 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-82e3780b-9c04-4b57-9be4-f52c27244ac0 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:29:56.358588 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-82e3780b-9c04-4b57-9be4-f52c27244ac0 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:29:56.359074 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-82e3780b-9c04-4b57-9be4-f52c27244ac0 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:29:56.359501 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-82e3780b-9c04-4b57-9be4-f52c27244ac0 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:29:56.492865 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-82e3780b-9c04-4b57-9be4-f52c27244ac0 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:29:56.501366 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-82e3780b-9c04-4b57-9be4-f52c27244ac0 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/58f32b46-f1a9-4860-a54b-b2f1a012fc18" status: 200 len: 1266 microversion: 2.1 time: 0.156564 Oct 04 22:29:56.501966 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3625/6575] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:29:56 2022] GET /compute/v2.1/servers/58f32b46-f1a9-4860-a54b-b2f1a012fc18 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:29:57.525147 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e69e0929-4c99-4127-a2f2-cc336cae3ef0 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:29:57.525972 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-e69e0929-4c99-4127-a2f2-cc336cae3ef0 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: 58f32b46-f1a9-4860-a54b-b2f1a012fc18] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:29:57.533095 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e69e0929-4c99-4127-a2f2-cc336cae3ef0 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:29:57.533595 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e69e0929-4c99-4127-a2f2-cc336cae3ef0 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:29:57.534045 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e69e0929-4c99-4127-a2f2-cc336cae3ef0 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:29:57.534780 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e69e0929-4c99-4127-a2f2-cc336cae3ef0 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:29:57.535249 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e69e0929-4c99-4127-a2f2-cc336cae3ef0 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:29:57.535690 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e69e0929-4c99-4127-a2f2-cc336cae3ef0 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:29:57.676986 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-e69e0929-4c99-4127-a2f2-cc336cae3ef0 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:29:57.685417 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-e69e0929-4c99-4127-a2f2-cc336cae3ef0 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/58f32b46-f1a9-4860-a54b-b2f1a012fc18" status: 200 len: 1266 microversion: 2.1 time: 0.164235 Oct 04 22:29:57.686635 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3626/6576] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:29:57 2022] GET /compute/v2.1/servers/58f32b46-f1a9-4860-a54b-b2f1a012fc18 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:29:58.499120 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-4a1541fc-58ca-47f4-acee-9b8d654dcc91 req-85f4bb8d-b4c0-4cb2-bad6-fa1fa3ed2bef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58f32b46-f1a9-4860-a54b-b2f1a012fc18", "name": "network-vif-plugged", "status": "completed", "tag": "20b3571c-10c9-40e0-a655-fbd88de173dd"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:29:58.511488 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-4a1541fc-58ca-47f4-acee-9b8d654dcc91 req-85f4bb8d-b4c0-4cb2-bad6-fa1fa3ed2bef service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:29:58.512269 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-4a1541fc-58ca-47f4-acee-9b8d654dcc91 req-85f4bb8d-b4c0-4cb2-bad6-fa1fa3ed2bef service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:29:58.512744 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-4a1541fc-58ca-47f4-acee-9b8d654dcc91 req-85f4bb8d-b4c0-4cb2-bad6-fa1fa3ed2bef service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:29:58.525247 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-4a1541fc-58ca-47f4-acee-9b8d654dcc91 req-85f4bb8d-b4c0-4cb2-bad6-fa1fa3ed2bef service nova] Creating event network-vif-plugged:20b3571c-10c9-40e0-a655-fbd88de173dd for instance 58f32b46-f1a9-4860-a54b-b2f1a012fc18 on n-h1-860284-1 Oct 04 22:29:58.531891 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-4a1541fc-58ca-47f4-acee-9b8d654dcc91 req-85f4bb8d-b4c0-4cb2-bad6-fa1fa3ed2bef service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037316 Oct 04 22:29:58.532688 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3627/6577] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:29:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:29:58.709688 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-77af5e51-06c9-4235-b49f-44cd42f968ee tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:29:58.710435 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-77af5e51-06c9-4235-b49f-44cd42f968ee tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: 58f32b46-f1a9-4860-a54b-b2f1a012fc18] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:29:58.716754 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-77af5e51-06c9-4235-b49f-44cd42f968ee tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:29:58.717237 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-77af5e51-06c9-4235-b49f-44cd42f968ee tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:29:58.718010 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-77af5e51-06c9-4235-b49f-44cd42f968ee tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:29:58.718762 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-77af5e51-06c9-4235-b49f-44cd42f968ee tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:29:58.719246 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-77af5e51-06c9-4235-b49f-44cd42f968ee tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:29:58.719694 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-77af5e51-06c9-4235-b49f-44cd42f968ee tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:29:58.862385 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-77af5e51-06c9-4235-b49f-44cd42f968ee tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:29:58.870633 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-77af5e51-06c9-4235-b49f-44cd42f968ee tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/58f32b46-f1a9-4860-a54b-b2f1a012fc18" status: 200 len: 1266 microversion: 2.1 time: 0.165251 Oct 04 22:29:58.871220 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3628/6578] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:29:58 2022] GET /compute/v2.1/servers/58f32b46-f1a9-4860-a54b-b2f1a012fc18 => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:29:59.894078 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-ed2a97ec-bbc6-4fd7-9de6-eef86d334173 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:29:59.895052 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-ed2a97ec-bbc6-4fd7-9de6-eef86d334173 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: 58f32b46-f1a9-4860-a54b-b2f1a012fc18] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:29:59.901730 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ed2a97ec-bbc6-4fd7-9de6-eef86d334173 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:29:59.902222 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ed2a97ec-bbc6-4fd7-9de6-eef86d334173 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:29:59.902698 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ed2a97ec-bbc6-4fd7-9de6-eef86d334173 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:29:59.903405 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ed2a97ec-bbc6-4fd7-9de6-eef86d334173 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:29:59.903870 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ed2a97ec-bbc6-4fd7-9de6-eef86d334173 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:29:59.904310 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ed2a97ec-bbc6-4fd7-9de6-eef86d334173 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:30:00.051255 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-ed2a97ec-bbc6-4fd7-9de6-eef86d334173 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:30:00.063331 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-ed2a97ec-bbc6-4fd7-9de6-eef86d334173 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/58f32b46-f1a9-4860-a54b-b2f1a012fc18" status: 200 len: 1266 microversion: 2.1 time: 0.172927 Oct 04 22:30:00.064339 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3629/6579] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:29:59 2022] GET /compute/v2.1/servers/58f32b46-f1a9-4860-a54b-b2f1a012fc18 => generated 1266 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:30:01.088286 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-dd87cd3e-6bc4-48cf-a3e5-ac54509ffb92 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:30:01.088943 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-dd87cd3e-6bc4-48cf-a3e5-ac54509ffb92 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: 58f32b46-f1a9-4860-a54b-b2f1a012fc18] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:30:01.096231 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dd87cd3e-6bc4-48cf-a3e5-ac54509ffb92 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:30:01.096735 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dd87cd3e-6bc4-48cf-a3e5-ac54509ffb92 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:30:01.097191 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dd87cd3e-6bc4-48cf-a3e5-ac54509ffb92 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:30:01.097904 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dd87cd3e-6bc4-48cf-a3e5-ac54509ffb92 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:30:01.098394 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dd87cd3e-6bc4-48cf-a3e5-ac54509ffb92 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:30:01.098843 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dd87cd3e-6bc4-48cf-a3e5-ac54509ffb92 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:30:01.238295 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-dd87cd3e-6bc4-48cf-a3e5-ac54509ffb92 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:30:01.246247 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-dd87cd3e-6bc4-48cf-a3e5-ac54509ffb92 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/58f32b46-f1a9-4860-a54b-b2f1a012fc18" status: 200 len: 1454 microversion: 2.1 time: 0.161895 Oct 04 22:30:01.246857 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3630/6580] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:30:01 2022] GET /compute/v2.1/servers/58f32b46-f1a9-4860-a54b-b2f1a012fc18 => generated 1454 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:30:01.269756 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-b36b855d-2e7d-4a54-b9f3-b938a6ad8999 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:30:01.270402 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-b36b855d-2e7d-4a54-b9f3-b938a6ad8999 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: 58f32b46-f1a9-4860-a54b-b2f1a012fc18] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:30:01.276399 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b36b855d-2e7d-4a54-b9f3-b938a6ad8999 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:30:01.276890 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b36b855d-2e7d-4a54-b9f3-b938a6ad8999 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:30:01.277338 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b36b855d-2e7d-4a54-b9f3-b938a6ad8999 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:30:01.278036 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b36b855d-2e7d-4a54-b9f3-b938a6ad8999 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:30:01.278531 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b36b855d-2e7d-4a54-b9f3-b938a6ad8999 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:30:01.278973 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b36b855d-2e7d-4a54-b9f3-b938a6ad8999 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:30:01.415156 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-b36b855d-2e7d-4a54-b9f3-b938a6ad8999 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:30:01.418765 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=100 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:30:01.424078 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-b36b855d-2e7d-4a54-b9f3-b938a6ad8999 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/58f32b46-f1a9-4860-a54b-b2f1a012fc18" status: 200 len: 1454 microversion: 2.1 time: 0.158314 Oct 04 22:30:01.424674 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3631/6581] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:30:01 2022] GET /compute/v2.1/servers/58f32b46-f1a9-4860-a54b-b2f1a012fc18 => generated 1454 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:30:03.176347 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-c992f937-069a-4cf7-b103-c3937c9a4910 req-580ed83c-920c-4442-a779-651474ee301c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58f32b46-f1a9-4860-a54b-b2f1a012fc18", "tag": "20b3571c-10c9-40e0-a655-fbd88de173dd"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:30:03.187895 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-c992f937-069a-4cf7-b103-c3937c9a4910 req-580ed83c-920c-4442-a779-651474ee301c service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:30:03.188878 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-c992f937-069a-4cf7-b103-c3937c9a4910 req-580ed83c-920c-4442-a779-651474ee301c service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:30:03.189338 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-c992f937-069a-4cf7-b103-c3937c9a4910 req-580ed83c-920c-4442-a779-651474ee301c service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:30:03.205424 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-c992f937-069a-4cf7-b103-c3937c9a4910 req-580ed83c-920c-4442-a779-651474ee301c service nova] Creating event network-changed:20b3571c-10c9-40e0-a655-fbd88de173dd for instance 58f32b46-f1a9-4860-a54b-b2f1a012fc18 on n-h1-860284-1 Oct 04 22:30:03.210889 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-c992f937-069a-4cf7-b103-c3937c9a4910 req-580ed83c-920c-4442-a779-651474ee301c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038904 Oct 04 22:30:03.211655 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3632/6582] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:30:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:31:08.525368 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=41 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:31:08.526397 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=2 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:31:08.656493 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-549c6f7a-a19a-4893-86ec-8280a71c6c70 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:31:08.657122 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-549c6f7a-a19a-4893-86ec-8280a71c6c70 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] [instance: a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:31:08.663572 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-549c6f7a-a19a-4893-86ec-8280a71c6c70 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:08.664069 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-549c6f7a-a19a-4893-86ec-8280a71c6c70 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:08.664521 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-549c6f7a-a19a-4893-86ec-8280a71c6c70 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:08.665228 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-549c6f7a-a19a-4893-86ec-8280a71c6c70 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:08.665691 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-549c6f7a-a19a-4893-86ec-8280a71c6c70 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:08.666125 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-549c6f7a-a19a-4893-86ec-8280a71c6c70 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:08.690877 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-549c6f7a-a19a-4893-86ec-8280a71c6c70 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] 10.222.0.43 "GET /compute/v2.1/servers/a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4/ips" status: 200 len: 152 microversion: 2.20 time: 0.168263 Oct 04 22:31:08.691437 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3633/6583] 10.222.0.43 () {60 vars in 1289 bytes} [Tue Oct 4 22:31:08 2022] GET /compute/v2.1/servers/a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4/ips => generated 152 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 22:31:10.488411 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-fffbeb44-1ad5-4b1e-ab91-014379f93494 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:31:10.489078 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-fffbeb44-1ad5-4b1e-ab91-014379f93494 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] [instance: a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:31:10.495849 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fffbeb44-1ad5-4b1e-ab91-014379f93494 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:10.496357 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fffbeb44-1ad5-4b1e-ab91-014379f93494 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:10.496815 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fffbeb44-1ad5-4b1e-ab91-014379f93494 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:10.497556 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fffbeb44-1ad5-4b1e-ab91-014379f93494 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:10.498598 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fffbeb44-1ad5-4b1e-ab91-014379f93494 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:10.499051 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fffbeb44-1ad5-4b1e-ab91-014379f93494 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:10.522274 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.objects.instance [None req-fffbeb44-1ad5-4b1e-ab91-014379f93494 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lazy-loading 'flavor' on Instance uuid a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4 {{(pid=134101) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 22:31:10.727302 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-fffbeb44-1ad5-4b1e-ab91-014379f93494 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] 10.222.0.43 "POST /compute/v2.1/servers/a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4/action" status: 202 len: 0 microversion: 2.20 time: 0.242639 Oct 04 22:31:10.727954 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3634/6584] 10.222.0.43 () {62 vars in 1319 bytes} [Tue Oct 4 22:31:10 2022] POST /compute/v2.1/servers/a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4/action => generated 0 bytes in 244 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 04 22:31:10.737069 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-22cfc965-d0e4-48c2-9796-fd988151c890 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:31:10.738473 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-22cfc965-d0e4-48c2-9796-fd988151c890 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] [instance: a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:31:10.744623 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-22cfc965-d0e4-48c2-9796-fd988151c890 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:10.745274 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-22cfc965-d0e4-48c2-9796-fd988151c890 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:10.745865 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-22cfc965-d0e4-48c2-9796-fd988151c890 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:10.746785 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-22cfc965-d0e4-48c2-9796-fd988151c890 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:10.747465 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-22cfc965-d0e4-48c2-9796-fd988151c890 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:10.748014 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-22cfc965-d0e4-48c2-9796-fd988151c890 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:10.886453 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-22cfc965-d0e4-48c2-9796-fd988151c890 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:31:10.896590 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-22cfc965-d0e4-48c2-9796-fd988151c890 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:31:10.898070 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-22cfc965-d0e4-48c2-9796-fd988151c890 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:31:10.899326 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-22cfc965-d0e4-48c2-9796-fd988151c890 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] 10.222.0.43 "GET /compute/v2.1/servers/a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4" status: 200 len: 1722 microversion: 2.20 time: 0.167184 Oct 04 22:31:10.900133 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3635/6585] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:31:10 2022] GET /compute/v2.1/servers/a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4 => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 22:31:11.925891 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-ffcdba31-a855-4250-858e-97e5d9d936ef tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:31:11.926575 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-ffcdba31-a855-4250-858e-97e5d9d936ef tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] [instance: a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:31:11.933366 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ffcdba31-a855-4250-858e-97e5d9d936ef tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:11.933860 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ffcdba31-a855-4250-858e-97e5d9d936ef tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:11.934306 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ffcdba31-a855-4250-858e-97e5d9d936ef tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:11.935160 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ffcdba31-a855-4250-858e-97e5d9d936ef tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:11.935637 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ffcdba31-a855-4250-858e-97e5d9d936ef tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:11.936133 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ffcdba31-a855-4250-858e-97e5d9d936ef tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:12.066143 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-ffcdba31-a855-4250-858e-97e5d9d936ef tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:31:12.074820 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-ffcdba31-a855-4250-858e-97e5d9d936ef tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:31:12.077090 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-ffcdba31-a855-4250-858e-97e5d9d936ef tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:31:12.078306 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-ffcdba31-a855-4250-858e-97e5d9d936ef tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] 10.222.0.43 "GET /compute/v2.1/servers/a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4" status: 200 len: 1722 microversion: 2.20 time: 0.156404 Oct 04 22:31:12.078908 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3636/6586] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:31:11 2022] GET /compute/v2.1/servers/a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 22:31:13.104887 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-42c8ee37-3c5e-454a-9c7c-cc57c2886eb6 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:31:13.105521 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-42c8ee37-3c5e-454a-9c7c-cc57c2886eb6 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] [instance: a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:31:13.114349 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-42c8ee37-3c5e-454a-9c7c-cc57c2886eb6 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:13.115320 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-42c8ee37-3c5e-454a-9c7c-cc57c2886eb6 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:13.116289 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-42c8ee37-3c5e-454a-9c7c-cc57c2886eb6 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:13.117335 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-42c8ee37-3c5e-454a-9c7c-cc57c2886eb6 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:13.118083 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-42c8ee37-3c5e-454a-9c7c-cc57c2886eb6 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:13.118833 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-42c8ee37-3c5e-454a-9c7c-cc57c2886eb6 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:13.277206 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-42c8ee37-3c5e-454a-9c7c-cc57c2886eb6 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:31:13.297687 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-42c8ee37-3c5e-454a-9c7c-cc57c2886eb6 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:31:13.299252 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-42c8ee37-3c5e-454a-9c7c-cc57c2886eb6 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:31:13.300839 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-42c8ee37-3c5e-454a-9c7c-cc57c2886eb6 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] 10.222.0.43 "GET /compute/v2.1/servers/a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4" status: 200 len: 1722 microversion: 2.20 time: 0.201751 Oct 04 22:31:13.301908 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3637/6587] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:31:13 2022] GET /compute/v2.1/servers/a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4 => generated 1722 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 22:31:14.328228 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-27eb6c46-891a-4b9f-9dbc-f6176c3db4b3 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:31:14.328885 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-27eb6c46-891a-4b9f-9dbc-f6176c3db4b3 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] [instance: a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:31:14.335920 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-27eb6c46-891a-4b9f-9dbc-f6176c3db4b3 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:14.336430 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-27eb6c46-891a-4b9f-9dbc-f6176c3db4b3 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:14.336878 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-27eb6c46-891a-4b9f-9dbc-f6176c3db4b3 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:14.337605 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-27eb6c46-891a-4b9f-9dbc-f6176c3db4b3 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:14.338069 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-27eb6c46-891a-4b9f-9dbc-f6176c3db4b3 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:14.338567 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-27eb6c46-891a-4b9f-9dbc-f6176c3db4b3 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:14.492479 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-27eb6c46-891a-4b9f-9dbc-f6176c3db4b3 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:31:14.505395 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-27eb6c46-891a-4b9f-9dbc-f6176c3db4b3 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:31:14.507015 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-27eb6c46-891a-4b9f-9dbc-f6176c3db4b3 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:31:14.508311 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-27eb6c46-891a-4b9f-9dbc-f6176c3db4b3 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] 10.222.0.43 "GET /compute/v2.1/servers/a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4" status: 200 len: 1722 microversion: 2.20 time: 0.184777 Oct 04 22:31:14.508954 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3638/6588] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:31:14 2022] GET /compute/v2.1/servers/a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4 => generated 1722 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 22:31:15.535243 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-964ec9d7-8a3f-40dc-aac8-5f4b42b1ded2 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:31:15.535855 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-964ec9d7-8a3f-40dc-aac8-5f4b42b1ded2 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] [instance: a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:31:15.542873 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-964ec9d7-8a3f-40dc-aac8-5f4b42b1ded2 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:15.543385 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-964ec9d7-8a3f-40dc-aac8-5f4b42b1ded2 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:15.543841 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-964ec9d7-8a3f-40dc-aac8-5f4b42b1ded2 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:15.544874 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-964ec9d7-8a3f-40dc-aac8-5f4b42b1ded2 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:15.545058 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-964ec9d7-8a3f-40dc-aac8-5f4b42b1ded2 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:15.545702 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-964ec9d7-8a3f-40dc-aac8-5f4b42b1ded2 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:15.691445 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-964ec9d7-8a3f-40dc-aac8-5f4b42b1ded2 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:31:15.699857 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-964ec9d7-8a3f-40dc-aac8-5f4b42b1ded2 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:31:15.701963 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-964ec9d7-8a3f-40dc-aac8-5f4b42b1ded2 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:31:15.703182 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-964ec9d7-8a3f-40dc-aac8-5f4b42b1ded2 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] 10.222.0.43 "GET /compute/v2.1/servers/a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4" status: 200 len: 1722 microversion: 2.20 time: 0.171973 Oct 04 22:31:15.703766 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3639/6589] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:31:15 2022] GET /compute/v2.1/servers/a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4 => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:31:16.729186 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-45e99593-dba4-4c0a-95b6-fef63cf824a4 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:31:16.729904 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-45e99593-dba4-4c0a-95b6-fef63cf824a4 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] [instance: a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:31:16.736856 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-45e99593-dba4-4c0a-95b6-fef63cf824a4 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:16.737364 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-45e99593-dba4-4c0a-95b6-fef63cf824a4 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:16.737823 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-45e99593-dba4-4c0a-95b6-fef63cf824a4 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:16.738579 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-45e99593-dba4-4c0a-95b6-fef63cf824a4 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:16.739062 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-45e99593-dba4-4c0a-95b6-fef63cf824a4 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:16.739508 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-45e99593-dba4-4c0a-95b6-fef63cf824a4 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:16.887343 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-45e99593-dba4-4c0a-95b6-fef63cf824a4 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:31:16.896442 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-45e99593-dba4-4c0a-95b6-fef63cf824a4 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:31:16.897921 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-45e99593-dba4-4c0a-95b6-fef63cf824a4 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:31:16.899151 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-45e99593-dba4-4c0a-95b6-fef63cf824a4 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] 10.222.0.43 "GET /compute/v2.1/servers/a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4" status: 200 len: 1722 microversion: 2.20 time: 0.174063 Oct 04 22:31:16.899728 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3640/6590] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:31:16 2022] GET /compute/v2.1/servers/a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4 => generated 1722 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 22:31:17.927852 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-10aad8eb-7ed4-4409-9f4b-ec84b8b2b488 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:31:17.928429 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-10aad8eb-7ed4-4409-9f4b-ec84b8b2b488 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] [instance: a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:31:17.936304 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-10aad8eb-7ed4-4409-9f4b-ec84b8b2b488 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:17.936818 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-10aad8eb-7ed4-4409-9f4b-ec84b8b2b488 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:17.937269 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-10aad8eb-7ed4-4409-9f4b-ec84b8b2b488 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:17.938004 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-10aad8eb-7ed4-4409-9f4b-ec84b8b2b488 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:17.938505 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-10aad8eb-7ed4-4409-9f4b-ec84b8b2b488 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:17.939168 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-10aad8eb-7ed4-4409-9f4b-ec84b8b2b488 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:18.080140 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-10aad8eb-7ed4-4409-9f4b-ec84b8b2b488 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:31:18.088697 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-10aad8eb-7ed4-4409-9f4b-ec84b8b2b488 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:31:18.090241 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-10aad8eb-7ed4-4409-9f4b-ec84b8b2b488 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:31:18.092224 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-10aad8eb-7ed4-4409-9f4b-ec84b8b2b488 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] 10.222.0.43 "GET /compute/v2.1/servers/a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4" status: 200 len: 1722 microversion: 2.20 time: 0.168378 Oct 04 22:31:18.092840 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3641/6591] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:31:17 2022] GET /compute/v2.1/servers/a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4 => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 22:31:19.117267 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-956769ae-67b7-4de6-aa14-7df847ffe752 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:31:19.118019 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-956769ae-67b7-4de6-aa14-7df847ffe752 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] [instance: a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:31:19.125705 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-956769ae-67b7-4de6-aa14-7df847ffe752 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:19.126218 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-956769ae-67b7-4de6-aa14-7df847ffe752 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:19.126702 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-956769ae-67b7-4de6-aa14-7df847ffe752 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:19.127456 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-956769ae-67b7-4de6-aa14-7df847ffe752 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:19.128166 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-956769ae-67b7-4de6-aa14-7df847ffe752 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:19.128609 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-956769ae-67b7-4de6-aa14-7df847ffe752 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:19.268379 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-956769ae-67b7-4de6-aa14-7df847ffe752 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:31:19.277008 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-956769ae-67b7-4de6-aa14-7df847ffe752 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:31:19.278538 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-956769ae-67b7-4de6-aa14-7df847ffe752 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:31:19.279775 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-956769ae-67b7-4de6-aa14-7df847ffe752 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] 10.222.0.43 "GET /compute/v2.1/servers/a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4" status: 200 len: 1722 microversion: 2.20 time: 0.166574 Oct 04 22:31:19.280336 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3642/6592] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:31:19 2022] GET /compute/v2.1/servers/a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4 => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 22:31:20.305404 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-3637ab38-7d3b-44b0-8539-fbec30e4e356 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:31:20.305982 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-3637ab38-7d3b-44b0-8539-fbec30e4e356 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] [instance: a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:31:20.313499 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3637ab38-7d3b-44b0-8539-fbec30e4e356 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:20.314019 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3637ab38-7d3b-44b0-8539-fbec30e4e356 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:20.314531 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3637ab38-7d3b-44b0-8539-fbec30e4e356 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:20.315456 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3637ab38-7d3b-44b0-8539-fbec30e4e356 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:20.315812 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3637ab38-7d3b-44b0-8539-fbec30e4e356 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:20.316155 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3637ab38-7d3b-44b0-8539-fbec30e4e356 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:20.473340 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-3637ab38-7d3b-44b0-8539-fbec30e4e356 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:31:20.484486 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-3637ab38-7d3b-44b0-8539-fbec30e4e356 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:31:20.486149 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-3637ab38-7d3b-44b0-8539-fbec30e4e356 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:31:20.487390 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-3637ab38-7d3b-44b0-8539-fbec30e4e356 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] 10.222.0.43 "GET /compute/v2.1/servers/a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4" status: 200 len: 1722 microversion: 2.20 time: 0.186150 Oct 04 22:31:20.487970 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3643/6593] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:31:20 2022] GET /compute/v2.1/servers/a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4 => generated 1722 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 22:31:21.515050 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-d68c962f-72cc-4acd-9f3d-0f5e5c94c4c4 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:31:21.515938 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-d68c962f-72cc-4acd-9f3d-0f5e5c94c4c4 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] [instance: a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:31:21.523303 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d68c962f-72cc-4acd-9f3d-0f5e5c94c4c4 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:21.523909 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d68c962f-72cc-4acd-9f3d-0f5e5c94c4c4 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:21.524442 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d68c962f-72cc-4acd-9f3d-0f5e5c94c4c4 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:21.525271 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d68c962f-72cc-4acd-9f3d-0f5e5c94c4c4 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:21.525924 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d68c962f-72cc-4acd-9f3d-0f5e5c94c4c4 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:21.526778 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d68c962f-72cc-4acd-9f3d-0f5e5c94c4c4 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:21.672482 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-d68c962f-72cc-4acd-9f3d-0f5e5c94c4c4 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:31:21.681007 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-d68c962f-72cc-4acd-9f3d-0f5e5c94c4c4 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:31:21.682542 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-d68c962f-72cc-4acd-9f3d-0f5e5c94c4c4 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:31:21.683833 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-d68c962f-72cc-4acd-9f3d-0f5e5c94c4c4 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] 10.222.0.43 "GET /compute/v2.1/servers/a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4" status: 200 len: 1722 microversion: 2.20 time: 0.173911 Oct 04 22:31:21.684432 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3644/6594] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:31:21 2022] GET /compute/v2.1/servers/a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4 => generated 1722 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 22:31:22.712413 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-f9481140-74f8-4cc9-9047-0ac372eda35a tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:31:22.713105 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-f9481140-74f8-4cc9-9047-0ac372eda35a tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] [instance: a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:31:22.720680 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f9481140-74f8-4cc9-9047-0ac372eda35a tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:22.721177 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f9481140-74f8-4cc9-9047-0ac372eda35a tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:22.721625 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f9481140-74f8-4cc9-9047-0ac372eda35a tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:22.722329 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f9481140-74f8-4cc9-9047-0ac372eda35a tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:22.722825 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f9481140-74f8-4cc9-9047-0ac372eda35a tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:22.723266 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f9481140-74f8-4cc9-9047-0ac372eda35a tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:22.877050 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-f9481140-74f8-4cc9-9047-0ac372eda35a tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:31:22.885675 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-f9481140-74f8-4cc9-9047-0ac372eda35a tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:31:22.887167 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-f9481140-74f8-4cc9-9047-0ac372eda35a tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:31:22.889095 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-f9481140-74f8-4cc9-9047-0ac372eda35a tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] 10.222.0.43 "GET /compute/v2.1/servers/a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4" status: 200 len: 1743 microversion: 2.20 time: 0.180641 Oct 04 22:31:22.889667 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3645/6595] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:31:22 2022] GET /compute/v2.1/servers/a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4 => generated 1743 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 22:31:23.915170 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-f9b62d81-7578-480e-87c2-3cd0c43c5927 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:31:23.915875 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-f9b62d81-7578-480e-87c2-3cd0c43c5927 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] [instance: a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:31:23.923994 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f9b62d81-7578-480e-87c2-3cd0c43c5927 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:23.924519 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f9b62d81-7578-480e-87c2-3cd0c43c5927 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:23.924981 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f9b62d81-7578-480e-87c2-3cd0c43c5927 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:23.925724 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f9b62d81-7578-480e-87c2-3cd0c43c5927 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:23.926199 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f9b62d81-7578-480e-87c2-3cd0c43c5927 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:23.926680 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f9b62d81-7578-480e-87c2-3cd0c43c5927 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:24.082627 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-f9b62d81-7578-480e-87c2-3cd0c43c5927 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:31:24.091231 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-f9b62d81-7578-480e-87c2-3cd0c43c5927 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:31:24.092734 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-f9b62d81-7578-480e-87c2-3cd0c43c5927 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:31:24.093922 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-f9b62d81-7578-480e-87c2-3cd0c43c5927 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] 10.222.0.43 "GET /compute/v2.1/servers/a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4" status: 200 len: 1743 microversion: 2.20 time: 0.182798 Oct 04 22:31:24.094506 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3646/6596] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:31:23 2022] GET /compute/v2.1/servers/a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4 => generated 1743 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 22:31:25.126788 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-843621db-f9a5-410d-a286-3d795fe3828f tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:31:25.128184 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-843621db-f9a5-410d-a286-3d795fe3828f tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] [instance: a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:31:25.145507 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-843621db-f9a5-410d-a286-3d795fe3828f tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:25.146389 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-843621db-f9a5-410d-a286-3d795fe3828f tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:25.147205 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-843621db-f9a5-410d-a286-3d795fe3828f tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:25.148450 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-843621db-f9a5-410d-a286-3d795fe3828f tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:25.149324 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-843621db-f9a5-410d-a286-3d795fe3828f tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:25.150087 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-843621db-f9a5-410d-a286-3d795fe3828f tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:25.305018 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-843621db-f9a5-410d-a286-3d795fe3828f tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:31:25.308566 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:31:25.314543 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-843621db-f9a5-410d-a286-3d795fe3828f tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:31:25.316010 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-843621db-f9a5-410d-a286-3d795fe3828f tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:31:25.317237 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-843621db-f9a5-410d-a286-3d795fe3828f tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] 10.222.0.43 "GET /compute/v2.1/servers/a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4" status: 200 len: 1743 microversion: 2.20 time: 0.202227 Oct 04 22:31:25.317768 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3647/6597] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:31:25 2022] GET /compute/v2.1/servers/a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4 => generated 1743 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 22:31:26.343727 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-1abd4fa8-660d-4828-ae59-8e563c884d97 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:31:26.344448 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-1abd4fa8-660d-4828-ae59-8e563c884d97 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] [instance: a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:31:26.352801 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1abd4fa8-660d-4828-ae59-8e563c884d97 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:26.353300 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1abd4fa8-660d-4828-ae59-8e563c884d97 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:26.353753 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1abd4fa8-660d-4828-ae59-8e563c884d97 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:26.354489 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1abd4fa8-660d-4828-ae59-8e563c884d97 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:26.354957 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1abd4fa8-660d-4828-ae59-8e563c884d97 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:26.355399 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1abd4fa8-660d-4828-ae59-8e563c884d97 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:26.489619 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-1abd4fa8-660d-4828-ae59-8e563c884d97 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:31:26.498766 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-1abd4fa8-660d-4828-ae59-8e563c884d97 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:31:26.500227 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-1abd4fa8-660d-4828-ae59-8e563c884d97 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:31:26.501418 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-1abd4fa8-660d-4828-ae59-8e563c884d97 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] 10.222.0.43 "GET /compute/v2.1/servers/a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4" status: 200 len: 1743 microversion: 2.20 time: 0.162509 Oct 04 22:31:26.501978 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3648/6598] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:31:26 2022] GET /compute/v2.1/servers/a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4 => generated 1743 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 22:31:26.890194 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-6941aa75-b441-4d09-b92a-91be4e81dc08 req-23c4d796-08fb-4c3b-8f4a-226f5189b021 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4", "name": "network-vif-plugged", "status": "completed", "tag": "c125f571-485f-4f51-9daa-780c14a6c4c9"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:31:26.901176 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-6941aa75-b441-4d09-b92a-91be4e81dc08 req-23c4d796-08fb-4c3b-8f4a-226f5189b021 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:26.901616 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-6941aa75-b441-4d09-b92a-91be4e81dc08 req-23c4d796-08fb-4c3b-8f4a-226f5189b021 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:26.902314 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-6941aa75-b441-4d09-b92a-91be4e81dc08 req-23c4d796-08fb-4c3b-8f4a-226f5189b021 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:26.916120 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-6941aa75-b441-4d09-b92a-91be4e81dc08 req-23c4d796-08fb-4c3b-8f4a-226f5189b021 service nova] Creating event network-vif-plugged:c125f571-485f-4f51-9daa-780c14a6c4c9 for instance a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4 on n-h2-860284-1 Oct 04 22:31:26.922143 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-6941aa75-b441-4d09-b92a-91be4e81dc08 req-23c4d796-08fb-4c3b-8f4a-226f5189b021 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035652 Oct 04 22:31:26.922866 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3649/6599] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:31:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:31:27.529345 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-d359593a-c770-4086-a220-be6b0598c6d4 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:31:27.530078 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-d359593a-c770-4086-a220-be6b0598c6d4 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] [instance: a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:31:27.536425 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d359593a-c770-4086-a220-be6b0598c6d4 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:27.536932 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d359593a-c770-4086-a220-be6b0598c6d4 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:27.537392 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d359593a-c770-4086-a220-be6b0598c6d4 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:27.538146 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d359593a-c770-4086-a220-be6b0598c6d4 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:27.538649 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d359593a-c770-4086-a220-be6b0598c6d4 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:27.539099 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d359593a-c770-4086-a220-be6b0598c6d4 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:27.676676 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-d359593a-c770-4086-a220-be6b0598c6d4 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:31:27.685997 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-d359593a-c770-4086-a220-be6b0598c6d4 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:31:27.687509 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-d359593a-c770-4086-a220-be6b0598c6d4 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:31:27.688706 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-d359593a-c770-4086-a220-be6b0598c6d4 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] 10.222.0.43 "GET /compute/v2.1/servers/a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4" status: 200 len: 1743 microversion: 2.20 time: 0.165027 Oct 04 22:31:27.689277 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3650/6600] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:31:27 2022] GET /compute/v2.1/servers/a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4 => generated 1743 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 22:31:28.714459 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-608a7448-5e83-4ff6-92e0-1d1a4245ddd7 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:31:28.716928 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-608a7448-5e83-4ff6-92e0-1d1a4245ddd7 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] [instance: a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:31:28.725115 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-608a7448-5e83-4ff6-92e0-1d1a4245ddd7 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:28.725618 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-608a7448-5e83-4ff6-92e0-1d1a4245ddd7 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:28.726492 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-608a7448-5e83-4ff6-92e0-1d1a4245ddd7 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:28.727554 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-608a7448-5e83-4ff6-92e0-1d1a4245ddd7 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:28.728363 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-608a7448-5e83-4ff6-92e0-1d1a4245ddd7 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:28.728988 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-608a7448-5e83-4ff6-92e0-1d1a4245ddd7 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:28.934080 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-608a7448-5e83-4ff6-92e0-1d1a4245ddd7 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:31:28.955313 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-608a7448-5e83-4ff6-92e0-1d1a4245ddd7 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:31:28.956854 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-608a7448-5e83-4ff6-92e0-1d1a4245ddd7 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:31:28.958421 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-608a7448-5e83-4ff6-92e0-1d1a4245ddd7 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] 10.222.0.43 "GET /compute/v2.1/servers/a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4" status: 200 len: 1738 microversion: 2.20 time: 0.248214 Oct 04 22:31:28.959533 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3651/6601] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:31:28 2022] GET /compute/v2.1/servers/a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4 => generated 1738 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 22:31:29.992645 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e432be73-6423-4570-aa10-e17f7b681f93 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:31:29.993996 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-e432be73-6423-4570-aa10-e17f7b681f93 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] [instance: a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:31:30.002583 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e432be73-6423-4570-aa10-e17f7b681f93 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:30.004074 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e432be73-6423-4570-aa10-e17f7b681f93 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:30.004726 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e432be73-6423-4570-aa10-e17f7b681f93 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:30.005653 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e432be73-6423-4570-aa10-e17f7b681f93 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:30.006330 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e432be73-6423-4570-aa10-e17f7b681f93 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:30.006990 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e432be73-6423-4570-aa10-e17f7b681f93 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:30.177345 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-e432be73-6423-4570-aa10-e17f7b681f93 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:31:30.189277 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-e432be73-6423-4570-aa10-e17f7b681f93 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:31:30.190826 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-e432be73-6423-4570-aa10-e17f7b681f93 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:31:30.192327 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-e432be73-6423-4570-aa10-e17f7b681f93 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] 10.222.0.43 "GET /compute/v2.1/servers/a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4" status: 200 len: 1738 microversion: 2.20 time: 0.203978 Oct 04 22:31:30.206388 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3652/6602] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:31:29 2022] GET /compute/v2.1/servers/a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4 => generated 1738 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 22:31:31.200508 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-44909634-79f9-4a4c-88aa-e75ea4fc8e29 tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Action: 'create', calling method: .version_select at 0x7fbb2e1ecd30>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-2146117326", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA4AFGFkzQapDhG2viQYOlSCmkj9bjAhPl1IWZ5mOZValvIDlBTlNN/AQBaRTnrwMLd0zbV4u0WJoT34iEvsQoVUAUvaEMKr4cZmFYss1eQu4kKXrOk1HZ+e6KKOrxju3A=="}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:31:31.224775 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-44909634-79f9-4a4c-88aa-e75ea4fc8e29 tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Getting quotas for project 65234c569b29466d85335f035aa7ede4. Resources: {'key_pairs'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:31:31.233245 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-44909634-79f9-4a4c-88aa-e75ea4fc8e29 tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Getting quotas for user 1b6b686aa4874b9ca998e9e1898d8d47 and project 65234c569b29466d85335f035aa7ede4. Resources: {'key_pairs'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:31:31.266251 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-44909634-79f9-4a4c-88aa-e75ea4fc8e29 tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.069788 Oct 04 22:31:31.267736 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3653/6603] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Oct 4 22:31:31 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:31:31.273380 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-6d1b45b2-64d9-4a5a-92f3-1c3dbd5c3c34 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:31:31.274690 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-6d1b45b2-64d9-4a5a-92f3-1c3dbd5c3c34 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] [instance: a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:31:31.281490 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6d1b45b2-64d9-4a5a-92f3-1c3dbd5c3c34 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:31.282188 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6d1b45b2-64d9-4a5a-92f3-1c3dbd5c3c34 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:31.282985 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6d1b45b2-64d9-4a5a-92f3-1c3dbd5c3c34 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:31.284023 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6d1b45b2-64d9-4a5a-92f3-1c3dbd5c3c34 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:31.284876 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6d1b45b2-64d9-4a5a-92f3-1c3dbd5c3c34 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:31.285493 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6d1b45b2-64d9-4a5a-92f3-1c3dbd5c3c34 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:31.591944 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-6d1b45b2-64d9-4a5a-92f3-1c3dbd5c3c34 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:31:31.605994 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-6d1b45b2-64d9-4a5a-92f3-1c3dbd5c3c34 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:31:31.608581 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-6d1b45b2-64d9-4a5a-92f3-1c3dbd5c3c34 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:31:31.610464 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-6d1b45b2-64d9-4a5a-92f3-1c3dbd5c3c34 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] 10.222.0.43 "GET /compute/v2.1/servers/a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4" status: 200 len: 1738 microversion: 2.20 time: 0.341370 Oct 04 22:31:31.632113 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3654/6604] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:31:31 2022] GET /compute/v2.1/servers/a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4 => generated 1738 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:31:32.351149 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-465a41f9-a407-4030-a185-4a2faa1b8f1c tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:31:32.352702 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-465a41f9-a407-4030-a185-4a2faa1b8f1c tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: 58f32b46-f1a9-4860-a54b-b2f1a012fc18] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:31:32.367195 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-465a41f9-a407-4030-a185-4a2faa1b8f1c tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:32.368428 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-465a41f9-a407-4030-a185-4a2faa1b8f1c tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:32.369124 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-465a41f9-a407-4030-a185-4a2faa1b8f1c tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:32.370519 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-465a41f9-a407-4030-a185-4a2faa1b8f1c tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:32.371381 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-465a41f9-a407-4030-a185-4a2faa1b8f1c tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:32.372469 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-465a41f9-a407-4030-a185-4a2faa1b8f1c tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:32.423310 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-465a41f9-a407-4030-a185-4a2faa1b8f1c tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: 58f32b46-f1a9-4860-a54b-b2f1a012fc18] Going to try to terminate instance {{(pid=134101) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 22:31:32.587463 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-465a41f9-a407-4030-a185-4a2faa1b8f1c tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "DELETE /compute/v2.1/servers/58f32b46-f1a9-4860-a54b-b2f1a012fc18" status: 204 len: 0 microversion: 2.1 time: 0.240119 Oct 04 22:31:32.589605 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3655/6605] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 22:31:32 2022] DELETE /compute/v2.1/servers/58f32b46-f1a9-4860-a54b-b2f1a012fc18 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 22:31:32.601299 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-681f3334-d77b-44c8-9054-e16cc96bcba4 req-f7b7b624-0728-4463-b122-71d0e4b3f951 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58f32b46-f1a9-4860-a54b-b2f1a012fc18", "tag": "20b3571c-10c9-40e0-a655-fbd88de173dd"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:31:32.613426 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-681f3334-d77b-44c8-9054-e16cc96bcba4 req-f7b7b624-0728-4463-b122-71d0e4b3f951 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:32.613846 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-681f3334-d77b-44c8-9054-e16cc96bcba4 req-f7b7b624-0728-4463-b122-71d0e4b3f951 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:32.614616 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-681f3334-d77b-44c8-9054-e16cc96bcba4 req-f7b7b624-0728-4463-b122-71d0e4b3f951 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:32.632070 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-681f3334-d77b-44c8-9054-e16cc96bcba4 req-f7b7b624-0728-4463-b122-71d0e4b3f951 service nova] Creating event network-changed:20b3571c-10c9-40e0-a655-fbd88de173dd for instance 58f32b46-f1a9-4860-a54b-b2f1a012fc18 on n-h1-860284-1 Oct 04 22:31:32.644642 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-681f3334-d77b-44c8-9054-e16cc96bcba4 req-f7b7b624-0728-4463-b122-71d0e4b3f951 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052345 Oct 04 22:31:32.645276 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3656/6606] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:31:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:31:32.656180 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-fb9f7ddb-4ac1-4b52-9403-74a736a3f6c3 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:31:32.656982 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-fb9f7ddb-4ac1-4b52-9403-74a736a3f6c3 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: 58f32b46-f1a9-4860-a54b-b2f1a012fc18] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:31:32.665204 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fb9f7ddb-4ac1-4b52-9403-74a736a3f6c3 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:32.665736 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fb9f7ddb-4ac1-4b52-9403-74a736a3f6c3 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:32.666290 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fb9f7ddb-4ac1-4b52-9403-74a736a3f6c3 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:32.667181 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fb9f7ddb-4ac1-4b52-9403-74a736a3f6c3 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:32.667667 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fb9f7ddb-4ac1-4b52-9403-74a736a3f6c3 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:32.668119 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fb9f7ddb-4ac1-4b52-9403-74a736a3f6c3 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:32.941492 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-fb9f7ddb-4ac1-4b52-9403-74a736a3f6c3 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:31:32.959704 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-fb9f7ddb-4ac1-4b52-9403-74a736a3f6c3 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/58f32b46-f1a9-4860-a54b-b2f1a012fc18" status: 200 len: 1578 microversion: 2.1 time: 0.309662 Oct 04 22:31:32.960731 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3657/6607] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:31:32 2022] GET /compute/v2.1/servers/58f32b46-f1a9-4860-a54b-b2f1a012fc18 => generated 1578 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:31:32.988316 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-b2e0477e-f910-4c44-b28a-9968addd5b9f tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:31:32.989343 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-b2e0477e-f910-4c44-b28a-9968addd5b9f tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] [instance: a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:31:32.998555 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b2e0477e-f910-4c44-b28a-9968addd5b9f tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:33.000382 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b2e0477e-f910-4c44-b28a-9968addd5b9f tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:33.002132 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b2e0477e-f910-4c44-b28a-9968addd5b9f tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:33.003275 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b2e0477e-f910-4c44-b28a-9968addd5b9f tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:33.004355 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b2e0477e-f910-4c44-b28a-9968addd5b9f tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:33.005038 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b2e0477e-f910-4c44-b28a-9968addd5b9f tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:33.175330 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-b2e0477e-f910-4c44-b28a-9968addd5b9f tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:31:33.189183 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-b2e0477e-f910-4c44-b28a-9968addd5b9f tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:31:33.192954 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-b2e0477e-f910-4c44-b28a-9968addd5b9f tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:31:33.194220 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-b2e0477e-f910-4c44-b28a-9968addd5b9f tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] 10.222.0.43 "GET /compute/v2.1/servers/a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4" status: 200 len: 1738 microversion: 2.20 time: 0.217123 Oct 04 22:31:33.195007 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3658/6608] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:31:32 2022] GET /compute/v2.1/servers/a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4 => generated 1738 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:31:33.644804 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-14883741-5663-42ff-9d08-c3d0716aa14c tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-884101064", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "277d6945-c0de-45a7-95bc-33046d2e0342", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-2146117326", "security_groups": [{"name": "tempest-secgroup-smoke-1517930272"}], "networks": [{"uuid": "73fdb873-18f3-442c-b76c-f8a033e9f606"}]}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:31:33.851792 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.network.neutron [None req-14883741-5663-42ff-9d08-c3d0716aa14c tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] validate_networks() for [('73fdb873-18f3-442c-b76c-f8a033e9f606', None, None, None, None, None)] {{(pid=134101) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 22:31:34.437865 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-14883741-5663-42ff-9d08-c3d0716aa14c tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Flavor limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 22:31:34.438675 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-14883741-5663-42ff-9d08-c3d0716aa14c tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Image limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 22:31:34.439348 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-14883741-5663-42ff-9d08-c3d0716aa14c tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Flavor pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 22:31:34.439847 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-14883741-5663-42ff-9d08-c3d0716aa14c tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Image pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 22:31:34.440368 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-14883741-5663-42ff-9d08-c3d0716aa14c tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 22:31:34.457243 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-14883741-5663-42ff-9d08-c3d0716aa14c tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:34.457769 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-14883741-5663-42ff-9d08-c3d0716aa14c tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:34.458238 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-14883741-5663-42ff-9d08-c3d0716aa14c tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:34.459397 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-14883741-5663-42ff-9d08-c3d0716aa14c tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:34.460115 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-14883741-5663-42ff-9d08-c3d0716aa14c tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:34.460336 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-14883741-5663-42ff-9d08-c3d0716aa14c tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:34.496184 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-14883741-5663-42ff-9d08-c3d0716aa14c tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Getting quotas for project 65234c569b29466d85335f035aa7ede4. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:31:34.506620 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-14883741-5663-42ff-9d08-c3d0716aa14c tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Getting quotas for user 1b6b686aa4874b9ca998e9e1898d8d47 and project 65234c569b29466d85335f035aa7ede4. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:31:34.589637 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-14883741-5663-42ff-9d08-c3d0716aa14c tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Going to run 1 instances... {{(pid=134101) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 22:31:34.592327 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-14883741-5663-42ff-9d08-c3d0716aa14c tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] [instance: 3d057e51-38a4-445e-b2b5-ac76aa567ab3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='277d6945-c0de-45a7-95bc-33046d2e0342',volume_size=None,volume_type=None)] {{(pid=134101) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 22:31:34.792761 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-14883741-5663-42ff-9d08-c3d0716aa14c tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.152237 Oct 04 22:31:34.794549 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3659/6609] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 22:31:33 2022] POST /compute/v2.1/servers => generated 406 bytes in 1155 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 22:31:34.799385 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-52aa4f76-4553-4c55-af37-02de2e8422d3 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:31:34.800470 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-52aa4f76-4553-4c55-af37-02de2e8422d3 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: 58f32b46-f1a9-4860-a54b-b2f1a012fc18] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:31:34.810059 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-52aa4f76-4553-4c55-af37-02de2e8422d3 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:34.810912 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-52aa4f76-4553-4c55-af37-02de2e8422d3 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:34.811553 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-52aa4f76-4553-4c55-af37-02de2e8422d3 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:34.812466 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-52aa4f76-4553-4c55-af37-02de2e8422d3 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:34.813111 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-52aa4f76-4553-4c55-af37-02de2e8422d3 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:34.813727 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-52aa4f76-4553-4c55-af37-02de2e8422d3 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:35.074077 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-52aa4f76-4553-4c55-af37-02de2e8422d3 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:31:35.083808 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-52aa4f76-4553-4c55-af37-02de2e8422d3 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/58f32b46-f1a9-4860-a54b-b2f1a012fc18" status: 200 len: 1460 microversion: 2.1 time: 0.287908 Oct 04 22:31:35.098389 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3660/6610] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:31:34 2022] GET /compute/v2.1/servers/58f32b46-f1a9-4860-a54b-b2f1a012fc18 => generated 1460 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:31:35.098389 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-bb5e793a-ec8f-4551-8463-951b09dd9b49 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:31:35.098389 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-bb5e793a-ec8f-4551-8463-951b09dd9b49 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] [instance: a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:31:35.098389 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bb5e793a-ec8f-4551-8463-951b09dd9b49 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:35.098389 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bb5e793a-ec8f-4551-8463-951b09dd9b49 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:35.098389 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bb5e793a-ec8f-4551-8463-951b09dd9b49 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:35.099467 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bb5e793a-ec8f-4551-8463-951b09dd9b49 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:35.099467 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bb5e793a-ec8f-4551-8463-951b09dd9b49 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:35.099633 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bb5e793a-ec8f-4551-8463-951b09dd9b49 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:35.301511 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-bb5e793a-ec8f-4551-8463-951b09dd9b49 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:31:35.314983 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-bb5e793a-ec8f-4551-8463-951b09dd9b49 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:31:35.316780 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-bb5e793a-ec8f-4551-8463-951b09dd9b49 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:31:35.318024 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-bb5e793a-ec8f-4551-8463-951b09dd9b49 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] 10.222.0.43 "GET /compute/v2.1/servers/a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4" status: 200 len: 1738 microversion: 2.20 time: 0.232056 Oct 04 22:31:35.339078 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3661/6611] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:31:35 2022] GET /compute/v2.1/servers/a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4 => generated 1738 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:31:35.346674 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-23288e18-6fb7-49ab-8418-2961a8342c90 tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:31:35.347514 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-23288e18-6fb7-49ab-8418-2961a8342c90 tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] [instance: 3d057e51-38a4-445e-b2b5-ac76aa567ab3] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:31:35.416802 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-23288e18-6fb7-49ab-8418-2961a8342c90 tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b6b686aa4874b9ca998e9e1898d8d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65234c569b29466d85335f035aa7ede4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:31:35.427013 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-23288e18-6fb7-49ab-8418-2961a8342c90 tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] 10.222.0.43 "GET /compute/v2.1/servers/3d057e51-38a4-445e-b2b5-ac76aa567ab3" status: 200 len: 1098 microversion: 2.1 time: 0.086596 Oct 04 22:31:35.443696 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3662/6612] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:31:35 2022] GET /compute/v2.1/servers/3d057e51-38a4-445e-b2b5-ac76aa567ab3 => generated 1098 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:31:35.551436 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-53ee80e3-e010-4e13-bea1-2cce317a0ff9 req-effa28be-42a9-46ca-a809-5ad9427fbf32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58f32b46-f1a9-4860-a54b-b2f1a012fc18", "name": "network-vif-deleted", "tag": "20b3571c-10c9-40e0-a655-fbd88de173dd"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:31:35.589919 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-53ee80e3-e010-4e13-bea1-2cce317a0ff9 req-effa28be-42a9-46ca-a809-5ad9427fbf32 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:35.591297 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-53ee80e3-e010-4e13-bea1-2cce317a0ff9 req-effa28be-42a9-46ca-a809-5ad9427fbf32 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:35.591830 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-53ee80e3-e010-4e13-bea1-2cce317a0ff9 req-effa28be-42a9-46ca-a809-5ad9427fbf32 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:35.622723 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-53ee80e3-e010-4e13-bea1-2cce317a0ff9 req-effa28be-42a9-46ca-a809-5ad9427fbf32 service nova] Creating event network-vif-deleted:20b3571c-10c9-40e0-a655-fbd88de173dd for instance 58f32b46-f1a9-4860-a54b-b2f1a012fc18 on n-h1-860284-1 Oct 04 22:31:35.633338 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-53ee80e3-e010-4e13-bea1-2cce317a0ff9 req-effa28be-42a9-46ca-a809-5ad9427fbf32 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.200485 Oct 04 22:31:35.635416 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3663/6613] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:31:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:31:36.117246 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-2287bdd0-321f-4b9d-af60-592166367d2a tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:31:36.117970 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-2287bdd0-321f-4b9d-af60-592166367d2a tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: 58f32b46-f1a9-4860-a54b-b2f1a012fc18] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:31:36.131475 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2287bdd0-321f-4b9d-af60-592166367d2a tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:36.131993 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2287bdd0-321f-4b9d-af60-592166367d2a tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:36.132450 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2287bdd0-321f-4b9d-af60-592166367d2a tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:36.133181 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2287bdd0-321f-4b9d-af60-592166367d2a tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:36.133892 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2287bdd0-321f-4b9d-af60-592166367d2a tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:36.134095 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2287bdd0-321f-4b9d-af60-592166367d2a tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:36.219711 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-2287bdd0-321f-4b9d-af60-592166367d2a tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:31:36.235332 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-2287bdd0-321f-4b9d-af60-592166367d2a tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/58f32b46-f1a9-4860-a54b-b2f1a012fc18" status: 200 len: 1225 microversion: 2.1 time: 0.123090 Oct 04 22:31:36.252399 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3664/6614] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:31:36 2022] GET /compute/v2.1/servers/58f32b46-f1a9-4860-a54b-b2f1a012fc18 => generated 1225 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:31:36.355022 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-c132d292-aea9-45dd-8782-57a56ddd7481 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:31:36.356264 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-c132d292-aea9-45dd-8782-57a56ddd7481 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] [instance: a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:31:36.378508 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:31:36.381019 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c132d292-aea9-45dd-8782-57a56ddd7481 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:36.381542 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c132d292-aea9-45dd-8782-57a56ddd7481 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:36.382059 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c132d292-aea9-45dd-8782-57a56ddd7481 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:36.384017 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c132d292-aea9-45dd-8782-57a56ddd7481 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:36.384505 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c132d292-aea9-45dd-8782-57a56ddd7481 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:36.384953 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c132d292-aea9-45dd-8782-57a56ddd7481 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:36.638281 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-c132d292-aea9-45dd-8782-57a56ddd7481 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:31:36.651262 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-c132d292-aea9-45dd-8782-57a56ddd7481 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:31:36.655389 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-c132d292-aea9-45dd-8782-57a56ddd7481 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:31:36.656981 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-c132d292-aea9-45dd-8782-57a56ddd7481 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] 10.222.0.43 "GET /compute/v2.1/servers/a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4" status: 200 len: 1738 microversion: 2.20 time: 0.309092 Oct 04 22:31:36.658228 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3665/6615] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:31:36 2022] GET /compute/v2.1/servers/a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4 => generated 1738 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:31:36.664036 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-a14b90a1-fe1a-4e4a-853d-33037d52a817 tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:31:36.665078 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-a14b90a1-fe1a-4e4a-853d-33037d52a817 tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] [instance: 3d057e51-38a4-445e-b2b5-ac76aa567ab3] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:31:36.672513 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a14b90a1-fe1a-4e4a-853d-33037d52a817 tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:36.673125 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a14b90a1-fe1a-4e4a-853d-33037d52a817 tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:36.673656 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a14b90a1-fe1a-4e4a-853d-33037d52a817 tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:36.674612 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a14b90a1-fe1a-4e4a-853d-33037d52a817 tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:36.675212 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a14b90a1-fe1a-4e4a-853d-33037d52a817 tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:36.675736 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a14b90a1-fe1a-4e4a-853d-33037d52a817 tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:36.753543 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-a14b90a1-fe1a-4e4a-853d-33037d52a817 tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b6b686aa4874b9ca998e9e1898d8d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65234c569b29466d85335f035aa7ede4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:31:36.768005 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-a14b90a1-fe1a-4e4a-853d-33037d52a817 tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] 10.222.0.43 "GET /compute/v2.1/servers/3d057e51-38a4-445e-b2b5-ac76aa567ab3" status: 200 len: 1214 microversion: 2.1 time: 0.105742 Oct 04 22:31:36.768005 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3666/6616] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:31:36 2022] GET /compute/v2.1/servers/3d057e51-38a4-445e-b2b5-ac76aa567ab3 => generated 1214 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:31:37.260465 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-cd52fba5-cd6c-465a-91da-45654d1da18c tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:31:37.261113 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-cd52fba5-cd6c-465a-91da-45654d1da18c tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: 58f32b46-f1a9-4860-a54b-b2f1a012fc18] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:31:37.272914 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cd52fba5-cd6c-465a-91da-45654d1da18c tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:37.279323 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cd52fba5-cd6c-465a-91da-45654d1da18c tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:37.280828 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cd52fba5-cd6c-465a-91da-45654d1da18c tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:37.281625 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cd52fba5-cd6c-465a-91da-45654d1da18c tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:37.282123 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cd52fba5-cd6c-465a-91da-45654d1da18c tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:37.289360 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cd52fba5-cd6c-465a-91da-45654d1da18c tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:37.353860 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:31:37.485505 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-cd52fba5-cd6c-465a-91da-45654d1da18c tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:31:37.501468 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-cd52fba5-cd6c-465a-91da-45654d1da18c tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/58f32b46-f1a9-4860-a54b-b2f1a012fc18" status: 200 len: 1225 microversion: 2.1 time: 0.244815 Oct 04 22:31:37.502387 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3667/6617] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:31:37 2022] GET /compute/v2.1/servers/58f32b46-f1a9-4860-a54b-b2f1a012fc18 => generated 1225 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:31:37.688260 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e1bcaa68-e258-4190-970e-5c6b2e8b7374 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:31:37.689338 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-e1bcaa68-e258-4190-970e-5c6b2e8b7374 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] [instance: a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:31:37.704604 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e1bcaa68-e258-4190-970e-5c6b2e8b7374 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:37.710226 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e1bcaa68-e258-4190-970e-5c6b2e8b7374 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:37.711035 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e1bcaa68-e258-4190-970e-5c6b2e8b7374 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:37.712055 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e1bcaa68-e258-4190-970e-5c6b2e8b7374 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:37.715715 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e1bcaa68-e258-4190-970e-5c6b2e8b7374 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:37.716546 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e1bcaa68-e258-4190-970e-5c6b2e8b7374 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:37.947663 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-e1bcaa68-e258-4190-970e-5c6b2e8b7374 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:31:37.958781 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-e1bcaa68-e258-4190-970e-5c6b2e8b7374 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:31:37.960573 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-e1bcaa68-e258-4190-970e-5c6b2e8b7374 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:31:37.962059 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-e1bcaa68-e258-4190-970e-5c6b2e8b7374 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] 10.222.0.43 "GET /compute/v2.1/servers/a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4" status: 200 len: 1738 microversion: 2.20 time: 0.280127 Oct 04 22:31:37.963243 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3668/6618] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:31:37 2022] GET /compute/v2.1/servers/a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4 => generated 1738 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:31:37.971637 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-edea833b-40dd-4433-b43a-a6f10a90f28b tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:31:37.972534 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-edea833b-40dd-4433-b43a-a6f10a90f28b tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] [instance: 3d057e51-38a4-445e-b2b5-ac76aa567ab3] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:31:37.979879 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-edea833b-40dd-4433-b43a-a6f10a90f28b tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:37.980521 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-edea833b-40dd-4433-b43a-a6f10a90f28b tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:37.981399 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-edea833b-40dd-4433-b43a-a6f10a90f28b tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:37.982386 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-edea833b-40dd-4433-b43a-a6f10a90f28b tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:37.982986 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-edea833b-40dd-4433-b43a-a6f10a90f28b tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:37.983731 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-edea833b-40dd-4433-b43a-a6f10a90f28b tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:38.169910 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-edea833b-40dd-4433-b43a-a6f10a90f28b tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b6b686aa4874b9ca998e9e1898d8d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65234c569b29466d85335f035aa7ede4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:31:38.178741 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-edea833b-40dd-4433-b43a-a6f10a90f28b tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] 10.222.0.43 "GET /compute/v2.1/servers/3d057e51-38a4-445e-b2b5-ac76aa567ab3" status: 200 len: 1282 microversion: 2.1 time: 0.214344 Oct 04 22:31:38.182039 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3669/6619] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:31:37 2022] GET /compute/v2.1/servers/3d057e51-38a4-445e-b2b5-ac76aa567ab3 => generated 1282 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:31:38.530036 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-3b533d58-ecac-4593-bc40-ca2542d6ac55 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:31:38.530036 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-3b533d58-ecac-4593-bc40-ca2542d6ac55 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: 58f32b46-f1a9-4860-a54b-b2f1a012fc18] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:31:38.550497 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3b533d58-ecac-4593-bc40-ca2542d6ac55 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:38.551017 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3b533d58-ecac-4593-bc40-ca2542d6ac55 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:38.551476 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3b533d58-ecac-4593-bc40-ca2542d6ac55 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:38.552227 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3b533d58-ecac-4593-bc40-ca2542d6ac55 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:38.552682 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3b533d58-ecac-4593-bc40-ca2542d6ac55 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:38.553325 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3b533d58-ecac-4593-bc40-ca2542d6ac55 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:38.693152 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-3b533d58-ecac-4593-bc40-ca2542d6ac55 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:31:38.702652 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-3b533d58-ecac-4593-bc40-ca2542d6ac55 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/58f32b46-f1a9-4860-a54b-b2f1a012fc18" status: 200 len: 1225 microversion: 2.1 time: 0.177792 Oct 04 22:31:38.703268 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3670/6620] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:31:38 2022] GET /compute/v2.1/servers/58f32b46-f1a9-4860-a54b-b2f1a012fc18 => generated 1225 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:31:38.735669 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-b62176c4-0b9f-4ce0-8724-41b5eeafa8e4 req-f6f986e3-54da-4083-a052-0f55422871f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d057e51-38a4-445e-b2b5-ac76aa567ab3", "tag": "16094bc3-52b3-4c3a-b7df-df6c6623cad1"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:31:38.758919 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-b62176c4-0b9f-4ce0-8724-41b5eeafa8e4 req-f6f986e3-54da-4083-a052-0f55422871f9 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:38.759426 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-b62176c4-0b9f-4ce0-8724-41b5eeafa8e4 req-f6f986e3-54da-4083-a052-0f55422871f9 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:38.759885 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-b62176c4-0b9f-4ce0-8724-41b5eeafa8e4 req-f6f986e3-54da-4083-a052-0f55422871f9 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:38.772568 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-b62176c4-0b9f-4ce0-8724-41b5eeafa8e4 req-f6f986e3-54da-4083-a052-0f55422871f9 service nova] Creating event network-changed:16094bc3-52b3-4c3a-b7df-df6c6623cad1 for instance 3d057e51-38a4-445e-b2b5-ac76aa567ab3 on n-h2-860284-1 Oct 04 22:31:38.789245 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-b62176c4-0b9f-4ce0-8724-41b5eeafa8e4 req-f6f986e3-54da-4083-a052-0f55422871f9 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068069 Oct 04 22:31:38.790402 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3671/6621] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:31:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:31:38.992275 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e7fc0624-5286-4d3a-b50b-a9789784f918 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:31:38.994482 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-e7fc0624-5286-4d3a-b50b-a9789784f918 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] [instance: a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:31:39.006901 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e7fc0624-5286-4d3a-b50b-a9789784f918 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:39.007824 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e7fc0624-5286-4d3a-b50b-a9789784f918 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:39.008571 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e7fc0624-5286-4d3a-b50b-a9789784f918 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:39.009595 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e7fc0624-5286-4d3a-b50b-a9789784f918 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:39.010330 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e7fc0624-5286-4d3a-b50b-a9789784f918 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:39.011057 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e7fc0624-5286-4d3a-b50b-a9789784f918 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:39.213931 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-e7fc0624-5286-4d3a-b50b-a9789784f918 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:31:39.223228 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-e7fc0624-5286-4d3a-b50b-a9789784f918 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:31:39.224423 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-e7fc0624-5286-4d3a-b50b-a9789784f918 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:31:39.225773 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-e7fc0624-5286-4d3a-b50b-a9789784f918 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] 10.222.0.43 "GET /compute/v2.1/servers/a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4" status: 200 len: 1738 microversion: 2.20 time: 0.237868 Oct 04 22:31:39.234973 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3672/6622] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:31:38 2022] GET /compute/v2.1/servers/a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4 => generated 1738 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 22:31:39.234973 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-9a127666-bf67-4493-b9ab-24136a240d9e tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:31:39.234973 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-9a127666-bf67-4493-b9ab-24136a240d9e tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] [instance: 3d057e51-38a4-445e-b2b5-ac76aa567ab3] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:31:39.250987 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9a127666-bf67-4493-b9ab-24136a240d9e tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:39.253707 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9a127666-bf67-4493-b9ab-24136a240d9e tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:39.254810 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9a127666-bf67-4493-b9ab-24136a240d9e tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:39.255777 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9a127666-bf67-4493-b9ab-24136a240d9e tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:39.256866 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9a127666-bf67-4493-b9ab-24136a240d9e tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:39.257604 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9a127666-bf67-4493-b9ab-24136a240d9e tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:39.425203 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-9a127666-bf67-4493-b9ab-24136a240d9e tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b6b686aa4874b9ca998e9e1898d8d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65234c569b29466d85335f035aa7ede4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:31:39.435941 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-9a127666-bf67-4493-b9ab-24136a240d9e tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] 10.222.0.43 "GET /compute/v2.1/servers/3d057e51-38a4-445e-b2b5-ac76aa567ab3" status: 200 len: 1282 microversion: 2.1 time: 0.208404 Oct 04 22:31:39.437238 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3673/6623] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:31:39 2022] GET /compute/v2.1/servers/3d057e51-38a4-445e-b2b5-ac76aa567ab3 => generated 1282 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:31:39.727297 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-adf89e9a-71b8-4468-9229-8025ef305f56 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:31:39.729190 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-adf89e9a-71b8-4468-9229-8025ef305f56 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: 58f32b46-f1a9-4860-a54b-b2f1a012fc18] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:31:39.738719 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-adf89e9a-71b8-4468-9229-8025ef305f56 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:39.739844 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-adf89e9a-71b8-4468-9229-8025ef305f56 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:39.740538 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-adf89e9a-71b8-4468-9229-8025ef305f56 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:39.741534 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-adf89e9a-71b8-4468-9229-8025ef305f56 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:39.742268 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-adf89e9a-71b8-4468-9229-8025ef305f56 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:39.743150 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-adf89e9a-71b8-4468-9229-8025ef305f56 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:39.847930 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-adf89e9a-71b8-4468-9229-8025ef305f56 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:31:39.866600 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-adf89e9a-71b8-4468-9229-8025ef305f56 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/58f32b46-f1a9-4860-a54b-b2f1a012fc18" status: 200 len: 1225 microversion: 2.1 time: 0.143456 Oct 04 22:31:39.883201 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3674/6624] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:31:39 2022] GET /compute/v2.1/servers/58f32b46-f1a9-4860-a54b-b2f1a012fc18 => generated 1225 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:31:40.252110 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-0ac15db9-609a-4ecb-9731-beef849ac344 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:31:40.252771 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-0ac15db9-609a-4ecb-9731-beef849ac344 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] [instance: a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:31:40.259026 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0ac15db9-609a-4ecb-9731-beef849ac344 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:40.259597 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0ac15db9-609a-4ecb-9731-beef849ac344 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:40.260006 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0ac15db9-609a-4ecb-9731-beef849ac344 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:40.260724 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0ac15db9-609a-4ecb-9731-beef849ac344 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:40.261198 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0ac15db9-609a-4ecb-9731-beef849ac344 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:40.261648 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0ac15db9-609a-4ecb-9731-beef849ac344 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:40.394634 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-0ac15db9-609a-4ecb-9731-beef849ac344 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:31:40.403187 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-0ac15db9-609a-4ecb-9731-beef849ac344 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:31:40.404662 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-0ac15db9-609a-4ecb-9731-beef849ac344 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:31:40.405864 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-0ac15db9-609a-4ecb-9731-beef849ac344 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] 10.222.0.43 "GET /compute/v2.1/servers/a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4" status: 200 len: 1738 microversion: 2.20 time: 0.158040 Oct 04 22:31:40.406476 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3675/6625] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:31:40 2022] GET /compute/v2.1/servers/a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4 => generated 1738 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 22:31:40.462401 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-1a4e5b34-99d8-43de-b8e6-493ecbfcce76 tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:31:40.463037 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-1a4e5b34-99d8-43de-b8e6-493ecbfcce76 tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] [instance: 3d057e51-38a4-445e-b2b5-ac76aa567ab3] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:31:40.470066 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1a4e5b34-99d8-43de-b8e6-493ecbfcce76 tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:40.470618 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1a4e5b34-99d8-43de-b8e6-493ecbfcce76 tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:40.471083 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1a4e5b34-99d8-43de-b8e6-493ecbfcce76 tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:40.471814 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1a4e5b34-99d8-43de-b8e6-493ecbfcce76 tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:40.472290 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1a4e5b34-99d8-43de-b8e6-493ecbfcce76 tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:40.472733 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1a4e5b34-99d8-43de-b8e6-493ecbfcce76 tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:40.620288 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-1a4e5b34-99d8-43de-b8e6-493ecbfcce76 tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b6b686aa4874b9ca998e9e1898d8d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65234c569b29466d85335f035aa7ede4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:31:40.628879 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-1a4e5b34-99d8-43de-b8e6-493ecbfcce76 tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] 10.222.0.43 "GET /compute/v2.1/servers/3d057e51-38a4-445e-b2b5-ac76aa567ab3" status: 200 len: 1282 microversion: 2.1 time: 0.170360 Oct 04 22:31:40.629665 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3676/6626] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:31:40 2022] GET /compute/v2.1/servers/3d057e51-38a4-445e-b2b5-ac76aa567ab3 => generated 1282 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:31:40.892159 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-85540aed-21cd-458a-8127-0673f8196298 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:31:40.892829 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-85540aed-21cd-458a-8127-0673f8196298 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: 58f32b46-f1a9-4860-a54b-b2f1a012fc18] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:31:40.900387 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-85540aed-21cd-458a-8127-0673f8196298 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:40.900993 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-85540aed-21cd-458a-8127-0673f8196298 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:40.901523 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-85540aed-21cd-458a-8127-0673f8196298 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:40.902510 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-85540aed-21cd-458a-8127-0673f8196298 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:40.903162 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-85540aed-21cd-458a-8127-0673f8196298 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:40.903960 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-85540aed-21cd-458a-8127-0673f8196298 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:40.938723 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-85540aed-21cd-458a-8127-0673f8196298 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:40.939236 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-85540aed-21cd-458a-8127-0673f8196298 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:40.939693 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-85540aed-21cd-458a-8127-0673f8196298 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:40.940159 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.objects.instance [None req-85540aed-21cd-458a-8127-0673f8196298 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lazy-loading 'fault' on Instance uuid 58f32b46-f1a9-4860-a54b-b2f1a012fc18 {{(pid=134101) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 22:31:40.985878 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-85540aed-21cd-458a-8127-0673f8196298 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:31:40.994433 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-85540aed-21cd-458a-8127-0673f8196298 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/58f32b46-f1a9-4860-a54b-b2f1a012fc18" status: 200 len: 1230 microversion: 2.1 time: 0.107447 Oct 04 22:31:40.995340 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3677/6627] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:31:40 2022] GET /compute/v2.1/servers/58f32b46-f1a9-4860-a54b-b2f1a012fc18 => generated 1230 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:31:41.431466 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-333a521f-26c5-4ff1-ad5e-f07360d5f301 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:31:41.432248 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-333a521f-26c5-4ff1-ad5e-f07360d5f301 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] [instance: a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:31:41.438727 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-333a521f-26c5-4ff1-ad5e-f07360d5f301 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:41.439356 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-333a521f-26c5-4ff1-ad5e-f07360d5f301 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:41.439918 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-333a521f-26c5-4ff1-ad5e-f07360d5f301 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:41.440762 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-333a521f-26c5-4ff1-ad5e-f07360d5f301 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:41.441349 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-333a521f-26c5-4ff1-ad5e-f07360d5f301 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:41.441896 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-333a521f-26c5-4ff1-ad5e-f07360d5f301 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:41.579405 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-333a521f-26c5-4ff1-ad5e-f07360d5f301 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:31:41.588255 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-333a521f-26c5-4ff1-ad5e-f07360d5f301 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:31:41.590389 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-333a521f-26c5-4ff1-ad5e-f07360d5f301 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:31:41.591704 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-333a521f-26c5-4ff1-ad5e-f07360d5f301 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] 10.222.0.43 "GET /compute/v2.1/servers/a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4" status: 200 len: 1720 microversion: 2.20 time: 0.164276 Oct 04 22:31:41.592606 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3678/6628] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:31:41 2022] GET /compute/v2.1/servers/a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4 => generated 1720 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:31:41.653386 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-f526f5af-f3a1-4a05-87c2-4891b6afbe6a tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:31:41.654117 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-f526f5af-f3a1-4a05-87c2-4891b6afbe6a tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] [instance: 3d057e51-38a4-445e-b2b5-ac76aa567ab3] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:31:41.660161 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f526f5af-f3a1-4a05-87c2-4891b6afbe6a tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:41.660657 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f526f5af-f3a1-4a05-87c2-4891b6afbe6a tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:41.661104 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f526f5af-f3a1-4a05-87c2-4891b6afbe6a tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:41.661825 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f526f5af-f3a1-4a05-87c2-4891b6afbe6a tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:41.662273 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f526f5af-f3a1-4a05-87c2-4891b6afbe6a tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:41.662736 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f526f5af-f3a1-4a05-87c2-4891b6afbe6a tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:41.796169 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-f526f5af-f3a1-4a05-87c2-4891b6afbe6a tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b6b686aa4874b9ca998e9e1898d8d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65234c569b29466d85335f035aa7ede4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:31:41.804083 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-f526f5af-f3a1-4a05-87c2-4891b6afbe6a tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] 10.222.0.43 "GET /compute/v2.1/servers/3d057e51-38a4-445e-b2b5-ac76aa567ab3" status: 200 len: 1282 microversion: 2.1 time: 0.155446 Oct 04 22:31:41.804666 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3679/6629] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:31:41 2022] GET /compute/v2.1/servers/3d057e51-38a4-445e-b2b5-ac76aa567ab3 => generated 1282 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:31:42.018723 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-07815155-0ee1-4a29-9857-8eaad3d12a18 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:31:42.019364 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-07815155-0ee1-4a29-9857-8eaad3d12a18 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: 58f32b46-f1a9-4860-a54b-b2f1a012fc18] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:31:42.029607 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-07815155-0ee1-4a29-9857-8eaad3d12a18 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:42.030099 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-07815155-0ee1-4a29-9857-8eaad3d12a18 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:42.030591 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-07815155-0ee1-4a29-9857-8eaad3d12a18 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:42.031319 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-07815155-0ee1-4a29-9857-8eaad3d12a18 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:42.031797 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-07815155-0ee1-4a29-9857-8eaad3d12a18 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:42.032243 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-07815155-0ee1-4a29-9857-8eaad3d12a18 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:42.046814 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-07815155-0ee1-4a29-9857-8eaad3d12a18 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] HTTP exception thrown: Instance 58f32b46-f1a9-4860-a54b-b2f1a012fc18 could not be found. Oct 04 22:31:42.048492 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-07815155-0ee1-4a29-9857-8eaad3d12a18 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Request method failure captured: Oct 04 22:31:42.048492 n-d-860284-1 devstack@n-api.service[134101]: request: GET /compute/v2.1/servers/58f32b46-f1a9-4860-a54b-b2f1a012fc18 HTTP/1.1 Oct 04 22:31:42.048492 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 22:31:42.048492 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 22:31:42.048492 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 22:31:42.048492 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 22:31:42.048492 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 22:31:42.048492 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 22:31:42.048492 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 22:31:42.048492 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 22:31:42.048492 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPLFSMo9Eg9y9Lu454XN1MXkt5BE7HeG-NZdibz9nP5ZbzTcA5eo2fVm4gnqUdOUNPfyWilTQor2E780fAI_U9XTD5akzJ8-jVP8Fthos4syj8Pc9nJeMuZjrdlu2EkiFF5ef-9mxCQWUxHOpcRBLI1i5aPH69baR_Z4N2zYKYuhPE2w Oct 04 22:31:42.048492 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 22:31:42.048492 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 22:31:42.048492 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 22:31:42.048492 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 22:31:42.048492 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 22:31:42.048492 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 22:31:42.048492 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: 5c98a72bacce47c3947f9b0f0b4e85b6 Oct 04 22:31:42.048492 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-TestVolumeBootPattern-1701442207 Oct 04 22:31:42.048492 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 22:31:42.048492 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 22:31:42.048492 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5c98a72bacce47c3947f9b0f0b4e85b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_5c98a72bacce47c3947f9b0f0b4e85b6", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5c98a72bacce47c3947f9b0f0b4e85b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/5c98a72bacce47c3947f9b0f0b4e85b6"}]}] Oct 04 22:31:42.048492 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-TestVolumeBootPattern-1701442207 Oct 04 22:31:42.048492 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: 5c98a72bacce47c3947f9b0f0b4e85b6 Oct 04 22:31:42.048492 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-TestVolumeBootPattern-1701442207 Oct 04 22:31:42.048492 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-TestVolumeBootPattern-1701442207-project Oct 04 22:31:42.048492 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 22:31:42.048492 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 22:31:42.048492 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 99acad09db70445b93ae1d64a1b49ca3 Oct 04 22:31:42.048492 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-TestVolumeBootPattern-1701442207-project Oct 04 22:31:42.048492 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 22:31:42.048492 n-d-860284-1 devstack@n-api.service[134101]: exception: Instance 58f32b46-f1a9-4860-a54b-b2f1a012fc18 could not be found. Oct 04 22:31:42.048492 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': '58f32b46-f1a9-4860-a54b-b2f1a012fc18'} Oct 04 22:31:42.048492 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:31:42.048492 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:31:42.048492 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:31:42.048492 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:31:42.048492 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:31:42.048492 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:31:42.048492 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:31:42.048492 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:31:42.048492 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:31:42.048492 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:31:42.048492 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58f32b46-f1a9-4860-a54b-b2f1a012fc18 could not be found. Oct 04 22:31:42.048492 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:31:42.048492 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:31:42.048492 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:31:42.048492 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:31:42.048492 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:31:42.048492 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:31:42.048492 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:31:42.048492 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:31:42.048492 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:31:42.048492 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:31:42.048492 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:31:42.048492 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:31:42.048492 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:31:42.048492 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:31:42.048492 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:31:42.048492 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:31:42.048492 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58f32b46-f1a9-4860-a54b-b2f1a012fc18 could not be found. Oct 04 22:31:42.048492 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:31:42.048492 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:31:42.048492 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:31:42.057372 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:31:42.057372 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:31:42.057372 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:31:42.057372 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:31:42.057372 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:31:42.057372 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58f32b46-f1a9-4860-a54b-b2f1a012fc18 could not be found. Oct 04 22:31:42.057372 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:31:42.057372 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-07815155-0ee1-4a29-9857-8eaad3d12a18 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Returning 404 to user: Instance 58f32b46-f1a9-4860-a54b-b2f1a012fc18 could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:31:42.057372 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-07815155-0ee1-4a29-9857-8eaad3d12a18 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/58f32b46-f1a9-4860-a54b-b2f1a012fc18" status: 404 len: 111 microversion: 2.1 time: 0.035475 Oct 04 22:31:42.057372 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3680/6630] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:31:42 2022] GET /compute/v2.1/servers/58f32b46-f1a9-4860-a54b-b2f1a012fc18 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 22:31:42.620101 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-6e696a41-e167-4d73-aa39-7753fc954624 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:31:42.620738 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-6e696a41-e167-4d73-aa39-7753fc954624 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] [instance: a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:31:42.627669 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6e696a41-e167-4d73-aa39-7753fc954624 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:42.628182 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6e696a41-e167-4d73-aa39-7753fc954624 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:42.628644 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6e696a41-e167-4d73-aa39-7753fc954624 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:42.629381 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6e696a41-e167-4d73-aa39-7753fc954624 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:42.629858 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6e696a41-e167-4d73-aa39-7753fc954624 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:42.630308 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6e696a41-e167-4d73-aa39-7753fc954624 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:42.769600 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-6e696a41-e167-4d73-aa39-7753fc954624 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:31:42.778651 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-6e696a41-e167-4d73-aa39-7753fc954624 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:31:42.780139 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-6e696a41-e167-4d73-aa39-7753fc954624 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:31:42.781336 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-6e696a41-e167-4d73-aa39-7753fc954624 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] 10.222.0.43 "GET /compute/v2.1/servers/a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4" status: 200 len: 1720 microversion: 2.20 time: 0.165315 Oct 04 22:31:42.781911 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3681/6631] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:31:42 2022] GET /compute/v2.1/servers/a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4 => generated 1720 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 22:31:42.829226 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-1bbb7539-c58a-445e-9358-ddd07b456d20 tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:31:42.829968 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-1bbb7539-c58a-445e-9358-ddd07b456d20 tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] [instance: 3d057e51-38a4-445e-b2b5-ac76aa567ab3] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:31:42.836197 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1bbb7539-c58a-445e-9358-ddd07b456d20 tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:42.836801 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1bbb7539-c58a-445e-9358-ddd07b456d20 tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:42.837334 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1bbb7539-c58a-445e-9358-ddd07b456d20 tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:42.838125 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1bbb7539-c58a-445e-9358-ddd07b456d20 tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:42.838712 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1bbb7539-c58a-445e-9358-ddd07b456d20 tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:42.839228 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1bbb7539-c58a-445e-9358-ddd07b456d20 tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:42.977864 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-1bbb7539-c58a-445e-9358-ddd07b456d20 tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b6b686aa4874b9ca998e9e1898d8d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65234c569b29466d85335f035aa7ede4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:31:42.986021 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-1bbb7539-c58a-445e-9358-ddd07b456d20 tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] 10.222.0.43 "GET /compute/v2.1/servers/3d057e51-38a4-445e-b2b5-ac76aa567ab3" status: 200 len: 1282 microversion: 2.1 time: 0.161652 Oct 04 22:31:42.986673 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3682/6632] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:31:42 2022] GET /compute/v2.1/servers/3d057e51-38a4-445e-b2b5-ac76aa567ab3 => generated 1282 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:31:43.114222 n-d-860284-1 devstack@n-api.service[134102]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 22:31:43.114797 n-d-860284-1 devstack@n-api.service[134102]: Tue Oct 4 22:31:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.43) !!! Oct 04 22:31:43.806712 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-203e72ea-4abf-4c81-8851-ac0cd5e0cd43 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:31:43.808224 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-203e72ea-4abf-4c81-8851-ac0cd5e0cd43 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] [instance: a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:31:43.816673 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-203e72ea-4abf-4c81-8851-ac0cd5e0cd43 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:43.817648 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-203e72ea-4abf-4c81-8851-ac0cd5e0cd43 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:43.818451 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-203e72ea-4abf-4c81-8851-ac0cd5e0cd43 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:43.819604 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-203e72ea-4abf-4c81-8851-ac0cd5e0cd43 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:43.820256 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-203e72ea-4abf-4c81-8851-ac0cd5e0cd43 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:43.821035 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-203e72ea-4abf-4c81-8851-ac0cd5e0cd43 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:43.970248 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-203e72ea-4abf-4c81-8851-ac0cd5e0cd43 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:31:43.978856 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-203e72ea-4abf-4c81-8851-ac0cd5e0cd43 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:31:43.980335 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-203e72ea-4abf-4c81-8851-ac0cd5e0cd43 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:31:43.982075 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-203e72ea-4abf-4c81-8851-ac0cd5e0cd43 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] 10.222.0.43 "GET /compute/v2.1/servers/a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4" status: 200 len: 1663 microversion: 2.20 time: 0.179414 Oct 04 22:31:43.982759 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3683/6633] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:31:43 2022] GET /compute/v2.1/servers/a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4 => generated 1663 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 22:31:44.008977 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-9996a18b-4fa9-48ec-8ff2-2a71487f26e8 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a3895bd3-33a7-4ff9-a9b3-81a19313a36a"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:31:44.011686 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-9996a18b-4fa9-48ec-8ff2-2a71487f26e8 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] [instance: a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:31:44.020093 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9996a18b-4fa9-48ec-8ff2-2a71487f26e8 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:44.020677 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9996a18b-4fa9-48ec-8ff2-2a71487f26e8 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:44.021205 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9996a18b-4fa9-48ec-8ff2-2a71487f26e8 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:44.022002 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9996a18b-4fa9-48ec-8ff2-2a71487f26e8 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:44.022581 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9996a18b-4fa9-48ec-8ff2-2a71487f26e8 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:44.023100 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9996a18b-4fa9-48ec-8ff2-2a71487f26e8 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:44.109398 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:31:44.367211 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-9996a18b-4fa9-48ec-8ff2-2a71487f26e8 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] 10.222.0.43 "POST /compute/v2.1/servers/a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.362184 Oct 04 22:31:44.374142 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3684/6634] 10.222.0.43 () {62 vars in 1364 bytes} [Tue Oct 4 22:31:44 2022] POST /compute/v2.1/servers/a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4/os-volume_attachments => generated 188 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 22:31:44.374142 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-fc7b09c8-f7b5-4f66-ac2c-7d9f70a6e9dc tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:31:44.378719 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-fc7b09c8-f7b5-4f66-ac2c-7d9f70a6e9dc tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] [instance: 3d057e51-38a4-445e-b2b5-ac76aa567ab3] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:31:44.389365 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fc7b09c8-f7b5-4f66-ac2c-7d9f70a6e9dc tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:44.390187 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fc7b09c8-f7b5-4f66-ac2c-7d9f70a6e9dc tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:44.390846 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fc7b09c8-f7b5-4f66-ac2c-7d9f70a6e9dc tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:44.392083 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fc7b09c8-f7b5-4f66-ac2c-7d9f70a6e9dc tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:44.392785 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fc7b09c8-f7b5-4f66-ac2c-7d9f70a6e9dc tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:44.393394 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fc7b09c8-f7b5-4f66-ac2c-7d9f70a6e9dc tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:44.474641 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=2 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:31:44.576649 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-fc7b09c8-f7b5-4f66-ac2c-7d9f70a6e9dc tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b6b686aa4874b9ca998e9e1898d8d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65234c569b29466d85335f035aa7ede4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:31:44.585861 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-fc7b09c8-f7b5-4f66-ac2c-7d9f70a6e9dc tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] 10.222.0.43 "GET /compute/v2.1/servers/3d057e51-38a4-445e-b2b5-ac76aa567ab3" status: 200 len: 1282 microversion: 2.1 time: 0.216773 Oct 04 22:31:44.586599 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3685/6635] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:31:44 2022] GET /compute/v2.1/servers/3d057e51-38a4-445e-b2b5-ac76aa567ab3 => generated 1282 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:31:44.592529 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-c2b93f4c-3bb4-432f-a223-25ecd2ed592b tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:31:44.593048 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-c2b93f4c-3bb4-432f-a223-25ecd2ed592b tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] [instance: a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:31:44.599636 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c2b93f4c-3bb4-432f-a223-25ecd2ed592b tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:44.600430 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c2b93f4c-3bb4-432f-a223-25ecd2ed592b tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:44.601126 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c2b93f4c-3bb4-432f-a223-25ecd2ed592b tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:44.601868 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c2b93f4c-3bb4-432f-a223-25ecd2ed592b tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:44.602342 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c2b93f4c-3bb4-432f-a223-25ecd2ed592b tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:44.602859 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c2b93f4c-3bb4-432f-a223-25ecd2ed592b tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:44.862053 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-c2b93f4c-3bb4-432f-a223-25ecd2ed592b tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] 10.222.0.43 "DELETE /compute/v2.1/servers/a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4/os-volume_attachments/a3895bd3-33a7-4ff9-a9b3-81a19313a36a" status: 202 len: 0 microversion: 2.20 time: 0.274313 Oct 04 22:31:44.863149 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3686/6636] 10.222.0.43 () {60 vars in 1457 bytes} [Tue Oct 4 22:31:44 2022] DELETE /compute/v2.1/servers/a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4/os-volume_attachments/a3895bd3-33a7-4ff9-a9b3-81a19313a36a => generated 0 bytes in 276 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 22:31:44.940892 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-c9866e36-89b2-4957-ad08-e434862fb6d4 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:31:44.941510 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-c9866e36-89b2-4957-ad08-e434862fb6d4 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] [instance: a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:31:44.947720 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c9866e36-89b2-4957-ad08-e434862fb6d4 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:44.948221 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c9866e36-89b2-4957-ad08-e434862fb6d4 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:44.948688 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c9866e36-89b2-4957-ad08-e434862fb6d4 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:44.949456 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c9866e36-89b2-4957-ad08-e434862fb6d4 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:44.950110 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c9866e36-89b2-4957-ad08-e434862fb6d4 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:44.950588 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c9866e36-89b2-4957-ad08-e434862fb6d4 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:44.984162 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-c9866e36-89b2-4957-ad08-e434862fb6d4 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] [instance: a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=134101) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 04 22:31:45.084309 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-c9866e36-89b2-4957-ad08-e434862fb6d4 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] 10.222.0.43 "POST /compute/v2.1/servers/a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4/action" status: 202 len: 0 microversion: 2.20 time: 0.146798 Oct 04 22:31:45.085642 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3687/6637] 10.222.0.43 () {62 vars in 1319 bytes} [Tue Oct 4 22:31:44 2022] POST /compute/v2.1/servers/a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4/action => generated 0 bytes in 149 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 04 22:31:45.092039 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-e8c62e23-c2cd-4f29-aa0b-2d05eedd7590 req-8cbe7a34-f45e-49d8-80df-3cb4abf16e69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4", "name": "network-vif-unplugged", "status": "completed", "tag": "c125f571-485f-4f51-9daa-780c14a6c4c9"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:31:45.103114 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-e8c62e23-c2cd-4f29-aa0b-2d05eedd7590 req-8cbe7a34-f45e-49d8-80df-3cb4abf16e69 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:45.103633 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-e8c62e23-c2cd-4f29-aa0b-2d05eedd7590 req-8cbe7a34-f45e-49d8-80df-3cb4abf16e69 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:45.104653 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-e8c62e23-c2cd-4f29-aa0b-2d05eedd7590 req-8cbe7a34-f45e-49d8-80df-3cb4abf16e69 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:45.118109 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.compute.server_external_events [req-e8c62e23-c2cd-4f29-aa0b-2d05eedd7590 req-8cbe7a34-f45e-49d8-80df-3cb4abf16e69 service nova] Unable to find a host for instance a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4. Dropping event network-vif-unplugged {{(pid=134101) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 04 22:31:45.119177 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-e8c62e23-c2cd-4f29-aa0b-2d05eedd7590 req-8cbe7a34-f45e-49d8-80df-3cb4abf16e69 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.032468 Oct 04 22:31:45.119982 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3688/6638] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:31:45 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 34 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 04 22:31:45.126247 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-2745a2ac-318e-4951-a82b-8b663bb21f24 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:31:45.126801 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-2745a2ac-318e-4951-a82b-8b663bb21f24 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] [instance: a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:31:45.133476 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2745a2ac-318e-4951-a82b-8b663bb21f24 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:45.134009 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2745a2ac-318e-4951-a82b-8b663bb21f24 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:45.134545 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2745a2ac-318e-4951-a82b-8b663bb21f24 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:45.135271 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2745a2ac-318e-4951-a82b-8b663bb21f24 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:45.136435 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2745a2ac-318e-4951-a82b-8b663bb21f24 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:45.136435 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2745a2ac-318e-4951-a82b-8b663bb21f24 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:45.299344 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-2745a2ac-318e-4951-a82b-8b663bb21f24 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:31:45.313726 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-2745a2ac-318e-4951-a82b-8b663bb21f24 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:31:45.319172 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-2745a2ac-318e-4951-a82b-8b663bb21f24 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:31:45.320425 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-2745a2ac-318e-4951-a82b-8b663bb21f24 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] 10.222.0.43 "GET /compute/v2.1/servers/a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4" status: 200 len: 1671 microversion: 2.20 time: 0.199501 Oct 04 22:31:45.323696 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3689/6639] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:31:45 2022] GET /compute/v2.1/servers/a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4 => generated 1671 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:31:45.611357 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-06d8b1b9-0763-4e6a-8241-4fabfd888033 tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:31:45.612686 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-06d8b1b9-0763-4e6a-8241-4fabfd888033 tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] [instance: 3d057e51-38a4-445e-b2b5-ac76aa567ab3] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:31:45.618987 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=12 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:31:45.620702 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-06d8b1b9-0763-4e6a-8241-4fabfd888033 tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:45.623006 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-06d8b1b9-0763-4e6a-8241-4fabfd888033 tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:45.623655 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-06d8b1b9-0763-4e6a-8241-4fabfd888033 tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:45.624546 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-06d8b1b9-0763-4e6a-8241-4fabfd888033 tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:45.625185 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-06d8b1b9-0763-4e6a-8241-4fabfd888033 tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:45.625872 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-06d8b1b9-0763-4e6a-8241-4fabfd888033 tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:45.893938 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-06d8b1b9-0763-4e6a-8241-4fabfd888033 tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b6b686aa4874b9ca998e9e1898d8d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65234c569b29466d85335f035aa7ede4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:31:45.905918 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-06d8b1b9-0763-4e6a-8241-4fabfd888033 tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] 10.222.0.43 "GET /compute/v2.1/servers/3d057e51-38a4-445e-b2b5-ac76aa567ab3" status: 200 len: 1282 microversion: 2.1 time: 0.300361 Oct 04 22:31:45.906658 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3690/6640] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:31:45 2022] GET /compute/v2.1/servers/3d057e51-38a4-445e-b2b5-ac76aa567ab3 => generated 1282 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:31:46.352613 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-ffc51655-25e6-4585-a001-6d4a11b73d33 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:31:46.353233 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-ffc51655-25e6-4585-a001-6d4a11b73d33 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] [instance: a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:31:46.360199 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ffc51655-25e6-4585-a001-6d4a11b73d33 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:46.360699 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ffc51655-25e6-4585-a001-6d4a11b73d33 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:46.361146 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ffc51655-25e6-4585-a001-6d4a11b73d33 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:46.361849 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ffc51655-25e6-4585-a001-6d4a11b73d33 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:46.362318 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ffc51655-25e6-4585-a001-6d4a11b73d33 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:46.362783 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ffc51655-25e6-4585-a001-6d4a11b73d33 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:46.531927 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-ffc51655-25e6-4585-a001-6d4a11b73d33 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:31:46.541096 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-ffc51655-25e6-4585-a001-6d4a11b73d33 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:31:46.543549 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-ffc51655-25e6-4585-a001-6d4a11b73d33 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:31:46.545315 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-ffc51655-25e6-4585-a001-6d4a11b73d33 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] 10.222.0.43 "GET /compute/v2.1/servers/a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4" status: 200 len: 1729 microversion: 2.20 time: 0.196702 Oct 04 22:31:46.546490 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3691/6641] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:31:46 2022] GET /compute/v2.1/servers/a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4 => generated 1729 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 22:31:46.929397 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-fffaff07-4229-4bd8-97af-aed662f8ea2c tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:31:46.930967 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-fffaff07-4229-4bd8-97af-aed662f8ea2c tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] [instance: 3d057e51-38a4-445e-b2b5-ac76aa567ab3] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:31:46.939590 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fffaff07-4229-4bd8-97af-aed662f8ea2c tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:46.940471 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fffaff07-4229-4bd8-97af-aed662f8ea2c tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:46.941185 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fffaff07-4229-4bd8-97af-aed662f8ea2c tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:46.942169 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fffaff07-4229-4bd8-97af-aed662f8ea2c tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:46.942900 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fffaff07-4229-4bd8-97af-aed662f8ea2c tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:46.943578 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fffaff07-4229-4bd8-97af-aed662f8ea2c tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:47.097418 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-fffaff07-4229-4bd8-97af-aed662f8ea2c tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b6b686aa4874b9ca998e9e1898d8d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65234c569b29466d85335f035aa7ede4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:31:47.106577 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-fffaff07-4229-4bd8-97af-aed662f8ea2c tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] 10.222.0.43 "GET /compute/v2.1/servers/3d057e51-38a4-445e-b2b5-ac76aa567ab3" status: 200 len: 1270 microversion: 2.1 time: 0.180918 Oct 04 22:31:47.107650 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3692/6642] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:31:46 2022] GET /compute/v2.1/servers/3d057e51-38a4-445e-b2b5-ac76aa567ab3 => generated 1270 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:31:47.572761 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-163f0302-bedb-410c-ac95-f9f368426bf0 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:31:47.573353 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-163f0302-bedb-410c-ac95-f9f368426bf0 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] [instance: a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:31:47.580109 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-163f0302-bedb-410c-ac95-f9f368426bf0 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:47.580614 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-163f0302-bedb-410c-ac95-f9f368426bf0 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:47.581059 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-163f0302-bedb-410c-ac95-f9f368426bf0 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:47.581802 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-163f0302-bedb-410c-ac95-f9f368426bf0 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:47.582271 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-163f0302-bedb-410c-ac95-f9f368426bf0 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:47.582909 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-163f0302-bedb-410c-ac95-f9f368426bf0 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:47.704974 n-d-860284-1 devstack@n-api.service[134102]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 22:31:47.705517 n-d-860284-1 devstack@n-api.service[134102]: Tue Oct 4 22:31:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.43) !!! Oct 04 22:31:47.737394 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-163f0302-bedb-410c-ac95-f9f368426bf0 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:31:47.746668 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-163f0302-bedb-410c-ac95-f9f368426bf0 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:31:47.748391 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-163f0302-bedb-410c-ac95-f9f368426bf0 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:31:47.749677 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-163f0302-bedb-410c-ac95-f9f368426bf0 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] 10.222.0.43 "GET /compute/v2.1/servers/a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4" status: 200 len: 1729 microversion: 2.20 time: 0.181016 Oct 04 22:31:47.750256 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3693/6643] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:31:47 2022] GET /compute/v2.1/servers/a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4 => generated 1729 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 22:31:47.792812 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-71f7aa62-a6b7-4c30-b9f5-2d2c9044fbee req-a679b108-b200-4468-ab19-a06350bf266d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4", "tag": "c125f571-485f-4f51-9daa-780c14a6c4c9"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:31:47.803199 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-71f7aa62-a6b7-4c30-b9f5-2d2c9044fbee req-a679b108-b200-4468-ab19-a06350bf266d service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:47.803691 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-71f7aa62-a6b7-4c30-b9f5-2d2c9044fbee req-a679b108-b200-4468-ab19-a06350bf266d service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:47.805770 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-71f7aa62-a6b7-4c30-b9f5-2d2c9044fbee req-a679b108-b200-4468-ab19-a06350bf266d service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:47.818019 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-71f7aa62-a6b7-4c30-b9f5-2d2c9044fbee req-a679b108-b200-4468-ab19-a06350bf266d service nova] Creating event network-changed:c125f571-485f-4f51-9daa-780c14a6c4c9 for instance a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4 on n-h1-860284-1 Oct 04 22:31:47.824733 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-71f7aa62-a6b7-4c30-b9f5-2d2c9044fbee req-a679b108-b200-4468-ab19-a06350bf266d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036235 Oct 04 22:31:47.826882 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3694/6644] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:31:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:31:48.136369 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-1961da77-b85a-4587-8910-1d64598a1ebb tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:31:48.137783 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-1961da77-b85a-4587-8910-1d64598a1ebb tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] [instance: 3d057e51-38a4-445e-b2b5-ac76aa567ab3] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:31:48.144534 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1961da77-b85a-4587-8910-1d64598a1ebb tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:48.145055 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1961da77-b85a-4587-8910-1d64598a1ebb tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:48.145516 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1961da77-b85a-4587-8910-1d64598a1ebb tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:48.146242 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1961da77-b85a-4587-8910-1d64598a1ebb tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:48.146795 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1961da77-b85a-4587-8910-1d64598a1ebb tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:48.147245 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1961da77-b85a-4587-8910-1d64598a1ebb tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:48.288248 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-1961da77-b85a-4587-8910-1d64598a1ebb tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b6b686aa4874b9ca998e9e1898d8d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65234c569b29466d85335f035aa7ede4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:31:48.296415 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-1961da77-b85a-4587-8910-1d64598a1ebb tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] 10.222.0.43 "GET /compute/v2.1/servers/3d057e51-38a4-445e-b2b5-ac76aa567ab3" status: 200 len: 1270 microversion: 2.1 time: 0.165334 Oct 04 22:31:48.296996 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3695/6645] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:31:48 2022] GET /compute/v2.1/servers/3d057e51-38a4-445e-b2b5-ac76aa567ab3 => generated 1270 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:31:48.778403 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-76610936-66a4-46a8-b176-be3d197402e9 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:31:48.779331 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-76610936-66a4-46a8-b176-be3d197402e9 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] [instance: a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:31:48.788290 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-76610936-66a4-46a8-b176-be3d197402e9 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:48.795096 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-76610936-66a4-46a8-b176-be3d197402e9 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:48.795802 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-76610936-66a4-46a8-b176-be3d197402e9 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:48.797612 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-76610936-66a4-46a8-b176-be3d197402e9 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:48.798855 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-76610936-66a4-46a8-b176-be3d197402e9 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:48.799500 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-76610936-66a4-46a8-b176-be3d197402e9 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:49.077968 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-76610936-66a4-46a8-b176-be3d197402e9 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:31:49.087021 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-76610936-66a4-46a8-b176-be3d197402e9 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:31:49.088508 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-76610936-66a4-46a8-b176-be3d197402e9 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:31:49.090317 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-76610936-66a4-46a8-b176-be3d197402e9 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] 10.222.0.43 "GET /compute/v2.1/servers/a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4" status: 200 len: 1729 microversion: 2.20 time: 0.316433 Oct 04 22:31:49.099092 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3696/6646] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:31:48 2022] GET /compute/v2.1/servers/a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4 => generated 1729 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 22:31:49.320574 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-09b4ea11-116a-49a2-8202-446a5f924068 tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:31:49.322086 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-09b4ea11-116a-49a2-8202-446a5f924068 tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] [instance: 3d057e51-38a4-445e-b2b5-ac76aa567ab3] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:31:49.332386 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-09b4ea11-116a-49a2-8202-446a5f924068 tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:49.333045 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-09b4ea11-116a-49a2-8202-446a5f924068 tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:49.333720 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-09b4ea11-116a-49a2-8202-446a5f924068 tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:49.334701 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-09b4ea11-116a-49a2-8202-446a5f924068 tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:49.335384 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-09b4ea11-116a-49a2-8202-446a5f924068 tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:49.336155 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-09b4ea11-116a-49a2-8202-446a5f924068 tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:49.364875 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=9,nova_cell1:INSERT=5 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:31:49.614189 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-09b4ea11-116a-49a2-8202-446a5f924068 tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b6b686aa4874b9ca998e9e1898d8d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65234c569b29466d85335f035aa7ede4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:31:49.627059 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-09b4ea11-116a-49a2-8202-446a5f924068 tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] 10.222.0.43 "GET /compute/v2.1/servers/3d057e51-38a4-445e-b2b5-ac76aa567ab3" status: 200 len: 1270 microversion: 2.1 time: 0.310387 Oct 04 22:31:49.628167 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3697/6647] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:31:49 2022] GET /compute/v2.1/servers/3d057e51-38a4-445e-b2b5-ac76aa567ab3 => generated 1270 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:31:49.896419 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-b3c68158-b072-4214-93d5-2b4da03e5c3a tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:31:49.897167 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-b3c68158-b072-4214-93d5-2b4da03e5c3a tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: f1dea61d-0ca6-457d-9d1b-3aff96427d52] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:31:49.904399 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b3c68158-b072-4214-93d5-2b4da03e5c3a tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:49.905237 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b3c68158-b072-4214-93d5-2b4da03e5c3a tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:49.905860 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b3c68158-b072-4214-93d5-2b4da03e5c3a tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:49.906797 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b3c68158-b072-4214-93d5-2b4da03e5c3a tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:49.907431 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b3c68158-b072-4214-93d5-2b4da03e5c3a tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:49.908038 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b3c68158-b072-4214-93d5-2b4da03e5c3a tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:49.939381 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-b3c68158-b072-4214-93d5-2b4da03e5c3a tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: f1dea61d-0ca6-457d-9d1b-3aff96427d52] Going to try to terminate instance {{(pid=134101) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 22:31:50.038996 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-b3c68158-b072-4214-93d5-2b4da03e5c3a tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "DELETE /compute/v2.1/servers/f1dea61d-0ca6-457d-9d1b-3aff96427d52" status: 204 len: 0 microversion: 2.1 time: 0.146201 Oct 04 22:31:50.040795 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3698/6648] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 22:31:49 2022] DELETE /compute/v2.1/servers/f1dea61d-0ca6-457d-9d1b-3aff96427d52 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 22:31:50.047773 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-629938d8-52eb-4fb6-8b3a-e14170fa4f13 req-82fe0116-b7c6-4ba5-9e3e-cf78a73572d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1dea61d-0ca6-457d-9d1b-3aff96427d52", "tag": "4a95490d-6ee2-4e08-a931-9210ae4b290c"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:31:50.070023 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-629938d8-52eb-4fb6-8b3a-e14170fa4f13 req-82fe0116-b7c6-4ba5-9e3e-cf78a73572d2 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:50.075378 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-629938d8-52eb-4fb6-8b3a-e14170fa4f13 req-82fe0116-b7c6-4ba5-9e3e-cf78a73572d2 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:50.075970 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-629938d8-52eb-4fb6-8b3a-e14170fa4f13 req-82fe0116-b7c6-4ba5-9e3e-cf78a73572d2 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:50.089595 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-629938d8-52eb-4fb6-8b3a-e14170fa4f13 req-82fe0116-b7c6-4ba5-9e3e-cf78a73572d2 service nova] Creating event network-changed:4a95490d-6ee2-4e08-a931-9210ae4b290c for instance f1dea61d-0ca6-457d-9d1b-3aff96427d52 on n-h1-860284-1 Oct 04 22:31:50.094463 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-629938d8-52eb-4fb6-8b3a-e14170fa4f13 req-82fe0116-b7c6-4ba5-9e3e-cf78a73572d2 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051876 Oct 04 22:31:50.095063 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3699/6649] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:31:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:31:50.100146 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-824543d3-9dea-4ac5-b0a5-805b9b75343e tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:31:50.100860 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-824543d3-9dea-4ac5-b0a5-805b9b75343e tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: f1dea61d-0ca6-457d-9d1b-3aff96427d52] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:31:50.107822 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-824543d3-9dea-4ac5-b0a5-805b9b75343e tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:50.108333 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-824543d3-9dea-4ac5-b0a5-805b9b75343e tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:50.108804 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-824543d3-9dea-4ac5-b0a5-805b9b75343e tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:50.109710 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-824543d3-9dea-4ac5-b0a5-805b9b75343e tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:50.110106 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-824543d3-9dea-4ac5-b0a5-805b9b75343e tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:50.110695 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-824543d3-9dea-4ac5-b0a5-805b9b75343e tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:50.329410 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-824543d3-9dea-4ac5-b0a5-805b9b75343e tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:31:50.341463 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-824543d3-9dea-4ac5-b0a5-805b9b75343e tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/f1dea61d-0ca6-457d-9d1b-3aff96427d52" status: 200 len: 1578 microversion: 2.1 time: 0.245159 Oct 04 22:31:50.342531 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3700/6650] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:31:50 2022] GET /compute/v2.1/servers/f1dea61d-0ca6-457d-9d1b-3aff96427d52 => generated 1578 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:31:50.347552 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-709676ff-6fb2-4320-a325-6add638f2f1e tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:31:50.348241 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-709676ff-6fb2-4320-a325-6add638f2f1e tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] [instance: a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:31:50.357203 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-709676ff-6fb2-4320-a325-6add638f2f1e tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:50.357836 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-709676ff-6fb2-4320-a325-6add638f2f1e tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:50.358397 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-709676ff-6fb2-4320-a325-6add638f2f1e tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:50.359841 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-709676ff-6fb2-4320-a325-6add638f2f1e tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:50.360402 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-709676ff-6fb2-4320-a325-6add638f2f1e tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:50.361262 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-709676ff-6fb2-4320-a325-6add638f2f1e tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:50.548026 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-709676ff-6fb2-4320-a325-6add638f2f1e tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:31:50.556727 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-709676ff-6fb2-4320-a325-6add638f2f1e tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:31:50.558204 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-709676ff-6fb2-4320-a325-6add638f2f1e tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:31:50.559477 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-709676ff-6fb2-4320-a325-6add638f2f1e tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] 10.222.0.43 "GET /compute/v2.1/servers/a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4" status: 200 len: 1729 microversion: 2.20 time: 0.215688 Oct 04 22:31:50.560374 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3701/6651] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:31:50 2022] GET /compute/v2.1/servers/a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4 => generated 1729 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:31:50.651092 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-eb95a46c-2aa1-4ac4-b5e9-3d8081874c9a tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:31:50.651809 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-eb95a46c-2aa1-4ac4-b5e9-3d8081874c9a tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] [instance: 3d057e51-38a4-445e-b2b5-ac76aa567ab3] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:31:50.658499 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-eb95a46c-2aa1-4ac4-b5e9-3d8081874c9a tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:50.659076 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-eb95a46c-2aa1-4ac4-b5e9-3d8081874c9a tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:50.659605 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-eb95a46c-2aa1-4ac4-b5e9-3d8081874c9a tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:50.660322 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-eb95a46c-2aa1-4ac4-b5e9-3d8081874c9a tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:50.660795 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-eb95a46c-2aa1-4ac4-b5e9-3d8081874c9a tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:50.661243 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-eb95a46c-2aa1-4ac4-b5e9-3d8081874c9a tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:50.845611 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-eb95a46c-2aa1-4ac4-b5e9-3d8081874c9a tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b6b686aa4874b9ca998e9e1898d8d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65234c569b29466d85335f035aa7ede4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:31:50.859312 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-eb95a46c-2aa1-4ac4-b5e9-3d8081874c9a tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] 10.222.0.43 "GET /compute/v2.1/servers/3d057e51-38a4-445e-b2b5-ac76aa567ab3" status: 200 len: 1270 microversion: 2.1 time: 0.212065 Oct 04 22:31:50.861189 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3702/6652] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:31:50 2022] GET /compute/v2.1/servers/3d057e51-38a4-445e-b2b5-ac76aa567ab3 => generated 1270 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:31:51.369816 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-0d2b06dc-42a3-4b88-8c65-9ac61809f216 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:31:51.370583 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-0d2b06dc-42a3-4b88-8c65-9ac61809f216 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: f1dea61d-0ca6-457d-9d1b-3aff96427d52] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:31:51.379620 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0d2b06dc-42a3-4b88-8c65-9ac61809f216 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:51.380238 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0d2b06dc-42a3-4b88-8c65-9ac61809f216 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:51.380696 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0d2b06dc-42a3-4b88-8c65-9ac61809f216 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:51.381721 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0d2b06dc-42a3-4b88-8c65-9ac61809f216 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:51.382579 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0d2b06dc-42a3-4b88-8c65-9ac61809f216 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:51.383026 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0d2b06dc-42a3-4b88-8c65-9ac61809f216 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:51.563983 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-0d2b06dc-42a3-4b88-8c65-9ac61809f216 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:31:51.574445 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-0d2b06dc-42a3-4b88-8c65-9ac61809f216 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/f1dea61d-0ca6-457d-9d1b-3aff96427d52" status: 200 len: 1578 microversion: 2.1 time: 0.208601 Oct 04 22:31:51.586893 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3703/6653] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:31:51 2022] GET /compute/v2.1/servers/f1dea61d-0ca6-457d-9d1b-3aff96427d52 => generated 1578 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:31:51.599140 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-d142490d-3db2-4632-a37e-49889ce2cf29 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:31:51.600229 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-d142490d-3db2-4632-a37e-49889ce2cf29 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] [instance: a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:31:51.607656 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d142490d-3db2-4632-a37e-49889ce2cf29 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:51.608172 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d142490d-3db2-4632-a37e-49889ce2cf29 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:51.608628 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d142490d-3db2-4632-a37e-49889ce2cf29 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:51.609369 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d142490d-3db2-4632-a37e-49889ce2cf29 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:51.609847 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d142490d-3db2-4632-a37e-49889ce2cf29 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:51.610285 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d142490d-3db2-4632-a37e-49889ce2cf29 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:51.777599 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-d142490d-3db2-4632-a37e-49889ce2cf29 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:31:51.787033 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-d142490d-3db2-4632-a37e-49889ce2cf29 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:31:51.788672 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-d142490d-3db2-4632-a37e-49889ce2cf29 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:31:51.790036 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-d142490d-3db2-4632-a37e-49889ce2cf29 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] 10.222.0.43 "GET /compute/v2.1/servers/a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4" status: 200 len: 1729 microversion: 2.20 time: 0.201636 Oct 04 22:31:51.790776 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3704/6654] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:31:51 2022] GET /compute/v2.1/servers/a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4 => generated 1729 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:31:51.885242 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-7e04c96b-21a0-474e-8bd3-83ab84233cea tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:31:51.885892 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-7e04c96b-21a0-474e-8bd3-83ab84233cea tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] [instance: 3d057e51-38a4-445e-b2b5-ac76aa567ab3] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:31:51.892261 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7e04c96b-21a0-474e-8bd3-83ab84233cea tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:51.892756 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7e04c96b-21a0-474e-8bd3-83ab84233cea tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:51.893204 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7e04c96b-21a0-474e-8bd3-83ab84233cea tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:51.893912 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7e04c96b-21a0-474e-8bd3-83ab84233cea tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:51.894394 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7e04c96b-21a0-474e-8bd3-83ab84233cea tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:51.894842 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7e04c96b-21a0-474e-8bd3-83ab84233cea tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:52.048917 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-7e04c96b-21a0-474e-8bd3-83ab84233cea tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b6b686aa4874b9ca998e9e1898d8d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65234c569b29466d85335f035aa7ede4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:31:52.056833 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-7e04c96b-21a0-474e-8bd3-83ab84233cea tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] 10.222.0.43 "GET /compute/v2.1/servers/3d057e51-38a4-445e-b2b5-ac76aa567ab3" status: 200 len: 1270 microversion: 2.1 time: 0.175563 Oct 04 22:31:52.057398 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3705/6655] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:31:51 2022] GET /compute/v2.1/servers/3d057e51-38a4-445e-b2b5-ac76aa567ab3 => generated 1270 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:31:52.602921 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-f0b0c686-87ef-4531-819a-617113c8b12f tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:31:52.603648 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-f0b0c686-87ef-4531-819a-617113c8b12f tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: f1dea61d-0ca6-457d-9d1b-3aff96427d52] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:31:52.610678 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f0b0c686-87ef-4531-819a-617113c8b12f tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:52.611185 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f0b0c686-87ef-4531-819a-617113c8b12f tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:52.611636 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f0b0c686-87ef-4531-819a-617113c8b12f tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:52.612354 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f0b0c686-87ef-4531-819a-617113c8b12f tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:52.612823 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f0b0c686-87ef-4531-819a-617113c8b12f tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:52.613279 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f0b0c686-87ef-4531-819a-617113c8b12f tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:52.721144 n-d-860284-1 devstack@n-api.service[134102]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 22:31:52.722388 n-d-860284-1 devstack@n-api.service[134102]: Tue Oct 4 22:31:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.43) !!! Oct 04 22:31:52.784460 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-f0b0c686-87ef-4531-819a-617113c8b12f tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:31:52.797103 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-f0b0c686-87ef-4531-819a-617113c8b12f tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/f1dea61d-0ca6-457d-9d1b-3aff96427d52" status: 200 len: 1578 microversion: 2.1 time: 0.197970 Oct 04 22:31:52.809633 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3706/6656] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:31:52 2022] GET /compute/v2.1/servers/f1dea61d-0ca6-457d-9d1b-3aff96427d52 => generated 1578 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:31:52.825302 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-d3456be2-a8ab-4f41-88ed-1e378bc4bff1 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:31:52.826022 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-d3456be2-a8ab-4f41-88ed-1e378bc4bff1 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] [instance: a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:31:52.832301 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d3456be2-a8ab-4f41-88ed-1e378bc4bff1 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:52.832807 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d3456be2-a8ab-4f41-88ed-1e378bc4bff1 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:52.833261 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d3456be2-a8ab-4f41-88ed-1e378bc4bff1 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:52.833975 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d3456be2-a8ab-4f41-88ed-1e378bc4bff1 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:52.834482 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d3456be2-a8ab-4f41-88ed-1e378bc4bff1 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:52.834929 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d3456be2-a8ab-4f41-88ed-1e378bc4bff1 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:52.981131 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-d3456be2-a8ab-4f41-88ed-1e378bc4bff1 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:31:52.989909 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-d3456be2-a8ab-4f41-88ed-1e378bc4bff1 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:31:52.991405 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-d3456be2-a8ab-4f41-88ed-1e378bc4bff1 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:31:52.992614 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-d3456be2-a8ab-4f41-88ed-1e378bc4bff1 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] 10.222.0.43 "GET /compute/v2.1/servers/a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4" status: 200 len: 1729 microversion: 2.20 time: 0.178389 Oct 04 22:31:52.993169 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3707/6657] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:31:52 2022] GET /compute/v2.1/servers/a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4 => generated 1729 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:31:53.080830 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e8370dff-4072-4bfe-b873-b8dde07b1f32 tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:31:53.081460 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-e8370dff-4072-4bfe-b873-b8dde07b1f32 tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] [instance: 3d057e51-38a4-445e-b2b5-ac76aa567ab3] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:31:53.087554 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e8370dff-4072-4bfe-b873-b8dde07b1f32 tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:53.088058 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e8370dff-4072-4bfe-b873-b8dde07b1f32 tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:53.088511 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e8370dff-4072-4bfe-b873-b8dde07b1f32 tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:53.089223 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e8370dff-4072-4bfe-b873-b8dde07b1f32 tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:53.089781 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e8370dff-4072-4bfe-b873-b8dde07b1f32 tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:53.090254 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e8370dff-4072-4bfe-b873-b8dde07b1f32 tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:53.243446 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-e8370dff-4072-4bfe-b873-b8dde07b1f32 tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b6b686aa4874b9ca998e9e1898d8d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65234c569b29466d85335f035aa7ede4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:31:53.251998 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-e8370dff-4072-4bfe-b873-b8dde07b1f32 tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] 10.222.0.43 "GET /compute/v2.1/servers/3d057e51-38a4-445e-b2b5-ac76aa567ab3" status: 200 len: 1270 microversion: 2.1 time: 0.175133 Oct 04 22:31:53.252580 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3708/6658] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:31:53 2022] GET /compute/v2.1/servers/3d057e51-38a4-445e-b2b5-ac76aa567ab3 => generated 1270 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:31:53.828426 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-bf08e9ce-48db-4ff4-a0f9-301ef31718ae tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:31:53.829823 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-bf08e9ce-48db-4ff4-a0f9-301ef31718ae tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: f1dea61d-0ca6-457d-9d1b-3aff96427d52] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:31:53.834055 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:31:53.837791 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bf08e9ce-48db-4ff4-a0f9-301ef31718ae tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:53.838303 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bf08e9ce-48db-4ff4-a0f9-301ef31718ae tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:53.838791 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bf08e9ce-48db-4ff4-a0f9-301ef31718ae tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:53.840122 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bf08e9ce-48db-4ff4-a0f9-301ef31718ae tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:53.840589 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bf08e9ce-48db-4ff4-a0f9-301ef31718ae tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:53.841044 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bf08e9ce-48db-4ff4-a0f9-301ef31718ae tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:53.999543 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-bf08e9ce-48db-4ff4-a0f9-301ef31718ae tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:31:54.007519 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-bf08e9ce-48db-4ff4-a0f9-301ef31718ae tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/f1dea61d-0ca6-457d-9d1b-3aff96427d52" status: 200 len: 1578 microversion: 2.1 time: 0.183474 Oct 04 22:31:54.008089 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3709/6659] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:31:53 2022] GET /compute/v2.1/servers/f1dea61d-0ca6-457d-9d1b-3aff96427d52 => generated 1578 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:31:54.029444 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-3b0ba214-159f-406f-91f7-a684305192c1 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:31:54.030075 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-3b0ba214-159f-406f-91f7-a684305192c1 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] [instance: a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:31:54.036429 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3b0ba214-159f-406f-91f7-a684305192c1 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:54.036945 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3b0ba214-159f-406f-91f7-a684305192c1 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:54.037386 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3b0ba214-159f-406f-91f7-a684305192c1 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:54.038215 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3b0ba214-159f-406f-91f7-a684305192c1 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:54.038736 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3b0ba214-159f-406f-91f7-a684305192c1 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:54.039157 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3b0ba214-159f-406f-91f7-a684305192c1 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:54.183313 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-3b0ba214-159f-406f-91f7-a684305192c1 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:31:54.192489 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-3b0ba214-159f-406f-91f7-a684305192c1 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:31:54.194098 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-3b0ba214-159f-406f-91f7-a684305192c1 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:31:54.195345 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-3b0ba214-159f-406f-91f7-a684305192c1 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] 10.222.0.43 "GET /compute/v2.1/servers/a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4" status: 200 len: 1729 microversion: 2.20 time: 0.175776 Oct 04 22:31:54.196258 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3710/6660] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:31:54 2022] GET /compute/v2.1/servers/a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4 => generated 1729 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:31:54.275039 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-8b7d6f9c-17bb-4333-8907-30e292062022 tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:31:54.275800 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-8b7d6f9c-17bb-4333-8907-30e292062022 tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] [instance: 3d057e51-38a4-445e-b2b5-ac76aa567ab3] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:31:54.282931 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8b7d6f9c-17bb-4333-8907-30e292062022 tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:54.283438 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8b7d6f9c-17bb-4333-8907-30e292062022 tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:54.283898 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8b7d6f9c-17bb-4333-8907-30e292062022 tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:54.284617 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8b7d6f9c-17bb-4333-8907-30e292062022 tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:54.285092 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8b7d6f9c-17bb-4333-8907-30e292062022 tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:54.285538 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8b7d6f9c-17bb-4333-8907-30e292062022 tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:54.429919 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-8b7d6f9c-17bb-4333-8907-30e292062022 tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b6b686aa4874b9ca998e9e1898d8d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65234c569b29466d85335f035aa7ede4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:31:54.438413 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-8b7d6f9c-17bb-4333-8907-30e292062022 tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] 10.222.0.43 "GET /compute/v2.1/servers/3d057e51-38a4-445e-b2b5-ac76aa567ab3" status: 200 len: 1270 microversion: 2.1 time: 0.167185 Oct 04 22:31:54.439189 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3711/6661] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:31:54 2022] GET /compute/v2.1/servers/3d057e51-38a4-445e-b2b5-ac76aa567ab3 => generated 1270 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:31:55.035557 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-f35c1ac4-c29d-4a67-bf04-f2e00b3af803 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:31:55.039109 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-f35c1ac4-c29d-4a67-bf04-f2e00b3af803 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: f1dea61d-0ca6-457d-9d1b-3aff96427d52] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:31:55.046499 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f35c1ac4-c29d-4a67-bf04-f2e00b3af803 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:55.046983 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f35c1ac4-c29d-4a67-bf04-f2e00b3af803 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:55.047448 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f35c1ac4-c29d-4a67-bf04-f2e00b3af803 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:55.048181 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f35c1ac4-c29d-4a67-bf04-f2e00b3af803 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:55.048653 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f35c1ac4-c29d-4a67-bf04-f2e00b3af803 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:55.049102 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f35c1ac4-c29d-4a67-bf04-f2e00b3af803 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:55.288085 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-f35c1ac4-c29d-4a67-bf04-f2e00b3af803 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:31:55.290413 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:31:55.299057 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-f35c1ac4-c29d-4a67-bf04-f2e00b3af803 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/f1dea61d-0ca6-457d-9d1b-3aff96427d52" status: 200 len: 1578 microversion: 2.1 time: 0.267688 Oct 04 22:31:55.311174 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3712/6662] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:31:55 2022] GET /compute/v2.1/servers/f1dea61d-0ca6-457d-9d1b-3aff96427d52 => generated 1578 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:31:55.316227 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-3ecd1164-de36-4f7f-ae82-5aee1074ef1e tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:31:55.316851 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-3ecd1164-de36-4f7f-ae82-5aee1074ef1e tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] [instance: a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:31:55.324782 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3ecd1164-de36-4f7f-ae82-5aee1074ef1e tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:55.325294 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3ecd1164-de36-4f7f-ae82-5aee1074ef1e tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:55.325751 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3ecd1164-de36-4f7f-ae82-5aee1074ef1e tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:55.326621 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3ecd1164-de36-4f7f-ae82-5aee1074ef1e tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:55.327103 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3ecd1164-de36-4f7f-ae82-5aee1074ef1e tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:55.327551 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3ecd1164-de36-4f7f-ae82-5aee1074ef1e tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:55.484464 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-3ecd1164-de36-4f7f-ae82-5aee1074ef1e tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:31:55.494565 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-3ecd1164-de36-4f7f-ae82-5aee1074ef1e tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:31:55.496659 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-3ecd1164-de36-4f7f-ae82-5aee1074ef1e tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:31:55.497915 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-3ecd1164-de36-4f7f-ae82-5aee1074ef1e tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] 10.222.0.43 "GET /compute/v2.1/servers/a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4" status: 200 len: 1729 microversion: 2.20 time: 0.185623 Oct 04 22:31:55.498525 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3713/6663] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:31:55 2022] GET /compute/v2.1/servers/a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4 => generated 1729 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:31:55.503253 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-11fd7cda-64dd-41e8-babe-628b55d6b35d tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:31:55.503884 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-11fd7cda-64dd-41e8-babe-628b55d6b35d tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] [instance: 3d057e51-38a4-445e-b2b5-ac76aa567ab3] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:31:55.510511 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-11fd7cda-64dd-41e8-babe-628b55d6b35d tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:55.510888 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-11fd7cda-64dd-41e8-babe-628b55d6b35d tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:55.511634 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-11fd7cda-64dd-41e8-babe-628b55d6b35d tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:55.512787 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-11fd7cda-64dd-41e8-babe-628b55d6b35d tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:55.513753 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-11fd7cda-64dd-41e8-babe-628b55d6b35d tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:55.513753 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-11fd7cda-64dd-41e8-babe-628b55d6b35d tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:55.811232 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-11fd7cda-64dd-41e8-babe-628b55d6b35d tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b6b686aa4874b9ca998e9e1898d8d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65234c569b29466d85335f035aa7ede4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:31:55.821637 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-11fd7cda-64dd-41e8-babe-628b55d6b35d tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] 10.222.0.43 "GET /compute/v2.1/servers/3d057e51-38a4-445e-b2b5-ac76aa567ab3" status: 200 len: 1270 microversion: 2.1 time: 0.321885 Oct 04 22:31:55.822537 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3714/6664] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:31:55 2022] GET /compute/v2.1/servers/3d057e51-38a4-445e-b2b5-ac76aa567ab3 => generated 1270 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:31:56.326864 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-0bf56fe9-09bb-4e4f-bb1e-0fef15354958 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:31:56.327535 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-0bf56fe9-09bb-4e4f-bb1e-0fef15354958 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: f1dea61d-0ca6-457d-9d1b-3aff96427d52] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:31:56.334321 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0bf56fe9-09bb-4e4f-bb1e-0fef15354958 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:56.334850 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0bf56fe9-09bb-4e4f-bb1e-0fef15354958 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:56.335303 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0bf56fe9-09bb-4e4f-bb1e-0fef15354958 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:56.336010 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0bf56fe9-09bb-4e4f-bb1e-0fef15354958 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:56.336481 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0bf56fe9-09bb-4e4f-bb1e-0fef15354958 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:56.336920 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0bf56fe9-09bb-4e4f-bb1e-0fef15354958 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:56.508381 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-0bf56fe9-09bb-4e4f-bb1e-0fef15354958 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:31:56.517143 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-0bf56fe9-09bb-4e4f-bb1e-0fef15354958 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/f1dea61d-0ca6-457d-9d1b-3aff96427d52" status: 200 len: 1578 microversion: 2.1 time: 0.194905 Oct 04 22:31:56.517713 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3715/6665] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:31:56 2022] GET /compute/v2.1/servers/f1dea61d-0ca6-457d-9d1b-3aff96427d52 => generated 1578 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:31:56.524876 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-823b21fa-22f7-4eba-98bf-b8b8d1aeb525 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:31:56.525484 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-823b21fa-22f7-4eba-98bf-b8b8d1aeb525 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] [instance: a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:31:56.531364 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-823b21fa-22f7-4eba-98bf-b8b8d1aeb525 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:56.531869 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-823b21fa-22f7-4eba-98bf-b8b8d1aeb525 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:56.532326 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-823b21fa-22f7-4eba-98bf-b8b8d1aeb525 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:56.533040 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-823b21fa-22f7-4eba-98bf-b8b8d1aeb525 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:56.533521 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-823b21fa-22f7-4eba-98bf-b8b8d1aeb525 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:56.533972 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-823b21fa-22f7-4eba-98bf-b8b8d1aeb525 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:56.667190 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-823b21fa-22f7-4eba-98bf-b8b8d1aeb525 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:31:56.675981 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-823b21fa-22f7-4eba-98bf-b8b8d1aeb525 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:31:56.677450 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-823b21fa-22f7-4eba-98bf-b8b8d1aeb525 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:31:56.678705 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-823b21fa-22f7-4eba-98bf-b8b8d1aeb525 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] 10.222.0.43 "GET /compute/v2.1/servers/a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4" status: 200 len: 1729 microversion: 2.20 time: 0.157581 Oct 04 22:31:56.679282 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3716/6666] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:31:56 2022] GET /compute/v2.1/servers/a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4 => generated 1729 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 22:31:56.847081 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-dd2c51d1-4144-4959-98ae-59e0e98cbba9 tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:31:56.847716 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-dd2c51d1-4144-4959-98ae-59e0e98cbba9 tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] [instance: 3d057e51-38a4-445e-b2b5-ac76aa567ab3] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:31:56.853652 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dd2c51d1-4144-4959-98ae-59e0e98cbba9 tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:56.854154 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dd2c51d1-4144-4959-98ae-59e0e98cbba9 tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:56.854651 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dd2c51d1-4144-4959-98ae-59e0e98cbba9 tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:56.855898 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dd2c51d1-4144-4959-98ae-59e0e98cbba9 tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:56.856492 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dd2c51d1-4144-4959-98ae-59e0e98cbba9 tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:56.856943 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dd2c51d1-4144-4959-98ae-59e0e98cbba9 tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:56.997269 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-dd2c51d1-4144-4959-98ae-59e0e98cbba9 tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b6b686aa4874b9ca998e9e1898d8d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65234c569b29466d85335f035aa7ede4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:31:57.005311 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-dd2c51d1-4144-4959-98ae-59e0e98cbba9 tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] 10.222.0.43 "GET /compute/v2.1/servers/3d057e51-38a4-445e-b2b5-ac76aa567ab3" status: 200 len: 1270 microversion: 2.1 time: 0.162248 Oct 04 22:31:57.006101 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3717/6667] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:31:56 2022] GET /compute/v2.1/servers/3d057e51-38a4-445e-b2b5-ac76aa567ab3 => generated 1270 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:31:57.016863 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-ea919aa2-550f-44a7-8dd8-4a7d7cf93dcb req-1f382eef-2626-4e38-a148-a3a41148a23e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d057e51-38a4-445e-b2b5-ac76aa567ab3", "name": "network-vif-plugged", "status": "completed", "tag": "16094bc3-52b3-4c3a-b7df-df6c6623cad1"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:31:57.027808 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-ea919aa2-550f-44a7-8dd8-4a7d7cf93dcb req-1f382eef-2626-4e38-a148-a3a41148a23e service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:57.028445 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-ea919aa2-550f-44a7-8dd8-4a7d7cf93dcb req-1f382eef-2626-4e38-a148-a3a41148a23e service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:57.028911 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-ea919aa2-550f-44a7-8dd8-4a7d7cf93dcb req-1f382eef-2626-4e38-a148-a3a41148a23e service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:57.040350 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-ea919aa2-550f-44a7-8dd8-4a7d7cf93dcb req-1f382eef-2626-4e38-a148-a3a41148a23e service nova] Creating event network-vif-plugged:16094bc3-52b3-4c3a-b7df-df6c6623cad1 for instance 3d057e51-38a4-445e-b2b5-ac76aa567ab3 on n-h2-860284-1 Oct 04 22:31:57.046016 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-ea919aa2-550f-44a7-8dd8-4a7d7cf93dcb req-1f382eef-2626-4e38-a148-a3a41148a23e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033697 Oct 04 22:31:57.046655 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3718/6668] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:31:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:31:57.543314 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-5055f82d-0339-49cc-b2f8-4f98c20fee48 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:31:57.544020 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-5055f82d-0339-49cc-b2f8-4f98c20fee48 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: f1dea61d-0ca6-457d-9d1b-3aff96427d52] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:31:57.552204 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5055f82d-0339-49cc-b2f8-4f98c20fee48 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:57.552824 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5055f82d-0339-49cc-b2f8-4f98c20fee48 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:57.553292 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5055f82d-0339-49cc-b2f8-4f98c20fee48 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:57.554030 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5055f82d-0339-49cc-b2f8-4f98c20fee48 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:57.554542 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5055f82d-0339-49cc-b2f8-4f98c20fee48 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:57.554996 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5055f82d-0339-49cc-b2f8-4f98c20fee48 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:57.714214 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-5055f82d-0339-49cc-b2f8-4f98c20fee48 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:31:57.723010 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-5055f82d-0339-49cc-b2f8-4f98c20fee48 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/f1dea61d-0ca6-457d-9d1b-3aff96427d52" status: 200 len: 1578 microversion: 2.1 time: 0.186265 Oct 04 22:31:57.723607 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3719/6669] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:31:57 2022] GET /compute/v2.1/servers/f1dea61d-0ca6-457d-9d1b-3aff96427d52 => generated 1578 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:31:57.728182 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-a078b370-d7c3-4464-b199-1279ec3932b3 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:31:57.728812 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-a078b370-d7c3-4464-b199-1279ec3932b3 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] [instance: a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:31:57.734930 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a078b370-d7c3-4464-b199-1279ec3932b3 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:57.735515 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a078b370-d7c3-4464-b199-1279ec3932b3 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:57.735987 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a078b370-d7c3-4464-b199-1279ec3932b3 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:57.737004 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a078b370-d7c3-4464-b199-1279ec3932b3 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:57.737487 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a078b370-d7c3-4464-b199-1279ec3932b3 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:57.737938 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a078b370-d7c3-4464-b199-1279ec3932b3 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:57.874349 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-a078b370-d7c3-4464-b199-1279ec3932b3 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:31:57.882949 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-a078b370-d7c3-4464-b199-1279ec3932b3 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:31:57.884422 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-a078b370-d7c3-4464-b199-1279ec3932b3 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:31:57.885650 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-a078b370-d7c3-4464-b199-1279ec3932b3 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] 10.222.0.43 "GET /compute/v2.1/servers/a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4" status: 200 len: 1729 microversion: 2.20 time: 0.161102 Oct 04 22:31:57.886941 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3720/6670] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:31:57 2022] GET /compute/v2.1/servers/a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4 => generated 1729 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:31:58.030919 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-7bef23d5-e8b1-4895-ae66-007045fb2b8b tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:31:58.032063 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-7bef23d5-e8b1-4895-ae66-007045fb2b8b tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] [instance: 3d057e51-38a4-445e-b2b5-ac76aa567ab3] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:31:58.038994 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7bef23d5-e8b1-4895-ae66-007045fb2b8b tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:58.039555 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7bef23d5-e8b1-4895-ae66-007045fb2b8b tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:58.040016 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7bef23d5-e8b1-4895-ae66-007045fb2b8b tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:58.040739 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7bef23d5-e8b1-4895-ae66-007045fb2b8b tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:58.041208 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7bef23d5-e8b1-4895-ae66-007045fb2b8b tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:58.041655 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7bef23d5-e8b1-4895-ae66-007045fb2b8b tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:58.180938 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-7bef23d5-e8b1-4895-ae66-007045fb2b8b tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b6b686aa4874b9ca998e9e1898d8d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65234c569b29466d85335f035aa7ede4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:31:58.190141 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-7bef23d5-e8b1-4895-ae66-007045fb2b8b tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] 10.222.0.43 "GET /compute/v2.1/servers/3d057e51-38a4-445e-b2b5-ac76aa567ab3" status: 200 len: 1270 microversion: 2.1 time: 0.164629 Oct 04 22:31:58.190768 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3721/6671] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:31:58 2022] GET /compute/v2.1/servers/3d057e51-38a4-445e-b2b5-ac76aa567ab3 => generated 1270 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:31:58.747300 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e941eb1f-96b6-4210-bb83-494d9331e30c tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:31:58.747989 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-e941eb1f-96b6-4210-bb83-494d9331e30c tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: f1dea61d-0ca6-457d-9d1b-3aff96427d52] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:31:58.759601 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e941eb1f-96b6-4210-bb83-494d9331e30c tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:58.760119 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e941eb1f-96b6-4210-bb83-494d9331e30c tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:58.760588 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e941eb1f-96b6-4210-bb83-494d9331e30c tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:58.761404 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e941eb1f-96b6-4210-bb83-494d9331e30c tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:58.761879 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e941eb1f-96b6-4210-bb83-494d9331e30c tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:58.762328 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e941eb1f-96b6-4210-bb83-494d9331e30c tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:58.912398 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-e941eb1f-96b6-4210-bb83-494d9331e30c tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:31:58.920621 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-e941eb1f-96b6-4210-bb83-494d9331e30c tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/f1dea61d-0ca6-457d-9d1b-3aff96427d52" status: 200 len: 1578 microversion: 2.1 time: 0.177550 Oct 04 22:31:58.921224 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3722/6672] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:31:58 2022] GET /compute/v2.1/servers/f1dea61d-0ca6-457d-9d1b-3aff96427d52 => generated 1578 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:31:58.925856 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-1f22378d-9140-4ea7-91cf-5b38ac4fed00 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:31:58.926514 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-1f22378d-9140-4ea7-91cf-5b38ac4fed00 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] [instance: a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:31:58.932777 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1f22378d-9140-4ea7-91cf-5b38ac4fed00 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:58.933482 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1f22378d-9140-4ea7-91cf-5b38ac4fed00 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:58.933928 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1f22378d-9140-4ea7-91cf-5b38ac4fed00 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:58.934681 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1f22378d-9140-4ea7-91cf-5b38ac4fed00 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:58.935164 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1f22378d-9140-4ea7-91cf-5b38ac4fed00 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:58.936598 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1f22378d-9140-4ea7-91cf-5b38ac4fed00 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:59.092421 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-1f22378d-9140-4ea7-91cf-5b38ac4fed00 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:31:59.100807 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-1f22378d-9140-4ea7-91cf-5b38ac4fed00 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:31:59.102264 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-1f22378d-9140-4ea7-91cf-5b38ac4fed00 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:31:59.103463 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-1f22378d-9140-4ea7-91cf-5b38ac4fed00 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] 10.222.0.43 "GET /compute/v2.1/servers/a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4" status: 200 len: 1729 microversion: 2.20 time: 0.181316 Oct 04 22:31:59.104024 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3723/6673] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:31:58 2022] GET /compute/v2.1/servers/a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4 => generated 1729 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:31:59.213989 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-4cfe5eb6-c008-4492-aa40-bd1a52fa5369 tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:31:59.214764 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-4cfe5eb6-c008-4492-aa40-bd1a52fa5369 tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] [instance: 3d057e51-38a4-445e-b2b5-ac76aa567ab3] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:31:59.221578 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4cfe5eb6-c008-4492-aa40-bd1a52fa5369 tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:59.222085 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4cfe5eb6-c008-4492-aa40-bd1a52fa5369 tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:59.222597 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4cfe5eb6-c008-4492-aa40-bd1a52fa5369 tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:59.223311 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4cfe5eb6-c008-4492-aa40-bd1a52fa5369 tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:59.223781 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4cfe5eb6-c008-4492-aa40-bd1a52fa5369 tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:59.224328 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4cfe5eb6-c008-4492-aa40-bd1a52fa5369 tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:59.373693 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-4cfe5eb6-c008-4492-aa40-bd1a52fa5369 tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b6b686aa4874b9ca998e9e1898d8d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65234c569b29466d85335f035aa7ede4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:31:59.383639 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-4cfe5eb6-c008-4492-aa40-bd1a52fa5369 tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] 10.222.0.43 "GET /compute/v2.1/servers/3d057e51-38a4-445e-b2b5-ac76aa567ab3" status: 200 len: 1459 microversion: 2.1 time: 0.173924 Oct 04 22:31:59.384238 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3724/6674] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:31:59 2022] GET /compute/v2.1/servers/3d057e51-38a4-445e-b2b5-ac76aa567ab3 => generated 1459 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:31:59.407252 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-bdbe7558-83cb-4272-8e2b-2e9d2ac99181 tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:31:59.407982 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-bdbe7558-83cb-4272-8e2b-2e9d2ac99181 tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] [instance: 3d057e51-38a4-445e-b2b5-ac76aa567ab3] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:31:59.418392 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bdbe7558-83cb-4272-8e2b-2e9d2ac99181 tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:59.421691 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bdbe7558-83cb-4272-8e2b-2e9d2ac99181 tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:59.422160 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bdbe7558-83cb-4272-8e2b-2e9d2ac99181 tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:59.422955 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bdbe7558-83cb-4272-8e2b-2e9d2ac99181 tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:59.423436 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bdbe7558-83cb-4272-8e2b-2e9d2ac99181 tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:59.423970 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bdbe7558-83cb-4272-8e2b-2e9d2ac99181 tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:59.563304 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-bdbe7558-83cb-4272-8e2b-2e9d2ac99181 tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b6b686aa4874b9ca998e9e1898d8d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65234c569b29466d85335f035aa7ede4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:31:59.571276 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-bdbe7558-83cb-4272-8e2b-2e9d2ac99181 tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] 10.222.0.43 "GET /compute/v2.1/servers/3d057e51-38a4-445e-b2b5-ac76aa567ab3" status: 200 len: 1459 microversion: 2.1 time: 0.168259 Oct 04 22:31:59.571865 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3725/6675] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:31:59 2022] GET /compute/v2.1/servers/3d057e51-38a4-445e-b2b5-ac76aa567ab3 => generated 1459 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:31:59.945250 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-d8d46c49-3cb9-48cb-843d-7bef2a2df268 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:31:59.945983 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-d8d46c49-3cb9-48cb-843d-7bef2a2df268 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: f1dea61d-0ca6-457d-9d1b-3aff96427d52] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:31:59.953565 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d8d46c49-3cb9-48cb-843d-7bef2a2df268 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:59.954075 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d8d46c49-3cb9-48cb-843d-7bef2a2df268 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:59.954568 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d8d46c49-3cb9-48cb-843d-7bef2a2df268 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:59.955285 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d8d46c49-3cb9-48cb-843d-7bef2a2df268 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:59.955766 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d8d46c49-3cb9-48cb-843d-7bef2a2df268 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:59.956213 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d8d46c49-3cb9-48cb-843d-7bef2a2df268 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:32:00.176446 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-d8d46c49-3cb9-48cb-843d-7bef2a2df268 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:32:00.184866 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-d8d46c49-3cb9-48cb-843d-7bef2a2df268 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/f1dea61d-0ca6-457d-9d1b-3aff96427d52" status: 200 len: 1578 microversion: 2.1 time: 0.243621 Oct 04 22:32:00.185447 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3726/6676] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:31:59 2022] GET /compute/v2.1/servers/f1dea61d-0ca6-457d-9d1b-3aff96427d52 => generated 1578 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:32:00.192190 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-1336183a-74c6-49aa-bebe-2b7aee6c6574 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:32:00.192820 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-1336183a-74c6-49aa-bebe-2b7aee6c6574 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] [instance: a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:32:00.199570 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1336183a-74c6-49aa-bebe-2b7aee6c6574 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:32:00.200150 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1336183a-74c6-49aa-bebe-2b7aee6c6574 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:32:00.200659 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1336183a-74c6-49aa-bebe-2b7aee6c6574 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:32:00.201378 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1336183a-74c6-49aa-bebe-2b7aee6c6574 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:32:00.201842 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1336183a-74c6-49aa-bebe-2b7aee6c6574 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:32:00.202279 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1336183a-74c6-49aa-bebe-2b7aee6c6574 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:32:00.448749 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-1336183a-74c6-49aa-bebe-2b7aee6c6574 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:32:00.458426 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-1336183a-74c6-49aa-bebe-2b7aee6c6574 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:32:00.459890 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-1336183a-74c6-49aa-bebe-2b7aee6c6574 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:32:00.461811 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-1336183a-74c6-49aa-bebe-2b7aee6c6574 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] 10.222.0.43 "GET /compute/v2.1/servers/a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4" status: 200 len: 1729 microversion: 2.20 time: 0.274714 Oct 04 22:32:00.474454 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3727/6677] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:32:00 2022] GET /compute/v2.1/servers/a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4 => generated 1729 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:32:01.208877 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-b7e1fd15-0402-40ed-b611-fde75e2d7209 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:32:01.209623 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-b7e1fd15-0402-40ed-b611-fde75e2d7209 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: f1dea61d-0ca6-457d-9d1b-3aff96427d52] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:32:01.217301 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b7e1fd15-0402-40ed-b611-fde75e2d7209 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:32:01.217883 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b7e1fd15-0402-40ed-b611-fde75e2d7209 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:32:01.218341 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b7e1fd15-0402-40ed-b611-fde75e2d7209 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:32:01.219076 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b7e1fd15-0402-40ed-b611-fde75e2d7209 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:32:01.219551 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b7e1fd15-0402-40ed-b611-fde75e2d7209 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:32:01.219994 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b7e1fd15-0402-40ed-b611-fde75e2d7209 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:32:01.435155 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-b7e1fd15-0402-40ed-b611-fde75e2d7209 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:32:01.443157 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-b7e1fd15-0402-40ed-b611-fde75e2d7209 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/f1dea61d-0ca6-457d-9d1b-3aff96427d52" status: 200 len: 1578 microversion: 2.1 time: 0.238223 Oct 04 22:32:01.443745 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3728/6678] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:32:01 2022] GET /compute/v2.1/servers/f1dea61d-0ca6-457d-9d1b-3aff96427d52 => generated 1578 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:32:01.487036 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-981e450c-5c13-415c-81fa-6656d7215828 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:32:01.487768 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-981e450c-5c13-415c-81fa-6656d7215828 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] [instance: a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:32:01.494266 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-981e450c-5c13-415c-81fa-6656d7215828 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:32:01.494800 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-981e450c-5c13-415c-81fa-6656d7215828 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:32:01.495753 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-981e450c-5c13-415c-81fa-6656d7215828 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:32:01.496609 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-981e450c-5c13-415c-81fa-6656d7215828 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:32:01.497109 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-981e450c-5c13-415c-81fa-6656d7215828 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:32:01.497556 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-981e450c-5c13-415c-81fa-6656d7215828 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:32:01.727498 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-981e450c-5c13-415c-81fa-6656d7215828 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:32:01.735789 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-981e450c-5c13-415c-81fa-6656d7215828 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:32:01.737249 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-981e450c-5c13-415c-81fa-6656d7215828 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:32:01.738448 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-981e450c-5c13-415c-81fa-6656d7215828 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] 10.222.0.43 "GET /compute/v2.1/servers/a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4" status: 200 len: 1729 microversion: 2.20 time: 0.255537 Oct 04 22:32:01.739015 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3729/6679] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:32:01 2022] GET /compute/v2.1/servers/a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4 => generated 1729 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 22:32:02.052639 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-a68369fa-c2ae-42b0-84dc-20a6ac971d75 req-1d3cde7d-0d03-4c81-833a-0958c54834b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d057e51-38a4-445e-b2b5-ac76aa567ab3", "tag": "16094bc3-52b3-4c3a-b7df-df6c6623cad1"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:32:02.063617 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-a68369fa-c2ae-42b0-84dc-20a6ac971d75 req-1d3cde7d-0d03-4c81-833a-0958c54834b0 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:32:02.064119 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-a68369fa-c2ae-42b0-84dc-20a6ac971d75 req-1d3cde7d-0d03-4c81-833a-0958c54834b0 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:32:02.064571 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-a68369fa-c2ae-42b0-84dc-20a6ac971d75 req-1d3cde7d-0d03-4c81-833a-0958c54834b0 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:32:02.068689 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=100 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:32:02.077083 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-a68369fa-c2ae-42b0-84dc-20a6ac971d75 req-1d3cde7d-0d03-4c81-833a-0958c54834b0 service nova] Creating event network-changed:16094bc3-52b3-4c3a-b7df-df6c6623cad1 for instance 3d057e51-38a4-445e-b2b5-ac76aa567ab3 on n-h2-860284-1 Oct 04 22:32:02.082059 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-a68369fa-c2ae-42b0-84dc-20a6ac971d75 req-1d3cde7d-0d03-4c81-833a-0958c54834b0 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033246 Oct 04 22:32:02.082989 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3730/6680] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:32:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:32:02.469797 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-f0a4f58f-88d8-4b46-8806-f4f6a9c3e299 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:32:02.470672 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-f0a4f58f-88d8-4b46-8806-f4f6a9c3e299 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: f1dea61d-0ca6-457d-9d1b-3aff96427d52] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:32:02.477401 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f0a4f58f-88d8-4b46-8806-f4f6a9c3e299 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:32:02.478312 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f0a4f58f-88d8-4b46-8806-f4f6a9c3e299 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:32:02.479196 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f0a4f58f-88d8-4b46-8806-f4f6a9c3e299 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:32:02.480890 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f0a4f58f-88d8-4b46-8806-f4f6a9c3e299 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:32:02.481527 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f0a4f58f-88d8-4b46-8806-f4f6a9c3e299 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:32:02.482041 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f0a4f58f-88d8-4b46-8806-f4f6a9c3e299 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:32:02.627910 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-f0a4f58f-88d8-4b46-8806-f4f6a9c3e299 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:32:02.637546 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-f0a4f58f-88d8-4b46-8806-f4f6a9c3e299 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/f1dea61d-0ca6-457d-9d1b-3aff96427d52" status: 200 len: 1578 microversion: 2.1 time: 0.173551 Oct 04 22:32:02.638387 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3731/6681] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:32:02 2022] GET /compute/v2.1/servers/f1dea61d-0ca6-457d-9d1b-3aff96427d52 => generated 1578 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:32:02.764855 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-9e4361bb-80b3-4722-bebe-7d136dae1107 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:32:02.766104 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-9e4361bb-80b3-4722-bebe-7d136dae1107 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] [instance: a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:32:02.772263 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9e4361bb-80b3-4722-bebe-7d136dae1107 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:32:02.773119 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9e4361bb-80b3-4722-bebe-7d136dae1107 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:32:02.773300 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9e4361bb-80b3-4722-bebe-7d136dae1107 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:32:02.774424 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9e4361bb-80b3-4722-bebe-7d136dae1107 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:32:02.775045 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9e4361bb-80b3-4722-bebe-7d136dae1107 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:32:02.775497 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9e4361bb-80b3-4722-bebe-7d136dae1107 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:32:02.916821 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-9e4361bb-80b3-4722-bebe-7d136dae1107 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:32:02.926906 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-9e4361bb-80b3-4722-bebe-7d136dae1107 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:32:02.928755 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-9e4361bb-80b3-4722-bebe-7d136dae1107 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:32:02.930229 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-9e4361bb-80b3-4722-bebe-7d136dae1107 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] 10.222.0.43 "GET /compute/v2.1/servers/a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4" status: 200 len: 1729 microversion: 2.20 time: 0.169709 Oct 04 22:32:02.931039 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3732/6682] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:32:02 2022] GET /compute/v2.1/servers/a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4 => generated 1729 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:32:03.661483 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-638e6e9e-383c-4317-b300-293286b63269 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:32:03.663214 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-638e6e9e-383c-4317-b300-293286b63269 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: f1dea61d-0ca6-457d-9d1b-3aff96427d52] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:32:03.670900 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-638e6e9e-383c-4317-b300-293286b63269 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:32:03.671595 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-638e6e9e-383c-4317-b300-293286b63269 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:32:03.672160 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-638e6e9e-383c-4317-b300-293286b63269 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:32:03.673134 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-638e6e9e-383c-4317-b300-293286b63269 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:32:03.673717 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-638e6e9e-383c-4317-b300-293286b63269 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:32:03.674271 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-638e6e9e-383c-4317-b300-293286b63269 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:32:03.916306 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-638e6e9e-383c-4317-b300-293286b63269 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:32:03.926795 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-638e6e9e-383c-4317-b300-293286b63269 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/f1dea61d-0ca6-457d-9d1b-3aff96427d52" status: 200 len: 1578 microversion: 2.1 time: 0.269216 Oct 04 22:32:03.927396 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3733/6683] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:32:03 2022] GET /compute/v2.1/servers/f1dea61d-0ca6-457d-9d1b-3aff96427d52 => generated 1578 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:32:03.940091 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-c4ce57d6-df79-4ebe-a904-c98692953e1a req-6bf06fa2-0399-4313-aa9e-1c97a42e11dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d057e51-38a4-445e-b2b5-ac76aa567ab3", "tag": "16094bc3-52b3-4c3a-b7df-df6c6623cad1"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:32:03.955857 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-c4ce57d6-df79-4ebe-a904-c98692953e1a req-6bf06fa2-0399-4313-aa9e-1c97a42e11dc service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:32:03.956635 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-c4ce57d6-df79-4ebe-a904-c98692953e1a req-6bf06fa2-0399-4313-aa9e-1c97a42e11dc service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:32:03.958315 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-c4ce57d6-df79-4ebe-a904-c98692953e1a req-6bf06fa2-0399-4313-aa9e-1c97a42e11dc service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:32:03.972641 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-c4ce57d6-df79-4ebe-a904-c98692953e1a req-6bf06fa2-0399-4313-aa9e-1c97a42e11dc service nova] Creating event network-changed:16094bc3-52b3-4c3a-b7df-df6c6623cad1 for instance 3d057e51-38a4-445e-b2b5-ac76aa567ab3 on n-h2-860284-1 Oct 04 22:32:03.985014 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-c4ce57d6-df79-4ebe-a904-c98692953e1a req-6bf06fa2-0399-4313-aa9e-1c97a42e11dc service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047983 Oct 04 22:32:03.986659 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3734/6684] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:32:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:32:03.992598 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-f132141c-5e6d-4286-9354-3813ddedebc3 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:32:03.993681 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-f132141c-5e6d-4286-9354-3813ddedebc3 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] [instance: a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:32:04.001061 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f132141c-5e6d-4286-9354-3813ddedebc3 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:32:04.001575 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f132141c-5e6d-4286-9354-3813ddedebc3 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:32:04.002024 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f132141c-5e6d-4286-9354-3813ddedebc3 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:32:04.002978 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f132141c-5e6d-4286-9354-3813ddedebc3 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:32:04.003446 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f132141c-5e6d-4286-9354-3813ddedebc3 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:32:04.004109 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f132141c-5e6d-4286-9354-3813ddedebc3 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:32:04.184655 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-f132141c-5e6d-4286-9354-3813ddedebc3 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:32:04.194203 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-f132141c-5e6d-4286-9354-3813ddedebc3 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:32:04.196429 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-f132141c-5e6d-4286-9354-3813ddedebc3 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:32:04.197833 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-f132141c-5e6d-4286-9354-3813ddedebc3 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] 10.222.0.43 "GET /compute/v2.1/servers/a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4" status: 200 len: 1729 microversion: 2.20 time: 0.209509 Oct 04 22:32:04.199460 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3735/6685] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:32:03 2022] GET /compute/v2.1/servers/a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4 => generated 1729 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 22:32:04.952861 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-08001bd5-55bf-4a61-ae84-99ed205b4c22 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:32:04.954150 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-08001bd5-55bf-4a61-ae84-99ed205b4c22 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: f1dea61d-0ca6-457d-9d1b-3aff96427d52] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:32:04.961383 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-08001bd5-55bf-4a61-ae84-99ed205b4c22 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:32:04.962098 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-08001bd5-55bf-4a61-ae84-99ed205b4c22 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:32:04.962758 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-08001bd5-55bf-4a61-ae84-99ed205b4c22 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:32:04.963678 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-08001bd5-55bf-4a61-ae84-99ed205b4c22 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:32:04.964208 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-08001bd5-55bf-4a61-ae84-99ed205b4c22 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:32:04.964677 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-08001bd5-55bf-4a61-ae84-99ed205b4c22 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:32:05.034282 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-08001bd5-55bf-4a61-ae84-99ed205b4c22 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:32:05.043076 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-08001bd5-55bf-4a61-ae84-99ed205b4c22 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/f1dea61d-0ca6-457d-9d1b-3aff96427d52" status: 200 len: 1226 microversion: 2.1 time: 0.093597 Oct 04 22:32:05.043816 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3736/6686] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:32:04 2022] GET /compute/v2.1/servers/f1dea61d-0ca6-457d-9d1b-3aff96427d52 => generated 1226 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:32:05.227205 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-2930163b-c426-4644-a40e-11118a795b7f tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:32:05.227750 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-2930163b-c426-4644-a40e-11118a795b7f tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] [instance: a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:32:05.234557 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2930163b-c426-4644-a40e-11118a795b7f tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:32:05.235069 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2930163b-c426-4644-a40e-11118a795b7f tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:32:05.235526 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2930163b-c426-4644-a40e-11118a795b7f tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:32:05.236260 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2930163b-c426-4644-a40e-11118a795b7f tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:32:05.236736 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2930163b-c426-4644-a40e-11118a795b7f tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:32:05.237186 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2930163b-c426-4644-a40e-11118a795b7f tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:32:05.378452 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-2930163b-c426-4644-a40e-11118a795b7f tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:32:05.387983 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-2930163b-c426-4644-a40e-11118a795b7f tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:32:05.389486 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-2930163b-c426-4644-a40e-11118a795b7f tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:32:05.390959 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-2930163b-c426-4644-a40e-11118a795b7f tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] 10.222.0.43 "GET /compute/v2.1/servers/a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4" status: 200 len: 1729 microversion: 2.20 time: 0.167642 Oct 04 22:32:05.391534 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3737/6687] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:32:05 2022] GET /compute/v2.1/servers/a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4 => generated 1729 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 22:32:06.024914 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-4205393c-05e2-464a-9ff1-967625fb0e4a req-e366fbdc-032c-41dd-8487-6ea941871d29 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d057e51-38a4-445e-b2b5-ac76aa567ab3", "tag": "16094bc3-52b3-4c3a-b7df-df6c6623cad1"}, {"server_uuid": "f1dea61d-0ca6-457d-9d1b-3aff96427d52", "name": "network-vif-deleted", "tag": "4a95490d-6ee2-4e08-a931-9210ae4b290c"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:32:06.038402 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-4205393c-05e2-464a-9ff1-967625fb0e4a req-e366fbdc-032c-41dd-8487-6ea941871d29 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:32:06.038978 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-4205393c-05e2-464a-9ff1-967625fb0e4a req-e366fbdc-032c-41dd-8487-6ea941871d29 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:32:06.039493 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-4205393c-05e2-464a-9ff1-967625fb0e4a req-e366fbdc-032c-41dd-8487-6ea941871d29 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:32:06.053819 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-4205393c-05e2-464a-9ff1-967625fb0e4a req-e366fbdc-032c-41dd-8487-6ea941871d29 service nova] Creating event network-changed:16094bc3-52b3-4c3a-b7df-df6c6623cad1 for instance 3d057e51-38a4-445e-b2b5-ac76aa567ab3 on n-h2-860284-1 Oct 04 22:32:06.054338 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-4205393c-05e2-464a-9ff1-967625fb0e4a req-e366fbdc-032c-41dd-8487-6ea941871d29 service nova] Creating event network-vif-deleted:4a95490d-6ee2-4e08-a931-9210ae4b290c for instance f1dea61d-0ca6-457d-9d1b-3aff96427d52 on n-h1-860284-1 Oct 04 22:32:06.063597 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-4205393c-05e2-464a-9ff1-967625fb0e4a req-e366fbdc-032c-41dd-8487-6ea941871d29 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.042183 Oct 04 22:32:06.064301 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3738/6688] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:32:06 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:32:06.069725 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-80a3f200-5159-4d44-9d4e-be604b9e0868 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:32:06.070466 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-80a3f200-5159-4d44-9d4e-be604b9e0868 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: f1dea61d-0ca6-457d-9d1b-3aff96427d52] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:32:06.077601 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-80a3f200-5159-4d44-9d4e-be604b9e0868 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:32:06.078415 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-80a3f200-5159-4d44-9d4e-be604b9e0868 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:32:06.079147 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-80a3f200-5159-4d44-9d4e-be604b9e0868 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:32:06.080356 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-80a3f200-5159-4d44-9d4e-be604b9e0868 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:32:06.080829 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-80a3f200-5159-4d44-9d4e-be604b9e0868 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:32:06.081272 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-80a3f200-5159-4d44-9d4e-be604b9e0868 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:32:06.157449 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-80a3f200-5159-4d44-9d4e-be604b9e0868 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:32:06.171288 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-80a3f200-5159-4d44-9d4e-be604b9e0868 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/f1dea61d-0ca6-457d-9d1b-3aff96427d52" status: 200 len: 1226 microversion: 2.1 time: 0.105754 Oct 04 22:32:06.171887 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3739/6689] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:32:06 2022] GET /compute/v2.1/servers/f1dea61d-0ca6-457d-9d1b-3aff96427d52 => generated 1226 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:32:06.416587 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-ca30ae65-7236-409e-a111-55f0e43bbebd tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:32:06.417592 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-ca30ae65-7236-409e-a111-55f0e43bbebd tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] [instance: a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:32:06.424913 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ca30ae65-7236-409e-a111-55f0e43bbebd tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:32:06.425440 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ca30ae65-7236-409e-a111-55f0e43bbebd tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:32:06.425898 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ca30ae65-7236-409e-a111-55f0e43bbebd tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:32:06.426656 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ca30ae65-7236-409e-a111-55f0e43bbebd tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:32:06.427132 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ca30ae65-7236-409e-a111-55f0e43bbebd tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:32:06.427576 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ca30ae65-7236-409e-a111-55f0e43bbebd tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:32:06.572470 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-ca30ae65-7236-409e-a111-55f0e43bbebd tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:32:06.582153 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-ca30ae65-7236-409e-a111-55f0e43bbebd tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:32:06.583753 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-ca30ae65-7236-409e-a111-55f0e43bbebd tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:32:06.585270 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-ca30ae65-7236-409e-a111-55f0e43bbebd tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] 10.222.0.43 "GET /compute/v2.1/servers/a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4" status: 200 len: 1729 microversion: 2.20 time: 0.172655 Oct 04 22:32:06.585847 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3740/6690] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:32:06 2022] GET /compute/v2.1/servers/a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4 => generated 1729 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 22:32:07.127950 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-18fd9ede-bd4e-47d0-9777-8098fdc97c71 req-137d207f-08a8-4244-96b2-54cd8574013c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4", "name": "network-vif-plugged", "status": "completed", "tag": "c125f571-485f-4f51-9daa-780c14a6c4c9"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:32:07.145737 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-18fd9ede-bd4e-47d0-9777-8098fdc97c71 req-137d207f-08a8-4244-96b2-54cd8574013c service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:32:07.146281 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-18fd9ede-bd4e-47d0-9777-8098fdc97c71 req-137d207f-08a8-4244-96b2-54cd8574013c service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:32:07.146964 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-18fd9ede-bd4e-47d0-9777-8098fdc97c71 req-137d207f-08a8-4244-96b2-54cd8574013c service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:32:07.160126 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-18fd9ede-bd4e-47d0-9777-8098fdc97c71 req-137d207f-08a8-4244-96b2-54cd8574013c service nova] Creating event network-vif-plugged:c125f571-485f-4f51-9daa-780c14a6c4c9 for instance a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4 on n-h1-860284-1 Oct 04 22:32:07.165925 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-18fd9ede-bd4e-47d0-9777-8098fdc97c71 req-137d207f-08a8-4244-96b2-54cd8574013c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042685 Oct 04 22:32:07.167592 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3741/6691] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:32:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:32:07.213272 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-8937c740-46f3-4010-9a53-0e03f92ab003 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:32:07.214082 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-8937c740-46f3-4010-9a53-0e03f92ab003 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: f1dea61d-0ca6-457d-9d1b-3aff96427d52] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:32:07.220579 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8937c740-46f3-4010-9a53-0e03f92ab003 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:32:07.221375 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8937c740-46f3-4010-9a53-0e03f92ab003 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:32:07.221839 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8937c740-46f3-4010-9a53-0e03f92ab003 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:32:07.222594 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8937c740-46f3-4010-9a53-0e03f92ab003 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:32:07.223072 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8937c740-46f3-4010-9a53-0e03f92ab003 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:32:07.223523 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8937c740-46f3-4010-9a53-0e03f92ab003 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:32:07.312767 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-8937c740-46f3-4010-9a53-0e03f92ab003 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:32:07.320993 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-8937c740-46f3-4010-9a53-0e03f92ab003 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/f1dea61d-0ca6-457d-9d1b-3aff96427d52" status: 200 len: 1226 microversion: 2.1 time: 0.114264 Oct 04 22:32:07.322660 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3742/6692] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:32:07 2022] GET /compute/v2.1/servers/f1dea61d-0ca6-457d-9d1b-3aff96427d52 => generated 1226 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:32:07.614632 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-13620baf-2b59-43fb-86cb-c7b08fe2fc83 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:32:07.615261 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-13620baf-2b59-43fb-86cb-c7b08fe2fc83 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] [instance: a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:32:07.622061 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-13620baf-2b59-43fb-86cb-c7b08fe2fc83 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:32:07.622536 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-13620baf-2b59-43fb-86cb-c7b08fe2fc83 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:32:07.622992 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-13620baf-2b59-43fb-86cb-c7b08fe2fc83 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:32:07.623698 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-13620baf-2b59-43fb-86cb-c7b08fe2fc83 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:32:07.624170 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-13620baf-2b59-43fb-86cb-c7b08fe2fc83 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:32:07.624615 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-13620baf-2b59-43fb-86cb-c7b08fe2fc83 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:32:07.778835 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-13620baf-2b59-43fb-86cb-c7b08fe2fc83 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:32:07.788724 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-13620baf-2b59-43fb-86cb-c7b08fe2fc83 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:32:07.790313 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-13620baf-2b59-43fb-86cb-c7b08fe2fc83 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:32:07.791630 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-13620baf-2b59-43fb-86cb-c7b08fe2fc83 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] 10.222.0.43 "GET /compute/v2.1/servers/a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4" status: 200 len: 1729 microversion: 2.20 time: 0.181112 Oct 04 22:32:07.792429 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3743/6693] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:32:07 2022] GET /compute/v2.1/servers/a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4 => generated 1729 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 22:32:08.345699 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-a6cf50b9-7bb7-45e8-adfc-d39f605865f8 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:32:08.346436 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-a6cf50b9-7bb7-45e8-adfc-d39f605865f8 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: f1dea61d-0ca6-457d-9d1b-3aff96427d52] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:32:08.353487 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a6cf50b9-7bb7-45e8-adfc-d39f605865f8 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:32:08.353989 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a6cf50b9-7bb7-45e8-adfc-d39f605865f8 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:32:08.355141 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a6cf50b9-7bb7-45e8-adfc-d39f605865f8 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:32:08.356135 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a6cf50b9-7bb7-45e8-adfc-d39f605865f8 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:32:08.356708 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a6cf50b9-7bb7-45e8-adfc-d39f605865f8 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:32:08.357161 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a6cf50b9-7bb7-45e8-adfc-d39f605865f8 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:32:08.421568 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-a6cf50b9-7bb7-45e8-adfc-d39f605865f8 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99acad09db70445b93ae1d64a1b49ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c98a72bacce47c3947f9b0f0b4e85b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:32:08.429908 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-a6cf50b9-7bb7-45e8-adfc-d39f605865f8 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/f1dea61d-0ca6-457d-9d1b-3aff96427d52" status: 200 len: 1226 microversion: 2.1 time: 0.088096 Oct 04 22:32:08.430533 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3744/6694] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:32:08 2022] GET /compute/v2.1/servers/f1dea61d-0ca6-457d-9d1b-3aff96427d52 => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:32:08.823972 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-d25efd10-54a0-4fb6-aa8f-b9c98314f54f tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:32:08.827658 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-d25efd10-54a0-4fb6-aa8f-b9c98314f54f tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] [instance: a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:32:08.834604 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d25efd10-54a0-4fb6-aa8f-b9c98314f54f tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:32:08.835125 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d25efd10-54a0-4fb6-aa8f-b9c98314f54f tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:32:08.835586 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d25efd10-54a0-4fb6-aa8f-b9c98314f54f tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:32:08.836495 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d25efd10-54a0-4fb6-aa8f-b9c98314f54f tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:32:08.837070 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d25efd10-54a0-4fb6-aa8f-b9c98314f54f tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:32:08.837424 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d25efd10-54a0-4fb6-aa8f-b9c98314f54f tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:32:09.004444 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-d25efd10-54a0-4fb6-aa8f-b9c98314f54f tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:32:09.013958 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-d25efd10-54a0-4fb6-aa8f-b9c98314f54f tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:32:09.015933 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-d25efd10-54a0-4fb6-aa8f-b9c98314f54f tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:32:09.017070 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-d25efd10-54a0-4fb6-aa8f-b9c98314f54f tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] 10.222.0.43 "GET /compute/v2.1/servers/a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4" status: 200 len: 1729 microversion: 2.20 time: 0.198143 Oct 04 22:32:09.017635 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3745/6695] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:32:08 2022] GET /compute/v2.1/servers/a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4 => generated 1729 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 22:32:09.454117 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-c309044d-6f68-421a-b4ae-dcc22bb57208 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:32:09.454928 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-c309044d-6f68-421a-b4ae-dcc22bb57208 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: f1dea61d-0ca6-457d-9d1b-3aff96427d52] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:32:09.462079 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c309044d-6f68-421a-b4ae-dcc22bb57208 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:32:09.462616 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c309044d-6f68-421a-b4ae-dcc22bb57208 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:32:09.463082 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c309044d-6f68-421a-b4ae-dcc22bb57208 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:32:09.463924 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c309044d-6f68-421a-b4ae-dcc22bb57208 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:32:09.464548 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c309044d-6f68-421a-b4ae-dcc22bb57208 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:32:09.464996 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c309044d-6f68-421a-b4ae-dcc22bb57208 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:32:09.479828 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-c309044d-6f68-421a-b4ae-dcc22bb57208 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] HTTP exception thrown: Instance f1dea61d-0ca6-457d-9d1b-3aff96427d52 could not be found. Oct 04 22:32:09.481928 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-c309044d-6f68-421a-b4ae-dcc22bb57208 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Request method failure captured: Oct 04 22:32:09.481928 n-d-860284-1 devstack@n-api.service[134101]: request: GET /compute/v2.1/servers/f1dea61d-0ca6-457d-9d1b-3aff96427d52 HTTP/1.1 Oct 04 22:32:09.481928 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 22:32:09.481928 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 22:32:09.481928 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 22:32:09.481928 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 22:32:09.481928 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 22:32:09.481928 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 22:32:09.481928 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 22:32:09.481928 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 22:32:09.481928 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPLFSMo9Eg9y9Lu454XN1MXkt5BE7HeG-NZdibz9nP5ZbzTcA5eo2fVm4gnqUdOUNPfyWilTQor2E780fAI_U9XTD5akzJ8-jVP8Fthos4syj8Pc9nJeMuZjrdlu2EkiFF5ef-9mxCQWUxHOpcRBLI1i5aPH69baR_Z4N2zYKYuhPE2w Oct 04 22:32:09.481928 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 22:32:09.481928 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 22:32:09.481928 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 22:32:09.481928 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 22:32:09.481928 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 22:32:09.481928 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 22:32:09.481928 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: 5c98a72bacce47c3947f9b0f0b4e85b6 Oct 04 22:32:09.481928 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-TestVolumeBootPattern-1701442207 Oct 04 22:32:09.481928 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 22:32:09.481928 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 22:32:09.481928 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5c98a72bacce47c3947f9b0f0b4e85b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_5c98a72bacce47c3947f9b0f0b4e85b6", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5c98a72bacce47c3947f9b0f0b4e85b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/5c98a72bacce47c3947f9b0f0b4e85b6"}]}] Oct 04 22:32:09.481928 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-TestVolumeBootPattern-1701442207 Oct 04 22:32:09.481928 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: 5c98a72bacce47c3947f9b0f0b4e85b6 Oct 04 22:32:09.481928 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-TestVolumeBootPattern-1701442207 Oct 04 22:32:09.481928 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-TestVolumeBootPattern-1701442207-project Oct 04 22:32:09.481928 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 22:32:09.481928 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 22:32:09.481928 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 99acad09db70445b93ae1d64a1b49ca3 Oct 04 22:32:09.481928 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-TestVolumeBootPattern-1701442207-project Oct 04 22:32:09.481928 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 22:32:09.481928 n-d-860284-1 devstack@n-api.service[134101]: exception: Instance f1dea61d-0ca6-457d-9d1b-3aff96427d52 could not be found. Oct 04 22:32:09.481928 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': 'f1dea61d-0ca6-457d-9d1b-3aff96427d52'} Oct 04 22:32:09.481928 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:32:09.481928 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:32:09.481928 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:32:09.481928 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:32:09.481928 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:32:09.481928 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:32:09.481928 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:32:09.481928 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:32:09.481928 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:32:09.481928 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:32:09.481928 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1dea61d-0ca6-457d-9d1b-3aff96427d52 could not be found. Oct 04 22:32:09.481928 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:32:09.481928 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:32:09.481928 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:32:09.481928 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:32:09.481928 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:32:09.481928 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:32:09.481928 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:32:09.481928 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:32:09.481928 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:32:09.481928 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:32:09.481928 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:32:09.481928 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:32:09.481928 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:32:09.481928 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:32:09.481928 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:32:09.481928 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:32:09.481928 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1dea61d-0ca6-457d-9d1b-3aff96427d52 could not be found. Oct 04 22:32:09.481928 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:32:09.481928 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:32:09.481928 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:32:09.487719 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:32:09.487719 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:32:09.487719 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:32:09.487719 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:32:09.487719 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:32:09.487719 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1dea61d-0ca6-457d-9d1b-3aff96427d52 could not be found. Oct 04 22:32:09.487719 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:32:09.487719 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-c309044d-6f68-421a-b4ae-dcc22bb57208 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Returning 404 to user: Instance f1dea61d-0ca6-457d-9d1b-3aff96427d52 could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:32:09.487719 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-c309044d-6f68-421a-b4ae-dcc22bb57208 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/f1dea61d-0ca6-457d-9d1b-3aff96427d52" status: 404 len: 111 microversion: 2.1 time: 0.034137 Oct 04 22:32:09.487719 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3746/6696] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:32:09 2022] GET /compute/v2.1/servers/f1dea61d-0ca6-457d-9d1b-3aff96427d52 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:32:09.965616 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-8ee5991f-df5e-4deb-9295-7a77fc0752cf tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:32:09.966139 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-8ee5991f-df5e-4deb-9295-7a77fc0752cf tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: 47aa758b-a866-4254-b7ff-47ed2bd1c87f] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:32:09.972553 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8ee5991f-df5e-4deb-9295-7a77fc0752cf tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:32:09.973057 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8ee5991f-df5e-4deb-9295-7a77fc0752cf tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:32:09.973513 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8ee5991f-df5e-4deb-9295-7a77fc0752cf tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:32:09.974221 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8ee5991f-df5e-4deb-9295-7a77fc0752cf tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:32:09.974789 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8ee5991f-df5e-4deb-9295-7a77fc0752cf tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:32:09.975238 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8ee5991f-df5e-4deb-9295-7a77fc0752cf tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:32:09.989265 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-8ee5991f-df5e-4deb-9295-7a77fc0752cf tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] HTTP exception thrown: Instance 47aa758b-a866-4254-b7ff-47ed2bd1c87f could not be found. Oct 04 22:32:09.990942 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-8ee5991f-df5e-4deb-9295-7a77fc0752cf tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Request method failure captured: Oct 04 22:32:09.990942 n-d-860284-1 devstack@n-api.service[134101]: request: DELETE /compute/v2.1/servers/47aa758b-a866-4254-b7ff-47ed2bd1c87f HTTP/1.1 Oct 04 22:32:09.990942 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 22:32:09.990942 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 22:32:09.990942 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 22:32:09.990942 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 22:32:09.990942 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 22:32:09.990942 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 22:32:09.990942 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 22:32:09.990942 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 22:32:09.990942 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPLFSMo9Eg9y9Lu454XN1MXkt5BE7HeG-NZdibz9nP5ZbzTcA5eo2fVm4gnqUdOUNPfyWilTQor2E780fAI_U9XTD5akzJ8-jVP8Fthos4syj8Pc9nJeMuZjrdlu2EkiFF5ef-9mxCQWUxHOpcRBLI1i5aPH69baR_Z4N2zYKYuhPE2w Oct 04 22:32:09.990942 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 22:32:09.990942 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 22:32:09.990942 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 22:32:09.990942 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 22:32:09.990942 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 22:32:09.990942 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 22:32:09.990942 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: 5c98a72bacce47c3947f9b0f0b4e85b6 Oct 04 22:32:09.990942 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-TestVolumeBootPattern-1701442207 Oct 04 22:32:09.990942 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 22:32:09.990942 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 22:32:09.990942 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5c98a72bacce47c3947f9b0f0b4e85b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_5c98a72bacce47c3947f9b0f0b4e85b6", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5c98a72bacce47c3947f9b0f0b4e85b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/5c98a72bacce47c3947f9b0f0b4e85b6"}]}] Oct 04 22:32:09.990942 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-TestVolumeBootPattern-1701442207 Oct 04 22:32:09.990942 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: 5c98a72bacce47c3947f9b0f0b4e85b6 Oct 04 22:32:09.990942 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-TestVolumeBootPattern-1701442207 Oct 04 22:32:09.990942 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-TestVolumeBootPattern-1701442207-project Oct 04 22:32:09.990942 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 22:32:09.990942 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 22:32:09.990942 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 99acad09db70445b93ae1d64a1b49ca3 Oct 04 22:32:09.990942 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-TestVolumeBootPattern-1701442207-project Oct 04 22:32:09.990942 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 22:32:09.990942 n-d-860284-1 devstack@n-api.service[134101]: exception: Instance 47aa758b-a866-4254-b7ff-47ed2bd1c87f could not be found. Oct 04 22:32:09.990942 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': '47aa758b-a866-4254-b7ff-47ed2bd1c87f'} Oct 04 22:32:09.990942 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:32:09.990942 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:32:09.990942 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:32:09.990942 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:32:09.990942 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:32:09.990942 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:32:09.990942 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:32:09.990942 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:32:09.990942 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:32:09.990942 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:32:09.990942 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47aa758b-a866-4254-b7ff-47ed2bd1c87f could not be found. Oct 04 22:32:09.990942 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:32:09.990942 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:32:09.990942 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:32:09.990942 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:32:09.990942 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:32:09.990942 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:32:09.990942 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:32:09.990942 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:32:09.990942 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:32:09.990942 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:32:09.990942 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 22:32:09.990942 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 22:32:09.990942 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 22:32:09.990942 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 22:32:09.990942 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:32:09.990942 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:32:09.990942 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:32:09.990942 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:32:09.997558 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47aa758b-a866-4254-b7ff-47ed2bd1c87f could not be found. Oct 04 22:32:09.997558 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:32:09.997558 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:32:09.997558 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:32:09.997558 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:32:09.997558 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:32:09.997558 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:32:09.997558 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:32:09.997558 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:32:09.997558 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47aa758b-a866-4254-b7ff-47ed2bd1c87f could not be found. Oct 04 22:32:09.997558 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:32:09.997558 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-8ee5991f-df5e-4deb-9295-7a77fc0752cf tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Returning 404 to user: Instance 47aa758b-a866-4254-b7ff-47ed2bd1c87f could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:32:09.997558 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-8ee5991f-df5e-4deb-9295-7a77fc0752cf tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "DELETE /compute/v2.1/servers/47aa758b-a866-4254-b7ff-47ed2bd1c87f" status: 404 len: 111 microversion: 2.1 time: 0.031186 Oct 04 22:32:09.997558 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3747/6697] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 22:32:09 2022] DELETE /compute/v2.1/servers/47aa758b-a866-4254-b7ff-47ed2bd1c87f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 22:32:10.002132 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-bfa890bd-4431-4c03-9d84-b7e0b4a78a47 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:32:10.002889 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-bfa890bd-4431-4c03-9d84-b7e0b4a78a47 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] [instance: 47aa758b-a866-4254-b7ff-47ed2bd1c87f] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:32:10.009333 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bfa890bd-4431-4c03-9d84-b7e0b4a78a47 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:32:10.009885 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bfa890bd-4431-4c03-9d84-b7e0b4a78a47 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:32:10.010339 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bfa890bd-4431-4c03-9d84-b7e0b4a78a47 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:32:10.011784 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bfa890bd-4431-4c03-9d84-b7e0b4a78a47 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:32:10.012251 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bfa890bd-4431-4c03-9d84-b7e0b4a78a47 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:32:10.012692 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bfa890bd-4431-4c03-9d84-b7e0b4a78a47 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:32:10.027231 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-bfa890bd-4431-4c03-9d84-b7e0b4a78a47 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] HTTP exception thrown: Instance 47aa758b-a866-4254-b7ff-47ed2bd1c87f could not be found. Oct 04 22:32:10.028990 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-bfa890bd-4431-4c03-9d84-b7e0b4a78a47 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Request method failure captured: Oct 04 22:32:10.028990 n-d-860284-1 devstack@n-api.service[134101]: request: GET /compute/v2.1/servers/47aa758b-a866-4254-b7ff-47ed2bd1c87f HTTP/1.1 Oct 04 22:32:10.028990 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 22:32:10.028990 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 22:32:10.028990 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 22:32:10.028990 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 22:32:10.028990 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 22:32:10.028990 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 22:32:10.028990 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 22:32:10.028990 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 22:32:10.028990 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPLFSMo9Eg9y9Lu454XN1MXkt5BE7HeG-NZdibz9nP5ZbzTcA5eo2fVm4gnqUdOUNPfyWilTQor2E780fAI_U9XTD5akzJ8-jVP8Fthos4syj8Pc9nJeMuZjrdlu2EkiFF5ef-9mxCQWUxHOpcRBLI1i5aPH69baR_Z4N2zYKYuhPE2w Oct 04 22:32:10.028990 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 22:32:10.028990 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 22:32:10.028990 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 22:32:10.028990 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 22:32:10.028990 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 22:32:10.028990 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 22:32:10.028990 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: 5c98a72bacce47c3947f9b0f0b4e85b6 Oct 04 22:32:10.028990 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-TestVolumeBootPattern-1701442207 Oct 04 22:32:10.028990 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 22:32:10.028990 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 22:32:10.028990 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5c98a72bacce47c3947f9b0f0b4e85b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_5c98a72bacce47c3947f9b0f0b4e85b6", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5c98a72bacce47c3947f9b0f0b4e85b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/5c98a72bacce47c3947f9b0f0b4e85b6"}]}] Oct 04 22:32:10.028990 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-TestVolumeBootPattern-1701442207 Oct 04 22:32:10.028990 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: 5c98a72bacce47c3947f9b0f0b4e85b6 Oct 04 22:32:10.028990 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-TestVolumeBootPattern-1701442207 Oct 04 22:32:10.028990 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-TestVolumeBootPattern-1701442207-project Oct 04 22:32:10.028990 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 22:32:10.028990 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 22:32:10.028990 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 99acad09db70445b93ae1d64a1b49ca3 Oct 04 22:32:10.028990 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-TestVolumeBootPattern-1701442207-project Oct 04 22:32:10.028990 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 22:32:10.028990 n-d-860284-1 devstack@n-api.service[134101]: exception: Instance 47aa758b-a866-4254-b7ff-47ed2bd1c87f could not be found. Oct 04 22:32:10.028990 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': '47aa758b-a866-4254-b7ff-47ed2bd1c87f'} Oct 04 22:32:10.028990 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:32:10.028990 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:32:10.028990 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:32:10.028990 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:32:10.028990 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:32:10.028990 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:32:10.028990 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:32:10.028990 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:32:10.028990 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:32:10.028990 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:32:10.028990 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47aa758b-a866-4254-b7ff-47ed2bd1c87f could not be found. Oct 04 22:32:10.028990 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:32:10.028990 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:32:10.028990 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:32:10.028990 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:32:10.028990 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:32:10.028990 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:32:10.028990 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:32:10.028990 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:32:10.028990 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:32:10.028990 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:32:10.028990 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:32:10.028990 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:32:10.028990 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:32:10.028990 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:32:10.028990 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:32:10.028990 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:32:10.028990 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47aa758b-a866-4254-b7ff-47ed2bd1c87f could not be found. Oct 04 22:32:10.028990 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:32:10.028990 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:32:10.028990 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:32:10.035289 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:32:10.035289 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:32:10.035289 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:32:10.035289 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:32:10.035289 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:32:10.035289 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47aa758b-a866-4254-b7ff-47ed2bd1c87f could not be found. Oct 04 22:32:10.035289 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:32:10.035289 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-bfa890bd-4431-4c03-9d84-b7e0b4a78a47 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Returning 404 to user: Instance 47aa758b-a866-4254-b7ff-47ed2bd1c87f could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:32:10.035289 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-bfa890bd-4431-4c03-9d84-b7e0b4a78a47 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "GET /compute/v2.1/servers/47aa758b-a866-4254-b7ff-47ed2bd1c87f" status: 404 len: 111 microversion: 2.1 time: 0.032144 Oct 04 22:32:10.035289 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3748/6698] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:32:09 2022] GET /compute/v2.1/servers/47aa758b-a866-4254-b7ff-47ed2bd1c87f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 22:32:10.044082 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-72799d67-4fe4-4dfa-bd17-74c8b28ff8aa tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:32:10.044759 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-72799d67-4fe4-4dfa-bd17-74c8b28ff8aa tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] [instance: a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:32:10.051125 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-72799d67-4fe4-4dfa-bd17-74c8b28ff8aa tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:32:10.051636 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-72799d67-4fe4-4dfa-bd17-74c8b28ff8aa tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:32:10.052148 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-72799d67-4fe4-4dfa-bd17-74c8b28ff8aa tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:32:10.052859 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-72799d67-4fe4-4dfa-bd17-74c8b28ff8aa tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:32:10.053409 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-72799d67-4fe4-4dfa-bd17-74c8b28ff8aa tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:32:10.053826 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-72799d67-4fe4-4dfa-bd17-74c8b28ff8aa tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:32:10.240087 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-72799d67-4fe4-4dfa-bd17-74c8b28ff8aa tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:32:10.249979 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-72799d67-4fe4-4dfa-bd17-74c8b28ff8aa tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:32:10.251522 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-72799d67-4fe4-4dfa-bd17-74c8b28ff8aa tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:32:10.252739 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-72799d67-4fe4-4dfa-bd17-74c8b28ff8aa tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] 10.222.0.43 "GET /compute/v2.1/servers/a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4" status: 200 len: 1716 microversion: 2.20 time: 0.212942 Oct 04 22:32:10.253305 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3749/6699] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:32:10 2022] GET /compute/v2.1/servers/a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4 => generated 1716 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 22:32:13.469792 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-37fd857e-6e0a-46a6-af7d-9c862287e7a7 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Calling method '.version_select at 0x7fbb2db07d30>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:32:13.505039 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-37fd857e-6e0a-46a6-af7d-9c862287e7a7 tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1068515310" status: 202 len: 0 microversion: 2.1 time: 0.039321 Oct 04 22:32:13.506225 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3750/6700] 10.222.0.43 () {58 vars in 1263 bytes} [Tue Oct 4 22:32:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1068515310 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 22:32:38.408227 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=91 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:32:38.408997 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=84,nova_api:DELETE=1 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:32:38.413230 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-9bb1ddb7-a1ea-4053-9bf6-29359a1e40ce tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:32:38.413738 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-9bb1ddb7-a1ea-4053-9bf6-29359a1e40ce tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] [instance: 3d057e51-38a4-445e-b2b5-ac76aa567ab3] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:32:38.421530 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9bb1ddb7-a1ea-4053-9bf6-29359a1e40ce tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:32:38.422031 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9bb1ddb7-a1ea-4053-9bf6-29359a1e40ce tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:32:38.422508 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9bb1ddb7-a1ea-4053-9bf6-29359a1e40ce tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:32:38.423216 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9bb1ddb7-a1ea-4053-9bf6-29359a1e40ce tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:32:38.423683 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9bb1ddb7-a1ea-4053-9bf6-29359a1e40ce tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:32:38.424149 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9bb1ddb7-a1ea-4053-9bf6-29359a1e40ce tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:32:38.453189 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-9bb1ddb7-a1ea-4053-9bf6-29359a1e40ce tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] [instance: 3d057e51-38a4-445e-b2b5-ac76aa567ab3] Going to try to terminate instance {{(pid=134101) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 22:32:38.535278 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-9bb1ddb7-a1ea-4053-9bf6-29359a1e40ce tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] 10.222.0.43 "DELETE /compute/v2.1/servers/3d057e51-38a4-445e-b2b5-ac76aa567ab3" status: 204 len: 0 microversion: 2.1 time: 0.129397 Oct 04 22:32:38.535922 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3751/6701] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 22:32:38 2022] DELETE /compute/v2.1/servers/3d057e51-38a4-445e-b2b5-ac76aa567ab3 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 22:32:38.541156 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-38b7c335-0d3f-4e2d-a72a-b7da29edeb54 req-c477d646-d40a-4127-ab22-cff8173cea2f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d057e51-38a4-445e-b2b5-ac76aa567ab3", "tag": "16094bc3-52b3-4c3a-b7df-df6c6623cad1"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:32:38.551538 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-38b7c335-0d3f-4e2d-a72a-b7da29edeb54 req-c477d646-d40a-4127-ab22-cff8173cea2f service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:32:38.552036 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-38b7c335-0d3f-4e2d-a72a-b7da29edeb54 req-c477d646-d40a-4127-ab22-cff8173cea2f service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:32:38.552485 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-38b7c335-0d3f-4e2d-a72a-b7da29edeb54 req-c477d646-d40a-4127-ab22-cff8173cea2f service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:32:38.564691 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-38b7c335-0d3f-4e2d-a72a-b7da29edeb54 req-c477d646-d40a-4127-ab22-cff8173cea2f service nova] Creating event network-changed:16094bc3-52b3-4c3a-b7df-df6c6623cad1 for instance 3d057e51-38a4-445e-b2b5-ac76aa567ab3 on n-h2-860284-1 Oct 04 22:32:38.569494 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-38b7c335-0d3f-4e2d-a72a-b7da29edeb54 req-c477d646-d40a-4127-ab22-cff8173cea2f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032334 Oct 04 22:32:38.570097 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3752/6702] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:32:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:32:38.578466 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-7d0ca92d-34d9-42be-89bd-b3772b4c57fc tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:32:38.579182 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-7d0ca92d-34d9-42be-89bd-b3772b4c57fc tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] [instance: 3d057e51-38a4-445e-b2b5-ac76aa567ab3] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:32:38.585461 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7d0ca92d-34d9-42be-89bd-b3772b4c57fc tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:32:38.585969 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7d0ca92d-34d9-42be-89bd-b3772b4c57fc tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:32:38.586451 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7d0ca92d-34d9-42be-89bd-b3772b4c57fc tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:32:38.587162 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7d0ca92d-34d9-42be-89bd-b3772b4c57fc tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:32:38.587633 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7d0ca92d-34d9-42be-89bd-b3772b4c57fc tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:32:38.588077 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7d0ca92d-34d9-42be-89bd-b3772b4c57fc tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:32:38.729659 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-7d0ca92d-34d9-42be-89bd-b3772b4c57fc tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b6b686aa4874b9ca998e9e1898d8d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65234c569b29466d85335f035aa7ede4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:32:38.737664 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-7d0ca92d-34d9-42be-89bd-b3772b4c57fc tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] 10.222.0.43 "GET /compute/v2.1/servers/3d057e51-38a4-445e-b2b5-ac76aa567ab3" status: 200 len: 1583 microversion: 2.1 time: 0.163336 Oct 04 22:32:38.738655 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3753/6703] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:32:38 2022] GET /compute/v2.1/servers/3d057e51-38a4-445e-b2b5-ac76aa567ab3 => generated 1583 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:32:39.762451 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-3d68bc3d-f016-4db3-96c9-9afe124164f4 tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:32:39.763157 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-3d68bc3d-f016-4db3-96c9-9afe124164f4 tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] [instance: 3d057e51-38a4-445e-b2b5-ac76aa567ab3] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:32:39.770481 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3d68bc3d-f016-4db3-96c9-9afe124164f4 tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:32:39.771020 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3d68bc3d-f016-4db3-96c9-9afe124164f4 tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:32:39.771504 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3d68bc3d-f016-4db3-96c9-9afe124164f4 tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:32:39.772228 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3d68bc3d-f016-4db3-96c9-9afe124164f4 tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:32:39.773399 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3d68bc3d-f016-4db3-96c9-9afe124164f4 tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:32:39.773850 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3d68bc3d-f016-4db3-96c9-9afe124164f4 tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:32:39.910822 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-3d68bc3d-f016-4db3-96c9-9afe124164f4 tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b6b686aa4874b9ca998e9e1898d8d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65234c569b29466d85335f035aa7ede4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:32:39.919512 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-3d68bc3d-f016-4db3-96c9-9afe124164f4 tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] 10.222.0.43 "GET /compute/v2.1/servers/3d057e51-38a4-445e-b2b5-ac76aa567ab3" status: 200 len: 1583 microversion: 2.1 time: 0.161959 Oct 04 22:32:39.920305 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3754/6704] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:32:39 2022] GET /compute/v2.1/servers/3d057e51-38a4-445e-b2b5-ac76aa567ab3 => generated 1583 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:32:40.840917 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-f8c57aa0-8eed-43cc-a65d-0eeb46ced8ac req-cba5fbab-1f2a-41f2-9a2e-44049733b9aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d057e51-38a4-445e-b2b5-ac76aa567ab3", "name": "network-vif-deleted", "tag": "16094bc3-52b3-4c3a-b7df-df6c6623cad1"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:32:40.852922 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-f8c57aa0-8eed-43cc-a65d-0eeb46ced8ac req-cba5fbab-1f2a-41f2-9a2e-44049733b9aa service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:32:40.853411 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-f8c57aa0-8eed-43cc-a65d-0eeb46ced8ac req-cba5fbab-1f2a-41f2-9a2e-44049733b9aa service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:32:40.853850 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-f8c57aa0-8eed-43cc-a65d-0eeb46ced8ac req-cba5fbab-1f2a-41f2-9a2e-44049733b9aa service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:32:40.866739 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-f8c57aa0-8eed-43cc-a65d-0eeb46ced8ac req-cba5fbab-1f2a-41f2-9a2e-44049733b9aa service nova] Creating event network-vif-deleted:16094bc3-52b3-4c3a-b7df-df6c6623cad1 for instance 3d057e51-38a4-445e-b2b5-ac76aa567ab3 on n-h2-860284-1 Oct 04 22:32:40.873310 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-f8c57aa0-8eed-43cc-a65d-0eeb46ced8ac req-cba5fbab-1f2a-41f2-9a2e-44049733b9aa service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036277 Oct 04 22:32:40.873870 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3755/6705] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:32:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:32:40.944949 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-518c27de-4d29-4724-9a7b-d0108a33419b tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:32:40.945748 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-518c27de-4d29-4724-9a7b-d0108a33419b tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] [instance: 3d057e51-38a4-445e-b2b5-ac76aa567ab3] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:32:40.952171 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-518c27de-4d29-4724-9a7b-d0108a33419b tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:32:40.952669 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-518c27de-4d29-4724-9a7b-d0108a33419b tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:32:40.953117 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-518c27de-4d29-4724-9a7b-d0108a33419b tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:32:40.953826 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-518c27de-4d29-4724-9a7b-d0108a33419b tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:32:40.954293 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-518c27de-4d29-4724-9a7b-d0108a33419b tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:32:40.954810 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-518c27de-4d29-4724-9a7b-d0108a33419b tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:32:41.021100 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-518c27de-4d29-4724-9a7b-d0108a33419b tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b6b686aa4874b9ca998e9e1898d8d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65234c569b29466d85335f035aa7ede4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:32:41.029851 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-518c27de-4d29-4724-9a7b-d0108a33419b tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] 10.222.0.43 "GET /compute/v2.1/servers/3d057e51-38a4-445e-b2b5-ac76aa567ab3" status: 200 len: 1229 microversion: 2.1 time: 0.089082 Oct 04 22:32:41.030458 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3756/6706] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:32:40 2022] GET /compute/v2.1/servers/3d057e51-38a4-445e-b2b5-ac76aa567ab3 => generated 1229 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:32:42.053798 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-6c161918-b551-4109-ad43-abf2684c37ba tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:32:42.054500 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-6c161918-b551-4109-ad43-abf2684c37ba tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] [instance: 3d057e51-38a4-445e-b2b5-ac76aa567ab3] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:32:42.062667 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6c161918-b551-4109-ad43-abf2684c37ba tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:32:42.063177 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6c161918-b551-4109-ad43-abf2684c37ba tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:32:42.063632 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6c161918-b551-4109-ad43-abf2684c37ba tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:32:42.064356 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6c161918-b551-4109-ad43-abf2684c37ba tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:32:42.064839 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6c161918-b551-4109-ad43-abf2684c37ba tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:32:42.065346 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6c161918-b551-4109-ad43-abf2684c37ba tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:32:42.138252 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-6c161918-b551-4109-ad43-abf2684c37ba tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b6b686aa4874b9ca998e9e1898d8d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65234c569b29466d85335f035aa7ede4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:32:42.146786 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-6c161918-b551-4109-ad43-abf2684c37ba tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] 10.222.0.43 "GET /compute/v2.1/servers/3d057e51-38a4-445e-b2b5-ac76aa567ab3" status: 200 len: 1229 microversion: 2.1 time: 0.096878 Oct 04 22:32:42.147576 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3757/6707] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:32:42 2022] GET /compute/v2.1/servers/3d057e51-38a4-445e-b2b5-ac76aa567ab3 => generated 1229 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:32:43.171153 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-126f47c6-bfe8-41d7-a5a1-a05ca959c4d4 tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:32:43.171894 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-126f47c6-bfe8-41d7-a5a1-a05ca959c4d4 tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] [instance: 3d057e51-38a4-445e-b2b5-ac76aa567ab3] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:32:43.178868 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-126f47c6-bfe8-41d7-a5a1-a05ca959c4d4 tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:32:43.179363 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-126f47c6-bfe8-41d7-a5a1-a05ca959c4d4 tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:32:43.179813 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-126f47c6-bfe8-41d7-a5a1-a05ca959c4d4 tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:32:43.180522 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-126f47c6-bfe8-41d7-a5a1-a05ca959c4d4 tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:32:43.180990 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-126f47c6-bfe8-41d7-a5a1-a05ca959c4d4 tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:32:43.181423 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-126f47c6-bfe8-41d7-a5a1-a05ca959c4d4 tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:32:43.249312 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-126f47c6-bfe8-41d7-a5a1-a05ca959c4d4 tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b6b686aa4874b9ca998e9e1898d8d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65234c569b29466d85335f035aa7ede4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:32:43.257797 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-126f47c6-bfe8-41d7-a5a1-a05ca959c4d4 tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] 10.222.0.43 "GET /compute/v2.1/servers/3d057e51-38a4-445e-b2b5-ac76aa567ab3" status: 200 len: 1229 microversion: 2.1 time: 0.091317 Oct 04 22:32:43.258696 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3758/6708] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:32:43 2022] GET /compute/v2.1/servers/3d057e51-38a4-445e-b2b5-ac76aa567ab3 => generated 1229 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:32:44.281215 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-99cb0334-404a-42d5-b05c-e1f3bc3810bb tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:32:44.281893 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-99cb0334-404a-42d5-b05c-e1f3bc3810bb tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] [instance: 3d057e51-38a4-445e-b2b5-ac76aa567ab3] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:32:44.288774 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-99cb0334-404a-42d5-b05c-e1f3bc3810bb tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:32:44.289281 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-99cb0334-404a-42d5-b05c-e1f3bc3810bb tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:32:44.289739 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-99cb0334-404a-42d5-b05c-e1f3bc3810bb tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:32:44.290478 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-99cb0334-404a-42d5-b05c-e1f3bc3810bb tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:32:44.290955 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-99cb0334-404a-42d5-b05c-e1f3bc3810bb tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:32:44.291403 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-99cb0334-404a-42d5-b05c-e1f3bc3810bb tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:32:44.353387 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-99cb0334-404a-42d5-b05c-e1f3bc3810bb tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b6b686aa4874b9ca998e9e1898d8d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65234c569b29466d85335f035aa7ede4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:32:44.362218 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-99cb0334-404a-42d5-b05c-e1f3bc3810bb tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] 10.222.0.43 "GET /compute/v2.1/servers/3d057e51-38a4-445e-b2b5-ac76aa567ab3" status: 200 len: 1229 microversion: 2.1 time: 0.085004 Oct 04 22:32:44.362830 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3759/6709] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:32:44 2022] GET /compute/v2.1/servers/3d057e51-38a4-445e-b2b5-ac76aa567ab3 => generated 1229 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:32:45.385320 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-41112fe5-dff6-4137-8d99-afc284048f14 tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:32:45.386077 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-41112fe5-dff6-4137-8d99-afc284048f14 tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] [instance: 3d057e51-38a4-445e-b2b5-ac76aa567ab3] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:32:45.393039 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-41112fe5-dff6-4137-8d99-afc284048f14 tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:32:45.393532 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-41112fe5-dff6-4137-8d99-afc284048f14 tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:32:45.393980 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-41112fe5-dff6-4137-8d99-afc284048f14 tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:32:45.394739 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-41112fe5-dff6-4137-8d99-afc284048f14 tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:32:45.395206 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-41112fe5-dff6-4137-8d99-afc284048f14 tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:32:45.395647 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-41112fe5-dff6-4137-8d99-afc284048f14 tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:32:45.429429 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-41112fe5-dff6-4137-8d99-afc284048f14 tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:32:45.429936 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-41112fe5-dff6-4137-8d99-afc284048f14 tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:32:45.431455 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-41112fe5-dff6-4137-8d99-afc284048f14 tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:32:45.432054 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.objects.instance [None req-41112fe5-dff6-4137-8d99-afc284048f14 tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Lazy-loading 'fault' on Instance uuid 3d057e51-38a4-445e-b2b5-ac76aa567ab3 {{(pid=134101) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 22:32:45.476406 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-41112fe5-dff6-4137-8d99-afc284048f14 tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b6b686aa4874b9ca998e9e1898d8d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65234c569b29466d85335f035aa7ede4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:32:45.484568 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-41112fe5-dff6-4137-8d99-afc284048f14 tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] 10.222.0.43 "GET /compute/v2.1/servers/3d057e51-38a4-445e-b2b5-ac76aa567ab3" status: 200 len: 1188 microversion: 2.1 time: 0.103219 Oct 04 22:32:45.485138 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3760/6710] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:32:45 2022] GET /compute/v2.1/servers/3d057e51-38a4-445e-b2b5-ac76aa567ab3 => generated 1188 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:32:46.508411 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-df04711d-57e0-476a-bfe7-a64c369bc563 tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:32:46.509071 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-df04711d-57e0-476a-bfe7-a64c369bc563 tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] [instance: 3d057e51-38a4-445e-b2b5-ac76aa567ab3] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:32:46.516629 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-df04711d-57e0-476a-bfe7-a64c369bc563 tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:32:46.517133 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-df04711d-57e0-476a-bfe7-a64c369bc563 tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:32:46.517595 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-df04711d-57e0-476a-bfe7-a64c369bc563 tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:32:46.518313 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-df04711d-57e0-476a-bfe7-a64c369bc563 tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:32:46.518823 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-df04711d-57e0-476a-bfe7-a64c369bc563 tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:32:46.519418 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-df04711d-57e0-476a-bfe7-a64c369bc563 tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:32:46.533012 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-df04711d-57e0-476a-bfe7-a64c369bc563 tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] HTTP exception thrown: Instance 3d057e51-38a4-445e-b2b5-ac76aa567ab3 could not be found. Oct 04 22:32:46.534702 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-df04711d-57e0-476a-bfe7-a64c369bc563 tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Request method failure captured: Oct 04 22:32:46.534702 n-d-860284-1 devstack@n-api.service[134101]: request: GET /compute/v2.1/servers/3d057e51-38a4-445e-b2b5-ac76aa567ab3 HTTP/1.1 Oct 04 22:32:46.534702 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 22:32:46.534702 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 22:32:46.534702 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 22:32:46.534702 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 22:32:46.534702 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 22:32:46.534702 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 22:32:46.534702 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 22:32:46.534702 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 22:32:46.534702 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPLPHRH0fA16aMafwxwtUM-kTIXAkvdDts5tCI1p877BpitHM-_HGnlYbOHpMvxpRwOZ-YVvwkJn86-c-z0muRTkwvC44XIhVKHQUsiQ5_H0RTjDWLcZvW-fLz_8YR1Kpd-3Y7gKgmeX5zkHoDV8S3GndgehsDOnfOBO9WX4Wv9CoLhk Oct 04 22:32:46.534702 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 22:32:46.534702 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 22:32:46.534702 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 22:32:46.534702 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 22:32:46.534702 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 22:32:46.534702 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 22:32:46.534702 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: 65234c569b29466d85335f035aa7ede4 Oct 04 22:32:46.534702 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-TestVolumeBackupRestore-752194523 Oct 04 22:32:46.534702 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 22:32:46.534702 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 22:32:46.534702 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/65234c569b29466d85335f035aa7ede4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_65234c569b29466d85335f035aa7ede4", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/65234c569b29466d85335f035aa7ede4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/65234c569b29466d85335f035aa7ede4"}]}] Oct 04 22:32:46.534702 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-TestVolumeBackupRestore-752194523 Oct 04 22:32:46.534702 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: 65234c569b29466d85335f035aa7ede4 Oct 04 22:32:46.534702 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-TestVolumeBackupRestore-752194523 Oct 04 22:32:46.534702 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-TestVolumeBackupRestore-752194523-project Oct 04 22:32:46.534702 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 22:32:46.534702 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 22:32:46.534702 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 1b6b686aa4874b9ca998e9e1898d8d47 Oct 04 22:32:46.534702 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-TestVolumeBackupRestore-752194523-project Oct 04 22:32:46.534702 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 22:32:46.534702 n-d-860284-1 devstack@n-api.service[134101]: exception: Instance 3d057e51-38a4-445e-b2b5-ac76aa567ab3 could not be found. Oct 04 22:32:46.534702 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': '3d057e51-38a4-445e-b2b5-ac76aa567ab3'} Oct 04 22:32:46.534702 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:32:46.534702 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:32:46.534702 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:32:46.534702 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:32:46.534702 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:32:46.534702 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:32:46.534702 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:32:46.534702 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:32:46.534702 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:32:46.534702 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:32:46.534702 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d057e51-38a4-445e-b2b5-ac76aa567ab3 could not be found. Oct 04 22:32:46.534702 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:32:46.534702 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:32:46.534702 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:32:46.534702 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:32:46.534702 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:32:46.534702 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:32:46.534702 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:32:46.534702 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:32:46.534702 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:32:46.534702 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:32:46.534702 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:32:46.534702 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:32:46.534702 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:32:46.534702 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:32:46.534702 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:32:46.534702 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:32:46.534702 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d057e51-38a4-445e-b2b5-ac76aa567ab3 could not be found. Oct 04 22:32:46.534702 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:32:46.534702 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:32:46.534702 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:32:46.540319 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:32:46.540319 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:32:46.540319 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:32:46.540319 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:32:46.540319 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:32:46.540319 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d057e51-38a4-445e-b2b5-ac76aa567ab3 could not be found. Oct 04 22:32:46.540319 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:32:46.540319 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-df04711d-57e0-476a-bfe7-a64c369bc563 tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Returning 404 to user: Instance 3d057e51-38a4-445e-b2b5-ac76aa567ab3 could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:32:46.540319 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-df04711d-57e0-476a-bfe7-a64c369bc563 tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] 10.222.0.43 "GET /compute/v2.1/servers/3d057e51-38a4-445e-b2b5-ac76aa567ab3" status: 404 len: 111 microversion: 2.1 time: 0.031822 Oct 04 22:32:46.540319 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3761/6711] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:32:46 2022] GET /compute/v2.1/servers/3d057e51-38a4-445e-b2b5-ac76aa567ab3 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 22:32:46.695000 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-2679999c-381c-436e-8be7-6a8dad2ff69c tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] Calling method '.version_select at 0x7fbb2ee991f0>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:32:46.718690 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-2679999c-381c-436e-8be7-6a8dad2ff69c tempest-TestVolumeBackupRestore-752194523 tempest-TestVolumeBackupRestore-752194523-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-2146117326" status: 202 len: 0 microversion: 2.1 time: 0.027820 Oct 04 22:32:46.719276 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3762/6712] 10.222.0.43 () {58 vars in 1269 bytes} [Tue Oct 4 22:32:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-2146117326 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 22:33:17.244511 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-ddacbf95-950c-452c-9dce-636db42343b0 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:33:17.247374 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-ddacbf95-950c-452c-9dce-636db42343b0 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] [instance: a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:33:17.251530 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:33:17.252206 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:33:17.258794 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ddacbf95-950c-452c-9dce-636db42343b0 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:33:17.259309 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ddacbf95-950c-452c-9dce-636db42343b0 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:33:17.259766 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ddacbf95-950c-452c-9dce-636db42343b0 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:33:17.260483 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ddacbf95-950c-452c-9dce-636db42343b0 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:33:17.260960 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ddacbf95-950c-452c-9dce-636db42343b0 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:33:17.261427 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ddacbf95-950c-452c-9dce-636db42343b0 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:33:17.293816 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-ddacbf95-950c-452c-9dce-636db42343b0 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] 10.222.0.43 "GET /compute/v2.1/servers/a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.053293 Oct 04 22:33:17.294389 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3763/6713] 10.222.0.43 () {60 vars in 1343 bytes} [Tue Oct 4 22:33:17 2022] GET /compute/v2.1/servers/a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:33:17.357355 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-ff5e448b-972f-4382-8b2b-df578a764e01 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:33:17.357869 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-ff5e448b-972f-4382-8b2b-df578a764e01 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] [instance: a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:33:17.364058 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ff5e448b-972f-4382-8b2b-df578a764e01 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:33:17.364551 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ff5e448b-972f-4382-8b2b-df578a764e01 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:33:17.365002 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ff5e448b-972f-4382-8b2b-df578a764e01 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:33:17.365711 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ff5e448b-972f-4382-8b2b-df578a764e01 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:33:17.366181 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ff5e448b-972f-4382-8b2b-df578a764e01 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:33:17.366654 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ff5e448b-972f-4382-8b2b-df578a764e01 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:33:17.392702 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-ff5e448b-972f-4382-8b2b-df578a764e01 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] [instance: a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4] Going to try to terminate instance {{(pid=134101) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 22:33:17.468283 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-ff5e448b-972f-4382-8b2b-df578a764e01 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] 10.222.0.43 "DELETE /compute/v2.1/servers/a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4" status: 204 len: 0 microversion: 2.20 time: 0.115106 Oct 04 22:33:17.468912 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3764/6714] 10.222.0.43 () {60 vars in 1280 bytes} [Tue Oct 4 22:33:17 2022] DELETE /compute/v2.1/servers/a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 04 22:33:17.478026 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-bd8ef4bd-2e73-4c3b-b481-1e68b6dd48bd tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:33:17.478695 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-bd8ef4bd-2e73-4c3b-b481-1e68b6dd48bd tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] [instance: a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:33:17.485120 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bd8ef4bd-2e73-4c3b-b481-1e68b6dd48bd tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:33:17.485625 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bd8ef4bd-2e73-4c3b-b481-1e68b6dd48bd tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:33:17.486091 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bd8ef4bd-2e73-4c3b-b481-1e68b6dd48bd tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:33:17.486859 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bd8ef4bd-2e73-4c3b-b481-1e68b6dd48bd tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:33:17.487335 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bd8ef4bd-2e73-4c3b-b481-1e68b6dd48bd tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:33:17.487777 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bd8ef4bd-2e73-4c3b-b481-1e68b6dd48bd tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:33:17.623247 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-bd8ef4bd-2e73-4c3b-b481-1e68b6dd48bd tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:33:17.631416 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-bd8ef4bd-2e73-4c3b-b481-1e68b6dd48bd tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:33:17.632898 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-bd8ef4bd-2e73-4c3b-b481-1e68b6dd48bd tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:33:17.634086 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-bd8ef4bd-2e73-4c3b-b481-1e68b6dd48bd tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] 10.222.0.43 "GET /compute/v2.1/servers/a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4" status: 200 len: 1722 microversion: 2.20 time: 0.160275 Oct 04 22:33:17.634705 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3765/6715] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:33:17 2022] GET /compute/v2.1/servers/a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 22:33:18.659158 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-cc4e387f-8140-4e66-a9b3-f2e714597211 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:33:18.659866 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-cc4e387f-8140-4e66-a9b3-f2e714597211 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] [instance: a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:33:18.666964 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cc4e387f-8140-4e66-a9b3-f2e714597211 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:33:18.667460 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cc4e387f-8140-4e66-a9b3-f2e714597211 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:33:18.668075 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cc4e387f-8140-4e66-a9b3-f2e714597211 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:33:18.668861 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cc4e387f-8140-4e66-a9b3-f2e714597211 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:33:18.669336 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cc4e387f-8140-4e66-a9b3-f2e714597211 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:33:18.669786 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cc4e387f-8140-4e66-a9b3-f2e714597211 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:33:18.810593 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-cc4e387f-8140-4e66-a9b3-f2e714597211 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:33:18.818929 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-cc4e387f-8140-4e66-a9b3-f2e714597211 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:33:18.820380 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-cc4e387f-8140-4e66-a9b3-f2e714597211 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:33:18.821561 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-cc4e387f-8140-4e66-a9b3-f2e714597211 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] 10.222.0.43 "GET /compute/v2.1/servers/a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4" status: 200 len: 1722 microversion: 2.20 time: 0.166358 Oct 04 22:33:18.822119 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3766/6716] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:33:18 2022] GET /compute/v2.1/servers/a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4 => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 22:33:19.848268 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-2a58afcd-1473-42bd-a319-79ad9068c98a tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:33:19.848954 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-2a58afcd-1473-42bd-a319-79ad9068c98a tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] [instance: a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:33:19.856184 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2a58afcd-1473-42bd-a319-79ad9068c98a tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:33:19.856691 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2a58afcd-1473-42bd-a319-79ad9068c98a tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:33:19.857147 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2a58afcd-1473-42bd-a319-79ad9068c98a tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:33:19.857889 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2a58afcd-1473-42bd-a319-79ad9068c98a tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:33:19.858397 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2a58afcd-1473-42bd-a319-79ad9068c98a tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:33:19.858867 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2a58afcd-1473-42bd-a319-79ad9068c98a tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:33:19.922569 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-2a58afcd-1473-42bd-a319-79ad9068c98a tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:33:19.930960 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-2a58afcd-1473-42bd-a319-79ad9068c98a tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:33:19.932407 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-2a58afcd-1473-42bd-a319-79ad9068c98a tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97dec2a1a8bc435c9480f89802614cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5031651f5e9a433e859e0038af1cb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:33:19.934107 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-2a58afcd-1473-42bd-a319-79ad9068c98a tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] 10.222.0.43 "GET /compute/v2.1/servers/a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4" status: 200 len: 1655 microversion: 2.20 time: 0.089400 Oct 04 22:33:19.934900 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3767/6717] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:33:19 2022] GET /compute/v2.1/servers/a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4 => generated 1655 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 22:33:20.009395 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-83e96f6d-ea33-41fe-bd2c-5a8f3e2b6777 req-e005ec1c-2ef0-421f-b9f5-2aed4d2b4246 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4", "name": "network-vif-deleted", "tag": "c125f571-485f-4f51-9daa-780c14a6c4c9"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:33:20.020415 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-83e96f6d-ea33-41fe-bd2c-5a8f3e2b6777 req-e005ec1c-2ef0-421f-b9f5-2aed4d2b4246 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:33:20.020919 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-83e96f6d-ea33-41fe-bd2c-5a8f3e2b6777 req-e005ec1c-2ef0-421f-b9f5-2aed4d2b4246 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:33:20.021369 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-83e96f6d-ea33-41fe-bd2c-5a8f3e2b6777 req-e005ec1c-2ef0-421f-b9f5-2aed4d2b4246 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:33:20.033766 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-83e96f6d-ea33-41fe-bd2c-5a8f3e2b6777 req-e005ec1c-2ef0-421f-b9f5-2aed4d2b4246 service nova] Creating event network-vif-deleted:c125f571-485f-4f51-9daa-780c14a6c4c9 for instance a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4 on n-h1-860284-1 Oct 04 22:33:20.039027 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-83e96f6d-ea33-41fe-bd2c-5a8f3e2b6777 req-e005ec1c-2ef0-421f-b9f5-2aed4d2b4246 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033197 Oct 04 22:33:20.039655 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3768/6718] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:33:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:33:20.962037 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-26309832-3c7c-4712-b054-09223d63c9a2 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:33:20.962720 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-26309832-3c7c-4712-b054-09223d63c9a2 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] [instance: a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:33:20.969745 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-26309832-3c7c-4712-b054-09223d63c9a2 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:33:20.970250 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-26309832-3c7c-4712-b054-09223d63c9a2 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:33:20.970726 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-26309832-3c7c-4712-b054-09223d63c9a2 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:33:20.971567 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-26309832-3c7c-4712-b054-09223d63c9a2 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:33:20.972039 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-26309832-3c7c-4712-b054-09223d63c9a2 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:33:20.972478 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-26309832-3c7c-4712-b054-09223d63c9a2 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:33:20.988110 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-26309832-3c7c-4712-b054-09223d63c9a2 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] HTTP exception thrown: Instance a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4 could not be found. Oct 04 22:33:20.989807 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-26309832-3c7c-4712-b054-09223d63c9a2 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Request method failure captured: Oct 04 22:33:20.989807 n-d-860284-1 devstack@n-api.service[134101]: request: GET /compute/v2.1/servers/a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4 HTTP/1.1 Oct 04 22:33:20.989807 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 22:33:20.989807 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 22:33:20.989807 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 22:33:20.989807 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 22:33:20.989807 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 22:33:20.989807 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 22:33:20.989807 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 22:33:20.989807 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 22:33:20.989807 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPLLS5H9qxnEqloh4s_Fb9sQ6v6LdePhqiIpQDnLeVJr4JmljPmqpyGa-uJ13u3bEOsSAZ1TFW03S-_x_PvbUw2pbG17jm8YFHXtgKD-MkrN05c5AsrMbB2tSIMeCYW80aUJrzlT1cVLz2CGYx3NFkEdXtBWY6BOtUYpSisAtWQWbEiI Oct 04 22:33:20.989807 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 22:33:20.989807 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 22:33:20.989807 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 22:33:20.989807 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 22:33:20.989807 n-d-860284-1 devstack@n-api.service[134101]: X-Openstack-Nova-Api-Version: 2.20 Oct 04 22:33:20.989807 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 22:33:20.989807 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 22:33:20.989807 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: 5031651f5e9a433e859e0038af1cb16d Oct 04 22:33:20.989807 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-863108842 Oct 04 22:33:20.989807 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 22:33:20.989807 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 22:33:20.989807 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5031651f5e9a433e859e0038af1cb16d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_5031651f5e9a433e859e0038af1cb16d", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5031651f5e9a433e859e0038af1cb16d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/5031651f5e9a433e859e0038af1cb16d"}]}] Oct 04 22:33:20.989807 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-AttachVolumeShelveTestJSON-863108842 Oct 04 22:33:20.989807 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: 5031651f5e9a433e859e0038af1cb16d Oct 04 22:33:20.989807 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-863108842 Oct 04 22:33:20.989807 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-AttachVolumeShelveTestJSON-863108842-project Oct 04 22:33:20.989807 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 22:33:20.989807 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 22:33:20.989807 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 97dec2a1a8bc435c9480f89802614cb2 Oct 04 22:33:20.989807 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-AttachVolumeShelveTestJSON-863108842-project Oct 04 22:33:20.989807 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 22:33:20.989807 n-d-860284-1 devstack@n-api.service[134101]: exception: Instance a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4 could not be found. Oct 04 22:33:20.989807 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': 'a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4'} Oct 04 22:33:20.989807 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:33:20.989807 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:33:20.989807 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:33:20.989807 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:33:20.989807 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:33:20.989807 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:33:20.989807 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:33:20.989807 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:33:20.989807 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:33:20.989807 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:33:20.989807 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4 could not be found. Oct 04 22:33:20.989807 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:33:20.989807 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:33:20.989807 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:33:20.989807 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:33:20.989807 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:33:20.989807 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:33:20.989807 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:33:20.989807 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:33:20.989807 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:33:20.989807 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:33:20.989807 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:33:20.989807 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:33:20.989807 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:33:20.989807 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:33:20.989807 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:33:20.989807 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:33:20.989807 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4 could not be found. Oct 04 22:33:20.989807 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:33:20.989807 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:33:20.996746 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:33:20.996746 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:33:20.996746 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:33:20.996746 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:33:20.996746 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:33:20.996746 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:33:20.996746 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4 could not be found. Oct 04 22:33:20.996746 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:33:20.996746 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-26309832-3c7c-4712-b054-09223d63c9a2 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Returning 404 to user: Instance a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4 could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:33:20.996746 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-26309832-3c7c-4712-b054-09223d63c9a2 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] 10.222.0.43 "GET /compute/v2.1/servers/a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4" status: 404 len: 111 microversion: 2.20 time: 0.034932 Oct 04 22:33:21.000188 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3769/6719] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:33:20 2022] GET /compute/v2.1/servers/a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 22:33:21.004637 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-cc32bb4a-eb48-4f09-afe8-70072b3b6c7b tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Calling method '.version_select at 0x7fbb2db0ff70>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:33:21.030282 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-cc32bb4a-eb48-4f09-afe8-70072b3b6c7b tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1583439296" status: 204 len: 0 microversion: 2.20 time: 0.026087 Oct 04 22:33:21.030831 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3770/6720] 10.222.0.43 () {60 vars in 1262 bytes} [Tue Oct 4 22:33:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1583439296 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 22:33:23.856045 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-9ca9278a-ce3d-42fb-8cb3-265c5fe732a6 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:33:23.856688 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-9ca9278a-ce3d-42fb-8cb3-265c5fe732a6 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] [instance: a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:33:23.863344 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9ca9278a-ce3d-42fb-8cb3-265c5fe732a6 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:33:23.863841 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9ca9278a-ce3d-42fb-8cb3-265c5fe732a6 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:33:23.864289 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9ca9278a-ce3d-42fb-8cb3-265c5fe732a6 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:33:23.864992 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9ca9278a-ce3d-42fb-8cb3-265c5fe732a6 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:33:23.865455 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9ca9278a-ce3d-42fb-8cb3-265c5fe732a6 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:33:23.865892 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9ca9278a-ce3d-42fb-8cb3-265c5fe732a6 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:33:23.879573 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-9ca9278a-ce3d-42fb-8cb3-265c5fe732a6 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] HTTP exception thrown: Instance a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4 could not be found. Oct 04 22:33:23.881163 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-9ca9278a-ce3d-42fb-8cb3-265c5fe732a6 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Request method failure captured: Oct 04 22:33:23.881163 n-d-860284-1 devstack@n-api.service[134101]: request: DELETE /compute/v2.1/servers/a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4 HTTP/1.1 Oct 04 22:33:23.881163 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 22:33:23.881163 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 22:33:23.881163 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 22:33:23.881163 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 22:33:23.881163 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 22:33:23.881163 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 22:33:23.881163 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 22:33:23.881163 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 22:33:23.881163 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPLLS5H9qxnEqloh4s_Fb9sQ6v6LdePhqiIpQDnLeVJr4JmljPmqpyGa-uJ13u3bEOsSAZ1TFW03S-_x_PvbUw2pbG17jm8YFHXtgKD-MkrN05c5AsrMbB2tSIMeCYW80aUJrzlT1cVLz2CGYx3NFkEdXtBWY6BOtUYpSisAtWQWbEiI Oct 04 22:33:23.881163 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 22:33:23.881163 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 22:33:23.881163 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 22:33:23.881163 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 22:33:23.881163 n-d-860284-1 devstack@n-api.service[134101]: X-Openstack-Nova-Api-Version: 2.20 Oct 04 22:33:23.881163 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 22:33:23.881163 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 22:33:23.881163 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: 5031651f5e9a433e859e0038af1cb16d Oct 04 22:33:23.881163 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-863108842 Oct 04 22:33:23.881163 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 22:33:23.881163 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 22:33:23.881163 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5031651f5e9a433e859e0038af1cb16d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_5031651f5e9a433e859e0038af1cb16d", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5031651f5e9a433e859e0038af1cb16d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/5031651f5e9a433e859e0038af1cb16d"}]}] Oct 04 22:33:23.881163 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-AttachVolumeShelveTestJSON-863108842 Oct 04 22:33:23.881163 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: 5031651f5e9a433e859e0038af1cb16d Oct 04 22:33:23.881163 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-863108842 Oct 04 22:33:23.881163 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-AttachVolumeShelveTestJSON-863108842-project Oct 04 22:33:23.881163 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 22:33:23.881163 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 22:33:23.881163 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 97dec2a1a8bc435c9480f89802614cb2 Oct 04 22:33:23.881163 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-AttachVolumeShelveTestJSON-863108842-project Oct 04 22:33:23.881163 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 22:33:23.881163 n-d-860284-1 devstack@n-api.service[134101]: exception: Instance a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4 could not be found. Oct 04 22:33:23.881163 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': 'a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4'} Oct 04 22:33:23.881163 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:33:23.881163 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:33:23.881163 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:33:23.881163 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:33:23.881163 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:33:23.881163 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:33:23.881163 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:33:23.881163 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:33:23.881163 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:33:23.881163 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:33:23.881163 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4 could not be found. Oct 04 22:33:23.881163 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:33:23.881163 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:33:23.881163 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:33:23.881163 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:33:23.881163 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:33:23.881163 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:33:23.881163 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:33:23.881163 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:33:23.881163 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:33:23.881163 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:33:23.881163 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 22:33:23.881163 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 22:33:23.881163 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 22:33:23.881163 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 22:33:23.881163 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:33:23.881163 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:33:23.881163 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:33:23.881163 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:33:23.885949 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4 could not be found. Oct 04 22:33:23.885949 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:33:23.885949 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:33:23.885949 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:33:23.885949 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:33:23.885949 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:33:23.885949 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:33:23.885949 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:33:23.885949 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:33:23.885949 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4 could not be found. Oct 04 22:33:23.885949 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:33:23.885949 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-9ca9278a-ce3d-42fb-8cb3-265c5fe732a6 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Returning 404 to user: Instance a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4 could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:33:23.885949 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-9ca9278a-ce3d-42fb-8cb3-265c5fe732a6 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] 10.222.0.43 "DELETE /compute/v2.1/servers/a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4" status: 404 len: 111 microversion: 2.20 time: 0.031437 Oct 04 22:33:23.885949 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3771/6721] 10.222.0.43 () {60 vars in 1280 bytes} [Tue Oct 4 22:33:23 2022] DELETE /compute/v2.1/servers/a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 22:33:23.891695 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-681dff45-9f61-48a9-8562-9431f7d6bdf6 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:33:23.892312 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-681dff45-9f61-48a9-8562-9431f7d6bdf6 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] [instance: a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:33:23.898005 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-681dff45-9f61-48a9-8562-9431f7d6bdf6 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:33:23.898538 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-681dff45-9f61-48a9-8562-9431f7d6bdf6 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:33:23.898988 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-681dff45-9f61-48a9-8562-9431f7d6bdf6 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:33:23.899682 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-681dff45-9f61-48a9-8562-9431f7d6bdf6 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:33:23.900144 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-681dff45-9f61-48a9-8562-9431f7d6bdf6 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:33:23.900577 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-681dff45-9f61-48a9-8562-9431f7d6bdf6 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:33:23.913861 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-681dff45-9f61-48a9-8562-9431f7d6bdf6 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] HTTP exception thrown: Instance a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4 could not be found. Oct 04 22:33:23.915405 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-681dff45-9f61-48a9-8562-9431f7d6bdf6 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Request method failure captured: Oct 04 22:33:23.915405 n-d-860284-1 devstack@n-api.service[134101]: request: GET /compute/v2.1/servers/a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4 HTTP/1.1 Oct 04 22:33:23.915405 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 22:33:23.915405 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 22:33:23.915405 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 22:33:23.915405 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 22:33:23.915405 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 22:33:23.915405 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 22:33:23.915405 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 22:33:23.915405 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 22:33:23.915405 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPLLS5H9qxnEqloh4s_Fb9sQ6v6LdePhqiIpQDnLeVJr4JmljPmqpyGa-uJ13u3bEOsSAZ1TFW03S-_x_PvbUw2pbG17jm8YFHXtgKD-MkrN05c5AsrMbB2tSIMeCYW80aUJrzlT1cVLz2CGYx3NFkEdXtBWY6BOtUYpSisAtWQWbEiI Oct 04 22:33:23.915405 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 22:33:23.915405 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 22:33:23.915405 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 22:33:23.915405 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 22:33:23.915405 n-d-860284-1 devstack@n-api.service[134101]: X-Openstack-Nova-Api-Version: 2.20 Oct 04 22:33:23.915405 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 22:33:23.915405 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 22:33:23.915405 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: 5031651f5e9a433e859e0038af1cb16d Oct 04 22:33:23.915405 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-863108842 Oct 04 22:33:23.915405 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 22:33:23.915405 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 22:33:23.915405 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5031651f5e9a433e859e0038af1cb16d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_5031651f5e9a433e859e0038af1cb16d", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5031651f5e9a433e859e0038af1cb16d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/5031651f5e9a433e859e0038af1cb16d"}]}] Oct 04 22:33:23.915405 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-AttachVolumeShelveTestJSON-863108842 Oct 04 22:33:23.915405 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: 5031651f5e9a433e859e0038af1cb16d Oct 04 22:33:23.915405 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-863108842 Oct 04 22:33:23.915405 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-AttachVolumeShelveTestJSON-863108842-project Oct 04 22:33:23.915405 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 22:33:23.915405 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 22:33:23.915405 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 97dec2a1a8bc435c9480f89802614cb2 Oct 04 22:33:23.915405 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-AttachVolumeShelveTestJSON-863108842-project Oct 04 22:33:23.915405 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 22:33:23.915405 n-d-860284-1 devstack@n-api.service[134101]: exception: Instance a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4 could not be found. Oct 04 22:33:23.915405 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': 'a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4'} Oct 04 22:33:23.915405 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:33:23.915405 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:33:23.915405 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:33:23.915405 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:33:23.915405 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:33:23.915405 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:33:23.915405 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:33:23.915405 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:33:23.915405 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:33:23.915405 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:33:23.915405 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4 could not be found. Oct 04 22:33:23.915405 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:33:23.915405 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:33:23.915405 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:33:23.915405 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:33:23.915405 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:33:23.915405 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:33:23.915405 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:33:23.915405 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:33:23.915405 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:33:23.915405 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:33:23.915405 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:33:23.915405 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:33:23.915405 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:33:23.915405 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:33:23.915405 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:33:23.915405 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:33:23.915405 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4 could not be found. Oct 04 22:33:23.915405 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:33:23.915405 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:33:23.921756 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:33:23.921756 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:33:23.921756 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:33:23.921756 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:33:23.921756 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:33:23.921756 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:33:23.921756 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4 could not be found. Oct 04 22:33:23.921756 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:33:23.921756 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-681dff45-9f61-48a9-8562-9431f7d6bdf6 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Returning 404 to user: Instance a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4 could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:33:23.921756 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-681dff45-9f61-48a9-8562-9431f7d6bdf6 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] 10.222.0.43 "GET /compute/v2.1/servers/a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4" status: 404 len: 111 microversion: 2.20 time: 0.028942 Oct 04 22:33:23.921756 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3772/6722] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:33:23 2022] GET /compute/v2.1/servers/a5cde6aa-f762-4c20-a1d5-ec70f3cbb0e4 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 04 22:33:27.190159 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-50fffd5e-283b-4582-a3af-d8e76086d08b tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:33:27.190808 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-50fffd5e-283b-4582-a3af-d8e76086d08b tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] [instance: 0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:33:27.198064 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-50fffd5e-283b-4582-a3af-d8e76086d08b tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:33:27.198735 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-50fffd5e-283b-4582-a3af-d8e76086d08b tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:33:27.199245 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-50fffd5e-283b-4582-a3af-d8e76086d08b tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:33:27.199892 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-50fffd5e-283b-4582-a3af-d8e76086d08b tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:33:27.200365 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-50fffd5e-283b-4582-a3af-d8e76086d08b tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:33:27.200799 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-50fffd5e-283b-4582-a3af-d8e76086d08b tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:33:27.214541 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-50fffd5e-283b-4582-a3af-d8e76086d08b tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] HTTP exception thrown: Instance 0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc could not be found. Oct 04 22:33:27.216227 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-50fffd5e-283b-4582-a3af-d8e76086d08b tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Request method failure captured: Oct 04 22:33:27.216227 n-d-860284-1 devstack@n-api.service[134101]: request: DELETE /compute/v2.1/servers/0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc HTTP/1.1 Oct 04 22:33:27.216227 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 22:33:27.216227 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 22:33:27.216227 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 22:33:27.216227 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 22:33:27.216227 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 22:33:27.216227 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 22:33:27.216227 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 22:33:27.216227 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 22:33:27.216227 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPLLS5H9qxnEqloh4s_Fb9sQ6v6LdePhqiIpQDnLeVJr4JmljPmqpyGa-uJ13u3bEOsSAZ1TFW03S-_x_PvbUw2pbG17jm8YFHXtgKD-MkrN05c5AsrMbB2tSIMeCYW80aUJrzlT1cVLz2CGYx3NFkEdXtBWY6BOtUYpSisAtWQWbEiI Oct 04 22:33:27.216227 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 22:33:27.216227 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 22:33:27.216227 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 22:33:27.216227 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 22:33:27.216227 n-d-860284-1 devstack@n-api.service[134101]: X-Openstack-Nova-Api-Version: 2.20 Oct 04 22:33:27.216227 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 22:33:27.216227 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 22:33:27.216227 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: 5031651f5e9a433e859e0038af1cb16d Oct 04 22:33:27.216227 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-863108842 Oct 04 22:33:27.216227 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 22:33:27.216227 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 22:33:27.216227 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5031651f5e9a433e859e0038af1cb16d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_5031651f5e9a433e859e0038af1cb16d", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5031651f5e9a433e859e0038af1cb16d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/5031651f5e9a433e859e0038af1cb16d"}]}] Oct 04 22:33:27.216227 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-AttachVolumeShelveTestJSON-863108842 Oct 04 22:33:27.216227 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: 5031651f5e9a433e859e0038af1cb16d Oct 04 22:33:27.216227 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-863108842 Oct 04 22:33:27.216227 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-AttachVolumeShelveTestJSON-863108842-project Oct 04 22:33:27.216227 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 22:33:27.216227 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 22:33:27.216227 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 97dec2a1a8bc435c9480f89802614cb2 Oct 04 22:33:27.216227 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-AttachVolumeShelveTestJSON-863108842-project Oct 04 22:33:27.216227 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 22:33:27.216227 n-d-860284-1 devstack@n-api.service[134101]: exception: Instance 0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc could not be found. Oct 04 22:33:27.216227 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': '0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc'} Oct 04 22:33:27.216227 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:33:27.216227 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:33:27.216227 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:33:27.216227 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:33:27.216227 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:33:27.216227 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:33:27.216227 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:33:27.216227 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:33:27.216227 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:33:27.216227 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:33:27.216227 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc could not be found. Oct 04 22:33:27.216227 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:33:27.216227 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:33:27.216227 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:33:27.216227 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:33:27.216227 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:33:27.216227 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:33:27.216227 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:33:27.216227 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:33:27.216227 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:33:27.216227 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:33:27.216227 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 22:33:27.216227 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 22:33:27.216227 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 22:33:27.216227 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 22:33:27.216227 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:33:27.216227 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:33:27.216227 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:33:27.216227 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:33:27.221053 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc could not be found. Oct 04 22:33:27.221053 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:33:27.221053 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:33:27.221053 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:33:27.221053 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:33:27.221053 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:33:27.221053 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:33:27.221053 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:33:27.221053 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:33:27.221053 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc could not be found. Oct 04 22:33:27.221053 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:33:27.221053 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-50fffd5e-283b-4582-a3af-d8e76086d08b tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Returning 404 to user: Instance 0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:33:27.221053 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-50fffd5e-283b-4582-a3af-d8e76086d08b tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] 10.222.0.43 "DELETE /compute/v2.1/servers/0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc" status: 404 len: 111 microversion: 2.20 time: 0.031482 Oct 04 22:33:27.221053 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3773/6723] 10.222.0.43 () {60 vars in 1280 bytes} [Tue Oct 4 22:33:27 2022] DELETE /compute/v2.1/servers/0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 04 22:33:27.225789 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-2e8f4ca0-0a75-4272-a7b5-91f6f6139f11 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:33:27.226430 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-2e8f4ca0-0a75-4272-a7b5-91f6f6139f11 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] [instance: 0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:33:27.232998 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2e8f4ca0-0a75-4272-a7b5-91f6f6139f11 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:33:27.233494 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2e8f4ca0-0a75-4272-a7b5-91f6f6139f11 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:33:27.233943 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2e8f4ca0-0a75-4272-a7b5-91f6f6139f11 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:33:27.234671 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2e8f4ca0-0a75-4272-a7b5-91f6f6139f11 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:33:27.235140 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2e8f4ca0-0a75-4272-a7b5-91f6f6139f11 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:33:27.235582 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2e8f4ca0-0a75-4272-a7b5-91f6f6139f11 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:33:27.252964 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-2e8f4ca0-0a75-4272-a7b5-91f6f6139f11 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] HTTP exception thrown: Instance 0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc could not be found. Oct 04 22:33:27.255176 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-2e8f4ca0-0a75-4272-a7b5-91f6f6139f11 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Request method failure captured: Oct 04 22:33:27.255176 n-d-860284-1 devstack@n-api.service[134101]: request: GET /compute/v2.1/servers/0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc HTTP/1.1 Oct 04 22:33:27.255176 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 22:33:27.255176 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 22:33:27.255176 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 22:33:27.255176 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 22:33:27.255176 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 22:33:27.255176 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 22:33:27.255176 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 22:33:27.255176 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 22:33:27.255176 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPLLS5H9qxnEqloh4s_Fb9sQ6v6LdePhqiIpQDnLeVJr4JmljPmqpyGa-uJ13u3bEOsSAZ1TFW03S-_x_PvbUw2pbG17jm8YFHXtgKD-MkrN05c5AsrMbB2tSIMeCYW80aUJrzlT1cVLz2CGYx3NFkEdXtBWY6BOtUYpSisAtWQWbEiI Oct 04 22:33:27.255176 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 22:33:27.255176 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 22:33:27.255176 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 22:33:27.255176 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 22:33:27.255176 n-d-860284-1 devstack@n-api.service[134101]: X-Openstack-Nova-Api-Version: 2.20 Oct 04 22:33:27.255176 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 22:33:27.255176 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 22:33:27.255176 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: 5031651f5e9a433e859e0038af1cb16d Oct 04 22:33:27.255176 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-863108842 Oct 04 22:33:27.255176 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 22:33:27.255176 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 22:33:27.255176 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5031651f5e9a433e859e0038af1cb16d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_5031651f5e9a433e859e0038af1cb16d", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5031651f5e9a433e859e0038af1cb16d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/5031651f5e9a433e859e0038af1cb16d"}]}] Oct 04 22:33:27.255176 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-AttachVolumeShelveTestJSON-863108842 Oct 04 22:33:27.255176 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: 5031651f5e9a433e859e0038af1cb16d Oct 04 22:33:27.255176 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-863108842 Oct 04 22:33:27.255176 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-AttachVolumeShelveTestJSON-863108842-project Oct 04 22:33:27.255176 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 22:33:27.255176 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 22:33:27.255176 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 97dec2a1a8bc435c9480f89802614cb2 Oct 04 22:33:27.255176 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-AttachVolumeShelveTestJSON-863108842-project Oct 04 22:33:27.255176 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 22:33:27.255176 n-d-860284-1 devstack@n-api.service[134101]: exception: Instance 0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc could not be found. Oct 04 22:33:27.255176 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': '0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc'} Oct 04 22:33:27.255176 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:33:27.255176 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:33:27.255176 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:33:27.255176 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:33:27.255176 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:33:27.255176 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:33:27.255176 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:33:27.255176 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:33:27.255176 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:33:27.255176 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:33:27.255176 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc could not be found. Oct 04 22:33:27.255176 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:33:27.255176 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:33:27.255176 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:33:27.255176 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:33:27.255176 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:33:27.255176 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:33:27.255176 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:33:27.255176 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:33:27.255176 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:33:27.255176 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:33:27.255176 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:33:27.255176 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:33:27.255176 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:33:27.255176 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:33:27.255176 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:33:27.255176 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:33:27.255176 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc could not be found. Oct 04 22:33:27.255176 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:33:27.255176 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:33:27.261253 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:33:27.261253 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:33:27.261253 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:33:27.261253 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:33:27.261253 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:33:27.261253 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:33:27.261253 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc could not be found. Oct 04 22:33:27.261253 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:33:27.261253 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-2e8f4ca0-0a75-4272-a7b5-91f6f6139f11 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] Returning 404 to user: Instance 0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:33:27.261253 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-2e8f4ca0-0a75-4272-a7b5-91f6f6139f11 tempest-AttachVolumeShelveTestJSON-863108842 tempest-AttachVolumeShelveTestJSON-863108842-project] 10.222.0.43 "GET /compute/v2.1/servers/0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc" status: 404 len: 111 microversion: 2.20 time: 0.034410 Oct 04 22:33:27.261253 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3774/6724] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Oct 4 22:33:27 2022] GET /compute/v2.1/servers/0baf9f7f-0f66-4f7b-bf4b-f6c262d126dc => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 04 22:34:11.502716 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-73bb0edf-08ed-43bd-bf35-0c731b87d71d tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] HTTP exception thrown: Network f55a0794-d215-4510-84cc-a7b063c083a4 could not be found. Oct 04 22:34:11.504974 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-73bb0edf-08ed-43bd-bf35-0c731b87d71d tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Request method failure captured: Oct 04 22:34:11.504974 n-d-860284-1 devstack@n-api.service[134102]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 22:34:11.504974 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 22:34:11.504974 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 22:34:11.504974 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 22:34:11.504974 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 354 Oct 04 22:34:11.504974 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 22:34:11.504974 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 22:34:11.504974 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 22:34:11.504974 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 22:34:11.504974 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPLFSMo9Eg9y9Lu454XN1MXkt5BE7HeG-NZdibz9nP5ZbzTcA5eo2fVm4gnqUdOUNPfyWilTQor2E780fAI_U9XTD5akzJ8-jVP8Fthos4syj8Pc9nJeMuZjrdlu2EkiFF5ef-9mxCQWUxHOpcRBLI1i5aPH69baR_Z4N2zYKYuhPE2w Oct 04 22:34:11.504974 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 22:34:11.504974 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 22:34:11.504974 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 22:34:11.504974 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 22:34:11.504974 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 22:34:11.504974 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 22:34:11.504974 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: 5c98a72bacce47c3947f9b0f0b4e85b6 Oct 04 22:34:11.504974 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-TestVolumeBootPattern-1701442207 Oct 04 22:34:11.504974 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 22:34:11.504974 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 22:34:11.504974 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5c98a72bacce47c3947f9b0f0b4e85b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_5c98a72bacce47c3947f9b0f0b4e85b6", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5c98a72bacce47c3947f9b0f0b4e85b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/5c98a72bacce47c3947f9b0f0b4e85b6"}]}] Oct 04 22:34:11.504974 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-TestVolumeBootPattern-1701442207 Oct 04 22:34:11.504974 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: 5c98a72bacce47c3947f9b0f0b4e85b6 Oct 04 22:34:11.504974 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-TestVolumeBootPattern-1701442207 Oct 04 22:34:11.504974 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-TestVolumeBootPattern-1701442207-project Oct 04 22:34:11.504974 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 22:34:11.504974 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 22:34:11.504974 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: 99acad09db70445b93ae1d64a1b49ca3 Oct 04 22:34:11.504974 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-TestVolumeBootPattern-1701442207-project Oct 04 22:34:11.504974 n-d-860284-1 devstack@n-api.service[134102]: Oct 04 22:34:11.504974 n-d-860284-1 devstack@n-api.service[134102]: {"server": {"name": "tempest-TestVolumeBootPattern-server-1760263666", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "a6bfe8c7-9df5-4814-a1ba-f9f9709c0645", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f55a0794-d215-4510-84cc-a7b063c083a4"}]}} Oct 04 22:34:11.504974 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 22:34:11.504974 n-d-860284-1 devstack@n-api.service[134102]: exception: Network f55a0794-d215-4510-84cc-a7b063c083a4 could not be found. Oct 04 22:34:11.504974 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'body': {'server': {'name': 'tempest-TestVolumeBootPattern-server-1760263666', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'volume', 'destination_type': 'volume', 'boot_index': 0, 'delete_on_termination': False, 'volume_id': 'a6bfe8c7-9df5-4814-a1ba-f9f9709c0645'}], 'networks': [{'uuid': 'f55a0794-d215-4510-84cc-a7b063c083a4'}]}}} Oct 04 22:34:11.504974 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:34:11.504974 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:34:11.504974 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 22:34:11.504974 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 22:34:11.504974 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 22:34:11.504974 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 22:34:11.504974 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 22:34:11.504974 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 22:34:11.504974 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1080, in _validate_and_build_base_options Oct 04 22:34:11.504974 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi max_network_count = self._check_requested_networks( Oct 04 22:34:11.504974 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 542, in _check_requested_networks Oct 04 22:34:11.504974 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return self.network_api.validate_networks(context, requested_networks, Oct 04 22:34:11.504974 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2626, in validate_networks Oct 04 22:34:11.504974 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi ports_needed_per_instance = self._ports_needed_per_instance( Oct 04 22:34:11.504974 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2565, in _ports_needed_per_instance Oct 04 22:34:11.504974 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.NetworkNotFound(network_id=id_str) Oct 04 22:34:11.504974 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.NetworkNotFound: Network f55a0794-d215-4510-84cc-a7b063c083a4 could not be found. Oct 04 22:34:11.504974 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:34:11.504974 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:34:11.504974 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:34:11.504974 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:34:11.504974 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:34:11.504974 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:34:11.510691 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:34:11.510691 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:34:11.510691 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:34:11.510691 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:34:11.510691 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 22:34:11.510691 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 22:34:11.510691 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 22:34:11.510691 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 22:34:11.510691 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 22:34:11.510691 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 22:34:11.510691 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 22:34:11.510691 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 04 22:34:11.510691 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 04 22:34:11.510691 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Network f55a0794-d215-4510-84cc-a7b063c083a4 could not be found. Oct 04 22:34:11.510691 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:34:11.510691 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:34:11.510691 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:34:11.510691 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:34:11.510691 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:34:11.510691 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:34:11.510691 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:34:11.510691 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:34:11.510691 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Network f55a0794-d215-4510-84cc-a7b063c083a4 could not be found. Oct 04 22:34:11.510691 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:34:11.510691 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-73bb0edf-08ed-43bd-bf35-0c731b87d71d tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Returning 400 to user: Network f55a0794-d215-4510-84cc-a7b063c083a4 could not be found. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:34:11.510691 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-73bb0edf-08ed-43bd-bf35-0c731b87d71d tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 900.174104 Oct 04 22:34:11.510691 n-d-860284-1 devstack@n-api.service[134102]: Tue Oct 4 22:34:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.43) !!! Oct 04 22:34:11.510691 n-d-860284-1 devstack@n-api.service[134102]: Tue Oct 4 22:34:11 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during POST /compute/v2.1/servers (10.222.0.43) Oct 04 22:34:11.510691 n-d-860284-1 devstack@n-api.service[134102]: CRITICAL nova [None req-73bb0edf-08ed-43bd-bf35-0c731b87d71d tempest-TestVolumeBootPattern-1701442207 tempest-TestVolumeBootPattern-1701442207-project] Unhandled error: OSError: write error Oct 04 22:34:11.510691 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova OSError: write error Oct 04 22:34:11.510691 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova Oct 04 22:34:11.510691 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2951/6725] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 22:19:11 2022] POST /compute/v2.1/servers => generated 0 bytes in 900176 msecs (HTTP/1.1 400) 9 headers in 0 bytes (0 switches on core 0) Oct 04 22:35:13.876372 n-d-860284-1 devstack@n-api.service[134101]: ERROR oslo.messaging._drivers.impl_rabbit [-] [dab38095-fcf8-46d0-9904-6bfbf5d1f82a] AMQP server on 10.222.0.43:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 04 22:35:13.877572 n-d-860284-1 devstack@n-api.service[134101]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f8e2fc52-bb96-4bc7-8039-fbfc8addcbeb] AMQP server on 10.222.0.43:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 04 22:35:13.878132 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:35:13.878927 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:35:13.880150 n-d-860284-1 devstack@n-api.service[134101]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 22:35:13.880332 n-d-860284-1 devstack@n-api.service[134101]: Tue Oct 4 22:35:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.43) !!! Oct 04 22:35:13.886071 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-daf5a6e9-a18a-4bb9-a05a-e16ac2de86ad tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1507201109", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452", "networks": [{"uuid": "fcfb6aa4-a9b6-4702-b760-c33a3cbfa755"}]}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:35:14.148830 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.network.neutron [None req-daf5a6e9-a18a-4bb9-a05a-e16ac2de86ad tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] validate_networks() for [('fcfb6aa4-a9b6-4702-b760-c33a3cbfa755', None, None, None, None, None)] {{(pid=134101) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 22:35:14.556963 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-daf5a6e9-a18a-4bb9-a05a-e16ac2de86ad tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Flavor limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 22:35:14.557429 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-daf5a6e9-a18a-4bb9-a05a-e16ac2de86ad tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Image limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 22:35:14.557922 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-daf5a6e9-a18a-4bb9-a05a-e16ac2de86ad tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Flavor pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 22:35:14.558471 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-daf5a6e9-a18a-4bb9-a05a-e16ac2de86ad tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Image pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 22:35:14.558905 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-daf5a6e9-a18a-4bb9-a05a-e16ac2de86ad tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 22:35:14.567917 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-daf5a6e9-a18a-4bb9-a05a-e16ac2de86ad tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:35:14.568416 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-daf5a6e9-a18a-4bb9-a05a-e16ac2de86ad tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:35:14.568865 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-daf5a6e9-a18a-4bb9-a05a-e16ac2de86ad tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:35:14.569729 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-daf5a6e9-a18a-4bb9-a05a-e16ac2de86ad tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:35:14.570205 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-daf5a6e9-a18a-4bb9-a05a-e16ac2de86ad tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:35:14.570685 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-daf5a6e9-a18a-4bb9-a05a-e16ac2de86ad tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:35:14.588102 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-daf5a6e9-a18a-4bb9-a05a-e16ac2de86ad tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Getting quotas for project feda9a9f3acc4e1abbc7d4963f8634cd. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:35:14.593340 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-daf5a6e9-a18a-4bb9-a05a-e16ac2de86ad tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Getting quotas for user 14d77e470e0743b7a39f37436c09003e and project feda9a9f3acc4e1abbc7d4963f8634cd. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:35:14.606355 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-daf5a6e9-a18a-4bb9-a05a-e16ac2de86ad tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Going to run 1 instances... {{(pid=134101) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 22:35:14.608711 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-daf5a6e9-a18a-4bb9-a05a-e16ac2de86ad tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] [instance: 7ec8a071-93b3-4f7e-91ab-ef31fda0f26d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='58548514-5dac-426c-81f5-19e3fba33e23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134101) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 22:35:14.654990 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-daf5a6e9-a18a-4bb9-a05a-e16ac2de86ad tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.780446 Oct 04 22:35:14.655845 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3775/6726] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 22:35:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 782 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 22:35:14.665760 n-d-860284-1 devstack@n-api.service[134102]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 22:35:14.666242 n-d-860284-1 devstack@n-api.service[134102]: Tue Oct 4 22:35:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7ec8a071-93b3-4f7e-91ab-ef31fda0f26d (ip 10.222.0.43) !!! Oct 04 22:35:14.667025 n-d-860284-1 devstack@n-api.service[134102]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 22:35:14.667150 n-d-860284-1 devstack@n-api.service[134102]: Tue Oct 4 22:35:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7ec8a071-93b3-4f7e-91ab-ef31fda0f26d (ip 10.222.0.43) !!! Oct 04 22:35:14.668180 n-d-860284-1 devstack@n-api.service[134102]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 22:35:14.668299 n-d-860284-1 devstack@n-api.service[134102]: Tue Oct 4 22:35:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7ec8a071-93b3-4f7e-91ab-ef31fda0f26d (ip 10.222.0.43) !!! Oct 04 22:35:14.674894 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-51952b88-309d-4cdb-82f2-113b7151ee01 tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:35:14.675513 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-51952b88-309d-4cdb-82f2-113b7151ee01 tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] [instance: 7ec8a071-93b3-4f7e-91ab-ef31fda0f26d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:35:14.738085 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-51952b88-309d-4cdb-82f2-113b7151ee01 tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d77e470e0743b7a39f37436c09003e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feda9a9f3acc4e1abbc7d4963f8634cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:35:14.745520 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-51952b88-309d-4cdb-82f2-113b7151ee01 tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] 10.222.0.43 "GET /compute/v2.1/servers/7ec8a071-93b3-4f7e-91ab-ef31fda0f26d" status: 200 len: 1214 microversion: 2.1 time: 0.082430 Oct 04 22:35:14.746112 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2952/6727] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:35:14 2022] GET /compute/v2.1/servers/7ec8a071-93b3-4f7e-91ab-ef31fda0f26d => generated 1214 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:35:15.770304 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-807dee7f-1fb9-402a-a75c-9cba692a8576 tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:35:15.770962 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-807dee7f-1fb9-402a-a75c-9cba692a8576 tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] [instance: 7ec8a071-93b3-4f7e-91ab-ef31fda0f26d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:35:15.780074 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-807dee7f-1fb9-402a-a75c-9cba692a8576 tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:35:15.780615 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-807dee7f-1fb9-402a-a75c-9cba692a8576 tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:35:15.781154 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-807dee7f-1fb9-402a-a75c-9cba692a8576 tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:35:15.782192 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-807dee7f-1fb9-402a-a75c-9cba692a8576 tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:35:15.782890 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-807dee7f-1fb9-402a-a75c-9cba692a8576 tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:35:15.783373 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-807dee7f-1fb9-402a-a75c-9cba692a8576 tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:35:15.789242 n-d-860284-1 devstack@n-api.service[134101]: INFO oslo.messaging._drivers.impl_rabbit [-] [f8e2fc52-bb96-4bc7-8039-fbfc8addcbeb] Reconnected to AMQP server on 10.222.0.43:5672 via [amqp] client with port 33064. Oct 04 22:35:15.803132 n-d-860284-1 devstack@n-api.service[134101]: INFO oslo.messaging._drivers.impl_rabbit [-] [dab38095-fcf8-46d0-9904-6bfbf5d1f82a] Reconnected to AMQP server on 10.222.0.43:5672 via [amqp] client with port 33062. Oct 04 22:35:15.852922 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-807dee7f-1fb9-402a-a75c-9cba692a8576 tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d77e470e0743b7a39f37436c09003e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feda9a9f3acc4e1abbc7d4963f8634cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:35:15.861543 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-807dee7f-1fb9-402a-a75c-9cba692a8576 tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] 10.222.0.43 "GET /compute/v2.1/servers/7ec8a071-93b3-4f7e-91ab-ef31fda0f26d" status: 200 len: 1274 microversion: 2.1 time: 0.097070 Oct 04 22:35:15.862139 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3776/6728] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:35:15 2022] GET /compute/v2.1/servers/7ec8a071-93b3-4f7e-91ab-ef31fda0f26d => generated 1274 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:35:16.885506 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-6a345d2c-4bc1-46fa-bb06-3293895c3be7 tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:35:16.886157 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-6a345d2c-4bc1-46fa-bb06-3293895c3be7 tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] [instance: 7ec8a071-93b3-4f7e-91ab-ef31fda0f26d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:35:16.893934 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6a345d2c-4bc1-46fa-bb06-3293895c3be7 tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:35:16.894896 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6a345d2c-4bc1-46fa-bb06-3293895c3be7 tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:35:16.894896 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6a345d2c-4bc1-46fa-bb06-3293895c3be7 tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:35:16.895590 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6a345d2c-4bc1-46fa-bb06-3293895c3be7 tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:35:16.896058 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6a345d2c-4bc1-46fa-bb06-3293895c3be7 tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:35:16.896493 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6a345d2c-4bc1-46fa-bb06-3293895c3be7 tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:35:17.110050 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-6a345d2c-4bc1-46fa-bb06-3293895c3be7 tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d77e470e0743b7a39f37436c09003e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feda9a9f3acc4e1abbc7d4963f8634cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:35:17.118097 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-6a345d2c-4bc1-46fa-bb06-3293895c3be7 tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] 10.222.0.43 "GET /compute/v2.1/servers/7ec8a071-93b3-4f7e-91ab-ef31fda0f26d" status: 200 len: 1314 microversion: 2.1 time: 0.237108 Oct 04 22:35:17.118919 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2953/6729] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:35:16 2022] GET /compute/v2.1/servers/7ec8a071-93b3-4f7e-91ab-ef31fda0f26d => generated 1314 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:35:17.246090 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-b847c8fa-7391-449f-b2aa-cd5908e3e744 req-46425d00-92dc-426e-8827-36ff8070f896 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ec8a071-93b3-4f7e-91ab-ef31fda0f26d", "tag": "2d3419a7-f0f4-44e3-a84f-1a7d9ae7fff3"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:35:17.260270 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-b847c8fa-7391-449f-b2aa-cd5908e3e744 req-46425d00-92dc-426e-8827-36ff8070f896 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:35:17.261726 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-b847c8fa-7391-449f-b2aa-cd5908e3e744 req-46425d00-92dc-426e-8827-36ff8070f896 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:35:17.262909 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-b847c8fa-7391-449f-b2aa-cd5908e3e744 req-46425d00-92dc-426e-8827-36ff8070f896 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:35:17.276456 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-b847c8fa-7391-449f-b2aa-cd5908e3e744 req-46425d00-92dc-426e-8827-36ff8070f896 service nova] Creating event network-changed:2d3419a7-f0f4-44e3-a84f-1a7d9ae7fff3 for instance 7ec8a071-93b3-4f7e-91ab-ef31fda0f26d on n-h1-860284-1 Oct 04 22:35:17.282560 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-b847c8fa-7391-449f-b2aa-cd5908e3e744 req-46425d00-92dc-426e-8827-36ff8070f896 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040984 Oct 04 22:35:17.283182 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3777/6730] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:35:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:35:18.141857 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-a9b8a3e7-267a-4c30-9b7b-4defbd480553 tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:35:18.142506 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-a9b8a3e7-267a-4c30-9b7b-4defbd480553 tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] [instance: 7ec8a071-93b3-4f7e-91ab-ef31fda0f26d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:35:18.149841 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a9b8a3e7-267a-4c30-9b7b-4defbd480553 tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:35:18.150326 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a9b8a3e7-267a-4c30-9b7b-4defbd480553 tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:35:18.150804 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a9b8a3e7-267a-4c30-9b7b-4defbd480553 tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:35:18.151507 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a9b8a3e7-267a-4c30-9b7b-4defbd480553 tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:35:18.151966 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a9b8a3e7-267a-4c30-9b7b-4defbd480553 tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:35:18.152394 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a9b8a3e7-267a-4c30-9b7b-4defbd480553 tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:35:18.289016 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-a9b8a3e7-267a-4c30-9b7b-4defbd480553 tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d77e470e0743b7a39f37436c09003e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feda9a9f3acc4e1abbc7d4963f8634cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:35:18.296766 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-a9b8a3e7-267a-4c30-9b7b-4defbd480553 tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] 10.222.0.43 "GET /compute/v2.1/servers/7ec8a071-93b3-4f7e-91ab-ef31fda0f26d" status: 200 len: 1314 microversion: 2.1 time: 0.158844 Oct 04 22:35:18.297364 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2954/6731] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:35:18 2022] GET /compute/v2.1/servers/7ec8a071-93b3-4f7e-91ab-ef31fda0f26d => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:35:19.320334 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-8a395253-a5cf-4633-816d-f602096b884c tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:35:19.321058 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-8a395253-a5cf-4633-816d-f602096b884c tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] [instance: 7ec8a071-93b3-4f7e-91ab-ef31fda0f26d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:35:19.328295 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8a395253-a5cf-4633-816d-f602096b884c tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:35:19.328801 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8a395253-a5cf-4633-816d-f602096b884c tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:35:19.329262 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8a395253-a5cf-4633-816d-f602096b884c tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:35:19.329971 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8a395253-a5cf-4633-816d-f602096b884c tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:35:19.330481 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8a395253-a5cf-4633-816d-f602096b884c tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:35:19.330934 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8a395253-a5cf-4633-816d-f602096b884c tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:35:19.790245 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-8a395253-a5cf-4633-816d-f602096b884c tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d77e470e0743b7a39f37436c09003e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feda9a9f3acc4e1abbc7d4963f8634cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:35:19.797987 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-8a395253-a5cf-4633-816d-f602096b884c tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] 10.222.0.43 "GET /compute/v2.1/servers/7ec8a071-93b3-4f7e-91ab-ef31fda0f26d" status: 200 len: 1314 microversion: 2.1 time: 0.482210 Oct 04 22:35:19.798592 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3778/6732] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:35:19 2022] GET /compute/v2.1/servers/7ec8a071-93b3-4f7e-91ab-ef31fda0f26d => generated 1314 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:35:20.821792 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-57793f3e-da86-4115-ba70-005d19fbf369 tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:35:20.822429 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-57793f3e-da86-4115-ba70-005d19fbf369 tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] [instance: 7ec8a071-93b3-4f7e-91ab-ef31fda0f26d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:35:20.829245 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-57793f3e-da86-4115-ba70-005d19fbf369 tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:35:20.829730 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-57793f3e-da86-4115-ba70-005d19fbf369 tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:35:20.830169 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-57793f3e-da86-4115-ba70-005d19fbf369 tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:35:20.830897 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-57793f3e-da86-4115-ba70-005d19fbf369 tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:35:20.831359 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-57793f3e-da86-4115-ba70-005d19fbf369 tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:35:20.831788 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-57793f3e-da86-4115-ba70-005d19fbf369 tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:35:20.964165 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-57793f3e-da86-4115-ba70-005d19fbf369 tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d77e470e0743b7a39f37436c09003e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feda9a9f3acc4e1abbc7d4963f8634cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:35:20.971969 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-57793f3e-da86-4115-ba70-005d19fbf369 tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] 10.222.0.43 "GET /compute/v2.1/servers/7ec8a071-93b3-4f7e-91ab-ef31fda0f26d" status: 200 len: 1314 microversion: 2.1 time: 0.155020 Oct 04 22:35:20.972539 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2955/6733] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:35:20 2022] GET /compute/v2.1/servers/7ec8a071-93b3-4f7e-91ab-ef31fda0f26d => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:35:21.993576 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-3b94de65-4e68-4574-8b17-47a929669116 tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:35:21.994205 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-3b94de65-4e68-4574-8b17-47a929669116 tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] [instance: 7ec8a071-93b3-4f7e-91ab-ef31fda0f26d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:35:22.001074 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3b94de65-4e68-4574-8b17-47a929669116 tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:35:22.001578 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3b94de65-4e68-4574-8b17-47a929669116 tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:35:22.002032 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3b94de65-4e68-4574-8b17-47a929669116 tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:35:22.002783 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3b94de65-4e68-4574-8b17-47a929669116 tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:35:22.003261 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3b94de65-4e68-4574-8b17-47a929669116 tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:35:22.003720 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3b94de65-4e68-4574-8b17-47a929669116 tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:35:22.134739 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-3b94de65-4e68-4574-8b17-47a929669116 tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d77e470e0743b7a39f37436c09003e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feda9a9f3acc4e1abbc7d4963f8634cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:35:22.143810 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-3b94de65-4e68-4574-8b17-47a929669116 tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] 10.222.0.43 "GET /compute/v2.1/servers/7ec8a071-93b3-4f7e-91ab-ef31fda0f26d" status: 200 len: 1314 microversion: 2.1 time: 0.154111 Oct 04 22:35:22.144402 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3779/6734] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:35:21 2022] GET /compute/v2.1/servers/7ec8a071-93b3-4f7e-91ab-ef31fda0f26d => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:35:23.167788 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-96498fec-3329-4d48-a37a-3f92c8ed14f4 tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:35:23.168443 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-96498fec-3329-4d48-a37a-3f92c8ed14f4 tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] [instance: 7ec8a071-93b3-4f7e-91ab-ef31fda0f26d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:35:23.175321 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-96498fec-3329-4d48-a37a-3f92c8ed14f4 tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:35:23.175815 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-96498fec-3329-4d48-a37a-3f92c8ed14f4 tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:35:23.176260 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-96498fec-3329-4d48-a37a-3f92c8ed14f4 tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:35:23.176961 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-96498fec-3329-4d48-a37a-3f92c8ed14f4 tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:35:23.177426 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-96498fec-3329-4d48-a37a-3f92c8ed14f4 tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:35:23.177863 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-96498fec-3329-4d48-a37a-3f92c8ed14f4 tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:35:23.304933 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-96498fec-3329-4d48-a37a-3f92c8ed14f4 tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d77e470e0743b7a39f37436c09003e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feda9a9f3acc4e1abbc7d4963f8634cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:35:23.312666 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-96498fec-3329-4d48-a37a-3f92c8ed14f4 tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] 10.222.0.43 "GET /compute/v2.1/servers/7ec8a071-93b3-4f7e-91ab-ef31fda0f26d" status: 200 len: 1314 microversion: 2.1 time: 0.149011 Oct 04 22:35:23.313249 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2956/6735] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:35:23 2022] GET /compute/v2.1/servers/7ec8a071-93b3-4f7e-91ab-ef31fda0f26d => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:35:24.048937 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-af3455e2-e505-4143-ba65-fc303727a4e8 req-7c7b9846-ebab-485a-b025-171991ce1552 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ec8a071-93b3-4f7e-91ab-ef31fda0f26d", "name": "network-vif-plugged", "status": "completed", "tag": "2d3419a7-f0f4-44e3-a84f-1a7d9ae7fff3"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:35:24.059091 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-af3455e2-e505-4143-ba65-fc303727a4e8 req-7c7b9846-ebab-485a-b025-171991ce1552 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:35:24.059590 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-af3455e2-e505-4143-ba65-fc303727a4e8 req-7c7b9846-ebab-485a-b025-171991ce1552 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:35:24.060040 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-af3455e2-e505-4143-ba65-fc303727a4e8 req-7c7b9846-ebab-485a-b025-171991ce1552 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:35:24.072149 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-af3455e2-e505-4143-ba65-fc303727a4e8 req-7c7b9846-ebab-485a-b025-171991ce1552 service nova] Creating event network-vif-plugged:2d3419a7-f0f4-44e3-a84f-1a7d9ae7fff3 for instance 7ec8a071-93b3-4f7e-91ab-ef31fda0f26d on n-h1-860284-1 Oct 04 22:35:24.077179 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-af3455e2-e505-4143-ba65-fc303727a4e8 req-7c7b9846-ebab-485a-b025-171991ce1552 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099615 Oct 04 22:35:24.077855 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3780/6736] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:35:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:35:24.336260 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-526a45c1-bcbf-4682-889b-adda0be556ac tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:35:24.336798 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-526a45c1-bcbf-4682-889b-adda0be556ac tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] [instance: 7ec8a071-93b3-4f7e-91ab-ef31fda0f26d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:35:24.343584 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-526a45c1-bcbf-4682-889b-adda0be556ac tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:35:24.344070 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-526a45c1-bcbf-4682-889b-adda0be556ac tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:35:24.344511 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-526a45c1-bcbf-4682-889b-adda0be556ac tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:35:24.345204 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-526a45c1-bcbf-4682-889b-adda0be556ac tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:35:24.345658 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-526a45c1-bcbf-4682-889b-adda0be556ac tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:35:24.346085 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-526a45c1-bcbf-4682-889b-adda0be556ac tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:35:24.472059 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-526a45c1-bcbf-4682-889b-adda0be556ac tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d77e470e0743b7a39f37436c09003e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feda9a9f3acc4e1abbc7d4963f8634cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:35:24.480490 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-526a45c1-bcbf-4682-889b-adda0be556ac tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] 10.222.0.43 "GET /compute/v2.1/servers/7ec8a071-93b3-4f7e-91ab-ef31fda0f26d" status: 200 len: 1314 microversion: 2.1 time: 0.148282 Oct 04 22:35:24.481082 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2957/6737] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:35:24 2022] GET /compute/v2.1/servers/7ec8a071-93b3-4f7e-91ab-ef31fda0f26d => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:35:25.500849 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=2 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:35:25.501643 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=6 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:35:25.509171 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e4997bdb-9d30-4f0a-bd46-ace9553b181d tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:35:25.509932 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-e4997bdb-9d30-4f0a-bd46-ace9553b181d tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] [instance: 7ec8a071-93b3-4f7e-91ab-ef31fda0f26d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:35:25.517677 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e4997bdb-9d30-4f0a-bd46-ace9553b181d tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:35:25.518185 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e4997bdb-9d30-4f0a-bd46-ace9553b181d tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:35:25.518669 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e4997bdb-9d30-4f0a-bd46-ace9553b181d tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:35:25.519385 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e4997bdb-9d30-4f0a-bd46-ace9553b181d tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:35:25.519857 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e4997bdb-9d30-4f0a-bd46-ace9553b181d tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:35:25.520303 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e4997bdb-9d30-4f0a-bd46-ace9553b181d tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:35:25.663776 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-e4997bdb-9d30-4f0a-bd46-ace9553b181d tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d77e470e0743b7a39f37436c09003e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feda9a9f3acc4e1abbc7d4963f8634cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:35:25.671757 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-e4997bdb-9d30-4f0a-bd46-ace9553b181d tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] 10.222.0.43 "GET /compute/v2.1/servers/7ec8a071-93b3-4f7e-91ab-ef31fda0f26d" status: 200 len: 1314 microversion: 2.1 time: 0.171860 Oct 04 22:35:25.672349 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3781/6738] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:35:25 2022] GET /compute/v2.1/servers/7ec8a071-93b3-4f7e-91ab-ef31fda0f26d => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:35:26.695271 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-16664ffa-84c4-4071-989a-f8d6003875aa tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:35:26.695933 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-16664ffa-84c4-4071-989a-f8d6003875aa tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] [instance: 7ec8a071-93b3-4f7e-91ab-ef31fda0f26d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:35:26.697807 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell0:SELECT=2 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:35:26.703850 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-16664ffa-84c4-4071-989a-f8d6003875aa tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:35:26.704333 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-16664ffa-84c4-4071-989a-f8d6003875aa tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:35:26.704768 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-16664ffa-84c4-4071-989a-f8d6003875aa tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:35:26.705454 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-16664ffa-84c4-4071-989a-f8d6003875aa tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:35:26.705908 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-16664ffa-84c4-4071-989a-f8d6003875aa tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:35:26.706333 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-16664ffa-84c4-4071-989a-f8d6003875aa tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:35:26.838746 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-16664ffa-84c4-4071-989a-f8d6003875aa tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d77e470e0743b7a39f37436c09003e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feda9a9f3acc4e1abbc7d4963f8634cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:35:26.846431 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-16664ffa-84c4-4071-989a-f8d6003875aa tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] 10.222.0.43 "GET /compute/v2.1/servers/7ec8a071-93b3-4f7e-91ab-ef31fda0f26d" status: 200 len: 1498 microversion: 2.1 time: 0.155979 Oct 04 22:35:26.847011 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2958/6739] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:35:26 2022] GET /compute/v2.1/servers/7ec8a071-93b3-4f7e-91ab-ef31fda0f26d => generated 1498 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:35:27.212357 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-afbc1af1-6a7f-4320-8c02-87862a219e3c tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:35:27.212993 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-afbc1af1-6a7f-4320-8c02-87862a219e3c tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] [instance: 7ec8a071-93b3-4f7e-91ab-ef31fda0f26d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:35:27.220297 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-afbc1af1-6a7f-4320-8c02-87862a219e3c tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:35:27.220798 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-afbc1af1-6a7f-4320-8c02-87862a219e3c tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:35:27.221251 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-afbc1af1-6a7f-4320-8c02-87862a219e3c tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:35:27.221958 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-afbc1af1-6a7f-4320-8c02-87862a219e3c tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:35:27.222453 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-afbc1af1-6a7f-4320-8c02-87862a219e3c tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:35:27.222895 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-afbc1af1-6a7f-4320-8c02-87862a219e3c tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:35:27.252203 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-afbc1af1-6a7f-4320-8c02-87862a219e3c tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] [instance: 7ec8a071-93b3-4f7e-91ab-ef31fda0f26d] Going to try to terminate instance {{(pid=134101) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 22:35:27.328120 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-afbc1af1-6a7f-4320-8c02-87862a219e3c tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] 10.222.0.43 "DELETE /compute/v2.1/servers/7ec8a071-93b3-4f7e-91ab-ef31fda0f26d" status: 204 len: 0 microversion: 2.1 time: 0.119358 Oct 04 22:35:27.328918 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3782/6740] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 22:35:27 2022] DELETE /compute/v2.1/servers/7ec8a071-93b3-4f7e-91ab-ef31fda0f26d => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 22:35:27.337636 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-7361e824-ab5d-4445-bbcc-9c7aa57887e1 tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:35:27.338253 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-7361e824-ab5d-4445-bbcc-9c7aa57887e1 tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] [instance: 7ec8a071-93b3-4f7e-91ab-ef31fda0f26d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:35:27.344221 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7361e824-ab5d-4445-bbcc-9c7aa57887e1 tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:35:27.344701 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7361e824-ab5d-4445-bbcc-9c7aa57887e1 tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:35:27.345136 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7361e824-ab5d-4445-bbcc-9c7aa57887e1 tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:35:27.345876 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7361e824-ab5d-4445-bbcc-9c7aa57887e1 tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:35:27.346273 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7361e824-ab5d-4445-bbcc-9c7aa57887e1 tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:35:27.346730 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7361e824-ab5d-4445-bbcc-9c7aa57887e1 tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:35:27.475764 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-7361e824-ab5d-4445-bbcc-9c7aa57887e1 tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d77e470e0743b7a39f37436c09003e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feda9a9f3acc4e1abbc7d4963f8634cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:35:27.483566 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-7361e824-ab5d-4445-bbcc-9c7aa57887e1 tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] 10.222.0.43 "GET /compute/v2.1/servers/7ec8a071-93b3-4f7e-91ab-ef31fda0f26d" status: 200 len: 1504 microversion: 2.1 time: 0.150245 Oct 04 22:35:27.484170 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2959/6741] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:35:27 2022] GET /compute/v2.1/servers/7ec8a071-93b3-4f7e-91ab-ef31fda0f26d => generated 1504 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:35:28.509877 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e0ebdbe5-720a-4ea2-a73c-bd3f9ff5047d tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:35:28.510563 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-e0ebdbe5-720a-4ea2-a73c-bd3f9ff5047d tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] [instance: 7ec8a071-93b3-4f7e-91ab-ef31fda0f26d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:35:28.517658 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e0ebdbe5-720a-4ea2-a73c-bd3f9ff5047d tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:35:28.518201 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e0ebdbe5-720a-4ea2-a73c-bd3f9ff5047d tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:35:28.518684 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e0ebdbe5-720a-4ea2-a73c-bd3f9ff5047d tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:35:28.519418 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e0ebdbe5-720a-4ea2-a73c-bd3f9ff5047d tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:35:28.519892 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e0ebdbe5-720a-4ea2-a73c-bd3f9ff5047d tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:35:28.520338 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e0ebdbe5-720a-4ea2-a73c-bd3f9ff5047d tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:35:28.650963 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-e0ebdbe5-720a-4ea2-a73c-bd3f9ff5047d tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d77e470e0743b7a39f37436c09003e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feda9a9f3acc4e1abbc7d4963f8634cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:35:28.658804 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-e0ebdbe5-720a-4ea2-a73c-bd3f9ff5047d tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] 10.222.0.43 "GET /compute/v2.1/servers/7ec8a071-93b3-4f7e-91ab-ef31fda0f26d" status: 200 len: 1504 microversion: 2.1 time: 0.155477 Oct 04 22:35:28.659379 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3783/6742] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:35:28 2022] GET /compute/v2.1/servers/7ec8a071-93b3-4f7e-91ab-ef31fda0f26d => generated 1504 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:35:29.528407 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-dabba31b-3ab8-4318-a1db-3e47f43ebe04 req-a5afdd31-9e34-47f9-8a1a-85c26080823c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ec8a071-93b3-4f7e-91ab-ef31fda0f26d", "name": "network-vif-deleted", "tag": "2d3419a7-f0f4-44e3-a84f-1a7d9ae7fff3"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:35:29.542578 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-dabba31b-3ab8-4318-a1db-3e47f43ebe04 req-a5afdd31-9e34-47f9-8a1a-85c26080823c service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:35:29.543078 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-dabba31b-3ab8-4318-a1db-3e47f43ebe04 req-a5afdd31-9e34-47f9-8a1a-85c26080823c service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:35:29.543519 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-dabba31b-3ab8-4318-a1db-3e47f43ebe04 req-a5afdd31-9e34-47f9-8a1a-85c26080823c service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:35:29.559968 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-dabba31b-3ab8-4318-a1db-3e47f43ebe04 req-a5afdd31-9e34-47f9-8a1a-85c26080823c service nova] Creating event network-vif-deleted:2d3419a7-f0f4-44e3-a84f-1a7d9ae7fff3 for instance 7ec8a071-93b3-4f7e-91ab-ef31fda0f26d on n-h1-860284-1 Oct 04 22:35:29.566315 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-dabba31b-3ab8-4318-a1db-3e47f43ebe04 req-a5afdd31-9e34-47f9-8a1a-85c26080823c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041607 Oct 04 22:35:29.567108 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2960/6743] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:35:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:35:29.681104 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-286c6d09-da3d-476c-8aff-5ff9c2035255 tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:35:29.681761 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-286c6d09-da3d-476c-8aff-5ff9c2035255 tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] [instance: 7ec8a071-93b3-4f7e-91ab-ef31fda0f26d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:35:29.688829 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-286c6d09-da3d-476c-8aff-5ff9c2035255 tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:35:29.689280 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-286c6d09-da3d-476c-8aff-5ff9c2035255 tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:35:29.689740 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-286c6d09-da3d-476c-8aff-5ff9c2035255 tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:35:29.690509 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-286c6d09-da3d-476c-8aff-5ff9c2035255 tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:35:29.690994 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-286c6d09-da3d-476c-8aff-5ff9c2035255 tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:35:29.691443 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-286c6d09-da3d-476c-8aff-5ff9c2035255 tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:35:29.724537 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-286c6d09-da3d-476c-8aff-5ff9c2035255 tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:35:29.725592 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-286c6d09-da3d-476c-8aff-5ff9c2035255 tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:35:29.726057 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-286c6d09-da3d-476c-8aff-5ff9c2035255 tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:35:29.726554 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.objects.instance [None req-286c6d09-da3d-476c-8aff-5ff9c2035255 tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Lazy-loading 'fault' on Instance uuid 7ec8a071-93b3-4f7e-91ab-ef31fda0f26d {{(pid=134101) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 22:35:29.767721 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-286c6d09-da3d-476c-8aff-5ff9c2035255 tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d77e470e0743b7a39f37436c09003e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feda9a9f3acc4e1abbc7d4963f8634cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:35:29.776156 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-286c6d09-da3d-476c-8aff-5ff9c2035255 tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] 10.222.0.43 "GET /compute/v2.1/servers/7ec8a071-93b3-4f7e-91ab-ef31fda0f26d" status: 200 len: 1304 microversion: 2.1 time: 0.099036 Oct 04 22:35:29.776730 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3784/6744] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:35:29 2022] GET /compute/v2.1/servers/7ec8a071-93b3-4f7e-91ab-ef31fda0f26d => generated 1304 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:35:30.800877 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-50fe7b3e-8d02-4c94-886f-e75fed2b58c2 tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:35:30.801594 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-50fe7b3e-8d02-4c94-886f-e75fed2b58c2 tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] [instance: 7ec8a071-93b3-4f7e-91ab-ef31fda0f26d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:35:30.808532 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-50fe7b3e-8d02-4c94-886f-e75fed2b58c2 tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:35:30.809029 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-50fe7b3e-8d02-4c94-886f-e75fed2b58c2 tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:35:30.809473 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-50fe7b3e-8d02-4c94-886f-e75fed2b58c2 tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:35:30.810171 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-50fe7b3e-8d02-4c94-886f-e75fed2b58c2 tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:35:30.810661 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-50fe7b3e-8d02-4c94-886f-e75fed2b58c2 tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:35:30.811096 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-50fe7b3e-8d02-4c94-886f-e75fed2b58c2 tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:35:30.824837 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-50fe7b3e-8d02-4c94-886f-e75fed2b58c2 tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] HTTP exception thrown: Instance 7ec8a071-93b3-4f7e-91ab-ef31fda0f26d could not be found. Oct 04 22:35:30.826483 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-50fe7b3e-8d02-4c94-886f-e75fed2b58c2 tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Request method failure captured: Oct 04 22:35:30.826483 n-d-860284-1 devstack@n-api.service[134102]: request: GET /compute/v2.1/servers/7ec8a071-93b3-4f7e-91ab-ef31fda0f26d HTTP/1.1 Oct 04 22:35:30.826483 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 22:35:30.826483 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 22:35:30.826483 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 22:35:30.826483 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 22:35:30.826483 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 22:35:30.826483 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 22:35:30.826483 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 22:35:30.826483 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 22:35:30.826483 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPLUgdrJLaLCVDN3XMXTPCYPyVdlJyRmDQd6A0QKRn0Nsz8bgU8fz7YRSTUJkIsY-eE3ctCWCazKzKSHRc5ce5a1C6B4VEUFYKdjQVRmI7_NtHl0x2_NEsOw8mEmxZI8TqSU1WApzHswLpCayI4Xnx-4z_1EGeR8rUTfnqwM87kQvmUk Oct 04 22:35:30.826483 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 22:35:30.826483 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 22:35:30.826483 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 22:35:30.826483 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 22:35:30.826483 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 22:35:30.826483 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 22:35:30.826483 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: feda9a9f3acc4e1abbc7d4963f8634cd Oct 04 22:35:30.826483 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-VolumesActionsTest-500945356 Oct 04 22:35:30.826483 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 22:35:30.826483 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 22:35:30.826483 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/feda9a9f3acc4e1abbc7d4963f8634cd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_feda9a9f3acc4e1abbc7d4963f8634cd", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/feda9a9f3acc4e1abbc7d4963f8634cd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/feda9a9f3acc4e1abbc7d4963f8634cd"}]}] Oct 04 22:35:30.826483 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-VolumesActionsTest-500945356 Oct 04 22:35:30.826483 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: feda9a9f3acc4e1abbc7d4963f8634cd Oct 04 22:35:30.826483 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-VolumesActionsTest-500945356 Oct 04 22:35:30.826483 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-VolumesActionsTest-500945356-project Oct 04 22:35:30.826483 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 22:35:30.826483 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 22:35:30.826483 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: 14d77e470e0743b7a39f37436c09003e Oct 04 22:35:30.826483 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-VolumesActionsTest-500945356-project Oct 04 22:35:30.826483 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 22:35:30.826483 n-d-860284-1 devstack@n-api.service[134102]: exception: Instance 7ec8a071-93b3-4f7e-91ab-ef31fda0f26d could not be found. Oct 04 22:35:30.826483 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': '7ec8a071-93b3-4f7e-91ab-ef31fda0f26d'} Oct 04 22:35:30.826483 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:35:30.826483 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:35:30.826483 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:35:30.826483 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:35:30.826483 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:35:30.826483 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:35:30.826483 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:35:30.826483 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:35:30.826483 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:35:30.826483 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:35:30.826483 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ec8a071-93b3-4f7e-91ab-ef31fda0f26d could not be found. Oct 04 22:35:30.826483 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:35:30.826483 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:35:30.826483 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:35:30.826483 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:35:30.826483 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:35:30.826483 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:35:30.826483 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:35:30.826483 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:35:30.826483 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:35:30.826483 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:35:30.826483 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:35:30.826483 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:35:30.826483 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:35:30.826483 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:35:30.826483 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:35:30.826483 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:35:30.826483 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ec8a071-93b3-4f7e-91ab-ef31fda0f26d could not be found. Oct 04 22:35:30.826483 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:35:30.826483 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:35:30.826483 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:35:30.832529 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:35:30.832529 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:35:30.832529 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:35:30.832529 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:35:30.832529 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:35:30.832529 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ec8a071-93b3-4f7e-91ab-ef31fda0f26d could not be found. Oct 04 22:35:30.832529 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:35:30.832529 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-50fe7b3e-8d02-4c94-886f-e75fed2b58c2 tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Returning 404 to user: Instance 7ec8a071-93b3-4f7e-91ab-ef31fda0f26d could not be found. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:35:30.832529 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-50fe7b3e-8d02-4c94-886f-e75fed2b58c2 tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] 10.222.0.43 "GET /compute/v2.1/servers/7ec8a071-93b3-4f7e-91ab-ef31fda0f26d" status: 404 len: 111 microversion: 2.1 time: 0.032396 Oct 04 22:35:30.832529 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2961/6745] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:35:30 2022] GET /compute/v2.1/servers/7ec8a071-93b3-4f7e-91ab-ef31fda0f26d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:35:30.876816 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-f484a0c9-ef09-481c-8c0e-633d45efcfee tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-406202866", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452", "networks": [{"uuid": "fcfb6aa4-a9b6-4702-b760-c33a3cbfa755"}]}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:35:30.931286 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.network.neutron [None req-f484a0c9-ef09-481c-8c0e-633d45efcfee tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] validate_networks() for [('fcfb6aa4-a9b6-4702-b760-c33a3cbfa755', None, None, None, None, None)] {{(pid=134101) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 22:35:31.285765 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-f484a0c9-ef09-481c-8c0e-633d45efcfee tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Flavor limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 22:35:31.286210 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-f484a0c9-ef09-481c-8c0e-633d45efcfee tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Image limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 22:35:31.286764 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-f484a0c9-ef09-481c-8c0e-633d45efcfee tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Flavor pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 22:35:31.287195 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-f484a0c9-ef09-481c-8c0e-633d45efcfee tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Image pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 22:35:31.288225 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-f484a0c9-ef09-481c-8c0e-633d45efcfee tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 22:35:31.297181 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f484a0c9-ef09-481c-8c0e-633d45efcfee tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:35:31.297709 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f484a0c9-ef09-481c-8c0e-633d45efcfee tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:35:31.298161 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f484a0c9-ef09-481c-8c0e-633d45efcfee tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:35:31.298940 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f484a0c9-ef09-481c-8c0e-633d45efcfee tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:35:31.299411 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f484a0c9-ef09-481c-8c0e-633d45efcfee tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:35:31.299854 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f484a0c9-ef09-481c-8c0e-633d45efcfee tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:35:31.317276 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-f484a0c9-ef09-481c-8c0e-633d45efcfee tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Getting quotas for project feda9a9f3acc4e1abbc7d4963f8634cd. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:35:31.322584 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-f484a0c9-ef09-481c-8c0e-633d45efcfee tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Getting quotas for user 14d77e470e0743b7a39f37436c09003e and project feda9a9f3acc4e1abbc7d4963f8634cd. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:35:31.334841 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-f484a0c9-ef09-481c-8c0e-633d45efcfee tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Going to run 1 instances... {{(pid=134101) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 22:35:31.337326 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-f484a0c9-ef09-481c-8c0e-633d45efcfee tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] [instance: 87ed62f7-c01b-417c-8ad7-d85586b32ebe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='58548514-5dac-426c-81f5-19e3fba33e23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134101) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 22:35:31.382633 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-f484a0c9-ef09-481c-8c0e-633d45efcfee tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.509727 Oct 04 22:35:31.383296 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3785/6746] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 22:35:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 511 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 22:35:31.395562 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-2f7831d0-3441-4338-9644-48aa1bc5c992 tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:35:31.396179 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-2f7831d0-3441-4338-9644-48aa1bc5c992 tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] [instance: 87ed62f7-c01b-417c-8ad7-d85586b32ebe] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:35:31.451864 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-2f7831d0-3441-4338-9644-48aa1bc5c992 tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d77e470e0743b7a39f37436c09003e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feda9a9f3acc4e1abbc7d4963f8634cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:35:31.458767 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-2f7831d0-3441-4338-9644-48aa1bc5c992 tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] 10.222.0.43 "GET /compute/v2.1/servers/87ed62f7-c01b-417c-8ad7-d85586b32ebe" status: 200 len: 1213 microversion: 2.1 time: 0.068125 Oct 04 22:35:31.459344 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2962/6747] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:35:31 2022] GET /compute/v2.1/servers/87ed62f7-c01b-417c-8ad7-d85586b32ebe => generated 1213 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:35:32.482186 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-18eebc83-65f0-4ac1-91a4-a44439ffb483 tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:35:32.484599 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-18eebc83-65f0-4ac1-91a4-a44439ffb483 tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] [instance: 87ed62f7-c01b-417c-8ad7-d85586b32ebe] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:35:32.491977 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-18eebc83-65f0-4ac1-91a4-a44439ffb483 tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:35:32.492477 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-18eebc83-65f0-4ac1-91a4-a44439ffb483 tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:35:32.492935 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-18eebc83-65f0-4ac1-91a4-a44439ffb483 tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:35:32.493657 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-18eebc83-65f0-4ac1-91a4-a44439ffb483 tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:35:32.494134 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-18eebc83-65f0-4ac1-91a4-a44439ffb483 tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:35:32.494619 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-18eebc83-65f0-4ac1-91a4-a44439ffb483 tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:35:32.559179 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-18eebc83-65f0-4ac1-91a4-a44439ffb483 tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d77e470e0743b7a39f37436c09003e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feda9a9f3acc4e1abbc7d4963f8634cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:35:32.567005 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-18eebc83-65f0-4ac1-91a4-a44439ffb483 tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] 10.222.0.43 "GET /compute/v2.1/servers/87ed62f7-c01b-417c-8ad7-d85586b32ebe" status: 200 len: 1271 microversion: 2.1 time: 0.089669 Oct 04 22:35:32.567581 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3786/6748] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:35:32 2022] GET /compute/v2.1/servers/87ed62f7-c01b-417c-8ad7-d85586b32ebe => generated 1271 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:35:33.590727 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-7d23b5b4-90b8-4cf2-a309-bb5af7603dd8 tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:35:33.591357 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-7d23b5b4-90b8-4cf2-a309-bb5af7603dd8 tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] [instance: 87ed62f7-c01b-417c-8ad7-d85586b32ebe] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:35:33.599084 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7d23b5b4-90b8-4cf2-a309-bb5af7603dd8 tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:35:33.599578 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7d23b5b4-90b8-4cf2-a309-bb5af7603dd8 tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:35:33.600558 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7d23b5b4-90b8-4cf2-a309-bb5af7603dd8 tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:35:33.601265 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7d23b5b4-90b8-4cf2-a309-bb5af7603dd8 tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:35:33.601722 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7d23b5b4-90b8-4cf2-a309-bb5af7603dd8 tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:35:33.602156 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7d23b5b4-90b8-4cf2-a309-bb5af7603dd8 tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:35:33.712683 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-391850d4-de35-479a-9a0f-d98e84c8a006 req-66e3cc81-a37b-4875-a8fb-1adda70e40bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87ed62f7-c01b-417c-8ad7-d85586b32ebe", "tag": "76a62bc2-4217-47b3-9f44-2c4a9fe549be"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:35:33.728088 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-391850d4-de35-479a-9a0f-d98e84c8a006 req-66e3cc81-a37b-4875-a8fb-1adda70e40bf service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:35:33.728603 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-391850d4-de35-479a-9a0f-d98e84c8a006 req-66e3cc81-a37b-4875-a8fb-1adda70e40bf service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:35:33.729334 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-391850d4-de35-479a-9a0f-d98e84c8a006 req-66e3cc81-a37b-4875-a8fb-1adda70e40bf service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:35:33.742614 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-391850d4-de35-479a-9a0f-d98e84c8a006 req-66e3cc81-a37b-4875-a8fb-1adda70e40bf service nova] Creating event network-changed:76a62bc2-4217-47b3-9f44-2c4a9fe549be for instance 87ed62f7-c01b-417c-8ad7-d85586b32ebe on n-h1-860284-1 Oct 04 22:35:33.747897 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-391850d4-de35-479a-9a0f-d98e84c8a006 req-66e3cc81-a37b-4875-a8fb-1adda70e40bf service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039427 Oct 04 22:35:33.748738 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3787/6749] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:35:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:35:33.837414 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-7d23b5b4-90b8-4cf2-a309-bb5af7603dd8 tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d77e470e0743b7a39f37436c09003e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feda9a9f3acc4e1abbc7d4963f8634cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:35:33.845231 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-7d23b5b4-90b8-4cf2-a309-bb5af7603dd8 tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] 10.222.0.43 "GET /compute/v2.1/servers/87ed62f7-c01b-417c-8ad7-d85586b32ebe" status: 200 len: 1313 microversion: 2.1 time: 0.258522 Oct 04 22:35:33.845822 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2963/6750] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:35:33 2022] GET /compute/v2.1/servers/87ed62f7-c01b-417c-8ad7-d85586b32ebe => generated 1313 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:35:34.870394 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-bee9648b-ec4a-45ae-85fa-4ca5df7a6d1e tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:35:34.871128 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-bee9648b-ec4a-45ae-85fa-4ca5df7a6d1e tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] [instance: 87ed62f7-c01b-417c-8ad7-d85586b32ebe] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:35:34.878187 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bee9648b-ec4a-45ae-85fa-4ca5df7a6d1e tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:35:34.878715 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bee9648b-ec4a-45ae-85fa-4ca5df7a6d1e tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:35:34.879166 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bee9648b-ec4a-45ae-85fa-4ca5df7a6d1e tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:35:34.879870 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bee9648b-ec4a-45ae-85fa-4ca5df7a6d1e tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:35:34.880342 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bee9648b-ec4a-45ae-85fa-4ca5df7a6d1e tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:35:34.880787 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bee9648b-ec4a-45ae-85fa-4ca5df7a6d1e tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:35:35.015978 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-bee9648b-ec4a-45ae-85fa-4ca5df7a6d1e tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d77e470e0743b7a39f37436c09003e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feda9a9f3acc4e1abbc7d4963f8634cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:35:35.024274 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-bee9648b-ec4a-45ae-85fa-4ca5df7a6d1e tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] 10.222.0.43 "GET /compute/v2.1/servers/87ed62f7-c01b-417c-8ad7-d85586b32ebe" status: 200 len: 1313 microversion: 2.1 time: 0.159083 Oct 04 22:35:35.024858 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3788/6751] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:35:34 2022] GET /compute/v2.1/servers/87ed62f7-c01b-417c-8ad7-d85586b32ebe => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:35:36.047298 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-7f34bc16-eb82-439b-ad61-baef03aae1c2 tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:35:36.047924 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-7f34bc16-eb82-439b-ad61-baef03aae1c2 tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] [instance: 87ed62f7-c01b-417c-8ad7-d85586b32ebe] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:35:36.055149 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7f34bc16-eb82-439b-ad61-baef03aae1c2 tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:35:36.055643 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7f34bc16-eb82-439b-ad61-baef03aae1c2 tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:35:36.056091 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7f34bc16-eb82-439b-ad61-baef03aae1c2 tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:35:36.056797 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7f34bc16-eb82-439b-ad61-baef03aae1c2 tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:35:36.057264 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7f34bc16-eb82-439b-ad61-baef03aae1c2 tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:35:36.057703 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7f34bc16-eb82-439b-ad61-baef03aae1c2 tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:35:36.222720 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-7f34bc16-eb82-439b-ad61-baef03aae1c2 tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d77e470e0743b7a39f37436c09003e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feda9a9f3acc4e1abbc7d4963f8634cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:35:36.231413 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-7f34bc16-eb82-439b-ad61-baef03aae1c2 tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] 10.222.0.43 "GET /compute/v2.1/servers/87ed62f7-c01b-417c-8ad7-d85586b32ebe" status: 200 len: 1313 microversion: 2.1 time: 0.188070 Oct 04 22:35:36.231994 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2964/6752] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:35:36 2022] GET /compute/v2.1/servers/87ed62f7-c01b-417c-8ad7-d85586b32ebe => generated 1313 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:35:37.254144 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-d6d9fd29-45bc-4905-b884-0a80f006923d tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:35:37.254803 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-d6d9fd29-45bc-4905-b884-0a80f006923d tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] [instance: 87ed62f7-c01b-417c-8ad7-d85586b32ebe] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:35:37.262547 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d6d9fd29-45bc-4905-b884-0a80f006923d tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:35:37.263041 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d6d9fd29-45bc-4905-b884-0a80f006923d tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:35:37.263490 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d6d9fd29-45bc-4905-b884-0a80f006923d tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:35:37.264188 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d6d9fd29-45bc-4905-b884-0a80f006923d tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:35:37.264650 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d6d9fd29-45bc-4905-b884-0a80f006923d tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:35:37.265103 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d6d9fd29-45bc-4905-b884-0a80f006923d tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:35:37.399789 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-d6d9fd29-45bc-4905-b884-0a80f006923d tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d77e470e0743b7a39f37436c09003e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feda9a9f3acc4e1abbc7d4963f8634cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:35:37.407648 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-d6d9fd29-45bc-4905-b884-0a80f006923d tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] 10.222.0.43 "GET /compute/v2.1/servers/87ed62f7-c01b-417c-8ad7-d85586b32ebe" status: 200 len: 1313 microversion: 2.1 time: 0.157432 Oct 04 22:35:37.408229 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3789/6753] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:35:37 2022] GET /compute/v2.1/servers/87ed62f7-c01b-417c-8ad7-d85586b32ebe => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:35:38.431055 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-5b0d468b-76df-4922-87ba-fb196e036c76 tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:35:38.431697 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-5b0d468b-76df-4922-87ba-fb196e036c76 tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] [instance: 87ed62f7-c01b-417c-8ad7-d85586b32ebe] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:35:38.438686 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5b0d468b-76df-4922-87ba-fb196e036c76 tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:35:38.439176 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5b0d468b-76df-4922-87ba-fb196e036c76 tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:35:38.439613 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5b0d468b-76df-4922-87ba-fb196e036c76 tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:35:38.440318 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5b0d468b-76df-4922-87ba-fb196e036c76 tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:35:38.440781 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5b0d468b-76df-4922-87ba-fb196e036c76 tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:35:38.441212 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5b0d468b-76df-4922-87ba-fb196e036c76 tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:35:38.579857 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-5b0d468b-76df-4922-87ba-fb196e036c76 tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d77e470e0743b7a39f37436c09003e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feda9a9f3acc4e1abbc7d4963f8634cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:35:38.587857 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-5b0d468b-76df-4922-87ba-fb196e036c76 tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] 10.222.0.43 "GET /compute/v2.1/servers/87ed62f7-c01b-417c-8ad7-d85586b32ebe" status: 200 len: 1313 microversion: 2.1 time: 0.161617 Oct 04 22:35:38.588442 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2965/6754] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:35:38 2022] GET /compute/v2.1/servers/87ed62f7-c01b-417c-8ad7-d85586b32ebe => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:35:39.610802 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-6a1903d2-ed45-4ad6-a9bd-fae91b0a534b tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:35:39.611427 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-6a1903d2-ed45-4ad6-a9bd-fae91b0a534b tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] [instance: 87ed62f7-c01b-417c-8ad7-d85586b32ebe] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:35:39.618553 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6a1903d2-ed45-4ad6-a9bd-fae91b0a534b tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:35:39.619060 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6a1903d2-ed45-4ad6-a9bd-fae91b0a534b tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:35:39.619516 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6a1903d2-ed45-4ad6-a9bd-fae91b0a534b tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:35:39.620217 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6a1903d2-ed45-4ad6-a9bd-fae91b0a534b tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:35:39.620684 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6a1903d2-ed45-4ad6-a9bd-fae91b0a534b tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:35:39.621121 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6a1903d2-ed45-4ad6-a9bd-fae91b0a534b tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:35:39.749273 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-6a1903d2-ed45-4ad6-a9bd-fae91b0a534b tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d77e470e0743b7a39f37436c09003e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feda9a9f3acc4e1abbc7d4963f8634cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:35:39.757727 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-6a1903d2-ed45-4ad6-a9bd-fae91b0a534b tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] 10.222.0.43 "GET /compute/v2.1/servers/87ed62f7-c01b-417c-8ad7-d85586b32ebe" status: 200 len: 1313 microversion: 2.1 time: 0.150922 Oct 04 22:35:39.758299 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3790/6755] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:35:39 2022] GET /compute/v2.1/servers/87ed62f7-c01b-417c-8ad7-d85586b32ebe => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:35:40.034432 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-fd9ba818-279a-46cb-b6db-8c8f2aefd8fa req-8f7cf447-839f-4bfd-a6d7-92bac114d48e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87ed62f7-c01b-417c-8ad7-d85586b32ebe", "name": "network-vif-plugged", "status": "completed", "tag": "76a62bc2-4217-47b3-9f44-2c4a9fe549be"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:35:40.045413 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-fd9ba818-279a-46cb-b6db-8c8f2aefd8fa req-8f7cf447-839f-4bfd-a6d7-92bac114d48e service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:35:40.046111 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-fd9ba818-279a-46cb-b6db-8c8f2aefd8fa req-8f7cf447-839f-4bfd-a6d7-92bac114d48e service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:35:40.046764 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-fd9ba818-279a-46cb-b6db-8c8f2aefd8fa req-8f7cf447-839f-4bfd-a6d7-92bac114d48e service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:35:40.060079 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-fd9ba818-279a-46cb-b6db-8c8f2aefd8fa req-8f7cf447-839f-4bfd-a6d7-92bac114d48e service nova] Creating event network-vif-plugged:76a62bc2-4217-47b3-9f44-2c4a9fe549be for instance 87ed62f7-c01b-417c-8ad7-d85586b32ebe on n-h1-860284-1 Oct 04 22:35:40.065324 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-fd9ba818-279a-46cb-b6db-8c8f2aefd8fa req-8f7cf447-839f-4bfd-a6d7-92bac114d48e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034682 Oct 04 22:35:40.065946 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2966/6756] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:35:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:35:40.780514 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-b4d81447-a1ba-4491-ab36-37423a1539cd tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:35:40.781151 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-b4d81447-a1ba-4491-ab36-37423a1539cd tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] [instance: 87ed62f7-c01b-417c-8ad7-d85586b32ebe] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:35:40.788280 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b4d81447-a1ba-4491-ab36-37423a1539cd tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:35:40.788785 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b4d81447-a1ba-4491-ab36-37423a1539cd tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:35:40.789244 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b4d81447-a1ba-4491-ab36-37423a1539cd tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:35:40.789960 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b4d81447-a1ba-4491-ab36-37423a1539cd tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:35:40.790471 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b4d81447-a1ba-4491-ab36-37423a1539cd tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:35:40.790921 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b4d81447-a1ba-4491-ab36-37423a1539cd tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:35:40.925212 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-b4d81447-a1ba-4491-ab36-37423a1539cd tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d77e470e0743b7a39f37436c09003e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feda9a9f3acc4e1abbc7d4963f8634cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:35:40.933673 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-b4d81447-a1ba-4491-ab36-37423a1539cd tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] 10.222.0.43 "GET /compute/v2.1/servers/87ed62f7-c01b-417c-8ad7-d85586b32ebe" status: 200 len: 1313 microversion: 2.1 time: 0.157155 Oct 04 22:35:40.934257 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3791/6757] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:35:40 2022] GET /compute/v2.1/servers/87ed62f7-c01b-417c-8ad7-d85586b32ebe => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:35:41.954109 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell0:SELECT=2 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:35:41.958820 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-1053067d-ef10-450f-ab53-77d0e7bc766f tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:35:41.960167 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-1053067d-ef10-450f-ab53-77d0e7bc766f tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] [instance: 87ed62f7-c01b-417c-8ad7-d85586b32ebe] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:35:41.966671 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1053067d-ef10-450f-ab53-77d0e7bc766f tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:35:41.967168 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1053067d-ef10-450f-ab53-77d0e7bc766f tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:35:41.967611 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1053067d-ef10-450f-ab53-77d0e7bc766f tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:35:41.968312 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1053067d-ef10-450f-ab53-77d0e7bc766f tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:35:41.968774 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1053067d-ef10-450f-ab53-77d0e7bc766f tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:35:41.969204 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1053067d-ef10-450f-ab53-77d0e7bc766f tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:35:42.103874 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-1053067d-ef10-450f-ab53-77d0e7bc766f tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d77e470e0743b7a39f37436c09003e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feda9a9f3acc4e1abbc7d4963f8634cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:35:42.111665 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-1053067d-ef10-450f-ab53-77d0e7bc766f tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] 10.222.0.43 "GET /compute/v2.1/servers/87ed62f7-c01b-417c-8ad7-d85586b32ebe" status: 200 len: 1497 microversion: 2.1 time: 0.159411 Oct 04 22:35:42.112253 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2967/6758] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:35:41 2022] GET /compute/v2.1/servers/87ed62f7-c01b-417c-8ad7-d85586b32ebe => generated 1497 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:35:42.527196 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-dab8f796-fdbf-477c-9d9f-00866d7cf1d1 tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:35:42.527713 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-dab8f796-fdbf-477c-9d9f-00866d7cf1d1 tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] [instance: 87ed62f7-c01b-417c-8ad7-d85586b32ebe] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:35:42.529670 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=2 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:35:42.530351 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=6 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:35:42.537885 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dab8f796-fdbf-477c-9d9f-00866d7cf1d1 tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:35:42.538403 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dab8f796-fdbf-477c-9d9f-00866d7cf1d1 tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:35:42.538850 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dab8f796-fdbf-477c-9d9f-00866d7cf1d1 tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:35:42.539550 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dab8f796-fdbf-477c-9d9f-00866d7cf1d1 tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:35:42.540018 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dab8f796-fdbf-477c-9d9f-00866d7cf1d1 tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:35:42.540457 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dab8f796-fdbf-477c-9d9f-00866d7cf1d1 tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:35:42.567057 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-dab8f796-fdbf-477c-9d9f-00866d7cf1d1 tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] [instance: 87ed62f7-c01b-417c-8ad7-d85586b32ebe] Going to try to terminate instance {{(pid=134101) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 22:35:42.570062 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:35:42.644465 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-dab8f796-fdbf-477c-9d9f-00866d7cf1d1 tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] 10.222.0.43 "DELETE /compute/v2.1/servers/87ed62f7-c01b-417c-8ad7-d85586b32ebe" status: 204 len: 0 microversion: 2.1 time: 0.120843 Oct 04 22:35:42.645233 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3792/6759] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 22:35:42 2022] DELETE /compute/v2.1/servers/87ed62f7-c01b-417c-8ad7-d85586b32ebe => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 22:35:42.653919 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-6bba8e1a-1730-4633-bca0-bf5a99f6c186 tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:35:42.654555 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-6bba8e1a-1730-4633-bca0-bf5a99f6c186 tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] [instance: 87ed62f7-c01b-417c-8ad7-d85586b32ebe] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:35:42.660538 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6bba8e1a-1730-4633-bca0-bf5a99f6c186 tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:35:42.661026 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6bba8e1a-1730-4633-bca0-bf5a99f6c186 tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:35:42.661470 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6bba8e1a-1730-4633-bca0-bf5a99f6c186 tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:35:42.662775 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6bba8e1a-1730-4633-bca0-bf5a99f6c186 tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:35:42.663246 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6bba8e1a-1730-4633-bca0-bf5a99f6c186 tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:35:42.663684 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6bba8e1a-1730-4633-bca0-bf5a99f6c186 tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:35:42.793473 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-6bba8e1a-1730-4633-bca0-bf5a99f6c186 tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d77e470e0743b7a39f37436c09003e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feda9a9f3acc4e1abbc7d4963f8634cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:35:42.801219 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-6bba8e1a-1730-4633-bca0-bf5a99f6c186 tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] 10.222.0.43 "GET /compute/v2.1/servers/87ed62f7-c01b-417c-8ad7-d85586b32ebe" status: 200 len: 1503 microversion: 2.1 time: 0.151240 Oct 04 22:35:42.801803 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2968/6760] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:35:42 2022] GET /compute/v2.1/servers/87ed62f7-c01b-417c-8ad7-d85586b32ebe => generated 1503 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:35:43.825318 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-66caa9b2-a099-4343-a30a-0c838d064f99 tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:35:43.826029 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-66caa9b2-a099-4343-a30a-0c838d064f99 tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] [instance: 87ed62f7-c01b-417c-8ad7-d85586b32ebe] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:35:43.832893 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-66caa9b2-a099-4343-a30a-0c838d064f99 tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:35:43.833388 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-66caa9b2-a099-4343-a30a-0c838d064f99 tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:35:43.833838 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-66caa9b2-a099-4343-a30a-0c838d064f99 tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:35:43.834611 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-66caa9b2-a099-4343-a30a-0c838d064f99 tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:35:43.835079 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-66caa9b2-a099-4343-a30a-0c838d064f99 tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:35:43.835551 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-66caa9b2-a099-4343-a30a-0c838d064f99 tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:35:43.973329 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-66caa9b2-a099-4343-a30a-0c838d064f99 tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d77e470e0743b7a39f37436c09003e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feda9a9f3acc4e1abbc7d4963f8634cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:35:43.981710 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-66caa9b2-a099-4343-a30a-0c838d064f99 tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] 10.222.0.43 "GET /compute/v2.1/servers/87ed62f7-c01b-417c-8ad7-d85586b32ebe" status: 200 len: 1503 microversion: 2.1 time: 0.160673 Oct 04 22:35:43.982287 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3793/6761] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:35:43 2022] GET /compute/v2.1/servers/87ed62f7-c01b-417c-8ad7-d85586b32ebe => generated 1503 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:35:44.573725 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-5c6d894a-082c-4b63-a814-9e1b06dedc0a req-cbf499d2-e303-4605-9140-c7fa9a3ceaab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87ed62f7-c01b-417c-8ad7-d85586b32ebe", "name": "network-vif-deleted", "tag": "76a62bc2-4217-47b3-9f44-2c4a9fe549be"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:35:44.587247 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-5c6d894a-082c-4b63-a814-9e1b06dedc0a req-cbf499d2-e303-4605-9140-c7fa9a3ceaab service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:35:44.587925 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-5c6d894a-082c-4b63-a814-9e1b06dedc0a req-cbf499d2-e303-4605-9140-c7fa9a3ceaab service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:35:44.588436 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-5c6d894a-082c-4b63-a814-9e1b06dedc0a req-cbf499d2-e303-4605-9140-c7fa9a3ceaab service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:35:44.605529 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-5c6d894a-082c-4b63-a814-9e1b06dedc0a req-cbf499d2-e303-4605-9140-c7fa9a3ceaab service nova] Creating event network-vif-deleted:76a62bc2-4217-47b3-9f44-2c4a9fe549be for instance 87ed62f7-c01b-417c-8ad7-d85586b32ebe on n-h1-860284-1 Oct 04 22:35:44.610988 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-5c6d894a-082c-4b63-a814-9e1b06dedc0a req-cbf499d2-e303-4605-9140-c7fa9a3ceaab service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041227 Oct 04 22:35:44.611611 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2969/6762] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:35:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:35:45.005662 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e2933089-18ae-4480-b0cc-8e3fd802bc3d tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:35:45.006870 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-e2933089-18ae-4480-b0cc-8e3fd802bc3d tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] [instance: 87ed62f7-c01b-417c-8ad7-d85586b32ebe] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:35:45.009806 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:35:45.015733 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e2933089-18ae-4480-b0cc-8e3fd802bc3d tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:35:45.016246 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e2933089-18ae-4480-b0cc-8e3fd802bc3d tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:35:45.016735 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e2933089-18ae-4480-b0cc-8e3fd802bc3d tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:35:45.017466 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e2933089-18ae-4480-b0cc-8e3fd802bc3d tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:35:45.017940 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e2933089-18ae-4480-b0cc-8e3fd802bc3d tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:35:45.018407 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e2933089-18ae-4480-b0cc-8e3fd802bc3d tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:35:45.058820 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e2933089-18ae-4480-b0cc-8e3fd802bc3d tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:35:45.059326 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e2933089-18ae-4480-b0cc-8e3fd802bc3d tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:35:45.059792 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e2933089-18ae-4480-b0cc-8e3fd802bc3d tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:35:45.060264 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.objects.instance [None req-e2933089-18ae-4480-b0cc-8e3fd802bc3d tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Lazy-loading 'fault' on Instance uuid 87ed62f7-c01b-417c-8ad7-d85586b32ebe {{(pid=134101) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 22:35:45.105427 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-e2933089-18ae-4480-b0cc-8e3fd802bc3d tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d77e470e0743b7a39f37436c09003e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feda9a9f3acc4e1abbc7d4963f8634cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:35:45.112432 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-e2933089-18ae-4480-b0cc-8e3fd802bc3d tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] 10.222.0.43 "GET /compute/v2.1/servers/87ed62f7-c01b-417c-8ad7-d85586b32ebe" status: 200 len: 1303 microversion: 2.1 time: 0.111141 Oct 04 22:35:45.113031 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3794/6763] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:35:44 2022] GET /compute/v2.1/servers/87ed62f7-c01b-417c-8ad7-d85586b32ebe => generated 1303 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:35:46.137182 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-6891627f-2d2c-4bc9-8e7f-9102af10f72a tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:35:46.137890 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-6891627f-2d2c-4bc9-8e7f-9102af10f72a tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] [instance: 87ed62f7-c01b-417c-8ad7-d85586b32ebe] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:35:46.139901 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_api:SELECT=41 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:35:46.145685 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6891627f-2d2c-4bc9-8e7f-9102af10f72a tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:35:46.146171 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6891627f-2d2c-4bc9-8e7f-9102af10f72a tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:35:46.146638 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6891627f-2d2c-4bc9-8e7f-9102af10f72a tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:35:46.147521 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6891627f-2d2c-4bc9-8e7f-9102af10f72a tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:35:46.148016 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6891627f-2d2c-4bc9-8e7f-9102af10f72a tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:35:46.148439 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6891627f-2d2c-4bc9-8e7f-9102af10f72a tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:35:46.151347 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=81 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:35:46.164344 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-6891627f-2d2c-4bc9-8e7f-9102af10f72a tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] HTTP exception thrown: Instance 87ed62f7-c01b-417c-8ad7-d85586b32ebe could not be found. Oct 04 22:35:46.166012 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-6891627f-2d2c-4bc9-8e7f-9102af10f72a tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Request method failure captured: Oct 04 22:35:46.166012 n-d-860284-1 devstack@n-api.service[134102]: request: GET /compute/v2.1/servers/87ed62f7-c01b-417c-8ad7-d85586b32ebe HTTP/1.1 Oct 04 22:35:46.166012 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 22:35:46.166012 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 22:35:46.166012 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 22:35:46.166012 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 22:35:46.166012 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 22:35:46.166012 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 22:35:46.166012 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 22:35:46.166012 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 22:35:46.166012 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPLUgdrJLaLCVDN3XMXTPCYPyVdlJyRmDQd6A0QKRn0Nsz8bgU8fz7YRSTUJkIsY-eE3ctCWCazKzKSHRc5ce5a1C6B4VEUFYKdjQVRmI7_NtHl0x2_NEsOw8mEmxZI8TqSU1WApzHswLpCayI4Xnx-4z_1EGeR8rUTfnqwM87kQvmUk Oct 04 22:35:46.166012 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 22:35:46.166012 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 22:35:46.166012 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 22:35:46.166012 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 22:35:46.166012 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 22:35:46.166012 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 22:35:46.166012 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: feda9a9f3acc4e1abbc7d4963f8634cd Oct 04 22:35:46.166012 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-VolumesActionsTest-500945356 Oct 04 22:35:46.166012 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 22:35:46.166012 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 22:35:46.166012 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/feda9a9f3acc4e1abbc7d4963f8634cd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_feda9a9f3acc4e1abbc7d4963f8634cd", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/feda9a9f3acc4e1abbc7d4963f8634cd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/feda9a9f3acc4e1abbc7d4963f8634cd"}]}] Oct 04 22:35:46.166012 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-VolumesActionsTest-500945356 Oct 04 22:35:46.166012 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: feda9a9f3acc4e1abbc7d4963f8634cd Oct 04 22:35:46.166012 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-VolumesActionsTest-500945356 Oct 04 22:35:46.166012 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-VolumesActionsTest-500945356-project Oct 04 22:35:46.166012 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 22:35:46.166012 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 22:35:46.166012 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: 14d77e470e0743b7a39f37436c09003e Oct 04 22:35:46.166012 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-VolumesActionsTest-500945356-project Oct 04 22:35:46.166012 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 22:35:46.166012 n-d-860284-1 devstack@n-api.service[134102]: exception: Instance 87ed62f7-c01b-417c-8ad7-d85586b32ebe could not be found. Oct 04 22:35:46.166012 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': '87ed62f7-c01b-417c-8ad7-d85586b32ebe'} Oct 04 22:35:46.166012 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:35:46.166012 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:35:46.166012 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:35:46.166012 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:35:46.166012 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:35:46.166012 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:35:46.166012 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:35:46.166012 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:35:46.166012 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:35:46.166012 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:35:46.166012 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87ed62f7-c01b-417c-8ad7-d85586b32ebe could not be found. Oct 04 22:35:46.166012 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:35:46.166012 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:35:46.166012 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:35:46.166012 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:35:46.166012 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:35:46.166012 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:35:46.166012 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:35:46.166012 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:35:46.166012 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:35:46.166012 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:35:46.166012 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:35:46.166012 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:35:46.166012 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:35:46.166012 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:35:46.166012 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:35:46.166012 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:35:46.166012 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87ed62f7-c01b-417c-8ad7-d85586b32ebe could not be found. Oct 04 22:35:46.166012 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:35:46.166012 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:35:46.166012 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:35:46.169700 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:35:46.169700 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:35:46.169700 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:35:46.169700 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:35:46.169700 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:35:46.169700 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87ed62f7-c01b-417c-8ad7-d85586b32ebe could not be found. Oct 04 22:35:46.169700 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:35:46.169700 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-6891627f-2d2c-4bc9-8e7f-9102af10f72a tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] Returning 404 to user: Instance 87ed62f7-c01b-417c-8ad7-d85586b32ebe could not be found. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:35:46.169700 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-6891627f-2d2c-4bc9-8e7f-9102af10f72a tempest-VolumesActionsTest-500945356 tempest-VolumesActionsTest-500945356-project] 10.222.0.43 "GET /compute/v2.1/servers/87ed62f7-c01b-417c-8ad7-d85586b32ebe" status: 404 len: 111 microversion: 2.1 time: 0.035707 Oct 04 22:35:46.169700 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2970/6764] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:35:46 2022] GET /compute/v2.1/servers/87ed62f7-c01b-417c-8ad7-d85586b32ebe => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:36:14.274383 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-47293a80-6bd0-40dd-97a7-81317123158e tempest-VolumesNegativeTest-1980825743 tempest-VolumesNegativeTest-1980825743-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1974834665", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:36:14.281616 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=3 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:36:14.282296 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:36:14.329469 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.network.neutron [None req-47293a80-6bd0-40dd-97a7-81317123158e tempest-VolumesNegativeTest-1980825743 tempest-VolumesNegativeTest-1980825743-project] validate_networks() for None {{(pid=134101) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 22:36:14.618278 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-47293a80-6bd0-40dd-97a7-81317123158e tempest-VolumesNegativeTest-1980825743 tempest-VolumesNegativeTest-1980825743-project] Flavor limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 22:36:14.618749 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-47293a80-6bd0-40dd-97a7-81317123158e tempest-VolumesNegativeTest-1980825743 tempest-VolumesNegativeTest-1980825743-project] Image limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 22:36:14.619248 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-47293a80-6bd0-40dd-97a7-81317123158e tempest-VolumesNegativeTest-1980825743 tempest-VolumesNegativeTest-1980825743-project] Flavor pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 22:36:14.619683 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-47293a80-6bd0-40dd-97a7-81317123158e tempest-VolumesNegativeTest-1980825743 tempest-VolumesNegativeTest-1980825743-project] Image pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 22:36:14.620120 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-47293a80-6bd0-40dd-97a7-81317123158e tempest-VolumesNegativeTest-1980825743 tempest-VolumesNegativeTest-1980825743-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 22:36:14.629098 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-47293a80-6bd0-40dd-97a7-81317123158e tempest-VolumesNegativeTest-1980825743 tempest-VolumesNegativeTest-1980825743-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:36:14.629600 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-47293a80-6bd0-40dd-97a7-81317123158e tempest-VolumesNegativeTest-1980825743 tempest-VolumesNegativeTest-1980825743-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:36:14.630057 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-47293a80-6bd0-40dd-97a7-81317123158e tempest-VolumesNegativeTest-1980825743 tempest-VolumesNegativeTest-1980825743-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:36:14.630864 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-47293a80-6bd0-40dd-97a7-81317123158e tempest-VolumesNegativeTest-1980825743 tempest-VolumesNegativeTest-1980825743-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:36:14.631698 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-47293a80-6bd0-40dd-97a7-81317123158e tempest-VolumesNegativeTest-1980825743 tempest-VolumesNegativeTest-1980825743-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:36:14.632151 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-47293a80-6bd0-40dd-97a7-81317123158e tempest-VolumesNegativeTest-1980825743 tempest-VolumesNegativeTest-1980825743-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:36:14.650413 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-47293a80-6bd0-40dd-97a7-81317123158e tempest-VolumesNegativeTest-1980825743 tempest-VolumesNegativeTest-1980825743-project] Getting quotas for project aa81e15869af4f5fb139b5c0a2c4c7eb. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:36:14.655709 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-47293a80-6bd0-40dd-97a7-81317123158e tempest-VolumesNegativeTest-1980825743 tempest-VolumesNegativeTest-1980825743-project] Getting quotas for user 02e2b7ba3abb4bd2b9abb2681c17f0bc and project aa81e15869af4f5fb139b5c0a2c4c7eb. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:36:14.668745 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-47293a80-6bd0-40dd-97a7-81317123158e tempest-VolumesNegativeTest-1980825743 tempest-VolumesNegativeTest-1980825743-project] Going to run 1 instances... {{(pid=134101) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 22:36:14.671060 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-47293a80-6bd0-40dd-97a7-81317123158e tempest-VolumesNegativeTest-1980825743 tempest-VolumesNegativeTest-1980825743-project] [instance: ba4ba6c9-cb04-49ff-ab78-ab5997e1ea56] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='58548514-5dac-426c-81f5-19e3fba33e23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134101) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 22:36:14.715870 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-47293a80-6bd0-40dd-97a7-81317123158e tempest-VolumesNegativeTest-1980825743 tempest-VolumesNegativeTest-1980825743-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.446065 Oct 04 22:36:14.716532 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3795/6765] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 22:36:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 447 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 22:36:14.728482 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-6b7ec43e-af8c-49db-98ec-ddae269aa7e0 tempest-VolumesNegativeTest-1980825743 tempest-VolumesNegativeTest-1980825743-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:36:14.729138 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-6b7ec43e-af8c-49db-98ec-ddae269aa7e0 tempest-VolumesNegativeTest-1980825743 tempest-VolumesNegativeTest-1980825743-project] [instance: ba4ba6c9-cb04-49ff-ab78-ab5997e1ea56] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:36:14.732126 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_api:SELECT=1 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:36:14.733005 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=1 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:36:14.788823 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-6b7ec43e-af8c-49db-98ec-ddae269aa7e0 tempest-VolumesNegativeTest-1980825743 tempest-VolumesNegativeTest-1980825743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e2b7ba3abb4bd2b9abb2681c17f0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa81e15869af4f5fb139b5c0a2c4c7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:36:14.796231 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-6b7ec43e-af8c-49db-98ec-ddae269aa7e0 tempest-VolumesNegativeTest-1980825743 tempest-VolumesNegativeTest-1980825743-project] 10.222.0.43 "GET /compute/v2.1/servers/ba4ba6c9-cb04-49ff-ab78-ab5997e1ea56" status: 200 len: 1215 microversion: 2.1 time: 0.072281 Oct 04 22:36:14.796821 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2971/6766] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:36:14 2022] GET /compute/v2.1/servers/ba4ba6c9-cb04-49ff-ab78-ab5997e1ea56 => generated 1215 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:36:15.820803 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-1cd7e33f-a168-48e7-a621-6f6e9120561b tempest-VolumesNegativeTest-1980825743 tempest-VolumesNegativeTest-1980825743-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:36:15.821440 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-1cd7e33f-a168-48e7-a621-6f6e9120561b tempest-VolumesNegativeTest-1980825743 tempest-VolumesNegativeTest-1980825743-project] [instance: ba4ba6c9-cb04-49ff-ab78-ab5997e1ea56] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:36:15.828127 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1cd7e33f-a168-48e7-a621-6f6e9120561b tempest-VolumesNegativeTest-1980825743 tempest-VolumesNegativeTest-1980825743-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:36:15.828631 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1cd7e33f-a168-48e7-a621-6f6e9120561b tempest-VolumesNegativeTest-1980825743 tempest-VolumesNegativeTest-1980825743-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:36:15.829088 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1cd7e33f-a168-48e7-a621-6f6e9120561b tempest-VolumesNegativeTest-1980825743 tempest-VolumesNegativeTest-1980825743-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:36:15.829812 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1cd7e33f-a168-48e7-a621-6f6e9120561b tempest-VolumesNegativeTest-1980825743 tempest-VolumesNegativeTest-1980825743-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:36:15.830289 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1cd7e33f-a168-48e7-a621-6f6e9120561b tempest-VolumesNegativeTest-1980825743 tempest-VolumesNegativeTest-1980825743-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:36:15.830766 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1cd7e33f-a168-48e7-a621-6f6e9120561b tempest-VolumesNegativeTest-1980825743 tempest-VolumesNegativeTest-1980825743-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:36:15.897584 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-1cd7e33f-a168-48e7-a621-6f6e9120561b tempest-VolumesNegativeTest-1980825743 tempest-VolumesNegativeTest-1980825743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e2b7ba3abb4bd2b9abb2681c17f0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa81e15869af4f5fb139b5c0a2c4c7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:36:15.905797 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-1cd7e33f-a168-48e7-a621-6f6e9120561b tempest-VolumesNegativeTest-1980825743 tempest-VolumesNegativeTest-1980825743-project] 10.222.0.43 "GET /compute/v2.1/servers/ba4ba6c9-cb04-49ff-ab78-ab5997e1ea56" status: 200 len: 1273 microversion: 2.1 time: 0.090284 Oct 04 22:36:15.914962 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3796/6767] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:36:15 2022] GET /compute/v2.1/servers/ba4ba6c9-cb04-49ff-ab78-ab5997e1ea56 => generated 1273 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:36:16.929512 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-33d6a73f-4d4e-4415-8769-cd14deb50b21 tempest-VolumesNegativeTest-1980825743 tempest-VolumesNegativeTest-1980825743-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:36:16.930019 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-33d6a73f-4d4e-4415-8769-cd14deb50b21 tempest-VolumesNegativeTest-1980825743 tempest-VolumesNegativeTest-1980825743-project] [instance: ba4ba6c9-cb04-49ff-ab78-ab5997e1ea56] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:36:16.938130 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-33d6a73f-4d4e-4415-8769-cd14deb50b21 tempest-VolumesNegativeTest-1980825743 tempest-VolumesNegativeTest-1980825743-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:36:16.938660 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-33d6a73f-4d4e-4415-8769-cd14deb50b21 tempest-VolumesNegativeTest-1980825743 tempest-VolumesNegativeTest-1980825743-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:36:16.939107 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-33d6a73f-4d4e-4415-8769-cd14deb50b21 tempest-VolumesNegativeTest-1980825743 tempest-VolumesNegativeTest-1980825743-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:36:16.939820 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-33d6a73f-4d4e-4415-8769-cd14deb50b21 tempest-VolumesNegativeTest-1980825743 tempest-VolumesNegativeTest-1980825743-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:36:16.940282 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-33d6a73f-4d4e-4415-8769-cd14deb50b21 tempest-VolumesNegativeTest-1980825743 tempest-VolumesNegativeTest-1980825743-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:36:16.940719 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-33d6a73f-4d4e-4415-8769-cd14deb50b21 tempest-VolumesNegativeTest-1980825743 tempest-VolumesNegativeTest-1980825743-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:36:17.153436 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-33d6a73f-4d4e-4415-8769-cd14deb50b21 tempest-VolumesNegativeTest-1980825743 tempest-VolumesNegativeTest-1980825743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e2b7ba3abb4bd2b9abb2681c17f0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa81e15869af4f5fb139b5c0a2c4c7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:36:17.161535 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-33d6a73f-4d4e-4415-8769-cd14deb50b21 tempest-VolumesNegativeTest-1980825743 tempest-VolumesNegativeTest-1980825743-project] 10.222.0.43 "GET /compute/v2.1/servers/ba4ba6c9-cb04-49ff-ab78-ab5997e1ea56" status: 200 len: 1315 microversion: 2.1 time: 0.236220 Oct 04 22:36:17.162271 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2972/6768] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:36:16 2022] GET /compute/v2.1/servers/ba4ba6c9-cb04-49ff-ab78-ab5997e1ea56 => generated 1315 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:36:17.402749 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-ed801af1-f145-4eed-980c-8bd1fce1db02 req-0e1f1833-2a1e-447a-b414-1db1ae51b66a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba4ba6c9-cb04-49ff-ab78-ab5997e1ea56", "tag": "1576c77a-4e97-44a0-b649-c44ce8ffbf48"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:36:17.414350 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-ed801af1-f145-4eed-980c-8bd1fce1db02 req-0e1f1833-2a1e-447a-b414-1db1ae51b66a service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:36:17.414968 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-ed801af1-f145-4eed-980c-8bd1fce1db02 req-0e1f1833-2a1e-447a-b414-1db1ae51b66a service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:36:17.415423 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-ed801af1-f145-4eed-980c-8bd1fce1db02 req-0e1f1833-2a1e-447a-b414-1db1ae51b66a service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:36:17.427675 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-ed801af1-f145-4eed-980c-8bd1fce1db02 req-0e1f1833-2a1e-447a-b414-1db1ae51b66a service nova] Creating event network-changed:1576c77a-4e97-44a0-b649-c44ce8ffbf48 for instance ba4ba6c9-cb04-49ff-ab78-ab5997e1ea56 on n-h1-860284-1 Oct 04 22:36:17.432718 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-ed801af1-f145-4eed-980c-8bd1fce1db02 req-0e1f1833-2a1e-447a-b414-1db1ae51b66a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034049 Oct 04 22:36:17.433493 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3797/6769] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:36:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:36:18.184353 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-948591f7-033c-4184-a578-295c1977f80e tempest-VolumesNegativeTest-1980825743 tempest-VolumesNegativeTest-1980825743-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:36:18.184976 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-948591f7-033c-4184-a578-295c1977f80e tempest-VolumesNegativeTest-1980825743 tempest-VolumesNegativeTest-1980825743-project] [instance: ba4ba6c9-cb04-49ff-ab78-ab5997e1ea56] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:36:18.191841 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-948591f7-033c-4184-a578-295c1977f80e tempest-VolumesNegativeTest-1980825743 tempest-VolumesNegativeTest-1980825743-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:36:18.192343 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-948591f7-033c-4184-a578-295c1977f80e tempest-VolumesNegativeTest-1980825743 tempest-VolumesNegativeTest-1980825743-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:36:18.192788 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-948591f7-033c-4184-a578-295c1977f80e tempest-VolumesNegativeTest-1980825743 tempest-VolumesNegativeTest-1980825743-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:36:18.193757 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-948591f7-033c-4184-a578-295c1977f80e tempest-VolumesNegativeTest-1980825743 tempest-VolumesNegativeTest-1980825743-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:36:18.194314 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-948591f7-033c-4184-a578-295c1977f80e tempest-VolumesNegativeTest-1980825743 tempest-VolumesNegativeTest-1980825743-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:36:18.194789 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-948591f7-033c-4184-a578-295c1977f80e tempest-VolumesNegativeTest-1980825743 tempest-VolumesNegativeTest-1980825743-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:36:18.327436 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-948591f7-033c-4184-a578-295c1977f80e tempest-VolumesNegativeTest-1980825743 tempest-VolumesNegativeTest-1980825743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e2b7ba3abb4bd2b9abb2681c17f0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa81e15869af4f5fb139b5c0a2c4c7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:36:18.335750 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-948591f7-033c-4184-a578-295c1977f80e tempest-VolumesNegativeTest-1980825743 tempest-VolumesNegativeTest-1980825743-project] 10.222.0.43 "GET /compute/v2.1/servers/ba4ba6c9-cb04-49ff-ab78-ab5997e1ea56" status: 200 len: 1315 microversion: 2.1 time: 0.155478 Oct 04 22:36:18.336331 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2973/6770] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:36:18 2022] GET /compute/v2.1/servers/ba4ba6c9-cb04-49ff-ab78-ab5997e1ea56 => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:36:19.368120 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-ae0d4ee6-825d-421c-88fd-3fd699cda83f tempest-VolumesNegativeTest-1980825743 tempest-VolumesNegativeTest-1980825743-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:36:19.369006 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-ae0d4ee6-825d-421c-88fd-3fd699cda83f tempest-VolumesNegativeTest-1980825743 tempest-VolumesNegativeTest-1980825743-project] [instance: ba4ba6c9-cb04-49ff-ab78-ab5997e1ea56] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:36:19.375467 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ae0d4ee6-825d-421c-88fd-3fd699cda83f tempest-VolumesNegativeTest-1980825743 tempest-VolumesNegativeTest-1980825743-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:36:19.375977 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ae0d4ee6-825d-421c-88fd-3fd699cda83f tempest-VolumesNegativeTest-1980825743 tempest-VolumesNegativeTest-1980825743-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:36:19.376460 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ae0d4ee6-825d-421c-88fd-3fd699cda83f tempest-VolumesNegativeTest-1980825743 tempest-VolumesNegativeTest-1980825743-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:36:19.377157 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ae0d4ee6-825d-421c-88fd-3fd699cda83f tempest-VolumesNegativeTest-1980825743 tempest-VolumesNegativeTest-1980825743-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:36:19.377638 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ae0d4ee6-825d-421c-88fd-3fd699cda83f tempest-VolumesNegativeTest-1980825743 tempest-VolumesNegativeTest-1980825743-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:36:19.378086 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ae0d4ee6-825d-421c-88fd-3fd699cda83f tempest-VolumesNegativeTest-1980825743 tempest-VolumesNegativeTest-1980825743-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:36:19.505860 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-ae0d4ee6-825d-421c-88fd-3fd699cda83f tempest-VolumesNegativeTest-1980825743 tempest-VolumesNegativeTest-1980825743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e2b7ba3abb4bd2b9abb2681c17f0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa81e15869af4f5fb139b5c0a2c4c7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:36:19.515016 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-ae0d4ee6-825d-421c-88fd-3fd699cda83f tempest-VolumesNegativeTest-1980825743 tempest-VolumesNegativeTest-1980825743-project] 10.222.0.43 "GET /compute/v2.1/servers/ba4ba6c9-cb04-49ff-ab78-ab5997e1ea56" status: 200 len: 1315 microversion: 2.1 time: 0.152831 Oct 04 22:36:19.515604 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3798/6771] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:36:19 2022] GET /compute/v2.1/servers/ba4ba6c9-cb04-49ff-ab78-ab5997e1ea56 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:36:20.537465 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-272c95fb-918a-47e3-9e36-3e022e505e67 tempest-VolumesNegativeTest-1980825743 tempest-VolumesNegativeTest-1980825743-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:36:20.538235 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-272c95fb-918a-47e3-9e36-3e022e505e67 tempest-VolumesNegativeTest-1980825743 tempest-VolumesNegativeTest-1980825743-project] [instance: ba4ba6c9-cb04-49ff-ab78-ab5997e1ea56] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:36:20.545375 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-272c95fb-918a-47e3-9e36-3e022e505e67 tempest-VolumesNegativeTest-1980825743 tempest-VolumesNegativeTest-1980825743-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:36:20.545871 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-272c95fb-918a-47e3-9e36-3e022e505e67 tempest-VolumesNegativeTest-1980825743 tempest-VolumesNegativeTest-1980825743-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:36:20.546316 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-272c95fb-918a-47e3-9e36-3e022e505e67 tempest-VolumesNegativeTest-1980825743 tempest-VolumesNegativeTest-1980825743-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:36:20.547063 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-272c95fb-918a-47e3-9e36-3e022e505e67 tempest-VolumesNegativeTest-1980825743 tempest-VolumesNegativeTest-1980825743-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:36:20.547525 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-272c95fb-918a-47e3-9e36-3e022e505e67 tempest-VolumesNegativeTest-1980825743 tempest-VolumesNegativeTest-1980825743-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:36:20.547953 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-272c95fb-918a-47e3-9e36-3e022e505e67 tempest-VolumesNegativeTest-1980825743 tempest-VolumesNegativeTest-1980825743-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:36:20.768650 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-272c95fb-918a-47e3-9e36-3e022e505e67 tempest-VolumesNegativeTest-1980825743 tempest-VolumesNegativeTest-1980825743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e2b7ba3abb4bd2b9abb2681c17f0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa81e15869af4f5fb139b5c0a2c4c7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:36:20.776527 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-272c95fb-918a-47e3-9e36-3e022e505e67 tempest-VolumesNegativeTest-1980825743 tempest-VolumesNegativeTest-1980825743-project] 10.222.0.43 "GET /compute/v2.1/servers/ba4ba6c9-cb04-49ff-ab78-ab5997e1ea56" status: 200 len: 1315 microversion: 2.1 time: 0.243222 Oct 04 22:36:20.777115 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2974/6772] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:36:20 2022] GET /compute/v2.1/servers/ba4ba6c9-cb04-49ff-ab78-ab5997e1ea56 => generated 1315 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:36:21.798771 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-7ffb2ebd-d093-4e11-9571-a160347f183e tempest-VolumesNegativeTest-1980825743 tempest-VolumesNegativeTest-1980825743-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:36:21.799989 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-7ffb2ebd-d093-4e11-9571-a160347f183e tempest-VolumesNegativeTest-1980825743 tempest-VolumesNegativeTest-1980825743-project] [instance: ba4ba6c9-cb04-49ff-ab78-ab5997e1ea56] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:36:21.807789 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7ffb2ebd-d093-4e11-9571-a160347f183e tempest-VolumesNegativeTest-1980825743 tempest-VolumesNegativeTest-1980825743-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:36:21.808299 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7ffb2ebd-d093-4e11-9571-a160347f183e tempest-VolumesNegativeTest-1980825743 tempest-VolumesNegativeTest-1980825743-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:36:21.808762 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7ffb2ebd-d093-4e11-9571-a160347f183e tempest-VolumesNegativeTest-1980825743 tempest-VolumesNegativeTest-1980825743-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:36:21.809496 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7ffb2ebd-d093-4e11-9571-a160347f183e tempest-VolumesNegativeTest-1980825743 tempest-VolumesNegativeTest-1980825743-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:36:21.809960 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7ffb2ebd-d093-4e11-9571-a160347f183e tempest-VolumesNegativeTest-1980825743 tempest-VolumesNegativeTest-1980825743-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:36:21.810429 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7ffb2ebd-d093-4e11-9571-a160347f183e tempest-VolumesNegativeTest-1980825743 tempest-VolumesNegativeTest-1980825743-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:36:21.942685 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-7ffb2ebd-d093-4e11-9571-a160347f183e tempest-VolumesNegativeTest-1980825743 tempest-VolumesNegativeTest-1980825743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e2b7ba3abb4bd2b9abb2681c17f0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa81e15869af4f5fb139b5c0a2c4c7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:36:21.950718 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-7ffb2ebd-d093-4e11-9571-a160347f183e tempest-VolumesNegativeTest-1980825743 tempest-VolumesNegativeTest-1980825743-project] 10.222.0.43 "GET /compute/v2.1/servers/ba4ba6c9-cb04-49ff-ab78-ab5997e1ea56" status: 200 len: 1315 microversion: 2.1 time: 0.155874 Oct 04 22:36:21.951293 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3799/6773] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:36:21 2022] GET /compute/v2.1/servers/ba4ba6c9-cb04-49ff-ab78-ab5997e1ea56 => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:36:22.973338 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-a567f43c-714e-43df-955e-5fde89f79276 tempest-VolumesNegativeTest-1980825743 tempest-VolumesNegativeTest-1980825743-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:36:22.973860 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-a567f43c-714e-43df-955e-5fde89f79276 tempest-VolumesNegativeTest-1980825743 tempest-VolumesNegativeTest-1980825743-project] [instance: ba4ba6c9-cb04-49ff-ab78-ab5997e1ea56] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:36:22.981593 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a567f43c-714e-43df-955e-5fde89f79276 tempest-VolumesNegativeTest-1980825743 tempest-VolumesNegativeTest-1980825743-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:36:22.982084 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a567f43c-714e-43df-955e-5fde89f79276 tempest-VolumesNegativeTest-1980825743 tempest-VolumesNegativeTest-1980825743-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:36:22.982565 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a567f43c-714e-43df-955e-5fde89f79276 tempest-VolumesNegativeTest-1980825743 tempest-VolumesNegativeTest-1980825743-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:36:22.983263 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a567f43c-714e-43df-955e-5fde89f79276 tempest-VolumesNegativeTest-1980825743 tempest-VolumesNegativeTest-1980825743-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:36:22.983725 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a567f43c-714e-43df-955e-5fde89f79276 tempest-VolumesNegativeTest-1980825743 tempest-VolumesNegativeTest-1980825743-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:36:22.984160 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a567f43c-714e-43df-955e-5fde89f79276 tempest-VolumesNegativeTest-1980825743 tempest-VolumesNegativeTest-1980825743-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:36:23.113321 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-a567f43c-714e-43df-955e-5fde89f79276 tempest-VolumesNegativeTest-1980825743 tempest-VolumesNegativeTest-1980825743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e2b7ba3abb4bd2b9abb2681c17f0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa81e15869af4f5fb139b5c0a2c4c7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:36:23.121845 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-a567f43c-714e-43df-955e-5fde89f79276 tempest-VolumesNegativeTest-1980825743 tempest-VolumesNegativeTest-1980825743-project] 10.222.0.43 "GET /compute/v2.1/servers/ba4ba6c9-cb04-49ff-ab78-ab5997e1ea56" status: 200 len: 1315 microversion: 2.1 time: 0.152457 Oct 04 22:36:23.122458 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2975/6774] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:36:22 2022] GET /compute/v2.1/servers/ba4ba6c9-cb04-49ff-ab78-ab5997e1ea56 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:36:24.144561 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-500dbf11-01f9-4f77-a642-5e7efbe3bc94 tempest-VolumesNegativeTest-1980825743 tempest-VolumesNegativeTest-1980825743-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:36:24.145186 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-500dbf11-01f9-4f77-a642-5e7efbe3bc94 tempest-VolumesNegativeTest-1980825743 tempest-VolumesNegativeTest-1980825743-project] [instance: ba4ba6c9-cb04-49ff-ab78-ab5997e1ea56] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:36:24.152566 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-500dbf11-01f9-4f77-a642-5e7efbe3bc94 tempest-VolumesNegativeTest-1980825743 tempest-VolumesNegativeTest-1980825743-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:36:24.153075 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-500dbf11-01f9-4f77-a642-5e7efbe3bc94 tempest-VolumesNegativeTest-1980825743 tempest-VolumesNegativeTest-1980825743-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:36:24.153538 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-500dbf11-01f9-4f77-a642-5e7efbe3bc94 tempest-VolumesNegativeTest-1980825743 tempest-VolumesNegativeTest-1980825743-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:36:24.154266 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-500dbf11-01f9-4f77-a642-5e7efbe3bc94 tempest-VolumesNegativeTest-1980825743 tempest-VolumesNegativeTest-1980825743-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:36:24.154800 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-500dbf11-01f9-4f77-a642-5e7efbe3bc94 tempest-VolumesNegativeTest-1980825743 tempest-VolumesNegativeTest-1980825743-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:36:24.155255 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-500dbf11-01f9-4f77-a642-5e7efbe3bc94 tempest-VolumesNegativeTest-1980825743 tempest-VolumesNegativeTest-1980825743-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:36:24.197016 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-32924597-f180-43a5-83ea-dbf1945d06e2 req-543131b7-1ccb-47b9-ad87-a5d356548006 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba4ba6c9-cb04-49ff-ab78-ab5997e1ea56", "name": "network-vif-plugged", "status": "completed", "tag": "1576c77a-4e97-44a0-b649-c44ce8ffbf48"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:36:24.209751 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-32924597-f180-43a5-83ea-dbf1945d06e2 req-543131b7-1ccb-47b9-ad87-a5d356548006 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:36:24.210290 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-32924597-f180-43a5-83ea-dbf1945d06e2 req-543131b7-1ccb-47b9-ad87-a5d356548006 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:36:24.210785 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-32924597-f180-43a5-83ea-dbf1945d06e2 req-543131b7-1ccb-47b9-ad87-a5d356548006 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:36:24.224351 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-32924597-f180-43a5-83ea-dbf1945d06e2 req-543131b7-1ccb-47b9-ad87-a5d356548006 service nova] Creating event network-vif-plugged:1576c77a-4e97-44a0-b649-c44ce8ffbf48 for instance ba4ba6c9-cb04-49ff-ab78-ab5997e1ea56 on n-h1-860284-1 Oct 04 22:36:24.229977 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-32924597-f180-43a5-83ea-dbf1945d06e2 req-543131b7-1ccb-47b9-ad87-a5d356548006 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037390 Oct 04 22:36:24.230795 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2976/6775] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:36:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:36:24.301125 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-500dbf11-01f9-4f77-a642-5e7efbe3bc94 tempest-VolumesNegativeTest-1980825743 tempest-VolumesNegativeTest-1980825743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e2b7ba3abb4bd2b9abb2681c17f0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa81e15869af4f5fb139b5c0a2c4c7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:36:24.311709 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-500dbf11-01f9-4f77-a642-5e7efbe3bc94 tempest-VolumesNegativeTest-1980825743 tempest-VolumesNegativeTest-1980825743-project] 10.222.0.43 "GET /compute/v2.1/servers/ba4ba6c9-cb04-49ff-ab78-ab5997e1ea56" status: 200 len: 1315 microversion: 2.1 time: 0.170908 Oct 04 22:36:24.312455 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3800/6776] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:36:24 2022] GET /compute/v2.1/servers/ba4ba6c9-cb04-49ff-ab78-ab5997e1ea56 => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:36:25.336392 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-2d0a45b6-25bf-48f9-8e29-7556ca7e2f53 tempest-VolumesNegativeTest-1980825743 tempest-VolumesNegativeTest-1980825743-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:36:25.337102 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-2d0a45b6-25bf-48f9-8e29-7556ca7e2f53 tempest-VolumesNegativeTest-1980825743 tempest-VolumesNegativeTest-1980825743-project] [instance: ba4ba6c9-cb04-49ff-ab78-ab5997e1ea56] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:36:25.339149 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell0:SELECT=2 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:36:25.345127 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2d0a45b6-25bf-48f9-8e29-7556ca7e2f53 tempest-VolumesNegativeTest-1980825743 tempest-VolumesNegativeTest-1980825743-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:36:25.345616 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2d0a45b6-25bf-48f9-8e29-7556ca7e2f53 tempest-VolumesNegativeTest-1980825743 tempest-VolumesNegativeTest-1980825743-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:36:25.346054 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2d0a45b6-25bf-48f9-8e29-7556ca7e2f53 tempest-VolumesNegativeTest-1980825743 tempest-VolumesNegativeTest-1980825743-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:36:25.346781 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2d0a45b6-25bf-48f9-8e29-7556ca7e2f53 tempest-VolumesNegativeTest-1980825743 tempest-VolumesNegativeTest-1980825743-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:36:25.347244 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2d0a45b6-25bf-48f9-8e29-7556ca7e2f53 tempest-VolumesNegativeTest-1980825743 tempest-VolumesNegativeTest-1980825743-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:36:25.347676 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2d0a45b6-25bf-48f9-8e29-7556ca7e2f53 tempest-VolumesNegativeTest-1980825743 tempest-VolumesNegativeTest-1980825743-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:36:25.481530 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-2d0a45b6-25bf-48f9-8e29-7556ca7e2f53 tempest-VolumesNegativeTest-1980825743 tempest-VolumesNegativeTest-1980825743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e2b7ba3abb4bd2b9abb2681c17f0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa81e15869af4f5fb139b5c0a2c4c7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:36:25.489222 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-2d0a45b6-25bf-48f9-8e29-7556ca7e2f53 tempest-VolumesNegativeTest-1980825743 tempest-VolumesNegativeTest-1980825743-project] 10.222.0.43 "GET /compute/v2.1/servers/ba4ba6c9-cb04-49ff-ab78-ab5997e1ea56" status: 200 len: 1315 microversion: 2.1 time: 0.158195 Oct 04 22:36:25.489807 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2977/6777] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:36:25 2022] GET /compute/v2.1/servers/ba4ba6c9-cb04-49ff-ab78-ab5997e1ea56 => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:36:26.512550 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-db126267-5432-4087-bd29-38c896c90abb tempest-VolumesNegativeTest-1980825743 tempest-VolumesNegativeTest-1980825743-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:36:26.513181 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-db126267-5432-4087-bd29-38c896c90abb tempest-VolumesNegativeTest-1980825743 tempest-VolumesNegativeTest-1980825743-project] [instance: ba4ba6c9-cb04-49ff-ab78-ab5997e1ea56] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:36:26.515222 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=2 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:36:26.515934 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=6 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:36:26.523000 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-db126267-5432-4087-bd29-38c896c90abb tempest-VolumesNegativeTest-1980825743 tempest-VolumesNegativeTest-1980825743-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:36:26.523496 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-db126267-5432-4087-bd29-38c896c90abb tempest-VolumesNegativeTest-1980825743 tempest-VolumesNegativeTest-1980825743-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:36:26.523947 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-db126267-5432-4087-bd29-38c896c90abb tempest-VolumesNegativeTest-1980825743 tempest-VolumesNegativeTest-1980825743-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:36:26.524652 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-db126267-5432-4087-bd29-38c896c90abb tempest-VolumesNegativeTest-1980825743 tempest-VolumesNegativeTest-1980825743-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:36:26.525118 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-db126267-5432-4087-bd29-38c896c90abb tempest-VolumesNegativeTest-1980825743 tempest-VolumesNegativeTest-1980825743-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:36:26.525555 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-db126267-5432-4087-bd29-38c896c90abb tempest-VolumesNegativeTest-1980825743 tempest-VolumesNegativeTest-1980825743-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:36:26.657368 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-db126267-5432-4087-bd29-38c896c90abb tempest-VolumesNegativeTest-1980825743 tempest-VolumesNegativeTest-1980825743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e2b7ba3abb4bd2b9abb2681c17f0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa81e15869af4f5fb139b5c0a2c4c7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:36:26.665305 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-db126267-5432-4087-bd29-38c896c90abb tempest-VolumesNegativeTest-1980825743 tempest-VolumesNegativeTest-1980825743-project] 10.222.0.43 "GET /compute/v2.1/servers/ba4ba6c9-cb04-49ff-ab78-ab5997e1ea56" status: 200 len: 1465 microversion: 2.1 time: 0.156985 Oct 04 22:36:26.665885 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3801/6778] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:36:26 2022] GET /compute/v2.1/servers/ba4ba6c9-cb04-49ff-ab78-ab5997e1ea56 => generated 1465 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:36:26.713059 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-c413c403-f999-4f08-93dd-4aff592ca767 tempest-VolumesNegativeTest-1980825743 tempest-VolumesNegativeTest-1980825743-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:36:26.713564 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-c413c403-f999-4f08-93dd-4aff592ca767 tempest-VolumesNegativeTest-1980825743 tempest-VolumesNegativeTest-1980825743-project] [instance: ba4ba6c9-cb04-49ff-ab78-ab5997e1ea56] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:36:26.720368 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c413c403-f999-4f08-93dd-4aff592ca767 tempest-VolumesNegativeTest-1980825743 tempest-VolumesNegativeTest-1980825743-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:36:26.720857 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c413c403-f999-4f08-93dd-4aff592ca767 tempest-VolumesNegativeTest-1980825743 tempest-VolumesNegativeTest-1980825743-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:36:26.721303 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c413c403-f999-4f08-93dd-4aff592ca767 tempest-VolumesNegativeTest-1980825743 tempest-VolumesNegativeTest-1980825743-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:36:26.721994 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c413c403-f999-4f08-93dd-4aff592ca767 tempest-VolumesNegativeTest-1980825743 tempest-VolumesNegativeTest-1980825743-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:36:26.722486 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c413c403-f999-4f08-93dd-4aff592ca767 tempest-VolumesNegativeTest-1980825743 tempest-VolumesNegativeTest-1980825743-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:36:26.723025 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c413c403-f999-4f08-93dd-4aff592ca767 tempest-VolumesNegativeTest-1980825743 tempest-VolumesNegativeTest-1980825743-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:36:26.747943 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-c413c403-f999-4f08-93dd-4aff592ca767 tempest-VolumesNegativeTest-1980825743 tempest-VolumesNegativeTest-1980825743-project] [instance: ba4ba6c9-cb04-49ff-ab78-ab5997e1ea56] Going to try to terminate instance {{(pid=134102) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 22:36:26.824346 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-c413c403-f999-4f08-93dd-4aff592ca767 tempest-VolumesNegativeTest-1980825743 tempest-VolumesNegativeTest-1980825743-project] 10.222.0.43 "DELETE /compute/v2.1/servers/ba4ba6c9-cb04-49ff-ab78-ab5997e1ea56" status: 204 len: 0 microversion: 2.1 time: 0.115513 Oct 04 22:36:26.825017 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2978/6779] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 22:36:26 2022] DELETE /compute/v2.1/servers/ba4ba6c9-cb04-49ff-ab78-ab5997e1ea56 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 22:36:26.833246 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-f0c4e50d-79a8-452f-9c7d-da236c0cbd64 tempest-VolumesNegativeTest-1980825743 tempest-VolumesNegativeTest-1980825743-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:36:26.834540 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-f0c4e50d-79a8-452f-9c7d-da236c0cbd64 tempest-VolumesNegativeTest-1980825743 tempest-VolumesNegativeTest-1980825743-project] [instance: ba4ba6c9-cb04-49ff-ab78-ab5997e1ea56] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:36:26.840545 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f0c4e50d-79a8-452f-9c7d-da236c0cbd64 tempest-VolumesNegativeTest-1980825743 tempest-VolumesNegativeTest-1980825743-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:36:26.841035 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f0c4e50d-79a8-452f-9c7d-da236c0cbd64 tempest-VolumesNegativeTest-1980825743 tempest-VolumesNegativeTest-1980825743-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:36:26.841488 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f0c4e50d-79a8-452f-9c7d-da236c0cbd64 tempest-VolumesNegativeTest-1980825743 tempest-VolumesNegativeTest-1980825743-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:36:26.842187 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f0c4e50d-79a8-452f-9c7d-da236c0cbd64 tempest-VolumesNegativeTest-1980825743 tempest-VolumesNegativeTest-1980825743-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:36:26.843273 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f0c4e50d-79a8-452f-9c7d-da236c0cbd64 tempest-VolumesNegativeTest-1980825743 tempest-VolumesNegativeTest-1980825743-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:36:26.843728 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f0c4e50d-79a8-452f-9c7d-da236c0cbd64 tempest-VolumesNegativeTest-1980825743 tempest-VolumesNegativeTest-1980825743-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:36:26.979073 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-f0c4e50d-79a8-452f-9c7d-da236c0cbd64 tempest-VolumesNegativeTest-1980825743 tempest-VolumesNegativeTest-1980825743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e2b7ba3abb4bd2b9abb2681c17f0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa81e15869af4f5fb139b5c0a2c4c7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:36:26.987368 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-f0c4e50d-79a8-452f-9c7d-da236c0cbd64 tempest-VolumesNegativeTest-1980825743 tempest-VolumesNegativeTest-1980825743-project] 10.222.0.43 "GET /compute/v2.1/servers/ba4ba6c9-cb04-49ff-ab78-ab5997e1ea56" status: 200 len: 1471 microversion: 2.1 time: 0.157975 Oct 04 22:36:26.987976 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3802/6780] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:36:26 2022] GET /compute/v2.1/servers/ba4ba6c9-cb04-49ff-ab78-ab5997e1ea56 => generated 1471 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:36:28.011685 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-c909e9c5-62eb-408c-a20a-9d61cb6a161e tempest-VolumesNegativeTest-1980825743 tempest-VolumesNegativeTest-1980825743-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:36:28.012400 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-c909e9c5-62eb-408c-a20a-9d61cb6a161e tempest-VolumesNegativeTest-1980825743 tempest-VolumesNegativeTest-1980825743-project] [instance: ba4ba6c9-cb04-49ff-ab78-ab5997e1ea56] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:36:28.019163 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c909e9c5-62eb-408c-a20a-9d61cb6a161e tempest-VolumesNegativeTest-1980825743 tempest-VolumesNegativeTest-1980825743-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:36:28.019657 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c909e9c5-62eb-408c-a20a-9d61cb6a161e tempest-VolumesNegativeTest-1980825743 tempest-VolumesNegativeTest-1980825743-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:36:28.020118 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c909e9c5-62eb-408c-a20a-9d61cb6a161e tempest-VolumesNegativeTest-1980825743 tempest-VolumesNegativeTest-1980825743-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:36:28.020823 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c909e9c5-62eb-408c-a20a-9d61cb6a161e tempest-VolumesNegativeTest-1980825743 tempest-VolumesNegativeTest-1980825743-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:36:28.021883 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c909e9c5-62eb-408c-a20a-9d61cb6a161e tempest-VolumesNegativeTest-1980825743 tempest-VolumesNegativeTest-1980825743-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:36:28.022608 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c909e9c5-62eb-408c-a20a-9d61cb6a161e tempest-VolumesNegativeTest-1980825743 tempest-VolumesNegativeTest-1980825743-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:36:28.157685 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-c909e9c5-62eb-408c-a20a-9d61cb6a161e tempest-VolumesNegativeTest-1980825743 tempest-VolumesNegativeTest-1980825743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e2b7ba3abb4bd2b9abb2681c17f0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa81e15869af4f5fb139b5c0a2c4c7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:36:28.165623 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-c909e9c5-62eb-408c-a20a-9d61cb6a161e tempest-VolumesNegativeTest-1980825743 tempest-VolumesNegativeTest-1980825743-project] 10.222.0.43 "GET /compute/v2.1/servers/ba4ba6c9-cb04-49ff-ab78-ab5997e1ea56" status: 200 len: 1471 microversion: 2.1 time: 0.158550 Oct 04 22:36:28.166203 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2979/6781] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:36:28 2022] GET /compute/v2.1/servers/ba4ba6c9-cb04-49ff-ab78-ab5997e1ea56 => generated 1471 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:36:28.750210 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-6aaf8674-1088-48f5-8ae9-6fa56d70b4bd req-48762c13-5202-4b2b-bded-71d627477493 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba4ba6c9-cb04-49ff-ab78-ab5997e1ea56", "name": "network-vif-deleted", "tag": "1576c77a-4e97-44a0-b649-c44ce8ffbf48"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:36:28.763503 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-6aaf8674-1088-48f5-8ae9-6fa56d70b4bd req-48762c13-5202-4b2b-bded-71d627477493 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:36:28.764254 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-6aaf8674-1088-48f5-8ae9-6fa56d70b4bd req-48762c13-5202-4b2b-bded-71d627477493 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:36:28.764705 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-6aaf8674-1088-48f5-8ae9-6fa56d70b4bd req-48762c13-5202-4b2b-bded-71d627477493 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:36:28.778257 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-6aaf8674-1088-48f5-8ae9-6fa56d70b4bd req-48762c13-5202-4b2b-bded-71d627477493 service nova] Creating event network-vif-deleted:1576c77a-4e97-44a0-b649-c44ce8ffbf48 for instance ba4ba6c9-cb04-49ff-ab78-ab5997e1ea56 on n-h1-860284-1 Oct 04 22:36:28.783698 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-6aaf8674-1088-48f5-8ae9-6fa56d70b4bd req-48762c13-5202-4b2b-bded-71d627477493 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037926 Oct 04 22:36:28.784325 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3803/6782] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:36:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:36:29.188301 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-4526a2bf-d2ea-4e09-b228-1d30e8eadb62 tempest-VolumesNegativeTest-1980825743 tempest-VolumesNegativeTest-1980825743-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:36:29.188928 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-4526a2bf-d2ea-4e09-b228-1d30e8eadb62 tempest-VolumesNegativeTest-1980825743 tempest-VolumesNegativeTest-1980825743-project] [instance: ba4ba6c9-cb04-49ff-ab78-ab5997e1ea56] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:36:29.196310 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4526a2bf-d2ea-4e09-b228-1d30e8eadb62 tempest-VolumesNegativeTest-1980825743 tempest-VolumesNegativeTest-1980825743-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:36:29.196809 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4526a2bf-d2ea-4e09-b228-1d30e8eadb62 tempest-VolumesNegativeTest-1980825743 tempest-VolumesNegativeTest-1980825743-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:36:29.197261 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4526a2bf-d2ea-4e09-b228-1d30e8eadb62 tempest-VolumesNegativeTest-1980825743 tempest-VolumesNegativeTest-1980825743-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:36:29.197970 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4526a2bf-d2ea-4e09-b228-1d30e8eadb62 tempest-VolumesNegativeTest-1980825743 tempest-VolumesNegativeTest-1980825743-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:36:29.198458 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4526a2bf-d2ea-4e09-b228-1d30e8eadb62 tempest-VolumesNegativeTest-1980825743 tempest-VolumesNegativeTest-1980825743-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:36:29.198898 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4526a2bf-d2ea-4e09-b228-1d30e8eadb62 tempest-VolumesNegativeTest-1980825743 tempest-VolumesNegativeTest-1980825743-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:36:29.232769 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4526a2bf-d2ea-4e09-b228-1d30e8eadb62 tempest-VolumesNegativeTest-1980825743 tempest-VolumesNegativeTest-1980825743-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:36:29.233215 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4526a2bf-d2ea-4e09-b228-1d30e8eadb62 tempest-VolumesNegativeTest-1980825743 tempest-VolumesNegativeTest-1980825743-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:36:29.233697 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4526a2bf-d2ea-4e09-b228-1d30e8eadb62 tempest-VolumesNegativeTest-1980825743 tempest-VolumesNegativeTest-1980825743-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:36:29.234291 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.objects.instance [None req-4526a2bf-d2ea-4e09-b228-1d30e8eadb62 tempest-VolumesNegativeTest-1980825743 tempest-VolumesNegativeTest-1980825743-project] Lazy-loading 'fault' on Instance uuid ba4ba6c9-cb04-49ff-ab78-ab5997e1ea56 {{(pid=134102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 22:36:29.277898 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-4526a2bf-d2ea-4e09-b228-1d30e8eadb62 tempest-VolumesNegativeTest-1980825743 tempest-VolumesNegativeTest-1980825743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e2b7ba3abb4bd2b9abb2681c17f0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa81e15869af4f5fb139b5c0a2c4c7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:36:29.285030 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-4526a2bf-d2ea-4e09-b228-1d30e8eadb62 tempest-VolumesNegativeTest-1980825743 tempest-VolumesNegativeTest-1980825743-project] 10.222.0.43 "GET /compute/v2.1/servers/ba4ba6c9-cb04-49ff-ab78-ab5997e1ea56" status: 200 len: 1305 microversion: 2.1 time: 0.100743 Oct 04 22:36:29.285652 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2980/6783] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:36:29 2022] GET /compute/v2.1/servers/ba4ba6c9-cb04-49ff-ab78-ab5997e1ea56 => generated 1305 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:36:30.310291 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-f99516f7-d4f0-41b6-bebd-839558f6dc0d tempest-VolumesNegativeTest-1980825743 tempest-VolumesNegativeTest-1980825743-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:36:30.311051 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-f99516f7-d4f0-41b6-bebd-839558f6dc0d tempest-VolumesNegativeTest-1980825743 tempest-VolumesNegativeTest-1980825743-project] [instance: ba4ba6c9-cb04-49ff-ab78-ab5997e1ea56] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:36:30.317338 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f99516f7-d4f0-41b6-bebd-839558f6dc0d tempest-VolumesNegativeTest-1980825743 tempest-VolumesNegativeTest-1980825743-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:36:30.317886 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f99516f7-d4f0-41b6-bebd-839558f6dc0d tempest-VolumesNegativeTest-1980825743 tempest-VolumesNegativeTest-1980825743-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:36:30.319035 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f99516f7-d4f0-41b6-bebd-839558f6dc0d tempest-VolumesNegativeTest-1980825743 tempest-VolumesNegativeTest-1980825743-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:36:30.319770 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f99516f7-d4f0-41b6-bebd-839558f6dc0d tempest-VolumesNegativeTest-1980825743 tempest-VolumesNegativeTest-1980825743-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:36:30.320241 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f99516f7-d4f0-41b6-bebd-839558f6dc0d tempest-VolumesNegativeTest-1980825743 tempest-VolumesNegativeTest-1980825743-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:36:30.320691 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f99516f7-d4f0-41b6-bebd-839558f6dc0d tempest-VolumesNegativeTest-1980825743 tempest-VolumesNegativeTest-1980825743-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:36:30.334358 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-f99516f7-d4f0-41b6-bebd-839558f6dc0d tempest-VolumesNegativeTest-1980825743 tempest-VolumesNegativeTest-1980825743-project] HTTP exception thrown: Instance ba4ba6c9-cb04-49ff-ab78-ab5997e1ea56 could not be found. Oct 04 22:36:30.336015 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-f99516f7-d4f0-41b6-bebd-839558f6dc0d tempest-VolumesNegativeTest-1980825743 tempest-VolumesNegativeTest-1980825743-project] Request method failure captured: Oct 04 22:36:30.336015 n-d-860284-1 devstack@n-api.service[134101]: request: GET /compute/v2.1/servers/ba4ba6c9-cb04-49ff-ab78-ab5997e1ea56 HTTP/1.1 Oct 04 22:36:30.336015 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 22:36:30.336015 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 22:36:30.336015 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 22:36:30.336015 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 22:36:30.336015 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 22:36:30.336015 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 22:36:30.336015 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 22:36:30.336015 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 22:36:30.336015 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPLVcBsTSgzrniRB0yPrakTi__-DhzVvBVlW99iu-XTrspxNfc9IETh9saq85x2JPwKxkeOvNyUE18xLBeArl_795Xb_4lyCVw60GqLEkuishFzK7p9qkvDdNhZ00VqYNpc46GXJ7J0BAb-LanUJPzkyIBomDsjnErtC2LeUm9cOLKLg Oct 04 22:36:30.336015 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 22:36:30.336015 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 22:36:30.336015 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 22:36:30.336015 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 22:36:30.336015 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 22:36:30.336015 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 22:36:30.336015 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: aa81e15869af4f5fb139b5c0a2c4c7eb Oct 04 22:36:30.336015 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-VolumesNegativeTest-1980825743 Oct 04 22:36:30.336015 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 22:36:30.336015 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 22:36:30.336015 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/aa81e15869af4f5fb139b5c0a2c4c7eb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_aa81e15869af4f5fb139b5c0a2c4c7eb", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/aa81e15869af4f5fb139b5c0a2c4c7eb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/aa81e15869af4f5fb139b5c0a2c4c7eb"}]}] Oct 04 22:36:30.336015 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-VolumesNegativeTest-1980825743 Oct 04 22:36:30.336015 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: aa81e15869af4f5fb139b5c0a2c4c7eb Oct 04 22:36:30.336015 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-VolumesNegativeTest-1980825743 Oct 04 22:36:30.336015 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-VolumesNegativeTest-1980825743-project Oct 04 22:36:30.336015 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 22:36:30.336015 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 22:36:30.336015 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 02e2b7ba3abb4bd2b9abb2681c17f0bc Oct 04 22:36:30.336015 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-VolumesNegativeTest-1980825743-project Oct 04 22:36:30.336015 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 22:36:30.336015 n-d-860284-1 devstack@n-api.service[134101]: exception: Instance ba4ba6c9-cb04-49ff-ab78-ab5997e1ea56 could not be found. Oct 04 22:36:30.336015 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': 'ba4ba6c9-cb04-49ff-ab78-ab5997e1ea56'} Oct 04 22:36:30.336015 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:36:30.336015 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:36:30.336015 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:36:30.336015 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:36:30.336015 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:36:30.336015 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:36:30.336015 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:36:30.336015 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:36:30.336015 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:36:30.336015 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:36:30.336015 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba4ba6c9-cb04-49ff-ab78-ab5997e1ea56 could not be found. Oct 04 22:36:30.336015 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:36:30.336015 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:36:30.336015 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:36:30.336015 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:36:30.336015 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:36:30.336015 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:36:30.336015 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:36:30.336015 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:36:30.336015 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:36:30.336015 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:36:30.336015 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:36:30.336015 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:36:30.336015 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:36:30.336015 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:36:30.336015 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:36:30.336015 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:36:30.336015 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba4ba6c9-cb04-49ff-ab78-ab5997e1ea56 could not be found. Oct 04 22:36:30.336015 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:36:30.336015 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:36:30.336015 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:36:30.340057 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:36:30.340057 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:36:30.340057 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:36:30.340057 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:36:30.340057 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:36:30.340057 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba4ba6c9-cb04-49ff-ab78-ab5997e1ea56 could not be found. Oct 04 22:36:30.340057 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:36:30.340057 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-f99516f7-d4f0-41b6-bebd-839558f6dc0d tempest-VolumesNegativeTest-1980825743 tempest-VolumesNegativeTest-1980825743-project] Returning 404 to user: Instance ba4ba6c9-cb04-49ff-ab78-ab5997e1ea56 could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:36:30.340057 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-f99516f7-d4f0-41b6-bebd-839558f6dc0d tempest-VolumesNegativeTest-1980825743 tempest-VolumesNegativeTest-1980825743-project] 10.222.0.43 "GET /compute/v2.1/servers/ba4ba6c9-cb04-49ff-ab78-ab5997e1ea56" status: 404 len: 111 microversion: 2.1 time: 0.032396 Oct 04 22:36:30.340057 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3804/6784] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:36:30 2022] GET /compute/v2.1/servers/ba4ba6c9-cb04-49ff-ab78-ab5997e1ea56 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:36:36.993281 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-3a825a4a-d1ec-4d4d-954d-7eb5625bb4ae tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Action: 'create', calling method: .version_select at 0x7fbb2e9b4040>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1620777126", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLQhrH0xEmtIktfatSLylX5efH0pef5YwqoRaipW56mKxNwa9qixYR7bWzUV0p6uqMP6b3sAJkfb/p6MK/G83NOTgdOq5/+q3wPJXSj5I0WM5/oMTNA8/OK4LQpE1ly+Fg=="}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:36:37.010394 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-3a825a4a-d1ec-4d4d-954d-7eb5625bb4ae tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Getting quotas for project fd2856184afa47f2b4349f7dea9e5569. Resources: {'key_pairs'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:36:37.015590 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-3a825a4a-d1ec-4d4d-954d-7eb5625bb4ae tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Getting quotas for user bbc0ba9f45d04dec89394df46d6096a3 and project fd2856184afa47f2b4349f7dea9e5569. Resources: {'key_pairs'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:36:37.042973 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-3a825a4a-d1ec-4d4d-954d-7eb5625bb4ae tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.218560 Oct 04 22:36:37.043592 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2981/6785] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Oct 4 22:36:36 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:36:42.723902 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-9a3e6714-fd93-4616-a53b-5c18e9f74259 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1434360914", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452", "networks": [{"uuid": "cf79b704-a71e-407f-9ab4-6073b84b8e5b"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1620777126", "security_groups": [{"name": "tempest-secgroup-smoke-686864845"}]}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:36:42.733992 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:36:42.734690 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=44 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:36:42.861708 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.network.neutron [None req-9a3e6714-fd93-4616-a53b-5c18e9f74259 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] validate_networks() for [('cf79b704-a71e-407f-9ab4-6073b84b8e5b', None, None, None, None, None)] {{(pid=134101) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 22:36:43.316786 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-9a3e6714-fd93-4616-a53b-5c18e9f74259 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Flavor limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 22:36:43.318015 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-9a3e6714-fd93-4616-a53b-5c18e9f74259 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Image limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 22:36:43.318760 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-9a3e6714-fd93-4616-a53b-5c18e9f74259 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Flavor pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 22:36:43.319191 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-9a3e6714-fd93-4616-a53b-5c18e9f74259 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Image pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 22:36:43.319903 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-9a3e6714-fd93-4616-a53b-5c18e9f74259 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 22:36:43.329759 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9a3e6714-fd93-4616-a53b-5c18e9f74259 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:36:43.330839 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9a3e6714-fd93-4616-a53b-5c18e9f74259 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:36:43.331299 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9a3e6714-fd93-4616-a53b-5c18e9f74259 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:36:43.332057 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9a3e6714-fd93-4616-a53b-5c18e9f74259 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:36:43.332697 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9a3e6714-fd93-4616-a53b-5c18e9f74259 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:36:43.333895 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9a3e6714-fd93-4616-a53b-5c18e9f74259 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:36:43.352774 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-9a3e6714-fd93-4616-a53b-5c18e9f74259 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Getting quotas for project fd2856184afa47f2b4349f7dea9e5569. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:36:43.358916 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-9a3e6714-fd93-4616-a53b-5c18e9f74259 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Getting quotas for user bbc0ba9f45d04dec89394df46d6096a3 and project fd2856184afa47f2b4349f7dea9e5569. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:36:43.373434 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-9a3e6714-fd93-4616-a53b-5c18e9f74259 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Going to run 1 instances... {{(pid=134101) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 22:36:43.376079 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-9a3e6714-fd93-4616-a53b-5c18e9f74259 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] [instance: eea0261c-26b6-4bf6-a59d-6e0d20d32bcb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='58548514-5dac-426c-81f5-19e3fba33e23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134101) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 22:36:43.430663 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-9a3e6714-fd93-4616-a53b-5c18e9f74259 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.710828 Oct 04 22:36:43.432045 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3805/6786] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 22:36:42 2022] POST /compute/v2.1/servers => generated 405 bytes in 713 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 22:36:43.441152 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:36:43.450343 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-3d4d1a38-104c-48d5-bbf3-c084ef4732ed tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:36:43.451266 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-3d4d1a38-104c-48d5-bbf3-c084ef4732ed tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] [instance: eea0261c-26b6-4bf6-a59d-6e0d20d32bcb] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:36:43.553097 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-3d4d1a38-104c-48d5-bbf3-c084ef4732ed tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc0ba9f45d04dec89394df46d6096a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2856184afa47f2b4349f7dea9e5569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:36:43.561047 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-3d4d1a38-104c-48d5-bbf3-c084ef4732ed tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] 10.222.0.43 "GET /compute/v2.1/servers/eea0261c-26b6-4bf6-a59d-6e0d20d32bcb" status: 200 len: 1267 microversion: 2.1 time: 0.121528 Oct 04 22:36:43.561644 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2982/6787] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:36:43 2022] GET /compute/v2.1/servers/eea0261c-26b6-4bf6-a59d-6e0d20d32bcb => generated 1267 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:36:44.585891 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-0f830d8d-d7e7-446f-b420-72b0d6c96aef tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:36:44.587161 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-0f830d8d-d7e7-446f-b420-72b0d6c96aef tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] [instance: eea0261c-26b6-4bf6-a59d-6e0d20d32bcb] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:36:44.596486 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0f830d8d-d7e7-446f-b420-72b0d6c96aef tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:36:44.597297 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0f830d8d-d7e7-446f-b420-72b0d6c96aef tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:36:44.597998 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0f830d8d-d7e7-446f-b420-72b0d6c96aef tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:36:44.599257 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0f830d8d-d7e7-446f-b420-72b0d6c96aef tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:36:44.599967 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0f830d8d-d7e7-446f-b420-72b0d6c96aef tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:36:44.601031 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0f830d8d-d7e7-446f-b420-72b0d6c96aef tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:36:44.683084 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-0f830d8d-d7e7-446f-b420-72b0d6c96aef tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc0ba9f45d04dec89394df46d6096a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2856184afa47f2b4349f7dea9e5569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:36:44.692048 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-0f830d8d-d7e7-446f-b420-72b0d6c96aef tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] 10.222.0.43 "GET /compute/v2.1/servers/eea0261c-26b6-4bf6-a59d-6e0d20d32bcb" status: 200 len: 1327 microversion: 2.1 time: 0.112646 Oct 04 22:36:44.693777 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3806/6788] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:36:44 2022] GET /compute/v2.1/servers/eea0261c-26b6-4bf6-a59d-6e0d20d32bcb => generated 1327 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:36:45.716560 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-dbf7feaf-9f05-49d8-a5f8-863b7064a337 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:36:45.717320 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-dbf7feaf-9f05-49d8-a5f8-863b7064a337 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] [instance: eea0261c-26b6-4bf6-a59d-6e0d20d32bcb] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:36:45.720180 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:36:45.731734 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dbf7feaf-9f05-49d8-a5f8-863b7064a337 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:36:45.732238 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dbf7feaf-9f05-49d8-a5f8-863b7064a337 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:36:45.733326 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dbf7feaf-9f05-49d8-a5f8-863b7064a337 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:36:45.734061 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dbf7feaf-9f05-49d8-a5f8-863b7064a337 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:36:45.734773 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dbf7feaf-9f05-49d8-a5f8-863b7064a337 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:36:45.735212 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dbf7feaf-9f05-49d8-a5f8-863b7064a337 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:36:45.991828 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-dbf7feaf-9f05-49d8-a5f8-863b7064a337 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc0ba9f45d04dec89394df46d6096a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2856184afa47f2b4349f7dea9e5569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:36:45.999545 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-dbf7feaf-9f05-49d8-a5f8-863b7064a337 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] 10.222.0.43 "GET /compute/v2.1/servers/eea0261c-26b6-4bf6-a59d-6e0d20d32bcb" status: 200 len: 1392 microversion: 2.1 time: 0.287395 Oct 04 22:36:46.000131 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2983/6789] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:36:45 2022] GET /compute/v2.1/servers/eea0261c-26b6-4bf6-a59d-6e0d20d32bcb => generated 1392 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:36:46.280646 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-2693e139-050b-4388-aaa0-5291b1ab5b41 req-445d6699-3489-4f0d-9fca-6b4f7dc80260 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eea0261c-26b6-4bf6-a59d-6e0d20d32bcb", "tag": "5235e153-524e-41e1-870f-fb98044623b8"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:36:46.293504 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-2693e139-050b-4388-aaa0-5291b1ab5b41 req-445d6699-3489-4f0d-9fca-6b4f7dc80260 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:36:46.294014 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-2693e139-050b-4388-aaa0-5291b1ab5b41 req-445d6699-3489-4f0d-9fca-6b4f7dc80260 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:36:46.294768 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-2693e139-050b-4388-aaa0-5291b1ab5b41 req-445d6699-3489-4f0d-9fca-6b4f7dc80260 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:36:46.307603 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-2693e139-050b-4388-aaa0-5291b1ab5b41 req-445d6699-3489-4f0d-9fca-6b4f7dc80260 service nova] Creating event network-changed:5235e153-524e-41e1-870f-fb98044623b8 for instance eea0261c-26b6-4bf6-a59d-6e0d20d32bcb on n-h1-860284-1 Oct 04 22:36:46.312763 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-2693e139-050b-4388-aaa0-5291b1ab5b41 req-445d6699-3489-4f0d-9fca-6b4f7dc80260 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124978 Oct 04 22:36:46.313471 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3807/6790] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:36:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:36:47.023642 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-7ca02854-bf57-4836-baad-729b0eb2470a tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:36:47.024268 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-7ca02854-bf57-4836-baad-729b0eb2470a tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] [instance: eea0261c-26b6-4bf6-a59d-6e0d20d32bcb] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:36:47.031311 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7ca02854-bf57-4836-baad-729b0eb2470a tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:36:47.031801 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7ca02854-bf57-4836-baad-729b0eb2470a tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:36:47.032251 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7ca02854-bf57-4836-baad-729b0eb2470a tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:36:47.032955 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7ca02854-bf57-4836-baad-729b0eb2470a tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:36:47.033441 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7ca02854-bf57-4836-baad-729b0eb2470a tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:36:47.033857 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7ca02854-bf57-4836-baad-729b0eb2470a tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:36:47.172306 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-7ca02854-bf57-4836-baad-729b0eb2470a tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc0ba9f45d04dec89394df46d6096a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2856184afa47f2b4349f7dea9e5569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:36:47.180838 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-7ca02854-bf57-4836-baad-729b0eb2470a tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] 10.222.0.43 "GET /compute/v2.1/servers/eea0261c-26b6-4bf6-a59d-6e0d20d32bcb" status: 200 len: 1392 microversion: 2.1 time: 0.161175 Oct 04 22:36:47.181424 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2984/6791] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:36:47 2022] GET /compute/v2.1/servers/eea0261c-26b6-4bf6-a59d-6e0d20d32bcb => generated 1392 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:36:48.205070 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-00772ec6-621d-4eab-9acc-e60c4b3dda89 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:36:48.205799 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-00772ec6-621d-4eab-9acc-e60c4b3dda89 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] [instance: eea0261c-26b6-4bf6-a59d-6e0d20d32bcb] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:36:48.212596 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-00772ec6-621d-4eab-9acc-e60c4b3dda89 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:36:48.213119 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-00772ec6-621d-4eab-9acc-e60c4b3dda89 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:36:48.213580 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-00772ec6-621d-4eab-9acc-e60c4b3dda89 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:36:48.214308 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-00772ec6-621d-4eab-9acc-e60c4b3dda89 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:36:48.214814 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-00772ec6-621d-4eab-9acc-e60c4b3dda89 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:36:48.215263 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-00772ec6-621d-4eab-9acc-e60c4b3dda89 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:36:48.354450 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-00772ec6-621d-4eab-9acc-e60c4b3dda89 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc0ba9f45d04dec89394df46d6096a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2856184afa47f2b4349f7dea9e5569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:36:48.362412 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-00772ec6-621d-4eab-9acc-e60c4b3dda89 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] 10.222.0.43 "GET /compute/v2.1/servers/eea0261c-26b6-4bf6-a59d-6e0d20d32bcb" status: 200 len: 1392 microversion: 2.1 time: 0.162380 Oct 04 22:36:48.363007 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3808/6792] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:36:48 2022] GET /compute/v2.1/servers/eea0261c-26b6-4bf6-a59d-6e0d20d32bcb => generated 1392 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:36:49.386509 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-b4aa5d33-5cf9-4d98-a89e-d27c7286872c tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:36:49.387052 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-b4aa5d33-5cf9-4d98-a89e-d27c7286872c tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] [instance: eea0261c-26b6-4bf6-a59d-6e0d20d32bcb] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:36:49.393763 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b4aa5d33-5cf9-4d98-a89e-d27c7286872c tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:36:49.394246 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b4aa5d33-5cf9-4d98-a89e-d27c7286872c tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:36:49.394711 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b4aa5d33-5cf9-4d98-a89e-d27c7286872c tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:36:49.395540 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b4aa5d33-5cf9-4d98-a89e-d27c7286872c tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:36:49.396786 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b4aa5d33-5cf9-4d98-a89e-d27c7286872c tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:36:49.397243 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b4aa5d33-5cf9-4d98-a89e-d27c7286872c tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:36:49.530412 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-b4aa5d33-5cf9-4d98-a89e-d27c7286872c tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc0ba9f45d04dec89394df46d6096a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2856184afa47f2b4349f7dea9e5569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:36:49.538241 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-b4aa5d33-5cf9-4d98-a89e-d27c7286872c tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] 10.222.0.43 "GET /compute/v2.1/servers/eea0261c-26b6-4bf6-a59d-6e0d20d32bcb" status: 200 len: 1392 microversion: 2.1 time: 0.155998 Oct 04 22:36:49.538871 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2985/6793] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:36:49 2022] GET /compute/v2.1/servers/eea0261c-26b6-4bf6-a59d-6e0d20d32bcb => generated 1392 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:36:50.561115 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-b7f4ab17-922a-46f2-b626-4cb64950496d tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:36:50.561742 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-b7f4ab17-922a-46f2-b626-4cb64950496d tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] [instance: eea0261c-26b6-4bf6-a59d-6e0d20d32bcb] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:36:50.568888 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b7f4ab17-922a-46f2-b626-4cb64950496d tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:36:50.569380 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b7f4ab17-922a-46f2-b626-4cb64950496d tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:36:50.569828 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b7f4ab17-922a-46f2-b626-4cb64950496d tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:36:50.570562 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b7f4ab17-922a-46f2-b626-4cb64950496d tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:36:50.571027 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b7f4ab17-922a-46f2-b626-4cb64950496d tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:36:50.571465 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b7f4ab17-922a-46f2-b626-4cb64950496d tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:36:50.707562 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-b7f4ab17-922a-46f2-b626-4cb64950496d tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc0ba9f45d04dec89394df46d6096a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2856184afa47f2b4349f7dea9e5569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:36:50.716373 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-b7f4ab17-922a-46f2-b626-4cb64950496d tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] 10.222.0.43 "GET /compute/v2.1/servers/eea0261c-26b6-4bf6-a59d-6e0d20d32bcb" status: 200 len: 1392 microversion: 2.1 time: 0.159165 Oct 04 22:36:50.717016 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3809/6794] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:36:50 2022] GET /compute/v2.1/servers/eea0261c-26b6-4bf6-a59d-6e0d20d32bcb => generated 1392 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:36:51.739942 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-cf2a4542-6d71-4bb1-be3d-c72e70d55100 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:36:51.740586 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-cf2a4542-6d71-4bb1-be3d-c72e70d55100 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] [instance: eea0261c-26b6-4bf6-a59d-6e0d20d32bcb] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:36:51.747566 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cf2a4542-6d71-4bb1-be3d-c72e70d55100 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:36:51.748050 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cf2a4542-6d71-4bb1-be3d-c72e70d55100 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:36:51.748493 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cf2a4542-6d71-4bb1-be3d-c72e70d55100 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:36:51.749183 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cf2a4542-6d71-4bb1-be3d-c72e70d55100 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:36:51.749632 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cf2a4542-6d71-4bb1-be3d-c72e70d55100 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:36:51.750057 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cf2a4542-6d71-4bb1-be3d-c72e70d55100 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:36:51.878337 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-cf2a4542-6d71-4bb1-be3d-c72e70d55100 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc0ba9f45d04dec89394df46d6096a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2856184afa47f2b4349f7dea9e5569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:36:51.886429 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-cf2a4542-6d71-4bb1-be3d-c72e70d55100 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] 10.222.0.43 "GET /compute/v2.1/servers/eea0261c-26b6-4bf6-a59d-6e0d20d32bcb" status: 200 len: 1392 microversion: 2.1 time: 0.150502 Oct 04 22:36:51.887012 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2986/6795] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:36:51 2022] GET /compute/v2.1/servers/eea0261c-26b6-4bf6-a59d-6e0d20d32bcb => generated 1392 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:36:52.326259 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-7b815831-5993-46b0-bf6c-f7b052b75ffc req-f6701108-aad4-4e65-9ac7-98f8a71c875a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eea0261c-26b6-4bf6-a59d-6e0d20d32bcb", "name": "network-vif-plugged", "status": "completed", "tag": "5235e153-524e-41e1-870f-fb98044623b8"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:36:52.339241 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-7b815831-5993-46b0-bf6c-f7b052b75ffc req-f6701108-aad4-4e65-9ac7-98f8a71c875a service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:36:52.340022 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-7b815831-5993-46b0-bf6c-f7b052b75ffc req-f6701108-aad4-4e65-9ac7-98f8a71c875a service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:36:52.340490 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-7b815831-5993-46b0-bf6c-f7b052b75ffc req-f6701108-aad4-4e65-9ac7-98f8a71c875a service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:36:52.352475 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-7b815831-5993-46b0-bf6c-f7b052b75ffc req-f6701108-aad4-4e65-9ac7-98f8a71c875a service nova] Creating event network-vif-plugged:5235e153-524e-41e1-870f-fb98044623b8 for instance eea0261c-26b6-4bf6-a59d-6e0d20d32bcb on n-h1-860284-1 Oct 04 22:36:52.357489 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-7b815831-5993-46b0-bf6c-f7b052b75ffc req-f6701108-aad4-4e65-9ac7-98f8a71c875a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035001 Oct 04 22:36:52.358094 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3810/6796] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:36:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:36:52.909213 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-647f123e-f029-457c-a057-06ea5d83fcc7 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:36:52.909890 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-647f123e-f029-457c-a057-06ea5d83fcc7 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] [instance: eea0261c-26b6-4bf6-a59d-6e0d20d32bcb] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:36:52.917527 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-647f123e-f029-457c-a057-06ea5d83fcc7 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:36:52.918016 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-647f123e-f029-457c-a057-06ea5d83fcc7 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:36:52.918489 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-647f123e-f029-457c-a057-06ea5d83fcc7 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:36:52.919191 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-647f123e-f029-457c-a057-06ea5d83fcc7 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:36:52.919654 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-647f123e-f029-457c-a057-06ea5d83fcc7 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:36:52.920088 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-647f123e-f029-457c-a057-06ea5d83fcc7 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:36:53.049849 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-647f123e-f029-457c-a057-06ea5d83fcc7 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc0ba9f45d04dec89394df46d6096a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2856184afa47f2b4349f7dea9e5569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:36:53.058093 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-647f123e-f029-457c-a057-06ea5d83fcc7 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] 10.222.0.43 "GET /compute/v2.1/servers/eea0261c-26b6-4bf6-a59d-6e0d20d32bcb" status: 200 len: 1392 microversion: 2.1 time: 0.152883 Oct 04 22:36:53.058726 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2987/6797] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:36:52 2022] GET /compute/v2.1/servers/eea0261c-26b6-4bf6-a59d-6e0d20d32bcb => generated 1392 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:36:54.081642 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-203edae7-477a-4707-84b6-6fae463a477d tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:36:54.082354 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-203edae7-477a-4707-84b6-6fae463a477d tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] [instance: eea0261c-26b6-4bf6-a59d-6e0d20d32bcb] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:36:54.085786 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=2 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:36:54.086502 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=6 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:36:54.087295 n-d-860284-1 devstack@n-api.service[134101]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 22:36:54.087425 n-d-860284-1 devstack@n-api.service[134101]: Tue Oct 4 22:36:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/eea0261c-26b6-4bf6-a59d-6e0d20d32bcb (ip 10.222.0.43) !!! Oct 04 22:36:54.095726 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-203edae7-477a-4707-84b6-6fae463a477d tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:36:54.096242 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-203edae7-477a-4707-84b6-6fae463a477d tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:36:54.096701 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-203edae7-477a-4707-84b6-6fae463a477d tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:36:54.097424 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-203edae7-477a-4707-84b6-6fae463a477d tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:36:54.097900 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-203edae7-477a-4707-84b6-6fae463a477d tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:36:54.098347 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-203edae7-477a-4707-84b6-6fae463a477d tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:36:54.239990 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-203edae7-477a-4707-84b6-6fae463a477d tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc0ba9f45d04dec89394df46d6096a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2856184afa47f2b4349f7dea9e5569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:36:54.248040 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-203edae7-477a-4707-84b6-6fae463a477d tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] 10.222.0.43 "GET /compute/v2.1/servers/eea0261c-26b6-4bf6-a59d-6e0d20d32bcb" status: 200 len: 1565 microversion: 2.1 time: 0.170737 Oct 04 22:36:54.248616 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3811/6798] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:36:54 2022] GET /compute/v2.1/servers/eea0261c-26b6-4bf6-a59d-6e0d20d32bcb => generated 1565 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:36:54.270276 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-33286039-ac03-495a-857b-53c6c7e79fb0 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:36:54.270927 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-33286039-ac03-495a-857b-53c6c7e79fb0 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] [instance: eea0261c-26b6-4bf6-a59d-6e0d20d32bcb] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:36:54.273315 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell0:SELECT=6 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:36:54.279304 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-33286039-ac03-495a-857b-53c6c7e79fb0 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:36:54.279795 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-33286039-ac03-495a-857b-53c6c7e79fb0 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:36:54.280241 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-33286039-ac03-495a-857b-53c6c7e79fb0 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:36:54.280939 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-33286039-ac03-495a-857b-53c6c7e79fb0 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:36:54.281404 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-33286039-ac03-495a-857b-53c6c7e79fb0 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:36:54.281866 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-33286039-ac03-495a-857b-53c6c7e79fb0 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:36:54.416900 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-33286039-ac03-495a-857b-53c6c7e79fb0 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc0ba9f45d04dec89394df46d6096a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2856184afa47f2b4349f7dea9e5569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:36:54.424578 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-33286039-ac03-495a-857b-53c6c7e79fb0 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] 10.222.0.43 "GET /compute/v2.1/servers/eea0261c-26b6-4bf6-a59d-6e0d20d32bcb" status: 200 len: 1565 microversion: 2.1 time: 0.158174 Oct 04 22:36:54.425161 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2988/6799] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:36:54 2022] GET /compute/v2.1/servers/eea0261c-26b6-4bf6-a59d-6e0d20d32bcb => generated 1565 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:36:56.452359 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-5acbd0e4-4294-4345-83a7-58bd5ba5f22a req-0f423168-ca5a-4b7d-9c61-7a83679880ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eea0261c-26b6-4bf6-a59d-6e0d20d32bcb", "tag": "5235e153-524e-41e1-870f-fb98044623b8"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:36:56.461818 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-7f4d9bae-3736-4333-a56a-0e804b1ef249 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:36:56.463012 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-7f4d9bae-3736-4333-a56a-0e804b1ef249 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] [instance: eea0261c-26b6-4bf6-a59d-6e0d20d32bcb] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:36:56.465334 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-5acbd0e4-4294-4345-83a7-58bd5ba5f22a req-0f423168-ca5a-4b7d-9c61-7a83679880ba service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:36:56.465817 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-5acbd0e4-4294-4345-83a7-58bd5ba5f22a req-0f423168-ca5a-4b7d-9c61-7a83679880ba service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:36:56.466277 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-5acbd0e4-4294-4345-83a7-58bd5ba5f22a req-0f423168-ca5a-4b7d-9c61-7a83679880ba service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:36:56.470648 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7f4d9bae-3736-4333-a56a-0e804b1ef249 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:36:56.470648 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7f4d9bae-3736-4333-a56a-0e804b1ef249 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:36:56.471018 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7f4d9bae-3736-4333-a56a-0e804b1ef249 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:36:56.471707 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7f4d9bae-3736-4333-a56a-0e804b1ef249 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:36:56.472179 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7f4d9bae-3736-4333-a56a-0e804b1ef249 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:36:56.472618 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7f4d9bae-3736-4333-a56a-0e804b1ef249 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:36:56.478534 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-5acbd0e4-4294-4345-83a7-58bd5ba5f22a req-0f423168-ca5a-4b7d-9c61-7a83679880ba service nova] Creating event network-changed:5235e153-524e-41e1-870f-fb98044623b8 for instance eea0261c-26b6-4bf6-a59d-6e0d20d32bcb on n-h1-860284-1 Oct 04 22:36:56.484463 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-5acbd0e4-4294-4345-83a7-58bd5ba5f22a req-0f423168-ca5a-4b7d-9c61-7a83679880ba service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035427 Oct 04 22:36:56.485639 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2989/6800] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:36:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:36:56.618201 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-7f4d9bae-3736-4333-a56a-0e804b1ef249 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc0ba9f45d04dec89394df46d6096a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2856184afa47f2b4349f7dea9e5569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:36:56.626418 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-7f4d9bae-3736-4333-a56a-0e804b1ef249 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] 10.222.0.43 "GET /compute/v2.1/servers/eea0261c-26b6-4bf6-a59d-6e0d20d32bcb" status: 200 len: 1565 microversion: 2.1 time: 0.180242 Oct 04 22:36:56.627196 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3812/6801] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:36:56 2022] GET /compute/v2.1/servers/eea0261c-26b6-4bf6-a59d-6e0d20d32bcb => generated 1565 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:37:31.932643 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-da456fa3-dcc4-40a6-b2b3-48cac8346302 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:37:31.934909 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-da456fa3-dcc4-40a6-b2b3-48cac8346302 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] [instance: eea0261c-26b6-4bf6-a59d-6e0d20d32bcb] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:37:31.937069 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_api:SELECT=13 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:37:31.937714 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=38 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:37:31.944627 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-da456fa3-dcc4-40a6-b2b3-48cac8346302 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:37:31.945186 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-da456fa3-dcc4-40a6-b2b3-48cac8346302 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:37:31.945621 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-da456fa3-dcc4-40a6-b2b3-48cac8346302 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:37:31.946317 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-da456fa3-dcc4-40a6-b2b3-48cac8346302 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:37:31.946796 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-da456fa3-dcc4-40a6-b2b3-48cac8346302 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:37:31.947222 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-da456fa3-dcc4-40a6-b2b3-48cac8346302 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:37:32.002282 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-da456fa3-dcc4-40a6-b2b3-48cac8346302 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] 10.222.0.43 "POST /compute/v2.1/servers/eea0261c-26b6-4bf6-a59d-6e0d20d32bcb/action" status: 200 len: 24571 microversion: 2.1 time: 0.074991 Oct 04 22:37:32.002979 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2990/6802] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 22:37:31 2022] POST /compute/v2.1/servers/eea0261c-26b6-4bf6-a59d-6e0d20d32bcb/action => generated 24571 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 22:38:11.061760 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:38:11.062572 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=36 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:38:11.066758 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-6a9ec4e8-4e5f-4618-aff5-76f9b1e6b8a1 tempest-TestNetworkAdvancedServerOps-1759506676 tempest-TestNetworkAdvancedServerOps-1759506676-project-admin] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:38:11.067906 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-6a9ec4e8-4e5f-4618-aff5-76f9b1e6b8a1 tempest-TestNetworkAdvancedServerOps-1759506676 tempest-TestNetworkAdvancedServerOps-1759506676-project-admin] [instance: eea0261c-26b6-4bf6-a59d-6e0d20d32bcb] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:38:11.076000 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6a9ec4e8-4e5f-4618-aff5-76f9b1e6b8a1 tempest-TestNetworkAdvancedServerOps-1759506676 tempest-TestNetworkAdvancedServerOps-1759506676-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:38:11.076504 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6a9ec4e8-4e5f-4618-aff5-76f9b1e6b8a1 tempest-TestNetworkAdvancedServerOps-1759506676 tempest-TestNetworkAdvancedServerOps-1759506676-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:38:11.076959 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6a9ec4e8-4e5f-4618-aff5-76f9b1e6b8a1 tempest-TestNetworkAdvancedServerOps-1759506676 tempest-TestNetworkAdvancedServerOps-1759506676-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:38:11.077675 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6a9ec4e8-4e5f-4618-aff5-76f9b1e6b8a1 tempest-TestNetworkAdvancedServerOps-1759506676 tempest-TestNetworkAdvancedServerOps-1759506676-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:38:11.078147 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6a9ec4e8-4e5f-4618-aff5-76f9b1e6b8a1 tempest-TestNetworkAdvancedServerOps-1759506676 tempest-TestNetworkAdvancedServerOps-1759506676-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:38:11.078624 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6a9ec4e8-4e5f-4618-aff5-76f9b1e6b8a1 tempest-TestNetworkAdvancedServerOps-1759506676 tempest-TestNetworkAdvancedServerOps-1759506676-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:38:11.309042 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-6a9ec4e8-4e5f-4618-aff5-76f9b1e6b8a1 tempest-TestNetworkAdvancedServerOps-1759506676 tempest-TestNetworkAdvancedServerOps-1759506676-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/eea0261c-26b6-4bf6-a59d-6e0d20d32bcb" status: 200 len: 1835 microversion: 2.1 time: 0.249186 Oct 04 22:38:11.309666 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3813/6803] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:38:11 2022] GET /compute/v2.1/servers/eea0261c-26b6-4bf6-a59d-6e0d20d32bcb => generated 1835 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:38:11.332317 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-1c86cdd4-1dfe-41d5-90bb-05d2c10c5fdf tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:38:11.333167 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-1c86cdd4-1dfe-41d5-90bb-05d2c10c5fdf tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] [instance: eea0261c-26b6-4bf6-a59d-6e0d20d32bcb] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:38:11.335726 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_api:SELECT=2 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:38:11.336528 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=4 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:38:11.342921 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1c86cdd4-1dfe-41d5-90bb-05d2c10c5fdf tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:38:11.343414 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1c86cdd4-1dfe-41d5-90bb-05d2c10c5fdf tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:38:11.343858 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1c86cdd4-1dfe-41d5-90bb-05d2c10c5fdf tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:38:11.344560 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1c86cdd4-1dfe-41d5-90bb-05d2c10c5fdf tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:38:11.345029 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1c86cdd4-1dfe-41d5-90bb-05d2c10c5fdf tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:38:11.345466 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1c86cdd4-1dfe-41d5-90bb-05d2c10c5fdf tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:38:11.483292 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-1c86cdd4-1dfe-41d5-90bb-05d2c10c5fdf tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc0ba9f45d04dec89394df46d6096a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2856184afa47f2b4349f7dea9e5569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:38:11.491954 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-1c86cdd4-1dfe-41d5-90bb-05d2c10c5fdf tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] 10.222.0.43 "GET /compute/v2.1/servers/eea0261c-26b6-4bf6-a59d-6e0d20d32bcb" status: 200 len: 1684 microversion: 2.1 time: 0.164079 Oct 04 22:38:11.492556 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2991/6804] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:38:11 2022] GET /compute/v2.1/servers/eea0261c-26b6-4bf6-a59d-6e0d20d32bcb => generated 1684 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:38:11.592799 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-f9d5acc1-3d69-4362-8dca-238b0661209c tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:38:11.595133 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-f9d5acc1-3d69-4362-8dca-238b0661209c tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] [instance: eea0261c-26b6-4bf6-a59d-6e0d20d32bcb] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:38:11.602542 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f9d5acc1-3d69-4362-8dca-238b0661209c tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:38:11.603056 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f9d5acc1-3d69-4362-8dca-238b0661209c tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:38:11.603519 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f9d5acc1-3d69-4362-8dca-238b0661209c tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:38:11.604239 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f9d5acc1-3d69-4362-8dca-238b0661209c tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:38:11.604715 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f9d5acc1-3d69-4362-8dca-238b0661209c tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:38:11.605170 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f9d5acc1-3d69-4362-8dca-238b0661209c tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:38:11.664979 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-f9d5acc1-3d69-4362-8dca-238b0661209c tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] 10.222.0.43 "POST /compute/v2.1/servers/eea0261c-26b6-4bf6-a59d-6e0d20d32bcb/action" status: 200 len: 32631 microversion: 2.1 time: 0.075993 Oct 04 22:38:11.665631 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3814/6805] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 22:38:11 2022] POST /compute/v2.1/servers/eea0261c-26b6-4bf6-a59d-6e0d20d32bcb/action => generated 32631 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 22:38:11.814084 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-5d242f72-dd93-4c18-9425-ad58db47316b tempest-TestNetworkAdvancedServerOps-1759506676 tempest-TestNetworkAdvancedServerOps-1759506676-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:38:11.814707 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-5d242f72-dd93-4c18-9425-ad58db47316b tempest-TestNetworkAdvancedServerOps-1759506676 tempest-TestNetworkAdvancedServerOps-1759506676-project-admin] [instance: eea0261c-26b6-4bf6-a59d-6e0d20d32bcb] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:38:11.821127 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5d242f72-dd93-4c18-9425-ad58db47316b tempest-TestNetworkAdvancedServerOps-1759506676 tempest-TestNetworkAdvancedServerOps-1759506676-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:38:11.821620 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5d242f72-dd93-4c18-9425-ad58db47316b tempest-TestNetworkAdvancedServerOps-1759506676 tempest-TestNetworkAdvancedServerOps-1759506676-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:38:11.822058 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5d242f72-dd93-4c18-9425-ad58db47316b tempest-TestNetworkAdvancedServerOps-1759506676 tempest-TestNetworkAdvancedServerOps-1759506676-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:38:11.822777 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5d242f72-dd93-4c18-9425-ad58db47316b tempest-TestNetworkAdvancedServerOps-1759506676 tempest-TestNetworkAdvancedServerOps-1759506676-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:38:11.823230 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5d242f72-dd93-4c18-9425-ad58db47316b tempest-TestNetworkAdvancedServerOps-1759506676 tempest-TestNetworkAdvancedServerOps-1759506676-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:38:11.823654 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5d242f72-dd93-4c18-9425-ad58db47316b tempest-TestNetworkAdvancedServerOps-1759506676 tempest-TestNetworkAdvancedServerOps-1759506676-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:38:11.914917 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-5d242f72-dd93-4c18-9425-ad58db47316b tempest-TestNetworkAdvancedServerOps-1759506676 tempest-TestNetworkAdvancedServerOps-1759506676-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '7db2bd8abcca431e81abcedf5b737894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2375770f8a694356908af88f549a8881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:38:11.915565 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-5d242f72-dd93-4c18-9425-ad58db47316b tempest-TestNetworkAdvancedServerOps-1759506676 tempest-TestNetworkAdvancedServerOps-1759506676-project-admin] [instance: eea0261c-26b6-4bf6-a59d-6e0d20d32bcb] flavor_id is None. Assuming migration. {{(pid=134102) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 04 22:38:11.916021 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-5d242f72-dd93-4c18-9425-ad58db47316b tempest-TestNetworkAdvancedServerOps-1759506676 tempest-TestNetworkAdvancedServerOps-1759506676-project-admin] [instance: eea0261c-26b6-4bf6-a59d-6e0d20d32bcb] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=134102) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 04 22:38:12.130025 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-5d242f72-dd93-4c18-9425-ad58db47316b tempest-TestNetworkAdvancedServerOps-1759506676 tempest-TestNetworkAdvancedServerOps-1759506676-project-admin] 10.222.0.43 "POST /compute/v2.1/servers/eea0261c-26b6-4bf6-a59d-6e0d20d32bcb/action" status: 202 len: 0 microversion: 2.1 time: 0.318922 Oct 04 22:38:12.130025 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2992/6806] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 22:38:11 2022] POST /compute/v2.1/servers/eea0261c-26b6-4bf6-a59d-6e0d20d32bcb/action => generated 0 bytes in 320 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 22:38:12.139178 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-a644a48c-4874-4467-b961-b1bd5a5a5613 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:38:12.139895 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-a644a48c-4874-4467-b961-b1bd5a5a5613 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] [instance: eea0261c-26b6-4bf6-a59d-6e0d20d32bcb] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:38:12.148200 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a644a48c-4874-4467-b961-b1bd5a5a5613 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:38:12.148702 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a644a48c-4874-4467-b961-b1bd5a5a5613 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:38:12.149150 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a644a48c-4874-4467-b961-b1bd5a5a5613 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:38:12.149858 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a644a48c-4874-4467-b961-b1bd5a5a5613 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:38:12.150321 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a644a48c-4874-4467-b961-b1bd5a5a5613 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:38:12.150795 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a644a48c-4874-4467-b961-b1bd5a5a5613 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:38:12.327335 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-a644a48c-4874-4467-b961-b1bd5a5a5613 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc0ba9f45d04dec89394df46d6096a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2856184afa47f2b4349f7dea9e5569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:38:12.335914 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-a644a48c-4874-4467-b961-b1bd5a5a5613 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] 10.222.0.43 "GET /compute/v2.1/servers/eea0261c-26b6-4bf6-a59d-6e0d20d32bcb" status: 200 len: 1693 microversion: 2.1 time: 0.201081 Oct 04 22:38:12.336656 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3815/6807] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:38:12 2022] GET /compute/v2.1/servers/eea0261c-26b6-4bf6-a59d-6e0d20d32bcb => generated 1693 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:38:13.358692 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-55bd33ca-47f5-4e71-af61-5e920249facd tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:38:13.359310 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-55bd33ca-47f5-4e71-af61-5e920249facd tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] [instance: eea0261c-26b6-4bf6-a59d-6e0d20d32bcb] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:38:13.367505 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-55bd33ca-47f5-4e71-af61-5e920249facd tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:38:13.367991 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-55bd33ca-47f5-4e71-af61-5e920249facd tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:38:13.368430 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-55bd33ca-47f5-4e71-af61-5e920249facd tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:38:13.369114 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-55bd33ca-47f5-4e71-af61-5e920249facd tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:38:13.369567 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-55bd33ca-47f5-4e71-af61-5e920249facd tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:38:13.369993 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-55bd33ca-47f5-4e71-af61-5e920249facd tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:38:13.500325 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-55bd33ca-47f5-4e71-af61-5e920249facd tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc0ba9f45d04dec89394df46d6096a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2856184afa47f2b4349f7dea9e5569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:38:13.508423 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-55bd33ca-47f5-4e71-af61-5e920249facd tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] 10.222.0.43 "GET /compute/v2.1/servers/eea0261c-26b6-4bf6-a59d-6e0d20d32bcb" status: 200 len: 1693 microversion: 2.1 time: 0.153456 Oct 04 22:38:13.509008 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2993/6808] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:38:13 2022] GET /compute/v2.1/servers/eea0261c-26b6-4bf6-a59d-6e0d20d32bcb => generated 1693 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:38:14.532780 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-9ab311c0-4e49-4dcb-8ee6-6dc44c4fe99c tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:38:14.533414 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-9ab311c0-4e49-4dcb-8ee6-6dc44c4fe99c tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] [instance: eea0261c-26b6-4bf6-a59d-6e0d20d32bcb] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:38:14.541326 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9ab311c0-4e49-4dcb-8ee6-6dc44c4fe99c tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:38:14.541836 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9ab311c0-4e49-4dcb-8ee6-6dc44c4fe99c tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:38:14.542305 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9ab311c0-4e49-4dcb-8ee6-6dc44c4fe99c tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:38:14.543045 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9ab311c0-4e49-4dcb-8ee6-6dc44c4fe99c tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:38:14.543521 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9ab311c0-4e49-4dcb-8ee6-6dc44c4fe99c tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:38:14.543969 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9ab311c0-4e49-4dcb-8ee6-6dc44c4fe99c tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:38:14.675761 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-9ab311c0-4e49-4dcb-8ee6-6dc44c4fe99c tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc0ba9f45d04dec89394df46d6096a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2856184afa47f2b4349f7dea9e5569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:38:14.683767 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-9ab311c0-4e49-4dcb-8ee6-6dc44c4fe99c tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] 10.222.0.43 "GET /compute/v2.1/servers/eea0261c-26b6-4bf6-a59d-6e0d20d32bcb" status: 200 len: 1698 microversion: 2.1 time: 0.155048 Oct 04 22:38:14.684348 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3816/6809] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:38:14 2022] GET /compute/v2.1/servers/eea0261c-26b6-4bf6-a59d-6e0d20d32bcb => generated 1698 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:38:15.708492 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-b8acd858-e1fa-4a6b-bf36-e406eef6d3a6 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:38:15.709187 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-b8acd858-e1fa-4a6b-bf36-e406eef6d3a6 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] [instance: eea0261c-26b6-4bf6-a59d-6e0d20d32bcb] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:38:15.716482 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b8acd858-e1fa-4a6b-bf36-e406eef6d3a6 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:38:15.716998 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b8acd858-e1fa-4a6b-bf36-e406eef6d3a6 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:38:15.717473 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b8acd858-e1fa-4a6b-bf36-e406eef6d3a6 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:38:15.718222 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b8acd858-e1fa-4a6b-bf36-e406eef6d3a6 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:38:15.718741 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b8acd858-e1fa-4a6b-bf36-e406eef6d3a6 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:38:15.719205 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b8acd858-e1fa-4a6b-bf36-e406eef6d3a6 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:38:15.861546 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-b8acd858-e1fa-4a6b-bf36-e406eef6d3a6 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc0ba9f45d04dec89394df46d6096a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2856184afa47f2b4349f7dea9e5569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:38:15.869452 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-b8acd858-e1fa-4a6b-bf36-e406eef6d3a6 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] 10.222.0.43 "GET /compute/v2.1/servers/eea0261c-26b6-4bf6-a59d-6e0d20d32bcb" status: 200 len: 1698 microversion: 2.1 time: 0.165724 Oct 04 22:38:15.870035 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2994/6810] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:38:15 2022] GET /compute/v2.1/servers/eea0261c-26b6-4bf6-a59d-6e0d20d32bcb => generated 1698 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:38:16.893150 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-6dfd2be5-3a00-437f-be74-a1086be70952 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:38:16.893789 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-6dfd2be5-3a00-437f-be74-a1086be70952 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] [instance: eea0261c-26b6-4bf6-a59d-6e0d20d32bcb] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:38:16.900505 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6dfd2be5-3a00-437f-be74-a1086be70952 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:38:16.901010 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6dfd2be5-3a00-437f-be74-a1086be70952 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:38:16.901472 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6dfd2be5-3a00-437f-be74-a1086be70952 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:38:16.902188 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6dfd2be5-3a00-437f-be74-a1086be70952 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:38:16.902694 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6dfd2be5-3a00-437f-be74-a1086be70952 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:38:16.903144 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6dfd2be5-3a00-437f-be74-a1086be70952 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:38:17.044475 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-6dfd2be5-3a00-437f-be74-a1086be70952 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc0ba9f45d04dec89394df46d6096a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2856184afa47f2b4349f7dea9e5569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:38:17.052980 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-6dfd2be5-3a00-437f-be74-a1086be70952 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] 10.222.0.43 "GET /compute/v2.1/servers/eea0261c-26b6-4bf6-a59d-6e0d20d32bcb" status: 200 len: 1698 microversion: 2.1 time: 0.163758 Oct 04 22:38:17.053560 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3817/6811] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:38:16 2022] GET /compute/v2.1/servers/eea0261c-26b6-4bf6-a59d-6e0d20d32bcb => generated 1698 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:38:18.077200 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-8c1eea59-5184-4a4d-918d-37b29671f515 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:38:18.077819 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-8c1eea59-5184-4a4d-918d-37b29671f515 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] [instance: eea0261c-26b6-4bf6-a59d-6e0d20d32bcb] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:38:18.084713 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8c1eea59-5184-4a4d-918d-37b29671f515 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:38:18.085199 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8c1eea59-5184-4a4d-918d-37b29671f515 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:38:18.085641 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8c1eea59-5184-4a4d-918d-37b29671f515 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:38:18.086338 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8c1eea59-5184-4a4d-918d-37b29671f515 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:38:18.086823 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8c1eea59-5184-4a4d-918d-37b29671f515 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:38:18.087254 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8c1eea59-5184-4a4d-918d-37b29671f515 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:38:18.224288 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-8c1eea59-5184-4a4d-918d-37b29671f515 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc0ba9f45d04dec89394df46d6096a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2856184afa47f2b4349f7dea9e5569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:38:18.232251 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-8c1eea59-5184-4a4d-918d-37b29671f515 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] 10.222.0.43 "GET /compute/v2.1/servers/eea0261c-26b6-4bf6-a59d-6e0d20d32bcb" status: 200 len: 1698 microversion: 2.1 time: 0.158749 Oct 04 22:38:18.232673 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2995/6812] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:38:18 2022] GET /compute/v2.1/servers/eea0261c-26b6-4bf6-a59d-6e0d20d32bcb => generated 1698 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:38:19.255607 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-94e0ad12-0647-4ae0-a83f-9714daec9a7a tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:38:19.256326 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-94e0ad12-0647-4ae0-a83f-9714daec9a7a tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] [instance: eea0261c-26b6-4bf6-a59d-6e0d20d32bcb] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:38:19.266316 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-94e0ad12-0647-4ae0-a83f-9714daec9a7a tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:38:19.267220 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-94e0ad12-0647-4ae0-a83f-9714daec9a7a tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:38:19.268014 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-94e0ad12-0647-4ae0-a83f-9714daec9a7a tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:38:19.269290 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-94e0ad12-0647-4ae0-a83f-9714daec9a7a tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:38:19.270133 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-94e0ad12-0647-4ae0-a83f-9714daec9a7a tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:38:19.270932 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-94e0ad12-0647-4ae0-a83f-9714daec9a7a tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:38:19.416375 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-94e0ad12-0647-4ae0-a83f-9714daec9a7a tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc0ba9f45d04dec89394df46d6096a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2856184afa47f2b4349f7dea9e5569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:38:19.424429 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-94e0ad12-0647-4ae0-a83f-9714daec9a7a tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] 10.222.0.43 "GET /compute/v2.1/servers/eea0261c-26b6-4bf6-a59d-6e0d20d32bcb" status: 200 len: 1698 microversion: 2.1 time: 0.172923 Oct 04 22:38:19.425002 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3818/6813] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:38:19 2022] GET /compute/v2.1/servers/eea0261c-26b6-4bf6-a59d-6e0d20d32bcb => generated 1698 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:38:20.448112 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-7233ce83-58b1-499c-842b-5bcdc5b3b4cc tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:38:20.448762 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-7233ce83-58b1-499c-842b-5bcdc5b3b4cc tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] [instance: eea0261c-26b6-4bf6-a59d-6e0d20d32bcb] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:38:20.455667 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7233ce83-58b1-499c-842b-5bcdc5b3b4cc tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:38:20.456158 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7233ce83-58b1-499c-842b-5bcdc5b3b4cc tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:38:20.456624 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7233ce83-58b1-499c-842b-5bcdc5b3b4cc tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:38:20.457326 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7233ce83-58b1-499c-842b-5bcdc5b3b4cc tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:38:20.457836 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7233ce83-58b1-499c-842b-5bcdc5b3b4cc tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:38:20.458266 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7233ce83-58b1-499c-842b-5bcdc5b3b4cc tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:38:20.595166 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-7233ce83-58b1-499c-842b-5bcdc5b3b4cc tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc0ba9f45d04dec89394df46d6096a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2856184afa47f2b4349f7dea9e5569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:38:20.603491 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-7233ce83-58b1-499c-842b-5bcdc5b3b4cc tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] 10.222.0.43 "GET /compute/v2.1/servers/eea0261c-26b6-4bf6-a59d-6e0d20d32bcb" status: 200 len: 1698 microversion: 2.1 time: 0.159366 Oct 04 22:38:20.604068 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2996/6814] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:38:20 2022] GET /compute/v2.1/servers/eea0261c-26b6-4bf6-a59d-6e0d20d32bcb => generated 1698 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:38:21.627151 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-8270ef83-6c5d-45ba-afbf-6805724c0861 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:38:21.627784 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-8270ef83-6c5d-45ba-afbf-6805724c0861 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] [instance: eea0261c-26b6-4bf6-a59d-6e0d20d32bcb] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:38:21.635198 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8270ef83-6c5d-45ba-afbf-6805724c0861 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:38:21.635703 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8270ef83-6c5d-45ba-afbf-6805724c0861 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:38:21.636163 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8270ef83-6c5d-45ba-afbf-6805724c0861 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:38:21.636869 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8270ef83-6c5d-45ba-afbf-6805724c0861 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:38:21.637347 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8270ef83-6c5d-45ba-afbf-6805724c0861 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:38:21.637794 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8270ef83-6c5d-45ba-afbf-6805724c0861 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:38:21.769315 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-8270ef83-6c5d-45ba-afbf-6805724c0861 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc0ba9f45d04dec89394df46d6096a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2856184afa47f2b4349f7dea9e5569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:38:21.777885 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-8270ef83-6c5d-45ba-afbf-6805724c0861 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] 10.222.0.43 "GET /compute/v2.1/servers/eea0261c-26b6-4bf6-a59d-6e0d20d32bcb" status: 200 len: 1698 microversion: 2.1 time: 0.154714 Oct 04 22:38:21.778487 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3819/6815] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:38:21 2022] GET /compute/v2.1/servers/eea0261c-26b6-4bf6-a59d-6e0d20d32bcb => generated 1698 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:38:22.802596 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-a65c9d76-addb-487f-9b70-5bd828920813 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:38:22.803226 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-a65c9d76-addb-487f-9b70-5bd828920813 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] [instance: eea0261c-26b6-4bf6-a59d-6e0d20d32bcb] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:38:22.810405 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a65c9d76-addb-487f-9b70-5bd828920813 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:38:22.810905 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a65c9d76-addb-487f-9b70-5bd828920813 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:38:22.811351 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a65c9d76-addb-487f-9b70-5bd828920813 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:38:22.812056 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a65c9d76-addb-487f-9b70-5bd828920813 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:38:22.812524 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a65c9d76-addb-487f-9b70-5bd828920813 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:38:22.812958 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a65c9d76-addb-487f-9b70-5bd828920813 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:38:22.949940 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-a65c9d76-addb-487f-9b70-5bd828920813 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc0ba9f45d04dec89394df46d6096a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2856184afa47f2b4349f7dea9e5569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:38:22.957835 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-a65c9d76-addb-487f-9b70-5bd828920813 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] 10.222.0.43 "GET /compute/v2.1/servers/eea0261c-26b6-4bf6-a59d-6e0d20d32bcb" status: 200 len: 1698 microversion: 2.1 time: 0.160097 Oct 04 22:38:22.958562 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2997/6816] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:38:22 2022] GET /compute/v2.1/servers/eea0261c-26b6-4bf6-a59d-6e0d20d32bcb => generated 1698 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:38:23.981173 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-46d2d29b-b516-4a61-9eac-a34b6df623af tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:38:23.981803 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-46d2d29b-b516-4a61-9eac-a34b6df623af tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] [instance: eea0261c-26b6-4bf6-a59d-6e0d20d32bcb] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:38:23.989292 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-46d2d29b-b516-4a61-9eac-a34b6df623af tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:38:23.989789 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-46d2d29b-b516-4a61-9eac-a34b6df623af tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:38:23.990242 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-46d2d29b-b516-4a61-9eac-a34b6df623af tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:38:23.990983 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-46d2d29b-b516-4a61-9eac-a34b6df623af tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:38:23.991461 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-46d2d29b-b516-4a61-9eac-a34b6df623af tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:38:23.991912 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-46d2d29b-b516-4a61-9eac-a34b6df623af tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:38:24.126691 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-46d2d29b-b516-4a61-9eac-a34b6df623af tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc0ba9f45d04dec89394df46d6096a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2856184afa47f2b4349f7dea9e5569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:38:24.135281 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-46d2d29b-b516-4a61-9eac-a34b6df623af tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] 10.222.0.43 "GET /compute/v2.1/servers/eea0261c-26b6-4bf6-a59d-6e0d20d32bcb" status: 200 len: 1698 microversion: 2.1 time: 0.158023 Oct 04 22:38:24.135863 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3820/6817] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:38:23 2022] GET /compute/v2.1/servers/eea0261c-26b6-4bf6-a59d-6e0d20d32bcb => generated 1698 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:38:25.158908 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-f53d57b0-15b5-4c5c-a33e-7b20f7761e41 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:38:25.159536 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-f53d57b0-15b5-4c5c-a33e-7b20f7761e41 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] [instance: eea0261c-26b6-4bf6-a59d-6e0d20d32bcb] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:38:25.166636 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f53d57b0-15b5-4c5c-a33e-7b20f7761e41 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:38:25.167121 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f53d57b0-15b5-4c5c-a33e-7b20f7761e41 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:38:25.167561 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f53d57b0-15b5-4c5c-a33e-7b20f7761e41 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:38:25.168252 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f53d57b0-15b5-4c5c-a33e-7b20f7761e41 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:38:25.168711 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f53d57b0-15b5-4c5c-a33e-7b20f7761e41 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:38:25.169144 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f53d57b0-15b5-4c5c-a33e-7b20f7761e41 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:38:25.300616 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-f53d57b0-15b5-4c5c-a33e-7b20f7761e41 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc0ba9f45d04dec89394df46d6096a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2856184afa47f2b4349f7dea9e5569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:38:25.308474 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-f53d57b0-15b5-4c5c-a33e-7b20f7761e41 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] 10.222.0.43 "GET /compute/v2.1/servers/eea0261c-26b6-4bf6-a59d-6e0d20d32bcb" status: 200 len: 1698 microversion: 2.1 time: 0.153683 Oct 04 22:38:25.309049 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2998/6818] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:38:25 2022] GET /compute/v2.1/servers/eea0261c-26b6-4bf6-a59d-6e0d20d32bcb => generated 1698 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:38:26.333260 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-bd0346b8-c725-408b-81a7-e4ad9398a26f tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:38:26.333892 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-bd0346b8-c725-408b-81a7-e4ad9398a26f tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] [instance: eea0261c-26b6-4bf6-a59d-6e0d20d32bcb] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:38:26.341058 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bd0346b8-c725-408b-81a7-e4ad9398a26f tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:38:26.341561 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bd0346b8-c725-408b-81a7-e4ad9398a26f tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:38:26.342012 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bd0346b8-c725-408b-81a7-e4ad9398a26f tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:38:26.342756 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bd0346b8-c725-408b-81a7-e4ad9398a26f tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:38:26.343233 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bd0346b8-c725-408b-81a7-e4ad9398a26f tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:38:26.343674 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bd0346b8-c725-408b-81a7-e4ad9398a26f tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:38:26.481665 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-bd0346b8-c725-408b-81a7-e4ad9398a26f tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc0ba9f45d04dec89394df46d6096a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2856184afa47f2b4349f7dea9e5569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:38:26.490194 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-bd0346b8-c725-408b-81a7-e4ad9398a26f tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] 10.222.0.43 "GET /compute/v2.1/servers/eea0261c-26b6-4bf6-a59d-6e0d20d32bcb" status: 200 len: 1697 microversion: 2.1 time: 0.160987 Oct 04 22:38:26.490860 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3821/6819] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:38:26 2022] GET /compute/v2.1/servers/eea0261c-26b6-4bf6-a59d-6e0d20d32bcb => generated 1697 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:38:26.733564 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-8e803a25-a593-4e84-becb-87dcf3ba9b62 req-94436418-0009-4c75-a68a-381b1c307743 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eea0261c-26b6-4bf6-a59d-6e0d20d32bcb", "name": "network-vif-unplugged", "status": "completed", "tag": "5235e153-524e-41e1-870f-fb98044623b8"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:38:26.745531 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-8e803a25-a593-4e84-becb-87dcf3ba9b62 req-94436418-0009-4c75-a68a-381b1c307743 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:38:26.746021 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-8e803a25-a593-4e84-becb-87dcf3ba9b62 req-94436418-0009-4c75-a68a-381b1c307743 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:38:26.746487 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-8e803a25-a593-4e84-becb-87dcf3ba9b62 req-94436418-0009-4c75-a68a-381b1c307743 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:38:26.758678 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-8e803a25-a593-4e84-becb-87dcf3ba9b62 req-94436418-0009-4c75-a68a-381b1c307743 service nova] Creating event network-vif-unplugged:5235e153-524e-41e1-870f-fb98044623b8 for instance eea0261c-26b6-4bf6-a59d-6e0d20d32bcb on n-h2-860284-1 Oct 04 22:38:26.764390 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [req-8e803a25-a593-4e84-becb-87dcf3ba9b62 req-94436418-0009-4c75-a68a-381b1c307743 service nova] Instance eea0261c-26b6-4bf6-a59d-6e0d20d32bcb is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860284-1', 'n-h2-860284-1'} {{(pid=134102) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 22:38:26.775807 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-8e803a25-a593-4e84-becb-87dcf3ba9b62 req-94436418-0009-4c75-a68a-381b1c307743 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046164 Oct 04 22:38:26.776429 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 2999/6820] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:38:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:38:27.514851 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-a07fabc4-86f7-4593-9876-bb24d6e7f8aa tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:38:27.515526 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-a07fabc4-86f7-4593-9876-bb24d6e7f8aa tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] [instance: eea0261c-26b6-4bf6-a59d-6e0d20d32bcb] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:38:27.523171 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a07fabc4-86f7-4593-9876-bb24d6e7f8aa tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:38:27.523739 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a07fabc4-86f7-4593-9876-bb24d6e7f8aa tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:38:27.524313 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a07fabc4-86f7-4593-9876-bb24d6e7f8aa tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:38:27.525044 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a07fabc4-86f7-4593-9876-bb24d6e7f8aa tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:38:27.525552 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a07fabc4-86f7-4593-9876-bb24d6e7f8aa tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:38:27.526001 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a07fabc4-86f7-4593-9876-bb24d6e7f8aa tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:38:27.663409 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-a07fabc4-86f7-4593-9876-bb24d6e7f8aa tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc0ba9f45d04dec89394df46d6096a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2856184afa47f2b4349f7dea9e5569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:38:27.671455 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-a07fabc4-86f7-4593-9876-bb24d6e7f8aa tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] 10.222.0.43 "GET /compute/v2.1/servers/eea0261c-26b6-4bf6-a59d-6e0d20d32bcb" status: 200 len: 1697 microversion: 2.1 time: 0.160635 Oct 04 22:38:27.672040 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3822/6821] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:38:27 2022] GET /compute/v2.1/servers/eea0261c-26b6-4bf6-a59d-6e0d20d32bcb => generated 1697 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:38:28.695284 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-a7e7206a-1262-4ffb-9bd7-d2a0110e20af tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:38:28.696021 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-a7e7206a-1262-4ffb-9bd7-d2a0110e20af tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] [instance: eea0261c-26b6-4bf6-a59d-6e0d20d32bcb] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:38:28.702917 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a7e7206a-1262-4ffb-9bd7-d2a0110e20af tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:38:28.703407 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a7e7206a-1262-4ffb-9bd7-d2a0110e20af tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:38:28.703854 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a7e7206a-1262-4ffb-9bd7-d2a0110e20af tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:38:28.704551 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a7e7206a-1262-4ffb-9bd7-d2a0110e20af tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:38:28.705018 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a7e7206a-1262-4ffb-9bd7-d2a0110e20af tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:38:28.705449 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a7e7206a-1262-4ffb-9bd7-d2a0110e20af tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:38:28.819919 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-ae4a93d3-4dae-4334-a865-443fbeaad447 req-4e6c9799-9369-4bb7-b315-26df302600a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eea0261c-26b6-4bf6-a59d-6e0d20d32bcb", "tag": "5235e153-524e-41e1-870f-fb98044623b8"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:38:28.830024 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-ae4a93d3-4dae-4334-a865-443fbeaad447 req-4e6c9799-9369-4bb7-b315-26df302600a4 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:38:28.830947 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-ae4a93d3-4dae-4334-a865-443fbeaad447 req-4e6c9799-9369-4bb7-b315-26df302600a4 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:38:28.831088 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-ae4a93d3-4dae-4334-a865-443fbeaad447 req-4e6c9799-9369-4bb7-b315-26df302600a4 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:38:28.845606 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-ae4a93d3-4dae-4334-a865-443fbeaad447 req-4e6c9799-9369-4bb7-b315-26df302600a4 service nova] Creating event network-changed:5235e153-524e-41e1-870f-fb98044623b8 for instance eea0261c-26b6-4bf6-a59d-6e0d20d32bcb on n-h2-860284-1 Oct 04 22:38:28.846574 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-a7e7206a-1262-4ffb-9bd7-d2a0110e20af tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc0ba9f45d04dec89394df46d6096a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2856184afa47f2b4349f7dea9e5569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:38:28.852150 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [req-ae4a93d3-4dae-4334-a865-443fbeaad447 req-4e6c9799-9369-4bb7-b315-26df302600a4 service nova] Instance eea0261c-26b6-4bf6-a59d-6e0d20d32bcb is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860284-1', 'n-h2-860284-1'} {{(pid=134101) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 22:38:28.855560 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-a7e7206a-1262-4ffb-9bd7-d2a0110e20af tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] 10.222.0.43 "GET /compute/v2.1/servers/eea0261c-26b6-4bf6-a59d-6e0d20d32bcb" status: 200 len: 1695 microversion: 2.1 time: 0.165094 Oct 04 22:38:28.856599 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3000/6822] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:38:28 2022] GET /compute/v2.1/servers/eea0261c-26b6-4bf6-a59d-6e0d20d32bcb => generated 1695 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:38:28.866563 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-ae4a93d3-4dae-4334-a865-443fbeaad447 req-4e6c9799-9369-4bb7-b315-26df302600a4 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050362 Oct 04 22:38:28.867190 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3823/6823] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:38:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:38:29.881803 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-6c823ab3-10bb-4485-9db5-dde414580c4d tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:38:29.882476 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-6c823ab3-10bb-4485-9db5-dde414580c4d tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] [instance: eea0261c-26b6-4bf6-a59d-6e0d20d32bcb] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:38:29.889399 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6c823ab3-10bb-4485-9db5-dde414580c4d tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:38:29.889876 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6c823ab3-10bb-4485-9db5-dde414580c4d tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:38:29.890307 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6c823ab3-10bb-4485-9db5-dde414580c4d tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:38:29.891018 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6c823ab3-10bb-4485-9db5-dde414580c4d tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:38:29.892243 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6c823ab3-10bb-4485-9db5-dde414580c4d tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:38:29.892243 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6c823ab3-10bb-4485-9db5-dde414580c4d tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:38:30.025309 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-6c823ab3-10bb-4485-9db5-dde414580c4d tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc0ba9f45d04dec89394df46d6096a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2856184afa47f2b4349f7dea9e5569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:38:30.033012 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-6c823ab3-10bb-4485-9db5-dde414580c4d tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] 10.222.0.43 "GET /compute/v2.1/servers/eea0261c-26b6-4bf6-a59d-6e0d20d32bcb" status: 200 len: 1695 microversion: 2.1 time: 0.155880 Oct 04 22:38:30.033616 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3001/6824] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:38:29 2022] GET /compute/v2.1/servers/eea0261c-26b6-4bf6-a59d-6e0d20d32bcb => generated 1695 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:38:31.057443 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-55b93b77-8c8f-4c53-ac6c-ebfa585d8f18 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:38:31.058168 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-55b93b77-8c8f-4c53-ac6c-ebfa585d8f18 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] [instance: eea0261c-26b6-4bf6-a59d-6e0d20d32bcb] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:38:31.065493 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-55b93b77-8c8f-4c53-ac6c-ebfa585d8f18 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:38:31.065997 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-55b93b77-8c8f-4c53-ac6c-ebfa585d8f18 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:38:31.067184 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-55b93b77-8c8f-4c53-ac6c-ebfa585d8f18 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:38:31.067744 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-55b93b77-8c8f-4c53-ac6c-ebfa585d8f18 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:38:31.068213 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-55b93b77-8c8f-4c53-ac6c-ebfa585d8f18 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:38:31.068660 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-55b93b77-8c8f-4c53-ac6c-ebfa585d8f18 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:38:31.205455 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-55b93b77-8c8f-4c53-ac6c-ebfa585d8f18 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc0ba9f45d04dec89394df46d6096a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2856184afa47f2b4349f7dea9e5569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:38:31.214009 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-55b93b77-8c8f-4c53-ac6c-ebfa585d8f18 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] 10.222.0.43 "GET /compute/v2.1/servers/eea0261c-26b6-4bf6-a59d-6e0d20d32bcb" status: 200 len: 1692 microversion: 2.1 time: 0.160826 Oct 04 22:38:31.214605 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3824/6825] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:38:31 2022] GET /compute/v2.1/servers/eea0261c-26b6-4bf6-a59d-6e0d20d32bcb => generated 1692 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:38:31.236462 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-d1f45870-0783-4492-a0e0-b58044f5003e tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:38:31.236978 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-d1f45870-0783-4492-a0e0-b58044f5003e tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] [instance: eea0261c-26b6-4bf6-a59d-6e0d20d32bcb] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:38:31.243798 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d1f45870-0783-4492-a0e0-b58044f5003e tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:38:31.244276 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d1f45870-0783-4492-a0e0-b58044f5003e tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:38:31.244714 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d1f45870-0783-4492-a0e0-b58044f5003e tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:38:31.245410 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d1f45870-0783-4492-a0e0-b58044f5003e tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:38:31.245860 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d1f45870-0783-4492-a0e0-b58044f5003e tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:38:31.246282 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d1f45870-0783-4492-a0e0-b58044f5003e tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:38:31.306022 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-d1f45870-0783-4492-a0e0-b58044f5003e tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] 10.222.0.43 "POST /compute/v2.1/servers/eea0261c-26b6-4bf6-a59d-6e0d20d32bcb/action" status: 204 len: 0 microversion: 2.1 time: 0.073373 Oct 04 22:38:31.309818 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3002/6826] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 22:38:31 2022] POST /compute/v2.1/servers/eea0261c-26b6-4bf6-a59d-6e0d20d32bcb/action => generated 0 bytes in 75 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 22:38:31.315261 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-dca18916-8808-4c7e-b677-d8f5382ffae1 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:38:31.316325 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-dca18916-8808-4c7e-b677-d8f5382ffae1 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] [instance: eea0261c-26b6-4bf6-a59d-6e0d20d32bcb] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:38:31.324485 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dca18916-8808-4c7e-b677-d8f5382ffae1 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:38:31.324991 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dca18916-8808-4c7e-b677-d8f5382ffae1 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:38:31.325644 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dca18916-8808-4c7e-b677-d8f5382ffae1 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:38:31.326635 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dca18916-8808-4c7e-b677-d8f5382ffae1 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:38:31.327118 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dca18916-8808-4c7e-b677-d8f5382ffae1 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:38:31.327564 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dca18916-8808-4c7e-b677-d8f5382ffae1 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:38:31.479458 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-dca18916-8808-4c7e-b677-d8f5382ffae1 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc0ba9f45d04dec89394df46d6096a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2856184afa47f2b4349f7dea9e5569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:38:31.487506 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-dca18916-8808-4c7e-b677-d8f5382ffae1 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] 10.222.0.43 "GET /compute/v2.1/servers/eea0261c-26b6-4bf6-a59d-6e0d20d32bcb" status: 200 len: 1692 microversion: 2.1 time: 0.176097 Oct 04 22:38:31.488127 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3825/6827] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:38:31 2022] GET /compute/v2.1/servers/eea0261c-26b6-4bf6-a59d-6e0d20d32bcb => generated 1692 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:38:32.513170 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-63d08622-d4f0-4d48-b8dc-dde41afd0a67 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:38:32.513875 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-63d08622-d4f0-4d48-b8dc-dde41afd0a67 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] [instance: eea0261c-26b6-4bf6-a59d-6e0d20d32bcb] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:38:32.520823 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-63d08622-d4f0-4d48-b8dc-dde41afd0a67 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:38:32.521312 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-63d08622-d4f0-4d48-b8dc-dde41afd0a67 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:38:32.521747 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-63d08622-d4f0-4d48-b8dc-dde41afd0a67 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:38:32.522554 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-63d08622-d4f0-4d48-b8dc-dde41afd0a67 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:38:32.523484 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-63d08622-d4f0-4d48-b8dc-dde41afd0a67 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:38:32.524277 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-63d08622-d4f0-4d48-b8dc-dde41afd0a67 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:38:32.661738 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-63d08622-d4f0-4d48-b8dc-dde41afd0a67 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc0ba9f45d04dec89394df46d6096a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2856184afa47f2b4349f7dea9e5569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:38:32.669817 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-63d08622-d4f0-4d48-b8dc-dde41afd0a67 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] 10.222.0.43 "GET /compute/v2.1/servers/eea0261c-26b6-4bf6-a59d-6e0d20d32bcb" status: 200 len: 1692 microversion: 2.1 time: 0.162706 Oct 04 22:38:32.670425 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3003/6828] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:38:32 2022] GET /compute/v2.1/servers/eea0261c-26b6-4bf6-a59d-6e0d20d32bcb => generated 1692 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:38:32.974942 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-fa6956f7-deca-4d1f-b952-a05bb4c754b2 req-fb3b4e7f-aaee-4afc-aa43-52c0a2235622 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eea0261c-26b6-4bf6-a59d-6e0d20d32bcb", "name": "network-vif-plugged", "status": "completed", "tag": "5235e153-524e-41e1-870f-fb98044623b8"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:38:32.986921 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-fa6956f7-deca-4d1f-b952-a05bb4c754b2 req-fb3b4e7f-aaee-4afc-aa43-52c0a2235622 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:38:32.987541 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-fa6956f7-deca-4d1f-b952-a05bb4c754b2 req-fb3b4e7f-aaee-4afc-aa43-52c0a2235622 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:38:32.988143 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-fa6956f7-deca-4d1f-b952-a05bb4c754b2 req-fb3b4e7f-aaee-4afc-aa43-52c0a2235622 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:38:33.000518 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-fa6956f7-deca-4d1f-b952-a05bb4c754b2 req-fb3b4e7f-aaee-4afc-aa43-52c0a2235622 service nova] Creating event network-vif-plugged:5235e153-524e-41e1-870f-fb98044623b8 for instance eea0261c-26b6-4bf6-a59d-6e0d20d32bcb on n-h2-860284-1 Oct 04 22:38:33.006556 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-fa6956f7-deca-4d1f-b952-a05bb4c754b2 req-fb3b4e7f-aaee-4afc-aa43-52c0a2235622 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036106 Oct 04 22:38:33.007875 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3826/6829] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:38:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:38:33.693225 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-7d55e383-9aff-42ec-b0e3-f35a8270f0b9 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:38:33.693845 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-7d55e383-9aff-42ec-b0e3-f35a8270f0b9 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] [instance: eea0261c-26b6-4bf6-a59d-6e0d20d32bcb] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:38:33.700977 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7d55e383-9aff-42ec-b0e3-f35a8270f0b9 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:38:33.701470 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7d55e383-9aff-42ec-b0e3-f35a8270f0b9 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:38:33.701919 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7d55e383-9aff-42ec-b0e3-f35a8270f0b9 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:38:33.702652 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7d55e383-9aff-42ec-b0e3-f35a8270f0b9 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:38:33.703118 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7d55e383-9aff-42ec-b0e3-f35a8270f0b9 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:38:33.703559 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7d55e383-9aff-42ec-b0e3-f35a8270f0b9 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:38:33.836949 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-7d55e383-9aff-42ec-b0e3-f35a8270f0b9 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc0ba9f45d04dec89394df46d6096a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2856184afa47f2b4349f7dea9e5569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:38:33.844670 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-7d55e383-9aff-42ec-b0e3-f35a8270f0b9 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] 10.222.0.43 "GET /compute/v2.1/servers/eea0261c-26b6-4bf6-a59d-6e0d20d32bcb" status: 200 len: 1684 microversion: 2.1 time: 0.155494 Oct 04 22:38:33.845380 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3004/6830] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:38:33 2022] GET /compute/v2.1/servers/eea0261c-26b6-4bf6-a59d-6e0d20d32bcb => generated 1684 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:39:02.070850 n-d-860284-1 devstack@n-api.service[134101]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Oct 04 22:39:02.072126 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=28 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:39:02.072881 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=76 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:39:02.077949 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-ded44e45-7f06-43bf-86c0-1b1f1f4c0ea7 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:39:02.080273 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-ded44e45-7f06-43bf-86c0-1b1f1f4c0ea7 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] [instance: eea0261c-26b6-4bf6-a59d-6e0d20d32bcb] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:39:02.088638 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ded44e45-7f06-43bf-86c0-1b1f1f4c0ea7 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:39:02.089171 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ded44e45-7f06-43bf-86c0-1b1f1f4c0ea7 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:39:02.089631 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ded44e45-7f06-43bf-86c0-1b1f1f4c0ea7 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:39:02.090346 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ded44e45-7f06-43bf-86c0-1b1f1f4c0ea7 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:39:02.090845 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ded44e45-7f06-43bf-86c0-1b1f1f4c0ea7 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:39:02.091293 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ded44e45-7f06-43bf-86c0-1b1f1f4c0ea7 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:39:02.151410 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-ded44e45-7f06-43bf-86c0-1b1f1f4c0ea7 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] 10.222.0.43 "POST /compute/v2.1/servers/eea0261c-26b6-4bf6-a59d-6e0d20d32bcb/action" status: 200 len: 24575 microversion: 2.1 time: 0.082447 Oct 04 22:39:02.151976 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3827/6831] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 22:39:02 2022] POST /compute/v2.1/servers/eea0261c-26b6-4bf6-a59d-6e0d20d32bcb/action => generated 24575 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 22:39:18.344740 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-0469c7a3-cfff-40b7-84a6-0454bc34d3c0 tempest-TestNetworkAdvancedServerOps-1759506676 tempest-TestNetworkAdvancedServerOps-1759506676-project-admin] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:39:18.345354 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-0469c7a3-cfff-40b7-84a6-0454bc34d3c0 tempest-TestNetworkAdvancedServerOps-1759506676 tempest-TestNetworkAdvancedServerOps-1759506676-project-admin] [instance: eea0261c-26b6-4bf6-a59d-6e0d20d32bcb] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:39:18.348572 n-d-860284-1 devstack@n-api.service[134102]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 22:39:18.348721 n-d-860284-1 devstack@n-api.service[134102]: Tue Oct 4 22:39:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/eea0261c-26b6-4bf6-a59d-6e0d20d32bcb (ip 10.222.0.43) !!! Oct 04 22:39:18.349820 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_api:SELECT=30 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:39:18.350508 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:39:18.358102 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0469c7a3-cfff-40b7-84a6-0454bc34d3c0 tempest-TestNetworkAdvancedServerOps-1759506676 tempest-TestNetworkAdvancedServerOps-1759506676-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:39:18.358614 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0469c7a3-cfff-40b7-84a6-0454bc34d3c0 tempest-TestNetworkAdvancedServerOps-1759506676 tempest-TestNetworkAdvancedServerOps-1759506676-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:39:18.359061 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0469c7a3-cfff-40b7-84a6-0454bc34d3c0 tempest-TestNetworkAdvancedServerOps-1759506676 tempest-TestNetworkAdvancedServerOps-1759506676-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:39:18.359765 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0469c7a3-cfff-40b7-84a6-0454bc34d3c0 tempest-TestNetworkAdvancedServerOps-1759506676 tempest-TestNetworkAdvancedServerOps-1759506676-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:39:18.360224 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0469c7a3-cfff-40b7-84a6-0454bc34d3c0 tempest-TestNetworkAdvancedServerOps-1759506676 tempest-TestNetworkAdvancedServerOps-1759506676-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:39:18.360658 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0469c7a3-cfff-40b7-84a6-0454bc34d3c0 tempest-TestNetworkAdvancedServerOps-1759506676 tempest-TestNetworkAdvancedServerOps-1759506676-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:39:18.545039 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-0469c7a3-cfff-40b7-84a6-0454bc34d3c0 tempest-TestNetworkAdvancedServerOps-1759506676 tempest-TestNetworkAdvancedServerOps-1759506676-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/eea0261c-26b6-4bf6-a59d-6e0d20d32bcb" status: 200 len: 1835 microversion: 2.1 time: 0.204326 Oct 04 22:39:18.545616 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3005/6832] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:39:18 2022] GET /compute/v2.1/servers/eea0261c-26b6-4bf6-a59d-6e0d20d32bcb => generated 1835 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:39:19.388207 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-a6b23a0b-a835-4fa6-9681-8656fd18f6a4 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:39:19.389125 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-a6b23a0b-a835-4fa6-9681-8656fd18f6a4 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] [instance: eea0261c-26b6-4bf6-a59d-6e0d20d32bcb] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:39:19.389229 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-60528a7d-2000-47bd-a7b5-526e892a4f33 req-0d1a33fa-af73-4432-9711-942861227313 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eea0261c-26b6-4bf6-a59d-6e0d20d32bcb", "tag": "5235e153-524e-41e1-870f-fb98044623b8"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:39:19.393288 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=2 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:39:19.394762 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=4 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:39:19.401188 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-60528a7d-2000-47bd-a7b5-526e892a4f33 req-0d1a33fa-af73-4432-9711-942861227313 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:39:19.401711 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-60528a7d-2000-47bd-a7b5-526e892a4f33 req-0d1a33fa-af73-4432-9711-942861227313 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:39:19.401829 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a6b23a0b-a835-4fa6-9681-8656fd18f6a4 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:39:19.402278 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-60528a7d-2000-47bd-a7b5-526e892a4f33 req-0d1a33fa-af73-4432-9711-942861227313 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:39:19.402509 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a6b23a0b-a835-4fa6-9681-8656fd18f6a4 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:39:19.402918 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a6b23a0b-a835-4fa6-9681-8656fd18f6a4 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:39:19.403641 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a6b23a0b-a835-4fa6-9681-8656fd18f6a4 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:39:19.404116 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a6b23a0b-a835-4fa6-9681-8656fd18f6a4 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:39:19.404587 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a6b23a0b-a835-4fa6-9681-8656fd18f6a4 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:39:19.414057 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-60528a7d-2000-47bd-a7b5-526e892a4f33 req-0d1a33fa-af73-4432-9711-942861227313 service nova] Creating event network-changed:5235e153-524e-41e1-870f-fb98044623b8 for instance eea0261c-26b6-4bf6-a59d-6e0d20d32bcb on n-h2-860284-1 Oct 04 22:39:19.420557 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-60528a7d-2000-47bd-a7b5-526e892a4f33 req-0d1a33fa-af73-4432-9711-942861227313 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035225 Oct 04 22:39:19.421399 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3006/6833] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:39:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:39:19.435025 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-a6b23a0b-a835-4fa6-9681-8656fd18f6a4 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] [instance: eea0261c-26b6-4bf6-a59d-6e0d20d32bcb] Going to try to terminate instance {{(pid=134101) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 22:39:19.535504 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-a6b23a0b-a835-4fa6-9681-8656fd18f6a4 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] 10.222.0.43 "DELETE /compute/v2.1/servers/eea0261c-26b6-4bf6-a59d-6e0d20d32bcb" status: 204 len: 0 microversion: 2.1 time: 0.151141 Oct 04 22:39:19.537086 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3828/6834] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 22:39:19 2022] DELETE /compute/v2.1/servers/eea0261c-26b6-4bf6-a59d-6e0d20d32bcb => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 22:39:19.546959 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-ae75a00c-c3c9-4e7e-a976-a18c4cdbb70c tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:39:19.547666 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-ae75a00c-c3c9-4e7e-a976-a18c4cdbb70c tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] [instance: eea0261c-26b6-4bf6-a59d-6e0d20d32bcb] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:39:19.555889 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ae75a00c-c3c9-4e7e-a976-a18c4cdbb70c tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:39:19.556388 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ae75a00c-c3c9-4e7e-a976-a18c4cdbb70c tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:39:19.556826 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ae75a00c-c3c9-4e7e-a976-a18c4cdbb70c tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:39:19.557527 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ae75a00c-c3c9-4e7e-a976-a18c4cdbb70c tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:39:19.557983 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ae75a00c-c3c9-4e7e-a976-a18c4cdbb70c tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:39:19.558428 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ae75a00c-c3c9-4e7e-a976-a18c4cdbb70c tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:39:19.716289 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-ae75a00c-c3c9-4e7e-a976-a18c4cdbb70c tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc0ba9f45d04dec89394df46d6096a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2856184afa47f2b4349f7dea9e5569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:39:19.725299 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-ae75a00c-c3c9-4e7e-a976-a18c4cdbb70c tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] 10.222.0.43 "GET /compute/v2.1/servers/eea0261c-26b6-4bf6-a59d-6e0d20d32bcb" status: 200 len: 1690 microversion: 2.1 time: 0.183388 Oct 04 22:39:19.725928 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3007/6835] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:39:19 2022] GET /compute/v2.1/servers/eea0261c-26b6-4bf6-a59d-6e0d20d32bcb => generated 1690 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:39:20.749410 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-54984a74-337b-4fbc-addc-99856cde36d7 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:39:20.750123 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-54984a74-337b-4fbc-addc-99856cde36d7 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] [instance: eea0261c-26b6-4bf6-a59d-6e0d20d32bcb] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:39:20.758290 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-54984a74-337b-4fbc-addc-99856cde36d7 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:39:20.758827 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-54984a74-337b-4fbc-addc-99856cde36d7 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:39:20.759286 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-54984a74-337b-4fbc-addc-99856cde36d7 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:39:20.759998 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-54984a74-337b-4fbc-addc-99856cde36d7 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:39:20.760470 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-54984a74-337b-4fbc-addc-99856cde36d7 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:39:20.760917 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-54984a74-337b-4fbc-addc-99856cde36d7 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:39:20.903314 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-54984a74-337b-4fbc-addc-99856cde36d7 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc0ba9f45d04dec89394df46d6096a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2856184afa47f2b4349f7dea9e5569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:39:20.912746 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-54984a74-337b-4fbc-addc-99856cde36d7 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] 10.222.0.43 "GET /compute/v2.1/servers/eea0261c-26b6-4bf6-a59d-6e0d20d32bcb" status: 200 len: 1690 microversion: 2.1 time: 0.167632 Oct 04 22:39:20.920645 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3829/6836] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:39:20 2022] GET /compute/v2.1/servers/eea0261c-26b6-4bf6-a59d-6e0d20d32bcb => generated 1690 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:39:21.486156 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-5ad30503-ed48-4f89-9b56-aa879a893ea5 req-5770f84d-782f-4f5c-988a-3d2edabb28c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eea0261c-26b6-4bf6-a59d-6e0d20d32bcb", "name": "network-vif-deleted", "tag": "5235e153-524e-41e1-870f-fb98044623b8"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:39:21.496427 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-5ad30503-ed48-4f89-9b56-aa879a893ea5 req-5770f84d-782f-4f5c-988a-3d2edabb28c2 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:39:21.496905 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-5ad30503-ed48-4f89-9b56-aa879a893ea5 req-5770f84d-782f-4f5c-988a-3d2edabb28c2 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:39:21.497338 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-5ad30503-ed48-4f89-9b56-aa879a893ea5 req-5770f84d-782f-4f5c-988a-3d2edabb28c2 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:39:21.512218 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-5ad30503-ed48-4f89-9b56-aa879a893ea5 req-5770f84d-782f-4f5c-988a-3d2edabb28c2 service nova] Creating event network-vif-deleted:5235e153-524e-41e1-870f-fb98044623b8 for instance eea0261c-26b6-4bf6-a59d-6e0d20d32bcb on n-h2-860284-1 Oct 04 22:39:21.517346 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-5ad30503-ed48-4f89-9b56-aa879a893ea5 req-5770f84d-782f-4f5c-988a-3d2edabb28c2 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034807 Oct 04 22:39:21.517960 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3008/6837] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:39:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:39:21.936034 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-55da96d9-f11d-4eba-9c32-dc2b5bda93cc tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:39:21.936672 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-55da96d9-f11d-4eba-9c32-dc2b5bda93cc tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] [instance: eea0261c-26b6-4bf6-a59d-6e0d20d32bcb] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:39:21.944444 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-55da96d9-f11d-4eba-9c32-dc2b5bda93cc tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:39:21.944974 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-55da96d9-f11d-4eba-9c32-dc2b5bda93cc tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:39:21.945440 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-55da96d9-f11d-4eba-9c32-dc2b5bda93cc tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:39:21.946156 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-55da96d9-f11d-4eba-9c32-dc2b5bda93cc tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:39:21.946660 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-55da96d9-f11d-4eba-9c32-dc2b5bda93cc tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:39:21.947107 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-55da96d9-f11d-4eba-9c32-dc2b5bda93cc tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:39:21.978703 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-55da96d9-f11d-4eba-9c32-dc2b5bda93cc tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:39:21.979197 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-55da96d9-f11d-4eba-9c32-dc2b5bda93cc tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:39:21.979652 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-55da96d9-f11d-4eba-9c32-dc2b5bda93cc tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:39:21.980127 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.objects.instance [None req-55da96d9-f11d-4eba-9c32-dc2b5bda93cc tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lazy-loading 'fault' on Instance uuid eea0261c-26b6-4bf6-a59d-6e0d20d32bcb {{(pid=134101) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 22:39:22.023481 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-55da96d9-f11d-4eba-9c32-dc2b5bda93cc tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc0ba9f45d04dec89394df46d6096a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2856184afa47f2b4349f7dea9e5569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:39:22.031213 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-55da96d9-f11d-4eba-9c32-dc2b5bda93cc tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] 10.222.0.43 "GET /compute/v2.1/servers/eea0261c-26b6-4bf6-a59d-6e0d20d32bcb" status: 200 len: 1357 microversion: 2.1 time: 0.099240 Oct 04 22:39:22.031788 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3830/6838] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:39:21 2022] GET /compute/v2.1/servers/eea0261c-26b6-4bf6-a59d-6e0d20d32bcb => generated 1357 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:39:23.057532 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-95c82b5a-4b8f-4a91-9f5a-c2fff0580099 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:39:23.058243 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-95c82b5a-4b8f-4a91-9f5a-c2fff0580099 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] [instance: eea0261c-26b6-4bf6-a59d-6e0d20d32bcb] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:39:23.064473 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-95c82b5a-4b8f-4a91-9f5a-c2fff0580099 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:39:23.065524 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-95c82b5a-4b8f-4a91-9f5a-c2fff0580099 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:39:23.066027 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-95c82b5a-4b8f-4a91-9f5a-c2fff0580099 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:39:23.066760 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-95c82b5a-4b8f-4a91-9f5a-c2fff0580099 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:39:23.067223 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-95c82b5a-4b8f-4a91-9f5a-c2fff0580099 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:39:23.067666 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-95c82b5a-4b8f-4a91-9f5a-c2fff0580099 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:39:23.081580 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-95c82b5a-4b8f-4a91-9f5a-c2fff0580099 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] HTTP exception thrown: Instance eea0261c-26b6-4bf6-a59d-6e0d20d32bcb could not be found. Oct 04 22:39:23.083316 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-95c82b5a-4b8f-4a91-9f5a-c2fff0580099 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Request method failure captured: Oct 04 22:39:23.083316 n-d-860284-1 devstack@n-api.service[134102]: request: GET /compute/v2.1/servers/eea0261c-26b6-4bf6-a59d-6e0d20d32bcb HTTP/1.1 Oct 04 22:39:23.083316 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 22:39:23.083316 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 22:39:23.083316 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 22:39:23.083316 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 22:39:23.083316 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 22:39:23.083316 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 22:39:23.083316 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 22:39:23.083316 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 22:39:23.083316 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPLV0i4fTyng2qLmqpOZDonbjmzoxCV_51fHF-2sehfrgMV9QVuGfN-Zf-uieedzXZTWMfP9hC44tva1SBwtRF8VLus6BFLrvLfEQUnNKLdCLmtRz5RQ2K95IuirNrCK0fpkR4wYvfI0Vw9CX7gwLNdKW8QNt5h37SFpMjtwukn05Yn0 Oct 04 22:39:23.083316 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 22:39:23.083316 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 22:39:23.083316 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 22:39:23.083316 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 22:39:23.083316 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 22:39:23.083316 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 22:39:23.083316 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: fd2856184afa47f2b4349f7dea9e5569 Oct 04 22:39:23.083316 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1049323607 Oct 04 22:39:23.083316 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 22:39:23.083316 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 22:39:23.083316 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/fd2856184afa47f2b4349f7dea9e5569"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_fd2856184afa47f2b4349f7dea9e5569", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/fd2856184afa47f2b4349f7dea9e5569"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/fd2856184afa47f2b4349f7dea9e5569"}]}] Oct 04 22:39:23.083316 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1049323607 Oct 04 22:39:23.083316 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: fd2856184afa47f2b4349f7dea9e5569 Oct 04 22:39:23.083316 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1049323607 Oct 04 22:39:23.083316 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-TestNetworkAdvancedServerOps-1049323607-project Oct 04 22:39:23.083316 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 22:39:23.083316 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 22:39:23.083316 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: bbc0ba9f45d04dec89394df46d6096a3 Oct 04 22:39:23.083316 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1049323607-project Oct 04 22:39:23.083316 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 22:39:23.083316 n-d-860284-1 devstack@n-api.service[134102]: exception: Instance eea0261c-26b6-4bf6-a59d-6e0d20d32bcb could not be found. Oct 04 22:39:23.083316 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': 'eea0261c-26b6-4bf6-a59d-6e0d20d32bcb'} Oct 04 22:39:23.083316 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:39:23.083316 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:39:23.083316 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:39:23.083316 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:39:23.083316 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:39:23.083316 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:39:23.083316 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:39:23.083316 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:39:23.083316 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:39:23.083316 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:39:23.083316 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eea0261c-26b6-4bf6-a59d-6e0d20d32bcb could not be found. Oct 04 22:39:23.083316 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:39:23.083316 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:39:23.083316 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:39:23.083316 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:39:23.083316 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:39:23.083316 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:39:23.083316 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:39:23.083316 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:39:23.083316 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:39:23.083316 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:39:23.083316 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:39:23.083316 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:39:23.083316 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:39:23.083316 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:39:23.083316 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:39:23.083316 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:39:23.083316 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eea0261c-26b6-4bf6-a59d-6e0d20d32bcb could not be found. Oct 04 22:39:23.083316 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:39:23.083316 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:39:23.087713 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:39:23.087713 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:39:23.087713 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:39:23.087713 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:39:23.087713 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:39:23.087713 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:39:23.087713 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eea0261c-26b6-4bf6-a59d-6e0d20d32bcb could not be found. Oct 04 22:39:23.087713 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:39:23.087713 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-95c82b5a-4b8f-4a91-9f5a-c2fff0580099 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Returning 404 to user: Instance eea0261c-26b6-4bf6-a59d-6e0d20d32bcb could not be found. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:39:23.087713 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-95c82b5a-4b8f-4a91-9f5a-c2fff0580099 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] 10.222.0.43 "GET /compute/v2.1/servers/eea0261c-26b6-4bf6-a59d-6e0d20d32bcb" status: 404 len: 111 microversion: 2.1 time: 0.032300 Oct 04 22:39:23.087713 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3009/6839] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:39:23 2022] GET /compute/v2.1/servers/eea0261c-26b6-4bf6-a59d-6e0d20d32bcb => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:39:26.375616 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-cdfe06e9-c524-4d1c-b7d1-8a6b9fb44bdb tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Calling method '.version_select at 0x7fbb2c0eef70>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:39:26.402347 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-cdfe06e9-c524-4d1c-b7d1-8a6b9fb44bdb tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1620777126" status: 202 len: 0 microversion: 2.1 time: 0.030971 Oct 04 22:39:26.403112 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3831/6840] 10.222.0.43 () {58 vars in 1284 bytes} [Tue Oct 4 22:39:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1620777126 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 22:39:26.434812 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-e5fd78de-1a18-4528-86af-9da562f06846 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Action: 'create', calling method: .version_select at 0x7fbb2f5661f0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-646888289", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHzfoW/r9/AEfAQXm9+U4HPUFrnd2m3YGLgDtSXH6Iy4JIMgefmJQAXjQ0HIQ4qtx6dEoZ+s04INDnx6ksRLFkO/XXlXUr30NbhYqJrxA1wMYYOP5t2PyJPOn+XaV9FEcA=="}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:39:26.451598 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-e5fd78de-1a18-4528-86af-9da562f06846 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Getting quotas for project fd2856184afa47f2b4349f7dea9e5569. Resources: {'key_pairs'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:39:26.458520 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-e5fd78de-1a18-4528-86af-9da562f06846 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Getting quotas for user bbc0ba9f45d04dec89394df46d6096a3 and project fd2856184afa47f2b4349f7dea9e5569. Resources: {'key_pairs'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:39:26.486351 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-e5fd78de-1a18-4528-86af-9da562f06846 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.057456 Oct 04 22:39:26.487057 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3010/6841] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Oct 4 22:39:26 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:39:32.235918 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:39:32.241352 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-b2b04f78-1a36-462b-a4c3-3617b5d3cf7f tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-2125154407", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452", "networks": [{"uuid": "fc74ff43-d276-4dd0-b6ff-c773763a99e4"}], "key_name": "tempest-TestNetworkAdvancedServerOps-646888289", "security_groups": [{"name": "tempest-secgroup-smoke-744407984"}]}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:39:32.375494 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.network.neutron [None req-b2b04f78-1a36-462b-a4c3-3617b5d3cf7f tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] validate_networks() for [('fc74ff43-d276-4dd0-b6ff-c773763a99e4', None, None, None, None, None)] {{(pid=134101) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 22:39:32.833130 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-b2b04f78-1a36-462b-a4c3-3617b5d3cf7f tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Flavor limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 22:39:32.833796 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-b2b04f78-1a36-462b-a4c3-3617b5d3cf7f tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Image limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 22:39:32.834434 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-b2b04f78-1a36-462b-a4c3-3617b5d3cf7f tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Flavor pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 22:39:32.835211 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-b2b04f78-1a36-462b-a4c3-3617b5d3cf7f tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Image pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 22:39:32.835652 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-b2b04f78-1a36-462b-a4c3-3617b5d3cf7f tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 22:39:32.847469 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b2b04f78-1a36-462b-a4c3-3617b5d3cf7f tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:39:32.847989 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b2b04f78-1a36-462b-a4c3-3617b5d3cf7f tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:39:32.848448 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b2b04f78-1a36-462b-a4c3-3617b5d3cf7f tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:39:32.849354 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b2b04f78-1a36-462b-a4c3-3617b5d3cf7f tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:39:32.849861 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b2b04f78-1a36-462b-a4c3-3617b5d3cf7f tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:39:32.850310 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b2b04f78-1a36-462b-a4c3-3617b5d3cf7f tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:39:32.879237 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-b2b04f78-1a36-462b-a4c3-3617b5d3cf7f tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Getting quotas for project fd2856184afa47f2b4349f7dea9e5569. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:39:32.885419 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-b2b04f78-1a36-462b-a4c3-3617b5d3cf7f tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Getting quotas for user bbc0ba9f45d04dec89394df46d6096a3 and project fd2856184afa47f2b4349f7dea9e5569. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:39:32.902497 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-b2b04f78-1a36-462b-a4c3-3617b5d3cf7f tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Going to run 1 instances... {{(pid=134101) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 22:39:32.904908 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-b2b04f78-1a36-462b-a4c3-3617b5d3cf7f tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] [instance: c35a32ea-7024-4981-a41c-e3570b8fee57] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='58548514-5dac-426c-81f5-19e3fba33e23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134101) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 22:39:32.976400 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-b2b04f78-1a36-462b-a4c3-3617b5d3cf7f tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.742156 Oct 04 22:39:32.988749 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3832/6842] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 22:39:32 2022] POST /compute/v2.1/servers => generated 405 bytes in 749 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 22:39:32.996126 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-d8f87757-1ab7-4b84-8e70-79026d753017 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:39:32.996794 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-d8f87757-1ab7-4b84-8e70-79026d753017 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] [instance: c35a32ea-7024-4981-a41c-e3570b8fee57] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:39:33.072850 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=18 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:39:33.105445 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-d8f87757-1ab7-4b84-8e70-79026d753017 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc0ba9f45d04dec89394df46d6096a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2856184afa47f2b4349f7dea9e5569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:39:33.114155 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-d8f87757-1ab7-4b84-8e70-79026d753017 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] 10.222.0.43 "GET /compute/v2.1/servers/c35a32ea-7024-4981-a41c-e3570b8fee57" status: 200 len: 1266 microversion: 2.1 time: 0.123826 Oct 04 22:39:33.114798 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3011/6843] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:39:32 2022] GET /compute/v2.1/servers/c35a32ea-7024-4981-a41c-e3570b8fee57 => generated 1266 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:39:34.137576 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-6a6938c1-5cb5-45c5-aa87-dcf9e753953a tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:39:34.138428 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-6a6938c1-5cb5-45c5-aa87-dcf9e753953a tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] [instance: c35a32ea-7024-4981-a41c-e3570b8fee57] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:39:34.199426 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-6a6938c1-5cb5-45c5-aa87-dcf9e753953a tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc0ba9f45d04dec89394df46d6096a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2856184afa47f2b4349f7dea9e5569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:39:34.210904 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-6a6938c1-5cb5-45c5-aa87-dcf9e753953a tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] 10.222.0.43 "GET /compute/v2.1/servers/c35a32ea-7024-4981-a41c-e3570b8fee57" status: 200 len: 1266 microversion: 2.1 time: 0.077284 Oct 04 22:39:34.217899 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3833/6844] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:39:34 2022] GET /compute/v2.1/servers/c35a32ea-7024-4981-a41c-e3570b8fee57 => generated 1266 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:39:35.233992 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-7290f599-0413-4d90-97a2-cbebc7213722 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:39:35.236099 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-7290f599-0413-4d90-97a2-cbebc7213722 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] [instance: c35a32ea-7024-4981-a41c-e3570b8fee57] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:39:35.247985 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7290f599-0413-4d90-97a2-cbebc7213722 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:39:35.248697 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7290f599-0413-4d90-97a2-cbebc7213722 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:39:35.249154 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7290f599-0413-4d90-97a2-cbebc7213722 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:39:35.249965 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7290f599-0413-4d90-97a2-cbebc7213722 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:39:35.250546 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7290f599-0413-4d90-97a2-cbebc7213722 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:39:35.250803 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7290f599-0413-4d90-97a2-cbebc7213722 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:39:35.363695 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-7290f599-0413-4d90-97a2-cbebc7213722 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc0ba9f45d04dec89394df46d6096a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2856184afa47f2b4349f7dea9e5569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:39:35.377164 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-7290f599-0413-4d90-97a2-cbebc7213722 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] 10.222.0.43 "GET /compute/v2.1/servers/c35a32ea-7024-4981-a41c-e3570b8fee57" status: 200 len: 1326 microversion: 2.1 time: 0.147683 Oct 04 22:39:35.378151 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3012/6845] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:39:35 2022] GET /compute/v2.1/servers/c35a32ea-7024-4981-a41c-e3570b8fee57 => generated 1326 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:39:36.401937 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-cd8dc697-707f-4947-b5df-f7473a2b26cb tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:39:36.402605 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-cd8dc697-707f-4947-b5df-f7473a2b26cb tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] [instance: c35a32ea-7024-4981-a41c-e3570b8fee57] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:39:36.410116 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cd8dc697-707f-4947-b5df-f7473a2b26cb tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:39:36.410935 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cd8dc697-707f-4947-b5df-f7473a2b26cb tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:39:36.411401 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cd8dc697-707f-4947-b5df-f7473a2b26cb tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:39:36.412134 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cd8dc697-707f-4947-b5df-f7473a2b26cb tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:39:36.412610 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cd8dc697-707f-4947-b5df-f7473a2b26cb tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:39:36.413061 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cd8dc697-707f-4947-b5df-f7473a2b26cb tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:39:36.558467 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-cd8dc697-707f-4947-b5df-f7473a2b26cb tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc0ba9f45d04dec89394df46d6096a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2856184afa47f2b4349f7dea9e5569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:39:36.567003 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-cd8dc697-707f-4947-b5df-f7473a2b26cb tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] 10.222.0.43 "GET /compute/v2.1/servers/c35a32ea-7024-4981-a41c-e3570b8fee57" status: 200 len: 1391 microversion: 2.1 time: 0.169667 Oct 04 22:39:36.567592 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3834/6846] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:39:36 2022] GET /compute/v2.1/servers/c35a32ea-7024-4981-a41c-e3570b8fee57 => generated 1391 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:39:36.742982 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-40cec367-4123-40bc-b482-8951c51186f8 req-94282690-d682-481f-98df-9eb5875ecbef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c35a32ea-7024-4981-a41c-e3570b8fee57", "tag": "2becf889-435b-4e3b-841f-ab2ee960966d"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:39:36.758049 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-40cec367-4123-40bc-b482-8951c51186f8 req-94282690-d682-481f-98df-9eb5875ecbef service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:39:36.758582 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-40cec367-4123-40bc-b482-8951c51186f8 req-94282690-d682-481f-98df-9eb5875ecbef service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:39:36.759074 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-40cec367-4123-40bc-b482-8951c51186f8 req-94282690-d682-481f-98df-9eb5875ecbef service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:39:36.773527 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-40cec367-4123-40bc-b482-8951c51186f8 req-94282690-d682-481f-98df-9eb5875ecbef service nova] Creating event network-changed:2becf889-435b-4e3b-841f-ab2ee960966d for instance c35a32ea-7024-4981-a41c-e3570b8fee57 on n-h1-860284-1 Oct 04 22:39:36.778884 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-40cec367-4123-40bc-b482-8951c51186f8 req-94282690-d682-481f-98df-9eb5875ecbef service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040430 Oct 04 22:39:36.779894 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3013/6847] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:39:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:39:37.590725 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-f669cc44-d710-43aa-9ef3-24f47065a5a4 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:39:37.591360 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-f669cc44-d710-43aa-9ef3-24f47065a5a4 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] [instance: c35a32ea-7024-4981-a41c-e3570b8fee57] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:39:37.599256 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f669cc44-d710-43aa-9ef3-24f47065a5a4 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:39:37.599764 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f669cc44-d710-43aa-9ef3-24f47065a5a4 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:39:37.600224 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f669cc44-d710-43aa-9ef3-24f47065a5a4 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:39:37.600945 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f669cc44-d710-43aa-9ef3-24f47065a5a4 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:39:37.601423 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f669cc44-d710-43aa-9ef3-24f47065a5a4 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:39:37.601870 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f669cc44-d710-43aa-9ef3-24f47065a5a4 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:39:37.731866 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-f669cc44-d710-43aa-9ef3-24f47065a5a4 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc0ba9f45d04dec89394df46d6096a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2856184afa47f2b4349f7dea9e5569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:39:37.740909 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-f669cc44-d710-43aa-9ef3-24f47065a5a4 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] 10.222.0.43 "GET /compute/v2.1/servers/c35a32ea-7024-4981-a41c-e3570b8fee57" status: 200 len: 1391 microversion: 2.1 time: 0.154140 Oct 04 22:39:37.741499 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3835/6848] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:39:37 2022] GET /compute/v2.1/servers/c35a32ea-7024-4981-a41c-e3570b8fee57 => generated 1391 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:39:38.764610 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-6d03fb07-9d72-460f-8682-fea09442664b tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:39:38.765323 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-6d03fb07-9d72-460f-8682-fea09442664b tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] [instance: c35a32ea-7024-4981-a41c-e3570b8fee57] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:39:38.773125 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6d03fb07-9d72-460f-8682-fea09442664b tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:39:38.773631 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6d03fb07-9d72-460f-8682-fea09442664b tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:39:38.774100 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6d03fb07-9d72-460f-8682-fea09442664b tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:39:38.774859 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6d03fb07-9d72-460f-8682-fea09442664b tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:39:38.775326 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6d03fb07-9d72-460f-8682-fea09442664b tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:39:38.775765 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6d03fb07-9d72-460f-8682-fea09442664b tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:39:38.910138 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-6d03fb07-9d72-460f-8682-fea09442664b tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc0ba9f45d04dec89394df46d6096a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2856184afa47f2b4349f7dea9e5569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:39:38.917974 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-6d03fb07-9d72-460f-8682-fea09442664b tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] 10.222.0.43 "GET /compute/v2.1/servers/c35a32ea-7024-4981-a41c-e3570b8fee57" status: 200 len: 1391 microversion: 2.1 time: 0.157732 Oct 04 22:39:38.918594 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3014/6849] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:39:38 2022] GET /compute/v2.1/servers/c35a32ea-7024-4981-a41c-e3570b8fee57 => generated 1391 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:39:39.941666 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-0cc659b2-07db-436b-90bc-01549ad2b6a9 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:39:39.942298 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-0cc659b2-07db-436b-90bc-01549ad2b6a9 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] [instance: c35a32ea-7024-4981-a41c-e3570b8fee57] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:39:39.949161 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0cc659b2-07db-436b-90bc-01549ad2b6a9 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:39:39.949662 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0cc659b2-07db-436b-90bc-01549ad2b6a9 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:39:39.950115 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0cc659b2-07db-436b-90bc-01549ad2b6a9 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:39:39.950853 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0cc659b2-07db-436b-90bc-01549ad2b6a9 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:39:39.951321 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0cc659b2-07db-436b-90bc-01549ad2b6a9 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:39:39.951768 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0cc659b2-07db-436b-90bc-01549ad2b6a9 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:39:40.086989 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-0cc659b2-07db-436b-90bc-01549ad2b6a9 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc0ba9f45d04dec89394df46d6096a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2856184afa47f2b4349f7dea9e5569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:39:40.094806 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-0cc659b2-07db-436b-90bc-01549ad2b6a9 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] 10.222.0.43 "GET /compute/v2.1/servers/c35a32ea-7024-4981-a41c-e3570b8fee57" status: 200 len: 1391 microversion: 2.1 time: 0.157812 Oct 04 22:39:40.095390 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3836/6850] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:39:39 2022] GET /compute/v2.1/servers/c35a32ea-7024-4981-a41c-e3570b8fee57 => generated 1391 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:39:41.118105 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-2dea5896-3172-40b4-a126-e0153733bfab tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:39:41.118847 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-2dea5896-3172-40b4-a126-e0153733bfab tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] [instance: c35a32ea-7024-4981-a41c-e3570b8fee57] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:39:41.126062 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2dea5896-3172-40b4-a126-e0153733bfab tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:39:41.126594 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2dea5896-3172-40b4-a126-e0153733bfab tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:39:41.127814 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2dea5896-3172-40b4-a126-e0153733bfab tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:39:41.128933 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2dea5896-3172-40b4-a126-e0153733bfab tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:39:41.129434 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2dea5896-3172-40b4-a126-e0153733bfab tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:39:41.129868 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2dea5896-3172-40b4-a126-e0153733bfab tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:39:41.263052 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-2dea5896-3172-40b4-a126-e0153733bfab tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc0ba9f45d04dec89394df46d6096a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2856184afa47f2b4349f7dea9e5569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:39:41.271248 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-2dea5896-3172-40b4-a126-e0153733bfab tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] 10.222.0.43 "GET /compute/v2.1/servers/c35a32ea-7024-4981-a41c-e3570b8fee57" status: 200 len: 1391 microversion: 2.1 time: 0.157152 Oct 04 22:39:41.271836 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3015/6851] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:39:41 2022] GET /compute/v2.1/servers/c35a32ea-7024-4981-a41c-e3570b8fee57 => generated 1391 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:39:42.293086 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-eabdf684-28f5-4060-bef3-0aa22aefe62a tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:39:42.293736 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-eabdf684-28f5-4060-bef3-0aa22aefe62a tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] [instance: c35a32ea-7024-4981-a41c-e3570b8fee57] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:39:42.300692 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-eabdf684-28f5-4060-bef3-0aa22aefe62a tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:39:42.301183 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-eabdf684-28f5-4060-bef3-0aa22aefe62a tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:39:42.301629 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-eabdf684-28f5-4060-bef3-0aa22aefe62a tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:39:42.302328 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-eabdf684-28f5-4060-bef3-0aa22aefe62a tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:39:42.302822 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-eabdf684-28f5-4060-bef3-0aa22aefe62a tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:39:42.303264 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-eabdf684-28f5-4060-bef3-0aa22aefe62a tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:39:42.436338 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-eabdf684-28f5-4060-bef3-0aa22aefe62a tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc0ba9f45d04dec89394df46d6096a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2856184afa47f2b4349f7dea9e5569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:39:42.444979 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-eabdf684-28f5-4060-bef3-0aa22aefe62a tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] 10.222.0.43 "GET /compute/v2.1/servers/c35a32ea-7024-4981-a41c-e3570b8fee57" status: 200 len: 1391 microversion: 2.1 time: 0.155788 Oct 04 22:39:42.445573 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3837/6852] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:39:42 2022] GET /compute/v2.1/servers/c35a32ea-7024-4981-a41c-e3570b8fee57 => generated 1391 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:39:43.062045 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-81cdf282-63a3-48b0-bbc8-77dfba166360 req-74b94b5a-eaf8-41bc-9ee0-6b4f572ea2af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c35a32ea-7024-4981-a41c-e3570b8fee57", "name": "network-vif-plugged", "status": "completed", "tag": "2becf889-435b-4e3b-841f-ab2ee960966d"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:39:43.072819 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-81cdf282-63a3-48b0-bbc8-77dfba166360 req-74b94b5a-eaf8-41bc-9ee0-6b4f572ea2af service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:39:43.073307 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-81cdf282-63a3-48b0-bbc8-77dfba166360 req-74b94b5a-eaf8-41bc-9ee0-6b4f572ea2af service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:39:43.073742 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-81cdf282-63a3-48b0-bbc8-77dfba166360 req-74b94b5a-eaf8-41bc-9ee0-6b4f572ea2af service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:39:43.085359 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-81cdf282-63a3-48b0-bbc8-77dfba166360 req-74b94b5a-eaf8-41bc-9ee0-6b4f572ea2af service nova] Creating event network-vif-plugged:2becf889-435b-4e3b-841f-ab2ee960966d for instance c35a32ea-7024-4981-a41c-e3570b8fee57 on n-h1-860284-1 Oct 04 22:39:43.090257 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-81cdf282-63a3-48b0-bbc8-77dfba166360 req-74b94b5a-eaf8-41bc-9ee0-6b4f572ea2af service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032003 Oct 04 22:39:43.090890 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3016/6853] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:39:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:39:43.468566 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-3f6138a2-2646-4679-ba56-ea996926450d tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:39:43.469144 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-3f6138a2-2646-4679-ba56-ea996926450d tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] [instance: c35a32ea-7024-4981-a41c-e3570b8fee57] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:39:43.471252 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=2 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:39:43.477908 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3f6138a2-2646-4679-ba56-ea996926450d tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:39:43.478432 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3f6138a2-2646-4679-ba56-ea996926450d tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:39:43.478891 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3f6138a2-2646-4679-ba56-ea996926450d tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:39:43.479599 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3f6138a2-2646-4679-ba56-ea996926450d tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:39:43.480073 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3f6138a2-2646-4679-ba56-ea996926450d tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:39:43.480517 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3f6138a2-2646-4679-ba56-ea996926450d tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:39:43.622204 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-3f6138a2-2646-4679-ba56-ea996926450d tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc0ba9f45d04dec89394df46d6096a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2856184afa47f2b4349f7dea9e5569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:39:43.630013 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-3f6138a2-2646-4679-ba56-ea996926450d tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] 10.222.0.43 "GET /compute/v2.1/servers/c35a32ea-7024-4981-a41c-e3570b8fee57" status: 200 len: 1391 microversion: 2.1 time: 0.165540 Oct 04 22:39:43.630627 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3838/6854] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:39:43 2022] GET /compute/v2.1/servers/c35a32ea-7024-4981-a41c-e3570b8fee57 => generated 1391 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:39:44.650338 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell0:SELECT=6 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:39:44.656074 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-1e2631b2-7a8a-4b29-ae8c-9dd998835094 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:39:44.656918 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-1e2631b2-7a8a-4b29-ae8c-9dd998835094 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] [instance: c35a32ea-7024-4981-a41c-e3570b8fee57] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:39:44.665496 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1e2631b2-7a8a-4b29-ae8c-9dd998835094 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:39:44.665992 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1e2631b2-7a8a-4b29-ae8c-9dd998835094 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:39:44.666463 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1e2631b2-7a8a-4b29-ae8c-9dd998835094 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:39:44.667175 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1e2631b2-7a8a-4b29-ae8c-9dd998835094 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:39:44.667639 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1e2631b2-7a8a-4b29-ae8c-9dd998835094 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:39:44.668073 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1e2631b2-7a8a-4b29-ae8c-9dd998835094 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:39:44.811398 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-1e2631b2-7a8a-4b29-ae8c-9dd998835094 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc0ba9f45d04dec89394df46d6096a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2856184afa47f2b4349f7dea9e5569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:39:44.819644 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-1e2631b2-7a8a-4b29-ae8c-9dd998835094 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] 10.222.0.43 "GET /compute/v2.1/servers/c35a32ea-7024-4981-a41c-e3570b8fee57" status: 200 len: 1391 microversion: 2.1 time: 0.170257 Oct 04 22:39:44.820245 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3017/6855] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:39:44 2022] GET /compute/v2.1/servers/c35a32ea-7024-4981-a41c-e3570b8fee57 => generated 1391 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:39:45.842506 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e909c848-ccf9-4b21-a469-70ecfba7e0bb tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:39:45.843170 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-e909c848-ccf9-4b21-a469-70ecfba7e0bb tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] [instance: c35a32ea-7024-4981-a41c-e3570b8fee57] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:39:45.845209 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=8 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:39:45.850736 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e909c848-ccf9-4b21-a469-70ecfba7e0bb tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:39:45.851238 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e909c848-ccf9-4b21-a469-70ecfba7e0bb tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:39:45.851696 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e909c848-ccf9-4b21-a469-70ecfba7e0bb tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:39:45.852407 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e909c848-ccf9-4b21-a469-70ecfba7e0bb tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:39:45.852883 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e909c848-ccf9-4b21-a469-70ecfba7e0bb tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:39:45.853327 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e909c848-ccf9-4b21-a469-70ecfba7e0bb tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:39:45.984115 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-e909c848-ccf9-4b21-a469-70ecfba7e0bb tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc0ba9f45d04dec89394df46d6096a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2856184afa47f2b4349f7dea9e5569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:39:45.992446 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-e909c848-ccf9-4b21-a469-70ecfba7e0bb tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] 10.222.0.43 "GET /compute/v2.1/servers/c35a32ea-7024-4981-a41c-e3570b8fee57" status: 200 len: 1564 microversion: 2.1 time: 0.154107 Oct 04 22:39:45.993028 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3839/6856] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:39:45 2022] GET /compute/v2.1/servers/c35a32ea-7024-4981-a41c-e3570b8fee57 => generated 1564 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:39:46.015133 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-c6442291-0f50-4737-8cd1-4d65254d0447 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:39:46.015757 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-c6442291-0f50-4737-8cd1-4d65254d0447 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] [instance: c35a32ea-7024-4981-a41c-e3570b8fee57] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:39:46.022726 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c6442291-0f50-4737-8cd1-4d65254d0447 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:39:46.023218 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c6442291-0f50-4737-8cd1-4d65254d0447 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:39:46.023671 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c6442291-0f50-4737-8cd1-4d65254d0447 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:39:46.024370 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c6442291-0f50-4737-8cd1-4d65254d0447 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:39:46.024837 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c6442291-0f50-4737-8cd1-4d65254d0447 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:39:46.025272 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c6442291-0f50-4737-8cd1-4d65254d0447 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:39:46.162197 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-c6442291-0f50-4737-8cd1-4d65254d0447 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc0ba9f45d04dec89394df46d6096a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2856184afa47f2b4349f7dea9e5569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:39:46.170109 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-c6442291-0f50-4737-8cd1-4d65254d0447 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] 10.222.0.43 "GET /compute/v2.1/servers/c35a32ea-7024-4981-a41c-e3570b8fee57" status: 200 len: 1564 microversion: 2.1 time: 0.158842 Oct 04 22:39:46.170730 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3018/6857] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:39:46 2022] GET /compute/v2.1/servers/c35a32ea-7024-4981-a41c-e3570b8fee57 => generated 1564 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:39:48.065785 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-3fa651c2-e301-443b-9e30-4a8165933324 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:39:48.071251 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-64a75b29-c743-40ec-957b-41aacbfa3946 req-ce363a41-ddfc-4378-88a7-cefc2f28cc77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c35a32ea-7024-4981-a41c-e3570b8fee57", "tag": "2becf889-435b-4e3b-841f-ab2ee960966d"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:39:48.074579 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-3fa651c2-e301-443b-9e30-4a8165933324 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] [instance: c35a32ea-7024-4981-a41c-e3570b8fee57] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:39:48.082670 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3fa651c2-e301-443b-9e30-4a8165933324 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:39:48.083644 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3fa651c2-e301-443b-9e30-4a8165933324 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:39:48.084172 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-64a75b29-c743-40ec-957b-41aacbfa3946 req-ce363a41-ddfc-4378-88a7-cefc2f28cc77 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:39:48.084307 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3fa651c2-e301-443b-9e30-4a8165933324 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:39:48.084658 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-64a75b29-c743-40ec-957b-41aacbfa3946 req-ce363a41-ddfc-4378-88a7-cefc2f28cc77 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:39:48.085138 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-64a75b29-c743-40ec-957b-41aacbfa3946 req-ce363a41-ddfc-4378-88a7-cefc2f28cc77 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:39:48.085255 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3fa651c2-e301-443b-9e30-4a8165933324 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:39:48.085724 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3fa651c2-e301-443b-9e30-4a8165933324 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:39:48.086247 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3fa651c2-e301-443b-9e30-4a8165933324 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:39:48.096724 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-64a75b29-c743-40ec-957b-41aacbfa3946 req-ce363a41-ddfc-4378-88a7-cefc2f28cc77 service nova] Creating event network-changed:2becf889-435b-4e3b-841f-ab2ee960966d for instance c35a32ea-7024-4981-a41c-e3570b8fee57 on n-h1-860284-1 Oct 04 22:39:48.102209 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-64a75b29-c743-40ec-957b-41aacbfa3946 req-ce363a41-ddfc-4378-88a7-cefc2f28cc77 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034515 Oct 04 22:39:48.103179 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3019/6858] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:39:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:39:48.231864 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-3fa651c2-e301-443b-9e30-4a8165933324 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc0ba9f45d04dec89394df46d6096a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2856184afa47f2b4349f7dea9e5569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:39:48.241493 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-3fa651c2-e301-443b-9e30-4a8165933324 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] 10.222.0.43 "GET /compute/v2.1/servers/c35a32ea-7024-4981-a41c-e3570b8fee57" status: 200 len: 1564 microversion: 2.1 time: 0.180031 Oct 04 22:39:48.242109 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3840/6859] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:39:48 2022] GET /compute/v2.1/servers/c35a32ea-7024-4981-a41c-e3570b8fee57 => generated 1564 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:40:23.554193 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:40:23.555276 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=36 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:40:23.560096 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-0c3b640c-630c-4d77-b336-5a12caa81566 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:40:23.562348 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-0c3b640c-630c-4d77-b336-5a12caa81566 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] [instance: c35a32ea-7024-4981-a41c-e3570b8fee57] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:40:23.570882 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0c3b640c-630c-4d77-b336-5a12caa81566 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:40:23.571372 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0c3b640c-630c-4d77-b336-5a12caa81566 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:40:23.571814 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0c3b640c-630c-4d77-b336-5a12caa81566 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:40:23.572520 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0c3b640c-630c-4d77-b336-5a12caa81566 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:40:23.572977 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0c3b640c-630c-4d77-b336-5a12caa81566 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:40:23.573409 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0c3b640c-630c-4d77-b336-5a12caa81566 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:40:23.627304 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-0c3b640c-630c-4d77-b336-5a12caa81566 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] 10.222.0.43 "POST /compute/v2.1/servers/c35a32ea-7024-4981-a41c-e3570b8fee57/action" status: 200 len: 24559 microversion: 2.1 time: 0.075589 Oct 04 22:40:23.627944 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3020/6860] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 22:40:23 2022] POST /compute/v2.1/servers/c35a32ea-7024-4981-a41c-e3570b8fee57/action => generated 24559 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 22:41:02.401645 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:41:02.402348 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=44 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:41:02.407356 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-95880527-cfd5-4f4e-9822-d2d20f1dd661 tempest-TestNetworkAdvancedServerOps-1759506676 tempest-TestNetworkAdvancedServerOps-1759506676-project-admin] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:41:02.408013 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-95880527-cfd5-4f4e-9822-d2d20f1dd661 tempest-TestNetworkAdvancedServerOps-1759506676 tempest-TestNetworkAdvancedServerOps-1759506676-project-admin] [instance: c35a32ea-7024-4981-a41c-e3570b8fee57] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:41:02.415339 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-95880527-cfd5-4f4e-9822-d2d20f1dd661 tempest-TestNetworkAdvancedServerOps-1759506676 tempest-TestNetworkAdvancedServerOps-1759506676-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:41:02.415842 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-95880527-cfd5-4f4e-9822-d2d20f1dd661 tempest-TestNetworkAdvancedServerOps-1759506676 tempest-TestNetworkAdvancedServerOps-1759506676-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:41:02.416291 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-95880527-cfd5-4f4e-9822-d2d20f1dd661 tempest-TestNetworkAdvancedServerOps-1759506676 tempest-TestNetworkAdvancedServerOps-1759506676-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:41:02.416996 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-95880527-cfd5-4f4e-9822-d2d20f1dd661 tempest-TestNetworkAdvancedServerOps-1759506676 tempest-TestNetworkAdvancedServerOps-1759506676-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:41:02.417458 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-95880527-cfd5-4f4e-9822-d2d20f1dd661 tempest-TestNetworkAdvancedServerOps-1759506676 tempest-TestNetworkAdvancedServerOps-1759506676-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:41:02.417896 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-95880527-cfd5-4f4e-9822-d2d20f1dd661 tempest-TestNetworkAdvancedServerOps-1759506676 tempest-TestNetworkAdvancedServerOps-1759506676-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:41:02.614198 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-95880527-cfd5-4f4e-9822-d2d20f1dd661 tempest-TestNetworkAdvancedServerOps-1759506676 tempest-TestNetworkAdvancedServerOps-1759506676-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/c35a32ea-7024-4981-a41c-e3570b8fee57" status: 200 len: 1834 microversion: 2.1 time: 0.214485 Oct 04 22:41:02.614820 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3841/6861] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:41:02 2022] GET /compute/v2.1/servers/c35a32ea-7024-4981-a41c-e3570b8fee57 => generated 1834 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:41:02.639700 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-27c9a6e8-4e7b-4718-b2be-de2679245944 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:41:02.640411 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-27c9a6e8-4e7b-4718-b2be-de2679245944 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] [instance: c35a32ea-7024-4981-a41c-e3570b8fee57] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:41:02.642929 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_api:SELECT=2 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:41:02.643608 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=4 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:41:02.644974 n-d-860284-1 devstack@n-api.service[134102]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 22:41:02.645155 n-d-860284-1 devstack@n-api.service[134102]: Tue Oct 4 22:41:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c35a32ea-7024-4981-a41c-e3570b8fee57 (ip 10.222.0.43) !!! Oct 04 22:41:02.654824 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-27c9a6e8-4e7b-4718-b2be-de2679245944 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:41:02.655490 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-27c9a6e8-4e7b-4718-b2be-de2679245944 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:41:02.655683 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-27c9a6e8-4e7b-4718-b2be-de2679245944 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:41:02.656940 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-27c9a6e8-4e7b-4718-b2be-de2679245944 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:41:02.658600 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-27c9a6e8-4e7b-4718-b2be-de2679245944 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:41:02.659046 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-27c9a6e8-4e7b-4718-b2be-de2679245944 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:41:02.794419 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-27c9a6e8-4e7b-4718-b2be-de2679245944 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc0ba9f45d04dec89394df46d6096a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2856184afa47f2b4349f7dea9e5569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:41:02.802789 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-27c9a6e8-4e7b-4718-b2be-de2679245944 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] 10.222.0.43 "GET /compute/v2.1/servers/c35a32ea-7024-4981-a41c-e3570b8fee57" status: 200 len: 1683 microversion: 2.1 time: 0.167622 Oct 04 22:41:02.803371 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3021/6862] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:41:02 2022] GET /compute/v2.1/servers/c35a32ea-7024-4981-a41c-e3570b8fee57 => generated 1683 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:41:02.898136 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-bbb17c6b-0c2b-4e62-890c-6056d2dbabca tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:41:02.900519 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-bbb17c6b-0c2b-4e62-890c-6056d2dbabca tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] [instance: c35a32ea-7024-4981-a41c-e3570b8fee57] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:41:02.907154 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bbb17c6b-0c2b-4e62-890c-6056d2dbabca tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:41:02.907621 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bbb17c6b-0c2b-4e62-890c-6056d2dbabca tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:41:02.908070 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bbb17c6b-0c2b-4e62-890c-6056d2dbabca tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:41:02.908799 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bbb17c6b-0c2b-4e62-890c-6056d2dbabca tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:41:02.909278 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bbb17c6b-0c2b-4e62-890c-6056d2dbabca tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:41:02.909733 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bbb17c6b-0c2b-4e62-890c-6056d2dbabca tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:41:02.961532 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-bbb17c6b-0c2b-4e62-890c-6056d2dbabca tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] 10.222.0.43 "POST /compute/v2.1/servers/c35a32ea-7024-4981-a41c-e3570b8fee57/action" status: 200 len: 32635 microversion: 2.1 time: 0.067120 Oct 04 22:41:02.962213 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3842/6863] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 22:41:02 2022] POST /compute/v2.1/servers/c35a32ea-7024-4981-a41c-e3570b8fee57/action => generated 32635 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 22:41:03.145326 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-064db28f-c874-4640-9fcb-8853084e5ab5 tempest-TestNetworkAdvancedServerOps-1759506676 tempest-TestNetworkAdvancedServerOps-1759506676-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:41:03.145905 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-064db28f-c874-4640-9fcb-8853084e5ab5 tempest-TestNetworkAdvancedServerOps-1759506676 tempest-TestNetworkAdvancedServerOps-1759506676-project-admin] [instance: c35a32ea-7024-4981-a41c-e3570b8fee57] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:41:03.152431 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-064db28f-c874-4640-9fcb-8853084e5ab5 tempest-TestNetworkAdvancedServerOps-1759506676 tempest-TestNetworkAdvancedServerOps-1759506676-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:41:03.152922 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-064db28f-c874-4640-9fcb-8853084e5ab5 tempest-TestNetworkAdvancedServerOps-1759506676 tempest-TestNetworkAdvancedServerOps-1759506676-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:41:03.153364 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-064db28f-c874-4640-9fcb-8853084e5ab5 tempest-TestNetworkAdvancedServerOps-1759506676 tempest-TestNetworkAdvancedServerOps-1759506676-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:41:03.154070 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-064db28f-c874-4640-9fcb-8853084e5ab5 tempest-TestNetworkAdvancedServerOps-1759506676 tempest-TestNetworkAdvancedServerOps-1759506676-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:41:03.154572 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-064db28f-c874-4640-9fcb-8853084e5ab5 tempest-TestNetworkAdvancedServerOps-1759506676 tempest-TestNetworkAdvancedServerOps-1759506676-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:41:03.155006 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-064db28f-c874-4640-9fcb-8853084e5ab5 tempest-TestNetworkAdvancedServerOps-1759506676 tempest-TestNetworkAdvancedServerOps-1759506676-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:41:03.182092 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-064db28f-c874-4640-9fcb-8853084e5ab5 tempest-TestNetworkAdvancedServerOps-1759506676 tempest-TestNetworkAdvancedServerOps-1759506676-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '7db2bd8abcca431e81abcedf5b737894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2375770f8a694356908af88f549a8881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:41:03.182642 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-064db28f-c874-4640-9fcb-8853084e5ab5 tempest-TestNetworkAdvancedServerOps-1759506676 tempest-TestNetworkAdvancedServerOps-1759506676-project-admin] [instance: c35a32ea-7024-4981-a41c-e3570b8fee57] flavor_id is None. Assuming migration. {{(pid=134102) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 04 22:41:03.183091 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-064db28f-c874-4640-9fcb-8853084e5ab5 tempest-TestNetworkAdvancedServerOps-1759506676 tempest-TestNetworkAdvancedServerOps-1759506676-project-admin] [instance: c35a32ea-7024-4981-a41c-e3570b8fee57] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=134102) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 04 22:41:03.295504 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-064db28f-c874-4640-9fcb-8853084e5ab5 tempest-TestNetworkAdvancedServerOps-1759506676 tempest-TestNetworkAdvancedServerOps-1759506676-project-admin] 10.222.0.43 "POST /compute/v2.1/servers/c35a32ea-7024-4981-a41c-e3570b8fee57/action" status: 202 len: 0 microversion: 2.1 time: 0.154554 Oct 04 22:41:03.296122 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3022/6864] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 22:41:03 2022] POST /compute/v2.1/servers/c35a32ea-7024-4981-a41c-e3570b8fee57/action => generated 0 bytes in 156 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 22:41:03.305127 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-ffb4d6e0-6d1c-4f3a-8022-08e97ab06cae tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:41:03.306155 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-ffb4d6e0-6d1c-4f3a-8022-08e97ab06cae tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] [instance: c35a32ea-7024-4981-a41c-e3570b8fee57] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:41:03.313950 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ffb4d6e0-6d1c-4f3a-8022-08e97ab06cae tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:41:03.314481 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ffb4d6e0-6d1c-4f3a-8022-08e97ab06cae tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:41:03.314948 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ffb4d6e0-6d1c-4f3a-8022-08e97ab06cae tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:41:03.315674 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ffb4d6e0-6d1c-4f3a-8022-08e97ab06cae tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:41:03.316156 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ffb4d6e0-6d1c-4f3a-8022-08e97ab06cae tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:41:03.316606 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ffb4d6e0-6d1c-4f3a-8022-08e97ab06cae tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:41:03.486215 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-ffb4d6e0-6d1c-4f3a-8022-08e97ab06cae tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc0ba9f45d04dec89394df46d6096a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2856184afa47f2b4349f7dea9e5569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:41:03.494788 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-ffb4d6e0-6d1c-4f3a-8022-08e97ab06cae tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] 10.222.0.43 "GET /compute/v2.1/servers/c35a32ea-7024-4981-a41c-e3570b8fee57" status: 200 len: 1692 microversion: 2.1 time: 0.193817 Oct 04 22:41:03.495589 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3843/6865] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:41:03 2022] GET /compute/v2.1/servers/c35a32ea-7024-4981-a41c-e3570b8fee57 => generated 1692 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:41:04.519934 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-a78560c6-cfba-48dc-bd52-436dedf655c9 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:41:04.520645 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-a78560c6-cfba-48dc-bd52-436dedf655c9 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] [instance: c35a32ea-7024-4981-a41c-e3570b8fee57] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:41:04.528500 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a78560c6-cfba-48dc-bd52-436dedf655c9 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:41:04.529001 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a78560c6-cfba-48dc-bd52-436dedf655c9 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:41:04.529461 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a78560c6-cfba-48dc-bd52-436dedf655c9 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:41:04.530202 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a78560c6-cfba-48dc-bd52-436dedf655c9 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:41:04.530696 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a78560c6-cfba-48dc-bd52-436dedf655c9 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:41:04.531136 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a78560c6-cfba-48dc-bd52-436dedf655c9 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:41:04.749150 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-a78560c6-cfba-48dc-bd52-436dedf655c9 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc0ba9f45d04dec89394df46d6096a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2856184afa47f2b4349f7dea9e5569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:41:04.758090 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-a78560c6-cfba-48dc-bd52-436dedf655c9 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] 10.222.0.43 "GET /compute/v2.1/servers/c35a32ea-7024-4981-a41c-e3570b8fee57" status: 200 len: 1692 microversion: 2.1 time: 0.243559 Oct 04 22:41:04.758709 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3023/6866] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:41:04 2022] GET /compute/v2.1/servers/c35a32ea-7024-4981-a41c-e3570b8fee57 => generated 1692 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:41:05.782604 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-8870e341-b8a5-4d01-858b-8b97dd8b892d tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:41:05.783277 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-8870e341-b8a5-4d01-858b-8b97dd8b892d tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] [instance: c35a32ea-7024-4981-a41c-e3570b8fee57] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:41:05.791803 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8870e341-b8a5-4d01-858b-8b97dd8b892d tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:41:05.792305 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8870e341-b8a5-4d01-858b-8b97dd8b892d tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:41:05.792762 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8870e341-b8a5-4d01-858b-8b97dd8b892d tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:41:05.793479 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8870e341-b8a5-4d01-858b-8b97dd8b892d tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:41:05.793962 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8870e341-b8a5-4d01-858b-8b97dd8b892d tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:41:05.794792 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8870e341-b8a5-4d01-858b-8b97dd8b892d tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:41:05.929364 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-8870e341-b8a5-4d01-858b-8b97dd8b892d tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc0ba9f45d04dec89394df46d6096a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2856184afa47f2b4349f7dea9e5569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:41:05.937214 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-8870e341-b8a5-4d01-858b-8b97dd8b892d tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] 10.222.0.43 "GET /compute/v2.1/servers/c35a32ea-7024-4981-a41c-e3570b8fee57" status: 200 len: 1697 microversion: 2.1 time: 0.158649 Oct 04 22:41:05.938396 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3844/6867] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:41:05 2022] GET /compute/v2.1/servers/c35a32ea-7024-4981-a41c-e3570b8fee57 => generated 1697 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:41:06.961150 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-17f6a845-561b-47f4-a410-c78cb40f5178 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:41:06.961772 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-17f6a845-561b-47f4-a410-c78cb40f5178 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] [instance: c35a32ea-7024-4981-a41c-e3570b8fee57] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:41:06.968605 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-17f6a845-561b-47f4-a410-c78cb40f5178 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:41:06.969736 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-17f6a845-561b-47f4-a410-c78cb40f5178 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:41:06.970181 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-17f6a845-561b-47f4-a410-c78cb40f5178 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:41:06.970914 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-17f6a845-561b-47f4-a410-c78cb40f5178 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:41:06.971384 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-17f6a845-561b-47f4-a410-c78cb40f5178 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:41:06.971818 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-17f6a845-561b-47f4-a410-c78cb40f5178 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:41:07.110270 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-17f6a845-561b-47f4-a410-c78cb40f5178 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc0ba9f45d04dec89394df46d6096a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2856184afa47f2b4349f7dea9e5569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:41:07.118473 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-17f6a845-561b-47f4-a410-c78cb40f5178 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] 10.222.0.43 "GET /compute/v2.1/servers/c35a32ea-7024-4981-a41c-e3570b8fee57" status: 200 len: 1697 microversion: 2.1 time: 0.161233 Oct 04 22:41:07.119064 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3024/6868] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:41:06 2022] GET /compute/v2.1/servers/c35a32ea-7024-4981-a41c-e3570b8fee57 => generated 1697 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:41:08.142794 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-af1649fb-9f7e-4e22-875d-b6c37a486ed8 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:41:08.143425 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-af1649fb-9f7e-4e22-875d-b6c37a486ed8 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] [instance: c35a32ea-7024-4981-a41c-e3570b8fee57] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:41:08.150271 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-af1649fb-9f7e-4e22-875d-b6c37a486ed8 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:41:08.150817 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-af1649fb-9f7e-4e22-875d-b6c37a486ed8 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:41:08.151255 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-af1649fb-9f7e-4e22-875d-b6c37a486ed8 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:41:08.151977 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-af1649fb-9f7e-4e22-875d-b6c37a486ed8 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:41:08.152429 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-af1649fb-9f7e-4e22-875d-b6c37a486ed8 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:41:08.152867 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-af1649fb-9f7e-4e22-875d-b6c37a486ed8 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:41:08.287122 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-af1649fb-9f7e-4e22-875d-b6c37a486ed8 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc0ba9f45d04dec89394df46d6096a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2856184afa47f2b4349f7dea9e5569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:41:08.294886 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-af1649fb-9f7e-4e22-875d-b6c37a486ed8 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] 10.222.0.43 "GET /compute/v2.1/servers/c35a32ea-7024-4981-a41c-e3570b8fee57" status: 200 len: 1697 microversion: 2.1 time: 0.156425 Oct 04 22:41:08.295456 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3845/6869] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:41:08 2022] GET /compute/v2.1/servers/c35a32ea-7024-4981-a41c-e3570b8fee57 => generated 1697 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:41:09.318544 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-da800951-a989-4c3e-acb3-154b4701f33d tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:41:09.319166 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-da800951-a989-4c3e-acb3-154b4701f33d tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] [instance: c35a32ea-7024-4981-a41c-e3570b8fee57] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:41:09.326018 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-da800951-a989-4c3e-acb3-154b4701f33d tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:41:09.326547 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-da800951-a989-4c3e-acb3-154b4701f33d tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:41:09.326995 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-da800951-a989-4c3e-acb3-154b4701f33d tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:41:09.327694 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-da800951-a989-4c3e-acb3-154b4701f33d tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:41:09.328205 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-da800951-a989-4c3e-acb3-154b4701f33d tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:41:09.328639 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-da800951-a989-4c3e-acb3-154b4701f33d tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:41:09.457578 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-da800951-a989-4c3e-acb3-154b4701f33d tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc0ba9f45d04dec89394df46d6096a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2856184afa47f2b4349f7dea9e5569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:41:09.465270 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-da800951-a989-4c3e-acb3-154b4701f33d tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] 10.222.0.43 "GET /compute/v2.1/servers/c35a32ea-7024-4981-a41c-e3570b8fee57" status: 200 len: 1697 microversion: 2.1 time: 0.150811 Oct 04 22:41:09.465852 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3025/6870] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:41:09 2022] GET /compute/v2.1/servers/c35a32ea-7024-4981-a41c-e3570b8fee57 => generated 1697 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:41:10.489525 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-f42267b5-2cc8-4c73-8cc8-85e8f8735a5e tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:41:10.490159 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-f42267b5-2cc8-4c73-8cc8-85e8f8735a5e tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] [instance: c35a32ea-7024-4981-a41c-e3570b8fee57] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:41:10.497209 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f42267b5-2cc8-4c73-8cc8-85e8f8735a5e tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:41:10.497709 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f42267b5-2cc8-4c73-8cc8-85e8f8735a5e tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:41:10.498166 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f42267b5-2cc8-4c73-8cc8-85e8f8735a5e tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:41:10.498911 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f42267b5-2cc8-4c73-8cc8-85e8f8735a5e tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:41:10.499390 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f42267b5-2cc8-4c73-8cc8-85e8f8735a5e tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:41:10.500562 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f42267b5-2cc8-4c73-8cc8-85e8f8735a5e tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:41:10.632245 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-f42267b5-2cc8-4c73-8cc8-85e8f8735a5e tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc0ba9f45d04dec89394df46d6096a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2856184afa47f2b4349f7dea9e5569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:41:10.640109 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-f42267b5-2cc8-4c73-8cc8-85e8f8735a5e tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] 10.222.0.43 "GET /compute/v2.1/servers/c35a32ea-7024-4981-a41c-e3570b8fee57" status: 200 len: 1697 microversion: 2.1 time: 0.154519 Oct 04 22:41:10.640813 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3846/6871] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:41:10 2022] GET /compute/v2.1/servers/c35a32ea-7024-4981-a41c-e3570b8fee57 => generated 1697 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:41:11.663400 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-d5b198d3-0cdd-4b73-af5c-d5b08ce9938b tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:41:11.664022 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-d5b198d3-0cdd-4b73-af5c-d5b08ce9938b tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] [instance: c35a32ea-7024-4981-a41c-e3570b8fee57] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:41:11.671091 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d5b198d3-0cdd-4b73-af5c-d5b08ce9938b tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:41:11.671600 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d5b198d3-0cdd-4b73-af5c-d5b08ce9938b tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:41:11.672084 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d5b198d3-0cdd-4b73-af5c-d5b08ce9938b tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:41:11.672788 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d5b198d3-0cdd-4b73-af5c-d5b08ce9938b tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:41:11.673252 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d5b198d3-0cdd-4b73-af5c-d5b08ce9938b tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:41:11.673684 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d5b198d3-0cdd-4b73-af5c-d5b08ce9938b tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:41:11.803589 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-d5b198d3-0cdd-4b73-af5c-d5b08ce9938b tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc0ba9f45d04dec89394df46d6096a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2856184afa47f2b4349f7dea9e5569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:41:11.811463 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-d5b198d3-0cdd-4b73-af5c-d5b08ce9938b tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] 10.222.0.43 "GET /compute/v2.1/servers/c35a32ea-7024-4981-a41c-e3570b8fee57" status: 200 len: 1697 microversion: 2.1 time: 0.152017 Oct 04 22:41:11.812048 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3026/6872] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:41:11 2022] GET /compute/v2.1/servers/c35a32ea-7024-4981-a41c-e3570b8fee57 => generated 1697 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:41:12.836220 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-f7845b44-43b0-40bd-9adb-449ca3964a9f tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:41:12.837035 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-f7845b44-43b0-40bd-9adb-449ca3964a9f tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] [instance: c35a32ea-7024-4981-a41c-e3570b8fee57] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:41:12.846519 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f7845b44-43b0-40bd-9adb-449ca3964a9f tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:41:12.847037 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f7845b44-43b0-40bd-9adb-449ca3964a9f tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:41:12.847549 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f7845b44-43b0-40bd-9adb-449ca3964a9f tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:41:12.848289 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f7845b44-43b0-40bd-9adb-449ca3964a9f tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:41:12.848768 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f7845b44-43b0-40bd-9adb-449ca3964a9f tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:41:12.849220 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f7845b44-43b0-40bd-9adb-449ca3964a9f tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:41:12.986465 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-f7845b44-43b0-40bd-9adb-449ca3964a9f tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc0ba9f45d04dec89394df46d6096a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2856184afa47f2b4349f7dea9e5569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:41:12.994611 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-f7845b44-43b0-40bd-9adb-449ca3964a9f tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] 10.222.0.43 "GET /compute/v2.1/servers/c35a32ea-7024-4981-a41c-e3570b8fee57" status: 200 len: 1697 microversion: 2.1 time: 0.162410 Oct 04 22:41:12.995186 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3847/6873] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:41:12 2022] GET /compute/v2.1/servers/c35a32ea-7024-4981-a41c-e3570b8fee57 => generated 1697 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:41:14.019638 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-83505524-a885-49d5-808b-8621924dbad2 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:41:14.020253 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-83505524-a885-49d5-808b-8621924dbad2 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] [instance: c35a32ea-7024-4981-a41c-e3570b8fee57] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:41:14.027333 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-83505524-a885-49d5-808b-8621924dbad2 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:41:14.027820 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-83505524-a885-49d5-808b-8621924dbad2 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:41:14.028258 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-83505524-a885-49d5-808b-8621924dbad2 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:41:14.028960 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-83505524-a885-49d5-808b-8621924dbad2 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:41:14.029412 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-83505524-a885-49d5-808b-8621924dbad2 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:41:14.029841 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-83505524-a885-49d5-808b-8621924dbad2 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:41:14.166009 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-83505524-a885-49d5-808b-8621924dbad2 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc0ba9f45d04dec89394df46d6096a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2856184afa47f2b4349f7dea9e5569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:41:14.174523 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-83505524-a885-49d5-808b-8621924dbad2 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] 10.222.0.43 "GET /compute/v2.1/servers/c35a32ea-7024-4981-a41c-e3570b8fee57" status: 200 len: 1697 microversion: 2.1 time: 0.159603 Oct 04 22:41:14.175102 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3027/6874] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:41:14 2022] GET /compute/v2.1/servers/c35a32ea-7024-4981-a41c-e3570b8fee57 => generated 1697 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:41:15.197866 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-57324ec9-d6d1-4dcd-b71a-d74626624542 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:41:15.198529 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-57324ec9-d6d1-4dcd-b71a-d74626624542 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] [instance: c35a32ea-7024-4981-a41c-e3570b8fee57] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:41:15.205798 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-57324ec9-d6d1-4dcd-b71a-d74626624542 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:41:15.206301 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-57324ec9-d6d1-4dcd-b71a-d74626624542 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:41:15.206803 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-57324ec9-d6d1-4dcd-b71a-d74626624542 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:41:15.207519 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-57324ec9-d6d1-4dcd-b71a-d74626624542 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:41:15.207989 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-57324ec9-d6d1-4dcd-b71a-d74626624542 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:41:15.208436 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-57324ec9-d6d1-4dcd-b71a-d74626624542 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:41:15.339725 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-57324ec9-d6d1-4dcd-b71a-d74626624542 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc0ba9f45d04dec89394df46d6096a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2856184afa47f2b4349f7dea9e5569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:41:15.348454 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-57324ec9-d6d1-4dcd-b71a-d74626624542 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] 10.222.0.43 "GET /compute/v2.1/servers/c35a32ea-7024-4981-a41c-e3570b8fee57" status: 200 len: 1697 microversion: 2.1 time: 0.154510 Oct 04 22:41:15.349030 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3848/6875] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:41:15 2022] GET /compute/v2.1/servers/c35a32ea-7024-4981-a41c-e3570b8fee57 => generated 1697 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:41:16.372125 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-04adec12-cdc7-45b7-8514-677b0cb24c64 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:41:16.372783 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-04adec12-cdc7-45b7-8514-677b0cb24c64 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] [instance: c35a32ea-7024-4981-a41c-e3570b8fee57] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:41:16.380507 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-04adec12-cdc7-45b7-8514-677b0cb24c64 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:41:16.380995 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-04adec12-cdc7-45b7-8514-677b0cb24c64 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:41:16.381439 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-04adec12-cdc7-45b7-8514-677b0cb24c64 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:41:16.382139 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-04adec12-cdc7-45b7-8514-677b0cb24c64 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:41:16.382632 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-04adec12-cdc7-45b7-8514-677b0cb24c64 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:41:16.383068 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-04adec12-cdc7-45b7-8514-677b0cb24c64 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:41:16.572042 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-04adec12-cdc7-45b7-8514-677b0cb24c64 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc0ba9f45d04dec89394df46d6096a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2856184afa47f2b4349f7dea9e5569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:41:16.580141 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-04adec12-cdc7-45b7-8514-677b0cb24c64 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] 10.222.0.43 "GET /compute/v2.1/servers/c35a32ea-7024-4981-a41c-e3570b8fee57" status: 200 len: 1697 microversion: 2.1 time: 0.211995 Oct 04 22:41:16.580721 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3028/6876] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:41:16 2022] GET /compute/v2.1/servers/c35a32ea-7024-4981-a41c-e3570b8fee57 => generated 1697 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:41:17.603827 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-ce643212-ed5a-4a45-8a9c-98571ac667cd tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:41:17.604485 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-ce643212-ed5a-4a45-8a9c-98571ac667cd tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] [instance: c35a32ea-7024-4981-a41c-e3570b8fee57] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:41:17.611768 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ce643212-ed5a-4a45-8a9c-98571ac667cd tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:41:17.612284 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ce643212-ed5a-4a45-8a9c-98571ac667cd tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:41:17.612745 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ce643212-ed5a-4a45-8a9c-98571ac667cd tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:41:17.613469 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ce643212-ed5a-4a45-8a9c-98571ac667cd tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:41:17.613947 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ce643212-ed5a-4a45-8a9c-98571ac667cd tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:41:17.614423 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ce643212-ed5a-4a45-8a9c-98571ac667cd tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:41:17.752985 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-ce643212-ed5a-4a45-8a9c-98571ac667cd tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc0ba9f45d04dec89394df46d6096a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2856184afa47f2b4349f7dea9e5569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:41:17.761465 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-ce643212-ed5a-4a45-8a9c-98571ac667cd tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] 10.222.0.43 "GET /compute/v2.1/servers/c35a32ea-7024-4981-a41c-e3570b8fee57" status: 200 len: 1696 microversion: 2.1 time: 0.161465 Oct 04 22:41:17.762062 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3849/6877] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:41:17 2022] GET /compute/v2.1/servers/c35a32ea-7024-4981-a41c-e3570b8fee57 => generated 1696 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:41:17.804356 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-b35d24ac-4212-4f5a-886d-3a65939c45bb req-68a1b4f4-b16e-4f7d-b63c-d9382b17305b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c35a32ea-7024-4981-a41c-e3570b8fee57", "name": "network-vif-unplugged", "status": "completed", "tag": "2becf889-435b-4e3b-841f-ab2ee960966d"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:41:17.815189 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-b35d24ac-4212-4f5a-886d-3a65939c45bb req-68a1b4f4-b16e-4f7d-b63c-d9382b17305b service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:41:17.815825 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-b35d24ac-4212-4f5a-886d-3a65939c45bb req-68a1b4f4-b16e-4f7d-b63c-d9382b17305b service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:41:17.816344 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-b35d24ac-4212-4f5a-886d-3a65939c45bb req-68a1b4f4-b16e-4f7d-b63c-d9382b17305b service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:41:17.829055 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-b35d24ac-4212-4f5a-886d-3a65939c45bb req-68a1b4f4-b16e-4f7d-b63c-d9382b17305b service nova] Creating event network-vif-unplugged:2becf889-435b-4e3b-841f-ab2ee960966d for instance c35a32ea-7024-4981-a41c-e3570b8fee57 on n-h2-860284-1 Oct 04 22:41:17.834600 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [req-b35d24ac-4212-4f5a-886d-3a65939c45bb req-68a1b4f4-b16e-4f7d-b63c-d9382b17305b service nova] Instance c35a32ea-7024-4981-a41c-e3570b8fee57 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860284-1', 'n-h2-860284-1'} {{(pid=134102) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 22:41:17.846648 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-b35d24ac-4212-4f5a-886d-3a65939c45bb req-68a1b4f4-b16e-4f7d-b63c-d9382b17305b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045958 Oct 04 22:41:17.847448 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3029/6878] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:41:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:41:18.785787 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e65dbf81-963f-40b2-a120-c99b25bd6b60 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:41:18.786524 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-e65dbf81-963f-40b2-a120-c99b25bd6b60 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] [instance: c35a32ea-7024-4981-a41c-e3570b8fee57] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:41:18.794604 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e65dbf81-963f-40b2-a120-c99b25bd6b60 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:41:18.795059 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e65dbf81-963f-40b2-a120-c99b25bd6b60 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:41:18.795507 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e65dbf81-963f-40b2-a120-c99b25bd6b60 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:41:18.796312 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e65dbf81-963f-40b2-a120-c99b25bd6b60 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:41:18.797300 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e65dbf81-963f-40b2-a120-c99b25bd6b60 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:41:18.797902 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e65dbf81-963f-40b2-a120-c99b25bd6b60 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:41:18.980689 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-e65dbf81-963f-40b2-a120-c99b25bd6b60 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc0ba9f45d04dec89394df46d6096a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2856184afa47f2b4349f7dea9e5569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:41:18.989418 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-e65dbf81-963f-40b2-a120-c99b25bd6b60 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] 10.222.0.43 "GET /compute/v2.1/servers/c35a32ea-7024-4981-a41c-e3570b8fee57" status: 200 len: 1696 microversion: 2.1 time: 0.208148 Oct 04 22:41:18.990013 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3850/6879] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:41:18 2022] GET /compute/v2.1/servers/c35a32ea-7024-4981-a41c-e3570b8fee57 => generated 1696 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:41:19.864277 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-fb8af9e5-0baa-42be-ab86-30e85d519c80 req-46097046-790e-4cd6-968e-cc383be69cd6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c35a32ea-7024-4981-a41c-e3570b8fee57", "tag": "2becf889-435b-4e3b-841f-ab2ee960966d"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:41:19.875187 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-fb8af9e5-0baa-42be-ab86-30e85d519c80 req-46097046-790e-4cd6-968e-cc383be69cd6 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:41:19.875846 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-fb8af9e5-0baa-42be-ab86-30e85d519c80 req-46097046-790e-4cd6-968e-cc383be69cd6 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:41:19.876285 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-fb8af9e5-0baa-42be-ab86-30e85d519c80 req-46097046-790e-4cd6-968e-cc383be69cd6 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:41:19.891494 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-fb8af9e5-0baa-42be-ab86-30e85d519c80 req-46097046-790e-4cd6-968e-cc383be69cd6 service nova] Creating event network-changed:2becf889-435b-4e3b-841f-ab2ee960966d for instance c35a32ea-7024-4981-a41c-e3570b8fee57 on n-h2-860284-1 Oct 04 22:41:19.896735 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [req-fb8af9e5-0baa-42be-ab86-30e85d519c80 req-46097046-790e-4cd6-968e-cc383be69cd6 service nova] Instance c35a32ea-7024-4981-a41c-e3570b8fee57 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860284-1', 'n-h2-860284-1'} {{(pid=134102) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 22:41:19.907325 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-fb8af9e5-0baa-42be-ab86-30e85d519c80 req-46097046-790e-4cd6-968e-cc383be69cd6 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047172 Oct 04 22:41:19.907929 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3030/6880] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:41:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:41:20.012657 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-dff67f21-a589-4538-ae1f-d731d7980f86 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:41:20.013308 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-dff67f21-a589-4538-ae1f-d731d7980f86 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] [instance: c35a32ea-7024-4981-a41c-e3570b8fee57] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:41:20.021079 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dff67f21-a589-4538-ae1f-d731d7980f86 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:41:20.021590 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dff67f21-a589-4538-ae1f-d731d7980f86 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:41:20.022052 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dff67f21-a589-4538-ae1f-d731d7980f86 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:41:20.022807 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dff67f21-a589-4538-ae1f-d731d7980f86 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:41:20.023292 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dff67f21-a589-4538-ae1f-d731d7980f86 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:41:20.023770 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dff67f21-a589-4538-ae1f-d731d7980f86 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:41:20.168044 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-dff67f21-a589-4538-ae1f-d731d7980f86 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc0ba9f45d04dec89394df46d6096a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2856184afa47f2b4349f7dea9e5569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:41:20.177590 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-dff67f21-a589-4538-ae1f-d731d7980f86 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] 10.222.0.43 "GET /compute/v2.1/servers/c35a32ea-7024-4981-a41c-e3570b8fee57" status: 200 len: 1694 microversion: 2.1 time: 0.168772 Oct 04 22:41:20.178184 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3851/6881] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:41:20 2022] GET /compute/v2.1/servers/c35a32ea-7024-4981-a41c-e3570b8fee57 => generated 1694 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:41:21.202321 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-48cde042-bb36-4185-879d-d6a03e8fe44c tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:41:21.203188 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-48cde042-bb36-4185-879d-d6a03e8fe44c tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] [instance: c35a32ea-7024-4981-a41c-e3570b8fee57] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:41:21.209323 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-48cde042-bb36-4185-879d-d6a03e8fe44c tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:41:21.209812 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-48cde042-bb36-4185-879d-d6a03e8fe44c tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:41:21.210250 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-48cde042-bb36-4185-879d-d6a03e8fe44c tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:41:21.210970 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-48cde042-bb36-4185-879d-d6a03e8fe44c tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:41:21.211431 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-48cde042-bb36-4185-879d-d6a03e8fe44c tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:41:21.211873 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-48cde042-bb36-4185-879d-d6a03e8fe44c tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:41:21.425698 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-48cde042-bb36-4185-879d-d6a03e8fe44c tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc0ba9f45d04dec89394df46d6096a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2856184afa47f2b4349f7dea9e5569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:41:21.433901 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-48cde042-bb36-4185-879d-d6a03e8fe44c tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] 10.222.0.43 "GET /compute/v2.1/servers/c35a32ea-7024-4981-a41c-e3570b8fee57" status: 200 len: 1694 microversion: 2.1 time: 0.236642 Oct 04 22:41:21.434557 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3031/6882] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:41:21 2022] GET /compute/v2.1/servers/c35a32ea-7024-4981-a41c-e3570b8fee57 => generated 1694 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:41:22.458640 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-66977f6e-def0-496c-a0e2-1061ae17a196 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:41:22.459234 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-66977f6e-def0-496c-a0e2-1061ae17a196 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] [instance: c35a32ea-7024-4981-a41c-e3570b8fee57] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:41:22.466100 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-66977f6e-def0-496c-a0e2-1061ae17a196 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:41:22.466705 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-66977f6e-def0-496c-a0e2-1061ae17a196 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:41:22.467174 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-66977f6e-def0-496c-a0e2-1061ae17a196 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:41:22.467892 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-66977f6e-def0-496c-a0e2-1061ae17a196 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:41:22.469124 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-66977f6e-def0-496c-a0e2-1061ae17a196 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:41:22.469577 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-66977f6e-def0-496c-a0e2-1061ae17a196 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:41:22.689731 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-66977f6e-def0-496c-a0e2-1061ae17a196 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc0ba9f45d04dec89394df46d6096a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2856184afa47f2b4349f7dea9e5569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:41:22.697530 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-66977f6e-def0-496c-a0e2-1061ae17a196 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] 10.222.0.43 "GET /compute/v2.1/servers/c35a32ea-7024-4981-a41c-e3570b8fee57" status: 200 len: 1691 microversion: 2.1 time: 0.242983 Oct 04 22:41:22.698139 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3852/6883] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:41:22 2022] GET /compute/v2.1/servers/c35a32ea-7024-4981-a41c-e3570b8fee57 => generated 1691 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:41:22.721351 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-e1c54895-33ee-4dff-a969-9cf783d28d2b tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:41:22.721823 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-e1c54895-33ee-4dff-a969-9cf783d28d2b tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] [instance: c35a32ea-7024-4981-a41c-e3570b8fee57] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:41:22.728585 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e1c54895-33ee-4dff-a969-9cf783d28d2b tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:41:22.729071 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e1c54895-33ee-4dff-a969-9cf783d28d2b tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:41:22.729518 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e1c54895-33ee-4dff-a969-9cf783d28d2b tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:41:22.730242 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e1c54895-33ee-4dff-a969-9cf783d28d2b tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:41:22.730759 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e1c54895-33ee-4dff-a969-9cf783d28d2b tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:41:22.731193 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e1c54895-33ee-4dff-a969-9cf783d28d2b tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:41:22.842084 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-e1c54895-33ee-4dff-a969-9cf783d28d2b tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] 10.222.0.43 "POST /compute/v2.1/servers/c35a32ea-7024-4981-a41c-e3570b8fee57/action" status: 202 len: 0 microversion: 2.1 time: 0.125291 Oct 04 22:41:22.842768 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3032/6884] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 22:41:22 2022] POST /compute/v2.1/servers/c35a32ea-7024-4981-a41c-e3570b8fee57/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 22:41:22.851427 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-aa8c4735-e86e-47b9-87e4-4050f20f8319 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:41:22.852408 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-aa8c4735-e86e-47b9-87e4-4050f20f8319 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] [instance: c35a32ea-7024-4981-a41c-e3570b8fee57] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:41:22.861051 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-aa8c4735-e86e-47b9-87e4-4050f20f8319 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:41:22.861913 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-aa8c4735-e86e-47b9-87e4-4050f20f8319 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:41:22.862462 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-aa8c4735-e86e-47b9-87e4-4050f20f8319 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:41:22.863330 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-aa8c4735-e86e-47b9-87e4-4050f20f8319 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:41:22.863940 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-aa8c4735-e86e-47b9-87e4-4050f20f8319 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:41:22.864417 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-aa8c4735-e86e-47b9-87e4-4050f20f8319 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:41:23.003839 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-aa8c4735-e86e-47b9-87e4-4050f20f8319 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc0ba9f45d04dec89394df46d6096a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2856184afa47f2b4349f7dea9e5569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:41:23.012459 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-aa8c4735-e86e-47b9-87e4-4050f20f8319 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] 10.222.0.43 "GET /compute/v2.1/servers/c35a32ea-7024-4981-a41c-e3570b8fee57" status: 200 len: 1690 microversion: 2.1 time: 0.165103 Oct 04 22:41:23.013366 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3853/6885] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:41:22 2022] GET /compute/v2.1/servers/c35a32ea-7024-4981-a41c-e3570b8fee57 => generated 1690 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:41:23.560085 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-071c362c-dba2-44c7-9819-9d79b0dff444 req-5b735441-9387-4ada-977d-47b3a722d63a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c35a32ea-7024-4981-a41c-e3570b8fee57", "name": "network-vif-plugged", "status": "completed", "tag": "2becf889-435b-4e3b-841f-ab2ee960966d"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:41:23.573928 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-071c362c-dba2-44c7-9819-9d79b0dff444 req-5b735441-9387-4ada-977d-47b3a722d63a service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:41:23.574487 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-071c362c-dba2-44c7-9819-9d79b0dff444 req-5b735441-9387-4ada-977d-47b3a722d63a service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:41:23.574924 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-071c362c-dba2-44c7-9819-9d79b0dff444 req-5b735441-9387-4ada-977d-47b3a722d63a service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:41:23.587632 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-071c362c-dba2-44c7-9819-9d79b0dff444 req-5b735441-9387-4ada-977d-47b3a722d63a service nova] Creating event network-vif-plugged:2becf889-435b-4e3b-841f-ab2ee960966d for instance c35a32ea-7024-4981-a41c-e3570b8fee57 on n-h2-860284-1 Oct 04 22:41:23.593061 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [req-071c362c-dba2-44c7-9819-9d79b0dff444 req-5b735441-9387-4ada-977d-47b3a722d63a service nova] Instance c35a32ea-7024-4981-a41c-e3570b8fee57 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860284-1', 'n-h2-860284-1'} {{(pid=134102) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 22:41:23.603914 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-071c362c-dba2-44c7-9819-9d79b0dff444 req-5b735441-9387-4ada-977d-47b3a722d63a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113741 Oct 04 22:41:23.604524 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3033/6886] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:41:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:41:24.036246 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-737d5744-1316-4732-8f4c-cda2f61f2c8e tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:41:24.036880 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-737d5744-1316-4732-8f4c-cda2f61f2c8e tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] [instance: c35a32ea-7024-4981-a41c-e3570b8fee57] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:41:24.043802 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-737d5744-1316-4732-8f4c-cda2f61f2c8e tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:41:24.044306 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-737d5744-1316-4732-8f4c-cda2f61f2c8e tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:41:24.044791 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-737d5744-1316-4732-8f4c-cda2f61f2c8e tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:41:24.045505 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-737d5744-1316-4732-8f4c-cda2f61f2c8e tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:41:24.045975 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-737d5744-1316-4732-8f4c-cda2f61f2c8e tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:41:24.047023 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-737d5744-1316-4732-8f4c-cda2f61f2c8e tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:41:24.182761 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-737d5744-1316-4732-8f4c-cda2f61f2c8e tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc0ba9f45d04dec89394df46d6096a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2856184afa47f2b4349f7dea9e5569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:41:24.191216 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-737d5744-1316-4732-8f4c-cda2f61f2c8e tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] 10.222.0.43 "GET /compute/v2.1/servers/c35a32ea-7024-4981-a41c-e3570b8fee57" status: 200 len: 1690 microversion: 2.1 time: 0.158970 Oct 04 22:41:24.191789 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3854/6887] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:41:24 2022] GET /compute/v2.1/servers/c35a32ea-7024-4981-a41c-e3570b8fee57 => generated 1690 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:41:25.215693 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-75506228-809b-4dcb-ba1c-5727f42f4a84 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:41:25.216435 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-75506228-809b-4dcb-ba1c-5727f42f4a84 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] [instance: c35a32ea-7024-4981-a41c-e3570b8fee57] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:41:25.222668 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-75506228-809b-4dcb-ba1c-5727f42f4a84 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:41:25.223157 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-75506228-809b-4dcb-ba1c-5727f42f4a84 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:41:25.223602 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-75506228-809b-4dcb-ba1c-5727f42f4a84 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:41:25.224302 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-75506228-809b-4dcb-ba1c-5727f42f4a84 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:41:25.224771 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-75506228-809b-4dcb-ba1c-5727f42f4a84 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:41:25.225204 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-75506228-809b-4dcb-ba1c-5727f42f4a84 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:41:25.446051 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-75506228-809b-4dcb-ba1c-5727f42f4a84 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc0ba9f45d04dec89394df46d6096a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2856184afa47f2b4349f7dea9e5569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:41:25.453968 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-75506228-809b-4dcb-ba1c-5727f42f4a84 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] 10.222.0.43 "GET /compute/v2.1/servers/c35a32ea-7024-4981-a41c-e3570b8fee57" status: 200 len: 1690 microversion: 2.1 time: 0.243734 Oct 04 22:41:25.454589 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3034/6888] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:41:25 2022] GET /compute/v2.1/servers/c35a32ea-7024-4981-a41c-e3570b8fee57 => generated 1690 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:41:26.105860 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-e55f6823-0f95-4ab7-be7f-ed751d781f72 req-179023b2-63c5-4fc9-8bd4-6443d8afd544 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c35a32ea-7024-4981-a41c-e3570b8fee57", "name": "network-vif-unplugged", "status": "completed", "tag": "2becf889-435b-4e3b-841f-ab2ee960966d"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:41:26.116998 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-e55f6823-0f95-4ab7-be7f-ed751d781f72 req-179023b2-63c5-4fc9-8bd4-6443d8afd544 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:41:26.117574 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-e55f6823-0f95-4ab7-be7f-ed751d781f72 req-179023b2-63c5-4fc9-8bd4-6443d8afd544 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:41:26.118027 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-e55f6823-0f95-4ab7-be7f-ed751d781f72 req-179023b2-63c5-4fc9-8bd4-6443d8afd544 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:41:26.131262 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-e55f6823-0f95-4ab7-be7f-ed751d781f72 req-179023b2-63c5-4fc9-8bd4-6443d8afd544 service nova] Creating event network-vif-unplugged:2becf889-435b-4e3b-841f-ab2ee960966d for instance c35a32ea-7024-4981-a41c-e3570b8fee57 on n-h1-860284-1 Oct 04 22:41:26.137110 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [req-e55f6823-0f95-4ab7-be7f-ed751d781f72 req-179023b2-63c5-4fc9-8bd4-6443d8afd544 service nova] Instance c35a32ea-7024-4981-a41c-e3570b8fee57 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860284-1', 'n-h1-860284-1'} {{(pid=134101) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 22:41:26.148647 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-e55f6823-0f95-4ab7-be7f-ed751d781f72 req-179023b2-63c5-4fc9-8bd4-6443d8afd544 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046659 Oct 04 22:41:26.149267 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3855/6889] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:41:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:41:26.477314 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-182cc778-4266-4136-af26-71891c8e59a2 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:41:26.477977 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-182cc778-4266-4136-af26-71891c8e59a2 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] [instance: c35a32ea-7024-4981-a41c-e3570b8fee57] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:41:26.485709 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-182cc778-4266-4136-af26-71891c8e59a2 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:41:26.486215 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-182cc778-4266-4136-af26-71891c8e59a2 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:41:26.486693 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-182cc778-4266-4136-af26-71891c8e59a2 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:41:26.487420 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-182cc778-4266-4136-af26-71891c8e59a2 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:41:26.487918 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-182cc778-4266-4136-af26-71891c8e59a2 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:41:26.488354 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-182cc778-4266-4136-af26-71891c8e59a2 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:41:26.491478 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:41:26.851543 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-182cc778-4266-4136-af26-71891c8e59a2 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc0ba9f45d04dec89394df46d6096a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2856184afa47f2b4349f7dea9e5569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:41:26.859884 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-182cc778-4266-4136-af26-71891c8e59a2 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] 10.222.0.43 "GET /compute/v2.1/servers/c35a32ea-7024-4981-a41c-e3570b8fee57" status: 200 len: 1690 microversion: 2.1 time: 0.386415 Oct 04 22:41:26.860397 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3035/6890] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:41:26 2022] GET /compute/v2.1/servers/c35a32ea-7024-4981-a41c-e3570b8fee57 => generated 1690 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:41:27.885167 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e6c0fc30-c356-4cb0-a343-8157e17bae76 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:41:27.885893 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-e6c0fc30-c356-4cb0-a343-8157e17bae76 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] [instance: c35a32ea-7024-4981-a41c-e3570b8fee57] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:41:27.892272 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e6c0fc30-c356-4cb0-a343-8157e17bae76 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:41:27.892773 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e6c0fc30-c356-4cb0-a343-8157e17bae76 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:41:27.893242 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e6c0fc30-c356-4cb0-a343-8157e17bae76 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:41:27.893948 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e6c0fc30-c356-4cb0-a343-8157e17bae76 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:41:27.894446 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e6c0fc30-c356-4cb0-a343-8157e17bae76 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:41:27.894893 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e6c0fc30-c356-4cb0-a343-8157e17bae76 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:41:28.025470 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-e6c0fc30-c356-4cb0-a343-8157e17bae76 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc0ba9f45d04dec89394df46d6096a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2856184afa47f2b4349f7dea9e5569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:41:28.033882 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-e6c0fc30-c356-4cb0-a343-8157e17bae76 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] 10.222.0.43 "GET /compute/v2.1/servers/c35a32ea-7024-4981-a41c-e3570b8fee57" status: 200 len: 1690 microversion: 2.1 time: 0.154204 Oct 04 22:41:28.034483 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3856/6891] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:41:27 2022] GET /compute/v2.1/servers/c35a32ea-7024-4981-a41c-e3570b8fee57 => generated 1690 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:41:28.164234 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-939935eb-b212-42a2-a874-a734b3d75068 req-700528e1-ffd5-4797-b681-a00d9fa128af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c35a32ea-7024-4981-a41c-e3570b8fee57", "tag": "2becf889-435b-4e3b-841f-ab2ee960966d"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:41:28.175245 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-939935eb-b212-42a2-a874-a734b3d75068 req-700528e1-ffd5-4797-b681-a00d9fa128af service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:41:28.175734 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-939935eb-b212-42a2-a874-a734b3d75068 req-700528e1-ffd5-4797-b681-a00d9fa128af service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:41:28.176173 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-939935eb-b212-42a2-a874-a734b3d75068 req-700528e1-ffd5-4797-b681-a00d9fa128af service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:41:28.187671 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-939935eb-b212-42a2-a874-a734b3d75068 req-700528e1-ffd5-4797-b681-a00d9fa128af service nova] Creating event network-changed:2becf889-435b-4e3b-841f-ab2ee960966d for instance c35a32ea-7024-4981-a41c-e3570b8fee57 on n-h1-860284-1 Oct 04 22:41:28.192896 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [req-939935eb-b212-42a2-a874-a734b3d75068 req-700528e1-ffd5-4797-b681-a00d9fa128af service nova] Instance c35a32ea-7024-4981-a41c-e3570b8fee57 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860284-1', 'n-h1-860284-1'} {{(pid=134102) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 22:41:28.203595 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-939935eb-b212-42a2-a874-a734b3d75068 req-700528e1-ffd5-4797-b681-a00d9fa128af service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043161 Oct 04 22:41:28.204192 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3036/6892] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:41:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:41:29.057182 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e129c9ed-383a-4468-957a-d1d9e1a92003 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:41:29.057820 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-e129c9ed-383a-4468-957a-d1d9e1a92003 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] [instance: c35a32ea-7024-4981-a41c-e3570b8fee57] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:41:29.065336 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e129c9ed-383a-4468-957a-d1d9e1a92003 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:41:29.065841 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e129c9ed-383a-4468-957a-d1d9e1a92003 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:41:29.066328 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e129c9ed-383a-4468-957a-d1d9e1a92003 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:41:29.067065 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e129c9ed-383a-4468-957a-d1d9e1a92003 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:41:29.067543 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e129c9ed-383a-4468-957a-d1d9e1a92003 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:41:29.067989 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e129c9ed-383a-4468-957a-d1d9e1a92003 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:41:29.202302 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-e129c9ed-383a-4468-957a-d1d9e1a92003 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc0ba9f45d04dec89394df46d6096a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2856184afa47f2b4349f7dea9e5569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:41:29.210111 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-e129c9ed-383a-4468-957a-d1d9e1a92003 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] 10.222.0.43 "GET /compute/v2.1/servers/c35a32ea-7024-4981-a41c-e3570b8fee57" status: 200 len: 1690 microversion: 2.1 time: 0.156930 Oct 04 22:41:29.210745 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3857/6893] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:41:29 2022] GET /compute/v2.1/servers/c35a32ea-7024-4981-a41c-e3570b8fee57 => generated 1690 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:41:30.235720 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-1b37708c-1ff6-49ff-b85b-2c8e505c2c06 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:41:30.236642 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-1b37708c-1ff6-49ff-b85b-2c8e505c2c06 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] [instance: c35a32ea-7024-4981-a41c-e3570b8fee57] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:41:30.243031 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1b37708c-1ff6-49ff-b85b-2c8e505c2c06 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:41:30.243521 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1b37708c-1ff6-49ff-b85b-2c8e505c2c06 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:41:30.243985 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1b37708c-1ff6-49ff-b85b-2c8e505c2c06 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:41:30.244688 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1b37708c-1ff6-49ff-b85b-2c8e505c2c06 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:41:30.245152 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1b37708c-1ff6-49ff-b85b-2c8e505c2c06 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:41:30.245587 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1b37708c-1ff6-49ff-b85b-2c8e505c2c06 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:41:30.458141 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-1b37708c-1ff6-49ff-b85b-2c8e505c2c06 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc0ba9f45d04dec89394df46d6096a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2856184afa47f2b4349f7dea9e5569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:41:30.465945 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-1b37708c-1ff6-49ff-b85b-2c8e505c2c06 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] 10.222.0.43 "GET /compute/v2.1/servers/c35a32ea-7024-4981-a41c-e3570b8fee57" status: 200 len: 1690 microversion: 2.1 time: 0.236514 Oct 04 22:41:30.466631 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3037/6894] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:41:30 2022] GET /compute/v2.1/servers/c35a32ea-7024-4981-a41c-e3570b8fee57 => generated 1690 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:41:31.490901 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-8e66fcdb-3e5c-4f47-9b30-f207c8e78215 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:41:31.491429 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-8e66fcdb-3e5c-4f47-9b30-f207c8e78215 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] [instance: c35a32ea-7024-4981-a41c-e3570b8fee57] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:41:31.498295 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8e66fcdb-3e5c-4f47-9b30-f207c8e78215 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:41:31.498856 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8e66fcdb-3e5c-4f47-9b30-f207c8e78215 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:41:31.499982 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8e66fcdb-3e5c-4f47-9b30-f207c8e78215 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:41:31.500773 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8e66fcdb-3e5c-4f47-9b30-f207c8e78215 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:41:31.501248 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8e66fcdb-3e5c-4f47-9b30-f207c8e78215 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:41:31.501691 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8e66fcdb-3e5c-4f47-9b30-f207c8e78215 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:41:31.506057 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=100 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:41:31.636555 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-8e66fcdb-3e5c-4f47-9b30-f207c8e78215 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc0ba9f45d04dec89394df46d6096a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2856184afa47f2b4349f7dea9e5569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:41:31.644282 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-8e66fcdb-3e5c-4f47-9b30-f207c8e78215 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] 10.222.0.43 "GET /compute/v2.1/servers/c35a32ea-7024-4981-a41c-e3570b8fee57" status: 200 len: 1683 microversion: 2.1 time: 0.157487 Oct 04 22:41:31.644847 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3858/6895] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:41:31 2022] GET /compute/v2.1/servers/c35a32ea-7024-4981-a41c-e3570b8fee57 => generated 1683 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:41:32.074603 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-478e8362-dfdb-49e8-a2a8-592673e5ca4e req-e3357b36-54cd-4d68-bf3c-2b7736574df7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c35a32ea-7024-4981-a41c-e3570b8fee57", "name": "network-vif-plugged", "status": "completed", "tag": "2becf889-435b-4e3b-841f-ab2ee960966d"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:41:32.085531 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-478e8362-dfdb-49e8-a2a8-592673e5ca4e req-e3357b36-54cd-4d68-bf3c-2b7736574df7 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:41:32.086022 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-478e8362-dfdb-49e8-a2a8-592673e5ca4e req-e3357b36-54cd-4d68-bf3c-2b7736574df7 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:41:32.086497 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-478e8362-dfdb-49e8-a2a8-592673e5ca4e req-e3357b36-54cd-4d68-bf3c-2b7736574df7 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:41:32.098564 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-478e8362-dfdb-49e8-a2a8-592673e5ca4e req-e3357b36-54cd-4d68-bf3c-2b7736574df7 service nova] Creating event network-vif-plugged:2becf889-435b-4e3b-841f-ab2ee960966d for instance c35a32ea-7024-4981-a41c-e3570b8fee57 on n-h1-860284-1 Oct 04 22:41:32.103665 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-478e8362-dfdb-49e8-a2a8-592673e5ca4e req-e3357b36-54cd-4d68-bf3c-2b7736574df7 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033438 Oct 04 22:41:32.104268 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3038/6896] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:41:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:42:05.881432 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=36 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:42:05.882213 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=4 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:42:05.949579 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-c0ff2074-ed18-4149-b0b3-c6d1b442985b tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:42:05.952277 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-c0ff2074-ed18-4149-b0b3-c6d1b442985b tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] [instance: c35a32ea-7024-4981-a41c-e3570b8fee57] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:42:05.958552 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c0ff2074-ed18-4149-b0b3-c6d1b442985b tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:42:05.959104 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c0ff2074-ed18-4149-b0b3-c6d1b442985b tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:42:05.959565 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c0ff2074-ed18-4149-b0b3-c6d1b442985b tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:42:05.960280 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c0ff2074-ed18-4149-b0b3-c6d1b442985b tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:42:05.960755 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c0ff2074-ed18-4149-b0b3-c6d1b442985b tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:42:05.961206 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c0ff2074-ed18-4149-b0b3-c6d1b442985b tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:42:06.017003 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-c0ff2074-ed18-4149-b0b3-c6d1b442985b tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] 10.222.0.43 "POST /compute/v2.1/servers/c35a32ea-7024-4981-a41c-e3570b8fee57/action" status: 200 len: 62993 microversion: 2.1 time: 0.140838 Oct 04 22:42:06.017629 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3859/6897] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 22:42:05 2022] POST /compute/v2.1/servers/c35a32ea-7024-4981-a41c-e3570b8fee57/action => generated 62993 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 22:42:28.760683 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_api:SELECT=42 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:42:28.761428 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=17 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:42:28.819221 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-875ce954-7462-4fb3-b58d-e90d08de5bfa tempest-TestNetworkAdvancedServerOps-1759506676 tempest-TestNetworkAdvancedServerOps-1759506676-project-admin] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:42:28.819929 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-875ce954-7462-4fb3-b58d-e90d08de5bfa tempest-TestNetworkAdvancedServerOps-1759506676 tempest-TestNetworkAdvancedServerOps-1759506676-project-admin] [instance: c35a32ea-7024-4981-a41c-e3570b8fee57] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:42:28.826120 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-875ce954-7462-4fb3-b58d-e90d08de5bfa tempest-TestNetworkAdvancedServerOps-1759506676 tempest-TestNetworkAdvancedServerOps-1759506676-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:42:28.826613 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-875ce954-7462-4fb3-b58d-e90d08de5bfa tempest-TestNetworkAdvancedServerOps-1759506676 tempest-TestNetworkAdvancedServerOps-1759506676-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:42:28.827051 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-875ce954-7462-4fb3-b58d-e90d08de5bfa tempest-TestNetworkAdvancedServerOps-1759506676 tempest-TestNetworkAdvancedServerOps-1759506676-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:42:28.827734 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-875ce954-7462-4fb3-b58d-e90d08de5bfa tempest-TestNetworkAdvancedServerOps-1759506676 tempest-TestNetworkAdvancedServerOps-1759506676-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:42:28.828183 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-875ce954-7462-4fb3-b58d-e90d08de5bfa tempest-TestNetworkAdvancedServerOps-1759506676 tempest-TestNetworkAdvancedServerOps-1759506676-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:42:28.828607 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-875ce954-7462-4fb3-b58d-e90d08de5bfa tempest-TestNetworkAdvancedServerOps-1759506676 tempest-TestNetworkAdvancedServerOps-1759506676-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:42:28.964499 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-875ce954-7462-4fb3-b58d-e90d08de5bfa tempest-TestNetworkAdvancedServerOps-1759506676 tempest-TestNetworkAdvancedServerOps-1759506676-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/c35a32ea-7024-4981-a41c-e3570b8fee57" status: 200 len: 1834 microversion: 2.1 time: 0.206089 Oct 04 22:42:28.965075 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3039/6898] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:42:28 2022] GET /compute/v2.1/servers/c35a32ea-7024-4981-a41c-e3570b8fee57 => generated 1834 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:42:29.814771 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-1e4838dd-853e-46fb-a7f9-eabcde58690f tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:42:29.815450 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-1e4838dd-853e-46fb-a7f9-eabcde58690f tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] [instance: c35a32ea-7024-4981-a41c-e3570b8fee57] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:42:29.818063 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=2 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:42:29.818774 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=4 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:42:29.826294 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1e4838dd-853e-46fb-a7f9-eabcde58690f tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:42:29.827167 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1e4838dd-853e-46fb-a7f9-eabcde58690f tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:42:29.827864 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1e4838dd-853e-46fb-a7f9-eabcde58690f tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:42:29.828592 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1e4838dd-853e-46fb-a7f9-eabcde58690f tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:42:29.829060 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1e4838dd-853e-46fb-a7f9-eabcde58690f tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:42:29.829498 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1e4838dd-853e-46fb-a7f9-eabcde58690f tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:42:29.857737 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-1e4838dd-853e-46fb-a7f9-eabcde58690f tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] [instance: c35a32ea-7024-4981-a41c-e3570b8fee57] Going to try to terminate instance {{(pid=134101) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 22:42:29.924311 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-3784e685-8ff5-44d8-98da-8ffd938dccb6 req-f9746d83-09f2-40ff-8b34-35c0e8cef0f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c35a32ea-7024-4981-a41c-e3570b8fee57", "tag": "2becf889-435b-4e3b-841f-ab2ee960966d"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:42:29.935021 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-3784e685-8ff5-44d8-98da-8ffd938dccb6 req-f9746d83-09f2-40ff-8b34-35c0e8cef0f2 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:42:29.936592 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-3784e685-8ff5-44d8-98da-8ffd938dccb6 req-f9746d83-09f2-40ff-8b34-35c0e8cef0f2 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:42:29.937140 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-3784e685-8ff5-44d8-98da-8ffd938dccb6 req-f9746d83-09f2-40ff-8b34-35c0e8cef0f2 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:42:29.948963 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-1e4838dd-853e-46fb-a7f9-eabcde58690f tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] 10.222.0.43 "DELETE /compute/v2.1/servers/c35a32ea-7024-4981-a41c-e3570b8fee57" status: 204 len: 0 microversion: 2.1 time: 0.138898 Oct 04 22:42:29.949216 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-3784e685-8ff5-44d8-98da-8ffd938dccb6 req-f9746d83-09f2-40ff-8b34-35c0e8cef0f2 service nova] Creating event network-changed:2becf889-435b-4e3b-841f-ab2ee960966d for instance c35a32ea-7024-4981-a41c-e3570b8fee57 on n-h1-860284-1 Oct 04 22:42:29.952889 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3860/6899] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 22:42:29 2022] DELETE /compute/v2.1/servers/c35a32ea-7024-4981-a41c-e3570b8fee57 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 22:42:29.955213 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-3784e685-8ff5-44d8-98da-8ffd938dccb6 req-f9746d83-09f2-40ff-8b34-35c0e8cef0f2 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089531 Oct 04 22:42:29.959126 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3040/6900] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:42:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:42:29.959257 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-f55484f1-b939-4dfa-8378-8523ab5f6b6c tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:42:29.960188 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-f55484f1-b939-4dfa-8378-8523ab5f6b6c tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] [instance: c35a32ea-7024-4981-a41c-e3570b8fee57] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:42:29.967249 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f55484f1-b939-4dfa-8378-8523ab5f6b6c tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:42:29.967743 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f55484f1-b939-4dfa-8378-8523ab5f6b6c tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:42:29.968361 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f55484f1-b939-4dfa-8378-8523ab5f6b6c tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:42:29.968911 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f55484f1-b939-4dfa-8378-8523ab5f6b6c tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:42:29.969375 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f55484f1-b939-4dfa-8378-8523ab5f6b6c tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:42:29.970076 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f55484f1-b939-4dfa-8378-8523ab5f6b6c tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:42:30.117246 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-f55484f1-b939-4dfa-8378-8523ab5f6b6c tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc0ba9f45d04dec89394df46d6096a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2856184afa47f2b4349f7dea9e5569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:42:30.125438 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-f55484f1-b939-4dfa-8378-8523ab5f6b6c tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] 10.222.0.43 "GET /compute/v2.1/servers/c35a32ea-7024-4981-a41c-e3570b8fee57" status: 200 len: 1689 microversion: 2.1 time: 0.171013 Oct 04 22:42:30.126107 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3861/6901] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:42:29 2022] GET /compute/v2.1/servers/c35a32ea-7024-4981-a41c-e3570b8fee57 => generated 1689 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:42:31.150960 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-c6d64e23-d06b-4755-bf64-01d6849e0d61 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:42:31.151541 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-c6d64e23-d06b-4755-bf64-01d6849e0d61 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] [instance: c35a32ea-7024-4981-a41c-e3570b8fee57] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:42:31.158581 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c6d64e23-d06b-4755-bf64-01d6849e0d61 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:42:31.159082 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c6d64e23-d06b-4755-bf64-01d6849e0d61 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:42:31.159545 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c6d64e23-d06b-4755-bf64-01d6849e0d61 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:42:31.160246 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c6d64e23-d06b-4755-bf64-01d6849e0d61 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:42:31.160738 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c6d64e23-d06b-4755-bf64-01d6849e0d61 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:42:31.161168 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c6d64e23-d06b-4755-bf64-01d6849e0d61 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:42:31.329659 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-c6d64e23-d06b-4755-bf64-01d6849e0d61 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc0ba9f45d04dec89394df46d6096a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2856184afa47f2b4349f7dea9e5569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:42:31.337836 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-c6d64e23-d06b-4755-bf64-01d6849e0d61 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] 10.222.0.43 "GET /compute/v2.1/servers/c35a32ea-7024-4981-a41c-e3570b8fee57" status: 200 len: 1689 microversion: 2.1 time: 0.192381 Oct 04 22:42:31.338430 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3041/6902] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:42:31 2022] GET /compute/v2.1/servers/c35a32ea-7024-4981-a41c-e3570b8fee57 => generated 1689 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:42:32.235583 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-d58ff287-9c1c-4ccf-902c-fee98ec846b9 req-269a353e-765e-4afe-ad92-6a98bdcaf21b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c35a32ea-7024-4981-a41c-e3570b8fee57", "name": "network-vif-deleted", "tag": "2becf889-435b-4e3b-841f-ab2ee960966d"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:42:32.248401 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-d58ff287-9c1c-4ccf-902c-fee98ec846b9 req-269a353e-765e-4afe-ad92-6a98bdcaf21b service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:42:32.249149 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-d58ff287-9c1c-4ccf-902c-fee98ec846b9 req-269a353e-765e-4afe-ad92-6a98bdcaf21b service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:42:32.249600 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-d58ff287-9c1c-4ccf-902c-fee98ec846b9 req-269a353e-765e-4afe-ad92-6a98bdcaf21b service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:42:32.261763 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-d58ff287-9c1c-4ccf-902c-fee98ec846b9 req-269a353e-765e-4afe-ad92-6a98bdcaf21b service nova] Creating event network-vif-deleted:2becf889-435b-4e3b-841f-ab2ee960966d for instance c35a32ea-7024-4981-a41c-e3570b8fee57 on n-h1-860284-1 Oct 04 22:42:32.267020 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-d58ff287-9c1c-4ccf-902c-fee98ec846b9 req-269a353e-765e-4afe-ad92-6a98bdcaf21b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035626 Oct 04 22:42:32.267732 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3862/6903] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:42:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:42:32.361622 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-0b23ba55-d72c-4c65-b7be-7fc02fccd02d tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:42:32.362236 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-0b23ba55-d72c-4c65-b7be-7fc02fccd02d tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] [instance: c35a32ea-7024-4981-a41c-e3570b8fee57] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:42:32.368978 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0b23ba55-d72c-4c65-b7be-7fc02fccd02d tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:42:32.369646 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0b23ba55-d72c-4c65-b7be-7fc02fccd02d tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:42:32.370246 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0b23ba55-d72c-4c65-b7be-7fc02fccd02d tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:42:32.370983 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0b23ba55-d72c-4c65-b7be-7fc02fccd02d tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:42:32.372029 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0b23ba55-d72c-4c65-b7be-7fc02fccd02d tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:42:32.372516 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0b23ba55-d72c-4c65-b7be-7fc02fccd02d tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:42:32.406423 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0b23ba55-d72c-4c65-b7be-7fc02fccd02d tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:42:32.406920 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0b23ba55-d72c-4c65-b7be-7fc02fccd02d tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:42:32.407394 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0b23ba55-d72c-4c65-b7be-7fc02fccd02d tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:42:32.407850 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.objects.instance [None req-0b23ba55-d72c-4c65-b7be-7fc02fccd02d tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lazy-loading 'fault' on Instance uuid c35a32ea-7024-4981-a41c-e3570b8fee57 {{(pid=134102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 22:42:32.447732 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-0b23ba55-d72c-4c65-b7be-7fc02fccd02d tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc0ba9f45d04dec89394df46d6096a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2856184afa47f2b4349f7dea9e5569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:42:32.456657 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-0b23ba55-d72c-4c65-b7be-7fc02fccd02d tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] 10.222.0.43 "GET /compute/v2.1/servers/c35a32ea-7024-4981-a41c-e3570b8fee57" status: 200 len: 1356 microversion: 2.1 time: 0.099066 Oct 04 22:42:32.457246 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3042/6904] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:42:32 2022] GET /compute/v2.1/servers/c35a32ea-7024-4981-a41c-e3570b8fee57 => generated 1356 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:42:33.482478 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-cfe66583-2b5c-49e5-b08f-800e822e9f8e tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:42:33.483140 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-cfe66583-2b5c-49e5-b08f-800e822e9f8e tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] [instance: c35a32ea-7024-4981-a41c-e3570b8fee57] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:42:33.489363 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cfe66583-2b5c-49e5-b08f-800e822e9f8e tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:42:33.489867 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cfe66583-2b5c-49e5-b08f-800e822e9f8e tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:42:33.490328 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cfe66583-2b5c-49e5-b08f-800e822e9f8e tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:42:33.491102 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cfe66583-2b5c-49e5-b08f-800e822e9f8e tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:42:33.491578 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cfe66583-2b5c-49e5-b08f-800e822e9f8e tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:42:33.492027 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cfe66583-2b5c-49e5-b08f-800e822e9f8e tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:42:33.508332 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-cfe66583-2b5c-49e5-b08f-800e822e9f8e tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] HTTP exception thrown: Instance c35a32ea-7024-4981-a41c-e3570b8fee57 could not be found. Oct 04 22:42:33.509965 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-cfe66583-2b5c-49e5-b08f-800e822e9f8e tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Request method failure captured: Oct 04 22:42:33.509965 n-d-860284-1 devstack@n-api.service[134101]: request: GET /compute/v2.1/servers/c35a32ea-7024-4981-a41c-e3570b8fee57 HTTP/1.1 Oct 04 22:42:33.509965 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 22:42:33.509965 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 22:42:33.509965 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 22:42:33.509965 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 22:42:33.509965 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 22:42:33.509965 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 22:42:33.509965 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 22:42:33.509965 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 22:42:33.509965 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPLV0i4fTyng2qLmqpOZDonbjmzoxCV_51fHF-2sehfrgMV9QVuGfN-Zf-uieedzXZTWMfP9hC44tva1SBwtRF8VLus6BFLrvLfEQUnNKLdCLmtRz5RQ2K95IuirNrCK0fpkR4wYvfI0Vw9CX7gwLNdKW8QNt5h37SFpMjtwukn05Yn0 Oct 04 22:42:33.509965 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 22:42:33.509965 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 22:42:33.509965 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 22:42:33.509965 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 22:42:33.509965 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 22:42:33.509965 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 22:42:33.509965 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: fd2856184afa47f2b4349f7dea9e5569 Oct 04 22:42:33.509965 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1049323607 Oct 04 22:42:33.509965 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 22:42:33.509965 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 22:42:33.509965 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/fd2856184afa47f2b4349f7dea9e5569"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_fd2856184afa47f2b4349f7dea9e5569", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/fd2856184afa47f2b4349f7dea9e5569"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/fd2856184afa47f2b4349f7dea9e5569"}]}] Oct 04 22:42:33.509965 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1049323607 Oct 04 22:42:33.509965 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: fd2856184afa47f2b4349f7dea9e5569 Oct 04 22:42:33.509965 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1049323607 Oct 04 22:42:33.509965 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-TestNetworkAdvancedServerOps-1049323607-project Oct 04 22:42:33.509965 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 22:42:33.509965 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 22:42:33.509965 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: bbc0ba9f45d04dec89394df46d6096a3 Oct 04 22:42:33.509965 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1049323607-project Oct 04 22:42:33.509965 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 22:42:33.509965 n-d-860284-1 devstack@n-api.service[134101]: exception: Instance c35a32ea-7024-4981-a41c-e3570b8fee57 could not be found. Oct 04 22:42:33.509965 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': 'c35a32ea-7024-4981-a41c-e3570b8fee57'} Oct 04 22:42:33.509965 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:42:33.509965 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:42:33.509965 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:42:33.509965 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:42:33.509965 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:42:33.509965 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:42:33.509965 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:42:33.509965 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:42:33.509965 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:42:33.509965 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:42:33.509965 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c35a32ea-7024-4981-a41c-e3570b8fee57 could not be found. Oct 04 22:42:33.509965 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:42:33.509965 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:42:33.509965 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:42:33.509965 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:42:33.509965 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:42:33.509965 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:42:33.509965 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:42:33.509965 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:42:33.509965 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:42:33.509965 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:42:33.509965 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:42:33.509965 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:42:33.509965 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:42:33.509965 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:42:33.509965 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:42:33.509965 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:42:33.509965 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c35a32ea-7024-4981-a41c-e3570b8fee57 could not be found. Oct 04 22:42:33.509965 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:42:33.509965 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:42:33.514320 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:42:33.514320 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:42:33.514320 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:42:33.514320 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:42:33.514320 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:42:33.514320 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:42:33.514320 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c35a32ea-7024-4981-a41c-e3570b8fee57 could not be found. Oct 04 22:42:33.514320 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:42:33.514320 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-cfe66583-2b5c-49e5-b08f-800e822e9f8e tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Returning 404 to user: Instance c35a32ea-7024-4981-a41c-e3570b8fee57 could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:42:33.514320 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-cfe66583-2b5c-49e5-b08f-800e822e9f8e tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] 10.222.0.43 "GET /compute/v2.1/servers/c35a32ea-7024-4981-a41c-e3570b8fee57" status: 404 len: 111 microversion: 2.1 time: 0.034788 Oct 04 22:42:33.514320 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3863/6905] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:42:33 2022] GET /compute/v2.1/servers/c35a32ea-7024-4981-a41c-e3570b8fee57 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:42:36.536647 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-8aa34a9a-09fc-49b8-b8af-4f7217241ea5 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Calling method '.version_select at 0x7fbb2f053af0>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:42:36.541280 n-d-860284-1 devstack@n-api.service[134102]: ERROR oslo.messaging._drivers.impl_rabbit [None req-8aa34a9a-09fc-49b8-b8af-4f7217241ea5 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] [cca57954-a89d-4bbd-8f41-b6cb754a5397] AMQP server on 10.222.0.43:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 22:42:37.550695 n-d-860284-1 devstack@n-api.service[134102]: INFO oslo.messaging._drivers.impl_rabbit [None req-8aa34a9a-09fc-49b8-b8af-4f7217241ea5 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] [cca57954-a89d-4bbd-8f41-b6cb754a5397] Reconnected to AMQP server on 10.222.0.43:5672 via [amqp] client with port 34432. Oct 04 22:42:37.570319 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-8aa34a9a-09fc-49b8-b8af-4f7217241ea5 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-646888289" status: 202 len: 0 microversion: 2.1 time: 1.037534 Oct 04 22:42:37.570959 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3043/6906] 10.222.0.43 () {58 vars in 1281 bytes} [Tue Oct 4 22:42:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-646888289 => generated 0 bytes in 1039 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 22:42:37.606445 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-9db29b1d-4a5a-44f4-b3f4-150d3258b536 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Action: 'create', calling method: .version_select at 0x7fbb2c0a3790>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-180182756", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPh2BkJ/IdoWwofZW5YoECXT3BfcJ5OI39970y8W9z/l13DEt8Zzk24TfEqI0FQIHdgoUJq1FZcmjJd2msNT6kAzkPjJI+8T3mLBp49Gy8mzZipultM4d8h9AtmVTe6tbw=="}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:42:37.628680 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-9db29b1d-4a5a-44f4-b3f4-150d3258b536 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Getting quotas for project fd2856184afa47f2b4349f7dea9e5569. Resources: {'key_pairs'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:42:37.634019 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-9db29b1d-4a5a-44f4-b3f4-150d3258b536 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Getting quotas for user bbc0ba9f45d04dec89394df46d6096a3 and project fd2856184afa47f2b4349f7dea9e5569. Resources: {'key_pairs'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:42:37.647927 n-d-860284-1 devstack@n-api.service[134101]: ERROR oslo.messaging._drivers.impl_rabbit [None req-9db29b1d-4a5a-44f4-b3f4-150d3258b536 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] [54f0993b-fb22-4e4c-ae00-e3f0e5da4c18] AMQP server on 10.222.0.43:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 22:42:38.654966 n-d-860284-1 devstack@n-api.service[134101]: INFO oslo.messaging._drivers.impl_rabbit [None req-9db29b1d-4a5a-44f4-b3f4-150d3258b536 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] [54f0993b-fb22-4e4c-ae00-e3f0e5da4c18] Reconnected to AMQP server on 10.222.0.43:5672 via [amqp] client with port 34440. Oct 04 22:42:38.669060 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-9db29b1d-4a5a-44f4-b3f4-150d3258b536 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 1.066586 Oct 04 22:42:38.669804 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3864/6907] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Oct 4 22:42:37 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:42:44.174761 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-b24677d2-d37f-4caf-a93a-d59e7a3e35bf tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-925095449", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452", "networks": [{"uuid": "1c869965-9594-4681-94ff-8ecf149f4d1f"}], "key_name": "tempest-TestNetworkAdvancedServerOps-180182756", "security_groups": [{"name": "tempest-secgroup-smoke-1105385273"}]}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:42:44.203411 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=22 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:42:44.350850 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.network.neutron [None req-b24677d2-d37f-4caf-a93a-d59e7a3e35bf tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] validate_networks() for [('1c869965-9594-4681-94ff-8ecf149f4d1f', None, None, None, None, None)] {{(pid=134102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 22:42:44.867698 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-b24677d2-d37f-4caf-a93a-d59e7a3e35bf tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Flavor limits 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 22:42:44.868891 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-b24677d2-d37f-4caf-a93a-d59e7a3e35bf tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Image limits 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 22:42:44.869352 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-b24677d2-d37f-4caf-a93a-d59e7a3e35bf tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Flavor pref 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 22:42:44.869817 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-b24677d2-d37f-4caf-a93a-d59e7a3e35bf tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Image pref 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 22:42:44.870755 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-b24677d2-d37f-4caf-a93a-d59e7a3e35bf tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 22:42:44.882777 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b24677d2-d37f-4caf-a93a-d59e7a3e35bf tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:42:44.883264 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b24677d2-d37f-4caf-a93a-d59e7a3e35bf tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:42:44.883711 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b24677d2-d37f-4caf-a93a-d59e7a3e35bf tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:42:44.884426 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b24677d2-d37f-4caf-a93a-d59e7a3e35bf tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:42:44.884902 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b24677d2-d37f-4caf-a93a-d59e7a3e35bf tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:42:44.885324 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b24677d2-d37f-4caf-a93a-d59e7a3e35bf tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:42:44.907540 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-b24677d2-d37f-4caf-a93a-d59e7a3e35bf tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Getting quotas for project fd2856184afa47f2b4349f7dea9e5569. Resources: {'instances', 'ram', 'cores'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:42:44.913010 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-b24677d2-d37f-4caf-a93a-d59e7a3e35bf tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Getting quotas for user bbc0ba9f45d04dec89394df46d6096a3 and project fd2856184afa47f2b4349f7dea9e5569. Resources: {'instances', 'ram', 'cores'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:42:44.925259 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-b24677d2-d37f-4caf-a93a-d59e7a3e35bf tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Going to run 1 instances... {{(pid=134102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 22:42:44.927615 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-b24677d2-d37f-4caf-a93a-d59e7a3e35bf tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] [instance: 33adc582-3420-40d7-b2db-768c73f7607d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='58548514-5dac-426c-81f5-19e3fba33e23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 22:42:44.975331 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-b24677d2-d37f-4caf-a93a-d59e7a3e35bf tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.804564 Oct 04 22:42:44.976193 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3044/6908] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 22:42:44 2022] POST /compute/v2.1/servers => generated 406 bytes in 806 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 22:42:44.986127 n-d-860284-1 devstack@n-api.service[134101]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 22:42:44.986943 n-d-860284-1 devstack@n-api.service[134101]: Tue Oct 4 22:42:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/33adc582-3420-40d7-b2db-768c73f7607d (ip 10.222.0.43) !!! Oct 04 22:42:44.988994 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:42:44.995885 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-5c202457-82bb-4811-9c01-002206b9560a tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:42:44.996804 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-5c202457-82bb-4811-9c01-002206b9560a tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] [instance: 33adc582-3420-40d7-b2db-768c73f7607d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:42:45.070483 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-5c202457-82bb-4811-9c01-002206b9560a tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc0ba9f45d04dec89394df46d6096a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2856184afa47f2b4349f7dea9e5569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:42:45.080177 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-5c202457-82bb-4811-9c01-002206b9560a tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] 10.222.0.43 "GET /compute/v2.1/servers/33adc582-3420-40d7-b2db-768c73f7607d" status: 200 len: 1265 microversion: 2.1 time: 0.096459 Oct 04 22:42:45.080923 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3865/6909] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:42:44 2022] GET /compute/v2.1/servers/33adc582-3420-40d7-b2db-768c73f7607d => generated 1265 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:42:46.106462 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-f031be5a-8d08-49f9-a8a0-dfa00eb32aee tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:42:46.107769 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-f031be5a-8d08-49f9-a8a0-dfa00eb32aee tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] [instance: 33adc582-3420-40d7-b2db-768c73f7607d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:42:46.120582 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f031be5a-8d08-49f9-a8a0-dfa00eb32aee tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:42:46.121625 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f031be5a-8d08-49f9-a8a0-dfa00eb32aee tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:42:46.122773 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f031be5a-8d08-49f9-a8a0-dfa00eb32aee tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:42:46.123753 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f031be5a-8d08-49f9-a8a0-dfa00eb32aee tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:42:46.124380 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f031be5a-8d08-49f9-a8a0-dfa00eb32aee tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:42:46.125540 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f031be5a-8d08-49f9-a8a0-dfa00eb32aee tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:42:46.222324 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-f031be5a-8d08-49f9-a8a0-dfa00eb32aee tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc0ba9f45d04dec89394df46d6096a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2856184afa47f2b4349f7dea9e5569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:42:46.230776 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-f031be5a-8d08-49f9-a8a0-dfa00eb32aee tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] 10.222.0.43 "GET /compute/v2.1/servers/33adc582-3420-40d7-b2db-768c73f7607d" status: 200 len: 1325 microversion: 2.1 time: 0.129076 Oct 04 22:42:46.240563 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3045/6910] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:42:46 2022] GET /compute/v2.1/servers/33adc582-3420-40d7-b2db-768c73f7607d => generated 1325 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:42:47.254563 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-6f4ff7fb-2a5a-461e-b8a5-690ccd68f442 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:42:47.256051 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-6f4ff7fb-2a5a-461e-b8a5-690ccd68f442 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] [instance: 33adc582-3420-40d7-b2db-768c73f7607d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:42:47.262270 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6f4ff7fb-2a5a-461e-b8a5-690ccd68f442 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:42:47.263056 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6f4ff7fb-2a5a-461e-b8a5-690ccd68f442 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:42:47.263628 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6f4ff7fb-2a5a-461e-b8a5-690ccd68f442 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:42:47.264361 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6f4ff7fb-2a5a-461e-b8a5-690ccd68f442 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:42:47.264838 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6f4ff7fb-2a5a-461e-b8a5-690ccd68f442 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:42:47.265474 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6f4ff7fb-2a5a-461e-b8a5-690ccd68f442 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:42:47.410781 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-6f4ff7fb-2a5a-461e-b8a5-690ccd68f442 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc0ba9f45d04dec89394df46d6096a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2856184afa47f2b4349f7dea9e5569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:42:47.419465 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-6f4ff7fb-2a5a-461e-b8a5-690ccd68f442 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] 10.222.0.43 "GET /compute/v2.1/servers/33adc582-3420-40d7-b2db-768c73f7607d" status: 200 len: 1391 microversion: 2.1 time: 0.168958 Oct 04 22:42:47.420073 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3866/6911] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:42:47 2022] GET /compute/v2.1/servers/33adc582-3420-40d7-b2db-768c73f7607d => generated 1391 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:42:47.843485 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-a0a82216-476f-4102-87e3-2916491f9bd4 req-5d997bb9-813d-4aea-8fb9-4548a2f8130d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33adc582-3420-40d7-b2db-768c73f7607d", "tag": "3d04717a-bc15-4176-a4cb-a146fbb750c7"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:42:47.853332 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-a0a82216-476f-4102-87e3-2916491f9bd4 req-5d997bb9-813d-4aea-8fb9-4548a2f8130d service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:42:47.853849 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-a0a82216-476f-4102-87e3-2916491f9bd4 req-5d997bb9-813d-4aea-8fb9-4548a2f8130d service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:42:47.854264 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-a0a82216-476f-4102-87e3-2916491f9bd4 req-5d997bb9-813d-4aea-8fb9-4548a2f8130d service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:42:47.866385 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-a0a82216-476f-4102-87e3-2916491f9bd4 req-5d997bb9-813d-4aea-8fb9-4548a2f8130d service nova] Creating event network-changed:3d04717a-bc15-4176-a4cb-a146fbb750c7 for instance 33adc582-3420-40d7-b2db-768c73f7607d on n-h2-860284-1 Oct 04 22:42:47.871412 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-a0a82216-476f-4102-87e3-2916491f9bd4 req-5d997bb9-813d-4aea-8fb9-4548a2f8130d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087873 Oct 04 22:42:47.872221 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3046/6912] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:42:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:42:48.443726 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-c22c6534-f3c6-4b33-b89e-1952d641d126 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:42:48.444368 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-c22c6534-f3c6-4b33-b89e-1952d641d126 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] [instance: 33adc582-3420-40d7-b2db-768c73f7607d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:42:48.453488 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c22c6534-f3c6-4b33-b89e-1952d641d126 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:42:48.454686 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c22c6534-f3c6-4b33-b89e-1952d641d126 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:42:48.455794 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c22c6534-f3c6-4b33-b89e-1952d641d126 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:42:48.456458 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c22c6534-f3c6-4b33-b89e-1952d641d126 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:42:48.457149 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c22c6534-f3c6-4b33-b89e-1952d641d126 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:42:48.457673 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c22c6534-f3c6-4b33-b89e-1952d641d126 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:42:48.600164 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-c22c6534-f3c6-4b33-b89e-1952d641d126 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc0ba9f45d04dec89394df46d6096a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2856184afa47f2b4349f7dea9e5569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:42:48.609161 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-c22c6534-f3c6-4b33-b89e-1952d641d126 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] 10.222.0.43 "GET /compute/v2.1/servers/33adc582-3420-40d7-b2db-768c73f7607d" status: 200 len: 1391 microversion: 2.1 time: 0.169392 Oct 04 22:42:48.609765 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3867/6913] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:42:48 2022] GET /compute/v2.1/servers/33adc582-3420-40d7-b2db-768c73f7607d => generated 1391 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:42:49.633627 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-5b2755f5-df2a-4dde-ba17-a9b77f69876d tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:42:49.634333 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-5b2755f5-df2a-4dde-ba17-a9b77f69876d tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] [instance: 33adc582-3420-40d7-b2db-768c73f7607d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:42:49.640600 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5b2755f5-df2a-4dde-ba17-a9b77f69876d tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:42:49.641088 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5b2755f5-df2a-4dde-ba17-a9b77f69876d tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:42:49.641526 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5b2755f5-df2a-4dde-ba17-a9b77f69876d tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:42:49.642265 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5b2755f5-df2a-4dde-ba17-a9b77f69876d tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:42:49.642757 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5b2755f5-df2a-4dde-ba17-a9b77f69876d tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:42:49.643192 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5b2755f5-df2a-4dde-ba17-a9b77f69876d tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:42:49.771519 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-5b2755f5-df2a-4dde-ba17-a9b77f69876d tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc0ba9f45d04dec89394df46d6096a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2856184afa47f2b4349f7dea9e5569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:42:49.779739 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-5b2755f5-df2a-4dde-ba17-a9b77f69876d tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] 10.222.0.43 "GET /compute/v2.1/servers/33adc582-3420-40d7-b2db-768c73f7607d" status: 200 len: 1391 microversion: 2.1 time: 0.151541 Oct 04 22:42:49.780318 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3047/6914] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:42:49 2022] GET /compute/v2.1/servers/33adc582-3420-40d7-b2db-768c73f7607d => generated 1391 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:42:50.802790 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-33dc7e0d-e29a-4126-82a1-8983c6cdfb0c tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:42:50.803456 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-33dc7e0d-e29a-4126-82a1-8983c6cdfb0c tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] [instance: 33adc582-3420-40d7-b2db-768c73f7607d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:42:50.810961 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-33dc7e0d-e29a-4126-82a1-8983c6cdfb0c tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:42:50.811466 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-33dc7e0d-e29a-4126-82a1-8983c6cdfb0c tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:42:50.811914 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-33dc7e0d-e29a-4126-82a1-8983c6cdfb0c tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:42:50.812632 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-33dc7e0d-e29a-4126-82a1-8983c6cdfb0c tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:42:50.813104 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-33dc7e0d-e29a-4126-82a1-8983c6cdfb0c tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:42:50.813550 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-33dc7e0d-e29a-4126-82a1-8983c6cdfb0c tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:42:50.952955 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-33dc7e0d-e29a-4126-82a1-8983c6cdfb0c tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc0ba9f45d04dec89394df46d6096a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2856184afa47f2b4349f7dea9e5569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:42:50.960930 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-33dc7e0d-e29a-4126-82a1-8983c6cdfb0c tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] 10.222.0.43 "GET /compute/v2.1/servers/33adc582-3420-40d7-b2db-768c73f7607d" status: 200 len: 1391 microversion: 2.1 time: 0.162084 Oct 04 22:42:50.961528 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3868/6915] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:42:50 2022] GET /compute/v2.1/servers/33adc582-3420-40d7-b2db-768c73f7607d => generated 1391 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:42:51.985171 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-a29744d5-be78-4ea0-b751-c8d481c1b983 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:42:51.985795 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-a29744d5-be78-4ea0-b751-c8d481c1b983 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] [instance: 33adc582-3420-40d7-b2db-768c73f7607d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:42:51.992819 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a29744d5-be78-4ea0-b751-c8d481c1b983 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:42:51.993338 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a29744d5-be78-4ea0-b751-c8d481c1b983 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:42:51.993787 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a29744d5-be78-4ea0-b751-c8d481c1b983 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:42:51.994516 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a29744d5-be78-4ea0-b751-c8d481c1b983 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:42:51.994978 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a29744d5-be78-4ea0-b751-c8d481c1b983 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:42:51.995409 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a29744d5-be78-4ea0-b751-c8d481c1b983 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:42:52.133417 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-a29744d5-be78-4ea0-b751-c8d481c1b983 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc0ba9f45d04dec89394df46d6096a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2856184afa47f2b4349f7dea9e5569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:42:52.141194 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-a29744d5-be78-4ea0-b751-c8d481c1b983 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] 10.222.0.43 "GET /compute/v2.1/servers/33adc582-3420-40d7-b2db-768c73f7607d" status: 200 len: 1391 microversion: 2.1 time: 0.160564 Oct 04 22:42:52.141774 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3048/6916] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:42:51 2022] GET /compute/v2.1/servers/33adc582-3420-40d7-b2db-768c73f7607d => generated 1391 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:42:53.163990 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-89555f61-5b8d-49e0-85fc-be6eae8088f1 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:42:53.164563 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-89555f61-5b8d-49e0-85fc-be6eae8088f1 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] [instance: 33adc582-3420-40d7-b2db-768c73f7607d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:42:53.172218 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-89555f61-5b8d-49e0-85fc-be6eae8088f1 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:42:53.172725 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-89555f61-5b8d-49e0-85fc-be6eae8088f1 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:42:53.173186 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-89555f61-5b8d-49e0-85fc-be6eae8088f1 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:42:53.173898 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-89555f61-5b8d-49e0-85fc-be6eae8088f1 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:42:53.174391 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-89555f61-5b8d-49e0-85fc-be6eae8088f1 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:42:53.174847 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-89555f61-5b8d-49e0-85fc-be6eae8088f1 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:42:53.304960 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-89555f61-5b8d-49e0-85fc-be6eae8088f1 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc0ba9f45d04dec89394df46d6096a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2856184afa47f2b4349f7dea9e5569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:42:53.313468 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-89555f61-5b8d-49e0-85fc-be6eae8088f1 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] 10.222.0.43 "GET /compute/v2.1/servers/33adc582-3420-40d7-b2db-768c73f7607d" status: 200 len: 1391 microversion: 2.1 time: 0.153553 Oct 04 22:42:53.314034 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3869/6917] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:42:53 2022] GET /compute/v2.1/servers/33adc582-3420-40d7-b2db-768c73f7607d => generated 1391 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:42:53.917618 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-ecd27064-e68b-4747-9f42-6e5ef391b35a req-0f560ef9-d7fa-4d9a-9433-03b9490caa63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33adc582-3420-40d7-b2db-768c73f7607d", "name": "network-vif-plugged", "status": "completed", "tag": "3d04717a-bc15-4176-a4cb-a146fbb750c7"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:42:53.927203 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-ecd27064-e68b-4747-9f42-6e5ef391b35a req-0f560ef9-d7fa-4d9a-9433-03b9490caa63 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:42:53.927678 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-ecd27064-e68b-4747-9f42-6e5ef391b35a req-0f560ef9-d7fa-4d9a-9433-03b9490caa63 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:42:53.928101 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-ecd27064-e68b-4747-9f42-6e5ef391b35a req-0f560ef9-d7fa-4d9a-9433-03b9490caa63 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:42:53.939097 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-ecd27064-e68b-4747-9f42-6e5ef391b35a req-0f560ef9-d7fa-4d9a-9433-03b9490caa63 service nova] Creating event network-vif-plugged:3d04717a-bc15-4176-a4cb-a146fbb750c7 for instance 33adc582-3420-40d7-b2db-768c73f7607d on n-h2-860284-1 Oct 04 22:42:53.944127 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-ecd27064-e68b-4747-9f42-6e5ef391b35a req-0f560ef9-d7fa-4d9a-9433-03b9490caa63 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080830 Oct 04 22:42:53.944796 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3049/6918] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:42:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:42:54.336636 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-1997d2fb-ee73-4d7b-83c5-c54338e9129a tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:42:54.337269 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-1997d2fb-ee73-4d7b-83c5-c54338e9129a tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] [instance: 33adc582-3420-40d7-b2db-768c73f7607d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:42:54.344766 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1997d2fb-ee73-4d7b-83c5-c54338e9129a tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:42:54.345266 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1997d2fb-ee73-4d7b-83c5-c54338e9129a tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:42:54.345722 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1997d2fb-ee73-4d7b-83c5-c54338e9129a tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:42:54.346458 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1997d2fb-ee73-4d7b-83c5-c54338e9129a tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:42:54.346932 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1997d2fb-ee73-4d7b-83c5-c54338e9129a tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:42:54.347377 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1997d2fb-ee73-4d7b-83c5-c54338e9129a tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:42:54.480958 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-1997d2fb-ee73-4d7b-83c5-c54338e9129a tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc0ba9f45d04dec89394df46d6096a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2856184afa47f2b4349f7dea9e5569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:42:54.489502 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-1997d2fb-ee73-4d7b-83c5-c54338e9129a tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] 10.222.0.43 "GET /compute/v2.1/servers/33adc582-3420-40d7-b2db-768c73f7607d" status: 200 len: 1391 microversion: 2.1 time: 0.156830 Oct 04 22:42:54.490088 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3870/6919] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:42:54 2022] GET /compute/v2.1/servers/33adc582-3420-40d7-b2db-768c73f7607d => generated 1391 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:42:55.510982 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell0:SELECT=2 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:42:55.511757 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell0:SELECT=6 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:42:55.516369 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-cbbc46c6-84ed-4a62-a134-0277c20dfa0a tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:42:55.517061 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-cbbc46c6-84ed-4a62-a134-0277c20dfa0a tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] [instance: 33adc582-3420-40d7-b2db-768c73f7607d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:42:55.524041 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cbbc46c6-84ed-4a62-a134-0277c20dfa0a tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:42:55.524517 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cbbc46c6-84ed-4a62-a134-0277c20dfa0a tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:42:55.524957 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cbbc46c6-84ed-4a62-a134-0277c20dfa0a tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:42:55.525645 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cbbc46c6-84ed-4a62-a134-0277c20dfa0a tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:42:55.526098 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cbbc46c6-84ed-4a62-a134-0277c20dfa0a tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:42:55.526551 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cbbc46c6-84ed-4a62-a134-0277c20dfa0a tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:42:55.659780 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-cbbc46c6-84ed-4a62-a134-0277c20dfa0a tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc0ba9f45d04dec89394df46d6096a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2856184afa47f2b4349f7dea9e5569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:42:55.667562 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-cbbc46c6-84ed-4a62-a134-0277c20dfa0a tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] 10.222.0.43 "GET /compute/v2.1/servers/33adc582-3420-40d7-b2db-768c73f7607d" status: 200 len: 1563 microversion: 2.1 time: 0.158550 Oct 04 22:42:55.668146 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3050/6920] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:42:55 2022] GET /compute/v2.1/servers/33adc582-3420-40d7-b2db-768c73f7607d => generated 1563 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:42:55.689568 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-a6efa766-536e-4f7a-8354-412cdfd061e6 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:42:55.690220 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-a6efa766-536e-4f7a-8354-412cdfd061e6 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] [instance: 33adc582-3420-40d7-b2db-768c73f7607d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:42:55.692170 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=6 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:42:55.698348 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a6efa766-536e-4f7a-8354-412cdfd061e6 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:42:55.698871 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a6efa766-536e-4f7a-8354-412cdfd061e6 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:42:55.699326 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a6efa766-536e-4f7a-8354-412cdfd061e6 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:42:55.700549 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a6efa766-536e-4f7a-8354-412cdfd061e6 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:42:55.701316 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a6efa766-536e-4f7a-8354-412cdfd061e6 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:42:55.701771 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a6efa766-536e-4f7a-8354-412cdfd061e6 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:42:55.841239 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-a6efa766-536e-4f7a-8354-412cdfd061e6 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc0ba9f45d04dec89394df46d6096a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2856184afa47f2b4349f7dea9e5569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:42:55.849069 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-a6efa766-536e-4f7a-8354-412cdfd061e6 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] 10.222.0.43 "GET /compute/v2.1/servers/33adc582-3420-40d7-b2db-768c73f7607d" status: 200 len: 1563 microversion: 2.1 time: 0.163370 Oct 04 22:42:55.849649 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3871/6921] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:42:55 2022] GET /compute/v2.1/servers/33adc582-3420-40d7-b2db-768c73f7607d => generated 1563 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:42:57.441590 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-55c23b97-ee82-486a-88fc-7272fe47b002 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:42:57.442215 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-55c23b97-ee82-486a-88fc-7272fe47b002 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] [instance: 33adc582-3420-40d7-b2db-768c73f7607d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:42:57.443932 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-a5f73548-4b09-43cb-8dd7-9b609ba5a505 req-0d9aa174-8526-4ce2-a591-b4d03547ceca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33adc582-3420-40d7-b2db-768c73f7607d", "tag": "3d04717a-bc15-4176-a4cb-a146fbb750c7"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:42:57.449236 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-55c23b97-ee82-486a-88fc-7272fe47b002 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:42:57.450038 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-55c23b97-ee82-486a-88fc-7272fe47b002 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:42:57.451144 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-55c23b97-ee82-486a-88fc-7272fe47b002 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:42:57.452110 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-55c23b97-ee82-486a-88fc-7272fe47b002 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:42:57.452777 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-55c23b97-ee82-486a-88fc-7272fe47b002 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:42:57.453212 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-55c23b97-ee82-486a-88fc-7272fe47b002 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:42:57.455532 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-a5f73548-4b09-43cb-8dd7-9b609ba5a505 req-0d9aa174-8526-4ce2-a591-b4d03547ceca service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:42:57.456179 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-a5f73548-4b09-43cb-8dd7-9b609ba5a505 req-0d9aa174-8526-4ce2-a591-b4d03547ceca service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:42:57.456639 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-a5f73548-4b09-43cb-8dd7-9b609ba5a505 req-0d9aa174-8526-4ce2-a591-b4d03547ceca service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:42:57.471393 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-a5f73548-4b09-43cb-8dd7-9b609ba5a505 req-0d9aa174-8526-4ce2-a591-b4d03547ceca service nova] Creating event network-changed:3d04717a-bc15-4176-a4cb-a146fbb750c7 for instance 33adc582-3420-40d7-b2db-768c73f7607d on n-h2-860284-1 Oct 04 22:42:57.476525 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-a5f73548-4b09-43cb-8dd7-9b609ba5a505 req-0d9aa174-8526-4ce2-a591-b4d03547ceca service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036513 Oct 04 22:42:57.477230 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3872/6922] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:42:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:42:57.683553 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-55c23b97-ee82-486a-88fc-7272fe47b002 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc0ba9f45d04dec89394df46d6096a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2856184afa47f2b4349f7dea9e5569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:42:57.692772 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-55c23b97-ee82-486a-88fc-7272fe47b002 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] 10.222.0.43 "GET /compute/v2.1/servers/33adc582-3420-40d7-b2db-768c73f7607d" status: 200 len: 1563 microversion: 2.1 time: 0.255267 Oct 04 22:42:57.693367 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3051/6923] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:42:57 2022] GET /compute/v2.1/servers/33adc582-3420-40d7-b2db-768c73f7607d => generated 1563 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:43:31.049908 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:43:31.050840 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=38 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:43:31.055159 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-de1694a2-8a1d-4ee5-9346-eb4f1d887042 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:43:31.057465 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-de1694a2-8a1d-4ee5-9346-eb4f1d887042 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] [instance: 33adc582-3420-40d7-b2db-768c73f7607d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:43:31.068411 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-de1694a2-8a1d-4ee5-9346-eb4f1d887042 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:43:31.068917 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-de1694a2-8a1d-4ee5-9346-eb4f1d887042 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:43:31.069374 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-de1694a2-8a1d-4ee5-9346-eb4f1d887042 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:43:31.070089 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-de1694a2-8a1d-4ee5-9346-eb4f1d887042 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:43:31.070596 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-de1694a2-8a1d-4ee5-9346-eb4f1d887042 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:43:31.071043 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-de1694a2-8a1d-4ee5-9346-eb4f1d887042 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:43:31.399967 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-de1694a2-8a1d-4ee5-9346-eb4f1d887042 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] 10.222.0.43 "POST /compute/v2.1/servers/33adc582-3420-40d7-b2db-768c73f7607d/action" status: 200 len: 24563 microversion: 2.1 time: 0.351717 Oct 04 22:43:31.408276 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3873/6924] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 22:43:31 2022] POST /compute/v2.1/servers/33adc582-3420-40d7-b2db-768c73f7607d/action => generated 24563 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 22:44:01.831618 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_api:SELECT=42,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:44:01.832386 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=36 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:44:01.836573 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-a8dabe3e-478a-4386-9493-84954a2a4920 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:44:01.837208 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-a8dabe3e-478a-4386-9493-84954a2a4920 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] [instance: 33adc582-3420-40d7-b2db-768c73f7607d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:44:01.848132 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a8dabe3e-478a-4386-9493-84954a2a4920 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:44:01.848619 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a8dabe3e-478a-4386-9493-84954a2a4920 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:44:01.849059 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a8dabe3e-478a-4386-9493-84954a2a4920 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:44:01.849755 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a8dabe3e-478a-4386-9493-84954a2a4920 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:44:01.850213 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a8dabe3e-478a-4386-9493-84954a2a4920 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:44:01.850669 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a8dabe3e-478a-4386-9493-84954a2a4920 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:44:01.985166 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-a8dabe3e-478a-4386-9493-84954a2a4920 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc0ba9f45d04dec89394df46d6096a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2856184afa47f2b4349f7dea9e5569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:44:01.993031 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-a8dabe3e-478a-4386-9493-84954a2a4920 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] 10.222.0.43 "GET /compute/v2.1/servers/33adc582-3420-40d7-b2db-768c73f7607d" status: 200 len: 1681 microversion: 2.1 time: 0.163573 Oct 04 22:44:01.993622 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3052/6925] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:44:01 2022] GET /compute/v2.1/servers/33adc582-3420-40d7-b2db-768c73f7607d => generated 1681 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:44:02.099428 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-bf8d0586-cb60-48ca-add8-7a5b008dc6f5 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:44:02.101633 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-bf8d0586-cb60-48ca-add8-7a5b008dc6f5 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] [instance: 33adc582-3420-40d7-b2db-768c73f7607d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:44:02.104359 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=2 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:44:02.105163 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=4 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:44:02.111493 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bf8d0586-cb60-48ca-add8-7a5b008dc6f5 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:44:02.112004 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bf8d0586-cb60-48ca-add8-7a5b008dc6f5 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:44:02.112467 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bf8d0586-cb60-48ca-add8-7a5b008dc6f5 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:44:02.113190 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bf8d0586-cb60-48ca-add8-7a5b008dc6f5 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:44:02.113665 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bf8d0586-cb60-48ca-add8-7a5b008dc6f5 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:44:02.114114 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bf8d0586-cb60-48ca-add8-7a5b008dc6f5 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:44:02.172521 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-bf8d0586-cb60-48ca-add8-7a5b008dc6f5 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] 10.222.0.43 "POST /compute/v2.1/servers/33adc582-3420-40d7-b2db-768c73f7607d/action" status: 200 len: 32636 microversion: 2.1 time: 0.077394 Oct 04 22:44:02.173159 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3874/6926] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 22:44:02 2022] POST /compute/v2.1/servers/33adc582-3420-40d7-b2db-768c73f7607d/action => generated 32636 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 22:44:02.371086 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-c3871d9d-d7b3-4fc7-a9eb-cd053da98b16 tempest-TestNetworkAdvancedServerOps-1759506676 tempest-TestNetworkAdvancedServerOps-1759506676-project-admin] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:44:02.371622 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-c3871d9d-d7b3-4fc7-a9eb-cd053da98b16 tempest-TestNetworkAdvancedServerOps-1759506676 tempest-TestNetworkAdvancedServerOps-1759506676-project-admin] [instance: 33adc582-3420-40d7-b2db-768c73f7607d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:44:02.377508 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c3871d9d-d7b3-4fc7-a9eb-cd053da98b16 tempest-TestNetworkAdvancedServerOps-1759506676 tempest-TestNetworkAdvancedServerOps-1759506676-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:44:02.377997 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c3871d9d-d7b3-4fc7-a9eb-cd053da98b16 tempest-TestNetworkAdvancedServerOps-1759506676 tempest-TestNetworkAdvancedServerOps-1759506676-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:44:02.378718 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c3871d9d-d7b3-4fc7-a9eb-cd053da98b16 tempest-TestNetworkAdvancedServerOps-1759506676 tempest-TestNetworkAdvancedServerOps-1759506676-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:44:02.379412 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c3871d9d-d7b3-4fc7-a9eb-cd053da98b16 tempest-TestNetworkAdvancedServerOps-1759506676 tempest-TestNetworkAdvancedServerOps-1759506676-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:44:02.379868 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c3871d9d-d7b3-4fc7-a9eb-cd053da98b16 tempest-TestNetworkAdvancedServerOps-1759506676 tempest-TestNetworkAdvancedServerOps-1759506676-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:44:02.380295 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c3871d9d-d7b3-4fc7-a9eb-cd053da98b16 tempest-TestNetworkAdvancedServerOps-1759506676 tempest-TestNetworkAdvancedServerOps-1759506676-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:44:02.514527 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-c3871d9d-d7b3-4fc7-a9eb-cd053da98b16 tempest-TestNetworkAdvancedServerOps-1759506676 tempest-TestNetworkAdvancedServerOps-1759506676-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/33adc582-3420-40d7-b2db-768c73f7607d" status: 200 len: 1832 microversion: 2.1 time: 0.147177 Oct 04 22:44:02.515114 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3053/6927] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:44:02 2022] GET /compute/v2.1/servers/33adc582-3420-40d7-b2db-768c73f7607d => generated 1832 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:44:02.544764 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-5179f16a-d564-4f11-97bf-9b3f64d87b6e tempest-TestNetworkAdvancedServerOps-1759506676 tempest-TestNetworkAdvancedServerOps-1759506676-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:44:02.547366 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-5179f16a-d564-4f11-97bf-9b3f64d87b6e tempest-TestNetworkAdvancedServerOps-1759506676 tempest-TestNetworkAdvancedServerOps-1759506676-project-admin] [instance: 33adc582-3420-40d7-b2db-768c73f7607d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:44:02.555738 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5179f16a-d564-4f11-97bf-9b3f64d87b6e tempest-TestNetworkAdvancedServerOps-1759506676 tempest-TestNetworkAdvancedServerOps-1759506676-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:44:02.556245 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5179f16a-d564-4f11-97bf-9b3f64d87b6e tempest-TestNetworkAdvancedServerOps-1759506676 tempest-TestNetworkAdvancedServerOps-1759506676-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:44:02.556714 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5179f16a-d564-4f11-97bf-9b3f64d87b6e tempest-TestNetworkAdvancedServerOps-1759506676 tempest-TestNetworkAdvancedServerOps-1759506676-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:44:02.557439 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5179f16a-d564-4f11-97bf-9b3f64d87b6e tempest-TestNetworkAdvancedServerOps-1759506676 tempest-TestNetworkAdvancedServerOps-1759506676-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:44:02.557915 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5179f16a-d564-4f11-97bf-9b3f64d87b6e tempest-TestNetworkAdvancedServerOps-1759506676 tempest-TestNetworkAdvancedServerOps-1759506676-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:44:02.558378 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5179f16a-d564-4f11-97bf-9b3f64d87b6e tempest-TestNetworkAdvancedServerOps-1759506676 tempest-TestNetworkAdvancedServerOps-1759506676-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:44:02.698993 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.objects.instance [None req-5179f16a-d564-4f11-97bf-9b3f64d87b6e tempest-TestNetworkAdvancedServerOps-1759506676 tempest-TestNetworkAdvancedServerOps-1759506676-project-admin] Lazy-loading 'flavor' on Instance uuid 33adc582-3420-40d7-b2db-768c73f7607d {{(pid=134101) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 22:44:02.719356 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-5179f16a-d564-4f11-97bf-9b3f64d87b6e tempest-TestNetworkAdvancedServerOps-1759506676 tempest-TestNetworkAdvancedServerOps-1759506676-project-admin] [instance: 33adc582-3420-40d7-b2db-768c73f7607d] Going to try to live migrate instance to another host {{(pid=134101) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 04 22:44:04.215935 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-5179f16a-d564-4f11-97bf-9b3f64d87b6e tempest-TestNetworkAdvancedServerOps-1759506676 tempest-TestNetworkAdvancedServerOps-1759506676-project-admin] 10.222.0.43 "POST /compute/v2.1/servers/33adc582-3420-40d7-b2db-768c73f7607d/action" status: 202 len: 0 microversion: 2.1 time: 1.675909 Oct 04 22:44:04.216868 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3875/6928] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 22:44:02 2022] POST /compute/v2.1/servers/33adc582-3420-40d7-b2db-768c73f7607d/action => generated 0 bytes in 1678 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 22:44:04.226076 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-8d135f13-2691-47a2-a520-5dc10d8ad96b tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:44:04.226722 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-8d135f13-2691-47a2-a520-5dc10d8ad96b tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] [instance: 33adc582-3420-40d7-b2db-768c73f7607d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:44:04.236103 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8d135f13-2691-47a2-a520-5dc10d8ad96b tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:44:04.236103 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8d135f13-2691-47a2-a520-5dc10d8ad96b tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:44:04.236691 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8d135f13-2691-47a2-a520-5dc10d8ad96b tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:44:04.237578 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8d135f13-2691-47a2-a520-5dc10d8ad96b tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:44:04.238252 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8d135f13-2691-47a2-a520-5dc10d8ad96b tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:44:04.238770 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8d135f13-2691-47a2-a520-5dc10d8ad96b tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:44:04.406326 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-8d135f13-2691-47a2-a520-5dc10d8ad96b tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc0ba9f45d04dec89394df46d6096a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2856184afa47f2b4349f7dea9e5569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:44:04.415036 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-8d135f13-2691-47a2-a520-5dc10d8ad96b tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] 10.222.0.43 "GET /compute/v2.1/servers/33adc582-3420-40d7-b2db-768c73f7607d" status: 200 len: 1691 microversion: 2.1 time: 0.192652 Oct 04 22:44:04.417635 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3054/6929] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:44:04 2022] GET /compute/v2.1/servers/33adc582-3420-40d7-b2db-768c73f7607d => generated 1691 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:44:05.346682 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-aa4931d1-d12e-42ef-b73f-ee42380f8327 req-04ae4590-05ab-4f24-a3cf-786132867984 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33adc582-3420-40d7-b2db-768c73f7607d", "name": "network-vif-unplugged", "status": "completed", "tag": "3d04717a-bc15-4176-a4cb-a146fbb750c7"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:44:05.358898 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-aa4931d1-d12e-42ef-b73f-ee42380f8327 req-04ae4590-05ab-4f24-a3cf-786132867984 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:44:05.359394 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-aa4931d1-d12e-42ef-b73f-ee42380f8327 req-04ae4590-05ab-4f24-a3cf-786132867984 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:44:05.359843 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-aa4931d1-d12e-42ef-b73f-ee42380f8327 req-04ae4590-05ab-4f24-a3cf-786132867984 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:44:05.370761 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-aa4931d1-d12e-42ef-b73f-ee42380f8327 req-04ae4590-05ab-4f24-a3cf-786132867984 service nova] Creating event network-vif-unplugged:3d04717a-bc15-4176-a4cb-a146fbb750c7 for instance 33adc582-3420-40d7-b2db-768c73f7607d on n-h2-860284-1 Oct 04 22:44:05.376751 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-aa4931d1-d12e-42ef-b73f-ee42380f8327 req-04ae4590-05ab-4f24-a3cf-786132867984 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034083 Oct 04 22:44:05.377352 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3876/6930] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:44:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:44:05.445566 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-09292779-050d-46b0-8320-48e46485b900 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:44:05.446244 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-09292779-050d-46b0-8320-48e46485b900 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] [instance: 33adc582-3420-40d7-b2db-768c73f7607d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:44:05.456091 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-09292779-050d-46b0-8320-48e46485b900 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:44:05.456612 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-09292779-050d-46b0-8320-48e46485b900 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:44:05.457059 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-09292779-050d-46b0-8320-48e46485b900 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:44:05.457773 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-09292779-050d-46b0-8320-48e46485b900 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:44:05.458238 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-09292779-050d-46b0-8320-48e46485b900 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:44:05.458706 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-09292779-050d-46b0-8320-48e46485b900 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:44:05.595568 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-09292779-050d-46b0-8320-48e46485b900 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc0ba9f45d04dec89394df46d6096a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2856184afa47f2b4349f7dea9e5569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:44:05.603633 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-09292779-050d-46b0-8320-48e46485b900 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] 10.222.0.43 "GET /compute/v2.1/servers/33adc582-3420-40d7-b2db-768c73f7607d" status: 200 len: 1691 microversion: 2.1 time: 0.162297 Oct 04 22:44:05.618387 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3055/6931] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:44:05 2022] GET /compute/v2.1/servers/33adc582-3420-40d7-b2db-768c73f7607d => generated 1691 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:44:06.630114 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-53a79188-63c3-41ac-8dc1-2554158b218b tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:44:06.630863 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-53a79188-63c3-41ac-8dc1-2554158b218b tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] [instance: 33adc582-3420-40d7-b2db-768c73f7607d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:44:06.639457 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-53a79188-63c3-41ac-8dc1-2554158b218b tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:44:06.639966 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-53a79188-63c3-41ac-8dc1-2554158b218b tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:44:06.640425 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-53a79188-63c3-41ac-8dc1-2554158b218b tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:44:06.641139 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-53a79188-63c3-41ac-8dc1-2554158b218b tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:44:06.641618 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-53a79188-63c3-41ac-8dc1-2554158b218b tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:44:06.642068 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-53a79188-63c3-41ac-8dc1-2554158b218b tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:44:07.144813 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-53a79188-63c3-41ac-8dc1-2554158b218b tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc0ba9f45d04dec89394df46d6096a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2856184afa47f2b4349f7dea9e5569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:44:07.153076 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-53a79188-63c3-41ac-8dc1-2554158b218b tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] 10.222.0.43 "GET /compute/v2.1/servers/33adc582-3420-40d7-b2db-768c73f7607d" status: 200 len: 1691 microversion: 2.1 time: 0.527825 Oct 04 22:44:07.153644 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3877/6932] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:44:06 2022] GET /compute/v2.1/servers/33adc582-3420-40d7-b2db-768c73f7607d => generated 1691 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:44:07.405360 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-9fe31f50-84e9-4b96-98f7-7d40a6389413 req-89a31f6c-ab19-4aff-970b-e48241427d5f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33adc582-3420-40d7-b2db-768c73f7607d", "tag": "3d04717a-bc15-4176-a4cb-a146fbb750c7"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:44:07.415551 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-9fe31f50-84e9-4b96-98f7-7d40a6389413 req-89a31f6c-ab19-4aff-970b-e48241427d5f service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:44:07.416038 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-9fe31f50-84e9-4b96-98f7-7d40a6389413 req-89a31f6c-ab19-4aff-970b-e48241427d5f service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:44:07.416483 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-9fe31f50-84e9-4b96-98f7-7d40a6389413 req-89a31f6c-ab19-4aff-970b-e48241427d5f service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:44:07.427347 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-9fe31f50-84e9-4b96-98f7-7d40a6389413 req-89a31f6c-ab19-4aff-970b-e48241427d5f service nova] Creating event network-changed:3d04717a-bc15-4176-a4cb-a146fbb750c7 for instance 33adc582-3420-40d7-b2db-768c73f7607d on n-h2-860284-1 Oct 04 22:44:07.432374 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-9fe31f50-84e9-4b96-98f7-7d40a6389413 req-89a31f6c-ab19-4aff-970b-e48241427d5f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031557 Oct 04 22:44:07.432955 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3056/6933] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:44:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:44:08.177412 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-d3c6abac-7bd9-4c03-8281-7560fce908aa tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:44:08.178059 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-d3c6abac-7bd9-4c03-8281-7560fce908aa tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] [instance: 33adc582-3420-40d7-b2db-768c73f7607d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:44:08.188300 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d3c6abac-7bd9-4c03-8281-7560fce908aa tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:44:08.188810 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d3c6abac-7bd9-4c03-8281-7560fce908aa tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:44:08.189272 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d3c6abac-7bd9-4c03-8281-7560fce908aa tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:44:08.189993 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d3c6abac-7bd9-4c03-8281-7560fce908aa tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:44:08.190499 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d3c6abac-7bd9-4c03-8281-7560fce908aa tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:44:08.190953 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d3c6abac-7bd9-4c03-8281-7560fce908aa tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:44:08.320917 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-d3c6abac-7bd9-4c03-8281-7560fce908aa tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc0ba9f45d04dec89394df46d6096a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2856184afa47f2b4349f7dea9e5569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:44:08.329234 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-d3c6abac-7bd9-4c03-8281-7560fce908aa tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] 10.222.0.43 "GET /compute/v2.1/servers/33adc582-3420-40d7-b2db-768c73f7607d" status: 200 len: 1691 microversion: 2.1 time: 0.156015 Oct 04 22:44:08.329822 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3878/6934] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:44:08 2022] GET /compute/v2.1/servers/33adc582-3420-40d7-b2db-768c73f7607d => generated 1691 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:44:09.353434 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-7fbe0ba7-51fc-4c6a-9aa5-25201bb2afed tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:44:09.354139 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-7fbe0ba7-51fc-4c6a-9aa5-25201bb2afed tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] [instance: 33adc582-3420-40d7-b2db-768c73f7607d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:44:09.360437 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7fbe0ba7-51fc-4c6a-9aa5-25201bb2afed tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:44:09.360921 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7fbe0ba7-51fc-4c6a-9aa5-25201bb2afed tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:44:09.361363 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7fbe0ba7-51fc-4c6a-9aa5-25201bb2afed tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:44:09.362054 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7fbe0ba7-51fc-4c6a-9aa5-25201bb2afed tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:44:09.362543 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7fbe0ba7-51fc-4c6a-9aa5-25201bb2afed tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:44:09.362981 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7fbe0ba7-51fc-4c6a-9aa5-25201bb2afed tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:44:09.498114 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-7fbe0ba7-51fc-4c6a-9aa5-25201bb2afed tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc0ba9f45d04dec89394df46d6096a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2856184afa47f2b4349f7dea9e5569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:44:09.506107 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-7fbe0ba7-51fc-4c6a-9aa5-25201bb2afed tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] 10.222.0.43 "GET /compute/v2.1/servers/33adc582-3420-40d7-b2db-768c73f7607d" status: 200 len: 1691 microversion: 2.1 time: 0.157831 Oct 04 22:44:09.506718 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3057/6935] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:44:09 2022] GET /compute/v2.1/servers/33adc582-3420-40d7-b2db-768c73f7607d => generated 1691 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:44:10.530139 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-da22b7e3-9713-4aaa-aeb8-67277da94be1 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:44:10.530819 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-da22b7e3-9713-4aaa-aeb8-67277da94be1 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] [instance: 33adc582-3420-40d7-b2db-768c73f7607d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:44:10.537673 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-da22b7e3-9713-4aaa-aeb8-67277da94be1 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:44:10.538180 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-da22b7e3-9713-4aaa-aeb8-67277da94be1 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:44:10.538674 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-da22b7e3-9713-4aaa-aeb8-67277da94be1 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:44:10.539391 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-da22b7e3-9713-4aaa-aeb8-67277da94be1 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:44:10.539867 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-da22b7e3-9713-4aaa-aeb8-67277da94be1 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:44:10.540314 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-da22b7e3-9713-4aaa-aeb8-67277da94be1 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:44:10.679378 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-da22b7e3-9713-4aaa-aeb8-67277da94be1 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc0ba9f45d04dec89394df46d6096a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2856184afa47f2b4349f7dea9e5569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:44:10.688148 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-da22b7e3-9713-4aaa-aeb8-67277da94be1 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] 10.222.0.43 "GET /compute/v2.1/servers/33adc582-3420-40d7-b2db-768c73f7607d" status: 200 len: 1691 microversion: 2.1 time: 0.163008 Oct 04 22:44:10.688724 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3879/6936] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:44:10 2022] GET /compute/v2.1/servers/33adc582-3420-40d7-b2db-768c73f7607d => generated 1691 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:44:11.712353 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-d61a44d1-bd86-4c0e-badb-0300eab41518 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:44:11.713005 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-d61a44d1-bd86-4c0e-badb-0300eab41518 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] [instance: 33adc582-3420-40d7-b2db-768c73f7607d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:44:11.722897 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d61a44d1-bd86-4c0e-badb-0300eab41518 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:44:11.723389 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d61a44d1-bd86-4c0e-badb-0300eab41518 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:44:11.723831 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d61a44d1-bd86-4c0e-badb-0300eab41518 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:44:11.724534 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d61a44d1-bd86-4c0e-badb-0300eab41518 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:44:11.725021 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d61a44d1-bd86-4c0e-badb-0300eab41518 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:44:11.725452 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d61a44d1-bd86-4c0e-badb-0300eab41518 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:44:11.855821 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-d61a44d1-bd86-4c0e-badb-0300eab41518 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc0ba9f45d04dec89394df46d6096a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2856184afa47f2b4349f7dea9e5569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:44:11.863731 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-d61a44d1-bd86-4c0e-badb-0300eab41518 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] 10.222.0.43 "GET /compute/v2.1/servers/33adc582-3420-40d7-b2db-768c73f7607d" status: 200 len: 1691 microversion: 2.1 time: 0.155467 Oct 04 22:44:11.864317 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3058/6937] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:44:11 2022] GET /compute/v2.1/servers/33adc582-3420-40d7-b2db-768c73f7607d => generated 1691 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:44:12.888011 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-2b857c30-2f15-40f9-b767-f6585dfe413d tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:44:12.888624 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-2b857c30-2f15-40f9-b767-f6585dfe413d tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] [instance: 33adc582-3420-40d7-b2db-768c73f7607d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:44:12.896104 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2b857c30-2f15-40f9-b767-f6585dfe413d tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:44:12.896618 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2b857c30-2f15-40f9-b767-f6585dfe413d tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:44:12.897079 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2b857c30-2f15-40f9-b767-f6585dfe413d tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:44:12.897809 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2b857c30-2f15-40f9-b767-f6585dfe413d tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:44:12.898286 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2b857c30-2f15-40f9-b767-f6585dfe413d tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:44:12.898771 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2b857c30-2f15-40f9-b767-f6585dfe413d tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:44:13.031746 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-2b857c30-2f15-40f9-b767-f6585dfe413d tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc0ba9f45d04dec89394df46d6096a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2856184afa47f2b4349f7dea9e5569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:44:13.039678 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-2b857c30-2f15-40f9-b767-f6585dfe413d tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] 10.222.0.43 "GET /compute/v2.1/servers/33adc582-3420-40d7-b2db-768c73f7607d" status: 200 len: 1691 microversion: 2.1 time: 0.156564 Oct 04 22:44:13.040259 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3880/6938] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:44:12 2022] GET /compute/v2.1/servers/33adc582-3420-40d7-b2db-768c73f7607d => generated 1691 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:44:14.063253 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-019afeee-91c7-47df-9f9b-c13e00aadefe tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:44:14.063826 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-019afeee-91c7-47df-9f9b-c13e00aadefe tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] [instance: 33adc582-3420-40d7-b2db-768c73f7607d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:44:14.070743 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-019afeee-91c7-47df-9f9b-c13e00aadefe tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:44:14.071237 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-019afeee-91c7-47df-9f9b-c13e00aadefe tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:44:14.071681 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-019afeee-91c7-47df-9f9b-c13e00aadefe tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:44:14.072387 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-019afeee-91c7-47df-9f9b-c13e00aadefe tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:44:14.072850 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-019afeee-91c7-47df-9f9b-c13e00aadefe tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:44:14.073286 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-019afeee-91c7-47df-9f9b-c13e00aadefe tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:44:14.209189 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-019afeee-91c7-47df-9f9b-c13e00aadefe tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc0ba9f45d04dec89394df46d6096a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2856184afa47f2b4349f7dea9e5569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:44:14.217910 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-019afeee-91c7-47df-9f9b-c13e00aadefe tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] 10.222.0.43 "GET /compute/v2.1/servers/33adc582-3420-40d7-b2db-768c73f7607d" status: 200 len: 1691 microversion: 2.1 time: 0.158653 Oct 04 22:44:14.218542 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3059/6939] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:44:14 2022] GET /compute/v2.1/servers/33adc582-3420-40d7-b2db-768c73f7607d => generated 1691 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:44:15.241935 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-de1be4ea-153e-4474-aeee-20f9dce9a877 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:44:15.242601 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-de1be4ea-153e-4474-aeee-20f9dce9a877 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] [instance: 33adc582-3420-40d7-b2db-768c73f7607d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:44:15.249678 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-de1be4ea-153e-4474-aeee-20f9dce9a877 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:44:15.250306 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-de1be4ea-153e-4474-aeee-20f9dce9a877 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:44:15.250794 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-de1be4ea-153e-4474-aeee-20f9dce9a877 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:44:15.251521 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-de1be4ea-153e-4474-aeee-20f9dce9a877 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:44:15.251999 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-de1be4ea-153e-4474-aeee-20f9dce9a877 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:44:15.252447 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-de1be4ea-153e-4474-aeee-20f9dce9a877 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:44:15.488961 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-de1be4ea-153e-4474-aeee-20f9dce9a877 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc0ba9f45d04dec89394df46d6096a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2856184afa47f2b4349f7dea9e5569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:44:15.496852 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-de1be4ea-153e-4474-aeee-20f9dce9a877 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] 10.222.0.43 "GET /compute/v2.1/servers/33adc582-3420-40d7-b2db-768c73f7607d" status: 200 len: 1691 microversion: 2.1 time: 0.259604 Oct 04 22:44:15.497432 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3881/6940] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:44:15 2022] GET /compute/v2.1/servers/33adc582-3420-40d7-b2db-768c73f7607d => generated 1691 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:44:16.520170 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-29946289-2d67-4ae1-a16b-ff232ab4b818 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:44:16.520788 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-29946289-2d67-4ae1-a16b-ff232ab4b818 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] [instance: 33adc582-3420-40d7-b2db-768c73f7607d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:44:16.527961 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-29946289-2d67-4ae1-a16b-ff232ab4b818 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:44:16.528459 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-29946289-2d67-4ae1-a16b-ff232ab4b818 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:44:16.528907 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-29946289-2d67-4ae1-a16b-ff232ab4b818 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:44:16.529610 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-29946289-2d67-4ae1-a16b-ff232ab4b818 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:44:16.530079 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-29946289-2d67-4ae1-a16b-ff232ab4b818 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:44:16.530549 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-29946289-2d67-4ae1-a16b-ff232ab4b818 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:44:16.667248 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-29946289-2d67-4ae1-a16b-ff232ab4b818 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc0ba9f45d04dec89394df46d6096a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2856184afa47f2b4349f7dea9e5569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:44:16.675846 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-29946289-2d67-4ae1-a16b-ff232ab4b818 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] 10.222.0.43 "GET /compute/v2.1/servers/33adc582-3420-40d7-b2db-768c73f7607d" status: 200 len: 1681 microversion: 2.1 time: 0.159606 Oct 04 22:44:16.676439 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3060/6941] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:44:16 2022] GET /compute/v2.1/servers/33adc582-3420-40d7-b2db-768c73f7607d => generated 1681 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:44:16.698455 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-8cf17a3e-ee8d-46ac-9917-2a65807cb2b9 tempest-TestNetworkAdvancedServerOps-1759506676 tempest-TestNetworkAdvancedServerOps-1759506676-project-admin] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:44:16.699105 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-8cf17a3e-ee8d-46ac-9917-2a65807cb2b9 tempest-TestNetworkAdvancedServerOps-1759506676 tempest-TestNetworkAdvancedServerOps-1759506676-project-admin] [instance: 33adc582-3420-40d7-b2db-768c73f7607d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:44:16.705915 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8cf17a3e-ee8d-46ac-9917-2a65807cb2b9 tempest-TestNetworkAdvancedServerOps-1759506676 tempest-TestNetworkAdvancedServerOps-1759506676-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:44:16.706458 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8cf17a3e-ee8d-46ac-9917-2a65807cb2b9 tempest-TestNetworkAdvancedServerOps-1759506676 tempest-TestNetworkAdvancedServerOps-1759506676-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:44:16.706928 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8cf17a3e-ee8d-46ac-9917-2a65807cb2b9 tempest-TestNetworkAdvancedServerOps-1759506676 tempest-TestNetworkAdvancedServerOps-1759506676-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:44:16.707648 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8cf17a3e-ee8d-46ac-9917-2a65807cb2b9 tempest-TestNetworkAdvancedServerOps-1759506676 tempest-TestNetworkAdvancedServerOps-1759506676-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:44:16.708126 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8cf17a3e-ee8d-46ac-9917-2a65807cb2b9 tempest-TestNetworkAdvancedServerOps-1759506676 tempest-TestNetworkAdvancedServerOps-1759506676-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:44:16.708627 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8cf17a3e-ee8d-46ac-9917-2a65807cb2b9 tempest-TestNetworkAdvancedServerOps-1759506676 tempest-TestNetworkAdvancedServerOps-1759506676-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:44:16.843020 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-8cf17a3e-ee8d-46ac-9917-2a65807cb2b9 tempest-TestNetworkAdvancedServerOps-1759506676 tempest-TestNetworkAdvancedServerOps-1759506676-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/33adc582-3420-40d7-b2db-768c73f7607d" status: 200 len: 1832 microversion: 2.1 time: 0.148247 Oct 04 22:44:16.843601 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3882/6942] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:44:16 2022] GET /compute/v2.1/servers/33adc582-3420-40d7-b2db-768c73f7607d => generated 1832 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:44:16.866269 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-25ab98f4-c5bb-4b6d-8f8a-76495f16d8fc tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:44:16.866916 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-25ab98f4-c5bb-4b6d-8f8a-76495f16d8fc tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] [instance: 33adc582-3420-40d7-b2db-768c73f7607d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:44:16.873130 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-25ab98f4-c5bb-4b6d-8f8a-76495f16d8fc tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:44:16.873611 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-25ab98f4-c5bb-4b6d-8f8a-76495f16d8fc tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:44:16.874054 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-25ab98f4-c5bb-4b6d-8f8a-76495f16d8fc tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:44:16.874809 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-25ab98f4-c5bb-4b6d-8f8a-76495f16d8fc tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:44:16.875271 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-25ab98f4-c5bb-4b6d-8f8a-76495f16d8fc tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:44:16.875729 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-25ab98f4-c5bb-4b6d-8f8a-76495f16d8fc tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:44:17.006081 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-25ab98f4-c5bb-4b6d-8f8a-76495f16d8fc tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc0ba9f45d04dec89394df46d6096a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2856184afa47f2b4349f7dea9e5569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:44:17.013827 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-25ab98f4-c5bb-4b6d-8f8a-76495f16d8fc tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] 10.222.0.43 "GET /compute/v2.1/servers/33adc582-3420-40d7-b2db-768c73f7607d" status: 200 len: 1681 microversion: 2.1 time: 0.151454 Oct 04 22:44:17.014419 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3061/6943] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:44:16 2022] GET /compute/v2.1/servers/33adc582-3420-40d7-b2db-768c73f7607d => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:44:17.110470 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-ab842dd3-8c66-4c8c-a437-7f14af1fbcfe tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:44:17.112656 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-ab842dd3-8c66-4c8c-a437-7f14af1fbcfe tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] [instance: 33adc582-3420-40d7-b2db-768c73f7607d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:44:17.118675 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ab842dd3-8c66-4c8c-a437-7f14af1fbcfe tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:44:17.119308 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ab842dd3-8c66-4c8c-a437-7f14af1fbcfe tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:44:17.119826 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ab842dd3-8c66-4c8c-a437-7f14af1fbcfe tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:44:17.120618 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ab842dd3-8c66-4c8c-a437-7f14af1fbcfe tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:44:17.121188 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ab842dd3-8c66-4c8c-a437-7f14af1fbcfe tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:44:17.121842 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ab842dd3-8c66-4c8c-a437-7f14af1fbcfe tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:44:17.184934 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-ab842dd3-8c66-4c8c-a437-7f14af1fbcfe tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] 10.222.0.43 "POST /compute/v2.1/servers/33adc582-3420-40d7-b2db-768c73f7607d/action" status: 200 len: 38459 microversion: 2.1 time: 0.078087 Oct 04 22:44:17.185575 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3883/6944] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 22:44:17 2022] POST /compute/v2.1/servers/33adc582-3420-40d7-b2db-768c73f7607d/action => generated 38459 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 22:44:18.154291 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-10ff1193-fb76-43a9-a638-0052da4485c1 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:44:18.154812 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-10ff1193-fb76-43a9-a638-0052da4485c1 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] [instance: 33adc582-3420-40d7-b2db-768c73f7607d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:44:18.158919 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-201de960-a2e2-40f5-a572-02cc1cfcaec3 req-9bceaecf-f191-4831-b3f6-1d1221b77c0e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33adc582-3420-40d7-b2db-768c73f7607d", "tag": "3d04717a-bc15-4176-a4cb-a146fbb750c7"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:44:18.161767 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-10ff1193-fb76-43a9-a638-0052da4485c1 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:44:18.162259 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-10ff1193-fb76-43a9-a638-0052da4485c1 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:44:18.162727 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-10ff1193-fb76-43a9-a638-0052da4485c1 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:44:18.163424 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-10ff1193-fb76-43a9-a638-0052da4485c1 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:44:18.163874 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-10ff1193-fb76-43a9-a638-0052da4485c1 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:44:18.164513 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-10ff1193-fb76-43a9-a638-0052da4485c1 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:44:18.171405 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-201de960-a2e2-40f5-a572-02cc1cfcaec3 req-9bceaecf-f191-4831-b3f6-1d1221b77c0e service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:44:18.171914 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-201de960-a2e2-40f5-a572-02cc1cfcaec3 req-9bceaecf-f191-4831-b3f6-1d1221b77c0e service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:44:18.172373 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-201de960-a2e2-40f5-a572-02cc1cfcaec3 req-9bceaecf-f191-4831-b3f6-1d1221b77c0e service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:44:18.184760 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-201de960-a2e2-40f5-a572-02cc1cfcaec3 req-9bceaecf-f191-4831-b3f6-1d1221b77c0e service nova] Creating event network-changed:3d04717a-bc15-4176-a4cb-a146fbb750c7 for instance 33adc582-3420-40d7-b2db-768c73f7607d on n-h1-860284-1 Oct 04 22:44:18.189946 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-201de960-a2e2-40f5-a572-02cc1cfcaec3 req-9bceaecf-f191-4831-b3f6-1d1221b77c0e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035482 Oct 04 22:44:18.190884 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3884/6945] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:44:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:44:18.193506 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-10ff1193-fb76-43a9-a638-0052da4485c1 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] [instance: 33adc582-3420-40d7-b2db-768c73f7607d] Going to try to terminate instance {{(pid=134102) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 22:44:18.280245 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-10ff1193-fb76-43a9-a638-0052da4485c1 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] 10.222.0.43 "DELETE /compute/v2.1/servers/33adc582-3420-40d7-b2db-768c73f7607d" status: 204 len: 0 microversion: 2.1 time: 0.129840 Oct 04 22:44:18.281488 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3062/6946] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 22:44:18 2022] DELETE /compute/v2.1/servers/33adc582-3420-40d7-b2db-768c73f7607d => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 22:44:18.291441 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-9726676e-57cd-4bea-a379-498408396506 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:44:18.292205 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-9726676e-57cd-4bea-a379-498408396506 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] [instance: 33adc582-3420-40d7-b2db-768c73f7607d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:44:18.300105 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9726676e-57cd-4bea-a379-498408396506 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:44:18.300657 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9726676e-57cd-4bea-a379-498408396506 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:44:18.301126 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9726676e-57cd-4bea-a379-498408396506 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:44:18.301941 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9726676e-57cd-4bea-a379-498408396506 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:44:18.302450 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9726676e-57cd-4bea-a379-498408396506 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:44:18.302940 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9726676e-57cd-4bea-a379-498408396506 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:44:18.502192 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-9726676e-57cd-4bea-a379-498408396506 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc0ba9f45d04dec89394df46d6096a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2856184afa47f2b4349f7dea9e5569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:44:18.516783 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-9726676e-57cd-4bea-a379-498408396506 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] 10.222.0.43 "GET /compute/v2.1/servers/33adc582-3420-40d7-b2db-768c73f7607d" status: 200 len: 1687 microversion: 2.1 time: 0.229883 Oct 04 22:44:18.531858 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3885/6947] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:44:18 2022] GET /compute/v2.1/servers/33adc582-3420-40d7-b2db-768c73f7607d => generated 1687 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:44:19.542928 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-197bfa1c-2ade-462e-86e6-814c35934f10 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:44:19.544007 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-197bfa1c-2ade-462e-86e6-814c35934f10 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] [instance: 33adc582-3420-40d7-b2db-768c73f7607d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:44:19.550469 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-197bfa1c-2ade-462e-86e6-814c35934f10 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:44:19.551190 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-197bfa1c-2ade-462e-86e6-814c35934f10 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:44:19.551627 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-197bfa1c-2ade-462e-86e6-814c35934f10 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:44:19.552502 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-197bfa1c-2ade-462e-86e6-814c35934f10 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:44:19.552970 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-197bfa1c-2ade-462e-86e6-814c35934f10 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:44:19.553399 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-197bfa1c-2ade-462e-86e6-814c35934f10 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:44:19.586222 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-197bfa1c-2ade-462e-86e6-814c35934f10 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:44:19.586664 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-197bfa1c-2ade-462e-86e6-814c35934f10 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:44:19.587106 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-197bfa1c-2ade-462e-86e6-814c35934f10 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:44:19.587551 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.objects.instance [None req-197bfa1c-2ade-462e-86e6-814c35934f10 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lazy-loading 'fault' on Instance uuid 33adc582-3420-40d7-b2db-768c73f7607d {{(pid=134102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 22:44:19.637763 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-197bfa1c-2ade-462e-86e6-814c35934f10 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc0ba9f45d04dec89394df46d6096a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2856184afa47f2b4349f7dea9e5569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:44:19.645137 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-197bfa1c-2ade-462e-86e6-814c35934f10 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] 10.222.0.43 "GET /compute/v2.1/servers/33adc582-3420-40d7-b2db-768c73f7607d" status: 200 len: 1355 microversion: 2.1 time: 0.106548 Oct 04 22:44:19.645713 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3063/6948] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:44:19 2022] GET /compute/v2.1/servers/33adc582-3420-40d7-b2db-768c73f7607d => generated 1355 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:44:20.204667 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-07537c90-61fa-4708-93a6-349eda6000da req-737b7005-5295-484f-b4ba-d836d57b362b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33adc582-3420-40d7-b2db-768c73f7607d", "name": "network-vif-deleted", "tag": "3d04717a-bc15-4176-a4cb-a146fbb750c7"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:44:20.214713 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-07537c90-61fa-4708-93a6-349eda6000da req-737b7005-5295-484f-b4ba-d836d57b362b service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:44:20.215202 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-07537c90-61fa-4708-93a6-349eda6000da req-737b7005-5295-484f-b4ba-d836d57b362b service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:44:20.215646 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-07537c90-61fa-4708-93a6-349eda6000da req-737b7005-5295-484f-b4ba-d836d57b362b service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:44:20.226771 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-07537c90-61fa-4708-93a6-349eda6000da req-737b7005-5295-484f-b4ba-d836d57b362b service nova] Creating event network-vif-deleted:3d04717a-bc15-4176-a4cb-a146fbb750c7 for instance 33adc582-3420-40d7-b2db-768c73f7607d on n-h1-860284-1 Oct 04 22:44:20.232328 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-07537c90-61fa-4708-93a6-349eda6000da req-737b7005-5295-484f-b4ba-d836d57b362b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031374 Oct 04 22:44:20.232907 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3886/6949] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:44:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:44:20.669757 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-3d2933e3-96f2-427d-a3ca-b1538f09779a tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:44:20.670391 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-3d2933e3-96f2-427d-a3ca-b1538f09779a tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] [instance: 33adc582-3420-40d7-b2db-768c73f7607d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:44:20.678424 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3d2933e3-96f2-427d-a3ca-b1538f09779a tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:44:20.678864 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3d2933e3-96f2-427d-a3ca-b1538f09779a tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:44:20.679307 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3d2933e3-96f2-427d-a3ca-b1538f09779a tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:44:20.680010 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3d2933e3-96f2-427d-a3ca-b1538f09779a tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:44:20.680473 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3d2933e3-96f2-427d-a3ca-b1538f09779a tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:44:20.680903 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3d2933e3-96f2-427d-a3ca-b1538f09779a tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:44:20.694162 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-3d2933e3-96f2-427d-a3ca-b1538f09779a tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] HTTP exception thrown: Instance 33adc582-3420-40d7-b2db-768c73f7607d could not be found. Oct 04 22:44:20.695832 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-3d2933e3-96f2-427d-a3ca-b1538f09779a tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Request method failure captured: Oct 04 22:44:20.695832 n-d-860284-1 devstack@n-api.service[134102]: request: GET /compute/v2.1/servers/33adc582-3420-40d7-b2db-768c73f7607d HTTP/1.1 Oct 04 22:44:20.695832 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 22:44:20.695832 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 22:44:20.695832 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 22:44:20.695832 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 22:44:20.695832 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 22:44:20.695832 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 22:44:20.695832 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 22:44:20.695832 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 22:44:20.695832 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPLV0i4fTyng2qLmqpOZDonbjmzoxCV_51fHF-2sehfrgMV9QVuGfN-Zf-uieedzXZTWMfP9hC44tva1SBwtRF8VLus6BFLrvLfEQUnNKLdCLmtRz5RQ2K95IuirNrCK0fpkR4wYvfI0Vw9CX7gwLNdKW8QNt5h37SFpMjtwukn05Yn0 Oct 04 22:44:20.695832 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 22:44:20.695832 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 22:44:20.695832 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 22:44:20.695832 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 22:44:20.695832 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 22:44:20.695832 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 22:44:20.695832 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: fd2856184afa47f2b4349f7dea9e5569 Oct 04 22:44:20.695832 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1049323607 Oct 04 22:44:20.695832 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 22:44:20.695832 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 22:44:20.695832 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/fd2856184afa47f2b4349f7dea9e5569"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_fd2856184afa47f2b4349f7dea9e5569", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/fd2856184afa47f2b4349f7dea9e5569"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/fd2856184afa47f2b4349f7dea9e5569"}]}] Oct 04 22:44:20.695832 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1049323607 Oct 04 22:44:20.695832 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: fd2856184afa47f2b4349f7dea9e5569 Oct 04 22:44:20.695832 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1049323607 Oct 04 22:44:20.695832 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-TestNetworkAdvancedServerOps-1049323607-project Oct 04 22:44:20.695832 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 22:44:20.695832 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 22:44:20.695832 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: bbc0ba9f45d04dec89394df46d6096a3 Oct 04 22:44:20.695832 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1049323607-project Oct 04 22:44:20.695832 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 22:44:20.695832 n-d-860284-1 devstack@n-api.service[134102]: exception: Instance 33adc582-3420-40d7-b2db-768c73f7607d could not be found. Oct 04 22:44:20.695832 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': '33adc582-3420-40d7-b2db-768c73f7607d'} Oct 04 22:44:20.695832 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:44:20.695832 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:44:20.695832 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:44:20.695832 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:44:20.695832 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:44:20.695832 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:44:20.695832 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:44:20.695832 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:44:20.695832 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:44:20.695832 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:44:20.695832 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33adc582-3420-40d7-b2db-768c73f7607d could not be found. Oct 04 22:44:20.695832 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:44:20.695832 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:44:20.695832 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:44:20.695832 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:44:20.695832 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:44:20.695832 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:44:20.695832 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:44:20.695832 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:44:20.695832 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:44:20.695832 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:44:20.695832 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:44:20.695832 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:44:20.695832 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:44:20.695832 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:44:20.695832 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:44:20.695832 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:44:20.695832 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33adc582-3420-40d7-b2db-768c73f7607d could not be found. Oct 04 22:44:20.695832 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:44:20.695832 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:44:20.700374 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:44:20.700374 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:44:20.700374 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:44:20.700374 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:44:20.700374 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:44:20.700374 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:44:20.700374 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33adc582-3420-40d7-b2db-768c73f7607d could not be found. Oct 04 22:44:20.700374 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:44:20.700374 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-3d2933e3-96f2-427d-a3ca-b1538f09779a tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Returning 404 to user: Instance 33adc582-3420-40d7-b2db-768c73f7607d could not be found. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:44:20.700374 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-3d2933e3-96f2-427d-a3ca-b1538f09779a tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] 10.222.0.43 "GET /compute/v2.1/servers/33adc582-3420-40d7-b2db-768c73f7607d" status: 404 len: 111 microversion: 2.1 time: 0.032016 Oct 04 22:44:20.700374 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3064/6950] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:44:20 2022] GET /compute/v2.1/servers/33adc582-3420-40d7-b2db-768c73f7607d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:44:23.943503 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-9e3212e5-0b35-4b08-9db3-ee14c83125f0 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Calling method '.version_select at 0x7fbb2c046670>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:44:23.977660 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-9e3212e5-0b35-4b08-9db3-ee14c83125f0 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-180182756" status: 202 len: 0 microversion: 2.1 time: 0.038103 Oct 04 22:44:23.983119 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3887/6951] 10.222.0.43 () {58 vars in 1281 bytes} [Tue Oct 4 22:44:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-180182756 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 22:44:24.007924 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-b9fa27d1-1d53-4276-aad6-abd4c90f11aa tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Action: 'create', calling method: .version_select at 0x7fbb2e793f70>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1320614161", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFhyZ3jjzwQ5gjPzNYJdXIqIIX/XaH3g6+eDqcydmYZNoDdr3rq/1hpzAz/m7n1kbDcJF/LXamCusp1OTad/sabSUBpo1bIOspx9fggHVyh7AagvA9SY7dbYqM/97FUrRw=="}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:44:24.025228 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-b9fa27d1-1d53-4276-aad6-abd4c90f11aa tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Getting quotas for project fd2856184afa47f2b4349f7dea9e5569. Resources: {'key_pairs'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:44:24.030405 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-b9fa27d1-1d53-4276-aad6-abd4c90f11aa tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Getting quotas for user bbc0ba9f45d04dec89394df46d6096a3 and project fd2856184afa47f2b4349f7dea9e5569. Resources: {'key_pairs'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:44:24.054354 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-b9fa27d1-1d53-4276-aad6-abd4c90f11aa tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.050261 Oct 04 22:44:24.055157 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3065/6952] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Oct 4 22:44:24 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:44:29.712191 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-78964e92-9411-4aa5-a844-a3c6c34c7e9e tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1495664010", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452", "networks": [{"uuid": "37bb8779-2f52-472d-b570-7fbe56a46915"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1320614161", "security_groups": [{"name": "tempest-secgroup-smoke-468606604"}]}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:44:29.831970 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.network.neutron [None req-78964e92-9411-4aa5-a844-a3c6c34c7e9e tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] validate_networks() for [('37bb8779-2f52-472d-b570-7fbe56a46915', None, None, None, None, None)] {{(pid=134101) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 22:44:30.220335 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=69,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:44:30.285008 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-78964e92-9411-4aa5-a844-a3c6c34c7e9e tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Flavor limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 22:44:30.285453 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-78964e92-9411-4aa5-a844-a3c6c34c7e9e tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Image limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 22:44:30.286503 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-78964e92-9411-4aa5-a844-a3c6c34c7e9e tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Flavor pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 22:44:30.286937 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-78964e92-9411-4aa5-a844-a3c6c34c7e9e tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Image pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 22:44:30.287377 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-78964e92-9411-4aa5-a844-a3c6c34c7e9e tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 22:44:30.298291 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-78964e92-9411-4aa5-a844-a3c6c34c7e9e tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:44:30.298839 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-78964e92-9411-4aa5-a844-a3c6c34c7e9e tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:44:30.299294 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-78964e92-9411-4aa5-a844-a3c6c34c7e9e tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:44:30.300275 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-78964e92-9411-4aa5-a844-a3c6c34c7e9e tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:44:30.300750 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-78964e92-9411-4aa5-a844-a3c6c34c7e9e tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:44:30.301529 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-78964e92-9411-4aa5-a844-a3c6c34c7e9e tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:44:30.333072 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-78964e92-9411-4aa5-a844-a3c6c34c7e9e tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Getting quotas for project fd2856184afa47f2b4349f7dea9e5569. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:44:30.339328 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-78964e92-9411-4aa5-a844-a3c6c34c7e9e tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Getting quotas for user bbc0ba9f45d04dec89394df46d6096a3 and project fd2856184afa47f2b4349f7dea9e5569. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:44:30.354028 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-78964e92-9411-4aa5-a844-a3c6c34c7e9e tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Going to run 1 instances... {{(pid=134101) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 22:44:30.356719 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-78964e92-9411-4aa5-a844-a3c6c34c7e9e tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] [instance: faed1301-6685-4155-bd00-c186366801cc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='58548514-5dac-426c-81f5-19e3fba33e23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134101) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 22:44:30.414332 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-78964e92-9411-4aa5-a844-a3c6c34c7e9e tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.706389 Oct 04 22:44:30.416663 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3888/6953] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 22:44:29 2022] POST /compute/v2.1/servers => generated 405 bytes in 709 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 22:44:30.429837 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-f6b75349-c9a6-4f4d-a638-ff7b61eb16fd tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:44:30.430615 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-f6b75349-c9a6-4f4d-a638-ff7b61eb16fd tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] [instance: faed1301-6685-4155-bd00-c186366801cc] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:44:30.500610 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-f6b75349-c9a6-4f4d-a638-ff7b61eb16fd tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc0ba9f45d04dec89394df46d6096a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2856184afa47f2b4349f7dea9e5569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:44:30.509200 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-f6b75349-c9a6-4f4d-a638-ff7b61eb16fd tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] 10.222.0.43 "GET /compute/v2.1/servers/faed1301-6685-4155-bd00-c186366801cc" status: 200 len: 1267 microversion: 2.1 time: 0.085177 Oct 04 22:44:30.509805 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3066/6954] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:44:30 2022] GET /compute/v2.1/servers/faed1301-6685-4155-bd00-c186366801cc => generated 1267 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:44:31.535996 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-016effdb-0f4d-4c69-8457-c9bf4999ed61 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:44:31.536953 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-016effdb-0f4d-4c69-8457-c9bf4999ed61 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] [instance: faed1301-6685-4155-bd00-c186366801cc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:44:31.545141 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-016effdb-0f4d-4c69-8457-c9bf4999ed61 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:44:31.545747 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-016effdb-0f4d-4c69-8457-c9bf4999ed61 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:44:31.546291 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-016effdb-0f4d-4c69-8457-c9bf4999ed61 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:44:31.547048 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-016effdb-0f4d-4c69-8457-c9bf4999ed61 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:44:31.547528 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-016effdb-0f4d-4c69-8457-c9bf4999ed61 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:44:31.548062 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-016effdb-0f4d-4c69-8457-c9bf4999ed61 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:44:31.619649 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-016effdb-0f4d-4c69-8457-c9bf4999ed61 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc0ba9f45d04dec89394df46d6096a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2856184afa47f2b4349f7dea9e5569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:44:31.629419 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-016effdb-0f4d-4c69-8457-c9bf4999ed61 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] 10.222.0.43 "GET /compute/v2.1/servers/faed1301-6685-4155-bd00-c186366801cc" status: 200 len: 1319 microversion: 2.1 time: 0.098168 Oct 04 22:44:31.629937 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3889/6955] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:44:31 2022] GET /compute/v2.1/servers/faed1301-6685-4155-bd00-c186366801cc => generated 1319 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:44:32.656789 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-dd893166-4ec1-483c-8b1e-e099d26729f4 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:44:32.657413 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-dd893166-4ec1-483c-8b1e-e099d26729f4 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] [instance: faed1301-6685-4155-bd00-c186366801cc] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:44:32.660389 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:44:32.663416 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:44:32.671887 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dd893166-4ec1-483c-8b1e-e099d26729f4 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:44:32.672613 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dd893166-4ec1-483c-8b1e-e099d26729f4 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:44:32.673306 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dd893166-4ec1-483c-8b1e-e099d26729f4 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:44:32.674242 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dd893166-4ec1-483c-8b1e-e099d26729f4 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:44:32.674940 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dd893166-4ec1-483c-8b1e-e099d26729f4 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:44:32.675474 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dd893166-4ec1-483c-8b1e-e099d26729f4 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:44:32.925153 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-dd893166-4ec1-483c-8b1e-e099d26729f4 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc0ba9f45d04dec89394df46d6096a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2856184afa47f2b4349f7dea9e5569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:44:32.934738 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-dd893166-4ec1-483c-8b1e-e099d26729f4 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] 10.222.0.43 "GET /compute/v2.1/servers/faed1301-6685-4155-bd00-c186366801cc" status: 200 len: 1392 microversion: 2.1 time: 0.286235 Oct 04 22:44:32.936141 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3067/6956] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:44:32 2022] GET /compute/v2.1/servers/faed1301-6685-4155-bd00-c186366801cc => generated 1392 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:44:33.620374 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-76d8e69a-4c22-4cb5-9abc-2104d975e503 req-c25f7c65-1ff8-4eb8-a990-ffb3943fb30b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "faed1301-6685-4155-bd00-c186366801cc", "tag": "5725edaa-390e-4835-b297-5c55a78e5a34"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:44:33.627775 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=49,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:44:33.635225 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-76d8e69a-4c22-4cb5-9abc-2104d975e503 req-c25f7c65-1ff8-4eb8-a990-ffb3943fb30b service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:44:33.635967 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-76d8e69a-4c22-4cb5-9abc-2104d975e503 req-c25f7c65-1ff8-4eb8-a990-ffb3943fb30b service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:44:33.636954 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-76d8e69a-4c22-4cb5-9abc-2104d975e503 req-c25f7c65-1ff8-4eb8-a990-ffb3943fb30b service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:44:33.651674 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-76d8e69a-4c22-4cb5-9abc-2104d975e503 req-c25f7c65-1ff8-4eb8-a990-ffb3943fb30b service nova] Creating event network-changed:5725edaa-390e-4835-b297-5c55a78e5a34 for instance faed1301-6685-4155-bd00-c186366801cc on n-h2-860284-1 Oct 04 22:44:33.659875 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-76d8e69a-4c22-4cb5-9abc-2104d975e503 req-c25f7c65-1ff8-4eb8-a990-ffb3943fb30b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044142 Oct 04 22:44:33.660515 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3890/6957] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:44:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:44:33.959141 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-6d42ae08-1b45-43d2-9096-176e053ef6a2 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:44:33.959757 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-6d42ae08-1b45-43d2-9096-176e053ef6a2 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] [instance: faed1301-6685-4155-bd00-c186366801cc] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:44:33.966551 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6d42ae08-1b45-43d2-9096-176e053ef6a2 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:44:33.967044 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6d42ae08-1b45-43d2-9096-176e053ef6a2 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:44:33.967541 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6d42ae08-1b45-43d2-9096-176e053ef6a2 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:44:33.968278 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6d42ae08-1b45-43d2-9096-176e053ef6a2 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:44:33.968781 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6d42ae08-1b45-43d2-9096-176e053ef6a2 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:44:33.969207 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6d42ae08-1b45-43d2-9096-176e053ef6a2 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:44:34.142112 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-6d42ae08-1b45-43d2-9096-176e053ef6a2 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc0ba9f45d04dec89394df46d6096a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2856184afa47f2b4349f7dea9e5569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:44:34.149826 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-6d42ae08-1b45-43d2-9096-176e053ef6a2 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] 10.222.0.43 "GET /compute/v2.1/servers/faed1301-6685-4155-bd00-c186366801cc" status: 200 len: 1392 microversion: 2.1 time: 0.194693 Oct 04 22:44:34.150432 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3068/6958] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:44:33 2022] GET /compute/v2.1/servers/faed1301-6685-4155-bd00-c186366801cc => generated 1392 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:44:35.174062 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-f420b03e-880b-44f9-b71f-400ebfad95fe tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:44:35.174827 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-f420b03e-880b-44f9-b71f-400ebfad95fe tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] [instance: faed1301-6685-4155-bd00-c186366801cc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:44:35.182636 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f420b03e-880b-44f9-b71f-400ebfad95fe tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:44:35.183770 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f420b03e-880b-44f9-b71f-400ebfad95fe tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:44:35.184234 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f420b03e-880b-44f9-b71f-400ebfad95fe tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:44:35.184959 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f420b03e-880b-44f9-b71f-400ebfad95fe tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:44:35.185435 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f420b03e-880b-44f9-b71f-400ebfad95fe tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:44:35.185883 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f420b03e-880b-44f9-b71f-400ebfad95fe tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:44:35.319047 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-f420b03e-880b-44f9-b71f-400ebfad95fe tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc0ba9f45d04dec89394df46d6096a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2856184afa47f2b4349f7dea9e5569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:44:35.326989 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-f420b03e-880b-44f9-b71f-400ebfad95fe tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] 10.222.0.43 "GET /compute/v2.1/servers/faed1301-6685-4155-bd00-c186366801cc" status: 200 len: 1392 microversion: 2.1 time: 0.157946 Oct 04 22:44:35.327569 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3891/6959] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:44:35 2022] GET /compute/v2.1/servers/faed1301-6685-4155-bd00-c186366801cc => generated 1392 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:44:36.351598 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-7364522d-d31b-4e22-bfd1-0b53edd90314 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:44:36.352763 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-7364522d-d31b-4e22-bfd1-0b53edd90314 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] [instance: faed1301-6685-4155-bd00-c186366801cc] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:44:36.359507 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7364522d-d31b-4e22-bfd1-0b53edd90314 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:44:36.360006 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7364522d-d31b-4e22-bfd1-0b53edd90314 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:44:36.360500 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7364522d-d31b-4e22-bfd1-0b53edd90314 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:44:36.361316 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7364522d-d31b-4e22-bfd1-0b53edd90314 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:44:36.361805 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7364522d-d31b-4e22-bfd1-0b53edd90314 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:44:36.362227 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7364522d-d31b-4e22-bfd1-0b53edd90314 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:44:36.584530 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-7364522d-d31b-4e22-bfd1-0b53edd90314 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc0ba9f45d04dec89394df46d6096a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2856184afa47f2b4349f7dea9e5569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:44:36.592522 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-7364522d-d31b-4e22-bfd1-0b53edd90314 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] 10.222.0.43 "GET /compute/v2.1/servers/faed1301-6685-4155-bd00-c186366801cc" status: 200 len: 1392 microversion: 2.1 time: 0.247108 Oct 04 22:44:36.593109 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3069/6960] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:44:36 2022] GET /compute/v2.1/servers/faed1301-6685-4155-bd00-c186366801cc => generated 1392 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:44:37.616110 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-287b7bb8-037a-45cc-8957-78a776950bb8 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:44:37.616735 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-287b7bb8-037a-45cc-8957-78a776950bb8 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] [instance: faed1301-6685-4155-bd00-c186366801cc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:44:37.624111 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-287b7bb8-037a-45cc-8957-78a776950bb8 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:44:37.624629 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-287b7bb8-037a-45cc-8957-78a776950bb8 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:44:37.625116 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-287b7bb8-037a-45cc-8957-78a776950bb8 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:44:37.625846 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-287b7bb8-037a-45cc-8957-78a776950bb8 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:44:37.626327 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-287b7bb8-037a-45cc-8957-78a776950bb8 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:44:37.626808 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-287b7bb8-037a-45cc-8957-78a776950bb8 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:44:37.760483 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-287b7bb8-037a-45cc-8957-78a776950bb8 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc0ba9f45d04dec89394df46d6096a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2856184afa47f2b4349f7dea9e5569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:44:37.768915 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-287b7bb8-037a-45cc-8957-78a776950bb8 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] 10.222.0.43 "GET /compute/v2.1/servers/faed1301-6685-4155-bd00-c186366801cc" status: 200 len: 1392 microversion: 2.1 time: 0.156795 Oct 04 22:44:37.769495 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3892/6961] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:44:37 2022] GET /compute/v2.1/servers/faed1301-6685-4155-bd00-c186366801cc => generated 1392 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:44:38.394441 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-da1c2503-94f6-443e-be16-9f11f41c892f req-bc3beb07-1eb8-4633-a8b0-9cb64e7e70aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "faed1301-6685-4155-bd00-c186366801cc", "name": "network-vif-plugged", "status": "completed", "tag": "5725edaa-390e-4835-b297-5c55a78e5a34"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:44:38.405353 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-da1c2503-94f6-443e-be16-9f11f41c892f req-bc3beb07-1eb8-4633-a8b0-9cb64e7e70aa service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:44:38.405835 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-da1c2503-94f6-443e-be16-9f11f41c892f req-bc3beb07-1eb8-4633-a8b0-9cb64e7e70aa service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:44:38.406264 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-da1c2503-94f6-443e-be16-9f11f41c892f req-bc3beb07-1eb8-4633-a8b0-9cb64e7e70aa service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:44:38.417454 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-da1c2503-94f6-443e-be16-9f11f41c892f req-bc3beb07-1eb8-4633-a8b0-9cb64e7e70aa service nova] Creating event network-vif-plugged:5725edaa-390e-4835-b297-5c55a78e5a34 for instance faed1301-6685-4155-bd00-c186366801cc on n-h2-860284-1 Oct 04 22:44:38.422822 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-da1c2503-94f6-443e-be16-9f11f41c892f req-bc3beb07-1eb8-4633-a8b0-9cb64e7e70aa service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032077 Oct 04 22:44:38.423602 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3070/6962] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:44:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:44:38.790562 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-61a2b6ad-a4f1-4534-a594-e80b462478e0 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:44:38.791202 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-61a2b6ad-a4f1-4534-a594-e80b462478e0 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] [instance: faed1301-6685-4155-bd00-c186366801cc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:44:38.798749 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-61a2b6ad-a4f1-4534-a594-e80b462478e0 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:44:38.799256 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-61a2b6ad-a4f1-4534-a594-e80b462478e0 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:44:38.799720 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-61a2b6ad-a4f1-4534-a594-e80b462478e0 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:44:38.800443 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-61a2b6ad-a4f1-4534-a594-e80b462478e0 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:44:38.800926 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-61a2b6ad-a4f1-4534-a594-e80b462478e0 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:44:38.801379 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-61a2b6ad-a4f1-4534-a594-e80b462478e0 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:44:38.949343 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-61a2b6ad-a4f1-4534-a594-e80b462478e0 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc0ba9f45d04dec89394df46d6096a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2856184afa47f2b4349f7dea9e5569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:44:38.957607 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-61a2b6ad-a4f1-4534-a594-e80b462478e0 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] 10.222.0.43 "GET /compute/v2.1/servers/faed1301-6685-4155-bd00-c186366801cc" status: 200 len: 1392 microversion: 2.1 time: 0.171080 Oct 04 22:44:38.958409 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3893/6963] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:44:38 2022] GET /compute/v2.1/servers/faed1301-6685-4155-bd00-c186366801cc => generated 1392 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:44:39.981646 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-9d074129-a06a-4ec0-8232-5e5758adf6a5 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:44:39.982337 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-9d074129-a06a-4ec0-8232-5e5758adf6a5 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] [instance: faed1301-6685-4155-bd00-c186366801cc] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:44:39.988468 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9d074129-a06a-4ec0-8232-5e5758adf6a5 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:44:39.988946 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9d074129-a06a-4ec0-8232-5e5758adf6a5 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:44:39.989381 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9d074129-a06a-4ec0-8232-5e5758adf6a5 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:44:39.990073 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9d074129-a06a-4ec0-8232-5e5758adf6a5 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:44:39.990558 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9d074129-a06a-4ec0-8232-5e5758adf6a5 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:44:39.990988 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9d074129-a06a-4ec0-8232-5e5758adf6a5 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:44:40.131863 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-9d074129-a06a-4ec0-8232-5e5758adf6a5 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc0ba9f45d04dec89394df46d6096a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2856184afa47f2b4349f7dea9e5569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:44:40.139984 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-9d074129-a06a-4ec0-8232-5e5758adf6a5 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] 10.222.0.43 "GET /compute/v2.1/servers/faed1301-6685-4155-bd00-c186366801cc" status: 200 len: 1392 microversion: 2.1 time: 0.163482 Oct 04 22:44:40.140579 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3071/6964] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:44:39 2022] GET /compute/v2.1/servers/faed1301-6685-4155-bd00-c186366801cc => generated 1392 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:44:41.164670 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-5d975db0-0192-412a-b43a-e280f628a10e tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:44:41.165340 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-5d975db0-0192-412a-b43a-e280f628a10e tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] [instance: faed1301-6685-4155-bd00-c186366801cc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:44:41.168937 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=2 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:44:41.169720 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=6 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:44:41.175984 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5d975db0-0192-412a-b43a-e280f628a10e tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:44:41.176533 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5d975db0-0192-412a-b43a-e280f628a10e tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:44:41.176995 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5d975db0-0192-412a-b43a-e280f628a10e tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:44:41.177759 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5d975db0-0192-412a-b43a-e280f628a10e tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:44:41.178259 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5d975db0-0192-412a-b43a-e280f628a10e tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:44:41.178767 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5d975db0-0192-412a-b43a-e280f628a10e tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:44:41.315074 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-5d975db0-0192-412a-b43a-e280f628a10e tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc0ba9f45d04dec89394df46d6096a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2856184afa47f2b4349f7dea9e5569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:44:41.322824 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-5d975db0-0192-412a-b43a-e280f628a10e tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] 10.222.0.43 "GET /compute/v2.1/servers/faed1301-6685-4155-bd00-c186366801cc" status: 200 len: 1565 microversion: 2.1 time: 0.162330 Oct 04 22:44:41.323414 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3894/6965] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:44:41 2022] GET /compute/v2.1/servers/faed1301-6685-4155-bd00-c186366801cc => generated 1565 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:44:41.344489 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-4d0332d3-d9b3-4458-bc30-eb59a69ab6bc tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:44:41.345149 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-4d0332d3-d9b3-4458-bc30-eb59a69ab6bc tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] [instance: faed1301-6685-4155-bd00-c186366801cc] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:44:41.347120 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell0:SELECT=6 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:44:41.353424 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4d0332d3-d9b3-4458-bc30-eb59a69ab6bc tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:44:41.353910 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4d0332d3-d9b3-4458-bc30-eb59a69ab6bc tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:44:41.354357 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4d0332d3-d9b3-4458-bc30-eb59a69ab6bc tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:44:41.355653 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4d0332d3-d9b3-4458-bc30-eb59a69ab6bc tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:44:41.356258 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4d0332d3-d9b3-4458-bc30-eb59a69ab6bc tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:44:41.356534 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4d0332d3-d9b3-4458-bc30-eb59a69ab6bc tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:44:41.489830 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-4d0332d3-d9b3-4458-bc30-eb59a69ab6bc tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc0ba9f45d04dec89394df46d6096a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2856184afa47f2b4349f7dea9e5569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:44:41.497865 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-4d0332d3-d9b3-4458-bc30-eb59a69ab6bc tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] 10.222.0.43 "GET /compute/v2.1/servers/faed1301-6685-4155-bd00-c186366801cc" status: 200 len: 1565 microversion: 2.1 time: 0.157278 Oct 04 22:44:41.498478 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3072/6966] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:44:41 2022] GET /compute/v2.1/servers/faed1301-6685-4155-bd00-c186366801cc => generated 1565 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:44:43.334396 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-0ad013ed-a18f-4806-b0c5-5dbd0517a880 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:44:43.335028 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-0ad013ed-a18f-4806-b0c5-5dbd0517a880 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] [instance: faed1301-6685-4155-bd00-c186366801cc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:44:43.336836 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-6f266c02-5811-4d4e-b394-bb931e0600bc req-a44f17e3-1ead-4415-860b-8c33a121f825 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "faed1301-6685-4155-bd00-c186366801cc", "tag": "5725edaa-390e-4835-b297-5c55a78e5a34"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:44:43.342684 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0ad013ed-a18f-4806-b0c5-5dbd0517a880 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:44:43.343198 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0ad013ed-a18f-4806-b0c5-5dbd0517a880 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:44:43.343649 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0ad013ed-a18f-4806-b0c5-5dbd0517a880 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:44:43.344379 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0ad013ed-a18f-4806-b0c5-5dbd0517a880 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:44:43.344849 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0ad013ed-a18f-4806-b0c5-5dbd0517a880 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:44:43.345290 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0ad013ed-a18f-4806-b0c5-5dbd0517a880 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:44:43.347978 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-6f266c02-5811-4d4e-b394-bb931e0600bc req-a44f17e3-1ead-4415-860b-8c33a121f825 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:44:43.348723 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-6f266c02-5811-4d4e-b394-bb931e0600bc req-a44f17e3-1ead-4415-860b-8c33a121f825 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:44:43.349270 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-6f266c02-5811-4d4e-b394-bb931e0600bc req-a44f17e3-1ead-4415-860b-8c33a121f825 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:44:43.361747 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-6f266c02-5811-4d4e-b394-bb931e0600bc req-a44f17e3-1ead-4415-860b-8c33a121f825 service nova] Creating event network-changed:5725edaa-390e-4835-b297-5c55a78e5a34 for instance faed1301-6685-4155-bd00-c186366801cc on n-h2-860284-1 Oct 04 22:44:43.367208 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-6f266c02-5811-4d4e-b394-bb931e0600bc req-a44f17e3-1ead-4415-860b-8c33a121f825 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034332 Oct 04 22:44:43.367947 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3073/6967] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:44:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:44:43.501943 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-0ad013ed-a18f-4806-b0c5-5dbd0517a880 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc0ba9f45d04dec89394df46d6096a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2856184afa47f2b4349f7dea9e5569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:44:43.510272 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-0ad013ed-a18f-4806-b0c5-5dbd0517a880 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] 10.222.0.43 "GET /compute/v2.1/servers/faed1301-6685-4155-bd00-c186366801cc" status: 200 len: 1565 microversion: 2.1 time: 0.180180 Oct 04 22:44:43.511390 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3895/6968] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:44:43 2022] GET /compute/v2.1/servers/faed1301-6685-4155-bd00-c186366801cc => generated 1565 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:45:16.803865 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_api:SELECT=13 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:45:16.804617 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=34 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:45:16.809356 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-5baa8d1e-f8a2-4ead-9d5b-8095a2a52b31 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:45:16.811656 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-5baa8d1e-f8a2-4ead-9d5b-8095a2a52b31 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] [instance: faed1301-6685-4155-bd00-c186366801cc] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:45:16.818536 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5baa8d1e-f8a2-4ead-9d5b-8095a2a52b31 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:45:16.819021 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5baa8d1e-f8a2-4ead-9d5b-8095a2a52b31 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:45:16.819462 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5baa8d1e-f8a2-4ead-9d5b-8095a2a52b31 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:45:16.820153 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5baa8d1e-f8a2-4ead-9d5b-8095a2a52b31 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:45:16.820610 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5baa8d1e-f8a2-4ead-9d5b-8095a2a52b31 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:45:16.821040 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5baa8d1e-f8a2-4ead-9d5b-8095a2a52b31 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:45:16.884279 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-5baa8d1e-f8a2-4ead-9d5b-8095a2a52b31 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] 10.222.0.43 "POST /compute/v2.1/servers/faed1301-6685-4155-bd00-c186366801cc/action" status: 200 len: 24572 microversion: 2.1 time: 0.082520 Oct 04 22:45:16.884945 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3074/6969] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 22:45:16 2022] POST /compute/v2.1/servers/faed1301-6685-4155-bd00-c186366801cc/action => generated 24572 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 22:45:47.259137 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=11 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:45:47.259966 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=40 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:45:47.264233 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-1e160820-5cab-4b3a-8619-340cc1fe7419 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "58548514-5dac-426c-81f5-19e3fba33e23"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:45:47.267066 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-1e160820-5cab-4b3a-8619-340cc1fe7419 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] [instance: faed1301-6685-4155-bd00-c186366801cc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:45:47.273819 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1e160820-5cab-4b3a-8619-340cc1fe7419 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:45:47.274327 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1e160820-5cab-4b3a-8619-340cc1fe7419 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:45:47.274859 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1e160820-5cab-4b3a-8619-340cc1fe7419 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:45:47.275643 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1e160820-5cab-4b3a-8619-340cc1fe7419 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:45:47.276115 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1e160820-5cab-4b3a-8619-340cc1fe7419 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:45:47.276564 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1e160820-5cab-4b3a-8619-340cc1fe7419 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:45:47.353621 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-1e160820-5cab-4b3a-8619-340cc1fe7419 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Flavor limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 22:45:47.354175 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-1e160820-5cab-4b3a-8619-340cc1fe7419 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Image limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 22:45:47.354700 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-1e160820-5cab-4b3a-8619-340cc1fe7419 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Flavor pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 22:45:47.355135 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-1e160820-5cab-4b3a-8619-340cc1fe7419 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Image pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 22:45:47.355574 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-1e160820-5cab-4b3a-8619-340cc1fe7419 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 22:45:47.416767 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-1e160820-5cab-4b3a-8619-340cc1fe7419 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] [instance: faed1301-6685-4155-bd00-c186366801cc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:45:47.424999 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1e160820-5cab-4b3a-8619-340cc1fe7419 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:45:47.425509 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1e160820-5cab-4b3a-8619-340cc1fe7419 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:45:47.425968 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1e160820-5cab-4b3a-8619-340cc1fe7419 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:45:47.426741 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1e160820-5cab-4b3a-8619-340cc1fe7419 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:45:47.427539 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1e160820-5cab-4b3a-8619-340cc1fe7419 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:45:47.427642 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1e160820-5cab-4b3a-8619-340cc1fe7419 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:45:47.458281 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-1e160820-5cab-4b3a-8619-340cc1fe7419 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] 10.222.0.43 "POST /compute/v2.1/servers/faed1301-6685-4155-bd00-c186366801cc/action" status: 202 len: 1139 microversion: 2.1 time: 0.201050 Oct 04 22:45:47.458977 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3896/6970] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 22:45:47 2022] POST /compute/v2.1/servers/faed1301-6685-4155-bd00-c186366801cc/action => generated 1139 bytes in 203 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 04 22:45:47.480268 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-ed686432-28ee-4d9e-ad16-c186cae16507 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:45:47.481024 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-ed686432-28ee-4d9e-ad16-c186cae16507 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] [instance: faed1301-6685-4155-bd00-c186366801cc] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:45:47.483742 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_api:SELECT=2 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:45:47.484489 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=4 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:45:47.490808 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ed686432-28ee-4d9e-ad16-c186cae16507 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:45:47.491305 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ed686432-28ee-4d9e-ad16-c186cae16507 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:45:47.491763 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ed686432-28ee-4d9e-ad16-c186cae16507 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:45:47.492466 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ed686432-28ee-4d9e-ad16-c186cae16507 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:45:47.492926 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ed686432-28ee-4d9e-ad16-c186cae16507 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:45:47.493356 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ed686432-28ee-4d9e-ad16-c186cae16507 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:45:47.629500 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-ed686432-28ee-4d9e-ad16-c186cae16507 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc0ba9f45d04dec89394df46d6096a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2856184afa47f2b4349f7dea9e5569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:45:47.637836 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-ed686432-28ee-4d9e-ad16-c186cae16507 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] 10.222.0.43 "GET /compute/v2.1/servers/faed1301-6685-4155-bd00-c186366801cc" status: 200 len: 1693 microversion: 2.1 time: 0.162840 Oct 04 22:45:47.638469 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3075/6971] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:45:47 2022] GET /compute/v2.1/servers/faed1301-6685-4155-bd00-c186366801cc => generated 1693 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:45:48.663395 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-6ec76422-dcf6-457b-811c-05bc50faa912 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:45:48.664061 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-6ec76422-dcf6-457b-811c-05bc50faa912 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] [instance: faed1301-6685-4155-bd00-c186366801cc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:45:48.671919 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6ec76422-dcf6-457b-811c-05bc50faa912 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:45:48.672425 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6ec76422-dcf6-457b-811c-05bc50faa912 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:45:48.672893 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6ec76422-dcf6-457b-811c-05bc50faa912 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:45:48.673611 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6ec76422-dcf6-457b-811c-05bc50faa912 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:45:48.674095 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6ec76422-dcf6-457b-811c-05bc50faa912 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:45:48.674578 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6ec76422-dcf6-457b-811c-05bc50faa912 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:45:48.811565 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-6ec76422-dcf6-457b-811c-05bc50faa912 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc0ba9f45d04dec89394df46d6096a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2856184afa47f2b4349f7dea9e5569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:45:48.819449 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-6ec76422-dcf6-457b-811c-05bc50faa912 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] 10.222.0.43 "GET /compute/v2.1/servers/faed1301-6685-4155-bd00-c186366801cc" status: 200 len: 1693 microversion: 2.1 time: 0.160054 Oct 04 22:45:48.820025 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3897/6972] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:45:48 2022] GET /compute/v2.1/servers/faed1301-6685-4155-bd00-c186366801cc => generated 1693 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:45:49.843147 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-2ce50bfe-7898-4b07-83f0-15818e058f3f tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:45:49.843764 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-2ce50bfe-7898-4b07-83f0-15818e058f3f tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] [instance: faed1301-6685-4155-bd00-c186366801cc] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:45:49.850592 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2ce50bfe-7898-4b07-83f0-15818e058f3f tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:45:49.851085 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2ce50bfe-7898-4b07-83f0-15818e058f3f tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:45:49.851528 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2ce50bfe-7898-4b07-83f0-15818e058f3f tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:45:49.852229 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2ce50bfe-7898-4b07-83f0-15818e058f3f tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:45:49.852692 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2ce50bfe-7898-4b07-83f0-15818e058f3f tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:45:49.853807 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2ce50bfe-7898-4b07-83f0-15818e058f3f tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:45:49.988348 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-2ce50bfe-7898-4b07-83f0-15818e058f3f tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc0ba9f45d04dec89394df46d6096a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2856184afa47f2b4349f7dea9e5569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:45:49.996254 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-2ce50bfe-7898-4b07-83f0-15818e058f3f tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] 10.222.0.43 "GET /compute/v2.1/servers/faed1301-6685-4155-bd00-c186366801cc" status: 200 len: 1693 microversion: 2.1 time: 0.157052 Oct 04 22:45:49.996837 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3076/6973] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:45:49 2022] GET /compute/v2.1/servers/faed1301-6685-4155-bd00-c186366801cc => generated 1693 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:45:51.019845 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e1aed9c9-6cb0-4c3a-93e0-8900577239a0 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:45:51.020518 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-e1aed9c9-6cb0-4c3a-93e0-8900577239a0 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] [instance: faed1301-6685-4155-bd00-c186366801cc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:45:51.027390 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e1aed9c9-6cb0-4c3a-93e0-8900577239a0 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:45:51.027900 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e1aed9c9-6cb0-4c3a-93e0-8900577239a0 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:45:51.028366 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e1aed9c9-6cb0-4c3a-93e0-8900577239a0 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:45:51.029086 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e1aed9c9-6cb0-4c3a-93e0-8900577239a0 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:45:51.029568 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e1aed9c9-6cb0-4c3a-93e0-8900577239a0 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:45:51.030023 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e1aed9c9-6cb0-4c3a-93e0-8900577239a0 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:45:51.169901 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-e1aed9c9-6cb0-4c3a-93e0-8900577239a0 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc0ba9f45d04dec89394df46d6096a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2856184afa47f2b4349f7dea9e5569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:45:51.177789 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-e1aed9c9-6cb0-4c3a-93e0-8900577239a0 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] 10.222.0.43 "GET /compute/v2.1/servers/faed1301-6685-4155-bd00-c186366801cc" status: 200 len: 1693 microversion: 2.1 time: 0.161959 Oct 04 22:45:51.178385 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3898/6974] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:45:51 2022] GET /compute/v2.1/servers/faed1301-6685-4155-bd00-c186366801cc => generated 1693 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:45:52.201003 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-e8c8019b-5a26-4664-902d-25b66d9aa288 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:45:52.201613 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-e8c8019b-5a26-4664-902d-25b66d9aa288 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] [instance: faed1301-6685-4155-bd00-c186366801cc] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:45:52.208416 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e8c8019b-5a26-4664-902d-25b66d9aa288 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:45:52.208903 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e8c8019b-5a26-4664-902d-25b66d9aa288 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:45:52.209340 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e8c8019b-5a26-4664-902d-25b66d9aa288 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:45:52.210025 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e8c8019b-5a26-4664-902d-25b66d9aa288 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:45:52.210508 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e8c8019b-5a26-4664-902d-25b66d9aa288 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:45:52.210941 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e8c8019b-5a26-4664-902d-25b66d9aa288 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:45:52.341741 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-e8c8019b-5a26-4664-902d-25b66d9aa288 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc0ba9f45d04dec89394df46d6096a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2856184afa47f2b4349f7dea9e5569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:45:52.349579 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-e8c8019b-5a26-4664-902d-25b66d9aa288 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] 10.222.0.43 "GET /compute/v2.1/servers/faed1301-6685-4155-bd00-c186366801cc" status: 200 len: 1693 microversion: 2.1 time: 0.152472 Oct 04 22:45:52.350167 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3077/6975] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:45:52 2022] GET /compute/v2.1/servers/faed1301-6685-4155-bd00-c186366801cc => generated 1693 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:45:53.373078 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-11534f77-eb6e-4a4b-b056-a7d553f05e4b tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:45:53.373722 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-11534f77-eb6e-4a4b-b056-a7d553f05e4b tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] [instance: faed1301-6685-4155-bd00-c186366801cc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:45:53.381008 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-11534f77-eb6e-4a4b-b056-a7d553f05e4b tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:45:53.381520 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-11534f77-eb6e-4a4b-b056-a7d553f05e4b tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:45:53.381986 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-11534f77-eb6e-4a4b-b056-a7d553f05e4b tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:45:53.382731 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-11534f77-eb6e-4a4b-b056-a7d553f05e4b tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:45:53.383216 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-11534f77-eb6e-4a4b-b056-a7d553f05e4b tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:45:53.383670 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-11534f77-eb6e-4a4b-b056-a7d553f05e4b tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:45:53.519674 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-11534f77-eb6e-4a4b-b056-a7d553f05e4b tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc0ba9f45d04dec89394df46d6096a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2856184afa47f2b4349f7dea9e5569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:45:53.527810 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-11534f77-eb6e-4a4b-b056-a7d553f05e4b tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] 10.222.0.43 "GET /compute/v2.1/servers/faed1301-6685-4155-bd00-c186366801cc" status: 200 len: 1693 microversion: 2.1 time: 0.158830 Oct 04 22:45:53.528396 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3899/6976] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:45:53 2022] GET /compute/v2.1/servers/faed1301-6685-4155-bd00-c186366801cc => generated 1693 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:45:54.550448 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-f85db390-44a2-4b9d-9623-2603e62bd51e tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:45:54.551073 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-f85db390-44a2-4b9d-9623-2603e62bd51e tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] [instance: faed1301-6685-4155-bd00-c186366801cc] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:45:54.559251 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f85db390-44a2-4b9d-9623-2603e62bd51e tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:45:54.559826 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f85db390-44a2-4b9d-9623-2603e62bd51e tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:45:54.560545 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f85db390-44a2-4b9d-9623-2603e62bd51e tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:45:54.561265 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f85db390-44a2-4b9d-9623-2603e62bd51e tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:45:54.561737 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f85db390-44a2-4b9d-9623-2603e62bd51e tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:45:54.562171 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f85db390-44a2-4b9d-9623-2603e62bd51e tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:45:54.696830 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-f85db390-44a2-4b9d-9623-2603e62bd51e tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc0ba9f45d04dec89394df46d6096a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2856184afa47f2b4349f7dea9e5569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:45:54.704736 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-f85db390-44a2-4b9d-9623-2603e62bd51e tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] 10.222.0.43 "GET /compute/v2.1/servers/faed1301-6685-4155-bd00-c186366801cc" status: 200 len: 1693 microversion: 2.1 time: 0.158258 Oct 04 22:45:54.705375 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3078/6977] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:45:54 2022] GET /compute/v2.1/servers/faed1301-6685-4155-bd00-c186366801cc => generated 1693 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:45:55.728790 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-170939bd-4c7f-4794-b3e9-f039be128540 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:45:55.729419 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-170939bd-4c7f-4794-b3e9-f039be128540 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] [instance: faed1301-6685-4155-bd00-c186366801cc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:45:55.736352 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-170939bd-4c7f-4794-b3e9-f039be128540 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:45:55.736794 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-170939bd-4c7f-4794-b3e9-f039be128540 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:45:55.737248 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-170939bd-4c7f-4794-b3e9-f039be128540 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:45:55.737954 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-170939bd-4c7f-4794-b3e9-f039be128540 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:45:55.738447 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-170939bd-4c7f-4794-b3e9-f039be128540 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:45:55.738893 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-170939bd-4c7f-4794-b3e9-f039be128540 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:45:55.871730 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-170939bd-4c7f-4794-b3e9-f039be128540 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc0ba9f45d04dec89394df46d6096a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2856184afa47f2b4349f7dea9e5569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:45:55.879777 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-170939bd-4c7f-4794-b3e9-f039be128540 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] 10.222.0.43 "GET /compute/v2.1/servers/faed1301-6685-4155-bd00-c186366801cc" status: 200 len: 1693 microversion: 2.1 time: 0.155769 Oct 04 22:45:55.880351 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3900/6978] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:45:55 2022] GET /compute/v2.1/servers/faed1301-6685-4155-bd00-c186366801cc => generated 1693 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:45:56.902869 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-049e4086-6d8c-4c42-b258-6816f49382d6 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:45:56.903512 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-049e4086-6d8c-4c42-b258-6816f49382d6 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] [instance: faed1301-6685-4155-bd00-c186366801cc] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:45:56.909958 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-049e4086-6d8c-4c42-b258-6816f49382d6 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:45:56.910483 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-049e4086-6d8c-4c42-b258-6816f49382d6 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:45:56.910934 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-049e4086-6d8c-4c42-b258-6816f49382d6 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:45:56.911633 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-049e4086-6d8c-4c42-b258-6816f49382d6 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:45:56.912093 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-049e4086-6d8c-4c42-b258-6816f49382d6 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:45:56.912525 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-049e4086-6d8c-4c42-b258-6816f49382d6 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:45:57.043656 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-049e4086-6d8c-4c42-b258-6816f49382d6 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc0ba9f45d04dec89394df46d6096a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2856184afa47f2b4349f7dea9e5569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:45:57.051354 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-049e4086-6d8c-4c42-b258-6816f49382d6 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] 10.222.0.43 "GET /compute/v2.1/servers/faed1301-6685-4155-bd00-c186366801cc" status: 200 len: 1693 microversion: 2.1 time: 0.152678 Oct 04 22:45:57.051940 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3079/6979] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:45:56 2022] GET /compute/v2.1/servers/faed1301-6685-4155-bd00-c186366801cc => generated 1693 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:45:58.075591 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e8afa143-f24d-4250-a834-c2a27ecd1e38 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:45:58.076228 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-e8afa143-f24d-4250-a834-c2a27ecd1e38 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] [instance: faed1301-6685-4155-bd00-c186366801cc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:45:58.083374 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e8afa143-f24d-4250-a834-c2a27ecd1e38 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:45:58.083880 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e8afa143-f24d-4250-a834-c2a27ecd1e38 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:45:58.084336 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e8afa143-f24d-4250-a834-c2a27ecd1e38 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:45:58.085056 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e8afa143-f24d-4250-a834-c2a27ecd1e38 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:45:58.085530 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e8afa143-f24d-4250-a834-c2a27ecd1e38 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:45:58.085979 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e8afa143-f24d-4250-a834-c2a27ecd1e38 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:45:58.219369 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-e8afa143-f24d-4250-a834-c2a27ecd1e38 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc0ba9f45d04dec89394df46d6096a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2856184afa47f2b4349f7dea9e5569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:45:58.227286 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-e8afa143-f24d-4250-a834-c2a27ecd1e38 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] 10.222.0.43 "GET /compute/v2.1/servers/faed1301-6685-4155-bd00-c186366801cc" status: 200 len: 1693 microversion: 2.1 time: 0.156114 Oct 04 22:45:58.227886 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3901/6980] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:45:58 2022] GET /compute/v2.1/servers/faed1301-6685-4155-bd00-c186366801cc => generated 1693 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:45:59.250527 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-03a88208-d252-440a-a3fe-78ec406d3eb4 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:45:59.251084 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-03a88208-d252-440a-a3fe-78ec406d3eb4 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] [instance: faed1301-6685-4155-bd00-c186366801cc] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:45:59.257947 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-03a88208-d252-440a-a3fe-78ec406d3eb4 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:45:59.258466 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-03a88208-d252-440a-a3fe-78ec406d3eb4 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:45:59.259469 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-03a88208-d252-440a-a3fe-78ec406d3eb4 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:45:59.260165 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-03a88208-d252-440a-a3fe-78ec406d3eb4 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:45:59.260623 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-03a88208-d252-440a-a3fe-78ec406d3eb4 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:45:59.261053 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-03a88208-d252-440a-a3fe-78ec406d3eb4 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:45:59.414802 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-03a88208-d252-440a-a3fe-78ec406d3eb4 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc0ba9f45d04dec89394df46d6096a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2856184afa47f2b4349f7dea9e5569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:45:59.422900 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-03a88208-d252-440a-a3fe-78ec406d3eb4 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] 10.222.0.43 "GET /compute/v2.1/servers/faed1301-6685-4155-bd00-c186366801cc" status: 200 len: 1693 microversion: 2.1 time: 0.176526 Oct 04 22:45:59.423498 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3080/6981] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:45:59 2022] GET /compute/v2.1/servers/faed1301-6685-4155-bd00-c186366801cc => generated 1693 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:46:00.447785 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-cc57ebc5-3416-43da-8a9f-103c100b5545 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:46:00.448421 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-cc57ebc5-3416-43da-8a9f-103c100b5545 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] [instance: faed1301-6685-4155-bd00-c186366801cc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:46:00.455365 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cc57ebc5-3416-43da-8a9f-103c100b5545 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:46:00.456027 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cc57ebc5-3416-43da-8a9f-103c100b5545 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:46:00.456508 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cc57ebc5-3416-43da-8a9f-103c100b5545 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:46:00.457222 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cc57ebc5-3416-43da-8a9f-103c100b5545 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:46:00.457692 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cc57ebc5-3416-43da-8a9f-103c100b5545 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:46:00.458143 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cc57ebc5-3416-43da-8a9f-103c100b5545 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:46:00.592415 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-cc57ebc5-3416-43da-8a9f-103c100b5545 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc0ba9f45d04dec89394df46d6096a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2856184afa47f2b4349f7dea9e5569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:46:00.600167 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-cc57ebc5-3416-43da-8a9f-103c100b5545 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] 10.222.0.43 "GET /compute/v2.1/servers/faed1301-6685-4155-bd00-c186366801cc" status: 200 len: 1693 microversion: 2.1 time: 0.156988 Oct 04 22:46:00.600743 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3902/6982] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:46:00 2022] GET /compute/v2.1/servers/faed1301-6685-4155-bd00-c186366801cc => generated 1693 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:46:01.623845 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-afca0b71-1caa-44af-981d-55cbd278642f tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:46:01.624447 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-afca0b71-1caa-44af-981d-55cbd278642f tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] [instance: faed1301-6685-4155-bd00-c186366801cc] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:46:01.631506 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-afca0b71-1caa-44af-981d-55cbd278642f tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:46:01.631993 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-afca0b71-1caa-44af-981d-55cbd278642f tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:46:01.632436 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-afca0b71-1caa-44af-981d-55cbd278642f tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:46:01.633135 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-afca0b71-1caa-44af-981d-55cbd278642f tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:46:01.633602 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-afca0b71-1caa-44af-981d-55cbd278642f tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:46:01.634822 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-afca0b71-1caa-44af-981d-55cbd278642f tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:46:01.769960 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-afca0b71-1caa-44af-981d-55cbd278642f tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc0ba9f45d04dec89394df46d6096a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2856184afa47f2b4349f7dea9e5569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:46:01.778335 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-afca0b71-1caa-44af-981d-55cbd278642f tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] 10.222.0.43 "GET /compute/v2.1/servers/faed1301-6685-4155-bd00-c186366801cc" status: 200 len: 1693 microversion: 2.1 time: 0.158477 Oct 04 22:46:01.778941 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3081/6983] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:46:01 2022] GET /compute/v2.1/servers/faed1301-6685-4155-bd00-c186366801cc => generated 1693 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:46:02.801640 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-3ccfe8f4-76d3-4376-afde-5737ff9c8a49 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:46:02.802282 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-3ccfe8f4-76d3-4376-afde-5737ff9c8a49 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] [instance: faed1301-6685-4155-bd00-c186366801cc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:46:02.809283 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3ccfe8f4-76d3-4376-afde-5737ff9c8a49 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:46:02.809793 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3ccfe8f4-76d3-4376-afde-5737ff9c8a49 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:46:02.810253 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3ccfe8f4-76d3-4376-afde-5737ff9c8a49 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:46:02.811001 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3ccfe8f4-76d3-4376-afde-5737ff9c8a49 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:46:02.811484 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3ccfe8f4-76d3-4376-afde-5737ff9c8a49 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:46:02.811936 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3ccfe8f4-76d3-4376-afde-5737ff9c8a49 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:46:02.942529 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-3ccfe8f4-76d3-4376-afde-5737ff9c8a49 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc0ba9f45d04dec89394df46d6096a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2856184afa47f2b4349f7dea9e5569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:46:02.950873 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-3ccfe8f4-76d3-4376-afde-5737ff9c8a49 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] 10.222.0.43 "GET /compute/v2.1/servers/faed1301-6685-4155-bd00-c186366801cc" status: 200 len: 1693 microversion: 2.1 time: 0.153206 Oct 04 22:46:02.951457 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3903/6984] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:46:02 2022] GET /compute/v2.1/servers/faed1301-6685-4155-bd00-c186366801cc => generated 1693 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:46:03.974434 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-ddd3a35f-c11d-43e3-8b18-6bdb24d3dfdf tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:46:03.975060 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-ddd3a35f-c11d-43e3-8b18-6bdb24d3dfdf tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] [instance: faed1301-6685-4155-bd00-c186366801cc] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:46:03.982592 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ddd3a35f-c11d-43e3-8b18-6bdb24d3dfdf tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:46:03.983087 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ddd3a35f-c11d-43e3-8b18-6bdb24d3dfdf tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:46:03.983536 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ddd3a35f-c11d-43e3-8b18-6bdb24d3dfdf tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:46:03.984237 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ddd3a35f-c11d-43e3-8b18-6bdb24d3dfdf tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:46:03.984701 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ddd3a35f-c11d-43e3-8b18-6bdb24d3dfdf tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:46:03.985133 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ddd3a35f-c11d-43e3-8b18-6bdb24d3dfdf tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:46:04.115340 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-ddd3a35f-c11d-43e3-8b18-6bdb24d3dfdf tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc0ba9f45d04dec89394df46d6096a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2856184afa47f2b4349f7dea9e5569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:46:04.123292 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-ddd3a35f-c11d-43e3-8b18-6bdb24d3dfdf tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] 10.222.0.43 "GET /compute/v2.1/servers/faed1301-6685-4155-bd00-c186366801cc" status: 200 len: 1693 microversion: 2.1 time: 0.152824 Oct 04 22:46:04.123882 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3082/6985] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:46:03 2022] GET /compute/v2.1/servers/faed1301-6685-4155-bd00-c186366801cc => generated 1693 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:46:05.147142 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-26888ebb-d382-43b9-9c1f-7c0be611b78b tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:46:05.147778 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-26888ebb-d382-43b9-9c1f-7c0be611b78b tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] [instance: faed1301-6685-4155-bd00-c186366801cc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:46:05.155039 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-26888ebb-d382-43b9-9c1f-7c0be611b78b tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:46:05.155553 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-26888ebb-d382-43b9-9c1f-7c0be611b78b tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:46:05.156014 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-26888ebb-d382-43b9-9c1f-7c0be611b78b tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:46:05.156739 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-26888ebb-d382-43b9-9c1f-7c0be611b78b tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:46:05.157217 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-26888ebb-d382-43b9-9c1f-7c0be611b78b tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:46:05.157664 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-26888ebb-d382-43b9-9c1f-7c0be611b78b tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:46:05.337995 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-26888ebb-d382-43b9-9c1f-7c0be611b78b tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc0ba9f45d04dec89394df46d6096a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2856184afa47f2b4349f7dea9e5569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:46:05.345924 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-26888ebb-d382-43b9-9c1f-7c0be611b78b tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] 10.222.0.43 "GET /compute/v2.1/servers/faed1301-6685-4155-bd00-c186366801cc" status: 200 len: 1699 microversion: 2.1 time: 0.202955 Oct 04 22:46:05.346962 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3904/6986] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:46:05 2022] GET /compute/v2.1/servers/faed1301-6685-4155-bd00-c186366801cc => generated 1699 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:46:06.370945 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-f8ed4659-6d2e-4d68-8841-db3247f44643 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:46:06.371567 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-f8ed4659-6d2e-4d68-8841-db3247f44643 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] [instance: faed1301-6685-4155-bd00-c186366801cc] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:46:06.378796 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f8ed4659-6d2e-4d68-8841-db3247f44643 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:46:06.379286 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f8ed4659-6d2e-4d68-8841-db3247f44643 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:46:06.379729 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f8ed4659-6d2e-4d68-8841-db3247f44643 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:46:06.380435 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f8ed4659-6d2e-4d68-8841-db3247f44643 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:46:06.380902 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f8ed4659-6d2e-4d68-8841-db3247f44643 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:46:06.381332 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f8ed4659-6d2e-4d68-8841-db3247f44643 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:46:06.514904 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-f8ed4659-6d2e-4d68-8841-db3247f44643 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc0ba9f45d04dec89394df46d6096a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2856184afa47f2b4349f7dea9e5569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:46:06.522606 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-f8ed4659-6d2e-4d68-8841-db3247f44643 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] 10.222.0.43 "GET /compute/v2.1/servers/faed1301-6685-4155-bd00-c186366801cc" status: 200 len: 1699 microversion: 2.1 time: 0.156202 Oct 04 22:46:06.523197 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3083/6987] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:46:06 2022] GET /compute/v2.1/servers/faed1301-6685-4155-bd00-c186366801cc => generated 1699 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:46:07.546141 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-aad055f6-9356-431f-ad40-d80a31e9a4f6 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:46:07.546811 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-aad055f6-9356-431f-ad40-d80a31e9a4f6 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] [instance: faed1301-6685-4155-bd00-c186366801cc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:46:07.553919 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-aad055f6-9356-431f-ad40-d80a31e9a4f6 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:46:07.554468 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-aad055f6-9356-431f-ad40-d80a31e9a4f6 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:46:07.555090 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-aad055f6-9356-431f-ad40-d80a31e9a4f6 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:46:07.555934 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-aad055f6-9356-431f-ad40-d80a31e9a4f6 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:46:07.556422 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-aad055f6-9356-431f-ad40-d80a31e9a4f6 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:46:07.556875 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-aad055f6-9356-431f-ad40-d80a31e9a4f6 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:46:07.690055 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-aad055f6-9356-431f-ad40-d80a31e9a4f6 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc0ba9f45d04dec89394df46d6096a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2856184afa47f2b4349f7dea9e5569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:46:07.698645 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-aad055f6-9356-431f-ad40-d80a31e9a4f6 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] 10.222.0.43 "GET /compute/v2.1/servers/faed1301-6685-4155-bd00-c186366801cc" status: 200 len: 1699 microversion: 2.1 time: 0.156420 Oct 04 22:46:07.699271 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3905/6988] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:46:07 2022] GET /compute/v2.1/servers/faed1301-6685-4155-bd00-c186366801cc => generated 1699 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:46:08.721946 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-e17b4f3a-48d4-492c-920e-b329ad33e8a7 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:46:08.722499 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-e17b4f3a-48d4-492c-920e-b329ad33e8a7 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] [instance: faed1301-6685-4155-bd00-c186366801cc] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:46:08.732292 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e17b4f3a-48d4-492c-920e-b329ad33e8a7 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:46:08.732292 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e17b4f3a-48d4-492c-920e-b329ad33e8a7 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:46:08.732292 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e17b4f3a-48d4-492c-920e-b329ad33e8a7 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:46:08.732803 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e17b4f3a-48d4-492c-920e-b329ad33e8a7 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:46:08.733256 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e17b4f3a-48d4-492c-920e-b329ad33e8a7 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:46:08.733698 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e17b4f3a-48d4-492c-920e-b329ad33e8a7 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:46:08.873547 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-e17b4f3a-48d4-492c-920e-b329ad33e8a7 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc0ba9f45d04dec89394df46d6096a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2856184afa47f2b4349f7dea9e5569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:46:08.882168 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-e17b4f3a-48d4-492c-920e-b329ad33e8a7 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] 10.222.0.43 "GET /compute/v2.1/servers/faed1301-6685-4155-bd00-c186366801cc" status: 200 len: 1684 microversion: 2.1 time: 0.164294 Oct 04 22:46:08.883383 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3084/6989] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:46:08 2022] GET /compute/v2.1/servers/faed1301-6685-4155-bd00-c186366801cc => generated 1684 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:46:08.997539 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-420211df-f741-4f0e-9edd-b74f809e76aa req-f5220555-de51-43ea-8286-52bb9031d350 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "faed1301-6685-4155-bd00-c186366801cc", "name": "network-vif-unplugged", "status": "completed", "tag": "5725edaa-390e-4835-b297-5c55a78e5a34"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:46:09.008325 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-420211df-f741-4f0e-9edd-b74f809e76aa req-f5220555-de51-43ea-8286-52bb9031d350 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:46:09.009390 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-420211df-f741-4f0e-9edd-b74f809e76aa req-f5220555-de51-43ea-8286-52bb9031d350 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:46:09.009935 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-420211df-f741-4f0e-9edd-b74f809e76aa req-f5220555-de51-43ea-8286-52bb9031d350 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:46:09.021878 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-420211df-f741-4f0e-9edd-b74f809e76aa req-f5220555-de51-43ea-8286-52bb9031d350 service nova] Creating event network-vif-unplugged:5725edaa-390e-4835-b297-5c55a78e5a34 for instance faed1301-6685-4155-bd00-c186366801cc on n-h2-860284-1 Oct 04 22:46:09.028444 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-420211df-f741-4f0e-9edd-b74f809e76aa req-f5220555-de51-43ea-8286-52bb9031d350 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034764 Oct 04 22:46:09.029219 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3906/6990] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:46:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:46:11.066246 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-48ddf394-a659-4539-87ba-429f5090c7f3 req-14c7bdc6-a64e-4fb8-9e0d-606f476af7ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "faed1301-6685-4155-bd00-c186366801cc", "name": "network-vif-plugged", "status": "completed", "tag": "5725edaa-390e-4835-b297-5c55a78e5a34"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:46:11.073128 n-d-860284-1 devstack@n-api.service[134102]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 22:46:11.073481 n-d-860284-1 devstack@n-api.service[134102]: Tue Oct 4 22:46:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.43) !!! Oct 04 22:46:11.081293 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-48ddf394-a659-4539-87ba-429f5090c7f3 req-14c7bdc6-a64e-4fb8-9e0d-606f476af7ed service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:46:11.081772 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-48ddf394-a659-4539-87ba-429f5090c7f3 req-14c7bdc6-a64e-4fb8-9e0d-606f476af7ed service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:46:11.082217 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-48ddf394-a659-4539-87ba-429f5090c7f3 req-14c7bdc6-a64e-4fb8-9e0d-606f476af7ed service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:46:11.094229 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-48ddf394-a659-4539-87ba-429f5090c7f3 req-14c7bdc6-a64e-4fb8-9e0d-606f476af7ed service nova] Creating event network-vif-plugged:5725edaa-390e-4835-b297-5c55a78e5a34 for instance faed1301-6685-4155-bd00-c186366801cc on n-h2-860284-1 Oct 04 22:46:11.099353 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-48ddf394-a659-4539-87ba-429f5090c7f3 req-14c7bdc6-a64e-4fb8-9e0d-606f476af7ed service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036867 Oct 04 22:46:11.100199 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3085/6991] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:46:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:46:45.126176 n-d-860284-1 devstack@n-api.service[134101]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 22:46:45.127423 n-d-860284-1 devstack@n-api.service[134101]: Tue Oct 4 22:46:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/faed1301-6685-4155-bd00-c186366801cc/action (ip 10.222.0.43) !!! Oct 04 22:46:45.128886 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=26 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:46:45.129671 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:46:45.134689 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-f3fa17b4-db0a-4ed0-855e-f1d394cb4d2d tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:46:45.136985 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-f3fa17b4-db0a-4ed0-855e-f1d394cb4d2d tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] [instance: faed1301-6685-4155-bd00-c186366801cc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:46:45.147760 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f3fa17b4-db0a-4ed0-855e-f1d394cb4d2d tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:46:45.148261 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f3fa17b4-db0a-4ed0-855e-f1d394cb4d2d tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:46:45.149356 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f3fa17b4-db0a-4ed0-855e-f1d394cb4d2d tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:46:45.150081 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f3fa17b4-db0a-4ed0-855e-f1d394cb4d2d tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:46:45.150587 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f3fa17b4-db0a-4ed0-855e-f1d394cb4d2d tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:46:45.151036 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f3fa17b4-db0a-4ed0-855e-f1d394cb4d2d tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:46:45.208525 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-f3fa17b4-db0a-4ed0-855e-f1d394cb4d2d tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] 10.222.0.43 "POST /compute/v2.1/servers/faed1301-6685-4155-bd00-c186366801cc/action" status: 200 len: 24572 microversion: 2.1 time: 0.083279 Oct 04 22:46:45.209181 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3907/6992] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 22:46:45 2022] POST /compute/v2.1/servers/faed1301-6685-4155-bd00-c186366801cc/action => generated 24572 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 22:47:16.517674 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_api:SELECT=22 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:47:16.518461 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=62 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:47:16.522682 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-e459f56f-df13-414d-ae02-10f03b0d8c56 req-119dc1f8-1b8d-45cb-b7cc-9fb5224b3bbc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "faed1301-6685-4155-bd00-c186366801cc", "tag": "5725edaa-390e-4835-b297-5c55a78e5a34"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:47:16.523355 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-2be9b762-0add-4a43-97c8-9db54d849e8b tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:47:16.524624 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-2be9b762-0add-4a43-97c8-9db54d849e8b tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] [instance: faed1301-6685-4155-bd00-c186366801cc] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:47:16.530655 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=2 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:47:16.531406 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=4 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:47:16.532597 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2be9b762-0add-4a43-97c8-9db54d849e8b tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:47:16.533529 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2be9b762-0add-4a43-97c8-9db54d849e8b tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:47:16.534785 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2be9b762-0add-4a43-97c8-9db54d849e8b tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:47:16.535875 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2be9b762-0add-4a43-97c8-9db54d849e8b tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:47:16.536585 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-e459f56f-df13-414d-ae02-10f03b0d8c56 req-119dc1f8-1b8d-45cb-b7cc-9fb5224b3bbc service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:47:16.536714 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2be9b762-0add-4a43-97c8-9db54d849e8b tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:47:16.537091 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-e459f56f-df13-414d-ae02-10f03b0d8c56 req-119dc1f8-1b8d-45cb-b7cc-9fb5224b3bbc service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:47:16.537207 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2be9b762-0add-4a43-97c8-9db54d849e8b tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:47:16.537550 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-e459f56f-df13-414d-ae02-10f03b0d8c56 req-119dc1f8-1b8d-45cb-b7cc-9fb5224b3bbc service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:47:16.551934 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-e459f56f-df13-414d-ae02-10f03b0d8c56 req-119dc1f8-1b8d-45cb-b7cc-9fb5224b3bbc service nova] Creating event network-changed:5725edaa-390e-4835-b297-5c55a78e5a34 for instance faed1301-6685-4155-bd00-c186366801cc on n-h2-860284-1 Oct 04 22:47:16.558652 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-e459f56f-df13-414d-ae02-10f03b0d8c56 req-119dc1f8-1b8d-45cb-b7cc-9fb5224b3bbc service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042404 Oct 04 22:47:16.559477 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3908/6993] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:47:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:47:16.569827 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-2be9b762-0add-4a43-97c8-9db54d849e8b tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] [instance: faed1301-6685-4155-bd00-c186366801cc] Going to try to terminate instance {{(pid=134102) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 22:47:16.662329 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-2be9b762-0add-4a43-97c8-9db54d849e8b tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] 10.222.0.43 "DELETE /compute/v2.1/servers/faed1301-6685-4155-bd00-c186366801cc" status: 204 len: 0 microversion: 2.1 time: 0.146570 Oct 04 22:47:16.663193 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3086/6994] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 22:47:16 2022] DELETE /compute/v2.1/servers/faed1301-6685-4155-bd00-c186366801cc => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 22:47:16.672735 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-34a411b2-e81d-499b-aa2c-a6ec3ce9eabd tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:47:16.673473 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-34a411b2-e81d-499b-aa2c-a6ec3ce9eabd tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] [instance: faed1301-6685-4155-bd00-c186366801cc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:47:16.681184 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-34a411b2-e81d-499b-aa2c-a6ec3ce9eabd tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:47:16.681701 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-34a411b2-e81d-499b-aa2c-a6ec3ce9eabd tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:47:16.682167 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-34a411b2-e81d-499b-aa2c-a6ec3ce9eabd tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:47:16.682988 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-34a411b2-e81d-499b-aa2c-a6ec3ce9eabd tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:47:16.683830 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-34a411b2-e81d-499b-aa2c-a6ec3ce9eabd tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:47:16.683965 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-34a411b2-e81d-499b-aa2c-a6ec3ce9eabd tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:47:16.941934 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-34a411b2-e81d-499b-aa2c-a6ec3ce9eabd tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc0ba9f45d04dec89394df46d6096a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2856184afa47f2b4349f7dea9e5569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:47:16.950086 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-34a411b2-e81d-499b-aa2c-a6ec3ce9eabd tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] 10.222.0.43 "GET /compute/v2.1/servers/faed1301-6685-4155-bd00-c186366801cc" status: 200 len: 1690 microversion: 2.1 time: 0.281740 Oct 04 22:47:16.950789 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3909/6995] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:47:16 2022] GET /compute/v2.1/servers/faed1301-6685-4155-bd00-c186366801cc => generated 1690 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:47:17.975146 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-2a4b2f97-0785-42b1-9da6-e62e8061fdd0 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:47:17.975852 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-2a4b2f97-0785-42b1-9da6-e62e8061fdd0 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] [instance: faed1301-6685-4155-bd00-c186366801cc] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:47:17.983209 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2a4b2f97-0785-42b1-9da6-e62e8061fdd0 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:47:17.983696 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2a4b2f97-0785-42b1-9da6-e62e8061fdd0 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:47:17.984138 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2a4b2f97-0785-42b1-9da6-e62e8061fdd0 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:47:17.984831 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2a4b2f97-0785-42b1-9da6-e62e8061fdd0 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:47:17.985291 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2a4b2f97-0785-42b1-9da6-e62e8061fdd0 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:47:17.985719 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2a4b2f97-0785-42b1-9da6-e62e8061fdd0 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:47:18.205263 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-2a4b2f97-0785-42b1-9da6-e62e8061fdd0 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc0ba9f45d04dec89394df46d6096a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2856184afa47f2b4349f7dea9e5569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:47:18.213959 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-2a4b2f97-0785-42b1-9da6-e62e8061fdd0 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] 10.222.0.43 "GET /compute/v2.1/servers/faed1301-6685-4155-bd00-c186366801cc" status: 200 len: 1690 microversion: 2.1 time: 0.243192 Oct 04 22:47:18.214589 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3087/6996] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:47:17 2022] GET /compute/v2.1/servers/faed1301-6685-4155-bd00-c186366801cc => generated 1690 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:47:18.715559 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-27e71686-02a2-463e-902a-98dd4b3e6ec4 req-180aac34-7939-4b18-817d-554053c3d80b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "faed1301-6685-4155-bd00-c186366801cc", "name": "network-vif-deleted", "tag": "5725edaa-390e-4835-b297-5c55a78e5a34"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:47:18.728172 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-27e71686-02a2-463e-902a-98dd4b3e6ec4 req-180aac34-7939-4b18-817d-554053c3d80b service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:47:18.728680 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-27e71686-02a2-463e-902a-98dd4b3e6ec4 req-180aac34-7939-4b18-817d-554053c3d80b service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:47:18.729217 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-27e71686-02a2-463e-902a-98dd4b3e6ec4 req-180aac34-7939-4b18-817d-554053c3d80b service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:47:18.740278 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-27e71686-02a2-463e-902a-98dd4b3e6ec4 req-180aac34-7939-4b18-817d-554053c3d80b service nova] Creating event network-vif-deleted:5725edaa-390e-4835-b297-5c55a78e5a34 for instance faed1301-6685-4155-bd00-c186366801cc on n-h2-860284-1 Oct 04 22:47:18.746191 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-27e71686-02a2-463e-902a-98dd4b3e6ec4 req-180aac34-7939-4b18-817d-554053c3d80b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034539 Oct 04 22:47:18.746839 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3910/6997] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:47:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:47:19.239573 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-88129510-7c5d-414c-ba38-91dc1d193daa tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:47:19.240224 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-88129510-7c5d-414c-ba38-91dc1d193daa tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] [instance: faed1301-6685-4155-bd00-c186366801cc] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:47:19.248214 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-88129510-7c5d-414c-ba38-91dc1d193daa tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:47:19.248797 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-88129510-7c5d-414c-ba38-91dc1d193daa tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:47:19.249245 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-88129510-7c5d-414c-ba38-91dc1d193daa tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:47:19.249958 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-88129510-7c5d-414c-ba38-91dc1d193daa tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:47:19.250495 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-88129510-7c5d-414c-ba38-91dc1d193daa tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:47:19.250950 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-88129510-7c5d-414c-ba38-91dc1d193daa tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:47:19.265558 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-88129510-7c5d-414c-ba38-91dc1d193daa tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] HTTP exception thrown: Instance faed1301-6685-4155-bd00-c186366801cc could not be found. Oct 04 22:47:19.267382 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-88129510-7c5d-414c-ba38-91dc1d193daa tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Request method failure captured: Oct 04 22:47:19.267382 n-d-860284-1 devstack@n-api.service[134102]: request: GET /compute/v2.1/servers/faed1301-6685-4155-bd00-c186366801cc HTTP/1.1 Oct 04 22:47:19.267382 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 22:47:19.267382 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 22:47:19.267382 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 22:47:19.267382 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 22:47:19.267382 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 22:47:19.267382 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 22:47:19.267382 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 22:47:19.267382 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 22:47:19.267382 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPLV0i4fTyng2qLmqpOZDonbjmzoxCV_51fHF-2sehfrgMV9QVuGfN-Zf-uieedzXZTWMfP9hC44tva1SBwtRF8VLus6BFLrvLfEQUnNKLdCLmtRz5RQ2K95IuirNrCK0fpkR4wYvfI0Vw9CX7gwLNdKW8QNt5h37SFpMjtwukn05Yn0 Oct 04 22:47:19.267382 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 22:47:19.267382 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 22:47:19.267382 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 22:47:19.267382 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 22:47:19.267382 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 22:47:19.267382 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 22:47:19.267382 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: fd2856184afa47f2b4349f7dea9e5569 Oct 04 22:47:19.267382 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1049323607 Oct 04 22:47:19.267382 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 22:47:19.267382 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 22:47:19.267382 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/fd2856184afa47f2b4349f7dea9e5569"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_fd2856184afa47f2b4349f7dea9e5569", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/fd2856184afa47f2b4349f7dea9e5569"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/fd2856184afa47f2b4349f7dea9e5569"}]}] Oct 04 22:47:19.267382 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1049323607 Oct 04 22:47:19.267382 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: fd2856184afa47f2b4349f7dea9e5569 Oct 04 22:47:19.267382 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1049323607 Oct 04 22:47:19.267382 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-TestNetworkAdvancedServerOps-1049323607-project Oct 04 22:47:19.267382 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 22:47:19.267382 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 22:47:19.267382 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: bbc0ba9f45d04dec89394df46d6096a3 Oct 04 22:47:19.267382 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1049323607-project Oct 04 22:47:19.267382 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 22:47:19.267382 n-d-860284-1 devstack@n-api.service[134102]: exception: Instance faed1301-6685-4155-bd00-c186366801cc could not be found. Oct 04 22:47:19.267382 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': 'faed1301-6685-4155-bd00-c186366801cc'} Oct 04 22:47:19.267382 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:47:19.267382 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:47:19.267382 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:47:19.267382 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:47:19.267382 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:47:19.267382 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:47:19.267382 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:47:19.267382 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:47:19.267382 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:47:19.267382 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:47:19.267382 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance faed1301-6685-4155-bd00-c186366801cc could not be found. Oct 04 22:47:19.267382 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:47:19.267382 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:47:19.267382 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:47:19.267382 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:47:19.267382 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:47:19.267382 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:47:19.267382 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:47:19.267382 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:47:19.267382 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:47:19.267382 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:47:19.267382 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:47:19.267382 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:47:19.267382 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:47:19.267382 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:47:19.267382 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:47:19.267382 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:47:19.267382 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance faed1301-6685-4155-bd00-c186366801cc could not be found. Oct 04 22:47:19.267382 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:47:19.267382 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:47:19.271169 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:47:19.271169 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:47:19.271169 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:47:19.271169 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:47:19.271169 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:47:19.271169 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:47:19.271169 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance faed1301-6685-4155-bd00-c186366801cc could not be found. Oct 04 22:47:19.271169 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:47:19.271169 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-88129510-7c5d-414c-ba38-91dc1d193daa tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Returning 404 to user: Instance faed1301-6685-4155-bd00-c186366801cc could not be found. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:47:19.271169 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-88129510-7c5d-414c-ba38-91dc1d193daa tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] 10.222.0.43 "GET /compute/v2.1/servers/faed1301-6685-4155-bd00-c186366801cc" status: 404 len: 111 microversion: 2.1 time: 0.033669 Oct 04 22:47:19.271169 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3088/6998] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:47:19 2022] GET /compute/v2.1/servers/faed1301-6685-4155-bd00-c186366801cc => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:47:22.766940 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-4017be29-f7ef-4ba7-9337-8d7e2ac757e3 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] Calling method '.version_select at 0x7fbb2e11ff70>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:47:22.796017 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-4017be29-f7ef-4ba7-9337-8d7e2ac757e3 tempest-TestNetworkAdvancedServerOps-1049323607 tempest-TestNetworkAdvancedServerOps-1049323607-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1320614161" status: 202 len: 0 microversion: 2.1 time: 0.034276 Oct 04 22:47:22.796598 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3911/6999] 10.222.0.43 () {58 vars in 1284 bytes} [Tue Oct 4 22:47:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1320614161 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 22:47:34.291742 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:47:34.293484 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:47:34.445717 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-12dba762-4a99-4bd2-9588-cd742195e63a tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:47:34.447565 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-12dba762-4a99-4bd2-9588-cd742195e63a tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:47:34.448133 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-12dba762-4a99-4bd2-9588-cd742195e63a tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:47:34.448655 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-12dba762-4a99-4bd2-9588-cd742195e63a tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:47:34.449469 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-12dba762-4a99-4bd2-9588-cd742195e63a tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:47:34.450181 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-12dba762-4a99-4bd2-9588-cd742195e63a tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:47:34.450868 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-12dba762-4a99-4bd2-9588-cd742195e63a tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:47:34.478834 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-12dba762-4a99-4bd2-9588-cd742195e63a tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] 10.222.0.43 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.193150 Oct 04 22:47:34.479443 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3089/7000] 10.222.0.43 () {58 vars in 1185 bytes} [Tue Oct 4 22:47:34 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:47:34.615563 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-30038c9d-b15c-4405-b852-2e11131cab74 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-294700008", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452", "availability_zone": "nova:n-h2-860284-1", "networks": [{"uuid": "9023a47f-a7e1-4443-8746-6b2407484daa"}]}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:47:34.625176 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=10 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:47:34.626604 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:47:34.691065 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.network.neutron [None req-30038c9d-b15c-4405-b852-2e11131cab74 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] validate_networks() for [('9023a47f-a7e1-4443-8746-6b2407484daa', None, None, None, None, None)] {{(pid=134101) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 22:47:35.082620 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-30038c9d-b15c-4405-b852-2e11131cab74 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Flavor limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 22:47:35.083097 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-30038c9d-b15c-4405-b852-2e11131cab74 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Image limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 22:47:35.083584 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-30038c9d-b15c-4405-b852-2e11131cab74 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Flavor pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 22:47:35.084055 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-30038c9d-b15c-4405-b852-2e11131cab74 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Image pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 22:47:35.084499 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-30038c9d-b15c-4405-b852-2e11131cab74 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 22:47:35.095511 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-30038c9d-b15c-4405-b852-2e11131cab74 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:47:35.096020 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-30038c9d-b15c-4405-b852-2e11131cab74 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:47:35.096480 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-30038c9d-b15c-4405-b852-2e11131cab74 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:47:35.097239 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-30038c9d-b15c-4405-b852-2e11131cab74 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:47:35.097720 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-30038c9d-b15c-4405-b852-2e11131cab74 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:47:35.098172 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-30038c9d-b15c-4405-b852-2e11131cab74 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:47:35.122852 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-30038c9d-b15c-4405-b852-2e11131cab74 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Getting quotas for project 8b911acbc44f4c419bdf2e7a15128d42. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:47:35.129041 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-30038c9d-b15c-4405-b852-2e11131cab74 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Getting quotas for user aa7baa9b51d54220b8fde803d250bd0c and project 8b911acbc44f4c419bdf2e7a15128d42. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:47:35.144592 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-30038c9d-b15c-4405-b852-2e11131cab74 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Going to run 1 instances... {{(pid=134101) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 22:47:35.147107 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-30038c9d-b15c-4405-b852-2e11131cab74 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] [instance: cce96b87-3345-4234-8656-c01d0ac5e46c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='58548514-5dac-426c-81f5-19e3fba33e23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134101) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 22:47:35.193538 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-30038c9d-b15c-4405-b852-2e11131cab74 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.581980 Oct 04 22:47:35.194193 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3912/7001] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 22:47:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 583 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 22:47:35.205489 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-826a7393-c4cb-459e-b29b-7b495923ef73 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:47:35.206111 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-826a7393-c4cb-459e-b29b-7b495923ef73 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] [instance: cce96b87-3345-4234-8656-c01d0ac5e46c] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:47:35.266302 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-826a7393-c4cb-459e-b29b-7b495923ef73 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/cce96b87-3345-4234-8656-c01d0ac5e46c" status: 200 len: 1328 microversion: 2.1 time: 0.064644 Oct 04 22:47:35.267026 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3090/7002] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:47:35 2022] GET /compute/v2.1/servers/cce96b87-3345-4234-8656-c01d0ac5e46c => generated 1328 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:47:36.290350 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-b4a176c4-62a7-46b1-82bf-6c064e03912d tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:47:36.291069 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-b4a176c4-62a7-46b1-82bf-6c064e03912d tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] [instance: cce96b87-3345-4234-8656-c01d0ac5e46c] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:47:36.300897 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b4a176c4-62a7-46b1-82bf-6c064e03912d tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:47:36.301406 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b4a176c4-62a7-46b1-82bf-6c064e03912d tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:47:36.301866 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b4a176c4-62a7-46b1-82bf-6c064e03912d tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:47:36.302645 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b4a176c4-62a7-46b1-82bf-6c064e03912d tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:47:36.303115 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b4a176c4-62a7-46b1-82bf-6c064e03912d tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:47:36.303564 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b4a176c4-62a7-46b1-82bf-6c064e03912d tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:47:36.380610 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-b4a176c4-62a7-46b1-82bf-6c064e03912d tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/cce96b87-3345-4234-8656-c01d0ac5e46c" status: 200 len: 1415 microversion: 2.1 time: 0.094836 Oct 04 22:47:36.391855 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3913/7003] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:47:36 2022] GET /compute/v2.1/servers/cce96b87-3345-4234-8656-c01d0ac5e46c => generated 1415 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:47:37.405034 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-84c98eb4-2e8f-4f79-8a5a-b08918bf4c3a tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:47:37.405819 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-84c98eb4-2e8f-4f79-8a5a-b08918bf4c3a tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] [instance: cce96b87-3345-4234-8656-c01d0ac5e46c] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:47:37.416506 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-84c98eb4-2e8f-4f79-8a5a-b08918bf4c3a tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:47:37.417093 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-84c98eb4-2e8f-4f79-8a5a-b08918bf4c3a tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:47:37.417636 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-84c98eb4-2e8f-4f79-8a5a-b08918bf4c3a tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:47:37.418473 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-84c98eb4-2e8f-4f79-8a5a-b08918bf4c3a tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:47:37.419001 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-84c98eb4-2e8f-4f79-8a5a-b08918bf4c3a tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:47:37.419513 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-84c98eb4-2e8f-4f79-8a5a-b08918bf4c3a tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:47:37.666315 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-84c98eb4-2e8f-4f79-8a5a-b08918bf4c3a tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/cce96b87-3345-4234-8656-c01d0ac5e46c" status: 200 len: 1463 microversion: 2.1 time: 0.265214 Oct 04 22:47:37.667408 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3091/7004] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:47:37 2022] GET /compute/v2.1/servers/cce96b87-3345-4234-8656-c01d0ac5e46c => generated 1463 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:47:37.802570 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-0ea30329-a4fb-42e7-b4e7-6ff0dd27f118 req-11fabb6b-9e34-47fd-b3d9-aa9ec9614922 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cce96b87-3345-4234-8656-c01d0ac5e46c", "tag": "c6073e3a-2632-404d-9593-508a0665bcae"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:47:37.816505 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-0ea30329-a4fb-42e7-b4e7-6ff0dd27f118 req-11fabb6b-9e34-47fd-b3d9-aa9ec9614922 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:47:37.817015 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-0ea30329-a4fb-42e7-b4e7-6ff0dd27f118 req-11fabb6b-9e34-47fd-b3d9-aa9ec9614922 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:47:37.817638 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-0ea30329-a4fb-42e7-b4e7-6ff0dd27f118 req-11fabb6b-9e34-47fd-b3d9-aa9ec9614922 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:47:37.831934 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-0ea30329-a4fb-42e7-b4e7-6ff0dd27f118 req-11fabb6b-9e34-47fd-b3d9-aa9ec9614922 service nova] Creating event network-changed:c6073e3a-2632-404d-9593-508a0665bcae for instance cce96b87-3345-4234-8656-c01d0ac5e46c on n-h2-860284-1 Oct 04 22:47:37.838338 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-0ea30329-a4fb-42e7-b4e7-6ff0dd27f118 req-11fabb6b-9e34-47fd-b3d9-aa9ec9614922 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041455 Oct 04 22:47:37.839029 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3914/7005] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:47:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:47:38.689626 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-87c4f9cf-1933-4e2e-8806-02f508aa6ec2 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:47:38.691066 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-87c4f9cf-1933-4e2e-8806-02f508aa6ec2 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] [instance: cce96b87-3345-4234-8656-c01d0ac5e46c] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:47:38.698632 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-87c4f9cf-1933-4e2e-8806-02f508aa6ec2 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:47:38.699215 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-87c4f9cf-1933-4e2e-8806-02f508aa6ec2 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:47:38.699725 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-87c4f9cf-1933-4e2e-8806-02f508aa6ec2 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:47:38.700466 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-87c4f9cf-1933-4e2e-8806-02f508aa6ec2 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:47:38.701094 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-87c4f9cf-1933-4e2e-8806-02f508aa6ec2 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:47:38.701827 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-87c4f9cf-1933-4e2e-8806-02f508aa6ec2 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:47:38.835497 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-87c4f9cf-1933-4e2e-8806-02f508aa6ec2 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/cce96b87-3345-4234-8656-c01d0ac5e46c" status: 200 len: 1463 microversion: 2.1 time: 0.149006 Oct 04 22:47:38.836247 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3092/7006] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:47:38 2022] GET /compute/v2.1/servers/cce96b87-3345-4234-8656-c01d0ac5e46c => generated 1463 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:47:39.858434 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-11abca52-bfbf-468a-aeef-6a8907c37914 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:47:39.859190 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-11abca52-bfbf-468a-aeef-6a8907c37914 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] [instance: cce96b87-3345-4234-8656-c01d0ac5e46c] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:47:39.865442 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-11abca52-bfbf-468a-aeef-6a8907c37914 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:47:39.866231 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-11abca52-bfbf-468a-aeef-6a8907c37914 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:47:39.866814 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-11abca52-bfbf-468a-aeef-6a8907c37914 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:47:39.867567 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-11abca52-bfbf-468a-aeef-6a8907c37914 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:47:39.868050 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-11abca52-bfbf-468a-aeef-6a8907c37914 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:47:39.868500 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-11abca52-bfbf-468a-aeef-6a8907c37914 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:47:40.000335 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-11abca52-bfbf-468a-aeef-6a8907c37914 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/cce96b87-3345-4234-8656-c01d0ac5e46c" status: 200 len: 1463 microversion: 2.1 time: 0.146774 Oct 04 22:47:40.001790 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3915/7007] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:47:39 2022] GET /compute/v2.1/servers/cce96b87-3345-4234-8656-c01d0ac5e46c => generated 1463 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:47:41.025397 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-40784ede-f20f-44a8-b807-bc25c8434cfa tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:47:41.026024 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-40784ede-f20f-44a8-b807-bc25c8434cfa tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] [instance: cce96b87-3345-4234-8656-c01d0ac5e46c] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:47:41.032844 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-40784ede-f20f-44a8-b807-bc25c8434cfa tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:47:41.033333 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-40784ede-f20f-44a8-b807-bc25c8434cfa tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:47:41.033776 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-40784ede-f20f-44a8-b807-bc25c8434cfa tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:47:41.034503 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-40784ede-f20f-44a8-b807-bc25c8434cfa tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:47:41.034972 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-40784ede-f20f-44a8-b807-bc25c8434cfa tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:47:41.035406 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-40784ede-f20f-44a8-b807-bc25c8434cfa tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:47:41.170432 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-40784ede-f20f-44a8-b807-bc25c8434cfa tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/cce96b87-3345-4234-8656-c01d0ac5e46c" status: 200 len: 1463 microversion: 2.1 time: 0.149291 Oct 04 22:47:41.171012 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3093/7008] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:47:41 2022] GET /compute/v2.1/servers/cce96b87-3345-4234-8656-c01d0ac5e46c => generated 1463 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:47:42.193057 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-59857320-dd8e-49e8-9d93-869ec080ae94 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:47:42.193763 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-59857320-dd8e-49e8-9d93-869ec080ae94 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] [instance: cce96b87-3345-4234-8656-c01d0ac5e46c] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:47:42.200752 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-59857320-dd8e-49e8-9d93-869ec080ae94 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:47:42.201268 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-59857320-dd8e-49e8-9d93-869ec080ae94 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:47:42.201729 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-59857320-dd8e-49e8-9d93-869ec080ae94 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:47:42.202490 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-59857320-dd8e-49e8-9d93-869ec080ae94 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:47:42.202976 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-59857320-dd8e-49e8-9d93-869ec080ae94 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:47:42.203427 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-59857320-dd8e-49e8-9d93-869ec080ae94 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:47:42.334346 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-59857320-dd8e-49e8-9d93-869ec080ae94 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/cce96b87-3345-4234-8656-c01d0ac5e46c" status: 200 len: 1463 microversion: 2.1 time: 0.144993 Oct 04 22:47:42.335753 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3916/7009] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:47:42 2022] GET /compute/v2.1/servers/cce96b87-3345-4234-8656-c01d0ac5e46c => generated 1463 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:47:43.357422 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-34d9d5bc-92e7-49f5-93f2-699517355b77 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:47:43.358040 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-34d9d5bc-92e7-49f5-93f2-699517355b77 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] [instance: cce96b87-3345-4234-8656-c01d0ac5e46c] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:47:43.364915 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-34d9d5bc-92e7-49f5-93f2-699517355b77 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:47:43.365404 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-34d9d5bc-92e7-49f5-93f2-699517355b77 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:47:43.365851 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-34d9d5bc-92e7-49f5-93f2-699517355b77 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:47:43.366625 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-34d9d5bc-92e7-49f5-93f2-699517355b77 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:47:43.367117 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-34d9d5bc-92e7-49f5-93f2-699517355b77 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:47:43.367552 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-34d9d5bc-92e7-49f5-93f2-699517355b77 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:47:43.495737 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-34d9d5bc-92e7-49f5-93f2-699517355b77 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/cce96b87-3345-4234-8656-c01d0ac5e46c" status: 200 len: 1463 microversion: 2.1 time: 0.141976 Oct 04 22:47:43.496347 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3094/7010] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:47:43 2022] GET /compute/v2.1/servers/cce96b87-3345-4234-8656-c01d0ac5e46c => generated 1463 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:47:43.564334 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-97e3afaf-fe62-42b8-8452-be41b9c4c5a4 req-4b7492e3-5005-4c5c-9837-89fc30ff7371 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cce96b87-3345-4234-8656-c01d0ac5e46c", "name": "network-vif-plugged", "status": "completed", "tag": "c6073e3a-2632-404d-9593-508a0665bcae"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:47:43.578169 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-97e3afaf-fe62-42b8-8452-be41b9c4c5a4 req-4b7492e3-5005-4c5c-9837-89fc30ff7371 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:47:43.578715 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-97e3afaf-fe62-42b8-8452-be41b9c4c5a4 req-4b7492e3-5005-4c5c-9837-89fc30ff7371 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:47:43.579173 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-97e3afaf-fe62-42b8-8452-be41b9c4c5a4 req-4b7492e3-5005-4c5c-9837-89fc30ff7371 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:47:43.591595 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-97e3afaf-fe62-42b8-8452-be41b9c4c5a4 req-4b7492e3-5005-4c5c-9837-89fc30ff7371 service nova] Creating event network-vif-plugged:c6073e3a-2632-404d-9593-508a0665bcae for instance cce96b87-3345-4234-8656-c01d0ac5e46c on n-h2-860284-1 Oct 04 22:47:43.596700 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-97e3afaf-fe62-42b8-8452-be41b9c4c5a4 req-4b7492e3-5005-4c5c-9837-89fc30ff7371 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036151 Oct 04 22:47:43.597308 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3917/7011] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:47:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:47:44.518883 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-4f3fc197-6ed3-4396-862b-1f75f46f6cbd tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:47:44.519696 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-4f3fc197-6ed3-4396-862b-1f75f46f6cbd tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] [instance: cce96b87-3345-4234-8656-c01d0ac5e46c] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:47:44.522658 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell0:SELECT=2 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:47:44.528496 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4f3fc197-6ed3-4396-862b-1f75f46f6cbd tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:47:44.528984 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4f3fc197-6ed3-4396-862b-1f75f46f6cbd tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:47:44.529424 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4f3fc197-6ed3-4396-862b-1f75f46f6cbd tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:47:44.530121 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4f3fc197-6ed3-4396-862b-1f75f46f6cbd tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:47:44.530605 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4f3fc197-6ed3-4396-862b-1f75f46f6cbd tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:47:44.531033 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4f3fc197-6ed3-4396-862b-1f75f46f6cbd tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:47:44.657039 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-4f3fc197-6ed3-4396-862b-1f75f46f6cbd tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/cce96b87-3345-4234-8656-c01d0ac5e46c" status: 200 len: 1463 microversion: 2.1 time: 0.141895 Oct 04 22:47:44.657622 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3095/7012] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:47:44 2022] GET /compute/v2.1/servers/cce96b87-3345-4234-8656-c01d0ac5e46c => generated 1463 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:47:45.678722 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=2 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:47:45.679428 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=6 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:47:45.683825 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-1beec19d-b981-4bdc-a218-f7e9b12e2ffa tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:47:45.684664 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-1beec19d-b981-4bdc-a218-f7e9b12e2ffa tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] [instance: cce96b87-3345-4234-8656-c01d0ac5e46c] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:47:45.691752 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1beec19d-b981-4bdc-a218-f7e9b12e2ffa tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:47:45.692251 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1beec19d-b981-4bdc-a218-f7e9b12e2ffa tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:47:45.692704 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1beec19d-b981-4bdc-a218-f7e9b12e2ffa tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:47:45.693410 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1beec19d-b981-4bdc-a218-f7e9b12e2ffa tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:47:45.693884 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1beec19d-b981-4bdc-a218-f7e9b12e2ffa tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:47:45.694850 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1beec19d-b981-4bdc-a218-f7e9b12e2ffa tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:47:45.822392 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-1beec19d-b981-4bdc-a218-f7e9b12e2ffa tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/cce96b87-3345-4234-8656-c01d0ac5e46c" status: 200 len: 1648 microversion: 2.1 time: 0.145828 Oct 04 22:47:45.822967 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3918/7013] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:47:45 2022] GET /compute/v2.1/servers/cce96b87-3345-4234-8656-c01d0ac5e46c => generated 1648 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:47:45.844570 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-a0118f2a-0302-42ed-b11a-ad37063863d3 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:47:45.845192 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-a0118f2a-0302-42ed-b11a-ad37063863d3 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] [instance: cce96b87-3345-4234-8656-c01d0ac5e46c] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:47:45.847166 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell0:SELECT=2 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:47:45.853483 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a0118f2a-0302-42ed-b11a-ad37063863d3 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:47:45.853970 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a0118f2a-0302-42ed-b11a-ad37063863d3 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:47:45.854435 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a0118f2a-0302-42ed-b11a-ad37063863d3 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:47:45.855135 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a0118f2a-0302-42ed-b11a-ad37063863d3 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:47:45.855596 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a0118f2a-0302-42ed-b11a-ad37063863d3 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:47:45.856026 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a0118f2a-0302-42ed-b11a-ad37063863d3 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:47:45.984472 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-a0118f2a-0302-42ed-b11a-ad37063863d3 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/cce96b87-3345-4234-8656-c01d0ac5e46c" status: 200 len: 1648 microversion: 2.1 time: 0.143560 Oct 04 22:47:45.985058 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3096/7014] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:47:45 2022] GET /compute/v2.1/servers/cce96b87-3345-4234-8656-c01d0ac5e46c => generated 1648 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:47:46.007782 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-fa1db40d-6c3b-4f34-903c-44f101713a0c tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:47:46.008420 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-fa1db40d-6c3b-4f34-903c-44f101713a0c tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] [instance: cce96b87-3345-4234-8656-c01d0ac5e46c] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:47:46.014508 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fa1db40d-6c3b-4f34-903c-44f101713a0c tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:47:46.015016 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fa1db40d-6c3b-4f34-903c-44f101713a0c tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:47:46.015478 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fa1db40d-6c3b-4f34-903c-44f101713a0c tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:47:46.016193 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fa1db40d-6c3b-4f34-903c-44f101713a0c tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:47:46.016675 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fa1db40d-6c3b-4f34-903c-44f101713a0c tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:47:46.017129 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fa1db40d-6c3b-4f34-903c-44f101713a0c tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:47:46.147572 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-fa1db40d-6c3b-4f34-903c-44f101713a0c tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/cce96b87-3345-4234-8656-c01d0ac5e46c" status: 200 len: 1648 microversion: 2.1 time: 0.143868 Oct 04 22:47:46.148155 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3919/7015] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:47:46 2022] GET /compute/v2.1/servers/cce96b87-3345-4234-8656-c01d0ac5e46c => generated 1648 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:47:46.210162 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-3197c0b5-5181-4e12-81fb-482cbf0d63fe tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-2002023181", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452", "availability_zone": "nova:n-h1-860284-1", "networks": [{"uuid": "9023a47f-a7e1-4443-8746-6b2407484daa"}]}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:47:46.269949 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.network.neutron [None req-3197c0b5-5181-4e12-81fb-482cbf0d63fe tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] validate_networks() for [('9023a47f-a7e1-4443-8746-6b2407484daa', None, None, None, None, None)] {{(pid=134102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 22:47:46.771216 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-3197c0b5-5181-4e12-81fb-482cbf0d63fe tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Flavor limits 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 22:47:46.771582 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-3197c0b5-5181-4e12-81fb-482cbf0d63fe tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Image limits 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 22:47:46.772574 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-3197c0b5-5181-4e12-81fb-482cbf0d63fe tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Flavor pref 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 22:47:46.772986 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-3197c0b5-5181-4e12-81fb-482cbf0d63fe tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Image pref 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 22:47:46.773541 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-3197c0b5-5181-4e12-81fb-482cbf0d63fe tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 22:47:46.782144 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3197c0b5-5181-4e12-81fb-482cbf0d63fe tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:47:46.782645 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3197c0b5-5181-4e12-81fb-482cbf0d63fe tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:47:46.783076 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3197c0b5-5181-4e12-81fb-482cbf0d63fe tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:47:46.783795 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3197c0b5-5181-4e12-81fb-482cbf0d63fe tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:47:46.784243 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3197c0b5-5181-4e12-81fb-482cbf0d63fe tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:47:46.784661 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3197c0b5-5181-4e12-81fb-482cbf0d63fe tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:47:46.801586 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-3197c0b5-5181-4e12-81fb-482cbf0d63fe tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Getting quotas for project 8b911acbc44f4c419bdf2e7a15128d42. Resources: {'instances', 'ram', 'cores'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:47:46.806988 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-3197c0b5-5181-4e12-81fb-482cbf0d63fe tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Getting quotas for user aa7baa9b51d54220b8fde803d250bd0c and project 8b911acbc44f4c419bdf2e7a15128d42. Resources: {'instances', 'ram', 'cores'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:47:46.818803 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-3197c0b5-5181-4e12-81fb-482cbf0d63fe tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Going to run 1 instances... {{(pid=134102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 22:47:46.821206 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-3197c0b5-5181-4e12-81fb-482cbf0d63fe tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] [instance: f5d49992-b855-460b-8a93-d1e596e444da] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='58548514-5dac-426c-81f5-19e3fba33e23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 22:47:46.868026 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-3197c0b5-5181-4e12-81fb-482cbf0d63fe tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.661594 Oct 04 22:47:46.869000 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3097/7016] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 22:47:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 663 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 22:47:46.880325 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-a2b4bf99-0c50-4503-8367-fff61834e395 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:47:46.880964 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-a2b4bf99-0c50-4503-8367-fff61834e395 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] [instance: f5d49992-b855-460b-8a93-d1e596e444da] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:47:46.944519 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-a2b4bf99-0c50-4503-8367-fff61834e395 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/f5d49992-b855-460b-8a93-d1e596e444da" status: 200 len: 1329 microversion: 2.1 time: 0.068180 Oct 04 22:47:46.945102 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3920/7017] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:47:46 2022] GET /compute/v2.1/servers/f5d49992-b855-460b-8a93-d1e596e444da => generated 1329 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:47:47.966768 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-b86458cf-d8d1-47ac-acf3-ebc749736044 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:47:47.967301 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-b86458cf-d8d1-47ac-acf3-ebc749736044 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] [instance: f5d49992-b855-460b-8a93-d1e596e444da] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:47:47.974549 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b86458cf-d8d1-47ac-acf3-ebc749736044 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:47:47.975048 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b86458cf-d8d1-47ac-acf3-ebc749736044 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:47:47.976023 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b86458cf-d8d1-47ac-acf3-ebc749736044 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:47:47.976862 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b86458cf-d8d1-47ac-acf3-ebc749736044 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:47:47.977334 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b86458cf-d8d1-47ac-acf3-ebc749736044 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:47:47.977770 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b86458cf-d8d1-47ac-acf3-ebc749736044 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:47:48.056638 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-b86458cf-d8d1-47ac-acf3-ebc749736044 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/f5d49992-b855-460b-8a93-d1e596e444da" status: 200 len: 1434 microversion: 2.1 time: 0.093562 Oct 04 22:47:48.057441 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3098/7018] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:47:47 2022] GET /compute/v2.1/servers/f5d49992-b855-460b-8a93-d1e596e444da => generated 1434 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:47:49.080021 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-60ee3ea0-9317-4aa4-855c-b7cd81b2b48a tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:47:49.080994 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-60ee3ea0-9317-4aa4-855c-b7cd81b2b48a tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] [instance: f5d49992-b855-460b-8a93-d1e596e444da] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:47:49.093901 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-60ee3ea0-9317-4aa4-855c-b7cd81b2b48a tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:47:49.094460 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-60ee3ea0-9317-4aa4-855c-b7cd81b2b48a tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:47:49.094997 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-60ee3ea0-9317-4aa4-855c-b7cd81b2b48a tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:47:49.095821 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-60ee3ea0-9317-4aa4-855c-b7cd81b2b48a tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:47:49.096375 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-60ee3ea0-9317-4aa4-855c-b7cd81b2b48a tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:47:49.096903 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-60ee3ea0-9317-4aa4-855c-b7cd81b2b48a tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:47:49.283303 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-60ee3ea0-9317-4aa4-855c-b7cd81b2b48a tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/f5d49992-b855-460b-8a93-d1e596e444da" status: 200 len: 1464 microversion: 2.1 time: 0.206675 Oct 04 22:47:49.283976 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3921/7019] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:47:49 2022] GET /compute/v2.1/servers/f5d49992-b855-460b-8a93-d1e596e444da => generated 1464 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:47:49.372023 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-85ab526e-d4b9-4368-bfbf-16d70ff24905 req-3f07fab9-681f-4aa0-a2ae-ab2d8855d6dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5d49992-b855-460b-8a93-d1e596e444da", "tag": "d44451f4-a7a5-42c1-bfa9-d3afd5a3ac5b"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:47:49.382585 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-85ab526e-d4b9-4368-bfbf-16d70ff24905 req-3f07fab9-681f-4aa0-a2ae-ab2d8855d6dc service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:47:49.383095 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-85ab526e-d4b9-4368-bfbf-16d70ff24905 req-3f07fab9-681f-4aa0-a2ae-ab2d8855d6dc service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:47:49.383519 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-85ab526e-d4b9-4368-bfbf-16d70ff24905 req-3f07fab9-681f-4aa0-a2ae-ab2d8855d6dc service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:47:49.394523 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-85ab526e-d4b9-4368-bfbf-16d70ff24905 req-3f07fab9-681f-4aa0-a2ae-ab2d8855d6dc service nova] Creating event network-changed:d44451f4-a7a5-42c1-bfa9-d3afd5a3ac5b for instance f5d49992-b855-460b-8a93-d1e596e444da on n-h1-860284-1 Oct 04 22:47:49.400486 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-85ab526e-d4b9-4368-bfbf-16d70ff24905 req-3f07fab9-681f-4aa0-a2ae-ab2d8855d6dc service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094522 Oct 04 22:47:49.401610 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3099/7020] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:47:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:47:50.307424 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-0b0e6321-d20f-4338-8b0d-4000a7c9dee6 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:47:50.308070 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-0b0e6321-d20f-4338-8b0d-4000a7c9dee6 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] [instance: f5d49992-b855-460b-8a93-d1e596e444da] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:47:50.314987 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0b0e6321-d20f-4338-8b0d-4000a7c9dee6 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:47:50.315501 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0b0e6321-d20f-4338-8b0d-4000a7c9dee6 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:47:50.315965 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0b0e6321-d20f-4338-8b0d-4000a7c9dee6 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:47:50.316687 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0b0e6321-d20f-4338-8b0d-4000a7c9dee6 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:47:50.317169 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0b0e6321-d20f-4338-8b0d-4000a7c9dee6 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:47:50.317617 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0b0e6321-d20f-4338-8b0d-4000a7c9dee6 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:47:50.451893 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-0b0e6321-d20f-4338-8b0d-4000a7c9dee6 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/f5d49992-b855-460b-8a93-d1e596e444da" status: 200 len: 1464 microversion: 2.1 time: 0.149054 Oct 04 22:47:50.452470 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3922/7021] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:47:50 2022] GET /compute/v2.1/servers/f5d49992-b855-460b-8a93-d1e596e444da => generated 1464 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:47:51.477407 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-027bbf26-5dc8-48c1-817d-d3d19f8bae41 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:47:51.478025 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-027bbf26-5dc8-48c1-817d-d3d19f8bae41 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] [instance: f5d49992-b855-460b-8a93-d1e596e444da] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:47:51.484524 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-027bbf26-5dc8-48c1-817d-d3d19f8bae41 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:47:51.485012 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-027bbf26-5dc8-48c1-817d-d3d19f8bae41 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:47:51.485450 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-027bbf26-5dc8-48c1-817d-d3d19f8bae41 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:47:51.486142 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-027bbf26-5dc8-48c1-817d-d3d19f8bae41 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:47:51.486660 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-027bbf26-5dc8-48c1-817d-d3d19f8bae41 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:47:51.487088 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-027bbf26-5dc8-48c1-817d-d3d19f8bae41 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:47:51.611528 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-027bbf26-5dc8-48c1-817d-d3d19f8bae41 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/f5d49992-b855-460b-8a93-d1e596e444da" status: 200 len: 1464 microversion: 2.1 time: 0.139874 Oct 04 22:47:51.612115 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3100/7022] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:47:51 2022] GET /compute/v2.1/servers/f5d49992-b855-460b-8a93-d1e596e444da => generated 1464 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:47:52.636356 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-625edfc9-87ed-4324-afcd-2ba27bc187aa tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:47:52.637315 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-625edfc9-87ed-4324-afcd-2ba27bc187aa tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] [instance: f5d49992-b855-460b-8a93-d1e596e444da] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:47:52.646042 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-625edfc9-87ed-4324-afcd-2ba27bc187aa tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:47:52.646591 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-625edfc9-87ed-4324-afcd-2ba27bc187aa tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:47:52.647766 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-625edfc9-87ed-4324-afcd-2ba27bc187aa tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:47:52.648578 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-625edfc9-87ed-4324-afcd-2ba27bc187aa tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:47:52.649052 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-625edfc9-87ed-4324-afcd-2ba27bc187aa tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:47:52.649529 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-625edfc9-87ed-4324-afcd-2ba27bc187aa tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:47:52.775908 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-625edfc9-87ed-4324-afcd-2ba27bc187aa tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/f5d49992-b855-460b-8a93-d1e596e444da" status: 200 len: 1464 microversion: 2.1 time: 0.144432 Oct 04 22:47:52.776486 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3923/7023] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:47:52 2022] GET /compute/v2.1/servers/f5d49992-b855-460b-8a93-d1e596e444da => generated 1464 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:47:53.798458 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-7288995d-51e8-4433-9a1c-ae10c540a5f3 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:47:53.799080 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-7288995d-51e8-4433-9a1c-ae10c540a5f3 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] [instance: f5d49992-b855-460b-8a93-d1e596e444da] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:47:53.806790 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7288995d-51e8-4433-9a1c-ae10c540a5f3 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:47:53.807616 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7288995d-51e8-4433-9a1c-ae10c540a5f3 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:47:53.807723 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7288995d-51e8-4433-9a1c-ae10c540a5f3 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:47:53.808391 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7288995d-51e8-4433-9a1c-ae10c540a5f3 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:47:53.808845 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7288995d-51e8-4433-9a1c-ae10c540a5f3 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:47:53.809272 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7288995d-51e8-4433-9a1c-ae10c540a5f3 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:47:53.944058 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-7288995d-51e8-4433-9a1c-ae10c540a5f3 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/f5d49992-b855-460b-8a93-d1e596e444da" status: 200 len: 1464 microversion: 2.1 time: 0.149224 Oct 04 22:47:53.944676 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3101/7024] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:47:53 2022] GET /compute/v2.1/servers/f5d49992-b855-460b-8a93-d1e596e444da => generated 1464 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:47:54.965611 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-33014ebf-a9d0-4986-8665-8a5f99a0685b tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:47:54.966274 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-33014ebf-a9d0-4986-8665-8a5f99a0685b tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] [instance: f5d49992-b855-460b-8a93-d1e596e444da] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:47:54.973433 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-33014ebf-a9d0-4986-8665-8a5f99a0685b tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:47:54.973971 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-33014ebf-a9d0-4986-8665-8a5f99a0685b tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:47:54.974449 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-33014ebf-a9d0-4986-8665-8a5f99a0685b tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:47:54.975333 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-33014ebf-a9d0-4986-8665-8a5f99a0685b tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:47:54.975888 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-33014ebf-a9d0-4986-8665-8a5f99a0685b tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:47:54.976335 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-33014ebf-a9d0-4986-8665-8a5f99a0685b tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:47:55.105362 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-33014ebf-a9d0-4986-8665-8a5f99a0685b tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/f5d49992-b855-460b-8a93-d1e596e444da" status: 200 len: 1464 microversion: 2.1 time: 0.143485 Oct 04 22:47:55.105940 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3924/7025] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:47:54 2022] GET /compute/v2.1/servers/f5d49992-b855-460b-8a93-d1e596e444da => generated 1464 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:47:56.040354 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-6f69c83b-64a1-416f-8c81-42fbb86bfa95 req-7b1a42ae-5d05-4023-9818-90a1ee6f95d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5d49992-b855-460b-8a93-d1e596e444da", "name": "network-vif-plugged", "status": "completed", "tag": "d44451f4-a7a5-42c1-bfa9-d3afd5a3ac5b"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:47:56.051317 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-6f69c83b-64a1-416f-8c81-42fbb86bfa95 req-7b1a42ae-5d05-4023-9818-90a1ee6f95d5 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:47:56.051797 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-6f69c83b-64a1-416f-8c81-42fbb86bfa95 req-7b1a42ae-5d05-4023-9818-90a1ee6f95d5 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:47:56.052229 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-6f69c83b-64a1-416f-8c81-42fbb86bfa95 req-7b1a42ae-5d05-4023-9818-90a1ee6f95d5 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:47:56.062812 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-6f69c83b-64a1-416f-8c81-42fbb86bfa95 req-7b1a42ae-5d05-4023-9818-90a1ee6f95d5 service nova] Creating event network-vif-plugged:d44451f4-a7a5-42c1-bfa9-d3afd5a3ac5b for instance f5d49992-b855-460b-8a93-d1e596e444da on n-h1-860284-1 Oct 04 22:47:56.067941 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-6f69c83b-64a1-416f-8c81-42fbb86bfa95 req-7b1a42ae-5d05-4023-9818-90a1ee6f95d5 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087682 Oct 04 22:47:56.068570 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3102/7026] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:47:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:47:56.128317 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-d1b8c3d7-3702-4c1c-8ebb-228b65d43f30 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:47:56.128929 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-d1b8c3d7-3702-4c1c-8ebb-228b65d43f30 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] [instance: f5d49992-b855-460b-8a93-d1e596e444da] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:47:56.136727 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d1b8c3d7-3702-4c1c-8ebb-228b65d43f30 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:47:56.137245 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d1b8c3d7-3702-4c1c-8ebb-228b65d43f30 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:47:56.137703 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d1b8c3d7-3702-4c1c-8ebb-228b65d43f30 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:47:56.138463 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d1b8c3d7-3702-4c1c-8ebb-228b65d43f30 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:47:56.138981 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d1b8c3d7-3702-4c1c-8ebb-228b65d43f30 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:47:56.139436 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d1b8c3d7-3702-4c1c-8ebb-228b65d43f30 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:47:56.295458 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-d1b8c3d7-3702-4c1c-8ebb-228b65d43f30 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/f5d49992-b855-460b-8a93-d1e596e444da" status: 200 len: 1464 microversion: 2.1 time: 0.171282 Oct 04 22:47:56.296048 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3925/7027] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:47:56 2022] GET /compute/v2.1/servers/f5d49992-b855-460b-8a93-d1e596e444da => generated 1464 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:47:57.315631 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell0:SELECT=2 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:47:57.316438 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell0:SELECT=6 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:47:57.321920 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-1edfafee-d555-4089-bfbd-3312ffad70b1 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:47:57.322674 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-1edfafee-d555-4089-bfbd-3312ffad70b1 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] [instance: f5d49992-b855-460b-8a93-d1e596e444da] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:47:57.329768 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1edfafee-d555-4089-bfbd-3312ffad70b1 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:47:57.330266 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1edfafee-d555-4089-bfbd-3312ffad70b1 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:47:57.330848 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1edfafee-d555-4089-bfbd-3312ffad70b1 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:47:57.331421 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1edfafee-d555-4089-bfbd-3312ffad70b1 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:47:57.331913 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1edfafee-d555-4089-bfbd-3312ffad70b1 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:47:57.332346 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1edfafee-d555-4089-bfbd-3312ffad70b1 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:47:57.464896 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-1edfafee-d555-4089-bfbd-3312ffad70b1 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/f5d49992-b855-460b-8a93-d1e596e444da" status: 200 len: 1464 microversion: 2.1 time: 0.150149 Oct 04 22:47:57.465482 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3103/7028] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:47:57 2022] GET /compute/v2.1/servers/f5d49992-b855-460b-8a93-d1e596e444da => generated 1464 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:47:58.488233 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-a2d14ddc-d03d-42c3-b99f-f0aea1ba2c31 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:47:58.488783 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-a2d14ddc-d03d-42c3-b99f-f0aea1ba2c31 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] [instance: f5d49992-b855-460b-8a93-d1e596e444da] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:47:58.490708 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=2 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:47:58.497306 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a2d14ddc-d03d-42c3-b99f-f0aea1ba2c31 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:47:58.497811 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a2d14ddc-d03d-42c3-b99f-f0aea1ba2c31 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:47:58.498273 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a2d14ddc-d03d-42c3-b99f-f0aea1ba2c31 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:47:58.499138 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a2d14ddc-d03d-42c3-b99f-f0aea1ba2c31 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:47:58.499483 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a2d14ddc-d03d-42c3-b99f-f0aea1ba2c31 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:47:58.499921 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a2d14ddc-d03d-42c3-b99f-f0aea1ba2c31 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:47:58.627758 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-a2d14ddc-d03d-42c3-b99f-f0aea1ba2c31 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/f5d49992-b855-460b-8a93-d1e596e444da" status: 200 len: 1650 microversion: 2.1 time: 0.143348 Oct 04 22:47:58.628332 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3926/7029] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:47:58 2022] GET /compute/v2.1/servers/f5d49992-b855-460b-8a93-d1e596e444da => generated 1650 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:47:58.649854 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-93c553f0-afd0-4367-ae84-6edfca80d903 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:47:58.650504 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-93c553f0-afd0-4367-ae84-6edfca80d903 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] [instance: f5d49992-b855-460b-8a93-d1e596e444da] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:47:58.657340 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-93c553f0-afd0-4367-ae84-6edfca80d903 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:47:58.657854 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-93c553f0-afd0-4367-ae84-6edfca80d903 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:47:58.658293 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-93c553f0-afd0-4367-ae84-6edfca80d903 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:47:58.659010 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-93c553f0-afd0-4367-ae84-6edfca80d903 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:47:58.659468 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-93c553f0-afd0-4367-ae84-6edfca80d903 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:47:58.659894 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-93c553f0-afd0-4367-ae84-6edfca80d903 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:47:58.789717 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-93c553f0-afd0-4367-ae84-6edfca80d903 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/f5d49992-b855-460b-8a93-d1e596e444da" status: 200 len: 1650 microversion: 2.1 time: 0.143865 Oct 04 22:47:58.790306 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3104/7030] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:47:58 2022] GET /compute/v2.1/servers/f5d49992-b855-460b-8a93-d1e596e444da => generated 1650 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:47:58.811202 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-f06f71fc-c53d-49cd-8e38-7eb11e5e14ca tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:47:58.811838 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-f06f71fc-c53d-49cd-8e38-7eb11e5e14ca tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] [instance: f5d49992-b855-460b-8a93-d1e596e444da] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:47:58.817741 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f06f71fc-c53d-49cd-8e38-7eb11e5e14ca tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:47:58.818245 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f06f71fc-c53d-49cd-8e38-7eb11e5e14ca tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:47:58.818803 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f06f71fc-c53d-49cd-8e38-7eb11e5e14ca tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:47:58.819516 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f06f71fc-c53d-49cd-8e38-7eb11e5e14ca tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:47:58.819984 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f06f71fc-c53d-49cd-8e38-7eb11e5e14ca tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:47:58.820431 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f06f71fc-c53d-49cd-8e38-7eb11e5e14ca tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:47:58.954212 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-f06f71fc-c53d-49cd-8e38-7eb11e5e14ca tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/f5d49992-b855-460b-8a93-d1e596e444da" status: 200 len: 1650 microversion: 2.1 time: 0.146716 Oct 04 22:47:58.954823 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3927/7031] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:47:58 2022] GET /compute/v2.1/servers/f5d49992-b855-460b-8a93-d1e596e444da => generated 1650 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:47:58.977573 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-ce49ed6e-5159-42d9-bfb4-0379cc5f12b2 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:47:58.978076 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-ce49ed6e-5159-42d9-bfb4-0379cc5f12b2 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] [instance: f5d49992-b855-460b-8a93-d1e596e444da] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:47:58.983984 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ce49ed6e-5159-42d9-bfb4-0379cc5f12b2 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:47:58.984465 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ce49ed6e-5159-42d9-bfb4-0379cc5f12b2 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:47:58.984900 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ce49ed6e-5159-42d9-bfb4-0379cc5f12b2 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:47:58.985591 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ce49ed6e-5159-42d9-bfb4-0379cc5f12b2 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:47:58.986043 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ce49ed6e-5159-42d9-bfb4-0379cc5f12b2 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:47:58.986505 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ce49ed6e-5159-42d9-bfb4-0379cc5f12b2 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:47:59.010761 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-ce49ed6e-5159-42d9-bfb4-0379cc5f12b2 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] [instance: f5d49992-b855-460b-8a93-d1e596e444da] Going to try to terminate instance {{(pid=134102) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 22:47:59.086738 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-ce49ed6e-5159-42d9-bfb4-0379cc5f12b2 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] 10.222.0.43 "DELETE /compute/v2.1/servers/f5d49992-b855-460b-8a93-d1e596e444da" status: 204 len: 0 microversion: 2.1 time: 0.113104 Oct 04 22:47:59.087743 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3105/7032] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 22:47:58 2022] DELETE /compute/v2.1/servers/f5d49992-b855-460b-8a93-d1e596e444da => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 22:47:59.096138 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-b9b15d4c-0f53-48b3-9d20-8ea70ce499df tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:47:59.096772 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-b9b15d4c-0f53-48b3-9d20-8ea70ce499df tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] [instance: f5d49992-b855-460b-8a93-d1e596e444da] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:47:59.102919 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b9b15d4c-0f53-48b3-9d20-8ea70ce499df tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:47:59.103418 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b9b15d4c-0f53-48b3-9d20-8ea70ce499df tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:47:59.103872 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b9b15d4c-0f53-48b3-9d20-8ea70ce499df tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:47:59.104578 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b9b15d4c-0f53-48b3-9d20-8ea70ce499df tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:47:59.105056 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b9b15d4c-0f53-48b3-9d20-8ea70ce499df tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:47:59.105503 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b9b15d4c-0f53-48b3-9d20-8ea70ce499df tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:47:59.230760 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-b9b15d4c-0f53-48b3-9d20-8ea70ce499df tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/f5d49992-b855-460b-8a93-d1e596e444da" status: 200 len: 1656 microversion: 2.1 time: 0.138299 Oct 04 22:47:59.231344 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3928/7033] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:47:59 2022] GET /compute/v2.1/servers/f5d49992-b855-460b-8a93-d1e596e444da => generated 1656 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:48:00.254280 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-84678eb4-69eb-4ead-b8df-65afaabb5045 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:48:00.255031 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-84678eb4-69eb-4ead-b8df-65afaabb5045 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] [instance: f5d49992-b855-460b-8a93-d1e596e444da] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:48:00.262026 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-84678eb4-69eb-4ead-b8df-65afaabb5045 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:48:00.262557 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-84678eb4-69eb-4ead-b8df-65afaabb5045 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:48:00.263002 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-84678eb4-69eb-4ead-b8df-65afaabb5045 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:48:00.263729 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-84678eb4-69eb-4ead-b8df-65afaabb5045 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:48:00.264190 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-84678eb4-69eb-4ead-b8df-65afaabb5045 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:48:00.264619 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-84678eb4-69eb-4ead-b8df-65afaabb5045 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:48:00.391052 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-84678eb4-69eb-4ead-b8df-65afaabb5045 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/f5d49992-b855-460b-8a93-d1e596e444da" status: 200 len: 1656 microversion: 2.1 time: 0.141049 Oct 04 22:48:00.391573 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3106/7034] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:48:00 2022] GET /compute/v2.1/servers/f5d49992-b855-460b-8a93-d1e596e444da => generated 1656 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:48:01.107877 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-d7464e8b-c58f-49fb-9725-0ac54f064df7 req-bc5b41bd-6b6c-4113-a4ce-edfe893e347e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5d49992-b855-460b-8a93-d1e596e444da", "name": "network-vif-deleted", "tag": "d44451f4-a7a5-42c1-bfa9-d3afd5a3ac5b"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:48:01.119553 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-d7464e8b-c58f-49fb-9725-0ac54f064df7 req-bc5b41bd-6b6c-4113-a4ce-edfe893e347e service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:48:01.120051 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-d7464e8b-c58f-49fb-9725-0ac54f064df7 req-bc5b41bd-6b6c-4113-a4ce-edfe893e347e service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:48:01.120506 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-d7464e8b-c58f-49fb-9725-0ac54f064df7 req-bc5b41bd-6b6c-4113-a4ce-edfe893e347e service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:48:01.147133 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-d7464e8b-c58f-49fb-9725-0ac54f064df7 req-bc5b41bd-6b6c-4113-a4ce-edfe893e347e service nova] Creating event network-vif-deleted:d44451f4-a7a5-42c1-bfa9-d3afd5a3ac5b for instance f5d49992-b855-460b-8a93-d1e596e444da on n-h1-860284-1 Oct 04 22:48:01.153008 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-d7464e8b-c58f-49fb-9725-0ac54f064df7 req-bc5b41bd-6b6c-4113-a4ce-edfe893e347e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048605 Oct 04 22:48:01.153436 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3929/7035] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:48:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:48:01.414515 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-f328721d-dd68-4bfc-b45e-71ee480b6df9 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:48:01.415047 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-f328721d-dd68-4bfc-b45e-71ee480b6df9 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] [instance: f5d49992-b855-460b-8a93-d1e596e444da] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:48:01.421921 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f328721d-dd68-4bfc-b45e-71ee480b6df9 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:48:01.422436 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f328721d-dd68-4bfc-b45e-71ee480b6df9 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:48:01.422881 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f328721d-dd68-4bfc-b45e-71ee480b6df9 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:48:01.423574 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f328721d-dd68-4bfc-b45e-71ee480b6df9 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:48:01.424034 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f328721d-dd68-4bfc-b45e-71ee480b6df9 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:48:01.424463 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f328721d-dd68-4bfc-b45e-71ee480b6df9 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:48:01.445532 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:48:01.460948 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f328721d-dd68-4bfc-b45e-71ee480b6df9 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:48:01.461435 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f328721d-dd68-4bfc-b45e-71ee480b6df9 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:48:01.461874 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f328721d-dd68-4bfc-b45e-71ee480b6df9 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:48:01.462321 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.objects.instance [None req-f328721d-dd68-4bfc-b45e-71ee480b6df9 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Lazy-loading 'fault' on Instance uuid f5d49992-b855-460b-8a93-d1e596e444da {{(pid=134102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 22:48:01.510135 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-f328721d-dd68-4bfc-b45e-71ee480b6df9 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/f5d49992-b855-460b-8a93-d1e596e444da" status: 200 len: 1454 microversion: 2.1 time: 0.099454 Oct 04 22:48:01.511242 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3107/7036] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:48:01 2022] GET /compute/v2.1/servers/f5d49992-b855-460b-8a93-d1e596e444da => generated 1454 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:48:02.533845 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e327e0fe-ba4d-414d-8c27-08d9d2cc343d tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:48:02.534606 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-e327e0fe-ba4d-414d-8c27-08d9d2cc343d tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] [instance: f5d49992-b855-460b-8a93-d1e596e444da] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:48:02.542835 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e327e0fe-ba4d-414d-8c27-08d9d2cc343d tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:48:02.543353 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e327e0fe-ba4d-414d-8c27-08d9d2cc343d tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:48:02.543820 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e327e0fe-ba4d-414d-8c27-08d9d2cc343d tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:48:02.545084 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e327e0fe-ba4d-414d-8c27-08d9d2cc343d tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:48:02.545084 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e327e0fe-ba4d-414d-8c27-08d9d2cc343d tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:48:02.545464 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e327e0fe-ba4d-414d-8c27-08d9d2cc343d tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:48:02.560185 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-e327e0fe-ba4d-414d-8c27-08d9d2cc343d tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] HTTP exception thrown: Instance f5d49992-b855-460b-8a93-d1e596e444da could not be found. Oct 04 22:48:02.561885 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e327e0fe-ba4d-414d-8c27-08d9d2cc343d tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Request method failure captured: Oct 04 22:48:02.561885 n-d-860284-1 devstack@n-api.service[134101]: request: GET /compute/v2.1/servers/f5d49992-b855-460b-8a93-d1e596e444da HTTP/1.1 Oct 04 22:48:02.561885 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 22:48:02.561885 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 22:48:02.561885 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 22:48:02.561885 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 22:48:02.561885 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 22:48:02.561885 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 22:48:02.561885 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 22:48:02.561885 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 22:48:02.561885 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPLgG2i8w6mEXsAVv84zr_5lHg_N5eY5kvBOp50bhOFxqAWRqOTDSVxQx7pJ7BnhxV3vuWBaHei7cPzuGy1rlKfuo9-FGxFAK2iy-9S0rTaiy02PnLwr2m9CobivgptuV2lUnoiXb87n28OfvCSNLBWOoHtlIHU1rBHlSD6fpPk3UpbI Oct 04 22:48:02.561885 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 22:48:02.561885 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 22:48:02.561885 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 22:48:02.561885 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 22:48:02.561885 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 22:48:02.561885 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 22:48:02.561885 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: 8b911acbc44f4c419bdf2e7a15128d42 Oct 04 22:48:02.561885 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-TestServerMultinode-1428333635 Oct 04 22:48:02.561885 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,admin,member Oct 04 22:48:02.561885 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,admin,member Oct 04 22:48:02.561885 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8b911acbc44f4c419bdf2e7a15128d42"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_8b911acbc44f4c419bdf2e7a15128d42", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8b911acbc44f4c419bdf2e7a15128d42"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/8b911acbc44f4c419bdf2e7a15128d42"}]}] Oct 04 22:48:02.561885 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-TestServerMultinode-1428333635 Oct 04 22:48:02.561885 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: 8b911acbc44f4c419bdf2e7a15128d42 Oct 04 22:48:02.561885 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-TestServerMultinode-1428333635 Oct 04 22:48:02.561885 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-TestServerMultinode-1428333635-project-admin Oct 04 22:48:02.561885 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 22:48:02.561885 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 22:48:02.561885 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: aa7baa9b51d54220b8fde803d250bd0c Oct 04 22:48:02.561885 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-TestServerMultinode-1428333635-project-admin Oct 04 22:48:02.561885 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 22:48:02.561885 n-d-860284-1 devstack@n-api.service[134101]: exception: Instance f5d49992-b855-460b-8a93-d1e596e444da could not be found. Oct 04 22:48:02.561885 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': 'f5d49992-b855-460b-8a93-d1e596e444da'} Oct 04 22:48:02.561885 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:48:02.561885 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:48:02.561885 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:48:02.561885 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:48:02.561885 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:48:02.561885 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:48:02.561885 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:48:02.561885 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:48:02.561885 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:48:02.561885 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:48:02.561885 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5d49992-b855-460b-8a93-d1e596e444da could not be found. Oct 04 22:48:02.561885 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:48:02.561885 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:48:02.561885 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:48:02.561885 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:48:02.561885 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:48:02.561885 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:48:02.561885 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:48:02.561885 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:48:02.561885 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:48:02.561885 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:48:02.561885 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:48:02.561885 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:48:02.561885 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:48:02.561885 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:48:02.561885 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:48:02.561885 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:48:02.561885 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5d49992-b855-460b-8a93-d1e596e444da could not be found. Oct 04 22:48:02.561885 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:48:02.561885 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:48:02.561885 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:48:02.566072 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:48:02.566072 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:48:02.566072 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:48:02.566072 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:48:02.566072 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:48:02.566072 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5d49992-b855-460b-8a93-d1e596e444da could not be found. Oct 04 22:48:02.566072 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:48:02.566072 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e327e0fe-ba4d-414d-8c27-08d9d2cc343d tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Returning 404 to user: Instance f5d49992-b855-460b-8a93-d1e596e444da could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:48:02.566072 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-e327e0fe-ba4d-414d-8c27-08d9d2cc343d tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/f5d49992-b855-460b-8a93-d1e596e444da" status: 404 len: 111 microversion: 2.1 time: 0.033709 Oct 04 22:48:02.566072 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3930/7037] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:48:02 2022] GET /compute/v2.1/servers/f5d49992-b855-460b-8a93-d1e596e444da => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:48:02.572207 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-e349e355-b9cf-4d03-b407-9a4f7ff036df tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:48:02.572712 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-e349e355-b9cf-4d03-b407-9a4f7ff036df tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] [instance: cce96b87-3345-4234-8656-c01d0ac5e46c] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:48:02.579464 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e349e355-b9cf-4d03-b407-9a4f7ff036df tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:48:02.579950 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e349e355-b9cf-4d03-b407-9a4f7ff036df tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:48:02.580390 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e349e355-b9cf-4d03-b407-9a4f7ff036df tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:48:02.581084 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e349e355-b9cf-4d03-b407-9a4f7ff036df tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:48:02.581530 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e349e355-b9cf-4d03-b407-9a4f7ff036df tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:48:02.581954 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e349e355-b9cf-4d03-b407-9a4f7ff036df tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:48:02.608073 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-e349e355-b9cf-4d03-b407-9a4f7ff036df tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] [instance: cce96b87-3345-4234-8656-c01d0ac5e46c] Going to try to terminate instance {{(pid=134102) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 22:48:02.688049 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-e349e355-b9cf-4d03-b407-9a4f7ff036df tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] 10.222.0.43 "DELETE /compute/v2.1/servers/cce96b87-3345-4234-8656-c01d0ac5e46c" status: 204 len: 0 microversion: 2.1 time: 0.119148 Oct 04 22:48:02.689000 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3108/7038] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 22:48:02 2022] DELETE /compute/v2.1/servers/cce96b87-3345-4234-8656-c01d0ac5e46c => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 22:48:02.697436 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-fa5f3964-cdfd-40ce-8a85-a56383eb49c0 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:48:02.698402 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-fa5f3964-cdfd-40ce-8a85-a56383eb49c0 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] [instance: cce96b87-3345-4234-8656-c01d0ac5e46c] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:48:02.704723 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fa5f3964-cdfd-40ce-8a85-a56383eb49c0 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:48:02.705236 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fa5f3964-cdfd-40ce-8a85-a56383eb49c0 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:48:02.705700 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fa5f3964-cdfd-40ce-8a85-a56383eb49c0 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:48:02.706448 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fa5f3964-cdfd-40ce-8a85-a56383eb49c0 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:48:02.706950 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fa5f3964-cdfd-40ce-8a85-a56383eb49c0 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:48:02.707388 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fa5f3964-cdfd-40ce-8a85-a56383eb49c0 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:48:02.835093 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-fa5f3964-cdfd-40ce-8a85-a56383eb49c0 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/cce96b87-3345-4234-8656-c01d0ac5e46c" status: 200 len: 1654 microversion: 2.1 time: 0.141049 Oct 04 22:48:02.835665 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3931/7039] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:48:02 2022] GET /compute/v2.1/servers/cce96b87-3345-4234-8656-c01d0ac5e46c => generated 1654 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:48:03.858435 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-9b467b00-01d0-48b5-b0e3-b7331e776c97 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:48:03.859174 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-9b467b00-01d0-48b5-b0e3-b7331e776c97 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] [instance: cce96b87-3345-4234-8656-c01d0ac5e46c] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:48:03.866514 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9b467b00-01d0-48b5-b0e3-b7331e776c97 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:48:03.866992 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9b467b00-01d0-48b5-b0e3-b7331e776c97 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:48:03.867428 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9b467b00-01d0-48b5-b0e3-b7331e776c97 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:48:03.868121 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9b467b00-01d0-48b5-b0e3-b7331e776c97 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:48:03.868571 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9b467b00-01d0-48b5-b0e3-b7331e776c97 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:48:03.868993 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9b467b00-01d0-48b5-b0e3-b7331e776c97 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:48:04.018466 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-9b467b00-01d0-48b5-b0e3-b7331e776c97 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/cce96b87-3345-4234-8656-c01d0ac5e46c" status: 200 len: 1654 microversion: 2.1 time: 0.164024 Oct 04 22:48:04.019069 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3109/7040] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:48:03 2022] GET /compute/v2.1/servers/cce96b87-3345-4234-8656-c01d0ac5e46c => generated 1654 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:48:04.737895 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-05fab2ef-0924-49c0-9d5d-95ffa2cb8ae2 req-f5e8f7d4-e511-465e-bf3a-797c8b1abe7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cce96b87-3345-4234-8656-c01d0ac5e46c", "name": "network-vif-deleted", "tag": "c6073e3a-2632-404d-9593-508a0665bcae"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:48:04.744796 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=3 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:48:04.753480 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-05fab2ef-0924-49c0-9d5d-95ffa2cb8ae2 req-f5e8f7d4-e511-465e-bf3a-797c8b1abe7f service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:48:04.754278 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-05fab2ef-0924-49c0-9d5d-95ffa2cb8ae2 req-f5e8f7d4-e511-465e-bf3a-797c8b1abe7f service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:48:04.754932 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-05fab2ef-0924-49c0-9d5d-95ffa2cb8ae2 req-f5e8f7d4-e511-465e-bf3a-797c8b1abe7f service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:48:04.760426 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=95 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:48:04.773532 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-05fab2ef-0924-49c0-9d5d-95ffa2cb8ae2 req-f5e8f7d4-e511-465e-bf3a-797c8b1abe7f service nova] Creating event network-vif-deleted:c6073e3a-2632-404d-9593-508a0665bcae for instance cce96b87-3345-4234-8656-c01d0ac5e46c on n-h2-860284-1 Oct 04 22:48:04.779828 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-05fab2ef-0924-49c0-9d5d-95ffa2cb8ae2 req-f5e8f7d4-e511-465e-bf3a-797c8b1abe7f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113937 Oct 04 22:48:04.780453 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3932/7041] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:48:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:48:05.041481 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-b898ee5f-5d95-4eeb-a6d8-c4d81f3bfeb7 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:48:05.042100 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-b898ee5f-5d95-4eeb-a6d8-c4d81f3bfeb7 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] [instance: cce96b87-3345-4234-8656-c01d0ac5e46c] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:48:05.044876 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:48:05.050819 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b898ee5f-5d95-4eeb-a6d8-c4d81f3bfeb7 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:48:05.051306 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b898ee5f-5d95-4eeb-a6d8-c4d81f3bfeb7 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:48:05.051746 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b898ee5f-5d95-4eeb-a6d8-c4d81f3bfeb7 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:48:05.052441 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b898ee5f-5d95-4eeb-a6d8-c4d81f3bfeb7 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:48:05.052944 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b898ee5f-5d95-4eeb-a6d8-c4d81f3bfeb7 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:48:05.053556 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b898ee5f-5d95-4eeb-a6d8-c4d81f3bfeb7 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:48:05.085787 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b898ee5f-5d95-4eeb-a6d8-c4d81f3bfeb7 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:48:05.086261 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b898ee5f-5d95-4eeb-a6d8-c4d81f3bfeb7 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:48:05.086721 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b898ee5f-5d95-4eeb-a6d8-c4d81f3bfeb7 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:48:05.087167 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.objects.instance [None req-b898ee5f-5d95-4eeb-a6d8-c4d81f3bfeb7 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Lazy-loading 'fault' on Instance uuid cce96b87-3345-4234-8656-c01d0ac5e46c {{(pid=134102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 22:48:05.134961 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-b898ee5f-5d95-4eeb-a6d8-c4d81f3bfeb7 tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/cce96b87-3345-4234-8656-c01d0ac5e46c" status: 200 len: 1453 microversion: 2.1 time: 0.097734 Oct 04 22:48:05.135654 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3110/7042] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:48:05 2022] GET /compute/v2.1/servers/cce96b87-3345-4234-8656-c01d0ac5e46c => generated 1453 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:48:06.161083 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-7c14879e-525d-4789-a4d1-666c7d175f1f tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:48:06.161792 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-7c14879e-525d-4789-a4d1-666c7d175f1f tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] [instance: cce96b87-3345-4234-8656-c01d0ac5e46c] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:48:06.170788 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7c14879e-525d-4789-a4d1-666c7d175f1f tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:48:06.171208 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7c14879e-525d-4789-a4d1-666c7d175f1f tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:48:06.171661 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7c14879e-525d-4789-a4d1-666c7d175f1f tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:48:06.172694 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7c14879e-525d-4789-a4d1-666c7d175f1f tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:48:06.173189 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7c14879e-525d-4789-a4d1-666c7d175f1f tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:48:06.173633 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7c14879e-525d-4789-a4d1-666c7d175f1f tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:48:06.192348 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-7c14879e-525d-4789-a4d1-666c7d175f1f tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] HTTP exception thrown: Instance cce96b87-3345-4234-8656-c01d0ac5e46c could not be found. Oct 04 22:48:06.195195 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-7c14879e-525d-4789-a4d1-666c7d175f1f tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Request method failure captured: Oct 04 22:48:06.195195 n-d-860284-1 devstack@n-api.service[134101]: request: GET /compute/v2.1/servers/cce96b87-3345-4234-8656-c01d0ac5e46c HTTP/1.1 Oct 04 22:48:06.195195 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 22:48:06.195195 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 22:48:06.195195 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 22:48:06.195195 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 22:48:06.195195 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 22:48:06.195195 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 22:48:06.195195 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 22:48:06.195195 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 22:48:06.195195 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPLgG2i8w6mEXsAVv84zr_5lHg_N5eY5kvBOp50bhOFxqAWRqOTDSVxQx7pJ7BnhxV3vuWBaHei7cPzuGy1rlKfuo9-FGxFAK2iy-9S0rTaiy02PnLwr2m9CobivgptuV2lUnoiXb87n28OfvCSNLBWOoHtlIHU1rBHlSD6fpPk3UpbI Oct 04 22:48:06.195195 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 22:48:06.195195 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 22:48:06.195195 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 22:48:06.195195 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 22:48:06.195195 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 22:48:06.195195 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 22:48:06.195195 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: 8b911acbc44f4c419bdf2e7a15128d42 Oct 04 22:48:06.195195 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-TestServerMultinode-1428333635 Oct 04 22:48:06.195195 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,admin,member Oct 04 22:48:06.195195 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,admin,member Oct 04 22:48:06.195195 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8b911acbc44f4c419bdf2e7a15128d42"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_8b911acbc44f4c419bdf2e7a15128d42", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8b911acbc44f4c419bdf2e7a15128d42"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/8b911acbc44f4c419bdf2e7a15128d42"}]}] Oct 04 22:48:06.195195 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-TestServerMultinode-1428333635 Oct 04 22:48:06.195195 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: 8b911acbc44f4c419bdf2e7a15128d42 Oct 04 22:48:06.195195 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-TestServerMultinode-1428333635 Oct 04 22:48:06.195195 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-TestServerMultinode-1428333635-project-admin Oct 04 22:48:06.195195 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 22:48:06.195195 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 22:48:06.195195 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: aa7baa9b51d54220b8fde803d250bd0c Oct 04 22:48:06.195195 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-TestServerMultinode-1428333635-project-admin Oct 04 22:48:06.195195 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 22:48:06.195195 n-d-860284-1 devstack@n-api.service[134101]: exception: Instance cce96b87-3345-4234-8656-c01d0ac5e46c could not be found. Oct 04 22:48:06.195195 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': 'cce96b87-3345-4234-8656-c01d0ac5e46c'} Oct 04 22:48:06.195195 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:48:06.195195 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:48:06.195195 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:48:06.195195 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:48:06.195195 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:48:06.195195 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:48:06.195195 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:48:06.195195 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:48:06.195195 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:48:06.195195 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:48:06.195195 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cce96b87-3345-4234-8656-c01d0ac5e46c could not be found. Oct 04 22:48:06.195195 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:48:06.195195 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:48:06.195195 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:48:06.195195 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:48:06.195195 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:48:06.195195 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:48:06.195195 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:48:06.195195 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:48:06.195195 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:48:06.195195 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:48:06.195195 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:48:06.195195 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:48:06.195195 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:48:06.195195 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:48:06.195195 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:48:06.195195 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:48:06.195195 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cce96b87-3345-4234-8656-c01d0ac5e46c could not be found. Oct 04 22:48:06.195195 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:48:06.195195 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:48:06.195195 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:48:06.199359 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:48:06.199359 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:48:06.199359 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:48:06.199359 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:48:06.199359 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:48:06.199359 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cce96b87-3345-4234-8656-c01d0ac5e46c could not be found. Oct 04 22:48:06.199359 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:48:06.199359 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-7c14879e-525d-4789-a4d1-666c7d175f1f tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] Returning 404 to user: Instance cce96b87-3345-4234-8656-c01d0ac5e46c could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:48:06.199359 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-7c14879e-525d-4789-a4d1-666c7d175f1f tempest-TestServerMultinode-1428333635 tempest-TestServerMultinode-1428333635-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/cce96b87-3345-4234-8656-c01d0ac5e46c" status: 404 len: 111 microversion: 2.1 time: 0.041072 Oct 04 22:48:06.199359 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3933/7043] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:48:06 2022] GET /compute/v2.1/servers/cce96b87-3345-4234-8656-c01d0ac5e46c => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:48:24.776276 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_api:SELECT=3 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:48:24.777912 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=32,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:48:24.894955 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-939eb9e7-d37a-4dbc-862f-151df3fec270 tempest-ServersAdminNegativeTestJSON-508526888 tempest-ServersAdminNegativeTestJSON-508526888-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1773363799", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452"}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:48:24.947790 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.network.neutron [None req-939eb9e7-d37a-4dbc-862f-151df3fec270 tempest-ServersAdminNegativeTestJSON-508526888 tempest-ServersAdminNegativeTestJSON-508526888-project] validate_networks() for None {{(pid=134102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 22:48:25.217022 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-939eb9e7-d37a-4dbc-862f-151df3fec270 tempest-ServersAdminNegativeTestJSON-508526888 tempest-ServersAdminNegativeTestJSON-508526888-project] Flavor limits 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 22:48:25.217449 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-939eb9e7-d37a-4dbc-862f-151df3fec270 tempest-ServersAdminNegativeTestJSON-508526888 tempest-ServersAdminNegativeTestJSON-508526888-project] Image limits 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 22:48:25.217926 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-939eb9e7-d37a-4dbc-862f-151df3fec270 tempest-ServersAdminNegativeTestJSON-508526888 tempest-ServersAdminNegativeTestJSON-508526888-project] Flavor pref 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 22:48:25.218342 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-939eb9e7-d37a-4dbc-862f-151df3fec270 tempest-ServersAdminNegativeTestJSON-508526888 tempest-ServersAdminNegativeTestJSON-508526888-project] Image pref 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 22:48:25.218788 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-939eb9e7-d37a-4dbc-862f-151df3fec270 tempest-ServersAdminNegativeTestJSON-508526888 tempest-ServersAdminNegativeTestJSON-508526888-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 22:48:25.228272 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-939eb9e7-d37a-4dbc-862f-151df3fec270 tempest-ServersAdminNegativeTestJSON-508526888 tempest-ServersAdminNegativeTestJSON-508526888-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:48:25.228750 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-939eb9e7-d37a-4dbc-862f-151df3fec270 tempest-ServersAdminNegativeTestJSON-508526888 tempest-ServersAdminNegativeTestJSON-508526888-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:48:25.229187 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-939eb9e7-d37a-4dbc-862f-151df3fec270 tempest-ServersAdminNegativeTestJSON-508526888 tempest-ServersAdminNegativeTestJSON-508526888-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:48:25.229911 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-939eb9e7-d37a-4dbc-862f-151df3fec270 tempest-ServersAdminNegativeTestJSON-508526888 tempest-ServersAdminNegativeTestJSON-508526888-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:48:25.230384 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-939eb9e7-d37a-4dbc-862f-151df3fec270 tempest-ServersAdminNegativeTestJSON-508526888 tempest-ServersAdminNegativeTestJSON-508526888-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:48:25.230804 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-939eb9e7-d37a-4dbc-862f-151df3fec270 tempest-ServersAdminNegativeTestJSON-508526888 tempest-ServersAdminNegativeTestJSON-508526888-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:48:25.247415 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-939eb9e7-d37a-4dbc-862f-151df3fec270 tempest-ServersAdminNegativeTestJSON-508526888 tempest-ServersAdminNegativeTestJSON-508526888-project] Getting quotas for project 7d553f807772435eaeba3fe2bf545172. Resources: {'instances', 'ram', 'cores'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:48:25.252903 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-939eb9e7-d37a-4dbc-862f-151df3fec270 tempest-ServersAdminNegativeTestJSON-508526888 tempest-ServersAdminNegativeTestJSON-508526888-project] Getting quotas for user e1d2e25fe9104b2b9dd13eab371764f8 and project 7d553f807772435eaeba3fe2bf545172. Resources: {'instances', 'ram', 'cores'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:48:25.264991 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-939eb9e7-d37a-4dbc-862f-151df3fec270 tempest-ServersAdminNegativeTestJSON-508526888 tempest-ServersAdminNegativeTestJSON-508526888-project] Going to run 1 instances... {{(pid=134102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 22:48:25.267361 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-939eb9e7-d37a-4dbc-862f-151df3fec270 tempest-ServersAdminNegativeTestJSON-508526888 tempest-ServersAdminNegativeTestJSON-508526888-project] [instance: 43a690fe-d177-426c-aa46-478d5f7aaf39] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='58548514-5dac-426c-81f5-19e3fba33e23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 22:48:25.311791 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-939eb9e7-d37a-4dbc-862f-151df3fec270 tempest-ServersAdminNegativeTestJSON-508526888 tempest-ServersAdminNegativeTestJSON-508526888-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.541594 Oct 04 22:48:25.312453 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3111/7044] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 22:48:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 543 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 22:48:25.326140 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-68e59e07-9ae2-4b7c-8ca9-8ff631cec16e tempest-ServersAdminNegativeTestJSON-508526888 tempest-ServersAdminNegativeTestJSON-508526888-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:48:25.327031 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-68e59e07-9ae2-4b7c-8ca9-8ff631cec16e tempest-ServersAdminNegativeTestJSON-508526888 tempest-ServersAdminNegativeTestJSON-508526888-project] [instance: 43a690fe-d177-426c-aa46-478d5f7aaf39] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:48:25.329311 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=3 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:48:25.330051 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=3 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:48:25.390723 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-68e59e07-9ae2-4b7c-8ca9-8ff631cec16e tempest-ServersAdminNegativeTestJSON-508526888 tempest-ServersAdminNegativeTestJSON-508526888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1d2e25fe9104b2b9dd13eab371764f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d553f807772435eaeba3fe2bf545172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:48:25.399192 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-68e59e07-9ae2-4b7c-8ca9-8ff631cec16e tempest-ServersAdminNegativeTestJSON-508526888 tempest-ServersAdminNegativeTestJSON-508526888-project] 10.222.0.43 "GET /compute/v2.1/servers/43a690fe-d177-426c-aa46-478d5f7aaf39" status: 200 len: 1222 microversion: 2.1 time: 0.077247 Oct 04 22:48:25.399763 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3934/7045] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:48:25 2022] GET /compute/v2.1/servers/43a690fe-d177-426c-aa46-478d5f7aaf39 => generated 1222 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:48:26.423751 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-6df9f87b-e628-411f-ae2e-f5b8ae195ae0 tempest-ServersAdminNegativeTestJSON-508526888 tempest-ServersAdminNegativeTestJSON-508526888-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:48:26.424375 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-6df9f87b-e628-411f-ae2e-f5b8ae195ae0 tempest-ServersAdminNegativeTestJSON-508526888 tempest-ServersAdminNegativeTestJSON-508526888-project] [instance: 43a690fe-d177-426c-aa46-478d5f7aaf39] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:48:26.431851 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6df9f87b-e628-411f-ae2e-f5b8ae195ae0 tempest-ServersAdminNegativeTestJSON-508526888 tempest-ServersAdminNegativeTestJSON-508526888-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:48:26.432342 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6df9f87b-e628-411f-ae2e-f5b8ae195ae0 tempest-ServersAdminNegativeTestJSON-508526888 tempest-ServersAdminNegativeTestJSON-508526888-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:48:26.432780 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6df9f87b-e628-411f-ae2e-f5b8ae195ae0 tempest-ServersAdminNegativeTestJSON-508526888 tempest-ServersAdminNegativeTestJSON-508526888-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:48:26.433480 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6df9f87b-e628-411f-ae2e-f5b8ae195ae0 tempest-ServersAdminNegativeTestJSON-508526888 tempest-ServersAdminNegativeTestJSON-508526888-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:48:26.433935 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6df9f87b-e628-411f-ae2e-f5b8ae195ae0 tempest-ServersAdminNegativeTestJSON-508526888 tempest-ServersAdminNegativeTestJSON-508526888-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:48:26.434379 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6df9f87b-e628-411f-ae2e-f5b8ae195ae0 tempest-ServersAdminNegativeTestJSON-508526888 tempest-ServersAdminNegativeTestJSON-508526888-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:48:26.499869 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-6df9f87b-e628-411f-ae2e-f5b8ae195ae0 tempest-ServersAdminNegativeTestJSON-508526888 tempest-ServersAdminNegativeTestJSON-508526888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1d2e25fe9104b2b9dd13eab371764f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d553f807772435eaeba3fe2bf545172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:48:26.507955 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-6df9f87b-e628-411f-ae2e-f5b8ae195ae0 tempest-ServersAdminNegativeTestJSON-508526888 tempest-ServersAdminNegativeTestJSON-508526888-project] 10.222.0.43 "GET /compute/v2.1/servers/43a690fe-d177-426c-aa46-478d5f7aaf39" status: 200 len: 1280 microversion: 2.1 time: 0.088974 Oct 04 22:48:26.508546 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3112/7046] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:48:26 2022] GET /compute/v2.1/servers/43a690fe-d177-426c-aa46-478d5f7aaf39 => generated 1280 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:48:27.531703 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-1cbe53a5-def5-48ff-b45b-8a55c6264211 tempest-ServersAdminNegativeTestJSON-508526888 tempest-ServersAdminNegativeTestJSON-508526888-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:48:27.532338 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-1cbe53a5-def5-48ff-b45b-8a55c6264211 tempest-ServersAdminNegativeTestJSON-508526888 tempest-ServersAdminNegativeTestJSON-508526888-project] [instance: 43a690fe-d177-426c-aa46-478d5f7aaf39] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:48:27.541120 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1cbe53a5-def5-48ff-b45b-8a55c6264211 tempest-ServersAdminNegativeTestJSON-508526888 tempest-ServersAdminNegativeTestJSON-508526888-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:48:27.541776 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1cbe53a5-def5-48ff-b45b-8a55c6264211 tempest-ServersAdminNegativeTestJSON-508526888 tempest-ServersAdminNegativeTestJSON-508526888-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:48:27.542313 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1cbe53a5-def5-48ff-b45b-8a55c6264211 tempest-ServersAdminNegativeTestJSON-508526888 tempest-ServersAdminNegativeTestJSON-508526888-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:48:27.543080 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1cbe53a5-def5-48ff-b45b-8a55c6264211 tempest-ServersAdminNegativeTestJSON-508526888 tempest-ServersAdminNegativeTestJSON-508526888-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:48:27.543558 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1cbe53a5-def5-48ff-b45b-8a55c6264211 tempest-ServersAdminNegativeTestJSON-508526888 tempest-ServersAdminNegativeTestJSON-508526888-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:48:27.544009 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1cbe53a5-def5-48ff-b45b-8a55c6264211 tempest-ServersAdminNegativeTestJSON-508526888 tempest-ServersAdminNegativeTestJSON-508526888-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:48:27.755714 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-1cbe53a5-def5-48ff-b45b-8a55c6264211 tempest-ServersAdminNegativeTestJSON-508526888 tempest-ServersAdminNegativeTestJSON-508526888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1d2e25fe9104b2b9dd13eab371764f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d553f807772435eaeba3fe2bf545172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:48:27.763556 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-1cbe53a5-def5-48ff-b45b-8a55c6264211 tempest-ServersAdminNegativeTestJSON-508526888 tempest-ServersAdminNegativeTestJSON-508526888-project] 10.222.0.43 "GET /compute/v2.1/servers/43a690fe-d177-426c-aa46-478d5f7aaf39" status: 200 len: 1322 microversion: 2.1 time: 0.235920 Oct 04 22:48:27.764134 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3935/7047] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:48:27 2022] GET /compute/v2.1/servers/43a690fe-d177-426c-aa46-478d5f7aaf39 => generated 1322 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:48:27.894259 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-730f4319-47b9-4684-af97-90e280b88309 req-aac7fa71-b7e6-4eeb-a17c-b5b4820414d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43a690fe-d177-426c-aa46-478d5f7aaf39", "tag": "b85d96d1-318a-4eb0-9114-5645646bc21b"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:48:27.905409 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-730f4319-47b9-4684-af97-90e280b88309 req-aac7fa71-b7e6-4eeb-a17c-b5b4820414d1 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:48:27.906140 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-730f4319-47b9-4684-af97-90e280b88309 req-aac7fa71-b7e6-4eeb-a17c-b5b4820414d1 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:48:27.906295 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-730f4319-47b9-4684-af97-90e280b88309 req-aac7fa71-b7e6-4eeb-a17c-b5b4820414d1 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:48:27.918527 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-730f4319-47b9-4684-af97-90e280b88309 req-aac7fa71-b7e6-4eeb-a17c-b5b4820414d1 service nova] Creating event network-changed:b85d96d1-318a-4eb0-9114-5645646bc21b for instance 43a690fe-d177-426c-aa46-478d5f7aaf39 on n-h1-860284-1 Oct 04 22:48:27.923597 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-730f4319-47b9-4684-af97-90e280b88309 req-aac7fa71-b7e6-4eeb-a17c-b5b4820414d1 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033339 Oct 04 22:48:27.924213 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3113/7048] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:48:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:48:28.786603 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-8c65bea5-3929-4ccd-8ae4-acc11f19e121 tempest-ServersAdminNegativeTestJSON-508526888 tempest-ServersAdminNegativeTestJSON-508526888-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:48:28.787289 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-8c65bea5-3929-4ccd-8ae4-acc11f19e121 tempest-ServersAdminNegativeTestJSON-508526888 tempest-ServersAdminNegativeTestJSON-508526888-project] [instance: 43a690fe-d177-426c-aa46-478d5f7aaf39] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:48:28.794307 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8c65bea5-3929-4ccd-8ae4-acc11f19e121 tempest-ServersAdminNegativeTestJSON-508526888 tempest-ServersAdminNegativeTestJSON-508526888-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:48:28.794792 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8c65bea5-3929-4ccd-8ae4-acc11f19e121 tempest-ServersAdminNegativeTestJSON-508526888 tempest-ServersAdminNegativeTestJSON-508526888-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:48:28.795261 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8c65bea5-3929-4ccd-8ae4-acc11f19e121 tempest-ServersAdminNegativeTestJSON-508526888 tempest-ServersAdminNegativeTestJSON-508526888-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:48:28.795980 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8c65bea5-3929-4ccd-8ae4-acc11f19e121 tempest-ServersAdminNegativeTestJSON-508526888 tempest-ServersAdminNegativeTestJSON-508526888-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:48:28.796461 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8c65bea5-3929-4ccd-8ae4-acc11f19e121 tempest-ServersAdminNegativeTestJSON-508526888 tempest-ServersAdminNegativeTestJSON-508526888-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:48:28.796914 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8c65bea5-3929-4ccd-8ae4-acc11f19e121 tempest-ServersAdminNegativeTestJSON-508526888 tempest-ServersAdminNegativeTestJSON-508526888-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:48:28.933737 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-8c65bea5-3929-4ccd-8ae4-acc11f19e121 tempest-ServersAdminNegativeTestJSON-508526888 tempest-ServersAdminNegativeTestJSON-508526888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1d2e25fe9104b2b9dd13eab371764f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d553f807772435eaeba3fe2bf545172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:48:28.941582 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-8c65bea5-3929-4ccd-8ae4-acc11f19e121 tempest-ServersAdminNegativeTestJSON-508526888 tempest-ServersAdminNegativeTestJSON-508526888-project] 10.222.0.43 "GET /compute/v2.1/servers/43a690fe-d177-426c-aa46-478d5f7aaf39" status: 200 len: 1322 microversion: 2.1 time: 0.158976 Oct 04 22:48:28.942171 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3936/7049] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:48:28 2022] GET /compute/v2.1/servers/43a690fe-d177-426c-aa46-478d5f7aaf39 => generated 1322 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:48:29.966567 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-c884bca1-3d45-46d7-9b1f-53af8303e68a tempest-ServersAdminNegativeTestJSON-508526888 tempest-ServersAdminNegativeTestJSON-508526888-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:48:29.967294 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-c884bca1-3d45-46d7-9b1f-53af8303e68a tempest-ServersAdminNegativeTestJSON-508526888 tempest-ServersAdminNegativeTestJSON-508526888-project] [instance: 43a690fe-d177-426c-aa46-478d5f7aaf39] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:48:29.973443 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c884bca1-3d45-46d7-9b1f-53af8303e68a tempest-ServersAdminNegativeTestJSON-508526888 tempest-ServersAdminNegativeTestJSON-508526888-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:48:29.973924 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c884bca1-3d45-46d7-9b1f-53af8303e68a tempest-ServersAdminNegativeTestJSON-508526888 tempest-ServersAdminNegativeTestJSON-508526888-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:48:29.974890 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c884bca1-3d45-46d7-9b1f-53af8303e68a tempest-ServersAdminNegativeTestJSON-508526888 tempest-ServersAdminNegativeTestJSON-508526888-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:48:29.975576 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c884bca1-3d45-46d7-9b1f-53af8303e68a tempest-ServersAdminNegativeTestJSON-508526888 tempest-ServersAdminNegativeTestJSON-508526888-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:48:29.976033 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c884bca1-3d45-46d7-9b1f-53af8303e68a tempest-ServersAdminNegativeTestJSON-508526888 tempest-ServersAdminNegativeTestJSON-508526888-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:48:29.976459 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c884bca1-3d45-46d7-9b1f-53af8303e68a tempest-ServersAdminNegativeTestJSON-508526888 tempest-ServersAdminNegativeTestJSON-508526888-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:48:30.107947 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-c884bca1-3d45-46d7-9b1f-53af8303e68a tempest-ServersAdminNegativeTestJSON-508526888 tempest-ServersAdminNegativeTestJSON-508526888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1d2e25fe9104b2b9dd13eab371764f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d553f807772435eaeba3fe2bf545172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:48:30.116319 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-c884bca1-3d45-46d7-9b1f-53af8303e68a tempest-ServersAdminNegativeTestJSON-508526888 tempest-ServersAdminNegativeTestJSON-508526888-project] 10.222.0.43 "GET /compute/v2.1/servers/43a690fe-d177-426c-aa46-478d5f7aaf39" status: 200 len: 1322 microversion: 2.1 time: 0.154835 Oct 04 22:48:30.116912 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3114/7050] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:48:29 2022] GET /compute/v2.1/servers/43a690fe-d177-426c-aa46-478d5f7aaf39 => generated 1322 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:48:31.139988 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-d9d147bc-16cb-4725-ae7d-c56572de5328 tempest-ServersAdminNegativeTestJSON-508526888 tempest-ServersAdminNegativeTestJSON-508526888-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:48:31.140737 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-d9d147bc-16cb-4725-ae7d-c56572de5328 tempest-ServersAdminNegativeTestJSON-508526888 tempest-ServersAdminNegativeTestJSON-508526888-project] [instance: 43a690fe-d177-426c-aa46-478d5f7aaf39] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:48:31.148440 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d9d147bc-16cb-4725-ae7d-c56572de5328 tempest-ServersAdminNegativeTestJSON-508526888 tempest-ServersAdminNegativeTestJSON-508526888-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:48:31.148955 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d9d147bc-16cb-4725-ae7d-c56572de5328 tempest-ServersAdminNegativeTestJSON-508526888 tempest-ServersAdminNegativeTestJSON-508526888-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:48:31.149425 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d9d147bc-16cb-4725-ae7d-c56572de5328 tempest-ServersAdminNegativeTestJSON-508526888 tempest-ServersAdminNegativeTestJSON-508526888-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:48:31.150152 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d9d147bc-16cb-4725-ae7d-c56572de5328 tempest-ServersAdminNegativeTestJSON-508526888 tempest-ServersAdminNegativeTestJSON-508526888-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:48:31.150672 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d9d147bc-16cb-4725-ae7d-c56572de5328 tempest-ServersAdminNegativeTestJSON-508526888 tempest-ServersAdminNegativeTestJSON-508526888-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:48:31.151129 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d9d147bc-16cb-4725-ae7d-c56572de5328 tempest-ServersAdminNegativeTestJSON-508526888 tempest-ServersAdminNegativeTestJSON-508526888-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:48:31.281017 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-d9d147bc-16cb-4725-ae7d-c56572de5328 tempest-ServersAdminNegativeTestJSON-508526888 tempest-ServersAdminNegativeTestJSON-508526888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1d2e25fe9104b2b9dd13eab371764f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d553f807772435eaeba3fe2bf545172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:48:31.289400 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-d9d147bc-16cb-4725-ae7d-c56572de5328 tempest-ServersAdminNegativeTestJSON-508526888 tempest-ServersAdminNegativeTestJSON-508526888-project] 10.222.0.43 "GET /compute/v2.1/servers/43a690fe-d177-426c-aa46-478d5f7aaf39" status: 200 len: 1322 microversion: 2.1 time: 0.153531 Oct 04 22:48:31.289983 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3937/7051] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:48:31 2022] GET /compute/v2.1/servers/43a690fe-d177-426c-aa46-478d5f7aaf39 => generated 1322 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:48:32.312110 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-bff4fe5e-c624-4501-b083-23ddfd6732b4 tempest-ServersAdminNegativeTestJSON-508526888 tempest-ServersAdminNegativeTestJSON-508526888-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:48:32.312726 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-bff4fe5e-c624-4501-b083-23ddfd6732b4 tempest-ServersAdminNegativeTestJSON-508526888 tempest-ServersAdminNegativeTestJSON-508526888-project] [instance: 43a690fe-d177-426c-aa46-478d5f7aaf39] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:48:32.319957 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bff4fe5e-c624-4501-b083-23ddfd6732b4 tempest-ServersAdminNegativeTestJSON-508526888 tempest-ServersAdminNegativeTestJSON-508526888-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:48:32.320449 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bff4fe5e-c624-4501-b083-23ddfd6732b4 tempest-ServersAdminNegativeTestJSON-508526888 tempest-ServersAdminNegativeTestJSON-508526888-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:48:32.320885 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bff4fe5e-c624-4501-b083-23ddfd6732b4 tempest-ServersAdminNegativeTestJSON-508526888 tempest-ServersAdminNegativeTestJSON-508526888-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:48:32.321575 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bff4fe5e-c624-4501-b083-23ddfd6732b4 tempest-ServersAdminNegativeTestJSON-508526888 tempest-ServersAdminNegativeTestJSON-508526888-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:48:32.322028 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bff4fe5e-c624-4501-b083-23ddfd6732b4 tempest-ServersAdminNegativeTestJSON-508526888 tempest-ServersAdminNegativeTestJSON-508526888-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:48:32.322552 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bff4fe5e-c624-4501-b083-23ddfd6732b4 tempest-ServersAdminNegativeTestJSON-508526888 tempest-ServersAdminNegativeTestJSON-508526888-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:48:32.450410 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-bff4fe5e-c624-4501-b083-23ddfd6732b4 tempest-ServersAdminNegativeTestJSON-508526888 tempest-ServersAdminNegativeTestJSON-508526888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1d2e25fe9104b2b9dd13eab371764f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d553f807772435eaeba3fe2bf545172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:48:32.458093 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-bff4fe5e-c624-4501-b083-23ddfd6732b4 tempest-ServersAdminNegativeTestJSON-508526888 tempest-ServersAdminNegativeTestJSON-508526888-project] 10.222.0.43 "GET /compute/v2.1/servers/43a690fe-d177-426c-aa46-478d5f7aaf39" status: 200 len: 1322 microversion: 2.1 time: 0.149889 Oct 04 22:48:32.459294 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3115/7052] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:48:32 2022] GET /compute/v2.1/servers/43a690fe-d177-426c-aa46-478d5f7aaf39 => generated 1322 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:48:33.481654 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-0894ad0f-1340-47b3-b45b-da1e93c02ec6 tempest-ServersAdminNegativeTestJSON-508526888 tempest-ServersAdminNegativeTestJSON-508526888-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:48:33.482252 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-0894ad0f-1340-47b3-b45b-da1e93c02ec6 tempest-ServersAdminNegativeTestJSON-508526888 tempest-ServersAdminNegativeTestJSON-508526888-project] [instance: 43a690fe-d177-426c-aa46-478d5f7aaf39] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:48:33.489220 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0894ad0f-1340-47b3-b45b-da1e93c02ec6 tempest-ServersAdminNegativeTestJSON-508526888 tempest-ServersAdminNegativeTestJSON-508526888-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:48:33.490234 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0894ad0f-1340-47b3-b45b-da1e93c02ec6 tempest-ServersAdminNegativeTestJSON-508526888 tempest-ServersAdminNegativeTestJSON-508526888-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:48:33.490733 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0894ad0f-1340-47b3-b45b-da1e93c02ec6 tempest-ServersAdminNegativeTestJSON-508526888 tempest-ServersAdminNegativeTestJSON-508526888-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:48:33.491444 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0894ad0f-1340-47b3-b45b-da1e93c02ec6 tempest-ServersAdminNegativeTestJSON-508526888 tempest-ServersAdminNegativeTestJSON-508526888-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:48:33.491925 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0894ad0f-1340-47b3-b45b-da1e93c02ec6 tempest-ServersAdminNegativeTestJSON-508526888 tempest-ServersAdminNegativeTestJSON-508526888-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:48:33.492382 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0894ad0f-1340-47b3-b45b-da1e93c02ec6 tempest-ServersAdminNegativeTestJSON-508526888 tempest-ServersAdminNegativeTestJSON-508526888-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:48:33.621849 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-0894ad0f-1340-47b3-b45b-da1e93c02ec6 tempest-ServersAdminNegativeTestJSON-508526888 tempest-ServersAdminNegativeTestJSON-508526888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1d2e25fe9104b2b9dd13eab371764f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d553f807772435eaeba3fe2bf545172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:48:33.629928 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-0894ad0f-1340-47b3-b45b-da1e93c02ec6 tempest-ServersAdminNegativeTestJSON-508526888 tempest-ServersAdminNegativeTestJSON-508526888-project] 10.222.0.43 "GET /compute/v2.1/servers/43a690fe-d177-426c-aa46-478d5f7aaf39" status: 200 len: 1322 microversion: 2.1 time: 0.152403 Oct 04 22:48:33.630600 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3938/7053] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:48:33 2022] GET /compute/v2.1/servers/43a690fe-d177-426c-aa46-478d5f7aaf39 => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:48:34.198546 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-7a5a3d4f-0d37-4e66-818f-68b5eaf1bb16 req-27e0814a-793f-49dd-ae23-17b6b8895e15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43a690fe-d177-426c-aa46-478d5f7aaf39", "name": "network-vif-plugged", "status": "completed", "tag": "b85d96d1-318a-4eb0-9114-5645646bc21b"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:48:34.209561 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-7a5a3d4f-0d37-4e66-818f-68b5eaf1bb16 req-27e0814a-793f-49dd-ae23-17b6b8895e15 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:48:34.210739 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-7a5a3d4f-0d37-4e66-818f-68b5eaf1bb16 req-27e0814a-793f-49dd-ae23-17b6b8895e15 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:48:34.211187 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-7a5a3d4f-0d37-4e66-818f-68b5eaf1bb16 req-27e0814a-793f-49dd-ae23-17b6b8895e15 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:48:34.222475 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-7a5a3d4f-0d37-4e66-818f-68b5eaf1bb16 req-27e0814a-793f-49dd-ae23-17b6b8895e15 service nova] Creating event network-vif-plugged:b85d96d1-318a-4eb0-9114-5645646bc21b for instance 43a690fe-d177-426c-aa46-478d5f7aaf39 on n-h1-860284-1 Oct 04 22:48:34.228229 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-7a5a3d4f-0d37-4e66-818f-68b5eaf1bb16 req-27e0814a-793f-49dd-ae23-17b6b8895e15 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033697 Oct 04 22:48:34.229020 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3116/7054] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:48:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:48:34.653413 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-dc8d972f-9929-4aa3-a4ba-82320fd38ae9 tempest-ServersAdminNegativeTestJSON-508526888 tempest-ServersAdminNegativeTestJSON-508526888-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:48:34.654000 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-dc8d972f-9929-4aa3-a4ba-82320fd38ae9 tempest-ServersAdminNegativeTestJSON-508526888 tempest-ServersAdminNegativeTestJSON-508526888-project] [instance: 43a690fe-d177-426c-aa46-478d5f7aaf39] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:48:34.660934 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dc8d972f-9929-4aa3-a4ba-82320fd38ae9 tempest-ServersAdminNegativeTestJSON-508526888 tempest-ServersAdminNegativeTestJSON-508526888-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:48:34.661445 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dc8d972f-9929-4aa3-a4ba-82320fd38ae9 tempest-ServersAdminNegativeTestJSON-508526888 tempest-ServersAdminNegativeTestJSON-508526888-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:48:34.661927 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dc8d972f-9929-4aa3-a4ba-82320fd38ae9 tempest-ServersAdminNegativeTestJSON-508526888 tempest-ServersAdminNegativeTestJSON-508526888-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:48:34.662672 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dc8d972f-9929-4aa3-a4ba-82320fd38ae9 tempest-ServersAdminNegativeTestJSON-508526888 tempest-ServersAdminNegativeTestJSON-508526888-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:48:34.663149 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dc8d972f-9929-4aa3-a4ba-82320fd38ae9 tempest-ServersAdminNegativeTestJSON-508526888 tempest-ServersAdminNegativeTestJSON-508526888-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:48:34.663600 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dc8d972f-9929-4aa3-a4ba-82320fd38ae9 tempest-ServersAdminNegativeTestJSON-508526888 tempest-ServersAdminNegativeTestJSON-508526888-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:48:34.797507 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-dc8d972f-9929-4aa3-a4ba-82320fd38ae9 tempest-ServersAdminNegativeTestJSON-508526888 tempest-ServersAdminNegativeTestJSON-508526888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1d2e25fe9104b2b9dd13eab371764f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d553f807772435eaeba3fe2bf545172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:48:34.805224 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-dc8d972f-9929-4aa3-a4ba-82320fd38ae9 tempest-ServersAdminNegativeTestJSON-508526888 tempest-ServersAdminNegativeTestJSON-508526888-project] 10.222.0.43 "GET /compute/v2.1/servers/43a690fe-d177-426c-aa46-478d5f7aaf39" status: 200 len: 1322 microversion: 2.1 time: 0.155876 Oct 04 22:48:34.805801 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3939/7055] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:48:34 2022] GET /compute/v2.1/servers/43a690fe-d177-426c-aa46-478d5f7aaf39 => generated 1322 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:48:35.827870 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-6f0e2b6a-e0d6-472b-892c-281d470979f0 tempest-ServersAdminNegativeTestJSON-508526888 tempest-ServersAdminNegativeTestJSON-508526888-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:48:35.828580 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-6f0e2b6a-e0d6-472b-892c-281d470979f0 tempest-ServersAdminNegativeTestJSON-508526888 tempest-ServersAdminNegativeTestJSON-508526888-project] [instance: 43a690fe-d177-426c-aa46-478d5f7aaf39] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:48:35.831348 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell0:SELECT=2 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:48:35.832106 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell0:SELECT=6 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:48:35.838966 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6f0e2b6a-e0d6-472b-892c-281d470979f0 tempest-ServersAdminNegativeTestJSON-508526888 tempest-ServersAdminNegativeTestJSON-508526888-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:48:35.839462 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6f0e2b6a-e0d6-472b-892c-281d470979f0 tempest-ServersAdminNegativeTestJSON-508526888 tempest-ServersAdminNegativeTestJSON-508526888-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:48:35.839908 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6f0e2b6a-e0d6-472b-892c-281d470979f0 tempest-ServersAdminNegativeTestJSON-508526888 tempest-ServersAdminNegativeTestJSON-508526888-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:48:35.840607 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6f0e2b6a-e0d6-472b-892c-281d470979f0 tempest-ServersAdminNegativeTestJSON-508526888 tempest-ServersAdminNegativeTestJSON-508526888-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:48:35.841071 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6f0e2b6a-e0d6-472b-892c-281d470979f0 tempest-ServersAdminNegativeTestJSON-508526888 tempest-ServersAdminNegativeTestJSON-508526888-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:48:35.841502 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6f0e2b6a-e0d6-472b-892c-281d470979f0 tempest-ServersAdminNegativeTestJSON-508526888 tempest-ServersAdminNegativeTestJSON-508526888-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:48:35.975393 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-6f0e2b6a-e0d6-472b-892c-281d470979f0 tempest-ServersAdminNegativeTestJSON-508526888 tempest-ServersAdminNegativeTestJSON-508526888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1d2e25fe9104b2b9dd13eab371764f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d553f807772435eaeba3fe2bf545172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:48:35.983985 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-6f0e2b6a-e0d6-472b-892c-281d470979f0 tempest-ServersAdminNegativeTestJSON-508526888 tempest-ServersAdminNegativeTestJSON-508526888-project] 10.222.0.43 "GET /compute/v2.1/servers/43a690fe-d177-426c-aa46-478d5f7aaf39" status: 200 len: 1471 microversion: 2.1 time: 0.160400 Oct 04 22:48:35.984563 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3117/7056] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:48:35 2022] GET /compute/v2.1/servers/43a690fe-d177-426c-aa46-478d5f7aaf39 => generated 1471 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:48:36.011375 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=2 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:48:36.063113 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-5b3992e5-e0f0-4741-b301-dfd4955e245b tempest-ServersAdminNegativeTestJSON-392264354 tempest-ServersAdminNegativeTestJSON-392264354-project-admin] Calling method '.version_select at 0x7fbb2d9fe820>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:48:36.126946 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-5b3992e5-e0f0-4741-b301-dfd4955e245b tempest-ServersAdminNegativeTestJSON-392264354 tempest-ServersAdminNegativeTestJSON-392264354-project-admin] 10.222.0.43 "GET /compute/v2.1/os-quota-sets/86c0fc73795743ecb3e49799f7474068" status: 200 len: 371 microversion: 2.1 time: 0.120111 Oct 04 22:48:36.127521 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3940/7057] 10.222.0.43 () {58 vars in 1242 bytes} [Tue Oct 4 22:48:36 2022] GET /compute/v2.1/os-quota-sets/86c0fc73795743ecb3e49799f7474068 => generated 371 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:48:36.139455 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-876b6a36-f66b-42ae-bbbd-1f1ab03f1fa0 tempest-ServersAdminNegativeTestJSON-392264354 tempest-ServersAdminNegativeTestJSON-392264354-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-1794642283", "id": 1746676474, "os-flavor-access:is_public": "True"}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:48:36.156985 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-876b6a36-f66b-42ae-bbbd-1f1ab03f1fa0 tempest-ServersAdminNegativeTestJSON-392264354 tempest-ServersAdminNegativeTestJSON-392264354-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.021302 Oct 04 22:48:36.157588 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3118/7058] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 22:48:36 2022] POST /compute/v2.1/flavors => generated 438 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:48:36.170319 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-3cbd3c58-ba56-4d87-88f5-186ae6db26b9 tempest-ServersAdminNegativeTestJSON-392264354 tempest-ServersAdminNegativeTestJSON-392264354-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "1746676474"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:48:36.172675 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-3cbd3c58-ba56-4d87-88f5-186ae6db26b9 tempest-ServersAdminNegativeTestJSON-392264354 tempest-ServersAdminNegativeTestJSON-392264354-project-admin] [instance: 43a690fe-d177-426c-aa46-478d5f7aaf39] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:48:36.179537 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3cbd3c58-ba56-4d87-88f5-186ae6db26b9 tempest-ServersAdminNegativeTestJSON-392264354 tempest-ServersAdminNegativeTestJSON-392264354-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:48:36.180038 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3cbd3c58-ba56-4d87-88f5-186ae6db26b9 tempest-ServersAdminNegativeTestJSON-392264354 tempest-ServersAdminNegativeTestJSON-392264354-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:48:36.180492 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3cbd3c58-ba56-4d87-88f5-186ae6db26b9 tempest-ServersAdminNegativeTestJSON-392264354 tempest-ServersAdminNegativeTestJSON-392264354-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:48:36.181196 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3cbd3c58-ba56-4d87-88f5-186ae6db26b9 tempest-ServersAdminNegativeTestJSON-392264354 tempest-ServersAdminNegativeTestJSON-392264354-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:48:36.181664 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3cbd3c58-ba56-4d87-88f5-186ae6db26b9 tempest-ServersAdminNegativeTestJSON-392264354 tempest-ServersAdminNegativeTestJSON-392264354-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:48:36.182104 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3cbd3c58-ba56-4d87-88f5-186ae6db26b9 tempest-ServersAdminNegativeTestJSON-392264354 tempest-ServersAdminNegativeTestJSON-392264354-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:48:36.269096 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-3cbd3c58-ba56-4d87-88f5-186ae6db26b9 tempest-ServersAdminNegativeTestJSON-392264354 tempest-ServersAdminNegativeTestJSON-392264354-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '6cc123483f2a41b59bb004d630f29bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86c0fc73795743ecb3e49799f7474068', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:48:36.275572 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-3cbd3c58-ba56-4d87-88f5-186ae6db26b9 tempest-ServersAdminNegativeTestJSON-392264354 tempest-ServersAdminNegativeTestJSON-392264354-project-admin] [instance: 43a690fe-d177-426c-aa46-478d5f7aaf39] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-1794642283 {{(pid=134101) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 04 22:48:36.282148 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3cbd3c58-ba56-4d87-88f5-186ae6db26b9 tempest-ServersAdminNegativeTestJSON-392264354 tempest-ServersAdminNegativeTestJSON-392264354-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:48:36.282665 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3cbd3c58-ba56-4d87-88f5-186ae6db26b9 tempest-ServersAdminNegativeTestJSON-392264354 tempest-ServersAdminNegativeTestJSON-392264354-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:48:36.283116 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3cbd3c58-ba56-4d87-88f5-186ae6db26b9 tempest-ServersAdminNegativeTestJSON-392264354 tempest-ServersAdminNegativeTestJSON-392264354-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:48:36.283851 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3cbd3c58-ba56-4d87-88f5-186ae6db26b9 tempest-ServersAdminNegativeTestJSON-392264354 tempest-ServersAdminNegativeTestJSON-392264354-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:48:36.284315 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3cbd3c58-ba56-4d87-88f5-186ae6db26b9 tempest-ServersAdminNegativeTestJSON-392264354 tempest-ServersAdminNegativeTestJSON-392264354-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:48:36.284751 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3cbd3c58-ba56-4d87-88f5-186ae6db26b9 tempest-ServersAdminNegativeTestJSON-392264354 tempest-ServersAdminNegativeTestJSON-392264354-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:48:36.305509 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-3cbd3c58-ba56-4d87-88f5-186ae6db26b9 tempest-ServersAdminNegativeTestJSON-392264354 tempest-ServersAdminNegativeTestJSON-392264354-project-admin] Getting quotas for project 7d553f807772435eaeba3fe2bf545172. Resources: {'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:48:36.310601 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-3cbd3c58-ba56-4d87-88f5-186ae6db26b9 tempest-ServersAdminNegativeTestJSON-392264354 tempest-ServersAdminNegativeTestJSON-392264354-project-admin] Getting quotas for user e1d2e25fe9104b2b9dd13eab371764f8 and project 7d553f807772435eaeba3fe2bf545172. Resources: {'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:48:36.322765 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.compute.api [None req-3cbd3c58-ba56-4d87-88f5-186ae6db26b9 tempest-ServersAdminNegativeTestJSON-392264354 tempest-ServersAdminNegativeTestJSON-392264354-project-admin] ram quota exceeded for 86c0fc73795743ecb3e49799f7474068, tried to resize instance. Oct 04 22:48:36.323313 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-3cbd3c58-ba56-4d87-88f5-186ae6db26b9 tempest-ServersAdminNegativeTestJSON-392264354 tempest-ServersAdminNegativeTestJSON-392264354-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 04 22:48:36.325259 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-3cbd3c58-ba56-4d87-88f5-186ae6db26b9 tempest-ServersAdminNegativeTestJSON-392264354 tempest-ServersAdminNegativeTestJSON-392264354-project-admin] Request method failure captured: Oct 04 22:48:36.325259 n-d-860284-1 devstack@n-api.service[134101]: request: POST /compute/v2.1/servers/43a690fe-d177-426c-aa46-478d5f7aaf39/action HTTP/1.1 Oct 04 22:48:36.325259 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 22:48:36.325259 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 22:48:36.325259 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 22:48:36.325259 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 39 Oct 04 22:48:36.325259 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 22:48:36.325259 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 22:48:36.325259 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 22:48:36.325259 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 22:48:36.325259 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPLg409tr7TvSv3vpVJ7pZAy05Ygx4yj_4Cip9npAYojDiCGTto525S0CAfnvfNdl4jdPNoClYq1WobXn62Qhi15VpDYJHci-QqepaQ1mYbAxZIDyA277nIASomxn-Yi5SjeetWCU_J-G9wIL43qqaMDoJlyz4Neg03Oeyi9--_-iA3Q Oct 04 22:48:36.325259 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 22:48:36.325259 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 22:48:36.325259 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 22:48:36.325259 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 22:48:36.325259 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 22:48:36.325259 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 22:48:36.325259 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: 86c0fc73795743ecb3e49799f7474068 Oct 04 22:48:36.325259 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-392264354 Oct 04 22:48:36.325259 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,admin,member Oct 04 22:48:36.325259 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,admin,member Oct 04 22:48:36.325259 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/86c0fc73795743ecb3e49799f7474068"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_86c0fc73795743ecb3e49799f7474068", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/86c0fc73795743ecb3e49799f7474068"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/86c0fc73795743ecb3e49799f7474068"}]}] Oct 04 22:48:36.325259 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-ServersAdminNegativeTestJSON-392264354 Oct 04 22:48:36.325259 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: 86c0fc73795743ecb3e49799f7474068 Oct 04 22:48:36.325259 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-392264354 Oct 04 22:48:36.325259 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-ServersAdminNegativeTestJSON-392264354-project-admin Oct 04 22:48:36.325259 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 22:48:36.325259 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 22:48:36.325259 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 6cc123483f2a41b59bb004d630f29bec Oct 04 22:48:36.325259 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-ServersAdminNegativeTestJSON-392264354-project-admin Oct 04 22:48:36.325259 n-d-860284-1 devstack@n-api.service[134101]: Oct 04 22:48:36.325259 n-d-860284-1 devstack@n-api.service[134101]: {"resize": {"flavorRef": "1746676474"}} Oct 04 22:48:36.325259 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 22:48:36.325259 n-d-860284-1 devstack@n-api.service[134101]: exception: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 04 22:48:36.325259 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': '43a690fe-d177-426c-aa46-478d5f7aaf39', 'body': {'resize': {'flavorRef': '1746676474'}}} Oct 04 22:48:36.325259 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:48:36.325259 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:48:36.325259 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3878, in _check_quota_for_upsize Oct 04 22:48:36.325259 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Oct 04 22:48:36.325259 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 22:48:36.325259 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 22:48:36.325259 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 04 22:48:36.325259 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc Oct 04 22:48:36.325259 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 04 22:48:36.325259 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 04 22:48:36.325259 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 22:48:36.325259 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 22:48:36.325259 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 04 22:48:36.325259 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 04 22:48:36.325259 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 04 22:48:36.325259 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 04 22:48:36.325259 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Oct 04 22:48:36.325259 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 04 22:48:36.325259 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Oct 04 22:48:36.325259 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:48:36.325259 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:48:36.325259 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:48:36.325259 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:48:36.325259 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 04 22:48:36.325259 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 04 22:48:36.325259 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 04 22:48:36.325259 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 22:48:36.325259 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 04 22:48:36.329318 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 22:48:36.329318 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 04 22:48:36.329318 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 22:48:36.329318 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 22:48:36.329318 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 22:48:36.329318 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 04 22:48:36.329318 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 22:48:36.329318 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 04 22:48:36.329318 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 22:48:36.329318 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4244, in resize Oct 04 22:48:36.329318 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Oct 04 22:48:36.329318 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3896, in _check_quota_for_upsize Oct 04 22:48:36.329318 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 04 22:48:36.329318 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 04 22:48:36.329318 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:48:36.329318 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:48:36.329318 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:48:36.329318 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:48:36.329318 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:48:36.329318 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:48:36.329318 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:48:36.329318 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:48:36.329318 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:48:36.329318 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:48:36.329318 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 22:48:36.329318 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 22:48:36.329318 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 04 22:48:36.329318 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 04 22:48:36.329318 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Oct 04 22:48:36.329318 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 04 22:48:36.329318 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 04 22:48:36.329318 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:48:36.329318 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:48:36.329318 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:48:36.329318 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:48:36.329318 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:48:36.329318 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:48:36.329318 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:48:36.329318 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:48:36.329318 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 04 22:48:36.329318 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:48:36.329318 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-3cbd3c58-ba56-4d87-88f5-186ae6db26b9 tempest-ServersAdminNegativeTestJSON-392264354 tempest-ServersAdminNegativeTestJSON-392264354-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:48:36.329318 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-3cbd3c58-ba56-4d87-88f5-186ae6db26b9 tempest-ServersAdminNegativeTestJSON-392264354 tempest-ServersAdminNegativeTestJSON-392264354-project-admin] 10.222.0.43 "POST /compute/v2.1/servers/43a690fe-d177-426c-aa46-478d5f7aaf39/action" status: 403 len: 118 microversion: 2.1 time: 0.160409 Oct 04 22:48:36.329318 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3941/7059] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 22:48:36 2022] POST /compute/v2.1/servers/43a690fe-d177-426c-aa46-478d5f7aaf39/action => generated 118 bytes in 162 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 04 22:48:36.336119 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-b5a322c8-352c-4738-94cf-e6300b6a237d tempest-ServersAdminNegativeTestJSON-392264354 tempest-ServersAdminNegativeTestJSON-392264354-project-admin] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:48:36.352908 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-b5a322c8-352c-4738-94cf-e6300b6a237d tempest-ServersAdminNegativeTestJSON-392264354 tempest-ServersAdminNegativeTestJSON-392264354-project-admin] 10.222.0.43 "DELETE /compute/v2.1/flavors/1746676474" status: 202 len: 0 microversion: 2.1 time: 0.021116 Oct 04 22:48:36.353458 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3119/7060] 10.222.0.43 () {58 vars in 1161 bytes} [Tue Oct 4 22:48:36 2022] DELETE /compute/v2.1/flavors/1746676474 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 22:48:36.361363 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e96d3e6f-8be8-4a16-9215-b24bb9b5adc4 tempest-ServersAdminNegativeTestJSON-392264354 tempest-ServersAdminNegativeTestJSON-392264354-project-admin] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:48:36.382597 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-e96d3e6f-8be8-4a16-9215-b24bb9b5adc4 tempest-ServersAdminNegativeTestJSON-392264354 tempest-ServersAdminNegativeTestJSON-392264354-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024976 Oct 04 22:48:36.383184 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3942/7061] 10.222.0.43 () {58 vars in 1146 bytes} [Tue Oct 4 22:48:36 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:48:36.403480 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-8a169899-72fb-4c78-a224-93dae516bf6c tempest-ServersAdminNegativeTestJSON-392264354 tempest-ServersAdminNegativeTestJSON-392264354-project-admin] Calling method '.version_select at 0x7fbb2e7794c0>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:48:36.468305 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-8a169899-72fb-4c78-a224-93dae516bf6c tempest-ServersAdminNegativeTestJSON-392264354 tempest-ServersAdminNegativeTestJSON-392264354-project-admin] 10.222.0.43 "GET /compute/v2.1/os-quota-sets/86c0fc73795743ecb3e49799f7474068" status: 200 len: 371 microversion: 2.1 time: 0.068465 Oct 04 22:48:36.468885 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3120/7062] 10.222.0.43 () {58 vars in 1242 bytes} [Tue Oct 4 22:48:36 2022] GET /compute/v2.1/os-quota-sets/86c0fc73795743ecb3e49799f7474068 => generated 371 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:48:36.481211 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-86cd3293-20c8-4df5-b38e-e96af1d4d311 tempest-ServersAdminNegativeTestJSON-392264354 tempest-ServersAdminNegativeTestJSON-392264354-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-1171357970", "id": 992501131, "os-flavor-access:is_public": "True"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:48:36.498915 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-86cd3293-20c8-4df5-b38e-e96af1d4d311 tempest-ServersAdminNegativeTestJSON-392264354 tempest-ServersAdminNegativeTestJSON-392264354-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 434 microversion: 2.1 time: 0.021464 Oct 04 22:48:36.499498 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3943/7063] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 22:48:36 2022] POST /compute/v2.1/flavors => generated 434 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:48:36.511830 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-e1e93199-962c-4ba9-b776-1b5fcc250486 tempest-ServersAdminNegativeTestJSON-392264354 tempest-ServersAdminNegativeTestJSON-392264354-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "992501131"}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:48:36.514173 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-e1e93199-962c-4ba9-b776-1b5fcc250486 tempest-ServersAdminNegativeTestJSON-392264354 tempest-ServersAdminNegativeTestJSON-392264354-project-admin] [instance: 43a690fe-d177-426c-aa46-478d5f7aaf39] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:48:36.520308 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e1e93199-962c-4ba9-b776-1b5fcc250486 tempest-ServersAdminNegativeTestJSON-392264354 tempest-ServersAdminNegativeTestJSON-392264354-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:48:36.520732 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e1e93199-962c-4ba9-b776-1b5fcc250486 tempest-ServersAdminNegativeTestJSON-392264354 tempest-ServersAdminNegativeTestJSON-392264354-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:48:36.521972 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e1e93199-962c-4ba9-b776-1b5fcc250486 tempest-ServersAdminNegativeTestJSON-392264354 tempest-ServersAdminNegativeTestJSON-392264354-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:48:36.522824 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e1e93199-962c-4ba9-b776-1b5fcc250486 tempest-ServersAdminNegativeTestJSON-392264354 tempest-ServersAdminNegativeTestJSON-392264354-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:48:36.523287 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e1e93199-962c-4ba9-b776-1b5fcc250486 tempest-ServersAdminNegativeTestJSON-392264354 tempest-ServersAdminNegativeTestJSON-392264354-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:48:36.523717 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e1e93199-962c-4ba9-b776-1b5fcc250486 tempest-ServersAdminNegativeTestJSON-392264354 tempest-ServersAdminNegativeTestJSON-392264354-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:48:36.612380 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-e1e93199-962c-4ba9-b776-1b5fcc250486 tempest-ServersAdminNegativeTestJSON-392264354 tempest-ServersAdminNegativeTestJSON-392264354-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '6cc123483f2a41b59bb004d630f29bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86c0fc73795743ecb3e49799f7474068', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:48:36.618912 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-e1e93199-962c-4ba9-b776-1b5fcc250486 tempest-ServersAdminNegativeTestJSON-392264354 tempest-ServersAdminNegativeTestJSON-392264354-project-admin] [instance: 43a690fe-d177-426c-aa46-478d5f7aaf39] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-1171357970 {{(pid=134102) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 04 22:48:36.625738 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e1e93199-962c-4ba9-b776-1b5fcc250486 tempest-ServersAdminNegativeTestJSON-392264354 tempest-ServersAdminNegativeTestJSON-392264354-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:48:36.626221 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e1e93199-962c-4ba9-b776-1b5fcc250486 tempest-ServersAdminNegativeTestJSON-392264354 tempest-ServersAdminNegativeTestJSON-392264354-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:48:36.626694 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e1e93199-962c-4ba9-b776-1b5fcc250486 tempest-ServersAdminNegativeTestJSON-392264354 tempest-ServersAdminNegativeTestJSON-392264354-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:48:36.627430 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e1e93199-962c-4ba9-b776-1b5fcc250486 tempest-ServersAdminNegativeTestJSON-392264354 tempest-ServersAdminNegativeTestJSON-392264354-project-admin] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:48:36.627879 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e1e93199-962c-4ba9-b776-1b5fcc250486 tempest-ServersAdminNegativeTestJSON-392264354 tempest-ServersAdminNegativeTestJSON-392264354-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:48:36.628302 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e1e93199-962c-4ba9-b776-1b5fcc250486 tempest-ServersAdminNegativeTestJSON-392264354 tempest-ServersAdminNegativeTestJSON-392264354-project-admin] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:48:36.649705 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-e1e93199-962c-4ba9-b776-1b5fcc250486 tempest-ServersAdminNegativeTestJSON-392264354 tempest-ServersAdminNegativeTestJSON-392264354-project-admin] Getting quotas for project 7d553f807772435eaeba3fe2bf545172. Resources: {'ram', 'cores'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:48:36.654652 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-e1e93199-962c-4ba9-b776-1b5fcc250486 tempest-ServersAdminNegativeTestJSON-392264354 tempest-ServersAdminNegativeTestJSON-392264354-project-admin] Getting quotas for user e1d2e25fe9104b2b9dd13eab371764f8 and project 7d553f807772435eaeba3fe2bf545172. Resources: {'ram', 'cores'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:48:36.666678 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.compute.api [None req-e1e93199-962c-4ba9-b776-1b5fcc250486 tempest-ServersAdminNegativeTestJSON-392264354 tempest-ServersAdminNegativeTestJSON-392264354-project-admin] cores quota exceeded for 86c0fc73795743ecb3e49799f7474068, tried to resize instance. Oct 04 22:48:36.667230 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-e1e93199-962c-4ba9-b776-1b5fcc250486 tempest-ServersAdminNegativeTestJSON-392264354 tempest-ServersAdminNegativeTestJSON-392264354-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 04 22:48:36.669277 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-e1e93199-962c-4ba9-b776-1b5fcc250486 tempest-ServersAdminNegativeTestJSON-392264354 tempest-ServersAdminNegativeTestJSON-392264354-project-admin] Request method failure captured: Oct 04 22:48:36.669277 n-d-860284-1 devstack@n-api.service[134102]: request: POST /compute/v2.1/servers/43a690fe-d177-426c-aa46-478d5f7aaf39/action HTTP/1.1 Oct 04 22:48:36.669277 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 22:48:36.669277 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 22:48:36.669277 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 22:48:36.669277 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 38 Oct 04 22:48:36.669277 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 22:48:36.669277 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 22:48:36.669277 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 22:48:36.669277 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 22:48:36.669277 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPLg409tr7TvSv3vpVJ7pZAy05Ygx4yj_4Cip9npAYojDiCGTto525S0CAfnvfNdl4jdPNoClYq1WobXn62Qhi15VpDYJHci-QqepaQ1mYbAxZIDyA277nIASomxn-Yi5SjeetWCU_J-G9wIL43qqaMDoJlyz4Neg03Oeyi9--_-iA3Q Oct 04 22:48:36.669277 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 22:48:36.669277 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 22:48:36.669277 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 22:48:36.669277 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 22:48:36.669277 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 22:48:36.669277 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 22:48:36.669277 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: 86c0fc73795743ecb3e49799f7474068 Oct 04 22:48:36.669277 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-392264354 Oct 04 22:48:36.669277 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,admin,member Oct 04 22:48:36.669277 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,admin,member Oct 04 22:48:36.669277 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/86c0fc73795743ecb3e49799f7474068"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_86c0fc73795743ecb3e49799f7474068", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/86c0fc73795743ecb3e49799f7474068"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/86c0fc73795743ecb3e49799f7474068"}]}] Oct 04 22:48:36.669277 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-ServersAdminNegativeTestJSON-392264354 Oct 04 22:48:36.669277 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: 86c0fc73795743ecb3e49799f7474068 Oct 04 22:48:36.669277 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-392264354 Oct 04 22:48:36.669277 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-ServersAdminNegativeTestJSON-392264354-project-admin Oct 04 22:48:36.669277 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 22:48:36.669277 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 22:48:36.669277 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: 6cc123483f2a41b59bb004d630f29bec Oct 04 22:48:36.669277 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-ServersAdminNegativeTestJSON-392264354-project-admin Oct 04 22:48:36.669277 n-d-860284-1 devstack@n-api.service[134102]: Oct 04 22:48:36.669277 n-d-860284-1 devstack@n-api.service[134102]: {"resize": {"flavorRef": "992501131"}} Oct 04 22:48:36.669277 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 22:48:36.669277 n-d-860284-1 devstack@n-api.service[134102]: exception: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 04 22:48:36.669277 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': '43a690fe-d177-426c-aa46-478d5f7aaf39', 'body': {'resize': {'flavorRef': '992501131'}}} Oct 04 22:48:36.669277 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:48:36.669277 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:48:36.669277 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3878, in _check_quota_for_upsize Oct 04 22:48:36.669277 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Oct 04 22:48:36.669277 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 22:48:36.669277 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 22:48:36.669277 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 04 22:48:36.669277 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc Oct 04 22:48:36.669277 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 04 22:48:36.669277 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 04 22:48:36.669277 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 22:48:36.669277 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 22:48:36.669277 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 04 22:48:36.669277 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 04 22:48:36.669277 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 04 22:48:36.669277 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 04 22:48:36.669277 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Oct 04 22:48:36.669277 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 04 22:48:36.669277 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Oct 04 22:48:36.669277 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:48:36.669277 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:48:36.669277 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:48:36.669277 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:48:36.669277 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 04 22:48:36.669277 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 04 22:48:36.669277 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 04 22:48:36.669277 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 22:48:36.669277 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 04 22:48:36.673752 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 22:48:36.673752 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 04 22:48:36.673752 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 22:48:36.673752 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 22:48:36.673752 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 22:48:36.673752 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 04 22:48:36.673752 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 22:48:36.673752 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 04 22:48:36.673752 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 22:48:36.673752 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4244, in resize Oct 04 22:48:36.673752 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Oct 04 22:48:36.673752 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3896, in _check_quota_for_upsize Oct 04 22:48:36.673752 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 04 22:48:36.673752 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 04 22:48:36.673752 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:48:36.673752 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:48:36.673752 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:48:36.673752 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:48:36.673752 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:48:36.673752 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:48:36.673752 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:48:36.673752 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:48:36.673752 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:48:36.673752 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:48:36.673752 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 22:48:36.673752 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 22:48:36.673752 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 04 22:48:36.673752 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 04 22:48:36.673752 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Oct 04 22:48:36.673752 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 04 22:48:36.673752 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 04 22:48:36.673752 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:48:36.673752 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:48:36.673752 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:48:36.673752 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:48:36.673752 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:48:36.673752 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:48:36.673752 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:48:36.673752 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:48:36.673752 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 04 22:48:36.673752 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:48:36.673752 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-e1e93199-962c-4ba9-b776-1b5fcc250486 tempest-ServersAdminNegativeTestJSON-392264354 tempest-ServersAdminNegativeTestJSON-392264354-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:48:36.673752 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-e1e93199-962c-4ba9-b776-1b5fcc250486 tempest-ServersAdminNegativeTestJSON-392264354 tempest-ServersAdminNegativeTestJSON-392264354-project-admin] 10.222.0.43 "POST /compute/v2.1/servers/43a690fe-d177-426c-aa46-478d5f7aaf39/action" status: 403 len: 113 microversion: 2.1 time: 0.162839 Oct 04 22:48:36.673752 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3121/7064] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 22:48:36 2022] POST /compute/v2.1/servers/43a690fe-d177-426c-aa46-478d5f7aaf39/action => generated 113 bytes in 164 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:48:36.679665 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-6db0872e-1246-40dc-9325-55fceff7103a tempest-ServersAdminNegativeTestJSON-392264354 tempest-ServersAdminNegativeTestJSON-392264354-project-admin] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:48:36.697413 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-6db0872e-1246-40dc-9325-55fceff7103a tempest-ServersAdminNegativeTestJSON-392264354 tempest-ServersAdminNegativeTestJSON-392264354-project-admin] 10.222.0.43 "DELETE /compute/v2.1/flavors/992501131" status: 202 len: 0 microversion: 2.1 time: 0.021676 Oct 04 22:48:36.698014 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3944/7065] 10.222.0.43 () {58 vars in 1158 bytes} [Tue Oct 4 22:48:36 2022] DELETE /compute/v2.1/flavors/992501131 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 22:48:36.705744 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-82d259ec-ee94-4f1b-a024-2fb82348a195 tempest-ServersAdminNegativeTestJSON-392264354 tempest-ServersAdminNegativeTestJSON-392264354-project-admin] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:48:36.727285 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-82d259ec-ee94-4f1b-a024-2fb82348a195 tempest-ServersAdminNegativeTestJSON-392264354 tempest-ServersAdminNegativeTestJSON-392264354-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.025131 Oct 04 22:48:36.727832 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3122/7066] 10.222.0.43 () {58 vars in 1146 bytes} [Tue Oct 4 22:48:36 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:48:36.748169 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-769b15c4-9973-42fd-928b-8d00ae407c0f tempest-ServersAdminNegativeTestJSON-508526888 tempest-ServersAdminNegativeTestJSON-508526888-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:48:36.748684 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-769b15c4-9973-42fd-928b-8d00ae407c0f tempest-ServersAdminNegativeTestJSON-508526888 tempest-ServersAdminNegativeTestJSON-508526888-project] [instance: 43a690fe-d177-426c-aa46-478d5f7aaf39] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:48:36.754895 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-769b15c4-9973-42fd-928b-8d00ae407c0f tempest-ServersAdminNegativeTestJSON-508526888 tempest-ServersAdminNegativeTestJSON-508526888-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:48:36.755952 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-769b15c4-9973-42fd-928b-8d00ae407c0f tempest-ServersAdminNegativeTestJSON-508526888 tempest-ServersAdminNegativeTestJSON-508526888-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:48:36.756409 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-769b15c4-9973-42fd-928b-8d00ae407c0f tempest-ServersAdminNegativeTestJSON-508526888 tempest-ServersAdminNegativeTestJSON-508526888-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:48:36.757112 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-769b15c4-9973-42fd-928b-8d00ae407c0f tempest-ServersAdminNegativeTestJSON-508526888 tempest-ServersAdminNegativeTestJSON-508526888-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:48:36.757579 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-769b15c4-9973-42fd-928b-8d00ae407c0f tempest-ServersAdminNegativeTestJSON-508526888 tempest-ServersAdminNegativeTestJSON-508526888-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:48:36.758017 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-769b15c4-9973-42fd-928b-8d00ae407c0f tempest-ServersAdminNegativeTestJSON-508526888 tempest-ServersAdminNegativeTestJSON-508526888-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:48:36.783332 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-769b15c4-9973-42fd-928b-8d00ae407c0f tempest-ServersAdminNegativeTestJSON-508526888 tempest-ServersAdminNegativeTestJSON-508526888-project] [instance: 43a690fe-d177-426c-aa46-478d5f7aaf39] Going to try to terminate instance {{(pid=134101) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 22:48:36.859647 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-769b15c4-9973-42fd-928b-8d00ae407c0f tempest-ServersAdminNegativeTestJSON-508526888 tempest-ServersAdminNegativeTestJSON-508526888-project] 10.222.0.43 "DELETE /compute/v2.1/servers/43a690fe-d177-426c-aa46-478d5f7aaf39" status: 204 len: 0 microversion: 2.1 time: 0.115036 Oct 04 22:48:36.860485 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3945/7067] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 22:48:36 2022] DELETE /compute/v2.1/servers/43a690fe-d177-426c-aa46-478d5f7aaf39 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 22:48:36.868835 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-7a89107c-c692-46e0-beff-b2c75eec0bec tempest-ServersAdminNegativeTestJSON-508526888 tempest-ServersAdminNegativeTestJSON-508526888-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:48:36.869489 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-7a89107c-c692-46e0-beff-b2c75eec0bec tempest-ServersAdminNegativeTestJSON-508526888 tempest-ServersAdminNegativeTestJSON-508526888-project] [instance: 43a690fe-d177-426c-aa46-478d5f7aaf39] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:48:36.876635 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7a89107c-c692-46e0-beff-b2c75eec0bec tempest-ServersAdminNegativeTestJSON-508526888 tempest-ServersAdminNegativeTestJSON-508526888-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:48:36.877125 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7a89107c-c692-46e0-beff-b2c75eec0bec tempest-ServersAdminNegativeTestJSON-508526888 tempest-ServersAdminNegativeTestJSON-508526888-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:48:36.877571 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7a89107c-c692-46e0-beff-b2c75eec0bec tempest-ServersAdminNegativeTestJSON-508526888 tempest-ServersAdminNegativeTestJSON-508526888-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:48:36.878270 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7a89107c-c692-46e0-beff-b2c75eec0bec tempest-ServersAdminNegativeTestJSON-508526888 tempest-ServersAdminNegativeTestJSON-508526888-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:48:36.878766 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7a89107c-c692-46e0-beff-b2c75eec0bec tempest-ServersAdminNegativeTestJSON-508526888 tempest-ServersAdminNegativeTestJSON-508526888-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:48:36.879201 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7a89107c-c692-46e0-beff-b2c75eec0bec tempest-ServersAdminNegativeTestJSON-508526888 tempest-ServersAdminNegativeTestJSON-508526888-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:48:37.007977 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-7a89107c-c692-46e0-beff-b2c75eec0bec tempest-ServersAdminNegativeTestJSON-508526888 tempest-ServersAdminNegativeTestJSON-508526888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1d2e25fe9104b2b9dd13eab371764f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d553f807772435eaeba3fe2bf545172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:48:37.015746 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-7a89107c-c692-46e0-beff-b2c75eec0bec tempest-ServersAdminNegativeTestJSON-508526888 tempest-ServersAdminNegativeTestJSON-508526888-project] 10.222.0.43 "GET /compute/v2.1/servers/43a690fe-d177-426c-aa46-478d5f7aaf39" status: 200 len: 1477 microversion: 2.1 time: 0.150875 Oct 04 22:48:37.016355 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3123/7068] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:48:36 2022] GET /compute/v2.1/servers/43a690fe-d177-426c-aa46-478d5f7aaf39 => generated 1477 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:48:38.039878 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-331d23df-1462-466b-bc29-6080ef20d2bd tempest-ServersAdminNegativeTestJSON-508526888 tempest-ServersAdminNegativeTestJSON-508526888-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:48:38.040688 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-331d23df-1462-466b-bc29-6080ef20d2bd tempest-ServersAdminNegativeTestJSON-508526888 tempest-ServersAdminNegativeTestJSON-508526888-project] [instance: 43a690fe-d177-426c-aa46-478d5f7aaf39] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:48:38.047728 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-331d23df-1462-466b-bc29-6080ef20d2bd tempest-ServersAdminNegativeTestJSON-508526888 tempest-ServersAdminNegativeTestJSON-508526888-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:48:38.048245 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-331d23df-1462-466b-bc29-6080ef20d2bd tempest-ServersAdminNegativeTestJSON-508526888 tempest-ServersAdminNegativeTestJSON-508526888-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:48:38.048708 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-331d23df-1462-466b-bc29-6080ef20d2bd tempest-ServersAdminNegativeTestJSON-508526888 tempest-ServersAdminNegativeTestJSON-508526888-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:48:38.049437 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-331d23df-1462-466b-bc29-6080ef20d2bd tempest-ServersAdminNegativeTestJSON-508526888 tempest-ServersAdminNegativeTestJSON-508526888-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:48:38.049920 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-331d23df-1462-466b-bc29-6080ef20d2bd tempest-ServersAdminNegativeTestJSON-508526888 tempest-ServersAdminNegativeTestJSON-508526888-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:48:38.050390 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-331d23df-1462-466b-bc29-6080ef20d2bd tempest-ServersAdminNegativeTestJSON-508526888 tempest-ServersAdminNegativeTestJSON-508526888-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:48:38.187580 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-331d23df-1462-466b-bc29-6080ef20d2bd tempest-ServersAdminNegativeTestJSON-508526888 tempest-ServersAdminNegativeTestJSON-508526888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1d2e25fe9104b2b9dd13eab371764f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d553f807772435eaeba3fe2bf545172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:48:38.196107 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-331d23df-1462-466b-bc29-6080ef20d2bd tempest-ServersAdminNegativeTestJSON-508526888 tempest-ServersAdminNegativeTestJSON-508526888-project] 10.222.0.43 "GET /compute/v2.1/servers/43a690fe-d177-426c-aa46-478d5f7aaf39" status: 200 len: 1477 microversion: 2.1 time: 0.161408 Oct 04 22:48:38.196684 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3946/7069] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:48:38 2022] GET /compute/v2.1/servers/43a690fe-d177-426c-aa46-478d5f7aaf39 => generated 1477 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:48:38.791386 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-873c9e5c-be65-4ec8-86ed-a4ae9ece1b20 req-b1ccc6f7-31e1-4d04-8e40-c1affe912c9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43a690fe-d177-426c-aa46-478d5f7aaf39", "name": "network-vif-deleted", "tag": "b85d96d1-318a-4eb0-9114-5645646bc21b"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:48:38.804136 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-873c9e5c-be65-4ec8-86ed-a4ae9ece1b20 req-b1ccc6f7-31e1-4d04-8e40-c1affe912c9f service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:48:38.804809 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-873c9e5c-be65-4ec8-86ed-a4ae9ece1b20 req-b1ccc6f7-31e1-4d04-8e40-c1affe912c9f service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:48:38.805336 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-873c9e5c-be65-4ec8-86ed-a4ae9ece1b20 req-b1ccc6f7-31e1-4d04-8e40-c1affe912c9f service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:48:38.817960 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-873c9e5c-be65-4ec8-86ed-a4ae9ece1b20 req-b1ccc6f7-31e1-4d04-8e40-c1affe912c9f service nova] Creating event network-vif-deleted:b85d96d1-318a-4eb0-9114-5645646bc21b for instance 43a690fe-d177-426c-aa46-478d5f7aaf39 on n-h1-860284-1 Oct 04 22:48:38.823924 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-873c9e5c-be65-4ec8-86ed-a4ae9ece1b20 req-b1ccc6f7-31e1-4d04-8e40-c1affe912c9f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036248 Oct 04 22:48:38.824632 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3124/7070] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:48:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:48:39.219724 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-0154a035-e896-4423-94dd-c4aa4188468e tempest-ServersAdminNegativeTestJSON-508526888 tempest-ServersAdminNegativeTestJSON-508526888-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:48:39.220370 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-0154a035-e896-4423-94dd-c4aa4188468e tempest-ServersAdminNegativeTestJSON-508526888 tempest-ServersAdminNegativeTestJSON-508526888-project] [instance: 43a690fe-d177-426c-aa46-478d5f7aaf39] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:48:39.228455 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0154a035-e896-4423-94dd-c4aa4188468e tempest-ServersAdminNegativeTestJSON-508526888 tempest-ServersAdminNegativeTestJSON-508526888-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:48:39.228987 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0154a035-e896-4423-94dd-c4aa4188468e tempest-ServersAdminNegativeTestJSON-508526888 tempest-ServersAdminNegativeTestJSON-508526888-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:48:39.229484 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0154a035-e896-4423-94dd-c4aa4188468e tempest-ServersAdminNegativeTestJSON-508526888 tempest-ServersAdminNegativeTestJSON-508526888-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:48:39.230283 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0154a035-e896-4423-94dd-c4aa4188468e tempest-ServersAdminNegativeTestJSON-508526888 tempest-ServersAdminNegativeTestJSON-508526888-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:48:39.230930 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0154a035-e896-4423-94dd-c4aa4188468e tempest-ServersAdminNegativeTestJSON-508526888 tempest-ServersAdminNegativeTestJSON-508526888-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:48:39.231381 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0154a035-e896-4423-94dd-c4aa4188468e tempest-ServersAdminNegativeTestJSON-508526888 tempest-ServersAdminNegativeTestJSON-508526888-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:48:39.263888 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0154a035-e896-4423-94dd-c4aa4188468e tempest-ServersAdminNegativeTestJSON-508526888 tempest-ServersAdminNegativeTestJSON-508526888-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:48:39.264391 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0154a035-e896-4423-94dd-c4aa4188468e tempest-ServersAdminNegativeTestJSON-508526888 tempest-ServersAdminNegativeTestJSON-508526888-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:48:39.264852 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0154a035-e896-4423-94dd-c4aa4188468e tempest-ServersAdminNegativeTestJSON-508526888 tempest-ServersAdminNegativeTestJSON-508526888-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:48:39.265329 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.objects.instance [None req-0154a035-e896-4423-94dd-c4aa4188468e tempest-ServersAdminNegativeTestJSON-508526888 tempest-ServersAdminNegativeTestJSON-508526888-project] Lazy-loading 'fault' on Instance uuid 43a690fe-d177-426c-aa46-478d5f7aaf39 {{(pid=134101) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 22:48:39.314421 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-0154a035-e896-4423-94dd-c4aa4188468e tempest-ServersAdminNegativeTestJSON-508526888 tempest-ServersAdminNegativeTestJSON-508526888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1d2e25fe9104b2b9dd13eab371764f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d553f807772435eaeba3fe2bf545172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:48:39.322539 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-0154a035-e896-4423-94dd-c4aa4188468e tempest-ServersAdminNegativeTestJSON-508526888 tempest-ServersAdminNegativeTestJSON-508526888-project] 10.222.0.43 "GET /compute/v2.1/servers/43a690fe-d177-426c-aa46-478d5f7aaf39" status: 200 len: 1312 microversion: 2.1 time: 0.106772 Oct 04 22:48:39.323150 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3947/7071] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:48:39 2022] GET /compute/v2.1/servers/43a690fe-d177-426c-aa46-478d5f7aaf39 => generated 1312 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:48:40.347823 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-01e48490-b33c-441a-8764-0cbfdf04c487 tempest-ServersAdminNegativeTestJSON-508526888 tempest-ServersAdminNegativeTestJSON-508526888-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:48:40.348526 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-01e48490-b33c-441a-8764-0cbfdf04c487 tempest-ServersAdminNegativeTestJSON-508526888 tempest-ServersAdminNegativeTestJSON-508526888-project] [instance: 43a690fe-d177-426c-aa46-478d5f7aaf39] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:48:40.355493 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-01e48490-b33c-441a-8764-0cbfdf04c487 tempest-ServersAdminNegativeTestJSON-508526888 tempest-ServersAdminNegativeTestJSON-508526888-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:48:40.355982 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-01e48490-b33c-441a-8764-0cbfdf04c487 tempest-ServersAdminNegativeTestJSON-508526888 tempest-ServersAdminNegativeTestJSON-508526888-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:48:40.356420 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-01e48490-b33c-441a-8764-0cbfdf04c487 tempest-ServersAdminNegativeTestJSON-508526888 tempest-ServersAdminNegativeTestJSON-508526888-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:48:40.357112 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-01e48490-b33c-441a-8764-0cbfdf04c487 tempest-ServersAdminNegativeTestJSON-508526888 tempest-ServersAdminNegativeTestJSON-508526888-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:48:40.357567 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-01e48490-b33c-441a-8764-0cbfdf04c487 tempest-ServersAdminNegativeTestJSON-508526888 tempest-ServersAdminNegativeTestJSON-508526888-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:48:40.357995 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-01e48490-b33c-441a-8764-0cbfdf04c487 tempest-ServersAdminNegativeTestJSON-508526888 tempest-ServersAdminNegativeTestJSON-508526888-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:48:40.373004 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-01e48490-b33c-441a-8764-0cbfdf04c487 tempest-ServersAdminNegativeTestJSON-508526888 tempest-ServersAdminNegativeTestJSON-508526888-project] HTTP exception thrown: Instance 43a690fe-d177-426c-aa46-478d5f7aaf39 could not be found. Oct 04 22:48:40.374975 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-01e48490-b33c-441a-8764-0cbfdf04c487 tempest-ServersAdminNegativeTestJSON-508526888 tempest-ServersAdminNegativeTestJSON-508526888-project] Request method failure captured: Oct 04 22:48:40.374975 n-d-860284-1 devstack@n-api.service[134102]: request: GET /compute/v2.1/servers/43a690fe-d177-426c-aa46-478d5f7aaf39 HTTP/1.1 Oct 04 22:48:40.374975 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 22:48:40.374975 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 22:48:40.374975 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 22:48:40.374975 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 22:48:40.374975 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 22:48:40.374975 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 22:48:40.374975 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 22:48:40.374975 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 22:48:40.374975 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPLg4g8DDxhrjVcjFP1a8K7nA4P8-Lvv-yMsQIyVHbyhPOoDV14LfwXQShZ8kAn_0KspxF-UKWi2Y8JUX9wAtH9B3-SvvtJqGmgxXclnMZrpAJVox7FGbYundN6nSkEEJHpGeuMWgNG8HuuEPXr2GufqQAO2ZPkrNXoSD1xwITsKeK94 Oct 04 22:48:40.374975 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 22:48:40.374975 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 22:48:40.374975 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 22:48:40.374975 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 22:48:40.374975 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 22:48:40.374975 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 22:48:40.374975 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: 7d553f807772435eaeba3fe2bf545172 Oct 04 22:48:40.374975 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-508526888 Oct 04 22:48:40.374975 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 22:48:40.374975 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 22:48:40.374975 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/7d553f807772435eaeba3fe2bf545172"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_7d553f807772435eaeba3fe2bf545172", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/7d553f807772435eaeba3fe2bf545172"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/7d553f807772435eaeba3fe2bf545172"}]}] Oct 04 22:48:40.374975 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-ServersAdminNegativeTestJSON-508526888 Oct 04 22:48:40.374975 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: 7d553f807772435eaeba3fe2bf545172 Oct 04 22:48:40.374975 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-508526888 Oct 04 22:48:40.374975 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-ServersAdminNegativeTestJSON-508526888-project Oct 04 22:48:40.374975 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 22:48:40.374975 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 22:48:40.374975 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: e1d2e25fe9104b2b9dd13eab371764f8 Oct 04 22:48:40.374975 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-ServersAdminNegativeTestJSON-508526888-project Oct 04 22:48:40.374975 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 22:48:40.374975 n-d-860284-1 devstack@n-api.service[134102]: exception: Instance 43a690fe-d177-426c-aa46-478d5f7aaf39 could not be found. Oct 04 22:48:40.374975 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': '43a690fe-d177-426c-aa46-478d5f7aaf39'} Oct 04 22:48:40.374975 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:48:40.374975 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:48:40.374975 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:48:40.374975 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:48:40.374975 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:48:40.374975 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:48:40.374975 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:48:40.374975 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:48:40.374975 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:48:40.374975 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:48:40.374975 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43a690fe-d177-426c-aa46-478d5f7aaf39 could not be found. Oct 04 22:48:40.374975 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:48:40.374975 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:48:40.374975 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:48:40.374975 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:48:40.374975 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:48:40.374975 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:48:40.374975 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:48:40.374975 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:48:40.374975 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:48:40.374975 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:48:40.374975 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:48:40.374975 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:48:40.374975 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:48:40.374975 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:48:40.374975 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:48:40.374975 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:48:40.374975 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43a690fe-d177-426c-aa46-478d5f7aaf39 could not be found. Oct 04 22:48:40.374975 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:48:40.374975 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:48:40.379085 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:48:40.379085 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:48:40.379085 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:48:40.379085 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:48:40.379085 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:48:40.379085 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:48:40.379085 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43a690fe-d177-426c-aa46-478d5f7aaf39 could not be found. Oct 04 22:48:40.379085 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:48:40.379085 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-01e48490-b33c-441a-8764-0cbfdf04c487 tempest-ServersAdminNegativeTestJSON-508526888 tempest-ServersAdminNegativeTestJSON-508526888-project] Returning 404 to user: Instance 43a690fe-d177-426c-aa46-478d5f7aaf39 could not be found. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:48:40.379085 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-01e48490-b33c-441a-8764-0cbfdf04c487 tempest-ServersAdminNegativeTestJSON-508526888 tempest-ServersAdminNegativeTestJSON-508526888-project] 10.222.0.43 "GET /compute/v2.1/servers/43a690fe-d177-426c-aa46-478d5f7aaf39" status: 404 len: 111 microversion: 2.1 time: 0.034030 Oct 04 22:48:40.379085 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3125/7072] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:48:40 2022] GET /compute/v2.1/servers/43a690fe-d177-426c-aa46-478d5f7aaf39 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:48:46.540455 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=2 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:48:46.541290 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=3 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:48:46.679855 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-fcde0860-84e3-42b7-bc94-d5dd5609b45d tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-253249951", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452", "networks": [{"uuid": "7e658488-d04b-4212-887a-22fd43b6077d"}]}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:48:46.741811 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.network.neutron [None req-fcde0860-84e3-42b7-bc94-d5dd5609b45d tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] validate_networks() for [('7e658488-d04b-4212-887a-22fd43b6077d', None, None, None, None, None)] {{(pid=134101) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 22:48:47.133838 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-fcde0860-84e3-42b7-bc94-d5dd5609b45d tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Flavor limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 22:48:47.134291 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-fcde0860-84e3-42b7-bc94-d5dd5609b45d tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Image limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 22:48:47.134821 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-fcde0860-84e3-42b7-bc94-d5dd5609b45d tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Flavor pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 22:48:47.135260 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-fcde0860-84e3-42b7-bc94-d5dd5609b45d tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Image pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 22:48:47.135705 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-fcde0860-84e3-42b7-bc94-d5dd5609b45d tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 22:48:47.144784 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fcde0860-84e3-42b7-bc94-d5dd5609b45d tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:48:47.145292 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fcde0860-84e3-42b7-bc94-d5dd5609b45d tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:48:47.146466 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fcde0860-84e3-42b7-bc94-d5dd5609b45d tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:48:47.147250 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fcde0860-84e3-42b7-bc94-d5dd5609b45d tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:48:47.147730 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fcde0860-84e3-42b7-bc94-d5dd5609b45d tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:48:47.148186 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fcde0860-84e3-42b7-bc94-d5dd5609b45d tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:48:47.165978 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-fcde0860-84e3-42b7-bc94-d5dd5609b45d tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Getting quotas for project b2ae75103a974b01a05a640ff62ac845. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:48:47.171461 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-fcde0860-84e3-42b7-bc94-d5dd5609b45d tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Getting quotas for user d9693ac87d6645c78684949d36cc1066 and project b2ae75103a974b01a05a640ff62ac845. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:48:47.185297 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-fcde0860-84e3-42b7-bc94-d5dd5609b45d tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Going to run 1 instances... {{(pid=134101) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 22:48:47.187744 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-fcde0860-84e3-42b7-bc94-d5dd5609b45d tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] [instance: a88193d1-d83f-49ec-bfad-753c00487b55] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='58548514-5dac-426c-81f5-19e3fba33e23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134101) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 22:48:47.234432 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-fcde0860-84e3-42b7-bc94-d5dd5609b45d tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.699916 Oct 04 22:48:47.235098 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3948/7073] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 22:48:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 701 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 22:48:47.246353 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-a5167c38-431e-4c04-825b-6a5d68cf8176 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:48:47.247091 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-a5167c38-431e-4c04-825b-6a5d68cf8176 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] [instance: a88193d1-d83f-49ec-bfad-753c00487b55] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:48:47.250060 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell0:SELECT=2 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:48:47.251035 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell0:SELECT=3 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:48:47.308554 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-a5167c38-431e-4c04-825b-6a5d68cf8176 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9693ac87d6645c78684949d36cc1066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ae75103a974b01a05a640ff62ac845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:48:47.316437 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-a5167c38-431e-4c04-825b-6a5d68cf8176 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] 10.222.0.43 "GET /compute/v2.1/servers/a88193d1-d83f-49ec-bfad-753c00487b55" status: 200 len: 1214 microversion: 2.1 time: 0.074022 Oct 04 22:48:47.317034 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3126/7074] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:48:47 2022] GET /compute/v2.1/servers/a88193d1-d83f-49ec-bfad-753c00487b55 => generated 1214 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:48:48.342001 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-ff9f3391-a5c2-45f0-897a-63fda38009b3 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:48:48.342667 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-ff9f3391-a5c2-45f0-897a-63fda38009b3 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] [instance: a88193d1-d83f-49ec-bfad-753c00487b55] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:48:48.350545 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ff9f3391-a5c2-45f0-897a-63fda38009b3 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:48:48.351329 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ff9f3391-a5c2-45f0-897a-63fda38009b3 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:48:48.352715 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ff9f3391-a5c2-45f0-897a-63fda38009b3 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:48:48.353663 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ff9f3391-a5c2-45f0-897a-63fda38009b3 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:48:48.354957 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ff9f3391-a5c2-45f0-897a-63fda38009b3 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:48:48.355675 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ff9f3391-a5c2-45f0-897a-63fda38009b3 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:48:48.435758 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-ff9f3391-a5c2-45f0-897a-63fda38009b3 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9693ac87d6645c78684949d36cc1066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ae75103a974b01a05a640ff62ac845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:48:48.444620 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-ff9f3391-a5c2-45f0-897a-63fda38009b3 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] 10.222.0.43 "GET /compute/v2.1/servers/a88193d1-d83f-49ec-bfad-753c00487b55" status: 200 len: 1274 microversion: 2.1 time: 0.107874 Oct 04 22:48:48.445230 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3949/7075] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:48:48 2022] GET /compute/v2.1/servers/a88193d1-d83f-49ec-bfad-753c00487b55 => generated 1274 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:48:49.468910 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-88f1768c-d407-437e-a1cf-760f7cf1afdc tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:48:49.469541 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-88f1768c-d407-437e-a1cf-760f7cf1afdc tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] [instance: a88193d1-d83f-49ec-bfad-753c00487b55] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:48:49.477894 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-88f1768c-d407-437e-a1cf-760f7cf1afdc tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:48:49.481057 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-88f1768c-d407-437e-a1cf-760f7cf1afdc tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:48:49.481199 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-88f1768c-d407-437e-a1cf-760f7cf1afdc tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:48:49.482146 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-88f1768c-d407-437e-a1cf-760f7cf1afdc tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:48:49.482660 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-88f1768c-d407-437e-a1cf-760f7cf1afdc tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:48:49.483089 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-88f1768c-d407-437e-a1cf-760f7cf1afdc tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:48:49.651736 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-88f1768c-d407-437e-a1cf-760f7cf1afdc tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9693ac87d6645c78684949d36cc1066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ae75103a974b01a05a640ff62ac845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:48:49.663999 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-88f1768c-d407-437e-a1cf-760f7cf1afdc tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] 10.222.0.43 "GET /compute/v2.1/servers/a88193d1-d83f-49ec-bfad-753c00487b55" status: 200 len: 1314 microversion: 2.1 time: 0.198972 Oct 04 22:48:49.665216 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3127/7076] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:48:49 2022] GET /compute/v2.1/servers/a88193d1-d83f-49ec-bfad-753c00487b55 => generated 1314 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:48:50.144189 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-e71894c2-6eea-49ec-a737-e7d144a661f9 req-2cf09234-4424-48c0-80ca-7c79c6879bce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a88193d1-d83f-49ec-bfad-753c00487b55", "tag": "312529db-3de8-4585-a030-c7e37d18055a"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:48:50.158306 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-e71894c2-6eea-49ec-a737-e7d144a661f9 req-2cf09234-4424-48c0-80ca-7c79c6879bce service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:48:50.159015 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-e71894c2-6eea-49ec-a737-e7d144a661f9 req-2cf09234-4424-48c0-80ca-7c79c6879bce service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:48:50.159524 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-e71894c2-6eea-49ec-a737-e7d144a661f9 req-2cf09234-4424-48c0-80ca-7c79c6879bce service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:48:50.181303 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-e71894c2-6eea-49ec-a737-e7d144a661f9 req-2cf09234-4424-48c0-80ca-7c79c6879bce service nova] Creating event network-changed:312529db-3de8-4585-a030-c7e37d18055a for instance a88193d1-d83f-49ec-bfad-753c00487b55 on n-h1-860284-1 Oct 04 22:48:50.187334 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-e71894c2-6eea-49ec-a737-e7d144a661f9 req-2cf09234-4424-48c0-80ca-7c79c6879bce service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047021 Oct 04 22:48:50.188382 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3950/7077] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:48:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:48:50.688526 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-ab6ca2bb-0253-41dc-bf6b-4ae7c24e586d tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:48:50.689182 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-ab6ca2bb-0253-41dc-bf6b-4ae7c24e586d tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] [instance: a88193d1-d83f-49ec-bfad-753c00487b55] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:48:50.696649 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ab6ca2bb-0253-41dc-bf6b-4ae7c24e586d tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:48:50.697135 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ab6ca2bb-0253-41dc-bf6b-4ae7c24e586d tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:48:50.697797 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ab6ca2bb-0253-41dc-bf6b-4ae7c24e586d tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:48:50.698644 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ab6ca2bb-0253-41dc-bf6b-4ae7c24e586d tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:48:50.699362 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ab6ca2bb-0253-41dc-bf6b-4ae7c24e586d tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:48:50.699944 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ab6ca2bb-0253-41dc-bf6b-4ae7c24e586d tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:48:50.836196 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-ab6ca2bb-0253-41dc-bf6b-4ae7c24e586d tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9693ac87d6645c78684949d36cc1066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ae75103a974b01a05a640ff62ac845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:48:50.844189 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-ab6ca2bb-0253-41dc-bf6b-4ae7c24e586d tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] 10.222.0.43 "GET /compute/v2.1/servers/a88193d1-d83f-49ec-bfad-753c00487b55" status: 200 len: 1314 microversion: 2.1 time: 0.160128 Oct 04 22:48:50.844838 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3128/7078] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:48:50 2022] GET /compute/v2.1/servers/a88193d1-d83f-49ec-bfad-753c00487b55 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:48:51.868987 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e23b856f-c65f-4757-bbc2-1cc1c950ccfa tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:48:51.869702 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-e23b856f-c65f-4757-bbc2-1cc1c950ccfa tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] [instance: a88193d1-d83f-49ec-bfad-753c00487b55] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:48:51.877026 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e23b856f-c65f-4757-bbc2-1cc1c950ccfa tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:48:51.877511 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e23b856f-c65f-4757-bbc2-1cc1c950ccfa tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:48:51.877966 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e23b856f-c65f-4757-bbc2-1cc1c950ccfa tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:48:51.878695 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e23b856f-c65f-4757-bbc2-1cc1c950ccfa tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:48:51.879167 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e23b856f-c65f-4757-bbc2-1cc1c950ccfa tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:48:51.879607 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e23b856f-c65f-4757-bbc2-1cc1c950ccfa tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:48:52.021562 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-e23b856f-c65f-4757-bbc2-1cc1c950ccfa tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9693ac87d6645c78684949d36cc1066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ae75103a974b01a05a640ff62ac845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:48:52.029487 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-e23b856f-c65f-4757-bbc2-1cc1c950ccfa tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] 10.222.0.43 "GET /compute/v2.1/servers/a88193d1-d83f-49ec-bfad-753c00487b55" status: 200 len: 1314 microversion: 2.1 time: 0.165439 Oct 04 22:48:52.030061 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3951/7079] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:48:51 2022] GET /compute/v2.1/servers/a88193d1-d83f-49ec-bfad-753c00487b55 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:48:53.054465 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-42a5f243-7027-4234-a995-f25362e3739f tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:48:53.055234 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-42a5f243-7027-4234-a995-f25362e3739f tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] [instance: a88193d1-d83f-49ec-bfad-753c00487b55] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:48:53.062679 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-42a5f243-7027-4234-a995-f25362e3739f tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:48:53.063206 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-42a5f243-7027-4234-a995-f25362e3739f tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:48:53.063695 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-42a5f243-7027-4234-a995-f25362e3739f tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:48:53.064407 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-42a5f243-7027-4234-a995-f25362e3739f tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:48:53.064870 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-42a5f243-7027-4234-a995-f25362e3739f tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:48:53.065330 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-42a5f243-7027-4234-a995-f25362e3739f tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:48:53.200105 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-42a5f243-7027-4234-a995-f25362e3739f tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9693ac87d6645c78684949d36cc1066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ae75103a974b01a05a640ff62ac845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:48:53.208107 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-42a5f243-7027-4234-a995-f25362e3739f tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] 10.222.0.43 "GET /compute/v2.1/servers/a88193d1-d83f-49ec-bfad-753c00487b55" status: 200 len: 1314 microversion: 2.1 time: 0.158521 Oct 04 22:48:53.208634 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3129/7080] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:48:53 2022] GET /compute/v2.1/servers/a88193d1-d83f-49ec-bfad-753c00487b55 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:48:54.232120 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-51e15af4-67da-4591-896e-e02afdce306a tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:48:54.232763 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-51e15af4-67da-4591-896e-e02afdce306a tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] [instance: a88193d1-d83f-49ec-bfad-753c00487b55] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:48:54.239634 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-51e15af4-67da-4591-896e-e02afdce306a tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:48:54.240240 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-51e15af4-67da-4591-896e-e02afdce306a tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:48:54.240706 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-51e15af4-67da-4591-896e-e02afdce306a tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:48:54.241431 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-51e15af4-67da-4591-896e-e02afdce306a tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:48:54.241914 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-51e15af4-67da-4591-896e-e02afdce306a tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:48:54.242383 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-51e15af4-67da-4591-896e-e02afdce306a tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:48:54.382011 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-51e15af4-67da-4591-896e-e02afdce306a tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9693ac87d6645c78684949d36cc1066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ae75103a974b01a05a640ff62ac845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:48:54.389832 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-51e15af4-67da-4591-896e-e02afdce306a tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] 10.222.0.43 "GET /compute/v2.1/servers/a88193d1-d83f-49ec-bfad-753c00487b55" status: 200 len: 1314 microversion: 2.1 time: 0.161714 Oct 04 22:48:54.390422 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3952/7081] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:48:54 2022] GET /compute/v2.1/servers/a88193d1-d83f-49ec-bfad-753c00487b55 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:48:55.413877 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-f1e7090c-fd78-445c-8971-af5b75ad55cd tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:48:55.414441 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-f1e7090c-fd78-445c-8971-af5b75ad55cd tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] [instance: a88193d1-d83f-49ec-bfad-753c00487b55] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:48:55.416791 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=4,nova_api:DELETE=3 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:48:55.422200 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f1e7090c-fd78-445c-8971-af5b75ad55cd tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:48:55.422715 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f1e7090c-fd78-445c-8971-af5b75ad55cd tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:48:55.423160 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f1e7090c-fd78-445c-8971-af5b75ad55cd tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:48:55.423857 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f1e7090c-fd78-445c-8971-af5b75ad55cd tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:48:55.424315 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f1e7090c-fd78-445c-8971-af5b75ad55cd tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:48:55.424752 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f1e7090c-fd78-445c-8971-af5b75ad55cd tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:48:55.430261 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=72 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:48:55.564614 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-f1e7090c-fd78-445c-8971-af5b75ad55cd tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9693ac87d6645c78684949d36cc1066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ae75103a974b01a05a640ff62ac845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:48:55.572540 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-f1e7090c-fd78-445c-8971-af5b75ad55cd tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] 10.222.0.43 "GET /compute/v2.1/servers/a88193d1-d83f-49ec-bfad-753c00487b55" status: 200 len: 1314 microversion: 2.1 time: 0.163333 Oct 04 22:48:55.573138 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3130/7082] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:48:55 2022] GET /compute/v2.1/servers/a88193d1-d83f-49ec-bfad-753c00487b55 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:48:56.286153 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-ebfacdf5-ad9d-4fc1-8678-75049ca4ae23 req-c81a7372-d293-4ffe-bbe9-78d75db73450 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a88193d1-d83f-49ec-bfad-753c00487b55", "name": "network-vif-plugged", "status": "completed", "tag": "312529db-3de8-4585-a030-c7e37d18055a"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:48:56.292229 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=4,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:48:56.299124 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-ebfacdf5-ad9d-4fc1-8678-75049ca4ae23 req-c81a7372-d293-4ffe-bbe9-78d75db73450 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:48:56.299674 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-ebfacdf5-ad9d-4fc1-8678-75049ca4ae23 req-c81a7372-d293-4ffe-bbe9-78d75db73450 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:48:56.300432 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-ebfacdf5-ad9d-4fc1-8678-75049ca4ae23 req-c81a7372-d293-4ffe-bbe9-78d75db73450 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:48:56.306517 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:48:56.317710 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-ebfacdf5-ad9d-4fc1-8678-75049ca4ae23 req-c81a7372-d293-4ffe-bbe9-78d75db73450 service nova] Creating event network-vif-plugged:312529db-3de8-4585-a030-c7e37d18055a for instance a88193d1-d83f-49ec-bfad-753c00487b55 on n-h1-860284-1 Oct 04 22:48:56.323400 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-ebfacdf5-ad9d-4fc1-8678-75049ca4ae23 req-c81a7372-d293-4ffe-bbe9-78d75db73450 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040871 Oct 04 22:48:56.324027 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3953/7083] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:48:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:48:56.595262 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-2fc37361-bf1d-470a-a9af-bba30feaa68a tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:48:56.595972 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-2fc37361-bf1d-470a-a9af-bba30feaa68a tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] [instance: a88193d1-d83f-49ec-bfad-753c00487b55] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:48:56.603227 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2fc37361-bf1d-470a-a9af-bba30feaa68a tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:48:56.603722 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2fc37361-bf1d-470a-a9af-bba30feaa68a tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:48:56.604199 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2fc37361-bf1d-470a-a9af-bba30feaa68a tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:48:56.604977 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2fc37361-bf1d-470a-a9af-bba30feaa68a tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:48:56.605439 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2fc37361-bf1d-470a-a9af-bba30feaa68a tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:48:56.605899 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2fc37361-bf1d-470a-a9af-bba30feaa68a tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:48:56.737780 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-2fc37361-bf1d-470a-a9af-bba30feaa68a tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9693ac87d6645c78684949d36cc1066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ae75103a974b01a05a640ff62ac845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:48:56.746105 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-2fc37361-bf1d-470a-a9af-bba30feaa68a tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] 10.222.0.43 "GET /compute/v2.1/servers/a88193d1-d83f-49ec-bfad-753c00487b55" status: 200 len: 1314 microversion: 2.1 time: 0.154910 Oct 04 22:48:56.746723 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3131/7084] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:48:56 2022] GET /compute/v2.1/servers/a88193d1-d83f-49ec-bfad-753c00487b55 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:48:57.772060 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-5b01df22-1773-4d37-bc1f-7b1776c7dc7d tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:48:57.772988 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-5b01df22-1773-4d37-bc1f-7b1776c7dc7d tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] [instance: a88193d1-d83f-49ec-bfad-753c00487b55] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:48:57.775807 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=2 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:48:57.776698 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=6 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:48:57.787318 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5b01df22-1773-4d37-bc1f-7b1776c7dc7d tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:48:57.787875 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5b01df22-1773-4d37-bc1f-7b1776c7dc7d tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:48:57.788520 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5b01df22-1773-4d37-bc1f-7b1776c7dc7d tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:48:57.789291 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5b01df22-1773-4d37-bc1f-7b1776c7dc7d tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:48:57.789774 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5b01df22-1773-4d37-bc1f-7b1776c7dc7d tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:48:57.790229 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5b01df22-1773-4d37-bc1f-7b1776c7dc7d tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:48:57.931261 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-5b01df22-1773-4d37-bc1f-7b1776c7dc7d tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9693ac87d6645c78684949d36cc1066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ae75103a974b01a05a640ff62ac845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:48:57.938997 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-5b01df22-1773-4d37-bc1f-7b1776c7dc7d tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] 10.222.0.43 "GET /compute/v2.1/servers/a88193d1-d83f-49ec-bfad-753c00487b55" status: 200 len: 1314 microversion: 2.1 time: 0.172347 Oct 04 22:48:57.939571 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3954/7085] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:48:57 2022] GET /compute/v2.1/servers/a88193d1-d83f-49ec-bfad-753c00487b55 => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:48:58.964282 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-2f0fbd32-7cba-41e2-89db-9fc030185232 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:48:58.964903 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-2f0fbd32-7cba-41e2-89db-9fc030185232 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] [instance: a88193d1-d83f-49ec-bfad-753c00487b55] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:48:58.966984 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell0:SELECT=2 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:48:58.972772 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2f0fbd32-7cba-41e2-89db-9fc030185232 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:48:58.973257 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2f0fbd32-7cba-41e2-89db-9fc030185232 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:48:58.974446 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2f0fbd32-7cba-41e2-89db-9fc030185232 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:48:58.975143 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2f0fbd32-7cba-41e2-89db-9fc030185232 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:48:58.975605 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2f0fbd32-7cba-41e2-89db-9fc030185232 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:48:58.976032 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2f0fbd32-7cba-41e2-89db-9fc030185232 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:48:59.108813 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-2f0fbd32-7cba-41e2-89db-9fc030185232 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9693ac87d6645c78684949d36cc1066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ae75103a974b01a05a640ff62ac845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:48:59.116920 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-2f0fbd32-7cba-41e2-89db-9fc030185232 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] 10.222.0.43 "GET /compute/v2.1/servers/a88193d1-d83f-49ec-bfad-753c00487b55" status: 200 len: 1499 microversion: 2.1 time: 0.156606 Oct 04 22:48:59.117518 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3132/7086] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:48:58 2022] GET /compute/v2.1/servers/a88193d1-d83f-49ec-bfad-753c00487b55 => generated 1499 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:48:59.140057 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-2d4f2e42-b912-4624-ab68-085618b03162 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:48:59.142324 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-2d4f2e42-b912-4624-ab68-085618b03162 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] [instance: a88193d1-d83f-49ec-bfad-753c00487b55] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:48:59.151839 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2d4f2e42-b912-4624-ab68-085618b03162 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:48:59.152342 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2d4f2e42-b912-4624-ab68-085618b03162 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:48:59.152794 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2d4f2e42-b912-4624-ab68-085618b03162 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:48:59.153498 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2d4f2e42-b912-4624-ab68-085618b03162 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:48:59.153968 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2d4f2e42-b912-4624-ab68-085618b03162 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:48:59.154428 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2d4f2e42-b912-4624-ab68-085618b03162 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:48:59.182195 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-2d4f2e42-b912-4624-ab68-085618b03162 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'd9693ac87d6645c78684949d36cc1066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ae75103a974b01a05a640ff62ac845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:48:59.187552 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-2d4f2e42-b912-4624-ab68-085618b03162 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] [instance: a88193d1-d83f-49ec-bfad-753c00487b55] Old instance type m1.heat2, new instance type m1.heat {{(pid=134101) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 04 22:48:59.194956 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-2d4f2e42-b912-4624-ab68-085618b03162 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Flavor limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 22:48:59.195395 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-2d4f2e42-b912-4624-ab68-085618b03162 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Image limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 22:48:59.195887 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-2d4f2e42-b912-4624-ab68-085618b03162 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Flavor pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 22:48:59.196317 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-2d4f2e42-b912-4624-ab68-085618b03162 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Image pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 22:48:59.196746 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-2d4f2e42-b912-4624-ab68-085618b03162 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 22:48:59.259496 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-2d4f2e42-b912-4624-ab68-085618b03162 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] 10.222.0.43 "POST /compute/v2.1/servers/a88193d1-d83f-49ec-bfad-753c00487b55/action" status: 202 len: 0 microversion: 2.1 time: 0.123340 Oct 04 22:48:59.260111 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3955/7087] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 22:48:59 2022] POST /compute/v2.1/servers/a88193d1-d83f-49ec-bfad-753c00487b55/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 22:48:59.268328 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-5a0bf7fc-fddf-4822-b431-4c7847466281 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:48:59.268944 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-5a0bf7fc-fddf-4822-b431-4c7847466281 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] [instance: a88193d1-d83f-49ec-bfad-753c00487b55] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:48:59.275461 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5a0bf7fc-fddf-4822-b431-4c7847466281 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:48:59.275936 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5a0bf7fc-fddf-4822-b431-4c7847466281 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:48:59.276371 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5a0bf7fc-fddf-4822-b431-4c7847466281 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:48:59.277062 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5a0bf7fc-fddf-4822-b431-4c7847466281 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:48:59.277517 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5a0bf7fc-fddf-4822-b431-4c7847466281 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:48:59.277939 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5a0bf7fc-fddf-4822-b431-4c7847466281 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:48:59.411026 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-5a0bf7fc-fddf-4822-b431-4c7847466281 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9693ac87d6645c78684949d36cc1066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ae75103a974b01a05a640ff62ac845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:48:59.419243 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-5a0bf7fc-fddf-4822-b431-4c7847466281 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] 10.222.0.43 "GET /compute/v2.1/servers/a88193d1-d83f-49ec-bfad-753c00487b55" status: 200 len: 1508 microversion: 2.1 time: 0.154818 Oct 04 22:48:59.419841 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3133/7088] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:48:59 2022] GET /compute/v2.1/servers/a88193d1-d83f-49ec-bfad-753c00487b55 => generated 1508 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:49:00.443562 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-09e6d95b-f11c-4d50-b94b-420ba7a400e9 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:49:00.444193 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-09e6d95b-f11c-4d50-b94b-420ba7a400e9 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] [instance: a88193d1-d83f-49ec-bfad-753c00487b55] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:49:00.451505 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-09e6d95b-f11c-4d50-b94b-420ba7a400e9 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:49:00.452017 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-09e6d95b-f11c-4d50-b94b-420ba7a400e9 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:49:00.452476 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-09e6d95b-f11c-4d50-b94b-420ba7a400e9 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:49:00.453198 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-09e6d95b-f11c-4d50-b94b-420ba7a400e9 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:49:00.453690 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-09e6d95b-f11c-4d50-b94b-420ba7a400e9 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:49:00.454197 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-09e6d95b-f11c-4d50-b94b-420ba7a400e9 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:49:00.587863 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-09e6d95b-f11c-4d50-b94b-420ba7a400e9 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9693ac87d6645c78684949d36cc1066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ae75103a974b01a05a640ff62ac845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:49:00.595605 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-09e6d95b-f11c-4d50-b94b-420ba7a400e9 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] 10.222.0.43 "GET /compute/v2.1/servers/a88193d1-d83f-49ec-bfad-753c00487b55" status: 200 len: 1508 microversion: 2.1 time: 0.156964 Oct 04 22:49:00.596186 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3956/7089] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:49:00 2022] GET /compute/v2.1/servers/a88193d1-d83f-49ec-bfad-753c00487b55 => generated 1508 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:49:01.619325 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-e3b2c024-b9c6-45af-b94e-ab0287494f43 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:49:01.619979 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-e3b2c024-b9c6-45af-b94e-ab0287494f43 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] [instance: a88193d1-d83f-49ec-bfad-753c00487b55] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:49:01.627221 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e3b2c024-b9c6-45af-b94e-ab0287494f43 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:49:01.627711 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e3b2c024-b9c6-45af-b94e-ab0287494f43 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:49:01.628155 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e3b2c024-b9c6-45af-b94e-ab0287494f43 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:49:01.628854 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e3b2c024-b9c6-45af-b94e-ab0287494f43 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:49:01.629339 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e3b2c024-b9c6-45af-b94e-ab0287494f43 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:49:01.629824 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e3b2c024-b9c6-45af-b94e-ab0287494f43 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:49:01.760029 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-e3b2c024-b9c6-45af-b94e-ab0287494f43 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9693ac87d6645c78684949d36cc1066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ae75103a974b01a05a640ff62ac845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:49:01.767745 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-e3b2c024-b9c6-45af-b94e-ab0287494f43 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] 10.222.0.43 "GET /compute/v2.1/servers/a88193d1-d83f-49ec-bfad-753c00487b55" status: 200 len: 1513 microversion: 2.1 time: 0.152405 Oct 04 22:49:01.768330 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3134/7090] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:49:01 2022] GET /compute/v2.1/servers/a88193d1-d83f-49ec-bfad-753c00487b55 => generated 1513 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:49:02.792295 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-4154c85b-5451-4d9c-a384-cf6eeb9f8638 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:49:02.792926 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-4154c85b-5451-4d9c-a384-cf6eeb9f8638 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] [instance: a88193d1-d83f-49ec-bfad-753c00487b55] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:49:02.800141 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4154c85b-5451-4d9c-a384-cf6eeb9f8638 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:49:02.800645 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4154c85b-5451-4d9c-a384-cf6eeb9f8638 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:49:02.801110 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4154c85b-5451-4d9c-a384-cf6eeb9f8638 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:49:02.802669 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4154c85b-5451-4d9c-a384-cf6eeb9f8638 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:49:02.803151 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4154c85b-5451-4d9c-a384-cf6eeb9f8638 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:49:02.803602 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4154c85b-5451-4d9c-a384-cf6eeb9f8638 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:49:02.935670 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-4154c85b-5451-4d9c-a384-cf6eeb9f8638 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9693ac87d6645c78684949d36cc1066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ae75103a974b01a05a640ff62ac845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:49:02.943745 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-4154c85b-5451-4d9c-a384-cf6eeb9f8638 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] 10.222.0.43 "GET /compute/v2.1/servers/a88193d1-d83f-49ec-bfad-753c00487b55" status: 200 len: 1513 microversion: 2.1 time: 0.155487 Oct 04 22:49:02.944324 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3957/7091] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:49:02 2022] GET /compute/v2.1/servers/a88193d1-d83f-49ec-bfad-753c00487b55 => generated 1513 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:49:03.966922 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-44fbf6b9-5ca5-4055-a148-7ae294d8dd03 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:49:03.967539 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-44fbf6b9-5ca5-4055-a148-7ae294d8dd03 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] [instance: a88193d1-d83f-49ec-bfad-753c00487b55] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:49:03.974393 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-44fbf6b9-5ca5-4055-a148-7ae294d8dd03 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:49:03.974896 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-44fbf6b9-5ca5-4055-a148-7ae294d8dd03 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:49:03.975337 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-44fbf6b9-5ca5-4055-a148-7ae294d8dd03 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:49:03.976064 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-44fbf6b9-5ca5-4055-a148-7ae294d8dd03 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:49:03.976527 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-44fbf6b9-5ca5-4055-a148-7ae294d8dd03 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:49:03.976958 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-44fbf6b9-5ca5-4055-a148-7ae294d8dd03 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:49:04.114067 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-44fbf6b9-5ca5-4055-a148-7ae294d8dd03 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9693ac87d6645c78684949d36cc1066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ae75103a974b01a05a640ff62ac845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:49:04.122027 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-44fbf6b9-5ca5-4055-a148-7ae294d8dd03 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] 10.222.0.43 "GET /compute/v2.1/servers/a88193d1-d83f-49ec-bfad-753c00487b55" status: 200 len: 1513 microversion: 2.1 time: 0.158978 Oct 04 22:49:04.122658 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3135/7092] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:49:03 2022] GET /compute/v2.1/servers/a88193d1-d83f-49ec-bfad-753c00487b55 => generated 1513 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:49:05.145219 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-2ac650ed-5462-4f8f-a984-22838c7c9cdb tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:49:05.145853 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-2ac650ed-5462-4f8f-a984-22838c7c9cdb tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] [instance: a88193d1-d83f-49ec-bfad-753c00487b55] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:49:05.152804 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2ac650ed-5462-4f8f-a984-22838c7c9cdb tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:49:05.153305 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2ac650ed-5462-4f8f-a984-22838c7c9cdb tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:49:05.153765 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2ac650ed-5462-4f8f-a984-22838c7c9cdb tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:49:05.154504 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2ac650ed-5462-4f8f-a984-22838c7c9cdb tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:49:05.154981 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2ac650ed-5462-4f8f-a984-22838c7c9cdb tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:49:05.155429 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2ac650ed-5462-4f8f-a984-22838c7c9cdb tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:49:05.290083 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-2ac650ed-5462-4f8f-a984-22838c7c9cdb tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9693ac87d6645c78684949d36cc1066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ae75103a974b01a05a640ff62ac845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:49:05.297855 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-2ac650ed-5462-4f8f-a984-22838c7c9cdb tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] 10.222.0.43 "GET /compute/v2.1/servers/a88193d1-d83f-49ec-bfad-753c00487b55" status: 200 len: 1513 microversion: 2.1 time: 0.156683 Oct 04 22:49:05.298456 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3958/7093] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:49:05 2022] GET /compute/v2.1/servers/a88193d1-d83f-49ec-bfad-753c00487b55 => generated 1513 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:49:06.321843 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-f55d1978-2f67-458a-8fc6-ff92a1d2d75a tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:49:06.322509 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-f55d1978-2f67-458a-8fc6-ff92a1d2d75a tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] [instance: a88193d1-d83f-49ec-bfad-753c00487b55] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:49:06.329558 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f55d1978-2f67-458a-8fc6-ff92a1d2d75a tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:49:06.330037 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f55d1978-2f67-458a-8fc6-ff92a1d2d75a tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:49:06.330492 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f55d1978-2f67-458a-8fc6-ff92a1d2d75a tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:49:06.331175 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f55d1978-2f67-458a-8fc6-ff92a1d2d75a tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:49:06.331625 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f55d1978-2f67-458a-8fc6-ff92a1d2d75a tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:49:06.332050 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f55d1978-2f67-458a-8fc6-ff92a1d2d75a tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:49:06.463038 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-f55d1978-2f67-458a-8fc6-ff92a1d2d75a tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9693ac87d6645c78684949d36cc1066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ae75103a974b01a05a640ff62ac845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:49:06.470695 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-f55d1978-2f67-458a-8fc6-ff92a1d2d75a tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] 10.222.0.43 "GET /compute/v2.1/servers/a88193d1-d83f-49ec-bfad-753c00487b55" status: 200 len: 1513 microversion: 2.1 time: 0.153422 Oct 04 22:49:06.471274 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3136/7094] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:49:06 2022] GET /compute/v2.1/servers/a88193d1-d83f-49ec-bfad-753c00487b55 => generated 1513 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:49:07.494412 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-8642fe82-5eac-4e20-909a-5ba254113593 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:49:07.494966 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-8642fe82-5eac-4e20-909a-5ba254113593 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] [instance: a88193d1-d83f-49ec-bfad-753c00487b55] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:49:07.502086 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8642fe82-5eac-4e20-909a-5ba254113593 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:49:07.502618 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8642fe82-5eac-4e20-909a-5ba254113593 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:49:07.503109 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8642fe82-5eac-4e20-909a-5ba254113593 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:49:07.503823 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8642fe82-5eac-4e20-909a-5ba254113593 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:49:07.504316 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8642fe82-5eac-4e20-909a-5ba254113593 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:49:07.505351 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8642fe82-5eac-4e20-909a-5ba254113593 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:49:07.637760 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-8642fe82-5eac-4e20-909a-5ba254113593 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9693ac87d6645c78684949d36cc1066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ae75103a974b01a05a640ff62ac845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:49:07.646266 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-8642fe82-5eac-4e20-909a-5ba254113593 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] 10.222.0.43 "GET /compute/v2.1/servers/a88193d1-d83f-49ec-bfad-753c00487b55" status: 200 len: 1513 microversion: 2.1 time: 0.156102 Oct 04 22:49:07.646890 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3959/7095] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:49:07 2022] GET /compute/v2.1/servers/a88193d1-d83f-49ec-bfad-753c00487b55 => generated 1513 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:49:08.669132 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-d0607c9e-ad6c-4284-83c9-f6f711909be1 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:49:08.669866 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-d0607c9e-ad6c-4284-83c9-f6f711909be1 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] [instance: a88193d1-d83f-49ec-bfad-753c00487b55] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:49:08.676900 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d0607c9e-ad6c-4284-83c9-f6f711909be1 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:49:08.677388 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d0607c9e-ad6c-4284-83c9-f6f711909be1 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:49:08.677828 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d0607c9e-ad6c-4284-83c9-f6f711909be1 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:49:08.678566 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d0607c9e-ad6c-4284-83c9-f6f711909be1 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:49:08.679033 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d0607c9e-ad6c-4284-83c9-f6f711909be1 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:49:08.679472 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d0607c9e-ad6c-4284-83c9-f6f711909be1 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:49:08.810345 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-d0607c9e-ad6c-4284-83c9-f6f711909be1 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9693ac87d6645c78684949d36cc1066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ae75103a974b01a05a640ff62ac845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:49:08.819022 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-d0607c9e-ad6c-4284-83c9-f6f711909be1 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] 10.222.0.43 "GET /compute/v2.1/servers/a88193d1-d83f-49ec-bfad-753c00487b55" status: 200 len: 1513 microversion: 2.1 time: 0.154145 Oct 04 22:49:08.819616 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3137/7096] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:49:08 2022] GET /compute/v2.1/servers/a88193d1-d83f-49ec-bfad-753c00487b55 => generated 1513 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:49:09.843168 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-44300a5f-e778-4c7b-ac9e-b04a44d1abc6 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:49:09.843739 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-44300a5f-e778-4c7b-ac9e-b04a44d1abc6 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] [instance: a88193d1-d83f-49ec-bfad-753c00487b55] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:49:09.851430 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-44300a5f-e778-4c7b-ac9e-b04a44d1abc6 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:49:09.851937 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-44300a5f-e778-4c7b-ac9e-b04a44d1abc6 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:49:09.852408 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-44300a5f-e778-4c7b-ac9e-b04a44d1abc6 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:49:09.853126 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-44300a5f-e778-4c7b-ac9e-b04a44d1abc6 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:49:09.853605 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-44300a5f-e778-4c7b-ac9e-b04a44d1abc6 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:49:09.854058 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-44300a5f-e778-4c7b-ac9e-b04a44d1abc6 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:49:09.990510 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-44300a5f-e778-4c7b-ac9e-b04a44d1abc6 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9693ac87d6645c78684949d36cc1066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ae75103a974b01a05a640ff62ac845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:49:09.998382 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-44300a5f-e778-4c7b-ac9e-b04a44d1abc6 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] 10.222.0.43 "GET /compute/v2.1/servers/a88193d1-d83f-49ec-bfad-753c00487b55" status: 200 len: 1513 microversion: 2.1 time: 0.159202 Oct 04 22:49:09.998974 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3960/7097] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:49:09 2022] GET /compute/v2.1/servers/a88193d1-d83f-49ec-bfad-753c00487b55 => generated 1513 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:49:11.022562 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-e62dd777-566d-445a-ba33-05a63f89c2d4 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:49:11.023193 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-e62dd777-566d-445a-ba33-05a63f89c2d4 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] [instance: a88193d1-d83f-49ec-bfad-753c00487b55] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:49:11.030108 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e62dd777-566d-445a-ba33-05a63f89c2d4 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:49:11.030646 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e62dd777-566d-445a-ba33-05a63f89c2d4 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:49:11.031088 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e62dd777-566d-445a-ba33-05a63f89c2d4 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:49:11.031821 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e62dd777-566d-445a-ba33-05a63f89c2d4 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:49:11.032311 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e62dd777-566d-445a-ba33-05a63f89c2d4 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:49:11.032748 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e62dd777-566d-445a-ba33-05a63f89c2d4 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:49:11.164682 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-e62dd777-566d-445a-ba33-05a63f89c2d4 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9693ac87d6645c78684949d36cc1066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ae75103a974b01a05a640ff62ac845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:49:11.172460 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-e62dd777-566d-445a-ba33-05a63f89c2d4 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] 10.222.0.43 "GET /compute/v2.1/servers/a88193d1-d83f-49ec-bfad-753c00487b55" status: 200 len: 1513 microversion: 2.1 time: 0.154179 Oct 04 22:49:11.173049 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3138/7098] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:49:11 2022] GET /compute/v2.1/servers/a88193d1-d83f-49ec-bfad-753c00487b55 => generated 1513 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:49:12.195909 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-ec4df586-f925-45a0-a6d5-36c8894c8df9 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:49:12.196585 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-ec4df586-f925-45a0-a6d5-36c8894c8df9 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] [instance: a88193d1-d83f-49ec-bfad-753c00487b55] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:49:12.203727 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ec4df586-f925-45a0-a6d5-36c8894c8df9 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:49:12.204236 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ec4df586-f925-45a0-a6d5-36c8894c8df9 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:49:12.204722 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ec4df586-f925-45a0-a6d5-36c8894c8df9 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:49:12.205486 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ec4df586-f925-45a0-a6d5-36c8894c8df9 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:49:12.205991 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ec4df586-f925-45a0-a6d5-36c8894c8df9 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:49:12.206468 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ec4df586-f925-45a0-a6d5-36c8894c8df9 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:49:12.338963 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-ec4df586-f925-45a0-a6d5-36c8894c8df9 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9693ac87d6645c78684949d36cc1066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ae75103a974b01a05a640ff62ac845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:49:12.346848 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-ec4df586-f925-45a0-a6d5-36c8894c8df9 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] 10.222.0.43 "GET /compute/v2.1/servers/a88193d1-d83f-49ec-bfad-753c00487b55" status: 200 len: 1513 microversion: 2.1 time: 0.155263 Oct 04 22:49:12.347427 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3961/7099] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:49:12 2022] GET /compute/v2.1/servers/a88193d1-d83f-49ec-bfad-753c00487b55 => generated 1513 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:49:13.370343 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-c0b1b2d5-5a6c-497a-bcfd-420ab628a376 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:49:13.371002 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-c0b1b2d5-5a6c-497a-bcfd-420ab628a376 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] [instance: a88193d1-d83f-49ec-bfad-753c00487b55] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:49:13.378047 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c0b1b2d5-5a6c-497a-bcfd-420ab628a376 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:49:13.378573 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c0b1b2d5-5a6c-497a-bcfd-420ab628a376 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:49:13.379012 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c0b1b2d5-5a6c-497a-bcfd-420ab628a376 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:49:13.379708 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c0b1b2d5-5a6c-497a-bcfd-420ab628a376 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:49:13.380167 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c0b1b2d5-5a6c-497a-bcfd-420ab628a376 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:49:13.380593 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c0b1b2d5-5a6c-497a-bcfd-420ab628a376 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:49:13.517862 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-c0b1b2d5-5a6c-497a-bcfd-420ab628a376 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9693ac87d6645c78684949d36cc1066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ae75103a974b01a05a640ff62ac845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:49:13.526106 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-c0b1b2d5-5a6c-497a-bcfd-420ab628a376 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] 10.222.0.43 "GET /compute/v2.1/servers/a88193d1-d83f-49ec-bfad-753c00487b55" status: 200 len: 1513 microversion: 2.1 time: 0.159657 Oct 04 22:49:13.526734 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3139/7100] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:49:13 2022] GET /compute/v2.1/servers/a88193d1-d83f-49ec-bfad-753c00487b55 => generated 1513 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:49:14.549835 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-a4947aa9-778a-4e6d-925d-4ede12e24110 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:49:14.550491 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-a4947aa9-778a-4e6d-925d-4ede12e24110 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] [instance: a88193d1-d83f-49ec-bfad-753c00487b55] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:49:14.557809 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a4947aa9-778a-4e6d-925d-4ede12e24110 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:49:14.558312 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a4947aa9-778a-4e6d-925d-4ede12e24110 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:49:14.558805 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a4947aa9-778a-4e6d-925d-4ede12e24110 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:49:14.559529 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a4947aa9-778a-4e6d-925d-4ede12e24110 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:49:14.560004 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a4947aa9-778a-4e6d-925d-4ede12e24110 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:49:14.560450 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a4947aa9-778a-4e6d-925d-4ede12e24110 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:49:14.701088 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-a4947aa9-778a-4e6d-925d-4ede12e24110 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9693ac87d6645c78684949d36cc1066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ae75103a974b01a05a640ff62ac845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:49:14.709956 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-a4947aa9-778a-4e6d-925d-4ede12e24110 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] 10.222.0.43 "GET /compute/v2.1/servers/a88193d1-d83f-49ec-bfad-753c00487b55" status: 200 len: 1513 microversion: 2.1 time: 0.164119 Oct 04 22:49:14.710576 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3962/7101] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:49:14 2022] GET /compute/v2.1/servers/a88193d1-d83f-49ec-bfad-753c00487b55 => generated 1513 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:49:15.733541 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-a8582630-dd33-42cf-bc92-5d22950291a7 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:49:15.734105 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-a8582630-dd33-42cf-bc92-5d22950291a7 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] [instance: a88193d1-d83f-49ec-bfad-753c00487b55] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:49:15.741672 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a8582630-dd33-42cf-bc92-5d22950291a7 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:49:15.742158 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a8582630-dd33-42cf-bc92-5d22950291a7 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:49:15.742628 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a8582630-dd33-42cf-bc92-5d22950291a7 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:49:15.743323 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a8582630-dd33-42cf-bc92-5d22950291a7 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:49:15.743782 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a8582630-dd33-42cf-bc92-5d22950291a7 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:49:15.744215 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a8582630-dd33-42cf-bc92-5d22950291a7 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:49:15.875234 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-a8582630-dd33-42cf-bc92-5d22950291a7 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9693ac87d6645c78684949d36cc1066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ae75103a974b01a05a640ff62ac845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:49:15.883166 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-a8582630-dd33-42cf-bc92-5d22950291a7 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] 10.222.0.43 "GET /compute/v2.1/servers/a88193d1-d83f-49ec-bfad-753c00487b55" status: 200 len: 1513 microversion: 2.1 time: 0.153585 Oct 04 22:49:15.883778 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3140/7102] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:49:15 2022] GET /compute/v2.1/servers/a88193d1-d83f-49ec-bfad-753c00487b55 => generated 1513 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:49:16.906032 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-0ca588aa-866d-4731-ad25-f20b24506d3d tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:49:16.906644 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-0ca588aa-866d-4731-ad25-f20b24506d3d tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] [instance: a88193d1-d83f-49ec-bfad-753c00487b55] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:49:16.912908 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0ca588aa-866d-4731-ad25-f20b24506d3d tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:49:16.913418 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0ca588aa-866d-4731-ad25-f20b24506d3d tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:49:16.913876 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0ca588aa-866d-4731-ad25-f20b24506d3d tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:49:16.914625 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0ca588aa-866d-4731-ad25-f20b24506d3d tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:49:16.915104 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0ca588aa-866d-4731-ad25-f20b24506d3d tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:49:16.915555 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0ca588aa-866d-4731-ad25-f20b24506d3d tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:49:17.048830 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-0ca588aa-866d-4731-ad25-f20b24506d3d tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9693ac87d6645c78684949d36cc1066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ae75103a974b01a05a640ff62ac845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:49:17.057584 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-0ca588aa-866d-4731-ad25-f20b24506d3d tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] 10.222.0.43 "GET /compute/v2.1/servers/a88193d1-d83f-49ec-bfad-753c00487b55" status: 200 len: 1513 microversion: 2.1 time: 0.155871 Oct 04 22:49:17.058182 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3963/7103] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:49:16 2022] GET /compute/v2.1/servers/a88193d1-d83f-49ec-bfad-753c00487b55 => generated 1513 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:49:18.081508 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-8fee3ee2-a742-4104-a458-4f49b064571e tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:49:18.082196 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-8fee3ee2-a742-4104-a458-4f49b064571e tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] [instance: a88193d1-d83f-49ec-bfad-753c00487b55] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:49:18.089207 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8fee3ee2-a742-4104-a458-4f49b064571e tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:49:18.089698 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8fee3ee2-a742-4104-a458-4f49b064571e tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:49:18.090143 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8fee3ee2-a742-4104-a458-4f49b064571e tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:49:18.090865 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8fee3ee2-a742-4104-a458-4f49b064571e tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:49:18.091328 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8fee3ee2-a742-4104-a458-4f49b064571e tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:49:18.091760 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8fee3ee2-a742-4104-a458-4f49b064571e tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:49:18.229761 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-8fee3ee2-a742-4104-a458-4f49b064571e tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9693ac87d6645c78684949d36cc1066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ae75103a974b01a05a640ff62ac845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:49:18.237497 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-8fee3ee2-a742-4104-a458-4f49b064571e tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] 10.222.0.43 "GET /compute/v2.1/servers/a88193d1-d83f-49ec-bfad-753c00487b55" status: 200 len: 1513 microversion: 2.1 time: 0.159899 Oct 04 22:49:18.238095 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3141/7104] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:49:18 2022] GET /compute/v2.1/servers/a88193d1-d83f-49ec-bfad-753c00487b55 => generated 1513 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:49:19.261874 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-d7b82ef2-11c7-432a-aa81-89bdbf7f46ed tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:49:19.262635 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-d7b82ef2-11c7-432a-aa81-89bdbf7f46ed tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] [instance: a88193d1-d83f-49ec-bfad-753c00487b55] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:49:19.269434 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d7b82ef2-11c7-432a-aa81-89bdbf7f46ed tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:49:19.269933 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d7b82ef2-11c7-432a-aa81-89bdbf7f46ed tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:49:19.270400 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d7b82ef2-11c7-432a-aa81-89bdbf7f46ed tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:49:19.271356 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d7b82ef2-11c7-432a-aa81-89bdbf7f46ed tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:49:19.271829 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d7b82ef2-11c7-432a-aa81-89bdbf7f46ed tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:49:19.272272 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d7b82ef2-11c7-432a-aa81-89bdbf7f46ed tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:49:19.403118 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-d7b82ef2-11c7-432a-aa81-89bdbf7f46ed tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9693ac87d6645c78684949d36cc1066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ae75103a974b01a05a640ff62ac845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:49:19.410929 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-d7b82ef2-11c7-432a-aa81-89bdbf7f46ed tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] 10.222.0.43 "GET /compute/v2.1/servers/a88193d1-d83f-49ec-bfad-753c00487b55" status: 200 len: 1513 microversion: 2.1 time: 0.152967 Oct 04 22:49:19.412185 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3964/7105] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:49:19 2022] GET /compute/v2.1/servers/a88193d1-d83f-49ec-bfad-753c00487b55 => generated 1513 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:49:20.435315 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-a3ac35ea-afee-43d2-b07f-60481d533adb tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:49:20.435848 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-a3ac35ea-afee-43d2-b07f-60481d533adb tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] [instance: a88193d1-d83f-49ec-bfad-753c00487b55] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:49:20.443270 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a3ac35ea-afee-43d2-b07f-60481d533adb tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:49:20.443648 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a3ac35ea-afee-43d2-b07f-60481d533adb tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:49:20.444085 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a3ac35ea-afee-43d2-b07f-60481d533adb tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:49:20.444772 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a3ac35ea-afee-43d2-b07f-60481d533adb tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:49:20.445224 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a3ac35ea-afee-43d2-b07f-60481d533adb tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:49:20.445651 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a3ac35ea-afee-43d2-b07f-60481d533adb tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:49:20.574064 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-a3ac35ea-afee-43d2-b07f-60481d533adb tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9693ac87d6645c78684949d36cc1066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ae75103a974b01a05a640ff62ac845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:49:20.581928 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-a3ac35ea-afee-43d2-b07f-60481d533adb tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] 10.222.0.43 "GET /compute/v2.1/servers/a88193d1-d83f-49ec-bfad-753c00487b55" status: 200 len: 1513 microversion: 2.1 time: 0.150647 Oct 04 22:49:20.582523 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3142/7106] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:49:20 2022] GET /compute/v2.1/servers/a88193d1-d83f-49ec-bfad-753c00487b55 => generated 1513 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:49:21.605048 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-90ce74bd-b651-4b00-b33f-d960aee3249b tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:49:21.605688 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-90ce74bd-b651-4b00-b33f-d960aee3249b tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] [instance: a88193d1-d83f-49ec-bfad-753c00487b55] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:49:21.612749 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-90ce74bd-b651-4b00-b33f-d960aee3249b tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:49:21.613258 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-90ce74bd-b651-4b00-b33f-d960aee3249b tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:49:21.613718 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-90ce74bd-b651-4b00-b33f-d960aee3249b tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:49:21.614496 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-90ce74bd-b651-4b00-b33f-d960aee3249b tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:49:21.615011 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-90ce74bd-b651-4b00-b33f-d960aee3249b tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:49:21.615464 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-90ce74bd-b651-4b00-b33f-d960aee3249b tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:49:21.749309 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-90ce74bd-b651-4b00-b33f-d960aee3249b tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9693ac87d6645c78684949d36cc1066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ae75103a974b01a05a640ff62ac845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:49:21.758000 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-90ce74bd-b651-4b00-b33f-d960aee3249b tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] 10.222.0.43 "GET /compute/v2.1/servers/a88193d1-d83f-49ec-bfad-753c00487b55" status: 200 len: 1513 microversion: 2.1 time: 0.157055 Oct 04 22:49:21.758619 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3965/7107] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:49:21 2022] GET /compute/v2.1/servers/a88193d1-d83f-49ec-bfad-753c00487b55 => generated 1513 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:49:22.781314 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-4688a29b-85d3-4c11-a8e1-64c5764ac295 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:49:22.781938 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-4688a29b-85d3-4c11-a8e1-64c5764ac295 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] [instance: a88193d1-d83f-49ec-bfad-753c00487b55] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:49:22.789753 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4688a29b-85d3-4c11-a8e1-64c5764ac295 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:49:22.790242 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4688a29b-85d3-4c11-a8e1-64c5764ac295 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:49:22.790715 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4688a29b-85d3-4c11-a8e1-64c5764ac295 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:49:22.791413 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4688a29b-85d3-4c11-a8e1-64c5764ac295 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:49:22.791872 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4688a29b-85d3-4c11-a8e1-64c5764ac295 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:49:22.792303 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4688a29b-85d3-4c11-a8e1-64c5764ac295 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:49:22.925859 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-4688a29b-85d3-4c11-a8e1-64c5764ac295 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9693ac87d6645c78684949d36cc1066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ae75103a974b01a05a640ff62ac845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:49:22.933956 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-4688a29b-85d3-4c11-a8e1-64c5764ac295 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] 10.222.0.43 "GET /compute/v2.1/servers/a88193d1-d83f-49ec-bfad-753c00487b55" status: 200 len: 1513 microversion: 2.1 time: 0.157028 Oct 04 22:49:22.934574 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3143/7108] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:49:22 2022] GET /compute/v2.1/servers/a88193d1-d83f-49ec-bfad-753c00487b55 => generated 1513 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:49:23.957654 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-7a786017-a5cc-4f3c-86cf-1ea4ece5472e tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:49:23.958416 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-7a786017-a5cc-4f3c-86cf-1ea4ece5472e tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] [instance: a88193d1-d83f-49ec-bfad-753c00487b55] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:49:23.965314 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7a786017-a5cc-4f3c-86cf-1ea4ece5472e tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:49:23.965825 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7a786017-a5cc-4f3c-86cf-1ea4ece5472e tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:49:23.966293 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7a786017-a5cc-4f3c-86cf-1ea4ece5472e tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:49:23.967039 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7a786017-a5cc-4f3c-86cf-1ea4ece5472e tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:49:23.967522 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7a786017-a5cc-4f3c-86cf-1ea4ece5472e tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:49:23.967975 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7a786017-a5cc-4f3c-86cf-1ea4ece5472e tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:49:24.100239 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-7a786017-a5cc-4f3c-86cf-1ea4ece5472e tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9693ac87d6645c78684949d36cc1066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ae75103a974b01a05a640ff62ac845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:49:24.108069 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-7a786017-a5cc-4f3c-86cf-1ea4ece5472e tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] 10.222.0.43 "GET /compute/v2.1/servers/a88193d1-d83f-49ec-bfad-753c00487b55" status: 200 len: 1513 microversion: 2.1 time: 0.154434 Oct 04 22:49:24.108653 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3966/7109] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:49:23 2022] GET /compute/v2.1/servers/a88193d1-d83f-49ec-bfad-753c00487b55 => generated 1513 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:49:25.136366 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-b954f48b-9556-4c73-bad0-b7c6ad026ed0 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:49:25.137008 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-b954f48b-9556-4c73-bad0-b7c6ad026ed0 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] [instance: a88193d1-d83f-49ec-bfad-753c00487b55] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:49:25.143065 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b954f48b-9556-4c73-bad0-b7c6ad026ed0 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:49:25.143549 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b954f48b-9556-4c73-bad0-b7c6ad026ed0 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:49:25.143978 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b954f48b-9556-4c73-bad0-b7c6ad026ed0 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:49:25.144667 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b954f48b-9556-4c73-bad0-b7c6ad026ed0 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:49:25.145118 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b954f48b-9556-4c73-bad0-b7c6ad026ed0 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:49:25.145537 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b954f48b-9556-4c73-bad0-b7c6ad026ed0 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:49:25.279976 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-b954f48b-9556-4c73-bad0-b7c6ad026ed0 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9693ac87d6645c78684949d36cc1066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ae75103a974b01a05a640ff62ac845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:49:25.287970 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-b954f48b-9556-4c73-bad0-b7c6ad026ed0 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] 10.222.0.43 "GET /compute/v2.1/servers/a88193d1-d83f-49ec-bfad-753c00487b55" status: 200 len: 1513 microversion: 2.1 time: 0.159957 Oct 04 22:49:25.288565 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3144/7110] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:49:25 2022] GET /compute/v2.1/servers/a88193d1-d83f-49ec-bfad-753c00487b55 => generated 1513 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:49:26.311196 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-a83a7155-20bd-4750-9cdf-4e4bc444986d tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:49:26.311836 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-a83a7155-20bd-4750-9cdf-4e4bc444986d tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] [instance: a88193d1-d83f-49ec-bfad-753c00487b55] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:49:26.319004 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a83a7155-20bd-4750-9cdf-4e4bc444986d tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:49:26.319515 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a83a7155-20bd-4750-9cdf-4e4bc444986d tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:49:26.319977 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a83a7155-20bd-4750-9cdf-4e4bc444986d tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:49:26.320696 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a83a7155-20bd-4750-9cdf-4e4bc444986d tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:49:26.321176 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a83a7155-20bd-4750-9cdf-4e4bc444986d tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:49:26.321629 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a83a7155-20bd-4750-9cdf-4e4bc444986d tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:49:26.453508 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-a83a7155-20bd-4750-9cdf-4e4bc444986d tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9693ac87d6645c78684949d36cc1066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ae75103a974b01a05a640ff62ac845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:49:26.461649 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-a83a7155-20bd-4750-9cdf-4e4bc444986d tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] 10.222.0.43 "GET /compute/v2.1/servers/a88193d1-d83f-49ec-bfad-753c00487b55" status: 200 len: 1513 microversion: 2.1 time: 0.154391 Oct 04 22:49:26.462233 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3967/7111] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:49:26 2022] GET /compute/v2.1/servers/a88193d1-d83f-49ec-bfad-753c00487b55 => generated 1513 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:49:27.484964 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-5d6f0d21-cf0a-4677-98b8-6b14fb451713 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:49:27.485508 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-5d6f0d21-cf0a-4677-98b8-6b14fb451713 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] [instance: a88193d1-d83f-49ec-bfad-753c00487b55] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:49:27.487951 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_api:SELECT=30 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:49:27.494011 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5d6f0d21-cf0a-4677-98b8-6b14fb451713 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:49:27.494538 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5d6f0d21-cf0a-4677-98b8-6b14fb451713 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:49:27.494986 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5d6f0d21-cf0a-4677-98b8-6b14fb451713 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:49:27.495692 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5d6f0d21-cf0a-4677-98b8-6b14fb451713 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:49:27.496158 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5d6f0d21-cf0a-4677-98b8-6b14fb451713 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:49:27.496588 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5d6f0d21-cf0a-4677-98b8-6b14fb451713 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:49:27.501092 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=90 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:49:27.628237 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-5d6f0d21-cf0a-4677-98b8-6b14fb451713 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9693ac87d6645c78684949d36cc1066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ae75103a974b01a05a640ff62ac845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:49:27.635989 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-5d6f0d21-cf0a-4677-98b8-6b14fb451713 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] 10.222.0.43 "GET /compute/v2.1/servers/a88193d1-d83f-49ec-bfad-753c00487b55" status: 200 len: 1513 microversion: 2.1 time: 0.155194 Oct 04 22:49:27.636565 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3145/7112] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:49:27 2022] GET /compute/v2.1/servers/a88193d1-d83f-49ec-bfad-753c00487b55 => generated 1513 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:49:28.659097 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-d28f9024-8c12-4b42-9cf9-0a7d71b420a0 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:49:28.659830 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-d28f9024-8c12-4b42-9cf9-0a7d71b420a0 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] [instance: a88193d1-d83f-49ec-bfad-753c00487b55] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:49:28.662792 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=34 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:49:28.668445 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d28f9024-8c12-4b42-9cf9-0a7d71b420a0 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:49:28.668958 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d28f9024-8c12-4b42-9cf9-0a7d71b420a0 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:49:28.669416 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d28f9024-8c12-4b42-9cf9-0a7d71b420a0 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:49:28.670171 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d28f9024-8c12-4b42-9cf9-0a7d71b420a0 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:49:28.670683 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d28f9024-8c12-4b42-9cf9-0a7d71b420a0 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:49:28.671133 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d28f9024-8c12-4b42-9cf9-0a7d71b420a0 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:49:28.674206 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:49:28.815634 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-7fd8efcb-c9ac-49ee-bf01-41d02d4b39c0 req-8eb5640c-9586-4348-95fb-234b67794836 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a88193d1-d83f-49ec-bfad-753c00487b55", "name": "network-vif-unplugged", "status": "completed", "tag": "312529db-3de8-4585-a030-c7e37d18055a"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:49:28.824637 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-d28f9024-8c12-4b42-9cf9-0a7d71b420a0 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9693ac87d6645c78684949d36cc1066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ae75103a974b01a05a640ff62ac845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:49:28.839255 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-7fd8efcb-c9ac-49ee-bf01-41d02d4b39c0 req-8eb5640c-9586-4348-95fb-234b67794836 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:49:28.841995 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-d28f9024-8c12-4b42-9cf9-0a7d71b420a0 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] 10.222.0.43 "GET /compute/v2.1/servers/a88193d1-d83f-49ec-bfad-753c00487b55" status: 200 len: 1512 microversion: 2.1 time: 0.186739 Oct 04 22:49:28.854390 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-7fd8efcb-c9ac-49ee-bf01-41d02d4b39c0 req-8eb5640c-9586-4348-95fb-234b67794836 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:49:28.854390 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-7fd8efcb-c9ac-49ee-bf01-41d02d4b39c0 req-8eb5640c-9586-4348-95fb-234b67794836 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:49:28.854728 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3968/7113] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:49:28 2022] GET /compute/v2.1/servers/a88193d1-d83f-49ec-bfad-753c00487b55 => generated 1512 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:49:28.859861 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-7fd8efcb-c9ac-49ee-bf01-41d02d4b39c0 req-8eb5640c-9586-4348-95fb-234b67794836 service nova] Creating event network-vif-unplugged:312529db-3de8-4585-a030-c7e37d18055a for instance a88193d1-d83f-49ec-bfad-753c00487b55 on n-h2-860284-1 Oct 04 22:49:28.865052 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [req-7fd8efcb-c9ac-49ee-bf01-41d02d4b39c0 req-8eb5640c-9586-4348-95fb-234b67794836 service nova] Instance a88193d1-d83f-49ec-bfad-753c00487b55 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860284-1', 'n-h2-860284-1'} {{(pid=134102) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 22:49:28.877744 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-7fd8efcb-c9ac-49ee-bf01-41d02d4b39c0 req-8eb5640c-9586-4348-95fb-234b67794836 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.070325 Oct 04 22:49:28.878552 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3146/7114] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:49:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:49:29.867668 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-3b926ed8-d341-450a-9ce4-68641f94d0a2 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:49:29.868308 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-3b926ed8-d341-450a-9ce4-68641f94d0a2 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] [instance: a88193d1-d83f-49ec-bfad-753c00487b55] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:49:29.875581 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3b926ed8-d341-450a-9ce4-68641f94d0a2 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:49:29.876092 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3b926ed8-d341-450a-9ce4-68641f94d0a2 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:49:29.876554 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3b926ed8-d341-450a-9ce4-68641f94d0a2 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:49:29.877279 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3b926ed8-d341-450a-9ce4-68641f94d0a2 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:49:29.877756 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3b926ed8-d341-450a-9ce4-68641f94d0a2 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:49:29.878213 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3b926ed8-d341-450a-9ce4-68641f94d0a2 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:49:30.012909 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-3b926ed8-d341-450a-9ce4-68641f94d0a2 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9693ac87d6645c78684949d36cc1066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ae75103a974b01a05a640ff62ac845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:49:30.021530 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-3b926ed8-d341-450a-9ce4-68641f94d0a2 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] 10.222.0.43 "GET /compute/v2.1/servers/a88193d1-d83f-49ec-bfad-753c00487b55" status: 200 len: 1510 microversion: 2.1 time: 0.157229 Oct 04 22:49:30.022272 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3969/7115] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:49:29 2022] GET /compute/v2.1/servers/a88193d1-d83f-49ec-bfad-753c00487b55 => generated 1510 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:49:30.900767 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-f093429d-dc3e-4883-b7a9-ba6f2e1a3c06 req-c396b11f-3a2a-4090-ab54-6b40f74c0d6f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a88193d1-d83f-49ec-bfad-753c00487b55", "tag": "312529db-3de8-4585-a030-c7e37d18055a"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:49:30.910243 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-f093429d-dc3e-4883-b7a9-ba6f2e1a3c06 req-c396b11f-3a2a-4090-ab54-6b40f74c0d6f service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:49:30.910758 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-f093429d-dc3e-4883-b7a9-ba6f2e1a3c06 req-c396b11f-3a2a-4090-ab54-6b40f74c0d6f service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:49:30.911845 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-f093429d-dc3e-4883-b7a9-ba6f2e1a3c06 req-c396b11f-3a2a-4090-ab54-6b40f74c0d6f service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:49:30.923099 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-f093429d-dc3e-4883-b7a9-ba6f2e1a3c06 req-c396b11f-3a2a-4090-ab54-6b40f74c0d6f service nova] Creating event network-changed:312529db-3de8-4585-a030-c7e37d18055a for instance a88193d1-d83f-49ec-bfad-753c00487b55 on n-h2-860284-1 Oct 04 22:49:30.928560 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [req-f093429d-dc3e-4883-b7a9-ba6f2e1a3c06 req-c396b11f-3a2a-4090-ab54-6b40f74c0d6f service nova] Instance a88193d1-d83f-49ec-bfad-753c00487b55 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860284-1', 'n-h2-860284-1'} {{(pid=134102) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 22:49:30.938963 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-f093429d-dc3e-4883-b7a9-ba6f2e1a3c06 req-c396b11f-3a2a-4090-ab54-6b40f74c0d6f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043666 Oct 04 22:49:30.939547 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3147/7116] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:49:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:49:31.045375 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-a77bc868-3576-4f45-aeec-89454965f4ea tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:49:31.046066 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-a77bc868-3576-4f45-aeec-89454965f4ea tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] [instance: a88193d1-d83f-49ec-bfad-753c00487b55] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:49:31.053164 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a77bc868-3576-4f45-aeec-89454965f4ea tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:49:31.053674 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a77bc868-3576-4f45-aeec-89454965f4ea tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:49:31.054135 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a77bc868-3576-4f45-aeec-89454965f4ea tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:49:31.054904 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a77bc868-3576-4f45-aeec-89454965f4ea tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:49:31.055370 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a77bc868-3576-4f45-aeec-89454965f4ea tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:49:31.055826 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a77bc868-3576-4f45-aeec-89454965f4ea tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:49:31.299634 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-a77bc868-3576-4f45-aeec-89454965f4ea tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9693ac87d6645c78684949d36cc1066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ae75103a974b01a05a640ff62ac845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:49:31.307996 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-a77bc868-3576-4f45-aeec-89454965f4ea tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] 10.222.0.43 "GET /compute/v2.1/servers/a88193d1-d83f-49ec-bfad-753c00487b55" status: 200 len: 1510 microversion: 2.1 time: 0.266638 Oct 04 22:49:31.309040 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3970/7117] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:49:31 2022] GET /compute/v2.1/servers/a88193d1-d83f-49ec-bfad-753c00487b55 => generated 1510 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:49:32.329704 n-d-860284-1 devstack@n-api.service[134102]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 22:49:32.330245 n-d-860284-1 devstack@n-api.service[134102]: Tue Oct 4 22:49:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a88193d1-d83f-49ec-bfad-753c00487b55 (ip 10.222.0.43) !!! Oct 04 22:49:32.342184 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-f8b0a4d7-a585-45ef-a9a9-a376589aabf3 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:49:32.342930 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-f8b0a4d7-a585-45ef-a9a9-a376589aabf3 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] [instance: a88193d1-d83f-49ec-bfad-753c00487b55] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:49:32.350444 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f8b0a4d7-a585-45ef-a9a9-a376589aabf3 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:49:32.350937 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f8b0a4d7-a585-45ef-a9a9-a376589aabf3 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:49:32.351398 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f8b0a4d7-a585-45ef-a9a9-a376589aabf3 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:49:32.352084 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f8b0a4d7-a585-45ef-a9a9-a376589aabf3 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:49:32.352547 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f8b0a4d7-a585-45ef-a9a9-a376589aabf3 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:49:32.352980 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f8b0a4d7-a585-45ef-a9a9-a376589aabf3 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:49:32.525809 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-f8b0a4d7-a585-45ef-a9a9-a376589aabf3 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9693ac87d6645c78684949d36cc1066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ae75103a974b01a05a640ff62ac845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:49:32.534556 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-f8b0a4d7-a585-45ef-a9a9-a376589aabf3 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] 10.222.0.43 "GET /compute/v2.1/servers/a88193d1-d83f-49ec-bfad-753c00487b55" status: 200 len: 1510 microversion: 2.1 time: 0.205794 Oct 04 22:49:32.535360 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3148/7118] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:49:32 2022] GET /compute/v2.1/servers/a88193d1-d83f-49ec-bfad-753c00487b55 => generated 1510 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:49:33.559523 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e5772d4f-36f8-43bd-b733-41427bf5dd14 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:49:33.560163 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-e5772d4f-36f8-43bd-b733-41427bf5dd14 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] [instance: a88193d1-d83f-49ec-bfad-753c00487b55] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:49:33.566932 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e5772d4f-36f8-43bd-b733-41427bf5dd14 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:49:33.567587 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e5772d4f-36f8-43bd-b733-41427bf5dd14 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:49:33.568069 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e5772d4f-36f8-43bd-b733-41427bf5dd14 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:49:33.568795 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e5772d4f-36f8-43bd-b733-41427bf5dd14 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:49:33.569277 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e5772d4f-36f8-43bd-b733-41427bf5dd14 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:49:33.569727 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e5772d4f-36f8-43bd-b733-41427bf5dd14 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:49:33.701772 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-e5772d4f-36f8-43bd-b733-41427bf5dd14 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9693ac87d6645c78684949d36cc1066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ae75103a974b01a05a640ff62ac845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:49:33.709799 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-e5772d4f-36f8-43bd-b733-41427bf5dd14 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] 10.222.0.43 "GET /compute/v2.1/servers/a88193d1-d83f-49ec-bfad-753c00487b55" status: 200 len: 1507 microversion: 2.1 time: 0.154284 Oct 04 22:49:33.710382 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3971/7119] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:49:33 2022] GET /compute/v2.1/servers/a88193d1-d83f-49ec-bfad-753c00487b55 => generated 1507 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:49:33.732558 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-6977a1d4-84f9-405d-9137-e4e2ee9cb541 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:49:33.733049 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-6977a1d4-84f9-405d-9137-e4e2ee9cb541 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] [instance: a88193d1-d83f-49ec-bfad-753c00487b55] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:49:33.742898 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6977a1d4-84f9-405d-9137-e4e2ee9cb541 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:49:33.743389 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6977a1d4-84f9-405d-9137-e4e2ee9cb541 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:49:33.743839 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6977a1d4-84f9-405d-9137-e4e2ee9cb541 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:49:33.744535 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6977a1d4-84f9-405d-9137-e4e2ee9cb541 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:49:33.744997 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6977a1d4-84f9-405d-9137-e4e2ee9cb541 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:49:33.745430 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6977a1d4-84f9-405d-9137-e4e2ee9cb541 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:49:33.772197 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-6977a1d4-84f9-405d-9137-e4e2ee9cb541 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] [instance: a88193d1-d83f-49ec-bfad-753c00487b55] Going to try to terminate instance {{(pid=134102) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 22:49:33.821671 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.compute.api [None req-6977a1d4-84f9-405d-9137-e4e2ee9cb541 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] [instance: a88193d1-d83f-49ec-bfad-753c00487b55] Found an unconfirmed migration during delete, id: 16, status: finished Oct 04 22:49:34.416989 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-f011dec2-5176-4340-9bad-b8654700a7a2 req-a2bd4d5a-15b8-4e4f-bec3-fad7e9017579 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a88193d1-d83f-49ec-bfad-753c00487b55", "name": "network-vif-plugged", "status": "completed", "tag": "312529db-3de8-4585-a030-c7e37d18055a"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:49:34.427634 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-f011dec2-5176-4340-9bad-b8654700a7a2 req-a2bd4d5a-15b8-4e4f-bec3-fad7e9017579 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:49:34.428257 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-f011dec2-5176-4340-9bad-b8654700a7a2 req-a2bd4d5a-15b8-4e4f-bec3-fad7e9017579 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:49:34.428767 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-f011dec2-5176-4340-9bad-b8654700a7a2 req-a2bd4d5a-15b8-4e4f-bec3-fad7e9017579 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:49:34.441341 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-f011dec2-5176-4340-9bad-b8654700a7a2 req-a2bd4d5a-15b8-4e4f-bec3-fad7e9017579 service nova] Creating event network-vif-plugged:312529db-3de8-4585-a030-c7e37d18055a for instance a88193d1-d83f-49ec-bfad-753c00487b55 on n-h2-860284-1 Oct 04 22:49:34.448437 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [req-f011dec2-5176-4340-9bad-b8654700a7a2 req-a2bd4d5a-15b8-4e4f-bec3-fad7e9017579 service nova] Instance a88193d1-d83f-49ec-bfad-753c00487b55 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860284-1', 'n-h2-860284-1'} {{(pid=134101) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 22:49:34.461151 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-f011dec2-5176-4340-9bad-b8654700a7a2 req-a2bd4d5a-15b8-4e4f-bec3-fad7e9017579 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047992 Oct 04 22:49:34.461938 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3972/7120] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:49:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:49:35.234644 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-6977a1d4-84f9-405d-9137-e4e2ee9cb541 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] 10.222.0.43 "DELETE /compute/v2.1/servers/a88193d1-d83f-49ec-bfad-753c00487b55" status: 204 len: 0 microversion: 2.1 time: 1.505595 Oct 04 22:49:35.235295 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3149/7121] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 22:49:33 2022] DELETE /compute/v2.1/servers/a88193d1-d83f-49ec-bfad-753c00487b55 => generated 0 bytes in 1507 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 22:49:35.245305 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-72f9ff94-a331-4e58-bf34-303cec8a8d63 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:49:35.246031 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-72f9ff94-a331-4e58-bf34-303cec8a8d63 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] [instance: a88193d1-d83f-49ec-bfad-753c00487b55] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:49:35.252694 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-72f9ff94-a331-4e58-bf34-303cec8a8d63 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:49:35.253198 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-72f9ff94-a331-4e58-bf34-303cec8a8d63 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:49:35.253657 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-72f9ff94-a331-4e58-bf34-303cec8a8d63 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:49:35.254393 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-72f9ff94-a331-4e58-bf34-303cec8a8d63 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:49:35.255380 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-72f9ff94-a331-4e58-bf34-303cec8a8d63 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:49:35.256155 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-72f9ff94-a331-4e58-bf34-303cec8a8d63 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:49:35.390287 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-72f9ff94-a331-4e58-bf34-303cec8a8d63 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9693ac87d6645c78684949d36cc1066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ae75103a974b01a05a640ff62ac845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:49:35.398853 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-72f9ff94-a331-4e58-bf34-303cec8a8d63 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] 10.222.0.43 "GET /compute/v2.1/servers/a88193d1-d83f-49ec-bfad-753c00487b55" status: 200 len: 1499 microversion: 2.1 time: 0.159059 Oct 04 22:49:35.399438 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3973/7122] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:49:35 2022] GET /compute/v2.1/servers/a88193d1-d83f-49ec-bfad-753c00487b55 => generated 1499 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:49:36.422850 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-d04db29f-12ad-48e0-9800-e1c272b53727 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:49:36.423485 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-d04db29f-12ad-48e0-9800-e1c272b53727 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] [instance: a88193d1-d83f-49ec-bfad-753c00487b55] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:49:36.430425 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d04db29f-12ad-48e0-9800-e1c272b53727 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:49:36.430920 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d04db29f-12ad-48e0-9800-e1c272b53727 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:49:36.431361 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d04db29f-12ad-48e0-9800-e1c272b53727 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:49:36.432067 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d04db29f-12ad-48e0-9800-e1c272b53727 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:49:36.432522 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d04db29f-12ad-48e0-9800-e1c272b53727 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:49:36.432951 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d04db29f-12ad-48e0-9800-e1c272b53727 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:49:36.565211 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-d04db29f-12ad-48e0-9800-e1c272b53727 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9693ac87d6645c78684949d36cc1066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ae75103a974b01a05a640ff62ac845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:49:36.573970 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-d04db29f-12ad-48e0-9800-e1c272b53727 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] 10.222.0.43 "GET /compute/v2.1/servers/a88193d1-d83f-49ec-bfad-753c00487b55" status: 200 len: 1499 microversion: 2.1 time: 0.155467 Oct 04 22:49:36.574674 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3150/7123] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:49:36 2022] GET /compute/v2.1/servers/a88193d1-d83f-49ec-bfad-753c00487b55 => generated 1499 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:49:37.430557 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-8c685f93-b979-417c-8a04-4fc3474e0aa2 req-f14f13ec-1f70-41f7-acb2-92fe20eeb9db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a88193d1-d83f-49ec-bfad-753c00487b55", "name": "network-vif-deleted", "tag": "312529db-3de8-4585-a030-c7e37d18055a"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:49:37.441915 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-8c685f93-b979-417c-8a04-4fc3474e0aa2 req-f14f13ec-1f70-41f7-acb2-92fe20eeb9db service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:49:37.442785 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-8c685f93-b979-417c-8a04-4fc3474e0aa2 req-f14f13ec-1f70-41f7-acb2-92fe20eeb9db service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:49:37.443222 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-8c685f93-b979-417c-8a04-4fc3474e0aa2 req-f14f13ec-1f70-41f7-acb2-92fe20eeb9db service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:49:37.456484 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-8c685f93-b979-417c-8a04-4fc3474e0aa2 req-f14f13ec-1f70-41f7-acb2-92fe20eeb9db service nova] Creating event network-vif-deleted:312529db-3de8-4585-a030-c7e37d18055a for instance a88193d1-d83f-49ec-bfad-753c00487b55 on n-h2-860284-1 Oct 04 22:49:37.464353 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-8c685f93-b979-417c-8a04-4fc3474e0aa2 req-f14f13ec-1f70-41f7-acb2-92fe20eeb9db service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036876 Oct 04 22:49:37.465101 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3974/7124] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:49:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:49:37.597874 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-c98bf9dc-df07-4840-a441-25cec6b58886 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:49:37.599098 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-c98bf9dc-df07-4840-a441-25cec6b58886 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] [instance: a88193d1-d83f-49ec-bfad-753c00487b55] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:49:37.606082 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c98bf9dc-df07-4840-a441-25cec6b58886 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:49:37.606612 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c98bf9dc-df07-4840-a441-25cec6b58886 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:49:37.607061 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c98bf9dc-df07-4840-a441-25cec6b58886 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:49:37.607768 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c98bf9dc-df07-4840-a441-25cec6b58886 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:49:37.608232 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c98bf9dc-df07-4840-a441-25cec6b58886 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:49:37.608663 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c98bf9dc-df07-4840-a441-25cec6b58886 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:49:37.641413 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c98bf9dc-df07-4840-a441-25cec6b58886 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:49:37.641803 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c98bf9dc-df07-4840-a441-25cec6b58886 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:49:37.642243 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c98bf9dc-df07-4840-a441-25cec6b58886 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:49:37.642725 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.objects.instance [None req-c98bf9dc-df07-4840-a441-25cec6b58886 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lazy-loading 'fault' on Instance uuid a88193d1-d83f-49ec-bfad-753c00487b55 {{(pid=134102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 22:49:37.684466 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-c98bf9dc-df07-4840-a441-25cec6b58886 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9693ac87d6645c78684949d36cc1066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ae75103a974b01a05a640ff62ac845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:49:37.691579 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-c98bf9dc-df07-4840-a441-25cec6b58886 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] 10.222.0.43 "GET /compute/v2.1/servers/a88193d1-d83f-49ec-bfad-753c00487b55" status: 200 len: 1304 microversion: 2.1 time: 0.097661 Oct 04 22:49:37.693012 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3151/7125] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:49:37 2022] GET /compute/v2.1/servers/a88193d1-d83f-49ec-bfad-753c00487b55 => generated 1304 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:49:38.715953 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-ea902040-90a1-4fbb-97a1-6de8f401406a tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:49:38.716683 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-ea902040-90a1-4fbb-97a1-6de8f401406a tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] [instance: a88193d1-d83f-49ec-bfad-753c00487b55] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:49:38.724431 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ea902040-90a1-4fbb-97a1-6de8f401406a tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:49:38.724939 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ea902040-90a1-4fbb-97a1-6de8f401406a tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:49:38.725397 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ea902040-90a1-4fbb-97a1-6de8f401406a tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:49:38.726115 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ea902040-90a1-4fbb-97a1-6de8f401406a tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:49:38.726624 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ea902040-90a1-4fbb-97a1-6de8f401406a tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:49:38.727076 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ea902040-90a1-4fbb-97a1-6de8f401406a tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:49:38.740779 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-ea902040-90a1-4fbb-97a1-6de8f401406a tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] HTTP exception thrown: Instance a88193d1-d83f-49ec-bfad-753c00487b55 could not be found. Oct 04 22:49:38.742444 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-ea902040-90a1-4fbb-97a1-6de8f401406a tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Request method failure captured: Oct 04 22:49:38.742444 n-d-860284-1 devstack@n-api.service[134101]: request: GET /compute/v2.1/servers/a88193d1-d83f-49ec-bfad-753c00487b55 HTTP/1.1 Oct 04 22:49:38.742444 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 22:49:38.742444 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 22:49:38.742444 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 22:49:38.742444 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 22:49:38.742444 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 22:49:38.742444 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 22:49:38.742444 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 22:49:38.742444 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 22:49:38.742444 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPLhO-c8ao2NGHDUirVqzxbe7ks71BG_CdEHNJVMCggJJFEiCJpoQYpUEw_MuBgtOVzgBC39V6H_7smFKvsYhyEM5ZZKzidsxvSGHEDaHHRJe8Za1SUM6JO58BRypz7RqMi287Nto9eL2ckRgsI-prsPgy7Gvah-vLgQQ3o43CX6o_eY Oct 04 22:49:38.742444 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 22:49:38.742444 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 22:49:38.742444 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 22:49:38.742444 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 22:49:38.742444 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 22:49:38.742444 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 22:49:38.742444 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: b2ae75103a974b01a05a640ff62ac845 Oct 04 22:49:38.742444 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-DeleteServersTestJSON-1538550069 Oct 04 22:49:38.742444 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 22:49:38.742444 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 22:49:38.742444 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b2ae75103a974b01a05a640ff62ac845"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_b2ae75103a974b01a05a640ff62ac845", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b2ae75103a974b01a05a640ff62ac845"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/b2ae75103a974b01a05a640ff62ac845"}]}] Oct 04 22:49:38.742444 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-DeleteServersTestJSON-1538550069 Oct 04 22:49:38.742444 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: b2ae75103a974b01a05a640ff62ac845 Oct 04 22:49:38.742444 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-DeleteServersTestJSON-1538550069 Oct 04 22:49:38.742444 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-DeleteServersTestJSON-1538550069-project Oct 04 22:49:38.742444 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 22:49:38.742444 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 22:49:38.742444 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: d9693ac87d6645c78684949d36cc1066 Oct 04 22:49:38.742444 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-DeleteServersTestJSON-1538550069-project Oct 04 22:49:38.742444 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 22:49:38.742444 n-d-860284-1 devstack@n-api.service[134101]: exception: Instance a88193d1-d83f-49ec-bfad-753c00487b55 could not be found. Oct 04 22:49:38.742444 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': 'a88193d1-d83f-49ec-bfad-753c00487b55'} Oct 04 22:49:38.742444 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:49:38.742444 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:49:38.742444 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:49:38.742444 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:49:38.742444 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:49:38.742444 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:49:38.742444 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:49:38.742444 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:49:38.742444 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:49:38.742444 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:49:38.742444 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a88193d1-d83f-49ec-bfad-753c00487b55 could not be found. Oct 04 22:49:38.742444 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:49:38.742444 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:49:38.742444 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:49:38.742444 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:49:38.742444 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:49:38.742444 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:49:38.742444 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:49:38.742444 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:49:38.742444 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:49:38.742444 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:49:38.742444 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:49:38.742444 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:49:38.742444 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:49:38.742444 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:49:38.742444 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:49:38.742444 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:49:38.742444 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a88193d1-d83f-49ec-bfad-753c00487b55 could not be found. Oct 04 22:49:38.742444 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:49:38.742444 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:49:38.742444 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:49:38.746677 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:49:38.746677 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:49:38.746677 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:49:38.746677 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:49:38.746677 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:49:38.746677 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a88193d1-d83f-49ec-bfad-753c00487b55 could not be found. Oct 04 22:49:38.746677 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:49:38.746677 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-ea902040-90a1-4fbb-97a1-6de8f401406a tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Returning 404 to user: Instance a88193d1-d83f-49ec-bfad-753c00487b55 could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:49:38.746677 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-ea902040-90a1-4fbb-97a1-6de8f401406a tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] 10.222.0.43 "GET /compute/v2.1/servers/a88193d1-d83f-49ec-bfad-753c00487b55" status: 404 len: 111 microversion: 2.1 time: 0.032337 Oct 04 22:49:38.746677 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3975/7126] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:49:38 2022] GET /compute/v2.1/servers/a88193d1-d83f-49ec-bfad-753c00487b55 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:49:38.759764 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-bcc4375d-db6a-430b-9682-48856f288178 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:49:38.760272 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-bcc4375d-db6a-430b-9682-48856f288178 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] [instance: a88193d1-d83f-49ec-bfad-753c00487b55] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:49:38.767154 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bcc4375d-db6a-430b-9682-48856f288178 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:49:38.767643 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bcc4375d-db6a-430b-9682-48856f288178 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:49:38.768082 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bcc4375d-db6a-430b-9682-48856f288178 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:49:38.768781 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bcc4375d-db6a-430b-9682-48856f288178 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:49:38.769242 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bcc4375d-db6a-430b-9682-48856f288178 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:49:38.769675 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bcc4375d-db6a-430b-9682-48856f288178 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:49:38.783697 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-bcc4375d-db6a-430b-9682-48856f288178 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] HTTP exception thrown: Instance a88193d1-d83f-49ec-bfad-753c00487b55 could not be found. Oct 04 22:49:38.785345 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-bcc4375d-db6a-430b-9682-48856f288178 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Request method failure captured: Oct 04 22:49:38.785345 n-d-860284-1 devstack@n-api.service[134102]: request: DELETE /compute/v2.1/servers/a88193d1-d83f-49ec-bfad-753c00487b55 HTTP/1.1 Oct 04 22:49:38.785345 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 22:49:38.785345 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 22:49:38.785345 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 22:49:38.785345 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 22:49:38.785345 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 22:49:38.785345 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 22:49:38.785345 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 22:49:38.785345 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 22:49:38.785345 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPLhO-c8ao2NGHDUirVqzxbe7ks71BG_CdEHNJVMCggJJFEiCJpoQYpUEw_MuBgtOVzgBC39V6H_7smFKvsYhyEM5ZZKzidsxvSGHEDaHHRJe8Za1SUM6JO58BRypz7RqMi287Nto9eL2ckRgsI-prsPgy7Gvah-vLgQQ3o43CX6o_eY Oct 04 22:49:38.785345 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 22:49:38.785345 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 22:49:38.785345 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 22:49:38.785345 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 22:49:38.785345 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 22:49:38.785345 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 22:49:38.785345 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: b2ae75103a974b01a05a640ff62ac845 Oct 04 22:49:38.785345 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-DeleteServersTestJSON-1538550069 Oct 04 22:49:38.785345 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 22:49:38.785345 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 22:49:38.785345 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b2ae75103a974b01a05a640ff62ac845"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_b2ae75103a974b01a05a640ff62ac845", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b2ae75103a974b01a05a640ff62ac845"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/b2ae75103a974b01a05a640ff62ac845"}]}] Oct 04 22:49:38.785345 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-DeleteServersTestJSON-1538550069 Oct 04 22:49:38.785345 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: b2ae75103a974b01a05a640ff62ac845 Oct 04 22:49:38.785345 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-DeleteServersTestJSON-1538550069 Oct 04 22:49:38.785345 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-DeleteServersTestJSON-1538550069-project Oct 04 22:49:38.785345 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 22:49:38.785345 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 22:49:38.785345 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: d9693ac87d6645c78684949d36cc1066 Oct 04 22:49:38.785345 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-DeleteServersTestJSON-1538550069-project Oct 04 22:49:38.785345 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 22:49:38.785345 n-d-860284-1 devstack@n-api.service[134102]: exception: Instance a88193d1-d83f-49ec-bfad-753c00487b55 could not be found. Oct 04 22:49:38.785345 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': 'a88193d1-d83f-49ec-bfad-753c00487b55'} Oct 04 22:49:38.785345 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:49:38.785345 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:49:38.785345 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:49:38.785345 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:49:38.785345 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:49:38.785345 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:49:38.785345 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:49:38.785345 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:49:38.785345 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:49:38.785345 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:49:38.785345 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a88193d1-d83f-49ec-bfad-753c00487b55 could not be found. Oct 04 22:49:38.785345 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:49:38.785345 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:49:38.785345 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:49:38.785345 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:49:38.785345 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:49:38.785345 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:49:38.785345 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:49:38.785345 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:49:38.785345 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:49:38.785345 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:49:38.785345 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 22:49:38.785345 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 22:49:38.785345 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 22:49:38.785345 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 22:49:38.785345 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:49:38.785345 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:49:38.785345 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:49:38.785345 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:49:38.790708 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a88193d1-d83f-49ec-bfad-753c00487b55 could not be found. Oct 04 22:49:38.790708 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:49:38.790708 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:49:38.790708 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:49:38.790708 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:49:38.790708 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:49:38.790708 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:49:38.790708 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:49:38.790708 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:49:38.790708 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a88193d1-d83f-49ec-bfad-753c00487b55 could not be found. Oct 04 22:49:38.790708 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:49:38.790708 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-bcc4375d-db6a-430b-9682-48856f288178 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Returning 404 to user: Instance a88193d1-d83f-49ec-bfad-753c00487b55 could not be found. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:49:38.790708 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-bcc4375d-db6a-430b-9682-48856f288178 tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] 10.222.0.43 "DELETE /compute/v2.1/servers/a88193d1-d83f-49ec-bfad-753c00487b55" status: 404 len: 111 microversion: 2.1 time: 0.030957 Oct 04 22:49:38.790708 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3152/7127] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 22:49:38 2022] DELETE /compute/v2.1/servers/a88193d1-d83f-49ec-bfad-753c00487b55 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:49:38.795281 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-67a33834-f1ae-49d3-8af1-76d3f872927f tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:49:38.795916 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-67a33834-f1ae-49d3-8af1-76d3f872927f tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] [instance: a88193d1-d83f-49ec-bfad-753c00487b55] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:49:38.801893 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-67a33834-f1ae-49d3-8af1-76d3f872927f tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:49:38.802421 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-67a33834-f1ae-49d3-8af1-76d3f872927f tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:49:38.802879 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-67a33834-f1ae-49d3-8af1-76d3f872927f tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:49:38.803586 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-67a33834-f1ae-49d3-8af1-76d3f872927f tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:49:38.804058 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-67a33834-f1ae-49d3-8af1-76d3f872927f tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:49:38.804504 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-67a33834-f1ae-49d3-8af1-76d3f872927f tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:49:38.818399 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-67a33834-f1ae-49d3-8af1-76d3f872927f tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] HTTP exception thrown: Instance a88193d1-d83f-49ec-bfad-753c00487b55 could not be found. Oct 04 22:49:38.819980 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-67a33834-f1ae-49d3-8af1-76d3f872927f tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Request method failure captured: Oct 04 22:49:38.819980 n-d-860284-1 devstack@n-api.service[134101]: request: GET /compute/v2.1/servers/a88193d1-d83f-49ec-bfad-753c00487b55 HTTP/1.1 Oct 04 22:49:38.819980 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 22:49:38.819980 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 22:49:38.819980 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 22:49:38.819980 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 22:49:38.819980 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 22:49:38.819980 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 22:49:38.819980 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 22:49:38.819980 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 22:49:38.819980 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPLhO-c8ao2NGHDUirVqzxbe7ks71BG_CdEHNJVMCggJJFEiCJpoQYpUEw_MuBgtOVzgBC39V6H_7smFKvsYhyEM5ZZKzidsxvSGHEDaHHRJe8Za1SUM6JO58BRypz7RqMi287Nto9eL2ckRgsI-prsPgy7Gvah-vLgQQ3o43CX6o_eY Oct 04 22:49:38.819980 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 22:49:38.819980 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 22:49:38.819980 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 22:49:38.819980 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 22:49:38.819980 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 22:49:38.819980 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 22:49:38.819980 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: b2ae75103a974b01a05a640ff62ac845 Oct 04 22:49:38.819980 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-DeleteServersTestJSON-1538550069 Oct 04 22:49:38.819980 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 22:49:38.819980 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 22:49:38.819980 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b2ae75103a974b01a05a640ff62ac845"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_b2ae75103a974b01a05a640ff62ac845", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b2ae75103a974b01a05a640ff62ac845"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/b2ae75103a974b01a05a640ff62ac845"}]}] Oct 04 22:49:38.819980 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-DeleteServersTestJSON-1538550069 Oct 04 22:49:38.819980 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: b2ae75103a974b01a05a640ff62ac845 Oct 04 22:49:38.819980 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-DeleteServersTestJSON-1538550069 Oct 04 22:49:38.819980 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-DeleteServersTestJSON-1538550069-project Oct 04 22:49:38.819980 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 22:49:38.819980 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 22:49:38.819980 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: d9693ac87d6645c78684949d36cc1066 Oct 04 22:49:38.819980 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-DeleteServersTestJSON-1538550069-project Oct 04 22:49:38.819980 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 22:49:38.819980 n-d-860284-1 devstack@n-api.service[134101]: exception: Instance a88193d1-d83f-49ec-bfad-753c00487b55 could not be found. Oct 04 22:49:38.819980 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': 'a88193d1-d83f-49ec-bfad-753c00487b55'} Oct 04 22:49:38.819980 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:49:38.819980 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:49:38.819980 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:49:38.819980 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:49:38.819980 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:49:38.819980 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:49:38.819980 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:49:38.819980 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:49:38.819980 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:49:38.819980 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:49:38.819980 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a88193d1-d83f-49ec-bfad-753c00487b55 could not be found. Oct 04 22:49:38.819980 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:49:38.819980 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:49:38.819980 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:49:38.819980 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:49:38.819980 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:49:38.819980 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:49:38.819980 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:49:38.819980 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:49:38.819980 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:49:38.819980 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:49:38.819980 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:49:38.819980 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:49:38.819980 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:49:38.819980 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:49:38.819980 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:49:38.819980 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:49:38.819980 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a88193d1-d83f-49ec-bfad-753c00487b55 could not be found. Oct 04 22:49:38.819980 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:49:38.819980 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:49:38.819980 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:49:38.823898 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:49:38.823898 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:49:38.823898 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:49:38.823898 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:49:38.823898 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:49:38.823898 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a88193d1-d83f-49ec-bfad-753c00487b55 could not be found. Oct 04 22:49:38.823898 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:49:38.823898 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-67a33834-f1ae-49d3-8af1-76d3f872927f tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] Returning 404 to user: Instance a88193d1-d83f-49ec-bfad-753c00487b55 could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:49:38.823898 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-67a33834-f1ae-49d3-8af1-76d3f872927f tempest-DeleteServersTestJSON-1538550069 tempest-DeleteServersTestJSON-1538550069-project] 10.222.0.43 "GET /compute/v2.1/servers/a88193d1-d83f-49ec-bfad-753c00487b55" status: 404 len: 111 microversion: 2.1 time: 0.030040 Oct 04 22:49:38.823898 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3976/7128] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:49:38 2022] GET /compute/v2.1/servers/a88193d1-d83f-49ec-bfad-753c00487b55 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:49:47.372129 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-b86ea5a5-57f6-43f9-b670-a59a867bb441 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-477641233", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452", "networks": [{"uuid": "287ab509-6835-44ac-8e49-a0088c426250"}]}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:49:47.429552 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.network.neutron [None req-b86ea5a5-57f6-43f9-b670-a59a867bb441 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] validate_networks() for [('287ab509-6835-44ac-8e49-a0088c426250', None, None, None, None, None)] {{(pid=134102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 22:49:47.841008 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-b86ea5a5-57f6-43f9-b670-a59a867bb441 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Flavor limits 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 22:49:47.841427 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-b86ea5a5-57f6-43f9-b670-a59a867bb441 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Image limits 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 22:49:47.841897 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-b86ea5a5-57f6-43f9-b670-a59a867bb441 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Flavor pref 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 22:49:47.842304 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-b86ea5a5-57f6-43f9-b670-a59a867bb441 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Image pref 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 22:49:47.842830 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-b86ea5a5-57f6-43f9-b670-a59a867bb441 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 22:49:47.852844 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b86ea5a5-57f6-43f9-b670-a59a867bb441 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:49:47.853339 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b86ea5a5-57f6-43f9-b670-a59a867bb441 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:49:47.853800 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b86ea5a5-57f6-43f9-b670-a59a867bb441 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:49:47.854592 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b86ea5a5-57f6-43f9-b670-a59a867bb441 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:49:47.855054 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b86ea5a5-57f6-43f9-b670-a59a867bb441 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:49:47.855516 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b86ea5a5-57f6-43f9-b670-a59a867bb441 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:49:47.873598 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-b86ea5a5-57f6-43f9-b670-a59a867bb441 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Getting quotas for project 8ec852e304484d27a84980417fffda0e. Resources: {'instances', 'ram', 'cores'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:49:47.879362 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-b86ea5a5-57f6-43f9-b670-a59a867bb441 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Getting quotas for user d0ebea4a152f4d01864ca878e528642c and project 8ec852e304484d27a84980417fffda0e. Resources: {'instances', 'ram', 'cores'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:49:47.892122 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-b86ea5a5-57f6-43f9-b670-a59a867bb441 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Going to run 1 instances... {{(pid=134102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 22:49:47.894499 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-b86ea5a5-57f6-43f9-b670-a59a867bb441 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] [instance: e351bace-1f8c-4b1e-b53b-3d4936a8209d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='58548514-5dac-426c-81f5-19e3fba33e23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 22:49:47.944784 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-b86ea5a5-57f6-43f9-b670-a59a867bb441 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.700061 Oct 04 22:49:47.945726 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3153/7129] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 22:49:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 701 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 22:49:47.956933 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-ea596671-60c0-49a2-87df-bf1216872156 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:49:47.958744 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-ea596671-60c0-49a2-87df-bf1216872156 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] [instance: e351bace-1f8c-4b1e-b53b-3d4936a8209d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:49:48.017937 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-ea596671-60c0-49a2-87df-bf1216872156 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ebea4a152f4d01864ca878e528642c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec852e304484d27a84980417fffda0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:49:48.025200 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-ea596671-60c0-49a2-87df-bf1216872156 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] 10.222.0.43 "GET /compute/v2.1/servers/e351bace-1f8c-4b1e-b53b-3d4936a8209d" status: 200 len: 1217 microversion: 2.1 time: 0.072305 Oct 04 22:49:48.025814 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3977/7130] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:49:47 2022] GET /compute/v2.1/servers/e351bace-1f8c-4b1e-b53b-3d4936a8209d => generated 1217 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:49:49.049386 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-4cf7a74b-2301-42b9-a626-b14a46626f06 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:49:49.050147 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-4cf7a74b-2301-42b9-a626-b14a46626f06 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] [instance: e351bace-1f8c-4b1e-b53b-3d4936a8209d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:49:49.059050 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4cf7a74b-2301-42b9-a626-b14a46626f06 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:49:49.059844 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4cf7a74b-2301-42b9-a626-b14a46626f06 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:49:49.060396 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4cf7a74b-2301-42b9-a626-b14a46626f06 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:49:49.061210 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4cf7a74b-2301-42b9-a626-b14a46626f06 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:49:49.061780 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4cf7a74b-2301-42b9-a626-b14a46626f06 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:49:49.062318 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4cf7a74b-2301-42b9-a626-b14a46626f06 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:49:49.167787 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-4cf7a74b-2301-42b9-a626-b14a46626f06 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ebea4a152f4d01864ca878e528642c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec852e304484d27a84980417fffda0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:49:49.175538 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-4cf7a74b-2301-42b9-a626-b14a46626f06 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] 10.222.0.43 "GET /compute/v2.1/servers/e351bace-1f8c-4b1e-b53b-3d4936a8209d" status: 200 len: 1277 microversion: 2.1 time: 0.130242 Oct 04 22:49:49.176054 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3154/7131] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:49:49 2022] GET /compute/v2.1/servers/e351bace-1f8c-4b1e-b53b-3d4936a8209d => generated 1277 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:49:50.199533 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-c8ed9df9-f895-4a92-be6f-8af0ea1895e6 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:49:50.200387 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-c8ed9df9-f895-4a92-be6f-8af0ea1895e6 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] [instance: e351bace-1f8c-4b1e-b53b-3d4936a8209d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:49:50.202837 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=39 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:49:50.213495 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c8ed9df9-f895-4a92-be6f-8af0ea1895e6 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:49:50.214088 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c8ed9df9-f895-4a92-be6f-8af0ea1895e6 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:49:50.214646 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c8ed9df9-f895-4a92-be6f-8af0ea1895e6 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:49:50.215461 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c8ed9df9-f895-4a92-be6f-8af0ea1895e6 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:49:50.216016 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c8ed9df9-f895-4a92-be6f-8af0ea1895e6 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:49:50.216530 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c8ed9df9-f895-4a92-be6f-8af0ea1895e6 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:49:50.369823 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-c8ed9df9-f895-4a92-be6f-8af0ea1895e6 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ebea4a152f4d01864ca878e528642c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec852e304484d27a84980417fffda0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:49:50.378466 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-c8ed9df9-f895-4a92-be6f-8af0ea1895e6 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] 10.222.0.43 "GET /compute/v2.1/servers/e351bace-1f8c-4b1e-b53b-3d4936a8209d" status: 200 len: 1317 microversion: 2.1 time: 0.182860 Oct 04 22:49:50.379072 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3978/7132] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:49:50 2022] GET /compute/v2.1/servers/e351bace-1f8c-4b1e-b53b-3d4936a8209d => generated 1317 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:49:50.525982 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-f7019744-917b-4e39-9c57-4b200b7c43d0 req-2f85ac48-16ac-486f-b91d-05f9cf3fbb08 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e351bace-1f8c-4b1e-b53b-3d4936a8209d", "tag": "a8bbd5fa-b77a-444b-bf4a-5ea729c1b8fc"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:49:50.544447 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-f7019744-917b-4e39-9c57-4b200b7c43d0 req-2f85ac48-16ac-486f-b91d-05f9cf3fbb08 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:49:50.544603 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-f7019744-917b-4e39-9c57-4b200b7c43d0 req-2f85ac48-16ac-486f-b91d-05f9cf3fbb08 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:49:50.545245 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-f7019744-917b-4e39-9c57-4b200b7c43d0 req-2f85ac48-16ac-486f-b91d-05f9cf3fbb08 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:49:50.556952 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-f7019744-917b-4e39-9c57-4b200b7c43d0 req-2f85ac48-16ac-486f-b91d-05f9cf3fbb08 service nova] Creating event network-changed:a8bbd5fa-b77a-444b-bf4a-5ea729c1b8fc for instance e351bace-1f8c-4b1e-b53b-3d4936a8209d on n-h2-860284-1 Oct 04 22:49:50.561837 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-f7019744-917b-4e39-9c57-4b200b7c43d0 req-2f85ac48-16ac-486f-b91d-05f9cf3fbb08 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039564 Oct 04 22:49:50.562570 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3155/7133] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:49:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:49:51.405381 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-58204bf2-c100-410e-a621-e02faf12b729 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:49:51.405915 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-58204bf2-c100-410e-a621-e02faf12b729 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] [instance: e351bace-1f8c-4b1e-b53b-3d4936a8209d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:49:51.412861 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-58204bf2-c100-410e-a621-e02faf12b729 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:49:51.413369 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-58204bf2-c100-410e-a621-e02faf12b729 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:49:51.413837 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-58204bf2-c100-410e-a621-e02faf12b729 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:49:51.414588 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-58204bf2-c100-410e-a621-e02faf12b729 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:49:51.415071 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-58204bf2-c100-410e-a621-e02faf12b729 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:49:51.415521 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-58204bf2-c100-410e-a621-e02faf12b729 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:49:51.546006 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-58204bf2-c100-410e-a621-e02faf12b729 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ebea4a152f4d01864ca878e528642c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec852e304484d27a84980417fffda0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:49:51.554679 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-58204bf2-c100-410e-a621-e02faf12b729 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] 10.222.0.43 "GET /compute/v2.1/servers/e351bace-1f8c-4b1e-b53b-3d4936a8209d" status: 200 len: 1317 microversion: 2.1 time: 0.153453 Oct 04 22:49:51.555262 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3979/7134] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:49:51 2022] GET /compute/v2.1/servers/e351bace-1f8c-4b1e-b53b-3d4936a8209d => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:49:52.580785 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-c1b7956f-33d6-4d9b-80db-db85dc79d72d tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:49:52.581530 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-c1b7956f-33d6-4d9b-80db-db85dc79d72d tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] [instance: e351bace-1f8c-4b1e-b53b-3d4936a8209d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:49:52.587850 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c1b7956f-33d6-4d9b-80db-db85dc79d72d tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:49:52.588337 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c1b7956f-33d6-4d9b-80db-db85dc79d72d tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:49:52.588774 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c1b7956f-33d6-4d9b-80db-db85dc79d72d tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:49:52.589511 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c1b7956f-33d6-4d9b-80db-db85dc79d72d tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:49:52.589920 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c1b7956f-33d6-4d9b-80db-db85dc79d72d tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:49:52.590389 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c1b7956f-33d6-4d9b-80db-db85dc79d72d tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:49:52.731856 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-c1b7956f-33d6-4d9b-80db-db85dc79d72d tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ebea4a152f4d01864ca878e528642c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec852e304484d27a84980417fffda0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:49:52.740182 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-c1b7956f-33d6-4d9b-80db-db85dc79d72d tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] 10.222.0.43 "GET /compute/v2.1/servers/e351bace-1f8c-4b1e-b53b-3d4936a8209d" status: 200 len: 1317 microversion: 2.1 time: 0.165827 Oct 04 22:49:52.740777 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3156/7135] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:49:52 2022] GET /compute/v2.1/servers/e351bace-1f8c-4b1e-b53b-3d4936a8209d => generated 1317 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:49:53.762746 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-868db62d-cd1b-466a-8772-4ff27a5242c8 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:49:53.763392 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-868db62d-cd1b-466a-8772-4ff27a5242c8 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] [instance: e351bace-1f8c-4b1e-b53b-3d4936a8209d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:49:53.770542 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-868db62d-cd1b-466a-8772-4ff27a5242c8 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:49:53.771054 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-868db62d-cd1b-466a-8772-4ff27a5242c8 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:49:53.771518 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-868db62d-cd1b-466a-8772-4ff27a5242c8 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:49:53.772261 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-868db62d-cd1b-466a-8772-4ff27a5242c8 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:49:53.772721 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-868db62d-cd1b-466a-8772-4ff27a5242c8 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:49:53.773174 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-868db62d-cd1b-466a-8772-4ff27a5242c8 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:49:53.904197 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-868db62d-cd1b-466a-8772-4ff27a5242c8 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ebea4a152f4d01864ca878e528642c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec852e304484d27a84980417fffda0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:49:53.912660 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-868db62d-cd1b-466a-8772-4ff27a5242c8 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] 10.222.0.43 "GET /compute/v2.1/servers/e351bace-1f8c-4b1e-b53b-3d4936a8209d" status: 200 len: 1317 microversion: 2.1 time: 0.153941 Oct 04 22:49:53.913249 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3980/7136] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:49:53 2022] GET /compute/v2.1/servers/e351bace-1f8c-4b1e-b53b-3d4936a8209d => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:49:54.935178 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-0ecd8762-ea4b-48b5-9984-8a7beeb7e75d tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:49:54.935797 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-0ecd8762-ea4b-48b5-9984-8a7beeb7e75d tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] [instance: e351bace-1f8c-4b1e-b53b-3d4936a8209d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:49:54.942500 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0ecd8762-ea4b-48b5-9984-8a7beeb7e75d tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:49:54.942994 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0ecd8762-ea4b-48b5-9984-8a7beeb7e75d tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:49:54.943436 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0ecd8762-ea4b-48b5-9984-8a7beeb7e75d tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:49:54.944136 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0ecd8762-ea4b-48b5-9984-8a7beeb7e75d tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:49:54.944590 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0ecd8762-ea4b-48b5-9984-8a7beeb7e75d tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:49:54.945013 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0ecd8762-ea4b-48b5-9984-8a7beeb7e75d tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:49:55.084385 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-0ecd8762-ea4b-48b5-9984-8a7beeb7e75d tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ebea4a152f4d01864ca878e528642c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec852e304484d27a84980417fffda0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:49:55.092088 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-0ecd8762-ea4b-48b5-9984-8a7beeb7e75d tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] 10.222.0.43 "GET /compute/v2.1/servers/e351bace-1f8c-4b1e-b53b-3d4936a8209d" status: 200 len: 1317 microversion: 2.1 time: 0.160887 Oct 04 22:49:55.092670 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3157/7137] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:49:54 2022] GET /compute/v2.1/servers/e351bace-1f8c-4b1e-b53b-3d4936a8209d => generated 1317 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:49:56.116209 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-86b0bce5-e38d-4a05-8ee6-31c6c9877ecf tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:49:56.116924 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-86b0bce5-e38d-4a05-8ee6-31c6c9877ecf tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] [instance: e351bace-1f8c-4b1e-b53b-3d4936a8209d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:49:56.123847 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-86b0bce5-e38d-4a05-8ee6-31c6c9877ecf tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:49:56.124353 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-86b0bce5-e38d-4a05-8ee6-31c6c9877ecf tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:49:56.125072 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-86b0bce5-e38d-4a05-8ee6-31c6c9877ecf tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:49:56.125799 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-86b0bce5-e38d-4a05-8ee6-31c6c9877ecf tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:49:56.126274 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-86b0bce5-e38d-4a05-8ee6-31c6c9877ecf tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:49:56.126750 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-86b0bce5-e38d-4a05-8ee6-31c6c9877ecf tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:49:56.257120 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-86b0bce5-e38d-4a05-8ee6-31c6c9877ecf tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ebea4a152f4d01864ca878e528642c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec852e304484d27a84980417fffda0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:49:56.264912 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-86b0bce5-e38d-4a05-8ee6-31c6c9877ecf tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] 10.222.0.43 "GET /compute/v2.1/servers/e351bace-1f8c-4b1e-b53b-3d4936a8209d" status: 200 len: 1317 microversion: 2.1 time: 0.153381 Oct 04 22:49:56.265490 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3981/7138] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:49:56 2022] GET /compute/v2.1/servers/e351bace-1f8c-4b1e-b53b-3d4936a8209d => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:49:56.573489 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-083ce1ad-77ca-4827-ac1b-0e96fdbb82a6 req-6783914c-b726-491e-9400-d381714d3039 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e351bace-1f8c-4b1e-b53b-3d4936a8209d", "name": "network-vif-plugged", "status": "completed", "tag": "a8bbd5fa-b77a-444b-bf4a-5ea729c1b8fc"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:49:56.585712 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-083ce1ad-77ca-4827-ac1b-0e96fdbb82a6 req-6783914c-b726-491e-9400-d381714d3039 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:49:56.586200 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-083ce1ad-77ca-4827-ac1b-0e96fdbb82a6 req-6783914c-b726-491e-9400-d381714d3039 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:49:56.586667 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-083ce1ad-77ca-4827-ac1b-0e96fdbb82a6 req-6783914c-b726-491e-9400-d381714d3039 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:49:56.597880 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-083ce1ad-77ca-4827-ac1b-0e96fdbb82a6 req-6783914c-b726-491e-9400-d381714d3039 service nova] Creating event network-vif-plugged:a8bbd5fa-b77a-444b-bf4a-5ea729c1b8fc for instance e351bace-1f8c-4b1e-b53b-3d4936a8209d on n-h2-860284-1 Oct 04 22:49:56.603585 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-083ce1ad-77ca-4827-ac1b-0e96fdbb82a6 req-6783914c-b726-491e-9400-d381714d3039 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033953 Oct 04 22:49:56.604394 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3158/7139] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:49:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:49:57.288715 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-1a813f13-6dca-4fb7-bc06-8b2965d26dbc tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:49:57.289377 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-1a813f13-6dca-4fb7-bc06-8b2965d26dbc tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] [instance: e351bace-1f8c-4b1e-b53b-3d4936a8209d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:49:57.296299 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1a813f13-6dca-4fb7-bc06-8b2965d26dbc tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:49:57.296810 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1a813f13-6dca-4fb7-bc06-8b2965d26dbc tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:49:57.297305 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1a813f13-6dca-4fb7-bc06-8b2965d26dbc tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:49:57.298028 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1a813f13-6dca-4fb7-bc06-8b2965d26dbc tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:49:57.298551 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1a813f13-6dca-4fb7-bc06-8b2965d26dbc tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:49:57.299009 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1a813f13-6dca-4fb7-bc06-8b2965d26dbc tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:49:57.429277 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-1a813f13-6dca-4fb7-bc06-8b2965d26dbc tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ebea4a152f4d01864ca878e528642c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec852e304484d27a84980417fffda0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:49:57.437144 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-1a813f13-6dca-4fb7-bc06-8b2965d26dbc tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] 10.222.0.43 "GET /compute/v2.1/servers/e351bace-1f8c-4b1e-b53b-3d4936a8209d" status: 200 len: 1317 microversion: 2.1 time: 0.152969 Oct 04 22:49:57.437734 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3982/7140] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:49:57 2022] GET /compute/v2.1/servers/e351bace-1f8c-4b1e-b53b-3d4936a8209d => generated 1317 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:49:58.457703 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell0:SELECT=2 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:49:58.458563 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell0:SELECT=6 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:49:58.463054 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-1e54d7a0-b2b4-4944-b85f-462f2c3b7a02 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:49:58.463764 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-1e54d7a0-b2b4-4944-b85f-462f2c3b7a02 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] [instance: e351bace-1f8c-4b1e-b53b-3d4936a8209d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:49:58.465562 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:49:58.472679 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1e54d7a0-b2b4-4944-b85f-462f2c3b7a02 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:49:58.473885 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1e54d7a0-b2b4-4944-b85f-462f2c3b7a02 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:49:58.474513 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1e54d7a0-b2b4-4944-b85f-462f2c3b7a02 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:49:58.475229 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1e54d7a0-b2b4-4944-b85f-462f2c3b7a02 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:49:58.475695 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1e54d7a0-b2b4-4944-b85f-462f2c3b7a02 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:49:58.476133 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1e54d7a0-b2b4-4944-b85f-462f2c3b7a02 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:49:58.479329 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:49:58.618119 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-1e54d7a0-b2b4-4944-b85f-462f2c3b7a02 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ebea4a152f4d01864ca878e528642c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec852e304484d27a84980417fffda0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:49:58.626117 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-1e54d7a0-b2b4-4944-b85f-462f2c3b7a02 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] 10.222.0.43 "GET /compute/v2.1/servers/e351bace-1f8c-4b1e-b53b-3d4936a8209d" status: 200 len: 1506 microversion: 2.1 time: 0.170256 Oct 04 22:49:58.626728 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3159/7141] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:49:58 2022] GET /compute/v2.1/servers/e351bace-1f8c-4b1e-b53b-3d4936a8209d => generated 1506 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:49:58.649057 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-5a2c7b67-0377-4dcf-b7e6-b03c854c08e5 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:49:58.649683 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-5a2c7b67-0377-4dcf-b7e6-b03c854c08e5 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] [instance: e351bace-1f8c-4b1e-b53b-3d4936a8209d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:49:58.651619 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=2 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:49:58.657827 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5a2c7b67-0377-4dcf-b7e6-b03c854c08e5 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:49:58.658323 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5a2c7b67-0377-4dcf-b7e6-b03c854c08e5 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:49:58.658804 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5a2c7b67-0377-4dcf-b7e6-b03c854c08e5 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:49:58.659510 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5a2c7b67-0377-4dcf-b7e6-b03c854c08e5 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:49:58.659980 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5a2c7b67-0377-4dcf-b7e6-b03c854c08e5 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:49:58.660423 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5a2c7b67-0377-4dcf-b7e6-b03c854c08e5 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:49:58.799219 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-5a2c7b67-0377-4dcf-b7e6-b03c854c08e5 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ebea4a152f4d01864ca878e528642c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec852e304484d27a84980417fffda0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:49:58.807659 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-5a2c7b67-0377-4dcf-b7e6-b03c854c08e5 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] 10.222.0.43 "GET /compute/v2.1/servers/e351bace-1f8c-4b1e-b53b-3d4936a8209d" status: 200 len: 1506 microversion: 2.1 time: 0.163170 Oct 04 22:49:58.808239 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3983/7142] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:49:58 2022] GET /compute/v2.1/servers/e351bace-1f8c-4b1e-b53b-3d4936a8209d => generated 1506 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:49:58.830809 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-323f134f-830c-4c8b-ab39-8496855a4733 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:49:58.833342 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-323f134f-830c-4c8b-ab39-8496855a4733 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] [instance: e351bace-1f8c-4b1e-b53b-3d4936a8209d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:49:58.839644 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-323f134f-830c-4c8b-ab39-8496855a4733 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:49:58.840133 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-323f134f-830c-4c8b-ab39-8496855a4733 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:49:58.840575 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-323f134f-830c-4c8b-ab39-8496855a4733 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:49:58.841304 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-323f134f-830c-4c8b-ab39-8496855a4733 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:49:58.841803 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-323f134f-830c-4c8b-ab39-8496855a4733 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:49:58.842269 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-323f134f-830c-4c8b-ab39-8496855a4733 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:49:58.906899 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-323f134f-830c-4c8b-ab39-8496855a4733 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] 10.222.0.43 "PUT /compute/v2.1/servers/e351bace-1f8c-4b1e-b53b-3d4936a8209d" status: 200 len: 1078 microversion: 2.1 time: 0.080344 Oct 04 22:49:58.907608 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3160/7143] 10.222.0.43 () {60 vars in 1256 bytes} [Tue Oct 4 22:49:58 2022] PUT /compute/v2.1/servers/e351bace-1f8c-4b1e-b53b-3d4936a8209d => generated 1078 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:49:58.928975 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-ec4207b4-46cd-4636-9964-c849581032c8 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:49:58.929648 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-ec4207b4-46cd-4636-9964-c849581032c8 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] [instance: e351bace-1f8c-4b1e-b53b-3d4936a8209d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:49:58.931560 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=34 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:49:58.936854 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ec4207b4-46cd-4636-9964-c849581032c8 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:49:58.937362 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ec4207b4-46cd-4636-9964-c849581032c8 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:49:58.937844 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ec4207b4-46cd-4636-9964-c849581032c8 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:49:58.938576 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ec4207b4-46cd-4636-9964-c849581032c8 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:49:58.939055 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ec4207b4-46cd-4636-9964-c849581032c8 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:49:58.939507 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ec4207b4-46cd-4636-9964-c849581032c8 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:49:59.073513 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-ec4207b4-46cd-4636-9964-c849581032c8 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ebea4a152f4d01864ca878e528642c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec852e304484d27a84980417fffda0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:49:59.081754 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-ec4207b4-46cd-4636-9964-c849581032c8 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] 10.222.0.43 "GET /compute/v2.1/servers/e351bace-1f8c-4b1e-b53b-3d4936a8209d" status: 200 len: 1504 microversion: 2.1 time: 0.157611 Oct 04 22:49:59.082457 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3984/7144] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:49:58 2022] GET /compute/v2.1/servers/e351bace-1f8c-4b1e-b53b-3d4936a8209d => generated 1504 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:49:59.104326 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-bde50d28-d103-46c5-b227-2d6d301f9a65 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:49:59.104976 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-bde50d28-d103-46c5-b227-2d6d301f9a65 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] [instance: e351bace-1f8c-4b1e-b53b-3d4936a8209d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:49:59.111207 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bde50d28-d103-46c5-b227-2d6d301f9a65 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:49:59.111730 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bde50d28-d103-46c5-b227-2d6d301f9a65 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:49:59.112205 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bde50d28-d103-46c5-b227-2d6d301f9a65 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:49:59.112902 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bde50d28-d103-46c5-b227-2d6d301f9a65 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:49:59.113358 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bde50d28-d103-46c5-b227-2d6d301f9a65 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:49:59.114535 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bde50d28-d103-46c5-b227-2d6d301f9a65 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:49:59.246487 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-bde50d28-d103-46c5-b227-2d6d301f9a65 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ebea4a152f4d01864ca878e528642c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec852e304484d27a84980417fffda0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:49:59.254919 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-bde50d28-d103-46c5-b227-2d6d301f9a65 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] 10.222.0.43 "GET /compute/v2.1/servers/e351bace-1f8c-4b1e-b53b-3d4936a8209d" status: 200 len: 1504 microversion: 2.1 time: 0.154404 Oct 04 22:49:59.255521 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3161/7145] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:49:59 2022] GET /compute/v2.1/servers/e351bace-1f8c-4b1e-b53b-3d4936a8209d => generated 1504 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:49:59.277135 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-f257825c-07e4-4a74-8bd8-f50909e87fdc tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:49:59.279589 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-f257825c-07e4-4a74-8bd8-f50909e87fdc tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] [instance: e351bace-1f8c-4b1e-b53b-3d4936a8209d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:49:59.286276 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f257825c-07e4-4a74-8bd8-f50909e87fdc tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:49:59.286836 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f257825c-07e4-4a74-8bd8-f50909e87fdc tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:49:59.287297 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f257825c-07e4-4a74-8bd8-f50909e87fdc tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:49:59.288043 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f257825c-07e4-4a74-8bd8-f50909e87fdc tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:49:59.288546 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f257825c-07e4-4a74-8bd8-f50909e87fdc tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:49:59.289003 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f257825c-07e4-4a74-8bd8-f50909e87fdc tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:49:59.318282 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-f257825c-07e4-4a74-8bd8-f50909e87fdc tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'd0ebea4a152f4d01864ca878e528642c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec852e304484d27a84980417fffda0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:49:59.323703 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-f257825c-07e4-4a74-8bd8-f50909e87fdc tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] [instance: e351bace-1f8c-4b1e-b53b-3d4936a8209d] Old instance type m1.heat2, new instance type m1.heat {{(pid=134101) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 04 22:49:59.330160 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-f257825c-07e4-4a74-8bd8-f50909e87fdc tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Flavor limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 22:49:59.330627 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-f257825c-07e4-4a74-8bd8-f50909e87fdc tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Image limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 22:49:59.331118 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-f257825c-07e4-4a74-8bd8-f50909e87fdc tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Flavor pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 22:49:59.331542 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-f257825c-07e4-4a74-8bd8-f50909e87fdc tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Image pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 22:49:59.331969 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-f257825c-07e4-4a74-8bd8-f50909e87fdc tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 22:49:59.396891 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-f257825c-07e4-4a74-8bd8-f50909e87fdc tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] 10.222.0.43 "POST /compute/v2.1/servers/e351bace-1f8c-4b1e-b53b-3d4936a8209d/action" status: 202 len: 0 microversion: 2.1 time: 0.123896 Oct 04 22:49:59.397815 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3985/7146] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 22:49:59 2022] POST /compute/v2.1/servers/e351bace-1f8c-4b1e-b53b-3d4936a8209d/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 22:49:59.405509 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-8d37b044-9435-4a75-a3e2-7414e186fafb tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:49:59.406495 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-8d37b044-9435-4a75-a3e2-7414e186fafb tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] [instance: e351bace-1f8c-4b1e-b53b-3d4936a8209d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:49:59.413020 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8d37b044-9435-4a75-a3e2-7414e186fafb tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:49:59.413503 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8d37b044-9435-4a75-a3e2-7414e186fafb tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:49:59.413939 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8d37b044-9435-4a75-a3e2-7414e186fafb tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:49:59.414668 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8d37b044-9435-4a75-a3e2-7414e186fafb tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:49:59.415118 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8d37b044-9435-4a75-a3e2-7414e186fafb tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:49:59.415540 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8d37b044-9435-4a75-a3e2-7414e186fafb tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:49:59.557748 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-8d37b044-9435-4a75-a3e2-7414e186fafb tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ebea4a152f4d01864ca878e528642c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec852e304484d27a84980417fffda0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:49:59.565853 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-8d37b044-9435-4a75-a3e2-7414e186fafb tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] 10.222.0.43 "GET /compute/v2.1/servers/e351bace-1f8c-4b1e-b53b-3d4936a8209d" status: 200 len: 1515 microversion: 2.1 time: 0.164143 Oct 04 22:49:59.566610 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3162/7147] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:49:59 2022] GET /compute/v2.1/servers/e351bace-1f8c-4b1e-b53b-3d4936a8209d => generated 1515 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:50:00.590985 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-89a788ef-a108-4ae0-bde1-a60c2baf0eba tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:50:00.593267 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-89a788ef-a108-4ae0-bde1-a60c2baf0eba tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] [instance: e351bace-1f8c-4b1e-b53b-3d4936a8209d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:50:00.602386 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-89a788ef-a108-4ae0-bde1-a60c2baf0eba tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:00.603145 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-89a788ef-a108-4ae0-bde1-a60c2baf0eba tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:00.603612 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-89a788ef-a108-4ae0-bde1-a60c2baf0eba tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:00.604345 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-89a788ef-a108-4ae0-bde1-a60c2baf0eba tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:00.604833 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-89a788ef-a108-4ae0-bde1-a60c2baf0eba tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:00.605287 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-89a788ef-a108-4ae0-bde1-a60c2baf0eba tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:00.740712 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-89a788ef-a108-4ae0-bde1-a60c2baf0eba tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ebea4a152f4d01864ca878e528642c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec852e304484d27a84980417fffda0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:50:00.748698 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-89a788ef-a108-4ae0-bde1-a60c2baf0eba tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] 10.222.0.43 "GET /compute/v2.1/servers/e351bace-1f8c-4b1e-b53b-3d4936a8209d" status: 200 len: 1515 microversion: 2.1 time: 0.162768 Oct 04 22:50:00.749289 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3986/7148] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:50:00 2022] GET /compute/v2.1/servers/e351bace-1f8c-4b1e-b53b-3d4936a8209d => generated 1515 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:50:01.772877 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-7d4390f2-c0fd-4624-8ab6-896f04b6b8fa tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:50:01.773495 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-7d4390f2-c0fd-4624-8ab6-896f04b6b8fa tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] [instance: e351bace-1f8c-4b1e-b53b-3d4936a8209d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:50:01.780635 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7d4390f2-c0fd-4624-8ab6-896f04b6b8fa tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:01.781116 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7d4390f2-c0fd-4624-8ab6-896f04b6b8fa tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:01.781547 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7d4390f2-c0fd-4624-8ab6-896f04b6b8fa tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:01.782705 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7d4390f2-c0fd-4624-8ab6-896f04b6b8fa tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:01.783157 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7d4390f2-c0fd-4624-8ab6-896f04b6b8fa tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:01.783579 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7d4390f2-c0fd-4624-8ab6-896f04b6b8fa tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:01.915603 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-7d4390f2-c0fd-4624-8ab6-896f04b6b8fa tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ebea4a152f4d01864ca878e528642c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec852e304484d27a84980417fffda0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:50:01.924348 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-7d4390f2-c0fd-4624-8ab6-896f04b6b8fa tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] 10.222.0.43 "GET /compute/v2.1/servers/e351bace-1f8c-4b1e-b53b-3d4936a8209d" status: 200 len: 1520 microversion: 2.1 time: 0.154655 Oct 04 22:50:01.925313 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3163/7149] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:50:01 2022] GET /compute/v2.1/servers/e351bace-1f8c-4b1e-b53b-3d4936a8209d => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:50:02.950198 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-6a7a292b-7e8f-472d-adf2-be243a35acb8 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:50:02.950882 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-6a7a292b-7e8f-472d-adf2-be243a35acb8 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] [instance: e351bace-1f8c-4b1e-b53b-3d4936a8209d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:50:02.957910 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6a7a292b-7e8f-472d-adf2-be243a35acb8 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:02.958438 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6a7a292b-7e8f-472d-adf2-be243a35acb8 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:02.958901 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6a7a292b-7e8f-472d-adf2-be243a35acb8 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:02.959611 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6a7a292b-7e8f-472d-adf2-be243a35acb8 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:02.960081 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6a7a292b-7e8f-472d-adf2-be243a35acb8 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:02.960524 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6a7a292b-7e8f-472d-adf2-be243a35acb8 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:03.092361 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-6a7a292b-7e8f-472d-adf2-be243a35acb8 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ebea4a152f4d01864ca878e528642c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec852e304484d27a84980417fffda0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:50:03.100770 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-6a7a292b-7e8f-472d-adf2-be243a35acb8 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] 10.222.0.43 "GET /compute/v2.1/servers/e351bace-1f8c-4b1e-b53b-3d4936a8209d" status: 200 len: 1520 microversion: 2.1 time: 0.154504 Oct 04 22:50:03.101346 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3987/7150] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:50:02 2022] GET /compute/v2.1/servers/e351bace-1f8c-4b1e-b53b-3d4936a8209d => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:50:04.124424 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-3c10ac7f-88cb-45c2-99fb-8cf13cdbaffb tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:50:04.125291 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-3c10ac7f-88cb-45c2-99fb-8cf13cdbaffb tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] [instance: e351bace-1f8c-4b1e-b53b-3d4936a8209d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:50:04.132397 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3c10ac7f-88cb-45c2-99fb-8cf13cdbaffb tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:04.132883 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3c10ac7f-88cb-45c2-99fb-8cf13cdbaffb tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:04.133317 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3c10ac7f-88cb-45c2-99fb-8cf13cdbaffb tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:04.134011 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3c10ac7f-88cb-45c2-99fb-8cf13cdbaffb tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:04.134490 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3c10ac7f-88cb-45c2-99fb-8cf13cdbaffb tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:04.134914 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3c10ac7f-88cb-45c2-99fb-8cf13cdbaffb tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:04.264917 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-3c10ac7f-88cb-45c2-99fb-8cf13cdbaffb tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ebea4a152f4d01864ca878e528642c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec852e304484d27a84980417fffda0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:50:04.272806 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-3c10ac7f-88cb-45c2-99fb-8cf13cdbaffb tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] 10.222.0.43 "GET /compute/v2.1/servers/e351bace-1f8c-4b1e-b53b-3d4936a8209d" status: 200 len: 1520 microversion: 2.1 time: 0.152287 Oct 04 22:50:04.273434 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3164/7151] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:50:04 2022] GET /compute/v2.1/servers/e351bace-1f8c-4b1e-b53b-3d4936a8209d => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:50:05.296581 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-88de53cc-e60e-40ca-ae95-97a5f3d30007 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:50:05.297224 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-88de53cc-e60e-40ca-ae95-97a5f3d30007 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] [instance: e351bace-1f8c-4b1e-b53b-3d4936a8209d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:50:05.306000 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-88de53cc-e60e-40ca-ae95-97a5f3d30007 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:05.306687 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-88de53cc-e60e-40ca-ae95-97a5f3d30007 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:05.307259 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-88de53cc-e60e-40ca-ae95-97a5f3d30007 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:05.308107 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-88de53cc-e60e-40ca-ae95-97a5f3d30007 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:05.308844 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-88de53cc-e60e-40ca-ae95-97a5f3d30007 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:05.309369 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-88de53cc-e60e-40ca-ae95-97a5f3d30007 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:05.333528 n-d-860284-1 devstack@n-api.service[134101]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 22:50:05.333725 n-d-860284-1 devstack@n-api.service[134101]: Tue Oct 4 22:50:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e351bace-1f8c-4b1e-b53b-3d4936a8209d (ip 10.222.0.43) !!! Oct 04 22:50:05.461685 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-88de53cc-e60e-40ca-ae95-97a5f3d30007 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ebea4a152f4d01864ca878e528642c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec852e304484d27a84980417fffda0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:50:05.469776 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-88de53cc-e60e-40ca-ae95-97a5f3d30007 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] 10.222.0.43 "GET /compute/v2.1/servers/e351bace-1f8c-4b1e-b53b-3d4936a8209d" status: 200 len: 1520 microversion: 2.1 time: 0.177258 Oct 04 22:50:05.470387 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3988/7152] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:50:05 2022] GET /compute/v2.1/servers/e351bace-1f8c-4b1e-b53b-3d4936a8209d => generated 1520 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:50:06.494109 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-99ba7964-3110-4a28-bbb3-4422ba868651 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:50:06.494671 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-99ba7964-3110-4a28-bbb3-4422ba868651 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] [instance: e351bace-1f8c-4b1e-b53b-3d4936a8209d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:50:06.501848 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-99ba7964-3110-4a28-bbb3-4422ba868651 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:06.502329 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-99ba7964-3110-4a28-bbb3-4422ba868651 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:06.502796 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-99ba7964-3110-4a28-bbb3-4422ba868651 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:06.503506 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-99ba7964-3110-4a28-bbb3-4422ba868651 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:06.503987 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-99ba7964-3110-4a28-bbb3-4422ba868651 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:06.505131 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-99ba7964-3110-4a28-bbb3-4422ba868651 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:06.637564 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-99ba7964-3110-4a28-bbb3-4422ba868651 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ebea4a152f4d01864ca878e528642c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec852e304484d27a84980417fffda0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:50:06.645917 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-99ba7964-3110-4a28-bbb3-4422ba868651 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] 10.222.0.43 "GET /compute/v2.1/servers/e351bace-1f8c-4b1e-b53b-3d4936a8209d" status: 200 len: 1520 microversion: 2.1 time: 0.156017 Oct 04 22:50:06.646538 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3165/7153] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:50:06 2022] GET /compute/v2.1/servers/e351bace-1f8c-4b1e-b53b-3d4936a8209d => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:50:07.669347 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-afdb1488-afdf-43c5-83b4-3cdbebd95c76 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:50:07.669970 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-afdb1488-afdf-43c5-83b4-3cdbebd95c76 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] [instance: e351bace-1f8c-4b1e-b53b-3d4936a8209d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:50:07.677296 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-afdb1488-afdf-43c5-83b4-3cdbebd95c76 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:07.677794 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-afdb1488-afdf-43c5-83b4-3cdbebd95c76 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:07.678246 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-afdb1488-afdf-43c5-83b4-3cdbebd95c76 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:07.678981 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-afdb1488-afdf-43c5-83b4-3cdbebd95c76 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:07.679452 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-afdb1488-afdf-43c5-83b4-3cdbebd95c76 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:07.679893 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-afdb1488-afdf-43c5-83b4-3cdbebd95c76 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:07.813298 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-afdb1488-afdf-43c5-83b4-3cdbebd95c76 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ebea4a152f4d01864ca878e528642c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec852e304484d27a84980417fffda0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:50:07.821790 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-afdb1488-afdf-43c5-83b4-3cdbebd95c76 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] 10.222.0.43 "GET /compute/v2.1/servers/e351bace-1f8c-4b1e-b53b-3d4936a8209d" status: 200 len: 1520 microversion: 2.1 time: 0.156374 Oct 04 22:50:07.822383 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3989/7154] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:50:07 2022] GET /compute/v2.1/servers/e351bace-1f8c-4b1e-b53b-3d4936a8209d => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:50:08.845302 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-170af26d-f10a-4674-8193-0b8ac1c3241a tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:50:08.845830 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-170af26d-f10a-4674-8193-0b8ac1c3241a tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] [instance: e351bace-1f8c-4b1e-b53b-3d4936a8209d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:50:08.853192 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-170af26d-f10a-4674-8193-0b8ac1c3241a tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:08.853685 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-170af26d-f10a-4674-8193-0b8ac1c3241a tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:08.854126 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-170af26d-f10a-4674-8193-0b8ac1c3241a tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:08.854859 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-170af26d-f10a-4674-8193-0b8ac1c3241a tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:08.855320 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-170af26d-f10a-4674-8193-0b8ac1c3241a tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:08.855751 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-170af26d-f10a-4674-8193-0b8ac1c3241a tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:08.998743 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-170af26d-f10a-4674-8193-0b8ac1c3241a tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ebea4a152f4d01864ca878e528642c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec852e304484d27a84980417fffda0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:50:09.007698 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-170af26d-f10a-4674-8193-0b8ac1c3241a tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] 10.222.0.43 "GET /compute/v2.1/servers/e351bace-1f8c-4b1e-b53b-3d4936a8209d" status: 200 len: 1520 microversion: 2.1 time: 0.166696 Oct 04 22:50:09.008728 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3166/7155] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:50:08 2022] GET /compute/v2.1/servers/e351bace-1f8c-4b1e-b53b-3d4936a8209d => generated 1520 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:50:10.033215 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-c59db2c1-0867-47d3-a1af-df60fa6f034b tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:50:10.033856 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-c59db2c1-0867-47d3-a1af-df60fa6f034b tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] [instance: e351bace-1f8c-4b1e-b53b-3d4936a8209d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:50:10.042108 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c59db2c1-0867-47d3-a1af-df60fa6f034b tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:10.042759 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c59db2c1-0867-47d3-a1af-df60fa6f034b tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:10.043274 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c59db2c1-0867-47d3-a1af-df60fa6f034b tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:10.043976 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c59db2c1-0867-47d3-a1af-df60fa6f034b tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:10.044569 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c59db2c1-0867-47d3-a1af-df60fa6f034b tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:10.045189 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c59db2c1-0867-47d3-a1af-df60fa6f034b tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:10.185219 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-c59db2c1-0867-47d3-a1af-df60fa6f034b tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ebea4a152f4d01864ca878e528642c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec852e304484d27a84980417fffda0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:50:10.193294 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-c59db2c1-0867-47d3-a1af-df60fa6f034b tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] 10.222.0.43 "GET /compute/v2.1/servers/e351bace-1f8c-4b1e-b53b-3d4936a8209d" status: 200 len: 1520 microversion: 2.1 time: 0.164477 Oct 04 22:50:10.193870 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3990/7156] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:50:10 2022] GET /compute/v2.1/servers/e351bace-1f8c-4b1e-b53b-3d4936a8209d => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:50:11.216453 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-464f378d-5c59-4ed4-bbe5-f680231ae99f tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:50:11.217063 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-464f378d-5c59-4ed4-bbe5-f680231ae99f tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] [instance: e351bace-1f8c-4b1e-b53b-3d4936a8209d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:50:11.224688 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-464f378d-5c59-4ed4-bbe5-f680231ae99f tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:11.225169 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-464f378d-5c59-4ed4-bbe5-f680231ae99f tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:11.225602 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-464f378d-5c59-4ed4-bbe5-f680231ae99f tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:11.226287 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-464f378d-5c59-4ed4-bbe5-f680231ae99f tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:11.226767 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-464f378d-5c59-4ed4-bbe5-f680231ae99f tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:11.227187 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-464f378d-5c59-4ed4-bbe5-f680231ae99f tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:11.357328 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-464f378d-5c59-4ed4-bbe5-f680231ae99f tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ebea4a152f4d01864ca878e528642c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec852e304484d27a84980417fffda0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:50:11.371079 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-464f378d-5c59-4ed4-bbe5-f680231ae99f tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] 10.222.0.43 "GET /compute/v2.1/servers/e351bace-1f8c-4b1e-b53b-3d4936a8209d" status: 200 len: 1520 microversion: 2.1 time: 0.158463 Oct 04 22:50:11.371713 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3167/7157] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:50:11 2022] GET /compute/v2.1/servers/e351bace-1f8c-4b1e-b53b-3d4936a8209d => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:50:12.395025 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-aa3e5fcb-de9a-46f7-bc0b-04dd065121d4 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:50:12.395637 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-aa3e5fcb-de9a-46f7-bc0b-04dd065121d4 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] [instance: e351bace-1f8c-4b1e-b53b-3d4936a8209d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:50:12.402629 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-aa3e5fcb-de9a-46f7-bc0b-04dd065121d4 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:12.403137 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-aa3e5fcb-de9a-46f7-bc0b-04dd065121d4 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:12.403597 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-aa3e5fcb-de9a-46f7-bc0b-04dd065121d4 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:12.404312 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-aa3e5fcb-de9a-46f7-bc0b-04dd065121d4 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:12.404791 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-aa3e5fcb-de9a-46f7-bc0b-04dd065121d4 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:12.405238 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-aa3e5fcb-de9a-46f7-bc0b-04dd065121d4 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:12.534403 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-aa3e5fcb-de9a-46f7-bc0b-04dd065121d4 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ebea4a152f4d01864ca878e528642c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec852e304484d27a84980417fffda0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:50:12.543552 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-aa3e5fcb-de9a-46f7-bc0b-04dd065121d4 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] 10.222.0.43 "GET /compute/v2.1/servers/e351bace-1f8c-4b1e-b53b-3d4936a8209d" status: 200 len: 1520 microversion: 2.1 time: 0.152544 Oct 04 22:50:12.544151 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3991/7158] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:50:12 2022] GET /compute/v2.1/servers/e351bace-1f8c-4b1e-b53b-3d4936a8209d => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:50:13.567914 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-4e41dc41-aa44-434f-bbd7-7fea3b5ca2d7 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:50:13.568532 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-4e41dc41-aa44-434f-bbd7-7fea3b5ca2d7 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] [instance: e351bace-1f8c-4b1e-b53b-3d4936a8209d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:50:13.575527 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4e41dc41-aa44-434f-bbd7-7fea3b5ca2d7 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:13.576012 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4e41dc41-aa44-434f-bbd7-7fea3b5ca2d7 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:13.576450 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4e41dc41-aa44-434f-bbd7-7fea3b5ca2d7 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:13.577149 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4e41dc41-aa44-434f-bbd7-7fea3b5ca2d7 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:13.577645 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4e41dc41-aa44-434f-bbd7-7fea3b5ca2d7 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:13.578175 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4e41dc41-aa44-434f-bbd7-7fea3b5ca2d7 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:13.713280 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-4e41dc41-aa44-434f-bbd7-7fea3b5ca2d7 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ebea4a152f4d01864ca878e528642c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec852e304484d27a84980417fffda0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:50:13.721038 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-4e41dc41-aa44-434f-bbd7-7fea3b5ca2d7 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] 10.222.0.43 "GET /compute/v2.1/servers/e351bace-1f8c-4b1e-b53b-3d4936a8209d" status: 200 len: 1520 microversion: 2.1 time: 0.157623 Oct 04 22:50:13.721631 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3168/7159] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:50:13 2022] GET /compute/v2.1/servers/e351bace-1f8c-4b1e-b53b-3d4936a8209d => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:50:14.745397 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-9ded4e13-b8c1-422b-b05a-d96bf0db3344 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:50:14.746039 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-9ded4e13-b8c1-422b-b05a-d96bf0db3344 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] [instance: e351bace-1f8c-4b1e-b53b-3d4936a8209d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:50:14.753319 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9ded4e13-b8c1-422b-b05a-d96bf0db3344 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:14.753830 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9ded4e13-b8c1-422b-b05a-d96bf0db3344 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:14.754291 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9ded4e13-b8c1-422b-b05a-d96bf0db3344 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:14.755769 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9ded4e13-b8c1-422b-b05a-d96bf0db3344 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:14.756246 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9ded4e13-b8c1-422b-b05a-d96bf0db3344 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:14.756707 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9ded4e13-b8c1-422b-b05a-d96bf0db3344 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:14.891350 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-9ded4e13-b8c1-422b-b05a-d96bf0db3344 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ebea4a152f4d01864ca878e528642c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec852e304484d27a84980417fffda0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:50:14.899791 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-9ded4e13-b8c1-422b-b05a-d96bf0db3344 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] 10.222.0.43 "GET /compute/v2.1/servers/e351bace-1f8c-4b1e-b53b-3d4936a8209d" status: 200 len: 1520 microversion: 2.1 time: 0.158335 Oct 04 22:50:14.900468 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3992/7160] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:50:14 2022] GET /compute/v2.1/servers/e351bace-1f8c-4b1e-b53b-3d4936a8209d => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:50:15.924370 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-76c6c198-77d5-424f-b7c3-2b9942c007c7 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:50:15.924982 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-76c6c198-77d5-424f-b7c3-2b9942c007c7 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] [instance: e351bace-1f8c-4b1e-b53b-3d4936a8209d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:50:15.932034 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-76c6c198-77d5-424f-b7c3-2b9942c007c7 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:15.932511 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-76c6c198-77d5-424f-b7c3-2b9942c007c7 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:15.932941 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-76c6c198-77d5-424f-b7c3-2b9942c007c7 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:15.933623 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-76c6c198-77d5-424f-b7c3-2b9942c007c7 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:15.934073 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-76c6c198-77d5-424f-b7c3-2b9942c007c7 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:15.934529 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-76c6c198-77d5-424f-b7c3-2b9942c007c7 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:16.062985 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-76c6c198-77d5-424f-b7c3-2b9942c007c7 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ebea4a152f4d01864ca878e528642c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec852e304484d27a84980417fffda0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:50:16.071944 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-76c6c198-77d5-424f-b7c3-2b9942c007c7 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] 10.222.0.43 "GET /compute/v2.1/servers/e351bace-1f8c-4b1e-b53b-3d4936a8209d" status: 200 len: 1520 microversion: 2.1 time: 0.151529 Oct 04 22:50:16.072530 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3169/7161] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:50:15 2022] GET /compute/v2.1/servers/e351bace-1f8c-4b1e-b53b-3d4936a8209d => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:50:17.096853 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-a8598daf-2f1a-49f9-bb47-726fe6bcbc25 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:50:17.097492 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-a8598daf-2f1a-49f9-bb47-726fe6bcbc25 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] [instance: e351bace-1f8c-4b1e-b53b-3d4936a8209d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:50:17.104028 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a8598daf-2f1a-49f9-bb47-726fe6bcbc25 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:17.104556 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a8598daf-2f1a-49f9-bb47-726fe6bcbc25 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:17.105009 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a8598daf-2f1a-49f9-bb47-726fe6bcbc25 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:17.105752 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a8598daf-2f1a-49f9-bb47-726fe6bcbc25 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:17.106222 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a8598daf-2f1a-49f9-bb47-726fe6bcbc25 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:17.106688 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a8598daf-2f1a-49f9-bb47-726fe6bcbc25 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:17.110777 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:50:17.246388 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-a8598daf-2f1a-49f9-bb47-726fe6bcbc25 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ebea4a152f4d01864ca878e528642c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec852e304484d27a84980417fffda0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:50:17.255183 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-a8598daf-2f1a-49f9-bb47-726fe6bcbc25 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] 10.222.0.43 "GET /compute/v2.1/servers/e351bace-1f8c-4b1e-b53b-3d4936a8209d" status: 200 len: 1520 microversion: 2.1 time: 0.161896 Oct 04 22:50:17.255773 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3993/7162] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:50:17 2022] GET /compute/v2.1/servers/e351bace-1f8c-4b1e-b53b-3d4936a8209d => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:50:18.279519 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-f6fc93a8-ce07-4212-93c9-705042d65a79 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:50:18.280142 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-f6fc93a8-ce07-4212-93c9-705042d65a79 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] [instance: e351bace-1f8c-4b1e-b53b-3d4936a8209d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:50:18.287636 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f6fc93a8-ce07-4212-93c9-705042d65a79 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:18.288155 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f6fc93a8-ce07-4212-93c9-705042d65a79 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:18.288600 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f6fc93a8-ce07-4212-93c9-705042d65a79 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:18.289299 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f6fc93a8-ce07-4212-93c9-705042d65a79 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:18.289773 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f6fc93a8-ce07-4212-93c9-705042d65a79 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:18.290192 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f6fc93a8-ce07-4212-93c9-705042d65a79 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:18.423133 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-f6fc93a8-ce07-4212-93c9-705042d65a79 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ebea4a152f4d01864ca878e528642c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec852e304484d27a84980417fffda0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:50:18.430978 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-f6fc93a8-ce07-4212-93c9-705042d65a79 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] 10.222.0.43 "GET /compute/v2.1/servers/e351bace-1f8c-4b1e-b53b-3d4936a8209d" status: 200 len: 1520 microversion: 2.1 time: 0.155852 Oct 04 22:50:18.431561 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3170/7163] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:50:18 2022] GET /compute/v2.1/servers/e351bace-1f8c-4b1e-b53b-3d4936a8209d => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:50:19.453188 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-56a5e398-3b59-46e1-8432-ab971d9d8b5f tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:50:19.453732 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-56a5e398-3b59-46e1-8432-ab971d9d8b5f tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] [instance: e351bace-1f8c-4b1e-b53b-3d4936a8209d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:50:19.460766 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-56a5e398-3b59-46e1-8432-ab971d9d8b5f tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:19.461262 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-56a5e398-3b59-46e1-8432-ab971d9d8b5f tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:19.461714 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-56a5e398-3b59-46e1-8432-ab971d9d8b5f tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:19.462482 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-56a5e398-3b59-46e1-8432-ab971d9d8b5f tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:19.462951 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-56a5e398-3b59-46e1-8432-ab971d9d8b5f tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:19.463392 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-56a5e398-3b59-46e1-8432-ab971d9d8b5f tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:19.596788 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-56a5e398-3b59-46e1-8432-ab971d9d8b5f tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ebea4a152f4d01864ca878e528642c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec852e304484d27a84980417fffda0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:50:19.604987 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-56a5e398-3b59-46e1-8432-ab971d9d8b5f tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] 10.222.0.43 "GET /compute/v2.1/servers/e351bace-1f8c-4b1e-b53b-3d4936a8209d" status: 200 len: 1520 microversion: 2.1 time: 0.155790 Oct 04 22:50:19.605564 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3994/7164] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:50:19 2022] GET /compute/v2.1/servers/e351bace-1f8c-4b1e-b53b-3d4936a8209d => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:50:20.628447 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-e7db5b1c-60e3-4a3a-92c6-c98db5f6a3f4 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:50:20.629059 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-e7db5b1c-60e3-4a3a-92c6-c98db5f6a3f4 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] [instance: e351bace-1f8c-4b1e-b53b-3d4936a8209d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:50:20.636717 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e7db5b1c-60e3-4a3a-92c6-c98db5f6a3f4 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:20.637476 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e7db5b1c-60e3-4a3a-92c6-c98db5f6a3f4 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:20.637916 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e7db5b1c-60e3-4a3a-92c6-c98db5f6a3f4 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:20.638632 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e7db5b1c-60e3-4a3a-92c6-c98db5f6a3f4 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:20.639084 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e7db5b1c-60e3-4a3a-92c6-c98db5f6a3f4 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:20.639507 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e7db5b1c-60e3-4a3a-92c6-c98db5f6a3f4 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:20.768498 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-e7db5b1c-60e3-4a3a-92c6-c98db5f6a3f4 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ebea4a152f4d01864ca878e528642c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec852e304484d27a84980417fffda0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:50:20.776112 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-e7db5b1c-60e3-4a3a-92c6-c98db5f6a3f4 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] 10.222.0.43 "GET /compute/v2.1/servers/e351bace-1f8c-4b1e-b53b-3d4936a8209d" status: 200 len: 1520 microversion: 2.1 time: 0.151804 Oct 04 22:50:20.776691 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3171/7165] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:50:20 2022] GET /compute/v2.1/servers/e351bace-1f8c-4b1e-b53b-3d4936a8209d => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:50:21.799957 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-34b55bbe-5464-4fde-b0aa-255bd3aeec2c tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:50:21.800596 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-34b55bbe-5464-4fde-b0aa-255bd3aeec2c tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] [instance: e351bace-1f8c-4b1e-b53b-3d4936a8209d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:50:21.808592 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-34b55bbe-5464-4fde-b0aa-255bd3aeec2c tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:21.809101 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-34b55bbe-5464-4fde-b0aa-255bd3aeec2c tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:21.809567 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-34b55bbe-5464-4fde-b0aa-255bd3aeec2c tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:21.810288 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-34b55bbe-5464-4fde-b0aa-255bd3aeec2c tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:21.810796 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-34b55bbe-5464-4fde-b0aa-255bd3aeec2c tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:21.811248 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-34b55bbe-5464-4fde-b0aa-255bd3aeec2c tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:21.945837 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-34b55bbe-5464-4fde-b0aa-255bd3aeec2c tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ebea4a152f4d01864ca878e528642c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec852e304484d27a84980417fffda0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:50:21.953552 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-34b55bbe-5464-4fde-b0aa-255bd3aeec2c tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] 10.222.0.43 "GET /compute/v2.1/servers/e351bace-1f8c-4b1e-b53b-3d4936a8209d" status: 200 len: 1520 microversion: 2.1 time: 0.157593 Oct 04 22:50:21.954115 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3995/7166] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:50:21 2022] GET /compute/v2.1/servers/e351bace-1f8c-4b1e-b53b-3d4936a8209d => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:50:22.976530 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-3c1b65e6-60ce-4a48-8c61-38224d42f9df tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:50:22.977137 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-3c1b65e6-60ce-4a48-8c61-38224d42f9df tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] [instance: e351bace-1f8c-4b1e-b53b-3d4936a8209d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:50:22.983984 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3c1b65e6-60ce-4a48-8c61-38224d42f9df tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:22.984464 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3c1b65e6-60ce-4a48-8c61-38224d42f9df tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:22.984895 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3c1b65e6-60ce-4a48-8c61-38224d42f9df tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:22.985575 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3c1b65e6-60ce-4a48-8c61-38224d42f9df tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:22.986022 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3c1b65e6-60ce-4a48-8c61-38224d42f9df tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:22.986471 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3c1b65e6-60ce-4a48-8c61-38224d42f9df tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:23.115585 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-3c1b65e6-60ce-4a48-8c61-38224d42f9df tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ebea4a152f4d01864ca878e528642c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec852e304484d27a84980417fffda0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:50:23.123352 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-3c1b65e6-60ce-4a48-8c61-38224d42f9df tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] 10.222.0.43 "GET /compute/v2.1/servers/e351bace-1f8c-4b1e-b53b-3d4936a8209d" status: 200 len: 1520 microversion: 2.1 time: 0.150896 Oct 04 22:50:23.123930 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3172/7167] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:50:22 2022] GET /compute/v2.1/servers/e351bace-1f8c-4b1e-b53b-3d4936a8209d => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:50:24.149679 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-359078ba-57b5-445d-873d-4a9d27518a84 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:50:24.150319 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-359078ba-57b5-445d-873d-4a9d27518a84 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] [instance: e351bace-1f8c-4b1e-b53b-3d4936a8209d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:50:24.157256 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-359078ba-57b5-445d-873d-4a9d27518a84 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:24.157765 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-359078ba-57b5-445d-873d-4a9d27518a84 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:24.158227 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-359078ba-57b5-445d-873d-4a9d27518a84 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:24.158975 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-359078ba-57b5-445d-873d-4a9d27518a84 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:24.159462 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-359078ba-57b5-445d-873d-4a9d27518a84 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:24.159914 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-359078ba-57b5-445d-873d-4a9d27518a84 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:24.291460 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-359078ba-57b5-445d-873d-4a9d27518a84 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ebea4a152f4d01864ca878e528642c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec852e304484d27a84980417fffda0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:50:24.299348 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-359078ba-57b5-445d-873d-4a9d27518a84 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] 10.222.0.43 "GET /compute/v2.1/servers/e351bace-1f8c-4b1e-b53b-3d4936a8209d" status: 200 len: 1520 microversion: 2.1 time: 0.154171 Oct 04 22:50:24.299934 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3996/7168] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:50:24 2022] GET /compute/v2.1/servers/e351bace-1f8c-4b1e-b53b-3d4936a8209d => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:50:25.323875 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-ec5ee4cd-6fbb-49d7-b6d2-bba54b52497a tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:50:25.324666 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-ec5ee4cd-6fbb-49d7-b6d2-bba54b52497a tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] [instance: e351bace-1f8c-4b1e-b53b-3d4936a8209d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:50:25.331002 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ec5ee4cd-6fbb-49d7-b6d2-bba54b52497a tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:25.331434 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ec5ee4cd-6fbb-49d7-b6d2-bba54b52497a tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:25.331874 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ec5ee4cd-6fbb-49d7-b6d2-bba54b52497a tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:25.332572 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ec5ee4cd-6fbb-49d7-b6d2-bba54b52497a tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:25.333031 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ec5ee4cd-6fbb-49d7-b6d2-bba54b52497a tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:25.333463 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ec5ee4cd-6fbb-49d7-b6d2-bba54b52497a tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:25.468003 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-ec5ee4cd-6fbb-49d7-b6d2-bba54b52497a tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ebea4a152f4d01864ca878e528642c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec852e304484d27a84980417fffda0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:50:25.476517 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-ec5ee4cd-6fbb-49d7-b6d2-bba54b52497a tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] 10.222.0.43 "GET /compute/v2.1/servers/e351bace-1f8c-4b1e-b53b-3d4936a8209d" status: 200 len: 1520 microversion: 2.1 time: 0.157567 Oct 04 22:50:25.477114 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3173/7169] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:50:25 2022] GET /compute/v2.1/servers/e351bace-1f8c-4b1e-b53b-3d4936a8209d => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:50:26.500676 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-601f0de9-d6f5-485e-9165-d428f409b581 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:50:26.501219 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-601f0de9-d6f5-485e-9165-d428f409b581 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] [instance: e351bace-1f8c-4b1e-b53b-3d4936a8209d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:50:26.508178 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-601f0de9-d6f5-485e-9165-d428f409b581 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:26.508677 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-601f0de9-d6f5-485e-9165-d428f409b581 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:26.509136 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-601f0de9-d6f5-485e-9165-d428f409b581 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:26.509846 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-601f0de9-d6f5-485e-9165-d428f409b581 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:26.510315 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-601f0de9-d6f5-485e-9165-d428f409b581 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:26.510782 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-601f0de9-d6f5-485e-9165-d428f409b581 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:26.639468 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-601f0de9-d6f5-485e-9165-d428f409b581 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ebea4a152f4d01864ca878e528642c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec852e304484d27a84980417fffda0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:50:26.648206 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-601f0de9-d6f5-485e-9165-d428f409b581 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] 10.222.0.43 "GET /compute/v2.1/servers/e351bace-1f8c-4b1e-b53b-3d4936a8209d" status: 200 len: 1520 microversion: 2.1 time: 0.152006 Oct 04 22:50:26.648792 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3997/7170] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:50:26 2022] GET /compute/v2.1/servers/e351bace-1f8c-4b1e-b53b-3d4936a8209d => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:50:27.672363 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-aca69c72-a5dc-4bda-8244-747c50eb4080 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:50:27.672989 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-aca69c72-a5dc-4bda-8244-747c50eb4080 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] [instance: e351bace-1f8c-4b1e-b53b-3d4936a8209d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:50:27.680197 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-aca69c72-a5dc-4bda-8244-747c50eb4080 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:27.680681 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-aca69c72-a5dc-4bda-8244-747c50eb4080 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:27.681119 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-aca69c72-a5dc-4bda-8244-747c50eb4080 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:27.681817 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-aca69c72-a5dc-4bda-8244-747c50eb4080 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:27.682276 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-aca69c72-a5dc-4bda-8244-747c50eb4080 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:27.682809 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-aca69c72-a5dc-4bda-8244-747c50eb4080 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:27.814221 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-aca69c72-a5dc-4bda-8244-747c50eb4080 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ebea4a152f4d01864ca878e528642c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec852e304484d27a84980417fffda0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:50:27.822411 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-aca69c72-a5dc-4bda-8244-747c50eb4080 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] 10.222.0.43 "GET /compute/v2.1/servers/e351bace-1f8c-4b1e-b53b-3d4936a8209d" status: 200 len: 1520 microversion: 2.1 time: 0.154149 Oct 04 22:50:27.823003 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3174/7171] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:50:27 2022] GET /compute/v2.1/servers/e351bace-1f8c-4b1e-b53b-3d4936a8209d => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:50:28.652572 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-ec80ddd4-be98-49ce-912e-423523870f0e req-b1a20275-a076-4911-99a6-914ea574d50f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e351bace-1f8c-4b1e-b53b-3d4936a8209d", "name": "network-vif-unplugged", "status": "completed", "tag": "a8bbd5fa-b77a-444b-bf4a-5ea729c1b8fc"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:50:28.665158 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-ec80ddd4-be98-49ce-912e-423523870f0e req-b1a20275-a076-4911-99a6-914ea574d50f service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:28.665896 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-ec80ddd4-be98-49ce-912e-423523870f0e req-b1a20275-a076-4911-99a6-914ea574d50f service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:28.666371 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-ec80ddd4-be98-49ce-912e-423523870f0e req-b1a20275-a076-4911-99a6-914ea574d50f service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:28.679712 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-ec80ddd4-be98-49ce-912e-423523870f0e req-b1a20275-a076-4911-99a6-914ea574d50f service nova] Creating event network-vif-unplugged:a8bbd5fa-b77a-444b-bf4a-5ea729c1b8fc for instance e351bace-1f8c-4b1e-b53b-3d4936a8209d on n-h1-860284-1 Oct 04 22:50:28.685193 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [req-ec80ddd4-be98-49ce-912e-423523870f0e req-b1a20275-a076-4911-99a6-914ea574d50f service nova] Instance e351bace-1f8c-4b1e-b53b-3d4936a8209d is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860284-1', 'n-h1-860284-1'} {{(pid=134101) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 22:50:28.697089 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-ec80ddd4-be98-49ce-912e-423523870f0e req-b1a20275-a076-4911-99a6-914ea574d50f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048344 Oct 04 22:50:28.697705 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3998/7172] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:50:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:50:28.846584 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-7e586f7a-7b92-4609-bea9-4e5d87bb459e tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:50:28.847329 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-7e586f7a-7b92-4609-bea9-4e5d87bb459e tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] [instance: e351bace-1f8c-4b1e-b53b-3d4936a8209d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:50:28.850678 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_api:SELECT=32 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:50:28.856164 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7e586f7a-7b92-4609-bea9-4e5d87bb459e tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:28.856664 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7e586f7a-7b92-4609-bea9-4e5d87bb459e tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:28.857181 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7e586f7a-7b92-4609-bea9-4e5d87bb459e tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:28.858143 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7e586f7a-7b92-4609-bea9-4e5d87bb459e tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:28.858637 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7e586f7a-7b92-4609-bea9-4e5d87bb459e tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:28.859070 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7e586f7a-7b92-4609-bea9-4e5d87bb459e tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:28.863888 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:50:29.008131 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-7e586f7a-7b92-4609-bea9-4e5d87bb459e tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ebea4a152f4d01864ca878e528642c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec852e304484d27a84980417fffda0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:50:29.015962 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-7e586f7a-7b92-4609-bea9-4e5d87bb459e tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] 10.222.0.43 "GET /compute/v2.1/servers/e351bace-1f8c-4b1e-b53b-3d4936a8209d" status: 200 len: 1519 microversion: 2.1 time: 0.173401 Oct 04 22:50:29.016550 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3175/7173] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:50:28 2022] GET /compute/v2.1/servers/e351bace-1f8c-4b1e-b53b-3d4936a8209d => generated 1519 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:50:30.042103 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-2a1eafb7-de73-4820-ac5c-b7d3bd556bfb tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:50:30.042861 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-2a1eafb7-de73-4820-ac5c-b7d3bd556bfb tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] [instance: e351bace-1f8c-4b1e-b53b-3d4936a8209d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:50:30.044824 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=34 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:50:30.050710 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2a1eafb7-de73-4820-ac5c-b7d3bd556bfb tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:30.051208 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2a1eafb7-de73-4820-ac5c-b7d3bd556bfb tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:30.051667 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2a1eafb7-de73-4820-ac5c-b7d3bd556bfb tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:30.053090 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2a1eafb7-de73-4820-ac5c-b7d3bd556bfb tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:30.053674 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2a1eafb7-de73-4820-ac5c-b7d3bd556bfb tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:30.054128 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2a1eafb7-de73-4820-ac5c-b7d3bd556bfb tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:30.192132 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-2a1eafb7-de73-4820-ac5c-b7d3bd556bfb tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ebea4a152f4d01864ca878e528642c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec852e304484d27a84980417fffda0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:50:30.200657 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-2a1eafb7-de73-4820-ac5c-b7d3bd556bfb tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] 10.222.0.43 "GET /compute/v2.1/servers/e351bace-1f8c-4b1e-b53b-3d4936a8209d" status: 200 len: 1517 microversion: 2.1 time: 0.164459 Oct 04 22:50:30.201237 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 3999/7174] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:50:30 2022] GET /compute/v2.1/servers/e351bace-1f8c-4b1e-b53b-3d4936a8209d => generated 1517 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:50:30.715979 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-4389f5c5-9b68-41fa-b7cd-ee61e184b6ca req-e3bbbc7c-59af-4a5d-98d0-433b05e708aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e351bace-1f8c-4b1e-b53b-3d4936a8209d", "tag": "a8bbd5fa-b77a-444b-bf4a-5ea729c1b8fc"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:50:30.726604 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-4389f5c5-9b68-41fa-b7cd-ee61e184b6ca req-e3bbbc7c-59af-4a5d-98d0-433b05e708aa service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:30.727080 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-4389f5c5-9b68-41fa-b7cd-ee61e184b6ca req-e3bbbc7c-59af-4a5d-98d0-433b05e708aa service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:30.727506 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-4389f5c5-9b68-41fa-b7cd-ee61e184b6ca req-e3bbbc7c-59af-4a5d-98d0-433b05e708aa service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:30.738633 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-4389f5c5-9b68-41fa-b7cd-ee61e184b6ca req-e3bbbc7c-59af-4a5d-98d0-433b05e708aa service nova] Creating event network-changed:a8bbd5fa-b77a-444b-bf4a-5ea729c1b8fc for instance e351bace-1f8c-4b1e-b53b-3d4936a8209d on n-h1-860284-1 Oct 04 22:50:30.744645 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [req-4389f5c5-9b68-41fa-b7cd-ee61e184b6ca req-e3bbbc7c-59af-4a5d-98d0-433b05e708aa service nova] Instance e351bace-1f8c-4b1e-b53b-3d4936a8209d is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860284-1', 'n-h1-860284-1'} {{(pid=134102) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 22:50:30.756222 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-4389f5c5-9b68-41fa-b7cd-ee61e184b6ca req-e3bbbc7c-59af-4a5d-98d0-433b05e708aa service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043367 Oct 04 22:50:30.756892 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3176/7175] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:50:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:50:31.223966 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-6211b883-4288-4ff4-9614-4ac787521506 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:50:31.225327 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-6211b883-4288-4ff4-9614-4ac787521506 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] [instance: e351bace-1f8c-4b1e-b53b-3d4936a8209d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:50:31.232246 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6211b883-4288-4ff4-9614-4ac787521506 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:31.232752 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6211b883-4288-4ff4-9614-4ac787521506 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:31.233211 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6211b883-4288-4ff4-9614-4ac787521506 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:31.233926 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6211b883-4288-4ff4-9614-4ac787521506 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:31.234440 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6211b883-4288-4ff4-9614-4ac787521506 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:31.234892 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6211b883-4288-4ff4-9614-4ac787521506 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:31.369753 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-6211b883-4288-4ff4-9614-4ac787521506 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ebea4a152f4d01864ca878e528642c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec852e304484d27a84980417fffda0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:50:31.377954 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-6211b883-4288-4ff4-9614-4ac787521506 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] 10.222.0.43 "GET /compute/v2.1/servers/e351bace-1f8c-4b1e-b53b-3d4936a8209d" status: 200 len: 1517 microversion: 2.1 time: 0.158091 Oct 04 22:50:31.378569 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4000/7176] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:50:31 2022] GET /compute/v2.1/servers/e351bace-1f8c-4b1e-b53b-3d4936a8209d => generated 1517 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:50:32.402644 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-fd8ecfaa-d21f-4389-867c-7f1a0f99f8de tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:50:32.403395 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-fd8ecfaa-d21f-4389-867c-7f1a0f99f8de tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] [instance: e351bace-1f8c-4b1e-b53b-3d4936a8209d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:50:32.409575 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fd8ecfaa-d21f-4389-867c-7f1a0f99f8de tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:32.410061 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fd8ecfaa-d21f-4389-867c-7f1a0f99f8de tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:32.410536 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fd8ecfaa-d21f-4389-867c-7f1a0f99f8de tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:32.411227 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fd8ecfaa-d21f-4389-867c-7f1a0f99f8de tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:32.411687 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fd8ecfaa-d21f-4389-867c-7f1a0f99f8de tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:32.412272 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fd8ecfaa-d21f-4389-867c-7f1a0f99f8de tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:32.543628 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-fd8ecfaa-d21f-4389-867c-7f1a0f99f8de tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ebea4a152f4d01864ca878e528642c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec852e304484d27a84980417fffda0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:50:32.552133 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-fd8ecfaa-d21f-4389-867c-7f1a0f99f8de tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] 10.222.0.43 "GET /compute/v2.1/servers/e351bace-1f8c-4b1e-b53b-3d4936a8209d" status: 200 len: 1517 microversion: 2.1 time: 0.154692 Oct 04 22:50:32.553273 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3177/7177] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:50:32 2022] GET /compute/v2.1/servers/e351bace-1f8c-4b1e-b53b-3d4936a8209d => generated 1517 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:50:33.577497 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-b637dd22-74b2-4273-90cc-b1eeeef58071 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:50:33.578163 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-b637dd22-74b2-4273-90cc-b1eeeef58071 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] [instance: e351bace-1f8c-4b1e-b53b-3d4936a8209d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:50:33.585568 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b637dd22-74b2-4273-90cc-b1eeeef58071 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:33.586068 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b637dd22-74b2-4273-90cc-b1eeeef58071 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:33.586564 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b637dd22-74b2-4273-90cc-b1eeeef58071 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:33.587281 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b637dd22-74b2-4273-90cc-b1eeeef58071 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:33.587758 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b637dd22-74b2-4273-90cc-b1eeeef58071 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:33.588205 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b637dd22-74b2-4273-90cc-b1eeeef58071 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:33.723720 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-b637dd22-74b2-4273-90cc-b1eeeef58071 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ebea4a152f4d01864ca878e528642c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec852e304484d27a84980417fffda0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:50:33.732054 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-b637dd22-74b2-4273-90cc-b1eeeef58071 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] 10.222.0.43 "GET /compute/v2.1/servers/e351bace-1f8c-4b1e-b53b-3d4936a8209d" status: 200 len: 1514 microversion: 2.1 time: 0.158548 Oct 04 22:50:33.732632 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4001/7178] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:50:33 2022] GET /compute/v2.1/servers/e351bace-1f8c-4b1e-b53b-3d4936a8209d => generated 1514 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:50:33.754869 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-8014adb8-9fc3-4d61-ac22-602a0cbc97c1 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:50:33.755441 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-8014adb8-9fc3-4d61-ac22-602a0cbc97c1 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] [instance: e351bace-1f8c-4b1e-b53b-3d4936a8209d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:50:33.763036 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8014adb8-9fc3-4d61-ac22-602a0cbc97c1 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:33.763524 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8014adb8-9fc3-4d61-ac22-602a0cbc97c1 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:33.763964 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8014adb8-9fc3-4d61-ac22-602a0cbc97c1 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:33.764664 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8014adb8-9fc3-4d61-ac22-602a0cbc97c1 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:33.765122 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8014adb8-9fc3-4d61-ac22-602a0cbc97c1 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:33.765551 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8014adb8-9fc3-4d61-ac22-602a0cbc97c1 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:33.822593 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-8014adb8-9fc3-4d61-ac22-602a0cbc97c1 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] 10.222.0.43 "POST /compute/v2.1/servers/e351bace-1f8c-4b1e-b53b-3d4936a8209d/action" status: 204 len: 0 microversion: 2.1 time: 0.071432 Oct 04 22:50:33.823255 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3178/7179] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 22:50:33 2022] POST /compute/v2.1/servers/e351bace-1f8c-4b1e-b53b-3d4936a8209d/action => generated 0 bytes in 73 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 22:50:33.831490 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-56693643-9d30-41a2-9f14-b6a93213a692 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:50:33.832064 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-56693643-9d30-41a2-9f14-b6a93213a692 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] [instance: e351bace-1f8c-4b1e-b53b-3d4936a8209d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:50:33.838984 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-56693643-9d30-41a2-9f14-b6a93213a692 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:33.839792 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-56693643-9d30-41a2-9f14-b6a93213a692 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:33.840341 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-56693643-9d30-41a2-9f14-b6a93213a692 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:33.841367 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-56693643-9d30-41a2-9f14-b6a93213a692 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:33.841844 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-56693643-9d30-41a2-9f14-b6a93213a692 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:33.842322 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-56693643-9d30-41a2-9f14-b6a93213a692 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:33.978941 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-56693643-9d30-41a2-9f14-b6a93213a692 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ebea4a152f4d01864ca878e528642c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec852e304484d27a84980417fffda0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:50:33.987798 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-56693643-9d30-41a2-9f14-b6a93213a692 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] 10.222.0.43 "GET /compute/v2.1/servers/e351bace-1f8c-4b1e-b53b-3d4936a8209d" status: 200 len: 1514 microversion: 2.1 time: 0.160212 Oct 04 22:50:33.988632 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4002/7180] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:50:33 2022] GET /compute/v2.1/servers/e351bace-1f8c-4b1e-b53b-3d4936a8209d => generated 1514 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:50:35.013259 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-1ef1d84d-d9d0-4363-b885-f9976204d3da tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:50:35.013963 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-1ef1d84d-d9d0-4363-b885-f9976204d3da tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] [instance: e351bace-1f8c-4b1e-b53b-3d4936a8209d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:50:35.020084 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1ef1d84d-d9d0-4363-b885-f9976204d3da tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:35.020573 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1ef1d84d-d9d0-4363-b885-f9976204d3da tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:35.021011 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1ef1d84d-d9d0-4363-b885-f9976204d3da tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:35.022468 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1ef1d84d-d9d0-4363-b885-f9976204d3da tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:35.022843 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1ef1d84d-d9d0-4363-b885-f9976204d3da tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:35.023270 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1ef1d84d-d9d0-4363-b885-f9976204d3da tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:35.162621 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-1ef1d84d-d9d0-4363-b885-f9976204d3da tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ebea4a152f4d01864ca878e528642c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec852e304484d27a84980417fffda0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:50:35.171190 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-1ef1d84d-d9d0-4363-b885-f9976204d3da tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] 10.222.0.43 "GET /compute/v2.1/servers/e351bace-1f8c-4b1e-b53b-3d4936a8209d" status: 200 len: 1506 microversion: 2.1 time: 0.163064 Oct 04 22:50:35.172060 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3179/7181] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:50:35 2022] GET /compute/v2.1/servers/e351bace-1f8c-4b1e-b53b-3d4936a8209d => generated 1506 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:50:35.197313 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-d2f138d9-7d44-4880-acd7-3447b8a86b7f tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:50:35.197942 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-d2f138d9-7d44-4880-acd7-3447b8a86b7f tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] [instance: e351bace-1f8c-4b1e-b53b-3d4936a8209d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:50:35.204820 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d2f138d9-7d44-4880-acd7-3447b8a86b7f tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:35.205322 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d2f138d9-7d44-4880-acd7-3447b8a86b7f tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:35.205775 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d2f138d9-7d44-4880-acd7-3447b8a86b7f tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:35.206518 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d2f138d9-7d44-4880-acd7-3447b8a86b7f tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:35.207034 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d2f138d9-7d44-4880-acd7-3447b8a86b7f tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:35.207509 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d2f138d9-7d44-4880-acd7-3447b8a86b7f tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:35.339141 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-d2f138d9-7d44-4880-acd7-3447b8a86b7f tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ebea4a152f4d01864ca878e528642c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec852e304484d27a84980417fffda0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:50:35.346905 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-d2f138d9-7d44-4880-acd7-3447b8a86b7f tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] 10.222.0.43 "GET /compute/v2.1/servers/e351bace-1f8c-4b1e-b53b-3d4936a8209d" status: 200 len: 1506 microversion: 2.1 time: 0.154423 Oct 04 22:50:35.347477 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4003/7182] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:50:35 2022] GET /compute/v2.1/servers/e351bace-1f8c-4b1e-b53b-3d4936a8209d => generated 1506 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:50:35.372461 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-2f131501-95c3-4a03-8c4f-6c6157b29514 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Action: 'create', calling method: .version_select at 0x7fbb2e5fdc10>, body: {"keypair": {"name": "tempest-keypair-1989799812", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKYx0aoVWvQQgYzCgNMl/x2vsfhiasLpfoDp9RcSKU9La1rZbLJToIOul4f+jKFsq2rgViXbAbi68HU1Fj5A+tq1EZE4xPpdVrz+aPwiGHnGAX2Nqo0nri8mvIEa8GqMZg=="}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:50:35.388820 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-2f131501-95c3-4a03-8c4f-6c6157b29514 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Getting quotas for project 8ec852e304484d27a84980417fffda0e. Resources: {'key_pairs'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:50:35.393845 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-2f131501-95c3-4a03-8c4f-6c6157b29514 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Getting quotas for user d0ebea4a152f4d01864ca878e528642c and project 8ec852e304484d27a84980417fffda0e. Resources: {'key_pairs'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:50:35.421585 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-2f131501-95c3-4a03-8c4f-6c6157b29514 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.053051 Oct 04 22:50:35.422219 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3180/7183] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Oct 4 22:50:35 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:50:36.651218 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-4176721b-1a13-48a3-84d8-52fde96113d4 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:50:36.651849 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-4176721b-1a13-48a3-84d8-52fde96113d4 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] [instance: e351bace-1f8c-4b1e-b53b-3d4936a8209d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:50:36.660198 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4176721b-1a13-48a3-84d8-52fde96113d4 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:36.660704 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4176721b-1a13-48a3-84d8-52fde96113d4 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:36.661156 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4176721b-1a13-48a3-84d8-52fde96113d4 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:36.662397 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4176721b-1a13-48a3-84d8-52fde96113d4 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:36.663044 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4176721b-1a13-48a3-84d8-52fde96113d4 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:36.663489 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4176721b-1a13-48a3-84d8-52fde96113d4 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:36.800150 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-4176721b-1a13-48a3-84d8-52fde96113d4 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ebea4a152f4d01864ca878e528642c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec852e304484d27a84980417fffda0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:50:36.808171 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-4176721b-1a13-48a3-84d8-52fde96113d4 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] 10.222.0.43 "GET /compute/v2.1/servers/e351bace-1f8c-4b1e-b53b-3d4936a8209d" status: 200 len: 1506 microversion: 2.1 time: 0.160850 Oct 04 22:50:36.808764 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4004/7184] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:50:36 2022] GET /compute/v2.1/servers/e351bace-1f8c-4b1e-b53b-3d4936a8209d => generated 1506 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:50:36.817399 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-87893ebc-38d1-49f3-bd95-5af3fba8df01 req-f030278c-55de-4534-8896-a58f91f0c3d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e351bace-1f8c-4b1e-b53b-3d4936a8209d", "name": "network-vif-plugged", "status": "completed", "tag": "a8bbd5fa-b77a-444b-bf4a-5ea729c1b8fc"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:50:36.830480 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-87893ebc-38d1-49f3-bd95-5af3fba8df01 req-f030278c-55de-4534-8896-a58f91f0c3d0 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:36.831226 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-87893ebc-38d1-49f3-bd95-5af3fba8df01 req-f030278c-55de-4534-8896-a58f91f0c3d0 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:36.831377 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-714b2e77-d977-4698-8fea-4d355d788f57 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:50:36.831782 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-714b2e77-d977-4698-8fea-4d355d788f57 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] [instance: e351bace-1f8c-4b1e-b53b-3d4936a8209d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:50:36.831973 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-87893ebc-38d1-49f3-bd95-5af3fba8df01 req-f030278c-55de-4534-8896-a58f91f0c3d0 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:36.839321 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-714b2e77-d977-4698-8fea-4d355d788f57 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:36.839841 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-714b2e77-d977-4698-8fea-4d355d788f57 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:36.840309 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-714b2e77-d977-4698-8fea-4d355d788f57 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:36.841041 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-714b2e77-d977-4698-8fea-4d355d788f57 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:36.841562 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-714b2e77-d977-4698-8fea-4d355d788f57 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:36.841964 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-714b2e77-d977-4698-8fea-4d355d788f57 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:36.843519 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-87893ebc-38d1-49f3-bd95-5af3fba8df01 req-f030278c-55de-4534-8896-a58f91f0c3d0 service nova] Creating event network-vif-plugged:a8bbd5fa-b77a-444b-bf4a-5ea729c1b8fc for instance e351bace-1f8c-4b1e-b53b-3d4936a8209d on n-h1-860284-1 Oct 04 22:50:36.848653 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-87893ebc-38d1-49f3-bd95-5af3fba8df01 req-f030278c-55de-4534-8896-a58f91f0c3d0 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036307 Oct 04 22:50:36.849470 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3181/7185] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:50:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:50:36.868728 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-714b2e77-d977-4698-8fea-4d355d788f57 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] [instance: e351bace-1f8c-4b1e-b53b-3d4936a8209d] Going to try to terminate instance {{(pid=134101) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 22:50:36.945419 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-714b2e77-d977-4698-8fea-4d355d788f57 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] 10.222.0.43 "DELETE /compute/v2.1/servers/e351bace-1f8c-4b1e-b53b-3d4936a8209d" status: 204 len: 0 microversion: 2.1 time: 0.117793 Oct 04 22:50:36.946358 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4005/7186] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 22:50:36 2022] DELETE /compute/v2.1/servers/e351bace-1f8c-4b1e-b53b-3d4936a8209d => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 22:50:37.001003 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-393412bb-de6e-4a77-84dc-e163c8e1178e tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-438998289", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452", "networks": [{"uuid": "287ab509-6835-44ac-8e49-a0088c426250"}]}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:50:37.055483 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.network.neutron [None req-393412bb-de6e-4a77-84dc-e163c8e1178e tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] validate_networks() for [('287ab509-6835-44ac-8e49-a0088c426250', None, None, None, None, None)] {{(pid=134102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 22:50:37.689280 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-393412bb-de6e-4a77-84dc-e163c8e1178e tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Flavor limits 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 22:50:37.689717 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-393412bb-de6e-4a77-84dc-e163c8e1178e tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Image limits 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 22:50:37.690199 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-393412bb-de6e-4a77-84dc-e163c8e1178e tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Flavor pref 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 22:50:37.690662 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-393412bb-de6e-4a77-84dc-e163c8e1178e tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Image pref 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 22:50:37.691086 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-393412bb-de6e-4a77-84dc-e163c8e1178e tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 22:50:37.700627 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-393412bb-de6e-4a77-84dc-e163c8e1178e tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:37.701110 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-393412bb-de6e-4a77-84dc-e163c8e1178e tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:37.701551 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-393412bb-de6e-4a77-84dc-e163c8e1178e tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:37.702283 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-393412bb-de6e-4a77-84dc-e163c8e1178e tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:37.702768 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-393412bb-de6e-4a77-84dc-e163c8e1178e tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:37.703198 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-393412bb-de6e-4a77-84dc-e163c8e1178e tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:37.720044 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-393412bb-de6e-4a77-84dc-e163c8e1178e tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Getting quotas for project 8ec852e304484d27a84980417fffda0e. Resources: {'instances', 'ram', 'cores'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:50:37.725359 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-393412bb-de6e-4a77-84dc-e163c8e1178e tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Getting quotas for user d0ebea4a152f4d01864ca878e528642c and project 8ec852e304484d27a84980417fffda0e. Resources: {'instances', 'ram', 'cores'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:50:37.737475 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-393412bb-de6e-4a77-84dc-e163c8e1178e tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Going to run 1 instances... {{(pid=134102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 22:50:37.740411 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-393412bb-de6e-4a77-84dc-e163c8e1178e tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] [instance: 810f7a94-01f2-4757-ac15-39a980d9f477] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='58548514-5dac-426c-81f5-19e3fba33e23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 22:50:37.785876 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-393412bb-de6e-4a77-84dc-e163c8e1178e tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.789230 Oct 04 22:50:37.786672 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3182/7187] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 22:50:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 791 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 22:50:37.799439 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-94a4ed83-4bca-444b-aa55-e7e0cbfc559d tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:50:37.800174 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-94a4ed83-4bca-444b-aa55-e7e0cbfc559d tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] [instance: 810f7a94-01f2-4757-ac15-39a980d9f477] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:50:37.857061 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-94a4ed83-4bca-444b-aa55-e7e0cbfc559d tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ebea4a152f4d01864ca878e528642c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec852e304484d27a84980417fffda0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:50:37.865502 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-94a4ed83-4bca-444b-aa55-e7e0cbfc559d tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] 10.222.0.43 "GET /compute/v2.1/servers/810f7a94-01f2-4757-ac15-39a980d9f477" status: 200 len: 1217 microversion: 2.1 time: 0.070126 Oct 04 22:50:37.866194 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4006/7188] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:50:37 2022] GET /compute/v2.1/servers/810f7a94-01f2-4757-ac15-39a980d9f477 => generated 1217 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:50:38.889806 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-ef26e6c2-6a58-4563-97d8-9dca30c6e040 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:50:38.890653 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-ef26e6c2-6a58-4563-97d8-9dca30c6e040 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] [instance: 810f7a94-01f2-4757-ac15-39a980d9f477] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:50:38.902314 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ef26e6c2-6a58-4563-97d8-9dca30c6e040 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:38.902934 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ef26e6c2-6a58-4563-97d8-9dca30c6e040 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:38.903451 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ef26e6c2-6a58-4563-97d8-9dca30c6e040 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:38.904238 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ef26e6c2-6a58-4563-97d8-9dca30c6e040 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:38.904773 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ef26e6c2-6a58-4563-97d8-9dca30c6e040 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:38.905489 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ef26e6c2-6a58-4563-97d8-9dca30c6e040 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:39.008527 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-ef26e6c2-6a58-4563-97d8-9dca30c6e040 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ebea4a152f4d01864ca878e528642c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec852e304484d27a84980417fffda0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:50:39.064871 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-ef26e6c2-6a58-4563-97d8-9dca30c6e040 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] 10.222.0.43 "GET /compute/v2.1/servers/810f7a94-01f2-4757-ac15-39a980d9f477" status: 200 len: 1269 microversion: 2.1 time: 0.180080 Oct 04 22:50:39.065509 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3183/7189] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:50:38 2022] GET /compute/v2.1/servers/810f7a94-01f2-4757-ac15-39a980d9f477 => generated 1269 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:50:39.124717 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-b6bddb5e-066e-42ba-bacd-850ee995cd8e req-3b63edd8-ee7c-4db0-ab6a-f796f0615495 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e351bace-1f8c-4b1e-b53b-3d4936a8209d", "name": "network-vif-deleted", "tag": "a8bbd5fa-b77a-444b-bf4a-5ea729c1b8fc"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:50:39.146701 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-b6bddb5e-066e-42ba-bacd-850ee995cd8e req-3b63edd8-ee7c-4db0-ab6a-f796f0615495 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:39.147414 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-b6bddb5e-066e-42ba-bacd-850ee995cd8e req-3b63edd8-ee7c-4db0-ab6a-f796f0615495 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:39.147873 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-b6bddb5e-066e-42ba-bacd-850ee995cd8e req-3b63edd8-ee7c-4db0-ab6a-f796f0615495 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:39.159701 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-b6bddb5e-066e-42ba-bacd-850ee995cd8e req-3b63edd8-ee7c-4db0-ab6a-f796f0615495 service nova] Creating event network-vif-deleted:a8bbd5fa-b77a-444b-bf4a-5ea729c1b8fc for instance e351bace-1f8c-4b1e-b53b-3d4936a8209d on n-h1-860284-1 Oct 04 22:50:39.166374 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-b6bddb5e-066e-42ba-bacd-850ee995cd8e req-3b63edd8-ee7c-4db0-ab6a-f796f0615495 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061739 Oct 04 22:50:39.167018 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4007/7190] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:50:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:50:40.089391 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-643937c0-ec03-4a3f-8f24-c683ca61e637 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:50:40.090418 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-643937c0-ec03-4a3f-8f24-c683ca61e637 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] [instance: 810f7a94-01f2-4757-ac15-39a980d9f477] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:50:40.097135 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-643937c0-ec03-4a3f-8f24-c683ca61e637 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:40.097629 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-643937c0-ec03-4a3f-8f24-c683ca61e637 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:40.098071 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-643937c0-ec03-4a3f-8f24-c683ca61e637 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:40.098866 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-643937c0-ec03-4a3f-8f24-c683ca61e637 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:40.099508 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-643937c0-ec03-4a3f-8f24-c683ca61e637 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:40.100131 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-643937c0-ec03-4a3f-8f24-c683ca61e637 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:40.314698 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-643937c0-ec03-4a3f-8f24-c683ca61e637 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ebea4a152f4d01864ca878e528642c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec852e304484d27a84980417fffda0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:50:40.322609 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-643937c0-ec03-4a3f-8f24-c683ca61e637 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] 10.222.0.43 "GET /compute/v2.1/servers/810f7a94-01f2-4757-ac15-39a980d9f477" status: 200 len: 1317 microversion: 2.1 time: 0.237130 Oct 04 22:50:40.323189 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3184/7191] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:50:40 2022] GET /compute/v2.1/servers/810f7a94-01f2-4757-ac15-39a980d9f477 => generated 1317 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:50:40.462376 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-433efce4-c9bf-4490-a3fb-86d2f4aa10ae req-139c53d8-2e08-47da-be17-a6415799a4ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "810f7a94-01f2-4757-ac15-39a980d9f477", "tag": "fd60947d-79b6-41d5-8775-0f0aa624d4f1"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:50:40.473076 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-433efce4-c9bf-4490-a3fb-86d2f4aa10ae req-139c53d8-2e08-47da-be17-a6415799a4ce service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:40.473744 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-433efce4-c9bf-4490-a3fb-86d2f4aa10ae req-139c53d8-2e08-47da-be17-a6415799a4ce service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:40.474996 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-433efce4-c9bf-4490-a3fb-86d2f4aa10ae req-139c53d8-2e08-47da-be17-a6415799a4ce service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:40.486743 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-433efce4-c9bf-4490-a3fb-86d2f4aa10ae req-139c53d8-2e08-47da-be17-a6415799a4ce service nova] Creating event network-changed:fd60947d-79b6-41d5-8775-0f0aa624d4f1 for instance 810f7a94-01f2-4757-ac15-39a980d9f477 on n-h1-860284-1 Oct 04 22:50:40.492387 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-433efce4-c9bf-4490-a3fb-86d2f4aa10ae req-139c53d8-2e08-47da-be17-a6415799a4ce service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036143 Oct 04 22:50:40.493103 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4008/7192] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:50:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:50:41.345892 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-9436b40a-3cc6-4bcb-b5ca-fb27e70595f1 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:50:41.346545 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-9436b40a-3cc6-4bcb-b5ca-fb27e70595f1 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] [instance: 810f7a94-01f2-4757-ac15-39a980d9f477] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:50:41.353607 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9436b40a-3cc6-4bcb-b5ca-fb27e70595f1 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:41.354094 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9436b40a-3cc6-4bcb-b5ca-fb27e70595f1 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:41.354571 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9436b40a-3cc6-4bcb-b5ca-fb27e70595f1 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:41.355269 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9436b40a-3cc6-4bcb-b5ca-fb27e70595f1 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:41.355724 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9436b40a-3cc6-4bcb-b5ca-fb27e70595f1 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:41.356160 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9436b40a-3cc6-4bcb-b5ca-fb27e70595f1 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:41.488992 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-9436b40a-3cc6-4bcb-b5ca-fb27e70595f1 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ebea4a152f4d01864ca878e528642c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec852e304484d27a84980417fffda0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:50:41.497175 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-9436b40a-3cc6-4bcb-b5ca-fb27e70595f1 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] 10.222.0.43 "GET /compute/v2.1/servers/810f7a94-01f2-4757-ac15-39a980d9f477" status: 200 len: 1317 microversion: 2.1 time: 0.155190 Oct 04 22:50:41.497759 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3185/7193] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:50:41 2022] GET /compute/v2.1/servers/810f7a94-01f2-4757-ac15-39a980d9f477 => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:50:42.522541 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-9485b493-0dcb-437d-bc78-e6c42ef0b25c tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:50:42.523266 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-9485b493-0dcb-437d-bc78-e6c42ef0b25c tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] [instance: 810f7a94-01f2-4757-ac15-39a980d9f477] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:50:42.529469 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9485b493-0dcb-437d-bc78-e6c42ef0b25c tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:42.529967 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9485b493-0dcb-437d-bc78-e6c42ef0b25c tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:42.530452 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9485b493-0dcb-437d-bc78-e6c42ef0b25c tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:42.531158 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9485b493-0dcb-437d-bc78-e6c42ef0b25c tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:42.531637 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9485b493-0dcb-437d-bc78-e6c42ef0b25c tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:42.532089 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9485b493-0dcb-437d-bc78-e6c42ef0b25c tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:42.667964 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-9485b493-0dcb-437d-bc78-e6c42ef0b25c tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ebea4a152f4d01864ca878e528642c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec852e304484d27a84980417fffda0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:50:42.675860 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-9485b493-0dcb-437d-bc78-e6c42ef0b25c tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] 10.222.0.43 "GET /compute/v2.1/servers/810f7a94-01f2-4757-ac15-39a980d9f477" status: 200 len: 1317 microversion: 2.1 time: 0.159308 Oct 04 22:50:42.677080 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4009/7194] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:50:42 2022] GET /compute/v2.1/servers/810f7a94-01f2-4757-ac15-39a980d9f477 => generated 1317 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:50:43.700200 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-043c09be-6247-4355-a8ba-b90a52f5e5f4 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:50:43.700820 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-043c09be-6247-4355-a8ba-b90a52f5e5f4 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] [instance: 810f7a94-01f2-4757-ac15-39a980d9f477] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:50:43.707729 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-043c09be-6247-4355-a8ba-b90a52f5e5f4 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:43.708153 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-043c09be-6247-4355-a8ba-b90a52f5e5f4 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:43.708596 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-043c09be-6247-4355-a8ba-b90a52f5e5f4 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:43.709376 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-043c09be-6247-4355-a8ba-b90a52f5e5f4 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:43.709838 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-043c09be-6247-4355-a8ba-b90a52f5e5f4 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:43.710270 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-043c09be-6247-4355-a8ba-b90a52f5e5f4 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:43.837724 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-043c09be-6247-4355-a8ba-b90a52f5e5f4 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ebea4a152f4d01864ca878e528642c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec852e304484d27a84980417fffda0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:50:43.845364 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-043c09be-6247-4355-a8ba-b90a52f5e5f4 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] 10.222.0.43 "GET /compute/v2.1/servers/810f7a94-01f2-4757-ac15-39a980d9f477" status: 200 len: 1317 microversion: 2.1 time: 0.149368 Oct 04 22:50:43.845950 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3186/7195] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:50:43 2022] GET /compute/v2.1/servers/810f7a94-01f2-4757-ac15-39a980d9f477 => generated 1317 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:50:44.868098 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e9ce6705-6284-4bab-adbe-e0df70896e4a tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:50:44.868668 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-e9ce6705-6284-4bab-adbe-e0df70896e4a tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] [instance: 810f7a94-01f2-4757-ac15-39a980d9f477] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:50:44.876210 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e9ce6705-6284-4bab-adbe-e0df70896e4a tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:44.876724 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e9ce6705-6284-4bab-adbe-e0df70896e4a tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:44.877185 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e9ce6705-6284-4bab-adbe-e0df70896e4a tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:44.877913 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e9ce6705-6284-4bab-adbe-e0df70896e4a tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:44.878427 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e9ce6705-6284-4bab-adbe-e0df70896e4a tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:44.878879 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e9ce6705-6284-4bab-adbe-e0df70896e4a tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:45.015128 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-e9ce6705-6284-4bab-adbe-e0df70896e4a tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ebea4a152f4d01864ca878e528642c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec852e304484d27a84980417fffda0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:50:45.018919 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:50:45.024875 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-e9ce6705-6284-4bab-adbe-e0df70896e4a tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] 10.222.0.43 "GET /compute/v2.1/servers/810f7a94-01f2-4757-ac15-39a980d9f477" status: 200 len: 1317 microversion: 2.1 time: 0.161245 Oct 04 22:50:45.025479 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4010/7196] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:50:44 2022] GET /compute/v2.1/servers/810f7a94-01f2-4757-ac15-39a980d9f477 => generated 1317 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:50:46.047960 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-2959fd1a-98b0-40ae-99ba-35ff796ac4c0 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:50:46.048576 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-2959fd1a-98b0-40ae-99ba-35ff796ac4c0 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] [instance: 810f7a94-01f2-4757-ac15-39a980d9f477] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:50:46.055523 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2959fd1a-98b0-40ae-99ba-35ff796ac4c0 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:46.056009 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2959fd1a-98b0-40ae-99ba-35ff796ac4c0 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:46.056451 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2959fd1a-98b0-40ae-99ba-35ff796ac4c0 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:46.057148 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2959fd1a-98b0-40ae-99ba-35ff796ac4c0 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:46.057605 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2959fd1a-98b0-40ae-99ba-35ff796ac4c0 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:46.058040 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2959fd1a-98b0-40ae-99ba-35ff796ac4c0 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:46.185420 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-2959fd1a-98b0-40ae-99ba-35ff796ac4c0 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ebea4a152f4d01864ca878e528642c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec852e304484d27a84980417fffda0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:50:46.193272 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-2959fd1a-98b0-40ae-99ba-35ff796ac4c0 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] 10.222.0.43 "GET /compute/v2.1/servers/810f7a94-01f2-4757-ac15-39a980d9f477" status: 200 len: 1317 microversion: 2.1 time: 0.149214 Oct 04 22:50:46.193847 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3187/7197] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:50:46 2022] GET /compute/v2.1/servers/810f7a94-01f2-4757-ac15-39a980d9f477 => generated 1317 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:50:46.855978 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-e205778a-2892-4a7a-8ca2-d026bf273dbb req-4a9ca13d-5828-4c4d-98bd-0ff0808ea5d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "810f7a94-01f2-4757-ac15-39a980d9f477", "name": "network-vif-plugged", "status": "completed", "tag": "fd60947d-79b6-41d5-8775-0f0aa624d4f1"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:50:46.868461 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-e205778a-2892-4a7a-8ca2-d026bf273dbb req-4a9ca13d-5828-4c4d-98bd-0ff0808ea5d7 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:46.868968 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-e205778a-2892-4a7a-8ca2-d026bf273dbb req-4a9ca13d-5828-4c4d-98bd-0ff0808ea5d7 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:46.869419 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-e205778a-2892-4a7a-8ca2-d026bf273dbb req-4a9ca13d-5828-4c4d-98bd-0ff0808ea5d7 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:46.882860 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-e205778a-2892-4a7a-8ca2-d026bf273dbb req-4a9ca13d-5828-4c4d-98bd-0ff0808ea5d7 service nova] Creating event network-vif-plugged:fd60947d-79b6-41d5-8775-0f0aa624d4f1 for instance 810f7a94-01f2-4757-ac15-39a980d9f477 on n-h1-860284-1 Oct 04 22:50:46.888189 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-e205778a-2892-4a7a-8ca2-d026bf273dbb req-4a9ca13d-5828-4c4d-98bd-0ff0808ea5d7 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035870 Oct 04 22:50:46.888807 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4011/7198] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:50:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:50:47.216037 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-2561029e-5b90-4f33-b01d-2f884b50210a tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:50:47.216652 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-2561029e-5b90-4f33-b01d-2f884b50210a tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] [instance: 810f7a94-01f2-4757-ac15-39a980d9f477] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:50:47.223500 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2561029e-5b90-4f33-b01d-2f884b50210a tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:47.224512 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2561029e-5b90-4f33-b01d-2f884b50210a tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:47.225124 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2561029e-5b90-4f33-b01d-2f884b50210a tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:47.225854 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2561029e-5b90-4f33-b01d-2f884b50210a tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:47.226342 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2561029e-5b90-4f33-b01d-2f884b50210a tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:47.226791 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2561029e-5b90-4f33-b01d-2f884b50210a tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:47.354238 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-2561029e-5b90-4f33-b01d-2f884b50210a tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ebea4a152f4d01864ca878e528642c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec852e304484d27a84980417fffda0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:50:47.361813 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-2561029e-5b90-4f33-b01d-2f884b50210a tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] 10.222.0.43 "GET /compute/v2.1/servers/810f7a94-01f2-4757-ac15-39a980d9f477" status: 200 len: 1317 microversion: 2.1 time: 0.149781 Oct 04 22:50:47.362510 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3188/7199] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:50:47 2022] GET /compute/v2.1/servers/810f7a94-01f2-4757-ac15-39a980d9f477 => generated 1317 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:50:48.383558 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=2 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:50:48.389377 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-bea1469f-5bd2-48c3-baf5-eaa9309441ac tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:50:48.390104 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-bea1469f-5bd2-48c3-baf5-eaa9309441ac tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] [instance: 810f7a94-01f2-4757-ac15-39a980d9f477] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:50:48.397309 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bea1469f-5bd2-48c3-baf5-eaa9309441ac tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:48.397800 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bea1469f-5bd2-48c3-baf5-eaa9309441ac tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:48.398950 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bea1469f-5bd2-48c3-baf5-eaa9309441ac tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:48.400023 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bea1469f-5bd2-48c3-baf5-eaa9309441ac tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:48.400502 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bea1469f-5bd2-48c3-baf5-eaa9309441ac tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:48.400949 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bea1469f-5bd2-48c3-baf5-eaa9309441ac tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:48.540761 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-bea1469f-5bd2-48c3-baf5-eaa9309441ac tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ebea4a152f4d01864ca878e528642c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec852e304484d27a84980417fffda0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:50:48.548846 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-bea1469f-5bd2-48c3-baf5-eaa9309441ac tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] 10.222.0.43 "GET /compute/v2.1/servers/810f7a94-01f2-4757-ac15-39a980d9f477" status: 200 len: 1507 microversion: 2.1 time: 0.167675 Oct 04 22:50:48.549579 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4012/7200] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:50:48 2022] GET /compute/v2.1/servers/810f7a94-01f2-4757-ac15-39a980d9f477 => generated 1507 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:50:48.572606 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-bab2912f-5306-476b-8fcc-8cfad7da572b tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:50:48.573270 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-bab2912f-5306-476b-8fcc-8cfad7da572b tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] [instance: 810f7a94-01f2-4757-ac15-39a980d9f477] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:50:48.575277 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell0:SELECT=2 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:50:48.575938 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell0:SELECT=10 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:50:48.582756 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bab2912f-5306-476b-8fcc-8cfad7da572b tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:48.583240 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bab2912f-5306-476b-8fcc-8cfad7da572b tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:48.583675 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bab2912f-5306-476b-8fcc-8cfad7da572b tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:48.584407 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bab2912f-5306-476b-8fcc-8cfad7da572b tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:48.584859 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bab2912f-5306-476b-8fcc-8cfad7da572b tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:48.585288 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bab2912f-5306-476b-8fcc-8cfad7da572b tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:48.722236 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-bab2912f-5306-476b-8fcc-8cfad7da572b tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ebea4a152f4d01864ca878e528642c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec852e304484d27a84980417fffda0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:50:48.730515 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-bab2912f-5306-476b-8fcc-8cfad7da572b tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] 10.222.0.43 "GET /compute/v2.1/servers/810f7a94-01f2-4757-ac15-39a980d9f477" status: 200 len: 1507 microversion: 2.1 time: 0.162025 Oct 04 22:50:48.731104 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3189/7201] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:50:48 2022] GET /compute/v2.1/servers/810f7a94-01f2-4757-ac15-39a980d9f477 => generated 1507 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:50:48.753446 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-64f5b606-baf3-414f-8c24-3996094c5d73 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:50:48.755732 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-64f5b606-baf3-414f-8c24-3996094c5d73 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] [instance: 810f7a94-01f2-4757-ac15-39a980d9f477] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:50:48.761788 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-64f5b606-baf3-414f-8c24-3996094c5d73 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:48.762302 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-64f5b606-baf3-414f-8c24-3996094c5d73 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:48.762799 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-64f5b606-baf3-414f-8c24-3996094c5d73 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:48.763519 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-64f5b606-baf3-414f-8c24-3996094c5d73 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:48.763996 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-64f5b606-baf3-414f-8c24-3996094c5d73 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:48.764450 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-64f5b606-baf3-414f-8c24-3996094c5d73 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:48.793034 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-64f5b606-baf3-414f-8c24-3996094c5d73 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'd0ebea4a152f4d01864ca878e528642c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec852e304484d27a84980417fffda0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:50:48.798592 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-64f5b606-baf3-414f-8c24-3996094c5d73 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] [instance: 810f7a94-01f2-4757-ac15-39a980d9f477] Old instance type m1.heat2, new instance type m1.heat {{(pid=134101) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 04 22:50:48.805842 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-64f5b606-baf3-414f-8c24-3996094c5d73 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Flavor limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 22:50:48.806288 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-64f5b606-baf3-414f-8c24-3996094c5d73 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Image limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 22:50:48.806817 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-64f5b606-baf3-414f-8c24-3996094c5d73 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Flavor pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 22:50:48.807251 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-64f5b606-baf3-414f-8c24-3996094c5d73 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Image pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 22:50:48.807690 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-64f5b606-baf3-414f-8c24-3996094c5d73 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 22:50:48.871020 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-64f5b606-baf3-414f-8c24-3996094c5d73 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] 10.222.0.43 "POST /compute/v2.1/servers/810f7a94-01f2-4757-ac15-39a980d9f477/action" status: 202 len: 0 microversion: 2.1 time: 0.121698 Oct 04 22:50:48.871716 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4013/7202] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 22:50:48 2022] POST /compute/v2.1/servers/810f7a94-01f2-4757-ac15-39a980d9f477/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 22:50:48.879901 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-b5cd7d9e-0302-4c4f-94cc-ef108055af5a tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:50:48.880521 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-b5cd7d9e-0302-4c4f-94cc-ef108055af5a tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] [instance: 810f7a94-01f2-4757-ac15-39a980d9f477] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:50:48.886632 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b5cd7d9e-0302-4c4f-94cc-ef108055af5a tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:48.887144 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b5cd7d9e-0302-4c4f-94cc-ef108055af5a tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:48.887706 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b5cd7d9e-0302-4c4f-94cc-ef108055af5a tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:48.888414 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b5cd7d9e-0302-4c4f-94cc-ef108055af5a tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:48.888869 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b5cd7d9e-0302-4c4f-94cc-ef108055af5a tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:48.889345 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b5cd7d9e-0302-4c4f-94cc-ef108055af5a tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:49.031172 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-b5cd7d9e-0302-4c4f-94cc-ef108055af5a tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ebea4a152f4d01864ca878e528642c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec852e304484d27a84980417fffda0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:50:49.039671 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-b5cd7d9e-0302-4c4f-94cc-ef108055af5a tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] 10.222.0.43 "GET /compute/v2.1/servers/810f7a94-01f2-4757-ac15-39a980d9f477" status: 200 len: 1514 microversion: 2.1 time: 0.163536 Oct 04 22:50:49.040259 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3190/7203] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:50:48 2022] GET /compute/v2.1/servers/810f7a94-01f2-4757-ac15-39a980d9f477 => generated 1514 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:50:50.064320 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-ef21c797-4772-40ef-b469-4b7c3db4bddc tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:50:50.064974 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-ef21c797-4772-40ef-b469-4b7c3db4bddc tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] [instance: 810f7a94-01f2-4757-ac15-39a980d9f477] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:50:50.072470 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ef21c797-4772-40ef-b469-4b7c3db4bddc tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:50.073177 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ef21c797-4772-40ef-b469-4b7c3db4bddc tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:50.073567 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ef21c797-4772-40ef-b469-4b7c3db4bddc tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:50.074442 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ef21c797-4772-40ef-b469-4b7c3db4bddc tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:50.074924 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ef21c797-4772-40ef-b469-4b7c3db4bddc tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:50.075375 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ef21c797-4772-40ef-b469-4b7c3db4bddc tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:50.212859 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-ef21c797-4772-40ef-b469-4b7c3db4bddc tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ebea4a152f4d01864ca878e528642c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec852e304484d27a84980417fffda0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:50:50.220853 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-ef21c797-4772-40ef-b469-4b7c3db4bddc tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] 10.222.0.43 "GET /compute/v2.1/servers/810f7a94-01f2-4757-ac15-39a980d9f477" status: 200 len: 1514 microversion: 2.1 time: 0.161291 Oct 04 22:50:50.221447 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4014/7204] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:50:50 2022] GET /compute/v2.1/servers/810f7a94-01f2-4757-ac15-39a980d9f477 => generated 1514 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:50:51.245192 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-b3c2898c-0013-4120-9928-5b3d05e0830b tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:50:51.245804 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-b3c2898c-0013-4120-9928-5b3d05e0830b tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] [instance: 810f7a94-01f2-4757-ac15-39a980d9f477] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:50:51.252880 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b3c2898c-0013-4120-9928-5b3d05e0830b tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:51.253362 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b3c2898c-0013-4120-9928-5b3d05e0830b tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:51.253799 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b3c2898c-0013-4120-9928-5b3d05e0830b tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:51.254535 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b3c2898c-0013-4120-9928-5b3d05e0830b tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:51.254993 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b3c2898c-0013-4120-9928-5b3d05e0830b tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:51.255420 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b3c2898c-0013-4120-9928-5b3d05e0830b tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:51.388303 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-b3c2898c-0013-4120-9928-5b3d05e0830b tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ebea4a152f4d01864ca878e528642c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec852e304484d27a84980417fffda0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:50:51.398647 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-b3c2898c-0013-4120-9928-5b3d05e0830b tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] 10.222.0.43 "GET /compute/v2.1/servers/810f7a94-01f2-4757-ac15-39a980d9f477" status: 200 len: 1519 microversion: 2.1 time: 0.157389 Oct 04 22:50:51.399240 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3191/7205] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:50:51 2022] GET /compute/v2.1/servers/810f7a94-01f2-4757-ac15-39a980d9f477 => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:50:52.423137 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-bb804266-09b5-4a2c-874c-78cd450accf6 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:50:52.423714 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-bb804266-09b5-4a2c-874c-78cd450accf6 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] [instance: 810f7a94-01f2-4757-ac15-39a980d9f477] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:50:52.431695 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bb804266-09b5-4a2c-874c-78cd450accf6 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:52.432203 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bb804266-09b5-4a2c-874c-78cd450accf6 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:52.432661 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bb804266-09b5-4a2c-874c-78cd450accf6 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:52.433381 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bb804266-09b5-4a2c-874c-78cd450accf6 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:52.433858 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bb804266-09b5-4a2c-874c-78cd450accf6 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:52.434308 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bb804266-09b5-4a2c-874c-78cd450accf6 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:52.569727 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-bb804266-09b5-4a2c-874c-78cd450accf6 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ebea4a152f4d01864ca878e528642c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec852e304484d27a84980417fffda0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:50:52.577524 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-bb804266-09b5-4a2c-874c-78cd450accf6 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] 10.222.0.43 "GET /compute/v2.1/servers/810f7a94-01f2-4757-ac15-39a980d9f477" status: 200 len: 1519 microversion: 2.1 time: 0.158576 Oct 04 22:50:52.578103 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4015/7206] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:50:52 2022] GET /compute/v2.1/servers/810f7a94-01f2-4757-ac15-39a980d9f477 => generated 1519 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:50:53.602435 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-e1cd2163-2e92-4c9c-9674-1d477f4914f9 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:50:53.603054 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-e1cd2163-2e92-4c9c-9674-1d477f4914f9 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] [instance: 810f7a94-01f2-4757-ac15-39a980d9f477] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:50:53.609741 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e1cd2163-2e92-4c9c-9674-1d477f4914f9 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:53.610218 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e1cd2163-2e92-4c9c-9674-1d477f4914f9 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:53.610681 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e1cd2163-2e92-4c9c-9674-1d477f4914f9 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:53.611372 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e1cd2163-2e92-4c9c-9674-1d477f4914f9 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:53.611823 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e1cd2163-2e92-4c9c-9674-1d477f4914f9 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:53.612244 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e1cd2163-2e92-4c9c-9674-1d477f4914f9 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:53.745022 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-e1cd2163-2e92-4c9c-9674-1d477f4914f9 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ebea4a152f4d01864ca878e528642c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec852e304484d27a84980417fffda0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:50:53.753059 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-e1cd2163-2e92-4c9c-9674-1d477f4914f9 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] 10.222.0.43 "GET /compute/v2.1/servers/810f7a94-01f2-4757-ac15-39a980d9f477" status: 200 len: 1519 microversion: 2.1 time: 0.154529 Oct 04 22:50:53.753646 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3192/7207] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:50:53 2022] GET /compute/v2.1/servers/810f7a94-01f2-4757-ac15-39a980d9f477 => generated 1519 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:50:54.776917 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-b1dcc897-0613-4861-a622-76022ec96320 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:50:54.777586 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-b1dcc897-0613-4861-a622-76022ec96320 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] [instance: 810f7a94-01f2-4757-ac15-39a980d9f477] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:50:54.784684 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b1dcc897-0613-4861-a622-76022ec96320 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:54.785188 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b1dcc897-0613-4861-a622-76022ec96320 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:54.785646 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b1dcc897-0613-4861-a622-76022ec96320 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:54.786355 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b1dcc897-0613-4861-a622-76022ec96320 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:54.786979 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b1dcc897-0613-4861-a622-76022ec96320 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:54.787422 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b1dcc897-0613-4861-a622-76022ec96320 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:54.921114 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-b1dcc897-0613-4861-a622-76022ec96320 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ebea4a152f4d01864ca878e528642c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec852e304484d27a84980417fffda0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:50:54.929443 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-b1dcc897-0613-4861-a622-76022ec96320 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] 10.222.0.43 "GET /compute/v2.1/servers/810f7a94-01f2-4757-ac15-39a980d9f477" status: 200 len: 1519 microversion: 2.1 time: 0.156520 Oct 04 22:50:54.930015 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4016/7208] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:50:54 2022] GET /compute/v2.1/servers/810f7a94-01f2-4757-ac15-39a980d9f477 => generated 1519 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:50:55.952851 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-24ac1020-eae4-41c8-8956-a3ae58238fee tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:50:55.953495 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-24ac1020-eae4-41c8-8956-a3ae58238fee tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] [instance: 810f7a94-01f2-4757-ac15-39a980d9f477] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:50:55.960769 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-24ac1020-eae4-41c8-8956-a3ae58238fee tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:55.961283 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-24ac1020-eae4-41c8-8956-a3ae58238fee tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:55.961721 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-24ac1020-eae4-41c8-8956-a3ae58238fee tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:55.962441 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-24ac1020-eae4-41c8-8956-a3ae58238fee tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:55.962902 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-24ac1020-eae4-41c8-8956-a3ae58238fee tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:55.963330 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-24ac1020-eae4-41c8-8956-a3ae58238fee tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:55.967324 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:50:56.094095 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-24ac1020-eae4-41c8-8956-a3ae58238fee tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ebea4a152f4d01864ca878e528642c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec852e304484d27a84980417fffda0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:50:56.102463 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-24ac1020-eae4-41c8-8956-a3ae58238fee tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] 10.222.0.43 "GET /compute/v2.1/servers/810f7a94-01f2-4757-ac15-39a980d9f477" status: 200 len: 1519 microversion: 2.1 time: 0.153491 Oct 04 22:50:56.103054 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3193/7209] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:50:55 2022] GET /compute/v2.1/servers/810f7a94-01f2-4757-ac15-39a980d9f477 => generated 1519 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:50:57.125959 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-ae9f1ce4-5a55-45fe-914a-9015265941ae tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:50:57.126620 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-ae9f1ce4-5a55-45fe-914a-9015265941ae tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] [instance: 810f7a94-01f2-4757-ac15-39a980d9f477] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:50:57.134314 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ae9f1ce4-5a55-45fe-914a-9015265941ae tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:57.135111 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ae9f1ce4-5a55-45fe-914a-9015265941ae tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:57.135289 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ae9f1ce4-5a55-45fe-914a-9015265941ae tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:57.136016 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ae9f1ce4-5a55-45fe-914a-9015265941ae tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:57.136487 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ae9f1ce4-5a55-45fe-914a-9015265941ae tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:57.136962 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ae9f1ce4-5a55-45fe-914a-9015265941ae tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:57.270525 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-ae9f1ce4-5a55-45fe-914a-9015265941ae tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ebea4a152f4d01864ca878e528642c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec852e304484d27a84980417fffda0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:50:57.279225 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-ae9f1ce4-5a55-45fe-914a-9015265941ae tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] 10.222.0.43 "GET /compute/v2.1/servers/810f7a94-01f2-4757-ac15-39a980d9f477" status: 200 len: 1519 microversion: 2.1 time: 0.157427 Oct 04 22:50:57.279802 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4017/7210] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:50:57 2022] GET /compute/v2.1/servers/810f7a94-01f2-4757-ac15-39a980d9f477 => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:50:58.304115 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-55c4ecf5-f4d4-4056-859d-a1f4b3175015 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:50:58.304739 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-55c4ecf5-f4d4-4056-859d-a1f4b3175015 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] [instance: 810f7a94-01f2-4757-ac15-39a980d9f477] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:50:58.311327 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-55c4ecf5-f4d4-4056-859d-a1f4b3175015 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:58.311811 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-55c4ecf5-f4d4-4056-859d-a1f4b3175015 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:58.312254 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-55c4ecf5-f4d4-4056-859d-a1f4b3175015 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:58.312945 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-55c4ecf5-f4d4-4056-859d-a1f4b3175015 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:58.313400 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-55c4ecf5-f4d4-4056-859d-a1f4b3175015 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:58.313829 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-55c4ecf5-f4d4-4056-859d-a1f4b3175015 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:58.442018 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-55c4ecf5-f4d4-4056-859d-a1f4b3175015 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ebea4a152f4d01864ca878e528642c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec852e304484d27a84980417fffda0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:50:58.449805 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-55c4ecf5-f4d4-4056-859d-a1f4b3175015 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] 10.222.0.43 "GET /compute/v2.1/servers/810f7a94-01f2-4757-ac15-39a980d9f477" status: 200 len: 1519 microversion: 2.1 time: 0.150469 Oct 04 22:50:58.450404 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3194/7211] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:50:58 2022] GET /compute/v2.1/servers/810f7a94-01f2-4757-ac15-39a980d9f477 => generated 1519 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:50:59.472868 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-caefb0d4-ba2c-4fb7-96d3-83ff49dca0c9 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:50:59.473511 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-caefb0d4-ba2c-4fb7-96d3-83ff49dca0c9 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] [instance: 810f7a94-01f2-4757-ac15-39a980d9f477] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:50:59.480874 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-caefb0d4-ba2c-4fb7-96d3-83ff49dca0c9 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:59.481360 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-caefb0d4-ba2c-4fb7-96d3-83ff49dca0c9 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:59.481809 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-caefb0d4-ba2c-4fb7-96d3-83ff49dca0c9 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:59.482560 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-caefb0d4-ba2c-4fb7-96d3-83ff49dca0c9 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:59.483028 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-caefb0d4-ba2c-4fb7-96d3-83ff49dca0c9 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:59.483468 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-caefb0d4-ba2c-4fb7-96d3-83ff49dca0c9 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:59.618241 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-caefb0d4-ba2c-4fb7-96d3-83ff49dca0c9 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ebea4a152f4d01864ca878e528642c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec852e304484d27a84980417fffda0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:50:59.626453 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-caefb0d4-ba2c-4fb7-96d3-83ff49dca0c9 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] 10.222.0.43 "GET /compute/v2.1/servers/810f7a94-01f2-4757-ac15-39a980d9f477" status: 200 len: 1519 microversion: 2.1 time: 0.157725 Oct 04 22:50:59.627033 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4018/7212] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:50:59 2022] GET /compute/v2.1/servers/810f7a94-01f2-4757-ac15-39a980d9f477 => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:51:00.649670 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-7aecfd00-bfb1-447a-ab2b-7893906fc127 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:51:00.650291 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-7aecfd00-bfb1-447a-ab2b-7893906fc127 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] [instance: 810f7a94-01f2-4757-ac15-39a980d9f477] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:51:00.653131 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=4 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:51:00.659148 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7aecfd00-bfb1-447a-ab2b-7893906fc127 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:51:00.659642 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7aecfd00-bfb1-447a-ab2b-7893906fc127 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:51:00.660131 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7aecfd00-bfb1-447a-ab2b-7893906fc127 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:51:00.660784 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7aecfd00-bfb1-447a-ab2b-7893906fc127 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:51:00.661243 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7aecfd00-bfb1-447a-ab2b-7893906fc127 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:51:00.661679 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7aecfd00-bfb1-447a-ab2b-7893906fc127 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:51:00.797613 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-7aecfd00-bfb1-447a-ab2b-7893906fc127 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ebea4a152f4d01864ca878e528642c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec852e304484d27a84980417fffda0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:51:00.806168 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-7aecfd00-bfb1-447a-ab2b-7893906fc127 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] 10.222.0.43 "GET /compute/v2.1/servers/810f7a94-01f2-4757-ac15-39a980d9f477" status: 200 len: 1519 microversion: 2.1 time: 0.161046 Oct 04 22:51:00.806789 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3195/7213] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:51:00 2022] GET /compute/v2.1/servers/810f7a94-01f2-4757-ac15-39a980d9f477 => generated 1519 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:51:01.830069 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-8e97c347-1b12-443a-988d-ea7209fdf88f tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:51:01.830744 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-8e97c347-1b12-443a-988d-ea7209fdf88f tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] [instance: 810f7a94-01f2-4757-ac15-39a980d9f477] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:51:01.834556 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:51:01.840333 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8e97c347-1b12-443a-988d-ea7209fdf88f tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:51:01.840840 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8e97c347-1b12-443a-988d-ea7209fdf88f tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:51:01.841310 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8e97c347-1b12-443a-988d-ea7209fdf88f tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:51:01.842027 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8e97c347-1b12-443a-988d-ea7209fdf88f tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:51:01.842541 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8e97c347-1b12-443a-988d-ea7209fdf88f tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:51:01.843450 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8e97c347-1b12-443a-988d-ea7209fdf88f tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:51:01.976870 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-8e97c347-1b12-443a-988d-ea7209fdf88f tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ebea4a152f4d01864ca878e528642c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec852e304484d27a84980417fffda0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:51:01.984658 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-8e97c347-1b12-443a-988d-ea7209fdf88f tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] 10.222.0.43 "GET /compute/v2.1/servers/810f7a94-01f2-4757-ac15-39a980d9f477" status: 200 len: 1519 microversion: 2.1 time: 0.158574 Oct 04 22:51:01.985241 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4019/7214] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:51:01 2022] GET /compute/v2.1/servers/810f7a94-01f2-4757-ac15-39a980d9f477 => generated 1519 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:51:03.008375 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-2d43facf-a644-4927-afc2-3e42049e2a2f tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:51:03.008902 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-2d43facf-a644-4927-afc2-3e42049e2a2f tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] [instance: 810f7a94-01f2-4757-ac15-39a980d9f477] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:51:03.015674 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2d43facf-a644-4927-afc2-3e42049e2a2f tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:51:03.016157 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2d43facf-a644-4927-afc2-3e42049e2a2f tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:51:03.016600 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2d43facf-a644-4927-afc2-3e42049e2a2f tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:51:03.017292 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2d43facf-a644-4927-afc2-3e42049e2a2f tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:51:03.017746 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2d43facf-a644-4927-afc2-3e42049e2a2f tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:51:03.018176 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2d43facf-a644-4927-afc2-3e42049e2a2f tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:51:03.151413 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-2d43facf-a644-4927-afc2-3e42049e2a2f tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ebea4a152f4d01864ca878e528642c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec852e304484d27a84980417fffda0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:51:03.159123 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-2d43facf-a644-4927-afc2-3e42049e2a2f tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] 10.222.0.43 "GET /compute/v2.1/servers/810f7a94-01f2-4757-ac15-39a980d9f477" status: 200 len: 1519 microversion: 2.1 time: 0.155183 Oct 04 22:51:03.159703 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3196/7215] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:51:03 2022] GET /compute/v2.1/servers/810f7a94-01f2-4757-ac15-39a980d9f477 => generated 1519 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:51:04.183582 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-97378de4-40db-4fd4-b6f3-416c0f5a748b tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:51:04.184215 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-97378de4-40db-4fd4-b6f3-416c0f5a748b tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] [instance: 810f7a94-01f2-4757-ac15-39a980d9f477] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:51:04.191041 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-97378de4-40db-4fd4-b6f3-416c0f5a748b tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:51:04.191539 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-97378de4-40db-4fd4-b6f3-416c0f5a748b tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:51:04.191991 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-97378de4-40db-4fd4-b6f3-416c0f5a748b tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:51:04.192698 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-97378de4-40db-4fd4-b6f3-416c0f5a748b tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:51:04.194020 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-97378de4-40db-4fd4-b6f3-416c0f5a748b tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:51:04.194464 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-97378de4-40db-4fd4-b6f3-416c0f5a748b tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:51:04.328874 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-97378de4-40db-4fd4-b6f3-416c0f5a748b tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ebea4a152f4d01864ca878e528642c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec852e304484d27a84980417fffda0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:51:04.337065 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-97378de4-40db-4fd4-b6f3-416c0f5a748b tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] 10.222.0.43 "GET /compute/v2.1/servers/810f7a94-01f2-4757-ac15-39a980d9f477" status: 200 len: 1519 microversion: 2.1 time: 0.157420 Oct 04 22:51:04.337652 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4020/7216] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:51:04 2022] GET /compute/v2.1/servers/810f7a94-01f2-4757-ac15-39a980d9f477 => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:51:05.360938 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-8a7556df-1971-44c8-90dc-8214f64c1f6b tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:51:05.361561 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-8a7556df-1971-44c8-90dc-8214f64c1f6b tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] [instance: 810f7a94-01f2-4757-ac15-39a980d9f477] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:51:05.369098 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8a7556df-1971-44c8-90dc-8214f64c1f6b tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:51:05.369585 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8a7556df-1971-44c8-90dc-8214f64c1f6b tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:51:05.370027 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8a7556df-1971-44c8-90dc-8214f64c1f6b tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:51:05.370746 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8a7556df-1971-44c8-90dc-8214f64c1f6b tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:51:05.371210 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8a7556df-1971-44c8-90dc-8214f64c1f6b tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:51:05.371668 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8a7556df-1971-44c8-90dc-8214f64c1f6b tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:51:05.503592 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-8a7556df-1971-44c8-90dc-8214f64c1f6b tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ebea4a152f4d01864ca878e528642c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec852e304484d27a84980417fffda0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:51:05.512107 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-8a7556df-1971-44c8-90dc-8214f64c1f6b tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] 10.222.0.43 "GET /compute/v2.1/servers/810f7a94-01f2-4757-ac15-39a980d9f477" status: 200 len: 1519 microversion: 2.1 time: 0.155049 Oct 04 22:51:05.512695 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3197/7217] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:51:05 2022] GET /compute/v2.1/servers/810f7a94-01f2-4757-ac15-39a980d9f477 => generated 1519 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:51:06.535254 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-8aa1ecd1-65f6-4661-b149-3d1e9a576d26 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:51:06.535894 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-8aa1ecd1-65f6-4661-b149-3d1e9a576d26 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] [instance: 810f7a94-01f2-4757-ac15-39a980d9f477] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:51:06.543106 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8aa1ecd1-65f6-4661-b149-3d1e9a576d26 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:51:06.543612 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8aa1ecd1-65f6-4661-b149-3d1e9a576d26 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:51:06.544077 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8aa1ecd1-65f6-4661-b149-3d1e9a576d26 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:51:06.544795 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8aa1ecd1-65f6-4661-b149-3d1e9a576d26 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:51:06.545273 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8aa1ecd1-65f6-4661-b149-3d1e9a576d26 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:51:06.545724 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8aa1ecd1-65f6-4661-b149-3d1e9a576d26 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:51:06.678669 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-8aa1ecd1-65f6-4661-b149-3d1e9a576d26 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ebea4a152f4d01864ca878e528642c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec852e304484d27a84980417fffda0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:51:06.687121 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-8aa1ecd1-65f6-4661-b149-3d1e9a576d26 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] 10.222.0.43 "GET /compute/v2.1/servers/810f7a94-01f2-4757-ac15-39a980d9f477" status: 200 len: 1519 microversion: 2.1 time: 0.155819 Oct 04 22:51:06.687702 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4021/7218] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:51:06 2022] GET /compute/v2.1/servers/810f7a94-01f2-4757-ac15-39a980d9f477 => generated 1519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:51:07.710588 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-26dfe813-7cfb-456a-bf97-a7b26966d8ca tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:51:07.711245 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-26dfe813-7cfb-456a-bf97-a7b26966d8ca tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] [instance: 810f7a94-01f2-4757-ac15-39a980d9f477] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:51:07.718060 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-26dfe813-7cfb-456a-bf97-a7b26966d8ca tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:51:07.718593 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-26dfe813-7cfb-456a-bf97-a7b26966d8ca tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:51:07.719044 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-26dfe813-7cfb-456a-bf97-a7b26966d8ca tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:51:07.719740 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-26dfe813-7cfb-456a-bf97-a7b26966d8ca tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:51:07.720203 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-26dfe813-7cfb-456a-bf97-a7b26966d8ca tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:51:07.720637 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-26dfe813-7cfb-456a-bf97-a7b26966d8ca tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:51:07.848526 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-26dfe813-7cfb-456a-bf97-a7b26966d8ca tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ebea4a152f4d01864ca878e528642c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec852e304484d27a84980417fffda0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:51:07.856383 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-26dfe813-7cfb-456a-bf97-a7b26966d8ca tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] 10.222.0.43 "GET /compute/v2.1/servers/810f7a94-01f2-4757-ac15-39a980d9f477" status: 200 len: 1519 microversion: 2.1 time: 0.150021 Oct 04 22:51:07.856975 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3198/7219] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:51:07 2022] GET /compute/v2.1/servers/810f7a94-01f2-4757-ac15-39a980d9f477 => generated 1519 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:51:08.881284 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-1ca14875-e614-4bd2-b191-660e9843ff49 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:51:08.882451 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-1ca14875-e614-4bd2-b191-660e9843ff49 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] [instance: 810f7a94-01f2-4757-ac15-39a980d9f477] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:51:08.891610 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1ca14875-e614-4bd2-b191-660e9843ff49 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:51:08.892451 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1ca14875-e614-4bd2-b191-660e9843ff49 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:51:08.893230 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1ca14875-e614-4bd2-b191-660e9843ff49 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:51:08.894352 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1ca14875-e614-4bd2-b191-660e9843ff49 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:51:08.894857 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1ca14875-e614-4bd2-b191-660e9843ff49 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:51:08.895516 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1ca14875-e614-4bd2-b191-660e9843ff49 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:51:09.055890 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-1ca14875-e614-4bd2-b191-660e9843ff49 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ebea4a152f4d01864ca878e528642c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec852e304484d27a84980417fffda0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:51:09.063941 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-1ca14875-e614-4bd2-b191-660e9843ff49 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] 10.222.0.43 "GET /compute/v2.1/servers/810f7a94-01f2-4757-ac15-39a980d9f477" status: 200 len: 1519 microversion: 2.1 time: 0.187268 Oct 04 22:51:09.064540 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4022/7220] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:51:08 2022] GET /compute/v2.1/servers/810f7a94-01f2-4757-ac15-39a980d9f477 => generated 1519 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:51:10.088819 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-9a24c00c-4483-4f39-af02-e765a97f26e1 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:51:10.089455 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-9a24c00c-4483-4f39-af02-e765a97f26e1 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] [instance: 810f7a94-01f2-4757-ac15-39a980d9f477] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:51:10.096253 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9a24c00c-4483-4f39-af02-e765a97f26e1 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:51:10.096739 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9a24c00c-4483-4f39-af02-e765a97f26e1 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:51:10.097185 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9a24c00c-4483-4f39-af02-e765a97f26e1 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:51:10.097878 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9a24c00c-4483-4f39-af02-e765a97f26e1 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:51:10.098340 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9a24c00c-4483-4f39-af02-e765a97f26e1 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:51:10.098804 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9a24c00c-4483-4f39-af02-e765a97f26e1 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:51:10.232614 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-9a24c00c-4483-4f39-af02-e765a97f26e1 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ebea4a152f4d01864ca878e528642c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec852e304484d27a84980417fffda0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:51:10.240651 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-9a24c00c-4483-4f39-af02-e765a97f26e1 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] 10.222.0.43 "GET /compute/v2.1/servers/810f7a94-01f2-4757-ac15-39a980d9f477" status: 200 len: 1519 microversion: 2.1 time: 0.155559 Oct 04 22:51:10.241234 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3199/7221] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:51:10 2022] GET /compute/v2.1/servers/810f7a94-01f2-4757-ac15-39a980d9f477 => generated 1519 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:51:11.264266 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-32cbd144-84de-4d51-9a98-959b89897f52 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:51:11.264901 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-32cbd144-84de-4d51-9a98-959b89897f52 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] [instance: 810f7a94-01f2-4757-ac15-39a980d9f477] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:51:11.272365 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-32cbd144-84de-4d51-9a98-959b89897f52 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:51:11.273331 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-32cbd144-84de-4d51-9a98-959b89897f52 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:51:11.273799 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-32cbd144-84de-4d51-9a98-959b89897f52 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:51:11.274581 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-32cbd144-84de-4d51-9a98-959b89897f52 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:51:11.275065 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-32cbd144-84de-4d51-9a98-959b89897f52 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:51:11.275519 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-32cbd144-84de-4d51-9a98-959b89897f52 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:51:11.408855 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-32cbd144-84de-4d51-9a98-959b89897f52 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ebea4a152f4d01864ca878e528642c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec852e304484d27a84980417fffda0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:51:11.417286 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-32cbd144-84de-4d51-9a98-959b89897f52 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] 10.222.0.43 "GET /compute/v2.1/servers/810f7a94-01f2-4757-ac15-39a980d9f477" status: 200 len: 1519 microversion: 2.1 time: 0.156988 Oct 04 22:51:11.417860 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4023/7222] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:51:11 2022] GET /compute/v2.1/servers/810f7a94-01f2-4757-ac15-39a980d9f477 => generated 1519 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:51:12.440327 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-1e6b5e9d-8388-4bde-b8a4-851842890eb6 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:51:12.440860 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-1e6b5e9d-8388-4bde-b8a4-851842890eb6 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] [instance: 810f7a94-01f2-4757-ac15-39a980d9f477] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:51:12.449090 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1e6b5e9d-8388-4bde-b8a4-851842890eb6 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:51:12.449578 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1e6b5e9d-8388-4bde-b8a4-851842890eb6 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:51:12.450022 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1e6b5e9d-8388-4bde-b8a4-851842890eb6 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:51:12.450816 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1e6b5e9d-8388-4bde-b8a4-851842890eb6 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:51:12.451280 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1e6b5e9d-8388-4bde-b8a4-851842890eb6 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:51:12.451715 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1e6b5e9d-8388-4bde-b8a4-851842890eb6 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:51:12.582251 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-1e6b5e9d-8388-4bde-b8a4-851842890eb6 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ebea4a152f4d01864ca878e528642c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec852e304484d27a84980417fffda0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:51:12.590948 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-1e6b5e9d-8388-4bde-b8a4-851842890eb6 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] 10.222.0.43 "GET /compute/v2.1/servers/810f7a94-01f2-4757-ac15-39a980d9f477" status: 200 len: 1519 microversion: 2.1 time: 0.154598 Oct 04 22:51:12.591654 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3200/7223] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:51:12 2022] GET /compute/v2.1/servers/810f7a94-01f2-4757-ac15-39a980d9f477 => generated 1519 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:51:13.614234 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-55085e4f-8dbe-4306-b69d-99e15e8eac67 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:51:13.615037 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-55085e4f-8dbe-4306-b69d-99e15e8eac67 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] [instance: 810f7a94-01f2-4757-ac15-39a980d9f477] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:51:13.622202 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-55085e4f-8dbe-4306-b69d-99e15e8eac67 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:51:13.622726 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-55085e4f-8dbe-4306-b69d-99e15e8eac67 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:51:13.623179 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-55085e4f-8dbe-4306-b69d-99e15e8eac67 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:51:13.624189 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-55085e4f-8dbe-4306-b69d-99e15e8eac67 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:51:13.624656 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-55085e4f-8dbe-4306-b69d-99e15e8eac67 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:51:13.625093 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-55085e4f-8dbe-4306-b69d-99e15e8eac67 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:51:13.762653 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-55085e4f-8dbe-4306-b69d-99e15e8eac67 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ebea4a152f4d01864ca878e528642c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec852e304484d27a84980417fffda0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:51:13.771439 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-55085e4f-8dbe-4306-b69d-99e15e8eac67 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] 10.222.0.43 "GET /compute/v2.1/servers/810f7a94-01f2-4757-ac15-39a980d9f477" status: 200 len: 1519 microversion: 2.1 time: 0.160537 Oct 04 22:51:13.772119 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4024/7224] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:51:13 2022] GET /compute/v2.1/servers/810f7a94-01f2-4757-ac15-39a980d9f477 => generated 1519 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:51:14.795605 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-e36cd2c2-81fd-493a-bb17-c80fc1f9ae8c tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:51:14.796488 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-e36cd2c2-81fd-493a-bb17-c80fc1f9ae8c tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] [instance: 810f7a94-01f2-4757-ac15-39a980d9f477] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:51:14.804014 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e36cd2c2-81fd-493a-bb17-c80fc1f9ae8c tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:51:14.804546 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e36cd2c2-81fd-493a-bb17-c80fc1f9ae8c tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:51:14.804987 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e36cd2c2-81fd-493a-bb17-c80fc1f9ae8c tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:51:14.805687 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e36cd2c2-81fd-493a-bb17-c80fc1f9ae8c tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:51:14.806148 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e36cd2c2-81fd-493a-bb17-c80fc1f9ae8c tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:51:14.806606 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e36cd2c2-81fd-493a-bb17-c80fc1f9ae8c tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:51:14.936728 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-e36cd2c2-81fd-493a-bb17-c80fc1f9ae8c tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ebea4a152f4d01864ca878e528642c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec852e304484d27a84980417fffda0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:51:14.944624 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-e36cd2c2-81fd-493a-bb17-c80fc1f9ae8c tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] 10.222.0.43 "GET /compute/v2.1/servers/810f7a94-01f2-4757-ac15-39a980d9f477" status: 200 len: 1519 microversion: 2.1 time: 0.152996 Oct 04 22:51:14.945228 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3201/7225] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:51:14 2022] GET /compute/v2.1/servers/810f7a94-01f2-4757-ac15-39a980d9f477 => generated 1519 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:51:15.969028 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-a000c0c7-38f9-4ad5-9ad3-144c6deb02e0 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:51:15.970222 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-a000c0c7-38f9-4ad5-9ad3-144c6deb02e0 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] [instance: 810f7a94-01f2-4757-ac15-39a980d9f477] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:51:15.977499 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a000c0c7-38f9-4ad5-9ad3-144c6deb02e0 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:51:15.978018 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a000c0c7-38f9-4ad5-9ad3-144c6deb02e0 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:51:15.978626 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a000c0c7-38f9-4ad5-9ad3-144c6deb02e0 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:51:15.979344 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a000c0c7-38f9-4ad5-9ad3-144c6deb02e0 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:51:15.979816 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a000c0c7-38f9-4ad5-9ad3-144c6deb02e0 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:51:15.980262 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a000c0c7-38f9-4ad5-9ad3-144c6deb02e0 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:51:16.112851 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-a000c0c7-38f9-4ad5-9ad3-144c6deb02e0 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ebea4a152f4d01864ca878e528642c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec852e304484d27a84980417fffda0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:51:16.121290 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-a000c0c7-38f9-4ad5-9ad3-144c6deb02e0 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] 10.222.0.43 "GET /compute/v2.1/servers/810f7a94-01f2-4757-ac15-39a980d9f477" status: 200 len: 1519 microversion: 2.1 time: 0.157754 Oct 04 22:51:16.121876 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4025/7226] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:51:15 2022] GET /compute/v2.1/servers/810f7a94-01f2-4757-ac15-39a980d9f477 => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:51:17.144889 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-1ed5d978-1e47-449c-9f58-753abf34bc82 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:51:17.145513 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-1ed5d978-1e47-449c-9f58-753abf34bc82 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] [instance: 810f7a94-01f2-4757-ac15-39a980d9f477] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:51:17.152366 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1ed5d978-1e47-449c-9f58-753abf34bc82 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:51:17.152853 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1ed5d978-1e47-449c-9f58-753abf34bc82 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:51:17.153299 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1ed5d978-1e47-449c-9f58-753abf34bc82 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:51:17.154083 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1ed5d978-1e47-449c-9f58-753abf34bc82 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:51:17.154653 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1ed5d978-1e47-449c-9f58-753abf34bc82 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:51:17.155092 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1ed5d978-1e47-449c-9f58-753abf34bc82 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:51:17.286347 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-1ed5d978-1e47-449c-9f58-753abf34bc82 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ebea4a152f4d01864ca878e528642c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec852e304484d27a84980417fffda0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:51:17.294708 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-1ed5d978-1e47-449c-9f58-753abf34bc82 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] 10.222.0.43 "GET /compute/v2.1/servers/810f7a94-01f2-4757-ac15-39a980d9f477" status: 200 len: 1519 microversion: 2.1 time: 0.153719 Oct 04 22:51:17.295298 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3202/7227] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:51:17 2022] GET /compute/v2.1/servers/810f7a94-01f2-4757-ac15-39a980d9f477 => generated 1519 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:51:18.153941 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-81d3d2fa-5c74-48f8-915c-d05720f3665b req-1a86721c-8772-42f8-8749-32041bd9512e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "810f7a94-01f2-4757-ac15-39a980d9f477", "name": "network-vif-unplugged", "status": "completed", "tag": "fd60947d-79b6-41d5-8775-0f0aa624d4f1"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:51:18.166092 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-81d3d2fa-5c74-48f8-915c-d05720f3665b req-1a86721c-8772-42f8-8749-32041bd9512e service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:51:18.166635 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-81d3d2fa-5c74-48f8-915c-d05720f3665b req-1a86721c-8772-42f8-8749-32041bd9512e service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:51:18.167154 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-81d3d2fa-5c74-48f8-915c-d05720f3665b req-1a86721c-8772-42f8-8749-32041bd9512e service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:51:18.171313 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:51:18.181402 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-81d3d2fa-5c74-48f8-915c-d05720f3665b req-1a86721c-8772-42f8-8749-32041bd9512e service nova] Creating event network-vif-unplugged:fd60947d-79b6-41d5-8775-0f0aa624d4f1 for instance 810f7a94-01f2-4757-ac15-39a980d9f477 on n-h2-860284-1 Oct 04 22:51:18.187794 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [req-81d3d2fa-5c74-48f8-915c-d05720f3665b req-1a86721c-8772-42f8-8749-32041bd9512e service nova] Instance 810f7a94-01f2-4757-ac15-39a980d9f477 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860284-1', 'n-h2-860284-1'} {{(pid=134101) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 22:51:18.199490 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-81d3d2fa-5c74-48f8-915c-d05720f3665b req-1a86721c-8772-42f8-8749-32041bd9512e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049184 Oct 04 22:51:18.200063 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4026/7228] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:51:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:51:18.318525 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-7177e4a2-3217-4c07-b509-bae4ebdd2298 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:51:18.319149 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-7177e4a2-3217-4c07-b509-bae4ebdd2298 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] [instance: 810f7a94-01f2-4757-ac15-39a980d9f477] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:51:18.325906 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7177e4a2-3217-4c07-b509-bae4ebdd2298 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:51:18.326415 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7177e4a2-3217-4c07-b509-bae4ebdd2298 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:51:18.326855 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7177e4a2-3217-4c07-b509-bae4ebdd2298 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:51:18.327583 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7177e4a2-3217-4c07-b509-bae4ebdd2298 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:51:18.328013 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7177e4a2-3217-4c07-b509-bae4ebdd2298 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:51:18.328440 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7177e4a2-3217-4c07-b509-bae4ebdd2298 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:51:18.793860 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-7177e4a2-3217-4c07-b509-bae4ebdd2298 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ebea4a152f4d01864ca878e528642c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec852e304484d27a84980417fffda0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:51:18.804120 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-7177e4a2-3217-4c07-b509-bae4ebdd2298 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] 10.222.0.43 "GET /compute/v2.1/servers/810f7a94-01f2-4757-ac15-39a980d9f477" status: 200 len: 1518 microversion: 2.1 time: 0.489655 Oct 04 22:51:18.804754 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3203/7229] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:51:18 2022] GET /compute/v2.1/servers/810f7a94-01f2-4757-ac15-39a980d9f477 => generated 1518 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:51:19.829528 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-7ac386d3-ff51-4fbb-b621-b8a89ad7156c tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:51:19.830284 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-7ac386d3-ff51-4fbb-b621-b8a89ad7156c tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] [instance: 810f7a94-01f2-4757-ac15-39a980d9f477] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:51:19.837112 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7ac386d3-ff51-4fbb-b621-b8a89ad7156c tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:51:19.837619 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7ac386d3-ff51-4fbb-b621-b8a89ad7156c tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:51:19.838076 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7ac386d3-ff51-4fbb-b621-b8a89ad7156c tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:51:19.838821 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7ac386d3-ff51-4fbb-b621-b8a89ad7156c tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:51:19.839298 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7ac386d3-ff51-4fbb-b621-b8a89ad7156c tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:51:19.839748 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7ac386d3-ff51-4fbb-b621-b8a89ad7156c tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:51:19.970990 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-7ac386d3-ff51-4fbb-b621-b8a89ad7156c tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ebea4a152f4d01864ca878e528642c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec852e304484d27a84980417fffda0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:51:19.978940 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-7ac386d3-ff51-4fbb-b621-b8a89ad7156c tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] 10.222.0.43 "GET /compute/v2.1/servers/810f7a94-01f2-4757-ac15-39a980d9f477" status: 200 len: 1516 microversion: 2.1 time: 0.154891 Oct 04 22:51:19.979528 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4027/7230] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:51:19 2022] GET /compute/v2.1/servers/810f7a94-01f2-4757-ac15-39a980d9f477 => generated 1516 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:51:20.229888 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-890a9536-6479-4208-90bf-161f0840d7b1 req-9102ac97-bcf8-4411-ad87-927811660284 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "810f7a94-01f2-4757-ac15-39a980d9f477", "tag": "fd60947d-79b6-41d5-8775-0f0aa624d4f1"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:51:20.240641 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-890a9536-6479-4208-90bf-161f0840d7b1 req-9102ac97-bcf8-4411-ad87-927811660284 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:51:20.241117 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-890a9536-6479-4208-90bf-161f0840d7b1 req-9102ac97-bcf8-4411-ad87-927811660284 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:51:20.241550 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-890a9536-6479-4208-90bf-161f0840d7b1 req-9102ac97-bcf8-4411-ad87-927811660284 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:51:20.253292 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-890a9536-6479-4208-90bf-161f0840d7b1 req-9102ac97-bcf8-4411-ad87-927811660284 service nova] Creating event network-changed:fd60947d-79b6-41d5-8775-0f0aa624d4f1 for instance 810f7a94-01f2-4757-ac15-39a980d9f477 on n-h2-860284-1 Oct 04 22:51:20.259098 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [req-890a9536-6479-4208-90bf-161f0840d7b1 req-9102ac97-bcf8-4411-ad87-927811660284 service nova] Instance 810f7a94-01f2-4757-ac15-39a980d9f477 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860284-1', 'n-h2-860284-1'} {{(pid=134102) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 22:51:20.269824 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-890a9536-6479-4208-90bf-161f0840d7b1 req-9102ac97-bcf8-4411-ad87-927811660284 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043715 Oct 04 22:51:20.270442 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3204/7231] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:51:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:51:21.001520 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-5d4706a2-cfc3-490b-94ae-96e58765e233 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:51:21.002069 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-5d4706a2-cfc3-490b-94ae-96e58765e233 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] [instance: 810f7a94-01f2-4757-ac15-39a980d9f477] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:51:21.009050 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5d4706a2-cfc3-490b-94ae-96e58765e233 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:51:21.009547 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5d4706a2-cfc3-490b-94ae-96e58765e233 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:51:21.010002 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5d4706a2-cfc3-490b-94ae-96e58765e233 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:51:21.010727 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5d4706a2-cfc3-490b-94ae-96e58765e233 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:51:21.011193 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5d4706a2-cfc3-490b-94ae-96e58765e233 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:51:21.011634 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5d4706a2-cfc3-490b-94ae-96e58765e233 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:51:21.144701 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-5d4706a2-cfc3-490b-94ae-96e58765e233 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ebea4a152f4d01864ca878e528642c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec852e304484d27a84980417fffda0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:51:21.153250 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-5d4706a2-cfc3-490b-94ae-96e58765e233 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] 10.222.0.43 "GET /compute/v2.1/servers/810f7a94-01f2-4757-ac15-39a980d9f477" status: 200 len: 1516 microversion: 2.1 time: 0.156089 Oct 04 22:51:21.153836 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4028/7232] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:51:20 2022] GET /compute/v2.1/servers/810f7a94-01f2-4757-ac15-39a980d9f477 => generated 1516 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:51:22.178989 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-b4564fbe-afe5-4a7e-8ad5-4640a41498a2 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:51:22.179884 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-b4564fbe-afe5-4a7e-8ad5-4640a41498a2 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] [instance: 810f7a94-01f2-4757-ac15-39a980d9f477] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:51:22.187890 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b4564fbe-afe5-4a7e-8ad5-4640a41498a2 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:51:22.188482 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b4564fbe-afe5-4a7e-8ad5-4640a41498a2 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:51:22.189005 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b4564fbe-afe5-4a7e-8ad5-4640a41498a2 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:51:22.189833 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b4564fbe-afe5-4a7e-8ad5-4640a41498a2 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:51:22.190385 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b4564fbe-afe5-4a7e-8ad5-4640a41498a2 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:51:22.190881 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b4564fbe-afe5-4a7e-8ad5-4640a41498a2 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:51:22.408790 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-b4564fbe-afe5-4a7e-8ad5-4640a41498a2 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ebea4a152f4d01864ca878e528642c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec852e304484d27a84980417fffda0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:51:22.417269 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-b4564fbe-afe5-4a7e-8ad5-4640a41498a2 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] 10.222.0.43 "GET /compute/v2.1/servers/810f7a94-01f2-4757-ac15-39a980d9f477" status: 200 len: 1516 microversion: 2.1 time: 0.243659 Oct 04 22:51:22.417864 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3205/7233] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:51:22 2022] GET /compute/v2.1/servers/810f7a94-01f2-4757-ac15-39a980d9f477 => generated 1516 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:51:23.440755 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-cdeae907-8960-41c0-9adb-ad5e34f0b32f tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:51:23.441392 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-cdeae907-8960-41c0-9adb-ad5e34f0b32f tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] [instance: 810f7a94-01f2-4757-ac15-39a980d9f477] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:51:23.448953 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cdeae907-8960-41c0-9adb-ad5e34f0b32f tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:51:23.449462 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cdeae907-8960-41c0-9adb-ad5e34f0b32f tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:51:23.449922 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cdeae907-8960-41c0-9adb-ad5e34f0b32f tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:51:23.450674 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cdeae907-8960-41c0-9adb-ad5e34f0b32f tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:51:23.451151 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cdeae907-8960-41c0-9adb-ad5e34f0b32f tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:51:23.451598 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cdeae907-8960-41c0-9adb-ad5e34f0b32f tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:51:23.585983 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-cdeae907-8960-41c0-9adb-ad5e34f0b32f tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ebea4a152f4d01864ca878e528642c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec852e304484d27a84980417fffda0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:51:23.593967 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-cdeae907-8960-41c0-9adb-ad5e34f0b32f tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] 10.222.0.43 "GET /compute/v2.1/servers/810f7a94-01f2-4757-ac15-39a980d9f477" status: 200 len: 1513 microversion: 2.1 time: 0.157212 Oct 04 22:51:23.594589 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4029/7234] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:51:23 2022] GET /compute/v2.1/servers/810f7a94-01f2-4757-ac15-39a980d9f477 => generated 1513 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:51:23.616913 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-378d480d-7f06-4c81-a08e-69dce1346d9d tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:51:23.617418 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-378d480d-7f06-4c81-a08e-69dce1346d9d tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] [instance: 810f7a94-01f2-4757-ac15-39a980d9f477] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:51:23.624582 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-378d480d-7f06-4c81-a08e-69dce1346d9d tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:51:23.625070 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-378d480d-7f06-4c81-a08e-69dce1346d9d tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:51:23.625507 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-378d480d-7f06-4c81-a08e-69dce1346d9d tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:51:23.626198 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-378d480d-7f06-4c81-a08e-69dce1346d9d tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:51:23.626684 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-378d480d-7f06-4c81-a08e-69dce1346d9d tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:51:23.627118 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-378d480d-7f06-4c81-a08e-69dce1346d9d tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:51:23.685950 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-378d480d-7f06-4c81-a08e-69dce1346d9d tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] 10.222.0.43 "POST /compute/v2.1/servers/810f7a94-01f2-4757-ac15-39a980d9f477/action" status: 204 len: 0 microversion: 2.1 time: 0.073352 Oct 04 22:51:23.686661 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3206/7235] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 22:51:23 2022] POST /compute/v2.1/servers/810f7a94-01f2-4757-ac15-39a980d9f477/action => generated 0 bytes in 75 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 22:51:23.695721 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e237a4a4-0276-4af4-a07b-bbd914e13c28 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:51:23.696375 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-e237a4a4-0276-4af4-a07b-bbd914e13c28 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] [instance: 810f7a94-01f2-4757-ac15-39a980d9f477] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:51:23.702628 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e237a4a4-0276-4af4-a07b-bbd914e13c28 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:51:23.703246 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e237a4a4-0276-4af4-a07b-bbd914e13c28 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:51:23.703836 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e237a4a4-0276-4af4-a07b-bbd914e13c28 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:51:23.704752 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e237a4a4-0276-4af4-a07b-bbd914e13c28 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:51:23.705243 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e237a4a4-0276-4af4-a07b-bbd914e13c28 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:51:23.705789 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e237a4a4-0276-4af4-a07b-bbd914e13c28 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:51:23.845662 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-e237a4a4-0276-4af4-a07b-bbd914e13c28 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ebea4a152f4d01864ca878e528642c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec852e304484d27a84980417fffda0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:51:23.854539 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-e237a4a4-0276-4af4-a07b-bbd914e13c28 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] 10.222.0.43 "GET /compute/v2.1/servers/810f7a94-01f2-4757-ac15-39a980d9f477" status: 200 len: 1513 microversion: 2.1 time: 0.163501 Oct 04 22:51:23.855126 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4030/7236] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:51:23 2022] GET /compute/v2.1/servers/810f7a94-01f2-4757-ac15-39a980d9f477 => generated 1513 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:51:24.878433 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-c312074f-65de-4d7f-bf29-19e0216ad476 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:51:24.879151 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-c312074f-65de-4d7f-bf29-19e0216ad476 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] [instance: 810f7a94-01f2-4757-ac15-39a980d9f477] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:51:24.887812 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c312074f-65de-4d7f-bf29-19e0216ad476 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:51:24.888310 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c312074f-65de-4d7f-bf29-19e0216ad476 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:51:24.888749 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c312074f-65de-4d7f-bf29-19e0216ad476 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:51:24.889745 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c312074f-65de-4d7f-bf29-19e0216ad476 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:51:24.890087 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c312074f-65de-4d7f-bf29-19e0216ad476 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:51:24.890879 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c312074f-65de-4d7f-bf29-19e0216ad476 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:51:24.968284 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-e9bffc7e-f4cb-4913-9268-4ed79aec0a65 req-2cd3d535-0f49-42d0-b3a0-a156f6e67506 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "810f7a94-01f2-4757-ac15-39a980d9f477", "name": "network-vif-plugged", "status": "completed", "tag": "fd60947d-79b6-41d5-8775-0f0aa624d4f1"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:51:24.988594 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-e9bffc7e-f4cb-4913-9268-4ed79aec0a65 req-2cd3d535-0f49-42d0-b3a0-a156f6e67506 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:51:24.989106 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-e9bffc7e-f4cb-4913-9268-4ed79aec0a65 req-2cd3d535-0f49-42d0-b3a0-a156f6e67506 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:51:24.990101 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-e9bffc7e-f4cb-4913-9268-4ed79aec0a65 req-2cd3d535-0f49-42d0-b3a0-a156f6e67506 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:51:25.005683 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-e9bffc7e-f4cb-4913-9268-4ed79aec0a65 req-2cd3d535-0f49-42d0-b3a0-a156f6e67506 service nova] Creating event network-vif-plugged:fd60947d-79b6-41d5-8775-0f0aa624d4f1 for instance 810f7a94-01f2-4757-ac15-39a980d9f477 on n-h2-860284-1 Oct 04 22:51:25.011876 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-e9bffc7e-f4cb-4913-9268-4ed79aec0a65 req-2cd3d535-0f49-42d0-b3a0-a156f6e67506 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047259 Oct 04 22:51:25.013010 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4031/7237] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:51:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:51:25.062959 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-c312074f-65de-4d7f-bf29-19e0216ad476 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ebea4a152f4d01864ca878e528642c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec852e304484d27a84980417fffda0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:51:25.072221 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-c312074f-65de-4d7f-bf29-19e0216ad476 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] 10.222.0.43 "GET /compute/v2.1/servers/810f7a94-01f2-4757-ac15-39a980d9f477" status: 200 len: 1505 microversion: 2.1 time: 0.198415 Oct 04 22:51:25.072830 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3207/7238] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:51:24 2022] GET /compute/v2.1/servers/810f7a94-01f2-4757-ac15-39a980d9f477 => generated 1505 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:51:25.096008 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-04d065e0-59e3-42b7-ba15-e026f4f98cd2 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:51:25.096749 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-04d065e0-59e3-42b7-ba15-e026f4f98cd2 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] [instance: 810f7a94-01f2-4757-ac15-39a980d9f477] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:51:25.103888 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-04d065e0-59e3-42b7-ba15-e026f4f98cd2 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:51:25.104405 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-04d065e0-59e3-42b7-ba15-e026f4f98cd2 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:51:25.104869 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-04d065e0-59e3-42b7-ba15-e026f4f98cd2 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:51:25.105613 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-04d065e0-59e3-42b7-ba15-e026f4f98cd2 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:51:25.106092 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-04d065e0-59e3-42b7-ba15-e026f4f98cd2 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:51:25.106577 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-04d065e0-59e3-42b7-ba15-e026f4f98cd2 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:51:25.247813 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-04d065e0-59e3-42b7-ba15-e026f4f98cd2 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ebea4a152f4d01864ca878e528642c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec852e304484d27a84980417fffda0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:51:25.256079 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-04d065e0-59e3-42b7-ba15-e026f4f98cd2 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] 10.222.0.43 "GET /compute/v2.1/servers/810f7a94-01f2-4757-ac15-39a980d9f477" status: 200 len: 1505 microversion: 2.1 time: 0.164560 Oct 04 22:51:25.256672 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4032/7239] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:51:25 2022] GET /compute/v2.1/servers/810f7a94-01f2-4757-ac15-39a980d9f477 => generated 1505 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:51:25.278808 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-498b7bee-6eca-4f62-940b-8abeee855547 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:51:25.279542 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-498b7bee-6eca-4f62-940b-8abeee855547 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] [instance: 810f7a94-01f2-4757-ac15-39a980d9f477] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:51:25.285515 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-498b7bee-6eca-4f62-940b-8abeee855547 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:51:25.286006 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-498b7bee-6eca-4f62-940b-8abeee855547 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:51:25.287177 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-498b7bee-6eca-4f62-940b-8abeee855547 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:51:25.287822 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-498b7bee-6eca-4f62-940b-8abeee855547 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:51:25.288292 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-498b7bee-6eca-4f62-940b-8abeee855547 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:51:25.288722 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-498b7bee-6eca-4f62-940b-8abeee855547 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:51:25.430806 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-498b7bee-6eca-4f62-940b-8abeee855547 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ebea4a152f4d01864ca878e528642c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec852e304484d27a84980417fffda0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:51:25.438744 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-498b7bee-6eca-4f62-940b-8abeee855547 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] 10.222.0.43 "GET /compute/v2.1/servers/810f7a94-01f2-4757-ac15-39a980d9f477" status: 200 len: 1505 microversion: 2.1 time: 0.163717 Oct 04 22:51:25.439574 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3208/7240] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:51:25 2022] GET /compute/v2.1/servers/810f7a94-01f2-4757-ac15-39a980d9f477 => generated 1505 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:51:25.461452 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-3a8e9988-e010-443d-afa0-34054d47394d tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:51:25.461976 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-3a8e9988-e010-443d-afa0-34054d47394d tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] [instance: 810f7a94-01f2-4757-ac15-39a980d9f477] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:51:25.468126 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3a8e9988-e010-443d-afa0-34054d47394d tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:51:25.468633 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3a8e9988-e010-443d-afa0-34054d47394d tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:51:25.469092 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3a8e9988-e010-443d-afa0-34054d47394d tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:51:25.469810 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3a8e9988-e010-443d-afa0-34054d47394d tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:51:25.470279 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3a8e9988-e010-443d-afa0-34054d47394d tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:51:25.470967 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3a8e9988-e010-443d-afa0-34054d47394d tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:51:25.497989 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-3a8e9988-e010-443d-afa0-34054d47394d tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] [instance: 810f7a94-01f2-4757-ac15-39a980d9f477] Going to try to terminate instance {{(pid=134101) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 22:51:25.576594 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-3a8e9988-e010-443d-afa0-34054d47394d tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] 10.222.0.43 "DELETE /compute/v2.1/servers/810f7a94-01f2-4757-ac15-39a980d9f477" status: 204 len: 0 microversion: 2.1 time: 0.118845 Oct 04 22:51:25.580864 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4033/7241] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 22:51:25 2022] DELETE /compute/v2.1/servers/810f7a94-01f2-4757-ac15-39a980d9f477 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 22:51:25.592159 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-34756942-56ac-4666-8130-a7738a45cac3 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:51:25.592764 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-34756942-56ac-4666-8130-a7738a45cac3 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] [instance: 810f7a94-01f2-4757-ac15-39a980d9f477] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:51:25.599304 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-34756942-56ac-4666-8130-a7738a45cac3 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:51:25.600463 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-34756942-56ac-4666-8130-a7738a45cac3 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:51:25.600985 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-34756942-56ac-4666-8130-a7738a45cac3 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:51:25.601763 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-34756942-56ac-4666-8130-a7738a45cac3 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:51:25.602295 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-34756942-56ac-4666-8130-a7738a45cac3 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:51:25.602827 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-34756942-56ac-4666-8130-a7738a45cac3 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:51:25.605684 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:51:25.631192 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-34756942-56ac-4666-8130-a7738a45cac3 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] [instance: 810f7a94-01f2-4757-ac15-39a980d9f477] Going to try to terminate instance {{(pid=134102) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 22:51:25.679080 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.compute.api [None req-34756942-56ac-4666-8130-a7738a45cac3 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] [instance: 810f7a94-01f2-4757-ac15-39a980d9f477] Instance is already in deleting state, ignoring this request Oct 04 22:51:25.679857 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-34756942-56ac-4666-8130-a7738a45cac3 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] 10.222.0.43 "DELETE /compute/v2.1/servers/810f7a94-01f2-4757-ac15-39a980d9f477" status: 204 len: 0 microversion: 2.1 time: 0.092132 Oct 04 22:51:25.680438 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3209/7242] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 22:51:25 2022] DELETE /compute/v2.1/servers/810f7a94-01f2-4757-ac15-39a980d9f477 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 22:51:25.689112 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-207c1329-3076-4b4a-a8dc-367aac392cf4 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:51:25.689864 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-207c1329-3076-4b4a-a8dc-367aac392cf4 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] [instance: 810f7a94-01f2-4757-ac15-39a980d9f477] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:51:25.695976 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-207c1329-3076-4b4a-a8dc-367aac392cf4 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:51:25.696477 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-207c1329-3076-4b4a-a8dc-367aac392cf4 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:51:25.696928 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-207c1329-3076-4b4a-a8dc-367aac392cf4 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:51:25.697633 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-207c1329-3076-4b4a-a8dc-367aac392cf4 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:51:25.698098 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-207c1329-3076-4b4a-a8dc-367aac392cf4 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:51:25.698567 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-207c1329-3076-4b4a-a8dc-367aac392cf4 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:51:25.826848 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-207c1329-3076-4b4a-a8dc-367aac392cf4 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ebea4a152f4d01864ca878e528642c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec852e304484d27a84980417fffda0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:51:25.835120 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-207c1329-3076-4b4a-a8dc-367aac392cf4 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] 10.222.0.43 "GET /compute/v2.1/servers/810f7a94-01f2-4757-ac15-39a980d9f477" status: 200 len: 1511 microversion: 2.1 time: 0.150300 Oct 04 22:51:25.835697 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4034/7243] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:51:25 2022] GET /compute/v2.1/servers/810f7a94-01f2-4757-ac15-39a980d9f477 => generated 1511 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:51:26.857824 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-0ff24b12-0ed5-4f43-bfe8-cc2e97ce5c2a tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:51:26.858469 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-0ff24b12-0ed5-4f43-bfe8-cc2e97ce5c2a tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] [instance: 810f7a94-01f2-4757-ac15-39a980d9f477] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:51:26.865788 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0ff24b12-0ed5-4f43-bfe8-cc2e97ce5c2a tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:51:26.866265 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0ff24b12-0ed5-4f43-bfe8-cc2e97ce5c2a tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:51:26.866721 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0ff24b12-0ed5-4f43-bfe8-cc2e97ce5c2a tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:51:26.867403 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0ff24b12-0ed5-4f43-bfe8-cc2e97ce5c2a tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:51:26.867853 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0ff24b12-0ed5-4f43-bfe8-cc2e97ce5c2a tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:51:26.868275 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0ff24b12-0ed5-4f43-bfe8-cc2e97ce5c2a tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:51:27.042913 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-0ff24b12-0ed5-4f43-bfe8-cc2e97ce5c2a tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ebea4a152f4d01864ca878e528642c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec852e304484d27a84980417fffda0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:51:27.050617 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-0ff24b12-0ed5-4f43-bfe8-cc2e97ce5c2a tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] 10.222.0.43 "GET /compute/v2.1/servers/810f7a94-01f2-4757-ac15-39a980d9f477" status: 200 len: 1511 microversion: 2.1 time: 0.196660 Oct 04 22:51:27.051194 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3210/7244] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:51:26 2022] GET /compute/v2.1/servers/810f7a94-01f2-4757-ac15-39a980d9f477 => generated 1511 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:51:27.437548 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-cdc772cf-94b7-4bd6-897f-5c21a0d24869 req-783d261d-25b8-4133-961d-03afc411ea72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "810f7a94-01f2-4757-ac15-39a980d9f477", "name": "network-vif-deleted", "tag": "fd60947d-79b6-41d5-8775-0f0aa624d4f1"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:51:27.452321 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-cdc772cf-94b7-4bd6-897f-5c21a0d24869 req-783d261d-25b8-4133-961d-03afc411ea72 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:51:27.453353 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-cdc772cf-94b7-4bd6-897f-5c21a0d24869 req-783d261d-25b8-4133-961d-03afc411ea72 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:51:27.453808 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-cdc772cf-94b7-4bd6-897f-5c21a0d24869 req-783d261d-25b8-4133-961d-03afc411ea72 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:51:27.468576 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-cdc772cf-94b7-4bd6-897f-5c21a0d24869 req-783d261d-25b8-4133-961d-03afc411ea72 service nova] Creating event network-vif-deleted:fd60947d-79b6-41d5-8775-0f0aa624d4f1 for instance 810f7a94-01f2-4757-ac15-39a980d9f477 on n-h2-860284-1 Oct 04 22:51:27.474822 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-cdc772cf-94b7-4bd6-897f-5c21a0d24869 req-783d261d-25b8-4133-961d-03afc411ea72 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040344 Oct 04 22:51:27.475447 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4035/7245] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:51:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:51:28.074373 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-61708c54-31f2-4d33-8d3a-17544936ee6f tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:51:28.075004 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-61708c54-31f2-4d33-8d3a-17544936ee6f tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] [instance: 810f7a94-01f2-4757-ac15-39a980d9f477] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:51:28.081574 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-61708c54-31f2-4d33-8d3a-17544936ee6f tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:51:28.082053 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-61708c54-31f2-4d33-8d3a-17544936ee6f tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:51:28.082539 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-61708c54-31f2-4d33-8d3a-17544936ee6f tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:51:28.083872 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-61708c54-31f2-4d33-8d3a-17544936ee6f tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:51:28.084324 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-61708c54-31f2-4d33-8d3a-17544936ee6f tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:51:28.084752 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-61708c54-31f2-4d33-8d3a-17544936ee6f tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:51:28.097723 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-61708c54-31f2-4d33-8d3a-17544936ee6f tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] HTTP exception thrown: Instance 810f7a94-01f2-4757-ac15-39a980d9f477 could not be found. Oct 04 22:51:28.100004 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-61708c54-31f2-4d33-8d3a-17544936ee6f tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Request method failure captured: Oct 04 22:51:28.100004 n-d-860284-1 devstack@n-api.service[134102]: request: GET /compute/v2.1/servers/810f7a94-01f2-4757-ac15-39a980d9f477 HTTP/1.1 Oct 04 22:51:28.100004 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 22:51:28.100004 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 22:51:28.100004 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 22:51:28.100004 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 22:51:28.100004 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 22:51:28.100004 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 22:51:28.100004 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 22:51:28.100004 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 22:51:28.100004 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPLiL6ZlDL5rkRMMa_LfJa3eVIOf18nZ8s5Fz6rxWuhkGn8ZogAdXJbWp0sK2Vwu_k3ZC5A0UqKNCcHDPOHYOxrZB7TvBNWPfSo5BbpFuW4KBSJ4jALlbsjkGXQ7jTcOZhdiUt1M3ouaRrrab4PsgY0ml6bFLk_5Eao1IXqPMDFAOkwM Oct 04 22:51:28.100004 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 22:51:28.100004 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 22:51:28.100004 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 22:51:28.100004 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 22:51:28.100004 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 22:51:28.100004 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 22:51:28.100004 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: 8ec852e304484d27a84980417fffda0e Oct 04 22:51:28.100004 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1571831035 Oct 04 22:51:28.100004 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 22:51:28.100004 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 22:51:28.100004 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8ec852e304484d27a84980417fffda0e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_8ec852e304484d27a84980417fffda0e", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8ec852e304484d27a84980417fffda0e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/8ec852e304484d27a84980417fffda0e"}]}] Oct 04 22:51:28.100004 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-ServerDiskConfigTestJSON-1571831035 Oct 04 22:51:28.100004 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: 8ec852e304484d27a84980417fffda0e Oct 04 22:51:28.100004 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1571831035 Oct 04 22:51:28.100004 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-ServerDiskConfigTestJSON-1571831035-project Oct 04 22:51:28.100004 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 22:51:28.100004 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 22:51:28.100004 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: d0ebea4a152f4d01864ca878e528642c Oct 04 22:51:28.100004 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-ServerDiskConfigTestJSON-1571831035-project Oct 04 22:51:28.100004 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 22:51:28.100004 n-d-860284-1 devstack@n-api.service[134102]: exception: Instance 810f7a94-01f2-4757-ac15-39a980d9f477 could not be found. Oct 04 22:51:28.100004 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': '810f7a94-01f2-4757-ac15-39a980d9f477'} Oct 04 22:51:28.100004 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:51:28.100004 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:51:28.100004 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:51:28.100004 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:51:28.100004 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:51:28.100004 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:51:28.100004 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:51:28.100004 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:51:28.100004 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:51:28.100004 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:51:28.100004 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 810f7a94-01f2-4757-ac15-39a980d9f477 could not be found. Oct 04 22:51:28.100004 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:51:28.100004 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:51:28.100004 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:51:28.100004 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:51:28.100004 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:51:28.100004 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:51:28.100004 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:51:28.100004 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:51:28.100004 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:51:28.100004 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:51:28.100004 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:51:28.100004 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:51:28.100004 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:51:28.100004 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:51:28.100004 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:51:28.100004 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:51:28.100004 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 810f7a94-01f2-4757-ac15-39a980d9f477 could not be found. Oct 04 22:51:28.100004 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:51:28.100004 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:51:28.100004 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:51:28.104668 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:51:28.104668 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:51:28.104668 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:51:28.104668 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:51:28.104668 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:51:28.104668 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 810f7a94-01f2-4757-ac15-39a980d9f477 could not be found. Oct 04 22:51:28.104668 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:51:28.104668 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-61708c54-31f2-4d33-8d3a-17544936ee6f tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Returning 404 to user: Instance 810f7a94-01f2-4757-ac15-39a980d9f477 could not be found. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:51:28.104668 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-61708c54-31f2-4d33-8d3a-17544936ee6f tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] 10.222.0.43 "GET /compute/v2.1/servers/810f7a94-01f2-4757-ac15-39a980d9f477" status: 404 len: 111 microversion: 2.1 time: 0.030980 Oct 04 22:51:28.104668 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3211/7246] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:51:28 2022] GET /compute/v2.1/servers/810f7a94-01f2-4757-ac15-39a980d9f477 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:51:28.110630 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-6ce5571b-f6ae-4b84-b908-e302df96c7dc tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Calling method '.version_select at 0x7fbb2e1af040>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:51:28.135195 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-6ce5571b-f6ae-4b84-b908-e302df96c7dc tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1989799812" status: 202 len: 0 microversion: 2.1 time: 0.028392 Oct 04 22:51:28.135503 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4036/7247] 10.222.0.43 () {58 vars in 1221 bytes} [Tue Oct 4 22:51:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1989799812 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 22:51:28.744827 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-045af2ab-ada1-47b3-afdc-92588752fd61 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:51:28.745546 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-045af2ab-ada1-47b3-afdc-92588752fd61 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] [instance: e351bace-1f8c-4b1e-b53b-3d4936a8209d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:51:28.751974 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-045af2ab-ada1-47b3-afdc-92588752fd61 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:51:28.752536 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-045af2ab-ada1-47b3-afdc-92588752fd61 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:51:28.753045 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-045af2ab-ada1-47b3-afdc-92588752fd61 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:51:28.753817 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-045af2ab-ada1-47b3-afdc-92588752fd61 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:51:28.754350 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-045af2ab-ada1-47b3-afdc-92588752fd61 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:51:28.755221 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-045af2ab-ada1-47b3-afdc-92588752fd61 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:51:28.768971 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-045af2ab-ada1-47b3-afdc-92588752fd61 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] HTTP exception thrown: Instance e351bace-1f8c-4b1e-b53b-3d4936a8209d could not be found. Oct 04 22:51:28.771207 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-045af2ab-ada1-47b3-afdc-92588752fd61 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Request method failure captured: Oct 04 22:51:28.771207 n-d-860284-1 devstack@n-api.service[134102]: request: DELETE /compute/v2.1/servers/e351bace-1f8c-4b1e-b53b-3d4936a8209d HTTP/1.1 Oct 04 22:51:28.771207 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 22:51:28.771207 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 22:51:28.771207 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 22:51:28.771207 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 22:51:28.771207 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 22:51:28.771207 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 22:51:28.771207 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 22:51:28.771207 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 22:51:28.771207 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPLiL6ZlDL5rkRMMa_LfJa3eVIOf18nZ8s5Fz6rxWuhkGn8ZogAdXJbWp0sK2Vwu_k3ZC5A0UqKNCcHDPOHYOxrZB7TvBNWPfSo5BbpFuW4KBSJ4jALlbsjkGXQ7jTcOZhdiUt1M3ouaRrrab4PsgY0ml6bFLk_5Eao1IXqPMDFAOkwM Oct 04 22:51:28.771207 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 22:51:28.771207 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 22:51:28.771207 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 22:51:28.771207 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 22:51:28.771207 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 22:51:28.771207 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 22:51:28.771207 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: 8ec852e304484d27a84980417fffda0e Oct 04 22:51:28.771207 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1571831035 Oct 04 22:51:28.771207 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 22:51:28.771207 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 22:51:28.771207 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8ec852e304484d27a84980417fffda0e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_8ec852e304484d27a84980417fffda0e", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8ec852e304484d27a84980417fffda0e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/8ec852e304484d27a84980417fffda0e"}]}] Oct 04 22:51:28.771207 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-ServerDiskConfigTestJSON-1571831035 Oct 04 22:51:28.771207 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: 8ec852e304484d27a84980417fffda0e Oct 04 22:51:28.771207 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1571831035 Oct 04 22:51:28.771207 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-ServerDiskConfigTestJSON-1571831035-project Oct 04 22:51:28.771207 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 22:51:28.771207 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 22:51:28.771207 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: d0ebea4a152f4d01864ca878e528642c Oct 04 22:51:28.771207 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-ServerDiskConfigTestJSON-1571831035-project Oct 04 22:51:28.771207 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 22:51:28.771207 n-d-860284-1 devstack@n-api.service[134102]: exception: Instance e351bace-1f8c-4b1e-b53b-3d4936a8209d could not be found. Oct 04 22:51:28.771207 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': 'e351bace-1f8c-4b1e-b53b-3d4936a8209d'} Oct 04 22:51:28.771207 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:51:28.771207 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:51:28.771207 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:51:28.771207 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:51:28.771207 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:51:28.771207 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:51:28.771207 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:51:28.771207 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:51:28.771207 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:51:28.771207 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:51:28.771207 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e351bace-1f8c-4b1e-b53b-3d4936a8209d could not be found. Oct 04 22:51:28.771207 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:51:28.771207 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:51:28.771207 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:51:28.771207 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:51:28.771207 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:51:28.771207 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:51:28.771207 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:51:28.771207 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:51:28.771207 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:51:28.771207 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:51:28.771207 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 22:51:28.771207 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 22:51:28.771207 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 22:51:28.771207 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 22:51:28.771207 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:51:28.771207 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:51:28.771207 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:51:28.771207 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:51:28.775532 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e351bace-1f8c-4b1e-b53b-3d4936a8209d could not be found. Oct 04 22:51:28.775532 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:51:28.775532 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:51:28.775532 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:51:28.775532 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:51:28.775532 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:51:28.775532 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:51:28.775532 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:51:28.775532 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:51:28.775532 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e351bace-1f8c-4b1e-b53b-3d4936a8209d could not be found. Oct 04 22:51:28.775532 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:51:28.775532 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-045af2ab-ada1-47b3-afdc-92588752fd61 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Returning 404 to user: Instance e351bace-1f8c-4b1e-b53b-3d4936a8209d could not be found. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:51:28.775532 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-045af2ab-ada1-47b3-afdc-92588752fd61 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] 10.222.0.43 "DELETE /compute/v2.1/servers/e351bace-1f8c-4b1e-b53b-3d4936a8209d" status: 404 len: 111 microversion: 2.1 time: 0.031871 Oct 04 22:51:28.775532 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3212/7248] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 22:51:28 2022] DELETE /compute/v2.1/servers/e351bace-1f8c-4b1e-b53b-3d4936a8209d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 22:51:28.781460 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-695e6677-f991-4f23-acdd-7daa5e124a72 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:51:28.782222 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-695e6677-f991-4f23-acdd-7daa5e124a72 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] [instance: e351bace-1f8c-4b1e-b53b-3d4936a8209d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:51:28.790961 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-695e6677-f991-4f23-acdd-7daa5e124a72 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:51:28.791474 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-695e6677-f991-4f23-acdd-7daa5e124a72 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:51:28.791937 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-695e6677-f991-4f23-acdd-7daa5e124a72 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:51:28.792659 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-695e6677-f991-4f23-acdd-7daa5e124a72 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:51:28.793138 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-695e6677-f991-4f23-acdd-7daa5e124a72 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:51:28.793587 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-695e6677-f991-4f23-acdd-7daa5e124a72 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:51:28.810034 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-695e6677-f991-4f23-acdd-7daa5e124a72 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] HTTP exception thrown: Instance e351bace-1f8c-4b1e-b53b-3d4936a8209d could not be found. Oct 04 22:51:28.811754 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-695e6677-f991-4f23-acdd-7daa5e124a72 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Request method failure captured: Oct 04 22:51:28.811754 n-d-860284-1 devstack@n-api.service[134101]: request: GET /compute/v2.1/servers/e351bace-1f8c-4b1e-b53b-3d4936a8209d HTTP/1.1 Oct 04 22:51:28.811754 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 22:51:28.811754 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 22:51:28.811754 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 22:51:28.811754 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 22:51:28.811754 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 22:51:28.811754 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 22:51:28.811754 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 22:51:28.811754 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 22:51:28.811754 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPLiL6ZlDL5rkRMMa_LfJa3eVIOf18nZ8s5Fz6rxWuhkGn8ZogAdXJbWp0sK2Vwu_k3ZC5A0UqKNCcHDPOHYOxrZB7TvBNWPfSo5BbpFuW4KBSJ4jALlbsjkGXQ7jTcOZhdiUt1M3ouaRrrab4PsgY0ml6bFLk_5Eao1IXqPMDFAOkwM Oct 04 22:51:28.811754 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 22:51:28.811754 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 22:51:28.811754 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 22:51:28.811754 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 22:51:28.811754 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 22:51:28.811754 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 22:51:28.811754 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: 8ec852e304484d27a84980417fffda0e Oct 04 22:51:28.811754 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1571831035 Oct 04 22:51:28.811754 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 22:51:28.811754 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 22:51:28.811754 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8ec852e304484d27a84980417fffda0e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_8ec852e304484d27a84980417fffda0e", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8ec852e304484d27a84980417fffda0e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/8ec852e304484d27a84980417fffda0e"}]}] Oct 04 22:51:28.811754 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-ServerDiskConfigTestJSON-1571831035 Oct 04 22:51:28.811754 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: 8ec852e304484d27a84980417fffda0e Oct 04 22:51:28.811754 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1571831035 Oct 04 22:51:28.811754 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-ServerDiskConfigTestJSON-1571831035-project Oct 04 22:51:28.811754 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 22:51:28.811754 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 22:51:28.811754 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: d0ebea4a152f4d01864ca878e528642c Oct 04 22:51:28.811754 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-ServerDiskConfigTestJSON-1571831035-project Oct 04 22:51:28.811754 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 22:51:28.811754 n-d-860284-1 devstack@n-api.service[134101]: exception: Instance e351bace-1f8c-4b1e-b53b-3d4936a8209d could not be found. Oct 04 22:51:28.811754 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': 'e351bace-1f8c-4b1e-b53b-3d4936a8209d'} Oct 04 22:51:28.811754 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:51:28.811754 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:51:28.811754 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:51:28.811754 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:51:28.811754 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:51:28.811754 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:51:28.811754 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:51:28.811754 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:51:28.811754 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:51:28.811754 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:51:28.811754 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e351bace-1f8c-4b1e-b53b-3d4936a8209d could not be found. Oct 04 22:51:28.811754 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:51:28.811754 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:51:28.811754 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:51:28.811754 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:51:28.811754 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:51:28.811754 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:51:28.811754 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:51:28.811754 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:51:28.811754 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:51:28.811754 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:51:28.811754 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:51:28.811754 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:51:28.811754 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:51:28.811754 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:51:28.811754 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:51:28.811754 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:51:28.811754 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e351bace-1f8c-4b1e-b53b-3d4936a8209d could not be found. Oct 04 22:51:28.811754 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:51:28.811754 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:51:28.811754 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:51:28.816244 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:51:28.816244 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:51:28.816244 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:51:28.816244 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:51:28.816244 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:51:28.816244 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e351bace-1f8c-4b1e-b53b-3d4936a8209d could not be found. Oct 04 22:51:28.816244 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:51:28.816244 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-695e6677-f991-4f23-acdd-7daa5e124a72 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] Returning 404 to user: Instance e351bace-1f8c-4b1e-b53b-3d4936a8209d could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:51:28.816244 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-695e6677-f991-4f23-acdd-7daa5e124a72 tempest-ServerDiskConfigTestJSON-1571831035 tempest-ServerDiskConfigTestJSON-1571831035-project] 10.222.0.43 "GET /compute/v2.1/servers/e351bace-1f8c-4b1e-b53b-3d4936a8209d" status: 404 len: 111 microversion: 2.1 time: 0.035664 Oct 04 22:51:28.816244 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4037/7249] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:51:28 2022] GET /compute/v2.1/servers/e351bace-1f8c-4b1e-b53b-3d4936a8209d => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:51:37.510835 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-9ba9b068-264c-4a5c-9f6b-cf94c8616408 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Action: 'create', calling method: .version_select at 0x7fbb2e7e4af0>, body: {"keypair": {"name": "tempest-keypair-524313961", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI+IWqoOBAvzcUII9JHGiWdl9txSnijdszcwCcIiFnVK9BEwdCg4gYiRtBQSiizwWG6dhPm4M3hUS+Un0yR8UHBKFXk9Zh0MxpDYOD3WHivEBrjxwBKu/NCOOuwVrkU8gg=="}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:51:37.516308 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_api:SELECT=36 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:51:37.528829 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-9ba9b068-264c-4a5c-9f6b-cf94c8616408 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Getting quotas for project d2ad9e4338314c269afb0cfcebe03584. Resources: {'key_pairs'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:51:37.534084 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-9ba9b068-264c-4a5c-9f6b-cf94c8616408 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Getting quotas for user aad9d55ccfe74ffb914f02030529523d and project d2ad9e4338314c269afb0cfcebe03584. Resources: {'key_pairs'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:51:37.560841 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-9ba9b068-264c-4a5c-9f6b-cf94c8616408 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.170415 Oct 04 22:51:37.561460 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3213/7250] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Oct 4 22:51:37 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:51:38.871629 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-91ebee91-97a9-45ff-a7ca-5d8e053e3260 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-99710261", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "edb1eff0-ecce-412d-a1f1-316814dcaa93"}], "security_groups": [{"name": "tempest-securitygroup--1626714274"}], "key_name": "tempest-keypair-524313961", "user_data": "}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:51:38.882135 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:51:38.882899 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=59,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:51:38.993704 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.network.neutron [None req-91ebee91-97a9-45ff-a7ca-5d8e053e3260 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] validate_networks() for [('edb1eff0-ecce-412d-a1f1-316814dcaa93', None, None, None, None, None)] {{(pid=134101) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 22:51:39.453905 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-91ebee91-97a9-45ff-a7ca-5d8e053e3260 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Flavor limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 22:51:39.454342 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-91ebee91-97a9-45ff-a7ca-5d8e053e3260 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Image limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 22:51:39.454859 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-91ebee91-97a9-45ff-a7ca-5d8e053e3260 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Flavor pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 22:51:39.455307 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-91ebee91-97a9-45ff-a7ca-5d8e053e3260 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Image pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 22:51:39.455733 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-91ebee91-97a9-45ff-a7ca-5d8e053e3260 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 22:51:39.464867 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-91ebee91-97a9-45ff-a7ca-5d8e053e3260 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:51:39.465441 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-91ebee91-97a9-45ff-a7ca-5d8e053e3260 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:51:39.465908 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-91ebee91-97a9-45ff-a7ca-5d8e053e3260 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:51:39.466721 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-91ebee91-97a9-45ff-a7ca-5d8e053e3260 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:51:39.467200 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-91ebee91-97a9-45ff-a7ca-5d8e053e3260 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:51:39.467647 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-91ebee91-97a9-45ff-a7ca-5d8e053e3260 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:51:39.485531 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-91ebee91-97a9-45ff-a7ca-5d8e053e3260 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Getting quotas for project d2ad9e4338314c269afb0cfcebe03584. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:51:39.491926 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-91ebee91-97a9-45ff-a7ca-5d8e053e3260 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Getting quotas for user aad9d55ccfe74ffb914f02030529523d and project d2ad9e4338314c269afb0cfcebe03584. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:51:39.504515 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-91ebee91-97a9-45ff-a7ca-5d8e053e3260 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Going to run 1 instances... {{(pid=134101) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 22:51:39.508031 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-91ebee91-97a9-45ff-a7ca-5d8e053e3260 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: 8ef4f4cd-170b-4474-ad7d-2e297a1dee54] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='58548514-5dac-426c-81f5-19e3fba33e23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134101) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 22:51:39.556510 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-91ebee91-97a9-45ff-a7ca-5d8e053e3260 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.689436 Oct 04 22:51:39.557525 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4038/7251] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 22:51:38 2022] POST /compute/v2.1/servers => generated 409 bytes in 691 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 22:51:39.566279 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:51:39.572214 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-3f85f388-74db-437a-9172-ec9ae44866db tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:51:39.572940 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-3f85f388-74db-437a-9172-ec9ae44866db tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: 8ef4f4cd-170b-4474-ad7d-2e297a1dee54] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:51:39.645934 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-3f85f388-74db-437a-9172-ec9ae44866db tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad9d55ccfe74ffb914f02030529523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ad9e4338314c269afb0cfcebe03584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:51:39.653855 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-3f85f388-74db-437a-9172-ec9ae44866db tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/8ef4f4cd-170b-4474-ad7d-2e297a1dee54" status: 200 len: 1236 microversion: 2.1 time: 0.089305 Oct 04 22:51:39.654827 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3214/7252] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:51:39 2022] GET /compute/v2.1/servers/8ef4f4cd-170b-4474-ad7d-2e297a1dee54 => generated 1236 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:51:40.681865 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-fcd6130e-e727-4708-bf88-635997ca0ce6 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:51:40.683603 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-fcd6130e-e727-4708-bf88-635997ca0ce6 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: 8ef4f4cd-170b-4474-ad7d-2e297a1dee54] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:51:40.693419 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fcd6130e-e727-4708-bf88-635997ca0ce6 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:51:40.694037 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fcd6130e-e727-4708-bf88-635997ca0ce6 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:51:40.694648 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fcd6130e-e727-4708-bf88-635997ca0ce6 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:51:40.695578 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fcd6130e-e727-4708-bf88-635997ca0ce6 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:51:40.696215 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fcd6130e-e727-4708-bf88-635997ca0ce6 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:51:40.696986 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fcd6130e-e727-4708-bf88-635997ca0ce6 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:51:40.804896 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-fcd6130e-e727-4708-bf88-635997ca0ce6 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad9d55ccfe74ffb914f02030529523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ad9e4338314c269afb0cfcebe03584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:51:40.816608 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-fcd6130e-e727-4708-bf88-635997ca0ce6 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/8ef4f4cd-170b-4474-ad7d-2e297a1dee54" status: 200 len: 1296 microversion: 2.1 time: 0.143546 Oct 04 22:51:40.818282 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4039/7253] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:51:40 2022] GET /compute/v2.1/servers/8ef4f4cd-170b-4474-ad7d-2e297a1dee54 => generated 1296 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:51:41.840478 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-0e4eda86-6b41-4bc3-a413-9feb157747c2 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:51:41.841117 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-0e4eda86-6b41-4bc3-a413-9feb157747c2 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: 8ef4f4cd-170b-4474-ad7d-2e297a1dee54] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:51:41.849972 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0e4eda86-6b41-4bc3-a413-9feb157747c2 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:51:41.850773 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0e4eda86-6b41-4bc3-a413-9feb157747c2 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:51:41.851235 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0e4eda86-6b41-4bc3-a413-9feb157747c2 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:51:41.851962 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0e4eda86-6b41-4bc3-a413-9feb157747c2 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:51:41.852453 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0e4eda86-6b41-4bc3-a413-9feb157747c2 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:51:41.852884 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0e4eda86-6b41-4bc3-a413-9feb157747c2 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:51:42.104992 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-0e4eda86-6b41-4bc3-a413-9feb157747c2 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad9d55ccfe74ffb914f02030529523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ad9e4338314c269afb0cfcebe03584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:51:42.112752 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-0e4eda86-6b41-4bc3-a413-9feb157747c2 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/8ef4f4cd-170b-4474-ad7d-2e297a1dee54" status: 200 len: 1362 microversion: 2.1 time: 0.276271 Oct 04 22:51:42.113332 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3215/7254] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:51:41 2022] GET /compute/v2.1/servers/8ef4f4cd-170b-4474-ad7d-2e297a1dee54 => generated 1362 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:51:42.523985 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-8258a9f3-8685-4797-b9b6-e24846b01e9e req-ae0d2b47-9f19-4d58-acd5-53f1eec4bbf3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ef4f4cd-170b-4474-ad7d-2e297a1dee54", "tag": "f5794086-46e5-4a0c-a1a7-d5c3eac3c3c3"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:51:42.535551 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-8258a9f3-8685-4797-b9b6-e24846b01e9e req-ae0d2b47-9f19-4d58-acd5-53f1eec4bbf3 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:51:42.536068 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-8258a9f3-8685-4797-b9b6-e24846b01e9e req-ae0d2b47-9f19-4d58-acd5-53f1eec4bbf3 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:51:42.536521 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-8258a9f3-8685-4797-b9b6-e24846b01e9e req-ae0d2b47-9f19-4d58-acd5-53f1eec4bbf3 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:51:42.548039 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-8258a9f3-8685-4797-b9b6-e24846b01e9e req-ae0d2b47-9f19-4d58-acd5-53f1eec4bbf3 service nova] Creating event network-changed:f5794086-46e5-4a0c-a1a7-d5c3eac3c3c3 for instance 8ef4f4cd-170b-4474-ad7d-2e297a1dee54 on n-h2-860284-1 Oct 04 22:51:42.553060 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-8258a9f3-8685-4797-b9b6-e24846b01e9e req-ae0d2b47-9f19-4d58-acd5-53f1eec4bbf3 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033750 Oct 04 22:51:42.553975 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4040/7255] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:51:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:51:43.135624 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-41bc8516-058b-42c1-9716-f7498f186d40 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:51:43.136250 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-41bc8516-058b-42c1-9716-f7498f186d40 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: 8ef4f4cd-170b-4474-ad7d-2e297a1dee54] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:51:43.143098 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-41bc8516-058b-42c1-9716-f7498f186d40 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:51:43.143589 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-41bc8516-058b-42c1-9716-f7498f186d40 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:51:43.144033 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-41bc8516-058b-42c1-9716-f7498f186d40 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:51:43.144740 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-41bc8516-058b-42c1-9716-f7498f186d40 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:51:43.145758 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-41bc8516-058b-42c1-9716-f7498f186d40 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:51:43.146548 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-41bc8516-058b-42c1-9716-f7498f186d40 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:51:43.282695 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-41bc8516-058b-42c1-9716-f7498f186d40 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad9d55ccfe74ffb914f02030529523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ad9e4338314c269afb0cfcebe03584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:51:43.290614 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-41bc8516-058b-42c1-9716-f7498f186d40 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/8ef4f4cd-170b-4474-ad7d-2e297a1dee54" status: 200 len: 1362 microversion: 2.1 time: 0.158896 Oct 04 22:51:43.291188 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3216/7256] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:51:43 2022] GET /compute/v2.1/servers/8ef4f4cd-170b-4474-ad7d-2e297a1dee54 => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:51:44.314801 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-c8d75224-a449-43d7-8e12-d341ae90a2a0 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:51:44.315559 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-c8d75224-a449-43d7-8e12-d341ae90a2a0 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: 8ef4f4cd-170b-4474-ad7d-2e297a1dee54] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:51:44.322258 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c8d75224-a449-43d7-8e12-d341ae90a2a0 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:51:44.322795 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c8d75224-a449-43d7-8e12-d341ae90a2a0 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:51:44.323247 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c8d75224-a449-43d7-8e12-d341ae90a2a0 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:51:44.323958 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c8d75224-a449-43d7-8e12-d341ae90a2a0 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:51:44.324435 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c8d75224-a449-43d7-8e12-d341ae90a2a0 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:51:44.324884 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c8d75224-a449-43d7-8e12-d341ae90a2a0 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:51:44.458461 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-c8d75224-a449-43d7-8e12-d341ae90a2a0 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad9d55ccfe74ffb914f02030529523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ad9e4338314c269afb0cfcebe03584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:51:44.466374 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-c8d75224-a449-43d7-8e12-d341ae90a2a0 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/8ef4f4cd-170b-4474-ad7d-2e297a1dee54" status: 200 len: 1362 microversion: 2.1 time: 0.156877 Oct 04 22:51:44.466955 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4041/7257] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:51:44 2022] GET /compute/v2.1/servers/8ef4f4cd-170b-4474-ad7d-2e297a1dee54 => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:51:45.489124 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-6ffa7533-73cf-4feb-b40d-991284171fa8 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:51:45.489954 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-6ffa7533-73cf-4feb-b40d-991284171fa8 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: 8ef4f4cd-170b-4474-ad7d-2e297a1dee54] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:51:45.496990 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6ffa7533-73cf-4feb-b40d-991284171fa8 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:51:45.497474 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6ffa7533-73cf-4feb-b40d-991284171fa8 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:51:45.497913 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6ffa7533-73cf-4feb-b40d-991284171fa8 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:51:45.498881 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6ffa7533-73cf-4feb-b40d-991284171fa8 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:51:45.499342 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6ffa7533-73cf-4feb-b40d-991284171fa8 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:51:45.499802 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6ffa7533-73cf-4feb-b40d-991284171fa8 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:51:45.630674 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-6ffa7533-73cf-4feb-b40d-991284171fa8 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad9d55ccfe74ffb914f02030529523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ad9e4338314c269afb0cfcebe03584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:51:45.638328 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-6ffa7533-73cf-4feb-b40d-991284171fa8 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/8ef4f4cd-170b-4474-ad7d-2e297a1dee54" status: 200 len: 1362 microversion: 2.1 time: 0.153180 Oct 04 22:51:45.638929 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3217/7258] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:51:45 2022] GET /compute/v2.1/servers/8ef4f4cd-170b-4474-ad7d-2e297a1dee54 => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:51:46.661777 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-a8caebc9-7f8d-4bbf-af4f-fa947a6b4c19 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:51:46.662475 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-a8caebc9-7f8d-4bbf-af4f-fa947a6b4c19 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: 8ef4f4cd-170b-4474-ad7d-2e297a1dee54] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:51:46.669301 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a8caebc9-7f8d-4bbf-af4f-fa947a6b4c19 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:51:46.669802 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a8caebc9-7f8d-4bbf-af4f-fa947a6b4c19 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:51:46.670261 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a8caebc9-7f8d-4bbf-af4f-fa947a6b4c19 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:51:46.671034 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a8caebc9-7f8d-4bbf-af4f-fa947a6b4c19 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:51:46.671516 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a8caebc9-7f8d-4bbf-af4f-fa947a6b4c19 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:51:46.671961 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a8caebc9-7f8d-4bbf-af4f-fa947a6b4c19 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:51:46.801649 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-a8caebc9-7f8d-4bbf-af4f-fa947a6b4c19 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad9d55ccfe74ffb914f02030529523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ad9e4338314c269afb0cfcebe03584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:51:46.809378 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-a8caebc9-7f8d-4bbf-af4f-fa947a6b4c19 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/8ef4f4cd-170b-4474-ad7d-2e297a1dee54" status: 200 len: 1362 microversion: 2.1 time: 0.152270 Oct 04 22:51:46.809984 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4042/7259] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:51:46 2022] GET /compute/v2.1/servers/8ef4f4cd-170b-4474-ad7d-2e297a1dee54 => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:51:47.831724 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-3404621b-5976-4e7a-b86a-1e1e111c1d71 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:51:47.832347 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-3404621b-5976-4e7a-b86a-1e1e111c1d71 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: 8ef4f4cd-170b-4474-ad7d-2e297a1dee54] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:51:47.839466 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3404621b-5976-4e7a-b86a-1e1e111c1d71 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:51:47.840094 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3404621b-5976-4e7a-b86a-1e1e111c1d71 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:51:47.840547 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3404621b-5976-4e7a-b86a-1e1e111c1d71 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:51:47.841251 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3404621b-5976-4e7a-b86a-1e1e111c1d71 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:51:47.841708 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3404621b-5976-4e7a-b86a-1e1e111c1d71 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:51:47.842141 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3404621b-5976-4e7a-b86a-1e1e111c1d71 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:51:47.972711 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-3404621b-5976-4e7a-b86a-1e1e111c1d71 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad9d55ccfe74ffb914f02030529523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ad9e4338314c269afb0cfcebe03584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:51:47.981069 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-3404621b-5976-4e7a-b86a-1e1e111c1d71 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/8ef4f4cd-170b-4474-ad7d-2e297a1dee54" status: 200 len: 1362 microversion: 2.1 time: 0.153268 Oct 04 22:51:47.981647 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3218/7260] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:51:47 2022] GET /compute/v2.1/servers/8ef4f4cd-170b-4474-ad7d-2e297a1dee54 => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:51:49.005705 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-4d9e2668-dfa1-4464-8eeb-277fc940553f tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:51:49.006347 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-4d9e2668-dfa1-4464-8eeb-277fc940553f tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: 8ef4f4cd-170b-4474-ad7d-2e297a1dee54] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:51:49.013196 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4d9e2668-dfa1-4464-8eeb-277fc940553f tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:51:49.013707 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4d9e2668-dfa1-4464-8eeb-277fc940553f tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:51:49.014171 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4d9e2668-dfa1-4464-8eeb-277fc940553f tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:51:49.014927 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4d9e2668-dfa1-4464-8eeb-277fc940553f tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:51:49.015413 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4d9e2668-dfa1-4464-8eeb-277fc940553f tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:51:49.015872 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4d9e2668-dfa1-4464-8eeb-277fc940553f tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:51:49.118768 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-2fb21fd2-da32-4854-aae6-c5966762b5b5 req-928506a7-b15b-4dfe-96c0-6eb478d35265 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ef4f4cd-170b-4474-ad7d-2e297a1dee54", "name": "network-vif-plugged", "status": "completed", "tag": "f5794086-46e5-4a0c-a1a7-d5c3eac3c3c3"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:51:49.135014 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-2fb21fd2-da32-4854-aae6-c5966762b5b5 req-928506a7-b15b-4dfe-96c0-6eb478d35265 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:51:49.135112 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-2fb21fd2-da32-4854-aae6-c5966762b5b5 req-928506a7-b15b-4dfe-96c0-6eb478d35265 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:51:49.135703 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-2fb21fd2-da32-4854-aae6-c5966762b5b5 req-928506a7-b15b-4dfe-96c0-6eb478d35265 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:51:49.148308 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-2fb21fd2-da32-4854-aae6-c5966762b5b5 req-928506a7-b15b-4dfe-96c0-6eb478d35265 service nova] Creating event network-vif-plugged:f5794086-46e5-4a0c-a1a7-d5c3eac3c3c3 for instance 8ef4f4cd-170b-4474-ad7d-2e297a1dee54 on n-h2-860284-1 Oct 04 22:51:49.154000 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-2fb21fd2-da32-4854-aae6-c5966762b5b5 req-928506a7-b15b-4dfe-96c0-6eb478d35265 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040479 Oct 04 22:51:49.155202 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3219/7261] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:51:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:51:49.160568 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-4d9e2668-dfa1-4464-8eeb-277fc940553f tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad9d55ccfe74ffb914f02030529523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ad9e4338314c269afb0cfcebe03584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:51:49.169080 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-4d9e2668-dfa1-4464-8eeb-277fc940553f tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/8ef4f4cd-170b-4474-ad7d-2e297a1dee54" status: 200 len: 1362 microversion: 2.1 time: 0.168013 Oct 04 22:51:49.169657 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4043/7262] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:51:48 2022] GET /compute/v2.1/servers/8ef4f4cd-170b-4474-ad7d-2e297a1dee54 => generated 1362 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:51:50.190979 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell0:SELECT=6 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:51:50.196301 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-ab598887-853a-427d-8d97-b83e444ab963 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:51:50.197050 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-ab598887-853a-427d-8d97-b83e444ab963 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: 8ef4f4cd-170b-4474-ad7d-2e297a1dee54] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:51:50.203547 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ab598887-853a-427d-8d97-b83e444ab963 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:51:50.204037 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ab598887-853a-427d-8d97-b83e444ab963 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:51:50.204479 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ab598887-853a-427d-8d97-b83e444ab963 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:51:50.205174 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ab598887-853a-427d-8d97-b83e444ab963 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:51:50.205640 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ab598887-853a-427d-8d97-b83e444ab963 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:51:50.206071 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ab598887-853a-427d-8d97-b83e444ab963 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:51:50.336315 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-ab598887-853a-427d-8d97-b83e444ab963 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad9d55ccfe74ffb914f02030529523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ad9e4338314c269afb0cfcebe03584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:51:50.344030 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-ab598887-853a-427d-8d97-b83e444ab963 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/8ef4f4cd-170b-4474-ad7d-2e297a1dee54" status: 200 len: 1362 microversion: 2.1 time: 0.153992 Oct 04 22:51:50.344648 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3220/7263] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:51:50 2022] GET /compute/v2.1/servers/8ef4f4cd-170b-4474-ad7d-2e297a1dee54 => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:51:51.368183 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-38ea4a49-833b-4ad1-879c-129315399bd3 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:51:51.368821 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-38ea4a49-833b-4ad1-879c-129315399bd3 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: 8ef4f4cd-170b-4474-ad7d-2e297a1dee54] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:51:51.370851 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=2 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:51:51.371613 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=6 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:51:51.379142 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-38ea4a49-833b-4ad1-879c-129315399bd3 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:51:51.379787 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-38ea4a49-833b-4ad1-879c-129315399bd3 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:51:51.380257 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-38ea4a49-833b-4ad1-879c-129315399bd3 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:51:51.380976 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-38ea4a49-833b-4ad1-879c-129315399bd3 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:51:51.381456 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-38ea4a49-833b-4ad1-879c-129315399bd3 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:51:51.381907 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-38ea4a49-833b-4ad1-879c-129315399bd3 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:51:51.517595 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-38ea4a49-833b-4ad1-879c-129315399bd3 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad9d55ccfe74ffb914f02030529523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ad9e4338314c269afb0cfcebe03584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:51:51.526007 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-38ea4a49-833b-4ad1-879c-129315399bd3 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/8ef4f4cd-170b-4474-ad7d-2e297a1dee54" status: 200 len: 1546 microversion: 2.1 time: 0.161954 Oct 04 22:51:51.526619 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4044/7264] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:51:51 2022] GET /compute/v2.1/servers/8ef4f4cd-170b-4474-ad7d-2e297a1dee54 => generated 1546 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:51:51.548230 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-04d0b2c0-0e92-41a1-a19f-4b36886a1b55 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:51:51.548719 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-04d0b2c0-0e92-41a1-a19f-4b36886a1b55 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: 8ef4f4cd-170b-4474-ad7d-2e297a1dee54] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:51:51.555433 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-04d0b2c0-0e92-41a1-a19f-4b36886a1b55 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:51:51.555918 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-04d0b2c0-0e92-41a1-a19f-4b36886a1b55 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:51:51.556358 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-04d0b2c0-0e92-41a1-a19f-4b36886a1b55 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:51:51.557049 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-04d0b2c0-0e92-41a1-a19f-4b36886a1b55 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:51:51.557506 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-04d0b2c0-0e92-41a1-a19f-4b36886a1b55 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:51:51.557936 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-04d0b2c0-0e92-41a1-a19f-4b36886a1b55 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:51:51.637789 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-04d0b2c0-0e92-41a1-a19f-4b36886a1b55 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/8ef4f4cd-170b-4474-ad7d-2e297a1dee54/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093344 Oct 04 22:51:51.638434 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3221/7265] 10.222.0.43 () {58 vars in 1275 bytes} [Tue Oct 4 22:51:51 2022] GET /compute/v2.1/servers/8ef4f4cd-170b-4474-ad7d-2e297a1dee54/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:51:52.585584 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-6bee31a6-f278-4909-9b31-51f5fbaa5f91 req-c0fe4aa4-4818-43e7-80b3-3bcb321d1f22 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ef4f4cd-170b-4474-ad7d-2e297a1dee54", "tag": "f5794086-46e5-4a0c-a1a7-d5c3eac3c3c3"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:51:52.596002 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-6bee31a6-f278-4909-9b31-51f5fbaa5f91 req-c0fe4aa4-4818-43e7-80b3-3bcb321d1f22 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:51:52.596503 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-6bee31a6-f278-4909-9b31-51f5fbaa5f91 req-c0fe4aa4-4818-43e7-80b3-3bcb321d1f22 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:51:52.596962 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-6bee31a6-f278-4909-9b31-51f5fbaa5f91 req-c0fe4aa4-4818-43e7-80b3-3bcb321d1f22 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:51:52.608449 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-6bee31a6-f278-4909-9b31-51f5fbaa5f91 req-c0fe4aa4-4818-43e7-80b3-3bcb321d1f22 service nova] Creating event network-changed:f5794086-46e5-4a0c-a1a7-d5c3eac3c3c3 for instance 8ef4f4cd-170b-4474-ad7d-2e297a1dee54 on n-h2-860284-1 Oct 04 22:51:52.613535 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-6bee31a6-f278-4909-9b31-51f5fbaa5f91 req-c0fe4aa4-4818-43e7-80b3-3bcb321d1f22 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032185 Oct 04 22:51:52.614723 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4045/7266] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:51:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:52:57.159621 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=1 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:52:57.160934 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=36 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:52:57.167126 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-794ed647-e15f-4fcc-a764-8477764568db tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:52:57.167657 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-794ed647-e15f-4fcc-a764-8477764568db tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: 8ef4f4cd-170b-4474-ad7d-2e297a1dee54] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:52:57.174984 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-794ed647-e15f-4fcc-a764-8477764568db tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:52:57.175461 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-794ed647-e15f-4fcc-a764-8477764568db tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:52:57.175891 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-794ed647-e15f-4fcc-a764-8477764568db tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:52:57.176569 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-794ed647-e15f-4fcc-a764-8477764568db tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:52:57.177020 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-794ed647-e15f-4fcc-a764-8477764568db tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:52:57.177441 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-794ed647-e15f-4fcc-a764-8477764568db tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:52:57.385229 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-794ed647-e15f-4fcc-a764-8477764568db tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad9d55ccfe74ffb914f02030529523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ad9e4338314c269afb0cfcebe03584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:52:57.392946 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-794ed647-e15f-4fcc-a764-8477764568db tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/8ef4f4cd-170b-4474-ad7d-2e297a1dee54" status: 200 len: 1665 microversion: 2.1 time: 0.235892 Oct 04 22:52:57.393527 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3222/7267] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:52:57 2022] GET /compute/v2.1/servers/8ef4f4cd-170b-4474-ad7d-2e297a1dee54 => generated 1665 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:52:57.414296 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:52:57.415087 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=36 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:52:57.420673 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-f65d0511-6b42-4bfb-a47a-6475c5605b41 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:52:57.421399 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-f65d0511-6b42-4bfb-a47a-6475c5605b41 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: 8ef4f4cd-170b-4474-ad7d-2e297a1dee54] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:52:57.428940 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f65d0511-6b42-4bfb-a47a-6475c5605b41 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:52:57.429447 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f65d0511-6b42-4bfb-a47a-6475c5605b41 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:52:57.429905 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f65d0511-6b42-4bfb-a47a-6475c5605b41 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:52:57.430651 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f65d0511-6b42-4bfb-a47a-6475c5605b41 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:52:57.431129 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f65d0511-6b42-4bfb-a47a-6475c5605b41 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:52:57.431576 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f65d0511-6b42-4bfb-a47a-6475c5605b41 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:52:57.615055 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-f65d0511-6b42-4bfb-a47a-6475c5605b41 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad9d55ccfe74ffb914f02030529523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ad9e4338314c269afb0cfcebe03584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:52:57.622959 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-f65d0511-6b42-4bfb-a47a-6475c5605b41 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/8ef4f4cd-170b-4474-ad7d-2e297a1dee54" status: 200 len: 1665 microversion: 2.1 time: 0.211304 Oct 04 22:52:57.623793 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4046/7268] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:52:57 2022] GET /compute/v2.1/servers/8ef4f4cd-170b-4474-ad7d-2e297a1dee54 => generated 1665 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:52:57.645431 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-1dab1cf6-c6ba-4b7f-bb65-87a9ba40aa83 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:52:57.646020 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-1dab1cf6-c6ba-4b7f-bb65-87a9ba40aa83 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: 8ef4f4cd-170b-4474-ad7d-2e297a1dee54] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:52:57.652623 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1dab1cf6-c6ba-4b7f-bb65-87a9ba40aa83 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:52:57.653109 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1dab1cf6-c6ba-4b7f-bb65-87a9ba40aa83 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:52:57.653552 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1dab1cf6-c6ba-4b7f-bb65-87a9ba40aa83 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:52:57.654246 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1dab1cf6-c6ba-4b7f-bb65-87a9ba40aa83 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:52:57.654742 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1dab1cf6-c6ba-4b7f-bb65-87a9ba40aa83 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:52:57.655174 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1dab1cf6-c6ba-4b7f-bb65-87a9ba40aa83 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:52:57.785705 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-1dab1cf6-c6ba-4b7f-bb65-87a9ba40aa83 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad9d55ccfe74ffb914f02030529523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ad9e4338314c269afb0cfcebe03584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:52:57.793487 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-1dab1cf6-c6ba-4b7f-bb65-87a9ba40aa83 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/8ef4f4cd-170b-4474-ad7d-2e297a1dee54" status: 200 len: 1665 microversion: 2.1 time: 0.152062 Oct 04 22:52:57.794086 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3223/7269] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:52:57 2022] GET /compute/v2.1/servers/8ef4f4cd-170b-4474-ad7d-2e297a1dee54 => generated 1665 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:52:57.815604 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-b645b82b-a267-4d9c-b592-78a4645e7a81 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:52:57.817891 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-b645b82b-a267-4d9c-b592-78a4645e7a81 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: 8ef4f4cd-170b-4474-ad7d-2e297a1dee54] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:52:57.824580 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b645b82b-a267-4d9c-b592-78a4645e7a81 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:52:57.825085 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b645b82b-a267-4d9c-b592-78a4645e7a81 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:52:57.825544 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b645b82b-a267-4d9c-b592-78a4645e7a81 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:52:57.826261 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b645b82b-a267-4d9c-b592-78a4645e7a81 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:52:57.826768 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b645b82b-a267-4d9c-b592-78a4645e7a81 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:52:57.827222 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b645b82b-a267-4d9c-b592-78a4645e7a81 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:52:57.855495 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-b645b82b-a267-4d9c-b592-78a4645e7a81 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'aad9d55ccfe74ffb914f02030529523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ad9e4338314c269afb0cfcebe03584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:52:57.860962 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-b645b82b-a267-4d9c-b592-78a4645e7a81 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: 8ef4f4cd-170b-4474-ad7d-2e297a1dee54] Old instance type m1.heat2, new instance type m1.heat {{(pid=134101) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 04 22:52:57.867592 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-b645b82b-a267-4d9c-b592-78a4645e7a81 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Flavor limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 22:52:57.868037 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-b645b82b-a267-4d9c-b592-78a4645e7a81 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Image limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 22:52:57.868534 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-b645b82b-a267-4d9c-b592-78a4645e7a81 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Flavor pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 22:52:57.868970 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-b645b82b-a267-4d9c-b592-78a4645e7a81 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Image pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 22:52:57.869513 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-b645b82b-a267-4d9c-b592-78a4645e7a81 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 22:52:57.934732 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-b645b82b-a267-4d9c-b592-78a4645e7a81 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "POST /compute/v2.1/servers/8ef4f4cd-170b-4474-ad7d-2e297a1dee54/action" status: 202 len: 0 microversion: 2.1 time: 0.122959 Oct 04 22:52:57.935611 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4047/7270] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 22:52:57 2022] POST /compute/v2.1/servers/8ef4f4cd-170b-4474-ad7d-2e297a1dee54/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 22:52:57.943950 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-5f04cf0f-31fb-4ec3-b76b-b2e1c13443f9 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:52:57.944584 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-5f04cf0f-31fb-4ec3-b76b-b2e1c13443f9 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: 8ef4f4cd-170b-4474-ad7d-2e297a1dee54] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:52:57.952151 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5f04cf0f-31fb-4ec3-b76b-b2e1c13443f9 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:52:57.952151 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5f04cf0f-31fb-4ec3-b76b-b2e1c13443f9 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:52:57.952350 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5f04cf0f-31fb-4ec3-b76b-b2e1c13443f9 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:52:57.952999 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5f04cf0f-31fb-4ec3-b76b-b2e1c13443f9 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:52:57.953407 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5f04cf0f-31fb-4ec3-b76b-b2e1c13443f9 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:52:57.953828 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5f04cf0f-31fb-4ec3-b76b-b2e1c13443f9 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:52:58.092809 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-5f04cf0f-31fb-4ec3-b76b-b2e1c13443f9 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad9d55ccfe74ffb914f02030529523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ad9e4338314c269afb0cfcebe03584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:52:58.100835 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-5f04cf0f-31fb-4ec3-b76b-b2e1c13443f9 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/8ef4f4cd-170b-4474-ad7d-2e297a1dee54" status: 200 len: 1674 microversion: 2.1 time: 0.160806 Oct 04 22:52:58.101437 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3224/7271] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:52:57 2022] GET /compute/v2.1/servers/8ef4f4cd-170b-4474-ad7d-2e297a1dee54 => generated 1674 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:52:59.126546 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-55ea4a06-b5ea-4092-9c28-ba7b212864e6 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:52:59.127186 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-55ea4a06-b5ea-4092-9c28-ba7b212864e6 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: 8ef4f4cd-170b-4474-ad7d-2e297a1dee54] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:52:59.134846 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-55ea4a06-b5ea-4092-9c28-ba7b212864e6 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:52:59.134846 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-55ea4a06-b5ea-4092-9c28-ba7b212864e6 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:52:59.136173 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-55ea4a06-b5ea-4092-9c28-ba7b212864e6 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:52:59.137068 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-55ea4a06-b5ea-4092-9c28-ba7b212864e6 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:52:59.137550 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-55ea4a06-b5ea-4092-9c28-ba7b212864e6 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:52:59.138003 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-55ea4a06-b5ea-4092-9c28-ba7b212864e6 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:52:59.271827 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-55ea4a06-b5ea-4092-9c28-ba7b212864e6 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad9d55ccfe74ffb914f02030529523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ad9e4338314c269afb0cfcebe03584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:52:59.280282 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-55ea4a06-b5ea-4092-9c28-ba7b212864e6 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/8ef4f4cd-170b-4474-ad7d-2e297a1dee54" status: 200 len: 1674 microversion: 2.1 time: 0.158798 Oct 04 22:52:59.281045 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4048/7272] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:52:59 2022] GET /compute/v2.1/servers/8ef4f4cd-170b-4474-ad7d-2e297a1dee54 => generated 1674 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:53:00.303209 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-262b05a0-943c-4c0e-8e7c-1f28f601e027 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:53:00.303828 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-262b05a0-943c-4c0e-8e7c-1f28f601e027 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: 8ef4f4cd-170b-4474-ad7d-2e297a1dee54] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:53:00.310855 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-262b05a0-943c-4c0e-8e7c-1f28f601e027 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:53:00.311344 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-262b05a0-943c-4c0e-8e7c-1f28f601e027 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:53:00.311788 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-262b05a0-943c-4c0e-8e7c-1f28f601e027 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:53:00.312510 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-262b05a0-943c-4c0e-8e7c-1f28f601e027 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:53:00.312973 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-262b05a0-943c-4c0e-8e7c-1f28f601e027 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:53:00.313403 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-262b05a0-943c-4c0e-8e7c-1f28f601e027 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:53:00.443521 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-262b05a0-943c-4c0e-8e7c-1f28f601e027 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad9d55ccfe74ffb914f02030529523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ad9e4338314c269afb0cfcebe03584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:53:00.452084 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-262b05a0-943c-4c0e-8e7c-1f28f601e027 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/8ef4f4cd-170b-4474-ad7d-2e297a1dee54" status: 200 len: 1679 microversion: 2.1 time: 0.152606 Oct 04 22:53:00.453014 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3225/7273] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:53:00 2022] GET /compute/v2.1/servers/8ef4f4cd-170b-4474-ad7d-2e297a1dee54 => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:53:01.477141 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-0dc1af03-a4b3-4897-acd5-d88f6123842f tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:53:01.477730 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-0dc1af03-a4b3-4897-acd5-d88f6123842f tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: 8ef4f4cd-170b-4474-ad7d-2e297a1dee54] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:53:01.485346 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0dc1af03-a4b3-4897-acd5-d88f6123842f tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:53:01.485856 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0dc1af03-a4b3-4897-acd5-d88f6123842f tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:53:01.486318 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0dc1af03-a4b3-4897-acd5-d88f6123842f tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:53:01.487063 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0dc1af03-a4b3-4897-acd5-d88f6123842f tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:53:01.487580 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0dc1af03-a4b3-4897-acd5-d88f6123842f tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:53:01.488033 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0dc1af03-a4b3-4897-acd5-d88f6123842f tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:53:01.619193 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-0dc1af03-a4b3-4897-acd5-d88f6123842f tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad9d55ccfe74ffb914f02030529523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ad9e4338314c269afb0cfcebe03584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:53:01.628063 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-0dc1af03-a4b3-4897-acd5-d88f6123842f tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/8ef4f4cd-170b-4474-ad7d-2e297a1dee54" status: 200 len: 1679 microversion: 2.1 time: 0.154965 Oct 04 22:53:01.628646 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4049/7274] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:53:01 2022] GET /compute/v2.1/servers/8ef4f4cd-170b-4474-ad7d-2e297a1dee54 => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:53:02.651542 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-579a9da2-dab5-45dd-997d-351a82d484f6 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:53:02.652204 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-579a9da2-dab5-45dd-997d-351a82d484f6 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: 8ef4f4cd-170b-4474-ad7d-2e297a1dee54] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:53:02.659081 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-579a9da2-dab5-45dd-997d-351a82d484f6 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:53:02.659574 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-579a9da2-dab5-45dd-997d-351a82d484f6 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:53:02.660017 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-579a9da2-dab5-45dd-997d-351a82d484f6 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:53:02.660721 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-579a9da2-dab5-45dd-997d-351a82d484f6 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:53:02.661180 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-579a9da2-dab5-45dd-997d-351a82d484f6 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:53:02.661612 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-579a9da2-dab5-45dd-997d-351a82d484f6 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:53:02.797290 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-579a9da2-dab5-45dd-997d-351a82d484f6 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad9d55ccfe74ffb914f02030529523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ad9e4338314c269afb0cfcebe03584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:53:02.805029 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-579a9da2-dab5-45dd-997d-351a82d484f6 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/8ef4f4cd-170b-4474-ad7d-2e297a1dee54" status: 200 len: 1679 microversion: 2.1 time: 0.157415 Oct 04 22:53:02.805616 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3226/7275] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:53:02 2022] GET /compute/v2.1/servers/8ef4f4cd-170b-4474-ad7d-2e297a1dee54 => generated 1679 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:53:03.829639 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-30bc1aa9-5e0e-490b-b784-92aef4fdb11c tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:53:03.830273 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-30bc1aa9-5e0e-490b-b784-92aef4fdb11c tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: 8ef4f4cd-170b-4474-ad7d-2e297a1dee54] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:53:03.837413 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-30bc1aa9-5e0e-490b-b784-92aef4fdb11c tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:53:03.837922 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-30bc1aa9-5e0e-490b-b784-92aef4fdb11c tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:53:03.839032 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-30bc1aa9-5e0e-490b-b784-92aef4fdb11c tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:53:03.839752 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-30bc1aa9-5e0e-490b-b784-92aef4fdb11c tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:53:03.840256 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-30bc1aa9-5e0e-490b-b784-92aef4fdb11c tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:53:03.840698 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-30bc1aa9-5e0e-490b-b784-92aef4fdb11c tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:53:03.973758 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-30bc1aa9-5e0e-490b-b784-92aef4fdb11c tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad9d55ccfe74ffb914f02030529523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ad9e4338314c269afb0cfcebe03584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:53:03.981744 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-30bc1aa9-5e0e-490b-b784-92aef4fdb11c tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/8ef4f4cd-170b-4474-ad7d-2e297a1dee54" status: 200 len: 1679 microversion: 2.1 time: 0.156068 Oct 04 22:53:03.982323 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4050/7276] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:53:03 2022] GET /compute/v2.1/servers/8ef4f4cd-170b-4474-ad7d-2e297a1dee54 => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:53:05.005202 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-7142c5d8-4366-4808-9633-3373fe4f95da tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:53:05.005740 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-7142c5d8-4366-4808-9633-3373fe4f95da tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: 8ef4f4cd-170b-4474-ad7d-2e297a1dee54] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:53:05.013742 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7142c5d8-4366-4808-9633-3373fe4f95da tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:53:05.014231 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7142c5d8-4366-4808-9633-3373fe4f95da tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:53:05.014701 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7142c5d8-4366-4808-9633-3373fe4f95da tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:53:05.015402 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7142c5d8-4366-4808-9633-3373fe4f95da tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:53:05.015859 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7142c5d8-4366-4808-9633-3373fe4f95da tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:53:05.016295 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7142c5d8-4366-4808-9633-3373fe4f95da tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:53:05.144399 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-7142c5d8-4366-4808-9633-3373fe4f95da tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad9d55ccfe74ffb914f02030529523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ad9e4338314c269afb0cfcebe03584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:53:05.152334 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-7142c5d8-4366-4808-9633-3373fe4f95da tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/8ef4f4cd-170b-4474-ad7d-2e297a1dee54" status: 200 len: 1679 microversion: 2.1 time: 0.151175 Oct 04 22:53:05.152911 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3227/7277] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:53:05 2022] GET /compute/v2.1/servers/8ef4f4cd-170b-4474-ad7d-2e297a1dee54 => generated 1679 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:53:06.175193 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-7ab71d1b-ea76-4e32-9631-d6896b4b1aad tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:53:06.175830 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-7ab71d1b-ea76-4e32-9631-d6896b4b1aad tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: 8ef4f4cd-170b-4474-ad7d-2e297a1dee54] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:53:06.183053 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7ab71d1b-ea76-4e32-9631-d6896b4b1aad tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:53:06.183561 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7ab71d1b-ea76-4e32-9631-d6896b4b1aad tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:53:06.184023 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7ab71d1b-ea76-4e32-9631-d6896b4b1aad tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:53:06.184743 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7ab71d1b-ea76-4e32-9631-d6896b4b1aad tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:53:06.185218 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7ab71d1b-ea76-4e32-9631-d6896b4b1aad tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:53:06.185668 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7ab71d1b-ea76-4e32-9631-d6896b4b1aad tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:53:06.319924 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-7ab71d1b-ea76-4e32-9631-d6896b4b1aad tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad9d55ccfe74ffb914f02030529523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ad9e4338314c269afb0cfcebe03584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:53:06.328729 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-7ab71d1b-ea76-4e32-9631-d6896b4b1aad tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/8ef4f4cd-170b-4474-ad7d-2e297a1dee54" status: 200 len: 1679 microversion: 2.1 time: 0.157576 Oct 04 22:53:06.329314 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4051/7278] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:53:06 2022] GET /compute/v2.1/servers/8ef4f4cd-170b-4474-ad7d-2e297a1dee54 => generated 1679 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:53:07.352191 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-65497cbf-692a-4585-bd2b-747bcf1ddc7f tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:53:07.352816 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-65497cbf-692a-4585-bd2b-747bcf1ddc7f tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: 8ef4f4cd-170b-4474-ad7d-2e297a1dee54] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:53:07.360149 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-65497cbf-692a-4585-bd2b-747bcf1ddc7f tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:53:07.360641 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-65497cbf-692a-4585-bd2b-747bcf1ddc7f tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:53:07.361081 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-65497cbf-692a-4585-bd2b-747bcf1ddc7f tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:53:07.361778 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-65497cbf-692a-4585-bd2b-747bcf1ddc7f tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:53:07.362238 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-65497cbf-692a-4585-bd2b-747bcf1ddc7f tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:53:07.362760 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-65497cbf-692a-4585-bd2b-747bcf1ddc7f tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:53:07.498895 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-65497cbf-692a-4585-bd2b-747bcf1ddc7f tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad9d55ccfe74ffb914f02030529523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ad9e4338314c269afb0cfcebe03584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:53:07.506650 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-65497cbf-692a-4585-bd2b-747bcf1ddc7f tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/8ef4f4cd-170b-4474-ad7d-2e297a1dee54" status: 200 len: 1679 microversion: 2.1 time: 0.158354 Oct 04 22:53:07.507240 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3228/7279] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:53:07 2022] GET /compute/v2.1/servers/8ef4f4cd-170b-4474-ad7d-2e297a1dee54 => generated 1679 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:53:08.529625 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-f0c5040b-3ad1-426d-a1b2-6889e51526b1 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:53:08.530281 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-f0c5040b-3ad1-426d-a1b2-6889e51526b1 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: 8ef4f4cd-170b-4474-ad7d-2e297a1dee54] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:53:08.537270 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f0c5040b-3ad1-426d-a1b2-6889e51526b1 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:53:08.537770 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f0c5040b-3ad1-426d-a1b2-6889e51526b1 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:53:08.538220 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f0c5040b-3ad1-426d-a1b2-6889e51526b1 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:53:08.538950 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f0c5040b-3ad1-426d-a1b2-6889e51526b1 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:53:08.539429 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f0c5040b-3ad1-426d-a1b2-6889e51526b1 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:53:08.539870 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f0c5040b-3ad1-426d-a1b2-6889e51526b1 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:53:08.671788 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-f0c5040b-3ad1-426d-a1b2-6889e51526b1 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad9d55ccfe74ffb914f02030529523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ad9e4338314c269afb0cfcebe03584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:53:08.679858 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-f0c5040b-3ad1-426d-a1b2-6889e51526b1 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/8ef4f4cd-170b-4474-ad7d-2e297a1dee54" status: 200 len: 1679 microversion: 2.1 time: 0.154706 Oct 04 22:53:08.680444 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4052/7280] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:53:08 2022] GET /compute/v2.1/servers/8ef4f4cd-170b-4474-ad7d-2e297a1dee54 => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:53:09.704342 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-faa03756-e0fa-4d38-9224-e1348e336fe8 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:53:09.704959 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-faa03756-e0fa-4d38-9224-e1348e336fe8 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: 8ef4f4cd-170b-4474-ad7d-2e297a1dee54] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:53:09.712048 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-faa03756-e0fa-4d38-9224-e1348e336fe8 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:53:09.712537 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-faa03756-e0fa-4d38-9224-e1348e336fe8 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:53:09.713764 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-faa03756-e0fa-4d38-9224-e1348e336fe8 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:53:09.714701 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-faa03756-e0fa-4d38-9224-e1348e336fe8 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:53:09.715167 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-faa03756-e0fa-4d38-9224-e1348e336fe8 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:53:09.715617 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-faa03756-e0fa-4d38-9224-e1348e336fe8 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:53:09.844047 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-faa03756-e0fa-4d38-9224-e1348e336fe8 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad9d55ccfe74ffb914f02030529523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ad9e4338314c269afb0cfcebe03584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:53:09.851919 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-faa03756-e0fa-4d38-9224-e1348e336fe8 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/8ef4f4cd-170b-4474-ad7d-2e297a1dee54" status: 200 len: 1679 microversion: 2.1 time: 0.151476 Oct 04 22:53:09.852497 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3229/7281] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:53:09 2022] GET /compute/v2.1/servers/8ef4f4cd-170b-4474-ad7d-2e297a1dee54 => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:53:10.877021 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-b1d673a5-fb6e-46eb-a614-e3c864355149 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:53:10.877647 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-b1d673a5-fb6e-46eb-a614-e3c864355149 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: 8ef4f4cd-170b-4474-ad7d-2e297a1dee54] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:53:10.884487 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b1d673a5-fb6e-46eb-a614-e3c864355149 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:53:10.884985 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b1d673a5-fb6e-46eb-a614-e3c864355149 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:53:10.885437 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b1d673a5-fb6e-46eb-a614-e3c864355149 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:53:10.886358 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b1d673a5-fb6e-46eb-a614-e3c864355149 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:53:10.886967 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b1d673a5-fb6e-46eb-a614-e3c864355149 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:53:10.887379 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b1d673a5-fb6e-46eb-a614-e3c864355149 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:53:11.016079 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-b1d673a5-fb6e-46eb-a614-e3c864355149 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad9d55ccfe74ffb914f02030529523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ad9e4338314c269afb0cfcebe03584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:53:11.023866 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-b1d673a5-fb6e-46eb-a614-e3c864355149 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/8ef4f4cd-170b-4474-ad7d-2e297a1dee54" status: 200 len: 1679 microversion: 2.1 time: 0.151050 Oct 04 22:53:11.024453 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4053/7282] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:53:10 2022] GET /compute/v2.1/servers/8ef4f4cd-170b-4474-ad7d-2e297a1dee54 => generated 1679 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:53:12.047616 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-dd5b84b0-3580-4b72-a255-5ebecf98f391 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:53:12.048274 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-dd5b84b0-3580-4b72-a255-5ebecf98f391 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: 8ef4f4cd-170b-4474-ad7d-2e297a1dee54] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:53:12.055686 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dd5b84b0-3580-4b72-a255-5ebecf98f391 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:53:12.056249 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dd5b84b0-3580-4b72-a255-5ebecf98f391 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:53:12.056908 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dd5b84b0-3580-4b72-a255-5ebecf98f391 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:53:12.058077 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dd5b84b0-3580-4b72-a255-5ebecf98f391 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:53:12.058578 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dd5b84b0-3580-4b72-a255-5ebecf98f391 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:53:12.059022 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dd5b84b0-3580-4b72-a255-5ebecf98f391 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:53:12.322672 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-dd5b84b0-3580-4b72-a255-5ebecf98f391 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad9d55ccfe74ffb914f02030529523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ad9e4338314c269afb0cfcebe03584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:53:12.334803 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-dd5b84b0-3580-4b72-a255-5ebecf98f391 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/8ef4f4cd-170b-4474-ad7d-2e297a1dee54" status: 200 len: 1678 microversion: 2.1 time: 0.290996 Oct 04 22:53:12.335615 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3230/7283] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:53:12 2022] GET /compute/v2.1/servers/8ef4f4cd-170b-4474-ad7d-2e297a1dee54 => generated 1678 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:53:12.622818 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-34805553-9873-47ce-9b9e-2d9a5ac4d401 req-0cd7cd48-87aa-4c5f-a884-5d5cc86626de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ef4f4cd-170b-4474-ad7d-2e297a1dee54", "name": "network-vif-unplugged", "status": "completed", "tag": "f5794086-46e5-4a0c-a1a7-d5c3eac3c3c3"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:53:12.637806 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-34805553-9873-47ce-9b9e-2d9a5ac4d401 req-0cd7cd48-87aa-4c5f-a884-5d5cc86626de service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:53:12.639084 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-34805553-9873-47ce-9b9e-2d9a5ac4d401 req-0cd7cd48-87aa-4c5f-a884-5d5cc86626de service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:53:12.639556 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-34805553-9873-47ce-9b9e-2d9a5ac4d401 req-0cd7cd48-87aa-4c5f-a884-5d5cc86626de service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:53:12.652985 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-34805553-9873-47ce-9b9e-2d9a5ac4d401 req-0cd7cd48-87aa-4c5f-a884-5d5cc86626de service nova] Creating event network-vif-unplugged:f5794086-46e5-4a0c-a1a7-d5c3eac3c3c3 for instance 8ef4f4cd-170b-4474-ad7d-2e297a1dee54 on n-h1-860284-1 Oct 04 22:53:12.659563 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [req-34805553-9873-47ce-9b9e-2d9a5ac4d401 req-0cd7cd48-87aa-4c5f-a884-5d5cc86626de service nova] Instance 8ef4f4cd-170b-4474-ad7d-2e297a1dee54 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860284-1', 'n-h1-860284-1'} {{(pid=134101) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 22:53:12.674615 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-34805553-9873-47ce-9b9e-2d9a5ac4d401 req-0cd7cd48-87aa-4c5f-a884-5d5cc86626de service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.144757 Oct 04 22:53:12.675831 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4054/7284] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:53:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:53:13.364549 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-aef34a05-efa4-4562-b23e-383afedc9372 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:53:13.365494 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-aef34a05-efa4-4562-b23e-383afedc9372 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: 8ef4f4cd-170b-4474-ad7d-2e297a1dee54] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:53:13.373293 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-aef34a05-efa4-4562-b23e-383afedc9372 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:53:13.373945 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-aef34a05-efa4-4562-b23e-383afedc9372 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:53:13.374507 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-aef34a05-efa4-4562-b23e-383afedc9372 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:53:13.375749 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-aef34a05-efa4-4562-b23e-383afedc9372 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:53:13.376346 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-aef34a05-efa4-4562-b23e-383afedc9372 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:53:13.376891 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-aef34a05-efa4-4562-b23e-383afedc9372 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:53:13.605071 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-aef34a05-efa4-4562-b23e-383afedc9372 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad9d55ccfe74ffb914f02030529523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ad9e4338314c269afb0cfcebe03584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:53:13.613379 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-aef34a05-efa4-4562-b23e-383afedc9372 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/8ef4f4cd-170b-4474-ad7d-2e297a1dee54" status: 200 len: 1678 microversion: 2.1 time: 0.252695 Oct 04 22:53:13.614126 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3231/7285] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:53:13 2022] GET /compute/v2.1/servers/8ef4f4cd-170b-4474-ad7d-2e297a1dee54 => generated 1678 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:53:14.638942 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-a8934331-7614-443e-a60c-b4d3cc929ad9 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:53:14.639671 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-a8934331-7614-443e-a60c-b4d3cc929ad9 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: 8ef4f4cd-170b-4474-ad7d-2e297a1dee54] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:53:14.645930 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a8934331-7614-443e-a60c-b4d3cc929ad9 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:53:14.646464 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a8934331-7614-443e-a60c-b4d3cc929ad9 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:53:14.646930 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a8934331-7614-443e-a60c-b4d3cc929ad9 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:53:14.647646 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a8934331-7614-443e-a60c-b4d3cc929ad9 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:53:14.648127 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a8934331-7614-443e-a60c-b4d3cc929ad9 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:53:14.648607 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a8934331-7614-443e-a60c-b4d3cc929ad9 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:53:14.690150 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-c746c0f2-5b6e-4351-bc95-190997fb0204 req-a1bc2cbe-2890-43e3-9644-0d5e25c405fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ef4f4cd-170b-4474-ad7d-2e297a1dee54", "tag": "f5794086-46e5-4a0c-a1a7-d5c3eac3c3c3"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:53:14.701242 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-c746c0f2-5b6e-4351-bc95-190997fb0204 req-a1bc2cbe-2890-43e3-9644-0d5e25c405fd service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:53:14.701734 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-c746c0f2-5b6e-4351-bc95-190997fb0204 req-a1bc2cbe-2890-43e3-9644-0d5e25c405fd service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:53:14.702175 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-c746c0f2-5b6e-4351-bc95-190997fb0204 req-a1bc2cbe-2890-43e3-9644-0d5e25c405fd service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:53:14.714218 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-c746c0f2-5b6e-4351-bc95-190997fb0204 req-a1bc2cbe-2890-43e3-9644-0d5e25c405fd service nova] Creating event network-changed:f5794086-46e5-4a0c-a1a7-d5c3eac3c3c3 for instance 8ef4f4cd-170b-4474-ad7d-2e297a1dee54 on n-h1-860284-1 Oct 04 22:53:14.719860 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [req-c746c0f2-5b6e-4351-bc95-190997fb0204 req-a1bc2cbe-2890-43e3-9644-0d5e25c405fd service nova] Instance 8ef4f4cd-170b-4474-ad7d-2e297a1dee54 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860284-1', 'n-h1-860284-1'} {{(pid=134102) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 22:53:14.731136 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-c746c0f2-5b6e-4351-bc95-190997fb0204 req-a1bc2cbe-2890-43e3-9644-0d5e25c405fd service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044741 Oct 04 22:53:14.731753 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3232/7286] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:53:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:53:14.784088 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-a8934331-7614-443e-a60c-b4d3cc929ad9 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad9d55ccfe74ffb914f02030529523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ad9e4338314c269afb0cfcebe03584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:53:14.792147 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-a8934331-7614-443e-a60c-b4d3cc929ad9 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/8ef4f4cd-170b-4474-ad7d-2e297a1dee54" status: 200 len: 1676 microversion: 2.1 time: 0.158472 Oct 04 22:53:14.792730 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4055/7287] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:53:14 2022] GET /compute/v2.1/servers/8ef4f4cd-170b-4474-ad7d-2e297a1dee54 => generated 1676 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:53:15.817660 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-37cac8be-83d4-4b8b-803d-5f1b17b8a376 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:53:15.818382 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-37cac8be-83d4-4b8b-803d-5f1b17b8a376 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: 8ef4f4cd-170b-4474-ad7d-2e297a1dee54] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:53:15.824930 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-37cac8be-83d4-4b8b-803d-5f1b17b8a376 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:53:15.825416 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-37cac8be-83d4-4b8b-803d-5f1b17b8a376 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:53:15.825856 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-37cac8be-83d4-4b8b-803d-5f1b17b8a376 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:53:15.826590 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-37cac8be-83d4-4b8b-803d-5f1b17b8a376 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:53:15.827050 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-37cac8be-83d4-4b8b-803d-5f1b17b8a376 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:53:15.827477 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-37cac8be-83d4-4b8b-803d-5f1b17b8a376 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:53:15.956303 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-37cac8be-83d4-4b8b-803d-5f1b17b8a376 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad9d55ccfe74ffb914f02030529523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ad9e4338314c269afb0cfcebe03584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:53:15.964772 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-37cac8be-83d4-4b8b-803d-5f1b17b8a376 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/8ef4f4cd-170b-4474-ad7d-2e297a1dee54" status: 200 len: 1676 microversion: 2.1 time: 0.152242 Oct 04 22:53:15.965648 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3233/7288] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:53:15 2022] GET /compute/v2.1/servers/8ef4f4cd-170b-4474-ad7d-2e297a1dee54 => generated 1676 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:53:16.989217 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-5f236413-72a7-4fb7-8b56-13174f92cd38 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:53:16.989857 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-5f236413-72a7-4fb7-8b56-13174f92cd38 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: 8ef4f4cd-170b-4474-ad7d-2e297a1dee54] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:53:16.997003 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5f236413-72a7-4fb7-8b56-13174f92cd38 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:53:16.997511 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5f236413-72a7-4fb7-8b56-13174f92cd38 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:53:16.998238 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5f236413-72a7-4fb7-8b56-13174f92cd38 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:53:16.998989 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5f236413-72a7-4fb7-8b56-13174f92cd38 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:53:16.999459 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5f236413-72a7-4fb7-8b56-13174f92cd38 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:53:16.999905 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5f236413-72a7-4fb7-8b56-13174f92cd38 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:53:17.134092 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-5f236413-72a7-4fb7-8b56-13174f92cd38 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad9d55ccfe74ffb914f02030529523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ad9e4338314c269afb0cfcebe03584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:53:17.142790 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-5f236413-72a7-4fb7-8b56-13174f92cd38 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/8ef4f4cd-170b-4474-ad7d-2e297a1dee54" status: 200 len: 1673 microversion: 2.1 time: 0.157816 Oct 04 22:53:17.143388 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4056/7289] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:53:16 2022] GET /compute/v2.1/servers/8ef4f4cd-170b-4474-ad7d-2e297a1dee54 => generated 1673 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:53:17.166207 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-1bb0da2a-34db-4d5b-a947-e0e276e45355 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:53:17.167532 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-1bb0da2a-34db-4d5b-a947-e0e276e45355 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: 8ef4f4cd-170b-4474-ad7d-2e297a1dee54] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:53:17.174459 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1bb0da2a-34db-4d5b-a947-e0e276e45355 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:53:17.174904 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1bb0da2a-34db-4d5b-a947-e0e276e45355 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:53:17.175347 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1bb0da2a-34db-4d5b-a947-e0e276e45355 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:53:17.176047 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1bb0da2a-34db-4d5b-a947-e0e276e45355 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:53:17.176508 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1bb0da2a-34db-4d5b-a947-e0e276e45355 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:53:17.176940 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1bb0da2a-34db-4d5b-a947-e0e276e45355 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:53:17.235239 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-1bb0da2a-34db-4d5b-a947-e0e276e45355 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "POST /compute/v2.1/servers/8ef4f4cd-170b-4474-ad7d-2e297a1dee54/action" status: 204 len: 0 microversion: 2.1 time: 0.072813 Oct 04 22:53:17.235950 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3234/7290] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 22:53:17 2022] POST /compute/v2.1/servers/8ef4f4cd-170b-4474-ad7d-2e297a1dee54/action => generated 0 bytes in 74 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 22:53:17.244155 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-fad616fa-01fe-41a8-bb11-6b2b0019a985 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:53:17.244978 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-fad616fa-01fe-41a8-bb11-6b2b0019a985 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: 8ef4f4cd-170b-4474-ad7d-2e297a1dee54] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:53:17.251303 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fad616fa-01fe-41a8-bb11-6b2b0019a985 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:53:17.251805 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fad616fa-01fe-41a8-bb11-6b2b0019a985 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:53:17.252316 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fad616fa-01fe-41a8-bb11-6b2b0019a985 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:53:17.253150 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fad616fa-01fe-41a8-bb11-6b2b0019a985 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:53:17.253737 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fad616fa-01fe-41a8-bb11-6b2b0019a985 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:53:17.254218 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fad616fa-01fe-41a8-bb11-6b2b0019a985 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:53:17.394236 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-fad616fa-01fe-41a8-bb11-6b2b0019a985 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad9d55ccfe74ffb914f02030529523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ad9e4338314c269afb0cfcebe03584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:53:17.402718 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-fad616fa-01fe-41a8-bb11-6b2b0019a985 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/8ef4f4cd-170b-4474-ad7d-2e297a1dee54" status: 200 len: 1673 microversion: 2.1 time: 0.162457 Oct 04 22:53:17.403305 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4057/7291] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:53:17 2022] GET /compute/v2.1/servers/8ef4f4cd-170b-4474-ad7d-2e297a1dee54 => generated 1673 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:53:18.427888 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-da1f40ae-8872-4c42-a65a-117bcceb7119 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:53:18.428606 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-da1f40ae-8872-4c42-a65a-117bcceb7119 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: 8ef4f4cd-170b-4474-ad7d-2e297a1dee54] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:53:18.434897 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-da1f40ae-8872-4c42-a65a-117bcceb7119 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:53:18.435378 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-da1f40ae-8872-4c42-a65a-117bcceb7119 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:53:18.435813 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-da1f40ae-8872-4c42-a65a-117bcceb7119 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:53:18.436496 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-da1f40ae-8872-4c42-a65a-117bcceb7119 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:53:18.436946 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-da1f40ae-8872-4c42-a65a-117bcceb7119 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:53:18.437368 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-da1f40ae-8872-4c42-a65a-117bcceb7119 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:53:18.572359 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-da1f40ae-8872-4c42-a65a-117bcceb7119 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad9d55ccfe74ffb914f02030529523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ad9e4338314c269afb0cfcebe03584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:53:18.581122 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-da1f40ae-8872-4c42-a65a-117bcceb7119 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/8ef4f4cd-170b-4474-ad7d-2e297a1dee54" status: 200 len: 1673 microversion: 2.1 time: 0.158424 Oct 04 22:53:18.581703 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3235/7292] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:53:18 2022] GET /compute/v2.1/servers/8ef4f4cd-170b-4474-ad7d-2e297a1dee54 => generated 1673 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:53:19.608219 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-37be9b8e-1f9a-4b90-9cf4-9240b0c3e355 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:53:19.609205 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-37be9b8e-1f9a-4b90-9cf4-9240b0c3e355 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: 8ef4f4cd-170b-4474-ad7d-2e297a1dee54] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:53:19.618135 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-37be9b8e-1f9a-4b90-9cf4-9240b0c3e355 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:53:19.618744 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-37be9b8e-1f9a-4b90-9cf4-9240b0c3e355 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:53:19.619415 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-37be9b8e-1f9a-4b90-9cf4-9240b0c3e355 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:53:19.620476 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-37be9b8e-1f9a-4b90-9cf4-9240b0c3e355 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:53:19.621248 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-37be9b8e-1f9a-4b90-9cf4-9240b0c3e355 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:53:19.621750 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-37be9b8e-1f9a-4b90-9cf4-9240b0c3e355 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:53:19.671576 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-4679486b-90e0-4a3c-a7dd-d4e0cc436e18 req-b3464f73-5b7b-4dd9-b32e-b8ce25bd4351 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ef4f4cd-170b-4474-ad7d-2e297a1dee54", "name": "network-vif-plugged", "status": "completed", "tag": "f5794086-46e5-4a0c-a1a7-d5c3eac3c3c3"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:53:19.681682 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-4679486b-90e0-4a3c-a7dd-d4e0cc436e18 req-b3464f73-5b7b-4dd9-b32e-b8ce25bd4351 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:53:19.682279 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-4679486b-90e0-4a3c-a7dd-d4e0cc436e18 req-b3464f73-5b7b-4dd9-b32e-b8ce25bd4351 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:53:19.682909 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-4679486b-90e0-4a3c-a7dd-d4e0cc436e18 req-b3464f73-5b7b-4dd9-b32e-b8ce25bd4351 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:53:19.694808 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-4679486b-90e0-4a3c-a7dd-d4e0cc436e18 req-b3464f73-5b7b-4dd9-b32e-b8ce25bd4351 service nova] Creating event network-vif-plugged:f5794086-46e5-4a0c-a1a7-d5c3eac3c3c3 for instance 8ef4f4cd-170b-4474-ad7d-2e297a1dee54 on n-h1-860284-1 Oct 04 22:53:19.700302 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-4679486b-90e0-4a3c-a7dd-d4e0cc436e18 req-b3464f73-5b7b-4dd9-b32e-b8ce25bd4351 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100553 Oct 04 22:53:19.700919 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4058/7293] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:53:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:53:19.770185 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-37be9b8e-1f9a-4b90-9cf4-9240b0c3e355 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad9d55ccfe74ffb914f02030529523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ad9e4338314c269afb0cfcebe03584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:53:19.778620 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-37be9b8e-1f9a-4b90-9cf4-9240b0c3e355 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/8ef4f4cd-170b-4474-ad7d-2e297a1dee54" status: 200 len: 1665 microversion: 2.1 time: 0.177128 Oct 04 22:53:19.779216 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3236/7294] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:53:19 2022] GET /compute/v2.1/servers/8ef4f4cd-170b-4474-ad7d-2e297a1dee54 => generated 1665 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:53:19.801902 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-28919058-3dff-4eba-9fba-768f422de17f tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:53:19.802711 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-28919058-3dff-4eba-9fba-768f422de17f tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: 8ef4f4cd-170b-4474-ad7d-2e297a1dee54] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:53:19.809162 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-28919058-3dff-4eba-9fba-768f422de17f tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:53:19.809677 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-28919058-3dff-4eba-9fba-768f422de17f tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:53:19.810136 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-28919058-3dff-4eba-9fba-768f422de17f tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:53:19.810894 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-28919058-3dff-4eba-9fba-768f422de17f tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:53:19.811372 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-28919058-3dff-4eba-9fba-768f422de17f tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:53:19.811821 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-28919058-3dff-4eba-9fba-768f422de17f tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:53:19.953080 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-28919058-3dff-4eba-9fba-768f422de17f tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad9d55ccfe74ffb914f02030529523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ad9e4338314c269afb0cfcebe03584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:53:19.961915 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-28919058-3dff-4eba-9fba-768f422de17f tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/8ef4f4cd-170b-4474-ad7d-2e297a1dee54" status: 200 len: 1665 microversion: 2.1 time: 0.164260 Oct 04 22:53:19.962505 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4059/7295] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:53:19 2022] GET /compute/v2.1/servers/8ef4f4cd-170b-4474-ad7d-2e297a1dee54 => generated 1665 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:53:19.984754 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-5aea77fd-49f0-4773-b82b-4e69247d3b4a tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:53:19.985539 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-5aea77fd-49f0-4773-b82b-4e69247d3b4a tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: 8ef4f4cd-170b-4474-ad7d-2e297a1dee54] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:53:19.991917 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5aea77fd-49f0-4773-b82b-4e69247d3b4a tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:53:19.992402 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5aea77fd-49f0-4773-b82b-4e69247d3b4a tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:53:19.992841 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5aea77fd-49f0-4773-b82b-4e69247d3b4a tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:53:19.993526 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5aea77fd-49f0-4773-b82b-4e69247d3b4a tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:53:19.993980 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5aea77fd-49f0-4773-b82b-4e69247d3b4a tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:53:19.994429 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5aea77fd-49f0-4773-b82b-4e69247d3b4a tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:53:20.129032 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-5aea77fd-49f0-4773-b82b-4e69247d3b4a tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad9d55ccfe74ffb914f02030529523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ad9e4338314c269afb0cfcebe03584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:53:20.131347 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:53:20.139517 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-5aea77fd-49f0-4773-b82b-4e69247d3b4a tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/8ef4f4cd-170b-4474-ad7d-2e297a1dee54" status: 200 len: 1665 microversion: 2.1 time: 0.158821 Oct 04 22:53:20.140096 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3237/7296] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:53:19 2022] GET /compute/v2.1/servers/8ef4f4cd-170b-4474-ad7d-2e297a1dee54 => generated 1665 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:53:20.162085 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-ec73507b-1969-42b8-9996-8f3985d67ab0 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:53:20.162629 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-ec73507b-1969-42b8-9996-8f3985d67ab0 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: 8ef4f4cd-170b-4474-ad7d-2e297a1dee54] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:53:20.168518 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ec73507b-1969-42b8-9996-8f3985d67ab0 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:53:20.169013 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ec73507b-1969-42b8-9996-8f3985d67ab0 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:53:20.169464 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ec73507b-1969-42b8-9996-8f3985d67ab0 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:53:20.170163 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ec73507b-1969-42b8-9996-8f3985d67ab0 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:53:20.170655 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ec73507b-1969-42b8-9996-8f3985d67ab0 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:53:20.171095 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ec73507b-1969-42b8-9996-8f3985d67ab0 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:53:20.195850 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-ec73507b-1969-42b8-9996-8f3985d67ab0 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: 8ef4f4cd-170b-4474-ad7d-2e297a1dee54] Going to try to terminate instance {{(pid=134101) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 22:53:20.242145 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:53:20.276405 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-ec73507b-1969-42b8-9996-8f3985d67ab0 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "DELETE /compute/v2.1/servers/8ef4f4cd-170b-4474-ad7d-2e297a1dee54" status: 204 len: 0 microversion: 2.1 time: 0.117806 Oct 04 22:53:20.277382 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4060/7297] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 22:53:20 2022] DELETE /compute/v2.1/servers/8ef4f4cd-170b-4474-ad7d-2e297a1dee54 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 22:53:20.286008 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-f2b4698f-4070-4712-9221-670ee06023cd tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:53:20.286667 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-f2b4698f-4070-4712-9221-670ee06023cd tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: 8ef4f4cd-170b-4474-ad7d-2e297a1dee54] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:53:20.293941 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f2b4698f-4070-4712-9221-670ee06023cd tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:53:20.294453 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f2b4698f-4070-4712-9221-670ee06023cd tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:53:20.294893 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f2b4698f-4070-4712-9221-670ee06023cd tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:53:20.295589 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f2b4698f-4070-4712-9221-670ee06023cd tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:53:20.296047 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f2b4698f-4070-4712-9221-670ee06023cd tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:53:20.296476 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f2b4698f-4070-4712-9221-670ee06023cd tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:53:20.426163 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-f2b4698f-4070-4712-9221-670ee06023cd tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad9d55ccfe74ffb914f02030529523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ad9e4338314c269afb0cfcebe03584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:53:20.434489 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-f2b4698f-4070-4712-9221-670ee06023cd tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/8ef4f4cd-170b-4474-ad7d-2e297a1dee54" status: 200 len: 1671 microversion: 2.1 time: 0.152708 Oct 04 22:53:20.435069 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3238/7298] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:53:20 2022] GET /compute/v2.1/servers/8ef4f4cd-170b-4474-ad7d-2e297a1dee54 => generated 1671 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:53:21.459154 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-20390a10-affb-48f9-bc2f-84c9e16f0c69 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:53:21.459908 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-20390a10-affb-48f9-bc2f-84c9e16f0c69 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: 8ef4f4cd-170b-4474-ad7d-2e297a1dee54] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:53:21.467481 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-20390a10-affb-48f9-bc2f-84c9e16f0c69 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:53:21.467993 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-20390a10-affb-48f9-bc2f-84c9e16f0c69 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:53:21.468454 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-20390a10-affb-48f9-bc2f-84c9e16f0c69 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:53:21.469176 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-20390a10-affb-48f9-bc2f-84c9e16f0c69 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:53:21.469659 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-20390a10-affb-48f9-bc2f-84c9e16f0c69 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:53:21.470107 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-20390a10-affb-48f9-bc2f-84c9e16f0c69 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:53:21.604870 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-20390a10-affb-48f9-bc2f-84c9e16f0c69 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad9d55ccfe74ffb914f02030529523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ad9e4338314c269afb0cfcebe03584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:53:21.612722 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-20390a10-affb-48f9-bc2f-84c9e16f0c69 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/8ef4f4cd-170b-4474-ad7d-2e297a1dee54" status: 200 len: 1671 microversion: 2.1 time: 0.157957 Oct 04 22:53:21.613300 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4061/7299] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:53:21 2022] GET /compute/v2.1/servers/8ef4f4cd-170b-4474-ad7d-2e297a1dee54 => generated 1671 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:53:22.614632 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-5e0ce81c-ca48-457d-8244-c6e457096246 req-c925a382-ef8b-439f-82d6-5a698ad12553 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ef4f4cd-170b-4474-ad7d-2e297a1dee54", "name": "network-vif-deleted", "tag": "f5794086-46e5-4a0c-a1a7-d5c3eac3c3c3"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:53:22.625943 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-5e0ce81c-ca48-457d-8244-c6e457096246 req-c925a382-ef8b-439f-82d6-5a698ad12553 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:53:22.626471 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-5e0ce81c-ca48-457d-8244-c6e457096246 req-c925a382-ef8b-439f-82d6-5a698ad12553 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:53:22.626908 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-5e0ce81c-ca48-457d-8244-c6e457096246 req-c925a382-ef8b-439f-82d6-5a698ad12553 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:53:22.637144 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-f6ec38c5-5fb3-487f-a20a-d60970f43788 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:53:22.637706 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-f6ec38c5-5fb3-487f-a20a-d60970f43788 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: 8ef4f4cd-170b-4474-ad7d-2e297a1dee54] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:53:22.647776 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f6ec38c5-5fb3-487f-a20a-d60970f43788 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:53:22.648698 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f6ec38c5-5fb3-487f-a20a-d60970f43788 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:53:22.649243 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f6ec38c5-5fb3-487f-a20a-d60970f43788 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:53:22.649561 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-5e0ce81c-ca48-457d-8244-c6e457096246 req-c925a382-ef8b-439f-82d6-5a698ad12553 service nova] Creating event network-vif-deleted:f5794086-46e5-4a0c-a1a7-d5c3eac3c3c3 for instance 8ef4f4cd-170b-4474-ad7d-2e297a1dee54 on n-h1-860284-1 Oct 04 22:53:22.650324 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f6ec38c5-5fb3-487f-a20a-d60970f43788 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:53:22.650915 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f6ec38c5-5fb3-487f-a20a-d60970f43788 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:53:22.651433 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f6ec38c5-5fb3-487f-a20a-d60970f43788 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:53:22.654870 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-5e0ce81c-ca48-457d-8244-c6e457096246 req-c925a382-ef8b-439f-82d6-5a698ad12553 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044451 Oct 04 22:53:22.655797 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3239/7300] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:53:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:53:22.724734 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-f6ec38c5-5fb3-487f-a20a-d60970f43788 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad9d55ccfe74ffb914f02030529523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ad9e4338314c269afb0cfcebe03584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:53:22.733649 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-f6ec38c5-5fb3-487f-a20a-d60970f43788 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/8ef4f4cd-170b-4474-ad7d-2e297a1dee54" status: 200 len: 1321 microversion: 2.1 time: 0.101509 Oct 04 22:53:22.734384 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4062/7301] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:53:22 2022] GET /compute/v2.1/servers/8ef4f4cd-170b-4474-ad7d-2e297a1dee54 => generated 1321 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:53:23.758510 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-2f591b85-8285-44ba-a3b3-f97a9be2913b tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:53:23.759221 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-2f591b85-8285-44ba-a3b3-f97a9be2913b tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: 8ef4f4cd-170b-4474-ad7d-2e297a1dee54] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:53:23.766077 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2f591b85-8285-44ba-a3b3-f97a9be2913b tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:53:23.766607 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2f591b85-8285-44ba-a3b3-f97a9be2913b tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:53:23.767052 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2f591b85-8285-44ba-a3b3-f97a9be2913b tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:53:23.767746 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2f591b85-8285-44ba-a3b3-f97a9be2913b tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:53:23.768211 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2f591b85-8285-44ba-a3b3-f97a9be2913b tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:53:23.768643 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2f591b85-8285-44ba-a3b3-f97a9be2913b tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:53:23.782601 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-2f591b85-8285-44ba-a3b3-f97a9be2913b tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] HTTP exception thrown: Instance 8ef4f4cd-170b-4474-ad7d-2e297a1dee54 could not be found. Oct 04 22:53:23.784195 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-2f591b85-8285-44ba-a3b3-f97a9be2913b tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Request method failure captured: Oct 04 22:53:23.784195 n-d-860284-1 devstack@n-api.service[134102]: request: GET /compute/v2.1/servers/8ef4f4cd-170b-4474-ad7d-2e297a1dee54 HTTP/1.1 Oct 04 22:53:23.784195 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 22:53:23.784195 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 22:53:23.784195 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 22:53:23.784195 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 22:53:23.784195 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 22:53:23.784195 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 22:53:23.784195 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 22:53:23.784195 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 22:53:23.784195 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPLj5Pwg8WnMY03a1UZoxjs8JJYeyX4gPNXk6kEaEUFSId5NkYbu9p7XcCT6xCsGLl965bhlzMmdcrnW3jmUrNP-IBqDDDBlZIgg6A8FuefFnP4mHIDNTJ0T7sYDTAC4YQVniCZjT1xnCXPrzoAdDzhVXLGL7ogVXgw4ofRJLecl7Qjo Oct 04 22:53:23.784195 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 22:53:23.784195 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 22:53:23.784195 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 22:53:23.784195 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 22:53:23.784195 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 22:53:23.784195 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 22:53:23.784195 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: d2ad9e4338314c269afb0cfcebe03584 Oct 04 22:53:23.784195 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-ServerActionsTestJSON-1972791785 Oct 04 22:53:23.784195 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 22:53:23.784195 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 22:53:23.784195 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d2ad9e4338314c269afb0cfcebe03584"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_d2ad9e4338314c269afb0cfcebe03584", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d2ad9e4338314c269afb0cfcebe03584"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/d2ad9e4338314c269afb0cfcebe03584"}]}] Oct 04 22:53:23.784195 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-ServerActionsTestJSON-1972791785 Oct 04 22:53:23.784195 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: d2ad9e4338314c269afb0cfcebe03584 Oct 04 22:53:23.784195 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-ServerActionsTestJSON-1972791785 Oct 04 22:53:23.784195 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-ServerActionsTestJSON-1972791785-project Oct 04 22:53:23.784195 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 22:53:23.784195 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 22:53:23.784195 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: aad9d55ccfe74ffb914f02030529523d Oct 04 22:53:23.784195 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-ServerActionsTestJSON-1972791785-project Oct 04 22:53:23.784195 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 22:53:23.784195 n-d-860284-1 devstack@n-api.service[134102]: exception: Instance 8ef4f4cd-170b-4474-ad7d-2e297a1dee54 could not be found. Oct 04 22:53:23.784195 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': '8ef4f4cd-170b-4474-ad7d-2e297a1dee54'} Oct 04 22:53:23.784195 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:53:23.784195 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:53:23.784195 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:53:23.784195 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:53:23.784195 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:53:23.784195 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:53:23.784195 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:53:23.784195 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:53:23.784195 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:53:23.784195 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:53:23.784195 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ef4f4cd-170b-4474-ad7d-2e297a1dee54 could not be found. Oct 04 22:53:23.784195 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:53:23.784195 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:53:23.784195 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:53:23.784195 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:53:23.784195 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:53:23.784195 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:53:23.784195 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:53:23.784195 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:53:23.784195 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:53:23.784195 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:53:23.784195 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:53:23.784195 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:53:23.784195 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:53:23.784195 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:53:23.784195 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:53:23.784195 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:53:23.784195 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ef4f4cd-170b-4474-ad7d-2e297a1dee54 could not be found. Oct 04 22:53:23.784195 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:53:23.784195 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:53:23.784195 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:53:23.788846 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:53:23.788846 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:53:23.788846 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:53:23.788846 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:53:23.788846 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:53:23.788846 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ef4f4cd-170b-4474-ad7d-2e297a1dee54 could not be found. Oct 04 22:53:23.788846 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:53:23.788846 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-2f591b85-8285-44ba-a3b3-f97a9be2913b tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Returning 404 to user: Instance 8ef4f4cd-170b-4474-ad7d-2e297a1dee54 could not be found. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:53:23.788846 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-2f591b85-8285-44ba-a3b3-f97a9be2913b tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/8ef4f4cd-170b-4474-ad7d-2e297a1dee54" status: 404 len: 111 microversion: 2.1 time: 0.032270 Oct 04 22:53:23.788846 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3240/7302] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:53:23 2022] GET /compute/v2.1/servers/8ef4f4cd-170b-4474-ad7d-2e297a1dee54 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:53:23.798716 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-7cb6032e-c4c9-46b9-8c18-94f6d728c73b tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:53:23.799347 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-7cb6032e-c4c9-46b9-8c18-94f6d728c73b tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: 8ef4f4cd-170b-4474-ad7d-2e297a1dee54] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:53:23.806180 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7cb6032e-c4c9-46b9-8c18-94f6d728c73b tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:53:23.806712 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7cb6032e-c4c9-46b9-8c18-94f6d728c73b tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:53:23.807168 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7cb6032e-c4c9-46b9-8c18-94f6d728c73b tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:53:23.807868 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7cb6032e-c4c9-46b9-8c18-94f6d728c73b tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:53:23.808336 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7cb6032e-c4c9-46b9-8c18-94f6d728c73b tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:53:23.808774 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7cb6032e-c4c9-46b9-8c18-94f6d728c73b tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:53:23.822018 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-7cb6032e-c4c9-46b9-8c18-94f6d728c73b tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] HTTP exception thrown: Instance 8ef4f4cd-170b-4474-ad7d-2e297a1dee54 could not be found. Oct 04 22:53:23.824386 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-7cb6032e-c4c9-46b9-8c18-94f6d728c73b tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Request method failure captured: Oct 04 22:53:23.824386 n-d-860284-1 devstack@n-api.service[134101]: request: GET /compute/v2.1/servers/8ef4f4cd-170b-4474-ad7d-2e297a1dee54 HTTP/1.1 Oct 04 22:53:23.824386 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 22:53:23.824386 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 22:53:23.824386 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 22:53:23.824386 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 22:53:23.824386 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 22:53:23.824386 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 22:53:23.824386 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 22:53:23.824386 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 22:53:23.824386 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPLj5Pwg8WnMY03a1UZoxjs8JJYeyX4gPNXk6kEaEUFSId5NkYbu9p7XcCT6xCsGLl965bhlzMmdcrnW3jmUrNP-IBqDDDBlZIgg6A8FuefFnP4mHIDNTJ0T7sYDTAC4YQVniCZjT1xnCXPrzoAdDzhVXLGL7ogVXgw4ofRJLecl7Qjo Oct 04 22:53:23.824386 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 22:53:23.824386 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 22:53:23.824386 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 22:53:23.824386 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 22:53:23.824386 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 22:53:23.824386 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 22:53:23.824386 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: d2ad9e4338314c269afb0cfcebe03584 Oct 04 22:53:23.824386 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-ServerActionsTestJSON-1972791785 Oct 04 22:53:23.824386 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 22:53:23.824386 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 22:53:23.824386 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d2ad9e4338314c269afb0cfcebe03584"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_d2ad9e4338314c269afb0cfcebe03584", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d2ad9e4338314c269afb0cfcebe03584"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/d2ad9e4338314c269afb0cfcebe03584"}]}] Oct 04 22:53:23.824386 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-ServerActionsTestJSON-1972791785 Oct 04 22:53:23.824386 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: d2ad9e4338314c269afb0cfcebe03584 Oct 04 22:53:23.824386 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-ServerActionsTestJSON-1972791785 Oct 04 22:53:23.824386 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-ServerActionsTestJSON-1972791785-project Oct 04 22:53:23.824386 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 22:53:23.824386 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 22:53:23.824386 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: aad9d55ccfe74ffb914f02030529523d Oct 04 22:53:23.824386 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-ServerActionsTestJSON-1972791785-project Oct 04 22:53:23.824386 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 22:53:23.824386 n-d-860284-1 devstack@n-api.service[134101]: exception: Instance 8ef4f4cd-170b-4474-ad7d-2e297a1dee54 could not be found. Oct 04 22:53:23.824386 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': '8ef4f4cd-170b-4474-ad7d-2e297a1dee54'} Oct 04 22:53:23.824386 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:53:23.824386 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:53:23.824386 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:53:23.824386 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:53:23.824386 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:53:23.824386 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:53:23.824386 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:53:23.824386 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:53:23.824386 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:53:23.824386 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:53:23.824386 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ef4f4cd-170b-4474-ad7d-2e297a1dee54 could not be found. Oct 04 22:53:23.824386 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:53:23.824386 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:53:23.824386 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:53:23.824386 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:53:23.824386 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:53:23.824386 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:53:23.824386 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:53:23.824386 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:53:23.824386 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:53:23.824386 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:53:23.824386 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:53:23.824386 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:53:23.824386 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:53:23.824386 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:53:23.824386 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:53:23.824386 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:53:23.824386 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ef4f4cd-170b-4474-ad7d-2e297a1dee54 could not be found. Oct 04 22:53:23.824386 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:53:23.824386 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:53:23.824386 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:53:23.832143 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:53:23.832143 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:53:23.832143 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:53:23.832143 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:53:23.832143 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:53:23.832143 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ef4f4cd-170b-4474-ad7d-2e297a1dee54 could not be found. Oct 04 22:53:23.832143 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:53:23.832143 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-7cb6032e-c4c9-46b9-8c18-94f6d728c73b tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Returning 404 to user: Instance 8ef4f4cd-170b-4474-ad7d-2e297a1dee54 could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:53:23.832143 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-7cb6032e-c4c9-46b9-8c18-94f6d728c73b tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/8ef4f4cd-170b-4474-ad7d-2e297a1dee54" status: 404 len: 111 microversion: 2.1 time: 0.031085 Oct 04 22:53:23.832143 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4063/7303] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:53:23 2022] GET /compute/v2.1/servers/8ef4f4cd-170b-4474-ad7d-2e297a1dee54 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 22:53:23.873981 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-edbe3f3b-d226-425b-9d1c-f402859fea89 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-419286475", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452", "networks": [{"uuid": "edb1eff0-ecce-412d-a1f1-316814dcaa93"}], "security_groups": [{"name": "tempest-securitygroup--1626714274"}], "key_name": "tempest-keypair-524313961", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:53:23.982394 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.network.neutron [None req-edbe3f3b-d226-425b-9d1c-f402859fea89 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] validate_networks() for [('edb1eff0-ecce-412d-a1f1-316814dcaa93', None, None, None, None, None)] {{(pid=134102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 22:53:24.409029 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-edbe3f3b-d226-425b-9d1c-f402859fea89 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Flavor limits 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 22:53:24.409460 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-edbe3f3b-d226-425b-9d1c-f402859fea89 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Image limits 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 22:53:24.409943 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-edbe3f3b-d226-425b-9d1c-f402859fea89 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Flavor pref 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 22:53:24.410358 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-edbe3f3b-d226-425b-9d1c-f402859fea89 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Image pref 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 22:53:24.410807 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-edbe3f3b-d226-425b-9d1c-f402859fea89 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 22:53:24.420211 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-edbe3f3b-d226-425b-9d1c-f402859fea89 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:53:24.420696 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-edbe3f3b-d226-425b-9d1c-f402859fea89 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:53:24.421134 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-edbe3f3b-d226-425b-9d1c-f402859fea89 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:53:24.421872 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-edbe3f3b-d226-425b-9d1c-f402859fea89 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:53:24.422331 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-edbe3f3b-d226-425b-9d1c-f402859fea89 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:53:24.422873 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-edbe3f3b-d226-425b-9d1c-f402859fea89 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:53:24.440686 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-edbe3f3b-d226-425b-9d1c-f402859fea89 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Getting quotas for project d2ad9e4338314c269afb0cfcebe03584. Resources: {'instances', 'ram', 'cores'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:53:24.445841 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-edbe3f3b-d226-425b-9d1c-f402859fea89 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Getting quotas for user aad9d55ccfe74ffb914f02030529523d and project d2ad9e4338314c269afb0cfcebe03584. Resources: {'instances', 'ram', 'cores'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:53:24.458471 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-edbe3f3b-d226-425b-9d1c-f402859fea89 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Going to run 1 instances... {{(pid=134102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 22:53:24.460765 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-edbe3f3b-d226-425b-9d1c-f402859fea89 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: 777aaf80-05b4-4e03-b329-084e9fda3e39] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='58548514-5dac-426c-81f5-19e3fba33e23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 22:53:24.508479 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-edbe3f3b-d226-425b-9d1c-f402859fea89 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.638730 Oct 04 22:53:24.509215 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3241/7304] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 22:53:23 2022] POST /compute/v2.1/servers => generated 406 bytes in 640 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 22:53:24.520823 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-a1ecfc5c-fcac-4f4d-b571-cd7250eec939 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:53:24.521465 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-a1ecfc5c-fcac-4f4d-b571-cd7250eec939 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: 777aaf80-05b4-4e03-b329-084e9fda3e39] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:53:24.577438 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-a1ecfc5c-fcac-4f4d-b571-cd7250eec939 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad9d55ccfe74ffb914f02030529523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ad9e4338314c269afb0cfcebe03584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:53:24.584626 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-a1ecfc5c-fcac-4f4d-b571-cd7250eec939 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/777aaf80-05b4-4e03-b329-084e9fda3e39" status: 200 len: 1237 microversion: 2.1 time: 0.067696 Oct 04 22:53:24.585385 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4064/7305] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:53:24 2022] GET /compute/v2.1/servers/777aaf80-05b4-4e03-b329-084e9fda3e39 => generated 1237 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:53:25.610857 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-e240cac4-3d07-4c22-9580-827a3be6879c tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:53:25.611473 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-e240cac4-3d07-4c22-9580-827a3be6879c tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: 777aaf80-05b4-4e03-b329-084e9fda3e39] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:53:25.618570 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e240cac4-3d07-4c22-9580-827a3be6879c tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:53:25.619061 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e240cac4-3d07-4c22-9580-827a3be6879c tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:53:25.619501 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e240cac4-3d07-4c22-9580-827a3be6879c tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:53:25.620742 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e240cac4-3d07-4c22-9580-827a3be6879c tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:53:25.621198 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e240cac4-3d07-4c22-9580-827a3be6879c tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:53:25.621639 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e240cac4-3d07-4c22-9580-827a3be6879c tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:53:25.705169 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-e240cac4-3d07-4c22-9580-827a3be6879c tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad9d55ccfe74ffb914f02030529523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ad9e4338314c269afb0cfcebe03584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:53:25.712881 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-e240cac4-3d07-4c22-9580-827a3be6879c tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/777aaf80-05b4-4e03-b329-084e9fda3e39" status: 200 len: 1307 microversion: 2.1 time: 0.106474 Oct 04 22:53:25.713475 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3242/7306] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:53:25 2022] GET /compute/v2.1/servers/777aaf80-05b4-4e03-b329-084e9fda3e39 => generated 1307 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:53:26.736044 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-a1823483-e4fc-48ce-b593-21e185c0ec93 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:53:26.736666 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-a1823483-e4fc-48ce-b593-21e185c0ec93 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: 777aaf80-05b4-4e03-b329-084e9fda3e39] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:53:26.745053 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a1823483-e4fc-48ce-b593-21e185c0ec93 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:53:26.745622 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a1823483-e4fc-48ce-b593-21e185c0ec93 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:53:26.746108 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a1823483-e4fc-48ce-b593-21e185c0ec93 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:53:26.746865 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a1823483-e4fc-48ce-b593-21e185c0ec93 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:53:26.747343 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a1823483-e4fc-48ce-b593-21e185c0ec93 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:53:26.748099 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a1823483-e4fc-48ce-b593-21e185c0ec93 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:53:26.886219 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-a1823483-e4fc-48ce-b593-21e185c0ec93 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad9d55ccfe74ffb914f02030529523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ad9e4338314c269afb0cfcebe03584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:53:26.894213 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-a1823483-e4fc-48ce-b593-21e185c0ec93 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/777aaf80-05b4-4e03-b329-084e9fda3e39" status: 200 len: 1363 microversion: 2.1 time: 0.162119 Oct 04 22:53:26.894849 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4065/7307] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:53:26 2022] GET /compute/v2.1/servers/777aaf80-05b4-4e03-b329-084e9fda3e39 => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:53:26.963336 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-b8744acc-a1a8-4348-ba93-393e419ed95c req-d27604ed-3f3f-4305-8d50-9dd151a09148 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "777aaf80-05b4-4e03-b329-084e9fda3e39", "tag": "c5b4e91f-9a61-4109-8ed0-499c66fe9dd6"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:53:26.974954 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-b8744acc-a1a8-4348-ba93-393e419ed95c req-d27604ed-3f3f-4305-8d50-9dd151a09148 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:53:26.975447 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-b8744acc-a1a8-4348-ba93-393e419ed95c req-d27604ed-3f3f-4305-8d50-9dd151a09148 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:53:26.975882 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-b8744acc-a1a8-4348-ba93-393e419ed95c req-d27604ed-3f3f-4305-8d50-9dd151a09148 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:53:26.987951 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-b8744acc-a1a8-4348-ba93-393e419ed95c req-d27604ed-3f3f-4305-8d50-9dd151a09148 service nova] Creating event network-changed:c5b4e91f-9a61-4109-8ed0-499c66fe9dd6 for instance 777aaf80-05b4-4e03-b329-084e9fda3e39 on n-h1-860284-1 Oct 04 22:53:26.993306 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-b8744acc-a1a8-4348-ba93-393e419ed95c req-d27604ed-3f3f-4305-8d50-9dd151a09148 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033547 Oct 04 22:53:26.993706 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3243/7308] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:53:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:53:27.919867 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-105a8235-5172-415c-98e7-fbd463ef50d7 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:53:27.920502 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-105a8235-5172-415c-98e7-fbd463ef50d7 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: 777aaf80-05b4-4e03-b329-084e9fda3e39] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:53:27.923341 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:53:27.929205 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-105a8235-5172-415c-98e7-fbd463ef50d7 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:53:27.929722 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-105a8235-5172-415c-98e7-fbd463ef50d7 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:53:27.930184 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-105a8235-5172-415c-98e7-fbd463ef50d7 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:53:27.930981 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-105a8235-5172-415c-98e7-fbd463ef50d7 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:53:27.931464 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-105a8235-5172-415c-98e7-fbd463ef50d7 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:53:27.931916 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-105a8235-5172-415c-98e7-fbd463ef50d7 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:53:28.063874 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-105a8235-5172-415c-98e7-fbd463ef50d7 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad9d55ccfe74ffb914f02030529523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ad9e4338314c269afb0cfcebe03584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:53:28.071745 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-105a8235-5172-415c-98e7-fbd463ef50d7 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/777aaf80-05b4-4e03-b329-084e9fda3e39" status: 200 len: 1363 microversion: 2.1 time: 0.156618 Oct 04 22:53:28.072335 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4066/7309] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:53:27 2022] GET /compute/v2.1/servers/777aaf80-05b4-4e03-b329-084e9fda3e39 => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:53:29.097425 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-5dab0337-af9b-444e-9884-fe5c46bb799a tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:53:29.098141 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-5dab0337-af9b-444e-9884-fe5c46bb799a tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: 777aaf80-05b4-4e03-b329-084e9fda3e39] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:53:29.100084 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=3 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:53:29.106118 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5dab0337-af9b-444e-9884-fe5c46bb799a tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:53:29.106636 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5dab0337-af9b-444e-9884-fe5c46bb799a tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:53:29.107078 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5dab0337-af9b-444e-9884-fe5c46bb799a tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:53:29.107778 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5dab0337-af9b-444e-9884-fe5c46bb799a tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:53:29.108238 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5dab0337-af9b-444e-9884-fe5c46bb799a tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:53:29.108672 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5dab0337-af9b-444e-9884-fe5c46bb799a tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:53:29.245367 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-5dab0337-af9b-444e-9884-fe5c46bb799a tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad9d55ccfe74ffb914f02030529523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ad9e4338314c269afb0cfcebe03584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:53:29.253357 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-5dab0337-af9b-444e-9884-fe5c46bb799a tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/777aaf80-05b4-4e03-b329-084e9fda3e39" status: 200 len: 1363 microversion: 2.1 time: 0.161285 Oct 04 22:53:29.253929 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3244/7310] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:53:29 2022] GET /compute/v2.1/servers/777aaf80-05b4-4e03-b329-084e9fda3e39 => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:53:30.277938 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-9fbcf175-39c2-4dcd-a374-e60ad10865cf tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:53:30.278595 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-9fbcf175-39c2-4dcd-a374-e60ad10865cf tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: 777aaf80-05b4-4e03-b329-084e9fda3e39] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:53:30.285545 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9fbcf175-39c2-4dcd-a374-e60ad10865cf tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:53:30.286040 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9fbcf175-39c2-4dcd-a374-e60ad10865cf tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:53:30.286530 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9fbcf175-39c2-4dcd-a374-e60ad10865cf tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:53:30.287234 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9fbcf175-39c2-4dcd-a374-e60ad10865cf tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:53:30.287704 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9fbcf175-39c2-4dcd-a374-e60ad10865cf tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:53:30.288145 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9fbcf175-39c2-4dcd-a374-e60ad10865cf tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:53:30.417591 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-9fbcf175-39c2-4dcd-a374-e60ad10865cf tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad9d55ccfe74ffb914f02030529523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ad9e4338314c269afb0cfcebe03584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:53:30.425283 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-9fbcf175-39c2-4dcd-a374-e60ad10865cf tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/777aaf80-05b4-4e03-b329-084e9fda3e39" status: 200 len: 1363 microversion: 2.1 time: 0.151783 Oct 04 22:53:30.425853 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4067/7311] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:53:30 2022] GET /compute/v2.1/servers/777aaf80-05b4-4e03-b329-084e9fda3e39 => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:53:31.449681 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-1a9447fc-e38d-4540-81f2-93dddfc6da6a tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:53:31.450212 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-1a9447fc-e38d-4540-81f2-93dddfc6da6a tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: 777aaf80-05b4-4e03-b329-084e9fda3e39] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:53:31.456935 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1a9447fc-e38d-4540-81f2-93dddfc6da6a tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:53:31.457417 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1a9447fc-e38d-4540-81f2-93dddfc6da6a tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:53:31.457847 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1a9447fc-e38d-4540-81f2-93dddfc6da6a tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:53:31.458559 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1a9447fc-e38d-4540-81f2-93dddfc6da6a tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:53:31.459010 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1a9447fc-e38d-4540-81f2-93dddfc6da6a tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:53:31.459436 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1a9447fc-e38d-4540-81f2-93dddfc6da6a tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:53:31.592242 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-1a9447fc-e38d-4540-81f2-93dddfc6da6a tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad9d55ccfe74ffb914f02030529523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ad9e4338314c269afb0cfcebe03584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:53:31.601078 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-1a9447fc-e38d-4540-81f2-93dddfc6da6a tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/777aaf80-05b4-4e03-b329-084e9fda3e39" status: 200 len: 1363 microversion: 2.1 time: 0.156059 Oct 04 22:53:31.601908 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3245/7312] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:53:31 2022] GET /compute/v2.1/servers/777aaf80-05b4-4e03-b329-084e9fda3e39 => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:53:32.625350 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-977f5ab2-cf78-4563-8d19-224b589e1123 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:53:32.625975 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-977f5ab2-cf78-4563-8d19-224b589e1123 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: 777aaf80-05b4-4e03-b329-084e9fda3e39] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:53:32.632928 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-977f5ab2-cf78-4563-8d19-224b589e1123 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:53:32.633482 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-977f5ab2-cf78-4563-8d19-224b589e1123 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:53:32.633936 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-977f5ab2-cf78-4563-8d19-224b589e1123 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:53:32.634674 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-977f5ab2-cf78-4563-8d19-224b589e1123 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:53:32.635141 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-977f5ab2-cf78-4563-8d19-224b589e1123 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:53:32.635609 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-977f5ab2-cf78-4563-8d19-224b589e1123 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:53:32.769623 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-977f5ab2-cf78-4563-8d19-224b589e1123 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad9d55ccfe74ffb914f02030529523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ad9e4338314c269afb0cfcebe03584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:53:32.777949 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-977f5ab2-cf78-4563-8d19-224b589e1123 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/777aaf80-05b4-4e03-b329-084e9fda3e39" status: 200 len: 1363 microversion: 2.1 time: 0.156590 Oct 04 22:53:32.778735 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4068/7313] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:53:32 2022] GET /compute/v2.1/servers/777aaf80-05b4-4e03-b329-084e9fda3e39 => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:53:33.690512 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-596340e1-10f5-44ef-a3b1-a597dc957f48 req-76d0f47b-69b9-45ab-8c1c-de0b28042497 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "777aaf80-05b4-4e03-b329-084e9fda3e39", "name": "network-vif-plugged", "status": "completed", "tag": "c5b4e91f-9a61-4109-8ed0-499c66fe9dd6"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:53:33.701369 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-596340e1-10f5-44ef-a3b1-a597dc957f48 req-76d0f47b-69b9-45ab-8c1c-de0b28042497 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:53:33.701845 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-596340e1-10f5-44ef-a3b1-a597dc957f48 req-76d0f47b-69b9-45ab-8c1c-de0b28042497 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:53:33.702901 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-596340e1-10f5-44ef-a3b1-a597dc957f48 req-76d0f47b-69b9-45ab-8c1c-de0b28042497 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:53:33.714232 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-596340e1-10f5-44ef-a3b1-a597dc957f48 req-76d0f47b-69b9-45ab-8c1c-de0b28042497 service nova] Creating event network-vif-plugged:c5b4e91f-9a61-4109-8ed0-499c66fe9dd6 for instance 777aaf80-05b4-4e03-b329-084e9fda3e39 on n-h1-860284-1 Oct 04 22:53:33.719992 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-596340e1-10f5-44ef-a3b1-a597dc957f48 req-76d0f47b-69b9-45ab-8c1c-de0b28042497 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033266 Oct 04 22:53:33.720759 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3246/7314] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:53:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:53:33.801656 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-4ecfa210-5d50-4571-8152-362e6ed8cd61 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:53:33.802224 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-4ecfa210-5d50-4571-8152-362e6ed8cd61 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: 777aaf80-05b4-4e03-b329-084e9fda3e39] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:53:33.809210 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4ecfa210-5d50-4571-8152-362e6ed8cd61 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:53:33.809782 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4ecfa210-5d50-4571-8152-362e6ed8cd61 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:53:33.810358 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4ecfa210-5d50-4571-8152-362e6ed8cd61 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:53:33.811186 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4ecfa210-5d50-4571-8152-362e6ed8cd61 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:53:33.811658 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4ecfa210-5d50-4571-8152-362e6ed8cd61 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:53:33.812094 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4ecfa210-5d50-4571-8152-362e6ed8cd61 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:53:33.942981 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-4ecfa210-5d50-4571-8152-362e6ed8cd61 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad9d55ccfe74ffb914f02030529523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ad9e4338314c269afb0cfcebe03584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:53:33.950867 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-4ecfa210-5d50-4571-8152-362e6ed8cd61 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/777aaf80-05b4-4e03-b329-084e9fda3e39" status: 200 len: 1363 microversion: 2.1 time: 0.153221 Oct 04 22:53:33.951448 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4069/7315] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:53:33 2022] GET /compute/v2.1/servers/777aaf80-05b4-4e03-b329-084e9fda3e39 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:53:34.975581 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-fcb70c25-8a07-4a81-af6d-8911332c6045 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:53:34.976281 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-fcb70c25-8a07-4a81-af6d-8911332c6045 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: 777aaf80-05b4-4e03-b329-084e9fda3e39] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:53:34.978297 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell0:SELECT=2 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:53:34.979005 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell0:SELECT=6 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:53:34.986934 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fcb70c25-8a07-4a81-af6d-8911332c6045 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:53:34.987413 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fcb70c25-8a07-4a81-af6d-8911332c6045 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:53:34.987845 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fcb70c25-8a07-4a81-af6d-8911332c6045 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:53:34.988534 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fcb70c25-8a07-4a81-af6d-8911332c6045 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:53:34.988981 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fcb70c25-8a07-4a81-af6d-8911332c6045 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:53:34.989406 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fcb70c25-8a07-4a81-af6d-8911332c6045 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:53:35.124432 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-fcb70c25-8a07-4a81-af6d-8911332c6045 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad9d55ccfe74ffb914f02030529523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ad9e4338314c269afb0cfcebe03584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:53:35.132374 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-fcb70c25-8a07-4a81-af6d-8911332c6045 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/777aaf80-05b4-4e03-b329-084e9fda3e39" status: 200 len: 1363 microversion: 2.1 time: 0.160990 Oct 04 22:53:35.132979 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3247/7316] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:53:34 2022] GET /compute/v2.1/servers/777aaf80-05b4-4e03-b329-084e9fda3e39 => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:53:36.155763 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-738794e5-527c-488d-ae27-a8140551e53f tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:53:36.156397 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-738794e5-527c-488d-ae27-a8140551e53f tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: 777aaf80-05b4-4e03-b329-084e9fda3e39] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:53:36.158301 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=2 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:53:36.164431 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-738794e5-527c-488d-ae27-a8140551e53f tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:53:36.164930 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-738794e5-527c-488d-ae27-a8140551e53f tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:53:36.165384 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-738794e5-527c-488d-ae27-a8140551e53f tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:53:36.166093 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-738794e5-527c-488d-ae27-a8140551e53f tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:53:36.166620 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-738794e5-527c-488d-ae27-a8140551e53f tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:53:36.167064 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-738794e5-527c-488d-ae27-a8140551e53f tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:53:36.307184 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-738794e5-527c-488d-ae27-a8140551e53f tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad9d55ccfe74ffb914f02030529523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ad9e4338314c269afb0cfcebe03584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:53:36.316133 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-738794e5-527c-488d-ae27-a8140551e53f tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/777aaf80-05b4-4e03-b329-084e9fda3e39" status: 200 len: 1547 microversion: 2.1 time: 0.164434 Oct 04 22:53:36.316710 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4070/7317] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:53:36 2022] GET /compute/v2.1/servers/777aaf80-05b4-4e03-b329-084e9fda3e39 => generated 1547 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:53:36.339143 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-095b3c9d-03a8-4958-8465-3dc417981c35 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:53:36.339639 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-095b3c9d-03a8-4958-8465-3dc417981c35 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: 777aaf80-05b4-4e03-b329-084e9fda3e39] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:53:36.346503 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-095b3c9d-03a8-4958-8465-3dc417981c35 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:53:36.346997 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-095b3c9d-03a8-4958-8465-3dc417981c35 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:53:36.347439 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-095b3c9d-03a8-4958-8465-3dc417981c35 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:53:36.348133 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-095b3c9d-03a8-4958-8465-3dc417981c35 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:53:36.348590 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-095b3c9d-03a8-4958-8465-3dc417981c35 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:53:36.349019 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-095b3c9d-03a8-4958-8465-3dc417981c35 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:53:36.426736 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-095b3c9d-03a8-4958-8465-3dc417981c35 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/777aaf80-05b4-4e03-b329-084e9fda3e39/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091443 Oct 04 22:53:36.427355 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3248/7318] 10.222.0.43 () {58 vars in 1275 bytes} [Tue Oct 4 22:53:36 2022] GET /compute/v2.1/servers/777aaf80-05b4-4e03-b329-084e9fda3e39/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:53:37.639663 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-ef18a7eb-ab4e-4bb8-8640-834d6054181a req-f5e0c64b-6d09-40a4-a16d-913263259917 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "777aaf80-05b4-4e03-b329-084e9fda3e39", "tag": "c5b4e91f-9a61-4109-8ed0-499c66fe9dd6"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:53:37.650331 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-ef18a7eb-ab4e-4bb8-8640-834d6054181a req-f5e0c64b-6d09-40a4-a16d-913263259917 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:53:37.650861 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-ef18a7eb-ab4e-4bb8-8640-834d6054181a req-f5e0c64b-6d09-40a4-a16d-913263259917 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:53:37.651312 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-ef18a7eb-ab4e-4bb8-8640-834d6054181a req-f5e0c64b-6d09-40a4-a16d-913263259917 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:53:37.663207 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-ef18a7eb-ab4e-4bb8-8640-834d6054181a req-f5e0c64b-6d09-40a4-a16d-913263259917 service nova] Creating event network-changed:c5b4e91f-9a61-4109-8ed0-499c66fe9dd6 for instance 777aaf80-05b4-4e03-b329-084e9fda3e39 on n-h1-860284-1 Oct 04 22:53:37.668302 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-ef18a7eb-ab4e-4bb8-8640-834d6054181a req-f5e0c64b-6d09-40a4-a16d-913263259917 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032772 Oct 04 22:53:37.669653 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4071/7319] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:53:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:54:49.705636 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_api:SELECT=9 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:54:49.706507 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=45 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:54:49.707339 n-d-860284-1 devstack@n-api.service[134102]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 22:54:49.707604 n-d-860284-1 devstack@n-api.service[134102]: Tue Oct 4 22:54:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/777aaf80-05b4-4e03-b329-084e9fda3e39/action (ip 10.222.0.43) !!! Oct 04 22:54:49.714288 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-fd3de954-f49b-4c09-9823-efffbf9aae82 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:54:49.721551 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fd3de954-f49b-4c09-9823-efffbf9aae82 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:54:49.722038 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fd3de954-f49b-4c09-9823-efffbf9aae82 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:54:49.722513 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fd3de954-f49b-4c09-9823-efffbf9aae82 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:54:49.745429 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-fd3de954-f49b-4c09-9823-efffbf9aae82 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: 777aaf80-05b4-4e03-b329-084e9fda3e39] Going to try to stop instance {{(pid=134102) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 04 22:54:49.786220 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-fd3de954-f49b-4c09-9823-efffbf9aae82 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "POST /compute/v2.1/servers/777aaf80-05b4-4e03-b329-084e9fda3e39/action" status: 202 len: 0 microversion: 2.1 time: 0.082788 Oct 04 22:54:49.786860 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3249/7320] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 22:54:49 2022] POST /compute/v2.1/servers/777aaf80-05b4-4e03-b329-084e9fda3e39/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 22:54:49.794699 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=11 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:54:49.795598 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=53,nova_cell1:INSERT=1 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:54:49.800413 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-8c0d5526-291d-4ecf-b475-fa1037921341 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:54:49.800985 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-8c0d5526-291d-4ecf-b475-fa1037921341 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: 777aaf80-05b4-4e03-b329-084e9fda3e39] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:54:49.808629 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8c0d5526-291d-4ecf-b475-fa1037921341 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:54:49.809163 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8c0d5526-291d-4ecf-b475-fa1037921341 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:54:49.810261 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8c0d5526-291d-4ecf-b475-fa1037921341 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:54:49.811142 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8c0d5526-291d-4ecf-b475-fa1037921341 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:54:49.811627 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8c0d5526-291d-4ecf-b475-fa1037921341 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:54:49.812081 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8c0d5526-291d-4ecf-b475-fa1037921341 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:54:49.947079 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-8c0d5526-291d-4ecf-b475-fa1037921341 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad9d55ccfe74ffb914f02030529523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ad9e4338314c269afb0cfcebe03584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:54:49.954933 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-8c0d5526-291d-4ecf-b475-fa1037921341 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/777aaf80-05b4-4e03-b329-084e9fda3e39" status: 200 len: 1676 microversion: 2.1 time: 0.163537 Oct 04 22:54:49.955538 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4072/7321] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:54:49 2022] GET /compute/v2.1/servers/777aaf80-05b4-4e03-b329-084e9fda3e39 => generated 1676 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:54:50.979703 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-c0ab51d9-770f-4163-b22c-978c251c54ab tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:54:50.980419 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-c0ab51d9-770f-4163-b22c-978c251c54ab tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: 777aaf80-05b4-4e03-b329-084e9fda3e39] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:54:50.986866 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c0ab51d9-770f-4163-b22c-978c251c54ab tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:54:50.987356 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c0ab51d9-770f-4163-b22c-978c251c54ab tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:54:50.987875 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c0ab51d9-770f-4163-b22c-978c251c54ab tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:54:50.988522 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c0ab51d9-770f-4163-b22c-978c251c54ab tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:54:50.988984 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c0ab51d9-770f-4163-b22c-978c251c54ab tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:54:50.989417 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c0ab51d9-770f-4163-b22c-978c251c54ab tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:54:51.119696 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-c0ab51d9-770f-4163-b22c-978c251c54ab tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad9d55ccfe74ffb914f02030529523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ad9e4338314c269afb0cfcebe03584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:54:51.129575 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-c0ab51d9-770f-4163-b22c-978c251c54ab tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/777aaf80-05b4-4e03-b329-084e9fda3e39" status: 200 len: 1676 microversion: 2.1 time: 0.155020 Oct 04 22:54:51.132967 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3250/7322] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:54:50 2022] GET /compute/v2.1/servers/777aaf80-05b4-4e03-b329-084e9fda3e39 => generated 1676 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:54:52.156344 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-b4d2f302-c70a-4d6d-bfc8-33423609c5c5 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:54:52.156975 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-b4d2f302-c70a-4d6d-bfc8-33423609c5c5 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: 777aaf80-05b4-4e03-b329-084e9fda3e39] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:54:52.163816 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b4d2f302-c70a-4d6d-bfc8-33423609c5c5 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:54:52.164318 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b4d2f302-c70a-4d6d-bfc8-33423609c5c5 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:54:52.164769 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b4d2f302-c70a-4d6d-bfc8-33423609c5c5 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:54:52.165469 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b4d2f302-c70a-4d6d-bfc8-33423609c5c5 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:54:52.165962 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b4d2f302-c70a-4d6d-bfc8-33423609c5c5 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:54:52.166428 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b4d2f302-c70a-4d6d-bfc8-33423609c5c5 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:54:52.299257 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-b4d2f302-c70a-4d6d-bfc8-33423609c5c5 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad9d55ccfe74ffb914f02030529523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ad9e4338314c269afb0cfcebe03584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:54:52.307077 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-b4d2f302-c70a-4d6d-bfc8-33423609c5c5 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/777aaf80-05b4-4e03-b329-084e9fda3e39" status: 200 len: 1676 microversion: 2.1 time: 0.155452 Oct 04 22:54:52.307652 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4073/7323] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:54:52 2022] GET /compute/v2.1/servers/777aaf80-05b4-4e03-b329-084e9fda3e39 => generated 1676 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:54:53.330791 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-f671cef1-c28b-4081-92e8-54052e0098b5 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:54:53.331416 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-f671cef1-c28b-4081-92e8-54052e0098b5 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: 777aaf80-05b4-4e03-b329-084e9fda3e39] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:54:53.338388 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f671cef1-c28b-4081-92e8-54052e0098b5 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:54:53.338882 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f671cef1-c28b-4081-92e8-54052e0098b5 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:54:53.339324 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f671cef1-c28b-4081-92e8-54052e0098b5 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:54:53.340018 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f671cef1-c28b-4081-92e8-54052e0098b5 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:54:53.340477 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f671cef1-c28b-4081-92e8-54052e0098b5 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:54:53.341631 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f671cef1-c28b-4081-92e8-54052e0098b5 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:54:53.474198 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-f671cef1-c28b-4081-92e8-54052e0098b5 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad9d55ccfe74ffb914f02030529523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ad9e4338314c269afb0cfcebe03584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:54:53.482403 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-f671cef1-c28b-4081-92e8-54052e0098b5 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/777aaf80-05b4-4e03-b329-084e9fda3e39" status: 200 len: 1676 microversion: 2.1 time: 0.155590 Oct 04 22:54:53.482990 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3251/7324] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:54:53 2022] GET /compute/v2.1/servers/777aaf80-05b4-4e03-b329-084e9fda3e39 => generated 1676 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:54:54.505346 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-eef115fe-8734-4b3f-b802-fa500bf39838 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:54:54.505909 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-eef115fe-8734-4b3f-b802-fa500bf39838 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: 777aaf80-05b4-4e03-b329-084e9fda3e39] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:54:54.514779 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-eef115fe-8734-4b3f-b802-fa500bf39838 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:54:54.515287 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-eef115fe-8734-4b3f-b802-fa500bf39838 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:54:54.515745 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-eef115fe-8734-4b3f-b802-fa500bf39838 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:54:54.516463 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-eef115fe-8734-4b3f-b802-fa500bf39838 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:54:54.516934 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-eef115fe-8734-4b3f-b802-fa500bf39838 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:54:54.517378 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-eef115fe-8734-4b3f-b802-fa500bf39838 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:54:54.654112 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-eef115fe-8734-4b3f-b802-fa500bf39838 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad9d55ccfe74ffb914f02030529523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ad9e4338314c269afb0cfcebe03584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:54:54.662863 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-eef115fe-8734-4b3f-b802-fa500bf39838 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/777aaf80-05b4-4e03-b329-084e9fda3e39" status: 200 len: 1676 microversion: 2.1 time: 0.161537 Oct 04 22:54:54.663454 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4074/7325] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:54:54 2022] GET /compute/v2.1/servers/777aaf80-05b4-4e03-b329-084e9fda3e39 => generated 1676 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:54:55.685289 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-6cd12d38-4f8e-4419-b2d6-477dfb7e85d4 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:54:55.685841 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-6cd12d38-4f8e-4419-b2d6-477dfb7e85d4 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: 777aaf80-05b4-4e03-b329-084e9fda3e39] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:54:55.692270 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6cd12d38-4f8e-4419-b2d6-477dfb7e85d4 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:54:55.692751 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6cd12d38-4f8e-4419-b2d6-477dfb7e85d4 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:54:55.693187 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6cd12d38-4f8e-4419-b2d6-477dfb7e85d4 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:54:55.693873 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6cd12d38-4f8e-4419-b2d6-477dfb7e85d4 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:54:55.694324 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6cd12d38-4f8e-4419-b2d6-477dfb7e85d4 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:54:55.694770 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6cd12d38-4f8e-4419-b2d6-477dfb7e85d4 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:54:55.826292 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-6cd12d38-4f8e-4419-b2d6-477dfb7e85d4 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad9d55ccfe74ffb914f02030529523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ad9e4338314c269afb0cfcebe03584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:54:55.834048 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-6cd12d38-4f8e-4419-b2d6-477dfb7e85d4 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/777aaf80-05b4-4e03-b329-084e9fda3e39" status: 200 len: 1676 microversion: 2.1 time: 0.152895 Oct 04 22:54:55.834673 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3252/7326] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:54:55 2022] GET /compute/v2.1/servers/777aaf80-05b4-4e03-b329-084e9fda3e39 => generated 1676 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:54:56.857564 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-46e807d7-71a0-4328-a45e-6a6325ec9cbd tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:54:56.858188 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-46e807d7-71a0-4328-a45e-6a6325ec9cbd tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: 777aaf80-05b4-4e03-b329-084e9fda3e39] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:54:56.865094 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-46e807d7-71a0-4328-a45e-6a6325ec9cbd tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:54:56.865598 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-46e807d7-71a0-4328-a45e-6a6325ec9cbd tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:54:56.866068 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-46e807d7-71a0-4328-a45e-6a6325ec9cbd tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:54:56.866812 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-46e807d7-71a0-4328-a45e-6a6325ec9cbd tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:54:56.867293 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-46e807d7-71a0-4328-a45e-6a6325ec9cbd tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:54:56.867743 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-46e807d7-71a0-4328-a45e-6a6325ec9cbd tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:54:56.995704 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-46e807d7-71a0-4328-a45e-6a6325ec9cbd tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad9d55ccfe74ffb914f02030529523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ad9e4338314c269afb0cfcebe03584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:54:57.004163 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-46e807d7-71a0-4328-a45e-6a6325ec9cbd tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/777aaf80-05b4-4e03-b329-084e9fda3e39" status: 200 len: 1676 microversion: 2.1 time: 0.150729 Oct 04 22:54:57.004755 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4075/7327] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:54:56 2022] GET /compute/v2.1/servers/777aaf80-05b4-4e03-b329-084e9fda3e39 => generated 1676 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:54:58.028864 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-019720b2-9a98-4871-b626-e48e81ace121 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:54:58.029505 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-019720b2-9a98-4871-b626-e48e81ace121 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: 777aaf80-05b4-4e03-b329-084e9fda3e39] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:54:58.036265 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-019720b2-9a98-4871-b626-e48e81ace121 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:54:58.036756 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-019720b2-9a98-4871-b626-e48e81ace121 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:54:58.037223 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-019720b2-9a98-4871-b626-e48e81ace121 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:54:58.037961 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-019720b2-9a98-4871-b626-e48e81ace121 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:54:58.038481 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-019720b2-9a98-4871-b626-e48e81ace121 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:54:58.038939 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-019720b2-9a98-4871-b626-e48e81ace121 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:54:58.168022 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-019720b2-9a98-4871-b626-e48e81ace121 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad9d55ccfe74ffb914f02030529523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ad9e4338314c269afb0cfcebe03584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:54:58.176041 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-019720b2-9a98-4871-b626-e48e81ace121 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/777aaf80-05b4-4e03-b329-084e9fda3e39" status: 200 len: 1676 microversion: 2.1 time: 0.151847 Oct 04 22:54:58.176620 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3253/7328] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:54:58 2022] GET /compute/v2.1/servers/777aaf80-05b4-4e03-b329-084e9fda3e39 => generated 1676 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:54:59.199509 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-fef35cc2-2bad-4df6-89ab-0a05a46d1d2c tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:54:59.200258 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-fef35cc2-2bad-4df6-89ab-0a05a46d1d2c tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: 777aaf80-05b4-4e03-b329-084e9fda3e39] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:54:59.207547 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fef35cc2-2bad-4df6-89ab-0a05a46d1d2c tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:54:59.208101 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fef35cc2-2bad-4df6-89ab-0a05a46d1d2c tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:54:59.208579 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fef35cc2-2bad-4df6-89ab-0a05a46d1d2c tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:54:59.209355 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fef35cc2-2bad-4df6-89ab-0a05a46d1d2c tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:54:59.209854 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fef35cc2-2bad-4df6-89ab-0a05a46d1d2c tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:54:59.210320 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fef35cc2-2bad-4df6-89ab-0a05a46d1d2c tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:54:59.345116 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-fef35cc2-2bad-4df6-89ab-0a05a46d1d2c tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad9d55ccfe74ffb914f02030529523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ad9e4338314c269afb0cfcebe03584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:54:59.352904 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-fef35cc2-2bad-4df6-89ab-0a05a46d1d2c tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/777aaf80-05b4-4e03-b329-084e9fda3e39" status: 200 len: 1676 microversion: 2.1 time: 0.157644 Oct 04 22:54:59.353475 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4076/7329] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:54:59 2022] GET /compute/v2.1/servers/777aaf80-05b4-4e03-b329-084e9fda3e39 => generated 1676 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:55:00.377124 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-16d33f5a-4f91-4749-814c-980ff57aeee5 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:55:00.377736 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-16d33f5a-4f91-4749-814c-980ff57aeee5 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: 777aaf80-05b4-4e03-b329-084e9fda3e39] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:55:00.384641 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-16d33f5a-4f91-4749-814c-980ff57aeee5 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:55:00.385069 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-16d33f5a-4f91-4749-814c-980ff57aeee5 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:55:00.385505 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-16d33f5a-4f91-4749-814c-980ff57aeee5 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:55:00.386191 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-16d33f5a-4f91-4749-814c-980ff57aeee5 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:55:00.386681 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-16d33f5a-4f91-4749-814c-980ff57aeee5 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:55:00.387118 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-16d33f5a-4f91-4749-814c-980ff57aeee5 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:55:00.522076 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-16d33f5a-4f91-4749-814c-980ff57aeee5 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad9d55ccfe74ffb914f02030529523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ad9e4338314c269afb0cfcebe03584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:55:00.530510 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-16d33f5a-4f91-4749-814c-980ff57aeee5 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/777aaf80-05b4-4e03-b329-084e9fda3e39" status: 200 len: 1653 microversion: 2.1 time: 0.157290 Oct 04 22:55:00.531101 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3254/7330] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:55:00 2022] GET /compute/v2.1/servers/777aaf80-05b4-4e03-b329-084e9fda3e39 => generated 1653 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:55:00.554881 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-315c9de4-04a9-47c0-9a5c-b4e110dfa288 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:55:00.557303 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-315c9de4-04a9-47c0-9a5c-b4e110dfa288 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: 777aaf80-05b4-4e03-b329-084e9fda3e39] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:55:00.564796 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-315c9de4-04a9-47c0-9a5c-b4e110dfa288 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:55:00.565307 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-315c9de4-04a9-47c0-9a5c-b4e110dfa288 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:55:00.565767 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-315c9de4-04a9-47c0-9a5c-b4e110dfa288 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:55:00.566508 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-315c9de4-04a9-47c0-9a5c-b4e110dfa288 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:55:00.566982 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-315c9de4-04a9-47c0-9a5c-b4e110dfa288 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:55:00.567427 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-315c9de4-04a9-47c0-9a5c-b4e110dfa288 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:55:00.596263 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-315c9de4-04a9-47c0-9a5c-b4e110dfa288 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'aad9d55ccfe74ffb914f02030529523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ad9e4338314c269afb0cfcebe03584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:55:00.602309 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-315c9de4-04a9-47c0-9a5c-b4e110dfa288 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: 777aaf80-05b4-4e03-b329-084e9fda3e39] Old instance type m1.heat2, new instance type m1.heat {{(pid=134101) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 04 22:55:00.610246 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-315c9de4-04a9-47c0-9a5c-b4e110dfa288 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Flavor limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 22:55:00.610718 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-315c9de4-04a9-47c0-9a5c-b4e110dfa288 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Image limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 22:55:00.611229 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-315c9de4-04a9-47c0-9a5c-b4e110dfa288 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Flavor pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 22:55:00.611652 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-315c9de4-04a9-47c0-9a5c-b4e110dfa288 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Image pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 22:55:00.612086 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-315c9de4-04a9-47c0-9a5c-b4e110dfa288 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 22:55:00.677934 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-315c9de4-04a9-47c0-9a5c-b4e110dfa288 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "POST /compute/v2.1/servers/777aaf80-05b4-4e03-b329-084e9fda3e39/action" status: 202 len: 0 microversion: 2.1 time: 0.127014 Oct 04 22:55:00.681677 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4077/7331] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 22:55:00 2022] POST /compute/v2.1/servers/777aaf80-05b4-4e03-b329-084e9fda3e39/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 22:55:00.686920 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-4aa9ecf7-eec3-4e39-8be1-29be56f965d9 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:55:00.687682 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-4aa9ecf7-eec3-4e39-8be1-29be56f965d9 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: 777aaf80-05b4-4e03-b329-084e9fda3e39] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:55:00.693764 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4aa9ecf7-eec3-4e39-8be1-29be56f965d9 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:55:00.694948 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4aa9ecf7-eec3-4e39-8be1-29be56f965d9 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:55:00.694948 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4aa9ecf7-eec3-4e39-8be1-29be56f965d9 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:55:00.695672 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4aa9ecf7-eec3-4e39-8be1-29be56f965d9 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:55:00.696374 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4aa9ecf7-eec3-4e39-8be1-29be56f965d9 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:55:00.696886 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4aa9ecf7-eec3-4e39-8be1-29be56f965d9 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:55:00.921564 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-4aa9ecf7-eec3-4e39-8be1-29be56f965d9 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad9d55ccfe74ffb914f02030529523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ad9e4338314c269afb0cfcebe03584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:55:00.929701 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-4aa9ecf7-eec3-4e39-8be1-29be56f965d9 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/777aaf80-05b4-4e03-b329-084e9fda3e39" status: 200 len: 1676 microversion: 2.1 time: 0.246688 Oct 04 22:55:00.930309 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3255/7332] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:55:00 2022] GET /compute/v2.1/servers/777aaf80-05b4-4e03-b329-084e9fda3e39 => generated 1676 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:55:01.955042 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-ea93fb85-d604-48b4-86aa-df33155d4731 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:55:01.955672 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-ea93fb85-d604-48b4-86aa-df33155d4731 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: 777aaf80-05b4-4e03-b329-084e9fda3e39] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:55:01.966098 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ea93fb85-d604-48b4-86aa-df33155d4731 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:55:01.966731 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ea93fb85-d604-48b4-86aa-df33155d4731 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:55:01.967184 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ea93fb85-d604-48b4-86aa-df33155d4731 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:55:01.967892 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ea93fb85-d604-48b4-86aa-df33155d4731 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:55:01.968360 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ea93fb85-d604-48b4-86aa-df33155d4731 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:55:01.968802 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ea93fb85-d604-48b4-86aa-df33155d4731 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:55:02.108109 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-ea93fb85-d604-48b4-86aa-df33155d4731 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad9d55ccfe74ffb914f02030529523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ad9e4338314c269afb0cfcebe03584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:55:02.115915 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-ea93fb85-d604-48b4-86aa-df33155d4731 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/777aaf80-05b4-4e03-b329-084e9fda3e39" status: 200 len: 1676 microversion: 2.1 time: 0.166235 Oct 04 22:55:02.116489 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4078/7333] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:55:01 2022] GET /compute/v2.1/servers/777aaf80-05b4-4e03-b329-084e9fda3e39 => generated 1676 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:55:03.141645 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-3649cf2b-e686-4cf6-b2d8-d71e190dafaa tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:55:03.142266 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-3649cf2b-e686-4cf6-b2d8-d71e190dafaa tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: 777aaf80-05b4-4e03-b329-084e9fda3e39] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:55:03.149095 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3649cf2b-e686-4cf6-b2d8-d71e190dafaa tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:55:03.149581 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3649cf2b-e686-4cf6-b2d8-d71e190dafaa tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:55:03.150024 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3649cf2b-e686-4cf6-b2d8-d71e190dafaa tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:55:03.150743 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3649cf2b-e686-4cf6-b2d8-d71e190dafaa tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:55:03.151205 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3649cf2b-e686-4cf6-b2d8-d71e190dafaa tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:55:03.151636 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3649cf2b-e686-4cf6-b2d8-d71e190dafaa tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:55:03.283726 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-3649cf2b-e686-4cf6-b2d8-d71e190dafaa tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad9d55ccfe74ffb914f02030529523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ad9e4338314c269afb0cfcebe03584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:55:03.291565 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-3649cf2b-e686-4cf6-b2d8-d71e190dafaa tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/777aaf80-05b4-4e03-b329-084e9fda3e39" status: 200 len: 1681 microversion: 2.1 time: 0.154515 Oct 04 22:55:03.292138 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3256/7334] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:55:03 2022] GET /compute/v2.1/servers/777aaf80-05b4-4e03-b329-084e9fda3e39 => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:55:04.316242 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-de6954fb-28f9-4adb-9580-38a0632cf0d0 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:55:04.316877 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-de6954fb-28f9-4adb-9580-38a0632cf0d0 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: 777aaf80-05b4-4e03-b329-084e9fda3e39] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:55:04.323835 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-de6954fb-28f9-4adb-9580-38a0632cf0d0 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:55:04.324326 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-de6954fb-28f9-4adb-9580-38a0632cf0d0 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:55:04.324779 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-de6954fb-28f9-4adb-9580-38a0632cf0d0 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:55:04.325561 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-de6954fb-28f9-4adb-9580-38a0632cf0d0 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:55:04.326030 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-de6954fb-28f9-4adb-9580-38a0632cf0d0 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:55:04.326491 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-de6954fb-28f9-4adb-9580-38a0632cf0d0 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:55:04.455490 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-de6954fb-28f9-4adb-9580-38a0632cf0d0 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad9d55ccfe74ffb914f02030529523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ad9e4338314c269afb0cfcebe03584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:55:04.463550 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-de6954fb-28f9-4adb-9580-38a0632cf0d0 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/777aaf80-05b4-4e03-b329-084e9fda3e39" status: 200 len: 1681 microversion: 2.1 time: 0.151261 Oct 04 22:55:04.464368 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4079/7335] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:55:04 2022] GET /compute/v2.1/servers/777aaf80-05b4-4e03-b329-084e9fda3e39 => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:55:05.035765 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-79cb3e20-f41a-460a-836d-2060480cdbff req-061e19e5-3d29-46de-bbac-11a6e16f8fd5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "777aaf80-05b4-4e03-b329-084e9fda3e39", "name": "network-vif-unplugged", "status": "completed", "tag": "c5b4e91f-9a61-4109-8ed0-499c66fe9dd6"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:55:05.047117 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-79cb3e20-f41a-460a-836d-2060480cdbff req-061e19e5-3d29-46de-bbac-11a6e16f8fd5 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:55:05.047614 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-79cb3e20-f41a-460a-836d-2060480cdbff req-061e19e5-3d29-46de-bbac-11a6e16f8fd5 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:55:05.048054 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-79cb3e20-f41a-460a-836d-2060480cdbff req-061e19e5-3d29-46de-bbac-11a6e16f8fd5 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:55:05.060706 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-79cb3e20-f41a-460a-836d-2060480cdbff req-061e19e5-3d29-46de-bbac-11a6e16f8fd5 service nova] Creating event network-vif-unplugged:c5b4e91f-9a61-4109-8ed0-499c66fe9dd6 for instance 777aaf80-05b4-4e03-b329-084e9fda3e39 on n-h2-860284-1 Oct 04 22:55:05.066162 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [req-79cb3e20-f41a-460a-836d-2060480cdbff req-061e19e5-3d29-46de-bbac-11a6e16f8fd5 service nova] Instance 777aaf80-05b4-4e03-b329-084e9fda3e39 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860284-1', 'n-h2-860284-1'} {{(pid=134102) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 22:55:05.079208 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-79cb3e20-f41a-460a-836d-2060480cdbff req-061e19e5-3d29-46de-bbac-11a6e16f8fd5 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047234 Oct 04 22:55:05.080022 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3257/7336] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:55:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:55:05.487612 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-4b28c412-4aaa-459f-b7d4-afaeea4994fd tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:55:05.488269 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-4b28c412-4aaa-459f-b7d4-afaeea4994fd tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: 777aaf80-05b4-4e03-b329-084e9fda3e39] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:55:05.495178 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4b28c412-4aaa-459f-b7d4-afaeea4994fd tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:55:05.495681 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4b28c412-4aaa-459f-b7d4-afaeea4994fd tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:55:05.496140 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4b28c412-4aaa-459f-b7d4-afaeea4994fd tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:55:05.496890 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4b28c412-4aaa-459f-b7d4-afaeea4994fd tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:55:05.497721 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4b28c412-4aaa-459f-b7d4-afaeea4994fd tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:55:05.498172 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4b28c412-4aaa-459f-b7d4-afaeea4994fd tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:55:05.632532 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-4b28c412-4aaa-459f-b7d4-afaeea4994fd tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad9d55ccfe74ffb914f02030529523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ad9e4338314c269afb0cfcebe03584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:55:05.640988 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-4b28c412-4aaa-459f-b7d4-afaeea4994fd tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/777aaf80-05b4-4e03-b329-084e9fda3e39" status: 200 len: 1680 microversion: 2.1 time: 0.157319 Oct 04 22:55:05.641580 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4080/7337] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:55:05 2022] GET /compute/v2.1/servers/777aaf80-05b4-4e03-b329-084e9fda3e39 => generated 1680 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:55:06.665786 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-4036032f-a053-4680-87ad-3e76bec201fb tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:55:06.666550 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-4036032f-a053-4680-87ad-3e76bec201fb tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: 777aaf80-05b4-4e03-b329-084e9fda3e39] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:55:06.673554 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4036032f-a053-4680-87ad-3e76bec201fb tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:55:06.674038 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4036032f-a053-4680-87ad-3e76bec201fb tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:55:06.674510 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4036032f-a053-4680-87ad-3e76bec201fb tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:55:06.675209 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4036032f-a053-4680-87ad-3e76bec201fb tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:55:06.675672 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4036032f-a053-4680-87ad-3e76bec201fb tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:55:06.676111 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4036032f-a053-4680-87ad-3e76bec201fb tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:55:06.805470 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-4036032f-a053-4680-87ad-3e76bec201fb tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad9d55ccfe74ffb914f02030529523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ad9e4338314c269afb0cfcebe03584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:55:06.813654 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-4036032f-a053-4680-87ad-3e76bec201fb tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/777aaf80-05b4-4e03-b329-084e9fda3e39" status: 200 len: 1678 microversion: 2.1 time: 0.152157 Oct 04 22:55:06.814229 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3258/7338] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:55:06 2022] GET /compute/v2.1/servers/777aaf80-05b4-4e03-b329-084e9fda3e39 => generated 1678 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:55:07.114279 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-54ccc360-3ea8-49c7-8ea6-9e4fd48d8241 req-d4443d89-ed33-4d61-b6f5-478937db3237 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "777aaf80-05b4-4e03-b329-084e9fda3e39", "tag": "c5b4e91f-9a61-4109-8ed0-499c66fe9dd6"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:55:07.126046 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-54ccc360-3ea8-49c7-8ea6-9e4fd48d8241 req-d4443d89-ed33-4d61-b6f5-478937db3237 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:55:07.126579 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-54ccc360-3ea8-49c7-8ea6-9e4fd48d8241 req-d4443d89-ed33-4d61-b6f5-478937db3237 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:55:07.127030 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-54ccc360-3ea8-49c7-8ea6-9e4fd48d8241 req-d4443d89-ed33-4d61-b6f5-478937db3237 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:55:07.138972 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-54ccc360-3ea8-49c7-8ea6-9e4fd48d8241 req-d4443d89-ed33-4d61-b6f5-478937db3237 service nova] Creating event network-changed:c5b4e91f-9a61-4109-8ed0-499c66fe9dd6 for instance 777aaf80-05b4-4e03-b329-084e9fda3e39 on n-h2-860284-1 Oct 04 22:55:07.144432 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [req-54ccc360-3ea8-49c7-8ea6-9e4fd48d8241 req-d4443d89-ed33-4d61-b6f5-478937db3237 service nova] Instance 777aaf80-05b4-4e03-b329-084e9fda3e39 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860284-1', 'n-h2-860284-1'} {{(pid=134101) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 22:55:07.155129 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-54ccc360-3ea8-49c7-8ea6-9e4fd48d8241 req-d4443d89-ed33-4d61-b6f5-478937db3237 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044608 Oct 04 22:55:07.155738 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4081/7339] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:55:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:55:07.837256 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-b01c99b5-2a9d-464e-8864-4260fd954b12 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:55:07.837797 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-b01c99b5-2a9d-464e-8864-4260fd954b12 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: 777aaf80-05b4-4e03-b329-084e9fda3e39] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:55:07.844757 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b01c99b5-2a9d-464e-8864-4260fd954b12 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:55:07.845250 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b01c99b5-2a9d-464e-8864-4260fd954b12 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:55:07.845686 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b01c99b5-2a9d-464e-8864-4260fd954b12 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:55:07.846476 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b01c99b5-2a9d-464e-8864-4260fd954b12 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:55:07.846949 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b01c99b5-2a9d-464e-8864-4260fd954b12 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:55:07.847376 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b01c99b5-2a9d-464e-8864-4260fd954b12 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:55:08.031128 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-b01c99b5-2a9d-464e-8864-4260fd954b12 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad9d55ccfe74ffb914f02030529523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ad9e4338314c269afb0cfcebe03584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:55:08.038795 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-b01c99b5-2a9d-464e-8864-4260fd954b12 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/777aaf80-05b4-4e03-b329-084e9fda3e39" status: 200 len: 1678 microversion: 2.1 time: 0.205515 Oct 04 22:55:08.039392 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3259/7340] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:55:07 2022] GET /compute/v2.1/servers/777aaf80-05b4-4e03-b329-084e9fda3e39 => generated 1678 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:55:09.064584 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-81639924-2295-454f-8ce9-0c9a1e8ee606 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:55:09.065303 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-81639924-2295-454f-8ce9-0c9a1e8ee606 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: 777aaf80-05b4-4e03-b329-084e9fda3e39] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:55:09.071531 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-81639924-2295-454f-8ce9-0c9a1e8ee606 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:55:09.072035 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-81639924-2295-454f-8ce9-0c9a1e8ee606 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:55:09.072488 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-81639924-2295-454f-8ce9-0c9a1e8ee606 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:55:09.073195 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-81639924-2295-454f-8ce9-0c9a1e8ee606 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:55:09.073667 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-81639924-2295-454f-8ce9-0c9a1e8ee606 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:55:09.074108 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-81639924-2295-454f-8ce9-0c9a1e8ee606 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:55:09.208201 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-81639924-2295-454f-8ce9-0c9a1e8ee606 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad9d55ccfe74ffb914f02030529523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ad9e4338314c269afb0cfcebe03584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:55:09.216327 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-81639924-2295-454f-8ce9-0c9a1e8ee606 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/777aaf80-05b4-4e03-b329-084e9fda3e39" status: 200 len: 1674 microversion: 2.1 time: 0.157470 Oct 04 22:55:09.217088 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4082/7341] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:55:09 2022] GET /compute/v2.1/servers/777aaf80-05b4-4e03-b329-084e9fda3e39 => generated 1674 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:55:09.239390 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-ac8ea0b0-f4c1-4371-a78f-f8a6ce366fe4 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:55:09.240045 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-ac8ea0b0-f4c1-4371-a78f-f8a6ce366fe4 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: 777aaf80-05b4-4e03-b329-084e9fda3e39] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:55:09.247511 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ac8ea0b0-f4c1-4371-a78f-f8a6ce366fe4 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:55:09.248004 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ac8ea0b0-f4c1-4371-a78f-f8a6ce366fe4 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:55:09.248472 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ac8ea0b0-f4c1-4371-a78f-f8a6ce366fe4 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:55:09.249175 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ac8ea0b0-f4c1-4371-a78f-f8a6ce366fe4 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:55:09.249637 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ac8ea0b0-f4c1-4371-a78f-f8a6ce366fe4 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:55:09.250125 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ac8ea0b0-f4c1-4371-a78f-f8a6ce366fe4 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:55:09.308724 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-ac8ea0b0-f4c1-4371-a78f-f8a6ce366fe4 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "POST /compute/v2.1/servers/777aaf80-05b4-4e03-b329-084e9fda3e39/action" status: 204 len: 0 microversion: 2.1 time: 0.073013 Oct 04 22:55:09.310706 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3260/7342] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 22:55:09 2022] POST /compute/v2.1/servers/777aaf80-05b4-4e03-b329-084e9fda3e39/action => generated 0 bytes in 76 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 22:55:09.319132 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-c7907929-7ce3-4d50-a41e-ce81a6a1af88 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:55:09.319861 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-c7907929-7ce3-4d50-a41e-ce81a6a1af88 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: 777aaf80-05b4-4e03-b329-084e9fda3e39] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:55:09.325937 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c7907929-7ce3-4d50-a41e-ce81a6a1af88 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:55:09.326523 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c7907929-7ce3-4d50-a41e-ce81a6a1af88 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:55:09.327039 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c7907929-7ce3-4d50-a41e-ce81a6a1af88 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:55:09.327786 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c7907929-7ce3-4d50-a41e-ce81a6a1af88 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:55:09.328309 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c7907929-7ce3-4d50-a41e-ce81a6a1af88 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:55:09.328834 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c7907929-7ce3-4d50-a41e-ce81a6a1af88 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:55:09.459875 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-c7907929-7ce3-4d50-a41e-ce81a6a1af88 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad9d55ccfe74ffb914f02030529523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ad9e4338314c269afb0cfcebe03584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:55:09.467984 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-c7907929-7ce3-4d50-a41e-ce81a6a1af88 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/777aaf80-05b4-4e03-b329-084e9fda3e39" status: 200 len: 1674 microversion: 2.1 time: 0.152812 Oct 04 22:55:09.468571 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4083/7343] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:55:09 2022] GET /compute/v2.1/servers/777aaf80-05b4-4e03-b329-084e9fda3e39 => generated 1674 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:55:10.493412 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-08a75a2a-134c-4363-a181-301d53a3dd4b tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:55:10.494440 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-08a75a2a-134c-4363-a181-301d53a3dd4b tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: 777aaf80-05b4-4e03-b329-084e9fda3e39] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:55:10.504257 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-08a75a2a-134c-4363-a181-301d53a3dd4b tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:55:10.504922 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-08a75a2a-134c-4363-a181-301d53a3dd4b tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:55:10.505379 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-08a75a2a-134c-4363-a181-301d53a3dd4b tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:55:10.506297 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-08a75a2a-134c-4363-a181-301d53a3dd4b tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:55:10.507233 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-08a75a2a-134c-4363-a181-301d53a3dd4b tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:55:10.507685 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-08a75a2a-134c-4363-a181-301d53a3dd4b tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:55:10.669356 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-08a75a2a-134c-4363-a181-301d53a3dd4b tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad9d55ccfe74ffb914f02030529523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ad9e4338314c269afb0cfcebe03584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:55:10.677402 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-08a75a2a-134c-4363-a181-301d53a3dd4b tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/777aaf80-05b4-4e03-b329-084e9fda3e39" status: 200 len: 1653 microversion: 2.1 time: 0.189136 Oct 04 22:55:10.677983 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3261/7344] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:55:10 2022] GET /compute/v2.1/servers/777aaf80-05b4-4e03-b329-084e9fda3e39 => generated 1653 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:55:10.700313 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-29c7ae40-0f77-41b7-b518-9aa98e5b8fe7 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:55:10.700949 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-29c7ae40-0f77-41b7-b518-9aa98e5b8fe7 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: 777aaf80-05b4-4e03-b329-084e9fda3e39] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:55:10.707989 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-29c7ae40-0f77-41b7-b518-9aa98e5b8fe7 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:55:10.708432 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-29c7ae40-0f77-41b7-b518-9aa98e5b8fe7 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:55:10.708888 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-29c7ae40-0f77-41b7-b518-9aa98e5b8fe7 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:55:10.709612 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-29c7ae40-0f77-41b7-b518-9aa98e5b8fe7 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:55:10.710082 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-29c7ae40-0f77-41b7-b518-9aa98e5b8fe7 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:55:10.710560 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-29c7ae40-0f77-41b7-b518-9aa98e5b8fe7 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:55:10.848529 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-29c7ae40-0f77-41b7-b518-9aa98e5b8fe7 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad9d55ccfe74ffb914f02030529523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ad9e4338314c269afb0cfcebe03584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:55:10.856824 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-29c7ae40-0f77-41b7-b518-9aa98e5b8fe7 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/777aaf80-05b4-4e03-b329-084e9fda3e39" status: 200 len: 1653 microversion: 2.1 time: 0.160493 Oct 04 22:55:10.857392 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4084/7345] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:55:10 2022] GET /compute/v2.1/servers/777aaf80-05b4-4e03-b329-084e9fda3e39 => generated 1653 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:55:10.880199 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-a58e1a4e-1069-4233-8e77-aee02c3cd3d8 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:55:10.886078 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a58e1a4e-1069-4233-8e77-aee02c3cd3d8 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:55:10.886596 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a58e1a4e-1069-4233-8e77-aee02c3cd3d8 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:55:10.887034 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a58e1a4e-1069-4233-8e77-aee02c3cd3d8 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:55:10.908435 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-a58e1a4e-1069-4233-8e77-aee02c3cd3d8 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: 777aaf80-05b4-4e03-b329-084e9fda3e39] Going to try to start instance {{(pid=134102) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 04 22:55:10.941533 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:55:10.950998 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-a58e1a4e-1069-4233-8e77-aee02c3cd3d8 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "POST /compute/v2.1/servers/777aaf80-05b4-4e03-b329-084e9fda3e39/action" status: 202 len: 0 microversion: 2.1 time: 0.074360 Oct 04 22:55:10.951600 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3262/7346] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 22:55:10 2022] POST /compute/v2.1/servers/777aaf80-05b4-4e03-b329-084e9fda3e39/action => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 22:55:10.959965 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-9f750367-fea8-40f8-bcea-0802444802b4 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:55:10.960528 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-9f750367-fea8-40f8-bcea-0802444802b4 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: 777aaf80-05b4-4e03-b329-084e9fda3e39] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:55:10.967281 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9f750367-fea8-40f8-bcea-0802444802b4 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:55:10.967793 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9f750367-fea8-40f8-bcea-0802444802b4 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:55:10.968277 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9f750367-fea8-40f8-bcea-0802444802b4 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:55:10.969029 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9f750367-fea8-40f8-bcea-0802444802b4 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:55:10.969512 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9f750367-fea8-40f8-bcea-0802444802b4 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:55:10.969973 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9f750367-fea8-40f8-bcea-0802444802b4 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:55:11.105364 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-9f750367-fea8-40f8-bcea-0802444802b4 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad9d55ccfe74ffb914f02030529523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ad9e4338314c269afb0cfcebe03584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:55:11.113959 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-9f750367-fea8-40f8-bcea-0802444802b4 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/777aaf80-05b4-4e03-b329-084e9fda3e39" status: 200 len: 1662 microversion: 2.1 time: 0.157882 Oct 04 22:55:11.114606 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4085/7347] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:55:10 2022] GET /compute/v2.1/servers/777aaf80-05b4-4e03-b329-084e9fda3e39 => generated 1662 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:55:12.076440 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-3f5c957f-971f-4201-8705-bc1a2e621425 req-68a870d7-7430-4f94-883e-f53db1fd68be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "777aaf80-05b4-4e03-b329-084e9fda3e39", "name": "network-vif-plugged", "status": "completed", "tag": "c5b4e91f-9a61-4109-8ed0-499c66fe9dd6"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:55:12.088275 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-3f5c957f-971f-4201-8705-bc1a2e621425 req-68a870d7-7430-4f94-883e-f53db1fd68be service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:55:12.088766 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-3f5c957f-971f-4201-8705-bc1a2e621425 req-68a870d7-7430-4f94-883e-f53db1fd68be service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:55:12.089219 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-3f5c957f-971f-4201-8705-bc1a2e621425 req-68a870d7-7430-4f94-883e-f53db1fd68be service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:55:12.103425 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-3f5c957f-971f-4201-8705-bc1a2e621425 req-68a870d7-7430-4f94-883e-f53db1fd68be service nova] Creating event network-vif-plugged:c5b4e91f-9a61-4109-8ed0-499c66fe9dd6 for instance 777aaf80-05b4-4e03-b329-084e9fda3e39 on n-h2-860284-1 Oct 04 22:55:12.110239 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-3f5c957f-971f-4201-8705-bc1a2e621425 req-68a870d7-7430-4f94-883e-f53db1fd68be service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039562 Oct 04 22:55:12.111459 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3263/7348] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:55:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:55:12.138491 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-90186845-f4c8-4fdf-8e1e-1f51ae6b4fd1 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:55:12.139161 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-90186845-f4c8-4fdf-8e1e-1f51ae6b4fd1 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: 777aaf80-05b4-4e03-b329-084e9fda3e39] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:55:12.146525 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-90186845-f4c8-4fdf-8e1e-1f51ae6b4fd1 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:55:12.147032 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-90186845-f4c8-4fdf-8e1e-1f51ae6b4fd1 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:55:12.147485 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-90186845-f4c8-4fdf-8e1e-1f51ae6b4fd1 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:55:12.148200 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-90186845-f4c8-4fdf-8e1e-1f51ae6b4fd1 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:55:12.148670 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-90186845-f4c8-4fdf-8e1e-1f51ae6b4fd1 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:55:12.149106 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-90186845-f4c8-4fdf-8e1e-1f51ae6b4fd1 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:55:12.284910 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-90186845-f4c8-4fdf-8e1e-1f51ae6b4fd1 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad9d55ccfe74ffb914f02030529523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ad9e4338314c269afb0cfcebe03584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:55:12.292901 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-90186845-f4c8-4fdf-8e1e-1f51ae6b4fd1 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/777aaf80-05b4-4e03-b329-084e9fda3e39" status: 200 len: 1666 microversion: 2.1 time: 0.158594 Oct 04 22:55:12.293537 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4086/7349] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:55:12 2022] GET /compute/v2.1/servers/777aaf80-05b4-4e03-b329-084e9fda3e39 => generated 1666 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:55:12.316138 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-ff05f0a4-e30b-48b1-a367-8a3ca2fc4398 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:55:12.316642 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-ff05f0a4-e30b-48b1-a367-8a3ca2fc4398 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: 777aaf80-05b4-4e03-b329-084e9fda3e39] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:55:12.322773 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ff05f0a4-e30b-48b1-a367-8a3ca2fc4398 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:55:12.323255 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ff05f0a4-e30b-48b1-a367-8a3ca2fc4398 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:55:12.323698 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ff05f0a4-e30b-48b1-a367-8a3ca2fc4398 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:55:12.324381 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ff05f0a4-e30b-48b1-a367-8a3ca2fc4398 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:55:12.325401 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ff05f0a4-e30b-48b1-a367-8a3ca2fc4398 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:55:12.325829 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ff05f0a4-e30b-48b1-a367-8a3ca2fc4398 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:55:12.351108 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-ff05f0a4-e30b-48b1-a367-8a3ca2fc4398 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: 777aaf80-05b4-4e03-b329-084e9fda3e39] Going to try to terminate instance {{(pid=134102) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 22:55:12.423795 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-ff05f0a4-e30b-48b1-a367-8a3ca2fc4398 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "DELETE /compute/v2.1/servers/777aaf80-05b4-4e03-b329-084e9fda3e39" status: 204 len: 0 microversion: 2.1 time: 0.111679 Oct 04 22:55:12.424847 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3264/7350] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 22:55:12 2022] DELETE /compute/v2.1/servers/777aaf80-05b4-4e03-b329-084e9fda3e39 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 22:55:12.433675 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-121cf9cb-4601-4f59-8946-c16d08f4faf2 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:55:12.434449 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-121cf9cb-4601-4f59-8946-c16d08f4faf2 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: 777aaf80-05b4-4e03-b329-084e9fda3e39] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:55:12.440398 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-121cf9cb-4601-4f59-8946-c16d08f4faf2 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:55:12.440879 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-121cf9cb-4601-4f59-8946-c16d08f4faf2 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:55:12.441330 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-121cf9cb-4601-4f59-8946-c16d08f4faf2 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:55:12.442030 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-121cf9cb-4601-4f59-8946-c16d08f4faf2 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:55:12.442529 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-121cf9cb-4601-4f59-8946-c16d08f4faf2 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:55:12.442969 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-121cf9cb-4601-4f59-8946-c16d08f4faf2 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:55:12.461657 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:55:12.582233 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-121cf9cb-4601-4f59-8946-c16d08f4faf2 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad9d55ccfe74ffb914f02030529523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ad9e4338314c269afb0cfcebe03584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:55:12.590208 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-121cf9cb-4601-4f59-8946-c16d08f4faf2 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/777aaf80-05b4-4e03-b329-084e9fda3e39" status: 200 len: 1672 microversion: 2.1 time: 0.160780 Oct 04 22:55:12.590828 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4087/7351] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:55:12 2022] GET /compute/v2.1/servers/777aaf80-05b4-4e03-b329-084e9fda3e39 => generated 1672 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:55:13.616237 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-505566e2-296c-4d64-a717-76c2523ae407 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:55:13.616994 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-505566e2-296c-4d64-a717-76c2523ae407 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: 777aaf80-05b4-4e03-b329-084e9fda3e39] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:55:13.624310 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-505566e2-296c-4d64-a717-76c2523ae407 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:55:13.624799 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-505566e2-296c-4d64-a717-76c2523ae407 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:55:13.625242 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-505566e2-296c-4d64-a717-76c2523ae407 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:55:13.625953 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-505566e2-296c-4d64-a717-76c2523ae407 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:55:13.626440 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-505566e2-296c-4d64-a717-76c2523ae407 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:55:13.626874 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-505566e2-296c-4d64-a717-76c2523ae407 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:55:13.764206 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-505566e2-296c-4d64-a717-76c2523ae407 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad9d55ccfe74ffb914f02030529523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ad9e4338314c269afb0cfcebe03584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:55:13.772408 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-505566e2-296c-4d64-a717-76c2523ae407 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/777aaf80-05b4-4e03-b329-084e9fda3e39" status: 200 len: 1672 microversion: 2.1 time: 0.160461 Oct 04 22:55:13.773016 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3265/7352] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:55:13 2022] GET /compute/v2.1/servers/777aaf80-05b4-4e03-b329-084e9fda3e39 => generated 1672 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:55:14.744355 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-c9e4182c-3f4c-41e7-8d0d-2770328de1e4 req-1bc729df-edd2-4dc6-b3ce-fdb7d525e414 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "777aaf80-05b4-4e03-b329-084e9fda3e39", "name": "network-vif-deleted", "tag": "c5b4e91f-9a61-4109-8ed0-499c66fe9dd6"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:55:14.769914 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-c9e4182c-3f4c-41e7-8d0d-2770328de1e4 req-1bc729df-edd2-4dc6-b3ce-fdb7d525e414 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:55:14.770778 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-c9e4182c-3f4c-41e7-8d0d-2770328de1e4 req-1bc729df-edd2-4dc6-b3ce-fdb7d525e414 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:55:14.771235 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-c9e4182c-3f4c-41e7-8d0d-2770328de1e4 req-1bc729df-edd2-4dc6-b3ce-fdb7d525e414 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:55:14.796522 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-c9e4182c-3f4c-41e7-8d0d-2770328de1e4 req-1bc729df-edd2-4dc6-b3ce-fdb7d525e414 service nova] Creating event network-vif-deleted:c5b4e91f-9a61-4109-8ed0-499c66fe9dd6 for instance 777aaf80-05b4-4e03-b329-084e9fda3e39 on n-h2-860284-1 Oct 04 22:55:14.799685 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-372e9527-d3b8-4a4c-b3e3-0ad12fda017c tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:55:14.801128 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-372e9527-d3b8-4a4c-b3e3-0ad12fda017c tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: 777aaf80-05b4-4e03-b329-084e9fda3e39] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:55:14.802284 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-c9e4182c-3f4c-41e7-8d0d-2770328de1e4 req-1bc729df-edd2-4dc6-b3ce-fdb7d525e414 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061811 Oct 04 22:55:14.808101 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4088/7353] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:55:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:55:14.812392 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-372e9527-d3b8-4a4c-b3e3-0ad12fda017c tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:55:14.813135 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-372e9527-d3b8-4a4c-b3e3-0ad12fda017c tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:55:14.813654 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-372e9527-d3b8-4a4c-b3e3-0ad12fda017c tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:55:14.814496 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-372e9527-d3b8-4a4c-b3e3-0ad12fda017c tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:55:14.815034 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-372e9527-d3b8-4a4c-b3e3-0ad12fda017c tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:55:14.815543 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-372e9527-d3b8-4a4c-b3e3-0ad12fda017c tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:55:14.896630 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-372e9527-d3b8-4a4c-b3e3-0ad12fda017c tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad9d55ccfe74ffb914f02030529523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ad9e4338314c269afb0cfcebe03584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:55:14.907260 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-372e9527-d3b8-4a4c-b3e3-0ad12fda017c tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/777aaf80-05b4-4e03-b329-084e9fda3e39" status: 200 len: 1322 microversion: 2.1 time: 0.114258 Oct 04 22:55:14.907958 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3266/7354] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:55:14 2022] GET /compute/v2.1/servers/777aaf80-05b4-4e03-b329-084e9fda3e39 => generated 1322 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:55:15.933005 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-8908a338-1629-47d1-9544-48f133a816bf tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:55:15.933659 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-8908a338-1629-47d1-9544-48f133a816bf tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: 777aaf80-05b4-4e03-b329-084e9fda3e39] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:55:15.944025 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8908a338-1629-47d1-9544-48f133a816bf tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:55:15.944535 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8908a338-1629-47d1-9544-48f133a816bf tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:55:15.944997 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8908a338-1629-47d1-9544-48f133a816bf tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:55:15.945719 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8908a338-1629-47d1-9544-48f133a816bf tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:55:15.946196 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8908a338-1629-47d1-9544-48f133a816bf tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:55:15.946683 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8908a338-1629-47d1-9544-48f133a816bf tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:55:15.960512 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-8908a338-1629-47d1-9544-48f133a816bf tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] HTTP exception thrown: Instance 777aaf80-05b4-4e03-b329-084e9fda3e39 could not be found. Oct 04 22:55:15.962166 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-8908a338-1629-47d1-9544-48f133a816bf tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Request method failure captured: Oct 04 22:55:15.962166 n-d-860284-1 devstack@n-api.service[134101]: request: GET /compute/v2.1/servers/777aaf80-05b4-4e03-b329-084e9fda3e39 HTTP/1.1 Oct 04 22:55:15.962166 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 22:55:15.962166 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 22:55:15.962166 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 22:55:15.962166 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 22:55:15.962166 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 22:55:15.962166 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 22:55:15.962166 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 22:55:15.962166 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 22:55:15.962166 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPLj5Pwg8WnMY03a1UZoxjs8JJYeyX4gPNXk6kEaEUFSId5NkYbu9p7XcCT6xCsGLl965bhlzMmdcrnW3jmUrNP-IBqDDDBlZIgg6A8FuefFnP4mHIDNTJ0T7sYDTAC4YQVniCZjT1xnCXPrzoAdDzhVXLGL7ogVXgw4ofRJLecl7Qjo Oct 04 22:55:15.962166 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 22:55:15.962166 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 22:55:15.962166 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 22:55:15.962166 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 22:55:15.962166 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 22:55:15.962166 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 22:55:15.962166 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: d2ad9e4338314c269afb0cfcebe03584 Oct 04 22:55:15.962166 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-ServerActionsTestJSON-1972791785 Oct 04 22:55:15.962166 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 22:55:15.962166 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 22:55:15.962166 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d2ad9e4338314c269afb0cfcebe03584"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_d2ad9e4338314c269afb0cfcebe03584", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d2ad9e4338314c269afb0cfcebe03584"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/d2ad9e4338314c269afb0cfcebe03584"}]}] Oct 04 22:55:15.962166 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-ServerActionsTestJSON-1972791785 Oct 04 22:55:15.962166 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: d2ad9e4338314c269afb0cfcebe03584 Oct 04 22:55:15.962166 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-ServerActionsTestJSON-1972791785 Oct 04 22:55:15.962166 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-ServerActionsTestJSON-1972791785-project Oct 04 22:55:15.962166 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 22:55:15.962166 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 22:55:15.962166 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: aad9d55ccfe74ffb914f02030529523d Oct 04 22:55:15.962166 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-ServerActionsTestJSON-1972791785-project Oct 04 22:55:15.962166 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 22:55:15.962166 n-d-860284-1 devstack@n-api.service[134101]: exception: Instance 777aaf80-05b4-4e03-b329-084e9fda3e39 could not be found. Oct 04 22:55:15.962166 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': '777aaf80-05b4-4e03-b329-084e9fda3e39'} Oct 04 22:55:15.962166 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:55:15.962166 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:55:15.962166 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:55:15.962166 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:55:15.962166 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:55:15.962166 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:55:15.962166 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:55:15.962166 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:55:15.962166 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:55:15.962166 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:55:15.962166 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 777aaf80-05b4-4e03-b329-084e9fda3e39 could not be found. Oct 04 22:55:15.962166 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:55:15.962166 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:55:15.962166 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:55:15.962166 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:55:15.962166 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:55:15.962166 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:55:15.962166 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:55:15.962166 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:55:15.962166 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:55:15.962166 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:55:15.962166 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:55:15.962166 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:55:15.962166 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:55:15.962166 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:55:15.962166 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:55:15.962166 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:55:15.962166 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 777aaf80-05b4-4e03-b329-084e9fda3e39 could not be found. Oct 04 22:55:15.962166 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:55:15.962166 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:55:15.962166 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:55:15.967356 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:55:15.967356 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:55:15.967356 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:55:15.967356 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:55:15.967356 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:55:15.967356 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 777aaf80-05b4-4e03-b329-084e9fda3e39 could not be found. Oct 04 22:55:15.967356 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:55:15.967356 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-8908a338-1629-47d1-9544-48f133a816bf tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Returning 404 to user: Instance 777aaf80-05b4-4e03-b329-084e9fda3e39 could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:55:15.967356 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-8908a338-1629-47d1-9544-48f133a816bf tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/777aaf80-05b4-4e03-b329-084e9fda3e39" status: 404 len: 111 microversion: 2.1 time: 0.036298 Oct 04 22:55:15.967356 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4089/7355] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:55:15 2022] GET /compute/v2.1/servers/777aaf80-05b4-4e03-b329-084e9fda3e39 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:55:15.982252 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-4c0a6a54-9710-4652-b8b6-62e6309d0e11 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:55:15.982933 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-4c0a6a54-9710-4652-b8b6-62e6309d0e11 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: 777aaf80-05b4-4e03-b329-084e9fda3e39] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:55:15.989834 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4c0a6a54-9710-4652-b8b6-62e6309d0e11 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:55:15.990412 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4c0a6a54-9710-4652-b8b6-62e6309d0e11 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:55:15.990866 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4c0a6a54-9710-4652-b8b6-62e6309d0e11 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:55:15.991562 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4c0a6a54-9710-4652-b8b6-62e6309d0e11 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:55:15.992026 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4c0a6a54-9710-4652-b8b6-62e6309d0e11 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:55:15.992457 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4c0a6a54-9710-4652-b8b6-62e6309d0e11 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:55:16.006557 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-4c0a6a54-9710-4652-b8b6-62e6309d0e11 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] HTTP exception thrown: Instance 777aaf80-05b4-4e03-b329-084e9fda3e39 could not be found. Oct 04 22:55:16.008216 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-4c0a6a54-9710-4652-b8b6-62e6309d0e11 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Request method failure captured: Oct 04 22:55:16.008216 n-d-860284-1 devstack@n-api.service[134102]: request: GET /compute/v2.1/servers/777aaf80-05b4-4e03-b329-084e9fda3e39 HTTP/1.1 Oct 04 22:55:16.008216 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 22:55:16.008216 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 22:55:16.008216 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 22:55:16.008216 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 22:55:16.008216 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 22:55:16.008216 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 22:55:16.008216 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 22:55:16.008216 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 22:55:16.008216 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPLj5Pwg8WnMY03a1UZoxjs8JJYeyX4gPNXk6kEaEUFSId5NkYbu9p7XcCT6xCsGLl965bhlzMmdcrnW3jmUrNP-IBqDDDBlZIgg6A8FuefFnP4mHIDNTJ0T7sYDTAC4YQVniCZjT1xnCXPrzoAdDzhVXLGL7ogVXgw4ofRJLecl7Qjo Oct 04 22:55:16.008216 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 22:55:16.008216 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 22:55:16.008216 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 22:55:16.008216 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 22:55:16.008216 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 22:55:16.008216 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 22:55:16.008216 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: d2ad9e4338314c269afb0cfcebe03584 Oct 04 22:55:16.008216 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-ServerActionsTestJSON-1972791785 Oct 04 22:55:16.008216 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 22:55:16.008216 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 22:55:16.008216 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d2ad9e4338314c269afb0cfcebe03584"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_d2ad9e4338314c269afb0cfcebe03584", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d2ad9e4338314c269afb0cfcebe03584"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/d2ad9e4338314c269afb0cfcebe03584"}]}] Oct 04 22:55:16.008216 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-ServerActionsTestJSON-1972791785 Oct 04 22:55:16.008216 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: d2ad9e4338314c269afb0cfcebe03584 Oct 04 22:55:16.008216 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-ServerActionsTestJSON-1972791785 Oct 04 22:55:16.008216 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-ServerActionsTestJSON-1972791785-project Oct 04 22:55:16.008216 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 22:55:16.008216 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 22:55:16.008216 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: aad9d55ccfe74ffb914f02030529523d Oct 04 22:55:16.008216 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-ServerActionsTestJSON-1972791785-project Oct 04 22:55:16.008216 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 22:55:16.008216 n-d-860284-1 devstack@n-api.service[134102]: exception: Instance 777aaf80-05b4-4e03-b329-084e9fda3e39 could not be found. Oct 04 22:55:16.008216 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': '777aaf80-05b4-4e03-b329-084e9fda3e39'} Oct 04 22:55:16.008216 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:55:16.008216 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:55:16.008216 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:55:16.008216 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:55:16.008216 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:55:16.008216 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:55:16.008216 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:55:16.008216 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:55:16.008216 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:55:16.008216 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:55:16.008216 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 777aaf80-05b4-4e03-b329-084e9fda3e39 could not be found. Oct 04 22:55:16.008216 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:55:16.008216 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:55:16.008216 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:55:16.008216 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:55:16.008216 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:55:16.008216 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:55:16.008216 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:55:16.008216 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:55:16.008216 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:55:16.008216 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:55:16.008216 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:55:16.008216 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:55:16.008216 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:55:16.008216 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:55:16.008216 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:55:16.008216 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:55:16.008216 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 777aaf80-05b4-4e03-b329-084e9fda3e39 could not be found. Oct 04 22:55:16.008216 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:55:16.008216 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:55:16.008216 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:55:16.013659 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:55:16.013659 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:55:16.013659 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:55:16.013659 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:55:16.013659 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:55:16.013659 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 777aaf80-05b4-4e03-b329-084e9fda3e39 could not be found. Oct 04 22:55:16.013659 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:55:16.013659 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-4c0a6a54-9710-4652-b8b6-62e6309d0e11 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Returning 404 to user: Instance 777aaf80-05b4-4e03-b329-084e9fda3e39 could not be found. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:55:16.013659 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-4c0a6a54-9710-4652-b8b6-62e6309d0e11 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/777aaf80-05b4-4e03-b329-084e9fda3e39" status: 404 len: 111 microversion: 2.1 time: 0.032055 Oct 04 22:55:16.013659 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3267/7356] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:55:15 2022] GET /compute/v2.1/servers/777aaf80-05b4-4e03-b329-084e9fda3e39 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:55:16.059250 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-703d1956-0d40-4ec5-80e2-cb5f2d272e3a tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-386189589", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452", "networks": [{"uuid": "edb1eff0-ecce-412d-a1f1-316814dcaa93"}], "security_groups": [{"name": "tempest-securitygroup--1626714274"}], "key_name": "tempest-keypair-524313961", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:55:16.164624 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.network.neutron [None req-703d1956-0d40-4ec5-80e2-cb5f2d272e3a tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] validate_networks() for [('edb1eff0-ecce-412d-a1f1-316814dcaa93', None, None, None, None, None)] {{(pid=134101) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 22:55:16.532050 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-703d1956-0d40-4ec5-80e2-cb5f2d272e3a tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Flavor limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 22:55:16.532503 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-703d1956-0d40-4ec5-80e2-cb5f2d272e3a tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Image limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 22:55:16.533006 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-703d1956-0d40-4ec5-80e2-cb5f2d272e3a tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Flavor pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 22:55:16.533447 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-703d1956-0d40-4ec5-80e2-cb5f2d272e3a tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Image pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 22:55:16.533887 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-703d1956-0d40-4ec5-80e2-cb5f2d272e3a tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 22:55:16.542894 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-703d1956-0d40-4ec5-80e2-cb5f2d272e3a tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:55:16.543400 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-703d1956-0d40-4ec5-80e2-cb5f2d272e3a tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:55:16.543919 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-703d1956-0d40-4ec5-80e2-cb5f2d272e3a tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:55:16.544685 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-703d1956-0d40-4ec5-80e2-cb5f2d272e3a tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:55:16.545166 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-703d1956-0d40-4ec5-80e2-cb5f2d272e3a tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:55:16.545615 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-703d1956-0d40-4ec5-80e2-cb5f2d272e3a tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:55:16.563208 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-703d1956-0d40-4ec5-80e2-cb5f2d272e3a tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Getting quotas for project d2ad9e4338314c269afb0cfcebe03584. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:55:16.568452 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-703d1956-0d40-4ec5-80e2-cb5f2d272e3a tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Getting quotas for user aad9d55ccfe74ffb914f02030529523d and project d2ad9e4338314c269afb0cfcebe03584. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:55:16.582223 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-703d1956-0d40-4ec5-80e2-cb5f2d272e3a tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Going to run 1 instances... {{(pid=134101) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 22:55:16.584617 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-703d1956-0d40-4ec5-80e2-cb5f2d272e3a tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: 16cdaac8-bb7a-405f-9bc6-1e7b17194689] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='58548514-5dac-426c-81f5-19e3fba33e23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134101) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 22:55:16.632317 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-703d1956-0d40-4ec5-80e2-cb5f2d272e3a tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.577062 Oct 04 22:55:16.632989 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4090/7357] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 22:55:16 2022] POST /compute/v2.1/servers => generated 406 bytes in 578 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 22:55:16.645151 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-329f8651-0c73-4fe9-8ca3-151ec3532e4b tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:55:16.645767 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-329f8651-0c73-4fe9-8ca3-151ec3532e4b tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: 16cdaac8-bb7a-405f-9bc6-1e7b17194689] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:55:16.699156 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-329f8651-0c73-4fe9-8ca3-151ec3532e4b tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad9d55ccfe74ffb914f02030529523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ad9e4338314c269afb0cfcebe03584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:55:16.707422 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-329f8651-0c73-4fe9-8ca3-151ec3532e4b tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/16cdaac8-bb7a-405f-9bc6-1e7b17194689" status: 200 len: 1237 microversion: 2.1 time: 0.065117 Oct 04 22:55:16.708205 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3268/7358] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:55:16 2022] GET /compute/v2.1/servers/16cdaac8-bb7a-405f-9bc6-1e7b17194689 => generated 1237 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:55:17.730935 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-ab249e37-1391-4b24-8da9-f5b0be63aea3 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:55:17.732305 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-ab249e37-1391-4b24-8da9-f5b0be63aea3 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: 16cdaac8-bb7a-405f-9bc6-1e7b17194689] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:55:17.740199 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ab249e37-1391-4b24-8da9-f5b0be63aea3 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:55:17.740712 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ab249e37-1391-4b24-8da9-f5b0be63aea3 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:55:17.741172 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ab249e37-1391-4b24-8da9-f5b0be63aea3 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:55:17.742033 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ab249e37-1391-4b24-8da9-f5b0be63aea3 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:55:17.743105 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ab249e37-1391-4b24-8da9-f5b0be63aea3 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:55:17.743105 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ab249e37-1391-4b24-8da9-f5b0be63aea3 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:55:17.810669 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-ab249e37-1391-4b24-8da9-f5b0be63aea3 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad9d55ccfe74ffb914f02030529523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ad9e4338314c269afb0cfcebe03584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:55:17.818609 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-ab249e37-1391-4b24-8da9-f5b0be63aea3 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/16cdaac8-bb7a-405f-9bc6-1e7b17194689" status: 200 len: 1307 microversion: 2.1 time: 0.091796 Oct 04 22:55:17.819196 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4091/7359] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:55:17 2022] GET /compute/v2.1/servers/16cdaac8-bb7a-405f-9bc6-1e7b17194689 => generated 1307 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:55:18.843779 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-bd0f47f2-2dfe-4c9b-811c-ebb7f0a2cff4 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:55:18.844402 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-bd0f47f2-2dfe-4c9b-811c-ebb7f0a2cff4 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: 16cdaac8-bb7a-405f-9bc6-1e7b17194689] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:55:18.852186 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bd0f47f2-2dfe-4c9b-811c-ebb7f0a2cff4 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:55:18.852877 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bd0f47f2-2dfe-4c9b-811c-ebb7f0a2cff4 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:55:18.853484 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bd0f47f2-2dfe-4c9b-811c-ebb7f0a2cff4 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:55:18.854386 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bd0f47f2-2dfe-4c9b-811c-ebb7f0a2cff4 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:55:18.855018 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bd0f47f2-2dfe-4c9b-811c-ebb7f0a2cff4 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:55:18.855453 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bd0f47f2-2dfe-4c9b-811c-ebb7f0a2cff4 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:55:19.064146 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-bd0f47f2-2dfe-4c9b-811c-ebb7f0a2cff4 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad9d55ccfe74ffb914f02030529523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ad9e4338314c269afb0cfcebe03584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:55:19.071834 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-bd0f47f2-2dfe-4c9b-811c-ebb7f0a2cff4 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/16cdaac8-bb7a-405f-9bc6-1e7b17194689" status: 200 len: 1363 microversion: 2.1 time: 0.232638 Oct 04 22:55:19.072419 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3269/7360] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:55:18 2022] GET /compute/v2.1/servers/16cdaac8-bb7a-405f-9bc6-1e7b17194689 => generated 1363 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:55:19.408463 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-80ad556d-e25c-43ab-89ce-371a47424d48 req-5f9d6ebe-5be6-4d35-8560-4f2c40668572 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16cdaac8-bb7a-405f-9bc6-1e7b17194689", "tag": "aac17ba0-17d8-4109-84a4-366867d1321a"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:55:19.420017 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-80ad556d-e25c-43ab-89ce-371a47424d48 req-5f9d6ebe-5be6-4d35-8560-4f2c40668572 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:55:19.420535 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-80ad556d-e25c-43ab-89ce-371a47424d48 req-5f9d6ebe-5be6-4d35-8560-4f2c40668572 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:55:19.420974 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-80ad556d-e25c-43ab-89ce-371a47424d48 req-5f9d6ebe-5be6-4d35-8560-4f2c40668572 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:55:19.432263 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-80ad556d-e25c-43ab-89ce-371a47424d48 req-5f9d6ebe-5be6-4d35-8560-4f2c40668572 service nova] Creating event network-changed:aac17ba0-17d8-4109-84a4-366867d1321a for instance 16cdaac8-bb7a-405f-9bc6-1e7b17194689 on n-h2-860284-1 Oct 04 22:55:19.437947 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-80ad556d-e25c-43ab-89ce-371a47424d48 req-5f9d6ebe-5be6-4d35-8560-4f2c40668572 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033285 Oct 04 22:55:19.438599 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4092/7361] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:55:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:55:20.096707 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-ae8becc3-a4ee-4ba3-9141-ae6afc4863d6 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:55:20.097332 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-ae8becc3-a4ee-4ba3-9141-ae6afc4863d6 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: 16cdaac8-bb7a-405f-9bc6-1e7b17194689] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:55:20.100144 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:55:20.106757 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ae8becc3-a4ee-4ba3-9141-ae6afc4863d6 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:55:20.107247 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ae8becc3-a4ee-4ba3-9141-ae6afc4863d6 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:55:20.107697 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ae8becc3-a4ee-4ba3-9141-ae6afc4863d6 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:55:20.108400 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ae8becc3-a4ee-4ba3-9141-ae6afc4863d6 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:55:20.108864 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ae8becc3-a4ee-4ba3-9141-ae6afc4863d6 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:55:20.109297 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ae8becc3-a4ee-4ba3-9141-ae6afc4863d6 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:55:20.242611 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-ae8becc3-a4ee-4ba3-9141-ae6afc4863d6 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad9d55ccfe74ffb914f02030529523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ad9e4338314c269afb0cfcebe03584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:55:20.250610 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-ae8becc3-a4ee-4ba3-9141-ae6afc4863d6 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/16cdaac8-bb7a-405f-9bc6-1e7b17194689" status: 200 len: 1363 microversion: 2.1 time: 0.157787 Oct 04 22:55:20.251195 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3270/7362] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:55:20 2022] GET /compute/v2.1/servers/16cdaac8-bb7a-405f-9bc6-1e7b17194689 => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:55:21.275594 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e6d955e6-8434-4db6-911f-0777eed54d70 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:55:21.276338 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-e6d955e6-8434-4db6-911f-0777eed54d70 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: 16cdaac8-bb7a-405f-9bc6-1e7b17194689] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:55:21.278300 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=3 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:55:21.283835 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e6d955e6-8434-4db6-911f-0777eed54d70 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:55:21.284334 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e6d955e6-8434-4db6-911f-0777eed54d70 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:55:21.284784 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e6d955e6-8434-4db6-911f-0777eed54d70 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:55:21.285490 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e6d955e6-8434-4db6-911f-0777eed54d70 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:55:21.285956 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e6d955e6-8434-4db6-911f-0777eed54d70 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:55:21.286416 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e6d955e6-8434-4db6-911f-0777eed54d70 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:55:21.424674 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-e6d955e6-8434-4db6-911f-0777eed54d70 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad9d55ccfe74ffb914f02030529523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ad9e4338314c269afb0cfcebe03584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:55:21.432436 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-e6d955e6-8434-4db6-911f-0777eed54d70 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/16cdaac8-bb7a-405f-9bc6-1e7b17194689" status: 200 len: 1363 microversion: 2.1 time: 0.162110 Oct 04 22:55:21.433020 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4093/7363] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:55:21 2022] GET /compute/v2.1/servers/16cdaac8-bb7a-405f-9bc6-1e7b17194689 => generated 1363 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:55:22.456875 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-02eaf87d-bc91-4c2e-b71e-f41ab653fb24 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:55:22.457422 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-02eaf87d-bc91-4c2e-b71e-f41ab653fb24 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: 16cdaac8-bb7a-405f-9bc6-1e7b17194689] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:55:22.464346 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-02eaf87d-bc91-4c2e-b71e-f41ab653fb24 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:55:22.464834 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-02eaf87d-bc91-4c2e-b71e-f41ab653fb24 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:55:22.465447 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-02eaf87d-bc91-4c2e-b71e-f41ab653fb24 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:55:22.466242 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-02eaf87d-bc91-4c2e-b71e-f41ab653fb24 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:55:22.466733 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-02eaf87d-bc91-4c2e-b71e-f41ab653fb24 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:55:22.467171 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-02eaf87d-bc91-4c2e-b71e-f41ab653fb24 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:55:22.599058 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-02eaf87d-bc91-4c2e-b71e-f41ab653fb24 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad9d55ccfe74ffb914f02030529523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ad9e4338314c269afb0cfcebe03584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:55:22.607535 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-02eaf87d-bc91-4c2e-b71e-f41ab653fb24 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/16cdaac8-bb7a-405f-9bc6-1e7b17194689" status: 200 len: 1363 microversion: 2.1 time: 0.154656 Oct 04 22:55:22.608142 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3271/7364] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:55:22 2022] GET /compute/v2.1/servers/16cdaac8-bb7a-405f-9bc6-1e7b17194689 => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:55:23.631764 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-c12767ce-242e-4af8-bb84-41dd4410bcea tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:55:23.632389 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-c12767ce-242e-4af8-bb84-41dd4410bcea tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: 16cdaac8-bb7a-405f-9bc6-1e7b17194689] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:55:23.640047 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c12767ce-242e-4af8-bb84-41dd4410bcea tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:55:23.640546 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c12767ce-242e-4af8-bb84-41dd4410bcea tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:55:23.641000 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c12767ce-242e-4af8-bb84-41dd4410bcea tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:55:23.641715 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c12767ce-242e-4af8-bb84-41dd4410bcea tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:55:23.642181 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c12767ce-242e-4af8-bb84-41dd4410bcea tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:55:23.642651 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c12767ce-242e-4af8-bb84-41dd4410bcea tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:55:23.771135 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-c12767ce-242e-4af8-bb84-41dd4410bcea tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad9d55ccfe74ffb914f02030529523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ad9e4338314c269afb0cfcebe03584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:55:23.779623 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-c12767ce-242e-4af8-bb84-41dd4410bcea tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/16cdaac8-bb7a-405f-9bc6-1e7b17194689" status: 200 len: 1363 microversion: 2.1 time: 0.151828 Oct 04 22:55:23.780210 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4094/7365] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:55:23 2022] GET /compute/v2.1/servers/16cdaac8-bb7a-405f-9bc6-1e7b17194689 => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:55:24.119772 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-356c72da-990f-44a3-969a-00586bf2bb86 req-d36c9e80-7bef-4966-ad76-59c10dc323c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16cdaac8-bb7a-405f-9bc6-1e7b17194689", "name": "network-vif-plugged", "status": "completed", "tag": "aac17ba0-17d8-4109-84a4-366867d1321a"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:55:24.131293 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-356c72da-990f-44a3-969a-00586bf2bb86 req-d36c9e80-7bef-4966-ad76-59c10dc323c8 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:55:24.131957 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-356c72da-990f-44a3-969a-00586bf2bb86 req-d36c9e80-7bef-4966-ad76-59c10dc323c8 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:55:24.132582 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-356c72da-990f-44a3-969a-00586bf2bb86 req-d36c9e80-7bef-4966-ad76-59c10dc323c8 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:55:24.145320 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-356c72da-990f-44a3-969a-00586bf2bb86 req-d36c9e80-7bef-4966-ad76-59c10dc323c8 service nova] Creating event network-vif-plugged:aac17ba0-17d8-4109-84a4-366867d1321a for instance 16cdaac8-bb7a-405f-9bc6-1e7b17194689 on n-h2-860284-1 Oct 04 22:55:24.150329 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-356c72da-990f-44a3-969a-00586bf2bb86 req-d36c9e80-7bef-4966-ad76-59c10dc323c8 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034319 Oct 04 22:55:24.150964 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3272/7366] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:55:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:55:24.802994 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-694af780-342a-4e9a-ba96-74d61e1b299b tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:55:24.803632 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-694af780-342a-4e9a-ba96-74d61e1b299b tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: 16cdaac8-bb7a-405f-9bc6-1e7b17194689] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:55:24.810726 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-694af780-342a-4e9a-ba96-74d61e1b299b tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:55:24.811234 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-694af780-342a-4e9a-ba96-74d61e1b299b tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:55:24.811700 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-694af780-342a-4e9a-ba96-74d61e1b299b tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:55:24.812414 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-694af780-342a-4e9a-ba96-74d61e1b299b tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:55:24.812893 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-694af780-342a-4e9a-ba96-74d61e1b299b tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:55:24.813341 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-694af780-342a-4e9a-ba96-74d61e1b299b tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:55:24.942487 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-694af780-342a-4e9a-ba96-74d61e1b299b tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad9d55ccfe74ffb914f02030529523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ad9e4338314c269afb0cfcebe03584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:55:24.951943 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-694af780-342a-4e9a-ba96-74d61e1b299b tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/16cdaac8-bb7a-405f-9bc6-1e7b17194689" status: 200 len: 1363 microversion: 2.1 time: 0.152868 Oct 04 22:55:24.952524 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4095/7367] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:55:24 2022] GET /compute/v2.1/servers/16cdaac8-bb7a-405f-9bc6-1e7b17194689 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:55:25.979927 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-f25ae977-548d-45b0-aff6-dabe19d61fc8 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:55:25.980633 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-f25ae977-548d-45b0-aff6-dabe19d61fc8 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: 16cdaac8-bb7a-405f-9bc6-1e7b17194689] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:55:25.987821 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f25ae977-548d-45b0-aff6-dabe19d61fc8 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:55:25.988310 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f25ae977-548d-45b0-aff6-dabe19d61fc8 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:55:25.988753 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f25ae977-548d-45b0-aff6-dabe19d61fc8 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:55:25.989449 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f25ae977-548d-45b0-aff6-dabe19d61fc8 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:55:25.989911 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f25ae977-548d-45b0-aff6-dabe19d61fc8 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:55:25.990346 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f25ae977-548d-45b0-aff6-dabe19d61fc8 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:55:26.127959 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-f25ae977-548d-45b0-aff6-dabe19d61fc8 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad9d55ccfe74ffb914f02030529523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ad9e4338314c269afb0cfcebe03584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:55:26.135890 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-f25ae977-548d-45b0-aff6-dabe19d61fc8 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/16cdaac8-bb7a-405f-9bc6-1e7b17194689" status: 200 len: 1548 microversion: 2.1 time: 0.163427 Oct 04 22:55:26.136497 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3273/7368] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:55:25 2022] GET /compute/v2.1/servers/16cdaac8-bb7a-405f-9bc6-1e7b17194689 => generated 1548 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:55:26.159395 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-873ea3fa-0c9e-409d-9670-033d88d9631e tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:55:26.159890 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-873ea3fa-0c9e-409d-9670-033d88d9631e tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: 16cdaac8-bb7a-405f-9bc6-1e7b17194689] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:55:26.166737 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-873ea3fa-0c9e-409d-9670-033d88d9631e tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:55:26.167234 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-873ea3fa-0c9e-409d-9670-033d88d9631e tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:55:26.167684 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-873ea3fa-0c9e-409d-9670-033d88d9631e tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:55:26.168398 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-873ea3fa-0c9e-409d-9670-033d88d9631e tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:55:26.168862 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-873ea3fa-0c9e-409d-9670-033d88d9631e tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:55:26.169917 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-873ea3fa-0c9e-409d-9670-033d88d9631e tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:55:26.249635 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-873ea3fa-0c9e-409d-9670-033d88d9631e tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/16cdaac8-bb7a-405f-9bc6-1e7b17194689/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.094070 Oct 04 22:55:26.250234 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4096/7369] 10.222.0.43 () {58 vars in 1275 bytes} [Tue Oct 4 22:55:26 2022] GET /compute/v2.1/servers/16cdaac8-bb7a-405f-9bc6-1e7b17194689/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:55:27.604034 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell0:SELECT=2 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:55:27.662347 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-a34ac424-dd26-4e02-9798-cd911e158dad req-3ae04ffc-18d3-4560-b4ad-98d3e7c2fb4b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16cdaac8-bb7a-405f-9bc6-1e7b17194689", "tag": "aac17ba0-17d8-4109-84a4-366867d1321a"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:55:27.672405 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-a34ac424-dd26-4e02-9798-cd911e158dad req-3ae04ffc-18d3-4560-b4ad-98d3e7c2fb4b service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:55:27.672894 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-a34ac424-dd26-4e02-9798-cd911e158dad req-3ae04ffc-18d3-4560-b4ad-98d3e7c2fb4b service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:55:27.673336 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-a34ac424-dd26-4e02-9798-cd911e158dad req-3ae04ffc-18d3-4560-b4ad-98d3e7c2fb4b service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:55:27.685857 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-a34ac424-dd26-4e02-9798-cd911e158dad req-3ae04ffc-18d3-4560-b4ad-98d3e7c2fb4b service nova] Creating event network-changed:aac17ba0-17d8-4109-84a4-366867d1321a for instance 16cdaac8-bb7a-405f-9bc6-1e7b17194689 on n-h2-860284-1 Oct 04 22:55:27.691006 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-a34ac424-dd26-4e02-9798-cd911e158dad req-3ae04ffc-18d3-4560-b4ad-98d3e7c2fb4b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091537 Oct 04 22:55:27.691665 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3274/7370] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:55:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:56:39.599183 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=2 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:56:39.599992 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=6 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:56:39.602542 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=7 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:56:39.603329 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=38 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:56:39.655860 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-86833bc1-b237-4d84-9ee2-c476c6670753 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:56:39.658273 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-86833bc1-b237-4d84-9ee2-c476c6670753 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: 16cdaac8-bb7a-405f-9bc6-1e7b17194689] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:56:39.664634 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-86833bc1-b237-4d84-9ee2-c476c6670753 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:56:39.665340 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-86833bc1-b237-4d84-9ee2-c476c6670753 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:56:39.665802 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-86833bc1-b237-4d84-9ee2-c476c6670753 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:56:39.666594 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-86833bc1-b237-4d84-9ee2-c476c6670753 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:56:39.667074 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-86833bc1-b237-4d84-9ee2-c476c6670753 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:56:39.667527 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-86833bc1-b237-4d84-9ee2-c476c6670753 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:56:39.696825 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-86833bc1-b237-4d84-9ee2-c476c6670753 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'aad9d55ccfe74ffb914f02030529523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ad9e4338314c269afb0cfcebe03584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:56:39.703009 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-86833bc1-b237-4d84-9ee2-c476c6670753 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: 16cdaac8-bb7a-405f-9bc6-1e7b17194689] Old instance type m1.heat2, new instance type m1.heat {{(pid=134101) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 04 22:56:39.709727 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-86833bc1-b237-4d84-9ee2-c476c6670753 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Flavor limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 22:56:39.710165 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-86833bc1-b237-4d84-9ee2-c476c6670753 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Image limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 22:56:39.710684 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-86833bc1-b237-4d84-9ee2-c476c6670753 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Flavor pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 22:56:39.711109 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-86833bc1-b237-4d84-9ee2-c476c6670753 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Image pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 22:56:39.711538 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-86833bc1-b237-4d84-9ee2-c476c6670753 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 22:56:39.774178 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-86833bc1-b237-4d84-9ee2-c476c6670753 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "POST /compute/v2.1/servers/16cdaac8-bb7a-405f-9bc6-1e7b17194689/action" status: 202 len: 0 microversion: 2.1 time: 0.176036 Oct 04 22:56:39.774835 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4097/7371] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 22:56:39 2022] POST /compute/v2.1/servers/16cdaac8-bb7a-405f-9bc6-1e7b17194689/action => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 22:56:39.782889 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_api:SELECT=9 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:56:39.783642 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=58,nova_cell1:UPDATE=1 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:56:39.784827 n-d-860284-1 devstack@n-api.service[134102]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 22:56:39.784963 n-d-860284-1 devstack@n-api.service[134102]: Tue Oct 4 22:56:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/16cdaac8-bb7a-405f-9bc6-1e7b17194689 (ip 10.222.0.43) !!! Oct 04 22:56:39.791396 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-16cbfee3-07cf-4833-8ae3-85ba700075ad tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:56:39.792102 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-16cbfee3-07cf-4833-8ae3-85ba700075ad tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: 16cdaac8-bb7a-405f-9bc6-1e7b17194689] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:56:39.800719 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-16cbfee3-07cf-4833-8ae3-85ba700075ad tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:56:39.801414 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-16cbfee3-07cf-4833-8ae3-85ba700075ad tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:56:39.801889 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-16cbfee3-07cf-4833-8ae3-85ba700075ad tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:56:39.802635 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-16cbfee3-07cf-4833-8ae3-85ba700075ad tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:56:39.803093 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-16cbfee3-07cf-4833-8ae3-85ba700075ad tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:56:39.803519 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-16cbfee3-07cf-4833-8ae3-85ba700075ad tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:56:39.941215 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-16cbfee3-07cf-4833-8ae3-85ba700075ad tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad9d55ccfe74ffb914f02030529523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ad9e4338314c269afb0cfcebe03584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:56:39.949156 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-16cbfee3-07cf-4833-8ae3-85ba700075ad tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/16cdaac8-bb7a-405f-9bc6-1e7b17194689" status: 200 len: 1676 microversion: 2.1 time: 0.169123 Oct 04 22:56:39.949738 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3275/7372] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:56:39 2022] GET /compute/v2.1/servers/16cdaac8-bb7a-405f-9bc6-1e7b17194689 => generated 1676 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:56:40.973996 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-dddd26b0-43ee-4ecb-8df4-6b46384c9e5f tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:56:40.974793 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-dddd26b0-43ee-4ecb-8df4-6b46384c9e5f tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: 16cdaac8-bb7a-405f-9bc6-1e7b17194689] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:56:40.982618 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dddd26b0-43ee-4ecb-8df4-6b46384c9e5f tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:56:40.983134 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dddd26b0-43ee-4ecb-8df4-6b46384c9e5f tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:56:40.983602 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dddd26b0-43ee-4ecb-8df4-6b46384c9e5f tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:56:40.984328 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dddd26b0-43ee-4ecb-8df4-6b46384c9e5f tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:56:40.984836 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dddd26b0-43ee-4ecb-8df4-6b46384c9e5f tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:56:40.985282 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dddd26b0-43ee-4ecb-8df4-6b46384c9e5f tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:56:41.121936 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-dddd26b0-43ee-4ecb-8df4-6b46384c9e5f tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad9d55ccfe74ffb914f02030529523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ad9e4338314c269afb0cfcebe03584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:56:41.129953 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-dddd26b0-43ee-4ecb-8df4-6b46384c9e5f tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/16cdaac8-bb7a-405f-9bc6-1e7b17194689" status: 200 len: 1676 microversion: 2.1 time: 0.160802 Oct 04 22:56:41.130754 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4098/7373] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:56:40 2022] GET /compute/v2.1/servers/16cdaac8-bb7a-405f-9bc6-1e7b17194689 => generated 1676 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:56:42.153699 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-8d8f35de-8109-49fe-aede-a5f27cbffbdc tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:56:42.154321 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-8d8f35de-8109-49fe-aede-a5f27cbffbdc tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: 16cdaac8-bb7a-405f-9bc6-1e7b17194689] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:56:42.161294 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8d8f35de-8109-49fe-aede-a5f27cbffbdc tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:56:42.161786 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8d8f35de-8109-49fe-aede-a5f27cbffbdc tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:56:42.162229 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8d8f35de-8109-49fe-aede-a5f27cbffbdc tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:56:42.162953 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8d8f35de-8109-49fe-aede-a5f27cbffbdc tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:56:42.163416 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8d8f35de-8109-49fe-aede-a5f27cbffbdc tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:56:42.163849 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8d8f35de-8109-49fe-aede-a5f27cbffbdc tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:56:42.292823 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-8d8f35de-8109-49fe-aede-a5f27cbffbdc tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad9d55ccfe74ffb914f02030529523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ad9e4338314c269afb0cfcebe03584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:56:42.301750 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-8d8f35de-8109-49fe-aede-a5f27cbffbdc tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/16cdaac8-bb7a-405f-9bc6-1e7b17194689" status: 200 len: 1681 microversion: 2.1 time: 0.152512 Oct 04 22:56:42.302408 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3276/7374] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:56:42 2022] GET /compute/v2.1/servers/16cdaac8-bb7a-405f-9bc6-1e7b17194689 => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:56:43.327102 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-09e304db-5301-489d-b8ee-59a8840b4b11 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:56:43.327736 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-09e304db-5301-489d-b8ee-59a8840b4b11 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: 16cdaac8-bb7a-405f-9bc6-1e7b17194689] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:56:43.335396 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-09e304db-5301-489d-b8ee-59a8840b4b11 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:56:43.335893 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-09e304db-5301-489d-b8ee-59a8840b4b11 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:56:43.336347 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-09e304db-5301-489d-b8ee-59a8840b4b11 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:56:43.337055 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-09e304db-5301-489d-b8ee-59a8840b4b11 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:56:43.337529 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-09e304db-5301-489d-b8ee-59a8840b4b11 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:56:43.337972 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-09e304db-5301-489d-b8ee-59a8840b4b11 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:56:43.473582 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-09e304db-5301-489d-b8ee-59a8840b4b11 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad9d55ccfe74ffb914f02030529523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ad9e4338314c269afb0cfcebe03584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:56:43.481355 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-09e304db-5301-489d-b8ee-59a8840b4b11 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/16cdaac8-bb7a-405f-9bc6-1e7b17194689" status: 200 len: 1681 microversion: 2.1 time: 0.158258 Oct 04 22:56:43.481928 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4099/7375] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:56:43 2022] GET /compute/v2.1/servers/16cdaac8-bb7a-405f-9bc6-1e7b17194689 => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:56:44.506011 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-587ef950-603b-46d6-8ea1-c13779e46643 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:56:44.506567 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-587ef950-603b-46d6-8ea1-c13779e46643 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: 16cdaac8-bb7a-405f-9bc6-1e7b17194689] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:56:44.513294 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-587ef950-603b-46d6-8ea1-c13779e46643 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:56:44.513773 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-587ef950-603b-46d6-8ea1-c13779e46643 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:56:44.514207 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-587ef950-603b-46d6-8ea1-c13779e46643 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:56:44.514930 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-587ef950-603b-46d6-8ea1-c13779e46643 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:56:44.515384 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-587ef950-603b-46d6-8ea1-c13779e46643 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:56:44.515807 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-587ef950-603b-46d6-8ea1-c13779e46643 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:56:44.649798 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-587ef950-603b-46d6-8ea1-c13779e46643 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad9d55ccfe74ffb914f02030529523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ad9e4338314c269afb0cfcebe03584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:56:44.658093 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-587ef950-603b-46d6-8ea1-c13779e46643 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/16cdaac8-bb7a-405f-9bc6-1e7b17194689" status: 200 len: 1681 microversion: 2.1 time: 0.156134 Oct 04 22:56:44.658734 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3277/7376] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:56:44 2022] GET /compute/v2.1/servers/16cdaac8-bb7a-405f-9bc6-1e7b17194689 => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:56:45.681108 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-21daa799-f7d0-4892-af0f-d53526ba2c85 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:56:45.681740 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-21daa799-f7d0-4892-af0f-d53526ba2c85 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: 16cdaac8-bb7a-405f-9bc6-1e7b17194689] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:56:45.689203 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-21daa799-f7d0-4892-af0f-d53526ba2c85 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:56:45.689734 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-21daa799-f7d0-4892-af0f-d53526ba2c85 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:56:45.690185 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-21daa799-f7d0-4892-af0f-d53526ba2c85 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:56:45.690921 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-21daa799-f7d0-4892-af0f-d53526ba2c85 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:56:45.691391 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-21daa799-f7d0-4892-af0f-d53526ba2c85 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:56:45.691837 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-21daa799-f7d0-4892-af0f-d53526ba2c85 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:56:45.824902 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-21daa799-f7d0-4892-af0f-d53526ba2c85 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad9d55ccfe74ffb914f02030529523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ad9e4338314c269afb0cfcebe03584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:56:45.832718 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-21daa799-f7d0-4892-af0f-d53526ba2c85 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/16cdaac8-bb7a-405f-9bc6-1e7b17194689" status: 200 len: 1681 microversion: 2.1 time: 0.155756 Oct 04 22:56:45.833304 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4100/7377] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:56:45 2022] GET /compute/v2.1/servers/16cdaac8-bb7a-405f-9bc6-1e7b17194689 => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:56:46.856662 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-bc39e594-2627-48b8-be56-90feb711405e tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:56:46.857268 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-bc39e594-2627-48b8-be56-90feb711405e tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: 16cdaac8-bb7a-405f-9bc6-1e7b17194689] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:56:46.864069 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bc39e594-2627-48b8-be56-90feb711405e tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:56:46.864547 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bc39e594-2627-48b8-be56-90feb711405e tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:56:46.864982 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bc39e594-2627-48b8-be56-90feb711405e tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:56:46.865665 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bc39e594-2627-48b8-be56-90feb711405e tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:56:46.866119 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bc39e594-2627-48b8-be56-90feb711405e tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:56:46.866568 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bc39e594-2627-48b8-be56-90feb711405e tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:56:46.999576 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-bc39e594-2627-48b8-be56-90feb711405e tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad9d55ccfe74ffb914f02030529523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ad9e4338314c269afb0cfcebe03584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:56:47.007788 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-bc39e594-2627-48b8-be56-90feb711405e tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/16cdaac8-bb7a-405f-9bc6-1e7b17194689" status: 200 len: 1681 microversion: 2.1 time: 0.155019 Oct 04 22:56:47.008372 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3278/7378] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:56:46 2022] GET /compute/v2.1/servers/16cdaac8-bb7a-405f-9bc6-1e7b17194689 => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:56:48.031423 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-a27e547d-3288-4bed-82d7-9cf05e0035b4 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:56:48.032045 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-a27e547d-3288-4bed-82d7-9cf05e0035b4 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: 16cdaac8-bb7a-405f-9bc6-1e7b17194689] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:56:48.035315 n-d-860284-1 devstack@n-api.service[134101]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 22:56:48.035459 n-d-860284-1 devstack@n-api.service[134101]: Tue Oct 4 22:56:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/16cdaac8-bb7a-405f-9bc6-1e7b17194689 (ip 10.222.0.43) !!! Oct 04 22:56:48.042947 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a27e547d-3288-4bed-82d7-9cf05e0035b4 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:56:48.043457 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a27e547d-3288-4bed-82d7-9cf05e0035b4 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:56:48.043916 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a27e547d-3288-4bed-82d7-9cf05e0035b4 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:56:48.044640 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a27e547d-3288-4bed-82d7-9cf05e0035b4 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:56:48.045118 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a27e547d-3288-4bed-82d7-9cf05e0035b4 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:56:48.045570 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a27e547d-3288-4bed-82d7-9cf05e0035b4 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:56:48.176549 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-a27e547d-3288-4bed-82d7-9cf05e0035b4 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad9d55ccfe74ffb914f02030529523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ad9e4338314c269afb0cfcebe03584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:56:48.184592 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-a27e547d-3288-4bed-82d7-9cf05e0035b4 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/16cdaac8-bb7a-405f-9bc6-1e7b17194689" status: 200 len: 1681 microversion: 2.1 time: 0.157056 Oct 04 22:56:48.185161 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4101/7379] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:56:48 2022] GET /compute/v2.1/servers/16cdaac8-bb7a-405f-9bc6-1e7b17194689 => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:56:49.208679 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-1bc915d0-61fc-4a92-83a4-beb904ac7149 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:56:49.209191 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-1bc915d0-61fc-4a92-83a4-beb904ac7149 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: 16cdaac8-bb7a-405f-9bc6-1e7b17194689] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:56:49.216182 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1bc915d0-61fc-4a92-83a4-beb904ac7149 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:56:49.216674 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1bc915d0-61fc-4a92-83a4-beb904ac7149 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:56:49.217118 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1bc915d0-61fc-4a92-83a4-beb904ac7149 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:56:49.217822 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1bc915d0-61fc-4a92-83a4-beb904ac7149 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:56:49.218313 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1bc915d0-61fc-4a92-83a4-beb904ac7149 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:56:49.218768 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1bc915d0-61fc-4a92-83a4-beb904ac7149 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:56:49.347205 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-1bc915d0-61fc-4a92-83a4-beb904ac7149 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad9d55ccfe74ffb914f02030529523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ad9e4338314c269afb0cfcebe03584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:56:49.354974 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-1bc915d0-61fc-4a92-83a4-beb904ac7149 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/16cdaac8-bb7a-405f-9bc6-1e7b17194689" status: 200 len: 1681 microversion: 2.1 time: 0.150793 Oct 04 22:56:49.355567 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3279/7380] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:56:49 2022] GET /compute/v2.1/servers/16cdaac8-bb7a-405f-9bc6-1e7b17194689 => generated 1681 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:56:50.379546 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-51d4a162-6457-44a8-ad7f-af800a5954a9 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:56:50.380149 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-51d4a162-6457-44a8-ad7f-af800a5954a9 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: 16cdaac8-bb7a-405f-9bc6-1e7b17194689] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:56:50.387709 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-51d4a162-6457-44a8-ad7f-af800a5954a9 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:56:50.388180 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-51d4a162-6457-44a8-ad7f-af800a5954a9 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:56:50.388641 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-51d4a162-6457-44a8-ad7f-af800a5954a9 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:56:50.389365 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-51d4a162-6457-44a8-ad7f-af800a5954a9 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:56:50.389847 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-51d4a162-6457-44a8-ad7f-af800a5954a9 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:56:50.390295 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-51d4a162-6457-44a8-ad7f-af800a5954a9 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:56:50.521542 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-51d4a162-6457-44a8-ad7f-af800a5954a9 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad9d55ccfe74ffb914f02030529523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ad9e4338314c269afb0cfcebe03584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:56:50.530497 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-51d4a162-6457-44a8-ad7f-af800a5954a9 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/16cdaac8-bb7a-405f-9bc6-1e7b17194689" status: 200 len: 1681 microversion: 2.1 time: 0.155899 Oct 04 22:56:50.531069 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4102/7381] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:56:50 2022] GET /compute/v2.1/servers/16cdaac8-bb7a-405f-9bc6-1e7b17194689 => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:56:51.553233 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-5dc95107-9b03-4d24-8976-b7c3dbdb6fff tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:56:51.553880 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-5dc95107-9b03-4d24-8976-b7c3dbdb6fff tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: 16cdaac8-bb7a-405f-9bc6-1e7b17194689] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:56:51.560837 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5dc95107-9b03-4d24-8976-b7c3dbdb6fff tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:56:51.561324 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5dc95107-9b03-4d24-8976-b7c3dbdb6fff tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:56:51.561762 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5dc95107-9b03-4d24-8976-b7c3dbdb6fff tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:56:51.562479 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5dc95107-9b03-4d24-8976-b7c3dbdb6fff tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:56:51.562946 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5dc95107-9b03-4d24-8976-b7c3dbdb6fff tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:56:51.563375 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5dc95107-9b03-4d24-8976-b7c3dbdb6fff tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:56:51.702168 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-5dc95107-9b03-4d24-8976-b7c3dbdb6fff tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad9d55ccfe74ffb914f02030529523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ad9e4338314c269afb0cfcebe03584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:56:51.710488 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-5dc95107-9b03-4d24-8976-b7c3dbdb6fff tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/16cdaac8-bb7a-405f-9bc6-1e7b17194689" status: 200 len: 1681 microversion: 2.1 time: 0.161240 Oct 04 22:56:51.711076 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3280/7382] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:56:51 2022] GET /compute/v2.1/servers/16cdaac8-bb7a-405f-9bc6-1e7b17194689 => generated 1681 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:56:52.733804 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-544dcbae-5b2f-437b-92a8-ba5bb87c85a5 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:56:52.734462 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-544dcbae-5b2f-437b-92a8-ba5bb87c85a5 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: 16cdaac8-bb7a-405f-9bc6-1e7b17194689] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:56:52.742229 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-544dcbae-5b2f-437b-92a8-ba5bb87c85a5 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:56:52.742760 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-544dcbae-5b2f-437b-92a8-ba5bb87c85a5 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:56:52.743214 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-544dcbae-5b2f-437b-92a8-ba5bb87c85a5 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:56:52.743924 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-544dcbae-5b2f-437b-92a8-ba5bb87c85a5 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:56:52.744396 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-544dcbae-5b2f-437b-92a8-ba5bb87c85a5 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:56:52.744841 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-544dcbae-5b2f-437b-92a8-ba5bb87c85a5 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:56:52.878989 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-544dcbae-5b2f-437b-92a8-ba5bb87c85a5 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad9d55ccfe74ffb914f02030529523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ad9e4338314c269afb0cfcebe03584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:56:52.886932 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-544dcbae-5b2f-437b-92a8-ba5bb87c85a5 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/16cdaac8-bb7a-405f-9bc6-1e7b17194689" status: 200 len: 1681 microversion: 2.1 time: 0.157076 Oct 04 22:56:52.887514 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4103/7383] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:56:52 2022] GET /compute/v2.1/servers/16cdaac8-bb7a-405f-9bc6-1e7b17194689 => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:56:53.910651 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-728e4ac6-aca5-4ac5-8c6d-d5717467e700 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:56:53.911295 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-728e4ac6-aca5-4ac5-8c6d-d5717467e700 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: 16cdaac8-bb7a-405f-9bc6-1e7b17194689] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:56:53.918022 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-728e4ac6-aca5-4ac5-8c6d-d5717467e700 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:56:53.918536 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-728e4ac6-aca5-4ac5-8c6d-d5717467e700 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:56:53.918975 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-728e4ac6-aca5-4ac5-8c6d-d5717467e700 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:56:53.919670 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-728e4ac6-aca5-4ac5-8c6d-d5717467e700 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:56:53.920121 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-728e4ac6-aca5-4ac5-8c6d-d5717467e700 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:56:53.920544 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-728e4ac6-aca5-4ac5-8c6d-d5717467e700 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:56:54.135522 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-728e4ac6-aca5-4ac5-8c6d-d5717467e700 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad9d55ccfe74ffb914f02030529523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ad9e4338314c269afb0cfcebe03584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:56:54.143504 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-728e4ac6-aca5-4ac5-8c6d-d5717467e700 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/16cdaac8-bb7a-405f-9bc6-1e7b17194689" status: 200 len: 1680 microversion: 2.1 time: 0.236681 Oct 04 22:56:54.144166 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3281/7384] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:56:53 2022] GET /compute/v2.1/servers/16cdaac8-bb7a-405f-9bc6-1e7b17194689 => generated 1680 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:56:54.228007 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-4d03519e-955c-48ef-8c5e-9106b5028041 req-a7b93594-2c24-4839-b87c-a930f824cc94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16cdaac8-bb7a-405f-9bc6-1e7b17194689", "name": "network-vif-unplugged", "status": "completed", "tag": "aac17ba0-17d8-4109-84a4-366867d1321a"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:56:54.239563 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-4d03519e-955c-48ef-8c5e-9106b5028041 req-a7b93594-2c24-4839-b87c-a930f824cc94 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:56:54.240062 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-4d03519e-955c-48ef-8c5e-9106b5028041 req-a7b93594-2c24-4839-b87c-a930f824cc94 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:56:54.240509 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-4d03519e-955c-48ef-8c5e-9106b5028041 req-a7b93594-2c24-4839-b87c-a930f824cc94 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:56:54.252881 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-4d03519e-955c-48ef-8c5e-9106b5028041 req-a7b93594-2c24-4839-b87c-a930f824cc94 service nova] Creating event network-vif-unplugged:aac17ba0-17d8-4109-84a4-366867d1321a for instance 16cdaac8-bb7a-405f-9bc6-1e7b17194689 on n-h1-860284-1 Oct 04 22:56:54.258238 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [req-4d03519e-955c-48ef-8c5e-9106b5028041 req-a7b93594-2c24-4839-b87c-a930f824cc94 service nova] Instance 16cdaac8-bb7a-405f-9bc6-1e7b17194689 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860284-1', 'n-h1-860284-1'} {{(pid=134101) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 22:56:54.269068 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-4d03519e-955c-48ef-8c5e-9106b5028041 req-a7b93594-2c24-4839-b87c-a930f824cc94 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045047 Oct 04 22:56:54.269679 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4104/7385] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:56:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:56:55.167862 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-d12d9b6b-377a-4501-86fb-c97389c438a2 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:56:55.168483 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-d12d9b6b-377a-4501-86fb-c97389c438a2 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: 16cdaac8-bb7a-405f-9bc6-1e7b17194689] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:56:55.175429 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d12d9b6b-377a-4501-86fb-c97389c438a2 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:56:55.175933 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d12d9b6b-377a-4501-86fb-c97389c438a2 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:56:55.176374 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d12d9b6b-377a-4501-86fb-c97389c438a2 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:56:55.177080 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d12d9b6b-377a-4501-86fb-c97389c438a2 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:56:55.177542 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d12d9b6b-377a-4501-86fb-c97389c438a2 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:56:55.177972 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d12d9b6b-377a-4501-86fb-c97389c438a2 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:56:55.367873 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-d12d9b6b-377a-4501-86fb-c97389c438a2 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad9d55ccfe74ffb914f02030529523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ad9e4338314c269afb0cfcebe03584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:56:55.375986 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-d12d9b6b-377a-4501-86fb-c97389c438a2 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/16cdaac8-bb7a-405f-9bc6-1e7b17194689" status: 200 len: 1680 microversion: 2.1 time: 0.212256 Oct 04 22:56:55.376579 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3282/7386] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:56:55 2022] GET /compute/v2.1/servers/16cdaac8-bb7a-405f-9bc6-1e7b17194689 => generated 1680 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:56:56.313587 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-347727a0-be77-4ff6-b62a-32602094fe49 req-ed8b73bb-0d4b-49c1-8bd1-1a47c0b50647 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16cdaac8-bb7a-405f-9bc6-1e7b17194689", "tag": "aac17ba0-17d8-4109-84a4-366867d1321a"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:56:56.323987 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-347727a0-be77-4ff6-b62a-32602094fe49 req-ed8b73bb-0d4b-49c1-8bd1-1a47c0b50647 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:56:56.324482 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-347727a0-be77-4ff6-b62a-32602094fe49 req-ed8b73bb-0d4b-49c1-8bd1-1a47c0b50647 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:56:56.324930 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-347727a0-be77-4ff6-b62a-32602094fe49 req-ed8b73bb-0d4b-49c1-8bd1-1a47c0b50647 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:56:56.336930 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-347727a0-be77-4ff6-b62a-32602094fe49 req-ed8b73bb-0d4b-49c1-8bd1-1a47c0b50647 service nova] Creating event network-changed:aac17ba0-17d8-4109-84a4-366867d1321a for instance 16cdaac8-bb7a-405f-9bc6-1e7b17194689 on n-h1-860284-1 Oct 04 22:56:56.342162 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [req-347727a0-be77-4ff6-b62a-32602094fe49 req-ed8b73bb-0d4b-49c1-8bd1-1a47c0b50647 service nova] Instance 16cdaac8-bb7a-405f-9bc6-1e7b17194689 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860284-1', 'n-h1-860284-1'} {{(pid=134101) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 22:56:56.352715 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-347727a0-be77-4ff6-b62a-32602094fe49 req-ed8b73bb-0d4b-49c1-8bd1-1a47c0b50647 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044086 Oct 04 22:56:56.353306 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4105/7387] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:56:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:56:56.400452 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-6c02e8f7-0def-48f6-a244-069db5d8e11e tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:56:56.401020 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-6c02e8f7-0def-48f6-a244-069db5d8e11e tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: 16cdaac8-bb7a-405f-9bc6-1e7b17194689] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:56:56.407491 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6c02e8f7-0def-48f6-a244-069db5d8e11e tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:56:56.407972 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6c02e8f7-0def-48f6-a244-069db5d8e11e tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:56:56.408404 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6c02e8f7-0def-48f6-a244-069db5d8e11e tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:56:56.409170 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6c02e8f7-0def-48f6-a244-069db5d8e11e tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:56:56.409626 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6c02e8f7-0def-48f6-a244-069db5d8e11e tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:56:56.410051 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6c02e8f7-0def-48f6-a244-069db5d8e11e tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:56:56.655519 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-6c02e8f7-0def-48f6-a244-069db5d8e11e tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad9d55ccfe74ffb914f02030529523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ad9e4338314c269afb0cfcebe03584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:56:56.663462 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-6c02e8f7-0def-48f6-a244-069db5d8e11e tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/16cdaac8-bb7a-405f-9bc6-1e7b17194689" status: 200 len: 1678 microversion: 2.1 time: 0.267066 Oct 04 22:56:56.664056 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3283/7388] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:56:56 2022] GET /compute/v2.1/servers/16cdaac8-bb7a-405f-9bc6-1e7b17194689 => generated 1678 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:56:57.689876 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-2587c774-881f-4435-8c4a-ae88ce688046 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:56:57.690619 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-2587c774-881f-4435-8c4a-ae88ce688046 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: 16cdaac8-bb7a-405f-9bc6-1e7b17194689] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:56:57.696739 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2587c774-881f-4435-8c4a-ae88ce688046 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:56:57.697233 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2587c774-881f-4435-8c4a-ae88ce688046 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:56:57.697683 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2587c774-881f-4435-8c4a-ae88ce688046 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:56:57.698387 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2587c774-881f-4435-8c4a-ae88ce688046 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:56:57.698870 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2587c774-881f-4435-8c4a-ae88ce688046 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:56:57.699302 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2587c774-881f-4435-8c4a-ae88ce688046 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:56:57.832747 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-2587c774-881f-4435-8c4a-ae88ce688046 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad9d55ccfe74ffb914f02030529523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ad9e4338314c269afb0cfcebe03584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:56:57.840536 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-2587c774-881f-4435-8c4a-ae88ce688046 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/16cdaac8-bb7a-405f-9bc6-1e7b17194689" status: 200 len: 1678 microversion: 2.1 time: 0.155792 Oct 04 22:56:57.841092 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4106/7389] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:56:57 2022] GET /compute/v2.1/servers/16cdaac8-bb7a-405f-9bc6-1e7b17194689 => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:56:58.864163 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-b517908f-1c6c-4d9d-a0c3-fb2202e7dd7c tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:56:58.864777 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-b517908f-1c6c-4d9d-a0c3-fb2202e7dd7c tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: 16cdaac8-bb7a-405f-9bc6-1e7b17194689] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:56:58.871712 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b517908f-1c6c-4d9d-a0c3-fb2202e7dd7c tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:56:58.872206 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b517908f-1c6c-4d9d-a0c3-fb2202e7dd7c tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:56:58.872642 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b517908f-1c6c-4d9d-a0c3-fb2202e7dd7c tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:56:58.873332 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b517908f-1c6c-4d9d-a0c3-fb2202e7dd7c tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:56:58.873784 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b517908f-1c6c-4d9d-a0c3-fb2202e7dd7c tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:56:58.874208 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b517908f-1c6c-4d9d-a0c3-fb2202e7dd7c tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:56:59.008958 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-b517908f-1c6c-4d9d-a0c3-fb2202e7dd7c tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad9d55ccfe74ffb914f02030529523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ad9e4338314c269afb0cfcebe03584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:56:59.017278 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-b517908f-1c6c-4d9d-a0c3-fb2202e7dd7c tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/16cdaac8-bb7a-405f-9bc6-1e7b17194689" status: 200 len: 1675 microversion: 2.1 time: 0.157695 Oct 04 22:56:59.018404 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3284/7390] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:56:58 2022] GET /compute/v2.1/servers/16cdaac8-bb7a-405f-9bc6-1e7b17194689 => generated 1675 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:56:59.041406 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-01727578-4f92-41ad-a19b-d11e588d857e tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:56:59.042013 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-01727578-4f92-41ad-a19b-d11e588d857e tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: 16cdaac8-bb7a-405f-9bc6-1e7b17194689] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:56:59.049400 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-01727578-4f92-41ad-a19b-d11e588d857e tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:56:59.049982 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-01727578-4f92-41ad-a19b-d11e588d857e tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:56:59.050466 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-01727578-4f92-41ad-a19b-d11e588d857e tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:56:59.051196 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-01727578-4f92-41ad-a19b-d11e588d857e tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:56:59.051668 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-01727578-4f92-41ad-a19b-d11e588d857e tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:56:59.052108 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-01727578-4f92-41ad-a19b-d11e588d857e tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:56:59.092323 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-01727578-4f92-41ad-a19b-d11e588d857e tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:56:59.092803 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-01727578-4f92-41ad-a19b-d11e588d857e tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:56:59.093254 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-01727578-4f92-41ad-a19b-d11e588d857e tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:56:59.094005 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-01727578-4f92-41ad-a19b-d11e588d857e tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:56:59.094497 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-01727578-4f92-41ad-a19b-d11e588d857e tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:56:59.094941 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-01727578-4f92-41ad-a19b-d11e588d857e tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:56:59.117360 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-01727578-4f92-41ad-a19b-d11e588d857e tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Getting quotas for project d2ad9e4338314c269afb0cfcebe03584. Resources: {'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:56:59.123117 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-01727578-4f92-41ad-a19b-d11e588d857e tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Getting quotas for user aad9d55ccfe74ffb914f02030529523d and project d2ad9e4338314c269afb0cfcebe03584. Resources: {'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:56:59.229169 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-01727578-4f92-41ad-a19b-d11e588d857e tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "POST /compute/v2.1/servers/16cdaac8-bb7a-405f-9bc6-1e7b17194689/action" status: 202 len: 0 microversion: 2.1 time: 0.191676 Oct 04 22:56:59.229837 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4107/7391] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 22:56:59 2022] POST /compute/v2.1/servers/16cdaac8-bb7a-405f-9bc6-1e7b17194689/action => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 22:56:59.238056 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-c1872ef7-3fd9-4cae-a048-bf98d7c7726c tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:56:59.238702 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-c1872ef7-3fd9-4cae-a048-bf98d7c7726c tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: 16cdaac8-bb7a-405f-9bc6-1e7b17194689] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:56:59.244674 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c1872ef7-3fd9-4cae-a048-bf98d7c7726c tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:56:59.245162 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c1872ef7-3fd9-4cae-a048-bf98d7c7726c tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:56:59.245601 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c1872ef7-3fd9-4cae-a048-bf98d7c7726c tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:56:59.246680 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c1872ef7-3fd9-4cae-a048-bf98d7c7726c tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:56:59.247078 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c1872ef7-3fd9-4cae-a048-bf98d7c7726c tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:56:59.247482 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c1872ef7-3fd9-4cae-a048-bf98d7c7726c tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:56:59.451219 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-c1872ef7-3fd9-4cae-a048-bf98d7c7726c tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad9d55ccfe74ffb914f02030529523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ad9e4338314c269afb0cfcebe03584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:56:59.459704 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-c1872ef7-3fd9-4cae-a048-bf98d7c7726c tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/16cdaac8-bb7a-405f-9bc6-1e7b17194689" status: 200 len: 1674 microversion: 2.1 time: 0.225701 Oct 04 22:56:59.460294 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3285/7392] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:56:59 2022] GET /compute/v2.1/servers/16cdaac8-bb7a-405f-9bc6-1e7b17194689 => generated 1674 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:57:00.485434 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-4acd71a7-7f9c-4fc7-90e1-05714cad5e5c tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:57:00.486194 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-4acd71a7-7f9c-4fc7-90e1-05714cad5e5c tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: 16cdaac8-bb7a-405f-9bc6-1e7b17194689] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:57:00.494080 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4acd71a7-7f9c-4fc7-90e1-05714cad5e5c tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:57:00.494618 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4acd71a7-7f9c-4fc7-90e1-05714cad5e5c tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:57:00.495078 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4acd71a7-7f9c-4fc7-90e1-05714cad5e5c tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:57:00.495796 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4acd71a7-7f9c-4fc7-90e1-05714cad5e5c tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:57:00.496535 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4acd71a7-7f9c-4fc7-90e1-05714cad5e5c tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:57:00.496980 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4acd71a7-7f9c-4fc7-90e1-05714cad5e5c tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:57:00.533955 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-72ff9c1c-5875-4ebb-a19d-8d4075d165b0 req-496228a4-b668-424d-80e6-fc4f1cfe7c70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16cdaac8-bb7a-405f-9bc6-1e7b17194689", "name": "network-vif-plugged", "status": "completed", "tag": "aac17ba0-17d8-4109-84a4-366867d1321a"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:57:00.545853 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-72ff9c1c-5875-4ebb-a19d-8d4075d165b0 req-496228a4-b668-424d-80e6-fc4f1cfe7c70 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:57:00.546351 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-72ff9c1c-5875-4ebb-a19d-8d4075d165b0 req-496228a4-b668-424d-80e6-fc4f1cfe7c70 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:57:00.547029 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-72ff9c1c-5875-4ebb-a19d-8d4075d165b0 req-496228a4-b668-424d-80e6-fc4f1cfe7c70 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:57:00.562436 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-72ff9c1c-5875-4ebb-a19d-8d4075d165b0 req-496228a4-b668-424d-80e6-fc4f1cfe7c70 service nova] Creating event network-vif-plugged:aac17ba0-17d8-4109-84a4-366867d1321a for instance 16cdaac8-bb7a-405f-9bc6-1e7b17194689 on n-h1-860284-1 Oct 04 22:57:00.568965 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [req-72ff9c1c-5875-4ebb-a19d-8d4075d165b0 req-496228a4-b668-424d-80e6-fc4f1cfe7c70 service nova] Instance 16cdaac8-bb7a-405f-9bc6-1e7b17194689 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860284-1', 'n-h1-860284-1'} {{(pid=134102) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 22:57:00.580454 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-72ff9c1c-5875-4ebb-a19d-8d4075d165b0 req-496228a4-b668-424d-80e6-fc4f1cfe7c70 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050268 Oct 04 22:57:00.581211 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3286/7393] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:57:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:57:00.644595 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-4acd71a7-7f9c-4fc7-90e1-05714cad5e5c tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad9d55ccfe74ffb914f02030529523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ad9e4338314c269afb0cfcebe03584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:57:00.652457 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-4acd71a7-7f9c-4fc7-90e1-05714cad5e5c tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/16cdaac8-bb7a-405f-9bc6-1e7b17194689" status: 200 len: 1674 microversion: 2.1 time: 0.172474 Oct 04 22:57:00.653046 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4108/7394] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:57:00 2022] GET /compute/v2.1/servers/16cdaac8-bb7a-405f-9bc6-1e7b17194689 => generated 1674 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:57:01.677883 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-8ff18125-ae7a-4cd7-82f2-461f17cffb2e tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:57:01.678633 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-8ff18125-ae7a-4cd7-82f2-461f17cffb2e tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: 16cdaac8-bb7a-405f-9bc6-1e7b17194689] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:57:01.684736 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8ff18125-ae7a-4cd7-82f2-461f17cffb2e tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:57:01.685216 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8ff18125-ae7a-4cd7-82f2-461f17cffb2e tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:57:01.685649 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8ff18125-ae7a-4cd7-82f2-461f17cffb2e tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:57:01.686379 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8ff18125-ae7a-4cd7-82f2-461f17cffb2e tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:57:01.686841 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8ff18125-ae7a-4cd7-82f2-461f17cffb2e tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:57:01.687264 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8ff18125-ae7a-4cd7-82f2-461f17cffb2e tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:57:01.819911 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-8ff18125-ae7a-4cd7-82f2-461f17cffb2e tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad9d55ccfe74ffb914f02030529523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ad9e4338314c269afb0cfcebe03584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:57:01.831528 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-8ff18125-ae7a-4cd7-82f2-461f17cffb2e tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/16cdaac8-bb7a-405f-9bc6-1e7b17194689" status: 200 len: 1674 microversion: 2.1 time: 0.159490 Oct 04 22:57:01.832133 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3287/7395] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:57:01 2022] GET /compute/v2.1/servers/16cdaac8-bb7a-405f-9bc6-1e7b17194689 => generated 1674 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:57:02.489202 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-b2e4fd3b-f8c0-4223-994a-018a47d5ce6a req-886c5d14-9516-40ec-a803-27c03fb62198 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16cdaac8-bb7a-405f-9bc6-1e7b17194689", "name": "network-vif-unplugged", "status": "completed", "tag": "aac17ba0-17d8-4109-84a4-366867d1321a"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:57:02.500260 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-b2e4fd3b-f8c0-4223-994a-018a47d5ce6a req-886c5d14-9516-40ec-a803-27c03fb62198 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:57:02.500758 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-b2e4fd3b-f8c0-4223-994a-018a47d5ce6a req-886c5d14-9516-40ec-a803-27c03fb62198 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:57:02.501209 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-b2e4fd3b-f8c0-4223-994a-018a47d5ce6a req-886c5d14-9516-40ec-a803-27c03fb62198 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:57:02.513539 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-b2e4fd3b-f8c0-4223-994a-018a47d5ce6a req-886c5d14-9516-40ec-a803-27c03fb62198 service nova] Creating event network-vif-unplugged:aac17ba0-17d8-4109-84a4-366867d1321a for instance 16cdaac8-bb7a-405f-9bc6-1e7b17194689 on n-h2-860284-1 Oct 04 22:57:02.518972 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [req-b2e4fd3b-f8c0-4223-994a-018a47d5ce6a req-886c5d14-9516-40ec-a803-27c03fb62198 service nova] Instance 16cdaac8-bb7a-405f-9bc6-1e7b17194689 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860284-1', 'n-h2-860284-1'} {{(pid=134101) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 22:57:02.530351 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-b2e4fd3b-f8c0-4223-994a-018a47d5ce6a req-886c5d14-9516-40ec-a803-27c03fb62198 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045595 Oct 04 22:57:02.530993 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4109/7396] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:57:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:57:02.855205 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-a6f25105-fa99-4ed5-ae94-8157aaa3acd0 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:57:02.855826 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-a6f25105-fa99-4ed5-ae94-8157aaa3acd0 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: 16cdaac8-bb7a-405f-9bc6-1e7b17194689] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:57:02.863174 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a6f25105-fa99-4ed5-ae94-8157aaa3acd0 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:57:02.863664 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a6f25105-fa99-4ed5-ae94-8157aaa3acd0 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:57:02.864109 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a6f25105-fa99-4ed5-ae94-8157aaa3acd0 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:57:02.864820 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a6f25105-fa99-4ed5-ae94-8157aaa3acd0 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:57:02.865322 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a6f25105-fa99-4ed5-ae94-8157aaa3acd0 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:57:02.865757 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a6f25105-fa99-4ed5-ae94-8157aaa3acd0 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:57:03.125390 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-a6f25105-fa99-4ed5-ae94-8157aaa3acd0 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad9d55ccfe74ffb914f02030529523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ad9e4338314c269afb0cfcebe03584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:57:03.134220 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-a6f25105-fa99-4ed5-ae94-8157aaa3acd0 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/16cdaac8-bb7a-405f-9bc6-1e7b17194689" status: 200 len: 1674 microversion: 2.1 time: 0.282842 Oct 04 22:57:03.135321 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3288/7397] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:57:02 2022] GET /compute/v2.1/servers/16cdaac8-bb7a-405f-9bc6-1e7b17194689 => generated 1674 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:57:04.160752 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-1eaba316-9069-40d1-b636-7b45dfc730d2 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:57:04.161487 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-1eaba316-9069-40d1-b636-7b45dfc730d2 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: 16cdaac8-bb7a-405f-9bc6-1e7b17194689] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:57:04.167821 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1eaba316-9069-40d1-b636-7b45dfc730d2 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:57:04.168321 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1eaba316-9069-40d1-b636-7b45dfc730d2 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:57:04.168774 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1eaba316-9069-40d1-b636-7b45dfc730d2 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:57:04.169482 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1eaba316-9069-40d1-b636-7b45dfc730d2 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:57:04.169953 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1eaba316-9069-40d1-b636-7b45dfc730d2 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:57:04.170431 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1eaba316-9069-40d1-b636-7b45dfc730d2 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:57:04.174501 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:57:04.304898 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-1eaba316-9069-40d1-b636-7b45dfc730d2 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad9d55ccfe74ffb914f02030529523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ad9e4338314c269afb0cfcebe03584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:57:04.312699 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-1eaba316-9069-40d1-b636-7b45dfc730d2 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/16cdaac8-bb7a-405f-9bc6-1e7b17194689" status: 200 len: 1674 microversion: 2.1 time: 0.157723 Oct 04 22:57:04.313276 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4110/7398] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:57:04 2022] GET /compute/v2.1/servers/16cdaac8-bb7a-405f-9bc6-1e7b17194689 => generated 1674 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:57:04.571173 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-df1f48f1-9175-4b4b-81fd-973845099bcd req-ee7cb71c-ffb1-419c-9abd-f1ba2578d89e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16cdaac8-bb7a-405f-9bc6-1e7b17194689", "tag": "aac17ba0-17d8-4109-84a4-366867d1321a"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:57:04.581891 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-df1f48f1-9175-4b4b-81fd-973845099bcd req-ee7cb71c-ffb1-419c-9abd-f1ba2578d89e service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:57:04.582388 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-df1f48f1-9175-4b4b-81fd-973845099bcd req-ee7cb71c-ffb1-419c-9abd-f1ba2578d89e service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:57:04.582819 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-df1f48f1-9175-4b4b-81fd-973845099bcd req-ee7cb71c-ffb1-419c-9abd-f1ba2578d89e service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:57:04.594193 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-df1f48f1-9175-4b4b-81fd-973845099bcd req-ee7cb71c-ffb1-419c-9abd-f1ba2578d89e service nova] Creating event network-changed:aac17ba0-17d8-4109-84a4-366867d1321a for instance 16cdaac8-bb7a-405f-9bc6-1e7b17194689 on n-h2-860284-1 Oct 04 22:57:04.599545 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [req-df1f48f1-9175-4b4b-81fd-973845099bcd req-ee7cb71c-ffb1-419c-9abd-f1ba2578d89e service nova] Instance 16cdaac8-bb7a-405f-9bc6-1e7b17194689 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860284-1', 'n-h2-860284-1'} {{(pid=134102) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 22:57:04.610328 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-df1f48f1-9175-4b4b-81fd-973845099bcd req-ee7cb71c-ffb1-419c-9abd-f1ba2578d89e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042834 Oct 04 22:57:04.610977 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3289/7399] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:57:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:57:05.336470 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-a2a145cb-c3bb-45c8-8629-e1170fe7ac2c tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:57:05.337127 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-a2a145cb-c3bb-45c8-8629-e1170fe7ac2c tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: 16cdaac8-bb7a-405f-9bc6-1e7b17194689] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:57:05.344060 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a2a145cb-c3bb-45c8-8629-e1170fe7ac2c tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:57:05.344563 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a2a145cb-c3bb-45c8-8629-e1170fe7ac2c tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:57:05.345017 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a2a145cb-c3bb-45c8-8629-e1170fe7ac2c tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:57:05.345727 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a2a145cb-c3bb-45c8-8629-e1170fe7ac2c tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:57:05.346791 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a2a145cb-c3bb-45c8-8629-e1170fe7ac2c tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:57:05.347243 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a2a145cb-c3bb-45c8-8629-e1170fe7ac2c tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:57:05.476258 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-a2a145cb-c3bb-45c8-8629-e1170fe7ac2c tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad9d55ccfe74ffb914f02030529523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ad9e4338314c269afb0cfcebe03584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:57:05.484024 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-a2a145cb-c3bb-45c8-8629-e1170fe7ac2c tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/16cdaac8-bb7a-405f-9bc6-1e7b17194689" status: 200 len: 1674 microversion: 2.1 time: 0.151513 Oct 04 22:57:05.484601 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4111/7400] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:57:05 2022] GET /compute/v2.1/servers/16cdaac8-bb7a-405f-9bc6-1e7b17194689 => generated 1674 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:57:06.510209 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-209273ef-d39f-4c6f-ae45-f6e62a704c57 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:57:06.510955 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-209273ef-d39f-4c6f-ae45-f6e62a704c57 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: 16cdaac8-bb7a-405f-9bc6-1e7b17194689] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:57:06.517277 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-209273ef-d39f-4c6f-ae45-f6e62a704c57 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:57:06.517874 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-209273ef-d39f-4c6f-ae45-f6e62a704c57 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:57:06.518630 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-209273ef-d39f-4c6f-ae45-f6e62a704c57 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:57:06.519343 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-209273ef-d39f-4c6f-ae45-f6e62a704c57 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:57:06.519812 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-209273ef-d39f-4c6f-ae45-f6e62a704c57 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:57:06.520247 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-209273ef-d39f-4c6f-ae45-f6e62a704c57 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:57:06.654128 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-209273ef-d39f-4c6f-ae45-f6e62a704c57 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad9d55ccfe74ffb914f02030529523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ad9e4338314c269afb0cfcebe03584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:57:06.661990 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-209273ef-d39f-4c6f-ae45-f6e62a704c57 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/16cdaac8-bb7a-405f-9bc6-1e7b17194689" status: 200 len: 1667 microversion: 2.1 time: 0.157137 Oct 04 22:57:06.662617 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3290/7401] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:57:06 2022] GET /compute/v2.1/servers/16cdaac8-bb7a-405f-9bc6-1e7b17194689 => generated 1667 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:57:06.684868 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-59428fc2-b2f5-4a42-992b-ed22fabce77a tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:57:06.685572 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-59428fc2-b2f5-4a42-992b-ed22fabce77a tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: 16cdaac8-bb7a-405f-9bc6-1e7b17194689] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:57:06.693109 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-59428fc2-b2f5-4a42-992b-ed22fabce77a tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:57:06.693605 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-59428fc2-b2f5-4a42-992b-ed22fabce77a tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:57:06.694334 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-59428fc2-b2f5-4a42-992b-ed22fabce77a tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:57:06.695228 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-59428fc2-b2f5-4a42-992b-ed22fabce77a tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:57:06.695708 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-59428fc2-b2f5-4a42-992b-ed22fabce77a tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:57:06.696152 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-59428fc2-b2f5-4a42-992b-ed22fabce77a tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:57:06.833108 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-59428fc2-b2f5-4a42-992b-ed22fabce77a tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad9d55ccfe74ffb914f02030529523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ad9e4338314c269afb0cfcebe03584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:57:06.841069 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-59428fc2-b2f5-4a42-992b-ed22fabce77a tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/16cdaac8-bb7a-405f-9bc6-1e7b17194689" status: 200 len: 1667 microversion: 2.1 time: 0.160207 Oct 04 22:57:06.841696 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4112/7402] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:57:06 2022] GET /compute/v2.1/servers/16cdaac8-bb7a-405f-9bc6-1e7b17194689 => generated 1667 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:57:06.864169 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-210874bf-2f1b-4b27-9501-1abe397b6437 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:57:06.864787 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-210874bf-2f1b-4b27-9501-1abe397b6437 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: 16cdaac8-bb7a-405f-9bc6-1e7b17194689] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:57:06.870726 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-210874bf-2f1b-4b27-9501-1abe397b6437 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:57:06.871473 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-210874bf-2f1b-4b27-9501-1abe397b6437 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:57:06.871914 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-210874bf-2f1b-4b27-9501-1abe397b6437 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:57:06.872614 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-210874bf-2f1b-4b27-9501-1abe397b6437 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:57:06.873070 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-210874bf-2f1b-4b27-9501-1abe397b6437 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:57:06.873500 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-210874bf-2f1b-4b27-9501-1abe397b6437 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:57:07.005574 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-210874bf-2f1b-4b27-9501-1abe397b6437 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad9d55ccfe74ffb914f02030529523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ad9e4338314c269afb0cfcebe03584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:57:07.013661 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-210874bf-2f1b-4b27-9501-1abe397b6437 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/16cdaac8-bb7a-405f-9bc6-1e7b17194689" status: 200 len: 1667 microversion: 2.1 time: 0.154073 Oct 04 22:57:07.014253 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3291/7403] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:57:06 2022] GET /compute/v2.1/servers/16cdaac8-bb7a-405f-9bc6-1e7b17194689 => generated 1667 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:57:07.036248 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-380651f5-8d8a-44e1-bf34-eb033eae8861 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:57:07.036786 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-380651f5-8d8a-44e1-bf34-eb033eae8861 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: 16cdaac8-bb7a-405f-9bc6-1e7b17194689] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:57:07.042805 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-380651f5-8d8a-44e1-bf34-eb033eae8861 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:57:07.043311 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-380651f5-8d8a-44e1-bf34-eb033eae8861 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:57:07.043782 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-380651f5-8d8a-44e1-bf34-eb033eae8861 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:57:07.044529 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-380651f5-8d8a-44e1-bf34-eb033eae8861 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:57:07.045003 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-380651f5-8d8a-44e1-bf34-eb033eae8861 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:57:07.045453 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-380651f5-8d8a-44e1-bf34-eb033eae8861 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:57:07.072193 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-380651f5-8d8a-44e1-bf34-eb033eae8861 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: 16cdaac8-bb7a-405f-9bc6-1e7b17194689] Going to try to terminate instance {{(pid=134101) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 22:57:07.150633 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-380651f5-8d8a-44e1-bf34-eb033eae8861 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "DELETE /compute/v2.1/servers/16cdaac8-bb7a-405f-9bc6-1e7b17194689" status: 204 len: 0 microversion: 2.1 time: 0.118596 Oct 04 22:57:07.151387 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4113/7404] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 22:57:07 2022] DELETE /compute/v2.1/servers/16cdaac8-bb7a-405f-9bc6-1e7b17194689 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 22:57:07.160672 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-30be4692-78b5-499d-b30a-15115f881406 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:57:07.161279 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-30be4692-78b5-499d-b30a-15115f881406 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: 16cdaac8-bb7a-405f-9bc6-1e7b17194689] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:57:07.167208 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-30be4692-78b5-499d-b30a-15115f881406 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:57:07.167693 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-30be4692-78b5-499d-b30a-15115f881406 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:57:07.168127 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-30be4692-78b5-499d-b30a-15115f881406 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:57:07.168812 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-30be4692-78b5-499d-b30a-15115f881406 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:57:07.169277 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-30be4692-78b5-499d-b30a-15115f881406 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:57:07.169683 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-30be4692-78b5-499d-b30a-15115f881406 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:57:07.173737 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=100 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:57:07.299166 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-30be4692-78b5-499d-b30a-15115f881406 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad9d55ccfe74ffb914f02030529523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ad9e4338314c269afb0cfcebe03584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:57:07.306813 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-30be4692-78b5-499d-b30a-15115f881406 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/16cdaac8-bb7a-405f-9bc6-1e7b17194689" status: 200 len: 1673 microversion: 2.1 time: 0.150823 Oct 04 22:57:07.307387 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3292/7405] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:57:07 2022] GET /compute/v2.1/servers/16cdaac8-bb7a-405f-9bc6-1e7b17194689 => generated 1673 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:57:08.331691 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-34058cd4-9879-44ac-b5a9-bbd739c899bb tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:57:08.332333 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-34058cd4-9879-44ac-b5a9-bbd739c899bb tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: 16cdaac8-bb7a-405f-9bc6-1e7b17194689] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:57:08.339268 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-34058cd4-9879-44ac-b5a9-bbd739c899bb tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:57:08.339767 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-34058cd4-9879-44ac-b5a9-bbd739c899bb tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:57:08.340222 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-34058cd4-9879-44ac-b5a9-bbd739c899bb tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:57:08.340932 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-34058cd4-9879-44ac-b5a9-bbd739c899bb tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:57:08.341478 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-34058cd4-9879-44ac-b5a9-bbd739c899bb tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:57:08.341924 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-34058cd4-9879-44ac-b5a9-bbd739c899bb tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:57:08.475283 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-34058cd4-9879-44ac-b5a9-bbd739c899bb tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad9d55ccfe74ffb914f02030529523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ad9e4338314c269afb0cfcebe03584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:57:08.483360 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-34058cd4-9879-44ac-b5a9-bbd739c899bb tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/16cdaac8-bb7a-405f-9bc6-1e7b17194689" status: 200 len: 1673 microversion: 2.1 time: 0.156772 Oct 04 22:57:08.483950 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4114/7406] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:57:08 2022] GET /compute/v2.1/servers/16cdaac8-bb7a-405f-9bc6-1e7b17194689 => generated 1673 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:57:08.609190 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-1c8d0781-ee58-4ab2-a573-4c0ea8f72ba5 req-c2bc062c-7d7e-4b40-a73b-1ad5b167402c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16cdaac8-bb7a-405f-9bc6-1e7b17194689", "name": "network-vif-plugged", "status": "completed", "tag": "aac17ba0-17d8-4109-84a4-366867d1321a"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:57:08.621617 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-1c8d0781-ee58-4ab2-a573-4c0ea8f72ba5 req-c2bc062c-7d7e-4b40-a73b-1ad5b167402c service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:57:08.622106 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-1c8d0781-ee58-4ab2-a573-4c0ea8f72ba5 req-c2bc062c-7d7e-4b40-a73b-1ad5b167402c service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:57:08.622592 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-1c8d0781-ee58-4ab2-a573-4c0ea8f72ba5 req-c2bc062c-7d7e-4b40-a73b-1ad5b167402c service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:57:08.637528 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-1c8d0781-ee58-4ab2-a573-4c0ea8f72ba5 req-c2bc062c-7d7e-4b40-a73b-1ad5b167402c service nova] Creating event network-vif-plugged:aac17ba0-17d8-4109-84a4-366867d1321a for instance 16cdaac8-bb7a-405f-9bc6-1e7b17194689 on n-h2-860284-1 Oct 04 22:57:08.643461 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-1c8d0781-ee58-4ab2-a573-4c0ea8f72ba5 req-c2bc062c-7d7e-4b40-a73b-1ad5b167402c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037351 Oct 04 22:57:08.644217 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3293/7407] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:57:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:57:09.469109 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-e930dc64-37db-4f8c-9850-a3c137bf377a req-57bdd7c5-47e6-4b5c-b136-e21210c826ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16cdaac8-bb7a-405f-9bc6-1e7b17194689", "name": "network-vif-deleted", "tag": "aac17ba0-17d8-4109-84a4-366867d1321a"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:57:09.476818 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=3 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:57:09.491776 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-e930dc64-37db-4f8c-9850-a3c137bf377a req-57bdd7c5-47e6-4b5c-b136-e21210c826ca service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:57:09.492310 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-e930dc64-37db-4f8c-9850-a3c137bf377a req-57bdd7c5-47e6-4b5c-b136-e21210c826ca service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:57:09.492842 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-e930dc64-37db-4f8c-9850-a3c137bf377a req-57bdd7c5-47e6-4b5c-b136-e21210c826ca service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:57:09.508946 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-eb67b42e-cade-4e9d-80e9-ae1ef9c2b88c tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:57:09.509638 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-eb67b42e-cade-4e9d-80e9-ae1ef9c2b88c tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: 16cdaac8-bb7a-405f-9bc6-1e7b17194689] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:57:09.513734 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-e930dc64-37db-4f8c-9850-a3c137bf377a req-57bdd7c5-47e6-4b5c-b136-e21210c826ca service nova] Creating event network-vif-deleted:aac17ba0-17d8-4109-84a4-366867d1321a for instance 16cdaac8-bb7a-405f-9bc6-1e7b17194689 on n-h2-860284-1 Oct 04 22:57:09.515936 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-eb67b42e-cade-4e9d-80e9-ae1ef9c2b88c tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:57:09.516625 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-eb67b42e-cade-4e9d-80e9-ae1ef9c2b88c tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:57:09.517290 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-eb67b42e-cade-4e9d-80e9-ae1ef9c2b88c tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:57:09.518205 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-eb67b42e-cade-4e9d-80e9-ae1ef9c2b88c tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:57:09.518843 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-eb67b42e-cade-4e9d-80e9-ae1ef9c2b88c tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:57:09.519433 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-eb67b42e-cade-4e9d-80e9-ae1ef9c2b88c tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:57:09.522081 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-e930dc64-37db-4f8c-9850-a3c137bf377a req-57bdd7c5-47e6-4b5c-b136-e21210c826ca service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056638 Oct 04 22:57:09.523333 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4115/7408] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:57:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:57:09.592261 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-eb67b42e-cade-4e9d-80e9-ae1ef9c2b88c tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad9d55ccfe74ffb914f02030529523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ad9e4338314c269afb0cfcebe03584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:57:09.601219 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-eb67b42e-cade-4e9d-80e9-ae1ef9c2b88c tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/16cdaac8-bb7a-405f-9bc6-1e7b17194689" status: 200 len: 1322 microversion: 2.1 time: 0.096413 Oct 04 22:57:09.601923 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3294/7409] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:57:09 2022] GET /compute/v2.1/servers/16cdaac8-bb7a-405f-9bc6-1e7b17194689 => generated 1322 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:57:10.628287 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-162ea7ad-b951-4a52-93c0-b9111c9d0dd9 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:57:10.629004 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-162ea7ad-b951-4a52-93c0-b9111c9d0dd9 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: 16cdaac8-bb7a-405f-9bc6-1e7b17194689] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:57:10.631000 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=2 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:57:10.637499 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-162ea7ad-b951-4a52-93c0-b9111c9d0dd9 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:57:10.638203 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-162ea7ad-b951-4a52-93c0-b9111c9d0dd9 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:57:10.638698 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-162ea7ad-b951-4a52-93c0-b9111c9d0dd9 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:57:10.639424 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-162ea7ad-b951-4a52-93c0-b9111c9d0dd9 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:57:10.639926 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-162ea7ad-b951-4a52-93c0-b9111c9d0dd9 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:57:10.640368 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-162ea7ad-b951-4a52-93c0-b9111c9d0dd9 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:57:10.654860 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-162ea7ad-b951-4a52-93c0-b9111c9d0dd9 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] HTTP exception thrown: Instance 16cdaac8-bb7a-405f-9bc6-1e7b17194689 could not be found. Oct 04 22:57:10.656503 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-162ea7ad-b951-4a52-93c0-b9111c9d0dd9 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Request method failure captured: Oct 04 22:57:10.656503 n-d-860284-1 devstack@n-api.service[134101]: request: GET /compute/v2.1/servers/16cdaac8-bb7a-405f-9bc6-1e7b17194689 HTTP/1.1 Oct 04 22:57:10.656503 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 22:57:10.656503 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 22:57:10.656503 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 22:57:10.656503 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 22:57:10.656503 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 22:57:10.656503 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 22:57:10.656503 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 22:57:10.656503 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 22:57:10.656503 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPLj5Pwg8WnMY03a1UZoxjs8JJYeyX4gPNXk6kEaEUFSId5NkYbu9p7XcCT6xCsGLl965bhlzMmdcrnW3jmUrNP-IBqDDDBlZIgg6A8FuefFnP4mHIDNTJ0T7sYDTAC4YQVniCZjT1xnCXPrzoAdDzhVXLGL7ogVXgw4ofRJLecl7Qjo Oct 04 22:57:10.656503 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 22:57:10.656503 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 22:57:10.656503 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 22:57:10.656503 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 22:57:10.656503 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 22:57:10.656503 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 22:57:10.656503 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: d2ad9e4338314c269afb0cfcebe03584 Oct 04 22:57:10.656503 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-ServerActionsTestJSON-1972791785 Oct 04 22:57:10.656503 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 22:57:10.656503 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 22:57:10.656503 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d2ad9e4338314c269afb0cfcebe03584"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_d2ad9e4338314c269afb0cfcebe03584", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d2ad9e4338314c269afb0cfcebe03584"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/d2ad9e4338314c269afb0cfcebe03584"}]}] Oct 04 22:57:10.656503 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-ServerActionsTestJSON-1972791785 Oct 04 22:57:10.656503 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: d2ad9e4338314c269afb0cfcebe03584 Oct 04 22:57:10.656503 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-ServerActionsTestJSON-1972791785 Oct 04 22:57:10.656503 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-ServerActionsTestJSON-1972791785-project Oct 04 22:57:10.656503 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 22:57:10.656503 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 22:57:10.656503 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: aad9d55ccfe74ffb914f02030529523d Oct 04 22:57:10.656503 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-ServerActionsTestJSON-1972791785-project Oct 04 22:57:10.656503 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 22:57:10.656503 n-d-860284-1 devstack@n-api.service[134101]: exception: Instance 16cdaac8-bb7a-405f-9bc6-1e7b17194689 could not be found. Oct 04 22:57:10.656503 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': '16cdaac8-bb7a-405f-9bc6-1e7b17194689'} Oct 04 22:57:10.656503 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:57:10.656503 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:57:10.656503 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:57:10.656503 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:57:10.656503 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:57:10.656503 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:57:10.656503 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:57:10.656503 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:57:10.656503 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:57:10.656503 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:57:10.656503 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16cdaac8-bb7a-405f-9bc6-1e7b17194689 could not be found. Oct 04 22:57:10.656503 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:57:10.656503 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:57:10.656503 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:57:10.656503 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:57:10.656503 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:57:10.656503 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:57:10.656503 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:57:10.656503 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:57:10.656503 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:57:10.656503 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:57:10.656503 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:57:10.656503 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:57:10.656503 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:57:10.656503 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:57:10.656503 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:57:10.656503 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:57:10.656503 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16cdaac8-bb7a-405f-9bc6-1e7b17194689 could not be found. Oct 04 22:57:10.656503 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:57:10.656503 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:57:10.656503 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:57:10.661096 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:57:10.661096 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:57:10.661096 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:57:10.661096 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:57:10.661096 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:57:10.661096 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16cdaac8-bb7a-405f-9bc6-1e7b17194689 could not be found. Oct 04 22:57:10.661096 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:57:10.661096 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-162ea7ad-b951-4a52-93c0-b9111c9d0dd9 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Returning 404 to user: Instance 16cdaac8-bb7a-405f-9bc6-1e7b17194689 could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:57:10.661096 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-162ea7ad-b951-4a52-93c0-b9111c9d0dd9 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/16cdaac8-bb7a-405f-9bc6-1e7b17194689" status: 404 len: 111 microversion: 2.1 time: 0.035471 Oct 04 22:57:10.661096 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4116/7410] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:57:10 2022] GET /compute/v2.1/servers/16cdaac8-bb7a-405f-9bc6-1e7b17194689 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:57:10.673753 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-f40ef729-1b82-4eaa-bf38-d61c32ee4d25 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:57:10.674556 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-f40ef729-1b82-4eaa-bf38-d61c32ee4d25 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: 16cdaac8-bb7a-405f-9bc6-1e7b17194689] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:57:10.677403 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_api:SELECT=41 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:57:10.682971 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f40ef729-1b82-4eaa-bf38-d61c32ee4d25 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:57:10.683462 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f40ef729-1b82-4eaa-bf38-d61c32ee4d25 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:57:10.683902 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f40ef729-1b82-4eaa-bf38-d61c32ee4d25 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:57:10.684597 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f40ef729-1b82-4eaa-bf38-d61c32ee4d25 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:57:10.685058 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f40ef729-1b82-4eaa-bf38-d61c32ee4d25 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:57:10.685487 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f40ef729-1b82-4eaa-bf38-d61c32ee4d25 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:57:10.699479 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-f40ef729-1b82-4eaa-bf38-d61c32ee4d25 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] HTTP exception thrown: Instance 16cdaac8-bb7a-405f-9bc6-1e7b17194689 could not be found. Oct 04 22:57:10.701111 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-f40ef729-1b82-4eaa-bf38-d61c32ee4d25 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Request method failure captured: Oct 04 22:57:10.701111 n-d-860284-1 devstack@n-api.service[134102]: request: GET /compute/v2.1/servers/16cdaac8-bb7a-405f-9bc6-1e7b17194689 HTTP/1.1 Oct 04 22:57:10.701111 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 22:57:10.701111 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 22:57:10.701111 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 22:57:10.701111 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 22:57:10.701111 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 22:57:10.701111 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 22:57:10.701111 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 22:57:10.701111 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 22:57:10.701111 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPLj5Pwg8WnMY03a1UZoxjs8JJYeyX4gPNXk6kEaEUFSId5NkYbu9p7XcCT6xCsGLl965bhlzMmdcrnW3jmUrNP-IBqDDDBlZIgg6A8FuefFnP4mHIDNTJ0T7sYDTAC4YQVniCZjT1xnCXPrzoAdDzhVXLGL7ogVXgw4ofRJLecl7Qjo Oct 04 22:57:10.701111 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 22:57:10.701111 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 22:57:10.701111 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 22:57:10.701111 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 22:57:10.701111 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 22:57:10.701111 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 22:57:10.701111 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: d2ad9e4338314c269afb0cfcebe03584 Oct 04 22:57:10.701111 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-ServerActionsTestJSON-1972791785 Oct 04 22:57:10.701111 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 22:57:10.701111 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 22:57:10.701111 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d2ad9e4338314c269afb0cfcebe03584"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_d2ad9e4338314c269afb0cfcebe03584", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d2ad9e4338314c269afb0cfcebe03584"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/d2ad9e4338314c269afb0cfcebe03584"}]}] Oct 04 22:57:10.701111 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-ServerActionsTestJSON-1972791785 Oct 04 22:57:10.701111 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: d2ad9e4338314c269afb0cfcebe03584 Oct 04 22:57:10.701111 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-ServerActionsTestJSON-1972791785 Oct 04 22:57:10.701111 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-ServerActionsTestJSON-1972791785-project Oct 04 22:57:10.701111 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 22:57:10.701111 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 22:57:10.701111 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: aad9d55ccfe74ffb914f02030529523d Oct 04 22:57:10.701111 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-ServerActionsTestJSON-1972791785-project Oct 04 22:57:10.701111 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 22:57:10.701111 n-d-860284-1 devstack@n-api.service[134102]: exception: Instance 16cdaac8-bb7a-405f-9bc6-1e7b17194689 could not be found. Oct 04 22:57:10.701111 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': '16cdaac8-bb7a-405f-9bc6-1e7b17194689'} Oct 04 22:57:10.701111 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:57:10.701111 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:57:10.701111 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:57:10.701111 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:57:10.701111 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:57:10.701111 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:57:10.701111 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:57:10.701111 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:57:10.701111 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:57:10.701111 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:57:10.701111 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16cdaac8-bb7a-405f-9bc6-1e7b17194689 could not be found. Oct 04 22:57:10.701111 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:57:10.701111 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:57:10.701111 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:57:10.701111 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:57:10.701111 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:57:10.701111 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:57:10.701111 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:57:10.701111 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:57:10.701111 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:57:10.701111 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:57:10.701111 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:57:10.701111 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:57:10.701111 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:57:10.701111 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:57:10.701111 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:57:10.701111 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:57:10.701111 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16cdaac8-bb7a-405f-9bc6-1e7b17194689 could not be found. Oct 04 22:57:10.701111 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:57:10.701111 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:57:10.701111 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:57:10.706391 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:57:10.706391 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:57:10.706391 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:57:10.706391 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:57:10.706391 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:57:10.706391 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16cdaac8-bb7a-405f-9bc6-1e7b17194689 could not be found. Oct 04 22:57:10.706391 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:57:10.706391 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-f40ef729-1b82-4eaa-bf38-d61c32ee4d25 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Returning 404 to user: Instance 16cdaac8-bb7a-405f-9bc6-1e7b17194689 could not be found. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:57:10.706391 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-f40ef729-1b82-4eaa-bf38-d61c32ee4d25 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/16cdaac8-bb7a-405f-9bc6-1e7b17194689" status: 404 len: 111 microversion: 2.1 time: 0.032644 Oct 04 22:57:10.706391 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3295/7411] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:57:10 2022] GET /compute/v2.1/servers/16cdaac8-bb7a-405f-9bc6-1e7b17194689 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:57:10.751562 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-423d4d8d-1277-4224-8368-76e95519b3a2 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-954411656", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452", "networks": [{"uuid": "edb1eff0-ecce-412d-a1f1-316814dcaa93"}], "security_groups": [{"name": "tempest-securitygroup--1626714274"}], "key_name": "tempest-keypair-524313961", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:57:10.856735 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.network.neutron [None req-423d4d8d-1277-4224-8368-76e95519b3a2 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] validate_networks() for [('edb1eff0-ecce-412d-a1f1-316814dcaa93', None, None, None, None, None)] {{(pid=134101) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 22:57:11.270516 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-423d4d8d-1277-4224-8368-76e95519b3a2 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Flavor limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 22:57:11.270990 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-423d4d8d-1277-4224-8368-76e95519b3a2 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Image limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 22:57:11.271481 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-423d4d8d-1277-4224-8368-76e95519b3a2 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Flavor pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 22:57:11.271911 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-423d4d8d-1277-4224-8368-76e95519b3a2 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Image pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 22:57:11.272336 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-423d4d8d-1277-4224-8368-76e95519b3a2 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 22:57:11.281098 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-423d4d8d-1277-4224-8368-76e95519b3a2 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:57:11.281591 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-423d4d8d-1277-4224-8368-76e95519b3a2 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:57:11.282092 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-423d4d8d-1277-4224-8368-76e95519b3a2 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:57:11.282810 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-423d4d8d-1277-4224-8368-76e95519b3a2 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:57:11.283278 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-423d4d8d-1277-4224-8368-76e95519b3a2 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:57:11.283714 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-423d4d8d-1277-4224-8368-76e95519b3a2 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:57:11.300565 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-423d4d8d-1277-4224-8368-76e95519b3a2 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Getting quotas for project d2ad9e4338314c269afb0cfcebe03584. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:57:11.305738 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-423d4d8d-1277-4224-8368-76e95519b3a2 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Getting quotas for user aad9d55ccfe74ffb914f02030529523d and project d2ad9e4338314c269afb0cfcebe03584. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:57:11.318464 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-423d4d8d-1277-4224-8368-76e95519b3a2 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Going to run 1 instances... {{(pid=134101) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 22:57:11.320738 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-423d4d8d-1277-4224-8368-76e95519b3a2 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: a429e625-83b7-4078-a34e-ba6d23e08bca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='58548514-5dac-426c-81f5-19e3fba33e23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134101) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 22:57:11.366811 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-423d4d8d-1277-4224-8368-76e95519b3a2 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.619111 Oct 04 22:57:11.367470 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4117/7412] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 22:57:10 2022] POST /compute/v2.1/servers => generated 406 bytes in 620 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 22:57:11.386259 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-07e9b83b-2605-4d41-abf5-64af1cd0392d tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:57:11.386960 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-07e9b83b-2605-4d41-abf5-64af1cd0392d tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: a429e625-83b7-4078-a34e-ba6d23e08bca] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:57:11.443033 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-07e9b83b-2605-4d41-abf5-64af1cd0392d tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad9d55ccfe74ffb914f02030529523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ad9e4338314c269afb0cfcebe03584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:57:11.450083 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-07e9b83b-2605-4d41-abf5-64af1cd0392d tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/a429e625-83b7-4078-a34e-ba6d23e08bca" status: 200 len: 1237 microversion: 2.1 time: 0.071629 Oct 04 22:57:11.462396 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3296/7413] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:57:11 2022] GET /compute/v2.1/servers/a429e625-83b7-4078-a34e-ba6d23e08bca => generated 1237 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:57:12.474678 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-fc87e739-8aa8-4925-aeba-4df30d1d242f tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:57:12.475334 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-fc87e739-8aa8-4925-aeba-4df30d1d242f tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: a429e625-83b7-4078-a34e-ba6d23e08bca] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:57:12.482622 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fc87e739-8aa8-4925-aeba-4df30d1d242f tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:57:12.483154 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fc87e739-8aa8-4925-aeba-4df30d1d242f tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:57:12.483608 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fc87e739-8aa8-4925-aeba-4df30d1d242f tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:57:12.484325 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fc87e739-8aa8-4925-aeba-4df30d1d242f tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:57:12.484930 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fc87e739-8aa8-4925-aeba-4df30d1d242f tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:57:12.485980 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fc87e739-8aa8-4925-aeba-4df30d1d242f tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:57:12.556072 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-fc87e739-8aa8-4925-aeba-4df30d1d242f tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad9d55ccfe74ffb914f02030529523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ad9e4338314c269afb0cfcebe03584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:57:12.567272 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-fc87e739-8aa8-4925-aeba-4df30d1d242f tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/a429e625-83b7-4078-a34e-ba6d23e08bca" status: 200 len: 1295 microversion: 2.1 time: 0.097286 Oct 04 22:57:12.578856 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4118/7414] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:57:12 2022] GET /compute/v2.1/servers/a429e625-83b7-4078-a34e-ba6d23e08bca => generated 1295 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:57:13.592353 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-6a6835d9-6068-445c-95b0-29e4e30b605e tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:57:13.593031 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-6a6835d9-6068-445c-95b0-29e4e30b605e tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: a429e625-83b7-4078-a34e-ba6d23e08bca] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:57:13.603004 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6a6835d9-6068-445c-95b0-29e4e30b605e tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:57:13.603502 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6a6835d9-6068-445c-95b0-29e4e30b605e tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:57:13.603974 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6a6835d9-6068-445c-95b0-29e4e30b605e tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:57:13.604683 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6a6835d9-6068-445c-95b0-29e4e30b605e tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:57:13.605330 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6a6835d9-6068-445c-95b0-29e4e30b605e tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:57:13.605764 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6a6835d9-6068-445c-95b0-29e4e30b605e tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:57:13.801732 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-6a6835d9-6068-445c-95b0-29e4e30b605e tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad9d55ccfe74ffb914f02030529523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ad9e4338314c269afb0cfcebe03584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:57:13.811385 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-6a6835d9-6068-445c-95b0-29e4e30b605e tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/a429e625-83b7-4078-a34e-ba6d23e08bca" status: 200 len: 1363 microversion: 2.1 time: 0.223282 Oct 04 22:57:13.812230 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3297/7415] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:57:13 2022] GET /compute/v2.1/servers/a429e625-83b7-4078-a34e-ba6d23e08bca => generated 1363 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:57:13.848676 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-b8aebd67-d9c6-4eea-9844-ab15d49759bf req-da5e55b6-1a2d-4f2f-aad5-073e32221239 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a429e625-83b7-4078-a34e-ba6d23e08bca", "tag": "2bffd9fb-5450-442f-ab82-e27a42819d21"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:57:13.867669 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-b8aebd67-d9c6-4eea-9844-ab15d49759bf req-da5e55b6-1a2d-4f2f-aad5-073e32221239 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:57:13.868175 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-b8aebd67-d9c6-4eea-9844-ab15d49759bf req-da5e55b6-1a2d-4f2f-aad5-073e32221239 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:57:13.868632 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-b8aebd67-d9c6-4eea-9844-ab15d49759bf req-da5e55b6-1a2d-4f2f-aad5-073e32221239 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:57:13.883174 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-b8aebd67-d9c6-4eea-9844-ab15d49759bf req-da5e55b6-1a2d-4f2f-aad5-073e32221239 service nova] Creating event network-changed:2bffd9fb-5450-442f-ab82-e27a42819d21 for instance a429e625-83b7-4078-a34e-ba6d23e08bca on n-h1-860284-1 Oct 04 22:57:13.888364 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-b8aebd67-d9c6-4eea-9844-ab15d49759bf req-da5e55b6-1a2d-4f2f-aad5-073e32221239 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044994 Oct 04 22:57:13.889089 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4119/7416] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:57:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:57:14.838631 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-536340ff-959c-4525-9fa0-2d25ffcb3160 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:57:14.839253 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-536340ff-959c-4525-9fa0-2d25ffcb3160 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: a429e625-83b7-4078-a34e-ba6d23e08bca] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:57:14.846237 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-536340ff-959c-4525-9fa0-2d25ffcb3160 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:57:14.846780 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-536340ff-959c-4525-9fa0-2d25ffcb3160 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:57:14.847210 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-536340ff-959c-4525-9fa0-2d25ffcb3160 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:57:14.847908 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-536340ff-959c-4525-9fa0-2d25ffcb3160 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:57:14.848378 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-536340ff-959c-4525-9fa0-2d25ffcb3160 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:57:14.848810 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-536340ff-959c-4525-9fa0-2d25ffcb3160 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:57:14.982796 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-536340ff-959c-4525-9fa0-2d25ffcb3160 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad9d55ccfe74ffb914f02030529523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ad9e4338314c269afb0cfcebe03584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:57:14.991230 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-536340ff-959c-4525-9fa0-2d25ffcb3160 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/a429e625-83b7-4078-a34e-ba6d23e08bca" status: 200 len: 1363 microversion: 2.1 time: 0.156524 Oct 04 22:57:14.991814 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3298/7417] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:57:14 2022] GET /compute/v2.1/servers/a429e625-83b7-4078-a34e-ba6d23e08bca => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:57:16.015911 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-ca254961-0d27-4027-a91b-5d5bb624d050 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:57:16.016628 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-ca254961-0d27-4027-a91b-5d5bb624d050 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: a429e625-83b7-4078-a34e-ba6d23e08bca] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:57:16.023518 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ca254961-0d27-4027-a91b-5d5bb624d050 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:57:16.024032 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ca254961-0d27-4027-a91b-5d5bb624d050 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:57:16.024493 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ca254961-0d27-4027-a91b-5d5bb624d050 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:57:16.025199 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ca254961-0d27-4027-a91b-5d5bb624d050 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:57:16.025673 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ca254961-0d27-4027-a91b-5d5bb624d050 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:57:16.026119 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ca254961-0d27-4027-a91b-5d5bb624d050 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:57:16.156892 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-ca254961-0d27-4027-a91b-5d5bb624d050 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad9d55ccfe74ffb914f02030529523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ad9e4338314c269afb0cfcebe03584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:57:16.164753 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-ca254961-0d27-4027-a91b-5d5bb624d050 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/a429e625-83b7-4078-a34e-ba6d23e08bca" status: 200 len: 1363 microversion: 2.1 time: 0.154149 Oct 04 22:57:16.165342 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4120/7418] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:57:16 2022] GET /compute/v2.1/servers/a429e625-83b7-4078-a34e-ba6d23e08bca => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:57:17.188943 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-f9f6bcdd-f1f5-4223-b407-9582d083f5da tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:57:17.189700 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-f9f6bcdd-f1f5-4223-b407-9582d083f5da tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: a429e625-83b7-4078-a34e-ba6d23e08bca] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:57:17.197358 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f9f6bcdd-f1f5-4223-b407-9582d083f5da tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:57:17.197884 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f9f6bcdd-f1f5-4223-b407-9582d083f5da tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:57:17.198330 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f9f6bcdd-f1f5-4223-b407-9582d083f5da tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:57:17.199083 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f9f6bcdd-f1f5-4223-b407-9582d083f5da tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:57:17.199547 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f9f6bcdd-f1f5-4223-b407-9582d083f5da tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:57:17.199981 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f9f6bcdd-f1f5-4223-b407-9582d083f5da tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:57:17.363095 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-f9f6bcdd-f1f5-4223-b407-9582d083f5da tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad9d55ccfe74ffb914f02030529523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ad9e4338314c269afb0cfcebe03584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:57:17.371234 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-f9f6bcdd-f1f5-4223-b407-9582d083f5da tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/a429e625-83b7-4078-a34e-ba6d23e08bca" status: 200 len: 1363 microversion: 2.1 time: 0.186379 Oct 04 22:57:17.371763 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3299/7419] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:57:17 2022] GET /compute/v2.1/servers/a429e625-83b7-4078-a34e-ba6d23e08bca => generated 1363 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:57:18.396201 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-b7161398-4d6e-4be4-ac3c-f4a03e59bd99 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:57:18.396767 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-b7161398-4d6e-4be4-ac3c-f4a03e59bd99 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: a429e625-83b7-4078-a34e-ba6d23e08bca] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:57:18.403795 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b7161398-4d6e-4be4-ac3c-f4a03e59bd99 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:57:18.404340 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b7161398-4d6e-4be4-ac3c-f4a03e59bd99 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:57:18.404802 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b7161398-4d6e-4be4-ac3c-f4a03e59bd99 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:57:18.405521 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b7161398-4d6e-4be4-ac3c-f4a03e59bd99 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:57:18.405998 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b7161398-4d6e-4be4-ac3c-f4a03e59bd99 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:57:18.406478 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b7161398-4d6e-4be4-ac3c-f4a03e59bd99 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:57:18.541564 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-b7161398-4d6e-4be4-ac3c-f4a03e59bd99 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad9d55ccfe74ffb914f02030529523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ad9e4338314c269afb0cfcebe03584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:57:18.550002 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-b7161398-4d6e-4be4-ac3c-f4a03e59bd99 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/a429e625-83b7-4078-a34e-ba6d23e08bca" status: 200 len: 1363 microversion: 2.1 time: 0.158338 Oct 04 22:57:18.550634 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4121/7420] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:57:18 2022] GET /compute/v2.1/servers/a429e625-83b7-4078-a34e-ba6d23e08bca => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:57:19.573681 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-5e7858fc-3539-41f1-812a-804c451d9d4a tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:57:19.574316 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-5e7858fc-3539-41f1-812a-804c451d9d4a tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: a429e625-83b7-4078-a34e-ba6d23e08bca] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:57:19.581792 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5e7858fc-3539-41f1-812a-804c451d9d4a tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:57:19.582269 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5e7858fc-3539-41f1-812a-804c451d9d4a tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:57:19.582731 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5e7858fc-3539-41f1-812a-804c451d9d4a tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:57:19.583773 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5e7858fc-3539-41f1-812a-804c451d9d4a tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:57:19.584230 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5e7858fc-3539-41f1-812a-804c451d9d4a tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:57:19.584655 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5e7858fc-3539-41f1-812a-804c451d9d4a tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:57:19.720587 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-5e7858fc-3539-41f1-812a-804c451d9d4a tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad9d55ccfe74ffb914f02030529523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ad9e4338314c269afb0cfcebe03584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:57:19.729053 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-5e7858fc-3539-41f1-812a-804c451d9d4a tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/a429e625-83b7-4078-a34e-ba6d23e08bca" status: 200 len: 1363 microversion: 2.1 time: 0.159301 Oct 04 22:57:19.729635 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3300/7421] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:57:19 2022] GET /compute/v2.1/servers/a429e625-83b7-4078-a34e-ba6d23e08bca => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:57:20.604559 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-3de07cc0-5948-4322-9504-0a1e13259a43 req-76b84571-e313-43cf-8fa2-297658b73063 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a429e625-83b7-4078-a34e-ba6d23e08bca", "name": "network-vif-plugged", "status": "completed", "tag": "2bffd9fb-5450-442f-ab82-e27a42819d21"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:57:20.617969 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-3de07cc0-5948-4322-9504-0a1e13259a43 req-76b84571-e313-43cf-8fa2-297658b73063 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:57:20.618505 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-3de07cc0-5948-4322-9504-0a1e13259a43 req-76b84571-e313-43cf-8fa2-297658b73063 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:57:20.618955 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-3de07cc0-5948-4322-9504-0a1e13259a43 req-76b84571-e313-43cf-8fa2-297658b73063 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:57:20.631705 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-3de07cc0-5948-4322-9504-0a1e13259a43 req-76b84571-e313-43cf-8fa2-297658b73063 service nova] Creating event network-vif-plugged:2bffd9fb-5450-442f-ab82-e27a42819d21 for instance a429e625-83b7-4078-a34e-ba6d23e08bca on n-h1-860284-1 Oct 04 22:57:20.637256 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-3de07cc0-5948-4322-9504-0a1e13259a43 req-76b84571-e313-43cf-8fa2-297658b73063 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036242 Oct 04 22:57:20.637994 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4122/7422] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:57:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:57:20.753355 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-7151e35c-2176-46bb-bafc-d5897c6b29f7 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:57:20.754011 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-7151e35c-2176-46bb-bafc-d5897c6b29f7 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: a429e625-83b7-4078-a34e-ba6d23e08bca] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:57:20.760900 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7151e35c-2176-46bb-bafc-d5897c6b29f7 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:57:20.761393 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7151e35c-2176-46bb-bafc-d5897c6b29f7 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:57:20.761835 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7151e35c-2176-46bb-bafc-d5897c6b29f7 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:57:20.762573 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7151e35c-2176-46bb-bafc-d5897c6b29f7 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:57:20.763040 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7151e35c-2176-46bb-bafc-d5897c6b29f7 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:57:20.763474 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7151e35c-2176-46bb-bafc-d5897c6b29f7 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:57:20.894286 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-7151e35c-2176-46bb-bafc-d5897c6b29f7 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad9d55ccfe74ffb914f02030529523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ad9e4338314c269afb0cfcebe03584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:57:20.901971 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-7151e35c-2176-46bb-bafc-d5897c6b29f7 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/a429e625-83b7-4078-a34e-ba6d23e08bca" status: 200 len: 1363 microversion: 2.1 time: 0.152801 Oct 04 22:57:20.902582 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3301/7423] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:57:20 2022] GET /compute/v2.1/servers/a429e625-83b7-4078-a34e-ba6d23e08bca => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:57:21.927759 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-514cdb1d-ccf7-437e-86cd-96be5dbd1403 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:57:21.928493 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-514cdb1d-ccf7-437e-86cd-96be5dbd1403 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: a429e625-83b7-4078-a34e-ba6d23e08bca] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:57:21.930552 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=2 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:57:21.931253 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=6 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:57:21.938297 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-514cdb1d-ccf7-437e-86cd-96be5dbd1403 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:57:21.938838 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-514cdb1d-ccf7-437e-86cd-96be5dbd1403 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:57:21.939360 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-514cdb1d-ccf7-437e-86cd-96be5dbd1403 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:57:21.940305 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-514cdb1d-ccf7-437e-86cd-96be5dbd1403 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:57:21.940792 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-514cdb1d-ccf7-437e-86cd-96be5dbd1403 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:57:21.941263 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-514cdb1d-ccf7-437e-86cd-96be5dbd1403 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:57:22.075459 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-514cdb1d-ccf7-437e-86cd-96be5dbd1403 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad9d55ccfe74ffb914f02030529523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ad9e4338314c269afb0cfcebe03584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:57:22.084022 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-514cdb1d-ccf7-437e-86cd-96be5dbd1403 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/a429e625-83b7-4078-a34e-ba6d23e08bca" status: 200 len: 1363 microversion: 2.1 time: 0.161306 Oct 04 22:57:22.084620 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4123/7424] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:57:21 2022] GET /compute/v2.1/servers/a429e625-83b7-4078-a34e-ba6d23e08bca => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:57:23.108031 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-1b2f3cbc-eee1-4854-a33c-ac2fc124d492 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:57:23.108565 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-1b2f3cbc-eee1-4854-a33c-ac2fc124d492 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: a429e625-83b7-4078-a34e-ba6d23e08bca] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:57:23.110426 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell0:SELECT=2 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:57:23.117741 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1b2f3cbc-eee1-4854-a33c-ac2fc124d492 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:57:23.118230 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1b2f3cbc-eee1-4854-a33c-ac2fc124d492 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:57:23.118703 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1b2f3cbc-eee1-4854-a33c-ac2fc124d492 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:57:23.119384 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1b2f3cbc-eee1-4854-a33c-ac2fc124d492 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:57:23.119834 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1b2f3cbc-eee1-4854-a33c-ac2fc124d492 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:57:23.120258 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1b2f3cbc-eee1-4854-a33c-ac2fc124d492 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:57:23.255368 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-1b2f3cbc-eee1-4854-a33c-ac2fc124d492 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad9d55ccfe74ffb914f02030529523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ad9e4338314c269afb0cfcebe03584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:57:23.263155 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-1b2f3cbc-eee1-4854-a33c-ac2fc124d492 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/a429e625-83b7-4078-a34e-ba6d23e08bca" status: 200 len: 1548 microversion: 2.1 time: 0.159122 Oct 04 22:57:23.263744 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3302/7425] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:57:23 2022] GET /compute/v2.1/servers/a429e625-83b7-4078-a34e-ba6d23e08bca => generated 1548 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:57:23.286754 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-908e4371-8704-4d40-9f80-82b1639e27ab tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:57:23.287263 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-908e4371-8704-4d40-9f80-82b1639e27ab tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: a429e625-83b7-4078-a34e-ba6d23e08bca] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:57:23.294313 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-908e4371-8704-4d40-9f80-82b1639e27ab tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:57:23.294851 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-908e4371-8704-4d40-9f80-82b1639e27ab tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:57:23.295312 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-908e4371-8704-4d40-9f80-82b1639e27ab tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:57:23.296186 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-908e4371-8704-4d40-9f80-82b1639e27ab tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:57:23.296784 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-908e4371-8704-4d40-9f80-82b1639e27ab tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:57:23.297239 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-908e4371-8704-4d40-9f80-82b1639e27ab tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:57:23.375926 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-908e4371-8704-4d40-9f80-82b1639e27ab tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/a429e625-83b7-4078-a34e-ba6d23e08bca/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.093643 Oct 04 22:57:23.376536 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4124/7426] 10.222.0.43 () {58 vars in 1275 bytes} [Tue Oct 4 22:57:23 2022] GET /compute/v2.1/servers/a429e625-83b7-4078-a34e-ba6d23e08bca/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:57:24.316337 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-0c0717fc-bd8a-4eb9-85c2-5f776f198642 req-4e052ccb-ceb8-493b-94b8-d15f18d021fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a429e625-83b7-4078-a34e-ba6d23e08bca", "tag": "2bffd9fb-5450-442f-ab82-e27a42819d21"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:57:24.326857 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-0c0717fc-bd8a-4eb9-85c2-5f776f198642 req-4e052ccb-ceb8-493b-94b8-d15f18d021fa service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:57:24.327418 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-0c0717fc-bd8a-4eb9-85c2-5f776f198642 req-4e052ccb-ceb8-493b-94b8-d15f18d021fa service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:57:24.327925 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-0c0717fc-bd8a-4eb9-85c2-5f776f198642 req-4e052ccb-ceb8-493b-94b8-d15f18d021fa service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:57:24.339947 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-0c0717fc-bd8a-4eb9-85c2-5f776f198642 req-4e052ccb-ceb8-493b-94b8-d15f18d021fa service nova] Creating event network-changed:2bffd9fb-5450-442f-ab82-e27a42819d21 for instance a429e625-83b7-4078-a34e-ba6d23e08bca on n-h1-860284-1 Oct 04 22:57:24.345026 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-0c0717fc-bd8a-4eb9-85c2-5f776f198642 req-4e052ccb-ceb8-493b-94b8-d15f18d021fa service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033237 Oct 04 22:57:24.345631 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3303/7427] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:57:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:58:39.508827 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=3 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:58:39.509582 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:58:39.516956 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-796d6d42-bdbb-4f43-9f14-4b63248f0438 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:58:39.517602 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-796d6d42-bdbb-4f43-9f14-4b63248f0438 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: a429e625-83b7-4078-a34e-ba6d23e08bca] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:58:39.526395 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-796d6d42-bdbb-4f43-9f14-4b63248f0438 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:58:39.526899 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-796d6d42-bdbb-4f43-9f14-4b63248f0438 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:58:39.527362 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-796d6d42-bdbb-4f43-9f14-4b63248f0438 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:58:39.528075 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-796d6d42-bdbb-4f43-9f14-4b63248f0438 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:58:39.528554 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-796d6d42-bdbb-4f43-9f14-4b63248f0438 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:58:39.529003 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-796d6d42-bdbb-4f43-9f14-4b63248f0438 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:58:39.716302 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-796d6d42-bdbb-4f43-9f14-4b63248f0438 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad9d55ccfe74ffb914f02030529523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ad9e4338314c269afb0cfcebe03584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:58:39.724288 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-796d6d42-bdbb-4f43-9f14-4b63248f0438 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/a429e625-83b7-4078-a34e-ba6d23e08bca" status: 200 len: 1667 microversion: 2.1 time: 0.218052 Oct 04 22:58:39.724998 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4125/7428] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:58:39 2022] GET /compute/v2.1/servers/a429e625-83b7-4078-a34e-ba6d23e08bca => generated 1667 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:58:39.746891 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_api:SELECT=19 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:58:39.747653 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=52 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:58:39.748918 n-d-860284-1 devstack@n-api.service[134102]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 22:58:39.749047 n-d-860284-1 devstack@n-api.service[134102]: Tue Oct 4 22:58:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a429e625-83b7-4078-a34e-ba6d23e08bca/os-volume_attachments (ip 10.222.0.43) !!! Oct 04 22:58:39.761922 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-fe982921-17d4-4d45-a595-cbe48135637f tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5ce69f40-0753-450c-a04b-ed182b0beb89"}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:58:39.764446 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-fe982921-17d4-4d45-a595-cbe48135637f tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: a429e625-83b7-4078-a34e-ba6d23e08bca] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:58:39.770921 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fe982921-17d4-4d45-a595-cbe48135637f tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:58:39.772053 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fe982921-17d4-4d45-a595-cbe48135637f tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:58:39.772501 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fe982921-17d4-4d45-a595-cbe48135637f tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:58:39.773193 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fe982921-17d4-4d45-a595-cbe48135637f tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:58:39.773655 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fe982921-17d4-4d45-a595-cbe48135637f tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:58:39.774087 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fe982921-17d4-4d45-a595-cbe48135637f tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:58:40.129548 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-fe982921-17d4-4d45-a595-cbe48135637f tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "POST /compute/v2.1/servers/a429e625-83b7-4078-a34e-ba6d23e08bca/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.386065 Oct 04 22:58:40.130567 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3304/7429] 10.222.0.43 () {60 vars in 1323 bytes} [Tue Oct 4 22:58:39 2022] POST /compute/v2.1/servers/a429e625-83b7-4078-a34e-ba6d23e08bca/os-volume_attachments => generated 194 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:58:51.924240 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-4c67875d-1e30-4c3d-980e-2c50f9ec1a1f tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:58:51.926591 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-4c67875d-1e30-4c3d-980e-2c50f9ec1a1f tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: a429e625-83b7-4078-a34e-ba6d23e08bca] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:58:51.929460 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=2 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:58:51.930248 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=6 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:58:51.936153 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4c67875d-1e30-4c3d-980e-2c50f9ec1a1f tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:58:51.936659 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4c67875d-1e30-4c3d-980e-2c50f9ec1a1f tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:58:51.937113 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4c67875d-1e30-4c3d-980e-2c50f9ec1a1f tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:58:51.937827 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4c67875d-1e30-4c3d-980e-2c50f9ec1a1f tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:58:51.938300 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4c67875d-1e30-4c3d-980e-2c50f9ec1a1f tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:58:51.938782 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4c67875d-1e30-4c3d-980e-2c50f9ec1a1f tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:58:51.978169 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-4c67875d-1e30-4c3d-980e-2c50f9ec1a1f tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'aad9d55ccfe74ffb914f02030529523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ad9e4338314c269afb0cfcebe03584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:58:51.984728 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-4c67875d-1e30-4c3d-980e-2c50f9ec1a1f tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: a429e625-83b7-4078-a34e-ba6d23e08bca] Old instance type m1.heat2, new instance type m1.heat {{(pid=134101) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 04 22:58:51.992784 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-4c67875d-1e30-4c3d-980e-2c50f9ec1a1f tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Flavor limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 22:58:51.993225 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-4c67875d-1e30-4c3d-980e-2c50f9ec1a1f tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Image limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 22:58:51.993723 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-4c67875d-1e30-4c3d-980e-2c50f9ec1a1f tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Flavor pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 22:58:51.994450 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-4c67875d-1e30-4c3d-980e-2c50f9ec1a1f tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Image pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 22:58:51.994887 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-4c67875d-1e30-4c3d-980e-2c50f9ec1a1f tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 22:58:52.074470 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-4c67875d-1e30-4c3d-980e-2c50f9ec1a1f tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "POST /compute/v2.1/servers/a429e625-83b7-4078-a34e-ba6d23e08bca/action" status: 202 len: 0 microversion: 2.1 time: 0.154350 Oct 04 22:58:52.078115 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4126/7430] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 22:58:51 2022] POST /compute/v2.1/servers/a429e625-83b7-4078-a34e-ba6d23e08bca/action => generated 0 bytes in 156 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 22:58:52.084724 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-38c8d1c0-b177-4d07-96e1-0cb328f2ac39 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:58:52.085434 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-38c8d1c0-b177-4d07-96e1-0cb328f2ac39 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: a429e625-83b7-4078-a34e-ba6d23e08bca] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:58:52.088452 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_api:SELECT=2 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:58:52.089134 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:58:52.095306 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-38c8d1c0-b177-4d07-96e1-0cb328f2ac39 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:58:52.095795 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-38c8d1c0-b177-4d07-96e1-0cb328f2ac39 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:58:52.096232 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-38c8d1c0-b177-4d07-96e1-0cb328f2ac39 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:58:52.096935 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-38c8d1c0-b177-4d07-96e1-0cb328f2ac39 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:58:52.097390 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-38c8d1c0-b177-4d07-96e1-0cb328f2ac39 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:58:52.097812 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-38c8d1c0-b177-4d07-96e1-0cb328f2ac39 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:58:52.240794 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-38c8d1c0-b177-4d07-96e1-0cb328f2ac39 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad9d55ccfe74ffb914f02030529523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ad9e4338314c269afb0cfcebe03584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:58:52.249443 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-38c8d1c0-b177-4d07-96e1-0cb328f2ac39 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/a429e625-83b7-4078-a34e-ba6d23e08bca" status: 200 len: 1722 microversion: 2.1 time: 0.169811 Oct 04 22:58:52.250191 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3305/7431] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:58:52 2022] GET /compute/v2.1/servers/a429e625-83b7-4078-a34e-ba6d23e08bca => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:58:53.273783 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-7add39b1-9b48-4c09-b6e3-c73514935819 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:58:53.274452 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-7add39b1-9b48-4c09-b6e3-c73514935819 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: a429e625-83b7-4078-a34e-ba6d23e08bca] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:58:53.281585 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7add39b1-9b48-4c09-b6e3-c73514935819 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:58:53.282090 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7add39b1-9b48-4c09-b6e3-c73514935819 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:58:53.282600 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7add39b1-9b48-4c09-b6e3-c73514935819 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:58:53.283321 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7add39b1-9b48-4c09-b6e3-c73514935819 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:58:53.283798 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7add39b1-9b48-4c09-b6e3-c73514935819 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:58:53.284246 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7add39b1-9b48-4c09-b6e3-c73514935819 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:58:53.424414 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-7add39b1-9b48-4c09-b6e3-c73514935819 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad9d55ccfe74ffb914f02030529523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ad9e4338314c269afb0cfcebe03584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:58:53.433772 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-7add39b1-9b48-4c09-b6e3-c73514935819 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/a429e625-83b7-4078-a34e-ba6d23e08bca" status: 200 len: 1722 microversion: 2.1 time: 0.164370 Oct 04 22:58:53.434468 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4127/7432] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:58:53 2022] GET /compute/v2.1/servers/a429e625-83b7-4078-a34e-ba6d23e08bca => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:58:54.457248 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-eae86967-a115-450e-b1e5-16261448d244 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:58:54.457788 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-eae86967-a115-450e-b1e5-16261448d244 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: a429e625-83b7-4078-a34e-ba6d23e08bca] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:58:54.464649 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-eae86967-a115-450e-b1e5-16261448d244 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:58:54.465137 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-eae86967-a115-450e-b1e5-16261448d244 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:58:54.465581 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-eae86967-a115-450e-b1e5-16261448d244 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:58:54.466279 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-eae86967-a115-450e-b1e5-16261448d244 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:58:54.466773 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-eae86967-a115-450e-b1e5-16261448d244 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:58:54.467204 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-eae86967-a115-450e-b1e5-16261448d244 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:58:54.595489 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-eae86967-a115-450e-b1e5-16261448d244 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad9d55ccfe74ffb914f02030529523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ad9e4338314c269afb0cfcebe03584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:58:54.604381 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-eae86967-a115-450e-b1e5-16261448d244 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/a429e625-83b7-4078-a34e-ba6d23e08bca" status: 200 len: 1727 microversion: 2.1 time: 0.151183 Oct 04 22:58:54.604968 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3306/7433] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:58:54 2022] GET /compute/v2.1/servers/a429e625-83b7-4078-a34e-ba6d23e08bca => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:58:55.629704 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-70dd0dd5-e8f4-4fbf-9acb-8b6c29a932fd tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:58:55.630931 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-70dd0dd5-e8f4-4fbf-9acb-8b6c29a932fd tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: a429e625-83b7-4078-a34e-ba6d23e08bca] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:58:55.637784 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-70dd0dd5-e8f4-4fbf-9acb-8b6c29a932fd tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:58:55.638275 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-70dd0dd5-e8f4-4fbf-9acb-8b6c29a932fd tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:58:55.638773 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-70dd0dd5-e8f4-4fbf-9acb-8b6c29a932fd tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:58:55.639473 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-70dd0dd5-e8f4-4fbf-9acb-8b6c29a932fd tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:58:55.639938 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-70dd0dd5-e8f4-4fbf-9acb-8b6c29a932fd tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:58:55.640408 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-70dd0dd5-e8f4-4fbf-9acb-8b6c29a932fd tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:58:55.775463 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-70dd0dd5-e8f4-4fbf-9acb-8b6c29a932fd tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad9d55ccfe74ffb914f02030529523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ad9e4338314c269afb0cfcebe03584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:58:55.784116 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-70dd0dd5-e8f4-4fbf-9acb-8b6c29a932fd tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/a429e625-83b7-4078-a34e-ba6d23e08bca" status: 200 len: 1727 microversion: 2.1 time: 0.158670 Oct 04 22:58:55.784691 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4128/7434] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:58:55 2022] GET /compute/v2.1/servers/a429e625-83b7-4078-a34e-ba6d23e08bca => generated 1727 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:58:56.808146 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-25d94e0c-9ec0-4c25-9c58-3fd4a8dca3c2 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:58:56.808765 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-25d94e0c-9ec0-4c25-9c58-3fd4a8dca3c2 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: a429e625-83b7-4078-a34e-ba6d23e08bca] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:58:56.815466 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-25d94e0c-9ec0-4c25-9c58-3fd4a8dca3c2 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:58:56.815955 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-25d94e0c-9ec0-4c25-9c58-3fd4a8dca3c2 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:58:56.816399 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-25d94e0c-9ec0-4c25-9c58-3fd4a8dca3c2 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:58:56.817092 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-25d94e0c-9ec0-4c25-9c58-3fd4a8dca3c2 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:58:56.818237 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-25d94e0c-9ec0-4c25-9c58-3fd4a8dca3c2 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:58:56.818694 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-25d94e0c-9ec0-4c25-9c58-3fd4a8dca3c2 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:58:56.954037 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-25d94e0c-9ec0-4c25-9c58-3fd4a8dca3c2 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad9d55ccfe74ffb914f02030529523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ad9e4338314c269afb0cfcebe03584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:58:56.962227 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-25d94e0c-9ec0-4c25-9c58-3fd4a8dca3c2 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/a429e625-83b7-4078-a34e-ba6d23e08bca" status: 200 len: 1727 microversion: 2.1 time: 0.158018 Oct 04 22:58:56.962834 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3307/7435] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:58:56 2022] GET /compute/v2.1/servers/a429e625-83b7-4078-a34e-ba6d23e08bca => generated 1727 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:58:57.986421 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-86306668-a4a3-4a18-8260-26714d34d27a tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:58:57.987054 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-86306668-a4a3-4a18-8260-26714d34d27a tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: a429e625-83b7-4078-a34e-ba6d23e08bca] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:58:57.994696 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-86306668-a4a3-4a18-8260-26714d34d27a tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:58:57.995197 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-86306668-a4a3-4a18-8260-26714d34d27a tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:58:57.995654 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-86306668-a4a3-4a18-8260-26714d34d27a tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:58:57.996381 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-86306668-a4a3-4a18-8260-26714d34d27a tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:58:57.996854 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-86306668-a4a3-4a18-8260-26714d34d27a tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:58:57.997306 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-86306668-a4a3-4a18-8260-26714d34d27a tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:58:58.135793 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-86306668-a4a3-4a18-8260-26714d34d27a tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad9d55ccfe74ffb914f02030529523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ad9e4338314c269afb0cfcebe03584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:58:58.144409 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-86306668-a4a3-4a18-8260-26714d34d27a tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/a429e625-83b7-4078-a34e-ba6d23e08bca" status: 200 len: 1727 microversion: 2.1 time: 0.161951 Oct 04 22:58:58.145026 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4129/7436] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:58:57 2022] GET /compute/v2.1/servers/a429e625-83b7-4078-a34e-ba6d23e08bca => generated 1727 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:58:59.168210 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-3c9edfcb-a2fa-431c-97d8-f8de6555b0ec tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:58:59.168865 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-3c9edfcb-a2fa-431c-97d8-f8de6555b0ec tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: a429e625-83b7-4078-a34e-ba6d23e08bca] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:58:59.175616 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3c9edfcb-a2fa-431c-97d8-f8de6555b0ec tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:58:59.176108 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3c9edfcb-a2fa-431c-97d8-f8de6555b0ec tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:58:59.176647 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3c9edfcb-a2fa-431c-97d8-f8de6555b0ec tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:58:59.177883 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3c9edfcb-a2fa-431c-97d8-f8de6555b0ec tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:58:59.178348 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3c9edfcb-a2fa-431c-97d8-f8de6555b0ec tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:58:59.178802 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3c9edfcb-a2fa-431c-97d8-f8de6555b0ec tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:58:59.561560 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-3c9edfcb-a2fa-431c-97d8-f8de6555b0ec tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad9d55ccfe74ffb914f02030529523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ad9e4338314c269afb0cfcebe03584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:58:59.569954 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-3c9edfcb-a2fa-431c-97d8-f8de6555b0ec tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/a429e625-83b7-4078-a34e-ba6d23e08bca" status: 200 len: 1727 microversion: 2.1 time: 0.405603 Oct 04 22:58:59.570549 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3308/7437] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:58:59 2022] GET /compute/v2.1/servers/a429e625-83b7-4078-a34e-ba6d23e08bca => generated 1727 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:59:00.593259 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-7ce2c27a-dfca-4a8a-87bc-a95faedbe740 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:59:00.593952 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-7ce2c27a-dfca-4a8a-87bc-a95faedbe740 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: a429e625-83b7-4078-a34e-ba6d23e08bca] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:59:00.601572 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7ce2c27a-dfca-4a8a-87bc-a95faedbe740 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:59:00.602069 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7ce2c27a-dfca-4a8a-87bc-a95faedbe740 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:59:00.602553 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7ce2c27a-dfca-4a8a-87bc-a95faedbe740 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:59:00.603275 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7ce2c27a-dfca-4a8a-87bc-a95faedbe740 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:59:00.603726 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7ce2c27a-dfca-4a8a-87bc-a95faedbe740 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:59:00.604165 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7ce2c27a-dfca-4a8a-87bc-a95faedbe740 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:59:00.734331 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-7ce2c27a-dfca-4a8a-87bc-a95faedbe740 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad9d55ccfe74ffb914f02030529523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ad9e4338314c269afb0cfcebe03584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:59:00.743408 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-7ce2c27a-dfca-4a8a-87bc-a95faedbe740 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/a429e625-83b7-4078-a34e-ba6d23e08bca" status: 200 len: 1727 microversion: 2.1 time: 0.154220 Oct 04 22:59:00.744277 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4130/7438] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:59:00 2022] GET /compute/v2.1/servers/a429e625-83b7-4078-a34e-ba6d23e08bca => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:59:01.767616 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-4c108606-daec-4fa7-9f88-ace95cb800f0 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:59:01.768241 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-4c108606-daec-4fa7-9f88-ace95cb800f0 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: a429e625-83b7-4078-a34e-ba6d23e08bca] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:59:01.775846 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4c108606-daec-4fa7-9f88-ace95cb800f0 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:59:01.776337 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4c108606-daec-4fa7-9f88-ace95cb800f0 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:59:01.776776 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4c108606-daec-4fa7-9f88-ace95cb800f0 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:59:01.777483 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4c108606-daec-4fa7-9f88-ace95cb800f0 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:59:01.777947 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4c108606-daec-4fa7-9f88-ace95cb800f0 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:59:01.778390 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4c108606-daec-4fa7-9f88-ace95cb800f0 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:59:01.908377 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-4c108606-daec-4fa7-9f88-ace95cb800f0 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad9d55ccfe74ffb914f02030529523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ad9e4338314c269afb0cfcebe03584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:59:01.917242 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-4c108606-daec-4fa7-9f88-ace95cb800f0 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/a429e625-83b7-4078-a34e-ba6d23e08bca" status: 200 len: 1727 microversion: 2.1 time: 0.153672 Oct 04 22:59:01.917816 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3309/7439] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:59:01 2022] GET /compute/v2.1/servers/a429e625-83b7-4078-a34e-ba6d23e08bca => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:59:02.940578 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-c6432f49-c246-4e27-9cdc-7054c49770fe tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:59:02.941211 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-c6432f49-c246-4e27-9cdc-7054c49770fe tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: a429e625-83b7-4078-a34e-ba6d23e08bca] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:59:02.948636 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c6432f49-c246-4e27-9cdc-7054c49770fe tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:59:02.949145 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c6432f49-c246-4e27-9cdc-7054c49770fe tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:59:02.949635 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c6432f49-c246-4e27-9cdc-7054c49770fe tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:59:02.950355 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c6432f49-c246-4e27-9cdc-7054c49770fe tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:59:02.950857 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c6432f49-c246-4e27-9cdc-7054c49770fe tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:59:02.951305 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c6432f49-c246-4e27-9cdc-7054c49770fe tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:59:03.083475 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-c6432f49-c246-4e27-9cdc-7054c49770fe tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad9d55ccfe74ffb914f02030529523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ad9e4338314c269afb0cfcebe03584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:59:03.091901 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-c6432f49-c246-4e27-9cdc-7054c49770fe tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/a429e625-83b7-4078-a34e-ba6d23e08bca" status: 200 len: 1727 microversion: 2.1 time: 0.155198 Oct 04 22:59:03.092481 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4131/7440] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:59:02 2022] GET /compute/v2.1/servers/a429e625-83b7-4078-a34e-ba6d23e08bca => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:59:04.115998 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-937f4205-1d39-4402-ba82-3ecb55dfd2a7 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:59:04.116701 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-937f4205-1d39-4402-ba82-3ecb55dfd2a7 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: a429e625-83b7-4078-a34e-ba6d23e08bca] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:59:04.123874 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-937f4205-1d39-4402-ba82-3ecb55dfd2a7 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:59:04.124340 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-937f4205-1d39-4402-ba82-3ecb55dfd2a7 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:59:04.124843 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-937f4205-1d39-4402-ba82-3ecb55dfd2a7 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:59:04.125575 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-937f4205-1d39-4402-ba82-3ecb55dfd2a7 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:59:04.126033 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-937f4205-1d39-4402-ba82-3ecb55dfd2a7 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:59:04.126488 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-937f4205-1d39-4402-ba82-3ecb55dfd2a7 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:59:04.261729 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-937f4205-1d39-4402-ba82-3ecb55dfd2a7 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad9d55ccfe74ffb914f02030529523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ad9e4338314c269afb0cfcebe03584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:59:04.270031 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-937f4205-1d39-4402-ba82-3ecb55dfd2a7 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/a429e625-83b7-4078-a34e-ba6d23e08bca" status: 200 len: 1727 microversion: 2.1 time: 0.157933 Oct 04 22:59:04.271141 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3310/7441] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:59:04 2022] GET /compute/v2.1/servers/a429e625-83b7-4078-a34e-ba6d23e08bca => generated 1727 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:59:05.294332 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e7d092fa-e177-4dfc-9da0-9003f852bc27 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:59:05.294986 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-e7d092fa-e177-4dfc-9da0-9003f852bc27 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: a429e625-83b7-4078-a34e-ba6d23e08bca] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:59:05.302030 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e7d092fa-e177-4dfc-9da0-9003f852bc27 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:59:05.302577 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e7d092fa-e177-4dfc-9da0-9003f852bc27 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:59:05.303037 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e7d092fa-e177-4dfc-9da0-9003f852bc27 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:59:05.303752 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e7d092fa-e177-4dfc-9da0-9003f852bc27 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:59:05.304228 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e7d092fa-e177-4dfc-9da0-9003f852bc27 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:59:05.304678 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e7d092fa-e177-4dfc-9da0-9003f852bc27 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:59:05.437889 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-e7d092fa-e177-4dfc-9da0-9003f852bc27 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad9d55ccfe74ffb914f02030529523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ad9e4338314c269afb0cfcebe03584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:59:05.447101 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-e7d092fa-e177-4dfc-9da0-9003f852bc27 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/a429e625-83b7-4078-a34e-ba6d23e08bca" status: 200 len: 1727 microversion: 2.1 time: 0.156782 Oct 04 22:59:05.447698 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4132/7442] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:59:05 2022] GET /compute/v2.1/servers/a429e625-83b7-4078-a34e-ba6d23e08bca => generated 1727 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:59:06.471348 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-9e9584f5-e66b-4c9f-b10c-f32610234dca tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:59:06.471922 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-9e9584f5-e66b-4c9f-b10c-f32610234dca tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: a429e625-83b7-4078-a34e-ba6d23e08bca] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:59:06.478802 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9e9584f5-e66b-4c9f-b10c-f32610234dca tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:59:06.479293 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9e9584f5-e66b-4c9f-b10c-f32610234dca tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:59:06.479735 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9e9584f5-e66b-4c9f-b10c-f32610234dca tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:59:06.480431 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9e9584f5-e66b-4c9f-b10c-f32610234dca tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:59:06.480891 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9e9584f5-e66b-4c9f-b10c-f32610234dca tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:59:06.481320 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9e9584f5-e66b-4c9f-b10c-f32610234dca tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:59:06.608993 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-9e9584f5-e66b-4c9f-b10c-f32610234dca tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad9d55ccfe74ffb914f02030529523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ad9e4338314c269afb0cfcebe03584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:59:06.617842 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-9e9584f5-e66b-4c9f-b10c-f32610234dca tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/a429e625-83b7-4078-a34e-ba6d23e08bca" status: 200 len: 1727 microversion: 2.1 time: 0.150512 Oct 04 22:59:06.618441 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3311/7443] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:59:06 2022] GET /compute/v2.1/servers/a429e625-83b7-4078-a34e-ba6d23e08bca => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:59:07.642092 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-a6215f28-97b0-47b9-b694-99db49476a38 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:59:07.642834 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-a6215f28-97b0-47b9-b694-99db49476a38 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: a429e625-83b7-4078-a34e-ba6d23e08bca] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:59:07.650609 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a6215f28-97b0-47b9-b694-99db49476a38 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:59:07.651115 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a6215f28-97b0-47b9-b694-99db49476a38 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:59:07.651573 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a6215f28-97b0-47b9-b694-99db49476a38 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:59:07.652300 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a6215f28-97b0-47b9-b694-99db49476a38 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:59:07.652769 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a6215f28-97b0-47b9-b694-99db49476a38 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:59:07.653214 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a6215f28-97b0-47b9-b694-99db49476a38 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:59:07.791903 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-a6215f28-97b0-47b9-b694-99db49476a38 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad9d55ccfe74ffb914f02030529523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ad9e4338314c269afb0cfcebe03584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:59:07.800364 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-a6215f28-97b0-47b9-b694-99db49476a38 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/a429e625-83b7-4078-a34e-ba6d23e08bca" status: 200 len: 1727 microversion: 2.1 time: 0.162226 Oct 04 22:59:07.800954 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4133/7444] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:59:07 2022] GET /compute/v2.1/servers/a429e625-83b7-4078-a34e-ba6d23e08bca => generated 1727 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:59:08.824418 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-2a71a96a-2f03-471d-86e2-3ccd6648c69e tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:59:08.825062 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-2a71a96a-2f03-471d-86e2-3ccd6648c69e tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: a429e625-83b7-4078-a34e-ba6d23e08bca] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:59:08.831849 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2a71a96a-2f03-471d-86e2-3ccd6648c69e tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:59:08.832335 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2a71a96a-2f03-471d-86e2-3ccd6648c69e tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:59:08.833660 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2a71a96a-2f03-471d-86e2-3ccd6648c69e tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:59:08.834391 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2a71a96a-2f03-471d-86e2-3ccd6648c69e tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:59:08.834858 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2a71a96a-2f03-471d-86e2-3ccd6648c69e tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:59:08.835290 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2a71a96a-2f03-471d-86e2-3ccd6648c69e tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:59:08.970305 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-2a71a96a-2f03-471d-86e2-3ccd6648c69e tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad9d55ccfe74ffb914f02030529523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ad9e4338314c269afb0cfcebe03584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:59:08.978636 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-2a71a96a-2f03-471d-86e2-3ccd6648c69e tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/a429e625-83b7-4078-a34e-ba6d23e08bca" status: 200 len: 1727 microversion: 2.1 time: 0.158174 Oct 04 22:59:08.979217 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3312/7445] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:59:08 2022] GET /compute/v2.1/servers/a429e625-83b7-4078-a34e-ba6d23e08bca => generated 1727 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:59:10.002130 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-96c4b175-d54c-4d3c-a3aa-a37adc69133b tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:59:10.002792 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-96c4b175-d54c-4d3c-a3aa-a37adc69133b tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: a429e625-83b7-4078-a34e-ba6d23e08bca] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:59:10.009705 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-96c4b175-d54c-4d3c-a3aa-a37adc69133b tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:59:10.010212 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-96c4b175-d54c-4d3c-a3aa-a37adc69133b tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:59:10.010719 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-96c4b175-d54c-4d3c-a3aa-a37adc69133b tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:59:10.011430 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-96c4b175-d54c-4d3c-a3aa-a37adc69133b tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:59:10.011907 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-96c4b175-d54c-4d3c-a3aa-a37adc69133b tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:59:10.012355 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-96c4b175-d54c-4d3c-a3aa-a37adc69133b tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:59:10.141457 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-96c4b175-d54c-4d3c-a3aa-a37adc69133b tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad9d55ccfe74ffb914f02030529523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ad9e4338314c269afb0cfcebe03584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:59:10.150593 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-96c4b175-d54c-4d3c-a3aa-a37adc69133b tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/a429e625-83b7-4078-a34e-ba6d23e08bca" status: 200 len: 1727 microversion: 2.1 time: 0.152319 Oct 04 22:59:10.151186 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4134/7446] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:59:09 2022] GET /compute/v2.1/servers/a429e625-83b7-4078-a34e-ba6d23e08bca => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:59:11.174817 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-9bf3da39-f7fc-45f8-b647-5c41ebea5232 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:59:11.175437 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-9bf3da39-f7fc-45f8-b647-5c41ebea5232 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: a429e625-83b7-4078-a34e-ba6d23e08bca] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:59:11.182813 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9bf3da39-f7fc-45f8-b647-5c41ebea5232 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:59:11.183299 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9bf3da39-f7fc-45f8-b647-5c41ebea5232 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:59:11.183738 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9bf3da39-f7fc-45f8-b647-5c41ebea5232 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:59:11.184433 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9bf3da39-f7fc-45f8-b647-5c41ebea5232 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:59:11.184889 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9bf3da39-f7fc-45f8-b647-5c41ebea5232 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:59:11.185318 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9bf3da39-f7fc-45f8-b647-5c41ebea5232 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:59:11.316625 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-9bf3da39-f7fc-45f8-b647-5c41ebea5232 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad9d55ccfe74ffb914f02030529523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ad9e4338314c269afb0cfcebe03584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:59:11.324889 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-9bf3da39-f7fc-45f8-b647-5c41ebea5232 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/a429e625-83b7-4078-a34e-ba6d23e08bca" status: 200 len: 1727 microversion: 2.1 time: 0.153959 Oct 04 22:59:11.325467 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3313/7447] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:59:11 2022] GET /compute/v2.1/servers/a429e625-83b7-4078-a34e-ba6d23e08bca => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:59:12.349078 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e81bcfbc-bad1-46e5-8056-417bd40ec55f tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:59:12.349741 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-e81bcfbc-bad1-46e5-8056-417bd40ec55f tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: a429e625-83b7-4078-a34e-ba6d23e08bca] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:59:12.356662 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e81bcfbc-bad1-46e5-8056-417bd40ec55f tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:59:12.357159 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e81bcfbc-bad1-46e5-8056-417bd40ec55f tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:59:12.357610 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e81bcfbc-bad1-46e5-8056-417bd40ec55f tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:59:12.358316 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e81bcfbc-bad1-46e5-8056-417bd40ec55f tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:59:12.358880 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e81bcfbc-bad1-46e5-8056-417bd40ec55f tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:59:12.359319 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e81bcfbc-bad1-46e5-8056-417bd40ec55f tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:59:12.489803 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-e81bcfbc-bad1-46e5-8056-417bd40ec55f tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad9d55ccfe74ffb914f02030529523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ad9e4338314c269afb0cfcebe03584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:59:12.498500 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-e81bcfbc-bad1-46e5-8056-417bd40ec55f tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/a429e625-83b7-4078-a34e-ba6d23e08bca" status: 200 len: 1727 microversion: 2.1 time: 0.153737 Oct 04 22:59:12.499079 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4135/7448] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:59:12 2022] GET /compute/v2.1/servers/a429e625-83b7-4078-a34e-ba6d23e08bca => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:59:13.524109 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-80a640bd-b72a-4b69-a9c8-93751cc17475 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:59:13.525445 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-80a640bd-b72a-4b69-a9c8-93751cc17475 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: a429e625-83b7-4078-a34e-ba6d23e08bca] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:59:13.533158 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-80a640bd-b72a-4b69-a9c8-93751cc17475 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:59:13.534033 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-80a640bd-b72a-4b69-a9c8-93751cc17475 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:59:13.534759 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-80a640bd-b72a-4b69-a9c8-93751cc17475 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:59:13.535800 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-80a640bd-b72a-4b69-a9c8-93751cc17475 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:59:13.536484 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-80a640bd-b72a-4b69-a9c8-93751cc17475 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:59:13.537137 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-80a640bd-b72a-4b69-a9c8-93751cc17475 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:59:13.805394 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-80a640bd-b72a-4b69-a9c8-93751cc17475 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad9d55ccfe74ffb914f02030529523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ad9e4338314c269afb0cfcebe03584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:59:13.814313 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-80a640bd-b72a-4b69-a9c8-93751cc17475 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/a429e625-83b7-4078-a34e-ba6d23e08bca" status: 200 len: 1726 microversion: 2.1 time: 0.295024 Oct 04 22:59:13.815233 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3314/7449] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:59:13 2022] GET /compute/v2.1/servers/a429e625-83b7-4078-a34e-ba6d23e08bca => generated 1726 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:59:13.965928 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-ce2884ea-df38-4fde-be06-025922859482 req-9f96581c-ef1f-450f-a505-04ed75e0e77c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a429e625-83b7-4078-a34e-ba6d23e08bca", "name": "network-vif-unplugged", "status": "completed", "tag": "2bffd9fb-5450-442f-ab82-e27a42819d21"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:59:13.975843 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-ce2884ea-df38-4fde-be06-025922859482 req-9f96581c-ef1f-450f-a505-04ed75e0e77c service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:59:13.976349 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-ce2884ea-df38-4fde-be06-025922859482 req-9f96581c-ef1f-450f-a505-04ed75e0e77c service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:59:13.976801 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-ce2884ea-df38-4fde-be06-025922859482 req-9f96581c-ef1f-450f-a505-04ed75e0e77c service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:59:13.989785 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-ce2884ea-df38-4fde-be06-025922859482 req-9f96581c-ef1f-450f-a505-04ed75e0e77c service nova] Creating event network-vif-unplugged:2bffd9fb-5450-442f-ab82-e27a42819d21 for instance a429e625-83b7-4078-a34e-ba6d23e08bca on n-h2-860284-1 Oct 04 22:59:13.996083 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [req-ce2884ea-df38-4fde-be06-025922859482 req-9f96581c-ef1f-450f-a505-04ed75e0e77c service nova] Instance a429e625-83b7-4078-a34e-ba6d23e08bca is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860284-1', 'n-h2-860284-1'} {{(pid=134101) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 22:59:14.008750 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-ce2884ea-df38-4fde-be06-025922859482 req-9f96581c-ef1f-450f-a505-04ed75e0e77c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.104760 Oct 04 22:59:14.011104 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4136/7450] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:59:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:59:14.839135 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-923d42a0-711e-4d70-8f79-214671c542b9 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:59:14.839754 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-923d42a0-711e-4d70-8f79-214671c542b9 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: a429e625-83b7-4078-a34e-ba6d23e08bca] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:59:14.846741 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-923d42a0-711e-4d70-8f79-214671c542b9 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:59:14.847236 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-923d42a0-711e-4d70-8f79-214671c542b9 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:59:14.847669 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-923d42a0-711e-4d70-8f79-214671c542b9 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:59:14.849210 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-923d42a0-711e-4d70-8f79-214671c542b9 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:59:14.849670 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-923d42a0-711e-4d70-8f79-214671c542b9 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:59:14.850097 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-923d42a0-711e-4d70-8f79-214671c542b9 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:59:14.989236 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-923d42a0-711e-4d70-8f79-214671c542b9 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad9d55ccfe74ffb914f02030529523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ad9e4338314c269afb0cfcebe03584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:59:14.998498 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-923d42a0-711e-4d70-8f79-214671c542b9 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/a429e625-83b7-4078-a34e-ba6d23e08bca" status: 200 len: 1726 microversion: 2.1 time: 0.163211 Oct 04 22:59:14.999095 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3315/7451] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:59:14 2022] GET /compute/v2.1/servers/a429e625-83b7-4078-a34e-ba6d23e08bca => generated 1726 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:59:16.023692 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-37336213-40af-43c7-99d5-d63bb37f5073 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:59:16.024416 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-37336213-40af-43c7-99d5-d63bb37f5073 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: a429e625-83b7-4078-a34e-ba6d23e08bca] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:59:16.029814 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-92aee12e-6836-4927-8255-d8a9a4362df8 req-35c36264-3a77-4c0e-9f5a-5c1f17f24c79 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a429e625-83b7-4078-a34e-ba6d23e08bca", "tag": "2bffd9fb-5450-442f-ab82-e27a42819d21"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:59:16.030902 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-37336213-40af-43c7-99d5-d63bb37f5073 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:59:16.031413 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-37336213-40af-43c7-99d5-d63bb37f5073 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:59:16.031868 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-37336213-40af-43c7-99d5-d63bb37f5073 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:59:16.032584 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-37336213-40af-43c7-99d5-d63bb37f5073 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:59:16.033083 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-37336213-40af-43c7-99d5-d63bb37f5073 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:59:16.033529 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-37336213-40af-43c7-99d5-d63bb37f5073 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:59:16.042063 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-92aee12e-6836-4927-8255-d8a9a4362df8 req-35c36264-3a77-4c0e-9f5a-5c1f17f24c79 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:59:16.042661 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-92aee12e-6836-4927-8255-d8a9a4362df8 req-35c36264-3a77-4c0e-9f5a-5c1f17f24c79 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:59:16.043175 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-92aee12e-6836-4927-8255-d8a9a4362df8 req-35c36264-3a77-4c0e-9f5a-5c1f17f24c79 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:59:16.056075 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-92aee12e-6836-4927-8255-d8a9a4362df8 req-35c36264-3a77-4c0e-9f5a-5c1f17f24c79 service nova] Creating event network-changed:2bffd9fb-5450-442f-ab82-e27a42819d21 for instance a429e625-83b7-4078-a34e-ba6d23e08bca on n-h2-860284-1 Oct 04 22:59:16.061634 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [req-92aee12e-6836-4927-8255-d8a9a4362df8 req-35c36264-3a77-4c0e-9f5a-5c1f17f24c79 service nova] Instance a429e625-83b7-4078-a34e-ba6d23e08bca is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860284-1', 'n-h2-860284-1'} {{(pid=134102) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 22:59:16.073711 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-92aee12e-6836-4927-8255-d8a9a4362df8 req-35c36264-3a77-4c0e-9f5a-5c1f17f24c79 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047529 Oct 04 22:59:16.074450 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3316/7452] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:59:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:59:16.186453 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-37336213-40af-43c7-99d5-d63bb37f5073 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad9d55ccfe74ffb914f02030529523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ad9e4338314c269afb0cfcebe03584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:59:16.195713 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-37336213-40af-43c7-99d5-d63bb37f5073 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/a429e625-83b7-4078-a34e-ba6d23e08bca" status: 200 len: 1724 microversion: 2.1 time: 0.178132 Oct 04 22:59:16.196668 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4137/7453] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:59:16 2022] GET /compute/v2.1/servers/a429e625-83b7-4078-a34e-ba6d23e08bca => generated 1724 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:59:17.221496 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-675af6ad-d943-47fb-b116-599191700e1e tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:59:17.222227 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-675af6ad-d943-47fb-b116-599191700e1e tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: a429e625-83b7-4078-a34e-ba6d23e08bca] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:59:17.231093 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-675af6ad-d943-47fb-b116-599191700e1e tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:59:17.231991 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-675af6ad-d943-47fb-b116-599191700e1e tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:59:17.232437 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-675af6ad-d943-47fb-b116-599191700e1e tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:59:17.233462 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-675af6ad-d943-47fb-b116-599191700e1e tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:59:17.233927 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-675af6ad-d943-47fb-b116-599191700e1e tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:59:17.234558 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-675af6ad-d943-47fb-b116-599191700e1e tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:59:17.373817 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-675af6ad-d943-47fb-b116-599191700e1e tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad9d55ccfe74ffb914f02030529523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ad9e4338314c269afb0cfcebe03584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:59:17.382826 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-675af6ad-d943-47fb-b116-599191700e1e tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/a429e625-83b7-4078-a34e-ba6d23e08bca" status: 200 len: 1724 microversion: 2.1 time: 0.166222 Oct 04 22:59:17.383343 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3317/7454] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:59:17 2022] GET /compute/v2.1/servers/a429e625-83b7-4078-a34e-ba6d23e08bca => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:59:18.407333 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-6bf9aa9e-7ea9-4e26-a152-ea260dfed0d4 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:59:18.407886 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-6bf9aa9e-7ea9-4e26-a152-ea260dfed0d4 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: a429e625-83b7-4078-a34e-ba6d23e08bca] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:59:18.415304 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6bf9aa9e-7ea9-4e26-a152-ea260dfed0d4 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:59:18.415813 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6bf9aa9e-7ea9-4e26-a152-ea260dfed0d4 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:59:18.416276 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6bf9aa9e-7ea9-4e26-a152-ea260dfed0d4 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:59:18.416995 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6bf9aa9e-7ea9-4e26-a152-ea260dfed0d4 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:59:18.417469 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6bf9aa9e-7ea9-4e26-a152-ea260dfed0d4 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:59:18.417918 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6bf9aa9e-7ea9-4e26-a152-ea260dfed0d4 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:59:18.566989 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-6bf9aa9e-7ea9-4e26-a152-ea260dfed0d4 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad9d55ccfe74ffb914f02030529523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ad9e4338314c269afb0cfcebe03584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:59:18.581675 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-6bf9aa9e-7ea9-4e26-a152-ea260dfed0d4 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/a429e625-83b7-4078-a34e-ba6d23e08bca" status: 200 len: 1724 microversion: 2.1 time: 0.178345 Oct 04 22:59:18.594674 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4138/7455] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:59:18 2022] GET /compute/v2.1/servers/a429e625-83b7-4078-a34e-ba6d23e08bca => generated 1724 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:59:19.606743 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-28a40e25-8430-451b-b004-6ecdf51ad7c2 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:59:19.607356 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-28a40e25-8430-451b-b004-6ecdf51ad7c2 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: a429e625-83b7-4078-a34e-ba6d23e08bca] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:59:19.614838 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-28a40e25-8430-451b-b004-6ecdf51ad7c2 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:59:19.615322 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-28a40e25-8430-451b-b004-6ecdf51ad7c2 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:59:19.615756 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-28a40e25-8430-451b-b004-6ecdf51ad7c2 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:59:19.616450 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-28a40e25-8430-451b-b004-6ecdf51ad7c2 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:59:19.616908 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-28a40e25-8430-451b-b004-6ecdf51ad7c2 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:59:19.617334 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-28a40e25-8430-451b-b004-6ecdf51ad7c2 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:59:19.759203 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-28a40e25-8430-451b-b004-6ecdf51ad7c2 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad9d55ccfe74ffb914f02030529523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ad9e4338314c269afb0cfcebe03584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:59:19.767901 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-28a40e25-8430-451b-b004-6ecdf51ad7c2 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/a429e625-83b7-4078-a34e-ba6d23e08bca" status: 200 len: 1724 microversion: 2.1 time: 0.165235 Oct 04 22:59:19.768500 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3318/7456] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:59:19 2022] GET /compute/v2.1/servers/a429e625-83b7-4078-a34e-ba6d23e08bca => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:59:20.792602 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-00aa9135-d1f9-4b49-9227-4bd25f49f35a tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:59:20.793224 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-00aa9135-d1f9-4b49-9227-4bd25f49f35a tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: a429e625-83b7-4078-a34e-ba6d23e08bca] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:59:20.800075 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-00aa9135-d1f9-4b49-9227-4bd25f49f35a tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:59:20.801109 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-00aa9135-d1f9-4b49-9227-4bd25f49f35a tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:59:20.801587 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-00aa9135-d1f9-4b49-9227-4bd25f49f35a tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:59:20.802312 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-00aa9135-d1f9-4b49-9227-4bd25f49f35a tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:59:20.802811 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-00aa9135-d1f9-4b49-9227-4bd25f49f35a tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:59:20.803252 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-00aa9135-d1f9-4b49-9227-4bd25f49f35a tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:59:20.940736 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-00aa9135-d1f9-4b49-9227-4bd25f49f35a tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad9d55ccfe74ffb914f02030529523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ad9e4338314c269afb0cfcebe03584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:59:20.949192 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-00aa9135-d1f9-4b49-9227-4bd25f49f35a tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/a429e625-83b7-4078-a34e-ba6d23e08bca" status: 200 len: 1724 microversion: 2.1 time: 0.160612 Oct 04 22:59:20.949786 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4139/7457] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:59:20 2022] GET /compute/v2.1/servers/a429e625-83b7-4078-a34e-ba6d23e08bca => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:59:21.972953 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-79b44272-c29c-4604-b7b4-9ce1157005c0 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:59:21.973789 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-79b44272-c29c-4604-b7b4-9ce1157005c0 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: a429e625-83b7-4078-a34e-ba6d23e08bca] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:59:21.980567 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-79b44272-c29c-4604-b7b4-9ce1157005c0 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:59:21.981065 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-79b44272-c29c-4604-b7b4-9ce1157005c0 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:59:21.981512 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-79b44272-c29c-4604-b7b4-9ce1157005c0 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:59:21.982219 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-79b44272-c29c-4604-b7b4-9ce1157005c0 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:59:21.982727 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-79b44272-c29c-4604-b7b4-9ce1157005c0 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:59:21.983162 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-79b44272-c29c-4604-b7b4-9ce1157005c0 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:59:22.111690 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-79b44272-c29c-4604-b7b4-9ce1157005c0 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad9d55ccfe74ffb914f02030529523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ad9e4338314c269afb0cfcebe03584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:59:22.120775 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-79b44272-c29c-4604-b7b4-9ce1157005c0 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/a429e625-83b7-4078-a34e-ba6d23e08bca" status: 200 len: 1724 microversion: 2.1 time: 0.152236 Oct 04 22:59:22.121372 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3319/7458] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:59:21 2022] GET /compute/v2.1/servers/a429e625-83b7-4078-a34e-ba6d23e08bca => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:59:23.145556 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-9288f585-7b6f-443a-9f06-d392b254e25f tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:59:23.146196 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-9288f585-7b6f-443a-9f06-d392b254e25f tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: a429e625-83b7-4078-a34e-ba6d23e08bca] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:59:23.149065 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=33 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:59:23.154435 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9288f585-7b6f-443a-9f06-d392b254e25f tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:59:23.154945 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9288f585-7b6f-443a-9f06-d392b254e25f tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:59:23.155401 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9288f585-7b6f-443a-9f06-d392b254e25f tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:59:23.156112 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9288f585-7b6f-443a-9f06-d392b254e25f tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:59:23.156584 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9288f585-7b6f-443a-9f06-d392b254e25f tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:59:23.157031 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9288f585-7b6f-443a-9f06-d392b254e25f tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:59:23.159837 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:59:23.288142 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-9288f585-7b6f-443a-9f06-d392b254e25f tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad9d55ccfe74ffb914f02030529523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ad9e4338314c269afb0cfcebe03584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:59:23.297056 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-9288f585-7b6f-443a-9f06-d392b254e25f tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/a429e625-83b7-4078-a34e-ba6d23e08bca" status: 200 len: 1724 microversion: 2.1 time: 0.156036 Oct 04 22:59:23.297614 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4140/7459] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:59:23 2022] GET /compute/v2.1/servers/a429e625-83b7-4078-a34e-ba6d23e08bca => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:59:24.321524 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-d598581e-3c3f-4440-b9e7-7f7a9ddf42ea tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:59:24.322189 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-d598581e-3c3f-4440-b9e7-7f7a9ddf42ea tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: a429e625-83b7-4078-a34e-ba6d23e08bca] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:59:24.325041 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_api:SELECT=31 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:59:24.330784 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d598581e-3c3f-4440-b9e7-7f7a9ddf42ea tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:59:24.331267 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d598581e-3c3f-4440-b9e7-7f7a9ddf42ea tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:59:24.331821 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d598581e-3c3f-4440-b9e7-7f7a9ddf42ea tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:59:24.332548 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d598581e-3c3f-4440-b9e7-7f7a9ddf42ea tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:59:24.332998 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d598581e-3c3f-4440-b9e7-7f7a9ddf42ea tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:59:24.333452 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d598581e-3c3f-4440-b9e7-7f7a9ddf42ea tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:59:24.336088 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=89 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:59:24.467350 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-d598581e-3c3f-4440-b9e7-7f7a9ddf42ea tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad9d55ccfe74ffb914f02030529523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ad9e4338314c269afb0cfcebe03584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:59:24.475728 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-d598581e-3c3f-4440-b9e7-7f7a9ddf42ea tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/a429e625-83b7-4078-a34e-ba6d23e08bca" status: 200 len: 1721 microversion: 2.1 time: 0.158130 Oct 04 22:59:24.476320 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3320/7460] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:59:24 2022] GET /compute/v2.1/servers/a429e625-83b7-4078-a34e-ba6d23e08bca => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:59:24.498917 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-164b8069-a5ec-48a5-9317-39f8e7d4937e tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:59:24.499475 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-164b8069-a5ec-48a5-9317-39f8e7d4937e tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: a429e625-83b7-4078-a34e-ba6d23e08bca] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:59:24.507337 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-164b8069-a5ec-48a5-9317-39f8e7d4937e tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:59:24.507848 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-164b8069-a5ec-48a5-9317-39f8e7d4937e tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:59:24.508306 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-164b8069-a5ec-48a5-9317-39f8e7d4937e tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:59:24.509029 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-164b8069-a5ec-48a5-9317-39f8e7d4937e tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:59:24.509506 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-164b8069-a5ec-48a5-9317-39f8e7d4937e tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:59:24.509957 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-164b8069-a5ec-48a5-9317-39f8e7d4937e tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:59:24.546893 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-164b8069-a5ec-48a5-9317-39f8e7d4937e tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:59:24.547391 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-164b8069-a5ec-48a5-9317-39f8e7d4937e tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:59:24.547849 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-164b8069-a5ec-48a5-9317-39f8e7d4937e tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:59:24.548592 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-164b8069-a5ec-48a5-9317-39f8e7d4937e tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:59:24.549069 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-164b8069-a5ec-48a5-9317-39f8e7d4937e tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:59:24.549515 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-164b8069-a5ec-48a5-9317-39f8e7d4937e tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:59:24.571193 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-164b8069-a5ec-48a5-9317-39f8e7d4937e tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Getting quotas for project d2ad9e4338314c269afb0cfcebe03584. Resources: {'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:59:24.576404 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-164b8069-a5ec-48a5-9317-39f8e7d4937e tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Getting quotas for user aad9d55ccfe74ffb914f02030529523d and project d2ad9e4338314c269afb0cfcebe03584. Resources: {'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:59:24.679090 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-164b8069-a5ec-48a5-9317-39f8e7d4937e tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "POST /compute/v2.1/servers/a429e625-83b7-4078-a34e-ba6d23e08bca/action" status: 202 len: 0 microversion: 2.1 time: 0.183870 Oct 04 22:59:24.680052 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4141/7461] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 22:59:24 2022] POST /compute/v2.1/servers/a429e625-83b7-4078-a34e-ba6d23e08bca/action => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 22:59:24.688080 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-3e1f9efb-6c88-4369-b9be-4780044d8403 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:59:24.688705 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-3e1f9efb-6c88-4369-b9be-4780044d8403 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: a429e625-83b7-4078-a34e-ba6d23e08bca] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:59:24.695015 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3e1f9efb-6c88-4369-b9be-4780044d8403 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:59:24.695447 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3e1f9efb-6c88-4369-b9be-4780044d8403 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:59:24.695895 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3e1f9efb-6c88-4369-b9be-4780044d8403 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:59:24.696629 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3e1f9efb-6c88-4369-b9be-4780044d8403 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:59:24.697099 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3e1f9efb-6c88-4369-b9be-4780044d8403 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:59:24.697543 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3e1f9efb-6c88-4369-b9be-4780044d8403 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:59:24.891267 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-3e1f9efb-6c88-4369-b9be-4780044d8403 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad9d55ccfe74ffb914f02030529523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ad9e4338314c269afb0cfcebe03584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:59:24.899644 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-3e1f9efb-6c88-4369-b9be-4780044d8403 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/a429e625-83b7-4078-a34e-ba6d23e08bca" status: 200 len: 1720 microversion: 2.1 time: 0.215521 Oct 04 22:59:24.900225 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3321/7462] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:59:24 2022] GET /compute/v2.1/servers/a429e625-83b7-4078-a34e-ba6d23e08bca => generated 1720 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:59:25.923836 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-2d075f20-3458-4788-8b4f-d67d0dabc1e6 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:59:25.924587 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-2d075f20-3458-4788-8b4f-d67d0dabc1e6 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: a429e625-83b7-4078-a34e-ba6d23e08bca] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:59:25.932697 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2d075f20-3458-4788-8b4f-d67d0dabc1e6 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:59:25.933210 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2d075f20-3458-4788-8b4f-d67d0dabc1e6 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:59:25.933670 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2d075f20-3458-4788-8b4f-d67d0dabc1e6 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:59:25.934399 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2d075f20-3458-4788-8b4f-d67d0dabc1e6 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:59:25.934879 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2d075f20-3458-4788-8b4f-d67d0dabc1e6 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:59:25.935325 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2d075f20-3458-4788-8b4f-d67d0dabc1e6 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:59:26.069037 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-2d075f20-3458-4788-8b4f-d67d0dabc1e6 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad9d55ccfe74ffb914f02030529523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ad9e4338314c269afb0cfcebe03584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:59:26.077390 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-2d075f20-3458-4788-8b4f-d67d0dabc1e6 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/a429e625-83b7-4078-a34e-ba6d23e08bca" status: 200 len: 1720 microversion: 2.1 time: 0.158026 Oct 04 22:59:26.077972 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4142/7463] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:59:25 2022] GET /compute/v2.1/servers/a429e625-83b7-4078-a34e-ba6d23e08bca => generated 1720 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:59:27.100713 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-67af6dc6-cbd6-40d8-84b4-cb2f13cf2d26 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:59:27.101423 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-67af6dc6-cbd6-40d8-84b4-cb2f13cf2d26 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: a429e625-83b7-4078-a34e-ba6d23e08bca] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:59:27.108210 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-67af6dc6-cbd6-40d8-84b4-cb2f13cf2d26 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:59:27.108702 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-67af6dc6-cbd6-40d8-84b4-cb2f13cf2d26 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:59:27.109146 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-67af6dc6-cbd6-40d8-84b4-cb2f13cf2d26 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:59:27.109854 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-67af6dc6-cbd6-40d8-84b4-cb2f13cf2d26 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:59:27.110462 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-67af6dc6-cbd6-40d8-84b4-cb2f13cf2d26 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:59:27.111060 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-67af6dc6-cbd6-40d8-84b4-cb2f13cf2d26 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:59:27.252017 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-f29351a5-83f0-42c8-af94-b1331a944e0f req-7753e12f-427e-4a0a-bfd7-c843e4ae9ffb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a429e625-83b7-4078-a34e-ba6d23e08bca", "name": "network-vif-plugged", "status": "completed", "tag": "2bffd9fb-5450-442f-ab82-e27a42819d21"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:59:27.253587 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-67af6dc6-cbd6-40d8-84b4-cb2f13cf2d26 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad9d55ccfe74ffb914f02030529523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ad9e4338314c269afb0cfcebe03584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:59:27.262974 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-67af6dc6-cbd6-40d8-84b4-cb2f13cf2d26 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/a429e625-83b7-4078-a34e-ba6d23e08bca" status: 200 len: 1720 microversion: 2.1 time: 0.166752 Oct 04 22:59:27.263576 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3322/7464] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:59:27 2022] GET /compute/v2.1/servers/a429e625-83b7-4078-a34e-ba6d23e08bca => generated 1720 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:59:27.265105 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-f29351a5-83f0-42c8-af94-b1331a944e0f req-7753e12f-427e-4a0a-bfd7-c843e4ae9ffb service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:59:27.265650 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-f29351a5-83f0-42c8-af94-b1331a944e0f req-7753e12f-427e-4a0a-bfd7-c843e4ae9ffb service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:59:27.266106 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-f29351a5-83f0-42c8-af94-b1331a944e0f req-7753e12f-427e-4a0a-bfd7-c843e4ae9ffb service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:59:27.286247 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-f29351a5-83f0-42c8-af94-b1331a944e0f req-7753e12f-427e-4a0a-bfd7-c843e4ae9ffb service nova] Creating event network-vif-plugged:2bffd9fb-5450-442f-ab82-e27a42819d21 for instance a429e625-83b7-4078-a34e-ba6d23e08bca on n-h2-860284-1 Oct 04 22:59:27.291952 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [req-f29351a5-83f0-42c8-af94-b1331a944e0f req-7753e12f-427e-4a0a-bfd7-c843e4ae9ffb service nova] Instance a429e625-83b7-4078-a34e-ba6d23e08bca is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860284-1', 'n-h2-860284-1'} {{(pid=134101) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 22:59:27.303215 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-f29351a5-83f0-42c8-af94-b1331a944e0f req-7753e12f-427e-4a0a-bfd7-c843e4ae9ffb service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116028 Oct 04 22:59:27.303828 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4143/7465] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:59:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:59:28.287610 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-4437aa79-c47f-47f4-8d43-d4fc358e50f9 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:59:28.288226 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-4437aa79-c47f-47f4-8d43-d4fc358e50f9 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: a429e625-83b7-4078-a34e-ba6d23e08bca] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:59:28.295047 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4437aa79-c47f-47f4-8d43-d4fc358e50f9 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:59:28.295534 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4437aa79-c47f-47f4-8d43-d4fc358e50f9 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:59:28.295969 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4437aa79-c47f-47f4-8d43-d4fc358e50f9 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:59:28.296657 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4437aa79-c47f-47f4-8d43-d4fc358e50f9 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:59:28.297116 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4437aa79-c47f-47f4-8d43-d4fc358e50f9 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:59:28.297541 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4437aa79-c47f-47f4-8d43-d4fc358e50f9 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:59:28.428765 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-4437aa79-c47f-47f4-8d43-d4fc358e50f9 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad9d55ccfe74ffb914f02030529523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ad9e4338314c269afb0cfcebe03584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:59:28.437054 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-4437aa79-c47f-47f4-8d43-d4fc358e50f9 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/a429e625-83b7-4078-a34e-ba6d23e08bca" status: 200 len: 1720 microversion: 2.1 time: 0.154094 Oct 04 22:59:28.437834 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3323/7466] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:59:28 2022] GET /compute/v2.1/servers/a429e625-83b7-4078-a34e-ba6d23e08bca => generated 1720 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:59:29.462039 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-d6cfe30d-7d03-4b7a-a167-5a334666d068 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:59:29.463075 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-d6cfe30d-7d03-4b7a-a167-5a334666d068 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: a429e625-83b7-4078-a34e-ba6d23e08bca] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:59:29.470986 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d6cfe30d-7d03-4b7a-a167-5a334666d068 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:59:29.471871 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d6cfe30d-7d03-4b7a-a167-5a334666d068 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:59:29.472301 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d6cfe30d-7d03-4b7a-a167-5a334666d068 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:59:29.473446 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d6cfe30d-7d03-4b7a-a167-5a334666d068 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:59:29.474270 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d6cfe30d-7d03-4b7a-a167-5a334666d068 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:59:29.474656 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d6cfe30d-7d03-4b7a-a167-5a334666d068 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:59:29.620790 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-d6cfe30d-7d03-4b7a-a167-5a334666d068 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad9d55ccfe74ffb914f02030529523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ad9e4338314c269afb0cfcebe03584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:59:29.631175 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-d6cfe30d-7d03-4b7a-a167-5a334666d068 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/a429e625-83b7-4078-a34e-ba6d23e08bca" status: 200 len: 1720 microversion: 2.1 time: 0.175425 Oct 04 22:59:29.631766 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4144/7467] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:59:29 2022] GET /compute/v2.1/servers/a429e625-83b7-4078-a34e-ba6d23e08bca => generated 1720 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:59:30.155739 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-c37f3b4e-f9ae-4403-ba60-acbf47f0b7f2 req-0bc7c803-a32e-4112-b732-b81b15c9bbdb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a429e625-83b7-4078-a34e-ba6d23e08bca", "name": "network-vif-unplugged", "status": "completed", "tag": "2bffd9fb-5450-442f-ab82-e27a42819d21"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:59:30.167530 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-c37f3b4e-f9ae-4403-ba60-acbf47f0b7f2 req-0bc7c803-a32e-4112-b732-b81b15c9bbdb service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:59:30.168059 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-c37f3b4e-f9ae-4403-ba60-acbf47f0b7f2 req-0bc7c803-a32e-4112-b732-b81b15c9bbdb service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:59:30.168505 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-c37f3b4e-f9ae-4403-ba60-acbf47f0b7f2 req-0bc7c803-a32e-4112-b732-b81b15c9bbdb service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:59:30.180848 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-c37f3b4e-f9ae-4403-ba60-acbf47f0b7f2 req-0bc7c803-a32e-4112-b732-b81b15c9bbdb service nova] Creating event network-vif-unplugged:2bffd9fb-5450-442f-ab82-e27a42819d21 for instance a429e625-83b7-4078-a34e-ba6d23e08bca on n-h1-860284-1 Oct 04 22:59:30.186745 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [req-c37f3b4e-f9ae-4403-ba60-acbf47f0b7f2 req-0bc7c803-a32e-4112-b732-b81b15c9bbdb service nova] Instance a429e625-83b7-4078-a34e-ba6d23e08bca is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860284-1', 'n-h1-860284-1'} {{(pid=134102) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 22:59:30.198233 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-c37f3b4e-f9ae-4403-ba60-acbf47f0b7f2 req-0bc7c803-a32e-4112-b732-b81b15c9bbdb service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046319 Oct 04 22:59:30.198936 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3324/7468] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:59:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:59:30.654391 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-f1153352-76dd-47c0-84f1-2c65b25b7bd9 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:59:30.655059 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-f1153352-76dd-47c0-84f1-2c65b25b7bd9 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: a429e625-83b7-4078-a34e-ba6d23e08bca] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:59:30.662637 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f1153352-76dd-47c0-84f1-2c65b25b7bd9 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:59:30.663138 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f1153352-76dd-47c0-84f1-2c65b25b7bd9 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:59:30.663588 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f1153352-76dd-47c0-84f1-2c65b25b7bd9 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:59:30.664303 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f1153352-76dd-47c0-84f1-2c65b25b7bd9 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:59:30.664769 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f1153352-76dd-47c0-84f1-2c65b25b7bd9 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:59:30.665211 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f1153352-76dd-47c0-84f1-2c65b25b7bd9 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:59:30.801675 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-f1153352-76dd-47c0-84f1-2c65b25b7bd9 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad9d55ccfe74ffb914f02030529523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ad9e4338314c269afb0cfcebe03584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:59:30.810248 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-f1153352-76dd-47c0-84f1-2c65b25b7bd9 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/a429e625-83b7-4078-a34e-ba6d23e08bca" status: 200 len: 1720 microversion: 2.1 time: 0.159832 Oct 04 22:59:30.810876 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4145/7469] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:59:30 2022] GET /compute/v2.1/servers/a429e625-83b7-4078-a34e-ba6d23e08bca => generated 1720 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:59:31.835017 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-6935baf0-32b6-4e87-949b-90c0d90eb432 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:59:31.835748 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-6935baf0-32b6-4e87-949b-90c0d90eb432 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: a429e625-83b7-4078-a34e-ba6d23e08bca] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:59:31.842051 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6935baf0-32b6-4e87-949b-90c0d90eb432 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:59:31.842577 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6935baf0-32b6-4e87-949b-90c0d90eb432 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:59:31.843017 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6935baf0-32b6-4e87-949b-90c0d90eb432 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:59:31.843714 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6935baf0-32b6-4e87-949b-90c0d90eb432 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:59:31.844176 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6935baf0-32b6-4e87-949b-90c0d90eb432 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:59:31.844698 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6935baf0-32b6-4e87-949b-90c0d90eb432 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:59:31.980597 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-6935baf0-32b6-4e87-949b-90c0d90eb432 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad9d55ccfe74ffb914f02030529523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ad9e4338314c269afb0cfcebe03584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:59:31.989753 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-6935baf0-32b6-4e87-949b-90c0d90eb432 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/a429e625-83b7-4078-a34e-ba6d23e08bca" status: 200 len: 1720 microversion: 2.1 time: 0.160318 Oct 04 22:59:31.990349 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3325/7470] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:59:31 2022] GET /compute/v2.1/servers/a429e625-83b7-4078-a34e-ba6d23e08bca => generated 1720 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:59:32.215321 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-15a58c94-bdff-45da-a513-bda3a81bada3 req-e75cb98f-2b5b-4e49-9753-118f14e44058 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a429e625-83b7-4078-a34e-ba6d23e08bca", "tag": "2bffd9fb-5450-442f-ab82-e27a42819d21"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:59:32.226477 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-15a58c94-bdff-45da-a513-bda3a81bada3 req-e75cb98f-2b5b-4e49-9753-118f14e44058 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:59:32.226982 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-15a58c94-bdff-45da-a513-bda3a81bada3 req-e75cb98f-2b5b-4e49-9753-118f14e44058 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:59:32.227430 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-15a58c94-bdff-45da-a513-bda3a81bada3 req-e75cb98f-2b5b-4e49-9753-118f14e44058 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:59:32.239806 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-15a58c94-bdff-45da-a513-bda3a81bada3 req-e75cb98f-2b5b-4e49-9753-118f14e44058 service nova] Creating event network-changed:2bffd9fb-5450-442f-ab82-e27a42819d21 for instance a429e625-83b7-4078-a34e-ba6d23e08bca on n-h1-860284-1 Oct 04 22:59:32.245628 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [req-15a58c94-bdff-45da-a513-bda3a81bada3 req-e75cb98f-2b5b-4e49-9753-118f14e44058 service nova] Instance a429e625-83b7-4078-a34e-ba6d23e08bca is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860284-1', 'n-h1-860284-1'} {{(pid=134101) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 22:59:32.256459 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-15a58c94-bdff-45da-a513-bda3a81bada3 req-e75cb98f-2b5b-4e49-9753-118f14e44058 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044942 Oct 04 22:59:32.257080 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4146/7471] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:59:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:59:33.013430 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-465fab8a-6931-4591-aa4a-8d387c127a22 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:59:33.014074 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-465fab8a-6931-4591-aa4a-8d387c127a22 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: a429e625-83b7-4078-a34e-ba6d23e08bca] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:59:33.021824 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-465fab8a-6931-4591-aa4a-8d387c127a22 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:59:33.022314 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-465fab8a-6931-4591-aa4a-8d387c127a22 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:59:33.022774 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-465fab8a-6931-4591-aa4a-8d387c127a22 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:59:33.023476 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-465fab8a-6931-4591-aa4a-8d387c127a22 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:59:33.023930 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-465fab8a-6931-4591-aa4a-8d387c127a22 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:59:33.024358 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-465fab8a-6931-4591-aa4a-8d387c127a22 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:59:33.231108 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-465fab8a-6931-4591-aa4a-8d387c127a22 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad9d55ccfe74ffb914f02030529523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ad9e4338314c269afb0cfcebe03584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:59:33.241653 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-465fab8a-6931-4591-aa4a-8d387c127a22 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/a429e625-83b7-4078-a34e-ba6d23e08bca" status: 200 len: 1720 microversion: 2.1 time: 0.232149 Oct 04 22:59:33.242255 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3326/7472] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:59:33 2022] GET /compute/v2.1/servers/a429e625-83b7-4078-a34e-ba6d23e08bca => generated 1720 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:59:34.267860 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-7cff6707-bdd3-402d-b335-ba2a40c9fe8d tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:59:34.268571 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-7cff6707-bdd3-402d-b335-ba2a40c9fe8d tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: a429e625-83b7-4078-a34e-ba6d23e08bca] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:59:34.275338 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7cff6707-bdd3-402d-b335-ba2a40c9fe8d tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:59:34.275844 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7cff6707-bdd3-402d-b335-ba2a40c9fe8d tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:59:34.276291 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7cff6707-bdd3-402d-b335-ba2a40c9fe8d tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:59:34.276995 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7cff6707-bdd3-402d-b335-ba2a40c9fe8d tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:59:34.277460 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7cff6707-bdd3-402d-b335-ba2a40c9fe8d tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:59:34.277900 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7cff6707-bdd3-402d-b335-ba2a40c9fe8d tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:59:34.420775 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-7cff6707-bdd3-402d-b335-ba2a40c9fe8d tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad9d55ccfe74ffb914f02030529523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ad9e4338314c269afb0cfcebe03584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:59:34.430022 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-7cff6707-bdd3-402d-b335-ba2a40c9fe8d tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/a429e625-83b7-4078-a34e-ba6d23e08bca" status: 200 len: 1720 microversion: 2.1 time: 0.167395 Oct 04 22:59:34.430702 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4147/7473] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:59:34 2022] GET /compute/v2.1/servers/a429e625-83b7-4078-a34e-ba6d23e08bca => generated 1720 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:59:35.453793 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-034b261d-f3fb-462a-8735-be839c46598c tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:59:35.454349 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-034b261d-f3fb-462a-8735-be839c46598c tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: a429e625-83b7-4078-a34e-ba6d23e08bca] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:59:35.462216 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-034b261d-f3fb-462a-8735-be839c46598c tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:59:35.462719 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-034b261d-f3fb-462a-8735-be839c46598c tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:59:35.463165 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-034b261d-f3fb-462a-8735-be839c46598c tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:59:35.463871 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-034b261d-f3fb-462a-8735-be839c46598c tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:59:35.464335 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-034b261d-f3fb-462a-8735-be839c46598c tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:59:35.464768 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-034b261d-f3fb-462a-8735-be839c46598c tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:59:35.600827 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-034b261d-f3fb-462a-8735-be839c46598c tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad9d55ccfe74ffb914f02030529523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ad9e4338314c269afb0cfcebe03584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:59:35.609230 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-034b261d-f3fb-462a-8735-be839c46598c tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/a429e625-83b7-4078-a34e-ba6d23e08bca" status: 200 len: 1720 microversion: 2.1 time: 0.159524 Oct 04 22:59:35.609819 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3327/7474] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:59:35 2022] GET /compute/v2.1/servers/a429e625-83b7-4078-a34e-ba6d23e08bca => generated 1720 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:59:36.634484 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-70008ce4-6cef-45c5-8359-21cbe23a4687 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:59:36.635109 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-70008ce4-6cef-45c5-8359-21cbe23a4687 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: a429e625-83b7-4078-a34e-ba6d23e08bca] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:59:36.637182 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=3 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:59:36.643372 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-70008ce4-6cef-45c5-8359-21cbe23a4687 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:59:36.644714 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-70008ce4-6cef-45c5-8359-21cbe23a4687 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:59:36.645355 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-70008ce4-6cef-45c5-8359-21cbe23a4687 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:59:36.646074 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-70008ce4-6cef-45c5-8359-21cbe23a4687 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:59:36.646594 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-70008ce4-6cef-45c5-8359-21cbe23a4687 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:59:36.647049 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-70008ce4-6cef-45c5-8359-21cbe23a4687 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:59:36.776999 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-70008ce4-6cef-45c5-8359-21cbe23a4687 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad9d55ccfe74ffb914f02030529523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ad9e4338314c269afb0cfcebe03584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:59:36.785580 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-70008ce4-6cef-45c5-8359-21cbe23a4687 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/a429e625-83b7-4078-a34e-ba6d23e08bca" status: 200 len: 1720 microversion: 2.1 time: 0.155129 Oct 04 22:59:36.786164 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4148/7475] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:59:36 2022] GET /compute/v2.1/servers/a429e625-83b7-4078-a34e-ba6d23e08bca => generated 1720 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:59:37.809011 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-6dfb3298-2e22-4ac0-87af-8b622b50c319 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:59:37.809666 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-6dfb3298-2e22-4ac0-87af-8b622b50c319 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: a429e625-83b7-4078-a34e-ba6d23e08bca] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:59:37.816466 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6dfb3298-2e22-4ac0-87af-8b622b50c319 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:59:37.816949 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6dfb3298-2e22-4ac0-87af-8b622b50c319 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:59:37.817388 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6dfb3298-2e22-4ac0-87af-8b622b50c319 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:59:37.818080 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6dfb3298-2e22-4ac0-87af-8b622b50c319 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:59:37.818581 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6dfb3298-2e22-4ac0-87af-8b622b50c319 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:59:37.819012 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6dfb3298-2e22-4ac0-87af-8b622b50c319 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:59:37.948542 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-6dfb3298-2e22-4ac0-87af-8b622b50c319 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad9d55ccfe74ffb914f02030529523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ad9e4338314c269afb0cfcebe03584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:59:37.958596 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-6dfb3298-2e22-4ac0-87af-8b622b50c319 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/a429e625-83b7-4078-a34e-ba6d23e08bca" status: 200 len: 1720 microversion: 2.1 time: 0.153541 Oct 04 22:59:37.959183 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3328/7476] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:59:37 2022] GET /compute/v2.1/servers/a429e625-83b7-4078-a34e-ba6d23e08bca => generated 1720 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:59:38.982180 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-0fb46859-ef38-4413-a6d8-b97c82ad420b tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:59:38.982849 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-0fb46859-ef38-4413-a6d8-b97c82ad420b tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: a429e625-83b7-4078-a34e-ba6d23e08bca] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:59:38.990307 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0fb46859-ef38-4413-a6d8-b97c82ad420b tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:59:38.990838 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0fb46859-ef38-4413-a6d8-b97c82ad420b tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:59:38.991295 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0fb46859-ef38-4413-a6d8-b97c82ad420b tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:59:38.992002 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0fb46859-ef38-4413-a6d8-b97c82ad420b tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:59:38.992475 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0fb46859-ef38-4413-a6d8-b97c82ad420b tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:59:38.993183 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0fb46859-ef38-4413-a6d8-b97c82ad420b tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:59:39.126722 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-0fb46859-ef38-4413-a6d8-b97c82ad420b tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad9d55ccfe74ffb914f02030529523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ad9e4338314c269afb0cfcebe03584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:59:39.135305 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-0fb46859-ef38-4413-a6d8-b97c82ad420b tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/a429e625-83b7-4078-a34e-ba6d23e08bca" status: 200 len: 1720 microversion: 2.1 time: 0.157021 Oct 04 22:59:39.135843 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4149/7477] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:59:38 2022] GET /compute/v2.1/servers/a429e625-83b7-4078-a34e-ba6d23e08bca => generated 1720 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:59:40.158859 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-cd17d901-bcd0-47f5-b95f-c43e91e71f74 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:59:40.159485 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-cd17d901-bcd0-47f5-b95f-c43e91e71f74 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: a429e625-83b7-4078-a34e-ba6d23e08bca] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:59:40.167004 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cd17d901-bcd0-47f5-b95f-c43e91e71f74 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:59:40.167489 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cd17d901-bcd0-47f5-b95f-c43e91e71f74 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:59:40.167930 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cd17d901-bcd0-47f5-b95f-c43e91e71f74 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:59:40.168638 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cd17d901-bcd0-47f5-b95f-c43e91e71f74 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:59:40.169104 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cd17d901-bcd0-47f5-b95f-c43e91e71f74 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:59:40.169541 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cd17d901-bcd0-47f5-b95f-c43e91e71f74 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:59:40.301006 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-cd17d901-bcd0-47f5-b95f-c43e91e71f74 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad9d55ccfe74ffb914f02030529523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ad9e4338314c269afb0cfcebe03584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:59:40.309534 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-cd17d901-bcd0-47f5-b95f-c43e91e71f74 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/a429e625-83b7-4078-a34e-ba6d23e08bca" status: 200 len: 1720 microversion: 2.1 time: 0.154650 Oct 04 22:59:40.310129 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3329/7478] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:59:40 2022] GET /compute/v2.1/servers/a429e625-83b7-4078-a34e-ba6d23e08bca => generated 1720 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:59:41.333768 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-3acad628-609e-4504-8202-e39a6f18e36d tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:59:41.334418 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-3acad628-609e-4504-8202-e39a6f18e36d tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: a429e625-83b7-4078-a34e-ba6d23e08bca] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:59:41.341337 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3acad628-609e-4504-8202-e39a6f18e36d tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:59:41.341837 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3acad628-609e-4504-8202-e39a6f18e36d tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:59:41.342298 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3acad628-609e-4504-8202-e39a6f18e36d tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:59:41.343036 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3acad628-609e-4504-8202-e39a6f18e36d tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:59:41.343508 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3acad628-609e-4504-8202-e39a6f18e36d tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:59:41.343951 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3acad628-609e-4504-8202-e39a6f18e36d tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:59:41.474318 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-3acad628-609e-4504-8202-e39a6f18e36d tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad9d55ccfe74ffb914f02030529523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ad9e4338314c269afb0cfcebe03584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:59:41.482751 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-3acad628-609e-4504-8202-e39a6f18e36d tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/a429e625-83b7-4078-a34e-ba6d23e08bca" status: 200 len: 1720 microversion: 2.1 time: 0.153521 Oct 04 22:59:41.483333 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4150/7479] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:59:41 2022] GET /compute/v2.1/servers/a429e625-83b7-4078-a34e-ba6d23e08bca => generated 1720 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:59:42.508471 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-5e150049-d447-497d-9e11-2a69662b345f tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:59:42.509033 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-5e150049-d447-497d-9e11-2a69662b345f tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: a429e625-83b7-4078-a34e-ba6d23e08bca] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:59:42.515768 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5e150049-d447-497d-9e11-2a69662b345f tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:59:42.516235 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5e150049-d447-497d-9e11-2a69662b345f tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:59:42.516670 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5e150049-d447-497d-9e11-2a69662b345f tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:59:42.517358 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5e150049-d447-497d-9e11-2a69662b345f tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:59:42.517814 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5e150049-d447-497d-9e11-2a69662b345f tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:59:42.518238 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5e150049-d447-497d-9e11-2a69662b345f tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:59:42.650507 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-5e150049-d447-497d-9e11-2a69662b345f tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad9d55ccfe74ffb914f02030529523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ad9e4338314c269afb0cfcebe03584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:59:42.658949 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-5e150049-d447-497d-9e11-2a69662b345f tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/a429e625-83b7-4078-a34e-ba6d23e08bca" status: 200 len: 1720 microversion: 2.1 time: 0.154507 Oct 04 22:59:42.659539 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3330/7480] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:59:42 2022] GET /compute/v2.1/servers/a429e625-83b7-4078-a34e-ba6d23e08bca => generated 1720 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:59:43.682095 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-2dbfd778-17eb-4337-93a1-5f8a2da93e24 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:59:43.682694 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-2dbfd778-17eb-4337-93a1-5f8a2da93e24 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: a429e625-83b7-4078-a34e-ba6d23e08bca] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:59:43.689535 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2dbfd778-17eb-4337-93a1-5f8a2da93e24 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:59:43.690031 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2dbfd778-17eb-4337-93a1-5f8a2da93e24 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:59:43.690574 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2dbfd778-17eb-4337-93a1-5f8a2da93e24 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:59:43.691287 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2dbfd778-17eb-4337-93a1-5f8a2da93e24 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:59:43.691748 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2dbfd778-17eb-4337-93a1-5f8a2da93e24 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:59:43.692241 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2dbfd778-17eb-4337-93a1-5f8a2da93e24 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:59:43.828161 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-2dbfd778-17eb-4337-93a1-5f8a2da93e24 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad9d55ccfe74ffb914f02030529523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ad9e4338314c269afb0cfcebe03584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:59:43.837564 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-2dbfd778-17eb-4337-93a1-5f8a2da93e24 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/a429e625-83b7-4078-a34e-ba6d23e08bca" status: 200 len: 1720 microversion: 2.1 time: 0.159469 Oct 04 22:59:43.838156 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4151/7481] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:59:43 2022] GET /compute/v2.1/servers/a429e625-83b7-4078-a34e-ba6d23e08bca => generated 1720 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:59:44.861209 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-6bc095da-ee34-4e12-97f9-63f0dfac87b4 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:59:44.861835 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-6bc095da-ee34-4e12-97f9-63f0dfac87b4 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: a429e625-83b7-4078-a34e-ba6d23e08bca] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:59:44.869653 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6bc095da-ee34-4e12-97f9-63f0dfac87b4 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:59:44.870146 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6bc095da-ee34-4e12-97f9-63f0dfac87b4 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:59:44.870619 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6bc095da-ee34-4e12-97f9-63f0dfac87b4 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:59:44.871325 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6bc095da-ee34-4e12-97f9-63f0dfac87b4 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:59:44.871789 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6bc095da-ee34-4e12-97f9-63f0dfac87b4 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:59:44.872223 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6bc095da-ee34-4e12-97f9-63f0dfac87b4 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:59:45.001673 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-6bc095da-ee34-4e12-97f9-63f0dfac87b4 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad9d55ccfe74ffb914f02030529523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ad9e4338314c269afb0cfcebe03584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:59:45.010054 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-6bc095da-ee34-4e12-97f9-63f0dfac87b4 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/a429e625-83b7-4078-a34e-ba6d23e08bca" status: 200 len: 1713 microversion: 2.1 time: 0.152844 Oct 04 22:59:45.010676 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3331/7482] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:59:44 2022] GET /compute/v2.1/servers/a429e625-83b7-4078-a34e-ba6d23e08bca => generated 1713 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:59:45.032209 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-591817a2-9b75-4159-8e6d-01884bca756d tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:59:45.032849 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-591817a2-9b75-4159-8e6d-01884bca756d tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: a429e625-83b7-4078-a34e-ba6d23e08bca] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:59:45.040276 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-591817a2-9b75-4159-8e6d-01884bca756d tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:59:45.040778 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-591817a2-9b75-4159-8e6d-01884bca756d tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:59:45.041229 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-591817a2-9b75-4159-8e6d-01884bca756d tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:59:45.041934 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-591817a2-9b75-4159-8e6d-01884bca756d tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:59:45.042432 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-591817a2-9b75-4159-8e6d-01884bca756d tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:59:45.042877 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-591817a2-9b75-4159-8e6d-01884bca756d tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:59:45.177377 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-591817a2-9b75-4159-8e6d-01884bca756d tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad9d55ccfe74ffb914f02030529523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ad9e4338314c269afb0cfcebe03584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:59:45.185770 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-591817a2-9b75-4159-8e6d-01884bca756d tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/a429e625-83b7-4078-a34e-ba6d23e08bca" status: 200 len: 1713 microversion: 2.1 time: 0.157522 Oct 04 22:59:45.186348 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4152/7483] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:59:45 2022] GET /compute/v2.1/servers/a429e625-83b7-4078-a34e-ba6d23e08bca => generated 1713 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:59:45.209049 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-8fbb5dcb-4c10-4ac5-b85b-22a00a0bb551 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:59:45.209669 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-8fbb5dcb-4c10-4ac5-b85b-22a00a0bb551 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: a429e625-83b7-4078-a34e-ba6d23e08bca] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:59:45.215896 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8fbb5dcb-4c10-4ac5-b85b-22a00a0bb551 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:59:45.216385 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8fbb5dcb-4c10-4ac5-b85b-22a00a0bb551 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:59:45.216825 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8fbb5dcb-4c10-4ac5-b85b-22a00a0bb551 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:59:45.217555 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8fbb5dcb-4c10-4ac5-b85b-22a00a0bb551 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:59:45.218018 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8fbb5dcb-4c10-4ac5-b85b-22a00a0bb551 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:59:45.218492 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8fbb5dcb-4c10-4ac5-b85b-22a00a0bb551 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:59:45.354189 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-8fbb5dcb-4c10-4ac5-b85b-22a00a0bb551 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad9d55ccfe74ffb914f02030529523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ad9e4338314c269afb0cfcebe03584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:59:45.362640 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-8fbb5dcb-4c10-4ac5-b85b-22a00a0bb551 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/a429e625-83b7-4078-a34e-ba6d23e08bca" status: 200 len: 1713 microversion: 2.1 time: 0.157589 Oct 04 22:59:45.363230 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3332/7484] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:59:45 2022] GET /compute/v2.1/servers/a429e625-83b7-4078-a34e-ba6d23e08bca => generated 1713 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:59:45.385987 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-52d75a45-936c-4292-9993-1b360ddf281c tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:59:45.386542 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-52d75a45-936c-4292-9993-1b360ddf281c tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: a429e625-83b7-4078-a34e-ba6d23e08bca] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:59:45.392670 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-52d75a45-936c-4292-9993-1b360ddf281c tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:59:45.393653 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-52d75a45-936c-4292-9993-1b360ddf281c tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:59:45.394425 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-52d75a45-936c-4292-9993-1b360ddf281c tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:59:45.395165 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-52d75a45-936c-4292-9993-1b360ddf281c tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:59:45.395702 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-52d75a45-936c-4292-9993-1b360ddf281c tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:59:45.396155 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-52d75a45-936c-4292-9993-1b360ddf281c tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:59:45.421340 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-52d75a45-936c-4292-9993-1b360ddf281c tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: a429e625-83b7-4078-a34e-ba6d23e08bca] Going to try to terminate instance {{(pid=134101) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 22:59:45.445315 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:59:45.501135 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-52d75a45-936c-4292-9993-1b360ddf281c tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "DELETE /compute/v2.1/servers/a429e625-83b7-4078-a34e-ba6d23e08bca" status: 204 len: 0 microversion: 2.1 time: 0.118699 Oct 04 22:59:45.501743 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4153/7485] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 22:59:45 2022] DELETE /compute/v2.1/servers/a429e625-83b7-4078-a34e-ba6d23e08bca => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 22:59:45.510782 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-0515ae13-3b2f-4b59-92f0-9aebe43d84ff tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:59:45.511500 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-0515ae13-3b2f-4b59-92f0-9aebe43d84ff tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: a429e625-83b7-4078-a34e-ba6d23e08bca] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:59:45.517643 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0515ae13-3b2f-4b59-92f0-9aebe43d84ff tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:59:45.518131 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0515ae13-3b2f-4b59-92f0-9aebe43d84ff tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:59:45.519181 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0515ae13-3b2f-4b59-92f0-9aebe43d84ff tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:59:45.519889 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0515ae13-3b2f-4b59-92f0-9aebe43d84ff tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:59:45.520349 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0515ae13-3b2f-4b59-92f0-9aebe43d84ff tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:59:45.520780 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0515ae13-3b2f-4b59-92f0-9aebe43d84ff tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:59:45.661804 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-0515ae13-3b2f-4b59-92f0-9aebe43d84ff tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad9d55ccfe74ffb914f02030529523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ad9e4338314c269afb0cfcebe03584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:59:45.670135 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-0515ae13-3b2f-4b59-92f0-9aebe43d84ff tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/a429e625-83b7-4078-a34e-ba6d23e08bca" status: 200 len: 1719 microversion: 2.1 time: 0.163315 Oct 04 22:59:45.670752 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3333/7486] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:59:45 2022] GET /compute/v2.1/servers/a429e625-83b7-4078-a34e-ba6d23e08bca => generated 1719 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:59:45.726068 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-7d46da2b-04b7-4df8-a59a-e2d52071cfff req-1216b407-6e08-4430-a7d7-443491005697 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a429e625-83b7-4078-a34e-ba6d23e08bca", "name": "network-vif-plugged", "status": "completed", "tag": "2bffd9fb-5450-442f-ab82-e27a42819d21"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:59:45.736490 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-7d46da2b-04b7-4df8-a59a-e2d52071cfff req-1216b407-6e08-4430-a7d7-443491005697 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:59:45.737083 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-7d46da2b-04b7-4df8-a59a-e2d52071cfff req-1216b407-6e08-4430-a7d7-443491005697 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:59:45.737611 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-7d46da2b-04b7-4df8-a59a-e2d52071cfff req-1216b407-6e08-4430-a7d7-443491005697 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:59:45.749206 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-7d46da2b-04b7-4df8-a59a-e2d52071cfff req-1216b407-6e08-4430-a7d7-443491005697 service nova] Creating event network-vif-plugged:2bffd9fb-5450-442f-ab82-e27a42819d21 for instance a429e625-83b7-4078-a34e-ba6d23e08bca on n-h1-860284-1 Oct 04 22:59:45.754608 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-7d46da2b-04b7-4df8-a59a-e2d52071cfff req-1216b407-6e08-4430-a7d7-443491005697 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033229 Oct 04 22:59:45.755374 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4154/7487] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:59:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:59:46.693603 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-86855930-23b2-4f04-a933-5205ce02067f tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:59:46.694275 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-86855930-23b2-4f04-a933-5205ce02067f tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: a429e625-83b7-4078-a34e-ba6d23e08bca] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:59:46.701099 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-86855930-23b2-4f04-a933-5205ce02067f tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:59:46.701592 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-86855930-23b2-4f04-a933-5205ce02067f tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:59:46.702033 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-86855930-23b2-4f04-a933-5205ce02067f tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:59:46.702757 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-86855930-23b2-4f04-a933-5205ce02067f tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:59:46.703228 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-86855930-23b2-4f04-a933-5205ce02067f tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:59:46.703678 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-86855930-23b2-4f04-a933-5205ce02067f tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:59:46.830225 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-86855930-23b2-4f04-a933-5205ce02067f tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad9d55ccfe74ffb914f02030529523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ad9e4338314c269afb0cfcebe03584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:59:46.839091 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-86855930-23b2-4f04-a933-5205ce02067f tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/a429e625-83b7-4078-a34e-ba6d23e08bca" status: 200 len: 1719 microversion: 2.1 time: 0.149558 Oct 04 22:59:46.839684 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3334/7488] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:59:46 2022] GET /compute/v2.1/servers/a429e625-83b7-4078-a34e-ba6d23e08bca => generated 1719 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:59:47.866065 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-2911c55b-798f-4956-a91a-b5cea84aaa61 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:59:47.866861 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-2911c55b-798f-4956-a91a-b5cea84aaa61 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: a429e625-83b7-4078-a34e-ba6d23e08bca] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:59:47.874126 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2911c55b-798f-4956-a91a-b5cea84aaa61 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:59:47.874831 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2911c55b-798f-4956-a91a-b5cea84aaa61 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:59:47.875386 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2911c55b-798f-4956-a91a-b5cea84aaa61 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:59:47.876206 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2911c55b-798f-4956-a91a-b5cea84aaa61 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:59:47.876755 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2911c55b-798f-4956-a91a-b5cea84aaa61 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:59:47.877272 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2911c55b-798f-4956-a91a-b5cea84aaa61 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:59:47.951671 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-2911c55b-798f-4956-a91a-b5cea84aaa61 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad9d55ccfe74ffb914f02030529523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ad9e4338314c269afb0cfcebe03584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:59:47.961374 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-2911c55b-798f-4956-a91a-b5cea84aaa61 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/a429e625-83b7-4078-a34e-ba6d23e08bca" status: 200 len: 1651 microversion: 2.1 time: 0.101550 Oct 04 22:59:47.974724 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4155/7489] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:59:47 2022] GET /compute/v2.1/servers/a429e625-83b7-4078-a34e-ba6d23e08bca => generated 1651 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:59:48.326805 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-ffe1105f-087d-4dd1-8e58-1ddadc7fea5b req-a2e176bb-ec97-4046-a7f8-96f73d935b34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a429e625-83b7-4078-a34e-ba6d23e08bca", "name": "network-vif-deleted", "tag": "2bffd9fb-5450-442f-ab82-e27a42819d21"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:59:48.337908 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-ffe1105f-087d-4dd1-8e58-1ddadc7fea5b req-a2e176bb-ec97-4046-a7f8-96f73d935b34 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:59:48.338305 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-ffe1105f-087d-4dd1-8e58-1ddadc7fea5b req-a2e176bb-ec97-4046-a7f8-96f73d935b34 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:59:48.339331 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-ffe1105f-087d-4dd1-8e58-1ddadc7fea5b req-a2e176bb-ec97-4046-a7f8-96f73d935b34 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:59:48.352565 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-ffe1105f-087d-4dd1-8e58-1ddadc7fea5b req-a2e176bb-ec97-4046-a7f8-96f73d935b34 service nova] Creating event network-vif-deleted:2bffd9fb-5450-442f-ab82-e27a42819d21 for instance a429e625-83b7-4078-a34e-ba6d23e08bca on n-h1-860284-1 Oct 04 22:59:48.357544 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-ffe1105f-087d-4dd1-8e58-1ddadc7fea5b req-a2e176bb-ec97-4046-a7f8-96f73d935b34 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034392 Oct 04 22:59:48.358157 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3335/7490] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 22:59:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:59:48.988316 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-a3249e5e-1cae-466f-90d1-e7f50c3298b9 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:59:48.989687 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-a3249e5e-1cae-466f-90d1-e7f50c3298b9 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: a429e625-83b7-4078-a34e-ba6d23e08bca] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:59:48.998720 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a3249e5e-1cae-466f-90d1-e7f50c3298b9 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:59:48.999510 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a3249e5e-1cae-466f-90d1-e7f50c3298b9 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:59:49.000067 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a3249e5e-1cae-466f-90d1-e7f50c3298b9 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:59:49.001516 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a3249e5e-1cae-466f-90d1-e7f50c3298b9 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:59:49.002139 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a3249e5e-1cae-466f-90d1-e7f50c3298b9 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:59:49.003589 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a3249e5e-1cae-466f-90d1-e7f50c3298b9 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:59:49.070161 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-a3249e5e-1cae-466f-90d1-e7f50c3298b9 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad9d55ccfe74ffb914f02030529523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ad9e4338314c269afb0cfcebe03584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:59:49.079090 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-a3249e5e-1cae-466f-90d1-e7f50c3298b9 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/a429e625-83b7-4078-a34e-ba6d23e08bca" status: 200 len: 1368 microversion: 2.1 time: 0.096097 Oct 04 22:59:49.086424 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4156/7491] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:59:48 2022] GET /compute/v2.1/servers/a429e625-83b7-4078-a34e-ba6d23e08bca => generated 1368 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:59:50.104659 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-6064cc2b-3848-4837-8d56-87697ae866a5 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:59:50.105366 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-6064cc2b-3848-4837-8d56-87697ae866a5 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: a429e625-83b7-4078-a34e-ba6d23e08bca] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:59:50.111625 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6064cc2b-3848-4837-8d56-87697ae866a5 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:59:50.112118 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6064cc2b-3848-4837-8d56-87697ae866a5 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:59:50.112566 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6064cc2b-3848-4837-8d56-87697ae866a5 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:59:50.113261 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6064cc2b-3848-4837-8d56-87697ae866a5 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:59:50.113725 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6064cc2b-3848-4837-8d56-87697ae866a5 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:59:50.114157 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6064cc2b-3848-4837-8d56-87697ae866a5 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:59:50.178178 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-6064cc2b-3848-4837-8d56-87697ae866a5 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad9d55ccfe74ffb914f02030529523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ad9e4338314c269afb0cfcebe03584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:59:50.186548 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-6064cc2b-3848-4837-8d56-87697ae866a5 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/a429e625-83b7-4078-a34e-ba6d23e08bca" status: 200 len: 1368 microversion: 2.1 time: 0.086972 Oct 04 22:59:50.187138 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3336/7492] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:59:50 2022] GET /compute/v2.1/servers/a429e625-83b7-4078-a34e-ba6d23e08bca => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:59:51.210134 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-42495758-ef86-4de3-bf35-1498a40caca0 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:59:51.210811 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-42495758-ef86-4de3-bf35-1498a40caca0 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: a429e625-83b7-4078-a34e-ba6d23e08bca] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:59:51.217669 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-42495758-ef86-4de3-bf35-1498a40caca0 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:59:51.218165 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-42495758-ef86-4de3-bf35-1498a40caca0 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:59:51.218640 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-42495758-ef86-4de3-bf35-1498a40caca0 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:59:51.219343 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-42495758-ef86-4de3-bf35-1498a40caca0 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:59:51.219811 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-42495758-ef86-4de3-bf35-1498a40caca0 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:59:51.220249 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-42495758-ef86-4de3-bf35-1498a40caca0 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:59:51.288291 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-42495758-ef86-4de3-bf35-1498a40caca0 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad9d55ccfe74ffb914f02030529523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ad9e4338314c269afb0cfcebe03584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:59:51.296849 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-42495758-ef86-4de3-bf35-1498a40caca0 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/a429e625-83b7-4078-a34e-ba6d23e08bca" status: 200 len: 1368 microversion: 2.1 time: 0.090728 Oct 04 22:59:51.297449 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4157/7493] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:59:51 2022] GET /compute/v2.1/servers/a429e625-83b7-4078-a34e-ba6d23e08bca => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:59:52.320338 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-b8e253b2-9d69-4bb4-8c5b-57eab0e6430b tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:59:52.320991 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-b8e253b2-9d69-4bb4-8c5b-57eab0e6430b tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: a429e625-83b7-4078-a34e-ba6d23e08bca] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:59:52.328301 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b8e253b2-9d69-4bb4-8c5b-57eab0e6430b tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:59:52.328788 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b8e253b2-9d69-4bb4-8c5b-57eab0e6430b tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:59:52.329240 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b8e253b2-9d69-4bb4-8c5b-57eab0e6430b tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:59:52.329939 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b8e253b2-9d69-4bb4-8c5b-57eab0e6430b tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:59:52.331014 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b8e253b2-9d69-4bb4-8c5b-57eab0e6430b tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:59:52.331494 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b8e253b2-9d69-4bb4-8c5b-57eab0e6430b tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:59:52.400159 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-b8e253b2-9d69-4bb4-8c5b-57eab0e6430b tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad9d55ccfe74ffb914f02030529523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ad9e4338314c269afb0cfcebe03584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:59:52.402570 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=100 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:59:52.410446 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-b8e253b2-9d69-4bb4-8c5b-57eab0e6430b tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/a429e625-83b7-4078-a34e-ba6d23e08bca" status: 200 len: 1368 microversion: 2.1 time: 0.094064 Oct 04 22:59:52.411090 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3337/7494] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:59:52 2022] GET /compute/v2.1/servers/a429e625-83b7-4078-a34e-ba6d23e08bca => generated 1368 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:59:53.441419 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-c435949b-fb75-41ce-9bb9-bf6a3ae3e40d tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:59:53.442087 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-c435949b-fb75-41ce-9bb9-bf6a3ae3e40d tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: a429e625-83b7-4078-a34e-ba6d23e08bca] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:59:53.445166 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=2 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:59:53.450035 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c435949b-fb75-41ce-9bb9-bf6a3ae3e40d tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:59:53.450497 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c435949b-fb75-41ce-9bb9-bf6a3ae3e40d tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:59:53.450957 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c435949b-fb75-41ce-9bb9-bf6a3ae3e40d tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:59:53.451678 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c435949b-fb75-41ce-9bb9-bf6a3ae3e40d tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:59:53.452157 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c435949b-fb75-41ce-9bb9-bf6a3ae3e40d tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:59:53.452605 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c435949b-fb75-41ce-9bb9-bf6a3ae3e40d tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:59:53.470512 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-c435949b-fb75-41ce-9bb9-bf6a3ae3e40d tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] HTTP exception thrown: Instance a429e625-83b7-4078-a34e-ba6d23e08bca could not be found. Oct 04 22:59:53.473097 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-c435949b-fb75-41ce-9bb9-bf6a3ae3e40d tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Request method failure captured: Oct 04 22:59:53.473097 n-d-860284-1 devstack@n-api.service[134101]: request: GET /compute/v2.1/servers/a429e625-83b7-4078-a34e-ba6d23e08bca HTTP/1.1 Oct 04 22:59:53.473097 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 22:59:53.473097 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 22:59:53.473097 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 22:59:53.473097 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 22:59:53.473097 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 22:59:53.473097 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 22:59:53.473097 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 22:59:53.473097 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 22:59:53.473097 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPLj5Pwg8WnMY03a1UZoxjs8JJYeyX4gPNXk6kEaEUFSId5NkYbu9p7XcCT6xCsGLl965bhlzMmdcrnW3jmUrNP-IBqDDDBlZIgg6A8FuefFnP4mHIDNTJ0T7sYDTAC4YQVniCZjT1xnCXPrzoAdDzhVXLGL7ogVXgw4ofRJLecl7Qjo Oct 04 22:59:53.473097 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 22:59:53.473097 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 22:59:53.473097 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 22:59:53.473097 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 22:59:53.473097 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 22:59:53.473097 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 22:59:53.473097 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: d2ad9e4338314c269afb0cfcebe03584 Oct 04 22:59:53.473097 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-ServerActionsTestJSON-1972791785 Oct 04 22:59:53.473097 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 22:59:53.473097 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 22:59:53.473097 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d2ad9e4338314c269afb0cfcebe03584"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_d2ad9e4338314c269afb0cfcebe03584", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d2ad9e4338314c269afb0cfcebe03584"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/d2ad9e4338314c269afb0cfcebe03584"}]}] Oct 04 22:59:53.473097 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-ServerActionsTestJSON-1972791785 Oct 04 22:59:53.473097 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: d2ad9e4338314c269afb0cfcebe03584 Oct 04 22:59:53.473097 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-ServerActionsTestJSON-1972791785 Oct 04 22:59:53.473097 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-ServerActionsTestJSON-1972791785-project Oct 04 22:59:53.473097 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 22:59:53.473097 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 22:59:53.473097 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: aad9d55ccfe74ffb914f02030529523d Oct 04 22:59:53.473097 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-ServerActionsTestJSON-1972791785-project Oct 04 22:59:53.473097 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 22:59:53.473097 n-d-860284-1 devstack@n-api.service[134101]: exception: Instance a429e625-83b7-4078-a34e-ba6d23e08bca could not be found. Oct 04 22:59:53.473097 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': 'a429e625-83b7-4078-a34e-ba6d23e08bca'} Oct 04 22:59:53.473097 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:59:53.473097 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:59:53.473097 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:59:53.473097 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:59:53.473097 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:59:53.473097 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:59:53.473097 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:59:53.473097 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:59:53.473097 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:59:53.473097 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:59:53.473097 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a429e625-83b7-4078-a34e-ba6d23e08bca could not be found. Oct 04 22:59:53.473097 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:59:53.473097 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:59:53.473097 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:59:53.473097 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:59:53.473097 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:59:53.473097 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:59:53.473097 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:59:53.473097 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:59:53.473097 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:59:53.473097 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:59:53.473097 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:59:53.473097 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:59:53.473097 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:59:53.473097 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:59:53.473097 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:59:53.473097 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:59:53.473097 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a429e625-83b7-4078-a34e-ba6d23e08bca could not be found. Oct 04 22:59:53.473097 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:59:53.473097 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:59:53.473097 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:59:53.477619 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:59:53.477619 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:59:53.477619 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:59:53.477619 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:59:53.477619 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:59:53.477619 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a429e625-83b7-4078-a34e-ba6d23e08bca could not be found. Oct 04 22:59:53.477619 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:59:53.477619 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-c435949b-fb75-41ce-9bb9-bf6a3ae3e40d tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Returning 404 to user: Instance a429e625-83b7-4078-a34e-ba6d23e08bca could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:59:53.477619 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-c435949b-fb75-41ce-9bb9-bf6a3ae3e40d tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/a429e625-83b7-4078-a34e-ba6d23e08bca" status: 404 len: 111 microversion: 2.1 time: 0.037448 Oct 04 22:59:53.477619 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4158/7495] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:59:53 2022] GET /compute/v2.1/servers/a429e625-83b7-4078-a34e-ba6d23e08bca => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:59:53.537890 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-401d36ce-c07b-47ca-a0d3-eec84b4f18dd tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:59:53.540158 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-401d36ce-c07b-47ca-a0d3-eec84b4f18dd tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: a429e625-83b7-4078-a34e-ba6d23e08bca] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:59:53.546957 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-401d36ce-c07b-47ca-a0d3-eec84b4f18dd tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:59:53.547447 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-401d36ce-c07b-47ca-a0d3-eec84b4f18dd tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:59:53.547885 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-401d36ce-c07b-47ca-a0d3-eec84b4f18dd tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:59:53.548581 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-401d36ce-c07b-47ca-a0d3-eec84b4f18dd tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:59:53.549066 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-401d36ce-c07b-47ca-a0d3-eec84b4f18dd tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:59:53.549753 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-401d36ce-c07b-47ca-a0d3-eec84b4f18dd tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:59:53.562386 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-401d36ce-c07b-47ca-a0d3-eec84b4f18dd tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] HTTP exception thrown: Instance a429e625-83b7-4078-a34e-ba6d23e08bca could not be found. Oct 04 22:59:53.564054 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-401d36ce-c07b-47ca-a0d3-eec84b4f18dd tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Request method failure captured: Oct 04 22:59:53.564054 n-d-860284-1 devstack@n-api.service[134102]: request: GET /compute/v2.1/servers/a429e625-83b7-4078-a34e-ba6d23e08bca/os-volume_attachments HTTP/1.1 Oct 04 22:59:53.564054 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 22:59:53.564054 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 22:59:53.564054 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 22:59:53.564054 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 22:59:53.564054 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 22:59:53.564054 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 22:59:53.564054 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 22:59:53.564054 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 22:59:53.564054 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPLj5Pwg8WnMY03a1UZoxjs8JJYeyX4gPNXk6kEaEUFSId5NkYbu9p7XcCT6xCsGLl965bhlzMmdcrnW3jmUrNP-IBqDDDBlZIgg6A8FuefFnP4mHIDNTJ0T7sYDTAC4YQVniCZjT1xnCXPrzoAdDzhVXLGL7ogVXgw4ofRJLecl7Qjo Oct 04 22:59:53.564054 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 22:59:53.564054 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 22:59:53.564054 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 22:59:53.564054 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 22:59:53.564054 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 22:59:53.564054 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 22:59:53.564054 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: d2ad9e4338314c269afb0cfcebe03584 Oct 04 22:59:53.564054 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-ServerActionsTestJSON-1972791785 Oct 04 22:59:53.564054 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 22:59:53.564054 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 22:59:53.564054 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d2ad9e4338314c269afb0cfcebe03584"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_d2ad9e4338314c269afb0cfcebe03584", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d2ad9e4338314c269afb0cfcebe03584"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/d2ad9e4338314c269afb0cfcebe03584"}]}] Oct 04 22:59:53.564054 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-ServerActionsTestJSON-1972791785 Oct 04 22:59:53.564054 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: d2ad9e4338314c269afb0cfcebe03584 Oct 04 22:59:53.564054 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-ServerActionsTestJSON-1972791785 Oct 04 22:59:53.564054 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-ServerActionsTestJSON-1972791785-project Oct 04 22:59:53.564054 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 22:59:53.564054 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 22:59:53.564054 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: aad9d55ccfe74ffb914f02030529523d Oct 04 22:59:53.564054 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-ServerActionsTestJSON-1972791785-project Oct 04 22:59:53.564054 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 22:59:53.564054 n-d-860284-1 devstack@n-api.service[134102]: exception: Instance a429e625-83b7-4078-a34e-ba6d23e08bca could not be found. Oct 04 22:59:53.564054 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'server_id': 'a429e625-83b7-4078-a34e-ba6d23e08bca'} Oct 04 22:59:53.564054 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:59:53.564054 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:59:53.564054 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:59:53.564054 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:59:53.564054 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:59:53.564054 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:59:53.564054 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:59:53.564054 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:59:53.564054 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:59:53.564054 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:59:53.564054 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a429e625-83b7-4078-a34e-ba6d23e08bca could not be found. Oct 04 22:59:53.564054 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:59:53.564054 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:59:53.564054 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:59:53.564054 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:59:53.564054 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:59:53.564054 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:59:53.564054 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:59:53.564054 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:59:53.564054 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:59:53.564054 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:59:53.564054 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 22:59:53.564054 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 22:59:53.564054 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 22:59:53.564054 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 22:59:53.564054 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 04 22:59:53.564054 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 04 22:59:53.564054 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:59:53.564054 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:59:53.568820 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a429e625-83b7-4078-a34e-ba6d23e08bca could not be found. Oct 04 22:59:53.568820 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:59:53.568820 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:59:53.568820 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:59:53.568820 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:59:53.568820 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:59:53.568820 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:59:53.568820 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:59:53.568820 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:59:53.568820 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a429e625-83b7-4078-a34e-ba6d23e08bca could not be found. Oct 04 22:59:53.568820 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:59:53.568820 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-401d36ce-c07b-47ca-a0d3-eec84b4f18dd tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Returning 404 to user: Instance a429e625-83b7-4078-a34e-ba6d23e08bca could not be found. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:59:53.568820 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-401d36ce-c07b-47ca-a0d3-eec84b4f18dd tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/a429e625-83b7-4078-a34e-ba6d23e08bca/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.032979 Oct 04 22:59:53.568820 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3338/7496] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 22:59:53 2022] GET /compute/v2.1/servers/a429e625-83b7-4078-a34e-ba6d23e08bca/os-volume_attachments => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:59:56.889827 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-93d1196d-31fd-4419-aa8a-4b532e9acb35 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:59:56.890346 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-93d1196d-31fd-4419-aa8a-4b532e9acb35 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: a429e625-83b7-4078-a34e-ba6d23e08bca] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:59:56.897931 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-93d1196d-31fd-4419-aa8a-4b532e9acb35 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:59:56.898471 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-93d1196d-31fd-4419-aa8a-4b532e9acb35 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:59:56.898934 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-93d1196d-31fd-4419-aa8a-4b532e9acb35 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:59:56.899641 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-93d1196d-31fd-4419-aa8a-4b532e9acb35 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:59:56.900110 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-93d1196d-31fd-4419-aa8a-4b532e9acb35 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:59:56.900553 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-93d1196d-31fd-4419-aa8a-4b532e9acb35 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:59:56.914144 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-93d1196d-31fd-4419-aa8a-4b532e9acb35 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] HTTP exception thrown: Instance a429e625-83b7-4078-a34e-ba6d23e08bca could not be found. Oct 04 22:59:56.915736 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-93d1196d-31fd-4419-aa8a-4b532e9acb35 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Request method failure captured: Oct 04 22:59:56.915736 n-d-860284-1 devstack@n-api.service[134101]: request: DELETE /compute/v2.1/servers/a429e625-83b7-4078-a34e-ba6d23e08bca HTTP/1.1 Oct 04 22:59:56.915736 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 22:59:56.915736 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 22:59:56.915736 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 22:59:56.915736 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 22:59:56.915736 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 22:59:56.915736 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 22:59:56.915736 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 22:59:56.915736 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 22:59:56.915736 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPLj5Pwg8WnMY03a1UZoxjs8JJYeyX4gPNXk6kEaEUFSId5NkYbu9p7XcCT6xCsGLl965bhlzMmdcrnW3jmUrNP-IBqDDDBlZIgg6A8FuefFnP4mHIDNTJ0T7sYDTAC4YQVniCZjT1xnCXPrzoAdDzhVXLGL7ogVXgw4ofRJLecl7Qjo Oct 04 22:59:56.915736 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 22:59:56.915736 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 22:59:56.915736 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 22:59:56.915736 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 22:59:56.915736 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 22:59:56.915736 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 22:59:56.915736 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: d2ad9e4338314c269afb0cfcebe03584 Oct 04 22:59:56.915736 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-ServerActionsTestJSON-1972791785 Oct 04 22:59:56.915736 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 22:59:56.915736 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 22:59:56.915736 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d2ad9e4338314c269afb0cfcebe03584"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_d2ad9e4338314c269afb0cfcebe03584", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d2ad9e4338314c269afb0cfcebe03584"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/d2ad9e4338314c269afb0cfcebe03584"}]}] Oct 04 22:59:56.915736 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-ServerActionsTestJSON-1972791785 Oct 04 22:59:56.915736 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: d2ad9e4338314c269afb0cfcebe03584 Oct 04 22:59:56.915736 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-ServerActionsTestJSON-1972791785 Oct 04 22:59:56.915736 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-ServerActionsTestJSON-1972791785-project Oct 04 22:59:56.915736 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 22:59:56.915736 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 22:59:56.915736 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: aad9d55ccfe74ffb914f02030529523d Oct 04 22:59:56.915736 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-ServerActionsTestJSON-1972791785-project Oct 04 22:59:56.915736 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 22:59:56.915736 n-d-860284-1 devstack@n-api.service[134101]: exception: Instance a429e625-83b7-4078-a34e-ba6d23e08bca could not be found. Oct 04 22:59:56.915736 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': 'a429e625-83b7-4078-a34e-ba6d23e08bca'} Oct 04 22:59:56.915736 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:59:56.915736 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:59:56.915736 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:59:56.915736 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:59:56.915736 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:59:56.915736 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:59:56.915736 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:59:56.915736 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:59:56.915736 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:59:56.915736 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:59:56.915736 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a429e625-83b7-4078-a34e-ba6d23e08bca could not be found. Oct 04 22:59:56.915736 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:59:56.915736 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:59:56.915736 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:59:56.915736 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:59:56.915736 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:59:56.915736 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:59:56.915736 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:59:56.915736 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:59:56.915736 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:59:56.915736 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:59:56.915736 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 22:59:56.915736 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 22:59:56.915736 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 22:59:56.915736 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 22:59:56.915736 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:59:56.915736 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:59:56.915736 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:59:56.915736 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:59:56.920592 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a429e625-83b7-4078-a34e-ba6d23e08bca could not be found. Oct 04 22:59:56.920592 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:59:56.920592 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:59:56.920592 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:59:56.920592 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:59:56.920592 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:59:56.920592 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:59:56.920592 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:59:56.920592 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:59:56.920592 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a429e625-83b7-4078-a34e-ba6d23e08bca could not be found. Oct 04 22:59:56.920592 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:59:56.920592 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-93d1196d-31fd-4419-aa8a-4b532e9acb35 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Returning 404 to user: Instance a429e625-83b7-4078-a34e-ba6d23e08bca could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:59:56.920592 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-93d1196d-31fd-4419-aa8a-4b532e9acb35 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "DELETE /compute/v2.1/servers/a429e625-83b7-4078-a34e-ba6d23e08bca" status: 404 len: 111 microversion: 2.1 time: 0.031206 Oct 04 22:59:56.920592 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4159/7497] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 22:59:56 2022] DELETE /compute/v2.1/servers/a429e625-83b7-4078-a34e-ba6d23e08bca => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:59:56.926069 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-2a4da617-264e-4708-9896-5c70609ff5f3 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:59:56.926712 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-2a4da617-264e-4708-9896-5c70609ff5f3 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: a429e625-83b7-4078-a34e-ba6d23e08bca] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:59:56.929307 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_api:SELECT=38 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:59:56.934723 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2a4da617-264e-4708-9896-5c70609ff5f3 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:59:56.935206 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2a4da617-264e-4708-9896-5c70609ff5f3 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:59:56.935639 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2a4da617-264e-4708-9896-5c70609ff5f3 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:59:56.936328 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2a4da617-264e-4708-9896-5c70609ff5f3 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:59:56.936780 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2a4da617-264e-4708-9896-5c70609ff5f3 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:59:56.937205 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2a4da617-264e-4708-9896-5c70609ff5f3 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:59:56.952193 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-2a4da617-264e-4708-9896-5c70609ff5f3 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] HTTP exception thrown: Instance a429e625-83b7-4078-a34e-ba6d23e08bca could not be found. Oct 04 22:59:56.953848 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-2a4da617-264e-4708-9896-5c70609ff5f3 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Request method failure captured: Oct 04 22:59:56.953848 n-d-860284-1 devstack@n-api.service[134102]: request: GET /compute/v2.1/servers/a429e625-83b7-4078-a34e-ba6d23e08bca HTTP/1.1 Oct 04 22:59:56.953848 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 22:59:56.953848 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 22:59:56.953848 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 22:59:56.953848 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 22:59:56.953848 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 22:59:56.953848 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 22:59:56.953848 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 22:59:56.953848 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 22:59:56.953848 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPLj5Pwg8WnMY03a1UZoxjs8JJYeyX4gPNXk6kEaEUFSId5NkYbu9p7XcCT6xCsGLl965bhlzMmdcrnW3jmUrNP-IBqDDDBlZIgg6A8FuefFnP4mHIDNTJ0T7sYDTAC4YQVniCZjT1xnCXPrzoAdDzhVXLGL7ogVXgw4ofRJLecl7Qjo Oct 04 22:59:56.953848 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 22:59:56.953848 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 22:59:56.953848 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 22:59:56.953848 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 22:59:56.953848 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 22:59:56.953848 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 22:59:56.953848 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: d2ad9e4338314c269afb0cfcebe03584 Oct 04 22:59:56.953848 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-ServerActionsTestJSON-1972791785 Oct 04 22:59:56.953848 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 22:59:56.953848 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 22:59:56.953848 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d2ad9e4338314c269afb0cfcebe03584"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_d2ad9e4338314c269afb0cfcebe03584", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d2ad9e4338314c269afb0cfcebe03584"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/d2ad9e4338314c269afb0cfcebe03584"}]}] Oct 04 22:59:56.953848 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-ServerActionsTestJSON-1972791785 Oct 04 22:59:56.953848 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: d2ad9e4338314c269afb0cfcebe03584 Oct 04 22:59:56.953848 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-ServerActionsTestJSON-1972791785 Oct 04 22:59:56.953848 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-ServerActionsTestJSON-1972791785-project Oct 04 22:59:56.953848 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 22:59:56.953848 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 22:59:56.953848 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: aad9d55ccfe74ffb914f02030529523d Oct 04 22:59:56.953848 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-ServerActionsTestJSON-1972791785-project Oct 04 22:59:56.953848 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 22:59:56.953848 n-d-860284-1 devstack@n-api.service[134102]: exception: Instance a429e625-83b7-4078-a34e-ba6d23e08bca could not be found. Oct 04 22:59:56.953848 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': 'a429e625-83b7-4078-a34e-ba6d23e08bca'} Oct 04 22:59:56.953848 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:59:56.953848 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:59:56.953848 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:59:56.953848 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:59:56.953848 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:59:56.953848 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:59:56.953848 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:59:56.953848 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:59:56.953848 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:59:56.953848 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:59:56.953848 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a429e625-83b7-4078-a34e-ba6d23e08bca could not be found. Oct 04 22:59:56.953848 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:59:56.953848 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:59:56.953848 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:59:56.953848 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:59:56.953848 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:59:56.953848 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:59:56.953848 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:59:56.953848 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:59:56.953848 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:59:56.953848 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:59:56.953848 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:59:56.953848 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:59:56.953848 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:59:56.953848 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:59:56.953848 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:59:56.953848 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:59:56.953848 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a429e625-83b7-4078-a34e-ba6d23e08bca could not be found. Oct 04 22:59:56.953848 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:59:56.953848 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:59:56.953848 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:59:56.960027 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:59:56.960027 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:59:56.960027 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:59:56.960027 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:59:56.960027 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:59:56.960027 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a429e625-83b7-4078-a34e-ba6d23e08bca could not be found. Oct 04 22:59:56.960027 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:59:56.960027 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-2a4da617-264e-4708-9896-5c70609ff5f3 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Returning 404 to user: Instance a429e625-83b7-4078-a34e-ba6d23e08bca could not be found. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:59:56.960027 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-2a4da617-264e-4708-9896-5c70609ff5f3 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/a429e625-83b7-4078-a34e-ba6d23e08bca" status: 404 len: 111 microversion: 2.1 time: 0.033519 Oct 04 22:59:56.960027 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3339/7498] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:59:56 2022] GET /compute/v2.1/servers/a429e625-83b7-4078-a34e-ba6d23e08bca => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:59:56.965076 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-a535cd8c-fc2b-46d6-8cc4-49d03c880338 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:59:56.965600 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-a535cd8c-fc2b-46d6-8cc4-49d03c880338 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: 16cdaac8-bb7a-405f-9bc6-1e7b17194689] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:59:56.971968 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a535cd8c-fc2b-46d6-8cc4-49d03c880338 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:59:56.972479 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a535cd8c-fc2b-46d6-8cc4-49d03c880338 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:59:56.972938 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a535cd8c-fc2b-46d6-8cc4-49d03c880338 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:59:56.973665 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a535cd8c-fc2b-46d6-8cc4-49d03c880338 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:59:56.974135 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a535cd8c-fc2b-46d6-8cc4-49d03c880338 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:59:56.974698 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a535cd8c-fc2b-46d6-8cc4-49d03c880338 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:59:56.989462 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-a535cd8c-fc2b-46d6-8cc4-49d03c880338 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] HTTP exception thrown: Instance 16cdaac8-bb7a-405f-9bc6-1e7b17194689 could not be found. Oct 04 22:59:56.991106 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-a535cd8c-fc2b-46d6-8cc4-49d03c880338 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Request method failure captured: Oct 04 22:59:56.991106 n-d-860284-1 devstack@n-api.service[134101]: request: DELETE /compute/v2.1/servers/16cdaac8-bb7a-405f-9bc6-1e7b17194689 HTTP/1.1 Oct 04 22:59:56.991106 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 22:59:56.991106 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 22:59:56.991106 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 22:59:56.991106 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 22:59:56.991106 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 22:59:56.991106 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 22:59:56.991106 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 22:59:56.991106 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 22:59:56.991106 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPLj5Pwg8WnMY03a1UZoxjs8JJYeyX4gPNXk6kEaEUFSId5NkYbu9p7XcCT6xCsGLl965bhlzMmdcrnW3jmUrNP-IBqDDDBlZIgg6A8FuefFnP4mHIDNTJ0T7sYDTAC4YQVniCZjT1xnCXPrzoAdDzhVXLGL7ogVXgw4ofRJLecl7Qjo Oct 04 22:59:56.991106 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 22:59:56.991106 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 22:59:56.991106 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 22:59:56.991106 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 22:59:56.991106 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 22:59:56.991106 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 22:59:56.991106 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: d2ad9e4338314c269afb0cfcebe03584 Oct 04 22:59:56.991106 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-ServerActionsTestJSON-1972791785 Oct 04 22:59:56.991106 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 22:59:56.991106 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 22:59:56.991106 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d2ad9e4338314c269afb0cfcebe03584"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_d2ad9e4338314c269afb0cfcebe03584", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d2ad9e4338314c269afb0cfcebe03584"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/d2ad9e4338314c269afb0cfcebe03584"}]}] Oct 04 22:59:56.991106 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-ServerActionsTestJSON-1972791785 Oct 04 22:59:56.991106 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: d2ad9e4338314c269afb0cfcebe03584 Oct 04 22:59:56.991106 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-ServerActionsTestJSON-1972791785 Oct 04 22:59:56.991106 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-ServerActionsTestJSON-1972791785-project Oct 04 22:59:56.991106 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 22:59:56.991106 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 22:59:56.991106 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: aad9d55ccfe74ffb914f02030529523d Oct 04 22:59:56.991106 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-ServerActionsTestJSON-1972791785-project Oct 04 22:59:56.991106 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 22:59:56.991106 n-d-860284-1 devstack@n-api.service[134101]: exception: Instance 16cdaac8-bb7a-405f-9bc6-1e7b17194689 could not be found. Oct 04 22:59:56.991106 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': '16cdaac8-bb7a-405f-9bc6-1e7b17194689'} Oct 04 22:59:56.991106 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:59:56.991106 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:59:56.991106 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:59:56.991106 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:59:56.991106 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:59:56.991106 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:59:56.991106 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:59:56.991106 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:59:56.991106 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:59:56.991106 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:59:56.991106 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16cdaac8-bb7a-405f-9bc6-1e7b17194689 could not be found. Oct 04 22:59:56.991106 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:59:56.991106 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:59:56.991106 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:59:56.991106 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:59:56.991106 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:59:56.991106 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:59:56.991106 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:59:56.991106 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:59:56.991106 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:59:56.991106 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:59:56.991106 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 22:59:56.991106 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 22:59:56.991106 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 22:59:56.991106 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 22:59:56.991106 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:59:56.991106 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:59:56.991106 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:59:56.991106 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:59:56.998671 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16cdaac8-bb7a-405f-9bc6-1e7b17194689 could not be found. Oct 04 22:59:56.998671 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:59:56.998671 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:59:56.998671 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:59:56.998671 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:59:56.998671 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:59:56.998671 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:59:56.998671 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:59:56.998671 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:59:56.998671 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16cdaac8-bb7a-405f-9bc6-1e7b17194689 could not be found. Oct 04 22:59:56.998671 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:59:56.998671 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-a535cd8c-fc2b-46d6-8cc4-49d03c880338 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Returning 404 to user: Instance 16cdaac8-bb7a-405f-9bc6-1e7b17194689 could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:59:56.998671 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-a535cd8c-fc2b-46d6-8cc4-49d03c880338 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "DELETE /compute/v2.1/servers/16cdaac8-bb7a-405f-9bc6-1e7b17194689" status: 404 len: 111 microversion: 2.1 time: 0.031780 Oct 04 22:59:56.998671 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4160/7499] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 22:59:56 2022] DELETE /compute/v2.1/servers/16cdaac8-bb7a-405f-9bc6-1e7b17194689 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:59:57.001733 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-1b2efe87-b359-4079-8c7b-de48501c689f tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:59:57.003251 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-1b2efe87-b359-4079-8c7b-de48501c689f tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: 16cdaac8-bb7a-405f-9bc6-1e7b17194689] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:59:57.009154 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1b2efe87-b359-4079-8c7b-de48501c689f tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:59:57.009673 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1b2efe87-b359-4079-8c7b-de48501c689f tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:59:57.010113 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1b2efe87-b359-4079-8c7b-de48501c689f tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:59:57.010849 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1b2efe87-b359-4079-8c7b-de48501c689f tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:59:57.011305 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1b2efe87-b359-4079-8c7b-de48501c689f tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:59:57.011732 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1b2efe87-b359-4079-8c7b-de48501c689f tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:59:57.027355 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-1b2efe87-b359-4079-8c7b-de48501c689f tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] HTTP exception thrown: Instance 16cdaac8-bb7a-405f-9bc6-1e7b17194689 could not be found. Oct 04 22:59:57.028786 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-1b2efe87-b359-4079-8c7b-de48501c689f tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Request method failure captured: Oct 04 22:59:57.028786 n-d-860284-1 devstack@n-api.service[134102]: request: GET /compute/v2.1/servers/16cdaac8-bb7a-405f-9bc6-1e7b17194689 HTTP/1.1 Oct 04 22:59:57.028786 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 22:59:57.028786 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 22:59:57.028786 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 22:59:57.028786 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 22:59:57.028786 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 22:59:57.028786 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 22:59:57.028786 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 22:59:57.028786 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 22:59:57.028786 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPLj5Pwg8WnMY03a1UZoxjs8JJYeyX4gPNXk6kEaEUFSId5NkYbu9p7XcCT6xCsGLl965bhlzMmdcrnW3jmUrNP-IBqDDDBlZIgg6A8FuefFnP4mHIDNTJ0T7sYDTAC4YQVniCZjT1xnCXPrzoAdDzhVXLGL7ogVXgw4ofRJLecl7Qjo Oct 04 22:59:57.028786 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 22:59:57.028786 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 22:59:57.028786 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 22:59:57.028786 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 22:59:57.028786 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 22:59:57.028786 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 22:59:57.028786 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: d2ad9e4338314c269afb0cfcebe03584 Oct 04 22:59:57.028786 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-ServerActionsTestJSON-1972791785 Oct 04 22:59:57.028786 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 22:59:57.028786 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 22:59:57.028786 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d2ad9e4338314c269afb0cfcebe03584"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_d2ad9e4338314c269afb0cfcebe03584", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d2ad9e4338314c269afb0cfcebe03584"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/d2ad9e4338314c269afb0cfcebe03584"}]}] Oct 04 22:59:57.028786 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-ServerActionsTestJSON-1972791785 Oct 04 22:59:57.028786 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: d2ad9e4338314c269afb0cfcebe03584 Oct 04 22:59:57.028786 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-ServerActionsTestJSON-1972791785 Oct 04 22:59:57.028786 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-ServerActionsTestJSON-1972791785-project Oct 04 22:59:57.028786 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 22:59:57.028786 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 22:59:57.028786 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: aad9d55ccfe74ffb914f02030529523d Oct 04 22:59:57.028786 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-ServerActionsTestJSON-1972791785-project Oct 04 22:59:57.028786 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 22:59:57.028786 n-d-860284-1 devstack@n-api.service[134102]: exception: Instance 16cdaac8-bb7a-405f-9bc6-1e7b17194689 could not be found. Oct 04 22:59:57.028786 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': '16cdaac8-bb7a-405f-9bc6-1e7b17194689'} Oct 04 22:59:57.028786 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:59:57.028786 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:59:57.028786 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:59:57.028786 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:59:57.028786 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:59:57.028786 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:59:57.028786 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:59:57.028786 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:59:57.028786 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:59:57.028786 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:59:57.028786 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16cdaac8-bb7a-405f-9bc6-1e7b17194689 could not be found. Oct 04 22:59:57.028786 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:59:57.028786 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:59:57.028786 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:59:57.028786 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:59:57.028786 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:59:57.028786 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:59:57.028786 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:59:57.028786 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:59:57.028786 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:59:57.028786 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:59:57.028786 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:59:57.028786 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:59:57.028786 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:59:57.028786 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:59:57.028786 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:59:57.028786 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:59:57.028786 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16cdaac8-bb7a-405f-9bc6-1e7b17194689 could not be found. Oct 04 22:59:57.028786 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:59:57.028786 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:59:57.028786 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:59:57.033518 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:59:57.033518 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:59:57.033518 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:59:57.033518 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:59:57.033518 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:59:57.033518 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16cdaac8-bb7a-405f-9bc6-1e7b17194689 could not be found. Oct 04 22:59:57.033518 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:59:57.033518 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-1b2efe87-b359-4079-8c7b-de48501c689f tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Returning 404 to user: Instance 16cdaac8-bb7a-405f-9bc6-1e7b17194689 could not be found. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:59:57.033518 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-1b2efe87-b359-4079-8c7b-de48501c689f tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/16cdaac8-bb7a-405f-9bc6-1e7b17194689" status: 404 len: 111 microversion: 2.1 time: 0.032630 Oct 04 22:59:57.033518 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3340/7500] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:59:56 2022] GET /compute/v2.1/servers/16cdaac8-bb7a-405f-9bc6-1e7b17194689 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:59:57.039820 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-8e82dba9-c371-4a98-84a4-cdd18b10a55c tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:59:57.040346 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-8e82dba9-c371-4a98-84a4-cdd18b10a55c tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: 777aaf80-05b4-4e03-b329-084e9fda3e39] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:59:57.046803 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8e82dba9-c371-4a98-84a4-cdd18b10a55c tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:59:57.047311 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8e82dba9-c371-4a98-84a4-cdd18b10a55c tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:59:57.047802 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8e82dba9-c371-4a98-84a4-cdd18b10a55c tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:59:57.048590 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8e82dba9-c371-4a98-84a4-cdd18b10a55c tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:59:57.049121 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8e82dba9-c371-4a98-84a4-cdd18b10a55c tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:59:57.049618 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8e82dba9-c371-4a98-84a4-cdd18b10a55c tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:59:57.064088 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-8e82dba9-c371-4a98-84a4-cdd18b10a55c tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] HTTP exception thrown: Instance 777aaf80-05b4-4e03-b329-084e9fda3e39 could not be found. Oct 04 22:59:57.066563 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-8e82dba9-c371-4a98-84a4-cdd18b10a55c tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Request method failure captured: Oct 04 22:59:57.066563 n-d-860284-1 devstack@n-api.service[134101]: request: DELETE /compute/v2.1/servers/777aaf80-05b4-4e03-b329-084e9fda3e39 HTTP/1.1 Oct 04 22:59:57.066563 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 22:59:57.066563 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 22:59:57.066563 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 22:59:57.066563 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 22:59:57.066563 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 22:59:57.066563 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 22:59:57.066563 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 22:59:57.066563 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 22:59:57.066563 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPLj5Pwg8WnMY03a1UZoxjs8JJYeyX4gPNXk6kEaEUFSId5NkYbu9p7XcCT6xCsGLl965bhlzMmdcrnW3jmUrNP-IBqDDDBlZIgg6A8FuefFnP4mHIDNTJ0T7sYDTAC4YQVniCZjT1xnCXPrzoAdDzhVXLGL7ogVXgw4ofRJLecl7Qjo Oct 04 22:59:57.066563 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 22:59:57.066563 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 22:59:57.066563 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 22:59:57.066563 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 22:59:57.066563 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 22:59:57.066563 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 22:59:57.066563 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: d2ad9e4338314c269afb0cfcebe03584 Oct 04 22:59:57.066563 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-ServerActionsTestJSON-1972791785 Oct 04 22:59:57.066563 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 22:59:57.066563 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 22:59:57.066563 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d2ad9e4338314c269afb0cfcebe03584"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_d2ad9e4338314c269afb0cfcebe03584", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d2ad9e4338314c269afb0cfcebe03584"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/d2ad9e4338314c269afb0cfcebe03584"}]}] Oct 04 22:59:57.066563 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-ServerActionsTestJSON-1972791785 Oct 04 22:59:57.066563 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: d2ad9e4338314c269afb0cfcebe03584 Oct 04 22:59:57.066563 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-ServerActionsTestJSON-1972791785 Oct 04 22:59:57.066563 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-ServerActionsTestJSON-1972791785-project Oct 04 22:59:57.066563 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 22:59:57.066563 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 22:59:57.066563 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: aad9d55ccfe74ffb914f02030529523d Oct 04 22:59:57.066563 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-ServerActionsTestJSON-1972791785-project Oct 04 22:59:57.066563 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 22:59:57.066563 n-d-860284-1 devstack@n-api.service[134101]: exception: Instance 777aaf80-05b4-4e03-b329-084e9fda3e39 could not be found. Oct 04 22:59:57.066563 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': '777aaf80-05b4-4e03-b329-084e9fda3e39'} Oct 04 22:59:57.066563 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:59:57.066563 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:59:57.066563 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:59:57.066563 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:59:57.066563 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:59:57.066563 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:59:57.066563 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:59:57.066563 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:59:57.066563 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:59:57.066563 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:59:57.066563 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 777aaf80-05b4-4e03-b329-084e9fda3e39 could not be found. Oct 04 22:59:57.066563 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:59:57.066563 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:59:57.066563 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:59:57.066563 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:59:57.066563 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:59:57.066563 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:59:57.066563 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:59:57.066563 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:59:57.066563 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:59:57.066563 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:59:57.066563 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 22:59:57.066563 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 22:59:57.066563 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 22:59:57.066563 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 22:59:57.066563 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:59:57.066563 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:59:57.066563 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:59:57.066563 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:59:57.070528 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 777aaf80-05b4-4e03-b329-084e9fda3e39 could not be found. Oct 04 22:59:57.070528 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:59:57.070528 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:59:57.070528 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:59:57.070528 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:59:57.070528 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:59:57.070528 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:59:57.070528 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:59:57.070528 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:59:57.070528 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 777aaf80-05b4-4e03-b329-084e9fda3e39 could not be found. Oct 04 22:59:57.070528 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:59:57.070528 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-8e82dba9-c371-4a98-84a4-cdd18b10a55c tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Returning 404 to user: Instance 777aaf80-05b4-4e03-b329-084e9fda3e39 could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:59:57.070528 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-8e82dba9-c371-4a98-84a4-cdd18b10a55c tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "DELETE /compute/v2.1/servers/777aaf80-05b4-4e03-b329-084e9fda3e39" status: 404 len: 111 microversion: 2.1 time: 0.032356 Oct 04 22:59:57.070528 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4161/7501] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 22:59:57 2022] DELETE /compute/v2.1/servers/777aaf80-05b4-4e03-b329-084e9fda3e39 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:59:57.076878 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-26a3d47b-4f95-4f0a-85ca-9d8a86280b2d tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:59:57.077504 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-26a3d47b-4f95-4f0a-85ca-9d8a86280b2d tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: 777aaf80-05b4-4e03-b329-084e9fda3e39] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:59:57.084210 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-26a3d47b-4f95-4f0a-85ca-9d8a86280b2d tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:59:57.084697 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-26a3d47b-4f95-4f0a-85ca-9d8a86280b2d tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:59:57.085134 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-26a3d47b-4f95-4f0a-85ca-9d8a86280b2d tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:59:57.085827 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-26a3d47b-4f95-4f0a-85ca-9d8a86280b2d tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:59:57.086280 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-26a3d47b-4f95-4f0a-85ca-9d8a86280b2d tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:59:57.086735 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-26a3d47b-4f95-4f0a-85ca-9d8a86280b2d tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:59:57.102617 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-26a3d47b-4f95-4f0a-85ca-9d8a86280b2d tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] HTTP exception thrown: Instance 777aaf80-05b4-4e03-b329-084e9fda3e39 could not be found. Oct 04 22:59:57.104138 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-26a3d47b-4f95-4f0a-85ca-9d8a86280b2d tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Request method failure captured: Oct 04 22:59:57.104138 n-d-860284-1 devstack@n-api.service[134102]: request: GET /compute/v2.1/servers/777aaf80-05b4-4e03-b329-084e9fda3e39 HTTP/1.1 Oct 04 22:59:57.104138 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 22:59:57.104138 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 22:59:57.104138 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 22:59:57.104138 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 22:59:57.104138 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 22:59:57.104138 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 22:59:57.104138 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 22:59:57.104138 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 22:59:57.104138 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPLj5Pwg8WnMY03a1UZoxjs8JJYeyX4gPNXk6kEaEUFSId5NkYbu9p7XcCT6xCsGLl965bhlzMmdcrnW3jmUrNP-IBqDDDBlZIgg6A8FuefFnP4mHIDNTJ0T7sYDTAC4YQVniCZjT1xnCXPrzoAdDzhVXLGL7ogVXgw4ofRJLecl7Qjo Oct 04 22:59:57.104138 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 22:59:57.104138 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 22:59:57.104138 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 22:59:57.104138 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 22:59:57.104138 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 22:59:57.104138 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 22:59:57.104138 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: d2ad9e4338314c269afb0cfcebe03584 Oct 04 22:59:57.104138 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-ServerActionsTestJSON-1972791785 Oct 04 22:59:57.104138 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 22:59:57.104138 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 22:59:57.104138 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d2ad9e4338314c269afb0cfcebe03584"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_d2ad9e4338314c269afb0cfcebe03584", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d2ad9e4338314c269afb0cfcebe03584"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/d2ad9e4338314c269afb0cfcebe03584"}]}] Oct 04 22:59:57.104138 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-ServerActionsTestJSON-1972791785 Oct 04 22:59:57.104138 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: d2ad9e4338314c269afb0cfcebe03584 Oct 04 22:59:57.104138 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-ServerActionsTestJSON-1972791785 Oct 04 22:59:57.104138 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-ServerActionsTestJSON-1972791785-project Oct 04 22:59:57.104138 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 22:59:57.104138 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 22:59:57.104138 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: aad9d55ccfe74ffb914f02030529523d Oct 04 22:59:57.104138 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-ServerActionsTestJSON-1972791785-project Oct 04 22:59:57.104138 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 22:59:57.104138 n-d-860284-1 devstack@n-api.service[134102]: exception: Instance 777aaf80-05b4-4e03-b329-084e9fda3e39 could not be found. Oct 04 22:59:57.104138 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': '777aaf80-05b4-4e03-b329-084e9fda3e39'} Oct 04 22:59:57.104138 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:59:57.104138 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:59:57.104138 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:59:57.104138 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:59:57.104138 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:59:57.104138 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:59:57.104138 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:59:57.104138 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:59:57.104138 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:59:57.104138 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:59:57.104138 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 777aaf80-05b4-4e03-b329-084e9fda3e39 could not be found. Oct 04 22:59:57.104138 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:59:57.104138 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:59:57.104138 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:59:57.104138 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:59:57.104138 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:59:57.104138 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:59:57.104138 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:59:57.104138 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:59:57.104138 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:59:57.104138 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:59:57.104138 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:59:57.104138 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:59:57.104138 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:59:57.104138 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:59:57.104138 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:59:57.104138 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:59:57.104138 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 777aaf80-05b4-4e03-b329-084e9fda3e39 could not be found. Oct 04 22:59:57.104138 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:59:57.104138 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:59:57.104138 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:59:57.108574 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:59:57.108574 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:59:57.108574 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:59:57.108574 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:59:57.108574 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:59:57.108574 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 777aaf80-05b4-4e03-b329-084e9fda3e39 could not be found. Oct 04 22:59:57.108574 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:59:57.108574 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-26a3d47b-4f95-4f0a-85ca-9d8a86280b2d tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Returning 404 to user: Instance 777aaf80-05b4-4e03-b329-084e9fda3e39 could not be found. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:59:57.108574 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-26a3d47b-4f95-4f0a-85ca-9d8a86280b2d tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/777aaf80-05b4-4e03-b329-084e9fda3e39" status: 404 len: 111 microversion: 2.1 time: 0.032625 Oct 04 22:59:57.108574 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3341/7502] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:59:57 2022] GET /compute/v2.1/servers/777aaf80-05b4-4e03-b329-084e9fda3e39 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:59:57.114248 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-41c24457-b1e3-4d6a-baf8-7731897dc1d5 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:59:57.114853 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-41c24457-b1e3-4d6a-baf8-7731897dc1d5 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: 8ef4f4cd-170b-4474-ad7d-2e297a1dee54] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:59:57.121321 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-41c24457-b1e3-4d6a-baf8-7731897dc1d5 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:59:57.121822 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-41c24457-b1e3-4d6a-baf8-7731897dc1d5 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:59:57.122299 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-41c24457-b1e3-4d6a-baf8-7731897dc1d5 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:59:57.123030 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-41c24457-b1e3-4d6a-baf8-7731897dc1d5 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:59:57.123496 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-41c24457-b1e3-4d6a-baf8-7731897dc1d5 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:59:57.123930 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-41c24457-b1e3-4d6a-baf8-7731897dc1d5 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:59:57.139050 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-41c24457-b1e3-4d6a-baf8-7731897dc1d5 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] HTTP exception thrown: Instance 8ef4f4cd-170b-4474-ad7d-2e297a1dee54 could not be found. Oct 04 22:59:57.140746 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-41c24457-b1e3-4d6a-baf8-7731897dc1d5 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Request method failure captured: Oct 04 22:59:57.140746 n-d-860284-1 devstack@n-api.service[134101]: request: DELETE /compute/v2.1/servers/8ef4f4cd-170b-4474-ad7d-2e297a1dee54 HTTP/1.1 Oct 04 22:59:57.140746 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 22:59:57.140746 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 22:59:57.140746 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 22:59:57.140746 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 22:59:57.140746 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 22:59:57.140746 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 22:59:57.140746 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 22:59:57.140746 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 22:59:57.140746 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPLj5Pwg8WnMY03a1UZoxjs8JJYeyX4gPNXk6kEaEUFSId5NkYbu9p7XcCT6xCsGLl965bhlzMmdcrnW3jmUrNP-IBqDDDBlZIgg6A8FuefFnP4mHIDNTJ0T7sYDTAC4YQVniCZjT1xnCXPrzoAdDzhVXLGL7ogVXgw4ofRJLecl7Qjo Oct 04 22:59:57.140746 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 22:59:57.140746 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 22:59:57.140746 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 22:59:57.140746 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 22:59:57.140746 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 22:59:57.140746 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 22:59:57.140746 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: d2ad9e4338314c269afb0cfcebe03584 Oct 04 22:59:57.140746 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-ServerActionsTestJSON-1972791785 Oct 04 22:59:57.140746 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 22:59:57.140746 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 22:59:57.140746 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d2ad9e4338314c269afb0cfcebe03584"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_d2ad9e4338314c269afb0cfcebe03584", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d2ad9e4338314c269afb0cfcebe03584"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/d2ad9e4338314c269afb0cfcebe03584"}]}] Oct 04 22:59:57.140746 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-ServerActionsTestJSON-1972791785 Oct 04 22:59:57.140746 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: d2ad9e4338314c269afb0cfcebe03584 Oct 04 22:59:57.140746 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-ServerActionsTestJSON-1972791785 Oct 04 22:59:57.140746 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-ServerActionsTestJSON-1972791785-project Oct 04 22:59:57.140746 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 22:59:57.140746 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 22:59:57.140746 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: aad9d55ccfe74ffb914f02030529523d Oct 04 22:59:57.140746 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-ServerActionsTestJSON-1972791785-project Oct 04 22:59:57.140746 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 22:59:57.140746 n-d-860284-1 devstack@n-api.service[134101]: exception: Instance 8ef4f4cd-170b-4474-ad7d-2e297a1dee54 could not be found. Oct 04 22:59:57.140746 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': '8ef4f4cd-170b-4474-ad7d-2e297a1dee54'} Oct 04 22:59:57.140746 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:59:57.140746 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:59:57.140746 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:59:57.140746 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:59:57.140746 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:59:57.140746 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:59:57.140746 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:59:57.140746 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:59:57.140746 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:59:57.140746 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:59:57.140746 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ef4f4cd-170b-4474-ad7d-2e297a1dee54 could not be found. Oct 04 22:59:57.140746 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:59:57.140746 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:59:57.140746 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:59:57.140746 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:59:57.140746 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:59:57.140746 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:59:57.140746 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:59:57.140746 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:59:57.140746 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:59:57.140746 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:59:57.140746 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 22:59:57.140746 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 22:59:57.140746 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 22:59:57.140746 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 22:59:57.140746 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:59:57.140746 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:59:57.140746 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:59:57.140746 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:59:57.145723 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ef4f4cd-170b-4474-ad7d-2e297a1dee54 could not be found. Oct 04 22:59:57.145723 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:59:57.145723 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:59:57.145723 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:59:57.145723 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:59:57.145723 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:59:57.145723 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:59:57.145723 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:59:57.145723 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:59:57.145723 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ef4f4cd-170b-4474-ad7d-2e297a1dee54 could not be found. Oct 04 22:59:57.145723 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 22:59:57.145723 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-41c24457-b1e3-4d6a-baf8-7731897dc1d5 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Returning 404 to user: Instance 8ef4f4cd-170b-4474-ad7d-2e297a1dee54 could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:59:57.145723 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-41c24457-b1e3-4d6a-baf8-7731897dc1d5 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "DELETE /compute/v2.1/servers/8ef4f4cd-170b-4474-ad7d-2e297a1dee54" status: 404 len: 111 microversion: 2.1 time: 0.031992 Oct 04 22:59:57.145723 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4162/7503] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 22:59:57 2022] DELETE /compute/v2.1/servers/8ef4f4cd-170b-4474-ad7d-2e297a1dee54 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:59:57.151354 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-e8e1ddf3-34d2-4e2e-9305-aed66864c316 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:59:57.151974 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-e8e1ddf3-34d2-4e2e-9305-aed66864c316 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [instance: 8ef4f4cd-170b-4474-ad7d-2e297a1dee54] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:59:57.158251 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e8e1ddf3-34d2-4e2e-9305-aed66864c316 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:59:57.158849 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e8e1ddf3-34d2-4e2e-9305-aed66864c316 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:59:57.159326 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e8e1ddf3-34d2-4e2e-9305-aed66864c316 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:59:57.160072 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e8e1ddf3-34d2-4e2e-9305-aed66864c316 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:59:57.160537 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e8e1ddf3-34d2-4e2e-9305-aed66864c316 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:59:57.160983 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e8e1ddf3-34d2-4e2e-9305-aed66864c316 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:59:57.175196 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-e8e1ddf3-34d2-4e2e-9305-aed66864c316 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] HTTP exception thrown: Instance 8ef4f4cd-170b-4474-ad7d-2e297a1dee54 could not be found. Oct 04 22:59:57.176845 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-e8e1ddf3-34d2-4e2e-9305-aed66864c316 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Request method failure captured: Oct 04 22:59:57.176845 n-d-860284-1 devstack@n-api.service[134102]: request: GET /compute/v2.1/servers/8ef4f4cd-170b-4474-ad7d-2e297a1dee54 HTTP/1.1 Oct 04 22:59:57.176845 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 22:59:57.176845 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 22:59:57.176845 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 22:59:57.176845 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 22:59:57.176845 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 22:59:57.176845 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 22:59:57.176845 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 22:59:57.176845 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 22:59:57.176845 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPLj5Pwg8WnMY03a1UZoxjs8JJYeyX4gPNXk6kEaEUFSId5NkYbu9p7XcCT6xCsGLl965bhlzMmdcrnW3jmUrNP-IBqDDDBlZIgg6A8FuefFnP4mHIDNTJ0T7sYDTAC4YQVniCZjT1xnCXPrzoAdDzhVXLGL7ogVXgw4ofRJLecl7Qjo Oct 04 22:59:57.176845 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 22:59:57.176845 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 22:59:57.176845 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 22:59:57.176845 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 22:59:57.176845 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 22:59:57.176845 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 22:59:57.176845 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: d2ad9e4338314c269afb0cfcebe03584 Oct 04 22:59:57.176845 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-ServerActionsTestJSON-1972791785 Oct 04 22:59:57.176845 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 22:59:57.176845 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 22:59:57.176845 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d2ad9e4338314c269afb0cfcebe03584"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_d2ad9e4338314c269afb0cfcebe03584", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d2ad9e4338314c269afb0cfcebe03584"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/d2ad9e4338314c269afb0cfcebe03584"}]}] Oct 04 22:59:57.176845 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-ServerActionsTestJSON-1972791785 Oct 04 22:59:57.176845 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: d2ad9e4338314c269afb0cfcebe03584 Oct 04 22:59:57.176845 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-ServerActionsTestJSON-1972791785 Oct 04 22:59:57.176845 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-ServerActionsTestJSON-1972791785-project Oct 04 22:59:57.176845 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 22:59:57.176845 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 22:59:57.176845 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: aad9d55ccfe74ffb914f02030529523d Oct 04 22:59:57.176845 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-ServerActionsTestJSON-1972791785-project Oct 04 22:59:57.176845 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 22:59:57.176845 n-d-860284-1 devstack@n-api.service[134102]: exception: Instance 8ef4f4cd-170b-4474-ad7d-2e297a1dee54 could not be found. Oct 04 22:59:57.176845 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': '8ef4f4cd-170b-4474-ad7d-2e297a1dee54'} Oct 04 22:59:57.176845 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:59:57.176845 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:59:57.176845 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:59:57.176845 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:59:57.176845 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:59:57.176845 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:59:57.176845 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:59:57.176845 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:59:57.176845 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:59:57.176845 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:59:57.176845 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ef4f4cd-170b-4474-ad7d-2e297a1dee54 could not be found. Oct 04 22:59:57.176845 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:59:57.176845 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:59:57.176845 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:59:57.176845 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:59:57.176845 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:59:57.176845 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:59:57.176845 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:59:57.176845 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:59:57.176845 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:59:57.176845 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:59:57.176845 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:59:57.176845 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:59:57.176845 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:59:57.176845 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:59:57.176845 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:59:57.176845 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:59:57.176845 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ef4f4cd-170b-4474-ad7d-2e297a1dee54 could not be found. Oct 04 22:59:57.176845 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:59:57.176845 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:59:57.176845 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:59:57.181080 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:59:57.181080 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:59:57.181080 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:59:57.181080 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:59:57.181080 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:59:57.181080 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ef4f4cd-170b-4474-ad7d-2e297a1dee54 could not be found. Oct 04 22:59:57.181080 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 22:59:57.181080 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-e8e1ddf3-34d2-4e2e-9305-aed66864c316 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Returning 404 to user: Instance 8ef4f4cd-170b-4474-ad7d-2e297a1dee54 could not be found. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:59:57.181080 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-e8e1ddf3-34d2-4e2e-9305-aed66864c316 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "GET /compute/v2.1/servers/8ef4f4cd-170b-4474-ad7d-2e297a1dee54" status: 404 len: 111 microversion: 2.1 time: 0.030872 Oct 04 22:59:57.181080 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3342/7504] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 22:59:57 2022] GET /compute/v2.1/servers/8ef4f4cd-170b-4474-ad7d-2e297a1dee54 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:59:57.187169 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-849f2cd0-2fb2-44d2-9a93-64724e555092 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] Calling method '.version_select at 0x7fbb2e1af670>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:59:57.192150 n-d-860284-1 devstack@n-api.service[134101]: ERROR oslo.messaging._drivers.impl_rabbit [None req-849f2cd0-2fb2-44d2-9a93-64724e555092 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [54f0993b-fb22-4e4c-ae00-e3f0e5da4c18] AMQP server on 10.222.0.43:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 22:59:58.199182 n-d-860284-1 devstack@n-api.service[134101]: INFO oslo.messaging._drivers.impl_rabbit [None req-849f2cd0-2fb2-44d2-9a93-64724e555092 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] [54f0993b-fb22-4e4c-ae00-e3f0e5da4c18] Reconnected to AMQP server on 10.222.0.43:5672 via [amqp] client with port 36970. Oct 04 22:59:58.220634 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-849f2cd0-2fb2-44d2-9a93-64724e555092 tempest-ServerActionsTestJSON-1972791785 tempest-ServerActionsTestJSON-1972791785-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-524313961" status: 202 len: 0 microversion: 2.1 time: 1.037400 Oct 04 22:59:58.221979 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4163/7505] 10.222.0.43 () {58 vars in 1218 bytes} [Tue Oct 4 22:59:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-524313961 => generated 0 bytes in 1039 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 23:00:07.562755 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_api:SELECT=7 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:00:07.564754 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=11 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:00:07.717325 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-19d4fc08-b9dd-4f9c-a476-aadc41d3db34 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1825114253", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452", "networks": [{"uuid": "e99befbf-3659-402b-8311-973ca79b22a7"}]}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 23:00:07.777660 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.network.neutron [None req-19d4fc08-b9dd-4f9c-a476-aadc41d3db34 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] validate_networks() for [('e99befbf-3659-402b-8311-973ca79b22a7', None, None, None, None, None)] {{(pid=134102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 23:00:08.217656 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-19d4fc08-b9dd-4f9c-a476-aadc41d3db34 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Flavor limits 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 23:00:08.218169 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-19d4fc08-b9dd-4f9c-a476-aadc41d3db34 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Image limits 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 23:00:08.218749 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-19d4fc08-b9dd-4f9c-a476-aadc41d3db34 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Flavor pref 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 23:00:08.219274 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-19d4fc08-b9dd-4f9c-a476-aadc41d3db34 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Image pref 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 23:00:08.219803 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-19d4fc08-b9dd-4f9c-a476-aadc41d3db34 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 23:00:08.230762 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-19d4fc08-b9dd-4f9c-a476-aadc41d3db34 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:00:08.231389 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-19d4fc08-b9dd-4f9c-a476-aadc41d3db34 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:00:08.231939 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-19d4fc08-b9dd-4f9c-a476-aadc41d3db34 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:00:08.232765 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-19d4fc08-b9dd-4f9c-a476-aadc41d3db34 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:00:08.233301 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-19d4fc08-b9dd-4f9c-a476-aadc41d3db34 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:00:08.233799 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-19d4fc08-b9dd-4f9c-a476-aadc41d3db34 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:00:08.254281 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-19d4fc08-b9dd-4f9c-a476-aadc41d3db34 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Getting quotas for project bf8479b202e544a785d8f165617ea33b. Resources: {'instances', 'ram', 'cores'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 23:00:08.259953 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-19d4fc08-b9dd-4f9c-a476-aadc41d3db34 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Getting quotas for user 7f2fb9b0105749a9a6604604bbc9cc14 and project bf8479b202e544a785d8f165617ea33b. Resources: {'instances', 'ram', 'cores'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 23:00:08.273725 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-19d4fc08-b9dd-4f9c-a476-aadc41d3db34 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Going to run 1 instances... {{(pid=134102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 23:00:08.276145 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-19d4fc08-b9dd-4f9c-a476-aadc41d3db34 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] [instance: 7ce6bf89-64b9-4f13-8114-2c4e8144b308] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='58548514-5dac-426c-81f5-19e3fba33e23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 23:00:08.319485 n-d-860284-1 devstack@n-api.service[134102]: ERROR oslo.messaging._drivers.impl_rabbit [None req-19d4fc08-b9dd-4f9c-a476-aadc41d3db34 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] [bd2f817c-7b36-496a-b3a6-fe3aafb6a711] AMQP server on 10.222.0.43:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 23:00:09.329351 n-d-860284-1 devstack@n-api.service[134102]: INFO oslo.messaging._drivers.impl_rabbit [None req-19d4fc08-b9dd-4f9c-a476-aadc41d3db34 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] [bd2f817c-7b36-496a-b3a6-fe3aafb6a711] Reconnected to AMQP server on 10.222.0.43:5672 via [amqp] client with port 37062. Oct 04 23:00:09.335181 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-19d4fc08-b9dd-4f9c-a476-aadc41d3db34 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.777945 Oct 04 23:00:09.336032 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3343/7506] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 23:00:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 1779 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 23:00:09.345054 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=35,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:00:09.347509 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=12,nova_api:DELETE=1 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:00:09.352712 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-60fba78b-0f2b-4385-b613-099e81d8f02f tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:00:09.353460 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-60fba78b-0f2b-4385-b613-099e81d8f02f tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] [instance: 7ce6bf89-64b9-4f13-8114-2c4e8144b308] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:00:09.421281 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-60fba78b-0f2b-4385-b613-099e81d8f02f tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2fb9b0105749a9a6604604bbc9cc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8479b202e544a785d8f165617ea33b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:00:09.429780 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-60fba78b-0f2b-4385-b613-099e81d8f02f tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] 10.222.0.43 "GET /compute/v2.1/servers/7ce6bf89-64b9-4f13-8114-2c4e8144b308" status: 200 len: 1217 microversion: 2.1 time: 0.086393 Oct 04 23:00:09.430590 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4164/7507] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:00:09 2022] GET /compute/v2.1/servers/7ce6bf89-64b9-4f13-8114-2c4e8144b308 => generated 1217 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:00:10.454451 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-bde7137e-e90d-42b8-beae-f860f296aa33 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:00:10.455817 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-bde7137e-e90d-42b8-beae-f860f296aa33 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] [instance: 7ce6bf89-64b9-4f13-8114-2c4e8144b308] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:00:10.462261 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bde7137e-e90d-42b8-beae-f860f296aa33 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:00:10.462787 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bde7137e-e90d-42b8-beae-f860f296aa33 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:00:10.463222 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bde7137e-e90d-42b8-beae-f860f296aa33 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:00:10.463995 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bde7137e-e90d-42b8-beae-f860f296aa33 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:00:10.464494 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bde7137e-e90d-42b8-beae-f860f296aa33 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:00:10.464993 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bde7137e-e90d-42b8-beae-f860f296aa33 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:00:10.539769 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-bde7137e-e90d-42b8-beae-f860f296aa33 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2fb9b0105749a9a6604604bbc9cc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8479b202e544a785d8f165617ea33b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:00:10.553758 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-bde7137e-e90d-42b8-beae-f860f296aa33 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] 10.222.0.43 "GET /compute/v2.1/servers/7ce6bf89-64b9-4f13-8114-2c4e8144b308" status: 200 len: 1269 microversion: 2.1 time: 0.104254 Oct 04 23:00:10.554678 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3344/7508] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:00:10 2022] GET /compute/v2.1/servers/7ce6bf89-64b9-4f13-8114-2c4e8144b308 => generated 1269 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:00:11.581031 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-ded4d333-6014-4b6f-9bdb-85e6c89cc897 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:00:11.581948 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-ded4d333-6014-4b6f-9bdb-85e6c89cc897 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] [instance: 7ce6bf89-64b9-4f13-8114-2c4e8144b308] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:00:11.590867 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ded4d333-6014-4b6f-9bdb-85e6c89cc897 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:00:11.591533 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ded4d333-6014-4b6f-9bdb-85e6c89cc897 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:00:11.592203 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ded4d333-6014-4b6f-9bdb-85e6c89cc897 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:00:11.593025 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ded4d333-6014-4b6f-9bdb-85e6c89cc897 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:00:11.593603 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ded4d333-6014-4b6f-9bdb-85e6c89cc897 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:00:11.594153 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ded4d333-6014-4b6f-9bdb-85e6c89cc897 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:00:11.734035 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-ded4d333-6014-4b6f-9bdb-85e6c89cc897 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2fb9b0105749a9a6604604bbc9cc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8479b202e544a785d8f165617ea33b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:00:11.743508 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-ded4d333-6014-4b6f-9bdb-85e6c89cc897 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] 10.222.0.43 "GET /compute/v2.1/servers/7ce6bf89-64b9-4f13-8114-2c4e8144b308" status: 200 len: 1317 microversion: 2.1 time: 0.167272 Oct 04 23:00:11.744091 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4165/7509] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:00:11 2022] GET /compute/v2.1/servers/7ce6bf89-64b9-4f13-8114-2c4e8144b308 => generated 1317 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:00:12.026197 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-291a48b0-a4af-4243-a93b-46665419f422 req-095e093d-4e3a-4cf6-9c3d-e4b395d8e7d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ce6bf89-64b9-4f13-8114-2c4e8144b308", "tag": "a9ff3e32-913c-4c1f-8736-cbb969870c65"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 23:00:12.038190 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-291a48b0-a4af-4243-a93b-46665419f422 req-095e093d-4e3a-4cf6-9c3d-e4b395d8e7d1 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:00:12.038707 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-291a48b0-a4af-4243-a93b-46665419f422 req-095e093d-4e3a-4cf6-9c3d-e4b395d8e7d1 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:00:12.039154 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-291a48b0-a4af-4243-a93b-46665419f422 req-095e093d-4e3a-4cf6-9c3d-e4b395d8e7d1 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:00:12.051160 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-291a48b0-a4af-4243-a93b-46665419f422 req-095e093d-4e3a-4cf6-9c3d-e4b395d8e7d1 service nova] Creating event network-changed:a9ff3e32-913c-4c1f-8736-cbb969870c65 for instance 7ce6bf89-64b9-4f13-8114-2c4e8144b308 on n-h2-860284-1 Oct 04 23:00:12.056795 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-291a48b0-a4af-4243-a93b-46665419f422 req-095e093d-4e3a-4cf6-9c3d-e4b395d8e7d1 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034436 Oct 04 23:00:12.057620 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3345/7510] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 23:00:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 23:00:12.768173 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-a8a8cf4a-0940-48a3-86e8-c421e49fd902 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:00:12.768959 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-a8a8cf4a-0940-48a3-86e8-c421e49fd902 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] [instance: 7ce6bf89-64b9-4f13-8114-2c4e8144b308] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:00:12.775910 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a8a8cf4a-0940-48a3-86e8-c421e49fd902 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:00:12.776417 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a8a8cf4a-0940-48a3-86e8-c421e49fd902 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:00:12.776874 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a8a8cf4a-0940-48a3-86e8-c421e49fd902 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:00:12.777593 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a8a8cf4a-0940-48a3-86e8-c421e49fd902 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:00:12.778072 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a8a8cf4a-0940-48a3-86e8-c421e49fd902 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:00:12.778550 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a8a8cf4a-0940-48a3-86e8-c421e49fd902 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:00:12.911888 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-a8a8cf4a-0940-48a3-86e8-c421e49fd902 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2fb9b0105749a9a6604604bbc9cc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8479b202e544a785d8f165617ea33b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:00:12.920400 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-a8a8cf4a-0940-48a3-86e8-c421e49fd902 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] 10.222.0.43 "GET /compute/v2.1/servers/7ce6bf89-64b9-4f13-8114-2c4e8144b308" status: 200 len: 1317 microversion: 2.1 time: 0.156743 Oct 04 23:00:12.933083 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4166/7511] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:00:12 2022] GET /compute/v2.1/servers/7ce6bf89-64b9-4f13-8114-2c4e8144b308 => generated 1317 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:00:13.946406 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-b57131ad-e723-435f-939a-a0b40f568c75 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:00:13.947045 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-b57131ad-e723-435f-939a-a0b40f568c75 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] [instance: 7ce6bf89-64b9-4f13-8114-2c4e8144b308] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:00:13.953309 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b57131ad-e723-435f-939a-a0b40f568c75 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:00:13.953801 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b57131ad-e723-435f-939a-a0b40f568c75 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:00:13.954245 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b57131ad-e723-435f-939a-a0b40f568c75 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:00:13.955207 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b57131ad-e723-435f-939a-a0b40f568c75 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:00:13.955675 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b57131ad-e723-435f-939a-a0b40f568c75 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:00:13.956113 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b57131ad-e723-435f-939a-a0b40f568c75 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:00:14.089424 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-b57131ad-e723-435f-939a-a0b40f568c75 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2fb9b0105749a9a6604604bbc9cc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8479b202e544a785d8f165617ea33b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:00:14.097687 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-b57131ad-e723-435f-939a-a0b40f568c75 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] 10.222.0.43 "GET /compute/v2.1/servers/7ce6bf89-64b9-4f13-8114-2c4e8144b308" status: 200 len: 1317 microversion: 2.1 time: 0.156544 Oct 04 23:00:14.098271 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3346/7512] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:00:13 2022] GET /compute/v2.1/servers/7ce6bf89-64b9-4f13-8114-2c4e8144b308 => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:00:15.121429 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-932942b6-eeb7-466f-942b-560b7dd2892c tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:00:15.122008 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-932942b6-eeb7-466f-942b-560b7dd2892c tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] [instance: 7ce6bf89-64b9-4f13-8114-2c4e8144b308] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:00:15.129524 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-932942b6-eeb7-466f-942b-560b7dd2892c tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:00:15.130030 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-932942b6-eeb7-466f-942b-560b7dd2892c tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:00:15.130521 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-932942b6-eeb7-466f-942b-560b7dd2892c tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:00:15.131270 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-932942b6-eeb7-466f-942b-560b7dd2892c tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:00:15.131747 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-932942b6-eeb7-466f-942b-560b7dd2892c tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:00:15.132201 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-932942b6-eeb7-466f-942b-560b7dd2892c tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:00:15.262711 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-932942b6-eeb7-466f-942b-560b7dd2892c tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2fb9b0105749a9a6604604bbc9cc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8479b202e544a785d8f165617ea33b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:00:15.270516 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-932942b6-eeb7-466f-942b-560b7dd2892c tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] 10.222.0.43 "GET /compute/v2.1/servers/7ce6bf89-64b9-4f13-8114-2c4e8144b308" status: 200 len: 1317 microversion: 2.1 time: 0.153141 Oct 04 23:00:15.271097 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4167/7513] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:00:15 2022] GET /compute/v2.1/servers/7ce6bf89-64b9-4f13-8114-2c4e8144b308 => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:00:16.293043 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-55dc7e6a-3701-4cd9-8baa-074f68eb5fc7 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:00:16.293705 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-55dc7e6a-3701-4cd9-8baa-074f68eb5fc7 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] [instance: 7ce6bf89-64b9-4f13-8114-2c4e8144b308] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:00:16.300715 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-55dc7e6a-3701-4cd9-8baa-074f68eb5fc7 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:00:16.301211 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-55dc7e6a-3701-4cd9-8baa-074f68eb5fc7 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:00:16.301657 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-55dc7e6a-3701-4cd9-8baa-074f68eb5fc7 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:00:16.302389 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-55dc7e6a-3701-4cd9-8baa-074f68eb5fc7 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:00:16.302852 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-55dc7e6a-3701-4cd9-8baa-074f68eb5fc7 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:00:16.303286 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-55dc7e6a-3701-4cd9-8baa-074f68eb5fc7 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:00:16.431138 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-55dc7e6a-3701-4cd9-8baa-074f68eb5fc7 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2fb9b0105749a9a6604604bbc9cc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8479b202e544a785d8f165617ea33b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:00:16.438973 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-55dc7e6a-3701-4cd9-8baa-074f68eb5fc7 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] 10.222.0.43 "GET /compute/v2.1/servers/7ce6bf89-64b9-4f13-8114-2c4e8144b308" status: 200 len: 1317 microversion: 2.1 time: 0.149822 Oct 04 23:00:16.439559 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3347/7514] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:00:16 2022] GET /compute/v2.1/servers/7ce6bf89-64b9-4f13-8114-2c4e8144b308 => generated 1317 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:00:17.461949 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-379a397e-7553-49b0-816c-752a3989a900 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:00:17.463117 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-379a397e-7553-49b0-816c-752a3989a900 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] [instance: 7ce6bf89-64b9-4f13-8114-2c4e8144b308] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:00:17.468838 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-379a397e-7553-49b0-816c-752a3989a900 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:00:17.469336 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-379a397e-7553-49b0-816c-752a3989a900 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:00:17.469782 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-379a397e-7553-49b0-816c-752a3989a900 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:00:17.471086 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-379a397e-7553-49b0-816c-752a3989a900 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:00:17.471601 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-379a397e-7553-49b0-816c-752a3989a900 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:00:17.472040 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-379a397e-7553-49b0-816c-752a3989a900 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:00:17.613296 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-379a397e-7553-49b0-816c-752a3989a900 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2fb9b0105749a9a6604604bbc9cc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8479b202e544a785d8f165617ea33b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:00:17.621518 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-379a397e-7553-49b0-816c-752a3989a900 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] 10.222.0.43 "GET /compute/v2.1/servers/7ce6bf89-64b9-4f13-8114-2c4e8144b308" status: 200 len: 1317 microversion: 2.1 time: 0.163468 Oct 04 23:00:17.622102 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4168/7515] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:00:17 2022] GET /compute/v2.1/servers/7ce6bf89-64b9-4f13-8114-2c4e8144b308 => generated 1317 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:00:18.645574 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-6714d75c-831b-48cc-8b15-b7a555d736b8 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:00:18.646183 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-6714d75c-831b-48cc-8b15-b7a555d736b8 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] [instance: 7ce6bf89-64b9-4f13-8114-2c4e8144b308] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:00:18.649025 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell0:SELECT=2 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:00:18.649707 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell0:SELECT=6 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:00:18.661074 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6714d75c-831b-48cc-8b15-b7a555d736b8 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:00:18.661644 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6714d75c-831b-48cc-8b15-b7a555d736b8 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:00:18.662100 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6714d75c-831b-48cc-8b15-b7a555d736b8 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:00:18.662853 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6714d75c-831b-48cc-8b15-b7a555d736b8 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:00:18.663326 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6714d75c-831b-48cc-8b15-b7a555d736b8 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:00:18.663770 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6714d75c-831b-48cc-8b15-b7a555d736b8 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:00:18.805476 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-6714d75c-831b-48cc-8b15-b7a555d736b8 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2fb9b0105749a9a6604604bbc9cc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8479b202e544a785d8f165617ea33b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:00:18.813352 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-6714d75c-831b-48cc-8b15-b7a555d736b8 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] 10.222.0.43 "GET /compute/v2.1/servers/7ce6bf89-64b9-4f13-8114-2c4e8144b308" status: 200 len: 1317 microversion: 2.1 time: 0.171959 Oct 04 23:00:18.813951 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3348/7516] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:00:18 2022] GET /compute/v2.1/servers/7ce6bf89-64b9-4f13-8114-2c4e8144b308 => generated 1317 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 23:00:19.484363 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-f251ee81-b4cd-4a53-b2fc-68e86184b8ef req-60049140-c116-44d0-a1e6-e465dbd3f13b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ce6bf89-64b9-4f13-8114-2c4e8144b308", "name": "network-vif-plugged", "status": "completed", "tag": "a9ff3e32-913c-4c1f-8736-cbb969870c65"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 23:00:19.490477 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=2 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:00:19.496384 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-f251ee81-b4cd-4a53-b2fc-68e86184b8ef req-60049140-c116-44d0-a1e6-e465dbd3f13b service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:00:19.496877 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-f251ee81-b4cd-4a53-b2fc-68e86184b8ef req-60049140-c116-44d0-a1e6-e465dbd3f13b service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:00:19.497319 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-f251ee81-b4cd-4a53-b2fc-68e86184b8ef req-60049140-c116-44d0-a1e6-e465dbd3f13b service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:00:19.509469 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-f251ee81-b4cd-4a53-b2fc-68e86184b8ef req-60049140-c116-44d0-a1e6-e465dbd3f13b service nova] Creating event network-vif-plugged:a9ff3e32-913c-4c1f-8736-cbb969870c65 for instance 7ce6bf89-64b9-4f13-8114-2c4e8144b308 on n-h2-860284-1 Oct 04 23:00:19.514562 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-f251ee81-b4cd-4a53-b2fc-68e86184b8ef req-60049140-c116-44d0-a1e6-e465dbd3f13b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034645 Oct 04 23:00:19.515160 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4169/7517] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 23:00:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 23:00:19.836627 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-ed4f5a59-c49b-45cc-9ea9-9a91f7a371eb tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:00:19.837284 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-ed4f5a59-c49b-45cc-9ea9-9a91f7a371eb tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] [instance: 7ce6bf89-64b9-4f13-8114-2c4e8144b308] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:00:19.845287 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ed4f5a59-c49b-45cc-9ea9-9a91f7a371eb tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:00:19.845778 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ed4f5a59-c49b-45cc-9ea9-9a91f7a371eb tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:00:19.846223 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ed4f5a59-c49b-45cc-9ea9-9a91f7a371eb tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:00:19.846966 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ed4f5a59-c49b-45cc-9ea9-9a91f7a371eb tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:00:19.847431 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ed4f5a59-c49b-45cc-9ea9-9a91f7a371eb tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:00:19.847863 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ed4f5a59-c49b-45cc-9ea9-9a91f7a371eb tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:00:19.978850 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-ed4f5a59-c49b-45cc-9ea9-9a91f7a371eb tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2fb9b0105749a9a6604604bbc9cc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8479b202e544a785d8f165617ea33b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:00:19.987457 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-ed4f5a59-c49b-45cc-9ea9-9a91f7a371eb tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] 10.222.0.43 "GET /compute/v2.1/servers/7ce6bf89-64b9-4f13-8114-2c4e8144b308" status: 200 len: 1317 microversion: 2.1 time: 0.154768 Oct 04 23:00:19.988046 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3349/7518] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:00:19 2022] GET /compute/v2.1/servers/7ce6bf89-64b9-4f13-8114-2c4e8144b308 => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:00:21.013542 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-28e7962e-d091-430e-a8f1-0c8ab304aad6 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:00:21.014262 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-28e7962e-d091-430e-a8f1-0c8ab304aad6 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] [instance: 7ce6bf89-64b9-4f13-8114-2c4e8144b308] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:00:21.022227 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-28e7962e-d091-430e-a8f1-0c8ab304aad6 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:00:21.022787 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-28e7962e-d091-430e-a8f1-0c8ab304aad6 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:00:21.023250 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-28e7962e-d091-430e-a8f1-0c8ab304aad6 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:00:21.023979 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-28e7962e-d091-430e-a8f1-0c8ab304aad6 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:00:21.024487 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-28e7962e-d091-430e-a8f1-0c8ab304aad6 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:00:21.024938 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-28e7962e-d091-430e-a8f1-0c8ab304aad6 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:00:21.162797 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-28e7962e-d091-430e-a8f1-0c8ab304aad6 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2fb9b0105749a9a6604604bbc9cc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8479b202e544a785d8f165617ea33b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:00:21.170753 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-28e7962e-d091-430e-a8f1-0c8ab304aad6 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] 10.222.0.43 "GET /compute/v2.1/servers/7ce6bf89-64b9-4f13-8114-2c4e8144b308" status: 200 len: 1507 microversion: 2.1 time: 0.162951 Oct 04 23:00:21.171330 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4170/7519] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:00:21 2022] GET /compute/v2.1/servers/7ce6bf89-64b9-4f13-8114-2c4e8144b308 => generated 1507 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:00:21.233458 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-c7ed9936-26f1-460e-bdd1-42156e460706 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1739244436", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452", "networks": [{"uuid": "e99befbf-3659-402b-8311-973ca79b22a7"}]}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 23:00:21.287623 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.network.neutron [None req-c7ed9936-26f1-460e-bdd1-42156e460706 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] validate_networks() for [('e99befbf-3659-402b-8311-973ca79b22a7', None, None, None, None, None)] {{(pid=134102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 23:00:21.654946 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-c7ed9936-26f1-460e-bdd1-42156e460706 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Flavor limits 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 23:00:21.655379 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-c7ed9936-26f1-460e-bdd1-42156e460706 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Image limits 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 23:00:21.655859 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-c7ed9936-26f1-460e-bdd1-42156e460706 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Flavor pref 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 23:00:21.656276 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-c7ed9936-26f1-460e-bdd1-42156e460706 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Image pref 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 23:00:21.656698 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-c7ed9936-26f1-460e-bdd1-42156e460706 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 23:00:21.665964 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c7ed9936-26f1-460e-bdd1-42156e460706 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:00:21.666417 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c7ed9936-26f1-460e-bdd1-42156e460706 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:00:21.666861 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c7ed9936-26f1-460e-bdd1-42156e460706 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:00:21.667596 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c7ed9936-26f1-460e-bdd1-42156e460706 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:00:21.668053 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c7ed9936-26f1-460e-bdd1-42156e460706 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:00:21.668484 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c7ed9936-26f1-460e-bdd1-42156e460706 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:00:21.686622 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-c7ed9936-26f1-460e-bdd1-42156e460706 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Getting quotas for project bf8479b202e544a785d8f165617ea33b. Resources: {'instances', 'ram', 'cores'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 23:00:21.692715 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-c7ed9936-26f1-460e-bdd1-42156e460706 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Getting quotas for user 7f2fb9b0105749a9a6604604bbc9cc14 and project bf8479b202e544a785d8f165617ea33b. Resources: {'instances', 'ram', 'cores'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 23:00:21.705018 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-c7ed9936-26f1-460e-bdd1-42156e460706 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Going to run 1 instances... {{(pid=134102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 23:00:21.707350 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-c7ed9936-26f1-460e-bdd1-42156e460706 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] [instance: 8b2f7ab3-ae9b-4b2d-95b0-5f96f724e84a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='58548514-5dac-426c-81f5-19e3fba33e23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 23:00:21.752305 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-c7ed9936-26f1-460e-bdd1-42156e460706 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.522809 Oct 04 23:00:21.753175 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3350/7520] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 23:00:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 524 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 23:00:21.764714 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-4c96a99b-5a92-42e7-9d89-23513cc5f405 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:00:21.765386 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-4c96a99b-5a92-42e7-9d89-23513cc5f405 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] [instance: 8b2f7ab3-ae9b-4b2d-95b0-5f96f724e84a] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:00:21.822673 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-4c96a99b-5a92-42e7-9d89-23513cc5f405 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2fb9b0105749a9a6604604bbc9cc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8479b202e544a785d8f165617ea33b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:00:21.832285 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-4c96a99b-5a92-42e7-9d89-23513cc5f405 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] 10.222.0.43 "GET /compute/v2.1/servers/8b2f7ab3-ae9b-4b2d-95b0-5f96f724e84a" status: 200 len: 1217 microversion: 2.1 time: 0.072081 Oct 04 23:00:21.833294 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4171/7521] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:00:21 2022] GET /compute/v2.1/servers/8b2f7ab3-ae9b-4b2d-95b0-5f96f724e84a => generated 1217 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:00:22.857565 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-0ca5eb14-3464-4fd3-b4dc-42626c7be8f1 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:00:22.858108 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-0ca5eb14-3464-4fd3-b4dc-42626c7be8f1 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] [instance: 8b2f7ab3-ae9b-4b2d-95b0-5f96f724e84a] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:00:22.865538 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0ca5eb14-3464-4fd3-b4dc-42626c7be8f1 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:00:22.866023 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0ca5eb14-3464-4fd3-b4dc-42626c7be8f1 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:00:22.866996 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0ca5eb14-3464-4fd3-b4dc-42626c7be8f1 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:00:22.868012 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0ca5eb14-3464-4fd3-b4dc-42626c7be8f1 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:00:22.868402 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0ca5eb14-3464-4fd3-b4dc-42626c7be8f1 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:00:22.868834 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0ca5eb14-3464-4fd3-b4dc-42626c7be8f1 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:00:22.963391 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-0ca5eb14-3464-4fd3-b4dc-42626c7be8f1 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2fb9b0105749a9a6604604bbc9cc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8479b202e544a785d8f165617ea33b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:00:22.971774 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-0ca5eb14-3464-4fd3-b4dc-42626c7be8f1 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] 10.222.0.43 "GET /compute/v2.1/servers/8b2f7ab3-ae9b-4b2d-95b0-5f96f724e84a" status: 200 len: 1287 microversion: 2.1 time: 0.119384 Oct 04 23:00:22.972365 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3351/7522] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:00:22 2022] GET /compute/v2.1/servers/8b2f7ab3-ae9b-4b2d-95b0-5f96f724e84a => generated 1287 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:00:23.995860 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-1e817896-b6a4-44a0-ba74-915a7ebeba29 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:00:23.996499 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-1e817896-b6a4-44a0-ba74-915a7ebeba29 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] [instance: 8b2f7ab3-ae9b-4b2d-95b0-5f96f724e84a] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:00:24.004522 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1e817896-b6a4-44a0-ba74-915a7ebeba29 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:00:24.005028 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1e817896-b6a4-44a0-ba74-915a7ebeba29 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:00:24.005489 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1e817896-b6a4-44a0-ba74-915a7ebeba29 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:00:24.006209 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1e817896-b6a4-44a0-ba74-915a7ebeba29 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:00:24.006747 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1e817896-b6a4-44a0-ba74-915a7ebeba29 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:00:24.007202 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1e817896-b6a4-44a0-ba74-915a7ebeba29 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:00:24.137723 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-4c71df4f-814d-4293-a7f9-affe37539609 req-a424f00d-8a90-40df-ae2e-902fa8fa9b71 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b2f7ab3-ae9b-4b2d-95b0-5f96f724e84a", "tag": "af963006-d84d-432b-b5c4-4c3c04dc2d77"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 23:00:24.152068 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-1e817896-b6a4-44a0-ba74-915a7ebeba29 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2fb9b0105749a9a6604604bbc9cc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8479b202e544a785d8f165617ea33b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:00:24.161373 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-1e817896-b6a4-44a0-ba74-915a7ebeba29 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] 10.222.0.43 "GET /compute/v2.1/servers/8b2f7ab3-ae9b-4b2d-95b0-5f96f724e84a" status: 200 len: 1317 microversion: 2.1 time: 0.169746 Oct 04 23:00:24.163347 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-4c71df4f-814d-4293-a7f9-affe37539609 req-a424f00d-8a90-40df-ae2e-902fa8fa9b71 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:00:24.164035 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-4c71df4f-814d-4293-a7f9-affe37539609 req-a424f00d-8a90-40df-ae2e-902fa8fa9b71 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:00:24.164480 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-4c71df4f-814d-4293-a7f9-affe37539609 req-a424f00d-8a90-40df-ae2e-902fa8fa9b71 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:00:24.176763 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4172/7523] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:00:23 2022] GET /compute/v2.1/servers/8b2f7ab3-ae9b-4b2d-95b0-5f96f724e84a => generated 1317 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:00:24.177164 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-4c71df4f-814d-4293-a7f9-affe37539609 req-a424f00d-8a90-40df-ae2e-902fa8fa9b71 service nova] Creating event network-changed:af963006-d84d-432b-b5c4-4c3c04dc2d77 for instance 8b2f7ab3-ae9b-4b2d-95b0-5f96f724e84a on n-h1-860284-1 Oct 04 23:00:24.183058 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-4c71df4f-814d-4293-a7f9-affe37539609 req-a424f00d-8a90-40df-ae2e-902fa8fa9b71 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055531 Oct 04 23:00:24.183676 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3352/7524] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 23:00:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 23:00:25.185918 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-ff0e6577-27d4-49ce-ba71-0707218c0a58 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:00:25.186529 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-ff0e6577-27d4-49ce-ba71-0707218c0a58 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] [instance: 8b2f7ab3-ae9b-4b2d-95b0-5f96f724e84a] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:00:25.194102 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ff0e6577-27d4-49ce-ba71-0707218c0a58 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:00:25.194709 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ff0e6577-27d4-49ce-ba71-0707218c0a58 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:00:25.195163 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ff0e6577-27d4-49ce-ba71-0707218c0a58 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:00:25.195866 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ff0e6577-27d4-49ce-ba71-0707218c0a58 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:00:25.196333 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ff0e6577-27d4-49ce-ba71-0707218c0a58 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:00:25.196797 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ff0e6577-27d4-49ce-ba71-0707218c0a58 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:00:25.326170 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-ff0e6577-27d4-49ce-ba71-0707218c0a58 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2fb9b0105749a9a6604604bbc9cc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8479b202e544a785d8f165617ea33b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:00:25.334006 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-ff0e6577-27d4-49ce-ba71-0707218c0a58 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] 10.222.0.43 "GET /compute/v2.1/servers/8b2f7ab3-ae9b-4b2d-95b0-5f96f724e84a" status: 200 len: 1317 microversion: 2.1 time: 0.152303 Oct 04 23:00:25.334617 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4173/7525] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:00:25 2022] GET /compute/v2.1/servers/8b2f7ab3-ae9b-4b2d-95b0-5f96f724e84a => generated 1317 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:00:26.356834 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-4e56598a-29a2-4df4-8432-f7c553cd692a tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:00:26.357554 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-4e56598a-29a2-4df4-8432-f7c553cd692a tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] [instance: 8b2f7ab3-ae9b-4b2d-95b0-5f96f724e84a] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:00:26.364462 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4e56598a-29a2-4df4-8432-f7c553cd692a tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:00:26.364956 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4e56598a-29a2-4df4-8432-f7c553cd692a tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:00:26.365402 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4e56598a-29a2-4df4-8432-f7c553cd692a tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:00:26.366104 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4e56598a-29a2-4df4-8432-f7c553cd692a tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:00:26.366851 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4e56598a-29a2-4df4-8432-f7c553cd692a tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:00:26.367287 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4e56598a-29a2-4df4-8432-f7c553cd692a tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:00:26.833908 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-4e56598a-29a2-4df4-8432-f7c553cd692a tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2fb9b0105749a9a6604604bbc9cc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8479b202e544a785d8f165617ea33b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:00:26.841840 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-4e56598a-29a2-4df4-8432-f7c553cd692a tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] 10.222.0.43 "GET /compute/v2.1/servers/8b2f7ab3-ae9b-4b2d-95b0-5f96f724e84a" status: 200 len: 1317 microversion: 2.1 time: 0.489498 Oct 04 23:00:26.842553 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3353/7526] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:00:26 2022] GET /compute/v2.1/servers/8b2f7ab3-ae9b-4b2d-95b0-5f96f724e84a => generated 1317 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:00:27.864589 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-4d203300-c013-4dd5-8a06-fdc4cd0cf47e tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:00:27.865222 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-4d203300-c013-4dd5-8a06-fdc4cd0cf47e tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] [instance: 8b2f7ab3-ae9b-4b2d-95b0-5f96f724e84a] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:00:27.872310 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4d203300-c013-4dd5-8a06-fdc4cd0cf47e tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:00:27.872806 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4d203300-c013-4dd5-8a06-fdc4cd0cf47e tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:00:27.873256 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4d203300-c013-4dd5-8a06-fdc4cd0cf47e tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:00:27.873967 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4d203300-c013-4dd5-8a06-fdc4cd0cf47e tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:00:27.874456 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4d203300-c013-4dd5-8a06-fdc4cd0cf47e tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:00:27.874897 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4d203300-c013-4dd5-8a06-fdc4cd0cf47e tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:00:28.014093 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-4d203300-c013-4dd5-8a06-fdc4cd0cf47e tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2fb9b0105749a9a6604604bbc9cc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8479b202e544a785d8f165617ea33b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:00:28.022637 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-4d203300-c013-4dd5-8a06-fdc4cd0cf47e tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] 10.222.0.43 "GET /compute/v2.1/servers/8b2f7ab3-ae9b-4b2d-95b0-5f96f724e84a" status: 200 len: 1317 microversion: 2.1 time: 0.162053 Oct 04 23:00:28.023221 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4174/7527] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:00:27 2022] GET /compute/v2.1/servers/8b2f7ab3-ae9b-4b2d-95b0-5f96f724e84a => generated 1317 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:00:29.045710 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-fe863368-e2aa-49a1-9beb-062e002f9560 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:00:29.046345 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-fe863368-e2aa-49a1-9beb-062e002f9560 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] [instance: 8b2f7ab3-ae9b-4b2d-95b0-5f96f724e84a] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:00:29.053062 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fe863368-e2aa-49a1-9beb-062e002f9560 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:00:29.053551 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fe863368-e2aa-49a1-9beb-062e002f9560 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:00:29.053984 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fe863368-e2aa-49a1-9beb-062e002f9560 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:00:29.054726 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fe863368-e2aa-49a1-9beb-062e002f9560 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:00:29.055179 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fe863368-e2aa-49a1-9beb-062e002f9560 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:00:29.055604 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fe863368-e2aa-49a1-9beb-062e002f9560 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:00:29.185829 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-fe863368-e2aa-49a1-9beb-062e002f9560 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2fb9b0105749a9a6604604bbc9cc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8479b202e544a785d8f165617ea33b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:00:29.193624 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-fe863368-e2aa-49a1-9beb-062e002f9560 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] 10.222.0.43 "GET /compute/v2.1/servers/8b2f7ab3-ae9b-4b2d-95b0-5f96f724e84a" status: 200 len: 1317 microversion: 2.1 time: 0.151925 Oct 04 23:00:29.194197 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3354/7528] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:00:29 2022] GET /compute/v2.1/servers/8b2f7ab3-ae9b-4b2d-95b0-5f96f724e84a => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:00:29.920165 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-3fbcd271-c0f3-4bf3-9bf9-ad184f643ac5 req-4222983c-e38f-4131-8105-87a195c2a6b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b2f7ab3-ae9b-4b2d-95b0-5f96f724e84a", "name": "network-vif-plugged", "status": "completed", "tag": "af963006-d84d-432b-b5c4-4c3c04dc2d77"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 23:00:29.931748 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-3fbcd271-c0f3-4bf3-9bf9-ad184f643ac5 req-4222983c-e38f-4131-8105-87a195c2a6b1 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:00:29.932257 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-3fbcd271-c0f3-4bf3-9bf9-ad184f643ac5 req-4222983c-e38f-4131-8105-87a195c2a6b1 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:00:29.932712 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-3fbcd271-c0f3-4bf3-9bf9-ad184f643ac5 req-4222983c-e38f-4131-8105-87a195c2a6b1 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:00:29.945174 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-3fbcd271-c0f3-4bf3-9bf9-ad184f643ac5 req-4222983c-e38f-4131-8105-87a195c2a6b1 service nova] Creating event network-vif-plugged:af963006-d84d-432b-b5c4-4c3c04dc2d77 for instance 8b2f7ab3-ae9b-4b2d-95b0-5f96f724e84a on n-h1-860284-1 Oct 04 23:00:29.950147 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-3fbcd271-c0f3-4bf3-9bf9-ad184f643ac5 req-4222983c-e38f-4131-8105-87a195c2a6b1 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033856 Oct 04 23:00:29.950979 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4175/7529] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 23:00:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 23:00:30.216900 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-e7001306-9430-4104-badb-10dec34ab307 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:00:30.217521 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-e7001306-9430-4104-badb-10dec34ab307 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] [instance: 8b2f7ab3-ae9b-4b2d-95b0-5f96f724e84a] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:00:30.224837 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e7001306-9430-4104-badb-10dec34ab307 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:00:30.225317 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e7001306-9430-4104-badb-10dec34ab307 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:00:30.225750 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e7001306-9430-4104-badb-10dec34ab307 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:00:30.226492 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e7001306-9430-4104-badb-10dec34ab307 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:00:30.226944 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e7001306-9430-4104-badb-10dec34ab307 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:00:30.227378 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e7001306-9430-4104-badb-10dec34ab307 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:00:30.361234 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-e7001306-9430-4104-badb-10dec34ab307 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2fb9b0105749a9a6604604bbc9cc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8479b202e544a785d8f165617ea33b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:00:30.369190 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-e7001306-9430-4104-badb-10dec34ab307 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] 10.222.0.43 "GET /compute/v2.1/servers/8b2f7ab3-ae9b-4b2d-95b0-5f96f724e84a" status: 200 len: 1317 microversion: 2.1 time: 0.156201 Oct 04 23:00:30.369785 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3355/7530] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:00:30 2022] GET /compute/v2.1/servers/8b2f7ab3-ae9b-4b2d-95b0-5f96f724e84a => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:00:31.393261 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-91996c26-4306-4330-a93b-5f82ddbe983f tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:00:31.393976 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-91996c26-4306-4330-a93b-5f82ddbe983f tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] [instance: 8b2f7ab3-ae9b-4b2d-95b0-5f96f724e84a] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:00:31.400346 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-91996c26-4306-4330-a93b-5f82ddbe983f tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:00:31.400893 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-91996c26-4306-4330-a93b-5f82ddbe983f tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:00:31.401347 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-91996c26-4306-4330-a93b-5f82ddbe983f tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:00:31.402084 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-91996c26-4306-4330-a93b-5f82ddbe983f tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:00:31.402581 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-91996c26-4306-4330-a93b-5f82ddbe983f tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:00:31.403020 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-91996c26-4306-4330-a93b-5f82ddbe983f tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:00:31.541607 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-91996c26-4306-4330-a93b-5f82ddbe983f tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2fb9b0105749a9a6604604bbc9cc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8479b202e544a785d8f165617ea33b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:00:31.551091 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-91996c26-4306-4330-a93b-5f82ddbe983f tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] 10.222.0.43 "GET /compute/v2.1/servers/8b2f7ab3-ae9b-4b2d-95b0-5f96f724e84a" status: 200 len: 1317 microversion: 2.1 time: 0.163215 Oct 04 23:00:31.551705 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4176/7531] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:00:31 2022] GET /compute/v2.1/servers/8b2f7ab3-ae9b-4b2d-95b0-5f96f724e84a => generated 1317 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:00:32.574346 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-64329ba8-2b0b-42cc-8236-026ea4a42a10 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:00:32.574996 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-64329ba8-2b0b-42cc-8236-026ea4a42a10 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] [instance: 8b2f7ab3-ae9b-4b2d-95b0-5f96f724e84a] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:00:32.577816 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell0:SELECT=2 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:00:32.578550 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell0:SELECT=6 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:00:32.585250 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-64329ba8-2b0b-42cc-8236-026ea4a42a10 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:00:32.585748 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-64329ba8-2b0b-42cc-8236-026ea4a42a10 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:00:32.586190 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-64329ba8-2b0b-42cc-8236-026ea4a42a10 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:00:32.587078 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-64329ba8-2b0b-42cc-8236-026ea4a42a10 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:00:32.587551 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-64329ba8-2b0b-42cc-8236-026ea4a42a10 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:00:32.588032 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-64329ba8-2b0b-42cc-8236-026ea4a42a10 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:00:32.719203 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-64329ba8-2b0b-42cc-8236-026ea4a42a10 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2fb9b0105749a9a6604604bbc9cc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8479b202e544a785d8f165617ea33b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:00:32.727538 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-64329ba8-2b0b-42cc-8236-026ea4a42a10 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] 10.222.0.43 "GET /compute/v2.1/servers/8b2f7ab3-ae9b-4b2d-95b0-5f96f724e84a" status: 200 len: 1507 microversion: 2.1 time: 0.157230 Oct 04 23:00:32.728120 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3356/7532] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:00:32 2022] GET /compute/v2.1/servers/8b2f7ab3-ae9b-4b2d-95b0-5f96f724e84a => generated 1507 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:00:32.749453 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-bfa0fcc9-e7cb-4589-a567-dd8e2d9873c1 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:00:32.749952 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-bfa0fcc9-e7cb-4589-a567-dd8e2d9873c1 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] [instance: 8b2f7ab3-ae9b-4b2d-95b0-5f96f724e84a] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:00:32.752070 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=2 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:00:32.757967 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bfa0fcc9-e7cb-4589-a567-dd8e2d9873c1 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:00:32.758541 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bfa0fcc9-e7cb-4589-a567-dd8e2d9873c1 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:00:32.758978 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bfa0fcc9-e7cb-4589-a567-dd8e2d9873c1 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:00:32.759680 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bfa0fcc9-e7cb-4589-a567-dd8e2d9873c1 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:00:32.760171 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bfa0fcc9-e7cb-4589-a567-dd8e2d9873c1 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:00:32.760609 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bfa0fcc9-e7cb-4589-a567-dd8e2d9873c1 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:00:32.786587 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-bfa0fcc9-e7cb-4589-a567-dd8e2d9873c1 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] [instance: 8b2f7ab3-ae9b-4b2d-95b0-5f96f724e84a] Going to try to terminate instance {{(pid=134101) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 23:00:32.862314 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-bfa0fcc9-e7cb-4589-a567-dd8e2d9873c1 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] 10.222.0.43 "DELETE /compute/v2.1/servers/8b2f7ab3-ae9b-4b2d-95b0-5f96f724e84a" status: 204 len: 0 microversion: 2.1 time: 0.115558 Oct 04 23:00:32.863281 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4177/7533] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 23:00:32 2022] DELETE /compute/v2.1/servers/8b2f7ab3-ae9b-4b2d-95b0-5f96f724e84a => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 23:00:32.871419 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-9ef35526-bdd5-4673-9161-1f6536a13ec2 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:00:32.872031 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-9ef35526-bdd5-4673-9161-1f6536a13ec2 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] [instance: 8b2f7ab3-ae9b-4b2d-95b0-5f96f724e84a] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:00:32.878007 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9ef35526-bdd5-4673-9161-1f6536a13ec2 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:00:32.878530 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9ef35526-bdd5-4673-9161-1f6536a13ec2 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:00:32.878968 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9ef35526-bdd5-4673-9161-1f6536a13ec2 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:00:32.879659 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9ef35526-bdd5-4673-9161-1f6536a13ec2 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:00:32.880149 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9ef35526-bdd5-4673-9161-1f6536a13ec2 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:00:32.880560 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9ef35526-bdd5-4673-9161-1f6536a13ec2 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:00:33.012032 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-9ef35526-bdd5-4673-9161-1f6536a13ec2 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2fb9b0105749a9a6604604bbc9cc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8479b202e544a785d8f165617ea33b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:00:33.020397 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-9ef35526-bdd5-4673-9161-1f6536a13ec2 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] 10.222.0.43 "GET /compute/v2.1/servers/8b2f7ab3-ae9b-4b2d-95b0-5f96f724e84a" status: 200 len: 1513 microversion: 2.1 time: 0.152861 Oct 04 23:00:33.020972 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3357/7534] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:00:32 2022] GET /compute/v2.1/servers/8b2f7ab3-ae9b-4b2d-95b0-5f96f724e84a => generated 1513 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:00:34.043988 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e20e56f9-84a3-4ccd-bbfa-e643dae006a5 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:00:34.044713 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-e20e56f9-84a3-4ccd-bbfa-e643dae006a5 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] [instance: 8b2f7ab3-ae9b-4b2d-95b0-5f96f724e84a] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:00:34.052306 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e20e56f9-84a3-4ccd-bbfa-e643dae006a5 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:00:34.052814 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e20e56f9-84a3-4ccd-bbfa-e643dae006a5 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:00:34.053274 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e20e56f9-84a3-4ccd-bbfa-e643dae006a5 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:00:34.054007 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e20e56f9-84a3-4ccd-bbfa-e643dae006a5 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:00:34.054510 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e20e56f9-84a3-4ccd-bbfa-e643dae006a5 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:00:34.054960 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e20e56f9-84a3-4ccd-bbfa-e643dae006a5 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:00:34.190794 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-e20e56f9-84a3-4ccd-bbfa-e643dae006a5 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2fb9b0105749a9a6604604bbc9cc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8479b202e544a785d8f165617ea33b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:00:34.198661 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-e20e56f9-84a3-4ccd-bbfa-e643dae006a5 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] 10.222.0.43 "GET /compute/v2.1/servers/8b2f7ab3-ae9b-4b2d-95b0-5f96f724e84a" status: 200 len: 1513 microversion: 2.1 time: 0.159060 Oct 04 23:00:34.199525 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4178/7535] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:00:34 2022] GET /compute/v2.1/servers/8b2f7ab3-ae9b-4b2d-95b0-5f96f724e84a => generated 1513 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:00:34.780014 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-38aaf531-dd15-4ffc-964a-528714756e63 req-ee43b1fb-34ad-4b36-bf7f-4a36178c53e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b2f7ab3-ae9b-4b2d-95b0-5f96f724e84a", "name": "network-vif-deleted", "tag": "af963006-d84d-432b-b5c4-4c3c04dc2d77"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 23:00:34.792386 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-38aaf531-dd15-4ffc-964a-528714756e63 req-ee43b1fb-34ad-4b36-bf7f-4a36178c53e4 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:00:34.793188 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-38aaf531-dd15-4ffc-964a-528714756e63 req-ee43b1fb-34ad-4b36-bf7f-4a36178c53e4 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:00:34.793632 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-38aaf531-dd15-4ffc-964a-528714756e63 req-ee43b1fb-34ad-4b36-bf7f-4a36178c53e4 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:00:34.808757 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-38aaf531-dd15-4ffc-964a-528714756e63 req-ee43b1fb-34ad-4b36-bf7f-4a36178c53e4 service nova] Creating event network-vif-deleted:af963006-d84d-432b-b5c4-4c3c04dc2d77 for instance 8b2f7ab3-ae9b-4b2d-95b0-5f96f724e84a on n-h1-860284-1 Oct 04 23:00:34.818323 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-38aaf531-dd15-4ffc-964a-528714756e63 req-ee43b1fb-34ad-4b36-bf7f-4a36178c53e4 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043539 Oct 04 23:00:34.819007 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3358/7536] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 23:00:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 23:00:35.224708 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e8903120-4d0f-4872-976d-e4574dff3d7e tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:00:35.225476 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-e8903120-4d0f-4872-976d-e4574dff3d7e tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] [instance: 8b2f7ab3-ae9b-4b2d-95b0-5f96f724e84a] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:00:35.234203 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e8903120-4d0f-4872-976d-e4574dff3d7e tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:00:35.234762 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e8903120-4d0f-4872-976d-e4574dff3d7e tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:00:35.235221 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e8903120-4d0f-4872-976d-e4574dff3d7e tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:00:35.236645 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e8903120-4d0f-4872-976d-e4574dff3d7e tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:00:35.237117 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e8903120-4d0f-4872-976d-e4574dff3d7e tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:00:35.237556 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e8903120-4d0f-4872-976d-e4574dff3d7e tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:00:35.271777 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e8903120-4d0f-4872-976d-e4574dff3d7e tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:00:35.272276 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e8903120-4d0f-4872-976d-e4574dff3d7e tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:00:35.272725 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e8903120-4d0f-4872-976d-e4574dff3d7e tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:00:35.273186 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.objects.instance [None req-e8903120-4d0f-4872-976d-e4574dff3d7e tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Lazy-loading 'fault' on Instance uuid 8b2f7ab3-ae9b-4b2d-95b0-5f96f724e84a {{(pid=134101) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 23:00:35.315999 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-e8903120-4d0f-4872-976d-e4574dff3d7e tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2fb9b0105749a9a6604604bbc9cc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8479b202e544a785d8f165617ea33b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:00:35.323387 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-e8903120-4d0f-4872-976d-e4574dff3d7e tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] 10.222.0.43 "GET /compute/v2.1/servers/8b2f7ab3-ae9b-4b2d-95b0-5f96f724e84a" status: 200 len: 1307 microversion: 2.1 time: 0.105258 Oct 04 23:00:35.324246 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4179/7537] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:00:35 2022] GET /compute/v2.1/servers/8b2f7ab3-ae9b-4b2d-95b0-5f96f724e84a => generated 1307 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:00:36.349113 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-f45686f0-3288-4014-82ea-2d11a4477935 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:00:36.349823 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-f45686f0-3288-4014-82ea-2d11a4477935 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] [instance: 8b2f7ab3-ae9b-4b2d-95b0-5f96f724e84a] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:00:36.356041 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f45686f0-3288-4014-82ea-2d11a4477935 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:00:36.356522 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f45686f0-3288-4014-82ea-2d11a4477935 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:00:36.356958 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f45686f0-3288-4014-82ea-2d11a4477935 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:00:36.357647 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f45686f0-3288-4014-82ea-2d11a4477935 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:00:36.358100 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f45686f0-3288-4014-82ea-2d11a4477935 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:00:36.358560 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f45686f0-3288-4014-82ea-2d11a4477935 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:00:36.372509 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-f45686f0-3288-4014-82ea-2d11a4477935 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] HTTP exception thrown: Instance 8b2f7ab3-ae9b-4b2d-95b0-5f96f724e84a could not be found. Oct 04 23:00:36.374147 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-f45686f0-3288-4014-82ea-2d11a4477935 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Request method failure captured: Oct 04 23:00:36.374147 n-d-860284-1 devstack@n-api.service[134102]: request: GET /compute/v2.1/servers/8b2f7ab3-ae9b-4b2d-95b0-5f96f724e84a HTTP/1.1 Oct 04 23:00:36.374147 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 23:00:36.374147 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 23:00:36.374147 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 23:00:36.374147 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 23:00:36.374147 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 23:00:36.374147 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 23:00:36.374147 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 23:00:36.374147 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 23:00:36.374147 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPLr3YFV3g-YeAqk0Jgg4aDwl7AI8QX1A2k7Trm2Uie58d-bW3CxvINs1KSKIPdIvgAdsFUs2X5cJyB_TkJUal4QaCYK9gvdzpjAAMz1ZmFTZfjEtL3pGfkvL-u3cNWZ-cvhoUP7a43dT0bBnlrFCxCxocXhrBw7Xco_xY9lMzR5Oags Oct 04 23:00:36.374147 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 23:00:36.374147 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 23:00:36.374147 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 23:00:36.374147 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 23:00:36.374147 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 23:00:36.374147 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 23:00:36.374147 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: bf8479b202e544a785d8f165617ea33b Oct 04 23:00:36.374147 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-ServersNegativeTestJSON-1159761747 Oct 04 23:00:36.374147 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 23:00:36.374147 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 23:00:36.374147 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/bf8479b202e544a785d8f165617ea33b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_bf8479b202e544a785d8f165617ea33b", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/bf8479b202e544a785d8f165617ea33b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/bf8479b202e544a785d8f165617ea33b"}]}] Oct 04 23:00:36.374147 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-ServersNegativeTestJSON-1159761747 Oct 04 23:00:36.374147 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: bf8479b202e544a785d8f165617ea33b Oct 04 23:00:36.374147 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1159761747 Oct 04 23:00:36.374147 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-ServersNegativeTestJSON-1159761747-project Oct 04 23:00:36.374147 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 23:00:36.374147 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 23:00:36.374147 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: 7f2fb9b0105749a9a6604604bbc9cc14 Oct 04 23:00:36.374147 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-ServersNegativeTestJSON-1159761747-project Oct 04 23:00:36.374147 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 23:00:36.374147 n-d-860284-1 devstack@n-api.service[134102]: exception: Instance 8b2f7ab3-ae9b-4b2d-95b0-5f96f724e84a could not be found. Oct 04 23:00:36.374147 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': '8b2f7ab3-ae9b-4b2d-95b0-5f96f724e84a'} Oct 04 23:00:36.374147 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 23:00:36.374147 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 23:00:36.374147 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 23:00:36.374147 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 23:00:36.374147 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 23:00:36.374147 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 23:00:36.374147 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 23:00:36.374147 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 23:00:36.374147 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 23:00:36.374147 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 23:00:36.374147 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b2f7ab3-ae9b-4b2d-95b0-5f96f724e84a could not be found. Oct 04 23:00:36.374147 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 23:00:36.374147 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 23:00:36.374147 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 23:00:36.374147 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 23:00:36.374147 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 23:00:36.374147 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 23:00:36.374147 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 23:00:36.374147 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 23:00:36.374147 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 23:00:36.374147 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 23:00:36.374147 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 23:00:36.374147 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 23:00:36.374147 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 23:00:36.374147 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 23:00:36.374147 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 23:00:36.374147 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 23:00:36.374147 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b2f7ab3-ae9b-4b2d-95b0-5f96f724e84a could not be found. Oct 04 23:00:36.374147 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 23:00:36.374147 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 23:00:36.374147 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 23:00:36.379719 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 23:00:36.379719 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 23:00:36.379719 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 23:00:36.379719 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 23:00:36.379719 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 23:00:36.379719 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b2f7ab3-ae9b-4b2d-95b0-5f96f724e84a could not be found. Oct 04 23:00:36.379719 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 23:00:36.379719 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-f45686f0-3288-4014-82ea-2d11a4477935 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Returning 404 to user: Instance 8b2f7ab3-ae9b-4b2d-95b0-5f96f724e84a could not be found. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 23:00:36.379719 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-f45686f0-3288-4014-82ea-2d11a4477935 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] 10.222.0.43 "GET /compute/v2.1/servers/8b2f7ab3-ae9b-4b2d-95b0-5f96f724e84a" status: 404 len: 111 microversion: 2.1 time: 0.031786 Oct 04 23:00:36.379719 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3359/7538] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:00:36 2022] GET /compute/v2.1/servers/8b2f7ab3-ae9b-4b2d-95b0-5f96f724e84a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 23:00:36.385886 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-fb0638a9-548c-466c-bcc8-47565943da35 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:00:36.386498 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-fb0638a9-548c-466c-bcc8-47565943da35 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] [instance: 7ce6bf89-64b9-4f13-8114-2c4e8144b308] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:00:36.393330 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fb0638a9-548c-466c-bcc8-47565943da35 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:00:36.393829 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fb0638a9-548c-466c-bcc8-47565943da35 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:00:36.394284 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fb0638a9-548c-466c-bcc8-47565943da35 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:00:36.395028 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fb0638a9-548c-466c-bcc8-47565943da35 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:00:36.395500 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fb0638a9-548c-466c-bcc8-47565943da35 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:00:36.395944 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fb0638a9-548c-466c-bcc8-47565943da35 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:00:36.525023 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-fb0638a9-548c-466c-bcc8-47565943da35 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2fb9b0105749a9a6604604bbc9cc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8479b202e544a785d8f165617ea33b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:00:36.533102 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-fb0638a9-548c-466c-bcc8-47565943da35 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] 10.222.0.43 "GET /compute/v2.1/servers/7ce6bf89-64b9-4f13-8114-2c4e8144b308" status: 200 len: 1507 microversion: 2.1 time: 0.151230 Oct 04 23:00:36.533691 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4180/7539] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:00:36 2022] GET /compute/v2.1/servers/7ce6bf89-64b9-4f13-8114-2c4e8144b308 => generated 1507 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:00:36.555692 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-f912fe32-d798-4686-a0a9-42ba65f83421 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 23:00:36.557965 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-f912fe32-d798-4686-a0a9-42ba65f83421 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] [instance: fdfab43c-67e8-4979-bc3b-9e26e1d0eb18] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:00:36.564067 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-f912fe32-d798-4686-a0a9-42ba65f83421 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] HTTP exception thrown: Instance fdfab43c-67e8-4979-bc3b-9e26e1d0eb18 could not be found. Oct 04 23:00:36.565756 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-f912fe32-d798-4686-a0a9-42ba65f83421 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Request method failure captured: Oct 04 23:00:36.565756 n-d-860284-1 devstack@n-api.service[134102]: request: POST /compute/v2.1/servers/fdfab43c-67e8-4979-bc3b-9e26e1d0eb18/action HTTP/1.1 Oct 04 23:00:36.565756 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 23:00:36.565756 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 23:00:36.565756 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 23:00:36.565756 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 32 Oct 04 23:00:36.565756 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 23:00:36.565756 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 23:00:36.565756 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 23:00:36.565756 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 23:00:36.565756 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPLr3YFV3g-YeAqk0Jgg4aDwl7AI8QX1A2k7Trm2Uie58d-bW3CxvINs1KSKIPdIvgAdsFUs2X5cJyB_TkJUal4QaCYK9gvdzpjAAMz1ZmFTZfjEtL3pGfkvL-u3cNWZ-cvhoUP7a43dT0bBnlrFCxCxocXhrBw7Xco_xY9lMzR5Oags Oct 04 23:00:36.565756 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 23:00:36.565756 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 23:00:36.565756 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 23:00:36.565756 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 23:00:36.565756 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 23:00:36.565756 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 23:00:36.565756 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: bf8479b202e544a785d8f165617ea33b Oct 04 23:00:36.565756 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-ServersNegativeTestJSON-1159761747 Oct 04 23:00:36.565756 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 23:00:36.565756 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 23:00:36.565756 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/bf8479b202e544a785d8f165617ea33b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_bf8479b202e544a785d8f165617ea33b", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/bf8479b202e544a785d8f165617ea33b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/bf8479b202e544a785d8f165617ea33b"}]}] Oct 04 23:00:36.565756 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-ServersNegativeTestJSON-1159761747 Oct 04 23:00:36.565756 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: bf8479b202e544a785d8f165617ea33b Oct 04 23:00:36.565756 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1159761747 Oct 04 23:00:36.565756 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-ServersNegativeTestJSON-1159761747-project Oct 04 23:00:36.565756 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 23:00:36.565756 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 23:00:36.565756 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: 7f2fb9b0105749a9a6604604bbc9cc14 Oct 04 23:00:36.565756 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-ServersNegativeTestJSON-1159761747-project Oct 04 23:00:36.565756 n-d-860284-1 devstack@n-api.service[134102]: Oct 04 23:00:36.565756 n-d-860284-1 devstack@n-api.service[134102]: {"resize": {"flavorRef": "452"}} Oct 04 23:00:36.565756 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 23:00:36.565756 n-d-860284-1 devstack@n-api.service[134102]: exception: Instance fdfab43c-67e8-4979-bc3b-9e26e1d0eb18 could not be found. Oct 04 23:00:36.565756 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': 'fdfab43c-67e8-4979-bc3b-9e26e1d0eb18', 'body': {'resize': {'flavorRef': '452'}}} Oct 04 23:00:36.565756 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 23:00:36.565756 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 23:00:36.565756 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 23:00:36.565756 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 23:00:36.565756 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 23:00:36.565756 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 23:00:36.565756 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 23:00:36.565756 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 23:00:36.565756 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fdfab43c-67e8-4979-bc3b-9e26e1d0eb18 could not be found. Oct 04 23:00:36.565756 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 23:00:36.565756 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 23:00:36.565756 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 23:00:36.565756 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 23:00:36.565756 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 23:00:36.565756 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 23:00:36.565756 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 23:00:36.565756 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 23:00:36.565756 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 23:00:36.565756 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 23:00:36.565756 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 23:00:36.565756 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 23:00:36.565756 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 04 23:00:36.565756 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 04 23:00:36.565756 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1046, in _resize Oct 04 23:00:36.565756 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_id, Oct 04 23:00:36.565756 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 23:00:36.565756 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 23:00:36.565756 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 23:00:36.565756 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 23:00:36.570178 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fdfab43c-67e8-4979-bc3b-9e26e1d0eb18 could not be found. Oct 04 23:00:36.570178 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 23:00:36.570178 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 23:00:36.570178 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 23:00:36.570178 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 23:00:36.570178 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 23:00:36.570178 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 23:00:36.570178 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 23:00:36.570178 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 23:00:36.570178 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fdfab43c-67e8-4979-bc3b-9e26e1d0eb18 could not be found. Oct 04 23:00:36.570178 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 23:00:36.570178 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-f912fe32-d798-4686-a0a9-42ba65f83421 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Returning 404 to user: Instance fdfab43c-67e8-4979-bc3b-9e26e1d0eb18 could not be found. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 23:00:36.570178 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-f912fe32-d798-4686-a0a9-42ba65f83421 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] 10.222.0.43 "POST /compute/v2.1/servers/fdfab43c-67e8-4979-bc3b-9e26e1d0eb18/action" status: 404 len: 111 microversion: 2.1 time: 0.015459 Oct 04 23:00:36.570178 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3360/7540] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 23:00:36 2022] POST /compute/v2.1/servers/fdfab43c-67e8-4979-bc3b-9e26e1d0eb18/action => generated 111 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 23:00:36.575569 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-76bb7b69-1981-4a7a-af77-27eb33a56a01 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:00:36.576199 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-76bb7b69-1981-4a7a-af77-27eb33a56a01 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] [instance: 7ce6bf89-64b9-4f13-8114-2c4e8144b308] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:00:36.582494 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-76bb7b69-1981-4a7a-af77-27eb33a56a01 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:00:36.582997 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-76bb7b69-1981-4a7a-af77-27eb33a56a01 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:00:36.583452 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-76bb7b69-1981-4a7a-af77-27eb33a56a01 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:00:36.584161 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-76bb7b69-1981-4a7a-af77-27eb33a56a01 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:00:36.584636 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-76bb7b69-1981-4a7a-af77-27eb33a56a01 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:00:36.585080 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-76bb7b69-1981-4a7a-af77-27eb33a56a01 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:00:36.721370 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-76bb7b69-1981-4a7a-af77-27eb33a56a01 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2fb9b0105749a9a6604604bbc9cc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8479b202e544a785d8f165617ea33b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:00:36.724962 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:00:36.730343 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-76bb7b69-1981-4a7a-af77-27eb33a56a01 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] 10.222.0.43 "GET /compute/v2.1/servers/7ce6bf89-64b9-4f13-8114-2c4e8144b308" status: 200 len: 1507 microversion: 2.1 time: 0.158574 Oct 04 23:00:36.730946 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4181/7541] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:00:36 2022] GET /compute/v2.1/servers/7ce6bf89-64b9-4f13-8114-2c4e8144b308 => generated 1507 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 23:00:36.754223 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-fe275164-0a97-4ccb-a910-c4271b5b0d46 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:00:36.754906 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-fe275164-0a97-4ccb-a910-c4271b5b0d46 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] [instance: 7ce6bf89-64b9-4f13-8114-2c4e8144b308] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:00:36.761724 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fe275164-0a97-4ccb-a910-c4271b5b0d46 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:00:36.762212 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fe275164-0a97-4ccb-a910-c4271b5b0d46 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:00:36.762691 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fe275164-0a97-4ccb-a910-c4271b5b0d46 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:00:36.763393 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fe275164-0a97-4ccb-a910-c4271b5b0d46 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:00:36.763854 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fe275164-0a97-4ccb-a910-c4271b5b0d46 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:00:36.764290 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fe275164-0a97-4ccb-a910-c4271b5b0d46 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:00:36.898813 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-fe275164-0a97-4ccb-a910-c4271b5b0d46 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2fb9b0105749a9a6604604bbc9cc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8479b202e544a785d8f165617ea33b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:00:36.906793 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-fe275164-0a97-4ccb-a910-c4271b5b0d46 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] 10.222.0.43 "GET /compute/v2.1/servers/7ce6bf89-64b9-4f13-8114-2c4e8144b308" status: 200 len: 1507 microversion: 2.1 time: 0.156709 Oct 04 23:00:36.907901 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3361/7542] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:00:36 2022] GET /compute/v2.1/servers/7ce6bf89-64b9-4f13-8114-2c4e8144b308 => generated 1507 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:00:36.931437 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-9171c2dc-492f-4a17-adc5-8a8bf8243194 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "f48fb129-44cd-4dc3-b0e5-353d6fb4b4b3"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 23:00:36.933670 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-9171c2dc-492f-4a17-adc5-8a8bf8243194 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] [instance: 7ce6bf89-64b9-4f13-8114-2c4e8144b308] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:00:36.940812 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9171c2dc-492f-4a17-adc5-8a8bf8243194 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:00:36.941312 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9171c2dc-492f-4a17-adc5-8a8bf8243194 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:00:36.941769 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9171c2dc-492f-4a17-adc5-8a8bf8243194 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:00:36.942499 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9171c2dc-492f-4a17-adc5-8a8bf8243194 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:00:36.942968 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9171c2dc-492f-4a17-adc5-8a8bf8243194 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:00:36.943412 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9171c2dc-492f-4a17-adc5-8a8bf8243194 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:00:36.974579 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-9171c2dc-492f-4a17-adc5-8a8bf8243194 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '7f2fb9b0105749a9a6604604bbc9cc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8479b202e544a785d8f165617ea33b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:00:36.979360 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-9171c2dc-492f-4a17-adc5-8a8bf8243194 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] HTTP exception thrown: Flavor f48fb129-44cd-4dc3-b0e5-353d6fb4b4b3 could not be found. Oct 04 23:00:36.991590 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-9171c2dc-492f-4a17-adc5-8a8bf8243194 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Request method failure captured: Oct 04 23:00:36.991590 n-d-860284-1 devstack@n-api.service[134101]: request: POST /compute/v2.1/servers/7ce6bf89-64b9-4f13-8114-2c4e8144b308/action HTTP/1.1 Oct 04 23:00:36.991590 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 23:00:36.991590 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 23:00:36.991590 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 23:00:36.991590 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 65 Oct 04 23:00:36.991590 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 23:00:36.991590 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 23:00:36.991590 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 23:00:36.991590 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 23:00:36.991590 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPLr3YFV3g-YeAqk0Jgg4aDwl7AI8QX1A2k7Trm2Uie58d-bW3CxvINs1KSKIPdIvgAdsFUs2X5cJyB_TkJUal4QaCYK9gvdzpjAAMz1ZmFTZfjEtL3pGfkvL-u3cNWZ-cvhoUP7a43dT0bBnlrFCxCxocXhrBw7Xco_xY9lMzR5Oags Oct 04 23:00:36.991590 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 23:00:36.991590 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 23:00:36.991590 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 23:00:36.991590 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 23:00:36.991590 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 23:00:36.991590 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 23:00:36.991590 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: bf8479b202e544a785d8f165617ea33b Oct 04 23:00:36.991590 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-ServersNegativeTestJSON-1159761747 Oct 04 23:00:36.991590 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 23:00:36.991590 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 23:00:36.991590 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/bf8479b202e544a785d8f165617ea33b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_bf8479b202e544a785d8f165617ea33b", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/bf8479b202e544a785d8f165617ea33b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/bf8479b202e544a785d8f165617ea33b"}]}] Oct 04 23:00:36.991590 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-ServersNegativeTestJSON-1159761747 Oct 04 23:00:36.991590 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: bf8479b202e544a785d8f165617ea33b Oct 04 23:00:36.991590 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1159761747 Oct 04 23:00:36.991590 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-ServersNegativeTestJSON-1159761747-project Oct 04 23:00:36.991590 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 23:00:36.991590 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 23:00:36.991590 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 7f2fb9b0105749a9a6604604bbc9cc14 Oct 04 23:00:36.991590 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-ServersNegativeTestJSON-1159761747-project Oct 04 23:00:36.991590 n-d-860284-1 devstack@n-api.service[134101]: Oct 04 23:00:36.991590 n-d-860284-1 devstack@n-api.service[134101]: {"resize": {"flavorRef": "f48fb129-44cd-4dc3-b0e5-353d6fb4b4b3"}} Oct 04 23:00:36.991590 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 23:00:36.991590 n-d-860284-1 devstack@n-api.service[134101]: exception: Flavor f48fb129-44cd-4dc3-b0e5-353d6fb4b4b3 could not be found. Oct 04 23:00:36.991590 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': '7ce6bf89-64b9-4f13-8114-2c4e8144b308', 'body': {'resize': {'flavorRef': 'f48fb129-44cd-4dc3-b0e5-353d6fb4b4b3'}}} Oct 04 23:00:36.991590 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 23:00:36.991590 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 23:00:36.991590 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 04 23:00:36.991590 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 04 23:00:36.991590 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 04 23:00:36.991590 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 23:00:36.991590 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 04 23:00:36.991590 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 23:00:36.991590 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 04 23:00:36.991590 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 23:00:36.991590 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 23:00:36.991590 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 23:00:36.991590 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 04 23:00:36.991590 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 23:00:36.991590 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 04 23:00:36.991590 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 23:00:36.991590 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4200, in resize Oct 04 23:00:36.991590 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi new_flavor = flavors.get_flavor_by_flavor_id( Oct 04 23:00:36.991590 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 04 23:00:36.991590 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 04 23:00:36.991590 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 23:00:36.991590 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 23:00:36.991590 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 04 23:00:36.991590 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 04 23:00:36.991590 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 04 23:00:36.991590 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 23:00:36.991590 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 04 23:00:36.996232 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 04 23:00:36.996232 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor f48fb129-44cd-4dc3-b0e5-353d6fb4b4b3 could not be found. Oct 04 23:00:36.996232 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 23:00:36.996232 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 23:00:36.996232 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 23:00:36.996232 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 23:00:36.996232 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 23:00:36.996232 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 23:00:36.996232 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 23:00:36.996232 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 23:00:36.996232 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 23:00:36.996232 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 23:00:36.996232 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 23:00:36.996232 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 23:00:36.996232 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 04 23:00:36.996232 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 04 23:00:36.996232 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1083, in _resize Oct 04 23:00:36.996232 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 04 23:00:36.996232 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor f48fb129-44cd-4dc3-b0e5-353d6fb4b4b3 could not be found. Oct 04 23:00:36.996232 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 23:00:36.996232 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 23:00:36.996232 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 23:00:36.996232 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 23:00:36.996232 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 23:00:36.996232 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 23:00:36.996232 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 23:00:36.996232 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 23:00:36.996232 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor f48fb129-44cd-4dc3-b0e5-353d6fb4b4b3 could not be found. Oct 04 23:00:36.996232 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 23:00:36.996232 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-9171c2dc-492f-4a17-adc5-8a8bf8243194 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Returning 400 to user: Flavor f48fb129-44cd-4dc3-b0e5-353d6fb4b4b3 could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 23:00:36.996232 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-9171c2dc-492f-4a17-adc5-8a8bf8243194 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] 10.222.0.43 "POST /compute/v2.1/servers/7ce6bf89-64b9-4f13-8114-2c4e8144b308/action" status: 400 len: 107 microversion: 2.1 time: 0.066366 Oct 04 23:00:36.996232 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4182/7543] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 23:00:36 2022] POST /compute/v2.1/servers/7ce6bf89-64b9-4f13-8114-2c4e8144b308/action => generated 107 bytes in 67 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 04 23:00:37.002282 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-536de2bc-6c2e-4edc-89c7-11316df119d1 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:00:37.002927 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-536de2bc-6c2e-4edc-89c7-11316df119d1 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] [instance: 7ce6bf89-64b9-4f13-8114-2c4e8144b308] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:00:37.008854 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-536de2bc-6c2e-4edc-89c7-11316df119d1 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:00:37.009333 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-536de2bc-6c2e-4edc-89c7-11316df119d1 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:00:37.009767 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-536de2bc-6c2e-4edc-89c7-11316df119d1 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:00:37.010485 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-536de2bc-6c2e-4edc-89c7-11316df119d1 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:00:37.010942 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-536de2bc-6c2e-4edc-89c7-11316df119d1 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:00:37.011376 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-536de2bc-6c2e-4edc-89c7-11316df119d1 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:00:37.140882 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-536de2bc-6c2e-4edc-89c7-11316df119d1 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2fb9b0105749a9a6604604bbc9cc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8479b202e544a785d8f165617ea33b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:00:37.149261 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-536de2bc-6c2e-4edc-89c7-11316df119d1 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] 10.222.0.43 "GET /compute/v2.1/servers/7ce6bf89-64b9-4f13-8114-2c4e8144b308" status: 200 len: 1507 microversion: 2.1 time: 0.151228 Oct 04 23:00:37.149836 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3362/7544] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:00:36 2022] GET /compute/v2.1/servers/7ce6bf89-64b9-4f13-8114-2c4e8144b308 => generated 1507 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:00:37.172590 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-cae8f0a7-6697-4873-938d-0eb72e94669f tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:00:37.173460 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-cae8f0a7-6697-4873-938d-0eb72e94669f tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] [instance: 7ce6bf89-64b9-4f13-8114-2c4e8144b308] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:00:37.179397 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cae8f0a7-6697-4873-938d-0eb72e94669f tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:00:37.179900 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cae8f0a7-6697-4873-938d-0eb72e94669f tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:00:37.180356 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cae8f0a7-6697-4873-938d-0eb72e94669f tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:00:37.181066 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cae8f0a7-6697-4873-938d-0eb72e94669f tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:00:37.181591 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cae8f0a7-6697-4873-938d-0eb72e94669f tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:00:37.181984 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cae8f0a7-6697-4873-938d-0eb72e94669f tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:00:37.312952 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-cae8f0a7-6697-4873-938d-0eb72e94669f tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2fb9b0105749a9a6604604bbc9cc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8479b202e544a785d8f165617ea33b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:00:37.320830 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-cae8f0a7-6697-4873-938d-0eb72e94669f tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] 10.222.0.43 "GET /compute/v2.1/servers/7ce6bf89-64b9-4f13-8114-2c4e8144b308" status: 200 len: 1507 microversion: 2.1 time: 0.152105 Oct 04 23:00:37.321407 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4183/7545] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:00:37 2022] GET /compute/v2.1/servers/7ce6bf89-64b9-4f13-8114-2c4e8144b308 => generated 1507 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:00:37.343464 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-dc9c542a-eb3c-4e6b-a619-6b79df6d7af1 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 23:00:37.347712 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-dc9c542a-eb3c-4e6b-a619-6b79df6d7af1 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Request method failure captured: Oct 04 23:00:37.347712 n-d-860284-1 devstack@n-api.service[134102]: request: POST /compute/v2.1/servers/7ce6bf89-64b9-4f13-8114-2c4e8144b308/action HTTP/1.1 Oct 04 23:00:37.347712 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 23:00:37.347712 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 23:00:37.347712 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 23:00:37.347712 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 29 Oct 04 23:00:37.347712 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 23:00:37.347712 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 23:00:37.347712 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 23:00:37.347712 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 23:00:37.347712 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPLr3YFV3g-YeAqk0Jgg4aDwl7AI8QX1A2k7Trm2Uie58d-bW3CxvINs1KSKIPdIvgAdsFUs2X5cJyB_TkJUal4QaCYK9gvdzpjAAMz1ZmFTZfjEtL3pGfkvL-u3cNWZ-cvhoUP7a43dT0bBnlrFCxCxocXhrBw7Xco_xY9lMzR5Oags Oct 04 23:00:37.347712 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 23:00:37.347712 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 23:00:37.347712 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 23:00:37.347712 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 23:00:37.347712 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 23:00:37.347712 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 23:00:37.347712 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: bf8479b202e544a785d8f165617ea33b Oct 04 23:00:37.347712 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-ServersNegativeTestJSON-1159761747 Oct 04 23:00:37.347712 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 23:00:37.347712 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 23:00:37.347712 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/bf8479b202e544a785d8f165617ea33b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_bf8479b202e544a785d8f165617ea33b", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/bf8479b202e544a785d8f165617ea33b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/bf8479b202e544a785d8f165617ea33b"}]}] Oct 04 23:00:37.347712 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-ServersNegativeTestJSON-1159761747 Oct 04 23:00:37.347712 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: bf8479b202e544a785d8f165617ea33b Oct 04 23:00:37.347712 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1159761747 Oct 04 23:00:37.347712 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-ServersNegativeTestJSON-1159761747-project Oct 04 23:00:37.347712 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 23:00:37.347712 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 23:00:37.347712 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: 7f2fb9b0105749a9a6604604bbc9cc14 Oct 04 23:00:37.347712 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-ServersNegativeTestJSON-1159761747-project Oct 04 23:00:37.347712 n-d-860284-1 devstack@n-api.service[134102]: Oct 04 23:00:37.347712 n-d-860284-1 devstack@n-api.service[134102]: {"resize": {"flavorRef": ""}} Oct 04 23:00:37.347712 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 23:00:37.347712 n-d-860284-1 devstack@n-api.service[134102]: exception: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 04 23:00:37.347712 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': '7ce6bf89-64b9-4f13-8114-2c4e8144b308', 'body': {'resize': {'flavorRef': ''}}} Oct 04 23:00:37.347712 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 23:00:37.347712 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 23:00:37.347712 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 23:00:37.347712 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 23:00:37.347712 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 23:00:37.347712 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise error Oct 04 23:00:37.347712 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 04 23:00:37.347712 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 23:00:37.347712 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['resize']['properties']['flavorRef']: Oct 04 23:00:37.347712 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi {'minLength': 1, 'type': ['string', 'integer']} Oct 04 23:00:37.347712 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 23:00:37.347712 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi On instance['resize']: Oct 04 23:00:37.347712 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi '' Oct 04 23:00:37.347712 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 23:00:37.347712 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 23:00:37.347712 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 23:00:37.347712 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 23:00:37.347712 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 23:00:37.347712 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 23:00:37.347712 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 23:00:37.347712 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 23:00:37.347712 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 23:00:37.347712 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 23:00:37.347712 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 23:00:37.347712 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 23:00:37.347712 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 23:00:37.347712 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 23:00:37.347712 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 23:00:37.347712 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 23:00:37.347712 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 04 23:00:37.347712 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 23:00:37.347712 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 23:00:37.353609 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 23:00:37.353609 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 23:00:37.353609 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 23:00:37.353609 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 23:00:37.353609 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 23:00:37.353609 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 23:00:37.353609 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 04 23:00:37.353609 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 23:00:37.353609 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-dc9c542a-eb3c-4e6b-a619-6b79df6d7af1 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 23:00:37.353609 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-dc9c542a-eb3c-4e6b-a619-6b79df6d7af1 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] 10.222.0.43 "POST /compute/v2.1/servers/7ce6bf89-64b9-4f13-8114-2c4e8144b308/action" status: 400 len: 113 microversion: 2.1 time: 0.009784 Oct 04 23:00:37.353609 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3363/7546] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 23:00:37 2022] POST /compute/v2.1/servers/7ce6bf89-64b9-4f13-8114-2c4e8144b308/action => generated 113 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 04 23:00:37.357661 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-44a1f662-122e-407f-8aa2-cfcb55cf242a tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:00:37.358337 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-44a1f662-122e-407f-8aa2-cfcb55cf242a tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] [instance: 7ce6bf89-64b9-4f13-8114-2c4e8144b308] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:00:37.364526 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-44a1f662-122e-407f-8aa2-cfcb55cf242a tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:00:37.365043 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-44a1f662-122e-407f-8aa2-cfcb55cf242a tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:00:37.365505 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-44a1f662-122e-407f-8aa2-cfcb55cf242a tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:00:37.366516 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-44a1f662-122e-407f-8aa2-cfcb55cf242a tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:00:37.367008 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-44a1f662-122e-407f-8aa2-cfcb55cf242a tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:00:37.367458 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-44a1f662-122e-407f-8aa2-cfcb55cf242a tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:00:37.499305 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-44a1f662-122e-407f-8aa2-cfcb55cf242a tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2fb9b0105749a9a6604604bbc9cc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8479b202e544a785d8f165617ea33b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:00:37.507844 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-44a1f662-122e-407f-8aa2-cfcb55cf242a tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] 10.222.0.43 "GET /compute/v2.1/servers/7ce6bf89-64b9-4f13-8114-2c4e8144b308" status: 200 len: 1507 microversion: 2.1 time: 0.154078 Oct 04 23:00:37.508443 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4184/7547] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:00:37 2022] GET /compute/v2.1/servers/7ce6bf89-64b9-4f13-8114-2c4e8144b308 => generated 1507 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 23:00:37.535381 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-667bd8a1-0ba4-4020-9c31-abdc2973f559 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:00:37.535882 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-667bd8a1-0ba4-4020-9c31-abdc2973f559 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] [instance: 8b2f7ab3-ae9b-4b2d-95b0-5f96f724e84a] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:00:37.543018 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-667bd8a1-0ba4-4020-9c31-abdc2973f559 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:00:37.543506 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-667bd8a1-0ba4-4020-9c31-abdc2973f559 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:00:37.543947 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-667bd8a1-0ba4-4020-9c31-abdc2973f559 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:00:37.544633 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-667bd8a1-0ba4-4020-9c31-abdc2973f559 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:00:37.545087 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-667bd8a1-0ba4-4020-9c31-abdc2973f559 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:00:37.545512 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-667bd8a1-0ba4-4020-9c31-abdc2973f559 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:00:37.558355 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-667bd8a1-0ba4-4020-9c31-abdc2973f559 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] HTTP exception thrown: Instance 8b2f7ab3-ae9b-4b2d-95b0-5f96f724e84a could not be found. Oct 04 23:00:37.559906 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-667bd8a1-0ba4-4020-9c31-abdc2973f559 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Request method failure captured: Oct 04 23:00:37.559906 n-d-860284-1 devstack@n-api.service[134102]: request: DELETE /compute/v2.1/servers/8b2f7ab3-ae9b-4b2d-95b0-5f96f724e84a HTTP/1.1 Oct 04 23:00:37.559906 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 23:00:37.559906 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 23:00:37.559906 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 23:00:37.559906 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 23:00:37.559906 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 23:00:37.559906 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 23:00:37.559906 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 23:00:37.559906 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 23:00:37.559906 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPLr3YFV3g-YeAqk0Jgg4aDwl7AI8QX1A2k7Trm2Uie58d-bW3CxvINs1KSKIPdIvgAdsFUs2X5cJyB_TkJUal4QaCYK9gvdzpjAAMz1ZmFTZfjEtL3pGfkvL-u3cNWZ-cvhoUP7a43dT0bBnlrFCxCxocXhrBw7Xco_xY9lMzR5Oags Oct 04 23:00:37.559906 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 23:00:37.559906 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 23:00:37.559906 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 23:00:37.559906 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 23:00:37.559906 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 23:00:37.559906 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 23:00:37.559906 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: bf8479b202e544a785d8f165617ea33b Oct 04 23:00:37.559906 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-ServersNegativeTestJSON-1159761747 Oct 04 23:00:37.559906 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 23:00:37.559906 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 23:00:37.559906 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/bf8479b202e544a785d8f165617ea33b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_bf8479b202e544a785d8f165617ea33b", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/bf8479b202e544a785d8f165617ea33b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/bf8479b202e544a785d8f165617ea33b"}]}] Oct 04 23:00:37.559906 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-ServersNegativeTestJSON-1159761747 Oct 04 23:00:37.559906 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: bf8479b202e544a785d8f165617ea33b Oct 04 23:00:37.559906 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1159761747 Oct 04 23:00:37.559906 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-ServersNegativeTestJSON-1159761747-project Oct 04 23:00:37.559906 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 23:00:37.559906 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 23:00:37.559906 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: 7f2fb9b0105749a9a6604604bbc9cc14 Oct 04 23:00:37.559906 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-ServersNegativeTestJSON-1159761747-project Oct 04 23:00:37.559906 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 23:00:37.559906 n-d-860284-1 devstack@n-api.service[134102]: exception: Instance 8b2f7ab3-ae9b-4b2d-95b0-5f96f724e84a could not be found. Oct 04 23:00:37.559906 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': '8b2f7ab3-ae9b-4b2d-95b0-5f96f724e84a'} Oct 04 23:00:37.559906 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 23:00:37.559906 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 23:00:37.559906 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 23:00:37.559906 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 23:00:37.559906 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 23:00:37.559906 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 23:00:37.559906 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 23:00:37.559906 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 23:00:37.559906 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 23:00:37.559906 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 23:00:37.559906 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b2f7ab3-ae9b-4b2d-95b0-5f96f724e84a could not be found. Oct 04 23:00:37.559906 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 23:00:37.559906 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 23:00:37.559906 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 23:00:37.559906 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 23:00:37.559906 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 23:00:37.559906 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 23:00:37.559906 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 23:00:37.559906 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 23:00:37.559906 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 23:00:37.559906 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 23:00:37.559906 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 23:00:37.559906 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 23:00:37.559906 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 23:00:37.559906 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 23:00:37.559906 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 23:00:37.559906 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 23:00:37.559906 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 23:00:37.559906 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 23:00:37.565052 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b2f7ab3-ae9b-4b2d-95b0-5f96f724e84a could not be found. Oct 04 23:00:37.565052 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 23:00:37.565052 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 23:00:37.565052 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 23:00:37.565052 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 23:00:37.565052 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 23:00:37.565052 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 23:00:37.565052 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 23:00:37.565052 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 23:00:37.565052 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b2f7ab3-ae9b-4b2d-95b0-5f96f724e84a could not be found. Oct 04 23:00:37.565052 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 23:00:37.565052 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-667bd8a1-0ba4-4020-9c31-abdc2973f559 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Returning 404 to user: Instance 8b2f7ab3-ae9b-4b2d-95b0-5f96f724e84a could not be found. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 23:00:37.565052 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-667bd8a1-0ba4-4020-9c31-abdc2973f559 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] 10.222.0.43 "DELETE /compute/v2.1/servers/8b2f7ab3-ae9b-4b2d-95b0-5f96f724e84a" status: 404 len: 111 microversion: 2.1 time: 0.030809 Oct 04 23:00:37.565052 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3364/7548] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 23:00:37 2022] DELETE /compute/v2.1/servers/8b2f7ab3-ae9b-4b2d-95b0-5f96f724e84a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 23:00:37.570353 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-9e70a1b2-fc72-4391-8d44-8e7b83ed8a5e tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:00:37.571044 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-9e70a1b2-fc72-4391-8d44-8e7b83ed8a5e tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] [instance: 8b2f7ab3-ae9b-4b2d-95b0-5f96f724e84a] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:00:37.577021 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9e70a1b2-fc72-4391-8d44-8e7b83ed8a5e tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:00:37.577511 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9e70a1b2-fc72-4391-8d44-8e7b83ed8a5e tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:00:37.577958 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9e70a1b2-fc72-4391-8d44-8e7b83ed8a5e tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:00:37.578684 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9e70a1b2-fc72-4391-8d44-8e7b83ed8a5e tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:00:37.579809 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9e70a1b2-fc72-4391-8d44-8e7b83ed8a5e tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:00:37.580248 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9e70a1b2-fc72-4391-8d44-8e7b83ed8a5e tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:00:37.593866 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-9e70a1b2-fc72-4391-8d44-8e7b83ed8a5e tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] HTTP exception thrown: Instance 8b2f7ab3-ae9b-4b2d-95b0-5f96f724e84a could not be found. Oct 04 23:00:37.595458 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-9e70a1b2-fc72-4391-8d44-8e7b83ed8a5e tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Request method failure captured: Oct 04 23:00:37.595458 n-d-860284-1 devstack@n-api.service[134101]: request: GET /compute/v2.1/servers/8b2f7ab3-ae9b-4b2d-95b0-5f96f724e84a HTTP/1.1 Oct 04 23:00:37.595458 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 23:00:37.595458 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 23:00:37.595458 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 23:00:37.595458 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 23:00:37.595458 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 23:00:37.595458 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 23:00:37.595458 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 23:00:37.595458 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 23:00:37.595458 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPLr3YFV3g-YeAqk0Jgg4aDwl7AI8QX1A2k7Trm2Uie58d-bW3CxvINs1KSKIPdIvgAdsFUs2X5cJyB_TkJUal4QaCYK9gvdzpjAAMz1ZmFTZfjEtL3pGfkvL-u3cNWZ-cvhoUP7a43dT0bBnlrFCxCxocXhrBw7Xco_xY9lMzR5Oags Oct 04 23:00:37.595458 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 23:00:37.595458 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 23:00:37.595458 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 23:00:37.595458 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 23:00:37.595458 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 23:00:37.595458 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 23:00:37.595458 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: bf8479b202e544a785d8f165617ea33b Oct 04 23:00:37.595458 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-ServersNegativeTestJSON-1159761747 Oct 04 23:00:37.595458 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 23:00:37.595458 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 23:00:37.595458 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/bf8479b202e544a785d8f165617ea33b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_bf8479b202e544a785d8f165617ea33b", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/bf8479b202e544a785d8f165617ea33b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/bf8479b202e544a785d8f165617ea33b"}]}] Oct 04 23:00:37.595458 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-ServersNegativeTestJSON-1159761747 Oct 04 23:00:37.595458 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: bf8479b202e544a785d8f165617ea33b Oct 04 23:00:37.595458 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1159761747 Oct 04 23:00:37.595458 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-ServersNegativeTestJSON-1159761747-project Oct 04 23:00:37.595458 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 23:00:37.595458 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 23:00:37.595458 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 7f2fb9b0105749a9a6604604bbc9cc14 Oct 04 23:00:37.595458 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-ServersNegativeTestJSON-1159761747-project Oct 04 23:00:37.595458 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 23:00:37.595458 n-d-860284-1 devstack@n-api.service[134101]: exception: Instance 8b2f7ab3-ae9b-4b2d-95b0-5f96f724e84a could not be found. Oct 04 23:00:37.595458 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': '8b2f7ab3-ae9b-4b2d-95b0-5f96f724e84a'} Oct 04 23:00:37.595458 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 23:00:37.595458 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 23:00:37.595458 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 23:00:37.595458 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 23:00:37.595458 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 23:00:37.595458 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 23:00:37.595458 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 23:00:37.595458 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 23:00:37.595458 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 23:00:37.595458 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 23:00:37.595458 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b2f7ab3-ae9b-4b2d-95b0-5f96f724e84a could not be found. Oct 04 23:00:37.595458 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 23:00:37.595458 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 23:00:37.595458 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 23:00:37.595458 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 23:00:37.595458 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 23:00:37.595458 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 23:00:37.595458 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 23:00:37.595458 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 23:00:37.595458 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 23:00:37.595458 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 23:00:37.595458 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 23:00:37.595458 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 23:00:37.595458 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 23:00:37.595458 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 23:00:37.595458 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 23:00:37.595458 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 23:00:37.595458 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b2f7ab3-ae9b-4b2d-95b0-5f96f724e84a could not be found. Oct 04 23:00:37.595458 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 23:00:37.595458 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 23:00:37.595458 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 23:00:37.600468 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 23:00:37.600468 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 23:00:37.600468 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 23:00:37.600468 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 23:00:37.600468 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 23:00:37.600468 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b2f7ab3-ae9b-4b2d-95b0-5f96f724e84a could not be found. Oct 04 23:00:37.600468 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 23:00:37.600468 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-9e70a1b2-fc72-4391-8d44-8e7b83ed8a5e tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Returning 404 to user: Instance 8b2f7ab3-ae9b-4b2d-95b0-5f96f724e84a could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 23:00:37.600468 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-9e70a1b2-fc72-4391-8d44-8e7b83ed8a5e tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] 10.222.0.43 "GET /compute/v2.1/servers/8b2f7ab3-ae9b-4b2d-95b0-5f96f724e84a" status: 404 len: 111 microversion: 2.1 time: 0.030344 Oct 04 23:00:37.600468 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4185/7549] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:00:37 2022] GET /compute/v2.1/servers/8b2f7ab3-ae9b-4b2d-95b0-5f96f724e84a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 23:00:37.605274 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-dd494aff-6883-48f7-9697-22163185d5a6 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:00:37.605774 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-dd494aff-6883-48f7-9697-22163185d5a6 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] [instance: 7ce6bf89-64b9-4f13-8114-2c4e8144b308] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:00:37.607725 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=6 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:00:37.613045 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dd494aff-6883-48f7-9697-22163185d5a6 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:00:37.613531 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dd494aff-6883-48f7-9697-22163185d5a6 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:00:37.613972 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dd494aff-6883-48f7-9697-22163185d5a6 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:00:37.614697 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dd494aff-6883-48f7-9697-22163185d5a6 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:00:37.615154 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dd494aff-6883-48f7-9697-22163185d5a6 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:00:37.615584 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dd494aff-6883-48f7-9697-22163185d5a6 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:00:37.620449 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=93 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:00:37.645005 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-dd494aff-6883-48f7-9697-22163185d5a6 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] [instance: 7ce6bf89-64b9-4f13-8114-2c4e8144b308] Going to try to terminate instance {{(pid=134102) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 23:00:37.722050 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-dd494aff-6883-48f7-9697-22163185d5a6 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] 10.222.0.43 "DELETE /compute/v2.1/servers/7ce6bf89-64b9-4f13-8114-2c4e8144b308" status: 204 len: 0 microversion: 2.1 time: 0.119995 Oct 04 23:00:37.722638 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3365/7550] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 23:00:37 2022] DELETE /compute/v2.1/servers/7ce6bf89-64b9-4f13-8114-2c4e8144b308 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 23:00:37.730758 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-d02b46ee-58a8-439e-886c-bb8434fd7616 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:00:37.731395 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-d02b46ee-58a8-439e-886c-bb8434fd7616 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] [instance: 7ce6bf89-64b9-4f13-8114-2c4e8144b308] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:00:37.737568 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d02b46ee-58a8-439e-886c-bb8434fd7616 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:00:37.738074 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d02b46ee-58a8-439e-886c-bb8434fd7616 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:00:37.738570 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d02b46ee-58a8-439e-886c-bb8434fd7616 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:00:37.739282 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d02b46ee-58a8-439e-886c-bb8434fd7616 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:00:37.739759 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d02b46ee-58a8-439e-886c-bb8434fd7616 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:00:37.740208 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d02b46ee-58a8-439e-886c-bb8434fd7616 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:00:37.875221 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-d02b46ee-58a8-439e-886c-bb8434fd7616 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2fb9b0105749a9a6604604bbc9cc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8479b202e544a785d8f165617ea33b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:00:37.883746 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-d02b46ee-58a8-439e-886c-bb8434fd7616 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] 10.222.0.43 "GET /compute/v2.1/servers/7ce6bf89-64b9-4f13-8114-2c4e8144b308" status: 200 len: 1513 microversion: 2.1 time: 0.156989 Oct 04 23:00:37.884332 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4186/7551] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:00:37 2022] GET /compute/v2.1/servers/7ce6bf89-64b9-4f13-8114-2c4e8144b308 => generated 1513 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 23:00:38.906937 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-36fdcf57-1214-4e07-b626-e4cab807e75a tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:00:38.908252 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-36fdcf57-1214-4e07-b626-e4cab807e75a tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] [instance: 7ce6bf89-64b9-4f13-8114-2c4e8144b308] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:00:38.915276 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-36fdcf57-1214-4e07-b626-e4cab807e75a tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:00:38.915771 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-36fdcf57-1214-4e07-b626-e4cab807e75a tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:00:38.916221 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-36fdcf57-1214-4e07-b626-e4cab807e75a tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:00:38.916926 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-36fdcf57-1214-4e07-b626-e4cab807e75a tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:00:38.917389 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-36fdcf57-1214-4e07-b626-e4cab807e75a tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:00:38.917824 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-36fdcf57-1214-4e07-b626-e4cab807e75a tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:00:39.050772 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-36fdcf57-1214-4e07-b626-e4cab807e75a tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2fb9b0105749a9a6604604bbc9cc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8479b202e544a785d8f165617ea33b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:00:39.058494 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-36fdcf57-1214-4e07-b626-e4cab807e75a tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] 10.222.0.43 "GET /compute/v2.1/servers/7ce6bf89-64b9-4f13-8114-2c4e8144b308" status: 200 len: 1513 microversion: 2.1 time: 0.156002 Oct 04 23:00:39.059066 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3366/7552] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:00:38 2022] GET /compute/v2.1/servers/7ce6bf89-64b9-4f13-8114-2c4e8144b308 => generated 1513 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:00:39.893433 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-da54c292-d58a-4dbe-95b4-7693334a8a74 req-36deaa7c-6abf-4427-b54d-21e45907a560 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ce6bf89-64b9-4f13-8114-2c4e8144b308", "name": "network-vif-deleted", "tag": "a9ff3e32-913c-4c1f-8736-cbb969870c65"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 23:00:39.900952 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=1 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:00:39.905400 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-da54c292-d58a-4dbe-95b4-7693334a8a74 req-36deaa7c-6abf-4427-b54d-21e45907a560 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:00:39.905902 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-da54c292-d58a-4dbe-95b4-7693334a8a74 req-36deaa7c-6abf-4427-b54d-21e45907a560 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:00:39.906356 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-da54c292-d58a-4dbe-95b4-7693334a8a74 req-36deaa7c-6abf-4427-b54d-21e45907a560 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:00:39.925790 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-da54c292-d58a-4dbe-95b4-7693334a8a74 req-36deaa7c-6abf-4427-b54d-21e45907a560 service nova] Creating event network-vif-deleted:a9ff3e32-913c-4c1f-8736-cbb969870c65 for instance 7ce6bf89-64b9-4f13-8114-2c4e8144b308 on n-h2-860284-1 Oct 04 23:00:39.930961 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-da54c292-d58a-4dbe-95b4-7693334a8a74 req-36deaa7c-6abf-4427-b54d-21e45907a560 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041332 Oct 04 23:00:39.931428 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4187/7553] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 23:00:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 23:00:40.081753 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-2b2b5153-2bb4-4136-9080-5f158349c9c5 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:00:40.082431 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-2b2b5153-2bb4-4136-9080-5f158349c9c5 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] [instance: 7ce6bf89-64b9-4f13-8114-2c4e8144b308] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:00:40.089891 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2b2b5153-2bb4-4136-9080-5f158349c9c5 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:00:40.090409 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2b2b5153-2bb4-4136-9080-5f158349c9c5 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:00:40.090913 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2b2b5153-2bb4-4136-9080-5f158349c9c5 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:00:40.091628 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2b2b5153-2bb4-4136-9080-5f158349c9c5 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:00:40.092097 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2b2b5153-2bb4-4136-9080-5f158349c9c5 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:00:40.092533 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2b2b5153-2bb4-4136-9080-5f158349c9c5 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:00:40.125714 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2b2b5153-2bb4-4136-9080-5f158349c9c5 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:00:40.126206 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2b2b5153-2bb4-4136-9080-5f158349c9c5 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:00:40.126683 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2b2b5153-2bb4-4136-9080-5f158349c9c5 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:00:40.127151 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.objects.instance [None req-2b2b5153-2bb4-4136-9080-5f158349c9c5 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Lazy-loading 'fault' on Instance uuid 7ce6bf89-64b9-4f13-8114-2c4e8144b308 {{(pid=134102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 23:00:40.172694 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-2b2b5153-2bb4-4136-9080-5f158349c9c5 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2fb9b0105749a9a6604604bbc9cc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8479b202e544a785d8f165617ea33b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:00:40.180730 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-2b2b5153-2bb4-4136-9080-5f158349c9c5 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] 10.222.0.43 "GET /compute/v2.1/servers/7ce6bf89-64b9-4f13-8114-2c4e8144b308" status: 200 len: 1307 microversion: 2.1 time: 0.103610 Oct 04 23:00:40.181322 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3367/7554] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:00:40 2022] GET /compute/v2.1/servers/7ce6bf89-64b9-4f13-8114-2c4e8144b308 => generated 1307 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:00:41.205513 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-4bd1c46f-3ba0-4dc6-8ded-5531917adc90 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:00:41.206178 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-4bd1c46f-3ba0-4dc6-8ded-5531917adc90 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] [instance: 7ce6bf89-64b9-4f13-8114-2c4e8144b308] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:00:41.212452 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4bd1c46f-3ba0-4dc6-8ded-5531917adc90 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:00:41.212958 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4bd1c46f-3ba0-4dc6-8ded-5531917adc90 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:00:41.213418 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4bd1c46f-3ba0-4dc6-8ded-5531917adc90 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:00:41.214129 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4bd1c46f-3ba0-4dc6-8ded-5531917adc90 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:00:41.214642 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4bd1c46f-3ba0-4dc6-8ded-5531917adc90 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:00:41.215092 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4bd1c46f-3ba0-4dc6-8ded-5531917adc90 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:00:41.229080 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-4bd1c46f-3ba0-4dc6-8ded-5531917adc90 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] HTTP exception thrown: Instance 7ce6bf89-64b9-4f13-8114-2c4e8144b308 could not be found. Oct 04 23:00:41.230754 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-4bd1c46f-3ba0-4dc6-8ded-5531917adc90 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Request method failure captured: Oct 04 23:00:41.230754 n-d-860284-1 devstack@n-api.service[134101]: request: GET /compute/v2.1/servers/7ce6bf89-64b9-4f13-8114-2c4e8144b308 HTTP/1.1 Oct 04 23:00:41.230754 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 23:00:41.230754 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 23:00:41.230754 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 23:00:41.230754 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 23:00:41.230754 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 23:00:41.230754 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 23:00:41.230754 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 23:00:41.230754 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 23:00:41.230754 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPLr3YFV3g-YeAqk0Jgg4aDwl7AI8QX1A2k7Trm2Uie58d-bW3CxvINs1KSKIPdIvgAdsFUs2X5cJyB_TkJUal4QaCYK9gvdzpjAAMz1ZmFTZfjEtL3pGfkvL-u3cNWZ-cvhoUP7a43dT0bBnlrFCxCxocXhrBw7Xco_xY9lMzR5Oags Oct 04 23:00:41.230754 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 23:00:41.230754 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 23:00:41.230754 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 23:00:41.230754 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 23:00:41.230754 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 23:00:41.230754 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 23:00:41.230754 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: bf8479b202e544a785d8f165617ea33b Oct 04 23:00:41.230754 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-ServersNegativeTestJSON-1159761747 Oct 04 23:00:41.230754 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 23:00:41.230754 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 23:00:41.230754 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/bf8479b202e544a785d8f165617ea33b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_bf8479b202e544a785d8f165617ea33b", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/bf8479b202e544a785d8f165617ea33b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/bf8479b202e544a785d8f165617ea33b"}]}] Oct 04 23:00:41.230754 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-ServersNegativeTestJSON-1159761747 Oct 04 23:00:41.230754 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: bf8479b202e544a785d8f165617ea33b Oct 04 23:00:41.230754 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1159761747 Oct 04 23:00:41.230754 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-ServersNegativeTestJSON-1159761747-project Oct 04 23:00:41.230754 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 23:00:41.230754 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 23:00:41.230754 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 7f2fb9b0105749a9a6604604bbc9cc14 Oct 04 23:00:41.230754 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-ServersNegativeTestJSON-1159761747-project Oct 04 23:00:41.230754 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 23:00:41.230754 n-d-860284-1 devstack@n-api.service[134101]: exception: Instance 7ce6bf89-64b9-4f13-8114-2c4e8144b308 could not be found. Oct 04 23:00:41.230754 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': '7ce6bf89-64b9-4f13-8114-2c4e8144b308'} Oct 04 23:00:41.230754 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 23:00:41.230754 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 23:00:41.230754 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 23:00:41.230754 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 23:00:41.230754 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 23:00:41.230754 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 23:00:41.230754 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 23:00:41.230754 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 23:00:41.230754 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 23:00:41.230754 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 23:00:41.230754 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ce6bf89-64b9-4f13-8114-2c4e8144b308 could not be found. Oct 04 23:00:41.230754 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 23:00:41.230754 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 23:00:41.230754 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 23:00:41.230754 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 23:00:41.230754 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 23:00:41.230754 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 23:00:41.230754 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 23:00:41.230754 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 23:00:41.230754 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 23:00:41.230754 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 23:00:41.230754 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 23:00:41.230754 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 23:00:41.230754 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 23:00:41.230754 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 23:00:41.230754 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 23:00:41.230754 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 23:00:41.230754 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ce6bf89-64b9-4f13-8114-2c4e8144b308 could not be found. Oct 04 23:00:41.230754 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 23:00:41.230754 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 23:00:41.230754 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 23:00:41.236170 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 23:00:41.236170 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 23:00:41.236170 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 23:00:41.236170 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 23:00:41.236170 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 23:00:41.236170 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ce6bf89-64b9-4f13-8114-2c4e8144b308 could not be found. Oct 04 23:00:41.236170 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 23:00:41.236170 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-4bd1c46f-3ba0-4dc6-8ded-5531917adc90 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] Returning 404 to user: Instance 7ce6bf89-64b9-4f13-8114-2c4e8144b308 could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 23:00:41.236170 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-4bd1c46f-3ba0-4dc6-8ded-5531917adc90 tempest-ServersNegativeTestJSON-1159761747 tempest-ServersNegativeTestJSON-1159761747-project] 10.222.0.43 "GET /compute/v2.1/servers/7ce6bf89-64b9-4f13-8114-2c4e8144b308" status: 404 len: 111 microversion: 2.1 time: 0.032084 Oct 04 23:00:41.236170 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4188/7555] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:00:41 2022] GET /compute/v2.1/servers/7ce6bf89-64b9-4f13-8114-2c4e8144b308 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 23:01:12.056567 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_api:SELECT=12,nova_api:UPDATE=1 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:01:12.057885 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=27,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:01:12.230647 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-4f84113c-4e6b-4469-afa8-8dd256898fd1 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Action: 'create', calling method: .version_select at 0x7fbb2df0eb80>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-559958232", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNVQgl6j+NutPSm/L7fkK1X5ejoaBpxURc9gpiu5zU1THjM2cAuiXcrJkOOOVJVTRdgLAh1iT4b6UhCI35NXsTvX+cWY+lbs/g1j18q/6GBwmhXtz/7jVq9wmbdbBgseeA=="}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 23:01:12.246882 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-4f84113c-4e6b-4469-afa8-8dd256898fd1 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Getting quotas for project f19c254bc18540a0907bbdaa0c639cac. Resources: {'key_pairs'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 23:01:12.252834 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-4f84113c-4e6b-4469-afa8-8dd256898fd1 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Getting quotas for user 683395f4e85a46778aa7d79c593e891a and project f19c254bc18540a0907bbdaa0c639cac. Resources: {'key_pairs'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 23:01:12.283410 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-4f84113c-4e6b-4469-afa8-8dd256898fd1 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.232140 Oct 04 23:01:12.284039 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3368/7556] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Oct 4 23:01:12 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 23:01:12.336904 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-f65da991-797f-4803-8e35-36f69e30faac tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1481137845", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-559958232", "networks": [{"uuid": "b63c0596-0169-4237-9516-91637b4e0bd2"}]}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 23:01:12.347914 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=3 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:01:12.348592 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=28 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:01:12.399108 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.network.neutron [None req-f65da991-797f-4803-8e35-36f69e30faac tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] validate_networks() for [('b63c0596-0169-4237-9516-91637b4e0bd2', None, None, None, None, None)] {{(pid=134101) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 23:01:12.824640 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-f65da991-797f-4803-8e35-36f69e30faac tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Flavor limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 23:01:12.825091 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-f65da991-797f-4803-8e35-36f69e30faac tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Image limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 23:01:12.825589 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-f65da991-797f-4803-8e35-36f69e30faac tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Flavor pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 23:01:12.826025 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-f65da991-797f-4803-8e35-36f69e30faac tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Image pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 23:01:12.826511 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-f65da991-797f-4803-8e35-36f69e30faac tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 23:01:12.838550 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f65da991-797f-4803-8e35-36f69e30faac tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:01:12.839059 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f65da991-797f-4803-8e35-36f69e30faac tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:01:12.839511 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f65da991-797f-4803-8e35-36f69e30faac tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:01:12.840261 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f65da991-797f-4803-8e35-36f69e30faac tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:01:12.840737 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f65da991-797f-4803-8e35-36f69e30faac tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:01:12.841178 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f65da991-797f-4803-8e35-36f69e30faac tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:01:12.860660 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-f65da991-797f-4803-8e35-36f69e30faac tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Getting quotas for project f19c254bc18540a0907bbdaa0c639cac. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 23:01:12.866685 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-f65da991-797f-4803-8e35-36f69e30faac tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Getting quotas for user 683395f4e85a46778aa7d79c593e891a and project f19c254bc18540a0907bbdaa0c639cac. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 23:01:12.880610 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-f65da991-797f-4803-8e35-36f69e30faac tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Going to run 1 instances... {{(pid=134101) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 23:01:12.883285 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-f65da991-797f-4803-8e35-36f69e30faac tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] [instance: 9f415759-b2fd-4581-8d36-3875cd0face6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='58548514-5dac-426c-81f5-19e3fba33e23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134101) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 23:01:12.936307 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-f65da991-797f-4803-8e35-36f69e30faac tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.603410 Oct 04 23:01:12.945760 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4189/7557] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 23:01:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 614 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 23:01:12.950776 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-38112ebf-0ad7-4ed1-9bb5-11b2cd2c9453 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:01:12.951616 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-38112ebf-0ad7-4ed1-9bb5-11b2cd2c9453 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] [instance: 9f415759-b2fd-4581-8d36-3875cd0face6] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:01:13.026036 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-38112ebf-0ad7-4ed1-9bb5-11b2cd2c9453 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683395f4e85a46778aa7d79c593e891a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f19c254bc18540a0907bbdaa0c639cac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:01:13.039433 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-38112ebf-0ad7-4ed1-9bb5-11b2cd2c9453 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] 10.222.0.43 "GET /compute/v2.1/servers/9f415759-b2fd-4581-8d36-3875cd0face6" status: 200 len: 1262 microversion: 2.1 time: 0.093220 Oct 04 23:01:13.040112 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3369/7558] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:01:12 2022] GET /compute/v2.1/servers/9f415759-b2fd-4581-8d36-3875cd0face6 => generated 1262 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 23:01:14.065114 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e29ce158-86b4-4c5c-be6a-117c167a7c83 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:01:14.065953 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-e29ce158-86b4-4c5c-be6a-117c167a7c83 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] [instance: 9f415759-b2fd-4581-8d36-3875cd0face6] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:01:14.076065 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e29ce158-86b4-4c5c-be6a-117c167a7c83 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:01:14.076943 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e29ce158-86b4-4c5c-be6a-117c167a7c83 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:01:14.078159 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e29ce158-86b4-4c5c-be6a-117c167a7c83 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:01:14.079429 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e29ce158-86b4-4c5c-be6a-117c167a7c83 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:01:14.079913 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e29ce158-86b4-4c5c-be6a-117c167a7c83 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:01:14.080368 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e29ce158-86b4-4c5c-be6a-117c167a7c83 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:01:14.164700 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-e29ce158-86b4-4c5c-be6a-117c167a7c83 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683395f4e85a46778aa7d79c593e891a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f19c254bc18540a0907bbdaa0c639cac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:01:14.174128 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-e29ce158-86b4-4c5c-be6a-117c167a7c83 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] 10.222.0.43 "GET /compute/v2.1/servers/9f415759-b2fd-4581-8d36-3875cd0face6" status: 200 len: 1322 microversion: 2.1 time: 0.113332 Oct 04 23:01:14.174760 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4190/7559] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:01:14 2022] GET /compute/v2.1/servers/9f415759-b2fd-4581-8d36-3875cd0face6 => generated 1322 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:01:15.197759 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-3200b1b8-4555-41fc-accf-216470c09c1f tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:01:15.198953 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-3200b1b8-4555-41fc-accf-216470c09c1f tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] [instance: 9f415759-b2fd-4581-8d36-3875cd0face6] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:01:15.207933 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3200b1b8-4555-41fc-accf-216470c09c1f tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:01:15.208698 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3200b1b8-4555-41fc-accf-216470c09c1f tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:01:15.209333 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3200b1b8-4555-41fc-accf-216470c09c1f tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:01:15.210222 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3200b1b8-4555-41fc-accf-216470c09c1f tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:01:15.210891 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3200b1b8-4555-41fc-accf-216470c09c1f tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:01:15.211483 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3200b1b8-4555-41fc-accf-216470c09c1f tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:01:15.440330 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-3200b1b8-4555-41fc-accf-216470c09c1f tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683395f4e85a46778aa7d79c593e891a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f19c254bc18540a0907bbdaa0c639cac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:01:15.448697 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-3200b1b8-4555-41fc-accf-216470c09c1f tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] 10.222.0.43 "GET /compute/v2.1/servers/9f415759-b2fd-4581-8d36-3875cd0face6" status: 200 len: 1362 microversion: 2.1 time: 0.255140 Oct 04 23:01:15.449314 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3370/7560] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:01:15 2022] GET /compute/v2.1/servers/9f415759-b2fd-4581-8d36-3875cd0face6 => generated 1362 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:01:15.662102 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-71fc3d15-607f-4702-aa0c-836fbdda622f req-2116057d-f2dd-4310-8801-423cb004890f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f415759-b2fd-4581-8d36-3875cd0face6", "tag": "388061ce-1b73-430c-b68c-4d6bb383175d"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 23:01:15.683740 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-71fc3d15-607f-4702-aa0c-836fbdda622f req-2116057d-f2dd-4310-8801-423cb004890f service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:01:15.684289 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-71fc3d15-607f-4702-aa0c-836fbdda622f req-2116057d-f2dd-4310-8801-423cb004890f service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:01:15.684746 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-71fc3d15-607f-4702-aa0c-836fbdda622f req-2116057d-f2dd-4310-8801-423cb004890f service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:01:15.697789 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-71fc3d15-607f-4702-aa0c-836fbdda622f req-2116057d-f2dd-4310-8801-423cb004890f service nova] Creating event network-changed:388061ce-1b73-430c-b68c-4d6bb383175d for instance 9f415759-b2fd-4581-8d36-3875cd0face6 on n-h1-860284-1 Oct 04 23:01:15.703985 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-71fc3d15-607f-4702-aa0c-836fbdda622f req-2116057d-f2dd-4310-8801-423cb004890f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053795 Oct 04 23:01:15.704611 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4191/7561] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 23:01:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 23:01:16.474805 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-96b0feb8-3ab0-46d5-af1f-f6bbb75729d8 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:01:16.475386 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-96b0feb8-3ab0-46d5-af1f-f6bbb75729d8 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] [instance: 9f415759-b2fd-4581-8d36-3875cd0face6] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:01:16.482305 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-96b0feb8-3ab0-46d5-af1f-f6bbb75729d8 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:01:16.482831 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-96b0feb8-3ab0-46d5-af1f-f6bbb75729d8 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:01:16.483277 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-96b0feb8-3ab0-46d5-af1f-f6bbb75729d8 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:01:16.484815 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-96b0feb8-3ab0-46d5-af1f-f6bbb75729d8 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:01:16.485279 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-96b0feb8-3ab0-46d5-af1f-f6bbb75729d8 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:01:16.485739 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-96b0feb8-3ab0-46d5-af1f-f6bbb75729d8 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:01:16.621254 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-96b0feb8-3ab0-46d5-af1f-f6bbb75729d8 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683395f4e85a46778aa7d79c593e891a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f19c254bc18540a0907bbdaa0c639cac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:01:16.629480 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-96b0feb8-3ab0-46d5-af1f-f6bbb75729d8 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] 10.222.0.43 "GET /compute/v2.1/servers/9f415759-b2fd-4581-8d36-3875cd0face6" status: 200 len: 1362 microversion: 2.1 time: 0.158769 Oct 04 23:01:16.630063 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3371/7562] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:01:16 2022] GET /compute/v2.1/servers/9f415759-b2fd-4581-8d36-3875cd0face6 => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:01:17.654681 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-ab81ba5c-d89c-4302-b5de-e9810bb804c7 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:01:17.656675 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-ab81ba5c-d89c-4302-b5de-e9810bb804c7 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] [instance: 9f415759-b2fd-4581-8d36-3875cd0face6] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:01:17.664726 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ab81ba5c-d89c-4302-b5de-e9810bb804c7 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:01:17.665231 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ab81ba5c-d89c-4302-b5de-e9810bb804c7 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:01:17.665711 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ab81ba5c-d89c-4302-b5de-e9810bb804c7 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:01:17.667035 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ab81ba5c-d89c-4302-b5de-e9810bb804c7 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:01:17.667845 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ab81ba5c-d89c-4302-b5de-e9810bb804c7 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:01:17.668864 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ab81ba5c-d89c-4302-b5de-e9810bb804c7 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:01:17.807084 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-ab81ba5c-d89c-4302-b5de-e9810bb804c7 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683395f4e85a46778aa7d79c593e891a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f19c254bc18540a0907bbdaa0c639cac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:01:17.816290 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-ab81ba5c-d89c-4302-b5de-e9810bb804c7 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] 10.222.0.43 "GET /compute/v2.1/servers/9f415759-b2fd-4581-8d36-3875cd0face6" status: 200 len: 1362 microversion: 2.1 time: 0.166911 Oct 04 23:01:17.816870 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4192/7563] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:01:17 2022] GET /compute/v2.1/servers/9f415759-b2fd-4581-8d36-3875cd0face6 => generated 1362 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:01:18.839785 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-9eb7999e-f53b-453c-8357-5d1b1617f141 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:01:18.840383 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-9eb7999e-f53b-453c-8357-5d1b1617f141 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] [instance: 9f415759-b2fd-4581-8d36-3875cd0face6] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:01:18.847612 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9eb7999e-f53b-453c-8357-5d1b1617f141 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:01:18.848101 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9eb7999e-f53b-453c-8357-5d1b1617f141 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:01:18.848548 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9eb7999e-f53b-453c-8357-5d1b1617f141 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:01:18.849246 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9eb7999e-f53b-453c-8357-5d1b1617f141 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:01:18.849708 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9eb7999e-f53b-453c-8357-5d1b1617f141 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:01:18.850138 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9eb7999e-f53b-453c-8357-5d1b1617f141 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:01:18.989088 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-9eb7999e-f53b-453c-8357-5d1b1617f141 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683395f4e85a46778aa7d79c593e891a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f19c254bc18540a0907bbdaa0c639cac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:01:18.998820 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-9eb7999e-f53b-453c-8357-5d1b1617f141 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] 10.222.0.43 "GET /compute/v2.1/servers/9f415759-b2fd-4581-8d36-3875cd0face6" status: 200 len: 1362 microversion: 2.1 time: 0.163087 Oct 04 23:01:18.999453 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3372/7564] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:01:18 2022] GET /compute/v2.1/servers/9f415759-b2fd-4581-8d36-3875cd0face6 => generated 1362 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:01:20.021573 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-f908118c-b6d9-4b1c-9718-014c404604ff tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:01:20.022823 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-f908118c-b6d9-4b1c-9718-014c404604ff tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] [instance: 9f415759-b2fd-4581-8d36-3875cd0face6] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:01:20.029686 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f908118c-b6d9-4b1c-9718-014c404604ff tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:01:20.030184 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f908118c-b6d9-4b1c-9718-014c404604ff tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:01:20.030710 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f908118c-b6d9-4b1c-9718-014c404604ff tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:01:20.031501 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f908118c-b6d9-4b1c-9718-014c404604ff tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:01:20.031958 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f908118c-b6d9-4b1c-9718-014c404604ff tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:01:20.032402 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f908118c-b6d9-4b1c-9718-014c404604ff tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:01:20.173525 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-f908118c-b6d9-4b1c-9718-014c404604ff tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683395f4e85a46778aa7d79c593e891a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f19c254bc18540a0907bbdaa0c639cac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:01:20.181644 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-f908118c-b6d9-4b1c-9718-014c404604ff tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] 10.222.0.43 "GET /compute/v2.1/servers/9f415759-b2fd-4581-8d36-3875cd0face6" status: 200 len: 1362 microversion: 2.1 time: 0.163991 Oct 04 23:01:20.182233 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4193/7565] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:01:20 2022] GET /compute/v2.1/servers/9f415759-b2fd-4581-8d36-3875cd0face6 => generated 1362 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:01:21.205859 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-1ad50458-8e77-4663-aaff-17fc5016dc98 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:01:21.206447 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-1ad50458-8e77-4663-aaff-17fc5016dc98 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] [instance: 9f415759-b2fd-4581-8d36-3875cd0face6] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:01:21.213291 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1ad50458-8e77-4663-aaff-17fc5016dc98 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:01:21.213782 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1ad50458-8e77-4663-aaff-17fc5016dc98 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:01:21.214229 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1ad50458-8e77-4663-aaff-17fc5016dc98 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:01:21.214962 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1ad50458-8e77-4663-aaff-17fc5016dc98 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:01:21.215431 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1ad50458-8e77-4663-aaff-17fc5016dc98 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:01:21.215868 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1ad50458-8e77-4663-aaff-17fc5016dc98 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:01:21.348201 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-1ad50458-8e77-4663-aaff-17fc5016dc98 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683395f4e85a46778aa7d79c593e891a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f19c254bc18540a0907bbdaa0c639cac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:01:21.355980 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-1ad50458-8e77-4663-aaff-17fc5016dc98 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] 10.222.0.43 "GET /compute/v2.1/servers/9f415759-b2fd-4581-8d36-3875cd0face6" status: 200 len: 1362 microversion: 2.1 time: 0.154751 Oct 04 23:01:21.356571 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3373/7566] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:01:21 2022] GET /compute/v2.1/servers/9f415759-b2fd-4581-8d36-3875cd0face6 => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:01:22.099091 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-ae93ba61-5ea3-45fa-b1a3-63e9569ddd4d req-9c1213e6-a7f4-4002-a4d8-5c47b3c0bb00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f415759-b2fd-4581-8d36-3875cd0face6", "name": "network-vif-plugged", "status": "completed", "tag": "388061ce-1b73-430c-b68c-4d6bb383175d"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 23:01:22.110592 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-ae93ba61-5ea3-45fa-b1a3-63e9569ddd4d req-9c1213e6-a7f4-4002-a4d8-5c47b3c0bb00 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:01:22.111102 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-ae93ba61-5ea3-45fa-b1a3-63e9569ddd4d req-9c1213e6-a7f4-4002-a4d8-5c47b3c0bb00 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:01:22.111557 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-ae93ba61-5ea3-45fa-b1a3-63e9569ddd4d req-9c1213e6-a7f4-4002-a4d8-5c47b3c0bb00 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:01:22.123195 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-ae93ba61-5ea3-45fa-b1a3-63e9569ddd4d req-9c1213e6-a7f4-4002-a4d8-5c47b3c0bb00 service nova] Creating event network-vif-plugged:388061ce-1b73-430c-b68c-4d6bb383175d for instance 9f415759-b2fd-4581-8d36-3875cd0face6 on n-h1-860284-1 Oct 04 23:01:22.128088 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-ae93ba61-5ea3-45fa-b1a3-63e9569ddd4d req-9c1213e6-a7f4-4002-a4d8-5c47b3c0bb00 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032830 Oct 04 23:01:22.128888 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4194/7567] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 23:01:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 23:01:22.380113 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-c461b172-e3d1-4a11-88f0-546f379ce231 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:01:22.380769 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-c461b172-e3d1-4a11-88f0-546f379ce231 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] [instance: 9f415759-b2fd-4581-8d36-3875cd0face6] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:01:22.387745 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c461b172-e3d1-4a11-88f0-546f379ce231 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:01:22.388223 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c461b172-e3d1-4a11-88f0-546f379ce231 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:01:22.388672 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c461b172-e3d1-4a11-88f0-546f379ce231 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:01:22.390345 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c461b172-e3d1-4a11-88f0-546f379ce231 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:01:22.390844 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c461b172-e3d1-4a11-88f0-546f379ce231 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:01:22.391282 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c461b172-e3d1-4a11-88f0-546f379ce231 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:01:22.519529 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-c461b172-e3d1-4a11-88f0-546f379ce231 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683395f4e85a46778aa7d79c593e891a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f19c254bc18540a0907bbdaa0c639cac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:01:22.527420 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-c461b172-e3d1-4a11-88f0-546f379ce231 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] 10.222.0.43 "GET /compute/v2.1/servers/9f415759-b2fd-4581-8d36-3875cd0face6" status: 200 len: 1362 microversion: 2.1 time: 0.151305 Oct 04 23:01:22.528006 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3374/7568] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:01:22 2022] GET /compute/v2.1/servers/9f415759-b2fd-4581-8d36-3875cd0face6 => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:01:23.549723 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=2 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:01:23.551283 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=6 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:01:23.556343 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-bbcdc54a-efff-4c7f-8a22-d95e734bac61 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:01:23.557096 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-bbcdc54a-efff-4c7f-8a22-d95e734bac61 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] [instance: 9f415759-b2fd-4581-8d36-3875cd0face6] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:01:23.564476 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bbcdc54a-efff-4c7f-8a22-d95e734bac61 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:01:23.564985 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bbcdc54a-efff-4c7f-8a22-d95e734bac61 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:01:23.565445 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bbcdc54a-efff-4c7f-8a22-d95e734bac61 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:01:23.566161 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bbcdc54a-efff-4c7f-8a22-d95e734bac61 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:01:23.566662 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bbcdc54a-efff-4c7f-8a22-d95e734bac61 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:01:23.567116 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bbcdc54a-efff-4c7f-8a22-d95e734bac61 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:01:23.706583 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-bbcdc54a-efff-4c7f-8a22-d95e734bac61 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683395f4e85a46778aa7d79c593e891a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f19c254bc18540a0907bbdaa0c639cac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:01:23.714390 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-bbcdc54a-efff-4c7f-8a22-d95e734bac61 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] 10.222.0.43 "GET /compute/v2.1/servers/9f415759-b2fd-4581-8d36-3875cd0face6" status: 200 len: 1362 microversion: 2.1 time: 0.165634 Oct 04 23:01:23.715057 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4195/7569] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:01:23 2022] GET /compute/v2.1/servers/9f415759-b2fd-4581-8d36-3875cd0face6 => generated 1362 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:01:24.738740 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-9c782b1d-4ee4-42fb-b292-ccccdf0f17fa tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:01:24.739391 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-9c782b1d-4ee4-42fb-b292-ccccdf0f17fa tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] [instance: 9f415759-b2fd-4581-8d36-3875cd0face6] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:01:24.741505 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell0:SELECT=6 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:01:24.747905 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9c782b1d-4ee4-42fb-b292-ccccdf0f17fa tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:01:24.748429 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9c782b1d-4ee4-42fb-b292-ccccdf0f17fa tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:01:24.748872 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9c782b1d-4ee4-42fb-b292-ccccdf0f17fa tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:01:24.749592 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9c782b1d-4ee4-42fb-b292-ccccdf0f17fa tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:01:24.750465 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9c782b1d-4ee4-42fb-b292-ccccdf0f17fa tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:01:24.750906 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9c782b1d-4ee4-42fb-b292-ccccdf0f17fa tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:01:24.882287 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-9c782b1d-4ee4-42fb-b292-ccccdf0f17fa tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683395f4e85a46778aa7d79c593e891a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f19c254bc18540a0907bbdaa0c639cac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:01:24.890222 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-9c782b1d-4ee4-42fb-b292-ccccdf0f17fa tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] 10.222.0.43 "GET /compute/v2.1/servers/9f415759-b2fd-4581-8d36-3875cd0face6" status: 200 len: 1553 microversion: 2.1 time: 0.156115 Oct 04 23:01:24.890846 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3375/7570] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:01:24 2022] GET /compute/v2.1/servers/9f415759-b2fd-4581-8d36-3875cd0face6 => generated 1553 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:01:24.912846 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-dd201614-d268-40ff-b2fd-677c684e8a9c tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:01:24.913481 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-dd201614-d268-40ff-b2fd-677c684e8a9c tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] [instance: 9f415759-b2fd-4581-8d36-3875cd0face6] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:01:24.920291 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dd201614-d268-40ff-b2fd-677c684e8a9c tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:01:24.920785 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dd201614-d268-40ff-b2fd-677c684e8a9c tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:01:24.921233 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dd201614-d268-40ff-b2fd-677c684e8a9c tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:01:24.922777 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dd201614-d268-40ff-b2fd-677c684e8a9c tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:01:24.923247 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dd201614-d268-40ff-b2fd-677c684e8a9c tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:01:24.923691 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dd201614-d268-40ff-b2fd-677c684e8a9c tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:01:25.060369 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-dd201614-d268-40ff-b2fd-677c684e8a9c tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683395f4e85a46778aa7d79c593e891a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f19c254bc18540a0907bbdaa0c639cac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:01:25.068745 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-dd201614-d268-40ff-b2fd-677c684e8a9c tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] 10.222.0.43 "GET /compute/v2.1/servers/9f415759-b2fd-4581-8d36-3875cd0face6" status: 200 len: 1553 microversion: 2.1 time: 0.159648 Oct 04 23:01:25.069321 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4196/7571] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:01:24 2022] GET /compute/v2.1/servers/9f415759-b2fd-4581-8d36-3875cd0face6 => generated 1553 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:01:26.727063 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-bdbdd2df-d37c-479f-9f5b-2fdb228abbad tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "42aeae3a-cd10-4856-9375-0d4b0ebf4da4"}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 23:01:26.729517 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-bdbdd2df-d37c-479f-9f5b-2fdb228abbad tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] [instance: 9f415759-b2fd-4581-8d36-3875cd0face6] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:01:26.737266 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bdbdd2df-d37c-479f-9f5b-2fdb228abbad tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:01:26.737752 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bdbdd2df-d37c-479f-9f5b-2fdb228abbad tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:01:26.738191 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bdbdd2df-d37c-479f-9f5b-2fdb228abbad tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:01:26.738917 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bdbdd2df-d37c-479f-9f5b-2fdb228abbad tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:01:26.739374 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bdbdd2df-d37c-479f-9f5b-2fdb228abbad tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:01:26.740066 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bdbdd2df-d37c-479f-9f5b-2fdb228abbad tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:01:26.982883 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-bdbdd2df-d37c-479f-9f5b-2fdb228abbad tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] 10.222.0.43 "POST /compute/v2.1/servers/9f415759-b2fd-4581-8d36-3875cd0face6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.259144 Oct 04 23:01:26.983689 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3376/7572] 10.222.0.43 () {60 vars in 1323 bytes} [Tue Oct 4 23:01:26 2022] POST /compute/v2.1/servers/9f415759-b2fd-4581-8d36-3875cd0face6/os-volume_attachments => generated 194 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 23:01:37.701151 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-65169808-2101-4901-b9ff-cccb829ed678 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:01:37.701693 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-65169808-2101-4901-b9ff-cccb829ed678 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] [instance: 9f415759-b2fd-4581-8d36-3875cd0face6] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:01:37.704745 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:01:37.705437 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=36 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:01:37.712556 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-65169808-2101-4901-b9ff-cccb829ed678 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:01:37.713064 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-65169808-2101-4901-b9ff-cccb829ed678 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:01:37.713527 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-65169808-2101-4901-b9ff-cccb829ed678 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:01:37.714243 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-65169808-2101-4901-b9ff-cccb829ed678 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:01:37.714756 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-65169808-2101-4901-b9ff-cccb829ed678 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:01:37.715206 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-65169808-2101-4901-b9ff-cccb829ed678 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:01:37.799633 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.objects.instance [None req-65169808-2101-4901-b9ff-cccb829ed678 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lazy-loading 'services' on Instance uuid 9f415759-b2fd-4581-8d36-3875cd0face6 {{(pid=134101) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 23:01:37.877029 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-65169808-2101-4901-b9ff-cccb829ed678 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] 10.222.0.43 "DELETE /compute/v2.1/servers/9f415759-b2fd-4581-8d36-3875cd0face6/os-volume_attachments/42aeae3a-cd10-4856-9375-0d4b0ebf4da4" status: 202 len: 0 microversion: 2.1 time: 0.179962 Oct 04 23:01:37.877862 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4197/7573] 10.222.0.43 () {58 vars in 1416 bytes} [Tue Oct 4 23:01:37 2022] DELETE /compute/v2.1/servers/9f415759-b2fd-4581-8d36-3875cd0face6/os-volume_attachments/42aeae3a-cd10-4856-9375-0d4b0ebf4da4 => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 23:01:37.887067 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-2cf32e91-e5c4-4abc-979b-16b2a1ce258d tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:01:37.889496 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-2cf32e91-e5c4-4abc-979b-16b2a1ce258d tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] [instance: 9f415759-b2fd-4581-8d36-3875cd0face6] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:01:37.893131 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:01:37.893823 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:01:37.900156 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2cf32e91-e5c4-4abc-979b-16b2a1ce258d tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:01:37.900663 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2cf32e91-e5c4-4abc-979b-16b2a1ce258d tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:01:37.901088 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2cf32e91-e5c4-4abc-979b-16b2a1ce258d tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:01:37.901803 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2cf32e91-e5c4-4abc-979b-16b2a1ce258d tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:01:37.902269 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2cf32e91-e5c4-4abc-979b-16b2a1ce258d tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:01:37.902730 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2cf32e91-e5c4-4abc-979b-16b2a1ce258d tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:01:37.934810 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-2cf32e91-e5c4-4abc-979b-16b2a1ce258d tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] 10.222.0.43 "GET /compute/v2.1/servers/9f415759-b2fd-4581-8d36-3875cd0face6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052191 Oct 04 23:01:37.935542 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3377/7574] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 23:01:37 2022] GET /compute/v2.1/servers/9f415759-b2fd-4581-8d36-3875cd0face6/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 23:01:38.948877 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-bb4837a1-c645-4467-a782-823b18adea15 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:01:38.951284 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-bb4837a1-c645-4467-a782-823b18adea15 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] [instance: 9f415759-b2fd-4581-8d36-3875cd0face6] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:01:38.959158 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bb4837a1-c645-4467-a782-823b18adea15 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:01:38.959667 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bb4837a1-c645-4467-a782-823b18adea15 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:01:38.960122 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bb4837a1-c645-4467-a782-823b18adea15 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:01:38.960843 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bb4837a1-c645-4467-a782-823b18adea15 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:01:38.961315 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bb4837a1-c645-4467-a782-823b18adea15 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:01:38.961760 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bb4837a1-c645-4467-a782-823b18adea15 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:01:38.994500 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-bb4837a1-c645-4467-a782-823b18adea15 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] 10.222.0.43 "GET /compute/v2.1/servers/9f415759-b2fd-4581-8d36-3875cd0face6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050088 Oct 04 23:01:38.995137 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4198/7575] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 23:01:38 2022] GET /compute/v2.1/servers/9f415759-b2fd-4581-8d36-3875cd0face6/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 23:01:40.007228 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-c2fe9de7-63ce-45ef-9b03-a7b424cf9158 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:01:40.009455 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-c2fe9de7-63ce-45ef-9b03-a7b424cf9158 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] [instance: 9f415759-b2fd-4581-8d36-3875cd0face6] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:01:40.016374 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c2fe9de7-63ce-45ef-9b03-a7b424cf9158 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:01:40.016856 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c2fe9de7-63ce-45ef-9b03-a7b424cf9158 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:01:40.017297 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c2fe9de7-63ce-45ef-9b03-a7b424cf9158 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:01:40.017992 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c2fe9de7-63ce-45ef-9b03-a7b424cf9158 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:01:40.018481 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c2fe9de7-63ce-45ef-9b03-a7b424cf9158 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:01:40.018910 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c2fe9de7-63ce-45ef-9b03-a7b424cf9158 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:01:40.052472 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-c2fe9de7-63ce-45ef-9b03-a7b424cf9158 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] 10.222.0.43 "GET /compute/v2.1/servers/9f415759-b2fd-4581-8d36-3875cd0face6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049207 Oct 04 23:01:40.053051 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3378/7576] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 23:01:40 2022] GET /compute/v2.1/servers/9f415759-b2fd-4581-8d36-3875cd0face6/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 23:01:41.064824 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-bc8a6120-4c49-4ccb-a5c5-c029e36e7c3b tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:01:41.067080 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-bc8a6120-4c49-4ccb-a5c5-c029e36e7c3b tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] [instance: 9f415759-b2fd-4581-8d36-3875cd0face6] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:01:41.073908 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bc8a6120-4c49-4ccb-a5c5-c029e36e7c3b tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:01:41.074437 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bc8a6120-4c49-4ccb-a5c5-c029e36e7c3b tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:01:41.074888 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bc8a6120-4c49-4ccb-a5c5-c029e36e7c3b tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:01:41.075592 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bc8a6120-4c49-4ccb-a5c5-c029e36e7c3b tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:01:41.076056 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bc8a6120-4c49-4ccb-a5c5-c029e36e7c3b tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:01:41.076493 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bc8a6120-4c49-4ccb-a5c5-c029e36e7c3b tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:01:41.106039 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-bc8a6120-4c49-4ccb-a5c5-c029e36e7c3b tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] 10.222.0.43 "GET /compute/v2.1/servers/9f415759-b2fd-4581-8d36-3875cd0face6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045815 Oct 04 23:01:41.106636 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4199/7577] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 23:01:41 2022] GET /compute/v2.1/servers/9f415759-b2fd-4581-8d36-3875cd0face6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 23:01:42.119837 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-a153cb36-8e48-412d-adb0-798ffd70434f tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:01:42.122088 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-a153cb36-8e48-412d-adb0-798ffd70434f tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] [instance: 9f415759-b2fd-4581-8d36-3875cd0face6] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:01:42.135442 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a153cb36-8e48-412d-adb0-798ffd70434f tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:01:42.135997 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a153cb36-8e48-412d-adb0-798ffd70434f tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:01:42.136447 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a153cb36-8e48-412d-adb0-798ffd70434f tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:01:42.137196 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a153cb36-8e48-412d-adb0-798ffd70434f tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:01:42.137654 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a153cb36-8e48-412d-adb0-798ffd70434f tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:01:42.138083 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a153cb36-8e48-412d-adb0-798ffd70434f tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:01:42.169262 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-a153cb36-8e48-412d-adb0-798ffd70434f tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] 10.222.0.43 "GET /compute/v2.1/servers/9f415759-b2fd-4581-8d36-3875cd0face6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053473 Oct 04 23:01:42.169841 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3379/7578] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 23:01:42 2022] GET /compute/v2.1/servers/9f415759-b2fd-4581-8d36-3875cd0face6/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 23:01:43.181958 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-8790d4a3-c522-435a-96fa-559145dbe15b tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:01:43.184165 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-8790d4a3-c522-435a-96fa-559145dbe15b tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] [instance: 9f415759-b2fd-4581-8d36-3875cd0face6] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:01:43.191091 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8790d4a3-c522-435a-96fa-559145dbe15b tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:01:43.191616 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8790d4a3-c522-435a-96fa-559145dbe15b tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:01:43.192065 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8790d4a3-c522-435a-96fa-559145dbe15b tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:01:43.192768 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8790d4a3-c522-435a-96fa-559145dbe15b tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:01:43.193230 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8790d4a3-c522-435a-96fa-559145dbe15b tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:01:43.193667 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8790d4a3-c522-435a-96fa-559145dbe15b tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:01:43.224092 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-8790d4a3-c522-435a-96fa-559145dbe15b tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] 10.222.0.43 "GET /compute/v2.1/servers/9f415759-b2fd-4581-8d36-3875cd0face6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046148 Oct 04 23:01:43.224657 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4200/7579] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 23:01:43 2022] GET /compute/v2.1/servers/9f415759-b2fd-4581-8d36-3875cd0face6/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 23:01:43.235548 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-806c82fe-63ea-4945-8901-c87bf2545b67 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:01:43.236066 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-806c82fe-63ea-4945-8901-c87bf2545b67 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] [instance: 9f415759-b2fd-4581-8d36-3875cd0face6] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:01:43.243289 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-806c82fe-63ea-4945-8901-c87bf2545b67 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:01:43.243772 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-806c82fe-63ea-4945-8901-c87bf2545b67 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:01:43.244216 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-806c82fe-63ea-4945-8901-c87bf2545b67 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:01:43.244907 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-806c82fe-63ea-4945-8901-c87bf2545b67 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:01:43.245361 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-806c82fe-63ea-4945-8901-c87bf2545b67 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:01:43.245787 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-806c82fe-63ea-4945-8901-c87bf2545b67 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:01:43.322238 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-806c82fe-63ea-4945-8901-c87bf2545b67 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] HTTP exception thrown: Instance 9f415759-b2fd-4581-8d36-3875cd0face6 is not attached to volume 42aeae3a-cd10-4856-9375-0d4b0ebf4da4 Oct 04 23:01:43.339989 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-806c82fe-63ea-4945-8901-c87bf2545b67 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Request method failure captured: Oct 04 23:01:43.339989 n-d-860284-1 devstack@n-api.service[134102]: request: DELETE /compute/v2.1/servers/9f415759-b2fd-4581-8d36-3875cd0face6/os-volume_attachments/42aeae3a-cd10-4856-9375-0d4b0ebf4da4 HTTP/1.1 Oct 04 23:01:43.339989 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 23:01:43.339989 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 23:01:43.339989 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 23:01:43.339989 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 23:01:43.339989 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 23:01:43.339989 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 23:01:43.339989 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 23:01:43.339989 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 23:01:43.339989 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPLsyKdlCFO8XjqdjbrmQXEX3PBcwAUdIS8WioaXr-p_7_cJwtgaHUyODPFeeLJyGXQyvdwqmqrDZh4nYA5YDsY0Cl2qP0PAR33Qcs_3Xbjr1yupxr9M-Dez8zfZD5c6wp24-29uHaIvSJMFEze328xNsRBfzBcbBhQxrB2zkLwffVno Oct 04 23:01:43.339989 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 23:01:43.339989 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 23:01:43.339989 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 23:01:43.339989 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 23:01:43.339989 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 23:01:43.339989 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 23:01:43.339989 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: f19c254bc18540a0907bbdaa0c639cac Oct 04 23:01:43.339989 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1163339446 Oct 04 23:01:43.339989 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 23:01:43.339989 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 23:01:43.339989 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f19c254bc18540a0907bbdaa0c639cac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_f19c254bc18540a0907bbdaa0c639cac", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f19c254bc18540a0907bbdaa0c639cac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/f19c254bc18540a0907bbdaa0c639cac"}]}] Oct 04 23:01:43.339989 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-TestEncryptedCinderVolumes-1163339446 Oct 04 23:01:43.339989 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: f19c254bc18540a0907bbdaa0c639cac Oct 04 23:01:43.339989 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1163339446 Oct 04 23:01:43.339989 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-TestEncryptedCinderVolumes-1163339446-project Oct 04 23:01:43.339989 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 23:01:43.339989 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 23:01:43.339989 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: 683395f4e85a46778aa7d79c593e891a Oct 04 23:01:43.339989 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-TestEncryptedCinderVolumes-1163339446-project Oct 04 23:01:43.339989 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 23:01:43.339989 n-d-860284-1 devstack@n-api.service[134102]: exception: Instance 9f415759-b2fd-4581-8d36-3875cd0face6 is not attached to volume 42aeae3a-cd10-4856-9375-0d4b0ebf4da4 Oct 04 23:01:43.339989 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'server_id': '9f415759-b2fd-4581-8d36-3875cd0face6', 'id': '42aeae3a-cd10-4856-9375-0d4b0ebf4da4'} Oct 04 23:01:43.339989 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 23:01:43.339989 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 23:01:43.339989 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 04 23:01:43.339989 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 04 23:01:43.339989 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 23:01:43.339989 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 23:01:43.339989 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 04 23:01:43.339989 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 04 23:01:43.339989 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 42aeae3a-cd10-4856-9375-0d4b0ebf4da4. Oct 04 23:01:43.339989 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 23:01:43.339989 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 23:01:43.339989 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 23:01:43.339989 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 23:01:43.339989 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 23:01:43.339989 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 23:01:43.339989 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 23:01:43.339989 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 23:01:43.339989 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 23:01:43.339989 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 23:01:43.339989 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 04 23:01:43.339989 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 04 23:01:43.339989 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f415759-b2fd-4581-8d36-3875cd0face6 is not attached to volume 42aeae3a-cd10-4856-9375-0d4b0ebf4da4 Oct 04 23:01:43.339989 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 23:01:43.339989 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 23:01:43.339989 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 23:01:43.339989 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 23:01:43.339989 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 23:01:43.339989 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 23:01:43.345386 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 23:01:43.345386 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 23:01:43.345386 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f415759-b2fd-4581-8d36-3875cd0face6 is not attached to volume 42aeae3a-cd10-4856-9375-0d4b0ebf4da4 Oct 04 23:01:43.345386 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 23:01:43.345386 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-806c82fe-63ea-4945-8901-c87bf2545b67 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Returning 404 to user: Instance 9f415759-b2fd-4581-8d36-3875cd0face6 is not attached to volume 42aeae3a-cd10-4856-9375-0d4b0ebf4da4 {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 23:01:43.345386 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-806c82fe-63ea-4945-8901-c87bf2545b67 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] 10.222.0.43 "DELETE /compute/v2.1/servers/9f415759-b2fd-4581-8d36-3875cd0face6/os-volume_attachments/42aeae3a-cd10-4856-9375-0d4b0ebf4da4" status: 404 len: 154 microversion: 2.1 time: 0.110254 Oct 04 23:01:43.345386 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3380/7580] 10.222.0.43 () {58 vars in 1416 bytes} [Tue Oct 4 23:01:43 2022] DELETE /compute/v2.1/servers/9f415759-b2fd-4581-8d36-3875cd0face6/os-volume_attachments/42aeae3a-cd10-4856-9375-0d4b0ebf4da4 => generated 154 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 23:01:46.724302 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-59d601ae-13a8-453e-8283-1c4591a35334 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:01:46.724843 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-59d601ae-13a8-453e-8283-1c4591a35334 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] [instance: 9f415759-b2fd-4581-8d36-3875cd0face6] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:01:46.730935 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-59d601ae-13a8-453e-8283-1c4591a35334 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:01:46.731433 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-59d601ae-13a8-453e-8283-1c4591a35334 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:01:46.731887 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-59d601ae-13a8-453e-8283-1c4591a35334 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:01:46.732592 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-59d601ae-13a8-453e-8283-1c4591a35334 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:01:46.733061 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-59d601ae-13a8-453e-8283-1c4591a35334 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:01:46.733587 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-59d601ae-13a8-453e-8283-1c4591a35334 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:01:46.760465 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-59d601ae-13a8-453e-8283-1c4591a35334 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] [instance: 9f415759-b2fd-4581-8d36-3875cd0face6] Going to try to terminate instance {{(pid=134101) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 23:01:46.839967 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-59d601ae-13a8-453e-8283-1c4591a35334 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] 10.222.0.43 "DELETE /compute/v2.1/servers/9f415759-b2fd-4581-8d36-3875cd0face6" status: 204 len: 0 microversion: 2.1 time: 0.119153 Oct 04 23:01:46.840912 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4201/7581] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 23:01:46 2022] DELETE /compute/v2.1/servers/9f415759-b2fd-4581-8d36-3875cd0face6 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 23:01:46.849653 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-76be1e0d-35c9-4c9f-98a1-6eebf71ea8f9 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:01:46.850311 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-76be1e0d-35c9-4c9f-98a1-6eebf71ea8f9 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] [instance: 9f415759-b2fd-4581-8d36-3875cd0face6] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:01:46.859461 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-76be1e0d-35c9-4c9f-98a1-6eebf71ea8f9 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:01:46.860125 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-76be1e0d-35c9-4c9f-98a1-6eebf71ea8f9 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:01:46.860574 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-76be1e0d-35c9-4c9f-98a1-6eebf71ea8f9 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:01:46.861797 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-76be1e0d-35c9-4c9f-98a1-6eebf71ea8f9 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:01:46.862332 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-76be1e0d-35c9-4c9f-98a1-6eebf71ea8f9 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:01:46.862798 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-76be1e0d-35c9-4c9f-98a1-6eebf71ea8f9 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:01:46.995452 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-76be1e0d-35c9-4c9f-98a1-6eebf71ea8f9 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683395f4e85a46778aa7d79c593e891a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f19c254bc18540a0907bbdaa0c639cac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:01:47.004065 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-76be1e0d-35c9-4c9f-98a1-6eebf71ea8f9 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] 10.222.0.43 "GET /compute/v2.1/servers/9f415759-b2fd-4581-8d36-3875cd0face6" status: 200 len: 1559 microversion: 2.1 time: 0.158644 Oct 04 23:01:47.004659 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3381/7582] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:01:46 2022] GET /compute/v2.1/servers/9f415759-b2fd-4581-8d36-3875cd0face6 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:01:48.028339 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-f5be89cc-35a9-473e-8e8b-112d8ce5f024 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:01:48.029055 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-f5be89cc-35a9-473e-8e8b-112d8ce5f024 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] [instance: 9f415759-b2fd-4581-8d36-3875cd0face6] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:01:48.036570 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f5be89cc-35a9-473e-8e8b-112d8ce5f024 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:01:48.037064 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f5be89cc-35a9-473e-8e8b-112d8ce5f024 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:01:48.037511 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f5be89cc-35a9-473e-8e8b-112d8ce5f024 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:01:48.038215 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f5be89cc-35a9-473e-8e8b-112d8ce5f024 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:01:48.038704 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f5be89cc-35a9-473e-8e8b-112d8ce5f024 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:01:48.039141 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f5be89cc-35a9-473e-8e8b-112d8ce5f024 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:01:48.168720 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-f5be89cc-35a9-473e-8e8b-112d8ce5f024 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683395f4e85a46778aa7d79c593e891a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f19c254bc18540a0907bbdaa0c639cac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:01:48.177321 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-f5be89cc-35a9-473e-8e8b-112d8ce5f024 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] 10.222.0.43 "GET /compute/v2.1/servers/9f415759-b2fd-4581-8d36-3875cd0face6" status: 200 len: 1559 microversion: 2.1 time: 0.153261 Oct 04 23:01:48.177898 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4202/7583] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:01:48 2022] GET /compute/v2.1/servers/9f415759-b2fd-4581-8d36-3875cd0face6 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:01:49.201759 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-5fb202a8-4997-4c76-bee5-2942e6fd7528 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:01:49.202514 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-5fb202a8-4997-4c76-bee5-2942e6fd7528 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] [instance: 9f415759-b2fd-4581-8d36-3875cd0face6] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:01:49.209606 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5fb202a8-4997-4c76-bee5-2942e6fd7528 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:01:49.210098 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5fb202a8-4997-4c76-bee5-2942e6fd7528 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:01:49.210908 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5fb202a8-4997-4c76-bee5-2942e6fd7528 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:01:49.212639 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5fb202a8-4997-4c76-bee5-2942e6fd7528 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:01:49.213258 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5fb202a8-4997-4c76-bee5-2942e6fd7528 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:01:49.213863 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5fb202a8-4997-4c76-bee5-2942e6fd7528 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:01:49.301244 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-5fb202a8-4997-4c76-bee5-2942e6fd7528 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683395f4e85a46778aa7d79c593e891a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f19c254bc18540a0907bbdaa0c639cac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:01:49.301505 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-a07b4b80-be55-485d-9c72-6e784dc930bb req-6ec4f508-69e9-44b4-b43c-5b5efe32eb83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f415759-b2fd-4581-8d36-3875cd0face6", "name": "network-vif-deleted", "tag": "388061ce-1b73-430c-b68c-4d6bb383175d"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 23:01:49.310597 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-5fb202a8-4997-4c76-bee5-2942e6fd7528 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] 10.222.0.43 "GET /compute/v2.1/servers/9f415759-b2fd-4581-8d36-3875cd0face6" status: 200 len: 1517 microversion: 2.1 time: 0.113674 Oct 04 23:01:49.311207 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3382/7584] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:01:49 2022] GET /compute/v2.1/servers/9f415759-b2fd-4581-8d36-3875cd0face6 => generated 1517 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:01:49.313279 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-a07b4b80-be55-485d-9c72-6e784dc930bb req-6ec4f508-69e9-44b4-b43c-5b5efe32eb83 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:01:49.313952 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-a07b4b80-be55-485d-9c72-6e784dc930bb req-6ec4f508-69e9-44b4-b43c-5b5efe32eb83 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:01:49.314609 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-a07b4b80-be55-485d-9c72-6e784dc930bb req-6ec4f508-69e9-44b4-b43c-5b5efe32eb83 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:01:49.331289 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-a07b4b80-be55-485d-9c72-6e784dc930bb req-6ec4f508-69e9-44b4-b43c-5b5efe32eb83 service nova] Creating event network-vif-deleted:388061ce-1b73-430c-b68c-4d6bb383175d for instance 9f415759-b2fd-4581-8d36-3875cd0face6 on n-h1-860284-1 Oct 04 23:01:49.336373 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-a07b4b80-be55-485d-9c72-6e784dc930bb req-6ec4f508-69e9-44b4-b43c-5b5efe32eb83 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038988 Oct 04 23:01:49.337144 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4203/7585] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 23:01:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 23:01:50.335005 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-5b6b5945-175c-4aec-bba8-08ba247e21a9 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:01:50.335620 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-5b6b5945-175c-4aec-bba8-08ba247e21a9 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] [instance: 9f415759-b2fd-4581-8d36-3875cd0face6] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:01:50.342464 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5b6b5945-175c-4aec-bba8-08ba247e21a9 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:01:50.343057 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5b6b5945-175c-4aec-bba8-08ba247e21a9 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:01:50.343493 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5b6b5945-175c-4aec-bba8-08ba247e21a9 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:01:50.344192 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5b6b5945-175c-4aec-bba8-08ba247e21a9 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:01:50.344646 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5b6b5945-175c-4aec-bba8-08ba247e21a9 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:01:50.345074 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5b6b5945-175c-4aec-bba8-08ba247e21a9 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:01:50.358225 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-5b6b5945-175c-4aec-bba8-08ba247e21a9 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] HTTP exception thrown: Instance 9f415759-b2fd-4581-8d36-3875cd0face6 could not be found. Oct 04 23:01:50.359680 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-5b6b5945-175c-4aec-bba8-08ba247e21a9 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Request method failure captured: Oct 04 23:01:50.359680 n-d-860284-1 devstack@n-api.service[134102]: request: GET /compute/v2.1/servers/9f415759-b2fd-4581-8d36-3875cd0face6 HTTP/1.1 Oct 04 23:01:50.359680 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 23:01:50.359680 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 23:01:50.359680 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 23:01:50.359680 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 23:01:50.359680 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 23:01:50.359680 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 23:01:50.359680 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 23:01:50.359680 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 23:01:50.359680 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPLsyKdlCFO8XjqdjbrmQXEX3PBcwAUdIS8WioaXr-p_7_cJwtgaHUyODPFeeLJyGXQyvdwqmqrDZh4nYA5YDsY0Cl2qP0PAR33Qcs_3Xbjr1yupxr9M-Dez8zfZD5c6wp24-29uHaIvSJMFEze328xNsRBfzBcbBhQxrB2zkLwffVno Oct 04 23:01:50.359680 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 23:01:50.359680 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 23:01:50.359680 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 23:01:50.359680 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 23:01:50.359680 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 23:01:50.359680 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 23:01:50.359680 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: f19c254bc18540a0907bbdaa0c639cac Oct 04 23:01:50.359680 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1163339446 Oct 04 23:01:50.359680 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 23:01:50.359680 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 23:01:50.359680 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f19c254bc18540a0907bbdaa0c639cac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_f19c254bc18540a0907bbdaa0c639cac", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f19c254bc18540a0907bbdaa0c639cac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/f19c254bc18540a0907bbdaa0c639cac"}]}] Oct 04 23:01:50.359680 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-TestEncryptedCinderVolumes-1163339446 Oct 04 23:01:50.359680 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: f19c254bc18540a0907bbdaa0c639cac Oct 04 23:01:50.359680 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1163339446 Oct 04 23:01:50.359680 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-TestEncryptedCinderVolumes-1163339446-project Oct 04 23:01:50.359680 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 23:01:50.359680 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 23:01:50.359680 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: 683395f4e85a46778aa7d79c593e891a Oct 04 23:01:50.359680 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-TestEncryptedCinderVolumes-1163339446-project Oct 04 23:01:50.359680 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 23:01:50.359680 n-d-860284-1 devstack@n-api.service[134102]: exception: Instance 9f415759-b2fd-4581-8d36-3875cd0face6 could not be found. Oct 04 23:01:50.359680 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': '9f415759-b2fd-4581-8d36-3875cd0face6'} Oct 04 23:01:50.359680 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 23:01:50.359680 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 23:01:50.359680 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 23:01:50.359680 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 23:01:50.359680 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 23:01:50.359680 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 23:01:50.359680 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 23:01:50.359680 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 23:01:50.359680 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 23:01:50.359680 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 23:01:50.359680 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f415759-b2fd-4581-8d36-3875cd0face6 could not be found. Oct 04 23:01:50.359680 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 23:01:50.359680 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 23:01:50.359680 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 23:01:50.359680 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 23:01:50.359680 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 23:01:50.359680 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 23:01:50.359680 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 23:01:50.359680 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 23:01:50.359680 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 23:01:50.359680 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 23:01:50.359680 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 23:01:50.359680 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 23:01:50.359680 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 23:01:50.359680 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 23:01:50.359680 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 23:01:50.359680 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 23:01:50.359680 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f415759-b2fd-4581-8d36-3875cd0face6 could not be found. Oct 04 23:01:50.359680 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 23:01:50.359680 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 23:01:50.364422 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 23:01:50.364422 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 23:01:50.364422 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 23:01:50.364422 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 23:01:50.364422 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 23:01:50.364422 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 23:01:50.364422 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f415759-b2fd-4581-8d36-3875cd0face6 could not be found. Oct 04 23:01:50.364422 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 23:01:50.364422 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-5b6b5945-175c-4aec-bba8-08ba247e21a9 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Returning 404 to user: Instance 9f415759-b2fd-4581-8d36-3875cd0face6 could not be found. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 23:01:50.364422 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-5b6b5945-175c-4aec-bba8-08ba247e21a9 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] 10.222.0.43 "GET /compute/v2.1/servers/9f415759-b2fd-4581-8d36-3875cd0face6" status: 404 len: 111 microversion: 2.1 time: 0.030036 Oct 04 23:01:50.364422 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3383/7586] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:01:50 2022] GET /compute/v2.1/servers/9f415759-b2fd-4581-8d36-3875cd0face6 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 23:01:50.371521 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-1c98fb86-6e8b-4671-8e6b-8e5334f359d1 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Calling method '.version_select at 0x7fbb2da57ee0>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:01:50.392578 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-1c98fb86-6e8b-4671-8e6b-8e5334f359d1 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-559958232" status: 202 len: 0 microversion: 2.1 time: 0.026030 Oct 04 23:01:50.393083 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4204/7587] 10.222.0.43 () {58 vars in 1275 bytes} [Tue Oct 4 23:01:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-559958232 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 23:01:50.411094 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-2007dd1f-4f09-47f3-9ac8-f1bc1adb3453 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Action: 'create', calling method: .version_select at 0x7fbb2dfc1940>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-446473906", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNLKt8H0vS6HtVsMWAaRf3sZWyLdusKhO03scl+/gKplUu4haOknNMiQoi5LkoHBdtCega7vAdgBVzMQ84o2SMtK/6VxD+wpo2B2sXn4ngDOYNdpJ6elesRbVZuuOwCUeA=="}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 23:01:50.426652 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-2007dd1f-4f09-47f3-9ac8-f1bc1adb3453 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Getting quotas for project f19c254bc18540a0907bbdaa0c639cac. Resources: {'key_pairs'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 23:01:50.432463 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-2007dd1f-4f09-47f3-9ac8-f1bc1adb3453 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Getting quotas for user 683395f4e85a46778aa7d79c593e891a and project f19c254bc18540a0907bbdaa0c639cac. Resources: {'key_pairs'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 23:01:50.456374 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-2007dd1f-4f09-47f3-9ac8-f1bc1adb3453 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.049273 Oct 04 23:01:50.456982 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3384/7588] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Oct 4 23:01:50 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 23:01:50.520372 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-63ecd706-4d4c-41e5-af4d-f867d6334053 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1888933663", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-446473906", "networks": [{"uuid": "b63c0596-0169-4237-9516-91637b4e0bd2"}]}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 23:01:50.575270 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.network.neutron [None req-63ecd706-4d4c-41e5-af4d-f867d6334053 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] validate_networks() for [('b63c0596-0169-4237-9516-91637b4e0bd2', None, None, None, None, None)] {{(pid=134101) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 23:01:51.257021 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-63ecd706-4d4c-41e5-af4d-f867d6334053 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Flavor limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 23:01:51.257462 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-63ecd706-4d4c-41e5-af4d-f867d6334053 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Image limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 23:01:51.257950 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-63ecd706-4d4c-41e5-af4d-f867d6334053 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Flavor pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 23:01:51.258388 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-63ecd706-4d4c-41e5-af4d-f867d6334053 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Image pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 23:01:51.258821 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-63ecd706-4d4c-41e5-af4d-f867d6334053 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 23:01:51.268397 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-63ecd706-4d4c-41e5-af4d-f867d6334053 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:01:51.268895 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-63ecd706-4d4c-41e5-af4d-f867d6334053 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:01:51.269341 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-63ecd706-4d4c-41e5-af4d-f867d6334053 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:01:51.270078 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-63ecd706-4d4c-41e5-af4d-f867d6334053 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:01:51.270569 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-63ecd706-4d4c-41e5-af4d-f867d6334053 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:01:51.271007 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-63ecd706-4d4c-41e5-af4d-f867d6334053 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:01:51.287501 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-63ecd706-4d4c-41e5-af4d-f867d6334053 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Getting quotas for project f19c254bc18540a0907bbdaa0c639cac. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 23:01:51.292763 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-63ecd706-4d4c-41e5-af4d-f867d6334053 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Getting quotas for user 683395f4e85a46778aa7d79c593e891a and project f19c254bc18540a0907bbdaa0c639cac. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 23:01:51.304928 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-63ecd706-4d4c-41e5-af4d-f867d6334053 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Going to run 1 instances... {{(pid=134101) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 23:01:51.307333 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-63ecd706-4d4c-41e5-af4d-f867d6334053 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] [instance: 3eca80cc-f4b3-495a-b8a9-f7d1652bc19d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='58548514-5dac-426c-81f5-19e3fba33e23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134101) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 23:01:51.354657 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-63ecd706-4d4c-41e5-af4d-f867d6334053 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.838211 Oct 04 23:01:51.355308 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4205/7589] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 23:01:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 840 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 23:01:51.367453 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-4349a779-3e86-42cc-84e0-73ac0cbdcf16 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:01:51.368340 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-4349a779-3e86-42cc-84e0-73ac0cbdcf16 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] [instance: 3eca80cc-f4b3-495a-b8a9-f7d1652bc19d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:01:51.424399 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-4349a779-3e86-42cc-84e0-73ac0cbdcf16 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683395f4e85a46778aa7d79c593e891a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f19c254bc18540a0907bbdaa0c639cac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:01:51.431409 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-4349a779-3e86-42cc-84e0-73ac0cbdcf16 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] 10.222.0.43 "GET /compute/v2.1/servers/3eca80cc-f4b3-495a-b8a9-f7d1652bc19d" status: 200 len: 1262 microversion: 2.1 time: 0.068301 Oct 04 23:01:51.432359 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3385/7590] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:01:51 2022] GET /compute/v2.1/servers/3eca80cc-f4b3-495a-b8a9-f7d1652bc19d => generated 1262 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:01:52.455211 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-1a89a2b3-ac2d-491d-81e9-b1d34e9a7a71 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:01:52.455844 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-1a89a2b3-ac2d-491d-81e9-b1d34e9a7a71 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] [instance: 3eca80cc-f4b3-495a-b8a9-f7d1652bc19d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:01:52.464053 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1a89a2b3-ac2d-491d-81e9-b1d34e9a7a71 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:01:52.464547 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1a89a2b3-ac2d-491d-81e9-b1d34e9a7a71 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:01:52.464997 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1a89a2b3-ac2d-491d-81e9-b1d34e9a7a71 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:01:52.465701 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1a89a2b3-ac2d-491d-81e9-b1d34e9a7a71 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:01:52.466169 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1a89a2b3-ac2d-491d-81e9-b1d34e9a7a71 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:01:52.466628 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1a89a2b3-ac2d-491d-81e9-b1d34e9a7a71 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:01:52.534947 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-1a89a2b3-ac2d-491d-81e9-b1d34e9a7a71 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683395f4e85a46778aa7d79c593e891a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f19c254bc18540a0907bbdaa0c639cac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:01:52.543301 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-1a89a2b3-ac2d-491d-81e9-b1d34e9a7a71 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] 10.222.0.43 "GET /compute/v2.1/servers/3eca80cc-f4b3-495a-b8a9-f7d1652bc19d" status: 200 len: 1320 microversion: 2.1 time: 0.092667 Oct 04 23:01:52.543962 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4206/7591] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:01:52 2022] GET /compute/v2.1/servers/3eca80cc-f4b3-495a-b8a9-f7d1652bc19d => generated 1320 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:01:53.565773 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-096701dc-0c70-4e6d-a01b-150b80b3c043 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:01:53.566423 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-096701dc-0c70-4e6d-a01b-150b80b3c043 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] [instance: 3eca80cc-f4b3-495a-b8a9-f7d1652bc19d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:01:53.574024 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-096701dc-0c70-4e6d-a01b-150b80b3c043 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:01:53.574556 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-096701dc-0c70-4e6d-a01b-150b80b3c043 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:01:53.575013 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-096701dc-0c70-4e6d-a01b-150b80b3c043 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:01:53.575733 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-096701dc-0c70-4e6d-a01b-150b80b3c043 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:01:53.576199 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-096701dc-0c70-4e6d-a01b-150b80b3c043 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:01:53.576633 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-096701dc-0c70-4e6d-a01b-150b80b3c043 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:01:53.702464 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-61e81df7-2fbd-4865-88bb-661dea81f137 req-b17acf0a-b3b2-43cf-8274-ca9b26331a2f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3eca80cc-f4b3-495a-b8a9-f7d1652bc19d", "tag": "f15d334e-6841-4d41-82ea-1a367b8016f9"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 23:01:53.716447 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-61e81df7-2fbd-4865-88bb-661dea81f137 req-b17acf0a-b3b2-43cf-8274-ca9b26331a2f service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:01:53.716663 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-61e81df7-2fbd-4865-88bb-661dea81f137 req-b17acf0a-b3b2-43cf-8274-ca9b26331a2f service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:01:53.718181 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-61e81df7-2fbd-4865-88bb-661dea81f137 req-b17acf0a-b3b2-43cf-8274-ca9b26331a2f service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:01:53.731006 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-61e81df7-2fbd-4865-88bb-661dea81f137 req-b17acf0a-b3b2-43cf-8274-ca9b26331a2f service nova] Creating event network-changed:f15d334e-6841-4d41-82ea-1a367b8016f9 for instance 3eca80cc-f4b3-495a-b8a9-f7d1652bc19d on n-h1-860284-1 Oct 04 23:01:53.737337 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-61e81df7-2fbd-4865-88bb-661dea81f137 req-b17acf0a-b3b2-43cf-8274-ca9b26331a2f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039797 Oct 04 23:01:53.737957 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4207/7592] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 23:01:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 23:01:53.807581 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-096701dc-0c70-4e6d-a01b-150b80b3c043 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683395f4e85a46778aa7d79c593e891a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f19c254bc18540a0907bbdaa0c639cac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:01:53.817117 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-096701dc-0c70-4e6d-a01b-150b80b3c043 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] 10.222.0.43 "GET /compute/v2.1/servers/3eca80cc-f4b3-495a-b8a9-f7d1652bc19d" status: 200 len: 1362 microversion: 2.1 time: 0.255277 Oct 04 23:01:53.817725 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3386/7593] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:01:53 2022] GET /compute/v2.1/servers/3eca80cc-f4b3-495a-b8a9-f7d1652bc19d => generated 1362 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:01:54.840681 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-017aca14-7b9a-4bbb-9204-9603d2d4635e tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:01:54.841438 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-017aca14-7b9a-4bbb-9204-9603d2d4635e tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] [instance: 3eca80cc-f4b3-495a-b8a9-f7d1652bc19d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:01:54.848610 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-017aca14-7b9a-4bbb-9204-9603d2d4635e tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:01:54.849116 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-017aca14-7b9a-4bbb-9204-9603d2d4635e tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:01:54.849570 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-017aca14-7b9a-4bbb-9204-9603d2d4635e tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:01:54.850284 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-017aca14-7b9a-4bbb-9204-9603d2d4635e tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:01:54.850784 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-017aca14-7b9a-4bbb-9204-9603d2d4635e tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:01:54.851243 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-017aca14-7b9a-4bbb-9204-9603d2d4635e tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:01:54.980889 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-017aca14-7b9a-4bbb-9204-9603d2d4635e tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683395f4e85a46778aa7d79c593e891a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f19c254bc18540a0907bbdaa0c639cac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:01:54.988725 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-017aca14-7b9a-4bbb-9204-9603d2d4635e tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] 10.222.0.43 "GET /compute/v2.1/servers/3eca80cc-f4b3-495a-b8a9-f7d1652bc19d" status: 200 len: 1362 microversion: 2.1 time: 0.152399 Oct 04 23:01:54.989558 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4208/7594] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:01:54 2022] GET /compute/v2.1/servers/3eca80cc-f4b3-495a-b8a9-f7d1652bc19d => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:01:56.012878 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-ed884699-e7d2-459b-ae47-a7951436dc87 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:01:56.013503 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-ed884699-e7d2-459b-ae47-a7951436dc87 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] [instance: 3eca80cc-f4b3-495a-b8a9-f7d1652bc19d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:01:56.020810 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ed884699-e7d2-459b-ae47-a7951436dc87 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:01:56.021296 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ed884699-e7d2-459b-ae47-a7951436dc87 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:01:56.021739 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ed884699-e7d2-459b-ae47-a7951436dc87 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:01:56.022469 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ed884699-e7d2-459b-ae47-a7951436dc87 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:01:56.022938 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ed884699-e7d2-459b-ae47-a7951436dc87 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:01:56.023371 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ed884699-e7d2-459b-ae47-a7951436dc87 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:01:56.158056 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-ed884699-e7d2-459b-ae47-a7951436dc87 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683395f4e85a46778aa7d79c593e891a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f19c254bc18540a0907bbdaa0c639cac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:01:56.165921 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-ed884699-e7d2-459b-ae47-a7951436dc87 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] 10.222.0.43 "GET /compute/v2.1/servers/3eca80cc-f4b3-495a-b8a9-f7d1652bc19d" status: 200 len: 1362 microversion: 2.1 time: 0.157215 Oct 04 23:01:56.166579 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3387/7595] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:01:56 2022] GET /compute/v2.1/servers/3eca80cc-f4b3-495a-b8a9-f7d1652bc19d => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:01:57.189227 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-9ebf39aa-efd5-47ef-a736-654844b1b444 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:01:57.189851 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-9ebf39aa-efd5-47ef-a736-654844b1b444 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] [instance: 3eca80cc-f4b3-495a-b8a9-f7d1652bc19d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:01:57.196803 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9ebf39aa-efd5-47ef-a736-654844b1b444 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:01:57.197296 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9ebf39aa-efd5-47ef-a736-654844b1b444 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:01:57.197754 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9ebf39aa-efd5-47ef-a736-654844b1b444 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:01:57.198484 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9ebf39aa-efd5-47ef-a736-654844b1b444 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:01:57.198954 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9ebf39aa-efd5-47ef-a736-654844b1b444 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:01:57.199394 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9ebf39aa-efd5-47ef-a736-654844b1b444 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:01:57.329877 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-9ebf39aa-efd5-47ef-a736-654844b1b444 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683395f4e85a46778aa7d79c593e891a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f19c254bc18540a0907bbdaa0c639cac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:01:57.337677 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-9ebf39aa-efd5-47ef-a736-654844b1b444 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] 10.222.0.43 "GET /compute/v2.1/servers/3eca80cc-f4b3-495a-b8a9-f7d1652bc19d" status: 200 len: 1362 microversion: 2.1 time: 0.152556 Oct 04 23:01:57.338262 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4209/7596] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:01:57 2022] GET /compute/v2.1/servers/3eca80cc-f4b3-495a-b8a9-f7d1652bc19d => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:01:58.319481 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-34630185-9f6c-43de-bdd0-065fa8b2c563 req-b8e437d2-0055-4489-89f3-cbe731d62e38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3eca80cc-f4b3-495a-b8a9-f7d1652bc19d", "name": "network-vif-plugged", "status": "completed", "tag": "f15d334e-6841-4d41-82ea-1a367b8016f9"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 23:01:58.329914 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-34630185-9f6c-43de-bdd0-065fa8b2c563 req-b8e437d2-0055-4489-89f3-cbe731d62e38 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:01:58.330426 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-34630185-9f6c-43de-bdd0-065fa8b2c563 req-b8e437d2-0055-4489-89f3-cbe731d62e38 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:01:58.330870 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-34630185-9f6c-43de-bdd0-065fa8b2c563 req-b8e437d2-0055-4489-89f3-cbe731d62e38 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:01:58.342437 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-34630185-9f6c-43de-bdd0-065fa8b2c563 req-b8e437d2-0055-4489-89f3-cbe731d62e38 service nova] Creating event network-vif-plugged:f15d334e-6841-4d41-82ea-1a367b8016f9 for instance 3eca80cc-f4b3-495a-b8a9-f7d1652bc19d on n-h1-860284-1 Oct 04 23:01:58.347794 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-34630185-9f6c-43de-bdd0-065fa8b2c563 req-b8e437d2-0055-4489-89f3-cbe731d62e38 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032310 Oct 04 23:01:58.348584 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3388/7597] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 23:01:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 23:01:58.362279 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-df1456a2-1516-4ccb-b6aa-1ec755c5f95e tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:01:58.363672 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-df1456a2-1516-4ccb-b6aa-1ec755c5f95e tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] [instance: 3eca80cc-f4b3-495a-b8a9-f7d1652bc19d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:01:58.371334 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-df1456a2-1516-4ccb-b6aa-1ec755c5f95e tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:01:58.371842 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-df1456a2-1516-4ccb-b6aa-1ec755c5f95e tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:01:58.372298 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-df1456a2-1516-4ccb-b6aa-1ec755c5f95e tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:01:58.373441 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-df1456a2-1516-4ccb-b6aa-1ec755c5f95e tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:01:58.375000 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-df1456a2-1516-4ccb-b6aa-1ec755c5f95e tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:01:58.375621 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-df1456a2-1516-4ccb-b6aa-1ec755c5f95e tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:01:58.514006 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-df1456a2-1516-4ccb-b6aa-1ec755c5f95e tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683395f4e85a46778aa7d79c593e891a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f19c254bc18540a0907bbdaa0c639cac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:01:58.521828 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-df1456a2-1516-4ccb-b6aa-1ec755c5f95e tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] 10.222.0.43 "GET /compute/v2.1/servers/3eca80cc-f4b3-495a-b8a9-f7d1652bc19d" status: 200 len: 1362 microversion: 2.1 time: 0.164085 Oct 04 23:01:58.522433 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4210/7598] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:01:58 2022] GET /compute/v2.1/servers/3eca80cc-f4b3-495a-b8a9-f7d1652bc19d => generated 1362 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 23:01:59.546722 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-4aa0389f-7cde-409c-99dc-c5e96ff26333 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:01:59.547439 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-4aa0389f-7cde-409c-99dc-c5e96ff26333 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] [instance: 3eca80cc-f4b3-495a-b8a9-f7d1652bc19d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:01:59.554769 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4aa0389f-7cde-409c-99dc-c5e96ff26333 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:01:59.555242 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4aa0389f-7cde-409c-99dc-c5e96ff26333 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:01:59.555687 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4aa0389f-7cde-409c-99dc-c5e96ff26333 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:01:59.556383 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4aa0389f-7cde-409c-99dc-c5e96ff26333 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:01:59.556842 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4aa0389f-7cde-409c-99dc-c5e96ff26333 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:01:59.557274 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4aa0389f-7cde-409c-99dc-c5e96ff26333 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:01:59.691867 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-4aa0389f-7cde-409c-99dc-c5e96ff26333 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683395f4e85a46778aa7d79c593e891a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f19c254bc18540a0907bbdaa0c639cac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:01:59.700250 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-4aa0389f-7cde-409c-99dc-c5e96ff26333 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] 10.222.0.43 "GET /compute/v2.1/servers/3eca80cc-f4b3-495a-b8a9-f7d1652bc19d" status: 200 len: 1362 microversion: 2.1 time: 0.158669 Oct 04 23:01:59.700874 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3389/7599] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:01:59 2022] GET /compute/v2.1/servers/3eca80cc-f4b3-495a-b8a9-f7d1652bc19d => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:02:00.723672 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-ea69578c-abff-4d25-8679-02c09e619090 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:02:00.724322 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-ea69578c-abff-4d25-8679-02c09e619090 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] [instance: 3eca80cc-f4b3-495a-b8a9-f7d1652bc19d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:02:00.731235 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ea69578c-abff-4d25-8679-02c09e619090 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:02:00.731664 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ea69578c-abff-4d25-8679-02c09e619090 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:02:00.732107 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ea69578c-abff-4d25-8679-02c09e619090 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:02:00.732835 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ea69578c-abff-4d25-8679-02c09e619090 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:02:00.733402 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ea69578c-abff-4d25-8679-02c09e619090 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:02:00.733839 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ea69578c-abff-4d25-8679-02c09e619090 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:02:00.865423 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-ea69578c-abff-4d25-8679-02c09e619090 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683395f4e85a46778aa7d79c593e891a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f19c254bc18540a0907bbdaa0c639cac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:02:00.873114 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-ea69578c-abff-4d25-8679-02c09e619090 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] 10.222.0.43 "GET /compute/v2.1/servers/3eca80cc-f4b3-495a-b8a9-f7d1652bc19d" status: 200 len: 1554 microversion: 2.1 time: 0.153382 Oct 04 23:02:00.874197 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4211/7600] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:02:00 2022] GET /compute/v2.1/servers/3eca80cc-f4b3-495a-b8a9-f7d1652bc19d => generated 1554 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:02:00.896386 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-b183565f-6ca0-4b77-9220-35b7ef618b59 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:02:00.897000 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-b183565f-6ca0-4b77-9220-35b7ef618b59 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] [instance: 3eca80cc-f4b3-495a-b8a9-f7d1652bc19d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:02:00.904552 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b183565f-6ca0-4b77-9220-35b7ef618b59 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:02:00.905063 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b183565f-6ca0-4b77-9220-35b7ef618b59 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:02:00.905502 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b183565f-6ca0-4b77-9220-35b7ef618b59 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:02:00.906198 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b183565f-6ca0-4b77-9220-35b7ef618b59 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:02:00.906676 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b183565f-6ca0-4b77-9220-35b7ef618b59 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:02:00.907104 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b183565f-6ca0-4b77-9220-35b7ef618b59 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:02:01.035557 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-b183565f-6ca0-4b77-9220-35b7ef618b59 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683395f4e85a46778aa7d79c593e891a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f19c254bc18540a0907bbdaa0c639cac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:02:01.043313 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-b183565f-6ca0-4b77-9220-35b7ef618b59 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] 10.222.0.43 "GET /compute/v2.1/servers/3eca80cc-f4b3-495a-b8a9-f7d1652bc19d" status: 200 len: 1554 microversion: 2.1 time: 0.150802 Oct 04 23:02:01.043893 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3390/7601] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:02:00 2022] GET /compute/v2.1/servers/3eca80cc-f4b3-495a-b8a9-f7d1652bc19d => generated 1554 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:02:02.560642 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-08ae9bb7-767c-49db-8de1-6d24f28e8afb tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "45d7a027-bd3c-49f7-9d1d-1e900a57c701"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 23:02:02.563245 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-08ae9bb7-767c-49db-8de1-6d24f28e8afb tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] [instance: 3eca80cc-f4b3-495a-b8a9-f7d1652bc19d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:02:02.565759 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=2 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:02:02.566584 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=6 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:02:02.573706 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-08ae9bb7-767c-49db-8de1-6d24f28e8afb tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:02:02.574202 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-08ae9bb7-767c-49db-8de1-6d24f28e8afb tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:02:02.574678 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-08ae9bb7-767c-49db-8de1-6d24f28e8afb tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:02:02.575400 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-08ae9bb7-767c-49db-8de1-6d24f28e8afb tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:02:02.575843 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-08ae9bb7-767c-49db-8de1-6d24f28e8afb tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:02:02.576282 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-08ae9bb7-767c-49db-8de1-6d24f28e8afb tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:02:02.805250 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:02:02.816496 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-08ae9bb7-767c-49db-8de1-6d24f28e8afb tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] 10.222.0.43 "POST /compute/v2.1/servers/3eca80cc-f4b3-495a-b8a9-f7d1652bc19d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.259565 Oct 04 23:02:02.817170 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4212/7602] 10.222.0.43 () {60 vars in 1323 bytes} [Tue Oct 4 23:02:02 2022] POST /compute/v2.1/servers/3eca80cc-f4b3-495a-b8a9-f7d1652bc19d/os-volume_attachments => generated 194 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 23:02:13.534894 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-73289c97-d83b-487b-9004-cd037013c213 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:02:13.535447 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-73289c97-d83b-487b-9004-cd037013c213 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] [instance: 3eca80cc-f4b3-495a-b8a9-f7d1652bc19d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:02:13.537372 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell0:SELECT=6 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:02:13.539352 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:02:13.540050 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=64 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:02:13.548652 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-73289c97-d83b-487b-9004-cd037013c213 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:02:13.549153 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-73289c97-d83b-487b-9004-cd037013c213 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:02:13.549605 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-73289c97-d83b-487b-9004-cd037013c213 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:02:13.550323 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-73289c97-d83b-487b-9004-cd037013c213 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:02:13.550821 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-73289c97-d83b-487b-9004-cd037013c213 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:02:13.551266 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-73289c97-d83b-487b-9004-cd037013c213 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:02:13.633753 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.objects.instance [None req-73289c97-d83b-487b-9004-cd037013c213 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lazy-loading 'services' on Instance uuid 3eca80cc-f4b3-495a-b8a9-f7d1652bc19d {{(pid=134102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 23:02:13.707647 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-73289c97-d83b-487b-9004-cd037013c213 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] 10.222.0.43 "DELETE /compute/v2.1/servers/3eca80cc-f4b3-495a-b8a9-f7d1652bc19d/os-volume_attachments/45d7a027-bd3c-49f7-9d1d-1e900a57c701" status: 202 len: 0 microversion: 2.1 time: 0.177025 Oct 04 23:02:13.708330 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3391/7603] 10.222.0.43 () {58 vars in 1416 bytes} [Tue Oct 4 23:02:13 2022] DELETE /compute/v2.1/servers/3eca80cc-f4b3-495a-b8a9-f7d1652bc19d/os-volume_attachments/45d7a027-bd3c-49f7-9d1d-1e900a57c701 => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 23:02:13.714896 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:02:13.722744 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-cea85ca4-da5a-436c-bf8f-b59c165ddd09 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:02:13.725560 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-cea85ca4-da5a-436c-bf8f-b59c165ddd09 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] [instance: 3eca80cc-f4b3-495a-b8a9-f7d1652bc19d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:02:13.734799 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cea85ca4-da5a-436c-bf8f-b59c165ddd09 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:02:13.735316 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cea85ca4-da5a-436c-bf8f-b59c165ddd09 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:02:13.735848 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cea85ca4-da5a-436c-bf8f-b59c165ddd09 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:02:13.736582 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cea85ca4-da5a-436c-bf8f-b59c165ddd09 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:02:13.737058 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cea85ca4-da5a-436c-bf8f-b59c165ddd09 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:02:13.737525 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cea85ca4-da5a-436c-bf8f-b59c165ddd09 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:02:13.771295 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-cea85ca4-da5a-436c-bf8f-b59c165ddd09 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] 10.222.0.43 "GET /compute/v2.1/servers/3eca80cc-f4b3-495a-b8a9-f7d1652bc19d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058214 Oct 04 23:02:13.771877 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4213/7604] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 23:02:13 2022] GET /compute/v2.1/servers/3eca80cc-f4b3-495a-b8a9-f7d1652bc19d/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 23:02:14.785647 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-fafb5f09-6100-44c6-8fef-7a5c5d9c1c00 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:02:14.788079 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-fafb5f09-6100-44c6-8fef-7a5c5d9c1c00 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] [instance: 3eca80cc-f4b3-495a-b8a9-f7d1652bc19d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:02:14.794525 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fafb5f09-6100-44c6-8fef-7a5c5d9c1c00 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:02:14.795593 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fafb5f09-6100-44c6-8fef-7a5c5d9c1c00 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:02:14.796280 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fafb5f09-6100-44c6-8fef-7a5c5d9c1c00 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:02:14.796995 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fafb5f09-6100-44c6-8fef-7a5c5d9c1c00 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:02:14.797460 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fafb5f09-6100-44c6-8fef-7a5c5d9c1c00 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:02:14.797898 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fafb5f09-6100-44c6-8fef-7a5c5d9c1c00 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:02:14.829686 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-fafb5f09-6100-44c6-8fef-7a5c5d9c1c00 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] 10.222.0.43 "GET /compute/v2.1/servers/3eca80cc-f4b3-495a-b8a9-f7d1652bc19d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049247 Oct 04 23:02:14.830282 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3392/7605] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 23:02:14 2022] GET /compute/v2.1/servers/3eca80cc-f4b3-495a-b8a9-f7d1652bc19d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 23:02:15.843155 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e3daf835-ba79-46e5-8423-cef11b43c013 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:02:15.845401 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-e3daf835-ba79-46e5-8423-cef11b43c013 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] [instance: 3eca80cc-f4b3-495a-b8a9-f7d1652bc19d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:02:15.852265 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e3daf835-ba79-46e5-8423-cef11b43c013 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:02:15.852773 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e3daf835-ba79-46e5-8423-cef11b43c013 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:02:15.853375 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e3daf835-ba79-46e5-8423-cef11b43c013 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:02:15.854111 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e3daf835-ba79-46e5-8423-cef11b43c013 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:02:15.854613 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e3daf835-ba79-46e5-8423-cef11b43c013 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:02:15.855058 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e3daf835-ba79-46e5-8423-cef11b43c013 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:02:15.886803 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-e3daf835-ba79-46e5-8423-cef11b43c013 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] 10.222.0.43 "GET /compute/v2.1/servers/3eca80cc-f4b3-495a-b8a9-f7d1652bc19d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048394 Oct 04 23:02:15.887373 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4214/7606] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 23:02:15 2022] GET /compute/v2.1/servers/3eca80cc-f4b3-495a-b8a9-f7d1652bc19d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 23:02:16.899767 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-f3514bad-5a4c-499a-bad5-9ef285157762 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:02:16.901885 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-f3514bad-5a4c-499a-bad5-9ef285157762 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] [instance: 3eca80cc-f4b3-495a-b8a9-f7d1652bc19d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:02:16.909504 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f3514bad-5a4c-499a-bad5-9ef285157762 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:02:16.910005 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f3514bad-5a4c-499a-bad5-9ef285157762 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:02:16.910510 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f3514bad-5a4c-499a-bad5-9ef285157762 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:02:16.911247 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f3514bad-5a4c-499a-bad5-9ef285157762 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:02:16.911711 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f3514bad-5a4c-499a-bad5-9ef285157762 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:02:16.912146 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f3514bad-5a4c-499a-bad5-9ef285157762 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:02:16.945959 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-f3514bad-5a4c-499a-bad5-9ef285157762 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] 10.222.0.43 "GET /compute/v2.1/servers/3eca80cc-f4b3-495a-b8a9-f7d1652bc19d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050533 Oct 04 23:02:16.946577 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3393/7607] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 23:02:16 2022] GET /compute/v2.1/servers/3eca80cc-f4b3-495a-b8a9-f7d1652bc19d/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 23:02:17.958471 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-66b541d9-a7f9-4894-8dd3-b5d8b8e1b994 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:02:17.960683 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-66b541d9-a7f9-4894-8dd3-b5d8b8e1b994 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] [instance: 3eca80cc-f4b3-495a-b8a9-f7d1652bc19d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:02:17.967773 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-66b541d9-a7f9-4894-8dd3-b5d8b8e1b994 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:02:17.968270 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-66b541d9-a7f9-4894-8dd3-b5d8b8e1b994 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:02:17.968721 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-66b541d9-a7f9-4894-8dd3-b5d8b8e1b994 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:02:17.969433 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-66b541d9-a7f9-4894-8dd3-b5d8b8e1b994 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:02:17.969894 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-66b541d9-a7f9-4894-8dd3-b5d8b8e1b994 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:02:17.970333 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-66b541d9-a7f9-4894-8dd3-b5d8b8e1b994 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:02:18.000861 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-66b541d9-a7f9-4894-8dd3-b5d8b8e1b994 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] 10.222.0.43 "GET /compute/v2.1/servers/3eca80cc-f4b3-495a-b8a9-f7d1652bc19d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046354 Oct 04 23:02:18.001425 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4215/7608] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 23:02:17 2022] GET /compute/v2.1/servers/3eca80cc-f4b3-495a-b8a9-f7d1652bc19d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 23:02:19.013391 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-175af9a3-aad8-406e-8425-7523c4713c09 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:02:19.015666 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-175af9a3-aad8-406e-8425-7523c4713c09 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] [instance: 3eca80cc-f4b3-495a-b8a9-f7d1652bc19d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:02:19.022675 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-175af9a3-aad8-406e-8425-7523c4713c09 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:02:19.023169 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-175af9a3-aad8-406e-8425-7523c4713c09 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:02:19.023613 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-175af9a3-aad8-406e-8425-7523c4713c09 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:02:19.024319 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-175af9a3-aad8-406e-8425-7523c4713c09 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:02:19.024784 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-175af9a3-aad8-406e-8425-7523c4713c09 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:02:19.025218 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-175af9a3-aad8-406e-8425-7523c4713c09 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:02:19.055829 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-175af9a3-aad8-406e-8425-7523c4713c09 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] 10.222.0.43 "GET /compute/v2.1/servers/3eca80cc-f4b3-495a-b8a9-f7d1652bc19d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046535 Oct 04 23:02:19.056397 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3394/7609] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 23:02:19 2022] GET /compute/v2.1/servers/3eca80cc-f4b3-495a-b8a9-f7d1652bc19d/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 23:02:19.067230 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e30f3416-3e3b-4f5f-9a07-b5121a70d3d5 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:02:19.067748 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-e30f3416-3e3b-4f5f-9a07-b5121a70d3d5 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] [instance: 3eca80cc-f4b3-495a-b8a9-f7d1652bc19d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:02:19.074619 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e30f3416-3e3b-4f5f-9a07-b5121a70d3d5 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:02:19.075124 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e30f3416-3e3b-4f5f-9a07-b5121a70d3d5 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:02:19.075581 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e30f3416-3e3b-4f5f-9a07-b5121a70d3d5 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:02:19.076787 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e30f3416-3e3b-4f5f-9a07-b5121a70d3d5 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:02:19.077260 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e30f3416-3e3b-4f5f-9a07-b5121a70d3d5 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:02:19.077706 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e30f3416-3e3b-4f5f-9a07-b5121a70d3d5 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:02:19.158138 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-e30f3416-3e3b-4f5f-9a07-b5121a70d3d5 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] HTTP exception thrown: Instance 3eca80cc-f4b3-495a-b8a9-f7d1652bc19d is not attached to volume 45d7a027-bd3c-49f7-9d1d-1e900a57c701 Oct 04 23:02:19.160102 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e30f3416-3e3b-4f5f-9a07-b5121a70d3d5 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Request method failure captured: Oct 04 23:02:19.160102 n-d-860284-1 devstack@n-api.service[134101]: request: DELETE /compute/v2.1/servers/3eca80cc-f4b3-495a-b8a9-f7d1652bc19d/os-volume_attachments/45d7a027-bd3c-49f7-9d1d-1e900a57c701 HTTP/1.1 Oct 04 23:02:19.160102 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 23:02:19.160102 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 23:02:19.160102 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 23:02:19.160102 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 23:02:19.160102 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 23:02:19.160102 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 23:02:19.160102 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 23:02:19.160102 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 23:02:19.160102 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPLsyKdlCFO8XjqdjbrmQXEX3PBcwAUdIS8WioaXr-p_7_cJwtgaHUyODPFeeLJyGXQyvdwqmqrDZh4nYA5YDsY0Cl2qP0PAR33Qcs_3Xbjr1yupxr9M-Dez8zfZD5c6wp24-29uHaIvSJMFEze328xNsRBfzBcbBhQxrB2zkLwffVno Oct 04 23:02:19.160102 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 23:02:19.160102 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 23:02:19.160102 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 23:02:19.160102 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 23:02:19.160102 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 23:02:19.160102 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 23:02:19.160102 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: f19c254bc18540a0907bbdaa0c639cac Oct 04 23:02:19.160102 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1163339446 Oct 04 23:02:19.160102 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 23:02:19.160102 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 23:02:19.160102 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f19c254bc18540a0907bbdaa0c639cac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_f19c254bc18540a0907bbdaa0c639cac", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f19c254bc18540a0907bbdaa0c639cac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/f19c254bc18540a0907bbdaa0c639cac"}]}] Oct 04 23:02:19.160102 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-TestEncryptedCinderVolumes-1163339446 Oct 04 23:02:19.160102 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: f19c254bc18540a0907bbdaa0c639cac Oct 04 23:02:19.160102 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1163339446 Oct 04 23:02:19.160102 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-TestEncryptedCinderVolumes-1163339446-project Oct 04 23:02:19.160102 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 23:02:19.160102 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 23:02:19.160102 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 683395f4e85a46778aa7d79c593e891a Oct 04 23:02:19.160102 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-TestEncryptedCinderVolumes-1163339446-project Oct 04 23:02:19.160102 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 23:02:19.160102 n-d-860284-1 devstack@n-api.service[134101]: exception: Instance 3eca80cc-f4b3-495a-b8a9-f7d1652bc19d is not attached to volume 45d7a027-bd3c-49f7-9d1d-1e900a57c701 Oct 04 23:02:19.160102 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'server_id': '3eca80cc-f4b3-495a-b8a9-f7d1652bc19d', 'id': '45d7a027-bd3c-49f7-9d1d-1e900a57c701'} Oct 04 23:02:19.160102 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 23:02:19.160102 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 23:02:19.160102 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 04 23:02:19.160102 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 04 23:02:19.160102 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 23:02:19.160102 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 23:02:19.160102 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 04 23:02:19.160102 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 04 23:02:19.160102 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 45d7a027-bd3c-49f7-9d1d-1e900a57c701. Oct 04 23:02:19.160102 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 23:02:19.160102 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 23:02:19.160102 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 23:02:19.160102 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 23:02:19.160102 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 23:02:19.160102 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 23:02:19.160102 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 23:02:19.160102 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 23:02:19.160102 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 23:02:19.160102 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 23:02:19.160102 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 04 23:02:19.160102 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 04 23:02:19.160102 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3eca80cc-f4b3-495a-b8a9-f7d1652bc19d is not attached to volume 45d7a027-bd3c-49f7-9d1d-1e900a57c701 Oct 04 23:02:19.160102 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 23:02:19.160102 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 23:02:19.160102 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 23:02:19.160102 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 23:02:19.160102 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 23:02:19.160102 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 23:02:19.164850 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 23:02:19.164850 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 23:02:19.164850 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3eca80cc-f4b3-495a-b8a9-f7d1652bc19d is not attached to volume 45d7a027-bd3c-49f7-9d1d-1e900a57c701 Oct 04 23:02:19.164850 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 23:02:19.164850 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e30f3416-3e3b-4f5f-9a07-b5121a70d3d5 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Returning 404 to user: Instance 3eca80cc-f4b3-495a-b8a9-f7d1652bc19d is not attached to volume 45d7a027-bd3c-49f7-9d1d-1e900a57c701 {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 23:02:19.164850 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-e30f3416-3e3b-4f5f-9a07-b5121a70d3d5 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] 10.222.0.43 "DELETE /compute/v2.1/servers/3eca80cc-f4b3-495a-b8a9-f7d1652bc19d/os-volume_attachments/45d7a027-bd3c-49f7-9d1d-1e900a57c701" status: 404 len: 154 microversion: 2.1 time: 0.098367 Oct 04 23:02:19.164850 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4216/7610] 10.222.0.43 () {58 vars in 1416 bytes} [Tue Oct 4 23:02:19 2022] DELETE /compute/v2.1/servers/3eca80cc-f4b3-495a-b8a9-f7d1652bc19d/os-volume_attachments/45d7a027-bd3c-49f7-9d1d-1e900a57c701 => generated 154 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 23:02:22.513191 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-53a94f5b-87e0-473a-8ed1-e0c5bf8abf42 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:02:22.513727 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-53a94f5b-87e0-473a-8ed1-e0c5bf8abf42 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] [instance: 3eca80cc-f4b3-495a-b8a9-f7d1652bc19d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:02:22.522301 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-53a94f5b-87e0-473a-8ed1-e0c5bf8abf42 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:02:22.522818 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-53a94f5b-87e0-473a-8ed1-e0c5bf8abf42 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:02:22.523292 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-53a94f5b-87e0-473a-8ed1-e0c5bf8abf42 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:02:22.524007 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-53a94f5b-87e0-473a-8ed1-e0c5bf8abf42 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:02:22.524474 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-53a94f5b-87e0-473a-8ed1-e0c5bf8abf42 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:02:22.524930 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-53a94f5b-87e0-473a-8ed1-e0c5bf8abf42 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:02:22.552072 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-53a94f5b-87e0-473a-8ed1-e0c5bf8abf42 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] [instance: 3eca80cc-f4b3-495a-b8a9-f7d1652bc19d] Going to try to terminate instance {{(pid=134102) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 23:02:22.639934 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-53a94f5b-87e0-473a-8ed1-e0c5bf8abf42 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] 10.222.0.43 "DELETE /compute/v2.1/servers/3eca80cc-f4b3-495a-b8a9-f7d1652bc19d" status: 204 len: 0 microversion: 2.1 time: 0.130694 Oct 04 23:02:22.640769 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3395/7611] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 23:02:22 2022] DELETE /compute/v2.1/servers/3eca80cc-f4b3-495a-b8a9-f7d1652bc19d => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 23:02:22.648939 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-5aa4b5d8-92d2-4ff1-8340-5bf3840b2b97 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:02:22.649542 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-5aa4b5d8-92d2-4ff1-8340-5bf3840b2b97 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] [instance: 3eca80cc-f4b3-495a-b8a9-f7d1652bc19d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:02:22.658428 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5aa4b5d8-92d2-4ff1-8340-5bf3840b2b97 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:02:22.659235 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5aa4b5d8-92d2-4ff1-8340-5bf3840b2b97 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:02:22.659884 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5aa4b5d8-92d2-4ff1-8340-5bf3840b2b97 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:02:22.660804 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5aa4b5d8-92d2-4ff1-8340-5bf3840b2b97 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:02:22.661443 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5aa4b5d8-92d2-4ff1-8340-5bf3840b2b97 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:02:22.662051 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5aa4b5d8-92d2-4ff1-8340-5bf3840b2b97 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:02:22.806046 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-5aa4b5d8-92d2-4ff1-8340-5bf3840b2b97 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683395f4e85a46778aa7d79c593e891a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f19c254bc18540a0907bbdaa0c639cac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:02:22.815061 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-5aa4b5d8-92d2-4ff1-8340-5bf3840b2b97 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] 10.222.0.43 "GET /compute/v2.1/servers/3eca80cc-f4b3-495a-b8a9-f7d1652bc19d" status: 200 len: 1560 microversion: 2.1 time: 0.170093 Oct 04 23:02:22.815643 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4217/7612] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:02:22 2022] GET /compute/v2.1/servers/3eca80cc-f4b3-495a-b8a9-f7d1652bc19d => generated 1560 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:02:23.839566 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-4ce2a554-fab6-4366-b1c9-fab0fced8711 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:02:23.840289 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-4ce2a554-fab6-4366-b1c9-fab0fced8711 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] [instance: 3eca80cc-f4b3-495a-b8a9-f7d1652bc19d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:02:23.847984 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4ce2a554-fab6-4366-b1c9-fab0fced8711 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:02:23.848474 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4ce2a554-fab6-4366-b1c9-fab0fced8711 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:02:23.848920 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4ce2a554-fab6-4366-b1c9-fab0fced8711 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:02:23.849618 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4ce2a554-fab6-4366-b1c9-fab0fced8711 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:02:23.850080 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4ce2a554-fab6-4366-b1c9-fab0fced8711 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:02:23.850546 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4ce2a554-fab6-4366-b1c9-fab0fced8711 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:02:23.983843 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-4ce2a554-fab6-4366-b1c9-fab0fced8711 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683395f4e85a46778aa7d79c593e891a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f19c254bc18540a0907bbdaa0c639cac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:02:23.991866 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-4ce2a554-fab6-4366-b1c9-fab0fced8711 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] 10.222.0.43 "GET /compute/v2.1/servers/3eca80cc-f4b3-495a-b8a9-f7d1652bc19d" status: 200 len: 1560 microversion: 2.1 time: 0.156629 Oct 04 23:02:23.992457 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3396/7613] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:02:23 2022] GET /compute/v2.1/servers/3eca80cc-f4b3-495a-b8a9-f7d1652bc19d => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:02:25.014781 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-c467f9ba-a1b2-4c60-ad3d-df9539bdbbac tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:02:25.015524 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-c467f9ba-a1b2-4c60-ad3d-df9539bdbbac tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] [instance: 3eca80cc-f4b3-495a-b8a9-f7d1652bc19d] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:02:25.022674 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c467f9ba-a1b2-4c60-ad3d-df9539bdbbac tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:02:25.023179 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c467f9ba-a1b2-4c60-ad3d-df9539bdbbac tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:02:25.023629 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c467f9ba-a1b2-4c60-ad3d-df9539bdbbac tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:02:25.024339 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c467f9ba-a1b2-4c60-ad3d-df9539bdbbac tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:02:25.024806 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c467f9ba-a1b2-4c60-ad3d-df9539bdbbac tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:02:25.025252 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c467f9ba-a1b2-4c60-ad3d-df9539bdbbac tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:02:25.182267 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-e06c8a54-d708-4bc7-a9c3-a3b232273990 req-e9dfc0b9-11ee-472c-a99d-2f82c6982202 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3eca80cc-f4b3-495a-b8a9-f7d1652bc19d", "name": "network-vif-deleted", "tag": "f15d334e-6841-4d41-82ea-1a367b8016f9"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 23:02:25.192407 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-e06c8a54-d708-4bc7-a9c3-a3b232273990 req-e9dfc0b9-11ee-472c-a99d-2f82c6982202 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:02:25.192897 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-e06c8a54-d708-4bc7-a9c3-a3b232273990 req-e9dfc0b9-11ee-472c-a99d-2f82c6982202 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:02:25.193339 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-e06c8a54-d708-4bc7-a9c3-a3b232273990 req-e9dfc0b9-11ee-472c-a99d-2f82c6982202 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:02:25.204092 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-c467f9ba-a1b2-4c60-ad3d-df9539bdbbac tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683395f4e85a46778aa7d79c593e891a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f19c254bc18540a0907bbdaa0c639cac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:02:25.211192 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-e06c8a54-d708-4bc7-a9c3-a3b232273990 req-e9dfc0b9-11ee-472c-a99d-2f82c6982202 service nova] Creating event network-vif-deleted:f15d334e-6841-4d41-82ea-1a367b8016f9 for instance 3eca80cc-f4b3-495a-b8a9-f7d1652bc19d on n-h1-860284-1 Oct 04 23:02:25.212878 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-c467f9ba-a1b2-4c60-ad3d-df9539bdbbac tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] 10.222.0.43 "GET /compute/v2.1/servers/3eca80cc-f4b3-495a-b8a9-f7d1652bc19d" status: 200 len: 1560 microversion: 2.1 time: 0.202336 Oct 04 23:02:25.217726 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-e06c8a54-d708-4bc7-a9c3-a3b232273990 req-e9dfc0b9-11ee-472c-a99d-2f82c6982202 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039660 Oct 04 23:02:25.218763 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3397/7614] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 23:02:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 23:02:25.242736 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4218/7615] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:02:25 2022] GET /compute/v2.1/servers/3eca80cc-f4b3-495a-b8a9-f7d1652bc19d => generated 1560 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:02:26.239884 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-2afa8ace-867c-4c9d-8e17-f597321618b5 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:02:26.240586 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-2afa8ace-867c-4c9d-8e17-f597321618b5 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] [instance: 3eca80cc-f4b3-495a-b8a9-f7d1652bc19d] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:02:26.246764 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2afa8ace-867c-4c9d-8e17-f597321618b5 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:02:26.247247 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2afa8ace-867c-4c9d-8e17-f597321618b5 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:02:26.248265 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2afa8ace-867c-4c9d-8e17-f597321618b5 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:02:26.248960 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2afa8ace-867c-4c9d-8e17-f597321618b5 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:02:26.249413 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2afa8ace-867c-4c9d-8e17-f597321618b5 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:02:26.249850 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2afa8ace-867c-4c9d-8e17-f597321618b5 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:02:26.263861 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-2afa8ace-867c-4c9d-8e17-f597321618b5 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] HTTP exception thrown: Instance 3eca80cc-f4b3-495a-b8a9-f7d1652bc19d could not be found. Oct 04 23:02:26.265474 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-2afa8ace-867c-4c9d-8e17-f597321618b5 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Request method failure captured: Oct 04 23:02:26.265474 n-d-860284-1 devstack@n-api.service[134102]: request: GET /compute/v2.1/servers/3eca80cc-f4b3-495a-b8a9-f7d1652bc19d HTTP/1.1 Oct 04 23:02:26.265474 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 23:02:26.265474 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 23:02:26.265474 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 23:02:26.265474 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 23:02:26.265474 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 23:02:26.265474 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 23:02:26.265474 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 23:02:26.265474 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 23:02:26.265474 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPLsyKdlCFO8XjqdjbrmQXEX3PBcwAUdIS8WioaXr-p_7_cJwtgaHUyODPFeeLJyGXQyvdwqmqrDZh4nYA5YDsY0Cl2qP0PAR33Qcs_3Xbjr1yupxr9M-Dez8zfZD5c6wp24-29uHaIvSJMFEze328xNsRBfzBcbBhQxrB2zkLwffVno Oct 04 23:02:26.265474 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 23:02:26.265474 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 23:02:26.265474 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 23:02:26.265474 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 23:02:26.265474 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 23:02:26.265474 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 23:02:26.265474 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: f19c254bc18540a0907bbdaa0c639cac Oct 04 23:02:26.265474 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1163339446 Oct 04 23:02:26.265474 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 23:02:26.265474 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 23:02:26.265474 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f19c254bc18540a0907bbdaa0c639cac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_f19c254bc18540a0907bbdaa0c639cac", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f19c254bc18540a0907bbdaa0c639cac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/f19c254bc18540a0907bbdaa0c639cac"}]}] Oct 04 23:02:26.265474 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-TestEncryptedCinderVolumes-1163339446 Oct 04 23:02:26.265474 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: f19c254bc18540a0907bbdaa0c639cac Oct 04 23:02:26.265474 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1163339446 Oct 04 23:02:26.265474 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-TestEncryptedCinderVolumes-1163339446-project Oct 04 23:02:26.265474 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 23:02:26.265474 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 23:02:26.265474 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: 683395f4e85a46778aa7d79c593e891a Oct 04 23:02:26.265474 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-TestEncryptedCinderVolumes-1163339446-project Oct 04 23:02:26.265474 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 23:02:26.265474 n-d-860284-1 devstack@n-api.service[134102]: exception: Instance 3eca80cc-f4b3-495a-b8a9-f7d1652bc19d could not be found. Oct 04 23:02:26.265474 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': '3eca80cc-f4b3-495a-b8a9-f7d1652bc19d'} Oct 04 23:02:26.265474 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 23:02:26.265474 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 23:02:26.265474 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 23:02:26.265474 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 23:02:26.265474 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 23:02:26.265474 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 23:02:26.265474 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 23:02:26.265474 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 23:02:26.265474 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 23:02:26.265474 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 23:02:26.265474 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3eca80cc-f4b3-495a-b8a9-f7d1652bc19d could not be found. Oct 04 23:02:26.265474 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 23:02:26.265474 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 23:02:26.265474 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 23:02:26.265474 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 23:02:26.265474 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 23:02:26.265474 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 23:02:26.265474 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 23:02:26.265474 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 23:02:26.265474 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 23:02:26.265474 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 23:02:26.265474 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 23:02:26.265474 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 23:02:26.265474 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 23:02:26.265474 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 23:02:26.265474 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 23:02:26.265474 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 23:02:26.265474 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3eca80cc-f4b3-495a-b8a9-f7d1652bc19d could not be found. Oct 04 23:02:26.265474 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 23:02:26.265474 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 23:02:26.270577 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 23:02:26.270577 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 23:02:26.270577 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 23:02:26.270577 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 23:02:26.270577 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 23:02:26.270577 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 23:02:26.270577 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3eca80cc-f4b3-495a-b8a9-f7d1652bc19d could not be found. Oct 04 23:02:26.270577 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 23:02:26.270577 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-2afa8ace-867c-4c9d-8e17-f597321618b5 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Returning 404 to user: Instance 3eca80cc-f4b3-495a-b8a9-f7d1652bc19d could not be found. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 23:02:26.270577 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-2afa8ace-867c-4c9d-8e17-f597321618b5 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] 10.222.0.43 "GET /compute/v2.1/servers/3eca80cc-f4b3-495a-b8a9-f7d1652bc19d" status: 404 len: 111 microversion: 2.1 time: 0.032496 Oct 04 23:02:26.270577 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3398/7616] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:02:26 2022] GET /compute/v2.1/servers/3eca80cc-f4b3-495a-b8a9-f7d1652bc19d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 23:02:26.275874 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-9af9d6e7-b576-4e0b-a59b-43165985e37d tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Calling method '.version_select at 0x7fbb2da57670>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:02:26.296373 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-9af9d6e7-b576-4e0b-a59b-43165985e37d tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-446473906" status: 202 len: 0 microversion: 2.1 time: 0.024276 Oct 04 23:02:26.297024 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4219/7617] 10.222.0.43 () {58 vars in 1275 bytes} [Tue Oct 4 23:02:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-446473906 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 23:02:26.314805 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-a1a01feb-cc05-42c1-a97b-8557bc5eae90 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Action: 'create', calling method: .version_select at 0x7fbb37282e50>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-54770786", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBgCWu4nMEg174eN41mIjXLGFU/NdlSk8s6qQcMF5eGnx9L1gqffp/6Urp4AglM0EQ5bPGnNpgrk2atTQGKV0vOwTNj42TqgnyoZJ1gHNthnh98/wybgdAHbN2Ae9+PINQ=="}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 23:02:26.330699 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-a1a01feb-cc05-42c1-a97b-8557bc5eae90 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Getting quotas for project f19c254bc18540a0907bbdaa0c639cac. Resources: {'key_pairs'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 23:02:26.336505 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-a1a01feb-cc05-42c1-a97b-8557bc5eae90 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Getting quotas for user 683395f4e85a46778aa7d79c593e891a and project f19c254bc18540a0907bbdaa0c639cac. Resources: {'key_pairs'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 23:02:26.359091 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-a1a01feb-cc05-42c1-a97b-8557bc5eae90 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.048899 Oct 04 23:02:26.359685 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3399/7618] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Oct 4 23:02:26 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 23:02:26.409989 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-ad30715e-3b55-44d5-9318-2fd35c9b2d1d tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-851341633", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-54770786", "networks": [{"uuid": "b63c0596-0169-4237-9516-91637b4e0bd2"}]}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 23:02:26.463090 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.network.neutron [None req-ad30715e-3b55-44d5-9318-2fd35c9b2d1d tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] validate_networks() for [('b63c0596-0169-4237-9516-91637b4e0bd2', None, None, None, None, None)] {{(pid=134101) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 23:02:26.941201 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-ad30715e-3b55-44d5-9318-2fd35c9b2d1d tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Flavor limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 23:02:26.941647 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-ad30715e-3b55-44d5-9318-2fd35c9b2d1d tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Image limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 23:02:26.942138 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-ad30715e-3b55-44d5-9318-2fd35c9b2d1d tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Flavor pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 23:02:26.942597 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-ad30715e-3b55-44d5-9318-2fd35c9b2d1d tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Image pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 23:02:26.943025 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-ad30715e-3b55-44d5-9318-2fd35c9b2d1d tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 23:02:26.952191 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ad30715e-3b55-44d5-9318-2fd35c9b2d1d tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:02:26.952681 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ad30715e-3b55-44d5-9318-2fd35c9b2d1d tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:02:26.953128 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ad30715e-3b55-44d5-9318-2fd35c9b2d1d tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:02:26.953867 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ad30715e-3b55-44d5-9318-2fd35c9b2d1d tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:02:26.954329 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ad30715e-3b55-44d5-9318-2fd35c9b2d1d tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:02:26.954790 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ad30715e-3b55-44d5-9318-2fd35c9b2d1d tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:02:26.972782 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-ad30715e-3b55-44d5-9318-2fd35c9b2d1d tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Getting quotas for project f19c254bc18540a0907bbdaa0c639cac. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 23:02:26.978007 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-ad30715e-3b55-44d5-9318-2fd35c9b2d1d tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Getting quotas for user 683395f4e85a46778aa7d79c593e891a and project f19c254bc18540a0907bbdaa0c639cac. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 23:02:26.991431 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-ad30715e-3b55-44d5-9318-2fd35c9b2d1d tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Going to run 1 instances... {{(pid=134101) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 23:02:26.993791 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-ad30715e-3b55-44d5-9318-2fd35c9b2d1d tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] [instance: cc09206e-4e98-4e3d-9a5f-ef1076ff38db] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='58548514-5dac-426c-81f5-19e3fba33e23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134101) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 23:02:27.041079 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-ad30715e-3b55-44d5-9318-2fd35c9b2d1d tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.635144 Oct 04 23:02:27.041737 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4220/7619] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 23:02:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 636 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 23:02:27.053936 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-c26fef02-5fbc-4861-9c0d-5894dccedf3b tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:02:27.054595 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-c26fef02-5fbc-4861-9c0d-5894dccedf3b tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] [instance: cc09206e-4e98-4e3d-9a5f-ef1076ff38db] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:02:27.110245 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-c26fef02-5fbc-4861-9c0d-5894dccedf3b tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683395f4e85a46778aa7d79c593e891a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f19c254bc18540a0907bbdaa0c639cac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:02:27.117908 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-c26fef02-5fbc-4861-9c0d-5894dccedf3b tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] 10.222.0.43 "GET /compute/v2.1/servers/cc09206e-4e98-4e3d-9a5f-ef1076ff38db" status: 200 len: 1260 microversion: 2.1 time: 0.067923 Oct 04 23:02:27.118792 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3400/7620] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:02:27 2022] GET /compute/v2.1/servers/cc09206e-4e98-4e3d-9a5f-ef1076ff38db => generated 1260 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:02:28.147080 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-4de71765-b77b-4e00-a7c1-0bc8bd9c4e26 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:02:28.148985 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-4de71765-b77b-4e00-a7c1-0bc8bd9c4e26 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] [instance: cc09206e-4e98-4e3d-9a5f-ef1076ff38db] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:02:28.162321 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4de71765-b77b-4e00-a7c1-0bc8bd9c4e26 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:02:28.164152 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4de71765-b77b-4e00-a7c1-0bc8bd9c4e26 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:02:28.165130 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4de71765-b77b-4e00-a7c1-0bc8bd9c4e26 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:02:28.166624 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4de71765-b77b-4e00-a7c1-0bc8bd9c4e26 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:02:28.168047 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4de71765-b77b-4e00-a7c1-0bc8bd9c4e26 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:02:28.169781 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4de71765-b77b-4e00-a7c1-0bc8bd9c4e26 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:02:28.277067 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-4de71765-b77b-4e00-a7c1-0bc8bd9c4e26 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683395f4e85a46778aa7d79c593e891a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f19c254bc18540a0907bbdaa0c639cac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:02:28.294097 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-4de71765-b77b-4e00-a7c1-0bc8bd9c4e26 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] 10.222.0.43 "GET /compute/v2.1/servers/cc09206e-4e98-4e3d-9a5f-ef1076ff38db" status: 200 len: 1320 microversion: 2.1 time: 0.155470 Oct 04 23:02:28.295588 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4221/7621] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:02:28 2022] GET /compute/v2.1/servers/cc09206e-4e98-4e3d-9a5f-ef1076ff38db => generated 1320 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:02:29.321459 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-f0ddb59f-7928-4ffc-8586-8c4b582842d7 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:02:29.322170 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-f0ddb59f-7928-4ffc-8586-8c4b582842d7 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] [instance: cc09206e-4e98-4e3d-9a5f-ef1076ff38db] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:02:29.329306 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f0ddb59f-7928-4ffc-8586-8c4b582842d7 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:02:29.329884 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f0ddb59f-7928-4ffc-8586-8c4b582842d7 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:02:29.330459 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f0ddb59f-7928-4ffc-8586-8c4b582842d7 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:02:29.331254 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f0ddb59f-7928-4ffc-8586-8c4b582842d7 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:02:29.331725 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f0ddb59f-7928-4ffc-8586-8c4b582842d7 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:02:29.332165 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f0ddb59f-7928-4ffc-8586-8c4b582842d7 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:02:29.532446 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-f0ddb59f-7928-4ffc-8586-8c4b582842d7 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683395f4e85a46778aa7d79c593e891a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f19c254bc18540a0907bbdaa0c639cac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:02:29.540337 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-f0ddb59f-7928-4ffc-8586-8c4b582842d7 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] 10.222.0.43 "GET /compute/v2.1/servers/cc09206e-4e98-4e3d-9a5f-ef1076ff38db" status: 200 len: 1360 microversion: 2.1 time: 0.223704 Oct 04 23:02:29.540934 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3401/7622] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:02:29 2022] GET /compute/v2.1/servers/cc09206e-4e98-4e3d-9a5f-ef1076ff38db => generated 1360 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:02:29.573087 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-75534f36-8a47-4ee9-a980-3e6f585793c3 req-b99ef61a-f59e-47fe-82d8-38bb564def58 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc09206e-4e98-4e3d-9a5f-ef1076ff38db", "tag": "c8356f5b-c1b2-4ad5-abf3-16f616220539"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 23:02:29.585738 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-75534f36-8a47-4ee9-a980-3e6f585793c3 req-b99ef61a-f59e-47fe-82d8-38bb564def58 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:02:29.586227 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-75534f36-8a47-4ee9-a980-3e6f585793c3 req-b99ef61a-f59e-47fe-82d8-38bb564def58 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:02:29.586740 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-75534f36-8a47-4ee9-a980-3e6f585793c3 req-b99ef61a-f59e-47fe-82d8-38bb564def58 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:02:29.597736 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-75534f36-8a47-4ee9-a980-3e6f585793c3 req-b99ef61a-f59e-47fe-82d8-38bb564def58 service nova] Creating event network-changed:c8356f5b-c1b2-4ad5-abf3-16f616220539 for instance cc09206e-4e98-4e3d-9a5f-ef1076ff38db on n-h2-860284-1 Oct 04 23:02:29.602594 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-75534f36-8a47-4ee9-a980-3e6f585793c3 req-b99ef61a-f59e-47fe-82d8-38bb564def58 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033538 Oct 04 23:02:29.603196 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4222/7623] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 23:02:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 23:02:30.564426 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-e1c2aa17-3db3-4886-a7fd-b868a7207575 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:02:30.565053 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-e1c2aa17-3db3-4886-a7fd-b868a7207575 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] [instance: cc09206e-4e98-4e3d-9a5f-ef1076ff38db] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:02:30.571992 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e1c2aa17-3db3-4886-a7fd-b868a7207575 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:02:30.572492 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e1c2aa17-3db3-4886-a7fd-b868a7207575 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:02:30.572940 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e1c2aa17-3db3-4886-a7fd-b868a7207575 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:02:30.573641 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e1c2aa17-3db3-4886-a7fd-b868a7207575 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:02:30.574110 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e1c2aa17-3db3-4886-a7fd-b868a7207575 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:02:30.574599 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e1c2aa17-3db3-4886-a7fd-b868a7207575 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:02:30.711397 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-e1c2aa17-3db3-4886-a7fd-b868a7207575 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683395f4e85a46778aa7d79c593e891a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f19c254bc18540a0907bbdaa0c639cac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:02:30.719056 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-e1c2aa17-3db3-4886-a7fd-b868a7207575 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] 10.222.0.43 "GET /compute/v2.1/servers/cc09206e-4e98-4e3d-9a5f-ef1076ff38db" status: 200 len: 1360 microversion: 2.1 time: 0.158648 Oct 04 23:02:30.719644 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3402/7624] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:02:30 2022] GET /compute/v2.1/servers/cc09206e-4e98-4e3d-9a5f-ef1076ff38db => generated 1360 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:02:31.743653 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-78bbf78d-9f22-43cc-9226-d3292b4763e4 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:02:31.744371 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-78bbf78d-9f22-43cc-9226-d3292b4763e4 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] [instance: cc09206e-4e98-4e3d-9a5f-ef1076ff38db] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:02:31.750637 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-78bbf78d-9f22-43cc-9226-d3292b4763e4 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:02:31.751138 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-78bbf78d-9f22-43cc-9226-d3292b4763e4 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:02:31.751595 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-78bbf78d-9f22-43cc-9226-d3292b4763e4 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:02:31.752305 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-78bbf78d-9f22-43cc-9226-d3292b4763e4 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:02:31.752786 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-78bbf78d-9f22-43cc-9226-d3292b4763e4 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:02:31.753233 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-78bbf78d-9f22-43cc-9226-d3292b4763e4 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:02:31.886526 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-78bbf78d-9f22-43cc-9226-d3292b4763e4 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683395f4e85a46778aa7d79c593e891a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f19c254bc18540a0907bbdaa0c639cac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:02:31.894768 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-78bbf78d-9f22-43cc-9226-d3292b4763e4 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] 10.222.0.43 "GET /compute/v2.1/servers/cc09206e-4e98-4e3d-9a5f-ef1076ff38db" status: 200 len: 1360 microversion: 2.1 time: 0.156555 Oct 04 23:02:31.895349 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4223/7625] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:02:31 2022] GET /compute/v2.1/servers/cc09206e-4e98-4e3d-9a5f-ef1076ff38db => generated 1360 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:02:32.919993 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-6e0d3f56-bbdf-4807-afa7-ef525d94ac07 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:02:32.920807 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-6e0d3f56-bbdf-4807-afa7-ef525d94ac07 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] [instance: cc09206e-4e98-4e3d-9a5f-ef1076ff38db] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:02:32.927816 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6e0d3f56-bbdf-4807-afa7-ef525d94ac07 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:02:32.928306 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6e0d3f56-bbdf-4807-afa7-ef525d94ac07 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:02:32.928844 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6e0d3f56-bbdf-4807-afa7-ef525d94ac07 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:02:32.929547 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6e0d3f56-bbdf-4807-afa7-ef525d94ac07 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:02:32.930006 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6e0d3f56-bbdf-4807-afa7-ef525d94ac07 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:02:32.930559 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6e0d3f56-bbdf-4807-afa7-ef525d94ac07 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:02:33.062549 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-6e0d3f56-bbdf-4807-afa7-ef525d94ac07 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683395f4e85a46778aa7d79c593e891a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f19c254bc18540a0907bbdaa0c639cac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:02:33.070178 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-6e0d3f56-bbdf-4807-afa7-ef525d94ac07 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] 10.222.0.43 "GET /compute/v2.1/servers/cc09206e-4e98-4e3d-9a5f-ef1076ff38db" status: 200 len: 1360 microversion: 2.1 time: 0.155577 Oct 04 23:02:33.070786 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3403/7626] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:02:32 2022] GET /compute/v2.1/servers/cc09206e-4e98-4e3d-9a5f-ef1076ff38db => generated 1360 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:02:34.097901 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-c3d1de1f-e341-48e8-b35d-9acbc2343073 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:02:34.098585 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-c3d1de1f-e341-48e8-b35d-9acbc2343073 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] [instance: cc09206e-4e98-4e3d-9a5f-ef1076ff38db] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:02:34.105582 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c3d1de1f-e341-48e8-b35d-9acbc2343073 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:02:34.106089 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c3d1de1f-e341-48e8-b35d-9acbc2343073 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:02:34.107086 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c3d1de1f-e341-48e8-b35d-9acbc2343073 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:02:34.107984 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c3d1de1f-e341-48e8-b35d-9acbc2343073 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:02:34.108659 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c3d1de1f-e341-48e8-b35d-9acbc2343073 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:02:34.109133 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c3d1de1f-e341-48e8-b35d-9acbc2343073 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:02:34.246685 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-c3d1de1f-e341-48e8-b35d-9acbc2343073 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683395f4e85a46778aa7d79c593e891a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f19c254bc18540a0907bbdaa0c639cac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:02:34.255118 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-c3d1de1f-e341-48e8-b35d-9acbc2343073 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] 10.222.0.43 "GET /compute/v2.1/servers/cc09206e-4e98-4e3d-9a5f-ef1076ff38db" status: 200 len: 1360 microversion: 2.1 time: 0.161328 Oct 04 23:02:34.255699 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4224/7627] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:02:34 2022] GET /compute/v2.1/servers/cc09206e-4e98-4e3d-9a5f-ef1076ff38db => generated 1360 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:02:35.277513 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-d7689e1c-2dee-4248-b1ef-7e57ef0b9182 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:02:35.278163 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-d7689e1c-2dee-4248-b1ef-7e57ef0b9182 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] [instance: cc09206e-4e98-4e3d-9a5f-ef1076ff38db] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:02:35.285241 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d7689e1c-2dee-4248-b1ef-7e57ef0b9182 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:02:35.285728 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d7689e1c-2dee-4248-b1ef-7e57ef0b9182 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:02:35.286169 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d7689e1c-2dee-4248-b1ef-7e57ef0b9182 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:02:35.286897 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d7689e1c-2dee-4248-b1ef-7e57ef0b9182 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:02:35.287354 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d7689e1c-2dee-4248-b1ef-7e57ef0b9182 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:02:35.287783 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d7689e1c-2dee-4248-b1ef-7e57ef0b9182 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:02:35.422468 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-d7689e1c-2dee-4248-b1ef-7e57ef0b9182 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683395f4e85a46778aa7d79c593e891a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f19c254bc18540a0907bbdaa0c639cac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:02:35.430161 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-d7689e1c-2dee-4248-b1ef-7e57ef0b9182 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] 10.222.0.43 "GET /compute/v2.1/servers/cc09206e-4e98-4e3d-9a5f-ef1076ff38db" status: 200 len: 1360 microversion: 2.1 time: 0.156579 Oct 04 23:02:35.430768 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3404/7628] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:02:35 2022] GET /compute/v2.1/servers/cc09206e-4e98-4e3d-9a5f-ef1076ff38db => generated 1360 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:02:36.051866 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-62eb9c0b-5c75-432d-9c3f-57b4b2cc496a req-73b61685-58cd-4b39-9a62-c1286d802742 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc09206e-4e98-4e3d-9a5f-ef1076ff38db", "name": "network-vif-plugged", "status": "completed", "tag": "c8356f5b-c1b2-4ad5-abf3-16f616220539"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 23:02:36.063097 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-62eb9c0b-5c75-432d-9c3f-57b4b2cc496a req-73b61685-58cd-4b39-9a62-c1286d802742 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:02:36.063681 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-62eb9c0b-5c75-432d-9c3f-57b4b2cc496a req-73b61685-58cd-4b39-9a62-c1286d802742 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:02:36.064164 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-62eb9c0b-5c75-432d-9c3f-57b4b2cc496a req-73b61685-58cd-4b39-9a62-c1286d802742 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:02:36.076785 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-62eb9c0b-5c75-432d-9c3f-57b4b2cc496a req-73b61685-58cd-4b39-9a62-c1286d802742 service nova] Creating event network-vif-plugged:c8356f5b-c1b2-4ad5-abf3-16f616220539 for instance cc09206e-4e98-4e3d-9a5f-ef1076ff38db on n-h2-860284-1 Oct 04 23:02:36.081681 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-62eb9c0b-5c75-432d-9c3f-57b4b2cc496a req-73b61685-58cd-4b39-9a62-c1286d802742 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033687 Oct 04 23:02:36.082581 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4225/7629] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 23:02:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 23:02:36.452918 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-4564639a-d625-40c8-aa10-f5b7ce378aa6 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:02:36.453548 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-4564639a-d625-40c8-aa10-f5b7ce378aa6 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] [instance: cc09206e-4e98-4e3d-9a5f-ef1076ff38db] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:02:36.460590 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4564639a-d625-40c8-aa10-f5b7ce378aa6 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:02:36.461031 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4564639a-d625-40c8-aa10-f5b7ce378aa6 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:02:36.461479 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4564639a-d625-40c8-aa10-f5b7ce378aa6 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:02:36.462185 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4564639a-d625-40c8-aa10-f5b7ce378aa6 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:02:36.462676 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4564639a-d625-40c8-aa10-f5b7ce378aa6 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:02:36.463112 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4564639a-d625-40c8-aa10-f5b7ce378aa6 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:02:36.594290 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-4564639a-d625-40c8-aa10-f5b7ce378aa6 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683395f4e85a46778aa7d79c593e891a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f19c254bc18540a0907bbdaa0c639cac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:02:36.602066 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-4564639a-d625-40c8-aa10-f5b7ce378aa6 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] 10.222.0.43 "GET /compute/v2.1/servers/cc09206e-4e98-4e3d-9a5f-ef1076ff38db" status: 200 len: 1360 microversion: 2.1 time: 0.153238 Oct 04 23:02:36.602684 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3405/7630] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:02:36 2022] GET /compute/v2.1/servers/cc09206e-4e98-4e3d-9a5f-ef1076ff38db => generated 1360 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:02:37.623267 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=2 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:02:37.624074 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=6 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:02:37.629929 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-ecd8b4e5-6ffd-4b14-bc8e-2b48f9f3b374 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:02:37.630741 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-ecd8b4e5-6ffd-4b14-bc8e-2b48f9f3b374 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] [instance: cc09206e-4e98-4e3d-9a5f-ef1076ff38db] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:02:37.650537 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ecd8b4e5-6ffd-4b14-bc8e-2b48f9f3b374 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:02:37.650537 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ecd8b4e5-6ffd-4b14-bc8e-2b48f9f3b374 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:02:37.650537 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ecd8b4e5-6ffd-4b14-bc8e-2b48f9f3b374 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:02:37.650537 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ecd8b4e5-6ffd-4b14-bc8e-2b48f9f3b374 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:02:37.650537 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ecd8b4e5-6ffd-4b14-bc8e-2b48f9f3b374 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:02:37.650537 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ecd8b4e5-6ffd-4b14-bc8e-2b48f9f3b374 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:02:37.788020 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-ecd8b4e5-6ffd-4b14-bc8e-2b48f9f3b374 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683395f4e85a46778aa7d79c593e891a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f19c254bc18540a0907bbdaa0c639cac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:02:37.796095 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-ecd8b4e5-6ffd-4b14-bc8e-2b48f9f3b374 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] 10.222.0.43 "GET /compute/v2.1/servers/cc09206e-4e98-4e3d-9a5f-ef1076ff38db" status: 200 len: 1552 microversion: 2.1 time: 0.174730 Oct 04 23:02:37.796685 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4226/7631] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:02:37 2022] GET /compute/v2.1/servers/cc09206e-4e98-4e3d-9a5f-ef1076ff38db => generated 1552 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:02:37.818907 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-cad7ce98-6f0f-405c-981e-687a39111979 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:02:37.819561 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-cad7ce98-6f0f-405c-981e-687a39111979 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] [instance: cc09206e-4e98-4e3d-9a5f-ef1076ff38db] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:02:37.821562 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell0:SELECT=6 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:02:37.828522 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cad7ce98-6f0f-405c-981e-687a39111979 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:02:37.829017 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cad7ce98-6f0f-405c-981e-687a39111979 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:02:37.829458 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cad7ce98-6f0f-405c-981e-687a39111979 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:02:37.830160 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cad7ce98-6f0f-405c-981e-687a39111979 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:02:37.830648 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cad7ce98-6f0f-405c-981e-687a39111979 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:02:37.831080 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cad7ce98-6f0f-405c-981e-687a39111979 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:02:37.960920 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-cad7ce98-6f0f-405c-981e-687a39111979 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683395f4e85a46778aa7d79c593e891a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f19c254bc18540a0907bbdaa0c639cac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:02:37.968769 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-cad7ce98-6f0f-405c-981e-687a39111979 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] 10.222.0.43 "GET /compute/v2.1/servers/cc09206e-4e98-4e3d-9a5f-ef1076ff38db" status: 200 len: 1552 microversion: 2.1 time: 0.153740 Oct 04 23:02:37.969380 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3406/7632] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:02:37 2022] GET /compute/v2.1/servers/cc09206e-4e98-4e3d-9a5f-ef1076ff38db => generated 1552 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:02:39.465836 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-b9eeb77a-0ae9-44e2-ab8f-3aa609e51070 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fa56827b-cbaf-47e1-b616-89a2c2429f64"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 23:02:39.468206 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-b9eeb77a-0ae9-44e2-ab8f-3aa609e51070 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] [instance: cc09206e-4e98-4e3d-9a5f-ef1076ff38db] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:02:39.475105 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b9eeb77a-0ae9-44e2-ab8f-3aa609e51070 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:02:39.475608 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b9eeb77a-0ae9-44e2-ab8f-3aa609e51070 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:02:39.476066 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b9eeb77a-0ae9-44e2-ab8f-3aa609e51070 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:02:39.476820 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b9eeb77a-0ae9-44e2-ab8f-3aa609e51070 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:02:39.477244 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b9eeb77a-0ae9-44e2-ab8f-3aa609e51070 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:02:39.477686 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b9eeb77a-0ae9-44e2-ab8f-3aa609e51070 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:02:39.727893 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-b9eeb77a-0ae9-44e2-ab8f-3aa609e51070 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] 10.222.0.43 "POST /compute/v2.1/servers/cc09206e-4e98-4e3d-9a5f-ef1076ff38db/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.265840 Oct 04 23:02:39.728469 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4227/7633] 10.222.0.43 () {60 vars in 1323 bytes} [Tue Oct 4 23:02:39 2022] POST /compute/v2.1/servers/cc09206e-4e98-4e3d-9a5f-ef1076ff38db/os-volume_attachments => generated 194 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 23:02:50.450449 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-dd9403a8-cdaa-423e-8ace-cbf56f8f6b69 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:02:50.450949 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-dd9403a8-cdaa-423e-8ace-cbf56f8f6b69 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] [instance: cc09206e-4e98-4e3d-9a5f-ef1076ff38db] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:02:50.454760 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:02:50.455556 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=87,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:02:50.462817 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dd9403a8-cdaa-423e-8ace-cbf56f8f6b69 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:02:50.463375 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dd9403a8-cdaa-423e-8ace-cbf56f8f6b69 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:02:50.463827 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dd9403a8-cdaa-423e-8ace-cbf56f8f6b69 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:02:50.464542 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dd9403a8-cdaa-423e-8ace-cbf56f8f6b69 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:02:50.465005 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dd9403a8-cdaa-423e-8ace-cbf56f8f6b69 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:02:50.465439 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dd9403a8-cdaa-423e-8ace-cbf56f8f6b69 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:02:50.551113 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.objects.instance [None req-dd9403a8-cdaa-423e-8ace-cbf56f8f6b69 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lazy-loading 'services' on Instance uuid cc09206e-4e98-4e3d-9a5f-ef1076ff38db {{(pid=134102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 23:02:50.622951 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-dd9403a8-cdaa-423e-8ace-cbf56f8f6b69 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] 10.222.0.43 "DELETE /compute/v2.1/servers/cc09206e-4e98-4e3d-9a5f-ef1076ff38db/os-volume_attachments/fa56827b-cbaf-47e1-b616-89a2c2429f64" status: 202 len: 0 microversion: 2.1 time: 0.176017 Oct 04 23:02:50.623595 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3407/7634] 10.222.0.43 () {58 vars in 1416 bytes} [Tue Oct 4 23:02:50 2022] DELETE /compute/v2.1/servers/cc09206e-4e98-4e3d-9a5f-ef1076ff38db/os-volume_attachments/fa56827b-cbaf-47e1-b616-89a2c2429f64 => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 23:02:50.630623 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=44,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:02:50.631427 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:02:50.636543 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-0c39a729-05e5-42c4-a465-f26ad287c540 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:02:50.638981 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-0c39a729-05e5-42c4-a465-f26ad287c540 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] [instance: cc09206e-4e98-4e3d-9a5f-ef1076ff38db] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:02:50.647152 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0c39a729-05e5-42c4-a465-f26ad287c540 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:02:50.647593 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0c39a729-05e5-42c4-a465-f26ad287c540 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:02:50.648050 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0c39a729-05e5-42c4-a465-f26ad287c540 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:02:50.648770 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0c39a729-05e5-42c4-a465-f26ad287c540 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:02:50.649244 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0c39a729-05e5-42c4-a465-f26ad287c540 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:02:50.649691 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0c39a729-05e5-42c4-a465-f26ad287c540 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:02:50.683962 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-0c39a729-05e5-42c4-a465-f26ad287c540 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] 10.222.0.43 "GET /compute/v2.1/servers/cc09206e-4e98-4e3d-9a5f-ef1076ff38db/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055283 Oct 04 23:02:50.684537 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4228/7635] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 23:02:50 2022] GET /compute/v2.1/servers/cc09206e-4e98-4e3d-9a5f-ef1076ff38db/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 23:02:51.698808 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-d7488c4b-4ade-4518-8522-8a6c51a85cfb tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:02:51.701247 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-d7488c4b-4ade-4518-8522-8a6c51a85cfb tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] [instance: cc09206e-4e98-4e3d-9a5f-ef1076ff38db] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:02:51.707936 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d7488c4b-4ade-4518-8522-8a6c51a85cfb tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:02:51.708436 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d7488c4b-4ade-4518-8522-8a6c51a85cfb tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:02:51.708882 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d7488c4b-4ade-4518-8522-8a6c51a85cfb tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:02:51.709626 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d7488c4b-4ade-4518-8522-8a6c51a85cfb tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:02:51.710065 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d7488c4b-4ade-4518-8522-8a6c51a85cfb tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:02:51.710529 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d7488c4b-4ade-4518-8522-8a6c51a85cfb tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:02:51.742566 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-d7488c4b-4ade-4518-8522-8a6c51a85cfb tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] 10.222.0.43 "GET /compute/v2.1/servers/cc09206e-4e98-4e3d-9a5f-ef1076ff38db/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049055 Oct 04 23:02:51.743153 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3408/7636] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 23:02:51 2022] GET /compute/v2.1/servers/cc09206e-4e98-4e3d-9a5f-ef1076ff38db/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 23:02:52.755660 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-2576ad7d-4640-43ea-bb46-0dc5de34f1eb tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:02:52.757909 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-2576ad7d-4640-43ea-bb46-0dc5de34f1eb tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] [instance: cc09206e-4e98-4e3d-9a5f-ef1076ff38db] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:02:52.765952 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2576ad7d-4640-43ea-bb46-0dc5de34f1eb tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:02:52.766488 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2576ad7d-4640-43ea-bb46-0dc5de34f1eb tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:02:52.766957 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2576ad7d-4640-43ea-bb46-0dc5de34f1eb tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:02:52.767695 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2576ad7d-4640-43ea-bb46-0dc5de34f1eb tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:02:52.768296 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2576ad7d-4640-43ea-bb46-0dc5de34f1eb tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:02:52.768753 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2576ad7d-4640-43ea-bb46-0dc5de34f1eb tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:02:52.801646 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-2576ad7d-4640-43ea-bb46-0dc5de34f1eb tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] 10.222.0.43 "GET /compute/v2.1/servers/cc09206e-4e98-4e3d-9a5f-ef1076ff38db/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050060 Oct 04 23:02:52.802261 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4229/7637] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 23:02:52 2022] GET /compute/v2.1/servers/cc09206e-4e98-4e3d-9a5f-ef1076ff38db/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 23:02:53.815199 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-5e862821-dba3-4df3-a52b-168b73a70e0f tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:02:53.817516 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-5e862821-dba3-4df3-a52b-168b73a70e0f tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] [instance: cc09206e-4e98-4e3d-9a5f-ef1076ff38db] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:02:53.824520 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5e862821-dba3-4df3-a52b-168b73a70e0f tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:02:53.825013 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5e862821-dba3-4df3-a52b-168b73a70e0f tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:02:53.825460 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5e862821-dba3-4df3-a52b-168b73a70e0f tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:02:53.826170 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5e862821-dba3-4df3-a52b-168b73a70e0f tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:02:53.826666 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5e862821-dba3-4df3-a52b-168b73a70e0f tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:02:53.827316 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5e862821-dba3-4df3-a52b-168b73a70e0f tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:02:53.857085 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-5e862821-dba3-4df3-a52b-168b73a70e0f tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] 10.222.0.43 "GET /compute/v2.1/servers/cc09206e-4e98-4e3d-9a5f-ef1076ff38db/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046695 Oct 04 23:02:53.857673 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3409/7638] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 23:02:53 2022] GET /compute/v2.1/servers/cc09206e-4e98-4e3d-9a5f-ef1076ff38db/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 23:02:54.870132 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-49eb8a24-d322-4032-af7e-6809c9af7b55 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:02:54.872341 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-49eb8a24-d322-4032-af7e-6809c9af7b55 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] [instance: cc09206e-4e98-4e3d-9a5f-ef1076ff38db] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:02:54.879701 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-49eb8a24-d322-4032-af7e-6809c9af7b55 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:02:54.880196 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-49eb8a24-d322-4032-af7e-6809c9af7b55 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:02:54.880646 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-49eb8a24-d322-4032-af7e-6809c9af7b55 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:02:54.881354 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-49eb8a24-d322-4032-af7e-6809c9af7b55 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:02:54.881819 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-49eb8a24-d322-4032-af7e-6809c9af7b55 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:02:54.882254 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-49eb8a24-d322-4032-af7e-6809c9af7b55 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:02:54.912934 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-49eb8a24-d322-4032-af7e-6809c9af7b55 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] 10.222.0.43 "GET /compute/v2.1/servers/cc09206e-4e98-4e3d-9a5f-ef1076ff38db/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046704 Oct 04 23:02:54.913414 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4230/7639] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 23:02:54 2022] GET /compute/v2.1/servers/cc09206e-4e98-4e3d-9a5f-ef1076ff38db/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 23:02:55.925349 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-7d6b2f77-62ac-4ae7-ae6f-45032e0414f8 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:02:55.927655 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-7d6b2f77-62ac-4ae7-ae6f-45032e0414f8 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] [instance: cc09206e-4e98-4e3d-9a5f-ef1076ff38db] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:02:55.934552 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7d6b2f77-62ac-4ae7-ae6f-45032e0414f8 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:02:55.935047 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7d6b2f77-62ac-4ae7-ae6f-45032e0414f8 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:02:55.935488 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7d6b2f77-62ac-4ae7-ae6f-45032e0414f8 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:02:55.936276 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7d6b2f77-62ac-4ae7-ae6f-45032e0414f8 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:02:55.936856 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7d6b2f77-62ac-4ae7-ae6f-45032e0414f8 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:02:55.937290 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7d6b2f77-62ac-4ae7-ae6f-45032e0414f8 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:02:55.966268 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-7d6b2f77-62ac-4ae7-ae6f-45032e0414f8 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] 10.222.0.43 "GET /compute/v2.1/servers/cc09206e-4e98-4e3d-9a5f-ef1076ff38db/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045068 Oct 04 23:02:55.966867 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3410/7640] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 23:02:55 2022] GET /compute/v2.1/servers/cc09206e-4e98-4e3d-9a5f-ef1076ff38db/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 23:02:55.978162 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-03ec48ce-ae69-407d-a358-f73bfe42bb6c tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:02:55.978705 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-03ec48ce-ae69-407d-a358-f73bfe42bb6c tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] [instance: cc09206e-4e98-4e3d-9a5f-ef1076ff38db] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:02:55.985680 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-03ec48ce-ae69-407d-a358-f73bfe42bb6c tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:02:55.986175 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-03ec48ce-ae69-407d-a358-f73bfe42bb6c tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:02:55.986671 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-03ec48ce-ae69-407d-a358-f73bfe42bb6c tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:02:55.987656 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-03ec48ce-ae69-407d-a358-f73bfe42bb6c tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:02:55.988123 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-03ec48ce-ae69-407d-a358-f73bfe42bb6c tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:02:55.988593 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-03ec48ce-ae69-407d-a358-f73bfe42bb6c tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:02:56.065603 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-03ec48ce-ae69-407d-a358-f73bfe42bb6c tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] HTTP exception thrown: Instance cc09206e-4e98-4e3d-9a5f-ef1076ff38db is not attached to volume fa56827b-cbaf-47e1-b616-89a2c2429f64 Oct 04 23:02:56.067245 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-03ec48ce-ae69-407d-a358-f73bfe42bb6c tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Request method failure captured: Oct 04 23:02:56.067245 n-d-860284-1 devstack@n-api.service[134101]: request: DELETE /compute/v2.1/servers/cc09206e-4e98-4e3d-9a5f-ef1076ff38db/os-volume_attachments/fa56827b-cbaf-47e1-b616-89a2c2429f64 HTTP/1.1 Oct 04 23:02:56.067245 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 23:02:56.067245 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 23:02:56.067245 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 23:02:56.067245 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 23:02:56.067245 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 23:02:56.067245 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 23:02:56.067245 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 23:02:56.067245 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 23:02:56.067245 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPLsyKdlCFO8XjqdjbrmQXEX3PBcwAUdIS8WioaXr-p_7_cJwtgaHUyODPFeeLJyGXQyvdwqmqrDZh4nYA5YDsY0Cl2qP0PAR33Qcs_3Xbjr1yupxr9M-Dez8zfZD5c6wp24-29uHaIvSJMFEze328xNsRBfzBcbBhQxrB2zkLwffVno Oct 04 23:02:56.067245 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 23:02:56.067245 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 23:02:56.067245 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 23:02:56.067245 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 23:02:56.067245 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 23:02:56.067245 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 23:02:56.067245 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: f19c254bc18540a0907bbdaa0c639cac Oct 04 23:02:56.067245 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1163339446 Oct 04 23:02:56.067245 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 23:02:56.067245 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 23:02:56.067245 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f19c254bc18540a0907bbdaa0c639cac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_f19c254bc18540a0907bbdaa0c639cac", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f19c254bc18540a0907bbdaa0c639cac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/f19c254bc18540a0907bbdaa0c639cac"}]}] Oct 04 23:02:56.067245 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-TestEncryptedCinderVolumes-1163339446 Oct 04 23:02:56.067245 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: f19c254bc18540a0907bbdaa0c639cac Oct 04 23:02:56.067245 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1163339446 Oct 04 23:02:56.067245 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-TestEncryptedCinderVolumes-1163339446-project Oct 04 23:02:56.067245 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 23:02:56.067245 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 23:02:56.067245 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 683395f4e85a46778aa7d79c593e891a Oct 04 23:02:56.067245 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-TestEncryptedCinderVolumes-1163339446-project Oct 04 23:02:56.067245 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 23:02:56.067245 n-d-860284-1 devstack@n-api.service[134101]: exception: Instance cc09206e-4e98-4e3d-9a5f-ef1076ff38db is not attached to volume fa56827b-cbaf-47e1-b616-89a2c2429f64 Oct 04 23:02:56.067245 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'server_id': 'cc09206e-4e98-4e3d-9a5f-ef1076ff38db', 'id': 'fa56827b-cbaf-47e1-b616-89a2c2429f64'} Oct 04 23:02:56.067245 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 23:02:56.067245 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 23:02:56.067245 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 04 23:02:56.067245 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 04 23:02:56.067245 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 23:02:56.067245 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 23:02:56.067245 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 04 23:02:56.067245 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 04 23:02:56.067245 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id fa56827b-cbaf-47e1-b616-89a2c2429f64. Oct 04 23:02:56.067245 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 23:02:56.067245 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 23:02:56.067245 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 23:02:56.067245 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 23:02:56.067245 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 23:02:56.067245 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 23:02:56.067245 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 23:02:56.067245 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 23:02:56.067245 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 23:02:56.067245 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 23:02:56.067245 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 04 23:02:56.067245 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 04 23:02:56.067245 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc09206e-4e98-4e3d-9a5f-ef1076ff38db is not attached to volume fa56827b-cbaf-47e1-b616-89a2c2429f64 Oct 04 23:02:56.067245 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 23:02:56.067245 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 23:02:56.067245 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 23:02:56.067245 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 23:02:56.067245 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 23:02:56.067245 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 23:02:56.071658 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 23:02:56.071658 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 23:02:56.071658 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc09206e-4e98-4e3d-9a5f-ef1076ff38db is not attached to volume fa56827b-cbaf-47e1-b616-89a2c2429f64 Oct 04 23:02:56.071658 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 23:02:56.071658 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-03ec48ce-ae69-407d-a358-f73bfe42bb6c tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Returning 404 to user: Instance cc09206e-4e98-4e3d-9a5f-ef1076ff38db is not attached to volume fa56827b-cbaf-47e1-b616-89a2c2429f64 {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 23:02:56.071658 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-03ec48ce-ae69-407d-a358-f73bfe42bb6c tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] 10.222.0.43 "DELETE /compute/v2.1/servers/cc09206e-4e98-4e3d-9a5f-ef1076ff38db/os-volume_attachments/fa56827b-cbaf-47e1-b616-89a2c2429f64" status: 404 len: 154 microversion: 2.1 time: 0.094611 Oct 04 23:02:56.071658 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4231/7641] 10.222.0.43 () {58 vars in 1416 bytes} [Tue Oct 4 23:02:55 2022] DELETE /compute/v2.1/servers/cc09206e-4e98-4e3d-9a5f-ef1076ff38db/os-volume_attachments/fa56827b-cbaf-47e1-b616-89a2c2429f64 => generated 154 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 23:02:59.423153 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-a0fba8ad-b197-47bd-b112-762685a46d90 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:02:59.423745 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-a0fba8ad-b197-47bd-b112-762685a46d90 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] [instance: cc09206e-4e98-4e3d-9a5f-ef1076ff38db] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:02:59.430963 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a0fba8ad-b197-47bd-b112-762685a46d90 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:02:59.431559 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a0fba8ad-b197-47bd-b112-762685a46d90 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:02:59.432017 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a0fba8ad-b197-47bd-b112-762685a46d90 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:02:59.432740 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a0fba8ad-b197-47bd-b112-762685a46d90 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:02:59.433220 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a0fba8ad-b197-47bd-b112-762685a46d90 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:02:59.433645 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a0fba8ad-b197-47bd-b112-762685a46d90 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:02:59.461382 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-a0fba8ad-b197-47bd-b112-762685a46d90 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] [instance: cc09206e-4e98-4e3d-9a5f-ef1076ff38db] Going to try to terminate instance {{(pid=134102) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 23:02:59.539324 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-a0fba8ad-b197-47bd-b112-762685a46d90 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] 10.222.0.43 "DELETE /compute/v2.1/servers/cc09206e-4e98-4e3d-9a5f-ef1076ff38db" status: 204 len: 0 microversion: 2.1 time: 0.121159 Oct 04 23:02:59.540037 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3411/7642] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 23:02:59 2022] DELETE /compute/v2.1/servers/cc09206e-4e98-4e3d-9a5f-ef1076ff38db => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 23:02:59.549515 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-81b777a3-f8d8-4535-8f53-27023f9f8f75 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:02:59.550402 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-81b777a3-f8d8-4535-8f53-27023f9f8f75 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] [instance: cc09206e-4e98-4e3d-9a5f-ef1076ff38db] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:02:59.558039 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-81b777a3-f8d8-4535-8f53-27023f9f8f75 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:02:59.558667 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-81b777a3-f8d8-4535-8f53-27023f9f8f75 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:02:59.559352 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-81b777a3-f8d8-4535-8f53-27023f9f8f75 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:02:59.560128 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-81b777a3-f8d8-4535-8f53-27023f9f8f75 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:02:59.560667 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-81b777a3-f8d8-4535-8f53-27023f9f8f75 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:02:59.561916 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-81b777a3-f8d8-4535-8f53-27023f9f8f75 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:02:59.699417 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-81b777a3-f8d8-4535-8f53-27023f9f8f75 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683395f4e85a46778aa7d79c593e891a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f19c254bc18540a0907bbdaa0c639cac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:02:59.707776 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-81b777a3-f8d8-4535-8f53-27023f9f8f75 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] 10.222.0.43 "GET /compute/v2.1/servers/cc09206e-4e98-4e3d-9a5f-ef1076ff38db" status: 200 len: 1558 microversion: 2.1 time: 0.162951 Oct 04 23:02:59.708347 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4232/7643] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:02:59 2022] GET /compute/v2.1/servers/cc09206e-4e98-4e3d-9a5f-ef1076ff38db => generated 1558 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:03:00.732457 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-3e766e4c-5c66-471b-959d-5ef06808b203 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:03:00.733390 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-3e766e4c-5c66-471b-959d-5ef06808b203 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] [instance: cc09206e-4e98-4e3d-9a5f-ef1076ff38db] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:03:00.740691 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3e766e4c-5c66-471b-959d-5ef06808b203 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:03:00.741189 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3e766e4c-5c66-471b-959d-5ef06808b203 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:03:00.741641 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3e766e4c-5c66-471b-959d-5ef06808b203 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:03:00.742355 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3e766e4c-5c66-471b-959d-5ef06808b203 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:03:00.742850 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3e766e4c-5c66-471b-959d-5ef06808b203 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:03:00.743292 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3e766e4c-5c66-471b-959d-5ef06808b203 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:03:00.872212 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-3e766e4c-5c66-471b-959d-5ef06808b203 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683395f4e85a46778aa7d79c593e891a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f19c254bc18540a0907bbdaa0c639cac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:03:00.880774 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-3e766e4c-5c66-471b-959d-5ef06808b203 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] 10.222.0.43 "GET /compute/v2.1/servers/cc09206e-4e98-4e3d-9a5f-ef1076ff38db" status: 200 len: 1558 microversion: 2.1 time: 0.152925 Oct 04 23:03:00.881369 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3412/7644] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:03:00 2022] GET /compute/v2.1/servers/cc09206e-4e98-4e3d-9a5f-ef1076ff38db => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:03:01.883716 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-1d4ab41a-753c-40d4-8f17-87e05ec5a891 req-478db450-6b22-424f-abe6-952fbe1ed8fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc09206e-4e98-4e3d-9a5f-ef1076ff38db", "name": "network-vif-deleted", "tag": "c8356f5b-c1b2-4ad5-abf3-16f616220539"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 23:03:01.895425 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-1d4ab41a-753c-40d4-8f17-87e05ec5a891 req-478db450-6b22-424f-abe6-952fbe1ed8fb service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:03:01.895981 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-1d4ab41a-753c-40d4-8f17-87e05ec5a891 req-478db450-6b22-424f-abe6-952fbe1ed8fb service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:03:01.896646 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-1d4ab41a-753c-40d4-8f17-87e05ec5a891 req-478db450-6b22-424f-abe6-952fbe1ed8fb service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:03:01.907383 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-94ded098-23aa-4935-859a-95647b2bf4fc tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:03:01.909416 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-1d4ab41a-753c-40d4-8f17-87e05ec5a891 req-478db450-6b22-424f-abe6-952fbe1ed8fb service nova] Creating event network-vif-deleted:c8356f5b-c1b2-4ad5-abf3-16f616220539 for instance cc09206e-4e98-4e3d-9a5f-ef1076ff38db on n-h2-860284-1 Oct 04 23:03:01.909637 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-94ded098-23aa-4935-859a-95647b2bf4fc tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] [instance: cc09206e-4e98-4e3d-9a5f-ef1076ff38db] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:03:01.915500 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-1d4ab41a-753c-40d4-8f17-87e05ec5a891 req-478db450-6b22-424f-abe6-952fbe1ed8fb service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035551 Oct 04 23:03:01.916382 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4233/7645] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 23:03:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 23:03:01.922581 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-94ded098-23aa-4935-859a-95647b2bf4fc tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:03:01.923079 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-94ded098-23aa-4935-859a-95647b2bf4fc tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:03:01.923520 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-94ded098-23aa-4935-859a-95647b2bf4fc tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:03:01.924235 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-94ded098-23aa-4935-859a-95647b2bf4fc tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:03:01.924688 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-94ded098-23aa-4935-859a-95647b2bf4fc tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:03:01.925117 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-94ded098-23aa-4935-859a-95647b2bf4fc tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:03:01.998953 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-94ded098-23aa-4935-859a-95647b2bf4fc tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683395f4e85a46778aa7d79c593e891a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f19c254bc18540a0907bbdaa0c639cac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:03:02.007005 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-94ded098-23aa-4935-859a-95647b2bf4fc tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] 10.222.0.43 "GET /compute/v2.1/servers/cc09206e-4e98-4e3d-9a5f-ef1076ff38db" status: 200 len: 1345 microversion: 2.1 time: 0.106372 Oct 04 23:03:02.008116 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3413/7646] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:03:01 2022] GET /compute/v2.1/servers/cc09206e-4e98-4e3d-9a5f-ef1076ff38db => generated 1345 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 23:03:03.032846 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-62dc3624-3568-40f8-8941-d9cdf98b27dc tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:03:03.033608 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-62dc3624-3568-40f8-8941-d9cdf98b27dc tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] [instance: cc09206e-4e98-4e3d-9a5f-ef1076ff38db] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:03:03.040082 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-62dc3624-3568-40f8-8941-d9cdf98b27dc tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:03:03.040584 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-62dc3624-3568-40f8-8941-d9cdf98b27dc tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:03:03.041041 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-62dc3624-3568-40f8-8941-d9cdf98b27dc tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:03:03.041789 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-62dc3624-3568-40f8-8941-d9cdf98b27dc tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:03:03.042269 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-62dc3624-3568-40f8-8941-d9cdf98b27dc tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:03:03.042837 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-62dc3624-3568-40f8-8941-d9cdf98b27dc tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:03:03.057060 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-62dc3624-3568-40f8-8941-d9cdf98b27dc tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] HTTP exception thrown: Instance cc09206e-4e98-4e3d-9a5f-ef1076ff38db could not be found. Oct 04 23:03:03.058757 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-62dc3624-3568-40f8-8941-d9cdf98b27dc tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Request method failure captured: Oct 04 23:03:03.058757 n-d-860284-1 devstack@n-api.service[134101]: request: GET /compute/v2.1/servers/cc09206e-4e98-4e3d-9a5f-ef1076ff38db HTTP/1.1 Oct 04 23:03:03.058757 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 23:03:03.058757 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 23:03:03.058757 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 23:03:03.058757 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 23:03:03.058757 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 23:03:03.058757 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 23:03:03.058757 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 23:03:03.058757 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 23:03:03.058757 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPLsyKdlCFO8XjqdjbrmQXEX3PBcwAUdIS8WioaXr-p_7_cJwtgaHUyODPFeeLJyGXQyvdwqmqrDZh4nYA5YDsY0Cl2qP0PAR33Qcs_3Xbjr1yupxr9M-Dez8zfZD5c6wp24-29uHaIvSJMFEze328xNsRBfzBcbBhQxrB2zkLwffVno Oct 04 23:03:03.058757 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 23:03:03.058757 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 23:03:03.058757 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 23:03:03.058757 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 23:03:03.058757 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 23:03:03.058757 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 23:03:03.058757 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: f19c254bc18540a0907bbdaa0c639cac Oct 04 23:03:03.058757 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1163339446 Oct 04 23:03:03.058757 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 23:03:03.058757 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 23:03:03.058757 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f19c254bc18540a0907bbdaa0c639cac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_f19c254bc18540a0907bbdaa0c639cac", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f19c254bc18540a0907bbdaa0c639cac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/f19c254bc18540a0907bbdaa0c639cac"}]}] Oct 04 23:03:03.058757 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-TestEncryptedCinderVolumes-1163339446 Oct 04 23:03:03.058757 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: f19c254bc18540a0907bbdaa0c639cac Oct 04 23:03:03.058757 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1163339446 Oct 04 23:03:03.058757 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-TestEncryptedCinderVolumes-1163339446-project Oct 04 23:03:03.058757 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 23:03:03.058757 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 23:03:03.058757 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 683395f4e85a46778aa7d79c593e891a Oct 04 23:03:03.058757 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-TestEncryptedCinderVolumes-1163339446-project Oct 04 23:03:03.058757 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 23:03:03.058757 n-d-860284-1 devstack@n-api.service[134101]: exception: Instance cc09206e-4e98-4e3d-9a5f-ef1076ff38db could not be found. Oct 04 23:03:03.058757 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': 'cc09206e-4e98-4e3d-9a5f-ef1076ff38db'} Oct 04 23:03:03.058757 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 23:03:03.058757 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 23:03:03.058757 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 23:03:03.058757 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 23:03:03.058757 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 23:03:03.058757 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 23:03:03.058757 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 23:03:03.058757 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 23:03:03.058757 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 23:03:03.058757 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 23:03:03.058757 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc09206e-4e98-4e3d-9a5f-ef1076ff38db could not be found. Oct 04 23:03:03.058757 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 23:03:03.058757 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 23:03:03.058757 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 23:03:03.058757 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 23:03:03.058757 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 23:03:03.058757 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 23:03:03.058757 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 23:03:03.058757 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 23:03:03.058757 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 23:03:03.058757 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 23:03:03.058757 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 23:03:03.058757 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 23:03:03.058757 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 23:03:03.058757 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 23:03:03.058757 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 23:03:03.058757 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 23:03:03.058757 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc09206e-4e98-4e3d-9a5f-ef1076ff38db could not be found. Oct 04 23:03:03.058757 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 23:03:03.058757 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 23:03:03.063331 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 23:03:03.063331 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 23:03:03.063331 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 23:03:03.063331 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 23:03:03.063331 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 23:03:03.063331 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 23:03:03.063331 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc09206e-4e98-4e3d-9a5f-ef1076ff38db could not be found. Oct 04 23:03:03.063331 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 23:03:03.063331 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-62dc3624-3568-40f8-8941-d9cdf98b27dc tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Returning 404 to user: Instance cc09206e-4e98-4e3d-9a5f-ef1076ff38db could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 23:03:03.063331 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-62dc3624-3568-40f8-8941-d9cdf98b27dc tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] 10.222.0.43 "GET /compute/v2.1/servers/cc09206e-4e98-4e3d-9a5f-ef1076ff38db" status: 404 len: 111 microversion: 2.1 time: 0.033320 Oct 04 23:03:03.063331 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4234/7647] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:03:03 2022] GET /compute/v2.1/servers/cc09206e-4e98-4e3d-9a5f-ef1076ff38db => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 23:03:03.069055 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-ba9e1240-a148-406c-a764-988aa616c372 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] Calling method '.version_select at 0x7fbb2f570820>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:03:03.089032 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-ba9e1240-a148-406c-a764-988aa616c372 tempest-TestEncryptedCinderVolumes-1163339446 tempest-TestEncryptedCinderVolumes-1163339446-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-54770786" status: 202 len: 0 microversion: 2.1 time: 0.023866 Oct 04 23:03:03.089615 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3414/7648] 10.222.0.43 () {58 vars in 1272 bytes} [Tue Oct 4 23:03:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-54770786 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 23:03:30.644603 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-2770781c-383c-4b28-a870-47f2539ad6a5 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Action: 'create', calling method: .version_select at 0x7fbb2da3dc10>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-249254140", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAYMnXigtlZyDjOlOut44QUsViFaOAVtanXXqV56I6X/SS6B34tSaC9uzpTLNfaKxIHgmRdbjK6YO2+2jiD6cmqANDWfiptisbMH3+ECv2I1Ja/nye+g0VnLcMFJYyUSww=="}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 23:03:30.650374 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=14 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:03:30.651063 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=34 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:03:30.663945 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-2770781c-383c-4b28-a870-47f2539ad6a5 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Getting quotas for project 79bde11f1ccc4a18919aff63b1757557. Resources: {'key_pairs'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 23:03:30.669090 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-2770781c-383c-4b28-a870-47f2539ad6a5 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Getting quotas for user 3e73b37189d04fa5a00d1c718ac9dbeb and project 79bde11f1ccc4a18919aff63b1757557. Resources: {'key_pairs'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 23:03:30.692939 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-2770781c-383c-4b28-a870-47f2539ad6a5 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.052480 Oct 04 23:03:30.693556 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4235/7649] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Oct 4 23:03:30 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 23:03:30.743924 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=53,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:03:30.744757 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:03:30.749248 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-923a2036-6e16-41a7-9f74-c7d20d348563 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1371413629", "imageRef": "7988ba44-87c7-4e6e-bbaa-3b26009fa319", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-249254140", "networks": [{"uuid": "58785199-8279-4343-9f1b-3b86be3b60be"}]}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 23:03:30.803735 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.network.neutron [None req-923a2036-6e16-41a7-9f74-c7d20d348563 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] validate_networks() for [('58785199-8279-4343-9f1b-3b86be3b60be', None, None, None, None, None)] {{(pid=134102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 23:03:31.186084 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-923a2036-6e16-41a7-9f74-c7d20d348563 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Flavor limits 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 23:03:31.186548 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-923a2036-6e16-41a7-9f74-c7d20d348563 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Image limits 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 23:03:31.187031 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-923a2036-6e16-41a7-9f74-c7d20d348563 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Flavor pref 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 23:03:31.187446 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-923a2036-6e16-41a7-9f74-c7d20d348563 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Image pref 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 23:03:31.187869 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-923a2036-6e16-41a7-9f74-c7d20d348563 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 23:03:31.196616 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-923a2036-6e16-41a7-9f74-c7d20d348563 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:03:31.197103 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-923a2036-6e16-41a7-9f74-c7d20d348563 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:03:31.197545 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-923a2036-6e16-41a7-9f74-c7d20d348563 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:03:31.198286 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-923a2036-6e16-41a7-9f74-c7d20d348563 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:03:31.198993 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-923a2036-6e16-41a7-9f74-c7d20d348563 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:03:31.199429 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-923a2036-6e16-41a7-9f74-c7d20d348563 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:03:31.216936 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-923a2036-6e16-41a7-9f74-c7d20d348563 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Getting quotas for project 79bde11f1ccc4a18919aff63b1757557. Resources: {'instances', 'ram', 'cores'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 23:03:31.222130 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-923a2036-6e16-41a7-9f74-c7d20d348563 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Getting quotas for user 3e73b37189d04fa5a00d1c718ac9dbeb and project 79bde11f1ccc4a18919aff63b1757557. Resources: {'instances', 'ram', 'cores'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 23:03:31.234690 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-923a2036-6e16-41a7-9f74-c7d20d348563 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Going to run 1 instances... {{(pid=134102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 23:03:31.237235 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-923a2036-6e16-41a7-9f74-c7d20d348563 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] [instance: 775294ed-3824-404d-b73c-2ecc16962b5c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7988ba44-87c7-4e6e-bbaa-3b26009fa319',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 23:03:31.281288 n-d-860284-1 devstack@n-api.service[134102]: ERROR oslo.messaging._drivers.impl_rabbit [None req-923a2036-6e16-41a7-9f74-c7d20d348563 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] [bd2f817c-7b36-496a-b3a6-fe3aafb6a711] AMQP server on 10.222.0.43:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 23:03:32.289176 n-d-860284-1 devstack@n-api.service[134102]: INFO oslo.messaging._drivers.impl_rabbit [None req-923a2036-6e16-41a7-9f74-c7d20d348563 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] [bd2f817c-7b36-496a-b3a6-fe3aafb6a711] Reconnected to AMQP server on 10.222.0.43:5672 via [amqp] client with port 38032. Oct 04 23:03:32.293272 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-923a2036-6e16-41a7-9f74-c7d20d348563 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.551438 Oct 04 23:03:32.294616 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3415/7650] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 23:03:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 1553 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 23:03:32.306683 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-83dab977-599c-41d0-a75e-a839ae4cf41e tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:03:32.307336 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-83dab977-599c-41d0-a75e-a839ae4cf41e tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] [instance: 775294ed-3824-404d-b73c-2ecc16962b5c] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:03:32.367387 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-83dab977-599c-41d0-a75e-a839ae4cf41e tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e73b37189d04fa5a00d1c718ac9dbeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bde11f1ccc4a18919aff63b1757557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:03:32.376448 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-83dab977-599c-41d0-a75e-a839ae4cf41e tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] 10.222.0.43 "GET /compute/v2.1/servers/775294ed-3824-404d-b73c-2ecc16962b5c" status: 200 len: 1258 microversion: 2.1 time: 0.074886 Oct 04 23:03:32.377034 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4236/7651] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:03:32 2022] GET /compute/v2.1/servers/775294ed-3824-404d-b73c-2ecc16962b5c => generated 1258 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:03:33.401138 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-448506d9-b6d3-412d-8b1c-8e722ee7c56e tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:03:33.402238 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-448506d9-b6d3-412d-8b1c-8e722ee7c56e tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] [instance: 775294ed-3824-404d-b73c-2ecc16962b5c] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:03:33.409836 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-448506d9-b6d3-412d-8b1c-8e722ee7c56e tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:03:33.410334 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-448506d9-b6d3-412d-8b1c-8e722ee7c56e tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:03:33.411071 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-448506d9-b6d3-412d-8b1c-8e722ee7c56e tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:03:33.411915 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-448506d9-b6d3-412d-8b1c-8e722ee7c56e tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:03:33.412383 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-448506d9-b6d3-412d-8b1c-8e722ee7c56e tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:03:33.412993 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-448506d9-b6d3-412d-8b1c-8e722ee7c56e tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:03:33.491556 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-448506d9-b6d3-412d-8b1c-8e722ee7c56e tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e73b37189d04fa5a00d1c718ac9dbeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bde11f1ccc4a18919aff63b1757557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:03:33.500337 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-448506d9-b6d3-412d-8b1c-8e722ee7c56e tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] 10.222.0.43 "GET /compute/v2.1/servers/775294ed-3824-404d-b73c-2ecc16962b5c" status: 200 len: 1316 microversion: 2.1 time: 0.105173 Oct 04 23:03:33.516009 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3416/7652] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:03:33 2022] GET /compute/v2.1/servers/775294ed-3824-404d-b73c-2ecc16962b5c => generated 1316 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:03:34.526939 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-9c3ecd5b-d1a4-442e-83ef-48beea25261a tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:03:34.527657 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-9c3ecd5b-d1a4-442e-83ef-48beea25261a tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] [instance: 775294ed-3824-404d-b73c-2ecc16962b5c] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:03:34.535957 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9c3ecd5b-d1a4-442e-83ef-48beea25261a tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:03:34.536879 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9c3ecd5b-d1a4-442e-83ef-48beea25261a tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:03:34.537402 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9c3ecd5b-d1a4-442e-83ef-48beea25261a tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:03:34.538233 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9c3ecd5b-d1a4-442e-83ef-48beea25261a tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:03:34.539117 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9c3ecd5b-d1a4-442e-83ef-48beea25261a tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:03:34.540206 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9c3ecd5b-d1a4-442e-83ef-48beea25261a tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:03:34.698311 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-9c3ecd5b-d1a4-442e-83ef-48beea25261a tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e73b37189d04fa5a00d1c718ac9dbeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bde11f1ccc4a18919aff63b1757557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:03:34.706749 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-9c3ecd5b-d1a4-442e-83ef-48beea25261a tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] 10.222.0.43 "GET /compute/v2.1/servers/775294ed-3824-404d-b73c-2ecc16962b5c" status: 200 len: 1358 microversion: 2.1 time: 0.183835 Oct 04 23:03:34.722775 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4237/7653] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:03:34 2022] GET /compute/v2.1/servers/775294ed-3824-404d-b73c-2ecc16962b5c => generated 1358 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:03:35.730874 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-bdd37f99-1aad-4323-ba30-53b6d928f567 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:03:35.732217 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-bdd37f99-1aad-4323-ba30-53b6d928f567 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] [instance: 775294ed-3824-404d-b73c-2ecc16962b5c] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:03:35.739890 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bdd37f99-1aad-4323-ba30-53b6d928f567 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:03:35.740634 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bdd37f99-1aad-4323-ba30-53b6d928f567 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:03:35.741088 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bdd37f99-1aad-4323-ba30-53b6d928f567 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:03:35.741992 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bdd37f99-1aad-4323-ba30-53b6d928f567 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:03:35.742798 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bdd37f99-1aad-4323-ba30-53b6d928f567 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:03:35.743552 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bdd37f99-1aad-4323-ba30-53b6d928f567 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:03:35.888449 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-bdd37f99-1aad-4323-ba30-53b6d928f567 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e73b37189d04fa5a00d1c718ac9dbeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bde11f1ccc4a18919aff63b1757557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:03:35.896527 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-bdd37f99-1aad-4323-ba30-53b6d928f567 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] 10.222.0.43 "GET /compute/v2.1/servers/775294ed-3824-404d-b73c-2ecc16962b5c" status: 200 len: 1358 microversion: 2.1 time: 0.169650 Oct 04 23:03:35.897350 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3417/7654] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:03:35 2022] GET /compute/v2.1/servers/775294ed-3824-404d-b73c-2ecc16962b5c => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:03:36.921671 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-6aa8811f-386e-44e8-a6e0-8eff9f144d2f tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:03:36.923095 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-6aa8811f-386e-44e8-a6e0-8eff9f144d2f tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] [instance: 775294ed-3824-404d-b73c-2ecc16962b5c] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:03:36.930190 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6aa8811f-386e-44e8-a6e0-8eff9f144d2f tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:03:36.930764 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6aa8811f-386e-44e8-a6e0-8eff9f144d2f tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:03:36.931219 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6aa8811f-386e-44e8-a6e0-8eff9f144d2f tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:03:36.931939 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6aa8811f-386e-44e8-a6e0-8eff9f144d2f tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:03:36.932411 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6aa8811f-386e-44e8-a6e0-8eff9f144d2f tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:03:36.932856 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6aa8811f-386e-44e8-a6e0-8eff9f144d2f tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:03:37.077411 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-6aa8811f-386e-44e8-a6e0-8eff9f144d2f tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e73b37189d04fa5a00d1c718ac9dbeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bde11f1ccc4a18919aff63b1757557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:03:37.085456 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-6aa8811f-386e-44e8-a6e0-8eff9f144d2f tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] 10.222.0.43 "GET /compute/v2.1/servers/775294ed-3824-404d-b73c-2ecc16962b5c" status: 200 len: 1358 microversion: 2.1 time: 0.169325 Oct 04 23:03:37.086056 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4238/7655] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:03:36 2022] GET /compute/v2.1/servers/775294ed-3824-404d-b73c-2ecc16962b5c => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 23:03:38.110236 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-9880552a-36c1-491a-b52f-970985e8f497 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:03:38.112059 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-9880552a-36c1-491a-b52f-970985e8f497 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] [instance: 775294ed-3824-404d-b73c-2ecc16962b5c] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:03:38.120322 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9880552a-36c1-491a-b52f-970985e8f497 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:03:38.121347 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9880552a-36c1-491a-b52f-970985e8f497 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:03:38.122620 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9880552a-36c1-491a-b52f-970985e8f497 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:03:38.123900 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9880552a-36c1-491a-b52f-970985e8f497 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:03:38.124520 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9880552a-36c1-491a-b52f-970985e8f497 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:03:38.124953 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9880552a-36c1-491a-b52f-970985e8f497 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:03:38.280252 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-9880552a-36c1-491a-b52f-970985e8f497 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e73b37189d04fa5a00d1c718ac9dbeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bde11f1ccc4a18919aff63b1757557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:03:38.288152 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-9880552a-36c1-491a-b52f-970985e8f497 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] 10.222.0.43 "GET /compute/v2.1/servers/775294ed-3824-404d-b73c-2ecc16962b5c" status: 200 len: 1358 microversion: 2.1 time: 0.182861 Oct 04 23:03:38.288760 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3418/7656] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:03:38 2022] GET /compute/v2.1/servers/775294ed-3824-404d-b73c-2ecc16962b5c => generated 1358 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:03:39.312217 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-9245135e-a7bd-439a-adf4-958329353968 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:03:39.312832 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-9245135e-a7bd-439a-adf4-958329353968 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] [instance: 775294ed-3824-404d-b73c-2ecc16962b5c] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:03:39.319827 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9245135e-a7bd-439a-adf4-958329353968 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:03:39.320343 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9245135e-a7bd-439a-adf4-958329353968 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:03:39.320803 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9245135e-a7bd-439a-adf4-958329353968 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:03:39.321527 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9245135e-a7bd-439a-adf4-958329353968 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:03:39.322471 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9245135e-a7bd-439a-adf4-958329353968 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:03:39.323130 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9245135e-a7bd-439a-adf4-958329353968 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:03:39.479117 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-9245135e-a7bd-439a-adf4-958329353968 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e73b37189d04fa5a00d1c718ac9dbeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bde11f1ccc4a18919aff63b1757557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:03:39.488689 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-9245135e-a7bd-439a-adf4-958329353968 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] 10.222.0.43 "GET /compute/v2.1/servers/775294ed-3824-404d-b73c-2ecc16962b5c" status: 200 len: 1358 microversion: 2.1 time: 0.180832 Oct 04 23:03:39.489284 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4239/7657] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:03:39 2022] GET /compute/v2.1/servers/775294ed-3824-404d-b73c-2ecc16962b5c => generated 1358 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:03:40.514607 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-428e1423-7be4-4fdf-a237-dfce1e452c3e tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:03:40.515352 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-428e1423-7be4-4fdf-a237-dfce1e452c3e tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] [instance: 775294ed-3824-404d-b73c-2ecc16962b5c] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:03:40.522874 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-428e1423-7be4-4fdf-a237-dfce1e452c3e tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:03:40.523638 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-428e1423-7be4-4fdf-a237-dfce1e452c3e tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:03:40.524247 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-428e1423-7be4-4fdf-a237-dfce1e452c3e tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:03:40.525150 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-428e1423-7be4-4fdf-a237-dfce1e452c3e tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:03:40.525788 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-428e1423-7be4-4fdf-a237-dfce1e452c3e tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:03:40.526233 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-428e1423-7be4-4fdf-a237-dfce1e452c3e tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:03:40.830904 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-428e1423-7be4-4fdf-a237-dfce1e452c3e tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e73b37189d04fa5a00d1c718ac9dbeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bde11f1ccc4a18919aff63b1757557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:03:40.838764 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-428e1423-7be4-4fdf-a237-dfce1e452c3e tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] 10.222.0.43 "GET /compute/v2.1/servers/775294ed-3824-404d-b73c-2ecc16962b5c" status: 200 len: 1358 microversion: 2.1 time: 0.329615 Oct 04 23:03:40.839347 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3419/7658] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:03:40 2022] GET /compute/v2.1/servers/775294ed-3824-404d-b73c-2ecc16962b5c => generated 1358 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:03:41.862392 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-a3ddcbeb-8e28-4076-bedf-aa441497b1b1 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:03:41.863096 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-a3ddcbeb-8e28-4076-bedf-aa441497b1b1 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] [instance: 775294ed-3824-404d-b73c-2ecc16962b5c] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:03:41.869989 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a3ddcbeb-8e28-4076-bedf-aa441497b1b1 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:03:41.870523 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a3ddcbeb-8e28-4076-bedf-aa441497b1b1 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:03:41.870971 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a3ddcbeb-8e28-4076-bedf-aa441497b1b1 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:03:41.871746 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a3ddcbeb-8e28-4076-bedf-aa441497b1b1 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:03:41.872926 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a3ddcbeb-8e28-4076-bedf-aa441497b1b1 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:03:41.873369 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a3ddcbeb-8e28-4076-bedf-aa441497b1b1 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:03:42.051793 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-a3ddcbeb-8e28-4076-bedf-aa441497b1b1 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e73b37189d04fa5a00d1c718ac9dbeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bde11f1ccc4a18919aff63b1757557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:03:42.059499 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-a3ddcbeb-8e28-4076-bedf-aa441497b1b1 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] 10.222.0.43 "GET /compute/v2.1/servers/775294ed-3824-404d-b73c-2ecc16962b5c" status: 200 len: 1358 microversion: 2.1 time: 0.201255 Oct 04 23:03:42.060083 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4240/7659] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:03:41 2022] GET /compute/v2.1/servers/775294ed-3824-404d-b73c-2ecc16962b5c => generated 1358 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:03:43.082267 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-de457b79-681d-4f41-967b-2e4e91a4291f tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:03:43.082918 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-de457b79-681d-4f41-967b-2e4e91a4291f tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] [instance: 775294ed-3824-404d-b73c-2ecc16962b5c] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:03:43.085320 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell0:SELECT=2 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:03:43.085982 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell0:SELECT=6 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:03:43.093415 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-de457b79-681d-4f41-967b-2e4e91a4291f tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:03:43.093897 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-de457b79-681d-4f41-967b-2e4e91a4291f tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:03:43.094333 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-de457b79-681d-4f41-967b-2e4e91a4291f tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:03:43.095046 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-de457b79-681d-4f41-967b-2e4e91a4291f tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:03:43.095501 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-de457b79-681d-4f41-967b-2e4e91a4291f tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:03:43.095928 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-de457b79-681d-4f41-967b-2e4e91a4291f tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:03:43.232152 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-de457b79-681d-4f41-967b-2e4e91a4291f tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e73b37189d04fa5a00d1c718ac9dbeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bde11f1ccc4a18919aff63b1757557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:03:43.240188 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-de457b79-681d-4f41-967b-2e4e91a4291f tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] 10.222.0.43 "GET /compute/v2.1/servers/775294ed-3824-404d-b73c-2ecc16962b5c" status: 200 len: 1358 microversion: 2.1 time: 0.161842 Oct 04 23:03:43.240792 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3420/7660] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:03:43 2022] GET /compute/v2.1/servers/775294ed-3824-404d-b73c-2ecc16962b5c => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:03:44.264698 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-5d04ab1e-1083-4d11-bcdf-e02c855e92f8 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:03:44.265336 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-5d04ab1e-1083-4d11-bcdf-e02c855e92f8 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] [instance: 775294ed-3824-404d-b73c-2ecc16962b5c] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:03:44.267241 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=6 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:03:44.274471 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5d04ab1e-1083-4d11-bcdf-e02c855e92f8 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:03:44.274983 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5d04ab1e-1083-4d11-bcdf-e02c855e92f8 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:03:44.275445 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5d04ab1e-1083-4d11-bcdf-e02c855e92f8 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:03:44.276164 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5d04ab1e-1083-4d11-bcdf-e02c855e92f8 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:03:44.276640 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5d04ab1e-1083-4d11-bcdf-e02c855e92f8 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:03:44.277089 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5d04ab1e-1083-4d11-bcdf-e02c855e92f8 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:03:44.409124 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-5d04ab1e-1083-4d11-bcdf-e02c855e92f8 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e73b37189d04fa5a00d1c718ac9dbeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bde11f1ccc4a18919aff63b1757557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:03:44.416923 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-5d04ab1e-1083-4d11-bcdf-e02c855e92f8 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] 10.222.0.43 "GET /compute/v2.1/servers/775294ed-3824-404d-b73c-2ecc16962b5c" status: 200 len: 1358 microversion: 2.1 time: 0.156906 Oct 04 23:03:44.417499 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4241/7661] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:03:44 2022] GET /compute/v2.1/servers/775294ed-3824-404d-b73c-2ecc16962b5c => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:03:45.440856 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-b96a1083-c07e-4f1d-a7ec-e9bb8ad2c77d tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:03:45.441400 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-b96a1083-c07e-4f1d-a7ec-e9bb8ad2c77d tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] [instance: 775294ed-3824-404d-b73c-2ecc16962b5c] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:03:45.448696 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b96a1083-c07e-4f1d-a7ec-e9bb8ad2c77d tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:03:45.449280 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b96a1083-c07e-4f1d-a7ec-e9bb8ad2c77d tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:03:45.450647 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b96a1083-c07e-4f1d-a7ec-e9bb8ad2c77d tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:03:45.451868 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b96a1083-c07e-4f1d-a7ec-e9bb8ad2c77d tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:03:45.452559 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b96a1083-c07e-4f1d-a7ec-e9bb8ad2c77d tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:03:45.452901 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b96a1083-c07e-4f1d-a7ec-e9bb8ad2c77d tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:03:45.649689 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-b96a1083-c07e-4f1d-a7ec-e9bb8ad2c77d tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e73b37189d04fa5a00d1c718ac9dbeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bde11f1ccc4a18919aff63b1757557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:03:45.659070 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-b96a1083-c07e-4f1d-a7ec-e9bb8ad2c77d tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] 10.222.0.43 "GET /compute/v2.1/servers/775294ed-3824-404d-b73c-2ecc16962b5c" status: 200 len: 1358 microversion: 2.1 time: 0.223158 Oct 04 23:03:45.659676 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3421/7662] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:03:45 2022] GET /compute/v2.1/servers/775294ed-3824-404d-b73c-2ecc16962b5c => generated 1358 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:03:46.167608 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-a488f06d-7e46-44ae-b6eb-f64e15db8e4b req-3ff4bb2f-61bc-4cd9-9d50-416ce1e6aaf9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "775294ed-3824-404d-b73c-2ecc16962b5c", "tag": "8bd0cfb4-1467-4bd8-b5d9-ef59546d57e8"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 23:03:46.178572 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-a488f06d-7e46-44ae-b6eb-f64e15db8e4b req-3ff4bb2f-61bc-4cd9-9d50-416ce1e6aaf9 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:03:46.179340 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-a488f06d-7e46-44ae-b6eb-f64e15db8e4b req-3ff4bb2f-61bc-4cd9-9d50-416ce1e6aaf9 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:03:46.179788 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-a488f06d-7e46-44ae-b6eb-f64e15db8e4b req-3ff4bb2f-61bc-4cd9-9d50-416ce1e6aaf9 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:03:46.191761 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-a488f06d-7e46-44ae-b6eb-f64e15db8e4b req-3ff4bb2f-61bc-4cd9-9d50-416ce1e6aaf9 service nova] Creating event network-changed:8bd0cfb4-1467-4bd8-b5d9-ef59546d57e8 for instance 775294ed-3824-404d-b73c-2ecc16962b5c on n-h1-860284-1 Oct 04 23:03:46.196945 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-a488f06d-7e46-44ae-b6eb-f64e15db8e4b req-3ff4bb2f-61bc-4cd9-9d50-416ce1e6aaf9 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033788 Oct 04 23:03:46.197582 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4242/7663] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 23:03:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 23:03:46.681614 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-af8477a1-7f15-4ea6-a39a-17ea0a657865 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:03:46.682192 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-af8477a1-7f15-4ea6-a39a-17ea0a657865 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] [instance: 775294ed-3824-404d-b73c-2ecc16962b5c] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:03:46.689247 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-af8477a1-7f15-4ea6-a39a-17ea0a657865 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:03:46.689738 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-af8477a1-7f15-4ea6-a39a-17ea0a657865 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:03:46.690186 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-af8477a1-7f15-4ea6-a39a-17ea0a657865 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:03:46.690927 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-af8477a1-7f15-4ea6-a39a-17ea0a657865 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:03:46.691391 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-af8477a1-7f15-4ea6-a39a-17ea0a657865 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:03:46.691829 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-af8477a1-7f15-4ea6-a39a-17ea0a657865 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:03:46.819672 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-af8477a1-7f15-4ea6-a39a-17ea0a657865 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e73b37189d04fa5a00d1c718ac9dbeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bde11f1ccc4a18919aff63b1757557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:03:46.828211 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-af8477a1-7f15-4ea6-a39a-17ea0a657865 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] 10.222.0.43 "GET /compute/v2.1/servers/775294ed-3824-404d-b73c-2ecc16962b5c" status: 200 len: 1358 microversion: 2.1 time: 0.150595 Oct 04 23:03:46.828799 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3422/7664] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:03:46 2022] GET /compute/v2.1/servers/775294ed-3824-404d-b73c-2ecc16962b5c => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:03:47.852638 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-c64cc26a-f2a9-444e-b5b0-8303c525cdfa tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:03:47.853389 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-c64cc26a-f2a9-444e-b5b0-8303c525cdfa tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] [instance: 775294ed-3824-404d-b73c-2ecc16962b5c] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:03:47.859805 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c64cc26a-f2a9-444e-b5b0-8303c525cdfa tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:03:47.860306 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c64cc26a-f2a9-444e-b5b0-8303c525cdfa tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:03:47.860767 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c64cc26a-f2a9-444e-b5b0-8303c525cdfa tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:03:47.861736 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c64cc26a-f2a9-444e-b5b0-8303c525cdfa tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:03:47.862210 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c64cc26a-f2a9-444e-b5b0-8303c525cdfa tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:03:47.862686 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c64cc26a-f2a9-444e-b5b0-8303c525cdfa tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:03:47.991621 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-c64cc26a-f2a9-444e-b5b0-8303c525cdfa tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e73b37189d04fa5a00d1c718ac9dbeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bde11f1ccc4a18919aff63b1757557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:03:47.999967 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-c64cc26a-f2a9-444e-b5b0-8303c525cdfa tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] 10.222.0.43 "GET /compute/v2.1/servers/775294ed-3824-404d-b73c-2ecc16962b5c" status: 200 len: 1358 microversion: 2.1 time: 0.152547 Oct 04 23:03:48.000549 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4243/7665] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:03:47 2022] GET /compute/v2.1/servers/775294ed-3824-404d-b73c-2ecc16962b5c => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:03:49.024036 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-9eb1e70a-4c3c-4ef3-8787-6256c4fa81b8 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:03:49.025208 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-9eb1e70a-4c3c-4ef3-8787-6256c4fa81b8 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] [instance: 775294ed-3824-404d-b73c-2ecc16962b5c] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:03:49.032828 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9eb1e70a-4c3c-4ef3-8787-6256c4fa81b8 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:03:49.033316 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9eb1e70a-4c3c-4ef3-8787-6256c4fa81b8 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:03:49.033951 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9eb1e70a-4c3c-4ef3-8787-6256c4fa81b8 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:03:49.034869 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9eb1e70a-4c3c-4ef3-8787-6256c4fa81b8 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:03:49.035332 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9eb1e70a-4c3c-4ef3-8787-6256c4fa81b8 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:03:49.035767 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9eb1e70a-4c3c-4ef3-8787-6256c4fa81b8 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:03:49.220851 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-9eb1e70a-4c3c-4ef3-8787-6256c4fa81b8 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e73b37189d04fa5a00d1c718ac9dbeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bde11f1ccc4a18919aff63b1757557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:03:49.228612 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-9eb1e70a-4c3c-4ef3-8787-6256c4fa81b8 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] 10.222.0.43 "GET /compute/v2.1/servers/775294ed-3824-404d-b73c-2ecc16962b5c" status: 200 len: 1358 microversion: 2.1 time: 0.208796 Oct 04 23:03:49.229198 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3423/7666] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:03:49 2022] GET /compute/v2.1/servers/775294ed-3824-404d-b73c-2ecc16962b5c => generated 1358 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:03:50.252417 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-ce8d208f-2678-497f-b636-badb5d4f46c2 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:03:50.253046 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-ce8d208f-2678-497f-b636-badb5d4f46c2 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] [instance: 775294ed-3824-404d-b73c-2ecc16962b5c] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:03:50.259860 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ce8d208f-2678-497f-b636-badb5d4f46c2 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:03:50.260350 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ce8d208f-2678-497f-b636-badb5d4f46c2 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:03:50.260801 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ce8d208f-2678-497f-b636-badb5d4f46c2 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:03:50.261527 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ce8d208f-2678-497f-b636-badb5d4f46c2 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:03:50.262020 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ce8d208f-2678-497f-b636-badb5d4f46c2 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:03:50.262509 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ce8d208f-2678-497f-b636-badb5d4f46c2 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:03:50.394570 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-ce8d208f-2678-497f-b636-badb5d4f46c2 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e73b37189d04fa5a00d1c718ac9dbeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bde11f1ccc4a18919aff63b1757557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:03:50.402192 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-ce8d208f-2678-497f-b636-badb5d4f46c2 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] 10.222.0.43 "GET /compute/v2.1/servers/775294ed-3824-404d-b73c-2ecc16962b5c" status: 200 len: 1358 microversion: 2.1 time: 0.153796 Oct 04 23:03:50.403308 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4244/7667] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:03:50 2022] GET /compute/v2.1/servers/775294ed-3824-404d-b73c-2ecc16962b5c => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:03:50.827061 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-1daa525f-93cf-4a31-b5df-2ecbf456ce80 req-08d71c31-a8b6-4a68-ab66-a7ba96b8eb44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "775294ed-3824-404d-b73c-2ecc16962b5c", "name": "network-vif-plugged", "status": "completed", "tag": "8bd0cfb4-1467-4bd8-b5d9-ef59546d57e8"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 23:03:50.839091 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-1daa525f-93cf-4a31-b5df-2ecbf456ce80 req-08d71c31-a8b6-4a68-ab66-a7ba96b8eb44 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:03:50.839812 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-1daa525f-93cf-4a31-b5df-2ecbf456ce80 req-08d71c31-a8b6-4a68-ab66-a7ba96b8eb44 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:03:50.840871 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-1daa525f-93cf-4a31-b5df-2ecbf456ce80 req-08d71c31-a8b6-4a68-ab66-a7ba96b8eb44 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:03:50.852284 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-1daa525f-93cf-4a31-b5df-2ecbf456ce80 req-08d71c31-a8b6-4a68-ab66-a7ba96b8eb44 service nova] Creating event network-vif-plugged:8bd0cfb4-1467-4bd8-b5d9-ef59546d57e8 for instance 775294ed-3824-404d-b73c-2ecc16962b5c on n-h1-860284-1 Oct 04 23:03:50.857754 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-1daa525f-93cf-4a31-b5df-2ecbf456ce80 req-08d71c31-a8b6-4a68-ab66-a7ba96b8eb44 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035079 Oct 04 23:03:50.858489 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3424/7668] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 23:03:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 23:03:51.425536 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-86c35940-307a-4d99-90c2-56f664ea640d tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:03:51.426174 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-86c35940-307a-4d99-90c2-56f664ea640d tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] [instance: 775294ed-3824-404d-b73c-2ecc16962b5c] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:03:51.433050 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-86c35940-307a-4d99-90c2-56f664ea640d tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:03:51.433553 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-86c35940-307a-4d99-90c2-56f664ea640d tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:03:51.434694 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-86c35940-307a-4d99-90c2-56f664ea640d tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:03:51.435500 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-86c35940-307a-4d99-90c2-56f664ea640d tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:03:51.435980 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-86c35940-307a-4d99-90c2-56f664ea640d tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:03:51.436427 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-86c35940-307a-4d99-90c2-56f664ea640d tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:03:51.563677 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-86c35940-307a-4d99-90c2-56f664ea640d tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e73b37189d04fa5a00d1c718ac9dbeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bde11f1ccc4a18919aff63b1757557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:03:51.571593 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-86c35940-307a-4d99-90c2-56f664ea640d tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] 10.222.0.43 "GET /compute/v2.1/servers/775294ed-3824-404d-b73c-2ecc16962b5c" status: 200 len: 1358 microversion: 2.1 time: 0.150016 Oct 04 23:03:51.572172 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4245/7669] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:03:51 2022] GET /compute/v2.1/servers/775294ed-3824-404d-b73c-2ecc16962b5c => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:03:52.595145 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-effc6e33-e48d-43d7-8be6-7476ac863a68 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:03:52.595962 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-effc6e33-e48d-43d7-8be6-7476ac863a68 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] [instance: 775294ed-3824-404d-b73c-2ecc16962b5c] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:03:52.603224 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-effc6e33-e48d-43d7-8be6-7476ac863a68 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:03:52.603718 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-effc6e33-e48d-43d7-8be6-7476ac863a68 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:03:52.604164 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-effc6e33-e48d-43d7-8be6-7476ac863a68 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:03:52.604870 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-effc6e33-e48d-43d7-8be6-7476ac863a68 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:03:52.605332 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-effc6e33-e48d-43d7-8be6-7476ac863a68 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:03:52.605809 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-effc6e33-e48d-43d7-8be6-7476ac863a68 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:03:52.737929 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-effc6e33-e48d-43d7-8be6-7476ac863a68 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e73b37189d04fa5a00d1c718ac9dbeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bde11f1ccc4a18919aff63b1757557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:03:52.745713 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-effc6e33-e48d-43d7-8be6-7476ac863a68 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] 10.222.0.43 "GET /compute/v2.1/servers/775294ed-3824-404d-b73c-2ecc16962b5c" status: 200 len: 1548 microversion: 2.1 time: 0.155069 Oct 04 23:03:52.746837 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3425/7670] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:03:52 2022] GET /compute/v2.1/servers/775294ed-3824-404d-b73c-2ecc16962b5c => generated 1548 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:03:52.769542 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-56bab9b9-b35e-45ab-888e-4835512a4fe6 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:03:52.770168 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-56bab9b9-b35e-45ab-888e-4835512a4fe6 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] [instance: 775294ed-3824-404d-b73c-2ecc16962b5c] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:03:52.777250 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-56bab9b9-b35e-45ab-888e-4835512a4fe6 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:03:52.777860 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-56bab9b9-b35e-45ab-888e-4835512a4fe6 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:03:52.778444 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-56bab9b9-b35e-45ab-888e-4835512a4fe6 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:03:52.779155 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-56bab9b9-b35e-45ab-888e-4835512a4fe6 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:03:52.779622 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-56bab9b9-b35e-45ab-888e-4835512a4fe6 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:03:52.780062 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-56bab9b9-b35e-45ab-888e-4835512a4fe6 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:03:52.908901 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-56bab9b9-b35e-45ab-888e-4835512a4fe6 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e73b37189d04fa5a00d1c718ac9dbeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bde11f1ccc4a18919aff63b1757557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:03:52.916593 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-56bab9b9-b35e-45ab-888e-4835512a4fe6 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] 10.222.0.43 "GET /compute/v2.1/servers/775294ed-3824-404d-b73c-2ecc16962b5c" status: 200 len: 1548 microversion: 2.1 time: 0.151009 Oct 04 23:03:52.917165 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4246/7671] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:03:52 2022] GET /compute/v2.1/servers/775294ed-3824-404d-b73c-2ecc16962b5c => generated 1548 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:03:52.939333 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-a43cd4a7-f940-40a2-9d4c-1d468a7dd76b tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:03:52.944047 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-a43cd4a7-f940-40a2-9d4c-1d468a7dd76b tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3e73b37189d04fa5a00d1c718ac9dbeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bde11f1ccc4a18919aff63b1757557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:03:52.944812 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-a43cd4a7-f940-40a2-9d4c-1d468a7dd76b tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Searching by: {'deleted': False, 'project_id': '79bde11f1ccc4a18919aff63b1757557'} {{(pid=134102) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 23:03:52.950331 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a43cd4a7-f940-40a2-9d4c-1d468a7dd76b tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:03:52.950835 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a43cd4a7-f940-40a2-9d4c-1d468a7dd76b tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:03:52.951270 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a43cd4a7-f940-40a2-9d4c-1d468a7dd76b tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:03:52.951989 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a43cd4a7-f940-40a2-9d4c-1d468a7dd76b tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:03:52.952442 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a43cd4a7-f940-40a2-9d4c-1d468a7dd76b tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:03:52.952869 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a43cd4a7-f940-40a2-9d4c-1d468a7dd76b tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:03:52.976099 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.multi_cell_list [None req-a43cd4a7-f940-40a2-9d4c-1d468a7dd76b tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=134102) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 23:03:53.003159 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-a43cd4a7-f940-40a2-9d4c-1d468a7dd76b tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] 10.222.0.43 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.067634 Oct 04 23:03:53.003736 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3426/7672] 10.222.0.43 () {58 vars in 1125 bytes} [Tue Oct 4 23:03:52 2022] GET /compute/v2.1/servers => generated 343 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 23:03:53.015427 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-b9d1c411-eae0-4393-a5c1-ab9e5c3571da tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:03:53.016086 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-b9d1c411-eae0-4393-a5c1-ab9e5c3571da tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] [instance: 775294ed-3824-404d-b73c-2ecc16962b5c] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:03:53.022138 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b9d1c411-eae0-4393-a5c1-ab9e5c3571da tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:03:53.022667 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b9d1c411-eae0-4393-a5c1-ab9e5c3571da tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:03:53.023123 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b9d1c411-eae0-4393-a5c1-ab9e5c3571da tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:03:53.023828 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b9d1c411-eae0-4393-a5c1-ab9e5c3571da tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:03:53.024297 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b9d1c411-eae0-4393-a5c1-ab9e5c3571da tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:03:53.024737 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b9d1c411-eae0-4393-a5c1-ab9e5c3571da tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:03:53.156938 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-b9d1c411-eae0-4393-a5c1-ab9e5c3571da tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e73b37189d04fa5a00d1c718ac9dbeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bde11f1ccc4a18919aff63b1757557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:03:53.164799 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-b9d1c411-eae0-4393-a5c1-ab9e5c3571da tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] 10.222.0.43 "GET /compute/v2.1/servers/775294ed-3824-404d-b73c-2ecc16962b5c" status: 200 len: 1548 microversion: 2.1 time: 0.153344 Oct 04 23:03:53.165371 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4247/7673] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:03:53 2022] GET /compute/v2.1/servers/775294ed-3824-404d-b73c-2ecc16962b5c => generated 1548 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:03:54.716677 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-46cf4106-3b69-4fb2-83f5-1c77ae4b52c5 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a0e91444-4ff1-484e-9229-89dfbe709923"}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 23:03:54.719037 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-46cf4106-3b69-4fb2-83f5-1c77ae4b52c5 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] [instance: 775294ed-3824-404d-b73c-2ecc16962b5c] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:03:54.725894 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-46cf4106-3b69-4fb2-83f5-1c77ae4b52c5 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:03:54.726413 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-46cf4106-3b69-4fb2-83f5-1c77ae4b52c5 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:03:54.726865 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-46cf4106-3b69-4fb2-83f5-1c77ae4b52c5 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:03:54.727569 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-46cf4106-3b69-4fb2-83f5-1c77ae4b52c5 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:03:54.728025 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-46cf4106-3b69-4fb2-83f5-1c77ae4b52c5 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:03:54.728589 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-46cf4106-3b69-4fb2-83f5-1c77ae4b52c5 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:03:54.968365 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-46cf4106-3b69-4fb2-83f5-1c77ae4b52c5 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] 10.222.0.43 "POST /compute/v2.1/servers/775294ed-3824-404d-b73c-2ecc16962b5c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.256247 Oct 04 23:03:54.968951 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3427/7674] 10.222.0.43 () {60 vars in 1323 bytes} [Tue Oct 4 23:03:54 2022] POST /compute/v2.1/servers/775294ed-3824-404d-b73c-2ecc16962b5c/os-volume_attachments => generated 194 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 23:04:08.194447 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-5d396bf2-5459-4e64-93ba-a022958e98e1 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:04:08.195077 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-5d396bf2-5459-4e64-93ba-a022958e98e1 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] [instance: 775294ed-3824-404d-b73c-2ecc16962b5c] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:04:08.198325 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:04:08.199878 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=62 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:04:08.207481 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5d396bf2-5459-4e64-93ba-a022958e98e1 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:04:08.208142 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5d396bf2-5459-4e64-93ba-a022958e98e1 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:04:08.208617 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5d396bf2-5459-4e64-93ba-a022958e98e1 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:04:08.209347 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5d396bf2-5459-4e64-93ba-a022958e98e1 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:04:08.209837 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5d396bf2-5459-4e64-93ba-a022958e98e1 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:04:08.210288 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5d396bf2-5459-4e64-93ba-a022958e98e1 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:04:08.344005 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-5d396bf2-5459-4e64-93ba-a022958e98e1 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e73b37189d04fa5a00d1c718ac9dbeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bde11f1ccc4a18919aff63b1757557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:04:08.352401 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-5d396bf2-5459-4e64-93ba-a022958e98e1 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] 10.222.0.43 "GET /compute/v2.1/servers/775294ed-3824-404d-b73c-2ecc16962b5c" status: 200 len: 1594 microversion: 2.1 time: 0.161827 Oct 04 23:04:08.352979 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4248/7675] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:04:08 2022] GET /compute/v2.1/servers/775294ed-3824-404d-b73c-2ecc16962b5c => generated 1594 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:04:10.081651 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell0:SELECT=2 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:04:10.087622 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:04:10.089124 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:04:10.180014 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-6c809f00-43d5-4226-b688-c1cf24168980 req-c36eb37a-4224-452d-ba4f-ee0dc35bbca3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "775294ed-3824-404d-b73c-2ecc16962b5c", "tag": "8bd0cfb4-1467-4bd8-b5d9-ef59546d57e8"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 23:04:10.191562 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-6c809f00-43d5-4226-b688-c1cf24168980 req-c36eb37a-4224-452d-ba4f-ee0dc35bbca3 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:04:10.192040 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-6c809f00-43d5-4226-b688-c1cf24168980 req-c36eb37a-4224-452d-ba4f-ee0dc35bbca3 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:04:10.192892 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-6c809f00-43d5-4226-b688-c1cf24168980 req-c36eb37a-4224-452d-ba4f-ee0dc35bbca3 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:04:10.204821 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-6c809f00-43d5-4226-b688-c1cf24168980 req-c36eb37a-4224-452d-ba4f-ee0dc35bbca3 service nova] Creating event network-changed:8bd0cfb4-1467-4bd8-b5d9-ef59546d57e8 for instance 775294ed-3824-404d-b73c-2ecc16962b5c on n-h1-860284-1 Oct 04 23:04:10.209927 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-6c809f00-43d5-4226-b688-c1cf24168980 req-c36eb37a-4224-452d-ba4f-ee0dc35bbca3 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.130385 Oct 04 23:04:10.210574 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3428/7676] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 23:04:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 23:04:11.124351 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-cea11fdd-00c1-48b7-a8af-3e455ad136aa tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-549774537"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 23:04:11.125923 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-cea11fdd-00c1-48b7-a8af-3e455ad136aa tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] [instance: 775294ed-3824-404d-b73c-2ecc16962b5c] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:04:11.135863 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cea11fdd-00c1-48b7-a8af-3e455ad136aa tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:04:11.136715 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cea11fdd-00c1-48b7-a8af-3e455ad136aa tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:04:11.137175 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cea11fdd-00c1-48b7-a8af-3e455ad136aa tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:04:11.137903 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cea11fdd-00c1-48b7-a8af-3e455ad136aa tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:04:11.138398 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cea11fdd-00c1-48b7-a8af-3e455ad136aa tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:04:11.138831 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cea11fdd-00c1-48b7-a8af-3e455ad136aa tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:04:11.272289 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.network.security_group_api [None req-cea11fdd-00c1-48b7-a8af-3e455ad136aa tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Adding security group 75722979-68af-4742-a9fd-715ca3475937 to port 8bd0cfb4-1467-4bd8-b5d9-ef59546d57e8 Oct 04 23:04:11.596624 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-cea11fdd-00c1-48b7-a8af-3e455ad136aa tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] 10.222.0.43 "POST /compute/v2.1/servers/775294ed-3824-404d-b73c-2ecc16962b5c/action" status: 202 len: 0 microversion: 2.1 time: 0.481534 Oct 04 23:04:11.597338 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4249/7677] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 23:04:11 2022] POST /compute/v2.1/servers/775294ed-3824-404d-b73c-2ecc16962b5c/action => generated 0 bytes in 483 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 23:04:11.607766 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-c0106e2b-0c39-4e09-a5eb-824ed7584e7c tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:04:11.608484 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-c0106e2b-0c39-4e09-a5eb-824ed7584e7c tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] [instance: 775294ed-3824-404d-b73c-2ecc16962b5c] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:04:11.615352 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c0106e2b-0c39-4e09-a5eb-824ed7584e7c tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:04:11.615850 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c0106e2b-0c39-4e09-a5eb-824ed7584e7c tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:04:11.616462 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c0106e2b-0c39-4e09-a5eb-824ed7584e7c tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:04:11.617371 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c0106e2b-0c39-4e09-a5eb-824ed7584e7c tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:04:11.617836 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c0106e2b-0c39-4e09-a5eb-824ed7584e7c tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:04:11.618279 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c0106e2b-0c39-4e09-a5eb-824ed7584e7c tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:04:11.768299 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-c0106e2b-0c39-4e09-a5eb-824ed7584e7c tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e73b37189d04fa5a00d1c718ac9dbeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bde11f1ccc4a18919aff63b1757557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:04:11.776643 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-c0106e2b-0c39-4e09-a5eb-824ed7584e7c tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] 10.222.0.43 "GET /compute/v2.1/servers/775294ed-3824-404d-b73c-2ecc16962b5c" status: 200 len: 1759 microversion: 2.1 time: 0.174884 Oct 04 23:04:11.777915 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3429/7678] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:04:11 2022] GET /compute/v2.1/servers/775294ed-3824-404d-b73c-2ecc16962b5c => generated 1759 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:04:12.229073 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-824ebab3-48f8-4576-a88f-6398867e9c07 req-cdff0999-68e0-47d2-8997-00753126186e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "775294ed-3824-404d-b73c-2ecc16962b5c", "tag": "8bd0cfb4-1467-4bd8-b5d9-ef59546d57e8"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 23:04:12.240285 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-824ebab3-48f8-4576-a88f-6398867e9c07 req-cdff0999-68e0-47d2-8997-00753126186e service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:04:12.240790 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-824ebab3-48f8-4576-a88f-6398867e9c07 req-cdff0999-68e0-47d2-8997-00753126186e service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:04:12.241334 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-824ebab3-48f8-4576-a88f-6398867e9c07 req-cdff0999-68e0-47d2-8997-00753126186e service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:04:12.253076 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-824ebab3-48f8-4576-a88f-6398867e9c07 req-cdff0999-68e0-47d2-8997-00753126186e service nova] Creating event network-changed:8bd0cfb4-1467-4bd8-b5d9-ef59546d57e8 for instance 775294ed-3824-404d-b73c-2ecc16962b5c on n-h1-860284-1 Oct 04 23:04:12.259595 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-824ebab3-48f8-4576-a88f-6398867e9c07 req-cdff0999-68e0-47d2-8997-00753126186e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035488 Oct 04 23:04:12.260234 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4250/7679] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 23:04:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 23:06:33.478184 n-d-860284-1 devstack@n-api.service[134102]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9c149bb3-0a09-4645-ba44-d3908964d17c] AMQP server on 10.222.0.43:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 04 23:06:33.479799 n-d-860284-1 devstack@n-api.service[134102]: ERROR oslo.messaging._drivers.impl_rabbit [-] [84f2d93b-5df1-409f-ad67-38bf0ff7216a] AMQP server on 10.222.0.43:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 04 23:06:33.480544 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_api:SELECT=4 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:06:33.481421 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=8 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:06:33.483237 n-d-860284-1 devstack@n-api.service[134102]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 04 23:06:33.483445 n-d-860284-1 devstack@n-api.service[134102]: Tue Oct 4 23:06:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/775294ed-3824-404d-b73c-2ecc16962b5c/action (ip 10.222.0.43) !!! Oct 04 23:06:33.485609 n-d-860284-1 devstack@n-api.service[134102]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 23:06:33.485752 n-d-860284-1 devstack@n-api.service[134102]: Tue Oct 4 23:06:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/775294ed-3824-404d-b73c-2ecc16962b5c/action (ip 10.222.0.43) !!! Oct 04 23:06:33.486893 n-d-860284-1 devstack@n-api.service[134102]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 23:06:33.487018 n-d-860284-1 devstack@n-api.service[134102]: Tue Oct 4 23:06:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/775294ed-3824-404d-b73c-2ecc16962b5c/action (ip 10.222.0.43) !!! Oct 04 23:06:33.494050 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-85d35bce-99e4-4a26-b32f-be67b1e5d29b tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 23:06:33.497053 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-85d35bce-99e4-4a26-b32f-be67b1e5d29b tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] [instance: 775294ed-3824-404d-b73c-2ecc16962b5c] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:06:33.513470 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-85d35bce-99e4-4a26-b32f-be67b1e5d29b tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:06:33.513966 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-85d35bce-99e4-4a26-b32f-be67b1e5d29b tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:06:33.514440 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-85d35bce-99e4-4a26-b32f-be67b1e5d29b tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:06:33.515148 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-85d35bce-99e4-4a26-b32f-be67b1e5d29b tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:06:33.515608 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-85d35bce-99e4-4a26-b32f-be67b1e5d29b tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:06:33.516045 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-85d35bce-99e4-4a26-b32f-be67b1e5d29b tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:06:33.591008 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-85d35bce-99e4-4a26-b32f-be67b1e5d29b tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] 10.222.0.43 "POST /compute/v2.1/servers/775294ed-3824-404d-b73c-2ecc16962b5c/action" status: 202 len: 0 microversion: 2.1 time: 0.114447 Oct 04 23:06:33.594792 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3430/7680] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 23:06:33 2022] POST /compute/v2.1/servers/775294ed-3824-404d-b73c-2ecc16962b5c/action => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 23:06:33.598730 n-d-860284-1 devstack@n-api.service[134101]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f8e2fc52-bb96-4bc7-8039-fbfc8addcbeb] AMQP server on 10.222.0.43:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 23:06:33.599578 n-d-860284-1 devstack@n-api.service[134101]: ERROR oslo.messaging._drivers.impl_rabbit [-] [dab38095-fcf8-46d0-9904-6bfbf5d1f82a] AMQP server on 10.222.0.43:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 23:06:33.600151 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=6 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:06:33.600929 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=12 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:06:33.602634 n-d-860284-1 devstack@n-api.service[134101]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 23:06:33.602769 n-d-860284-1 devstack@n-api.service[134101]: Tue Oct 4 23:06:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/775294ed-3824-404d-b73c-2ecc16962b5c (ip 10.222.0.43) !!! Oct 04 23:06:33.604954 n-d-860284-1 devstack@n-api.service[134101]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 23:06:33.605177 n-d-860284-1 devstack@n-api.service[134101]: Tue Oct 4 23:06:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/775294ed-3824-404d-b73c-2ecc16962b5c (ip 10.222.0.43) !!! Oct 04 23:06:33.623624 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-d13247af-aeb3-43c0-be64-ed4cb3b675e5 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:06:33.624354 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-d13247af-aeb3-43c0-be64-ed4cb3b675e5 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] [instance: 775294ed-3824-404d-b73c-2ecc16962b5c] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:06:33.632467 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d13247af-aeb3-43c0-be64-ed4cb3b675e5 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:06:33.632978 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d13247af-aeb3-43c0-be64-ed4cb3b675e5 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:06:33.633437 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d13247af-aeb3-43c0-be64-ed4cb3b675e5 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:06:33.634156 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d13247af-aeb3-43c0-be64-ed4cb3b675e5 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:06:33.634692 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d13247af-aeb3-43c0-be64-ed4cb3b675e5 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:06:33.635199 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d13247af-aeb3-43c0-be64-ed4cb3b675e5 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:06:33.787512 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-d13247af-aeb3-43c0-be64-ed4cb3b675e5 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e73b37189d04fa5a00d1c718ac9dbeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bde11f1ccc4a18919aff63b1757557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:06:33.796680 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-d13247af-aeb3-43c0-be64-ed4cb3b675e5 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] 10.222.0.43 "GET /compute/v2.1/servers/775294ed-3824-404d-b73c-2ecc16962b5c" status: 200 len: 1761 microversion: 2.1 time: 0.200359 Oct 04 23:06:33.797260 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4251/7681] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:06:33 2022] GET /compute/v2.1/servers/775294ed-3824-404d-b73c-2ecc16962b5c => generated 1761 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 23:06:34.820948 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-0d88bec2-5594-4a6a-a31f-d2f631f9ccb7 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:06:34.821668 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-0d88bec2-5594-4a6a-a31f-d2f631f9ccb7 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] [instance: 775294ed-3824-404d-b73c-2ecc16962b5c] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:06:34.837632 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0d88bec2-5594-4a6a-a31f-d2f631f9ccb7 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:06:34.838133 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0d88bec2-5594-4a6a-a31f-d2f631f9ccb7 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:06:34.838750 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0d88bec2-5594-4a6a-a31f-d2f631f9ccb7 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:06:34.839567 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0d88bec2-5594-4a6a-a31f-d2f631f9ccb7 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:06:34.840036 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0d88bec2-5594-4a6a-a31f-d2f631f9ccb7 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:06:34.840476 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0d88bec2-5594-4a6a-a31f-d2f631f9ccb7 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:06:34.842276 n-d-860284-1 devstack@n-api.service[134102]: INFO oslo.messaging._drivers.impl_rabbit [-] [84f2d93b-5df1-409f-ad67-38bf0ff7216a] Reconnected to AMQP server on 10.222.0.43:5672 via [amqp] client with port 38282. Oct 04 23:06:34.847728 n-d-860284-1 devstack@n-api.service[134102]: INFO oslo.messaging._drivers.impl_rabbit [-] [9c149bb3-0a09-4645-ba44-d3908964d17c] Reconnected to AMQP server on 10.222.0.43:5672 via [amqp] client with port 38280. Oct 04 23:06:34.992633 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-0d88bec2-5594-4a6a-a31f-d2f631f9ccb7 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e73b37189d04fa5a00d1c718ac9dbeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bde11f1ccc4a18919aff63b1757557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:06:35.001460 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-0d88bec2-5594-4a6a-a31f-d2f631f9ccb7 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] 10.222.0.43 "GET /compute/v2.1/servers/775294ed-3824-404d-b73c-2ecc16962b5c" status: 200 len: 1759 microversion: 2.1 time: 0.184830 Oct 04 23:06:35.002043 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3431/7682] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:06:34 2022] GET /compute/v2.1/servers/775294ed-3824-404d-b73c-2ecc16962b5c => generated 1759 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:08:18.027785 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-808b81af-bcaa-4dac-af5a-f92d1652558a tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-549774537"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 23:08:18.028463 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-808b81af-bcaa-4dac-af5a-f92d1652558a tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] [instance: 775294ed-3824-404d-b73c-2ecc16962b5c] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:08:18.032129 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=2 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:08:18.032995 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=6 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:08:18.034340 n-d-860284-1 devstack@n-api.service[134101]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 23:08:18.034518 n-d-860284-1 devstack@n-api.service[134101]: Tue Oct 4 23:08:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/775294ed-3824-404d-b73c-2ecc16962b5c/action (ip 10.222.0.43) !!! Oct 04 23:08:18.046603 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-808b81af-bcaa-4dac-af5a-f92d1652558a tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:08:18.047110 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-808b81af-bcaa-4dac-af5a-f92d1652558a tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:08:18.047568 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-808b81af-bcaa-4dac-af5a-f92d1652558a tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:08:18.048286 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-808b81af-bcaa-4dac-af5a-f92d1652558a tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:08:18.048755 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-808b81af-bcaa-4dac-af5a-f92d1652558a tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:08:18.049198 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-808b81af-bcaa-4dac-af5a-f92d1652558a tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:08:18.054050 n-d-860284-1 devstack@n-api.service[134101]: INFO oslo.messaging._drivers.impl_rabbit [-] [f8e2fc52-bb96-4bc7-8039-fbfc8addcbeb] Reconnected to AMQP server on 10.222.0.43:5672 via [amqp] client with port 38320. Oct 04 23:08:18.056458 n-d-860284-1 devstack@n-api.service[134101]: INFO oslo.messaging._drivers.impl_rabbit [-] [dab38095-fcf8-46d0-9904-6bfbf5d1f82a] Reconnected to AMQP server on 10.222.0.43:5672 via [amqp] client with port 38322. Oct 04 23:08:18.186282 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.network.security_group_api [None req-808b81af-bcaa-4dac-af5a-f92d1652558a tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Removing security group 75722979-68af-4742-a9fd-715ca3475937 from port 8bd0cfb4-1467-4bd8-b5d9-ef59546d57e8 Oct 04 23:08:18.490324 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-808b81af-bcaa-4dac-af5a-f92d1652558a tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] 10.222.0.43 "POST /compute/v2.1/servers/775294ed-3824-404d-b73c-2ecc16962b5c/action" status: 202 len: 0 microversion: 2.1 time: 0.467963 Oct 04 23:08:18.491477 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4252/7683] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 23:08:18 2022] POST /compute/v2.1/servers/775294ed-3824-404d-b73c-2ecc16962b5c/action => generated 0 bytes in 470 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 23:08:18.526059 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_api:SELECT=4 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:08:18.528197 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:08:18.534529 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-a479b72d-aae0-40ae-b35b-87c929e44e87 req-4410e238-bb5b-4da4-99f0-cff21868b9c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "775294ed-3824-404d-b73c-2ecc16962b5c", "tag": "8bd0cfb4-1467-4bd8-b5d9-ef59546d57e8"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 23:08:18.547436 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-a479b72d-aae0-40ae-b35b-87c929e44e87 req-4410e238-bb5b-4da4-99f0-cff21868b9c8 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:08:18.548209 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-a479b72d-aae0-40ae-b35b-87c929e44e87 req-4410e238-bb5b-4da4-99f0-cff21868b9c8 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:08:18.548878 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-a479b72d-aae0-40ae-b35b-87c929e44e87 req-4410e238-bb5b-4da4-99f0-cff21868b9c8 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:08:18.572647 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-a479b72d-aae0-40ae-b35b-87c929e44e87 req-4410e238-bb5b-4da4-99f0-cff21868b9c8 service nova] Creating event network-changed:8bd0cfb4-1467-4bd8-b5d9-ef59546d57e8 for instance 775294ed-3824-404d-b73c-2ecc16962b5c on n-h1-860284-1 Oct 04 23:08:18.578137 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-a479b72d-aae0-40ae-b35b-87c929e44e87 req-4410e238-bb5b-4da4-99f0-cff21868b9c8 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054060 Oct 04 23:08:18.579220 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3432/7684] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 23:08:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 23:08:19.682096 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-b07e7e71-565c-4cfb-8b67-3ffa5804c3a1 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:08:19.683303 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-b07e7e71-565c-4cfb-8b67-3ffa5804c3a1 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] [instance: 775294ed-3824-404d-b73c-2ecc16962b5c] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:08:19.690183 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b07e7e71-565c-4cfb-8b67-3ffa5804c3a1 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:08:19.690940 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b07e7e71-565c-4cfb-8b67-3ffa5804c3a1 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:08:19.691469 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b07e7e71-565c-4cfb-8b67-3ffa5804c3a1 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:08:19.692270 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b07e7e71-565c-4cfb-8b67-3ffa5804c3a1 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:08:19.692752 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b07e7e71-565c-4cfb-8b67-3ffa5804c3a1 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:08:19.693232 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b07e7e71-565c-4cfb-8b67-3ffa5804c3a1 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:08:19.780984 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.objects.instance [None req-b07e7e71-565c-4cfb-8b67-3ffa5804c3a1 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lazy-loading 'services' on Instance uuid 775294ed-3824-404d-b73c-2ecc16962b5c {{(pid=134101) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 23:08:19.861995 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-b07e7e71-565c-4cfb-8b67-3ffa5804c3a1 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] 10.222.0.43 "DELETE /compute/v2.1/servers/775294ed-3824-404d-b73c-2ecc16962b5c/os-volume_attachments/a0e91444-4ff1-484e-9229-89dfbe709923" status: 202 len: 0 microversion: 2.1 time: 0.184780 Oct 04 23:08:19.862665 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4253/7685] 10.222.0.43 () {58 vars in 1416 bytes} [Tue Oct 4 23:08:19 2022] DELETE /compute/v2.1/servers/775294ed-3824-404d-b73c-2ecc16962b5c/os-volume_attachments/a0e91444-4ff1-484e-9229-89dfbe709923 => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 23:08:19.871864 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-a74441cb-20c4-4238-92a4-673ed6c6fcf0 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:08:19.875061 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-a74441cb-20c4-4238-92a4-673ed6c6fcf0 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] [instance: 775294ed-3824-404d-b73c-2ecc16962b5c] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:08:19.883342 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a74441cb-20c4-4238-92a4-673ed6c6fcf0 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:08:19.884353 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a74441cb-20c4-4238-92a4-673ed6c6fcf0 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:08:19.885018 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a74441cb-20c4-4238-92a4-673ed6c6fcf0 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:08:19.886523 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a74441cb-20c4-4238-92a4-673ed6c6fcf0 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:08:19.887209 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a74441cb-20c4-4238-92a4-673ed6c6fcf0 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:08:19.887880 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a74441cb-20c4-4238-92a4-673ed6c6fcf0 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:08:19.925906 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-a74441cb-20c4-4238-92a4-673ed6c6fcf0 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] 10.222.0.43 "GET /compute/v2.1/servers/775294ed-3824-404d-b73c-2ecc16962b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058405 Oct 04 23:08:19.926718 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3433/7686] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 23:08:19 2022] GET /compute/v2.1/servers/775294ed-3824-404d-b73c-2ecc16962b5c/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 23:08:20.594089 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-1ac39ce4-bcb5-460a-90dc-0198421beef1 req-72dd3a81-3790-413b-84fb-3db013ae23de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "775294ed-3824-404d-b73c-2ecc16962b5c", "tag": "8bd0cfb4-1467-4bd8-b5d9-ef59546d57e8"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 23:08:20.605322 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-1ac39ce4-bcb5-460a-90dc-0198421beef1 req-72dd3a81-3790-413b-84fb-3db013ae23de service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:08:20.606083 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-1ac39ce4-bcb5-460a-90dc-0198421beef1 req-72dd3a81-3790-413b-84fb-3db013ae23de service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:08:20.606800 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-1ac39ce4-bcb5-460a-90dc-0198421beef1 req-72dd3a81-3790-413b-84fb-3db013ae23de service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:08:20.622148 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-1ac39ce4-bcb5-460a-90dc-0198421beef1 req-72dd3a81-3790-413b-84fb-3db013ae23de service nova] Creating event network-changed:8bd0cfb4-1467-4bd8-b5d9-ef59546d57e8 for instance 775294ed-3824-404d-b73c-2ecc16962b5c on n-h1-860284-1 Oct 04 23:08:20.627579 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-1ac39ce4-bcb5-460a-90dc-0198421beef1 req-72dd3a81-3790-413b-84fb-3db013ae23de service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037447 Oct 04 23:08:20.628787 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4254/7687] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 23:08:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 23:08:20.989169 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-ef227d81-f7bb-427c-a381-fca858a0bc89 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:08:20.991493 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-ef227d81-f7bb-427c-a381-fca858a0bc89 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] [instance: 775294ed-3824-404d-b73c-2ecc16962b5c] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:08:20.997784 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ef227d81-f7bb-427c-a381-fca858a0bc89 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:08:20.998280 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ef227d81-f7bb-427c-a381-fca858a0bc89 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:08:20.998788 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ef227d81-f7bb-427c-a381-fca858a0bc89 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:08:20.999499 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ef227d81-f7bb-427c-a381-fca858a0bc89 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:08:20.999962 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ef227d81-f7bb-427c-a381-fca858a0bc89 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:08:21.000394 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ef227d81-f7bb-427c-a381-fca858a0bc89 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:08:21.032795 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-ef227d81-f7bb-427c-a381-fca858a0bc89 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] 10.222.0.43 "GET /compute/v2.1/servers/775294ed-3824-404d-b73c-2ecc16962b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.097573 Oct 04 23:08:21.038027 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3434/7688] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 23:08:20 2022] GET /compute/v2.1/servers/775294ed-3824-404d-b73c-2ecc16962b5c/os-volume_attachments => generated 197 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 23:08:22.047608 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-6a9d3a7d-47dc-4945-ba98-f66e5359971f tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:08:22.049957 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-6a9d3a7d-47dc-4945-ba98-f66e5359971f tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] [instance: 775294ed-3824-404d-b73c-2ecc16962b5c] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:08:22.056309 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6a9d3a7d-47dc-4945-ba98-f66e5359971f tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:08:22.056811 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6a9d3a7d-47dc-4945-ba98-f66e5359971f tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:08:22.057259 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6a9d3a7d-47dc-4945-ba98-f66e5359971f tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:08:22.057977 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6a9d3a7d-47dc-4945-ba98-f66e5359971f tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:08:22.058468 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6a9d3a7d-47dc-4945-ba98-f66e5359971f tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:08:22.058908 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6a9d3a7d-47dc-4945-ba98-f66e5359971f tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:08:22.090396 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-6a9d3a7d-47dc-4945-ba98-f66e5359971f tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] 10.222.0.43 "GET /compute/v2.1/servers/775294ed-3824-404d-b73c-2ecc16962b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048177 Oct 04 23:08:22.090973 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4255/7689] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 23:08:22 2022] GET /compute/v2.1/servers/775294ed-3824-404d-b73c-2ecc16962b5c/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 23:08:23.103103 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-fb069bcd-aee6-4c88-aea8-d8ed2e87962f tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:08:23.106095 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-fb069bcd-aee6-4c88-aea8-d8ed2e87962f tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] [instance: 775294ed-3824-404d-b73c-2ecc16962b5c] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:08:23.112971 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fb069bcd-aee6-4c88-aea8-d8ed2e87962f tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:08:23.113458 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fb069bcd-aee6-4c88-aea8-d8ed2e87962f tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:08:23.113902 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fb069bcd-aee6-4c88-aea8-d8ed2e87962f tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:08:23.114630 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fb069bcd-aee6-4c88-aea8-d8ed2e87962f tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:08:23.115093 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fb069bcd-aee6-4c88-aea8-d8ed2e87962f tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:08:23.115523 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fb069bcd-aee6-4c88-aea8-d8ed2e87962f tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:08:23.146175 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-fb069bcd-aee6-4c88-aea8-d8ed2e87962f tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] 10.222.0.43 "GET /compute/v2.1/servers/775294ed-3824-404d-b73c-2ecc16962b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047177 Oct 04 23:08:23.146785 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3435/7690] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 23:08:23 2022] GET /compute/v2.1/servers/775294ed-3824-404d-b73c-2ecc16962b5c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 23:08:24.159418 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-fd844b3f-871e-42bb-abf3-4aae0761a4e4 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:08:24.161607 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-fd844b3f-871e-42bb-abf3-4aae0761a4e4 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] [instance: 775294ed-3824-404d-b73c-2ecc16962b5c] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:08:24.168780 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fd844b3f-871e-42bb-abf3-4aae0761a4e4 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:08:24.169279 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fd844b3f-871e-42bb-abf3-4aae0761a4e4 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:08:24.169733 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fd844b3f-871e-42bb-abf3-4aae0761a4e4 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:08:24.170474 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fd844b3f-871e-42bb-abf3-4aae0761a4e4 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:08:24.170948 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fd844b3f-871e-42bb-abf3-4aae0761a4e4 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:08:24.171398 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fd844b3f-871e-42bb-abf3-4aae0761a4e4 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:08:24.202006 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-fd844b3f-871e-42bb-abf3-4aae0761a4e4 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] 10.222.0.43 "GET /compute/v2.1/servers/775294ed-3824-404d-b73c-2ecc16962b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046581 Oct 04 23:08:24.202627 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4256/7691] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 23:08:24 2022] GET /compute/v2.1/servers/775294ed-3824-404d-b73c-2ecc16962b5c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 23:08:25.216618 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-8b881610-116b-482f-9155-207f761a4f29 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:08:25.218889 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-8b881610-116b-482f-9155-207f761a4f29 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] [instance: 775294ed-3824-404d-b73c-2ecc16962b5c] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:08:25.227693 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8b881610-116b-482f-9155-207f761a4f29 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:08:25.228553 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8b881610-116b-482f-9155-207f761a4f29 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:08:25.229353 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8b881610-116b-482f-9155-207f761a4f29 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:08:25.230165 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8b881610-116b-482f-9155-207f761a4f29 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:08:25.231034 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8b881610-116b-482f-9155-207f761a4f29 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:08:25.231846 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8b881610-116b-482f-9155-207f761a4f29 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:08:25.266850 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-8b881610-116b-482f-9155-207f761a4f29 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] 10.222.0.43 "GET /compute/v2.1/servers/775294ed-3824-404d-b73c-2ecc16962b5c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.055153 Oct 04 23:08:25.267670 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3436/7692] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 23:08:25 2022] GET /compute/v2.1/servers/775294ed-3824-404d-b73c-2ecc16962b5c/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 23:08:25.279338 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-9c4a5957-daa8-459c-a651-75eac2cc6773 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:08:25.279919 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-9c4a5957-daa8-459c-a651-75eac2cc6773 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] [instance: 775294ed-3824-404d-b73c-2ecc16962b5c] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:08:25.286994 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9c4a5957-daa8-459c-a651-75eac2cc6773 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:08:25.287594 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9c4a5957-daa8-459c-a651-75eac2cc6773 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:08:25.288064 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9c4a5957-daa8-459c-a651-75eac2cc6773 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:08:25.288792 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9c4a5957-daa8-459c-a651-75eac2cc6773 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:08:25.289273 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9c4a5957-daa8-459c-a651-75eac2cc6773 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:08:25.289721 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9c4a5957-daa8-459c-a651-75eac2cc6773 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:08:25.369998 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-9c4a5957-daa8-459c-a651-75eac2cc6773 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] HTTP exception thrown: Instance 775294ed-3824-404d-b73c-2ecc16962b5c is not attached to volume a0e91444-4ff1-484e-9229-89dfbe709923 Oct 04 23:08:25.371657 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-9c4a5957-daa8-459c-a651-75eac2cc6773 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Request method failure captured: Oct 04 23:08:25.371657 n-d-860284-1 devstack@n-api.service[134101]: request: DELETE /compute/v2.1/servers/775294ed-3824-404d-b73c-2ecc16962b5c/os-volume_attachments/a0e91444-4ff1-484e-9229-89dfbe709923 HTTP/1.1 Oct 04 23:08:25.371657 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 23:08:25.371657 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 23:08:25.371657 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 23:08:25.371657 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 23:08:25.371657 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 23:08:25.371657 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 23:08:25.371657 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 23:08:25.371657 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 23:08:25.371657 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPLuzm4MU0j9WOPE9dRAxjx-lrneOUj_8l9DjH6VdQXwqWEQY6Ny-AwELbj9MEXHi7Y4BFrp7QpJgL8bKi3kZNDIumlp2Tjl_JBj5F9z3F79WRWaouVgUXUSUVVq_Afp-PbjKUOOZoW9IKLCKkU57pkxrB7eq-Owb-l27WIpBGSFrOkc Oct 04 23:08:25.371657 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 23:08:25.371657 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 23:08:25.371657 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 23:08:25.371657 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 23:08:25.371657 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 23:08:25.371657 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 23:08:25.371657 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: 79bde11f1ccc4a18919aff63b1757557 Oct 04 23:08:25.371657 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-TestMinimumBasicScenario-1625155882 Oct 04 23:08:25.371657 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 23:08:25.371657 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 23:08:25.371657 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/79bde11f1ccc4a18919aff63b1757557"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_79bde11f1ccc4a18919aff63b1757557", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/79bde11f1ccc4a18919aff63b1757557"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/79bde11f1ccc4a18919aff63b1757557"}]}] Oct 04 23:08:25.371657 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-TestMinimumBasicScenario-1625155882 Oct 04 23:08:25.371657 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: 79bde11f1ccc4a18919aff63b1757557 Oct 04 23:08:25.371657 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1625155882 Oct 04 23:08:25.371657 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-TestMinimumBasicScenario-1625155882-project Oct 04 23:08:25.371657 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 23:08:25.371657 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 23:08:25.371657 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 3e73b37189d04fa5a00d1c718ac9dbeb Oct 04 23:08:25.371657 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-TestMinimumBasicScenario-1625155882-project Oct 04 23:08:25.371657 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 23:08:25.371657 n-d-860284-1 devstack@n-api.service[134101]: exception: Instance 775294ed-3824-404d-b73c-2ecc16962b5c is not attached to volume a0e91444-4ff1-484e-9229-89dfbe709923 Oct 04 23:08:25.371657 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'server_id': '775294ed-3824-404d-b73c-2ecc16962b5c', 'id': 'a0e91444-4ff1-484e-9229-89dfbe709923'} Oct 04 23:08:25.371657 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 23:08:25.371657 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 23:08:25.371657 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 04 23:08:25.371657 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 04 23:08:25.371657 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 23:08:25.371657 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 23:08:25.371657 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 04 23:08:25.371657 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 04 23:08:25.371657 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id a0e91444-4ff1-484e-9229-89dfbe709923. Oct 04 23:08:25.371657 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 23:08:25.371657 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 23:08:25.371657 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 23:08:25.371657 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 23:08:25.371657 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 23:08:25.371657 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 23:08:25.371657 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 23:08:25.371657 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 23:08:25.371657 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 23:08:25.371657 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 23:08:25.371657 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 04 23:08:25.371657 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 04 23:08:25.371657 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 775294ed-3824-404d-b73c-2ecc16962b5c is not attached to volume a0e91444-4ff1-484e-9229-89dfbe709923 Oct 04 23:08:25.371657 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 23:08:25.371657 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 23:08:25.371657 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 23:08:25.371657 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 23:08:25.371657 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 23:08:25.371657 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 23:08:25.376679 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 23:08:25.376679 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 23:08:25.376679 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 775294ed-3824-404d-b73c-2ecc16962b5c is not attached to volume a0e91444-4ff1-484e-9229-89dfbe709923 Oct 04 23:08:25.376679 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 23:08:25.376679 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-9c4a5957-daa8-459c-a651-75eac2cc6773 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Returning 404 to user: Instance 775294ed-3824-404d-b73c-2ecc16962b5c is not attached to volume a0e91444-4ff1-484e-9229-89dfbe709923 {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 23:08:25.376679 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-9c4a5957-daa8-459c-a651-75eac2cc6773 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] 10.222.0.43 "DELETE /compute/v2.1/servers/775294ed-3824-404d-b73c-2ecc16962b5c/os-volume_attachments/a0e91444-4ff1-484e-9229-89dfbe709923" status: 404 len: 154 microversion: 2.1 time: 0.098882 Oct 04 23:08:25.376679 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4257/7693] 10.222.0.43 () {58 vars in 1416 bytes} [Tue Oct 4 23:08:25 2022] DELETE /compute/v2.1/servers/775294ed-3824-404d-b73c-2ecc16962b5c/os-volume_attachments/a0e91444-4ff1-484e-9229-89dfbe709923 => generated 154 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 23:08:28.632755 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-b3d08035-f535-4bcd-8b30-66d2ddfce91a tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:08:28.633260 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-b3d08035-f535-4bcd-8b30-66d2ddfce91a tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] [instance: 775294ed-3824-404d-b73c-2ecc16962b5c] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:08:28.641136 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b3d08035-f535-4bcd-8b30-66d2ddfce91a tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:08:28.641619 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b3d08035-f535-4bcd-8b30-66d2ddfce91a tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:08:28.642054 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b3d08035-f535-4bcd-8b30-66d2ddfce91a tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:08:28.642838 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b3d08035-f535-4bcd-8b30-66d2ddfce91a tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:08:28.643294 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b3d08035-f535-4bcd-8b30-66d2ddfce91a tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:08:28.643725 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b3d08035-f535-4bcd-8b30-66d2ddfce91a tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:08:28.668847 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-b3d08035-f535-4bcd-8b30-66d2ddfce91a tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] [instance: 775294ed-3824-404d-b73c-2ecc16962b5c] Going to try to terminate instance {{(pid=134102) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 23:08:28.756621 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-b3d08035-f535-4bcd-8b30-66d2ddfce91a tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] 10.222.0.43 "DELETE /compute/v2.1/servers/775294ed-3824-404d-b73c-2ecc16962b5c" status: 204 len: 0 microversion: 2.1 time: 0.127113 Oct 04 23:08:28.757426 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3437/7694] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 23:08:28 2022] DELETE /compute/v2.1/servers/775294ed-3824-404d-b73c-2ecc16962b5c => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 23:08:28.766247 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-1898fce1-e298-4f49-b1e7-93e01c72a6b1 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:08:28.767549 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-1898fce1-e298-4f49-b1e7-93e01c72a6b1 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] [instance: 775294ed-3824-404d-b73c-2ecc16962b5c] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:08:28.775282 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1898fce1-e298-4f49-b1e7-93e01c72a6b1 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:08:28.775802 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1898fce1-e298-4f49-b1e7-93e01c72a6b1 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:08:28.776265 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1898fce1-e298-4f49-b1e7-93e01c72a6b1 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:08:28.776987 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1898fce1-e298-4f49-b1e7-93e01c72a6b1 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:08:28.777465 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1898fce1-e298-4f49-b1e7-93e01c72a6b1 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:08:28.777929 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1898fce1-e298-4f49-b1e7-93e01c72a6b1 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:08:28.920254 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-1898fce1-e298-4f49-b1e7-93e01c72a6b1 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e73b37189d04fa5a00d1c718ac9dbeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bde11f1ccc4a18919aff63b1757557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:08:28.929455 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-1898fce1-e298-4f49-b1e7-93e01c72a6b1 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] 10.222.0.43 "GET /compute/v2.1/servers/775294ed-3824-404d-b73c-2ecc16962b5c" status: 200 len: 1554 microversion: 2.1 time: 0.167598 Oct 04 23:08:28.930133 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4258/7695] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:08:28 2022] GET /compute/v2.1/servers/775294ed-3824-404d-b73c-2ecc16962b5c => generated 1554 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 23:08:29.954500 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-ef3bc6f4-e138-4d0f-91eb-bcbc584a84ad tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:08:29.955253 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-ef3bc6f4-e138-4d0f-91eb-bcbc584a84ad tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] [instance: 775294ed-3824-404d-b73c-2ecc16962b5c] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:08:29.963341 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ef3bc6f4-e138-4d0f-91eb-bcbc584a84ad tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:08:29.963873 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ef3bc6f4-e138-4d0f-91eb-bcbc584a84ad tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:08:29.964341 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ef3bc6f4-e138-4d0f-91eb-bcbc584a84ad tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:08:29.965025 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ef3bc6f4-e138-4d0f-91eb-bcbc584a84ad tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:08:29.965489 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ef3bc6f4-e138-4d0f-91eb-bcbc584a84ad tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:08:29.965920 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ef3bc6f4-e138-4d0f-91eb-bcbc584a84ad tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:08:30.101542 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-ef3bc6f4-e138-4d0f-91eb-bcbc584a84ad tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e73b37189d04fa5a00d1c718ac9dbeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bde11f1ccc4a18919aff63b1757557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:08:30.109740 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-ef3bc6f4-e138-4d0f-91eb-bcbc584a84ad tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] 10.222.0.43 "GET /compute/v2.1/servers/775294ed-3824-404d-b73c-2ecc16962b5c" status: 200 len: 1554 microversion: 2.1 time: 0.159689 Oct 04 23:08:30.110330 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3438/7696] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:08:29 2022] GET /compute/v2.1/servers/775294ed-3824-404d-b73c-2ecc16962b5c => generated 1554 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:08:31.133413 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-f443efd1-b148-441f-9e33-a6fd73329148 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:08:31.134099 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-f443efd1-b148-441f-9e33-a6fd73329148 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] [instance: 775294ed-3824-404d-b73c-2ecc16962b5c] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:08:31.141914 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f443efd1-b148-441f-9e33-a6fd73329148 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:08:31.142460 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f443efd1-b148-441f-9e33-a6fd73329148 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:08:31.142917 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f443efd1-b148-441f-9e33-a6fd73329148 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:08:31.143632 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f443efd1-b148-441f-9e33-a6fd73329148 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:08:31.144273 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f443efd1-b148-441f-9e33-a6fd73329148 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:08:31.144713 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f443efd1-b148-441f-9e33-a6fd73329148 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:08:31.195964 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-5f27e759-3049-4b1c-a2c2-2028e9d41f30 req-9b825bec-613e-4e6a-b151-5363dbeab76b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "775294ed-3824-404d-b73c-2ecc16962b5c", "name": "network-vif-deleted", "tag": "8bd0cfb4-1467-4bd8-b5d9-ef59546d57e8"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 23:08:31.208265 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-5f27e759-3049-4b1c-a2c2-2028e9d41f30 req-9b825bec-613e-4e6a-b151-5363dbeab76b service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:08:31.208764 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-5f27e759-3049-4b1c-a2c2-2028e9d41f30 req-9b825bec-613e-4e6a-b151-5363dbeab76b service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:08:31.209211 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-5f27e759-3049-4b1c-a2c2-2028e9d41f30 req-9b825bec-613e-4e6a-b151-5363dbeab76b service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:08:31.217606 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-f443efd1-b148-441f-9e33-a6fd73329148 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e73b37189d04fa5a00d1c718ac9dbeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bde11f1ccc4a18919aff63b1757557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:08:31.224408 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-5f27e759-3049-4b1c-a2c2-2028e9d41f30 req-9b825bec-613e-4e6a-b151-5363dbeab76b service nova] Creating event network-vif-deleted:8bd0cfb4-1467-4bd8-b5d9-ef59546d57e8 for instance 775294ed-3824-404d-b73c-2ecc16962b5c on n-h1-860284-1 Oct 04 23:08:31.225723 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-f443efd1-b148-441f-9e33-a6fd73329148 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] 10.222.0.43 "GET /compute/v2.1/servers/775294ed-3824-404d-b73c-2ecc16962b5c" status: 200 len: 1343 microversion: 2.1 time: 0.096424 Oct 04 23:08:31.226317 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3439/7697] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:08:31 2022] GET /compute/v2.1/servers/775294ed-3824-404d-b73c-2ecc16962b5c => generated 1343 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 23:08:31.244302 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-5f27e759-3049-4b1c-a2c2-2028e9d41f30 req-9b825bec-613e-4e6a-b151-5363dbeab76b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130817 Oct 04 23:08:31.245026 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4259/7698] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 23:08:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 23:08:32.249719 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-c5bc9d06-ae5e-45f6-9552-27e6054d0e9c tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:08:32.250340 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-c5bc9d06-ae5e-45f6-9552-27e6054d0e9c tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] [instance: 775294ed-3824-404d-b73c-2ecc16962b5c] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:08:32.257232 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c5bc9d06-ae5e-45f6-9552-27e6054d0e9c tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:08:32.257718 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c5bc9d06-ae5e-45f6-9552-27e6054d0e9c tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:08:32.258164 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c5bc9d06-ae5e-45f6-9552-27e6054d0e9c tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:08:32.258980 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c5bc9d06-ae5e-45f6-9552-27e6054d0e9c tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:08:32.259480 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c5bc9d06-ae5e-45f6-9552-27e6054d0e9c tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:08:32.260590 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c5bc9d06-ae5e-45f6-9552-27e6054d0e9c tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:08:32.274118 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-c5bc9d06-ae5e-45f6-9552-27e6054d0e9c tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] HTTP exception thrown: Instance 775294ed-3824-404d-b73c-2ecc16962b5c could not be found. Oct 04 23:08:32.275888 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-c5bc9d06-ae5e-45f6-9552-27e6054d0e9c tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Request method failure captured: Oct 04 23:08:32.275888 n-d-860284-1 devstack@n-api.service[134102]: request: GET /compute/v2.1/servers/775294ed-3824-404d-b73c-2ecc16962b5c HTTP/1.1 Oct 04 23:08:32.275888 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 23:08:32.275888 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 23:08:32.275888 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 23:08:32.275888 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 23:08:32.275888 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 23:08:32.275888 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 23:08:32.275888 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 23:08:32.275888 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 23:08:32.275888 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPLuzm4MU0j9WOPE9dRAxjx-lrneOUj_8l9DjH6VdQXwqWEQY6Ny-AwELbj9MEXHi7Y4BFrp7QpJgL8bKi3kZNDIumlp2Tjl_JBj5F9z3F79WRWaouVgUXUSUVVq_Afp-PbjKUOOZoW9IKLCKkU57pkxrB7eq-Owb-l27WIpBGSFrOkc Oct 04 23:08:32.275888 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 23:08:32.275888 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 23:08:32.275888 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 23:08:32.275888 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 23:08:32.275888 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 23:08:32.275888 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 23:08:32.275888 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: 79bde11f1ccc4a18919aff63b1757557 Oct 04 23:08:32.275888 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-TestMinimumBasicScenario-1625155882 Oct 04 23:08:32.275888 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 23:08:32.275888 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 23:08:32.275888 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/79bde11f1ccc4a18919aff63b1757557"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_79bde11f1ccc4a18919aff63b1757557", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/79bde11f1ccc4a18919aff63b1757557"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/79bde11f1ccc4a18919aff63b1757557"}]}] Oct 04 23:08:32.275888 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-TestMinimumBasicScenario-1625155882 Oct 04 23:08:32.275888 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: 79bde11f1ccc4a18919aff63b1757557 Oct 04 23:08:32.275888 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1625155882 Oct 04 23:08:32.275888 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-TestMinimumBasicScenario-1625155882-project Oct 04 23:08:32.275888 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 23:08:32.275888 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 23:08:32.275888 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: 3e73b37189d04fa5a00d1c718ac9dbeb Oct 04 23:08:32.275888 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-TestMinimumBasicScenario-1625155882-project Oct 04 23:08:32.275888 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 23:08:32.275888 n-d-860284-1 devstack@n-api.service[134102]: exception: Instance 775294ed-3824-404d-b73c-2ecc16962b5c could not be found. Oct 04 23:08:32.275888 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': '775294ed-3824-404d-b73c-2ecc16962b5c'} Oct 04 23:08:32.275888 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 23:08:32.275888 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 23:08:32.275888 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 23:08:32.275888 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 23:08:32.275888 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 23:08:32.275888 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 23:08:32.275888 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 23:08:32.275888 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 23:08:32.275888 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 23:08:32.275888 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 23:08:32.275888 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 775294ed-3824-404d-b73c-2ecc16962b5c could not be found. Oct 04 23:08:32.275888 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 23:08:32.275888 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 23:08:32.275888 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 23:08:32.275888 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 23:08:32.275888 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 23:08:32.275888 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 23:08:32.275888 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 23:08:32.275888 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 23:08:32.275888 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 23:08:32.275888 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 23:08:32.275888 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 23:08:32.275888 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 23:08:32.275888 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 23:08:32.275888 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 23:08:32.275888 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 23:08:32.275888 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 23:08:32.275888 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 775294ed-3824-404d-b73c-2ecc16962b5c could not be found. Oct 04 23:08:32.275888 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 23:08:32.275888 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 23:08:32.275888 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 23:08:32.280454 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 23:08:32.280454 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 23:08:32.280454 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 23:08:32.280454 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 23:08:32.280454 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 23:08:32.280454 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 775294ed-3824-404d-b73c-2ecc16962b5c could not be found. Oct 04 23:08:32.280454 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 23:08:32.280454 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-c5bc9d06-ae5e-45f6-9552-27e6054d0e9c tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Returning 404 to user: Instance 775294ed-3824-404d-b73c-2ecc16962b5c could not be found. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 23:08:32.280454 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-c5bc9d06-ae5e-45f6-9552-27e6054d0e9c tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] 10.222.0.43 "GET /compute/v2.1/servers/775294ed-3824-404d-b73c-2ecc16962b5c" status: 404 len: 111 microversion: 2.1 time: 0.031582 Oct 04 23:08:32.280454 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3440/7699] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:08:32 2022] GET /compute/v2.1/servers/775294ed-3824-404d-b73c-2ecc16962b5c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 23:08:32.287650 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-157e7bd8-40d0-4319-9305-f58e42aeb8bb tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Calling method '.version_select at 0x7fbb2dabd430>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:08:32.311743 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-157e7bd8-40d0-4319-9305-f58e42aeb8bb tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-249254140" status: 202 len: 0 microversion: 2.1 time: 0.029155 Oct 04 23:08:32.312363 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4260/7700] 10.222.0.43 () {58 vars in 1269 bytes} [Tue Oct 4 23:08:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-249254140 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 23:08:41.458863 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-a6ca10fe-52ef-4893-b758-64eed460714a tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Action: 'create', calling method: .version_select at 0x7fbb2e8d31f0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-845113305", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMY84SP55D1MmAsbw99Pc0m76HGUuE3Ok5As+Hu1a+8z+x/C8KbO8nqg3ZJOQASU0a43OSgOjImOLKsiWFNBwdX3cSBO599b5stNLOnfcbadr1y6hin2/ENjR70SSNXf6w=="}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 23:08:41.475999 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-a6ca10fe-52ef-4893-b758-64eed460714a tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Getting quotas for project 79bde11f1ccc4a18919aff63b1757557. Resources: {'key_pairs'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 23:08:41.481839 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-a6ca10fe-52ef-4893-b758-64eed460714a tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Getting quotas for user 3e73b37189d04fa5a00d1c718ac9dbeb and project 79bde11f1ccc4a18919aff63b1757557. Resources: {'key_pairs'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 23:08:41.507365 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-a6ca10fe-52ef-4893-b758-64eed460714a tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.052625 Oct 04 23:08:41.507974 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3441/7701] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Oct 4 23:08:41 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 23:08:41.556524 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=41,nova_cell1:INSERT=1 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:08:41.561451 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-dc5e1008-d26e-4cb2-88fc-912d95cc3e7f tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1923383177", "imageRef": "787d9476-d285-421e-ac45-eb6968348d2d", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-845113305", "networks": [{"uuid": "58785199-8279-4343-9f1b-3b86be3b60be"}]}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 23:08:41.613041 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.network.neutron [None req-dc5e1008-d26e-4cb2-88fc-912d95cc3e7f tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] validate_networks() for [('58785199-8279-4343-9f1b-3b86be3b60be', None, None, None, None, None)] {{(pid=134101) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 23:08:42.055300 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-dc5e1008-d26e-4cb2-88fc-912d95cc3e7f tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Flavor limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 23:08:42.055749 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-dc5e1008-d26e-4cb2-88fc-912d95cc3e7f tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Image limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 23:08:42.056249 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-dc5e1008-d26e-4cb2-88fc-912d95cc3e7f tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Flavor pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 23:08:42.056681 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-dc5e1008-d26e-4cb2-88fc-912d95cc3e7f tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Image pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 23:08:42.057670 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-dc5e1008-d26e-4cb2-88fc-912d95cc3e7f tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 23:08:42.066641 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dc5e1008-d26e-4cb2-88fc-912d95cc3e7f tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:08:42.067143 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dc5e1008-d26e-4cb2-88fc-912d95cc3e7f tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:08:42.067598 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dc5e1008-d26e-4cb2-88fc-912d95cc3e7f tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:08:42.068352 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dc5e1008-d26e-4cb2-88fc-912d95cc3e7f tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:08:42.068826 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dc5e1008-d26e-4cb2-88fc-912d95cc3e7f tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:08:42.069273 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dc5e1008-d26e-4cb2-88fc-912d95cc3e7f tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:08:42.087712 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-dc5e1008-d26e-4cb2-88fc-912d95cc3e7f tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Getting quotas for project 79bde11f1ccc4a18919aff63b1757557. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 23:08:42.093136 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-dc5e1008-d26e-4cb2-88fc-912d95cc3e7f tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Getting quotas for user 3e73b37189d04fa5a00d1c718ac9dbeb and project 79bde11f1ccc4a18919aff63b1757557. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 23:08:42.105887 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-dc5e1008-d26e-4cb2-88fc-912d95cc3e7f tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Going to run 1 instances... {{(pid=134101) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 23:08:42.108236 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-dc5e1008-d26e-4cb2-88fc-912d95cc3e7f tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] [instance: a180e93f-0f5e-4f77-835c-4fd11cd7d9a3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='787d9476-d285-421e-ac45-eb6968348d2d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134101) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 23:08:42.156209 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-dc5e1008-d26e-4cb2-88fc-912d95cc3e7f tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.601402 Oct 04 23:08:42.156855 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4261/7702] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 23:08:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 603 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 23:08:42.168547 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-ae61c3b9-6edc-4b65-9952-99f46acbb423 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:08:42.169232 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-ae61c3b9-6edc-4b65-9952-99f46acbb423 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] [instance: a180e93f-0f5e-4f77-835c-4fd11cd7d9a3] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:08:42.265740 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:08:42.281985 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-ae61c3b9-6edc-4b65-9952-99f46acbb423 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e73b37189d04fa5a00d1c718ac9dbeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bde11f1ccc4a18919aff63b1757557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:08:42.293359 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-ae61c3b9-6edc-4b65-9952-99f46acbb423 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] 10.222.0.43 "GET /compute/v2.1/servers/a180e93f-0f5e-4f77-835c-4fd11cd7d9a3" status: 200 len: 1258 microversion: 2.1 time: 0.129318 Oct 04 23:08:42.293983 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3442/7703] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:08:42 2022] GET /compute/v2.1/servers/a180e93f-0f5e-4f77-835c-4fd11cd7d9a3 => generated 1258 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:08:43.317153 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-7389a2ac-fedc-4a69-a4d7-ce9b6551c1b8 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:08:43.317768 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-7389a2ac-fedc-4a69-a4d7-ce9b6551c1b8 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] [instance: a180e93f-0f5e-4f77-835c-4fd11cd7d9a3] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:08:43.325512 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7389a2ac-fedc-4a69-a4d7-ce9b6551c1b8 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:08:43.326016 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7389a2ac-fedc-4a69-a4d7-ce9b6551c1b8 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:08:43.326486 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7389a2ac-fedc-4a69-a4d7-ce9b6551c1b8 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:08:43.327202 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7389a2ac-fedc-4a69-a4d7-ce9b6551c1b8 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:08:43.327671 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7389a2ac-fedc-4a69-a4d7-ce9b6551c1b8 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:08:43.328293 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7389a2ac-fedc-4a69-a4d7-ce9b6551c1b8 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:08:43.446320 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-7389a2ac-fedc-4a69-a4d7-ce9b6551c1b8 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e73b37189d04fa5a00d1c718ac9dbeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bde11f1ccc4a18919aff63b1757557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:08:43.455200 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-7389a2ac-fedc-4a69-a4d7-ce9b6551c1b8 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] 10.222.0.43 "GET /compute/v2.1/servers/a180e93f-0f5e-4f77-835c-4fd11cd7d9a3" status: 200 len: 1328 microversion: 2.1 time: 0.142779 Oct 04 23:08:43.455800 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4262/7704] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:08:43 2022] GET /compute/v2.1/servers/a180e93f-0f5e-4f77-835c-4fd11cd7d9a3 => generated 1328 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:08:44.480343 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-0476eac0-b966-43bb-8438-dea89ddbf374 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:08:44.482246 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-0476eac0-b966-43bb-8438-dea89ddbf374 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] [instance: a180e93f-0f5e-4f77-835c-4fd11cd7d9a3] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:08:44.492344 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0476eac0-b966-43bb-8438-dea89ddbf374 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:08:44.493205 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0476eac0-b966-43bb-8438-dea89ddbf374 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:08:44.493823 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0476eac0-b966-43bb-8438-dea89ddbf374 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:08:44.494824 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0476eac0-b966-43bb-8438-dea89ddbf374 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:08:44.495467 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0476eac0-b966-43bb-8438-dea89ddbf374 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:08:44.496050 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0476eac0-b966-43bb-8438-dea89ddbf374 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:08:44.965505 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-0476eac0-b966-43bb-8438-dea89ddbf374 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e73b37189d04fa5a00d1c718ac9dbeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bde11f1ccc4a18919aff63b1757557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:08:44.973546 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-0476eac0-b966-43bb-8438-dea89ddbf374 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] 10.222.0.43 "GET /compute/v2.1/servers/a180e93f-0f5e-4f77-835c-4fd11cd7d9a3" status: 200 len: 1358 microversion: 2.1 time: 0.498966 Oct 04 23:08:44.974136 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3443/7705] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:08:44 2022] GET /compute/v2.1/servers/a180e93f-0f5e-4f77-835c-4fd11cd7d9a3 => generated 1358 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:08:45.998002 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-47623a22-a7f8-47ae-b81d-ddd2aa6bb35f tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:08:45.998670 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-47623a22-a7f8-47ae-b81d-ddd2aa6bb35f tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] [instance: a180e93f-0f5e-4f77-835c-4fd11cd7d9a3] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:08:46.005760 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-47623a22-a7f8-47ae-b81d-ddd2aa6bb35f tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:08:46.006264 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-47623a22-a7f8-47ae-b81d-ddd2aa6bb35f tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:08:46.006751 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-47623a22-a7f8-47ae-b81d-ddd2aa6bb35f tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:08:46.007472 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-47623a22-a7f8-47ae-b81d-ddd2aa6bb35f tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:08:46.007949 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-47623a22-a7f8-47ae-b81d-ddd2aa6bb35f tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:08:46.008397 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-47623a22-a7f8-47ae-b81d-ddd2aa6bb35f tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:08:46.151573 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-47623a22-a7f8-47ae-b81d-ddd2aa6bb35f tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e73b37189d04fa5a00d1c718ac9dbeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bde11f1ccc4a18919aff63b1757557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:08:46.161908 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-47623a22-a7f8-47ae-b81d-ddd2aa6bb35f tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] 10.222.0.43 "GET /compute/v2.1/servers/a180e93f-0f5e-4f77-835c-4fd11cd7d9a3" status: 200 len: 1358 microversion: 2.1 time: 0.168469 Oct 04 23:08:46.162917 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4263/7706] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:08:45 2022] GET /compute/v2.1/servers/a180e93f-0f5e-4f77-835c-4fd11cd7d9a3 => generated 1358 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:08:47.186567 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-5b3be89d-a7fa-41b4-8d38-92e71041376a tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:08:47.187599 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-5b3be89d-a7fa-41b4-8d38-92e71041376a tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] [instance: a180e93f-0f5e-4f77-835c-4fd11cd7d9a3] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:08:47.194488 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5b3be89d-a7fa-41b4-8d38-92e71041376a tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:08:47.194977 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5b3be89d-a7fa-41b4-8d38-92e71041376a tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:08:47.195417 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5b3be89d-a7fa-41b4-8d38-92e71041376a tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:08:47.196128 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5b3be89d-a7fa-41b4-8d38-92e71041376a tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:08:47.196582 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5b3be89d-a7fa-41b4-8d38-92e71041376a tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:08:47.197011 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5b3be89d-a7fa-41b4-8d38-92e71041376a tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:08:47.347281 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-5b3be89d-a7fa-41b4-8d38-92e71041376a tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e73b37189d04fa5a00d1c718ac9dbeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bde11f1ccc4a18919aff63b1757557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:08:47.355831 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-5b3be89d-a7fa-41b4-8d38-92e71041376a tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] 10.222.0.43 "GET /compute/v2.1/servers/a180e93f-0f5e-4f77-835c-4fd11cd7d9a3" status: 200 len: 1358 microversion: 2.1 time: 0.174233 Oct 04 23:08:47.356431 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3444/7707] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:08:47 2022] GET /compute/v2.1/servers/a180e93f-0f5e-4f77-835c-4fd11cd7d9a3 => generated 1358 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:08:48.379822 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-864e16fc-093d-4cd8-8fc8-f0ba43b0e477 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:08:48.380489 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-864e16fc-093d-4cd8-8fc8-f0ba43b0e477 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] [instance: a180e93f-0f5e-4f77-835c-4fd11cd7d9a3] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:08:48.382519 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=39,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:08:48.388966 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-864e16fc-093d-4cd8-8fc8-f0ba43b0e477 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:08:48.389458 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-864e16fc-093d-4cd8-8fc8-f0ba43b0e477 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:08:48.389941 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-864e16fc-093d-4cd8-8fc8-f0ba43b0e477 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:08:48.390684 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-864e16fc-093d-4cd8-8fc8-f0ba43b0e477 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:08:48.391162 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-864e16fc-093d-4cd8-8fc8-f0ba43b0e477 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:08:48.391610 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-864e16fc-093d-4cd8-8fc8-f0ba43b0e477 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:08:48.525228 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-864e16fc-093d-4cd8-8fc8-f0ba43b0e477 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e73b37189d04fa5a00d1c718ac9dbeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bde11f1ccc4a18919aff63b1757557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:08:48.536098 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-864e16fc-093d-4cd8-8fc8-f0ba43b0e477 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] 10.222.0.43 "GET /compute/v2.1/servers/a180e93f-0f5e-4f77-835c-4fd11cd7d9a3" status: 200 len: 1358 microversion: 2.1 time: 0.159884 Oct 04 23:08:48.551808 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4264/7708] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:08:48 2022] GET /compute/v2.1/servers/a180e93f-0f5e-4f77-835c-4fd11cd7d9a3 => generated 1358 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:08:49.561186 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-b0623ec1-441d-46f6-84d1-9406f0327c62 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:08:49.561810 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-b0623ec1-441d-46f6-84d1-9406f0327c62 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] [instance: a180e93f-0f5e-4f77-835c-4fd11cd7d9a3] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:08:49.564563 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:08:49.569935 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b0623ec1-441d-46f6-84d1-9406f0327c62 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:08:49.570445 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b0623ec1-441d-46f6-84d1-9406f0327c62 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:08:49.570897 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b0623ec1-441d-46f6-84d1-9406f0327c62 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:08:49.571599 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b0623ec1-441d-46f6-84d1-9406f0327c62 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:08:49.572063 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b0623ec1-441d-46f6-84d1-9406f0327c62 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:08:49.572511 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b0623ec1-441d-46f6-84d1-9406f0327c62 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:08:49.718247 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-b0623ec1-441d-46f6-84d1-9406f0327c62 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e73b37189d04fa5a00d1c718ac9dbeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bde11f1ccc4a18919aff63b1757557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:08:49.727095 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-b0623ec1-441d-46f6-84d1-9406f0327c62 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] 10.222.0.43 "GET /compute/v2.1/servers/a180e93f-0f5e-4f77-835c-4fd11cd7d9a3" status: 200 len: 1358 microversion: 2.1 time: 0.169791 Oct 04 23:08:49.743009 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3445/7709] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:08:49 2022] GET /compute/v2.1/servers/a180e93f-0f5e-4f77-835c-4fd11cd7d9a3 => generated 1358 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:08:50.751116 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-681cc549-206c-47f4-a1b7-9c1097d6b244 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:08:50.751752 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-681cc549-206c-47f4-a1b7-9c1097d6b244 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] [instance: a180e93f-0f5e-4f77-835c-4fd11cd7d9a3] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:08:50.758668 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-681cc549-206c-47f4-a1b7-9c1097d6b244 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:08:50.759198 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-681cc549-206c-47f4-a1b7-9c1097d6b244 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:08:50.759655 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-681cc549-206c-47f4-a1b7-9c1097d6b244 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:08:50.760911 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-681cc549-206c-47f4-a1b7-9c1097d6b244 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:08:50.761390 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-681cc549-206c-47f4-a1b7-9c1097d6b244 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:08:50.761837 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-681cc549-206c-47f4-a1b7-9c1097d6b244 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:08:50.900001 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-681cc549-206c-47f4-a1b7-9c1097d6b244 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e73b37189d04fa5a00d1c718ac9dbeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bde11f1ccc4a18919aff63b1757557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:08:50.908127 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-681cc549-206c-47f4-a1b7-9c1097d6b244 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] 10.222.0.43 "GET /compute/v2.1/servers/a180e93f-0f5e-4f77-835c-4fd11cd7d9a3" status: 200 len: 1358 microversion: 2.1 time: 0.160957 Oct 04 23:08:50.908929 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4265/7710] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:08:50 2022] GET /compute/v2.1/servers/a180e93f-0f5e-4f77-835c-4fd11cd7d9a3 => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:08:51.931053 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-74f59a5a-23c6-4279-a4f4-bc1f482ee674 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:08:51.931650 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-74f59a5a-23c6-4279-a4f4-bc1f482ee674 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] [instance: a180e93f-0f5e-4f77-835c-4fd11cd7d9a3] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:08:51.938681 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-74f59a5a-23c6-4279-a4f4-bc1f482ee674 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:08:51.939172 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-74f59a5a-23c6-4279-a4f4-bc1f482ee674 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:08:51.939615 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-74f59a5a-23c6-4279-a4f4-bc1f482ee674 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:08:51.940318 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-74f59a5a-23c6-4279-a4f4-bc1f482ee674 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:08:51.940780 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-74f59a5a-23c6-4279-a4f4-bc1f482ee674 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:08:51.941215 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-74f59a5a-23c6-4279-a4f4-bc1f482ee674 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:08:52.071926 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-74f59a5a-23c6-4279-a4f4-bc1f482ee674 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e73b37189d04fa5a00d1c718ac9dbeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bde11f1ccc4a18919aff63b1757557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:08:52.081130 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-74f59a5a-23c6-4279-a4f4-bc1f482ee674 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] 10.222.0.43 "GET /compute/v2.1/servers/a180e93f-0f5e-4f77-835c-4fd11cd7d9a3" status: 200 len: 1358 microversion: 2.1 time: 0.153829 Oct 04 23:08:52.082209 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3446/7711] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:08:51 2022] GET /compute/v2.1/servers/a180e93f-0f5e-4f77-835c-4fd11cd7d9a3 => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:08:53.109538 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-41118425-6ee3-4b53-a3ac-ec093abf8db0 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:08:53.110298 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-41118425-6ee3-4b53-a3ac-ec093abf8db0 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] [instance: a180e93f-0f5e-4f77-835c-4fd11cd7d9a3] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:08:53.113044 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=2 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:08:53.113734 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=6 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:08:53.120168 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-41118425-6ee3-4b53-a3ac-ec093abf8db0 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:08:53.120905 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-41118425-6ee3-4b53-a3ac-ec093abf8db0 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:08:53.121365 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-41118425-6ee3-4b53-a3ac-ec093abf8db0 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:08:53.122105 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-41118425-6ee3-4b53-a3ac-ec093abf8db0 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:08:53.122616 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-41118425-6ee3-4b53-a3ac-ec093abf8db0 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:08:53.123063 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-41118425-6ee3-4b53-a3ac-ec093abf8db0 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:08:53.302974 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-41118425-6ee3-4b53-a3ac-ec093abf8db0 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e73b37189d04fa5a00d1c718ac9dbeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bde11f1ccc4a18919aff63b1757557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:08:53.311906 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-41118425-6ee3-4b53-a3ac-ec093abf8db0 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] 10.222.0.43 "GET /compute/v2.1/servers/a180e93f-0f5e-4f77-835c-4fd11cd7d9a3" status: 200 len: 1358 microversion: 2.1 time: 0.206678 Oct 04 23:08:53.312498 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4266/7712] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:08:53 2022] GET /compute/v2.1/servers/a180e93f-0f5e-4f77-835c-4fd11cd7d9a3 => generated 1358 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:08:54.335681 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-fea0001f-7a40-422a-a064-361fe7cde414 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:08:54.336295 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-fea0001f-7a40-422a-a064-361fe7cde414 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] [instance: a180e93f-0f5e-4f77-835c-4fd11cd7d9a3] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:08:54.338912 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell0:SELECT=6 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:08:54.345129 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fea0001f-7a40-422a-a064-361fe7cde414 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:08:54.345621 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fea0001f-7a40-422a-a064-361fe7cde414 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:08:54.346066 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fea0001f-7a40-422a-a064-361fe7cde414 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:08:54.346807 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fea0001f-7a40-422a-a064-361fe7cde414 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:08:54.347260 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fea0001f-7a40-422a-a064-361fe7cde414 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:08:54.347698 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fea0001f-7a40-422a-a064-361fe7cde414 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:08:54.476498 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-fea0001f-7a40-422a-a064-361fe7cde414 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e73b37189d04fa5a00d1c718ac9dbeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bde11f1ccc4a18919aff63b1757557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:08:54.484716 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-fea0001f-7a40-422a-a064-361fe7cde414 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] 10.222.0.43 "GET /compute/v2.1/servers/a180e93f-0f5e-4f77-835c-4fd11cd7d9a3" status: 200 len: 1358 microversion: 2.1 time: 0.153211 Oct 04 23:08:54.485300 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3447/7713] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:08:54 2022] GET /compute/v2.1/servers/a180e93f-0f5e-4f77-835c-4fd11cd7d9a3 => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:08:55.507699 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-4f990ed2-378f-407d-a214-14f3144491d1 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:08:55.508263 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-4f990ed2-378f-407d-a214-14f3144491d1 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] [instance: a180e93f-0f5e-4f77-835c-4fd11cd7d9a3] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:08:55.515238 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4f990ed2-378f-407d-a214-14f3144491d1 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:08:55.515748 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4f990ed2-378f-407d-a214-14f3144491d1 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:08:55.516217 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4f990ed2-378f-407d-a214-14f3144491d1 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:08:55.516934 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4f990ed2-378f-407d-a214-14f3144491d1 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:08:55.517408 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4f990ed2-378f-407d-a214-14f3144491d1 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:08:55.517860 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4f990ed2-378f-407d-a214-14f3144491d1 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:08:55.649767 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-4f990ed2-378f-407d-a214-14f3144491d1 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e73b37189d04fa5a00d1c718ac9dbeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bde11f1ccc4a18919aff63b1757557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:08:55.658327 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-4f990ed2-378f-407d-a214-14f3144491d1 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] 10.222.0.43 "GET /compute/v2.1/servers/a180e93f-0f5e-4f77-835c-4fd11cd7d9a3" status: 200 len: 1358 microversion: 2.1 time: 0.154571 Oct 04 23:08:55.658929 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4267/7714] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:08:55 2022] GET /compute/v2.1/servers/a180e93f-0f5e-4f77-835c-4fd11cd7d9a3 => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:08:56.682972 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-b75d0761-b93d-4b63-8d59-1b71652dde07 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:08:56.683605 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-b75d0761-b93d-4b63-8d59-1b71652dde07 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] [instance: a180e93f-0f5e-4f77-835c-4fd11cd7d9a3] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:08:56.690584 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b75d0761-b93d-4b63-8d59-1b71652dde07 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:08:56.691079 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b75d0761-b93d-4b63-8d59-1b71652dde07 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:08:56.691527 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b75d0761-b93d-4b63-8d59-1b71652dde07 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:08:56.692232 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b75d0761-b93d-4b63-8d59-1b71652dde07 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:08:56.692730 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b75d0761-b93d-4b63-8d59-1b71652dde07 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:08:56.693169 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b75d0761-b93d-4b63-8d59-1b71652dde07 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:08:56.825014 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-b75d0761-b93d-4b63-8d59-1b71652dde07 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e73b37189d04fa5a00d1c718ac9dbeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bde11f1ccc4a18919aff63b1757557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:08:56.832696 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-b75d0761-b93d-4b63-8d59-1b71652dde07 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] 10.222.0.43 "GET /compute/v2.1/servers/a180e93f-0f5e-4f77-835c-4fd11cd7d9a3" status: 200 len: 1358 microversion: 2.1 time: 0.154887 Oct 04 23:08:56.833286 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3448/7715] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:08:56 2022] GET /compute/v2.1/servers/a180e93f-0f5e-4f77-835c-4fd11cd7d9a3 => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:08:57.856560 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-97477919-abd7-4563-9836-a5a85e5577f4 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:08:57.857191 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-97477919-abd7-4563-9836-a5a85e5577f4 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] [instance: a180e93f-0f5e-4f77-835c-4fd11cd7d9a3] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:08:57.864073 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-97477919-abd7-4563-9836-a5a85e5577f4 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:08:57.864576 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-97477919-abd7-4563-9836-a5a85e5577f4 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:08:57.865030 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-97477919-abd7-4563-9836-a5a85e5577f4 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:08:57.865774 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-97477919-abd7-4563-9836-a5a85e5577f4 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:08:57.866248 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-97477919-abd7-4563-9836-a5a85e5577f4 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:08:57.866720 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-97477919-abd7-4563-9836-a5a85e5577f4 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:08:57.999826 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-97477919-abd7-4563-9836-a5a85e5577f4 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e73b37189d04fa5a00d1c718ac9dbeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bde11f1ccc4a18919aff63b1757557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:08:58.007472 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-97477919-abd7-4563-9836-a5a85e5577f4 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] 10.222.0.43 "GET /compute/v2.1/servers/a180e93f-0f5e-4f77-835c-4fd11cd7d9a3" status: 200 len: 1358 microversion: 2.1 time: 0.155241 Oct 04 23:08:58.008044 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4268/7716] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:08:57 2022] GET /compute/v2.1/servers/a180e93f-0f5e-4f77-835c-4fd11cd7d9a3 => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:08:58.828548 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-1ebd3ed1-cabe-40d6-9ec7-d98b8ae82986 req-21026408-4b79-4ecb-a3ca-49642bea3b9a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a180e93f-0f5e-4f77-835c-4fd11cd7d9a3", "tag": "e3b9d81f-f6d0-483c-9832-dd757ca3bf10"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 23:08:58.842590 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-1ebd3ed1-cabe-40d6-9ec7-d98b8ae82986 req-21026408-4b79-4ecb-a3ca-49642bea3b9a service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:08:58.843412 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-1ebd3ed1-cabe-40d6-9ec7-d98b8ae82986 req-21026408-4b79-4ecb-a3ca-49642bea3b9a service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:08:58.843544 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-1ebd3ed1-cabe-40d6-9ec7-d98b8ae82986 req-21026408-4b79-4ecb-a3ca-49642bea3b9a service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:08:58.856419 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-1ebd3ed1-cabe-40d6-9ec7-d98b8ae82986 req-21026408-4b79-4ecb-a3ca-49642bea3b9a service nova] Creating event network-changed:e3b9d81f-f6d0-483c-9832-dd757ca3bf10 for instance a180e93f-0f5e-4f77-835c-4fd11cd7d9a3 on n-h2-860284-1 Oct 04 23:08:58.861479 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-1ebd3ed1-cabe-40d6-9ec7-d98b8ae82986 req-21026408-4b79-4ecb-a3ca-49642bea3b9a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038894 Oct 04 23:08:58.862423 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3449/7717] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 23:08:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 23:08:59.030504 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-df1490a6-61c2-40f9-ad6a-08b80b469dd2 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:08:59.031169 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-df1490a6-61c2-40f9-ad6a-08b80b469dd2 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] [instance: a180e93f-0f5e-4f77-835c-4fd11cd7d9a3] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:08:59.038900 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-df1490a6-61c2-40f9-ad6a-08b80b469dd2 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:08:59.039309 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-df1490a6-61c2-40f9-ad6a-08b80b469dd2 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:08:59.039803 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-df1490a6-61c2-40f9-ad6a-08b80b469dd2 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:08:59.040612 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-df1490a6-61c2-40f9-ad6a-08b80b469dd2 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:08:59.041726 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-df1490a6-61c2-40f9-ad6a-08b80b469dd2 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:08:59.042302 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-df1490a6-61c2-40f9-ad6a-08b80b469dd2 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:08:59.472990 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-df1490a6-61c2-40f9-ad6a-08b80b469dd2 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e73b37189d04fa5a00d1c718ac9dbeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bde11f1ccc4a18919aff63b1757557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:08:59.481919 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-df1490a6-61c2-40f9-ad6a-08b80b469dd2 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] 10.222.0.43 "GET /compute/v2.1/servers/a180e93f-0f5e-4f77-835c-4fd11cd7d9a3" status: 200 len: 1358 microversion: 2.1 time: 0.455543 Oct 04 23:08:59.482527 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4269/7718] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:08:59 2022] GET /compute/v2.1/servers/a180e93f-0f5e-4f77-835c-4fd11cd7d9a3 => generated 1358 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:09:00.506918 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-cabc4de7-1483-41ac-a634-de2ce5c39941 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:09:00.507538 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-cabc4de7-1483-41ac-a634-de2ce5c39941 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] [instance: a180e93f-0f5e-4f77-835c-4fd11cd7d9a3] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:09:00.514615 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cabc4de7-1483-41ac-a634-de2ce5c39941 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:09:00.514913 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cabc4de7-1483-41ac-a634-de2ce5c39941 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:09:00.515357 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cabc4de7-1483-41ac-a634-de2ce5c39941 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:09:00.516055 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cabc4de7-1483-41ac-a634-de2ce5c39941 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:09:00.516511 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cabc4de7-1483-41ac-a634-de2ce5c39941 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:09:00.516938 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cabc4de7-1483-41ac-a634-de2ce5c39941 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:09:00.652947 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-cabc4de7-1483-41ac-a634-de2ce5c39941 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e73b37189d04fa5a00d1c718ac9dbeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bde11f1ccc4a18919aff63b1757557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:09:00.660735 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-cabc4de7-1483-41ac-a634-de2ce5c39941 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] 10.222.0.43 "GET /compute/v2.1/servers/a180e93f-0f5e-4f77-835c-4fd11cd7d9a3" status: 200 len: 1358 microversion: 2.1 time: 0.159098 Oct 04 23:09:00.661330 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3450/7719] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:09:00 2022] GET /compute/v2.1/servers/a180e93f-0f5e-4f77-835c-4fd11cd7d9a3 => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:09:01.684497 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-6775b9cf-03ad-44ab-8b7c-c51fc8ad1fa8 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:09:01.685168 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-6775b9cf-03ad-44ab-8b7c-c51fc8ad1fa8 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] [instance: a180e93f-0f5e-4f77-835c-4fd11cd7d9a3] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:09:01.692401 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6775b9cf-03ad-44ab-8b7c-c51fc8ad1fa8 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:09:01.692907 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6775b9cf-03ad-44ab-8b7c-c51fc8ad1fa8 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:09:01.693368 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6775b9cf-03ad-44ab-8b7c-c51fc8ad1fa8 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:09:01.694086 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6775b9cf-03ad-44ab-8b7c-c51fc8ad1fa8 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:09:01.694595 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6775b9cf-03ad-44ab-8b7c-c51fc8ad1fa8 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:09:01.695044 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6775b9cf-03ad-44ab-8b7c-c51fc8ad1fa8 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:09:01.828310 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-6775b9cf-03ad-44ab-8b7c-c51fc8ad1fa8 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e73b37189d04fa5a00d1c718ac9dbeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bde11f1ccc4a18919aff63b1757557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:09:01.836171 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-6775b9cf-03ad-44ab-8b7c-c51fc8ad1fa8 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] 10.222.0.43 "GET /compute/v2.1/servers/a180e93f-0f5e-4f77-835c-4fd11cd7d9a3" status: 200 len: 1358 microversion: 2.1 time: 0.155977 Oct 04 23:09:01.836747 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4270/7720] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:09:01 2022] GET /compute/v2.1/servers/a180e93f-0f5e-4f77-835c-4fd11cd7d9a3 => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:09:02.860736 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-40f719d4-ad6e-4ab9-9155-1d6cb59b0aa8 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:09:02.861362 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-40f719d4-ad6e-4ab9-9155-1d6cb59b0aa8 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] [instance: a180e93f-0f5e-4f77-835c-4fd11cd7d9a3] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:09:02.868315 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-40f719d4-ad6e-4ab9-9155-1d6cb59b0aa8 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:09:02.868798 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-40f719d4-ad6e-4ab9-9155-1d6cb59b0aa8 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:09:02.869837 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-40f719d4-ad6e-4ab9-9155-1d6cb59b0aa8 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:09:02.870646 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-40f719d4-ad6e-4ab9-9155-1d6cb59b0aa8 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:09:02.871112 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-40f719d4-ad6e-4ab9-9155-1d6cb59b0aa8 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:09:02.871552 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-40f719d4-ad6e-4ab9-9155-1d6cb59b0aa8 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:09:03.001904 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-40f719d4-ad6e-4ab9-9155-1d6cb59b0aa8 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e73b37189d04fa5a00d1c718ac9dbeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bde11f1ccc4a18919aff63b1757557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:09:03.010338 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-40f719d4-ad6e-4ab9-9155-1d6cb59b0aa8 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] 10.222.0.43 "GET /compute/v2.1/servers/a180e93f-0f5e-4f77-835c-4fd11cd7d9a3" status: 200 len: 1358 microversion: 2.1 time: 0.152988 Oct 04 23:09:03.010916 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3451/7721] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:09:02 2022] GET /compute/v2.1/servers/a180e93f-0f5e-4f77-835c-4fd11cd7d9a3 => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:09:04.033717 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-c2d4a352-f88d-4100-8fac-cb1e725a7ff1 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:09:04.034404 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-c2d4a352-f88d-4100-8fac-cb1e725a7ff1 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] [instance: a180e93f-0f5e-4f77-835c-4fd11cd7d9a3] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:09:04.041428 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c2d4a352-f88d-4100-8fac-cb1e725a7ff1 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:09:04.041978 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c2d4a352-f88d-4100-8fac-cb1e725a7ff1 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:09:04.042535 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c2d4a352-f88d-4100-8fac-cb1e725a7ff1 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:09:04.043261 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c2d4a352-f88d-4100-8fac-cb1e725a7ff1 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:09:04.043738 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c2d4a352-f88d-4100-8fac-cb1e725a7ff1 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:09:04.044183 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c2d4a352-f88d-4100-8fac-cb1e725a7ff1 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:09:04.176490 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-c2d4a352-f88d-4100-8fac-cb1e725a7ff1 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e73b37189d04fa5a00d1c718ac9dbeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bde11f1ccc4a18919aff63b1757557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:09:04.184307 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-c2d4a352-f88d-4100-8fac-cb1e725a7ff1 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] 10.222.0.43 "GET /compute/v2.1/servers/a180e93f-0f5e-4f77-835c-4fd11cd7d9a3" status: 200 len: 1358 microversion: 2.1 time: 0.154574 Oct 04 23:09:04.184882 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4271/7722] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:09:04 2022] GET /compute/v2.1/servers/a180e93f-0f5e-4f77-835c-4fd11cd7d9a3 => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:09:05.208764 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-09eb99d2-aa56-4448-8671-ae3de00fabab tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:09:05.209399 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-09eb99d2-aa56-4448-8671-ae3de00fabab tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] [instance: a180e93f-0f5e-4f77-835c-4fd11cd7d9a3] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:09:05.216380 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-09eb99d2-aa56-4448-8671-ae3de00fabab tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:09:05.216875 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-09eb99d2-aa56-4448-8671-ae3de00fabab tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:09:05.217321 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-09eb99d2-aa56-4448-8671-ae3de00fabab tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:09:05.218032 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-09eb99d2-aa56-4448-8671-ae3de00fabab tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:09:05.218537 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-09eb99d2-aa56-4448-8671-ae3de00fabab tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:09:05.218974 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-09eb99d2-aa56-4448-8671-ae3de00fabab tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:09:05.346783 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-09eb99d2-aa56-4448-8671-ae3de00fabab tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e73b37189d04fa5a00d1c718ac9dbeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bde11f1ccc4a18919aff63b1757557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:09:05.355626 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-09eb99d2-aa56-4448-8671-ae3de00fabab tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] 10.222.0.43 "GET /compute/v2.1/servers/a180e93f-0f5e-4f77-835c-4fd11cd7d9a3" status: 200 len: 1358 microversion: 2.1 time: 0.150301 Oct 04 23:09:05.356225 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3452/7723] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:09:05 2022] GET /compute/v2.1/servers/a180e93f-0f5e-4f77-835c-4fd11cd7d9a3 => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:09:05.857780 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-7f78fa64-83a8-4820-8c1b-c7d4c4c157d4 req-15d71d89-a9fc-4422-a58e-b28ed968f623 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a180e93f-0f5e-4f77-835c-4fd11cd7d9a3", "name": "network-vif-plugged", "status": "completed", "tag": "e3b9d81f-f6d0-483c-9832-dd757ca3bf10"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 23:09:05.867341 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-7f78fa64-83a8-4820-8c1b-c7d4c4c157d4 req-15d71d89-a9fc-4422-a58e-b28ed968f623 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:09:05.867845 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-7f78fa64-83a8-4820-8c1b-c7d4c4c157d4 req-15d71d89-a9fc-4422-a58e-b28ed968f623 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:09:05.868304 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-7f78fa64-83a8-4820-8c1b-c7d4c4c157d4 req-15d71d89-a9fc-4422-a58e-b28ed968f623 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:09:05.880050 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-7f78fa64-83a8-4820-8c1b-c7d4c4c157d4 req-15d71d89-a9fc-4422-a58e-b28ed968f623 service nova] Creating event network-vif-plugged:e3b9d81f-f6d0-483c-9832-dd757ca3bf10 for instance a180e93f-0f5e-4f77-835c-4fd11cd7d9a3 on n-h2-860284-1 Oct 04 23:09:05.884992 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-7f78fa64-83a8-4820-8c1b-c7d4c4c157d4 req-15d71d89-a9fc-4422-a58e-b28ed968f623 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086939 Oct 04 23:09:05.886269 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4272/7724] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 23:09:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 23:09:06.378629 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-7f3568dd-a60d-49f8-9aa7-1e47c7bdb17a tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:09:06.379199 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-7f3568dd-a60d-49f8-9aa7-1e47c7bdb17a tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] [instance: a180e93f-0f5e-4f77-835c-4fd11cd7d9a3] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:09:06.385974 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7f3568dd-a60d-49f8-9aa7-1e47c7bdb17a tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:09:06.386494 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7f3568dd-a60d-49f8-9aa7-1e47c7bdb17a tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:09:06.386935 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7f3568dd-a60d-49f8-9aa7-1e47c7bdb17a tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:09:06.387624 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7f3568dd-a60d-49f8-9aa7-1e47c7bdb17a tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:09:06.388079 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7f3568dd-a60d-49f8-9aa7-1e47c7bdb17a tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:09:06.388505 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7f3568dd-a60d-49f8-9aa7-1e47c7bdb17a tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:09:06.516578 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-7f3568dd-a60d-49f8-9aa7-1e47c7bdb17a tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e73b37189d04fa5a00d1c718ac9dbeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bde11f1ccc4a18919aff63b1757557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:09:06.524293 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-7f3568dd-a60d-49f8-9aa7-1e47c7bdb17a tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] 10.222.0.43 "GET /compute/v2.1/servers/a180e93f-0f5e-4f77-835c-4fd11cd7d9a3" status: 200 len: 1358 microversion: 2.1 time: 0.149738 Oct 04 23:09:06.524877 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3453/7725] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:09:06 2022] GET /compute/v2.1/servers/a180e93f-0f5e-4f77-835c-4fd11cd7d9a3 => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:09:07.549638 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-650b299c-b365-4645-9a35-37e090e80e22 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:09:07.550473 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-650b299c-b365-4645-9a35-37e090e80e22 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] [instance: a180e93f-0f5e-4f77-835c-4fd11cd7d9a3] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:09:07.556759 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-650b299c-b365-4645-9a35-37e090e80e22 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:09:07.557256 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-650b299c-b365-4645-9a35-37e090e80e22 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:09:07.558250 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-650b299c-b365-4645-9a35-37e090e80e22 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:09:07.559060 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-650b299c-b365-4645-9a35-37e090e80e22 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:09:07.559534 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-650b299c-b365-4645-9a35-37e090e80e22 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:09:07.559977 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-650b299c-b365-4645-9a35-37e090e80e22 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:09:07.690179 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-650b299c-b365-4645-9a35-37e090e80e22 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e73b37189d04fa5a00d1c718ac9dbeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bde11f1ccc4a18919aff63b1757557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:09:07.698061 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-650b299c-b365-4645-9a35-37e090e80e22 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] 10.222.0.43 "GET /compute/v2.1/servers/a180e93f-0f5e-4f77-835c-4fd11cd7d9a3" status: 200 len: 1549 microversion: 2.1 time: 0.153982 Oct 04 23:09:07.698666 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4273/7726] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:09:07 2022] GET /compute/v2.1/servers/a180e93f-0f5e-4f77-835c-4fd11cd7d9a3 => generated 1549 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:09:07.720591 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-e8c0eec9-93b3-4993-a7a5-4e07f85dfb99 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:09:07.721246 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-e8c0eec9-93b3-4993-a7a5-4e07f85dfb99 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] [instance: a180e93f-0f5e-4f77-835c-4fd11cd7d9a3] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:09:07.728809 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e8c0eec9-93b3-4993-a7a5-4e07f85dfb99 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:09:07.729838 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e8c0eec9-93b3-4993-a7a5-4e07f85dfb99 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:09:07.730637 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e8c0eec9-93b3-4993-a7a5-4e07f85dfb99 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:09:07.731357 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e8c0eec9-93b3-4993-a7a5-4e07f85dfb99 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:09:07.731822 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e8c0eec9-93b3-4993-a7a5-4e07f85dfb99 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:09:07.732253 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e8c0eec9-93b3-4993-a7a5-4e07f85dfb99 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:09:07.864201 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-e8c0eec9-93b3-4993-a7a5-4e07f85dfb99 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e73b37189d04fa5a00d1c718ac9dbeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bde11f1ccc4a18919aff63b1757557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:09:07.872757 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-e8c0eec9-93b3-4993-a7a5-4e07f85dfb99 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] 10.222.0.43 "GET /compute/v2.1/servers/a180e93f-0f5e-4f77-835c-4fd11cd7d9a3" status: 200 len: 1549 microversion: 2.1 time: 0.156603 Oct 04 23:09:07.873358 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3454/7727] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:09:07 2022] GET /compute/v2.1/servers/a180e93f-0f5e-4f77-835c-4fd11cd7d9a3 => generated 1549 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:09:07.895088 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-a000f9c1-9e50-4425-9c90-141401389ca3 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:09:07.899875 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-a000f9c1-9e50-4425-9c90-141401389ca3 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3e73b37189d04fa5a00d1c718ac9dbeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bde11f1ccc4a18919aff63b1757557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:09:07.900693 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-a000f9c1-9e50-4425-9c90-141401389ca3 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Searching by: {'deleted': False, 'project_id': '79bde11f1ccc4a18919aff63b1757557'} {{(pid=134101) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 23:09:07.905995 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a000f9c1-9e50-4425-9c90-141401389ca3 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:09:07.906533 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a000f9c1-9e50-4425-9c90-141401389ca3 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:09:07.906987 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a000f9c1-9e50-4425-9c90-141401389ca3 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:09:07.907733 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a000f9c1-9e50-4425-9c90-141401389ca3 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:09:07.908216 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a000f9c1-9e50-4425-9c90-141401389ca3 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:09:07.908651 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a000f9c1-9e50-4425-9c90-141401389ca3 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:09:07.933857 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.multi_cell_list [None req-a000f9c1-9e50-4425-9c90-141401389ca3 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=134101) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 23:09:07.960595 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-a000f9c1-9e50-4425-9c90-141401389ca3 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] 10.222.0.43 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.069358 Oct 04 23:09:07.961184 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4274/7728] 10.222.0.43 () {58 vars in 1125 bytes} [Tue Oct 4 23:09:07 2022] GET /compute/v2.1/servers => generated 343 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 23:09:07.973119 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-a5fa3766-03f5-4467-b4c1-15f73405c815 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:09:07.973774 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-a5fa3766-03f5-4467-b4c1-15f73405c815 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] [instance: a180e93f-0f5e-4f77-835c-4fd11cd7d9a3] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:09:07.981220 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a5fa3766-03f5-4467-b4c1-15f73405c815 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:09:07.981722 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a5fa3766-03f5-4467-b4c1-15f73405c815 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:09:07.982169 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a5fa3766-03f5-4467-b4c1-15f73405c815 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:09:07.982953 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a5fa3766-03f5-4467-b4c1-15f73405c815 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:09:07.983419 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a5fa3766-03f5-4467-b4c1-15f73405c815 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:09:07.983854 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a5fa3766-03f5-4467-b4c1-15f73405c815 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:09:08.111528 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-a5fa3766-03f5-4467-b4c1-15f73405c815 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e73b37189d04fa5a00d1c718ac9dbeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bde11f1ccc4a18919aff63b1757557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:09:08.119388 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-a5fa3766-03f5-4467-b4c1-15f73405c815 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] 10.222.0.43 "GET /compute/v2.1/servers/a180e93f-0f5e-4f77-835c-4fd11cd7d9a3" status: 200 len: 1549 microversion: 2.1 time: 0.150455 Oct 04 23:09:08.120509 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3455/7729] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:09:07 2022] GET /compute/v2.1/servers/a180e93f-0f5e-4f77-835c-4fd11cd7d9a3 => generated 1549 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:09:09.639954 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-d1343a82-bfca-4ec5-ba8e-3ed7d81a521f tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fa6bd077-af87-4793-8eac-561f76e76374"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 23:09:09.642282 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-d1343a82-bfca-4ec5-ba8e-3ed7d81a521f tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] [instance: a180e93f-0f5e-4f77-835c-4fd11cd7d9a3] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:09:09.649170 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d1343a82-bfca-4ec5-ba8e-3ed7d81a521f tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:09:09.649664 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d1343a82-bfca-4ec5-ba8e-3ed7d81a521f tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:09:09.650116 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d1343a82-bfca-4ec5-ba8e-3ed7d81a521f tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:09:09.650840 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d1343a82-bfca-4ec5-ba8e-3ed7d81a521f tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:09:09.651872 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d1343a82-bfca-4ec5-ba8e-3ed7d81a521f tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:09:09.652890 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d1343a82-bfca-4ec5-ba8e-3ed7d81a521f tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:09:09.907978 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-d1343a82-bfca-4ec5-ba8e-3ed7d81a521f tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] 10.222.0.43 "POST /compute/v2.1/servers/a180e93f-0f5e-4f77-835c-4fd11cd7d9a3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.271818 Oct 04 23:09:09.908716 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4275/7730] 10.222.0.43 () {60 vars in 1323 bytes} [Tue Oct 4 23:09:09 2022] POST /compute/v2.1/servers/a180e93f-0f5e-4f77-835c-4fd11cd7d9a3/os-volume_attachments => generated 194 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 23:09:20.693600 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-47fe4c51-347d-43c6-bb9e-a6f84be84297 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:09:20.694224 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-47fe4c51-347d-43c6-bb9e-a6f84be84297 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] [instance: a180e93f-0f5e-4f77-835c-4fd11cd7d9a3] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:09:20.697245 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_api:SELECT=21 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:09:20.698049 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=74 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:09:20.704127 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-47fe4c51-347d-43c6-bb9e-a6f84be84297 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:09:20.704618 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-47fe4c51-347d-43c6-bb9e-a6f84be84297 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:09:20.705061 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-47fe4c51-347d-43c6-bb9e-a6f84be84297 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:09:20.705766 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-47fe4c51-347d-43c6-bb9e-a6f84be84297 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:09:20.706225 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-47fe4c51-347d-43c6-bb9e-a6f84be84297 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:09:20.706688 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-47fe4c51-347d-43c6-bb9e-a6f84be84297 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:09:20.839428 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-47fe4c51-347d-43c6-bb9e-a6f84be84297 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e73b37189d04fa5a00d1c718ac9dbeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bde11f1ccc4a18919aff63b1757557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:09:20.848188 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-47fe4c51-347d-43c6-bb9e-a6f84be84297 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] 10.222.0.43 "GET /compute/v2.1/servers/a180e93f-0f5e-4f77-835c-4fd11cd7d9a3" status: 200 len: 1595 microversion: 2.1 time: 0.158544 Oct 04 23:09:20.848792 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3456/7731] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:09:20 2022] GET /compute/v2.1/servers/a180e93f-0f5e-4f77-835c-4fd11cd7d9a3 => generated 1595 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:09:22.470449 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=2 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:09:22.471411 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=23 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:09:22.472104 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:09:22.477541 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-96ece73f-e0e0-4744-9729-a4f02f5a7bac req-d960d714-57ad-483e-a7da-b34bc0e54474 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a180e93f-0f5e-4f77-835c-4fd11cd7d9a3", "tag": "e3b9d81f-f6d0-483c-9832-dd757ca3bf10"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 23:09:22.490970 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-96ece73f-e0e0-4744-9729-a4f02f5a7bac req-d960d714-57ad-483e-a7da-b34bc0e54474 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:09:22.491536 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-96ece73f-e0e0-4744-9729-a4f02f5a7bac req-d960d714-57ad-483e-a7da-b34bc0e54474 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:09:22.492016 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-96ece73f-e0e0-4744-9729-a4f02f5a7bac req-d960d714-57ad-483e-a7da-b34bc0e54474 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:09:22.505300 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-96ece73f-e0e0-4744-9729-a4f02f5a7bac req-d960d714-57ad-483e-a7da-b34bc0e54474 service nova] Creating event network-changed:e3b9d81f-f6d0-483c-9832-dd757ca3bf10 for instance a180e93f-0f5e-4f77-835c-4fd11cd7d9a3 on n-h2-860284-1 Oct 04 23:09:22.510967 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-96ece73f-e0e0-4744-9729-a4f02f5a7bac req-d960d714-57ad-483e-a7da-b34bc0e54474 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042404 Oct 04 23:09:22.511810 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4276/7732] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 23:09:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 23:09:23.516343 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-8b02dbed-87cd-4a94-92b2-d0b4b957c9ea tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1999569690"}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 23:09:23.516909 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-8b02dbed-87cd-4a94-92b2-d0b4b957c9ea tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] [instance: a180e93f-0f5e-4f77-835c-4fd11cd7d9a3] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:09:23.524940 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8b02dbed-87cd-4a94-92b2-d0b4b957c9ea tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:09:23.525468 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8b02dbed-87cd-4a94-92b2-d0b4b957c9ea tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:09:23.525912 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8b02dbed-87cd-4a94-92b2-d0b4b957c9ea tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:09:23.526661 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8b02dbed-87cd-4a94-92b2-d0b4b957c9ea tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:09:23.527128 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8b02dbed-87cd-4a94-92b2-d0b4b957c9ea tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:09:23.528175 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8b02dbed-87cd-4a94-92b2-d0b4b957c9ea tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:09:23.662989 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.network.security_group_api [None req-8b02dbed-87cd-4a94-92b2-d0b4b957c9ea tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Adding security group 77def137-5c51-4861-8348-c436d9d99168 to port e3b9d81f-f6d0-483c-9832-dd757ca3bf10 Oct 04 23:09:23.983773 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-8b02dbed-87cd-4a94-92b2-d0b4b957c9ea tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] 10.222.0.43 "POST /compute/v2.1/servers/a180e93f-0f5e-4f77-835c-4fd11cd7d9a3/action" status: 202 len: 0 microversion: 2.1 time: 0.472783 Oct 04 23:09:23.984638 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3457/7733] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 23:09:23 2022] POST /compute/v2.1/servers/a180e93f-0f5e-4f77-835c-4fd11cd7d9a3/action => generated 0 bytes in 475 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 23:09:23.994911 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-08ade95b-d201-441e-ac59-1d09bcfd2354 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:09:23.995791 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-08ade95b-d201-441e-ac59-1d09bcfd2354 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] [instance: a180e93f-0f5e-4f77-835c-4fd11cd7d9a3] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:09:24.003427 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-08ade95b-d201-441e-ac59-1d09bcfd2354 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:09:24.004001 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-08ade95b-d201-441e-ac59-1d09bcfd2354 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:09:24.004529 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-08ade95b-d201-441e-ac59-1d09bcfd2354 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:09:24.005327 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-08ade95b-d201-441e-ac59-1d09bcfd2354 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:09:24.006070 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-08ade95b-d201-441e-ac59-1d09bcfd2354 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:09:24.006795 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-08ade95b-d201-441e-ac59-1d09bcfd2354 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:09:24.172215 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-08ade95b-d201-441e-ac59-1d09bcfd2354 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e73b37189d04fa5a00d1c718ac9dbeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bde11f1ccc4a18919aff63b1757557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:09:24.180711 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-08ade95b-d201-441e-ac59-1d09bcfd2354 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] 10.222.0.43 "GET /compute/v2.1/servers/a180e93f-0f5e-4f77-835c-4fd11cd7d9a3" status: 200 len: 1761 microversion: 2.1 time: 0.191538 Oct 04 23:09:24.181278 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4277/7734] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:09:23 2022] GET /compute/v2.1/servers/a180e93f-0f5e-4f77-835c-4fd11cd7d9a3 => generated 1761 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 23:09:24.524438 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-c2ff5799-787a-40ec-a450-3877560a6a2c req-90033df2-f4f7-423a-935c-2ab3a4f31b9c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a180e93f-0f5e-4f77-835c-4fd11cd7d9a3", "tag": "e3b9d81f-f6d0-483c-9832-dd757ca3bf10"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 23:09:24.536337 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-c2ff5799-787a-40ec-a450-3877560a6a2c req-90033df2-f4f7-423a-935c-2ab3a4f31b9c service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:09:24.537089 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-c2ff5799-787a-40ec-a450-3877560a6a2c req-90033df2-f4f7-423a-935c-2ab3a4f31b9c service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:09:24.537694 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-c2ff5799-787a-40ec-a450-3877560a6a2c req-90033df2-f4f7-423a-935c-2ab3a4f31b9c service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:09:24.552252 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-c2ff5799-787a-40ec-a450-3877560a6a2c req-90033df2-f4f7-423a-935c-2ab3a4f31b9c service nova] Creating event network-changed:e3b9d81f-f6d0-483c-9832-dd757ca3bf10 for instance a180e93f-0f5e-4f77-835c-4fd11cd7d9a3 on n-h2-860284-1 Oct 04 23:09:24.557423 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-c2ff5799-787a-40ec-a450-3877560a6a2c req-90033df2-f4f7-423a-935c-2ab3a4f31b9c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036387 Oct 04 23:09:24.558441 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3458/7735] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 23:09:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 23:10:35.572593 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=4 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:10:35.573374 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=8 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:10:35.575083 n-d-860284-1 devstack@n-api.service[134101]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 04 23:10:35.575272 n-d-860284-1 devstack@n-api.service[134101]: Tue Oct 4 23:10:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a180e93f-0f5e-4f77-835c-4fd11cd7d9a3/action (ip 10.222.0.43) !!! Oct 04 23:10:35.580228 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-b84c658d-023d-40b4-8ea1-40b1248ee660 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 23:10:35.582475 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-b84c658d-023d-40b4-8ea1-40b1248ee660 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] [instance: a180e93f-0f5e-4f77-835c-4fd11cd7d9a3] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:10:35.591711 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b84c658d-023d-40b4-8ea1-40b1248ee660 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:10:35.592220 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b84c658d-023d-40b4-8ea1-40b1248ee660 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:10:35.592679 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b84c658d-023d-40b4-8ea1-40b1248ee660 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:10:35.593399 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b84c658d-023d-40b4-8ea1-40b1248ee660 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:10:35.593875 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b84c658d-023d-40b4-8ea1-40b1248ee660 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:10:35.594322 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b84c658d-023d-40b4-8ea1-40b1248ee660 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:10:35.667471 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-b84c658d-023d-40b4-8ea1-40b1248ee660 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] 10.222.0.43 "POST /compute/v2.1/servers/a180e93f-0f5e-4f77-835c-4fd11cd7d9a3/action" status: 202 len: 0 microversion: 2.1 time: 0.096606 Oct 04 23:10:35.668227 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4278/7736] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 23:10:35 2022] POST /compute/v2.1/servers/a180e93f-0f5e-4f77-835c-4fd11cd7d9a3/action => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 23:10:35.676134 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_api:SELECT=6 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:10:35.676897 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=12 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:10:35.677681 n-d-860284-1 devstack@n-api.service[134102]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 23:10:35.677866 n-d-860284-1 devstack@n-api.service[134102]: Tue Oct 4 23:10:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a180e93f-0f5e-4f77-835c-4fd11cd7d9a3 (ip 10.222.0.43) !!! Oct 04 23:10:35.683997 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-514d05c6-83d3-4e4a-a912-7a8b4693077c tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:10:35.684841 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-514d05c6-83d3-4e4a-a912-7a8b4693077c tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] [instance: a180e93f-0f5e-4f77-835c-4fd11cd7d9a3] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:10:35.694590 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-514d05c6-83d3-4e4a-a912-7a8b4693077c tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:10:35.695080 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-514d05c6-83d3-4e4a-a912-7a8b4693077c tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:10:35.695528 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-514d05c6-83d3-4e4a-a912-7a8b4693077c tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:10:35.696241 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-514d05c6-83d3-4e4a-a912-7a8b4693077c tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:10:35.696700 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-514d05c6-83d3-4e4a-a912-7a8b4693077c tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:10:35.697141 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-514d05c6-83d3-4e4a-a912-7a8b4693077c tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:10:35.922765 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-514d05c6-83d3-4e4a-a912-7a8b4693077c tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e73b37189d04fa5a00d1c718ac9dbeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bde11f1ccc4a18919aff63b1757557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:10:35.931229 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-514d05c6-83d3-4e4a-a912-7a8b4693077c tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] 10.222.0.43 "GET /compute/v2.1/servers/a180e93f-0f5e-4f77-835c-4fd11cd7d9a3" status: 200 len: 1753 microversion: 2.1 time: 0.257846 Oct 04 23:10:35.931832 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3459/7737] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:10:35 2022] GET /compute/v2.1/servers/a180e93f-0f5e-4f77-835c-4fd11cd7d9a3 => generated 1753 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:10:36.958529 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-fd3d87fd-54a2-4375-8940-6958f5edf44b tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:10:36.959275 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-fd3d87fd-54a2-4375-8940-6958f5edf44b tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] [instance: a180e93f-0f5e-4f77-835c-4fd11cd7d9a3] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:10:36.965643 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fd3d87fd-54a2-4375-8940-6958f5edf44b tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:10:36.966147 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fd3d87fd-54a2-4375-8940-6958f5edf44b tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:10:36.966626 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fd3d87fd-54a2-4375-8940-6958f5edf44b tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:10:36.967329 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fd3d87fd-54a2-4375-8940-6958f5edf44b tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:10:36.967797 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fd3d87fd-54a2-4375-8940-6958f5edf44b tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:10:36.968236 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fd3d87fd-54a2-4375-8940-6958f5edf44b tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:10:37.113862 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-fd3d87fd-54a2-4375-8940-6958f5edf44b tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e73b37189d04fa5a00d1c718ac9dbeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bde11f1ccc4a18919aff63b1757557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:10:37.123491 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-fd3d87fd-54a2-4375-8940-6958f5edf44b tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] 10.222.0.43 "GET /compute/v2.1/servers/a180e93f-0f5e-4f77-835c-4fd11cd7d9a3" status: 200 len: 1758 microversion: 2.1 time: 0.170367 Oct 04 23:10:37.124077 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4279/7738] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:10:36 2022] GET /compute/v2.1/servers/a180e93f-0f5e-4f77-835c-4fd11cd7d9a3 => generated 1758 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:10:38.147514 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-6be3161b-234a-4ca0-bb02-4cd13de63576 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:10:38.148274 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-6be3161b-234a-4ca0-bb02-4cd13de63576 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] [instance: a180e93f-0f5e-4f77-835c-4fd11cd7d9a3] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:10:38.155307 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6be3161b-234a-4ca0-bb02-4cd13de63576 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:10:38.155786 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6be3161b-234a-4ca0-bb02-4cd13de63576 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:10:38.156222 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6be3161b-234a-4ca0-bb02-4cd13de63576 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:10:38.156929 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6be3161b-234a-4ca0-bb02-4cd13de63576 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:10:38.157382 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6be3161b-234a-4ca0-bb02-4cd13de63576 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:10:38.157804 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6be3161b-234a-4ca0-bb02-4cd13de63576 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:10:38.307534 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-6be3161b-234a-4ca0-bb02-4cd13de63576 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e73b37189d04fa5a00d1c718ac9dbeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bde11f1ccc4a18919aff63b1757557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:10:38.317270 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-6be3161b-234a-4ca0-bb02-4cd13de63576 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] 10.222.0.43 "GET /compute/v2.1/servers/a180e93f-0f5e-4f77-835c-4fd11cd7d9a3" status: 200 len: 1758 microversion: 2.1 time: 0.173645 Oct 04 23:10:38.318101 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3460/7739] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:10:38 2022] GET /compute/v2.1/servers/a180e93f-0f5e-4f77-835c-4fd11cd7d9a3 => generated 1758 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:10:39.341868 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-14d804f4-ab7b-471b-8476-156668bf742a tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:10:39.342513 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-14d804f4-ab7b-471b-8476-156668bf742a tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] [instance: a180e93f-0f5e-4f77-835c-4fd11cd7d9a3] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:10:39.349316 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-14d804f4-ab7b-471b-8476-156668bf742a tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:10:39.349802 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-14d804f4-ab7b-471b-8476-156668bf742a tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:10:39.350244 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-14d804f4-ab7b-471b-8476-156668bf742a tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:10:39.350968 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-14d804f4-ab7b-471b-8476-156668bf742a tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:10:39.351430 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-14d804f4-ab7b-471b-8476-156668bf742a tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:10:39.351895 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-14d804f4-ab7b-471b-8476-156668bf742a tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:10:39.492390 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-14d804f4-ab7b-471b-8476-156668bf742a tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e73b37189d04fa5a00d1c718ac9dbeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bde11f1ccc4a18919aff63b1757557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:10:39.501250 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-14d804f4-ab7b-471b-8476-156668bf742a tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] 10.222.0.43 "GET /compute/v2.1/servers/a180e93f-0f5e-4f77-835c-4fd11cd7d9a3" status: 200 len: 1758 microversion: 2.1 time: 0.163975 Oct 04 23:10:39.501817 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4280/7740] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:10:39 2022] GET /compute/v2.1/servers/a180e93f-0f5e-4f77-835c-4fd11cd7d9a3 => generated 1758 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:10:40.524041 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-91c29e2b-5088-4d56-a6df-f1e0453571dd tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:10:40.524694 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-91c29e2b-5088-4d56-a6df-f1e0453571dd tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] [instance: a180e93f-0f5e-4f77-835c-4fd11cd7d9a3] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:10:40.531749 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-91c29e2b-5088-4d56-a6df-f1e0453571dd tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:10:40.532245 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-91c29e2b-5088-4d56-a6df-f1e0453571dd tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:10:40.532691 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-91c29e2b-5088-4d56-a6df-f1e0453571dd tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:10:40.533394 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-91c29e2b-5088-4d56-a6df-f1e0453571dd tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:10:40.533854 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-91c29e2b-5088-4d56-a6df-f1e0453571dd tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:10:40.534286 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-91c29e2b-5088-4d56-a6df-f1e0453571dd tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:10:40.677967 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-91c29e2b-5088-4d56-a6df-f1e0453571dd tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e73b37189d04fa5a00d1c718ac9dbeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bde11f1ccc4a18919aff63b1757557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:10:40.687697 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-91c29e2b-5088-4d56-a6df-f1e0453571dd tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] 10.222.0.43 "GET /compute/v2.1/servers/a180e93f-0f5e-4f77-835c-4fd11cd7d9a3" status: 200 len: 1758 microversion: 2.1 time: 0.167560 Oct 04 23:10:40.688287 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3461/7741] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:10:40 2022] GET /compute/v2.1/servers/a180e93f-0f5e-4f77-835c-4fd11cd7d9a3 => generated 1758 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:10:41.711242 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-bcf12235-c009-4728-8abb-1ae08a997955 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:10:41.711871 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-bcf12235-c009-4728-8abb-1ae08a997955 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] [instance: a180e93f-0f5e-4f77-835c-4fd11cd7d9a3] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:10:41.718985 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bcf12235-c009-4728-8abb-1ae08a997955 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:10:41.719480 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bcf12235-c009-4728-8abb-1ae08a997955 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:10:41.719928 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bcf12235-c009-4728-8abb-1ae08a997955 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:10:41.720641 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bcf12235-c009-4728-8abb-1ae08a997955 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:10:41.721109 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bcf12235-c009-4728-8abb-1ae08a997955 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:10:41.721550 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bcf12235-c009-4728-8abb-1ae08a997955 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:10:41.873286 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-bcf12235-c009-4728-8abb-1ae08a997955 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e73b37189d04fa5a00d1c718ac9dbeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bde11f1ccc4a18919aff63b1757557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:10:41.881685 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-bcf12235-c009-4728-8abb-1ae08a997955 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] 10.222.0.43 "GET /compute/v2.1/servers/a180e93f-0f5e-4f77-835c-4fd11cd7d9a3" status: 200 len: 1758 microversion: 2.1 time: 0.174447 Oct 04 23:10:41.882262 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4281/7742] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:10:41 2022] GET /compute/v2.1/servers/a180e93f-0f5e-4f77-835c-4fd11cd7d9a3 => generated 1758 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:10:42.906231 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-2f120859-ffae-4387-b07d-025f347b7e18 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:10:42.906900 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-2f120859-ffae-4387-b07d-025f347b7e18 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] [instance: a180e93f-0f5e-4f77-835c-4fd11cd7d9a3] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:10:42.913768 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2f120859-ffae-4387-b07d-025f347b7e18 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:10:42.914267 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2f120859-ffae-4387-b07d-025f347b7e18 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:10:42.914866 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2f120859-ffae-4387-b07d-025f347b7e18 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:10:42.915570 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2f120859-ffae-4387-b07d-025f347b7e18 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:10:42.916032 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2f120859-ffae-4387-b07d-025f347b7e18 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:10:42.916467 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2f120859-ffae-4387-b07d-025f347b7e18 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:10:43.064002 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-2f120859-ffae-4387-b07d-025f347b7e18 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e73b37189d04fa5a00d1c718ac9dbeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bde11f1ccc4a18919aff63b1757557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:10:43.072634 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-2f120859-ffae-4387-b07d-025f347b7e18 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] 10.222.0.43 "GET /compute/v2.1/servers/a180e93f-0f5e-4f77-835c-4fd11cd7d9a3" status: 200 len: 1758 microversion: 2.1 time: 0.171031 Oct 04 23:10:43.073228 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3462/7743] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:10:42 2022] GET /compute/v2.1/servers/a180e93f-0f5e-4f77-835c-4fd11cd7d9a3 => generated 1758 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:10:44.096927 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-db5f9f1e-6f70-48a9-8764-2e8c01992202 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:10:44.097604 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-db5f9f1e-6f70-48a9-8764-2e8c01992202 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] [instance: a180e93f-0f5e-4f77-835c-4fd11cd7d9a3] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:10:44.104655 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-db5f9f1e-6f70-48a9-8764-2e8c01992202 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:10:44.105146 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-db5f9f1e-6f70-48a9-8764-2e8c01992202 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:10:44.105593 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-db5f9f1e-6f70-48a9-8764-2e8c01992202 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:10:44.106954 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-db5f9f1e-6f70-48a9-8764-2e8c01992202 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:10:44.107416 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-db5f9f1e-6f70-48a9-8764-2e8c01992202 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:10:44.107854 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-db5f9f1e-6f70-48a9-8764-2e8c01992202 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:10:44.249811 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-db5f9f1e-6f70-48a9-8764-2e8c01992202 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e73b37189d04fa5a00d1c718ac9dbeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bde11f1ccc4a18919aff63b1757557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:10:44.258177 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-db5f9f1e-6f70-48a9-8764-2e8c01992202 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] 10.222.0.43 "GET /compute/v2.1/servers/a180e93f-0f5e-4f77-835c-4fd11cd7d9a3" status: 200 len: 1758 microversion: 2.1 time: 0.165152 Oct 04 23:10:44.258799 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4282/7744] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:10:44 2022] GET /compute/v2.1/servers/a180e93f-0f5e-4f77-835c-4fd11cd7d9a3 => generated 1758 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:10:45.282119 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-770a9d98-5e38-4798-b086-4c07c0e278f2 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:10:45.282720 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-770a9d98-5e38-4798-b086-4c07c0e278f2 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] [instance: a180e93f-0f5e-4f77-835c-4fd11cd7d9a3] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:10:45.289532 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-770a9d98-5e38-4798-b086-4c07c0e278f2 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:10:45.290016 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-770a9d98-5e38-4798-b086-4c07c0e278f2 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:10:45.290487 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-770a9d98-5e38-4798-b086-4c07c0e278f2 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:10:45.291177 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-770a9d98-5e38-4798-b086-4c07c0e278f2 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:10:45.291631 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-770a9d98-5e38-4798-b086-4c07c0e278f2 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:10:45.292058 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-770a9d98-5e38-4798-b086-4c07c0e278f2 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:10:45.439322 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-770a9d98-5e38-4798-b086-4c07c0e278f2 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e73b37189d04fa5a00d1c718ac9dbeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bde11f1ccc4a18919aff63b1757557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:10:45.447621 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-770a9d98-5e38-4798-b086-4c07c0e278f2 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] 10.222.0.43 "GET /compute/v2.1/servers/a180e93f-0f5e-4f77-835c-4fd11cd7d9a3" status: 200 len: 1758 microversion: 2.1 time: 0.170186 Oct 04 23:10:45.448225 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3463/7745] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:10:45 2022] GET /compute/v2.1/servers/a180e93f-0f5e-4f77-835c-4fd11cd7d9a3 => generated 1758 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:10:46.472284 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-f1acdbd6-4d1e-4e8a-b9bd-408ee6544bf7 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:10:46.472864 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-f1acdbd6-4d1e-4e8a-b9bd-408ee6544bf7 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] [instance: a180e93f-0f5e-4f77-835c-4fd11cd7d9a3] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:10:46.480098 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f1acdbd6-4d1e-4e8a-b9bd-408ee6544bf7 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:10:46.480595 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f1acdbd6-4d1e-4e8a-b9bd-408ee6544bf7 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:10:46.481050 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f1acdbd6-4d1e-4e8a-b9bd-408ee6544bf7 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:10:46.482410 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f1acdbd6-4d1e-4e8a-b9bd-408ee6544bf7 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:10:46.482889 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f1acdbd6-4d1e-4e8a-b9bd-408ee6544bf7 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:10:46.483334 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f1acdbd6-4d1e-4e8a-b9bd-408ee6544bf7 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:10:46.626797 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-f1acdbd6-4d1e-4e8a-b9bd-408ee6544bf7 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e73b37189d04fa5a00d1c718ac9dbeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bde11f1ccc4a18919aff63b1757557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:10:46.635165 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-f1acdbd6-4d1e-4e8a-b9bd-408ee6544bf7 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] 10.222.0.43 "GET /compute/v2.1/servers/a180e93f-0f5e-4f77-835c-4fd11cd7d9a3" status: 200 len: 1758 microversion: 2.1 time: 0.166910 Oct 04 23:10:46.635740 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4283/7746] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:10:46 2022] GET /compute/v2.1/servers/a180e93f-0f5e-4f77-835c-4fd11cd7d9a3 => generated 1758 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:10:47.659173 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-854d421e-4299-4db6-b8b7-7694f05ee2e0 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:10:47.659788 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-854d421e-4299-4db6-b8b7-7694f05ee2e0 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] [instance: a180e93f-0f5e-4f77-835c-4fd11cd7d9a3] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:10:47.666774 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-854d421e-4299-4db6-b8b7-7694f05ee2e0 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:10:47.667255 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-854d421e-4299-4db6-b8b7-7694f05ee2e0 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:10:47.667691 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-854d421e-4299-4db6-b8b7-7694f05ee2e0 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:10:47.668387 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-854d421e-4299-4db6-b8b7-7694f05ee2e0 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:10:47.669497 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-854d421e-4299-4db6-b8b7-7694f05ee2e0 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:10:47.669957 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-854d421e-4299-4db6-b8b7-7694f05ee2e0 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:10:47.818124 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-854d421e-4299-4db6-b8b7-7694f05ee2e0 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e73b37189d04fa5a00d1c718ac9dbeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bde11f1ccc4a18919aff63b1757557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:10:47.826554 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-854d421e-4299-4db6-b8b7-7694f05ee2e0 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] 10.222.0.43 "GET /compute/v2.1/servers/a180e93f-0f5e-4f77-835c-4fd11cd7d9a3" status: 200 len: 1758 microversion: 2.1 time: 0.171279 Oct 04 23:10:47.827143 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3464/7747] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:10:47 2022] GET /compute/v2.1/servers/a180e93f-0f5e-4f77-835c-4fd11cd7d9a3 => generated 1758 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:10:48.850476 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-ee5dab9e-ff59-4708-b0f6-a885e0a8d4ce tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:10:48.851119 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-ee5dab9e-ff59-4708-b0f6-a885e0a8d4ce tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] [instance: a180e93f-0f5e-4f77-835c-4fd11cd7d9a3] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:10:48.858967 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ee5dab9e-ff59-4708-b0f6-a885e0a8d4ce tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:10:48.859482 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ee5dab9e-ff59-4708-b0f6-a885e0a8d4ce tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:10:48.859943 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ee5dab9e-ff59-4708-b0f6-a885e0a8d4ce tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:10:48.860672 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ee5dab9e-ff59-4708-b0f6-a885e0a8d4ce tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:10:48.861182 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ee5dab9e-ff59-4708-b0f6-a885e0a8d4ce tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:10:48.861638 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ee5dab9e-ff59-4708-b0f6-a885e0a8d4ce tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:10:49.007240 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-ee5dab9e-ff59-4708-b0f6-a885e0a8d4ce tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e73b37189d04fa5a00d1c718ac9dbeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bde11f1ccc4a18919aff63b1757557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:10:49.015740 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-ee5dab9e-ff59-4708-b0f6-a885e0a8d4ce tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] 10.222.0.43 "GET /compute/v2.1/servers/a180e93f-0f5e-4f77-835c-4fd11cd7d9a3" status: 200 len: 1758 microversion: 2.1 time: 0.169785 Oct 04 23:10:49.016345 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4284/7748] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:10:48 2022] GET /compute/v2.1/servers/a180e93f-0f5e-4f77-835c-4fd11cd7d9a3 => generated 1758 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:10:50.038919 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-ea0f174a-611f-4293-b666-5c90ed55f640 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:10:50.039537 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-ea0f174a-611f-4293-b666-5c90ed55f640 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] [instance: a180e93f-0f5e-4f77-835c-4fd11cd7d9a3] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:10:50.046686 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ea0f174a-611f-4293-b666-5c90ed55f640 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:10:50.047182 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ea0f174a-611f-4293-b666-5c90ed55f640 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:10:50.047620 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ea0f174a-611f-4293-b666-5c90ed55f640 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:10:50.048315 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ea0f174a-611f-4293-b666-5c90ed55f640 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:10:50.048776 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ea0f174a-611f-4293-b666-5c90ed55f640 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:10:50.049205 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ea0f174a-611f-4293-b666-5c90ed55f640 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:10:50.191086 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-ea0f174a-611f-4293-b666-5c90ed55f640 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e73b37189d04fa5a00d1c718ac9dbeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bde11f1ccc4a18919aff63b1757557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:10:50.199594 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-ea0f174a-611f-4293-b666-5c90ed55f640 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] 10.222.0.43 "GET /compute/v2.1/servers/a180e93f-0f5e-4f77-835c-4fd11cd7d9a3" status: 200 len: 1758 microversion: 2.1 time: 0.164633 Oct 04 23:10:50.200876 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3465/7749] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:10:50 2022] GET /compute/v2.1/servers/a180e93f-0f5e-4f77-835c-4fd11cd7d9a3 => generated 1758 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:10:51.223416 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-7b5e4b11-0b46-428c-aa99-28ce2f81d09c tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:10:51.224049 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-7b5e4b11-0b46-428c-aa99-28ce2f81d09c tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] [instance: a180e93f-0f5e-4f77-835c-4fd11cd7d9a3] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:10:51.231321 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7b5e4b11-0b46-428c-aa99-28ce2f81d09c tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:10:51.231820 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7b5e4b11-0b46-428c-aa99-28ce2f81d09c tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:10:51.232275 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7b5e4b11-0b46-428c-aa99-28ce2f81d09c tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:10:51.232987 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7b5e4b11-0b46-428c-aa99-28ce2f81d09c tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:10:51.233454 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7b5e4b11-0b46-428c-aa99-28ce2f81d09c tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:10:51.233897 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7b5e4b11-0b46-428c-aa99-28ce2f81d09c tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:10:51.380993 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-7b5e4b11-0b46-428c-aa99-28ce2f81d09c tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e73b37189d04fa5a00d1c718ac9dbeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bde11f1ccc4a18919aff63b1757557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:10:51.390034 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-7b5e4b11-0b46-428c-aa99-28ce2f81d09c tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] 10.222.0.43 "GET /compute/v2.1/servers/a180e93f-0f5e-4f77-835c-4fd11cd7d9a3" status: 200 len: 1758 microversion: 2.1 time: 0.170491 Oct 04 23:10:51.390572 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4285/7750] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:10:51 2022] GET /compute/v2.1/servers/a180e93f-0f5e-4f77-835c-4fd11cd7d9a3 => generated 1758 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:10:52.413229 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-93456c46-bee2-47a8-936d-012fe0b18c71 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:10:52.413773 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-93456c46-bee2-47a8-936d-012fe0b18c71 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] [instance: a180e93f-0f5e-4f77-835c-4fd11cd7d9a3] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:10:52.421174 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-93456c46-bee2-47a8-936d-012fe0b18c71 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:10:52.421656 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-93456c46-bee2-47a8-936d-012fe0b18c71 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:10:52.422095 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-93456c46-bee2-47a8-936d-012fe0b18c71 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:10:52.422869 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-93456c46-bee2-47a8-936d-012fe0b18c71 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:10:52.423324 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-93456c46-bee2-47a8-936d-012fe0b18c71 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:10:52.423752 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-93456c46-bee2-47a8-936d-012fe0b18c71 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:10:52.569206 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-93456c46-bee2-47a8-936d-012fe0b18c71 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e73b37189d04fa5a00d1c718ac9dbeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bde11f1ccc4a18919aff63b1757557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:10:52.577785 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-93456c46-bee2-47a8-936d-012fe0b18c71 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] 10.222.0.43 "GET /compute/v2.1/servers/a180e93f-0f5e-4f77-835c-4fd11cd7d9a3" status: 200 len: 1761 microversion: 2.1 time: 0.168653 Oct 04 23:10:52.578395 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3466/7751] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:10:52 2022] GET /compute/v2.1/servers/a180e93f-0f5e-4f77-835c-4fd11cd7d9a3 => generated 1761 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:11:51.557895 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=16 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:11:51.558790 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:11:51.563345 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-5c60e8f7-ec71-4e75-a708-ffe68fed9f90 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1999569690"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 23:11:51.563878 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-5c60e8f7-ec71-4e75-a708-ffe68fed9f90 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] [instance: a180e93f-0f5e-4f77-835c-4fd11cd7d9a3] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:11:51.570407 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5c60e8f7-ec71-4e75-a708-ffe68fed9f90 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:11:51.570926 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5c60e8f7-ec71-4e75-a708-ffe68fed9f90 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:11:51.571383 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5c60e8f7-ec71-4e75-a708-ffe68fed9f90 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:11:51.572104 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5c60e8f7-ec71-4e75-a708-ffe68fed9f90 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:11:51.572574 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5c60e8f7-ec71-4e75-a708-ffe68fed9f90 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:11:51.573021 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5c60e8f7-ec71-4e75-a708-ffe68fed9f90 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:11:51.704018 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.network.security_group_api [None req-5c60e8f7-ec71-4e75-a708-ffe68fed9f90 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Removing security group 77def137-5c51-4861-8348-c436d9d99168 from port e3b9d81f-f6d0-483c-9832-dd757ca3bf10 Oct 04 23:11:52.011030 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-5c60e8f7-ec71-4e75-a708-ffe68fed9f90 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] 10.222.0.43 "POST /compute/v2.1/servers/a180e93f-0f5e-4f77-835c-4fd11cd7d9a3/action" status: 202 len: 0 microversion: 2.1 time: 0.455027 Oct 04 23:11:52.011699 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4286/7752] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 23:11:51 2022] POST /compute/v2.1/servers/a180e93f-0f5e-4f77-835c-4fd11cd7d9a3/action => generated 0 bytes in 456 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 23:11:52.020756 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_api:SELECT=16 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:11:52.021596 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=48 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:11:52.091834 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-9bff45db-6511-4727-8805-ed31dfb51d10 req-e3aca6ed-b41e-4fbf-b5ee-309c72503ea2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a180e93f-0f5e-4f77-835c-4fd11cd7d9a3", "tag": "e3b9d81f-f6d0-483c-9832-dd757ca3bf10"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 23:11:52.102776 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-9bff45db-6511-4727-8805-ed31dfb51d10 req-e3aca6ed-b41e-4fbf-b5ee-309c72503ea2 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:11:52.103256 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-9bff45db-6511-4727-8805-ed31dfb51d10 req-e3aca6ed-b41e-4fbf-b5ee-309c72503ea2 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:11:52.103686 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-9bff45db-6511-4727-8805-ed31dfb51d10 req-e3aca6ed-b41e-4fbf-b5ee-309c72503ea2 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:11:52.115858 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-9bff45db-6511-4727-8805-ed31dfb51d10 req-e3aca6ed-b41e-4fbf-b5ee-309c72503ea2 service nova] Creating event network-changed:e3b9d81f-f6d0-483c-9832-dd757ca3bf10 for instance a180e93f-0f5e-4f77-835c-4fd11cd7d9a3 on n-h2-860284-1 Oct 04 23:11:52.119498 n-d-860284-1 devstack@n-api.service[134102]: ERROR oslo.messaging._drivers.impl_rabbit [req-9bff45db-6511-4727-8805-ed31dfb51d10 req-e3aca6ed-b41e-4fbf-b5ee-309c72503ea2 service nova] [0dfd1d9b-dd68-4fdd-8441-2f3663d5f602] AMQP server on 10.222.0.43:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 23:11:53.037331 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-8c56d4c3-3f17-4d6f-8c00-d6b25dc224a2 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:11:53.038002 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-8c56d4c3-3f17-4d6f-8c00-d6b25dc224a2 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] [instance: a180e93f-0f5e-4f77-835c-4fd11cd7d9a3] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:11:53.044130 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8c56d4c3-3f17-4d6f-8c00-d6b25dc224a2 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:11:53.044633 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8c56d4c3-3f17-4d6f-8c00-d6b25dc224a2 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:11:53.045097 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8c56d4c3-3f17-4d6f-8c00-d6b25dc224a2 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:11:53.045816 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8c56d4c3-3f17-4d6f-8c00-d6b25dc224a2 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:11:53.046666 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8c56d4c3-3f17-4d6f-8c00-d6b25dc224a2 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:11:53.047134 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8c56d4c3-3f17-4d6f-8c00-d6b25dc224a2 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:11:53.132070 n-d-860284-1 devstack@n-api.service[134102]: INFO oslo.messaging._drivers.impl_rabbit [req-9bff45db-6511-4727-8805-ed31dfb51d10 req-e3aca6ed-b41e-4fbf-b5ee-309c72503ea2 service nova] [0dfd1d9b-dd68-4fdd-8441-2f3663d5f602] Reconnected to AMQP server on 10.222.0.43:5672 via [amqp] client with port 38806. Oct 04 23:11:53.136617 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.objects.instance [None req-8c56d4c3-3f17-4d6f-8c00-d6b25dc224a2 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lazy-loading 'services' on Instance uuid a180e93f-0f5e-4f77-835c-4fd11cd7d9a3 {{(pid=134101) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 23:11:53.137700 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-9bff45db-6511-4727-8805-ed31dfb51d10 req-e3aca6ed-b41e-4fbf-b5ee-309c72503ea2 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.122179 Oct 04 23:11:53.138709 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3467/7753] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 23:11:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 23:11:53.220500 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-8c56d4c3-3f17-4d6f-8c00-d6b25dc224a2 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] 10.222.0.43 "DELETE /compute/v2.1/servers/a180e93f-0f5e-4f77-835c-4fd11cd7d9a3/os-volume_attachments/fa6bd077-af87-4793-8eac-561f76e76374" status: 202 len: 0 microversion: 2.1 time: 0.188653 Oct 04 23:11:53.221481 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4287/7754] 10.222.0.43 () {58 vars in 1416 bytes} [Tue Oct 4 23:11:53 2022] DELETE /compute/v2.1/servers/a180e93f-0f5e-4f77-835c-4fd11cd7d9a3/os-volume_attachments/fa6bd077-af87-4793-8eac-561f76e76374 => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 23:11:53.233666 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-3bf45a49-1ca8-4201-a14f-c4b928c5a53a tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:11:53.239323 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-3bf45a49-1ca8-4201-a14f-c4b928c5a53a tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] [instance: a180e93f-0f5e-4f77-835c-4fd11cd7d9a3] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:11:53.247503 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3bf45a49-1ca8-4201-a14f-c4b928c5a53a tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:11:53.248464 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3bf45a49-1ca8-4201-a14f-c4b928c5a53a tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:11:53.248916 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3bf45a49-1ca8-4201-a14f-c4b928c5a53a tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:11:53.250018 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3bf45a49-1ca8-4201-a14f-c4b928c5a53a tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:11:53.250626 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3bf45a49-1ca8-4201-a14f-c4b928c5a53a tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:11:53.251311 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3bf45a49-1ca8-4201-a14f-c4b928c5a53a tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:11:53.288240 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-3bf45a49-1ca8-4201-a14f-c4b928c5a53a tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] 10.222.0.43 "GET /compute/v2.1/servers/a180e93f-0f5e-4f77-835c-4fd11cd7d9a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059930 Oct 04 23:11:53.289651 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3468/7755] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 23:11:53 2022] GET /compute/v2.1/servers/a180e93f-0f5e-4f77-835c-4fd11cd7d9a3/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 23:11:54.303403 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-9afc382c-428e-4a1b-8def-7ceb35e01a33 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:11:54.305795 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-9afc382c-428e-4a1b-8def-7ceb35e01a33 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] [instance: a180e93f-0f5e-4f77-835c-4fd11cd7d9a3] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:11:54.313219 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9afc382c-428e-4a1b-8def-7ceb35e01a33 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:11:54.313729 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9afc382c-428e-4a1b-8def-7ceb35e01a33 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:11:54.314191 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9afc382c-428e-4a1b-8def-7ceb35e01a33 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:11:54.315012 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9afc382c-428e-4a1b-8def-7ceb35e01a33 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:11:54.315492 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9afc382c-428e-4a1b-8def-7ceb35e01a33 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:11:54.315937 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9afc382c-428e-4a1b-8def-7ceb35e01a33 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:11:54.346198 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-9afc382c-428e-4a1b-8def-7ceb35e01a33 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] 10.222.0.43 "GET /compute/v2.1/servers/a180e93f-0f5e-4f77-835c-4fd11cd7d9a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047998 Oct 04 23:11:54.346844 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4288/7756] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 23:11:54 2022] GET /compute/v2.1/servers/a180e93f-0f5e-4f77-835c-4fd11cd7d9a3/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 23:11:55.153733 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-3112efa2-1d8b-4f25-9f2b-e2baa648f4bc req-f3846fa5-9804-4718-8723-7d0d2a30e35b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a180e93f-0f5e-4f77-835c-4fd11cd7d9a3", "tag": "e3b9d81f-f6d0-483c-9832-dd757ca3bf10"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 23:11:55.164338 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-3112efa2-1d8b-4f25-9f2b-e2baa648f4bc req-f3846fa5-9804-4718-8723-7d0d2a30e35b service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:11:55.164902 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-3112efa2-1d8b-4f25-9f2b-e2baa648f4bc req-f3846fa5-9804-4718-8723-7d0d2a30e35b service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:11:55.165400 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-3112efa2-1d8b-4f25-9f2b-e2baa648f4bc req-f3846fa5-9804-4718-8723-7d0d2a30e35b service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:11:55.176979 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-3112efa2-1d8b-4f25-9f2b-e2baa648f4bc req-f3846fa5-9804-4718-8723-7d0d2a30e35b service nova] Creating event network-changed:e3b9d81f-f6d0-483c-9832-dd757ca3bf10 for instance a180e93f-0f5e-4f77-835c-4fd11cd7d9a3 on n-h2-860284-1 Oct 04 23:11:55.182399 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-3112efa2-1d8b-4f25-9f2b-e2baa648f4bc req-f3846fa5-9804-4718-8723-7d0d2a30e35b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032429 Oct 04 23:11:55.183092 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3469/7757] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 23:11:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 23:11:55.360749 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-8fbba571-a1b4-43da-ae4e-b63749b1824c tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:11:55.364549 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-8fbba571-a1b4-43da-ae4e-b63749b1824c tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] [instance: a180e93f-0f5e-4f77-835c-4fd11cd7d9a3] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:11:55.372392 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8fbba571-a1b4-43da-ae4e-b63749b1824c tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:11:55.372900 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8fbba571-a1b4-43da-ae4e-b63749b1824c tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:11:55.373360 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8fbba571-a1b4-43da-ae4e-b63749b1824c tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:11:55.374087 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8fbba571-a1b4-43da-ae4e-b63749b1824c tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:11:55.374591 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8fbba571-a1b4-43da-ae4e-b63749b1824c tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:11:55.375035 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8fbba571-a1b4-43da-ae4e-b63749b1824c tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:11:55.407338 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-8fbba571-a1b4-43da-ae4e-b63749b1824c tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] 10.222.0.43 "GET /compute/v2.1/servers/a180e93f-0f5e-4f77-835c-4fd11cd7d9a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051886 Oct 04 23:11:55.412356 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4289/7758] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 23:11:55 2022] GET /compute/v2.1/servers/a180e93f-0f5e-4f77-835c-4fd11cd7d9a3/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 23:11:56.420809 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-f8b2bdce-683a-436b-8128-95c1e0cae4da tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:11:56.423121 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-f8b2bdce-683a-436b-8128-95c1e0cae4da tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] [instance: a180e93f-0f5e-4f77-835c-4fd11cd7d9a3] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:11:56.430356 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f8b2bdce-683a-436b-8128-95c1e0cae4da tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:11:56.430869 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f8b2bdce-683a-436b-8128-95c1e0cae4da tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:11:56.431303 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f8b2bdce-683a-436b-8128-95c1e0cae4da tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:11:56.431998 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f8b2bdce-683a-436b-8128-95c1e0cae4da tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:11:56.432458 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f8b2bdce-683a-436b-8128-95c1e0cae4da tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:11:56.432884 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f8b2bdce-683a-436b-8128-95c1e0cae4da tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:11:56.463018 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-f8b2bdce-683a-436b-8128-95c1e0cae4da tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] 10.222.0.43 "GET /compute/v2.1/servers/a180e93f-0f5e-4f77-835c-4fd11cd7d9a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046678 Oct 04 23:11:56.463594 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3470/7759] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 23:11:56 2022] GET /compute/v2.1/servers/a180e93f-0f5e-4f77-835c-4fd11cd7d9a3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 23:11:57.476085 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-d6b01ab5-86c5-4125-84f7-106a770c9936 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:11:57.478443 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-d6b01ab5-86c5-4125-84f7-106a770c9936 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] [instance: a180e93f-0f5e-4f77-835c-4fd11cd7d9a3] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:11:57.485414 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d6b01ab5-86c5-4125-84f7-106a770c9936 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:11:57.485906 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d6b01ab5-86c5-4125-84f7-106a770c9936 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:11:57.486349 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d6b01ab5-86c5-4125-84f7-106a770c9936 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:11:57.487081 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d6b01ab5-86c5-4125-84f7-106a770c9936 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:11:57.487543 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d6b01ab5-86c5-4125-84f7-106a770c9936 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:11:57.487976 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d6b01ab5-86c5-4125-84f7-106a770c9936 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:11:57.520733 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-d6b01ab5-86c5-4125-84f7-106a770c9936 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] 10.222.0.43 "GET /compute/v2.1/servers/a180e93f-0f5e-4f77-835c-4fd11cd7d9a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048735 Oct 04 23:11:57.521309 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4290/7760] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 23:11:57 2022] GET /compute/v2.1/servers/a180e93f-0f5e-4f77-835c-4fd11cd7d9a3/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 23:11:58.533727 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-c63c8567-228f-4704-bdf4-431a5ba91118 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:11:58.535952 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-c63c8567-228f-4704-bdf4-431a5ba91118 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] [instance: a180e93f-0f5e-4f77-835c-4fd11cd7d9a3] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:11:58.542838 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c63c8567-228f-4704-bdf4-431a5ba91118 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:11:58.543602 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c63c8567-228f-4704-bdf4-431a5ba91118 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:11:58.544047 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c63c8567-228f-4704-bdf4-431a5ba91118 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:11:58.544744 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c63c8567-228f-4704-bdf4-431a5ba91118 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:11:58.545203 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c63c8567-228f-4704-bdf4-431a5ba91118 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:11:58.546172 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c63c8567-228f-4704-bdf4-431a5ba91118 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:11:58.578667 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-c63c8567-228f-4704-bdf4-431a5ba91118 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] 10.222.0.43 "GET /compute/v2.1/servers/a180e93f-0f5e-4f77-835c-4fd11cd7d9a3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049484 Oct 04 23:11:58.579254 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3471/7761] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Oct 4 23:11:58 2022] GET /compute/v2.1/servers/a180e93f-0f5e-4f77-835c-4fd11cd7d9a3/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 23:11:58.589956 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-86036573-8590-408a-92f8-4d9e655ad3e5 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:11:58.590517 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-86036573-8590-408a-92f8-4d9e655ad3e5 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] [instance: a180e93f-0f5e-4f77-835c-4fd11cd7d9a3] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:11:58.597387 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-86036573-8590-408a-92f8-4d9e655ad3e5 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:11:58.597880 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-86036573-8590-408a-92f8-4d9e655ad3e5 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:11:58.598331 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-86036573-8590-408a-92f8-4d9e655ad3e5 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:11:58.599053 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-86036573-8590-408a-92f8-4d9e655ad3e5 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:11:58.599516 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-86036573-8590-408a-92f8-4d9e655ad3e5 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:11:58.599951 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-86036573-8590-408a-92f8-4d9e655ad3e5 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:11:58.675611 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-86036573-8590-408a-92f8-4d9e655ad3e5 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] HTTP exception thrown: Instance a180e93f-0f5e-4f77-835c-4fd11cd7d9a3 is not attached to volume fa6bd077-af87-4793-8eac-561f76e76374 Oct 04 23:11:58.677218 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-86036573-8590-408a-92f8-4d9e655ad3e5 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Request method failure captured: Oct 04 23:11:58.677218 n-d-860284-1 devstack@n-api.service[134101]: request: DELETE /compute/v2.1/servers/a180e93f-0f5e-4f77-835c-4fd11cd7d9a3/os-volume_attachments/fa6bd077-af87-4793-8eac-561f76e76374 HTTP/1.1 Oct 04 23:11:58.677218 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 23:11:58.677218 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 23:11:58.677218 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 23:11:58.677218 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 23:11:58.677218 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 23:11:58.677218 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 23:11:58.677218 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 23:11:58.677218 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 23:11:58.677218 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPLuzm4MU0j9WOPE9dRAxjx-lrneOUj_8l9DjH6VdQXwqWEQY6Ny-AwELbj9MEXHi7Y4BFrp7QpJgL8bKi3kZNDIumlp2Tjl_JBj5F9z3F79WRWaouVgUXUSUVVq_Afp-PbjKUOOZoW9IKLCKkU57pkxrB7eq-Owb-l27WIpBGSFrOkc Oct 04 23:11:58.677218 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 23:11:58.677218 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 23:11:58.677218 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 23:11:58.677218 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 23:11:58.677218 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 23:11:58.677218 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 23:11:58.677218 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: 79bde11f1ccc4a18919aff63b1757557 Oct 04 23:11:58.677218 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-TestMinimumBasicScenario-1625155882 Oct 04 23:11:58.677218 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 23:11:58.677218 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 23:11:58.677218 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/79bde11f1ccc4a18919aff63b1757557"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_79bde11f1ccc4a18919aff63b1757557", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/79bde11f1ccc4a18919aff63b1757557"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/79bde11f1ccc4a18919aff63b1757557"}]}] Oct 04 23:11:58.677218 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-TestMinimumBasicScenario-1625155882 Oct 04 23:11:58.677218 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: 79bde11f1ccc4a18919aff63b1757557 Oct 04 23:11:58.677218 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1625155882 Oct 04 23:11:58.677218 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-TestMinimumBasicScenario-1625155882-project Oct 04 23:11:58.677218 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 23:11:58.677218 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 23:11:58.677218 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 3e73b37189d04fa5a00d1c718ac9dbeb Oct 04 23:11:58.677218 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-TestMinimumBasicScenario-1625155882-project Oct 04 23:11:58.677218 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 23:11:58.677218 n-d-860284-1 devstack@n-api.service[134101]: exception: Instance a180e93f-0f5e-4f77-835c-4fd11cd7d9a3 is not attached to volume fa6bd077-af87-4793-8eac-561f76e76374 Oct 04 23:11:58.677218 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'server_id': 'a180e93f-0f5e-4f77-835c-4fd11cd7d9a3', 'id': 'fa6bd077-af87-4793-8eac-561f76e76374'} Oct 04 23:11:58.677218 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 23:11:58.677218 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 23:11:58.677218 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 04 23:11:58.677218 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 04 23:11:58.677218 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 23:11:58.677218 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 23:11:58.677218 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 04 23:11:58.677218 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 04 23:11:58.677218 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id fa6bd077-af87-4793-8eac-561f76e76374. Oct 04 23:11:58.677218 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 23:11:58.677218 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 23:11:58.677218 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 23:11:58.677218 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 23:11:58.677218 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 23:11:58.677218 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 23:11:58.677218 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 23:11:58.677218 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 23:11:58.677218 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 23:11:58.677218 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 23:11:58.677218 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 04 23:11:58.677218 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 04 23:11:58.677218 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a180e93f-0f5e-4f77-835c-4fd11cd7d9a3 is not attached to volume fa6bd077-af87-4793-8eac-561f76e76374 Oct 04 23:11:58.677218 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 23:11:58.677218 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 23:11:58.677218 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 23:11:58.677218 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 23:11:58.677218 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 23:11:58.677218 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 23:11:58.681779 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 23:11:58.681779 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 23:11:58.681779 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a180e93f-0f5e-4f77-835c-4fd11cd7d9a3 is not attached to volume fa6bd077-af87-4793-8eac-561f76e76374 Oct 04 23:11:58.681779 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 23:11:58.681779 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-86036573-8590-408a-92f8-4d9e655ad3e5 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Returning 404 to user: Instance a180e93f-0f5e-4f77-835c-4fd11cd7d9a3 is not attached to volume fa6bd077-af87-4793-8eac-561f76e76374 {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 23:11:58.681779 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-86036573-8590-408a-92f8-4d9e655ad3e5 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] 10.222.0.43 "DELETE /compute/v2.1/servers/a180e93f-0f5e-4f77-835c-4fd11cd7d9a3/os-volume_attachments/fa6bd077-af87-4793-8eac-561f76e76374" status: 404 len: 154 microversion: 2.1 time: 0.092748 Oct 04 23:11:58.681779 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4291/7762] 10.222.0.43 () {58 vars in 1416 bytes} [Tue Oct 4 23:11:58 2022] DELETE /compute/v2.1/servers/a180e93f-0f5e-4f77-835c-4fd11cd7d9a3/os-volume_attachments/fa6bd077-af87-4793-8eac-561f76e76374 => generated 154 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 23:12:01.931356 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-0e077909-73ba-4123-a708-394c1e56c329 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:12:01.931879 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-0e077909-73ba-4123-a708-394c1e56c329 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] [instance: a180e93f-0f5e-4f77-835c-4fd11cd7d9a3] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:12:01.938818 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0e077909-73ba-4123-a708-394c1e56c329 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:12:01.939661 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0e077909-73ba-4123-a708-394c1e56c329 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:12:01.940106 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0e077909-73ba-4123-a708-394c1e56c329 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:12:01.940805 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0e077909-73ba-4123-a708-394c1e56c329 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:12:01.941258 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0e077909-73ba-4123-a708-394c1e56c329 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:12:01.941683 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0e077909-73ba-4123-a708-394c1e56c329 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:12:01.969072 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-0e077909-73ba-4123-a708-394c1e56c329 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] [instance: a180e93f-0f5e-4f77-835c-4fd11cd7d9a3] Going to try to terminate instance {{(pid=134102) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 23:12:02.053329 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-0e077909-73ba-4123-a708-394c1e56c329 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] 10.222.0.43 "DELETE /compute/v2.1/servers/a180e93f-0f5e-4f77-835c-4fd11cd7d9a3" status: 204 len: 0 microversion: 2.1 time: 0.125750 Oct 04 23:12:02.057078 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3472/7763] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 23:12:01 2022] DELETE /compute/v2.1/servers/a180e93f-0f5e-4f77-835c-4fd11cd7d9a3 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 23:12:02.062735 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-1ce1f1ed-8ac3-4462-bcd1-b461c0335473 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:12:02.063381 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-1ce1f1ed-8ac3-4462-bcd1-b461c0335473 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] [instance: a180e93f-0f5e-4f77-835c-4fd11cd7d9a3] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:12:02.071257 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1ce1f1ed-8ac3-4462-bcd1-b461c0335473 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:12:02.071758 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1ce1f1ed-8ac3-4462-bcd1-b461c0335473 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:12:02.072230 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1ce1f1ed-8ac3-4462-bcd1-b461c0335473 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:12:02.072932 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1ce1f1ed-8ac3-4462-bcd1-b461c0335473 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:12:02.073407 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1ce1f1ed-8ac3-4462-bcd1-b461c0335473 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:12:02.073859 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1ce1f1ed-8ac3-4462-bcd1-b461c0335473 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:12:02.211551 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-1ce1f1ed-8ac3-4462-bcd1-b461c0335473 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e73b37189d04fa5a00d1c718ac9dbeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bde11f1ccc4a18919aff63b1757557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:12:02.220065 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-1ce1f1ed-8ac3-4462-bcd1-b461c0335473 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] 10.222.0.43 "GET /compute/v2.1/servers/a180e93f-0f5e-4f77-835c-4fd11cd7d9a3" status: 200 len: 1555 microversion: 2.1 time: 0.161575 Oct 04 23:12:02.220651 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4292/7764] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:12:02 2022] GET /compute/v2.1/servers/a180e93f-0f5e-4f77-835c-4fd11cd7d9a3 => generated 1555 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 23:12:03.244573 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-b3347af6-8731-4974-8a0d-8e696cc7d2e9 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:12:03.245285 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-b3347af6-8731-4974-8a0d-8e696cc7d2e9 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] [instance: a180e93f-0f5e-4f77-835c-4fd11cd7d9a3] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:12:03.252318 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b3347af6-8731-4974-8a0d-8e696cc7d2e9 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:12:03.252801 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b3347af6-8731-4974-8a0d-8e696cc7d2e9 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:12:03.253245 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b3347af6-8731-4974-8a0d-8e696cc7d2e9 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:12:03.253940 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b3347af6-8731-4974-8a0d-8e696cc7d2e9 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:12:03.254422 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b3347af6-8731-4974-8a0d-8e696cc7d2e9 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:12:03.254863 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b3347af6-8731-4974-8a0d-8e696cc7d2e9 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:12:03.388213 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-b3347af6-8731-4974-8a0d-8e696cc7d2e9 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e73b37189d04fa5a00d1c718ac9dbeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bde11f1ccc4a18919aff63b1757557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:12:03.396693 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-b3347af6-8731-4974-8a0d-8e696cc7d2e9 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] 10.222.0.43 "GET /compute/v2.1/servers/a180e93f-0f5e-4f77-835c-4fd11cd7d9a3" status: 200 len: 1555 microversion: 2.1 time: 0.156449 Oct 04 23:12:03.397279 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3473/7765] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:12:03 2022] GET /compute/v2.1/servers/a180e93f-0f5e-4f77-835c-4fd11cd7d9a3 => generated 1555 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:12:04.419397 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-65ed61bc-1d56-49a3-a021-50f831c49c06 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:12:04.419947 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-65ed61bc-1d56-49a3-a021-50f831c49c06 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] [instance: a180e93f-0f5e-4f77-835c-4fd11cd7d9a3] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:12:04.427469 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-65ed61bc-1d56-49a3-a021-50f831c49c06 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:12:04.427973 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-65ed61bc-1d56-49a3-a021-50f831c49c06 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:12:04.428430 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-65ed61bc-1d56-49a3-a021-50f831c49c06 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:12:04.429155 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-65ed61bc-1d56-49a3-a021-50f831c49c06 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:12:04.429637 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-65ed61bc-1d56-49a3-a021-50f831c49c06 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:12:04.430077 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-65ed61bc-1d56-49a3-a021-50f831c49c06 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:12:04.566026 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-65ed61bc-1d56-49a3-a021-50f831c49c06 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e73b37189d04fa5a00d1c718ac9dbeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bde11f1ccc4a18919aff63b1757557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:12:04.574084 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-65ed61bc-1d56-49a3-a021-50f831c49c06 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] 10.222.0.43 "GET /compute/v2.1/servers/a180e93f-0f5e-4f77-835c-4fd11cd7d9a3" status: 200 len: 1555 microversion: 2.1 time: 0.158655 Oct 04 23:12:04.574669 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4293/7766] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:12:04 2022] GET /compute/v2.1/servers/a180e93f-0f5e-4f77-835c-4fd11cd7d9a3 => generated 1555 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:12:04.801129 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-9cfb7178-0358-45a0-bcf2-76e16e30c7b1 req-899d49af-47a1-4d6d-88d3-8c22b8e90c11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a180e93f-0f5e-4f77-835c-4fd11cd7d9a3", "name": "network-vif-deleted", "tag": "e3b9d81f-f6d0-483c-9832-dd757ca3bf10"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 23:12:04.815148 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-9cfb7178-0358-45a0-bcf2-76e16e30c7b1 req-899d49af-47a1-4d6d-88d3-8c22b8e90c11 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:12:04.815762 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-9cfb7178-0358-45a0-bcf2-76e16e30c7b1 req-899d49af-47a1-4d6d-88d3-8c22b8e90c11 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:12:04.816192 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-9cfb7178-0358-45a0-bcf2-76e16e30c7b1 req-899d49af-47a1-4d6d-88d3-8c22b8e90c11 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:12:04.830127 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-9cfb7178-0358-45a0-bcf2-76e16e30c7b1 req-899d49af-47a1-4d6d-88d3-8c22b8e90c11 service nova] Creating event network-vif-deleted:e3b9d81f-f6d0-483c-9832-dd757ca3bf10 for instance a180e93f-0f5e-4f77-835c-4fd11cd7d9a3 on n-h2-860284-1 Oct 04 23:12:04.835813 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-9cfb7178-0358-45a0-bcf2-76e16e30c7b1 req-899d49af-47a1-4d6d-88d3-8c22b8e90c11 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038586 Oct 04 23:12:04.836605 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3474/7767] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 23:12:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 23:12:05.597618 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-c62637a5-49c4-4be7-aeb5-5aefb95762ab tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:12:05.598248 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-c62637a5-49c4-4be7-aeb5-5aefb95762ab tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] [instance: a180e93f-0f5e-4f77-835c-4fd11cd7d9a3] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:12:05.605381 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c62637a5-49c4-4be7-aeb5-5aefb95762ab tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:12:05.605877 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c62637a5-49c4-4be7-aeb5-5aefb95762ab tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:12:05.606328 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c62637a5-49c4-4be7-aeb5-5aefb95762ab tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:12:05.607063 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c62637a5-49c4-4be7-aeb5-5aefb95762ab tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:12:05.607530 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c62637a5-49c4-4be7-aeb5-5aefb95762ab tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:12:05.608623 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c62637a5-49c4-4be7-aeb5-5aefb95762ab tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:12:05.621899 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-c62637a5-49c4-4be7-aeb5-5aefb95762ab tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] HTTP exception thrown: Instance a180e93f-0f5e-4f77-835c-4fd11cd7d9a3 could not be found. Oct 04 23:12:05.623459 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-c62637a5-49c4-4be7-aeb5-5aefb95762ab tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Request method failure captured: Oct 04 23:12:05.623459 n-d-860284-1 devstack@n-api.service[134101]: request: GET /compute/v2.1/servers/a180e93f-0f5e-4f77-835c-4fd11cd7d9a3 HTTP/1.1 Oct 04 23:12:05.623459 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 23:12:05.623459 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 23:12:05.623459 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 23:12:05.623459 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 23:12:05.623459 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 23:12:05.623459 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 23:12:05.623459 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 23:12:05.623459 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 23:12:05.623459 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPLuzm4MU0j9WOPE9dRAxjx-lrneOUj_8l9DjH6VdQXwqWEQY6Ny-AwELbj9MEXHi7Y4BFrp7QpJgL8bKi3kZNDIumlp2Tjl_JBj5F9z3F79WRWaouVgUXUSUVVq_Afp-PbjKUOOZoW9IKLCKkU57pkxrB7eq-Owb-l27WIpBGSFrOkc Oct 04 23:12:05.623459 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 23:12:05.623459 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 23:12:05.623459 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 23:12:05.623459 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 23:12:05.623459 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 23:12:05.623459 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 23:12:05.623459 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: 79bde11f1ccc4a18919aff63b1757557 Oct 04 23:12:05.623459 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-TestMinimumBasicScenario-1625155882 Oct 04 23:12:05.623459 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 23:12:05.623459 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 23:12:05.623459 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/79bde11f1ccc4a18919aff63b1757557"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_79bde11f1ccc4a18919aff63b1757557", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/79bde11f1ccc4a18919aff63b1757557"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/79bde11f1ccc4a18919aff63b1757557"}]}] Oct 04 23:12:05.623459 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-TestMinimumBasicScenario-1625155882 Oct 04 23:12:05.623459 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: 79bde11f1ccc4a18919aff63b1757557 Oct 04 23:12:05.623459 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1625155882 Oct 04 23:12:05.623459 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-TestMinimumBasicScenario-1625155882-project Oct 04 23:12:05.623459 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 23:12:05.623459 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 23:12:05.623459 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 3e73b37189d04fa5a00d1c718ac9dbeb Oct 04 23:12:05.623459 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-TestMinimumBasicScenario-1625155882-project Oct 04 23:12:05.623459 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 23:12:05.623459 n-d-860284-1 devstack@n-api.service[134101]: exception: Instance a180e93f-0f5e-4f77-835c-4fd11cd7d9a3 could not be found. Oct 04 23:12:05.623459 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': 'a180e93f-0f5e-4f77-835c-4fd11cd7d9a3'} Oct 04 23:12:05.623459 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 23:12:05.623459 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 23:12:05.623459 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 23:12:05.623459 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 23:12:05.623459 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 23:12:05.623459 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 23:12:05.623459 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 23:12:05.623459 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 23:12:05.623459 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 23:12:05.623459 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 23:12:05.623459 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a180e93f-0f5e-4f77-835c-4fd11cd7d9a3 could not be found. Oct 04 23:12:05.623459 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 23:12:05.623459 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 23:12:05.623459 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 23:12:05.623459 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 23:12:05.623459 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 23:12:05.623459 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 23:12:05.623459 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 23:12:05.623459 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 23:12:05.623459 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 23:12:05.623459 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 23:12:05.623459 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 23:12:05.623459 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 23:12:05.623459 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 23:12:05.623459 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 23:12:05.623459 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 23:12:05.623459 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 23:12:05.623459 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a180e93f-0f5e-4f77-835c-4fd11cd7d9a3 could not be found. Oct 04 23:12:05.623459 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 23:12:05.623459 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 23:12:05.623459 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 23:12:05.628529 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 23:12:05.628529 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 23:12:05.628529 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 23:12:05.628529 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 23:12:05.628529 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 23:12:05.628529 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a180e93f-0f5e-4f77-835c-4fd11cd7d9a3 could not be found. Oct 04 23:12:05.628529 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 23:12:05.628529 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-c62637a5-49c4-4be7-aeb5-5aefb95762ab tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Returning 404 to user: Instance a180e93f-0f5e-4f77-835c-4fd11cd7d9a3 could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 23:12:05.628529 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-c62637a5-49c4-4be7-aeb5-5aefb95762ab tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] 10.222.0.43 "GET /compute/v2.1/servers/a180e93f-0f5e-4f77-835c-4fd11cd7d9a3" status: 404 len: 111 microversion: 2.1 time: 0.031775 Oct 04 23:12:05.628529 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4294/7768] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:12:05 2022] GET /compute/v2.1/servers/a180e93f-0f5e-4f77-835c-4fd11cd7d9a3 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 23:12:05.635090 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-f364a404-6d13-42a0-9c52-de1bc2ecb3f7 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] Calling method '.version_select at 0x7fbb2f6b89d0>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:12:05.640295 n-d-860284-1 devstack@n-api.service[134102]: ERROR oslo.messaging._drivers.impl_rabbit [None req-f364a404-6d13-42a0-9c52-de1bc2ecb3f7 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] [cca57954-a89d-4bbd-8f41-b6cb754a5397] AMQP server on 10.222.0.43:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 23:12:06.647466 n-d-860284-1 devstack@n-api.service[134102]: INFO oslo.messaging._drivers.impl_rabbit [None req-f364a404-6d13-42a0-9c52-de1bc2ecb3f7 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] [cca57954-a89d-4bbd-8f41-b6cb754a5397] Reconnected to AMQP server on 10.222.0.43:5672 via [amqp] client with port 38854. Oct 04 23:12:06.668424 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-f364a404-6d13-42a0-9c52-de1bc2ecb3f7 tempest-TestMinimumBasicScenario-1625155882 tempest-TestMinimumBasicScenario-1625155882-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-845113305" status: 202 len: 0 microversion: 2.1 time: 1.037882 Oct 04 23:12:06.669083 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3475/7769] 10.222.0.43 () {58 vars in 1269 bytes} [Tue Oct 4 23:12:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-845113305 => generated 0 bytes in 1039 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 23:12:15.659916 n-d-860284-1 devstack@n-api.service[134101]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 23:12:15.660425 n-d-860284-1 devstack@n-api.service[134101]: Tue Oct 4 23:12:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.43) !!! Oct 04 23:12:15.661388 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=18 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:12:15.662135 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=51,nova_cell1:INSERT=1 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:12:15.836964 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-289cd089-b8b0-41de-b068-f13764c53107 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Action: 'create', calling method: .version_select at 0x7fbb2c09bf70>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-726668790", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNReafTRpszck1fSNUJzuuu3f/dWEKW0pyTjGWAjHX+bCAnoCcjlktMifquum4IwsZGd9QiUpgO2iO+f5fgcWeFvN6rk+85kNOjvkVEFvVInyWkEnvCxD163qdbCICLoOw=="}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 23:12:15.853287 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-289cd089-b8b0-41de-b068-f13764c53107 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Getting quotas for project 339847fffad841c59cd6f9e3439eb420. Resources: {'key_pairs'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 23:12:15.859031 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-289cd089-b8b0-41de-b068-f13764c53107 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Getting quotas for user 7124fd831f0d4ce8b561d79639b5f272 and project 339847fffad841c59cd6f9e3439eb420. Resources: {'key_pairs'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 23:12:15.887106 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-289cd089-b8b0-41de-b068-f13764c53107 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.232993 Oct 04 23:12:15.887711 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4295/7770] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Oct 4 23:12:15 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 23:12:21.519687 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:12:21.522512 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:12:21.529342 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-c261ef10-472f-45b6-9644-05a8cd206d38 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1365721096", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452", "networks": [{"uuid": "4036e8c4-3b5b-40d5-ad2e-afef0979a279"}], "key_name": "tempest-TestNetworkAdvancedServerOps-726668790", "security_groups": [{"name": "tempest-secgroup-smoke-1795307954"}]}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 23:12:21.674906 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.network.neutron [None req-c261ef10-472f-45b6-9644-05a8cd206d38 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] validate_networks() for [('4036e8c4-3b5b-40d5-ad2e-afef0979a279', None, None, None, None, None)] {{(pid=134102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 23:12:22.182156 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-c261ef10-472f-45b6-9644-05a8cd206d38 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Flavor limits 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 23:12:22.182777 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-c261ef10-472f-45b6-9644-05a8cd206d38 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Image limits 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 23:12:22.183262 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-c261ef10-472f-45b6-9644-05a8cd206d38 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Flavor pref 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 23:12:22.183673 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-c261ef10-472f-45b6-9644-05a8cd206d38 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Image pref 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 23:12:22.184139 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-c261ef10-472f-45b6-9644-05a8cd206d38 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 23:12:22.193310 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c261ef10-472f-45b6-9644-05a8cd206d38 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:12:22.194030 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c261ef10-472f-45b6-9644-05a8cd206d38 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:12:22.194704 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c261ef10-472f-45b6-9644-05a8cd206d38 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:12:22.195756 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c261ef10-472f-45b6-9644-05a8cd206d38 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:12:22.196988 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c261ef10-472f-45b6-9644-05a8cd206d38 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:12:22.197891 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c261ef10-472f-45b6-9644-05a8cd206d38 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:12:22.216145 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-c261ef10-472f-45b6-9644-05a8cd206d38 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Getting quotas for project 339847fffad841c59cd6f9e3439eb420. Resources: {'instances', 'ram', 'cores'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 23:12:22.222543 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-c261ef10-472f-45b6-9644-05a8cd206d38 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Getting quotas for user 7124fd831f0d4ce8b561d79639b5f272 and project 339847fffad841c59cd6f9e3439eb420. Resources: {'instances', 'ram', 'cores'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 23:12:22.236032 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-c261ef10-472f-45b6-9644-05a8cd206d38 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Going to run 1 instances... {{(pid=134102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 23:12:22.238528 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-c261ef10-472f-45b6-9644-05a8cd206d38 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] [instance: 13f4991c-e5bc-44a9-a9d1-ad3608caaf5a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='58548514-5dac-426c-81f5-19e3fba33e23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 23:12:22.289027 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-c261ef10-472f-45b6-9644-05a8cd206d38 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.770927 Oct 04 23:12:22.296241 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3476/7771] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 23:12:21 2022] POST /compute/v2.1/servers => generated 406 bytes in 773 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 23:12:22.303546 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-cd72cac0-4237-44a1-877e-c9f23dd71725 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:12:22.304265 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-cd72cac0-4237-44a1-877e-c9f23dd71725 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] [instance: 13f4991c-e5bc-44a9-a9d1-ad3608caaf5a] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:12:22.375264 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-cd72cac0-4237-44a1-877e-c9f23dd71725 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7124fd831f0d4ce8b561d79639b5f272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339847fffad841c59cd6f9e3439eb420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:12:22.388439 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-cd72cac0-4237-44a1-877e-c9f23dd71725 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] 10.222.0.43 "GET /compute/v2.1/servers/13f4991c-e5bc-44a9-a9d1-ad3608caaf5a" status: 200 len: 1266 microversion: 2.1 time: 0.090198 Oct 04 23:12:22.389574 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4296/7772] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:12:22 2022] GET /compute/v2.1/servers/13f4991c-e5bc-44a9-a9d1-ad3608caaf5a => generated 1266 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:12:23.415292 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-8c67c2b3-3b55-4c4b-ab30-0adeb3da658e tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:12:23.415917 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-8c67c2b3-3b55-4c4b-ab30-0adeb3da658e tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] [instance: 13f4991c-e5bc-44a9-a9d1-ad3608caaf5a] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:12:23.423529 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8c67c2b3-3b55-4c4b-ab30-0adeb3da658e tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:12:23.424032 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8c67c2b3-3b55-4c4b-ab30-0adeb3da658e tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:12:23.424539 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8c67c2b3-3b55-4c4b-ab30-0adeb3da658e tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:12:23.425266 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8c67c2b3-3b55-4c4b-ab30-0adeb3da658e tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:12:23.425738 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8c67c2b3-3b55-4c4b-ab30-0adeb3da658e tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:12:23.426171 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8c67c2b3-3b55-4c4b-ab30-0adeb3da658e tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:12:23.545982 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-8c67c2b3-3b55-4c4b-ab30-0adeb3da658e tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7124fd831f0d4ce8b561d79639b5f272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339847fffad841c59cd6f9e3439eb420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:12:23.555110 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-8c67c2b3-3b55-4c4b-ab30-0adeb3da658e tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] 10.222.0.43 "GET /compute/v2.1/servers/13f4991c-e5bc-44a9-a9d1-ad3608caaf5a" status: 200 len: 1318 microversion: 2.1 time: 0.145391 Oct 04 23:12:23.555723 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3477/7773] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:12:23 2022] GET /compute/v2.1/servers/13f4991c-e5bc-44a9-a9d1-ad3608caaf5a => generated 1318 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:12:24.581038 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-283e9eb3-b0db-427b-a343-67534967d699 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:12:24.581777 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-283e9eb3-b0db-427b-a343-67534967d699 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] [instance: 13f4991c-e5bc-44a9-a9d1-ad3608caaf5a] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:12:24.592621 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-283e9eb3-b0db-427b-a343-67534967d699 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:12:24.593148 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-283e9eb3-b0db-427b-a343-67534967d699 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:12:24.593621 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-283e9eb3-b0db-427b-a343-67534967d699 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:12:24.594398 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-283e9eb3-b0db-427b-a343-67534967d699 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:12:24.595059 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-283e9eb3-b0db-427b-a343-67534967d699 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:12:24.595516 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-283e9eb3-b0db-427b-a343-67534967d699 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:12:24.745167 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-283e9eb3-b0db-427b-a343-67534967d699 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7124fd831f0d4ce8b561d79639b5f272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339847fffad841c59cd6f9e3439eb420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:12:24.754020 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-283e9eb3-b0db-427b-a343-67534967d699 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] 10.222.0.43 "GET /compute/v2.1/servers/13f4991c-e5bc-44a9-a9d1-ad3608caaf5a" status: 200 len: 1392 microversion: 2.1 time: 0.179458 Oct 04 23:12:24.762484 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4297/7774] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:12:24 2022] GET /compute/v2.1/servers/13f4991c-e5bc-44a9-a9d1-ad3608caaf5a => generated 1392 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:12:25.070051 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-d8213842-646b-437a-83ed-09a52b56c8da req-401c4e5c-2b10-4240-9b63-cb012be9141d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13f4991c-e5bc-44a9-a9d1-ad3608caaf5a", "tag": "a84f61d8-ce33-4c73-bb34-20df88764151"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 23:12:25.084586 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-d8213842-646b-437a-83ed-09a52b56c8da req-401c4e5c-2b10-4240-9b63-cb012be9141d service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:12:25.085913 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-d8213842-646b-437a-83ed-09a52b56c8da req-401c4e5c-2b10-4240-9b63-cb012be9141d service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:12:25.086965 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-d8213842-646b-437a-83ed-09a52b56c8da req-401c4e5c-2b10-4240-9b63-cb012be9141d service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:12:25.100609 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-d8213842-646b-437a-83ed-09a52b56c8da req-401c4e5c-2b10-4240-9b63-cb012be9141d service nova] Creating event network-changed:a84f61d8-ce33-4c73-bb34-20df88764151 for instance 13f4991c-e5bc-44a9-a9d1-ad3608caaf5a on n-h1-860284-1 Oct 04 23:12:25.107069 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-d8213842-646b-437a-83ed-09a52b56c8da req-401c4e5c-2b10-4240-9b63-cb012be9141d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040401 Oct 04 23:12:25.108472 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3478/7775] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 23:12:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 23:12:25.777443 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-0747345f-0001-4310-89dd-5637cd40cd56 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:12:25.778113 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-0747345f-0001-4310-89dd-5637cd40cd56 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] [instance: 13f4991c-e5bc-44a9-a9d1-ad3608caaf5a] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:12:25.785631 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0747345f-0001-4310-89dd-5637cd40cd56 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:12:25.786140 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0747345f-0001-4310-89dd-5637cd40cd56 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:12:25.786631 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0747345f-0001-4310-89dd-5637cd40cd56 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:12:25.787350 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0747345f-0001-4310-89dd-5637cd40cd56 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:12:25.787824 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0747345f-0001-4310-89dd-5637cd40cd56 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:12:25.788273 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0747345f-0001-4310-89dd-5637cd40cd56 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:12:25.921211 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-0747345f-0001-4310-89dd-5637cd40cd56 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7124fd831f0d4ce8b561d79639b5f272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339847fffad841c59cd6f9e3439eb420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:12:25.929214 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-0747345f-0001-4310-89dd-5637cd40cd56 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] 10.222.0.43 "GET /compute/v2.1/servers/13f4991c-e5bc-44a9-a9d1-ad3608caaf5a" status: 200 len: 1392 microversion: 2.1 time: 0.155762 Oct 04 23:12:25.929827 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4298/7776] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:12:25 2022] GET /compute/v2.1/servers/13f4991c-e5bc-44a9-a9d1-ad3608caaf5a => generated 1392 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:12:26.953767 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-08ee3e84-2e7f-4342-ad6a-9f81f986fca9 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:12:26.954431 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-08ee3e84-2e7f-4342-ad6a-9f81f986fca9 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] [instance: 13f4991c-e5bc-44a9-a9d1-ad3608caaf5a] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:12:26.961572 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-08ee3e84-2e7f-4342-ad6a-9f81f986fca9 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:12:26.962055 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-08ee3e84-2e7f-4342-ad6a-9f81f986fca9 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:12:26.962514 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-08ee3e84-2e7f-4342-ad6a-9f81f986fca9 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:12:26.963241 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-08ee3e84-2e7f-4342-ad6a-9f81f986fca9 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:12:26.963702 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-08ee3e84-2e7f-4342-ad6a-9f81f986fca9 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:12:26.964128 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-08ee3e84-2e7f-4342-ad6a-9f81f986fca9 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:12:27.118291 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-08ee3e84-2e7f-4342-ad6a-9f81f986fca9 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7124fd831f0d4ce8b561d79639b5f272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339847fffad841c59cd6f9e3439eb420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:12:27.130902 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-08ee3e84-2e7f-4342-ad6a-9f81f986fca9 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] 10.222.0.43 "GET /compute/v2.1/servers/13f4991c-e5bc-44a9-a9d1-ad3608caaf5a" status: 200 len: 1392 microversion: 2.1 time: 0.181360 Oct 04 23:12:27.131924 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3479/7777] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:12:26 2022] GET /compute/v2.1/servers/13f4991c-e5bc-44a9-a9d1-ad3608caaf5a => generated 1392 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:12:28.155108 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-b5fbd6a3-8c86-4c1a-9640-649afb144a75 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:12:28.155770 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-b5fbd6a3-8c86-4c1a-9640-649afb144a75 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] [instance: 13f4991c-e5bc-44a9-a9d1-ad3608caaf5a] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:12:28.162660 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b5fbd6a3-8c86-4c1a-9640-649afb144a75 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:12:28.163165 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b5fbd6a3-8c86-4c1a-9640-649afb144a75 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:12:28.163618 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b5fbd6a3-8c86-4c1a-9640-649afb144a75 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:12:28.164330 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b5fbd6a3-8c86-4c1a-9640-649afb144a75 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:12:28.164802 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b5fbd6a3-8c86-4c1a-9640-649afb144a75 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:12:28.165245 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b5fbd6a3-8c86-4c1a-9640-649afb144a75 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:12:28.314312 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-b5fbd6a3-8c86-4c1a-9640-649afb144a75 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7124fd831f0d4ce8b561d79639b5f272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339847fffad841c59cd6f9e3439eb420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:12:28.322551 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-b5fbd6a3-8c86-4c1a-9640-649afb144a75 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] 10.222.0.43 "GET /compute/v2.1/servers/13f4991c-e5bc-44a9-a9d1-ad3608caaf5a" status: 200 len: 1392 microversion: 2.1 time: 0.172068 Oct 04 23:12:28.323177 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4299/7778] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:12:28 2022] GET /compute/v2.1/servers/13f4991c-e5bc-44a9-a9d1-ad3608caaf5a => generated 1392 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:12:29.346106 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-a246f941-c3b3-49f9-bdf2-a270bf1b0a8d tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:12:29.346819 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-a246f941-c3b3-49f9-bdf2-a270bf1b0a8d tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] [instance: 13f4991c-e5bc-44a9-a9d1-ad3608caaf5a] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:12:29.354090 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a246f941-c3b3-49f9-bdf2-a270bf1b0a8d tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:12:29.354627 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a246f941-c3b3-49f9-bdf2-a270bf1b0a8d tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:12:29.355075 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a246f941-c3b3-49f9-bdf2-a270bf1b0a8d tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:12:29.355777 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a246f941-c3b3-49f9-bdf2-a270bf1b0a8d tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:12:29.356240 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a246f941-c3b3-49f9-bdf2-a270bf1b0a8d tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:12:29.356676 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a246f941-c3b3-49f9-bdf2-a270bf1b0a8d tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:12:29.488134 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-a246f941-c3b3-49f9-bdf2-a270bf1b0a8d tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7124fd831f0d4ce8b561d79639b5f272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339847fffad841c59cd6f9e3439eb420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:12:29.495934 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-a246f941-c3b3-49f9-bdf2-a270bf1b0a8d tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] 10.222.0.43 "GET /compute/v2.1/servers/13f4991c-e5bc-44a9-a9d1-ad3608caaf5a" status: 200 len: 1392 microversion: 2.1 time: 0.154546 Oct 04 23:12:29.496519 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3480/7779] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:12:29 2022] GET /compute/v2.1/servers/13f4991c-e5bc-44a9-a9d1-ad3608caaf5a => generated 1392 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:12:30.519489 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-abe3d619-6f17-4ba8-8b8a-c71103b4addf tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:12:30.520124 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-abe3d619-6f17-4ba8-8b8a-c71103b4addf tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] [instance: 13f4991c-e5bc-44a9-a9d1-ad3608caaf5a] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:12:30.527238 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-abe3d619-6f17-4ba8-8b8a-c71103b4addf tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:12:30.527744 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-abe3d619-6f17-4ba8-8b8a-c71103b4addf tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:12:30.528195 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-abe3d619-6f17-4ba8-8b8a-c71103b4addf tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:12:30.528898 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-abe3d619-6f17-4ba8-8b8a-c71103b4addf tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:12:30.529888 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-abe3d619-6f17-4ba8-8b8a-c71103b4addf tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:12:30.530329 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-abe3d619-6f17-4ba8-8b8a-c71103b4addf tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:12:30.661414 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-abe3d619-6f17-4ba8-8b8a-c71103b4addf tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7124fd831f0d4ce8b561d79639b5f272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339847fffad841c59cd6f9e3439eb420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:12:30.669290 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-abe3d619-6f17-4ba8-8b8a-c71103b4addf tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] 10.222.0.43 "GET /compute/v2.1/servers/13f4991c-e5bc-44a9-a9d1-ad3608caaf5a" status: 200 len: 1392 microversion: 2.1 time: 0.153766 Oct 04 23:12:30.670562 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4300/7780] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:12:30 2022] GET /compute/v2.1/servers/13f4991c-e5bc-44a9-a9d1-ad3608caaf5a => generated 1392 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:12:31.110279 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-9569bc66-a3c6-4e2e-af29-9c1ffc6d78dc req-6c1a3bab-c538-44d1-8ef3-55d5a1c6e7cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13f4991c-e5bc-44a9-a9d1-ad3608caaf5a", "name": "network-vif-plugged", "status": "completed", "tag": "a84f61d8-ce33-4c73-bb34-20df88764151"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 23:12:31.122150 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-9569bc66-a3c6-4e2e-af29-9c1ffc6d78dc req-6c1a3bab-c538-44d1-8ef3-55d5a1c6e7cd service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:12:31.123163 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-9569bc66-a3c6-4e2e-af29-9c1ffc6d78dc req-6c1a3bab-c538-44d1-8ef3-55d5a1c6e7cd service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:12:31.124615 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-9569bc66-a3c6-4e2e-af29-9c1ffc6d78dc req-6c1a3bab-c538-44d1-8ef3-55d5a1c6e7cd service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:12:31.136454 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-9569bc66-a3c6-4e2e-af29-9c1ffc6d78dc req-6c1a3bab-c538-44d1-8ef3-55d5a1c6e7cd service nova] Creating event network-vif-plugged:a84f61d8-ce33-4c73-bb34-20df88764151 for instance 13f4991c-e5bc-44a9-a9d1-ad3608caaf5a on n-h1-860284-1 Oct 04 23:12:31.142350 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-9569bc66-a3c6-4e2e-af29-9c1ffc6d78dc req-6c1a3bab-c538-44d1-8ef3-55d5a1c6e7cd service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035802 Oct 04 23:12:31.143192 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3481/7781] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 23:12:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 23:12:31.694315 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-8fb0d831-2487-4d32-a3a1-562536101047 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:12:31.695175 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-8fb0d831-2487-4d32-a3a1-562536101047 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] [instance: 13f4991c-e5bc-44a9-a9d1-ad3608caaf5a] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:12:31.702760 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8fb0d831-2487-4d32-a3a1-562536101047 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:12:31.703270 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8fb0d831-2487-4d32-a3a1-562536101047 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:12:31.703728 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8fb0d831-2487-4d32-a3a1-562536101047 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:12:31.704451 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8fb0d831-2487-4d32-a3a1-562536101047 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:12:31.704929 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8fb0d831-2487-4d32-a3a1-562536101047 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:12:31.705375 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8fb0d831-2487-4d32-a3a1-562536101047 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:12:31.842014 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-8fb0d831-2487-4d32-a3a1-562536101047 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7124fd831f0d4ce8b561d79639b5f272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339847fffad841c59cd6f9e3439eb420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:12:31.849997 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-8fb0d831-2487-4d32-a3a1-562536101047 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] 10.222.0.43 "GET /compute/v2.1/servers/13f4991c-e5bc-44a9-a9d1-ad3608caaf5a" status: 200 len: 1392 microversion: 2.1 time: 0.159672 Oct 04 23:12:31.850618 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4301/7782] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:12:31 2022] GET /compute/v2.1/servers/13f4991c-e5bc-44a9-a9d1-ad3608caaf5a => generated 1392 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:12:32.874877 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-a4bcf52f-5508-4a2f-b6ff-d39b77892064 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:12:32.875614 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-a4bcf52f-5508-4a2f-b6ff-d39b77892064 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] [instance: 13f4991c-e5bc-44a9-a9d1-ad3608caaf5a] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:12:32.878338 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell0:SELECT=2 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:12:32.879091 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell0:SELECT=6 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:12:32.885233 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a4bcf52f-5508-4a2f-b6ff-d39b77892064 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:12:32.885715 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a4bcf52f-5508-4a2f-b6ff-d39b77892064 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:12:32.886268 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a4bcf52f-5508-4a2f-b6ff-d39b77892064 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:12:32.886987 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a4bcf52f-5508-4a2f-b6ff-d39b77892064 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:12:32.887444 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a4bcf52f-5508-4a2f-b6ff-d39b77892064 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:12:32.887872 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a4bcf52f-5508-4a2f-b6ff-d39b77892064 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:12:33.025307 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-a4bcf52f-5508-4a2f-b6ff-d39b77892064 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7124fd831f0d4ce8b561d79639b5f272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339847fffad841c59cd6f9e3439eb420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:12:33.033420 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-a4bcf52f-5508-4a2f-b6ff-d39b77892064 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] 10.222.0.43 "GET /compute/v2.1/servers/13f4991c-e5bc-44a9-a9d1-ad3608caaf5a" status: 200 len: 1564 microversion: 2.1 time: 0.163414 Oct 04 23:12:33.034002 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3482/7783] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:12:32 2022] GET /compute/v2.1/servers/13f4991c-e5bc-44a9-a9d1-ad3608caaf5a => generated 1564 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:12:33.055966 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-d0ec656c-a216-4f50-aa16-b1172e5113bb tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:12:33.056538 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-d0ec656c-a216-4f50-aa16-b1172e5113bb tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] [instance: 13f4991c-e5bc-44a9-a9d1-ad3608caaf5a] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:12:33.058432 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=6 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:12:33.065481 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d0ec656c-a216-4f50-aa16-b1172e5113bb tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:12:33.065983 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d0ec656c-a216-4f50-aa16-b1172e5113bb tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:12:33.066473 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d0ec656c-a216-4f50-aa16-b1172e5113bb tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:12:33.067190 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d0ec656c-a216-4f50-aa16-b1172e5113bb tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:12:33.067667 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d0ec656c-a216-4f50-aa16-b1172e5113bb tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:12:33.068118 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d0ec656c-a216-4f50-aa16-b1172e5113bb tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:12:33.199520 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-d0ec656c-a216-4f50-aa16-b1172e5113bb tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7124fd831f0d4ce8b561d79639b5f272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339847fffad841c59cd6f9e3439eb420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:12:33.207949 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-d0ec656c-a216-4f50-aa16-b1172e5113bb tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] 10.222.0.43 "GET /compute/v2.1/servers/13f4991c-e5bc-44a9-a9d1-ad3608caaf5a" status: 200 len: 1564 microversion: 2.1 time: 0.156018 Oct 04 23:12:33.208521 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4302/7784] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:12:33 2022] GET /compute/v2.1/servers/13f4991c-e5bc-44a9-a9d1-ad3608caaf5a => generated 1564 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:12:35.090022 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-ccc2b917-73f3-440f-836c-b2e556c66489 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:12:35.091916 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-ccc2b917-73f3-440f-836c-b2e556c66489 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] [instance: 13f4991c-e5bc-44a9-a9d1-ad3608caaf5a] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:12:35.093257 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-7b603756-dd38-4fcc-9afd-fce2b83ca9ef req-3eb2ab3d-1a3d-4554-a857-72199e8e0593 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13f4991c-e5bc-44a9-a9d1-ad3608caaf5a", "tag": "a84f61d8-ce33-4c73-bb34-20df88764151"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 23:12:35.098264 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ccc2b917-73f3-440f-836c-b2e556c66489 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:12:35.098569 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ccc2b917-73f3-440f-836c-b2e556c66489 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:12:35.099015 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ccc2b917-73f3-440f-836c-b2e556c66489 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:12:35.099724 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ccc2b917-73f3-440f-836c-b2e556c66489 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:12:35.100189 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ccc2b917-73f3-440f-836c-b2e556c66489 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:12:35.100653 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ccc2b917-73f3-440f-836c-b2e556c66489 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:12:35.104115 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-7b603756-dd38-4fcc-9afd-fce2b83ca9ef req-3eb2ab3d-1a3d-4554-a857-72199e8e0593 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:12:35.104813 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-7b603756-dd38-4fcc-9afd-fce2b83ca9ef req-3eb2ab3d-1a3d-4554-a857-72199e8e0593 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:12:35.105442 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-7b603756-dd38-4fcc-9afd-fce2b83ca9ef req-3eb2ab3d-1a3d-4554-a857-72199e8e0593 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:12:35.121350 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-7b603756-dd38-4fcc-9afd-fce2b83ca9ef req-3eb2ab3d-1a3d-4554-a857-72199e8e0593 service nova] Creating event network-changed:a84f61d8-ce33-4c73-bb34-20df88764151 for instance 13f4991c-e5bc-44a9-a9d1-ad3608caaf5a on n-h1-860284-1 Oct 04 23:12:35.126832 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-7b603756-dd38-4fcc-9afd-fce2b83ca9ef req-3eb2ab3d-1a3d-4554-a857-72199e8e0593 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037779 Oct 04 23:12:35.127650 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4303/7785] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 23:12:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 23:12:35.331815 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-ccc2b917-73f3-440f-836c-b2e556c66489 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7124fd831f0d4ce8b561d79639b5f272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339847fffad841c59cd6f9e3439eb420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:12:35.340092 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-ccc2b917-73f3-440f-836c-b2e556c66489 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] 10.222.0.43 "GET /compute/v2.1/servers/13f4991c-e5bc-44a9-a9d1-ad3608caaf5a" status: 200 len: 1564 microversion: 2.1 time: 0.254258 Oct 04 23:12:35.340833 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3483/7786] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:12:35 2022] GET /compute/v2.1/servers/13f4991c-e5bc-44a9-a9d1-ad3608caaf5a => generated 1564 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:13:12.659982 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:13:12.661236 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=38 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:13:12.666485 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-b6de2883-6813-48f0-a139-78d55cd3a565 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 23:13:12.668772 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-b6de2883-6813-48f0-a139-78d55cd3a565 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] [instance: 13f4991c-e5bc-44a9-a9d1-ad3608caaf5a] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:13:12.676865 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b6de2883-6813-48f0-a139-78d55cd3a565 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:13:12.677405 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b6de2883-6813-48f0-a139-78d55cd3a565 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:13:12.677865 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b6de2883-6813-48f0-a139-78d55cd3a565 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:13:12.678625 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b6de2883-6813-48f0-a139-78d55cd3a565 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:13:12.679105 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b6de2883-6813-48f0-a139-78d55cd3a565 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:13:12.679555 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b6de2883-6813-48f0-a139-78d55cd3a565 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:13:12.735735 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-b6de2883-6813-48f0-a139-78d55cd3a565 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] 10.222.0.43 "POST /compute/v2.1/servers/13f4991c-e5bc-44a9-a9d1-ad3608caaf5a/action" status: 200 len: 24573 microversion: 2.1 time: 0.077788 Oct 04 23:13:12.736641 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4304/7787] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 23:13:12 2022] POST /compute/v2.1/servers/13f4991c-e5bc-44a9-a9d1-ad3608caaf5a/action => generated 24573 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 23:13:51.709940 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:13:51.710725 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=36 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:13:51.715140 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-13ea54d0-f9e8-4323-b079-129ab8b6e1dc tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 23:13:51.715711 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-13ea54d0-f9e8-4323-b079-129ab8b6e1dc tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] [instance: 13f4991c-e5bc-44a9-a9d1-ad3608caaf5a] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:13:51.723392 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-13ea54d0-f9e8-4323-b079-129ab8b6e1dc tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:13:51.723882 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-13ea54d0-f9e8-4323-b079-129ab8b6e1dc tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:13:51.724327 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-13ea54d0-f9e8-4323-b079-129ab8b6e1dc tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:13:51.725022 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-13ea54d0-f9e8-4323-b079-129ab8b6e1dc tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:13:51.725477 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-13ea54d0-f9e8-4323-b079-129ab8b6e1dc tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:13:51.726164 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-13ea54d0-f9e8-4323-b079-129ab8b6e1dc tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:13:51.793476 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-13ea54d0-f9e8-4323-b079-129ab8b6e1dc tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] 10.222.0.43 "POST /compute/v2.1/servers/13f4991c-e5bc-44a9-a9d1-ad3608caaf5a/action" status: 202 len: 0 microversion: 2.1 time: 0.085058 Oct 04 23:13:51.794133 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3484/7788] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 23:13:51 2022] POST /compute/v2.1/servers/13f4991c-e5bc-44a9-a9d1-ad3608caaf5a/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 23:13:51.803677 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-f0cfbbd4-eaf6-4e7f-9bcb-bc3672bf7fd3 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:13:51.804403 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-f0cfbbd4-eaf6-4e7f-9bcb-bc3672bf7fd3 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] [instance: 13f4991c-e5bc-44a9-a9d1-ad3608caaf5a] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:13:51.806949 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=2 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:13:51.807948 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=4 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:13:51.816208 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f0cfbbd4-eaf6-4e7f-9bcb-bc3672bf7fd3 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:13:51.816719 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f0cfbbd4-eaf6-4e7f-9bcb-bc3672bf7fd3 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:13:51.817182 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f0cfbbd4-eaf6-4e7f-9bcb-bc3672bf7fd3 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:13:51.817904 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f0cfbbd4-eaf6-4e7f-9bcb-bc3672bf7fd3 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:13:51.818398 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f0cfbbd4-eaf6-4e7f-9bcb-bc3672bf7fd3 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:13:51.818851 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f0cfbbd4-eaf6-4e7f-9bcb-bc3672bf7fd3 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:13:52.059036 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-f0cfbbd4-eaf6-4e7f-9bcb-bc3672bf7fd3 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7124fd831f0d4ce8b561d79639b5f272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339847fffad841c59cd6f9e3439eb420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:13:52.067985 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-f0cfbbd4-eaf6-4e7f-9bcb-bc3672bf7fd3 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] 10.222.0.43 "GET /compute/v2.1/servers/13f4991c-e5bc-44a9-a9d1-ad3608caaf5a" status: 200 len: 1688 microversion: 2.1 time: 0.268559 Oct 04 23:13:52.068566 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4305/7789] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:13:51 2022] GET /compute/v2.1/servers/13f4991c-e5bc-44a9-a9d1-ad3608caaf5a => generated 1688 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:13:53.093979 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-25ea9cbb-67c6-46ac-a9ce-0e18782a1a29 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:13:53.094722 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-25ea9cbb-67c6-46ac-a9ce-0e18782a1a29 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] [instance: 13f4991c-e5bc-44a9-a9d1-ad3608caaf5a] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:13:53.102240 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-25ea9cbb-67c6-46ac-a9ce-0e18782a1a29 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:13:53.102759 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-25ea9cbb-67c6-46ac-a9ce-0e18782a1a29 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:13:53.103204 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-25ea9cbb-67c6-46ac-a9ce-0e18782a1a29 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:13:53.103908 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-25ea9cbb-67c6-46ac-a9ce-0e18782a1a29 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:13:53.104371 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-25ea9cbb-67c6-46ac-a9ce-0e18782a1a29 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:13:53.104808 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-25ea9cbb-67c6-46ac-a9ce-0e18782a1a29 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:13:53.291752 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-25ea9cbb-67c6-46ac-a9ce-0e18782a1a29 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7124fd831f0d4ce8b561d79639b5f272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339847fffad841c59cd6f9e3439eb420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:13:53.299530 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-25ea9cbb-67c6-46ac-a9ce-0e18782a1a29 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] 10.222.0.43 "GET /compute/v2.1/servers/13f4991c-e5bc-44a9-a9d1-ad3608caaf5a" status: 200 len: 1668 microversion: 2.1 time: 0.210738 Oct 04 23:13:53.300113 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3485/7790] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:13:53 2022] GET /compute/v2.1/servers/13f4991c-e5bc-44a9-a9d1-ad3608caaf5a => generated 1668 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:13:54.398437 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-f35eeb0f-9f8f-48fa-b82b-8a53348d80b7 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 23:13:54.400580 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-f35eeb0f-9f8f-48fa-b82b-8a53348d80b7 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] [instance: 13f4991c-e5bc-44a9-a9d1-ad3608caaf5a] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:13:54.408906 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f35eeb0f-9f8f-48fa-b82b-8a53348d80b7 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:13:54.409409 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f35eeb0f-9f8f-48fa-b82b-8a53348d80b7 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:13:54.409864 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f35eeb0f-9f8f-48fa-b82b-8a53348d80b7 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:13:54.410615 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f35eeb0f-9f8f-48fa-b82b-8a53348d80b7 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:13:54.411093 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f35eeb0f-9f8f-48fa-b82b-8a53348d80b7 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:13:54.411537 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f35eeb0f-9f8f-48fa-b82b-8a53348d80b7 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:13:54.464555 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-f35eeb0f-9f8f-48fa-b82b-8a53348d80b7 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] 10.222.0.43 "POST /compute/v2.1/servers/13f4991c-e5bc-44a9-a9d1-ad3608caaf5a/action" status: 200 len: 32646 microversion: 2.1 time: 0.070066 Oct 04 23:13:54.465443 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4306/7791] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 23:13:54 2022] POST /compute/v2.1/servers/13f4991c-e5bc-44a9-a9d1-ad3608caaf5a/action => generated 32646 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 23:13:54.478322 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-170fa518-2cb9-4812-8d3e-5af1bdf6b941 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 23:13:54.478879 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-170fa518-2cb9-4812-8d3e-5af1bdf6b941 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] [instance: 13f4991c-e5bc-44a9-a9d1-ad3608caaf5a] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:13:54.485897 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-170fa518-2cb9-4812-8d3e-5af1bdf6b941 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:13:54.486418 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-170fa518-2cb9-4812-8d3e-5af1bdf6b941 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:13:54.486867 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-170fa518-2cb9-4812-8d3e-5af1bdf6b941 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:13:54.487569 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-170fa518-2cb9-4812-8d3e-5af1bdf6b941 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:13:54.488028 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-170fa518-2cb9-4812-8d3e-5af1bdf6b941 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:13:54.488461 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-170fa518-2cb9-4812-8d3e-5af1bdf6b941 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:13:54.558841 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-170fa518-2cb9-4812-8d3e-5af1bdf6b941 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] 10.222.0.43 "POST /compute/v2.1/servers/13f4991c-e5bc-44a9-a9d1-ad3608caaf5a/action" status: 202 len: 0 microversion: 2.1 time: 0.084669 Oct 04 23:13:54.562833 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3486/7792] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 23:13:54 2022] POST /compute/v2.1/servers/13f4991c-e5bc-44a9-a9d1-ad3608caaf5a/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 23:13:54.568581 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-5f10665f-a297-4ca7-ae67-6a98254c7815 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:13:54.569305 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-5f10665f-a297-4ca7-ae67-6a98254c7815 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] [instance: 13f4991c-e5bc-44a9-a9d1-ad3608caaf5a] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:13:54.577731 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5f10665f-a297-4ca7-ae67-6a98254c7815 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:13:54.578287 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5f10665f-a297-4ca7-ae67-6a98254c7815 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:13:54.578777 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5f10665f-a297-4ca7-ae67-6a98254c7815 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:13:54.579518 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5f10665f-a297-4ca7-ae67-6a98254c7815 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:13:54.579991 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5f10665f-a297-4ca7-ae67-6a98254c7815 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:13:54.580436 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5f10665f-a297-4ca7-ae67-6a98254c7815 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:13:54.721122 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-5f10665f-a297-4ca7-ae67-6a98254c7815 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7124fd831f0d4ce8b561d79639b5f272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339847fffad841c59cd6f9e3439eb420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:13:54.729950 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-5f10665f-a297-4ca7-ae67-6a98254c7815 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] 10.222.0.43 "GET /compute/v2.1/servers/13f4991c-e5bc-44a9-a9d1-ad3608caaf5a" status: 200 len: 1675 microversion: 2.1 time: 0.165565 Oct 04 23:13:54.730940 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4307/7793] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:13:54 2022] GET /compute/v2.1/servers/13f4991c-e5bc-44a9-a9d1-ad3608caaf5a => generated 1675 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 23:13:55.754647 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-70713b36-a6bb-42b8-8823-4774e5f1cf5b tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:13:55.755354 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-70713b36-a6bb-42b8-8823-4774e5f1cf5b tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] [instance: 13f4991c-e5bc-44a9-a9d1-ad3608caaf5a] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:13:55.762459 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-70713b36-a6bb-42b8-8823-4774e5f1cf5b tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:13:55.762965 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-70713b36-a6bb-42b8-8823-4774e5f1cf5b tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:13:55.763931 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-70713b36-a6bb-42b8-8823-4774e5f1cf5b tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:13:55.764631 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-70713b36-a6bb-42b8-8823-4774e5f1cf5b tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:13:55.765083 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-70713b36-a6bb-42b8-8823-4774e5f1cf5b tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:13:55.765508 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-70713b36-a6bb-42b8-8823-4774e5f1cf5b tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:13:55.896652 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-70713b36-a6bb-42b8-8823-4774e5f1cf5b tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7124fd831f0d4ce8b561d79639b5f272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339847fffad841c59cd6f9e3439eb420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:13:55.905214 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-70713b36-a6bb-42b8-8823-4774e5f1cf5b tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] 10.222.0.43 "GET /compute/v2.1/servers/13f4991c-e5bc-44a9-a9d1-ad3608caaf5a" status: 200 len: 1683 microversion: 2.1 time: 0.155066 Oct 04 23:13:55.905797 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3487/7794] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:13:55 2022] GET /compute/v2.1/servers/13f4991c-e5bc-44a9-a9d1-ad3608caaf5a => generated 1683 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:13:56.003884 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-c53e1839-9790-40f3-b256-30647766d36c tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 23:13:56.006177 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-c53e1839-9790-40f3-b256-30647766d36c tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] [instance: 13f4991c-e5bc-44a9-a9d1-ad3608caaf5a] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:13:56.015134 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c53e1839-9790-40f3-b256-30647766d36c tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:13:56.015628 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c53e1839-9790-40f3-b256-30647766d36c tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:13:56.016076 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c53e1839-9790-40f3-b256-30647766d36c tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:13:56.016781 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c53e1839-9790-40f3-b256-30647766d36c tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:13:56.017246 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c53e1839-9790-40f3-b256-30647766d36c tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:13:56.017684 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c53e1839-9790-40f3-b256-30647766d36c tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:13:56.070990 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-c53e1839-9790-40f3-b256-30647766d36c tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] 10.222.0.43 "POST /compute/v2.1/servers/13f4991c-e5bc-44a9-a9d1-ad3608caaf5a/action" status: 200 len: 37216 microversion: 2.1 time: 0.070831 Oct 04 23:13:56.071618 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4308/7795] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 23:13:55 2022] POST /compute/v2.1/servers/13f4991c-e5bc-44a9-a9d1-ad3608caaf5a/action => generated 37216 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 23:13:57.083109 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-34e37de6-a52d-4270-8d9f-c95e2c1c9200 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:13:57.083605 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-34e37de6-a52d-4270-8d9f-c95e2c1c9200 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] [instance: 13f4991c-e5bc-44a9-a9d1-ad3608caaf5a] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:13:57.085477 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-5f1c06e2-111f-4fb2-a1a8-fa73a5bd9828 req-7c18dd06-7080-43c5-8258-114c006f4e3a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13f4991c-e5bc-44a9-a9d1-ad3608caaf5a", "tag": "a84f61d8-ce33-4c73-bb34-20df88764151"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 23:13:57.090772 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-34e37de6-a52d-4270-8d9f-c95e2c1c9200 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:13:57.091796 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-34e37de6-a52d-4270-8d9f-c95e2c1c9200 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:13:57.092313 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-34e37de6-a52d-4270-8d9f-c95e2c1c9200 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:13:57.093025 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-34e37de6-a52d-4270-8d9f-c95e2c1c9200 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:13:57.093669 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-34e37de6-a52d-4270-8d9f-c95e2c1c9200 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:13:57.094100 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-34e37de6-a52d-4270-8d9f-c95e2c1c9200 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:13:57.097706 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-5f1c06e2-111f-4fb2-a1a8-fa73a5bd9828 req-7c18dd06-7080-43c5-8258-114c006f4e3a service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:13:57.098264 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-5f1c06e2-111f-4fb2-a1a8-fa73a5bd9828 req-7c18dd06-7080-43c5-8258-114c006f4e3a service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:13:57.098958 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-5f1c06e2-111f-4fb2-a1a8-fa73a5bd9828 req-7c18dd06-7080-43c5-8258-114c006f4e3a service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:13:57.111341 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-5f1c06e2-111f-4fb2-a1a8-fa73a5bd9828 req-7c18dd06-7080-43c5-8258-114c006f4e3a service nova] Creating event network-changed:a84f61d8-ce33-4c73-bb34-20df88764151 for instance 13f4991c-e5bc-44a9-a9d1-ad3608caaf5a on n-h1-860284-1 Oct 04 23:13:57.116410 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-5f1c06e2-111f-4fb2-a1a8-fa73a5bd9828 req-7c18dd06-7080-43c5-8258-114c006f4e3a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035114 Oct 04 23:13:57.117643 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4309/7796] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 23:13:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 23:13:57.126194 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-34e37de6-a52d-4270-8d9f-c95e2c1c9200 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] [instance: 13f4991c-e5bc-44a9-a9d1-ad3608caaf5a] Going to try to terminate instance {{(pid=134102) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 23:13:57.212432 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-34e37de6-a52d-4270-8d9f-c95e2c1c9200 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] 10.222.0.43 "DELETE /compute/v2.1/servers/13f4991c-e5bc-44a9-a9d1-ad3608caaf5a" status: 204 len: 0 microversion: 2.1 time: 0.132850 Oct 04 23:13:57.213817 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3488/7797] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 23:13:57 2022] DELETE /compute/v2.1/servers/13f4991c-e5bc-44a9-a9d1-ad3608caaf5a => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 23:13:57.223447 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-73b417c3-c2ce-4176-aeb7-943677128e00 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:13:57.224153 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-73b417c3-c2ce-4176-aeb7-943677128e00 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] [instance: 13f4991c-e5bc-44a9-a9d1-ad3608caaf5a] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:13:57.233947 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-73b417c3-c2ce-4176-aeb7-943677128e00 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:13:57.234484 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-73b417c3-c2ce-4176-aeb7-943677128e00 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:13:57.234936 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-73b417c3-c2ce-4176-aeb7-943677128e00 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:13:57.235655 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-73b417c3-c2ce-4176-aeb7-943677128e00 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:13:57.236121 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-73b417c3-c2ce-4176-aeb7-943677128e00 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:13:57.236559 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-73b417c3-c2ce-4176-aeb7-943677128e00 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:13:57.381128 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-73b417c3-c2ce-4176-aeb7-943677128e00 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7124fd831f0d4ce8b561d79639b5f272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339847fffad841c59cd6f9e3439eb420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:13:57.390133 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-73b417c3-c2ce-4176-aeb7-943677128e00 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] 10.222.0.43 "GET /compute/v2.1/servers/13f4991c-e5bc-44a9-a9d1-ad3608caaf5a" status: 200 len: 1689 microversion: 2.1 time: 0.171493 Oct 04 23:13:57.391132 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4310/7798] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:13:57 2022] GET /compute/v2.1/servers/13f4991c-e5bc-44a9-a9d1-ad3608caaf5a => generated 1689 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:13:58.415546 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-6ade8fd8-1f3c-46a8-9e72-847fd4faee29 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:13:58.416177 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-6ade8fd8-1f3c-46a8-9e72-847fd4faee29 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] [instance: 13f4991c-e5bc-44a9-a9d1-ad3608caaf5a] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:13:58.423633 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6ade8fd8-1f3c-46a8-9e72-847fd4faee29 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:13:58.424128 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6ade8fd8-1f3c-46a8-9e72-847fd4faee29 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:13:58.424570 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6ade8fd8-1f3c-46a8-9e72-847fd4faee29 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:13:58.425269 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6ade8fd8-1f3c-46a8-9e72-847fd4faee29 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:13:58.425731 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6ade8fd8-1f3c-46a8-9e72-847fd4faee29 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:13:58.426163 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6ade8fd8-1f3c-46a8-9e72-847fd4faee29 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:13:58.568444 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-6ade8fd8-1f3c-46a8-9e72-847fd4faee29 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7124fd831f0d4ce8b561d79639b5f272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339847fffad841c59cd6f9e3439eb420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:13:58.577059 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-6ade8fd8-1f3c-46a8-9e72-847fd4faee29 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] 10.222.0.43 "GET /compute/v2.1/servers/13f4991c-e5bc-44a9-a9d1-ad3608caaf5a" status: 200 len: 1689 microversion: 2.1 time: 0.165746 Oct 04 23:13:58.577697 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3489/7799] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:13:58 2022] GET /compute/v2.1/servers/13f4991c-e5bc-44a9-a9d1-ad3608caaf5a => generated 1689 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 23:13:59.602102 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-f7dac48e-5eaf-4849-9b78-d7ff5d93b8ac tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:13:59.602533 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-f7dac48e-5eaf-4849-9b78-d7ff5d93b8ac tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] [instance: 13f4991c-e5bc-44a9-a9d1-ad3608caaf5a] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:13:59.610277 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f7dac48e-5eaf-4849-9b78-d7ff5d93b8ac tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:13:59.610823 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f7dac48e-5eaf-4849-9b78-d7ff5d93b8ac tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:13:59.611281 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f7dac48e-5eaf-4849-9b78-d7ff5d93b8ac tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:13:59.612012 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f7dac48e-5eaf-4849-9b78-d7ff5d93b8ac tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:13:59.612487 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f7dac48e-5eaf-4849-9b78-d7ff5d93b8ac tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:13:59.613159 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f7dac48e-5eaf-4849-9b78-d7ff5d93b8ac tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:13:59.681413 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-f7dac48e-5eaf-4849-9b78-d7ff5d93b8ac tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7124fd831f0d4ce8b561d79639b5f272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339847fffad841c59cd6f9e3439eb420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:13:59.690147 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-f7dac48e-5eaf-4849-9b78-d7ff5d93b8ac tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] 10.222.0.43 "GET /compute/v2.1/servers/13f4991c-e5bc-44a9-a9d1-ad3608caaf5a" status: 200 len: 1502 microversion: 2.1 time: 0.092422 Oct 04 23:13:59.690774 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4311/7800] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:13:59 2022] GET /compute/v2.1/servers/13f4991c-e5bc-44a9-a9d1-ad3608caaf5a => generated 1502 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:13:59.775235 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-b6946b97-87bd-4edf-a0c5-d829ae6e4e7b req-c0a6dd1d-0ee0-42eb-a160-1605d3b803a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13f4991c-e5bc-44a9-a9d1-ad3608caaf5a", "name": "network-vif-deleted", "tag": "a84f61d8-ce33-4c73-bb34-20df88764151"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 23:13:59.785364 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-b6946b97-87bd-4edf-a0c5-d829ae6e4e7b req-c0a6dd1d-0ee0-42eb-a160-1605d3b803a9 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:13:59.786120 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-b6946b97-87bd-4edf-a0c5-d829ae6e4e7b req-c0a6dd1d-0ee0-42eb-a160-1605d3b803a9 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:13:59.786651 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-b6946b97-87bd-4edf-a0c5-d829ae6e4e7b req-c0a6dd1d-0ee0-42eb-a160-1605d3b803a9 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:13:59.798821 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-b6946b97-87bd-4edf-a0c5-d829ae6e4e7b req-c0a6dd1d-0ee0-42eb-a160-1605d3b803a9 service nova] Creating event network-vif-deleted:a84f61d8-ce33-4c73-bb34-20df88764151 for instance 13f4991c-e5bc-44a9-a9d1-ad3608caaf5a on n-h1-860284-1 Oct 04 23:13:59.803747 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-b6946b97-87bd-4edf-a0c5-d829ae6e4e7b req-c0a6dd1d-0ee0-42eb-a160-1605d3b803a9 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090574 Oct 04 23:13:59.804357 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3490/7801] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 23:13:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 23:14:00.715219 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-3685cbd9-7ea3-43d3-95fc-a1565132218c tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:14:00.715872 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-3685cbd9-7ea3-43d3-95fc-a1565132218c tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] [instance: 13f4991c-e5bc-44a9-a9d1-ad3608caaf5a] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:14:00.723467 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3685cbd9-7ea3-43d3-95fc-a1565132218c tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:14:00.723976 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3685cbd9-7ea3-43d3-95fc-a1565132218c tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:14:00.724437 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3685cbd9-7ea3-43d3-95fc-a1565132218c tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:14:00.725160 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3685cbd9-7ea3-43d3-95fc-a1565132218c tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:14:00.725636 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3685cbd9-7ea3-43d3-95fc-a1565132218c tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:14:00.726341 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3685cbd9-7ea3-43d3-95fc-a1565132218c tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:14:00.740354 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-3685cbd9-7ea3-43d3-95fc-a1565132218c tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] HTTP exception thrown: Instance 13f4991c-e5bc-44a9-a9d1-ad3608caaf5a could not be found. Oct 04 23:14:00.742026 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-3685cbd9-7ea3-43d3-95fc-a1565132218c tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Request method failure captured: Oct 04 23:14:00.742026 n-d-860284-1 devstack@n-api.service[134101]: request: GET /compute/v2.1/servers/13f4991c-e5bc-44a9-a9d1-ad3608caaf5a HTTP/1.1 Oct 04 23:14:00.742026 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 23:14:00.742026 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 23:14:00.742026 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 23:14:00.742026 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 23:14:00.742026 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 23:14:00.742026 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 23:14:00.742026 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 23:14:00.742026 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 23:14:00.742026 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPL3PV1P3eiBng-eyftmazLIMFOGhxgvlJE5kLv8qSAxeZ7nw7JEQcBo6uebpFaCmIciYVzYahs6GheYsSkJ64LI0k5-JJiivZ7ZQcPNIUVS-FFaLcyFAAb-8gYSuTYUwgQIpyTivuP6QEOS5wIqgxRi6U8ltOJnUssrNHH8u3ZtbLbs Oct 04 23:14:00.742026 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 23:14:00.742026 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 23:14:00.742026 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 23:14:00.742026 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 23:14:00.742026 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 23:14:00.742026 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 23:14:00.742026 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: 339847fffad841c59cd6f9e3439eb420 Oct 04 23:14:00.742026 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-217321805 Oct 04 23:14:00.742026 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 23:14:00.742026 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 23:14:00.742026 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/339847fffad841c59cd6f9e3439eb420"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_339847fffad841c59cd6f9e3439eb420", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/339847fffad841c59cd6f9e3439eb420"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/339847fffad841c59cd6f9e3439eb420"}]}] Oct 04 23:14:00.742026 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-TestNetworkAdvancedServerOps-217321805 Oct 04 23:14:00.742026 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: 339847fffad841c59cd6f9e3439eb420 Oct 04 23:14:00.742026 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-217321805 Oct 04 23:14:00.742026 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-TestNetworkAdvancedServerOps-217321805-project Oct 04 23:14:00.742026 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 23:14:00.742026 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 23:14:00.742026 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 7124fd831f0d4ce8b561d79639b5f272 Oct 04 23:14:00.742026 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-TestNetworkAdvancedServerOps-217321805-project Oct 04 23:14:00.742026 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 23:14:00.742026 n-d-860284-1 devstack@n-api.service[134101]: exception: Instance 13f4991c-e5bc-44a9-a9d1-ad3608caaf5a could not be found. Oct 04 23:14:00.742026 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': '13f4991c-e5bc-44a9-a9d1-ad3608caaf5a'} Oct 04 23:14:00.742026 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 23:14:00.742026 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 23:14:00.742026 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 23:14:00.742026 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 23:14:00.742026 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 23:14:00.742026 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 23:14:00.742026 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 23:14:00.742026 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 23:14:00.742026 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 23:14:00.742026 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 23:14:00.742026 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13f4991c-e5bc-44a9-a9d1-ad3608caaf5a could not be found. Oct 04 23:14:00.742026 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 23:14:00.742026 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 23:14:00.742026 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 23:14:00.742026 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 23:14:00.742026 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 23:14:00.742026 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 23:14:00.742026 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 23:14:00.742026 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 23:14:00.742026 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 23:14:00.742026 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 23:14:00.742026 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 23:14:00.742026 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 23:14:00.742026 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 23:14:00.742026 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 23:14:00.742026 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 23:14:00.742026 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 23:14:00.742026 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13f4991c-e5bc-44a9-a9d1-ad3608caaf5a could not be found. Oct 04 23:14:00.742026 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 23:14:00.742026 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 23:14:00.747154 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 23:14:00.747154 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 23:14:00.747154 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 23:14:00.747154 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 23:14:00.747154 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 23:14:00.747154 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 23:14:00.747154 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13f4991c-e5bc-44a9-a9d1-ad3608caaf5a could not be found. Oct 04 23:14:00.747154 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 23:14:00.747154 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-3685cbd9-7ea3-43d3-95fc-a1565132218c tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Returning 404 to user: Instance 13f4991c-e5bc-44a9-a9d1-ad3608caaf5a could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 23:14:00.747154 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-3685cbd9-7ea3-43d3-95fc-a1565132218c tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] 10.222.0.43 "GET /compute/v2.1/servers/13f4991c-e5bc-44a9-a9d1-ad3608caaf5a" status: 404 len: 111 microversion: 2.1 time: 0.032443 Oct 04 23:14:00.747154 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4312/7802] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:14:00 2022] GET /compute/v2.1/servers/13f4991c-e5bc-44a9-a9d1-ad3608caaf5a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 23:14:04.067719 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-c655f996-6f32-446a-a9ab-45cfa5db5c30 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Calling method '.version_select at 0x7fbb2e646550>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:14:04.090118 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-c655f996-6f32-446a-a9ab-45cfa5db5c30 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-726668790" status: 202 len: 0 microversion: 2.1 time: 0.028282 Oct 04 23:14:04.090639 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3491/7803] 10.222.0.43 () {58 vars in 1281 bytes} [Tue Oct 4 23:14:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-726668790 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 23:14:04.116031 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-b24d2ec3-c8bc-4177-b9a0-fedbc2942c64 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Action: 'create', calling method: .version_select at 0x7fbb2c0db940>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-774065264", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAWw9zIOkLcKChSEjQUqz/nbGceCQxf3/iyazBr0seqdm7X0eCbTm3bqRhUPjyKXSpd2Z5YN41W3W8nje3DCPszj+5X1VJFYc2kVbOnPtyc4coqd4eOF/0P8+lawxirX1Q=="}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 23:14:04.137294 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-b24d2ec3-c8bc-4177-b9a0-fedbc2942c64 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Getting quotas for project 339847fffad841c59cd6f9e3439eb420. Resources: {'key_pairs'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 23:14:04.143527 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-b24d2ec3-c8bc-4177-b9a0-fedbc2942c64 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Getting quotas for user 7124fd831f0d4ce8b561d79639b5f272 and project 339847fffad841c59cd6f9e3439eb420. Resources: {'key_pairs'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 23:14:04.167644 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-b24d2ec3-c8bc-4177-b9a0-fedbc2942c64 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.055583 Oct 04 23:14:04.168272 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4313/7804] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Oct 4 23:14:04 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 23:14:09.421660 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-3b84ba04-8212-4203-a9b4-f832a024ea69 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-685411196", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452", "networks": [{"uuid": "0fabf032-82c6-427c-bfec-582f0872cdff"}], "key_name": "tempest-TestNetworkAdvancedServerOps-774065264", "security_groups": [{"name": "tempest-secgroup-smoke-1953640327"}]}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 23:14:09.557139 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.network.neutron [None req-3b84ba04-8212-4203-a9b4-f832a024ea69 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] validate_networks() for [('0fabf032-82c6-427c-bfec-582f0872cdff', None, None, None, None, None)] {{(pid=134102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 23:14:09.792455 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:14:10.302056 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-3b84ba04-8212-4203-a9b4-f832a024ea69 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Flavor limits 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 23:14:10.303431 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-3b84ba04-8212-4203-a9b4-f832a024ea69 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Image limits 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 23:14:10.304024 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-3b84ba04-8212-4203-a9b4-f832a024ea69 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Flavor pref 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 23:14:10.304665 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-3b84ba04-8212-4203-a9b4-f832a024ea69 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Image pref 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 23:14:10.305755 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-3b84ba04-8212-4203-a9b4-f832a024ea69 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 23:14:10.319661 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3b84ba04-8212-4203-a9b4-f832a024ea69 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:14:10.320159 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3b84ba04-8212-4203-a9b4-f832a024ea69 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:14:10.320600 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3b84ba04-8212-4203-a9b4-f832a024ea69 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:14:10.321338 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3b84ba04-8212-4203-a9b4-f832a024ea69 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:14:10.321799 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3b84ba04-8212-4203-a9b4-f832a024ea69 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:14:10.322227 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3b84ba04-8212-4203-a9b4-f832a024ea69 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:14:10.343711 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-3b84ba04-8212-4203-a9b4-f832a024ea69 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Getting quotas for project 339847fffad841c59cd6f9e3439eb420. Resources: {'instances', 'ram', 'cores'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 23:14:10.349209 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-3b84ba04-8212-4203-a9b4-f832a024ea69 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Getting quotas for user 7124fd831f0d4ce8b561d79639b5f272 and project 339847fffad841c59cd6f9e3439eb420. Resources: {'instances', 'ram', 'cores'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 23:14:10.363500 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-3b84ba04-8212-4203-a9b4-f832a024ea69 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Going to run 1 instances... {{(pid=134102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 23:14:10.366665 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-3b84ba04-8212-4203-a9b4-f832a024ea69 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] [instance: 5a48e362-e26c-40a0-ac45-39f436f414ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='58548514-5dac-426c-81f5-19e3fba33e23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 23:14:10.421160 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-3b84ba04-8212-4203-a9b4-f832a024ea69 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.004618 Oct 04 23:14:10.433227 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-94ca12a9-dc7c-4bc2-b82b-a635a25fc51b tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:14:10.433776 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-94ca12a9-dc7c-4bc2-b82b-a635a25fc51b tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] [instance: 5a48e362-e26c-40a0-ac45-39f436f414ed] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:14:10.434487 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3492/7805] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 23:14:09 2022] POST /compute/v2.1/servers => generated 406 bytes in 1019 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 23:14:10.506827 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-94ca12a9-dc7c-4bc2-b82b-a635a25fc51b tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7124fd831f0d4ce8b561d79639b5f272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339847fffad841c59cd6f9e3439eb420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:14:10.515467 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-94ca12a9-dc7c-4bc2-b82b-a635a25fc51b tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] 10.222.0.43 "GET /compute/v2.1/servers/5a48e362-e26c-40a0-ac45-39f436f414ed" status: 200 len: 1265 microversion: 2.1 time: 0.086162 Oct 04 23:14:10.522498 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4314/7806] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:14:10 2022] GET /compute/v2.1/servers/5a48e362-e26c-40a0-ac45-39f436f414ed => generated 1265 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 23:14:11.542388 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-04ea4438-cf16-480b-9fc3-07f8853a2c10 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:14:11.543863 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-04ea4438-cf16-480b-9fc3-07f8853a2c10 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] [instance: 5a48e362-e26c-40a0-ac45-39f436f414ed] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:14:11.562396 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-04ea4438-cf16-480b-9fc3-07f8853a2c10 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:14:11.563443 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-04ea4438-cf16-480b-9fc3-07f8853a2c10 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:14:11.564117 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-04ea4438-cf16-480b-9fc3-07f8853a2c10 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:14:11.565638 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-04ea4438-cf16-480b-9fc3-07f8853a2c10 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:14:11.566896 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-04ea4438-cf16-480b-9fc3-07f8853a2c10 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:14:11.568778 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-04ea4438-cf16-480b-9fc3-07f8853a2c10 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:14:11.660972 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-04ea4438-cf16-480b-9fc3-07f8853a2c10 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7124fd831f0d4ce8b561d79639b5f272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339847fffad841c59cd6f9e3439eb420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:14:11.670165 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-04ea4438-cf16-480b-9fc3-07f8853a2c10 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] 10.222.0.43 "GET /compute/v2.1/servers/5a48e362-e26c-40a0-ac45-39f436f414ed" status: 200 len: 1317 microversion: 2.1 time: 0.134571 Oct 04 23:14:11.675191 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3493/7807] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:14:11 2022] GET /compute/v2.1/servers/5a48e362-e26c-40a0-ac45-39f436f414ed => generated 1317 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:14:12.699396 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-2ee0f040-409c-4cee-9700-b346d1bcd757 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:14:12.700038 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-2ee0f040-409c-4cee-9700-b346d1bcd757 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] [instance: 5a48e362-e26c-40a0-ac45-39f436f414ed] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:14:12.709311 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=36 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:14:12.714116 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2ee0f040-409c-4cee-9700-b346d1bcd757 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:14:12.714733 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2ee0f040-409c-4cee-9700-b346d1bcd757 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:14:12.715265 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2ee0f040-409c-4cee-9700-b346d1bcd757 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:14:12.721838 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2ee0f040-409c-4cee-9700-b346d1bcd757 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:14:12.722760 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2ee0f040-409c-4cee-9700-b346d1bcd757 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:14:12.723322 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2ee0f040-409c-4cee-9700-b346d1bcd757 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:14:12.897137 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-2ee0f040-409c-4cee-9700-b346d1bcd757 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7124fd831f0d4ce8b561d79639b5f272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339847fffad841c59cd6f9e3439eb420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:14:12.910877 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-2ee0f040-409c-4cee-9700-b346d1bcd757 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] 10.222.0.43 "GET /compute/v2.1/servers/5a48e362-e26c-40a0-ac45-39f436f414ed" status: 200 len: 1391 microversion: 2.1 time: 0.216081 Oct 04 23:14:12.911737 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4315/7808] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:14:12 2022] GET /compute/v2.1/servers/5a48e362-e26c-40a0-ac45-39f436f414ed => generated 1391 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:14:13.281789 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-0282917d-7b41-4f8a-b179-3657e1c7195f req-1d20c048-0b40-4a53-ac85-e27c6fd53575 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a48e362-e26c-40a0-ac45-39f436f414ed", "tag": "626f3662-8812-4723-83dc-8bd7dc8b1161"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 23:14:13.297160 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-0282917d-7b41-4f8a-b179-3657e1c7195f req-1d20c048-0b40-4a53-ac85-e27c6fd53575 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:14:13.297570 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-0282917d-7b41-4f8a-b179-3657e1c7195f req-1d20c048-0b40-4a53-ac85-e27c6fd53575 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:14:13.298004 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-0282917d-7b41-4f8a-b179-3657e1c7195f req-1d20c048-0b40-4a53-ac85-e27c6fd53575 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:14:13.320963 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-0282917d-7b41-4f8a-b179-3657e1c7195f req-1d20c048-0b40-4a53-ac85-e27c6fd53575 service nova] Creating event network-changed:626f3662-8812-4723-83dc-8bd7dc8b1161 for instance 5a48e362-e26c-40a0-ac45-39f436f414ed on n-h2-860284-1 Oct 04 23:14:13.326381 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-0282917d-7b41-4f8a-b179-3657e1c7195f req-1d20c048-0b40-4a53-ac85-e27c6fd53575 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049522 Oct 04 23:14:13.327014 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3494/7809] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 23:14:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 23:14:13.934884 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-48159734-bf24-4cd0-922d-810f999f22c3 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:14:13.935505 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-48159734-bf24-4cd0-922d-810f999f22c3 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] [instance: 5a48e362-e26c-40a0-ac45-39f436f414ed] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:14:13.942303 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-48159734-bf24-4cd0-922d-810f999f22c3 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:14:13.942841 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-48159734-bf24-4cd0-922d-810f999f22c3 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:14:13.943291 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-48159734-bf24-4cd0-922d-810f999f22c3 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:14:13.944046 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-48159734-bf24-4cd0-922d-810f999f22c3 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:14:13.944512 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-48159734-bf24-4cd0-922d-810f999f22c3 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:14:13.944950 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-48159734-bf24-4cd0-922d-810f999f22c3 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:14:14.078064 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-48159734-bf24-4cd0-922d-810f999f22c3 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7124fd831f0d4ce8b561d79639b5f272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339847fffad841c59cd6f9e3439eb420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:14:14.085749 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-48159734-bf24-4cd0-922d-810f999f22c3 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] 10.222.0.43 "GET /compute/v2.1/servers/5a48e362-e26c-40a0-ac45-39f436f414ed" status: 200 len: 1391 microversion: 2.1 time: 0.154781 Oct 04 23:14:14.086317 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4316/7810] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:14:13 2022] GET /compute/v2.1/servers/5a48e362-e26c-40a0-ac45-39f436f414ed => generated 1391 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:14:15.110973 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-54c8b34b-779a-44b2-a7fc-ab5a6679ee7b tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:14:15.111751 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-54c8b34b-779a-44b2-a7fc-ab5a6679ee7b tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] [instance: 5a48e362-e26c-40a0-ac45-39f436f414ed] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:14:15.118798 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-54c8b34b-779a-44b2-a7fc-ab5a6679ee7b tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:14:15.119316 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-54c8b34b-779a-44b2-a7fc-ab5a6679ee7b tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:14:15.119783 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-54c8b34b-779a-44b2-a7fc-ab5a6679ee7b tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:14:15.120572 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-54c8b34b-779a-44b2-a7fc-ab5a6679ee7b tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:14:15.121076 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-54c8b34b-779a-44b2-a7fc-ab5a6679ee7b tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:14:15.121555 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-54c8b34b-779a-44b2-a7fc-ab5a6679ee7b tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:14:15.258220 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-54c8b34b-779a-44b2-a7fc-ab5a6679ee7b tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7124fd831f0d4ce8b561d79639b5f272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339847fffad841c59cd6f9e3439eb420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:14:15.266695 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-54c8b34b-779a-44b2-a7fc-ab5a6679ee7b tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] 10.222.0.43 "GET /compute/v2.1/servers/5a48e362-e26c-40a0-ac45-39f436f414ed" status: 200 len: 1391 microversion: 2.1 time: 0.161555 Oct 04 23:14:15.267287 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3495/7811] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:14:15 2022] GET /compute/v2.1/servers/5a48e362-e26c-40a0-ac45-39f436f414ed => generated 1391 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:14:16.289524 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-bbd736ef-465b-4a4a-8d4a-fa0b2ecadba1 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:14:16.290175 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-bbd736ef-465b-4a4a-8d4a-fa0b2ecadba1 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] [instance: 5a48e362-e26c-40a0-ac45-39f436f414ed] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:14:16.297164 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bbd736ef-465b-4a4a-8d4a-fa0b2ecadba1 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:14:16.297667 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bbd736ef-465b-4a4a-8d4a-fa0b2ecadba1 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:14:16.298114 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bbd736ef-465b-4a4a-8d4a-fa0b2ecadba1 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:14:16.298858 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bbd736ef-465b-4a4a-8d4a-fa0b2ecadba1 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:14:16.299327 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bbd736ef-465b-4a4a-8d4a-fa0b2ecadba1 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:14:16.299767 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bbd736ef-465b-4a4a-8d4a-fa0b2ecadba1 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:14:16.432573 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-bbd736ef-465b-4a4a-8d4a-fa0b2ecadba1 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7124fd831f0d4ce8b561d79639b5f272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339847fffad841c59cd6f9e3439eb420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:14:16.441103 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-bbd736ef-465b-4a4a-8d4a-fa0b2ecadba1 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] 10.222.0.43 "GET /compute/v2.1/servers/5a48e362-e26c-40a0-ac45-39f436f414ed" status: 200 len: 1391 microversion: 2.1 time: 0.155632 Oct 04 23:14:16.441680 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4317/7812] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:14:16 2022] GET /compute/v2.1/servers/5a48e362-e26c-40a0-ac45-39f436f414ed => generated 1391 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:14:17.464824 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-f140774b-d2cc-4f9e-83e1-52fdd5408d00 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:14:17.465547 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-f140774b-d2cc-4f9e-83e1-52fdd5408d00 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] [instance: 5a48e362-e26c-40a0-ac45-39f436f414ed] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:14:17.472957 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f140774b-d2cc-4f9e-83e1-52fdd5408d00 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:14:17.473442 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f140774b-d2cc-4f9e-83e1-52fdd5408d00 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:14:17.473885 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f140774b-d2cc-4f9e-83e1-52fdd5408d00 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:14:17.474619 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f140774b-d2cc-4f9e-83e1-52fdd5408d00 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:14:17.475114 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f140774b-d2cc-4f9e-83e1-52fdd5408d00 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:14:17.475824 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f140774b-d2cc-4f9e-83e1-52fdd5408d00 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:14:17.610221 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-f140774b-d2cc-4f9e-83e1-52fdd5408d00 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7124fd831f0d4ce8b561d79639b5f272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339847fffad841c59cd6f9e3439eb420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:14:17.618197 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-f140774b-d2cc-4f9e-83e1-52fdd5408d00 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] 10.222.0.43 "GET /compute/v2.1/servers/5a48e362-e26c-40a0-ac45-39f436f414ed" status: 200 len: 1391 microversion: 2.1 time: 0.157353 Oct 04 23:14:17.618812 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3496/7813] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:14:17 2022] GET /compute/v2.1/servers/5a48e362-e26c-40a0-ac45-39f436f414ed => generated 1391 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:14:18.641414 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-38d676b9-6444-40ea-baa2-f9877576ac9d tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:14:18.642038 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-38d676b9-6444-40ea-baa2-f9877576ac9d tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] [instance: 5a48e362-e26c-40a0-ac45-39f436f414ed] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:14:18.649065 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-38d676b9-6444-40ea-baa2-f9877576ac9d tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:14:18.649559 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-38d676b9-6444-40ea-baa2-f9877576ac9d tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:14:18.650039 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-38d676b9-6444-40ea-baa2-f9877576ac9d tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:14:18.650782 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-38d676b9-6444-40ea-baa2-f9877576ac9d tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:14:18.651252 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-38d676b9-6444-40ea-baa2-f9877576ac9d tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:14:18.651689 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-38d676b9-6444-40ea-baa2-f9877576ac9d tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:14:18.791929 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-38d676b9-6444-40ea-baa2-f9877576ac9d tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7124fd831f0d4ce8b561d79639b5f272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339847fffad841c59cd6f9e3439eb420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:14:18.800389 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-38d676b9-6444-40ea-baa2-f9877576ac9d tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] 10.222.0.43 "GET /compute/v2.1/servers/5a48e362-e26c-40a0-ac45-39f436f414ed" status: 200 len: 1391 microversion: 2.1 time: 0.163134 Oct 04 23:14:18.800976 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4318/7814] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:14:18 2022] GET /compute/v2.1/servers/5a48e362-e26c-40a0-ac45-39f436f414ed => generated 1391 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:14:19.459191 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-1ef35f8e-1ffd-494d-9bc9-ecce0d0456c3 req-093bfd0c-8cca-42f9-8fce-7ee4ff6b928c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a48e362-e26c-40a0-ac45-39f436f414ed", "name": "network-vif-plugged", "status": "completed", "tag": "626f3662-8812-4723-83dc-8bd7dc8b1161"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 23:14:19.470598 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-1ef35f8e-1ffd-494d-9bc9-ecce0d0456c3 req-093bfd0c-8cca-42f9-8fce-7ee4ff6b928c service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:14:19.471119 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-1ef35f8e-1ffd-494d-9bc9-ecce0d0456c3 req-093bfd0c-8cca-42f9-8fce-7ee4ff6b928c service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:14:19.471910 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-1ef35f8e-1ffd-494d-9bc9-ecce0d0456c3 req-093bfd0c-8cca-42f9-8fce-7ee4ff6b928c service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:14:19.483572 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-1ef35f8e-1ffd-494d-9bc9-ecce0d0456c3 req-093bfd0c-8cca-42f9-8fce-7ee4ff6b928c service nova] Creating event network-vif-plugged:626f3662-8812-4723-83dc-8bd7dc8b1161 for instance 5a48e362-e26c-40a0-ac45-39f436f414ed on n-h2-860284-1 Oct 04 23:14:19.489000 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-1ef35f8e-1ffd-494d-9bc9-ecce0d0456c3 req-093bfd0c-8cca-42f9-8fce-7ee4ff6b928c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091563 Oct 04 23:14:19.489634 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3497/7815] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 23:14:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 23:14:19.823230 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-42930b23-d95e-4c33-9048-f261e83cf605 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:14:19.823991 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-42930b23-d95e-4c33-9048-f261e83cf605 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] [instance: 5a48e362-e26c-40a0-ac45-39f436f414ed] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:14:19.831603 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-42930b23-d95e-4c33-9048-f261e83cf605 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:14:19.832109 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-42930b23-d95e-4c33-9048-f261e83cf605 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:14:19.832568 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-42930b23-d95e-4c33-9048-f261e83cf605 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:14:19.833279 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-42930b23-d95e-4c33-9048-f261e83cf605 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:14:19.833753 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-42930b23-d95e-4c33-9048-f261e83cf605 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:14:19.834229 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-42930b23-d95e-4c33-9048-f261e83cf605 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:14:19.972164 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-42930b23-d95e-4c33-9048-f261e83cf605 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7124fd831f0d4ce8b561d79639b5f272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339847fffad841c59cd6f9e3439eb420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:14:19.980136 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-42930b23-d95e-4c33-9048-f261e83cf605 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] 10.222.0.43 "GET /compute/v2.1/servers/5a48e362-e26c-40a0-ac45-39f436f414ed" status: 200 len: 1391 microversion: 2.1 time: 0.160841 Oct 04 23:14:19.980714 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4319/7816] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:14:19 2022] GET /compute/v2.1/servers/5a48e362-e26c-40a0-ac45-39f436f414ed => generated 1391 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:14:21.000358 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell0:SELECT=2 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:14:21.001465 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell0:SELECT=6 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:14:21.006390 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-24077d94-df40-46e3-b0b3-661025d64202 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:14:21.007130 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-24077d94-df40-46e3-b0b3-661025d64202 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] [instance: 5a48e362-e26c-40a0-ac45-39f436f414ed] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:14:21.014273 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-24077d94-df40-46e3-b0b3-661025d64202 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:14:21.014779 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-24077d94-df40-46e3-b0b3-661025d64202 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:14:21.015214 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-24077d94-df40-46e3-b0b3-661025d64202 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:14:21.015958 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-24077d94-df40-46e3-b0b3-661025d64202 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:14:21.016370 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-24077d94-df40-46e3-b0b3-661025d64202 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:14:21.016820 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-24077d94-df40-46e3-b0b3-661025d64202 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:14:21.151746 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-24077d94-df40-46e3-b0b3-661025d64202 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7124fd831f0d4ce8b561d79639b5f272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339847fffad841c59cd6f9e3439eb420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:14:21.160049 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-24077d94-df40-46e3-b0b3-661025d64202 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] 10.222.0.43 "GET /compute/v2.1/servers/5a48e362-e26c-40a0-ac45-39f436f414ed" status: 200 len: 1391 microversion: 2.1 time: 0.160650 Oct 04 23:14:21.160627 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3498/7817] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:14:20 2022] GET /compute/v2.1/servers/5a48e362-e26c-40a0-ac45-39f436f414ed => generated 1391 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:14:22.183224 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-ba294d7e-fd07-48af-a234-3a43c8045d31 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:14:22.183921 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-ba294d7e-fd07-48af-a234-3a43c8045d31 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] [instance: 5a48e362-e26c-40a0-ac45-39f436f414ed] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:14:22.186596 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=6 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:14:22.188123 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=1 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:14:22.194463 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ba294d7e-fd07-48af-a234-3a43c8045d31 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:14:22.194974 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ba294d7e-fd07-48af-a234-3a43c8045d31 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:14:22.195433 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ba294d7e-fd07-48af-a234-3a43c8045d31 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:14:22.196147 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ba294d7e-fd07-48af-a234-3a43c8045d31 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:14:22.196630 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ba294d7e-fd07-48af-a234-3a43c8045d31 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:14:22.197078 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ba294d7e-fd07-48af-a234-3a43c8045d31 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:14:22.329366 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-ba294d7e-fd07-48af-a234-3a43c8045d31 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7124fd831f0d4ce8b561d79639b5f272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339847fffad841c59cd6f9e3439eb420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:14:22.337267 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-ba294d7e-fd07-48af-a234-3a43c8045d31 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] 10.222.0.43 "GET /compute/v2.1/servers/5a48e362-e26c-40a0-ac45-39f436f414ed" status: 200 len: 1563 microversion: 2.1 time: 0.157982 Oct 04 23:14:22.337848 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4320/7818] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:14:22 2022] GET /compute/v2.1/servers/5a48e362-e26c-40a0-ac45-39f436f414ed => generated 1563 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:14:22.360448 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-7819ef62-5888-466c-b452-ee1c01e46171 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:14:22.361072 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-7819ef62-5888-466c-b452-ee1c01e46171 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] [instance: 5a48e362-e26c-40a0-ac45-39f436f414ed] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:14:22.363773 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:14:22.369190 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7819ef62-5888-466c-b452-ee1c01e46171 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:14:22.369681 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7819ef62-5888-466c-b452-ee1c01e46171 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:14:22.370127 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7819ef62-5888-466c-b452-ee1c01e46171 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:14:22.370932 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7819ef62-5888-466c-b452-ee1c01e46171 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:14:22.371396 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7819ef62-5888-466c-b452-ee1c01e46171 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:14:22.372462 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7819ef62-5888-466c-b452-ee1c01e46171 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:14:22.510099 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-7819ef62-5888-466c-b452-ee1c01e46171 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7124fd831f0d4ce8b561d79639b5f272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339847fffad841c59cd6f9e3439eb420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:14:22.517994 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-7819ef62-5888-466c-b452-ee1c01e46171 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] 10.222.0.43 "GET /compute/v2.1/servers/5a48e362-e26c-40a0-ac45-39f436f414ed" status: 200 len: 1563 microversion: 2.1 time: 0.162125 Oct 04 23:14:22.518632 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3499/7819] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:14:22 2022] GET /compute/v2.1/servers/5a48e362-e26c-40a0-ac45-39f436f414ed => generated 1563 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:14:24.366290 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-2a0cddfd-88e5-4224-9614-869a31e39a81 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:14:24.367556 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-2a0cddfd-88e5-4224-9614-869a31e39a81 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] [instance: 5a48e362-e26c-40a0-ac45-39f436f414ed] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:14:24.368593 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-3806c5a2-2085-465d-815e-675880fdb1f7 req-ece6b52d-9260-4144-aadd-9fbfff8093f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a48e362-e26c-40a0-ac45-39f436f414ed", "tag": "626f3662-8812-4723-83dc-8bd7dc8b1161"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 23:14:24.374645 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2a0cddfd-88e5-4224-9614-869a31e39a81 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:14:24.375353 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2a0cddfd-88e5-4224-9614-869a31e39a81 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:14:24.376056 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2a0cddfd-88e5-4224-9614-869a31e39a81 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:14:24.376990 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2a0cddfd-88e5-4224-9614-869a31e39a81 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:14:24.377696 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2a0cddfd-88e5-4224-9614-869a31e39a81 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:14:24.378354 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2a0cddfd-88e5-4224-9614-869a31e39a81 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:14:24.379773 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-3806c5a2-2085-465d-815e-675880fdb1f7 req-ece6b52d-9260-4144-aadd-9fbfff8093f3 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:14:24.380250 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-3806c5a2-2085-465d-815e-675880fdb1f7 req-ece6b52d-9260-4144-aadd-9fbfff8093f3 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:14:24.380681 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-3806c5a2-2085-465d-815e-675880fdb1f7 req-ece6b52d-9260-4144-aadd-9fbfff8093f3 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:14:24.396612 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-3806c5a2-2085-465d-815e-675880fdb1f7 req-ece6b52d-9260-4144-aadd-9fbfff8093f3 service nova] Creating event network-changed:626f3662-8812-4723-83dc-8bd7dc8b1161 for instance 5a48e362-e26c-40a0-ac45-39f436f414ed on n-h2-860284-1 Oct 04 23:14:24.401936 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-3806c5a2-2085-465d-815e-675880fdb1f7 req-ece6b52d-9260-4144-aadd-9fbfff8093f3 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037357 Oct 04 23:14:24.402920 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3500/7820] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 23:14:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 23:14:24.528353 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-2a0cddfd-88e5-4224-9614-869a31e39a81 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7124fd831f0d4ce8b561d79639b5f272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339847fffad841c59cd6f9e3439eb420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:14:24.536876 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-2a0cddfd-88e5-4224-9614-869a31e39a81 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] 10.222.0.43 "GET /compute/v2.1/servers/5a48e362-e26c-40a0-ac45-39f436f414ed" status: 200 len: 1563 microversion: 2.1 time: 0.174817 Oct 04 23:14:24.550220 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4321/7821] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:14:24 2022] GET /compute/v2.1/servers/5a48e362-e26c-40a0-ac45-39f436f414ed => generated 1563 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:14:59.826005 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_api:SELECT=3 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:14:59.826794 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=38 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:14:59.831593 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-1afa5bd3-9821-4854-a6f8-1f15ddd5f960 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 23:14:59.833850 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-1afa5bd3-9821-4854-a6f8-1f15ddd5f960 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] [instance: 5a48e362-e26c-40a0-ac45-39f436f414ed] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:14:59.840798 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1afa5bd3-9821-4854-a6f8-1f15ddd5f960 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:14:59.841280 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1afa5bd3-9821-4854-a6f8-1f15ddd5f960 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:14:59.841715 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1afa5bd3-9821-4854-a6f8-1f15ddd5f960 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:14:59.842427 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1afa5bd3-9821-4854-a6f8-1f15ddd5f960 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:14:59.842887 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1afa5bd3-9821-4854-a6f8-1f15ddd5f960 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:14:59.843317 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1afa5bd3-9821-4854-a6f8-1f15ddd5f960 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:14:59.900123 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-1afa5bd3-9821-4854-a6f8-1f15ddd5f960 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] 10.222.0.43 "POST /compute/v2.1/servers/5a48e362-e26c-40a0-ac45-39f436f414ed/action" status: 200 len: 24572 microversion: 2.1 time: 0.076076 Oct 04 23:14:59.900765 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3501/7822] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 23:14:59 2022] POST /compute/v2.1/servers/5a48e362-e26c-40a0-ac45-39f436f414ed/action => generated 24572 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 23:15:30.370784 n-d-860284-1 devstack@n-api.service[134101]: ERROR oslo.messaging._drivers.impl_rabbit [-] [dab38095-fcf8-46d0-9904-6bfbf5d1f82a] AMQP server on 10.222.0.43:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 04 23:15:30.371449 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=3 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:15:30.372282 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=42 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:15:30.376831 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-b3d2a0fe-3cf4-412b-b7f3-aa4c917b1ed4 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 23:15:30.379209 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-b3d2a0fe-3cf4-412b-b7f3-aa4c917b1ed4 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] [instance: 5a48e362-e26c-40a0-ac45-39f436f414ed] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:15:30.386268 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b3d2a0fe-3cf4-412b-b7f3-aa4c917b1ed4 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:15:30.386741 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b3d2a0fe-3cf4-412b-b7f3-aa4c917b1ed4 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:15:30.387201 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b3d2a0fe-3cf4-412b-b7f3-aa4c917b1ed4 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:15:30.387929 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b3d2a0fe-3cf4-412b-b7f3-aa4c917b1ed4 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:15:30.388405 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b3d2a0fe-3cf4-412b-b7f3-aa4c917b1ed4 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:15:30.388852 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b3d2a0fe-3cf4-412b-b7f3-aa4c917b1ed4 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:15:30.464986 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-b3d2a0fe-3cf4-412b-b7f3-aa4c917b1ed4 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] 10.222.0.43 "POST /compute/v2.1/servers/5a48e362-e26c-40a0-ac45-39f436f414ed/action" status: 202 len: 0 microversion: 2.1 time: 0.096011 Oct 04 23:15:30.465778 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4322/7823] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 23:15:30 2022] POST /compute/v2.1/servers/5a48e362-e26c-40a0-ac45-39f436f414ed/action => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 23:15:30.475618 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-fc7d4103-e21e-47c7-85bb-129e1a84bb77 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:15:30.476339 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-fc7d4103-e21e-47c7-85bb-129e1a84bb77 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] [instance: 5a48e362-e26c-40a0-ac45-39f436f414ed] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:15:30.479111 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_api:SELECT=2 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:15:30.479757 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=4 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:15:30.486052 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fc7d4103-e21e-47c7-85bb-129e1a84bb77 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:15:30.486605 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fc7d4103-e21e-47c7-85bb-129e1a84bb77 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:15:30.487060 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fc7d4103-e21e-47c7-85bb-129e1a84bb77 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:15:30.487995 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fc7d4103-e21e-47c7-85bb-129e1a84bb77 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:15:30.488669 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fc7d4103-e21e-47c7-85bb-129e1a84bb77 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:15:30.489073 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fc7d4103-e21e-47c7-85bb-129e1a84bb77 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:15:30.720145 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-fc7d4103-e21e-47c7-85bb-129e1a84bb77 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7124fd831f0d4ce8b561d79639b5f272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339847fffad841c59cd6f9e3439eb420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:15:30.730620 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-fc7d4103-e21e-47c7-85bb-129e1a84bb77 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] 10.222.0.43 "GET /compute/v2.1/servers/5a48e362-e26c-40a0-ac45-39f436f414ed" status: 200 len: 1673 microversion: 2.1 time: 0.260510 Oct 04 23:15:30.731207 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3502/7824] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:15:30 2022] GET /compute/v2.1/servers/5a48e362-e26c-40a0-ac45-39f436f414ed => generated 1673 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 23:15:31.841922 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-37536dc0-c123-4542-8d97-b44f7a5498da tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:15:31.842677 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-37536dc0-c123-4542-8d97-b44f7a5498da tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] [instance: 5a48e362-e26c-40a0-ac45-39f436f414ed] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:15:31.850700 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-37536dc0-c123-4542-8d97-b44f7a5498da tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:15:31.851199 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-37536dc0-c123-4542-8d97-b44f7a5498da tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:15:31.851648 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-37536dc0-c123-4542-8d97-b44f7a5498da tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:15:31.852357 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-37536dc0-c123-4542-8d97-b44f7a5498da tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:15:31.852824 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-37536dc0-c123-4542-8d97-b44f7a5498da tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:15:31.853263 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-37536dc0-c123-4542-8d97-b44f7a5498da tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:15:31.856697 n-d-860284-1 devstack@n-api.service[134101]: INFO oslo.messaging._drivers.impl_rabbit [-] [dab38095-fcf8-46d0-9904-6bfbf5d1f82a] Reconnected to AMQP server on 10.222.0.43:5672 via [amqp] client with port 39302. Oct 04 23:15:32.291898 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-37536dc0-c123-4542-8d97-b44f7a5498da tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7124fd831f0d4ce8b561d79639b5f272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339847fffad841c59cd6f9e3439eb420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:15:32.299914 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-37536dc0-c123-4542-8d97-b44f7a5498da tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] 10.222.0.43 "GET /compute/v2.1/servers/5a48e362-e26c-40a0-ac45-39f436f414ed" status: 200 len: 1678 microversion: 2.1 time: 0.463810 Oct 04 23:15:32.302771 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4323/7825] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:15:31 2022] GET /compute/v2.1/servers/5a48e362-e26c-40a0-ac45-39f436f414ed => generated 1678 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:15:33.326002 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-3ee292fc-3d79-419f-9d23-ebceae3a15df tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:15:33.326651 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-3ee292fc-3d79-419f-9d23-ebceae3a15df tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] [instance: 5a48e362-e26c-40a0-ac45-39f436f414ed] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:15:33.333752 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3ee292fc-3d79-419f-9d23-ebceae3a15df tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:15:33.334247 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3ee292fc-3d79-419f-9d23-ebceae3a15df tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:15:33.334728 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3ee292fc-3d79-419f-9d23-ebceae3a15df tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:15:33.335431 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3ee292fc-3d79-419f-9d23-ebceae3a15df tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:15:33.335899 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3ee292fc-3d79-419f-9d23-ebceae3a15df tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:15:33.336340 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3ee292fc-3d79-419f-9d23-ebceae3a15df tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:15:33.474067 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-3ee292fc-3d79-419f-9d23-ebceae3a15df tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7124fd831f0d4ce8b561d79639b5f272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339847fffad841c59cd6f9e3439eb420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:15:33.482104 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-3ee292fc-3d79-419f-9d23-ebceae3a15df tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] 10.222.0.43 "GET /compute/v2.1/servers/5a48e362-e26c-40a0-ac45-39f436f414ed" status: 200 len: 1678 microversion: 2.1 time: 0.160110 Oct 04 23:15:33.482715 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3503/7826] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:15:33 2022] GET /compute/v2.1/servers/5a48e362-e26c-40a0-ac45-39f436f414ed => generated 1678 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:15:34.505993 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-50b55605-6305-498a-9550-558869f59748 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:15:34.506637 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-50b55605-6305-498a-9550-558869f59748 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] [instance: 5a48e362-e26c-40a0-ac45-39f436f414ed] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:15:34.513419 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-50b55605-6305-498a-9550-558869f59748 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:15:34.513929 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-50b55605-6305-498a-9550-558869f59748 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:15:34.514406 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-50b55605-6305-498a-9550-558869f59748 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:15:34.515123 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-50b55605-6305-498a-9550-558869f59748 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:15:34.515599 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-50b55605-6305-498a-9550-558869f59748 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:15:34.516046 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-50b55605-6305-498a-9550-558869f59748 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:15:34.649318 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-50b55605-6305-498a-9550-558869f59748 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7124fd831f0d4ce8b561d79639b5f272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339847fffad841c59cd6f9e3439eb420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:15:34.657115 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-50b55605-6305-498a-9550-558869f59748 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] 10.222.0.43 "GET /compute/v2.1/servers/5a48e362-e26c-40a0-ac45-39f436f414ed" status: 200 len: 1678 microversion: 2.1 time: 0.155838 Oct 04 23:15:34.657689 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4324/7827] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:15:34 2022] GET /compute/v2.1/servers/5a48e362-e26c-40a0-ac45-39f436f414ed => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:15:35.681352 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-348896fd-e7ad-4c8d-806d-9dd1c295dded tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:15:35.681962 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-348896fd-e7ad-4c8d-806d-9dd1c295dded tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] [instance: 5a48e362-e26c-40a0-ac45-39f436f414ed] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:15:35.688102 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-348896fd-e7ad-4c8d-806d-9dd1c295dded tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:15:35.688586 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-348896fd-e7ad-4c8d-806d-9dd1c295dded tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:15:35.689020 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-348896fd-e7ad-4c8d-806d-9dd1c295dded tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:15:35.689710 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-348896fd-e7ad-4c8d-806d-9dd1c295dded tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:15:35.690185 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-348896fd-e7ad-4c8d-806d-9dd1c295dded tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:15:35.691149 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-348896fd-e7ad-4c8d-806d-9dd1c295dded tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:15:35.820351 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-348896fd-e7ad-4c8d-806d-9dd1c295dded tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7124fd831f0d4ce8b561d79639b5f272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339847fffad841c59cd6f9e3439eb420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:15:35.828094 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-348896fd-e7ad-4c8d-806d-9dd1c295dded tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] 10.222.0.43 "GET /compute/v2.1/servers/5a48e362-e26c-40a0-ac45-39f436f414ed" status: 200 len: 1678 microversion: 2.1 time: 0.150902 Oct 04 23:15:35.828692 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3504/7828] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:15:35 2022] GET /compute/v2.1/servers/5a48e362-e26c-40a0-ac45-39f436f414ed => generated 1678 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:15:36.852147 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-02f182a7-8de7-4859-87fc-356350b3fd49 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:15:36.852799 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-02f182a7-8de7-4859-87fc-356350b3fd49 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] [instance: 5a48e362-e26c-40a0-ac45-39f436f414ed] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:15:36.856036 n-d-860284-1 devstack@n-api.service[134101]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 23:15:36.856163 n-d-860284-1 devstack@n-api.service[134101]: Tue Oct 4 23:15:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5a48e362-e26c-40a0-ac45-39f436f414ed (ip 10.222.0.43) !!! Oct 04 23:15:36.865799 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-02f182a7-8de7-4859-87fc-356350b3fd49 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:15:36.866294 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-02f182a7-8de7-4859-87fc-356350b3fd49 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:15:36.866766 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-02f182a7-8de7-4859-87fc-356350b3fd49 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:15:36.867469 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-02f182a7-8de7-4859-87fc-356350b3fd49 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:15:36.867932 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-02f182a7-8de7-4859-87fc-356350b3fd49 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:15:36.868369 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-02f182a7-8de7-4859-87fc-356350b3fd49 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:15:37.000672 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-02f182a7-8de7-4859-87fc-356350b3fd49 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7124fd831f0d4ce8b561d79639b5f272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339847fffad841c59cd6f9e3439eb420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:15:37.009518 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-02f182a7-8de7-4859-87fc-356350b3fd49 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] 10.222.0.43 "GET /compute/v2.1/servers/5a48e362-e26c-40a0-ac45-39f436f414ed" status: 200 len: 1678 microversion: 2.1 time: 0.161589 Oct 04 23:15:37.010097 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4325/7829] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:15:36 2022] GET /compute/v2.1/servers/5a48e362-e26c-40a0-ac45-39f436f414ed => generated 1678 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:15:38.034237 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-836eada2-c91c-452c-a856-e2f15a2a9b77 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:15:38.035467 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-836eada2-c91c-452c-a856-e2f15a2a9b77 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] [instance: 5a48e362-e26c-40a0-ac45-39f436f414ed] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:15:38.042245 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-836eada2-c91c-452c-a856-e2f15a2a9b77 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:15:38.042759 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-836eada2-c91c-452c-a856-e2f15a2a9b77 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:15:38.043195 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-836eada2-c91c-452c-a856-e2f15a2a9b77 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:15:38.043880 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-836eada2-c91c-452c-a856-e2f15a2a9b77 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:15:38.044334 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-836eada2-c91c-452c-a856-e2f15a2a9b77 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:15:38.044759 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-836eada2-c91c-452c-a856-e2f15a2a9b77 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:15:38.179194 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-836eada2-c91c-452c-a856-e2f15a2a9b77 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7124fd831f0d4ce8b561d79639b5f272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339847fffad841c59cd6f9e3439eb420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:15:38.187025 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-836eada2-c91c-452c-a856-e2f15a2a9b77 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] 10.222.0.43 "GET /compute/v2.1/servers/5a48e362-e26c-40a0-ac45-39f436f414ed" status: 200 len: 1678 microversion: 2.1 time: 0.156699 Oct 04 23:15:38.187614 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3505/7830] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:15:38 2022] GET /compute/v2.1/servers/5a48e362-e26c-40a0-ac45-39f436f414ed => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:15:39.209964 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-b83145e7-7788-4e48-b13e-9e97d6d42411 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:15:39.210653 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-b83145e7-7788-4e48-b13e-9e97d6d42411 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] [instance: 5a48e362-e26c-40a0-ac45-39f436f414ed] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:15:39.217503 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b83145e7-7788-4e48-b13e-9e97d6d42411 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:15:39.218007 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b83145e7-7788-4e48-b13e-9e97d6d42411 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:15:39.218505 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b83145e7-7788-4e48-b13e-9e97d6d42411 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:15:39.219215 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b83145e7-7788-4e48-b13e-9e97d6d42411 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:15:39.219686 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b83145e7-7788-4e48-b13e-9e97d6d42411 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:15:39.220131 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b83145e7-7788-4e48-b13e-9e97d6d42411 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:15:39.352652 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-b83145e7-7788-4e48-b13e-9e97d6d42411 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7124fd831f0d4ce8b561d79639b5f272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339847fffad841c59cd6f9e3439eb420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:15:39.360470 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-b83145e7-7788-4e48-b13e-9e97d6d42411 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] 10.222.0.43 "GET /compute/v2.1/servers/5a48e362-e26c-40a0-ac45-39f436f414ed" status: 200 len: 1678 microversion: 2.1 time: 0.154544 Oct 04 23:15:39.361034 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4326/7831] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:15:39 2022] GET /compute/v2.1/servers/5a48e362-e26c-40a0-ac45-39f436f414ed => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:15:40.385011 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-0eecb6a9-c2d3-4356-896b-a2f8bb2ee3a9 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:15:40.385551 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-0eecb6a9-c2d3-4356-896b-a2f8bb2ee3a9 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] [instance: 5a48e362-e26c-40a0-ac45-39f436f414ed] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:15:40.392442 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0eecb6a9-c2d3-4356-896b-a2f8bb2ee3a9 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:15:40.392935 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0eecb6a9-c2d3-4356-896b-a2f8bb2ee3a9 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:15:40.393384 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0eecb6a9-c2d3-4356-896b-a2f8bb2ee3a9 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:15:40.394432 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0eecb6a9-c2d3-4356-896b-a2f8bb2ee3a9 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:15:40.394906 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0eecb6a9-c2d3-4356-896b-a2f8bb2ee3a9 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:15:40.395344 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0eecb6a9-c2d3-4356-896b-a2f8bb2ee3a9 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:15:40.528163 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-0eecb6a9-c2d3-4356-896b-a2f8bb2ee3a9 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7124fd831f0d4ce8b561d79639b5f272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339847fffad841c59cd6f9e3439eb420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:15:40.536174 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-0eecb6a9-c2d3-4356-896b-a2f8bb2ee3a9 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] 10.222.0.43 "GET /compute/v2.1/servers/5a48e362-e26c-40a0-ac45-39f436f414ed" status: 200 len: 1678 microversion: 2.1 time: 0.155233 Oct 04 23:15:40.536754 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3506/7832] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:15:40 2022] GET /compute/v2.1/servers/5a48e362-e26c-40a0-ac45-39f436f414ed => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:15:41.559471 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-d16e12ce-c66c-4cc2-b771-10dbc8216c5e tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:15:41.560092 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-d16e12ce-c66c-4cc2-b771-10dbc8216c5e tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] [instance: 5a48e362-e26c-40a0-ac45-39f436f414ed] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:15:41.567168 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d16e12ce-c66c-4cc2-b771-10dbc8216c5e tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:15:41.567664 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d16e12ce-c66c-4cc2-b771-10dbc8216c5e tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:15:41.568114 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d16e12ce-c66c-4cc2-b771-10dbc8216c5e tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:15:41.568810 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d16e12ce-c66c-4cc2-b771-10dbc8216c5e tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:15:41.569275 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d16e12ce-c66c-4cc2-b771-10dbc8216c5e tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:15:41.569718 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d16e12ce-c66c-4cc2-b771-10dbc8216c5e tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:15:41.707322 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-d16e12ce-c66c-4cc2-b771-10dbc8216c5e tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7124fd831f0d4ce8b561d79639b5f272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339847fffad841c59cd6f9e3439eb420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:15:41.715568 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-d16e12ce-c66c-4cc2-b771-10dbc8216c5e tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] 10.222.0.43 "GET /compute/v2.1/servers/5a48e362-e26c-40a0-ac45-39f436f414ed" status: 200 len: 1678 microversion: 2.1 time: 0.159980 Oct 04 23:15:41.716157 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4327/7833] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:15:41 2022] GET /compute/v2.1/servers/5a48e362-e26c-40a0-ac45-39f436f414ed => generated 1678 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:15:42.740346 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-f495a9f7-6ff6-4b0a-b73e-bba5d8062e79 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:15:42.740962 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-f495a9f7-6ff6-4b0a-b73e-bba5d8062e79 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] [instance: 5a48e362-e26c-40a0-ac45-39f436f414ed] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:15:42.747727 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f495a9f7-6ff6-4b0a-b73e-bba5d8062e79 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:15:42.748210 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f495a9f7-6ff6-4b0a-b73e-bba5d8062e79 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:15:42.748647 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f495a9f7-6ff6-4b0a-b73e-bba5d8062e79 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:15:42.749335 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f495a9f7-6ff6-4b0a-b73e-bba5d8062e79 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:15:42.749790 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f495a9f7-6ff6-4b0a-b73e-bba5d8062e79 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:15:42.750217 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f495a9f7-6ff6-4b0a-b73e-bba5d8062e79 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:15:42.885036 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-f495a9f7-6ff6-4b0a-b73e-bba5d8062e79 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7124fd831f0d4ce8b561d79639b5f272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339847fffad841c59cd6f9e3439eb420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:15:42.892745 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-f495a9f7-6ff6-4b0a-b73e-bba5d8062e79 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] 10.222.0.43 "GET /compute/v2.1/servers/5a48e362-e26c-40a0-ac45-39f436f414ed" status: 200 len: 1681 microversion: 2.1 time: 0.156903 Oct 04 23:15:42.893326 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3507/7834] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:15:42 2022] GET /compute/v2.1/servers/5a48e362-e26c-40a0-ac45-39f436f414ed => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:16:17.126540 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-dab08f47-aa6d-4bba-96e9-e8275cf362c4 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 23:16:17.129818 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-dab08f47-aa6d-4bba-96e9-e8275cf362c4 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] [instance: 5a48e362-e26c-40a0-ac45-39f436f414ed] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:16:17.131933 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=12 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:16:17.132653 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:16:17.138968 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dab08f47-aa6d-4bba-96e9-e8275cf362c4 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:16:17.139627 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dab08f47-aa6d-4bba-96e9-e8275cf362c4 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:16:17.140090 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dab08f47-aa6d-4bba-96e9-e8275cf362c4 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:16:17.140861 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dab08f47-aa6d-4bba-96e9-e8275cf362c4 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:16:17.141341 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dab08f47-aa6d-4bba-96e9-e8275cf362c4 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:16:17.141790 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-dab08f47-aa6d-4bba-96e9-e8275cf362c4 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:16:17.204223 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-dab08f47-aa6d-4bba-96e9-e8275cf362c4 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] 10.222.0.43 "POST /compute/v2.1/servers/5a48e362-e26c-40a0-ac45-39f436f414ed/action" status: 200 len: 68984 microversion: 2.1 time: 0.081863 Oct 04 23:16:17.205223 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4328/7835] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 23:16:17 2022] POST /compute/v2.1/servers/5a48e362-e26c-40a0-ac45-39f436f414ed/action => generated 68984 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 23:16:41.088157 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-bc5cf748-afde-4d23-b893-0eff9f786201 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:16:41.088714 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-bc5cf748-afde-4d23-b893-0eff9f786201 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] [instance: 5a48e362-e26c-40a0-ac45-39f436f414ed] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:16:41.091137 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-dc785b83-856a-4a57-be7f-54ef8de3abbd req-61fd50cc-8baf-4eb4-9423-dd039bc47c47 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a48e362-e26c-40a0-ac45-39f436f414ed", "tag": "626f3662-8812-4723-83dc-8bd7dc8b1161"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 23:16:41.091566 n-d-860284-1 devstack@n-api.service[134102]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 04 23:16:41.091566 n-d-860284-1 devstack@n-api.service[134102]: Tue Oct 4 23:16:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5a48e362-e26c-40a0-ac45-39f436f414ed (ip 10.222.0.43) !!! Oct 04 23:16:41.093489 n-d-860284-1 devstack@n-api.service[134102]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 04 23:16:41.093605 n-d-860284-1 devstack@n-api.service[134102]: Tue Oct 4 23:16:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5a48e362-e26c-40a0-ac45-39f436f414ed (ip 10.222.0.43) !!! Oct 04 23:16:41.094881 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_api:SELECT=12 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:16:41.095567 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=36 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:16:41.102605 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=2 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:16:41.105434 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=4 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:16:41.114187 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bc5cf748-afde-4d23-b893-0eff9f786201 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:16:41.114481 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-dc785b83-856a-4a57-be7f-54ef8de3abbd req-61fd50cc-8baf-4eb4-9423-dd039bc47c47 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:16:41.115057 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-dc785b83-856a-4a57-be7f-54ef8de3abbd req-61fd50cc-8baf-4eb4-9423-dd039bc47c47 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:16:41.115372 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bc5cf748-afde-4d23-b893-0eff9f786201 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:16:41.115827 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bc5cf748-afde-4d23-b893-0eff9f786201 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:16:41.116337 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-dc785b83-856a-4a57-be7f-54ef8de3abbd req-61fd50cc-8baf-4eb4-9423-dd039bc47c47 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:16:41.116767 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bc5cf748-afde-4d23-b893-0eff9f786201 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:16:41.117230 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bc5cf748-afde-4d23-b893-0eff9f786201 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:16:41.117662 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bc5cf748-afde-4d23-b893-0eff9f786201 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:16:41.129430 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-dc785b83-856a-4a57-be7f-54ef8de3abbd req-61fd50cc-8baf-4eb4-9423-dd039bc47c47 service nova] Creating event network-changed:626f3662-8812-4723-83dc-8bd7dc8b1161 for instance 5a48e362-e26c-40a0-ac45-39f436f414ed on n-h2-860284-1 Oct 04 23:16:41.135264 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-dc785b83-856a-4a57-be7f-54ef8de3abbd req-61fd50cc-8baf-4eb4-9423-dd039bc47c47 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048336 Oct 04 23:16:41.136366 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4329/7836] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 23:16:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 23:16:41.151036 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-bc5cf748-afde-4d23-b893-0eff9f786201 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] [instance: 5a48e362-e26c-40a0-ac45-39f436f414ed] Going to try to terminate instance {{(pid=134102) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 23:16:41.239922 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-bc5cf748-afde-4d23-b893-0eff9f786201 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] 10.222.0.43 "DELETE /compute/v2.1/servers/5a48e362-e26c-40a0-ac45-39f436f414ed" status: 204 len: 0 microversion: 2.1 time: 0.156172 Oct 04 23:16:41.240500 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3508/7837] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 23:16:41 2022] DELETE /compute/v2.1/servers/5a48e362-e26c-40a0-ac45-39f436f414ed => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 23:16:41.250730 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-a69a5ea8-bf73-496d-8495-36343a39b563 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:16:41.251920 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-a69a5ea8-bf73-496d-8495-36343a39b563 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] [instance: 5a48e362-e26c-40a0-ac45-39f436f414ed] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:16:41.260550 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a69a5ea8-bf73-496d-8495-36343a39b563 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:16:41.261414 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a69a5ea8-bf73-496d-8495-36343a39b563 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:16:41.262740 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a69a5ea8-bf73-496d-8495-36343a39b563 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:16:41.263754 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a69a5ea8-bf73-496d-8495-36343a39b563 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:16:41.265265 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a69a5ea8-bf73-496d-8495-36343a39b563 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:16:41.265265 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a69a5ea8-bf73-496d-8495-36343a39b563 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:16:41.403932 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-a69a5ea8-bf73-496d-8495-36343a39b563 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7124fd831f0d4ce8b561d79639b5f272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339847fffad841c59cd6f9e3439eb420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:16:41.413409 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-a69a5ea8-bf73-496d-8495-36343a39b563 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] 10.222.0.43 "GET /compute/v2.1/servers/5a48e362-e26c-40a0-ac45-39f436f414ed" status: 200 len: 1687 microversion: 2.1 time: 0.167805 Oct 04 23:16:41.414609 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4330/7838] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:16:41 2022] GET /compute/v2.1/servers/5a48e362-e26c-40a0-ac45-39f436f414ed => generated 1687 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:16:42.438384 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-7b032787-bc2f-4fe1-a771-fa265fe0c38f tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:16:42.439112 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-7b032787-bc2f-4fe1-a771-fa265fe0c38f tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] [instance: 5a48e362-e26c-40a0-ac45-39f436f414ed] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:16:42.447107 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7b032787-bc2f-4fe1-a771-fa265fe0c38f tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:16:42.447597 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7b032787-bc2f-4fe1-a771-fa265fe0c38f tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:16:42.448041 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7b032787-bc2f-4fe1-a771-fa265fe0c38f tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:16:42.448742 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7b032787-bc2f-4fe1-a771-fa265fe0c38f tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:16:42.449211 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7b032787-bc2f-4fe1-a771-fa265fe0c38f tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:16:42.449644 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7b032787-bc2f-4fe1-a771-fa265fe0c38f tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:16:42.580161 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-7b032787-bc2f-4fe1-a771-fa265fe0c38f tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7124fd831f0d4ce8b561d79639b5f272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339847fffad841c59cd6f9e3439eb420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:16:42.588633 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-7b032787-bc2f-4fe1-a771-fa265fe0c38f tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] 10.222.0.43 "GET /compute/v2.1/servers/5a48e362-e26c-40a0-ac45-39f436f414ed" status: 200 len: 1687 microversion: 2.1 time: 0.154752 Oct 04 23:16:42.589221 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3509/7839] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:16:42 2022] GET /compute/v2.1/servers/5a48e362-e26c-40a0-ac45-39f436f414ed => generated 1687 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:16:43.613403 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-690d4558-a167-411b-a1de-462fbeb2a187 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:16:43.614036 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-690d4558-a167-411b-a1de-462fbeb2a187 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] [instance: 5a48e362-e26c-40a0-ac45-39f436f414ed] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:16:43.621872 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-690d4558-a167-411b-a1de-462fbeb2a187 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:16:43.622391 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-690d4558-a167-411b-a1de-462fbeb2a187 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:16:43.622856 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-690d4558-a167-411b-a1de-462fbeb2a187 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:16:43.623575 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-690d4558-a167-411b-a1de-462fbeb2a187 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:16:43.624038 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-690d4558-a167-411b-a1de-462fbeb2a187 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:16:43.624473 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-690d4558-a167-411b-a1de-462fbeb2a187 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:16:43.719115 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-690d4558-a167-411b-a1de-462fbeb2a187 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7124fd831f0d4ce8b561d79639b5f272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339847fffad841c59cd6f9e3439eb420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:16:43.728475 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-690d4558-a167-411b-a1de-462fbeb2a187 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] 10.222.0.43 "GET /compute/v2.1/servers/5a48e362-e26c-40a0-ac45-39f436f414ed" status: 200 len: 1619 microversion: 2.1 time: 0.118342 Oct 04 23:16:43.740239 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4331/7840] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:16:43 2022] GET /compute/v2.1/servers/5a48e362-e26c-40a0-ac45-39f436f414ed => generated 1619 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 23:16:43.793924 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-e26955e3-04c2-421a-beb9-3aac2926d4dc req-8c2d562a-b110-4c54-83d7-2530d0a5c6e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a48e362-e26c-40a0-ac45-39f436f414ed", "name": "network-vif-deleted", "tag": "626f3662-8812-4723-83dc-8bd7dc8b1161"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 23:16:43.804834 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-e26955e3-04c2-421a-beb9-3aac2926d4dc req-8c2d562a-b110-4c54-83d7-2530d0a5c6e6 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:16:43.805315 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-e26955e3-04c2-421a-beb9-3aac2926d4dc req-8c2d562a-b110-4c54-83d7-2530d0a5c6e6 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:16:43.805747 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-e26955e3-04c2-421a-beb9-3aac2926d4dc req-8c2d562a-b110-4c54-83d7-2530d0a5c6e6 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:16:43.817263 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-e26955e3-04c2-421a-beb9-3aac2926d4dc req-8c2d562a-b110-4c54-83d7-2530d0a5c6e6 service nova] Creating event network-vif-deleted:626f3662-8812-4723-83dc-8bd7dc8b1161 for instance 5a48e362-e26c-40a0-ac45-39f436f414ed on n-h2-860284-1 Oct 04 23:16:43.822621 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-e26955e3-04c2-421a-beb9-3aac2926d4dc req-8c2d562a-b110-4c54-83d7-2530d0a5c6e6 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032420 Oct 04 23:16:43.823233 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3510/7841] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 23:16:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 23:16:44.752232 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-a4b3192e-620d-414a-9d33-8902e0624367 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:16:44.753508 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-a4b3192e-620d-414a-9d33-8902e0624367 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] [instance: 5a48e362-e26c-40a0-ac45-39f436f414ed] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:16:44.760750 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a4b3192e-620d-414a-9d33-8902e0624367 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:16:44.761251 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a4b3192e-620d-414a-9d33-8902e0624367 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:16:44.762244 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a4b3192e-620d-414a-9d33-8902e0624367 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:16:44.763207 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a4b3192e-620d-414a-9d33-8902e0624367 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:16:44.763207 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a4b3192e-620d-414a-9d33-8902e0624367 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:16:44.763592 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a4b3192e-620d-414a-9d33-8902e0624367 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:16:44.777830 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-a4b3192e-620d-414a-9d33-8902e0624367 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] HTTP exception thrown: Instance 5a48e362-e26c-40a0-ac45-39f436f414ed could not be found. Oct 04 23:16:44.779527 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-a4b3192e-620d-414a-9d33-8902e0624367 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Request method failure captured: Oct 04 23:16:44.779527 n-d-860284-1 devstack@n-api.service[134101]: request: GET /compute/v2.1/servers/5a48e362-e26c-40a0-ac45-39f436f414ed HTTP/1.1 Oct 04 23:16:44.779527 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 23:16:44.779527 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 23:16:44.779527 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 23:16:44.779527 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 23:16:44.779527 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 23:16:44.779527 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 23:16:44.779527 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 23:16:44.779527 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 23:16:44.779527 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPL3PV1P3eiBng-eyftmazLIMFOGhxgvlJE5kLv8qSAxeZ7nw7JEQcBo6uebpFaCmIciYVzYahs6GheYsSkJ64LI0k5-JJiivZ7ZQcPNIUVS-FFaLcyFAAb-8gYSuTYUwgQIpyTivuP6QEOS5wIqgxRi6U8ltOJnUssrNHH8u3ZtbLbs Oct 04 23:16:44.779527 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 23:16:44.779527 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 23:16:44.779527 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 23:16:44.779527 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 23:16:44.779527 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 23:16:44.779527 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 23:16:44.779527 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: 339847fffad841c59cd6f9e3439eb420 Oct 04 23:16:44.779527 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-217321805 Oct 04 23:16:44.779527 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 23:16:44.779527 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 23:16:44.779527 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/339847fffad841c59cd6f9e3439eb420"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_339847fffad841c59cd6f9e3439eb420", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/339847fffad841c59cd6f9e3439eb420"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/339847fffad841c59cd6f9e3439eb420"}]}] Oct 04 23:16:44.779527 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-TestNetworkAdvancedServerOps-217321805 Oct 04 23:16:44.779527 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: 339847fffad841c59cd6f9e3439eb420 Oct 04 23:16:44.779527 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-217321805 Oct 04 23:16:44.779527 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-TestNetworkAdvancedServerOps-217321805-project Oct 04 23:16:44.779527 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 23:16:44.779527 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 23:16:44.779527 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 7124fd831f0d4ce8b561d79639b5f272 Oct 04 23:16:44.779527 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-TestNetworkAdvancedServerOps-217321805-project Oct 04 23:16:44.779527 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 23:16:44.779527 n-d-860284-1 devstack@n-api.service[134101]: exception: Instance 5a48e362-e26c-40a0-ac45-39f436f414ed could not be found. Oct 04 23:16:44.779527 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': '5a48e362-e26c-40a0-ac45-39f436f414ed'} Oct 04 23:16:44.779527 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 23:16:44.779527 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 23:16:44.779527 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 23:16:44.779527 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 23:16:44.779527 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 23:16:44.779527 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 23:16:44.779527 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 23:16:44.779527 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 23:16:44.779527 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 23:16:44.779527 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 23:16:44.779527 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a48e362-e26c-40a0-ac45-39f436f414ed could not be found. Oct 04 23:16:44.779527 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 23:16:44.779527 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 23:16:44.779527 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 23:16:44.779527 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 23:16:44.779527 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 23:16:44.779527 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 23:16:44.779527 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 23:16:44.779527 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 23:16:44.779527 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 23:16:44.779527 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 23:16:44.779527 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 23:16:44.779527 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 23:16:44.779527 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 23:16:44.779527 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 23:16:44.779527 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 23:16:44.779527 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 23:16:44.779527 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a48e362-e26c-40a0-ac45-39f436f414ed could not be found. Oct 04 23:16:44.779527 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 23:16:44.779527 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 23:16:44.784457 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 23:16:44.784457 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 23:16:44.784457 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 23:16:44.784457 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 23:16:44.784457 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 23:16:44.784457 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 23:16:44.784457 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a48e362-e26c-40a0-ac45-39f436f414ed could not be found. Oct 04 23:16:44.784457 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 23:16:44.784457 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-a4b3192e-620d-414a-9d33-8902e0624367 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Returning 404 to user: Instance 5a48e362-e26c-40a0-ac45-39f436f414ed could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 23:16:44.784457 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-a4b3192e-620d-414a-9d33-8902e0624367 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] 10.222.0.43 "GET /compute/v2.1/servers/5a48e362-e26c-40a0-ac45-39f436f414ed" status: 404 len: 111 microversion: 2.1 time: 0.032673 Oct 04 23:16:44.784457 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4332/7842] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:16:44 2022] GET /compute/v2.1/servers/5a48e362-e26c-40a0-ac45-39f436f414ed => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 23:16:47.750336 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-6240a20a-cb98-4826-b1d0-839715cfa833 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Calling method '.version_select at 0x7fbb2f893dc0>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:16:47.783308 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-6240a20a-cb98-4826-b1d0-839715cfa833 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-774065264" status: 202 len: 0 microversion: 2.1 time: 0.038850 Oct 04 23:16:47.784038 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3511/7843] 10.222.0.43 () {58 vars in 1281 bytes} [Tue Oct 4 23:16:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-774065264 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 23:16:47.810991 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-2e6d27ea-3f3e-473f-b773-2480604c18d9 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Action: 'create', calling method: .version_select at 0x7fbb2f8020d0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-46637147", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBUY04Cgb4bpv1lmqrnuDiID/oi9xCyxXck21ExorwzU7S2fIuDqofAdX9VLyFJtmrm9nQFPF/Q8sYV/9ueWJ5UeLlOgaC8VQz3UAekWDeu7QS39QU4idSH49Fycvvaw4Q=="}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 23:16:47.828688 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-2e6d27ea-3f3e-473f-b773-2480604c18d9 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Getting quotas for project 339847fffad841c59cd6f9e3439eb420. Resources: {'key_pairs'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 23:16:47.834995 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-2e6d27ea-3f3e-473f-b773-2480604c18d9 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Getting quotas for user 7124fd831f0d4ce8b561d79639b5f272 and project 339847fffad841c59cd6f9e3439eb420. Resources: {'key_pairs'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 23:16:47.848917 n-d-860284-1 devstack@n-api.service[134101]: ERROR oslo.messaging._drivers.impl_rabbit [None req-2e6d27ea-3f3e-473f-b773-2480604c18d9 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] [54f0993b-fb22-4e4c-ae00-e3f0e5da4c18] AMQP server on 10.222.0.43:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 23:16:48.856748 n-d-860284-1 devstack@n-api.service[134101]: INFO oslo.messaging._drivers.impl_rabbit [None req-2e6d27ea-3f3e-473f-b773-2480604c18d9 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] [54f0993b-fb22-4e4c-ae00-e3f0e5da4c18] Reconnected to AMQP server on 10.222.0.43:5672 via [amqp] client with port 39394. Oct 04 23:16:48.871877 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-2e6d27ea-3f3e-473f-b773-2480604c18d9 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 1.064946 Oct 04 23:16:48.872475 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4333/7844] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Oct 4 23:16:47 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 23:16:54.681504 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-990fbdcb-f84c-4503-b305-5d962664e98f tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-2094474872", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452", "networks": [{"uuid": "4e183099-fcd4-4470-be86-dbe1c7ce7faa"}], "key_name": "tempest-TestNetworkAdvancedServerOps-46637147", "security_groups": [{"name": "tempest-secgroup-smoke-1162528944"}]}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 23:16:54.693143 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:16:54.819399 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.network.neutron [None req-990fbdcb-f84c-4503-b305-5d962664e98f tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] validate_networks() for [('4e183099-fcd4-4470-be86-dbe1c7ce7faa', None, None, None, None, None)] {{(pid=134102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 23:16:55.218688 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-990fbdcb-f84c-4503-b305-5d962664e98f tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Flavor limits 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 23:16:55.219119 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-990fbdcb-f84c-4503-b305-5d962664e98f tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Image limits 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 23:16:55.219725 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-990fbdcb-f84c-4503-b305-5d962664e98f tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Flavor pref 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 23:16:55.220298 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-990fbdcb-f84c-4503-b305-5d962664e98f tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Image pref 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 23:16:55.220608 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-990fbdcb-f84c-4503-b305-5d962664e98f tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 23:16:55.229716 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-990fbdcb-f84c-4503-b305-5d962664e98f tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:16:55.230202 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-990fbdcb-f84c-4503-b305-5d962664e98f tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:16:55.230664 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-990fbdcb-f84c-4503-b305-5d962664e98f tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:16:55.231386 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-990fbdcb-f84c-4503-b305-5d962664e98f tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:16:55.231837 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-990fbdcb-f84c-4503-b305-5d962664e98f tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:16:55.232259 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-990fbdcb-f84c-4503-b305-5d962664e98f tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:16:55.250066 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-990fbdcb-f84c-4503-b305-5d962664e98f tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Getting quotas for project 339847fffad841c59cd6f9e3439eb420. Resources: {'instances', 'ram', 'cores'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 23:16:55.255346 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-990fbdcb-f84c-4503-b305-5d962664e98f tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Getting quotas for user 7124fd831f0d4ce8b561d79639b5f272 and project 339847fffad841c59cd6f9e3439eb420. Resources: {'instances', 'ram', 'cores'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 23:16:55.269044 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-990fbdcb-f84c-4503-b305-5d962664e98f tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Going to run 1 instances... {{(pid=134102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 23:16:55.271516 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-990fbdcb-f84c-4503-b305-5d962664e98f tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] [instance: 5c4b1243-8ffd-48f4-9976-b6ab857536e6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='58548514-5dac-426c-81f5-19e3fba33e23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 23:16:55.323522 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-990fbdcb-f84c-4503-b305-5d962664e98f tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.646742 Oct 04 23:16:55.324502 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3512/7845] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 23:16:54 2022] POST /compute/v2.1/servers => generated 406 bytes in 648 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 23:16:55.333939 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=16 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:16:55.339697 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-109d5af5-85c2-4e51-9e38-6d13e3562263 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:16:55.341728 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-109d5af5-85c2-4e51-9e38-6d13e3562263 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] [instance: 5c4b1243-8ffd-48f4-9976-b6ab857536e6] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:16:55.400729 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-109d5af5-85c2-4e51-9e38-6d13e3562263 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7124fd831f0d4ce8b561d79639b5f272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339847fffad841c59cd6f9e3439eb420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:16:55.407874 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-109d5af5-85c2-4e51-9e38-6d13e3562263 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] 10.222.0.43 "GET /compute/v2.1/servers/5c4b1243-8ffd-48f4-9976-b6ab857536e6" status: 200 len: 1265 microversion: 2.1 time: 0.075804 Oct 04 23:16:55.408458 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4334/7846] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:16:55 2022] GET /compute/v2.1/servers/5c4b1243-8ffd-48f4-9976-b6ab857536e6 => generated 1265 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:16:56.431557 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-d39755c8-05d1-4d6c-bba0-8b2c4de1135a tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:16:56.432305 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-d39755c8-05d1-4d6c-bba0-8b2c4de1135a tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] [instance: 5c4b1243-8ffd-48f4-9976-b6ab857536e6] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:16:56.440071 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d39755c8-05d1-4d6c-bba0-8b2c4de1135a tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:16:56.440569 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d39755c8-05d1-4d6c-bba0-8b2c4de1135a tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:16:56.441012 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d39755c8-05d1-4d6c-bba0-8b2c4de1135a tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:16:56.441726 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d39755c8-05d1-4d6c-bba0-8b2c4de1135a tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:16:56.442192 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d39755c8-05d1-4d6c-bba0-8b2c4de1135a tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:16:56.442645 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d39755c8-05d1-4d6c-bba0-8b2c4de1135a tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:16:56.545504 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-d39755c8-05d1-4d6c-bba0-8b2c4de1135a tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7124fd831f0d4ce8b561d79639b5f272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339847fffad841c59cd6f9e3439eb420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:16:56.562078 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-d39755c8-05d1-4d6c-bba0-8b2c4de1135a tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] 10.222.0.43 "GET /compute/v2.1/servers/5c4b1243-8ffd-48f4-9976-b6ab857536e6" status: 200 len: 1335 microversion: 2.1 time: 0.134448 Oct 04 23:16:56.570451 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3513/7847] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:16:56 2022] GET /compute/v2.1/servers/5c4b1243-8ffd-48f4-9976-b6ab857536e6 => generated 1335 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:16:57.587225 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-93a14b34-2a7d-49f5-a94b-bcb44bee635f tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:16:57.588624 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-93a14b34-2a7d-49f5-a94b-bcb44bee635f tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] [instance: 5c4b1243-8ffd-48f4-9976-b6ab857536e6] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:16:57.596492 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-93a14b34-2a7d-49f5-a94b-bcb44bee635f tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:16:57.598189 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-93a14b34-2a7d-49f5-a94b-bcb44bee635f tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:16:57.598954 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-93a14b34-2a7d-49f5-a94b-bcb44bee635f tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:16:57.599894 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-93a14b34-2a7d-49f5-a94b-bcb44bee635f tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:16:57.601675 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-93a14b34-2a7d-49f5-a94b-bcb44bee635f tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:16:57.602470 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-93a14b34-2a7d-49f5-a94b-bcb44bee635f tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:16:57.762446 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-93a14b34-2a7d-49f5-a94b-bcb44bee635f tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7124fd831f0d4ce8b561d79639b5f272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339847fffad841c59cd6f9e3439eb420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:16:57.775674 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-93a14b34-2a7d-49f5-a94b-bcb44bee635f tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] 10.222.0.43 "GET /compute/v2.1/servers/5c4b1243-8ffd-48f4-9976-b6ab857536e6" status: 200 len: 1391 microversion: 2.1 time: 0.192938 Oct 04 23:16:57.777484 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4335/7848] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:16:57 2022] GET /compute/v2.1/servers/5c4b1243-8ffd-48f4-9976-b6ab857536e6 => generated 1391 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:16:57.973144 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-0ec67012-bbeb-4e2c-b030-83c841474f98 req-50c47bb4-8d48-47dc-a14d-99d059397146 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c4b1243-8ffd-48f4-9976-b6ab857536e6", "tag": "89915f52-e081-4707-ab59-56d072882447"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 23:16:57.986193 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-0ec67012-bbeb-4e2c-b030-83c841474f98 req-50c47bb4-8d48-47dc-a14d-99d059397146 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:16:57.987136 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-0ec67012-bbeb-4e2c-b030-83c841474f98 req-50c47bb4-8d48-47dc-a14d-99d059397146 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:16:57.987577 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-0ec67012-bbeb-4e2c-b030-83c841474f98 req-50c47bb4-8d48-47dc-a14d-99d059397146 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:16:58.000219 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-0ec67012-bbeb-4e2c-b030-83c841474f98 req-50c47bb4-8d48-47dc-a14d-99d059397146 service nova] Creating event network-changed:89915f52-e081-4707-ab59-56d072882447 for instance 5c4b1243-8ffd-48f4-9976-b6ab857536e6 on n-h1-860284-1 Oct 04 23:16:58.006598 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-0ec67012-bbeb-4e2c-b030-83c841474f98 req-50c47bb4-8d48-47dc-a14d-99d059397146 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037075 Oct 04 23:16:58.007433 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3514/7849] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 23:16:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 23:16:58.799846 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-63abe49d-72c8-4ad2-bb48-9c9e6cd79efb tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:16:58.800474 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-63abe49d-72c8-4ad2-bb48-9c9e6cd79efb tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] [instance: 5c4b1243-8ffd-48f4-9976-b6ab857536e6] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:16:58.808003 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-63abe49d-72c8-4ad2-bb48-9c9e6cd79efb tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:16:58.808511 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-63abe49d-72c8-4ad2-bb48-9c9e6cd79efb tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:16:58.808969 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-63abe49d-72c8-4ad2-bb48-9c9e6cd79efb tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:16:58.809687 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-63abe49d-72c8-4ad2-bb48-9c9e6cd79efb tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:16:58.810169 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-63abe49d-72c8-4ad2-bb48-9c9e6cd79efb tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:16:58.810643 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-63abe49d-72c8-4ad2-bb48-9c9e6cd79efb tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:16:58.942805 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-63abe49d-72c8-4ad2-bb48-9c9e6cd79efb tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7124fd831f0d4ce8b561d79639b5f272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339847fffad841c59cd6f9e3439eb420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:16:58.951284 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-63abe49d-72c8-4ad2-bb48-9c9e6cd79efb tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] 10.222.0.43 "GET /compute/v2.1/servers/5c4b1243-8ffd-48f4-9976-b6ab857536e6" status: 200 len: 1391 microversion: 2.1 time: 0.155414 Oct 04 23:16:58.951858 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4336/7850] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:16:58 2022] GET /compute/v2.1/servers/5c4b1243-8ffd-48f4-9976-b6ab857536e6 => generated 1391 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:16:59.975464 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-b91a9934-6bff-419b-8195-d01f950c6c6a tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:16:59.976684 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-b91a9934-6bff-419b-8195-d01f950c6c6a tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] [instance: 5c4b1243-8ffd-48f4-9976-b6ab857536e6] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:16:59.983129 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b91a9934-6bff-419b-8195-d01f950c6c6a tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:16:59.983614 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b91a9934-6bff-419b-8195-d01f950c6c6a tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:16:59.984167 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b91a9934-6bff-419b-8195-d01f950c6c6a tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:16:59.984863 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b91a9934-6bff-419b-8195-d01f950c6c6a tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:16:59.985325 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b91a9934-6bff-419b-8195-d01f950c6c6a tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:16:59.985758 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b91a9934-6bff-419b-8195-d01f950c6c6a tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:17:00.122330 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-b91a9934-6bff-419b-8195-d01f950c6c6a tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7124fd831f0d4ce8b561d79639b5f272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339847fffad841c59cd6f9e3439eb420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:17:00.130096 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-b91a9934-6bff-419b-8195-d01f950c6c6a tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] 10.222.0.43 "GET /compute/v2.1/servers/5c4b1243-8ffd-48f4-9976-b6ab857536e6" status: 200 len: 1391 microversion: 2.1 time: 0.159965 Oct 04 23:17:00.130730 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3515/7851] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:16:59 2022] GET /compute/v2.1/servers/5c4b1243-8ffd-48f4-9976-b6ab857536e6 => generated 1391 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:17:01.153418 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-8cebf73a-7d7a-45c9-8795-fdd612519649 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:17:01.154044 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-8cebf73a-7d7a-45c9-8795-fdd612519649 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] [instance: 5c4b1243-8ffd-48f4-9976-b6ab857536e6] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:17:01.160785 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8cebf73a-7d7a-45c9-8795-fdd612519649 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:17:01.161281 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8cebf73a-7d7a-45c9-8795-fdd612519649 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:17:01.161728 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8cebf73a-7d7a-45c9-8795-fdd612519649 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:17:01.162448 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8cebf73a-7d7a-45c9-8795-fdd612519649 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:17:01.162916 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8cebf73a-7d7a-45c9-8795-fdd612519649 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:17:01.163385 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8cebf73a-7d7a-45c9-8795-fdd612519649 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:17:01.298069 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-8cebf73a-7d7a-45c9-8795-fdd612519649 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7124fd831f0d4ce8b561d79639b5f272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339847fffad841c59cd6f9e3439eb420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:17:01.305804 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-8cebf73a-7d7a-45c9-8795-fdd612519649 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] 10.222.0.43 "GET /compute/v2.1/servers/5c4b1243-8ffd-48f4-9976-b6ab857536e6" status: 200 len: 1391 microversion: 2.1 time: 0.156657 Oct 04 23:17:01.306396 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4337/7852] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:17:01 2022] GET /compute/v2.1/servers/5c4b1243-8ffd-48f4-9976-b6ab857536e6 => generated 1391 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:17:02.327999 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-896989ec-029c-487e-94ec-e6eced074fe6 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:17:02.328542 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-896989ec-029c-487e-94ec-e6eced074fe6 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] [instance: 5c4b1243-8ffd-48f4-9976-b6ab857536e6] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:17:02.335366 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-896989ec-029c-487e-94ec-e6eced074fe6 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:17:02.335852 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-896989ec-029c-487e-94ec-e6eced074fe6 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:17:02.336290 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-896989ec-029c-487e-94ec-e6eced074fe6 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:17:02.337013 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-896989ec-029c-487e-94ec-e6eced074fe6 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:17:02.337466 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-896989ec-029c-487e-94ec-e6eced074fe6 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:17:02.337892 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-896989ec-029c-487e-94ec-e6eced074fe6 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:17:02.467702 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-896989ec-029c-487e-94ec-e6eced074fe6 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7124fd831f0d4ce8b561d79639b5f272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339847fffad841c59cd6f9e3439eb420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:17:02.475413 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-896989ec-029c-487e-94ec-e6eced074fe6 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] 10.222.0.43 "GET /compute/v2.1/servers/5c4b1243-8ffd-48f4-9976-b6ab857536e6" status: 200 len: 1391 microversion: 2.1 time: 0.151403 Oct 04 23:17:02.475996 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3516/7853] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:17:02 2022] GET /compute/v2.1/servers/5c4b1243-8ffd-48f4-9976-b6ab857536e6 => generated 1391 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:17:03.499243 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-96625f9c-0c77-4997-b6d0-d10600d4f358 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:17:03.499889 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-96625f9c-0c77-4997-b6d0-d10600d4f358 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] [instance: 5c4b1243-8ffd-48f4-9976-b6ab857536e6] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:17:03.507100 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-96625f9c-0c77-4997-b6d0-d10600d4f358 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:17:03.507610 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-96625f9c-0c77-4997-b6d0-d10600d4f358 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:17:03.508066 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-96625f9c-0c77-4997-b6d0-d10600d4f358 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:17:03.509616 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-96625f9c-0c77-4997-b6d0-d10600d4f358 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:17:03.510101 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-96625f9c-0c77-4997-b6d0-d10600d4f358 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:17:03.510598 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-96625f9c-0c77-4997-b6d0-d10600d4f358 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:17:03.639736 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-96625f9c-0c77-4997-b6d0-d10600d4f358 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7124fd831f0d4ce8b561d79639b5f272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339847fffad841c59cd6f9e3439eb420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:17:03.647649 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-96625f9c-0c77-4997-b6d0-d10600d4f358 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] 10.222.0.43 "GET /compute/v2.1/servers/5c4b1243-8ffd-48f4-9976-b6ab857536e6" status: 200 len: 1391 microversion: 2.1 time: 0.152565 Oct 04 23:17:03.648225 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4338/7854] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:17:03 2022] GET /compute/v2.1/servers/5c4b1243-8ffd-48f4-9976-b6ab857536e6 => generated 1391 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:17:04.671019 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-130789d9-3c4a-4acf-8f70-cb17e98e454a tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:17:04.672243 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-130789d9-3c4a-4acf-8f70-cb17e98e454a tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] [instance: 5c4b1243-8ffd-48f4-9976-b6ab857536e6] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:17:04.680135 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-130789d9-3c4a-4acf-8f70-cb17e98e454a tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:17:04.680666 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-130789d9-3c4a-4acf-8f70-cb17e98e454a tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:17:04.681118 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-130789d9-3c4a-4acf-8f70-cb17e98e454a tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:17:04.681916 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-130789d9-3c4a-4acf-8f70-cb17e98e454a tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:17:04.682390 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-130789d9-3c4a-4acf-8f70-cb17e98e454a tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:17:04.682841 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-130789d9-3c4a-4acf-8f70-cb17e98e454a tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:17:04.728905 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-32115f7d-7235-4be9-b4db-fdc101477335 req-aeb5b43f-b828-4766-85fd-6024b57b5494 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c4b1243-8ffd-48f4-9976-b6ab857536e6", "name": "network-vif-plugged", "status": "completed", "tag": "89915f52-e081-4707-ab59-56d072882447"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 23:17:04.742336 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-32115f7d-7235-4be9-b4db-fdc101477335 req-aeb5b43f-b828-4766-85fd-6024b57b5494 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:17:04.743086 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-32115f7d-7235-4be9-b4db-fdc101477335 req-aeb5b43f-b828-4766-85fd-6024b57b5494 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:17:04.743669 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-32115f7d-7235-4be9-b4db-fdc101477335 req-aeb5b43f-b828-4766-85fd-6024b57b5494 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:17:04.756082 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-32115f7d-7235-4be9-b4db-fdc101477335 req-aeb5b43f-b828-4766-85fd-6024b57b5494 service nova] Creating event network-vif-plugged:89915f52-e081-4707-ab59-56d072882447 for instance 5c4b1243-8ffd-48f4-9976-b6ab857536e6 on n-h1-860284-1 Oct 04 23:17:04.764886 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-32115f7d-7235-4be9-b4db-fdc101477335 req-aeb5b43f-b828-4766-85fd-6024b57b5494 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041284 Oct 04 23:17:04.765538 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4339/7855] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 23:17:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 23:17:04.856298 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-130789d9-3c4a-4acf-8f70-cb17e98e454a tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7124fd831f0d4ce8b561d79639b5f272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339847fffad841c59cd6f9e3439eb420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:17:04.864124 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-130789d9-3c4a-4acf-8f70-cb17e98e454a tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] 10.222.0.43 "GET /compute/v2.1/servers/5c4b1243-8ffd-48f4-9976-b6ab857536e6" status: 200 len: 1391 microversion: 2.1 time: 0.197027 Oct 04 23:17:04.864712 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3517/7856] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:17:04 2022] GET /compute/v2.1/servers/5c4b1243-8ffd-48f4-9976-b6ab857536e6 => generated 1391 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:17:05.885734 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=6 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:17:05.891349 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-ccdc0ffd-6c09-4e4f-8e8c-2a4987c675a2 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:17:05.892106 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-ccdc0ffd-6c09-4e4f-8e8c-2a4987c675a2 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] [instance: 5c4b1243-8ffd-48f4-9976-b6ab857536e6] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:17:05.898695 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ccdc0ffd-6c09-4e4f-8e8c-2a4987c675a2 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:17:05.899200 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ccdc0ffd-6c09-4e4f-8e8c-2a4987c675a2 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:17:05.900250 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ccdc0ffd-6c09-4e4f-8e8c-2a4987c675a2 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:17:05.900962 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ccdc0ffd-6c09-4e4f-8e8c-2a4987c675a2 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:17:05.901438 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ccdc0ffd-6c09-4e4f-8e8c-2a4987c675a2 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:17:05.901889 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ccdc0ffd-6c09-4e4f-8e8c-2a4987c675a2 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:17:06.043004 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-ccdc0ffd-6c09-4e4f-8e8c-2a4987c675a2 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7124fd831f0d4ce8b561d79639b5f272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339847fffad841c59cd6f9e3439eb420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:17:06.050955 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-ccdc0ffd-6c09-4e4f-8e8c-2a4987c675a2 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] 10.222.0.43 "GET /compute/v2.1/servers/5c4b1243-8ffd-48f4-9976-b6ab857536e6" status: 200 len: 1391 microversion: 2.1 time: 0.166259 Oct 04 23:17:06.051551 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4340/7857] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:17:05 2022] GET /compute/v2.1/servers/5c4b1243-8ffd-48f4-9976-b6ab857536e6 => generated 1391 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:17:07.074025 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-074f23f0-271e-4e42-acd1-350991fdfe19 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:17:07.074678 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-074f23f0-271e-4e42-acd1-350991fdfe19 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] [instance: 5c4b1243-8ffd-48f4-9976-b6ab857536e6] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:17:07.076640 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell0:SELECT=2 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:17:07.077315 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell0:SELECT=6 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:17:07.084617 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-074f23f0-271e-4e42-acd1-350991fdfe19 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:17:07.085115 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-074f23f0-271e-4e42-acd1-350991fdfe19 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:17:07.085563 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-074f23f0-271e-4e42-acd1-350991fdfe19 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:17:07.086274 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-074f23f0-271e-4e42-acd1-350991fdfe19 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:17:07.087289 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-074f23f0-271e-4e42-acd1-350991fdfe19 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:17:07.087792 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-074f23f0-271e-4e42-acd1-350991fdfe19 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:17:07.223556 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-074f23f0-271e-4e42-acd1-350991fdfe19 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7124fd831f0d4ce8b561d79639b5f272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339847fffad841c59cd6f9e3439eb420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:17:07.232474 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-074f23f0-271e-4e42-acd1-350991fdfe19 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] 10.222.0.43 "GET /compute/v2.1/servers/5c4b1243-8ffd-48f4-9976-b6ab857536e6" status: 200 len: 1564 microversion: 2.1 time: 0.162495 Oct 04 23:17:07.233055 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3518/7858] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:17:07 2022] GET /compute/v2.1/servers/5c4b1243-8ffd-48f4-9976-b6ab857536e6 => generated 1564 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:17:07.254120 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-840a7f50-7020-47ba-a8dd-353d12b757bf tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:17:07.254777 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-840a7f50-7020-47ba-a8dd-353d12b757bf tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] [instance: 5c4b1243-8ffd-48f4-9976-b6ab857536e6] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:17:07.261593 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-840a7f50-7020-47ba-a8dd-353d12b757bf tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:17:07.262095 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-840a7f50-7020-47ba-a8dd-353d12b757bf tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:17:07.262583 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-840a7f50-7020-47ba-a8dd-353d12b757bf tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:17:07.263572 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-840a7f50-7020-47ba-a8dd-353d12b757bf tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:17:07.264041 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-840a7f50-7020-47ba-a8dd-353d12b757bf tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:17:07.264483 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-840a7f50-7020-47ba-a8dd-353d12b757bf tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:17:07.396404 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-840a7f50-7020-47ba-a8dd-353d12b757bf tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7124fd831f0d4ce8b561d79639b5f272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339847fffad841c59cd6f9e3439eb420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:17:07.404836 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-840a7f50-7020-47ba-a8dd-353d12b757bf tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] 10.222.0.43 "GET /compute/v2.1/servers/5c4b1243-8ffd-48f4-9976-b6ab857536e6" status: 200 len: 1564 microversion: 2.1 time: 0.154634 Oct 04 23:17:07.405413 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4341/7859] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:17:07 2022] GET /compute/v2.1/servers/5c4b1243-8ffd-48f4-9976-b6ab857536e6 => generated 1564 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:17:09.004671 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-7b995817-d437-4e22-b1b9-e5f689fcfc0e tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:17:09.005817 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-7b995817-d437-4e22-b1b9-e5f689fcfc0e tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] [instance: 5c4b1243-8ffd-48f4-9976-b6ab857536e6] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:17:09.013041 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7b995817-d437-4e22-b1b9-e5f689fcfc0e tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:17:09.013776 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7b995817-d437-4e22-b1b9-e5f689fcfc0e tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:17:09.014227 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7b995817-d437-4e22-b1b9-e5f689fcfc0e tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:17:09.014978 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7b995817-d437-4e22-b1b9-e5f689fcfc0e tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:17:09.015447 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7b995817-d437-4e22-b1b9-e5f689fcfc0e tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:17:09.015885 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7b995817-d437-4e22-b1b9-e5f689fcfc0e tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:17:09.067576 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-da724d99-66c0-405c-9eb5-d1cebc2b29b9 req-4cb614e1-1922-4728-af62-5a0b592b710b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c4b1243-8ffd-48f4-9976-b6ab857536e6", "tag": "89915f52-e081-4707-ab59-56d072882447"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 23:17:09.082517 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-da724d99-66c0-405c-9eb5-d1cebc2b29b9 req-4cb614e1-1922-4728-af62-5a0b592b710b service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:17:09.082678 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-da724d99-66c0-405c-9eb5-d1cebc2b29b9 req-4cb614e1-1922-4728-af62-5a0b592b710b service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:17:09.083124 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-da724d99-66c0-405c-9eb5-d1cebc2b29b9 req-4cb614e1-1922-4728-af62-5a0b592b710b service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:17:09.095685 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-da724d99-66c0-405c-9eb5-d1cebc2b29b9 req-4cb614e1-1922-4728-af62-5a0b592b710b service nova] Creating event network-changed:89915f52-e081-4707-ab59-56d072882447 for instance 5c4b1243-8ffd-48f4-9976-b6ab857536e6 on n-h1-860284-1 Oct 04 23:17:09.100730 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-da724d99-66c0-405c-9eb5-d1cebc2b29b9 req-4cb614e1-1922-4728-af62-5a0b592b710b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104535 Oct 04 23:17:09.101662 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4342/7860] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 23:17:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 23:17:09.207684 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-7b995817-d437-4e22-b1b9-e5f689fcfc0e tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7124fd831f0d4ce8b561d79639b5f272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339847fffad841c59cd6f9e3439eb420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:17:09.216954 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-7b995817-d437-4e22-b1b9-e5f689fcfc0e tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] 10.222.0.43 "GET /compute/v2.1/servers/5c4b1243-8ffd-48f4-9976-b6ab857536e6" status: 200 len: 1564 microversion: 2.1 time: 0.223365 Oct 04 23:17:09.217888 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3519/7861] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:17:08 2022] GET /compute/v2.1/servers/5c4b1243-8ffd-48f4-9976-b6ab857536e6 => generated 1564 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:17:44.514353 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:17:44.515134 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=40 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:17:44.566670 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-4f7e93b4-3078-4217-be06-92e990c7426b tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 23:17:44.568992 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-4f7e93b4-3078-4217-be06-92e990c7426b tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] [instance: 5c4b1243-8ffd-48f4-9976-b6ab857536e6] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:17:44.576114 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4f7e93b4-3078-4217-be06-92e990c7426b tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:17:44.576678 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4f7e93b4-3078-4217-be06-92e990c7426b tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:17:44.577132 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4f7e93b4-3078-4217-be06-92e990c7426b tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:17:44.577835 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4f7e93b4-3078-4217-be06-92e990c7426b tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:17:44.578309 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4f7e93b4-3078-4217-be06-92e990c7426b tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:17:44.579681 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4f7e93b4-3078-4217-be06-92e990c7426b tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:17:44.635292 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-4f7e93b4-3078-4217-be06-92e990c7426b tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] 10.222.0.43 "POST /compute/v2.1/servers/5c4b1243-8ffd-48f4-9976-b6ab857536e6/action" status: 200 len: 24572 microversion: 2.1 time: 0.123425 Oct 04 23:17:44.635945 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4343/7862] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 23:17:44 2022] POST /compute/v2.1/servers/5c4b1243-8ffd-48f4-9976-b6ab857536e6/action => generated 24572 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 23:18:23.398974 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:18:23.400411 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=40 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:18:23.406015 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-7c409fac-8525-401c-b6b3-dcbc11e797cb tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 23:18:23.408344 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-7c409fac-8525-401c-b6b3-dcbc11e797cb tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] [instance: 5c4b1243-8ffd-48f4-9976-b6ab857536e6] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:18:23.418015 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7c409fac-8525-401c-b6b3-dcbc11e797cb tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:18:23.418543 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7c409fac-8525-401c-b6b3-dcbc11e797cb tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:18:23.418995 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7c409fac-8525-401c-b6b3-dcbc11e797cb tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:18:23.419704 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7c409fac-8525-401c-b6b3-dcbc11e797cb tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:18:23.420167 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7c409fac-8525-401c-b6b3-dcbc11e797cb tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:18:23.420610 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7c409fac-8525-401c-b6b3-dcbc11e797cb tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:18:23.499749 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-7c409fac-8525-401c-b6b3-dcbc11e797cb tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '7124fd831f0d4ce8b561d79639b5f272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339847fffad841c59cd6f9e3439eb420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:18:23.505918 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-7c409fac-8525-401c-b6b3-dcbc11e797cb tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] [instance: 5c4b1243-8ffd-48f4-9976-b6ab857536e6] Old instance type m1.heat2, new instance type m1.heat {{(pid=134102) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 04 23:18:23.513432 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-7c409fac-8525-401c-b6b3-dcbc11e797cb tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Flavor limits 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 23:18:23.513852 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-7c409fac-8525-401c-b6b3-dcbc11e797cb tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Image limits 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 23:18:23.514324 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-7c409fac-8525-401c-b6b3-dcbc11e797cb tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Flavor pref 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 23:18:23.514763 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-7c409fac-8525-401c-b6b3-dcbc11e797cb tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Image pref 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 23:18:23.515171 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-7c409fac-8525-401c-b6b3-dcbc11e797cb tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 23:18:23.580159 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-7c409fac-8525-401c-b6b3-dcbc11e797cb tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] 10.222.0.43 "POST /compute/v2.1/servers/5c4b1243-8ffd-48f4-9976-b6ab857536e6/action" status: 202 len: 0 microversion: 2.1 time: 0.183132 Oct 04 23:18:23.580779 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3520/7863] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 23:18:23 2022] POST /compute/v2.1/servers/5c4b1243-8ffd-48f4-9976-b6ab857536e6/action => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 23:18:23.589943 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-a57fbbeb-957c-4804-aa21-71e6dfe6fd63 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:18:23.590746 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-a57fbbeb-957c-4804-aa21-71e6dfe6fd63 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] [instance: 5c4b1243-8ffd-48f4-9976-b6ab857536e6] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:18:23.593068 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=2 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:18:23.593749 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=4 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:18:23.601189 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a57fbbeb-957c-4804-aa21-71e6dfe6fd63 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:18:23.601700 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a57fbbeb-957c-4804-aa21-71e6dfe6fd63 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:18:23.602510 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a57fbbeb-957c-4804-aa21-71e6dfe6fd63 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:18:23.603799 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a57fbbeb-957c-4804-aa21-71e6dfe6fd63 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:18:23.604425 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a57fbbeb-957c-4804-aa21-71e6dfe6fd63 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:18:23.604846 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a57fbbeb-957c-4804-aa21-71e6dfe6fd63 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:18:23.779475 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-a57fbbeb-957c-4804-aa21-71e6dfe6fd63 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7124fd831f0d4ce8b561d79639b5f272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339847fffad841c59cd6f9e3439eb420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:18:23.792086 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-a57fbbeb-957c-4804-aa21-71e6dfe6fd63 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] 10.222.0.43 "GET /compute/v2.1/servers/5c4b1243-8ffd-48f4-9976-b6ab857536e6" status: 200 len: 1692 microversion: 2.1 time: 0.206703 Oct 04 23:18:23.793002 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4344/7864] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:18:23 2022] GET /compute/v2.1/servers/5c4b1243-8ffd-48f4-9976-b6ab857536e6 => generated 1692 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:18:24.819251 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-1f593145-94ba-475b-b20c-60c743575c70 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:18:24.819850 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-1f593145-94ba-475b-b20c-60c743575c70 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] [instance: 5c4b1243-8ffd-48f4-9976-b6ab857536e6] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:18:24.826410 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1f593145-94ba-475b-b20c-60c743575c70 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:18:24.826898 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1f593145-94ba-475b-b20c-60c743575c70 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:18:24.827335 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1f593145-94ba-475b-b20c-60c743575c70 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:18:24.828024 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1f593145-94ba-475b-b20c-60c743575c70 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:18:24.828478 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1f593145-94ba-475b-b20c-60c743575c70 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:18:24.828902 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1f593145-94ba-475b-b20c-60c743575c70 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:18:24.960692 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-1f593145-94ba-475b-b20c-60c743575c70 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7124fd831f0d4ce8b561d79639b5f272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339847fffad841c59cd6f9e3439eb420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:18:24.969003 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-1f593145-94ba-475b-b20c-60c743575c70 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] 10.222.0.43 "GET /compute/v2.1/servers/5c4b1243-8ffd-48f4-9976-b6ab857536e6" status: 200 len: 1692 microversion: 2.1 time: 0.154796 Oct 04 23:18:24.969583 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3521/7865] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:18:24 2022] GET /compute/v2.1/servers/5c4b1243-8ffd-48f4-9976-b6ab857536e6 => generated 1692 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:18:25.992501 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-a4227e02-d6c8-472a-83f6-3aa9699b7715 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:18:25.993737 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-a4227e02-d6c8-472a-83f6-3aa9699b7715 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] [instance: 5c4b1243-8ffd-48f4-9976-b6ab857536e6] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:18:26.001711 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a4227e02-d6c8-472a-83f6-3aa9699b7715 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:18:26.002211 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a4227e02-d6c8-472a-83f6-3aa9699b7715 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:18:26.002697 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a4227e02-d6c8-472a-83f6-3aa9699b7715 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:18:26.003409 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a4227e02-d6c8-472a-83f6-3aa9699b7715 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:18:26.003885 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a4227e02-d6c8-472a-83f6-3aa9699b7715 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:18:26.004330 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a4227e02-d6c8-472a-83f6-3aa9699b7715 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:18:26.141016 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-a4227e02-d6c8-472a-83f6-3aa9699b7715 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7124fd831f0d4ce8b561d79639b5f272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339847fffad841c59cd6f9e3439eb420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:18:26.148788 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-a4227e02-d6c8-472a-83f6-3aa9699b7715 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] 10.222.0.43 "GET /compute/v2.1/servers/5c4b1243-8ffd-48f4-9976-b6ab857536e6" status: 200 len: 1697 microversion: 2.1 time: 0.160299 Oct 04 23:18:26.149386 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4345/7866] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:18:25 2022] GET /compute/v2.1/servers/5c4b1243-8ffd-48f4-9976-b6ab857536e6 => generated 1697 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:18:27.172165 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-ec07d93f-7fd0-44d1-b070-8b012754af15 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:18:27.172787 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-ec07d93f-7fd0-44d1-b070-8b012754af15 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] [instance: 5c4b1243-8ffd-48f4-9976-b6ab857536e6] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:18:27.179700 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ec07d93f-7fd0-44d1-b070-8b012754af15 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:18:27.180197 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ec07d93f-7fd0-44d1-b070-8b012754af15 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:18:27.181354 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ec07d93f-7fd0-44d1-b070-8b012754af15 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:18:27.182078 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ec07d93f-7fd0-44d1-b070-8b012754af15 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:18:27.182580 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ec07d93f-7fd0-44d1-b070-8b012754af15 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:18:27.183020 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ec07d93f-7fd0-44d1-b070-8b012754af15 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:18:27.317292 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-ec07d93f-7fd0-44d1-b070-8b012754af15 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7124fd831f0d4ce8b561d79639b5f272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339847fffad841c59cd6f9e3439eb420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:18:27.325785 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-ec07d93f-7fd0-44d1-b070-8b012754af15 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] 10.222.0.43 "GET /compute/v2.1/servers/5c4b1243-8ffd-48f4-9976-b6ab857536e6" status: 200 len: 1697 microversion: 2.1 time: 0.157607 Oct 04 23:18:27.326397 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3522/7867] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:18:27 2022] GET /compute/v2.1/servers/5c4b1243-8ffd-48f4-9976-b6ab857536e6 => generated 1697 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:18:28.349625 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e62a7ab4-85a3-4b5a-9d8c-990cd1b93286 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:18:28.350260 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-e62a7ab4-85a3-4b5a-9d8c-990cd1b93286 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] [instance: 5c4b1243-8ffd-48f4-9976-b6ab857536e6] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:18:28.358085 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e62a7ab4-85a3-4b5a-9d8c-990cd1b93286 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:18:28.358620 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e62a7ab4-85a3-4b5a-9d8c-990cd1b93286 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:18:28.359084 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e62a7ab4-85a3-4b5a-9d8c-990cd1b93286 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:18:28.359796 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e62a7ab4-85a3-4b5a-9d8c-990cd1b93286 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:18:28.360271 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e62a7ab4-85a3-4b5a-9d8c-990cd1b93286 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:18:28.360718 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e62a7ab4-85a3-4b5a-9d8c-990cd1b93286 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:18:28.493763 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-e62a7ab4-85a3-4b5a-9d8c-990cd1b93286 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7124fd831f0d4ce8b561d79639b5f272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339847fffad841c59cd6f9e3439eb420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:18:28.501566 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-e62a7ab4-85a3-4b5a-9d8c-990cd1b93286 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] 10.222.0.43 "GET /compute/v2.1/servers/5c4b1243-8ffd-48f4-9976-b6ab857536e6" status: 200 len: 1697 microversion: 2.1 time: 0.156182 Oct 04 23:18:28.502544 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4346/7868] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:18:28 2022] GET /compute/v2.1/servers/5c4b1243-8ffd-48f4-9976-b6ab857536e6 => generated 1697 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:18:29.526699 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-ec5bfcf7-c0e0-413f-a155-f110d4df67f4 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:18:29.527321 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-ec5bfcf7-c0e0-413f-a155-f110d4df67f4 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] [instance: 5c4b1243-8ffd-48f4-9976-b6ab857536e6] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:18:29.534096 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ec5bfcf7-c0e0-413f-a155-f110d4df67f4 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:18:29.534619 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ec5bfcf7-c0e0-413f-a155-f110d4df67f4 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:18:29.535066 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ec5bfcf7-c0e0-413f-a155-f110d4df67f4 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:18:29.535780 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ec5bfcf7-c0e0-413f-a155-f110d4df67f4 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:18:29.536221 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ec5bfcf7-c0e0-413f-a155-f110d4df67f4 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:18:29.536651 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ec5bfcf7-c0e0-413f-a155-f110d4df67f4 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:18:29.669587 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-ec5bfcf7-c0e0-413f-a155-f110d4df67f4 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7124fd831f0d4ce8b561d79639b5f272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339847fffad841c59cd6f9e3439eb420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:18:29.677466 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-ec5bfcf7-c0e0-413f-a155-f110d4df67f4 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] 10.222.0.43 "GET /compute/v2.1/servers/5c4b1243-8ffd-48f4-9976-b6ab857536e6" status: 200 len: 1697 microversion: 2.1 time: 0.155191 Oct 04 23:18:29.678047 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3523/7869] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:18:29 2022] GET /compute/v2.1/servers/5c4b1243-8ffd-48f4-9976-b6ab857536e6 => generated 1697 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:18:30.701196 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-7c796727-4879-495b-b503-eef3a7bbac12 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:18:30.701852 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-7c796727-4879-495b-b503-eef3a7bbac12 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] [instance: 5c4b1243-8ffd-48f4-9976-b6ab857536e6] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:18:30.708637 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7c796727-4879-495b-b503-eef3a7bbac12 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:18:30.709135 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7c796727-4879-495b-b503-eef3a7bbac12 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:18:30.709584 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7c796727-4879-495b-b503-eef3a7bbac12 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:18:30.710287 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7c796727-4879-495b-b503-eef3a7bbac12 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:18:30.710785 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7c796727-4879-495b-b503-eef3a7bbac12 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:18:30.711229 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7c796727-4879-495b-b503-eef3a7bbac12 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:18:30.845680 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-7c796727-4879-495b-b503-eef3a7bbac12 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7124fd831f0d4ce8b561d79639b5f272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339847fffad841c59cd6f9e3439eb420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:18:30.854635 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-7c796727-4879-495b-b503-eef3a7bbac12 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] 10.222.0.43 "GET /compute/v2.1/servers/5c4b1243-8ffd-48f4-9976-b6ab857536e6" status: 200 len: 1697 microversion: 2.1 time: 0.157315 Oct 04 23:18:30.855218 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4347/7870] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:18:30 2022] GET /compute/v2.1/servers/5c4b1243-8ffd-48f4-9976-b6ab857536e6 => generated 1697 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 23:18:31.878961 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-32eca8fe-bdff-465f-8971-4fff051af76d tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:18:31.879577 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-32eca8fe-bdff-465f-8971-4fff051af76d tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] [instance: 5c4b1243-8ffd-48f4-9976-b6ab857536e6] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:18:31.886355 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-32eca8fe-bdff-465f-8971-4fff051af76d tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:18:31.886871 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-32eca8fe-bdff-465f-8971-4fff051af76d tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:18:31.887309 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-32eca8fe-bdff-465f-8971-4fff051af76d tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:18:31.887998 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-32eca8fe-bdff-465f-8971-4fff051af76d tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:18:31.888456 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-32eca8fe-bdff-465f-8971-4fff051af76d tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:18:31.888880 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-32eca8fe-bdff-465f-8971-4fff051af76d tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:18:32.017851 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-32eca8fe-bdff-465f-8971-4fff051af76d tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7124fd831f0d4ce8b561d79639b5f272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339847fffad841c59cd6f9e3439eb420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:18:32.026102 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-32eca8fe-bdff-465f-8971-4fff051af76d tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] 10.222.0.43 "GET /compute/v2.1/servers/5c4b1243-8ffd-48f4-9976-b6ab857536e6" status: 200 len: 1697 microversion: 2.1 time: 0.151124 Oct 04 23:18:32.026702 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3524/7871] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:18:31 2022] GET /compute/v2.1/servers/5c4b1243-8ffd-48f4-9976-b6ab857536e6 => generated 1697 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:18:33.050257 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-16fe5671-8e8e-434b-8a7b-4231f852e6cb tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:18:33.050925 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-16fe5671-8e8e-434b-8a7b-4231f852e6cb tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] [instance: 5c4b1243-8ffd-48f4-9976-b6ab857536e6] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:18:33.057566 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-16fe5671-8e8e-434b-8a7b-4231f852e6cb tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:18:33.058065 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-16fe5671-8e8e-434b-8a7b-4231f852e6cb tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:18:33.058546 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-16fe5671-8e8e-434b-8a7b-4231f852e6cb tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:18:33.059249 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-16fe5671-8e8e-434b-8a7b-4231f852e6cb tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:18:33.059716 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-16fe5671-8e8e-434b-8a7b-4231f852e6cb tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:18:33.060165 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-16fe5671-8e8e-434b-8a7b-4231f852e6cb tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:18:33.190171 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-16fe5671-8e8e-434b-8a7b-4231f852e6cb tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7124fd831f0d4ce8b561d79639b5f272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339847fffad841c59cd6f9e3439eb420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:18:33.198667 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-16fe5671-8e8e-434b-8a7b-4231f852e6cb tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] 10.222.0.43 "GET /compute/v2.1/servers/5c4b1243-8ffd-48f4-9976-b6ab857536e6" status: 200 len: 1697 microversion: 2.1 time: 0.152359 Oct 04 23:18:33.199241 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4348/7872] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:18:33 2022] GET /compute/v2.1/servers/5c4b1243-8ffd-48f4-9976-b6ab857536e6 => generated 1697 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:18:34.221852 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-e9d40a93-0ccd-4727-924b-06da8fed39fd tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:18:34.222519 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-e9d40a93-0ccd-4727-924b-06da8fed39fd tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] [instance: 5c4b1243-8ffd-48f4-9976-b6ab857536e6] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:18:34.230768 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e9d40a93-0ccd-4727-924b-06da8fed39fd tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:18:34.231267 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e9d40a93-0ccd-4727-924b-06da8fed39fd tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:18:34.231717 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e9d40a93-0ccd-4727-924b-06da8fed39fd tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:18:34.232432 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e9d40a93-0ccd-4727-924b-06da8fed39fd tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:18:34.232906 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e9d40a93-0ccd-4727-924b-06da8fed39fd tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:18:34.233344 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e9d40a93-0ccd-4727-924b-06da8fed39fd tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:18:34.391136 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-e9d40a93-0ccd-4727-924b-06da8fed39fd tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7124fd831f0d4ce8b561d79639b5f272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339847fffad841c59cd6f9e3439eb420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:18:34.399116 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-e9d40a93-0ccd-4727-924b-06da8fed39fd tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] 10.222.0.43 "GET /compute/v2.1/servers/5c4b1243-8ffd-48f4-9976-b6ab857536e6" status: 200 len: 1697 microversion: 2.1 time: 0.181296 Oct 04 23:18:34.399720 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3525/7873] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:18:34 2022] GET /compute/v2.1/servers/5c4b1243-8ffd-48f4-9976-b6ab857536e6 => generated 1697 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:18:35.424561 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-388d1bf2-4f3a-407a-bad0-5aa6e9049a85 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:18:35.425089 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-388d1bf2-4f3a-407a-bad0-5aa6e9049a85 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] [instance: 5c4b1243-8ffd-48f4-9976-b6ab857536e6] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:18:35.432725 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-388d1bf2-4f3a-407a-bad0-5aa6e9049a85 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:18:35.433224 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-388d1bf2-4f3a-407a-bad0-5aa6e9049a85 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:18:35.433682 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-388d1bf2-4f3a-407a-bad0-5aa6e9049a85 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:18:35.434414 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-388d1bf2-4f3a-407a-bad0-5aa6e9049a85 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:18:35.434893 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-388d1bf2-4f3a-407a-bad0-5aa6e9049a85 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:18:35.435341 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-388d1bf2-4f3a-407a-bad0-5aa6e9049a85 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:18:35.565415 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-388d1bf2-4f3a-407a-bad0-5aa6e9049a85 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7124fd831f0d4ce8b561d79639b5f272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339847fffad841c59cd6f9e3439eb420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:18:35.573484 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-388d1bf2-4f3a-407a-bad0-5aa6e9049a85 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] 10.222.0.43 "GET /compute/v2.1/servers/5c4b1243-8ffd-48f4-9976-b6ab857536e6" status: 200 len: 1697 microversion: 2.1 time: 0.152964 Oct 04 23:18:35.574070 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4349/7874] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:18:35 2022] GET /compute/v2.1/servers/5c4b1243-8ffd-48f4-9976-b6ab857536e6 => generated 1697 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:18:36.597317 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-9ae948fe-ae16-4832-9538-8b3744c39f9c tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:18:36.597968 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-9ae948fe-ae16-4832-9538-8b3744c39f9c tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] [instance: 5c4b1243-8ffd-48f4-9976-b6ab857536e6] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:18:36.605392 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9ae948fe-ae16-4832-9538-8b3744c39f9c tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:18:36.605882 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9ae948fe-ae16-4832-9538-8b3744c39f9c tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:18:36.606328 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9ae948fe-ae16-4832-9538-8b3744c39f9c tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:18:36.607054 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9ae948fe-ae16-4832-9538-8b3744c39f9c tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:18:36.607518 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9ae948fe-ae16-4832-9538-8b3744c39f9c tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:18:36.607951 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9ae948fe-ae16-4832-9538-8b3744c39f9c tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:18:36.737747 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-9ae948fe-ae16-4832-9538-8b3744c39f9c tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7124fd831f0d4ce8b561d79639b5f272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339847fffad841c59cd6f9e3439eb420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:18:36.746032 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-9ae948fe-ae16-4832-9538-8b3744c39f9c tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] 10.222.0.43 "GET /compute/v2.1/servers/5c4b1243-8ffd-48f4-9976-b6ab857536e6" status: 200 len: 1697 microversion: 2.1 time: 0.152801 Oct 04 23:18:36.746659 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3526/7875] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:18:36 2022] GET /compute/v2.1/servers/5c4b1243-8ffd-48f4-9976-b6ab857536e6 => generated 1697 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:18:37.770246 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-cb1364d9-b500-440b-b709-dcda8d7b0e7d tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:18:37.771041 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-cb1364d9-b500-440b-b709-dcda8d7b0e7d tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] [instance: 5c4b1243-8ffd-48f4-9976-b6ab857536e6] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:18:37.778477 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cb1364d9-b500-440b-b709-dcda8d7b0e7d tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:18:37.779020 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cb1364d9-b500-440b-b709-dcda8d7b0e7d tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:18:37.779583 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cb1364d9-b500-440b-b709-dcda8d7b0e7d tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:18:37.780269 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cb1364d9-b500-440b-b709-dcda8d7b0e7d tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:18:37.781819 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cb1364d9-b500-440b-b709-dcda8d7b0e7d tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:18:37.782836 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cb1364d9-b500-440b-b709-dcda8d7b0e7d tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:18:37.999487 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-cb1364d9-b500-440b-b709-dcda8d7b0e7d tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7124fd831f0d4ce8b561d79639b5f272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339847fffad841c59cd6f9e3439eb420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:18:38.007385 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-cb1364d9-b500-440b-b709-dcda8d7b0e7d tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] 10.222.0.43 "GET /compute/v2.1/servers/5c4b1243-8ffd-48f4-9976-b6ab857536e6" status: 200 len: 1696 microversion: 2.1 time: 0.242146 Oct 04 23:18:38.007969 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4350/7876] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:18:37 2022] GET /compute/v2.1/servers/5c4b1243-8ffd-48f4-9976-b6ab857536e6 => generated 1696 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:18:38.283215 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-1f1e2e4b-9511-4300-8b7d-b185078be9dc req-859107a8-dd14-48ef-8e5c-b93ce4deb005 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c4b1243-8ffd-48f4-9976-b6ab857536e6", "name": "network-vif-unplugged", "status": "completed", "tag": "89915f52-e081-4707-ab59-56d072882447"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 23:18:38.294560 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-1f1e2e4b-9511-4300-8b7d-b185078be9dc req-859107a8-dd14-48ef-8e5c-b93ce4deb005 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:18:38.295225 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-1f1e2e4b-9511-4300-8b7d-b185078be9dc req-859107a8-dd14-48ef-8e5c-b93ce4deb005 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:18:38.295796 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-1f1e2e4b-9511-4300-8b7d-b185078be9dc req-859107a8-dd14-48ef-8e5c-b93ce4deb005 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:18:38.312245 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-1f1e2e4b-9511-4300-8b7d-b185078be9dc req-859107a8-dd14-48ef-8e5c-b93ce4deb005 service nova] Creating event network-vif-unplugged:89915f52-e081-4707-ab59-56d072882447 for instance 5c4b1243-8ffd-48f4-9976-b6ab857536e6 on n-h2-860284-1 Oct 04 23:18:38.317599 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [req-1f1e2e4b-9511-4300-8b7d-b185078be9dc req-859107a8-dd14-48ef-8e5c-b93ce4deb005 service nova] Instance 5c4b1243-8ffd-48f4-9976-b6ab857536e6 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860284-1', 'n-h2-860284-1'} {{(pid=134102) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 23:18:38.328720 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-1f1e2e4b-9511-4300-8b7d-b185078be9dc req-859107a8-dd14-48ef-8e5c-b93ce4deb005 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049179 Oct 04 23:18:38.329639 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3527/7877] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 23:18:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 23:18:39.031968 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-1bb9a75b-7e68-43b4-b4fc-9315f131df2c tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:18:39.032604 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-1bb9a75b-7e68-43b4-b4fc-9315f131df2c tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] [instance: 5c4b1243-8ffd-48f4-9976-b6ab857536e6] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:18:39.043951 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1bb9a75b-7e68-43b4-b4fc-9315f131df2c tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:18:39.044521 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1bb9a75b-7e68-43b4-b4fc-9315f131df2c tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:18:39.046860 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1bb9a75b-7e68-43b4-b4fc-9315f131df2c tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:18:39.047633 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1bb9a75b-7e68-43b4-b4fc-9315f131df2c tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:18:39.048120 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1bb9a75b-7e68-43b4-b4fc-9315f131df2c tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:18:39.048573 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1bb9a75b-7e68-43b4-b4fc-9315f131df2c tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:18:39.278254 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-1bb9a75b-7e68-43b4-b4fc-9315f131df2c tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7124fd831f0d4ce8b561d79639b5f272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339847fffad841c59cd6f9e3439eb420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:18:39.286527 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-1bb9a75b-7e68-43b4-b4fc-9315f131df2c tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] 10.222.0.43 "GET /compute/v2.1/servers/5c4b1243-8ffd-48f4-9976-b6ab857536e6" status: 200 len: 1696 microversion: 2.1 time: 0.258725 Oct 04 23:18:39.287118 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4351/7878] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:18:39 2022] GET /compute/v2.1/servers/5c4b1243-8ffd-48f4-9976-b6ab857536e6 => generated 1696 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 23:18:40.312088 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-fff93ec9-685e-47a7-a966-fd174a8fc21e tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:18:40.312781 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-fff93ec9-685e-47a7-a966-fd174a8fc21e tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] [instance: 5c4b1243-8ffd-48f4-9976-b6ab857536e6] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:18:40.319194 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fff93ec9-685e-47a7-a966-fd174a8fc21e tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:18:40.319680 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fff93ec9-685e-47a7-a966-fd174a8fc21e tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:18:40.320113 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fff93ec9-685e-47a7-a966-fd174a8fc21e tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:18:40.321001 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fff93ec9-685e-47a7-a966-fd174a8fc21e tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:18:40.321410 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fff93ec9-685e-47a7-a966-fd174a8fc21e tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:18:40.321835 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fff93ec9-685e-47a7-a966-fd174a8fc21e tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:18:40.369100 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-e9127cda-5342-4107-b055-1617e889a734 req-930666cc-6534-47e2-8d88-3ab201cc1005 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c4b1243-8ffd-48f4-9976-b6ab857536e6", "tag": "89915f52-e081-4707-ab59-56d072882447"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 23:18:40.379434 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-e9127cda-5342-4107-b055-1617e889a734 req-930666cc-6534-47e2-8d88-3ab201cc1005 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:18:40.379932 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-e9127cda-5342-4107-b055-1617e889a734 req-930666cc-6534-47e2-8d88-3ab201cc1005 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:18:40.380386 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-e9127cda-5342-4107-b055-1617e889a734 req-930666cc-6534-47e2-8d88-3ab201cc1005 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:18:40.392788 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-e9127cda-5342-4107-b055-1617e889a734 req-930666cc-6534-47e2-8d88-3ab201cc1005 service nova] Creating event network-changed:89915f52-e081-4707-ab59-56d072882447 for instance 5c4b1243-8ffd-48f4-9976-b6ab857536e6 on n-h2-860284-1 Oct 04 23:18:40.398166 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [req-e9127cda-5342-4107-b055-1617e889a734 req-930666cc-6534-47e2-8d88-3ab201cc1005 service nova] Instance 5c4b1243-8ffd-48f4-9976-b6ab857536e6 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860284-1', 'n-h2-860284-1'} {{(pid=134101) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 23:18:40.409564 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-e9127cda-5342-4107-b055-1617e889a734 req-930666cc-6534-47e2-8d88-3ab201cc1005 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044739 Oct 04 23:18:40.410407 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4352/7879] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 23:18:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 23:18:40.490437 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-fff93ec9-685e-47a7-a966-fd174a8fc21e tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7124fd831f0d4ce8b561d79639b5f272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339847fffad841c59cd6f9e3439eb420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:18:40.498700 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-fff93ec9-685e-47a7-a966-fd174a8fc21e tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] 10.222.0.43 "GET /compute/v2.1/servers/5c4b1243-8ffd-48f4-9976-b6ab857536e6" status: 200 len: 1694 microversion: 2.1 time: 0.191800 Oct 04 23:18:40.499372 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3528/7880] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:18:40 2022] GET /compute/v2.1/servers/5c4b1243-8ffd-48f4-9976-b6ab857536e6 => generated 1694 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:18:41.524191 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-3c95838f-b397-4004-94b3-80c27ba91f88 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:18:41.524903 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-3c95838f-b397-4004-94b3-80c27ba91f88 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] [instance: 5c4b1243-8ffd-48f4-9976-b6ab857536e6] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:18:41.531103 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3c95838f-b397-4004-94b3-80c27ba91f88 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:18:41.531601 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3c95838f-b397-4004-94b3-80c27ba91f88 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:18:41.532052 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3c95838f-b397-4004-94b3-80c27ba91f88 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:18:41.532748 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3c95838f-b397-4004-94b3-80c27ba91f88 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:18:41.533211 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3c95838f-b397-4004-94b3-80c27ba91f88 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:18:41.533648 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-3c95838f-b397-4004-94b3-80c27ba91f88 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:18:41.669347 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-3c95838f-b397-4004-94b3-80c27ba91f88 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7124fd831f0d4ce8b561d79639b5f272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339847fffad841c59cd6f9e3439eb420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:18:41.677235 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-3c95838f-b397-4004-94b3-80c27ba91f88 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] 10.222.0.43 "GET /compute/v2.1/servers/5c4b1243-8ffd-48f4-9976-b6ab857536e6" status: 200 len: 1694 microversion: 2.1 time: 0.158147 Oct 04 23:18:41.677832 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4353/7881] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:18:41 2022] GET /compute/v2.1/servers/5c4b1243-8ffd-48f4-9976-b6ab857536e6 => generated 1694 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:18:42.701590 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-dfaa4cb4-fc1e-4da6-885c-b79631df9329 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:18:42.702204 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-dfaa4cb4-fc1e-4da6-885c-b79631df9329 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] [instance: 5c4b1243-8ffd-48f4-9976-b6ab857536e6] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:18:42.709099 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dfaa4cb4-fc1e-4da6-885c-b79631df9329 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:18:42.709586 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dfaa4cb4-fc1e-4da6-885c-b79631df9329 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:18:42.710024 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dfaa4cb4-fc1e-4da6-885c-b79631df9329 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:18:42.710748 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dfaa4cb4-fc1e-4da6-885c-b79631df9329 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:18:42.711228 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dfaa4cb4-fc1e-4da6-885c-b79631df9329 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:18:42.711800 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-dfaa4cb4-fc1e-4da6-885c-b79631df9329 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:18:42.849019 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-dfaa4cb4-fc1e-4da6-885c-b79631df9329 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7124fd831f0d4ce8b561d79639b5f272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339847fffad841c59cd6f9e3439eb420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:18:42.859016 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-dfaa4cb4-fc1e-4da6-885c-b79631df9329 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] 10.222.0.43 "GET /compute/v2.1/servers/5c4b1243-8ffd-48f4-9976-b6ab857536e6" status: 200 len: 1694 microversion: 2.1 time: 0.161614 Oct 04 23:18:42.859615 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3529/7882] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:18:42 2022] GET /compute/v2.1/servers/5c4b1243-8ffd-48f4-9976-b6ab857536e6 => generated 1694 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:18:43.882896 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-94661aa5-d842-46bd-84b5-d4688afd4ecf tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:18:43.883562 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-94661aa5-d842-46bd-84b5-d4688afd4ecf tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] [instance: 5c4b1243-8ffd-48f4-9976-b6ab857536e6] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:18:43.890631 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-94661aa5-d842-46bd-84b5-d4688afd4ecf tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:18:43.891137 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-94661aa5-d842-46bd-84b5-d4688afd4ecf tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:18:43.891599 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-94661aa5-d842-46bd-84b5-d4688afd4ecf tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:18:43.892318 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-94661aa5-d842-46bd-84b5-d4688afd4ecf tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:18:43.892792 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-94661aa5-d842-46bd-84b5-d4688afd4ecf tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:18:43.893242 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-94661aa5-d842-46bd-84b5-d4688afd4ecf tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:18:44.029540 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-94661aa5-d842-46bd-84b5-d4688afd4ecf tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7124fd831f0d4ce8b561d79639b5f272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339847fffad841c59cd6f9e3439eb420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:18:44.037298 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-94661aa5-d842-46bd-84b5-d4688afd4ecf tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] 10.222.0.43 "GET /compute/v2.1/servers/5c4b1243-8ffd-48f4-9976-b6ab857536e6" status: 200 len: 1691 microversion: 2.1 time: 0.158384 Oct 04 23:18:44.037874 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4354/7883] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:18:43 2022] GET /compute/v2.1/servers/5c4b1243-8ffd-48f4-9976-b6ab857536e6 => generated 1691 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:18:44.061630 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-edd10334-8a26-4b00-952a-e0288da03cb7 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 23:18:44.062168 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-edd10334-8a26-4b00-952a-e0288da03cb7 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] [instance: 5c4b1243-8ffd-48f4-9976-b6ab857536e6] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:18:44.068990 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-edd10334-8a26-4b00-952a-e0288da03cb7 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:18:44.069478 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-edd10334-8a26-4b00-952a-e0288da03cb7 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:18:44.069915 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-edd10334-8a26-4b00-952a-e0288da03cb7 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:18:44.070720 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-edd10334-8a26-4b00-952a-e0288da03cb7 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:18:44.071173 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-edd10334-8a26-4b00-952a-e0288da03cb7 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:18:44.071598 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-edd10334-8a26-4b00-952a-e0288da03cb7 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:18:44.135343 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-edd10334-8a26-4b00-952a-e0288da03cb7 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] 10.222.0.43 "POST /compute/v2.1/servers/5c4b1243-8ffd-48f4-9976-b6ab857536e6/action" status: 204 len: 0 microversion: 2.1 time: 0.077339 Oct 04 23:18:44.136447 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3530/7884] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 23:18:44 2022] POST /compute/v2.1/servers/5c4b1243-8ffd-48f4-9976-b6ab857536e6/action => generated 0 bytes in 79 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 23:18:44.144057 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-4fbd535a-a75f-4dbf-b4a3-56944af74175 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:18:44.144699 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-4fbd535a-a75f-4dbf-b4a3-56944af74175 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] [instance: 5c4b1243-8ffd-48f4-9976-b6ab857536e6] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:18:44.152235 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4fbd535a-a75f-4dbf-b4a3-56944af74175 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:18:44.153003 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4fbd535a-a75f-4dbf-b4a3-56944af74175 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:18:44.153429 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4fbd535a-a75f-4dbf-b4a3-56944af74175 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:18:44.154442 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4fbd535a-a75f-4dbf-b4a3-56944af74175 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:18:44.154944 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4fbd535a-a75f-4dbf-b4a3-56944af74175 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:18:44.155461 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4fbd535a-a75f-4dbf-b4a3-56944af74175 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:18:44.292689 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-4fbd535a-a75f-4dbf-b4a3-56944af74175 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7124fd831f0d4ce8b561d79639b5f272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339847fffad841c59cd6f9e3439eb420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:18:44.300952 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-4fbd535a-a75f-4dbf-b4a3-56944af74175 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] 10.222.0.43 "GET /compute/v2.1/servers/5c4b1243-8ffd-48f4-9976-b6ab857536e6" status: 200 len: 1691 microversion: 2.1 time: 0.160799 Oct 04 23:18:44.301578 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4355/7885] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:18:44 2022] GET /compute/v2.1/servers/5c4b1243-8ffd-48f4-9976-b6ab857536e6 => generated 1691 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:18:44.325624 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-af5a973b-2cdf-4b68-abb7-a58e02caad2a tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:18:44.326329 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-af5a973b-2cdf-4b68-abb7-a58e02caad2a tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] [instance: 5c4b1243-8ffd-48f4-9976-b6ab857536e6] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:18:44.332418 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-af5a973b-2cdf-4b68-abb7-a58e02caad2a tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:18:44.332926 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-af5a973b-2cdf-4b68-abb7-a58e02caad2a tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:18:44.333365 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-af5a973b-2cdf-4b68-abb7-a58e02caad2a tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:18:44.334047 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-af5a973b-2cdf-4b68-abb7-a58e02caad2a tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:18:44.334533 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-af5a973b-2cdf-4b68-abb7-a58e02caad2a tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:18:44.334953 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-af5a973b-2cdf-4b68-abb7-a58e02caad2a tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:18:44.553219 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-af5a973b-2cdf-4b68-abb7-a58e02caad2a tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7124fd831f0d4ce8b561d79639b5f272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339847fffad841c59cd6f9e3439eb420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:18:44.562717 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-af5a973b-2cdf-4b68-abb7-a58e02caad2a tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] 10.222.0.43 "GET /compute/v2.1/servers/5c4b1243-8ffd-48f4-9976-b6ab857536e6" status: 200 len: 1691 microversion: 2.1 time: 0.242227 Oct 04 23:18:44.563424 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3531/7886] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:18:44 2022] GET /compute/v2.1/servers/5c4b1243-8ffd-48f4-9976-b6ab857536e6 => generated 1691 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:18:45.587158 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-8d4ba48a-cb0e-4fd7-bdca-388a689ed36b tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:18:45.587783 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-8d4ba48a-cb0e-4fd7-bdca-388a689ed36b tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] [instance: 5c4b1243-8ffd-48f4-9976-b6ab857536e6] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:18:45.594786 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8d4ba48a-cb0e-4fd7-bdca-388a689ed36b tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:18:45.595284 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8d4ba48a-cb0e-4fd7-bdca-388a689ed36b tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:18:45.595734 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8d4ba48a-cb0e-4fd7-bdca-388a689ed36b tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:18:45.596430 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8d4ba48a-cb0e-4fd7-bdca-388a689ed36b tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:18:45.596896 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8d4ba48a-cb0e-4fd7-bdca-388a689ed36b tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:18:45.597335 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8d4ba48a-cb0e-4fd7-bdca-388a689ed36b tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:18:45.730539 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-8d4ba48a-cb0e-4fd7-bdca-388a689ed36b tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7124fd831f0d4ce8b561d79639b5f272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339847fffad841c59cd6f9e3439eb420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:18:45.738401 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-8d4ba48a-cb0e-4fd7-bdca-388a689ed36b tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] 10.222.0.43 "GET /compute/v2.1/servers/5c4b1243-8ffd-48f4-9976-b6ab857536e6" status: 200 len: 1683 microversion: 2.1 time: 0.155207 Oct 04 23:18:45.738984 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4356/7887] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:18:45 2022] GET /compute/v2.1/servers/5c4b1243-8ffd-48f4-9976-b6ab857536e6 => generated 1683 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:18:46.623483 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-c88bfa92-000a-48ef-8fa5-d35e6b5832e2 req-5972e8ba-b4f3-4c70-a243-04e3b69dd1fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c4b1243-8ffd-48f4-9976-b6ab857536e6", "name": "network-vif-plugged", "status": "completed", "tag": "89915f52-e081-4707-ab59-56d072882447"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 23:18:46.637642 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-c88bfa92-000a-48ef-8fa5-d35e6b5832e2 req-5972e8ba-b4f3-4c70-a243-04e3b69dd1fc service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:18:46.638146 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-c88bfa92-000a-48ef-8fa5-d35e6b5832e2 req-5972e8ba-b4f3-4c70-a243-04e3b69dd1fc service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:18:46.638962 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-c88bfa92-000a-48ef-8fa5-d35e6b5832e2 req-5972e8ba-b4f3-4c70-a243-04e3b69dd1fc service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:18:46.652259 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-c88bfa92-000a-48ef-8fa5-d35e6b5832e2 req-5972e8ba-b4f3-4c70-a243-04e3b69dd1fc service nova] Creating event network-vif-plugged:89915f52-e081-4707-ab59-56d072882447 for instance 5c4b1243-8ffd-48f4-9976-b6ab857536e6 on n-h2-860284-1 Oct 04 23:18:46.657811 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-c88bfa92-000a-48ef-8fa5-d35e6b5832e2 req-5972e8ba-b4f3-4c70-a243-04e3b69dd1fc service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038082 Oct 04 23:18:46.658909 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3532/7888] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 23:18:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 23:19:21.979860 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-577dd5c5-b4ec-4627-b02f-dd984de4f7be tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 23:19:21.982087 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-577dd5c5-b4ec-4627-b02f-dd984de4f7be tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] [instance: 5c4b1243-8ffd-48f4-9976-b6ab857536e6] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:19:21.984519 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=26 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:19:21.985202 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=76 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:19:21.991131 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-577dd5c5-b4ec-4627-b02f-dd984de4f7be tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:19:21.991641 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-577dd5c5-b4ec-4627-b02f-dd984de4f7be tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:19:21.992107 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-577dd5c5-b4ec-4627-b02f-dd984de4f7be tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:19:21.993051 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-577dd5c5-b4ec-4627-b02f-dd984de4f7be tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:19:21.993530 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-577dd5c5-b4ec-4627-b02f-dd984de4f7be tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:19:21.993984 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-577dd5c5-b4ec-4627-b02f-dd984de4f7be tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:19:22.067845 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-577dd5c5-b4ec-4627-b02f-dd984de4f7be tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] 10.222.0.43 "POST /compute/v2.1/servers/5c4b1243-8ffd-48f4-9976-b6ab857536e6/action" status: 200 len: 24577 microversion: 2.1 time: 0.092798 Oct 04 23:19:22.068486 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4357/7889] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 23:19:21 2022] POST /compute/v2.1/servers/5c4b1243-8ffd-48f4-9976-b6ab857536e6/action => generated 24577 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 23:19:53.404702 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_api:SELECT=30 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:19:53.406400 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:19:53.410312 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-e106fb54-0847-49dd-bfb4-059babac0ce5 req-7df79522-0bb8-4b9f-917e-0fa1c684a3c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c4b1243-8ffd-48f4-9976-b6ab857536e6", "tag": "89915f52-e081-4707-ab59-56d072882447"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 23:19:53.410942 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-95a4f2b1-8975-4372-b1bc-e61ab1e94efa tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:19:53.411545 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-95a4f2b1-8975-4372-b1bc-e61ab1e94efa tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] [instance: 5c4b1243-8ffd-48f4-9976-b6ab857536e6] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:19:53.417097 n-d-860284-1 devstack@n-api.service[134101]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 23:19:53.417281 n-d-860284-1 devstack@n-api.service[134101]: Tue Oct 4 23:19:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.43) !!! Oct 04 23:19:53.418687 n-d-860284-1 devstack@n-api.service[134101]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 23:19:53.418687 n-d-860284-1 devstack@n-api.service[134101]: Tue Oct 4 23:19:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.43) !!! Oct 04 23:19:53.419041 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-95a4f2b1-8975-4372-b1bc-e61ab1e94efa tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:19:53.419832 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-95a4f2b1-8975-4372-b1bc-e61ab1e94efa tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:19:53.419989 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=2 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:19:53.420090 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-95a4f2b1-8975-4372-b1bc-e61ab1e94efa tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:19:53.420310 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=4 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:19:53.420969 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-95a4f2b1-8975-4372-b1bc-e61ab1e94efa tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:19:53.422231 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-95a4f2b1-8975-4372-b1bc-e61ab1e94efa tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:19:53.422629 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-95a4f2b1-8975-4372-b1bc-e61ab1e94efa tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:19:53.433143 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-e106fb54-0847-49dd-bfb4-059babac0ce5 req-7df79522-0bb8-4b9f-917e-0fa1c684a3c4 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:19:53.433657 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-e106fb54-0847-49dd-bfb4-059babac0ce5 req-7df79522-0bb8-4b9f-917e-0fa1c684a3c4 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:19:53.434113 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-e106fb54-0847-49dd-bfb4-059babac0ce5 req-7df79522-0bb8-4b9f-917e-0fa1c684a3c4 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:19:53.451355 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-95a4f2b1-8975-4372-b1bc-e61ab1e94efa tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] [instance: 5c4b1243-8ffd-48f4-9976-b6ab857536e6] Going to try to terminate instance {{(pid=134102) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 23:19:53.452552 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-e106fb54-0847-49dd-bfb4-059babac0ce5 req-7df79522-0bb8-4b9f-917e-0fa1c684a3c4 service nova] Creating event network-changed:89915f52-e081-4707-ab59-56d072882447 for instance 5c4b1243-8ffd-48f4-9976-b6ab857536e6 on n-h2-860284-1 Oct 04 23:19:53.457551 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-e106fb54-0847-49dd-bfb4-059babac0ce5 req-7df79522-0bb8-4b9f-917e-0fa1c684a3c4 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052811 Oct 04 23:19:53.458406 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4358/7890] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 23:19:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 23:19:53.544595 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-95a4f2b1-8975-4372-b1bc-e61ab1e94efa tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] 10.222.0.43 "DELETE /compute/v2.1/servers/5c4b1243-8ffd-48f4-9976-b6ab857536e6" status: 204 len: 0 microversion: 2.1 time: 0.141516 Oct 04 23:19:53.546043 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3533/7891] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 23:19:53 2022] DELETE /compute/v2.1/servers/5c4b1243-8ffd-48f4-9976-b6ab857536e6 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 23:19:53.556096 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-f5e3fbe5-3387-4d4f-9fa3-f302a8f1cfb6 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:19:53.557083 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-f5e3fbe5-3387-4d4f-9fa3-f302a8f1cfb6 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] [instance: 5c4b1243-8ffd-48f4-9976-b6ab857536e6] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:19:53.564816 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f5e3fbe5-3387-4d4f-9fa3-f302a8f1cfb6 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:19:53.565324 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f5e3fbe5-3387-4d4f-9fa3-f302a8f1cfb6 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:19:53.565782 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f5e3fbe5-3387-4d4f-9fa3-f302a8f1cfb6 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:19:53.566540 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f5e3fbe5-3387-4d4f-9fa3-f302a8f1cfb6 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:19:53.567052 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f5e3fbe5-3387-4d4f-9fa3-f302a8f1cfb6 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:19:53.567501 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f5e3fbe5-3387-4d4f-9fa3-f302a8f1cfb6 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:19:53.769303 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-f5e3fbe5-3387-4d4f-9fa3-f302a8f1cfb6 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7124fd831f0d4ce8b561d79639b5f272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339847fffad841c59cd6f9e3439eb420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:19:53.777085 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-f5e3fbe5-3387-4d4f-9fa3-f302a8f1cfb6 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] 10.222.0.43 "GET /compute/v2.1/servers/5c4b1243-8ffd-48f4-9976-b6ab857536e6" status: 200 len: 1689 microversion: 2.1 time: 0.225785 Oct 04 23:19:53.777661 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4359/7892] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:19:53 2022] GET /compute/v2.1/servers/5c4b1243-8ffd-48f4-9976-b6ab857536e6 => generated 1689 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:19:54.802505 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-0a050d17-813f-40e6-9403-cec25dde1d32 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:19:54.803317 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-0a050d17-813f-40e6-9403-cec25dde1d32 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] [instance: 5c4b1243-8ffd-48f4-9976-b6ab857536e6] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:19:54.810818 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0a050d17-813f-40e6-9403-cec25dde1d32 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:19:54.811302 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0a050d17-813f-40e6-9403-cec25dde1d32 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:19:54.811857 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0a050d17-813f-40e6-9403-cec25dde1d32 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:19:54.812710 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0a050d17-813f-40e6-9403-cec25dde1d32 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:19:54.813168 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0a050d17-813f-40e6-9403-cec25dde1d32 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:19:54.813599 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0a050d17-813f-40e6-9403-cec25dde1d32 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:19:55.000246 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-0a050d17-813f-40e6-9403-cec25dde1d32 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7124fd831f0d4ce8b561d79639b5f272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339847fffad841c59cd6f9e3439eb420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:19:55.008348 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-0a050d17-813f-40e6-9403-cec25dde1d32 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] 10.222.0.43 "GET /compute/v2.1/servers/5c4b1243-8ffd-48f4-9976-b6ab857536e6" status: 200 len: 1689 microversion: 2.1 time: 0.210742 Oct 04 23:19:55.008946 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3534/7893] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:19:54 2022] GET /compute/v2.1/servers/5c4b1243-8ffd-48f4-9976-b6ab857536e6 => generated 1689 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 23:19:55.935035 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-040ab914-43b9-40fa-8250-74d2d105be46 req-8651da9b-9b39-4bb3-a424-2cd3698087a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c4b1243-8ffd-48f4-9976-b6ab857536e6", "name": "network-vif-deleted", "tag": "89915f52-e081-4707-ab59-56d072882447"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 23:19:55.946584 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-040ab914-43b9-40fa-8250-74d2d105be46 req-8651da9b-9b39-4bb3-a424-2cd3698087a3 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:19:55.947084 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-040ab914-43b9-40fa-8250-74d2d105be46 req-8651da9b-9b39-4bb3-a424-2cd3698087a3 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:19:55.947524 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-040ab914-43b9-40fa-8250-74d2d105be46 req-8651da9b-9b39-4bb3-a424-2cd3698087a3 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:19:55.961906 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-040ab914-43b9-40fa-8250-74d2d105be46 req-8651da9b-9b39-4bb3-a424-2cd3698087a3 service nova] Creating event network-vif-deleted:89915f52-e081-4707-ab59-56d072882447 for instance 5c4b1243-8ffd-48f4-9976-b6ab857536e6 on n-h2-860284-1 Oct 04 23:19:55.967327 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-040ab914-43b9-40fa-8250-74d2d105be46 req-8651da9b-9b39-4bb3-a424-2cd3698087a3 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035822 Oct 04 23:19:55.969491 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4360/7894] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 23:19:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 23:19:56.033169 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-779b2ed2-ae76-4837-9b56-44390e12c994 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:19:56.033791 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-779b2ed2-ae76-4837-9b56-44390e12c994 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] [instance: 5c4b1243-8ffd-48f4-9976-b6ab857536e6] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:19:56.040869 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-779b2ed2-ae76-4837-9b56-44390e12c994 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:19:56.041358 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-779b2ed2-ae76-4837-9b56-44390e12c994 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:19:56.041804 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-779b2ed2-ae76-4837-9b56-44390e12c994 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:19:56.042538 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-779b2ed2-ae76-4837-9b56-44390e12c994 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:19:56.043002 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-779b2ed2-ae76-4837-9b56-44390e12c994 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:19:56.043437 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-779b2ed2-ae76-4837-9b56-44390e12c994 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:19:56.077306 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-779b2ed2-ae76-4837-9b56-44390e12c994 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:19:56.077811 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-779b2ed2-ae76-4837-9b56-44390e12c994 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:19:56.078960 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-779b2ed2-ae76-4837-9b56-44390e12c994 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:19:56.079412 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.objects.instance [None req-779b2ed2-ae76-4837-9b56-44390e12c994 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lazy-loading 'fault' on Instance uuid 5c4b1243-8ffd-48f4-9976-b6ab857536e6 {{(pid=134102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 23:19:56.122093 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-779b2ed2-ae76-4837-9b56-44390e12c994 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7124fd831f0d4ce8b561d79639b5f272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339847fffad841c59cd6f9e3439eb420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:19:56.130791 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-779b2ed2-ae76-4837-9b56-44390e12c994 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] 10.222.0.43 "GET /compute/v2.1/servers/5c4b1243-8ffd-48f4-9976-b6ab857536e6" status: 200 len: 1355 microversion: 2.1 time: 0.102166 Oct 04 23:19:56.143250 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3535/7895] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:19:56 2022] GET /compute/v2.1/servers/5c4b1243-8ffd-48f4-9976-b6ab857536e6 => generated 1355 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:19:57.156659 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-582855a0-be00-466b-bd43-03a610cdcd94 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:19:57.157370 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-582855a0-be00-466b-bd43-03a610cdcd94 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] [instance: 5c4b1243-8ffd-48f4-9976-b6ab857536e6] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:19:57.163596 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-582855a0-be00-466b-bd43-03a610cdcd94 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:19:57.164091 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-582855a0-be00-466b-bd43-03a610cdcd94 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:19:57.164543 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-582855a0-be00-466b-bd43-03a610cdcd94 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:19:57.165247 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-582855a0-be00-466b-bd43-03a610cdcd94 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:19:57.165712 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-582855a0-be00-466b-bd43-03a610cdcd94 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:19:57.166152 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-582855a0-be00-466b-bd43-03a610cdcd94 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:19:57.179647 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-582855a0-be00-466b-bd43-03a610cdcd94 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] HTTP exception thrown: Instance 5c4b1243-8ffd-48f4-9976-b6ab857536e6 could not be found. Oct 04 23:19:57.181247 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-582855a0-be00-466b-bd43-03a610cdcd94 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Request method failure captured: Oct 04 23:19:57.181247 n-d-860284-1 devstack@n-api.service[134101]: request: GET /compute/v2.1/servers/5c4b1243-8ffd-48f4-9976-b6ab857536e6 HTTP/1.1 Oct 04 23:19:57.181247 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 23:19:57.181247 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 23:19:57.181247 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 23:19:57.181247 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 23:19:57.181247 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 23:19:57.181247 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 23:19:57.181247 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 23:19:57.181247 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 23:19:57.181247 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPL3PV1P3eiBng-eyftmazLIMFOGhxgvlJE5kLv8qSAxeZ7nw7JEQcBo6uebpFaCmIciYVzYahs6GheYsSkJ64LI0k5-JJiivZ7ZQcPNIUVS-FFaLcyFAAb-8gYSuTYUwgQIpyTivuP6QEOS5wIqgxRi6U8ltOJnUssrNHH8u3ZtbLbs Oct 04 23:19:57.181247 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 23:19:57.181247 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 23:19:57.181247 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 23:19:57.181247 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 23:19:57.181247 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 23:19:57.181247 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 23:19:57.181247 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: 339847fffad841c59cd6f9e3439eb420 Oct 04 23:19:57.181247 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-217321805 Oct 04 23:19:57.181247 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 23:19:57.181247 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 23:19:57.181247 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/339847fffad841c59cd6f9e3439eb420"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_339847fffad841c59cd6f9e3439eb420", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/339847fffad841c59cd6f9e3439eb420"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/339847fffad841c59cd6f9e3439eb420"}]}] Oct 04 23:19:57.181247 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-TestNetworkAdvancedServerOps-217321805 Oct 04 23:19:57.181247 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: 339847fffad841c59cd6f9e3439eb420 Oct 04 23:19:57.181247 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-217321805 Oct 04 23:19:57.181247 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-TestNetworkAdvancedServerOps-217321805-project Oct 04 23:19:57.181247 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 23:19:57.181247 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 23:19:57.181247 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 7124fd831f0d4ce8b561d79639b5f272 Oct 04 23:19:57.181247 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-TestNetworkAdvancedServerOps-217321805-project Oct 04 23:19:57.181247 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 23:19:57.181247 n-d-860284-1 devstack@n-api.service[134101]: exception: Instance 5c4b1243-8ffd-48f4-9976-b6ab857536e6 could not be found. Oct 04 23:19:57.181247 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': '5c4b1243-8ffd-48f4-9976-b6ab857536e6'} Oct 04 23:19:57.181247 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 23:19:57.181247 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 23:19:57.181247 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 23:19:57.181247 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 23:19:57.181247 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 23:19:57.181247 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 23:19:57.181247 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 23:19:57.181247 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 23:19:57.181247 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 23:19:57.181247 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 23:19:57.181247 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c4b1243-8ffd-48f4-9976-b6ab857536e6 could not be found. Oct 04 23:19:57.181247 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 23:19:57.181247 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 23:19:57.181247 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 23:19:57.181247 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 23:19:57.181247 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 23:19:57.181247 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 23:19:57.181247 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 23:19:57.181247 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 23:19:57.181247 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 23:19:57.181247 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 23:19:57.181247 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 23:19:57.181247 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 23:19:57.181247 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 23:19:57.181247 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 23:19:57.181247 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 23:19:57.181247 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 23:19:57.181247 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c4b1243-8ffd-48f4-9976-b6ab857536e6 could not be found. Oct 04 23:19:57.181247 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 23:19:57.181247 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 23:19:57.186326 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 23:19:57.186326 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 23:19:57.186326 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 23:19:57.186326 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 23:19:57.186326 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 23:19:57.186326 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 23:19:57.186326 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c4b1243-8ffd-48f4-9976-b6ab857536e6 could not be found. Oct 04 23:19:57.186326 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 23:19:57.186326 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-582855a0-be00-466b-bd43-03a610cdcd94 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Returning 404 to user: Instance 5c4b1243-8ffd-48f4-9976-b6ab857536e6 could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 23:19:57.186326 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-582855a0-be00-466b-bd43-03a610cdcd94 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] 10.222.0.43 "GET /compute/v2.1/servers/5c4b1243-8ffd-48f4-9976-b6ab857536e6" status: 404 len: 111 microversion: 2.1 time: 0.031220 Oct 04 23:19:57.186326 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4361/7896] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:19:57 2022] GET /compute/v2.1/servers/5c4b1243-8ffd-48f4-9976-b6ab857536e6 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 23:20:00.517049 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-62112b11-86cf-43aa-82fb-1444a01a0fe2 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Calling method '.version_select at 0x7fbb2e6f2040>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:20:00.521702 n-d-860284-1 devstack@n-api.service[134102]: ERROR oslo.messaging._drivers.impl_rabbit [None req-62112b11-86cf-43aa-82fb-1444a01a0fe2 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] [cca57954-a89d-4bbd-8f41-b6cb754a5397] AMQP server on 10.222.0.43:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 23:20:01.529982 n-d-860284-1 devstack@n-api.service[134102]: INFO oslo.messaging._drivers.impl_rabbit [None req-62112b11-86cf-43aa-82fb-1444a01a0fe2 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] [cca57954-a89d-4bbd-8f41-b6cb754a5397] Reconnected to AMQP server on 10.222.0.43:5672 via [amqp] client with port 39664. Oct 04 23:20:01.551304 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-62112b11-86cf-43aa-82fb-1444a01a0fe2 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-46637147" status: 202 len: 0 microversion: 2.1 time: 1.038963 Oct 04 23:20:01.551902 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3536/7897] 10.222.0.43 () {58 vars in 1278 bytes} [Tue Oct 4 23:20:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-46637147 => generated 0 bytes in 1040 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 23:20:01.583155 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-df2427b4-734f-491d-a188-cc4a1866772b tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Action: 'create', calling method: .version_select at 0x7fbb2e330b80>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-257838368", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNshhY/asLFsCUJR08cG0QjGWRyl1oHEF6Rl+kUDhAIaFUvTT6R9yNIMxebE2obXeRIKRoCHIZU1Jv/mweoqMYGDRJCI6Ey9pEarUSTi7rlUS6EXB7ZQ6MQhYBhV4UoNmA=="}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 23:20:01.600323 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-df2427b4-734f-491d-a188-cc4a1866772b tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Getting quotas for project 339847fffad841c59cd6f9e3439eb420. Resources: {'key_pairs'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 23:20:01.606926 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-df2427b4-734f-491d-a188-cc4a1866772b tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Getting quotas for user 7124fd831f0d4ce8b561d79639b5f272 and project 339847fffad841c59cd6f9e3439eb420. Resources: {'key_pairs'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 23:20:01.633746 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-df2427b4-734f-491d-a188-cc4a1866772b tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.054643 Oct 04 23:20:01.634343 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4362/7898] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Oct 4 23:20:01 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 23:20:07.103368 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:20:07.108417 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-0a04300c-1750-497d-97cd-7ac28821c776 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-655702827", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452", "networks": [{"uuid": "5fcb032e-bf38-4a3c-a7ec-1f1ab6af0ea2"}], "key_name": "tempest-TestNetworkAdvancedServerOps-257838368", "security_groups": [{"name": "tempest-secgroup-smoke-2111420625"}]}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 23:20:07.242674 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.network.neutron [None req-0a04300c-1750-497d-97cd-7ac28821c776 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] validate_networks() for [('5fcb032e-bf38-4a3c-a7ec-1f1ab6af0ea2', None, None, None, None, None)] {{(pid=134102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 23:20:07.774602 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-0a04300c-1750-497d-97cd-7ac28821c776 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Flavor limits 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 23:20:07.774951 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-0a04300c-1750-497d-97cd-7ac28821c776 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Image limits 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 23:20:07.775436 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-0a04300c-1750-497d-97cd-7ac28821c776 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Flavor pref 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 23:20:07.775853 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-0a04300c-1750-497d-97cd-7ac28821c776 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Image pref 0:0:0 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 23:20:07.776267 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.virt.hardware [None req-0a04300c-1750-497d-97cd-7ac28821c776 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 23:20:07.788612 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0a04300c-1750-497d-97cd-7ac28821c776 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:20:07.789638 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0a04300c-1750-497d-97cd-7ac28821c776 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:20:07.790261 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0a04300c-1750-497d-97cd-7ac28821c776 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:20:07.791247 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0a04300c-1750-497d-97cd-7ac28821c776 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:20:07.791899 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0a04300c-1750-497d-97cd-7ac28821c776 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:20:07.792549 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0a04300c-1750-497d-97cd-7ac28821c776 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:20:07.814858 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-0a04300c-1750-497d-97cd-7ac28821c776 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Getting quotas for project 339847fffad841c59cd6f9e3439eb420. Resources: {'instances', 'ram', 'cores'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 23:20:07.824136 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-0a04300c-1750-497d-97cd-7ac28821c776 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Getting quotas for user 7124fd831f0d4ce8b561d79639b5f272 and project 339847fffad841c59cd6f9e3439eb420. Resources: {'instances', 'ram', 'cores'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 23:20:07.844021 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-0a04300c-1750-497d-97cd-7ac28821c776 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Going to run 1 instances... {{(pid=134102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 23:20:07.846928 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-0a04300c-1750-497d-97cd-7ac28821c776 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] [instance: 71ada3dc-3049-48c0-bace-e9560924732e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='58548514-5dac-426c-81f5-19e3fba33e23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 23:20:07.907558 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-0a04300c-1750-497d-97cd-7ac28821c776 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.806361 Oct 04 23:20:07.908506 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3537/7899] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 23:20:07 2022] POST /compute/v2.1/servers => generated 406 bytes in 809 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 23:20:07.918568 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=12 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:20:07.924182 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-40ec7f13-e1c6-4d4e-8ebf-ce9fbb2ba0af tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:20:07.924911 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-40ec7f13-e1c6-4d4e-8ebf-ce9fbb2ba0af tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] [instance: 71ada3dc-3049-48c0-bace-e9560924732e] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:20:08.016565 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-40ec7f13-e1c6-4d4e-8ebf-ce9fbb2ba0af tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7124fd831f0d4ce8b561d79639b5f272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339847fffad841c59cd6f9e3439eb420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:20:08.025769 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-40ec7f13-e1c6-4d4e-8ebf-ce9fbb2ba0af tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] 10.222.0.43 "GET /compute/v2.1/servers/71ada3dc-3049-48c0-bace-e9560924732e" status: 200 len: 1265 microversion: 2.1 time: 0.109311 Oct 04 23:20:08.027027 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4363/7900] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:20:07 2022] GET /compute/v2.1/servers/71ada3dc-3049-48c0-bace-e9560924732e => generated 1265 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:20:09.052214 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-1bc9b2a3-40df-46b1-ace0-05533ccbb72b tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:20:09.052681 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-1bc9b2a3-40df-46b1-ace0-05533ccbb72b tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] [instance: 71ada3dc-3049-48c0-bace-e9560924732e] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:20:09.061001 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1bc9b2a3-40df-46b1-ace0-05533ccbb72b tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:20:09.062348 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1bc9b2a3-40df-46b1-ace0-05533ccbb72b tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:20:09.062930 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1bc9b2a3-40df-46b1-ace0-05533ccbb72b tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:20:09.063680 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1bc9b2a3-40df-46b1-ace0-05533ccbb72b tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:20:09.064146 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1bc9b2a3-40df-46b1-ace0-05533ccbb72b tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:20:09.064578 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1bc9b2a3-40df-46b1-ace0-05533ccbb72b tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:20:09.134590 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-1bc9b2a3-40df-46b1-ace0-05533ccbb72b tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7124fd831f0d4ce8b561d79639b5f272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339847fffad841c59cd6f9e3439eb420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:20:09.142937 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-1bc9b2a3-40df-46b1-ace0-05533ccbb72b tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] 10.222.0.43 "GET /compute/v2.1/servers/71ada3dc-3049-48c0-bace-e9560924732e" status: 200 len: 1269 microversion: 2.1 time: 0.095456 Oct 04 23:20:09.143572 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3538/7901] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:20:09 2022] GET /compute/v2.1/servers/71ada3dc-3049-48c0-bace-e9560924732e => generated 1269 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:20:10.166509 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-1690cb94-35e0-45a2-b67d-e835798640a5 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:20:10.167350 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-1690cb94-35e0-45a2-b67d-e835798640a5 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] [instance: 71ada3dc-3049-48c0-bace-e9560924732e] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:20:10.175048 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1690cb94-35e0-45a2-b67d-e835798640a5 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:20:10.175925 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1690cb94-35e0-45a2-b67d-e835798640a5 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:20:10.176621 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1690cb94-35e0-45a2-b67d-e835798640a5 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:20:10.177491 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1690cb94-35e0-45a2-b67d-e835798640a5 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:20:10.178462 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1690cb94-35e0-45a2-b67d-e835798640a5 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:20:10.179315 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1690cb94-35e0-45a2-b67d-e835798640a5 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:20:10.267931 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-1690cb94-35e0-45a2-b67d-e835798640a5 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7124fd831f0d4ce8b561d79639b5f272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339847fffad841c59cd6f9e3439eb420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:20:10.276425 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-1690cb94-35e0-45a2-b67d-e835798640a5 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] 10.222.0.43 "GET /compute/v2.1/servers/71ada3dc-3049-48c0-bace-e9560924732e" status: 200 len: 1325 microversion: 2.1 time: 0.113920 Oct 04 23:20:10.277367 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4364/7902] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:20:10 2022] GET /compute/v2.1/servers/71ada3dc-3049-48c0-bace-e9560924732e => generated 1325 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:20:11.300878 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-f9a3ba88-7f03-4c95-b882-0df79571b57b tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:20:11.301596 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-f9a3ba88-7f03-4c95-b882-0df79571b57b tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] [instance: 71ada3dc-3049-48c0-bace-e9560924732e] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:20:11.309370 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f9a3ba88-7f03-4c95-b882-0df79571b57b tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:20:11.310172 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f9a3ba88-7f03-4c95-b882-0df79571b57b tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:20:11.310812 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f9a3ba88-7f03-4c95-b882-0df79571b57b tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:20:11.312150 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f9a3ba88-7f03-4c95-b882-0df79571b57b tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:20:11.312622 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f9a3ba88-7f03-4c95-b882-0df79571b57b tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:20:11.313062 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f9a3ba88-7f03-4c95-b882-0df79571b57b tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:20:11.533024 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-f9a3ba88-7f03-4c95-b882-0df79571b57b tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7124fd831f0d4ce8b561d79639b5f272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339847fffad841c59cd6f9e3439eb420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:20:11.541867 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-f9a3ba88-7f03-4c95-b882-0df79571b57b tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] 10.222.0.43 "GET /compute/v2.1/servers/71ada3dc-3049-48c0-bace-e9560924732e" status: 200 len: 1391 microversion: 2.1 time: 0.245018 Oct 04 23:20:11.542488 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3539/7903] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:20:11 2022] GET /compute/v2.1/servers/71ada3dc-3049-48c0-bace-e9560924732e => generated 1391 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:20:11.737001 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-4a8ac830-734c-49ef-8ed9-79f602c0b543 req-c2d1f536-ce95-49bb-afb7-ecdebfe03d6b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71ada3dc-3049-48c0-bace-e9560924732e", "tag": "144d5cba-057c-4f8b-88dd-293db584353d"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 23:20:11.746405 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-4a8ac830-734c-49ef-8ed9-79f602c0b543 req-c2d1f536-ce95-49bb-afb7-ecdebfe03d6b service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:20:11.746925 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-4a8ac830-734c-49ef-8ed9-79f602c0b543 req-c2d1f536-ce95-49bb-afb7-ecdebfe03d6b service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:20:11.748328 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-4a8ac830-734c-49ef-8ed9-79f602c0b543 req-c2d1f536-ce95-49bb-afb7-ecdebfe03d6b service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:20:11.760414 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-4a8ac830-734c-49ef-8ed9-79f602c0b543 req-c2d1f536-ce95-49bb-afb7-ecdebfe03d6b service nova] Creating event network-changed:144d5cba-057c-4f8b-88dd-293db584353d for instance 71ada3dc-3049-48c0-bace-e9560924732e on n-h1-860284-1 Oct 04 23:20:11.765505 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-4a8ac830-734c-49ef-8ed9-79f602c0b543 req-c2d1f536-ce95-49bb-afb7-ecdebfe03d6b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091980 Oct 04 23:20:11.766106 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4365/7904] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 23:20:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 23:20:12.566378 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-f05b60eb-d19c-4d2f-a0e3-54b12dd44817 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:20:12.566979 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-f05b60eb-d19c-4d2f-a0e3-54b12dd44817 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] [instance: 71ada3dc-3049-48c0-bace-e9560924732e] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:20:12.573981 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f05b60eb-d19c-4d2f-a0e3-54b12dd44817 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:20:12.574508 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f05b60eb-d19c-4d2f-a0e3-54b12dd44817 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:20:12.574946 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f05b60eb-d19c-4d2f-a0e3-54b12dd44817 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:20:12.575654 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f05b60eb-d19c-4d2f-a0e3-54b12dd44817 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:20:12.576108 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f05b60eb-d19c-4d2f-a0e3-54b12dd44817 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:20:12.576535 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f05b60eb-d19c-4d2f-a0e3-54b12dd44817 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:20:12.713220 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-f05b60eb-d19c-4d2f-a0e3-54b12dd44817 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7124fd831f0d4ce8b561d79639b5f272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339847fffad841c59cd6f9e3439eb420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:20:12.721300 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-f05b60eb-d19c-4d2f-a0e3-54b12dd44817 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] 10.222.0.43 "GET /compute/v2.1/servers/71ada3dc-3049-48c0-bace-e9560924732e" status: 200 len: 1391 microversion: 2.1 time: 0.158845 Oct 04 23:20:12.721979 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3540/7905] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:20:12 2022] GET /compute/v2.1/servers/71ada3dc-3049-48c0-bace-e9560924732e => generated 1391 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:20:13.746781 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e9d2707f-5f78-4b8d-a005-ab8ac3c93760 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:20:13.747504 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-e9d2707f-5f78-4b8d-a005-ab8ac3c93760 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] [instance: 71ada3dc-3049-48c0-bace-e9560924732e] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:20:13.755059 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e9d2707f-5f78-4b8d-a005-ab8ac3c93760 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:20:13.755561 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e9d2707f-5f78-4b8d-a005-ab8ac3c93760 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:20:13.756015 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e9d2707f-5f78-4b8d-a005-ab8ac3c93760 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:20:13.756737 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e9d2707f-5f78-4b8d-a005-ab8ac3c93760 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:20:13.757212 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e9d2707f-5f78-4b8d-a005-ab8ac3c93760 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:20:13.757655 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e9d2707f-5f78-4b8d-a005-ab8ac3c93760 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:20:13.900127 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-e9d2707f-5f78-4b8d-a005-ab8ac3c93760 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7124fd831f0d4ce8b561d79639b5f272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339847fffad841c59cd6f9e3439eb420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:20:13.908559 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-e9d2707f-5f78-4b8d-a005-ab8ac3c93760 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] 10.222.0.43 "GET /compute/v2.1/servers/71ada3dc-3049-48c0-bace-e9560924732e" status: 200 len: 1391 microversion: 2.1 time: 0.166880 Oct 04 23:20:13.909144 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4366/7906] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:20:13 2022] GET /compute/v2.1/servers/71ada3dc-3049-48c0-bace-e9560924732e => generated 1391 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:20:14.931687 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-15514b1c-7aa4-407d-9575-acc263543ce0 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:20:14.932300 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-15514b1c-7aa4-407d-9575-acc263543ce0 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] [instance: 71ada3dc-3049-48c0-bace-e9560924732e] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:20:14.939879 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-15514b1c-7aa4-407d-9575-acc263543ce0 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:20:14.940387 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-15514b1c-7aa4-407d-9575-acc263543ce0 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:20:14.940807 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-15514b1c-7aa4-407d-9575-acc263543ce0 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:20:14.941491 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-15514b1c-7aa4-407d-9575-acc263543ce0 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:20:14.941945 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-15514b1c-7aa4-407d-9575-acc263543ce0 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:20:14.942388 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-15514b1c-7aa4-407d-9575-acc263543ce0 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:20:15.084022 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-15514b1c-7aa4-407d-9575-acc263543ce0 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7124fd831f0d4ce8b561d79639b5f272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339847fffad841c59cd6f9e3439eb420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:20:15.091785 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-15514b1c-7aa4-407d-9575-acc263543ce0 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] 10.222.0.43 "GET /compute/v2.1/servers/71ada3dc-3049-48c0-bace-e9560924732e" status: 200 len: 1391 microversion: 2.1 time: 0.164016 Oct 04 23:20:15.093007 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3541/7907] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:20:14 2022] GET /compute/v2.1/servers/71ada3dc-3049-48c0-bace-e9560924732e => generated 1391 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:20:16.115680 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-931aced0-7d1a-4cc2-b465-599d88198bc8 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:20:16.116349 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-931aced0-7d1a-4cc2-b465-599d88198bc8 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] [instance: 71ada3dc-3049-48c0-bace-e9560924732e] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:20:16.123360 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-931aced0-7d1a-4cc2-b465-599d88198bc8 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:20:16.124427 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-931aced0-7d1a-4cc2-b465-599d88198bc8 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:20:16.124951 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-931aced0-7d1a-4cc2-b465-599d88198bc8 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:20:16.125723 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-931aced0-7d1a-4cc2-b465-599d88198bc8 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:20:16.126197 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-931aced0-7d1a-4cc2-b465-599d88198bc8 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:20:16.126673 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-931aced0-7d1a-4cc2-b465-599d88198bc8 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:20:16.261084 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-931aced0-7d1a-4cc2-b465-599d88198bc8 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7124fd831f0d4ce8b561d79639b5f272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339847fffad841c59cd6f9e3439eb420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:20:16.269104 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-931aced0-7d1a-4cc2-b465-599d88198bc8 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] 10.222.0.43 "GET /compute/v2.1/servers/71ada3dc-3049-48c0-bace-e9560924732e" status: 200 len: 1391 microversion: 2.1 time: 0.157367 Oct 04 23:20:16.269680 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4367/7908] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:20:16 2022] GET /compute/v2.1/servers/71ada3dc-3049-48c0-bace-e9560924732e => generated 1391 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:20:17.292018 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-87a0b8b1-2892-4e4f-a275-47759442429f tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:20:17.292640 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-87a0b8b1-2892-4e4f-a275-47759442429f tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] [instance: 71ada3dc-3049-48c0-bace-e9560924732e] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:20:17.299939 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-87a0b8b1-2892-4e4f-a275-47759442429f tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:20:17.300434 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-87a0b8b1-2892-4e4f-a275-47759442429f tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:20:17.300880 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-87a0b8b1-2892-4e4f-a275-47759442429f tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:20:17.301579 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-87a0b8b1-2892-4e4f-a275-47759442429f tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:20:17.302044 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-87a0b8b1-2892-4e4f-a275-47759442429f tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:20:17.302503 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-87a0b8b1-2892-4e4f-a275-47759442429f tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:20:17.433118 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-87a0b8b1-2892-4e4f-a275-47759442429f tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7124fd831f0d4ce8b561d79639b5f272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339847fffad841c59cd6f9e3439eb420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:20:17.440773 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-87a0b8b1-2892-4e4f-a275-47759442429f tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] 10.222.0.43 "GET /compute/v2.1/servers/71ada3dc-3049-48c0-bace-e9560924732e" status: 200 len: 1391 microversion: 2.1 time: 0.152719 Oct 04 23:20:17.441659 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3542/7909] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:20:17 2022] GET /compute/v2.1/servers/71ada3dc-3049-48c0-bace-e9560924732e => generated 1391 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:20:17.668373 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-05da1669-4dee-44c8-94dc-5d17f1488e98 req-12555e67-cb98-44c9-98c2-9622decb94c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71ada3dc-3049-48c0-bace-e9560924732e", "name": "network-vif-plugged", "status": "completed", "tag": "144d5cba-057c-4f8b-88dd-293db584353d"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 23:20:17.678096 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-05da1669-4dee-44c8-94dc-5d17f1488e98 req-12555e67-cb98-44c9-98c2-9622decb94c1 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:20:17.678626 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-05da1669-4dee-44c8-94dc-5d17f1488e98 req-12555e67-cb98-44c9-98c2-9622decb94c1 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:20:17.679075 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-05da1669-4dee-44c8-94dc-5d17f1488e98 req-12555e67-cb98-44c9-98c2-9622decb94c1 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:20:17.690631 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-05da1669-4dee-44c8-94dc-5d17f1488e98 req-12555e67-cb98-44c9-98c2-9622decb94c1 service nova] Creating event network-vif-plugged:144d5cba-057c-4f8b-88dd-293db584353d for instance 71ada3dc-3049-48c0-bace-e9560924732e on n-h1-860284-1 Oct 04 23:20:17.695616 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-05da1669-4dee-44c8-94dc-5d17f1488e98 req-12555e67-cb98-44c9-98c2-9622decb94c1 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089927 Oct 04 23:20:17.696281 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4368/7910] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 23:20:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 23:20:18.465116 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-340fc36b-98e9-48bf-8e2a-f0e017398da1 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:20:18.465742 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-340fc36b-98e9-48bf-8e2a-f0e017398da1 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] [instance: 71ada3dc-3049-48c0-bace-e9560924732e] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:20:18.468226 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell0:SELECT=2 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:20:18.468958 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell0:SELECT=6 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:20:18.476621 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-340fc36b-98e9-48bf-8e2a-f0e017398da1 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:20:18.477370 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-340fc36b-98e9-48bf-8e2a-f0e017398da1 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:20:18.477817 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-340fc36b-98e9-48bf-8e2a-f0e017398da1 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:20:18.478666 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-340fc36b-98e9-48bf-8e2a-f0e017398da1 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:20:18.479133 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-340fc36b-98e9-48bf-8e2a-f0e017398da1 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:20:18.479572 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-340fc36b-98e9-48bf-8e2a-f0e017398da1 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:20:18.621613 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-340fc36b-98e9-48bf-8e2a-f0e017398da1 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7124fd831f0d4ce8b561d79639b5f272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339847fffad841c59cd6f9e3439eb420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:20:18.629383 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-340fc36b-98e9-48bf-8e2a-f0e017398da1 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] 10.222.0.43 "GET /compute/v2.1/servers/71ada3dc-3049-48c0-bace-e9560924732e" status: 200 len: 1391 microversion: 2.1 time: 0.168981 Oct 04 23:20:18.629971 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3543/7911] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:20:18 2022] GET /compute/v2.1/servers/71ada3dc-3049-48c0-bace-e9560924732e => generated 1391 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:20:19.650274 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=6 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:20:19.655495 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-f1df89bf-850c-40ab-a9ae-f49d449d7947 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:20:19.656248 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-f1df89bf-850c-40ab-a9ae-f49d449d7947 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] [instance: 71ada3dc-3049-48c0-bace-e9560924732e] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:20:19.662966 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f1df89bf-850c-40ab-a9ae-f49d449d7947 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:20:19.663467 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f1df89bf-850c-40ab-a9ae-f49d449d7947 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:20:19.663915 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f1df89bf-850c-40ab-a9ae-f49d449d7947 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:20:19.664617 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f1df89bf-850c-40ab-a9ae-f49d449d7947 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:20:19.665081 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f1df89bf-850c-40ab-a9ae-f49d449d7947 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:20:19.665516 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f1df89bf-850c-40ab-a9ae-f49d449d7947 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:20:19.802414 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-f1df89bf-850c-40ab-a9ae-f49d449d7947 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7124fd831f0d4ce8b561d79639b5f272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339847fffad841c59cd6f9e3439eb420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:20:19.810162 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-f1df89bf-850c-40ab-a9ae-f49d449d7947 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] 10.222.0.43 "GET /compute/v2.1/servers/71ada3dc-3049-48c0-bace-e9560924732e" status: 200 len: 1563 microversion: 2.1 time: 0.160889 Oct 04 23:20:19.810768 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4369/7912] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:20:19 2022] GET /compute/v2.1/servers/71ada3dc-3049-48c0-bace-e9560924732e => generated 1563 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:20:19.833531 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-23128fff-d175-4e9c-ac24-ff6d2212b5eb tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:20:19.834154 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-23128fff-d175-4e9c-ac24-ff6d2212b5eb tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] [instance: 71ada3dc-3049-48c0-bace-e9560924732e] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:20:19.840656 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-23128fff-d175-4e9c-ac24-ff6d2212b5eb tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:20:19.841157 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-23128fff-d175-4e9c-ac24-ff6d2212b5eb tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:20:19.841603 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-23128fff-d175-4e9c-ac24-ff6d2212b5eb tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:20:19.842304 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-23128fff-d175-4e9c-ac24-ff6d2212b5eb tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:20:19.842796 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-23128fff-d175-4e9c-ac24-ff6d2212b5eb tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:20:19.843232 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-23128fff-d175-4e9c-ac24-ff6d2212b5eb tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:20:19.973416 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-23128fff-d175-4e9c-ac24-ff6d2212b5eb tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7124fd831f0d4ce8b561d79639b5f272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339847fffad841c59cd6f9e3439eb420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:20:19.981620 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-23128fff-d175-4e9c-ac24-ff6d2212b5eb tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] 10.222.0.43 "GET /compute/v2.1/servers/71ada3dc-3049-48c0-bace-e9560924732e" status: 200 len: 1563 microversion: 2.1 time: 0.152026 Oct 04 23:20:19.982209 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3544/7913] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:20:19 2022] GET /compute/v2.1/servers/71ada3dc-3049-48c0-bace-e9560924732e => generated 1563 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:20:21.847415 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-b97a4d93-66fb-4186-9683-d99388b3a699 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:20:21.848042 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-b97a4d93-66fb-4186-9683-d99388b3a699 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] [instance: 71ada3dc-3049-48c0-bace-e9560924732e] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:20:21.850513 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-0c88c7e5-3566-4a22-9bf5-43e26dc352ad req-82c75b53-430c-4ed9-90fb-03396e3fa6be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71ada3dc-3049-48c0-bace-e9560924732e", "tag": "144d5cba-057c-4f8b-88dd-293db584353d"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 23:20:21.857239 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b97a4d93-66fb-4186-9683-d99388b3a699 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:20:21.857739 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b97a4d93-66fb-4186-9683-d99388b3a699 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:20:21.858189 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b97a4d93-66fb-4186-9683-d99388b3a699 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:20:21.858932 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b97a4d93-66fb-4186-9683-d99388b3a699 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:20:21.859920 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b97a4d93-66fb-4186-9683-d99388b3a699 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:20:21.860371 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b97a4d93-66fb-4186-9683-d99388b3a699 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:20:21.862052 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-0c88c7e5-3566-4a22-9bf5-43e26dc352ad req-82c75b53-430c-4ed9-90fb-03396e3fa6be service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:20:21.862571 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-0c88c7e5-3566-4a22-9bf5-43e26dc352ad req-82c75b53-430c-4ed9-90fb-03396e3fa6be service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:20:21.863014 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-0c88c7e5-3566-4a22-9bf5-43e26dc352ad req-82c75b53-430c-4ed9-90fb-03396e3fa6be service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:20:21.874476 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-0c88c7e5-3566-4a22-9bf5-43e26dc352ad req-82c75b53-430c-4ed9-90fb-03396e3fa6be service nova] Creating event network-changed:144d5cba-057c-4f8b-88dd-293db584353d for instance 71ada3dc-3049-48c0-bace-e9560924732e on n-h1-860284-1 Oct 04 23:20:21.888134 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-0c88c7e5-3566-4a22-9bf5-43e26dc352ad req-82c75b53-430c-4ed9-90fb-03396e3fa6be service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041618 Oct 04 23:20:21.888862 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3545/7914] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 23:20:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 23:20:22.012952 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-b97a4d93-66fb-4186-9683-d99388b3a699 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7124fd831f0d4ce8b561d79639b5f272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339847fffad841c59cd6f9e3439eb420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:20:22.021967 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-b97a4d93-66fb-4186-9683-d99388b3a699 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] 10.222.0.43 "GET /compute/v2.1/servers/71ada3dc-3049-48c0-bace-e9560924732e" status: 200 len: 1563 microversion: 2.1 time: 0.178748 Oct 04 23:20:22.022917 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4370/7915] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:20:21 2022] GET /compute/v2.1/servers/71ada3dc-3049-48c0-bace-e9560924732e => generated 1563 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:20:59.316886 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:20:59.317633 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=46 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:20:59.321815 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-c59e4b40-587d-4dea-8717-9c7dab80e61a tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 23:20:59.324158 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-c59e4b40-587d-4dea-8717-9c7dab80e61a tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] [instance: 71ada3dc-3049-48c0-bace-e9560924732e] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:20:59.331993 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c59e4b40-587d-4dea-8717-9c7dab80e61a tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:20:59.332476 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c59e4b40-587d-4dea-8717-9c7dab80e61a tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:20:59.332913 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c59e4b40-587d-4dea-8717-9c7dab80e61a tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:20:59.333603 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c59e4b40-587d-4dea-8717-9c7dab80e61a tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:20:59.334062 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c59e4b40-587d-4dea-8717-9c7dab80e61a tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:20:59.334518 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c59e4b40-587d-4dea-8717-9c7dab80e61a tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:20:59.388145 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-c59e4b40-587d-4dea-8717-9c7dab80e61a tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] 10.222.0.43 "POST /compute/v2.1/servers/71ada3dc-3049-48c0-bace-e9560924732e/action" status: 200 len: 24568 microversion: 2.1 time: 0.073194 Oct 04 23:20:59.388976 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3546/7916] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 23:20:59 2022] POST /compute/v2.1/servers/71ada3dc-3049-48c0-bace-e9560924732e/action => generated 24568 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 23:21:38.167722 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:21:38.168525 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=34 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:21:38.174051 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-72f78064-6c6d-4e4c-b77a-6f717a34c182 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 23:21:38.181822 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-72f78064-6c6d-4e4c-b77a-6f717a34c182 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:21:38.182330 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-72f78064-6c6d-4e4c-b77a-6f717a34c182 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:21:38.182809 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-72f78064-6c6d-4e4c-b77a-6f717a34c182 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:21:38.206707 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-72f78064-6c6d-4e4c-b77a-6f717a34c182 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] [instance: 71ada3dc-3049-48c0-bace-e9560924732e] Going to try to stop instance {{(pid=134101) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 04 23:21:38.250621 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-72f78064-6c6d-4e4c-b77a-6f717a34c182 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] 10.222.0.43 "POST /compute/v2.1/servers/71ada3dc-3049-48c0-bace-e9560924732e/action" status: 202 len: 0 microversion: 2.1 time: 0.084587 Oct 04 23:21:38.251400 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4371/7917] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 23:21:38 2022] POST /compute/v2.1/servers/71ada3dc-3049-48c0-bace-e9560924732e/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 23:21:38.260602 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-4b35a607-69bd-4f02-977d-723ededeed33 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:21:38.261339 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-4b35a607-69bd-4f02-977d-723ededeed33 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] [instance: 71ada3dc-3049-48c0-bace-e9560924732e] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:21:38.263954 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=4 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:21:38.264616 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_api:SELECT=2 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:21:38.273241 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4b35a607-69bd-4f02-977d-723ededeed33 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:21:38.273738 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4b35a607-69bd-4f02-977d-723ededeed33 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:21:38.274174 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4b35a607-69bd-4f02-977d-723ededeed33 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:21:38.274946 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4b35a607-69bd-4f02-977d-723ededeed33 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:21:38.275411 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4b35a607-69bd-4f02-977d-723ededeed33 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:21:38.275836 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4b35a607-69bd-4f02-977d-723ededeed33 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:21:38.427796 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-4b35a607-69bd-4f02-977d-723ededeed33 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7124fd831f0d4ce8b561d79639b5f272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339847fffad841c59cd6f9e3439eb420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:21:38.436136 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-4b35a607-69bd-4f02-977d-723ededeed33 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] 10.222.0.43 "GET /compute/v2.1/servers/71ada3dc-3049-48c0-bace-e9560924732e" status: 200 len: 1692 microversion: 2.1 time: 0.179568 Oct 04 23:21:38.436831 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3547/7918] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:21:38 2022] GET /compute/v2.1/servers/71ada3dc-3049-48c0-bace-e9560924732e => generated 1692 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:21:39.462640 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-5e1ea33e-f14e-43ae-94ee-bf02199d5129 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:21:39.463278 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-5e1ea33e-f14e-43ae-94ee-bf02199d5129 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] [instance: 71ada3dc-3049-48c0-bace-e9560924732e] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:21:39.469511 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5e1ea33e-f14e-43ae-94ee-bf02199d5129 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:21:39.470668 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5e1ea33e-f14e-43ae-94ee-bf02199d5129 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:21:39.471126 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5e1ea33e-f14e-43ae-94ee-bf02199d5129 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:21:39.471907 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5e1ea33e-f14e-43ae-94ee-bf02199d5129 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:21:39.472382 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5e1ea33e-f14e-43ae-94ee-bf02199d5129 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:21:39.472831 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5e1ea33e-f14e-43ae-94ee-bf02199d5129 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:21:39.610232 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-5e1ea33e-f14e-43ae-94ee-bf02199d5129 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7124fd831f0d4ce8b561d79639b5f272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339847fffad841c59cd6f9e3439eb420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:21:39.618624 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-5e1ea33e-f14e-43ae-94ee-bf02199d5129 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] 10.222.0.43 "GET /compute/v2.1/servers/71ada3dc-3049-48c0-bace-e9560924732e" status: 200 len: 1692 microversion: 2.1 time: 0.161376 Oct 04 23:21:39.619197 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4372/7919] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:21:39 2022] GET /compute/v2.1/servers/71ada3dc-3049-48c0-bace-e9560924732e => generated 1692 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:21:40.641965 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-84fddbe1-005d-49ff-9d39-eeb25b6805d7 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:21:40.642607 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-84fddbe1-005d-49ff-9d39-eeb25b6805d7 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] [instance: 71ada3dc-3049-48c0-bace-e9560924732e] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:21:40.649402 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-84fddbe1-005d-49ff-9d39-eeb25b6805d7 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:21:40.649884 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-84fddbe1-005d-49ff-9d39-eeb25b6805d7 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:21:40.650321 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-84fddbe1-005d-49ff-9d39-eeb25b6805d7 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:21:40.651035 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-84fddbe1-005d-49ff-9d39-eeb25b6805d7 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:21:40.651489 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-84fddbe1-005d-49ff-9d39-eeb25b6805d7 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:21:40.651915 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-84fddbe1-005d-49ff-9d39-eeb25b6805d7 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:21:40.787404 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-84fddbe1-005d-49ff-9d39-eeb25b6805d7 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7124fd831f0d4ce8b561d79639b5f272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339847fffad841c59cd6f9e3439eb420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:21:40.795520 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-84fddbe1-005d-49ff-9d39-eeb25b6805d7 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] 10.222.0.43 "GET /compute/v2.1/servers/71ada3dc-3049-48c0-bace-e9560924732e" status: 200 len: 1692 microversion: 2.1 time: 0.157612 Oct 04 23:21:40.796163 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3548/7920] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:21:40 2022] GET /compute/v2.1/servers/71ada3dc-3049-48c0-bace-e9560924732e => generated 1692 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:21:41.820428 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-984734ac-892f-42d5-acb7-a273395f03fe tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:21:41.821041 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-984734ac-892f-42d5-acb7-a273395f03fe tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] [instance: 71ada3dc-3049-48c0-bace-e9560924732e] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:21:41.827852 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-984734ac-892f-42d5-acb7-a273395f03fe tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:21:41.828353 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-984734ac-892f-42d5-acb7-a273395f03fe tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:21:41.828806 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-984734ac-892f-42d5-acb7-a273395f03fe tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:21:41.829513 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-984734ac-892f-42d5-acb7-a273395f03fe tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:21:41.829993 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-984734ac-892f-42d5-acb7-a273395f03fe tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:21:41.831069 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-984734ac-892f-42d5-acb7-a273395f03fe tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:21:41.964409 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-984734ac-892f-42d5-acb7-a273395f03fe tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7124fd831f0d4ce8b561d79639b5f272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339847fffad841c59cd6f9e3439eb420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:21:41.972516 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-984734ac-892f-42d5-acb7-a273395f03fe tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] 10.222.0.43 "GET /compute/v2.1/servers/71ada3dc-3049-48c0-bace-e9560924732e" status: 200 len: 1692 microversion: 2.1 time: 0.156108 Oct 04 23:21:41.973098 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4373/7921] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:21:41 2022] GET /compute/v2.1/servers/71ada3dc-3049-48c0-bace-e9560924732e => generated 1692 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:21:42.995967 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-4f8ed211-7582-4d46-960f-9a25fe4031d9 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:21:42.996507 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-4f8ed211-7582-4d46-960f-9a25fe4031d9 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] [instance: 71ada3dc-3049-48c0-bace-e9560924732e] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:21:43.004345 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4f8ed211-7582-4d46-960f-9a25fe4031d9 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:21:43.004846 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4f8ed211-7582-4d46-960f-9a25fe4031d9 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:21:43.005291 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4f8ed211-7582-4d46-960f-9a25fe4031d9 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:21:43.006005 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4f8ed211-7582-4d46-960f-9a25fe4031d9 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:21:43.006503 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4f8ed211-7582-4d46-960f-9a25fe4031d9 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:21:43.007068 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4f8ed211-7582-4d46-960f-9a25fe4031d9 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:21:43.146580 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-4f8ed211-7582-4d46-960f-9a25fe4031d9 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7124fd831f0d4ce8b561d79639b5f272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339847fffad841c59cd6f9e3439eb420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:21:43.154724 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-4f8ed211-7582-4d46-960f-9a25fe4031d9 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] 10.222.0.43 "GET /compute/v2.1/servers/71ada3dc-3049-48c0-bace-e9560924732e" status: 200 len: 1692 microversion: 2.1 time: 0.162740 Oct 04 23:21:43.155309 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3549/7922] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:21:42 2022] GET /compute/v2.1/servers/71ada3dc-3049-48c0-bace-e9560924732e => generated 1692 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:21:44.178644 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-fb9ead9d-bc70-4cb4-a030-32d26ce96864 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:21:44.179302 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-fb9ead9d-bc70-4cb4-a030-32d26ce96864 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] [instance: 71ada3dc-3049-48c0-bace-e9560924732e] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:21:44.186149 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fb9ead9d-bc70-4cb4-a030-32d26ce96864 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:21:44.186686 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fb9ead9d-bc70-4cb4-a030-32d26ce96864 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:21:44.187138 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fb9ead9d-bc70-4cb4-a030-32d26ce96864 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:21:44.187843 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fb9ead9d-bc70-4cb4-a030-32d26ce96864 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:21:44.188313 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fb9ead9d-bc70-4cb4-a030-32d26ce96864 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:21:44.188755 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fb9ead9d-bc70-4cb4-a030-32d26ce96864 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:21:44.325988 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-fb9ead9d-bc70-4cb4-a030-32d26ce96864 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7124fd831f0d4ce8b561d79639b5f272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339847fffad841c59cd6f9e3439eb420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:21:44.335018 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-fb9ead9d-bc70-4cb4-a030-32d26ce96864 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] 10.222.0.43 "GET /compute/v2.1/servers/71ada3dc-3049-48c0-bace-e9560924732e" status: 200 len: 1692 microversion: 2.1 time: 0.160531 Oct 04 23:21:44.335593 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4374/7923] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:21:44 2022] GET /compute/v2.1/servers/71ada3dc-3049-48c0-bace-e9560924732e => generated 1692 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:21:45.358786 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-db3da4c3-a32f-4773-af26-1ffb0e6a3811 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:21:45.359352 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-db3da4c3-a32f-4773-af26-1ffb0e6a3811 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] [instance: 71ada3dc-3049-48c0-bace-e9560924732e] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:21:45.367116 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-db3da4c3-a32f-4773-af26-1ffb0e6a3811 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:21:45.367609 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-db3da4c3-a32f-4773-af26-1ffb0e6a3811 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:21:45.368055 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-db3da4c3-a32f-4773-af26-1ffb0e6a3811 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:21:45.368759 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-db3da4c3-a32f-4773-af26-1ffb0e6a3811 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:21:45.369220 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-db3da4c3-a32f-4773-af26-1ffb0e6a3811 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:21:45.369657 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-db3da4c3-a32f-4773-af26-1ffb0e6a3811 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:21:45.498025 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-db3da4c3-a32f-4773-af26-1ffb0e6a3811 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7124fd831f0d4ce8b561d79639b5f272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339847fffad841c59cd6f9e3439eb420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:21:45.506245 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-db3da4c3-a32f-4773-af26-1ffb0e6a3811 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] 10.222.0.43 "GET /compute/v2.1/servers/71ada3dc-3049-48c0-bace-e9560924732e" status: 200 len: 1692 microversion: 2.1 time: 0.151487 Oct 04 23:21:45.506853 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3550/7924] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:21:45 2022] GET /compute/v2.1/servers/71ada3dc-3049-48c0-bace-e9560924732e => generated 1692 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:21:46.529027 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-104ea7ac-7597-449f-994d-1935be0eca2c tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:21:46.529669 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-104ea7ac-7597-449f-994d-1935be0eca2c tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] [instance: 71ada3dc-3049-48c0-bace-e9560924732e] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:21:46.537287 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-104ea7ac-7597-449f-994d-1935be0eca2c tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:21:46.537796 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-104ea7ac-7597-449f-994d-1935be0eca2c tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:21:46.538251 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-104ea7ac-7597-449f-994d-1935be0eca2c tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:21:46.539004 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-104ea7ac-7597-449f-994d-1935be0eca2c tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:21:46.539473 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-104ea7ac-7597-449f-994d-1935be0eca2c tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:21:46.540035 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-104ea7ac-7597-449f-994d-1935be0eca2c tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:21:46.680666 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-104ea7ac-7597-449f-994d-1935be0eca2c tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7124fd831f0d4ce8b561d79639b5f272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339847fffad841c59cd6f9e3439eb420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:21:46.688603 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-104ea7ac-7597-449f-994d-1935be0eca2c tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] 10.222.0.43 "GET /compute/v2.1/servers/71ada3dc-3049-48c0-bace-e9560924732e" status: 200 len: 1692 microversion: 2.1 time: 0.163499 Oct 04 23:21:46.689176 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4375/7925] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:21:46 2022] GET /compute/v2.1/servers/71ada3dc-3049-48c0-bace-e9560924732e => generated 1692 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:21:47.712483 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-ae269d99-cf64-4b5e-b42c-e445b3e32606 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:21:47.713138 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-ae269d99-cf64-4b5e-b42c-e445b3e32606 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] [instance: 71ada3dc-3049-48c0-bace-e9560924732e] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:21:47.720840 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ae269d99-cf64-4b5e-b42c-e445b3e32606 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:21:47.721368 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ae269d99-cf64-4b5e-b42c-e445b3e32606 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:21:47.721773 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ae269d99-cf64-4b5e-b42c-e445b3e32606 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:21:47.722536 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ae269d99-cf64-4b5e-b42c-e445b3e32606 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:21:47.723002 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ae269d99-cf64-4b5e-b42c-e445b3e32606 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:21:47.723436 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ae269d99-cf64-4b5e-b42c-e445b3e32606 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:21:47.860022 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-ae269d99-cf64-4b5e-b42c-e445b3e32606 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7124fd831f0d4ce8b561d79639b5f272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339847fffad841c59cd6f9e3439eb420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:21:47.868466 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-ae269d99-cf64-4b5e-b42c-e445b3e32606 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] 10.222.0.43 "GET /compute/v2.1/servers/71ada3dc-3049-48c0-bace-e9560924732e" status: 200 len: 1692 microversion: 2.1 time: 0.159925 Oct 04 23:21:47.869045 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3551/7926] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:21:47 2022] GET /compute/v2.1/servers/71ada3dc-3049-48c0-bace-e9560924732e => generated 1692 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:21:48.892908 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-61c2c18f-a94d-40f4-a922-15af630151da tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:21:48.893540 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-61c2c18f-a94d-40f4-a922-15af630151da tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] [instance: 71ada3dc-3049-48c0-bace-e9560924732e] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:21:48.900491 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-61c2c18f-a94d-40f4-a922-15af630151da tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:21:48.901084 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-61c2c18f-a94d-40f4-a922-15af630151da tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:21:48.901539 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-61c2c18f-a94d-40f4-a922-15af630151da tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:21:48.902244 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-61c2c18f-a94d-40f4-a922-15af630151da tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:21:48.902743 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-61c2c18f-a94d-40f4-a922-15af630151da tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:21:48.903189 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-61c2c18f-a94d-40f4-a922-15af630151da tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:21:49.034126 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-61c2c18f-a94d-40f4-a922-15af630151da tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7124fd831f0d4ce8b561d79639b5f272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339847fffad841c59cd6f9e3439eb420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:21:49.042557 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-61c2c18f-a94d-40f4-a922-15af630151da tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] 10.222.0.43 "GET /compute/v2.1/servers/71ada3dc-3049-48c0-bace-e9560924732e" status: 200 len: 1669 microversion: 2.1 time: 0.153553 Oct 04 23:21:49.043135 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4376/7927] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:21:48 2022] GET /compute/v2.1/servers/71ada3dc-3049-48c0-bace-e9560924732e => generated 1669 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:21:50.139264 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-600d1a5d-a502-4a28-b7bf-656ae5070773 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 23:21:50.141527 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-600d1a5d-a502-4a28-b7bf-656ae5070773 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] [instance: 71ada3dc-3049-48c0-bace-e9560924732e] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:21:50.149150 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-600d1a5d-a502-4a28-b7bf-656ae5070773 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:21:50.149631 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-600d1a5d-a502-4a28-b7bf-656ae5070773 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:21:50.150063 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-600d1a5d-a502-4a28-b7bf-656ae5070773 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:21:50.150797 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-600d1a5d-a502-4a28-b7bf-656ae5070773 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:21:50.151250 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-600d1a5d-a502-4a28-b7bf-656ae5070773 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:21:50.151674 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-600d1a5d-a502-4a28-b7bf-656ae5070773 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:21:50.203158 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-600d1a5d-a502-4a28-b7bf-656ae5070773 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] 10.222.0.43 "POST /compute/v2.1/servers/71ada3dc-3049-48c0-bace-e9560924732e/action" status: 200 len: 38431 microversion: 2.1 time: 0.067705 Oct 04 23:21:50.203818 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3552/7928] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 23:21:50 2022] POST /compute/v2.1/servers/71ada3dc-3049-48c0-bace-e9560924732e/action => generated 38431 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 23:21:50.216606 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-6b7249ed-1444-4d1b-8337-54b0c93115f1 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 23:21:50.223557 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6b7249ed-1444-4d1b-8337-54b0c93115f1 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:21:50.224061 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6b7249ed-1444-4d1b-8337-54b0c93115f1 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:21:50.224524 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6b7249ed-1444-4d1b-8337-54b0c93115f1 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:21:50.246603 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-6b7249ed-1444-4d1b-8337-54b0c93115f1 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] [instance: 71ada3dc-3049-48c0-bace-e9560924732e] Going to try to start instance {{(pid=134101) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 04 23:21:50.289255 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-6b7249ed-1444-4d1b-8337-54b0c93115f1 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] 10.222.0.43 "POST /compute/v2.1/servers/71ada3dc-3049-48c0-bace-e9560924732e/action" status: 202 len: 0 microversion: 2.1 time: 0.076415 Oct 04 23:21:50.290068 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4377/7929] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 23:21:50 2022] POST /compute/v2.1/servers/71ada3dc-3049-48c0-bace-e9560924732e/action => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 23:21:50.298860 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-1d565fe7-472f-4307-9fab-3f6a94e2ead0 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:21:50.299567 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-1d565fe7-472f-4307-9fab-3f6a94e2ead0 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] [instance: 71ada3dc-3049-48c0-bace-e9560924732e] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:21:50.306818 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1d565fe7-472f-4307-9fab-3f6a94e2ead0 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:21:50.307306 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1d565fe7-472f-4307-9fab-3f6a94e2ead0 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:21:50.307745 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1d565fe7-472f-4307-9fab-3f6a94e2ead0 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:21:50.308460 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1d565fe7-472f-4307-9fab-3f6a94e2ead0 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:21:50.309054 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1d565fe7-472f-4307-9fab-3f6a94e2ead0 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:21:50.309318 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1d565fe7-472f-4307-9fab-3f6a94e2ead0 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:21:50.534743 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-1d565fe7-472f-4307-9fab-3f6a94e2ead0 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7124fd831f0d4ce8b561d79639b5f272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339847fffad841c59cd6f9e3439eb420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:21:50.542602 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-1d565fe7-472f-4307-9fab-3f6a94e2ead0 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] 10.222.0.43 "GET /compute/v2.1/servers/71ada3dc-3049-48c0-bace-e9560924732e" status: 200 len: 1678 microversion: 2.1 time: 0.248006 Oct 04 23:21:50.543498 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3553/7930] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:21:50 2022] GET /compute/v2.1/servers/71ada3dc-3049-48c0-bace-e9560924732e => generated 1678 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:21:51.570425 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-a5fd4d0c-d0c3-41e9-873b-ce8b6bf007aa tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:21:51.571149 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-a5fd4d0c-d0c3-41e9-873b-ce8b6bf007aa tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] [instance: 71ada3dc-3049-48c0-bace-e9560924732e] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:21:51.578174 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a5fd4d0c-d0c3-41e9-873b-ce8b6bf007aa tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:21:51.578711 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a5fd4d0c-d0c3-41e9-873b-ce8b6bf007aa tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:21:51.579162 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a5fd4d0c-d0c3-41e9-873b-ce8b6bf007aa tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:21:51.579867 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a5fd4d0c-d0c3-41e9-873b-ce8b6bf007aa tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:21:51.580335 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a5fd4d0c-d0c3-41e9-873b-ce8b6bf007aa tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:21:51.580777 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a5fd4d0c-d0c3-41e9-873b-ce8b6bf007aa tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:21:51.719693 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-a5fd4d0c-d0c3-41e9-873b-ce8b6bf007aa tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7124fd831f0d4ce8b561d79639b5f272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339847fffad841c59cd6f9e3439eb420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:21:51.728054 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-a5fd4d0c-d0c3-41e9-873b-ce8b6bf007aa tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] 10.222.0.43 "GET /compute/v2.1/servers/71ada3dc-3049-48c0-bace-e9560924732e" status: 200 len: 1682 microversion: 2.1 time: 0.162598 Oct 04 23:21:51.728649 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4378/7931] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:21:51 2022] GET /compute/v2.1/servers/71ada3dc-3049-48c0-bace-e9560924732e => generated 1682 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:22:25.951036 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-4fac487f-b8e0-449e-8aa9-f620574cc8e6 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 23:22:25.953182 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-4fac487f-b8e0-449e-8aa9-f620574cc8e6 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] [instance: 71ada3dc-3049-48c0-bace-e9560924732e] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:22:25.955906 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_api:SELECT=14 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:22:25.956753 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=40 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:22:25.962395 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4fac487f-b8e0-449e-8aa9-f620574cc8e6 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:22:25.962889 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4fac487f-b8e0-449e-8aa9-f620574cc8e6 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:22:25.963333 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4fac487f-b8e0-449e-8aa9-f620574cc8e6 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:22:25.964035 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4fac487f-b8e0-449e-8aa9-f620574cc8e6 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:22:25.964494 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4fac487f-b8e0-449e-8aa9-f620574cc8e6 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:22:25.964926 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4fac487f-b8e0-449e-8aa9-f620574cc8e6 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:22:26.024422 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-4fac487f-b8e0-449e-8aa9-f620574cc8e6 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] 10.222.0.43 "POST /compute/v2.1/servers/71ada3dc-3049-48c0-bace-e9560924732e/action" status: 200 len: 62989 microversion: 2.1 time: 0.077432 Oct 04 23:22:26.025109 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3554/7932] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 23:22:25 2022] POST /compute/v2.1/servers/71ada3dc-3049-48c0-bace-e9560924732e/action => generated 62989 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 23:22:49.724634 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-67fb6c14-b3eb-45d3-8374-bd37d6801927 req-554a4a86-7ebb-42a3-a477-c94b90996fd5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71ada3dc-3049-48c0-bace-e9560924732e", "tag": "144d5cba-057c-4f8b-88dd-293db584353d"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 23:22:49.726784 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-65f02d88-b5f5-41d0-993e-487a59870383 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:22:49.727367 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-65f02d88-b5f5-41d0-993e-487a59870383 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] [instance: 71ada3dc-3049-48c0-bace-e9560924732e] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:22:49.729806 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=16 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:22:49.730523 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:22:49.741546 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-65f02d88-b5f5-41d0-993e-487a59870383 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:22:49.742067 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-65f02d88-b5f5-41d0-993e-487a59870383 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:22:49.742561 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-65f02d88-b5f5-41d0-993e-487a59870383 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:22:49.743296 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-65f02d88-b5f5-41d0-993e-487a59870383 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:22:49.743773 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-65f02d88-b5f5-41d0-993e-487a59870383 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:22:49.744389 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_api:SELECT=2 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:22:49.745155 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=4 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:22:49.752289 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-67fb6c14-b3eb-45d3-8374-bd37d6801927 req-554a4a86-7ebb-42a3-a477-c94b90996fd5 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:22:49.752777 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-67fb6c14-b3eb-45d3-8374-bd37d6801927 req-554a4a86-7ebb-42a3-a477-c94b90996fd5 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:22:49.753218 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-67fb6c14-b3eb-45d3-8374-bd37d6801927 req-554a4a86-7ebb-42a3-a477-c94b90996fd5 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:22:49.755750 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-65f02d88-b5f5-41d0-993e-487a59870383 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:22:49.766074 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-67fb6c14-b3eb-45d3-8374-bd37d6801927 req-554a4a86-7ebb-42a3-a477-c94b90996fd5 service nova] Creating event network-changed:144d5cba-057c-4f8b-88dd-293db584353d for instance 71ada3dc-3049-48c0-bace-e9560924732e on n-h1-860284-1 Oct 04 23:22:49.771711 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-67fb6c14-b3eb-45d3-8374-bd37d6801927 req-554a4a86-7ebb-42a3-a477-c94b90996fd5 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051778 Oct 04 23:22:49.772387 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3555/7933] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 23:22:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 23:22:49.785617 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-65f02d88-b5f5-41d0-993e-487a59870383 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] [instance: 71ada3dc-3049-48c0-bace-e9560924732e] Going to try to terminate instance {{(pid=134101) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 23:22:49.881170 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-65f02d88-b5f5-41d0-993e-487a59870383 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] 10.222.0.43 "DELETE /compute/v2.1/servers/71ada3dc-3049-48c0-bace-e9560924732e" status: 204 len: 0 microversion: 2.1 time: 0.166556 Oct 04 23:22:49.882145 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4379/7934] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 23:22:49 2022] DELETE /compute/v2.1/servers/71ada3dc-3049-48c0-bace-e9560924732e => generated 0 bytes in 168 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 23:22:49.890947 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-34c7f977-0143-4d72-bbfd-2fd50204f5c7 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:22:49.891662 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-34c7f977-0143-4d72-bbfd-2fd50204f5c7 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] [instance: 71ada3dc-3049-48c0-bace-e9560924732e] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:22:49.899060 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-34c7f977-0143-4d72-bbfd-2fd50204f5c7 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:22:49.899558 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-34c7f977-0143-4d72-bbfd-2fd50204f5c7 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:22:49.900218 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-34c7f977-0143-4d72-bbfd-2fd50204f5c7 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:22:49.901113 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-34c7f977-0143-4d72-bbfd-2fd50204f5c7 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:22:49.901774 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-34c7f977-0143-4d72-bbfd-2fd50204f5c7 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:22:49.902211 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-34c7f977-0143-4d72-bbfd-2fd50204f5c7 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:22:50.059117 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-34c7f977-0143-4d72-bbfd-2fd50204f5c7 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7124fd831f0d4ce8b561d79639b5f272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339847fffad841c59cd6f9e3439eb420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:22:50.068199 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-34c7f977-0143-4d72-bbfd-2fd50204f5c7 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] 10.222.0.43 "GET /compute/v2.1/servers/71ada3dc-3049-48c0-bace-e9560924732e" status: 200 len: 1688 microversion: 2.1 time: 0.181551 Oct 04 23:22:50.068876 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3556/7935] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:22:49 2022] GET /compute/v2.1/servers/71ada3dc-3049-48c0-bace-e9560924732e => generated 1688 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:22:51.094682 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-4b093123-1ff7-4dcf-8a07-3bbeaaf9193f tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:22:51.095409 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-4b093123-1ff7-4dcf-8a07-3bbeaaf9193f tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] [instance: 71ada3dc-3049-48c0-bace-e9560924732e] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:22:51.103504 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4b093123-1ff7-4dcf-8a07-3bbeaaf9193f tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:22:51.104003 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4b093123-1ff7-4dcf-8a07-3bbeaaf9193f tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:22:51.104452 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4b093123-1ff7-4dcf-8a07-3bbeaaf9193f tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:22:51.105188 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4b093123-1ff7-4dcf-8a07-3bbeaaf9193f tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:22:51.105671 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4b093123-1ff7-4dcf-8a07-3bbeaaf9193f tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:22:51.106107 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-4b093123-1ff7-4dcf-8a07-3bbeaaf9193f tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:22:51.247255 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-4b093123-1ff7-4dcf-8a07-3bbeaaf9193f tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7124fd831f0d4ce8b561d79639b5f272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339847fffad841c59cd6f9e3439eb420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:22:51.255931 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-4b093123-1ff7-4dcf-8a07-3bbeaaf9193f tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] 10.222.0.43 "GET /compute/v2.1/servers/71ada3dc-3049-48c0-bace-e9560924732e" status: 200 len: 1688 microversion: 2.1 time: 0.165830 Oct 04 23:22:51.256619 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4380/7936] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:22:51 2022] GET /compute/v2.1/servers/71ada3dc-3049-48c0-bace-e9560924732e => generated 1688 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:22:52.279535 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-ba22e45e-3cf8-4d27-9143-25e5b2757562 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:22:52.280146 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-ba22e45e-3cf8-4d27-9143-25e5b2757562 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] [instance: 71ada3dc-3049-48c0-bace-e9560924732e] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:22:52.288396 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ba22e45e-3cf8-4d27-9143-25e5b2757562 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:22:52.288923 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ba22e45e-3cf8-4d27-9143-25e5b2757562 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:22:52.289363 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ba22e45e-3cf8-4d27-9143-25e5b2757562 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:22:52.290091 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ba22e45e-3cf8-4d27-9143-25e5b2757562 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:22:52.290601 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ba22e45e-3cf8-4d27-9143-25e5b2757562 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:22:52.291035 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ba22e45e-3cf8-4d27-9143-25e5b2757562 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:22:52.568828 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-ba22e45e-3cf8-4d27-9143-25e5b2757562 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7124fd831f0d4ce8b561d79639b5f272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339847fffad841c59cd6f9e3439eb420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:22:52.577624 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-ba22e45e-3cf8-4d27-9143-25e5b2757562 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] 10.222.0.43 "GET /compute/v2.1/servers/71ada3dc-3049-48c0-bace-e9560924732e" status: 200 len: 1569 microversion: 2.1 time: 0.301955 Oct 04 23:22:52.578216 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3557/7937] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:22:52 2022] GET /compute/v2.1/servers/71ada3dc-3049-48c0-bace-e9560924732e => generated 1569 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:22:52.619274 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-096ecbdb-65ec-4f27-a548-71cbab65976d req-1208b533-8d17-4c31-b27d-e7648646f30f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71ada3dc-3049-48c0-bace-e9560924732e", "name": "network-vif-deleted", "tag": "144d5cba-057c-4f8b-88dd-293db584353d"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 23:22:52.633064 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-096ecbdb-65ec-4f27-a548-71cbab65976d req-1208b533-8d17-4c31-b27d-e7648646f30f service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:22:52.633563 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-096ecbdb-65ec-4f27-a548-71cbab65976d req-1208b533-8d17-4c31-b27d-e7648646f30f service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:22:52.634035 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-096ecbdb-65ec-4f27-a548-71cbab65976d req-1208b533-8d17-4c31-b27d-e7648646f30f service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:22:52.647641 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-096ecbdb-65ec-4f27-a548-71cbab65976d req-1208b533-8d17-4c31-b27d-e7648646f30f service nova] Creating event network-vif-deleted:144d5cba-057c-4f8b-88dd-293db584353d for instance 71ada3dc-3049-48c0-bace-e9560924732e on n-h1-860284-1 Oct 04 23:22:52.652765 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-096ecbdb-65ec-4f27-a548-71cbab65976d req-1208b533-8d17-4c31-b27d-e7648646f30f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037297 Oct 04 23:22:52.653376 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4381/7938] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 23:22:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 23:22:53.602544 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-027818d1-f452-432a-b077-ec7963bb73dc tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:22:53.603168 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-027818d1-f452-432a-b077-ec7963bb73dc tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] [instance: 71ada3dc-3049-48c0-bace-e9560924732e] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:22:53.610022 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-027818d1-f452-432a-b077-ec7963bb73dc tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:22:53.610553 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-027818d1-f452-432a-b077-ec7963bb73dc tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:22:53.611003 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-027818d1-f452-432a-b077-ec7963bb73dc tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:22:53.611703 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-027818d1-f452-432a-b077-ec7963bb73dc tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:22:53.612166 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-027818d1-f452-432a-b077-ec7963bb73dc tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:22:53.612601 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-027818d1-f452-432a-b077-ec7963bb73dc tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:22:53.626343 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-027818d1-f452-432a-b077-ec7963bb73dc tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] HTTP exception thrown: Instance 71ada3dc-3049-48c0-bace-e9560924732e could not be found. Oct 04 23:22:53.628026 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-027818d1-f452-432a-b077-ec7963bb73dc tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Request method failure captured: Oct 04 23:22:53.628026 n-d-860284-1 devstack@n-api.service[134102]: request: GET /compute/v2.1/servers/71ada3dc-3049-48c0-bace-e9560924732e HTTP/1.1 Oct 04 23:22:53.628026 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 23:22:53.628026 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 23:22:53.628026 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 23:22:53.628026 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 23:22:53.628026 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 23:22:53.628026 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 23:22:53.628026 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 23:22:53.628026 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 23:22:53.628026 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPL3PV1P3eiBng-eyftmazLIMFOGhxgvlJE5kLv8qSAxeZ7nw7JEQcBo6uebpFaCmIciYVzYahs6GheYsSkJ64LI0k5-JJiivZ7ZQcPNIUVS-FFaLcyFAAb-8gYSuTYUwgQIpyTivuP6QEOS5wIqgxRi6U8ltOJnUssrNHH8u3ZtbLbs Oct 04 23:22:53.628026 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 23:22:53.628026 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 23:22:53.628026 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 23:22:53.628026 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 23:22:53.628026 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 23:22:53.628026 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 23:22:53.628026 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: 339847fffad841c59cd6f9e3439eb420 Oct 04 23:22:53.628026 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-217321805 Oct 04 23:22:53.628026 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 23:22:53.628026 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 23:22:53.628026 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/339847fffad841c59cd6f9e3439eb420"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_339847fffad841c59cd6f9e3439eb420", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/339847fffad841c59cd6f9e3439eb420"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/339847fffad841c59cd6f9e3439eb420"}]}] Oct 04 23:22:53.628026 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-TestNetworkAdvancedServerOps-217321805 Oct 04 23:22:53.628026 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: 339847fffad841c59cd6f9e3439eb420 Oct 04 23:22:53.628026 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-217321805 Oct 04 23:22:53.628026 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-TestNetworkAdvancedServerOps-217321805-project Oct 04 23:22:53.628026 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 23:22:53.628026 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 23:22:53.628026 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: 7124fd831f0d4ce8b561d79639b5f272 Oct 04 23:22:53.628026 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-TestNetworkAdvancedServerOps-217321805-project Oct 04 23:22:53.628026 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 23:22:53.628026 n-d-860284-1 devstack@n-api.service[134102]: exception: Instance 71ada3dc-3049-48c0-bace-e9560924732e could not be found. Oct 04 23:22:53.628026 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': '71ada3dc-3049-48c0-bace-e9560924732e'} Oct 04 23:22:53.628026 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 23:22:53.628026 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 23:22:53.628026 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 23:22:53.628026 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 23:22:53.628026 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 23:22:53.628026 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 23:22:53.628026 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 23:22:53.628026 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 23:22:53.628026 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 23:22:53.628026 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 23:22:53.628026 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71ada3dc-3049-48c0-bace-e9560924732e could not be found. Oct 04 23:22:53.628026 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 23:22:53.628026 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 23:22:53.628026 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 23:22:53.628026 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 23:22:53.628026 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 23:22:53.628026 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 23:22:53.628026 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 23:22:53.628026 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 23:22:53.628026 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 23:22:53.628026 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 23:22:53.628026 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 23:22:53.628026 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 23:22:53.628026 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 23:22:53.628026 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 23:22:53.628026 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 23:22:53.628026 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 23:22:53.628026 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71ada3dc-3049-48c0-bace-e9560924732e could not be found. Oct 04 23:22:53.628026 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 23:22:53.628026 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 23:22:53.633197 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 23:22:53.633197 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 23:22:53.633197 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 23:22:53.633197 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 23:22:53.633197 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 23:22:53.633197 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 23:22:53.633197 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71ada3dc-3049-48c0-bace-e9560924732e could not be found. Oct 04 23:22:53.633197 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 23:22:53.633197 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-027818d1-f452-432a-b077-ec7963bb73dc tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Returning 404 to user: Instance 71ada3dc-3049-48c0-bace-e9560924732e could not be found. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 23:22:53.633197 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-027818d1-f452-432a-b077-ec7963bb73dc tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] 10.222.0.43 "GET /compute/v2.1/servers/71ada3dc-3049-48c0-bace-e9560924732e" status: 404 len: 111 microversion: 2.1 time: 0.032215 Oct 04 23:22:53.633197 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3558/7939] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:22:53 2022] GET /compute/v2.1/servers/71ada3dc-3049-48c0-bace-e9560924732e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 23:22:56.784569 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-a15e89c9-346e-49e3-b3bc-26b7b4d17ab0 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Calling method '.version_select at 0x7fbb1c7bb820>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:22:56.790193 n-d-860284-1 devstack@n-api.service[134101]: ERROR oslo.messaging._drivers.impl_rabbit [None req-a15e89c9-346e-49e3-b3bc-26b7b4d17ab0 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] [54f0993b-fb22-4e4c-ae00-e3f0e5da4c18] AMQP server on 10.222.0.43:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 23:22:57.803458 n-d-860284-1 devstack@n-api.service[134101]: INFO oslo.messaging._drivers.impl_rabbit [None req-a15e89c9-346e-49e3-b3bc-26b7b4d17ab0 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] [54f0993b-fb22-4e4c-ae00-e3f0e5da4c18] Reconnected to AMQP server on 10.222.0.43:5672 via [amqp] client with port 39898. Oct 04 23:22:57.822539 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-a15e89c9-346e-49e3-b3bc-26b7b4d17ab0 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-257838368" status: 202 len: 0 microversion: 2.1 time: 1.042255 Oct 04 23:22:57.823143 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4382/7940] 10.222.0.43 () {58 vars in 1281 bytes} [Tue Oct 4 23:22:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-257838368 => generated 0 bytes in 1044 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 23:22:57.856242 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-f368cb52-040b-4be5-93c8-1a541dc58d6d tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Action: 'create', calling method: .version_select at 0x7fbb37438e50>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-2064909144", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAqt9laJE14W0bFkzMrWoL9AyJY1CY1f5+6Bqlwx+Yqh9NpZGNIE/kcuG3yfRdSdQ1FO51jfVwzqHjotEHl22Cu2mgTXpmAZzP7Y+9fBOSHT7D1BgHiucUJJafD/eDzOVQ=="}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 23:22:57.874096 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-f368cb52-040b-4be5-93c8-1a541dc58d6d tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Getting quotas for project 339847fffad841c59cd6f9e3439eb420. Resources: {'key_pairs'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 23:22:57.880019 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-f368cb52-040b-4be5-93c8-1a541dc58d6d tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Getting quotas for user 7124fd831f0d4ce8b561d79639b5f272 and project 339847fffad841c59cd6f9e3439eb420. Resources: {'key_pairs'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 23:22:57.903919 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-f368cb52-040b-4be5-93c8-1a541dc58d6d tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.051676 Oct 04 23:22:57.904563 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3559/7941] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Oct 4 23:22:57 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 23:23:03.382103 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-13560bc4-e6e0-4c94-9930-6d8049c98952 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-469142430", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452", "networks": [{"uuid": "96135899-7582-4b14-b058-83cd217ad608"}], "key_name": "tempest-TestNetworkAdvancedServerOps-2064909144", "security_groups": [{"name": "tempest-secgroup-smoke-1225454143"}]}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 23:23:03.396236 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:23:03.508597 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.network.neutron [None req-13560bc4-e6e0-4c94-9930-6d8049c98952 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] validate_networks() for [('96135899-7582-4b14-b058-83cd217ad608', None, None, None, None, None)] {{(pid=134101) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 23:23:03.972370 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-13560bc4-e6e0-4c94-9930-6d8049c98952 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Flavor limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 23:23:03.973657 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-13560bc4-e6e0-4c94-9930-6d8049c98952 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Image limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 23:23:03.974220 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-13560bc4-e6e0-4c94-9930-6d8049c98952 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Flavor pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 23:23:03.974808 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-13560bc4-e6e0-4c94-9930-6d8049c98952 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Image pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 23:23:03.975563 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-13560bc4-e6e0-4c94-9930-6d8049c98952 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 23:23:03.984582 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-13560bc4-e6e0-4c94-9930-6d8049c98952 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:23:03.985180 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-13560bc4-e6e0-4c94-9930-6d8049c98952 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:23:03.985703 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-13560bc4-e6e0-4c94-9930-6d8049c98952 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:23:03.986553 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-13560bc4-e6e0-4c94-9930-6d8049c98952 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:23:03.987093 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-13560bc4-e6e0-4c94-9930-6d8049c98952 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:23:03.987606 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-13560bc4-e6e0-4c94-9930-6d8049c98952 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:23:04.006455 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-13560bc4-e6e0-4c94-9930-6d8049c98952 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Getting quotas for project 339847fffad841c59cd6f9e3439eb420. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 23:23:04.012074 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-13560bc4-e6e0-4c94-9930-6d8049c98952 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Getting quotas for user 7124fd831f0d4ce8b561d79639b5f272 and project 339847fffad841c59cd6f9e3439eb420. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 23:23:04.025124 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-13560bc4-e6e0-4c94-9930-6d8049c98952 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Going to run 1 instances... {{(pid=134101) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 23:23:04.027583 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-13560bc4-e6e0-4c94-9930-6d8049c98952 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] [instance: 24a5eaf9-f8cf-4b02-88a5-cb57a4e51742] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='58548514-5dac-426c-81f5-19e3fba33e23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134101) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 23:23:04.072627 n-d-860284-1 devstack@n-api.service[134101]: ERROR oslo.messaging._drivers.impl_rabbit [None req-13560bc4-e6e0-4c94-9930-6d8049c98952 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] [a0705614-f64e-4f2c-9d91-c9cad833fc6d] AMQP server on 10.222.0.43:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 23:23:05.080900 n-d-860284-1 devstack@n-api.service[134101]: INFO oslo.messaging._drivers.impl_rabbit [None req-13560bc4-e6e0-4c94-9930-6d8049c98952 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] [a0705614-f64e-4f2c-9d91-c9cad833fc6d] Reconnected to AMQP server on 10.222.0.43:5672 via [amqp] client with port 39948. Oct 04 23:23:05.085365 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-13560bc4-e6e0-4c94-9930-6d8049c98952 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.707297 Oct 04 23:23:05.086468 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4383/7942] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 23:23:03 2022] POST /compute/v2.1/servers => generated 406 bytes in 1709 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 23:23:05.095480 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=16 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:23:05.100819 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-4e8c4202-36cc-4491-a62c-e60df0d88fd1 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:23:05.101694 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-4e8c4202-36cc-4491-a62c-e60df0d88fd1 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] [instance: 24a5eaf9-f8cf-4b02-88a5-cb57a4e51742] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:23:05.165477 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-4e8c4202-36cc-4491-a62c-e60df0d88fd1 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7124fd831f0d4ce8b561d79639b5f272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339847fffad841c59cd6f9e3439eb420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:23:05.172876 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-4e8c4202-36cc-4491-a62c-e60df0d88fd1 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] 10.222.0.43 "GET /compute/v2.1/servers/24a5eaf9-f8cf-4b02-88a5-cb57a4e51742" status: 200 len: 1266 microversion: 2.1 time: 0.079019 Oct 04 23:23:05.174669 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3560/7943] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:23:05 2022] GET /compute/v2.1/servers/24a5eaf9-f8cf-4b02-88a5-cb57a4e51742 => generated 1266 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:23:06.198828 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-ee98150d-4cb2-4db1-9066-b45c3455ce48 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:23:06.199548 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-ee98150d-4cb2-4db1-9066-b45c3455ce48 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] [instance: 24a5eaf9-f8cf-4b02-88a5-cb57a4e51742] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:23:06.206874 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ee98150d-4cb2-4db1-9066-b45c3455ce48 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:23:06.207897 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ee98150d-4cb2-4db1-9066-b45c3455ce48 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:23:06.208368 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ee98150d-4cb2-4db1-9066-b45c3455ce48 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:23:06.209160 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ee98150d-4cb2-4db1-9066-b45c3455ce48 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:23:06.209629 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ee98150d-4cb2-4db1-9066-b45c3455ce48 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:23:06.210068 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ee98150d-4cb2-4db1-9066-b45c3455ce48 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:23:06.272030 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-ee98150d-4cb2-4db1-9066-b45c3455ce48 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7124fd831f0d4ce8b561d79639b5f272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339847fffad841c59cd6f9e3439eb420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:23:06.279770 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-ee98150d-4cb2-4db1-9066-b45c3455ce48 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] 10.222.0.43 "GET /compute/v2.1/servers/24a5eaf9-f8cf-4b02-88a5-cb57a4e51742" status: 200 len: 1270 microversion: 2.1 time: 0.085905 Oct 04 23:23:06.280340 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4384/7944] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:23:06 2022] GET /compute/v2.1/servers/24a5eaf9-f8cf-4b02-88a5-cb57a4e51742 => generated 1270 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:23:07.304070 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-59556274-7b8d-4644-9060-e699aa87b628 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:23:07.304681 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-59556274-7b8d-4644-9060-e699aa87b628 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] [instance: 24a5eaf9-f8cf-4b02-88a5-cb57a4e51742] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:23:07.312988 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-59556274-7b8d-4644-9060-e699aa87b628 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:23:07.313589 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-59556274-7b8d-4644-9060-e699aa87b628 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:23:07.314094 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-59556274-7b8d-4644-9060-e699aa87b628 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:23:07.314898 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-59556274-7b8d-4644-9060-e699aa87b628 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:23:07.315428 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-59556274-7b8d-4644-9060-e699aa87b628 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:23:07.315929 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-59556274-7b8d-4644-9060-e699aa87b628 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:23:07.380487 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-59556274-7b8d-4644-9060-e699aa87b628 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7124fd831f0d4ce8b561d79639b5f272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339847fffad841c59cd6f9e3439eb420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:23:07.389232 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-59556274-7b8d-4644-9060-e699aa87b628 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] 10.222.0.43 "GET /compute/v2.1/servers/24a5eaf9-f8cf-4b02-88a5-cb57a4e51742" status: 200 len: 1318 microversion: 2.1 time: 0.089733 Oct 04 23:23:07.389822 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3561/7945] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:23:07 2022] GET /compute/v2.1/servers/24a5eaf9-f8cf-4b02-88a5-cb57a4e51742 => generated 1318 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 23:23:08.412584 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-f6d9e290-a311-4474-a6de-ff56b8355786 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:23:08.413128 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-f6d9e290-a311-4474-a6de-ff56b8355786 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] [instance: 24a5eaf9-f8cf-4b02-88a5-cb57a4e51742] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:23:08.420027 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f6d9e290-a311-4474-a6de-ff56b8355786 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:23:08.420532 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f6d9e290-a311-4474-a6de-ff56b8355786 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:23:08.420989 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f6d9e290-a311-4474-a6de-ff56b8355786 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:23:08.421697 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f6d9e290-a311-4474-a6de-ff56b8355786 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:23:08.422196 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f6d9e290-a311-4474-a6de-ff56b8355786 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:23:08.422667 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f6d9e290-a311-4474-a6de-ff56b8355786 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:23:08.643768 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-f6d9e290-a311-4474-a6de-ff56b8355786 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7124fd831f0d4ce8b561d79639b5f272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339847fffad841c59cd6f9e3439eb420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:23:08.652339 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-f6d9e290-a311-4474-a6de-ff56b8355786 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] 10.222.0.43 "GET /compute/v2.1/servers/24a5eaf9-f8cf-4b02-88a5-cb57a4e51742" status: 200 len: 1392 microversion: 2.1 time: 0.243845 Oct 04 23:23:08.653153 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4385/7946] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:23:08 2022] GET /compute/v2.1/servers/24a5eaf9-f8cf-4b02-88a5-cb57a4e51742 => generated 1392 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:23:09.043503 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-aba7008e-64ad-4fbe-8a05-95fbba0d810c req-e7e64e32-744a-4f9a-92cf-274625b7f529 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24a5eaf9-f8cf-4b02-88a5-cb57a4e51742", "tag": "9d770989-f06b-4faa-af9e-243be33e4868"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 23:23:09.053345 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-aba7008e-64ad-4fbe-8a05-95fbba0d810c req-e7e64e32-744a-4f9a-92cf-274625b7f529 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:23:09.053838 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-aba7008e-64ad-4fbe-8a05-95fbba0d810c req-e7e64e32-744a-4f9a-92cf-274625b7f529 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:23:09.054278 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-aba7008e-64ad-4fbe-8a05-95fbba0d810c req-e7e64e32-744a-4f9a-92cf-274625b7f529 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:23:09.068660 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-aba7008e-64ad-4fbe-8a05-95fbba0d810c req-e7e64e32-744a-4f9a-92cf-274625b7f529 service nova] Creating event network-changed:9d770989-f06b-4faa-af9e-243be33e4868 for instance 24a5eaf9-f8cf-4b02-88a5-cb57a4e51742 on n-h2-860284-1 Oct 04 23:23:09.074290 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-aba7008e-64ad-4fbe-8a05-95fbba0d810c req-e7e64e32-744a-4f9a-92cf-274625b7f529 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.164517 Oct 04 23:23:09.074925 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3562/7947] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 23:23:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 23:23:09.676386 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-69ad52cc-4f29-47fc-a7d6-414a3b8bf9ef tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:23:09.677042 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-69ad52cc-4f29-47fc-a7d6-414a3b8bf9ef tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] [instance: 24a5eaf9-f8cf-4b02-88a5-cb57a4e51742] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:23:09.683884 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-69ad52cc-4f29-47fc-a7d6-414a3b8bf9ef tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:23:09.684394 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-69ad52cc-4f29-47fc-a7d6-414a3b8bf9ef tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:23:09.684855 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-69ad52cc-4f29-47fc-a7d6-414a3b8bf9ef tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:23:09.685634 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-69ad52cc-4f29-47fc-a7d6-414a3b8bf9ef tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:23:09.686188 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-69ad52cc-4f29-47fc-a7d6-414a3b8bf9ef tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:23:09.686702 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-69ad52cc-4f29-47fc-a7d6-414a3b8bf9ef tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:23:09.822922 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-69ad52cc-4f29-47fc-a7d6-414a3b8bf9ef tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7124fd831f0d4ce8b561d79639b5f272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339847fffad841c59cd6f9e3439eb420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:23:09.830668 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-69ad52cc-4f29-47fc-a7d6-414a3b8bf9ef tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] 10.222.0.43 "GET /compute/v2.1/servers/24a5eaf9-f8cf-4b02-88a5-cb57a4e51742" status: 200 len: 1392 microversion: 2.1 time: 0.158326 Oct 04 23:23:09.831245 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4386/7948] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:23:09 2022] GET /compute/v2.1/servers/24a5eaf9-f8cf-4b02-88a5-cb57a4e51742 => generated 1392 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:23:10.856011 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-e8866de5-25e8-4b31-81a2-0163cf6c167f tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:23:10.856718 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-e8866de5-25e8-4b31-81a2-0163cf6c167f tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] [instance: 24a5eaf9-f8cf-4b02-88a5-cb57a4e51742] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:23:10.863987 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e8866de5-25e8-4b31-81a2-0163cf6c167f tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:23:10.864471 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e8866de5-25e8-4b31-81a2-0163cf6c167f tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:23:10.864912 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e8866de5-25e8-4b31-81a2-0163cf6c167f tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:23:10.865620 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e8866de5-25e8-4b31-81a2-0163cf6c167f tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:23:10.866086 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e8866de5-25e8-4b31-81a2-0163cf6c167f tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:23:10.866542 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e8866de5-25e8-4b31-81a2-0163cf6c167f tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:23:11.024140 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-e8866de5-25e8-4b31-81a2-0163cf6c167f tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7124fd831f0d4ce8b561d79639b5f272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339847fffad841c59cd6f9e3439eb420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:23:11.032338 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-e8866de5-25e8-4b31-81a2-0163cf6c167f tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] 10.222.0.43 "GET /compute/v2.1/servers/24a5eaf9-f8cf-4b02-88a5-cb57a4e51742" status: 200 len: 1392 microversion: 2.1 time: 0.180580 Oct 04 23:23:11.032940 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3563/7949] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:23:10 2022] GET /compute/v2.1/servers/24a5eaf9-f8cf-4b02-88a5-cb57a4e51742 => generated 1392 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:23:12.056664 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-109d13f5-897a-4a71-b414-1a2ece2db58e tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:23:12.057374 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-109d13f5-897a-4a71-b414-1a2ece2db58e tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] [instance: 24a5eaf9-f8cf-4b02-88a5-cb57a4e51742] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:23:12.064647 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-109d13f5-897a-4a71-b414-1a2ece2db58e tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:23:12.065158 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-109d13f5-897a-4a71-b414-1a2ece2db58e tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:23:12.065619 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-109d13f5-897a-4a71-b414-1a2ece2db58e tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:23:12.066424 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-109d13f5-897a-4a71-b414-1a2ece2db58e tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:23:12.066853 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-109d13f5-897a-4a71-b414-1a2ece2db58e tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:23:12.067300 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-109d13f5-897a-4a71-b414-1a2ece2db58e tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:23:12.359160 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-109d13f5-897a-4a71-b414-1a2ece2db58e tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7124fd831f0d4ce8b561d79639b5f272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339847fffad841c59cd6f9e3439eb420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:23:12.367309 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-109d13f5-897a-4a71-b414-1a2ece2db58e tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] 10.222.0.43 "GET /compute/v2.1/servers/24a5eaf9-f8cf-4b02-88a5-cb57a4e51742" status: 200 len: 1392 microversion: 2.1 time: 0.314651 Oct 04 23:23:12.367891 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4387/7950] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:23:12 2022] GET /compute/v2.1/servers/24a5eaf9-f8cf-4b02-88a5-cb57a4e51742 => generated 1392 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 23:23:13.390190 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-d59b995d-0176-4b27-a913-69b80faff428 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:23:13.390841 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-d59b995d-0176-4b27-a913-69b80faff428 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] [instance: 24a5eaf9-f8cf-4b02-88a5-cb57a4e51742] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:23:13.398323 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d59b995d-0176-4b27-a913-69b80faff428 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:23:13.398840 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d59b995d-0176-4b27-a913-69b80faff428 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:23:13.399285 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d59b995d-0176-4b27-a913-69b80faff428 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:23:13.399995 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d59b995d-0176-4b27-a913-69b80faff428 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:23:13.400460 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d59b995d-0176-4b27-a913-69b80faff428 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:23:13.400896 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d59b995d-0176-4b27-a913-69b80faff428 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:23:13.534587 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-d59b995d-0176-4b27-a913-69b80faff428 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7124fd831f0d4ce8b561d79639b5f272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339847fffad841c59cd6f9e3439eb420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:23:13.543176 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-d59b995d-0176-4b27-a913-69b80faff428 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] 10.222.0.43 "GET /compute/v2.1/servers/24a5eaf9-f8cf-4b02-88a5-cb57a4e51742" status: 200 len: 1392 microversion: 2.1 time: 0.156997 Oct 04 23:23:13.543771 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3564/7951] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:23:13 2022] GET /compute/v2.1/servers/24a5eaf9-f8cf-4b02-88a5-cb57a4e51742 => generated 1392 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:23:14.567621 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-16089984-d35e-4154-840b-be91174e727a tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:23:14.568323 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-16089984-d35e-4154-840b-be91174e727a tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] [instance: 24a5eaf9-f8cf-4b02-88a5-cb57a4e51742] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:23:14.571004 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=2 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:23:14.571691 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=6 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:23:14.577681 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-16089984-d35e-4154-840b-be91174e727a tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:23:14.578186 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-16089984-d35e-4154-840b-be91174e727a tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:23:14.578669 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-16089984-d35e-4154-840b-be91174e727a tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:23:14.579398 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-16089984-d35e-4154-840b-be91174e727a tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:23:14.579874 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-16089984-d35e-4154-840b-be91174e727a tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:23:14.580318 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-16089984-d35e-4154-840b-be91174e727a tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:23:14.715595 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-16089984-d35e-4154-840b-be91174e727a tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7124fd831f0d4ce8b561d79639b5f272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339847fffad841c59cd6f9e3439eb420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:23:14.723490 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-16089984-d35e-4154-840b-be91174e727a tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] 10.222.0.43 "GET /compute/v2.1/servers/24a5eaf9-f8cf-4b02-88a5-cb57a4e51742" status: 200 len: 1392 microversion: 2.1 time: 0.160271 Oct 04 23:23:14.724073 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4388/7952] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:23:14 2022] GET /compute/v2.1/servers/24a5eaf9-f8cf-4b02-88a5-cb57a4e51742 => generated 1392 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:23:15.747968 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-3228f864-06c0-4268-ba48-03f108dbb082 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:23:15.748705 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-3228f864-06c0-4268-ba48-03f108dbb082 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] [instance: 24a5eaf9-f8cf-4b02-88a5-cb57a4e51742] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:23:15.751402 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell0:SELECT=6 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:23:15.756899 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3228f864-06c0-4268-ba48-03f108dbb082 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:23:15.757396 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3228f864-06c0-4268-ba48-03f108dbb082 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:23:15.757843 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3228f864-06c0-4268-ba48-03f108dbb082 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:23:15.758588 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3228f864-06c0-4268-ba48-03f108dbb082 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:23:15.759055 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3228f864-06c0-4268-ba48-03f108dbb082 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:23:15.759491 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3228f864-06c0-4268-ba48-03f108dbb082 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:23:15.894250 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-3228f864-06c0-4268-ba48-03f108dbb082 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7124fd831f0d4ce8b561d79639b5f272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339847fffad841c59cd6f9e3439eb420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:23:15.902716 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-3228f864-06c0-4268-ba48-03f108dbb082 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] 10.222.0.43 "GET /compute/v2.1/servers/24a5eaf9-f8cf-4b02-88a5-cb57a4e51742" status: 200 len: 1392 microversion: 2.1 time: 0.158711 Oct 04 23:23:15.903317 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3565/7953] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:23:15 2022] GET /compute/v2.1/servers/24a5eaf9-f8cf-4b02-88a5-cb57a4e51742 => generated 1392 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:23:15.968148 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-d14ced08-8878-4efc-b69d-af4904d705b8 req-67c298a6-7423-421e-860e-3925d316e44a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24a5eaf9-f8cf-4b02-88a5-cb57a4e51742", "name": "network-vif-plugged", "status": "completed", "tag": "9d770989-f06b-4faa-af9e-243be33e4868"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 23:23:15.980325 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-d14ced08-8878-4efc-b69d-af4904d705b8 req-67c298a6-7423-421e-860e-3925d316e44a service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:23:15.980836 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-d14ced08-8878-4efc-b69d-af4904d705b8 req-67c298a6-7423-421e-860e-3925d316e44a service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:23:15.981282 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-d14ced08-8878-4efc-b69d-af4904d705b8 req-67c298a6-7423-421e-860e-3925d316e44a service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:23:15.996197 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-d14ced08-8878-4efc-b69d-af4904d705b8 req-67c298a6-7423-421e-860e-3925d316e44a service nova] Creating event network-vif-plugged:9d770989-f06b-4faa-af9e-243be33e4868 for instance 24a5eaf9-f8cf-4b02-88a5-cb57a4e51742 on n-h2-860284-1 Oct 04 23:23:16.002028 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-d14ced08-8878-4efc-b69d-af4904d705b8 req-67c298a6-7423-421e-860e-3925d316e44a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037807 Oct 04 23:23:16.002721 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4389/7954] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 23:23:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 23:23:16.926106 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-304c9c5f-c65e-44e3-9e0e-436a415e9834 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:23:16.927346 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-304c9c5f-c65e-44e3-9e0e-436a415e9834 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] [instance: 24a5eaf9-f8cf-4b02-88a5-cb57a4e51742] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:23:16.934228 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-304c9c5f-c65e-44e3-9e0e-436a415e9834 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:23:16.934742 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-304c9c5f-c65e-44e3-9e0e-436a415e9834 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:23:16.935183 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-304c9c5f-c65e-44e3-9e0e-436a415e9834 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:23:16.935872 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-304c9c5f-c65e-44e3-9e0e-436a415e9834 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:23:16.936326 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-304c9c5f-c65e-44e3-9e0e-436a415e9834 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:23:16.936783 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-304c9c5f-c65e-44e3-9e0e-436a415e9834 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:23:17.356546 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-304c9c5f-c65e-44e3-9e0e-436a415e9834 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7124fd831f0d4ce8b561d79639b5f272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339847fffad841c59cd6f9e3439eb420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:23:17.364414 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-304c9c5f-c65e-44e3-9e0e-436a415e9834 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] 10.222.0.43 "GET /compute/v2.1/servers/24a5eaf9-f8cf-4b02-88a5-cb57a4e51742" status: 200 len: 1392 microversion: 2.1 time: 0.442080 Oct 04 23:23:17.365012 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3566/7955] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:23:16 2022] GET /compute/v2.1/servers/24a5eaf9-f8cf-4b02-88a5-cb57a4e51742 => generated 1392 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:23:18.389147 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-5ab83b7e-0f15-4139-b369-8374c249059d tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:23:18.389783 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-5ab83b7e-0f15-4139-b369-8374c249059d tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] [instance: 24a5eaf9-f8cf-4b02-88a5-cb57a4e51742] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:23:18.396534 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5ab83b7e-0f15-4139-b369-8374c249059d tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:23:18.397031 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5ab83b7e-0f15-4139-b369-8374c249059d tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:23:18.397486 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5ab83b7e-0f15-4139-b369-8374c249059d tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:23:18.398193 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5ab83b7e-0f15-4139-b369-8374c249059d tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:23:18.398694 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5ab83b7e-0f15-4139-b369-8374c249059d tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:23:18.399139 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5ab83b7e-0f15-4139-b369-8374c249059d tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:23:18.530426 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-5ab83b7e-0f15-4139-b369-8374c249059d tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7124fd831f0d4ce8b561d79639b5f272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339847fffad841c59cd6f9e3439eb420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:23:18.539029 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-5ab83b7e-0f15-4139-b369-8374c249059d tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] 10.222.0.43 "GET /compute/v2.1/servers/24a5eaf9-f8cf-4b02-88a5-cb57a4e51742" status: 200 len: 1564 microversion: 2.1 time: 0.155636 Oct 04 23:23:18.539599 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4390/7956] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:23:18 2022] GET /compute/v2.1/servers/24a5eaf9-f8cf-4b02-88a5-cb57a4e51742 => generated 1564 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:23:18.561970 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-4997db33-53bb-4000-8fc9-cccced58acf8 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:23:18.562732 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-4997db33-53bb-4000-8fc9-cccced58acf8 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] [instance: 24a5eaf9-f8cf-4b02-88a5-cb57a4e51742] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:23:18.569676 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4997db33-53bb-4000-8fc9-cccced58acf8 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:23:18.570172 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4997db33-53bb-4000-8fc9-cccced58acf8 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:23:18.570653 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4997db33-53bb-4000-8fc9-cccced58acf8 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:23:18.571356 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4997db33-53bb-4000-8fc9-cccced58acf8 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:23:18.571819 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4997db33-53bb-4000-8fc9-cccced58acf8 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:23:18.572255 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4997db33-53bb-4000-8fc9-cccced58acf8 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:23:18.702796 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-4997db33-53bb-4000-8fc9-cccced58acf8 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7124fd831f0d4ce8b561d79639b5f272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339847fffad841c59cd6f9e3439eb420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:23:18.713237 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-4997db33-53bb-4000-8fc9-cccced58acf8 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] 10.222.0.43 "GET /compute/v2.1/servers/24a5eaf9-f8cf-4b02-88a5-cb57a4e51742" status: 200 len: 1564 microversion: 2.1 time: 0.155074 Oct 04 23:23:18.713822 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3567/7957] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:23:18 2022] GET /compute/v2.1/servers/24a5eaf9-f8cf-4b02-88a5-cb57a4e51742 => generated 1564 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:23:20.314355 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-87a6ee9d-8739-446f-8515-689b60975933 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:23:20.315013 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-87a6ee9d-8739-446f-8515-689b60975933 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] [instance: 24a5eaf9-f8cf-4b02-88a5-cb57a4e51742] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:23:20.316992 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-b56db2ef-b48a-4229-a586-b721fc712cd3 req-325cefd1-36aa-4c90-93f2-49bee265d373 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24a5eaf9-f8cf-4b02-88a5-cb57a4e51742", "tag": "9d770989-f06b-4faa-af9e-243be33e4868"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 23:23:20.318323 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:23:20.324753 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:23:20.327161 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-87a6ee9d-8739-446f-8515-689b60975933 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:23:20.327676 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-87a6ee9d-8739-446f-8515-689b60975933 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:23:20.328160 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-87a6ee9d-8739-446f-8515-689b60975933 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:23:20.329524 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-87a6ee9d-8739-446f-8515-689b60975933 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:23:20.329655 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-b56db2ef-b48a-4229-a586-b721fc712cd3 req-325cefd1-36aa-4c90-93f2-49bee265d373 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:23:20.329759 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-87a6ee9d-8739-446f-8515-689b60975933 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:23:20.329851 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-b56db2ef-b48a-4229-a586-b721fc712cd3 req-325cefd1-36aa-4c90-93f2-49bee265d373 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:23:20.330083 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-87a6ee9d-8739-446f-8515-689b60975933 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:23:20.330200 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-b56db2ef-b48a-4229-a586-b721fc712cd3 req-325cefd1-36aa-4c90-93f2-49bee265d373 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:23:20.345268 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-b56db2ef-b48a-4229-a586-b721fc712cd3 req-325cefd1-36aa-4c90-93f2-49bee265d373 service nova] Creating event network-changed:9d770989-f06b-4faa-af9e-243be33e4868 for instance 24a5eaf9-f8cf-4b02-88a5-cb57a4e51742 on n-h2-860284-1 Oct 04 23:23:20.351038 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-b56db2ef-b48a-4229-a586-b721fc712cd3 req-325cefd1-36aa-4c90-93f2-49bee265d373 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037763 Oct 04 23:23:20.351972 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3568/7958] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 23:23:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 23:23:20.571533 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-87a6ee9d-8739-446f-8515-689b60975933 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7124fd831f0d4ce8b561d79639b5f272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339847fffad841c59cd6f9e3439eb420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:23:20.579740 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-87a6ee9d-8739-446f-8515-689b60975933 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] 10.222.0.43 "GET /compute/v2.1/servers/24a5eaf9-f8cf-4b02-88a5-cb57a4e51742" status: 200 len: 1564 microversion: 2.1 time: 0.269204 Oct 04 23:23:20.594389 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4391/7959] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:23:20 2022] GET /compute/v2.1/servers/24a5eaf9-f8cf-4b02-88a5-cb57a4e51742 => generated 1564 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:23:53.863546 n-d-860284-1 devstack@n-api.service[134102]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 23:23:53.864133 n-d-860284-1 devstack@n-api.service[134102]: Tue Oct 4 23:23:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/24a5eaf9-f8cf-4b02-88a5-cb57a4e51742/action (ip 10.222.0.43) !!! Oct 04 23:23:53.865578 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=40 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:23:53.866327 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_api:SELECT=1 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:23:53.870756 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-ffa9590e-7a05-4f80-8c9e-1daf9b61a13f tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 23:23:53.872932 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-ffa9590e-7a05-4f80-8c9e-1daf9b61a13f tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] [instance: 24a5eaf9-f8cf-4b02-88a5-cb57a4e51742] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:23:53.883133 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ffa9590e-7a05-4f80-8c9e-1daf9b61a13f tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:23:53.883622 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ffa9590e-7a05-4f80-8c9e-1daf9b61a13f tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:23:53.884064 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ffa9590e-7a05-4f80-8c9e-1daf9b61a13f tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:23:53.884759 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ffa9590e-7a05-4f80-8c9e-1daf9b61a13f tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:23:53.885216 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ffa9590e-7a05-4f80-8c9e-1daf9b61a13f tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:23:53.885643 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ffa9590e-7a05-4f80-8c9e-1daf9b61a13f tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:23:53.946917 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-ffa9590e-7a05-4f80-8c9e-1daf9b61a13f tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] 10.222.0.43 "POST /compute/v2.1/servers/24a5eaf9-f8cf-4b02-88a5-cb57a4e51742/action" status: 200 len: 24571 microversion: 2.1 time: 0.085446 Oct 04 23:23:53.947566 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3569/7960] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 23:23:53 2022] POST /compute/v2.1/servers/24a5eaf9-f8cf-4b02-88a5-cb57a4e51742/action => generated 24571 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 23:24:24.347937 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=1 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:24:24.348830 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=46 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:24:24.352912 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-2974b39c-047d-4892-9667-fc171e7c8156 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 23:24:24.353459 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-2974b39c-047d-4892-9667-fc171e7c8156 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] [instance: 24a5eaf9-f8cf-4b02-88a5-cb57a4e51742] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:24:24.360474 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2974b39c-047d-4892-9667-fc171e7c8156 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:24:24.360967 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2974b39c-047d-4892-9667-fc171e7c8156 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:24:24.361412 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2974b39c-047d-4892-9667-fc171e7c8156 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:24:24.362109 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2974b39c-047d-4892-9667-fc171e7c8156 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:24:24.362596 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2974b39c-047d-4892-9667-fc171e7c8156 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:24:24.363027 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2974b39c-047d-4892-9667-fc171e7c8156 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:24:24.387357 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.objects.instance [None req-2974b39c-047d-4892-9667-fc171e7c8156 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lazy-loading 'flavor' on Instance uuid 24a5eaf9-f8cf-4b02-88a5-cb57a4e51742 {{(pid=134101) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 23:24:24.452520 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-2974b39c-047d-4892-9667-fc171e7c8156 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] 10.222.0.43 "POST /compute/v2.1/servers/24a5eaf9-f8cf-4b02-88a5-cb57a4e51742/action" status: 202 len: 0 microversion: 2.1 time: 0.106276 Oct 04 23:24:24.453218 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4392/7961] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 23:24:24 2022] POST /compute/v2.1/servers/24a5eaf9-f8cf-4b02-88a5-cb57a4e51742/action => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 23:24:24.461981 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-fa142cf6-8c40-4c04-b89b-3d2dccd2288b tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:24:24.462718 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-fa142cf6-8c40-4c04-b89b-3d2dccd2288b tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] [instance: 24a5eaf9-f8cf-4b02-88a5-cb57a4e51742] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:24:24.465334 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_api:SELECT=2 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:24:24.466331 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=4 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:24:24.472490 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fa142cf6-8c40-4c04-b89b-3d2dccd2288b tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:24:24.472980 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fa142cf6-8c40-4c04-b89b-3d2dccd2288b tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:24:24.473955 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fa142cf6-8c40-4c04-b89b-3d2dccd2288b tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:24:24.474715 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fa142cf6-8c40-4c04-b89b-3d2dccd2288b tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:24:24.475140 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fa142cf6-8c40-4c04-b89b-3d2dccd2288b tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:24:24.475562 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-fa142cf6-8c40-4c04-b89b-3d2dccd2288b tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:24:24.610845 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-fa142cf6-8c40-4c04-b89b-3d2dccd2288b tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7124fd831f0d4ce8b561d79639b5f272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339847fffad841c59cd6f9e3439eb420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:24:24.619453 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-fa142cf6-8c40-4c04-b89b-3d2dccd2288b tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] 10.222.0.43 "GET /compute/v2.1/servers/24a5eaf9-f8cf-4b02-88a5-cb57a4e51742" status: 200 len: 1690 microversion: 2.1 time: 0.161842 Oct 04 23:24:24.620040 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3570/7962] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:24:24 2022] GET /compute/v2.1/servers/24a5eaf9-f8cf-4b02-88a5-cb57a4e51742 => generated 1690 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:24:25.647211 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-c3e6e786-ffc5-4f01-9e00-6dad01b4a00b tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:24:25.647938 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-c3e6e786-ffc5-4f01-9e00-6dad01b4a00b tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] [instance: 24a5eaf9-f8cf-4b02-88a5-cb57a4e51742] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:24:25.654169 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c3e6e786-ffc5-4f01-9e00-6dad01b4a00b tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:24:25.654707 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c3e6e786-ffc5-4f01-9e00-6dad01b4a00b tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:24:25.655169 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c3e6e786-ffc5-4f01-9e00-6dad01b4a00b tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:24:25.655879 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c3e6e786-ffc5-4f01-9e00-6dad01b4a00b tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:24:25.656355 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c3e6e786-ffc5-4f01-9e00-6dad01b4a00b tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:24:25.656802 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c3e6e786-ffc5-4f01-9e00-6dad01b4a00b tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:24:25.793296 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-c3e6e786-ffc5-4f01-9e00-6dad01b4a00b tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7124fd831f0d4ce8b561d79639b5f272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339847fffad841c59cd6f9e3439eb420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:24:25.801085 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-c3e6e786-ffc5-4f01-9e00-6dad01b4a00b tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] 10.222.0.43 "GET /compute/v2.1/servers/24a5eaf9-f8cf-4b02-88a5-cb57a4e51742" status: 200 len: 1690 microversion: 2.1 time: 0.159938 Oct 04 23:24:25.802187 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4393/7963] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:24:25 2022] GET /compute/v2.1/servers/24a5eaf9-f8cf-4b02-88a5-cb57a4e51742 => generated 1690 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:24:26.825799 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-01ac1732-e9d3-4a08-bca1-de854b2caeeb tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:24:26.826434 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-01ac1732-e9d3-4a08-bca1-de854b2caeeb tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] [instance: 24a5eaf9-f8cf-4b02-88a5-cb57a4e51742] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:24:26.833993 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-01ac1732-e9d3-4a08-bca1-de854b2caeeb tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:24:26.834511 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-01ac1732-e9d3-4a08-bca1-de854b2caeeb tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:24:26.834954 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-01ac1732-e9d3-4a08-bca1-de854b2caeeb tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:24:26.835648 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-01ac1732-e9d3-4a08-bca1-de854b2caeeb tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:24:26.836106 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-01ac1732-e9d3-4a08-bca1-de854b2caeeb tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:24:26.836535 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-01ac1732-e9d3-4a08-bca1-de854b2caeeb tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:24:26.968157 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-01ac1732-e9d3-4a08-bca1-de854b2caeeb tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7124fd831f0d4ce8b561d79639b5f272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339847fffad841c59cd6f9e3439eb420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:24:26.976704 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-01ac1732-e9d3-4a08-bca1-de854b2caeeb tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] 10.222.0.43 "GET /compute/v2.1/servers/24a5eaf9-f8cf-4b02-88a5-cb57a4e51742" status: 200 len: 1673 microversion: 2.1 time: 0.154935 Oct 04 23:24:26.977326 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3571/7964] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:24:26 2022] GET /compute/v2.1/servers/24a5eaf9-f8cf-4b02-88a5-cb57a4e51742 => generated 1673 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:24:28.074697 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-acc5828d-c164-428a-9da7-2f521218f5d3 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 23:24:28.076920 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-acc5828d-c164-428a-9da7-2f521218f5d3 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] [instance: 24a5eaf9-f8cf-4b02-88a5-cb57a4e51742] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:24:28.083914 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-acc5828d-c164-428a-9da7-2f521218f5d3 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:24:28.084415 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-acc5828d-c164-428a-9da7-2f521218f5d3 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:24:28.084865 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-acc5828d-c164-428a-9da7-2f521218f5d3 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:24:28.085572 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-acc5828d-c164-428a-9da7-2f521218f5d3 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:24:28.086043 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-acc5828d-c164-428a-9da7-2f521218f5d3 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:24:28.086517 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-acc5828d-c164-428a-9da7-2f521218f5d3 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:24:28.140496 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-acc5828d-c164-428a-9da7-2f521218f5d3 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] 10.222.0.43 "POST /compute/v2.1/servers/24a5eaf9-f8cf-4b02-88a5-cb57a4e51742/action" status: 200 len: 38185 microversion: 2.1 time: 0.069575 Oct 04 23:24:28.141153 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4394/7965] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 23:24:28 2022] POST /compute/v2.1/servers/24a5eaf9-f8cf-4b02-88a5-cb57a4e51742/action => generated 38185 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 23:24:28.153465 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-9a82a71a-d501-4f7e-a29b-490b62253f28 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 23:24:28.154009 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-9a82a71a-d501-4f7e-a29b-490b62253f28 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] [instance: 24a5eaf9-f8cf-4b02-88a5-cb57a4e51742] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:24:28.160892 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9a82a71a-d501-4f7e-a29b-490b62253f28 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:24:28.161380 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9a82a71a-d501-4f7e-a29b-490b62253f28 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:24:28.161821 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9a82a71a-d501-4f7e-a29b-490b62253f28 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:24:28.162615 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9a82a71a-d501-4f7e-a29b-490b62253f28 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:24:28.163228 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9a82a71a-d501-4f7e-a29b-490b62253f28 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:24:28.163668 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9a82a71a-d501-4f7e-a29b-490b62253f28 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:24:28.229967 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-9a82a71a-d501-4f7e-a29b-490b62253f28 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] 10.222.0.43 "POST /compute/v2.1/servers/24a5eaf9-f8cf-4b02-88a5-cb57a4e51742/action" status: 202 len: 0 microversion: 2.1 time: 0.080251 Oct 04 23:24:28.231064 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3572/7966] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 23:24:28 2022] POST /compute/v2.1/servers/24a5eaf9-f8cf-4b02-88a5-cb57a4e51742/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 23:24:28.240633 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-069ab05f-08b9-4f85-8b25-7e298ea671d8 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:24:28.241355 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-069ab05f-08b9-4f85-8b25-7e298ea671d8 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] [instance: 24a5eaf9-f8cf-4b02-88a5-cb57a4e51742] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:24:28.249772 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-069ab05f-08b9-4f85-8b25-7e298ea671d8 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:24:28.250278 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-069ab05f-08b9-4f85-8b25-7e298ea671d8 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:24:28.250775 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-069ab05f-08b9-4f85-8b25-7e298ea671d8 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:24:28.251501 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-069ab05f-08b9-4f85-8b25-7e298ea671d8 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:24:28.251973 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-069ab05f-08b9-4f85-8b25-7e298ea671d8 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:24:28.252448 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-069ab05f-08b9-4f85-8b25-7e298ea671d8 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:24:28.472279 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-069ab05f-08b9-4f85-8b25-7e298ea671d8 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7124fd831f0d4ce8b561d79639b5f272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339847fffad841c59cd6f9e3439eb420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:24:28.480492 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-069ab05f-08b9-4f85-8b25-7e298ea671d8 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] 10.222.0.43 "GET /compute/v2.1/servers/24a5eaf9-f8cf-4b02-88a5-cb57a4e51742" status: 200 len: 1679 microversion: 2.1 time: 0.244736 Oct 04 23:24:28.481292 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4395/7967] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:24:28 2022] GET /compute/v2.1/servers/24a5eaf9-f8cf-4b02-88a5-cb57a4e51742 => generated 1679 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:24:29.505706 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-62f246fe-3dbe-4065-a06c-9ee69a4e7066 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:24:29.506340 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-62f246fe-3dbe-4065-a06c-9ee69a4e7066 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] [instance: 24a5eaf9-f8cf-4b02-88a5-cb57a4e51742] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:24:29.512529 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-62f246fe-3dbe-4065-a06c-9ee69a4e7066 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:24:29.513015 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-62f246fe-3dbe-4065-a06c-9ee69a4e7066 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:24:29.513455 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-62f246fe-3dbe-4065-a06c-9ee69a4e7066 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:24:29.514148 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-62f246fe-3dbe-4065-a06c-9ee69a4e7066 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:24:29.514634 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-62f246fe-3dbe-4065-a06c-9ee69a4e7066 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:24:29.515065 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-62f246fe-3dbe-4065-a06c-9ee69a4e7066 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:24:29.648381 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-62f246fe-3dbe-4065-a06c-9ee69a4e7066 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7124fd831f0d4ce8b561d79639b5f272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339847fffad841c59cd6f9e3439eb420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:24:29.656110 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-62f246fe-3dbe-4065-a06c-9ee69a4e7066 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] 10.222.0.43 "GET /compute/v2.1/servers/24a5eaf9-f8cf-4b02-88a5-cb57a4e51742" status: 200 len: 1679 microversion: 2.1 time: 0.155719 Oct 04 23:24:29.656689 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3573/7968] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:24:29 2022] GET /compute/v2.1/servers/24a5eaf9-f8cf-4b02-88a5-cb57a4e51742 => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:24:30.679973 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-b5b02b30-33ef-4ec7-a1d1-b90bbd3bcb73 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:24:30.680875 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-b5b02b30-33ef-4ec7-a1d1-b90bbd3bcb73 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] [instance: 24a5eaf9-f8cf-4b02-88a5-cb57a4e51742] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:24:30.688071 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b5b02b30-33ef-4ec7-a1d1-b90bbd3bcb73 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:24:30.688573 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b5b02b30-33ef-4ec7-a1d1-b90bbd3bcb73 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:24:30.689031 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b5b02b30-33ef-4ec7-a1d1-b90bbd3bcb73 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:24:30.689743 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b5b02b30-33ef-4ec7-a1d1-b90bbd3bcb73 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:24:30.690215 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b5b02b30-33ef-4ec7-a1d1-b90bbd3bcb73 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:24:30.690694 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b5b02b30-33ef-4ec7-a1d1-b90bbd3bcb73 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:24:31.100117 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-b5b02b30-33ef-4ec7-a1d1-b90bbd3bcb73 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7124fd831f0d4ce8b561d79639b5f272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339847fffad841c59cd6f9e3439eb420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:24:31.108095 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-b5b02b30-33ef-4ec7-a1d1-b90bbd3bcb73 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] 10.222.0.43 "GET /compute/v2.1/servers/24a5eaf9-f8cf-4b02-88a5-cb57a4e51742" status: 200 len: 1682 microversion: 2.1 time: 0.432449 Oct 04 23:24:31.108661 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4396/7969] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:24:30 2022] GET /compute/v2.1/servers/24a5eaf9-f8cf-4b02-88a5-cb57a4e51742 => generated 1682 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:24:31.206993 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-475df239-7380-43ba-a1be-fc279796e621 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 23:24:31.209770 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-475df239-7380-43ba-a1be-fc279796e621 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] [instance: 24a5eaf9-f8cf-4b02-88a5-cb57a4e51742] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:24:31.216597 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-475df239-7380-43ba-a1be-fc279796e621 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:24:31.217091 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-475df239-7380-43ba-a1be-fc279796e621 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:24:31.217533 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-475df239-7380-43ba-a1be-fc279796e621 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:24:31.218224 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-475df239-7380-43ba-a1be-fc279796e621 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:24:31.218710 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-475df239-7380-43ba-a1be-fc279796e621 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:24:31.219140 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-475df239-7380-43ba-a1be-fc279796e621 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:24:31.273448 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-475df239-7380-43ba-a1be-fc279796e621 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] 10.222.0.43 "POST /compute/v2.1/servers/24a5eaf9-f8cf-4b02-88a5-cb57a4e51742/action" status: 200 len: 38185 microversion: 2.1 time: 0.070373 Oct 04 23:24:31.274104 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3574/7970] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 23:24:31 2022] POST /compute/v2.1/servers/24a5eaf9-f8cf-4b02-88a5-cb57a4e51742/action => generated 38185 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 23:24:32.241778 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-13ba363c-32cd-46cd-8e97-d95f0491b3fe tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:24:32.242310 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-13ba363c-32cd-46cd-8e97-d95f0491b3fe tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] [instance: 24a5eaf9-f8cf-4b02-88a5-cb57a4e51742] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:24:32.244459 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-e3cc8abe-9bca-4e5b-8942-a25f5a840514 req-a33ce55d-1531-4467-b2f7-f65bfe0abf26 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24a5eaf9-f8cf-4b02-88a5-cb57a4e51742", "tag": "9d770989-f06b-4faa-af9e-243be33e4868"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 23:24:32.248790 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-13ba363c-32cd-46cd-8e97-d95f0491b3fe tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:24:32.249290 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-13ba363c-32cd-46cd-8e97-d95f0491b3fe tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:24:32.249956 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-13ba363c-32cd-46cd-8e97-d95f0491b3fe tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:24:32.250693 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-13ba363c-32cd-46cd-8e97-d95f0491b3fe tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:24:32.251166 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-13ba363c-32cd-46cd-8e97-d95f0491b3fe tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:24:32.251603 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-13ba363c-32cd-46cd-8e97-d95f0491b3fe tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:24:32.256879 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-e3cc8abe-9bca-4e5b-8942-a25f5a840514 req-a33ce55d-1531-4467-b2f7-f65bfe0abf26 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:24:32.257457 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-e3cc8abe-9bca-4e5b-8942-a25f5a840514 req-a33ce55d-1531-4467-b2f7-f65bfe0abf26 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:24:32.257961 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-e3cc8abe-9bca-4e5b-8942-a25f5a840514 req-a33ce55d-1531-4467-b2f7-f65bfe0abf26 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:24:32.271842 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-e3cc8abe-9bca-4e5b-8942-a25f5a840514 req-a33ce55d-1531-4467-b2f7-f65bfe0abf26 service nova] Creating event network-changed:9d770989-f06b-4faa-af9e-243be33e4868 for instance 24a5eaf9-f8cf-4b02-88a5-cb57a4e51742 on n-h2-860284-1 Oct 04 23:24:32.277239 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-e3cc8abe-9bca-4e5b-8942-a25f5a840514 req-a33ce55d-1531-4467-b2f7-f65bfe0abf26 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037137 Oct 04 23:24:32.277939 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3575/7971] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 23:24:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 23:24:32.279096 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-13ba363c-32cd-46cd-8e97-d95f0491b3fe tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] [instance: 24a5eaf9-f8cf-4b02-88a5-cb57a4e51742] Going to try to terminate instance {{(pid=134101) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 23:24:32.364549 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-13ba363c-32cd-46cd-8e97-d95f0491b3fe tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] 10.222.0.43 "DELETE /compute/v2.1/servers/24a5eaf9-f8cf-4b02-88a5-cb57a4e51742" status: 204 len: 0 microversion: 2.1 time: 0.124713 Oct 04 23:24:32.365411 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4397/7972] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 23:24:32 2022] DELETE /compute/v2.1/servers/24a5eaf9-f8cf-4b02-88a5-cb57a4e51742 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 23:24:32.376712 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-0c42f5c7-68ed-4885-9afe-845b02ccc30e tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:24:32.377584 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-0c42f5c7-68ed-4885-9afe-845b02ccc30e tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] [instance: 24a5eaf9-f8cf-4b02-88a5-cb57a4e51742] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:24:32.389126 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0c42f5c7-68ed-4885-9afe-845b02ccc30e tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:24:32.391087 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0c42f5c7-68ed-4885-9afe-845b02ccc30e tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:24:32.391716 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0c42f5c7-68ed-4885-9afe-845b02ccc30e tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:24:32.392575 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0c42f5c7-68ed-4885-9afe-845b02ccc30e tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:24:32.394136 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0c42f5c7-68ed-4885-9afe-845b02ccc30e tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:24:32.396352 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-0c42f5c7-68ed-4885-9afe-845b02ccc30e tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:24:32.546841 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-0c42f5c7-68ed-4885-9afe-845b02ccc30e tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7124fd831f0d4ce8b561d79639b5f272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339847fffad841c59cd6f9e3439eb420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:24:32.554924 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-0c42f5c7-68ed-4885-9afe-845b02ccc30e tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] 10.222.0.43 "GET /compute/v2.1/servers/24a5eaf9-f8cf-4b02-88a5-cb57a4e51742" status: 200 len: 1688 microversion: 2.1 time: 0.183299 Oct 04 23:24:32.555646 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3576/7973] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:24:32 2022] GET /compute/v2.1/servers/24a5eaf9-f8cf-4b02-88a5-cb57a4e51742 => generated 1688 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:24:33.581022 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-30afca03-ca7d-4b41-90fd-596c60a8210a tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:24:33.581939 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-30afca03-ca7d-4b41-90fd-596c60a8210a tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] [instance: 24a5eaf9-f8cf-4b02-88a5-cb57a4e51742] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:24:33.589737 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-30afca03-ca7d-4b41-90fd-596c60a8210a tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:24:33.590242 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-30afca03-ca7d-4b41-90fd-596c60a8210a tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:24:33.591001 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-30afca03-ca7d-4b41-90fd-596c60a8210a tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:24:33.591855 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-30afca03-ca7d-4b41-90fd-596c60a8210a tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:24:33.592367 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-30afca03-ca7d-4b41-90fd-596c60a8210a tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:24:33.592811 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-30afca03-ca7d-4b41-90fd-596c60a8210a tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:24:33.820806 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-30afca03-ca7d-4b41-90fd-596c60a8210a tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7124fd831f0d4ce8b561d79639b5f272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339847fffad841c59cd6f9e3439eb420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:24:33.829783 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-30afca03-ca7d-4b41-90fd-596c60a8210a tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] 10.222.0.43 "GET /compute/v2.1/servers/24a5eaf9-f8cf-4b02-88a5-cb57a4e51742" status: 200 len: 1688 microversion: 2.1 time: 0.253153 Oct 04 23:24:33.830356 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4398/7974] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:24:33 2022] GET /compute/v2.1/servers/24a5eaf9-f8cf-4b02-88a5-cb57a4e51742 => generated 1688 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:24:34.613441 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-9357a672-0bc9-49e3-ad07-04b0c6a45a07 req-4c39b0a4-2643-4f29-a3a8-cc5093a53287 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24a5eaf9-f8cf-4b02-88a5-cb57a4e51742", "name": "network-vif-deleted", "tag": "9d770989-f06b-4faa-af9e-243be33e4868"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 23:24:34.625520 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-9357a672-0bc9-49e3-ad07-04b0c6a45a07 req-4c39b0a4-2643-4f29-a3a8-cc5093a53287 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:24:34.626009 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-9357a672-0bc9-49e3-ad07-04b0c6a45a07 req-4c39b0a4-2643-4f29-a3a8-cc5093a53287 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:24:34.626480 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-9357a672-0bc9-49e3-ad07-04b0c6a45a07 req-4c39b0a4-2643-4f29-a3a8-cc5093a53287 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:24:34.638718 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-9357a672-0bc9-49e3-ad07-04b0c6a45a07 req-4c39b0a4-2643-4f29-a3a8-cc5093a53287 service nova] Creating event network-vif-deleted:9d770989-f06b-4faa-af9e-243be33e4868 for instance 24a5eaf9-f8cf-4b02-88a5-cb57a4e51742 on n-h2-860284-1 Oct 04 23:24:34.643866 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-9357a672-0bc9-49e3-ad07-04b0c6a45a07 req-4c39b0a4-2643-4f29-a3a8-cc5093a53287 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034263 Oct 04 23:24:34.644476 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3577/7975] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 23:24:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 23:24:34.853836 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-5e619b6f-3c0e-4828-8b65-114c210c78c1 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:24:34.854418 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-5e619b6f-3c0e-4828-8b65-114c210c78c1 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] [instance: 24a5eaf9-f8cf-4b02-88a5-cb57a4e51742] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:24:34.861601 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5e619b6f-3c0e-4828-8b65-114c210c78c1 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:24:34.862113 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5e619b6f-3c0e-4828-8b65-114c210c78c1 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:24:34.862623 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5e619b6f-3c0e-4828-8b65-114c210c78c1 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:24:34.863424 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5e619b6f-3c0e-4828-8b65-114c210c78c1 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:24:34.864198 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5e619b6f-3c0e-4828-8b65-114c210c78c1 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:24:34.864642 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5e619b6f-3c0e-4828-8b65-114c210c78c1 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:24:34.899926 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5e619b6f-3c0e-4828-8b65-114c210c78c1 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:24:34.900442 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5e619b6f-3c0e-4828-8b65-114c210c78c1 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:24:34.900896 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5e619b6f-3c0e-4828-8b65-114c210c78c1 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:24:34.901372 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.objects.instance [None req-5e619b6f-3c0e-4828-8b65-114c210c78c1 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lazy-loading 'fault' on Instance uuid 24a5eaf9-f8cf-4b02-88a5-cb57a4e51742 {{(pid=134101) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 23:24:34.944038 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-5e619b6f-3c0e-4828-8b65-114c210c78c1 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7124fd831f0d4ce8b561d79639b5f272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339847fffad841c59cd6f9e3439eb420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:24:34.952313 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-5e619b6f-3c0e-4828-8b65-114c210c78c1 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] 10.222.0.43 "GET /compute/v2.1/servers/24a5eaf9-f8cf-4b02-88a5-cb57a4e51742" status: 200 len: 1356 microversion: 2.1 time: 0.103098 Oct 04 23:24:34.952893 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4399/7976] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:24:34 2022] GET /compute/v2.1/servers/24a5eaf9-f8cf-4b02-88a5-cb57a4e51742 => generated 1356 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:24:35.978517 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-faf8191e-e138-43f2-8ea8-ad5c4f9036b3 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:24:35.979130 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-faf8191e-e138-43f2-8ea8-ad5c4f9036b3 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] [instance: 24a5eaf9-f8cf-4b02-88a5-cb57a4e51742] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:24:35.985488 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-faf8191e-e138-43f2-8ea8-ad5c4f9036b3 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:24:35.985971 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-faf8191e-e138-43f2-8ea8-ad5c4f9036b3 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:24:35.986456 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-faf8191e-e138-43f2-8ea8-ad5c4f9036b3 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:24:35.987145 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-faf8191e-e138-43f2-8ea8-ad5c4f9036b3 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:24:35.987598 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-faf8191e-e138-43f2-8ea8-ad5c4f9036b3 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:24:35.988024 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-faf8191e-e138-43f2-8ea8-ad5c4f9036b3 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:24:36.002481 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-faf8191e-e138-43f2-8ea8-ad5c4f9036b3 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] HTTP exception thrown: Instance 24a5eaf9-f8cf-4b02-88a5-cb57a4e51742 could not be found. Oct 04 23:24:36.004128 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-faf8191e-e138-43f2-8ea8-ad5c4f9036b3 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Request method failure captured: Oct 04 23:24:36.004128 n-d-860284-1 devstack@n-api.service[134102]: request: GET /compute/v2.1/servers/24a5eaf9-f8cf-4b02-88a5-cb57a4e51742 HTTP/1.1 Oct 04 23:24:36.004128 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 23:24:36.004128 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 23:24:36.004128 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 23:24:36.004128 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 23:24:36.004128 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 23:24:36.004128 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 23:24:36.004128 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 23:24:36.004128 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 23:24:36.004128 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPL3PV1P3eiBng-eyftmazLIMFOGhxgvlJE5kLv8qSAxeZ7nw7JEQcBo6uebpFaCmIciYVzYahs6GheYsSkJ64LI0k5-JJiivZ7ZQcPNIUVS-FFaLcyFAAb-8gYSuTYUwgQIpyTivuP6QEOS5wIqgxRi6U8ltOJnUssrNHH8u3ZtbLbs Oct 04 23:24:36.004128 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 23:24:36.004128 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 23:24:36.004128 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 23:24:36.004128 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 23:24:36.004128 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 23:24:36.004128 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 23:24:36.004128 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: 339847fffad841c59cd6f9e3439eb420 Oct 04 23:24:36.004128 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-217321805 Oct 04 23:24:36.004128 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 23:24:36.004128 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 23:24:36.004128 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/339847fffad841c59cd6f9e3439eb420"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_339847fffad841c59cd6f9e3439eb420", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/339847fffad841c59cd6f9e3439eb420"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/339847fffad841c59cd6f9e3439eb420"}]}] Oct 04 23:24:36.004128 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-TestNetworkAdvancedServerOps-217321805 Oct 04 23:24:36.004128 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: 339847fffad841c59cd6f9e3439eb420 Oct 04 23:24:36.004128 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-217321805 Oct 04 23:24:36.004128 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-TestNetworkAdvancedServerOps-217321805-project Oct 04 23:24:36.004128 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 23:24:36.004128 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 23:24:36.004128 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: 7124fd831f0d4ce8b561d79639b5f272 Oct 04 23:24:36.004128 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-TestNetworkAdvancedServerOps-217321805-project Oct 04 23:24:36.004128 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 23:24:36.004128 n-d-860284-1 devstack@n-api.service[134102]: exception: Instance 24a5eaf9-f8cf-4b02-88a5-cb57a4e51742 could not be found. Oct 04 23:24:36.004128 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': '24a5eaf9-f8cf-4b02-88a5-cb57a4e51742'} Oct 04 23:24:36.004128 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 23:24:36.004128 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 23:24:36.004128 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 23:24:36.004128 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 23:24:36.004128 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 23:24:36.004128 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 23:24:36.004128 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 23:24:36.004128 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 23:24:36.004128 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 23:24:36.004128 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 23:24:36.004128 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24a5eaf9-f8cf-4b02-88a5-cb57a4e51742 could not be found. Oct 04 23:24:36.004128 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 23:24:36.004128 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 23:24:36.004128 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 23:24:36.004128 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 23:24:36.004128 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 23:24:36.004128 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 23:24:36.004128 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 23:24:36.004128 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 23:24:36.004128 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 23:24:36.004128 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 23:24:36.004128 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 23:24:36.004128 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 23:24:36.004128 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 23:24:36.004128 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 23:24:36.004128 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 23:24:36.004128 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 23:24:36.004128 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24a5eaf9-f8cf-4b02-88a5-cb57a4e51742 could not be found. Oct 04 23:24:36.004128 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 23:24:36.004128 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 23:24:36.009991 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 23:24:36.009991 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 23:24:36.009991 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 23:24:36.009991 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 23:24:36.009991 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 23:24:36.009991 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 23:24:36.009991 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24a5eaf9-f8cf-4b02-88a5-cb57a4e51742 could not be found. Oct 04 23:24:36.009991 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 23:24:36.009991 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-faf8191e-e138-43f2-8ea8-ad5c4f9036b3 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Returning 404 to user: Instance 24a5eaf9-f8cf-4b02-88a5-cb57a4e51742 could not be found. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 23:24:36.009991 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-faf8191e-e138-43f2-8ea8-ad5c4f9036b3 tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] 10.222.0.43 "GET /compute/v2.1/servers/24a5eaf9-f8cf-4b02-88a5-cb57a4e51742" status: 404 len: 111 microversion: 2.1 time: 0.032898 Oct 04 23:24:36.009991 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3578/7977] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:24:35 2022] GET /compute/v2.1/servers/24a5eaf9-f8cf-4b02-88a5-cb57a4e51742 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 23:24:39.632304 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-9332c19b-a485-4f6b-8057-7eebe8804bbd tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] Calling method '.version_select at 0x7fbb1c7d09d0>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:24:39.653047 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-9332c19b-a485-4f6b-8057-7eebe8804bbd tempest-TestNetworkAdvancedServerOps-217321805 tempest-TestNetworkAdvancedServerOps-217321805-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2064909144" status: 202 len: 0 microversion: 2.1 time: 0.024577 Oct 04 23:24:39.653833 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4400/7978] 10.222.0.43 () {58 vars in 1284 bytes} [Tue Oct 4 23:24:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2064909144 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 23:24:50.909246 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_api:SELECT=18 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:24:50.910674 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:24:51.116545 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-a0f186d9-bac4-495c-9c1e-199e0a884805 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Action: 'create', calling method: .version_select at 0x7fbb2f5234c0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1248365448", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBACHti9+eHASfa1pzTBfHCjyqXsg5eZPq7aQ/HPf+FhWyeTC+twKkkuquyhSn221Mxi++azxj8InkmRJX2kvxeaFdrdmpx5aza9hO4QiQGrC/J5YUvY8vQtovZvyaNpg5A=="}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 23:24:51.139088 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-a0f186d9-bac4-495c-9c1e-199e0a884805 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Getting quotas for project 979814de519c46d08cd2301bf5d33eac. Resources: {'key_pairs'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 23:24:51.145716 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-a0f186d9-bac4-495c-9c1e-199e0a884805 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Getting quotas for user 841e202efcb143cf93d6d9bb1f3edba3 and project 979814de519c46d08cd2301bf5d33eac. Resources: {'key_pairs'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 23:24:51.169515 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-a0f186d9-bac4-495c-9c1e-199e0a884805 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.265971 Oct 04 23:24:51.170136 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3579/7979] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Oct 4 23:24:50 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 23:24:52.167846 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:24:52.169102 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:24:52.173127 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-cc0ded87-62fd-4a6f-9cb6-21eabd1f0ed7 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1004039613", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1248365448", "security_groups": [{"name": "tempest-secgroup-smoke-1346688649"}], "networks": [{"uuid": "bf5db42b-8323-4711-a3cb-8f87e8038bbd"}]}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 23:24:52.284545 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.network.neutron [None req-cc0ded87-62fd-4a6f-9cb6-21eabd1f0ed7 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] validate_networks() for [('bf5db42b-8323-4711-a3cb-8f87e8038bbd', None, None, None, None, None)] {{(pid=134101) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 23:24:52.662782 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-cc0ded87-62fd-4a6f-9cb6-21eabd1f0ed7 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Flavor limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 23:24:52.663255 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-cc0ded87-62fd-4a6f-9cb6-21eabd1f0ed7 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Image limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 23:24:52.663746 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-cc0ded87-62fd-4a6f-9cb6-21eabd1f0ed7 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Flavor pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 23:24:52.664179 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-cc0ded87-62fd-4a6f-9cb6-21eabd1f0ed7 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Image pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 23:24:52.664607 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-cc0ded87-62fd-4a6f-9cb6-21eabd1f0ed7 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 23:24:52.673928 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cc0ded87-62fd-4a6f-9cb6-21eabd1f0ed7 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:24:52.674457 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cc0ded87-62fd-4a6f-9cb6-21eabd1f0ed7 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:24:52.674907 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cc0ded87-62fd-4a6f-9cb6-21eabd1f0ed7 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:24:52.675686 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cc0ded87-62fd-4a6f-9cb6-21eabd1f0ed7 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:24:52.676153 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cc0ded87-62fd-4a6f-9cb6-21eabd1f0ed7 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:24:52.676591 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-cc0ded87-62fd-4a6f-9cb6-21eabd1f0ed7 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:24:52.700239 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-cc0ded87-62fd-4a6f-9cb6-21eabd1f0ed7 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Getting quotas for project 979814de519c46d08cd2301bf5d33eac. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 23:24:52.705616 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-cc0ded87-62fd-4a6f-9cb6-21eabd1f0ed7 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Getting quotas for user 841e202efcb143cf93d6d9bb1f3edba3 and project 979814de519c46d08cd2301bf5d33eac. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 23:24:52.718135 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-cc0ded87-62fd-4a6f-9cb6-21eabd1f0ed7 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Going to run 1 instances... {{(pid=134101) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 23:24:52.720484 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-cc0ded87-62fd-4a6f-9cb6-21eabd1f0ed7 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] [instance: f6fb6a98-0120-4ed4-a763-951c74a1e5bc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='58548514-5dac-426c-81f5-19e3fba33e23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134101) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 23:24:52.767738 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-cc0ded87-62fd-4a6f-9cb6-21eabd1f0ed7 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.601650 Oct 04 23:24:52.774525 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4401/7980] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 23:24:52 2022] POST /compute/v2.1/servers => generated 406 bytes in 603 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 23:24:52.780559 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-5b9bdfcd-179c-41a6-ae1d-b8d3e846b164 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:24:52.781206 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-5b9bdfcd-179c-41a6-ae1d-b8d3e846b164 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] [instance: f6fb6a98-0120-4ed4-a763-951c74a1e5bc] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:24:52.851458 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-5b9bdfcd-179c-41a6-ae1d-b8d3e846b164 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841e202efcb143cf93d6d9bb1f3edba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979814de519c46d08cd2301bf5d33eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:24:52.858785 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-5b9bdfcd-179c-41a6-ae1d-b8d3e846b164 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] 10.222.0.43 "GET /compute/v2.1/servers/f6fb6a98-0120-4ed4-a763-951c74a1e5bc" status: 200 len: 1247 microversion: 2.1 time: 0.082952 Oct 04 23:24:52.859383 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3580/7981] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:24:52 2022] GET /compute/v2.1/servers/f6fb6a98-0120-4ed4-a763-951c74a1e5bc => generated 1247 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 23:24:53.887251 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-a3b029fa-cad6-4ad4-8825-459f993bc232 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:24:53.888050 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-a3b029fa-cad6-4ad4-8825-459f993bc232 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] [instance: f6fb6a98-0120-4ed4-a763-951c74a1e5bc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:24:53.894229 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a3b029fa-cad6-4ad4-8825-459f993bc232 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:24:53.894786 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a3b029fa-cad6-4ad4-8825-459f993bc232 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:24:53.895249 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a3b029fa-cad6-4ad4-8825-459f993bc232 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:24:53.896514 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a3b029fa-cad6-4ad4-8825-459f993bc232 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:24:53.897318 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a3b029fa-cad6-4ad4-8825-459f993bc232 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:24:53.897921 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a3b029fa-cad6-4ad4-8825-459f993bc232 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:24:54.073287 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-a3b029fa-cad6-4ad4-8825-459f993bc232 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841e202efcb143cf93d6d9bb1f3edba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979814de519c46d08cd2301bf5d33eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:24:54.081715 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-a3b029fa-cad6-4ad4-8825-459f993bc232 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] 10.222.0.43 "GET /compute/v2.1/servers/f6fb6a98-0120-4ed4-a763-951c74a1e5bc" status: 200 len: 1251 microversion: 2.1 time: 0.201390 Oct 04 23:24:54.082791 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4402/7982] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:24:53 2022] GET /compute/v2.1/servers/f6fb6a98-0120-4ed4-a763-951c74a1e5bc => generated 1251 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:24:55.105581 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-e180efa1-ac8e-4d4e-82f4-2cfb766a3361 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:24:55.106312 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-e180efa1-ac8e-4d4e-82f4-2cfb766a3361 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] [instance: f6fb6a98-0120-4ed4-a763-951c74a1e5bc] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:24:55.114482 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e180efa1-ac8e-4d4e-82f4-2cfb766a3361 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:24:55.115372 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e180efa1-ac8e-4d4e-82f4-2cfb766a3361 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:24:55.116064 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e180efa1-ac8e-4d4e-82f4-2cfb766a3361 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:24:55.117139 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e180efa1-ac8e-4d4e-82f4-2cfb766a3361 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:24:55.117819 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e180efa1-ac8e-4d4e-82f4-2cfb766a3361 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:24:55.118554 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e180efa1-ac8e-4d4e-82f4-2cfb766a3361 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:24:55.258783 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-e180efa1-ac8e-4d4e-82f4-2cfb766a3361 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841e202efcb143cf93d6d9bb1f3edba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979814de519c46d08cd2301bf5d33eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:24:55.266565 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-e180efa1-ac8e-4d4e-82f4-2cfb766a3361 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] 10.222.0.43 "GET /compute/v2.1/servers/f6fb6a98-0120-4ed4-a763-951c74a1e5bc" status: 200 len: 1305 microversion: 2.1 time: 0.164998 Oct 04 23:24:55.267078 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3581/7983] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:24:55 2022] GET /compute/v2.1/servers/f6fb6a98-0120-4ed4-a763-951c74a1e5bc => generated 1305 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:24:56.291427 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-45f72843-f249-4839-bd8e-f23975db9485 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:24:56.292643 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-45f72843-f249-4839-bd8e-f23975db9485 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] [instance: f6fb6a98-0120-4ed4-a763-951c74a1e5bc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:24:56.300610 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-45f72843-f249-4839-bd8e-f23975db9485 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:24:56.301395 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-45f72843-f249-4839-bd8e-f23975db9485 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:24:56.301856 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-45f72843-f249-4839-bd8e-f23975db9485 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:24:56.302900 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-45f72843-f249-4839-bd8e-f23975db9485 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:24:56.303383 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-45f72843-f249-4839-bd8e-f23975db9485 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:24:56.303946 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-45f72843-f249-4839-bd8e-f23975db9485 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:24:56.313966 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-ca71db62-2bcd-4f78-8579-4ec83cece7d0 req-4a47299f-544e-4768-9a12-10d585151836 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6fb6a98-0120-4ed4-a763-951c74a1e5bc", "tag": "73b3b80a-1887-4868-9e74-19b14e43d2d3"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 23:24:56.332781 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-ca71db62-2bcd-4f78-8579-4ec83cece7d0 req-4a47299f-544e-4768-9a12-10d585151836 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:24:56.333179 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-ca71db62-2bcd-4f78-8579-4ec83cece7d0 req-4a47299f-544e-4768-9a12-10d585151836 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:24:56.334243 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-ca71db62-2bcd-4f78-8579-4ec83cece7d0 req-4a47299f-544e-4768-9a12-10d585151836 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:24:56.346173 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-ca71db62-2bcd-4f78-8579-4ec83cece7d0 req-4a47299f-544e-4768-9a12-10d585151836 service nova] Creating event network-changed:73b3b80a-1887-4868-9e74-19b14e43d2d3 for instance f6fb6a98-0120-4ed4-a763-951c74a1e5bc on n-h1-860284-1 Oct 04 23:24:56.352946 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-ca71db62-2bcd-4f78-8579-4ec83cece7d0 req-4a47299f-544e-4768-9a12-10d585151836 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042534 Oct 04 23:24:56.354205 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3582/7984] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 23:24:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 23:24:56.451802 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-45f72843-f249-4839-bd8e-f23975db9485 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841e202efcb143cf93d6d9bb1f3edba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979814de519c46d08cd2301bf5d33eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:24:56.460283 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-45f72843-f249-4839-bd8e-f23975db9485 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] 10.222.0.43 "GET /compute/v2.1/servers/f6fb6a98-0120-4ed4-a763-951c74a1e5bc" status: 200 len: 1373 microversion: 2.1 time: 0.174061 Oct 04 23:24:56.461082 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4403/7985] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:24:56 2022] GET /compute/v2.1/servers/f6fb6a98-0120-4ed4-a763-951c74a1e5bc => generated 1373 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:24:57.484354 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-c99d366c-4c60-405e-b36e-2b8be04a3bd8 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:24:57.484967 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-c99d366c-4c60-405e-b36e-2b8be04a3bd8 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] [instance: f6fb6a98-0120-4ed4-a763-951c74a1e5bc] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:24:57.492504 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c99d366c-4c60-405e-b36e-2b8be04a3bd8 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:24:57.492984 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c99d366c-4c60-405e-b36e-2b8be04a3bd8 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:24:57.493420 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c99d366c-4c60-405e-b36e-2b8be04a3bd8 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:24:57.494135 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c99d366c-4c60-405e-b36e-2b8be04a3bd8 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:24:57.494615 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c99d366c-4c60-405e-b36e-2b8be04a3bd8 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:24:57.495041 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c99d366c-4c60-405e-b36e-2b8be04a3bd8 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:24:57.634670 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-c99d366c-4c60-405e-b36e-2b8be04a3bd8 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841e202efcb143cf93d6d9bb1f3edba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979814de519c46d08cd2301bf5d33eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:24:57.642715 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-c99d366c-4c60-405e-b36e-2b8be04a3bd8 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] 10.222.0.43 "GET /compute/v2.1/servers/f6fb6a98-0120-4ed4-a763-951c74a1e5bc" status: 200 len: 1373 microversion: 2.1 time: 0.162909 Oct 04 23:24:57.643396 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3583/7986] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:24:57 2022] GET /compute/v2.1/servers/f6fb6a98-0120-4ed4-a763-951c74a1e5bc => generated 1373 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:24:58.666327 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-ee5dcaef-a48c-4e5e-9cae-9cda1e01be38 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:24:58.667001 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-ee5dcaef-a48c-4e5e-9cae-9cda1e01be38 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] [instance: f6fb6a98-0120-4ed4-a763-951c74a1e5bc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:24:58.674293 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ee5dcaef-a48c-4e5e-9cae-9cda1e01be38 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:24:58.674823 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ee5dcaef-a48c-4e5e-9cae-9cda1e01be38 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:24:58.675283 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ee5dcaef-a48c-4e5e-9cae-9cda1e01be38 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:24:58.676002 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ee5dcaef-a48c-4e5e-9cae-9cda1e01be38 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:24:58.676479 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ee5dcaef-a48c-4e5e-9cae-9cda1e01be38 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:24:58.676930 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ee5dcaef-a48c-4e5e-9cae-9cda1e01be38 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:24:58.811745 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-ee5dcaef-a48c-4e5e-9cae-9cda1e01be38 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841e202efcb143cf93d6d9bb1f3edba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979814de519c46d08cd2301bf5d33eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:24:58.820783 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-ee5dcaef-a48c-4e5e-9cae-9cda1e01be38 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] 10.222.0.43 "GET /compute/v2.1/servers/f6fb6a98-0120-4ed4-a763-951c74a1e5bc" status: 200 len: 1373 microversion: 2.1 time: 0.158213 Oct 04 23:24:58.821379 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4404/7987] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:24:58 2022] GET /compute/v2.1/servers/f6fb6a98-0120-4ed4-a763-951c74a1e5bc => generated 1373 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:24:59.844173 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-af1317f3-c9eb-4a4d-83ef-e00198e7dd62 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:24:59.844712 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-af1317f3-c9eb-4a4d-83ef-e00198e7dd62 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] [instance: f6fb6a98-0120-4ed4-a763-951c74a1e5bc] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:24:59.852248 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-af1317f3-c9eb-4a4d-83ef-e00198e7dd62 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:24:59.852737 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-af1317f3-c9eb-4a4d-83ef-e00198e7dd62 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:24:59.853181 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-af1317f3-c9eb-4a4d-83ef-e00198e7dd62 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:24:59.853871 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-af1317f3-c9eb-4a4d-83ef-e00198e7dd62 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:24:59.854328 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-af1317f3-c9eb-4a4d-83ef-e00198e7dd62 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:24:59.854781 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-af1317f3-c9eb-4a4d-83ef-e00198e7dd62 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:24:59.986997 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-af1317f3-c9eb-4a4d-83ef-e00198e7dd62 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841e202efcb143cf93d6d9bb1f3edba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979814de519c46d08cd2301bf5d33eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:24:59.994733 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-af1317f3-c9eb-4a4d-83ef-e00198e7dd62 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] 10.222.0.43 "GET /compute/v2.1/servers/f6fb6a98-0120-4ed4-a763-951c74a1e5bc" status: 200 len: 1373 microversion: 2.1 time: 0.154602 Oct 04 23:24:59.995315 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3584/7988] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:24:59 2022] GET /compute/v2.1/servers/f6fb6a98-0120-4ed4-a763-951c74a1e5bc => generated 1373 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:25:00.924612 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-63ccacab-da09-4e7d-8803-04414ec9c145 req-c03498f3-5ddd-467d-93d4-6fe4997858d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6fb6a98-0120-4ed4-a763-951c74a1e5bc", "name": "network-vif-plugged", "status": "completed", "tag": "73b3b80a-1887-4868-9e74-19b14e43d2d3"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 23:25:00.936596 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-63ccacab-da09-4e7d-8803-04414ec9c145 req-c03498f3-5ddd-467d-93d4-6fe4997858d5 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:25:00.937102 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-63ccacab-da09-4e7d-8803-04414ec9c145 req-c03498f3-5ddd-467d-93d4-6fe4997858d5 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:25:00.937556 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-63ccacab-da09-4e7d-8803-04414ec9c145 req-c03498f3-5ddd-467d-93d4-6fe4997858d5 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:25:00.948744 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-63ccacab-da09-4e7d-8803-04414ec9c145 req-c03498f3-5ddd-467d-93d4-6fe4997858d5 service nova] Creating event network-vif-plugged:73b3b80a-1887-4868-9e74-19b14e43d2d3 for instance f6fb6a98-0120-4ed4-a763-951c74a1e5bc on n-h1-860284-1 Oct 04 23:25:00.953829 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-63ccacab-da09-4e7d-8803-04414ec9c145 req-c03498f3-5ddd-467d-93d4-6fe4997858d5 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033134 Oct 04 23:25:00.954522 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4405/7989] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 23:25:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 23:25:01.017578 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-a3c5e81e-2fbc-42a9-b453-cbd66e9c64b7 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:25:01.018300 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-a3c5e81e-2fbc-42a9-b453-cbd66e9c64b7 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] [instance: f6fb6a98-0120-4ed4-a763-951c74a1e5bc] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:25:01.026101 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a3c5e81e-2fbc-42a9-b453-cbd66e9c64b7 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:25:01.026724 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a3c5e81e-2fbc-42a9-b453-cbd66e9c64b7 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:25:01.027246 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a3c5e81e-2fbc-42a9-b453-cbd66e9c64b7 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:25:01.028027 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a3c5e81e-2fbc-42a9-b453-cbd66e9c64b7 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:25:01.028565 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a3c5e81e-2fbc-42a9-b453-cbd66e9c64b7 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:25:01.029091 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a3c5e81e-2fbc-42a9-b453-cbd66e9c64b7 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:25:01.193501 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-a3c5e81e-2fbc-42a9-b453-cbd66e9c64b7 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841e202efcb143cf93d6d9bb1f3edba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979814de519c46d08cd2301bf5d33eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:25:01.202041 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-a3c5e81e-2fbc-42a9-b453-cbd66e9c64b7 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] 10.222.0.43 "GET /compute/v2.1/servers/f6fb6a98-0120-4ed4-a763-951c74a1e5bc" status: 200 len: 1373 microversion: 2.1 time: 0.188557 Oct 04 23:25:01.202662 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3585/7990] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:25:01 2022] GET /compute/v2.1/servers/f6fb6a98-0120-4ed4-a763-951c74a1e5bc => generated 1373 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:25:02.226865 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-a44ee1d8-178c-4c8e-9114-333bc5b60408 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:25:02.227580 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-a44ee1d8-178c-4c8e-9114-333bc5b60408 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] [instance: f6fb6a98-0120-4ed4-a763-951c74a1e5bc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:25:02.233955 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a44ee1d8-178c-4c8e-9114-333bc5b60408 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:25:02.234485 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a44ee1d8-178c-4c8e-9114-333bc5b60408 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:25:02.234937 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a44ee1d8-178c-4c8e-9114-333bc5b60408 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:25:02.235639 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a44ee1d8-178c-4c8e-9114-333bc5b60408 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:25:02.236107 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a44ee1d8-178c-4c8e-9114-333bc5b60408 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:25:02.236548 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a44ee1d8-178c-4c8e-9114-333bc5b60408 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:25:02.369029 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-a44ee1d8-178c-4c8e-9114-333bc5b60408 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841e202efcb143cf93d6d9bb1f3edba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979814de519c46d08cd2301bf5d33eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:25:02.377600 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-a44ee1d8-178c-4c8e-9114-333bc5b60408 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] 10.222.0.43 "GET /compute/v2.1/servers/f6fb6a98-0120-4ed4-a763-951c74a1e5bc" status: 200 len: 1373 microversion: 2.1 time: 0.156376 Oct 04 23:25:02.378191 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4406/7991] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:25:02 2022] GET /compute/v2.1/servers/f6fb6a98-0120-4ed4-a763-951c74a1e5bc => generated 1373 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:25:03.401404 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-82d2c4c7-45bc-4c11-bafc-cb7b37ef6b1e tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:25:03.402035 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-82d2c4c7-45bc-4c11-bafc-cb7b37ef6b1e tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] [instance: f6fb6a98-0120-4ed4-a763-951c74a1e5bc] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:25:03.404837 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell0:SELECT=6 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:25:03.410309 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-82d2c4c7-45bc-4c11-bafc-cb7b37ef6b1e tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:25:03.410832 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-82d2c4c7-45bc-4c11-bafc-cb7b37ef6b1e tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:25:03.411280 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-82d2c4c7-45bc-4c11-bafc-cb7b37ef6b1e tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:25:03.411988 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-82d2c4c7-45bc-4c11-bafc-cb7b37ef6b1e tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:25:03.412454 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-82d2c4c7-45bc-4c11-bafc-cb7b37ef6b1e tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:25:03.412890 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-82d2c4c7-45bc-4c11-bafc-cb7b37ef6b1e tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:25:03.543750 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-82d2c4c7-45bc-4c11-bafc-cb7b37ef6b1e tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841e202efcb143cf93d6d9bb1f3edba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979814de519c46d08cd2301bf5d33eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:25:03.551552 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-82d2c4c7-45bc-4c11-bafc-cb7b37ef6b1e tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] 10.222.0.43 "GET /compute/v2.1/servers/f6fb6a98-0120-4ed4-a763-951c74a1e5bc" status: 200 len: 1557 microversion: 2.1 time: 0.154372 Oct 04 23:25:03.552736 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3586/7992] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:25:03 2022] GET /compute/v2.1/servers/f6fb6a98-0120-4ed4-a763-951c74a1e5bc => generated 1557 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:25:03.574932 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-97ebfcb9-f9b5-4e80-bb6c-0a3e2c9f2407 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:25:03.575645 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-97ebfcb9-f9b5-4e80-bb6c-0a3e2c9f2407 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] [instance: f6fb6a98-0120-4ed4-a763-951c74a1e5bc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:25:03.577631 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=2 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:25:03.578319 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=6 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:25:03.585377 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-97ebfcb9-f9b5-4e80-bb6c-0a3e2c9f2407 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:25:03.585886 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-97ebfcb9-f9b5-4e80-bb6c-0a3e2c9f2407 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:25:03.586343 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-97ebfcb9-f9b5-4e80-bb6c-0a3e2c9f2407 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:25:03.587085 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-97ebfcb9-f9b5-4e80-bb6c-0a3e2c9f2407 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:25:03.587560 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-97ebfcb9-f9b5-4e80-bb6c-0a3e2c9f2407 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:25:03.588008 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-97ebfcb9-f9b5-4e80-bb6c-0a3e2c9f2407 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:25:03.724244 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-97ebfcb9-f9b5-4e80-bb6c-0a3e2c9f2407 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841e202efcb143cf93d6d9bb1f3edba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979814de519c46d08cd2301bf5d33eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:25:03.732308 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-97ebfcb9-f9b5-4e80-bb6c-0a3e2c9f2407 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] 10.222.0.43 "GET /compute/v2.1/servers/f6fb6a98-0120-4ed4-a763-951c74a1e5bc" status: 200 len: 1557 microversion: 2.1 time: 0.161375 Oct 04 23:25:03.732878 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4407/7993] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:25:03 2022] GET /compute/v2.1/servers/f6fb6a98-0120-4ed4-a763-951c74a1e5bc => generated 1557 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:25:05.371094 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-f33d1c56-3d28-47d6-87b3-5c2a3a2277c4 req-1b0831e7-6fba-43bf-9583-aa222f358f82 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6fb6a98-0120-4ed4-a763-951c74a1e5bc", "tag": "73b3b80a-1887-4868-9e74-19b14e43d2d3"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 23:25:05.380827 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-f33d1c56-3d28-47d6-87b3-5c2a3a2277c4 req-1b0831e7-6fba-43bf-9583-aa222f358f82 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:25:05.381309 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-f33d1c56-3d28-47d6-87b3-5c2a3a2277c4 req-1b0831e7-6fba-43bf-9583-aa222f358f82 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:25:05.381746 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-f33d1c56-3d28-47d6-87b3-5c2a3a2277c4 req-1b0831e7-6fba-43bf-9583-aa222f358f82 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:25:05.393251 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-f33d1c56-3d28-47d6-87b3-5c2a3a2277c4 req-1b0831e7-6fba-43bf-9583-aa222f358f82 service nova] Creating event network-changed:73b3b80a-1887-4868-9e74-19b14e43d2d3 for instance f6fb6a98-0120-4ed4-a763-951c74a1e5bc on n-h1-860284-1 Oct 04 23:25:05.398774 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-f33d1c56-3d28-47d6-87b3-5c2a3a2277c4 req-1b0831e7-6fba-43bf-9583-aa222f358f82 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031747 Oct 04 23:25:05.400531 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3587/7994] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 23:25:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 23:27:43.223254 n-d-860284-1 devstack@n-api.service[134101]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f8e2fc52-bb96-4bc7-8039-fbfc8addcbeb] AMQP server on 10.222.0.43:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 04 23:27:43.224147 n-d-860284-1 devstack@n-api.service[134101]: ERROR oslo.messaging._drivers.impl_rabbit [-] [dab38095-fcf8-46d0-9904-6bfbf5d1f82a] AMQP server on 10.222.0.43:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 04 23:27:43.224615 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:27:43.225487 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=34 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:27:43.226487 n-d-860284-1 devstack@n-api.service[134101]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 04 23:27:43.226657 n-d-860284-1 devstack@n-api.service[134101]: Tue Oct 4 23:27:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f6fb6a98-0120-4ed4-a763-951c74a1e5bc/action (ip 10.222.0.43) !!! Oct 04 23:27:43.227844 n-d-860284-1 devstack@n-api.service[134101]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 23:27:43.227844 n-d-860284-1 devstack@n-api.service[134101]: Tue Oct 4 23:27:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f6fb6a98-0120-4ed4-a763-951c74a1e5bc/action (ip 10.222.0.43) !!! Oct 04 23:27:43.229164 n-d-860284-1 devstack@n-api.service[134101]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 23:27:43.229286 n-d-860284-1 devstack@n-api.service[134101]: Tue Oct 4 23:27:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f6fb6a98-0120-4ed4-a763-951c74a1e5bc/action (ip 10.222.0.43) !!! Oct 04 23:27:43.234442 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-d124cbea-ba46-4c1d-8e35-17f77b5a3a75 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 23:27:43.235021 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-d124cbea-ba46-4c1d-8e35-17f77b5a3a75 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] [instance: f6fb6a98-0120-4ed4-a763-951c74a1e5bc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:27:43.248814 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d124cbea-ba46-4c1d-8e35-17f77b5a3a75 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:27:43.249317 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d124cbea-ba46-4c1d-8e35-17f77b5a3a75 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:27:43.249773 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d124cbea-ba46-4c1d-8e35-17f77b5a3a75 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:27:43.250532 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d124cbea-ba46-4c1d-8e35-17f77b5a3a75 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:27:43.251006 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d124cbea-ba46-4c1d-8e35-17f77b5a3a75 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:27:43.251455 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d124cbea-ba46-4c1d-8e35-17f77b5a3a75 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:27:43.276886 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.objects.instance [None req-d124cbea-ba46-4c1d-8e35-17f77b5a3a75 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lazy-loading 'flavor' on Instance uuid f6fb6a98-0120-4ed4-a763-951c74a1e5bc {{(pid=134101) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 23:27:43.466077 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-d124cbea-ba46-4c1d-8e35-17f77b5a3a75 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] 10.222.0.43 "POST /compute/v2.1/servers/f6fb6a98-0120-4ed4-a763-951c74a1e5bc/action" status: 202 len: 0 microversion: 2.1 time: 0.244703 Oct 04 23:27:43.466729 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4408/7995] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 23:27:43 2022] POST /compute/v2.1/servers/f6fb6a98-0120-4ed4-a763-951c74a1e5bc/action => generated 0 bytes in 246 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 23:27:43.473101 n-d-860284-1 devstack@n-api.service[134102]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9c149bb3-0a09-4645-ba44-d3908964d17c] AMQP server on 10.222.0.43:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 23:27:43.473997 n-d-860284-1 devstack@n-api.service[134102]: ERROR oslo.messaging._drivers.impl_rabbit [-] [84f2d93b-5df1-409f-ad67-38bf0ff7216a] AMQP server on 10.222.0.43:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 23:27:43.474707 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:27:43.475467 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=34 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:27:43.476782 n-d-860284-1 devstack@n-api.service[134102]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 04 23:27:43.477150 n-d-860284-1 devstack@n-api.service[134102]: Tue Oct 4 23:27:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f6fb6a98-0120-4ed4-a763-951c74a1e5bc (ip 10.222.0.43) !!! Oct 04 23:27:43.479018 n-d-860284-1 devstack@n-api.service[134102]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 04 23:27:43.479149 n-d-860284-1 devstack@n-api.service[134102]: Tue Oct 4 23:27:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f6fb6a98-0120-4ed4-a763-951c74a1e5bc (ip 10.222.0.43) !!! Oct 04 23:27:43.487289 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-48777241-0959-4f35-ae28-d988ecf2f2a7 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:27:43.488001 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-48777241-0959-4f35-ae28-d988ecf2f2a7 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] [instance: f6fb6a98-0120-4ed4-a763-951c74a1e5bc] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:27:43.498827 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-48777241-0959-4f35-ae28-d988ecf2f2a7 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:27:43.499321 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-48777241-0959-4f35-ae28-d988ecf2f2a7 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:27:43.499763 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-48777241-0959-4f35-ae28-d988ecf2f2a7 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:27:43.500472 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-48777241-0959-4f35-ae28-d988ecf2f2a7 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:27:43.501084 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-48777241-0959-4f35-ae28-d988ecf2f2a7 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:27:43.501526 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-48777241-0959-4f35-ae28-d988ecf2f2a7 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:27:43.634375 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-48777241-0959-4f35-ae28-d988ecf2f2a7 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841e202efcb143cf93d6d9bb1f3edba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979814de519c46d08cd2301bf5d33eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:27:43.642960 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-48777241-0959-4f35-ae28-d988ecf2f2a7 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] 10.222.0.43 "GET /compute/v2.1/servers/f6fb6a98-0120-4ed4-a763-951c74a1e5bc" status: 200 len: 1681 microversion: 2.1 time: 0.171705 Oct 04 23:27:43.643553 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3588/7996] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:27:43 2022] GET /compute/v2.1/servers/f6fb6a98-0120-4ed4-a763-951c74a1e5bc => generated 1681 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:27:44.670337 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-7de623d9-d405-4a29-99c1-8512e1e8bac5 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:27:44.671070 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-7de623d9-d405-4a29-99c1-8512e1e8bac5 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] [instance: f6fb6a98-0120-4ed4-a763-951c74a1e5bc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:27:44.684487 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7de623d9-d405-4a29-99c1-8512e1e8bac5 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:27:44.685009 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7de623d9-d405-4a29-99c1-8512e1e8bac5 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:27:44.685475 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7de623d9-d405-4a29-99c1-8512e1e8bac5 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:27:44.686197 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7de623d9-d405-4a29-99c1-8512e1e8bac5 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:27:44.686700 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7de623d9-d405-4a29-99c1-8512e1e8bac5 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:27:44.687153 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7de623d9-d405-4a29-99c1-8512e1e8bac5 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:27:44.687875 n-d-860284-1 devstack@n-api.service[134101]: INFO oslo.messaging._drivers.impl_rabbit [-] [dab38095-fcf8-46d0-9904-6bfbf5d1f82a] Reconnected to AMQP server on 10.222.0.43:5672 via [amqp] client with port 40322. Oct 04 23:27:44.692167 n-d-860284-1 devstack@n-api.service[134101]: INFO oslo.messaging._drivers.impl_rabbit [-] [f8e2fc52-bb96-4bc7-8039-fbfc8addcbeb] Reconnected to AMQP server on 10.222.0.43:5672 via [amqp] client with port 40320. Oct 04 23:27:44.849242 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-7de623d9-d405-4a29-99c1-8512e1e8bac5 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841e202efcb143cf93d6d9bb1f3edba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979814de519c46d08cd2301bf5d33eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:27:44.857575 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-7de623d9-d405-4a29-99c1-8512e1e8bac5 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] 10.222.0.43 "GET /compute/v2.1/servers/f6fb6a98-0120-4ed4-a763-951c74a1e5bc" status: 200 len: 1681 microversion: 2.1 time: 0.194818 Oct 04 23:27:44.858159 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4409/7997] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:27:44 2022] GET /compute/v2.1/servers/f6fb6a98-0120-4ed4-a763-951c74a1e5bc => generated 1681 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:27:45.881290 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-45820ed7-f7ef-4b51-b3c2-04beeb8ce24f tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:27:45.881833 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-45820ed7-f7ef-4b51-b3c2-04beeb8ce24f tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] [instance: f6fb6a98-0120-4ed4-a763-951c74a1e5bc] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:27:45.894550 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-45820ed7-f7ef-4b51-b3c2-04beeb8ce24f tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:27:45.895047 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-45820ed7-f7ef-4b51-b3c2-04beeb8ce24f tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:27:45.895487 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-45820ed7-f7ef-4b51-b3c2-04beeb8ce24f tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:27:45.896229 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-45820ed7-f7ef-4b51-b3c2-04beeb8ce24f tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:27:45.896699 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-45820ed7-f7ef-4b51-b3c2-04beeb8ce24f tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:27:45.897165 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-45820ed7-f7ef-4b51-b3c2-04beeb8ce24f tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:27:45.904220 n-d-860284-1 devstack@n-api.service[134102]: INFO oslo.messaging._drivers.impl_rabbit [-] [84f2d93b-5df1-409f-ad67-38bf0ff7216a] Reconnected to AMQP server on 10.222.0.43:5672 via [amqp] client with port 40330. Oct 04 23:27:45.905035 n-d-860284-1 devstack@n-api.service[134102]: INFO oslo.messaging._drivers.impl_rabbit [-] [9c149bb3-0a09-4645-ba44-d3908964d17c] Reconnected to AMQP server on 10.222.0.43:5672 via [amqp] client with port 40328. Oct 04 23:27:46.034538 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-45820ed7-f7ef-4b51-b3c2-04beeb8ce24f tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841e202efcb143cf93d6d9bb1f3edba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979814de519c46d08cd2301bf5d33eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:27:46.042621 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-45820ed7-f7ef-4b51-b3c2-04beeb8ce24f tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] 10.222.0.43 "GET /compute/v2.1/servers/f6fb6a98-0120-4ed4-a763-951c74a1e5bc" status: 200 len: 1681 microversion: 2.1 time: 0.165409 Oct 04 23:27:46.043207 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3589/7998] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:27:45 2022] GET /compute/v2.1/servers/f6fb6a98-0120-4ed4-a763-951c74a1e5bc => generated 1681 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:27:47.073851 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-9609fefd-9ee9-4ce4-a05d-6590a3d5558d tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:27:47.074727 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-9609fefd-9ee9-4ce4-a05d-6590a3d5558d tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] [instance: f6fb6a98-0120-4ed4-a763-951c74a1e5bc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:27:47.081362 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9609fefd-9ee9-4ce4-a05d-6590a3d5558d tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:27:47.081864 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9609fefd-9ee9-4ce4-a05d-6590a3d5558d tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:27:47.082335 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9609fefd-9ee9-4ce4-a05d-6590a3d5558d tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:27:47.083059 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9609fefd-9ee9-4ce4-a05d-6590a3d5558d tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:27:47.083527 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9609fefd-9ee9-4ce4-a05d-6590a3d5558d tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:27:47.083970 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9609fefd-9ee9-4ce4-a05d-6590a3d5558d tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:27:47.216679 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-9609fefd-9ee9-4ce4-a05d-6590a3d5558d tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841e202efcb143cf93d6d9bb1f3edba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979814de519c46d08cd2301bf5d33eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:27:47.224421 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-9609fefd-9ee9-4ce4-a05d-6590a3d5558d tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] 10.222.0.43 "GET /compute/v2.1/servers/f6fb6a98-0120-4ed4-a763-951c74a1e5bc" status: 200 len: 1681 microversion: 2.1 time: 0.155279 Oct 04 23:27:47.224994 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4410/7999] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:27:47 2022] GET /compute/v2.1/servers/f6fb6a98-0120-4ed4-a763-951c74a1e5bc => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:27:48.248440 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-33008db9-f05f-45b2-b11a-8da46a85cdf1 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:27:48.249063 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-33008db9-f05f-45b2-b11a-8da46a85cdf1 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] [instance: f6fb6a98-0120-4ed4-a763-951c74a1e5bc] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:27:48.255963 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-33008db9-f05f-45b2-b11a-8da46a85cdf1 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:27:48.256450 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-33008db9-f05f-45b2-b11a-8da46a85cdf1 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:27:48.256892 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-33008db9-f05f-45b2-b11a-8da46a85cdf1 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:27:48.257586 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-33008db9-f05f-45b2-b11a-8da46a85cdf1 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:27:48.258044 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-33008db9-f05f-45b2-b11a-8da46a85cdf1 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:27:48.258579 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-33008db9-f05f-45b2-b11a-8da46a85cdf1 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:27:48.388995 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-33008db9-f05f-45b2-b11a-8da46a85cdf1 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841e202efcb143cf93d6d9bb1f3edba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979814de519c46d08cd2301bf5d33eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:27:48.396669 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-33008db9-f05f-45b2-b11a-8da46a85cdf1 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] 10.222.0.43 "GET /compute/v2.1/servers/f6fb6a98-0120-4ed4-a763-951c74a1e5bc" status: 200 len: 1681 microversion: 2.1 time: 0.152266 Oct 04 23:27:48.397255 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3590/8000] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:27:48 2022] GET /compute/v2.1/servers/f6fb6a98-0120-4ed4-a763-951c74a1e5bc => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:27:49.420611 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-07f84f11-eaf3-46b8-b01d-3e329e8aa6de tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:27:49.421285 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-07f84f11-eaf3-46b8-b01d-3e329e8aa6de tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] [instance: f6fb6a98-0120-4ed4-a763-951c74a1e5bc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:27:49.428238 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-07f84f11-eaf3-46b8-b01d-3e329e8aa6de tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:27:49.428745 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-07f84f11-eaf3-46b8-b01d-3e329e8aa6de tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:27:49.429203 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-07f84f11-eaf3-46b8-b01d-3e329e8aa6de tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:27:49.429915 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-07f84f11-eaf3-46b8-b01d-3e329e8aa6de tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:27:49.430411 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-07f84f11-eaf3-46b8-b01d-3e329e8aa6de tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:27:49.430862 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-07f84f11-eaf3-46b8-b01d-3e329e8aa6de tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:27:49.565152 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-07f84f11-eaf3-46b8-b01d-3e329e8aa6de tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841e202efcb143cf93d6d9bb1f3edba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979814de519c46d08cd2301bf5d33eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:27:49.572981 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-07f84f11-eaf3-46b8-b01d-3e329e8aa6de tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] 10.222.0.43 "GET /compute/v2.1/servers/f6fb6a98-0120-4ed4-a763-951c74a1e5bc" status: 200 len: 1681 microversion: 2.1 time: 0.156844 Oct 04 23:27:49.573566 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4411/8001] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:27:49 2022] GET /compute/v2.1/servers/f6fb6a98-0120-4ed4-a763-951c74a1e5bc => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:27:50.597140 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-32fc612a-1f83-479f-817d-9a6570293a83 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:27:50.597782 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-32fc612a-1f83-479f-817d-9a6570293a83 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] [instance: f6fb6a98-0120-4ed4-a763-951c74a1e5bc] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:27:50.604954 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-32fc612a-1f83-479f-817d-9a6570293a83 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:27:50.605441 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-32fc612a-1f83-479f-817d-9a6570293a83 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:27:50.605887 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-32fc612a-1f83-479f-817d-9a6570293a83 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:27:50.606614 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-32fc612a-1f83-479f-817d-9a6570293a83 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:27:50.607078 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-32fc612a-1f83-479f-817d-9a6570293a83 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:27:50.607508 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-32fc612a-1f83-479f-817d-9a6570293a83 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:27:50.746589 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-32fc612a-1f83-479f-817d-9a6570293a83 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841e202efcb143cf93d6d9bb1f3edba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979814de519c46d08cd2301bf5d33eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:27:50.754327 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-32fc612a-1f83-479f-817d-9a6570293a83 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] 10.222.0.43 "GET /compute/v2.1/servers/f6fb6a98-0120-4ed4-a763-951c74a1e5bc" status: 200 len: 1681 microversion: 2.1 time: 0.161134 Oct 04 23:27:50.754991 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3591/8002] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:27:50 2022] GET /compute/v2.1/servers/f6fb6a98-0120-4ed4-a763-951c74a1e5bc => generated 1681 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:27:51.778453 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-94765914-2f90-4b4c-9dde-6775832e750d tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:27:51.779090 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-94765914-2f90-4b4c-9dde-6775832e750d tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] [instance: f6fb6a98-0120-4ed4-a763-951c74a1e5bc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:27:51.786003 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-94765914-2f90-4b4c-9dde-6775832e750d tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:27:51.786554 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-94765914-2f90-4b4c-9dde-6775832e750d tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:27:51.787021 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-94765914-2f90-4b4c-9dde-6775832e750d tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:27:51.787736 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-94765914-2f90-4b4c-9dde-6775832e750d tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:27:51.788215 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-94765914-2f90-4b4c-9dde-6775832e750d tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:27:51.788666 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-94765914-2f90-4b4c-9dde-6775832e750d tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:27:51.922235 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-94765914-2f90-4b4c-9dde-6775832e750d tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841e202efcb143cf93d6d9bb1f3edba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979814de519c46d08cd2301bf5d33eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:27:51.930157 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-94765914-2f90-4b4c-9dde-6775832e750d tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] 10.222.0.43 "GET /compute/v2.1/servers/f6fb6a98-0120-4ed4-a763-951c74a1e5bc" status: 200 len: 1681 microversion: 2.1 time: 0.156314 Oct 04 23:27:51.930842 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4412/8003] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:27:51 2022] GET /compute/v2.1/servers/f6fb6a98-0120-4ed4-a763-951c74a1e5bc => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:27:52.954640 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-88066a7e-09bd-42d3-aeb5-9c7599fe0f1a tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:27:52.955230 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-88066a7e-09bd-42d3-aeb5-9c7599fe0f1a tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] [instance: f6fb6a98-0120-4ed4-a763-951c74a1e5bc] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:27:52.962132 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-88066a7e-09bd-42d3-aeb5-9c7599fe0f1a tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:27:52.962650 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-88066a7e-09bd-42d3-aeb5-9c7599fe0f1a tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:27:52.963864 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-88066a7e-09bd-42d3-aeb5-9c7599fe0f1a tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:27:52.964514 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-88066a7e-09bd-42d3-aeb5-9c7599fe0f1a tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:27:52.964977 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-88066a7e-09bd-42d3-aeb5-9c7599fe0f1a tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:27:52.965408 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-88066a7e-09bd-42d3-aeb5-9c7599fe0f1a tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:27:53.097654 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-88066a7e-09bd-42d3-aeb5-9c7599fe0f1a tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841e202efcb143cf93d6d9bb1f3edba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979814de519c46d08cd2301bf5d33eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:27:53.106803 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-88066a7e-09bd-42d3-aeb5-9c7599fe0f1a tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] 10.222.0.43 "GET /compute/v2.1/servers/f6fb6a98-0120-4ed4-a763-951c74a1e5bc" status: 200 len: 1681 microversion: 2.1 time: 0.156141 Oct 04 23:27:53.107390 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3592/8004] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:27:52 2022] GET /compute/v2.1/servers/f6fb6a98-0120-4ed4-a763-951c74a1e5bc => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:27:54.131215 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-accb3454-4be4-4d74-b7f4-64b317dd8f58 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:27:54.131861 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-accb3454-4be4-4d74-b7f4-64b317dd8f58 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] [instance: f6fb6a98-0120-4ed4-a763-951c74a1e5bc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:27:54.139032 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-accb3454-4be4-4d74-b7f4-64b317dd8f58 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:27:54.139541 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-accb3454-4be4-4d74-b7f4-64b317dd8f58 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:27:54.140003 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-accb3454-4be4-4d74-b7f4-64b317dd8f58 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:27:54.140727 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-accb3454-4be4-4d74-b7f4-64b317dd8f58 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:27:54.141212 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-accb3454-4be4-4d74-b7f4-64b317dd8f58 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:27:54.141658 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-accb3454-4be4-4d74-b7f4-64b317dd8f58 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:27:54.281587 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-accb3454-4be4-4d74-b7f4-64b317dd8f58 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841e202efcb143cf93d6d9bb1f3edba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979814de519c46d08cd2301bf5d33eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:27:54.289385 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-accb3454-4be4-4d74-b7f4-64b317dd8f58 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] 10.222.0.43 "GET /compute/v2.1/servers/f6fb6a98-0120-4ed4-a763-951c74a1e5bc" status: 200 len: 1681 microversion: 2.1 time: 0.162239 Oct 04 23:27:54.289946 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4413/8005] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:27:54 2022] GET /compute/v2.1/servers/f6fb6a98-0120-4ed4-a763-951c74a1e5bc => generated 1681 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:27:55.313777 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-70a55a69-bdc0-4c5d-ac2a-934e1e1a9617 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:27:55.314455 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-70a55a69-bdc0-4c5d-ac2a-934e1e1a9617 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] [instance: f6fb6a98-0120-4ed4-a763-951c74a1e5bc] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:27:55.321417 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-70a55a69-bdc0-4c5d-ac2a-934e1e1a9617 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:27:55.321903 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-70a55a69-bdc0-4c5d-ac2a-934e1e1a9617 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:27:55.322342 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-70a55a69-bdc0-4c5d-ac2a-934e1e1a9617 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:27:55.323110 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-70a55a69-bdc0-4c5d-ac2a-934e1e1a9617 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:27:55.324377 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-70a55a69-bdc0-4c5d-ac2a-934e1e1a9617 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:27:55.324809 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-70a55a69-bdc0-4c5d-ac2a-934e1e1a9617 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:27:55.457002 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-70a55a69-bdc0-4c5d-ac2a-934e1e1a9617 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841e202efcb143cf93d6d9bb1f3edba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979814de519c46d08cd2301bf5d33eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:27:55.464882 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-70a55a69-bdc0-4c5d-ac2a-934e1e1a9617 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] 10.222.0.43 "GET /compute/v2.1/servers/f6fb6a98-0120-4ed4-a763-951c74a1e5bc" status: 200 len: 1702 microversion: 2.1 time: 0.155081 Oct 04 23:27:55.465468 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3593/8006] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:27:55 2022] GET /compute/v2.1/servers/f6fb6a98-0120-4ed4-a763-951c74a1e5bc => generated 1702 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:27:56.488895 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-16443eb5-7665-4050-9504-bbbe3b6e34c3 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:27:56.489462 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-16443eb5-7665-4050-9504-bbbe3b6e34c3 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] [instance: f6fb6a98-0120-4ed4-a763-951c74a1e5bc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:27:56.496260 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-16443eb5-7665-4050-9504-bbbe3b6e34c3 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:27:56.496846 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-16443eb5-7665-4050-9504-bbbe3b6e34c3 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:27:56.497336 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-16443eb5-7665-4050-9504-bbbe3b6e34c3 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:27:56.498054 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-16443eb5-7665-4050-9504-bbbe3b6e34c3 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:27:56.498571 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-16443eb5-7665-4050-9504-bbbe3b6e34c3 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:27:56.499015 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-16443eb5-7665-4050-9504-bbbe3b6e34c3 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:27:56.633033 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-16443eb5-7665-4050-9504-bbbe3b6e34c3 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841e202efcb143cf93d6d9bb1f3edba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979814de519c46d08cd2301bf5d33eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:27:56.641568 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-16443eb5-7665-4050-9504-bbbe3b6e34c3 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] 10.222.0.43 "GET /compute/v2.1/servers/f6fb6a98-0120-4ed4-a763-951c74a1e5bc" status: 200 len: 1702 microversion: 2.1 time: 0.156679 Oct 04 23:27:56.642148 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4414/8007] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:27:56 2022] GET /compute/v2.1/servers/f6fb6a98-0120-4ed4-a763-951c74a1e5bc => generated 1702 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:27:57.664815 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-7b96589c-582a-43ce-b285-6a8ad86a5b69 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:27:57.665562 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-7b96589c-582a-43ce-b285-6a8ad86a5b69 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] [instance: f6fb6a98-0120-4ed4-a763-951c74a1e5bc] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:27:57.673084 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7b96589c-582a-43ce-b285-6a8ad86a5b69 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:27:57.673582 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7b96589c-582a-43ce-b285-6a8ad86a5b69 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:27:57.674025 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7b96589c-582a-43ce-b285-6a8ad86a5b69 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:27:57.674776 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7b96589c-582a-43ce-b285-6a8ad86a5b69 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:27:57.675403 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7b96589c-582a-43ce-b285-6a8ad86a5b69 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:27:57.675835 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7b96589c-582a-43ce-b285-6a8ad86a5b69 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:27:57.818105 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-7b96589c-582a-43ce-b285-6a8ad86a5b69 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841e202efcb143cf93d6d9bb1f3edba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979814de519c46d08cd2301bf5d33eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:27:57.826756 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-7b96589c-582a-43ce-b285-6a8ad86a5b69 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] 10.222.0.43 "GET /compute/v2.1/servers/f6fb6a98-0120-4ed4-a763-951c74a1e5bc" status: 200 len: 1702 microversion: 2.1 time: 0.165672 Oct 04 23:27:57.827184 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3594/8008] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:27:57 2022] GET /compute/v2.1/servers/f6fb6a98-0120-4ed4-a763-951c74a1e5bc => generated 1702 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:27:57.864940 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-fe4fa6f6-0551-47ea-b2b7-501667211e90 req-ae37b92a-c4c3-47bc-9ca5-8c39a72ae71c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6fb6a98-0120-4ed4-a763-951c74a1e5bc", "name": "network-vif-plugged", "status": "completed", "tag": "73b3b80a-1887-4868-9e74-19b14e43d2d3"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 23:27:57.874599 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-fe4fa6f6-0551-47ea-b2b7-501667211e90 req-ae37b92a-c4c3-47bc-9ca5-8c39a72ae71c service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:27:57.875102 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-fe4fa6f6-0551-47ea-b2b7-501667211e90 req-ae37b92a-c4c3-47bc-9ca5-8c39a72ae71c service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:27:57.875558 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-fe4fa6f6-0551-47ea-b2b7-501667211e90 req-ae37b92a-c4c3-47bc-9ca5-8c39a72ae71c service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:27:57.886956 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-fe4fa6f6-0551-47ea-b2b7-501667211e90 req-ae37b92a-c4c3-47bc-9ca5-8c39a72ae71c service nova] Creating event network-vif-plugged:73b3b80a-1887-4868-9e74-19b14e43d2d3 for instance f6fb6a98-0120-4ed4-a763-951c74a1e5bc on n-h1-860284-1 Oct 04 23:27:57.892175 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-fe4fa6f6-0551-47ea-b2b7-501667211e90 req-ae37b92a-c4c3-47bc-9ca5-8c39a72ae71c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101995 Oct 04 23:27:57.892795 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4415/8009] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 23:27:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 23:27:58.850794 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-17ce33ad-c61d-42db-ad35-19d73515f10f tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:27:58.851415 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-17ce33ad-c61d-42db-ad35-19d73515f10f tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] [instance: f6fb6a98-0120-4ed4-a763-951c74a1e5bc] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:27:58.859272 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-17ce33ad-c61d-42db-ad35-19d73515f10f tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:27:58.859759 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-17ce33ad-c61d-42db-ad35-19d73515f10f tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:27:58.860196 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-17ce33ad-c61d-42db-ad35-19d73515f10f tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:27:58.860887 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-17ce33ad-c61d-42db-ad35-19d73515f10f tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:27:58.861347 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-17ce33ad-c61d-42db-ad35-19d73515f10f tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:27:58.861774 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-17ce33ad-c61d-42db-ad35-19d73515f10f tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:27:58.996037 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-17ce33ad-c61d-42db-ad35-19d73515f10f tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841e202efcb143cf93d6d9bb1f3edba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979814de519c46d08cd2301bf5d33eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:27:59.003835 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-17ce33ad-c61d-42db-ad35-19d73515f10f tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] 10.222.0.43 "GET /compute/v2.1/servers/f6fb6a98-0120-4ed4-a763-951c74a1e5bc" status: 200 len: 1702 microversion: 2.1 time: 0.157051 Oct 04 23:27:59.004415 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3595/8010] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:27:58 2022] GET /compute/v2.1/servers/f6fb6a98-0120-4ed4-a763-951c74a1e5bc => generated 1702 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:28:00.028893 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-f21432e3-27ea-4246-bb41-2517806b63c6 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:28:00.029619 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-f21432e3-27ea-4246-bb41-2517806b63c6 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] [instance: f6fb6a98-0120-4ed4-a763-951c74a1e5bc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:28:00.035877 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f21432e3-27ea-4246-bb41-2517806b63c6 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:28:00.036384 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f21432e3-27ea-4246-bb41-2517806b63c6 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:28:00.036865 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f21432e3-27ea-4246-bb41-2517806b63c6 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:28:00.037580 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f21432e3-27ea-4246-bb41-2517806b63c6 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:28:00.038067 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f21432e3-27ea-4246-bb41-2517806b63c6 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:28:00.038522 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f21432e3-27ea-4246-bb41-2517806b63c6 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:28:00.173498 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-f21432e3-27ea-4246-bb41-2517806b63c6 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841e202efcb143cf93d6d9bb1f3edba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979814de519c46d08cd2301bf5d33eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:28:00.181348 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-f21432e3-27ea-4246-bb41-2517806b63c6 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] 10.222.0.43 "GET /compute/v2.1/servers/f6fb6a98-0120-4ed4-a763-951c74a1e5bc" status: 200 len: 1702 microversion: 2.1 time: 0.157669 Oct 04 23:28:00.181968 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4416/8011] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:28:00 2022] GET /compute/v2.1/servers/f6fb6a98-0120-4ed4-a763-951c74a1e5bc => generated 1702 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:28:01.206339 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-c680ff04-98d3-4ce0-abaf-01fc856854c7 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:28:01.207253 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-c680ff04-98d3-4ce0-abaf-01fc856854c7 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] [instance: f6fb6a98-0120-4ed4-a763-951c74a1e5bc] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:28:01.215671 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c680ff04-98d3-4ce0-abaf-01fc856854c7 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:28:01.216277 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c680ff04-98d3-4ce0-abaf-01fc856854c7 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:28:01.216781 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c680ff04-98d3-4ce0-abaf-01fc856854c7 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:28:01.217551 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c680ff04-98d3-4ce0-abaf-01fc856854c7 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:28:01.218077 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c680ff04-98d3-4ce0-abaf-01fc856854c7 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:28:01.218599 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c680ff04-98d3-4ce0-abaf-01fc856854c7 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:28:01.362705 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-c680ff04-98d3-4ce0-abaf-01fc856854c7 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841e202efcb143cf93d6d9bb1f3edba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979814de519c46d08cd2301bf5d33eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:28:01.373726 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-c680ff04-98d3-4ce0-abaf-01fc856854c7 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] 10.222.0.43 "GET /compute/v2.1/servers/f6fb6a98-0120-4ed4-a763-951c74a1e5bc" status: 200 len: 1697 microversion: 2.1 time: 0.172343 Oct 04 23:28:01.389640 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3596/8012] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:28:01 2022] GET /compute/v2.1/servers/f6fb6a98-0120-4ed4-a763-951c74a1e5bc => generated 1697 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 23:28:02.397383 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-d9ba2873-4a8c-4c22-96f4-515265a95aa6 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:28:02.399008 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-d9ba2873-4a8c-4c22-96f4-515265a95aa6 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] [instance: f6fb6a98-0120-4ed4-a763-951c74a1e5bc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:28:02.406500 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d9ba2873-4a8c-4c22-96f4-515265a95aa6 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:28:02.407078 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d9ba2873-4a8c-4c22-96f4-515265a95aa6 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:28:02.407755 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d9ba2873-4a8c-4c22-96f4-515265a95aa6 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:28:02.408843 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d9ba2873-4a8c-4c22-96f4-515265a95aa6 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:28:02.409351 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d9ba2873-4a8c-4c22-96f4-515265a95aa6 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:28:02.409798 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d9ba2873-4a8c-4c22-96f4-515265a95aa6 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:28:02.570572 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-d9ba2873-4a8c-4c22-96f4-515265a95aa6 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841e202efcb143cf93d6d9bb1f3edba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979814de519c46d08cd2301bf5d33eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:28:02.579843 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-d9ba2873-4a8c-4c22-96f4-515265a95aa6 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] 10.222.0.43 "GET /compute/v2.1/servers/f6fb6a98-0120-4ed4-a763-951c74a1e5bc" status: 200 len: 1697 microversion: 2.1 time: 0.186435 Oct 04 23:28:02.580774 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4417/8013] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:28:02 2022] GET /compute/v2.1/servers/f6fb6a98-0120-4ed4-a763-951c74a1e5bc => generated 1697 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 23:28:03.607952 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-6284048b-b284-4a81-932e-600cc2a722a7 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:28:03.608585 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-6284048b-b284-4a81-932e-600cc2a722a7 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] [instance: f6fb6a98-0120-4ed4-a763-951c74a1e5bc] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:28:03.616459 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6284048b-b284-4a81-932e-600cc2a722a7 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:28:03.617955 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6284048b-b284-4a81-932e-600cc2a722a7 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:28:03.618678 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6284048b-b284-4a81-932e-600cc2a722a7 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:28:03.620123 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6284048b-b284-4a81-932e-600cc2a722a7 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:28:03.620931 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6284048b-b284-4a81-932e-600cc2a722a7 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:28:03.621531 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6284048b-b284-4a81-932e-600cc2a722a7 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:28:03.781151 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-6284048b-b284-4a81-932e-600cc2a722a7 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841e202efcb143cf93d6d9bb1f3edba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979814de519c46d08cd2301bf5d33eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:28:03.790219 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-6284048b-b284-4a81-932e-600cc2a722a7 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] 10.222.0.43 "GET /compute/v2.1/servers/f6fb6a98-0120-4ed4-a763-951c74a1e5bc" status: 200 len: 1697 microversion: 2.1 time: 0.186888 Oct 04 23:28:03.791423 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3597/8014] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:28:03 2022] GET /compute/v2.1/servers/f6fb6a98-0120-4ed4-a763-951c74a1e5bc => generated 1697 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:28:04.814917 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-ff46ee46-88fe-46b2-be24-6132da2585a3 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:28:04.815730 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-ff46ee46-88fe-46b2-be24-6132da2585a3 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] [instance: f6fb6a98-0120-4ed4-a763-951c74a1e5bc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:28:04.822939 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ff46ee46-88fe-46b2-be24-6132da2585a3 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:28:04.823731 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ff46ee46-88fe-46b2-be24-6132da2585a3 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:28:04.824183 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ff46ee46-88fe-46b2-be24-6132da2585a3 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:28:04.825886 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ff46ee46-88fe-46b2-be24-6132da2585a3 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:28:04.826411 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ff46ee46-88fe-46b2-be24-6132da2585a3 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:28:04.826850 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ff46ee46-88fe-46b2-be24-6132da2585a3 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:28:04.972576 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-ff46ee46-88fe-46b2-be24-6132da2585a3 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841e202efcb143cf93d6d9bb1f3edba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979814de519c46d08cd2301bf5d33eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:28:04.981260 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-ff46ee46-88fe-46b2-be24-6132da2585a3 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] 10.222.0.43 "GET /compute/v2.1/servers/f6fb6a98-0120-4ed4-a763-951c74a1e5bc" status: 200 len: 1697 microversion: 2.1 time: 0.170098 Oct 04 23:28:04.982840 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4418/8015] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:28:04 2022] GET /compute/v2.1/servers/f6fb6a98-0120-4ed4-a763-951c74a1e5bc => generated 1697 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:28:06.011345 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-2b870c3d-dbc6-40e3-873f-197f59e9cc96 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:28:06.013375 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-2b870c3d-dbc6-40e3-873f-197f59e9cc96 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] [instance: f6fb6a98-0120-4ed4-a763-951c74a1e5bc] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:28:06.021283 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2b870c3d-dbc6-40e3-873f-197f59e9cc96 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:28:06.022261 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2b870c3d-dbc6-40e3-873f-197f59e9cc96 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:28:06.023078 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2b870c3d-dbc6-40e3-873f-197f59e9cc96 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:28:06.024072 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2b870c3d-dbc6-40e3-873f-197f59e9cc96 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:28:06.025022 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2b870c3d-dbc6-40e3-873f-197f59e9cc96 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:28:06.025816 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2b870c3d-dbc6-40e3-873f-197f59e9cc96 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:28:06.186157 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-2b870c3d-dbc6-40e3-873f-197f59e9cc96 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841e202efcb143cf93d6d9bb1f3edba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979814de519c46d08cd2301bf5d33eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:28:06.195814 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-2b870c3d-dbc6-40e3-873f-197f59e9cc96 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] 10.222.0.43 "GET /compute/v2.1/servers/f6fb6a98-0120-4ed4-a763-951c74a1e5bc" status: 200 len: 1697 microversion: 2.1 time: 0.188664 Oct 04 23:28:06.196758 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3598/8016] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:28:06 2022] GET /compute/v2.1/servers/f6fb6a98-0120-4ed4-a763-951c74a1e5bc => generated 1697 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:28:07.221016 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-abb7ac9b-d684-435e-8ff3-411b4f800635 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:28:07.221739 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-abb7ac9b-d684-435e-8ff3-411b4f800635 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] [instance: f6fb6a98-0120-4ed4-a763-951c74a1e5bc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:28:07.228225 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-abb7ac9b-d684-435e-8ff3-411b4f800635 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:28:07.228700 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-abb7ac9b-d684-435e-8ff3-411b4f800635 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:28:07.229047 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-abb7ac9b-d684-435e-8ff3-411b4f800635 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:28:07.229775 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-abb7ac9b-d684-435e-8ff3-411b4f800635 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:28:07.230256 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-abb7ac9b-d684-435e-8ff3-411b4f800635 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:28:07.230733 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-abb7ac9b-d684-435e-8ff3-411b4f800635 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:28:07.401310 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-abb7ac9b-d684-435e-8ff3-411b4f800635 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841e202efcb143cf93d6d9bb1f3edba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979814de519c46d08cd2301bf5d33eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:28:07.410710 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-abb7ac9b-d684-435e-8ff3-411b4f800635 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] 10.222.0.43 "GET /compute/v2.1/servers/f6fb6a98-0120-4ed4-a763-951c74a1e5bc" status: 200 len: 1697 microversion: 2.1 time: 0.194531 Oct 04 23:28:07.411453 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4419/8017] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:28:07 2022] GET /compute/v2.1/servers/f6fb6a98-0120-4ed4-a763-951c74a1e5bc => generated 1697 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:28:08.436768 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-f4dc76fc-2bb6-4f5d-b5e5-eecba699aba6 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:28:08.437355 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-f4dc76fc-2bb6-4f5d-b5e5-eecba699aba6 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] [instance: f6fb6a98-0120-4ed4-a763-951c74a1e5bc] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:28:08.445189 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f4dc76fc-2bb6-4f5d-b5e5-eecba699aba6 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:28:08.445682 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f4dc76fc-2bb6-4f5d-b5e5-eecba699aba6 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:28:08.446126 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f4dc76fc-2bb6-4f5d-b5e5-eecba699aba6 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:28:08.446863 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f4dc76fc-2bb6-4f5d-b5e5-eecba699aba6 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:28:08.447327 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f4dc76fc-2bb6-4f5d-b5e5-eecba699aba6 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:28:08.447753 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f4dc76fc-2bb6-4f5d-b5e5-eecba699aba6 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:28:08.611427 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-f4dc76fc-2bb6-4f5d-b5e5-eecba699aba6 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841e202efcb143cf93d6d9bb1f3edba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979814de519c46d08cd2301bf5d33eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:28:08.622750 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-f4dc76fc-2bb6-4f5d-b5e5-eecba699aba6 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] 10.222.0.43 "GET /compute/v2.1/servers/f6fb6a98-0120-4ed4-a763-951c74a1e5bc" status: 200 len: 1697 microversion: 2.1 time: 0.192453 Oct 04 23:28:08.623571 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3599/8018] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:28:08 2022] GET /compute/v2.1/servers/f6fb6a98-0120-4ed4-a763-951c74a1e5bc => generated 1697 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:28:09.647454 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-5c132048-a91d-4850-905c-0b00b3a0dca7 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:28:09.649145 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-5c132048-a91d-4850-905c-0b00b3a0dca7 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] [instance: f6fb6a98-0120-4ed4-a763-951c74a1e5bc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:28:09.657846 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5c132048-a91d-4850-905c-0b00b3a0dca7 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:28:09.658372 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5c132048-a91d-4850-905c-0b00b3a0dca7 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:28:09.658958 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5c132048-a91d-4850-905c-0b00b3a0dca7 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:28:09.659740 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5c132048-a91d-4850-905c-0b00b3a0dca7 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:28:09.660213 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5c132048-a91d-4850-905c-0b00b3a0dca7 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:28:09.660656 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5c132048-a91d-4850-905c-0b00b3a0dca7 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:28:09.818221 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-5c132048-a91d-4850-905c-0b00b3a0dca7 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841e202efcb143cf93d6d9bb1f3edba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979814de519c46d08cd2301bf5d33eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:28:09.829009 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-5c132048-a91d-4850-905c-0b00b3a0dca7 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] 10.222.0.43 "GET /compute/v2.1/servers/f6fb6a98-0120-4ed4-a763-951c74a1e5bc" status: 200 len: 1697 microversion: 2.1 time: 0.186377 Oct 04 23:28:09.842386 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4420/8019] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:28:09 2022] GET /compute/v2.1/servers/f6fb6a98-0120-4ed4-a763-951c74a1e5bc => generated 1697 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:28:10.853894 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-156dd69b-cdb4-4250-94f0-a0b81ea05547 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:28:10.854555 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-156dd69b-cdb4-4250-94f0-a0b81ea05547 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] [instance: f6fb6a98-0120-4ed4-a763-951c74a1e5bc] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:28:10.862243 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-156dd69b-cdb4-4250-94f0-a0b81ea05547 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:28:10.862764 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-156dd69b-cdb4-4250-94f0-a0b81ea05547 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:28:10.863212 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-156dd69b-cdb4-4250-94f0-a0b81ea05547 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:28:10.863914 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-156dd69b-cdb4-4250-94f0-a0b81ea05547 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:28:10.864386 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-156dd69b-cdb4-4250-94f0-a0b81ea05547 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:28:10.864818 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-156dd69b-cdb4-4250-94f0-a0b81ea05547 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:28:11.003061 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-156dd69b-cdb4-4250-94f0-a0b81ea05547 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841e202efcb143cf93d6d9bb1f3edba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979814de519c46d08cd2301bf5d33eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:28:11.010780 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-156dd69b-cdb4-4250-94f0-a0b81ea05547 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] 10.222.0.43 "GET /compute/v2.1/servers/f6fb6a98-0120-4ed4-a763-951c74a1e5bc" status: 200 len: 1697 microversion: 2.1 time: 0.161078 Oct 04 23:28:11.011360 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3600/8020] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:28:10 2022] GET /compute/v2.1/servers/f6fb6a98-0120-4ed4-a763-951c74a1e5bc => generated 1697 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:28:12.035284 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-af2887ab-3653-4d87-9b6e-0ced408e5cd6 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:28:12.035920 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-af2887ab-3653-4d87-9b6e-0ced408e5cd6 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] [instance: f6fb6a98-0120-4ed4-a763-951c74a1e5bc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:28:12.042728 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-af2887ab-3653-4d87-9b6e-0ced408e5cd6 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:28:12.043236 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-af2887ab-3653-4d87-9b6e-0ced408e5cd6 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:28:12.043880 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-af2887ab-3653-4d87-9b6e-0ced408e5cd6 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:28:12.044805 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-af2887ab-3653-4d87-9b6e-0ced408e5cd6 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:28:12.045280 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-af2887ab-3653-4d87-9b6e-0ced408e5cd6 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:28:12.045726 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-af2887ab-3653-4d87-9b6e-0ced408e5cd6 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:28:12.180693 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-af2887ab-3653-4d87-9b6e-0ced408e5cd6 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841e202efcb143cf93d6d9bb1f3edba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979814de519c46d08cd2301bf5d33eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:28:12.188776 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-af2887ab-3653-4d87-9b6e-0ced408e5cd6 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] 10.222.0.43 "GET /compute/v2.1/servers/f6fb6a98-0120-4ed4-a763-951c74a1e5bc" status: 200 len: 1679 microversion: 2.1 time: 0.157393 Oct 04 23:28:12.189360 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4421/8021] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:28:12 2022] GET /compute/v2.1/servers/f6fb6a98-0120-4ed4-a763-951c74a1e5bc => generated 1679 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:28:13.212035 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-12f03e67-ef12-410c-a8e5-29b771246ca0 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:28:13.212805 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-12f03e67-ef12-410c-a8e5-29b771246ca0 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] [instance: f6fb6a98-0120-4ed4-a763-951c74a1e5bc] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:28:13.220117 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-12f03e67-ef12-410c-a8e5-29b771246ca0 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:28:13.220605 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-12f03e67-ef12-410c-a8e5-29b771246ca0 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:28:13.221043 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-12f03e67-ef12-410c-a8e5-29b771246ca0 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:28:13.221741 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-12f03e67-ef12-410c-a8e5-29b771246ca0 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:28:13.222204 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-12f03e67-ef12-410c-a8e5-29b771246ca0 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:28:13.222791 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-12f03e67-ef12-410c-a8e5-29b771246ca0 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:28:13.361606 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-12f03e67-ef12-410c-a8e5-29b771246ca0 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841e202efcb143cf93d6d9bb1f3edba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979814de519c46d08cd2301bf5d33eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:28:13.369681 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-12f03e67-ef12-410c-a8e5-29b771246ca0 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] 10.222.0.43 "GET /compute/v2.1/servers/f6fb6a98-0120-4ed4-a763-951c74a1e5bc" status: 200 len: 1682 microversion: 2.1 time: 0.161645 Oct 04 23:28:13.370277 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3601/8022] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:28:13 2022] GET /compute/v2.1/servers/f6fb6a98-0120-4ed4-a763-951c74a1e5bc => generated 1682 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:28:13.393408 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-d8155102-a9ad-4aec-8ee8-7cc4e56b3a2f tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 23:28:13.394146 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-d8155102-a9ad-4aec-8ee8-7cc4e56b3a2f tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] [instance: f6fb6a98-0120-4ed4-a763-951c74a1e5bc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:28:13.397089 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=29 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:28:13.402746 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d8155102-a9ad-4aec-8ee8-7cc4e56b3a2f tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:28:13.403570 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d8155102-a9ad-4aec-8ee8-7cc4e56b3a2f tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:28:13.404091 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d8155102-a9ad-4aec-8ee8-7cc4e56b3a2f tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:28:13.404868 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d8155102-a9ad-4aec-8ee8-7cc4e56b3a2f tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:28:13.405410 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d8155102-a9ad-4aec-8ee8-7cc4e56b3a2f tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:28:13.405857 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d8155102-a9ad-4aec-8ee8-7cc4e56b3a2f tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:28:13.408478 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:28:13.495690 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-d8155102-a9ad-4aec-8ee8-7cc4e56b3a2f tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] [instance: f6fb6a98-0120-4ed4-a763-951c74a1e5bc] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=134101) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 04 23:28:13.566738 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-d8155102-a9ad-4aec-8ee8-7cc4e56b3a2f tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] 10.222.0.43 "POST /compute/v2.1/servers/f6fb6a98-0120-4ed4-a763-951c74a1e5bc/action" status: 202 len: 0 microversion: 2.1 time: 0.177183 Oct 04 23:28:13.567278 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4422/8023] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 23:28:13 2022] POST /compute/v2.1/servers/f6fb6a98-0120-4ed4-a763-951c74a1e5bc/action => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 23:28:13.578634 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-6d6ea0bb-1a9b-4ee5-a669-f765ae7b8d74 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:28:13.579260 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-6d6ea0bb-1a9b-4ee5-a669-f765ae7b8d74 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] [instance: f6fb6a98-0120-4ed4-a763-951c74a1e5bc] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:28:13.584173 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_api:SELECT=29 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:28:13.586257 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6d6ea0bb-1a9b-4ee5-a669-f765ae7b8d74 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:28:13.586903 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6d6ea0bb-1a9b-4ee5-a669-f765ae7b8d74 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:28:13.587347 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6d6ea0bb-1a9b-4ee5-a669-f765ae7b8d74 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:28:13.588076 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6d6ea0bb-1a9b-4ee5-a669-f765ae7b8d74 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:28:13.588516 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6d6ea0bb-1a9b-4ee5-a669-f765ae7b8d74 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:28:13.588939 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6d6ea0bb-1a9b-4ee5-a669-f765ae7b8d74 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:28:13.592802 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=85 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:28:13.732787 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-6d6ea0bb-1a9b-4ee5-a669-f765ae7b8d74 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841e202efcb143cf93d6d9bb1f3edba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979814de519c46d08cd2301bf5d33eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:28:13.740582 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-6d6ea0bb-1a9b-4ee5-a669-f765ae7b8d74 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] 10.222.0.43 "GET /compute/v2.1/servers/f6fb6a98-0120-4ed4-a763-951c74a1e5bc" status: 200 len: 1630 microversion: 2.1 time: 0.167038 Oct 04 23:28:13.741173 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3602/8024] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:28:13 2022] GET /compute/v2.1/servers/f6fb6a98-0120-4ed4-a763-951c74a1e5bc => generated 1630 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:28:14.764297 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-1d655b59-2d2e-4bef-9c45-3ab971c145ab tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:28:14.764965 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-1d655b59-2d2e-4bef-9c45-3ab971c145ab tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] [instance: f6fb6a98-0120-4ed4-a763-951c74a1e5bc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:28:14.771108 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1d655b59-2d2e-4bef-9c45-3ab971c145ab tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:28:14.771617 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1d655b59-2d2e-4bef-9c45-3ab971c145ab tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:28:14.772074 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1d655b59-2d2e-4bef-9c45-3ab971c145ab tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:28:14.772789 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1d655b59-2d2e-4bef-9c45-3ab971c145ab tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:28:14.773266 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1d655b59-2d2e-4bef-9c45-3ab971c145ab tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:28:14.773712 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1d655b59-2d2e-4bef-9c45-3ab971c145ab tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:28:14.906636 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-1d655b59-2d2e-4bef-9c45-3ab971c145ab tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841e202efcb143cf93d6d9bb1f3edba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979814de519c46d08cd2301bf5d33eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:28:14.914455 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-1d655b59-2d2e-4bef-9c45-3ab971c145ab tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] 10.222.0.43 "GET /compute/v2.1/servers/f6fb6a98-0120-4ed4-a763-951c74a1e5bc" status: 200 len: 1630 microversion: 2.1 time: 0.155152 Oct 04 23:28:14.915045 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4423/8025] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:28:14 2022] GET /compute/v2.1/servers/f6fb6a98-0120-4ed4-a763-951c74a1e5bc => generated 1630 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:28:15.839370 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-ebda7bff-3e04-46cc-8a93-8911e113da47 req-9c7150da-dca4-4c28-b220-a7b3761d7080 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6fb6a98-0120-4ed4-a763-951c74a1e5bc", "name": "network-vif-unplugged", "status": "completed", "tag": "73b3b80a-1887-4868-9e74-19b14e43d2d3"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 23:28:15.852148 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-ebda7bff-3e04-46cc-8a93-8911e113da47 req-9c7150da-dca4-4c28-b220-a7b3761d7080 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:28:15.852640 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-ebda7bff-3e04-46cc-8a93-8911e113da47 req-9c7150da-dca4-4c28-b220-a7b3761d7080 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:28:15.853325 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-ebda7bff-3e04-46cc-8a93-8911e113da47 req-9c7150da-dca4-4c28-b220-a7b3761d7080 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:28:15.864744 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.compute.server_external_events [req-ebda7bff-3e04-46cc-8a93-8911e113da47 req-9c7150da-dca4-4c28-b220-a7b3761d7080 service nova] Unable to find a host for instance f6fb6a98-0120-4ed4-a763-951c74a1e5bc. Dropping event network-vif-unplugged {{(pid=134102) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 04 23:28:15.865666 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-ebda7bff-3e04-46cc-8a93-8911e113da47 req-9c7150da-dca4-4c28-b220-a7b3761d7080 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.030289 Oct 04 23:28:15.866259 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3603/8026] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 23:28:15 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 32 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 04 23:28:15.938014 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-f938dbf6-f2dc-472d-ab9f-2c770370680a tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:28:15.938740 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-f938dbf6-f2dc-472d-ab9f-2c770370680a tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] [instance: f6fb6a98-0120-4ed4-a763-951c74a1e5bc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:28:15.945717 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f938dbf6-f2dc-472d-ab9f-2c770370680a tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:28:15.946218 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f938dbf6-f2dc-472d-ab9f-2c770370680a tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:28:15.946710 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f938dbf6-f2dc-472d-ab9f-2c770370680a tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:28:15.947417 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f938dbf6-f2dc-472d-ab9f-2c770370680a tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:28:15.947893 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f938dbf6-f2dc-472d-ab9f-2c770370680a tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:28:15.948341 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f938dbf6-f2dc-472d-ab9f-2c770370680a tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:28:16.085354 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-f938dbf6-f2dc-472d-ab9f-2c770370680a tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841e202efcb143cf93d6d9bb1f3edba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979814de519c46d08cd2301bf5d33eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:28:16.093996 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-f938dbf6-f2dc-472d-ab9f-2c770370680a tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] 10.222.0.43 "GET /compute/v2.1/servers/f6fb6a98-0120-4ed4-a763-951c74a1e5bc" status: 200 len: 1630 microversion: 2.1 time: 0.160124 Oct 04 23:28:16.094611 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4424/8027] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:28:15 2022] GET /compute/v2.1/servers/f6fb6a98-0120-4ed4-a763-951c74a1e5bc => generated 1630 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:28:17.117463 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-8398acb0-f20f-4865-b17f-5ef0d0370a3f tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:28:17.118088 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-8398acb0-f20f-4865-b17f-5ef0d0370a3f tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] [instance: f6fb6a98-0120-4ed4-a763-951c74a1e5bc] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:28:17.125133 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8398acb0-f20f-4865-b17f-5ef0d0370a3f tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:28:17.125629 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8398acb0-f20f-4865-b17f-5ef0d0370a3f tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:28:17.126072 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8398acb0-f20f-4865-b17f-5ef0d0370a3f tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:28:17.126802 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8398acb0-f20f-4865-b17f-5ef0d0370a3f tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:28:17.127266 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8398acb0-f20f-4865-b17f-5ef0d0370a3f tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:28:17.127706 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8398acb0-f20f-4865-b17f-5ef0d0370a3f tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:28:17.261121 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-8398acb0-f20f-4865-b17f-5ef0d0370a3f tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841e202efcb143cf93d6d9bb1f3edba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979814de519c46d08cd2301bf5d33eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:28:17.269408 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-8398acb0-f20f-4865-b17f-5ef0d0370a3f tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] 10.222.0.43 "GET /compute/v2.1/servers/f6fb6a98-0120-4ed4-a763-951c74a1e5bc" status: 200 len: 1630 microversion: 2.1 time: 0.155889 Oct 04 23:28:17.269999 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3604/8028] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:28:17 2022] GET /compute/v2.1/servers/f6fb6a98-0120-4ed4-a763-951c74a1e5bc => generated 1630 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:28:18.293253 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-0a8d96c5-8322-4827-9e73-1a87b1bac8eb tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:28:18.293978 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-0a8d96c5-8322-4827-9e73-1a87b1bac8eb tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] [instance: f6fb6a98-0120-4ed4-a763-951c74a1e5bc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:28:18.301089 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0a8d96c5-8322-4827-9e73-1a87b1bac8eb tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:28:18.301590 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0a8d96c5-8322-4827-9e73-1a87b1bac8eb tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:28:18.302044 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0a8d96c5-8322-4827-9e73-1a87b1bac8eb tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:28:18.302781 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0a8d96c5-8322-4827-9e73-1a87b1bac8eb tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:28:18.303254 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0a8d96c5-8322-4827-9e73-1a87b1bac8eb tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:28:18.303697 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0a8d96c5-8322-4827-9e73-1a87b1bac8eb tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:28:18.437599 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-0a8d96c5-8322-4827-9e73-1a87b1bac8eb tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841e202efcb143cf93d6d9bb1f3edba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979814de519c46d08cd2301bf5d33eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:28:18.447210 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-0a8d96c5-8322-4827-9e73-1a87b1bac8eb tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] 10.222.0.43 "GET /compute/v2.1/servers/f6fb6a98-0120-4ed4-a763-951c74a1e5bc" status: 200 len: 1630 microversion: 2.1 time: 0.157876 Oct 04 23:28:18.447804 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4425/8029] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:28:18 2022] GET /compute/v2.1/servers/f6fb6a98-0120-4ed4-a763-951c74a1e5bc => generated 1630 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:28:19.472043 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-bb6c052e-e085-4f50-95c5-ff920430aee2 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:28:19.472665 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-bb6c052e-e085-4f50-95c5-ff920430aee2 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] [instance: f6fb6a98-0120-4ed4-a763-951c74a1e5bc] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:28:19.480000 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bb6c052e-e085-4f50-95c5-ff920430aee2 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:28:19.480533 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bb6c052e-e085-4f50-95c5-ff920430aee2 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:28:19.481569 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bb6c052e-e085-4f50-95c5-ff920430aee2 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:28:19.482295 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bb6c052e-e085-4f50-95c5-ff920430aee2 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:28:19.482780 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bb6c052e-e085-4f50-95c5-ff920430aee2 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:28:19.483212 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-bb6c052e-e085-4f50-95c5-ff920430aee2 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:28:19.620585 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-bb6c052e-e085-4f50-95c5-ff920430aee2 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841e202efcb143cf93d6d9bb1f3edba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979814de519c46d08cd2301bf5d33eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:28:19.629776 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-bb6c052e-e085-4f50-95c5-ff920430aee2 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] 10.222.0.43 "GET /compute/v2.1/servers/f6fb6a98-0120-4ed4-a763-951c74a1e5bc" status: 200 len: 1688 microversion: 2.1 time: 0.161647 Oct 04 23:28:19.642608 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3605/8030] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:28:19 2022] GET /compute/v2.1/servers/f6fb6a98-0120-4ed4-a763-951c74a1e5bc => generated 1688 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:28:20.020454 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-ab0bcea6-bc61-4c95-83c2-929286cbe76e req-fac937b1-d162-47d2-b741-7851a4677b3b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6fb6a98-0120-4ed4-a763-951c74a1e5bc", "tag": "73b3b80a-1887-4868-9e74-19b14e43d2d3"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 23:28:20.030614 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-ab0bcea6-bc61-4c95-83c2-929286cbe76e req-fac937b1-d162-47d2-b741-7851a4677b3b service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:28:20.031123 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-ab0bcea6-bc61-4c95-83c2-929286cbe76e req-fac937b1-d162-47d2-b741-7851a4677b3b service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:28:20.031576 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-ab0bcea6-bc61-4c95-83c2-929286cbe76e req-fac937b1-d162-47d2-b741-7851a4677b3b service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:28:20.047231 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-ab0bcea6-bc61-4c95-83c2-929286cbe76e req-fac937b1-d162-47d2-b741-7851a4677b3b service nova] Creating event network-changed:73b3b80a-1887-4868-9e74-19b14e43d2d3 for instance f6fb6a98-0120-4ed4-a763-951c74a1e5bc on n-h2-860284-1 Oct 04 23:28:20.052387 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-ab0bcea6-bc61-4c95-83c2-929286cbe76e req-fac937b1-d162-47d2-b741-7851a4677b3b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091824 Oct 04 23:28:20.053012 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4426/8031] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 23:28:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 23:28:20.653065 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-cad49949-b8c6-46ad-8869-006d7921ae45 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:28:20.653797 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-cad49949-b8c6-46ad-8869-006d7921ae45 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] [instance: f6fb6a98-0120-4ed4-a763-951c74a1e5bc] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:28:20.660578 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cad49949-b8c6-46ad-8869-006d7921ae45 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:28:20.661071 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cad49949-b8c6-46ad-8869-006d7921ae45 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:28:20.661516 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cad49949-b8c6-46ad-8869-006d7921ae45 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:28:20.662219 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cad49949-b8c6-46ad-8869-006d7921ae45 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:28:20.662706 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cad49949-b8c6-46ad-8869-006d7921ae45 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:28:20.663134 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-cad49949-b8c6-46ad-8869-006d7921ae45 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:28:20.800954 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-cad49949-b8c6-46ad-8869-006d7921ae45 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841e202efcb143cf93d6d9bb1f3edba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979814de519c46d08cd2301bf5d33eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:28:20.808714 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-cad49949-b8c6-46ad-8869-006d7921ae45 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] 10.222.0.43 "GET /compute/v2.1/servers/f6fb6a98-0120-4ed4-a763-951c74a1e5bc" status: 200 len: 1688 microversion: 2.1 time: 0.159577 Oct 04 23:28:20.810016 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3606/8032] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:28:20 2022] GET /compute/v2.1/servers/f6fb6a98-0120-4ed4-a763-951c74a1e5bc => generated 1688 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:28:21.835116 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-f5ec525d-9bc3-4c57-a2c1-d733a6bbdf2f tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:28:21.835987 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-f5ec525d-9bc3-4c57-a2c1-d733a6bbdf2f tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] [instance: f6fb6a98-0120-4ed4-a763-951c74a1e5bc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:28:21.843187 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f5ec525d-9bc3-4c57-a2c1-d733a6bbdf2f tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:28:21.844033 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f5ec525d-9bc3-4c57-a2c1-d733a6bbdf2f tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:28:21.844491 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f5ec525d-9bc3-4c57-a2c1-d733a6bbdf2f tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:28:21.845650 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f5ec525d-9bc3-4c57-a2c1-d733a6bbdf2f tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:28:21.846422 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f5ec525d-9bc3-4c57-a2c1-d733a6bbdf2f tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:28:21.847134 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f5ec525d-9bc3-4c57-a2c1-d733a6bbdf2f tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:28:21.990388 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-f5ec525d-9bc3-4c57-a2c1-d733a6bbdf2f tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841e202efcb143cf93d6d9bb1f3edba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979814de519c46d08cd2301bf5d33eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:28:22.000354 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-f5ec525d-9bc3-4c57-a2c1-d733a6bbdf2f tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] 10.222.0.43 "GET /compute/v2.1/servers/f6fb6a98-0120-4ed4-a763-951c74a1e5bc" status: 200 len: 1688 microversion: 2.1 time: 0.170397 Oct 04 23:28:22.000923 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4427/8033] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:28:21 2022] GET /compute/v2.1/servers/f6fb6a98-0120-4ed4-a763-951c74a1e5bc => generated 1688 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:28:23.024481 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-b90231c5-08bc-4576-9545-7eb386b88fe1 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:28:23.025091 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-b90231c5-08bc-4576-9545-7eb386b88fe1 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] [instance: f6fb6a98-0120-4ed4-a763-951c74a1e5bc] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:28:23.033069 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b90231c5-08bc-4576-9545-7eb386b88fe1 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:28:23.033540 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b90231c5-08bc-4576-9545-7eb386b88fe1 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:28:23.033980 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b90231c5-08bc-4576-9545-7eb386b88fe1 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:28:23.034710 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b90231c5-08bc-4576-9545-7eb386b88fe1 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:28:23.035173 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b90231c5-08bc-4576-9545-7eb386b88fe1 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:28:23.035607 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b90231c5-08bc-4576-9545-7eb386b88fe1 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:28:23.179578 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-b90231c5-08bc-4576-9545-7eb386b88fe1 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841e202efcb143cf93d6d9bb1f3edba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979814de519c46d08cd2301bf5d33eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:28:23.187833 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-b90231c5-08bc-4576-9545-7eb386b88fe1 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] 10.222.0.43 "GET /compute/v2.1/servers/f6fb6a98-0120-4ed4-a763-951c74a1e5bc" status: 200 len: 1688 microversion: 2.1 time: 0.167349 Oct 04 23:28:23.188617 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3607/8034] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:28:23 2022] GET /compute/v2.1/servers/f6fb6a98-0120-4ed4-a763-951c74a1e5bc => generated 1688 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:28:24.212654 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-5531a482-96f1-448e-b209-25e4cd7a3686 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:28:24.213479 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-5531a482-96f1-448e-b209-25e4cd7a3686 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] [instance: f6fb6a98-0120-4ed4-a763-951c74a1e5bc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:28:24.221331 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5531a482-96f1-448e-b209-25e4cd7a3686 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:28:24.221848 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5531a482-96f1-448e-b209-25e4cd7a3686 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:28:24.222314 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5531a482-96f1-448e-b209-25e4cd7a3686 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:28:24.223072 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5531a482-96f1-448e-b209-25e4cd7a3686 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:28:24.223550 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5531a482-96f1-448e-b209-25e4cd7a3686 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:28:24.224002 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5531a482-96f1-448e-b209-25e4cd7a3686 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:28:24.378867 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-5531a482-96f1-448e-b209-25e4cd7a3686 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841e202efcb143cf93d6d9bb1f3edba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979814de519c46d08cd2301bf5d33eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:28:24.388469 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-5531a482-96f1-448e-b209-25e4cd7a3686 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] 10.222.0.43 "GET /compute/v2.1/servers/f6fb6a98-0120-4ed4-a763-951c74a1e5bc" status: 200 len: 1688 microversion: 2.1 time: 0.179379 Oct 04 23:28:24.393806 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4428/8035] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:28:24 2022] GET /compute/v2.1/servers/f6fb6a98-0120-4ed4-a763-951c74a1e5bc => generated 1688 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:28:25.412806 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-c0f73d78-32fa-4a75-be37-9cede6d24a5c tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:28:25.413389 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-c0f73d78-32fa-4a75-be37-9cede6d24a5c tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] [instance: f6fb6a98-0120-4ed4-a763-951c74a1e5bc] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:28:25.421323 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c0f73d78-32fa-4a75-be37-9cede6d24a5c tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:28:25.421824 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c0f73d78-32fa-4a75-be37-9cede6d24a5c tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:28:25.422309 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c0f73d78-32fa-4a75-be37-9cede6d24a5c tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:28:25.423086 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c0f73d78-32fa-4a75-be37-9cede6d24a5c tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:28:25.423549 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c0f73d78-32fa-4a75-be37-9cede6d24a5c tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:28:25.424011 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c0f73d78-32fa-4a75-be37-9cede6d24a5c tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:28:25.574996 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-c0f73d78-32fa-4a75-be37-9cede6d24a5c tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841e202efcb143cf93d6d9bb1f3edba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979814de519c46d08cd2301bf5d33eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:28:25.583711 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-c0f73d78-32fa-4a75-be37-9cede6d24a5c tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] 10.222.0.43 "GET /compute/v2.1/servers/f6fb6a98-0120-4ed4-a763-951c74a1e5bc" status: 200 len: 1688 microversion: 2.1 time: 0.174875 Oct 04 23:28:25.584303 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3608/8036] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:28:25 2022] GET /compute/v2.1/servers/f6fb6a98-0120-4ed4-a763-951c74a1e5bc => generated 1688 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:28:26.610009 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-fd8ee32f-b37b-4886-9f88-275a00c653e7 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:28:26.611514 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-fd8ee32f-b37b-4886-9f88-275a00c653e7 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] [instance: f6fb6a98-0120-4ed4-a763-951c74a1e5bc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:28:26.618858 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fd8ee32f-b37b-4886-9f88-275a00c653e7 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:28:26.619354 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fd8ee32f-b37b-4886-9f88-275a00c653e7 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:28:26.619812 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fd8ee32f-b37b-4886-9f88-275a00c653e7 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:28:26.620526 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fd8ee32f-b37b-4886-9f88-275a00c653e7 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:28:26.621001 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fd8ee32f-b37b-4886-9f88-275a00c653e7 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:28:26.621645 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fd8ee32f-b37b-4886-9f88-275a00c653e7 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:28:26.765035 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-fd8ee32f-b37b-4886-9f88-275a00c653e7 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841e202efcb143cf93d6d9bb1f3edba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979814de519c46d08cd2301bf5d33eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:28:26.773187 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-fd8ee32f-b37b-4886-9f88-275a00c653e7 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] 10.222.0.43 "GET /compute/v2.1/servers/f6fb6a98-0120-4ed4-a763-951c74a1e5bc" status: 200 len: 1688 microversion: 2.1 time: 0.167675 Oct 04 23:28:26.774020 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4429/8037] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:28:26 2022] GET /compute/v2.1/servers/f6fb6a98-0120-4ed4-a763-951c74a1e5bc => generated 1688 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:28:27.798970 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-3811e51b-6728-4ee2-956d-d2e45d321a86 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:28:27.799657 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-3811e51b-6728-4ee2-956d-d2e45d321a86 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] [instance: f6fb6a98-0120-4ed4-a763-951c74a1e5bc] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:28:27.806742 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3811e51b-6728-4ee2-956d-d2e45d321a86 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:28:27.807229 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3811e51b-6728-4ee2-956d-d2e45d321a86 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:28:27.807664 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3811e51b-6728-4ee2-956d-d2e45d321a86 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:28:27.808372 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3811e51b-6728-4ee2-956d-d2e45d321a86 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:28:27.809404 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3811e51b-6728-4ee2-956d-d2e45d321a86 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:28:27.809834 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3811e51b-6728-4ee2-956d-d2e45d321a86 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:28:27.951305 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-3811e51b-6728-4ee2-956d-d2e45d321a86 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841e202efcb143cf93d6d9bb1f3edba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979814de519c46d08cd2301bf5d33eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:28:27.959860 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-3811e51b-6728-4ee2-956d-d2e45d321a86 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] 10.222.0.43 "GET /compute/v2.1/servers/f6fb6a98-0120-4ed4-a763-951c74a1e5bc" status: 200 len: 1688 microversion: 2.1 time: 0.164744 Oct 04 23:28:27.961057 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3609/8038] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:28:27 2022] GET /compute/v2.1/servers/f6fb6a98-0120-4ed4-a763-951c74a1e5bc => generated 1688 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:28:28.984158 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-9c519d77-897a-41cc-9423-0ba7d6a010d7 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:28:28.984819 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-9c519d77-897a-41cc-9423-0ba7d6a010d7 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] [instance: f6fb6a98-0120-4ed4-a763-951c74a1e5bc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:28:28.993263 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9c519d77-897a-41cc-9423-0ba7d6a010d7 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:28:28.993892 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9c519d77-897a-41cc-9423-0ba7d6a010d7 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:28:28.994309 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9c519d77-897a-41cc-9423-0ba7d6a010d7 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:28:28.995138 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9c519d77-897a-41cc-9423-0ba7d6a010d7 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:28:28.995642 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9c519d77-897a-41cc-9423-0ba7d6a010d7 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:28:28.996105 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9c519d77-897a-41cc-9423-0ba7d6a010d7 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:28:29.162896 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-9c519d77-897a-41cc-9423-0ba7d6a010d7 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841e202efcb143cf93d6d9bb1f3edba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979814de519c46d08cd2301bf5d33eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:28:29.171576 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-9c519d77-897a-41cc-9423-0ba7d6a010d7 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] 10.222.0.43 "GET /compute/v2.1/servers/f6fb6a98-0120-4ed4-a763-951c74a1e5bc" status: 200 len: 1688 microversion: 2.1 time: 0.191196 Oct 04 23:28:29.186404 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4430/8039] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:28:28 2022] GET /compute/v2.1/servers/f6fb6a98-0120-4ed4-a763-951c74a1e5bc => generated 1688 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:28:30.196297 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-3312cd59-1be2-4099-ab63-f3e43ba6e5a3 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:28:30.196971 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-3312cd59-1be2-4099-ab63-f3e43ba6e5a3 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] [instance: f6fb6a98-0120-4ed4-a763-951c74a1e5bc] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:28:30.204516 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3312cd59-1be2-4099-ab63-f3e43ba6e5a3 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:28:30.205006 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3312cd59-1be2-4099-ab63-f3e43ba6e5a3 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:28:30.205450 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3312cd59-1be2-4099-ab63-f3e43ba6e5a3 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:28:30.206160 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3312cd59-1be2-4099-ab63-f3e43ba6e5a3 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:28:30.206650 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3312cd59-1be2-4099-ab63-f3e43ba6e5a3 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:28:30.207081 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3312cd59-1be2-4099-ab63-f3e43ba6e5a3 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:28:30.343121 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-3312cd59-1be2-4099-ab63-f3e43ba6e5a3 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841e202efcb143cf93d6d9bb1f3edba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979814de519c46d08cd2301bf5d33eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:28:30.350957 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-3312cd59-1be2-4099-ab63-f3e43ba6e5a3 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] 10.222.0.43 "GET /compute/v2.1/servers/f6fb6a98-0120-4ed4-a763-951c74a1e5bc" status: 200 len: 1688 microversion: 2.1 time: 0.158634 Oct 04 23:28:30.351552 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3610/8040] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:28:30 2022] GET /compute/v2.1/servers/f6fb6a98-0120-4ed4-a763-951c74a1e5bc => generated 1688 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:28:31.374647 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-c3c5016e-d2c0-44aa-859c-a3e1ad23971e tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:28:31.375306 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-c3c5016e-d2c0-44aa-859c-a3e1ad23971e tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] [instance: f6fb6a98-0120-4ed4-a763-951c74a1e5bc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:28:31.382170 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c3c5016e-d2c0-44aa-859c-a3e1ad23971e tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:28:31.382737 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c3c5016e-d2c0-44aa-859c-a3e1ad23971e tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:28:31.383198 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c3c5016e-d2c0-44aa-859c-a3e1ad23971e tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:28:31.383916 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c3c5016e-d2c0-44aa-859c-a3e1ad23971e tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:28:31.384444 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c3c5016e-d2c0-44aa-859c-a3e1ad23971e tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:28:31.384844 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c3c5016e-d2c0-44aa-859c-a3e1ad23971e tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:28:31.521661 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-c3c5016e-d2c0-44aa-859c-a3e1ad23971e tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841e202efcb143cf93d6d9bb1f3edba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979814de519c46d08cd2301bf5d33eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:28:31.530236 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-c3c5016e-d2c0-44aa-859c-a3e1ad23971e tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] 10.222.0.43 "GET /compute/v2.1/servers/f6fb6a98-0120-4ed4-a763-951c74a1e5bc" status: 200 len: 1688 microversion: 2.1 time: 0.159828 Oct 04 23:28:31.530898 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4431/8041] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:28:31 2022] GET /compute/v2.1/servers/f6fb6a98-0120-4ed4-a763-951c74a1e5bc => generated 1688 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:28:32.553111 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-7c0e639b-80ba-412d-9e03-04c23e348502 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:28:32.553800 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-7c0e639b-80ba-412d-9e03-04c23e348502 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] [instance: f6fb6a98-0120-4ed4-a763-951c74a1e5bc] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:28:32.561453 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7c0e639b-80ba-412d-9e03-04c23e348502 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:28:32.561943 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7c0e639b-80ba-412d-9e03-04c23e348502 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:28:32.562412 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7c0e639b-80ba-412d-9e03-04c23e348502 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:28:32.563124 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7c0e639b-80ba-412d-9e03-04c23e348502 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:28:32.563586 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7c0e639b-80ba-412d-9e03-04c23e348502 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:28:32.564016 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7c0e639b-80ba-412d-9e03-04c23e348502 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:28:32.698357 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-7c0e639b-80ba-412d-9e03-04c23e348502 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841e202efcb143cf93d6d9bb1f3edba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979814de519c46d08cd2301bf5d33eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:28:32.706620 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-7c0e639b-80ba-412d-9e03-04c23e348502 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] 10.222.0.43 "GET /compute/v2.1/servers/f6fb6a98-0120-4ed4-a763-951c74a1e5bc" status: 200 len: 1688 microversion: 2.1 time: 0.157408 Oct 04 23:28:32.707207 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3611/8042] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:28:32 2022] GET /compute/v2.1/servers/f6fb6a98-0120-4ed4-a763-951c74a1e5bc => generated 1688 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:28:33.731518 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-9aeb91e8-1d8a-4d7a-91bd-a0b56f99a07a tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:28:33.733095 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-9aeb91e8-1d8a-4d7a-91bd-a0b56f99a07a tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] [instance: f6fb6a98-0120-4ed4-a763-951c74a1e5bc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:28:33.739023 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9aeb91e8-1d8a-4d7a-91bd-a0b56f99a07a tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:28:33.739508 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9aeb91e8-1d8a-4d7a-91bd-a0b56f99a07a tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:28:33.739962 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9aeb91e8-1d8a-4d7a-91bd-a0b56f99a07a tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:28:33.740675 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9aeb91e8-1d8a-4d7a-91bd-a0b56f99a07a tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:28:33.741143 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9aeb91e8-1d8a-4d7a-91bd-a0b56f99a07a tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:28:33.741619 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9aeb91e8-1d8a-4d7a-91bd-a0b56f99a07a tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:28:33.882008 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-9aeb91e8-1d8a-4d7a-91bd-a0b56f99a07a tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841e202efcb143cf93d6d9bb1f3edba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979814de519c46d08cd2301bf5d33eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:28:33.890387 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-9aeb91e8-1d8a-4d7a-91bd-a0b56f99a07a tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] 10.222.0.43 "GET /compute/v2.1/servers/f6fb6a98-0120-4ed4-a763-951c74a1e5bc" status: 200 len: 1688 microversion: 2.1 time: 0.163954 Oct 04 23:28:33.891032 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4432/8043] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:28:33 2022] GET /compute/v2.1/servers/f6fb6a98-0120-4ed4-a763-951c74a1e5bc => generated 1688 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:28:34.914649 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-67fb6bf8-657e-40f3-a3f5-58b6b3a3df84 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:28:34.915261 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-67fb6bf8-657e-40f3-a3f5-58b6b3a3df84 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] [instance: f6fb6a98-0120-4ed4-a763-951c74a1e5bc] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:28:34.922536 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-67fb6bf8-657e-40f3-a3f5-58b6b3a3df84 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:28:34.923075 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-67fb6bf8-657e-40f3-a3f5-58b6b3a3df84 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:28:34.923502 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-67fb6bf8-657e-40f3-a3f5-58b6b3a3df84 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:28:34.924197 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-67fb6bf8-657e-40f3-a3f5-58b6b3a3df84 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:28:34.924660 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-67fb6bf8-657e-40f3-a3f5-58b6b3a3df84 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:28:34.925089 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-67fb6bf8-657e-40f3-a3f5-58b6b3a3df84 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:28:35.057630 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-67fb6bf8-657e-40f3-a3f5-58b6b3a3df84 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841e202efcb143cf93d6d9bb1f3edba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979814de519c46d08cd2301bf5d33eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:28:35.065892 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-67fb6bf8-657e-40f3-a3f5-58b6b3a3df84 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] 10.222.0.43 "GET /compute/v2.1/servers/f6fb6a98-0120-4ed4-a763-951c74a1e5bc" status: 200 len: 1688 microversion: 2.1 time: 0.155299 Oct 04 23:28:35.066490 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3612/8044] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:28:34 2022] GET /compute/v2.1/servers/f6fb6a98-0120-4ed4-a763-951c74a1e5bc => generated 1688 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:28:36.089622 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-87a4ac50-7bec-4b00-9c5e-9ad810649a22 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:28:36.090903 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-87a4ac50-7bec-4b00-9c5e-9ad810649a22 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] [instance: f6fb6a98-0120-4ed4-a763-951c74a1e5bc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:28:36.097938 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-87a4ac50-7bec-4b00-9c5e-9ad810649a22 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:28:36.098521 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-87a4ac50-7bec-4b00-9c5e-9ad810649a22 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:28:36.098998 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-87a4ac50-7bec-4b00-9c5e-9ad810649a22 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:28:36.099725 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-87a4ac50-7bec-4b00-9c5e-9ad810649a22 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:28:36.100202 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-87a4ac50-7bec-4b00-9c5e-9ad810649a22 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:28:36.100654 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-87a4ac50-7bec-4b00-9c5e-9ad810649a22 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:28:36.241222 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-87a4ac50-7bec-4b00-9c5e-9ad810649a22 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841e202efcb143cf93d6d9bb1f3edba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979814de519c46d08cd2301bf5d33eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:28:36.249557 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-87a4ac50-7bec-4b00-9c5e-9ad810649a22 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] 10.222.0.43 "GET /compute/v2.1/servers/f6fb6a98-0120-4ed4-a763-951c74a1e5bc" status: 200 len: 1688 microversion: 2.1 time: 0.164188 Oct 04 23:28:36.250146 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4433/8045] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:28:36 2022] GET /compute/v2.1/servers/f6fb6a98-0120-4ed4-a763-951c74a1e5bc => generated 1688 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:28:37.273733 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-ac7c6fcb-95ac-4eb7-bc17-eded0e228639 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:28:37.274412 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-ac7c6fcb-95ac-4eb7-bc17-eded0e228639 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] [instance: f6fb6a98-0120-4ed4-a763-951c74a1e5bc] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:28:37.281588 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ac7c6fcb-95ac-4eb7-bc17-eded0e228639 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:28:37.282073 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ac7c6fcb-95ac-4eb7-bc17-eded0e228639 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:28:37.282549 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ac7c6fcb-95ac-4eb7-bc17-eded0e228639 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:28:37.283241 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ac7c6fcb-95ac-4eb7-bc17-eded0e228639 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:28:37.283699 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ac7c6fcb-95ac-4eb7-bc17-eded0e228639 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:28:37.284152 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ac7c6fcb-95ac-4eb7-bc17-eded0e228639 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:28:37.422890 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-ac7c6fcb-95ac-4eb7-bc17-eded0e228639 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841e202efcb143cf93d6d9bb1f3edba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979814de519c46d08cd2301bf5d33eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:28:37.430658 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-ac7c6fcb-95ac-4eb7-bc17-eded0e228639 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] 10.222.0.43 "GET /compute/v2.1/servers/f6fb6a98-0120-4ed4-a763-951c74a1e5bc" status: 200 len: 1688 microversion: 2.1 time: 0.160802 Oct 04 23:28:37.431251 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3613/8046] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:28:37 2022] GET /compute/v2.1/servers/f6fb6a98-0120-4ed4-a763-951c74a1e5bc => generated 1688 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:28:37.506085 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-f43adf3c-8c4b-42be-a1d2-25beaf6a8294 req-1fe1aa23-d1a5-4467-a57f-f46763ebd663 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6fb6a98-0120-4ed4-a763-951c74a1e5bc", "name": "network-vif-plugged", "status": "completed", "tag": "73b3b80a-1887-4868-9e74-19b14e43d2d3"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 23:28:37.518304 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-f43adf3c-8c4b-42be-a1d2-25beaf6a8294 req-1fe1aa23-d1a5-4467-a57f-f46763ebd663 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:28:37.518840 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-f43adf3c-8c4b-42be-a1d2-25beaf6a8294 req-1fe1aa23-d1a5-4467-a57f-f46763ebd663 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:28:37.519303 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-f43adf3c-8c4b-42be-a1d2-25beaf6a8294 req-1fe1aa23-d1a5-4467-a57f-f46763ebd663 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:28:37.530954 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-f43adf3c-8c4b-42be-a1d2-25beaf6a8294 req-1fe1aa23-d1a5-4467-a57f-f46763ebd663 service nova] Creating event network-vif-plugged:73b3b80a-1887-4868-9e74-19b14e43d2d3 for instance f6fb6a98-0120-4ed4-a763-951c74a1e5bc on n-h2-860284-1 Oct 04 23:28:37.536194 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-f43adf3c-8c4b-42be-a1d2-25beaf6a8294 req-1fe1aa23-d1a5-4467-a57f-f46763ebd663 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033912 Oct 04 23:28:37.536803 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4434/8047] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 23:28:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 23:28:38.455603 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-ae5eef22-abdf-4334-b637-54c3ce58317e tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:28:38.456218 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-ae5eef22-abdf-4334-b637-54c3ce58317e tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] [instance: f6fb6a98-0120-4ed4-a763-951c74a1e5bc] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:28:38.463584 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ae5eef22-abdf-4334-b637-54c3ce58317e tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:28:38.464077 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ae5eef22-abdf-4334-b637-54c3ce58317e tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:28:38.464523 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ae5eef22-abdf-4334-b637-54c3ce58317e tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:28:38.465974 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ae5eef22-abdf-4334-b637-54c3ce58317e tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:28:38.466524 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ae5eef22-abdf-4334-b637-54c3ce58317e tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:28:38.466965 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ae5eef22-abdf-4334-b637-54c3ce58317e tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:28:38.603199 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-ae5eef22-abdf-4334-b637-54c3ce58317e tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841e202efcb143cf93d6d9bb1f3edba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979814de519c46d08cd2301bf5d33eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:28:38.611007 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-ae5eef22-abdf-4334-b637-54c3ce58317e tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] 10.222.0.43 "GET /compute/v2.1/servers/f6fb6a98-0120-4ed4-a763-951c74a1e5bc" status: 200 len: 1688 microversion: 2.1 time: 0.159520 Oct 04 23:28:38.611583 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3614/8048] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:28:38 2022] GET /compute/v2.1/servers/f6fb6a98-0120-4ed4-a763-951c74a1e5bc => generated 1688 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:28:39.635083 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-70f5c414-74ca-46ad-a948-f8b9350c774e tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:28:39.635852 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-70f5c414-74ca-46ad-a948-f8b9350c774e tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] [instance: f6fb6a98-0120-4ed4-a763-951c74a1e5bc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:28:39.643142 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-70f5c414-74ca-46ad-a948-f8b9350c774e tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:28:39.643640 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-70f5c414-74ca-46ad-a948-f8b9350c774e tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:28:39.644091 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-70f5c414-74ca-46ad-a948-f8b9350c774e tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:28:39.644796 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-70f5c414-74ca-46ad-a948-f8b9350c774e tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:28:39.645262 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-70f5c414-74ca-46ad-a948-f8b9350c774e tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:28:39.645698 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-70f5c414-74ca-46ad-a948-f8b9350c774e tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:28:39.867049 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-70f5c414-74ca-46ad-a948-f8b9350c774e tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841e202efcb143cf93d6d9bb1f3edba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979814de519c46d08cd2301bf5d33eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:28:39.875001 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-70f5c414-74ca-46ad-a948-f8b9350c774e tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] 10.222.0.43 "GET /compute/v2.1/servers/f6fb6a98-0120-4ed4-a763-951c74a1e5bc" status: 200 len: 1688 microversion: 2.1 time: 0.244217 Oct 04 23:28:39.875693 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4435/8049] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:28:39 2022] GET /compute/v2.1/servers/f6fb6a98-0120-4ed4-a763-951c74a1e5bc => generated 1688 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:28:40.898705 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-c3ca68ab-0503-4fda-90af-398a80369f49 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:28:40.899381 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-c3ca68ab-0503-4fda-90af-398a80369f49 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] [instance: f6fb6a98-0120-4ed4-a763-951c74a1e5bc] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:28:40.906998 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c3ca68ab-0503-4fda-90af-398a80369f49 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:28:40.907474 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c3ca68ab-0503-4fda-90af-398a80369f49 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:28:40.907915 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c3ca68ab-0503-4fda-90af-398a80369f49 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:28:40.908613 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c3ca68ab-0503-4fda-90af-398a80369f49 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:28:40.909073 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c3ca68ab-0503-4fda-90af-398a80369f49 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:28:40.909501 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c3ca68ab-0503-4fda-90af-398a80369f49 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:28:41.044027 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-c3ca68ab-0503-4fda-90af-398a80369f49 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841e202efcb143cf93d6d9bb1f3edba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979814de519c46d08cd2301bf5d33eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:28:41.052673 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-c3ca68ab-0503-4fda-90af-398a80369f49 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] 10.222.0.43 "GET /compute/v2.1/servers/f6fb6a98-0120-4ed4-a763-951c74a1e5bc" status: 200 len: 1675 microversion: 2.1 time: 0.157996 Oct 04 23:28:41.053264 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3615/8050] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:28:40 2022] GET /compute/v2.1/servers/f6fb6a98-0120-4ed4-a763-951c74a1e5bc => generated 1675 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:30:29.587122 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=1 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:30:29.588664 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:30:29.593966 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_api:SELECT=27 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:30:29.594800 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=79 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:30:29.595582 n-d-860284-1 devstack@n-api.service[134102]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 23:30:29.595724 n-d-860284-1 devstack@n-api.service[134102]: Tue Oct 4 23:30:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.43) !!! Oct 04 23:30:29.595824 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-375ead77-aff3-431b-ac59-7ca9e1a12211 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:30:29.599638 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-375ead77-aff3-431b-ac59-7ca9e1a12211 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] [instance: f6fb6a98-0120-4ed4-a763-951c74a1e5bc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:30:29.611877 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-375ead77-aff3-431b-ac59-7ca9e1a12211 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:30:29.612395 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-375ead77-aff3-431b-ac59-7ca9e1a12211 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:30:29.612861 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-375ead77-aff3-431b-ac59-7ca9e1a12211 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:30:29.613617 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-375ead77-aff3-431b-ac59-7ca9e1a12211 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:30:29.614095 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-375ead77-aff3-431b-ac59-7ca9e1a12211 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:30:29.614588 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-375ead77-aff3-431b-ac59-7ca9e1a12211 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:30:29.641692 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-375ead77-aff3-431b-ac59-7ca9e1a12211 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] [instance: f6fb6a98-0120-4ed4-a763-951c74a1e5bc] Going to try to terminate instance {{(pid=134101) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 23:30:29.668741 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-d2c1d196-d963-45f9-8c72-37ed5f5a3a84 req-457dc3db-240c-4f6c-af28-40e6ee90b014 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6fb6a98-0120-4ed4-a763-951c74a1e5bc", "tag": "73b3b80a-1887-4868-9e74-19b14e43d2d3"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 23:30:29.678726 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-d2c1d196-d963-45f9-8c72-37ed5f5a3a84 req-457dc3db-240c-4f6c-af28-40e6ee90b014 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:30:29.679484 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-d2c1d196-d963-45f9-8c72-37ed5f5a3a84 req-457dc3db-240c-4f6c-af28-40e6ee90b014 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:30:29.679696 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-d2c1d196-d963-45f9-8c72-37ed5f5a3a84 req-457dc3db-240c-4f6c-af28-40e6ee90b014 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:30:29.691632 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-d2c1d196-d963-45f9-8c72-37ed5f5a3a84 req-457dc3db-240c-4f6c-af28-40e6ee90b014 service nova] Creating event network-changed:73b3b80a-1887-4868-9e74-19b14e43d2d3 for instance f6fb6a98-0120-4ed4-a763-951c74a1e5bc on n-h2-860284-1 Oct 04 23:30:29.698576 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-d2c1d196-d963-45f9-8c72-37ed5f5a3a84 req-457dc3db-240c-4f6c-af28-40e6ee90b014 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111784 Oct 04 23:30:29.699326 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3616/8051] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 23:30:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 23:30:29.726084 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-375ead77-aff3-431b-ac59-7ca9e1a12211 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] 10.222.0.43 "DELETE /compute/v2.1/servers/f6fb6a98-0120-4ed4-a763-951c74a1e5bc" status: 204 len: 0 microversion: 2.1 time: 0.141360 Oct 04 23:30:29.727183 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4436/8052] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 23:30:29 2022] DELETE /compute/v2.1/servers/f6fb6a98-0120-4ed4-a763-951c74a1e5bc => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 23:30:29.736893 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-2bc767db-d375-4e7d-af7e-8f6746cb81ba tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:30:29.737224 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-2bc767db-d375-4e7d-af7e-8f6746cb81ba tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] [instance: f6fb6a98-0120-4ed4-a763-951c74a1e5bc] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:30:29.743556 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2bc767db-d375-4e7d-af7e-8f6746cb81ba tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:30:29.744050 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2bc767db-d375-4e7d-af7e-8f6746cb81ba tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:30:29.744482 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2bc767db-d375-4e7d-af7e-8f6746cb81ba tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:30:29.745191 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2bc767db-d375-4e7d-af7e-8f6746cb81ba tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:30:29.745646 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2bc767db-d375-4e7d-af7e-8f6746cb81ba tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:30:29.746071 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-2bc767db-d375-4e7d-af7e-8f6746cb81ba tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:30:29.928374 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-2bc767db-d375-4e7d-af7e-8f6746cb81ba tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841e202efcb143cf93d6d9bb1f3edba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979814de519c46d08cd2301bf5d33eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:30:29.936840 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-2bc767db-d375-4e7d-af7e-8f6746cb81ba tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] 10.222.0.43 "GET /compute/v2.1/servers/f6fb6a98-0120-4ed4-a763-951c74a1e5bc" status: 200 len: 1681 microversion: 2.1 time: 0.205107 Oct 04 23:30:29.937442 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3617/8053] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:30:29 2022] GET /compute/v2.1/servers/f6fb6a98-0120-4ed4-a763-951c74a1e5bc => generated 1681 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:30:30.961784 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-6bc8b738-0daa-41af-8a19-9bcde82151dc tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:30:30.962570 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-6bc8b738-0daa-41af-8a19-9bcde82151dc tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] [instance: f6fb6a98-0120-4ed4-a763-951c74a1e5bc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:30:30.970477 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6bc8b738-0daa-41af-8a19-9bcde82151dc tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:30:30.971029 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6bc8b738-0daa-41af-8a19-9bcde82151dc tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:30:30.971489 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6bc8b738-0daa-41af-8a19-9bcde82151dc tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:30:30.972271 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6bc8b738-0daa-41af-8a19-9bcde82151dc tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:30:30.972783 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6bc8b738-0daa-41af-8a19-9bcde82151dc tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:30:30.973233 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6bc8b738-0daa-41af-8a19-9bcde82151dc tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:30:31.194544 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-6bc8b738-0daa-41af-8a19-9bcde82151dc tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841e202efcb143cf93d6d9bb1f3edba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979814de519c46d08cd2301bf5d33eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:30:31.203100 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-6bc8b738-0daa-41af-8a19-9bcde82151dc tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] 10.222.0.43 "GET /compute/v2.1/servers/f6fb6a98-0120-4ed4-a763-951c74a1e5bc" status: 200 len: 1681 microversion: 2.1 time: 0.245667 Oct 04 23:30:31.203676 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4437/8054] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:30:30 2022] GET /compute/v2.1/servers/f6fb6a98-0120-4ed4-a763-951c74a1e5bc => generated 1681 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:30:31.987113 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-5432ec4c-a649-4872-8939-c84d6dd53251 req-9b6ed0d7-dd50-4f9c-a928-eb5586e64a62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6fb6a98-0120-4ed4-a763-951c74a1e5bc", "name": "network-vif-deleted", "tag": "73b3b80a-1887-4868-9e74-19b14e43d2d3"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 23:30:31.996994 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-5432ec4c-a649-4872-8939-c84d6dd53251 req-9b6ed0d7-dd50-4f9c-a928-eb5586e64a62 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:30:31.998059 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-5432ec4c-a649-4872-8939-c84d6dd53251 req-9b6ed0d7-dd50-4f9c-a928-eb5586e64a62 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:30:31.998597 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-5432ec4c-a649-4872-8939-c84d6dd53251 req-9b6ed0d7-dd50-4f9c-a928-eb5586e64a62 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:30:32.010127 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-5432ec4c-a649-4872-8939-c84d6dd53251 req-9b6ed0d7-dd50-4f9c-a928-eb5586e64a62 service nova] Creating event network-vif-deleted:73b3b80a-1887-4868-9e74-19b14e43d2d3 for instance f6fb6a98-0120-4ed4-a763-951c74a1e5bc on n-h2-860284-1 Oct 04 23:30:32.015523 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-5432ec4c-a649-4872-8939-c84d6dd53251 req-9b6ed0d7-dd50-4f9c-a928-eb5586e64a62 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033831 Oct 04 23:30:32.016213 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3618/8055] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 23:30:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 23:30:32.228519 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-b63b7222-69f7-4bc9-913d-194ed512544f tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:30:32.229252 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-b63b7222-69f7-4bc9-913d-194ed512544f tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] [instance: f6fb6a98-0120-4ed4-a763-951c74a1e5bc] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:30:32.237047 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b63b7222-69f7-4bc9-913d-194ed512544f tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:30:32.237567 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b63b7222-69f7-4bc9-913d-194ed512544f tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:30:32.238026 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b63b7222-69f7-4bc9-913d-194ed512544f tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:30:32.238789 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b63b7222-69f7-4bc9-913d-194ed512544f tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:30:32.239274 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b63b7222-69f7-4bc9-913d-194ed512544f tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:30:32.239725 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b63b7222-69f7-4bc9-913d-194ed512544f tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:30:32.272828 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b63b7222-69f7-4bc9-913d-194ed512544f tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:30:32.273339 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b63b7222-69f7-4bc9-913d-194ed512544f tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:30:32.273801 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b63b7222-69f7-4bc9-913d-194ed512544f tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:30:32.274273 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.objects.instance [None req-b63b7222-69f7-4bc9-913d-194ed512544f tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lazy-loading 'fault' on Instance uuid f6fb6a98-0120-4ed4-a763-951c74a1e5bc {{(pid=134101) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 23:30:32.317979 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-b63b7222-69f7-4bc9-913d-194ed512544f tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841e202efcb143cf93d6d9bb1f3edba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979814de519c46d08cd2301bf5d33eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:30:32.326441 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-b63b7222-69f7-4bc9-913d-194ed512544f tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] 10.222.0.43 "GET /compute/v2.1/servers/f6fb6a98-0120-4ed4-a763-951c74a1e5bc" status: 200 len: 1337 microversion: 2.1 time: 0.102087 Oct 04 23:30:32.327046 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4438/8056] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:30:32 2022] GET /compute/v2.1/servers/f6fb6a98-0120-4ed4-a763-951c74a1e5bc => generated 1337 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:30:33.351029 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-ece4d581-6e0c-4673-ab63-89fc8cadf938 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:30:33.351981 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-ece4d581-6e0c-4673-ab63-89fc8cadf938 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] [instance: f6fb6a98-0120-4ed4-a763-951c74a1e5bc] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:30:33.358953 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ece4d581-6e0c-4673-ab63-89fc8cadf938 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:30:33.359433 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ece4d581-6e0c-4673-ab63-89fc8cadf938 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:30:33.359869 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ece4d581-6e0c-4673-ab63-89fc8cadf938 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:30:33.360553 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ece4d581-6e0c-4673-ab63-89fc8cadf938 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:30:33.361007 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ece4d581-6e0c-4673-ab63-89fc8cadf938 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:30:33.361431 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ece4d581-6e0c-4673-ab63-89fc8cadf938 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:30:33.374783 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-ece4d581-6e0c-4673-ab63-89fc8cadf938 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] HTTP exception thrown: Instance f6fb6a98-0120-4ed4-a763-951c74a1e5bc could not be found. Oct 04 23:30:33.376414 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-ece4d581-6e0c-4673-ab63-89fc8cadf938 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Request method failure captured: Oct 04 23:30:33.376414 n-d-860284-1 devstack@n-api.service[134102]: request: GET /compute/v2.1/servers/f6fb6a98-0120-4ed4-a763-951c74a1e5bc HTTP/1.1 Oct 04 23:30:33.376414 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 23:30:33.376414 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 23:30:33.376414 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 23:30:33.376414 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 23:30:33.376414 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 23:30:33.376414 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 23:30:33.376414 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 23:30:33.376414 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 23:30:33.376414 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPMC9Rei2sE5K1O5vICl-Bspm0-DRHURZojLcFXZ3m1nisETEfWE5GNdWn1-IVdJmWGQ2ULHAiuBkbHiKq9WriVXXV8gdEqF5l3kjlKdiFGPKVRsZCGioIHnbNGSL8ibbBaRU_fLr-Q764swQ_pSwSqL6XBc-vOfDAaf55ClRqlzDyVs Oct 04 23:30:33.376414 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 23:30:33.376414 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 23:30:33.376414 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 23:30:33.376414 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 23:30:33.376414 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 23:30:33.376414 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 23:30:33.376414 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: 979814de519c46d08cd2301bf5d33eac Oct 04 23:30:33.376414 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-TestShelveInstance-1707614860 Oct 04 23:30:33.376414 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 23:30:33.376414 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 23:30:33.376414 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/979814de519c46d08cd2301bf5d33eac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_979814de519c46d08cd2301bf5d33eac", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/979814de519c46d08cd2301bf5d33eac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/979814de519c46d08cd2301bf5d33eac"}]}] Oct 04 23:30:33.376414 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-TestShelveInstance-1707614860 Oct 04 23:30:33.376414 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: 979814de519c46d08cd2301bf5d33eac Oct 04 23:30:33.376414 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-TestShelveInstance-1707614860 Oct 04 23:30:33.376414 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-TestShelveInstance-1707614860-project Oct 04 23:30:33.376414 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 23:30:33.376414 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 23:30:33.376414 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: 841e202efcb143cf93d6d9bb1f3edba3 Oct 04 23:30:33.376414 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-TestShelveInstance-1707614860-project Oct 04 23:30:33.376414 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 23:30:33.376414 n-d-860284-1 devstack@n-api.service[134102]: exception: Instance f6fb6a98-0120-4ed4-a763-951c74a1e5bc could not be found. Oct 04 23:30:33.376414 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': 'f6fb6a98-0120-4ed4-a763-951c74a1e5bc'} Oct 04 23:30:33.376414 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 23:30:33.376414 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 23:30:33.376414 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 23:30:33.376414 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 23:30:33.376414 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 23:30:33.376414 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 23:30:33.376414 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 23:30:33.376414 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 23:30:33.376414 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 23:30:33.376414 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 23:30:33.376414 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6fb6a98-0120-4ed4-a763-951c74a1e5bc could not be found. Oct 04 23:30:33.376414 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 23:30:33.376414 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 23:30:33.376414 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 23:30:33.376414 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 23:30:33.376414 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 23:30:33.376414 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 23:30:33.376414 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 23:30:33.376414 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 23:30:33.376414 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 23:30:33.376414 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 23:30:33.376414 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 23:30:33.376414 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 23:30:33.376414 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 23:30:33.376414 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 23:30:33.376414 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 23:30:33.376414 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 23:30:33.376414 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6fb6a98-0120-4ed4-a763-951c74a1e5bc could not be found. Oct 04 23:30:33.376414 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 23:30:33.376414 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 23:30:33.376414 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 23:30:33.382508 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 23:30:33.382508 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 23:30:33.382508 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 23:30:33.382508 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 23:30:33.382508 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 23:30:33.382508 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6fb6a98-0120-4ed4-a763-951c74a1e5bc could not be found. Oct 04 23:30:33.382508 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 23:30:33.382508 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-ece4d581-6e0c-4673-ab63-89fc8cadf938 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Returning 404 to user: Instance f6fb6a98-0120-4ed4-a763-951c74a1e5bc could not be found. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 23:30:33.382508 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-ece4d581-6e0c-4673-ab63-89fc8cadf938 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] 10.222.0.43 "GET /compute/v2.1/servers/f6fb6a98-0120-4ed4-a763-951c74a1e5bc" status: 404 len: 111 microversion: 2.1 time: 0.031885 Oct 04 23:30:33.382508 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3619/8057] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:30:33 2022] GET /compute/v2.1/servers/f6fb6a98-0120-4ed4-a763-951c74a1e5bc => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 23:30:33.535929 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-3b6ebcec-3c88-4ff3-bca2-06761f12f3dd tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Calling method '.version_select at 0x7fbb2db14dc0>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:30:33.561702 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-3b6ebcec-3c88-4ff3-bca2-06761f12f3dd tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1248365448" status: 202 len: 0 microversion: 2.1 time: 0.029727 Oct 04 23:30:33.562623 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4439/8058] 10.222.0.43 () {58 vars in 1254 bytes} [Tue Oct 4 23:30:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1248365448 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 23:30:33.588318 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-674fcea7-edce-40cf-9d6a-db9c98fd2874 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Action: 'create', calling method: .version_select at 0x7fbb2f6bd670>, body: {"keypair": {"name": "tempest-TestShelveInstance-674050281", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMGpHGp3gPMdCDqEBPobjoXqbxtl5+RQxS81xuoHsFOc4vnyJQI5IlfA9DzbeJQNEHDVD2E7o1RsBSbxX6g+430nXvzJRSTGiHwb6Ck2cRks8AhH3aydFv7EYKJoOV4+Wg=="}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 23:30:33.604663 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-674fcea7-edce-40cf-9d6a-db9c98fd2874 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Getting quotas for project 979814de519c46d08cd2301bf5d33eac. Resources: {'key_pairs'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 23:30:33.610470 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-674fcea7-edce-40cf-9d6a-db9c98fd2874 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Getting quotas for user 841e202efcb143cf93d6d9bb1f3edba3 and project 979814de519c46d08cd2301bf5d33eac. Resources: {'key_pairs'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 23:30:33.635918 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-674fcea7-edce-40cf-9d6a-db9c98fd2874 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.051569 Oct 04 23:30:33.636529 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3620/8059] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Oct 4 23:30:33 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 23:30:49.830806 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:30:49.831644 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:30:49.839476 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-7aafefc7-a4c6-4251-a2f7-94e05ef25777 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-2057437548", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-674050281", "security_groups": [{"name": "tempest-secgroup-smoke-604364356"}], "networks": [{"uuid": "bf5db42b-8323-4711-a3cb-8f87e8038bbd"}], "block_device_mapping_v2": [{"uuid": "1eb838a6-3e1a-41a7-8103-6389e89b1a5b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 23:30:49.954495 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.network.neutron [None req-7aafefc7-a4c6-4251-a2f7-94e05ef25777 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] validate_networks() for [('bf5db42b-8323-4711-a3cb-8f87e8038bbd', None, None, None, None, None)] {{(pid=134101) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 23:30:50.329312 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-7aafefc7-a4c6-4251-a2f7-94e05ef25777 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Flavor limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 23:30:50.329745 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-7aafefc7-a4c6-4251-a2f7-94e05ef25777 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Image limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 23:30:50.330243 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-7aafefc7-a4c6-4251-a2f7-94e05ef25777 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Flavor pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 23:30:50.330713 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-7aafefc7-a4c6-4251-a2f7-94e05ef25777 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Image pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 23:30:50.331148 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-7aafefc7-a4c6-4251-a2f7-94e05ef25777 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 23:30:50.340257 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7aafefc7-a4c6-4251-a2f7-94e05ef25777 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:30:50.341387 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7aafefc7-a4c6-4251-a2f7-94e05ef25777 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:30:50.341851 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7aafefc7-a4c6-4251-a2f7-94e05ef25777 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:30:50.342638 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7aafefc7-a4c6-4251-a2f7-94e05ef25777 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:30:50.343124 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7aafefc7-a4c6-4251-a2f7-94e05ef25777 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:30:50.343571 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7aafefc7-a4c6-4251-a2f7-94e05ef25777 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:30:50.362053 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-7aafefc7-a4c6-4251-a2f7-94e05ef25777 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Getting quotas for project 979814de519c46d08cd2301bf5d33eac. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 23:30:50.367339 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-7aafefc7-a4c6-4251-a2f7-94e05ef25777 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Getting quotas for user 841e202efcb143cf93d6d9bb1f3edba3 and project 979814de519c46d08cd2301bf5d33eac. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 23:30:50.426752 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-7aafefc7-a4c6-4251-a2f7-94e05ef25777 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Going to run 1 instances... {{(pid=134101) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 23:30:50.428957 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-7aafefc7-a4c6-4251-a2f7-94e05ef25777 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] [instance: 7a3c06ab-77fb-4b24-8913-f5514e2598cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1eb838a6-3e1a-41a7-8103-6389e89b1a5b',volume_size=None,volume_type=None)] {{(pid=134101) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 23:30:50.557574 n-d-860284-1 devstack@n-api.service[134101]: ERROR oslo.messaging._drivers.impl_rabbit [None req-7aafefc7-a4c6-4251-a2f7-94e05ef25777 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] [a0705614-f64e-4f2c-9d91-c9cad833fc6d] AMQP server on 10.222.0.43:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 23:30:51.565028 n-d-860284-1 devstack@n-api.service[134101]: INFO oslo.messaging._drivers.impl_rabbit [None req-7aafefc7-a4c6-4251-a2f7-94e05ef25777 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] [a0705614-f64e-4f2c-9d91-c9cad833fc6d] Reconnected to AMQP server on 10.222.0.43:5672 via [amqp] client with port 40816. Oct 04 23:30:51.568944 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-7aafefc7-a4c6-4251-a2f7-94e05ef25777 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.740128 Oct 04 23:30:51.569613 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4440/8060] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 23:30:49 2022] POST /compute/v2.1/servers => generated 405 bytes in 1741 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 23:30:51.578891 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=12 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:30:51.579667 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell0:SELECT=4 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:30:51.580383 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=1 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:30:51.586746 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-0cd43c09-5f1d-4512-a34a-02dea4ad6bae tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:30:51.587562 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-0cd43c09-5f1d-4512-a34a-02dea4ad6bae tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] [instance: 7a3c06ab-77fb-4b24-8913-f5514e2598cb] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:30:51.650864 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-0cd43c09-5f1d-4512-a34a-02dea4ad6bae tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841e202efcb143cf93d6d9bb1f3edba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979814de519c46d08cd2301bf5d33eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:30:51.658008 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-0cd43c09-5f1d-4512-a34a-02dea4ad6bae tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] 10.222.0.43 "GET /compute/v2.1/servers/7a3c06ab-77fb-4b24-8913-f5514e2598cb" status: 200 len: 1088 microversion: 2.1 time: 0.081071 Oct 04 23:30:51.658624 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3621/8061] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:30:51 2022] GET /compute/v2.1/servers/7a3c06ab-77fb-4b24-8913-f5514e2598cb => generated 1088 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:30:52.682017 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-df2e4c3e-19b0-44c4-8797-7893fab26c0a tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:30:52.682711 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-df2e4c3e-19b0-44c4-8797-7893fab26c0a tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] [instance: 7a3c06ab-77fb-4b24-8913-f5514e2598cb] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:30:52.690520 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-df2e4c3e-19b0-44c4-8797-7893fab26c0a tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:30:52.691044 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-df2e4c3e-19b0-44c4-8797-7893fab26c0a tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:30:52.691571 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-df2e4c3e-19b0-44c4-8797-7893fab26c0a tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:30:52.692311 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-df2e4c3e-19b0-44c4-8797-7893fab26c0a tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:30:52.692790 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-df2e4c3e-19b0-44c4-8797-7893fab26c0a tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:30:52.693241 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-df2e4c3e-19b0-44c4-8797-7893fab26c0a tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:30:52.758410 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-df2e4c3e-19b0-44c4-8797-7893fab26c0a tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841e202efcb143cf93d6d9bb1f3edba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979814de519c46d08cd2301bf5d33eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:30:52.767021 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-df2e4c3e-19b0-44c4-8797-7893fab26c0a tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] 10.222.0.43 "GET /compute/v2.1/servers/7a3c06ab-77fb-4b24-8913-f5514e2598cb" status: 200 len: 1204 microversion: 2.1 time: 0.089775 Oct 04 23:30:52.767622 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4441/8062] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:30:52 2022] GET /compute/v2.1/servers/7a3c06ab-77fb-4b24-8913-f5514e2598cb => generated 1204 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:30:53.790501 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-d237fc0e-a1f9-4f82-ab2d-7702d15e39fe tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:30:53.791350 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-d237fc0e-a1f9-4f82-ab2d-7702d15e39fe tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] [instance: 7a3c06ab-77fb-4b24-8913-f5514e2598cb] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:30:53.798677 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d237fc0e-a1f9-4f82-ab2d-7702d15e39fe tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:30:53.799290 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d237fc0e-a1f9-4f82-ab2d-7702d15e39fe tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:30:53.800001 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d237fc0e-a1f9-4f82-ab2d-7702d15e39fe tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:30:53.800802 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d237fc0e-a1f9-4f82-ab2d-7702d15e39fe tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:30:53.801412 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d237fc0e-a1f9-4f82-ab2d-7702d15e39fe tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:30:53.801930 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d237fc0e-a1f9-4f82-ab2d-7702d15e39fe tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:30:54.014355 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-d237fc0e-a1f9-4f82-ab2d-7702d15e39fe tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841e202efcb143cf93d6d9bb1f3edba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979814de519c46d08cd2301bf5d33eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:30:54.022873 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-d237fc0e-a1f9-4f82-ab2d-7702d15e39fe tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] 10.222.0.43 "GET /compute/v2.1/servers/7a3c06ab-77fb-4b24-8913-f5514e2598cb" status: 200 len: 1271 microversion: 2.1 time: 0.236702 Oct 04 23:30:54.032812 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3622/8063] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:30:53 2022] GET /compute/v2.1/servers/7a3c06ab-77fb-4b24-8913-f5514e2598cb => generated 1271 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:30:54.094619 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-6de9afd9-62e6-4608-918b-9717d58391be req-c2bf72d2-ab95-418a-a898-812a3b1154ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a3c06ab-77fb-4b24-8913-f5514e2598cb", "tag": "77e0c1ff-0437-4875-b013-302c6d326931"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 23:30:54.105298 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-6de9afd9-62e6-4608-918b-9717d58391be req-c2bf72d2-ab95-418a-a898-812a3b1154ce service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:30:54.106329 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-6de9afd9-62e6-4608-918b-9717d58391be req-c2bf72d2-ab95-418a-a898-812a3b1154ce service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:30:54.106816 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-6de9afd9-62e6-4608-918b-9717d58391be req-c2bf72d2-ab95-418a-a898-812a3b1154ce service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:30:54.124783 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-6de9afd9-62e6-4608-918b-9717d58391be req-c2bf72d2-ab95-418a-a898-812a3b1154ce service nova] Creating event network-changed:77e0c1ff-0437-4875-b013-302c6d326931 for instance 7a3c06ab-77fb-4b24-8913-f5514e2598cb on n-h1-860284-1 Oct 04 23:30:54.135212 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-6de9afd9-62e6-4608-918b-9717d58391be req-c2bf72d2-ab95-418a-a898-812a3b1154ce service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044181 Oct 04 23:30:54.135992 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4442/8064] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 23:30:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 23:30:55.045151 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-264414dc-cbc0-4724-922c-fc45a858638c tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:30:55.045763 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-264414dc-cbc0-4724-922c-fc45a858638c tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] [instance: 7a3c06ab-77fb-4b24-8913-f5514e2598cb] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:30:55.053277 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-264414dc-cbc0-4724-922c-fc45a858638c tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:30:55.053681 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-264414dc-cbc0-4724-922c-fc45a858638c tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:30:55.054328 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-264414dc-cbc0-4724-922c-fc45a858638c tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:30:55.055063 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-264414dc-cbc0-4724-922c-fc45a858638c tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:30:55.055521 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-264414dc-cbc0-4724-922c-fc45a858638c tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:30:55.055947 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-264414dc-cbc0-4724-922c-fc45a858638c tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:30:55.273640 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-264414dc-cbc0-4724-922c-fc45a858638c tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841e202efcb143cf93d6d9bb1f3edba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979814de519c46d08cd2301bf5d33eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:30:55.282198 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-264414dc-cbc0-4724-922c-fc45a858638c tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] 10.222.0.43 "GET /compute/v2.1/servers/7a3c06ab-77fb-4b24-8913-f5514e2598cb" status: 200 len: 1271 microversion: 2.1 time: 0.240922 Oct 04 23:30:55.283011 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3623/8065] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:30:55 2022] GET /compute/v2.1/servers/7a3c06ab-77fb-4b24-8913-f5514e2598cb => generated 1271 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:30:56.306652 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-ddcc4c8c-9aa6-45e5-9864-8f3351aa17a4 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:30:56.307371 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-ddcc4c8c-9aa6-45e5-9864-8f3351aa17a4 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] [instance: 7a3c06ab-77fb-4b24-8913-f5514e2598cb] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:30:56.313803 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ddcc4c8c-9aa6-45e5-9864-8f3351aa17a4 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:30:56.314351 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ddcc4c8c-9aa6-45e5-9864-8f3351aa17a4 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:30:56.315019 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ddcc4c8c-9aa6-45e5-9864-8f3351aa17a4 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:30:56.315734 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ddcc4c8c-9aa6-45e5-9864-8f3351aa17a4 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:30:56.316204 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ddcc4c8c-9aa6-45e5-9864-8f3351aa17a4 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:30:56.316646 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ddcc4c8c-9aa6-45e5-9864-8f3351aa17a4 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:30:56.456425 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-ddcc4c8c-9aa6-45e5-9864-8f3351aa17a4 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841e202efcb143cf93d6d9bb1f3edba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979814de519c46d08cd2301bf5d33eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:30:56.464425 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-ddcc4c8c-9aa6-45e5-9864-8f3351aa17a4 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] 10.222.0.43 "GET /compute/v2.1/servers/7a3c06ab-77fb-4b24-8913-f5514e2598cb" status: 200 len: 1271 microversion: 2.1 time: 0.162920 Oct 04 23:30:56.465016 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4443/8066] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:30:56 2022] GET /compute/v2.1/servers/7a3c06ab-77fb-4b24-8913-f5514e2598cb => generated 1271 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:30:57.488292 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-47dc355a-efd2-4cb2-aecf-cb173b18e996 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:30:57.489240 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-47dc355a-efd2-4cb2-aecf-cb173b18e996 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] [instance: 7a3c06ab-77fb-4b24-8913-f5514e2598cb] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:30:57.496143 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-47dc355a-efd2-4cb2-aecf-cb173b18e996 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:30:57.496677 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-47dc355a-efd2-4cb2-aecf-cb173b18e996 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:30:57.497149 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-47dc355a-efd2-4cb2-aecf-cb173b18e996 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:30:57.498624 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-47dc355a-efd2-4cb2-aecf-cb173b18e996 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:30:57.499267 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-47dc355a-efd2-4cb2-aecf-cb173b18e996 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:30:57.499709 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-47dc355a-efd2-4cb2-aecf-cb173b18e996 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:30:57.648208 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-47dc355a-efd2-4cb2-aecf-cb173b18e996 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841e202efcb143cf93d6d9bb1f3edba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979814de519c46d08cd2301bf5d33eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:30:57.656989 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-47dc355a-efd2-4cb2-aecf-cb173b18e996 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] 10.222.0.43 "GET /compute/v2.1/servers/7a3c06ab-77fb-4b24-8913-f5514e2598cb" status: 200 len: 1271 microversion: 2.1 time: 0.172505 Oct 04 23:30:57.657497 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3624/8067] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:30:57 2022] GET /compute/v2.1/servers/7a3c06ab-77fb-4b24-8913-f5514e2598cb => generated 1271 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:30:58.681019 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-6aa009bf-7c7e-4618-ae4a-7b4dbb585779 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:30:58.681662 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-6aa009bf-7c7e-4618-ae4a-7b4dbb585779 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] [instance: 7a3c06ab-77fb-4b24-8913-f5514e2598cb] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:30:58.689503 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6aa009bf-7c7e-4618-ae4a-7b4dbb585779 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:30:58.690008 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6aa009bf-7c7e-4618-ae4a-7b4dbb585779 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:30:58.690507 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6aa009bf-7c7e-4618-ae4a-7b4dbb585779 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:30:58.691231 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6aa009bf-7c7e-4618-ae4a-7b4dbb585779 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:30:58.691707 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6aa009bf-7c7e-4618-ae4a-7b4dbb585779 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:30:58.692156 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6aa009bf-7c7e-4618-ae4a-7b4dbb585779 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:30:58.821365 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-6aa009bf-7c7e-4618-ae4a-7b4dbb585779 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841e202efcb143cf93d6d9bb1f3edba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979814de519c46d08cd2301bf5d33eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:30:58.829655 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-6aa009bf-7c7e-4618-ae4a-7b4dbb585779 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] 10.222.0.43 "GET /compute/v2.1/servers/7a3c06ab-77fb-4b24-8913-f5514e2598cb" status: 200 len: 1259 microversion: 2.1 time: 0.152644 Oct 04 23:30:58.830244 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4444/8068] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:30:58 2022] GET /compute/v2.1/servers/7a3c06ab-77fb-4b24-8913-f5514e2598cb => generated 1259 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:30:59.856592 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-3417fc25-384a-465b-8146-46813f17f26b tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:30:59.857204 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-3417fc25-384a-465b-8146-46813f17f26b tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] [instance: 7a3c06ab-77fb-4b24-8913-f5514e2598cb] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:30:59.864070 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3417fc25-384a-465b-8146-46813f17f26b tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:30:59.864557 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3417fc25-384a-465b-8146-46813f17f26b tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:30:59.864987 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3417fc25-384a-465b-8146-46813f17f26b tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:30:59.865670 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3417fc25-384a-465b-8146-46813f17f26b tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:30:59.866121 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3417fc25-384a-465b-8146-46813f17f26b tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:30:59.866575 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3417fc25-384a-465b-8146-46813f17f26b tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:30:59.998460 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-3417fc25-384a-465b-8146-46813f17f26b tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841e202efcb143cf93d6d9bb1f3edba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979814de519c46d08cd2301bf5d33eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:31:00.006313 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-3417fc25-384a-465b-8146-46813f17f26b tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] 10.222.0.43 "GET /compute/v2.1/servers/7a3c06ab-77fb-4b24-8913-f5514e2598cb" status: 200 len: 1259 microversion: 2.1 time: 0.153672 Oct 04 23:31:00.006922 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3625/8069] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:30:59 2022] GET /compute/v2.1/servers/7a3c06ab-77fb-4b24-8913-f5514e2598cb => generated 1259 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:31:01.029832 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-60b0c468-228f-4d1a-939c-395184858c08 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:31:01.030498 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-60b0c468-228f-4d1a-939c-395184858c08 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] [instance: 7a3c06ab-77fb-4b24-8913-f5514e2598cb] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:31:01.033338 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=2 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:31:01.034071 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=6 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:31:01.040249 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-60b0c468-228f-4d1a-939c-395184858c08 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:31:01.040758 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-60b0c468-228f-4d1a-939c-395184858c08 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:31:01.041235 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-60b0c468-228f-4d1a-939c-395184858c08 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:31:01.041948 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-60b0c468-228f-4d1a-939c-395184858c08 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:31:01.042456 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-60b0c468-228f-4d1a-939c-395184858c08 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:31:01.042911 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-60b0c468-228f-4d1a-939c-395184858c08 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:31:01.173887 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-60b0c468-228f-4d1a-939c-395184858c08 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841e202efcb143cf93d6d9bb1f3edba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979814de519c46d08cd2301bf5d33eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:31:01.181683 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-60b0c468-228f-4d1a-939c-395184858c08 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] 10.222.0.43 "GET /compute/v2.1/servers/7a3c06ab-77fb-4b24-8913-f5514e2598cb" status: 200 len: 1259 microversion: 2.1 time: 0.155940 Oct 04 23:31:01.182263 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4445/8070] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:31:01 2022] GET /compute/v2.1/servers/7a3c06ab-77fb-4b24-8913-f5514e2598cb => generated 1259 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:31:02.204514 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-c9ccbdfb-d3a8-408d-a70e-eee02a557847 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:31:02.205161 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-c9ccbdfb-d3a8-408d-a70e-eee02a557847 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] [instance: 7a3c06ab-77fb-4b24-8913-f5514e2598cb] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:31:02.208638 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell0:SELECT=2 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:31:02.214789 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c9ccbdfb-d3a8-408d-a70e-eee02a557847 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:31:02.215284 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c9ccbdfb-d3a8-408d-a70e-eee02a557847 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:31:02.215743 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c9ccbdfb-d3a8-408d-a70e-eee02a557847 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:31:02.216432 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c9ccbdfb-d3a8-408d-a70e-eee02a557847 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:31:02.216894 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c9ccbdfb-d3a8-408d-a70e-eee02a557847 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:31:02.217328 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c9ccbdfb-d3a8-408d-a70e-eee02a557847 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:31:02.352767 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-c9ccbdfb-d3a8-408d-a70e-eee02a557847 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841e202efcb143cf93d6d9bb1f3edba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979814de519c46d08cd2301bf5d33eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:31:02.360803 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-c9ccbdfb-d3a8-408d-a70e-eee02a557847 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] 10.222.0.43 "GET /compute/v2.1/servers/7a3c06ab-77fb-4b24-8913-f5514e2598cb" status: 200 len: 1259 microversion: 2.1 time: 0.160432 Oct 04 23:31:02.361400 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3626/8071] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:31:02 2022] GET /compute/v2.1/servers/7a3c06ab-77fb-4b24-8913-f5514e2598cb => generated 1259 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:31:03.383618 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-0a6f4eca-0fc1-40c4-a356-2f4e14ba6121 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:31:03.384257 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-0a6f4eca-0fc1-40c4-a356-2f4e14ba6121 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] [instance: 7a3c06ab-77fb-4b24-8913-f5514e2598cb] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:31:03.391384 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0a6f4eca-0fc1-40c4-a356-2f4e14ba6121 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:31:03.391833 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0a6f4eca-0fc1-40c4-a356-2f4e14ba6121 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:31:03.392299 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0a6f4eca-0fc1-40c4-a356-2f4e14ba6121 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:31:03.393014 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0a6f4eca-0fc1-40c4-a356-2f4e14ba6121 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:31:03.393491 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0a6f4eca-0fc1-40c4-a356-2f4e14ba6121 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:31:03.393945 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0a6f4eca-0fc1-40c4-a356-2f4e14ba6121 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:31:03.530919 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-0a6f4eca-0fc1-40c4-a356-2f4e14ba6121 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841e202efcb143cf93d6d9bb1f3edba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979814de519c46d08cd2301bf5d33eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:31:03.538744 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-0a6f4eca-0fc1-40c4-a356-2f4e14ba6121 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] 10.222.0.43 "GET /compute/v2.1/servers/7a3c06ab-77fb-4b24-8913-f5514e2598cb" status: 200 len: 1259 microversion: 2.1 time: 0.159071 Oct 04 23:31:03.539338 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4446/8072] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:31:03 2022] GET /compute/v2.1/servers/7a3c06ab-77fb-4b24-8913-f5514e2598cb => generated 1259 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:31:04.562610 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-5b633688-85ed-4255-870c-94ef44feeec6 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:31:04.563225 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-5b633688-85ed-4255-870c-94ef44feeec6 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] [instance: 7a3c06ab-77fb-4b24-8913-f5514e2598cb] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:31:04.570111 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5b633688-85ed-4255-870c-94ef44feeec6 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:31:04.570613 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5b633688-85ed-4255-870c-94ef44feeec6 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:31:04.571049 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5b633688-85ed-4255-870c-94ef44feeec6 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:31:04.571735 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5b633688-85ed-4255-870c-94ef44feeec6 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:31:04.572193 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5b633688-85ed-4255-870c-94ef44feeec6 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:31:04.572613 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-5b633688-85ed-4255-870c-94ef44feeec6 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:31:04.708321 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-5b633688-85ed-4255-870c-94ef44feeec6 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841e202efcb143cf93d6d9bb1f3edba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979814de519c46d08cd2301bf5d33eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:31:04.716283 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-5b633688-85ed-4255-870c-94ef44feeec6 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] 10.222.0.43 "GET /compute/v2.1/servers/7a3c06ab-77fb-4b24-8913-f5514e2598cb" status: 200 len: 1259 microversion: 2.1 time: 0.158365 Oct 04 23:31:04.716866 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3627/8073] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:31:04 2022] GET /compute/v2.1/servers/7a3c06ab-77fb-4b24-8913-f5514e2598cb => generated 1259 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:31:05.739870 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-56439f2b-d7ca-408d-a092-d3eaf153d01f tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:31:05.740497 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-56439f2b-d7ca-408d-a092-d3eaf153d01f tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] [instance: 7a3c06ab-77fb-4b24-8913-f5514e2598cb] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:31:05.747359 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-56439f2b-d7ca-408d-a092-d3eaf153d01f tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:31:05.747855 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-56439f2b-d7ca-408d-a092-d3eaf153d01f tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:31:05.748306 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-56439f2b-d7ca-408d-a092-d3eaf153d01f tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:31:05.749008 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-56439f2b-d7ca-408d-a092-d3eaf153d01f tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:31:05.749475 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-56439f2b-d7ca-408d-a092-d3eaf153d01f tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:31:05.749917 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-56439f2b-d7ca-408d-a092-d3eaf153d01f tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:31:05.880321 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-56439f2b-d7ca-408d-a092-d3eaf153d01f tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841e202efcb143cf93d6d9bb1f3edba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979814de519c46d08cd2301bf5d33eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:31:05.888126 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-56439f2b-d7ca-408d-a092-d3eaf153d01f tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] 10.222.0.43 "GET /compute/v2.1/servers/7a3c06ab-77fb-4b24-8913-f5514e2598cb" status: 200 len: 1259 microversion: 2.1 time: 0.152134 Oct 04 23:31:05.888693 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4447/8074] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:31:05 2022] GET /compute/v2.1/servers/7a3c06ab-77fb-4b24-8913-f5514e2598cb => generated 1259 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:31:06.910709 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-ab7ccaad-ab28-4ade-b216-aea552c7b19e tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:31:06.911367 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-ab7ccaad-ab28-4ade-b216-aea552c7b19e tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] [instance: 7a3c06ab-77fb-4b24-8913-f5514e2598cb] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:31:06.918792 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ab7ccaad-ab28-4ade-b216-aea552c7b19e tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:31:06.919281 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ab7ccaad-ab28-4ade-b216-aea552c7b19e tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:31:06.919724 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ab7ccaad-ab28-4ade-b216-aea552c7b19e tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:31:06.920422 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ab7ccaad-ab28-4ade-b216-aea552c7b19e tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:31:06.920885 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ab7ccaad-ab28-4ade-b216-aea552c7b19e tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:31:06.921328 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ab7ccaad-ab28-4ade-b216-aea552c7b19e tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:31:07.053777 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-ab7ccaad-ab28-4ade-b216-aea552c7b19e tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841e202efcb143cf93d6d9bb1f3edba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979814de519c46d08cd2301bf5d33eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:31:07.062340 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-ab7ccaad-ab28-4ade-b216-aea552c7b19e tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] 10.222.0.43 "GET /compute/v2.1/servers/7a3c06ab-77fb-4b24-8913-f5514e2598cb" status: 200 len: 1259 microversion: 2.1 time: 0.155600 Oct 04 23:31:07.062954 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3628/8075] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:31:06 2022] GET /compute/v2.1/servers/7a3c06ab-77fb-4b24-8913-f5514e2598cb => generated 1259 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:31:08.084630 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-f2d25e81-4977-465e-b739-e8a31d982f9b tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:31:08.085274 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-f2d25e81-4977-465e-b739-e8a31d982f9b tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] [instance: 7a3c06ab-77fb-4b24-8913-f5514e2598cb] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:31:08.092550 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f2d25e81-4977-465e-b739-e8a31d982f9b tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:31:08.093053 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f2d25e81-4977-465e-b739-e8a31d982f9b tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:31:08.093513 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f2d25e81-4977-465e-b739-e8a31d982f9b tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:31:08.094232 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f2d25e81-4977-465e-b739-e8a31d982f9b tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:31:08.094746 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f2d25e81-4977-465e-b739-e8a31d982f9b tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:31:08.095202 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f2d25e81-4977-465e-b739-e8a31d982f9b tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:31:08.230014 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-f2d25e81-4977-465e-b739-e8a31d982f9b tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841e202efcb143cf93d6d9bb1f3edba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979814de519c46d08cd2301bf5d33eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:31:08.238469 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-f2d25e81-4977-465e-b739-e8a31d982f9b tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] 10.222.0.43 "GET /compute/v2.1/servers/7a3c06ab-77fb-4b24-8913-f5514e2598cb" status: 200 len: 1259 microversion: 2.1 time: 0.157802 Oct 04 23:31:08.239050 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4448/8076] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:31:08 2022] GET /compute/v2.1/servers/7a3c06ab-77fb-4b24-8913-f5514e2598cb => generated 1259 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:31:09.261368 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-67558cab-9f45-477b-b3ea-351cf0d62f23 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:31:09.262683 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-67558cab-9f45-477b-b3ea-351cf0d62f23 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] [instance: 7a3c06ab-77fb-4b24-8913-f5514e2598cb] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:31:09.269918 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-67558cab-9f45-477b-b3ea-351cf0d62f23 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:31:09.270442 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-67558cab-9f45-477b-b3ea-351cf0d62f23 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:31:09.270886 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-67558cab-9f45-477b-b3ea-351cf0d62f23 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:31:09.271594 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-67558cab-9f45-477b-b3ea-351cf0d62f23 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:31:09.272056 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-67558cab-9f45-477b-b3ea-351cf0d62f23 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:31:09.272494 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-67558cab-9f45-477b-b3ea-351cf0d62f23 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:31:09.411823 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-67558cab-9f45-477b-b3ea-351cf0d62f23 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841e202efcb143cf93d6d9bb1f3edba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979814de519c46d08cd2301bf5d33eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:31:09.420230 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-67558cab-9f45-477b-b3ea-351cf0d62f23 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] 10.222.0.43 "GET /compute/v2.1/servers/7a3c06ab-77fb-4b24-8913-f5514e2598cb" status: 200 len: 1259 microversion: 2.1 time: 0.162910 Oct 04 23:31:09.420812 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3629/8077] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:31:09 2022] GET /compute/v2.1/servers/7a3c06ab-77fb-4b24-8913-f5514e2598cb => generated 1259 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:31:10.443045 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-ceeedeb9-2e78-4b88-8698-454f6532df34 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:31:10.443616 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-ceeedeb9-2e78-4b88-8698-454f6532df34 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] [instance: 7a3c06ab-77fb-4b24-8913-f5514e2598cb] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:31:10.450585 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ceeedeb9-2e78-4b88-8698-454f6532df34 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:31:10.451082 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ceeedeb9-2e78-4b88-8698-454f6532df34 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:31:10.451536 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ceeedeb9-2e78-4b88-8698-454f6532df34 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:31:10.452233 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ceeedeb9-2e78-4b88-8698-454f6532df34 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:31:10.452705 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ceeedeb9-2e78-4b88-8698-454f6532df34 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:31:10.453140 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ceeedeb9-2e78-4b88-8698-454f6532df34 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:31:10.588833 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-ceeedeb9-2e78-4b88-8698-454f6532df34 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841e202efcb143cf93d6d9bb1f3edba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979814de519c46d08cd2301bf5d33eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:31:10.597058 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-ceeedeb9-2e78-4b88-8698-454f6532df34 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] 10.222.0.43 "GET /compute/v2.1/servers/7a3c06ab-77fb-4b24-8913-f5514e2598cb" status: 200 len: 1259 microversion: 2.1 time: 0.158025 Oct 04 23:31:10.597646 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4449/8078] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:31:10 2022] GET /compute/v2.1/servers/7a3c06ab-77fb-4b24-8913-f5514e2598cb => generated 1259 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:31:10.659008 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-a3d48af4-a61c-4ced-b3a0-07ebff2dee52 req-47557672-dbe7-4a9f-bda5-ac8e3607bbe5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a3c06ab-77fb-4b24-8913-f5514e2598cb", "name": "network-vif-plugged", "status": "completed", "tag": "77e0c1ff-0437-4875-b013-302c6d326931"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 23:31:10.671036 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-a3d48af4-a61c-4ced-b3a0-07ebff2dee52 req-47557672-dbe7-4a9f-bda5-ac8e3607bbe5 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:31:10.671665 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-a3d48af4-a61c-4ced-b3a0-07ebff2dee52 req-47557672-dbe7-4a9f-bda5-ac8e3607bbe5 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:31:10.672430 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-a3d48af4-a61c-4ced-b3a0-07ebff2dee52 req-47557672-dbe7-4a9f-bda5-ac8e3607bbe5 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:31:10.684925 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-a3d48af4-a61c-4ced-b3a0-07ebff2dee52 req-47557672-dbe7-4a9f-bda5-ac8e3607bbe5 service nova] Creating event network-vif-plugged:77e0c1ff-0437-4875-b013-302c6d326931 for instance 7a3c06ab-77fb-4b24-8913-f5514e2598cb on n-h1-860284-1 Oct 04 23:31:10.690003 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-a3d48af4-a61c-4ced-b3a0-07ebff2dee52 req-47557672-dbe7-4a9f-bda5-ac8e3607bbe5 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035244 Oct 04 23:31:10.690659 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3630/8079] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 23:31:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 23:31:11.621230 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-242855ce-96ca-4756-9dc5-95e13f4b0ddc tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:31:11.621889 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-242855ce-96ca-4756-9dc5-95e13f4b0ddc tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] [instance: 7a3c06ab-77fb-4b24-8913-f5514e2598cb] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:31:11.628971 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-242855ce-96ca-4756-9dc5-95e13f4b0ddc tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:31:11.629477 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-242855ce-96ca-4756-9dc5-95e13f4b0ddc tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:31:11.629935 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-242855ce-96ca-4756-9dc5-95e13f4b0ddc tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:31:11.630683 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-242855ce-96ca-4756-9dc5-95e13f4b0ddc tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:31:11.631159 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-242855ce-96ca-4756-9dc5-95e13f4b0ddc tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:31:11.631609 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-242855ce-96ca-4756-9dc5-95e13f4b0ddc tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:31:11.768889 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-242855ce-96ca-4756-9dc5-95e13f4b0ddc tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841e202efcb143cf93d6d9bb1f3edba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979814de519c46d08cd2301bf5d33eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:31:11.776867 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-242855ce-96ca-4756-9dc5-95e13f4b0ddc tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] 10.222.0.43 "GET /compute/v2.1/servers/7a3c06ab-77fb-4b24-8913-f5514e2598cb" status: 200 len: 1259 microversion: 2.1 time: 0.159749 Oct 04 23:31:11.778161 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4450/8080] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:31:11 2022] GET /compute/v2.1/servers/7a3c06ab-77fb-4b24-8913-f5514e2598cb => generated 1259 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:31:12.801899 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-a5b4f11f-79e0-4b7a-be28-7cdef72531ac tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:31:12.802624 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-a5b4f11f-79e0-4b7a-be28-7cdef72531ac tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] [instance: 7a3c06ab-77fb-4b24-8913-f5514e2598cb] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:31:12.809511 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a5b4f11f-79e0-4b7a-be28-7cdef72531ac tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:31:12.810003 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a5b4f11f-79e0-4b7a-be28-7cdef72531ac tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:31:12.810468 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a5b4f11f-79e0-4b7a-be28-7cdef72531ac tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:31:12.811175 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a5b4f11f-79e0-4b7a-be28-7cdef72531ac tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:31:12.811641 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a5b4f11f-79e0-4b7a-be28-7cdef72531ac tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:31:12.812069 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a5b4f11f-79e0-4b7a-be28-7cdef72531ac tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:31:12.946604 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-a5b4f11f-79e0-4b7a-be28-7cdef72531ac tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841e202efcb143cf93d6d9bb1f3edba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979814de519c46d08cd2301bf5d33eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:31:12.955459 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-a5b4f11f-79e0-4b7a-be28-7cdef72531ac tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] 10.222.0.43 "GET /compute/v2.1/servers/7a3c06ab-77fb-4b24-8913-f5514e2598cb" status: 200 len: 1443 microversion: 2.1 time: 0.158889 Oct 04 23:31:12.956044 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3631/8081] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:31:12 2022] GET /compute/v2.1/servers/7a3c06ab-77fb-4b24-8913-f5514e2598cb => generated 1443 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:31:12.979152 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-7a6fa6d1-aba6-4991-933b-00d55811ed92 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:31:12.980136 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-7a6fa6d1-aba6-4991-933b-00d55811ed92 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] [instance: 7a3c06ab-77fb-4b24-8913-f5514e2598cb] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:31:12.987444 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7a6fa6d1-aba6-4991-933b-00d55811ed92 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:31:12.987953 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7a6fa6d1-aba6-4991-933b-00d55811ed92 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:31:12.988413 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7a6fa6d1-aba6-4991-933b-00d55811ed92 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:31:12.989139 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7a6fa6d1-aba6-4991-933b-00d55811ed92 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:31:12.989614 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7a6fa6d1-aba6-4991-933b-00d55811ed92 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:31:12.990081 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-7a6fa6d1-aba6-4991-933b-00d55811ed92 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:31:13.128066 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-7a6fa6d1-aba6-4991-933b-00d55811ed92 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841e202efcb143cf93d6d9bb1f3edba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979814de519c46d08cd2301bf5d33eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:31:13.137410 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-7a6fa6d1-aba6-4991-933b-00d55811ed92 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] 10.222.0.43 "GET /compute/v2.1/servers/7a3c06ab-77fb-4b24-8913-f5514e2598cb" status: 200 len: 1443 microversion: 2.1 time: 0.161772 Oct 04 23:31:13.138103 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4451/8082] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:31:12 2022] GET /compute/v2.1/servers/7a3c06ab-77fb-4b24-8913-f5514e2598cb => generated 1443 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:31:14.766505 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-a21c2b5e-78ad-425b-af98-3685e8e0d993 req-f65c3bc0-b2e9-43de-967a-34240de48705 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a3c06ab-77fb-4b24-8913-f5514e2598cb", "tag": "77e0c1ff-0437-4875-b013-302c6d326931"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 23:31:14.777920 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-a21c2b5e-78ad-425b-af98-3685e8e0d993 req-f65c3bc0-b2e9-43de-967a-34240de48705 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:31:14.778429 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-a21c2b5e-78ad-425b-af98-3685e8e0d993 req-f65c3bc0-b2e9-43de-967a-34240de48705 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:31:14.778867 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-a21c2b5e-78ad-425b-af98-3685e8e0d993 req-f65c3bc0-b2e9-43de-967a-34240de48705 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:31:14.790701 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-a21c2b5e-78ad-425b-af98-3685e8e0d993 req-f65c3bc0-b2e9-43de-967a-34240de48705 service nova] Creating event network-changed:77e0c1ff-0437-4875-b013-302c6d326931 for instance 7a3c06ab-77fb-4b24-8913-f5514e2598cb on n-h1-860284-1 Oct 04 23:31:14.796718 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-a21c2b5e-78ad-425b-af98-3685e8e0d993 req-f65c3bc0-b2e9-43de-967a-34240de48705 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033932 Oct 04 23:31:14.797344 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3632/8083] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 23:31:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 23:33:12.491335 n-d-860284-1 devstack@n-api.service[134101]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f8e2fc52-bb96-4bc7-8039-fbfc8addcbeb] AMQP server on 10.222.0.43:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 04 23:33:12.492203 n-d-860284-1 devstack@n-api.service[134101]: ERROR oslo.messaging._drivers.impl_rabbit [-] [dab38095-fcf8-46d0-9904-6bfbf5d1f82a] AMQP server on 10.222.0.43:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 04 23:33:12.493047 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:33:12.493814 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=64 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:33:12.495177 n-d-860284-1 devstack@n-api.service[134101]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 04 23:33:12.495472 n-d-860284-1 devstack@n-api.service[134101]: Tue Oct 4 23:33:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7a3c06ab-77fb-4b24-8913-f5514e2598cb/action (ip 10.222.0.43) !!! Oct 04 23:33:12.502033 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-1713200c-831a-4b7f-b348-c00300a41fe9 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 23:33:12.502617 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-1713200c-831a-4b7f-b348-c00300a41fe9 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] [instance: 7a3c06ab-77fb-4b24-8913-f5514e2598cb] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:33:12.512231 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1713200c-831a-4b7f-b348-c00300a41fe9 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:33:12.512730 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1713200c-831a-4b7f-b348-c00300a41fe9 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:33:12.513184 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1713200c-831a-4b7f-b348-c00300a41fe9 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:33:12.513891 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1713200c-831a-4b7f-b348-c00300a41fe9 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:33:12.514456 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1713200c-831a-4b7f-b348-c00300a41fe9 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:33:12.514902 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1713200c-831a-4b7f-b348-c00300a41fe9 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:33:12.538852 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.objects.instance [None req-1713200c-831a-4b7f-b348-c00300a41fe9 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lazy-loading 'flavor' on Instance uuid 7a3c06ab-77fb-4b24-8913-f5514e2598cb {{(pid=134101) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 23:33:12.615520 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-1713200c-831a-4b7f-b348-c00300a41fe9 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] 10.222.0.43 "POST /compute/v2.1/servers/7a3c06ab-77fb-4b24-8913-f5514e2598cb/action" status: 202 len: 0 microversion: 2.1 time: 0.126162 Oct 04 23:33:12.616336 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4452/8084] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 23:33:12 2022] POST /compute/v2.1/servers/7a3c06ab-77fb-4b24-8913-f5514e2598cb/action => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 23:33:12.622578 n-d-860284-1 devstack@n-api.service[134102]: ERROR oslo.messaging._drivers.impl_rabbit [-] [84f2d93b-5df1-409f-ad67-38bf0ff7216a] AMQP server on 10.222.0.43:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 23:33:12.623385 n-d-860284-1 devstack@n-api.service[134102]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9c149bb3-0a09-4645-ba44-d3908964d17c] AMQP server on 10.222.0.43:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 23:33:12.623972 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_api:SELECT=26 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:33:12.624960 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=58 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:33:12.625795 n-d-860284-1 devstack@n-api.service[134102]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 23:33:12.625929 n-d-860284-1 devstack@n-api.service[134102]: Tue Oct 4 23:33:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7a3c06ab-77fb-4b24-8913-f5514e2598cb (ip 10.222.0.43) !!! Oct 04 23:33:12.627300 n-d-860284-1 devstack@n-api.service[134102]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 04 23:33:12.627300 n-d-860284-1 devstack@n-api.service[134102]: Tue Oct 4 23:33:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7a3c06ab-77fb-4b24-8913-f5514e2598cb (ip 10.222.0.43) !!! Oct 04 23:33:12.633223 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-f7fa6103-7034-44a1-8e8a-1a8775619dbc tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:33:12.633926 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-f7fa6103-7034-44a1-8e8a-1a8775619dbc tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] [instance: 7a3c06ab-77fb-4b24-8913-f5514e2598cb] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:33:12.650519 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f7fa6103-7034-44a1-8e8a-1a8775619dbc tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:33:12.651007 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f7fa6103-7034-44a1-8e8a-1a8775619dbc tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:33:12.651478 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f7fa6103-7034-44a1-8e8a-1a8775619dbc tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:33:12.652194 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f7fa6103-7034-44a1-8e8a-1a8775619dbc tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:33:12.652589 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f7fa6103-7034-44a1-8e8a-1a8775619dbc tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:33:12.653017 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f7fa6103-7034-44a1-8e8a-1a8775619dbc tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:33:12.790812 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-f7fa6103-7034-44a1-8e8a-1a8775619dbc tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841e202efcb143cf93d6d9bb1f3edba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979814de519c46d08cd2301bf5d33eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:33:12.800546 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-f7fa6103-7034-44a1-8e8a-1a8775619dbc tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] 10.222.0.43 "GET /compute/v2.1/servers/7a3c06ab-77fb-4b24-8913-f5514e2598cb" status: 200 len: 1567 microversion: 2.1 time: 0.179873 Oct 04 23:33:12.801191 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3633/8085] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:33:12 2022] GET /compute/v2.1/servers/7a3c06ab-77fb-4b24-8913-f5514e2598cb => generated 1567 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:33:13.829840 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-703d73cc-8263-4a63-b647-e7443b4ddfa1 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:33:13.830613 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-703d73cc-8263-4a63-b647-e7443b4ddfa1 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] [instance: 7a3c06ab-77fb-4b24-8913-f5514e2598cb] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:33:13.840458 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-703d73cc-8263-4a63-b647-e7443b4ddfa1 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:33:13.840962 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-703d73cc-8263-4a63-b647-e7443b4ddfa1 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:33:13.841412 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-703d73cc-8263-4a63-b647-e7443b4ddfa1 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:33:13.842116 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-703d73cc-8263-4a63-b647-e7443b4ddfa1 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:33:13.842613 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-703d73cc-8263-4a63-b647-e7443b4ddfa1 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:33:13.843734 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-703d73cc-8263-4a63-b647-e7443b4ddfa1 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:33:13.848469 n-d-860284-1 devstack@n-api.service[134101]: INFO oslo.messaging._drivers.impl_rabbit [-] [dab38095-fcf8-46d0-9904-6bfbf5d1f82a] Reconnected to AMQP server on 10.222.0.43:5672 via [amqp] client with port 40932. Oct 04 23:33:13.850541 n-d-860284-1 devstack@n-api.service[134101]: INFO oslo.messaging._drivers.impl_rabbit [-] [f8e2fc52-bb96-4bc7-8039-fbfc8addcbeb] Reconnected to AMQP server on 10.222.0.43:5672 via [amqp] client with port 40930. Oct 04 23:33:13.982675 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-703d73cc-8263-4a63-b647-e7443b4ddfa1 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841e202efcb143cf93d6d9bb1f3edba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979814de519c46d08cd2301bf5d33eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:33:13.991186 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-703d73cc-8263-4a63-b647-e7443b4ddfa1 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] 10.222.0.43 "GET /compute/v2.1/servers/7a3c06ab-77fb-4b24-8913-f5514e2598cb" status: 200 len: 1567 microversion: 2.1 time: 0.170653 Oct 04 23:33:13.991766 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4453/8086] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:33:13 2022] GET /compute/v2.1/servers/7a3c06ab-77fb-4b24-8913-f5514e2598cb => generated 1567 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:33:15.015201 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-7d9725b8-4ce3-4b91-af28-fd672c367437 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:33:15.015827 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-7d9725b8-4ce3-4b91-af28-fd672c367437 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] [instance: 7a3c06ab-77fb-4b24-8913-f5514e2598cb] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:33:15.024642 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7d9725b8-4ce3-4b91-af28-fd672c367437 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:33:15.025115 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7d9725b8-4ce3-4b91-af28-fd672c367437 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:33:15.025557 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7d9725b8-4ce3-4b91-af28-fd672c367437 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:33:15.026256 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7d9725b8-4ce3-4b91-af28-fd672c367437 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:33:15.026740 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7d9725b8-4ce3-4b91-af28-fd672c367437 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:33:15.027170 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7d9725b8-4ce3-4b91-af28-fd672c367437 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:33:15.033797 n-d-860284-1 devstack@n-api.service[134102]: INFO oslo.messaging._drivers.impl_rabbit [-] [84f2d93b-5df1-409f-ad67-38bf0ff7216a] Reconnected to AMQP server on 10.222.0.43:5672 via [amqp] client with port 40938. Oct 04 23:33:15.045237 n-d-860284-1 devstack@n-api.service[134102]: INFO oslo.messaging._drivers.impl_rabbit [-] [9c149bb3-0a09-4645-ba44-d3908964d17c] Reconnected to AMQP server on 10.222.0.43:5672 via [amqp] client with port 40940. Oct 04 23:33:15.174588 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-7d9725b8-4ce3-4b91-af28-fd672c367437 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841e202efcb143cf93d6d9bb1f3edba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979814de519c46d08cd2301bf5d33eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:33:15.182425 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-7d9725b8-4ce3-4b91-af28-fd672c367437 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] 10.222.0.43 "GET /compute/v2.1/servers/7a3c06ab-77fb-4b24-8913-f5514e2598cb" status: 200 len: 1567 microversion: 2.1 time: 0.171293 Oct 04 23:33:15.183019 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3634/8087] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:33:15 2022] GET /compute/v2.1/servers/7a3c06ab-77fb-4b24-8913-f5514e2598cb => generated 1567 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:33:16.206114 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-c2ae54a5-5be9-41e9-a2b4-22b8a8814949 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:33:16.206715 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-c2ae54a5-5be9-41e9-a2b4-22b8a8814949 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] [instance: 7a3c06ab-77fb-4b24-8913-f5514e2598cb] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:33:16.213474 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c2ae54a5-5be9-41e9-a2b4-22b8a8814949 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:33:16.213981 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c2ae54a5-5be9-41e9-a2b4-22b8a8814949 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:33:16.214464 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c2ae54a5-5be9-41e9-a2b4-22b8a8814949 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:33:16.215172 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c2ae54a5-5be9-41e9-a2b4-22b8a8814949 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:33:16.215639 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c2ae54a5-5be9-41e9-a2b4-22b8a8814949 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:33:16.216079 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c2ae54a5-5be9-41e9-a2b4-22b8a8814949 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:33:16.348748 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-c2ae54a5-5be9-41e9-a2b4-22b8a8814949 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841e202efcb143cf93d6d9bb1f3edba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979814de519c46d08cd2301bf5d33eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:33:16.356795 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-c2ae54a5-5be9-41e9-a2b4-22b8a8814949 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] 10.222.0.43 "GET /compute/v2.1/servers/7a3c06ab-77fb-4b24-8913-f5514e2598cb" status: 200 len: 1567 microversion: 2.1 time: 0.155313 Oct 04 23:33:16.357369 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4454/8088] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:33:16 2022] GET /compute/v2.1/servers/7a3c06ab-77fb-4b24-8913-f5514e2598cb => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:33:17.379990 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-7656da26-7ce2-49fe-84e4-69e00774c23a tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:33:17.380648 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-7656da26-7ce2-49fe-84e4-69e00774c23a tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] [instance: 7a3c06ab-77fb-4b24-8913-f5514e2598cb] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:33:17.388134 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7656da26-7ce2-49fe-84e4-69e00774c23a tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:33:17.388564 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7656da26-7ce2-49fe-84e4-69e00774c23a tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:33:17.389009 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7656da26-7ce2-49fe-84e4-69e00774c23a tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:33:17.389867 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7656da26-7ce2-49fe-84e4-69e00774c23a tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:33:17.390174 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7656da26-7ce2-49fe-84e4-69e00774c23a tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:33:17.390630 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7656da26-7ce2-49fe-84e4-69e00774c23a tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:33:17.526554 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-7656da26-7ce2-49fe-84e4-69e00774c23a tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841e202efcb143cf93d6d9bb1f3edba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979814de519c46d08cd2301bf5d33eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:33:17.534979 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-7656da26-7ce2-49fe-84e4-69e00774c23a tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] 10.222.0.43 "GET /compute/v2.1/servers/7a3c06ab-77fb-4b24-8913-f5514e2598cb" status: 200 len: 1567 microversion: 2.1 time: 0.159084 Oct 04 23:33:17.535562 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3635/8089] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:33:17 2022] GET /compute/v2.1/servers/7a3c06ab-77fb-4b24-8913-f5514e2598cb => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:33:18.558224 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e6135352-0601-42f9-bc84-f6a191d1967a tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:33:18.558910 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-e6135352-0601-42f9-bc84-f6a191d1967a tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] [instance: 7a3c06ab-77fb-4b24-8913-f5514e2598cb] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:33:18.565787 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e6135352-0601-42f9-bc84-f6a191d1967a tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:33:18.566284 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e6135352-0601-42f9-bc84-f6a191d1967a tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:33:18.566769 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e6135352-0601-42f9-bc84-f6a191d1967a tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:33:18.567470 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e6135352-0601-42f9-bc84-f6a191d1967a tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:33:18.567939 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e6135352-0601-42f9-bc84-f6a191d1967a tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:33:18.568383 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e6135352-0601-42f9-bc84-f6a191d1967a tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:33:18.698742 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-e6135352-0601-42f9-bc84-f6a191d1967a tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841e202efcb143cf93d6d9bb1f3edba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979814de519c46d08cd2301bf5d33eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:33:18.706869 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-e6135352-0601-42f9-bc84-f6a191d1967a tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] 10.222.0.43 "GET /compute/v2.1/servers/7a3c06ab-77fb-4b24-8913-f5514e2598cb" status: 200 len: 1567 microversion: 2.1 time: 0.152642 Oct 04 23:33:18.707443 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4455/8090] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:33:18 2022] GET /compute/v2.1/servers/7a3c06ab-77fb-4b24-8913-f5514e2598cb => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:33:19.730374 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-f1d2e973-d167-46d3-ab73-51d34d87ae27 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:33:19.731017 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-f1d2e973-d167-46d3-ab73-51d34d87ae27 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] [instance: 7a3c06ab-77fb-4b24-8913-f5514e2598cb] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:33:19.738459 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f1d2e973-d167-46d3-ab73-51d34d87ae27 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:33:19.738945 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f1d2e973-d167-46d3-ab73-51d34d87ae27 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:33:19.739378 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f1d2e973-d167-46d3-ab73-51d34d87ae27 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:33:19.740063 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f1d2e973-d167-46d3-ab73-51d34d87ae27 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:33:19.740542 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f1d2e973-d167-46d3-ab73-51d34d87ae27 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:33:19.740964 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f1d2e973-d167-46d3-ab73-51d34d87ae27 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:33:19.875395 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-f1d2e973-d167-46d3-ab73-51d34d87ae27 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841e202efcb143cf93d6d9bb1f3edba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979814de519c46d08cd2301bf5d33eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:33:19.883171 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-f1d2e973-d167-46d3-ab73-51d34d87ae27 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] 10.222.0.43 "GET /compute/v2.1/servers/7a3c06ab-77fb-4b24-8913-f5514e2598cb" status: 200 len: 1567 microversion: 2.1 time: 0.156698 Oct 04 23:33:19.883746 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3636/8091] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:33:19 2022] GET /compute/v2.1/servers/7a3c06ab-77fb-4b24-8913-f5514e2598cb => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:33:20.906815 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-843b43c9-6e2b-4a37-9a2a-353e451e774b tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:33:20.907446 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-843b43c9-6e2b-4a37-9a2a-353e451e774b tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] [instance: 7a3c06ab-77fb-4b24-8913-f5514e2598cb] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:33:20.914222 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-843b43c9-6e2b-4a37-9a2a-353e451e774b tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:33:20.914750 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-843b43c9-6e2b-4a37-9a2a-353e451e774b tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:33:20.915201 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-843b43c9-6e2b-4a37-9a2a-353e451e774b tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:33:20.915935 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-843b43c9-6e2b-4a37-9a2a-353e451e774b tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:33:20.916407 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-843b43c9-6e2b-4a37-9a2a-353e451e774b tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:33:20.916849 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-843b43c9-6e2b-4a37-9a2a-353e451e774b tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:33:21.055784 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-843b43c9-6e2b-4a37-9a2a-353e451e774b tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841e202efcb143cf93d6d9bb1f3edba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979814de519c46d08cd2301bf5d33eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:33:21.064431 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-843b43c9-6e2b-4a37-9a2a-353e451e774b tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] 10.222.0.43 "GET /compute/v2.1/servers/7a3c06ab-77fb-4b24-8913-f5514e2598cb" status: 200 len: 1567 microversion: 2.1 time: 0.161638 Oct 04 23:33:21.065054 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4456/8092] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:33:20 2022] GET /compute/v2.1/servers/7a3c06ab-77fb-4b24-8913-f5514e2598cb => generated 1567 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:33:22.088410 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-17259b99-e93e-4cb9-8a79-377ed8bf9583 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:33:22.089008 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-17259b99-e93e-4cb9-8a79-377ed8bf9583 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] [instance: 7a3c06ab-77fb-4b24-8913-f5514e2598cb] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:33:22.096618 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-17259b99-e93e-4cb9-8a79-377ed8bf9583 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:33:22.097120 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-17259b99-e93e-4cb9-8a79-377ed8bf9583 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:33:22.097566 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-17259b99-e93e-4cb9-8a79-377ed8bf9583 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:33:22.098269 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-17259b99-e93e-4cb9-8a79-377ed8bf9583 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:33:22.098758 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-17259b99-e93e-4cb9-8a79-377ed8bf9583 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:33:22.099459 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-17259b99-e93e-4cb9-8a79-377ed8bf9583 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:33:22.232507 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-17259b99-e93e-4cb9-8a79-377ed8bf9583 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841e202efcb143cf93d6d9bb1f3edba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979814de519c46d08cd2301bf5d33eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:33:22.240826 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-17259b99-e93e-4cb9-8a79-377ed8bf9583 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] 10.222.0.43 "GET /compute/v2.1/servers/7a3c06ab-77fb-4b24-8913-f5514e2598cb" status: 200 len: 1567 microversion: 2.1 time: 0.156315 Oct 04 23:33:22.241388 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3637/8093] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:33:22 2022] GET /compute/v2.1/servers/7a3c06ab-77fb-4b24-8913-f5514e2598cb => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 23:33:23.264884 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-391a0367-1728-44c9-b7b5-e3ee50771bb0 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:33:23.266271 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-391a0367-1728-44c9-b7b5-e3ee50771bb0 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] [instance: 7a3c06ab-77fb-4b24-8913-f5514e2598cb] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:33:23.273346 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-391a0367-1728-44c9-b7b5-e3ee50771bb0 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:33:23.273856 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-391a0367-1728-44c9-b7b5-e3ee50771bb0 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:33:23.274316 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-391a0367-1728-44c9-b7b5-e3ee50771bb0 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:33:23.275111 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-391a0367-1728-44c9-b7b5-e3ee50771bb0 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:33:23.275590 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-391a0367-1728-44c9-b7b5-e3ee50771bb0 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:33:23.276037 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-391a0367-1728-44c9-b7b5-e3ee50771bb0 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:33:23.413620 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-391a0367-1728-44c9-b7b5-e3ee50771bb0 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841e202efcb143cf93d6d9bb1f3edba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979814de519c46d08cd2301bf5d33eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:33:23.422916 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-391a0367-1728-44c9-b7b5-e3ee50771bb0 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] 10.222.0.43 "GET /compute/v2.1/servers/7a3c06ab-77fb-4b24-8913-f5514e2598cb" status: 200 len: 1567 microversion: 2.1 time: 0.161977 Oct 04 23:33:23.423501 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4457/8094] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:33:23 2022] GET /compute/v2.1/servers/7a3c06ab-77fb-4b24-8913-f5514e2598cb => generated 1567 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:33:24.446651 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-60b5e072-00a5-46e6-ac48-cb6afa554611 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:33:24.447286 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-60b5e072-00a5-46e6-ac48-cb6afa554611 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] [instance: 7a3c06ab-77fb-4b24-8913-f5514e2598cb] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:33:24.455012 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-60b5e072-00a5-46e6-ac48-cb6afa554611 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:33:24.455496 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-60b5e072-00a5-46e6-ac48-cb6afa554611 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:33:24.455930 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-60b5e072-00a5-46e6-ac48-cb6afa554611 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:33:24.456618 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-60b5e072-00a5-46e6-ac48-cb6afa554611 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:33:24.457073 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-60b5e072-00a5-46e6-ac48-cb6afa554611 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:33:24.457496 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-60b5e072-00a5-46e6-ac48-cb6afa554611 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:33:24.599860 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-60b5e072-00a5-46e6-ac48-cb6afa554611 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841e202efcb143cf93d6d9bb1f3edba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979814de519c46d08cd2301bf5d33eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:33:24.607639 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-60b5e072-00a5-46e6-ac48-cb6afa554611 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] 10.222.0.43 "GET /compute/v2.1/servers/7a3c06ab-77fb-4b24-8913-f5514e2598cb" status: 200 len: 1567 microversion: 2.1 time: 0.164966 Oct 04 23:33:24.608212 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3638/8095] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:33:24 2022] GET /compute/v2.1/servers/7a3c06ab-77fb-4b24-8913-f5514e2598cb => generated 1567 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:33:25.631318 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-f134f6b2-ba0f-436d-b92b-3edc9bb664bb tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:33:25.631976 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-f134f6b2-ba0f-436d-b92b-3edc9bb664bb tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] [instance: 7a3c06ab-77fb-4b24-8913-f5514e2598cb] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:33:25.638906 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f134f6b2-ba0f-436d-b92b-3edc9bb664bb tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:33:25.639418 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f134f6b2-ba0f-436d-b92b-3edc9bb664bb tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:33:25.639875 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f134f6b2-ba0f-436d-b92b-3edc9bb664bb tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:33:25.641110 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f134f6b2-ba0f-436d-b92b-3edc9bb664bb tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:33:25.641677 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f134f6b2-ba0f-436d-b92b-3edc9bb664bb tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:33:25.642128 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f134f6b2-ba0f-436d-b92b-3edc9bb664bb tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:33:25.787566 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-f134f6b2-ba0f-436d-b92b-3edc9bb664bb tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841e202efcb143cf93d6d9bb1f3edba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979814de519c46d08cd2301bf5d33eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:33:25.795526 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-f134f6b2-ba0f-436d-b92b-3edc9bb664bb tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] 10.222.0.43 "GET /compute/v2.1/servers/7a3c06ab-77fb-4b24-8913-f5514e2598cb" status: 200 len: 1567 microversion: 2.1 time: 0.168229 Oct 04 23:33:25.796126 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4458/8096] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:33:25 2022] GET /compute/v2.1/servers/7a3c06ab-77fb-4b24-8913-f5514e2598cb => generated 1567 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:33:26.819551 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-214ddea0-2caa-4f45-8afd-f79658971519 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:33:26.820089 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-214ddea0-2caa-4f45-8afd-f79658971519 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] [instance: 7a3c06ab-77fb-4b24-8913-f5514e2598cb] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:33:26.826876 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-214ddea0-2caa-4f45-8afd-f79658971519 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:33:26.827364 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-214ddea0-2caa-4f45-8afd-f79658971519 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:33:26.828409 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-214ddea0-2caa-4f45-8afd-f79658971519 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:33:26.829111 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-214ddea0-2caa-4f45-8afd-f79658971519 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:33:26.829572 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-214ddea0-2caa-4f45-8afd-f79658971519 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:33:26.830003 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-214ddea0-2caa-4f45-8afd-f79658971519 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:33:26.967771 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-214ddea0-2caa-4f45-8afd-f79658971519 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841e202efcb143cf93d6d9bb1f3edba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979814de519c46d08cd2301bf5d33eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:33:26.976094 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-214ddea0-2caa-4f45-8afd-f79658971519 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] 10.222.0.43 "GET /compute/v2.1/servers/7a3c06ab-77fb-4b24-8913-f5514e2598cb" status: 200 len: 1568 microversion: 2.1 time: 0.160542 Oct 04 23:33:26.976683 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3639/8097] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:33:26 2022] GET /compute/v2.1/servers/7a3c06ab-77fb-4b24-8913-f5514e2598cb => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:33:26.998871 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-bb0f8602-bc14-48ca-8fac-fab19972f326 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 23:33:27.000018 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-bb0f8602-bc14-48ca-8fac-fab19972f326 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] [instance: 7a3c06ab-77fb-4b24-8913-f5514e2598cb] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:33:27.006999 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bb0f8602-bc14-48ca-8fac-fab19972f326 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:33:27.007509 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bb0f8602-bc14-48ca-8fac-fab19972f326 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:33:27.007971 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bb0f8602-bc14-48ca-8fac-fab19972f326 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:33:27.008695 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bb0f8602-bc14-48ca-8fac-fab19972f326 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:33:27.009176 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bb0f8602-bc14-48ca-8fac-fab19972f326 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:33:27.009623 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bb0f8602-bc14-48ca-8fac-fab19972f326 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:33:27.042887 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-bb0f8602-bc14-48ca-8fac-fab19972f326 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] [instance: 7a3c06ab-77fb-4b24-8913-f5514e2598cb] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=134101) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 04 23:33:27.108614 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-bb0f8602-bc14-48ca-8fac-fab19972f326 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] 10.222.0.43 "POST /compute/v2.1/servers/7a3c06ab-77fb-4b24-8913-f5514e2598cb/action" status: 202 len: 0 microversion: 2.1 time: 0.114016 Oct 04 23:33:27.109397 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4459/8098] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 23:33:26 2022] POST /compute/v2.1/servers/7a3c06ab-77fb-4b24-8913-f5514e2598cb/action => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 23:33:27.117659 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-41a4f767-0ef8-4cb3-b9de-c179aa1097b4 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:33:27.118390 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-41a4f767-0ef8-4cb3-b9de-c179aa1097b4 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] [instance: 7a3c06ab-77fb-4b24-8913-f5514e2598cb] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:33:27.125447 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-41a4f767-0ef8-4cb3-b9de-c179aa1097b4 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:33:27.126273 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-41a4f767-0ef8-4cb3-b9de-c179aa1097b4 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:33:27.126804 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-41a4f767-0ef8-4cb3-b9de-c179aa1097b4 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:33:27.127589 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-41a4f767-0ef8-4cb3-b9de-c179aa1097b4 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:33:27.130459 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-41a4f767-0ef8-4cb3-b9de-c179aa1097b4 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:33:27.130459 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-41a4f767-0ef8-4cb3-b9de-c179aa1097b4 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:33:27.268915 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-41a4f767-0ef8-4cb3-b9de-c179aa1097b4 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841e202efcb143cf93d6d9bb1f3edba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979814de519c46d08cd2301bf5d33eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:33:27.276881 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-41a4f767-0ef8-4cb3-b9de-c179aa1097b4 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] 10.222.0.43 "GET /compute/v2.1/servers/7a3c06ab-77fb-4b24-8913-f5514e2598cb" status: 200 len: 1516 microversion: 2.1 time: 0.163213 Oct 04 23:33:27.277467 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3640/8099] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:33:27 2022] GET /compute/v2.1/servers/7a3c06ab-77fb-4b24-8913-f5514e2598cb => generated 1516 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:33:28.302562 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-b1befa88-eea7-4b54-bedc-32c8c87016f0 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:33:28.303193 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-b1befa88-eea7-4b54-bedc-32c8c87016f0 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] [instance: 7a3c06ab-77fb-4b24-8913-f5514e2598cb] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:33:28.309953 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b1befa88-eea7-4b54-bedc-32c8c87016f0 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:33:28.310489 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b1befa88-eea7-4b54-bedc-32c8c87016f0 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:33:28.310952 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b1befa88-eea7-4b54-bedc-32c8c87016f0 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:33:28.311668 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b1befa88-eea7-4b54-bedc-32c8c87016f0 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:33:28.312716 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b1befa88-eea7-4b54-bedc-32c8c87016f0 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:33:28.313519 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b1befa88-eea7-4b54-bedc-32c8c87016f0 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:33:28.447790 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-b1befa88-eea7-4b54-bedc-32c8c87016f0 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841e202efcb143cf93d6d9bb1f3edba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979814de519c46d08cd2301bf5d33eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:33:28.456674 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-b1befa88-eea7-4b54-bedc-32c8c87016f0 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] 10.222.0.43 "GET /compute/v2.1/servers/7a3c06ab-77fb-4b24-8913-f5514e2598cb" status: 200 len: 1518 microversion: 2.1 time: 0.159942 Oct 04 23:33:28.457260 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4460/8100] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:33:28 2022] GET /compute/v2.1/servers/7a3c06ab-77fb-4b24-8913-f5514e2598cb => generated 1518 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:33:29.432994 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-005287f3-5656-44cb-9738-d9c56b697cda req-71ad51e4-6b0f-46ae-9573-694b742a171d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a3c06ab-77fb-4b24-8913-f5514e2598cb", "name": "network-vif-unplugged", "status": "completed", "tag": "77e0c1ff-0437-4875-b013-302c6d326931"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 23:33:29.445725 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-005287f3-5656-44cb-9738-d9c56b697cda req-71ad51e4-6b0f-46ae-9573-694b742a171d service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:33:29.446406 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-005287f3-5656-44cb-9738-d9c56b697cda req-71ad51e4-6b0f-46ae-9573-694b742a171d service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:33:29.446911 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-005287f3-5656-44cb-9738-d9c56b697cda req-71ad51e4-6b0f-46ae-9573-694b742a171d service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:33:29.461555 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.compute.server_external_events [req-005287f3-5656-44cb-9738-d9c56b697cda req-71ad51e4-6b0f-46ae-9573-694b742a171d service nova] Unable to find a host for instance 7a3c06ab-77fb-4b24-8913-f5514e2598cb. Dropping event network-vif-unplugged {{(pid=134102) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 04 23:33:29.462746 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-005287f3-5656-44cb-9738-d9c56b697cda req-71ad51e4-6b0f-46ae-9573-694b742a171d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.092335 Oct 04 23:33:29.463549 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3641/8101] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 23:33:29 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 94 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 04 23:33:29.481046 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-312bbf5c-99ce-416c-85f6-804bf02bc0ff tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:33:29.481675 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-312bbf5c-99ce-416c-85f6-804bf02bc0ff tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] [instance: 7a3c06ab-77fb-4b24-8913-f5514e2598cb] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:33:29.489554 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-312bbf5c-99ce-416c-85f6-804bf02bc0ff tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:33:29.490073 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-312bbf5c-99ce-416c-85f6-804bf02bc0ff tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:33:29.490578 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-312bbf5c-99ce-416c-85f6-804bf02bc0ff tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:33:29.491305 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-312bbf5c-99ce-416c-85f6-804bf02bc0ff tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:33:29.491785 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-312bbf5c-99ce-416c-85f6-804bf02bc0ff tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:33:29.492236 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-312bbf5c-99ce-416c-85f6-804bf02bc0ff tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:33:29.632394 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-312bbf5c-99ce-416c-85f6-804bf02bc0ff tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841e202efcb143cf93d6d9bb1f3edba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979814de519c46d08cd2301bf5d33eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:33:29.640454 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-312bbf5c-99ce-416c-85f6-804bf02bc0ff tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] 10.222.0.43 "GET /compute/v2.1/servers/7a3c06ab-77fb-4b24-8913-f5514e2598cb" status: 200 len: 1518 microversion: 2.1 time: 0.163295 Oct 04 23:33:29.640986 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4461/8102] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:33:29 2022] GET /compute/v2.1/servers/7a3c06ab-77fb-4b24-8913-f5514e2598cb => generated 1518 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:33:30.664072 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-53440c84-d23a-42a2-b9c2-d3d68d29cfd4 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:33:30.664700 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-53440c84-d23a-42a2-b9c2-d3d68d29cfd4 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] [instance: 7a3c06ab-77fb-4b24-8913-f5514e2598cb] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:33:30.672218 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-53440c84-d23a-42a2-b9c2-d3d68d29cfd4 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:33:30.672709 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-53440c84-d23a-42a2-b9c2-d3d68d29cfd4 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:33:30.673152 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-53440c84-d23a-42a2-b9c2-d3d68d29cfd4 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:33:30.673859 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-53440c84-d23a-42a2-b9c2-d3d68d29cfd4 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:33:30.674326 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-53440c84-d23a-42a2-b9c2-d3d68d29cfd4 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:33:30.674789 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-53440c84-d23a-42a2-b9c2-d3d68d29cfd4 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:33:30.810338 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-53440c84-d23a-42a2-b9c2-d3d68d29cfd4 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841e202efcb143cf93d6d9bb1f3edba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979814de519c46d08cd2301bf5d33eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:33:30.820074 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-53440c84-d23a-42a2-b9c2-d3d68d29cfd4 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] 10.222.0.43 "GET /compute/v2.1/servers/7a3c06ab-77fb-4b24-8913-f5514e2598cb" status: 200 len: 1518 microversion: 2.1 time: 0.159975 Oct 04 23:33:30.821482 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3642/8103] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:33:30 2022] GET /compute/v2.1/servers/7a3c06ab-77fb-4b24-8913-f5514e2598cb => generated 1518 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:33:31.845369 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-50997c51-8810-4a6b-a13a-9027d0be20bf tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:33:31.845996 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-50997c51-8810-4a6b-a13a-9027d0be20bf tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] [instance: 7a3c06ab-77fb-4b24-8913-f5514e2598cb] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:33:31.853122 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-50997c51-8810-4a6b-a13a-9027d0be20bf tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:33:31.853616 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-50997c51-8810-4a6b-a13a-9027d0be20bf tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:33:31.854071 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-50997c51-8810-4a6b-a13a-9027d0be20bf tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:33:31.854807 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-50997c51-8810-4a6b-a13a-9027d0be20bf tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:33:31.855274 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-50997c51-8810-4a6b-a13a-9027d0be20bf tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:33:31.855714 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-50997c51-8810-4a6b-a13a-9027d0be20bf tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:33:31.989794 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-50997c51-8810-4a6b-a13a-9027d0be20bf tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841e202efcb143cf93d6d9bb1f3edba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979814de519c46d08cd2301bf5d33eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:33:31.997973 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-50997c51-8810-4a6b-a13a-9027d0be20bf tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] 10.222.0.43 "GET /compute/v2.1/servers/7a3c06ab-77fb-4b24-8913-f5514e2598cb" status: 200 len: 1518 microversion: 2.1 time: 0.157188 Oct 04 23:33:31.998488 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4462/8104] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:33:31 2022] GET /compute/v2.1/servers/7a3c06ab-77fb-4b24-8913-f5514e2598cb => generated 1518 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:33:33.021829 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-3cbe41a3-c606-4c9c-9939-4dee65f16270 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:33:33.022617 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-3cbe41a3-c606-4c9c-9939-4dee65f16270 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] [instance: 7a3c06ab-77fb-4b24-8913-f5514e2598cb] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:33:33.029516 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3cbe41a3-c606-4c9c-9939-4dee65f16270 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:33:33.030009 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3cbe41a3-c606-4c9c-9939-4dee65f16270 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:33:33.030548 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3cbe41a3-c606-4c9c-9939-4dee65f16270 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:33:33.031418 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3cbe41a3-c606-4c9c-9939-4dee65f16270 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:33:33.031883 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3cbe41a3-c606-4c9c-9939-4dee65f16270 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:33:33.032318 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3cbe41a3-c606-4c9c-9939-4dee65f16270 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:33:33.161993 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-3cbe41a3-c606-4c9c-9939-4dee65f16270 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841e202efcb143cf93d6d9bb1f3edba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979814de519c46d08cd2301bf5d33eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:33:33.170606 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-3cbe41a3-c606-4c9c-9939-4dee65f16270 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] 10.222.0.43 "GET /compute/v2.1/servers/7a3c06ab-77fb-4b24-8913-f5514e2598cb" status: 200 len: 1574 microversion: 2.1 time: 0.151974 Oct 04 23:33:33.171654 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3643/8105] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:33:33 2022] GET /compute/v2.1/servers/7a3c06ab-77fb-4b24-8913-f5514e2598cb => generated 1574 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:33:34.138785 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-45c24619-292e-4727-ba4d-6a0ed74bc20d req-43df138c-d5f3-405a-8bb8-4d524c369661 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a3c06ab-77fb-4b24-8913-f5514e2598cb", "tag": "77e0c1ff-0437-4875-b013-302c6d326931"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 23:33:34.149568 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-45c24619-292e-4727-ba4d-6a0ed74bc20d req-43df138c-d5f3-405a-8bb8-4d524c369661 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:33:34.150067 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-45c24619-292e-4727-ba4d-6a0ed74bc20d req-43df138c-d5f3-405a-8bb8-4d524c369661 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:33:34.150555 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-45c24619-292e-4727-ba4d-6a0ed74bc20d req-43df138c-d5f3-405a-8bb8-4d524c369661 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:33:34.163555 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-45c24619-292e-4727-ba4d-6a0ed74bc20d req-43df138c-d5f3-405a-8bb8-4d524c369661 service nova] Creating event network-changed:77e0c1ff-0437-4875-b013-302c6d326931 for instance 7a3c06ab-77fb-4b24-8913-f5514e2598cb on n-h2-860284-1 Oct 04 23:33:34.168746 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-45c24619-292e-4727-ba4d-6a0ed74bc20d req-43df138c-d5f3-405a-8bb8-4d524c369661 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085101 Oct 04 23:33:34.169572 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4463/8106] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 23:33:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 23:33:34.195587 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-531f0a49-7e65-4b6a-91e7-c932b01a1095 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:33:34.196219 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-531f0a49-7e65-4b6a-91e7-c932b01a1095 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] [instance: 7a3c06ab-77fb-4b24-8913-f5514e2598cb] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:33:34.203689 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-531f0a49-7e65-4b6a-91e7-c932b01a1095 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:33:34.204187 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-531f0a49-7e65-4b6a-91e7-c932b01a1095 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:33:34.204667 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-531f0a49-7e65-4b6a-91e7-c932b01a1095 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:33:34.205395 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-531f0a49-7e65-4b6a-91e7-c932b01a1095 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:33:34.205869 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-531f0a49-7e65-4b6a-91e7-c932b01a1095 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:33:34.206295 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-531f0a49-7e65-4b6a-91e7-c932b01a1095 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:33:34.353435 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-531f0a49-7e65-4b6a-91e7-c932b01a1095 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841e202efcb143cf93d6d9bb1f3edba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979814de519c46d08cd2301bf5d33eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:33:34.362213 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-531f0a49-7e65-4b6a-91e7-c932b01a1095 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] 10.222.0.43 "GET /compute/v2.1/servers/7a3c06ab-77fb-4b24-8913-f5514e2598cb" status: 200 len: 1574 microversion: 2.1 time: 0.170564 Oct 04 23:33:34.362870 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3644/8107] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:33:34 2022] GET /compute/v2.1/servers/7a3c06ab-77fb-4b24-8913-f5514e2598cb => generated 1574 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:33:35.386701 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-0ad0b34c-18ff-4cba-b73c-fb638d14b304 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:33:35.387345 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-0ad0b34c-18ff-4cba-b73c-fb638d14b304 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] [instance: 7a3c06ab-77fb-4b24-8913-f5514e2598cb] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:33:35.394053 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0ad0b34c-18ff-4cba-b73c-fb638d14b304 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:33:35.394594 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0ad0b34c-18ff-4cba-b73c-fb638d14b304 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:33:35.395049 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0ad0b34c-18ff-4cba-b73c-fb638d14b304 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:33:35.395746 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0ad0b34c-18ff-4cba-b73c-fb638d14b304 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:33:35.396213 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0ad0b34c-18ff-4cba-b73c-fb638d14b304 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:33:35.396651 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-0ad0b34c-18ff-4cba-b73c-fb638d14b304 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:33:35.536595 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-0ad0b34c-18ff-4cba-b73c-fb638d14b304 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841e202efcb143cf93d6d9bb1f3edba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979814de519c46d08cd2301bf5d33eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:33:35.544550 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-0ad0b34c-18ff-4cba-b73c-fb638d14b304 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] 10.222.0.43 "GET /compute/v2.1/servers/7a3c06ab-77fb-4b24-8913-f5514e2598cb" status: 200 len: 1574 microversion: 2.1 time: 0.163207 Oct 04 23:33:35.545135 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4464/8108] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:33:35 2022] GET /compute/v2.1/servers/7a3c06ab-77fb-4b24-8913-f5514e2598cb => generated 1574 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:33:36.568065 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-3fd2a77c-febd-483e-bfcd-1c511a717391 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:33:36.568708 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-3fd2a77c-febd-483e-bfcd-1c511a717391 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] [instance: 7a3c06ab-77fb-4b24-8913-f5514e2598cb] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:33:36.575608 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3fd2a77c-febd-483e-bfcd-1c511a717391 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:33:36.576102 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3fd2a77c-febd-483e-bfcd-1c511a717391 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:33:36.576571 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3fd2a77c-febd-483e-bfcd-1c511a717391 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:33:36.577570 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3fd2a77c-febd-483e-bfcd-1c511a717391 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:33:36.578263 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3fd2a77c-febd-483e-bfcd-1c511a717391 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:33:36.578774 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3fd2a77c-febd-483e-bfcd-1c511a717391 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:33:36.711259 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-3fd2a77c-febd-483e-bfcd-1c511a717391 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841e202efcb143cf93d6d9bb1f3edba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979814de519c46d08cd2301bf5d33eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:33:36.719554 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-3fd2a77c-febd-483e-bfcd-1c511a717391 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] 10.222.0.43 "GET /compute/v2.1/servers/7a3c06ab-77fb-4b24-8913-f5514e2598cb" status: 200 len: 1574 microversion: 2.1 time: 0.155916 Oct 04 23:33:36.720171 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3645/8109] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:33:36 2022] GET /compute/v2.1/servers/7a3c06ab-77fb-4b24-8913-f5514e2598cb => generated 1574 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:33:37.743376 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-59dc9050-775f-4765-86f4-c54c0dcb5553 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:33:37.744015 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-59dc9050-775f-4765-86f4-c54c0dcb5553 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] [instance: 7a3c06ab-77fb-4b24-8913-f5514e2598cb] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:33:37.751620 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-59dc9050-775f-4765-86f4-c54c0dcb5553 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:33:37.752129 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-59dc9050-775f-4765-86f4-c54c0dcb5553 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:33:37.752594 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-59dc9050-775f-4765-86f4-c54c0dcb5553 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:33:37.753316 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-59dc9050-775f-4765-86f4-c54c0dcb5553 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:33:37.753800 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-59dc9050-775f-4765-86f4-c54c0dcb5553 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:33:37.754229 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-59dc9050-775f-4765-86f4-c54c0dcb5553 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:33:37.888885 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-59dc9050-775f-4765-86f4-c54c0dcb5553 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841e202efcb143cf93d6d9bb1f3edba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979814de519c46d08cd2301bf5d33eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:33:37.897120 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-59dc9050-775f-4765-86f4-c54c0dcb5553 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] 10.222.0.43 "GET /compute/v2.1/servers/7a3c06ab-77fb-4b24-8913-f5514e2598cb" status: 200 len: 1574 microversion: 2.1 time: 0.157747 Oct 04 23:33:37.897715 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4465/8110] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:33:37 2022] GET /compute/v2.1/servers/7a3c06ab-77fb-4b24-8913-f5514e2598cb => generated 1574 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:33:38.921116 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-d8ace284-206c-41f3-99bb-2a7311efd5df tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:33:38.921668 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-d8ace284-206c-41f3-99bb-2a7311efd5df tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] [instance: 7a3c06ab-77fb-4b24-8913-f5514e2598cb] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:33:38.928739 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d8ace284-206c-41f3-99bb-2a7311efd5df tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:33:38.929226 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d8ace284-206c-41f3-99bb-2a7311efd5df tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:33:38.929699 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d8ace284-206c-41f3-99bb-2a7311efd5df tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:33:38.930441 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d8ace284-206c-41f3-99bb-2a7311efd5df tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:33:38.930902 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d8ace284-206c-41f3-99bb-2a7311efd5df tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:33:38.931334 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d8ace284-206c-41f3-99bb-2a7311efd5df tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:33:39.068932 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-d8ace284-206c-41f3-99bb-2a7311efd5df tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841e202efcb143cf93d6d9bb1f3edba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979814de519c46d08cd2301bf5d33eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:33:39.076823 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-d8ace284-206c-41f3-99bb-2a7311efd5df tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] 10.222.0.43 "GET /compute/v2.1/servers/7a3c06ab-77fb-4b24-8913-f5514e2598cb" status: 200 len: 1574 microversion: 2.1 time: 0.159760 Oct 04 23:33:39.077416 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3646/8111] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:33:38 2022] GET /compute/v2.1/servers/7a3c06ab-77fb-4b24-8913-f5514e2598cb => generated 1574 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:33:40.100783 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-a878408d-e4ff-4b4f-88f9-a248b563f8be tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:33:40.101418 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-a878408d-e4ff-4b4f-88f9-a248b563f8be tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] [instance: 7a3c06ab-77fb-4b24-8913-f5514e2598cb] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:33:40.108327 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a878408d-e4ff-4b4f-88f9-a248b563f8be tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:33:40.108836 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a878408d-e4ff-4b4f-88f9-a248b563f8be tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:33:40.109307 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a878408d-e4ff-4b4f-88f9-a248b563f8be tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:33:40.110040 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a878408d-e4ff-4b4f-88f9-a248b563f8be tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:33:40.110588 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a878408d-e4ff-4b4f-88f9-a248b563f8be tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:33:40.111046 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-a878408d-e4ff-4b4f-88f9-a248b563f8be tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:33:40.115115 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:33:40.253837 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-a878408d-e4ff-4b4f-88f9-a248b563f8be tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841e202efcb143cf93d6d9bb1f3edba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979814de519c46d08cd2301bf5d33eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:33:40.261587 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-a878408d-e4ff-4b4f-88f9-a248b563f8be tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] 10.222.0.43 "GET /compute/v2.1/servers/7a3c06ab-77fb-4b24-8913-f5514e2598cb" status: 200 len: 1574 microversion: 2.1 time: 0.165036 Oct 04 23:33:40.262167 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4466/8112] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:33:40 2022] GET /compute/v2.1/servers/7a3c06ab-77fb-4b24-8913-f5514e2598cb => generated 1574 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:33:41.286030 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-66c9079d-cb23-4c53-9230-5f502194b93e tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:33:41.286721 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-66c9079d-cb23-4c53-9230-5f502194b93e tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] [instance: 7a3c06ab-77fb-4b24-8913-f5514e2598cb] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:33:41.294052 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-66c9079d-cb23-4c53-9230-5f502194b93e tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:33:41.294594 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-66c9079d-cb23-4c53-9230-5f502194b93e tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:33:41.295042 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-66c9079d-cb23-4c53-9230-5f502194b93e tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:33:41.295756 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-66c9079d-cb23-4c53-9230-5f502194b93e tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:33:41.296228 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-66c9079d-cb23-4c53-9230-5f502194b93e tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:33:41.297194 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-66c9079d-cb23-4c53-9230-5f502194b93e tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:33:41.430204 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-66c9079d-cb23-4c53-9230-5f502194b93e tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841e202efcb143cf93d6d9bb1f3edba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979814de519c46d08cd2301bf5d33eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:33:41.438122 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-66c9079d-cb23-4c53-9230-5f502194b93e tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] 10.222.0.43 "GET /compute/v2.1/servers/7a3c06ab-77fb-4b24-8913-f5514e2598cb" status: 200 len: 1574 microversion: 2.1 time: 0.157485 Oct 04 23:33:41.438777 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3647/8113] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:33:41 2022] GET /compute/v2.1/servers/7a3c06ab-77fb-4b24-8913-f5514e2598cb => generated 1574 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:33:42.461226 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-bf7a48f2-e39a-41d0-8387-262648837d82 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:33:42.461869 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-bf7a48f2-e39a-41d0-8387-262648837d82 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] [instance: 7a3c06ab-77fb-4b24-8913-f5514e2598cb] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:33:42.468746 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bf7a48f2-e39a-41d0-8387-262648837d82 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:33:42.469802 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bf7a48f2-e39a-41d0-8387-262648837d82 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:33:42.470293 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bf7a48f2-e39a-41d0-8387-262648837d82 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:33:42.471054 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bf7a48f2-e39a-41d0-8387-262648837d82 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:33:42.471535 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bf7a48f2-e39a-41d0-8387-262648837d82 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:33:42.471984 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-bf7a48f2-e39a-41d0-8387-262648837d82 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:33:42.603241 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-bf7a48f2-e39a-41d0-8387-262648837d82 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841e202efcb143cf93d6d9bb1f3edba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979814de519c46d08cd2301bf5d33eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:33:42.613258 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-bf7a48f2-e39a-41d0-8387-262648837d82 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] 10.222.0.43 "GET /compute/v2.1/servers/7a3c06ab-77fb-4b24-8913-f5514e2598cb" status: 200 len: 1574 microversion: 2.1 time: 0.155990 Oct 04 23:33:42.613861 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4467/8114] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:33:42 2022] GET /compute/v2.1/servers/7a3c06ab-77fb-4b24-8913-f5514e2598cb => generated 1574 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:33:43.637148 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-59378dea-8442-4686-b000-1388cafb0477 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:33:43.637769 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-59378dea-8442-4686-b000-1388cafb0477 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] [instance: 7a3c06ab-77fb-4b24-8913-f5514e2598cb] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:33:43.640517 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_api:SELECT=31 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:33:43.646408 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-59378dea-8442-4686-b000-1388cafb0477 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:33:43.646912 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-59378dea-8442-4686-b000-1388cafb0477 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:33:43.647359 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-59378dea-8442-4686-b000-1388cafb0477 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:33:43.648065 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-59378dea-8442-4686-b000-1388cafb0477 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:33:43.648529 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-59378dea-8442-4686-b000-1388cafb0477 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:33:43.648966 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-59378dea-8442-4686-b000-1388cafb0477 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:33:43.653013 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=87 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:33:43.782258 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-59378dea-8442-4686-b000-1388cafb0477 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841e202efcb143cf93d6d9bb1f3edba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979814de519c46d08cd2301bf5d33eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:33:43.790194 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-59378dea-8442-4686-b000-1388cafb0477 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] 10.222.0.43 "GET /compute/v2.1/servers/7a3c06ab-77fb-4b24-8913-f5514e2598cb" status: 200 len: 1574 microversion: 2.1 time: 0.156987 Oct 04 23:33:43.790809 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3648/8115] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:33:43 2022] GET /compute/v2.1/servers/7a3c06ab-77fb-4b24-8913-f5514e2598cb => generated 1574 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:33:44.815808 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-8ecac873-aa02-4111-9070-70aa63719838 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:33:44.816546 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-8ecac873-aa02-4111-9070-70aa63719838 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] [instance: 7a3c06ab-77fb-4b24-8913-f5514e2598cb] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:33:44.819871 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:33:44.824460 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8ecac873-aa02-4111-9070-70aa63719838 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:33:44.825187 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8ecac873-aa02-4111-9070-70aa63719838 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:33:44.825827 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8ecac873-aa02-4111-9070-70aa63719838 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:33:44.826749 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8ecac873-aa02-4111-9070-70aa63719838 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:33:44.827391 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8ecac873-aa02-4111-9070-70aa63719838 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:33:44.828027 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-8ecac873-aa02-4111-9070-70aa63719838 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:33:44.982107 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-8ecac873-aa02-4111-9070-70aa63719838 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841e202efcb143cf93d6d9bb1f3edba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979814de519c46d08cd2301bf5d33eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:33:44.990561 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-8ecac873-aa02-4111-9070-70aa63719838 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] 10.222.0.43 "GET /compute/v2.1/servers/7a3c06ab-77fb-4b24-8913-f5514e2598cb" status: 200 len: 1574 microversion: 2.1 time: 0.179917 Oct 04 23:33:44.991161 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4468/8116] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:33:44 2022] GET /compute/v2.1/servers/7a3c06ab-77fb-4b24-8913-f5514e2598cb => generated 1574 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 23:33:46.013999 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-c261a986-3463-4ddb-94ee-84d4a26bb6f6 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:33:46.014640 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-c261a986-3463-4ddb-94ee-84d4a26bb6f6 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] [instance: 7a3c06ab-77fb-4b24-8913-f5514e2598cb] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:33:46.021686 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c261a986-3463-4ddb-94ee-84d4a26bb6f6 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:33:46.022167 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c261a986-3463-4ddb-94ee-84d4a26bb6f6 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:33:46.022626 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c261a986-3463-4ddb-94ee-84d4a26bb6f6 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:33:46.023309 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c261a986-3463-4ddb-94ee-84d4a26bb6f6 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:33:46.023763 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c261a986-3463-4ddb-94ee-84d4a26bb6f6 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:33:46.024187 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c261a986-3463-4ddb-94ee-84d4a26bb6f6 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:33:46.162007 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-c261a986-3463-4ddb-94ee-84d4a26bb6f6 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841e202efcb143cf93d6d9bb1f3edba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979814de519c46d08cd2301bf5d33eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:33:46.172356 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-c261a986-3463-4ddb-94ee-84d4a26bb6f6 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] 10.222.0.43 "GET /compute/v2.1/servers/7a3c06ab-77fb-4b24-8913-f5514e2598cb" status: 200 len: 1574 microversion: 2.1 time: 0.162048 Oct 04 23:33:46.172870 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3649/8117] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:33:46 2022] GET /compute/v2.1/servers/7a3c06ab-77fb-4b24-8913-f5514e2598cb => generated 1574 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:33:46.939935 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-3265fdf2-8381-4048-8209-ec2dc5b106fe req-d5fca9a5-dc4c-443f-9c9f-8b960b865ba0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a3c06ab-77fb-4b24-8913-f5514e2598cb", "name": "network-vif-plugged", "status": "completed", "tag": "77e0c1ff-0437-4875-b013-302c6d326931"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 23:33:46.950830 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-3265fdf2-8381-4048-8209-ec2dc5b106fe req-d5fca9a5-dc4c-443f-9c9f-8b960b865ba0 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:33:46.951323 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-3265fdf2-8381-4048-8209-ec2dc5b106fe req-d5fca9a5-dc4c-443f-9c9f-8b960b865ba0 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:33:46.951767 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-3265fdf2-8381-4048-8209-ec2dc5b106fe req-d5fca9a5-dc4c-443f-9c9f-8b960b865ba0 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:33:46.963350 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-3265fdf2-8381-4048-8209-ec2dc5b106fe req-d5fca9a5-dc4c-443f-9c9f-8b960b865ba0 service nova] Creating event network-vif-plugged:77e0c1ff-0437-4875-b013-302c6d326931 for instance 7a3c06ab-77fb-4b24-8913-f5514e2598cb on n-h2-860284-1 Oct 04 23:33:46.968426 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-3265fdf2-8381-4048-8209-ec2dc5b106fe req-d5fca9a5-dc4c-443f-9c9f-8b960b865ba0 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032983 Oct 04 23:33:46.969715 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4469/8118] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 23:33:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 23:33:47.199724 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-db77e914-1323-492f-98a6-5833dba5c00e tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:33:47.200502 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-db77e914-1323-492f-98a6-5833dba5c00e tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] [instance: 7a3c06ab-77fb-4b24-8913-f5514e2598cb] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:33:47.208047 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-db77e914-1323-492f-98a6-5833dba5c00e tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:33:47.208539 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-db77e914-1323-492f-98a6-5833dba5c00e tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:33:47.208984 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-db77e914-1323-492f-98a6-5833dba5c00e tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:33:47.209690 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-db77e914-1323-492f-98a6-5833dba5c00e tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:33:47.210157 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-db77e914-1323-492f-98a6-5833dba5c00e tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:33:47.210628 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-db77e914-1323-492f-98a6-5833dba5c00e tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:33:47.344028 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-db77e914-1323-492f-98a6-5833dba5c00e tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841e202efcb143cf93d6d9bb1f3edba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979814de519c46d08cd2301bf5d33eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:33:47.352893 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-db77e914-1323-492f-98a6-5833dba5c00e tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] 10.222.0.43 "GET /compute/v2.1/servers/7a3c06ab-77fb-4b24-8913-f5514e2598cb" status: 200 len: 1574 microversion: 2.1 time: 0.157156 Oct 04 23:33:47.353479 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3650/8119] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:33:47 2022] GET /compute/v2.1/servers/7a3c06ab-77fb-4b24-8913-f5514e2598cb => generated 1574 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:33:48.381087 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-98af6d21-928e-4224-90ee-ef3d28036503 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:33:48.381800 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-98af6d21-928e-4224-90ee-ef3d28036503 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] [instance: 7a3c06ab-77fb-4b24-8913-f5514e2598cb] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:33:48.388027 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-98af6d21-928e-4224-90ee-ef3d28036503 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:33:48.388523 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-98af6d21-928e-4224-90ee-ef3d28036503 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:33:48.388984 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-98af6d21-928e-4224-90ee-ef3d28036503 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:33:48.389689 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-98af6d21-928e-4224-90ee-ef3d28036503 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:33:48.390156 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-98af6d21-928e-4224-90ee-ef3d28036503 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:33:48.390627 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-98af6d21-928e-4224-90ee-ef3d28036503 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:33:48.529138 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-98af6d21-928e-4224-90ee-ef3d28036503 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841e202efcb143cf93d6d9bb1f3edba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979814de519c46d08cd2301bf5d33eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:33:48.537982 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-98af6d21-928e-4224-90ee-ef3d28036503 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] 10.222.0.43 "GET /compute/v2.1/servers/7a3c06ab-77fb-4b24-8913-f5514e2598cb" status: 200 len: 1574 microversion: 2.1 time: 0.163014 Oct 04 23:33:48.538804 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4470/8120] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:33:48 2022] GET /compute/v2.1/servers/7a3c06ab-77fb-4b24-8913-f5514e2598cb => generated 1574 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:33:49.563059 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-c9b91ae1-1169-4c51-adf5-878f0f53f154 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:33:49.563842 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-c9b91ae1-1169-4c51-adf5-878f0f53f154 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] [instance: 7a3c06ab-77fb-4b24-8913-f5514e2598cb] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:33:49.570760 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c9b91ae1-1169-4c51-adf5-878f0f53f154 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:33:49.571243 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c9b91ae1-1169-4c51-adf5-878f0f53f154 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:33:49.571679 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c9b91ae1-1169-4c51-adf5-878f0f53f154 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:33:49.572373 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c9b91ae1-1169-4c51-adf5-878f0f53f154 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:33:49.572826 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c9b91ae1-1169-4c51-adf5-878f0f53f154 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:33:49.573248 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c9b91ae1-1169-4c51-adf5-878f0f53f154 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:33:49.711668 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-c9b91ae1-1169-4c51-adf5-878f0f53f154 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841e202efcb143cf93d6d9bb1f3edba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979814de519c46d08cd2301bf5d33eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:33:49.719498 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-c9b91ae1-1169-4c51-adf5-878f0f53f154 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] 10.222.0.43 "GET /compute/v2.1/servers/7a3c06ab-77fb-4b24-8913-f5514e2598cb" status: 200 len: 1561 microversion: 2.1 time: 0.160319 Oct 04 23:33:49.720768 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3651/8121] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:33:49 2022] GET /compute/v2.1/servers/7a3c06ab-77fb-4b24-8913-f5514e2598cb => generated 1561 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:35:03.525677 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=5 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:35:03.526965 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=24 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:35:03.528214 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_api:SELECT=7 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:35:03.529269 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=23 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:35:03.530300 n-d-860284-1 devstack@n-api.service[134102]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 23:35:03.530503 n-d-860284-1 devstack@n-api.service[134102]: Tue Oct 4 23:35:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.43) !!! Oct 04 23:35:03.532312 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-2f747be7-c9b4-4a12-a912-fe29711a8417 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:35:03.532871 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-2f747be7-c9b4-4a12-a912-fe29711a8417 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] [instance: 7a3c06ab-77fb-4b24-8913-f5514e2598cb] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:35:03.541625 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-bcda5328-d99c-43d5-8e25-ba69cbcf6155 req-2131b693-745a-494b-80a3-dec55c362807 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a3c06ab-77fb-4b24-8913-f5514e2598cb", "tag": "77e0c1ff-0437-4875-b013-302c6d326931"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 23:35:03.542345 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2f747be7-c9b4-4a12-a912-fe29711a8417 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:35:03.542898 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2f747be7-c9b4-4a12-a912-fe29711a8417 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:35:03.543421 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2f747be7-c9b4-4a12-a912-fe29711a8417 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:35:03.544195 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2f747be7-c9b4-4a12-a912-fe29711a8417 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:35:03.544704 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2f747be7-c9b4-4a12-a912-fe29711a8417 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:35:03.545155 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2f747be7-c9b4-4a12-a912-fe29711a8417 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:35:03.551805 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-bcda5328-d99c-43d5-8e25-ba69cbcf6155 req-2131b693-745a-494b-80a3-dec55c362807 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:35:03.552520 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-bcda5328-d99c-43d5-8e25-ba69cbcf6155 req-2131b693-745a-494b-80a3-dec55c362807 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:35:03.553177 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-bcda5328-d99c-43d5-8e25-ba69cbcf6155 req-2131b693-745a-494b-80a3-dec55c362807 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:35:03.568328 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-bcda5328-d99c-43d5-8e25-ba69cbcf6155 req-2131b693-745a-494b-80a3-dec55c362807 service nova] Creating event network-changed:77e0c1ff-0437-4875-b013-302c6d326931 for instance 7a3c06ab-77fb-4b24-8913-f5514e2598cb on n-h2-860284-1 Oct 04 23:35:03.574878 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-bcda5328-d99c-43d5-8e25-ba69cbcf6155 req-2131b693-745a-494b-80a3-dec55c362807 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049071 Oct 04 23:35:03.575072 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-2f747be7-c9b4-4a12-a912-fe29711a8417 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] [instance: 7a3c06ab-77fb-4b24-8913-f5514e2598cb] Going to try to terminate instance {{(pid=134101) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 23:35:03.575708 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3652/8122] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 23:35:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 23:35:03.668117 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-2f747be7-c9b4-4a12-a912-fe29711a8417 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] 10.222.0.43 "DELETE /compute/v2.1/servers/7a3c06ab-77fb-4b24-8913-f5514e2598cb" status: 204 len: 0 microversion: 2.1 time: 0.144239 Oct 04 23:35:03.669079 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4471/8123] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 23:35:03 2022] DELETE /compute/v2.1/servers/7a3c06ab-77fb-4b24-8913-f5514e2598cb => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 23:35:03.678201 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-24995686-c7d2-4fdb-9d63-daa382d53bf4 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:35:03.679254 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-24995686-c7d2-4fdb-9d63-daa382d53bf4 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] [instance: 7a3c06ab-77fb-4b24-8913-f5514e2598cb] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:35:03.686445 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-24995686-c7d2-4fdb-9d63-daa382d53bf4 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:35:03.687218 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-24995686-c7d2-4fdb-9d63-daa382d53bf4 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:35:03.687674 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-24995686-c7d2-4fdb-9d63-daa382d53bf4 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:35:03.688390 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-24995686-c7d2-4fdb-9d63-daa382d53bf4 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:35:03.689067 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-24995686-c7d2-4fdb-9d63-daa382d53bf4 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:35:03.690418 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-24995686-c7d2-4fdb-9d63-daa382d53bf4 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:35:03.833579 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-24995686-c7d2-4fdb-9d63-daa382d53bf4 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841e202efcb143cf93d6d9bb1f3edba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979814de519c46d08cd2301bf5d33eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:35:03.842140 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-24995686-c7d2-4fdb-9d63-daa382d53bf4 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] 10.222.0.43 "GET /compute/v2.1/servers/7a3c06ab-77fb-4b24-8913-f5514e2598cb" status: 200 len: 1567 microversion: 2.1 time: 0.168632 Oct 04 23:35:03.842883 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3653/8124] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:35:03 2022] GET /compute/v2.1/servers/7a3c06ab-77fb-4b24-8913-f5514e2598cb => generated 1567 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:35:04.868662 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-9d130131-8e1c-439b-a137-13ddbb10d86c tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:35:04.869392 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-9d130131-8e1c-439b-a137-13ddbb10d86c tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] [instance: 7a3c06ab-77fb-4b24-8913-f5514e2598cb] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:35:04.876340 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9d130131-8e1c-439b-a137-13ddbb10d86c tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:35:04.876838 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9d130131-8e1c-439b-a137-13ddbb10d86c tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:35:04.877289 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9d130131-8e1c-439b-a137-13ddbb10d86c tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:35:04.878001 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9d130131-8e1c-439b-a137-13ddbb10d86c tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:35:04.878502 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9d130131-8e1c-439b-a137-13ddbb10d86c tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:35:04.878946 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9d130131-8e1c-439b-a137-13ddbb10d86c tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:35:05.072932 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-9d130131-8e1c-439b-a137-13ddbb10d86c tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841e202efcb143cf93d6d9bb1f3edba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979814de519c46d08cd2301bf5d33eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:35:05.080833 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-9d130131-8e1c-439b-a137-13ddbb10d86c tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] 10.222.0.43 "GET /compute/v2.1/servers/7a3c06ab-77fb-4b24-8913-f5514e2598cb" status: 200 len: 1567 microversion: 2.1 time: 0.217129 Oct 04 23:35:05.081422 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4472/8125] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:35:04 2022] GET /compute/v2.1/servers/7a3c06ab-77fb-4b24-8913-f5514e2598cb => generated 1567 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:35:05.986010 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-0424cf03-bbc6-4cc0-8946-00cf21f7e479 req-02b2ecb9-e277-4e9b-ad3b-b7517a722a08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a3c06ab-77fb-4b24-8913-f5514e2598cb", "name": "network-vif-deleted", "tag": "77e0c1ff-0437-4875-b013-302c6d326931"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 23:35:05.997433 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-0424cf03-bbc6-4cc0-8946-00cf21f7e479 req-02b2ecb9-e277-4e9b-ad3b-b7517a722a08 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:35:05.997910 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-0424cf03-bbc6-4cc0-8946-00cf21f7e479 req-02b2ecb9-e277-4e9b-ad3b-b7517a722a08 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:35:05.998341 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-0424cf03-bbc6-4cc0-8946-00cf21f7e479 req-02b2ecb9-e277-4e9b-ad3b-b7517a722a08 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:35:06.010746 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-0424cf03-bbc6-4cc0-8946-00cf21f7e479 req-02b2ecb9-e277-4e9b-ad3b-b7517a722a08 service nova] Creating event network-vif-deleted:77e0c1ff-0437-4875-b013-302c6d326931 for instance 7a3c06ab-77fb-4b24-8913-f5514e2598cb on n-h2-860284-1 Oct 04 23:35:06.016202 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-0424cf03-bbc6-4cc0-8946-00cf21f7e479 req-02b2ecb9-e277-4e9b-ad3b-b7517a722a08 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033778 Oct 04 23:35:06.016817 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3654/8126] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 23:35:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 23:35:06.105365 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-e567e2e4-3843-4907-8528-1388bb92bc82 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:35:06.106032 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-e567e2e4-3843-4907-8528-1388bb92bc82 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] [instance: 7a3c06ab-77fb-4b24-8913-f5514e2598cb] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:35:06.113303 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e567e2e4-3843-4907-8528-1388bb92bc82 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:35:06.113739 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e567e2e4-3843-4907-8528-1388bb92bc82 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:35:06.114199 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e567e2e4-3843-4907-8528-1388bb92bc82 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:35:06.114958 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e567e2e4-3843-4907-8528-1388bb92bc82 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:35:06.115623 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e567e2e4-3843-4907-8528-1388bb92bc82 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:35:06.116246 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-e567e2e4-3843-4907-8528-1388bb92bc82 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:35:06.180362 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-e567e2e4-3843-4907-8528-1388bb92bc82 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841e202efcb143cf93d6d9bb1f3edba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979814de519c46d08cd2301bf5d33eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:35:06.189120 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-e567e2e4-3843-4907-8528-1388bb92bc82 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] 10.222.0.43 "GET /compute/v2.1/servers/7a3c06ab-77fb-4b24-8913-f5514e2598cb" status: 200 len: 1219 microversion: 2.1 time: 0.087803 Oct 04 23:35:06.189705 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4473/8127] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:35:06 2022] GET /compute/v2.1/servers/7a3c06ab-77fb-4b24-8913-f5514e2598cb => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:35:07.214808 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-4f9133e1-6931-4eda-80fd-d1c5f9b4b101 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:35:07.215528 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-4f9133e1-6931-4eda-80fd-d1c5f9b4b101 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] [instance: 7a3c06ab-77fb-4b24-8913-f5514e2598cb] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:35:07.221798 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4f9133e1-6931-4eda-80fd-d1c5f9b4b101 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:35:07.222575 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4f9133e1-6931-4eda-80fd-d1c5f9b4b101 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:35:07.223097 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4f9133e1-6931-4eda-80fd-d1c5f9b4b101 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:35:07.223802 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4f9133e1-6931-4eda-80fd-d1c5f9b4b101 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:35:07.224266 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4f9133e1-6931-4eda-80fd-d1c5f9b4b101 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:35:07.224700 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-4f9133e1-6931-4eda-80fd-d1c5f9b4b101 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:35:07.291887 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-4f9133e1-6931-4eda-80fd-d1c5f9b4b101 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841e202efcb143cf93d6d9bb1f3edba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979814de519c46d08cd2301bf5d33eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:35:07.300197 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-4f9133e1-6931-4eda-80fd-d1c5f9b4b101 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] 10.222.0.43 "GET /compute/v2.1/servers/7a3c06ab-77fb-4b24-8913-f5514e2598cb" status: 200 len: 1219 microversion: 2.1 time: 0.091311 Oct 04 23:35:07.300889 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3655/8128] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:35:07 2022] GET /compute/v2.1/servers/7a3c06ab-77fb-4b24-8913-f5514e2598cb => generated 1219 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:35:08.323940 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-b0b4bb75-4148-4153-a819-905f077d7449 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:35:08.324583 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-b0b4bb75-4148-4153-a819-905f077d7449 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] [instance: 7a3c06ab-77fb-4b24-8913-f5514e2598cb] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:35:08.331813 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b0b4bb75-4148-4153-a819-905f077d7449 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:35:08.332322 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b0b4bb75-4148-4153-a819-905f077d7449 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:35:08.332783 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b0b4bb75-4148-4153-a819-905f077d7449 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:35:08.333515 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b0b4bb75-4148-4153-a819-905f077d7449 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:35:08.333988 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b0b4bb75-4148-4153-a819-905f077d7449 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:35:08.334458 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b0b4bb75-4148-4153-a819-905f077d7449 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:35:08.401515 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-b0b4bb75-4148-4153-a819-905f077d7449 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841e202efcb143cf93d6d9bb1f3edba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979814de519c46d08cd2301bf5d33eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:35:08.409644 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-b0b4bb75-4148-4153-a819-905f077d7449 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] 10.222.0.43 "GET /compute/v2.1/servers/7a3c06ab-77fb-4b24-8913-f5514e2598cb" status: 200 len: 1219 microversion: 2.1 time: 0.090061 Oct 04 23:35:08.410245 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4474/8129] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:35:08 2022] GET /compute/v2.1/servers/7a3c06ab-77fb-4b24-8913-f5514e2598cb => generated 1219 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:35:09.433962 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-74252d36-de8b-4e76-b6e3-f59bef41c87b tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:35:09.434612 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-74252d36-de8b-4e76-b6e3-f59bef41c87b tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] [instance: 7a3c06ab-77fb-4b24-8913-f5514e2598cb] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:35:09.441441 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-74252d36-de8b-4e76-b6e3-f59bef41c87b tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:35:09.441925 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-74252d36-de8b-4e76-b6e3-f59bef41c87b tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:35:09.442381 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-74252d36-de8b-4e76-b6e3-f59bef41c87b tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:35:09.443074 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-74252d36-de8b-4e76-b6e3-f59bef41c87b tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:35:09.443529 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-74252d36-de8b-4e76-b6e3-f59bef41c87b tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:35:09.443955 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-74252d36-de8b-4e76-b6e3-f59bef41c87b tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:35:09.506781 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-74252d36-de8b-4e76-b6e3-f59bef41c87b tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841e202efcb143cf93d6d9bb1f3edba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979814de519c46d08cd2301bf5d33eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:35:09.514628 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-74252d36-de8b-4e76-b6e3-f59bef41c87b tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] 10.222.0.43 "GET /compute/v2.1/servers/7a3c06ab-77fb-4b24-8913-f5514e2598cb" status: 200 len: 1219 microversion: 2.1 time: 0.085286 Oct 04 23:35:09.515212 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3656/8130] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:35:09 2022] GET /compute/v2.1/servers/7a3c06ab-77fb-4b24-8913-f5514e2598cb => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:35:10.536864 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-d3820126-c7aa-4aa9-b548-8b83ca46038d tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:35:10.538168 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-d3820126-c7aa-4aa9-b548-8b83ca46038d tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] [instance: 7a3c06ab-77fb-4b24-8913-f5514e2598cb] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:35:10.545738 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d3820126-c7aa-4aa9-b548-8b83ca46038d tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:35:10.546383 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d3820126-c7aa-4aa9-b548-8b83ca46038d tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:35:10.546911 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d3820126-c7aa-4aa9-b548-8b83ca46038d tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:35:10.547933 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d3820126-c7aa-4aa9-b548-8b83ca46038d tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:35:10.548442 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d3820126-c7aa-4aa9-b548-8b83ca46038d tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:35:10.548891 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d3820126-c7aa-4aa9-b548-8b83ca46038d tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:35:10.583002 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d3820126-c7aa-4aa9-b548-8b83ca46038d tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:35:10.583773 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d3820126-c7aa-4aa9-b548-8b83ca46038d tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:35:10.584221 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d3820126-c7aa-4aa9-b548-8b83ca46038d tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:35:10.584857 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.objects.instance [None req-d3820126-c7aa-4aa9-b548-8b83ca46038d tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lazy-loading 'fault' on Instance uuid 7a3c06ab-77fb-4b24-8913-f5514e2598cb {{(pid=134101) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 23:35:10.636663 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-d3820126-c7aa-4aa9-b548-8b83ca46038d tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841e202efcb143cf93d6d9bb1f3edba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979814de519c46d08cd2301bf5d33eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:35:10.647573 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-d3820126-c7aa-4aa9-b548-8b83ca46038d tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] 10.222.0.43 "GET /compute/v2.1/servers/7a3c06ab-77fb-4b24-8913-f5514e2598cb" status: 200 len: 1224 microversion: 2.1 time: 0.114297 Oct 04 23:35:10.648208 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4475/8131] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:35:10 2022] GET /compute/v2.1/servers/7a3c06ab-77fb-4b24-8913-f5514e2598cb => generated 1224 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:35:11.671785 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-8151e448-e207-4401-943a-f9a6aa3b7b10 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:35:11.672403 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-8151e448-e207-4401-943a-f9a6aa3b7b10 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] [instance: 7a3c06ab-77fb-4b24-8913-f5514e2598cb] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:35:11.679267 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8151e448-e207-4401-943a-f9a6aa3b7b10 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:35:11.679753 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8151e448-e207-4401-943a-f9a6aa3b7b10 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:35:11.680197 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8151e448-e207-4401-943a-f9a6aa3b7b10 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:35:11.681474 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8151e448-e207-4401-943a-f9a6aa3b7b10 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:35:11.681918 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8151e448-e207-4401-943a-f9a6aa3b7b10 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:35:11.682347 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8151e448-e207-4401-943a-f9a6aa3b7b10 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:35:11.697772 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-8151e448-e207-4401-943a-f9a6aa3b7b10 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] HTTP exception thrown: Instance 7a3c06ab-77fb-4b24-8913-f5514e2598cb could not be found. Oct 04 23:35:11.699477 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-8151e448-e207-4401-943a-f9a6aa3b7b10 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Request method failure captured: Oct 04 23:35:11.699477 n-d-860284-1 devstack@n-api.service[134102]: request: GET /compute/v2.1/servers/7a3c06ab-77fb-4b24-8913-f5514e2598cb HTTP/1.1 Oct 04 23:35:11.699477 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 23:35:11.699477 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 23:35:11.699477 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 23:35:11.699477 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 23:35:11.699477 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 23:35:11.699477 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 23:35:11.699477 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 23:35:11.699477 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 23:35:11.699477 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPMC9Rei2sE5K1O5vICl-Bspm0-DRHURZojLcFXZ3m1nisETEfWE5GNdWn1-IVdJmWGQ2ULHAiuBkbHiKq9WriVXXV8gdEqF5l3kjlKdiFGPKVRsZCGioIHnbNGSL8ibbBaRU_fLr-Q764swQ_pSwSqL6XBc-vOfDAaf55ClRqlzDyVs Oct 04 23:35:11.699477 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 23:35:11.699477 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 23:35:11.699477 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 23:35:11.699477 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 23:35:11.699477 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 23:35:11.699477 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 23:35:11.699477 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: 979814de519c46d08cd2301bf5d33eac Oct 04 23:35:11.699477 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-TestShelveInstance-1707614860 Oct 04 23:35:11.699477 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 23:35:11.699477 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 23:35:11.699477 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/979814de519c46d08cd2301bf5d33eac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_979814de519c46d08cd2301bf5d33eac", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/979814de519c46d08cd2301bf5d33eac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/979814de519c46d08cd2301bf5d33eac"}]}] Oct 04 23:35:11.699477 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-TestShelveInstance-1707614860 Oct 04 23:35:11.699477 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: 979814de519c46d08cd2301bf5d33eac Oct 04 23:35:11.699477 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-TestShelveInstance-1707614860 Oct 04 23:35:11.699477 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-TestShelveInstance-1707614860-project Oct 04 23:35:11.699477 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 23:35:11.699477 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 23:35:11.699477 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: 841e202efcb143cf93d6d9bb1f3edba3 Oct 04 23:35:11.699477 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-TestShelveInstance-1707614860-project Oct 04 23:35:11.699477 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 23:35:11.699477 n-d-860284-1 devstack@n-api.service[134102]: exception: Instance 7a3c06ab-77fb-4b24-8913-f5514e2598cb could not be found. Oct 04 23:35:11.699477 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': '7a3c06ab-77fb-4b24-8913-f5514e2598cb'} Oct 04 23:35:11.699477 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 23:35:11.699477 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 23:35:11.699477 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 23:35:11.699477 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 23:35:11.699477 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 23:35:11.699477 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 23:35:11.699477 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 23:35:11.699477 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 23:35:11.699477 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 23:35:11.699477 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 23:35:11.699477 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a3c06ab-77fb-4b24-8913-f5514e2598cb could not be found. Oct 04 23:35:11.699477 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 23:35:11.699477 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 23:35:11.699477 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 23:35:11.699477 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 23:35:11.699477 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 23:35:11.699477 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 23:35:11.699477 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 23:35:11.699477 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 23:35:11.699477 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 23:35:11.699477 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 23:35:11.699477 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 23:35:11.699477 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 23:35:11.699477 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 23:35:11.699477 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 23:35:11.699477 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 23:35:11.699477 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 23:35:11.699477 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a3c06ab-77fb-4b24-8913-f5514e2598cb could not be found. Oct 04 23:35:11.699477 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 23:35:11.699477 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 23:35:11.699477 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 23:35:11.704738 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 23:35:11.704738 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 23:35:11.704738 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 23:35:11.704738 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 23:35:11.704738 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 23:35:11.704738 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a3c06ab-77fb-4b24-8913-f5514e2598cb could not be found. Oct 04 23:35:11.704738 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 23:35:11.704738 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-8151e448-e207-4401-943a-f9a6aa3b7b10 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Returning 404 to user: Instance 7a3c06ab-77fb-4b24-8913-f5514e2598cb could not be found. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 23:35:11.704738 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-8151e448-e207-4401-943a-f9a6aa3b7b10 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] 10.222.0.43 "GET /compute/v2.1/servers/7a3c06ab-77fb-4b24-8913-f5514e2598cb" status: 404 len: 111 microversion: 2.1 time: 0.033064 Oct 04 23:35:11.704738 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3657/8132] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:35:11 2022] GET /compute/v2.1/servers/7a3c06ab-77fb-4b24-8913-f5514e2598cb => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 23:35:11.865535 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-1a9b35b6-c221-47d9-8950-8871f91b9388 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] Calling method '.version_select at 0x7fbb2ef75af0>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:35:11.892404 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-1a9b35b6-c221-47d9-8950-8871f91b9388 tempest-TestShelveInstance-1707614860 tempest-TestShelveInstance-1707614860-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-674050281" status: 202 len: 0 microversion: 2.1 time: 0.030696 Oct 04 23:35:11.893370 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4476/8133] 10.222.0.43 () {58 vars in 1251 bytes} [Tue Oct 4 23:35:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-674050281 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 23:35:29.577060 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_api:SELECT=12 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:35:29.578273 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=24 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:35:29.777530 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-50b34f72-1112-4d70-9926-0056da88987f tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Action: 'create', calling method: .version_select at 0x7fbb2e4434c0>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-1850706400", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCgM3c3TTcnkmZnto+UJGoh0q96NajB5CN7rSRKzMIcLRolMyTB2DbQvFHPRzPf7M3RnXKczbjVFizC2eH6Px+0AlA1T6rR682Whny2Fny/NXP3v5kimxl9wJO09pAWvLA=="}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 23:35:29.798712 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-50b34f72-1112-4d70-9926-0056da88987f tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Getting quotas for project 938498ad9e794c2e8e95e9fafdd80259. Resources: {'key_pairs'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 23:35:29.804317 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.quota [None req-50b34f72-1112-4d70-9926-0056da88987f tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Getting quotas for user 3dc44cc49a37432cb1eb70628f29e2f9 and project 938498ad9e794c2e8e95e9fafdd80259. Resources: {'key_pairs'} {{(pid=134102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 23:35:29.839496 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-50b34f72-1112-4d70-9926-0056da88987f tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.267564 Oct 04 23:35:29.840126 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3658/8134] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Oct 4 23:35:29 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 23:35:30.882743 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:35:30.882743 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:35:30.907152 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-6e16e697-b534-4690-bad4-115498f695b9 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-1843949577", "imageRef": "58548514-5dac-426c-81f5-19e3fba33e23", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1850706400", "security_groups": [{"name": "tempest-secgroup-smoke-1220292457"}], "networks": [{"uuid": "f723cac0-3313-4ca7-9c81-2be4242a0484"}]}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 23:35:31.190853 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.network.neutron [None req-6e16e697-b534-4690-bad4-115498f695b9 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] validate_networks() for [('f723cac0-3313-4ca7-9c81-2be4242a0484', None, None, None, None, None)] {{(pid=134101) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 23:35:31.681983 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-6e16e697-b534-4690-bad4-115498f695b9 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Flavor limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 23:35:31.682651 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-6e16e697-b534-4690-bad4-115498f695b9 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Image limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 23:35:31.683178 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-6e16e697-b534-4690-bad4-115498f695b9 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Flavor pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 23:35:31.683611 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-6e16e697-b534-4690-bad4-115498f695b9 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Image pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 23:35:31.684046 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-6e16e697-b534-4690-bad4-115498f695b9 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 23:35:31.692822 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6e16e697-b534-4690-bad4-115498f695b9 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:35:31.693314 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6e16e697-b534-4690-bad4-115498f695b9 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:35:31.693761 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6e16e697-b534-4690-bad4-115498f695b9 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:35:31.694576 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6e16e697-b534-4690-bad4-115498f695b9 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:35:31.695045 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6e16e697-b534-4690-bad4-115498f695b9 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:35:31.696092 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-6e16e697-b534-4690-bad4-115498f695b9 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:35:31.715635 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-6e16e697-b534-4690-bad4-115498f695b9 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Getting quotas for project 938498ad9e794c2e8e95e9fafdd80259. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 23:35:31.721096 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-6e16e697-b534-4690-bad4-115498f695b9 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Getting quotas for user 3dc44cc49a37432cb1eb70628f29e2f9 and project 938498ad9e794c2e8e95e9fafdd80259. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 23:35:31.734577 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-6e16e697-b534-4690-bad4-115498f695b9 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Going to run 1 instances... {{(pid=134101) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 23:35:31.736901 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-6e16e697-b534-4690-bad4-115498f695b9 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] [instance: 8db1c9d3-f2d1-450e-acaa-6398122b01b5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='58548514-5dac-426c-81f5-19e3fba33e23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134101) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 23:35:31.783824 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-6e16e697-b534-4690-bad4-115498f695b9 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.906055 Oct 04 23:35:31.784425 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4477/8135] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 23:35:30 2022] POST /compute/v2.1/servers => generated 406 bytes in 908 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 23:35:31.797154 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-43c456ca-d2f7-433d-8b2c-a36970fd3fd5 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:35:31.797910 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-43c456ca-d2f7-433d-8b2c-a36970fd3fd5 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] [instance: 8db1c9d3-f2d1-450e-acaa-6398122b01b5] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:35:31.913436 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-43c456ca-d2f7-433d-8b2c-a36970fd3fd5 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc44cc49a37432cb1eb70628f29e2f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938498ad9e794c2e8e95e9fafdd80259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:35:31.929422 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-43c456ca-d2f7-433d-8b2c-a36970fd3fd5 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] 10.222.0.43 "GET /compute/v2.1/servers/8db1c9d3-f2d1-450e-acaa-6398122b01b5" status: 200 len: 1249 microversion: 2.1 time: 0.136991 Oct 04 23:35:31.931177 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3659/8136] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:35:31 2022] GET /compute/v2.1/servers/8db1c9d3-f2d1-450e-acaa-6398122b01b5 => generated 1249 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:35:32.955201 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-033a75d0-806b-412c-863e-954b5d4b49e7 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:35:32.956483 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-033a75d0-806b-412c-863e-954b5d4b49e7 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] [instance: 8db1c9d3-f2d1-450e-acaa-6398122b01b5] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:35:32.964424 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-033a75d0-806b-412c-863e-954b5d4b49e7 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:35:32.965268 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-033a75d0-806b-412c-863e-954b5d4b49e7 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:35:32.965924 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-033a75d0-806b-412c-863e-954b5d4b49e7 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:35:32.966975 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-033a75d0-806b-412c-863e-954b5d4b49e7 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:35:32.967723 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-033a75d0-806b-412c-863e-954b5d4b49e7 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:35:32.968345 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-033a75d0-806b-412c-863e-954b5d4b49e7 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:35:33.045785 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-033a75d0-806b-412c-863e-954b5d4b49e7 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc44cc49a37432cb1eb70628f29e2f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938498ad9e794c2e8e95e9fafdd80259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:35:33.058333 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-033a75d0-806b-412c-863e-954b5d4b49e7 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] 10.222.0.43 "GET /compute/v2.1/servers/8db1c9d3-f2d1-450e-acaa-6398122b01b5" status: 200 len: 1301 microversion: 2.1 time: 0.108632 Oct 04 23:35:33.060143 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4478/8137] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:35:32 2022] GET /compute/v2.1/servers/8db1c9d3-f2d1-450e-acaa-6398122b01b5 => generated 1301 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:35:34.083559 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-6921b8f9-1fbb-4b6f-9299-4b6ed9ecd2db tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:35:34.084845 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-6921b8f9-1fbb-4b6f-9299-4b6ed9ecd2db tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] [instance: 8db1c9d3-f2d1-450e-acaa-6398122b01b5] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:35:34.094128 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6921b8f9-1fbb-4b6f-9299-4b6ed9ecd2db tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:35:34.094924 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6921b8f9-1fbb-4b6f-9299-4b6ed9ecd2db tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:35:34.095367 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6921b8f9-1fbb-4b6f-9299-4b6ed9ecd2db tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:35:34.096290 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6921b8f9-1fbb-4b6f-9299-4b6ed9ecd2db tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:35:34.097045 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6921b8f9-1fbb-4b6f-9299-4b6ed9ecd2db tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:35:34.097477 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-6921b8f9-1fbb-4b6f-9299-4b6ed9ecd2db tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:35:34.331233 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-6921b8f9-1fbb-4b6f-9299-4b6ed9ecd2db tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc44cc49a37432cb1eb70628f29e2f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938498ad9e794c2e8e95e9fafdd80259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:35:34.339929 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-6921b8f9-1fbb-4b6f-9299-4b6ed9ecd2db tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] 10.222.0.43 "GET /compute/v2.1/servers/8db1c9d3-f2d1-450e-acaa-6398122b01b5" status: 200 len: 1375 microversion: 2.1 time: 0.260362 Oct 04 23:35:34.341066 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3660/8138] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:35:34 2022] GET /compute/v2.1/servers/8db1c9d3-f2d1-450e-acaa-6398122b01b5 => generated 1375 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:35:34.729118 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-539fff57-cff2-48e3-af11-f709b0af6f2f req-528fefa2-db39-4a01-8f3a-1cb4dc1dce8e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8db1c9d3-f2d1-450e-acaa-6398122b01b5", "tag": "7cddf58d-1ced-4237-ac44-c31aa22bf240"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 23:35:34.738737 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-539fff57-cff2-48e3-af11-f709b0af6f2f req-528fefa2-db39-4a01-8f3a-1cb4dc1dce8e service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:35:34.739231 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-539fff57-cff2-48e3-af11-f709b0af6f2f req-528fefa2-db39-4a01-8f3a-1cb4dc1dce8e service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:35:34.739675 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-539fff57-cff2-48e3-af11-f709b0af6f2f req-528fefa2-db39-4a01-8f3a-1cb4dc1dce8e service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:35:34.751204 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-539fff57-cff2-48e3-af11-f709b0af6f2f req-528fefa2-db39-4a01-8f3a-1cb4dc1dce8e service nova] Creating event network-changed:7cddf58d-1ced-4237-ac44-c31aa22bf240 for instance 8db1c9d3-f2d1-450e-acaa-6398122b01b5 on n-h1-860284-1 Oct 04 23:35:34.756113 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-539fff57-cff2-48e3-af11-f709b0af6f2f req-528fefa2-db39-4a01-8f3a-1cb4dc1dce8e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096877 Oct 04 23:35:34.756822 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4479/8139] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 23:35:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 23:35:35.364276 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-1b899729-c132-4708-a26b-1319f24f81cb tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:35:35.364908 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-1b899729-c132-4708-a26b-1319f24f81cb tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] [instance: 8db1c9d3-f2d1-450e-acaa-6398122b01b5] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:35:35.372338 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1b899729-c132-4708-a26b-1319f24f81cb tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:35:35.372833 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1b899729-c132-4708-a26b-1319f24f81cb tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:35:35.373276 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1b899729-c132-4708-a26b-1319f24f81cb tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:35:35.373998 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1b899729-c132-4708-a26b-1319f24f81cb tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:35:35.374492 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1b899729-c132-4708-a26b-1319f24f81cb tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:35:35.374926 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-1b899729-c132-4708-a26b-1319f24f81cb tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:35:35.508058 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-1b899729-c132-4708-a26b-1319f24f81cb tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc44cc49a37432cb1eb70628f29e2f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938498ad9e794c2e8e95e9fafdd80259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:35:35.515869 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-1b899729-c132-4708-a26b-1319f24f81cb tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] 10.222.0.43 "GET /compute/v2.1/servers/8db1c9d3-f2d1-450e-acaa-6398122b01b5" status: 200 len: 1375 microversion: 2.1 time: 0.155873 Oct 04 23:35:35.516457 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3661/8140] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:35:35 2022] GET /compute/v2.1/servers/8db1c9d3-f2d1-450e-acaa-6398122b01b5 => generated 1375 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:35:36.539759 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-1976f748-44dc-4a4e-aeaf-5f334b5b40fb tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:35:36.540490 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-1976f748-44dc-4a4e-aeaf-5f334b5b40fb tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] [instance: 8db1c9d3-f2d1-450e-acaa-6398122b01b5] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:35:36.546891 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1976f748-44dc-4a4e-aeaf-5f334b5b40fb tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:35:36.547397 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1976f748-44dc-4a4e-aeaf-5f334b5b40fb tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:35:36.547857 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1976f748-44dc-4a4e-aeaf-5f334b5b40fb tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:35:36.548571 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1976f748-44dc-4a4e-aeaf-5f334b5b40fb tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:35:36.549050 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1976f748-44dc-4a4e-aeaf-5f334b5b40fb tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:35:36.549500 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-1976f748-44dc-4a4e-aeaf-5f334b5b40fb tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:35:36.681714 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-1976f748-44dc-4a4e-aeaf-5f334b5b40fb tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc44cc49a37432cb1eb70628f29e2f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938498ad9e794c2e8e95e9fafdd80259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:35:36.689693 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-1976f748-44dc-4a4e-aeaf-5f334b5b40fb tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] 10.222.0.43 "GET /compute/v2.1/servers/8db1c9d3-f2d1-450e-acaa-6398122b01b5" status: 200 len: 1375 microversion: 2.1 time: 0.155349 Oct 04 23:35:36.690271 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4480/8141] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:35:36 2022] GET /compute/v2.1/servers/8db1c9d3-f2d1-450e-acaa-6398122b01b5 => generated 1375 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:35:37.713706 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-7498710e-0424-4be9-9e76-34dd98190315 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:35:37.714484 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-7498710e-0424-4be9-9e76-34dd98190315 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] [instance: 8db1c9d3-f2d1-450e-acaa-6398122b01b5] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:35:37.721053 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7498710e-0424-4be9-9e76-34dd98190315 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:35:37.721801 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7498710e-0424-4be9-9e76-34dd98190315 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:35:37.722243 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7498710e-0424-4be9-9e76-34dd98190315 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:35:37.722976 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7498710e-0424-4be9-9e76-34dd98190315 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:35:37.723436 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7498710e-0424-4be9-9e76-34dd98190315 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:35:37.723868 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-7498710e-0424-4be9-9e76-34dd98190315 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:35:37.957063 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-7498710e-0424-4be9-9e76-34dd98190315 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc44cc49a37432cb1eb70628f29e2f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938498ad9e794c2e8e95e9fafdd80259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:35:37.965421 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-7498710e-0424-4be9-9e76-34dd98190315 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] 10.222.0.43 "GET /compute/v2.1/servers/8db1c9d3-f2d1-450e-acaa-6398122b01b5" status: 200 len: 1375 microversion: 2.1 time: 0.256164 Oct 04 23:35:37.966148 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3662/8142] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:35:37 2022] GET /compute/v2.1/servers/8db1c9d3-f2d1-450e-acaa-6398122b01b5 => generated 1375 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:35:38.989288 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-5e97d25d-1b64-4499-b9bc-3bf111a28e16 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:35:38.989823 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-5e97d25d-1b64-4499-b9bc-3bf111a28e16 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] [instance: 8db1c9d3-f2d1-450e-acaa-6398122b01b5] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:35:38.997353 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5e97d25d-1b64-4499-b9bc-3bf111a28e16 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:35:38.997857 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5e97d25d-1b64-4499-b9bc-3bf111a28e16 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:35:38.998314 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5e97d25d-1b64-4499-b9bc-3bf111a28e16 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:35:38.999051 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5e97d25d-1b64-4499-b9bc-3bf111a28e16 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:35:38.999524 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5e97d25d-1b64-4499-b9bc-3bf111a28e16 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:35:38.999970 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-5e97d25d-1b64-4499-b9bc-3bf111a28e16 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:35:39.139529 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-5e97d25d-1b64-4499-b9bc-3bf111a28e16 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc44cc49a37432cb1eb70628f29e2f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938498ad9e794c2e8e95e9fafdd80259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:35:39.147330 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-5e97d25d-1b64-4499-b9bc-3bf111a28e16 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] 10.222.0.43 "GET /compute/v2.1/servers/8db1c9d3-f2d1-450e-acaa-6398122b01b5" status: 200 len: 1375 microversion: 2.1 time: 0.162176 Oct 04 23:35:39.147900 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4481/8143] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:35:38 2022] GET /compute/v2.1/servers/8db1c9d3-f2d1-450e-acaa-6398122b01b5 => generated 1375 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:35:40.169129 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-e86acd24-b9f0-4813-86b2-bb559d92b083 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:35:40.169680 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-e86acd24-b9f0-4813-86b2-bb559d92b083 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] [instance: 8db1c9d3-f2d1-450e-acaa-6398122b01b5] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:35:40.176575 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e86acd24-b9f0-4813-86b2-bb559d92b083 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:35:40.177055 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e86acd24-b9f0-4813-86b2-bb559d92b083 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:35:40.177502 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e86acd24-b9f0-4813-86b2-bb559d92b083 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:35:40.178197 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e86acd24-b9f0-4813-86b2-bb559d92b083 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:35:40.178685 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e86acd24-b9f0-4813-86b2-bb559d92b083 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:35:40.179113 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e86acd24-b9f0-4813-86b2-bb559d92b083 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:35:40.310762 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-e86acd24-b9f0-4813-86b2-bb559d92b083 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc44cc49a37432cb1eb70628f29e2f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938498ad9e794c2e8e95e9fafdd80259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:35:40.318463 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-e86acd24-b9f0-4813-86b2-bb559d92b083 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] 10.222.0.43 "GET /compute/v2.1/servers/8db1c9d3-f2d1-450e-acaa-6398122b01b5" status: 200 len: 1375 microversion: 2.1 time: 0.153481 Oct 04 23:35:40.319038 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3663/8144] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:35:40 2022] GET /compute/v2.1/servers/8db1c9d3-f2d1-450e-acaa-6398122b01b5 => generated 1375 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:35:41.341694 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-b3d8acd4-7dd6-4f8a-ad07-d149c50f7c46 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:35:41.342324 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-b3d8acd4-7dd6-4f8a-ad07-d149c50f7c46 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] [instance: 8db1c9d3-f2d1-450e-acaa-6398122b01b5] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:35:41.349544 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b3d8acd4-7dd6-4f8a-ad07-d149c50f7c46 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:35:41.350041 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b3d8acd4-7dd6-4f8a-ad07-d149c50f7c46 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:35:41.350529 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b3d8acd4-7dd6-4f8a-ad07-d149c50f7c46 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:35:41.351874 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b3d8acd4-7dd6-4f8a-ad07-d149c50f7c46 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:35:41.352437 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b3d8acd4-7dd6-4f8a-ad07-d149c50f7c46 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:35:41.352883 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-b3d8acd4-7dd6-4f8a-ad07-d149c50f7c46 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:35:41.481940 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-b3d8acd4-7dd6-4f8a-ad07-d149c50f7c46 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc44cc49a37432cb1eb70628f29e2f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938498ad9e794c2e8e95e9fafdd80259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:35:41.489747 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-b3d8acd4-7dd6-4f8a-ad07-d149c50f7c46 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] 10.222.0.43 "GET /compute/v2.1/servers/8db1c9d3-f2d1-450e-acaa-6398122b01b5" status: 200 len: 1375 microversion: 2.1 time: 0.151980 Oct 04 23:35:41.490329 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4482/8145] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:35:41 2022] GET /compute/v2.1/servers/8db1c9d3-f2d1-450e-acaa-6398122b01b5 => generated 1375 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 23:35:42.077278 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-916f9d4a-6e2b-4b80-868c-7dae8cfa2bba req-c635927d-8a5d-45ec-adb4-e1742818d3c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8db1c9d3-f2d1-450e-acaa-6398122b01b5", "name": "network-vif-plugged", "status": "completed", "tag": "7cddf58d-1ced-4237-ac44-c31aa22bf240"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 23:35:42.083148 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell0:SELECT=6 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:35:42.090479 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-916f9d4a-6e2b-4b80-868c-7dae8cfa2bba req-c635927d-8a5d-45ec-adb4-e1742818d3c6 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:35:42.091114 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-916f9d4a-6e2b-4b80-868c-7dae8cfa2bba req-c635927d-8a5d-45ec-adb4-e1742818d3c6 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:35:42.091890 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-916f9d4a-6e2b-4b80-868c-7dae8cfa2bba req-c635927d-8a5d-45ec-adb4-e1742818d3c6 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:35:42.104414 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-916f9d4a-6e2b-4b80-868c-7dae8cfa2bba req-c635927d-8a5d-45ec-adb4-e1742818d3c6 service nova] Creating event network-vif-plugged:7cddf58d-1ced-4237-ac44-c31aa22bf240 for instance 8db1c9d3-f2d1-450e-acaa-6398122b01b5 on n-h1-860284-1 Oct 04 23:35:42.109849 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-916f9d4a-6e2b-4b80-868c-7dae8cfa2bba req-c635927d-8a5d-45ec-adb4-e1742818d3c6 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035969 Oct 04 23:35:42.110461 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3664/8146] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 23:35:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 23:35:42.512939 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-c8b0c7ea-46a9-411e-a5c4-aa5473576c9d tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:35:42.513576 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-c8b0c7ea-46a9-411e-a5c4-aa5473576c9d tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] [instance: 8db1c9d3-f2d1-450e-acaa-6398122b01b5] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:35:42.515797 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=2 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:35:42.516489 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=6 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:35:42.523429 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c8b0c7ea-46a9-411e-a5c4-aa5473576c9d tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:35:42.523937 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c8b0c7ea-46a9-411e-a5c4-aa5473576c9d tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:35:42.524393 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c8b0c7ea-46a9-411e-a5c4-aa5473576c9d tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:35:42.525107 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c8b0c7ea-46a9-411e-a5c4-aa5473576c9d tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:35:42.525579 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c8b0c7ea-46a9-411e-a5c4-aa5473576c9d tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:35:42.526025 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c8b0c7ea-46a9-411e-a5c4-aa5473576c9d tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:35:42.661176 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-c8b0c7ea-46a9-411e-a5c4-aa5473576c9d tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc44cc49a37432cb1eb70628f29e2f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938498ad9e794c2e8e95e9fafdd80259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:35:42.669934 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-c8b0c7ea-46a9-411e-a5c4-aa5473576c9d tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] 10.222.0.43 "GET /compute/v2.1/servers/8db1c9d3-f2d1-450e-acaa-6398122b01b5" status: 200 len: 1375 microversion: 2.1 time: 0.161111 Oct 04 23:35:42.670552 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4483/8147] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:35:42 2022] GET /compute/v2.1/servers/8db1c9d3-f2d1-450e-acaa-6398122b01b5 => generated 1375 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:35:43.694557 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-76643fab-0bba-4038-949e-79542bf5d56b tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:35:43.695186 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-76643fab-0bba-4038-949e-79542bf5d56b tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] [instance: 8db1c9d3-f2d1-450e-acaa-6398122b01b5] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:35:43.701896 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-76643fab-0bba-4038-949e-79542bf5d56b tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:35:43.702417 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-76643fab-0bba-4038-949e-79542bf5d56b tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:35:43.702867 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-76643fab-0bba-4038-949e-79542bf5d56b tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:35:43.703575 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-76643fab-0bba-4038-949e-79542bf5d56b tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:35:43.704117 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-76643fab-0bba-4038-949e-79542bf5d56b tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:35:43.704666 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-76643fab-0bba-4038-949e-79542bf5d56b tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:35:43.840724 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-76643fab-0bba-4038-949e-79542bf5d56b tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc44cc49a37432cb1eb70628f29e2f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938498ad9e794c2e8e95e9fafdd80259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:35:43.849110 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-76643fab-0bba-4038-949e-79542bf5d56b tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] 10.222.0.43 "GET /compute/v2.1/servers/8db1c9d3-f2d1-450e-acaa-6398122b01b5" status: 200 len: 1561 microversion: 2.1 time: 0.160052 Oct 04 23:35:43.849700 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3665/8148] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:35:43 2022] GET /compute/v2.1/servers/8db1c9d3-f2d1-450e-acaa-6398122b01b5 => generated 1561 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:35:43.871805 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-f57f062f-e639-4aff-b2d5-9724320a72e4 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:35:43.872444 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-f57f062f-e639-4aff-b2d5-9724320a72e4 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] [instance: 8db1c9d3-f2d1-450e-acaa-6398122b01b5] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:35:43.879117 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f57f062f-e639-4aff-b2d5-9724320a72e4 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:35:43.879628 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f57f062f-e639-4aff-b2d5-9724320a72e4 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:35:43.880092 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f57f062f-e639-4aff-b2d5-9724320a72e4 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:35:43.880813 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f57f062f-e639-4aff-b2d5-9724320a72e4 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:35:43.881297 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f57f062f-e639-4aff-b2d5-9724320a72e4 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:35:43.881750 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-f57f062f-e639-4aff-b2d5-9724320a72e4 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:35:44.014855 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-f57f062f-e639-4aff-b2d5-9724320a72e4 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc44cc49a37432cb1eb70628f29e2f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938498ad9e794c2e8e95e9fafdd80259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:35:44.022773 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-f57f062f-e639-4aff-b2d5-9724320a72e4 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] 10.222.0.43 "GET /compute/v2.1/servers/8db1c9d3-f2d1-450e-acaa-6398122b01b5" status: 200 len: 1561 microversion: 2.1 time: 0.155304 Oct 04 23:35:44.023356 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4484/8149] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:35:43 2022] GET /compute/v2.1/servers/8db1c9d3-f2d1-450e-acaa-6398122b01b5 => generated 1561 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:35:45.682504 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-c4fbf6be-1efa-4159-8040-cc6dc965aa09 req-78747949-297b-4dc8-a400-0256cd8cb2b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8db1c9d3-f2d1-450e-acaa-6398122b01b5", "tag": "7cddf58d-1ced-4237-ac44-c31aa22bf240"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 23:35:45.692375 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-c4fbf6be-1efa-4159-8040-cc6dc965aa09 req-78747949-297b-4dc8-a400-0256cd8cb2b9 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:35:45.693016 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-c4fbf6be-1efa-4159-8040-cc6dc965aa09 req-78747949-297b-4dc8-a400-0256cd8cb2b9 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:35:45.693453 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-c4fbf6be-1efa-4159-8040-cc6dc965aa09 req-78747949-297b-4dc8-a400-0256cd8cb2b9 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:35:45.705230 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-c4fbf6be-1efa-4159-8040-cc6dc965aa09 req-78747949-297b-4dc8-a400-0256cd8cb2b9 service nova] Creating event network-changed:7cddf58d-1ced-4237-ac44-c31aa22bf240 for instance 8db1c9d3-f2d1-450e-acaa-6398122b01b5 on n-h1-860284-1 Oct 04 23:35:45.710591 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-c4fbf6be-1efa-4159-8040-cc6dc965aa09 req-78747949-297b-4dc8-a400-0256cd8cb2b9 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031914 Oct 04 23:35:45.711201 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3666/8150] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 23:35:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 23:38:24.677175 n-d-860284-1 devstack@n-api.service[134101]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f8e2fc52-bb96-4bc7-8039-fbfc8addcbeb] AMQP server on 10.222.0.43:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 04 23:38:24.678337 n-d-860284-1 devstack@n-api.service[134101]: ERROR oslo.messaging._drivers.impl_rabbit [-] [dab38095-fcf8-46d0-9904-6bfbf5d1f82a] AMQP server on 10.222.0.43:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 04 23:38:24.678940 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:38:24.679711 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=40 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:38:24.680780 n-d-860284-1 devstack@n-api.service[134101]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 04 23:38:24.680921 n-d-860284-1 devstack@n-api.service[134101]: Tue Oct 4 23:38:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8db1c9d3-f2d1-450e-acaa-6398122b01b5/action (ip 10.222.0.43) !!! Oct 04 23:38:24.683681 n-d-860284-1 devstack@n-api.service[134101]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 04 23:38:24.683816 n-d-860284-1 devstack@n-api.service[134101]: Tue Oct 4 23:38:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8db1c9d3-f2d1-450e-acaa-6398122b01b5/action (ip 10.222.0.43) !!! Oct 04 23:38:24.685496 n-d-860284-1 devstack@n-api.service[134101]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 04 23:38:24.685616 n-d-860284-1 devstack@n-api.service[134101]: Tue Oct 4 23:38:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8db1c9d3-f2d1-450e-acaa-6398122b01b5/action (ip 10.222.0.43) !!! Oct 04 23:38:24.694195 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-fde56a40-740b-47af-9abb-cc1d3cd4a759 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-321458109"}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 23:38:24.696653 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-fde56a40-740b-47af-9abb-cc1d3cd4a759 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] [instance: 8db1c9d3-f2d1-450e-acaa-6398122b01b5] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:38:24.718011 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fde56a40-740b-47af-9abb-cc1d3cd4a759 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:38:24.718818 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fde56a40-740b-47af-9abb-cc1d3cd4a759 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:38:24.719285 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fde56a40-740b-47af-9abb-cc1d3cd4a759 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:38:24.720047 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fde56a40-740b-47af-9abb-cc1d3cd4a759 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:38:24.720552 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fde56a40-740b-47af-9abb-cc1d3cd4a759 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:38:24.721003 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fde56a40-740b-47af-9abb-cc1d3cd4a759 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:38:24.928257 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-fde56a40-740b-47af-9abb-cc1d3cd4a759 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] 10.222.0.43 "POST /compute/v2.1/servers/8db1c9d3-f2d1-450e-acaa-6398122b01b5/action" status: 202 len: 0 microversion: 2.1 time: 0.252657 Oct 04 23:38:24.928852 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4485/8151] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 23:38:24 2022] POST /compute/v2.1/servers/8db1c9d3-f2d1-450e-acaa-6398122b01b5/action => generated 0 bytes in 254 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 04 23:38:33.111009 n-d-860284-1 devstack@n-api.service[134102]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9c149bb3-0a09-4645-ba44-d3908964d17c] AMQP server on 10.222.0.43:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 23:38:33.111874 n-d-860284-1 devstack@n-api.service[134102]: ERROR oslo.messaging._drivers.impl_rabbit [-] [84f2d93b-5df1-409f-ad67-38bf0ff7216a] AMQP server on 10.222.0.43:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 23:38:33.112467 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:38:33.113287 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=34 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:38:33.114215 n-d-860284-1 devstack@n-api.service[134102]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 04 23:38:33.114346 n-d-860284-1 devstack@n-api.service[134102]: Tue Oct 4 23:38:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.43) !!! Oct 04 23:38:33.115924 n-d-860284-1 devstack@n-api.service[134102]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 23:38:33.115924 n-d-860284-1 devstack@n-api.service[134102]: Tue Oct 4 23:38:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.43) !!! Oct 04 23:38:33.117104 n-d-860284-1 devstack@n-api.service[134102]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 04 23:38:33.117104 n-d-860284-1 devstack@n-api.service[134102]: Tue Oct 4 23:38:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.43) !!! Oct 04 23:38:33.195809 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-6ad8df95-0dfa-40f8-960c-e26114c6d2ea req-97a3a95d-fc1d-471f-a46d-3f56d5947acf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8db1c9d3-f2d1-450e-acaa-6398122b01b5", "name": "network-vif-plugged", "status": "completed", "tag": "7cddf58d-1ced-4237-ac44-c31aa22bf240"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 23:38:33.206231 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-6ad8df95-0dfa-40f8-960c-e26114c6d2ea req-97a3a95d-fc1d-471f-a46d-3f56d5947acf service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:38:33.206750 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-6ad8df95-0dfa-40f8-960c-e26114c6d2ea req-97a3a95d-fc1d-471f-a46d-3f56d5947acf service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:38:33.207181 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-6ad8df95-0dfa-40f8-960c-e26114c6d2ea req-97a3a95d-fc1d-471f-a46d-3f56d5947acf service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:38:33.217317 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-6ad8df95-0dfa-40f8-960c-e26114c6d2ea req-97a3a95d-fc1d-471f-a46d-3f56d5947acf service nova] Creating event network-vif-plugged:7cddf58d-1ced-4237-ac44-c31aa22bf240 for instance 8db1c9d3-f2d1-450e-acaa-6398122b01b5 on n-h1-860284-1 Oct 04 23:38:33.224318 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-6ad8df95-0dfa-40f8-960c-e26114c6d2ea req-97a3a95d-fc1d-471f-a46d-3f56d5947acf service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114996 Oct 04 23:38:33.224931 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3667/8152] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 23:38:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 23:38:45.652482 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-d590542c-b85f-4997-8c1b-21aafba15e59 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-904682613", "imageRef": "48e27c70-0513-4cdf-91bf-787112b23efa", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1850706400", "security_groups": [{"name": "tempest-secgroup-smoke-1220292457"}], "networks": [{"uuid": "f723cac0-3313-4ca7-9c81-2be4242a0484"}]}} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 23:38:45.664378 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=2 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:38:45.665129 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:38:45.676444 n-d-860284-1 devstack@n-api.service[134101]: INFO oslo.messaging._drivers.impl_rabbit [-] [dab38095-fcf8-46d0-9904-6bfbf5d1f82a] Reconnected to AMQP server on 10.222.0.43:5672 via [amqp] client with port 41562. Oct 04 23:38:45.692602 n-d-860284-1 devstack@n-api.service[134101]: INFO oslo.messaging._drivers.impl_rabbit [-] [f8e2fc52-bb96-4bc7-8039-fbfc8addcbeb] Reconnected to AMQP server on 10.222.0.43:5672 via [amqp] client with port 41560. Oct 04 23:38:45.785472 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.network.neutron [None req-d590542c-b85f-4997-8c1b-21aafba15e59 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] validate_networks() for [('f723cac0-3313-4ca7-9c81-2be4242a0484', None, None, None, None, None)] {{(pid=134101) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 23:38:46.169249 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-d590542c-b85f-4997-8c1b-21aafba15e59 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Flavor limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 23:38:46.169757 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-d590542c-b85f-4997-8c1b-21aafba15e59 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Image limits 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 23:38:46.170263 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-d590542c-b85f-4997-8c1b-21aafba15e59 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Flavor pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 23:38:46.170751 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-d590542c-b85f-4997-8c1b-21aafba15e59 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Image pref 0:0:0 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 23:38:46.171173 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.virt.hardware [None req-d590542c-b85f-4997-8c1b-21aafba15e59 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 23:38:46.180030 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d590542c-b85f-4997-8c1b-21aafba15e59 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:38:46.180564 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d590542c-b85f-4997-8c1b-21aafba15e59 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:38:46.181158 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d590542c-b85f-4997-8c1b-21aafba15e59 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:38:46.181925 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d590542c-b85f-4997-8c1b-21aafba15e59 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:38:46.182431 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d590542c-b85f-4997-8c1b-21aafba15e59 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:38:46.182882 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d590542c-b85f-4997-8c1b-21aafba15e59 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:38:46.201987 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-d590542c-b85f-4997-8c1b-21aafba15e59 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Getting quotas for project 938498ad9e794c2e8e95e9fafdd80259. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 23:38:46.207759 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.quota [None req-d590542c-b85f-4997-8c1b-21aafba15e59 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Getting quotas for user 3dc44cc49a37432cb1eb70628f29e2f9 and project 938498ad9e794c2e8e95e9fafdd80259. Resources: {'instances', 'ram', 'cores'} {{(pid=134101) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 23:38:46.221099 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-d590542c-b85f-4997-8c1b-21aafba15e59 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Going to run 1 instances... {{(pid=134101) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 23:38:46.223656 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-d590542c-b85f-4997-8c1b-21aafba15e59 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] [instance: b2eb9de4-5509-44c7-b987-4361d3672fc7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='48e27c70-0513-4cdf-91bf-787112b23efa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134101) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 23:38:46.272264 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-d590542c-b85f-4997-8c1b-21aafba15e59 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.626507 Oct 04 23:38:46.272935 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4486/8153] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Oct 4 23:38:45 2022] POST /compute/v2.1/servers => generated 406 bytes in 628 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 23:38:46.285604 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-cfe933a8-5626-46b4-bf34-e316ea45eb06 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:38:46.286573 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-cfe933a8-5626-46b4-bf34-e316ea45eb06 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] [instance: b2eb9de4-5509-44c7-b987-4361d3672fc7] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:38:46.289772 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_api:SELECT=2 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:38:46.291053 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=2 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:38:46.306819 n-d-860284-1 devstack@n-api.service[134102]: INFO oslo.messaging._drivers.impl_rabbit [-] [9c149bb3-0a09-4645-ba44-d3908964d17c] Reconnected to AMQP server on 10.222.0.43:5672 via [amqp] client with port 41576. Oct 04 23:38:46.309389 n-d-860284-1 devstack@n-api.service[134102]: INFO oslo.messaging._drivers.impl_rabbit [-] [84f2d93b-5df1-409f-ad67-38bf0ff7216a] Reconnected to AMQP server on 10.222.0.43:5672 via [amqp] client with port 41578. Oct 04 23:38:46.357604 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-cfe933a8-5626-46b4-bf34-e316ea45eb06 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc44cc49a37432cb1eb70628f29e2f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938498ad9e794c2e8e95e9fafdd80259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:38:46.367078 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-cfe933a8-5626-46b4-bf34-e316ea45eb06 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] 10.222.0.43 "GET /compute/v2.1/servers/b2eb9de4-5509-44c7-b987-4361d3672fc7" status: 200 len: 1248 microversion: 2.1 time: 0.085623 Oct 04 23:38:46.367661 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3668/8154] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:38:46 2022] GET /compute/v2.1/servers/b2eb9de4-5509-44c7-b987-4361d3672fc7 => generated 1248 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:38:47.389476 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-fd5a48de-79e2-465a-b7fe-b779cbdd7855 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:38:47.390111 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-fd5a48de-79e2-465a-b7fe-b779cbdd7855 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] [instance: b2eb9de4-5509-44c7-b987-4361d3672fc7] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:38:47.398178 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fd5a48de-79e2-465a-b7fe-b779cbdd7855 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:38:47.398737 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fd5a48de-79e2-465a-b7fe-b779cbdd7855 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:38:47.399199 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fd5a48de-79e2-465a-b7fe-b779cbdd7855 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:38:47.400403 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fd5a48de-79e2-465a-b7fe-b779cbdd7855 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:38:47.400898 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fd5a48de-79e2-465a-b7fe-b779cbdd7855 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:38:47.401359 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fd5a48de-79e2-465a-b7fe-b779cbdd7855 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:38:47.485120 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-fd5a48de-79e2-465a-b7fe-b779cbdd7855 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc44cc49a37432cb1eb70628f29e2f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938498ad9e794c2e8e95e9fafdd80259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:38:47.493229 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-fd5a48de-79e2-465a-b7fe-b779cbdd7855 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] 10.222.0.43 "GET /compute/v2.1/servers/b2eb9de4-5509-44c7-b987-4361d3672fc7" status: 200 len: 1300 microversion: 2.1 time: 0.107619 Oct 04 23:38:47.494383 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4487/8155] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:38:47 2022] GET /compute/v2.1/servers/b2eb9de4-5509-44c7-b987-4361d3672fc7 => generated 1300 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:38:48.521054 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-d76c1684-93db-4b52-bd2f-94607e8e7261 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:38:48.521697 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-d76c1684-93db-4b52-bd2f-94607e8e7261 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] [instance: b2eb9de4-5509-44c7-b987-4361d3672fc7] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:38:48.530093 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d76c1684-93db-4b52-bd2f-94607e8e7261 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:38:48.530941 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d76c1684-93db-4b52-bd2f-94607e8e7261 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:38:48.531580 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d76c1684-93db-4b52-bd2f-94607e8e7261 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:38:48.532803 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d76c1684-93db-4b52-bd2f-94607e8e7261 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:38:48.533446 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d76c1684-93db-4b52-bd2f-94607e8e7261 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:38:48.534040 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-d76c1684-93db-4b52-bd2f-94607e8e7261 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:38:48.714641 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-d76c1684-93db-4b52-bd2f-94607e8e7261 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc44cc49a37432cb1eb70628f29e2f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938498ad9e794c2e8e95e9fafdd80259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:38:48.724631 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-d76c1684-93db-4b52-bd2f-94607e8e7261 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] 10.222.0.43 "GET /compute/v2.1/servers/b2eb9de4-5509-44c7-b987-4361d3672fc7" status: 200 len: 1374 microversion: 2.1 time: 0.207701 Oct 04 23:38:48.726053 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3669/8156] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:38:48 2022] GET /compute/v2.1/servers/b2eb9de4-5509-44c7-b987-4361d3672fc7 => generated 1374 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:38:48.999169 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-a72cb448-cef8-4fff-bc15-1d0b8d3e9658 req-c0d74279-d437-4de8-bd4b-8a8a64ea6dc3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8db1c9d3-f2d1-450e-acaa-6398122b01b5", "name": "network-vif-unplugged", "status": "completed", "tag": "7cddf58d-1ced-4237-ac44-c31aa22bf240"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 23:38:49.015583 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-a72cb448-cef8-4fff-bc15-1d0b8d3e9658 req-c0d74279-d437-4de8-bd4b-8a8a64ea6dc3 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:38:49.016159 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-a72cb448-cef8-4fff-bc15-1d0b8d3e9658 req-c0d74279-d437-4de8-bd4b-8a8a64ea6dc3 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:38:49.016698 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-a72cb448-cef8-4fff-bc15-1d0b8d3e9658 req-c0d74279-d437-4de8-bd4b-8a8a64ea6dc3 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:38:49.031497 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-a72cb448-cef8-4fff-bc15-1d0b8d3e9658 req-c0d74279-d437-4de8-bd4b-8a8a64ea6dc3 service nova] Creating event network-vif-unplugged:7cddf58d-1ced-4237-ac44-c31aa22bf240 for instance 8db1c9d3-f2d1-450e-acaa-6398122b01b5 on n-h1-860284-1 Oct 04 23:38:49.037217 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-a72cb448-cef8-4fff-bc15-1d0b8d3e9658 req-c0d74279-d437-4de8-bd4b-8a8a64ea6dc3 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044334 Oct 04 23:38:49.038422 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4488/8157] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 23:38:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 23:38:49.749119 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-b921fe32-b775-463a-ab36-e98d12df9a44 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:38:49.749739 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-b921fe32-b775-463a-ab36-e98d12df9a44 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] [instance: b2eb9de4-5509-44c7-b987-4361d3672fc7] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:38:49.757126 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b921fe32-b775-463a-ab36-e98d12df9a44 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:38:49.757617 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b921fe32-b775-463a-ab36-e98d12df9a44 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:38:49.758062 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b921fe32-b775-463a-ab36-e98d12df9a44 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:38:49.759651 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b921fe32-b775-463a-ab36-e98d12df9a44 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:38:49.760249 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b921fe32-b775-463a-ab36-e98d12df9a44 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:38:49.760691 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-b921fe32-b775-463a-ab36-e98d12df9a44 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:38:49.915945 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-b921fe32-b775-463a-ab36-e98d12df9a44 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc44cc49a37432cb1eb70628f29e2f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938498ad9e794c2e8e95e9fafdd80259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:38:49.924626 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-b921fe32-b775-463a-ab36-e98d12df9a44 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] 10.222.0.43 "GET /compute/v2.1/servers/b2eb9de4-5509-44c7-b987-4361d3672fc7" status: 200 len: 1374 microversion: 2.1 time: 0.179339 Oct 04 23:38:49.925586 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3670/8158] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:38:49 2022] GET /compute/v2.1/servers/b2eb9de4-5509-44c7-b987-4361d3672fc7 => generated 1374 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:38:50.951009 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-9f41cc98-1a3c-443b-8195-3723b1836649 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:38:50.951887 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-9f41cc98-1a3c-443b-8195-3723b1836649 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] [instance: b2eb9de4-5509-44c7-b987-4361d3672fc7] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:38:50.958638 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9f41cc98-1a3c-443b-8195-3723b1836649 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:38:50.959138 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9f41cc98-1a3c-443b-8195-3723b1836649 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:38:50.959589 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9f41cc98-1a3c-443b-8195-3723b1836649 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:38:50.960755 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9f41cc98-1a3c-443b-8195-3723b1836649 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:38:50.961192 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9f41cc98-1a3c-443b-8195-3723b1836649 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:38:50.961659 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-9f41cc98-1a3c-443b-8195-3723b1836649 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:38:51.111823 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-9f41cc98-1a3c-443b-8195-3723b1836649 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc44cc49a37432cb1eb70628f29e2f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938498ad9e794c2e8e95e9fafdd80259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:38:51.124406 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-9f41cc98-1a3c-443b-8195-3723b1836649 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] 10.222.0.43 "GET /compute/v2.1/servers/b2eb9de4-5509-44c7-b987-4361d3672fc7" status: 200 len: 1374 microversion: 2.1 time: 0.179141 Oct 04 23:38:51.136674 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4489/8159] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:38:50 2022] GET /compute/v2.1/servers/b2eb9de4-5509-44c7-b987-4361d3672fc7 => generated 1374 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:38:52.150816 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-96efde56-6867-497e-b8a9-8d40744491ab tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:38:52.152400 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-96efde56-6867-497e-b8a9-8d40744491ab tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] [instance: b2eb9de4-5509-44c7-b987-4361d3672fc7] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:38:52.166675 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-96efde56-6867-497e-b8a9-8d40744491ab tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:38:52.167180 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-96efde56-6867-497e-b8a9-8d40744491ab tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:38:52.167631 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-96efde56-6867-497e-b8a9-8d40744491ab tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:38:52.168391 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-96efde56-6867-497e-b8a9-8d40744491ab tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:38:52.168861 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-96efde56-6867-497e-b8a9-8d40744491ab tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:38:52.169301 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-96efde56-6867-497e-b8a9-8d40744491ab tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:38:52.339189 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-96efde56-6867-497e-b8a9-8d40744491ab tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc44cc49a37432cb1eb70628f29e2f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938498ad9e794c2e8e95e9fafdd80259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:38:52.349189 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-96efde56-6867-497e-b8a9-8d40744491ab tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] 10.222.0.43 "GET /compute/v2.1/servers/b2eb9de4-5509-44c7-b987-4361d3672fc7" status: 200 len: 1374 microversion: 2.1 time: 0.203540 Oct 04 23:38:52.350254 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3671/8160] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:38:52 2022] GET /compute/v2.1/servers/b2eb9de4-5509-44c7-b987-4361d3672fc7 => generated 1374 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:38:53.374343 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-d7cbb4fa-8c2f-4f41-9555-4587a3d9cc71 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:38:53.375184 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-d7cbb4fa-8c2f-4f41-9555-4587a3d9cc71 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] [instance: b2eb9de4-5509-44c7-b987-4361d3672fc7] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:38:53.382768 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d7cbb4fa-8c2f-4f41-9555-4587a3d9cc71 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:38:53.383401 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d7cbb4fa-8c2f-4f41-9555-4587a3d9cc71 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:38:53.383735 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d7cbb4fa-8c2f-4f41-9555-4587a3d9cc71 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:38:53.384474 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d7cbb4fa-8c2f-4f41-9555-4587a3d9cc71 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:38:53.385125 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d7cbb4fa-8c2f-4f41-9555-4587a3d9cc71 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:38:53.385677 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d7cbb4fa-8c2f-4f41-9555-4587a3d9cc71 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:38:53.544760 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-d7cbb4fa-8c2f-4f41-9555-4587a3d9cc71 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc44cc49a37432cb1eb70628f29e2f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938498ad9e794c2e8e95e9fafdd80259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:38:53.556208 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-d7cbb4fa-8c2f-4f41-9555-4587a3d9cc71 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] 10.222.0.43 "GET /compute/v2.1/servers/b2eb9de4-5509-44c7-b987-4361d3672fc7" status: 200 len: 1374 microversion: 2.1 time: 0.185776 Oct 04 23:38:53.556909 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4490/8161] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:38:53 2022] GET /compute/v2.1/servers/b2eb9de4-5509-44c7-b987-4361d3672fc7 => generated 1374 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:38:54.579694 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-76e84dbf-ad83-4b1d-bdc4-db3689f7e993 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:38:54.580303 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-76e84dbf-ad83-4b1d-bdc4-db3689f7e993 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] [instance: b2eb9de4-5509-44c7-b987-4361d3672fc7] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:38:54.587591 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-76e84dbf-ad83-4b1d-bdc4-db3689f7e993 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:38:54.588223 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-76e84dbf-ad83-4b1d-bdc4-db3689f7e993 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:38:54.588672 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-76e84dbf-ad83-4b1d-bdc4-db3689f7e993 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:38:54.589474 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-76e84dbf-ad83-4b1d-bdc4-db3689f7e993 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:38:54.589945 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-76e84dbf-ad83-4b1d-bdc4-db3689f7e993 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:38:54.591838 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-76e84dbf-ad83-4b1d-bdc4-db3689f7e993 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:38:54.796609 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-76e84dbf-ad83-4b1d-bdc4-db3689f7e993 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc44cc49a37432cb1eb70628f29e2f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938498ad9e794c2e8e95e9fafdd80259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:38:54.805312 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-76e84dbf-ad83-4b1d-bdc4-db3689f7e993 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] 10.222.0.43 "GET /compute/v2.1/servers/b2eb9de4-5509-44c7-b987-4361d3672fc7" status: 200 len: 1374 microversion: 2.1 time: 0.229503 Oct 04 23:38:54.806958 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3672/8162] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:38:54 2022] GET /compute/v2.1/servers/b2eb9de4-5509-44c7-b987-4361d3672fc7 => generated 1374 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:38:55.836229 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-c66c5990-c0b7-4b7f-ab6c-79e049c23b67 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:38:55.837539 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-c66c5990-c0b7-4b7f-ab6c-79e049c23b67 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] [instance: b2eb9de4-5509-44c7-b987-4361d3672fc7] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:38:55.844657 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c66c5990-c0b7-4b7f-ab6c-79e049c23b67 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:38:55.845151 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c66c5990-c0b7-4b7f-ab6c-79e049c23b67 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:38:55.845618 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c66c5990-c0b7-4b7f-ab6c-79e049c23b67 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:38:55.846306 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c66c5990-c0b7-4b7f-ab6c-79e049c23b67 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:38:55.846802 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c66c5990-c0b7-4b7f-ab6c-79e049c23b67 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:38:55.847242 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c66c5990-c0b7-4b7f-ab6c-79e049c23b67 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:38:55.982652 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-c66c5990-c0b7-4b7f-ab6c-79e049c23b67 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc44cc49a37432cb1eb70628f29e2f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938498ad9e794c2e8e95e9fafdd80259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:38:55.990758 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-c66c5990-c0b7-4b7f-ab6c-79e049c23b67 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] 10.222.0.43 "GET /compute/v2.1/servers/b2eb9de4-5509-44c7-b987-4361d3672fc7" status: 200 len: 1374 microversion: 2.1 time: 0.158488 Oct 04 23:38:55.991351 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4491/8163] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:38:55 2022] GET /compute/v2.1/servers/b2eb9de4-5509-44c7-b987-4361d3672fc7 => generated 1374 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:38:57.014143 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-c5762daa-b61b-4a05-b566-5c80780203b1 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:38:57.014774 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-c5762daa-b61b-4a05-b566-5c80780203b1 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] [instance: b2eb9de4-5509-44c7-b987-4361d3672fc7] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:38:57.017482 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell0:SELECT=2 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:38:57.023117 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c5762daa-b61b-4a05-b566-5c80780203b1 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:38:57.023605 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c5762daa-b61b-4a05-b566-5c80780203b1 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:38:57.024046 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c5762daa-b61b-4a05-b566-5c80780203b1 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:38:57.025374 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c5762daa-b61b-4a05-b566-5c80780203b1 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:38:57.025830 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c5762daa-b61b-4a05-b566-5c80780203b1 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:38:57.026261 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-c5762daa-b61b-4a05-b566-5c80780203b1 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:38:57.157689 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-c5762daa-b61b-4a05-b566-5c80780203b1 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc44cc49a37432cb1eb70628f29e2f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938498ad9e794c2e8e95e9fafdd80259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:38:57.165525 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-c5762daa-b61b-4a05-b566-5c80780203b1 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] 10.222.0.43 "GET /compute/v2.1/servers/b2eb9de4-5509-44c7-b987-4361d3672fc7" status: 200 len: 1374 microversion: 2.1 time: 0.155243 Oct 04 23:38:57.166126 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3673/8164] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:38:57 2022] GET /compute/v2.1/servers/b2eb9de4-5509-44c7-b987-4361d3672fc7 => generated 1374 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:38:58.188299 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-fbde05fe-aeea-471f-ba44-32d70b861335 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:38:58.188937 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-fbde05fe-aeea-471f-ba44-32d70b861335 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] [instance: b2eb9de4-5509-44c7-b987-4361d3672fc7] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:38:58.190999 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=2 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:38:58.191775 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell0:SELECT=6 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:38:58.199311 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fbde05fe-aeea-471f-ba44-32d70b861335 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:38:58.199824 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fbde05fe-aeea-471f-ba44-32d70b861335 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:38:58.200281 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fbde05fe-aeea-471f-ba44-32d70b861335 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:38:58.201006 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fbde05fe-aeea-471f-ba44-32d70b861335 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:38:58.201485 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fbde05fe-aeea-471f-ba44-32d70b861335 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:38:58.201935 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-fbde05fe-aeea-471f-ba44-32d70b861335 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:38:58.673675 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-7f33ed1f-e8cf-4a0c-a3c8-dceb3d7a3d35 req-de545250-be37-47f2-9fcc-707c114dde3b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2eb9de4-5509-44c7-b987-4361d3672fc7", "tag": "e48cf48f-fdba-4f06-b3e6-e033d98005c8"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 23:38:58.684489 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-7f33ed1f-e8cf-4a0c-a3c8-dceb3d7a3d35 req-de545250-be37-47f2-9fcc-707c114dde3b service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:38:58.684489 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-7f33ed1f-e8cf-4a0c-a3c8-dceb3d7a3d35 req-de545250-be37-47f2-9fcc-707c114dde3b service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:38:58.684835 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-7f33ed1f-e8cf-4a0c-a3c8-dceb3d7a3d35 req-de545250-be37-47f2-9fcc-707c114dde3b service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:38:58.697887 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-7f33ed1f-e8cf-4a0c-a3c8-dceb3d7a3d35 req-de545250-be37-47f2-9fcc-707c114dde3b service nova] Creating event network-changed:e48cf48f-fdba-4f06-b3e6-e033d98005c8 for instance b2eb9de4-5509-44c7-b987-4361d3672fc7 on n-h2-860284-1 Oct 04 23:38:58.703751 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-7f33ed1f-e8cf-4a0c-a3c8-dceb3d7a3d35 req-de545250-be37-47f2-9fcc-707c114dde3b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093797 Oct 04 23:38:58.704376 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3674/8165] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 23:38:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 23:38:58.736802 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-fbde05fe-aeea-471f-ba44-32d70b861335 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc44cc49a37432cb1eb70628f29e2f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938498ad9e794c2e8e95e9fafdd80259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:38:58.745089 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-fbde05fe-aeea-471f-ba44-32d70b861335 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] 10.222.0.43 "GET /compute/v2.1/servers/b2eb9de4-5509-44c7-b987-4361d3672fc7" status: 200 len: 1374 microversion: 2.1 time: 0.560768 Oct 04 23:38:58.745676 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4492/8166] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:38:58 2022] GET /compute/v2.1/servers/b2eb9de4-5509-44c7-b987-4361d3672fc7 => generated 1374 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:38:59.770223 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-236c9268-1f40-43bb-98a3-368c3759a75d tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:38:59.770969 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-236c9268-1f40-43bb-98a3-368c3759a75d tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] [instance: b2eb9de4-5509-44c7-b987-4361d3672fc7] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:38:59.778214 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-236c9268-1f40-43bb-98a3-368c3759a75d tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:38:59.778734 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-236c9268-1f40-43bb-98a3-368c3759a75d tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:38:59.779178 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-236c9268-1f40-43bb-98a3-368c3759a75d tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:38:59.779879 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-236c9268-1f40-43bb-98a3-368c3759a75d tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:38:59.780346 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-236c9268-1f40-43bb-98a3-368c3759a75d tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:38:59.780771 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-236c9268-1f40-43bb-98a3-368c3759a75d tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:38:59.919146 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-236c9268-1f40-43bb-98a3-368c3759a75d tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc44cc49a37432cb1eb70628f29e2f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938498ad9e794c2e8e95e9fafdd80259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:38:59.926952 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-236c9268-1f40-43bb-98a3-368c3759a75d tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] 10.222.0.43 "GET /compute/v2.1/servers/b2eb9de4-5509-44c7-b987-4361d3672fc7" status: 200 len: 1374 microversion: 2.1 time: 0.161870 Oct 04 23:38:59.927536 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3675/8167] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:38:59 2022] GET /compute/v2.1/servers/b2eb9de4-5509-44c7-b987-4361d3672fc7 => generated 1374 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:39:00.950033 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-d398f9df-e592-4a1b-8680-a4299d3034b7 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:39:00.950672 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-d398f9df-e592-4a1b-8680-a4299d3034b7 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] [instance: b2eb9de4-5509-44c7-b987-4361d3672fc7] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:39:00.957492 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d398f9df-e592-4a1b-8680-a4299d3034b7 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:39:00.957989 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d398f9df-e592-4a1b-8680-a4299d3034b7 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:39:00.958467 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d398f9df-e592-4a1b-8680-a4299d3034b7 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:39:00.959174 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d398f9df-e592-4a1b-8680-a4299d3034b7 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:39:00.959641 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d398f9df-e592-4a1b-8680-a4299d3034b7 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:39:00.960079 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-d398f9df-e592-4a1b-8680-a4299d3034b7 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:39:01.097186 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-d398f9df-e592-4a1b-8680-a4299d3034b7 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc44cc49a37432cb1eb70628f29e2f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938498ad9e794c2e8e95e9fafdd80259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:39:01.105506 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-d398f9df-e592-4a1b-8680-a4299d3034b7 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] 10.222.0.43 "GET /compute/v2.1/servers/b2eb9de4-5509-44c7-b987-4361d3672fc7" status: 200 len: 1374 microversion: 2.1 time: 0.159595 Oct 04 23:39:01.106088 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4493/8168] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:39:00 2022] GET /compute/v2.1/servers/b2eb9de4-5509-44c7-b987-4361d3672fc7 => generated 1374 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:39:02.129082 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-9f186dbd-38e6-44e5-9ab3-1a6b69428368 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:39:02.129709 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-9f186dbd-38e6-44e5-9ab3-1a6b69428368 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] [instance: b2eb9de4-5509-44c7-b987-4361d3672fc7] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:39:02.137445 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9f186dbd-38e6-44e5-9ab3-1a6b69428368 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:39:02.137944 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9f186dbd-38e6-44e5-9ab3-1a6b69428368 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:39:02.138417 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9f186dbd-38e6-44e5-9ab3-1a6b69428368 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:39:02.139136 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9f186dbd-38e6-44e5-9ab3-1a6b69428368 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:39:02.139599 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9f186dbd-38e6-44e5-9ab3-1a6b69428368 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:39:02.140033 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9f186dbd-38e6-44e5-9ab3-1a6b69428368 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:39:02.275178 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-9f186dbd-38e6-44e5-9ab3-1a6b69428368 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc44cc49a37432cb1eb70628f29e2f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938498ad9e794c2e8e95e9fafdd80259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:39:02.283094 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-9f186dbd-38e6-44e5-9ab3-1a6b69428368 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] 10.222.0.43 "GET /compute/v2.1/servers/b2eb9de4-5509-44c7-b987-4361d3672fc7" status: 200 len: 1374 microversion: 2.1 time: 0.157925 Oct 04 23:39:02.283700 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3676/8169] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:39:02 2022] GET /compute/v2.1/servers/b2eb9de4-5509-44c7-b987-4361d3672fc7 => generated 1374 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:39:03.306905 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-42946061-511a-42a4-9cfa-648fe6d83a5a tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:39:03.307563 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-42946061-511a-42a4-9cfa-648fe6d83a5a tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] [instance: b2eb9de4-5509-44c7-b987-4361d3672fc7] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:39:03.314513 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-42946061-511a-42a4-9cfa-648fe6d83a5a tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:39:03.315018 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-42946061-511a-42a4-9cfa-648fe6d83a5a tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:39:03.315473 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-42946061-511a-42a4-9cfa-648fe6d83a5a tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:39:03.316181 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-42946061-511a-42a4-9cfa-648fe6d83a5a tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:39:03.316657 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-42946061-511a-42a4-9cfa-648fe6d83a5a tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:39:03.317104 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-42946061-511a-42a4-9cfa-648fe6d83a5a tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:39:03.453293 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-42946061-511a-42a4-9cfa-648fe6d83a5a tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc44cc49a37432cb1eb70628f29e2f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938498ad9e794c2e8e95e9fafdd80259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:39:03.461237 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-42946061-511a-42a4-9cfa-648fe6d83a5a tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] 10.222.0.43 "GET /compute/v2.1/servers/b2eb9de4-5509-44c7-b987-4361d3672fc7" status: 200 len: 1374 microversion: 2.1 time: 0.158552 Oct 04 23:39:03.462190 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4494/8170] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:39:03 2022] GET /compute/v2.1/servers/b2eb9de4-5509-44c7-b987-4361d3672fc7 => generated 1374 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:39:04.456650 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-163dc3b7-e48c-4e91-aa00-7ee892dc7401 req-77e859ed-ce77-4d04-b32c-56be1ecf6533 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2eb9de4-5509-44c7-b987-4361d3672fc7", "name": "network-vif-plugged", "status": "completed", "tag": "e48cf48f-fdba-4f06-b3e6-e033d98005c8"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 23:39:04.467459 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-163dc3b7-e48c-4e91-aa00-7ee892dc7401 req-77e859ed-ce77-4d04-b32c-56be1ecf6533 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:39:04.468204 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-163dc3b7-e48c-4e91-aa00-7ee892dc7401 req-77e859ed-ce77-4d04-b32c-56be1ecf6533 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:39:04.468646 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-163dc3b7-e48c-4e91-aa00-7ee892dc7401 req-77e859ed-ce77-4d04-b32c-56be1ecf6533 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:39:04.480115 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-163dc3b7-e48c-4e91-aa00-7ee892dc7401 req-77e859ed-ce77-4d04-b32c-56be1ecf6533 service nova] Creating event network-vif-plugged:e48cf48f-fdba-4f06-b3e6-e033d98005c8 for instance b2eb9de4-5509-44c7-b987-4361d3672fc7 on n-h2-860284-1 Oct 04 23:39:04.485788 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-163dc3b7-e48c-4e91-aa00-7ee892dc7401 req-77e859ed-ce77-4d04-b32c-56be1ecf6533 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032802 Oct 04 23:39:04.486609 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3677/8171] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 23:39:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 23:39:04.487123 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-2c7dabb4-4232-45db-97be-73d2c6f27355 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:39:04.487770 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-2c7dabb4-4232-45db-97be-73d2c6f27355 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] [instance: b2eb9de4-5509-44c7-b987-4361d3672fc7] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:39:04.495224 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2c7dabb4-4232-45db-97be-73d2c6f27355 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:39:04.495740 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2c7dabb4-4232-45db-97be-73d2c6f27355 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:39:04.496207 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2c7dabb4-4232-45db-97be-73d2c6f27355 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:39:04.496933 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2c7dabb4-4232-45db-97be-73d2c6f27355 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:39:04.497412 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2c7dabb4-4232-45db-97be-73d2c6f27355 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:39:04.497863 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-2c7dabb4-4232-45db-97be-73d2c6f27355 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:39:04.678231 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-2c7dabb4-4232-45db-97be-73d2c6f27355 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc44cc49a37432cb1eb70628f29e2f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938498ad9e794c2e8e95e9fafdd80259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:39:04.686959 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-2c7dabb4-4232-45db-97be-73d2c6f27355 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] 10.222.0.43 "GET /compute/v2.1/servers/b2eb9de4-5509-44c7-b987-4361d3672fc7" status: 200 len: 1374 microversion: 2.1 time: 0.205676 Oct 04 23:39:04.687558 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4495/8172] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:39:04 2022] GET /compute/v2.1/servers/b2eb9de4-5509-44c7-b987-4361d3672fc7 => generated 1374 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 23:39:05.712707 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-a69903fa-53a8-4e21-ab48-a97436959fdb tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:39:05.713426 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-a69903fa-53a8-4e21-ab48-a97436959fdb tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] [instance: b2eb9de4-5509-44c7-b987-4361d3672fc7] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:39:05.719881 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a69903fa-53a8-4e21-ab48-a97436959fdb tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:39:05.720366 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a69903fa-53a8-4e21-ab48-a97436959fdb tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:39:05.720801 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a69903fa-53a8-4e21-ab48-a97436959fdb tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:39:05.721501 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a69903fa-53a8-4e21-ab48-a97436959fdb tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:39:05.721960 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a69903fa-53a8-4e21-ab48-a97436959fdb tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:39:05.722407 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-a69903fa-53a8-4e21-ab48-a97436959fdb tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:39:05.860105 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-a69903fa-53a8-4e21-ab48-a97436959fdb tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc44cc49a37432cb1eb70628f29e2f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938498ad9e794c2e8e95e9fafdd80259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:39:05.867751 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-a69903fa-53a8-4e21-ab48-a97436959fdb tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] 10.222.0.43 "GET /compute/v2.1/servers/b2eb9de4-5509-44c7-b987-4361d3672fc7" status: 200 len: 1374 microversion: 2.1 time: 0.160885 Oct 04 23:39:05.868348 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3678/8173] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:39:05 2022] GET /compute/v2.1/servers/b2eb9de4-5509-44c7-b987-4361d3672fc7 => generated 1374 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:39:06.891212 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-c2755cd7-0af3-4e51-a9b3-0fa964bc9886 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:39:06.891854 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-c2755cd7-0af3-4e51-a9b3-0fa964bc9886 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] [instance: b2eb9de4-5509-44c7-b987-4361d3672fc7] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:39:06.898871 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c2755cd7-0af3-4e51-a9b3-0fa964bc9886 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:39:06.899400 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c2755cd7-0af3-4e51-a9b3-0fa964bc9886 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:39:06.899871 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c2755cd7-0af3-4e51-a9b3-0fa964bc9886 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:39:06.900576 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c2755cd7-0af3-4e51-a9b3-0fa964bc9886 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:39:06.901043 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c2755cd7-0af3-4e51-a9b3-0fa964bc9886 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:39:06.901482 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c2755cd7-0af3-4e51-a9b3-0fa964bc9886 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:39:07.036936 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-c2755cd7-0af3-4e51-a9b3-0fa964bc9886 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc44cc49a37432cb1eb70628f29e2f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938498ad9e794c2e8e95e9fafdd80259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:39:07.045418 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-c2755cd7-0af3-4e51-a9b3-0fa964bc9886 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] 10.222.0.43 "GET /compute/v2.1/servers/b2eb9de4-5509-44c7-b987-4361d3672fc7" status: 200 len: 1559 microversion: 2.1 time: 0.158171 Oct 04 23:39:07.046181 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4496/8174] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:39:06 2022] GET /compute/v2.1/servers/b2eb9de4-5509-44c7-b987-4361d3672fc7 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:39:07.068886 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-f112659a-a9eb-49a5-b089-2bed13f3dee9 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:39:07.069515 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-f112659a-a9eb-49a5-b089-2bed13f3dee9 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] [instance: b2eb9de4-5509-44c7-b987-4361d3672fc7] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:39:07.076628 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f112659a-a9eb-49a5-b089-2bed13f3dee9 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:39:07.077116 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f112659a-a9eb-49a5-b089-2bed13f3dee9 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:39:07.077562 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f112659a-a9eb-49a5-b089-2bed13f3dee9 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:39:07.078261 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f112659a-a9eb-49a5-b089-2bed13f3dee9 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:39:07.078751 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f112659a-a9eb-49a5-b089-2bed13f3dee9 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:39:07.079183 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-f112659a-a9eb-49a5-b089-2bed13f3dee9 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:39:07.210521 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-f112659a-a9eb-49a5-b089-2bed13f3dee9 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc44cc49a37432cb1eb70628f29e2f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938498ad9e794c2e8e95e9fafdd80259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:39:07.219466 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-f112659a-a9eb-49a5-b089-2bed13f3dee9 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] 10.222.0.43 "GET /compute/v2.1/servers/b2eb9de4-5509-44c7-b987-4361d3672fc7" status: 200 len: 1559 microversion: 2.1 time: 0.154428 Oct 04 23:39:07.220047 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3679/8175] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:39:07 2022] GET /compute/v2.1/servers/b2eb9de4-5509-44c7-b987-4361d3672fc7 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:39:09.099144 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-21db7770-2f0b-4a45-9ba3-96ea19f12540 req-1400357e-babc-42ad-869b-b791b71abebf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2eb9de4-5509-44c7-b987-4361d3672fc7", "tag": "e48cf48f-fdba-4f06-b3e6-e033d98005c8"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 23:39:09.110178 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-21db7770-2f0b-4a45-9ba3-96ea19f12540 req-1400357e-babc-42ad-869b-b791b71abebf service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:39:09.110956 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-21db7770-2f0b-4a45-9ba3-96ea19f12540 req-1400357e-babc-42ad-869b-b791b71abebf service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:39:09.111473 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-21db7770-2f0b-4a45-9ba3-96ea19f12540 req-1400357e-babc-42ad-869b-b791b71abebf service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:39:09.123279 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-21db7770-2f0b-4a45-9ba3-96ea19f12540 req-1400357e-babc-42ad-869b-b791b71abebf service nova] Creating event network-changed:e48cf48f-fdba-4f06-b3e6-e033d98005c8 for instance b2eb9de4-5509-44c7-b987-4361d3672fc7 on n-h2-860284-1 Oct 04 23:39:09.128753 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-21db7770-2f0b-4a45-9ba3-96ea19f12540 req-1400357e-babc-42ad-869b-b791b71abebf service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033926 Oct 04 23:39:09.129562 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4497/8176] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 23:39:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 23:41:22.388912 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_api:SELECT=26 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:41:22.389613 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=58 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:41:22.507035 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-e1681d87-5000-4a4f-9db0-23f1eda656b1 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-1833397729"}} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 23:41:22.510225 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-e1681d87-5000-4a4f-9db0-23f1eda656b1 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] [instance: b2eb9de4-5509-44c7-b987-4361d3672fc7] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:41:22.517059 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e1681d87-5000-4a4f-9db0-23f1eda656b1 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:41:22.517554 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e1681d87-5000-4a4f-9db0-23f1eda656b1 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:41:22.517994 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e1681d87-5000-4a4f-9db0-23f1eda656b1 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:41:22.518731 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e1681d87-5000-4a4f-9db0-23f1eda656b1 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:41:22.519197 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e1681d87-5000-4a4f-9db0-23f1eda656b1 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:41:22.519629 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-e1681d87-5000-4a4f-9db0-23f1eda656b1 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:41:22.817470 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-e1681d87-5000-4a4f-9db0-23f1eda656b1 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] 10.222.0.43 "POST /compute/v2.1/servers/b2eb9de4-5509-44c7-b987-4361d3672fc7/action" status: 202 len: 0 microversion: 2.1 time: 0.430414 Oct 04 23:41:22.818135 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3680/8177] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Oct 4 23:41:22 2022] POST /compute/v2.1/servers/b2eb9de4-5509-44c7-b987-4361d3672fc7/action => generated 0 bytes in 432 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 04 23:41:29.316728 n-d-860284-1 devstack@n-api.service[134101]: ERROR oslo.messaging._drivers.impl_rabbit [-] [dab38095-fcf8-46d0-9904-6bfbf5d1f82a] AMQP server on 10.222.0.43:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 04 23:41:29.318488 n-d-860284-1 devstack@n-api.service[134101]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f8e2fc52-bb96-4bc7-8039-fbfc8addcbeb] AMQP server on 10.222.0.43:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 04 23:41:29.319198 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:41:29.320046 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=60 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:41:29.320981 n-d-860284-1 devstack@n-api.service[134101]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 04 23:41:29.321128 n-d-860284-1 devstack@n-api.service[134101]: Tue Oct 4 23:41:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.43) !!! Oct 04 23:41:29.322578 n-d-860284-1 devstack@n-api.service[134101]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 04 23:41:29.322708 n-d-860284-1 devstack@n-api.service[134101]: Tue Oct 4 23:41:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.43) !!! Oct 04 23:41:29.323794 n-d-860284-1 devstack@n-api.service[134101]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 04 23:41:29.323921 n-d-860284-1 devstack@n-api.service[134101]: Tue Oct 4 23:41:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.43) !!! Oct 04 23:41:29.422990 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-4ab4d348-b7aa-41e4-a577-59a95c4c9e78 req-2c8f778e-050c-45ef-b334-642d57503759 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2eb9de4-5509-44c7-b987-4361d3672fc7", "name": "network-vif-plugged", "status": "completed", "tag": "e48cf48f-fdba-4f06-b3e6-e033d98005c8"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 23:41:29.436911 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-4ab4d348-b7aa-41e4-a577-59a95c4c9e78 req-2c8f778e-050c-45ef-b334-642d57503759 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:41:29.437407 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-4ab4d348-b7aa-41e4-a577-59a95c4c9e78 req-2c8f778e-050c-45ef-b334-642d57503759 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:41:29.437859 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-4ab4d348-b7aa-41e4-a577-59a95c4c9e78 req-2c8f778e-050c-45ef-b334-642d57503759 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:41:29.448193 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-4ab4d348-b7aa-41e4-a577-59a95c4c9e78 req-2c8f778e-050c-45ef-b334-642d57503759 service nova] Creating event network-vif-plugged:e48cf48f-fdba-4f06-b3e6-e033d98005c8 for instance b2eb9de4-5509-44c7-b987-4361d3672fc7 on n-h2-860284-1 Oct 04 23:41:29.454181 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-4ab4d348-b7aa-41e4-a577-59a95c4c9e78 req-2c8f778e-050c-45ef-b334-642d57503759 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.139370 Oct 04 23:41:29.454824 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4498/8178] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 23:41:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 23:41:40.573274 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_api:SELECT=2 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:41:40.574770 n-d-860284-1 devstack@n-api.service[134102]: DEBUG dbcounter [-] [134102] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:41:40.580167 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-de9cf609-eced-4bf6-b27b-b45400280557 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:41:40.580979 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-de9cf609-eced-4bf6-b27b-b45400280557 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] [instance: b2eb9de4-5509-44c7-b987-4361d3672fc7] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:41:40.589311 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-de9cf609-eced-4bf6-b27b-b45400280557 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:41:40.589810 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-de9cf609-eced-4bf6-b27b-b45400280557 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:41:40.590261 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-de9cf609-eced-4bf6-b27b-b45400280557 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:41:40.591277 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-de9cf609-eced-4bf6-b27b-b45400280557 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:41:40.591739 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-de9cf609-eced-4bf6-b27b-b45400280557 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:41:40.592375 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-de9cf609-eced-4bf6-b27b-b45400280557 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:41:40.617277 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_api:SELECT=2 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:41:40.618041 n-d-860284-1 devstack@n-api.service[134101]: DEBUG dbcounter [-] [134101] Writing DB stats nova_cell1:SELECT=2 {{(pid=134101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:41:40.624662 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-de9cf609-eced-4bf6-b27b-b45400280557 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] [instance: b2eb9de4-5509-44c7-b987-4361d3672fc7] Going to try to terminate instance {{(pid=134102) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 23:41:40.636070 n-d-860284-1 devstack@n-api.service[134101]: INFO oslo.messaging._drivers.impl_rabbit [-] [dab38095-fcf8-46d0-9904-6bfbf5d1f82a] Reconnected to AMQP server on 10.222.0.43:5672 via [amqp] client with port 41908. Oct 04 23:41:40.638546 n-d-860284-1 devstack@n-api.service[134101]: INFO oslo.messaging._drivers.impl_rabbit [-] [f8e2fc52-bb96-4bc7-8039-fbfc8addcbeb] Reconnected to AMQP server on 10.222.0.43:5672 via [amqp] client with port 41910. Oct 04 23:41:40.709686 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-07135a59-b4d7-4f5c-8667-739323511fa1 req-7c31e6ec-917d-42cd-8b68-de4d77458ad9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2eb9de4-5509-44c7-b987-4361d3672fc7", "tag": "e48cf48f-fdba-4f06-b3e6-e033d98005c8"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 23:41:40.709868 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-de9cf609-eced-4bf6-b27b-b45400280557 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] 10.222.0.43 "DELETE /compute/v2.1/servers/b2eb9de4-5509-44c7-b987-4361d3672fc7" status: 204 len: 0 microversion: 2.1 time: 0.143495 Oct 04 23:41:40.710797 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3681/8179] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 23:41:40 2022] DELETE /compute/v2.1/servers/b2eb9de4-5509-44c7-b987-4361d3672fc7 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 23:41:40.720032 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-9ae7751b-1863-44f8-90e8-dc45041a8526 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:41:40.720866 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-9ae7751b-1863-44f8-90e8-dc45041a8526 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] [instance: b2eb9de4-5509-44c7-b987-4361d3672fc7] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:41:40.727561 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9ae7751b-1863-44f8-90e8-dc45041a8526 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:41:40.728136 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9ae7751b-1863-44f8-90e8-dc45041a8526 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:41:40.728650 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9ae7751b-1863-44f8-90e8-dc45041a8526 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:41:40.730063 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9ae7751b-1863-44f8-90e8-dc45041a8526 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:41:40.730865 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-07135a59-b4d7-4f5c-8667-739323511fa1 req-7c31e6ec-917d-42cd-8b68-de4d77458ad9 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:41:40.731020 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9ae7751b-1863-44f8-90e8-dc45041a8526 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:41:40.731366 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-07135a59-b4d7-4f5c-8667-739323511fa1 req-7c31e6ec-917d-42cd-8b68-de4d77458ad9 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:41:40.731522 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-9ae7751b-1863-44f8-90e8-dc45041a8526 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:41:40.731832 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-07135a59-b4d7-4f5c-8667-739323511fa1 req-7c31e6ec-917d-42cd-8b68-de4d77458ad9 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:41:40.744555 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-07135a59-b4d7-4f5c-8667-739323511fa1 req-7c31e6ec-917d-42cd-8b68-de4d77458ad9 service nova] Creating event network-changed:e48cf48f-fdba-4f06-b3e6-e033d98005c8 for instance b2eb9de4-5509-44c7-b987-4361d3672fc7 on n-h2-860284-1 Oct 04 23:41:40.750539 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-07135a59-b4d7-4f5c-8667-739323511fa1 req-7c31e6ec-917d-42cd-8b68-de4d77458ad9 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.137168 Oct 04 23:41:40.752168 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4499/8180] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 23:41:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 23:41:40.876460 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-9ae7751b-1863-44f8-90e8-dc45041a8526 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc44cc49a37432cb1eb70628f29e2f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938498ad9e794c2e8e95e9fafdd80259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:41:40.884228 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-9ae7751b-1863-44f8-90e8-dc45041a8526 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] 10.222.0.43 "GET /compute/v2.1/servers/b2eb9de4-5509-44c7-b987-4361d3672fc7" status: 200 len: 1684 microversion: 2.1 time: 0.168808 Oct 04 23:41:40.884818 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3682/8181] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:41:40 2022] GET /compute/v2.1/servers/b2eb9de4-5509-44c7-b987-4361d3672fc7 => generated 1684 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 23:41:41.908175 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-ed77a582-d018-4e19-bc34-377fb1ab2eff tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:41:41.908850 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-ed77a582-d018-4e19-bc34-377fb1ab2eff tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] [instance: b2eb9de4-5509-44c7-b987-4361d3672fc7] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:41:41.915968 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ed77a582-d018-4e19-bc34-377fb1ab2eff tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:41:41.917165 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ed77a582-d018-4e19-bc34-377fb1ab2eff tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:41:41.917633 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ed77a582-d018-4e19-bc34-377fb1ab2eff tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:41:41.918347 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ed77a582-d018-4e19-bc34-377fb1ab2eff tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:41:41.918846 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ed77a582-d018-4e19-bc34-377fb1ab2eff tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:41:41.919295 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-ed77a582-d018-4e19-bc34-377fb1ab2eff tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:41:42.221218 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-ed77a582-d018-4e19-bc34-377fb1ab2eff tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc44cc49a37432cb1eb70628f29e2f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938498ad9e794c2e8e95e9fafdd80259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:41:42.230065 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-ed77a582-d018-4e19-bc34-377fb1ab2eff tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] 10.222.0.43 "GET /compute/v2.1/servers/b2eb9de4-5509-44c7-b987-4361d3672fc7" status: 200 len: 1684 microversion: 2.1 time: 0.326248 Oct 04 23:41:42.230684 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4500/8182] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:41:41 2022] GET /compute/v2.1/servers/b2eb9de4-5509-44c7-b987-4361d3672fc7 => generated 1684 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:41:43.254582 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-3abd227e-eddb-4432-b487-15a3cb1fc89b tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:41:43.255211 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-3abd227e-eddb-4432-b487-15a3cb1fc89b tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] [instance: b2eb9de4-5509-44c7-b987-4361d3672fc7] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:41:43.263142 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3abd227e-eddb-4432-b487-15a3cb1fc89b tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:41:43.263635 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3abd227e-eddb-4432-b487-15a3cb1fc89b tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:41:43.264272 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3abd227e-eddb-4432-b487-15a3cb1fc89b tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:41:43.265544 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3abd227e-eddb-4432-b487-15a3cb1fc89b tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:41:43.265694 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3abd227e-eddb-4432-b487-15a3cb1fc89b tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:41:43.266121 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-3abd227e-eddb-4432-b487-15a3cb1fc89b tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:41:43.407104 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-3abd227e-eddb-4432-b487-15a3cb1fc89b tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc44cc49a37432cb1eb70628f29e2f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938498ad9e794c2e8e95e9fafdd80259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:41:43.415227 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-3abd227e-eddb-4432-b487-15a3cb1fc89b tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] 10.222.0.43 "GET /compute/v2.1/servers/b2eb9de4-5509-44c7-b987-4361d3672fc7" status: 200 len: 1565 microversion: 2.1 time: 0.164581 Oct 04 23:41:43.415826 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3683/8183] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:41:43 2022] GET /compute/v2.1/servers/b2eb9de4-5509-44c7-b987-4361d3672fc7 => generated 1565 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:41:43.423811 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [req-aadacae5-99d3-43e5-ba7a-f5fd769acb0d req-3602ab05-164c-4ca5-b48b-06d6b352e605 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2eb9de4-5509-44c7-b987-4361d3672fc7", "name": "network-vif-deleted", "tag": "e48cf48f-fdba-4f06-b3e6-e033d98005c8"}]} {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 23:41:43.435619 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-aadacae5-99d3-43e5-ba7a-f5fd769acb0d req-3602ab05-164c-4ca5-b48b-06d6b352e605 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:41:43.436113 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-aadacae5-99d3-43e5-ba7a-f5fd769acb0d req-3602ab05-164c-4ca5-b48b-06d6b352e605 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:41:43.436772 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [req-aadacae5-99d3-43e5-ba7a-f5fd769acb0d req-3602ab05-164c-4ca5-b48b-06d6b352e605 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:41:43.448823 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.compute.server_external_events [req-aadacae5-99d3-43e5-ba7a-f5fd769acb0d req-3602ab05-164c-4ca5-b48b-06d6b352e605 service nova] Creating event network-vif-deleted:e48cf48f-fdba-4f06-b3e6-e033d98005c8 for instance b2eb9de4-5509-44c7-b987-4361d3672fc7 on n-h2-860284-1 Oct 04 23:41:43.453966 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [req-aadacae5-99d3-43e5-ba7a-f5fd769acb0d req-3602ab05-164c-4ca5-b48b-06d6b352e605 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033883 Oct 04 23:41:43.454852 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4501/8184] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 23:41:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 23:41:44.439687 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-ebe86d5b-06af-4141-b6d4-d878aa2777f8 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:41:44.440237 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-ebe86d5b-06af-4141-b6d4-d878aa2777f8 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] [instance: b2eb9de4-5509-44c7-b987-4361d3672fc7] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:41:44.446969 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ebe86d5b-06af-4141-b6d4-d878aa2777f8 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:41:44.447450 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ebe86d5b-06af-4141-b6d4-d878aa2777f8 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:41:44.447881 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ebe86d5b-06af-4141-b6d4-d878aa2777f8 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:41:44.448561 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ebe86d5b-06af-4141-b6d4-d878aa2777f8 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:41:44.449014 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ebe86d5b-06af-4141-b6d4-d878aa2777f8 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:41:44.449434 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-ebe86d5b-06af-4141-b6d4-d878aa2777f8 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:41:44.463301 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.wsgi [None req-ebe86d5b-06af-4141-b6d4-d878aa2777f8 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] HTTP exception thrown: Instance b2eb9de4-5509-44c7-b987-4361d3672fc7 could not be found. Oct 04 23:41:44.464952 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-ebe86d5b-06af-4141-b6d4-d878aa2777f8 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Request method failure captured: Oct 04 23:41:44.464952 n-d-860284-1 devstack@n-api.service[134102]: request: GET /compute/v2.1/servers/b2eb9de4-5509-44c7-b987-4361d3672fc7 HTTP/1.1 Oct 04 23:41:44.464952 n-d-860284-1 devstack@n-api.service[134102]: Accept: application/json Oct 04 23:41:44.464952 n-d-860284-1 devstack@n-api.service[134102]: Accept-Encoding: identity Oct 04 23:41:44.464952 n-d-860284-1 devstack@n-api.service[134102]: Connection: close Oct 04 23:41:44.464952 n-d-860284-1 devstack@n-api.service[134102]: Content-Length: 0 Oct 04 23:41:44.464952 n-d-860284-1 devstack@n-api.service[134102]: Content-Type: application/json Oct 04 23:41:44.464952 n-d-860284-1 devstack@n-api.service[134102]: Host: 10.222.0.43 Oct 04 23:41:44.464952 n-d-860284-1 devstack@n-api.service[134102]: Openstack-System-Scope: None Oct 04 23:41:44.464952 n-d-860284-1 devstack@n-api.service[134102]: User-Agent: python-urllib3/1.26.12 Oct 04 23:41:44.464952 n-d-860284-1 devstack@n-api.service[134102]: X-Auth-Token: gAAAAABjPMM8TibtHWW4-RTvmhkx0ScuigVkjrh4rJ-kCEc4seGbyVMSb6vBC7GElin9MR4P4pUuG-ywigBgEcsm7D0jkY5RXOWJUAOUFCxQDyMhknDWAEhGEqrJPvQSlDjHNRGU3G-nOTxB7dfUiqr9Sxsz5Xf9y6-TbNnYxbUSp-piv2EV3C8 Oct 04 23:41:44.464952 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Id: None Oct 04 23:41:44.464952 n-d-860284-1 devstack@n-api.service[134102]: X-Domain-Name: None Oct 04 23:41:44.464952 n-d-860284-1 devstack@n-api.service[134102]: X-Identity-Status: Confirmed Oct 04 23:41:44.464952 n-d-860284-1 devstack@n-api.service[134102]: X-Is-Admin-Project: True Oct 04 23:41:44.464952 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Id: default Oct 04 23:41:44.464952 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Domain-Name: Default Oct 04 23:41:44.464952 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Id: 938498ad9e794c2e8e95e9fafdd80259 Oct 04 23:41:44.464952 n-d-860284-1 devstack@n-api.service[134102]: X-Project-Name: tempest-TestSnapshotPattern-51446606 Oct 04 23:41:44.464952 n-d-860284-1 devstack@n-api.service[134102]: X-Role: reader,member Oct 04 23:41:44.464952 n-d-860284-1 devstack@n-api.service[134102]: X-Roles: reader,member Oct 04 23:41:44.464952 n-d-860284-1 devstack@n-api.service[134102]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/938498ad9e794c2e8e95e9fafdd80259"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_938498ad9e794c2e8e95e9fafdd80259", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/938498ad9e794c2e8e95e9fafdd80259"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/938498ad9e794c2e8e95e9fafdd80259"}]}] Oct 04 23:41:44.464952 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant: tempest-TestSnapshotPattern-51446606 Oct 04 23:41:44.464952 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Id: 938498ad9e794c2e8e95e9fafdd80259 Oct 04 23:41:44.464952 n-d-860284-1 devstack@n-api.service[134102]: X-Tenant-Name: tempest-TestSnapshotPattern-51446606 Oct 04 23:41:44.464952 n-d-860284-1 devstack@n-api.service[134102]: X-User: tempest-TestSnapshotPattern-51446606-project Oct 04 23:41:44.464952 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Id: default Oct 04 23:41:44.464952 n-d-860284-1 devstack@n-api.service[134102]: X-User-Domain-Name: Default Oct 04 23:41:44.464952 n-d-860284-1 devstack@n-api.service[134102]: X-User-Id: 3dc44cc49a37432cb1eb70628f29e2f9 Oct 04 23:41:44.464952 n-d-860284-1 devstack@n-api.service[134102]: X-User-Name: tempest-TestSnapshotPattern-51446606-project Oct 04 23:41:44.464952 n-d-860284-1 devstack@n-api.service[134102]: method: > Oct 04 23:41:44.464952 n-d-860284-1 devstack@n-api.service[134102]: exception: Instance b2eb9de4-5509-44c7-b987-4361d3672fc7 could not be found. Oct 04 23:41:44.464952 n-d-860284-1 devstack@n-api.service[134102]: action_args: {'id': 'b2eb9de4-5509-44c7-b987-4361d3672fc7'} Oct 04 23:41:44.464952 n-d-860284-1 devstack@n-api.service[134102]: {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 23:41:44.464952 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 23:41:44.464952 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 23:41:44.464952 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 23:41:44.464952 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 23:41:44.464952 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 23:41:44.464952 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 23:41:44.464952 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 23:41:44.464952 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 23:41:44.464952 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 23:41:44.464952 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2eb9de4-5509-44c7-b987-4361d3672fc7 could not be found. Oct 04 23:41:44.464952 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 23:41:44.464952 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 23:41:44.464952 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 23:41:44.464952 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 23:41:44.464952 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 23:41:44.464952 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 23:41:44.464952 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 23:41:44.464952 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 23:41:44.464952 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 23:41:44.464952 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 23:41:44.464952 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 23:41:44.464952 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 23:41:44.464952 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 23:41:44.464952 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 23:41:44.464952 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 23:41:44.464952 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 23:41:44.464952 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2eb9de4-5509-44c7-b987-4361d3672fc7 could not be found. Oct 04 23:41:44.464952 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 23:41:44.464952 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 23:41:44.464952 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 23:41:44.471220 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 23:41:44.471220 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 23:41:44.471220 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 23:41:44.471220 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 23:41:44.471220 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 23:41:44.471220 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2eb9de4-5509-44c7-b987-4361d3672fc7 could not be found. Oct 04 23:41:44.471220 n-d-860284-1 devstack@n-api.service[134102]: ERROR nova.api.openstack.wsgi Oct 04 23:41:44.471220 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-ebe86d5b-06af-4141-b6d4-d878aa2777f8 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Returning 404 to user: Instance b2eb9de4-5509-44c7-b987-4361d3672fc7 could not be found. {{(pid=134102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 23:41:44.471220 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-ebe86d5b-06af-4141-b6d4-d878aa2777f8 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] 10.222.0.43 "GET /compute/v2.1/servers/b2eb9de4-5509-44c7-b987-4361d3672fc7" status: 404 len: 111 microversion: 2.1 time: 0.030999 Oct 04 23:41:44.471220 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3684/8185] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:41:44 2022] GET /compute/v2.1/servers/b2eb9de4-5509-44c7-b987-4361d3672fc7 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 23:41:45.812895 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-538cb835-9a52-4d50-a6fa-19cd1c242bd1 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:41:45.813569 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-f6e3bbcc-53df-4fe9-adaa-de3da51be0f0 req-b19b32d8-a33d-43f7-9327-a7499149c7f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8db1c9d3-f2d1-450e-acaa-6398122b01b5", "tag": "7cddf58d-1ced-4237-ac44-c31aa22bf240"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 23:41:45.813962 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-538cb835-9a52-4d50-a6fa-19cd1c242bd1 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] [instance: 8db1c9d3-f2d1-450e-acaa-6398122b01b5] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:41:45.820243 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-538cb835-9a52-4d50-a6fa-19cd1c242bd1 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:41:45.821207 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-538cb835-9a52-4d50-a6fa-19cd1c242bd1 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:41:45.821703 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-538cb835-9a52-4d50-a6fa-19cd1c242bd1 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:41:45.822476 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-538cb835-9a52-4d50-a6fa-19cd1c242bd1 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:41:45.822952 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-538cb835-9a52-4d50-a6fa-19cd1c242bd1 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:41:45.823396 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-538cb835-9a52-4d50-a6fa-19cd1c242bd1 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:41:45.825959 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-f6e3bbcc-53df-4fe9-adaa-de3da51be0f0 req-b19b32d8-a33d-43f7-9327-a7499149c7f1 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:41:45.826580 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-f6e3bbcc-53df-4fe9-adaa-de3da51be0f0 req-b19b32d8-a33d-43f7-9327-a7499149c7f1 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:41:45.827108 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-f6e3bbcc-53df-4fe9-adaa-de3da51be0f0 req-b19b32d8-a33d-43f7-9327-a7499149c7f1 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:41:45.838040 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-f6e3bbcc-53df-4fe9-adaa-de3da51be0f0 req-b19b32d8-a33d-43f7-9327-a7499149c7f1 service nova] Creating event network-changed:7cddf58d-1ced-4237-ac44-c31aa22bf240 for instance 8db1c9d3-f2d1-450e-acaa-6398122b01b5 on n-h1-860284-1 Oct 04 23:41:45.844327 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-f6e3bbcc-53df-4fe9-adaa-de3da51be0f0 req-b19b32d8-a33d-43f7-9327-a7499149c7f1 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034627 Oct 04 23:41:45.845266 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3685/8186] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 23:41:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 23:41:45.855807 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-538cb835-9a52-4d50-a6fa-19cd1c242bd1 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] [instance: 8db1c9d3-f2d1-450e-acaa-6398122b01b5] Going to try to terminate instance {{(pid=134101) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 23:41:45.952353 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-538cb835-9a52-4d50-a6fa-19cd1c242bd1 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] 10.222.0.43 "DELETE /compute/v2.1/servers/8db1c9d3-f2d1-450e-acaa-6398122b01b5" status: 204 len: 0 microversion: 2.1 time: 0.144570 Oct 04 23:41:45.954029 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4502/8187] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Oct 4 23:41:45 2022] DELETE /compute/v2.1/servers/8db1c9d3-f2d1-450e-acaa-6398122b01b5 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 23:41:45.963723 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-8693a2db-40d0-4a42-b8c2-d36a6b2690c4 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Calling method '>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:41:45.964720 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.compute.api [None req-8693a2db-40d0-4a42-b8c2-d36a6b2690c4 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] [instance: 8db1c9d3-f2d1-450e-acaa-6398122b01b5] Fetching instance by UUID {{(pid=134102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:41:45.974689 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8693a2db-40d0-4a42-b8c2-d36a6b2690c4 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:41:45.975928 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8693a2db-40d0-4a42-b8c2-d36a6b2690c4 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:41:45.976577 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8693a2db-40d0-4a42-b8c2-d36a6b2690c4 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:41:45.978070 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8693a2db-40d0-4a42-b8c2-d36a6b2690c4 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:41:45.978787 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8693a2db-40d0-4a42-b8c2-d36a6b2690c4 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:41:45.979870 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [None req-8693a2db-40d0-4a42-b8c2-d36a6b2690c4 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:41:46.121184 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.policy [None req-8693a2db-40d0-4a42-b8c2-d36a6b2690c4 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc44cc49a37432cb1eb70628f29e2f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938498ad9e794c2e8e95e9fafdd80259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:41:46.129726 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-8693a2db-40d0-4a42-b8c2-d36a6b2690c4 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] 10.222.0.43 "GET /compute/v2.1/servers/8db1c9d3-f2d1-450e-acaa-6398122b01b5" status: 200 len: 1686 microversion: 2.1 time: 0.171159 Oct 04 23:41:46.130326 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3686/8188] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:41:45 2022] GET /compute/v2.1/servers/8db1c9d3-f2d1-450e-acaa-6398122b01b5 => generated 1686 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 23:41:47.154457 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-c9393390-93f5-4000-a377-9c7536cb6380 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:41:47.155188 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-c9393390-93f5-4000-a377-9c7536cb6380 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] [instance: 8db1c9d3-f2d1-450e-acaa-6398122b01b5] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:41:47.162350 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c9393390-93f5-4000-a377-9c7536cb6380 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:41:47.162916 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c9393390-93f5-4000-a377-9c7536cb6380 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:41:47.163365 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c9393390-93f5-4000-a377-9c7536cb6380 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:41:47.164111 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c9393390-93f5-4000-a377-9c7536cb6380 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:41:47.164629 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c9393390-93f5-4000-a377-9c7536cb6380 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:41:47.165068 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-c9393390-93f5-4000-a377-9c7536cb6380 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:41:47.307328 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.policy [None req-c9393390-93f5-4000-a377-9c7536cb6380 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc44cc49a37432cb1eb70628f29e2f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938498ad9e794c2e8e95e9fafdd80259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134101) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:41:47.316197 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-c9393390-93f5-4000-a377-9c7536cb6380 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] 10.222.0.43 "GET /compute/v2.1/servers/8db1c9d3-f2d1-450e-acaa-6398122b01b5" status: 200 len: 1567 microversion: 2.1 time: 0.166171 Oct 04 23:41:47.317070 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4503/8189] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:41:47 2022] GET /compute/v2.1/servers/8db1c9d3-f2d1-450e-acaa-6398122b01b5 => generated 1567 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:41:47.575988 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [req-4fd14bdc-41fe-4d28-9a55-311e386a198b req-17a39ff3-1008-46cc-a584-f9dece6a4994 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8db1c9d3-f2d1-450e-acaa-6398122b01b5", "name": "network-vif-deleted", "tag": "7cddf58d-1ced-4237-ac44-c31aa22bf240"}]} {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 23:41:47.587069 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-4fd14bdc-41fe-4d28-9a55-311e386a198b req-17a39ff3-1008-46cc-a584-f9dece6a4994 service nova] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:41:47.587563 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-4fd14bdc-41fe-4d28-9a55-311e386a198b req-17a39ff3-1008-46cc-a584-f9dece6a4994 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:41:47.588004 n-d-860284-1 devstack@n-api.service[134102]: DEBUG oslo_concurrency.lockutils [req-4fd14bdc-41fe-4d28-9a55-311e386a198b req-17a39ff3-1008-46cc-a584-f9dece6a4994 service nova] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:41:47.600117 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.compute.server_external_events [req-4fd14bdc-41fe-4d28-9a55-311e386a198b req-17a39ff3-1008-46cc-a584-f9dece6a4994 service nova] Creating event network-vif-deleted:7cddf58d-1ced-4237-ac44-c31aa22bf240 for instance 8db1c9d3-f2d1-450e-acaa-6398122b01b5 on n-h1-860284-1 Oct 04 23:41:47.607108 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [req-4fd14bdc-41fe-4d28-9a55-311e386a198b req-17a39ff3-1008-46cc-a584-f9dece6a4994 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085702 Oct 04 23:41:47.607722 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3687/8190] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Oct 4 23:41:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 23:41:48.341189 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-19459203-1d22-4f67-8eec-f92a28e4a5d8 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Calling method '>' {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:41:48.341928 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.compute.api [None req-19459203-1d22-4f67-8eec-f92a28e4a5d8 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] [instance: 8db1c9d3-f2d1-450e-acaa-6398122b01b5] Fetching instance by UUID {{(pid=134101) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:41:48.348762 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-19459203-1d22-4f67-8eec-f92a28e4a5d8 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:41:48.349259 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-19459203-1d22-4f67-8eec-f92a28e4a5d8 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:41:48.349716 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-19459203-1d22-4f67-8eec-f92a28e4a5d8 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:41:48.350449 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-19459203-1d22-4f67-8eec-f92a28e4a5d8 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Acquiring lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:41:48.350918 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-19459203-1d22-4f67-8eec-f92a28e4a5d8 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:41:48.351358 n-d-860284-1 devstack@n-api.service[134101]: DEBUG oslo_concurrency.lockutils [None req-19459203-1d22-4f67-8eec-f92a28e4a5d8 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Lock "1297bf18-d456-4d7b-91a9-0a07f1cafd2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:41:48.364617 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.wsgi [None req-19459203-1d22-4f67-8eec-f92a28e4a5d8 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] HTTP exception thrown: Instance 8db1c9d3-f2d1-450e-acaa-6398122b01b5 could not be found. Oct 04 23:41:48.366315 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-19459203-1d22-4f67-8eec-f92a28e4a5d8 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Request method failure captured: Oct 04 23:41:48.366315 n-d-860284-1 devstack@n-api.service[134101]: request: GET /compute/v2.1/servers/8db1c9d3-f2d1-450e-acaa-6398122b01b5 HTTP/1.1 Oct 04 23:41:48.366315 n-d-860284-1 devstack@n-api.service[134101]: Accept: application/json Oct 04 23:41:48.366315 n-d-860284-1 devstack@n-api.service[134101]: Accept-Encoding: identity Oct 04 23:41:48.366315 n-d-860284-1 devstack@n-api.service[134101]: Connection: close Oct 04 23:41:48.366315 n-d-860284-1 devstack@n-api.service[134101]: Content-Length: 0 Oct 04 23:41:48.366315 n-d-860284-1 devstack@n-api.service[134101]: Content-Type: application/json Oct 04 23:41:48.366315 n-d-860284-1 devstack@n-api.service[134101]: Host: 10.222.0.43 Oct 04 23:41:48.366315 n-d-860284-1 devstack@n-api.service[134101]: Openstack-System-Scope: None Oct 04 23:41:48.366315 n-d-860284-1 devstack@n-api.service[134101]: User-Agent: python-urllib3/1.26.12 Oct 04 23:41:48.366315 n-d-860284-1 devstack@n-api.service[134101]: X-Auth-Token: gAAAAABjPMM8TibtHWW4-RTvmhkx0ScuigVkjrh4rJ-kCEc4seGbyVMSb6vBC7GElin9MR4P4pUuG-ywigBgEcsm7D0jkY5RXOWJUAOUFCxQDyMhknDWAEhGEqrJPvQSlDjHNRGU3G-nOTxB7dfUiqr9Sxsz5Xf9y6-TbNnYxbUSp-piv2EV3C8 Oct 04 23:41:48.366315 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Id: None Oct 04 23:41:48.366315 n-d-860284-1 devstack@n-api.service[134101]: X-Domain-Name: None Oct 04 23:41:48.366315 n-d-860284-1 devstack@n-api.service[134101]: X-Identity-Status: Confirmed Oct 04 23:41:48.366315 n-d-860284-1 devstack@n-api.service[134101]: X-Is-Admin-Project: True Oct 04 23:41:48.366315 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Id: default Oct 04 23:41:48.366315 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Domain-Name: Default Oct 04 23:41:48.366315 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Id: 938498ad9e794c2e8e95e9fafdd80259 Oct 04 23:41:48.366315 n-d-860284-1 devstack@n-api.service[134101]: X-Project-Name: tempest-TestSnapshotPattern-51446606 Oct 04 23:41:48.366315 n-d-860284-1 devstack@n-api.service[134101]: X-Role: reader,member Oct 04 23:41:48.366315 n-d-860284-1 devstack@n-api.service[134101]: X-Roles: reader,member Oct 04 23:41:48.366315 n-d-860284-1 devstack@n-api.service[134101]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/938498ad9e794c2e8e95e9fafdd80259"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_938498ad9e794c2e8e95e9fafdd80259", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/938498ad9e794c2e8e95e9fafdd80259"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/938498ad9e794c2e8e95e9fafdd80259"}]}] Oct 04 23:41:48.366315 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant: tempest-TestSnapshotPattern-51446606 Oct 04 23:41:48.366315 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Id: 938498ad9e794c2e8e95e9fafdd80259 Oct 04 23:41:48.366315 n-d-860284-1 devstack@n-api.service[134101]: X-Tenant-Name: tempest-TestSnapshotPattern-51446606 Oct 04 23:41:48.366315 n-d-860284-1 devstack@n-api.service[134101]: X-User: tempest-TestSnapshotPattern-51446606-project Oct 04 23:41:48.366315 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Id: default Oct 04 23:41:48.366315 n-d-860284-1 devstack@n-api.service[134101]: X-User-Domain-Name: Default Oct 04 23:41:48.366315 n-d-860284-1 devstack@n-api.service[134101]: X-User-Id: 3dc44cc49a37432cb1eb70628f29e2f9 Oct 04 23:41:48.366315 n-d-860284-1 devstack@n-api.service[134101]: X-User-Name: tempest-TestSnapshotPattern-51446606-project Oct 04 23:41:48.366315 n-d-860284-1 devstack@n-api.service[134101]: method: > Oct 04 23:41:48.366315 n-d-860284-1 devstack@n-api.service[134101]: exception: Instance 8db1c9d3-f2d1-450e-acaa-6398122b01b5 could not be found. Oct 04 23:41:48.366315 n-d-860284-1 devstack@n-api.service[134101]: action_args: {'id': '8db1c9d3-f2d1-450e-acaa-6398122b01b5'} Oct 04 23:41:48.366315 n-d-860284-1 devstack@n-api.service[134101]: {{(pid=134101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 23:41:48.366315 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 23:41:48.366315 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 23:41:48.366315 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 23:41:48.366315 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 23:41:48.366315 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 23:41:48.366315 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 23:41:48.366315 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 23:41:48.366315 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 23:41:48.366315 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 23:41:48.366315 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8db1c9d3-f2d1-450e-acaa-6398122b01b5 could not be found. Oct 04 23:41:48.366315 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 23:41:48.366315 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 23:41:48.366315 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 23:41:48.366315 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 23:41:48.366315 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 23:41:48.366315 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 23:41:48.366315 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 23:41:48.366315 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 23:41:48.366315 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 23:41:48.366315 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 23:41:48.366315 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 23:41:48.366315 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 23:41:48.366315 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 23:41:48.366315 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 23:41:48.366315 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 23:41:48.366315 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 23:41:48.366315 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8db1c9d3-f2d1-450e-acaa-6398122b01b5 could not be found. Oct 04 23:41:48.366315 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 23:41:48.366315 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 23:41:48.366315 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 23:41:48.372155 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 23:41:48.372155 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 23:41:48.372155 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 23:41:48.372155 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 23:41:48.372155 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 23:41:48.372155 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8db1c9d3-f2d1-450e-acaa-6398122b01b5 could not be found. Oct 04 23:41:48.372155 n-d-860284-1 devstack@n-api.service[134101]: ERROR nova.api.openstack.wsgi Oct 04 23:41:48.372155 n-d-860284-1 devstack@n-api.service[134101]: DEBUG nova.api.openstack.wsgi [None req-19459203-1d22-4f67-8eec-f92a28e4a5d8 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Returning 404 to user: Instance 8db1c9d3-f2d1-450e-acaa-6398122b01b5 could not be found. {{(pid=134101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 23:41:48.372155 n-d-860284-1 devstack@n-api.service[134101]: INFO nova.api.openstack.requestlog [None req-19459203-1d22-4f67-8eec-f92a28e4a5d8 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] 10.222.0.43 "GET /compute/v2.1/servers/8db1c9d3-f2d1-450e-acaa-6398122b01b5" status: 404 len: 111 microversion: 2.1 time: 0.030907 Oct 04 23:41:48.372155 n-d-860284-1 devstack@n-api.service[134101]: [pid: 134101|app: 0|req: 4504/8191] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Oct 4 23:41:48 2022] GET /compute/v2.1/servers/8db1c9d3-f2d1-450e-acaa-6398122b01b5 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 23:41:48.533921 n-d-860284-1 devstack@n-api.service[134102]: DEBUG nova.api.openstack.wsgi [None req-ea69908a-42a1-4f0d-b672-f9db134aff17 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] Calling method '.version_select at 0x7fbb2e958820>' {{(pid=134102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:41:48.538331 n-d-860284-1 devstack@n-api.service[134102]: ERROR oslo.messaging._drivers.impl_rabbit [None req-ea69908a-42a1-4f0d-b672-f9db134aff17 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] [cca57954-a89d-4bbd-8f41-b6cb754a5397] AMQP server on 10.222.0.43:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 23:41:49.548031 n-d-860284-1 devstack@n-api.service[134102]: INFO oslo.messaging._drivers.impl_rabbit [None req-ea69908a-42a1-4f0d-b672-f9db134aff17 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] [cca57954-a89d-4bbd-8f41-b6cb754a5397] Reconnected to AMQP server on 10.222.0.43:5672 via [amqp] client with port 42006. Oct 04 23:41:49.568717 n-d-860284-1 devstack@n-api.service[134102]: INFO nova.api.openstack.requestlog [None req-ea69908a-42a1-4f0d-b672-f9db134aff17 tempest-TestSnapshotPattern-51446606 tempest-TestSnapshotPattern-51446606-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1850706400" status: 202 len: 0 microversion: 2.1 time: 1.038933 Oct 04 23:41:49.569362 n-d-860284-1 devstack@n-api.service[134102]: [pid: 134102|app: 0|req: 3688/8192] 10.222.0.43 () {58 vars in 1257 bytes} [Tue Oct 4 23:41:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1850706400 => generated 0 bytes in 1041 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)